-- Logs begin at Fri 2022-09-23 03:39:16 UTC, end at Fri 2022-09-23 06:19:38 UTC. -- Sep 23 04:20:21.473707 n-d-846463-3 systemd[1]: Starting Devstack devstack@n-api.service... Sep 23 04:20:21.483023 n-d-846463-3 devstack@n-api.service[106610]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 23 04:20:21.485003 n-d-846463-3 devstack@n-api.service[106610]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 23 04:20:21 2022] *** Sep 23 04:20:21.485003 n-d-846463-3 devstack@n-api.service[106610]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 23 04:20:21.485003 n-d-846463-3 devstack@n-api.service[106610]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 23 04:20:21.485003 n-d-846463-3 devstack@n-api.service[106610]: nodename: n-d-846463-3 Sep 23 04:20:21.485003 n-d-846463-3 devstack@n-api.service[106610]: machine: x86_64 Sep 23 04:20:21.485003 n-d-846463-3 devstack@n-api.service[106610]: clock source: unix Sep 23 04:20:21.485003 n-d-846463-3 devstack@n-api.service[106610]: pcre jit disabled Sep 23 04:20:21.485003 n-d-846463-3 devstack@n-api.service[106610]: detected number of CPU cores: 4 Sep 23 04:20:21.485003 n-d-846463-3 devstack@n-api.service[106610]: current working directory: / Sep 23 04:20:21.485003 n-d-846463-3 devstack@n-api.service[106610]: detected binary path: /usr/bin/uwsgi-core Sep 23 04:20:21.485661 n-d-846463-3 devstack@n-api.service[106610]: your processes number limit is 47680 Sep 23 04:20:21.485661 n-d-846463-3 devstack@n-api.service[106610]: your memory page size is 4096 bytes Sep 23 04:20:21.485661 n-d-846463-3 devstack@n-api.service[106610]: detected max file descriptor number: 2048 Sep 23 04:20:21.485661 n-d-846463-3 devstack@n-api.service[106610]: lock engine: pthread robust mutexes Sep 23 04:20:21.485661 n-d-846463-3 devstack@n-api.service[106610]: thunder lock: enabled Sep 23 04:20:21.485661 n-d-846463-3 devstack@n-api.service[106610]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 23 04:20:21.485661 n-d-846463-3 devstack@n-api.service[106610]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 23 04:20:21.524222 n-d-846463-3 devstack@n-api.service[106610]: Python main interpreter initialized at 0x5634e088b9c0 Sep 23 04:20:21.524222 n-d-846463-3 devstack@n-api.service[106610]: python threads support enabled Sep 23 04:20:21.524222 n-d-846463-3 devstack@n-api.service[106610]: your server socket listen backlog is limited to 100 connections Sep 23 04:20:21.524464 n-d-846463-3 devstack@n-api.service[106610]: your mercy for graceful operations on workers is 90 seconds Sep 23 04:20:21.524540 n-d-846463-3 devstack@n-api.service[106610]: mapped 403077 bytes (393 KB) for 2 cores Sep 23 04:20:21.524614 n-d-846463-3 devstack@n-api.service[106610]: *** Operational MODE: preforking *** Sep 23 04:20:21.524877 n-d-846463-3 devstack@n-api.service[106610]: *** uWSGI is running in multiple interpreter mode *** Sep 23 04:20:21.524877 n-d-846463-3 devstack@n-api.service[106610]: spawned uWSGI master process (pid: 106610) Sep 23 04:20:21.525055 n-d-846463-3 systemd[1]: Started Devstack devstack@n-api.service. Sep 23 04:20:21.525773 n-d-846463-3 devstack@n-api.service[106610]: spawned uWSGI worker 1 (pid: 106611, cores: 1) Sep 23 04:20:21.525907 n-d-846463-3 devstack@n-api.service[106610]: spawned uWSGI worker 2 (pid: 106612, cores: 1) Sep 23 04:20:21.526083 n-d-846463-3 devstack@n-api.service[106610]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 23 04:20:22.198868 n-d-846463-3 devstack@n-api.service[106612]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 23 04:20:22.204685 n-d-846463-3 devstack@n-api.service[106611]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 23 04:20:23.286555 n-d-846463-3 devstack@n-api.service[106611]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 23 04:20:23.286555 n-d-846463-3 devstack@n-api.service[106611]: from cryptography.utils import int_from_bytes Sep 23 04:20:23.287801 n-d-846463-3 devstack@n-api.service[106611]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 23 04:20:23.287801 n-d-846463-3 devstack@n-api.service[106611]: from cryptography.utils import int_from_bytes Sep 23 04:20:23.290126 n-d-846463-3 devstack@n-api.service[106612]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 23 04:20:23.290126 n-d-846463-3 devstack@n-api.service[106612]: from cryptography.utils import int_from_bytes Sep 23 04:20:23.290552 n-d-846463-3 devstack@n-api.service[106612]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 23 04:20:23.290552 n-d-846463-3 devstack@n-api.service[106612]: from cryptography.utils import int_from_bytes Sep 23 04:20:25.750079 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 23 04:20:25.750688 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 23 04:20:25.750850 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 23 04:20:25.751209 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 23 04:20:25.751461 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 23 04:20:25.751839 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.752162 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.752307 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 23 04:20:25.752731 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.752828 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 23 04:20:25.752927 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.753098 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 23 04:20:25.753198 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.753420 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.753505 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 23 04:20:25.753714 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 23 04:20:25.753816 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.754049 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.754148 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.754376 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.754480 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.754636 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.754758 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.754948 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.755084 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.755270 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-846463-3 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.755419 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.755589 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.755734 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.755917 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.756082 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.756225 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.756405 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.756540 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.756737 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.756830 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.757004 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.757147 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.757321 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.757450 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.757647 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-846463-3 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.757964 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.758083 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.758295 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.758420 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.758610 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.758732 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.758928 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.759055 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.759233 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.759355 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.759557 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.759658 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.759866 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.759965 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.760206 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.760378 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.760496 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.760691 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.760862 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.761014 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.761162 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.761309 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.761487 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-846463-3 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.761647 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.761802 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.761989 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.762139 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.762304 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.762451 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.762630 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.762855 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.762957 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.763165 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.763270 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.763474 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.763567 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.763791 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.763936 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-846463-3 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.764109 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.764258 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.764415 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.764654 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.764754 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.764882 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.765040 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.765294 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.765390 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.765608 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.765695 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.765941 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.766048 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.766278 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.766369 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.766570 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.766658 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.766884 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.766976 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.767186 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.767279 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.767488 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.767576 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.767737 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.767833 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.768042 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.768140 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.768359 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.768452 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.768679 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.768764 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.768995 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.769097 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.769244 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.769332 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.769494 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.769624 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.769808 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.769959 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.770145 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.770239 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.770717 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.770815 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.771022 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.771118 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.771326 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.771943 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.772148 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.772247 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.772454 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.772551 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.772719 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.772806 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.773047 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.773143 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.773349 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.773442 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.773664 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.773807 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.773997 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.774100 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.774309 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.774395 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.774613 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.774700 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.774921 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.775022 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.775231 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.775318 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.775540 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.775642 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.775842 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.775934 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.776160 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.776251 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.776475 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.776572 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.776781 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.776878 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.777093 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.777186 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.777411 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.777506 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.777715 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.777803 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.778040 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.778141 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.778347 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.778434 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.778664 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.778758 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.779002 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.779095 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.779303 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.779404 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.779552 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.779734 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.779850 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.780067 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.780167 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.780382 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.780482 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.780694 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.780795 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.781001 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.781095 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.781322 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.781464 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.781620 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.781706 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.781946 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.782037 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.782222 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.782309 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.782529 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.782630 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.782831 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.782929 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.783135 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.783222 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.783437 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.783531 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.783737 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.783835 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.784040 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.784137 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.784341 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.784434 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.784639 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.784738 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.784949 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.785035 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.785259 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.785346 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.785560 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.785658 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.785863 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.785972 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.786190 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.786292 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.786494 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.786658 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.786803 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.786888 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.787170 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.787789 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.787987 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.788148 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.788309 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.788470 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.788632 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.788776 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.788944 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.789081 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.789253 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.789399 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.789562 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.789704 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.789871 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.790031 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.790215 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.790348 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.790524 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.790646 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.790835 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.790940 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.791160 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.791254 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.791468 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.791568 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.791777 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.791864 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.792095 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.792182 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.792405 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.792492 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.792703 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.792795 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.793003 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.793089 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.793301 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.793392 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.793600 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.793687 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.793935 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.794072 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.794228 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.794325 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.794537 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.794623 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.794839 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.794925 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.795144 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.795241 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.795441 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.795526 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.795745 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.795829 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.796050 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.796147 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.796354 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.796447 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.796656 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.796753 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.796974 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.797072 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.797297 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.797384 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.797610 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.797703 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.797947 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.798039 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.798260 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.798347 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.798569 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.798665 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:20:25.798891 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.798986 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.799206 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.799299 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.799513 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.799599 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.799820 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.799907 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.800136 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.800221 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.800451 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.800537 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.800779 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.800915 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.801093 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.801178 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.801406 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.801504 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.801722 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.801821 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.802051 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.802140 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.802367 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.802464 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.802702 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.802790 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.803032 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.803116 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.803340 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.803443 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.803671 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.803764 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.803995 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.804082 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.804302 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.804399 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.804622 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.804708 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.804938 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.805031 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.805243 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.805351 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.805550 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.805637 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.805856 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.805963 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.806213 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.806312 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.806521 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.806614 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.806830 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.806916 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.807146 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.807235 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.807454 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.807548 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.807771 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.807865 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.808080 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.808174 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.808388 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.808483 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.808695 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.808782 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.809006 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.809094 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.809318 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.809406 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.809640 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.809732 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.809975 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.810067 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.810290 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.810376 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.810603 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.810689 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.810940 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.811041 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.811226 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.811312 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.811534 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.811627 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.811843 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.811934 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.812152 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.812237 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.812453 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.812546 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.812754 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.812841 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.813056 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.813143 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.813365 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.813461 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.813668 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.813754 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.814011 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.814100 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.814337 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.814438 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.814642 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.814729 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.814955 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.815039 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.815259 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.815344 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.815563 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.815655 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.815868 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.815959 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.816175 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.816261 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.816476 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.816562 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.816783 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.816869 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.817089 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.817175 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.817389 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.817481 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.817706 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.817794 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.818041 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.818144 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.818367 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.818460 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.818682 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.818839 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.818996 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.819304 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.819389 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.819619 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.819907 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.820001 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.820224 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.820442 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.820534 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.820847 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.821024 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.821232 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.821444 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.821534 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.821760 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.821909 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.822104 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.822577 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.822665 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.822906 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.823035 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.823227 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.823359 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.823553 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.823850 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.823936 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.824179 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.824273 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.824507 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.824699 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.824825 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.825141 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.825283 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.825481 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.825815 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.825934 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.826230 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.826329 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.826570 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.826655 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.826894 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.826981 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.827209 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.827295 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.827517 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.827614 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.827830 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.827925 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.828138 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.828222 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.828445 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.828538 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.828749 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.828840 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.829054 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.829139 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.829359 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.829453 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.829662 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.829748 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.829989 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.830079 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.830299 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.830399 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.830603 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.830687 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.830909 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.830995 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.831285 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.831384 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.831589 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.831675 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.831893 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.832027 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.832236 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.832324 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.832573 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.832666 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.832894 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.832986 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.833361 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.833486 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.833710 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.833844 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.834583 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.834742 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.834899 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.835076 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.835260 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.835397 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.835527 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.835722 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.835842 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.836040 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.836164 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.836359 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.836476 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.836677 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.836797 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.836993 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.837109 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.837321 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.837432 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.837639 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.837726 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.837988 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.838079 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.838305 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.838393 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.838631 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.838720 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.838946 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.839033 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.839271 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.839357 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.839581 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.839669 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.839900 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.839986 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.840229 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.840394 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.840543 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.840641 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.840852 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.840939 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.841175 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.841277 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.841470 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.841568 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.841779 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.841865 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.842119 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.842222 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.842431 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.842517 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.842745 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.842832 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.843049 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.843144 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.843368 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.843453 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.843673 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.843757 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.843991 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.844090 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.844294 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.844388 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.844607 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.844693 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.844920 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.845014 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.845239 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.845325 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.845546 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.845630 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.845860 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.846010 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.846201 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.846288 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.846512 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.846598 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.846820 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.846908 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.847130 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.847226 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.847441 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.847528 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.847739 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.847826 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.848049 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.848135 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.848360 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.848462 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.848667 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.848752 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.848973 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.849065 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.849275 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.849369 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.849639 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.850268 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.850478 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.850577 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.850808 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.850951 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.851096 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.851190 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.851407 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.851518 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.851720 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.851830 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.852025 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.852121 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.852330 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.852469 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.852646 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.852742 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.852948 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.853033 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.853253 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.853347 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.853575 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.853668 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.853918 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.854008 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.854206 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.854294 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.854514 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.854602 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.854818 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.854904 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.855135 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.855221 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.855443 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.855541 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.855745 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.855876 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.856049 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.856152 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.856368 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.856454 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.856679 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.856773 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.856989 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.857083 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.857297 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.857382 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.857605 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.857691 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.857940 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.858047 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.858256 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.858343 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.858562 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.858656 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.858873 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.858968 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.859180 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.859264 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.859489 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.859576 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.859799 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.859885 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.860115 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.860211 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.860424 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.860509 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.860733 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.860827 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.861039 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.861132 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.861346 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.861460 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.861656 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.861762 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.861992 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.862090 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.862306 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.862557 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.862658 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.862886 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.862972 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.863199 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.863285 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.863514 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.863772 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.863860 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.864120 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.864217 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.864443 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.864543 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.864773 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.864916 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.865082 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.865167 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.865410 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.865575 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.865718 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.865806 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.866043 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.866133 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.866346 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.866450 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.866656 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.866758 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.866957 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.867051 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.867258 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.867353 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.867559 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.867658 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.867866 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.867962 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.868166 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.868260 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.868465 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.868565 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.868765 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.868858 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.869064 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.869151 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.869376 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.869472 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.869678 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.869765 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.870011 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.870102 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.870319 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.870407 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.870634 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.870719 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.870937 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.871033 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.871238 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.871325 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.871537 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.871627 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.871837 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.871931 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.872161 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.872258 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.872463 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.872549 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.872768 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.872854 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.873076 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.873165 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.873421 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.873509 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.873720 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.873818 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.874046 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.874135 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.874368 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.874466 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.874669 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.874773 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.874970 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.875057 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.875270 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.875357 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.875575 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.875672 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.875880 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.875966 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.876177 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.876264 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.876484 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.876580 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.876790 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.876877 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.877096 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.877181 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.877399 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.877493 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.877694 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.877787 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.878018 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.878123 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.878320 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.878408 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.878631 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.878716 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.878935 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.879020 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.879237 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.879324 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.879537 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.879623 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.879842 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.879928 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.880155 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.880265 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.880455 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.880547 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.880765 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.880918 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.881085 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.881173 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.881398 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.881529 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.881698 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.881799 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.882019 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.882107 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.882320 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.882414 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.882627 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.882727 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.882933 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.883020 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.883233 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.883318 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.883551 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.883648 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.883859 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.883944 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.884159 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.884245 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.884457 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.884545 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.884762 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.884847 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.885061 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.885146 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.885359 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.885447 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.885665 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.885751 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.885998 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.886103 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.886306 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.886395 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.886604 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.886697 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.886912 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.887006 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.887213 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.887301 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.887515 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.887601 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.887818 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.887914 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.888124 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.888211 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.888421 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.888511 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.888719 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.888814 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.889019 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.889106 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.889319 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.889411 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.889618 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.889713 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.889943 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.890043 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.890254 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.890348 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.890553 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.890648 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.890855 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.890949 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.891157 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.891243 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.891474 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.891604 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.891782 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.891879 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.892093 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.892186 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.892401 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.892488 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.892726 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.892811 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.893042 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.893128 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.893350 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.893437 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.893659 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.893744 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.893990 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.894080 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.894292 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.894380 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.894605 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.894692 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.894916 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.895010 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.895226 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.895590 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.895814 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.895899 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.896117 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.896211 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.896963 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.897055 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.897277 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.897363 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.897583 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.897681 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.897905 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.897995 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.898235 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.898322 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.898549 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.898645 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.898851 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.898944 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.899159 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.899247 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.899470 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.899569 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.899778 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.899865 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.900091 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.900177 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.900401 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.900489 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.900713 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.900798 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.901022 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.901107 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.901333 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.901428 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.901645 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.901756 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.901979 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.902074 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.902285 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.902429 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.902595 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.902683 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.902903 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.902997 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.903204 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.903292 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.903511 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.903598 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.903823 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.903918 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.904125 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.904212 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.904434 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.904521 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.904739 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.904835 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.905048 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.905138 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.905352 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.905437 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.905662 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.905761 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.905995 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.906087 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.906311 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.906400 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.906619 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.906708 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.906982 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.907067 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.907294 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.907381 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.907608 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.907696 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.907920 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.908006 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.908222 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.908314 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.908557 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.908643 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.908877 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.908963 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.909196 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.909282 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.909506 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.909594 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.909813 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.909963 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.910138 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.910282 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.910445 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.910599 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.910770 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.910915 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.911072 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.911225 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.911373 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.911532 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.911672 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.911849 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.911989 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.912735 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.912882 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.913051 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.913139 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.913359 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.913552 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.913668 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.913860 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.914020 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.914185 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.914335 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.914595 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.914692 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.914904 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.915072 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.915211 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.915389 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.915530 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.915699 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.915848 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.916118 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.916216 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.916433 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.916520 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.916749 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.916845 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.917056 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.917141 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.917376 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.917462 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.917697 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.917796 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.918027 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.918118 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.918341 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.918427 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.918643 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.918746 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.918964 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.919053 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.919284 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.919378 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.919594 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.919690 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.919910 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.919996 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.920219 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.920305 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.920544 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.920633 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.920870 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.920960 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.921190 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.921277 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.921518 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.921606 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.921824 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.921954 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.922152 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.922278 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.922462 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.922596 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.922766 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.922922 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.923069 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.923250 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.923388 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.923559 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.923689 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.923869 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.923997 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.924189 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.924303 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.924499 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.924595 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.924808 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.924903 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.925134 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.925222 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.925443 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.925537 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.925760 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.925847 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.926109 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.926199 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.926420 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.926512 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.926726 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.926813 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.927034 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.927122 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.927336 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.927425 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.927674 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.927777 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.927983 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.928078 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.928287 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.928374 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.928591 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.928690 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.928894 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.928980 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.929220 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.929307 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.929523 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.929618 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.929841 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.929947 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.930174 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.930267 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.930484 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.930581 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.930792 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.930887 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.931122 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.931208 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.931433 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.931522 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.931747 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.931832 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.932054 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.932140 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.932366 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.932454 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.932685 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.932771 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.932986 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.933072 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.933284 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.933373 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.933590 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.933723 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.933943 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.934111 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.934203 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.934291 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.934497 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.934585 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.934801 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.934897 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.935101 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.935189 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.935401 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.935488 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.935700 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.935799 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.936017 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.936105 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.936317 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.936403 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.936635 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.936734 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.936939 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.937034 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.937241 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.937329 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.937542 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.937638 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.937839 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.937942 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.938203 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.938290 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.938505 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.938594 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.938827 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.938921 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.939133 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.939220 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.939448 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.939536 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.939754 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.939842 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.940064 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.940158 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.940380 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.940468 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.940698 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.940793 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.941009 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.941103 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.941318 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.941411 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.941632 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.941727 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.941959 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.942063 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.942273 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.942368 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.942584 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.942672 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.942898 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.942993 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.943215 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.943434 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.943558 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.943760 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.943856 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.944072 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.944182 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.944382 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.944498 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.944693 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.944818 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.945004 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.945314 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.945405 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.945624 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.945759 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.945957 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.946062 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.946268 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.946355 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.946575 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.946663 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.946900 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.946987 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.947214 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.947300 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.947528 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.947614 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.947844 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.947933 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.948158 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.948246 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.948467 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.948561 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.948779 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.948875 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.949091 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.949179 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.949415 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.949513 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.949738 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.949834 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.950063 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.950165 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.950376 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.950485 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.950693 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.950783 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.951005 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.951092 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.951314 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.951402 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.951621 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.951716 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.951932 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.952028 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.952243 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.952330 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.952551 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.952638 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.952861 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.952960 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.953171 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.953257 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.953479 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.953565 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.953795 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.953914 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.954137 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.954225 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.954457 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.954544 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.954769 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.954856 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.955079 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.955166 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.955393 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.955479 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.955718 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.955903 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.956053 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.956214 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.956379 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.956540 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.956698 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.956861 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.957018 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.957179 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.957338 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.957490 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.957803 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.957906 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.958149 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.958236 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.958451 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.958550 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.958752 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.958838 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.959607 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.959696 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.959915 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.960011 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.960219 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.960306 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.960537 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.960669 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.960844 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.960945 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.961150 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.961237 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.961469 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.961556 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.961775 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.961864 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.962106 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.962324 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.962412 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.962668 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.962774 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.962982 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.963070 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.963303 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.963430 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.963624 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.963786 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.963938 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.964157 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.964245 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.964507 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.964604 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.964836 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.964923 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.965137 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.965224 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.965450 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.965550 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.965759 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.965847 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.966085 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.966175 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.966386 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.966527 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.966695 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.966820 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.967003 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.967089 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.967309 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.967423 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.967603 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.967696 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.967903 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.967997 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.968209 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.968313 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.968512 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.968602 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.968814 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.968901 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.969115 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.969203 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.969422 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.969509 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.969722 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.969809 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.970045 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.970136 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.970349 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.970436 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.970649 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.970746 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.970955 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.971049 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.971258 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.971343 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.971562 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.971657 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.971859 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.971991 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.972165 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.972252 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.972470 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.972567 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.972787 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.972887 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.973084 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.973170 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.973395 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.973528 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.973694 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.973780 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.974014 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.974105 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.974330 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.974430 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.975215 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.975312 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.975522 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.975617 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.975833 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.975929 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.976141 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.976229 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.976446 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.976532 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.976766 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.976860 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.977079 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.977292 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.977407 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.977620 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.977716 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.977965 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.978067 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.978297 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.978384 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.978623 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.978718 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.978927 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.979215 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.979311 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.979516 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.979602 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.979835 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.979923 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.980169 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.980265 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.980445 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.980545 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.980750 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.980838 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.981061 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.981149 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.981366 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.981489 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.981672 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.981828 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.981997 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.982171 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.982303 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.982491 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.982608 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.982808 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.982896 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.983125 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.983227 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.983441 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.983530 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.983757 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.983845 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.984072 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.984168 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.984380 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.984466 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.984692 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.984779 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.985006 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.985110 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.985317 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.985412 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.985628 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.985714 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.985964 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.986069 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.986273 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.986367 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.986580 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.986666 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.986885 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.986968 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.987190 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.987276 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.987502 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.987598 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.987826 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.987915 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.988136 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.988230 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.988437 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.988531 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.988746 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.989058 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.989144 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.989371 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.989458 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.989688 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.989776 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.990035 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.990123 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.990372 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.990460 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.990680 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.990807 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.991001 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.991313 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.991399 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.991633 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.991729 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.991941 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.992027 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.992264 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.992350 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.992598 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.992685 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.992918 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.993004 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.993237 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.993324 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.993538 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.993635 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.993841 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.993961 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.994164 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.994253 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.994471 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.994568 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.994784 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.994871 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.995090 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.995185 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.995389 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.995484 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.995686 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.995774 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.995992 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.996092 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.996293 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.996381 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.996592 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.996679 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.996891 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.996987 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.997190 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.997276 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.997493 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.997579 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.997790 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.997911 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.998112 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.998200 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.998411 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.998509 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.998709 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.998797 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.999006 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.999094 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.999304 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.999391 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.999608 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.999697 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.999905 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:25.999993 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.000250 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.000352 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.000504 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.000600 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.000801 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.000937 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.001105 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.001196 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.001410 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.001500 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.001722 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.001810 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.002052 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.002155 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.002363 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.002505 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.002669 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.002755 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.002972 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.003072 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.003276 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.003362 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.003591 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.003724 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.003909 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.004011 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.004218 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.004306 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.004524 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.004611 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.004838 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.004933 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.005146 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.005240 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.005453 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.005540 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.005781 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.005875 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.006110 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.006211 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.006415 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.006511 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.006721 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.006810 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.007043 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.007194 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.007358 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.007448 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.007657 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.007744 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.007973 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.008061 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.008284 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.008378 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.008595 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.008683 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.008905 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.008991 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.009213 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.009309 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.009539 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.009627 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.009844 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.009965 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.010171 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.010267 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.010478 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.010574 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.010784 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.010872 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.011099 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.011191 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.011409 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.011503 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.011713 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.011799 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.012020 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.012115 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.012331 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.012419 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.012642 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.012728 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.012957 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.013046 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.013271 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.013371 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.013577 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.013672 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.013901 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.014024 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.014222 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.014310 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.014540 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.014640 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.014856 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.014951 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.015189 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.015285 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.015511 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.015606 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.015820 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.015908 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.016129 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.016214 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.016430 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.016529 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.016672 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 23 04:20:26.016793 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.017109 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.017455 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.017785 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.018125 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.018444 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.018752 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:20:26.018997 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106612) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 23 04:20:26.171922 n-d-846463-3 devstack@n-api.service[106611]: INFO dbcounter [None req-83ae1449-01d2-49bd-a423-a080be4b4a02 None None] Registered counter for database nova_api Sep 23 04:20:26.182427 n-d-846463-3 devstack@n-api.service[106612]: INFO dbcounter [None req-595eab46-5149-4f3a-a14a-c4d4e77e5dd9 None None] Registered counter for database nova_api Sep 23 04:20:26.192413 n-d-846463-3 devstack@n-api.service[106611]: DEBUG oslo_db.sqlalchemy.engines [None req-83ae1449-01d2-49bd-a423-a080be4b4a02 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106611) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 04:20:26.199455 n-d-846463-3 devstack@n-api.service[106611]: DEBUG dbcounter [-] [106611] Writer thread running {{(pid=106611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 23 04:20:26.202196 n-d-846463-3 devstack@n-api.service[106612]: DEBUG oslo_db.sqlalchemy.engines [None req-595eab46-5149-4f3a-a14a-c4d4e77e5dd9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106612) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 04:20:26.208492 n-d-846463-3 devstack@n-api.service[106612]: DEBUG dbcounter [-] [106612] Writer thread running {{(pid=106612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 23 04:20:26.259786 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.context [None req-83ae1449-01d2-49bd-a423-a080be4b4a02 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),feac528b-4983-4e61-aae7-f1973fe5bc2c(cell1) {{(pid=106611) load_cells /opt/stack/nova/nova/context.py:464}} Sep 23 04:20:26.263649 n-d-846463-3 devstack@n-api.service[106611]: DEBUG oslo_concurrency.lockutils [None req-83ae1449-01d2-49bd-a423-a080be4b4a02 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:26.264118 n-d-846463-3 devstack@n-api.service[106611]: DEBUG oslo_concurrency.lockutils [None req-83ae1449-01d2-49bd-a423-a080be4b4a02 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:26.265657 n-d-846463-3 devstack@n-api.service[106611]: DEBUG oslo_concurrency.lockutils [None req-83ae1449-01d2-49bd-a423-a080be4b4a02 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:26.266397 n-d-846463-3 devstack@n-api.service[106611]: DEBUG oslo_concurrency.lockutils [None req-83ae1449-01d2-49bd-a423-a080be4b4a02 None None] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:26.266839 n-d-846463-3 devstack@n-api.service[106611]: DEBUG oslo_concurrency.lockutils [None req-83ae1449-01d2-49bd-a423-a080be4b4a02 None None] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:26.268352 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.context [None req-595eab46-5149-4f3a-a14a-c4d4e77e5dd9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),feac528b-4983-4e61-aae7-f1973fe5bc2c(cell1) {{(pid=106612) load_cells /opt/stack/nova/nova/context.py:464}} Sep 23 04:20:26.268790 n-d-846463-3 devstack@n-api.service[106611]: DEBUG oslo_concurrency.lockutils [None req-83ae1449-01d2-49bd-a423-a080be4b4a02 None None] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:26.271036 n-d-846463-3 devstack@n-api.service[106611]: INFO dbcounter [None req-83ae1449-01d2-49bd-a423-a080be4b4a02 None None] Registered counter for database nova_cell0 Sep 23 04:20:26.273097 n-d-846463-3 devstack@n-api.service[106612]: DEBUG oslo_concurrency.lockutils [None req-595eab46-5149-4f3a-a14a-c4d4e77e5dd9 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:26.273564 n-d-846463-3 devstack@n-api.service[106612]: DEBUG oslo_concurrency.lockutils [None req-595eab46-5149-4f3a-a14a-c4d4e77e5dd9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:26.275182 n-d-846463-3 devstack@n-api.service[106612]: DEBUG oslo_concurrency.lockutils [None req-595eab46-5149-4f3a-a14a-c4d4e77e5dd9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:26.275535 n-d-846463-3 devstack@n-api.service[106611]: INFO dbcounter [None req-83ae1449-01d2-49bd-a423-a080be4b4a02 None None] Registered counter for database nova_cell1 Sep 23 04:20:26.275902 n-d-846463-3 devstack@n-api.service[106612]: DEBUG oslo_concurrency.lockutils [None req-595eab46-5149-4f3a-a14a-c4d4e77e5dd9 None None] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:20:26.276341 n-d-846463-3 devstack@n-api.service[106612]: DEBUG oslo_concurrency.lockutils [None req-595eab46-5149-4f3a-a14a-c4d4e77e5dd9 None None] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:20:26.278307 n-d-846463-3 devstack@n-api.service[106612]: DEBUG oslo_concurrency.lockutils [None req-595eab46-5149-4f3a-a14a-c4d4e77e5dd9 None None] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106612) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:20:26.280297 n-d-846463-3 devstack@n-api.service[106612]: INFO dbcounter [None req-595eab46-5149-4f3a-a14a-c4d4e77e5dd9 None None] Registered counter for database nova_cell0 Sep 23 04:20:26.284420 n-d-846463-3 devstack@n-api.service[106611]: DEBUG oslo_db.sqlalchemy.engines [None req-83ae1449-01d2-49bd-a423-a080be4b4a02 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106611) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 04:20:26.284589 n-d-846463-3 devstack@n-api.service[106612]: INFO dbcounter [None req-595eab46-5149-4f3a-a14a-c4d4e77e5dd9 None None] Registered counter for database nova_cell1 Sep 23 04:20:26.285520 n-d-846463-3 devstack@n-api.service[106611]: DEBUG oslo_db.sqlalchemy.engines [None req-83ae1449-01d2-49bd-a423-a080be4b4a02 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106611) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 04:20:26.288875 n-d-846463-3 devstack@n-api.service[106611]: DEBUG dbcounter [-] [106611] Writer thread running {{(pid=106611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 23 04:20:26.291622 n-d-846463-3 devstack@n-api.service[106612]: DEBUG oslo_db.sqlalchemy.engines [None req-595eab46-5149-4f3a-a14a-c4d4e77e5dd9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106612) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 04:20:26.293818 n-d-846463-3 devstack@n-api.service[106612]: DEBUG oslo_db.sqlalchemy.engines [None req-595eab46-5149-4f3a-a14a-c4d4e77e5dd9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106612) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 04:20:26.298276 n-d-846463-3 devstack@n-api.service[106612]: DEBUG dbcounter [-] [106612] Writer thread running {{(pid=106612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 23 04:20:26.426417 n-d-846463-3 devstack@n-api.service[106611]: DEBUG dbcounter [-] [106611] Writer thread running {{(pid=106611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 23 04:20:26.434863 n-d-846463-3 devstack@n-api.service[106611]: INFO dbcounter [None req-83ae1449-01d2-49bd-a423-a080be4b4a02 None None] Registered counter for database nova_cell0 Sep 23 04:20:26.434975 n-d-846463-3 devstack@n-api.service[106612]: DEBUG dbcounter [-] [106612] Writer thread running {{(pid=106612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 23 04:20:26.445483 n-d-846463-3 devstack@n-api.service[106612]: INFO dbcounter [None req-595eab46-5149-4f3a-a14a-c4d4e77e5dd9 None None] Registered counter for database nova_cell0 Sep 23 04:20:26.446041 n-d-846463-3 devstack@n-api.service[106611]: DEBUG oslo_db.sqlalchemy.engines [None req-83ae1449-01d2-49bd-a423-a080be4b4a02 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106611) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 04:20:26.450874 n-d-846463-3 devstack@n-api.service[106611]: DEBUG dbcounter [-] [106611] Writer thread running {{(pid=106611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 23 04:20:26.454278 n-d-846463-3 devstack@n-api.service[106612]: DEBUG oslo_db.sqlalchemy.engines [None req-595eab46-5149-4f3a-a14a-c4d4e77e5dd9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106612) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 04:20:26.459721 n-d-846463-3 devstack@n-api.service[106612]: DEBUG dbcounter [-] [106612] Writer thread running {{(pid=106612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 23 04:20:26.872738 n-d-846463-3 devstack@n-api.service[106611]: WARNING keystonemiddleware.auth_token [None req-83ae1449-01d2-49bd-a423-a080be4b4a02 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 23 04:20:26.880039 n-d-846463-3 devstack@n-api.service[106611]: WARNING keystonemiddleware.auth_token [None req-83ae1449-01d2-49bd-a423-a080be4b4a02 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 23 04:20:26.908626 n-d-846463-3 devstack@n-api.service[106612]: WARNING keystonemiddleware.auth_token [None req-595eab46-5149-4f3a-a14a-c4d4e77e5dd9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 23 04:20:26.915856 n-d-846463-3 devstack@n-api.service[106612]: WARNING keystonemiddleware.auth_token [None req-595eab46-5149-4f3a-a14a-c4d4e77e5dd9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 23 04:20:27.234950 n-d-846463-3 devstack@n-api.service[106611]: WARNING keystonemiddleware.auth_token [None req-83ae1449-01d2-49bd-a423-a080be4b4a02 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 23 04:20:27.241676 n-d-846463-3 devstack@n-api.service[106611]: WARNING keystonemiddleware.auth_token [None req-83ae1449-01d2-49bd-a423-a080be4b4a02 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 23 04:20:27.247032 n-d-846463-3 devstack@n-api.service[106611]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5634e088b9c0 pid: 106611 (default app) Sep 23 04:20:27.249088 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi [None req-83ae1449-01d2-49bd-a423-a080be4b4a02 None None] Calling method '>' {{(pid=106611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:20:27.250322 n-d-846463-3 devstack@n-api.service[106611]: INFO nova.api.openstack.requestlog [None req-83ae1449-01d2-49bd-a423-a080be4b4a02 None None] 10.222.0.33 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001723 Sep 23 04:20:27.250742 n-d-846463-3 devstack@n-api.service[106611]: [pid: 106611|app: 0|req: 1/1] 10.222.0.33 () {50 vars in 788 bytes} [Fri Sep 23 04:20:27 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:20:27.295646 n-d-846463-3 devstack@n-api.service[106612]: WARNING keystonemiddleware.auth_token [None req-595eab46-5149-4f3a-a14a-c4d4e77e5dd9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 23 04:20:27.301720 n-d-846463-3 devstack@n-api.service[106612]: WARNING keystonemiddleware.auth_token [None req-595eab46-5149-4f3a-a14a-c4d4e77e5dd9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 23 04:20:27.307427 n-d-846463-3 devstack@n-api.service[106612]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5634e088b9c0 pid: 106612 (default app) Sep 23 04:21:51.864152 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi [None req-83ae1449-01d2-49bd-a423-a080be4b4a02 None None] Calling method '>' {{(pid=106611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:21:51.868781 n-d-846463-3 devstack@n-api.service[106611]: INFO nova.api.openstack.requestlog [None req-83ae1449-01d2-49bd-a423-a080be4b4a02 None None] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001833 Sep 23 04:21:51.868781 n-d-846463-3 devstack@n-api.service[106611]: [pid: 106611|app: 0|req: 2/2] 10.222.0.33 () {54 vars in 931 bytes} [Fri Sep 23 04:21:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:21:51.890038 n-d-846463-3 devstack@n-api.service[106612]: DEBUG dbcounter [-] [106612] Writing DB stats nova_api:SELECT=3 {{(pid=106612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:21:51.891503 n-d-846463-3 devstack@n-api.service[106612]: DEBUG dbcounter [-] [106612] Writing DB stats nova_cell0:SELECT=3 {{(pid=106612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:21:51.892414 n-d-846463-3 devstack@n-api.service[106612]: DEBUG dbcounter [-] [106612] Writing DB stats nova_cell1:SELECT=3 {{(pid=106612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:21:51.893972 n-d-846463-3 devstack@n-api.service[106612]: DEBUG dbcounter [-] [106612] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:21:52.789642 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi [None req-25b392ee-576b-4e8c-ae09-8c0e246de098 admin admin] Calling method '>' {{(pid=106612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:21:52.828154 n-d-846463-3 devstack@n-api.service[106612]: INFO nova.api.openstack.requestlog [None req-25b392ee-576b-4e8c-ae09-8c0e246de098 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.953068 Sep 23 04:21:52.847375 n-d-846463-3 devstack@n-api.service[106612]: [pid: 106612|app: 0|req: 1/3] 10.222.0.33 () {60 vars in 1292 bytes} [Fri Sep 23 04:21:51 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:21:55.465127 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi [None req-83ae1449-01d2-49bd-a423-a080be4b4a02 None None] Calling method '>' {{(pid=106611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:21:55.466175 n-d-846463-3 devstack@n-api.service[106611]: INFO nova.api.openstack.requestlog [None req-83ae1449-01d2-49bd-a423-a080be4b4a02 None None] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001406 Sep 23 04:21:55.466761 n-d-846463-3 devstack@n-api.service[106611]: [pid: 106611|app: 0|req: 3/4] 10.222.0.33 () {54 vars in 931 bytes} [Fri Sep 23 04:21:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:21:55.943743 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi [None req-18b56745-735c-4583-87b9-929e5e07c05a admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "swap": 0, "name": "cirros256", "ram": 256}} {{(pid=106612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:21:56.041675 n-d-846463-3 devstack@n-api.service[106612]: INFO nova.api.openstack.requestlog [None req-18b56745-735c-4583-87b9-929e5e07c05a admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.568475 Sep 23 04:21:56.042303 n-d-846463-3 devstack@n-api.service[106612]: [pid: 106612|app: 0|req: 2/5] 10.222.0.33 () {64 vars in 1283 bytes} [Fri Sep 23 04:21:55 2022] POST /compute/v2.1/flavors => generated 407 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 04:21:56.056455 n-d-846463-3 devstack@n-api.service[106611]: DEBUG dbcounter [-] [106611] Writing DB stats nova_api:SELECT=3 {{(pid=106611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:21:56.057265 n-d-846463-3 devstack@n-api.service[106611]: DEBUG dbcounter [-] [106611] Writing DB stats nova_cell0:SELECT=3 {{(pid=106611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:21:56.060259 n-d-846463-3 devstack@n-api.service[106611]: DEBUG dbcounter [-] [106611] Writing DB stats nova_cell1:SELECT=3 {{(pid=106611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:21:56.061031 n-d-846463-3 devstack@n-api.service[106611]: DEBUG dbcounter [-] [106611] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:21:56.263373 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi [None req-c8cead9d-8b49-47a7-bcaf-e4db5eb892fa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:21:56.382096 n-d-846463-3 devstack@n-api.service[106611]: INFO nova.api.openstack.requestlog [None req-c8cead9d-8b49-47a7-bcaf-e4db5eb892fa admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.330803 Sep 23 04:21:56.382697 n-d-846463-3 devstack@n-api.service[106611]: [pid: 106611|app: 0|req: 4/6] 10.222.0.33 () {64 vars in 1336 bytes} [Fri Sep 23 04:21:56 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:21:59.089207 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi [None req-18b56745-735c-4583-87b9-929e5e07c05a admin admin] Calling method '>' {{(pid=106612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:21:59.091181 n-d-846463-3 devstack@n-api.service[106612]: INFO nova.api.openstack.requestlog [None req-18b56745-735c-4583-87b9-929e5e07c05a admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002445 Sep 23 04:21:59.092372 n-d-846463-3 devstack@n-api.service[106612]: [pid: 106612|app: 0|req: 3/7] 10.222.0.33 () {54 vars in 931 bytes} [Fri Sep 23 04:21:59 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:21:59.917051 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi [None req-7297bd3a-1397-484f-a9f8-6e3d7f0b3197 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 1, "disk": 5, "rxtx_factor": 1.0, "swap": 0, "ram": 512, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M"}} {{(pid=106611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:22:00.028730 n-d-846463-3 devstack@n-api.service[106611]: INFO nova.api.openstack.requestlog [None req-7297bd3a-1397-484f-a9f8-6e3d7f0b3197 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.928785 Sep 23 04:22:00.030210 n-d-846463-3 devstack@n-api.service[106611]: [pid: 106611|app: 0|req: 5/8] 10.222.0.33 () {64 vars in 1283 bytes} [Fri Sep 23 04:21:59 2022] POST /compute/v2.1/flavors => generated 404 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 23 04:22:00.055671 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi [None req-a0acf6b5-a5ff-49a7-a3bb-0ae0bcd538d1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:22:00.237470 n-d-846463-3 devstack@n-api.service[106612]: INFO nova.api.openstack.requestlog [None req-a0acf6b5-a5ff-49a7-a3bb-0ae0bcd538d1 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.194238 Sep 23 04:22:00.238834 n-d-846463-3 devstack@n-api.service[106612]: [pid: 106612|app: 0|req: 4/9] 10.222.0.33 () {64 vars in 1336 bytes} [Fri Sep 23 04:22:00 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:22:03.260023 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi [None req-7297bd3a-1397-484f-a9f8-6e3d7f0b3197 admin admin] Calling method '>' {{(pid=106611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:22:03.261069 n-d-846463-3 devstack@n-api.service[106611]: INFO nova.api.openstack.requestlog [None req-7297bd3a-1397-484f-a9f8-6e3d7f0b3197 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Sep 23 04:22:03.261700 n-d-846463-3 devstack@n-api.service[106611]: [pid: 106611|app: 0|req: 6/10] 10.222.0.33 () {54 vars in 931 bytes} [Fri Sep 23 04:22:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:22:03.727592 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi [None req-81f46a82-3e8a-48be-b46b-3931924dfdc1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "name": "ds1G", "ram": 1024, "swap": 0, "os-flavor-access:is_public": true, "disk": 10, "rxtx_factor": 1.0}} {{(pid=106612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:22:03.826587 n-d-846463-3 devstack@n-api.service[106612]: INFO nova.api.openstack.requestlog [None req-81f46a82-3e8a-48be-b46b-3931924dfdc1 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.558569 Sep 23 04:22:03.828244 n-d-846463-3 devstack@n-api.service[106612]: [pid: 106612|app: 0|req: 5/11] 10.222.0.33 () {64 vars in 1283 bytes} [Fri Sep 23 04:22:03 2022] POST /compute/v2.1/flavors => generated 404 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 23 04:22:03.841832 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi [None req-cab3cf60-af8d-4dac-aa55-e84ce103227e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:22:03.904825 n-d-846463-3 devstack@n-api.service[106611]: INFO nova.api.openstack.requestlog [None req-cab3cf60-af8d-4dac-aa55-e84ce103227e admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.066674 Sep 23 04:22:03.905431 n-d-846463-3 devstack@n-api.service[106611]: [pid: 106611|app: 0|req: 7/12] 10.222.0.33 () {64 vars in 1336 bytes} [Fri Sep 23 04:22:03 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:22:06.542401 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi [None req-81f46a82-3e8a-48be-b46b-3931924dfdc1 admin admin] Calling method '>' {{(pid=106612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:22:06.543414 n-d-846463-3 devstack@n-api.service[106612]: INFO nova.api.openstack.requestlog [None req-81f46a82-3e8a-48be-b46b-3931924dfdc1 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Sep 23 04:22:06.543809 n-d-846463-3 devstack@n-api.service[106612]: [pid: 106612|app: 0|req: 6/13] 10.222.0.33 () {54 vars in 931 bytes} [Fri Sep 23 04:22:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:22:07.019014 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi [None req-6fe2ddc4-5cf4-4253-88a3-95b1b1ce8c17 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "rxtx_factor": 1.0, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "os-flavor-access:is_public": true, "ram": 2048, "vcpus": 2, "swap": 0}} {{(pid=106611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:22:07.106492 n-d-846463-3 devstack@n-api.service[106611]: INFO nova.api.openstack.requestlog [None req-6fe2ddc4-5cf4-4253-88a3-95b1b1ce8c17 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.556205 Sep 23 04:22:07.107290 n-d-846463-3 devstack@n-api.service[106611]: [pid: 106611|app: 0|req: 8/14] 10.222.0.33 () {64 vars in 1283 bytes} [Fri Sep 23 04:22:06 2022] POST /compute/v2.1/flavors => generated 404 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 23 04:22:07.119993 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi [None req-52c80570-ab1a-4349-b1d2-ab4f36835a27 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:22:07.213412 n-d-846463-3 devstack@n-api.service[106612]: INFO nova.api.openstack.requestlog [None req-52c80570-ab1a-4349-b1d2-ab4f36835a27 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097049 Sep 23 04:22:07.214441 n-d-846463-3 devstack@n-api.service[106612]: [pid: 106612|app: 0|req: 7/15] 10.222.0.33 () {64 vars in 1336 bytes} [Fri Sep 23 04:22:07 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:22:09.927705 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi [None req-6fe2ddc4-5cf4-4253-88a3-95b1b1ce8c17 admin admin] Calling method '>' {{(pid=106611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:22:09.929298 n-d-846463-3 devstack@n-api.service[106611]: INFO nova.api.openstack.requestlog [None req-6fe2ddc4-5cf4-4253-88a3-95b1b1ce8c17 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002022 Sep 23 04:22:09.929845 n-d-846463-3 devstack@n-api.service[106611]: [pid: 106611|app: 0|req: 9/16] 10.222.0.33 () {54 vars in 931 bytes} [Fri Sep 23 04:22:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:22:10.351834 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi [None req-b54caf04-36dc-4250-bd94-d75e95a4bb3a admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 4096, "id": "d4", "name": "ds4G", "disk": 20, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 4}} {{(pid=106612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:22:10.427730 n-d-846463-3 devstack@n-api.service[106612]: INFO nova.api.openstack.requestlog [None req-b54caf04-36dc-4250-bd94-d75e95a4bb3a admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.491756 Sep 23 04:22:10.428720 n-d-846463-3 devstack@n-api.service[106612]: [pid: 106612|app: 0|req: 8/17] 10.222.0.33 () {64 vars in 1283 bytes} [Fri Sep 23 04:22:09 2022] POST /compute/v2.1/flavors => generated 404 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 04:22:10.443373 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi [None req-3f643eca-3d48-4bcb-931c-d0f908caa924 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:22:10.532182 n-d-846463-3 devstack@n-api.service[106611]: INFO nova.api.openstack.requestlog [None req-3f643eca-3d48-4bcb-931c-d0f908caa924 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.093415 Sep 23 04:22:10.533089 n-d-846463-3 devstack@n-api.service[106611]: [pid: 106611|app: 0|req: 10/18] 10.222.0.33 () {64 vars in 1336 bytes} [Fri Sep 23 04:22:10 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:22:13.190513 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi [None req-b54caf04-36dc-4250-bd94-d75e95a4bb3a admin admin] Calling method '>' {{(pid=106612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:22:13.191539 n-d-846463-3 devstack@n-api.service[106612]: INFO nova.api.openstack.requestlog [None req-b54caf04-36dc-4250-bd94-d75e95a4bb3a admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002125 Sep 23 04:22:13.191966 n-d-846463-3 devstack@n-api.service[106612]: [pid: 106612|app: 0|req: 9/19] 10.222.0.33 () {54 vars in 931 bytes} [Fri Sep 23 04:22:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:22:13.625501 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi [None req-67f278ef-17a9-4d53-9947-de422827400c admin admin] Calling method '>' {{(pid=106611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:22:13.649599 n-d-846463-3 devstack@n-api.service[106611]: INFO nova.api.openstack.requestlog [None req-67f278ef-17a9-4d53-9947-de422827400c admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.451537 Sep 23 04:22:13.650205 n-d-846463-3 devstack@n-api.service[106611]: [pid: 106611|app: 0|req: 11/20] 10.222.0.33 () {60 vars in 1292 bytes} [Fri Sep 23 04:22:13 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:22:16.344392 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi [None req-b54caf04-36dc-4250-bd94-d75e95a4bb3a admin admin] Calling method '>' {{(pid=106612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:22:16.345408 n-d-846463-3 devstack@n-api.service[106612]: INFO nova.api.openstack.requestlog [None req-b54caf04-36dc-4250-bd94-d75e95a4bb3a admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001511 Sep 23 04:22:16.345814 n-d-846463-3 devstack@n-api.service[106612]: [pid: 106612|app: 0|req: 10/21] 10.222.0.33 () {54 vars in 931 bytes} [Fri Sep 23 04:22:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:22:16.790806 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi [None req-27956488-044e-4518-a7a7-30d5c2340d63 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "1", "disk": 1, "name": "m1.tiny", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512}} {{(pid=106611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:22:16.885909 n-d-846463-3 devstack@n-api.service[106611]: INFO nova.api.openstack.requestlog [None req-27956488-044e-4518-a7a7-30d5c2340d63 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.533720 Sep 23 04:22:16.886510 n-d-846463-3 devstack@n-api.service[106611]: [pid: 106611|app: 0|req: 12/22] 10.222.0.33 () {64 vars in 1283 bytes} [Fri Sep 23 04:22:16 2022] POST /compute/v2.1/flavors => generated 402 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 04:22:16.900406 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi [None req-91e62a94-8322-4d8b-ba65-78c36cc8a436 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:22:16.983695 n-d-846463-3 devstack@n-api.service[106612]: INFO nova.api.openstack.requestlog [None req-91e62a94-8322-4d8b-ba65-78c36cc8a436 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.086777 Sep 23 04:22:16.984277 n-d-846463-3 devstack@n-api.service[106612]: [pid: 106612|app: 0|req: 11/23] 10.222.0.33 () {64 vars in 1333 bytes} [Fri Sep 23 04:22:16 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:22:19.845974 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi [None req-27956488-044e-4518-a7a7-30d5c2340d63 admin admin] Calling method '>' {{(pid=106611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:22:19.847003 n-d-846463-3 devstack@n-api.service[106611]: INFO nova.api.openstack.requestlog [None req-27956488-044e-4518-a7a7-30d5c2340d63 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002130 Sep 23 04:22:19.847409 n-d-846463-3 devstack@n-api.service[106611]: [pid: 106611|app: 0|req: 13/24] 10.222.0.33 () {54 vars in 931 bytes} [Fri Sep 23 04:22:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:22:20.259391 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi [None req-887dc269-ff8f-4e92-9568-32d6e431025a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "os-flavor-access:is_public": true, "id": "2", "disk": 20, "vcpus": 1, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0}} {{(pid=106612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:22:20.350665 n-d-846463-3 devstack@n-api.service[106612]: INFO nova.api.openstack.requestlog [None req-887dc269-ff8f-4e92-9568-32d6e431025a admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.497210 Sep 23 04:22:20.353334 n-d-846463-3 devstack@n-api.service[106612]: [pid: 106612|app: 0|req: 12/25] 10.222.0.33 () {64 vars in 1283 bytes} [Fri Sep 23 04:22:19 2022] POST /compute/v2.1/flavors => generated 405 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 23 04:22:20.363660 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi [None req-f6de0bbe-da19-4c8c-8754-910e2a141a0c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:22:20.428429 n-d-846463-3 devstack@n-api.service[106611]: INFO nova.api.openstack.requestlog [None req-f6de0bbe-da19-4c8c-8754-910e2a141a0c admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.068352 Sep 23 04:22:20.429004 n-d-846463-3 devstack@n-api.service[106611]: [pid: 106611|app: 0|req: 14/26] 10.222.0.33 () {64 vars in 1333 bytes} [Fri Sep 23 04:22:20 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:22:23.044249 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi [None req-887dc269-ff8f-4e92-9568-32d6e431025a admin admin] Calling method '>' {{(pid=106612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:22:23.045201 n-d-846463-3 devstack@n-api.service[106612]: INFO nova.api.openstack.requestlog [None req-887dc269-ff8f-4e92-9568-32d6e431025a admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Sep 23 04:22:23.045608 n-d-846463-3 devstack@n-api.service[106612]: [pid: 106612|app: 0|req: 13/27] 10.222.0.33 () {54 vars in 931 bytes} [Fri Sep 23 04:22:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:22:23.418997 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi [None req-dcfd0363-8736-45e4-89ea-a6a7604b3008 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "name": "m1.medium", "id": "3", "swap": 0, "rxtx_factor": 1.0, "vcpus": 2, "os-flavor-access:is_public": true, "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:22:24.248442 n-d-846463-3 devstack@n-api.service[106611]: INFO nova.api.openstack.requestlog [None req-dcfd0363-8736-45e4-89ea-a6a7604b3008 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 1.196804 Sep 23 04:22:24.249352 n-d-846463-3 devstack@n-api.service[106611]: [pid: 106611|app: 0|req: 15/28] 10.222.0.33 () {64 vars in 1283 bytes} [Fri Sep 23 04:22:23 2022] POST /compute/v2.1/flavors => generated 406 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 04:22:24.262964 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi [None req-d2b4f274-54fe-449b-9c92-7cc2dbca8772 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:22:24.269766 n-d-846463-3 devstack@n-api.service[106612]: DEBUG dbcounter [-] [106612] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=106612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:22:24.326901 n-d-846463-3 devstack@n-api.service[106612]: INFO nova.api.openstack.requestlog [None req-d2b4f274-54fe-449b-9c92-7cc2dbca8772 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.067064 Sep 23 04:22:24.338433 n-d-846463-3 devstack@n-api.service[106612]: [pid: 106612|app: 0|req: 14/29] 10.222.0.33 () {64 vars in 1333 bytes} [Fri Sep 23 04:22:24 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:22:26.968330 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi [None req-dcfd0363-8736-45e4-89ea-a6a7604b3008 admin admin] Calling method '>' {{(pid=106611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:22:26.969416 n-d-846463-3 devstack@n-api.service[106611]: INFO nova.api.openstack.requestlog [None req-dcfd0363-8736-45e4-89ea-a6a7604b3008 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001603 Sep 23 04:22:26.969827 n-d-846463-3 devstack@n-api.service[106611]: [pid: 106611|app: 0|req: 16/30] 10.222.0.33 () {54 vars in 931 bytes} [Fri Sep 23 04:22:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:22:27.430667 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi [None req-234d2fe6-5631-4b63-a699-f6bff09f5241 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "ram": 8192, "vcpus": 4, "disk": 80, "id": "4", "rxtx_factor": 1.0, "swap": 0}} {{(pid=106612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:22:27.511635 n-d-846463-3 devstack@n-api.service[106612]: INFO nova.api.openstack.requestlog [None req-234d2fe6-5631-4b63-a699-f6bff09f5241 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.535648 Sep 23 04:22:27.512841 n-d-846463-3 devstack@n-api.service[106612]: [pid: 106612|app: 0|req: 15/31] 10.222.0.33 () {64 vars in 1283 bytes} [Fri Sep 23 04:22:26 2022] POST /compute/v2.1/flavors => generated 405 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 04:22:27.525130 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi [None req-d8e78041-51a7-408a-90ef-0595ebe2d76f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:22:27.634630 n-d-846463-3 devstack@n-api.service[106611]: INFO nova.api.openstack.requestlog [None req-d8e78041-51a7-408a-90ef-0595ebe2d76f admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.113089 Sep 23 04:22:27.637864 n-d-846463-3 devstack@n-api.service[106611]: [pid: 106611|app: 0|req: 17/32] 10.222.0.33 () {64 vars in 1333 bytes} [Fri Sep 23 04:22:27 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:22:30.262329 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi [None req-234d2fe6-5631-4b63-a699-f6bff09f5241 admin admin] Calling method '>' {{(pid=106612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:22:30.264005 n-d-846463-3 devstack@n-api.service[106612]: INFO nova.api.openstack.requestlog [None req-234d2fe6-5631-4b63-a699-f6bff09f5241 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002219 Sep 23 04:22:30.264417 n-d-846463-3 devstack@n-api.service[106612]: [pid: 106612|app: 0|req: 16/33] 10.222.0.33 () {54 vars in 931 bytes} [Fri Sep 23 04:22:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:22:30.704899 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi [None req-595baa1a-f5c9-4b77-9741-5e35ed9302b3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "rxtx_factor": 1.0, "name": "m1.xlarge", "swap": 0, "ram": 16384, "disk": 160, "id": "5", "os-flavor-access:is_public": true}} {{(pid=106611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:22:30.711377 n-d-846463-3 devstack@n-api.service[106611]: DEBUG dbcounter [-] [106611] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=106611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:22:30.814331 n-d-846463-3 devstack@n-api.service[106611]: INFO nova.api.openstack.requestlog [None req-595baa1a-f5c9-4b77-9741-5e35ed9302b3 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.543040 Sep 23 04:22:30.815169 n-d-846463-3 devstack@n-api.service[106611]: [pid: 106611|app: 0|req: 18/34] 10.222.0.33 () {64 vars in 1283 bytes} [Fri Sep 23 04:22:30 2022] POST /compute/v2.1/flavors => generated 408 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 04:22:30.827658 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi [None req-89bdb5ac-d63c-4bfa-b9eb-ca88edbd3c26 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:22:30.926312 n-d-846463-3 devstack@n-api.service[106612]: INFO nova.api.openstack.requestlog [None req-89bdb5ac-d63c-4bfa-b9eb-ca88edbd3c26 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.102500 Sep 23 04:22:30.927103 n-d-846463-3 devstack@n-api.service[106612]: [pid: 106612|app: 0|req: 17/35] 10.222.0.33 () {64 vars in 1333 bytes} [Fri Sep 23 04:22:30 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:22:51.403473 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi [None req-595baa1a-f5c9-4b77-9741-5e35ed9302b3 admin admin] Calling method '>' {{(pid=106611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:22:51.404494 n-d-846463-3 devstack@n-api.service[106611]: INFO nova.api.openstack.requestlog [None req-595baa1a-f5c9-4b77-9741-5e35ed9302b3 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Sep 23 04:22:51.404896 n-d-846463-3 devstack@n-api.service[106611]: [pid: 106611|app: 0|req: 19/36] 10.222.0.33 () {54 vars in 931 bytes} [Fri Sep 23 04:22:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:22:51.416207 n-d-846463-3 devstack@n-api.service[106612]: DEBUG dbcounter [-] [106612] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=106612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:22:51.810326 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi [None req-be57b81c-02b7-4e91-bd4e-1c26af6d2a20 admin admin] Calling method '>' {{(pid=106612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:22:51.830597 n-d-846463-3 devstack@n-api.service[106612]: INFO nova.api.openstack.requestlog [None req-be57b81c-02b7-4e91-bd4e-1c26af6d2a20 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.418744 Sep 23 04:22:51.831477 n-d-846463-3 devstack@n-api.service[106612]: [pid: 106612|app: 0|req: 18/37] 10.222.0.33 () {60 vars in 1292 bytes} [Fri Sep 23 04:22:51 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:22:53.146382 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi [None req-595baa1a-f5c9-4b77-9741-5e35ed9302b3 admin admin] Calling method '>' {{(pid=106611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:22:53.147440 n-d-846463-3 devstack@n-api.service[106611]: INFO nova.api.openstack.requestlog [None req-595baa1a-f5c9-4b77-9741-5e35ed9302b3 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001519 Sep 23 04:22:53.148011 n-d-846463-3 devstack@n-api.service[106611]: [pid: 106611|app: 0|req: 20/38] 10.222.0.33 () {56 vars in 1074 bytes} [Fri Sep 23 04:22:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:22:53.718873 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi [None req-c219b23c-edf6-4ac7-86b9-cb5762517b89 admin admin] Calling method '>' {{(pid=106612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:22:53.724841 n-d-846463-3 devstack@n-api.service[106612]: INFO nova.api.openstack.wsgi [None req-c219b23c-edf6-4ac7-86b9-cb5762517b89 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 23 04:22:53.728082 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi [None req-c219b23c-edf6-4ac7-86b9-cb5762517b89 admin admin] Request method failure captured: Sep 23 04:22:53.728082 n-d-846463-3 devstack@n-api.service[106612]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 23 04:22:53.728082 n-d-846463-3 devstack@n-api.service[106612]: Accept: application/json Sep 23 04:22:53.728082 n-d-846463-3 devstack@n-api.service[106612]: Accept-Encoding: gzip, deflate Sep 23 04:22:53.728082 n-d-846463-3 devstack@n-api.service[106612]: Connection: keep-alive Sep 23 04:22:53.728082 n-d-846463-3 devstack@n-api.service[106612]: Content-Length: 0 Sep 23 04:22:53.728082 n-d-846463-3 devstack@n-api.service[106612]: Host: 10.222.0.33 Sep 23 04:22:53.728082 n-d-846463-3 devstack@n-api.service[106612]: Openstack-Api-Version: compute 2.92 Sep 23 04:22:53.728082 n-d-846463-3 devstack@n-api.service[106612]: Openstack-System-Scope: None Sep 23 04:22:53.728082 n-d-846463-3 devstack@n-api.service[106612]: User-Agent: python-novaclient Sep 23 04:22:53.728082 n-d-846463-3 devstack@n-api.service[106612]: X-Auth-Token: gAAAAABjLTSdrt2m5aPYLyruTIgwi6eoMJR0cJR2QCyIWdqH5xr9UHbJY_8lzP-6Y79AfkGyM8HBXissp_oLE6A-gM43aNarXw2jcqWyGDsMOVLfa57biemIbyPN1daXXcSRKBY6Til4RvXAxJdZQym12gcVS1jKNgOL6Z5HuF1CyPpLBDz8384 Sep 23 04:22:53.728082 n-d-846463-3 devstack@n-api.service[106612]: X-Domain-Id: None Sep 23 04:22:53.728082 n-d-846463-3 devstack@n-api.service[106612]: X-Domain-Name: None Sep 23 04:22:53.728082 n-d-846463-3 devstack@n-api.service[106612]: X-Identity-Status: Confirmed Sep 23 04:22:53.728082 n-d-846463-3 devstack@n-api.service[106612]: X-Is-Admin-Project: True Sep 23 04:22:53.728082 n-d-846463-3 devstack@n-api.service[106612]: X-Openstack-Nova-Api-Version: 2.92 Sep 23 04:22:53.728082 n-d-846463-3 devstack@n-api.service[106612]: X-Project-Domain-Id: default Sep 23 04:22:53.728082 n-d-846463-3 devstack@n-api.service[106612]: X-Project-Domain-Name: Default Sep 23 04:22:53.728082 n-d-846463-3 devstack@n-api.service[106612]: X-Project-Id: 81abc1878347454c9540eb18c2f170a2 Sep 23 04:22:53.728082 n-d-846463-3 devstack@n-api.service[106612]: X-Project-Name: admin Sep 23 04:22:53.728082 n-d-846463-3 devstack@n-api.service[106612]: X-Role: reader,admin,member Sep 23 04:22:53.728082 n-d-846463-3 devstack@n-api.service[106612]: X-Roles: reader,admin,member Sep 23 04:22:53.729808 n-d-846463-3 devstack@n-api.service[106612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_81abc1878347454c9540eb18c2f170a2", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/81abc1878347454c9540eb18c2f170a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/81abc1878347454c9540eb18c2f170a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/81abc1878347454c9540eb18c2f170a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:22:53.729808 n-d-846463-3 devstack@n-api.service[106612]: X-Tenant: admin Sep 23 04:22:53.729808 n-d-846463-3 devstack@n-api.service[106612]: X-Tenant-Id: 81abc1878347454c9540eb18c2f170a2 Sep 23 04:22:53.729808 n-d-846463-3 devstack@n-api.service[106612]: X-Tenant-Name: admin Sep 23 04:22:53.729808 n-d-846463-3 devstack@n-api.service[106612]: X-User: admin Sep 23 04:22:53.729808 n-d-846463-3 devstack@n-api.service[106612]: X-User-Domain-Id: default Sep 23 04:22:53.729808 n-d-846463-3 devstack@n-api.service[106612]: X-User-Domain-Name: Default Sep 23 04:22:53.729808 n-d-846463-3 devstack@n-api.service[106612]: X-User-Id: 40a0e911222f4716ac90df65d5c1d033 Sep 23 04:22:53.729808 n-d-846463-3 devstack@n-api.service[106612]: X-User-Name: admin Sep 23 04:22:53.729808 n-d-846463-3 devstack@n-api.service[106612]: method: > Sep 23 04:22:53.729808 n-d-846463-3 devstack@n-api.service[106612]: exception: Flavor 42 could not be found. Sep 23 04:22:53.729808 n-d-846463-3 devstack@n-api.service[106612]: action_args: {'id': '42'} Sep 23 04:22:53.729808 n-d-846463-3 devstack@n-api.service[106612]: {{(pid=106612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:22:53.729808 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:22:53.730922 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 23 04:22:53.730922 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 23 04:22:53.730922 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 23 04:22:53.730922 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 23 04:22:53.730922 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 04:22:53.730922 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 04:22:53.730922 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 23 04:22:53.730922 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 23 04:22:53.730922 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 23 04:22:53.730922 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:22:53.730922 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 23 04:22:53.730922 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 23 04:22:53.730922 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 23 04:22:53.730922 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi Sep 23 04:22:53.730922 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:22:53.730922 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi Sep 23 04:22:53.730922 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:22:53.730922 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:22:53.730922 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:22:53.732289 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:22:53.732289 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:22:53.732289 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:22:53.732289 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:22:53.732289 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 23 04:22:53.732289 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:22:53.732289 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 23 04:22:53.732289 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi Sep 23 04:22:53.732289 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:22:53.732289 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi Sep 23 04:22:53.732289 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:22:53.732289 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:22:53.732289 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:22:53.732289 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:22:53.732289 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:22:53.732289 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 23 04:22:53.732289 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi Sep 23 04:22:53.732289 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi [None req-c219b23c-edf6-4ac7-86b9-cb5762517b89 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:22:53.733552 n-d-846463-3 devstack@n-api.service[106612]: INFO nova.api.openstack.requestlog [None req-c219b23c-edf6-4ac7-86b9-cb5762517b89 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.408788 Sep 23 04:22:53.733552 n-d-846463-3 devstack@n-api.service[106612]: [pid: 106612|app: 0|req: 19/39] 10.222.0.33 () {60 vars in 1190 bytes} [Fri Sep 23 04:22:53 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 410 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 23 04:22:53.739797 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi [None req-4c8702a9-a0e0-49d7-aef9-1dab228966e3 admin admin] Calling method '>' {{(pid=106611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:22:53.761721 n-d-846463-3 devstack@n-api.service[106611]: INFO nova.api.openstack.requestlog [None req-4c8702a9-a0e0-49d7-aef9-1dab228966e3 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.025837 Sep 23 04:22:53.762311 n-d-846463-3 devstack@n-api.service[106611]: [pid: 106611|app: 0|req: 21/40] 10.222.0.33 () {60 vars in 1210 bytes} [Fri Sep 23 04:22:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:22:53.785083 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi [None req-5b27a75c-8d71-4934-acef-0ce299f3e796 admin admin] Calling method '>' {{(pid=106612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:22:53.807103 n-d-846463-3 devstack@n-api.service[106612]: INFO nova.api.openstack.requestlog [None req-5b27a75c-8d71-4934-acef-0ce299f3e796 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027350 Sep 23 04:22:53.807634 n-d-846463-3 devstack@n-api.service[106612]: [pid: 106612|app: 0|req: 20/41] 10.222.0.33 () {60 vars in 1210 bytes} [Fri Sep 23 04:22:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:22:53.817334 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi [None req-f6e73ceb-e886-40a3-b986-c6ebc6fa16aa admin admin] Calling method '>' {{(pid=106611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:22:53.823181 n-d-846463-3 devstack@n-api.service[106611]: INFO nova.api.openstack.wsgi [None req-f6e73ceb-e886-40a3-b986-c6ebc6fa16aa admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 23 04:22:53.826688 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi [None req-f6e73ceb-e886-40a3-b986-c6ebc6fa16aa admin admin] Request method failure captured: Sep 23 04:22:53.826688 n-d-846463-3 devstack@n-api.service[106611]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 23 04:22:53.826688 n-d-846463-3 devstack@n-api.service[106611]: Accept: application/json Sep 23 04:22:53.826688 n-d-846463-3 devstack@n-api.service[106611]: Accept-Encoding: gzip, deflate Sep 23 04:22:53.826688 n-d-846463-3 devstack@n-api.service[106611]: Connection: keep-alive Sep 23 04:22:53.826688 n-d-846463-3 devstack@n-api.service[106611]: Content-Length: 0 Sep 23 04:22:53.826688 n-d-846463-3 devstack@n-api.service[106611]: Host: 10.222.0.33 Sep 23 04:22:53.826688 n-d-846463-3 devstack@n-api.service[106611]: Openstack-Api-Version: compute 2.92 Sep 23 04:22:53.826688 n-d-846463-3 devstack@n-api.service[106611]: Openstack-System-Scope: None Sep 23 04:22:53.826688 n-d-846463-3 devstack@n-api.service[106611]: User-Agent: python-novaclient Sep 23 04:22:53.826688 n-d-846463-3 devstack@n-api.service[106611]: X-Auth-Token: gAAAAABjLTSdrt2m5aPYLyruTIgwi6eoMJR0cJR2QCyIWdqH5xr9UHbJY_8lzP-6Y79AfkGyM8HBXissp_oLE6A-gM43aNarXw2jcqWyGDsMOVLfa57biemIbyPN1daXXcSRKBY6Til4RvXAxJdZQym12gcVS1jKNgOL6Z5HuF1CyPpLBDz8384 Sep 23 04:22:53.826688 n-d-846463-3 devstack@n-api.service[106611]: X-Domain-Id: None Sep 23 04:22:53.826688 n-d-846463-3 devstack@n-api.service[106611]: X-Domain-Name: None Sep 23 04:22:53.826688 n-d-846463-3 devstack@n-api.service[106611]: X-Identity-Status: Confirmed Sep 23 04:22:53.826688 n-d-846463-3 devstack@n-api.service[106611]: X-Is-Admin-Project: True Sep 23 04:22:53.826688 n-d-846463-3 devstack@n-api.service[106611]: X-Openstack-Nova-Api-Version: 2.92 Sep 23 04:22:53.826688 n-d-846463-3 devstack@n-api.service[106611]: X-Project-Domain-Id: default Sep 23 04:22:53.826688 n-d-846463-3 devstack@n-api.service[106611]: X-Project-Domain-Name: Default Sep 23 04:22:53.826688 n-d-846463-3 devstack@n-api.service[106611]: X-Project-Id: 81abc1878347454c9540eb18c2f170a2 Sep 23 04:22:53.826688 n-d-846463-3 devstack@n-api.service[106611]: X-Project-Name: admin Sep 23 04:22:53.826688 n-d-846463-3 devstack@n-api.service[106611]: X-Role: reader,admin,member Sep 23 04:22:53.826688 n-d-846463-3 devstack@n-api.service[106611]: X-Roles: reader,admin,member Sep 23 04:22:53.828816 n-d-846463-3 devstack@n-api.service[106611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_81abc1878347454c9540eb18c2f170a2", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/81abc1878347454c9540eb18c2f170a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/81abc1878347454c9540eb18c2f170a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/81abc1878347454c9540eb18c2f170a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:22:53.828816 n-d-846463-3 devstack@n-api.service[106611]: X-Tenant: admin Sep 23 04:22:53.828816 n-d-846463-3 devstack@n-api.service[106611]: X-Tenant-Id: 81abc1878347454c9540eb18c2f170a2 Sep 23 04:22:53.828816 n-d-846463-3 devstack@n-api.service[106611]: X-Tenant-Name: admin Sep 23 04:22:53.828816 n-d-846463-3 devstack@n-api.service[106611]: X-User: admin Sep 23 04:22:53.828816 n-d-846463-3 devstack@n-api.service[106611]: X-User-Domain-Id: default Sep 23 04:22:53.828816 n-d-846463-3 devstack@n-api.service[106611]: X-User-Domain-Name: Default Sep 23 04:22:53.828816 n-d-846463-3 devstack@n-api.service[106611]: X-User-Id: 40a0e911222f4716ac90df65d5c1d033 Sep 23 04:22:53.828816 n-d-846463-3 devstack@n-api.service[106611]: X-User-Name: admin Sep 23 04:22:53.828816 n-d-846463-3 devstack@n-api.service[106611]: method: > Sep 23 04:22:53.828816 n-d-846463-3 devstack@n-api.service[106611]: exception: Flavor 42 could not be found. Sep 23 04:22:53.828816 n-d-846463-3 devstack@n-api.service[106611]: action_args: {'id': '42'} Sep 23 04:22:53.828816 n-d-846463-3 devstack@n-api.service[106611]: {{(pid=106611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:22:53.828816 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:22:53.829754 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 23 04:22:53.829754 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 23 04:22:53.829754 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 23 04:22:53.829754 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 23 04:22:53.829754 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 04:22:53.829754 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 04:22:53.829754 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 23 04:22:53.829754 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 23 04:22:53.829754 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 23 04:22:53.829754 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:22:53.829754 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 23 04:22:53.829754 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 23 04:22:53.829754 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 23 04:22:53.829754 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi Sep 23 04:22:53.829754 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:22:53.829754 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi Sep 23 04:22:53.829754 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:22:53.829754 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:22:53.829754 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:22:53.831045 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:22:53.831045 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:22:53.831045 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:22:53.831045 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:22:53.831045 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 23 04:22:53.831045 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:22:53.831045 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 23 04:22:53.831045 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi Sep 23 04:22:53.831045 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:22:53.831045 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi Sep 23 04:22:53.831045 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:22:53.831045 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:22:53.831045 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:22:53.831045 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:22:53.831045 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:22:53.831045 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 23 04:22:53.831045 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi Sep 23 04:22:53.831045 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi [None req-f6e73ceb-e886-40a3-b986-c6ebc6fa16aa admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:22:53.832313 n-d-846463-3 devstack@n-api.service[106611]: INFO nova.api.openstack.requestlog [None req-f6e73ceb-e886-40a3-b986-c6ebc6fa16aa admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014694 Sep 23 04:22:53.832313 n-d-846463-3 devstack@n-api.service[106611]: [pid: 106611|app: 0|req: 22/42] 10.222.0.33 () {60 vars in 1190 bytes} [Fri Sep 23 04:22:53 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 23 04:22:55.041986 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi [None req-5b27a75c-8d71-4934-acef-0ce299f3e796 admin admin] Calling method '>' {{(pid=106612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:22:55.043004 n-d-846463-3 devstack@n-api.service[106612]: INFO nova.api.openstack.requestlog [None req-5b27a75c-8d71-4934-acef-0ce299f3e796 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Sep 23 04:22:55.043406 n-d-846463-3 devstack@n-api.service[106612]: [pid: 106612|app: 0|req: 21/43] 10.222.0.33 () {56 vars in 1074 bytes} [Fri Sep 23 04:22:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:22:55.563201 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi [None req-12acfd38-08e4-4d66-8c1f-75597991c0ee admin admin] Calling method '>' {{(pid=106611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:22:55.568130 n-d-846463-3 devstack@n-api.service[106611]: INFO nova.api.openstack.wsgi [None req-12acfd38-08e4-4d66-8c1f-75597991c0ee admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 23 04:22:55.569617 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi [None req-12acfd38-08e4-4d66-8c1f-75597991c0ee admin admin] Request method failure captured: Sep 23 04:22:55.569617 n-d-846463-3 devstack@n-api.service[106611]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 23 04:22:55.569617 n-d-846463-3 devstack@n-api.service[106611]: Accept: application/json Sep 23 04:22:55.569617 n-d-846463-3 devstack@n-api.service[106611]: Accept-Encoding: gzip, deflate Sep 23 04:22:55.569617 n-d-846463-3 devstack@n-api.service[106611]: Connection: keep-alive Sep 23 04:22:55.569617 n-d-846463-3 devstack@n-api.service[106611]: Content-Length: 0 Sep 23 04:22:55.569617 n-d-846463-3 devstack@n-api.service[106611]: Host: 10.222.0.33 Sep 23 04:22:55.569617 n-d-846463-3 devstack@n-api.service[106611]: Openstack-Api-Version: compute 2.92 Sep 23 04:22:55.569617 n-d-846463-3 devstack@n-api.service[106611]: Openstack-System-Scope: None Sep 23 04:22:55.569617 n-d-846463-3 devstack@n-api.service[106611]: User-Agent: python-novaclient Sep 23 04:22:55.569617 n-d-846463-3 devstack@n-api.service[106611]: X-Auth-Token: gAAAAABjLTSeG5zv2ONAlMmqEHjVMjI90KPbLMznxpWgrbbLd-0sOdXf5vuqRhWy-we0H5Rjb_9inLxvgub7F6aSN4pjOVQNtds0yug_mD47TlyWmBAeQaEHotDZKcVQYbUQ_UU6jkjSN2aQdHI_3IvQXno59nFuGRGAjzLSxS1HOSMrMn30nWY Sep 23 04:22:55.569617 n-d-846463-3 devstack@n-api.service[106611]: X-Domain-Id: None Sep 23 04:22:55.569617 n-d-846463-3 devstack@n-api.service[106611]: X-Domain-Name: None Sep 23 04:22:55.569617 n-d-846463-3 devstack@n-api.service[106611]: X-Identity-Status: Confirmed Sep 23 04:22:55.569617 n-d-846463-3 devstack@n-api.service[106611]: X-Is-Admin-Project: True Sep 23 04:22:55.569617 n-d-846463-3 devstack@n-api.service[106611]: X-Openstack-Nova-Api-Version: 2.92 Sep 23 04:22:55.569617 n-d-846463-3 devstack@n-api.service[106611]: X-Project-Domain-Id: default Sep 23 04:22:55.569617 n-d-846463-3 devstack@n-api.service[106611]: X-Project-Domain-Name: Default Sep 23 04:22:55.569617 n-d-846463-3 devstack@n-api.service[106611]: X-Project-Id: 81abc1878347454c9540eb18c2f170a2 Sep 23 04:22:55.569617 n-d-846463-3 devstack@n-api.service[106611]: X-Project-Name: admin Sep 23 04:22:55.569617 n-d-846463-3 devstack@n-api.service[106611]: X-Role: reader,admin,member Sep 23 04:22:55.569617 n-d-846463-3 devstack@n-api.service[106611]: X-Roles: reader,admin,member Sep 23 04:22:55.571156 n-d-846463-3 devstack@n-api.service[106611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_81abc1878347454c9540eb18c2f170a2", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/81abc1878347454c9540eb18c2f170a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/81abc1878347454c9540eb18c2f170a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/81abc1878347454c9540eb18c2f170a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:22:55.571156 n-d-846463-3 devstack@n-api.service[106611]: X-Tenant: admin Sep 23 04:22:55.571156 n-d-846463-3 devstack@n-api.service[106611]: X-Tenant-Id: 81abc1878347454c9540eb18c2f170a2 Sep 23 04:22:55.571156 n-d-846463-3 devstack@n-api.service[106611]: X-Tenant-Name: admin Sep 23 04:22:55.571156 n-d-846463-3 devstack@n-api.service[106611]: X-User: admin Sep 23 04:22:55.571156 n-d-846463-3 devstack@n-api.service[106611]: X-User-Domain-Id: default Sep 23 04:22:55.571156 n-d-846463-3 devstack@n-api.service[106611]: X-User-Domain-Name: Default Sep 23 04:22:55.571156 n-d-846463-3 devstack@n-api.service[106611]: X-User-Id: 40a0e911222f4716ac90df65d5c1d033 Sep 23 04:22:55.571156 n-d-846463-3 devstack@n-api.service[106611]: X-User-Name: admin Sep 23 04:22:55.571156 n-d-846463-3 devstack@n-api.service[106611]: method: > Sep 23 04:22:55.571156 n-d-846463-3 devstack@n-api.service[106611]: exception: Flavor 84 could not be found. Sep 23 04:22:55.571156 n-d-846463-3 devstack@n-api.service[106611]: action_args: {'id': '84'} Sep 23 04:22:55.571156 n-d-846463-3 devstack@n-api.service[106611]: {{(pid=106611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:22:55.571156 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:22:55.572225 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 23 04:22:55.572225 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 23 04:22:55.572225 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 23 04:22:55.572225 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 23 04:22:55.572225 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 04:22:55.572225 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 04:22:55.572225 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 23 04:22:55.572225 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 23 04:22:55.572225 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 23 04:22:55.572225 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:22:55.572225 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 23 04:22:55.572225 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 23 04:22:55.572225 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 23 04:22:55.572225 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi Sep 23 04:22:55.572225 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:22:55.572225 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi Sep 23 04:22:55.572225 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:22:55.572225 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:22:55.572225 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:22:55.573677 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:22:55.573677 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:22:55.573677 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:22:55.573677 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:22:55.573677 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 23 04:22:55.573677 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:22:55.573677 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 23 04:22:55.573677 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi Sep 23 04:22:55.573677 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:22:55.573677 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi Sep 23 04:22:55.573677 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:22:55.573677 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:22:55.573677 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:22:55.573677 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:22:55.573677 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:22:55.573677 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 23 04:22:55.573677 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi Sep 23 04:22:55.573677 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi [None req-12acfd38-08e4-4d66-8c1f-75597991c0ee admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:22:55.575010 n-d-846463-3 devstack@n-api.service[106611]: INFO nova.api.openstack.requestlog [None req-12acfd38-08e4-4d66-8c1f-75597991c0ee admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.392310 Sep 23 04:22:55.575010 n-d-846463-3 devstack@n-api.service[106611]: [pid: 106611|app: 0|req: 23/44] 10.222.0.33 () {60 vars in 1190 bytes} [Fri Sep 23 04:22:55 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 393 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 23 04:22:55.581397 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi [None req-a529edac-33b0-4db4-b844-42c551e860d3 admin admin] Calling method '>' {{(pid=106612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:22:55.596097 n-d-846463-3 devstack@n-api.service[106612]: INFO nova.api.openstack.requestlog [None req-a529edac-33b0-4db4-b844-42c551e860d3 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018871 Sep 23 04:22:55.596617 n-d-846463-3 devstack@n-api.service[106612]: [pid: 106612|app: 0|req: 22/45] 10.222.0.33 () {60 vars in 1210 bytes} [Fri Sep 23 04:22:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:22:55.605746 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi [None req-d5f06586-abde-428e-9230-47dafaf77097 admin admin] Calling method '>' {{(pid=106611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:22:55.620875 n-d-846463-3 devstack@n-api.service[106611]: INFO nova.api.openstack.requestlog [None req-d5f06586-abde-428e-9230-47dafaf77097 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018677 Sep 23 04:22:55.621400 n-d-846463-3 devstack@n-api.service[106611]: [pid: 106611|app: 0|req: 24/46] 10.222.0.33 () {60 vars in 1210 bytes} [Fri Sep 23 04:22:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:22:55.630858 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi [None req-f1f30466-7bf2-4df0-9a2b-2dbaab671e16 admin admin] Calling method '>' {{(pid=106612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:22:55.635696 n-d-846463-3 devstack@n-api.service[106612]: INFO nova.api.openstack.wsgi [None req-f1f30466-7bf2-4df0-9a2b-2dbaab671e16 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 23 04:22:55.637187 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi [None req-f1f30466-7bf2-4df0-9a2b-2dbaab671e16 admin admin] Request method failure captured: Sep 23 04:22:55.637187 n-d-846463-3 devstack@n-api.service[106612]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 23 04:22:55.637187 n-d-846463-3 devstack@n-api.service[106612]: Accept: application/json Sep 23 04:22:55.637187 n-d-846463-3 devstack@n-api.service[106612]: Accept-Encoding: gzip, deflate Sep 23 04:22:55.637187 n-d-846463-3 devstack@n-api.service[106612]: Connection: keep-alive Sep 23 04:22:55.637187 n-d-846463-3 devstack@n-api.service[106612]: Content-Length: 0 Sep 23 04:22:55.637187 n-d-846463-3 devstack@n-api.service[106612]: Host: 10.222.0.33 Sep 23 04:22:55.637187 n-d-846463-3 devstack@n-api.service[106612]: Openstack-Api-Version: compute 2.92 Sep 23 04:22:55.637187 n-d-846463-3 devstack@n-api.service[106612]: Openstack-System-Scope: None Sep 23 04:22:55.637187 n-d-846463-3 devstack@n-api.service[106612]: User-Agent: python-novaclient Sep 23 04:22:55.637187 n-d-846463-3 devstack@n-api.service[106612]: X-Auth-Token: gAAAAABjLTSeG5zv2ONAlMmqEHjVMjI90KPbLMznxpWgrbbLd-0sOdXf5vuqRhWy-we0H5Rjb_9inLxvgub7F6aSN4pjOVQNtds0yug_mD47TlyWmBAeQaEHotDZKcVQYbUQ_UU6jkjSN2aQdHI_3IvQXno59nFuGRGAjzLSxS1HOSMrMn30nWY Sep 23 04:22:55.637187 n-d-846463-3 devstack@n-api.service[106612]: X-Domain-Id: None Sep 23 04:22:55.637187 n-d-846463-3 devstack@n-api.service[106612]: X-Domain-Name: None Sep 23 04:22:55.637187 n-d-846463-3 devstack@n-api.service[106612]: X-Identity-Status: Confirmed Sep 23 04:22:55.637187 n-d-846463-3 devstack@n-api.service[106612]: X-Is-Admin-Project: True Sep 23 04:22:55.637187 n-d-846463-3 devstack@n-api.service[106612]: X-Openstack-Nova-Api-Version: 2.92 Sep 23 04:22:55.637187 n-d-846463-3 devstack@n-api.service[106612]: X-Project-Domain-Id: default Sep 23 04:22:55.637187 n-d-846463-3 devstack@n-api.service[106612]: X-Project-Domain-Name: Default Sep 23 04:22:55.637187 n-d-846463-3 devstack@n-api.service[106612]: X-Project-Id: 81abc1878347454c9540eb18c2f170a2 Sep 23 04:22:55.637187 n-d-846463-3 devstack@n-api.service[106612]: X-Project-Name: admin Sep 23 04:22:55.637187 n-d-846463-3 devstack@n-api.service[106612]: X-Role: reader,admin,member Sep 23 04:22:55.637187 n-d-846463-3 devstack@n-api.service[106612]: X-Roles: reader,admin,member Sep 23 04:22:55.638614 n-d-846463-3 devstack@n-api.service[106612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_81abc1878347454c9540eb18c2f170a2", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/81abc1878347454c9540eb18c2f170a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/81abc1878347454c9540eb18c2f170a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/81abc1878347454c9540eb18c2f170a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:22:55.638614 n-d-846463-3 devstack@n-api.service[106612]: X-Tenant: admin Sep 23 04:22:55.638614 n-d-846463-3 devstack@n-api.service[106612]: X-Tenant-Id: 81abc1878347454c9540eb18c2f170a2 Sep 23 04:22:55.638614 n-d-846463-3 devstack@n-api.service[106612]: X-Tenant-Name: admin Sep 23 04:22:55.638614 n-d-846463-3 devstack@n-api.service[106612]: X-User: admin Sep 23 04:22:55.638614 n-d-846463-3 devstack@n-api.service[106612]: X-User-Domain-Id: default Sep 23 04:22:55.638614 n-d-846463-3 devstack@n-api.service[106612]: X-User-Domain-Name: Default Sep 23 04:22:55.638614 n-d-846463-3 devstack@n-api.service[106612]: X-User-Id: 40a0e911222f4716ac90df65d5c1d033 Sep 23 04:22:55.638614 n-d-846463-3 devstack@n-api.service[106612]: X-User-Name: admin Sep 23 04:22:55.638614 n-d-846463-3 devstack@n-api.service[106612]: method: > Sep 23 04:22:55.638614 n-d-846463-3 devstack@n-api.service[106612]: exception: Flavor 84 could not be found. Sep 23 04:22:55.638614 n-d-846463-3 devstack@n-api.service[106612]: action_args: {'id': '84'} Sep 23 04:22:55.638614 n-d-846463-3 devstack@n-api.service[106612]: {{(pid=106612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:22:55.638614 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:22:55.639389 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 23 04:22:55.639389 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 23 04:22:55.639389 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 23 04:22:55.639389 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 23 04:22:55.639389 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 04:22:55.639389 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 04:22:55.639389 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 23 04:22:55.639389 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 23 04:22:55.639389 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 23 04:22:55.639389 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:22:55.639389 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 23 04:22:55.639389 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 23 04:22:55.639389 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 23 04:22:55.639389 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi Sep 23 04:22:55.639389 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:22:55.639389 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi Sep 23 04:22:55.639389 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:22:55.639389 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:22:55.639389 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:22:55.640482 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:22:55.640482 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:22:55.640482 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:22:55.640482 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:22:55.640482 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 23 04:22:55.640482 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:22:55.640482 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 23 04:22:55.640482 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi Sep 23 04:22:55.640482 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:22:55.640482 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi Sep 23 04:22:55.640482 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:22:55.640482 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:22:55.640482 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:22:55.640482 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:22:55.640482 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:22:55.640482 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 23 04:22:55.640482 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi Sep 23 04:22:55.640482 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi [None req-f1f30466-7bf2-4df0-9a2b-2dbaab671e16 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:22:55.642189 n-d-846463-3 devstack@n-api.service[106612]: INFO nova.api.openstack.requestlog [None req-f1f30466-7bf2-4df0-9a2b-2dbaab671e16 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011147 Sep 23 04:22:55.642189 n-d-846463-3 devstack@n-api.service[106612]: [pid: 106612|app: 0|req: 23/47] 10.222.0.33 () {60 vars in 1190 bytes} [Fri Sep 23 04:22:55 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 23 04:22:56.855134 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi [None req-d5f06586-abde-428e-9230-47dafaf77097 admin admin] Calling method '>' {{(pid=106611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:22:56.856135 n-d-846463-3 devstack@n-api.service[106611]: INFO nova.api.openstack.requestlog [None req-d5f06586-abde-428e-9230-47dafaf77097 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Sep 23 04:22:56.856536 n-d-846463-3 devstack@n-api.service[106611]: [pid: 106611|app: 0|req: 25/48] 10.222.0.33 () {56 vars in 1074 bytes} [Fri Sep 23 04:22:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:22:57.500750 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi [None req-96ac5d41-c0ca-48bd-8c57-285d95552db6 admin admin] Calling method '>' {{(pid=106612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:22:57.506567 n-d-846463-3 devstack@n-api.service[106612]: INFO nova.api.openstack.wsgi [None req-96ac5d41-c0ca-48bd-8c57-285d95552db6 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 23 04:22:57.508070 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi [None req-96ac5d41-c0ca-48bd-8c57-285d95552db6 admin admin] Request method failure captured: Sep 23 04:22:57.508070 n-d-846463-3 devstack@n-api.service[106612]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 23 04:22:57.508070 n-d-846463-3 devstack@n-api.service[106612]: Accept: application/json Sep 23 04:22:57.508070 n-d-846463-3 devstack@n-api.service[106612]: Accept-Encoding: gzip, deflate Sep 23 04:22:57.508070 n-d-846463-3 devstack@n-api.service[106612]: Connection: keep-alive Sep 23 04:22:57.508070 n-d-846463-3 devstack@n-api.service[106612]: Content-Length: 0 Sep 23 04:22:57.508070 n-d-846463-3 devstack@n-api.service[106612]: Host: 10.222.0.33 Sep 23 04:22:57.508070 n-d-846463-3 devstack@n-api.service[106612]: Openstack-Api-Version: compute 2.92 Sep 23 04:22:57.508070 n-d-846463-3 devstack@n-api.service[106612]: Openstack-System-Scope: None Sep 23 04:22:57.508070 n-d-846463-3 devstack@n-api.service[106612]: User-Agent: python-novaclient Sep 23 04:22:57.508070 n-d-846463-3 devstack@n-api.service[106612]: X-Auth-Token: gAAAAABjLTSg00pF1l5vhj3PZr2UmobVxlUyE2TeqGcvTU41db9rgj1rtMi2KUyoljVZetCEti1ukyfJOsMOtFToZ_PHgQdV03GlyS1aNmaRxB0ajtUcwd_vsdLkljzfHs9y46qI7Qsm7-i2dmpX_nY-0-Ta0Y8Gb63aOwhKytb9yXJUBWMHbtU Sep 23 04:22:57.508070 n-d-846463-3 devstack@n-api.service[106612]: X-Domain-Id: None Sep 23 04:22:57.508070 n-d-846463-3 devstack@n-api.service[106612]: X-Domain-Name: None Sep 23 04:22:57.508070 n-d-846463-3 devstack@n-api.service[106612]: X-Identity-Status: Confirmed Sep 23 04:22:57.508070 n-d-846463-3 devstack@n-api.service[106612]: X-Is-Admin-Project: True Sep 23 04:22:57.508070 n-d-846463-3 devstack@n-api.service[106612]: X-Openstack-Nova-Api-Version: 2.92 Sep 23 04:22:57.508070 n-d-846463-3 devstack@n-api.service[106612]: X-Project-Domain-Id: default Sep 23 04:22:57.508070 n-d-846463-3 devstack@n-api.service[106612]: X-Project-Domain-Name: Default Sep 23 04:22:57.508070 n-d-846463-3 devstack@n-api.service[106612]: X-Project-Id: 81abc1878347454c9540eb18c2f170a2 Sep 23 04:22:57.508070 n-d-846463-3 devstack@n-api.service[106612]: X-Project-Name: admin Sep 23 04:22:57.508070 n-d-846463-3 devstack@n-api.service[106612]: X-Role: reader,admin,member Sep 23 04:22:57.508070 n-d-846463-3 devstack@n-api.service[106612]: X-Roles: reader,admin,member Sep 23 04:22:57.509604 n-d-846463-3 devstack@n-api.service[106612]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_81abc1878347454c9540eb18c2f170a2", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/81abc1878347454c9540eb18c2f170a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/81abc1878347454c9540eb18c2f170a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/81abc1878347454c9540eb18c2f170a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:22:57.509604 n-d-846463-3 devstack@n-api.service[106612]: X-Tenant: admin Sep 23 04:22:57.509604 n-d-846463-3 devstack@n-api.service[106612]: X-Tenant-Id: 81abc1878347454c9540eb18c2f170a2 Sep 23 04:22:57.509604 n-d-846463-3 devstack@n-api.service[106612]: X-Tenant-Name: admin Sep 23 04:22:57.509604 n-d-846463-3 devstack@n-api.service[106612]: X-User: admin Sep 23 04:22:57.509604 n-d-846463-3 devstack@n-api.service[106612]: X-User-Domain-Id: default Sep 23 04:22:57.509604 n-d-846463-3 devstack@n-api.service[106612]: X-User-Domain-Name: Default Sep 23 04:22:57.509604 n-d-846463-3 devstack@n-api.service[106612]: X-User-Id: 40a0e911222f4716ac90df65d5c1d033 Sep 23 04:22:57.509604 n-d-846463-3 devstack@n-api.service[106612]: X-User-Name: admin Sep 23 04:22:57.509604 n-d-846463-3 devstack@n-api.service[106612]: method: > Sep 23 04:22:57.509604 n-d-846463-3 devstack@n-api.service[106612]: exception: Flavor 451 could not be found. Sep 23 04:22:57.509604 n-d-846463-3 devstack@n-api.service[106612]: action_args: {'id': '451'} Sep 23 04:22:57.509604 n-d-846463-3 devstack@n-api.service[106612]: {{(pid=106612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:22:57.509604 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:22:57.510625 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 23 04:22:57.510625 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 23 04:22:57.510625 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 23 04:22:57.510625 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 23 04:22:57.510625 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 04:22:57.510625 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 04:22:57.510625 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 23 04:22:57.510625 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 23 04:22:57.510625 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 23 04:22:57.510625 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:22:57.510625 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 23 04:22:57.510625 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 23 04:22:57.510625 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 23 04:22:57.510625 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi Sep 23 04:22:57.510625 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:22:57.510625 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi Sep 23 04:22:57.510625 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:22:57.510625 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:22:57.510625 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:22:57.511999 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:22:57.511999 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:22:57.511999 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:22:57.511999 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:22:57.511999 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 23 04:22:57.511999 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:22:57.511999 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 23 04:22:57.511999 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi Sep 23 04:22:57.511999 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:22:57.511999 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi Sep 23 04:22:57.511999 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:22:57.511999 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:22:57.511999 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:22:57.511999 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:22:57.511999 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:22:57.511999 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 23 04:22:57.511999 n-d-846463-3 devstack@n-api.service[106612]: ERROR nova.api.openstack.wsgi Sep 23 04:22:57.511999 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi [None req-96ac5d41-c0ca-48bd-8c57-285d95552db6 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106612) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:22:57.513315 n-d-846463-3 devstack@n-api.service[106612]: INFO nova.api.openstack.requestlog [None req-96ac5d41-c0ca-48bd-8c57-285d95552db6 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.511339 Sep 23 04:22:57.513315 n-d-846463-3 devstack@n-api.service[106612]: [pid: 106612|app: 0|req: 24/49] 10.222.0.33 () {60 vars in 1193 bytes} [Fri Sep 23 04:22:56 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 512 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 23 04:22:57.520560 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi [None req-c70e88dd-db27-40d1-b083-23384376934d admin admin] Calling method '>' {{(pid=106611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:22:57.536054 n-d-846463-3 devstack@n-api.service[106611]: INFO nova.api.openstack.requestlog [None req-c70e88dd-db27-40d1-b083-23384376934d admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.020422 Sep 23 04:22:57.536770 n-d-846463-3 devstack@n-api.service[106611]: [pid: 106611|app: 0|req: 26/50] 10.222.0.33 () {60 vars in 1210 bytes} [Fri Sep 23 04:22:57 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:22:57.546118 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi [None req-bc9b4939-167e-437b-8068-2562f017a17c admin admin] Calling method '>' {{(pid=106612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:22:57.560981 n-d-846463-3 devstack@n-api.service[106612]: INFO nova.api.openstack.requestlog [None req-bc9b4939-167e-437b-8068-2562f017a17c admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018372 Sep 23 04:22:57.561517 n-d-846463-3 devstack@n-api.service[106612]: [pid: 106612|app: 0|req: 25/51] 10.222.0.33 () {60 vars in 1210 bytes} [Fri Sep 23 04:22:57 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:22:57.571113 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi [None req-f300fb44-12c0-42fe-b97f-f4c17fdf47c2 admin admin] Calling method '>' {{(pid=106611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:22:57.576118 n-d-846463-3 devstack@n-api.service[106611]: INFO nova.api.openstack.wsgi [None req-f300fb44-12c0-42fe-b97f-f4c17fdf47c2 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 23 04:22:57.577614 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi [None req-f300fb44-12c0-42fe-b97f-f4c17fdf47c2 admin admin] Request method failure captured: Sep 23 04:22:57.577614 n-d-846463-3 devstack@n-api.service[106611]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 23 04:22:57.577614 n-d-846463-3 devstack@n-api.service[106611]: Accept: application/json Sep 23 04:22:57.577614 n-d-846463-3 devstack@n-api.service[106611]: Accept-Encoding: gzip, deflate Sep 23 04:22:57.577614 n-d-846463-3 devstack@n-api.service[106611]: Connection: keep-alive Sep 23 04:22:57.577614 n-d-846463-3 devstack@n-api.service[106611]: Content-Length: 0 Sep 23 04:22:57.577614 n-d-846463-3 devstack@n-api.service[106611]: Host: 10.222.0.33 Sep 23 04:22:57.577614 n-d-846463-3 devstack@n-api.service[106611]: Openstack-Api-Version: compute 2.92 Sep 23 04:22:57.577614 n-d-846463-3 devstack@n-api.service[106611]: Openstack-System-Scope: None Sep 23 04:22:57.577614 n-d-846463-3 devstack@n-api.service[106611]: User-Agent: python-novaclient Sep 23 04:22:57.577614 n-d-846463-3 devstack@n-api.service[106611]: X-Auth-Token: gAAAAABjLTSg00pF1l5vhj3PZr2UmobVxlUyE2TeqGcvTU41db9rgj1rtMi2KUyoljVZetCEti1ukyfJOsMOtFToZ_PHgQdV03GlyS1aNmaRxB0ajtUcwd_vsdLkljzfHs9y46qI7Qsm7-i2dmpX_nY-0-Ta0Y8Gb63aOwhKytb9yXJUBWMHbtU Sep 23 04:22:57.577614 n-d-846463-3 devstack@n-api.service[106611]: X-Domain-Id: None Sep 23 04:22:57.577614 n-d-846463-3 devstack@n-api.service[106611]: X-Domain-Name: None Sep 23 04:22:57.577614 n-d-846463-3 devstack@n-api.service[106611]: X-Identity-Status: Confirmed Sep 23 04:22:57.577614 n-d-846463-3 devstack@n-api.service[106611]: X-Is-Admin-Project: True Sep 23 04:22:57.577614 n-d-846463-3 devstack@n-api.service[106611]: X-Openstack-Nova-Api-Version: 2.92 Sep 23 04:22:57.577614 n-d-846463-3 devstack@n-api.service[106611]: X-Project-Domain-Id: default Sep 23 04:22:57.577614 n-d-846463-3 devstack@n-api.service[106611]: X-Project-Domain-Name: Default Sep 23 04:22:57.577614 n-d-846463-3 devstack@n-api.service[106611]: X-Project-Id: 81abc1878347454c9540eb18c2f170a2 Sep 23 04:22:57.577614 n-d-846463-3 devstack@n-api.service[106611]: X-Project-Name: admin Sep 23 04:22:57.577614 n-d-846463-3 devstack@n-api.service[106611]: X-Role: reader,admin,member Sep 23 04:22:57.577614 n-d-846463-3 devstack@n-api.service[106611]: X-Roles: reader,admin,member Sep 23 04:22:57.579771 n-d-846463-3 devstack@n-api.service[106611]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_81abc1878347454c9540eb18c2f170a2", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/81abc1878347454c9540eb18c2f170a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/81abc1878347454c9540eb18c2f170a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/81abc1878347454c9540eb18c2f170a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:22:57.579771 n-d-846463-3 devstack@n-api.service[106611]: X-Tenant: admin Sep 23 04:22:57.579771 n-d-846463-3 devstack@n-api.service[106611]: X-Tenant-Id: 81abc1878347454c9540eb18c2f170a2 Sep 23 04:22:57.579771 n-d-846463-3 devstack@n-api.service[106611]: X-Tenant-Name: admin Sep 23 04:22:57.579771 n-d-846463-3 devstack@n-api.service[106611]: X-User: admin Sep 23 04:22:57.579771 n-d-846463-3 devstack@n-api.service[106611]: X-User-Domain-Id: default Sep 23 04:22:57.579771 n-d-846463-3 devstack@n-api.service[106611]: X-User-Domain-Name: Default Sep 23 04:22:57.579771 n-d-846463-3 devstack@n-api.service[106611]: X-User-Id: 40a0e911222f4716ac90df65d5c1d033 Sep 23 04:22:57.579771 n-d-846463-3 devstack@n-api.service[106611]: X-User-Name: admin Sep 23 04:22:57.579771 n-d-846463-3 devstack@n-api.service[106611]: method: > Sep 23 04:22:57.579771 n-d-846463-3 devstack@n-api.service[106611]: exception: Flavor 451 could not be found. Sep 23 04:22:57.579771 n-d-846463-3 devstack@n-api.service[106611]: action_args: {'id': '451'} Sep 23 04:22:57.579771 n-d-846463-3 devstack@n-api.service[106611]: {{(pid=106611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:22:57.579771 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:22:57.580831 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 23 04:22:57.580831 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 23 04:22:57.580831 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 23 04:22:57.580831 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 23 04:22:57.580831 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 04:22:57.580831 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 04:22:57.580831 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 23 04:22:57.580831 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 23 04:22:57.580831 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 23 04:22:57.580831 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:22:57.580831 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 23 04:22:57.580831 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 23 04:22:57.580831 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 23 04:22:57.580831 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi Sep 23 04:22:57.580831 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:22:57.580831 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi Sep 23 04:22:57.580831 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:22:57.580831 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:22:57.580831 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:22:57.582387 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:22:57.582387 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:22:57.582387 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:22:57.582387 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:22:57.582387 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 23 04:22:57.582387 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:22:57.582387 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 23 04:22:57.582387 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi Sep 23 04:22:57.582387 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:22:57.582387 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi Sep 23 04:22:57.582387 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:22:57.582387 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:22:57.582387 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:22:57.582387 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:22:57.582387 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:22:57.582387 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 23 04:22:57.582387 n-d-846463-3 devstack@n-api.service[106611]: ERROR nova.api.openstack.wsgi Sep 23 04:22:57.582387 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi [None req-f300fb44-12c0-42fe-b97f-f4c17fdf47c2 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106611) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:22:57.583623 n-d-846463-3 devstack@n-api.service[106611]: INFO nova.api.openstack.requestlog [None req-f300fb44-12c0-42fe-b97f-f4c17fdf47c2 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.012064 Sep 23 04:22:57.583623 n-d-846463-3 devstack@n-api.service[106611]: [pid: 106611|app: 0|req: 27/52] 10.222.0.33 () {60 vars in 1193 bytes} [Fri Sep 23 04:22:57 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 23 04:22:58.794659 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi [None req-bc9b4939-167e-437b-8068-2562f017a17c admin admin] Calling method '>' {{(pid=106612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:22:58.795677 n-d-846463-3 devstack@n-api.service[106612]: INFO nova.api.openstack.requestlog [None req-bc9b4939-167e-437b-8068-2562f017a17c admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Sep 23 04:22:58.796076 n-d-846463-3 devstack@n-api.service[106612]: [pid: 106612|app: 0|req: 26/53] 10.222.0.33 () {56 vars in 1074 bytes} [Fri Sep 23 04:22:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:22:59.316750 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi [None req-79828b67-e3b1-4616-a690-9adc4981722f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:22:59.372464 n-d-846463-3 devstack@n-api.service[106611]: INFO nova.api.openstack.requestlog [None req-79828b67-e3b1-4616-a690-9adc4981722f admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.437799 Sep 23 04:22:59.373016 n-d-846463-3 devstack@n-api.service[106611]: [pid: 106611|app: 0|req: 28/54] 10.222.0.33 () {64 vars in 1235 bytes} [Fri Sep 23 04:22:58 2022] POST /compute/v2.1/flavors => generated 404 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 04:23:00.582438 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi [None req-bc9b4939-167e-437b-8068-2562f017a17c admin admin] Calling method '>' {{(pid=106612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:23:00.583401 n-d-846463-3 devstack@n-api.service[106612]: INFO nova.api.openstack.requestlog [None req-bc9b4939-167e-437b-8068-2562f017a17c admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Sep 23 04:23:00.583797 n-d-846463-3 devstack@n-api.service[106612]: [pid: 106612|app: 0|req: 27/55] 10.222.0.33 () {56 vars in 1074 bytes} [Fri Sep 23 04:23:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:23:01.103013 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi [None req-026343a5-586c-4b4d-8f84-1f4962962bbd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:23:01.171876 n-d-846463-3 devstack@n-api.service[106611]: INFO nova.api.openstack.requestlog [None req-026343a5-586c-4b4d-8f84-1f4962962bbd admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.450728 Sep 23 04:23:01.172364 n-d-846463-3 devstack@n-api.service[106611]: [pid: 106611|app: 0|req: 29/56] 10.222.0.33 () {64 vars in 1235 bytes} [Fri Sep 23 04:23:00 2022] POST /compute/v2.1/flavors => generated 405 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 04:23:02.405200 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi [None req-bc9b4939-167e-437b-8068-2562f017a17c admin admin] Calling method '>' {{(pid=106612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:23:02.406951 n-d-846463-3 devstack@n-api.service[106612]: INFO nova.api.openstack.requestlog [None req-bc9b4939-167e-437b-8068-2562f017a17c admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Sep 23 04:23:02.407402 n-d-846463-3 devstack@n-api.service[106612]: [pid: 106612|app: 0|req: 28/57] 10.222.0.33 () {56 vars in 1074 bytes} [Fri Sep 23 04:23:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:23:02.932121 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi [None req-019f7290-d541-4f0d-bc0e-fb0766842379 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:23:03.036161 n-d-846463-3 devstack@n-api.service[106611]: INFO nova.api.openstack.requestlog [None req-019f7290-d541-4f0d-bc0e-fb0766842379 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.491397 Sep 23 04:23:03.036713 n-d-846463-3 devstack@n-api.service[106611]: [pid: 106611|app: 0|req: 30/58] 10.222.0.33 () {64 vars in 1235 bytes} [Fri Sep 23 04:23:02 2022] POST /compute/v2.1/flavors => generated 407 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 23 04:23:04.260015 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi [None req-bc9b4939-167e-437b-8068-2562f017a17c admin admin] Calling method '>' {{(pid=106612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:23:04.261024 n-d-846463-3 devstack@n-api.service[106612]: INFO nova.api.openstack.requestlog [None req-bc9b4939-167e-437b-8068-2562f017a17c admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Sep 23 04:23:04.261422 n-d-846463-3 devstack@n-api.service[106612]: [pid: 106612|app: 0|req: 29/59] 10.222.0.33 () {56 vars in 1074 bytes} [Fri Sep 23 04:23:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:23:04.780709 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi [None req-c387e68a-a751-42db-8f27-2ff0472d6575 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:23:04.857767 n-d-846463-3 devstack@n-api.service[106611]: INFO nova.api.openstack.requestlog [None req-c387e68a-a751-42db-8f27-2ff0472d6575 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.458509 Sep 23 04:23:04.858356 n-d-846463-3 devstack@n-api.service[106611]: [pid: 106611|app: 0|req: 31/60] 10.222.0.33 () {64 vars in 1235 bytes} [Fri Sep 23 04:23:04 2022] POST /compute/v2.1/flavors => generated 409 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 04:23:06.091578 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi [None req-bc9b4939-167e-437b-8068-2562f017a17c admin admin] Calling method '>' {{(pid=106612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:23:06.092579 n-d-846463-3 devstack@n-api.service[106612]: INFO nova.api.openstack.requestlog [None req-bc9b4939-167e-437b-8068-2562f017a17c admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Sep 23 04:23:06.092976 n-d-846463-3 devstack@n-api.service[106612]: [pid: 106612|app: 0|req: 30/61] 10.222.0.33 () {56 vars in 1074 bytes} [Fri Sep 23 04:23:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:23:06.606534 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi [None req-1432f61d-5737-4855-b97d-1245eb9d5201 admin admin] Calling method '>' {{(pid=106611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:23:06.627231 n-d-846463-3 devstack@n-api.service[106611]: INFO nova.api.openstack.requestlog [None req-1432f61d-5737-4855-b97d-1245eb9d5201 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.399837 Sep 23 04:23:06.627768 n-d-846463-3 devstack@n-api.service[106611]: [pid: 106611|app: 0|req: 32/62] 10.222.0.33 () {60 vars in 1202 bytes} [Fri Sep 23 04:23:06 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:24:03.291837 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi [None req-bc9b4939-167e-437b-8068-2562f017a17c admin admin] Calling method '>' {{(pid=106612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:24:03.292857 n-d-846463-3 devstack@n-api.service[106612]: INFO nova.api.openstack.requestlog [None req-bc9b4939-167e-437b-8068-2562f017a17c admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 Sep 23 04:24:03.293303 n-d-846463-3 devstack@n-api.service[106612]: [pid: 106612|app: 0|req: 31/63] 10.222.0.33 () {54 vars in 931 bytes} [Fri Sep 23 04:24:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:24:03.303869 n-d-846463-3 devstack@n-api.service[106611]: DEBUG dbcounter [-] [106611] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=106611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:24:03.686336 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi [None req-62f6100a-f735-40cc-971c-f0df4415db51 admin admin] Calling method '>' {{(pid=106611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:24:03.707399 n-d-846463-3 devstack@n-api.service[106611]: INFO nova.api.openstack.requestlog [None req-62f6100a-f735-40cc-971c-f0df4415db51 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.407956 Sep 23 04:24:03.707877 n-d-846463-3 devstack@n-api.service[106611]: [pid: 106611|app: 0|req: 33/64] 10.222.0.33 () {60 vars in 1292 bytes} [Fri Sep 23 04:24:03 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:24:03.728528 n-d-846463-3 devstack@n-api.service[106612]: DEBUG dbcounter [-] [106612] Writing DB stats nova_api:SELECT=14 {{(pid=106612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:24:03.732279 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi [None req-b890d5fb-6d75-467c-b5a2-2c28b4fc4c89 admin admin] Calling method '>' {{(pid=106612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:24:03.739662 n-d-846463-3 devstack@n-api.service[106612]: INFO nova.api.openstack.requestlog [None req-b890d5fb-6d75-467c-b5a2-2c28b4fc4c89 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012566 Sep 23 04:24:03.740202 n-d-846463-3 devstack@n-api.service[106612]: [pid: 106612|app: 0|req: 32/65] 10.222.0.33 () {60 vars in 1283 bytes} [Fri Sep 23 04:24:03 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:24:03.752776 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi [None req-9112fa7b-8a60-45fa-a0fa-b02dc99391b3 admin admin] Calling method '>' {{(pid=106611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:24:03.760327 n-d-846463-3 devstack@n-api.service[106611]: INFO nova.api.openstack.requestlog [None req-9112fa7b-8a60-45fa-a0fa-b02dc99391b3 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011542 Sep 23 04:24:03.761226 n-d-846463-3 devstack@n-api.service[106611]: [pid: 106611|app: 0|req: 34/66] 10.222.0.33 () {60 vars in 1286 bytes} [Fri Sep 23 04:24:03 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:24:03.773805 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi [None req-080a9cd2-9a00-4998-b786-3595ac733c86 admin admin] Calling method '>' {{(pid=106612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:24:03.781212 n-d-846463-3 devstack@n-api.service[106612]: INFO nova.api.openstack.requestlog [None req-080a9cd2-9a00-4998-b786-3595ac733c86 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011295 Sep 23 04:24:03.781785 n-d-846463-3 devstack@n-api.service[106612]: [pid: 106612|app: 0|req: 33/67] 10.222.0.33 () {60 vars in 1286 bytes} [Fri Sep 23 04:24:03 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:24:03.793219 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi [None req-2bfe1498-be89-4b17-808b-fef43d0789be admin admin] Calling method '>' {{(pid=106611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:24:03.800772 n-d-846463-3 devstack@n-api.service[106611]: INFO nova.api.openstack.requestlog [None req-2bfe1498-be89-4b17-808b-fef43d0789be admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011118 Sep 23 04:24:03.801279 n-d-846463-3 devstack@n-api.service[106611]: [pid: 106611|app: 0|req: 35/68] 10.222.0.33 () {60 vars in 1283 bytes} [Fri Sep 23 04:24:03 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:29:14.027652 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi [None req-080a9cd2-9a00-4998-b786-3595ac733c86 admin admin] Calling method '>' {{(pid=106612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:29:14.028651 n-d-846463-3 devstack@n-api.service[106612]: INFO nova.api.openstack.requestlog [None req-080a9cd2-9a00-4998-b786-3595ac733c86 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Sep 23 04:29:14.029041 n-d-846463-3 devstack@n-api.service[106612]: [pid: 106612|app: 0|req: 34/69] 10.222.0.33 () {56 vars in 1074 bytes} [Fri Sep 23 04:29:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:29:14.171008 n-d-846463-3 devstack@n-api.service[106611]: DEBUG dbcounter [-] [106611] Writing DB stats nova_api:SELECT=6 {{(pid=106611) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:29:14.313839 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi [None req-7f32f41e-44cc-4391-b2f4-10b1c1ca1e4a admin admin] Calling method '>' {{(pid=106611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:29:14.318486 n-d-846463-3 devstack@n-api.service[106611]: DEBUG oslo_concurrency.lockutils [None req-7f32f41e-44cc-4391-b2f4-10b1c1ca1e4a admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:29:14.318957 n-d-846463-3 devstack@n-api.service[106611]: DEBUG oslo_concurrency.lockutils [None req-7f32f41e-44cc-4391-b2f4-10b1c1ca1e4a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:29:14.319386 n-d-846463-3 devstack@n-api.service[106611]: DEBUG oslo_concurrency.lockutils [None req-7f32f41e-44cc-4391-b2f4-10b1c1ca1e4a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:29:14.320097 n-d-846463-3 devstack@n-api.service[106611]: DEBUG oslo_concurrency.lockutils [None req-7f32f41e-44cc-4391-b2f4-10b1c1ca1e4a admin admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:29:14.320543 n-d-846463-3 devstack@n-api.service[106611]: DEBUG oslo_concurrency.lockutils [None req-7f32f41e-44cc-4391-b2f4-10b1c1ca1e4a admin admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:29:14.320958 n-d-846463-3 devstack@n-api.service[106611]: DEBUG oslo_concurrency.lockutils [None req-7f32f41e-44cc-4391-b2f4-10b1c1ca1e4a admin admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:29:14.359801 n-d-846463-3 devstack@n-api.service[106611]: INFO nova.api.openstack.requestlog [None req-7f32f41e-44cc-4391-b2f4-10b1c1ca1e4a admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.189996 Sep 23 04:29:14.360363 n-d-846463-3 devstack@n-api.service[106611]: [pid: 106611|app: 0|req: 36/70] 10.222.0.33 () {60 vars in 1193 bytes} [Fri Sep 23 04:29:14 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:29:15.438510 n-d-846463-3 devstack@n-api.service[106612]: DEBUG nova.api.openstack.wsgi [None req-080a9cd2-9a00-4998-b786-3595ac733c86 admin admin] Calling method '>' {{(pid=106612) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:29:15.439523 n-d-846463-3 devstack@n-api.service[106612]: INFO nova.api.openstack.requestlog [None req-080a9cd2-9a00-4998-b786-3595ac733c86 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Sep 23 04:29:15.439924 n-d-846463-3 devstack@n-api.service[106612]: [pid: 106612|app: 0|req: 35/71] 10.222.0.33 () {56 vars in 1074 bytes} [Fri Sep 23 04:29:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:29:15.630924 n-d-846463-3 devstack@n-api.service[106611]: DEBUG nova.api.openstack.wsgi [None req-b1b5c867-c424-4fa5-81a0-a57be0ae37ac admin admin] Calling method '>' {{(pid=106611) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:29:15.634893 n-d-846463-3 devstack@n-api.service[106611]: DEBUG oslo_concurrency.lockutils [None req-b1b5c867-c424-4fa5-81a0-a57be0ae37ac admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:29:15.635361 n-d-846463-3 devstack@n-api.service[106611]: DEBUG oslo_concurrency.lockutils [None req-b1b5c867-c424-4fa5-81a0-a57be0ae37ac admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:29:15.635783 n-d-846463-3 devstack@n-api.service[106611]: DEBUG oslo_concurrency.lockutils [None req-b1b5c867-c424-4fa5-81a0-a57be0ae37ac admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:29:15.636484 n-d-846463-3 devstack@n-api.service[106611]: DEBUG oslo_concurrency.lockutils [None req-b1b5c867-c424-4fa5-81a0-a57be0ae37ac admin admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:29:15.636921 n-d-846463-3 devstack@n-api.service[106611]: DEBUG oslo_concurrency.lockutils [None req-b1b5c867-c424-4fa5-81a0-a57be0ae37ac admin admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:29:15.637330 n-d-846463-3 devstack@n-api.service[106611]: DEBUG oslo_concurrency.lockutils [None req-b1b5c867-c424-4fa5-81a0-a57be0ae37ac admin admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106611) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:29:15.659761 n-d-846463-3 devstack@n-api.service[106611]: INFO nova.api.openstack.requestlog [None req-b1b5c867-c424-4fa5-81a0-a57be0ae37ac admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.079544 Sep 23 04:29:15.660298 n-d-846463-3 devstack@n-api.service[106611]: [pid: 106611|app: 0|req: 37/72] 10.222.0.33 () {60 vars in 1193 bytes} [Fri Sep 23 04:29:15 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:29:59.722798 n-d-846463-3 devstack@n-api.service[106610]: Fri Sep 23 04:29:59 2022 - graceful shutdown triggered... Sep 23 04:29:59.723366 n-d-846463-3 devstack@n-api.service[106611]: Gracefully killing worker 1 (pid: 106611)... Sep 23 04:29:59.723840 n-d-846463-3 devstack@n-api.service[106612]: Gracefully killing worker 2 (pid: 106612)... Sep 23 04:29:59.724949 n-d-846463-3 systemd[1]: Stopping Devstack devstack@n-api.service... Sep 23 04:29:59.862264 n-d-846463-3 devstack@n-api.service[106612]: DEBUG dbcounter [-] [106612] Writing DB stats nova_api:SELECT=4 {{(pid=106612) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:30:00.723928 n-d-846463-3 devstack@n-api.service[106610]: worker 1 buried after 1 seconds Sep 23 04:30:00.723928 n-d-846463-3 devstack@n-api.service[106610]: worker 2 buried after 1 seconds Sep 23 04:30:00.723928 n-d-846463-3 devstack@n-api.service[106610]: goodbye to uWSGI. Sep 23 04:30:00.727010 n-d-846463-3 systemd[1]: devstack@n-api.service: Succeeded. Sep 23 04:30:00.727796 n-d-846463-3 systemd[1]: Stopped Devstack devstack@n-api.service. Sep 23 04:30:00.730619 n-d-846463-3 systemd[1]: Starting Devstack devstack@n-api.service... Sep 23 04:30:00.748782 n-d-846463-3 devstack@n-api.service[122643]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 23 04:30:00.771760 n-d-846463-3 devstack@n-api.service[122643]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 23 04:30:00 2022] *** Sep 23 04:30:00.771760 n-d-846463-3 devstack@n-api.service[122643]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 23 04:30:00.771760 n-d-846463-3 devstack@n-api.service[122643]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 23 04:30:00.771760 n-d-846463-3 devstack@n-api.service[122643]: nodename: n-d-846463-3 Sep 23 04:30:00.771760 n-d-846463-3 devstack@n-api.service[122643]: machine: x86_64 Sep 23 04:30:00.771760 n-d-846463-3 devstack@n-api.service[122643]: clock source: unix Sep 23 04:30:00.771760 n-d-846463-3 devstack@n-api.service[122643]: pcre jit disabled Sep 23 04:30:00.771760 n-d-846463-3 devstack@n-api.service[122643]: detected number of CPU cores: 4 Sep 23 04:30:00.771760 n-d-846463-3 devstack@n-api.service[122643]: current working directory: / Sep 23 04:30:00.771760 n-d-846463-3 devstack@n-api.service[122643]: detected binary path: /usr/bin/uwsgi-core Sep 23 04:30:00.771760 n-d-846463-3 devstack@n-api.service[122643]: your processes number limit is 47680 Sep 23 04:30:00.771760 n-d-846463-3 devstack@n-api.service[122643]: your memory page size is 4096 bytes Sep 23 04:30:00.771760 n-d-846463-3 devstack@n-api.service[122643]: detected max file descriptor number: 2048 Sep 23 04:30:00.771760 n-d-846463-3 devstack@n-api.service[122643]: lock engine: pthread robust mutexes Sep 23 04:30:00.772792 n-d-846463-3 devstack@n-api.service[122643]: thunder lock: enabled Sep 23 04:30:00.772792 n-d-846463-3 devstack@n-api.service[122643]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 23 04:30:00.772792 n-d-846463-3 devstack@n-api.service[122643]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 23 04:30:00.812917 n-d-846463-3 devstack@n-api.service[122643]: Python main interpreter initialized at 0x55ae9d8199c0 Sep 23 04:30:00.812917 n-d-846463-3 devstack@n-api.service[122643]: python threads support enabled Sep 23 04:30:00.812917 n-d-846463-3 devstack@n-api.service[122643]: your server socket listen backlog is limited to 100 connections Sep 23 04:30:00.812917 n-d-846463-3 devstack@n-api.service[122643]: your mercy for graceful operations on workers is 90 seconds Sep 23 04:30:00.813334 n-d-846463-3 devstack@n-api.service[122643]: mapped 403077 bytes (393 KB) for 2 cores Sep 23 04:30:00.813334 n-d-846463-3 devstack@n-api.service[122643]: *** Operational MODE: preforking *** Sep 23 04:30:00.813624 n-d-846463-3 devstack@n-api.service[122643]: *** uWSGI is running in multiple interpreter mode *** Sep 23 04:30:00.813624 n-d-846463-3 devstack@n-api.service[122643]: spawned uWSGI master process (pid: 122643) Sep 23 04:30:00.813825 n-d-846463-3 systemd[1]: Started Devstack devstack@n-api.service. Sep 23 04:30:00.817947 n-d-846463-3 devstack@n-api.service[122643]: spawned uWSGI worker 1 (pid: 122698, cores: 1) Sep 23 04:30:00.817947 n-d-846463-3 devstack@n-api.service[122643]: spawned uWSGI worker 2 (pid: 122699, cores: 1) Sep 23 04:30:00.817947 n-d-846463-3 devstack@n-api.service[122643]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 23 04:30:01.484236 n-d-846463-3 devstack@n-api.service[122699]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 23 04:30:01.495269 n-d-846463-3 devstack@n-api.service[122698]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 23 04:30:02.659470 n-d-846463-3 devstack@n-api.service[122699]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 23 04:30:02.659470 n-d-846463-3 devstack@n-api.service[122699]: from cryptography.utils import int_from_bytes Sep 23 04:30:02.660090 n-d-846463-3 devstack@n-api.service[122699]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 23 04:30:02.660090 n-d-846463-3 devstack@n-api.service[122699]: from cryptography.utils import int_from_bytes Sep 23 04:30:02.660224 n-d-846463-3 devstack@n-api.service[122698]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 23 04:30:02.660224 n-d-846463-3 devstack@n-api.service[122698]: from cryptography.utils import int_from_bytes Sep 23 04:30:02.660659 n-d-846463-3 devstack@n-api.service[122698]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 23 04:30:02.660659 n-d-846463-3 devstack@n-api.service[122698]: from cryptography.utils import int_from_bytes Sep 23 04:30:05.135000 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 23 04:30:05.135698 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 23 04:30:05.135797 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 23 04:30:05.136140 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 23 04:30:05.136269 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 23 04:30:05.136678 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 23 04:30:05.136777 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 23 04:30:05.136869 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.136954 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 23 04:30:05.137105 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.137330 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 23 04:30:05.137449 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.137548 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 23 04:30:05.137750 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.137918 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.138107 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.138279 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.138446 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.138597 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.138743 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.138874 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.139069 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.139206 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.139404 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.139515 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.139671 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.139818 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.139985 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.140134 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.140443 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-846463-3 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.140558 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.140704 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.140794 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.141018 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.141120 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.141380 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.141496 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-846463-3 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.141711 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.141826 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.142049 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.142151 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.142379 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.142471 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.142691 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.142803 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.143261 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.143468 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.143582 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.143879 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.144139 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.144386 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.144507 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.144699 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.144805 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.145001 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.145116 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.145311 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.145409 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.145643 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.145740 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.145980 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.146093 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.146292 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.146385 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.146614 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.146717 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.146922 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.147023 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.147248 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.147389 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-846463-3 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.147556 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.147707 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.147972 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-846463-3 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.148172 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.148382 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.148514 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.148683 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.148809 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.148909 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.149088 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.149281 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.149405 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.149592 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.149729 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.149908 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.150069 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.150238 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.150384 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.150565 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.150702 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.150877 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.151066 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.151229 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.151375 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.151559 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.151663 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.151808 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.151943 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.152124 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.152255 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.152423 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.152560 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.152729 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.152876 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.153034 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.153185 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.153348 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.153509 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.153645 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.153748 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.153959 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.154146 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.154234 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.154382 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.154500 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.154707 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.154861 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.155034 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.155137 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.155290 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.155425 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.155543 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.155675 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.155865 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.155957 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.156190 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.156292 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.156503 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.156603 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.156818 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.156929 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.157123 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.157222 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.157428 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.157528 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.157732 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.157822 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.158061 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.158153 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.158368 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.158460 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.158671 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.158771 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.158980 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.159079 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.159294 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.159389 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.159602 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.159690 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.159919 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.160025 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.160221 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.160310 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.160537 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.160650 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.160871 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.160987 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.161165 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.161258 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.161473 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.161647 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.161809 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.161932 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.162150 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.162252 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.162458 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.162549 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.162773 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.162865 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.163082 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.163178 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.163383 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.163479 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.163716 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.163808 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.164022 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.164129 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.164337 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.164428 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.164661 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.164765 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.164918 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.165018 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.165196 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.165294 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.165495 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.165594 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.165798 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.165941 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.166139 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.166233 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.166444 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.166536 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.166747 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.166869 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.167051 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.167163 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.167344 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.167435 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.167647 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.167746 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.167950 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.168055 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.168253 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.168350 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.168557 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.168657 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.168860 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.169009 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.169146 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.169233 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.169455 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.169557 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.169757 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.169865 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.170086 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.170231 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.170390 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.170482 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.170705 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.170808 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.171026 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.171136 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.171331 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.171425 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.171660 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.171792 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.171943 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.172041 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.172247 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.172349 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.172566 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.172669 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.172870 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.172971 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.173174 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.173267 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.173493 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.173593 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.173791 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.173972 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.174119 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.174223 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.174432 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.174530 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.174730 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.174908 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.175033 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.175175 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.175342 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.175433 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.175637 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.175736 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.175942 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.176047 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.176255 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.176355 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.176561 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.176658 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.176868 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.176967 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.177167 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.177257 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.177471 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.177561 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.177774 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.177883 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.178103 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.178206 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.178405 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.178503 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.178708 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.178815 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.179012 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.179598 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.179848 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.179943 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.180165 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.180340 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.180470 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.180568 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.180775 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.180865 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.181079 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.181199 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.181398 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 04:30:05.181501 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.181792 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.181976 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.182158 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.182246 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.182417 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.182516 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.182727 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.182824 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.183060 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.183160 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.183388 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.183484 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.183705 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.183807 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.184012 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.184105 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.184325 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.184416 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.184644 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.184742 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.184954 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.185043 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.185264 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.185356 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.185573 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.185672 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.185904 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.186011 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.186243 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.186332 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.186567 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.186658 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.186879 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.186970 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.187194 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.187333 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.187509 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.187601 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.187816 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.187906 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.188132 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.188223 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.188457 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.188562 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.188773 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.188863 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.189081 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.189179 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.189422 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.189522 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.189759 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.189923 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.190097 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.190188 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.190421 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.190576 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.190737 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.190834 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.191046 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.191154 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.191365 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.191515 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.191664 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.191772 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.191997 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.192097 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.192303 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.192394 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.192614 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.192703 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.192930 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.193019 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.193237 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.193334 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.193558 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.193658 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.193868 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.193981 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.194201 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.194295 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.194513 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.194604 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.195381 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.195490 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.195695 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.195787 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.196028 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.196125 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.196341 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.196446 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.196661 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.196752 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.196973 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.197064 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.197284 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.197434 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.197599 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.197691 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.197937 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.198033 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.198241 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.198347 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.198552 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.198643 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.198855 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.198944 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.199159 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.199258 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.199466 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.199567 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.199772 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.199862 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.200072 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.200177 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.200388 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.200479 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.200711 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.200801 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.201013 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.201103 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.201344 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.201441 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.201648 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.201740 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.201986 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.202146 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.202295 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.202386 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.202605 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.202704 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.202907 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.203005 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.203216 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.203307 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.203522 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.203620 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.203824 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.203914 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.204146 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.204246 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.204453 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.204552 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.204755 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.204845 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.205076 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.205166 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.205378 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.205481 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.205693 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.205823 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.206022 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.206120 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.206331 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.206435 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.206640 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.206741 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.206950 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.207044 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.207260 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.207361 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.207580 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.207688 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.207888 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.207986 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.208198 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.208299 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.208530 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.208626 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.208838 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.208937 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.209145 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.209247 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.209471 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.209564 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.209787 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.209905 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.210126 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.210277 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.210453 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.210596 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.210765 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.210913 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.211058 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.211195 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.211435 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.211595 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.211731 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.211828 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.211919 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.212065 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.212234 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.212337 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.212519 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.212625 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.212822 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.212922 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.213123 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.213225 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.213426 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.213532 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.213745 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.213837 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.214079 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.214173 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.214386 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.214493 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.214685 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.214775 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.214985 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.215086 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.215324 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.215427 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.215628 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.215719 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.215962 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.216061 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.216294 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.216393 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.216613 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.216715 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.216929 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.217025 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.217237 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.217336 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.217567 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.217679 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.217858 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.217982 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.218193 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.218292 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.218502 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.218600 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.218814 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.218914 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.219130 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.219229 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.219442 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.219539 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.219759 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.219859 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.220065 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.220154 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.220385 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.220478 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.220692 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.220791 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.221001 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.221100 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.221298 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.221394 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.221610 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.221711 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.221969 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.222079 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.222346 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.222458 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.222609 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.222711 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.222925 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.223015 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.223234 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.223330 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.223547 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.223637 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.223852 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.223949 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.224160 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.224257 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.224467 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.224576 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.224773 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.224865 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.225087 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.225193 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.225391 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.225489 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.225706 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.225857 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.226560 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.226666 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.226880 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.226978 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.227185 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.227275 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.227498 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.227615 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.227798 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.227898 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.228109 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.228209 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.228430 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.228535 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.228757 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.228854 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.229064 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.229163 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.229374 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.229475 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.229685 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.229787 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.230019 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.230124 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.230328 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.230479 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.230637 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.230735 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.230938 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.231071 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.231239 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.231332 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.231549 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.231647 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.231862 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.231952 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.232169 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.232259 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.232479 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.232594 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.232777 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.232876 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.233089 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.233201 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.233393 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.233496 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.233692 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.233794 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.234015 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.234121 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.234327 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.234437 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.234644 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.234756 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.234946 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.235058 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.235264 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.235368 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.235576 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.235705 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.235877 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.236070 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.236227 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.236386 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.236551 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.236716 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.236857 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.236952 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.237066 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.237165 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.237368 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.237468 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.237668 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.237800 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.238032 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.238138 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.238339 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.238511 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.238638 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.238737 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.238951 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.239050 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.239267 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.239358 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.239572 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.239669 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.239881 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.239973 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.240193 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.240298 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.240496 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.240593 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.240815 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.240907 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.241125 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.241216 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.241434 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.241525 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.241796 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.242488 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.242648 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.242739 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.242916 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.243017 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.243225 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.243332 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.243546 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.243637 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.243852 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.243941 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.244160 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.244263 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.244466 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.244557 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.244765 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.244855 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.245072 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.245176 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.245389 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.245657 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.245978 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.246087 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.246315 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.246419 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.246631 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.246731 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.246949 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.247048 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.247289 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.247394 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.247605 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.247705 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.247935 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.248036 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.248251 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.248354 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.248559 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.248649 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.248862 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.248954 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.249168 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.249273 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.249467 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.249556 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.249769 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.249867 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.250108 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.250213 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.250413 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.250505 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.250716 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.250808 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.251020 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.251112 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.251325 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.251430 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.251623 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.251714 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.251926 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.252018 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.252227 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.252319 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.252531 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.252642 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.252843 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.252944 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.253148 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.253292 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.253455 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.253555 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.253757 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.253856 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.254104 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.254210 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.254415 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.254514 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.254717 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.254815 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.255017 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.255116 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.255320 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.255419 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.255657 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.255755 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.255956 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.256045 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.256291 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.256390 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.256616 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.256707 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.256947 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.257091 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.257273 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.257381 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.257578 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.257670 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.257911 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.258049 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.258223 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.258323 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.258525 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.258626 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.258827 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.258920 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.259135 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.259235 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.259444 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.259542 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.259739 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.259830 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.260051 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.260143 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.260359 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.260457 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.260666 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.260765 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.260966 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.261059 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.261263 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.261361 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.261569 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.261671 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.261867 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.262014 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.262201 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.262293 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.262505 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.262667 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.262796 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.262888 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.263087 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.263186 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.263394 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.263498 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.263699 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.263798 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.263998 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.264090 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.264301 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.264405 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.264598 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.264696 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.264911 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.265012 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.265215 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.265315 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.265517 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.265608 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.265818 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.265941 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.266153 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.266247 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.266461 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.266591 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.266760 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.266853 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.267079 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.267179 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.267390 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.267482 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.267693 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.267785 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.268270 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.268370 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.268581 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.268672 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.268883 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.268983 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.269185 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.269285 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.269490 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.269589 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.269812 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.270010 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.270146 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.270247 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.270446 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.270545 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.270755 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.270859 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.271062 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.271204 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.271362 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.271468 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.271663 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.271824 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.271968 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.272060 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.272255 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.272451 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.272608 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.272700 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.272919 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.273113 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.273251 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.273433 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.273608 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.273832 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.274044 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.274208 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.274359 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.274509 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.274667 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.274817 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.274965 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.275122 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.275283 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.275442 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.275605 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.275763 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.275921 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.276070 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.276227 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.276385 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.276543 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.276702 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.276849 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.277006 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.277164 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.277332 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.277491 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.277648 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.277806 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.277978 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.278142 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.278302 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.278451 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.278600 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.278746 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.278902 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.279051 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.279213 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.279377 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.279534 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.279685 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.279833 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.279981 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.280085 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.280195 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.280474 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.280625 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.280809 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.280959 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.281138 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.281293 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.281460 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.281601 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.281785 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.281995 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.282117 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.282246 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.282428 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.282519 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.282740 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.282881 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.283051 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.283146 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.283358 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.283449 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.283669 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.283784 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.283978 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.284077 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.284287 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.284379 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.284597 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.284699 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.284906 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.285004 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.285216 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.285315 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.285521 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.285613 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.285834 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.285944 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.286172 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.286265 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.286477 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.286576 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.286801 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.286900 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.287114 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.287205 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.287420 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.287522 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.287730 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.287827 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.288036 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.288142 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.288350 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.506373 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.507266 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.507368 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.507368 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.507521 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.507614 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.507693 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.507768 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.507857 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.507944 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.508029 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.508104 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.508207 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.508300 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.508391 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.508469 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.508559 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.508636 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.508716 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.508816 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.508891 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.508962 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.509037 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.509104 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.509174 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.509343 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.509417 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.509489 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.509708 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.509828 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.509915 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.509976 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.510030 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.510083 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.510136 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.510201 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.510259 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.510313 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.510381 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.510448 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.510510 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.510567 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.510635 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.510702 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.510828 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.510902 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.510980 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.511050 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.511118 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.511118 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.511239 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.511306 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.511381 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.511450 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.511518 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.511584 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.511652 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.511718 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.511857 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.511929 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.511996 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.512064 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.512121 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.512194 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.512263 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.512331 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.512398 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.512464 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.512530 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.512606 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.512675 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.512742 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.512808 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.512874 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.512940 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.513014 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.513082 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.513149 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.513216 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.513291 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.513291 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.513414 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.513414 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.513540 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.513540 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.513662 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.513728 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.513795 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.513862 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.513967 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.513967 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.514092 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.514092 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.514203 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.514266 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.514335 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.514390 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.514456 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.514522 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.514588 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.514663 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.514732 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.514799 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.514866 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.514932 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.514997 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.515073 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.515133 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.515200 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.515266 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.515331 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.515405 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.515524 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.515597 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.515664 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.515731 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.515827 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.515918 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.515996 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.516066 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.516134 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.516201 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.516273 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.516342 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.516466 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.516543 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.516612 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.516680 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.516749 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.516818 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.516894 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.516967 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.516967 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.517089 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.517089 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.517211 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.517286 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.517357 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.517425 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.517493 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.517561 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.517637 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.517707 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.517775 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.517843 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.517936 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.518313 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.518400 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.518462 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.518519 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.518574 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.518643 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.518713 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.518788 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.518859 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.518927 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.518996 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.519064 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.519132 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.519208 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.519278 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.519347 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.519403 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.519470 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.519546 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.519617 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.519687 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.519764 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.519843 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.519960 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.520046 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.520113 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.520183 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.520251 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.520320 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.520320 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.520451 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.520522 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.520592 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.520660 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.520729 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.520797 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.520874 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.520945 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.521013 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.521082 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.521150 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.521292 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.521366 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.521424 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.521552 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.521628 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.522391 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.522486 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.522697 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.523043 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.523119 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.523188 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.523248 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.523326 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.523399 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.523479 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.523558 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.523628 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.523696 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.523773 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.523846 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.523915 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.523984 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.524052 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.524129 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.524201 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.524270 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.524339 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.524408 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.524477 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.524554 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.524633 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.524727 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.524801 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.524870 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.524928 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.524993 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.525053 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.525110 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.525179 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.525237 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.525292 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.525369 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.525503 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.525579 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.525643 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.525788 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.525866 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.525955 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.526030 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.526110 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.526110 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.526246 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.526316 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.526405 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.526405 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.526534 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.526591 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.526647 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.526702 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.526766 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.526837 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.526905 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.526973 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.530055 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.530149 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.530149 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.530268 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.530268 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.530370 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.530428 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.530493 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.530493 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.530598 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.530655 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.530712 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.530712 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.530820 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.530880 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.530936 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.530936 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.531062 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.531128 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.531189 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.531246 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.531302 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.531358 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.531414 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.531478 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.531539 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.531595 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.531652 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.531708 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.531771 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.531830 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.531887 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.531966 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.532026 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.532084 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.532148 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.532208 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.532265 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.532322 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.532379 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.532435 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.532498 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.532557 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.532614 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.532670 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.532745 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.532814 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.532875 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.532931 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.532987 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.533044 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.533101 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.533165 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.533224 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.533281 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.533337 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.533393 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.533449 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.533512 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.533571 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.533628 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.533685 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.533741 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.533805 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.533805 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.536400 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.536400 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.536888 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.536888 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.537199 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.537199 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.537653 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.537788 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.537939 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.538095 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.538095 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.538906 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.539061 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.539213 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.539353 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.539498 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.539633 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.539796 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.539796 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.540067 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.540197 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.540336 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.540468 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.540468 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.540715 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.540845 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.540975 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.541113 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.541113 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.541383 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.541525 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.541525 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.541772 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.541931 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.542070 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.542285 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.542285 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.542591 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.542733 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.542733 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.543020 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.543153 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.543153 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.543422 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.543572 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.543712 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.543846 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.543846 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.543846 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.544255 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.544415 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.544555 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.544689 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.544820 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.544953 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.545877 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.546126 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.546264 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.546528 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.546672 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.546927 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.546927 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.547189 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.547323 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.547323 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.547323 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.547821 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.547956 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.547956 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.548224 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.548356 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.548356 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.548615 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.548748 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.548748 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.548997 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.549130 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.549130 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.549130 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.549563 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.549707 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.549840 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.550042 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.550188 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.550323 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.550454 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.550586 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.550586 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.550835 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.550976 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.550976 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.551227 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.551359 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.551359 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.551618 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.551762 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.551762 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.551762 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.551762 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.552249 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.552380 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.552380 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.552380 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.552380 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.552380 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.553055 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.553207 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.553342 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.553342 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.553590 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.553723 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.553855 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.553855 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.554708 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.554867 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.555001 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.555197 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.555971 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.556127 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.556127 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.556396 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.556653 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.556653 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.557100 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.557352 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.557496 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.557728 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.557728 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.558046 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.558194 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.558328 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.558474 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.558474 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.558724 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.558856 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.559004 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.559138 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.559270 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.559409 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.559547 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.559679 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.559832 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.559970 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.560115 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.560263 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.560408 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.560544 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.560700 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.560889 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.561029 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.561175 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.561175 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.561450 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.561587 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.561587 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.561838 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.562009 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.562155 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.562300 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.562300 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.562567 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.562701 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.562701 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.562960 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.563102 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.563235 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.563368 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.563368 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.563634 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.563797 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.563933 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.564078 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.564211 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.564363 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.564535 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.564681 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.564817 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.564948 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.565080 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.565251 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.565394 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.566158 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.566305 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.566439 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.566571 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.566806 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.566962 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.567184 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.567324 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.567457 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.567457 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.567801 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.567957 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.568093 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.568239 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.568372 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.568503 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.568635 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.568775 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.568775 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.569134 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.569268 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.569406 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.569542 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.569542 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.569836 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.570006 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.570143 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.570276 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.570420 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.570555 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.570555 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.570804 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.570936 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.571069 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.571211 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.571211 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.571461 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.571593 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.571739 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.571871 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.572014 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.572149 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.572281 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.572413 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.572544 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.572684 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.572817 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.572949 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.572949 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.573198 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.573331 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.573480 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.573614 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.573746 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.573877 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.574055 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.574191 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.574334 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.574469 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.574469 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.574671 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.574793 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.574901 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.575027 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.575027 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.575251 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.575404 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.575611 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.576225 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.576356 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.576486 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.576607 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.576725 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.576856 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.576983 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.577318 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.577442 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.577560 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.577678 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.577796 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.578119 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.578244 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.578362 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.578362 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.578584 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.578710 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.578710 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.578933 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.579051 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.579168 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.579286 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.579286 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.579523 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.579641 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.579641 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.579862 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.579978 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.580093 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.580212 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.580212 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.580431 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.580549 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.580549 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.580778 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.580895 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.581012 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.581129 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.581129 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.581356 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.581475 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.581475 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.581475 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.581798 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.581930 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.582065 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.582185 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.582185 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.582404 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.582521 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.582521 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.582750 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.582869 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.582986 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.583101 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.583251 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.583492 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.583616 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.583902 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.584022 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.584221 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.584399 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.584554 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.584830 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.584952 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.585226 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.585369 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.585573 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.585793 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.586428 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.586593 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.586716 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.586836 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.586967 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.586967 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.587371 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.587504 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.587624 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.587741 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 23 04:30:05.587923 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.588302 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.588678 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.589076 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.589455 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.589862 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.590293 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.590682 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.591077 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.591463 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.591856 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.592249 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.592678 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.593070 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.593463 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.593846 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.594295 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.594682 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.595066 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.595453 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.595838 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.596482 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.596617 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.596961 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.597374 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.597729 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.598153 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.598564 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.598965 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.599354 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.599741 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.600140 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.600523 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.600906 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.601812 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.602215 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.602602 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.602990 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.603373 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.603755 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.604153 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.604551 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.604948 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.605345 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.605726 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.606722 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.606722 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.606983 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.607309 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.607721 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.608121 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.608508 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.608892 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.609279 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 04:30:05.609593 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 23 04:30:05.651607 n-d-846463-3 devstack@n-api.service[122698]: INFO dbcounter [None req-245ee95b-ce63-493e-a625-cb325b39bf0f None None] Registered counter for database nova_api Sep 23 04:30:05.672634 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_db.sqlalchemy.engines [None req-245ee95b-ce63-493e-a625-cb325b39bf0f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122698) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 04:30:05.674246 n-d-846463-3 devstack@n-api.service[122699]: INFO dbcounter [None req-7455c83f-c3d6-4aba-8544-1d03fa066434 None None] Registered counter for database nova_api Sep 23 04:30:05.679716 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writer thread running {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 23 04:30:05.694482 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_db.sqlalchemy.engines [None req-7455c83f-c3d6-4aba-8544-1d03fa066434 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122699) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 04:30:05.702178 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writer thread running {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 23 04:30:05.736529 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.context [None req-245ee95b-ce63-493e-a625-cb325b39bf0f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),feac528b-4983-4e61-aae7-f1973fe5bc2c(cell1) {{(pid=122698) load_cells /opt/stack/nova/nova/context.py:464}} Sep 23 04:30:05.740571 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-245ee95b-ce63-493e-a625-cb325b39bf0f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:30:05.741167 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-245ee95b-ce63-493e-a625-cb325b39bf0f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:30:05.742761 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-245ee95b-ce63-493e-a625-cb325b39bf0f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:30:05.743503 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-245ee95b-ce63-493e-a625-cb325b39bf0f None None] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:30:05.743957 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-245ee95b-ce63-493e-a625-cb325b39bf0f None None] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:30:05.745973 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-245ee95b-ce63-493e-a625-cb325b39bf0f None None] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:30:05.747988 n-d-846463-3 devstack@n-api.service[122698]: INFO dbcounter [None req-245ee95b-ce63-493e-a625-cb325b39bf0f None None] Registered counter for database nova_cell0 Sep 23 04:30:05.752303 n-d-846463-3 devstack@n-api.service[122698]: INFO dbcounter [None req-245ee95b-ce63-493e-a625-cb325b39bf0f None None] Registered counter for database nova_cell1 Sep 23 04:30:05.760492 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.context [None req-7455c83f-c3d6-4aba-8544-1d03fa066434 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),feac528b-4983-4e61-aae7-f1973fe5bc2c(cell1) {{(pid=122699) load_cells /opt/stack/nova/nova/context.py:464}} Sep 23 04:30:05.760666 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_db.sqlalchemy.engines [None req-245ee95b-ce63-493e-a625-cb325b39bf0f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122698) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 04:30:05.761322 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_db.sqlalchemy.engines [None req-245ee95b-ce63-493e-a625-cb325b39bf0f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122698) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 04:30:05.763635 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7455c83f-c3d6-4aba-8544-1d03fa066434 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:30:05.764119 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7455c83f-c3d6-4aba-8544-1d03fa066434 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:30:05.765735 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7455c83f-c3d6-4aba-8544-1d03fa066434 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:30:05.766493 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7455c83f-c3d6-4aba-8544-1d03fa066434 None None] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:30:05.766943 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7455c83f-c3d6-4aba-8544-1d03fa066434 None None] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:30:05.767059 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writer thread running {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 23 04:30:05.769193 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7455c83f-c3d6-4aba-8544-1d03fa066434 None None] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:30:05.770056 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writer thread running {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 23 04:30:05.771232 n-d-846463-3 devstack@n-api.service[122699]: INFO dbcounter [None req-7455c83f-c3d6-4aba-8544-1d03fa066434 None None] Registered counter for database nova_cell0 Sep 23 04:30:05.775975 n-d-846463-3 devstack@n-api.service[122699]: INFO dbcounter [None req-7455c83f-c3d6-4aba-8544-1d03fa066434 None None] Registered counter for database nova_cell1 Sep 23 04:30:05.784475 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_db.sqlalchemy.engines [None req-7455c83f-c3d6-4aba-8544-1d03fa066434 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122699) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 04:30:05.785194 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_db.sqlalchemy.engines [None req-7455c83f-c3d6-4aba-8544-1d03fa066434 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122699) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 04:30:05.791064 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writer thread running {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 23 04:30:05.918095 n-d-846463-3 devstack@n-api.service[122698]: INFO dbcounter [None req-245ee95b-ce63-493e-a625-cb325b39bf0f None None] Registered counter for database nova_cell0 Sep 23 04:30:05.925030 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_db.sqlalchemy.engines [None req-245ee95b-ce63-493e-a625-cb325b39bf0f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122698) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 04:30:05.929773 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writer thread running {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 23 04:30:05.930471 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writer thread running {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 23 04:30:05.943013 n-d-846463-3 devstack@n-api.service[122699]: INFO dbcounter [None req-7455c83f-c3d6-4aba-8544-1d03fa066434 None None] Registered counter for database nova_cell0 Sep 23 04:30:05.951090 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_db.sqlalchemy.engines [None req-7455c83f-c3d6-4aba-8544-1d03fa066434 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122699) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 04:30:05.956189 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writer thread running {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 23 04:30:06.253319 n-d-846463-3 devstack@n-api.service[122698]: WARNING keystonemiddleware.auth_token [None req-245ee95b-ce63-493e-a625-cb325b39bf0f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 23 04:30:06.261352 n-d-846463-3 devstack@n-api.service[122698]: WARNING keystonemiddleware.auth_token [None req-245ee95b-ce63-493e-a625-cb325b39bf0f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 23 04:30:06.282275 n-d-846463-3 devstack@n-api.service[122699]: WARNING keystonemiddleware.auth_token [None req-7455c83f-c3d6-4aba-8544-1d03fa066434 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 23 04:30:06.289531 n-d-846463-3 devstack@n-api.service[122699]: WARNING keystonemiddleware.auth_token [None req-7455c83f-c3d6-4aba-8544-1d03fa066434 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 23 04:30:06.611232 n-d-846463-3 devstack@n-api.service[122698]: WARNING keystonemiddleware.auth_token [None req-245ee95b-ce63-493e-a625-cb325b39bf0f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 23 04:30:06.616272 n-d-846463-3 devstack@n-api.service[122698]: WARNING keystonemiddleware.auth_token [None req-245ee95b-ce63-493e-a625-cb325b39bf0f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 23 04:30:06.621849 n-d-846463-3 devstack@n-api.service[122698]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ae9d8199c0 pid: 122698 (default app) Sep 23 04:30:06.649713 n-d-846463-3 devstack@n-api.service[122699]: WARNING keystonemiddleware.auth_token [None req-7455c83f-c3d6-4aba-8544-1d03fa066434 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 23 04:30:06.656760 n-d-846463-3 devstack@n-api.service[122699]: WARNING keystonemiddleware.auth_token [None req-7455c83f-c3d6-4aba-8544-1d03fa066434 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 23 04:30:06.663609 n-d-846463-3 devstack@n-api.service[122699]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ae9d8199c0 pid: 122699 (default app) Sep 23 04:30:47.749100 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=3 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:30:47.751717 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=3 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:30:47.752683 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=3 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:30:47.754473 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=3 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:30:48.515117 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=3 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:30:48.516743 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=3 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:30:48.518308 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=3 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:30:48.519426 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=3 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:30:49.125819 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-73ad298f-85f3-4f55-9cce-a175ecc01b07 tempest-AZAdminNegativeTestJSON-682322770 tempest-AZAdminNegativeTestJSON-682322770-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:30:49.127756 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-73ad298f-85f3-4f55-9cce-a175ecc01b07 tempest-AZAdminNegativeTestJSON-682322770 tempest-AZAdminNegativeTestJSON-682322770-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '1cec2364934149ae9ea72866320004a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'befb761c5d3b4a98ac927c5bcd7ca26e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:30:49.131152 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-73ad298f-85f3-4f55-9cce-a175ecc01b07 tempest-AZAdminNegativeTestJSON-682322770 tempest-AZAdminNegativeTestJSON-682322770-project] Request method failure captured: Sep 23 04:30:49.131152 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Sep 23 04:30:49.131152 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:30:49.131152 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:30:49.131152 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:30:49.131152 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:30:49.131152 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:30:49.131152 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:30:49.131152 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:30:49.131152 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:30:49.131152 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTZ0btRQifkTCAXR4qQTDyG2ZfHjZNSZ0Ncc6vx6vcdIsceeEyeVGpmz8jyc6cF9P87IPlJ7BnTZaqupTV8tgpglo1uh7611PR4XU5mTSbMpmTgrFjI2tnFHL3-h61W6wpCWonfyxl4jIBNupYvuhk6XuqmxvSBbweVTNw4nsiy07h0 Sep 23 04:30:49.131152 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:30:49.131152 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:30:49.131152 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:30:49.131152 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:30:49.131152 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:30:49.131152 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:30:49.131152 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: befb761c5d3b4a98ac927c5bcd7ca26e Sep 23 04:30:49.131152 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-AZAdminNegativeTestJSON-682322770 Sep 23 04:30:49.131152 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:30:49.131152 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:30:49.132315 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_befb761c5d3b4a98ac927c5bcd7ca26e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/befb761c5d3b4a98ac927c5bcd7ca26e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/befb761c5d3b4a98ac927c5bcd7ca26e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/befb761c5d3b4a98ac927c5bcd7ca26e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:30:49.132315 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-AZAdminNegativeTestJSON-682322770 Sep 23 04:30:49.132315 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: befb761c5d3b4a98ac927c5bcd7ca26e Sep 23 04:30:49.132315 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-682322770 Sep 23 04:30:49.132315 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-AZAdminNegativeTestJSON-682322770-project Sep 23 04:30:49.132315 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:30:49.132315 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:30:49.132315 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 1cec2364934149ae9ea72866320004a0 Sep 23 04:30:49.132315 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-AZAdminNegativeTestJSON-682322770-project Sep 23 04:30:49.132315 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:30:49.132315 n-d-846463-3 devstack@n-api.service[122698]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Sep 23 04:30:49.132315 n-d-846463-3 devstack@n-api.service[122698]: action_args: {} Sep 23 04:30:49.132902 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:30:49.132902 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:30:49.132902 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:30:49.132902 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:30:49.132902 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:30:49.132902 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:30:49.132902 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:30:49.132902 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:30:49.132902 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Sep 23 04:30:49.132902 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Sep 23 04:30:49.132902 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 23 04:30:49.132902 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 23 04:30:49.132902 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 23 04:30:49.132902 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 23 04:30:49.132902 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 23 04:30:49.132902 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 23 04:30:49.132902 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 23 04:30:49.132902 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise self.value Sep 23 04:30:49.132902 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 23 04:30:49.133809 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 23 04:30:49.133809 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 23 04:30:49.133809 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 23 04:30:49.133809 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 23 04:30:49.133809 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 23 04:30:49.133809 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Sep 23 04:30:49.133809 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:30:49.133809 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:30:49.133809 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:30:49.133809 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:30:49.133809 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:30:49.133809 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:30:49.133809 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 23 04:30:49.133809 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 23 04:30:49.133809 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Sep 23 04:30:49.133809 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:30:49.133809 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-73ad298f-85f3-4f55-9cce-a175ecc01b07 tempest-AZAdminNegativeTestJSON-682322770 tempest-AZAdminNegativeTestJSON-682322770-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:30:49.134697 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-73ad298f-85f3-4f55-9cce-a175ecc01b07 tempest-AZAdminNegativeTestJSON-682322770 tempest-AZAdminNegativeTestJSON-682322770-project] 10.222.0.33 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 1.399537 Sep 23 04:30:49.137802 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1/1] 10.222.0.33 () {58 vars in 1185 bytes} [Fri Sep 23 04:30:47 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 1406 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:30:49.652756 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f54571ad-8b86-4129-95fe-d34dc7dd85ee tempest-AZAdminV2TestJSON-966617374 tempest-AZAdminV2TestJSON-966617374-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:30:49.657068 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f54571ad-8b86-4129-95fe-d34dc7dd85ee tempest-AZAdminV2TestJSON-966617374 tempest-AZAdminV2TestJSON-966617374-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:30:49.657068 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f54571ad-8b86-4129-95fe-d34dc7dd85ee tempest-AZAdminV2TestJSON-966617374 tempest-AZAdminV2TestJSON-966617374-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:30:49.657068 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f54571ad-8b86-4129-95fe-d34dc7dd85ee tempest-AZAdminV2TestJSON-966617374 tempest-AZAdminV2TestJSON-966617374-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:30:49.657068 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f54571ad-8b86-4129-95fe-d34dc7dd85ee tempest-AZAdminV2TestJSON-966617374 tempest-AZAdminV2TestJSON-966617374-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:30:49.657401 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f54571ad-8b86-4129-95fe-d34dc7dd85ee tempest-AZAdminV2TestJSON-966617374 tempest-AZAdminV2TestJSON-966617374-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:30:49.657636 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f54571ad-8b86-4129-95fe-d34dc7dd85ee tempest-AZAdminV2TestJSON-966617374 tempest-AZAdminV2TestJSON-966617374-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:30:49.724177 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f54571ad-8b86-4129-95fe-d34dc7dd85ee tempest-AZAdminV2TestJSON-966617374 tempest-AZAdminV2TestJSON-966617374-project-admin] 10.222.0.33 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.585058 Sep 23 04:30:49.733304 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2/2] 10.222.0.33 () {58 vars in 1164 bytes} [Fri Sep 23 04:30:49 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 04:30:50.004865 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9d8e5188-4a30-40ea-8779-5d72b9e3d619 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1815576229", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:30:50.246076 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0a124ad8-52a8-4e2b-88bd-5be2f5499a31 tempest-FlavorsV255TestJSON-447354217 tempest-FlavorsV255TestJSON-447354217-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-2127634609", "id": 1446949448, "os-flavor-access:is_public": "True"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:30:50.397042 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0a124ad8-52a8-4e2b-88bd-5be2f5499a31 tempest-FlavorsV255TestJSON-447354217 tempest-FlavorsV255TestJSON-447354217-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 449 microversion: 2.55 time: 0.661129 Sep 23 04:30:50.398220 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3/3] 10.222.0.33 () {62 vars in 1188 bytes} [Fri Sep 23 04:30:49 2022] POST /compute/v2.1/flavors => generated 449 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 04:30:50.493469 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.neutron [None req-9d8e5188-4a30-40ea-8779-5d72b9e3d619 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] validate_networks() for None {{(pid=122699) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:30:50.595211 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-105b800d-0c97-45d5-ae84-4033352f1aa5 tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:30:50.601460 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-105b800d-0c97-45d5-ae84-4033352f1aa5 tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:30:50.602370 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-105b800d-0c97-45d5-ae84-4033352f1aa5 tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:30:50.602971 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-105b800d-0c97-45d5-ae84-4033352f1aa5 tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:30:50.604044 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-105b800d-0c97-45d5-ae84-4033352f1aa5 tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:30:50.604732 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-105b800d-0c97-45d5-ae84-4033352f1aa5 tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:30:50.605321 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-105b800d-0c97-45d5-ae84-4033352f1aa5 tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:30:50.635568 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-105b800d-0c97-45d5-ae84-4033352f1aa5 tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.236138 Sep 23 04:30:50.636531 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 4/4] 10.222.0.33 () {58 vars in 1176 bytes} [Fri Sep 23 04:30:50 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:30:50.800437 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-032c79d4-1611-40b6-b112-44359662692e tempest-FlavorsExtraSpecsNegativeTestJSON-171571836 tempest-FlavorsExtraSpecsNegativeTestJSON-171571836-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-233171624", "ram": 512, "vcpus": 1, "disk": 10, "id": 1924032965, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:30:50.899499 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-032c79d4-1611-40b6-b112-44359662692e tempest-FlavorsExtraSpecsNegativeTestJSON-171571836 tempest-FlavorsExtraSpecsNegativeTestJSON-171571836-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.250535 Sep 23 04:30:50.910666 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 5/5] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:30:50 2022] POST /compute/v2.1/flavors => generated 415 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:30:50.917909 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-9d8e5188-4a30-40ea-8779-5d72b9e3d619 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Flavor limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:30:50.918506 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-9d8e5188-4a30-40ea-8779-5d72b9e3d619 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Image limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:30:50.919203 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-9d8e5188-4a30-40ea-8779-5d72b9e3d619 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Flavor pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:30:50.920210 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-9d8e5188-4a30-40ea-8779-5d72b9e3d619 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Image pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:30:50.920933 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-9d8e5188-4a30-40ea-8779-5d72b9e3d619 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:30:50.926674 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c75e7896-4a07-468f-a4c1-d87a7bbcd1bb tempest-AZAdminV2TestJSON-966617374 tempest-AZAdminV2TestJSON-966617374-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:30:50.930969 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c75e7896-4a07-468f-a4c1-d87a7bbcd1bb tempest-AZAdminV2TestJSON-966617374 tempest-AZAdminV2TestJSON-966617374-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:30:50.930969 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c75e7896-4a07-468f-a4c1-d87a7bbcd1bb tempest-AZAdminV2TestJSON-966617374 tempest-AZAdminV2TestJSON-966617374-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:30:50.930969 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c75e7896-4a07-468f-a4c1-d87a7bbcd1bb tempest-AZAdminV2TestJSON-966617374 tempest-AZAdminV2TestJSON-966617374-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:30:50.930969 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c75e7896-4a07-468f-a4c1-d87a7bbcd1bb tempest-AZAdminV2TestJSON-966617374 tempest-AZAdminV2TestJSON-966617374-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:30:50.931274 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c75e7896-4a07-468f-a4c1-d87a7bbcd1bb tempest-AZAdminV2TestJSON-966617374 tempest-AZAdminV2TestJSON-966617374-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:30:50.931451 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c75e7896-4a07-468f-a4c1-d87a7bbcd1bb tempest-AZAdminV2TestJSON-966617374 tempest-AZAdminV2TestJSON-966617374-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:30:50.942605 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9d8e5188-4a30-40ea-8779-5d72b9e3d619 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:30:50.944014 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9d8e5188-4a30-40ea-8779-5d72b9e3d619 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:30:50.945081 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9d8e5188-4a30-40ea-8779-5d72b9e3d619 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:30:50.946119 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9d8e5188-4a30-40ea-8779-5d72b9e3d619 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:30:50.946787 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9d8e5188-4a30-40ea-8779-5d72b9e3d619 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:30:50.947581 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9d8e5188-4a30-40ea-8779-5d72b9e3d619 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:30:50.959471 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c75e7896-4a07-468f-a4c1-d87a7bbcd1bb tempest-AZAdminV2TestJSON-966617374 tempest-AZAdminV2TestJSON-966617374-project-admin] 10.222.0.33 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.046892 Sep 23 04:30:50.960493 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 6/6] 10.222.0.33 () {58 vars in 1185 bytes} [Fri Sep 23 04:30:50 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:30:51.015496 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-9d8e5188-4a30-40ea-8779-5d72b9e3d619 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Getting quotas for project 79442cd4a69040f594e19b3492df7e7e. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:30:51.046727 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-9d8e5188-4a30-40ea-8779-5d72b9e3d619 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Getting quotas for user ac39d27bcf5d4def9ff9bd5b81bd7b76 and project 79442cd4a69040f594e19b3492df7e7e. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:30:51.072566 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-9d8e5188-4a30-40ea-8779-5d72b9e3d619 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Going to run 1 instances... {{(pid=122699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:30:51.075480 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-9d8e5188-4a30-40ea-8779-5d72b9e3d619 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] [instance: e18459f8-cd71-4feb-8764-c3b4cc3d89be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:30:51.117548 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-55c5ff43-994a-4bf1-85e6-312f23dbb3e1 tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] Calling method '.version_select at 0x7ff1c14c2310>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:30:51.126561 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-55c5ff43-994a-4bf1-85e6-312f23dbb3e1 tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),feac528b-4983-4e61-aae7-f1973fe5bc2c(cell1) {{(pid=122698) load_cells /opt/stack/nova/nova/compute/api.py:319}} Sep 23 04:30:51.127549 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-55c5ff43-994a-4bf1-85e6-312f23dbb3e1 tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:30:51.128023 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-55c5ff43-994a-4bf1-85e6-312f23dbb3e1 tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:30:51.128609 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-55c5ff43-994a-4bf1-85e6-312f23dbb3e1 tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:30:51.155923 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-55c5ff43-994a-4bf1-85e6-312f23dbb3e1 tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:30:51.156657 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-55c5ff43-994a-4bf1-85e6-312f23dbb3e1 tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:30:51.157098 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-55c5ff43-994a-4bf1-85e6-312f23dbb3e1 tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:30:51.171755 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-55c5ff43-994a-4bf1-85e6-312f23dbb3e1 tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:30:51.172832 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-55c5ff43-994a-4bf1-85e6-312f23dbb3e1 tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:30:51.173775 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-55c5ff43-994a-4bf1-85e6-312f23dbb3e1 tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:30:51.193627 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-55c5ff43-994a-4bf1-85e6-312f23dbb3e1 tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.231415 Sep 23 04:30:51.194906 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 7/7] 10.222.0.33 () {58 vars in 1167 bytes} [Fri Sep 23 04:30:50 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:30:51.226991 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-9d8e5188-4a30-40ea-8779-5d72b9e3d619 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.717342 Sep 23 04:30:51.238474 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1/8] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:30:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 2720 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 23 04:30:51.247235 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-45bc2c37-f8d5-413d-8522-ee5b43e9ce9e tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2009889643"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:30:51.256604 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.aggregate [None req-45bc2c37-f8d5-413d-8522-ee5b43e9ce9e tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] Generated uuid 9a0fb7a6-552c-4b59-8d08-9228b77cec92 for aggregate {{(pid=122699) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 23 04:30:51.395223 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-45bc2c37-f8d5-413d-8522-ee5b43e9ce9e tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.155165 Sep 23 04:30:51.397015 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2/9] 10.222.0.33 () {60 vars in 1164 bytes} [Fri Sep 23 04:30:51 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:30:51.644114 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d4e9486d-9277-40d1-91c3-01ef6b1076f0 tempest-FlavorsV255TestJSON-1672813140 tempest-FlavorsV255TestJSON-1672813140-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:30:51.682243 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d4e9486d-9277-40d1-91c3-01ef6b1076f0 tempest-FlavorsV255TestJSON-1672813140 tempest-FlavorsV255TestJSON-1672813140-project] 10.222.0.33 "GET /compute/v2.1/flavors/1446949448" status: 200 len: 449 microversion: 2.55 time: 0.486054 Sep 23 04:30:51.682830 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 8/10] 10.222.0.33 () {60 vars in 1199 bytes} [Fri Sep 23 04:30:51 2022] GET /compute/v2.1/flavors/1446949448 => generated 449 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 04:30:51.700315 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-200a16c3-9937-439f-ac8b-57732384b13c tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:30:51.705205 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-200a16c3-9937-439f-ac8b-57732384b13c tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] [instance: e18459f8-cd71-4feb-8764-c3b4cc3d89be] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:30:52.036022 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ae533416-a9d1-4c55-990b-67dd5f64a63b tempest-FlavorsExtraSpecsNegativeTestJSON-1766239395 tempest-FlavorsExtraSpecsNegativeTestJSON-1766239395-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:30:52.070570 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-ae533416-a9d1-4c55-990b-67dd5f64a63b tempest-FlavorsExtraSpecsNegativeTestJSON-1766239395 tempest-FlavorsExtraSpecsNegativeTestJSON-1766239395-project] HTTP exception thrown: Flavor 1924032965 has no extra specs with key hw:cpu_thread_policy. Sep 23 04:30:52.086117 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ae533416-a9d1-4c55-990b-67dd5f64a63b tempest-FlavorsExtraSpecsNegativeTestJSON-1766239395 tempest-FlavorsExtraSpecsNegativeTestJSON-1766239395-project] Request method failure captured: Sep 23 04:30:52.086117 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/flavors/1924032965/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Sep 23 04:30:52.086117 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:30:52.086117 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:30:52.086117 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:30:52.086117 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:30:52.086117 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:30:52.086117 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:30:52.086117 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:30:52.086117 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:30:52.086117 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTZ2oMwYhktNTBoUmM-gvqVMH0VldReaTqbfca74Q6010AyJllFfSWxT-XxITWP8JX0WnLrN2RwcDJCMYcPRb2MYGHNaRe8olNany_94muhwPmlOYWDsD5SQnQamUH3MLipnYcdg5JafxQUBzOpewo4jVpdSahODaqOl6ZUJSuWYdJ8 Sep 23 04:30:52.086117 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:30:52.086117 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:30:52.086117 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:30:52.086117 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:30:52.086117 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:30:52.086117 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:30:52.086117 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 00d186e7c7b14d47bf4026a39a7227ad Sep 23 04:30:52.086117 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1766239395 Sep 23 04:30:52.086117 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:30:52.086117 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:30:52.087521 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_00d186e7c7b14d47bf4026a39a7227ad", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/00d186e7c7b14d47bf4026a39a7227ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/00d186e7c7b14d47bf4026a39a7227ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/00d186e7c7b14d47bf4026a39a7227ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:30:52.087521 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1766239395 Sep 23 04:30:52.087521 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 00d186e7c7b14d47bf4026a39a7227ad Sep 23 04:30:52.087521 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1766239395 Sep 23 04:30:52.087521 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1766239395-project Sep 23 04:30:52.087521 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:30:52.087521 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:30:52.087521 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 30754f7b913a48fe90c9dab5af7e7bb6 Sep 23 04:30:52.087521 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1766239395-project Sep 23 04:30:52.087521 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:30:52.087521 n-d-846463-3 devstack@n-api.service[122699]: exception: Flavor 1924032965 has no extra specs with key hw:cpu_thread_policy. Sep 23 04:30:52.088220 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'flavor_id': '1924032965', 'id': 'hw:cpu_thread_policy'} Sep 23 04:30:52.088220 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:30:52.088220 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:30:52.088220 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Sep 23 04:30:52.088220 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Sep 23 04:30:52.088220 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Sep 23 04:30:52.088220 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:30:52.088220 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:30:52.088220 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:30:52.088220 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:30:52.088220 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:30:52.088220 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:30:52.088220 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:30:52.088220 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:30:52.088220 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:30:52.088220 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:30:52.088220 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Sep 23 04:30:52.088220 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 23 04:30:52.088220 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1924032965 has no extra specs with key hw:cpu_thread_policy. Sep 23 04:30:52.088220 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:30:52.088220 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:30:52.088220 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:30:52.089468 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:30:52.089468 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:30:52.089468 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:30:52.089468 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:30:52.089468 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:30:52.089468 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1924032965 has no extra specs with key hw:cpu_thread_policy. Sep 23 04:30:52.089468 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:30:52.089468 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ae533416-a9d1-4c55-990b-67dd5f64a63b tempest-FlavorsExtraSpecsNegativeTestJSON-1766239395 tempest-FlavorsExtraSpecsNegativeTestJSON-1766239395-project] Returning 404 to user: Flavor 1924032965 has no extra specs with key hw:cpu_thread_policy. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:30:52.095521 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ae533416-a9d1-4c55-990b-67dd5f64a63b tempest-FlavorsExtraSpecsNegativeTestJSON-1766239395 tempest-FlavorsExtraSpecsNegativeTestJSON-1766239395-project] 10.222.0.33 "GET /compute/v2.1/flavors/1924032965/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.696750 Sep 23 04:30:52.096095 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3/11] 10.222.0.33 () {58 vars in 1266 bytes} [Fri Sep 23 04:30:51 2022] GET /compute/v2.1/flavors/1924032965/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 698 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:30:52.108408 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-11da5790-4d8a-426f-be84-24cdcdb20106 tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-846463-3"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:30:52.156767 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-11da5790-4d8a-426f-be84-24cdcdb20106 tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:30:52.157515 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-11da5790-4d8a-426f-be84-24cdcdb20106 tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:30:52.159002 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-11da5790-4d8a-426f-be84-24cdcdb20106 tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:30:52.689349 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-200a16c3-9937-439f-ac8b-57732384b13c tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac39d27bcf5d4def9ff9bd5b81bd7b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79442cd4a69040f594e19b3492df7e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:30:52.716187 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-200a16c3-9937-439f-ac8b-57732384b13c tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] 10.222.0.33 "GET /compute/v2.1/servers/e18459f8-cd71-4feb-8764-c3b4cc3d89be" status: 200 len: 1220 microversion: 2.1 time: 1.032305 Sep 23 04:30:52.726188 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 9/12] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:30:51 2022] GET /compute/v2.1/servers/e18459f8-cd71-4feb-8764-c3b4cc3d89be => generated 1220 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:30:52.731427 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1de99e8e-1cf8-4134-80c6-61f7c86df145 tempest-FlavorsV255TestJSON-447354217 tempest-FlavorsV255TestJSON-447354217-project-admin] Action: 'update', calling method: .version_select at 0x7ff1c1a01af0>, body: {"flavor": {"description": "new"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:30:52.856437 n-d-846463-3 devstack@n-api.service[122699]: WARNING nova.scheduler.client.report [None req-11da5790-4d8a-426f-be84-24cdcdb20106 tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] [req-aedde5ba-5dbd-4600-9033-836de8c786cb] Failed to update aggregates to [9a0fb7a6-552c-4b59-8d08-9228b77cec92] for resource provider with UUID aa8c60d8-7122-44e6-8d0a-5cea3693ca01. Got 409: {"errors": [{"status": 409, "title": "Conflict", "detail": "There was a conflict when trying to complete your request.\n\n Update conflict: Another thread concurrently updated the resource provider data. Please retry your update ", "request_id": "req-aedde5ba-5dbd-4600-9033-836de8c786cb"}]} Sep 23 04:30:52.883863 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-1de99e8e-1cf8-4134-80c6-61f7c86df145 tempest-FlavorsV255TestJSON-447354217 tempest-FlavorsV255TestJSON-447354217-project-admin] 10.222.0.33 "PUT /compute/v2.1/flavors/1446949448" status: 200 len: 450 microversion: 2.55 time: 0.156058 Sep 23 04:30:52.885077 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 10/13] 10.222.0.33 () {62 vars in 1219 bytes} [Fri Sep 23 04:30:52 2022] PUT /compute/v2.1/flavors/1446949448 => generated 450 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 04:30:52.892263 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-686d58ea-0a7a-40fe-85c9-d9e44a34fefd tempest-FlavorsExtraSpecsNegativeTestJSON-1766239395 tempest-FlavorsExtraSpecsNegativeTestJSON-1766239395-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:30:52.897222 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-686d58ea-0a7a-40fe-85c9-d9e44a34fefd tempest-FlavorsExtraSpecsNegativeTestJSON-1766239395 tempest-FlavorsExtraSpecsNegativeTestJSON-1766239395-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '30754f7b913a48fe90c9dab5af7e7bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d186e7c7b14d47bf4026a39a7227ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:30:52.899746 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-686d58ea-0a7a-40fe-85c9-d9e44a34fefd tempest-FlavorsExtraSpecsNegativeTestJSON-1766239395 tempest-FlavorsExtraSpecsNegativeTestJSON-1766239395-project] Request method failure captured: Sep 23 04:30:52.899746 n-d-846463-3 devstack@n-api.service[122698]: request: POST /compute/v2.1/flavors/1924032965/os-extra_specs HTTP/1.1 Sep 23 04:30:52.899746 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:30:52.899746 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:30:52.899746 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:30:52.899746 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 66 Sep 23 04:30:52.899746 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:30:52.899746 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:30:52.899746 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:30:52.899746 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:30:52.899746 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTZ2oMwYhktNTBoUmM-gvqVMH0VldReaTqbfca74Q6010AyJllFfSWxT-XxITWP8JX0WnLrN2RwcDJCMYcPRb2MYGHNaRe8olNany_94muhwPmlOYWDsD5SQnQamUH3MLipnYcdg5JafxQUBzOpewo4jVpdSahODaqOl6ZUJSuWYdJ8 Sep 23 04:30:52.899746 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:30:52.899746 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:30:52.899746 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:30:52.899746 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:30:52.899746 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:30:52.899746 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:30:52.899746 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 00d186e7c7b14d47bf4026a39a7227ad Sep 23 04:30:52.899746 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1766239395 Sep 23 04:30:52.899746 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:30:52.899746 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:30:52.900810 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_00d186e7c7b14d47bf4026a39a7227ad", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/00d186e7c7b14d47bf4026a39a7227ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/00d186e7c7b14d47bf4026a39a7227ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/00d186e7c7b14d47bf4026a39a7227ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:30:52.900810 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1766239395 Sep 23 04:30:52.900810 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 00d186e7c7b14d47bf4026a39a7227ad Sep 23 04:30:52.900810 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1766239395 Sep 23 04:30:52.900810 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1766239395-project Sep 23 04:30:52.900810 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:30:52.900810 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:30:52.900810 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 30754f7b913a48fe90c9dab5af7e7bb6 Sep 23 04:30:52.900810 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1766239395-project Sep 23 04:30:52.900810 n-d-846463-3 devstack@n-api.service[122698]: Sep 23 04:30:52.900810 n-d-846463-3 devstack@n-api.service[122698]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Sep 23 04:30:52.900810 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:30:52.901414 n-d-846463-3 devstack@n-api.service[122698]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Sep 23 04:30:52.901414 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'flavor_id': '1924032965', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Sep 23 04:30:52.901414 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:30:52.901414 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:30:52.901414 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:30:52.901414 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:30:52.901414 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:30:52.901414 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:30:52.901414 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:30:52.901414 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:30:52.901414 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:30:52.901414 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:30:52.901414 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Sep 23 04:30:52.901414 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Sep 23 04:30:52.901414 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 23 04:30:52.901414 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 23 04:30:52.901414 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 23 04:30:52.901414 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 23 04:30:52.901414 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 23 04:30:52.902469 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 23 04:30:52.902469 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 23 04:30:52.902469 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise self.value Sep 23 04:30:52.902469 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 23 04:30:52.902469 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 23 04:30:52.902469 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 23 04:30:52.902469 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 23 04:30:52.902469 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 23 04:30:52.902469 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 23 04:30:52.902469 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Sep 23 04:30:52.902469 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:30:52.902469 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:30:52.902469 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:30:52.902469 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:30:52.902469 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:30:52.902469 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:30:52.902469 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 23 04:30:52.902469 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 23 04:30:52.902469 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Sep 23 04:30:52.902469 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:30:52.904123 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-686d58ea-0a7a-40fe-85c9-d9e44a34fefd tempest-FlavorsExtraSpecsNegativeTestJSON-1766239395 tempest-FlavorsExtraSpecsNegativeTestJSON-1766239395-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:30:52.904123 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-686d58ea-0a7a-40fe-85c9-d9e44a34fefd tempest-FlavorsExtraSpecsNegativeTestJSON-1766239395 tempest-FlavorsExtraSpecsNegativeTestJSON-1766239395-project] 10.222.0.33 "POST /compute/v2.1/flavors/1924032965/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.014930 Sep 23 04:30:52.906248 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 11/14] 10.222.0.33 () {60 vars in 1224 bytes} [Fri Sep 23 04:30:52 2022] POST /compute/v2.1/flavors/1924032965/os-extra_specs => generated 124 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:30:52.913338 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-bee5365d-be13-400c-be71-77ddbc72a05d tempest-FlavorsV255TestJSON-1672813140 tempest-FlavorsV255TestJSON-1672813140-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:30:52.974863 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-bee5365d-be13-400c-be71-77ddbc72a05d tempest-FlavorsV255TestJSON-1672813140 tempest-FlavorsV255TestJSON-1672813140-project] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 6151 microversion: 2.55 time: 0.064758 Sep 23 04:30:52.975517 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 12/15] 10.222.0.33 () {60 vars in 1187 bytes} [Fri Sep 23 04:30:52 2022] GET /compute/v2.1/flavors/detail => generated 6151 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:30:52.986105 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-cbd9c50f-5583-447d-92cf-1711631cb039 tempest-FlavorsExtraSpecsNegativeTestJSON-171571836 tempest-FlavorsExtraSpecsNegativeTestJSON-171571836-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:30:53.103523 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-cbd9c50f-5583-447d-92cf-1711631cb039 tempest-FlavorsExtraSpecsNegativeTestJSON-171571836 tempest-FlavorsExtraSpecsNegativeTestJSON-171571836-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/1924032965/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.126302 Sep 23 04:30:53.103928 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 13/16] 10.222.0.33 () {60 vars in 1224 bytes} [Fri Sep 23 04:30:52 2022] POST /compute/v2.1/flavors/1924032965/os-extra_specs => generated 66 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 04:30:53.120592 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f5c9966a-6460-413b-8cc9-bb72ae8aa9d0 tempest-FlavorsV255TestJSON-1672813140 tempest-FlavorsV255TestJSON-1672813140-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:30:53.143650 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-11da5790-4d8a-426f-be84-24cdcdb20106 tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 242 microversion: 2.1 time: 1.042607 Sep 23 04:30:53.146275 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4/17] 10.222.0.33 () {60 vars in 1191 bytes} [Fri Sep 23 04:30:52 2022] POST /compute/v2.1/os-aggregates/1/action => generated 242 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:30:53.155865 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-bdfa0ea6-82c6-4937-b5b3-c8397a4d7fa8 tempest-FlavorsExtraSpecsNegativeTestJSON-1766239395 tempest-FlavorsExtraSpecsNegativeTestJSON-1766239395-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:30:53.168612 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-bdfa0ea6-82c6-4937-b5b3-c8397a4d7fa8 tempest-FlavorsExtraSpecsNegativeTestJSON-1766239395 tempest-FlavorsExtraSpecsNegativeTestJSON-1766239395-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '30754f7b913a48fe90c9dab5af7e7bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d186e7c7b14d47bf4026a39a7227ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:30:53.174250 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-bdfa0ea6-82c6-4937-b5b3-c8397a4d7fa8 tempest-FlavorsExtraSpecsNegativeTestJSON-1766239395 tempest-FlavorsExtraSpecsNegativeTestJSON-1766239395-project] Request method failure captured: Sep 23 04:30:53.174250 n-d-846463-3 devstack@n-api.service[122699]: request: DELETE /compute/v2.1/flavors/1924032965/os-extra_specs/hw:numa_nodes HTTP/1.1 Sep 23 04:30:53.174250 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:30:53.174250 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:30:53.174250 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:30:53.174250 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:30:53.174250 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:30:53.174250 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:30:53.174250 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:30:53.174250 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:30:53.174250 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTZ2oMwYhktNTBoUmM-gvqVMH0VldReaTqbfca74Q6010AyJllFfSWxT-XxITWP8JX0WnLrN2RwcDJCMYcPRb2MYGHNaRe8olNany_94muhwPmlOYWDsD5SQnQamUH3MLipnYcdg5JafxQUBzOpewo4jVpdSahODaqOl6ZUJSuWYdJ8 Sep 23 04:30:53.174250 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:30:53.174250 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:30:53.174250 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:30:53.174250 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:30:53.174250 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:30:53.174250 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:30:53.174250 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 00d186e7c7b14d47bf4026a39a7227ad Sep 23 04:30:53.174250 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1766239395 Sep 23 04:30:53.174250 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:30:53.174250 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:30:53.175314 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_00d186e7c7b14d47bf4026a39a7227ad", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/00d186e7c7b14d47bf4026a39a7227ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/00d186e7c7b14d47bf4026a39a7227ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/00d186e7c7b14d47bf4026a39a7227ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:30:53.175314 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1766239395 Sep 23 04:30:53.175314 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 00d186e7c7b14d47bf4026a39a7227ad Sep 23 04:30:53.175314 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1766239395 Sep 23 04:30:53.175314 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1766239395-project Sep 23 04:30:53.175314 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:30:53.175314 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:30:53.175314 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 30754f7b913a48fe90c9dab5af7e7bb6 Sep 23 04:30:53.175314 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1766239395-project Sep 23 04:30:53.175314 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:30:53.175314 n-d-846463-3 devstack@n-api.service[122699]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Sep 23 04:30:53.175896 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'flavor_id': '1924032965', 'id': 'hw:numa_nodes'} Sep 23 04:30:53.175896 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:30:53.175896 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:30:53.175896 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:30:53.175896 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:30:53.175896 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:30:53.175896 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:30:53.175896 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:30:53.175896 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:30:53.175896 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Sep 23 04:30:53.175896 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Sep 23 04:30:53.175896 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 23 04:30:53.175896 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 23 04:30:53.175896 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 23 04:30:53.175896 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 23 04:30:53.175896 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 23 04:30:53.175896 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 23 04:30:53.175896 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 23 04:30:53.175896 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise self.value Sep 23 04:30:53.175896 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 23 04:30:53.176841 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 23 04:30:53.176841 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 23 04:30:53.176841 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 23 04:30:53.176841 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 23 04:30:53.176841 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 23 04:30:53.176841 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Sep 23 04:30:53.176841 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:30:53.176841 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:30:53.176841 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:30:53.176841 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:30:53.176841 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:30:53.176841 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:30:53.176841 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 23 04:30:53.176841 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 23 04:30:53.176841 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Sep 23 04:30:53.176841 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:30:53.176841 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-bdfa0ea6-82c6-4937-b5b3-c8397a4d7fa8 tempest-FlavorsExtraSpecsNegativeTestJSON-1766239395 tempest-FlavorsExtraSpecsNegativeTestJSON-1766239395-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:30:53.178266 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f5c9966a-6460-413b-8cc9-bb72ae8aa9d0 tempest-FlavorsV255TestJSON-1672813140 tempest-FlavorsV255TestJSON-1672813140-project] 10.222.0.33 "GET /compute/v2.1/flavors" status: 200 len: 3409 microversion: 2.55 time: 0.063796 Sep 23 04:30:53.178340 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-bdfa0ea6-82c6-4937-b5b3-c8397a4d7fa8 tempest-FlavorsExtraSpecsNegativeTestJSON-1766239395 tempest-FlavorsExtraSpecsNegativeTestJSON-1766239395-project] 10.222.0.33 "DELETE /compute/v2.1/flavors/1924032965/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.027461 Sep 23 04:30:53.178412 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 14/18] 10.222.0.33 () {60 vars in 1166 bytes} [Fri Sep 23 04:30:53 2022] GET /compute/v2.1/flavors => generated 3409 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:30:53.178477 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 5/19] 10.222.0.33 () {58 vars in 1248 bytes} [Fri Sep 23 04:30:53 2022] DELETE /compute/v2.1/flavors/1924032965/os-extra_specs/hw:numa_nodes => generated 124 bytes in 30 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:30:53.184020 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0296aaef-2493-4501-9c89-050cf37510e3 tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-846463-3"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:30:53.192006 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3f352091-9e41-4dbd-8b05-22cec5976547 tempest-FlavorsExtraSpecsNegativeTestJSON-171571836 tempest-FlavorsExtraSpecsNegativeTestJSON-171571836-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:30:53.237074 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0296aaef-2493-4501-9c89-050cf37510e3 tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:30:53.242289 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0296aaef-2493-4501-9c89-050cf37510e3 tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:30:53.245012 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0296aaef-2493-4501-9c89-050cf37510e3 tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:30:53.298259 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3f352091-9e41-4dbd-8b05-22cec5976547 tempest-FlavorsExtraSpecsNegativeTestJSON-171571836 tempest-FlavorsExtraSpecsNegativeTestJSON-171571836-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/1924032965/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.107724 Sep 23 04:30:53.298893 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 6/20] 10.222.0.33 () {60 vars in 1224 bytes} [Fri Sep 23 04:30:53 2022] POST /compute/v2.1/flavors/1924032965/os-extra_specs => generated 66 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 23 04:30:53.310532 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0aeef91e-c9c5-4f27-94f5-661cf94a42a9 tempest-FlavorsV255TestJSON-447354217 tempest-FlavorsV255TestJSON-447354217-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:30:53.432053 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-0296aaef-2493-4501-9c89-050cf37510e3 tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] HTTP exception thrown: Aggregate 1 already has host n-h2-846463-3. Sep 23 04:30:53.447368 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0296aaef-2493-4501-9c89-050cf37510e3 tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] Request method failure captured: Sep 23 04:30:53.447368 n-d-846463-3 devstack@n-api.service[122698]: request: POST /compute/v2.1/os-aggregates/1/action HTTP/1.1 Sep 23 04:30:53.447368 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:30:53.447368 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:30:53.447368 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:30:53.447368 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 39 Sep 23 04:30:53.447368 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:30:53.447368 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:30:53.447368 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:30:53.447368 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:30:53.447368 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTZ5oEAchpKsFTLJD2ORtLdgqj3VHiTBLEM6UEPkUUCvcyhf0_w1Xxxls4zrNN9m-rmbehAHDIYaSPnFC9qCAriwu0PussLgdOCF2zTCPBrKzCi-GYGjkUruxttnETP-K2i9CdZdQcLkzw59XHXqeXxFwe_YqUAo93JD5ZxCOdShtNA Sep 23 04:30:53.447368 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:30:53.447368 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:30:53.447368 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:30:53.447368 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:30:53.447368 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:30:53.447368 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:30:53.447368 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: db8ef5d6dc834d57b5b3fad0dda5512c Sep 23 04:30:53.447368 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2040548293 Sep 23 04:30:53.447368 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,admin,member Sep 23 04:30:53.447368 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,admin,member Sep 23 04:30:53.448501 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_db8ef5d6dc834d57b5b3fad0dda5512c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/db8ef5d6dc834d57b5b3fad0dda5512c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/db8ef5d6dc834d57b5b3fad0dda5512c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/db8ef5d6dc834d57b5b3fad0dda5512c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:30:53.448501 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2040548293 Sep 23 04:30:53.448501 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: db8ef5d6dc834d57b5b3fad0dda5512c Sep 23 04:30:53.448501 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2040548293 Sep 23 04:30:53.448501 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin Sep 23 04:30:53.448501 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:30:53.448501 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:30:53.448501 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 289ab0514fa048a9b6662b3e56304199 Sep 23 04:30:53.448501 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin Sep 23 04:30:53.448501 n-d-846463-3 devstack@n-api.service[122698]: Sep 23 04:30:53.448501 n-d-846463-3 devstack@n-api.service[122698]: {"add_host": {"host": "n-h2-846463-3"}} Sep 23 04:30:53.448501 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:30:53.448501 n-d-846463-3 devstack@n-api.service[122698]: exception: Aggregate 1 already has host n-h2-846463-3. Sep 23 04:30:53.449330 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '1', 'body': {'add_host': {'host': 'n-h2-846463-3'}}} Sep 23 04:30:53.449330 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:30:53.449330 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:30:53.449330 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 23 04:30:53.449330 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 23 04:30:53.449330 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 23 04:30:53.449330 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 23 04:30:53.449330 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 23 04:30:53.449330 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 23 04:30:53.449330 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 23 04:30:53.449330 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 23 04:30:53.449330 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 23 04:30:53.449330 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 23 04:30:53.449330 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 23 04:30:53.449330 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi result.read() Sep 23 04:30:53.449330 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 23 04:30:53.449330 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 23 04:30:53.449330 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 23 04:30:53.449330 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 23 04:30:53.450372 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 23 04:30:53.450372 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 23 04:30:53.450372 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 23 04:30:53.450372 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 23 04:30:53.450372 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h2-846463-3-1' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Sep 23 04:30:53.450372 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:30:53.450372 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 23 04:30:53.450372 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:30:53.450372 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:30:53.450372 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Sep 23 04:30:53.450372 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Sep 23 04:30:53.450372 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Sep 23 04:30:53.450372 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi session.flush() Sep 23 04:30:53.450372 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 23 04:30:53.450372 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self._flush(objects) Sep 23 04:30:53.450372 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 23 04:30:53.450372 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Sep 23 04:30:53.450372 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 23 04:30:53.450372 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi compat.raise_( Sep 23 04:30:53.451585 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 23 04:30:53.451585 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception Sep 23 04:30:53.451585 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 23 04:30:53.451585 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi flush_context.execute() Sep 23 04:30:53.451585 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 23 04:30:53.451585 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi rec.execute(self) Sep 23 04:30:53.451585 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 23 04:30:53.451585 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Sep 23 04:30:53.451585 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 23 04:30:53.451585 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Sep 23 04:30:53.451585 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 23 04:30:53.451585 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Sep 23 04:30:53.451585 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 23 04:30:53.451585 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Sep 23 04:30:53.451585 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 23 04:30:53.451585 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Sep 23 04:30:53.451585 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 23 04:30:53.451585 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Sep 23 04:30:53.452494 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 23 04:30:53.452494 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Sep 23 04:30:53.452494 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 23 04:30:53.452494 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 23 04:30:53.452494 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 23 04:30:53.452494 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception Sep 23 04:30:53.452494 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 23 04:30:53.452494 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 23 04:30:53.452494 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 23 04:30:53.452494 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 23 04:30:53.452494 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 23 04:30:53.452494 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 23 04:30:53.452494 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 23 04:30:53.452494 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 23 04:30:53.452494 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 23 04:30:53.452494 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 23 04:30:53.452494 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 23 04:30:53.452494 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi result.read() Sep 23 04:30:53.453405 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 23 04:30:53.453405 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 23 04:30:53.453405 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 23 04:30:53.453405 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 23 04:30:53.453405 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 23 04:30:53.453405 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 23 04:30:53.453405 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 23 04:30:53.453405 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 23 04:30:53.453405 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h2-846463-3-1' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Sep 23 04:30:53.453405 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Sep 23 04:30:53.453405 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 9, 23, 4, 30, 53, 367231), 'updated_at': None, 'host': 'n-h2-846463-3', 'aggregate_id': 1}] Sep 23 04:30:53.453405 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 23 04:30:53.453405 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:30:53.453405 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:30:53.453405 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:30:53.453405 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:30:53.453405 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Sep 23 04:30:53.459993 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Sep 23 04:30:53.459993 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 23 04:30:53.459993 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 23 04:30:53.459993 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 23 04:30:53.459993 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 23 04:30:53.459993 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 23 04:30:53.459993 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise self.value Sep 23 04:30:53.459993 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 23 04:30:53.459993 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 23 04:30:53.459993 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in add_host_to_aggregate Sep 23 04:30:53.459993 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Sep 23 04:30:53.459993 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 23 04:30:53.459993 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 23 04:30:53.459993 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Sep 23 04:30:53.459993 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Sep 23 04:30:53.459993 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Sep 23 04:30:53.459993 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Sep 23 04:30:53.459993 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 1 already has host n-h2-846463-3. Sep 23 04:30:53.459993 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:30:53.459993 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:30:53.461035 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:30:53.461035 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:30:53.461035 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:30:53.461035 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:30:53.461035 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:30:53.461035 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:30:53.461035 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:30:53.461035 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:30:53.461035 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:30:53.461035 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:30:53.461035 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Sep 23 04:30:53.461035 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Sep 23 04:30:53.461035 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 1 already has host n-h2-846463-3. Sep 23 04:30:53.461035 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:30:53.461035 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:30:53.461035 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:30:53.461035 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:30:53.461035 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:30:53.461035 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:30:53.461035 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:30:53.461035 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:30:53.462786 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 1 already has host n-h2-846463-3. Sep 23 04:30:53.462786 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:30:53.462903 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0aeef91e-c9c5-4f27-94f5-661cf94a42a9 tempest-FlavorsV255TestJSON-447354217 tempest-FlavorsV255TestJSON-447354217-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/1446949448" status: 202 len: 0 microversion: 2.55 time: 0.154798 Sep 23 04:30:53.462971 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0296aaef-2493-4501-9c89-050cf37510e3 tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] Returning 409 to user: Aggregate 1 already has host n-h2-846463-3. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:30:53.463034 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 7/21] 10.222.0.33 () {60 vars in 1202 bytes} [Fri Sep 23 04:30:53 2022] DELETE /compute/v2.1/flavors/1446949448 => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:30:53.463095 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0296aaef-2493-4501-9c89-050cf37510e3 tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/1/action" status: 409 len: 95 microversion: 2.1 time: 0.277698 Sep 23 04:30:53.463095 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 15/22] 10.222.0.33 () {60 vars in 1191 bytes} [Fri Sep 23 04:30:53 2022] POST /compute/v2.1/os-aggregates/1/action => generated 95 bytes in 283 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Sep 23 04:30:53.463223 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c7747c82-9155-4939-b4bb-427fcf3e1567 tempest-FlavorsExtraSpecsNegativeTestJSON-1766239395 tempest-FlavorsExtraSpecsNegativeTestJSON-1766239395-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:30:53.465876 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c7747c82-9155-4939-b4bb-427fcf3e1567 tempest-FlavorsExtraSpecsNegativeTestJSON-1766239395 tempest-FlavorsExtraSpecsNegativeTestJSON-1766239395-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '30754f7b913a48fe90c9dab5af7e7bb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d186e7c7b14d47bf4026a39a7227ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:30:53.471593 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1bf205f7-82ee-4020-8ec4-5a3d6f6c42b8 tempest-FlavorsV255TestJSON-447354217 tempest-FlavorsV255TestJSON-447354217-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:30:53.472151 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c7747c82-9155-4939-b4bb-427fcf3e1567 tempest-FlavorsExtraSpecsNegativeTestJSON-1766239395 tempest-FlavorsExtraSpecsNegativeTestJSON-1766239395-project] Request method failure captured: Sep 23 04:30:53.472151 n-d-846463-3 devstack@n-api.service[122699]: request: PUT /compute/v2.1/flavors/1924032965/os-extra_specs/hw:numa_nodes HTTP/1.1 Sep 23 04:30:53.472151 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:30:53.472151 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:30:53.472151 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:30:53.472151 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 22 Sep 23 04:30:53.472151 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:30:53.472151 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:30:53.472151 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:30:53.472151 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:30:53.472151 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTZ2oMwYhktNTBoUmM-gvqVMH0VldReaTqbfca74Q6010AyJllFfSWxT-XxITWP8JX0WnLrN2RwcDJCMYcPRb2MYGHNaRe8olNany_94muhwPmlOYWDsD5SQnQamUH3MLipnYcdg5JafxQUBzOpewo4jVpdSahODaqOl6ZUJSuWYdJ8 Sep 23 04:30:53.472151 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:30:53.472151 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:30:53.472151 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:30:53.472151 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:30:53.472151 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:30:53.472151 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:30:53.472151 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 00d186e7c7b14d47bf4026a39a7227ad Sep 23 04:30:53.472151 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1766239395 Sep 23 04:30:53.472151 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:30:53.472151 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:30:53.473226 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_00d186e7c7b14d47bf4026a39a7227ad", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/00d186e7c7b14d47bf4026a39a7227ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/00d186e7c7b14d47bf4026a39a7227ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/00d186e7c7b14d47bf4026a39a7227ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:30:53.473226 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1766239395 Sep 23 04:30:53.473226 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 00d186e7c7b14d47bf4026a39a7227ad Sep 23 04:30:53.473226 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1766239395 Sep 23 04:30:53.473226 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1766239395-project Sep 23 04:30:53.473226 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:30:53.473226 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:30:53.473226 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 30754f7b913a48fe90c9dab5af7e7bb6 Sep 23 04:30:53.473226 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1766239395-project Sep 23 04:30:53.473226 n-d-846463-3 devstack@n-api.service[122699]: Sep 23 04:30:53.473226 n-d-846463-3 devstack@n-api.service[122699]: {"hw:numa_nodes": "1"} Sep 23 04:30:53.473226 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:30:53.473226 n-d-846463-3 devstack@n-api.service[122699]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Sep 23 04:30:53.474466 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'flavor_id': '1924032965', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Sep 23 04:30:53.474466 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:30:53.474466 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:30:53.474466 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:30:53.474466 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:30:53.474466 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:30:53.474466 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:30:53.474466 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:30:53.474466 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:30:53.474466 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:30:53.474466 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:30:53.474466 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Sep 23 04:30:53.474466 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Sep 23 04:30:53.474466 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 23 04:30:53.474466 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 23 04:30:53.474466 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 23 04:30:53.474466 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 23 04:30:53.474466 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 23 04:30:53.474466 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 23 04:30:53.475380 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 23 04:30:53.475380 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise self.value Sep 23 04:30:53.475380 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 23 04:30:53.475380 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 23 04:30:53.475380 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 23 04:30:53.475380 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 23 04:30:53.475380 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 23 04:30:53.475380 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 23 04:30:53.475380 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Sep 23 04:30:53.475380 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:30:53.475380 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:30:53.475380 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:30:53.475380 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:30:53.475380 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:30:53.475380 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:30:53.475380 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 23 04:30:53.475380 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 23 04:30:53.475380 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Sep 23 04:30:53.475380 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:30:53.477574 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c7747c82-9155-4939-b4bb-427fcf3e1567 tempest-FlavorsExtraSpecsNegativeTestJSON-1766239395 tempest-FlavorsExtraSpecsNegativeTestJSON-1766239395-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:30:53.477574 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c7747c82-9155-4939-b4bb-427fcf3e1567 tempest-FlavorsExtraSpecsNegativeTestJSON-1766239395 tempest-FlavorsExtraSpecsNegativeTestJSON-1766239395-project] 10.222.0.33 "PUT /compute/v2.1/flavors/1924032965/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.017015 Sep 23 04:30:53.478693 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 8/23] 10.222.0.33 () {60 vars in 1265 bytes} [Fri Sep 23 04:30:53 2022] PUT /compute/v2.1/flavors/1924032965/os-extra_specs/hw:numa_nodes => generated 124 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:30:53.501078 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-130f0edd-3104-4c20-a6fb-8d93b18e9d34 tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-846463-3"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:30:53.517261 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-1bf205f7-82ee-4020-8ec4-5a3d6f6c42b8 tempest-FlavorsV255TestJSON-447354217 tempest-FlavorsV255TestJSON-447354217-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5711 microversion: 2.55 time: 0.051793 Sep 23 04:30:53.518991 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 16/24] 10.222.0.33 () {60 vars in 1187 bytes} [Fri Sep 23 04:30:53 2022] GET /compute/v2.1/flavors/detail => generated 5711 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:30:53.520910 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-130f0edd-3104-4c20-a6fb-8d93b18e9d34 tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:30:53.521425 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-130f0edd-3104-4c20-a6fb-8d93b18e9d34 tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:30:53.521862 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-130f0edd-3104-4c20-a6fb-8d93b18e9d34 tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:30:53.527363 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5a60bd52-6b3f-42fd-b1a2-9d64c751313f tempest-FlavorsExtraSpecsNegativeTestJSON-171571836 tempest-FlavorsExtraSpecsNegativeTestJSON-171571836-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:30:53.538001 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-5a60bd52-6b3f-42fd-b1a2-9d64c751313f tempest-FlavorsExtraSpecsNegativeTestJSON-171571836 tempest-FlavorsExtraSpecsNegativeTestJSON-171571836-project-admin] HTTP exception thrown: Flavor 1924032965 has no extra specs with key hw:cpu_thread_policy. Sep 23 04:30:53.540446 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5a60bd52-6b3f-42fd-b1a2-9d64c751313f tempest-FlavorsExtraSpecsNegativeTestJSON-171571836 tempest-FlavorsExtraSpecsNegativeTestJSON-171571836-project-admin] Request method failure captured: Sep 23 04:30:53.540446 n-d-846463-3 devstack@n-api.service[122698]: request: DELETE /compute/v2.1/flavors/1924032965/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Sep 23 04:30:53.540446 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:30:53.540446 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:30:53.540446 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:30:53.540446 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:30:53.540446 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:30:53.540446 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:30:53.540446 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:30:53.540446 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:30:53.540446 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTZ5n1pKbEhRW-KfYA3fY2Kuedwz2HvygVDTH1opoSwOl2vjGQm-1h-VygwGbtjWthzZ-6m0uble5J6o2Ro-OT7iitl9ptYE4HuHPqJjqwBdBKoQiqrL3yAxCuLlwOzyHYTkE1saBYPNffxXw0EJnPFs41BovDxgfMxYidqPrAPOSDY Sep 23 04:30:53.540446 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:30:53.540446 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:30:53.540446 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:30:53.540446 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:30:53.540446 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:30:53.540446 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:30:53.540446 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 7066c4d72f8d4db5b1e85656d6da8dae Sep 23 04:30:53.540446 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-171571836 Sep 23 04:30:53.540446 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,admin,member Sep 23 04:30:53.540446 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,admin,member Sep 23 04:30:53.541758 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7066c4d72f8d4db5b1e85656d6da8dae", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7066c4d72f8d4db5b1e85656d6da8dae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7066c4d72f8d4db5b1e85656d6da8dae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7066c4d72f8d4db5b1e85656d6da8dae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:30:53.541758 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-171571836 Sep 23 04:30:53.541758 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 7066c4d72f8d4db5b1e85656d6da8dae Sep 23 04:30:53.541758 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-171571836 Sep 23 04:30:53.541758 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-171571836-project-admin Sep 23 04:30:53.541758 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:30:53.541758 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:30:53.541758 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 67683685bc4748d88e3d12f4eb81e9d6 Sep 23 04:30:53.541758 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-171571836-project-admin Sep 23 04:30:53.541758 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:30:53.541758 n-d-846463-3 devstack@n-api.service[122698]: exception: Flavor 1924032965 has no extra specs with key hw:cpu_thread_policy. Sep 23 04:30:53.542525 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'flavor_id': '1924032965', 'id': 'hw:cpu_thread_policy'} Sep 23 04:30:53.542525 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:30:53.542525 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:30:53.542525 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Sep 23 04:30:53.542525 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Sep 23 04:30:53.542525 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Sep 23 04:30:53.542525 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:30:53.542525 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:30:53.542525 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:30:53.542525 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:30:53.542525 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:30:53.542525 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:30:53.542525 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:30:53.542525 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:30:53.542525 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:30:53.542525 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:30:53.542525 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Sep 23 04:30:53.542525 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 23 04:30:53.542525 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1924032965 has no extra specs with key hw:cpu_thread_policy. Sep 23 04:30:53.542525 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:30:53.542525 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:30:53.542525 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:30:53.543598 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:30:53.543598 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:30:53.543598 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:30:53.543598 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:30:53.543598 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:30:53.543598 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1924032965 has no extra specs with key hw:cpu_thread_policy. Sep 23 04:30:53.543598 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:30:53.545825 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5a60bd52-6b3f-42fd-b1a2-9d64c751313f tempest-FlavorsExtraSpecsNegativeTestJSON-171571836 tempest-FlavorsExtraSpecsNegativeTestJSON-171571836-project-admin] Returning 404 to user: Flavor 1924032965 has no extra specs with key hw:cpu_thread_policy. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:30:53.547237 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5a60bd52-6b3f-42fd-b1a2-9d64c751313f tempest-FlavorsExtraSpecsNegativeTestJSON-171571836 tempest-FlavorsExtraSpecsNegativeTestJSON-171571836-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/1924032965/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.026861 Sep 23 04:30:53.553624 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 17/25] 10.222.0.33 () {58 vars in 1269 bytes} [Fri Sep 23 04:30:53 2022] DELETE /compute/v2.1/flavors/1924032965/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:30:53.562947 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8eac74da-5a8a-4958-bb5a-46f51ed25e86 tempest-FlavorsExtraSpecsNegativeTestJSON-171571836 tempest-FlavorsExtraSpecsNegativeTestJSON-171571836-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:30:53.590442 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-8eac74da-5a8a-4958-bb5a-46f51ed25e86 tempest-FlavorsExtraSpecsNegativeTestJSON-171571836 tempest-FlavorsExtraSpecsNegativeTestJSON-171571836-project-admin] HTTP exception thrown: Request body and URI mismatch Sep 23 04:30:53.591918 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8eac74da-5a8a-4958-bb5a-46f51ed25e86 tempest-FlavorsExtraSpecsNegativeTestJSON-171571836 tempest-FlavorsExtraSpecsNegativeTestJSON-171571836-project-admin] Request method failure captured: Sep 23 04:30:53.591918 n-d-846463-3 devstack@n-api.service[122698]: request: PUT /compute/v2.1/flavors/1924032965/os-extra_specs/hw:numa_nodes HTTP/1.1 Sep 23 04:30:53.591918 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:30:53.591918 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:30:53.591918 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:30:53.591918 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 27 Sep 23 04:30:53.591918 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:30:53.591918 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:30:53.591918 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:30:53.591918 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:30:53.591918 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTZ5n1pKbEhRW-KfYA3fY2Kuedwz2HvygVDTH1opoSwOl2vjGQm-1h-VygwGbtjWthzZ-6m0uble5J6o2Ro-OT7iitl9ptYE4HuHPqJjqwBdBKoQiqrL3yAxCuLlwOzyHYTkE1saBYPNffxXw0EJnPFs41BovDxgfMxYidqPrAPOSDY Sep 23 04:30:53.591918 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:30:53.591918 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:30:53.591918 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:30:53.591918 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:30:53.591918 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:30:53.591918 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:30:53.591918 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 7066c4d72f8d4db5b1e85656d6da8dae Sep 23 04:30:53.591918 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-171571836 Sep 23 04:30:53.591918 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,admin,member Sep 23 04:30:53.591918 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,admin,member Sep 23 04:30:53.592990 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7066c4d72f8d4db5b1e85656d6da8dae", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7066c4d72f8d4db5b1e85656d6da8dae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7066c4d72f8d4db5b1e85656d6da8dae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7066c4d72f8d4db5b1e85656d6da8dae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:30:53.592990 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-171571836 Sep 23 04:30:53.592990 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 7066c4d72f8d4db5b1e85656d6da8dae Sep 23 04:30:53.592990 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-171571836 Sep 23 04:30:53.592990 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-171571836-project-admin Sep 23 04:30:53.592990 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:30:53.592990 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:30:53.592990 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 67683685bc4748d88e3d12f4eb81e9d6 Sep 23 04:30:53.592990 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-171571836-project-admin Sep 23 04:30:53.592990 n-d-846463-3 devstack@n-api.service[122698]: Sep 23 04:30:53.592990 n-d-846463-3 devstack@n-api.service[122698]: {"hw:cpu_policy": "shared"} Sep 23 04:30:53.592990 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:30:53.592990 n-d-846463-3 devstack@n-api.service[122698]: exception: Request body and URI mismatch Sep 23 04:30:53.593632 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'flavor_id': '1924032965', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Sep 23 04:30:53.593632 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:30:53.593632 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:30:53.593632 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:30:53.593632 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:30:53.593632 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:30:53.593632 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:30:53.593632 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:30:53.593632 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:30:53.593632 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:30:53.593632 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:30:53.593632 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Sep 23 04:30:53.593632 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Sep 23 04:30:53.593632 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Sep 23 04:30:53.593632 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:30:53.593632 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:30:53.593632 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:30:53.593632 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:30:53.593632 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:30:53.593632 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:30:53.600099 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:30:53.600099 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:30:53.600099 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Sep 23 04:30:53.600099 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:30:53.600099 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8eac74da-5a8a-4958-bb5a-46f51ed25e86 tempest-FlavorsExtraSpecsNegativeTestJSON-171571836 tempest-FlavorsExtraSpecsNegativeTestJSON-171571836-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:30:53.600099 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8eac74da-5a8a-4958-bb5a-46f51ed25e86 tempest-FlavorsExtraSpecsNegativeTestJSON-171571836 tempest-FlavorsExtraSpecsNegativeTestJSON-171571836-project-admin] 10.222.0.33 "PUT /compute/v2.1/flavors/1924032965/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.035738 Sep 23 04:30:53.600099 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 18/26] 10.222.0.33 () {60 vars in 1265 bytes} [Fri Sep 23 04:30:53 2022] PUT /compute/v2.1/flavors/1924032965/os-extra_specs/hw:numa_nodes => generated 73 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 23 04:30:53.610137 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6061dcf3-314a-45a7-86c8-13cdf2bf9cca tempest-FlavorsExtraSpecsNegativeTestJSON-171571836 tempest-FlavorsExtraSpecsNegativeTestJSON-171571836-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:30:53.615673 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6061dcf3-314a-45a7-86c8-13cdf2bf9cca tempest-FlavorsExtraSpecsNegativeTestJSON-171571836 tempest-FlavorsExtraSpecsNegativeTestJSON-171571836-project-admin] Request method failure captured: Sep 23 04:30:53.615673 n-d-846463-3 devstack@n-api.service[122698]: request: PUT /compute/v2.1/flavors/1924032965/os-extra_specs/hw:numa_nodes HTTP/1.1 Sep 23 04:30:53.615673 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:30:53.615673 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:30:53.615673 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:30:53.615673 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 49 Sep 23 04:30:53.615673 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:30:53.615673 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:30:53.615673 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:30:53.615673 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:30:53.615673 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTZ5n1pKbEhRW-KfYA3fY2Kuedwz2HvygVDTH1opoSwOl2vjGQm-1h-VygwGbtjWthzZ-6m0uble5J6o2Ro-OT7iitl9ptYE4HuHPqJjqwBdBKoQiqrL3yAxCuLlwOzyHYTkE1saBYPNffxXw0EJnPFs41BovDxgfMxYidqPrAPOSDY Sep 23 04:30:53.615673 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:30:53.615673 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:30:53.615673 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:30:53.615673 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:30:53.615673 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:30:53.615673 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:30:53.615673 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 7066c4d72f8d4db5b1e85656d6da8dae Sep 23 04:30:53.615673 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-171571836 Sep 23 04:30:53.615673 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,admin,member Sep 23 04:30:53.615673 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,admin,member Sep 23 04:30:53.617026 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7066c4d72f8d4db5b1e85656d6da8dae", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7066c4d72f8d4db5b1e85656d6da8dae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7066c4d72f8d4db5b1e85656d6da8dae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7066c4d72f8d4db5b1e85656d6da8dae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:30:53.617026 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-171571836 Sep 23 04:30:53.617026 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 7066c4d72f8d4db5b1e85656d6da8dae Sep 23 04:30:53.617026 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-171571836 Sep 23 04:30:53.617026 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-171571836-project-admin Sep 23 04:30:53.617026 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:30:53.617026 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:30:53.617026 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 67683685bc4748d88e3d12f4eb81e9d6 Sep 23 04:30:53.617026 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-171571836-project-admin Sep 23 04:30:53.617026 n-d-846463-3 devstack@n-api.service[122698]: Sep 23 04:30:53.617026 n-d-846463-3 devstack@n-api.service[122698]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Sep 23 04:30:53.617026 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:30:53.617763 n-d-846463-3 devstack@n-api.service[122698]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Sep 23 04:30:53.617763 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'flavor_id': '1924032965', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Sep 23 04:30:53.617763 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:30:53.617763 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:30:53.617763 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 23 04:30:53.617763 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 23 04:30:53.617763 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 23 04:30:53.617763 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise error Sep 23 04:30:53.617763 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Sep 23 04:30:53.617763 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:30:53.617763 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Sep 23 04:30:53.617763 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 23 04:30:53.617763 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Sep 23 04:30:53.617763 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Sep 23 04:30:53.617763 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 23 04:30:53.617763 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi 'type': ['string', Sep 23 04:30:53.617763 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi 'number']}}, Sep 23 04:30:53.617763 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 23 04:30:53.617763 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:30:53.617763 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi On instance: Sep 23 04:30:53.617763 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Sep 23 04:30:53.617763 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:30:53.619124 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:30:53.619124 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:30:53.619124 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:30:53.619124 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:30:53.619124 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:30:53.619124 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:30:53.619124 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:30:53.619124 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:30:53.619124 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:30:53.619124 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 23 04:30:53.619124 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 23 04:30:53.619124 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 23 04:30:53.619124 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 23 04:30:53.619124 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 23 04:30:53.619124 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 23 04:30:53.619124 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Sep 23 04:30:53.619124 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:30:53.619124 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:30:53.619124 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:30:53.619124 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:30:53.620451 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:30:53.620451 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:30:53.620451 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 23 04:30:53.620451 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 23 04:30:53.620451 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Sep 23 04:30:53.620451 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:30:53.620451 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6061dcf3-314a-45a7-86c8-13cdf2bf9cca tempest-FlavorsExtraSpecsNegativeTestJSON-171571836 tempest-FlavorsExtraSpecsNegativeTestJSON-171571836-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:30:53.620451 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-6061dcf3-314a-45a7-86c8-13cdf2bf9cca tempest-FlavorsExtraSpecsNegativeTestJSON-171571836 tempest-FlavorsExtraSpecsNegativeTestJSON-171571836-project-admin] 10.222.0.33 "PUT /compute/v2.1/flavors/1924032965/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.016759 Sep 23 04:30:53.624164 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 19/27] 10.222.0.33 () {60 vars in 1265 bytes} [Fri Sep 23 04:30:53 2022] PUT /compute/v2.1/flavors/1924032965/os-extra_specs/hw:numa_nodes => generated 117 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 04:30:53.630031 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d8594c6c-cf8f-46d0-a3e4-64950f03a749 tempest-FlavorsExtraSpecsNegativeTestJSON-171571836 tempest-FlavorsExtraSpecsNegativeTestJSON-171571836-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:30:53.721103 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d8594c6c-cf8f-46d0-a3e4-64950f03a749 tempest-FlavorsExtraSpecsNegativeTestJSON-171571836 tempest-FlavorsExtraSpecsNegativeTestJSON-171571836-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/1924032965" status: 202 len: 0 microversion: 2.1 time: 0.095767 Sep 23 04:30:53.725663 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 20/28] 10.222.0.33 () {58 vars in 1161 bytes} [Fri Sep 23 04:30:53 2022] DELETE /compute/v2.1/flavors/1924032965 => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:30:53.731936 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0da23fd5-1186-496a-83e1-a02015eacde8 tempest-FlavorsExtraSpecsNegativeTestJSON-171571836 tempest-FlavorsExtraSpecsNegativeTestJSON-171571836-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:30:53.759240 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0da23fd5-1186-496a-83e1-a02015eacde8 tempest-FlavorsExtraSpecsNegativeTestJSON-171571836 tempest-FlavorsExtraSpecsNegativeTestJSON-171571836-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.031841 Sep 23 04:30:53.760048 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 21/29] 10.222.0.33 () {58 vars in 1146 bytes} [Fri Sep 23 04:30:53 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:30:53.767378 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-95a697cf-43db-493f-b148-5a611bd523b2 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:30:53.768602 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-95a697cf-43db-493f-b148-5a611bd523b2 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] [instance: e18459f8-cd71-4feb-8764-c3b4cc3d89be] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:30:53.906316 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-130f0edd-3104-4c20-a6fb-8d93b18e9d34 tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 227 microversion: 2.1 time: 0.425294 Sep 23 04:30:53.908080 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 9/30] 10.222.0.33 () {60 vars in 1191 bytes} [Fri Sep 23 04:30:53 2022] POST /compute/v2.1/os-aggregates/1/action => generated 227 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:30:53.921085 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9a2aecfe-b385-4274-b417-12798f82fb4f tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:30:53.948673 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-95a697cf-43db-493f-b148-5a611bd523b2 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac39d27bcf5d4def9ff9bd5b81bd7b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79442cd4a69040f594e19b3492df7e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:30:53.968353 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-95a697cf-43db-493f-b148-5a611bd523b2 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] 10.222.0.33 "GET /compute/v2.1/servers/e18459f8-cd71-4feb-8764-c3b4cc3d89be" status: 200 len: 1220 microversion: 2.1 time: 0.204905 Sep 23 04:30:53.969406 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 22/31] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:30:53 2022] GET /compute/v2.1/servers/e18459f8-cd71-4feb-8764-c3b4cc3d89be => generated 1220 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:30:54.075791 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-9a2aecfe-b385-4274-b417-12798f82fb4f tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.158282 Sep 23 04:30:54.076703 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 10/32] 10.222.0.33 () {58 vars in 1152 bytes} [Fri Sep 23 04:30:53 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 23 04:30:54.091177 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-bf088091-ff58-4deb-88f7-e206e77981a4 tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1534795933"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:30:54.097754 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.aggregate [None req-bf088091-ff58-4deb-88f7-e206e77981a4 tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] Generated uuid 2e34ab3b-b289-4dc1-83b8-aae0cef76bfd for aggregate {{(pid=122698) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 23 04:30:54.170619 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6636f2c0-9bc0-42b6-ab66-75cedf81b599 tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-46173666", "name": "tempest-test_aggregate-1030227813"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:30:54.212334 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.aggregate [None req-6636f2c0-9bc0-42b6-ab66-75cedf81b599 tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] Generated uuid 69ef616d-fd51-46f1-a99a-4acc68cee48e for aggregate {{(pid=122699) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 23 04:30:54.303867 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-bf088091-ff58-4deb-88f7-e206e77981a4 tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.220863 Sep 23 04:30:54.305397 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 23/33] 10.222.0.33 () {60 vars in 1164 bytes} [Fri Sep 23 04:30:54 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:30:54.342818 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6636f2c0-9bc0-42b6-ab66-75cedf81b599 tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 220 microversion: 2.1 time: 0.176127 Sep 23 04:30:54.343597 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 11/34] 10.222.0.33 () {60 vars in 1165 bytes} [Fri Sep 23 04:30:54 2022] POST /compute/v2.1/os-aggregates => generated 220 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:30:54.360473 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-52840c36-15be-45df-a08c-a32ccc41ba84 tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:30:54.379293 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-52840c36-15be-45df-a08c-a32ccc41ba84 tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates" status: 200 len: 513 microversion: 2.1 time: 0.022409 Sep 23 04:30:54.388892 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 12/35] 10.222.0.33 () {58 vars in 1143 bytes} [Fri Sep 23 04:30:54 2022] GET /compute/v2.1/os-aggregates => generated 513 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:30:54.395387 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9f1ed8e1-f3d9-49fe-bc7e-1277d1be48ef tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-846463-3"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:30:54.409124 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9f1ed8e1-f3d9-49fe-bc7e-1277d1be48ef tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:30:54.409996 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9f1ed8e1-f3d9-49fe-bc7e-1277d1be48ef tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:30:54.410586 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9f1ed8e1-f3d9-49fe-bc7e-1277d1be48ef tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:30:54.793027 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-9f1ed8e1-f3d9-49fe-bc7e-1277d1be48ef tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 311 microversion: 2.1 time: 0.402447 Sep 23 04:30:54.794587 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 13/36] 10.222.0.33 () {60 vars in 1191 bytes} [Fri Sep 23 04:30:54 2022] POST /compute/v2.1/os-aggregates/3/action => generated 311 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:30:54.963242 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-03cf140f-6082-4df3-b3e9-c0c01fec8f9e tempest-AggregatesAdminNegativeTestJSON-1067524409 tempest-AggregatesAdminNegativeTestJSON-1067524409-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-846463-3"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:30:54.975008 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-03cf140f-6082-4df3-b3e9-c0c01fec8f9e tempest-AggregatesAdminNegativeTestJSON-1067524409 tempest-AggregatesAdminNegativeTestJSON-1067524409-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '24bb0c35a0084dac80d254287f655725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1afd0e729aae49b981a3636e6f624484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:30:54.976745 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-03cf140f-6082-4df3-b3e9-c0c01fec8f9e tempest-AggregatesAdminNegativeTestJSON-1067524409 tempest-AggregatesAdminNegativeTestJSON-1067524409-project] Request method failure captured: Sep 23 04:30:54.976745 n-d-846463-3 devstack@n-api.service[122698]: request: POST /compute/v2.1/os-aggregates/2/action HTTP/1.1 Sep 23 04:30:54.976745 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:30:54.976745 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:30:54.976745 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:30:54.976745 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 39 Sep 23 04:30:54.976745 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:30:54.976745 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:30:54.976745 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:30:54.976745 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:30:54.976745 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTZ2Bmf2_m05_gVOD5T53ER-1nncrPHmXve7d0hTs46C9PzKHYRjJbGa1nOFPP3OOKdjd0mb5lLNofLIron7_t_GWAnczvLJFriTpPDE959L2qsQy0co9m-MlEpNHrFH-rS2rfsrOiKNuZFr1Mz8QltnRj0IzzpoRmfFH7LcCQCTs_8 Sep 23 04:30:54.976745 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:30:54.976745 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:30:54.976745 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:30:54.976745 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:30:54.976745 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:30:54.976745 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:30:54.976745 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 1afd0e729aae49b981a3636e6f624484 Sep 23 04:30:54.976745 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1067524409 Sep 23 04:30:54.976745 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:30:54.976745 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:30:54.977859 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1afd0e729aae49b981a3636e6f624484", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1afd0e729aae49b981a3636e6f624484"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1afd0e729aae49b981a3636e6f624484"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1afd0e729aae49b981a3636e6f624484"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:30:54.977859 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1067524409 Sep 23 04:30:54.977859 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 1afd0e729aae49b981a3636e6f624484 Sep 23 04:30:54.977859 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1067524409 Sep 23 04:30:54.977859 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-AggregatesAdminNegativeTestJSON-1067524409-project Sep 23 04:30:54.977859 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:30:54.977859 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:30:54.977859 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 24bb0c35a0084dac80d254287f655725 Sep 23 04:30:54.977859 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1067524409-project Sep 23 04:30:54.977859 n-d-846463-3 devstack@n-api.service[122698]: Sep 23 04:30:54.977859 n-d-846463-3 devstack@n-api.service[122698]: {"add_host": {"host": "n-h2-846463-3"}} Sep 23 04:30:54.977859 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:30:54.977859 n-d-846463-3 devstack@n-api.service[122698]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Sep 23 04:30:54.978555 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '2', 'body': {'add_host': {'host': 'n-h2-846463-3'}}} Sep 23 04:30:54.978555 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:30:54.978555 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:30:54.978555 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:30:54.978555 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:30:54.978555 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:30:54.978555 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:30:54.978555 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:30:54.978555 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:30:54.978555 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:30:54.978555 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:30:54.978555 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Sep 23 04:30:54.978555 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Sep 23 04:30:54.978555 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 23 04:30:54.978555 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 23 04:30:54.978555 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 23 04:30:54.978555 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 23 04:30:54.978555 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 23 04:30:54.978555 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 23 04:30:54.979528 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 23 04:30:54.979528 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise self.value Sep 23 04:30:54.979528 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 23 04:30:54.979528 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 23 04:30:54.979528 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 23 04:30:54.979528 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 23 04:30:54.979528 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 23 04:30:54.979528 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 23 04:30:54.979528 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Sep 23 04:30:54.979528 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:30:54.979528 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:30:54.979528 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:30:54.979528 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:30:54.979528 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:30:54.979528 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:30:54.979528 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 23 04:30:54.979528 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 23 04:30:54.979528 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Sep 23 04:30:54.979528 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:30:54.980498 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-03cf140f-6082-4df3-b3e9-c0c01fec8f9e tempest-AggregatesAdminNegativeTestJSON-1067524409 tempest-AggregatesAdminNegativeTestJSON-1067524409-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:30:54.980498 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-03cf140f-6082-4df3-b3e9-c0c01fec8f9e tempest-AggregatesAdminNegativeTestJSON-1067524409 tempest-AggregatesAdminNegativeTestJSON-1067524409-project] 10.222.0.33 "POST /compute/v2.1/os-aggregates/2/action" status: 403 len: 118 microversion: 2.1 time: 0.665414 Sep 23 04:30:54.980498 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 24/37] 10.222.0.33 () {60 vars in 1191 bytes} [Fri Sep 23 04:30:54 2022] POST /compute/v2.1/os-aggregates/2/action => generated 118 bytes in 666 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:30:54.990086 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5626461d-1abc-4625-bd9f-454439adcdc7 tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:30:55.002851 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5ac7ec6e-7cea-42b2-ac04-e8a5f7e65c77 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:30:55.003580 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5ac7ec6e-7cea-42b2-ac04-e8a5f7e65c77 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] [instance: e18459f8-cd71-4feb-8764-c3b4cc3d89be] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:30:55.023719 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5ac7ec6e-7cea-42b2-ac04-e8a5f7e65c77 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:30:55.027890 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5ac7ec6e-7cea-42b2-ac04-e8a5f7e65c77 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:30:55.028361 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5ac7ec6e-7cea-42b2-ac04-e8a5f7e65c77 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:30:55.036781 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5ac7ec6e-7cea-42b2-ac04-e8a5f7e65c77 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:30:55.036781 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5ac7ec6e-7cea-42b2-ac04-e8a5f7e65c77 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:30:55.036781 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5ac7ec6e-7cea-42b2-ac04-e8a5f7e65c77 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:30:55.145410 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5626461d-1abc-4625-bd9f-454439adcdc7 tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.162244 Sep 23 04:30:55.150857 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 14/38] 10.222.0.33 () {58 vars in 1152 bytes} [Fri Sep 23 04:30:54 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 23 04:30:55.156061 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ba3884e1-e6a3-440d-93eb-a0ed3cbdc496 tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-63440766"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:30:55.159579 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.aggregate [None req-ba3884e1-e6a3-440d-93eb-a0ed3cbdc496 tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] Generated uuid 8c34e841-23bd-49f6-afa1-967f14d74bc9 for aggregate {{(pid=122699) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 23 04:30:55.253727 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ba3884e1-e6a3-440d-93eb-a0ed3cbdc496 tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 196 microversion: 2.1 time: 0.099024 Sep 23 04:30:55.263802 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 15/39] 10.222.0.33 () {60 vars in 1164 bytes} [Fri Sep 23 04:30:55 2022] POST /compute/v2.1/os-aggregates => generated 196 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:30:55.273661 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6591afa6-4301-40aa-822a-212373deb482 tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-1324032505"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:30:55.302088 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-6591afa6-4301-40aa-822a-212373deb482 tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),feac528b-4983-4e61-aae7-f1973fe5bc2c(cell1) {{(pid=122699) load_cells /opt/stack/nova/nova/compute/api.py:319}} Sep 23 04:30:55.304418 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6591afa6-4301-40aa-822a-212373deb482 tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:30:55.305117 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6591afa6-4301-40aa-822a-212373deb482 tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:30:55.305809 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6591afa6-4301-40aa-822a-212373deb482 tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:30:55.316215 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6591afa6-4301-40aa-822a-212373deb482 tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:30:55.316985 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6591afa6-4301-40aa-822a-212373deb482 tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:30:55.317671 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6591afa6-4301-40aa-822a-212373deb482 tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:30:55.341443 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-6591afa6-4301-40aa-822a-212373deb482 tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-1324032505 could not be found. Sep 23 04:30:55.351572 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6591afa6-4301-40aa-822a-212373deb482 tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] Request method failure captured: Sep 23 04:30:55.351572 n-d-846463-3 devstack@n-api.service[122699]: request: POST /compute/v2.1/os-aggregates/4/action HTTP/1.1 Sep 23 04:30:55.351572 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:30:55.351572 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:30:55.351572 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:30:55.351572 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 58 Sep 23 04:30:55.351572 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:30:55.351572 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:30:55.351572 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:30:55.351572 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:30:55.351572 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTZ5oEAchpKsFTLJD2ORtLdgqj3VHiTBLEM6UEPkUUCvcyhf0_w1Xxxls4zrNN9m-rmbehAHDIYaSPnFC9qCAriwu0PussLgdOCF2zTCPBrKzCi-GYGjkUruxttnETP-K2i9CdZdQcLkzw59XHXqeXxFwe_YqUAo93JD5ZxCOdShtNA Sep 23 04:30:55.351572 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:30:55.351572 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:30:55.351572 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:30:55.351572 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:30:55.351572 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:30:55.351572 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:30:55.351572 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: db8ef5d6dc834d57b5b3fad0dda5512c Sep 23 04:30:55.351572 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2040548293 Sep 23 04:30:55.351572 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,admin,member Sep 23 04:30:55.351572 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,admin,member Sep 23 04:30:55.352918 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_db8ef5d6dc834d57b5b3fad0dda5512c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/db8ef5d6dc834d57b5b3fad0dda5512c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/db8ef5d6dc834d57b5b3fad0dda5512c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/db8ef5d6dc834d57b5b3fad0dda5512c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:30:55.352918 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2040548293 Sep 23 04:30:55.352918 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: db8ef5d6dc834d57b5b3fad0dda5512c Sep 23 04:30:55.352918 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2040548293 Sep 23 04:30:55.352918 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin Sep 23 04:30:55.352918 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:30:55.352918 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:30:55.352918 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 289ab0514fa048a9b6662b3e56304199 Sep 23 04:30:55.352918 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin Sep 23 04:30:55.352918 n-d-846463-3 devstack@n-api.service[122699]: Sep 23 04:30:55.352918 n-d-846463-3 devstack@n-api.service[122699]: {"add_host": {"host": "tempest-nonexist_host-1324032505"}} Sep 23 04:30:55.352918 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:30:55.353664 n-d-846463-3 devstack@n-api.service[122699]: exception: Compute host tempest-nonexist_host-1324032505 could not be found. Sep 23 04:30:55.353664 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '4', 'body': {'add_host': {'host': 'tempest-nonexist_host-1324032505'}}} Sep 23 04:30:55.353664 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:30:55.353664 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:30:55.353664 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Sep 23 04:30:55.353664 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Sep 23 04:30:55.353664 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 04:30:55.353664 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 04:30:55.353664 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 23 04:30:55.353664 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 23 04:30:55.353664 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 23 04:30:55.353664 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 23 04:30:55.353664 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 23 04:30:55.353664 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 23 04:30:55.353664 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-1324032505' is not mapped to any cell Sep 23 04:30:55.353664 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:30:55.353664 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:30:55.353664 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:30:55.353664 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:30:55.353664 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Sep 23 04:30:55.354876 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Sep 23 04:30:55.354876 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 23 04:30:55.354876 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 23 04:30:55.354876 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 23 04:30:55.354876 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:30:55.354876 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:30:55.354876 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:30:55.354876 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:30:55.354876 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Sep 23 04:30:55.354876 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Sep 23 04:30:55.354876 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 23 04:30:55.354876 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 23 04:30:55.354876 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 23 04:30:55.354876 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 23 04:30:55.354876 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 23 04:30:55.354876 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise self.value Sep 23 04:30:55.354876 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 23 04:30:55.354876 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 23 04:30:55.354876 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6621, in add_host_to_aggregate Sep 23 04:30:55.354876 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Sep 23 04:30:55.355840 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Sep 23 04:30:55.355840 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Sep 23 04:30:55.355840 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-1324032505 could not be found. Sep 23 04:30:55.355840 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:30:55.355840 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:30:55.355840 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:30:55.355840 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:30:55.355840 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:30:55.355840 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:30:55.355840 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:30:55.355840 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:30:55.355840 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:30:55.355840 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:30:55.355840 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:30:55.355840 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:30:55.355840 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Sep 23 04:30:55.355840 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:30:55.355840 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-1324032505 could not be found. Sep 23 04:30:55.355840 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:30:55.355840 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:30:55.355840 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:30:55.356864 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:30:55.356864 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:30:55.356864 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:30:55.356864 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:30:55.356864 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:30:55.356864 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-1324032505 could not be found. Sep 23 04:30:55.356864 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:30:55.358268 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6591afa6-4301-40aa-822a-212373deb482 tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-1324032505 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:30:55.359272 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6591afa6-4301-40aa-822a-212373deb482 tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/4/action" status: 404 len: 111 microversion: 2.1 time: 0.093988 Sep 23 04:30:55.360005 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 16/40] 10.222.0.33 () {60 vars in 1191 bytes} [Fri Sep 23 04:30:55 2022] POST /compute/v2.1/os-aggregates/4/action => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:30:55.393578 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-5ac7ec6e-7cea-42b2-ac04-e8a5f7e65c77 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac39d27bcf5d4def9ff9bd5b81bd7b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79442cd4a69040f594e19b3492df7e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:30:55.412721 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5ac7ec6e-7cea-42b2-ac04-e8a5f7e65c77 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] 10.222.0.33 "GET /compute/v2.1/servers/e18459f8-cd71-4feb-8764-c3b4cc3d89be" status: 200 len: 1292 microversion: 2.1 time: 0.421460 Sep 23 04:30:55.413624 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 25/41] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:30:54 2022] GET /compute/v2.1/servers/e18459f8-cd71-4feb-8764-c3b4cc3d89be => generated 1292 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:30:55.418576 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ed9a9c8e-75fe-4c05-ba37-d4a892754f52 tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:30:55.535328 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ed9a9c8e-75fe-4c05-ba37-d4a892754f52 tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.118909 Sep 23 04:30:55.536189 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 26/42] 10.222.0.33 () {58 vars in 1152 bytes} [Fri Sep 23 04:30:55 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 23 04:30:55.558292 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5b16dfb5-10b9-4d12-805c-d445aa422a12 tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:30:55.564892 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5b16dfb5-10b9-4d12-805c-d445aa422a12 tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] Request method failure captured: Sep 23 04:30:55.564892 n-d-846463-3 devstack@n-api.service[122698]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Sep 23 04:30:55.564892 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:30:55.564892 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:30:55.564892 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:30:55.564892 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 283 Sep 23 04:30:55.564892 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:30:55.564892 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:30:55.564892 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:30:55.564892 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:30:55.564892 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTZ5oEAchpKsFTLJD2ORtLdgqj3VHiTBLEM6UEPkUUCvcyhf0_w1Xxxls4zrNN9m-rmbehAHDIYaSPnFC9qCAriwu0PussLgdOCF2zTCPBrKzCi-GYGjkUruxttnETP-K2i9CdZdQcLkzw59XHXqeXxFwe_YqUAo93JD5ZxCOdShtNA Sep 23 04:30:55.564892 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:30:55.564892 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:30:55.564892 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:30:55.564892 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:30:55.564892 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:30:55.564892 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:30:55.564892 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: db8ef5d6dc834d57b5b3fad0dda5512c Sep 23 04:30:55.564892 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2040548293 Sep 23 04:30:55.564892 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,admin,member Sep 23 04:30:55.564892 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,admin,member Sep 23 04:30:55.566178 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_db8ef5d6dc834d57b5b3fad0dda5512c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/db8ef5d6dc834d57b5b3fad0dda5512c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/db8ef5d6dc834d57b5b3fad0dda5512c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/db8ef5d6dc834d57b5b3fad0dda5512c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:30:55.566178 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2040548293 Sep 23 04:30:55.566178 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: db8ef5d6dc834d57b5b3fad0dda5512c Sep 23 04:30:55.566178 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2040548293 Sep 23 04:30:55.566178 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin Sep 23 04:30:55.566178 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:30:55.566178 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:30:55.566178 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 289ab0514fa048a9b6662b3e56304199 Sep 23 04:30:55.566178 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin Sep 23 04:30:55.566178 n-d-846463-3 devstack@n-api.service[122698]: Sep 23 04:30:55.566677 n-d-846463-3 devstack@n-api.service[122698]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Sep 23 04:30:55.566677 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:30:55.566677 n-d-846463-3 devstack@n-api.service[122698]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 23 04:30:55.566677 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Sep 23 04:30:55.566677 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:30:55.566677 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:30:55.566677 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 23 04:30:55.566677 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 23 04:30:55.566677 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 23 04:30:55.566677 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise error Sep 23 04:30:55.567194 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 23 04:30:55.567194 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:30:55.567194 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Sep 23 04:30:55.567194 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 23 04:30:55.567194 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:30:55.567194 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Sep 23 04:30:55.567194 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 23 04:30:55.567194 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:30:55.567194 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:30:55.567194 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:30:55.567194 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:30:55.567194 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:30:55.567194 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:30:55.567194 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:30:55.567194 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:30:55.567194 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:30:55.567194 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:30:55.573346 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:30:55.573346 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:30:55.573346 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 23 04:30:55.573346 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 23 04:30:55.573346 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 23 04:30:55.573346 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 23 04:30:55.573346 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 23 04:30:55.573346 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 23 04:30:55.573346 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 23 04:30:55.573346 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:30:55.573346 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:30:55.573346 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:30:55.573346 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:30:55.573346 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:30:55.573346 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:30:55.574523 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 23 04:30:55.574523 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 23 04:30:55.574523 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 23 04:30:55.574523 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:30:55.574523 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5b16dfb5-10b9-4d12-805c-d445aa422a12 tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:30:55.574993 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5b16dfb5-10b9-4d12-805c-d445aa422a12 tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.024553 Sep 23 04:30:55.574993 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 27/43] 10.222.0.33 () {60 vars in 1165 bytes} [Fri Sep 23 04:30:55 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 04:30:55.579514 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0555fd85-797e-4c3a-8886-cb21389c9072 tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:30:55.584452 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0555fd85-797e-4c3a-8886-cb21389c9072 tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] Request method failure captured: Sep 23 04:30:55.584452 n-d-846463-3 devstack@n-api.service[122698]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Sep 23 04:30:55.584452 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:30:55.584452 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:30:55.584452 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:30:55.584452 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 27 Sep 23 04:30:55.584452 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:30:55.584452 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:30:55.584452 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:30:55.584452 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:30:55.584452 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTZ5oEAchpKsFTLJD2ORtLdgqj3VHiTBLEM6UEPkUUCvcyhf0_w1Xxxls4zrNN9m-rmbehAHDIYaSPnFC9qCAriwu0PussLgdOCF2zTCPBrKzCi-GYGjkUruxttnETP-K2i9CdZdQcLkzw59XHXqeXxFwe_YqUAo93JD5ZxCOdShtNA Sep 23 04:30:55.584452 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:30:55.584452 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:30:55.584452 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:30:55.584452 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:30:55.584452 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:30:55.584452 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:30:55.584452 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: db8ef5d6dc834d57b5b3fad0dda5512c Sep 23 04:30:55.584452 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2040548293 Sep 23 04:30:55.584452 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,admin,member Sep 23 04:30:55.584452 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,admin,member Sep 23 04:30:55.585939 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_db8ef5d6dc834d57b5b3fad0dda5512c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/db8ef5d6dc834d57b5b3fad0dda5512c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/db8ef5d6dc834d57b5b3fad0dda5512c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/db8ef5d6dc834d57b5b3fad0dda5512c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:30:55.585939 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2040548293 Sep 23 04:30:55.585939 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: db8ef5d6dc834d57b5b3fad0dda5512c Sep 23 04:30:55.585939 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2040548293 Sep 23 04:30:55.585939 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin Sep 23 04:30:55.585939 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:30:55.585939 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:30:55.585939 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 289ab0514fa048a9b6662b3e56304199 Sep 23 04:30:55.585939 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin Sep 23 04:30:55.585939 n-d-846463-3 devstack@n-api.service[122698]: Sep 23 04:30:55.585939 n-d-846463-3 devstack@n-api.service[122698]: {"aggregate": {"name": ""}} Sep 23 04:30:55.585939 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:30:55.585939 n-d-846463-3 devstack@n-api.service[122698]: exception: Invalid input for field/attribute name. Value: . '' is too short Sep 23 04:30:55.586850 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'body': {'aggregate': {'name': ''}}} Sep 23 04:30:55.586850 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:30:55.586850 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:30:55.586850 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 23 04:30:55.586850 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 23 04:30:55.586850 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 23 04:30:55.586850 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise error Sep 23 04:30:55.586850 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 23 04:30:55.586850 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:30:55.586850 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Sep 23 04:30:55.586850 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 23 04:30:55.586850 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:30:55.586850 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Sep 23 04:30:55.586850 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi '' Sep 23 04:30:55.586850 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:30:55.586850 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:30:55.586850 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:30:55.586850 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:30:55.586850 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:30:55.586850 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:30:55.586850 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:30:55.586850 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:30:55.586850 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:30:55.588287 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:30:55.588287 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:30:55.588287 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:30:55.588287 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 23 04:30:55.588287 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 23 04:30:55.588287 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 23 04:30:55.588287 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 23 04:30:55.588287 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 23 04:30:55.588287 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 23 04:30:55.588287 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Sep 23 04:30:55.588287 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:30:55.588287 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:30:55.588287 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:30:55.588287 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:30:55.588287 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:30:55.588287 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:30:55.588287 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 23 04:30:55.588287 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 23 04:30:55.588287 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Sep 23 04:30:55.588287 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:30:55.589477 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0555fd85-797e-4c3a-8886-cb21389c9072 tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:30:55.589477 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0555fd85-797e-4c3a-8886-cb21389c9072 tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.012596 Sep 23 04:30:55.589957 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 28/44] 10.222.0.33 () {60 vars in 1164 bytes} [Fri Sep 23 04:30:55 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 04:30:55.606378 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b2363297-10ce-48e1-9f89-f3107d593c3a tempest-AggregatesAdminNegativeTestJSON-1067524409 tempest-AggregatesAdminNegativeTestJSON-1067524409-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-924749409"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:30:55.609715 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b2363297-10ce-48e1-9f89-f3107d593c3a tempest-AggregatesAdminNegativeTestJSON-1067524409 tempest-AggregatesAdminNegativeTestJSON-1067524409-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '24bb0c35a0084dac80d254287f655725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1afd0e729aae49b981a3636e6f624484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:30:55.611386 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b2363297-10ce-48e1-9f89-f3107d593c3a tempest-AggregatesAdminNegativeTestJSON-1067524409 tempest-AggregatesAdminNegativeTestJSON-1067524409-project] Request method failure captured: Sep 23 04:30:55.611386 n-d-846463-3 devstack@n-api.service[122698]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Sep 23 04:30:55.611386 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:30:55.611386 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:30:55.611386 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:30:55.611386 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 59 Sep 23 04:30:55.611386 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:30:55.611386 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:30:55.611386 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:30:55.611386 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:30:55.611386 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTZ2Bmf2_m05_gVOD5T53ER-1nncrPHmXve7d0hTs46C9PzKHYRjJbGa1nOFPP3OOKdjd0mb5lLNofLIron7_t_GWAnczvLJFriTpPDE959L2qsQy0co9m-MlEpNHrFH-rS2rfsrOiKNuZFr1Mz8QltnRj0IzzpoRmfFH7LcCQCTs_8 Sep 23 04:30:55.611386 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:30:55.611386 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:30:55.611386 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:30:55.611386 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:30:55.611386 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:30:55.611386 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:30:55.611386 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 1afd0e729aae49b981a3636e6f624484 Sep 23 04:30:55.611386 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1067524409 Sep 23 04:30:55.611386 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:30:55.611386 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:30:55.615901 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1afd0e729aae49b981a3636e6f624484", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1afd0e729aae49b981a3636e6f624484"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1afd0e729aae49b981a3636e6f624484"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1afd0e729aae49b981a3636e6f624484"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:30:55.615901 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1067524409 Sep 23 04:30:55.615901 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 1afd0e729aae49b981a3636e6f624484 Sep 23 04:30:55.615901 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1067524409 Sep 23 04:30:55.615901 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-AggregatesAdminNegativeTestJSON-1067524409-project Sep 23 04:30:55.615901 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:30:55.615901 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:30:55.615901 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 24bb0c35a0084dac80d254287f655725 Sep 23 04:30:55.615901 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1067524409-project Sep 23 04:30:55.615901 n-d-846463-3 devstack@n-api.service[122698]: Sep 23 04:30:55.615901 n-d-846463-3 devstack@n-api.service[122698]: {"aggregate": {"name": "tempest-test_aggregate-924749409"}} Sep 23 04:30:55.615901 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:30:55.615901 n-d-846463-3 devstack@n-api.service[122698]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Sep 23 04:30:55.616732 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-924749409'}}} Sep 23 04:30:55.616732 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:30:55.616732 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:30:55.616732 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:30:55.616732 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:30:55.616732 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:30:55.616732 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:30:55.616732 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:30:55.616732 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:30:55.616732 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:30:55.616732 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:30:55.616732 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:30:55.616732 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:30:55.616732 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Sep 23 04:30:55.616732 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Sep 23 04:30:55.616732 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 23 04:30:55.616732 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 23 04:30:55.616732 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 23 04:30:55.616732 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 23 04:30:55.617658 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 23 04:30:55.617658 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 23 04:30:55.617658 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 23 04:30:55.617658 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise self.value Sep 23 04:30:55.617658 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 23 04:30:55.617658 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 23 04:30:55.617658 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 23 04:30:55.617658 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 23 04:30:55.617658 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 23 04:30:55.617658 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 23 04:30:55.617658 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Sep 23 04:30:55.617658 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:30:55.617658 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:30:55.617658 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:30:55.617658 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:30:55.617658 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:30:55.617658 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:30:55.617658 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 23 04:30:55.617658 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 23 04:30:55.617658 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Sep 23 04:30:55.618670 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:30:55.618670 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b2363297-10ce-48e1-9f89-f3107d593c3a tempest-AggregatesAdminNegativeTestJSON-1067524409 tempest-AggregatesAdminNegativeTestJSON-1067524409-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:30:55.618670 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b2363297-10ce-48e1-9f89-f3107d593c3a tempest-AggregatesAdminNegativeTestJSON-1067524409 tempest-AggregatesAdminNegativeTestJSON-1067524409-project] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.013489 Sep 23 04:30:55.618670 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 29/45] 10.222.0.33 () {60 vars in 1164 bytes} [Fri Sep 23 04:30:55 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:30:55.625205 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-845cf0ee-4234-4b97-9bdc-66330559a79d tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-586956649"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:30:55.628531 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.aggregate [None req-845cf0ee-4234-4b97-9bdc-66330559a79d tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] Generated uuid 88dbc1a9-11fc-4d56-8221-da776c85c5e6 for aggregate {{(pid=122698) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 23 04:30:55.722698 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-845cf0ee-4234-4b97-9bdc-66330559a79d tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.101793 Sep 23 04:30:55.724648 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 30/46] 10.222.0.33 () {60 vars in 1164 bytes} [Fri Sep 23 04:30:55 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:30:55.736614 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3eecb1b2-ad51-4b42-aebb-dd60f02235fd tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-586956649"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:30:55.740767 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.aggregate [None req-3eecb1b2-ad51-4b42-aebb-dd60f02235fd tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] Generated uuid f8f9098b-b171-422d-b3fd-f3095d7b8d6f for aggregate {{(pid=122698) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 23 04:30:55.746391 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=7,nova_api:UPDATE=1,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:DELETE=5 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:30:55.755637 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-3eecb1b2-ad51-4b42-aebb-dd60f02235fd tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-586956649 already exists. Sep 23 04:30:55.758919 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3eecb1b2-ad51-4b42-aebb-dd60f02235fd tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] Request method failure captured: Sep 23 04:30:55.758919 n-d-846463-3 devstack@n-api.service[122698]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Sep 23 04:30:55.758919 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:30:55.758919 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:30:55.758919 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:30:55.758919 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 59 Sep 23 04:30:55.758919 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:30:55.758919 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:30:55.758919 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:30:55.758919 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:30:55.758919 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTZ5oEAchpKsFTLJD2ORtLdgqj3VHiTBLEM6UEPkUUCvcyhf0_w1Xxxls4zrNN9m-rmbehAHDIYaSPnFC9qCAriwu0PussLgdOCF2zTCPBrKzCi-GYGjkUruxttnETP-K2i9CdZdQcLkzw59XHXqeXxFwe_YqUAo93JD5ZxCOdShtNA Sep 23 04:30:55.758919 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:30:55.758919 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:30:55.758919 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:30:55.758919 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:30:55.758919 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:30:55.758919 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:30:55.758919 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: db8ef5d6dc834d57b5b3fad0dda5512c Sep 23 04:30:55.758919 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2040548293 Sep 23 04:30:55.758919 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,admin,member Sep 23 04:30:55.758919 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,admin,member Sep 23 04:30:55.760282 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_db8ef5d6dc834d57b5b3fad0dda5512c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/db8ef5d6dc834d57b5b3fad0dda5512c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/db8ef5d6dc834d57b5b3fad0dda5512c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/db8ef5d6dc834d57b5b3fad0dda5512c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:30:55.760282 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2040548293 Sep 23 04:30:55.760282 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: db8ef5d6dc834d57b5b3fad0dda5512c Sep 23 04:30:55.760282 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2040548293 Sep 23 04:30:55.760282 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin Sep 23 04:30:55.760282 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:30:55.760282 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:30:55.760282 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 289ab0514fa048a9b6662b3e56304199 Sep 23 04:30:55.760282 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin Sep 23 04:30:55.760282 n-d-846463-3 devstack@n-api.service[122698]: Sep 23 04:30:55.760282 n-d-846463-3 devstack@n-api.service[122698]: {"aggregate": {"name": "tempest-test_aggregate-586956649"}} Sep 23 04:30:55.760282 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:30:55.760282 n-d-846463-3 devstack@n-api.service[122698]: exception: Aggregate tempest-test_aggregate-586956649 already exists. Sep 23 04:30:55.761161 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-586956649'}}} Sep 23 04:30:55.761161 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:30:55.761161 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:30:55.761161 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Sep 23 04:30:55.761161 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Sep 23 04:30:55.761161 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 23 04:30:55.761161 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 23 04:30:55.761161 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 23 04:30:55.761161 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 23 04:30:55.761161 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 23 04:30:55.761161 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise self.value Sep 23 04:30:55.761161 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 23 04:30:55.761161 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 23 04:30:55.761161 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6458, in create_aggregate Sep 23 04:30:55.761161 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi aggregate.create() Sep 23 04:30:55.761161 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 23 04:30:55.761161 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 23 04:30:55.761161 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Sep 23 04:30:55.761161 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Sep 23 04:30:55.762313 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 23 04:30:55.762313 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 23 04:30:55.762313 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Sep 23 04:30:55.762313 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Sep 23 04:30:55.762313 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-586956649 already exists. Sep 23 04:30:55.762313 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:30:55.762313 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:30:55.762313 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:30:55.762313 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:30:55.762313 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:30:55.762313 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:30:55.762313 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:30:55.762313 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:30:55.762313 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:30:55.762313 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:30:55.762313 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:30:55.762313 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:30:55.762313 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:30:55.762313 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:30:55.762313 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Sep 23 04:30:55.763695 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Sep 23 04:30:55.763695 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-586956649 already exists. Sep 23 04:30:55.763695 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:30:55.763695 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:30:55.763695 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:30:55.763695 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:30:55.763695 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:30:55.763695 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:30:55.763695 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:30:55.763695 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:30:55.763695 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-586956649 already exists. Sep 23 04:30:55.763695 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:30:55.766966 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3eecb1b2-ad51-4b42-aebb-dd60f02235fd tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-586956649 already exists. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:30:55.768292 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3eecb1b2-ad51-4b42-aebb-dd60f02235fd tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 409 len: 110 microversion: 2.1 time: 0.036097 Sep 23 04:30:55.772769 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 31/47] 10.222.0.33 () {60 vars in 1164 bytes} [Fri Sep 23 04:30:55 2022] POST /compute/v2.1/os-aggregates => generated 110 bytes in 38 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 23 04:30:55.778369 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f842b5f4-37ce-4256-acb7-fad9f283fbd4 tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:30:55.903311 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f842b5f4-37ce-4256-acb7-fad9f283fbd4 tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.129155 Sep 23 04:30:55.904443 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 32/48] 10.222.0.33 () {58 vars in 1152 bytes} [Fri Sep 23 04:30:55 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Sep 23 04:30:55.919247 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-68f6c2c4-7edc-46c0-a9b8-34a01741b237 tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-657946229"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:30:55.926994 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.aggregate [None req-68f6c2c4-7edc-46c0-a9b8-34a01741b237 tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] Generated uuid 28ea0e5a-1ec8-463c-97e5-f9d707ef3a1d for aggregate {{(pid=122698) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 23 04:30:55.946551 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8a66f110-0137-451f-a905-f9ce5abc3bc9 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-493881138", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "availability_zone": "tempest-test_az-46173666"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:30:55.977470 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8a66f110-0137-451f-a905-f9ce5abc3bc9 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:30:55.978069 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8a66f110-0137-451f-a905-f9ce5abc3bc9 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:30:55.980445 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8a66f110-0137-451f-a905-f9ce5abc3bc9 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:30:55.981375 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8a66f110-0137-451f-a905-f9ce5abc3bc9 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:30:55.983964 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8a66f110-0137-451f-a905-f9ce5abc3bc9 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:30:55.984456 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8a66f110-0137-451f-a905-f9ce5abc3bc9 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:30:56.050236 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-68f6c2c4-7edc-46c0-a9b8-34a01741b237 tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.138555 Sep 23 04:30:56.051920 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 33/49] 10.222.0.33 () {60 vars in 1164 bytes} [Fri Sep 23 04:30:55 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:30:56.063560 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b2ba282c-8840-4de7-8b77-163af5994f75 tempest-AggregatesAdminNegativeTestJSON-1067524409 tempest-AggregatesAdminNegativeTestJSON-1067524409-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:30:56.064229 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=9,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:DELETE=8 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:30:56.066447 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b2ba282c-8840-4de7-8b77-163af5994f75 tempest-AggregatesAdminNegativeTestJSON-1067524409 tempest-AggregatesAdminNegativeTestJSON-1067524409-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '24bb0c35a0084dac80d254287f655725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1afd0e729aae49b981a3636e6f624484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:30:56.068626 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b2ba282c-8840-4de7-8b77-163af5994f75 tempest-AggregatesAdminNegativeTestJSON-1067524409 tempest-AggregatesAdminNegativeTestJSON-1067524409-project] Request method failure captured: Sep 23 04:30:56.068626 n-d-846463-3 devstack@n-api.service[122698]: request: DELETE /compute/v2.1/os-aggregates/6 HTTP/1.1 Sep 23 04:30:56.068626 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:30:56.068626 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:30:56.068626 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:30:56.068626 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:30:56.068626 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:30:56.068626 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:30:56.068626 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:30:56.068626 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:30:56.068626 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTZ2Bmf2_m05_gVOD5T53ER-1nncrPHmXve7d0hTs46C9PzKHYRjJbGa1nOFPP3OOKdjd0mb5lLNofLIron7_t_GWAnczvLJFriTpPDE959L2qsQy0co9m-MlEpNHrFH-rS2rfsrOiKNuZFr1Mz8QltnRj0IzzpoRmfFH7LcCQCTs_8 Sep 23 04:30:56.068626 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:30:56.068626 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:30:56.068626 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:30:56.068626 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:30:56.068626 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:30:56.068626 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:30:56.068626 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 1afd0e729aae49b981a3636e6f624484 Sep 23 04:30:56.068626 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1067524409 Sep 23 04:30:56.068626 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:30:56.068626 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:30:56.069769 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1afd0e729aae49b981a3636e6f624484", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1afd0e729aae49b981a3636e6f624484"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1afd0e729aae49b981a3636e6f624484"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1afd0e729aae49b981a3636e6f624484"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:30:56.069769 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1067524409 Sep 23 04:30:56.069769 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 1afd0e729aae49b981a3636e6f624484 Sep 23 04:30:56.069769 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1067524409 Sep 23 04:30:56.069769 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-AggregatesAdminNegativeTestJSON-1067524409-project Sep 23 04:30:56.069769 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:30:56.069769 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:30:56.069769 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 24bb0c35a0084dac80d254287f655725 Sep 23 04:30:56.069769 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1067524409-project Sep 23 04:30:56.069769 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:30:56.069769 n-d-846463-3 devstack@n-api.service[122698]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Sep 23 04:30:56.069769 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '6'} Sep 23 04:30:56.070703 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:30:56.070703 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:30:56.070703 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:30:56.070703 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:30:56.070703 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:30:56.070703 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:30:56.070703 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:30:56.070703 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:30:56.070703 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Sep 23 04:30:56.070703 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Sep 23 04:30:56.070703 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 23 04:30:56.070703 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 23 04:30:56.070703 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 23 04:30:56.070703 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 23 04:30:56.070703 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 23 04:30:56.070703 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 23 04:30:56.070703 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 23 04:30:56.070703 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise self.value Sep 23 04:30:56.070703 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 23 04:30:56.071875 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 23 04:30:56.071875 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 23 04:30:56.071875 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 23 04:30:56.071875 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 23 04:30:56.071875 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 23 04:30:56.071875 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Sep 23 04:30:56.071875 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:30:56.071875 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:30:56.071875 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:30:56.071875 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:30:56.071875 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:30:56.071875 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:30:56.071875 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 23 04:30:56.071875 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 23 04:30:56.071875 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Sep 23 04:30:56.071875 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:30:56.075359 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b2ba282c-8840-4de7-8b77-163af5994f75 tempest-AggregatesAdminNegativeTestJSON-1067524409 tempest-AggregatesAdminNegativeTestJSON-1067524409-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:30:56.078806 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b2ba282c-8840-4de7-8b77-163af5994f75 tempest-AggregatesAdminNegativeTestJSON-1067524409 tempest-AggregatesAdminNegativeTestJSON-1067524409-project] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/6" status: 403 len: 116 microversion: 2.1 time: 0.019450 Sep 23 04:30:56.081184 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 34/50] 10.222.0.33 () {58 vars in 1152 bytes} [Fri Sep 23 04:30:56 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 116 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Sep 23 04:30:56.096027 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7046f773-a7fc-4cdf-8c75-fe441e71dbe2 tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:30:56.162206 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.neutron [None req-8a66f110-0137-451f-a905-f9ce5abc3bc9 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] validate_networks() for None {{(pid=122699) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:30:56.202851 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7046f773-a7fc-4cdf-8c75-fe441e71dbe2 tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.116167 Sep 23 04:30:56.208964 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 35/51] 10.222.0.33 () {58 vars in 1152 bytes} [Fri Sep 23 04:30:56 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 23 04:30:56.219754 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-57bd0f8f-ac36-40e8-95c2-d0085531f726 tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:30:56.252116 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-57bd0f8f-ac36-40e8-95c2-d0085531f726 tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Sep 23 04:30:56.257112 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-57bd0f8f-ac36-40e8-95c2-d0085531f726 tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] Request method failure captured: Sep 23 04:30:56.257112 n-d-846463-3 devstack@n-api.service[122698]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Sep 23 04:30:56.257112 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:30:56.257112 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:30:56.257112 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:30:56.257112 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:30:56.257112 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:30:56.257112 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:30:56.257112 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:30:56.257112 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:30:56.257112 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTZ5oEAchpKsFTLJD2ORtLdgqj3VHiTBLEM6UEPkUUCvcyhf0_w1Xxxls4zrNN9m-rmbehAHDIYaSPnFC9qCAriwu0PussLgdOCF2zTCPBrKzCi-GYGjkUruxttnETP-K2i9CdZdQcLkzw59XHXqeXxFwe_YqUAo93JD5ZxCOdShtNA Sep 23 04:30:56.257112 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:30:56.257112 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:30:56.257112 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:30:56.257112 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:30:56.257112 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:30:56.257112 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:30:56.257112 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: db8ef5d6dc834d57b5b3fad0dda5512c Sep 23 04:30:56.257112 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2040548293 Sep 23 04:30:56.257112 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,admin,member Sep 23 04:30:56.257112 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,admin,member Sep 23 04:30:56.258590 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_db8ef5d6dc834d57b5b3fad0dda5512c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/db8ef5d6dc834d57b5b3fad0dda5512c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/db8ef5d6dc834d57b5b3fad0dda5512c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/db8ef5d6dc834d57b5b3fad0dda5512c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:30:56.258590 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2040548293 Sep 23 04:30:56.258590 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: db8ef5d6dc834d57b5b3fad0dda5512c Sep 23 04:30:56.258590 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2040548293 Sep 23 04:30:56.258590 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin Sep 23 04:30:56.258590 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:30:56.258590 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:30:56.258590 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 289ab0514fa048a9b6662b3e56304199 Sep 23 04:30:56.258590 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin Sep 23 04:30:56.258590 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:30:56.258590 n-d-846463-3 devstack@n-api.service[122698]: exception: Aggregate -1 could not be found. Sep 23 04:30:56.258590 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '-1'} Sep 23 04:30:56.259373 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:30:56.259373 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:30:56.259373 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Sep 23 04:30:56.259373 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Sep 23 04:30:56.259373 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 23 04:30:56.259373 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 23 04:30:56.259373 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 23 04:30:56.259373 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 23 04:30:56.259373 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 23 04:30:56.259373 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise self.value Sep 23 04:30:56.259373 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 23 04:30:56.259373 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 23 04:30:56.259373 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Sep 23 04:30:56.259373 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Sep 23 04:30:56.259373 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 04:30:56.259373 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 04:30:56.259373 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 23 04:30:56.259373 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 23 04:30:56.259373 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 23 04:30:56.260488 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 23 04:30:56.260488 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 23 04:30:56.260488 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 23 04:30:56.260488 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Sep 23 04:30:56.260488 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:30:56.260488 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:30:56.260488 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:30:56.260488 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:30:56.260488 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:30:56.260488 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:30:56.260488 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:30:56.260488 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:30:56.260488 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:30:56.260488 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:30:56.260488 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Sep 23 04:30:56.260488 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:30:56.260488 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Sep 23 04:30:56.260488 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:30:56.260488 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:30:56.260488 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:30:56.260488 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:30:56.261728 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:30:56.261728 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:30:56.261728 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:30:56.261728 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:30:56.261728 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Sep 23 04:30:56.261728 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:30:56.264114 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-57bd0f8f-ac36-40e8-95c2-d0085531f726 tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:30:56.268249 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-57bd0f8f-ac36-40e8-95c2-d0085531f726 tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.051509 Sep 23 04:30:56.276623 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 36/52] 10.222.0.33 () {58 vars in 1155 bytes} [Fri Sep 23 04:30:56 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 23 04:30:56.288579 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-53c2de4b-af11-4ddf-ba3f-333373c91996 tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-383138507"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:30:56.303513 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.aggregate [None req-53c2de4b-af11-4ddf-ba3f-333373c91996 tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] Generated uuid 803dc711-ef18-4671-893d-d72f77098c12 for aggregate {{(pid=122698) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 23 04:30:56.431578 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-53c2de4b-af11-4ddf-ba3f-333373c91996 tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.152754 Sep 23 04:30:56.432187 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 37/53] 10.222.0.33 () {60 vars in 1164 bytes} [Fri Sep 23 04:30:56 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:30:56.451353 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8c546db6-9e34-4499-b6e0-feedff523de1 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:30:56.451989 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8c546db6-9e34-4499-b6e0-feedff523de1 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] [instance: e18459f8-cd71-4feb-8764-c3b4cc3d89be] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:30:56.461920 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8c546db6-9e34-4499-b6e0-feedff523de1 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:30:56.462863 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8c546db6-9e34-4499-b6e0-feedff523de1 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:30:56.463313 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8c546db6-9e34-4499-b6e0-feedff523de1 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:30:56.464033 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8c546db6-9e34-4499-b6e0-feedff523de1 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:30:56.464784 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8c546db6-9e34-4499-b6e0-feedff523de1 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:30:56.465395 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8c546db6-9e34-4499-b6e0-feedff523de1 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:30:56.738111 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8c546db6-9e34-4499-b6e0-feedff523de1 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac39d27bcf5d4def9ff9bd5b81bd7b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79442cd4a69040f594e19b3492df7e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:30:56.750851 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8c546db6-9e34-4499-b6e0-feedff523de1 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] 10.222.0.33 "GET /compute/v2.1/servers/e18459f8-cd71-4feb-8764-c3b4cc3d89be" status: 200 len: 1298 microversion: 2.1 time: 0.314111 Sep 23 04:30:56.753986 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 38/54] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:30:56 2022] GET /compute/v2.1/servers/e18459f8-cd71-4feb-8764-c3b4cc3d89be => generated 1298 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:30:56.772380 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-8a66f110-0137-451f-a905-f9ce5abc3bc9 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Flavor limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:30:56.772890 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4c62ba4d-a460-447e-83ea-0c103b9bbe49 tempest-AggregatesAdminNegativeTestJSON-1067524409 tempest-AggregatesAdminNegativeTestJSON-1067524409-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:30:56.773671 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-8a66f110-0137-451f-a905-f9ce5abc3bc9 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Image limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:30:56.774345 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-8a66f110-0137-451f-a905-f9ce5abc3bc9 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Flavor pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:30:56.774558 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4c62ba4d-a460-447e-83ea-0c103b9bbe49 tempest-AggregatesAdminNegativeTestJSON-1067524409 tempest-AggregatesAdminNegativeTestJSON-1067524409-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '24bb0c35a0084dac80d254287f655725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1afd0e729aae49b981a3636e6f624484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:30:56.774912 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-8a66f110-0137-451f-a905-f9ce5abc3bc9 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Image pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:30:56.775394 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-8a66f110-0137-451f-a905-f9ce5abc3bc9 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:30:56.776717 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4c62ba4d-a460-447e-83ea-0c103b9bbe49 tempest-AggregatesAdminNegativeTestJSON-1067524409 tempest-AggregatesAdminNegativeTestJSON-1067524409-project] Request method failure captured: Sep 23 04:30:56.776717 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/os-aggregates/7 HTTP/1.1 Sep 23 04:30:56.776717 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:30:56.776717 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:30:56.776717 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:30:56.776717 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:30:56.776717 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:30:56.776717 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:30:56.776717 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:30:56.776717 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:30:56.776717 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTZ2Bmf2_m05_gVOD5T53ER-1nncrPHmXve7d0hTs46C9PzKHYRjJbGa1nOFPP3OOKdjd0mb5lLNofLIron7_t_GWAnczvLJFriTpPDE959L2qsQy0co9m-MlEpNHrFH-rS2rfsrOiKNuZFr1Mz8QltnRj0IzzpoRmfFH7LcCQCTs_8 Sep 23 04:30:56.776717 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:30:56.776717 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:30:56.776717 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:30:56.776717 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:30:56.776717 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:30:56.776717 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:30:56.776717 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 1afd0e729aae49b981a3636e6f624484 Sep 23 04:30:56.776717 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1067524409 Sep 23 04:30:56.776717 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:30:56.776717 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:30:56.777806 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1afd0e729aae49b981a3636e6f624484", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1afd0e729aae49b981a3636e6f624484"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1afd0e729aae49b981a3636e6f624484"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1afd0e729aae49b981a3636e6f624484"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:30:56.777806 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1067524409 Sep 23 04:30:56.777806 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 1afd0e729aae49b981a3636e6f624484 Sep 23 04:30:56.777806 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1067524409 Sep 23 04:30:56.777806 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-AggregatesAdminNegativeTestJSON-1067524409-project Sep 23 04:30:56.777806 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:30:56.777806 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:30:56.777806 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 24bb0c35a0084dac80d254287f655725 Sep 23 04:30:56.777806 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1067524409-project Sep 23 04:30:56.777806 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:30:56.777806 n-d-846463-3 devstack@n-api.service[122698]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Sep 23 04:30:56.777806 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '7'} Sep 23 04:30:56.778444 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:30:56.778444 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:30:56.778444 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:30:56.778444 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:30:56.778444 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:30:56.778444 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:30:56.778444 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:30:56.778444 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:30:56.778444 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Sep 23 04:30:56.778444 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Sep 23 04:30:56.778444 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 23 04:30:56.778444 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 23 04:30:56.778444 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 23 04:30:56.778444 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 23 04:30:56.778444 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 23 04:30:56.778444 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 23 04:30:56.778444 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 23 04:30:56.778444 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise self.value Sep 23 04:30:56.778444 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 23 04:30:56.779360 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 23 04:30:56.779360 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 23 04:30:56.779360 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 23 04:30:56.779360 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 23 04:30:56.779360 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 23 04:30:56.779360 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Sep 23 04:30:56.779360 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:30:56.779360 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:30:56.779360 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:30:56.779360 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:30:56.779360 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:30:56.779360 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:30:56.779360 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 23 04:30:56.779360 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 23 04:30:56.779360 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Sep 23 04:30:56.779360 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:30:56.781559 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4c62ba4d-a460-447e-83ea-0c103b9bbe49 tempest-AggregatesAdminNegativeTestJSON-1067524409 tempest-AggregatesAdminNegativeTestJSON-1067524409-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:30:56.782639 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4c62ba4d-a460-447e-83ea-0c103b9bbe49 tempest-AggregatesAdminNegativeTestJSON-1067524409 tempest-AggregatesAdminNegativeTestJSON-1067524409-project] 10.222.0.33 "GET /compute/v2.1/os-aggregates/7" status: 403 len: 114 microversion: 2.1 time: 0.019591 Sep 23 04:30:56.784096 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 39/55] 10.222.0.33 () {58 vars in 1149 bytes} [Fri Sep 23 04:30:56 2022] GET /compute/v2.1/os-aggregates/7 => generated 114 bytes in 31 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:30:56.791800 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8a66f110-0137-451f-a905-f9ce5abc3bc9 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:30:56.792306 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8a66f110-0137-451f-a905-f9ce5abc3bc9 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:30:56.792636 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c0bdeac6-077c-4964-89b1-0af861ae50dd tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:30:56.792744 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8a66f110-0137-451f-a905-f9ce5abc3bc9 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:30:56.793815 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8a66f110-0137-451f-a905-f9ce5abc3bc9 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:30:56.794369 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8a66f110-0137-451f-a905-f9ce5abc3bc9 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:30:56.796155 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8a66f110-0137-451f-a905-f9ce5abc3bc9 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:30:56.815999 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-8a66f110-0137-451f-a905-f9ce5abc3bc9 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Getting quotas for project a161d95e4c44433ba5af6b941190fa24. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:30:56.822749 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-8a66f110-0137-451f-a905-f9ce5abc3bc9 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Getting quotas for user 82ee10291f2c4914b348a82e51b9c967 and project a161d95e4c44433ba5af6b941190fa24. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:30:56.838596 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-8a66f110-0137-451f-a905-f9ce5abc3bc9 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Going to run 1 instances... {{(pid=122699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:30:56.842269 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-8a66f110-0137-451f-a905-f9ce5abc3bc9 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] [instance: 43aee7fc-54b8-4499-998b-92054bfd82b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:30:56.889355 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c0bdeac6-077c-4964-89b1-0af861ae50dd tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.101236 Sep 23 04:30:56.890346 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 40/56] 10.222.0.33 () {58 vars in 1152 bytes} [Fri Sep 23 04:30:56 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Sep 23 04:30:56.904138 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e9224d42-b9d7-4e50-aff7-9a5feba0e7a0 tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:30:56.913057 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-e9224d42-b9d7-4e50-aff7-9a5feba0e7a0 tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Sep 23 04:30:56.914616 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e9224d42-b9d7-4e50-aff7-9a5feba0e7a0 tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] Request method failure captured: Sep 23 04:30:56.914616 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Sep 23 04:30:56.914616 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:30:56.914616 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:30:56.914616 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:30:56.914616 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:30:56.914616 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:30:56.914616 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:30:56.914616 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:30:56.914616 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:30:56.914616 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTZ5oEAchpKsFTLJD2ORtLdgqj3VHiTBLEM6UEPkUUCvcyhf0_w1Xxxls4zrNN9m-rmbehAHDIYaSPnFC9qCAriwu0PussLgdOCF2zTCPBrKzCi-GYGjkUruxttnETP-K2i9CdZdQcLkzw59XHXqeXxFwe_YqUAo93JD5ZxCOdShtNA Sep 23 04:30:56.914616 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:30:56.914616 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:30:56.914616 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:30:56.914616 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:30:56.914616 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:30:56.914616 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:30:56.914616 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: db8ef5d6dc834d57b5b3fad0dda5512c Sep 23 04:30:56.914616 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2040548293 Sep 23 04:30:56.914616 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,admin,member Sep 23 04:30:56.914616 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,admin,member Sep 23 04:30:56.915819 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_db8ef5d6dc834d57b5b3fad0dda5512c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/db8ef5d6dc834d57b5b3fad0dda5512c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/db8ef5d6dc834d57b5b3fad0dda5512c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/db8ef5d6dc834d57b5b3fad0dda5512c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:30:56.915819 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2040548293 Sep 23 04:30:56.915819 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: db8ef5d6dc834d57b5b3fad0dda5512c Sep 23 04:30:56.915819 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2040548293 Sep 23 04:30:56.915819 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin Sep 23 04:30:56.915819 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:30:56.915819 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:30:56.915819 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 289ab0514fa048a9b6662b3e56304199 Sep 23 04:30:56.915819 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin Sep 23 04:30:56.915819 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:30:56.915819 n-d-846463-3 devstack@n-api.service[122698]: exception: Aggregate -1 could not be found. Sep 23 04:30:56.915819 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '-1'} Sep 23 04:30:56.916407 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:30:56.916407 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:30:56.916407 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Sep 23 04:30:56.916407 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Sep 23 04:30:56.916407 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Sep 23 04:30:56.916407 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Sep 23 04:30:56.916407 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 04:30:56.916407 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 04:30:56.916407 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 23 04:30:56.916407 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 23 04:30:56.916407 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 23 04:30:56.916407 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 23 04:30:56.916407 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 23 04:30:56.916407 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 23 04:30:56.916407 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Sep 23 04:30:56.916407 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:30:56.916407 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:30:56.916407 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:30:56.916407 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:30:56.916407 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:30:56.917386 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:30:56.917386 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:30:56.917386 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:30:56.917386 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:30:56.917386 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:30:56.917386 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Sep 23 04:30:56.917386 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:30:56.917386 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Sep 23 04:30:56.917386 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:30:56.917386 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:30:56.917386 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:30:56.917386 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:30:56.917386 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:30:56.917386 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:30:56.917386 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:30:56.917386 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:30:56.917386 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Sep 23 04:30:56.917386 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:30:56.919776 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e9224d42-b9d7-4e50-aff7-9a5feba0e7a0 tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:30:56.920793 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e9224d42-b9d7-4e50-aff7-9a5feba0e7a0 tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.020583 Sep 23 04:30:56.921540 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 41/57] 10.222.0.33 () {58 vars in 1152 bytes} [Fri Sep 23 04:30:56 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 23 04:30:56.931219 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-74ab391f-74a5-409a-b457-4e64c4b58cc2 tempest-AggregatesAdminNegativeTestJSON-1067524409 tempest-AggregatesAdminNegativeTestJSON-1067524409-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:30:56.932808 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-74ab391f-74a5-409a-b457-4e64c4b58cc2 tempest-AggregatesAdminNegativeTestJSON-1067524409 tempest-AggregatesAdminNegativeTestJSON-1067524409-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '24bb0c35a0084dac80d254287f655725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1afd0e729aae49b981a3636e6f624484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:30:56.934456 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-74ab391f-74a5-409a-b457-4e64c4b58cc2 tempest-AggregatesAdminNegativeTestJSON-1067524409 tempest-AggregatesAdminNegativeTestJSON-1067524409-project] Request method failure captured: Sep 23 04:30:56.934456 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Sep 23 04:30:56.934456 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:30:56.934456 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:30:56.934456 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:30:56.934456 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:30:56.934456 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:30:56.934456 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:30:56.934456 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:30:56.934456 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:30:56.934456 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTZ2Bmf2_m05_gVOD5T53ER-1nncrPHmXve7d0hTs46C9PzKHYRjJbGa1nOFPP3OOKdjd0mb5lLNofLIron7_t_GWAnczvLJFriTpPDE959L2qsQy0co9m-MlEpNHrFH-rS2rfsrOiKNuZFr1Mz8QltnRj0IzzpoRmfFH7LcCQCTs_8 Sep 23 04:30:56.934456 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:30:56.934456 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:30:56.934456 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:30:56.934456 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:30:56.934456 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:30:56.934456 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:30:56.934456 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 1afd0e729aae49b981a3636e6f624484 Sep 23 04:30:56.934456 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1067524409 Sep 23 04:30:56.934456 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:30:56.934456 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:30:56.935681 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1afd0e729aae49b981a3636e6f624484", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1afd0e729aae49b981a3636e6f624484"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1afd0e729aae49b981a3636e6f624484"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1afd0e729aae49b981a3636e6f624484"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:30:56.935681 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1067524409 Sep 23 04:30:56.935681 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 1afd0e729aae49b981a3636e6f624484 Sep 23 04:30:56.935681 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1067524409 Sep 23 04:30:56.935681 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-AggregatesAdminNegativeTestJSON-1067524409-project Sep 23 04:30:56.935681 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:30:56.935681 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:30:56.935681 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 24bb0c35a0084dac80d254287f655725 Sep 23 04:30:56.935681 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1067524409-project Sep 23 04:30:56.935681 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:30:56.935681 n-d-846463-3 devstack@n-api.service[122698]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Sep 23 04:30:56.935681 n-d-846463-3 devstack@n-api.service[122698]: action_args: {} Sep 23 04:30:56.936282 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:30:56.936282 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:30:56.936282 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:30:56.936282 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:30:56.936282 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:30:56.936282 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:30:56.936282 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:30:56.936282 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:30:56.936282 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Sep 23 04:30:56.936282 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Sep 23 04:30:56.936282 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 23 04:30:56.936282 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 23 04:30:56.936282 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 23 04:30:56.936282 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 23 04:30:56.936282 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 23 04:30:56.936282 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 23 04:30:56.936282 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 23 04:30:56.936282 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise self.value Sep 23 04:30:56.936282 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 23 04:30:56.937204 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 23 04:30:56.937204 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 23 04:30:56.937204 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 23 04:30:56.937204 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 23 04:30:56.937204 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 23 04:30:56.937204 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Sep 23 04:30:56.937204 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:30:56.937204 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:30:56.937204 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:30:56.937204 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:30:56.937204 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:30:56.937204 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:30:56.937204 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 23 04:30:56.937204 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 23 04:30:56.937204 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Sep 23 04:30:56.937204 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:30:56.937204 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-74ab391f-74a5-409a-b457-4e64c4b58cc2 tempest-AggregatesAdminNegativeTestJSON-1067524409 tempest-AggregatesAdminNegativeTestJSON-1067524409-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:30:56.940080 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-74ab391f-74a5-409a-b457-4e64c4b58cc2 tempest-AggregatesAdminNegativeTestJSON-1067524409 tempest-AggregatesAdminNegativeTestJSON-1067524409-project] 10.222.0.33 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.009172 Sep 23 04:30:56.940080 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 42/58] 10.222.0.33 () {58 vars in 1143 bytes} [Fri Sep 23 04:30:56 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 10 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:30:57.061100 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-8a66f110-0137-451f-a905-f9ce5abc3bc9 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.699654 Sep 23 04:30:57.062135 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 17/59] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:30:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1701 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:30:57.078684 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c5f72957-c301-4ad6-ba77-2346ad140952 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:30:57.079298 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c5f72957-c301-4ad6-ba77-2346ad140952 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] [instance: 43aee7fc-54b8-4499-998b-92054bfd82b4] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:30:57.189306 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c5f72957-c301-4ad6-ba77-2346ad140952 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82ee10291f2c4914b348a82e51b9c967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a161d95e4c44433ba5af6b941190fa24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:30:57.197152 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c5f72957-c301-4ad6-ba77-2346ad140952 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] 10.222.0.33 "GET /compute/v2.1/servers/43aee7fc-54b8-4499-998b-92054bfd82b4" status: 200 len: 1240 microversion: 2.1 time: 0.126365 Sep 23 04:30:57.199471 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 43/60] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:30:57 2022] GET /compute/v2.1/servers/43aee7fc-54b8-4499-998b-92054bfd82b4 => generated 1240 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:30:57.779829 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2737a40b-3c18-4598-b8a3-7d31b807ab9a tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:30:57.781050 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-2737a40b-3c18-4598-b8a3-7d31b807ab9a tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] [instance: e18459f8-cd71-4feb-8764-c3b4cc3d89be] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:30:57.813979 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2737a40b-3c18-4598-b8a3-7d31b807ab9a tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:30:57.827456 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2737a40b-3c18-4598-b8a3-7d31b807ab9a tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:30:57.828172 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2737a40b-3c18-4598-b8a3-7d31b807ab9a tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:30:57.828979 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2737a40b-3c18-4598-b8a3-7d31b807ab9a tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:30:57.829461 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2737a40b-3c18-4598-b8a3-7d31b807ab9a tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:30:57.829926 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2737a40b-3c18-4598-b8a3-7d31b807ab9a tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:30:58.020335 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2737a40b-3c18-4598-b8a3-7d31b807ab9a tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac39d27bcf5d4def9ff9bd5b81bd7b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79442cd4a69040f594e19b3492df7e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:30:58.040544 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2737a40b-3c18-4598-b8a3-7d31b807ab9a tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] 10.222.0.33 "GET /compute/v2.1/servers/e18459f8-cd71-4feb-8764-c3b4cc3d89be" status: 200 len: 1298 microversion: 2.1 time: 0.265484 Sep 23 04:30:58.041881 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 18/61] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:30:57 2022] GET /compute/v2.1/servers/e18459f8-cd71-4feb-8764-c3b4cc3d89be => generated 1298 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:30:58.232532 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-125825f7-d2af-45bc-8c9b-65446e8f1026 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:30:58.234695 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-125825f7-d2af-45bc-8c9b-65446e8f1026 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] [instance: 43aee7fc-54b8-4499-998b-92054bfd82b4] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:30:58.356561 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-125825f7-d2af-45bc-8c9b-65446e8f1026 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82ee10291f2c4914b348a82e51b9c967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a161d95e4c44433ba5af6b941190fa24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:30:58.378412 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-125825f7-d2af-45bc-8c9b-65446e8f1026 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] 10.222.0.33 "GET /compute/v2.1/servers/43aee7fc-54b8-4499-998b-92054bfd82b4" status: 200 len: 1240 microversion: 2.1 time: 0.161218 Sep 23 04:30:58.379360 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 44/62] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:30:58 2022] GET /compute/v2.1/servers/43aee7fc-54b8-4499-998b-92054bfd82b4 => generated 1240 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:30:59.070838 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-585dae54-f76b-49e7-842b-ec45362609ca tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:30:59.071627 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-585dae54-f76b-49e7-842b-ec45362609ca tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] [instance: e18459f8-cd71-4feb-8764-c3b4cc3d89be] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:30:59.116517 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-585dae54-f76b-49e7-842b-ec45362609ca tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:30:59.117077 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-585dae54-f76b-49e7-842b-ec45362609ca tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:30:59.126776 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-585dae54-f76b-49e7-842b-ec45362609ca tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:30:59.139840 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-585dae54-f76b-49e7-842b-ec45362609ca tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:30:59.140339 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-585dae54-f76b-49e7-842b-ec45362609ca tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:30:59.140803 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-585dae54-f76b-49e7-842b-ec45362609ca tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:30:59.404759 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2ddc915c-4d09-472f-a921-6f4bd2536a1c tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:30:59.407181 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-2ddc915c-4d09-472f-a921-6f4bd2536a1c tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] [instance: 43aee7fc-54b8-4499-998b-92054bfd82b4] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:30:59.450606 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2ddc915c-4d09-472f-a921-6f4bd2536a1c tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:30:59.451616 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2ddc915c-4d09-472f-a921-6f4bd2536a1c tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:30:59.452253 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2ddc915c-4d09-472f-a921-6f4bd2536a1c tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:30:59.455851 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2ddc915c-4d09-472f-a921-6f4bd2536a1c tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:30:59.456662 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2ddc915c-4d09-472f-a921-6f4bd2536a1c tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:30:59.458340 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2ddc915c-4d09-472f-a921-6f4bd2536a1c tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:30:59.803262 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-2ddc915c-4d09-472f-a921-6f4bd2536a1c tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82ee10291f2c4914b348a82e51b9c967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a161d95e4c44433ba5af6b941190fa24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:30:59.828474 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2ddc915c-4d09-472f-a921-6f4bd2536a1c tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] 10.222.0.33 "GET /compute/v2.1/servers/43aee7fc-54b8-4499-998b-92054bfd82b4" status: 200 len: 1240 microversion: 2.1 time: 0.425941 Sep 23 04:30:59.833170 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 45/63] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:30:59 2022] GET /compute/v2.1/servers/43aee7fc-54b8-4499-998b-92054bfd82b4 => generated 1240 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:31:00.032919 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-585dae54-f76b-49e7-842b-ec45362609ca tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac39d27bcf5d4def9ff9bd5b81bd7b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79442cd4a69040f594e19b3492df7e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:00.045565 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-585dae54-f76b-49e7-842b-ec45362609ca tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] 10.222.0.33 "GET /compute/v2.1/servers/e18459f8-cd71-4feb-8764-c3b4cc3d89be" status: 200 len: 1340 microversion: 2.1 time: 0.983569 Sep 23 04:31:00.058484 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 19/64] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:30:59 2022] GET /compute/v2.1/servers/e18459f8-cd71-4feb-8764-c3b4cc3d89be => generated 1340 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:31:00.855171 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4f88e5ac-b190-4408-8795-53e834ee0ff9 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:00.855924 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4f88e5ac-b190-4408-8795-53e834ee0ff9 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] [instance: 43aee7fc-54b8-4499-998b-92054bfd82b4] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:00.868406 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4f88e5ac-b190-4408-8795-53e834ee0ff9 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:00.875558 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4f88e5ac-b190-4408-8795-53e834ee0ff9 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:00.875558 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4f88e5ac-b190-4408-8795-53e834ee0ff9 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:00.875558 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4f88e5ac-b190-4408-8795-53e834ee0ff9 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:00.875558 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4f88e5ac-b190-4408-8795-53e834ee0ff9 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:00.881141 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4f88e5ac-b190-4408-8795-53e834ee0ff9 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:00.945716 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=6 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:31:01.074756 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0353577d-a935-4712-af71-3a90fc4ba409 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:01.081313 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-0353577d-a935-4712-af71-3a90fc4ba409 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] [instance: e18459f8-cd71-4feb-8764-c3b4cc3d89be] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:01.094769 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0353577d-a935-4712-af71-3a90fc4ba409 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:01.099929 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0353577d-a935-4712-af71-3a90fc4ba409 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:01.101421 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0353577d-a935-4712-af71-3a90fc4ba409 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:01.102537 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0353577d-a935-4712-af71-3a90fc4ba409 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:01.103246 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0353577d-a935-4712-af71-3a90fc4ba409 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:01.104171 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0353577d-a935-4712-af71-3a90fc4ba409 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:01.301059 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4f88e5ac-b190-4408-8795-53e834ee0ff9 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82ee10291f2c4914b348a82e51b9c967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a161d95e4c44433ba5af6b941190fa24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:01.316186 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4f88e5ac-b190-4408-8795-53e834ee0ff9 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] 10.222.0.33 "GET /compute/v2.1/servers/43aee7fc-54b8-4499-998b-92054bfd82b4" status: 200 len: 1288 microversion: 2.1 time: 0.465326 Sep 23 04:31:01.321604 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 46/65] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:31:00 2022] GET /compute/v2.1/servers/43aee7fc-54b8-4499-998b-92054bfd82b4 => generated 1288 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:31:01.768297 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-0353577d-a935-4712-af71-3a90fc4ba409 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac39d27bcf5d4def9ff9bd5b81bd7b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79442cd4a69040f594e19b3492df7e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:01.782730 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0353577d-a935-4712-af71-3a90fc4ba409 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] 10.222.0.33 "GET /compute/v2.1/servers/e18459f8-cd71-4feb-8764-c3b4cc3d89be" status: 200 len: 1340 microversion: 2.1 time: 0.712127 Sep 23 04:31:01.783681 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 20/66] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:31:01 2022] GET /compute/v2.1/servers/e18459f8-cd71-4feb-8764-c3b4cc3d89be => generated 1340 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:31:02.344400 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3ac737b0-8831-407c-8839-13408caceab0 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:02.346449 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3ac737b0-8831-407c-8839-13408caceab0 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] [instance: 43aee7fc-54b8-4499-998b-92054bfd82b4] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:02.359462 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3ac737b0-8831-407c-8839-13408caceab0 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:02.361546 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3ac737b0-8831-407c-8839-13408caceab0 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:02.362442 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3ac737b0-8831-407c-8839-13408caceab0 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:02.364149 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3ac737b0-8831-407c-8839-13408caceab0 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:02.365961 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3ac737b0-8831-407c-8839-13408caceab0 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:02.367427 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3ac737b0-8831-407c-8839-13408caceab0 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:02.529423 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-3ac737b0-8831-407c-8839-13408caceab0 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82ee10291f2c4914b348a82e51b9c967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a161d95e4c44433ba5af6b941190fa24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:02.554448 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3ac737b0-8831-407c-8839-13408caceab0 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] 10.222.0.33 "GET /compute/v2.1/servers/43aee7fc-54b8-4499-998b-92054bfd82b4" status: 200 len: 1306 microversion: 2.1 time: 0.197823 Sep 23 04:31:02.554448 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 47/67] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:31:02 2022] GET /compute/v2.1/servers/43aee7fc-54b8-4499-998b-92054bfd82b4 => generated 1306 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:31:02.824464 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-93a1bb5e-2dc9-4589-a77c-4032193f5068 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:02.828929 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-93a1bb5e-2dc9-4589-a77c-4032193f5068 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] [instance: e18459f8-cd71-4feb-8764-c3b4cc3d89be] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:02.851191 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-93a1bb5e-2dc9-4589-a77c-4032193f5068 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:02.851688 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-93a1bb5e-2dc9-4589-a77c-4032193f5068 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:02.855829 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-93a1bb5e-2dc9-4589-a77c-4032193f5068 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:02.856919 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-93a1bb5e-2dc9-4589-a77c-4032193f5068 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:02.857730 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-93a1bb5e-2dc9-4589-a77c-4032193f5068 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:02.858506 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-93a1bb5e-2dc9-4589-a77c-4032193f5068 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:03.079902 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-bc3a4e70-9904-4ccd-97ee-c75b1116639f tempest-HypervisorAdminUnderV252Test-281956107 tempest-HypervisorAdminUnderV252Test-281956107-project-admin] Calling method '.version_select at 0x7ff1c096eb80>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:03.082504 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bc3a4e70-9904-4ccd-97ee-c75b1116639f tempest-HypervisorAdminUnderV252Test-281956107 tempest-HypervisorAdminUnderV252Test-281956107-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:03.083731 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bc3a4e70-9904-4ccd-97ee-c75b1116639f tempest-HypervisorAdminUnderV252Test-281956107 tempest-HypervisorAdminUnderV252Test-281956107-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:03.084324 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bc3a4e70-9904-4ccd-97ee-c75b1116639f tempest-HypervisorAdminUnderV252Test-281956107 tempest-HypervisorAdminUnderV252Test-281956107-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:03.138654 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bc3a4e70-9904-4ccd-97ee-c75b1116639f tempest-HypervisorAdminUnderV252Test-281956107 tempest-HypervisorAdminUnderV252Test-281956107-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:03.139754 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bc3a4e70-9904-4ccd-97ee-c75b1116639f tempest-HypervisorAdminUnderV252Test-281956107 tempest-HypervisorAdminUnderV252Test-281956107-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:03.142957 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bc3a4e70-9904-4ccd-97ee-c75b1116639f tempest-HypervisorAdminUnderV252Test-281956107 tempest-HypervisorAdminUnderV252Test-281956107-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:03.165139 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bc3a4e70-9904-4ccd-97ee-c75b1116639f tempest-HypervisorAdminUnderV252Test-281956107 tempest-HypervisorAdminUnderV252Test-281956107-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:03.166192 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bc3a4e70-9904-4ccd-97ee-c75b1116639f tempest-HypervisorAdminUnderV252Test-281956107 tempest-HypervisorAdminUnderV252Test-281956107-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:03.167011 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bc3a4e70-9904-4ccd-97ee-c75b1116639f tempest-HypervisorAdminUnderV252Test-281956107 tempest-HypervisorAdminUnderV252Test-281956107-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:03.180396 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-bc3a4e70-9904-4ccd-97ee-c75b1116639f tempest-HypervisorAdminUnderV252Test-281956107 tempest-HypervisorAdminUnderV252Test-281956107-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.760348 Sep 23 04:31:03.183646 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 21/68] 10.222.0.33 () {58 vars in 1146 bytes} [Fri Sep 23 04:31:02 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:31:03.198738 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a9fa9a53-e688-4a3d-a80f-ff23d6e99191 tempest-HypervisorAdminUnderV252Test-281956107 tempest-HypervisorAdminUnderV252Test-281956107-project-admin] Calling method '.version_select at 0x7ff1c09bd280>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:03.202917 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a9fa9a53-e688-4a3d-a80f-ff23d6e99191 tempest-HypervisorAdminUnderV252Test-281956107 tempest-HypervisorAdminUnderV252Test-281956107-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:03.228868 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a9fa9a53-e688-4a3d-a80f-ff23d6e99191 tempest-HypervisorAdminUnderV252Test-281956107 tempest-HypervisorAdminUnderV252Test-281956107-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:03.230351 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a9fa9a53-e688-4a3d-a80f-ff23d6e99191 tempest-HypervisorAdminUnderV252Test-281956107 tempest-HypervisorAdminUnderV252Test-281956107-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:03.299448 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a9fa9a53-e688-4a3d-a80f-ff23d6e99191 tempest-HypervisorAdminUnderV252Test-281956107 tempest-HypervisorAdminUnderV252Test-281956107-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:03.299976 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a9fa9a53-e688-4a3d-a80f-ff23d6e99191 tempest-HypervisorAdminUnderV252Test-281956107 tempest-HypervisorAdminUnderV252Test-281956107-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:03.302260 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a9fa9a53-e688-4a3d-a80f-ff23d6e99191 tempest-HypervisorAdminUnderV252Test-281956107 tempest-HypervisorAdminUnderV252Test-281956107-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:03.444583 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a9fa9a53-e688-4a3d-a80f-ff23d6e99191 tempest-HypervisorAdminUnderV252Test-281956107 tempest-HypervisorAdminUnderV252Test-281956107-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:03.445245 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a9fa9a53-e688-4a3d-a80f-ff23d6e99191 tempest-HypervisorAdminUnderV252Test-281956107 tempest-HypervisorAdminUnderV252Test-281956107-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:03.445708 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a9fa9a53-e688-4a3d-a80f-ff23d6e99191 tempest-HypervisorAdminUnderV252Test-281956107 tempest-HypervisorAdminUnderV252Test-281956107-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:03.462231 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a9fa9a53-e688-4a3d-a80f-ff23d6e99191 tempest-HypervisorAdminUnderV252Test-281956107 tempest-HypervisorAdminUnderV252Test-281956107-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/n-h2-846463-3/servers" status: 200 len: 275 microversion: 2.1 time: 0.272055 Sep 23 04:31:03.463850 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 22/69] 10.222.0.33 () {58 vars in 1212 bytes} [Fri Sep 23 04:31:03 2022] GET /compute/v2.1/os-hypervisors/n-h2-846463-3/servers => generated 275 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:31:03.484567 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-93a1bb5e-2dc9-4589-a77c-4032193f5068 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac39d27bcf5d4def9ff9bd5b81bd7b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79442cd4a69040f594e19b3492df7e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:03.496419 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-93a1bb5e-2dc9-4589-a77c-4032193f5068 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] 10.222.0.33 "GET /compute/v2.1/servers/e18459f8-cd71-4feb-8764-c3b4cc3d89be" status: 200 len: 1340 microversion: 2.1 time: 0.688047 Sep 23 04:31:03.497666 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 48/70] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:31:02 2022] GET /compute/v2.1/servers/e18459f8-cd71-4feb-8764-c3b4cc3d89be => generated 1340 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:31:03.622648 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-03362019-26eb-4e73-b17d-4b9cdd9121fb tempest-FlavorsAccessTestJSON-6182965 tempest-FlavorsAccessTestJSON-6182965-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1723013897", "id": 1809697282, "os-flavor-access:is_public": "False"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:31:03.714441 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-03362019-26eb-4e73-b17d-4b9cdd9121fb tempest-FlavorsAccessTestJSON-6182965 tempest-FlavorsAccessTestJSON-6182965-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.248702 Sep 23 04:31:03.717947 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 23/71] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:31:03 2022] POST /compute/v2.1/flavors => generated 431 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:31:03.729348 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-cd4ec9aa-b820-4085-92f3-68fca438816b tempest-HypervisorAdminUnderV252Test-281956107 tempest-HypervisorAdminUnderV252Test-281956107-project-admin] Calling method '.version_select at 0x7ff1c08cfb80>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:03.731572 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cd4ec9aa-b820-4085-92f3-68fca438816b tempest-HypervisorAdminUnderV252Test-281956107 tempest-HypervisorAdminUnderV252Test-281956107-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:03.738590 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cd4ec9aa-b820-4085-92f3-68fca438816b tempest-HypervisorAdminUnderV252Test-281956107 tempest-HypervisorAdminUnderV252Test-281956107-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:03.742336 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cd4ec9aa-b820-4085-92f3-68fca438816b tempest-HypervisorAdminUnderV252Test-281956107 tempest-HypervisorAdminUnderV252Test-281956107-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:03.779677 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cd4ec9aa-b820-4085-92f3-68fca438816b tempest-HypervisorAdminUnderV252Test-281956107 tempest-HypervisorAdminUnderV252Test-281956107-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:03.782891 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cd4ec9aa-b820-4085-92f3-68fca438816b tempest-HypervisorAdminUnderV252Test-281956107 tempest-HypervisorAdminUnderV252Test-281956107-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:03.783605 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cd4ec9aa-b820-4085-92f3-68fca438816b tempest-HypervisorAdminUnderV252Test-281956107 tempest-HypervisorAdminUnderV252Test-281956107-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:03.816008 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cd4ec9aa-b820-4085-92f3-68fca438816b tempest-HypervisorAdminUnderV252Test-281956107 tempest-HypervisorAdminUnderV252Test-281956107-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:03.816525 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cd4ec9aa-b820-4085-92f3-68fca438816b tempest-HypervisorAdminUnderV252Test-281956107 tempest-HypervisorAdminUnderV252Test-281956107-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:03.817800 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cd4ec9aa-b820-4085-92f3-68fca438816b tempest-HypervisorAdminUnderV252Test-281956107 tempest-HypervisorAdminUnderV252Test-281956107-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:03.851318 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-cd4ec9aa-b820-4085-92f3-68fca438816b tempest-HypervisorAdminUnderV252Test-281956107 tempest-HypervisorAdminUnderV252Test-281956107-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.134073 Sep 23 04:31:03.856186 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 24/72] 10.222.0.33 () {58 vars in 1146 bytes} [Fri Sep 23 04:31:03 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:31:03.857370 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-b82567c7-598e-40e5-89c8-0dd0831aca67 req-ca87ef97-affc-4771-aff2-f7c1740ac731 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e18459f8-cd71-4feb-8764-c3b4cc3d89be", "tag": "7d2a2b75-42dc-4cfd-b0dd-6f06df2a1f28"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:31:03.868265 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-81d48fa7-9082-4ee5-bf9e-4969598ae971 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:03.869601 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-81d48fa7-9082-4ee5-bf9e-4969598ae971 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] [instance: 43aee7fc-54b8-4499-998b-92054bfd82b4] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:03.883562 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-81d48fa7-9082-4ee5-bf9e-4969598ae971 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:03.884342 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-81d48fa7-9082-4ee5-bf9e-4969598ae971 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:03.890420 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-81d48fa7-9082-4ee5-bf9e-4969598ae971 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:03.891465 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-81d48fa7-9082-4ee5-bf9e-4969598ae971 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:03.892169 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-81d48fa7-9082-4ee5-bf9e-4969598ae971 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:03.893013 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-81d48fa7-9082-4ee5-bf9e-4969598ae971 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:03.906718 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-b82567c7-598e-40e5-89c8-0dd0831aca67 req-ca87ef97-affc-4771-aff2-f7c1740ac731 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:03.911280 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-b82567c7-598e-40e5-89c8-0dd0831aca67 req-ca87ef97-affc-4771-aff2-f7c1740ac731 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:03.915794 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-b82567c7-598e-40e5-89c8-0dd0831aca67 req-ca87ef97-affc-4771-aff2-f7c1740ac731 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:03.959265 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-b82567c7-598e-40e5-89c8-0dd0831aca67 req-ca87ef97-affc-4771-aff2-f7c1740ac731 service nova] Creating event network-changed:7d2a2b75-42dc-4cfd-b0dd-6f06df2a1f28 for instance e18459f8-cd71-4feb-8764-c3b4cc3d89be on n-h2-846463-3 Sep 23 04:31:03.959927 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-b82567c7-598e-40e5-89c8-0dd0831aca67 req-ca87ef97-affc-4771-aff2-f7c1740ac731 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=122698) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 23 04:31:03.960430 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-b82567c7-598e-40e5-89c8-0dd0831aca67 req-ca87ef97-affc-4771-aff2-f7c1740ac731 service nova] Acquired lock "compute-rpcapi-router" {{(pid=122698) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 23 04:31:03.961802 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a28194b1-e37c-4664-b15b-e766295ef02a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:03.962534 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a28194b1-e37c-4664-b15b-e766295ef02a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:03.968830 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a28194b1-e37c-4664-b15b-e766295ef02a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:03.974059 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a28194b1-e37c-4664-b15b-e766295ef02a None None] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:03.977570 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a28194b1-e37c-4664-b15b-e766295ef02a None None] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:03.978308 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a28194b1-e37c-4664-b15b-e766295ef02a None None] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:04.002565 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.compute.rpcapi [None req-a28194b1-e37c-4664-b15b-e766295ef02a None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 23 04:31:04.004391 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a28194b1-e37c-4664-b15b-e766295ef02a None None] Releasing lock "compute-rpcapi-router" {{(pid=122698) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 23 04:31:04.009814 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-81d48fa7-9082-4ee5-bf9e-4969598ae971 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82ee10291f2c4914b348a82e51b9c967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a161d95e4c44433ba5af6b941190fa24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:04.019261 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-81d48fa7-9082-4ee5-bf9e-4969598ae971 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] 10.222.0.33 "GET /compute/v2.1/servers/43aee7fc-54b8-4499-998b-92054bfd82b4" status: 200 len: 1294 microversion: 2.1 time: 0.161305 Sep 23 04:31:04.024412 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 25/73] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:31:03 2022] GET /compute/v2.1/servers/43aee7fc-54b8-4499-998b-92054bfd82b4 => generated 1294 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:31:04.029470 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6b03c1d3-998b-416e-a193-205ddb196e5e tempest-FlavorsAccessTestJSON-6182965 tempest-FlavorsAccessTestJSON-6182965-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "cbec134da05b414193ac9ea7ffa7c6c6"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:31:04.064109 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a28194b1-e37c-4664-b15b-e766295ef02a None None] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.535902 Sep 23 04:31:04.074303 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 49/74] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:31:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:31:04.092034 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f3c7a312-afe0-4948-b2dd-d77462b7aa39 tempest-HypervisorAdminUnderV252Test-281956107 tempest-HypervisorAdminUnderV252Test-281956107-project-admin] Calling method '.version_select at 0x7ff1c07c4700>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:04.095632 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f3c7a312-afe0-4948-b2dd-d77462b7aa39 tempest-HypervisorAdminUnderV252Test-281956107 tempest-HypervisorAdminUnderV252Test-281956107-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:04.098449 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f3c7a312-afe0-4948-b2dd-d77462b7aa39 tempest-HypervisorAdminUnderV252Test-281956107 tempest-HypervisorAdminUnderV252Test-281956107-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:04.098449 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f3c7a312-afe0-4948-b2dd-d77462b7aa39 tempest-HypervisorAdminUnderV252Test-281956107 tempest-HypervisorAdminUnderV252Test-281956107-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:04.137582 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f3c7a312-afe0-4948-b2dd-d77462b7aa39 tempest-HypervisorAdminUnderV252Test-281956107 tempest-HypervisorAdminUnderV252Test-281956107-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:04.138812 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f3c7a312-afe0-4948-b2dd-d77462b7aa39 tempest-HypervisorAdminUnderV252Test-281956107 tempest-HypervisorAdminUnderV252Test-281956107-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:04.139468 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f3c7a312-afe0-4948-b2dd-d77462b7aa39 tempest-HypervisorAdminUnderV252Test-281956107 tempest-HypervisorAdminUnderV252Test-281956107-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:04.150220 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f3c7a312-afe0-4948-b2dd-d77462b7aa39 tempest-HypervisorAdminUnderV252Test-281956107 tempest-HypervisorAdminUnderV252Test-281956107-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/n-h2-846463-3/search" status: 200 len: 104 microversion: 2.1 time: 0.080551 Sep 23 04:31:04.151150 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 50/75] 10.222.0.33 () {58 vars in 1209 bytes} [Fri Sep 23 04:31:04 2022] GET /compute/v2.1/os-hypervisors/n-h2-846463-3/search => generated 104 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:31:04.522625 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-907c9449-3230-49aa-a617-64d03dc5e073 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:04.524108 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-907c9449-3230-49aa-a617-64d03dc5e073 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] [instance: e18459f8-cd71-4feb-8764-c3b4cc3d89be] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:04.531202 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-907c9449-3230-49aa-a617-64d03dc5e073 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:04.538730 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-907c9449-3230-49aa-a617-64d03dc5e073 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:04.538730 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-907c9449-3230-49aa-a617-64d03dc5e073 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:04.538730 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-907c9449-3230-49aa-a617-64d03dc5e073 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:04.538730 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-907c9449-3230-49aa-a617-64d03dc5e073 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:04.539076 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-907c9449-3230-49aa-a617-64d03dc5e073 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:04.849844 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6b03c1d3-998b-416e-a193-205ddb196e5e tempest-FlavorsAccessTestJSON-6182965 tempest-FlavorsAccessTestJSON-6182965-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/1809697282/action" status: 200 len: 97 microversion: 2.1 time: 0.822541 Sep 23 04:31:04.852002 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 26/76] 10.222.0.33 () {60 vars in 1200 bytes} [Fri Sep 23 04:31:04 2022] POST /compute/v2.1/flavors/1809697282/action => generated 97 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 04:31:05.244355 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-907c9449-3230-49aa-a617-64d03dc5e073 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac39d27bcf5d4def9ff9bd5b81bd7b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79442cd4a69040f594e19b3492df7e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:05.259168 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-907c9449-3230-49aa-a617-64d03dc5e073 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] 10.222.0.33 "GET /compute/v2.1/servers/e18459f8-cd71-4feb-8764-c3b4cc3d89be" status: 200 len: 1340 microversion: 2.1 time: 0.738667 Sep 23 04:31:05.262723 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 51/77] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:31:04 2022] GET /compute/v2.1/servers/e18459f8-cd71-4feb-8764-c3b4cc3d89be => generated 1340 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:31:05.276265 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6b3c40b3-a07e-467d-9999-b62a35fa7a99 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:05.276978 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-6b3c40b3-a07e-467d-9999-b62a35fa7a99 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] [instance: 43aee7fc-54b8-4499-998b-92054bfd82b4] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:05.295812 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6b3c40b3-a07e-467d-9999-b62a35fa7a99 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:05.303852 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6b3c40b3-a07e-467d-9999-b62a35fa7a99 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:05.304762 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6b3c40b3-a07e-467d-9999-b62a35fa7a99 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:05.305748 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6b3c40b3-a07e-467d-9999-b62a35fa7a99 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:05.306447 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6b3c40b3-a07e-467d-9999-b62a35fa7a99 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:05.307088 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6b3c40b3-a07e-467d-9999-b62a35fa7a99 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:05.923391 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6b3c40b3-a07e-467d-9999-b62a35fa7a99 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82ee10291f2c4914b348a82e51b9c967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a161d95e4c44433ba5af6b941190fa24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:05.937392 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-757a3615-ff9e-4534-90c1-e3dd2e216771 tempest-FlavorsAccessTestJSON-472163106 tempest-FlavorsAccessTestJSON-472163106-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:05.954168 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-6b3c40b3-a07e-467d-9999-b62a35fa7a99 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] 10.222.0.33 "GET /compute/v2.1/servers/43aee7fc-54b8-4499-998b-92054bfd82b4" status: 200 len: 1336 microversion: 2.1 time: 0.676562 Sep 23 04:31:05.954168 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 52/78] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:31:05 2022] GET /compute/v2.1/servers/43aee7fc-54b8-4499-998b-92054bfd82b4 => generated 1336 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:31:06.025389 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-757a3615-ff9e-4534-90c1-e3dd2e216771 tempest-FlavorsAccessTestJSON-472163106 tempest-FlavorsAccessTestJSON-472163106-project] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5412 microversion: 2.1 time: 1.166044 Sep 23 04:31:06.035806 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 27/79] 10.222.0.33 () {58 vars in 1146 bytes} [Fri Sep 23 04:31:04 2022] GET /compute/v2.1/flavors/detail => generated 5412 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:31:06.054712 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-93e650df-78d2-4767-9a9c-f29a1f4baec6 tempest-FlavorsAccessTestJSON-6182965 tempest-FlavorsAccessTestJSON-6182965-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "cbec134da05b414193ac9ea7ffa7c6c6"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:31:06.284578 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-639705ff-52b8-43fb-9f21-01cd0970eab4 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:06.285305 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-639705ff-52b8-43fb-9f21-01cd0970eab4 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] [instance: e18459f8-cd71-4feb-8764-c3b4cc3d89be] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:06.303605 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-639705ff-52b8-43fb-9f21-01cd0970eab4 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:06.303605 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-639705ff-52b8-43fb-9f21-01cd0970eab4 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:06.303605 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-639705ff-52b8-43fb-9f21-01cd0970eab4 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:06.303605 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-639705ff-52b8-43fb-9f21-01cd0970eab4 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:06.304011 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-639705ff-52b8-43fb-9f21-01cd0970eab4 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:06.304011 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-639705ff-52b8-43fb-9f21-01cd0970eab4 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:06.524537 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-93e650df-78d2-4767-9a9c-f29a1f4baec6 tempest-FlavorsAccessTestJSON-6182965 tempest-FlavorsAccessTestJSON-6182965-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/1809697282/action" status: 200 len: 21 microversion: 2.1 time: 0.483042 Sep 23 04:31:06.528170 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 53/80] 10.222.0.33 () {60 vars in 1200 bytes} [Fri Sep 23 04:31:06 2022] POST /compute/v2.1/flavors/1809697282/action => generated 21 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 23 04:31:06.545819 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0062a21c-6c19-4b60-ae47-de49f7ad64de tempest-FlavorsAccessTestJSON-472163106 tempest-FlavorsAccessTestJSON-472163106-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:06.606929 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0062a21c-6c19-4b60-ae47-de49f7ad64de tempest-FlavorsAccessTestJSON-472163106 tempest-FlavorsAccessTestJSON-472163106-project] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.075289 Sep 23 04:31:06.612666 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 54/81] 10.222.0.33 () {58 vars in 1146 bytes} [Fri Sep 23 04:31:06 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:31:06.636705 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8dd31ca7-8dd1-4e66-94f9-e8778ac79067 tempest-FlavorsAccessTestJSON-6182965 tempest-FlavorsAccessTestJSON-6182965-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:06.748967 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8dd31ca7-8dd1-4e66-94f9-e8778ac79067 tempest-FlavorsAccessTestJSON-6182965 tempest-FlavorsAccessTestJSON-6182965-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/1809697282" status: 202 len: 0 microversion: 2.1 time: 0.119928 Sep 23 04:31:06.755088 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 55/82] 10.222.0.33 () {58 vars in 1161 bytes} [Fri Sep 23 04:31:06 2022] DELETE /compute/v2.1/flavors/1809697282 => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:31:06.779146 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-639705ff-52b8-43fb-9f21-01cd0970eab4 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac39d27bcf5d4def9ff9bd5b81bd7b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79442cd4a69040f594e19b3492df7e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:06.815368 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-639705ff-52b8-43fb-9f21-01cd0970eab4 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] 10.222.0.33 "GET /compute/v2.1/servers/e18459f8-cd71-4feb-8764-c3b4cc3d89be" status: 200 len: 1340 microversion: 2.1 time: 0.534632 Sep 23 04:31:06.816596 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 28/83] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:31:06 2022] GET /compute/v2.1/servers/e18459f8-cd71-4feb-8764-c3b4cc3d89be => generated 1340 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:31:06.822873 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=8 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:31:06.838556 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-431f9ac0-5ca3-4827-a73e-b998cd3ca5e9 tempest-FlavorsAccessTestJSON-6182965 tempest-FlavorsAccessTestJSON-6182965-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:06.912135 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=12 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:31:06.947066 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-431f9ac0-5ca3-4827-a73e-b998cd3ca5e9 tempest-FlavorsAccessTestJSON-6182965 tempest-FlavorsAccessTestJSON-6182965-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.118684 Sep 23 04:31:06.970205 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-09a4e7a5-5d28-4d7c-a596-c297abbf184e tempest-HypervisorAdminTestJSON-406406439 tempest-HypervisorAdminTestJSON-406406439-project-admin] Calling method '.version_select at 0x7ff1c0778af0>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:06.972855 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-09a4e7a5-5d28-4d7c-a596-c297abbf184e tempest-HypervisorAdminTestJSON-406406439 tempest-HypervisorAdminTestJSON-406406439-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:06.977866 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-09a4e7a5-5d28-4d7c-a596-c297abbf184e tempest-HypervisorAdminTestJSON-406406439 tempest-HypervisorAdminTestJSON-406406439-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:06.978606 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-09a4e7a5-5d28-4d7c-a596-c297abbf184e tempest-HypervisorAdminTestJSON-406406439 tempest-HypervisorAdminTestJSON-406406439-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:06.981915 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 29/84] 10.222.0.33 () {58 vars in 1146 bytes} [Fri Sep 23 04:31:06 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:31:06.999001 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-09a4e7a5-5d28-4d7c-a596-c297abbf184e tempest-HypervisorAdminTestJSON-406406439 tempest-HypervisorAdminTestJSON-406406439-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:06.999825 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-09a4e7a5-5d28-4d7c-a596-c297abbf184e tempest-HypervisorAdminTestJSON-406406439 tempest-HypervisorAdminTestJSON-406406439-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:07.000486 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-09a4e7a5-5d28-4d7c-a596-c297abbf184e tempest-HypervisorAdminTestJSON-406406439 tempest-HypervisorAdminTestJSON-406406439-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:07.006859 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-18d639e0-9960-40b3-bc2a-13c0051effa4 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:07.007583 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-18d639e0-9960-40b3-bc2a-13c0051effa4 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] [instance: 43aee7fc-54b8-4499-998b-92054bfd82b4] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:07.015382 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-09a4e7a5-5d28-4d7c-a596-c297abbf184e tempest-HypervisorAdminTestJSON-406406439 tempest-HypervisorAdminTestJSON-406406439-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:07.020970 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-09a4e7a5-5d28-4d7c-a596-c297abbf184e tempest-HypervisorAdminTestJSON-406406439 tempest-HypervisorAdminTestJSON-406406439-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:07.020970 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-09a4e7a5-5d28-4d7c-a596-c297abbf184e tempest-HypervisorAdminTestJSON-406406439 tempest-HypervisorAdminTestJSON-406406439-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:07.028166 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-09a4e7a5-5d28-4d7c-a596-c297abbf184e tempest-HypervisorAdminTestJSON-406406439 tempest-HypervisorAdminTestJSON-406406439-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.274871 Sep 23 04:31:07.029337 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 56/85] 10.222.0.33 () {58 vars in 1146 bytes} [Fri Sep 23 04:31:06 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:31:07.033366 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-18d639e0-9960-40b3-bc2a-13c0051effa4 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:07.035703 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-fdb96a39-5cf6-49b4-bb8e-a75e8639f450 tempest-FlavorsAccessTestJSON-6182965 tempest-FlavorsAccessTestJSON-6182965-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1774669843", "id": 1802952456, "os-flavor-access:is_public": "False"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:31:07.038653 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-18d639e0-9960-40b3-bc2a-13c0051effa4 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:07.039314 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-18d639e0-9960-40b3-bc2a-13c0051effa4 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:07.054579 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-18d639e0-9960-40b3-bc2a-13c0051effa4 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:07.057274 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-18d639e0-9960-40b3-bc2a-13c0051effa4 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:07.058751 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-18d639e0-9960-40b3-bc2a-13c0051effa4 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:07.169348 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-fdb96a39-5cf6-49b4-bb8e-a75e8639f450 tempest-FlavorsAccessTestJSON-6182965 tempest-FlavorsAccessTestJSON-6182965-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.138696 Sep 23 04:31:07.170380 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 57/86] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:31:07 2022] POST /compute/v2.1/flavors => generated 431 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:31:07.189168 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-79da54e1-6684-47e0-8675-2f69e50d1905 tempest-HypervisorAdminTestJSON-406406439 tempest-HypervisorAdminTestJSON-406406439-project-admin] Calling method '.version_select at 0x7ff1c0718ca0>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:07.192848 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-79da54e1-6684-47e0-8675-2f69e50d1905 tempest-HypervisorAdminTestJSON-406406439 tempest-HypervisorAdminTestJSON-406406439-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:07.193410 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-79da54e1-6684-47e0-8675-2f69e50d1905 tempest-HypervisorAdminTestJSON-406406439 tempest-HypervisorAdminTestJSON-406406439-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:07.194105 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-79da54e1-6684-47e0-8675-2f69e50d1905 tempest-HypervisorAdminTestJSON-406406439 tempest-HypervisorAdminTestJSON-406406439-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:07.219701 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-79da54e1-6684-47e0-8675-2f69e50d1905 tempest-HypervisorAdminTestJSON-406406439 tempest-HypervisorAdminTestJSON-406406439-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:07.220664 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-79da54e1-6684-47e0-8675-2f69e50d1905 tempest-HypervisorAdminTestJSON-406406439 tempest-HypervisorAdminTestJSON-406406439-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:07.221295 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-79da54e1-6684-47e0-8675-2f69e50d1905 tempest-HypervisorAdminTestJSON-406406439 tempest-HypervisorAdminTestJSON-406406439-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:07.234472 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-79da54e1-6684-47e0-8675-2f69e50d1905 tempest-HypervisorAdminTestJSON-406406439 tempest-HypervisorAdminTestJSON-406406439-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:07.235200 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-79da54e1-6684-47e0-8675-2f69e50d1905 tempest-HypervisorAdminTestJSON-406406439 tempest-HypervisorAdminTestJSON-406406439-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:07.235803 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-79da54e1-6684-47e0-8675-2f69e50d1905 tempest-HypervisorAdminTestJSON-406406439 tempest-HypervisorAdminTestJSON-406406439-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:07.245081 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-79da54e1-6684-47e0-8675-2f69e50d1905 tempest-HypervisorAdminTestJSON-406406439 tempest-HypervisorAdminTestJSON-406406439-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1504 microversion: 2.1 time: 0.073368 Sep 23 04:31:07.253162 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 58/87] 10.222.0.33 () {58 vars in 1167 bytes} [Fri Sep 23 04:31:07 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1504 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:31:07.253162 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-beaa8510-0b79-4b43-a95c-c93b396ab987 tempest-FlavorsAccessTestJSON-6182965 tempest-FlavorsAccessTestJSON-6182965-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:07.266457 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-beaa8510-0b79-4b43-a95c-c93b396ab987 tempest-FlavorsAccessTestJSON-6182965 tempest-FlavorsAccessTestJSON-6182965-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/1802952456/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.018506 Sep 23 04:31:07.268275 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 59/88] 10.222.0.33 () {58 vars in 1209 bytes} [Fri Sep 23 04:31:07 2022] GET /compute/v2.1/flavors/1802952456/os-flavor-access => generated 21 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 04:31:07.274486 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-39384f64-aba9-413a-b46e-c8106a9e8209 tempest-HypervisorAdminTestJSON-406406439 tempest-HypervisorAdminTestJSON-406406439-project-admin] Calling method '.version_select at 0x7ff1c07de4c0>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:07.276466 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-39384f64-aba9-413a-b46e-c8106a9e8209 tempest-HypervisorAdminTestJSON-406406439 tempest-HypervisorAdminTestJSON-406406439-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:07.277250 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-39384f64-aba9-413a-b46e-c8106a9e8209 tempest-HypervisorAdminTestJSON-406406439 tempest-HypervisorAdminTestJSON-406406439-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:07.282084 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-39384f64-aba9-413a-b46e-c8106a9e8209 tempest-HypervisorAdminTestJSON-406406439 tempest-HypervisorAdminTestJSON-406406439-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:07.294880 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-18d639e0-9960-40b3-bc2a-13c0051effa4 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82ee10291f2c4914b348a82e51b9c967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a161d95e4c44433ba5af6b941190fa24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:07.308619 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-18d639e0-9960-40b3-bc2a-13c0051effa4 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] 10.222.0.33 "GET /compute/v2.1/servers/43aee7fc-54b8-4499-998b-92054bfd82b4" status: 200 len: 1336 microversion: 2.1 time: 0.322897 Sep 23 04:31:07.323526 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-39384f64-aba9-413a-b46e-c8106a9e8209 tempest-HypervisorAdminTestJSON-406406439 tempest-HypervisorAdminTestJSON-406406439-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:07.323526 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-39384f64-aba9-413a-b46e-c8106a9e8209 tempest-HypervisorAdminTestJSON-406406439 tempest-HypervisorAdminTestJSON-406406439-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:07.323526 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-39384f64-aba9-413a-b46e-c8106a9e8209 tempest-HypervisorAdminTestJSON-406406439 tempest-HypervisorAdminTestJSON-406406439-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:07.323742 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 30/89] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:31:06 2022] GET /compute/v2.1/servers/43aee7fc-54b8-4499-998b-92054bfd82b4 => generated 1336 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:31:07.342829 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-670edc59-3404-417f-8620-93e6a8ffa307 tempest-FlavorsAccessTestJSON-6182965 tempest-FlavorsAccessTestJSON-6182965-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:07.375769 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-39384f64-aba9-413a-b46e-c8106a9e8209 tempest-HypervisorAdminTestJSON-406406439 tempest-HypervisorAdminTestJSON-406406439-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:07.378892 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-39384f64-aba9-413a-b46e-c8106a9e8209 tempest-HypervisorAdminTestJSON-406406439 tempest-HypervisorAdminTestJSON-406406439-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:07.381363 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-39384f64-aba9-413a-b46e-c8106a9e8209 tempest-HypervisorAdminTestJSON-406406439 tempest-HypervisorAdminTestJSON-406406439-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:07.392498 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-39384f64-aba9-413a-b46e-c8106a9e8209 tempest-HypervisorAdminTestJSON-406406439 tempest-HypervisorAdminTestJSON-406406439-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.122805 Sep 23 04:31:07.394095 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 60/90] 10.222.0.33 () {58 vars in 1146 bytes} [Fri Sep 23 04:31:07 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:31:07.424882 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-be9fdf4c-d08d-4b36-82dd-b64e76fc53df tempest-HypervisorAdminTestJSON-406406439 tempest-HypervisorAdminTestJSON-406406439-project-admin] Calling method '.version_select at 0x7ff1c0732f70>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:07.431095 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-be9fdf4c-d08d-4b36-82dd-b64e76fc53df tempest-HypervisorAdminTestJSON-406406439 tempest-HypervisorAdminTestJSON-406406439-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:07.435977 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-be9fdf4c-d08d-4b36-82dd-b64e76fc53df tempest-HypervisorAdminTestJSON-406406439 tempest-HypervisorAdminTestJSON-406406439-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:07.438289 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-be9fdf4c-d08d-4b36-82dd-b64e76fc53df tempest-HypervisorAdminTestJSON-406406439 tempest-HypervisorAdminTestJSON-406406439-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:07.446084 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-670edc59-3404-417f-8620-93e6a8ffa307 tempest-FlavorsAccessTestJSON-6182965 tempest-FlavorsAccessTestJSON-6182965-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/1802952456" status: 202 len: 0 microversion: 2.1 time: 0.126381 Sep 23 04:31:07.446786 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 31/91] 10.222.0.33 () {58 vars in 1161 bytes} [Fri Sep 23 04:31:07 2022] DELETE /compute/v2.1/flavors/1802952456 => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:31:07.454851 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7140daf3-71a9-4b4c-905a-cf47aefeb097 tempest-FlavorsAccessTestJSON-6182965 tempest-FlavorsAccessTestJSON-6182965-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:07.465656 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-be9fdf4c-d08d-4b36-82dd-b64e76fc53df tempest-HypervisorAdminTestJSON-406406439 tempest-HypervisorAdminTestJSON-406406439-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:07.466469 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-be9fdf4c-d08d-4b36-82dd-b64e76fc53df tempest-HypervisorAdminTestJSON-406406439 tempest-HypervisorAdminTestJSON-406406439-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:07.467425 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-be9fdf4c-d08d-4b36-82dd-b64e76fc53df tempest-HypervisorAdminTestJSON-406406439 tempest-HypervisorAdminTestJSON-406406439-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:07.478952 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-be9fdf4c-d08d-4b36-82dd-b64e76fc53df tempest-HypervisorAdminTestJSON-406406439 tempest-HypervisorAdminTestJSON-406406439-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.071416 Sep 23 04:31:07.491297 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 61/92] 10.222.0.33 () {58 vars in 1152 bytes} [Fri Sep 23 04:31:07 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:31:07.497550 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-966ad9f9-7220-4df8-b9af-6a67f889b62c tempest-HypervisorAdminTestJSON-406406439 tempest-HypervisorAdminTestJSON-406406439-project-admin] Calling method '.version_select at 0x7ff1c07de430>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:07.507568 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-7140daf3-71a9-4b4c-905a-cf47aefeb097 tempest-FlavorsAccessTestJSON-6182965 tempest-FlavorsAccessTestJSON-6182965-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.047043 Sep 23 04:31:07.508238 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 32/93] 10.222.0.33 () {58 vars in 1146 bytes} [Fri Sep 23 04:31:07 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:31:07.512483 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-966ad9f9-7220-4df8-b9af-6a67f889b62c tempest-HypervisorAdminTestJSON-406406439 tempest-HypervisorAdminTestJSON-406406439-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:07.518373 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-966ad9f9-7220-4df8-b9af-6a67f889b62c tempest-HypervisorAdminTestJSON-406406439 tempest-HypervisorAdminTestJSON-406406439-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:07.519016 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-966ad9f9-7220-4df8-b9af-6a67f889b62c tempest-HypervisorAdminTestJSON-406406439 tempest-HypervisorAdminTestJSON-406406439-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:07.547023 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-966ad9f9-7220-4df8-b9af-6a67f889b62c tempest-HypervisorAdminTestJSON-406406439 tempest-HypervisorAdminTestJSON-406406439-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.053589 Sep 23 04:31:07.548378 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 62/94] 10.222.0.33 () {58 vars in 1179 bytes} [Fri Sep 23 04:31:07 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:31:07.563087 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d55ebb35-efeb-49ad-ad17-b33d309a0ac0 tempest-HypervisorAdminTestJSON-406406439 tempest-HypervisorAdminTestJSON-406406439-project-admin] Calling method '.version_select at 0x7ff1c08c5280>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:07.565448 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d55ebb35-efeb-49ad-ad17-b33d309a0ac0 tempest-HypervisorAdminTestJSON-406406439 tempest-HypervisorAdminTestJSON-406406439-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:07.565985 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d55ebb35-efeb-49ad-ad17-b33d309a0ac0 tempest-HypervisorAdminTestJSON-406406439 tempest-HypervisorAdminTestJSON-406406439-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:07.566563 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d55ebb35-efeb-49ad-ad17-b33d309a0ac0 tempest-HypervisorAdminTestJSON-406406439 tempest-HypervisorAdminTestJSON-406406439-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:07.586363 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d55ebb35-efeb-49ad-ad17-b33d309a0ac0 tempest-HypervisorAdminTestJSON-406406439 tempest-HypervisorAdminTestJSON-406406439-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:07.587348 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d55ebb35-efeb-49ad-ad17-b33d309a0ac0 tempest-HypervisorAdminTestJSON-406406439 tempest-HypervisorAdminTestJSON-406406439-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:07.587802 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d55ebb35-efeb-49ad-ad17-b33d309a0ac0 tempest-HypervisorAdminTestJSON-406406439 tempest-HypervisorAdminTestJSON-406406439-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:07.601419 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d55ebb35-efeb-49ad-ad17-b33d309a0ac0 tempest-HypervisorAdminTestJSON-406406439 tempest-HypervisorAdminTestJSON-406406439-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:07.601928 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d55ebb35-efeb-49ad-ad17-b33d309a0ac0 tempest-HypervisorAdminTestJSON-406406439 tempest-HypervisorAdminTestJSON-406406439-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:07.602702 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d55ebb35-efeb-49ad-ad17-b33d309a0ac0 tempest-HypervisorAdminTestJSON-406406439 tempest-HypervisorAdminTestJSON-406406439-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:07.611526 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d55ebb35-efeb-49ad-ad17-b33d309a0ac0 tempest-HypervisorAdminTestJSON-406406439 tempest-HypervisorAdminTestJSON-406406439-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.053999 Sep 23 04:31:07.612146 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 33/95] 10.222.0.33 () {58 vars in 1146 bytes} [Fri Sep 23 04:31:07 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:31:07.624481 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-bcb05282-bae9-4d01-8a53-f422fd6a44dc tempest-HypervisorAdminTestJSON-406406439 tempest-HypervisorAdminTestJSON-406406439-project-admin] Calling method '.version_select at 0x7ff1c078aee0>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:07.637756 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bcb05282-bae9-4d01-8a53-f422fd6a44dc tempest-HypervisorAdminTestJSON-406406439 tempest-HypervisorAdminTestJSON-406406439-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:07.638515 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bcb05282-bae9-4d01-8a53-f422fd6a44dc tempest-HypervisorAdminTestJSON-406406439 tempest-HypervisorAdminTestJSON-406406439-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:07.639030 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bcb05282-bae9-4d01-8a53-f422fd6a44dc tempest-HypervisorAdminTestJSON-406406439 tempest-HypervisorAdminTestJSON-406406439-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:07.699564 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=10,nova_api:INSERT=3 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:31:07.702704 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bcb05282-bae9-4d01-8a53-f422fd6a44dc tempest-HypervisorAdminTestJSON-406406439 tempest-HypervisorAdminTestJSON-406406439-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:07.708883 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bcb05282-bae9-4d01-8a53-f422fd6a44dc tempest-HypervisorAdminTestJSON-406406439 tempest-HypervisorAdminTestJSON-406406439-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:07.709839 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bcb05282-bae9-4d01-8a53-f422fd6a44dc tempest-HypervisorAdminTestJSON-406406439 tempest-HypervisorAdminTestJSON-406406439-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:07.739551 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-bcb05282-bae9-4d01-8a53-f422fd6a44dc tempest-HypervisorAdminTestJSON-406406439 tempest-HypervisorAdminTestJSON-406406439-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.119025 Sep 23 04:31:07.744533 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 63/96] 10.222.0.33 () {58 vars in 1152 bytes} [Fri Sep 23 04:31:07 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:31:07.756815 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e6d290e4-2704-4672-bfa9-776ddda8607b tempest-HypervisorAdminTestJSON-406406439 tempest-HypervisorAdminTestJSON-406406439-project-admin] Calling method '.version_select at 0x7ff1c0895d30>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:07.760503 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e6d290e4-2704-4672-bfa9-776ddda8607b tempest-HypervisorAdminTestJSON-406406439 tempest-HypervisorAdminTestJSON-406406439-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:07.760503 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e6d290e4-2704-4672-bfa9-776ddda8607b tempest-HypervisorAdminTestJSON-406406439 tempest-HypervisorAdminTestJSON-406406439-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:07.760503 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e6d290e4-2704-4672-bfa9-776ddda8607b tempest-HypervisorAdminTestJSON-406406439 tempest-HypervisorAdminTestJSON-406406439-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:07.796087 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e6d290e4-2704-4672-bfa9-776ddda8607b tempest-HypervisorAdminTestJSON-406406439 tempest-HypervisorAdminTestJSON-406406439-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:07.798397 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e6d290e4-2704-4672-bfa9-776ddda8607b tempest-HypervisorAdminTestJSON-406406439 tempest-HypervisorAdminTestJSON-406406439-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:07.798865 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e6d290e4-2704-4672-bfa9-776ddda8607b tempest-HypervisorAdminTestJSON-406406439 tempest-HypervisorAdminTestJSON-406406439-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:07.807502 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e6d290e4-2704-4672-bfa9-776ddda8607b tempest-HypervisorAdminTestJSON-406406439 tempest-HypervisorAdminTestJSON-406406439-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 757 microversion: 2.1 time: 0.055255 Sep 23 04:31:07.808427 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 34/97] 10.222.0.33 () {58 vars in 1152 bytes} [Fri Sep 23 04:31:07 2022] GET /compute/v2.1/os-hypervisors/2 => generated 757 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:31:07.829033 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-90149a06-51eb-4608-a401-1534fb804b34 tempest-HypervisorAdminTestJSON-406406439 tempest-HypervisorAdminTestJSON-406406439-project-admin] Calling method '.version_select at 0x7ff1c0732820>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:07.833861 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-90149a06-51eb-4608-a401-1534fb804b34 tempest-HypervisorAdminTestJSON-406406439 tempest-HypervisorAdminTestJSON-406406439-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:07.834389 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-90149a06-51eb-4608-a401-1534fb804b34 tempest-HypervisorAdminTestJSON-406406439 tempest-HypervisorAdminTestJSON-406406439-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:07.834933 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-90149a06-51eb-4608-a401-1534fb804b34 tempest-HypervisorAdminTestJSON-406406439 tempest-HypervisorAdminTestJSON-406406439-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:07.840873 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-62e609ea-f894-42ef-bf99-2045963ee79b tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:07.842154 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-62e609ea-f894-42ef-bf99-2045963ee79b tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] [instance: e18459f8-cd71-4feb-8764-c3b4cc3d89be] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:07.852471 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-62e609ea-f894-42ef-bf99-2045963ee79b tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:07.855312 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=100 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:31:07.870154 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-62e609ea-f894-42ef-bf99-2045963ee79b tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:07.872922 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-62e609ea-f894-42ef-bf99-2045963ee79b tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:07.877343 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-62e609ea-f894-42ef-bf99-2045963ee79b tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:07.880948 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-62e609ea-f894-42ef-bf99-2045963ee79b tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:07.881408 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-90149a06-51eb-4608-a401-1534fb804b34 tempest-HypervisorAdminTestJSON-406406439 tempest-HypervisorAdminTestJSON-406406439-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:07.882124 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-62e609ea-f894-42ef-bf99-2045963ee79b tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:07.882325 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-90149a06-51eb-4608-a401-1534fb804b34 tempest-HypervisorAdminTestJSON-406406439 tempest-HypervisorAdminTestJSON-406406439-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:07.882939 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-90149a06-51eb-4608-a401-1534fb804b34 tempest-HypervisorAdminTestJSON-406406439 tempest-HypervisorAdminTestJSON-406406439-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:07.914419 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-90149a06-51eb-4608-a401-1534fb804b34 tempest-HypervisorAdminTestJSON-406406439 tempest-HypervisorAdminTestJSON-406406439-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:07.918035 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-90149a06-51eb-4608-a401-1534fb804b34 tempest-HypervisorAdminTestJSON-406406439 tempest-HypervisorAdminTestJSON-406406439-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:07.919491 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-90149a06-51eb-4608-a401-1534fb804b34 tempest-HypervisorAdminTestJSON-406406439 tempest-HypervisorAdminTestJSON-406406439-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:07.974512 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-90149a06-51eb-4608-a401-1534fb804b34 tempest-HypervisorAdminTestJSON-406406439 tempest-HypervisorAdminTestJSON-406406439-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.152033 Sep 23 04:31:07.976333 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 64/98] 10.222.0.33 () {58 vars in 1173 bytes} [Fri Sep 23 04:31:07 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:31:08.345448 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-501d7879-77c8-44bc-b9b0-98b36c82c93b tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:08.346248 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-501d7879-77c8-44bc-b9b0-98b36c82c93b tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] [instance: 43aee7fc-54b8-4499-998b-92054bfd82b4] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:08.376365 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-501d7879-77c8-44bc-b9b0-98b36c82c93b tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:08.376865 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-501d7879-77c8-44bc-b9b0-98b36c82c93b tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:08.377304 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-501d7879-77c8-44bc-b9b0-98b36c82c93b tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:08.378076 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-501d7879-77c8-44bc-b9b0-98b36c82c93b tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:08.378551 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-501d7879-77c8-44bc-b9b0-98b36c82c93b tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:08.379021 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-501d7879-77c8-44bc-b9b0-98b36c82c93b tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:08.391672 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=8 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:31:09.604980 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-62e609ea-f894-42ef-bf99-2045963ee79b tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac39d27bcf5d4def9ff9bd5b81bd7b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79442cd4a69040f594e19b3492df7e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:09.626587 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-62e609ea-f894-42ef-bf99-2045963ee79b tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] 10.222.0.33 "GET /compute/v2.1/servers/e18459f8-cd71-4feb-8764-c3b4cc3d89be" status: 200 len: 1340 microversion: 2.1 time: 1.789670 Sep 23 04:31:09.630512 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 35/99] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:31:07 2022] GET /compute/v2.1/servers/e18459f8-cd71-4feb-8764-c3b4cc3d89be => generated 1340 bytes in 1795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:31:09.728386 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-501d7879-77c8-44bc-b9b0-98b36c82c93b tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82ee10291f2c4914b348a82e51b9c967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a161d95e4c44433ba5af6b941190fa24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:09.737862 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-501d7879-77c8-44bc-b9b0-98b36c82c93b tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] 10.222.0.33 "GET /compute/v2.1/servers/43aee7fc-54b8-4499-998b-92054bfd82b4" status: 200 len: 1336 microversion: 2.1 time: 1.396753 Sep 23 04:31:09.739195 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 65/100] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:31:08 2022] GET /compute/v2.1/servers/43aee7fc-54b8-4499-998b-92054bfd82b4 => generated 1336 bytes in 1399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:31:10.051465 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-a994a87c-eed6-4b2a-9042-f712560b15e1 req-b1f68ea7-5d0a-4db3-8cad-c9a5b59b54e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43aee7fc-54b8-4499-998b-92054bfd82b4", "tag": "d45ea1b3-0a7f-4ca6-9abe-cea1df49fdd7"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:31:10.067634 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-a994a87c-eed6-4b2a-9042-f712560b15e1 req-b1f68ea7-5d0a-4db3-8cad-c9a5b59b54e0 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:10.068127 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-a994a87c-eed6-4b2a-9042-f712560b15e1 req-b1f68ea7-5d0a-4db3-8cad-c9a5b59b54e0 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:10.069118 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-a994a87c-eed6-4b2a-9042-f712560b15e1 req-b1f68ea7-5d0a-4db3-8cad-c9a5b59b54e0 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:10.092343 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-a994a87c-eed6-4b2a-9042-f712560b15e1 req-b1f68ea7-5d0a-4db3-8cad-c9a5b59b54e0 service nova] Creating event network-changed:d45ea1b3-0a7f-4ca6-9abe-cea1df49fdd7 for instance 43aee7fc-54b8-4499-998b-92054bfd82b4 on n-h2-846463-3 Sep 23 04:31:10.092944 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-a994a87c-eed6-4b2a-9042-f712560b15e1 req-b1f68ea7-5d0a-4db3-8cad-c9a5b59b54e0 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=122699) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 23 04:31:10.093440 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-a994a87c-eed6-4b2a-9042-f712560b15e1 req-b1f68ea7-5d0a-4db3-8cad-c9a5b59b54e0 service nova] Acquired lock "compute-rpcapi-router" {{(pid=122699) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 23 04:31:10.094640 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a89eab90-753f-4c9a-9f5e-a09784571abf None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:10.095104 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a89eab90-753f-4c9a-9f5e-a09784571abf None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:10.095535 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a89eab90-753f-4c9a-9f5e-a09784571abf None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:10.096290 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a89eab90-753f-4c9a-9f5e-a09784571abf None None] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:10.096744 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a89eab90-753f-4c9a-9f5e-a09784571abf None None] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:10.097329 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a89eab90-753f-4c9a-9f5e-a09784571abf None None] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:10.110165 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.compute.rpcapi [None req-a89eab90-753f-4c9a-9f5e-a09784571abf None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 23 04:31:10.111563 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a89eab90-753f-4c9a-9f5e-a09784571abf None None] Releasing lock "compute-rpcapi-router" {{(pid=122699) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 23 04:31:10.131576 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a89eab90-753f-4c9a-9f5e-a09784571abf None None] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.214806 Sep 23 04:31:10.132684 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 36/101] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:31:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:31:10.652579 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3d9da8a7-6c5d-4e70-bd48-f4c6e9e73207 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:10.653258 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3d9da8a7-6c5d-4e70-bd48-f4c6e9e73207 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] [instance: e18459f8-cd71-4feb-8764-c3b4cc3d89be] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:10.666288 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3d9da8a7-6c5d-4e70-bd48-f4c6e9e73207 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:10.668009 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3d9da8a7-6c5d-4e70-bd48-f4c6e9e73207 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:10.669329 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3d9da8a7-6c5d-4e70-bd48-f4c6e9e73207 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:10.673088 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3d9da8a7-6c5d-4e70-bd48-f4c6e9e73207 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:10.674457 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3d9da8a7-6c5d-4e70-bd48-f4c6e9e73207 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:10.675228 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3d9da8a7-6c5d-4e70-bd48-f4c6e9e73207 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:10.763991 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ff8f5420-cd71-4a51-a0bb-f6d38b4166d5 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:10.764756 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ff8f5420-cd71-4a51-a0bb-f6d38b4166d5 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] [instance: 43aee7fc-54b8-4499-998b-92054bfd82b4] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:10.776133 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ff8f5420-cd71-4a51-a0bb-f6d38b4166d5 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:10.780966 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ff8f5420-cd71-4a51-a0bb-f6d38b4166d5 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:10.780966 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ff8f5420-cd71-4a51-a0bb-f6d38b4166d5 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:10.780966 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ff8f5420-cd71-4a51-a0bb-f6d38b4166d5 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:10.781524 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ff8f5420-cd71-4a51-a0bb-f6d38b4166d5 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:10.782745 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ff8f5420-cd71-4a51-a0bb-f6d38b4166d5 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:10.835790 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=100 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:31:11.565760 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-3d9da8a7-6c5d-4e70-bd48-f4c6e9e73207 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac39d27bcf5d4def9ff9bd5b81bd7b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79442cd4a69040f594e19b3492df7e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:11.577354 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3d9da8a7-6c5d-4e70-bd48-f4c6e9e73207 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] 10.222.0.33 "GET /compute/v2.1/servers/e18459f8-cd71-4feb-8764-c3b4cc3d89be" status: 200 len: 1340 microversion: 2.1 time: 0.926244 Sep 23 04:31:11.578367 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 66/102] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:31:10 2022] GET /compute/v2.1/servers/e18459f8-cd71-4feb-8764-c3b4cc3d89be => generated 1340 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:31:11.713680 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ff8f5420-cd71-4a51-a0bb-f6d38b4166d5 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82ee10291f2c4914b348a82e51b9c967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a161d95e4c44433ba5af6b941190fa24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:11.728908 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ff8f5420-cd71-4a51-a0bb-f6d38b4166d5 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] 10.222.0.33 "GET /compute/v2.1/servers/43aee7fc-54b8-4499-998b-92054bfd82b4" status: 200 len: 1336 microversion: 2.1 time: 0.969491 Sep 23 04:31:11.735603 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 37/103] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:31:10 2022] GET /compute/v2.1/servers/43aee7fc-54b8-4499-998b-92054bfd82b4 => generated 1336 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:31:12.607004 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4a8b3926-d05a-411b-9e7f-49772d0de3c2 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:12.608112 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4a8b3926-d05a-411b-9e7f-49772d0de3c2 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] [instance: e18459f8-cd71-4feb-8764-c3b4cc3d89be] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:12.616818 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4a8b3926-d05a-411b-9e7f-49772d0de3c2 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:12.617465 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4a8b3926-d05a-411b-9e7f-49772d0de3c2 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:12.617785 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4a8b3926-d05a-411b-9e7f-49772d0de3c2 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:12.618587 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4a8b3926-d05a-411b-9e7f-49772d0de3c2 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:12.619137 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4a8b3926-d05a-411b-9e7f-49772d0de3c2 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:12.619578 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4a8b3926-d05a-411b-9e7f-49772d0de3c2 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:12.767145 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3d8d2c93-e530-4bf5-a4f9-4bd650344357 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:12.767145 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-3d8d2c93-e530-4bf5-a4f9-4bd650344357 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] [instance: 43aee7fc-54b8-4499-998b-92054bfd82b4] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:12.793475 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3d8d2c93-e530-4bf5-a4f9-4bd650344357 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:12.794337 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3d8d2c93-e530-4bf5-a4f9-4bd650344357 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:12.794836 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3d8d2c93-e530-4bf5-a4f9-4bd650344357 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:12.796005 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3d8d2c93-e530-4bf5-a4f9-4bd650344357 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:12.796489 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3d8d2c93-e530-4bf5-a4f9-4bd650344357 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:12.797241 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3d8d2c93-e530-4bf5-a4f9-4bd650344357 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:12.799054 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4a8b3926-d05a-411b-9e7f-49772d0de3c2 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac39d27bcf5d4def9ff9bd5b81bd7b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79442cd4a69040f594e19b3492df7e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:12.811812 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4a8b3926-d05a-411b-9e7f-49772d0de3c2 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] 10.222.0.33 "GET /compute/v2.1/servers/e18459f8-cd71-4feb-8764-c3b4cc3d89be" status: 200 len: 1340 microversion: 2.1 time: 0.209004 Sep 23 04:31:12.811812 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 67/104] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:31:12 2022] GET /compute/v2.1/servers/e18459f8-cd71-4feb-8764-c3b4cc3d89be => generated 1340 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:31:12.950821 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-3d8d2c93-e530-4bf5-a4f9-4bd650344357 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82ee10291f2c4914b348a82e51b9c967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a161d95e4c44433ba5af6b941190fa24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:12.958866 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3d8d2c93-e530-4bf5-a4f9-4bd650344357 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] 10.222.0.33 "GET /compute/v2.1/servers/43aee7fc-54b8-4499-998b-92054bfd82b4" status: 200 len: 1336 microversion: 2.1 time: 0.200247 Sep 23 04:31:12.959462 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 38/105] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:31:12 2022] GET /compute/v2.1/servers/43aee7fc-54b8-4499-998b-92054bfd82b4 => generated 1336 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:31:13.833509 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9dfe6247-7c4f-4594-afc0-5fa5353c3c71 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:13.835608 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-9dfe6247-7c4f-4594-afc0-5fa5353c3c71 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] [instance: e18459f8-cd71-4feb-8764-c3b4cc3d89be] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:13.848563 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9dfe6247-7c4f-4594-afc0-5fa5353c3c71 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:13.848563 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9dfe6247-7c4f-4594-afc0-5fa5353c3c71 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:13.848804 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9dfe6247-7c4f-4594-afc0-5fa5353c3c71 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:13.849524 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9dfe6247-7c4f-4594-afc0-5fa5353c3c71 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:13.850021 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9dfe6247-7c4f-4594-afc0-5fa5353c3c71 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:13.850456 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9dfe6247-7c4f-4594-afc0-5fa5353c3c71 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:13.983784 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5c7d093c-5c3b-49e5-908d-d8d3abf4e1c8 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:13.985180 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-5c7d093c-5c3b-49e5-908d-d8d3abf4e1c8 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] [instance: 43aee7fc-54b8-4499-998b-92054bfd82b4] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:13.996413 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:31:14.001346 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5c7d093c-5c3b-49e5-908d-d8d3abf4e1c8 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:14.002595 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5c7d093c-5c3b-49e5-908d-d8d3abf4e1c8 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:14.004063 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5c7d093c-5c3b-49e5-908d-d8d3abf4e1c8 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:14.006772 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5c7d093c-5c3b-49e5-908d-d8d3abf4e1c8 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:14.007778 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5c7d093c-5c3b-49e5-908d-d8d3abf4e1c8 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:14.008698 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5c7d093c-5c3b-49e5-908d-d8d3abf4e1c8 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:14.174689 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-9dfe6247-7c4f-4594-afc0-5fa5353c3c71 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac39d27bcf5d4def9ff9bd5b81bd7b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79442cd4a69040f594e19b3492df7e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:14.187966 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9dfe6247-7c4f-4594-afc0-5fa5353c3c71 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] 10.222.0.33 "GET /compute/v2.1/servers/e18459f8-cd71-4feb-8764-c3b4cc3d89be" status: 200 len: 1340 microversion: 2.1 time: 0.358776 Sep 23 04:31:14.190582 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 68/106] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:31:13 2022] GET /compute/v2.1/servers/e18459f8-cd71-4feb-8764-c3b4cc3d89be => generated 1340 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:31:14.313313 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-5c7d093c-5c3b-49e5-908d-d8d3abf4e1c8 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82ee10291f2c4914b348a82e51b9c967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a161d95e4c44433ba5af6b941190fa24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:14.323490 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5c7d093c-5c3b-49e5-908d-d8d3abf4e1c8 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] 10.222.0.33 "GET /compute/v2.1/servers/43aee7fc-54b8-4499-998b-92054bfd82b4" status: 200 len: 1336 microversion: 2.1 time: 0.345174 Sep 23 04:31:14.334076 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 39/107] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:31:13 2022] GET /compute/v2.1/servers/43aee7fc-54b8-4499-998b-92054bfd82b4 => generated 1336 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:31:14.816827 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-590209d7-acbf-4b1f-aaf8-7b4d4d89e18a tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:14.825506 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-590209d7-acbf-4b1f-aaf8-7b4d4d89e18a tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.573947 Sep 23 04:31:14.843339 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 69/108] 10.222.0.33 () {58 vars in 1137 bytes} [Fri Sep 23 04:31:14 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:31:15.214655 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1eaa1d6a-6d4a-4e78-932d-4efce272830b tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:15.223107 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-1eaa1d6a-6d4a-4e78-932d-4efce272830b tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] [instance: e18459f8-cd71-4feb-8764-c3b4cc3d89be] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:15.225996 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1eaa1d6a-6d4a-4e78-932d-4efce272830b tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:15.230447 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1eaa1d6a-6d4a-4e78-932d-4efce272830b tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:15.231092 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1eaa1d6a-6d4a-4e78-932d-4efce272830b tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:15.232003 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1eaa1d6a-6d4a-4e78-932d-4efce272830b tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:15.232807 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1eaa1d6a-6d4a-4e78-932d-4efce272830b tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:15.234422 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1eaa1d6a-6d4a-4e78-932d-4efce272830b tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:15.410197 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5afc1d1c-8627-49d4-bcba-d32c1aa0aef3 tempest-ServersWithSpecificFlavorTestJSON-390767506 tempest-ServersWithSpecificFlavorTestJSON-390767506-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-1399216722", "id": 1110633300, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:31:15.527147 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5afc1d1c-8627-49d4-bcba-d32c1aa0aef3 tempest-ServersWithSpecificFlavorTestJSON-390767506 tempest-ServersWithSpecificFlavorTestJSON-390767506-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.688374 Sep 23 04:31:15.538065 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 40/109] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:31:14 2022] POST /compute/v2.1/flavors => generated 425 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:31:15.538065 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-004d785d-8683-4c9a-ae54-e3a5a3af0a78 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:15.538065 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-004d785d-8683-4c9a-ae54-e3a5a3af0a78 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] [instance: 43aee7fc-54b8-4499-998b-92054bfd82b4] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:15.569605 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-004d785d-8683-4c9a-ae54-e3a5a3af0a78 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:15.570248 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-004d785d-8683-4c9a-ae54-e3a5a3af0a78 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:15.570699 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-004d785d-8683-4c9a-ae54-e3a5a3af0a78 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:15.573396 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-004d785d-8683-4c9a-ae54-e3a5a3af0a78 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:15.573396 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-004d785d-8683-4c9a-ae54-e3a5a3af0a78 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:15.573624 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-004d785d-8683-4c9a-ae54-e3a5a3af0a78 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:15.756585 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-1eaa1d6a-6d4a-4e78-932d-4efce272830b tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac39d27bcf5d4def9ff9bd5b81bd7b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79442cd4a69040f594e19b3492df7e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:15.764379 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-1eaa1d6a-6d4a-4e78-932d-4efce272830b tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] 10.222.0.33 "GET /compute/v2.1/servers/e18459f8-cd71-4feb-8764-c3b4cc3d89be" status: 200 len: 1340 microversion: 2.1 time: 0.555000 Sep 23 04:31:15.764964 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 70/110] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:31:15 2022] GET /compute/v2.1/servers/e18459f8-cd71-4feb-8764-c3b4cc3d89be => generated 1340 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:31:15.784361 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ec437303-d70e-4227-ad20-3677024b58fc tempest-ServersWithSpecificFlavorTestJSON-390767506 tempest-ServersWithSpecificFlavorTestJSON-390767506-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:15.792674 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ec437303-d70e-4227-ad20-3677024b58fc tempest-ServersWithSpecificFlavorTestJSON-390767506 tempest-ServersWithSpecificFlavorTestJSON-390767506-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.013563 Sep 23 04:31:15.793385 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 71/111] 10.222.0.33 () {58 vars in 1182 bytes} [Fri Sep 23 04:31:15 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 04:31:15.810957 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f3d5d325-dd9d-4843-a017-93390fa0cd67 tempest-ServersWithSpecificFlavorTestJSON-390767506 tempest-ServersWithSpecificFlavorTestJSON-390767506-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-448784599", "id": 320083998, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:31:15.917070 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f3d5d325-dd9d-4843-a017-93390fa0cd67 tempest-ServersWithSpecificFlavorTestJSON-390767506 tempest-ServersWithSpecificFlavorTestJSON-390767506-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 421 microversion: 2.1 time: 0.117784 Sep 23 04:31:15.922504 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 72/112] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:31:15 2022] POST /compute/v2.1/flavors => generated 421 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:31:15.934861 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2913a713-aca2-4d2d-aed9-0cb15c9aadce tempest-ServersWithSpecificFlavorTestJSON-390767506 tempest-ServersWithSpecificFlavorTestJSON-390767506-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:15.948982 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2913a713-aca2-4d2d-aed9-0cb15c9aadce tempest-ServersWithSpecificFlavorTestJSON-390767506 tempest-ServersWithSpecificFlavorTestJSON-390767506-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.017787 Sep 23 04:31:15.954728 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 73/113] 10.222.0.33 () {58 vars in 1182 bytes} [Fri Sep 23 04:31:15 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 23 04:31:15.969878 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-94bf89c3-0912-4bac-a67d-00605cc02e4d tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Action: 'create', calling method: .version_select at 0x7ff1c07b28b0>, body: {"keypair": {"name": "tempest-keypair-587713181", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFfJf7vh/Za8oo428LYmaY4rBZE465Euz43twX1dAuZMTX8kdIN6FVBuVHHiVGGJFaHFi9htalrdTorzi+WRLOSa0ebJQIwsrfLLVe5WerHJeRUUx1oORHSju3sUsY0MBw=="}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:31:15.982822 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-004d785d-8683-4c9a-ae54-e3a5a3af0a78 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82ee10291f2c4914b348a82e51b9c967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a161d95e4c44433ba5af6b941190fa24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:15.992134 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-004d785d-8683-4c9a-ae54-e3a5a3af0a78 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] 10.222.0.33 "GET /compute/v2.1/servers/43aee7fc-54b8-4499-998b-92054bfd82b4" status: 200 len: 1336 microversion: 2.1 time: 0.463049 Sep 23 04:31:16.009056 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 41/114] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:31:15 2022] GET /compute/v2.1/servers/43aee7fc-54b8-4499-998b-92054bfd82b4 => generated 1336 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:31:16.051894 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-94bf89c3-0912-4bac-a67d-00605cc02e4d tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Getting quotas for project 98c7c21aa6b342b6bc52365cfdeb7c7b. Resources: {'key_pairs'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:31:16.065344 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-94bf89c3-0912-4bac-a67d-00605cc02e4d tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Getting quotas for user ffcc413bf53847b89cfe6bdf48909ea0 and project 98c7c21aa6b342b6bc52365cfdeb7c7b. Resources: {'key_pairs'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:31:16.196267 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-94bf89c3-0912-4bac-a67d-00605cc02e4d tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.233199 Sep 23 04:31:16.201156 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 74/115] 10.222.0.33 () {60 vars in 1159 bytes} [Fri Sep 23 04:31:15 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:31:16.793680 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4b90c8bd-7e33-473f-8791-b256c54a9e85 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:16.794365 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4b90c8bd-7e33-473f-8791-b256c54a9e85 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] [instance: e18459f8-cd71-4feb-8764-c3b4cc3d89be] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:16.814043 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4b90c8bd-7e33-473f-8791-b256c54a9e85 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:16.814043 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4b90c8bd-7e33-473f-8791-b256c54a9e85 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:16.814043 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4b90c8bd-7e33-473f-8791-b256c54a9e85 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:16.814043 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4b90c8bd-7e33-473f-8791-b256c54a9e85 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:16.815113 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4b90c8bd-7e33-473f-8791-b256c54a9e85 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:16.815767 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4b90c8bd-7e33-473f-8791-b256c54a9e85 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:17.171084 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4b90c8bd-7e33-473f-8791-b256c54a9e85 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac39d27bcf5d4def9ff9bd5b81bd7b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79442cd4a69040f594e19b3492df7e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:17.185566 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4b90c8bd-7e33-473f-8791-b256c54a9e85 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] 10.222.0.33 "GET /compute/v2.1/servers/e18459f8-cd71-4feb-8764-c3b4cc3d89be" status: 200 len: 1340 microversion: 2.1 time: 0.397402 Sep 23 04:31:17.187142 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 75/116] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:31:16 2022] GET /compute/v2.1/servers/e18459f8-cd71-4feb-8764-c3b4cc3d89be => generated 1340 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:31:17.206213 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3a331193-5869-4252-bafc-f6f361c3fdbd tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:17.206734 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3a331193-5869-4252-bafc-f6f361c3fdbd tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] [instance: 43aee7fc-54b8-4499-998b-92054bfd82b4] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:17.216141 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3a331193-5869-4252-bafc-f6f361c3fdbd tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:17.216631 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3a331193-5869-4252-bafc-f6f361c3fdbd tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:17.217073 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3a331193-5869-4252-bafc-f6f361c3fdbd tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:17.219862 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3a331193-5869-4252-bafc-f6f361c3fdbd tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:17.220339 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3a331193-5869-4252-bafc-f6f361c3fdbd tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:17.222658 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3a331193-5869-4252-bafc-f6f361c3fdbd tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:17.300476 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-94497614-d47a-4553-9352-aedf0078f360 tempest-SecurityGroupsTestAdminJSON-523114485 tempest-SecurityGroupsTestAdminJSON-523114485-project] Action: 'create', calling method: .version_select at 0x7ff1c0828d30>, body: {"security_group": {"name": "tempest-securitygroup-1013514974", "description": "tempest-description-1993129048"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:31:17.775223 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-3a331193-5869-4252-bafc-f6f361c3fdbd tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82ee10291f2c4914b348a82e51b9c967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a161d95e4c44433ba5af6b941190fa24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:17.783320 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3a331193-5869-4252-bafc-f6f361c3fdbd tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] 10.222.0.33 "GET /compute/v2.1/servers/43aee7fc-54b8-4499-998b-92054bfd82b4" status: 200 len: 1336 microversion: 2.1 time: 0.592386 Sep 23 04:31:17.783926 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 76/117] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:31:17 2022] GET /compute/v2.1/servers/43aee7fc-54b8-4499-998b-92054bfd82b4 => generated 1336 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:31:18.214433 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-43b9d1f1-cb8a-44d5-bff4-ceed675f943b tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:18.215984 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-43b9d1f1-cb8a-44d5-bff4-ceed675f943b tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] [instance: e18459f8-cd71-4feb-8764-c3b4cc3d89be] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:18.225384 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-43b9d1f1-cb8a-44d5-bff4-ceed675f943b tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:18.226462 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-43b9d1f1-cb8a-44d5-bff4-ceed675f943b tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:18.227243 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-43b9d1f1-cb8a-44d5-bff4-ceed675f943b tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:18.228507 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-43b9d1f1-cb8a-44d5-bff4-ceed675f943b tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:18.229381 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-43b9d1f1-cb8a-44d5-bff4-ceed675f943b tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:18.230213 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-43b9d1f1-cb8a-44d5-bff4-ceed675f943b tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:18.425138 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-94497614-d47a-4553-9352-aedf0078f360 tempest-SecurityGroupsTestAdminJSON-523114485 tempest-SecurityGroupsTestAdminJSON-523114485-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 1.659458 Sep 23 04:31:18.426175 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 42/118] 10.222.0.33 () {60 vars in 1180 bytes} [Fri Sep 23 04:31:16 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 1661 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:31:18.438578 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3693eb73-5491-4b91-b069-bbe746d39860 tempest-SecurityGroupsTestAdminJSON-523114485 tempest-SecurityGroupsTestAdminJSON-523114485-project] Action: 'create', calling method: .version_select at 0x7ff1c0828af0>, body: {"security_group": {"name": "tempest-securitygroup-1454516695", "description": "tempest-description-1095200323"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:31:18.715919 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-43b9d1f1-cb8a-44d5-bff4-ceed675f943b tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac39d27bcf5d4def9ff9bd5b81bd7b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79442cd4a69040f594e19b3492df7e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:18.733617 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-43b9d1f1-cb8a-44d5-bff4-ceed675f943b tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] 10.222.0.33 "GET /compute/v2.1/servers/e18459f8-cd71-4feb-8764-c3b4cc3d89be" status: 200 len: 1340 microversion: 2.1 time: 0.516525 Sep 23 04:31:18.733617 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 77/119] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:31:18 2022] GET /compute/v2.1/servers/e18459f8-cd71-4feb-8764-c3b4cc3d89be => generated 1340 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:31:18.824281 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2104c4f6-7134-4749-b9fc-aeedce13cc48 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:18.824911 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-2104c4f6-7134-4749-b9fc-aeedce13cc48 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] [instance: 43aee7fc-54b8-4499-998b-92054bfd82b4] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:18.831298 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2104c4f6-7134-4749-b9fc-aeedce13cc48 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:18.831958 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2104c4f6-7134-4749-b9fc-aeedce13cc48 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:18.832952 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2104c4f6-7134-4749-b9fc-aeedce13cc48 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:18.833667 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2104c4f6-7134-4749-b9fc-aeedce13cc48 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:18.834152 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2104c4f6-7134-4749-b9fc-aeedce13cc48 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:18.834909 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2104c4f6-7134-4749-b9fc-aeedce13cc48 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:19.039554 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-2104c4f6-7134-4749-b9fc-aeedce13cc48 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82ee10291f2c4914b348a82e51b9c967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a161d95e4c44433ba5af6b941190fa24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:19.052568 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2104c4f6-7134-4749-b9fc-aeedce13cc48 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] 10.222.0.33 "GET /compute/v2.1/servers/43aee7fc-54b8-4499-998b-92054bfd82b4" status: 200 len: 1336 microversion: 2.1 time: 0.245094 Sep 23 04:31:19.053475 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 78/120] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:31:18 2022] GET /compute/v2.1/servers/43aee7fc-54b8-4499-998b-92054bfd82b4 => generated 1336 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:31:19.167973 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3693eb73-5491-4b91-b069-bbe746d39860 tempest-SecurityGroupsTestAdminJSON-523114485 tempest-SecurityGroupsTestAdminJSON-523114485-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.732991 Sep 23 04:31:19.168781 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 43/121] 10.222.0.33 () {60 vars in 1180 bytes} [Fri Sep 23 04:31:18 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:31:19.673060 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d815e4ac-2ada-4ed0-a7f8-917afa4e38d6 tempest-SecurityGroupsTestAdminJSON-1737441997 tempest-SecurityGroupsTestAdminJSON-1737441997-project-admin] Action: 'create', calling method: .version_select at 0x7ff1c064b5e0>, body: {"security_group": {"name": "tempest-securitygroup-1533061662", "description": "tempest-description-857755483"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:31:19.892049 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-64706b09-0b74-4a4b-aa05-1e5e029aeab4 tempest-HypervisorAdminV228Test-404728833 tempest-HypervisorAdminV228Test-404728833-project-admin] Calling method '.version_select at 0x7ff1c08280d0>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:19.894340 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-64706b09-0b74-4a4b-aa05-1e5e029aeab4 tempest-HypervisorAdminV228Test-404728833 tempest-HypervisorAdminV228Test-404728833-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:19.895221 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-64706b09-0b74-4a4b-aa05-1e5e029aeab4 tempest-HypervisorAdminV228Test-404728833 tempest-HypervisorAdminV228Test-404728833-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:19.895785 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-64706b09-0b74-4a4b-aa05-1e5e029aeab4 tempest-HypervisorAdminV228Test-404728833 tempest-HypervisorAdminV228Test-404728833-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:19.922504 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-64706b09-0b74-4a4b-aa05-1e5e029aeab4 tempest-HypervisorAdminV228Test-404728833 tempest-HypervisorAdminV228Test-404728833-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:19.923290 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-64706b09-0b74-4a4b-aa05-1e5e029aeab4 tempest-HypervisorAdminV228Test-404728833 tempest-HypervisorAdminV228Test-404728833-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:19.924057 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-64706b09-0b74-4a4b-aa05-1e5e029aeab4 tempest-HypervisorAdminV228Test-404728833 tempest-HypervisorAdminV228Test-404728833-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:19.938287 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-64706b09-0b74-4a4b-aa05-1e5e029aeab4 tempest-HypervisorAdminV228Test-404728833 tempest-HypervisorAdminV228Test-404728833-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:19.939038 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-64706b09-0b74-4a4b-aa05-1e5e029aeab4 tempest-HypervisorAdminV228Test-404728833 tempest-HypervisorAdminV228Test-404728833-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:19.939689 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-64706b09-0b74-4a4b-aa05-1e5e029aeab4 tempest-HypervisorAdminV228Test-404728833 tempest-HypervisorAdminV228Test-404728833-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:19.947693 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-64706b09-0b74-4a4b-aa05-1e5e029aeab4 tempest-HypervisorAdminV228Test-404728833 tempest-HypervisorAdminV228Test-404728833-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.601619 Sep 23 04:31:19.949092 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 44/122] 10.222.0.33 () {60 vars in 1187 bytes} [Fri Sep 23 04:31:19 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 23 04:31:19.954404 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-09dfb1a4-b9dc-4ef2-8a2c-7097adbd9719 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:19.955026 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-09dfb1a4-b9dc-4ef2-8a2c-7097adbd9719 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] [instance: e18459f8-cd71-4feb-8764-c3b4cc3d89be] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:19.962697 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-09dfb1a4-b9dc-4ef2-8a2c-7097adbd9719 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:19.963891 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-09dfb1a4-b9dc-4ef2-8a2c-7097adbd9719 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:19.965453 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-09dfb1a4-b9dc-4ef2-8a2c-7097adbd9719 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:19.965868 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-09dfb1a4-b9dc-4ef2-8a2c-7097adbd9719 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:19.966562 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-09dfb1a4-b9dc-4ef2-8a2c-7097adbd9719 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:19.967217 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-09dfb1a4-b9dc-4ef2-8a2c-7097adbd9719 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:20.000591 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=3 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:31:20.109090 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:31:20.163877 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-09dfb1a4-b9dc-4ef2-8a2c-7097adbd9719 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac39d27bcf5d4def9ff9bd5b81bd7b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79442cd4a69040f594e19b3492df7e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:20.173762 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-09dfb1a4-b9dc-4ef2-8a2c-7097adbd9719 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] 10.222.0.33 "GET /compute/v2.1/servers/e18459f8-cd71-4feb-8764-c3b4cc3d89be" status: 200 len: 1340 microversion: 2.1 time: 0.223346 Sep 23 04:31:20.174402 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 45/123] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:31:19 2022] GET /compute/v2.1/servers/e18459f8-cd71-4feb-8764-c3b4cc3d89be => generated 1340 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:31:20.181239 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5f407c97-bb4b-4239-a0b7-17dc3efd0b65 tempest-HypervisorAdminV228Test-404728833 tempest-HypervisorAdminV228Test-404728833-project-admin] Calling method '.version_select at 0x7ff1c08c5280>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:20.183190 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5f407c97-bb4b-4239-a0b7-17dc3efd0b65 tempest-HypervisorAdminV228Test-404728833 tempest-HypervisorAdminV228Test-404728833-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:20.183908 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5f407c97-bb4b-4239-a0b7-17dc3efd0b65 tempest-HypervisorAdminV228Test-404728833 tempest-HypervisorAdminV228Test-404728833-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:20.184360 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5f407c97-bb4b-4239-a0b7-17dc3efd0b65 tempest-HypervisorAdminV228Test-404728833 tempest-HypervisorAdminV228Test-404728833-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:20.198646 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5f407c97-bb4b-4239-a0b7-17dc3efd0b65 tempest-HypervisorAdminV228Test-404728833 tempest-HypervisorAdminV228Test-404728833-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:20.199143 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5f407c97-bb4b-4239-a0b7-17dc3efd0b65 tempest-HypervisorAdminV228Test-404728833 tempest-HypervisorAdminV228Test-404728833-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:20.199606 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5f407c97-bb4b-4239-a0b7-17dc3efd0b65 tempest-HypervisorAdminV228Test-404728833 tempest-HypervisorAdminV228Test-404728833-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:20.206728 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5f407c97-bb4b-4239-a0b7-17dc3efd0b65 tempest-HypervisorAdminV228Test-404728833 tempest-HypervisorAdminV228Test-404728833-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.031222 Sep 23 04:31:20.207369 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 46/124] 10.222.0.33 () {60 vars in 1193 bytes} [Fri Sep 23 04:31:20 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 04:31:20.212873 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e8b31b66-921a-474b-92ba-8bb0c827110e tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1773556359", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "320083998", "adminPass": "***", "networks": [{"uuid": "925b67df-b828-4400-a5a9-c03e0e7996fc"}], "security_groups": [{"name": "tempest-securitygroup--938214951"}], "key_name": "tempest-keypair-587713181", "user_data": "}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:31:20.337711 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.neutron [None req-e8b31b66-921a-474b-92ba-8bb0c827110e tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] validate_networks() for [('925b67df-b828-4400-a5a9-c03e0e7996fc', None, None, None, None, None)] {{(pid=122699) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:31:20.596840 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d815e4ac-2ada-4ed0-a7f8-917afa4e38d6 tempest-SecurityGroupsTestAdminJSON-1737441997 tempest-SecurityGroupsTestAdminJSON-1737441997-project-admin] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.418834 Sep 23 04:31:20.601104 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 79/125] 10.222.0.33 () {60 vars in 1180 bytes} [Fri Sep 23 04:31:19 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:31:20.611412 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-850a1566-9a75-4213-95ad-7b14d20bd983 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:20.612838 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-850a1566-9a75-4213-95ad-7b14d20bd983 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] [instance: 43aee7fc-54b8-4499-998b-92054bfd82b4] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:20.652663 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-850a1566-9a75-4213-95ad-7b14d20bd983 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:20.654185 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-850a1566-9a75-4213-95ad-7b14d20bd983 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:20.657564 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-850a1566-9a75-4213-95ad-7b14d20bd983 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:20.659489 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-850a1566-9a75-4213-95ad-7b14d20bd983 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:20.663549 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-850a1566-9a75-4213-95ad-7b14d20bd983 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:20.664585 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-850a1566-9a75-4213-95ad-7b14d20bd983 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:20.895168 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-850a1566-9a75-4213-95ad-7b14d20bd983 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82ee10291f2c4914b348a82e51b9c967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a161d95e4c44433ba5af6b941190fa24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:20.909607 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-850a1566-9a75-4213-95ad-7b14d20bd983 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] 10.222.0.33 "GET /compute/v2.1/servers/43aee7fc-54b8-4499-998b-92054bfd82b4" status: 200 len: 1336 microversion: 2.1 time: 0.306239 Sep 23 04:31:20.910881 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 80/126] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:31:20 2022] GET /compute/v2.1/servers/43aee7fc-54b8-4499-998b-92054bfd82b4 => generated 1336 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:31:21.203054 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-4cd7bdaa-aeb0-43f7-97b9-3c33ac97fef5 req-c739b459-b89b-4df1-af3c-cfd8fd0a69c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43aee7fc-54b8-4499-998b-92054bfd82b4", "name": "network-vif-plugged", "status": "completed", "tag": "d45ea1b3-0a7f-4ca6-9abe-cea1df49fdd7"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:31:21.213138 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-4cd7bdaa-aeb0-43f7-97b9-3c33ac97fef5 req-c739b459-b89b-4df1-af3c-cfd8fd0a69c6 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:21.213852 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-4cd7bdaa-aeb0-43f7-97b9-3c33ac97fef5 req-c739b459-b89b-4df1-af3c-cfd8fd0a69c6 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:21.214302 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-4cd7bdaa-aeb0-43f7-97b9-3c33ac97fef5 req-c739b459-b89b-4df1-af3c-cfd8fd0a69c6 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:21.229822 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-4cd7bdaa-aeb0-43f7-97b9-3c33ac97fef5 req-c739b459-b89b-4df1-af3c-cfd8fd0a69c6 service nova] Creating event network-vif-plugged:d45ea1b3-0a7f-4ca6-9abe-cea1df49fdd7 for instance 43aee7fc-54b8-4499-998b-92054bfd82b4 on n-h2-846463-3 Sep 23 04:31:21.235445 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-4cd7bdaa-aeb0-43f7-97b9-3c33ac97fef5 req-c739b459-b89b-4df1-af3c-cfd8fd0a69c6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.317556 Sep 23 04:31:21.236129 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 81/127] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:31:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:31:21.241386 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-76bf2e9b-774d-4105-b8e8-bb773a74cc1b tempest-SecurityGroupsTestAdminJSON-1737441997 tempest-SecurityGroupsTestAdminJSON-1737441997-project-admin] Action: 'create', calling method: .version_select at 0x7ff1c064b820>, body: {"security_group": {"name": "tempest-securitygroup-1139238543", "description": "tempest-description-1153416504"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:31:21.469037 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-e8b31b66-921a-474b-92ba-8bb0c827110e tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Flavor limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:31:21.470547 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-e8b31b66-921a-474b-92ba-8bb0c827110e tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Image limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:31:21.471840 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-e8b31b66-921a-474b-92ba-8bb0c827110e tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Flavor pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:31:21.472552 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-e8b31b66-921a-474b-92ba-8bb0c827110e tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Image pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:31:21.473324 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-e8b31b66-921a-474b-92ba-8bb0c827110e tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:31:21.492745 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e8b31b66-921a-474b-92ba-8bb0c827110e tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:21.494198 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e8b31b66-921a-474b-92ba-8bb0c827110e tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:21.494886 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e8b31b66-921a-474b-92ba-8bb0c827110e tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:21.497025 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e8b31b66-921a-474b-92ba-8bb0c827110e tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:21.497718 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e8b31b66-921a-474b-92ba-8bb0c827110e tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:21.498555 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e8b31b66-921a-474b-92ba-8bb0c827110e tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:21.535485 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-e8b31b66-921a-474b-92ba-8bb0c827110e tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Getting quotas for project 98c7c21aa6b342b6bc52365cfdeb7c7b. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:31:21.545507 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-e8b31b66-921a-474b-92ba-8bb0c827110e tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Getting quotas for user ffcc413bf53847b89cfe6bdf48909ea0 and project 98c7c21aa6b342b6bc52365cfdeb7c7b. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:31:21.585964 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e8b31b66-921a-474b-92ba-8bb0c827110e tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Going to run 1 instances... {{(pid=122699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:31:21.588833 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e8b31b66-921a-474b-92ba-8bb0c827110e tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] [instance: 074ac5a1-94af-4e9d-b458-107710ca0972] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:31:21.764526 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e8b31b66-921a-474b-92ba-8bb0c827110e tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.556048 Sep 23 04:31:21.769589 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 47/128] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:31:20 2022] POST /compute/v2.1/servers => generated 401 bytes in 1558 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:31:21.919159 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-76bf2e9b-774d-4105-b8e8-bb773a74cc1b tempest-SecurityGroupsTestAdminJSON-1737441997 tempest-SecurityGroupsTestAdminJSON-1737441997-project-admin] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.681571 Sep 23 04:31:21.920627 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 82/129] 10.222.0.33 () {60 vars in 1180 bytes} [Fri Sep 23 04:31:21 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:31:21.930579 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-83401604-aa95-4aa9-b5be-53b4e5b3710a tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:21.931580 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-83401604-aa95-4aa9-b5be-53b4e5b3710a tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] [instance: e18459f8-cd71-4feb-8764-c3b4cc3d89be] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:21.939264 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-83401604-aa95-4aa9-b5be-53b4e5b3710a tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:21.939946 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-83401604-aa95-4aa9-b5be-53b4e5b3710a tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:21.940994 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-83401604-aa95-4aa9-b5be-53b4e5b3710a tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:21.942418 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-83401604-aa95-4aa9-b5be-53b4e5b3710a tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:21.943034 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-83401604-aa95-4aa9-b5be-53b4e5b3710a tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:21.943817 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-83401604-aa95-4aa9-b5be-53b4e5b3710a tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:21.958998 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4ca14ad3-b09b-43a5-b521-98d4ddfb10d1 tempest-FlavorsAccessNegativeTestJSON-176088663 tempest-FlavorsAccessNegativeTestJSON-176088663-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-86961794", "id": 836464932, "os-flavor-access:is_public": "False"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:31:22.042125 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4ca14ad3-b09b-43a5-b521-98d4ddfb10d1 tempest-FlavorsAccessNegativeTestJSON-176088663 tempest-FlavorsAccessNegativeTestJSON-176088663-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.275238 Sep 23 04:31:22.043171 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 48/130] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:31:21 2022] POST /compute/v2.1/flavors => generated 434 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:31:22.053705 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8288bac3-20f7-460d-b3ec-07f2435a159d tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:22.054927 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-8288bac3-20f7-460d-b3ec-07f2435a159d tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] [instance: 074ac5a1-94af-4e9d-b458-107710ca0972] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:22.153102 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-8288bac3-20f7-460d-b3ec-07f2435a159d tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcc413bf53847b89cfe6bdf48909ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c7c21aa6b342b6bc52365cfdeb7c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:22.187072 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-8288bac3-20f7-460d-b3ec-07f2435a159d tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] 10.222.0.33 "GET /compute/v2.1/servers/074ac5a1-94af-4e9d-b458-107710ca0972" status: 200 len: 1262 microversion: 2.1 time: 0.137149 Sep 23 04:31:22.188475 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 49/131] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:31:22 2022] GET /compute/v2.1/servers/074ac5a1-94af-4e9d-b458-107710ca0972 => generated 1262 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:31:22.196043 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-83401604-aa95-4aa9-b5be-53b4e5b3710a tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac39d27bcf5d4def9ff9bd5b81bd7b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79442cd4a69040f594e19b3492df7e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:22.210463 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-83401604-aa95-4aa9-b5be-53b4e5b3710a tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] 10.222.0.33 "GET /compute/v2.1/servers/e18459f8-cd71-4feb-8764-c3b4cc3d89be" status: 200 len: 1340 microversion: 2.1 time: 0.288553 Sep 23 04:31:22.211379 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 83/132] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:31:21 2022] GET /compute/v2.1/servers/e18459f8-cd71-4feb-8764-c3b4cc3d89be => generated 1340 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:31:22.213537 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e7046645-1763-4259-be2c-abe71f3e6e24 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:22.218072 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e7046645-1763-4259-be2c-abe71f3e6e24 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] [instance: 43aee7fc-54b8-4499-998b-92054bfd82b4] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:22.218944 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-64c606e2-2bad-4952-8093-d192a8d85555 tempest-SecurityGroupsTestAdminJSON-1737441997 tempest-SecurityGroupsTestAdminJSON-1737441997-project-admin] Calling method '.version_select at 0x7ff1c063c160>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:22.237631 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e7046645-1763-4259-be2c-abe71f3e6e24 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:22.239727 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e7046645-1763-4259-be2c-abe71f3e6e24 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:22.245713 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e7046645-1763-4259-be2c-abe71f3e6e24 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:22.245713 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e7046645-1763-4259-be2c-abe71f3e6e24 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:22.245713 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e7046645-1763-4259-be2c-abe71f3e6e24 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:22.245713 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e7046645-1763-4259-be2c-abe71f3e6e24 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:22.453882 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e7046645-1763-4259-be2c-abe71f3e6e24 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82ee10291f2c4914b348a82e51b9c967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a161d95e4c44433ba5af6b941190fa24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:22.463406 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e7046645-1763-4259-be2c-abe71f3e6e24 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] 10.222.0.33 "GET /compute/v2.1/servers/43aee7fc-54b8-4499-998b-92054bfd82b4" status: 200 len: 1336 microversion: 2.1 time: 0.273455 Sep 23 04:31:22.464145 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 50/133] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:31:22 2022] GET /compute/v2.1/servers/43aee7fc-54b8-4499-998b-92054bfd82b4 => generated 1336 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:31:22.469813 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b74e39d6-1030-40f5-af8d-e38f3a286759 tempest-FlavorsAccessNegativeTestJSON-176088663 tempest-FlavorsAccessNegativeTestJSON-176088663-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "47fa14906ea743358cbe94c4d3aa861c"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:31:23.023857 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b74e39d6-1030-40f5-af8d-e38f3a286759 tempest-FlavorsAccessNegativeTestJSON-176088663 tempest-FlavorsAccessNegativeTestJSON-176088663-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/836464932/action" status: 200 len: 96 microversion: 2.1 time: 0.558230 Sep 23 04:31:23.033380 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 51/134] 10.222.0.33 () {60 vars in 1197 bytes} [Fri Sep 23 04:31:22 2022] POST /compute/v2.1/flavors/836464932/action => generated 96 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 04:31:23.045019 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-fb065b05-d4ba-4cc3-8beb-eca51241cd5b tempest-FlavorsAccessNegativeTestJSON-176088663 tempest-FlavorsAccessNegativeTestJSON-176088663-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "47fa14906ea743358cbe94c4d3aa861c"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:31:23.351150 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-fb065b05-d4ba-4cc3-8beb-eca51241cd5b tempest-FlavorsAccessNegativeTestJSON-176088663 tempest-FlavorsAccessNegativeTestJSON-176088663-project-admin] HTTP exception thrown: Flavor access already exists for flavor 21 and project 47fa14906ea743358cbe94c4d3aa861c combination. Sep 23 04:31:23.369710 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-fb065b05-d4ba-4cc3-8beb-eca51241cd5b tempest-FlavorsAccessNegativeTestJSON-176088663 tempest-FlavorsAccessNegativeTestJSON-176088663-project-admin] Request method failure captured: Sep 23 04:31:23.369710 n-d-846463-3 devstack@n-api.service[122699]: request: POST /compute/v2.1/flavors/836464932/action HTTP/1.1 Sep 23 04:31:23.369710 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:31:23.369710 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:31:23.369710 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:31:23.369710 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 67 Sep 23 04:31:23.369710 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:31:23.369710 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:31:23.369710 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:31:23.369710 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:31:23.369710 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTaXX9Sl4WL8VBXeSMNCd4q34w1EXQfVHG9ArjHheEroXrHHtBPuq_-oNst2bcBswIlXHbSKY73GnrpPg68V4iv1DreLAQs6QRkGMru80ufT87bDVgRXDA_1UhTbuZZSQAKQuwDdcxCQBr3vXhqbfINqNJxDpPmyXhU5Kv-QZbrhSDE Sep 23 04:31:23.369710 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:31:23.369710 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:31:23.369710 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:31:23.369710 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:31:23.369710 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:31:23.369710 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:31:23.369710 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 199d065b5bef446185af6a619e85adfe Sep 23 04:31:23.369710 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-176088663 Sep 23 04:31:23.369710 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,admin,member Sep 23 04:31:23.369710 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,admin,member Sep 23 04:31:23.375303 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_199d065b5bef446185af6a619e85adfe", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/199d065b5bef446185af6a619e85adfe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/199d065b5bef446185af6a619e85adfe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/199d065b5bef446185af6a619e85adfe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:31:23.375303 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-176088663 Sep 23 04:31:23.375303 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 199d065b5bef446185af6a619e85adfe Sep 23 04:31:23.375303 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-176088663 Sep 23 04:31:23.375303 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-FlavorsAccessNegativeTestJSON-176088663-project-admin Sep 23 04:31:23.375303 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:31:23.375303 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:31:23.375303 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 54d6971179c04c91b5f631ca3c3265d6 Sep 23 04:31:23.375303 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-176088663-project-admin Sep 23 04:31:23.375303 n-d-846463-3 devstack@n-api.service[122699]: Sep 23 04:31:23.375303 n-d-846463-3 devstack@n-api.service[122699]: {"addTenantAccess": {"tenant": "47fa14906ea743358cbe94c4d3aa861c"}} Sep 23 04:31:23.375303 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:31:23.376018 n-d-846463-3 devstack@n-api.service[122699]: exception: Flavor access already exists for flavor 21 and project 47fa14906ea743358cbe94c4d3aa861c combination. Sep 23 04:31:23.376018 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '836464932', 'body': {'addTenantAccess': {'tenant': '47fa14906ea743358cbe94c4d3aa861c'}}} Sep 23 04:31:23.376018 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:31:23.376018 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:31:23.376018 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 23 04:31:23.376018 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 23 04:31:23.376018 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 23 04:31:23.376018 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 23 04:31:23.376018 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 23 04:31:23.376018 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 23 04:31:23.376018 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 23 04:31:23.376018 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 23 04:31:23.376018 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 23 04:31:23.376018 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 23 04:31:23.376018 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 23 04:31:23.376018 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi result.read() Sep 23 04:31:23.376018 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 23 04:31:23.376018 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 23 04:31:23.376999 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 23 04:31:23.376999 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 23 04:31:23.376999 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 23 04:31:23.376999 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 23 04:31:23.376999 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 23 04:31:23.376999 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 23 04:31:23.376999 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '21-47fa14906ea743358cbe94c4d3aa861c' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Sep 23 04:31:23.376999 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:31:23.376999 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 23 04:31:23.376999 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:31:23.376999 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:31:23.376999 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Sep 23 04:31:23.376999 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi project.save(context.session) Sep 23 04:31:23.376999 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Sep 23 04:31:23.376999 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi session.flush() Sep 23 04:31:23.376999 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 23 04:31:23.376999 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self._flush(objects) Sep 23 04:31:23.376999 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 23 04:31:23.376999 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Sep 23 04:31:23.378059 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 23 04:31:23.378059 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi compat.raise_( Sep 23 04:31:23.378059 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 23 04:31:23.378059 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception Sep 23 04:31:23.378059 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 23 04:31:23.378059 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi flush_context.execute() Sep 23 04:31:23.378059 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 23 04:31:23.378059 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi rec.execute(self) Sep 23 04:31:23.378059 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 23 04:31:23.378059 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Sep 23 04:31:23.378059 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 23 04:31:23.378059 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Sep 23 04:31:23.378059 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 23 04:31:23.378059 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Sep 23 04:31:23.378059 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 23 04:31:23.378059 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Sep 23 04:31:23.378059 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 23 04:31:23.378059 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Sep 23 04:31:23.379023 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 23 04:31:23.379023 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Sep 23 04:31:23.379023 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 23 04:31:23.379023 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Sep 23 04:31:23.379023 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 23 04:31:23.379023 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 23 04:31:23.379023 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 23 04:31:23.379023 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception Sep 23 04:31:23.379023 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 23 04:31:23.379023 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 23 04:31:23.379023 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 23 04:31:23.379023 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 23 04:31:23.379023 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 23 04:31:23.379023 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 23 04:31:23.379023 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 23 04:31:23.379023 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 23 04:31:23.379023 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 23 04:31:23.379023 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 23 04:31:23.379997 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 23 04:31:23.379997 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi result.read() Sep 23 04:31:23.379997 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 23 04:31:23.379997 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 23 04:31:23.379997 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 23 04:31:23.379997 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 23 04:31:23.379997 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 23 04:31:23.379997 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 23 04:31:23.379997 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 23 04:31:23.379997 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 23 04:31:23.379997 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '21-47fa14906ea743358cbe94c4d3aa861c' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Sep 23 04:31:23.379997 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Sep 23 04:31:23.379997 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 9, 23, 4, 31, 23, 258973), 'updated_at': None, 'flavor_id': 21, 'project_id': '47fa14906ea743358cbe94c4d3aa861c'}] Sep 23 04:31:23.379997 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 23 04:31:23.379997 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:31:23.379997 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:31:23.379997 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:31:23.380910 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:31:23.380910 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Sep 23 04:31:23.380910 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Sep 23 04:31:23.380910 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 23 04:31:23.380910 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 23 04:31:23.380910 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Sep 23 04:31:23.380910 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Sep 23 04:31:23.380910 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Sep 23 04:31:23.380910 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Sep 23 04:31:23.380910 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Sep 23 04:31:23.380910 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Sep 23 04:31:23.380910 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 23 04:31:23.380910 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 23 04:31:23.380910 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Sep 23 04:31:23.380910 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Sep 23 04:31:23.380910 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 21 and project 47fa14906ea743358cbe94c4d3aa861c combination. Sep 23 04:31:23.380910 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:31:23.380910 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:31:23.380910 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:31:23.382437 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:31:23.382437 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:31:23.382437 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:31:23.382437 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:31:23.382437 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:31:23.382437 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:31:23.382437 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:31:23.382437 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:31:23.382437 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:31:23.382437 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Sep 23 04:31:23.382437 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Sep 23 04:31:23.382437 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 21 and project 47fa14906ea743358cbe94c4d3aa861c combination. Sep 23 04:31:23.382437 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:31:23.382437 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:31:23.382437 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:31:23.382437 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:31:23.382437 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:31:23.382437 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:31:23.382437 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:31:23.382437 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:31:23.383603 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 21 and project 47fa14906ea743358cbe94c4d3aa861c combination. Sep 23 04:31:23.383603 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:31:23.383603 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-fb065b05-d4ba-4cc3-8beb-eca51241cd5b tempest-FlavorsAccessNegativeTestJSON-176088663 tempest-FlavorsAccessNegativeTestJSON-176088663-project-admin] Returning 409 to user: Flavor access already exists for flavor 21 and project 47fa14906ea743358cbe94c4d3aa861c combination. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:31:23.383603 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-fb065b05-d4ba-4cc3-8beb-eca51241cd5b tempest-FlavorsAccessNegativeTestJSON-176088663 tempest-FlavorsAccessNegativeTestJSON-176088663-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/836464932/action" status: 409 len: 152 microversion: 2.1 time: 0.331310 Sep 23 04:31:23.383603 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 52/135] 10.222.0.33 () {60 vars in 1197 bytes} [Fri Sep 23 04:31:23 2022] POST /compute/v2.1/flavors/836464932/action => generated 152 bytes in 332 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 23 04:31:23.383603 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-596bab4a-d78a-44ff-8f81-85e4a173082f tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:23.384052 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-596bab4a-d78a-44ff-8f81-85e4a173082f tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] [instance: 074ac5a1-94af-4e9d-b458-107710ca0972] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:23.387020 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-596bab4a-d78a-44ff-8f81-85e4a173082f tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:23.387588 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-596bab4a-d78a-44ff-8f81-85e4a173082f tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:23.388112 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-596bab4a-d78a-44ff-8f81-85e4a173082f tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:23.388882 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-596bab4a-d78a-44ff-8f81-85e4a173082f tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:23.389411 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-596bab4a-d78a-44ff-8f81-85e4a173082f tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:23.389984 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-596bab4a-d78a-44ff-8f81-85e4a173082f tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:23.479917 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-596bab4a-d78a-44ff-8f81-85e4a173082f tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcc413bf53847b89cfe6bdf48909ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c7c21aa6b342b6bc52365cfdeb7c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:23.492427 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-596bab4a-d78a-44ff-8f81-85e4a173082f tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] 10.222.0.33 "GET /compute/v2.1/servers/074ac5a1-94af-4e9d-b458-107710ca0972" status: 200 len: 1266 microversion: 2.1 time: 0.119463 Sep 23 04:31:23.496513 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 53/136] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:31:23 2022] GET /compute/v2.1/servers/074ac5a1-94af-4e9d-b458-107710ca0972 => generated 1266 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:31:23.507413 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-63de88ea-1b10-40e2-bd4b-5c88fa811cf3 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:23.511288 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-63de88ea-1b10-40e2-bd4b-5c88fa811cf3 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] [instance: e18459f8-cd71-4feb-8764-c3b4cc3d89be] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:23.521376 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-63de88ea-1b10-40e2-bd4b-5c88fa811cf3 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:23.525447 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-63de88ea-1b10-40e2-bd4b-5c88fa811cf3 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:23.526144 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-63de88ea-1b10-40e2-bd4b-5c88fa811cf3 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:23.528294 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-63de88ea-1b10-40e2-bd4b-5c88fa811cf3 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:23.529821 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-63de88ea-1b10-40e2-bd4b-5c88fa811cf3 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:23.536891 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-63de88ea-1b10-40e2-bd4b-5c88fa811cf3 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:23.944673 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-63de88ea-1b10-40e2-bd4b-5c88fa811cf3 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac39d27bcf5d4def9ff9bd5b81bd7b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79442cd4a69040f594e19b3492df7e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:23.953499 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-63de88ea-1b10-40e2-bd4b-5c88fa811cf3 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] 10.222.0.33 "GET /compute/v2.1/servers/e18459f8-cd71-4feb-8764-c3b4cc3d89be" status: 200 len: 1340 microversion: 2.1 time: 0.455456 Sep 23 04:31:23.956712 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 54/137] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:31:23 2022] GET /compute/v2.1/servers/e18459f8-cd71-4feb-8764-c3b4cc3d89be => generated 1340 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:31:23.962692 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-81bef207-d462-46dd-85fd-f33560f5137f req-f007aeaf-ef16-4535-a287-aa9c5bd8c238 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e18459f8-cd71-4feb-8764-c3b4cc3d89be", "name": "network-vif-plugged", "status": "completed", "tag": "7d2a2b75-42dc-4cfd-b0dd-6f06df2a1f28"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:31:23.998723 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-81bef207-d462-46dd-85fd-f33560f5137f req-f007aeaf-ef16-4535-a287-aa9c5bd8c238 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:23.999561 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-81bef207-d462-46dd-85fd-f33560f5137f req-f007aeaf-ef16-4535-a287-aa9c5bd8c238 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:24.002240 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-81bef207-d462-46dd-85fd-f33560f5137f req-f007aeaf-ef16-4535-a287-aa9c5bd8c238 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:24.027950 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-81bef207-d462-46dd-85fd-f33560f5137f req-f007aeaf-ef16-4535-a287-aa9c5bd8c238 service nova] Creating event network-vif-plugged:7d2a2b75-42dc-4cfd-b0dd-6f06df2a1f28 for instance e18459f8-cd71-4feb-8764-c3b4cc3d89be on n-h2-846463-3 Sep 23 04:31:24.039109 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-81bef207-d462-46dd-85fd-f33560f5137f req-f007aeaf-ef16-4535-a287-aa9c5bd8c238 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080090 Sep 23 04:31:24.045983 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 55/138] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:31:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:31:24.053376 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8e45b1fd-75ae-47a5-b325-7c27689a2f72 tempest-FlavorsAccessNegativeTestJSON-176088663 tempest-FlavorsAccessNegativeTestJSON-176088663-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "47fa14906ea743358cbe94c4d3aa861c"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:31:24.554449 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-8e45b1fd-75ae-47a5-b325-7c27689a2f72 tempest-FlavorsAccessNegativeTestJSON-176088663 tempest-FlavorsAccessNegativeTestJSON-176088663-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/836464932/action" status: 200 len: 21 microversion: 2.1 time: 0.506799 Sep 23 04:31:24.556396 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 56/139] 10.222.0.33 () {60 vars in 1197 bytes} [Fri Sep 23 04:31:24 2022] POST /compute/v2.1/flavors/836464932/action => generated 21 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 04:31:24.563038 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c802ec43-40eb-4dbf-981d-08fe1cac605f tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:24.564141 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c802ec43-40eb-4dbf-981d-08fe1cac605f tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] [instance: 43aee7fc-54b8-4499-998b-92054bfd82b4] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:24.572183 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c802ec43-40eb-4dbf-981d-08fe1cac605f tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:24.572695 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c802ec43-40eb-4dbf-981d-08fe1cac605f tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:24.573140 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c802ec43-40eb-4dbf-981d-08fe1cac605f tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:24.573927 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c802ec43-40eb-4dbf-981d-08fe1cac605f tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:24.574339 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c802ec43-40eb-4dbf-981d-08fe1cac605f tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:24.574937 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c802ec43-40eb-4dbf-981d-08fe1cac605f tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:25.302288 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c802ec43-40eb-4dbf-981d-08fe1cac605f tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82ee10291f2c4914b348a82e51b9c967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a161d95e4c44433ba5af6b941190fa24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:25.317565 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c802ec43-40eb-4dbf-981d-08fe1cac605f tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] 10.222.0.33 "GET /compute/v2.1/servers/43aee7fc-54b8-4499-998b-92054bfd82b4" status: 200 len: 1486 microversion: 2.1 time: 0.757824 Sep 23 04:31:25.318275 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 57/140] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:31:24 2022] GET /compute/v2.1/servers/43aee7fc-54b8-4499-998b-92054bfd82b4 => generated 1486 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:31:25.344555 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-26b0ad78-1a4b-41b6-9b86-086dfb9dea9b tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:25.349015 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-26b0ad78-1a4b-41b6-9b86-086dfb9dea9b tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] [instance: 074ac5a1-94af-4e9d-b458-107710ca0972] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:25.372496 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-26b0ad78-1a4b-41b6-9b86-086dfb9dea9b tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:25.373015 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-26b0ad78-1a4b-41b6-9b86-086dfb9dea9b tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:25.373455 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-26b0ad78-1a4b-41b6-9b86-086dfb9dea9b tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:25.374658 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-26b0ad78-1a4b-41b6-9b86-086dfb9dea9b tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:25.377156 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-26b0ad78-1a4b-41b6-9b86-086dfb9dea9b tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:25.377611 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-26b0ad78-1a4b-41b6-9b86-086dfb9dea9b tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:25.563995 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-26b0ad78-1a4b-41b6-9b86-086dfb9dea9b tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcc413bf53847b89cfe6bdf48909ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c7c21aa6b342b6bc52365cfdeb7c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:25.573257 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-26b0ad78-1a4b-41b6-9b86-086dfb9dea9b tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] 10.222.0.33 "GET /compute/v2.1/servers/074ac5a1-94af-4e9d-b458-107710ca0972" status: 200 len: 1332 microversion: 2.1 time: 0.253815 Sep 23 04:31:25.573854 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 58/141] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:31:25 2022] GET /compute/v2.1/servers/074ac5a1-94af-4e9d-b458-107710ca0972 => generated 1332 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:31:25.578158 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-63fdaa14-0b86-4947-88a4-aac6a9df3155 tempest-FlavorsAccessNegativeTestJSON-176088663 tempest-FlavorsAccessNegativeTestJSON-176088663-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:25.679331 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-63fdaa14-0b86-4947-88a4-aac6a9df3155 tempest-FlavorsAccessNegativeTestJSON-176088663 tempest-FlavorsAccessNegativeTestJSON-176088663-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/836464932" status: 202 len: 0 microversion: 2.1 time: 0.104346 Sep 23 04:31:25.680015 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 59/142] 10.222.0.33 () {58 vars in 1158 bytes} [Fri Sep 23 04:31:25 2022] DELETE /compute/v2.1/flavors/836464932 => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:31:25.680599 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-64c606e2-2bad-4952-8093-d192a8d85555 tempest-SecurityGroupsTestAdminJSON-1737441997 tempest-SecurityGroupsTestAdminJSON-1737441997-project-admin] 10.222.0.33 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 8999 microversion: 2.1 time: 3.467813 Sep 23 04:31:25.682054 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 84/143] 10.222.0.33 () {58 vars in 1191 bytes} [Fri Sep 23 04:31:22 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 8999 bytes in 3470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:31:25.688078 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b242b025-8c3c-443b-a6c8-52b981ddeadf tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:25.688975 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b242b025-8c3c-443b-a6c8-52b981ddeadf tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] [instance: 43aee7fc-54b8-4499-998b-92054bfd82b4] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:25.698238 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f04226ec-4f5d-4ce9-a579-50df2409c7c3 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:25.699018 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f04226ec-4f5d-4ce9-a579-50df2409c7c3 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] [instance: e18459f8-cd71-4feb-8764-c3b4cc3d89be] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:25.707700 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f04226ec-4f5d-4ce9-a579-50df2409c7c3 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:25.708195 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f04226ec-4f5d-4ce9-a579-50df2409c7c3 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:25.708632 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f04226ec-4f5d-4ce9-a579-50df2409c7c3 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:25.710771 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f04226ec-4f5d-4ce9-a579-50df2409c7c3 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:25.712804 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f04226ec-4f5d-4ce9-a579-50df2409c7c3 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:25.713722 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f04226ec-4f5d-4ce9-a579-50df2409c7c3 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:25.719684 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b242b025-8c3c-443b-a6c8-52b981ddeadf tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:25.720190 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b242b025-8c3c-443b-a6c8-52b981ddeadf tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:25.720691 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b242b025-8c3c-443b-a6c8-52b981ddeadf tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:25.724340 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b242b025-8c3c-443b-a6c8-52b981ddeadf tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:25.732084 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b242b025-8c3c-443b-a6c8-52b981ddeadf tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:25.732981 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b242b025-8c3c-443b-a6c8-52b981ddeadf tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:26.087035 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=4 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:31:26.093609 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f04226ec-4f5d-4ce9-a579-50df2409c7c3 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac39d27bcf5d4def9ff9bd5b81bd7b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79442cd4a69040f594e19b3492df7e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:26.104053 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f04226ec-4f5d-4ce9-a579-50df2409c7c3 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] 10.222.0.33 "GET /compute/v2.1/servers/e18459f8-cd71-4feb-8764-c3b4cc3d89be" status: 200 len: 1490 microversion: 2.1 time: 0.419065 Sep 23 04:31:26.104803 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 60/144] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:31:25 2022] GET /compute/v2.1/servers/e18459f8-cd71-4feb-8764-c3b4cc3d89be => generated 1490 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:31:26.109548 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b863604a-ab08-48ff-9180-c44d33c7fc46 tempest-FlavorsAccessNegativeTestJSON-176088663 tempest-FlavorsAccessNegativeTestJSON-176088663-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:26.179920 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b863604a-ab08-48ff-9180-c44d33c7fc46 tempest-FlavorsAccessNegativeTestJSON-176088663 tempest-FlavorsAccessNegativeTestJSON-176088663-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.051601 Sep 23 04:31:26.181809 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 61/145] 10.222.0.33 () {58 vars in 1146 bytes} [Fri Sep 23 04:31:26 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:31:26.195779 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b7bf1220-f02e-495d-b706-b47b51f8415e tempest-SecurityGroupsTestAdminJSON-523114485 tempest-SecurityGroupsTestAdminJSON-523114485-project] Calling method '.version_select at 0x7ff1c0b08af0>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:26.507431 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b242b025-8c3c-443b-a6c8-52b981ddeadf tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/43aee7fc-54b8-4499-998b-92054bfd82b4" status: 200 len: 1637 microversion: 2.1 time: 0.823876 Sep 23 04:31:26.509261 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 85/146] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:31:25 2022] GET /compute/v2.1/servers/43aee7fc-54b8-4499-998b-92054bfd82b4 => generated 1637 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:31:26.585443 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b7bf1220-f02e-495d-b706-b47b51f8415e tempest-SecurityGroupsTestAdminJSON-523114485 tempest-SecurityGroupsTestAdminJSON-523114485-project] 10.222.0.33 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1113 microversion: 2.1 time: 0.401832 Sep 23 04:31:26.595706 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 62/147] 10.222.0.33 () {58 vars in 1191 bytes} [Fri Sep 23 04:31:26 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1113 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:31:26.610766 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-93069ac8-69b5-45a8-8e84-bced09734d82 tempest-FlavorsAccessNegativeTestJSON-176088663 tempest-FlavorsAccessNegativeTestJSON-176088663-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-790743621", "id": 1269959131, "os-flavor-access:is_public": "True"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:31:26.720062 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-93069ac8-69b5-45a8-8e84-bced09734d82 tempest-FlavorsAccessNegativeTestJSON-176088663 tempest-FlavorsAccessNegativeTestJSON-176088663-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.122741 Sep 23 04:31:26.721089 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 63/148] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:31:26 2022] POST /compute/v2.1/flavors => generated 437 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:31:26.732881 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f0ecec7e-76b7-4663-b68b-0f78b1125b3f tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:26.733576 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f0ecec7e-76b7-4663-b68b-0f78b1125b3f tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] [instance: 43aee7fc-54b8-4499-998b-92054bfd82b4] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:26.748073 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f0ecec7e-76b7-4663-b68b-0f78b1125b3f tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:26.748073 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f0ecec7e-76b7-4663-b68b-0f78b1125b3f tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:26.748073 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f0ecec7e-76b7-4663-b68b-0f78b1125b3f tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:26.752605 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f0ecec7e-76b7-4663-b68b-0f78b1125b3f tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:26.753110 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f0ecec7e-76b7-4663-b68b-0f78b1125b3f tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:26.753553 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f0ecec7e-76b7-4663-b68b-0f78b1125b3f tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:26.828720 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f0ecec7e-76b7-4663-b68b-0f78b1125b3f tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] [instance: 43aee7fc-54b8-4499-998b-92054bfd82b4] Going to try to terminate instance {{(pid=122699) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:31:27.014196 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2a643129-a644-4786-a0ab-2ca9e6534878 tempest-DeleteServersAdminTestJSON-1592115612 tempest-DeleteServersAdminTestJSON-1592115612-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:27.015486 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-2a643129-a644-4786-a0ab-2ca9e6534878 tempest-DeleteServersAdminTestJSON-1592115612 tempest-DeleteServersAdminTestJSON-1592115612-project-admin] [instance: e18459f8-cd71-4feb-8764-c3b4cc3d89be] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:27.029846 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2a643129-a644-4786-a0ab-2ca9e6534878 tempest-DeleteServersAdminTestJSON-1592115612 tempest-DeleteServersAdminTestJSON-1592115612-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:27.030318 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2a643129-a644-4786-a0ab-2ca9e6534878 tempest-DeleteServersAdminTestJSON-1592115612 tempest-DeleteServersAdminTestJSON-1592115612-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:27.030832 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2a643129-a644-4786-a0ab-2ca9e6534878 tempest-DeleteServersAdminTestJSON-1592115612 tempest-DeleteServersAdminTestJSON-1592115612-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:27.031567 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2a643129-a644-4786-a0ab-2ca9e6534878 tempest-DeleteServersAdminTestJSON-1592115612 tempest-DeleteServersAdminTestJSON-1592115612-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:27.032156 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2a643129-a644-4786-a0ab-2ca9e6534878 tempest-DeleteServersAdminTestJSON-1592115612 tempest-DeleteServersAdminTestJSON-1592115612-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:27.032855 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2a643129-a644-4786-a0ab-2ca9e6534878 tempest-DeleteServersAdminTestJSON-1592115612 tempest-DeleteServersAdminTestJSON-1592115612-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:27.063524 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-2a643129-a644-4786-a0ab-2ca9e6534878 tempest-DeleteServersAdminTestJSON-1592115612 tempest-DeleteServersAdminTestJSON-1592115612-project-admin] [instance: e18459f8-cd71-4feb-8764-c3b4cc3d89be] Going to try to terminate instance {{(pid=122698) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:31:27.422821 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f0ecec7e-76b7-4663-b68b-0f78b1125b3f tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] 10.222.0.33 "DELETE /compute/v2.1/servers/43aee7fc-54b8-4499-998b-92054bfd82b4" status: 204 len: 0 microversion: 2.1 time: 0.700305 Sep 23 04:31:27.423902 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 64/149] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:31:26 2022] DELETE /compute/v2.1/servers/43aee7fc-54b8-4499-998b-92054bfd82b4 => generated 0 bytes in 702 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:31:27.430080 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-98b4899a-5fd4-4118-a4d6-d7be74a6931e tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:27.433589 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-98b4899a-5fd4-4118-a4d6-d7be74a6931e tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] [instance: 074ac5a1-94af-4e9d-b458-107710ca0972] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:27.443402 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-98b4899a-5fd4-4118-a4d6-d7be74a6931e tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:27.444568 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-98b4899a-5fd4-4118-a4d6-d7be74a6931e tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:27.444662 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-98b4899a-5fd4-4118-a4d6-d7be74a6931e tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:27.449021 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-98b4899a-5fd4-4118-a4d6-d7be74a6931e tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:27.449021 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-98b4899a-5fd4-4118-a4d6-d7be74a6931e tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:27.449021 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-98b4899a-5fd4-4118-a4d6-d7be74a6931e tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:27.491611 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2a643129-a644-4786-a0ab-2ca9e6534878 tempest-DeleteServersAdminTestJSON-1592115612 tempest-DeleteServersAdminTestJSON-1592115612-project-admin] 10.222.0.33 "DELETE /compute/v2.1/servers/e18459f8-cd71-4feb-8764-c3b4cc3d89be" status: 204 len: 0 microversion: 2.1 time: 0.980263 Sep 23 04:31:27.492252 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 86/150] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:31:26 2022] DELETE /compute/v2.1/servers/e18459f8-cd71-4feb-8764-c3b4cc3d89be => generated 0 bytes in 982 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:31:27.499231 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5bfa1db3-ec06-40cc-971a-c51e75c3e7c4 tempest-SecurityGroupsTestAdminJSON-1737441997 tempest-SecurityGroupsTestAdminJSON-1737441997-project-admin] Calling method '.version_select at 0x7ff1c063c700>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:27.976400 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-98b4899a-5fd4-4118-a4d6-d7be74a6931e tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcc413bf53847b89cfe6bdf48909ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c7c21aa6b342b6bc52365cfdeb7c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:27.986898 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-98b4899a-5fd4-4118-a4d6-d7be74a6931e tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] 10.222.0.33 "GET /compute/v2.1/servers/074ac5a1-94af-4e9d-b458-107710ca0972" status: 200 len: 1387 microversion: 2.1 time: 0.561624 Sep 23 04:31:27.988730 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 65/151] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:31:27 2022] GET /compute/v2.1/servers/074ac5a1-94af-4e9d-b458-107710ca0972 => generated 1387 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:31:28.063065 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-bf537394-ee00-4daf-af18-e451fc728bb5 tempest-KeyPairsV210TestJSON-271334240 tempest-KeyPairsV210TestJSON-271334240-project-admin] Action: 'create', calling method: .version_select at 0x7ff1c058c550>, body: {"keypair": {"name": "tempest-keypair-1294580492", "type": "ssh", "user_id": "c9b3ad921c8c4986b089503cfff668ef", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN3xiztkkSOqwD59Pxk8GO+h5DT6MqXax0+rF4F8N4M8JiGN92iB6f0CHxwv4rBr+3W1lZ7MkIaAFR7Vj9wcacRwkKbjQGzTQghDft7uqXmwkZ2vLojQsDNyc6D/R1i50A=="}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:31:28.096784 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-bf537394-ee00-4daf-af18-e451fc728bb5 tempest-KeyPairsV210TestJSON-271334240 tempest-KeyPairsV210TestJSON-271334240-project-admin] Getting quotas for project b4b880f026974d1292020a0f1e50cc40. Resources: {'key_pairs'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:31:28.102558 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-bf537394-ee00-4daf-af18-e451fc728bb5 tempest-KeyPairsV210TestJSON-271334240 tempest-KeyPairsV210TestJSON-271334240-project-admin] Getting quotas for user a971b0ccfb724988b75cfe217c6b2486 and project b4b880f026974d1292020a0f1e50cc40. Resources: {'key_pairs'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:31:28.224833 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-bf537394-ee00-4daf-af18-e451fc728bb5 tempest-KeyPairsV210TestJSON-271334240 tempest-KeyPairsV210TestJSON-271334240-project-admin] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.234732 Sep 23 04:31:28.225488 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 66/152] 10.222.0.33 () {62 vars in 1200 bytes} [Fri Sep 23 04:31:27 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 236 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 23 04:31:28.236612 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7d010143-2c69-49b3-aa31-f1c26c0e09e2 tempest-FlavorsAccessNegativeTestJSON-176088663 tempest-FlavorsAccessNegativeTestJSON-176088663-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:28.240916 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=8,nova_api:DELETE=4,nova_api:UPDATE=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:31:28.243843 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-7d010143-2c69-49b3-aa31-f1c26c0e09e2 tempest-FlavorsAccessNegativeTestJSON-176088663 tempest-FlavorsAccessNegativeTestJSON-176088663-project-admin] HTTP exception thrown: Access list not available for public flavors. Sep 23 04:31:28.245197 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7d010143-2c69-49b3-aa31-f1c26c0e09e2 tempest-FlavorsAccessNegativeTestJSON-176088663 tempest-FlavorsAccessNegativeTestJSON-176088663-project-admin] Request method failure captured: Sep 23 04:31:28.245197 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/flavors/1269959131/os-flavor-access HTTP/1.1 Sep 23 04:31:28.245197 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:31:28.245197 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:31:28.245197 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:31:28.245197 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:31:28.245197 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:31:28.245197 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:31:28.245197 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:31:28.245197 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:31:28.245197 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTaXX9Sl4WL8VBXeSMNCd4q34w1EXQfVHG9ArjHheEroXrHHtBPuq_-oNst2bcBswIlXHbSKY73GnrpPg68V4iv1DreLAQs6QRkGMru80ufT87bDVgRXDA_1UhTbuZZSQAKQuwDdcxCQBr3vXhqbfINqNJxDpPmyXhU5Kv-QZbrhSDE Sep 23 04:31:28.245197 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:31:28.245197 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:31:28.245197 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:31:28.245197 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:31:28.245197 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:31:28.245197 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:31:28.245197 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 199d065b5bef446185af6a619e85adfe Sep 23 04:31:28.245197 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-176088663 Sep 23 04:31:28.245197 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,admin,member Sep 23 04:31:28.245197 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,admin,member Sep 23 04:31:28.246746 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_199d065b5bef446185af6a619e85adfe", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/199d065b5bef446185af6a619e85adfe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/199d065b5bef446185af6a619e85adfe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/199d065b5bef446185af6a619e85adfe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:31:28.246746 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-176088663 Sep 23 04:31:28.246746 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 199d065b5bef446185af6a619e85adfe Sep 23 04:31:28.246746 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-176088663 Sep 23 04:31:28.246746 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-FlavorsAccessNegativeTestJSON-176088663-project-admin Sep 23 04:31:28.246746 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:31:28.246746 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:31:28.246746 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 54d6971179c04c91b5f631ca3c3265d6 Sep 23 04:31:28.246746 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-176088663-project-admin Sep 23 04:31:28.246746 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:31:28.246746 n-d-846463-3 devstack@n-api.service[122699]: exception: Access list not available for public flavors. Sep 23 04:31:28.246746 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'flavor_id': '1269959131'} Sep 23 04:31:28.247515 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:31:28.247515 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:31:28.247515 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:31:28.247515 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:31:28.247515 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:31:28.247515 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:31:28.247515 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:31:28.247515 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:31:28.247515 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Sep 23 04:31:28.247515 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 23 04:31:28.247515 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Sep 23 04:31:28.247515 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:31:28.247515 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:31:28.247515 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:31:28.247515 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:31:28.247515 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:31:28.247515 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:31:28.247515 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:31:28.247515 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:31:28.247515 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Sep 23 04:31:28.247515 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:31:28.249000 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7d010143-2c69-49b3-aa31-f1c26c0e09e2 tempest-FlavorsAccessNegativeTestJSON-176088663 tempest-FlavorsAccessNegativeTestJSON-176088663-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:31:28.249000 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-7d010143-2c69-49b3-aa31-f1c26c0e09e2 tempest-FlavorsAccessNegativeTestJSON-176088663 tempest-FlavorsAccessNegativeTestJSON-176088663-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/1269959131/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.020131 Sep 23 04:31:28.250519 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 67/153] 10.222.0.33 () {58 vars in 1209 bytes} [Fri Sep 23 04:31:28 2022] GET /compute/v2.1/flavors/1269959131/os-flavor-access => generated 91 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 23 04:31:28.255549 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-37918a48-678e-4bfb-8736-e8b20330e9fd tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:28.258793 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5bfa1db3-ec06-40cc-971a-c51e75c3e7c4 tempest-SecurityGroupsTestAdminJSON-1737441997 tempest-SecurityGroupsTestAdminJSON-1737441997-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/e28a39d9-4d1d-4efd-a99d-eb85852d4e6c" status: 202 len: 0 microversion: 2.1 time: 0.764913 Sep 23 04:31:28.260062 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-37918a48-678e-4bfb-8736-e8b20330e9fd tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] [instance: 43aee7fc-54b8-4499-998b-92054bfd82b4] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:28.262978 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 87/154] 10.222.0.33 () {58 vars in 1272 bytes} [Fri Sep 23 04:31:27 2022] DELETE /compute/v2.1/os-security-groups/e28a39d9-4d1d-4efd-a99d-eb85852d4e6c => generated 0 bytes in 770 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:31:28.268480 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-58778cc2-9e49-4ec2-8d42-23a2e5f37bdc tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:28.269787 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-58778cc2-9e49-4ec2-8d42-23a2e5f37bdc tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] [instance: e18459f8-cd71-4feb-8764-c3b4cc3d89be] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:28.274295 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-37918a48-678e-4bfb-8736-e8b20330e9fd tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:28.276668 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-37918a48-678e-4bfb-8736-e8b20330e9fd tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:28.276668 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-37918a48-678e-4bfb-8736-e8b20330e9fd tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:28.276668 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-37918a48-678e-4bfb-8736-e8b20330e9fd tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:28.276668 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-37918a48-678e-4bfb-8736-e8b20330e9fd tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:28.276969 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-37918a48-678e-4bfb-8736-e8b20330e9fd tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:28.281389 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:31:28.286934 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-58778cc2-9e49-4ec2-8d42-23a2e5f37bdc tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:28.287710 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-58778cc2-9e49-4ec2-8d42-23a2e5f37bdc tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:28.288287 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-58778cc2-9e49-4ec2-8d42-23a2e5f37bdc tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:28.289200 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-58778cc2-9e49-4ec2-8d42-23a2e5f37bdc tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:28.289815 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-58778cc2-9e49-4ec2-8d42-23a2e5f37bdc tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:28.290431 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-58778cc2-9e49-4ec2-8d42-23a2e5f37bdc tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:28.663756 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-37918a48-678e-4bfb-8736-e8b20330e9fd tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82ee10291f2c4914b348a82e51b9c967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a161d95e4c44433ba5af6b941190fa24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:28.674851 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-37918a48-678e-4bfb-8736-e8b20330e9fd tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] 10.222.0.33 "GET /compute/v2.1/servers/43aee7fc-54b8-4499-998b-92054bfd82b4" status: 200 len: 1492 microversion: 2.1 time: 0.423064 Sep 23 04:31:28.676300 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 68/155] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:31:28 2022] GET /compute/v2.1/servers/43aee7fc-54b8-4499-998b-92054bfd82b4 => generated 1492 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:31:28.692768 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-58778cc2-9e49-4ec2-8d42-23a2e5f37bdc tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac39d27bcf5d4def9ff9bd5b81bd7b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79442cd4a69040f594e19b3492df7e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:28.700006 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:31:28.702491 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-078ade04-07ae-4249-bbe9-faa9498386a5 tempest-KeyPairsV210TestJSON-271334240 tempest-KeyPairsV210TestJSON-271334240-project-admin] Action: 'create', calling method: .version_select at 0x7ff1c096eb80>, body: {"keypair": {"name": "tempest-keypair-1685051793", "type": "ssh", "user_id": "c9b3ad921c8c4986b089503cfff668ef", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBADpAPBFb44gA0pBWnCLTYB+XB4FQYXWFhMdiPj1FrGF1PRuN5320Ft3GmvLmqj6kZxpxQfR51ihge4EavF6wv5NiPjBfExqZMz0NiyY0k6FR/AKCLhrnMqvxSdpB4Ancw=="}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:31:28.704403 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-58778cc2-9e49-4ec2-8d42-23a2e5f37bdc tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] 10.222.0.33 "GET /compute/v2.1/servers/e18459f8-cd71-4feb-8764-c3b4cc3d89be" status: 200 len: 1496 microversion: 2.1 time: 0.439803 Sep 23 04:31:28.705595 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 88/156] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:31:28 2022] GET /compute/v2.1/servers/e18459f8-cd71-4feb-8764-c3b4cc3d89be => generated 1496 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:31:28.712032 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d188caa2-d1d1-41bd-b115-6094692b41c2 tempest-FlavorsAccessNegativeTestJSON-176088663 tempest-FlavorsAccessNegativeTestJSON-176088663-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:28.731878 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-078ade04-07ae-4249-bbe9-faa9498386a5 tempest-KeyPairsV210TestJSON-271334240 tempest-KeyPairsV210TestJSON-271334240-project-admin] Getting quotas for project b4b880f026974d1292020a0f1e50cc40. Resources: {'key_pairs'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:31:28.735956 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-078ade04-07ae-4249-bbe9-faa9498386a5 tempest-KeyPairsV210TestJSON-271334240 tempest-KeyPairsV210TestJSON-271334240-project-admin] Getting quotas for user a971b0ccfb724988b75cfe217c6b2486 and project b4b880f026974d1292020a0f1e50cc40. Resources: {'key_pairs'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:31:28.874527 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d188caa2-d1d1-41bd-b115-6094692b41c2 tempest-FlavorsAccessNegativeTestJSON-176088663 tempest-FlavorsAccessNegativeTestJSON-176088663-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/1269959131" status: 202 len: 0 microversion: 2.1 time: 0.167476 Sep 23 04:31:28.875170 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 89/157] 10.222.0.33 () {58 vars in 1161 bytes} [Fri Sep 23 04:31:28 2022] DELETE /compute/v2.1/flavors/1269959131 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:31:28.880030 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-735243f3-5b24-4449-99b4-80130053b047 tempest-SecurityGroupsTestAdminJSON-1737441997 tempest-SecurityGroupsTestAdminJSON-1737441997-project-admin] Calling method '.version_select at 0x7ff1c0666b80>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:28.903086 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-078ade04-07ae-4249-bbe9-faa9498386a5 tempest-KeyPairsV210TestJSON-271334240 tempest-KeyPairsV210TestJSON-271334240-project-admin] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.204993 Sep 23 04:31:28.903701 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 69/158] 10.222.0.33 () {62 vars in 1200 bytes} [Fri Sep 23 04:31:28 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 227 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 23 04:31:28.908270 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-15ad8310-4804-4e09-82e4-94a9d41e8afc tempest-FlavorsAccessNegativeTestJSON-176088663 tempest-FlavorsAccessNegativeTestJSON-176088663-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:28.934818 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-15ad8310-4804-4e09-82e4-94a9d41e8afc tempest-FlavorsAccessNegativeTestJSON-176088663 tempest-FlavorsAccessNegativeTestJSON-176088663-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.030015 Sep 23 04:31:28.935627 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 70/159] 10.222.0.33 () {58 vars in 1146 bytes} [Fri Sep 23 04:31:28 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:31:28.940654 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-16e0d9ca-1322-45f5-8488-113e23a687f4 tempest-KeyPairsV210TestJSON-271334240 tempest-KeyPairsV210TestJSON-271334240-project-admin] Calling method '.version_select at 0x7ff1c05e0a60>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:28.950361 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-16e0d9ca-1322-45f5-8488-113e23a687f4 tempest-KeyPairsV210TestJSON-271334240 tempest-KeyPairsV210TestJSON-271334240-project-admin] 10.222.0.33 "GET /compute/v2.1/os-keypairs/tempest-keypair-1294580492?user_id=c9b3ad921c8c4986b089503cfff668ef" status: 200 len: 512 microversion: 2.10 time: 0.013267 Sep 23 04:31:28.951172 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 71/160] 10.222.0.33 () {60 vars in 1340 bytes} [Fri Sep 23 04:31:28 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1294580492?user_id=c9b3ad921c8c4986b089503cfff668ef => generated 512 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 04:31:28.970754 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4da25072-52ff-493d-b017-2b9b1eb477ba tempest-FlavorsAccessNegativeTestJSON-176088663 tempest-FlavorsAccessNegativeTestJSON-176088663-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-2111142949", "id": 1011549338, "os-flavor-access:is_public": "False"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:31:29.050275 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4da25072-52ff-493d-b017-2b9b1eb477ba tempest-FlavorsAccessNegativeTestJSON-176088663 tempest-FlavorsAccessNegativeTestJSON-176088663-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.084270 Sep 23 04:31:29.051700 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 72/161] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:31:28 2022] POST /compute/v2.1/flavors => generated 439 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:31:29.057007 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8ef6e9b1-ba9e-4700-b994-45d08d95d947 tempest-KeyPairsV210TestJSON-271334240 tempest-KeyPairsV210TestJSON-271334240-project-admin] Action: 'create', calling method: .version_select at 0x7ff1c0895820>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-798366518", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN1i3/ZZa5JQphfeJ4K3T9GZ0eoE3R+paHWF02FUnQhJQZyXnKnUbAZ8SHGjlEE7W7m8y+C8G1/qRZLxVd+mCXG9+sgY7xctzmhFwEXed7oSuYCvHT4H4oOpccXIEia8Xg=="}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:31:29.076099 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-8ef6e9b1-ba9e-4700-b994-45d08d95d947 tempest-KeyPairsV210TestJSON-271334240 tempest-KeyPairsV210TestJSON-271334240-project-admin] Getting quotas for project b4b880f026974d1292020a0f1e50cc40. Resources: {'key_pairs'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:31:29.082562 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-8ef6e9b1-ba9e-4700-b994-45d08d95d947 tempest-KeyPairsV210TestJSON-271334240 tempest-KeyPairsV210TestJSON-271334240-project-admin] Getting quotas for user a971b0ccfb724988b75cfe217c6b2486 and project b4b880f026974d1292020a0f1e50cc40. Resources: {'key_pairs'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:31:29.178234 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-8ef6e9b1-ba9e-4700-b994-45d08d95d947 tempest-KeyPairsV210TestJSON-271334240 tempest-KeyPairsV210TestJSON-271334240-project-admin] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.10 time: 0.124911 Sep 23 04:31:29.178859 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 73/162] 10.222.0.33 () {62 vars in 1200 bytes} [Fri Sep 23 04:31:29 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 126 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 23 04:31:29.187256 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-bd5aaaf3-90f4-4a80-b090-ec6a8ebb3e77 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:29.187879 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-bd5aaaf3-90f4-4a80-b090-ec6a8ebb3e77 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] [instance: 074ac5a1-94af-4e9d-b458-107710ca0972] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:29.194472 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bd5aaaf3-90f4-4a80-b090-ec6a8ebb3e77 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:29.194973 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bd5aaaf3-90f4-4a80-b090-ec6a8ebb3e77 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:29.195410 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bd5aaaf3-90f4-4a80-b090-ec6a8ebb3e77 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:29.196116 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bd5aaaf3-90f4-4a80-b090-ec6a8ebb3e77 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:29.196571 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bd5aaaf3-90f4-4a80-b090-ec6a8ebb3e77 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:29.197287 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bd5aaaf3-90f4-4a80-b090-ec6a8ebb3e77 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:29.300526 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-735243f3-5b24-4449-99b4-80130053b047 tempest-SecurityGroupsTestAdminJSON-1737441997 tempest-SecurityGroupsTestAdminJSON-1737441997-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/a5504192-c76b-418b-a506-ba392b0231b0" status: 202 len: 0 microversion: 2.1 time: 0.424109 Sep 23 04:31:29.304397 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 90/163] 10.222.0.33 () {58 vars in 1272 bytes} [Fri Sep 23 04:31:28 2022] DELETE /compute/v2.1/os-security-groups/a5504192-c76b-418b-a506-ba392b0231b0 => generated 0 bytes in 426 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:31:29.488318 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a2f22c56-3338-4a69-a7a5-3d0205d14bdb tempest-FlavorsAccessNegativeTestJSON-1863632838 tempest-FlavorsAccessNegativeTestJSON-1863632838-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "47fa14906ea743358cbe94c4d3aa861c"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:31:29.492124 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a2f22c56-3338-4a69-a7a5-3d0205d14bdb tempest-FlavorsAccessNegativeTestJSON-1863632838 tempest-FlavorsAccessNegativeTestJSON-1863632838-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '1b65b017aeac4b0e8c933771ac44feb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47fa14906ea743358cbe94c4d3aa861c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:29.494097 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a2f22c56-3338-4a69-a7a5-3d0205d14bdb tempest-FlavorsAccessNegativeTestJSON-1863632838 tempest-FlavorsAccessNegativeTestJSON-1863632838-project] Request method failure captured: Sep 23 04:31:29.494097 n-d-846463-3 devstack@n-api.service[122698]: request: POST /compute/v2.1/flavors/1011549338/action HTTP/1.1 Sep 23 04:31:29.494097 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:31:29.494097 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:31:29.494097 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:31:29.494097 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 67 Sep 23 04:31:29.494097 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:31:29.494097 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:31:29.494097 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:31:29.494097 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:31:29.494097 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTaVIYwqWyAOAgiR1z_Zp2b5Jg8BWE1xTglDpBEcVXN_fCpz_3udYiocikwdqPUgS1JCT_5RG4Hti0zIf6Qo_351j1lFfCZ5I7s8DaVIy1wLyH-jBPH0JJyzF0cqFbnqoYpCONwUT3QUom91dVhu7H6s90iy40JaeB074vi0aokz1yc Sep 23 04:31:29.494097 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:31:29.494097 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:31:29.494097 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:31:29.494097 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:31:29.494097 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:31:29.494097 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:31:29.494097 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 47fa14906ea743358cbe94c4d3aa861c Sep 23 04:31:29.494097 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1863632838 Sep 23 04:31:29.494097 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:31:29.494097 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:31:29.495555 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_47fa14906ea743358cbe94c4d3aa861c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/47fa14906ea743358cbe94c4d3aa861c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/47fa14906ea743358cbe94c4d3aa861c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/47fa14906ea743358cbe94c4d3aa861c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:31:29.495555 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1863632838 Sep 23 04:31:29.495555 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 47fa14906ea743358cbe94c4d3aa861c Sep 23 04:31:29.495555 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1863632838 Sep 23 04:31:29.495555 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-FlavorsAccessNegativeTestJSON-1863632838-project Sep 23 04:31:29.495555 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:31:29.495555 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:31:29.495555 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 1b65b017aeac4b0e8c933771ac44feb0 Sep 23 04:31:29.495555 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1863632838-project Sep 23 04:31:29.495555 n-d-846463-3 devstack@n-api.service[122698]: Sep 23 04:31:29.495555 n-d-846463-3 devstack@n-api.service[122698]: {"addTenantAccess": {"tenant": "47fa14906ea743358cbe94c4d3aa861c"}} Sep 23 04:31:29.495555 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:31:29.496345 n-d-846463-3 devstack@n-api.service[122698]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Sep 23 04:31:29.496345 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '1011549338', 'body': {'addTenantAccess': {'tenant': '47fa14906ea743358cbe94c4d3aa861c'}}} Sep 23 04:31:29.496345 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:31:29.496345 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:31:29.496345 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:31:29.496345 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:31:29.496345 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:31:29.496345 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:31:29.496345 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:31:29.496345 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:31:29.496345 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:31:29.496345 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:31:29.496345 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Sep 23 04:31:29.496345 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Sep 23 04:31:29.496345 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 23 04:31:29.496345 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 23 04:31:29.496345 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 23 04:31:29.496345 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 23 04:31:29.496345 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 23 04:31:29.497573 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 23 04:31:29.497573 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 23 04:31:29.497573 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise self.value Sep 23 04:31:29.497573 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 23 04:31:29.497573 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 23 04:31:29.497573 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 23 04:31:29.497573 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 23 04:31:29.497573 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 23 04:31:29.497573 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 23 04:31:29.497573 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Sep 23 04:31:29.497573 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:31:29.497573 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:31:29.497573 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:31:29.497573 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:31:29.497573 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:31:29.497573 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:31:29.497573 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 23 04:31:29.497573 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 23 04:31:29.497573 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Sep 23 04:31:29.497573 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:31:29.498900 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a2f22c56-3338-4a69-a7a5-3d0205d14bdb tempest-FlavorsAccessNegativeTestJSON-1863632838 tempest-FlavorsAccessNegativeTestJSON-1863632838-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:31:29.498900 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a2f22c56-3338-4a69-a7a5-3d0205d14bdb tempest-FlavorsAccessNegativeTestJSON-1863632838 tempest-FlavorsAccessNegativeTestJSON-1863632838-project] 10.222.0.33 "POST /compute/v2.1/flavors/1011549338/action" status: 403 len: 130 microversion: 2.1 time: 0.192999 Sep 23 04:31:29.498900 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 91/164] 10.222.0.33 () {60 vars in 1200 bytes} [Fri Sep 23 04:31:29 2022] POST /compute/v2.1/flavors/1011549338/action => generated 130 bytes in 194 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:31:29.501357 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5ea13d9a-861f-4dbd-9d0c-02962541d426 tempest-KeyPairsV210TestJSON-271334240 tempest-KeyPairsV210TestJSON-271334240-project-admin] Calling method '.version_select at 0x7ff1c10a1280>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:29.505983 n-d-846463-3 devstack@n-api.service[122698]: WARNING oslo_db.sqlalchemy.utils [None req-5ea13d9a-861f-4dbd-9d0c-02962541d426 tempest-KeyPairsV210TestJSON-271334240 tempest-KeyPairsV210TestJSON-271334240-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Sep 23 04:31:29.510490 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-bd5aaaf3-90f4-4a80-b090-ec6a8ebb3e77 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcc413bf53847b89cfe6bdf48909ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c7c21aa6b342b6bc52365cfdeb7c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:29.518808 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5ea13d9a-861f-4dbd-9d0c-02962541d426 tempest-KeyPairsV210TestJSON-271334240 tempest-KeyPairsV210TestJSON-271334240-project-admin] 10.222.0.33 "GET /compute/v2.1/os-keypairs?user_id=c9b3ad921c8c4986b089503cfff668ef" status: 200 len: 726 microversion: 2.10 time: 0.021768 Sep 23 04:31:29.526128 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 92/165] 10.222.0.33 () {60 vars in 1259 bytes} [Fri Sep 23 04:31:29 2022] GET /compute/v2.1/os-keypairs?user_id=c9b3ad921c8c4986b089503cfff668ef => generated 726 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 04:31:29.526128 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2330f493-b489-4095-8abe-43b78c35e61d tempest-SecurityGroupsTestAdminJSON-523114485 tempest-SecurityGroupsTestAdminJSON-523114485-project] Calling method '.version_select at 0x7ff1c0666e50>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:29.552227 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-bd5aaaf3-90f4-4a80-b090-ec6a8ebb3e77 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] 10.222.0.33 "GET /compute/v2.1/servers/074ac5a1-94af-4e9d-b458-107710ca0972" status: 200 len: 1387 microversion: 2.1 time: 0.369120 Sep 23 04:31:29.553087 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 74/166] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:31:29 2022] GET /compute/v2.1/servers/074ac5a1-94af-4e9d-b458-107710ca0972 => generated 1387 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:31:29.567582 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-fbfa9d66-b991-4238-9f11-8b417e5da724 tempest-FlavorsAccessNegativeTestJSON-176088663 tempest-FlavorsAccessNegativeTestJSON-176088663-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:29.651300 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-fbfa9d66-b991-4238-9f11-8b417e5da724 tempest-FlavorsAccessNegativeTestJSON-176088663 tempest-FlavorsAccessNegativeTestJSON-176088663-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/1011549338" status: 202 len: 0 microversion: 2.1 time: 0.096183 Sep 23 04:31:29.652130 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 75/167] 10.222.0.33 () {58 vars in 1161 bytes} [Fri Sep 23 04:31:29 2022] DELETE /compute/v2.1/flavors/1011549338 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:31:29.658615 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-faefc0bb-4b57-4f36-8427-eb3e31792700 tempest-KeyPairsV210TestJSON-271334240 tempest-KeyPairsV210TestJSON-271334240-project-admin] Calling method '.version_select at 0x7ff1c058c310>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:29.738827 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-faefc0bb-4b57-4f36-8427-eb3e31792700 tempest-KeyPairsV210TestJSON-271334240 tempest-KeyPairsV210TestJSON-271334240-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-798366518" status: 204 len: 0 microversion: 2.10 time: 0.085637 Sep 23 04:31:29.739737 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 76/168] 10.222.0.33 () {60 vars in 1322 bytes} [Fri Sep 23 04:31:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-798366518 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 23 04:31:29.749118 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a35f4016-5782-4b96-aaea-0402abbdb95b tempest-FlavorsAccessNegativeTestJSON-176088663 tempest-FlavorsAccessNegativeTestJSON-176088663-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:29.784545 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a35f4016-5782-4b96-aaea-0402abbdb95b tempest-FlavorsAccessNegativeTestJSON-176088663 tempest-FlavorsAccessNegativeTestJSON-176088663-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.043225 Sep 23 04:31:29.787526 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 77/169] 10.222.0.33 () {58 vars in 1146 bytes} [Fri Sep 23 04:31:29 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:31:29.799404 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c5a78b73-8b8e-4d95-9514-d2a9a3abc7fd tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:29.801025 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c5a78b73-8b8e-4d95-9514-d2a9a3abc7fd tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] [instance: 43aee7fc-54b8-4499-998b-92054bfd82b4] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:29.814101 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c5a78b73-8b8e-4d95-9514-d2a9a3abc7fd tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:29.814789 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c5a78b73-8b8e-4d95-9514-d2a9a3abc7fd tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:29.815320 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c5a78b73-8b8e-4d95-9514-d2a9a3abc7fd tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:29.816428 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c5a78b73-8b8e-4d95-9514-d2a9a3abc7fd tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:29.816987 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c5a78b73-8b8e-4d95-9514-d2a9a3abc7fd tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:29.817857 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c5a78b73-8b8e-4d95-9514-d2a9a3abc7fd tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:30.208879 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c5a78b73-8b8e-4d95-9514-d2a9a3abc7fd tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82ee10291f2c4914b348a82e51b9c967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a161d95e4c44433ba5af6b941190fa24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:30.225835 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c5a78b73-8b8e-4d95-9514-d2a9a3abc7fd tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] 10.222.0.33 "GET /compute/v2.1/servers/43aee7fc-54b8-4499-998b-92054bfd82b4" status: 200 len: 1492 microversion: 2.1 time: 0.436213 Sep 23 04:31:30.234839 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 78/170] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:31:29 2022] GET /compute/v2.1/servers/43aee7fc-54b8-4499-998b-92054bfd82b4 => generated 1492 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:31:30.234839 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8570ea4d-6df3-430c-b362-2af6e959cb6e tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:30.234839 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-8570ea4d-6df3-430c-b362-2af6e959cb6e tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] [instance: e18459f8-cd71-4feb-8764-c3b4cc3d89be] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:30.246308 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8570ea4d-6df3-430c-b362-2af6e959cb6e tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:30.246880 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8570ea4d-6df3-430c-b362-2af6e959cb6e tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:30.247514 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8570ea4d-6df3-430c-b362-2af6e959cb6e tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:30.248494 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8570ea4d-6df3-430c-b362-2af6e959cb6e tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:30.248945 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8570ea4d-6df3-430c-b362-2af6e959cb6e tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:30.249495 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8570ea4d-6df3-430c-b362-2af6e959cb6e tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:30.285280 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2330f493-b489-4095-8abe-43b78c35e61d tempest-SecurityGroupsTestAdminJSON-523114485 tempest-SecurityGroupsTestAdminJSON-523114485-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/130b1d55-345f-4405-b2e7-36794da1aa57" status: 202 len: 0 microversion: 2.1 time: 0.763695 Sep 23 04:31:30.286258 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 93/171] 10.222.0.33 () {58 vars in 1272 bytes} [Fri Sep 23 04:31:29 2022] DELETE /compute/v2.1/os-security-groups/130b1d55-345f-4405-b2e7-36794da1aa57 => generated 0 bytes in 765 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:31:30.291477 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8ccc90ee-cfe3-4503-ad82-9aaf30d8c199 tempest-KeyPairsV210TestJSON-271334240 tempest-KeyPairsV210TestJSON-271334240-project-admin] Calling method '.version_select at 0x7ff1c0666280>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:30.446007 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8ccc90ee-cfe3-4503-ad82-9aaf30d8c199 tempest-KeyPairsV210TestJSON-271334240 tempest-KeyPairsV210TestJSON-271334240-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1685051793?user_id=c9b3ad921c8c4986b089503cfff668ef" status: 204 len: 0 microversion: 2.10 time: 0.155156 Sep 23 04:31:30.446007 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 94/172] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Sep 23 04:31:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1685051793?user_id=c9b3ad921c8c4986b089503cfff668ef => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 23 04:31:30.451014 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4afaae59-e061-411f-92d9-4b247a45edf9 tempest-FlavorsAccessNegativeTestJSON-176088663 tempest-FlavorsAccessNegativeTestJSON-176088663-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-2100508195", "id": 547822997, "os-flavor-access:is_public": "False"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:31:30.601771 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4afaae59-e061-411f-92d9-4b247a45edf9 tempest-FlavorsAccessNegativeTestJSON-176088663 tempest-FlavorsAccessNegativeTestJSON-176088663-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.155958 Sep 23 04:31:30.624260 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 95/173] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:31:30 2022] POST /compute/v2.1/flavors => generated 436 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:31:30.631625 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f1831a93-3c93-4642-947b-a08ca5b5adf3 tempest-SecurityGroupsTestAdminJSON-523114485 tempest-SecurityGroupsTestAdminJSON-523114485-project] Calling method '.version_select at 0x7ff1c07c4ca0>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:30.636095 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-8570ea4d-6df3-430c-b362-2af6e959cb6e tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac39d27bcf5d4def9ff9bd5b81bd7b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79442cd4a69040f594e19b3492df7e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:30.644592 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-8570ea4d-6df3-430c-b362-2af6e959cb6e tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] 10.222.0.33 "GET /compute/v2.1/servers/e18459f8-cd71-4feb-8764-c3b4cc3d89be" status: 200 len: 1496 microversion: 2.1 time: 0.417188 Sep 23 04:31:30.645942 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 79/174] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:31:30 2022] GET /compute/v2.1/servers/e18459f8-cd71-4feb-8764-c3b4cc3d89be => generated 1496 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:31:30.650856 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6c71b464-43bd-460e-bce3-e69e5c695135 tempest-KeyPairsV210TestJSON-271334240 tempest-KeyPairsV210TestJSON-271334240-project-admin] Calling method '.version_select at 0x7ff1c05cfdc0>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:30.741922 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6c71b464-43bd-460e-bce3-e69e5c695135 tempest-KeyPairsV210TestJSON-271334240 tempest-KeyPairsV210TestJSON-271334240-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1294580492?user_id=c9b3ad921c8c4986b089503cfff668ef" status: 204 len: 0 microversion: 2.10 time: 0.094584 Sep 23 04:31:30.742599 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 80/175] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Sep 23 04:31:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1294580492?user_id=c9b3ad921c8c4986b089503cfff668ef => generated 0 bytes in 96 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 23 04:31:30.756566 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-28afe4f6-95bf-48ed-9877-b090b8295d4b req-3a6fff8a-82a3-4d04-8779-a44a2fe4c2d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43aee7fc-54b8-4499-998b-92054bfd82b4", "name": "network-vif-deleted", "tag": "d45ea1b3-0a7f-4ca6-9abe-cea1df49fdd7"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:31:30.795022 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-28afe4f6-95bf-48ed-9877-b090b8295d4b req-3a6fff8a-82a3-4d04-8779-a44a2fe4c2d9 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:30.795532 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-28afe4f6-95bf-48ed-9877-b090b8295d4b req-3a6fff8a-82a3-4d04-8779-a44a2fe4c2d9 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:30.797398 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-28afe4f6-95bf-48ed-9877-b090b8295d4b req-3a6fff8a-82a3-4d04-8779-a44a2fe4c2d9 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:31.029088 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-28afe4f6-95bf-48ed-9877-b090b8295d4b req-3a6fff8a-82a3-4d04-8779-a44a2fe4c2d9 service nova] Creating event network-vif-deleted:d45ea1b3-0a7f-4ca6-9abe-cea1df49fdd7 for instance 43aee7fc-54b8-4499-998b-92054bfd82b4 on n-h2-846463-3 Sep 23 04:31:31.040763 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-28afe4f6-95bf-48ed-9877-b090b8295d4b req-3a6fff8a-82a3-4d04-8779-a44a2fe4c2d9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.291589 Sep 23 04:31:31.042467 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 81/176] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:31:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:31:31.170555 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a2449fc7-37a0-43a3-b9b6-5a47f26e7ee1 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1181697504", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "networks": [{"uuid": "019d7df5-4f38-47cb-b9f3-1f0f6f2be581"}]}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:31:31.193747 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f1831a93-3c93-4642-947b-a08ca5b5adf3 tempest-SecurityGroupsTestAdminJSON-523114485 tempest-SecurityGroupsTestAdminJSON-523114485-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/0337ea5e-f03c-47cd-b76d-1849a31a1a19" status: 202 len: 0 microversion: 2.1 time: 0.567752 Sep 23 04:31:31.201756 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 96/177] 10.222.0.33 () {58 vars in 1272 bytes} [Fri Sep 23 04:31:30 2022] DELETE /compute/v2.1/os-security-groups/0337ea5e-f03c-47cd-b76d-1849a31a1a19 => generated 0 bytes in 575 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:31:31.205598 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2b2ff516-b096-46bf-aa4e-4a0bf22e8322 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:31.206467 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-2b2ff516-b096-46bf-aa4e-4a0bf22e8322 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] [instance: 074ac5a1-94af-4e9d-b458-107710ca0972] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:31.223340 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2b2ff516-b096-46bf-aa4e-4a0bf22e8322 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:31.226187 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2b2ff516-b096-46bf-aa4e-4a0bf22e8322 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:31.226187 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2b2ff516-b096-46bf-aa4e-4a0bf22e8322 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:31.227470 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2b2ff516-b096-46bf-aa4e-4a0bf22e8322 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:31.228141 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2b2ff516-b096-46bf-aa4e-4a0bf22e8322 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:31.229605 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2b2ff516-b096-46bf-aa4e-4a0bf22e8322 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:31.276040 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.neutron [None req-a2449fc7-37a0-43a3-b9b6-5a47f26e7ee1 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] validate_networks() for [('019d7df5-4f38-47cb-b9f3-1f0f6f2be581', None, None, None, None, None)] {{(pid=122699) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:31:31.515456 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:31:31.727673 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-2b2ff516-b096-46bf-aa4e-4a0bf22e8322 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcc413bf53847b89cfe6bdf48909ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c7c21aa6b342b6bc52365cfdeb7c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:31.737114 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2b2ff516-b096-46bf-aa4e-4a0bf22e8322 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] 10.222.0.33 "GET /compute/v2.1/servers/074ac5a1-94af-4e9d-b458-107710ca0972" status: 200 len: 1387 microversion: 2.1 time: 0.536171 Sep 23 04:31:31.738081 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 97/178] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:31:31 2022] GET /compute/v2.1/servers/074ac5a1-94af-4e9d-b458-107710ca0972 => generated 1387 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:31:31.743585 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f0127b83-860a-4200-b792-311e3134211f tempest-FlavorsAccessNegativeTestJSON-176088663 tempest-FlavorsAccessNegativeTestJSON-176088663-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "47fa14906ea743358cbe94c4d3aa861c"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:31:32.033925 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=4 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:31:32.139629 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f0127b83-860a-4200-b792-311e3134211f tempest-FlavorsAccessNegativeTestJSON-176088663 tempest-FlavorsAccessNegativeTestJSON-176088663-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/547822997/action" status: 200 len: 96 microversion: 2.1 time: 0.400172 Sep 23 04:31:32.142901 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 98/179] 10.222.0.33 () {60 vars in 1197 bytes} [Fri Sep 23 04:31:31 2022] POST /compute/v2.1/flavors/547822997/action => generated 96 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 04:31:32.154858 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-2cac8703-a617-4a46-80d1-6098bded93f0 req-1684cb58-278c-4f5a-a8de-8874672f48dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e18459f8-cd71-4feb-8764-c3b4cc3d89be", "name": "network-vif-deleted", "tag": "7d2a2b75-42dc-4cfd-b0dd-6f06df2a1f28"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:31:32.186492 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-2cac8703-a617-4a46-80d1-6098bded93f0 req-1684cb58-278c-4f5a-a8de-8874672f48dd service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:32.188094 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-2cac8703-a617-4a46-80d1-6098bded93f0 req-1684cb58-278c-4f5a-a8de-8874672f48dd service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:32.188656 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-2cac8703-a617-4a46-80d1-6098bded93f0 req-1684cb58-278c-4f5a-a8de-8874672f48dd service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:32.208834 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-2cac8703-a617-4a46-80d1-6098bded93f0 req-1684cb58-278c-4f5a-a8de-8874672f48dd service nova] Creating event network-vif-deleted:7d2a2b75-42dc-4cfd-b0dd-6f06df2a1f28 for instance e18459f8-cd71-4feb-8764-c3b4cc3d89be on n-h2-846463-3 Sep 23 04:31:32.210643 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-a2449fc7-37a0-43a3-b9b6-5a47f26e7ee1 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Flavor limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:31:32.211274 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-a2449fc7-37a0-43a3-b9b6-5a47f26e7ee1 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Image limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:31:32.211902 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-a2449fc7-37a0-43a3-b9b6-5a47f26e7ee1 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Flavor pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:31:32.212490 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-a2449fc7-37a0-43a3-b9b6-5a47f26e7ee1 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Image pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:31:32.213052 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-a2449fc7-37a0-43a3-b9b6-5a47f26e7ee1 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:31:32.219744 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-2cac8703-a617-4a46-80d1-6098bded93f0 req-1684cb58-278c-4f5a-a8de-8874672f48dd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075382 Sep 23 04:31:32.222764 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 99/180] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:31:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:31:32.226943 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a2449fc7-37a0-43a3-b9b6-5a47f26e7ee1 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:32.229420 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a2449fc7-37a0-43a3-b9b6-5a47f26e7ee1 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:32.230712 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a2449fc7-37a0-43a3-b9b6-5a47f26e7ee1 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:32.231579 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a2449fc7-37a0-43a3-b9b6-5a47f26e7ee1 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:32.232304 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a2449fc7-37a0-43a3-b9b6-5a47f26e7ee1 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:32.232837 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a2449fc7-37a0-43a3-b9b6-5a47f26e7ee1 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:32.233144 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4d78a554-1f01-4500-a4bf-8858f29cd9a6 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:32.233868 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4d78a554-1f01-4500-a4bf-8858f29cd9a6 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] [instance: 43aee7fc-54b8-4499-998b-92054bfd82b4] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:32.251959 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4d78a554-1f01-4500-a4bf-8858f29cd9a6 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:32.252158 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4d78a554-1f01-4500-a4bf-8858f29cd9a6 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:32.252444 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4d78a554-1f01-4500-a4bf-8858f29cd9a6 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:32.255430 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4d78a554-1f01-4500-a4bf-8858f29cd9a6 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:32.257723 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4d78a554-1f01-4500-a4bf-8858f29cd9a6 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:32.264050 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-a2449fc7-37a0-43a3-b9b6-5a47f26e7ee1 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Getting quotas for project 0abccbbae40b47968a8dda6323b618e3. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:31:32.268448 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4d78a554-1f01-4500-a4bf-8858f29cd9a6 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:32.269622 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-a2449fc7-37a0-43a3-b9b6-5a47f26e7ee1 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Getting quotas for user 84d0c7a6520443d896f88069e91a2eb2 and project 0abccbbae40b47968a8dda6323b618e3. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:31:32.286177 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a2449fc7-37a0-43a3-b9b6-5a47f26e7ee1 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Going to run 1 instances... {{(pid=122699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:31:32.288396 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-4d78a554-1f01-4500-a4bf-8858f29cd9a6 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] HTTP exception thrown: Instance 43aee7fc-54b8-4499-998b-92054bfd82b4 could not be found. Sep 23 04:31:32.291645 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a2449fc7-37a0-43a3-b9b6-5a47f26e7ee1 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: bbf05a2b-af42-4f14-8956-4f6249c46974] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:31:32.291805 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4d78a554-1f01-4500-a4bf-8858f29cd9a6 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Request method failure captured: Sep 23 04:31:32.291805 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/43aee7fc-54b8-4499-998b-92054bfd82b4 HTTP/1.1 Sep 23 04:31:32.291805 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:31:32.291805 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:31:32.291805 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:31:32.291805 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:31:32.291805 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:31:32.291805 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:31:32.291805 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:31:32.291805 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:31:32.291805 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTZ2dSiaqYHbShaqFrlHJtjSKM-XDtiEUKZW_7C_iWQc5AnhQ1viBZ5rTZuqBFRX0xAIHdf37vGm4WsYufPNVVQCjWFSYqqMY_9UU5le379PodmsuNmFomcOQfw-dgRu-xyJYUAMmvQWwQSaZEDt47d_gISy4r8GWm0MOfQIuD2tdeU Sep 23 04:31:32.291805 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:31:32.291805 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:31:32.291805 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:31:32.291805 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:31:32.291805 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:31:32.291805 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:31:32.291805 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: a161d95e4c44433ba5af6b941190fa24 Sep 23 04:31:32.291805 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-AggregatesAdminTestJSON-144473189 Sep 23 04:31:32.291805 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:31:32.291805 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:31:32.293257 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a161d95e4c44433ba5af6b941190fa24", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a161d95e4c44433ba5af6b941190fa24"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a161d95e4c44433ba5af6b941190fa24"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a161d95e4c44433ba5af6b941190fa24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:31:32.293257 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-AggregatesAdminTestJSON-144473189 Sep 23 04:31:32.293257 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: a161d95e4c44433ba5af6b941190fa24 Sep 23 04:31:32.293257 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-144473189 Sep 23 04:31:32.293257 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-AggregatesAdminTestJSON-144473189-project Sep 23 04:31:32.293257 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:31:32.293257 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:31:32.293257 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 82ee10291f2c4914b348a82e51b9c967 Sep 23 04:31:32.293257 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-AggregatesAdminTestJSON-144473189-project Sep 23 04:31:32.293257 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:31:32.293257 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 43aee7fc-54b8-4499-998b-92054bfd82b4 could not be found. Sep 23 04:31:32.293257 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '43aee7fc-54b8-4499-998b-92054bfd82b4'} Sep 23 04:31:32.294297 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:31:32.294297 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:31:32.294297 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:31:32.294297 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:31:32.294297 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:31:32.294297 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:31:32.294297 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:31:32.294297 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:31:32.294297 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:31:32.294297 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:31:32.294297 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43aee7fc-54b8-4499-998b-92054bfd82b4 could not be found. Sep 23 04:31:32.294297 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:31:32.294297 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:31:32.294297 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:31:32.294297 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:31:32.294297 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:31:32.294297 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:31:32.294297 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:31:32.294297 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:31:32.294297 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:31:32.295593 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:31:32.295593 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:31:32.295593 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:31:32.295593 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:31:32.295593 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:31:32.295593 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:31:32.295593 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:31:32.295593 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43aee7fc-54b8-4499-998b-92054bfd82b4 could not be found. Sep 23 04:31:32.295593 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:31:32.295593 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:31:32.295593 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:31:32.295593 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:31:32.295593 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:31:32.295593 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:31:32.295593 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:31:32.295593 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:31:32.295593 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43aee7fc-54b8-4499-998b-92054bfd82b4 could not be found. Sep 23 04:31:32.295593 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:31:32.298117 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4d78a554-1f01-4500-a4bf-8858f29cd9a6 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Returning 404 to user: Instance 43aee7fc-54b8-4499-998b-92054bfd82b4 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:31:32.298117 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4d78a554-1f01-4500-a4bf-8858f29cd9a6 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] 10.222.0.33 "GET /compute/v2.1/servers/43aee7fc-54b8-4499-998b-92054bfd82b4" status: 404 len: 111 microversion: 2.1 time: 0.069864 Sep 23 04:31:32.298117 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 100/181] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:31:32 2022] GET /compute/v2.1/servers/43aee7fc-54b8-4499-998b-92054bfd82b4 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:31:32.302818 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3b521be4-7af5-4390-a391-979754a396cc tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:32.302818 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3b521be4-7af5-4390-a391-979754a396cc tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] [instance: e18459f8-cd71-4feb-8764-c3b4cc3d89be] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:32.308140 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3b521be4-7af5-4390-a391-979754a396cc tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:32.308702 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3b521be4-7af5-4390-a391-979754a396cc tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:32.309139 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3b521be4-7af5-4390-a391-979754a396cc tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:32.310123 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3b521be4-7af5-4390-a391-979754a396cc tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:32.310946 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3b521be4-7af5-4390-a391-979754a396cc tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:32.311915 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3b521be4-7af5-4390-a391-979754a396cc tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:32.530501 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3b521be4-7af5-4390-a391-979754a396cc tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:32.531224 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3b521be4-7af5-4390-a391-979754a396cc tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:32.531812 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3b521be4-7af5-4390-a391-979754a396cc tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:32.543808 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a2449fc7-37a0-43a3-b9b6-5a47f26e7ee1 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.492125 Sep 23 04:31:32.544083 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-3b521be4-7af5-4390-a391-979754a396cc tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lazy-loading 'fault' on Instance uuid e18459f8-cd71-4feb-8764-c3b4cc3d89be {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:31:32.544561 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 82/182] 10.222.0.33 () {62 vars in 1188 bytes} [Fri Sep 23 04:31:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1502 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 23 04:31:32.566166 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-16c3f036-c096-4aa9-b6e9-9b17b82a585b tempest-FlavorsAccessNegativeTestJSON-1863632838 tempest-FlavorsAccessNegativeTestJSON-1863632838-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "47fa14906ea743358cbe94c4d3aa861c"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:31:32.585322 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-16c3f036-c096-4aa9-b6e9-9b17b82a585b tempest-FlavorsAccessNegativeTestJSON-1863632838 tempest-FlavorsAccessNegativeTestJSON-1863632838-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '1b65b017aeac4b0e8c933771ac44feb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47fa14906ea743358cbe94c4d3aa861c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:32.589427 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-16c3f036-c096-4aa9-b6e9-9b17b82a585b tempest-FlavorsAccessNegativeTestJSON-1863632838 tempest-FlavorsAccessNegativeTestJSON-1863632838-project] Request method failure captured: Sep 23 04:31:32.589427 n-d-846463-3 devstack@n-api.service[122699]: request: POST /compute/v2.1/flavors/547822997/action HTTP/1.1 Sep 23 04:31:32.589427 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:31:32.589427 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:31:32.589427 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:31:32.589427 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 70 Sep 23 04:31:32.589427 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:31:32.589427 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:31:32.589427 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:31:32.589427 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:31:32.589427 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTaVIYwqWyAOAgiR1z_Zp2b5Jg8BWE1xTglDpBEcVXN_fCpz_3udYiocikwdqPUgS1JCT_5RG4Hti0zIf6Qo_351j1lFfCZ5I7s8DaVIy1wLyH-jBPH0JJyzF0cqFbnqoYpCONwUT3QUom91dVhu7H6s90iy40JaeB074vi0aokz1yc Sep 23 04:31:32.589427 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:31:32.589427 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:31:32.589427 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:31:32.589427 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:31:32.589427 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:31:32.589427 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:31:32.589427 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 47fa14906ea743358cbe94c4d3aa861c Sep 23 04:31:32.589427 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1863632838 Sep 23 04:31:32.589427 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:31:32.589427 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:31:32.590679 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_47fa14906ea743358cbe94c4d3aa861c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/47fa14906ea743358cbe94c4d3aa861c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/47fa14906ea743358cbe94c4d3aa861c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/47fa14906ea743358cbe94c4d3aa861c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:31:32.590679 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1863632838 Sep 23 04:31:32.590679 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 47fa14906ea743358cbe94c4d3aa861c Sep 23 04:31:32.590679 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1863632838 Sep 23 04:31:32.590679 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-FlavorsAccessNegativeTestJSON-1863632838-project Sep 23 04:31:32.590679 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:31:32.590679 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:31:32.590679 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 1b65b017aeac4b0e8c933771ac44feb0 Sep 23 04:31:32.590679 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1863632838-project Sep 23 04:31:32.590679 n-d-846463-3 devstack@n-api.service[122699]: Sep 23 04:31:32.590679 n-d-846463-3 devstack@n-api.service[122699]: {"removeTenantAccess": {"tenant": "47fa14906ea743358cbe94c4d3aa861c"}} Sep 23 04:31:32.590679 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:31:32.591322 n-d-846463-3 devstack@n-api.service[122699]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Sep 23 04:31:32.591322 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '547822997', 'body': {'removeTenantAccess': {'tenant': '47fa14906ea743358cbe94c4d3aa861c'}}} Sep 23 04:31:32.591322 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:31:32.591322 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:31:32.591322 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:31:32.591322 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:31:32.591322 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:31:32.591322 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:31:32.591322 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:31:32.591322 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:31:32.591322 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:31:32.591322 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:31:32.591322 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Sep 23 04:31:32.591322 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi context.can( Sep 23 04:31:32.591322 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 23 04:31:32.591322 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 23 04:31:32.591322 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 23 04:31:32.591322 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 23 04:31:32.591322 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 23 04:31:32.591322 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 23 04:31:32.596092 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 23 04:31:32.596092 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise self.value Sep 23 04:31:32.596092 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 23 04:31:32.596092 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 23 04:31:32.596092 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 23 04:31:32.596092 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 23 04:31:32.596092 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 23 04:31:32.596092 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 23 04:31:32.596092 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Sep 23 04:31:32.596092 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:31:32.596092 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:31:32.596092 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:31:32.596092 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:31:32.596092 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:31:32.596092 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:31:32.596092 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 23 04:31:32.596092 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 23 04:31:32.596092 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Sep 23 04:31:32.596092 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:31:32.600801 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-16c3f036-c096-4aa9-b6e9-9b17b82a585b tempest-FlavorsAccessNegativeTestJSON-1863632838 tempest-FlavorsAccessNegativeTestJSON-1863632838-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:31:32.600801 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-16c3f036-c096-4aa9-b6e9-9b17b82a585b tempest-FlavorsAccessNegativeTestJSON-1863632838 tempest-FlavorsAccessNegativeTestJSON-1863632838-project] 10.222.0.33 "POST /compute/v2.1/flavors/547822997/action" status: 403 len: 133 microversion: 2.1 time: 0.045372 Sep 23 04:31:32.615597 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 83/183] 10.222.0.33 () {60 vars in 1197 bytes} [Fri Sep 23 04:31:32 2022] POST /compute/v2.1/flavors/547822997/action => generated 133 bytes in 70 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:31:32.630060 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1be5c06a-49f7-4b8c-8153-d2465901a561 tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-846463-3"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:31:32.645625 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-3b521be4-7af5-4390-a391-979754a396cc tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac39d27bcf5d4def9ff9bd5b81bd7b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79442cd4a69040f594e19b3492df7e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:32.670844 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1be5c06a-49f7-4b8c-8153-d2465901a561 tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:32.671352 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1be5c06a-49f7-4b8c-8153-d2465901a561 tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:32.671798 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1be5c06a-49f7-4b8c-8153-d2465901a561 tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:32.677457 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3b521be4-7af5-4390-a391-979754a396cc tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] 10.222.0.33 "GET /compute/v2.1/servers/e18459f8-cd71-4feb-8764-c3b4cc3d89be" status: 200 len: 1330 microversion: 2.1 time: 0.381720 Sep 23 04:31:32.680749 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 101/184] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:31:32 2022] GET /compute/v2.1/servers/e18459f8-cd71-4feb-8764-c3b4cc3d89be => generated 1330 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:31:32.712271 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-698f444a-12ec-4d8a-9af7-25e00cc90dbf tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:32.715958 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-698f444a-12ec-4d8a-9af7-25e00cc90dbf tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: bbf05a2b-af42-4f14-8956-4f6249c46974] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:32.842699 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-698f444a-12ec-4d8a-9af7-25e00cc90dbf tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:32.854219 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-698f444a-12ec-4d8a-9af7-25e00cc90dbf tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:32.856289 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-698f444a-12ec-4d8a-9af7-25e00cc90dbf tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:32.857788 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-698f444a-12ec-4d8a-9af7-25e00cc90dbf tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/bbf05a2b-af42-4f14-8956-4f6249c46974" status: 200 len: 1262 microversion: 2.25 time: 0.162354 Sep 23 04:31:32.858428 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 102/185] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:31:32 2022] GET /compute/v2.1/servers/bbf05a2b-af42-4f14-8956-4f6249c46974 => generated 1262 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:31:32.869323 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-40a90db1-3f3a-45d5-aa5e-8576bd0904de tempest-FlavorsAccessNegativeTestJSON-176088663 tempest-FlavorsAccessNegativeTestJSON-176088663-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "47fa14906ea743358cbe94c4d3aa861c"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:31:33.088868 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1be5c06a-49f7-4b8c-8153-d2465901a561 tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 296 microversion: 2.1 time: 0.471963 Sep 23 04:31:33.099607 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 84/186] 10.222.0.33 () {60 vars in 1191 bytes} [Fri Sep 23 04:31:32 2022] POST /compute/v2.1/os-aggregates/3/action => generated 296 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:31:33.107572 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-11dc9840-fa37-4b9d-b45f-9518d0da884b tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:33.108469 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-11dc9840-fa37-4b9d-b45f-9518d0da884b tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] [instance: 074ac5a1-94af-4e9d-b458-107710ca0972] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:33.117871 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-11dc9840-fa37-4b9d-b45f-9518d0da884b tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:33.118670 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-11dc9840-fa37-4b9d-b45f-9518d0da884b tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:33.119476 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-11dc9840-fa37-4b9d-b45f-9518d0da884b tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:33.120428 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-11dc9840-fa37-4b9d-b45f-9518d0da884b tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:33.121063 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-11dc9840-fa37-4b9d-b45f-9518d0da884b tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:33.122074 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-11dc9840-fa37-4b9d-b45f-9518d0da884b tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:33.303649 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-11dc9840-fa37-4b9d-b45f-9518d0da884b tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcc413bf53847b89cfe6bdf48909ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c7c21aa6b342b6bc52365cfdeb7c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:33.318634 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-11dc9840-fa37-4b9d-b45f-9518d0da884b tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] 10.222.0.33 "GET /compute/v2.1/servers/074ac5a1-94af-4e9d-b458-107710ca0972" status: 200 len: 1387 microversion: 2.1 time: 0.217130 Sep 23 04:31:33.319976 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 85/187] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:31:33 2022] GET /compute/v2.1/servers/074ac5a1-94af-4e9d-b458-107710ca0972 => generated 1387 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:31:33.339994 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-36c891fa-605b-4c61-97df-3282e9deaf7d req-0a0242e5-482a-477d-88ef-bb96151a47b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "074ac5a1-94af-4e9d-b458-107710ca0972", "tag": "d2a87d8d-10e1-4e42-a88a-2baacccb1f56"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:31:33.353527 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-36c891fa-605b-4c61-97df-3282e9deaf7d req-0a0242e5-482a-477d-88ef-bb96151a47b1 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:33.354339 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-36c891fa-605b-4c61-97df-3282e9deaf7d req-0a0242e5-482a-477d-88ef-bb96151a47b1 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:33.355035 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-36c891fa-605b-4c61-97df-3282e9deaf7d req-0a0242e5-482a-477d-88ef-bb96151a47b1 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:33.371848 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-36c891fa-605b-4c61-97df-3282e9deaf7d req-0a0242e5-482a-477d-88ef-bb96151a47b1 service nova] Creating event network-changed:d2a87d8d-10e1-4e42-a88a-2baacccb1f56 for instance 074ac5a1-94af-4e9d-b458-107710ca0972 on n-h1-846463-3 Sep 23 04:31:33.377965 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-36c891fa-605b-4c61-97df-3282e9deaf7d req-0a0242e5-482a-477d-88ef-bb96151a47b1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056293 Sep 23 04:31:33.380406 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 86/188] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:31:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:31:33.388670 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-131ecc1b-dd34-46d7-896b-c2878604b999 tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:33.499181 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-131ecc1b-dd34-46d7-896b-c2878604b999 tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.117297 Sep 23 04:31:33.499799 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 87/189] 10.222.0.33 () {58 vars in 1152 bytes} [Fri Sep 23 04:31:33 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 23 04:31:33.513367 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4688bbb1-87f0-4366-8abe-2121af6fdb0d tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1103080011"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:31:33.516824 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.aggregate [None req-4688bbb1-87f0-4366-8abe-2121af6fdb0d tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] Generated uuid a010af1e-ae23-4f5d-994a-6af29869bf50 for aggregate {{(pid=122699) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 23 04:31:33.529295 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=7,nova_api:DELETE=8 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:31:33.539408 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-40a90db1-3f3a-45d5-aa5e-8576bd0904de tempest-FlavorsAccessNegativeTestJSON-176088663 tempest-FlavorsAccessNegativeTestJSON-176088663-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/547822997/action" status: 200 len: 21 microversion: 2.1 time: 0.676249 Sep 23 04:31:33.540750 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 103/190] 10.222.0.33 () {60 vars in 1197 bytes} [Fri Sep 23 04:31:32 2022] POST /compute/v2.1/flavors/547822997/action => generated 21 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 04:31:33.551647 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d15304f8-be3d-4305-b7a8-3526ee46bde6 tempest-FlavorsAccessNegativeTestJSON-176088663 tempest-FlavorsAccessNegativeTestJSON-176088663-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:33.609312 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4688bbb1-87f0-4366-8abe-2121af6fdb0d tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.099516 Sep 23 04:31:33.610024 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 88/191] 10.222.0.33 () {60 vars in 1164 bytes} [Fri Sep 23 04:31:33 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:31:33.621954 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-81e6158f-e7cb-415d-9f5c-a7194b92451a tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-846463-3"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:31:33.635766 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-81e6158f-e7cb-415d-9f5c-a7194b92451a tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:33.636543 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-81e6158f-e7cb-415d-9f5c-a7194b92451a tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:33.637087 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-81e6158f-e7cb-415d-9f5c-a7194b92451a tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:33.647432 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d15304f8-be3d-4305-b7a8-3526ee46bde6 tempest-FlavorsAccessNegativeTestJSON-176088663 tempest-FlavorsAccessNegativeTestJSON-176088663-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/547822997" status: 202 len: 0 microversion: 2.1 time: 0.100868 Sep 23 04:31:33.649332 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 104/192] 10.222.0.33 () {58 vars in 1158 bytes} [Fri Sep 23 04:31:33 2022] DELETE /compute/v2.1/flavors/547822997 => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 23 04:31:33.659998 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-68c90dc5-a1ba-42af-b7e0-93659c7717b5 tempest-FlavorsAccessNegativeTestJSON-176088663 tempest-FlavorsAccessNegativeTestJSON-176088663-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:33.690571 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-68c90dc5-a1ba-42af-b7e0-93659c7717b5 tempest-FlavorsAccessNegativeTestJSON-176088663 tempest-FlavorsAccessNegativeTestJSON-176088663-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.033545 Sep 23 04:31:33.694400 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 105/193] 10.222.0.33 () {58 vars in 1146 bytes} [Fri Sep 23 04:31:33 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:31:33.716408 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-41279578-c4ad-4902-b6ad-392828b8f53c tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:33.717989 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-41279578-c4ad-4902-b6ad-392828b8f53c tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] [instance: e18459f8-cd71-4feb-8764-c3b4cc3d89be] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:33.757400 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-41279578-c4ad-4902-b6ad-392828b8f53c tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:33.758026 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-41279578-c4ad-4902-b6ad-392828b8f53c tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:33.758485 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-41279578-c4ad-4902-b6ad-392828b8f53c tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:33.759207 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-41279578-c4ad-4902-b6ad-392828b8f53c tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:33.759734 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-41279578-c4ad-4902-b6ad-392828b8f53c tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:33.760190 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-41279578-c4ad-4902-b6ad-392828b8f53c tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:33.785214 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-41279578-c4ad-4902-b6ad-392828b8f53c tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] HTTP exception thrown: Instance e18459f8-cd71-4feb-8764-c3b4cc3d89be could not be found. Sep 23 04:31:33.786826 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-41279578-c4ad-4902-b6ad-392828b8f53c tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Request method failure captured: Sep 23 04:31:33.786826 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/e18459f8-cd71-4feb-8764-c3b4cc3d89be HTTP/1.1 Sep 23 04:31:33.786826 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:31:33.786826 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:31:33.786826 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:31:33.786826 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:31:33.786826 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:31:33.786826 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:31:33.786826 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:31:33.786826 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:31:33.786826 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTZ0ZRM17NaqF0hn5-kjr9OlGSPbN5wsvgrLJK5hdwNQSoh_bZlXH7rylroSVcAQ6XmBWmxa3XfDGdAsEhITR0cbVHqwQjue_laQf8JxM9GoGubSF06G4uzoSEXuixINAft_nQ3s8fkQDBy-Q6kkhcGgHtWZHcTw_SVmbRZHySOWK20 Sep 23 04:31:33.786826 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:31:33.786826 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:31:33.786826 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:31:33.786826 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:31:33.786826 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:31:33.786826 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:31:33.786826 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 79442cd4a69040f594e19b3492df7e7e Sep 23 04:31:33.786826 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1289949374 Sep 23 04:31:33.786826 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:31:33.786826 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:31:33.787986 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_79442cd4a69040f594e19b3492df7e7e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/79442cd4a69040f594e19b3492df7e7e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/79442cd4a69040f594e19b3492df7e7e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/79442cd4a69040f594e19b3492df7e7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:31:33.787986 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-DeleteServersAdminTestJSON-1289949374 Sep 23 04:31:33.787986 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 79442cd4a69040f594e19b3492df7e7e Sep 23 04:31:33.787986 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1289949374 Sep 23 04:31:33.787986 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-DeleteServersAdminTestJSON-1289949374-project Sep 23 04:31:33.787986 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:31:33.787986 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:31:33.787986 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: ac39d27bcf5d4def9ff9bd5b81bd7b76 Sep 23 04:31:33.787986 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-DeleteServersAdminTestJSON-1289949374-project Sep 23 04:31:33.787986 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:31:33.787986 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance e18459f8-cd71-4feb-8764-c3b4cc3d89be could not be found. Sep 23 04:31:33.787986 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': 'e18459f8-cd71-4feb-8764-c3b4cc3d89be'} Sep 23 04:31:33.788657 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:31:33.788657 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:31:33.788657 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:31:33.788657 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:31:33.788657 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:31:33.788657 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:31:33.788657 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:31:33.788657 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:31:33.788657 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:31:33.788657 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:31:33.788657 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e18459f8-cd71-4feb-8764-c3b4cc3d89be could not be found. Sep 23 04:31:33.788657 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:31:33.788657 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:31:33.788657 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:31:33.788657 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:31:33.788657 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:31:33.788657 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:31:33.788657 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:31:33.788657 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:31:33.788657 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:31:33.789757 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:31:33.789757 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:31:33.789757 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:31:33.789757 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:31:33.789757 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:31:33.789757 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:31:33.789757 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:31:33.789757 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e18459f8-cd71-4feb-8764-c3b4cc3d89be could not be found. Sep 23 04:31:33.789757 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:31:33.789757 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:31:33.789757 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:31:33.789757 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:31:33.789757 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:31:33.789757 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:31:33.789757 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:31:33.789757 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:31:33.789757 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e18459f8-cd71-4feb-8764-c3b4cc3d89be could not be found. Sep 23 04:31:33.789757 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:31:33.791028 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-41279578-c4ad-4902-b6ad-392828b8f53c tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Returning 404 to user: Instance e18459f8-cd71-4feb-8764-c3b4cc3d89be could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:31:33.791028 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-41279578-c4ad-4902-b6ad-392828b8f53c tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] 10.222.0.33 "GET /compute/v2.1/servers/e18459f8-cd71-4feb-8764-c3b4cc3d89be" status: 404 len: 111 microversion: 2.1 time: 0.079657 Sep 23 04:31:33.791028 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 106/194] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:31:33 2022] GET /compute/v2.1/servers/e18459f8-cd71-4feb-8764-c3b4cc3d89be => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:31:33.797831 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3963e38d-6960-4723-8b26-cf59a8fc2388 tempest-FlavorsAccessNegativeTestJSON-176088663 tempest-FlavorsAccessNegativeTestJSON-176088663-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-883422356", "id": 1555342456, "os-flavor-access:is_public": "False"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:31:33.933345 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3963e38d-6960-4723-8b26-cf59a8fc2388 tempest-FlavorsAccessNegativeTestJSON-176088663 tempest-FlavorsAccessNegativeTestJSON-176088663-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.141244 Sep 23 04:31:33.934586 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 107/195] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:31:33 2022] POST /compute/v2.1/flavors => generated 438 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:31:33.954548 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a5ac4e3a-7312-466d-b88f-40686cba6f5c tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:33.954996 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a5ac4e3a-7312-466d-b88f-40686cba6f5c tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: bbf05a2b-af42-4f14-8956-4f6249c46974] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:33.993429 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-81e6158f-e7cb-415d-9f5c-a7194b92451a tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 242 microversion: 2.1 time: 0.375252 Sep 23 04:31:33.994344 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 89/196] 10.222.0.33 () {60 vars in 1191 bytes} [Fri Sep 23 04:31:33 2022] POST /compute/v2.1/os-aggregates/8/action => generated 242 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:31:34.000914 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e415051b-f629-466a-9789-5197dce1c2bb tempest-FlavorsAccessNegativeTestJSON-176088663 tempest-FlavorsAccessNegativeTestJSON-176088663-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "99ca8dfa1f6b4013ac7dad0d243772bf"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:31:34.043213 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a5ac4e3a-7312-466d-b88f-40686cba6f5c tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:34.056465 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a5ac4e3a-7312-466d-b88f-40686cba6f5c tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:34.059054 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a5ac4e3a-7312-466d-b88f-40686cba6f5c tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:34.060444 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a5ac4e3a-7312-466d-b88f-40686cba6f5c tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/bbf05a2b-af42-4f14-8956-4f6249c46974" status: 200 len: 1262 microversion: 2.25 time: 0.123826 Sep 23 04:31:34.060942 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 108/197] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:31:33 2022] GET /compute/v2.1/servers/bbf05a2b-af42-4f14-8956-4f6249c46974 => generated 1262 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:31:34.066264 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-93e5e4c7-4cf5-450a-ae44-e57ea0ec3966 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1296553280", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:31:34.134865 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.network.neutron [None req-93e5e4c7-4cf5-450a-ae44-e57ea0ec3966 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] validate_networks() for None {{(pid=122698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:31:34.330553 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-e415051b-f629-466a-9789-5197dce1c2bb tempest-FlavorsAccessNegativeTestJSON-176088663 tempest-FlavorsAccessNegativeTestJSON-176088663-project-admin] HTTP exception thrown: Flavor access not found for 25 / 99ca8dfa1f6b4013ac7dad0d243772bf combination. Sep 23 04:31:34.334054 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e415051b-f629-466a-9789-5197dce1c2bb tempest-FlavorsAccessNegativeTestJSON-176088663 tempest-FlavorsAccessNegativeTestJSON-176088663-project-admin] Request method failure captured: Sep 23 04:31:34.334054 n-d-846463-3 devstack@n-api.service[122699]: request: POST /compute/v2.1/flavors/1555342456/action HTTP/1.1 Sep 23 04:31:34.334054 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:31:34.334054 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:31:34.334054 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:31:34.334054 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 70 Sep 23 04:31:34.334054 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:31:34.334054 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:31:34.334054 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:31:34.334054 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:31:34.334054 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTaXX9Sl4WL8VBXeSMNCd4q34w1EXQfVHG9ArjHheEroXrHHtBPuq_-oNst2bcBswIlXHbSKY73GnrpPg68V4iv1DreLAQs6QRkGMru80ufT87bDVgRXDA_1UhTbuZZSQAKQuwDdcxCQBr3vXhqbfINqNJxDpPmyXhU5Kv-QZbrhSDE Sep 23 04:31:34.334054 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:31:34.334054 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:31:34.334054 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:31:34.334054 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:31:34.334054 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:31:34.334054 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:31:34.334054 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 199d065b5bef446185af6a619e85adfe Sep 23 04:31:34.334054 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-176088663 Sep 23 04:31:34.334054 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,admin,member Sep 23 04:31:34.334054 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,admin,member Sep 23 04:31:34.341226 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_199d065b5bef446185af6a619e85adfe", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/199d065b5bef446185af6a619e85adfe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/199d065b5bef446185af6a619e85adfe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/199d065b5bef446185af6a619e85adfe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:31:34.341226 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-176088663 Sep 23 04:31:34.341226 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 199d065b5bef446185af6a619e85adfe Sep 23 04:31:34.341226 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-176088663 Sep 23 04:31:34.341226 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-FlavorsAccessNegativeTestJSON-176088663-project-admin Sep 23 04:31:34.341226 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:31:34.341226 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:31:34.341226 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 54d6971179c04c91b5f631ca3c3265d6 Sep 23 04:31:34.341226 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-176088663-project-admin Sep 23 04:31:34.341226 n-d-846463-3 devstack@n-api.service[122699]: Sep 23 04:31:34.341226 n-d-846463-3 devstack@n-api.service[122699]: {"removeTenantAccess": {"tenant": "99ca8dfa1f6b4013ac7dad0d243772bf"}} Sep 23 04:31:34.341226 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:31:34.342506 n-d-846463-3 devstack@n-api.service[122699]: exception: Flavor access not found for 25 / 99ca8dfa1f6b4013ac7dad0d243772bf combination. Sep 23 04:31:34.342506 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '1555342456', 'body': {'removeTenantAccess': {'tenant': '99ca8dfa1f6b4013ac7dad0d243772bf'}}} Sep 23 04:31:34.342506 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:31:34.342506 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:31:34.342506 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Sep 23 04:31:34.342506 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Sep 23 04:31:34.342506 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 23 04:31:34.342506 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 23 04:31:34.342506 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Sep 23 04:31:34.342506 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Sep 23 04:31:34.342506 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Sep 23 04:31:34.342506 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Sep 23 04:31:34.342506 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Sep 23 04:31:34.342506 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Sep 23 04:31:34.342506 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 23 04:31:34.342506 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 23 04:31:34.342506 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Sep 23 04:31:34.342506 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Sep 23 04:31:34.343451 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 25 / 99ca8dfa1f6b4013ac7dad0d243772bf combination. Sep 23 04:31:34.343451 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:31:34.343451 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:31:34.343451 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:31:34.343451 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:31:34.343451 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:31:34.343451 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:31:34.343451 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:31:34.343451 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:31:34.343451 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:31:34.343451 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:31:34.343451 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:31:34.343451 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:31:34.343451 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Sep 23 04:31:34.343451 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:31:34.343451 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 25 / 99ca8dfa1f6b4013ac7dad0d243772bf combination. Sep 23 04:31:34.343451 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:31:34.343451 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:31:34.343451 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:31:34.343451 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:31:34.344476 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:31:34.344476 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:31:34.344476 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:31:34.344476 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:31:34.344476 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 25 / 99ca8dfa1f6b4013ac7dad0d243772bf combination. Sep 23 04:31:34.344476 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:31:34.344476 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e415051b-f629-466a-9789-5197dce1c2bb tempest-FlavorsAccessNegativeTestJSON-176088663 tempest-FlavorsAccessNegativeTestJSON-176088663-project-admin] Returning 404 to user: Flavor access not found for 25 / 99ca8dfa1f6b4013ac7dad0d243772bf combination. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:31:34.344476 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e415051b-f629-466a-9789-5197dce1c2bb tempest-FlavorsAccessNegativeTestJSON-176088663 tempest-FlavorsAccessNegativeTestJSON-176088663-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/1555342456/action" status: 404 len: 124 microversion: 2.1 time: 0.340432 Sep 23 04:31:34.344476 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 90/198] 10.222.0.33 () {60 vars in 1200 bytes} [Fri Sep 23 04:31:33 2022] POST /compute/v2.1/flavors/1555342456/action => generated 124 bytes in 345 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:31:34.353287 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-18cec841-af3a-420a-9973-e57030dfe12b tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:34.363177 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-18cec841-af3a-420a-9973-e57030dfe12b tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 242 microversion: 2.1 time: 0.022124 Sep 23 04:31:34.365996 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 91/199] 10.222.0.33 () {58 vars in 1149 bytes} [Fri Sep 23 04:31:34 2022] GET /compute/v2.1/os-aggregates/8 => generated 242 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:31:34.375748 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ce0b3228-589b-40b0-a028-9710cf51f221 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:34.376547 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ce0b3228-589b-40b0-a028-9710cf51f221 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] [instance: 074ac5a1-94af-4e9d-b458-107710ca0972] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:34.383870 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ce0b3228-589b-40b0-a028-9710cf51f221 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:34.384717 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ce0b3228-589b-40b0-a028-9710cf51f221 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:34.385575 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ce0b3228-589b-40b0-a028-9710cf51f221 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:34.386611 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ce0b3228-589b-40b0-a028-9710cf51f221 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:34.387476 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ce0b3228-589b-40b0-a028-9710cf51f221 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:34.388068 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ce0b3228-589b-40b0-a028-9710cf51f221 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:34.504844 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-93e5e4c7-4cf5-450a-ae44-e57ea0ec3966 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Flavor limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:31:34.505348 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-93e5e4c7-4cf5-450a-ae44-e57ea0ec3966 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Image limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:31:34.505806 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-93e5e4c7-4cf5-450a-ae44-e57ea0ec3966 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Flavor pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:31:34.506466 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-93e5e4c7-4cf5-450a-ae44-e57ea0ec3966 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Image pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:31:34.507048 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-93e5e4c7-4cf5-450a-ae44-e57ea0ec3966 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:31:34.527132 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-93e5e4c7-4cf5-450a-ae44-e57ea0ec3966 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:34.527633 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-93e5e4c7-4cf5-450a-ae44-e57ea0ec3966 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:34.528076 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-93e5e4c7-4cf5-450a-ae44-e57ea0ec3966 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:34.528817 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-93e5e4c7-4cf5-450a-ae44-e57ea0ec3966 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:34.529283 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-93e5e4c7-4cf5-450a-ae44-e57ea0ec3966 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:34.529722 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-93e5e4c7-4cf5-450a-ae44-e57ea0ec3966 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:34.560577 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-93e5e4c7-4cf5-450a-ae44-e57ea0ec3966 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Getting quotas for project 79442cd4a69040f594e19b3492df7e7e. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:31:34.571851 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-93e5e4c7-4cf5-450a-ae44-e57ea0ec3966 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Getting quotas for user ac39d27bcf5d4def9ff9bd5b81bd7b76 and project 79442cd4a69040f594e19b3492df7e7e. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:31:34.586194 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-93e5e4c7-4cf5-450a-ae44-e57ea0ec3966 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Going to run 1 instances... {{(pid=122698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:31:34.588892 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-93e5e4c7-4cf5-450a-ae44-e57ea0ec3966 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] [instance: 24b8436f-97ba-49c5-ad91-8aea43f0e755] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:31:34.637585 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ce0b3228-589b-40b0-a028-9710cf51f221 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcc413bf53847b89cfe6bdf48909ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c7c21aa6b342b6bc52365cfdeb7c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:34.671073 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ce0b3228-589b-40b0-a028-9710cf51f221 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] 10.222.0.33 "GET /compute/v2.1/servers/074ac5a1-94af-4e9d-b458-107710ca0972" status: 200 len: 1387 microversion: 2.1 time: 0.305953 Sep 23 04:31:34.674669 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 92/200] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:31:34 2022] GET /compute/v2.1/servers/074ac5a1-94af-4e9d-b458-107710ca0972 => generated 1387 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:31:34.694979 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9185cc92-56ba-4ca2-ba25-4dcdc42f91ac tempest-FlavorsAccessNegativeTestJSON-176088663 tempest-FlavorsAccessNegativeTestJSON-176088663-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:34.788634 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-9185cc92-56ba-4ca2-ba25-4dcdc42f91ac tempest-FlavorsAccessNegativeTestJSON-176088663 tempest-FlavorsAccessNegativeTestJSON-176088663-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/1555342456" status: 202 len: 0 microversion: 2.1 time: 0.111038 Sep 23 04:31:34.789645 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 93/201] 10.222.0.33 () {58 vars in 1161 bytes} [Fri Sep 23 04:31:34 2022] DELETE /compute/v2.1/flavors/1555342456 => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:31:34.795639 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-71099f08-9341-4c81-a4ed-53785db99cc6 tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-846463-3"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:31:34.803455 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-93e5e4c7-4cf5-450a-ae44-e57ea0ec3966 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.740692 Sep 23 04:31:34.807077 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 109/202] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:31:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 745 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:31:34.819690 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-939b285d-fa76-42c5-9d86-7f2537b03f1b tempest-FlavorsAccessNegativeTestJSON-176088663 tempest-FlavorsAccessNegativeTestJSON-176088663-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:34.830974 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-71099f08-9341-4c81-a4ed-53785db99cc6 tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:34.833182 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-71099f08-9341-4c81-a4ed-53785db99cc6 tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:34.834107 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-71099f08-9341-4c81-a4ed-53785db99cc6 tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:34.861910 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-939b285d-fa76-42c5-9d86-7f2537b03f1b tempest-FlavorsAccessNegativeTestJSON-176088663 tempest-FlavorsAccessNegativeTestJSON-176088663-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.052003 Sep 23 04:31:34.863872 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 110/203] 10.222.0.33 () {58 vars in 1146 bytes} [Fri Sep 23 04:31:34 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:31:34.872007 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2d755595-a1f5-4b72-8265-d93560879172 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:34.872935 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-2d755595-a1f5-4b72-8265-d93560879172 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] [instance: 24b8436f-97ba-49c5-ad91-8aea43f0e755] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:34.965675 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-2d755595-a1f5-4b72-8265-d93560879172 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac39d27bcf5d4def9ff9bd5b81bd7b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79442cd4a69040f594e19b3492df7e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:34.980803 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2d755595-a1f5-4b72-8265-d93560879172 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] 10.222.0.33 "GET /compute/v2.1/servers/24b8436f-97ba-49c5-ad91-8aea43f0e755" status: 200 len: 1220 microversion: 2.1 time: 0.114888 Sep 23 04:31:34.993927 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 111/204] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:31:34 2022] GET /compute/v2.1/servers/24b8436f-97ba-49c5-ad91-8aea43f0e755 => generated 1220 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:31:35.086746 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d45f8277-b79c-4b5b-b079-eebd7e942942 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:35.088051 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d45f8277-b79c-4b5b-b079-eebd7e942942 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: bbf05a2b-af42-4f14-8956-4f6249c46974] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:35.103997 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d45f8277-b79c-4b5b-b079-eebd7e942942 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:35.104676 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d45f8277-b79c-4b5b-b079-eebd7e942942 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:35.105313 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d45f8277-b79c-4b5b-b079-eebd7e942942 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:35.106948 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d45f8277-b79c-4b5b-b079-eebd7e942942 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:35.108283 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d45f8277-b79c-4b5b-b079-eebd7e942942 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:35.109312 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d45f8277-b79c-4b5b-b079-eebd7e942942 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:35.247907 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-71099f08-9341-4c81-a4ed-53785db99cc6 tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 227 microversion: 2.1 time: 0.456684 Sep 23 04:31:35.255823 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 94/205] 10.222.0.33 () {60 vars in 1191 bytes} [Fri Sep 23 04:31:34 2022] POST /compute/v2.1/os-aggregates/8/action => generated 227 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:31:35.258625 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d45f8277-b79c-4b5b-b079-eebd7e942942 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:35.264840 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-64d067a9-7638-4a27-ac04-3b7f71315f08 tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:35.271926 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d45f8277-b79c-4b5b-b079-eebd7e942942 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:35.273875 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d45f8277-b79c-4b5b-b079-eebd7e942942 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:35.276899 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d45f8277-b79c-4b5b-b079-eebd7e942942 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/bbf05a2b-af42-4f14-8956-4f6249c46974" status: 200 len: 1314 microversion: 2.25 time: 0.194426 Sep 23 04:31:35.278534 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 112/206] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:31:35 2022] GET /compute/v2.1/servers/bbf05a2b-af42-4f14-8956-4f6249c46974 => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:31:35.426905 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-64d067a9-7638-4a27-ac04-3b7f71315f08 tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.169754 Sep 23 04:31:35.428088 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 95/207] 10.222.0.33 () {58 vars in 1152 bytes} [Fri Sep 23 04:31:35 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 23 04:31:35.441838 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-33adf05d-5fd1-4794-9ea8-dfe31031519b tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1944466372"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:31:35.446718 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.aggregate [None req-33adf05d-5fd1-4794-9ea8-dfe31031519b tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] Generated uuid 4681f231-650c-47c2-b51e-d34605ff7b1c for aggregate {{(pid=122698) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 23 04:31:35.568658 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-33adf05d-5fd1-4794-9ea8-dfe31031519b tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.131411 Sep 23 04:31:35.575814 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 113/208] 10.222.0.33 () {60 vars in 1164 bytes} [Fri Sep 23 04:31:35 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:31:35.585317 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f3369d06-8881-4898-899f-ad9281b4f069 tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-846463-3"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:31:35.600073 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f3369d06-8881-4898-899f-ad9281b4f069 tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:35.600835 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f3369d06-8881-4898-899f-ad9281b4f069 tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:35.601523 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f3369d06-8881-4898-899f-ad9281b4f069 tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:35.703046 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f2409a3d-11c6-4c42-8d18-e3c71b1548e4 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:35.704562 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f2409a3d-11c6-4c42-8d18-e3c71b1548e4 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] [instance: 074ac5a1-94af-4e9d-b458-107710ca0972] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:35.713533 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f2409a3d-11c6-4c42-8d18-e3c71b1548e4 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:35.714075 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f2409a3d-11c6-4c42-8d18-e3c71b1548e4 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:35.714523 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f2409a3d-11c6-4c42-8d18-e3c71b1548e4 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:35.715275 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f2409a3d-11c6-4c42-8d18-e3c71b1548e4 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:35.715739 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f2409a3d-11c6-4c42-8d18-e3c71b1548e4 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:35.716231 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f2409a3d-11c6-4c42-8d18-e3c71b1548e4 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:35.949923 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f2409a3d-11c6-4c42-8d18-e3c71b1548e4 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcc413bf53847b89cfe6bdf48909ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c7c21aa6b342b6bc52365cfdeb7c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:35.951631 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f3369d06-8881-4898-899f-ad9281b4f069 tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 242 microversion: 2.1 time: 0.373761 Sep 23 04:31:35.953237 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f2409a3d-11c6-4c42-8d18-e3c71b1548e4 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] 10.222.0.33 "GET /compute/v2.1/servers/074ac5a1-94af-4e9d-b458-107710ca0972" status: 200 len: 1387 microversion: 2.1 time: 0.260469 Sep 23 04:31:35.966416 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 114/209] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:31:35 2022] GET /compute/v2.1/servers/074ac5a1-94af-4e9d-b458-107710ca0972 => generated 1387 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:31:35.966941 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 96/210] 10.222.0.33 () {60 vars in 1191 bytes} [Fri Sep 23 04:31:35 2022] POST /compute/v2.1/os-aggregates/9/action => generated 242 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:31:35.971150 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f7a05e2a-d412-4ebb-a8ee-c9156be73080 tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:35.985084 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f7a05e2a-d412-4ebb-a8ee-c9156be73080 tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.1 time: 0.019891 Sep 23 04:31:35.986000 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 115/211] 10.222.0.33 () {58 vars in 1143 bytes} [Fri Sep 23 04:31:35 2022] GET /compute/v2.1/os-aggregates => generated 245 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:31:35.998676 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3de099a9-1772-41d0-8d24-754decc5c51f tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-846463-3"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:31:36.010275 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-233e6e97-87c7-4a39-ae41-ca8a234cba4a tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:36.013223 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-233e6e97-87c7-4a39-ae41-ca8a234cba4a tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] [instance: 24b8436f-97ba-49c5-ad91-8aea43f0e755] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:36.013979 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3de099a9-1772-41d0-8d24-754decc5c51f tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:36.014490 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3de099a9-1772-41d0-8d24-754decc5c51f tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:36.014931 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3de099a9-1772-41d0-8d24-754decc5c51f tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:36.118697 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-233e6e97-87c7-4a39-ae41-ca8a234cba4a tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac39d27bcf5d4def9ff9bd5b81bd7b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79442cd4a69040f594e19b3492df7e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:36.130484 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-233e6e97-87c7-4a39-ae41-ca8a234cba4a tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] 10.222.0.33 "GET /compute/v2.1/servers/24b8436f-97ba-49c5-ad91-8aea43f0e755" status: 200 len: 1220 microversion: 2.1 time: 0.125633 Sep 23 04:31:36.146030 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 116/212] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:31:36 2022] GET /compute/v2.1/servers/24b8436f-97ba-49c5-ad91-8aea43f0e755 => generated 1220 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:31:36.309774 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1004ea2f-83ff-49d7-85d7-a085278b78f4 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:36.313593 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-1004ea2f-83ff-49d7-85d7-a085278b78f4 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: bbf05a2b-af42-4f14-8956-4f6249c46974] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:36.320799 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1004ea2f-83ff-49d7-85d7-a085278b78f4 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:36.321373 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1004ea2f-83ff-49d7-85d7-a085278b78f4 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:36.321972 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1004ea2f-83ff-49d7-85d7-a085278b78f4 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:36.322745 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1004ea2f-83ff-49d7-85d7-a085278b78f4 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:36.323480 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1004ea2f-83ff-49d7-85d7-a085278b78f4 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:36.324097 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1004ea2f-83ff-49d7-85d7-a085278b78f4 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:36.439160 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-1004ea2f-83ff-49d7-85d7-a085278b78f4 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:36.452547 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-1004ea2f-83ff-49d7-85d7-a085278b78f4 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:36.454280 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-1004ea2f-83ff-49d7-85d7-a085278b78f4 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:36.455593 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-1004ea2f-83ff-49d7-85d7-a085278b78f4 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/bbf05a2b-af42-4f14-8956-4f6249c46974" status: 200 len: 1320 microversion: 2.25 time: 0.153517 Sep 23 04:31:36.457256 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 117/213] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:31:36 2022] GET /compute/v2.1/servers/bbf05a2b-af42-4f14-8956-4f6249c46974 => generated 1320 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:31:36.483674 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3de099a9-1772-41d0-8d24-754decc5c51f tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 227 microversion: 2.1 time: 0.489310 Sep 23 04:31:36.484834 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 97/214] 10.222.0.33 () {60 vars in 1191 bytes} [Fri Sep 23 04:31:35 2022] POST /compute/v2.1/os-aggregates/9/action => generated 227 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:31:36.500453 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-23dee732-643b-4995-88e8-c2c7c9b5f6e4 tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:36.626321 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-23dee732-643b-4995-88e8-c2c7c9b5f6e4 tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.131558 Sep 23 04:31:36.626931 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 118/215] 10.222.0.33 () {58 vars in 1152 bytes} [Fri Sep 23 04:31:36 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 23 04:31:36.639711 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ad2561d8-78ff-4acf-ba55-48797eeee947 tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1719244698"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:31:36.643499 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.aggregate [None req-ad2561d8-78ff-4acf-ba55-48797eeee947 tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] Generated uuid b0b853f5-5cbd-402e-a2a8-eeb47c79b515 for aggregate {{(pid=122699) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 23 04:31:36.752036 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ad2561d8-78ff-4acf-ba55-48797eeee947 tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.116546 Sep 23 04:31:36.759849 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 98/216] 10.222.0.33 () {60 vars in 1164 bytes} [Fri Sep 23 04:31:36 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:31:36.773122 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-cd1b832e-d7c7-4ea6-b86e-33f8c53974d3 tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-846463-3"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:31:36.791673 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cd1b832e-d7c7-4ea6-b86e-33f8c53974d3 tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:36.792178 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cd1b832e-d7c7-4ea6-b86e-33f8c53974d3 tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:36.793560 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cd1b832e-d7c7-4ea6-b86e-33f8c53974d3 tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:36.978571 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-64e6fb0d-444f-415e-8926-e6eaf1667bf0 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:36.979241 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-64e6fb0d-444f-415e-8926-e6eaf1667bf0 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] [instance: 074ac5a1-94af-4e9d-b458-107710ca0972] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:36.986044 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-64e6fb0d-444f-415e-8926-e6eaf1667bf0 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:36.986538 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-64e6fb0d-444f-415e-8926-e6eaf1667bf0 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:36.991721 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-64e6fb0d-444f-415e-8926-e6eaf1667bf0 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:36.991721 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-64e6fb0d-444f-415e-8926-e6eaf1667bf0 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:36.991721 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-64e6fb0d-444f-415e-8926-e6eaf1667bf0 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:36.991721 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-64e6fb0d-444f-415e-8926-e6eaf1667bf0 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:37.327263 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-64e6fb0d-444f-415e-8926-e6eaf1667bf0 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcc413bf53847b89cfe6bdf48909ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c7c21aa6b342b6bc52365cfdeb7c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:37.339001 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-64e6fb0d-444f-415e-8926-e6eaf1667bf0 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] 10.222.0.33 "GET /compute/v2.1/servers/074ac5a1-94af-4e9d-b458-107710ca0972" status: 200 len: 1387 microversion: 2.1 time: 0.365116 Sep 23 04:31:37.340309 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 99/217] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:31:36 2022] GET /compute/v2.1/servers/074ac5a1-94af-4e9d-b458-107710ca0972 => generated 1387 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:31:37.358689 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c4f3fe6b-2971-4a3a-8600-d908292fab61 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:37.359324 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c4f3fe6b-2971-4a3a-8600-d908292fab61 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] [instance: 24b8436f-97ba-49c5-ad91-8aea43f0e755] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:37.377583 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c4f3fe6b-2971-4a3a-8600-d908292fab61 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:37.378347 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c4f3fe6b-2971-4a3a-8600-d908292fab61 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:37.380444 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c4f3fe6b-2971-4a3a-8600-d908292fab61 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:37.381350 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c4f3fe6b-2971-4a3a-8600-d908292fab61 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:37.382427 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c4f3fe6b-2971-4a3a-8600-d908292fab61 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:37.383838 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c4f3fe6b-2971-4a3a-8600-d908292fab61 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:37.478361 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c4f3fe6b-2971-4a3a-8600-d908292fab61 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac39d27bcf5d4def9ff9bd5b81bd7b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79442cd4a69040f594e19b3492df7e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:37.520794 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c4f3fe6b-2971-4a3a-8600-d908292fab61 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] 10.222.0.33 "GET /compute/v2.1/servers/24b8436f-97ba-49c5-ad91-8aea43f0e755" status: 200 len: 1272 microversion: 2.1 time: 0.176091 Sep 23 04:31:37.551705 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 100/218] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:31:37 2022] GET /compute/v2.1/servers/24b8436f-97ba-49c5-ad91-8aea43f0e755 => generated 1272 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:31:37.569577 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-86f7aa03-b4db-4e70-9adf-983e5db73d66 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:37.570511 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-86f7aa03-b4db-4e70-9adf-983e5db73d66 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: bbf05a2b-af42-4f14-8956-4f6249c46974] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:37.577742 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-86f7aa03-b4db-4e70-9adf-983e5db73d66 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:37.578669 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-86f7aa03-b4db-4e70-9adf-983e5db73d66 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:37.579366 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-86f7aa03-b4db-4e70-9adf-983e5db73d66 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:37.580298 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-86f7aa03-b4db-4e70-9adf-983e5db73d66 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:37.581112 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-86f7aa03-b4db-4e70-9adf-983e5db73d66 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:37.581745 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-86f7aa03-b4db-4e70-9adf-983e5db73d66 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:37.870788 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-86f7aa03-b4db-4e70-9adf-983e5db73d66 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:37.887184 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-86f7aa03-b4db-4e70-9adf-983e5db73d66 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:37.897321 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-86f7aa03-b4db-4e70-9adf-983e5db73d66 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:37.902957 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-86f7aa03-b4db-4e70-9adf-983e5db73d66 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/bbf05a2b-af42-4f14-8956-4f6249c46974" status: 200 len: 1362 microversion: 2.25 time: 0.346969 Sep 23 04:31:37.905160 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 101/219] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:31:37 2022] GET /compute/v2.1/servers/bbf05a2b-af42-4f14-8956-4f6249c46974 => generated 1362 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:31:38.069333 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-cd1b832e-d7c7-4ea6-b86e-33f8c53974d3 tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 243 microversion: 2.1 time: 1.299856 Sep 23 04:31:38.072288 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 119/220] 10.222.0.33 () {60 vars in 1194 bytes} [Fri Sep 23 04:31:36 2022] POST /compute/v2.1/os-aggregates/10/action => generated 243 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:31:38.082784 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9e746988-372e-4fca-89d1-53755717b9b3 tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-846463-3"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:31:38.122260 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9e746988-372e-4fca-89d1-53755717b9b3 tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:38.123096 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9e746988-372e-4fca-89d1-53755717b9b3 tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:38.127169 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9e746988-372e-4fca-89d1-53755717b9b3 tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:38.522697 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-9e746988-372e-4fca-89d1-53755717b9b3 tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 228 microversion: 2.1 time: 0.443996 Sep 23 04:31:38.534924 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 102/221] 10.222.0.33 () {60 vars in 1194 bytes} [Fri Sep 23 04:31:38 2022] POST /compute/v2.1/os-aggregates/10/action => generated 228 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:31:38.546631 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-586e8b81-206d-4310-9acd-0e82fd9dc501 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:38.558859 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-586e8b81-206d-4310-9acd-0e82fd9dc501 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] [instance: 074ac5a1-94af-4e9d-b458-107710ca0972] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:38.573119 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-586e8b81-206d-4310-9acd-0e82fd9dc501 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:38.576392 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-586e8b81-206d-4310-9acd-0e82fd9dc501 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:38.578999 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-586e8b81-206d-4310-9acd-0e82fd9dc501 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:38.579812 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-586e8b81-206d-4310-9acd-0e82fd9dc501 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:38.580875 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-586e8b81-206d-4310-9acd-0e82fd9dc501 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:38.581451 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-586e8b81-206d-4310-9acd-0e82fd9dc501 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:38.686016 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8f55c0bb-30a4-4a36-887a-f1a35a736039 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1237753635", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:31:38.757733 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.network.neutron [None req-8f55c0bb-30a4-4a36-887a-f1a35a736039 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] validate_networks() for None {{(pid=122698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:31:39.018606 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-586e8b81-206d-4310-9acd-0e82fd9dc501 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcc413bf53847b89cfe6bdf48909ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c7c21aa6b342b6bc52365cfdeb7c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:39.027415 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-586e8b81-206d-4310-9acd-0e82fd9dc501 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] 10.222.0.33 "GET /compute/v2.1/servers/074ac5a1-94af-4e9d-b458-107710ca0972" status: 200 len: 1387 microversion: 2.1 time: 0.491106 Sep 23 04:31:39.045913 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 103/222] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:31:38 2022] GET /compute/v2.1/servers/074ac5a1-94af-4e9d-b458-107710ca0972 => generated 1387 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:31:39.052586 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-c5edc998-0854-48c4-8a87-aacabed1d3b5 req-fc42018d-4b1b-4985-95fe-7f3418784186 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbf05a2b-af42-4f14-8956-4f6249c46974", "tag": "e5083905-a132-4abf-8cec-deb2f60a1547"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:31:39.068902 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-c5edc998-0854-48c4-8a87-aacabed1d3b5 req-fc42018d-4b1b-4985-95fe-7f3418784186 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:39.069214 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-c5edc998-0854-48c4-8a87-aacabed1d3b5 req-fc42018d-4b1b-4985-95fe-7f3418784186 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:39.070751 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-c5edc998-0854-48c4-8a87-aacabed1d3b5 req-fc42018d-4b1b-4985-95fe-7f3418784186 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:39.087045 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-c5edc998-0854-48c4-8a87-aacabed1d3b5 req-fc42018d-4b1b-4985-95fe-7f3418784186 service nova] Creating event network-changed:e5083905-a132-4abf-8cec-deb2f60a1547 for instance bbf05a2b-af42-4f14-8956-4f6249c46974 on n-h2-846463-3 Sep 23 04:31:39.094900 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-c5edc998-0854-48c4-8a87-aacabed1d3b5 req-fc42018d-4b1b-4985-95fe-7f3418784186 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057991 Sep 23 04:31:39.098449 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 104/223] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:31:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:31:39.107657 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8bc4934f-a940-4b4c-be39-44b902a2f4b3 tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:39.220328 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-8bc4934f-a940-4b4c-be39-44b902a2f4b3 tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.119089 Sep 23 04:31:39.221718 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 105/224] 10.222.0.33 () {58 vars in 1155 bytes} [Fri Sep 23 04:31:39 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 23 04:31:39.229720 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1f07a3b1-8833-4b35-8952-bf7b8c01f6b6 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:39.232864 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1f07a3b1-8833-4b35-8952-bf7b8c01f6b6 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] [instance: 24b8436f-97ba-49c5-ad91-8aea43f0e755] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:39.248023 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1f07a3b1-8833-4b35-8952-bf7b8c01f6b6 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:39.250183 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1f07a3b1-8833-4b35-8952-bf7b8c01f6b6 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:39.252770 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1f07a3b1-8833-4b35-8952-bf7b8c01f6b6 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:39.256308 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1f07a3b1-8833-4b35-8952-bf7b8c01f6b6 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:39.257017 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1f07a3b1-8833-4b35-8952-bf7b8c01f6b6 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:39.261297 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1f07a3b1-8833-4b35-8952-bf7b8c01f6b6 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:39.474243 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-8f55c0bb-30a4-4a36-887a-f1a35a736039 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Flavor limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:31:39.474682 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-8f55c0bb-30a4-4a36-887a-f1a35a736039 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Image limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:31:39.475500 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-8f55c0bb-30a4-4a36-887a-f1a35a736039 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Flavor pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:31:39.475958 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-8f55c0bb-30a4-4a36-887a-f1a35a736039 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Image pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:31:39.476635 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-8f55c0bb-30a4-4a36-887a-f1a35a736039 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:31:39.515070 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8f55c0bb-30a4-4a36-887a-f1a35a736039 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:39.518615 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8f55c0bb-30a4-4a36-887a-f1a35a736039 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:39.519974 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8f55c0bb-30a4-4a36-887a-f1a35a736039 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:39.520834 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8f55c0bb-30a4-4a36-887a-f1a35a736039 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:39.521321 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8f55c0bb-30a4-4a36-887a-f1a35a736039 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:39.521763 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8f55c0bb-30a4-4a36-887a-f1a35a736039 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:39.568361 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-8f55c0bb-30a4-4a36-887a-f1a35a736039 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Getting quotas for project 649eb80e1ea849868c651849047833e1. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:31:39.577091 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:INSERT=7,nova_api:SELECT=87,nova_api:DELETE=6 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:31:39.583923 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-8f55c0bb-30a4-4a36-887a-f1a35a736039 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Getting quotas for user 54d1a7a9e4ee44b9992ff9362108b311 and project 649eb80e1ea849868c651849047833e1. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:31:39.605869 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8f55c0bb-30a4-4a36-887a-f1a35a736039 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Going to run 1 instances... {{(pid=122698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:31:39.608568 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8f55c0bb-30a4-4a36-887a-f1a35a736039 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] [instance: ed83bf5a-f3ce-4b5c-af6f-92b80599a022] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:31:39.662368 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1f07a3b1-8833-4b35-8952-bf7b8c01f6b6 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac39d27bcf5d4def9ff9bd5b81bd7b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79442cd4a69040f594e19b3492df7e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:39.673653 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1f07a3b1-8833-4b35-8952-bf7b8c01f6b6 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] 10.222.0.33 "GET /compute/v2.1/servers/24b8436f-97ba-49c5-ad91-8aea43f0e755" status: 200 len: 1320 microversion: 2.1 time: 0.450273 Sep 23 04:31:39.677309 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 106/225] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:31:39 2022] GET /compute/v2.1/servers/24b8436f-97ba-49c5-ad91-8aea43f0e755 => generated 1320 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:31:39.688389 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e9aea15d-d94e-43b6-9c46-f32e35bf32af tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:39.693560 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e9aea15d-d94e-43b6-9c46-f32e35bf32af tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: bbf05a2b-af42-4f14-8956-4f6249c46974] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:39.722840 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e9aea15d-d94e-43b6-9c46-f32e35bf32af tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:39.723495 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e9aea15d-d94e-43b6-9c46-f32e35bf32af tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:39.723954 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e9aea15d-d94e-43b6-9c46-f32e35bf32af tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:39.724706 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e9aea15d-d94e-43b6-9c46-f32e35bf32af tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:39.725169 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e9aea15d-d94e-43b6-9c46-f32e35bf32af tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:39.725600 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e9aea15d-d94e-43b6-9c46-f32e35bf32af tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:39.759616 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8f55c0bb-30a4-4a36-887a-f1a35a736039 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.417849 Sep 23 04:31:39.763256 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 120/226] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:31:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1422 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:31:39.792329 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8a04b39c-a422-4be9-90b0-9d09dc2f5b31 tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1522740214"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:31:39.800202 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=100 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:31:39.820352 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.aggregate [None req-8a04b39c-a422-4be9-90b0-9d09dc2f5b31 tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] Generated uuid 5c56644f-b973-44a2-94c5-c9e11bd764f3 for aggregate {{(pid=122698) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 23 04:31:39.959451 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8a04b39c-a422-4be9-90b0-9d09dc2f5b31 tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.180445 Sep 23 04:31:39.960303 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 121/227] 10.222.0.33 () {60 vars in 1164 bytes} [Fri Sep 23 04:31:39 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:31:39.974279 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-100b0104-d0fd-4915-87f5-85a4286a9183 tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1791059242"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:31:39.978697 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.aggregate [None req-100b0104-d0fd-4915-87f5-85a4286a9183 tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] Generated uuid b04018b9-683e-4789-bc01-bd3db6b710ff for aggregate {{(pid=122698) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 23 04:31:39.996323 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e9aea15d-d94e-43b6-9c46-f32e35bf32af tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:40.008494 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e9aea15d-d94e-43b6-9c46-f32e35bf32af tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:40.010102 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e9aea15d-d94e-43b6-9c46-f32e35bf32af tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:40.011612 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e9aea15d-d94e-43b6-9c46-f32e35bf32af tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/bbf05a2b-af42-4f14-8956-4f6249c46974" status: 200 len: 1362 microversion: 2.25 time: 0.330526 Sep 23 04:31:40.012463 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 107/228] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:31:39 2022] GET /compute/v2.1/servers/bbf05a2b-af42-4f14-8956-4f6249c46974 => generated 1362 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:31:40.017830 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4e2fa5e6-f2d2-492a-ba1b-6455c4d7d74d tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:40.019648 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4e2fa5e6-f2d2-492a-ba1b-6455c4d7d74d tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] [instance: ed83bf5a-f3ce-4b5c-af6f-92b80599a022] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:40.129610 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-100b0104-d0fd-4915-87f5-85a4286a9183 tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.168254 Sep 23 04:31:40.130584 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 122/229] 10.222.0.33 () {60 vars in 1164 bytes} [Fri Sep 23 04:31:39 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:31:40.131604 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-4e2fa5e6-f2d2-492a-ba1b-6455c4d7d74d tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54d1a7a9e4ee44b9992ff9362108b311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649eb80e1ea849868c651849047833e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:40.136563 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-695ef0d9-ba75-495e-8e8c-7da4c69f0d5d tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:40.143960 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4e2fa5e6-f2d2-492a-ba1b-6455c4d7d74d tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] 10.222.0.33 "GET /compute/v2.1/servers/ed83bf5a-f3ce-4b5c-af6f-92b80599a022" status: 200 len: 1222 microversion: 2.1 time: 0.128016 Sep 23 04:31:40.149053 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 108/230] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:31:40 2022] GET /compute/v2.1/servers/ed83bf5a-f3ce-4b5c-af6f-92b80599a022 => generated 1222 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:31:40.171626 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-fc1427e0-2b7e-4564-8a1f-d265e0d9f5f2 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:40.174260 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-fc1427e0-2b7e-4564-8a1f-d265e0d9f5f2 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] [instance: 074ac5a1-94af-4e9d-b458-107710ca0972] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:40.191656 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fc1427e0-2b7e-4564-8a1f-d265e0d9f5f2 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:40.192165 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fc1427e0-2b7e-4564-8a1f-d265e0d9f5f2 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:40.192615 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fc1427e0-2b7e-4564-8a1f-d265e0d9f5f2 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:40.194936 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fc1427e0-2b7e-4564-8a1f-d265e0d9f5f2 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:40.196459 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fc1427e0-2b7e-4564-8a1f-d265e0d9f5f2 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:40.198477 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fc1427e0-2b7e-4564-8a1f-d265e0d9f5f2 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:40.277631 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-695ef0d9-ba75-495e-8e8c-7da4c69f0d5d tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.145317 Sep 23 04:31:40.278636 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 123/231] 10.222.0.33 () {58 vars in 1155 bytes} [Fri Sep 23 04:31:40 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 23 04:31:40.284341 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f04aaadd-c2cc-414a-9721-6d19565053df tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-846463-3"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:31:40.303757 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f04aaadd-c2cc-414a-9721-6d19565053df tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:40.304260 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f04aaadd-c2cc-414a-9721-6d19565053df tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:40.306022 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f04aaadd-c2cc-414a-9721-6d19565053df tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:40.385847 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-fc1427e0-2b7e-4564-8a1f-d265e0d9f5f2 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcc413bf53847b89cfe6bdf48909ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c7c21aa6b342b6bc52365cfdeb7c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:40.394659 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-fc1427e0-2b7e-4564-8a1f-d265e0d9f5f2 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] 10.222.0.33 "GET /compute/v2.1/servers/074ac5a1-94af-4e9d-b458-107710ca0972" status: 200 len: 1387 microversion: 2.1 time: 0.246330 Sep 23 04:31:40.397131 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 109/232] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:31:40 2022] GET /compute/v2.1/servers/074ac5a1-94af-4e9d-b458-107710ca0972 => generated 1387 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:31:40.402155 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d2aeba63-1358-4bd8-8b10-1c0a0c8a984f tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:40.423664 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-d2aeba63-1358-4bd8-8b10-1c0a0c8a984f tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] HTTP exception thrown: Aggregate 11 could not be found. Sep 23 04:31:40.427829 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d2aeba63-1358-4bd8-8b10-1c0a0c8a984f tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] Request method failure captured: Sep 23 04:31:40.427829 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/os-aggregates/11 HTTP/1.1 Sep 23 04:31:40.427829 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:31:40.427829 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:31:40.427829 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:31:40.427829 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:31:40.427829 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:31:40.427829 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:31:40.427829 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:31:40.427829 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:31:40.427829 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTZ5kFgsWdY6FVdWL3c-F308nq6ljfztcO8uBLgsqrhwOE4FcmiiS5aAZ3pvyvA4CqRtSjTCuCvgAlNIASvNeNyxvFCQ2PqOmlW4bZD4QvoYQjPv2BdvXzUBlmTTfD4qTN6I5mLmo7KZdgpGI9bHbuRwXpzs4J6qhpEpcn49oh0T9OM Sep 23 04:31:40.427829 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:31:40.427829 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:31:40.427829 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:31:40.427829 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:31:40.427829 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:31:40.427829 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:31:40.427829 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 9c586d7e75854862ba78270c718742b1 Sep 23 04:31:40.427829 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-AggregatesAdminTestJSON-359373671 Sep 23 04:31:40.427829 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,admin,member Sep 23 04:31:40.427829 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,admin,member Sep 23 04:31:40.431122 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9c586d7e75854862ba78270c718742b1", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9c586d7e75854862ba78270c718742b1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9c586d7e75854862ba78270c718742b1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9c586d7e75854862ba78270c718742b1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:31:40.431122 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-AggregatesAdminTestJSON-359373671 Sep 23 04:31:40.431122 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 9c586d7e75854862ba78270c718742b1 Sep 23 04:31:40.431122 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-359373671 Sep 23 04:31:40.431122 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-AggregatesAdminTestJSON-359373671-project-admin Sep 23 04:31:40.431122 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:31:40.431122 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:31:40.431122 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: d37724d539a44967983e15cc0f55dff0 Sep 23 04:31:40.431122 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-AggregatesAdminTestJSON-359373671-project-admin Sep 23 04:31:40.431122 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:31:40.431122 n-d-846463-3 devstack@n-api.service[122699]: exception: Aggregate 11 could not be found. Sep 23 04:31:40.431122 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '11'} Sep 23 04:31:40.431122 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:31:40.432433 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:31:40.432433 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Sep 23 04:31:40.432433 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Sep 23 04:31:40.432433 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Sep 23 04:31:40.432433 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Sep 23 04:31:40.432433 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 04:31:40.432433 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 04:31:40.432433 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 23 04:31:40.432433 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 23 04:31:40.432433 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 23 04:31:40.432433 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 23 04:31:40.432433 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 23 04:31:40.432433 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 23 04:31:40.432433 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 11 could not be found. Sep 23 04:31:40.432433 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:31:40.432433 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:31:40.432433 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:31:40.432433 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:31:40.432433 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:31:40.433632 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:31:40.433632 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:31:40.433632 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:31:40.433632 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:31:40.433632 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:31:40.433632 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Sep 23 04:31:40.433632 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:31:40.433632 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 11 could not be found. Sep 23 04:31:40.433632 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:31:40.433632 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:31:40.433632 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:31:40.433632 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:31:40.433632 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:31:40.433632 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:31:40.433632 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:31:40.433632 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:31:40.433632 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 11 could not be found. Sep 23 04:31:40.433632 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:31:40.436269 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d2aeba63-1358-4bd8-8b10-1c0a0c8a984f tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] Returning 404 to user: Aggregate 11 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:31:40.436269 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d2aeba63-1358-4bd8-8b10-1c0a0c8a984f tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates/11" status: 404 len: 78 microversion: 2.1 time: 0.031593 Sep 23 04:31:40.437445 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 110/233] 10.222.0.33 () {58 vars in 1152 bytes} [Fri Sep 23 04:31:40 2022] GET /compute/v2.1/os-aggregates/11 => generated 78 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 23 04:31:40.445879 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-cc36967c-0859-4141-a2b3-754847ba4e87 req-e6094800-b3b9-45c8-be30-55bda44b11e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "074ac5a1-94af-4e9d-b458-107710ca0972", "name": "network-vif-plugged", "status": "completed", "tag": "d2a87d8d-10e1-4e42-a88a-2baacccb1f56"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:31:40.457587 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-cc36967c-0859-4141-a2b3-754847ba4e87 req-e6094800-b3b9-45c8-be30-55bda44b11e1 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:40.458354 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-cc36967c-0859-4141-a2b3-754847ba4e87 req-e6094800-b3b9-45c8-be30-55bda44b11e1 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:40.458988 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-cc36967c-0859-4141-a2b3-754847ba4e87 req-e6094800-b3b9-45c8-be30-55bda44b11e1 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:40.470530 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-cc36967c-0859-4141-a2b3-754847ba4e87 req-e6094800-b3b9-45c8-be30-55bda44b11e1 service nova] Creating event network-vif-plugged:d2a87d8d-10e1-4e42-a88a-2baacccb1f56 for instance 074ac5a1-94af-4e9d-b458-107710ca0972 on n-h1-846463-3 Sep 23 04:31:40.477109 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-cc36967c-0859-4141-a2b3-754847ba4e87 req-e6094800-b3b9-45c8-be30-55bda44b11e1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038201 Sep 23 04:31:40.478455 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 111/234] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:31:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:31:40.485785 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a0fc3b30-9064-4456-b087-6af395b207e1 tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:40.509986 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-a0fc3b30-9064-4456-b087-6af395b207e1 tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] HTTP exception thrown: Aggregate 11 could not be found. Sep 23 04:31:40.512018 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a0fc3b30-9064-4456-b087-6af395b207e1 tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] Request method failure captured: Sep 23 04:31:40.512018 n-d-846463-3 devstack@n-api.service[122699]: request: DELETE /compute/v2.1/os-aggregates/11 HTTP/1.1 Sep 23 04:31:40.512018 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:31:40.512018 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:31:40.512018 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:31:40.512018 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:31:40.512018 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:31:40.512018 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:31:40.512018 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:31:40.512018 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:31:40.512018 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTZ5kFgsWdY6FVdWL3c-F308nq6ljfztcO8uBLgsqrhwOE4FcmiiS5aAZ3pvyvA4CqRtSjTCuCvgAlNIASvNeNyxvFCQ2PqOmlW4bZD4QvoYQjPv2BdvXzUBlmTTfD4qTN6I5mLmo7KZdgpGI9bHbuRwXpzs4J6qhpEpcn49oh0T9OM Sep 23 04:31:40.512018 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:31:40.512018 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:31:40.512018 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:31:40.512018 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:31:40.512018 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:31:40.512018 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:31:40.512018 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 9c586d7e75854862ba78270c718742b1 Sep 23 04:31:40.512018 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-AggregatesAdminTestJSON-359373671 Sep 23 04:31:40.512018 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,admin,member Sep 23 04:31:40.512018 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,admin,member Sep 23 04:31:40.513391 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9c586d7e75854862ba78270c718742b1", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9c586d7e75854862ba78270c718742b1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9c586d7e75854862ba78270c718742b1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9c586d7e75854862ba78270c718742b1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:31:40.513391 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-AggregatesAdminTestJSON-359373671 Sep 23 04:31:40.513391 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 9c586d7e75854862ba78270c718742b1 Sep 23 04:31:40.513391 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-359373671 Sep 23 04:31:40.513391 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-AggregatesAdminTestJSON-359373671-project-admin Sep 23 04:31:40.513391 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:31:40.513391 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:31:40.513391 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: d37724d539a44967983e15cc0f55dff0 Sep 23 04:31:40.513391 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-AggregatesAdminTestJSON-359373671-project-admin Sep 23 04:31:40.513391 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:31:40.513391 n-d-846463-3 devstack@n-api.service[122699]: exception: Aggregate 11 could not be found. Sep 23 04:31:40.513391 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '11'} Sep 23 04:31:40.513391 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:31:40.514093 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:31:40.514093 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Sep 23 04:31:40.514093 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Sep 23 04:31:40.514093 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 23 04:31:40.514093 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 23 04:31:40.514093 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 23 04:31:40.514093 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 23 04:31:40.514093 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 23 04:31:40.514093 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise self.value Sep 23 04:31:40.514093 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 23 04:31:40.514093 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 23 04:31:40.514093 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Sep 23 04:31:40.514093 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Sep 23 04:31:40.514093 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 04:31:40.514093 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 04:31:40.514093 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 23 04:31:40.514093 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 23 04:31:40.514093 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 23 04:31:40.514093 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 23 04:31:40.515134 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 23 04:31:40.515134 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 23 04:31:40.515134 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 11 could not be found. Sep 23 04:31:40.515134 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:31:40.515134 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:31:40.515134 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:31:40.515134 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:31:40.515134 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:31:40.515134 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:31:40.515134 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:31:40.515134 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:31:40.515134 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:31:40.515134 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:31:40.515134 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Sep 23 04:31:40.515134 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:31:40.515134 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 11 could not be found. Sep 23 04:31:40.515134 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:31:40.515134 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:31:40.515134 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:31:40.515134 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:31:40.515134 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:31:40.516209 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:31:40.516209 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:31:40.516209 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:31:40.516209 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 11 could not be found. Sep 23 04:31:40.516209 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:31:40.519179 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a0fc3b30-9064-4456-b087-6af395b207e1 tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] Returning 404 to user: Aggregate 11 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:31:40.522370 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a0fc3b30-9064-4456-b087-6af395b207e1 tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/11" status: 404 len: 78 microversion: 2.1 time: 0.042634 Sep 23 04:31:40.523092 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 112/235] 10.222.0.33 () {58 vars in 1155 bytes} [Fri Sep 23 04:31:40 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 78 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 23 04:31:40.541465 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3e8e2efd-9b9a-480f-9ccd-def289ccdb92 tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-310587211", "name": "tempest-test_aggregate-559776145"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:31:40.546254 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.aggregate [None req-3e8e2efd-9b9a-480f-9ccd-def289ccdb92 tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] Generated uuid 0f6ac5e6-d9d7-4528-abb8-2c296fae6d2c for aggregate {{(pid=122699) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 23 04:31:40.664299 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f04aaadd-c2cc-414a-9721-6d19565053df tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/12/action" status: 200 len: 243 microversion: 2.1 time: 0.384392 Sep 23 04:31:40.666751 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 124/236] 10.222.0.33 () {60 vars in 1194 bytes} [Fri Sep 23 04:31:40 2022] POST /compute/v2.1/os-aggregates/12/action => generated 243 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:31:40.678040 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e678268d-78b0-4a0b-8ac8-4b66d64246bf tempest-AggregatesAdminNegativeTestJSON-1067524409 tempest-AggregatesAdminNegativeTestJSON-1067524409-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-846463-3"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:31:40.682255 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e678268d-78b0-4a0b-8ac8-4b66d64246bf tempest-AggregatesAdminNegativeTestJSON-1067524409 tempest-AggregatesAdminNegativeTestJSON-1067524409-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '24bb0c35a0084dac80d254287f655725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1afd0e729aae49b981a3636e6f624484', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:40.683974 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e678268d-78b0-4a0b-8ac8-4b66d64246bf tempest-AggregatesAdminNegativeTestJSON-1067524409 tempest-AggregatesAdminNegativeTestJSON-1067524409-project] Request method failure captured: Sep 23 04:31:40.683974 n-d-846463-3 devstack@n-api.service[122698]: request: POST /compute/v2.1/os-aggregates/12/action HTTP/1.1 Sep 23 04:31:40.683974 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:31:40.683974 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:31:40.683974 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:31:40.683974 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 42 Sep 23 04:31:40.683974 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:31:40.683974 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:31:40.683974 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:31:40.683974 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:31:40.683974 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTZ2Bmf2_m05_gVOD5T53ER-1nncrPHmXve7d0hTs46C9PzKHYRjJbGa1nOFPP3OOKdjd0mb5lLNofLIron7_t_GWAnczvLJFriTpPDE959L2qsQy0co9m-MlEpNHrFH-rS2rfsrOiKNuZFr1Mz8QltnRj0IzzpoRmfFH7LcCQCTs_8 Sep 23 04:31:40.683974 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:31:40.683974 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:31:40.683974 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:31:40.683974 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:31:40.683974 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:31:40.683974 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:31:40.683974 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 1afd0e729aae49b981a3636e6f624484 Sep 23 04:31:40.683974 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1067524409 Sep 23 04:31:40.683974 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:31:40.683974 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:31:40.685200 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1afd0e729aae49b981a3636e6f624484", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1afd0e729aae49b981a3636e6f624484"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1afd0e729aae49b981a3636e6f624484"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1afd0e729aae49b981a3636e6f624484"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:31:40.685200 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1067524409 Sep 23 04:31:40.685200 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 1afd0e729aae49b981a3636e6f624484 Sep 23 04:31:40.685200 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1067524409 Sep 23 04:31:40.685200 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-AggregatesAdminNegativeTestJSON-1067524409-project Sep 23 04:31:40.685200 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:31:40.685200 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:31:40.685200 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 24bb0c35a0084dac80d254287f655725 Sep 23 04:31:40.685200 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1067524409-project Sep 23 04:31:40.685200 n-d-846463-3 devstack@n-api.service[122698]: Sep 23 04:31:40.685200 n-d-846463-3 devstack@n-api.service[122698]: {"remove_host": {"host": "n-h2-846463-3"}} Sep 23 04:31:40.685200 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:31:40.685200 n-d-846463-3 devstack@n-api.service[122698]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Sep 23 04:31:40.685962 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '12', 'body': {'remove_host': {'host': 'n-h2-846463-3'}}} Sep 23 04:31:40.685962 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:31:40.685962 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:31:40.685962 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:31:40.685962 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:31:40.685962 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:31:40.685962 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:31:40.685962 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:31:40.685962 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:31:40.685962 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:31:40.685962 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:31:40.685962 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Sep 23 04:31:40.685962 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Sep 23 04:31:40.685962 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 23 04:31:40.685962 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 23 04:31:40.685962 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 23 04:31:40.685962 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 23 04:31:40.685962 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 23 04:31:40.685962 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 23 04:31:40.687002 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 23 04:31:40.687002 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise self.value Sep 23 04:31:40.687002 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 23 04:31:40.687002 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 23 04:31:40.687002 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 23 04:31:40.687002 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 23 04:31:40.687002 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 23 04:31:40.687002 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 23 04:31:40.687002 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Sep 23 04:31:40.687002 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:31:40.687002 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:31:40.687002 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:31:40.687002 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:31:40.687002 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:31:40.687002 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:31:40.687002 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 23 04:31:40.687002 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 23 04:31:40.687002 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Sep 23 04:31:40.687002 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:31:40.688260 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e678268d-78b0-4a0b-8ac8-4b66d64246bf tempest-AggregatesAdminNegativeTestJSON-1067524409 tempest-AggregatesAdminNegativeTestJSON-1067524409-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:31:40.688260 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e678268d-78b0-4a0b-8ac8-4b66d64246bf tempest-AggregatesAdminNegativeTestJSON-1067524409 tempest-AggregatesAdminNegativeTestJSON-1067524409-project] 10.222.0.33 "POST /compute/v2.1/os-aggregates/12/action" status: 403 len: 121 microversion: 2.1 time: 0.011882 Sep 23 04:31:40.688260 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 125/237] 10.222.0.33 () {60 vars in 1194 bytes} [Fri Sep 23 04:31:40 2022] POST /compute/v2.1/os-aggregates/12/action => generated 121 bytes in 13 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:31:40.693984 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-bfe53f53-eb02-4673-a8d8-927404c6608b tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-846463-3"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:31:40.706741 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bfe53f53-eb02-4673-a8d8-927404c6608b tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:40.707544 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bfe53f53-eb02-4673-a8d8-927404c6608b tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:40.708360 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bfe53f53-eb02-4673-a8d8-927404c6608b tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:40.717210 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3e8e2efd-9b9a-480f-9ccd-def289ccdb92 tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.179563 Sep 23 04:31:40.722651 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 113/238] 10.222.0.33 () {60 vars in 1165 bytes} [Fri Sep 23 04:31:40 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:31:40.736832 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-fc8c4aae-1fd4-4807-90e1-b27c7f8e2cf7 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:40.739090 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-fc8c4aae-1fd4-4807-90e1-b27c7f8e2cf7 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] [instance: 24b8436f-97ba-49c5-ad91-8aea43f0e755] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:40.743056 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=5,nova_api:DELETE=11 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:31:40.750013 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fc8c4aae-1fd4-4807-90e1-b27c7f8e2cf7 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:40.753777 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fc8c4aae-1fd4-4807-90e1-b27c7f8e2cf7 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:40.753777 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fc8c4aae-1fd4-4807-90e1-b27c7f8e2cf7 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:40.753777 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fc8c4aae-1fd4-4807-90e1-b27c7f8e2cf7 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:40.754925 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fc8c4aae-1fd4-4807-90e1-b27c7f8e2cf7 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:40.755714 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fc8c4aae-1fd4-4807-90e1-b27c7f8e2cf7 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:41.033236 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-bfe53f53-eb02-4673-a8d8-927404c6608b tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/12/action" status: 200 len: 228 microversion: 2.1 time: 0.342538 Sep 23 04:31:41.038458 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 126/239] 10.222.0.33 () {60 vars in 1194 bytes} [Fri Sep 23 04:31:40 2022] POST /compute/v2.1/os-aggregates/12/action => generated 228 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:31:41.052644 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-93354598-8324-4c70-8823-3dcb4b496d23 tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:41.182057 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-93354598-8324-4c70-8823-3dcb4b496d23 tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.138603 Sep 23 04:31:41.183634 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 127/240] 10.222.0.33 () {58 vars in 1155 bytes} [Fri Sep 23 04:31:41 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 23 04:31:41.193086 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2ef30346-3cb2-43d7-8e65-c2581e53b777 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:41.193965 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-2ef30346-3cb2-43d7-8e65-c2581e53b777 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: bbf05a2b-af42-4f14-8956-4f6249c46974] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:41.208785 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2ef30346-3cb2-43d7-8e65-c2581e53b777 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:41.210144 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2ef30346-3cb2-43d7-8e65-c2581e53b777 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:41.211323 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2ef30346-3cb2-43d7-8e65-c2581e53b777 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:41.212727 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2ef30346-3cb2-43d7-8e65-c2581e53b777 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:41.213398 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2ef30346-3cb2-43d7-8e65-c2581e53b777 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:41.214366 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2ef30346-3cb2-43d7-8e65-c2581e53b777 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:41.237989 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-fc8c4aae-1fd4-4807-90e1-b27c7f8e2cf7 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac39d27bcf5d4def9ff9bd5b81bd7b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79442cd4a69040f594e19b3492df7e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:41.296205 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-fc8c4aae-1fd4-4807-90e1-b27c7f8e2cf7 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] 10.222.0.33 "GET /compute/v2.1/servers/24b8436f-97ba-49c5-ad91-8aea43f0e755" status: 200 len: 1320 microversion: 2.1 time: 0.572107 Sep 23 04:31:41.300481 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 114/241] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:31:40 2022] GET /compute/v2.1/servers/24b8436f-97ba-49c5-ad91-8aea43f0e755 => generated 1320 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:31:41.316024 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-62c46181-e20a-43d2-9134-c01ba5fdfb62 tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:41.463029 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-62c46181-e20a-43d2-9134-c01ba5fdfb62 tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.161378 Sep 23 04:31:41.471276 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 115/242] 10.222.0.33 () {58 vars in 1155 bytes} [Fri Sep 23 04:31:41 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 23 04:31:41.477570 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d7360e68-5115-476c-9716-19e996017c76 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:41.483619 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d7360e68-5115-476c-9716-19e996017c76 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] [instance: ed83bf5a-f3ce-4b5c-af6f-92b80599a022] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:41.568510 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d7360e68-5115-476c-9716-19e996017c76 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54d1a7a9e4ee44b9992ff9362108b311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649eb80e1ea849868c651849047833e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:41.570714 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-2ef30346-3cb2-43d7-8e65-c2581e53b777 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:41.578863 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-2ef30346-3cb2-43d7-8e65-c2581e53b777 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:41.580294 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-2ef30346-3cb2-43d7-8e65-c2581e53b777 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:41.580892 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d7360e68-5115-476c-9716-19e996017c76 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] 10.222.0.33 "GET /compute/v2.1/servers/ed83bf5a-f3ce-4b5c-af6f-92b80599a022" status: 200 len: 1222 microversion: 2.1 time: 0.107869 Sep 23 04:31:41.582112 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2ef30346-3cb2-43d7-8e65-c2581e53b777 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/bbf05a2b-af42-4f14-8956-4f6249c46974" status: 200 len: 1362 microversion: 2.25 time: 0.396494 Sep 23 04:31:41.582704 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 116/243] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:31:41 2022] GET /compute/v2.1/servers/ed83bf5a-f3ce-4b5c-af6f-92b80599a022 => generated 1222 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:31:41.594138 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 128/244] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:31:41 2022] GET /compute/v2.1/servers/bbf05a2b-af42-4f14-8956-4f6249c46974 => generated 1362 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:31:41.594138 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e25757cf-1e91-4b09-90b2-377178173a5c tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:41.601816 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6aaded40-6f6f-4615-a7d2-167e431c2dcd tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:41.602496 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-6aaded40-6f6f-4615-a7d2-167e431c2dcd tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] [instance: 074ac5a1-94af-4e9d-b458-107710ca0972] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:41.603233 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-e25757cf-1e91-4b09-90b2-377178173a5c tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] HTTP exception thrown: Aggregate 13 could not be found. Sep 23 04:31:41.605565 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e25757cf-1e91-4b09-90b2-377178173a5c tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] Request method failure captured: Sep 23 04:31:41.605565 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/os-aggregates/13 HTTP/1.1 Sep 23 04:31:41.605565 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:31:41.605565 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:31:41.605565 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:31:41.605565 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:31:41.605565 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:31:41.605565 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:31:41.605565 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:31:41.605565 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:31:41.605565 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTZ5kFgsWdY6FVdWL3c-F308nq6ljfztcO8uBLgsqrhwOE4FcmiiS5aAZ3pvyvA4CqRtSjTCuCvgAlNIASvNeNyxvFCQ2PqOmlW4bZD4QvoYQjPv2BdvXzUBlmTTfD4qTN6I5mLmo7KZdgpGI9bHbuRwXpzs4J6qhpEpcn49oh0T9OM Sep 23 04:31:41.605565 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:31:41.605565 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:31:41.605565 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:31:41.605565 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:31:41.605565 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:31:41.605565 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:31:41.605565 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 9c586d7e75854862ba78270c718742b1 Sep 23 04:31:41.605565 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-AggregatesAdminTestJSON-359373671 Sep 23 04:31:41.605565 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,admin,member Sep 23 04:31:41.605565 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,admin,member Sep 23 04:31:41.607106 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9c586d7e75854862ba78270c718742b1", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9c586d7e75854862ba78270c718742b1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9c586d7e75854862ba78270c718742b1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9c586d7e75854862ba78270c718742b1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:31:41.607106 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-AggregatesAdminTestJSON-359373671 Sep 23 04:31:41.607106 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 9c586d7e75854862ba78270c718742b1 Sep 23 04:31:41.607106 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-359373671 Sep 23 04:31:41.607106 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-AggregatesAdminTestJSON-359373671-project-admin Sep 23 04:31:41.607106 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:31:41.607106 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:31:41.607106 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: d37724d539a44967983e15cc0f55dff0 Sep 23 04:31:41.607106 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-AggregatesAdminTestJSON-359373671-project-admin Sep 23 04:31:41.607106 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:31:41.607106 n-d-846463-3 devstack@n-api.service[122698]: exception: Aggregate 13 could not be found. Sep 23 04:31:41.607106 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '13'} Sep 23 04:31:41.607106 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:31:41.607864 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:31:41.607864 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Sep 23 04:31:41.607864 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Sep 23 04:31:41.607864 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Sep 23 04:31:41.607864 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Sep 23 04:31:41.607864 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 04:31:41.607864 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 04:31:41.607864 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 23 04:31:41.607864 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 23 04:31:41.607864 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 23 04:31:41.607864 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 23 04:31:41.607864 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 23 04:31:41.607864 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 23 04:31:41.607864 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 13 could not be found. Sep 23 04:31:41.607864 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:31:41.607864 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:31:41.607864 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:31:41.607864 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:31:41.607864 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:31:41.609097 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:31:41.609097 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:31:41.609097 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:31:41.609097 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:31:41.609097 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:31:41.609097 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Sep 23 04:31:41.609097 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:31:41.609097 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 13 could not be found. Sep 23 04:31:41.609097 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:31:41.609097 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:31:41.609097 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:31:41.609097 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:31:41.609097 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:31:41.609097 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:31:41.609097 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:31:41.609097 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:31:41.609097 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 13 could not be found. Sep 23 04:31:41.609097 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:31:41.610445 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6aaded40-6f6f-4615-a7d2-167e431c2dcd tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:41.610445 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6aaded40-6f6f-4615-a7d2-167e431c2dcd tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:41.610445 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6aaded40-6f6f-4615-a7d2-167e431c2dcd tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:41.610697 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e25757cf-1e91-4b09-90b2-377178173a5c tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] Returning 404 to user: Aggregate 13 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:31:41.610781 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6aaded40-6f6f-4615-a7d2-167e431c2dcd tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:41.611090 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6aaded40-6f6f-4615-a7d2-167e431c2dcd tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:41.611724 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6aaded40-6f6f-4615-a7d2-167e431c2dcd tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:41.612088 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e25757cf-1e91-4b09-90b2-377178173a5c tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates/13" status: 404 len: 78 microversion: 2.1 time: 0.027362 Sep 23 04:31:41.618469 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 129/245] 10.222.0.33 () {58 vars in 1152 bytes} [Fri Sep 23 04:31:41 2022] GET /compute/v2.1/os-aggregates/13 => generated 78 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 23 04:31:41.619399 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-458644ab-3f57-43ab-b70e-dd8f15f3b93d tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-29591100"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:31:41.625211 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.aggregate [None req-458644ab-3f57-43ab-b70e-dd8f15f3b93d tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] Generated uuid af765c4c-886a-4e7c-8584-740ed76a17b1 for aggregate {{(pid=122698) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 23 04:31:41.757246 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-458644ab-3f57-43ab-b70e-dd8f15f3b93d tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.140507 Sep 23 04:31:41.773292 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 130/246] 10.222.0.33 () {60 vars in 1164 bytes} [Fri Sep 23 04:31:41 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:31:41.781454 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-923ab8f9-6095-4e50-b1c1-4b5a8176033c tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:41.814644 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-923ab8f9-6095-4e50-b1c1-4b5a8176033c tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] HTTP exception thrown: Aggregate 13 could not be found. Sep 23 04:31:41.819018 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-923ab8f9-6095-4e50-b1c1-4b5a8176033c tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] Request method failure captured: Sep 23 04:31:41.819018 n-d-846463-3 devstack@n-api.service[122698]: request: DELETE /compute/v2.1/os-aggregates/13 HTTP/1.1 Sep 23 04:31:41.819018 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:31:41.819018 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:31:41.819018 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:31:41.819018 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:31:41.819018 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:31:41.819018 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:31:41.819018 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:31:41.819018 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:31:41.819018 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTZ5kFgsWdY6FVdWL3c-F308nq6ljfztcO8uBLgsqrhwOE4FcmiiS5aAZ3pvyvA4CqRtSjTCuCvgAlNIASvNeNyxvFCQ2PqOmlW4bZD4QvoYQjPv2BdvXzUBlmTTfD4qTN6I5mLmo7KZdgpGI9bHbuRwXpzs4J6qhpEpcn49oh0T9OM Sep 23 04:31:41.819018 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:31:41.819018 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:31:41.819018 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:31:41.819018 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:31:41.819018 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:31:41.819018 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:31:41.819018 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 9c586d7e75854862ba78270c718742b1 Sep 23 04:31:41.819018 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-AggregatesAdminTestJSON-359373671 Sep 23 04:31:41.819018 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,admin,member Sep 23 04:31:41.819018 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,admin,member Sep 23 04:31:41.820441 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9c586d7e75854862ba78270c718742b1", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9c586d7e75854862ba78270c718742b1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9c586d7e75854862ba78270c718742b1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9c586d7e75854862ba78270c718742b1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:31:41.820441 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-AggregatesAdminTestJSON-359373671 Sep 23 04:31:41.820441 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 9c586d7e75854862ba78270c718742b1 Sep 23 04:31:41.820441 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-359373671 Sep 23 04:31:41.820441 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-AggregatesAdminTestJSON-359373671-project-admin Sep 23 04:31:41.820441 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:31:41.820441 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:31:41.820441 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: d37724d539a44967983e15cc0f55dff0 Sep 23 04:31:41.820441 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-AggregatesAdminTestJSON-359373671-project-admin Sep 23 04:31:41.820441 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:31:41.820441 n-d-846463-3 devstack@n-api.service[122698]: exception: Aggregate 13 could not be found. Sep 23 04:31:41.820441 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '13'} Sep 23 04:31:41.820441 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:31:41.821321 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:31:41.821321 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Sep 23 04:31:41.821321 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Sep 23 04:31:41.821321 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 23 04:31:41.821321 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 23 04:31:41.821321 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 23 04:31:41.821321 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 23 04:31:41.821321 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 23 04:31:41.821321 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise self.value Sep 23 04:31:41.821321 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 23 04:31:41.821321 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 23 04:31:41.821321 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Sep 23 04:31:41.821321 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Sep 23 04:31:41.821321 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 04:31:41.821321 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 04:31:41.821321 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 23 04:31:41.821321 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 23 04:31:41.821321 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 23 04:31:41.821321 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 23 04:31:41.823460 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 23 04:31:41.823460 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 23 04:31:41.823460 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 13 could not be found. Sep 23 04:31:41.823460 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:31:41.823460 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:31:41.823460 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:31:41.823460 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:31:41.823460 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:31:41.823460 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:31:41.823460 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:31:41.823460 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:31:41.823460 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:31:41.823460 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:31:41.823460 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Sep 23 04:31:41.823460 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:31:41.823460 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 13 could not be found. Sep 23 04:31:41.823460 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:31:41.823460 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:31:41.823460 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:31:41.823460 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:31:41.823460 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:31:41.824914 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:31:41.824914 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:31:41.824914 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:31:41.824914 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 13 could not be found. Sep 23 04:31:41.824914 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:31:41.828581 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-923ab8f9-6095-4e50-b1c1-4b5a8176033c tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] Returning 404 to user: Aggregate 13 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:31:41.829645 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-923ab8f9-6095-4e50-b1c1-4b5a8176033c tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/13" status: 404 len: 78 microversion: 2.1 time: 0.054909 Sep 23 04:31:41.830389 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 131/247] 10.222.0.33 () {58 vars in 1155 bytes} [Fri Sep 23 04:31:41 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 78 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 23 04:31:41.837266 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-45112fb0-7c22-43f4-86bb-540bef8d749e req-8d4ca51b-a415-4776-a674-a120c44a54ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24b8436f-97ba-49c5-ad91-8aea43f0e755", "tag": "74eca486-20b1-4087-bc60-f2deb1ac37e5"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:31:41.851933 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-45112fb0-7c22-43f4-86bb-540bef8d749e req-8d4ca51b-a415-4776-a674-a120c44a54ab service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:41.852709 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-45112fb0-7c22-43f4-86bb-540bef8d749e req-8d4ca51b-a415-4776-a674-a120c44a54ab service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:41.853360 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-45112fb0-7c22-43f4-86bb-540bef8d749e req-8d4ca51b-a415-4776-a674-a120c44a54ab service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:41.863317 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-6aaded40-6f6f-4615-a7d2-167e431c2dcd tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcc413bf53847b89cfe6bdf48909ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c7c21aa6b342b6bc52365cfdeb7c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:41.873274 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6aaded40-6f6f-4615-a7d2-167e431c2dcd tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] 10.222.0.33 "GET /compute/v2.1/servers/074ac5a1-94af-4e9d-b458-107710ca0972" status: 200 len: 1387 microversion: 2.1 time: 0.277346 Sep 23 04:31:41.874122 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 117/248] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:31:41 2022] GET /compute/v2.1/servers/074ac5a1-94af-4e9d-b458-107710ca0972 => generated 1387 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:31:41.877421 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-45112fb0-7c22-43f4-86bb-540bef8d749e req-8d4ca51b-a415-4776-a674-a120c44a54ab service nova] Creating event network-changed:74eca486-20b1-4087-bc60-f2deb1ac37e5 for instance 24b8436f-97ba-49c5-ad91-8aea43f0e755 on n-h2-846463-3 Sep 23 04:31:41.881713 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-960077b9-5caf-46f6-afc8-b78cba82cb4f tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:31:41.884454 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-45112fb0-7c22-43f4-86bb-540bef8d749e req-8d4ca51b-a415-4776-a674-a120c44a54ab service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052448 Sep 23 04:31:41.888432 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 132/249] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:31:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:31:41.907187 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-960077b9-5caf-46f6-afc8-b78cba82cb4f tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:41.907686 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-960077b9-5caf-46f6-afc8-b78cba82cb4f tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:41.925603 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-fd5c4d36-7e25-40dd-b4aa-3cc1c12ef1b5 tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-304613748"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:31:41.925837 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-960077b9-5caf-46f6-afc8-b78cba82cb4f tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:41.926057 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.aggregate [None req-fd5c4d36-7e25-40dd-b4aa-3cc1c12ef1b5 tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] Generated uuid 6098fc67-5d28-43a1-9e1a-895aed7ed380 for aggregate {{(pid=122698) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 23 04:31:41.926228 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-960077b9-5caf-46f6-afc8-b78cba82cb4f tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:41.926228 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-960077b9-5caf-46f6-afc8-b78cba82cb4f tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:41.926228 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-960077b9-5caf-46f6-afc8-b78cba82cb4f tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:41.945234 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.compute.aggregates [None req-960077b9-5caf-46f6-afc8-b78cba82cb4f tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] Failed to remove host nonexist_host from aggregate 14. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Sep 23 04:31:41.945760 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-960077b9-5caf-46f6-afc8-b78cba82cb4f tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 14 Sep 23 04:31:41.947838 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-960077b9-5caf-46f6-afc8-b78cba82cb4f tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] Request method failure captured: Sep 23 04:31:41.947838 n-d-846463-3 devstack@n-api.service[122699]: request: POST /compute/v2.1/os-aggregates/14/action HTTP/1.1 Sep 23 04:31:41.947838 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:31:41.947838 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:31:41.947838 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:31:41.947838 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 42 Sep 23 04:31:41.947838 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:31:41.947838 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:31:41.947838 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:31:41.947838 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:31:41.947838 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTZ5oEAchpKsFTLJD2ORtLdgqj3VHiTBLEM6UEPkUUCvcyhf0_w1Xxxls4zrNN9m-rmbehAHDIYaSPnFC9qCAriwu0PussLgdOCF2zTCPBrKzCi-GYGjkUruxttnETP-K2i9CdZdQcLkzw59XHXqeXxFwe_YqUAo93JD5ZxCOdShtNA Sep 23 04:31:41.947838 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:31:41.947838 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:31:41.947838 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:31:41.947838 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:31:41.947838 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:31:41.947838 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:31:41.947838 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: db8ef5d6dc834d57b5b3fad0dda5512c Sep 23 04:31:41.947838 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2040548293 Sep 23 04:31:41.947838 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,admin,member Sep 23 04:31:41.947838 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,admin,member Sep 23 04:31:41.949273 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_db8ef5d6dc834d57b5b3fad0dda5512c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/db8ef5d6dc834d57b5b3fad0dda5512c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/db8ef5d6dc834d57b5b3fad0dda5512c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/db8ef5d6dc834d57b5b3fad0dda5512c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:31:41.949273 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2040548293 Sep 23 04:31:41.949273 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: db8ef5d6dc834d57b5b3fad0dda5512c Sep 23 04:31:41.949273 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2040548293 Sep 23 04:31:41.949273 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin Sep 23 04:31:41.949273 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:31:41.949273 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:31:41.949273 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 289ab0514fa048a9b6662b3e56304199 Sep 23 04:31:41.949273 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin Sep 23 04:31:41.949273 n-d-846463-3 devstack@n-api.service[122699]: Sep 23 04:31:41.949273 n-d-846463-3 devstack@n-api.service[122699]: {"remove_host": {"host": "nonexist_host"}} Sep 23 04:31:41.949273 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:31:41.949273 n-d-846463-3 devstack@n-api.service[122699]: exception: Cannot remove host nonexist_host in aggregate 14 Sep 23 04:31:41.950163 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '14', 'body': {'remove_host': {'host': 'nonexist_host'}}} Sep 23 04:31:41.950163 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:31:41.950163 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:31:41.950163 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Sep 23 04:31:41.950163 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Sep 23 04:31:41.950163 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 04:31:41.950163 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 04:31:41.950163 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 23 04:31:41.950163 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 23 04:31:41.950163 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 23 04:31:41.950163 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 23 04:31:41.950163 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 23 04:31:41.950163 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 23 04:31:41.950163 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Sep 23 04:31:41.950163 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:31:41.950163 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:31:41.950163 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:31:41.950163 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:31:41.950163 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Sep 23 04:31:41.950163 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Sep 23 04:31:41.951579 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 23 04:31:41.951579 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 23 04:31:41.951579 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 23 04:31:41.951579 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:31:41.951579 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:31:41.951579 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:31:41.951579 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:31:41.951579 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Sep 23 04:31:41.951579 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Sep 23 04:31:41.951579 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 23 04:31:41.951579 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 23 04:31:41.951579 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 23 04:31:41.951579 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 23 04:31:41.951579 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 23 04:31:41.951579 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise self.value Sep 23 04:31:41.951579 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 23 04:31:41.951579 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 23 04:31:41.951579 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6683, in remove_host_from_aggregate Sep 23 04:31:41.951579 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Sep 23 04:31:41.951579 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Sep 23 04:31:41.952905 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Sep 23 04:31:41.952905 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Sep 23 04:31:41.952905 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:31:41.952905 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:31:41.952905 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:31:41.952905 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:31:41.952905 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:31:41.952905 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:31:41.952905 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:31:41.952905 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:31:41.952905 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:31:41.952905 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:31:41.952905 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:31:41.952905 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:31:41.952905 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Sep 23 04:31:41.952905 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 23 04:31:41.952905 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 14 Sep 23 04:31:41.952905 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:31:41.952905 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:31:41.952905 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:31:41.952905 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:31:41.954300 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:31:41.954300 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:31:41.954300 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:31:41.954300 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:31:41.954300 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 14 Sep 23 04:31:41.954300 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:31:41.954300 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-960077b9-5caf-46f6-afc8-b78cba82cb4f tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 14 {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:31:41.954300 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-960077b9-5caf-46f6-afc8-b78cba82cb4f tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/14/action" status: 404 len: 94 microversion: 2.1 time: 0.074174 Sep 23 04:31:41.954300 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 118/250] 10.222.0.33 () {60 vars in 1194 bytes} [Fri Sep 23 04:31:41 2022] POST /compute/v2.1/os-aggregates/14/action => generated 94 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 23 04:31:41.959231 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c33b2af9-fdb0-444a-94aa-db3bab3ee430 tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:42.103163 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c33b2af9-fdb0-444a-94aa-db3bab3ee430 tempest-AggregatesAdminNegativeTestJSON-2040548293 tempest-AggregatesAdminNegativeTestJSON-2040548293-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.146525 Sep 23 04:31:42.108061 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 119/251] 10.222.0.33 () {58 vars in 1155 bytes} [Fri Sep 23 04:31:41 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 23 04:31:42.109691 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-fd5c4d36-7e25-40dd-b4aa-3cc1c12ef1b5 tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.214414 Sep 23 04:31:42.111084 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 133/252] 10.222.0.33 () {60 vars in 1164 bytes} [Fri Sep 23 04:31:41 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:31:42.126672 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-46ad6d5f-8dfb-4f55-9b68-fa68b42d4971 tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:42.140043 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-46ad6d5f-8dfb-4f55-9b68-fa68b42d4971 tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates/15" status: 200 len: 227 microversion: 2.1 time: 0.021357 Sep 23 04:31:42.141088 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 120/253] 10.222.0.33 () {58 vars in 1152 bytes} [Fri Sep 23 04:31:42 2022] GET /compute/v2.1/os-aggregates/15 => generated 227 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:31:42.158818 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a9b4a2f8-a710-4b77-989a-e2ada18705f3 tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:31:42.293280 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a9b4a2f8-a710-4b77-989a-e2ada18705f3 tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/15/action" status: 200 len: 265 microversion: 2.1 time: 0.142341 Sep 23 04:31:42.302731 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 134/254] 10.222.0.33 () {60 vars in 1194 bytes} [Fri Sep 23 04:31:42 2022] POST /compute/v2.1/os-aggregates/15/action => generated 265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:31:42.306431 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b883863a-ab50-410f-8c42-05891ed7ed26 tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:42.314900 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b883863a-ab50-410f-8c42-05891ed7ed26 tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates/15" status: 200 len: 241 microversion: 2.1 time: 0.012482 Sep 23 04:31:42.315977 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 121/255] 10.222.0.33 () {58 vars in 1152 bytes} [Fri Sep 23 04:31:42 2022] GET /compute/v2.1/os-aggregates/15 => generated 241 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:31:42.328082 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d299a24f-ddfa-4137-892c-15989cec61a8 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:42.329471 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d299a24f-ddfa-4137-892c-15989cec61a8 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] [instance: 24b8436f-97ba-49c5-ad91-8aea43f0e755] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:42.338449 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d299a24f-ddfa-4137-892c-15989cec61a8 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:42.339110 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d299a24f-ddfa-4137-892c-15989cec61a8 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:42.339673 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d299a24f-ddfa-4137-892c-15989cec61a8 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:42.340532 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d299a24f-ddfa-4137-892c-15989cec61a8 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:42.341093 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d299a24f-ddfa-4137-892c-15989cec61a8 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:42.341650 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d299a24f-ddfa-4137-892c-15989cec61a8 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:42.342176 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3a111cda-2865-427b-914b-d52403ab8bc8 tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:42.470566 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3a111cda-2865-427b-914b-d52403ab8bc8 tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.135939 Sep 23 04:31:42.473228 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 122/256] 10.222.0.33 () {58 vars in 1155 bytes} [Fri Sep 23 04:31:42 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 23 04:31:42.497438 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0ee42e37-c953-46b4-b848-c6ec61affc99 tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1403648276", "availability_zone": "tempest-test_az-747016331"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:31:42.513242 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.aggregate [None req-0ee42e37-c953-46b4-b848-c6ec61affc99 tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] Generated uuid af4c737d-a704-488f-87a3-4c6640001d3f for aggregate {{(pid=122699) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 23 04:31:42.583750 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d299a24f-ddfa-4137-892c-15989cec61a8 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac39d27bcf5d4def9ff9bd5b81bd7b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79442cd4a69040f594e19b3492df7e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:42.599658 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d299a24f-ddfa-4137-892c-15989cec61a8 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] 10.222.0.33 "GET /compute/v2.1/servers/24b8436f-97ba-49c5-ad91-8aea43f0e755" status: 200 len: 1320 microversion: 2.1 time: 0.276367 Sep 23 04:31:42.603219 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 135/257] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:31:42 2022] GET /compute/v2.1/servers/24b8436f-97ba-49c5-ad91-8aea43f0e755 => generated 1320 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:31:42.621776 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-bde020a9-4731-4afd-9a79-5018334f7f28 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:42.627668 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-bde020a9-4731-4afd-9a79-5018334f7f28 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] [instance: ed83bf5a-f3ce-4b5c-af6f-92b80599a022] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:42.644568 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bde020a9-4731-4afd-9a79-5018334f7f28 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:42.645579 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bde020a9-4731-4afd-9a79-5018334f7f28 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:42.646733 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bde020a9-4731-4afd-9a79-5018334f7f28 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:42.648718 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bde020a9-4731-4afd-9a79-5018334f7f28 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:42.650080 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bde020a9-4731-4afd-9a79-5018334f7f28 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:42.650883 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bde020a9-4731-4afd-9a79-5018334f7f28 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:42.706677 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0ee42e37-c953-46b4-b848-c6ec61affc99 tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.225332 Sep 23 04:31:42.707654 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 123/258] 10.222.0.33 () {60 vars in 1165 bytes} [Fri Sep 23 04:31:42 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:31:42.738310 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-89a09e53-8452-4778-9948-bba475f773a7 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:42.742319 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-89a09e53-8452-4778-9948-bba475f773a7 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: bbf05a2b-af42-4f14-8956-4f6249c46974] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:42.778380 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-89a09e53-8452-4778-9948-bba475f773a7 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:42.778892 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-89a09e53-8452-4778-9948-bba475f773a7 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:42.779338 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-89a09e53-8452-4778-9948-bba475f773a7 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:42.780059 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-89a09e53-8452-4778-9948-bba475f773a7 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:42.785318 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-89a09e53-8452-4778-9948-bba475f773a7 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:42.787168 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-89a09e53-8452-4778-9948-bba475f773a7 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:42.833493 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-bde020a9-4731-4afd-9a79-5018334f7f28 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54d1a7a9e4ee44b9992ff9362108b311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649eb80e1ea849868c651849047833e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:42.847638 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-bde020a9-4731-4afd-9a79-5018334f7f28 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] 10.222.0.33 "GET /compute/v2.1/servers/ed83bf5a-f3ce-4b5c-af6f-92b80599a022" status: 200 len: 1218 microversion: 2.1 time: 0.242972 Sep 23 04:31:42.848221 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 136/259] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:31:42 2022] GET /compute/v2.1/servers/ed83bf5a-f3ce-4b5c-af6f-92b80599a022 => generated 1218 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:31:42.865551 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4912c705-91fe-4746-9e07-ed8a2f49a118 tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1403648276_new", "availability_zone": "tempest-test_az-747016331_new"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:31:43.058709 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-89a09e53-8452-4778-9948-bba475f773a7 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:43.078592 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-89a09e53-8452-4778-9948-bba475f773a7 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:43.078592 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-89a09e53-8452-4778-9948-bba475f773a7 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:43.078592 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-89a09e53-8452-4778-9948-bba475f773a7 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/bbf05a2b-af42-4f14-8956-4f6249c46974" status: 200 len: 1362 microversion: 2.25 time: 0.366618 Sep 23 04:31:43.092357 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 124/260] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:31:42 2022] GET /compute/v2.1/servers/bbf05a2b-af42-4f14-8956-4f6249c46974 => generated 1362 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:31:43.103894 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-eaa6ed47-a2b5-4b8e-8b99-dbdcdc766a29 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:43.104772 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-eaa6ed47-a2b5-4b8e-8b99-dbdcdc766a29 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] [instance: 074ac5a1-94af-4e9d-b458-107710ca0972] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:43.112356 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eaa6ed47-a2b5-4b8e-8b99-dbdcdc766a29 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:43.113349 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eaa6ed47-a2b5-4b8e-8b99-dbdcdc766a29 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:43.113793 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eaa6ed47-a2b5-4b8e-8b99-dbdcdc766a29 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:43.114556 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eaa6ed47-a2b5-4b8e-8b99-dbdcdc766a29 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:43.121041 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eaa6ed47-a2b5-4b8e-8b99-dbdcdc766a29 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:43.121041 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eaa6ed47-a2b5-4b8e-8b99-dbdcdc766a29 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:43.308441 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-eaa6ed47-a2b5-4b8e-8b99-dbdcdc766a29 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcc413bf53847b89cfe6bdf48909ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c7c21aa6b342b6bc52365cfdeb7c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:43.321919 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-eaa6ed47-a2b5-4b8e-8b99-dbdcdc766a29 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] 10.222.0.33 "GET /compute/v2.1/servers/074ac5a1-94af-4e9d-b458-107710ca0972" status: 200 len: 1387 microversion: 2.1 time: 0.228389 Sep 23 04:31:43.338837 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 125/261] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:31:43 2022] GET /compute/v2.1/servers/074ac5a1-94af-4e9d-b458-107710ca0972 => generated 1387 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:31:43.356754 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4912c705-91fe-4746-9e07-ed8a2f49a118 tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:43.357586 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4912c705-91fe-4746-9e07-ed8a2f49a118 tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:43.358439 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4912c705-91fe-4746-9e07-ed8a2f49a118 tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:43.629567 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-43e5da1b-392e-4b24-a5c9-edf1fb209b2f tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:43.631154 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-43e5da1b-392e-4b24-a5c9-edf1fb209b2f tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] [instance: 24b8436f-97ba-49c5-ad91-8aea43f0e755] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:43.639289 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-43e5da1b-392e-4b24-a5c9-edf1fb209b2f tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:43.639878 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-43e5da1b-392e-4b24-a5c9-edf1fb209b2f tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:43.640414 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-43e5da1b-392e-4b24-a5c9-edf1fb209b2f tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:43.641537 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-43e5da1b-392e-4b24-a5c9-edf1fb209b2f tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:43.642741 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-43e5da1b-392e-4b24-a5c9-edf1fb209b2f tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:43.643395 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-43e5da1b-392e-4b24-a5c9-edf1fb209b2f tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:43.781745 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-43e5da1b-392e-4b24-a5c9-edf1fb209b2f tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac39d27bcf5d4def9ff9bd5b81bd7b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79442cd4a69040f594e19b3492df7e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:43.790135 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-43e5da1b-392e-4b24-a5c9-edf1fb209b2f tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] 10.222.0.33 "GET /compute/v2.1/servers/24b8436f-97ba-49c5-ad91-8aea43f0e755" status: 200 len: 1320 microversion: 2.1 time: 0.166748 Sep 23 04:31:43.790994 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 126/262] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:31:43 2022] GET /compute/v2.1/servers/24b8436f-97ba-49c5-ad91-8aea43f0e755 => generated 1320 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:31:43.860980 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4912c705-91fe-4746-9e07-ed8a2f49a118 tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-aggregates/16" status: 200 len: 335 microversion: 2.1 time: 1.011603 Sep 23 04:31:43.861525 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 137/263] 10.222.0.33 () {60 vars in 1173 bytes} [Fri Sep 23 04:31:42 2022] PUT /compute/v2.1/os-aggregates/16 => generated 335 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:31:43.873952 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-40a96eca-2e52-4699-a1d9-7af5a176cc17 tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:43.882550 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a1b27ead-713f-4cd4-ae7a-c91801da010d tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:43.883268 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a1b27ead-713f-4cd4-ae7a-c91801da010d tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] [instance: ed83bf5a-f3ce-4b5c-af6f-92b80599a022] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:43.885013 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-40a96eca-2e52-4699-a1d9-7af5a176cc17 tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates" status: 200 len: 338 microversion: 2.1 time: 0.015347 Sep 23 04:31:43.886808 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 127/264] 10.222.0.33 () {58 vars in 1143 bytes} [Fri Sep 23 04:31:43 2022] GET /compute/v2.1/os-aggregates => generated 338 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:31:43.897011 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a1b27ead-713f-4cd4-ae7a-c91801da010d tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:43.897773 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a1b27ead-713f-4cd4-ae7a-c91801da010d tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:43.899124 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a1b27ead-713f-4cd4-ae7a-c91801da010d tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:43.899266 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3e1d7120-0e30-49e7-a313-e6c35a345773 tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:43.900093 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a1b27ead-713f-4cd4-ae7a-c91801da010d tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:43.901937 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a1b27ead-713f-4cd4-ae7a-c91801da010d tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:43.901937 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a1b27ead-713f-4cd4-ae7a-c91801da010d tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:43.973304 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a1b27ead-713f-4cd4-ae7a-c91801da010d tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54d1a7a9e4ee44b9992ff9362108b311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649eb80e1ea849868c651849047833e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:43.981977 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a1b27ead-713f-4cd4-ae7a-c91801da010d tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] 10.222.0.33 "GET /compute/v2.1/servers/ed83bf5a-f3ce-4b5c-af6f-92b80599a022" status: 200 len: 1274 microversion: 2.1 time: 0.105209 Sep 23 04:31:43.997344 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 138/265] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:31:43 2022] GET /compute/v2.1/servers/ed83bf5a-f3ce-4b5c-af6f-92b80599a022 => generated 1274 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:31:44.041603 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3e1d7120-0e30-49e7-a313-e6c35a345773 tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.147570 Sep 23 04:31:44.044758 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 128/266] 10.222.0.33 () {58 vars in 1155 bytes} [Fri Sep 23 04:31:43 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Sep 23 04:31:44.053350 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8a93edec-75e2-428d-a785-31bff272695c tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-633507356"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:31:44.056775 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.aggregate [None req-8a93edec-75e2-428d-a785-31bff272695c tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] Generated uuid 1c888014-1530-4d16-ab3b-b9cf07f1eec8 for aggregate {{(pid=122698) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 23 04:31:44.114454 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-da609427-31ec-4594-a30c-e7f7adeed046 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:44.115142 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-da609427-31ec-4594-a30c-e7f7adeed046 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: bbf05a2b-af42-4f14-8956-4f6249c46974] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:44.122442 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-da609427-31ec-4594-a30c-e7f7adeed046 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:44.122985 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-da609427-31ec-4594-a30c-e7f7adeed046 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:44.123398 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-da609427-31ec-4594-a30c-e7f7adeed046 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:44.131392 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-da609427-31ec-4594-a30c-e7f7adeed046 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:44.131808 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-da609427-31ec-4594-a30c-e7f7adeed046 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:44.132258 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-da609427-31ec-4594-a30c-e7f7adeed046 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:44.146995 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8a93edec-75e2-428d-a785-31bff272695c tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.097011 Sep 23 04:31:44.148067 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 139/267] 10.222.0.33 () {60 vars in 1164 bytes} [Fri Sep 23 04:31:44 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:31:44.161189 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-147455f8-5647-4033-a0d9-5d36f67ef6da tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:44.176832 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-147455f8-5647-4033-a0d9-5d36f67ef6da tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates" status: 200 len: 230 microversion: 2.1 time: 0.019917 Sep 23 04:31:44.178459 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 140/268] 10.222.0.33 () {58 vars in 1143 bytes} [Fri Sep 23 04:31:44 2022] GET /compute/v2.1/os-aggregates => generated 230 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:31:44.198747 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3922bad7-9b76-4f6b-b342-479cd431b1dc tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:44.378138 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3922bad7-9b76-4f6b-b342-479cd431b1dc tempest-AggregatesAdminTestJSON-359373671 tempest-AggregatesAdminTestJSON-359373671-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.188308 Sep 23 04:31:44.379544 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 141/269] 10.222.0.33 () {58 vars in 1155 bytes} [Fri Sep 23 04:31:44 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 23 04:31:44.405744 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8d317d4b-fe37-4764-ae3c-e5d73b28237e tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:44.410649 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8d317d4b-fe37-4764-ae3c-e5d73b28237e tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] [instance: 074ac5a1-94af-4e9d-b458-107710ca0972] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:44.426952 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8d317d4b-fe37-4764-ae3c-e5d73b28237e tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:44.429616 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-da609427-31ec-4594-a30c-e7f7adeed046 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:44.432314 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8d317d4b-fe37-4764-ae3c-e5d73b28237e tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:44.435810 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8d317d4b-fe37-4764-ae3c-e5d73b28237e tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:44.435810 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8d317d4b-fe37-4764-ae3c-e5d73b28237e tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:44.435810 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8d317d4b-fe37-4764-ae3c-e5d73b28237e tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:44.438258 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8d317d4b-fe37-4764-ae3c-e5d73b28237e tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:44.440507 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-da609427-31ec-4594-a30c-e7f7adeed046 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:44.444764 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-da609427-31ec-4594-a30c-e7f7adeed046 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:44.446277 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-da609427-31ec-4594-a30c-e7f7adeed046 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/bbf05a2b-af42-4f14-8956-4f6249c46974" status: 200 len: 1362 microversion: 2.25 time: 0.344140 Sep 23 04:31:44.449094 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 129/270] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:31:44 2022] GET /compute/v2.1/servers/bbf05a2b-af42-4f14-8956-4f6249c46974 => generated 1362 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:31:44.469678 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e1986527-6b89-4fd0-a6b6-b2719a7087a7 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:44.472687 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e1986527-6b89-4fd0-a6b6-b2719a7087a7 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] [instance: 43aee7fc-54b8-4499-998b-92054bfd82b4] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:44.487876 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e1986527-6b89-4fd0-a6b6-b2719a7087a7 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:44.487876 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e1986527-6b89-4fd0-a6b6-b2719a7087a7 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:44.488136 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e1986527-6b89-4fd0-a6b6-b2719a7087a7 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:44.490980 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e1986527-6b89-4fd0-a6b6-b2719a7087a7 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:44.491675 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e1986527-6b89-4fd0-a6b6-b2719a7087a7 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:44.492795 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e1986527-6b89-4fd0-a6b6-b2719a7087a7 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:44.527676 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-e1986527-6b89-4fd0-a6b6-b2719a7087a7 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] HTTP exception thrown: Instance 43aee7fc-54b8-4499-998b-92054bfd82b4 could not be found. Sep 23 04:31:44.536880 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e1986527-6b89-4fd0-a6b6-b2719a7087a7 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Request method failure captured: Sep 23 04:31:44.536880 n-d-846463-3 devstack@n-api.service[122699]: request: DELETE /compute/v2.1/servers/43aee7fc-54b8-4499-998b-92054bfd82b4 HTTP/1.1 Sep 23 04:31:44.536880 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:31:44.536880 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:31:44.536880 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:31:44.536880 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:31:44.536880 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:31:44.536880 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:31:44.536880 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:31:44.536880 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:31:44.536880 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTZ2dSiaqYHbShaqFrlHJtjSKM-XDtiEUKZW_7C_iWQc5AnhQ1viBZ5rTZuqBFRX0xAIHdf37vGm4WsYufPNVVQCjWFSYqqMY_9UU5le379PodmsuNmFomcOQfw-dgRu-xyJYUAMmvQWwQSaZEDt47d_gISy4r8GWm0MOfQIuD2tdeU Sep 23 04:31:44.536880 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:31:44.536880 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:31:44.536880 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:31:44.536880 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:31:44.536880 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:31:44.536880 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:31:44.536880 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: a161d95e4c44433ba5af6b941190fa24 Sep 23 04:31:44.536880 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-AggregatesAdminTestJSON-144473189 Sep 23 04:31:44.536880 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:31:44.536880 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:31:44.538483 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a161d95e4c44433ba5af6b941190fa24", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a161d95e4c44433ba5af6b941190fa24"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a161d95e4c44433ba5af6b941190fa24"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a161d95e4c44433ba5af6b941190fa24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:31:44.538483 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-AggregatesAdminTestJSON-144473189 Sep 23 04:31:44.538483 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: a161d95e4c44433ba5af6b941190fa24 Sep 23 04:31:44.538483 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-144473189 Sep 23 04:31:44.538483 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-AggregatesAdminTestJSON-144473189-project Sep 23 04:31:44.538483 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:31:44.538483 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:31:44.538483 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 82ee10291f2c4914b348a82e51b9c967 Sep 23 04:31:44.538483 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-AggregatesAdminTestJSON-144473189-project Sep 23 04:31:44.538483 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:31:44.538483 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 43aee7fc-54b8-4499-998b-92054bfd82b4 could not be found. Sep 23 04:31:44.538483 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '43aee7fc-54b8-4499-998b-92054bfd82b4'} Sep 23 04:31:44.539280 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:31:44.539280 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:31:44.539280 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:31:44.539280 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:31:44.539280 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:31:44.539280 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:31:44.539280 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:31:44.539280 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:31:44.539280 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:31:44.539280 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:31:44.539280 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43aee7fc-54b8-4499-998b-92054bfd82b4 could not be found. Sep 23 04:31:44.539280 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:31:44.539280 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:31:44.539280 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:31:44.539280 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:31:44.539280 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:31:44.539280 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:31:44.539280 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:31:44.539280 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:31:44.539280 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:31:44.540665 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:31:44.540665 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 04:31:44.540665 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 04:31:44.540665 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 04:31:44.540665 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 04:31:44.540665 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:31:44.540665 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:31:44.540665 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:31:44.540665 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:31:44.540665 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43aee7fc-54b8-4499-998b-92054bfd82b4 could not be found. Sep 23 04:31:44.540665 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:31:44.540665 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:31:44.540665 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:31:44.540665 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:31:44.540665 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:31:44.540665 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:31:44.540665 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:31:44.540665 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:31:44.540665 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43aee7fc-54b8-4499-998b-92054bfd82b4 could not be found. Sep 23 04:31:44.540665 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:31:44.545531 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e1986527-6b89-4fd0-a6b6-b2719a7087a7 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Returning 404 to user: Instance 43aee7fc-54b8-4499-998b-92054bfd82b4 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:31:44.545531 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e1986527-6b89-4fd0-a6b6-b2719a7087a7 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] 10.222.0.33 "DELETE /compute/v2.1/servers/43aee7fc-54b8-4499-998b-92054bfd82b4" status: 404 len: 111 microversion: 2.1 time: 0.090003 Sep 23 04:31:44.548535 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 130/271] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:31:44 2022] DELETE /compute/v2.1/servers/43aee7fc-54b8-4499-998b-92054bfd82b4 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:31:44.560649 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f7197321-b276-4976-9d6c-a04882adbd23 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:44.561283 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f7197321-b276-4976-9d6c-a04882adbd23 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] [instance: 43aee7fc-54b8-4499-998b-92054bfd82b4] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:44.588720 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f7197321-b276-4976-9d6c-a04882adbd23 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:44.589224 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f7197321-b276-4976-9d6c-a04882adbd23 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:44.589668 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f7197321-b276-4976-9d6c-a04882adbd23 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:44.594973 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f7197321-b276-4976-9d6c-a04882adbd23 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:44.595631 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f7197321-b276-4976-9d6c-a04882adbd23 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:44.603064 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f7197321-b276-4976-9d6c-a04882adbd23 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:44.646481 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-f7197321-b276-4976-9d6c-a04882adbd23 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] HTTP exception thrown: Instance 43aee7fc-54b8-4499-998b-92054bfd82b4 could not be found. Sep 23 04:31:44.646481 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f7197321-b276-4976-9d6c-a04882adbd23 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Request method failure captured: Sep 23 04:31:44.646481 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/43aee7fc-54b8-4499-998b-92054bfd82b4 HTTP/1.1 Sep 23 04:31:44.646481 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:31:44.646481 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:31:44.646481 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:31:44.646481 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:31:44.646481 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:31:44.646481 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:31:44.646481 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:31:44.646481 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:31:44.646481 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTZ2dSiaqYHbShaqFrlHJtjSKM-XDtiEUKZW_7C_iWQc5AnhQ1viBZ5rTZuqBFRX0xAIHdf37vGm4WsYufPNVVQCjWFSYqqMY_9UU5le379PodmsuNmFomcOQfw-dgRu-xyJYUAMmvQWwQSaZEDt47d_gISy4r8GWm0MOfQIuD2tdeU Sep 23 04:31:44.646481 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:31:44.646481 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:31:44.646481 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:31:44.646481 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:31:44.646481 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:31:44.646481 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:31:44.646481 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: a161d95e4c44433ba5af6b941190fa24 Sep 23 04:31:44.646481 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-AggregatesAdminTestJSON-144473189 Sep 23 04:31:44.646481 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:31:44.646481 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:31:44.648129 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a161d95e4c44433ba5af6b941190fa24", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a161d95e4c44433ba5af6b941190fa24"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a161d95e4c44433ba5af6b941190fa24"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a161d95e4c44433ba5af6b941190fa24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:31:44.648129 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-AggregatesAdminTestJSON-144473189 Sep 23 04:31:44.648129 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: a161d95e4c44433ba5af6b941190fa24 Sep 23 04:31:44.648129 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-144473189 Sep 23 04:31:44.648129 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-AggregatesAdminTestJSON-144473189-project Sep 23 04:31:44.648129 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:31:44.648129 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:31:44.648129 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 82ee10291f2c4914b348a82e51b9c967 Sep 23 04:31:44.648129 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-AggregatesAdminTestJSON-144473189-project Sep 23 04:31:44.648129 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:31:44.648129 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 43aee7fc-54b8-4499-998b-92054bfd82b4 could not be found. Sep 23 04:31:44.648129 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '43aee7fc-54b8-4499-998b-92054bfd82b4'} Sep 23 04:31:44.648936 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:31:44.648936 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:31:44.648936 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:31:44.648936 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:31:44.648936 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:31:44.648936 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:31:44.648936 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:31:44.648936 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:31:44.648936 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:31:44.648936 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:31:44.648936 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43aee7fc-54b8-4499-998b-92054bfd82b4 could not be found. Sep 23 04:31:44.648936 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:31:44.648936 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:31:44.648936 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:31:44.648936 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:31:44.648936 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:31:44.648936 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:31:44.648936 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:31:44.648936 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:31:44.648936 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:31:44.650308 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:31:44.650308 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:31:44.650308 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:31:44.650308 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:31:44.650308 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:31:44.650308 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:31:44.650308 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:31:44.650308 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43aee7fc-54b8-4499-998b-92054bfd82b4 could not be found. Sep 23 04:31:44.650308 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:31:44.650308 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:31:44.650308 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:31:44.650308 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:31:44.650308 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:31:44.650308 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:31:44.650308 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:31:44.650308 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:31:44.650308 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43aee7fc-54b8-4499-998b-92054bfd82b4 could not be found. Sep 23 04:31:44.650308 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:31:44.651786 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f7197321-b276-4976-9d6c-a04882adbd23 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] Returning 404 to user: Instance 43aee7fc-54b8-4499-998b-92054bfd82b4 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:31:44.651786 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f7197321-b276-4976-9d6c-a04882adbd23 tempest-AggregatesAdminTestJSON-144473189 tempest-AggregatesAdminTestJSON-144473189-project] 10.222.0.33 "GET /compute/v2.1/servers/43aee7fc-54b8-4499-998b-92054bfd82b4" status: 404 len: 111 microversion: 2.1 time: 0.097390 Sep 23 04:31:44.651786 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 131/272] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:31:44 2022] GET /compute/v2.1/servers/43aee7fc-54b8-4499-998b-92054bfd82b4 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:31:44.813988 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7801484c-714a-4e2a-9bee-035b74c99cfb tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:44.814751 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-7801484c-714a-4e2a-9bee-035b74c99cfb tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] [instance: 24b8436f-97ba-49c5-ad91-8aea43f0e755] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:44.827025 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7801484c-714a-4e2a-9bee-035b74c99cfb tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:44.829375 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7801484c-714a-4e2a-9bee-035b74c99cfb tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:44.830022 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7801484c-714a-4e2a-9bee-035b74c99cfb tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:44.831679 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7801484c-714a-4e2a-9bee-035b74c99cfb tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:44.832384 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7801484c-714a-4e2a-9bee-035b74c99cfb tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:44.834557 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7801484c-714a-4e2a-9bee-035b74c99cfb tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:44.891120 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8d317d4b-fe37-4764-ae3c-e5d73b28237e tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcc413bf53847b89cfe6bdf48909ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c7c21aa6b342b6bc52365cfdeb7c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:44.897419 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8d317d4b-fe37-4764-ae3c-e5d73b28237e tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] 10.222.0.33 "GET /compute/v2.1/servers/074ac5a1-94af-4e9d-b458-107710ca0972" status: 200 len: 1587 microversion: 2.1 time: 0.515091 Sep 23 04:31:44.915480 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 142/273] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:31:44 2022] GET /compute/v2.1/servers/074ac5a1-94af-4e9d-b458-107710ca0972 => generated 1587 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:31:44.927655 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b99732b9-fb71-4726-8c5c-50d2b63c91c5 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:44.928500 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b99732b9-fb71-4726-8c5c-50d2b63c91c5 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] [instance: 074ac5a1-94af-4e9d-b458-107710ca0972] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:44.934940 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b99732b9-fb71-4726-8c5c-50d2b63c91c5 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:44.935888 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b99732b9-fb71-4726-8c5c-50d2b63c91c5 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:44.936583 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b99732b9-fb71-4726-8c5c-50d2b63c91c5 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:44.937562 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b99732b9-fb71-4726-8c5c-50d2b63c91c5 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:44.938275 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b99732b9-fb71-4726-8c5c-50d2b63c91c5 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:44.938922 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b99732b9-fb71-4726-8c5c-50d2b63c91c5 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:45.212938 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b99732b9-fb71-4726-8c5c-50d2b63c91c5 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] 10.222.0.33 "GET /compute/v2.1/servers/074ac5a1-94af-4e9d-b458-107710ca0972/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.285797 Sep 23 04:31:45.212938 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 143/274] 10.222.0.33 () {58 vars in 1275 bytes} [Fri Sep 23 04:31:44 2022] GET /compute/v2.1/servers/074ac5a1-94af-4e9d-b458-107710ca0972/os-interface => generated 285 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:31:45.214760 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f3737775-cc48-4406-a475-41116984f1b8 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:45.215586 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f3737775-cc48-4406-a475-41116984f1b8 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] [instance: ed83bf5a-f3ce-4b5c-af6f-92b80599a022] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:45.215963 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-7801484c-714a-4e2a-9bee-035b74c99cfb tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac39d27bcf5d4def9ff9bd5b81bd7b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79442cd4a69040f594e19b3492df7e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:45.228335 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=10,nova_api:DELETE=7,nova_api:UPDATE=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:31:45.228820 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-7801484c-714a-4e2a-9bee-035b74c99cfb tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] 10.222.0.33 "GET /compute/v2.1/servers/24b8436f-97ba-49c5-ad91-8aea43f0e755" status: 200 len: 1320 microversion: 2.1 time: 0.419470 Sep 23 04:31:45.232005 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 132/275] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:31:44 2022] GET /compute/v2.1/servers/24b8436f-97ba-49c5-ad91-8aea43f0e755 => generated 1320 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:31:45.249255 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f3737775-cc48-4406-a475-41116984f1b8 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:45.249834 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f3737775-cc48-4406-a475-41116984f1b8 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:45.250312 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f3737775-cc48-4406-a475-41116984f1b8 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:45.251052 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f3737775-cc48-4406-a475-41116984f1b8 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:45.251510 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f3737775-cc48-4406-a475-41116984f1b8 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:45.251934 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f3737775-cc48-4406-a475-41116984f1b8 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:45.397957 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-49b65836-390f-494c-aab1-28ca808953b3 req-8a551a89-d41f-4ccd-9822-30c6c201ba28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbf05a2b-af42-4f14-8956-4f6249c46974", "name": "network-vif-plugged", "status": "completed", "tag": "e5083905-a132-4abf-8cec-deb2f60a1547"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:31:45.407756 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f3737775-cc48-4406-a475-41116984f1b8 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54d1a7a9e4ee44b9992ff9362108b311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649eb80e1ea849868c651849047833e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:45.413428 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-49b65836-390f-494c-aab1-28ca808953b3 req-8a551a89-d41f-4ccd-9822-30c6c201ba28 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:45.420160 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-49b65836-390f-494c-aab1-28ca808953b3 req-8a551a89-d41f-4ccd-9822-30c6c201ba28 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:45.420160 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-49b65836-390f-494c-aab1-28ca808953b3 req-8a551a89-d41f-4ccd-9822-30c6c201ba28 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:45.420375 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f3737775-cc48-4406-a475-41116984f1b8 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] 10.222.0.33 "GET /compute/v2.1/servers/ed83bf5a-f3ce-4b5c-af6f-92b80599a022" status: 200 len: 1280 microversion: 2.1 time: 0.206576 Sep 23 04:31:45.420375 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 144/276] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:31:45 2022] GET /compute/v2.1/servers/ed83bf5a-f3ce-4b5c-af6f-92b80599a022 => generated 1280 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:31:45.436245 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-49b65836-390f-494c-aab1-28ca808953b3 req-8a551a89-d41f-4ccd-9822-30c6c201ba28 service nova] Creating event network-vif-plugged:e5083905-a132-4abf-8cec-deb2f60a1547 for instance bbf05a2b-af42-4f14-8956-4f6249c46974 on n-h2-846463-3 Sep 23 04:31:45.443321 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-49b65836-390f-494c-aab1-28ca808953b3 req-8a551a89-d41f-4ccd-9822-30c6c201ba28 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049394 Sep 23 04:31:45.443321 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 133/277] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:31:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:31:45.477306 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4139bbb1-1735-4b69-af58-c81dfc852fea tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:45.477944 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4139bbb1-1735-4b69-af58-c81dfc852fea tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: bbf05a2b-af42-4f14-8956-4f6249c46974] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:45.485092 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4139bbb1-1735-4b69-af58-c81dfc852fea tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:45.485586 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4139bbb1-1735-4b69-af58-c81dfc852fea tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:45.495611 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4139bbb1-1735-4b69-af58-c81dfc852fea tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:45.496392 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4139bbb1-1735-4b69-af58-c81dfc852fea tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:45.496866 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4139bbb1-1735-4b69-af58-c81dfc852fea tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:45.497315 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4139bbb1-1735-4b69-af58-c81dfc852fea tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:45.524471 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=100 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:31:45.946247 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4139bbb1-1735-4b69-af58-c81dfc852fea tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:45.959665 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4139bbb1-1735-4b69-af58-c81dfc852fea tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:45.964795 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4139bbb1-1735-4b69-af58-c81dfc852fea tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:45.967455 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4139bbb1-1735-4b69-af58-c81dfc852fea tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/bbf05a2b-af42-4f14-8956-4f6249c46974" status: 200 len: 1362 microversion: 2.25 time: 0.493998 Sep 23 04:31:45.969261 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 145/278] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:31:45 2022] GET /compute/v2.1/servers/bbf05a2b-af42-4f14-8956-4f6249c46974 => generated 1362 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:31:46.256599 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9da398dc-3448-4565-9b1e-54bb1d2ff21b tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:46.257338 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-9da398dc-3448-4565-9b1e-54bb1d2ff21b tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] [instance: 24b8436f-97ba-49c5-ad91-8aea43f0e755] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:46.266133 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9da398dc-3448-4565-9b1e-54bb1d2ff21b tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:46.266953 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9da398dc-3448-4565-9b1e-54bb1d2ff21b tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:46.267827 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9da398dc-3448-4565-9b1e-54bb1d2ff21b tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:46.269499 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9da398dc-3448-4565-9b1e-54bb1d2ff21b tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:46.270234 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9da398dc-3448-4565-9b1e-54bb1d2ff21b tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:46.270893 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9da398dc-3448-4565-9b1e-54bb1d2ff21b tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:46.505482 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-beb955e3-3e9e-4335-ae88-36ee230ea0d0 tempest-FlavorMetadataValidation-1582411828 tempest-FlavorMetadataValidation-1582411828-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-1324933628", "id": 53079636, "os-flavor-access:is_public": "True"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:31:46.597972 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-beb955e3-3e9e-4335-ae88-36ee230ea0d0 tempest-FlavorMetadataValidation-1582411828 tempest-FlavorMetadataValidation-1582411828-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 465 microversion: 2.86 time: 0.252195 Sep 23 04:31:46.608924 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 146/279] 10.222.0.33 () {62 vars in 1188 bytes} [Fri Sep 23 04:31:46 2022] POST /compute/v2.1/flavors => generated 465 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 04:31:46.615176 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a5028834-08f6-46dc-b2f0-cdeb6ba31cca tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:46.615873 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a5028834-08f6-46dc-b2f0-cdeb6ba31cca tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] [instance: ed83bf5a-f3ce-4b5c-af6f-92b80599a022] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:46.627076 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a5028834-08f6-46dc-b2f0-cdeb6ba31cca tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:46.627912 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a5028834-08f6-46dc-b2f0-cdeb6ba31cca tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:46.630469 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a5028834-08f6-46dc-b2f0-cdeb6ba31cca tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:46.631748 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a5028834-08f6-46dc-b2f0-cdeb6ba31cca tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:46.632364 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a5028834-08f6-46dc-b2f0-cdeb6ba31cca tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:46.634292 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a5028834-08f6-46dc-b2f0-cdeb6ba31cca tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:46.798304 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a5028834-08f6-46dc-b2f0-cdeb6ba31cca tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54d1a7a9e4ee44b9992ff9362108b311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649eb80e1ea849868c651849047833e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:46.822443 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a5028834-08f6-46dc-b2f0-cdeb6ba31cca tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] 10.222.0.33 "GET /compute/v2.1/servers/ed83bf5a-f3ce-4b5c-af6f-92b80599a022" status: 200 len: 1280 microversion: 2.1 time: 0.201425 Sep 23 04:31:46.824777 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 147/280] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:31:46 2022] GET /compute/v2.1/servers/ed83bf5a-f3ce-4b5c-af6f-92b80599a022 => generated 1280 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:31:46.839949 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-782aaa0a-cbd8-43fb-a075-0b6f6e3994c9 tempest-FlavorMetadataValidation-1582411828 tempest-FlavorMetadataValidation-1582411828-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:31:46.882989 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-9da398dc-3448-4565-9b1e-54bb1d2ff21b tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac39d27bcf5d4def9ff9bd5b81bd7b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79442cd4a69040f594e19b3492df7e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:46.910425 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-9da398dc-3448-4565-9b1e-54bb1d2ff21b tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] 10.222.0.33 "GET /compute/v2.1/servers/24b8436f-97ba-49c5-ad91-8aea43f0e755" status: 200 len: 1320 microversion: 2.1 time: 0.658469 Sep 23 04:31:46.926046 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 134/281] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:31:46 2022] GET /compute/v2.1/servers/24b8436f-97ba-49c5-ad91-8aea43f0e755 => generated 1320 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:31:47.002124 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5b870dea-009b-418c-a4e0-d3f25bffcf61 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:47.011300 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-5b870dea-009b-418c-a4e0-d3f25bffcf61 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: bbf05a2b-af42-4f14-8956-4f6249c46974] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:47.017600 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5b870dea-009b-418c-a4e0-d3f25bffcf61 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:47.020394 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5b870dea-009b-418c-a4e0-d3f25bffcf61 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:47.021963 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5b870dea-009b-418c-a4e0-d3f25bffcf61 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:47.023132 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5b870dea-009b-418c-a4e0-d3f25bffcf61 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:47.028371 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5b870dea-009b-418c-a4e0-d3f25bffcf61 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:47.029405 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5b870dea-009b-418c-a4e0-d3f25bffcf61 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:47.293792 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-782aaa0a-cbd8-43fb-a075-0b6f6e3994c9 tempest-FlavorMetadataValidation-1582411828 tempest-FlavorMetadataValidation-1582411828-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/53079636/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.465480 Sep 23 04:31:47.299401 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 148/282] 10.222.0.33 () {62 vars in 1259 bytes} [Fri Sep 23 04:31:46 2022] POST /compute/v2.1/flavors/53079636/os-extra_specs => generated 62 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:31:47.322089 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-33052349-73a3-4b97-9619-20f2e864bddf tempest-FlavorMetadataValidation-1582411828 tempest-FlavorMetadataValidation-1582411828-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:47.473852 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-33052349-73a3-4b97-9619-20f2e864bddf tempest-FlavorMetadataValidation-1582411828 tempest-FlavorMetadataValidation-1582411828-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/53079636" status: 202 len: 0 microversion: 2.86 time: 0.166914 Sep 23 04:31:47.477609 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 149/283] 10.222.0.33 () {60 vars in 1196 bytes} [Fri Sep 23 04:31:47 2022] DELETE /compute/v2.1/flavors/53079636 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:31:47.483177 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c0084f21-140a-4833-8bb3-40a0e1ab43a8 tempest-FlavorMetadataValidation-1582411828 tempest-FlavorMetadataValidation-1582411828-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:47.533502 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c0084f21-140a-4833-8bb3-40a0e1ab43a8 tempest-FlavorMetadataValidation-1582411828 tempest-FlavorMetadataValidation-1582411828-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 6681 microversion: 2.86 time: 0.054123 Sep 23 04:31:47.536298 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 150/284] 10.222.0.33 () {60 vars in 1187 bytes} [Fri Sep 23 04:31:47 2022] GET /compute/v2.1/flavors/detail => generated 6681 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:31:47.574270 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-5b870dea-009b-418c-a4e0-d3f25bffcf61 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:47.588369 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-5b870dea-009b-418c-a4e0-d3f25bffcf61 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:47.589832 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-5b870dea-009b-418c-a4e0-d3f25bffcf61 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:47.591019 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5b870dea-009b-418c-a4e0-d3f25bffcf61 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/bbf05a2b-af42-4f14-8956-4f6249c46974" status: 200 len: 1362 microversion: 2.25 time: 0.599833 Sep 23 04:31:47.591576 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 135/285] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:31:46 2022] GET /compute/v2.1/servers/bbf05a2b-af42-4f14-8956-4f6249c46974 => generated 1362 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:31:47.849337 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-10f6210d-42c7-4f59-baac-c3b0f496c8ce tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:47.857718 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-10f6210d-42c7-4f59-baac-c3b0f496c8ce tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] [instance: ed83bf5a-f3ce-4b5c-af6f-92b80599a022] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:47.858557 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-10f6210d-42c7-4f59-baac-c3b0f496c8ce tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:47.859220 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-10f6210d-42c7-4f59-baac-c3b0f496c8ce tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:47.859780 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-10f6210d-42c7-4f59-baac-c3b0f496c8ce tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:47.860377 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-10f6210d-42c7-4f59-baac-c3b0f496c8ce tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:47.860839 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-10f6210d-42c7-4f59-baac-c3b0f496c8ce tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:47.861267 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-10f6210d-42c7-4f59-baac-c3b0f496c8ce tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:47.934939 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-40d10127-502f-4a51-9a7a-e779a8484871 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:47.935755 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-40d10127-502f-4a51-9a7a-e779a8484871 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] [instance: 24b8436f-97ba-49c5-ad91-8aea43f0e755] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:47.944751 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-40d10127-502f-4a51-9a7a-e779a8484871 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:47.945375 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-40d10127-502f-4a51-9a7a-e779a8484871 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:47.945942 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-40d10127-502f-4a51-9a7a-e779a8484871 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:47.949653 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-40d10127-502f-4a51-9a7a-e779a8484871 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:47.949653 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-40d10127-502f-4a51-9a7a-e779a8484871 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:47.949653 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-40d10127-502f-4a51-9a7a-e779a8484871 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:48.224062 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-10f6210d-42c7-4f59-baac-c3b0f496c8ce tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54d1a7a9e4ee44b9992ff9362108b311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649eb80e1ea849868c651849047833e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:48.238683 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-10f6210d-42c7-4f59-baac-c3b0f496c8ce tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] 10.222.0.33 "GET /compute/v2.1/servers/ed83bf5a-f3ce-4b5c-af6f-92b80599a022" status: 200 len: 1322 microversion: 2.1 time: 0.394094 Sep 23 04:31:48.239294 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 151/286] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:31:47 2022] GET /compute/v2.1/servers/ed83bf5a-f3ce-4b5c-af6f-92b80599a022 => generated 1322 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:31:48.300333 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-40d10127-502f-4a51-9a7a-e779a8484871 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac39d27bcf5d4def9ff9bd5b81bd7b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79442cd4a69040f594e19b3492df7e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:48.313019 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ec5fde9a-c07a-4a76-a5d7-5372226c9686 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:48.320804 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-ec5fde9a-c07a-4a76-a5d7-5372226c9686 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] [instance: 074ac5a1-94af-4e9d-b458-107710ca0972] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:48.343311 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-40d10127-502f-4a51-9a7a-e779a8484871 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] 10.222.0.33 "GET /compute/v2.1/servers/24b8436f-97ba-49c5-ad91-8aea43f0e755" status: 200 len: 1320 microversion: 2.1 time: 0.397295 Sep 23 04:31:48.343311 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 136/287] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:31:47 2022] GET /compute/v2.1/servers/24b8436f-97ba-49c5-ad91-8aea43f0e755 => generated 1320 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:31:48.343607 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ec5fde9a-c07a-4a76-a5d7-5372226c9686 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:48.343607 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ec5fde9a-c07a-4a76-a5d7-5372226c9686 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:48.343607 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ec5fde9a-c07a-4a76-a5d7-5372226c9686 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:48.343607 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ec5fde9a-c07a-4a76-a5d7-5372226c9686 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:48.344015 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ec5fde9a-c07a-4a76-a5d7-5372226c9686 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:48.344015 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ec5fde9a-c07a-4a76-a5d7-5372226c9686 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:48.347854 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-2dc428b7-6134-47fe-8b58-3ea27177bbf6 req-dd41c3c1-4fe3-4511-a504-531a76312e94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "074ac5a1-94af-4e9d-b458-107710ca0972", "tag": "d2a87d8d-10e1-4e42-a88a-2baacccb1f56"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:31:48.368531 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-2dc428b7-6134-47fe-8b58-3ea27177bbf6 req-dd41c3c1-4fe3-4511-a504-531a76312e94 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:48.370370 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-2dc428b7-6134-47fe-8b58-3ea27177bbf6 req-dd41c3c1-4fe3-4511-a504-531a76312e94 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:48.370931 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-2dc428b7-6134-47fe-8b58-3ea27177bbf6 req-dd41c3c1-4fe3-4511-a504-531a76312e94 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:48.416300 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-2dc428b7-6134-47fe-8b58-3ea27177bbf6 req-dd41c3c1-4fe3-4511-a504-531a76312e94 service nova] Creating event network-changed:d2a87d8d-10e1-4e42-a88a-2baacccb1f56 for instance 074ac5a1-94af-4e9d-b458-107710ca0972 on n-h1-846463-3 Sep 23 04:31:48.429985 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-2dc428b7-6134-47fe-8b58-3ea27177bbf6 req-dd41c3c1-4fe3-4511-a504-531a76312e94 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086302 Sep 23 04:31:48.435423 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 137/288] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:31:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:31:48.619196 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-21361641-eaac-4eb5-ba5b-91cc1c44a376 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:48.620071 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-21361641-eaac-4eb5-ba5b-91cc1c44a376 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: bbf05a2b-af42-4f14-8956-4f6249c46974] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:48.628850 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-21361641-eaac-4eb5-ba5b-91cc1c44a376 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:48.629998 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-21361641-eaac-4eb5-ba5b-91cc1c44a376 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:48.648539 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-21361641-eaac-4eb5-ba5b-91cc1c44a376 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:48.650170 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-21361641-eaac-4eb5-ba5b-91cc1c44a376 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:48.650880 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-21361641-eaac-4eb5-ba5b-91cc1c44a376 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:48.651711 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-21361641-eaac-4eb5-ba5b-91cc1c44a376 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:48.946487 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ec5fde9a-c07a-4a76-a5d7-5372226c9686 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcc413bf53847b89cfe6bdf48909ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c7c21aa6b342b6bc52365cfdeb7c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:48.960029 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ec5fde9a-c07a-4a76-a5d7-5372226c9686 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] 10.222.0.33 "GET /compute/v2.1/servers/074ac5a1-94af-4e9d-b458-107710ca0972" status: 200 len: 1587 microversion: 2.1 time: 0.651634 Sep 23 04:31:48.963890 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 152/289] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:31:48 2022] GET /compute/v2.1/servers/074ac5a1-94af-4e9d-b458-107710ca0972 => generated 1587 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:31:49.047567 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-21361641-eaac-4eb5-ba5b-91cc1c44a376 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:49.062657 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-21361641-eaac-4eb5-ba5b-91cc1c44a376 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:49.065295 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-21361641-eaac-4eb5-ba5b-91cc1c44a376 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:49.065515 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-21361641-eaac-4eb5-ba5b-91cc1c44a376 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/bbf05a2b-af42-4f14-8956-4f6249c46974" status: 200 len: 1559 microversion: 2.25 time: 0.450944 Sep 23 04:31:49.070004 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 138/290] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:31:48 2022] GET /compute/v2.1/servers/bbf05a2b-af42-4f14-8956-4f6249c46974 => generated 1559 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:31:49.263682 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0a6fb32a-3bec-4dd4-bc49-41dab2880683 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:49.264413 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-0a6fb32a-3bec-4dd4-bc49-41dab2880683 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] [instance: ed83bf5a-f3ce-4b5c-af6f-92b80599a022] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:49.275766 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0a6fb32a-3bec-4dd4-bc49-41dab2880683 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:49.276695 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0a6fb32a-3bec-4dd4-bc49-41dab2880683 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:49.280861 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0a6fb32a-3bec-4dd4-bc49-41dab2880683 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:49.282239 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0a6fb32a-3bec-4dd4-bc49-41dab2880683 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:49.282941 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0a6fb32a-3bec-4dd4-bc49-41dab2880683 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:49.283588 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0a6fb32a-3bec-4dd4-bc49-41dab2880683 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:49.546523 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=4 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:31:49.562055 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-0a6fb32a-3bec-4dd4-bc49-41dab2880683 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54d1a7a9e4ee44b9992ff9362108b311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649eb80e1ea849868c651849047833e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:49.572532 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0a6fb32a-3bec-4dd4-bc49-41dab2880683 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] 10.222.0.33 "GET /compute/v2.1/servers/ed83bf5a-f3ce-4b5c-af6f-92b80599a022" status: 200 len: 1322 microversion: 2.1 time: 0.313465 Sep 23 04:31:49.575345 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 139/291] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:31:49 2022] GET /compute/v2.1/servers/ed83bf5a-f3ce-4b5c-af6f-92b80599a022 => generated 1322 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:31:49.585551 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ed0593e1-2e02-4bed-953e-ce2dc2110ed8 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:49.587393 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ed0593e1-2e02-4bed-953e-ce2dc2110ed8 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] [instance: 24b8436f-97ba-49c5-ad91-8aea43f0e755] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:49.599576 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ed0593e1-2e02-4bed-953e-ce2dc2110ed8 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:49.601852 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ed0593e1-2e02-4bed-953e-ce2dc2110ed8 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:49.602371 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=20 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:31:49.602676 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ed0593e1-2e02-4bed-953e-ce2dc2110ed8 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:49.606626 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ed0593e1-2e02-4bed-953e-ce2dc2110ed8 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:49.607131 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ed0593e1-2e02-4bed-953e-ce2dc2110ed8 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:49.607571 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ed0593e1-2e02-4bed-953e-ce2dc2110ed8 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:49.702759 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1a4c4923-c95c-4020-a07d-68d78051939a tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:49.703566 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-1a4c4923-c95c-4020-a07d-68d78051939a tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] [instance: bbf05a2b-af42-4f14-8956-4f6249c46974] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:49.716593 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1a4c4923-c95c-4020-a07d-68d78051939a tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:49.717171 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1a4c4923-c95c-4020-a07d-68d78051939a tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:49.718682 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1a4c4923-c95c-4020-a07d-68d78051939a tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:49.719586 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1a4c4923-c95c-4020-a07d-68d78051939a tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:49.720874 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1a4c4923-c95c-4020-a07d-68d78051939a tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:49.722803 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1a4c4923-c95c-4020-a07d-68d78051939a tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:49.792009 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ed0593e1-2e02-4bed-953e-ce2dc2110ed8 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac39d27bcf5d4def9ff9bd5b81bd7b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79442cd4a69040f594e19b3492df7e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:49.802402 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ed0593e1-2e02-4bed-953e-ce2dc2110ed8 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] 10.222.0.33 "GET /compute/v2.1/servers/24b8436f-97ba-49c5-ad91-8aea43f0e755" status: 200 len: 1320 microversion: 2.1 time: 0.225133 Sep 23 04:31:49.803013 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 140/292] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:31:49 2022] GET /compute/v2.1/servers/24b8436f-97ba-49c5-ad91-8aea43f0e755 => generated 1320 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:31:50.004035 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-1a4c4923-c95c-4020-a07d-68d78051939a tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lazy-loading 'services' on Instance uuid bbf05a2b-af42-4f14-8956-4f6249c46974 {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:31:50.059461 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-1a4c4923-c95c-4020-a07d-68d78051939a tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/bbf05a2b-af42-4f14-8956-4f6249c46974" status: 200 len: 2052 microversion: 2.25 time: 0.968324 Sep 23 04:31:50.061077 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 153/293] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:31:49 2022] GET /compute/v2.1/servers/bbf05a2b-af42-4f14-8956-4f6249c46974 => generated 2052 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:31:50.088104 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1d1e3a7b-dfdb-46bb-afe4-b2d749c4e1f3 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:50.089072 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1d1e3a7b-dfdb-46bb-afe4-b2d749c4e1f3 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] [instance: bbf05a2b-af42-4f14-8956-4f6249c46974] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:50.095979 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1d1e3a7b-dfdb-46bb-afe4-b2d749c4e1f3 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:50.096712 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1d1e3a7b-dfdb-46bb-afe4-b2d749c4e1f3 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:50.097307 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1d1e3a7b-dfdb-46bb-afe4-b2d749c4e1f3 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:50.098730 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1d1e3a7b-dfdb-46bb-afe4-b2d749c4e1f3 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:50.099614 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1d1e3a7b-dfdb-46bb-afe4-b2d749c4e1f3 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:50.100393 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1d1e3a7b-dfdb-46bb-afe4-b2d749c4e1f3 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:50.200794 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=100 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:31:50.247217 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-edd9501a-6a73-41f4-983e-f42808835771 req-a7ed224a-7ed2-4e76-ac61-23d588f8b928 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24b8436f-97ba-49c5-ad91-8aea43f0e755", "name": "network-vif-plugged", "status": "completed", "tag": "74eca486-20b1-4087-bc60-f2deb1ac37e5"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:31:50.278068 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-edd9501a-6a73-41f4-983e-f42808835771 req-a7ed224a-7ed2-4e76-ac61-23d588f8b928 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:50.282062 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-edd9501a-6a73-41f4-983e-f42808835771 req-a7ed224a-7ed2-4e76-ac61-23d588f8b928 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:50.282062 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-edd9501a-6a73-41f4-983e-f42808835771 req-a7ed224a-7ed2-4e76-ac61-23d588f8b928 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:50.313870 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-edd9501a-6a73-41f4-983e-f42808835771 req-a7ed224a-7ed2-4e76-ac61-23d588f8b928 service nova] Creating event network-vif-plugged:74eca486-20b1-4087-bc60-f2deb1ac37e5 for instance 24b8436f-97ba-49c5-ad91-8aea43f0e755 on n-h2-846463-3 Sep 23 04:31:50.321190 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-edd9501a-6a73-41f4-983e-f42808835771 req-a7ed224a-7ed2-4e76-ac61-23d588f8b928 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091273 Sep 23 04:31:50.322315 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 154/294] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:31:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:31:50.444539 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-1d1e3a7b-dfdb-46bb-afe4-b2d749c4e1f3 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lazy-loading 'services' on Instance uuid bbf05a2b-af42-4f14-8956-4f6249c46974 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:31:50.604540 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-fbbc2075-bef3-4046-b88c-7f6727787f43 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:50.605844 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-fbbc2075-bef3-4046-b88c-7f6727787f43 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] [instance: ed83bf5a-f3ce-4b5c-af6f-92b80599a022] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:50.632990 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fbbc2075-bef3-4046-b88c-7f6727787f43 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:50.636533 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fbbc2075-bef3-4046-b88c-7f6727787f43 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:50.638440 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fbbc2075-bef3-4046-b88c-7f6727787f43 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:50.639185 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fbbc2075-bef3-4046-b88c-7f6727787f43 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:50.639705 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fbbc2075-bef3-4046-b88c-7f6727787f43 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:50.644728 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fbbc2075-bef3-4046-b88c-7f6727787f43 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:50.677578 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1d1e3a7b-dfdb-46bb-afe4-b2d749c4e1f3 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/bbf05a2b-af42-4f14-8956-4f6249c46974" status: 200 len: 2052 microversion: 2.25 time: 0.576783 Sep 23 04:31:50.682529 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 141/295] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:31:50 2022] GET /compute/v2.1/servers/bbf05a2b-af42-4f14-8956-4f6249c46974 => generated 2052 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:31:50.709923 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-24f486fc-3b7c-4810-8d38-4382bbe17f4a req-c5f637e2-990f-4ba9-a66d-56ce1f7215ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed83bf5a-f3ce-4b5c-af6f-92b80599a022", "tag": "76175fda-bb1d-4f82-bc8b-0c30bf8aee3f"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:31:50.763719 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-24f486fc-3b7c-4810-8d38-4382bbe17f4a req-c5f637e2-990f-4ba9-a66d-56ce1f7215ae service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:50.768284 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-24f486fc-3b7c-4810-8d38-4382bbe17f4a req-c5f637e2-990f-4ba9-a66d-56ce1f7215ae service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:50.771182 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-24f486fc-3b7c-4810-8d38-4382bbe17f4a req-c5f637e2-990f-4ba9-a66d-56ce1f7215ae service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:50.819605 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-24f486fc-3b7c-4810-8d38-4382bbe17f4a req-c5f637e2-990f-4ba9-a66d-56ce1f7215ae service nova] Creating event network-changed:76175fda-bb1d-4f82-bc8b-0c30bf8aee3f for instance ed83bf5a-f3ce-4b5c-af6f-92b80599a022 on n-h1-846463-3 Sep 23 04:31:50.844914 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-24f486fc-3b7c-4810-8d38-4382bbe17f4a req-c5f637e2-990f-4ba9-a66d-56ce1f7215ae service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.158634 Sep 23 04:31:50.846833 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 142/296] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:31:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:31:50.857289 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-75253380-57b6-48a5-9274-fc08c976e50c tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:50.863871 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-75253380-57b6-48a5-9274-fc08c976e50c tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:50.864874 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-75253380-57b6-48a5-9274-fc08c976e50c tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:50.877387 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-75253380-57b6-48a5-9274-fc08c976e50c tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:50.877387 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-75253380-57b6-48a5-9274-fc08c976e50c tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:50.877387 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-75253380-57b6-48a5-9274-fc08c976e50c tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:50.877387 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-75253380-57b6-48a5-9274-fc08c976e50c tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:50.934881 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-75253380-57b6-48a5-9274-fc08c976e50c tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.084098 Sep 23 04:31:50.935773 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 143/297] 10.222.0.33 () {60 vars in 1217 bytes} [Fri Sep 23 04:31:50 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 04:31:50.943463 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ee3f9e78-83ae-4846-bd43-67a1bf6e45b6 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:50.945190 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ee3f9e78-83ae-4846-bd43-67a1bf6e45b6 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] [instance: 24b8436f-97ba-49c5-ad91-8aea43f0e755] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:50.957932 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ee3f9e78-83ae-4846-bd43-67a1bf6e45b6 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:50.960706 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ee3f9e78-83ae-4846-bd43-67a1bf6e45b6 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:50.961526 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ee3f9e78-83ae-4846-bd43-67a1bf6e45b6 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:50.966188 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ee3f9e78-83ae-4846-bd43-67a1bf6e45b6 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:50.969128 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ee3f9e78-83ae-4846-bd43-67a1bf6e45b6 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:50.973455 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ee3f9e78-83ae-4846-bd43-67a1bf6e45b6 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:51.313782 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-fbbc2075-bef3-4046-b88c-7f6727787f43 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54d1a7a9e4ee44b9992ff9362108b311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649eb80e1ea849868c651849047833e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:51.326226 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-fbbc2075-bef3-4046-b88c-7f6727787f43 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] 10.222.0.33 "GET /compute/v2.1/servers/ed83bf5a-f3ce-4b5c-af6f-92b80599a022" status: 200 len: 1322 microversion: 2.1 time: 0.726784 Sep 23 04:31:51.326812 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 155/298] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:31:50 2022] GET /compute/v2.1/servers/ed83bf5a-f3ce-4b5c-af6f-92b80599a022 => generated 1322 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:31:51.334518 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0d6f1010-f593-41c3-91a3-f6e1a0dcdeaf tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-846463-3", "block_migration": "auto"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:31:51.340302 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-0d6f1010-f593-41c3-91a3-f6e1a0dcdeaf tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] [instance: bbf05a2b-af42-4f14-8956-4f6249c46974] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:51.360373 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0d6f1010-f593-41c3-91a3-f6e1a0dcdeaf tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:51.361044 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0d6f1010-f593-41c3-91a3-f6e1a0dcdeaf tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:51.364177 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0d6f1010-f593-41c3-91a3-f6e1a0dcdeaf tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:51.365139 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0d6f1010-f593-41c3-91a3-f6e1a0dcdeaf tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:51.366084 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0d6f1010-f593-41c3-91a3-f6e1a0dcdeaf tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:51.366702 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0d6f1010-f593-41c3-91a3-f6e1a0dcdeaf tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:51.399856 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ee3f9e78-83ae-4846-bd43-67a1bf6e45b6 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac39d27bcf5d4def9ff9bd5b81bd7b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79442cd4a69040f594e19b3492df7e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:51.412264 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ee3f9e78-83ae-4846-bd43-67a1bf6e45b6 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] 10.222.0.33 "GET /compute/v2.1/servers/24b8436f-97ba-49c5-ad91-8aea43f0e755" status: 200 len: 1320 microversion: 2.1 time: 0.474938 Sep 23 04:31:51.413969 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 144/299] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:31:50 2022] GET /compute/v2.1/servers/24b8436f-97ba-49c5-ad91-8aea43f0e755 => generated 1320 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:31:52.354205 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5a815471-dd7c-42bd-9aaa-63aedc046b76 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:52.357396 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-5a815471-dd7c-42bd-9aaa-63aedc046b76 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] [instance: ed83bf5a-f3ce-4b5c-af6f-92b80599a022] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:52.372382 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=30 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:31:52.376642 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5a815471-dd7c-42bd-9aaa-63aedc046b76 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:52.377418 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5a815471-dd7c-42bd-9aaa-63aedc046b76 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:52.382587 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5a815471-dd7c-42bd-9aaa-63aedc046b76 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:52.383774 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5a815471-dd7c-42bd-9aaa-63aedc046b76 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:52.384558 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5a815471-dd7c-42bd-9aaa-63aedc046b76 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:52.385259 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5a815471-dd7c-42bd-9aaa-63aedc046b76 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:52.512333 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-0d6f1010-f593-41c3-91a3-f6e1a0dcdeaf tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lazy-loading 'flavor' on Instance uuid bbf05a2b-af42-4f14-8956-4f6249c46974 {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:31:52.647478 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-0d6f1010-f593-41c3-91a3-f6e1a0dcdeaf tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] [instance: bbf05a2b-af42-4f14-8956-4f6249c46974] Going to try to live migrate instance to n-h1-846463-3 {{(pid=122698) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 23 04:31:52.669119 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-5a815471-dd7c-42bd-9aaa-63aedc046b76 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54d1a7a9e4ee44b9992ff9362108b311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649eb80e1ea849868c651849047833e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:52.685857 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5a815471-dd7c-42bd-9aaa-63aedc046b76 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] 10.222.0.33 "GET /compute/v2.1/servers/ed83bf5a-f3ce-4b5c-af6f-92b80599a022" status: 200 len: 1322 microversion: 2.1 time: 0.336952 Sep 23 04:31:52.686483 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 145/300] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:31:52 2022] GET /compute/v2.1/servers/ed83bf5a-f3ce-4b5c-af6f-92b80599a022 => generated 1322 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:31:52.711324 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-fabf7827-5023-4114-b115-983016d60253 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:52.715218 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-fabf7827-5023-4114-b115-983016d60253 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] [instance: 24b8436f-97ba-49c5-ad91-8aea43f0e755] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:52.730234 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fabf7827-5023-4114-b115-983016d60253 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:52.731451 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fabf7827-5023-4114-b115-983016d60253 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:52.733556 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fabf7827-5023-4114-b115-983016d60253 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:52.734596 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fabf7827-5023-4114-b115-983016d60253 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:52.736377 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fabf7827-5023-4114-b115-983016d60253 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:52.738067 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fabf7827-5023-4114-b115-983016d60253 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:52.969173 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-fabf7827-5023-4114-b115-983016d60253 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac39d27bcf5d4def9ff9bd5b81bd7b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79442cd4a69040f594e19b3492df7e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:52.978853 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-fabf7827-5023-4114-b115-983016d60253 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] 10.222.0.33 "GET /compute/v2.1/servers/24b8436f-97ba-49c5-ad91-8aea43f0e755" status: 200 len: 1469 microversion: 2.1 time: 0.291316 Sep 23 04:31:52.997654 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 146/301] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:31:52 2022] GET /compute/v2.1/servers/24b8436f-97ba-49c5-ad91-8aea43f0e755 => generated 1469 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:31:53.004898 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f2198603-db15-4600-bf28-518928b296ad tempest-DeleteServersAdminTestJSON-1592115612 tempest-DeleteServersAdminTestJSON-1592115612-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:31:53.007339 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f2198603-db15-4600-bf28-518928b296ad tempest-DeleteServersAdminTestJSON-1592115612 tempest-DeleteServersAdminTestJSON-1592115612-project-admin] [instance: 24b8436f-97ba-49c5-ad91-8aea43f0e755] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:53.013569 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f2198603-db15-4600-bf28-518928b296ad tempest-DeleteServersAdminTestJSON-1592115612 tempest-DeleteServersAdminTestJSON-1592115612-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:53.014585 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f2198603-db15-4600-bf28-518928b296ad tempest-DeleteServersAdminTestJSON-1592115612 tempest-DeleteServersAdminTestJSON-1592115612-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:53.015235 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f2198603-db15-4600-bf28-518928b296ad tempest-DeleteServersAdminTestJSON-1592115612 tempest-DeleteServersAdminTestJSON-1592115612-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:53.015974 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f2198603-db15-4600-bf28-518928b296ad tempest-DeleteServersAdminTestJSON-1592115612 tempest-DeleteServersAdminTestJSON-1592115612-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:53.016589 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f2198603-db15-4600-bf28-518928b296ad tempest-DeleteServersAdminTestJSON-1592115612 tempest-DeleteServersAdminTestJSON-1592115612-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:53.017026 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f2198603-db15-4600-bf28-518928b296ad tempest-DeleteServersAdminTestJSON-1592115612 tempest-DeleteServersAdminTestJSON-1592115612-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:53.557028 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f2198603-db15-4600-bf28-518928b296ad tempest-DeleteServersAdminTestJSON-1592115612 tempest-DeleteServersAdminTestJSON-1592115612-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/24b8436f-97ba-49c5-ad91-8aea43f0e755/action" status: 202 len: 0 microversion: 2.1 time: 0.555888 Sep 23 04:31:53.558556 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 147/302] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:31:52 2022] POST /compute/v2.1/servers/24b8436f-97ba-49c5-ad91-8aea43f0e755/action => generated 0 bytes in 558 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 23 04:31:53.570077 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ee2f8b4b-fa44-40bd-89dc-5a2bb9a3d34a tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:53.571031 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ee2f8b4b-fa44-40bd-89dc-5a2bb9a3d34a tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] [instance: 24b8436f-97ba-49c5-ad91-8aea43f0e755] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:53.593262 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ee2f8b4b-fa44-40bd-89dc-5a2bb9a3d34a tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:53.593726 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ee2f8b4b-fa44-40bd-89dc-5a2bb9a3d34a tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:53.594292 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ee2f8b4b-fa44-40bd-89dc-5a2bb9a3d34a tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:53.602910 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ee2f8b4b-fa44-40bd-89dc-5a2bb9a3d34a tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:53.603404 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ee2f8b4b-fa44-40bd-89dc-5a2bb9a3d34a tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:53.603854 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ee2f8b4b-fa44-40bd-89dc-5a2bb9a3d34a tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:53.723647 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ee2f8b4b-fa44-40bd-89dc-5a2bb9a3d34a tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:53.724769 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ee2f8b4b-fa44-40bd-89dc-5a2bb9a3d34a tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:53.725582 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ee2f8b4b-fa44-40bd-89dc-5a2bb9a3d34a tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:53.726605 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-ee2f8b4b-fa44-40bd-89dc-5a2bb9a3d34a tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lazy-loading 'fault' on Instance uuid 24b8436f-97ba-49c5-ad91-8aea43f0e755 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:31:54.009951 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ee2f8b4b-fa44-40bd-89dc-5a2bb9a3d34a tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac39d27bcf5d4def9ff9bd5b81bd7b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79442cd4a69040f594e19b3492df7e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:54.021711 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ee2f8b4b-fa44-40bd-89dc-5a2bb9a3d34a tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] 10.222.0.33 "GET /compute/v2.1/servers/24b8436f-97ba-49c5-ad91-8aea43f0e755" status: 200 len: 1452 microversion: 2.1 time: 0.456523 Sep 23 04:31:54.023100 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 148/303] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:31:53 2022] GET /compute/v2.1/servers/24b8436f-97ba-49c5-ad91-8aea43f0e755 => generated 1452 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:31:54.028319 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-bba1dd61-a698-4096-887b-ed1fbcdd74b1 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:54.029766 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-bba1dd61-a698-4096-887b-ed1fbcdd74b1 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] [instance: ed83bf5a-f3ce-4b5c-af6f-92b80599a022] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:54.037437 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bba1dd61-a698-4096-887b-ed1fbcdd74b1 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:54.038206 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bba1dd61-a698-4096-887b-ed1fbcdd74b1 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:54.038899 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bba1dd61-a698-4096-887b-ed1fbcdd74b1 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:54.040591 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bba1dd61-a698-4096-887b-ed1fbcdd74b1 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:54.041628 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bba1dd61-a698-4096-887b-ed1fbcdd74b1 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:54.047134 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bba1dd61-a698-4096-887b-ed1fbcdd74b1 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:54.247822 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-bba1dd61-a698-4096-887b-ed1fbcdd74b1 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54d1a7a9e4ee44b9992ff9362108b311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649eb80e1ea849868c651849047833e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:54.255878 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-bba1dd61-a698-4096-887b-ed1fbcdd74b1 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] 10.222.0.33 "GET /compute/v2.1/servers/ed83bf5a-f3ce-4b5c-af6f-92b80599a022" status: 200 len: 1322 microversion: 2.1 time: 0.231413 Sep 23 04:31:54.256446 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 149/304] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:31:54 2022] GET /compute/v2.1/servers/ed83bf5a-f3ce-4b5c-af6f-92b80599a022 => generated 1322 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:31:54.260928 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-650f04ab-c90e-4638-8433-1303d4726e7d tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:54.261752 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-650f04ab-c90e-4638-8433-1303d4726e7d tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] [instance: 24b8436f-97ba-49c5-ad91-8aea43f0e755] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:54.267944 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-650f04ab-c90e-4638-8433-1303d4726e7d tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:54.268420 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-650f04ab-c90e-4638-8433-1303d4726e7d tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:54.268850 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-650f04ab-c90e-4638-8433-1303d4726e7d tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:54.270431 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-650f04ab-c90e-4638-8433-1303d4726e7d tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:54.270431 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-650f04ab-c90e-4638-8433-1303d4726e7d tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:54.270815 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-650f04ab-c90e-4638-8433-1303d4726e7d tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:54.314054 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-650f04ab-c90e-4638-8433-1303d4726e7d tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] [instance: 24b8436f-97ba-49c5-ad91-8aea43f0e755] Going to try to terminate instance {{(pid=122699) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:31:54.603528 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=8,nova_api:INSERT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:31:54.688495 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-650f04ab-c90e-4638-8433-1303d4726e7d tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] 10.222.0.33 "DELETE /compute/v2.1/servers/24b8436f-97ba-49c5-ad91-8aea43f0e755" status: 204 len: 0 microversion: 2.1 time: 0.430282 Sep 23 04:31:54.689726 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 150/305] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:31:54 2022] DELETE /compute/v2.1/servers/24b8436f-97ba-49c5-ad91-8aea43f0e755 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:31:54.705477 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-78bd9f3f-c1d0-461c-8d77-4138ed4919ed tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:54.706866 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-78bd9f3f-c1d0-461c-8d77-4138ed4919ed tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] [instance: 24b8436f-97ba-49c5-ad91-8aea43f0e755] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:54.716249 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-78bd9f3f-c1d0-461c-8d77-4138ed4919ed tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:54.717012 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-78bd9f3f-c1d0-461c-8d77-4138ed4919ed tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:54.717454 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-78bd9f3f-c1d0-461c-8d77-4138ed4919ed tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:54.718336 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-78bd9f3f-c1d0-461c-8d77-4138ed4919ed tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:54.718686 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-78bd9f3f-c1d0-461c-8d77-4138ed4919ed tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:54.719100 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-78bd9f3f-c1d0-461c-8d77-4138ed4919ed tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:54.782360 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-78bd9f3f-c1d0-461c-8d77-4138ed4919ed tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:54.782862 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-78bd9f3f-c1d0-461c-8d77-4138ed4919ed tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:54.783301 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-78bd9f3f-c1d0-461c-8d77-4138ed4919ed tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:54.783794 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-78bd9f3f-c1d0-461c-8d77-4138ed4919ed tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lazy-loading 'fault' on Instance uuid 24b8436f-97ba-49c5-ad91-8aea43f0e755 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:31:54.952497 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-78bd9f3f-c1d0-461c-8d77-4138ed4919ed tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac39d27bcf5d4def9ff9bd5b81bd7b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79442cd4a69040f594e19b3492df7e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:54.961412 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-78bd9f3f-c1d0-461c-8d77-4138ed4919ed tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] 10.222.0.33 "GET /compute/v2.1/servers/24b8436f-97ba-49c5-ad91-8aea43f0e755" status: 200 len: 1458 microversion: 2.1 time: 0.262818 Sep 23 04:31:54.963267 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 151/306] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:31:54 2022] GET /compute/v2.1/servers/24b8436f-97ba-49c5-ad91-8aea43f0e755 => generated 1458 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:31:55.258170 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7b655ce6-34e6-4359-b63b-36a802b4a50f tempest-AggregatesAdminTestV241-641326946 tempest-AggregatesAdminTestV241-641326946-project-admin] Calling method '.version_select at 0x7ff1c07ecc10>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:55.262557 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7b655ce6-34e6-4359-b63b-36a802b4a50f tempest-AggregatesAdminTestV241-641326946 tempest-AggregatesAdminTestV241-641326946-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:55.265249 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7b655ce6-34e6-4359-b63b-36a802b4a50f tempest-AggregatesAdminTestV241-641326946 tempest-AggregatesAdminTestV241-641326946-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:55.266950 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7b655ce6-34e6-4359-b63b-36a802b4a50f tempest-AggregatesAdminTestV241-641326946 tempest-AggregatesAdminTestV241-641326946-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:55.301766 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7b655ce6-34e6-4359-b63b-36a802b4a50f tempest-AggregatesAdminTestV241-641326946 tempest-AggregatesAdminTestV241-641326946-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:55.302362 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7b655ce6-34e6-4359-b63b-36a802b4a50f tempest-AggregatesAdminTestV241-641326946 tempest-AggregatesAdminTestV241-641326946-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:55.302873 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7b655ce6-34e6-4359-b63b-36a802b4a50f tempest-AggregatesAdminTestV241-641326946 tempest-AggregatesAdminTestV241-641326946-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:55.316631 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7b655ce6-34e6-4359-b63b-36a802b4a50f tempest-AggregatesAdminTestV241-641326946 tempest-AggregatesAdminTestV241-641326946-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:55.317158 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7b655ce6-34e6-4359-b63b-36a802b4a50f tempest-AggregatesAdminTestV241-641326946 tempest-AggregatesAdminTestV241-641326946-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:55.317733 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7b655ce6-34e6-4359-b63b-36a802b4a50f tempest-AggregatesAdminTestV241-641326946 tempest-AggregatesAdminTestV241-641326946-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:55.326020 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-7b655ce6-34e6-4359-b63b-36a802b4a50f tempest-AggregatesAdminTestV241-641326946 tempest-AggregatesAdminTestV241-641326946-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1425 microversion: 2.41 time: 0.362101 Sep 23 04:31:55.326739 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 152/307] 10.222.0.33 () {60 vars in 1208 bytes} [Fri Sep 23 04:31:54 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1425 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:31:55.332064 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-79dc032e-b411-4740-b743-27a014c7485a tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:55.332791 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-79dc032e-b411-4740-b743-27a014c7485a tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] [instance: ed83bf5a-f3ce-4b5c-af6f-92b80599a022] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:55.339572 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-79dc032e-b411-4740-b743-27a014c7485a tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:55.340263 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-79dc032e-b411-4740-b743-27a014c7485a tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:55.340786 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-79dc032e-b411-4740-b743-27a014c7485a tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:55.341696 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-79dc032e-b411-4740-b743-27a014c7485a tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:55.342414 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-79dc032e-b411-4740-b743-27a014c7485a tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:55.342916 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-79dc032e-b411-4740-b743-27a014c7485a tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:55.524668 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-79dc032e-b411-4740-b743-27a014c7485a tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54d1a7a9e4ee44b9992ff9362108b311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649eb80e1ea849868c651849047833e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:55.540797 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-79dc032e-b411-4740-b743-27a014c7485a tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] 10.222.0.33 "GET /compute/v2.1/servers/ed83bf5a-f3ce-4b5c-af6f-92b80599a022" status: 200 len: 1322 microversion: 2.1 time: 0.212839 Sep 23 04:31:55.543761 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 153/308] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:31:55 2022] GET /compute/v2.1/servers/ed83bf5a-f3ce-4b5c-af6f-92b80599a022 => generated 1322 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:31:55.569609 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e1fce320-5b06-4aeb-964b-c445c5e23b1c tempest-AggregatesAdminTestV241-641326946 tempest-AggregatesAdminTestV241-641326946-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2060424073"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:31:55.577598 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.aggregate [None req-e1fce320-5b06-4aeb-964b-c445c5e23b1c tempest-AggregatesAdminTestV241-641326946 tempest-AggregatesAdminTestV241-641326946-project-admin] Generated uuid e65057e1-6fd7-4932-b34c-bca379a7b443 for aggregate {{(pid=122699) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 23 04:31:55.723107 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e1fce320-5b06-4aeb-964b-c445c5e23b1c tempest-AggregatesAdminTestV241-641326946 tempest-AggregatesAdminTestV241-641326946-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 247 microversion: 2.41 time: 0.161026 Sep 23 04:31:55.726872 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 154/309] 10.222.0.33 () {62 vars in 1205 bytes} [Fri Sep 23 04:31:55 2022] POST /compute/v2.1/os-aggregates => generated 247 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 04:31:55.741105 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e7a8ad90-5e6d-4111-a876-883d22dc76dc tempest-AggregatesAdminTestV241-641326946 tempest-AggregatesAdminTestV241-641326946-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-965821844"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:31:56.044721 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e7a8ad90-5e6d-4111-a876-883d22dc76dc tempest-AggregatesAdminTestV241-641326946 tempest-AggregatesAdminTestV241-641326946-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-aggregates/18" status: 200 len: 299 microversion: 2.41 time: 0.306683 Sep 23 04:31:56.047165 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 155/310] 10.222.0.33 () {62 vars in 1213 bytes} [Fri Sep 23 04:31:55 2022] PUT /compute/v2.1/os-aggregates/18 => generated 299 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 23 04:31:56.064464 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2205965b-fabf-4141-8d2a-f21bec45b095 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:56.066844 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-2205965b-fabf-4141-8d2a-f21bec45b095 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] [instance: 24b8436f-97ba-49c5-ad91-8aea43f0e755] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:56.074505 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2205965b-fabf-4141-8d2a-f21bec45b095 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:56.075807 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2205965b-fabf-4141-8d2a-f21bec45b095 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:56.076318 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2205965b-fabf-4141-8d2a-f21bec45b095 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:56.086910 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2205965b-fabf-4141-8d2a-f21bec45b095 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:56.088426 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2205965b-fabf-4141-8d2a-f21bec45b095 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:56.091009 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2205965b-fabf-4141-8d2a-f21bec45b095 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:56.153057 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2205965b-fabf-4141-8d2a-f21bec45b095 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:56.161170 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2205965b-fabf-4141-8d2a-f21bec45b095 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:56.165631 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2205965b-fabf-4141-8d2a-f21bec45b095 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:56.166515 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-2205965b-fabf-4141-8d2a-f21bec45b095 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lazy-loading 'fault' on Instance uuid 24b8436f-97ba-49c5-ad91-8aea43f0e755 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:31:56.328481 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2205965b-fabf-4141-8d2a-f21bec45b095 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac39d27bcf5d4def9ff9bd5b81bd7b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79442cd4a69040f594e19b3492df7e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:56.331616 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:31:56.338913 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2205965b-fabf-4141-8d2a-f21bec45b095 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] 10.222.0.33 "GET /compute/v2.1/servers/24b8436f-97ba-49c5-ad91-8aea43f0e755" status: 200 len: 1458 microversion: 2.1 time: 0.290489 Sep 23 04:31:56.340047 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 156/311] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:31:56 2022] GET /compute/v2.1/servers/24b8436f-97ba-49c5-ad91-8aea43f0e755 => generated 1458 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:31:56.344851 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-431d41fd-c620-40b1-a002-d41422ebb240 tempest-AggregatesAdminTestV241-641326946 tempest-AggregatesAdminTestV241-641326946-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:56.355076 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-431d41fd-c620-40b1-a002-d41422ebb240 tempest-AggregatesAdminTestV241-641326946 tempest-AggregatesAdminTestV241-641326946-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates/18" status: 200 len: 299 microversion: 2.41 time: 0.013255 Sep 23 04:31:56.356028 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 157/312] 10.222.0.33 () {60 vars in 1193 bytes} [Fri Sep 23 04:31:56 2022] GET /compute/v2.1/os-aggregates/18 => generated 299 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 04:31:56.371665 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f77cd204-2db1-47c0-8785-dfeccb5da768 tempest-AggregatesAdminTestV241-641326946 tempest-AggregatesAdminTestV241-641326946-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-846463-3"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:31:56.389049 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f77cd204-2db1-47c0-8785-dfeccb5da768 tempest-AggregatesAdminTestV241-641326946 tempest-AggregatesAdminTestV241-641326946-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:56.389049 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f77cd204-2db1-47c0-8785-dfeccb5da768 tempest-AggregatesAdminTestV241-641326946 tempest-AggregatesAdminTestV241-641326946-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:56.390251 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f77cd204-2db1-47c0-8785-dfeccb5da768 tempest-AggregatesAdminTestV241-641326946 tempest-AggregatesAdminTestV241-641326946-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:56.763944 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f77cd204-2db1-47c0-8785-dfeccb5da768 tempest-AggregatesAdminTestV241-641326946 tempest-AggregatesAdminTestV241-641326946-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/18/action" status: 200 len: 314 microversion: 2.41 time: 0.397628 Sep 23 04:31:56.764543 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 158/313] 10.222.0.33 () {62 vars in 1235 bytes} [Fri Sep 23 04:31:56 2022] POST /compute/v2.1/os-aggregates/18/action => generated 314 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 04:31:56.769274 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d8a0b77a-bb46-4e95-a9d2-f64c4b7bf8a3 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:56.769877 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d8a0b77a-bb46-4e95-a9d2-f64c4b7bf8a3 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] [instance: ed83bf5a-f3ce-4b5c-af6f-92b80599a022] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:56.776644 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d8a0b77a-bb46-4e95-a9d2-f64c4b7bf8a3 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:56.777432 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d8a0b77a-bb46-4e95-a9d2-f64c4b7bf8a3 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:56.778145 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d8a0b77a-bb46-4e95-a9d2-f64c4b7bf8a3 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:56.779070 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d8a0b77a-bb46-4e95-a9d2-f64c4b7bf8a3 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:56.779745 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d8a0b77a-bb46-4e95-a9d2-f64c4b7bf8a3 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:56.780582 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d8a0b77a-bb46-4e95-a9d2-f64c4b7bf8a3 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:56.959309 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d8a0b77a-bb46-4e95-a9d2-f64c4b7bf8a3 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54d1a7a9e4ee44b9992ff9362108b311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649eb80e1ea849868c651849047833e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:56.991978 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d8a0b77a-bb46-4e95-a9d2-f64c4b7bf8a3 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] 10.222.0.33 "GET /compute/v2.1/servers/ed83bf5a-f3ce-4b5c-af6f-92b80599a022" status: 200 len: 1322 microversion: 2.1 time: 0.216622 Sep 23 04:31:56.991978 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 159/314] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:31:56 2022] GET /compute/v2.1/servers/ed83bf5a-f3ce-4b5c-af6f-92b80599a022 => generated 1322 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:31:57.005599 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-77f93ecb-0342-4be4-b916-9ca27296d756 tempest-AggregatesAdminTestV241-641326946 tempest-AggregatesAdminTestV241-641326946-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-846463-3"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:31:57.059139 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-77f93ecb-0342-4be4-b916-9ca27296d756 tempest-AggregatesAdminTestV241-641326946 tempest-AggregatesAdminTestV241-641326946-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:57.059983 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-77f93ecb-0342-4be4-b916-9ca27296d756 tempest-AggregatesAdminTestV241-641326946 tempest-AggregatesAdminTestV241-641326946-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:57.065321 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-77f93ecb-0342-4be4-b916-9ca27296d756 tempest-AggregatesAdminTestV241-641326946 tempest-AggregatesAdminTestV241-641326946-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:57.446279 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-77f93ecb-0342-4be4-b916-9ca27296d756 tempest-AggregatesAdminTestV241-641326946 tempest-AggregatesAdminTestV241-641326946-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/18/action" status: 200 len: 299 microversion: 2.41 time: 0.456743 Sep 23 04:31:57.453374 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 160/315] 10.222.0.33 () {62 vars in 1235 bytes} [Fri Sep 23 04:31:56 2022] POST /compute/v2.1/os-aggregates/18/action => generated 299 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 04:31:57.466256 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-05e8216c-3aad-4a95-a799-4163c4cf92fb req-e748d2dd-7d36-4300-a3d7-7aea69dbdacf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24b8436f-97ba-49c5-ad91-8aea43f0e755", "name": "network-vif-deleted", "tag": "74eca486-20b1-4087-bc60-f2deb1ac37e5"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:31:57.493604 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-05e8216c-3aad-4a95-a799-4163c4cf92fb req-e748d2dd-7d36-4300-a3d7-7aea69dbdacf service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:57.498540 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-05e8216c-3aad-4a95-a799-4163c4cf92fb req-e748d2dd-7d36-4300-a3d7-7aea69dbdacf service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:57.498540 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-05e8216c-3aad-4a95-a799-4163c4cf92fb req-e748d2dd-7d36-4300-a3d7-7aea69dbdacf service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:57.527986 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-05e8216c-3aad-4a95-a799-4163c4cf92fb req-e748d2dd-7d36-4300-a3d7-7aea69dbdacf service nova] Creating event network-vif-deleted:74eca486-20b1-4087-bc60-f2deb1ac37e5 for instance 24b8436f-97ba-49c5-ad91-8aea43f0e755 on n-h2-846463-3 Sep 23 04:31:57.536920 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-05e8216c-3aad-4a95-a799-4163c4cf92fb req-e748d2dd-7d36-4300-a3d7-7aea69dbdacf service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081965 Sep 23 04:31:57.539249 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 161/316] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:31:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:31:57.547186 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e07fd83e-5bf4-4413-8168-2ecfc4b2e374 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:57.547891 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e07fd83e-5bf4-4413-8168-2ecfc4b2e374 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] [instance: 24b8436f-97ba-49c5-ad91-8aea43f0e755] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:57.555398 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e07fd83e-5bf4-4413-8168-2ecfc4b2e374 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:57.556562 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e07fd83e-5bf4-4413-8168-2ecfc4b2e374 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:57.557385 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e07fd83e-5bf4-4413-8168-2ecfc4b2e374 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:57.558398 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e07fd83e-5bf4-4413-8168-2ecfc4b2e374 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:57.559097 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e07fd83e-5bf4-4413-8168-2ecfc4b2e374 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:57.560165 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e07fd83e-5bf4-4413-8168-2ecfc4b2e374 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:57.635861 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e07fd83e-5bf4-4413-8168-2ecfc4b2e374 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:57.636579 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e07fd83e-5bf4-4413-8168-2ecfc4b2e374 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:57.637024 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e07fd83e-5bf4-4413-8168-2ecfc4b2e374 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:57.637479 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-e07fd83e-5bf4-4413-8168-2ecfc4b2e374 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lazy-loading 'fault' on Instance uuid 24b8436f-97ba-49c5-ad91-8aea43f0e755 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:31:57.709328 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e07fd83e-5bf4-4413-8168-2ecfc4b2e374 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac39d27bcf5d4def9ff9bd5b81bd7b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79442cd4a69040f594e19b3492df7e7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:57.722500 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e07fd83e-5bf4-4413-8168-2ecfc4b2e374 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] 10.222.0.33 "GET /compute/v2.1/servers/24b8436f-97ba-49c5-ad91-8aea43f0e755" status: 200 len: 1310 microversion: 2.1 time: 0.179626 Sep 23 04:31:57.723650 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 162/317] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:31:57 2022] GET /compute/v2.1/servers/24b8436f-97ba-49c5-ad91-8aea43f0e755 => generated 1310 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:31:57.970199 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0a1da22b-7b7d-4d26-b10f-fccd19528552 tempest-FlavorsV261TestJSON-552610965 tempest-FlavorsV261TestJSON-552610965-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-6828216", "id": 253227097, "os-flavor-access:is_public": "True"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:31:58.051520 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0a1da22b-7b7d-4d26-b10f-fccd19528552 tempest-FlavorsV261TestJSON-552610965 tempest-FlavorsV261TestJSON-552610965-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 462 microversion: 2.61 time: 0.326338 Sep 23 04:31:58.052726 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 163/318] 10.222.0.33 () {62 vars in 1188 bytes} [Fri Sep 23 04:31:57 2022] POST /compute/v2.1/flavors => generated 462 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 04:31:58.064154 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6ce9c2f6-8a75-4d99-8fae-76d4777f9aae tempest-AggregatesAdminTestV241-641326946 tempest-AggregatesAdminTestV241-641326946-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:58.173708 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6ce9c2f6-8a75-4d99-8fae-76d4777f9aae tempest-AggregatesAdminTestV241-641326946 tempest-AggregatesAdminTestV241-641326946-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.41 time: 0.119391 Sep 23 04:31:58.175236 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 164/319] 10.222.0.33 () {60 vars in 1196 bytes} [Fri Sep 23 04:31:58 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:31:58.253830 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-792875fa-f61d-4808-a3db-20cbc6bee370 tempest-HypervisorAdminV253TestBase-503727975 tempest-HypervisorAdminV253TestBase-503727975-project-admin] Calling method '.version_select at 0x7ff1c03a7ca0>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:58.262742 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-792875fa-f61d-4808-a3db-20cbc6bee370 tempest-HypervisorAdminV253TestBase-503727975 tempest-HypervisorAdminV253TestBase-503727975-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:58.264299 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-792875fa-f61d-4808-a3db-20cbc6bee370 tempest-HypervisorAdminV253TestBase-503727975 tempest-HypervisorAdminV253TestBase-503727975-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:58.265531 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-792875fa-f61d-4808-a3db-20cbc6bee370 tempest-HypervisorAdminV253TestBase-503727975 tempest-HypervisorAdminV253TestBase-503727975-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:58.284116 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-792875fa-f61d-4808-a3db-20cbc6bee370 tempest-HypervisorAdminV253TestBase-503727975 tempest-HypervisorAdminV253TestBase-503727975-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:58.284948 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-792875fa-f61d-4808-a3db-20cbc6bee370 tempest-HypervisorAdminV253TestBase-503727975 tempest-HypervisorAdminV253TestBase-503727975-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:58.285450 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-792875fa-f61d-4808-a3db-20cbc6bee370 tempest-HypervisorAdminV253TestBase-503727975 tempest-HypervisorAdminV253TestBase-503727975-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:58.312459 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-792875fa-f61d-4808-a3db-20cbc6bee370 tempest-HypervisorAdminV253TestBase-503727975 tempest-HypervisorAdminV253TestBase-503727975-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:58.312962 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-792875fa-f61d-4808-a3db-20cbc6bee370 tempest-HypervisorAdminV253TestBase-503727975 tempest-HypervisorAdminV253TestBase-503727975-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:58.313433 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-792875fa-f61d-4808-a3db-20cbc6bee370 tempest-HypervisorAdminV253TestBase-503727975 tempest-HypervisorAdminV253TestBase-503727975-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:58.330309 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-792875fa-f61d-4808-a3db-20cbc6bee370 tempest-HypervisorAdminV253TestBase-503727975 tempest-HypervisorAdminV253TestBase-503727975-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:58.330841 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-792875fa-f61d-4808-a3db-20cbc6bee370 tempest-HypervisorAdminV253TestBase-503727975 tempest-HypervisorAdminV253TestBase-503727975-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:58.331280 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-792875fa-f61d-4808-a3db-20cbc6bee370 tempest-HypervisorAdminV253TestBase-503727975 tempest-HypervisorAdminV253TestBase-503727975-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:58.354351 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-792875fa-f61d-4808-a3db-20cbc6bee370 tempest-HypervisorAdminV253TestBase-503727975 tempest-HypervisorAdminV253TestBase-503727975-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:58.354838 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-792875fa-f61d-4808-a3db-20cbc6bee370 tempest-HypervisorAdminV253TestBase-503727975 tempest-HypervisorAdminV253TestBase-503727975-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:58.355272 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-792875fa-f61d-4808-a3db-20cbc6bee370 tempest-HypervisorAdminV253TestBase-503727975 tempest-HypervisorAdminV253TestBase-503727975-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:58.362283 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-792875fa-f61d-4808-a3db-20cbc6bee370 tempest-HypervisorAdminV253TestBase-503727975 tempest-HypervisorAdminV253TestBase-503727975-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1915 microversion: 2.53 time: 0.184212 Sep 23 04:31:58.362871 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 165/320] 10.222.0.33 () {60 vars in 1243 bytes} [Fri Sep 23 04:31:58 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1915 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:31:58.367386 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-d610d590-8b63-41df-93e4-c1c3c96c3bdb req-f4b69137-0bab-4374-b2b7-38341c66304c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed83bf5a-f3ce-4b5c-af6f-92b80599a022", "name": "network-vif-plugged", "status": "completed", "tag": "76175fda-bb1d-4f82-bc8b-0c30bf8aee3f"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:31:58.378292 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-d610d590-8b63-41df-93e4-c1c3c96c3bdb req-f4b69137-0bab-4374-b2b7-38341c66304c service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:58.378841 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-d610d590-8b63-41df-93e4-c1c3c96c3bdb req-f4b69137-0bab-4374-b2b7-38341c66304c service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:58.379262 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-d610d590-8b63-41df-93e4-c1c3c96c3bdb req-f4b69137-0bab-4374-b2b7-38341c66304c service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:58.397529 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-d610d590-8b63-41df-93e4-c1c3c96c3bdb req-f4b69137-0bab-4374-b2b7-38341c66304c service nova] Creating event network-vif-plugged:76175fda-bb1d-4f82-bc8b-0c30bf8aee3f for instance ed83bf5a-f3ce-4b5c-af6f-92b80599a022 on n-h1-846463-3 Sep 23 04:31:58.403984 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-d610d590-8b63-41df-93e4-c1c3c96c3bdb req-f4b69137-0bab-4374-b2b7-38341c66304c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039729 Sep 23 04:31:58.405467 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 166/321] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:31:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:31:58.410277 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-16119592-7902-4163-81b4-e41fbe91bbd6 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:58.415210 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-16119592-7902-4163-81b4-e41fbe91bbd6 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] [instance: ed83bf5a-f3ce-4b5c-af6f-92b80599a022] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:58.430657 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-16119592-7902-4163-81b4-e41fbe91bbd6 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:58.431544 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-16119592-7902-4163-81b4-e41fbe91bbd6 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:58.431936 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-16119592-7902-4163-81b4-e41fbe91bbd6 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:58.433321 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-16119592-7902-4163-81b4-e41fbe91bbd6 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:58.433823 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-16119592-7902-4163-81b4-e41fbe91bbd6 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:58.434317 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-16119592-7902-4163-81b4-e41fbe91bbd6 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:58.687882 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-16119592-7902-4163-81b4-e41fbe91bbd6 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54d1a7a9e4ee44b9992ff9362108b311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649eb80e1ea849868c651849047833e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:58.698074 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-16119592-7902-4163-81b4-e41fbe91bbd6 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] 10.222.0.33 "GET /compute/v2.1/servers/ed83bf5a-f3ce-4b5c-af6f-92b80599a022" status: 200 len: 1322 microversion: 2.1 time: 0.291675 Sep 23 04:31:58.699301 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 167/322] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:31:58 2022] GET /compute/v2.1/servers/ed83bf5a-f3ce-4b5c-af6f-92b80599a022 => generated 1322 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:31:58.824918 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0d6f1010-f593-41c3-91a3-f6e1a0dcdeaf tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/bbf05a2b-af42-4f14-8956-4f6249c46974/action" status: 202 len: 0 microversion: 2.25 time: 7.496766 Sep 23 04:31:58.825787 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 156/323] 10.222.0.33 () {62 vars in 1319 bytes} [Fri Sep 23 04:31:51 2022] POST /compute/v2.1/servers/bbf05a2b-af42-4f14-8956-4f6249c46974/action => generated 0 bytes in 7498 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:31:58.831938 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7885db5f-83f8-4133-9b1d-83deeb754412 tempest-HypervisorAdminV253TestBase-503727975 tempest-HypervisorAdminV253TestBase-503727975-project-admin] Calling method '.version_select at 0x7ff1c029dca0>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:58.841751 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7885db5f-83f8-4133-9b1d-83deeb754412 tempest-HypervisorAdminV253TestBase-503727975 tempest-HypervisorAdminV253TestBase-503727975-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:58.842277 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7885db5f-83f8-4133-9b1d-83deeb754412 tempest-HypervisorAdminV253TestBase-503727975 tempest-HypervisorAdminV253TestBase-503727975-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:58.845181 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7885db5f-83f8-4133-9b1d-83deeb754412 tempest-HypervisorAdminV253TestBase-503727975 tempest-HypervisorAdminV253TestBase-503727975-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:58.871004 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7885db5f-83f8-4133-9b1d-83deeb754412 tempest-HypervisorAdminV253TestBase-503727975 tempest-HypervisorAdminV253TestBase-503727975-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:58.871785 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7885db5f-83f8-4133-9b1d-83deeb754412 tempest-HypervisorAdminV253TestBase-503727975 tempest-HypervisorAdminV253TestBase-503727975-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:58.872426 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7885db5f-83f8-4133-9b1d-83deeb754412 tempest-HypervisorAdminV253TestBase-503727975 tempest-HypervisorAdminV253TestBase-503727975-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:58.907804 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7885db5f-83f8-4133-9b1d-83deeb754412 tempest-HypervisorAdminV253TestBase-503727975 tempest-HypervisorAdminV253TestBase-503727975-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:58.908649 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7885db5f-83f8-4133-9b1d-83deeb754412 tempest-HypervisorAdminV253TestBase-503727975 tempest-HypervisorAdminV253TestBase-503727975-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:58.909287 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7885db5f-83f8-4133-9b1d-83deeb754412 tempest-HypervisorAdminV253TestBase-503727975 tempest-HypervisorAdminV253TestBase-503727975-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:58.921659 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7885db5f-83f8-4133-9b1d-83deeb754412 tempest-HypervisorAdminV253TestBase-503727975 tempest-HypervisorAdminV253TestBase-503727975-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:58.922466 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7885db5f-83f8-4133-9b1d-83deeb754412 tempest-HypervisorAdminV253TestBase-503727975 tempest-HypervisorAdminV253TestBase-503727975-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:58.923084 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7885db5f-83f8-4133-9b1d-83deeb754412 tempest-HypervisorAdminV253TestBase-503727975 tempest-HypervisorAdminV253TestBase-503727975-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:58.952801 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7885db5f-83f8-4133-9b1d-83deeb754412 tempest-HypervisorAdminV253TestBase-503727975 tempest-HypervisorAdminV253TestBase-503727975-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:58.953609 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7885db5f-83f8-4133-9b1d-83deeb754412 tempest-HypervisorAdminV253TestBase-503727975 tempest-HypervisorAdminV253TestBase-503727975-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:58.954090 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7885db5f-83f8-4133-9b1d-83deeb754412 tempest-HypervisorAdminV253TestBase-503727975 tempest-HypervisorAdminV253TestBase-503727975-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:58.962184 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7885db5f-83f8-4133-9b1d-83deeb754412 tempest-HypervisorAdminV253TestBase-503727975 tempest-HypervisorAdminV253TestBase-503727975-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 528 microversion: 2.53 time: 0.133447 Sep 23 04:31:58.971887 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 157/324] 10.222.0.33 () {60 vars in 1222 bytes} [Fri Sep 23 04:31:58 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 528 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 04:31:58.976780 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9910a580-dae0-4016-a61a-16d354084022 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:58.977528 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-9910a580-dae0-4016-a61a-16d354084022 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] [instance: 24b8436f-97ba-49c5-ad91-8aea43f0e755] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:58.984222 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9910a580-dae0-4016-a61a-16d354084022 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:58.984726 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9910a580-dae0-4016-a61a-16d354084022 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:58.985173 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9910a580-dae0-4016-a61a-16d354084022 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:58.985956 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9910a580-dae0-4016-a61a-16d354084022 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:58.986405 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9910a580-dae0-4016-a61a-16d354084022 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:58.987394 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9910a580-dae0-4016-a61a-16d354084022 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:59.013125 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-68dbfc73-b0f1-4e07-9993-41631ef83fe9 tempest-FlavorsV261TestJSON-1755223627 tempest-FlavorsV261TestJSON-1755223627-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:59.017686 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-9910a580-dae0-4016-a61a-16d354084022 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] HTTP exception thrown: Instance 24b8436f-97ba-49c5-ad91-8aea43f0e755 could not be found. Sep 23 04:31:59.020764 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9910a580-dae0-4016-a61a-16d354084022 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Request method failure captured: Sep 23 04:31:59.020764 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/24b8436f-97ba-49c5-ad91-8aea43f0e755 HTTP/1.1 Sep 23 04:31:59.020764 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:31:59.020764 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:31:59.020764 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:31:59.020764 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:31:59.020764 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:31:59.020764 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:31:59.020764 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:31:59.020764 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:31:59.020764 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTZ0ZRM17NaqF0hn5-kjr9OlGSPbN5wsvgrLJK5hdwNQSoh_bZlXH7rylroSVcAQ6XmBWmxa3XfDGdAsEhITR0cbVHqwQjue_laQf8JxM9GoGubSF06G4uzoSEXuixINAft_nQ3s8fkQDBy-Q6kkhcGgHtWZHcTw_SVmbRZHySOWK20 Sep 23 04:31:59.020764 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:31:59.020764 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:31:59.020764 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:31:59.020764 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:31:59.020764 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:31:59.020764 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:31:59.020764 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 79442cd4a69040f594e19b3492df7e7e Sep 23 04:31:59.020764 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1289949374 Sep 23 04:31:59.020764 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:31:59.020764 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:31:59.022373 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_79442cd4a69040f594e19b3492df7e7e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/79442cd4a69040f594e19b3492df7e7e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/79442cd4a69040f594e19b3492df7e7e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/79442cd4a69040f594e19b3492df7e7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:31:59.022373 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-DeleteServersAdminTestJSON-1289949374 Sep 23 04:31:59.022373 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 79442cd4a69040f594e19b3492df7e7e Sep 23 04:31:59.022373 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1289949374 Sep 23 04:31:59.022373 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-DeleteServersAdminTestJSON-1289949374-project Sep 23 04:31:59.022373 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:31:59.022373 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:31:59.022373 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: ac39d27bcf5d4def9ff9bd5b81bd7b76 Sep 23 04:31:59.022373 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-DeleteServersAdminTestJSON-1289949374-project Sep 23 04:31:59.022373 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:31:59.022373 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 24b8436f-97ba-49c5-ad91-8aea43f0e755 could not be found. Sep 23 04:31:59.022373 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '24b8436f-97ba-49c5-ad91-8aea43f0e755'} Sep 23 04:31:59.023069 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:31:59.023069 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:31:59.023069 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:31:59.023069 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:31:59.023069 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:31:59.023069 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:31:59.023069 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:31:59.023069 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:31:59.023069 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:31:59.023069 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:31:59.023069 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24b8436f-97ba-49c5-ad91-8aea43f0e755 could not be found. Sep 23 04:31:59.023069 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:31:59.023069 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:31:59.023069 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:31:59.023069 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:31:59.023069 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:31:59.023069 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:31:59.023069 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:31:59.023069 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:31:59.023069 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:31:59.024165 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:31:59.024165 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:31:59.024165 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:31:59.024165 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:31:59.024165 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:31:59.024165 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:31:59.024165 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:31:59.024165 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24b8436f-97ba-49c5-ad91-8aea43f0e755 could not be found. Sep 23 04:31:59.024165 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:31:59.024165 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:31:59.024165 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:31:59.024165 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:31:59.024165 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:31:59.024165 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:31:59.024165 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:31:59.024165 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:31:59.024165 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24b8436f-97ba-49c5-ad91-8aea43f0e755 could not be found. Sep 23 04:31:59.024165 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:31:59.026883 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9910a580-dae0-4016-a61a-16d354084022 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Returning 404 to user: Instance 24b8436f-97ba-49c5-ad91-8aea43f0e755 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:31:59.028097 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9910a580-dae0-4016-a61a-16d354084022 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] 10.222.0.33 "GET /compute/v2.1/servers/24b8436f-97ba-49c5-ad91-8aea43f0e755" status: 404 len: 111 microversion: 2.1 time: 0.054980 Sep 23 04:31:59.028665 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 158/325] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:31:58 2022] GET /compute/v2.1/servers/24b8436f-97ba-49c5-ad91-8aea43f0e755 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:31:59.034727 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-68dbfc73-b0f1-4e07-9993-41631ef83fe9 tempest-FlavorsV261TestJSON-1755223627 tempest-FlavorsV261TestJSON-1755223627-project] 10.222.0.33 "GET /compute/v2.1/flavors/253227097" status: 200 len: 462 microversion: 2.61 time: 0.334153 Sep 23 04:31:59.035278 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 168/326] 10.222.0.33 () {60 vars in 1196 bytes} [Fri Sep 23 04:31:58 2022] GET /compute/v2.1/flavors/253227097 => generated 462 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 04:31:59.046018 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7ed21810-247d-4fa3-a828-d96dffe29410 tempest-HypervisorAdminV253TestBase-503727975 tempest-HypervisorAdminV253TestBase-503727975-project-admin] Calling method '.version_select at 0x7ff1c038aa60>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:59.052089 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8be07036-a910-493f-8bbc-c061eef88f04 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:59.052713 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8be07036-a910-493f-8bbc-c061eef88f04 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: bbf05a2b-af42-4f14-8956-4f6249c46974] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:59.058069 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7ed21810-247d-4fa3-a828-d96dffe29410 tempest-HypervisorAdminV253TestBase-503727975 tempest-HypervisorAdminV253TestBase-503727975-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:59.058577 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7ed21810-247d-4fa3-a828-d96dffe29410 tempest-HypervisorAdminV253TestBase-503727975 tempest-HypervisorAdminV253TestBase-503727975-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:59.059021 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7ed21810-247d-4fa3-a828-d96dffe29410 tempest-HypervisorAdminV253TestBase-503727975 tempest-HypervisorAdminV253TestBase-503727975-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:59.065540 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8be07036-a910-493f-8bbc-c061eef88f04 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:59.066011 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8be07036-a910-493f-8bbc-c061eef88f04 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:59.067042 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8be07036-a910-493f-8bbc-c061eef88f04 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:59.067933 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8be07036-a910-493f-8bbc-c061eef88f04 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:59.069185 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8be07036-a910-493f-8bbc-c061eef88f04 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:59.069675 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8be07036-a910-493f-8bbc-c061eef88f04 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:59.105300 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7ed21810-247d-4fa3-a828-d96dffe29410 tempest-HypervisorAdminV253TestBase-503727975 tempest-HypervisorAdminV253TestBase-503727975-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:59.105808 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7ed21810-247d-4fa3-a828-d96dffe29410 tempest-HypervisorAdminV253TestBase-503727975 tempest-HypervisorAdminV253TestBase-503727975-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:59.106786 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7ed21810-247d-4fa3-a828-d96dffe29410 tempest-HypervisorAdminV253TestBase-503727975 tempest-HypervisorAdminV253TestBase-503727975-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:59.119443 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-7ed21810-247d-4fa3-a828-d96dffe29410 tempest-HypervisorAdminV253TestBase-503727975 tempest-HypervisorAdminV253TestBase-503727975-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/aa8c60d8-7122-44e6-8d0a-5cea3693ca01" status: 200 len: 792 microversion: 2.53 time: 0.082726 Sep 23 04:31:59.125786 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 169/327] 10.222.0.33 () {60 vars in 1298 bytes} [Fri Sep 23 04:31:59 2022] GET /compute/v2.1/os-hypervisors/aa8c60d8-7122-44e6-8d0a-5cea3693ca01 => generated 792 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 04:31:59.134175 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6fd17a2d-4d57-4674-b22f-36ba65141b77 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:59.138600 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-6fd17a2d-4d57-4674-b22f-36ba65141b77 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] [instance: 24b8436f-97ba-49c5-ad91-8aea43f0e755] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:59.153616 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6fd17a2d-4d57-4674-b22f-36ba65141b77 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:59.154204 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6fd17a2d-4d57-4674-b22f-36ba65141b77 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:59.154641 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6fd17a2d-4d57-4674-b22f-36ba65141b77 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:59.155528 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6fd17a2d-4d57-4674-b22f-36ba65141b77 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:59.156294 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6fd17a2d-4d57-4674-b22f-36ba65141b77 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:59.157083 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6fd17a2d-4d57-4674-b22f-36ba65141b77 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:59.178109 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-6fd17a2d-4d57-4674-b22f-36ba65141b77 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] HTTP exception thrown: Instance 24b8436f-97ba-49c5-ad91-8aea43f0e755 could not be found. Sep 23 04:31:59.181363 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6fd17a2d-4d57-4674-b22f-36ba65141b77 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Request method failure captured: Sep 23 04:31:59.181363 n-d-846463-3 devstack@n-api.service[122699]: request: DELETE /compute/v2.1/servers/24b8436f-97ba-49c5-ad91-8aea43f0e755 HTTP/1.1 Sep 23 04:31:59.181363 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:31:59.181363 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:31:59.181363 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:31:59.181363 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:31:59.181363 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:31:59.181363 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:31:59.181363 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:31:59.181363 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:31:59.181363 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTZ0ZRM17NaqF0hn5-kjr9OlGSPbN5wsvgrLJK5hdwNQSoh_bZlXH7rylroSVcAQ6XmBWmxa3XfDGdAsEhITR0cbVHqwQjue_laQf8JxM9GoGubSF06G4uzoSEXuixINAft_nQ3s8fkQDBy-Q6kkhcGgHtWZHcTw_SVmbRZHySOWK20 Sep 23 04:31:59.181363 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:31:59.181363 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:31:59.181363 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:31:59.181363 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:31:59.181363 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:31:59.181363 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:31:59.181363 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 79442cd4a69040f594e19b3492df7e7e Sep 23 04:31:59.181363 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1289949374 Sep 23 04:31:59.181363 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:31:59.181363 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:31:59.182870 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_79442cd4a69040f594e19b3492df7e7e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/79442cd4a69040f594e19b3492df7e7e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/79442cd4a69040f594e19b3492df7e7e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/79442cd4a69040f594e19b3492df7e7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:31:59.182870 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-DeleteServersAdminTestJSON-1289949374 Sep 23 04:31:59.182870 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 79442cd4a69040f594e19b3492df7e7e Sep 23 04:31:59.182870 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1289949374 Sep 23 04:31:59.182870 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-DeleteServersAdminTestJSON-1289949374-project Sep 23 04:31:59.182870 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:31:59.182870 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:31:59.182870 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: ac39d27bcf5d4def9ff9bd5b81bd7b76 Sep 23 04:31:59.182870 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-DeleteServersAdminTestJSON-1289949374-project Sep 23 04:31:59.182870 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:31:59.182870 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 24b8436f-97ba-49c5-ad91-8aea43f0e755 could not be found. Sep 23 04:31:59.182870 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '24b8436f-97ba-49c5-ad91-8aea43f0e755'} Sep 23 04:31:59.183671 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:31:59.183671 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:31:59.183671 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:31:59.183671 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:31:59.183671 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:31:59.183671 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:31:59.183671 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:31:59.183671 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:31:59.183671 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:31:59.183671 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:31:59.183671 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24b8436f-97ba-49c5-ad91-8aea43f0e755 could not be found. Sep 23 04:31:59.183671 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:31:59.183671 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:31:59.183671 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:31:59.183671 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:31:59.183671 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:31:59.183671 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:31:59.183671 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:31:59.183671 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:31:59.183671 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:31:59.184967 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:31:59.184967 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 04:31:59.184967 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 04:31:59.184967 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 04:31:59.184967 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 04:31:59.184967 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:31:59.184967 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:31:59.184967 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:31:59.184967 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:31:59.184967 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24b8436f-97ba-49c5-ad91-8aea43f0e755 could not be found. Sep 23 04:31:59.184967 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:31:59.184967 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:31:59.184967 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:31:59.184967 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:31:59.184967 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:31:59.184967 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:31:59.184967 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:31:59.184967 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:31:59.184967 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24b8436f-97ba-49c5-ad91-8aea43f0e755 could not be found. Sep 23 04:31:59.184967 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:31:59.188040 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6fd17a2d-4d57-4674-b22f-36ba65141b77 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Returning 404 to user: Instance 24b8436f-97ba-49c5-ad91-8aea43f0e755 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:31:59.189233 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6fd17a2d-4d57-4674-b22f-36ba65141b77 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] 10.222.0.33 "DELETE /compute/v2.1/servers/24b8436f-97ba-49c5-ad91-8aea43f0e755" status: 404 len: 111 microversion: 2.1 time: 0.062144 Sep 23 04:31:59.191149 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 170/328] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:31:59 2022] DELETE /compute/v2.1/servers/24b8436f-97ba-49c5-ad91-8aea43f0e755 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:31:59.198098 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-51bc3bf3-4f2f-45cb-afe9-67b28811b40b tempest-FlavorsV261TestJSON-552610965 tempest-FlavorsV261TestJSON-552610965-project-admin] Action: 'update', calling method: .version_select at 0x7ff1c19fbb80>, body: {"flavor": {"description": "new"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:31:59.335709 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-51bc3bf3-4f2f-45cb-afe9-67b28811b40b tempest-FlavorsV261TestJSON-552610965 tempest-FlavorsV261TestJSON-552610965-project-admin] 10.222.0.33 "PUT /compute/v2.1/flavors/253227097" status: 200 len: 463 microversion: 2.61 time: 0.143177 Sep 23 04:31:59.338148 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 171/329] 10.222.0.33 () {62 vars in 1216 bytes} [Fri Sep 23 04:31:59 2022] PUT /compute/v2.1/flavors/253227097 => generated 463 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 04:31:59.351471 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c3c828d7-be75-4bcd-8a0b-b74e46ef4017 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:59.352893 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c3c828d7-be75-4bcd-8a0b-b74e46ef4017 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] [instance: 24b8436f-97ba-49c5-ad91-8aea43f0e755] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:59.365068 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c3c828d7-be75-4bcd-8a0b-b74e46ef4017 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:59.365699 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c3c828d7-be75-4bcd-8a0b-b74e46ef4017 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:59.366248 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c3c828d7-be75-4bcd-8a0b-b74e46ef4017 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:59.367052 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c3c828d7-be75-4bcd-8a0b-b74e46ef4017 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:59.367523 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c3c828d7-be75-4bcd-8a0b-b74e46ef4017 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:59.368024 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c3c828d7-be75-4bcd-8a0b-b74e46ef4017 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:59.388933 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-c3c828d7-be75-4bcd-8a0b-b74e46ef4017 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] HTTP exception thrown: Instance 24b8436f-97ba-49c5-ad91-8aea43f0e755 could not be found. Sep 23 04:31:59.390295 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c3c828d7-be75-4bcd-8a0b-b74e46ef4017 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Request method failure captured: Sep 23 04:31:59.390295 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/24b8436f-97ba-49c5-ad91-8aea43f0e755 HTTP/1.1 Sep 23 04:31:59.390295 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:31:59.390295 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:31:59.390295 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:31:59.390295 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:31:59.390295 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:31:59.390295 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:31:59.390295 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:31:59.390295 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:31:59.390295 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTZ0ZRM17NaqF0hn5-kjr9OlGSPbN5wsvgrLJK5hdwNQSoh_bZlXH7rylroSVcAQ6XmBWmxa3XfDGdAsEhITR0cbVHqwQjue_laQf8JxM9GoGubSF06G4uzoSEXuixINAft_nQ3s8fkQDBy-Q6kkhcGgHtWZHcTw_SVmbRZHySOWK20 Sep 23 04:31:59.390295 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:31:59.390295 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:31:59.390295 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:31:59.390295 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:31:59.390295 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:31:59.390295 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:31:59.390295 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 79442cd4a69040f594e19b3492df7e7e Sep 23 04:31:59.390295 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1289949374 Sep 23 04:31:59.390295 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:31:59.390295 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:31:59.391444 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_79442cd4a69040f594e19b3492df7e7e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/79442cd4a69040f594e19b3492df7e7e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/79442cd4a69040f594e19b3492df7e7e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/79442cd4a69040f594e19b3492df7e7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:31:59.391444 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-DeleteServersAdminTestJSON-1289949374 Sep 23 04:31:59.391444 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 79442cd4a69040f594e19b3492df7e7e Sep 23 04:31:59.391444 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1289949374 Sep 23 04:31:59.391444 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-DeleteServersAdminTestJSON-1289949374-project Sep 23 04:31:59.391444 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:31:59.391444 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:31:59.391444 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: ac39d27bcf5d4def9ff9bd5b81bd7b76 Sep 23 04:31:59.391444 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-DeleteServersAdminTestJSON-1289949374-project Sep 23 04:31:59.391444 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:31:59.391444 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 24b8436f-97ba-49c5-ad91-8aea43f0e755 could not be found. Sep 23 04:31:59.391444 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '24b8436f-97ba-49c5-ad91-8aea43f0e755'} Sep 23 04:31:59.392096 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:31:59.392096 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:31:59.392096 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:31:59.392096 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:31:59.392096 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:31:59.392096 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:31:59.392096 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:31:59.392096 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:31:59.392096 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:31:59.392096 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:31:59.392096 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24b8436f-97ba-49c5-ad91-8aea43f0e755 could not be found. Sep 23 04:31:59.392096 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:31:59.392096 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:31:59.392096 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:31:59.392096 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:31:59.392096 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:31:59.392096 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:31:59.392096 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:31:59.392096 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:31:59.392096 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:31:59.393483 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:31:59.393483 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:31:59.393483 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:31:59.393483 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:31:59.393483 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:31:59.393483 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:31:59.393483 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:31:59.393483 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24b8436f-97ba-49c5-ad91-8aea43f0e755 could not be found. Sep 23 04:31:59.393483 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:31:59.393483 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:31:59.393483 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:31:59.393483 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:31:59.393483 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:31:59.393483 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:31:59.393483 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:31:59.393483 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:31:59.393483 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24b8436f-97ba-49c5-ad91-8aea43f0e755 could not be found. Sep 23 04:31:59.393483 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:31:59.394490 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c3c828d7-be75-4bcd-8a0b-b74e46ef4017 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Returning 404 to user: Instance 24b8436f-97ba-49c5-ad91-8aea43f0e755 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:31:59.394490 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c3c828d7-be75-4bcd-8a0b-b74e46ef4017 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] 10.222.0.33 "GET /compute/v2.1/servers/24b8436f-97ba-49c5-ad91-8aea43f0e755" status: 404 len: 111 microversion: 2.1 time: 0.052096 Sep 23 04:31:59.396258 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 172/330] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:31:59 2022] GET /compute/v2.1/servers/24b8436f-97ba-49c5-ad91-8aea43f0e755 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:31:59.402632 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-29da3f04-79d8-48ca-9d0b-922b98159ccd tempest-FlavorsV261TestJSON-1755223627 tempest-FlavorsV261TestJSON-1755223627-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:59.403197 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8be07036-a910-493f-8bbc-c061eef88f04 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:59.418296 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8be07036-a910-493f-8bbc-c061eef88f04 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:59.422710 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8be07036-a910-493f-8bbc-c061eef88f04 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:31:59.426183 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8be07036-a910-493f-8bbc-c061eef88f04 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/bbf05a2b-af42-4f14-8956-4f6249c46974" status: 200 len: 1569 microversion: 2.25 time: 0.396190 Sep 23 04:31:59.427491 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 159/331] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:31:59 2022] GET /compute/v2.1/servers/bbf05a2b-af42-4f14-8956-4f6249c46974 => generated 1569 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:31:59.432961 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d0f45b8f-6bcb-465d-8340-fea2a6dae899 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:59.433794 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d0f45b8f-6bcb-465d-8340-fea2a6dae899 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] [instance: e18459f8-cd71-4feb-8764-c3b4cc3d89be] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:59.455884 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d0f45b8f-6bcb-465d-8340-fea2a6dae899 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:59.455884 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d0f45b8f-6bcb-465d-8340-fea2a6dae899 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:59.455884 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d0f45b8f-6bcb-465d-8340-fea2a6dae899 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:59.457999 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d0f45b8f-6bcb-465d-8340-fea2a6dae899 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:59.460740 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d0f45b8f-6bcb-465d-8340-fea2a6dae899 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:59.461807 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d0f45b8f-6bcb-465d-8340-fea2a6dae899 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:59.497877 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-d0f45b8f-6bcb-465d-8340-fea2a6dae899 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] HTTP exception thrown: Instance e18459f8-cd71-4feb-8764-c3b4cc3d89be could not be found. Sep 23 04:31:59.502140 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d0f45b8f-6bcb-465d-8340-fea2a6dae899 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Request method failure captured: Sep 23 04:31:59.502140 n-d-846463-3 devstack@n-api.service[122698]: request: DELETE /compute/v2.1/servers/e18459f8-cd71-4feb-8764-c3b4cc3d89be HTTP/1.1 Sep 23 04:31:59.502140 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:31:59.502140 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:31:59.502140 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:31:59.502140 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:31:59.502140 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:31:59.502140 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:31:59.502140 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:31:59.502140 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:31:59.502140 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTZ0ZRM17NaqF0hn5-kjr9OlGSPbN5wsvgrLJK5hdwNQSoh_bZlXH7rylroSVcAQ6XmBWmxa3XfDGdAsEhITR0cbVHqwQjue_laQf8JxM9GoGubSF06G4uzoSEXuixINAft_nQ3s8fkQDBy-Q6kkhcGgHtWZHcTw_SVmbRZHySOWK20 Sep 23 04:31:59.502140 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:31:59.502140 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:31:59.502140 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:31:59.502140 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:31:59.502140 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:31:59.502140 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:31:59.502140 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 79442cd4a69040f594e19b3492df7e7e Sep 23 04:31:59.502140 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1289949374 Sep 23 04:31:59.502140 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:31:59.502140 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:31:59.503462 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_79442cd4a69040f594e19b3492df7e7e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/79442cd4a69040f594e19b3492df7e7e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/79442cd4a69040f594e19b3492df7e7e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/79442cd4a69040f594e19b3492df7e7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:31:59.503462 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-DeleteServersAdminTestJSON-1289949374 Sep 23 04:31:59.503462 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 79442cd4a69040f594e19b3492df7e7e Sep 23 04:31:59.503462 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1289949374 Sep 23 04:31:59.503462 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-DeleteServersAdminTestJSON-1289949374-project Sep 23 04:31:59.503462 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:31:59.503462 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:31:59.503462 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: ac39d27bcf5d4def9ff9bd5b81bd7b76 Sep 23 04:31:59.503462 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-DeleteServersAdminTestJSON-1289949374-project Sep 23 04:31:59.503462 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:31:59.503462 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance e18459f8-cd71-4feb-8764-c3b4cc3d89be could not be found. Sep 23 04:31:59.503462 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': 'e18459f8-cd71-4feb-8764-c3b4cc3d89be'} Sep 23 04:31:59.504104 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:31:59.504104 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:31:59.504104 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:31:59.504104 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:31:59.504104 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:31:59.504104 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:31:59.504104 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:31:59.504104 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:31:59.504104 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:31:59.504104 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:31:59.504104 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e18459f8-cd71-4feb-8764-c3b4cc3d89be could not be found. Sep 23 04:31:59.504104 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:31:59.504104 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:31:59.504104 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:31:59.504104 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:31:59.504104 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:31:59.504104 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:31:59.504104 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:31:59.504104 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:31:59.504104 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:31:59.505125 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:31:59.505125 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 04:31:59.505125 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 04:31:59.505125 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 04:31:59.505125 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 04:31:59.505125 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:31:59.505125 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:31:59.505125 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:31:59.505125 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:31:59.505125 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e18459f8-cd71-4feb-8764-c3b4cc3d89be could not be found. Sep 23 04:31:59.505125 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:31:59.505125 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:31:59.505125 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:31:59.505125 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:31:59.505125 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:31:59.505125 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:31:59.505125 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:31:59.505125 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:31:59.505125 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e18459f8-cd71-4feb-8764-c3b4cc3d89be could not be found. Sep 23 04:31:59.505125 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:31:59.506297 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-29da3f04-79d8-48ca-9d0b-922b98159ccd tempest-FlavorsV261TestJSON-1755223627 tempest-FlavorsV261TestJSON-1755223627-project] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 7150 microversion: 2.61 time: 0.104805 Sep 23 04:31:59.525394 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d0f45b8f-6bcb-465d-8340-fea2a6dae899 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Returning 404 to user: Instance e18459f8-cd71-4feb-8764-c3b4cc3d89be could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:31:59.526139 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 173/332] 10.222.0.33 () {60 vars in 1187 bytes} [Fri Sep 23 04:31:59 2022] GET /compute/v2.1/flavors/detail => generated 7150 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:31:59.530964 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c3ab7171-b8a0-41a0-947a-5b1b4e3f1819 tempest-FlavorsV261TestJSON-1755223627 tempest-FlavorsV261TestJSON-1755223627-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:59.534333 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d0f45b8f-6bcb-465d-8340-fea2a6dae899 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e18459f8-cd71-4feb-8764-c3b4cc3d89be" status: 404 len: 111 microversion: 2.1 time: 0.104659 Sep 23 04:31:59.536649 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 160/333] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:31:59 2022] DELETE /compute/v2.1/servers/e18459f8-cd71-4feb-8764-c3b4cc3d89be => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:31:59.556033 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c9ee5345-45f7-4cd5-ab55-822eabd75ad3 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:59.564013 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c9ee5345-45f7-4cd5-ab55-822eabd75ad3 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] [instance: e18459f8-cd71-4feb-8764-c3b4cc3d89be] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:59.568329 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c9ee5345-45f7-4cd5-ab55-822eabd75ad3 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:59.569274 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c9ee5345-45f7-4cd5-ab55-822eabd75ad3 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:59.569925 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c9ee5345-45f7-4cd5-ab55-822eabd75ad3 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:59.571046 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c9ee5345-45f7-4cd5-ab55-822eabd75ad3 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:59.571664 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c9ee5345-45f7-4cd5-ab55-822eabd75ad3 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:59.573559 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c9ee5345-45f7-4cd5-ab55-822eabd75ad3 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:59.576544 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c3ab7171-b8a0-41a0-947a-5b1b4e3f1819 tempest-FlavorsV261TestJSON-1755223627 tempest-FlavorsV261TestJSON-1755223627-project] 10.222.0.33 "GET /compute/v2.1/flavors" status: 200 len: 3677 microversion: 2.61 time: 0.049219 Sep 23 04:31:59.577574 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 174/334] 10.222.0.33 () {60 vars in 1166 bytes} [Fri Sep 23 04:31:59 2022] GET /compute/v2.1/flavors => generated 3677 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:31:59.595199 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-93802e32-e47c-43f5-bd2b-40c06bf07c39 tempest-FlavorsV261TestJSON-552610965 tempest-FlavorsV261TestJSON-552610965-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:59.625624 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-c9ee5345-45f7-4cd5-ab55-822eabd75ad3 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] HTTP exception thrown: Instance e18459f8-cd71-4feb-8764-c3b4cc3d89be could not be found. Sep 23 04:31:59.628476 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c9ee5345-45f7-4cd5-ab55-822eabd75ad3 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Request method failure captured: Sep 23 04:31:59.628476 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/e18459f8-cd71-4feb-8764-c3b4cc3d89be HTTP/1.1 Sep 23 04:31:59.628476 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:31:59.628476 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:31:59.628476 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:31:59.628476 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:31:59.628476 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:31:59.628476 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:31:59.628476 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:31:59.628476 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:31:59.628476 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTZ0ZRM17NaqF0hn5-kjr9OlGSPbN5wsvgrLJK5hdwNQSoh_bZlXH7rylroSVcAQ6XmBWmxa3XfDGdAsEhITR0cbVHqwQjue_laQf8JxM9GoGubSF06G4uzoSEXuixINAft_nQ3s8fkQDBy-Q6kkhcGgHtWZHcTw_SVmbRZHySOWK20 Sep 23 04:31:59.628476 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:31:59.628476 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:31:59.628476 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:31:59.628476 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:31:59.628476 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:31:59.628476 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:31:59.628476 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 79442cd4a69040f594e19b3492df7e7e Sep 23 04:31:59.628476 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1289949374 Sep 23 04:31:59.628476 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:31:59.628476 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:31:59.629772 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_79442cd4a69040f594e19b3492df7e7e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/79442cd4a69040f594e19b3492df7e7e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/79442cd4a69040f594e19b3492df7e7e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/79442cd4a69040f594e19b3492df7e7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:31:59.629772 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-DeleteServersAdminTestJSON-1289949374 Sep 23 04:31:59.629772 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 79442cd4a69040f594e19b3492df7e7e Sep 23 04:31:59.629772 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1289949374 Sep 23 04:31:59.629772 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-DeleteServersAdminTestJSON-1289949374-project Sep 23 04:31:59.629772 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:31:59.629772 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:31:59.629772 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: ac39d27bcf5d4def9ff9bd5b81bd7b76 Sep 23 04:31:59.629772 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-DeleteServersAdminTestJSON-1289949374-project Sep 23 04:31:59.629772 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:31:59.629772 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance e18459f8-cd71-4feb-8764-c3b4cc3d89be could not be found. Sep 23 04:31:59.629772 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': 'e18459f8-cd71-4feb-8764-c3b4cc3d89be'} Sep 23 04:31:59.630479 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:31:59.630479 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:31:59.630479 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:31:59.630479 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:31:59.630479 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:31:59.630479 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:31:59.630479 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:31:59.630479 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:31:59.630479 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:31:59.630479 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:31:59.630479 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e18459f8-cd71-4feb-8764-c3b4cc3d89be could not be found. Sep 23 04:31:59.630479 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:31:59.630479 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:31:59.630479 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:31:59.630479 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:31:59.630479 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:31:59.630479 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:31:59.630479 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:31:59.630479 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:31:59.630479 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:31:59.631531 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:31:59.631531 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:31:59.631531 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:31:59.631531 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:31:59.631531 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:31:59.631531 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:31:59.631531 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:31:59.631531 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e18459f8-cd71-4feb-8764-c3b4cc3d89be could not be found. Sep 23 04:31:59.631531 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:31:59.631531 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:31:59.631531 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:31:59.631531 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:31:59.631531 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:31:59.631531 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:31:59.631531 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:31:59.631531 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:31:59.631531 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e18459f8-cd71-4feb-8764-c3b4cc3d89be could not be found. Sep 23 04:31:59.631531 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:31:59.634229 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c9ee5345-45f7-4cd5-ab55-822eabd75ad3 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] Returning 404 to user: Instance e18459f8-cd71-4feb-8764-c3b4cc3d89be could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:31:59.635793 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c9ee5345-45f7-4cd5-ab55-822eabd75ad3 tempest-DeleteServersAdminTestJSON-1289949374 tempest-DeleteServersAdminTestJSON-1289949374-project] 10.222.0.33 "GET /compute/v2.1/servers/e18459f8-cd71-4feb-8764-c3b4cc3d89be" status: 404 len: 111 microversion: 2.1 time: 0.091297 Sep 23 04:31:59.640783 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 161/335] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:31:59 2022] GET /compute/v2.1/servers/e18459f8-cd71-4feb-8764-c3b4cc3d89be => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:31:59.728577 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2dc38daa-9e01-4cda-926d-ecf8c8ae2325 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:59.729284 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-2dc38daa-9e01-4cda-926d-ecf8c8ae2325 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] [instance: ed83bf5a-f3ce-4b5c-af6f-92b80599a022] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:31:59.759891 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-93802e32-e47c-43f5-bd2b-40c06bf07c39 tempest-FlavorsV261TestJSON-552610965 tempest-FlavorsV261TestJSON-552610965-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/253227097" status: 202 len: 0 microversion: 2.61 time: 0.168599 Sep 23 04:31:59.761132 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 175/336] 10.222.0.33 () {60 vars in 1199 bytes} [Fri Sep 23 04:31:59 2022] DELETE /compute/v2.1/flavors/253227097 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:31:59.772850 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-533463e0-2668-462b-81fb-831ccf147fb6 tempest-FlavorsV261TestJSON-552610965 tempest-FlavorsV261TestJSON-552610965-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:31:59.776502 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2dc38daa-9e01-4cda-926d-ecf8c8ae2325 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:59.777016 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2dc38daa-9e01-4cda-926d-ecf8c8ae2325 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:59.777474 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2dc38daa-9e01-4cda-926d-ecf8c8ae2325 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:59.782725 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2dc38daa-9e01-4cda-926d-ecf8c8ae2325 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:31:59.783315 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2dc38daa-9e01-4cda-926d-ecf8c8ae2325 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:31:59.789386 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2dc38daa-9e01-4cda-926d-ecf8c8ae2325 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:31:59.790771 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=3,nova_api:INSERT=3,nova_api:DELETE=6 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:31:59.830203 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-533463e0-2668-462b-81fb-831ccf147fb6 tempest-FlavorsV261TestJSON-552610965 tempest-FlavorsV261TestJSON-552610965-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 6697 microversion: 2.61 time: 0.064443 Sep 23 04:31:59.831954 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 176/337] 10.222.0.33 () {60 vars in 1187 bytes} [Fri Sep 23 04:31:59 2022] GET /compute/v2.1/flavors/detail => generated 6697 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:32:00.114485 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-2dc38daa-9e01-4cda-926d-ecf8c8ae2325 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54d1a7a9e4ee44b9992ff9362108b311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649eb80e1ea849868c651849047833e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:00.129692 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2dc38daa-9e01-4cda-926d-ecf8c8ae2325 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] 10.222.0.33 "GET /compute/v2.1/servers/ed83bf5a-f3ce-4b5c-af6f-92b80599a022" status: 200 len: 1322 microversion: 2.1 time: 0.408319 Sep 23 04:32:00.130305 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 162/338] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:31:59 2022] GET /compute/v2.1/servers/ed83bf5a-f3ce-4b5c-af6f-92b80599a022 => generated 1322 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:00.452455 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6c234ac3-4b24-43fa-8065-db923c757dd2 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:00.453222 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-6c234ac3-4b24-43fa-8065-db923c757dd2 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: bbf05a2b-af42-4f14-8956-4f6249c46974] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:00.462467 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6c234ac3-4b24-43fa-8065-db923c757dd2 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:00.464208 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6c234ac3-4b24-43fa-8065-db923c757dd2 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:00.464352 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6c234ac3-4b24-43fa-8065-db923c757dd2 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:00.464989 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6c234ac3-4b24-43fa-8065-db923c757dd2 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:00.471428 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6c234ac3-4b24-43fa-8065-db923c757dd2 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:00.471904 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6c234ac3-4b24-43fa-8065-db923c757dd2 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:00.885087 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=6 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:32:00.888051 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-6c234ac3-4b24-43fa-8065-db923c757dd2 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:00.900563 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-6c234ac3-4b24-43fa-8065-db923c757dd2 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:00.904563 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-6c234ac3-4b24-43fa-8065-db923c757dd2 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:00.907657 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6c234ac3-4b24-43fa-8065-db923c757dd2 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/bbf05a2b-af42-4f14-8956-4f6249c46974" status: 200 len: 1569 microversion: 2.25 time: 0.459091 Sep 23 04:32:00.909277 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 177/339] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:32:00 2022] GET /compute/v2.1/servers/bbf05a2b-af42-4f14-8956-4f6249c46974 => generated 1569 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:32:01.152886 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-dad2d668-1a2a-4c84-8d47-3a54deed7447 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:01.153501 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-dad2d668-1a2a-4c84-8d47-3a54deed7447 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] [instance: ed83bf5a-f3ce-4b5c-af6f-92b80599a022] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:01.170709 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dad2d668-1a2a-4c84-8d47-3a54deed7447 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:01.170709 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dad2d668-1a2a-4c84-8d47-3a54deed7447 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:01.170709 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dad2d668-1a2a-4c84-8d47-3a54deed7447 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:01.170709 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dad2d668-1a2a-4c84-8d47-3a54deed7447 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:01.170989 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dad2d668-1a2a-4c84-8d47-3a54deed7447 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:01.170989 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dad2d668-1a2a-4c84-8d47-3a54deed7447 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:01.388148 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-885b91af-ce90-4a86-a66f-a0ad188416d5 req-b9c59d20-8a68-4785-a7eb-14c7e0e2e37e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbf05a2b-af42-4f14-8956-4f6249c46974", "name": "network-vif-unplugged", "status": "completed", "tag": "e5083905-a132-4abf-8cec-deb2f60a1547"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:32:01.401382 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-885b91af-ce90-4a86-a66f-a0ad188416d5 req-b9c59d20-8a68-4785-a7eb-14c7e0e2e37e service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:01.402277 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-885b91af-ce90-4a86-a66f-a0ad188416d5 req-b9c59d20-8a68-4785-a7eb-14c7e0e2e37e service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:01.402930 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-885b91af-ce90-4a86-a66f-a0ad188416d5 req-b9c59d20-8a68-4785-a7eb-14c7e0e2e37e service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:01.415645 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-885b91af-ce90-4a86-a66f-a0ad188416d5 req-b9c59d20-8a68-4785-a7eb-14c7e0e2e37e service nova] Creating event network-vif-unplugged:e5083905-a132-4abf-8cec-deb2f60a1547 for instance bbf05a2b-af42-4f14-8956-4f6249c46974 on n-h2-846463-3 Sep 23 04:32:01.423007 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-885b91af-ce90-4a86-a66f-a0ad188416d5 req-b9c59d20-8a68-4785-a7eb-14c7e0e2e37e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038414 Sep 23 04:32:01.424518 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 178/340] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:32:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:32:01.936011 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-78b94ef8-7a70-4551-98df-05c7eb1bebc8 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:01.937744 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-78b94ef8-7a70-4551-98df-05c7eb1bebc8 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: bbf05a2b-af42-4f14-8956-4f6249c46974] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:01.949105 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-78b94ef8-7a70-4551-98df-05c7eb1bebc8 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:01.951853 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-78b94ef8-7a70-4551-98df-05c7eb1bebc8 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:01.954202 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-78b94ef8-7a70-4551-98df-05c7eb1bebc8 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:01.959209 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-78b94ef8-7a70-4551-98df-05c7eb1bebc8 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:01.960062 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-78b94ef8-7a70-4551-98df-05c7eb1bebc8 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:01.962728 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-78b94ef8-7a70-4551-98df-05c7eb1bebc8 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:02.211281 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-dad2d668-1a2a-4c84-8d47-3a54deed7447 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54d1a7a9e4ee44b9992ff9362108b311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649eb80e1ea849868c651849047833e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:02.220754 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-dad2d668-1a2a-4c84-8d47-3a54deed7447 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] 10.222.0.33 "GET /compute/v2.1/servers/ed83bf5a-f3ce-4b5c-af6f-92b80599a022" status: 200 len: 1472 microversion: 2.1 time: 1.071625 Sep 23 04:32:02.240126 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 163/341] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:32:01 2022] GET /compute/v2.1/servers/ed83bf5a-f3ce-4b5c-af6f-92b80599a022 => generated 1472 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:02.595609 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-78b94ef8-7a70-4551-98df-05c7eb1bebc8 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:02.606944 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-78b94ef8-7a70-4551-98df-05c7eb1bebc8 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:02.610966 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-78b94ef8-7a70-4551-98df-05c7eb1bebc8 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:02.614507 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-78b94ef8-7a70-4551-98df-05c7eb1bebc8 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/bbf05a2b-af42-4f14-8956-4f6249c46974" status: 200 len: 1569 microversion: 2.25 time: 0.683146 Sep 23 04:32:02.615090 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 179/342] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:32:01 2022] GET /compute/v2.1/servers/bbf05a2b-af42-4f14-8956-4f6249c46974 => generated 1569 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:32:02.961734 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8d5c5785-2619-4144-8b75-c52babf0ac34 tempest-ServersAdminNegativeTestJSON-609839287 tempest-ServersAdminNegativeTestJSON-609839287-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:32:02.962678 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8d5c5785-2619-4144-8b75-c52babf0ac34 tempest-ServersAdminNegativeTestJSON-609839287 tempest-ServersAdminNegativeTestJSON-609839287-project-admin] [instance: 8a514082-2da0-46ce-a917-8d155824768d] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:02.974306 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-8d5c5785-2619-4144-8b75-c52babf0ac34 tempest-ServersAdminNegativeTestJSON-609839287 tempest-ServersAdminNegativeTestJSON-609839287-project-admin] HTTP exception thrown: Instance 8a514082-2da0-46ce-a917-8d155824768d could not be found. Sep 23 04:32:02.977080 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8d5c5785-2619-4144-8b75-c52babf0ac34 tempest-ServersAdminNegativeTestJSON-609839287 tempest-ServersAdminNegativeTestJSON-609839287-project-admin] Request method failure captured: Sep 23 04:32:02.977080 n-d-846463-3 devstack@n-api.service[122698]: request: POST /compute/v2.1/servers/8a514082-2da0-46ce-a917-8d155824768d/action HTTP/1.1 Sep 23 04:32:02.977080 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:32:02.977080 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:32:02.977080 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:32:02.977080 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 15 Sep 23 04:32:02.977080 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:32:02.977080 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:32:02.977080 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:32:02.977080 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:32:02.977080 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTaqvXdqw74382SxtAF02y7wVqfnlYcueFkovkv1cEgNfx8EVyrD_zGc3KpK1PFBY15axzL2p5o6fHzYmcaPrfof8pgbYejg3RN7Z_hoaT_tJolDuQLHoncWlIOw77TiO29ioCcJFYAsSIrV6zHC-VPlRqN_nALC_8i1bNbICXVhdNE Sep 23 04:32:02.977080 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:32:02.977080 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:32:02.977080 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:32:02.977080 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:32:02.977080 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:32:02.977080 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:32:02.977080 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 781acc8678e24264ba3f17a2b92c243a Sep 23 04:32:02.977080 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-609839287 Sep 23 04:32:02.977080 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,admin,member Sep 23 04:32:02.977080 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,admin,member Sep 23 04:32:02.978287 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_781acc8678e24264ba3f17a2b92c243a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/781acc8678e24264ba3f17a2b92c243a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/781acc8678e24264ba3f17a2b92c243a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/781acc8678e24264ba3f17a2b92c243a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:32:02.978287 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ServersAdminNegativeTestJSON-609839287 Sep 23 04:32:02.978287 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 781acc8678e24264ba3f17a2b92c243a Sep 23 04:32:02.978287 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-609839287 Sep 23 04:32:02.978287 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ServersAdminNegativeTestJSON-609839287-project-admin Sep 23 04:32:02.978287 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:32:02.978287 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:32:02.978287 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: a79acec9c9184778a28c138fac26167e Sep 23 04:32:02.978287 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ServersAdminNegativeTestJSON-609839287-project-admin Sep 23 04:32:02.978287 n-d-846463-3 devstack@n-api.service[122698]: Sep 23 04:32:02.978287 n-d-846463-3 devstack@n-api.service[122698]: {"migrate": {}} Sep 23 04:32:02.978287 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:32:02.978287 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 8a514082-2da0-46ce-a917-8d155824768d could not be found. Sep 23 04:32:02.980029 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '8a514082-2da0-46ce-a917-8d155824768d', 'body': {'migrate': {}}} Sep 23 04:32:02.980029 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:32:02.980029 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:32:02.980029 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:32:02.980029 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:32:02.980029 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:32:02.980029 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:32:02.980029 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 23 04:32:02.980029 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 23 04:32:02.980029 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a514082-2da0-46ce-a917-8d155824768d could not be found. Sep 23 04:32:02.980029 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:32:02.980029 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:32:02.980029 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:32:02.980029 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:32:02.980029 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:32:02.980029 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:32:02.980029 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:32:02.980029 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:32:02.980029 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:32:02.980029 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:32:02.981241 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:32:02.981241 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:32:02.981241 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Sep 23 04:32:02.981241 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Sep 23 04:32:02.981241 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:32:02.981241 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:32:02.981241 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a514082-2da0-46ce-a917-8d155824768d could not be found. Sep 23 04:32:02.981241 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:32:02.981241 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:32:02.981241 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:32:02.981241 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:32:02.981241 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:32:02.981241 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:32:02.981241 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:32:02.981241 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:32:02.981241 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a514082-2da0-46ce-a917-8d155824768d could not be found. Sep 23 04:32:02.981241 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:32:02.985136 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8d5c5785-2619-4144-8b75-c52babf0ac34 tempest-ServersAdminNegativeTestJSON-609839287 tempest-ServersAdminNegativeTestJSON-609839287-project-admin] Returning 404 to user: Instance 8a514082-2da0-46ce-a917-8d155824768d could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:32:02.986441 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8d5c5785-2619-4144-8b75-c52babf0ac34 tempest-ServersAdminNegativeTestJSON-609839287 tempest-ServersAdminNegativeTestJSON-609839287-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/8a514082-2da0-46ce-a917-8d155824768d/action" status: 404 len: 111 microversion: 2.1 time: 0.741026 Sep 23 04:32:03.004450 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 164/343] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:32:02 2022] POST /compute/v2.1/servers/8a514082-2da0-46ce-a917-8d155824768d/action => generated 111 bytes in 756 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:32:03.332136 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-79ce1d7c-3fe4-459d-bebf-b4671238d07a tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-115023211", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:32:03.402258 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.neutron [None req-79ce1d7c-3fe4-459d-bebf-b4671238d07a tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] validate_networks() for None {{(pid=122699) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:32:03.446764 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-e42f30ed-6cfe-435e-beca-662d9e4af4a0 req-ec7713c1-32a9-48f4-8dab-f6c12e0b2892 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbf05a2b-af42-4f14-8956-4f6249c46974", "tag": "e5083905-a132-4abf-8cec-deb2f60a1547"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:32:03.477218 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-e42f30ed-6cfe-435e-beca-662d9e4af4a0 req-ec7713c1-32a9-48f4-8dab-f6c12e0b2892 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:03.477726 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-e42f30ed-6cfe-435e-beca-662d9e4af4a0 req-ec7713c1-32a9-48f4-8dab-f6c12e0b2892 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:03.478198 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-e42f30ed-6cfe-435e-beca-662d9e4af4a0 req-ec7713c1-32a9-48f4-8dab-f6c12e0b2892 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:03.497699 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-e42f30ed-6cfe-435e-beca-662d9e4af4a0 req-ec7713c1-32a9-48f4-8dab-f6c12e0b2892 service nova] Creating event network-changed:e5083905-a132-4abf-8cec-deb2f60a1547 for instance bbf05a2b-af42-4f14-8956-4f6249c46974 on n-h2-846463-3 Sep 23 04:32:03.506180 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-e42f30ed-6cfe-435e-beca-662d9e4af4a0 req-ec7713c1-32a9-48f4-8dab-f6c12e0b2892 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065625 Sep 23 04:32:03.512154 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 165/344] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:32:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:32:03.644262 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1ed88c7f-05ae-48f1-ba3d-3f1e0c3e4753 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:03.646184 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-1ed88c7f-05ae-48f1-ba3d-3f1e0c3e4753 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: bbf05a2b-af42-4f14-8956-4f6249c46974] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:03.663654 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1ed88c7f-05ae-48f1-ba3d-3f1e0c3e4753 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:03.666495 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1ed88c7f-05ae-48f1-ba3d-3f1e0c3e4753 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:03.667124 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1ed88c7f-05ae-48f1-ba3d-3f1e0c3e4753 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:03.668241 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1ed88c7f-05ae-48f1-ba3d-3f1e0c3e4753 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:03.671813 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1ed88c7f-05ae-48f1-ba3d-3f1e0c3e4753 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:03.675176 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1ed88c7f-05ae-48f1-ba3d-3f1e0c3e4753 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:03.718373 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:32:04.173988 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-1ed88c7f-05ae-48f1-ba3d-3f1e0c3e4753 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:04.185983 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-1ed88c7f-05ae-48f1-ba3d-3f1e0c3e4753 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:04.191638 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-1ed88c7f-05ae-48f1-ba3d-3f1e0c3e4753 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:04.192877 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-1ed88c7f-05ae-48f1-ba3d-3f1e0c3e4753 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/bbf05a2b-af42-4f14-8956-4f6249c46974" status: 200 len: 1569 microversion: 2.25 time: 0.555884 Sep 23 04:32:04.193440 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 166/345] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:32:03 2022] GET /compute/v2.1/servers/bbf05a2b-af42-4f14-8956-4f6249c46974 => generated 1569 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:32:04.225721 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-79ce1d7c-3fe4-459d-bebf-b4671238d07a tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Flavor limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:32:04.226189 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-79ce1d7c-3fe4-459d-bebf-b4671238d07a tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Image limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:32:04.226875 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-79ce1d7c-3fe4-459d-bebf-b4671238d07a tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Flavor pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:32:04.227464 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-79ce1d7c-3fe4-459d-bebf-b4671238d07a tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Image pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:32:04.228080 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-79ce1d7c-3fe4-459d-bebf-b4671238d07a tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:32:04.247189 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-79ce1d7c-3fe4-459d-bebf-b4671238d07a tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:04.248050 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-79ce1d7c-3fe4-459d-bebf-b4671238d07a tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:04.248738 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-79ce1d7c-3fe4-459d-bebf-b4671238d07a tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:04.252149 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-79ce1d7c-3fe4-459d-bebf-b4671238d07a tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:04.255497 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-79ce1d7c-3fe4-459d-bebf-b4671238d07a tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:04.256050 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-79ce1d7c-3fe4-459d-bebf-b4671238d07a tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:04.314222 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-79ce1d7c-3fe4-459d-bebf-b4671238d07a tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Getting quotas for project 649eb80e1ea849868c651849047833e1. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:32:04.327189 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-79ce1d7c-3fe4-459d-bebf-b4671238d07a tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Getting quotas for user 54d1a7a9e4ee44b9992ff9362108b311 and project 649eb80e1ea849868c651849047833e1. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:32:04.356835 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-79ce1d7c-3fe4-459d-bebf-b4671238d07a tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Going to run 1 instances... {{(pid=122699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:32:04.360039 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-79ce1d7c-3fe4-459d-bebf-b4671238d07a tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] [instance: b09cd1e3-a561-47b1-9276-fdc378c475fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:32:04.545501 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-79ce1d7c-3fe4-459d-bebf-b4671238d07a tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.217471 Sep 23 04:32:04.547556 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 180/346] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:32:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1220 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:32:04.574442 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2986e5a4-c4fe-4eff-965f-6c91174cde13 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:04.577572 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-2986e5a4-c4fe-4eff-965f-6c91174cde13 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] [instance: b09cd1e3-a561-47b1-9276-fdc378c475fc] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:04.763460 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-2986e5a4-c4fe-4eff-965f-6c91174cde13 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54d1a7a9e4ee44b9992ff9362108b311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649eb80e1ea849868c651849047833e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:04.771607 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2986e5a4-c4fe-4eff-965f-6c91174cde13 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] 10.222.0.33 "GET /compute/v2.1/servers/b09cd1e3-a561-47b1-9276-fdc378c475fc" status: 200 len: 1221 microversion: 2.1 time: 0.217701 Sep 23 04:32:04.772719 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 167/347] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:32:04 2022] GET /compute/v2.1/servers/b09cd1e3-a561-47b1-9276-fdc378c475fc => generated 1221 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:32:05.229067 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a6b4cc24-4909-4c01-9ac8-3d97ed6a9d78 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:05.229923 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a6b4cc24-4909-4c01-9ac8-3d97ed6a9d78 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: bbf05a2b-af42-4f14-8956-4f6249c46974] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:05.240537 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a6b4cc24-4909-4c01-9ac8-3d97ed6a9d78 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:05.240955 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a6b4cc24-4909-4c01-9ac8-3d97ed6a9d78 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:05.241395 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a6b4cc24-4909-4c01-9ac8-3d97ed6a9d78 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:05.248120 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a6b4cc24-4909-4c01-9ac8-3d97ed6a9d78 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:05.249646 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a6b4cc24-4909-4c01-9ac8-3d97ed6a9d78 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:05.251163 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a6b4cc24-4909-4c01-9ac8-3d97ed6a9d78 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:05.604930 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a6b4cc24-4909-4c01-9ac8-3d97ed6a9d78 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:05.615255 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a6b4cc24-4909-4c01-9ac8-3d97ed6a9d78 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:05.616708 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a6b4cc24-4909-4c01-9ac8-3d97ed6a9d78 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:05.618053 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a6b4cc24-4909-4c01-9ac8-3d97ed6a9d78 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/bbf05a2b-af42-4f14-8956-4f6249c46974" status: 200 len: 1569 microversion: 2.25 time: 0.393149 Sep 23 04:32:05.618593 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 181/348] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:32:05 2022] GET /compute/v2.1/servers/bbf05a2b-af42-4f14-8956-4f6249c46974 => generated 1569 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:32:05.798299 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c58bb7fd-e6f8-49b4-8bbc-f0aca29a392a tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:05.799463 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c58bb7fd-e6f8-49b4-8bbc-f0aca29a392a tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] [instance: b09cd1e3-a561-47b1-9276-fdc378c475fc] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:05.808678 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c58bb7fd-e6f8-49b4-8bbc-f0aca29a392a tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:05.809448 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c58bb7fd-e6f8-49b4-8bbc-f0aca29a392a tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:05.809928 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c58bb7fd-e6f8-49b4-8bbc-f0aca29a392a tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:05.810779 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c58bb7fd-e6f8-49b4-8bbc-f0aca29a392a tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:05.816032 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c58bb7fd-e6f8-49b4-8bbc-f0aca29a392a tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:05.816032 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c58bb7fd-e6f8-49b4-8bbc-f0aca29a392a tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:05.912125 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c58bb7fd-e6f8-49b4-8bbc-f0aca29a392a tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54d1a7a9e4ee44b9992ff9362108b311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649eb80e1ea849868c651849047833e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:05.920675 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c58bb7fd-e6f8-49b4-8bbc-f0aca29a392a tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] 10.222.0.33 "GET /compute/v2.1/servers/b09cd1e3-a561-47b1-9276-fdc378c475fc" status: 200 len: 1225 microversion: 2.1 time: 0.126112 Sep 23 04:32:05.921683 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 168/349] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:32:05 2022] GET /compute/v2.1/servers/b09cd1e3-a561-47b1-9276-fdc378c475fc => generated 1225 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:06.649405 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-eb967c4a-832f-4c80-8a66-20a7f75fb52e tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:06.654940 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-eb967c4a-832f-4c80-8a66-20a7f75fb52e tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: bbf05a2b-af42-4f14-8956-4f6249c46974] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:06.675928 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eb967c4a-832f-4c80-8a66-20a7f75fb52e tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:06.675928 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eb967c4a-832f-4c80-8a66-20a7f75fb52e tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:06.675928 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eb967c4a-832f-4c80-8a66-20a7f75fb52e tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:06.675928 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eb967c4a-832f-4c80-8a66-20a7f75fb52e tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:06.676539 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eb967c4a-832f-4c80-8a66-20a7f75fb52e tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:06.676539 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eb967c4a-832f-4c80-8a66-20a7f75fb52e tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:06.893854 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-eb967c4a-832f-4c80-8a66-20a7f75fb52e tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:06.902417 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-eb967c4a-832f-4c80-8a66-20a7f75fb52e tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:06.907900 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-eb967c4a-832f-4c80-8a66-20a7f75fb52e tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:06.909415 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-eb967c4a-832f-4c80-8a66-20a7f75fb52e tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/bbf05a2b-af42-4f14-8956-4f6249c46974" status: 200 len: 1569 microversion: 2.25 time: 0.265261 Sep 23 04:32:06.910309 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 182/350] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:32:06 2022] GET /compute/v2.1/servers/bbf05a2b-af42-4f14-8956-4f6249c46974 => generated 1569 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:32:06.947220 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-fa008220-34fe-402a-b662-2574c3e7b7c5 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:06.947829 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-fa008220-34fe-402a-b662-2574c3e7b7c5 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] [instance: b09cd1e3-a561-47b1-9276-fdc378c475fc] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:06.958158 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fa008220-34fe-402a-b662-2574c3e7b7c5 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:06.959110 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fa008220-34fe-402a-b662-2574c3e7b7c5 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:06.959718 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fa008220-34fe-402a-b662-2574c3e7b7c5 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:06.960830 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fa008220-34fe-402a-b662-2574c3e7b7c5 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:06.961490 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fa008220-34fe-402a-b662-2574c3e7b7c5 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:06.965286 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fa008220-34fe-402a-b662-2574c3e7b7c5 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:07.087053 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-fa008220-34fe-402a-b662-2574c3e7b7c5 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54d1a7a9e4ee44b9992ff9362108b311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649eb80e1ea849868c651849047833e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:07.104212 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-fa008220-34fe-402a-b662-2574c3e7b7c5 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] 10.222.0.33 "GET /compute/v2.1/servers/b09cd1e3-a561-47b1-9276-fdc378c475fc" status: 200 len: 1273 microversion: 2.1 time: 0.157676 Sep 23 04:32:07.104212 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 169/351] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:32:06 2022] GET /compute/v2.1/servers/b09cd1e3-a561-47b1-9276-fdc378c475fc => generated 1273 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:07.937316 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b984a043-ba5d-4cb9-810b-269faa675e16 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:07.939131 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b984a043-ba5d-4cb9-810b-269faa675e16 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: bbf05a2b-af42-4f14-8956-4f6249c46974] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:07.949432 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b984a043-ba5d-4cb9-810b-269faa675e16 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:07.951584 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b984a043-ba5d-4cb9-810b-269faa675e16 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:07.952262 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b984a043-ba5d-4cb9-810b-269faa675e16 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:07.953391 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b984a043-ba5d-4cb9-810b-269faa675e16 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:07.954105 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b984a043-ba5d-4cb9-810b-269faa675e16 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:07.955717 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b984a043-ba5d-4cb9-810b-269faa675e16 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:08.125182 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d4364952-ecfe-45e8-adf5-a6647038b3be tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:08.129015 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d4364952-ecfe-45e8-adf5-a6647038b3be tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] [instance: b09cd1e3-a561-47b1-9276-fdc378c475fc] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:08.135903 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d4364952-ecfe-45e8-adf5-a6647038b3be tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:08.136641 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d4364952-ecfe-45e8-adf5-a6647038b3be tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:08.137301 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d4364952-ecfe-45e8-adf5-a6647038b3be tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:08.138253 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d4364952-ecfe-45e8-adf5-a6647038b3be tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:08.138905 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d4364952-ecfe-45e8-adf5-a6647038b3be tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:08.139526 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d4364952-ecfe-45e8-adf5-a6647038b3be tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:08.179572 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b984a043-ba5d-4cb9-810b-269faa675e16 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:08.196241 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b984a043-ba5d-4cb9-810b-269faa675e16 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:08.201116 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b984a043-ba5d-4cb9-810b-269faa675e16 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:08.203946 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b984a043-ba5d-4cb9-810b-269faa675e16 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/bbf05a2b-af42-4f14-8956-4f6249c46974" status: 200 len: 1569 microversion: 2.25 time: 0.271396 Sep 23 04:32:08.208414 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 183/352] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:32:07 2022] GET /compute/v2.1/servers/bbf05a2b-af42-4f14-8956-4f6249c46974 => generated 1569 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:32:08.210916 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d4364952-ecfe-45e8-adf5-a6647038b3be tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54d1a7a9e4ee44b9992ff9362108b311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649eb80e1ea849868c651849047833e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:08.220475 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d4364952-ecfe-45e8-adf5-a6647038b3be tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] 10.222.0.33 "GET /compute/v2.1/servers/b09cd1e3-a561-47b1-9276-fdc378c475fc" status: 200 len: 1279 microversion: 2.1 time: 0.099290 Sep 23 04:32:08.225168 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 170/353] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:32:08 2022] GET /compute/v2.1/servers/b09cd1e3-a561-47b1-9276-fdc378c475fc => generated 1279 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:08.847468 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9b98930e-d681-4289-a6c2-028fc7b57202 tempest-InstanceUsageAuditLogNegativeTestJSON-1027295206 tempest-InstanceUsageAuditLogNegativeTestJSON-1027295206-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:08.851067 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-9b98930e-d681-4289-a6c2-028fc7b57202 tempest-InstanceUsageAuditLogNegativeTestJSON-1027295206 tempest-InstanceUsageAuditLogNegativeTestJSON-1027295206-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Sep 23 04:32:08.864035 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9b98930e-d681-4289-a6c2-028fc7b57202 tempest-InstanceUsageAuditLogNegativeTestJSON-1027295206 tempest-InstanceUsageAuditLogNegativeTestJSON-1027295206-project-admin] Request method failure captured: Sep 23 04:32:08.864035 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Sep 23 04:32:08.864035 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:32:08.864035 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:32:08.864035 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:32:08.864035 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:32:08.864035 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:32:08.864035 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:32:08.864035 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:32:08.864035 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:32:08.864035 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTbIsDSiGrSqtxkxvIgUAbXvnZgVfXZRDEVhjWtFBzSukC4QDDFItxVRTSOTTWs-46LU7cTOG9Np-Hx6Jy_rcUb3FY_MRt0R1UptdmZXovRE-_8vSv_KdiquAd03X03YDLqCnU1-Mw4oG-j0yDvDglk1l0HNjJBXvZEy0q_DMs5RT7w Sep 23 04:32:08.864035 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:32:08.864035 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:32:08.864035 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:32:08.864035 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:32:08.864035 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:32:08.864035 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:32:08.864035 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: f345332b0de545bf9edb585bb7210fae Sep 23 04:32:08.864035 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1027295206 Sep 23 04:32:08.864035 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,admin,member Sep 23 04:32:08.864035 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,admin,member Sep 23 04:32:08.865651 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f345332b0de545bf9edb585bb7210fae", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f345332b0de545bf9edb585bb7210fae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f345332b0de545bf9edb585bb7210fae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f345332b0de545bf9edb585bb7210fae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:32:08.865651 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1027295206 Sep 23 04:32:08.865651 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: f345332b0de545bf9edb585bb7210fae Sep 23 04:32:08.865651 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1027295206 Sep 23 04:32:08.865651 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1027295206-project-admin Sep 23 04:32:08.865651 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:32:08.865651 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:32:08.865651 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 5385e2dee0aa4182b36e103e5ba3928a Sep 23 04:32:08.865651 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1027295206-project-admin Sep 23 04:32:08.865651 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:32:08.865651 n-d-846463-3 devstack@n-api.service[122699]: exception: Invalid timestamp for date invalid_time Sep 23 04:32:08.866312 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': 'invalid_time'} Sep 23 04:32:08.866312 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:32:08.866312 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:32:08.866312 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Sep 23 04:32:08.866312 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Sep 23 04:32:08.866312 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Sep 23 04:32:08.866312 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Sep 23 04:32:08.866312 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Sep 23 04:32:08.866312 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Sep 23 04:32:08.866312 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Sep 23 04:32:08.866312 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:32:08.866312 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:32:08.866312 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:32:08.866312 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:32:08.866312 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:32:08.866312 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:32:08.866312 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:32:08.866312 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:32:08.866312 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:32:08.866312 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:32:08.867419 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Sep 23 04:32:08.867419 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Sep 23 04:32:08.867419 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Sep 23 04:32:08.867419 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:32:08.867419 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:32:08.867419 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:32:08.867419 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:32:08.867419 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:32:08.867419 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:32:08.867419 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:32:08.867419 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:32:08.867419 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Sep 23 04:32:08.867419 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:32:08.867419 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9b98930e-d681-4289-a6c2-028fc7b57202 tempest-InstanceUsageAuditLogNegativeTestJSON-1027295206 tempest-InstanceUsageAuditLogNegativeTestJSON-1027295206-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:32:08.869262 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-9b98930e-d681-4289-a6c2-028fc7b57202 tempest-InstanceUsageAuditLogNegativeTestJSON-1027295206 tempest-InstanceUsageAuditLogNegativeTestJSON-1027295206-project-admin] 10.222.0.33 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.621626 Sep 23 04:32:08.880627 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 184/354] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 23 04:32:08 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 637 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 23 04:32:09.179924 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2f00a64a-1567-4a25-9178-5347dbb90828 tempest-FlavorsAdminTestJSON-1860961112 tempest-FlavorsAdminTestJSON-1860961112-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-10441985", "id": 2083227213, "os-flavor-access:is_public": "True"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:32:09.331388 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2f00a64a-1567-4a25-9178-5347dbb90828 tempest-FlavorsAdminTestJSON-1860961112 tempest-FlavorsAdminTestJSON-1860961112-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.693323 Sep 23 04:32:09.333925 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-749849aa-1b39-47ab-913e-79502218d6bd tempest-InstanceUsageAuditLogNegativeTestJSON-600615936 tempest-InstanceUsageAuditLogNegativeTestJSON-600615936-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:09.336141 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 171/355] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:32:08 2022] POST /compute/v2.1/flavors => generated 428 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:32:09.336648 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-749849aa-1b39-47ab-913e-79502218d6bd tempest-InstanceUsageAuditLogNegativeTestJSON-600615936 tempest-InstanceUsageAuditLogNegativeTestJSON-600615936-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '0f06526ea8a9442c95ceeea78115a898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcb6feb1595243529fbec4d8ecc87ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:09.341959 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-749849aa-1b39-47ab-913e-79502218d6bd tempest-InstanceUsageAuditLogNegativeTestJSON-600615936 tempest-InstanceUsageAuditLogNegativeTestJSON-600615936-project] Request method failure captured: Sep 23 04:32:09.341959 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Sep 23 04:32:09.341959 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:32:09.341959 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:32:09.341959 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:32:09.341959 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:32:09.341959 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:32:09.341959 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:32:09.341959 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:32:09.341959 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:32:09.341959 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTbF7aeY417FeVddiKn0A3ErM5EeGXxc3kfiWdn0A7GFvir3FPhrvehD0ai-qn28Ut_yxY0BwfFtG6LRklMPKGsc1KyZPwQP9LmCQ_8NS6lhIG6AVYuvGI0HxraNlA6sVCQXSrgREeK3N8pvjsW4ojR4oo4bxTUmr_pGMDiJdJ3aw0A Sep 23 04:32:09.341959 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:32:09.341959 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:32:09.341959 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:32:09.341959 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:32:09.341959 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:32:09.341959 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:32:09.341959 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: dcb6feb1595243529fbec4d8ecc87ee9 Sep 23 04:32:09.341959 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-600615936 Sep 23 04:32:09.341959 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:32:09.341959 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:32:09.343203 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_dcb6feb1595243529fbec4d8ecc87ee9", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dcb6feb1595243529fbec4d8ecc87ee9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/dcb6feb1595243529fbec4d8ecc87ee9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dcb6feb1595243529fbec4d8ecc87ee9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:32:09.343203 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-600615936 Sep 23 04:32:09.343203 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: dcb6feb1595243529fbec4d8ecc87ee9 Sep 23 04:32:09.343203 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-600615936 Sep 23 04:32:09.343203 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-600615936-project Sep 23 04:32:09.343203 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:32:09.343203 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:32:09.343203 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 0f06526ea8a9442c95ceeea78115a898 Sep 23 04:32:09.343203 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-600615936-project Sep 23 04:32:09.343203 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:32:09.343780 n-d-846463-3 devstack@n-api.service[122699]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Sep 23 04:32:09.343780 n-d-846463-3 devstack@n-api.service[122699]: action_args: {} Sep 23 04:32:09.343780 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:32:09.343780 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:32:09.343780 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:32:09.343780 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:32:09.343780 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:32:09.343780 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:32:09.343780 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:32:09.343780 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:32:09.343780 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Sep 23 04:32:09.343780 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Sep 23 04:32:09.343780 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 23 04:32:09.343780 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 23 04:32:09.343780 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 23 04:32:09.343780 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 23 04:32:09.343780 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 23 04:32:09.343780 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 23 04:32:09.343780 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 23 04:32:09.343780 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise self.value Sep 23 04:32:09.345104 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 23 04:32:09.345104 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 23 04:32:09.345104 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 23 04:32:09.345104 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 23 04:32:09.345104 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 23 04:32:09.345104 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 23 04:32:09.345104 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Sep 23 04:32:09.345104 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:32:09.345104 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:32:09.345104 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:32:09.345104 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:32:09.345104 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:32:09.345104 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:32:09.345104 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 23 04:32:09.345104 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 23 04:32:09.345104 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Sep 23 04:32:09.345104 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:32:09.353392 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-749849aa-1b39-47ab-913e-79502218d6bd tempest-InstanceUsageAuditLogNegativeTestJSON-600615936 tempest-InstanceUsageAuditLogNegativeTestJSON-600615936-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:32:09.353392 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-749849aa-1b39-47ab-913e-79502218d6bd tempest-InstanceUsageAuditLogNegativeTestJSON-600615936 tempest-InstanceUsageAuditLogNegativeTestJSON-600615936-project] 10.222.0.33 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.467723 Sep 23 04:32:09.353392 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 185/356] 10.222.0.33 () {58 vars in 1185 bytes} [Fri Sep 23 04:32:08 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 469 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:32:09.359185 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-eba7f675-0a6b-4d67-b3e4-2cb210a9d9aa tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:09.360079 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-eba7f675-0a6b-4d67-b3e4-2cb210a9d9aa tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: bbf05a2b-af42-4f14-8956-4f6249c46974] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:09.367617 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eba7f675-0a6b-4d67-b3e4-2cb210a9d9aa tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:09.368315 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eba7f675-0a6b-4d67-b3e4-2cb210a9d9aa tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:09.369124 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eba7f675-0a6b-4d67-b3e4-2cb210a9d9aa tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:09.370705 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eba7f675-0a6b-4d67-b3e4-2cb210a9d9aa tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:09.372793 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eba7f675-0a6b-4d67-b3e4-2cb210a9d9aa tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:09.373285 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eba7f675-0a6b-4d67-b3e4-2cb210a9d9aa tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:09.485102 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-678d75e6-731c-4947-b4e5-34eb81a2c076 tempest-QuotaClassesAdmin257Test-1842863548 tempest-QuotaClassesAdmin257Test-1842863548-project-admin] Calling method '.version_select at 0x7ff1c0778af0>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:09.506465 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-678d75e6-731c-4947-b4e5-34eb81a2c076 tempest-QuotaClassesAdmin257Test-1842863548 tempest-QuotaClassesAdmin257Test-1842863548-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.168804 Sep 23 04:32:09.512152 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 172/357] 10.222.0.33 () {60 vars in 1226 bytes} [Fri Sep 23 04:32:09 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 04:32:09.520170 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8918b09d-add0-4f55-8ba6-5f1b8fbb2f93 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:09.521000 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8918b09d-add0-4f55-8ba6-5f1b8fbb2f93 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] [instance: b09cd1e3-a561-47b1-9276-fdc378c475fc] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:09.529613 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8918b09d-add0-4f55-8ba6-5f1b8fbb2f93 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:09.530541 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8918b09d-add0-4f55-8ba6-5f1b8fbb2f93 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:09.533794 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8918b09d-add0-4f55-8ba6-5f1b8fbb2f93 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:09.533794 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8918b09d-add0-4f55-8ba6-5f1b8fbb2f93 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:09.533794 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8918b09d-add0-4f55-8ba6-5f1b8fbb2f93 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:09.533794 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8918b09d-add0-4f55-8ba6-5f1b8fbb2f93 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:09.692891 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-eba7f675-0a6b-4d67-b3e4-2cb210a9d9aa tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:09.701561 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-eba7f675-0a6b-4d67-b3e4-2cb210a9d9aa tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:09.703839 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-eba7f675-0a6b-4d67-b3e4-2cb210a9d9aa tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:09.705548 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-eba7f675-0a6b-4d67-b3e4-2cb210a9d9aa tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/bbf05a2b-af42-4f14-8956-4f6249c46974" status: 200 len: 1569 microversion: 2.25 time: 0.349612 Sep 23 04:32:09.707432 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 186/358] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:32:09 2022] GET /compute/v2.1/servers/bbf05a2b-af42-4f14-8956-4f6249c46974 => generated 1569 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:32:09.721869 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5fe6ae64-f47f-49a3-adc9-14ecc25bd219 tempest-FlavorsAdminTestJSON-1860961112 tempest-FlavorsAdminTestJSON-1860961112-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:09.784143 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8918b09d-add0-4f55-8ba6-5f1b8fbb2f93 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54d1a7a9e4ee44b9992ff9362108b311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649eb80e1ea849868c651849047833e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:09.792296 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8918b09d-add0-4f55-8ba6-5f1b8fbb2f93 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] 10.222.0.33 "GET /compute/v2.1/servers/b09cd1e3-a561-47b1-9276-fdc378c475fc" status: 200 len: 1321 microversion: 2.1 time: 0.278911 Sep 23 04:32:09.793164 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 173/359] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:32:09 2022] GET /compute/v2.1/servers/b09cd1e3-a561-47b1-9276-fdc378c475fc => generated 1321 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:09.809153 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b656e8d2-9d51-4aec-93f7-e823eaf4e0ca tempest-InstanceUsageAuditLogNegativeTestJSON-600615936 tempest-InstanceUsageAuditLogNegativeTestJSON-600615936-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:09.812535 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b656e8d2-9d51-4aec-93f7-e823eaf4e0ca tempest-InstanceUsageAuditLogNegativeTestJSON-600615936 tempest-InstanceUsageAuditLogNegativeTestJSON-600615936-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '0f06526ea8a9442c95ceeea78115a898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcb6feb1595243529fbec4d8ecc87ee9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:09.814596 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b656e8d2-9d51-4aec-93f7-e823eaf4e0ca tempest-InstanceUsageAuditLogNegativeTestJSON-600615936 tempest-InstanceUsageAuditLogNegativeTestJSON-600615936-project] Request method failure captured: Sep 23 04:32:09.814596 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-09-23%2004:32:09 HTTP/1.1 Sep 23 04:32:09.814596 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:32:09.814596 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:32:09.814596 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:32:09.814596 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:32:09.814596 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:32:09.814596 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:32:09.814596 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:32:09.814596 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:32:09.814596 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTbF7aeY417FeVddiKn0A3ErM5EeGXxc3kfiWdn0A7GFvir3FPhrvehD0ai-qn28Ut_yxY0BwfFtG6LRklMPKGsc1KyZPwQP9LmCQ_8NS6lhIG6AVYuvGI0HxraNlA6sVCQXSrgREeK3N8pvjsW4ojR4oo4bxTUmr_pGMDiJdJ3aw0A Sep 23 04:32:09.814596 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:32:09.814596 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:32:09.814596 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:32:09.814596 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:32:09.814596 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:32:09.814596 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:32:09.814596 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: dcb6feb1595243529fbec4d8ecc87ee9 Sep 23 04:32:09.814596 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-600615936 Sep 23 04:32:09.814596 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:32:09.814596 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:32:09.815817 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_dcb6feb1595243529fbec4d8ecc87ee9", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dcb6feb1595243529fbec4d8ecc87ee9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/dcb6feb1595243529fbec4d8ecc87ee9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dcb6feb1595243529fbec4d8ecc87ee9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:32:09.815817 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-600615936 Sep 23 04:32:09.815817 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: dcb6feb1595243529fbec4d8ecc87ee9 Sep 23 04:32:09.815817 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-600615936 Sep 23 04:32:09.815817 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-600615936-project Sep 23 04:32:09.815817 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:32:09.815817 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:32:09.815817 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 0f06526ea8a9442c95ceeea78115a898 Sep 23 04:32:09.815817 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-600615936-project Sep 23 04:32:09.815817 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:32:09.816545 n-d-846463-3 devstack@n-api.service[122698]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Sep 23 04:32:09.816545 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '2022-09-23 04:32:09'} Sep 23 04:32:09.816545 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:32:09.816545 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:32:09.816545 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:32:09.816545 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:32:09.816545 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:32:09.816545 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:32:09.816545 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:32:09.816545 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:32:09.816545 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Sep 23 04:32:09.816545 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Sep 23 04:32:09.816545 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 23 04:32:09.816545 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 23 04:32:09.816545 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 23 04:32:09.816545 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 23 04:32:09.816545 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 23 04:32:09.816545 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 23 04:32:09.816545 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 23 04:32:09.816545 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise self.value Sep 23 04:32:09.817636 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 23 04:32:09.817636 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 23 04:32:09.817636 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 23 04:32:09.817636 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 23 04:32:09.817636 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 23 04:32:09.817636 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 23 04:32:09.817636 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Sep 23 04:32:09.817636 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:32:09.817636 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:32:09.817636 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:32:09.817636 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:32:09.817636 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:32:09.817636 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:32:09.817636 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 23 04:32:09.817636 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 23 04:32:09.817636 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Sep 23 04:32:09.817636 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:32:09.818630 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b656e8d2-9d51-4aec-93f7-e823eaf4e0ca tempest-InstanceUsageAuditLogNegativeTestJSON-600615936 tempest-InstanceUsageAuditLogNegativeTestJSON-600615936-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:32:09.819540 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b656e8d2-9d51-4aec-93f7-e823eaf4e0ca tempest-InstanceUsageAuditLogNegativeTestJSON-600615936 tempest-InstanceUsageAuditLogNegativeTestJSON-600615936-project] 10.222.0.33 "GET /compute/v2.1/os-instance_usage_audit_log/2022-09-23 04:32:09" status: 403 len: 128 microversion: 2.1 time: 0.021524 Sep 23 04:32:09.824420 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 174/360] 10.222.0.33 () {58 vars in 1251 bytes} [Fri Sep 23 04:32:09 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-09-23%2004%3A32%3A09 => generated 128 bytes in 30 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:32:09.832130 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5fe6ae64-f47f-49a3-adc9-14ecc25bd219 tempest-FlavorsAdminTestJSON-1860961112 tempest-FlavorsAdminTestJSON-1860961112-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/2083227213" status: 202 len: 0 microversion: 2.1 time: 0.120097 Sep 23 04:32:09.839382 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-244c7a27-d3c8-4d38-9743-c455780c1c75 tempest-QuotaClassesAdmin257Test-1842863548 tempest-QuotaClassesAdmin257Test-1842863548-project-admin] Action: 'update', calling method: .version_select at 0x7ff1c028bee0>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:32:09.841860 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 187/361] 10.222.0.33 () {58 vars in 1161 bytes} [Fri Sep 23 04:32:09 2022] DELETE /compute/v2.1/flavors/2083227213 => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:32:09.848551 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b90a79b5-3853-4ff0-bda0-483075aff649 tempest-FlavorsAdminTestJSON-1860961112 tempest-FlavorsAdminTestJSON-1860961112-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:09.911968 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b90a79b5-3853-4ff0-bda0-483075aff649 tempest-FlavorsAdminTestJSON-1860961112 tempest-FlavorsAdminTestJSON-1860961112-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.066050 Sep 23 04:32:09.927003 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 188/362] 10.222.0.33 () {58 vars in 1146 bytes} [Fri Sep 23 04:32:09 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:09.934275 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a3a6233c-0dda-4a82-825e-01bf966dc3d4 tempest-FlavorsAdminTestJSON-1860961112 tempest-FlavorsAdminTestJSON-1860961112-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-355780228", "id": 2125686308, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:32:10.019503 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a3a6233c-0dda-4a82-825e-01bf966dc3d4 tempest-FlavorsAdminTestJSON-1860961112 tempest-FlavorsAdminTestJSON-1860961112-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.089478 Sep 23 04:32:10.021165 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 189/363] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:32:09 2022] POST /compute/v2.1/flavors => generated 416 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:32:10.032629 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-35009459-38b1-4654-b17d-659f7bc0a8fc tempest-FlavorsAdminTestJSON-1860961112 tempest-FlavorsAdminTestJSON-1860961112-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:10.055194 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-35009459-38b1-4654-b17d-659f7bc0a8fc tempest-FlavorsAdminTestJSON-1860961112 tempest-FlavorsAdminTestJSON-1860961112-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 6223 microversion: 2.1 time: 0.026423 Sep 23 04:32:10.056088 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 190/364] 10.222.0.33 () {58 vars in 1146 bytes} [Fri Sep 23 04:32:10 2022] GET /compute/v2.1/flavors/detail => generated 6223 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:10.075973 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1bcae8bb-b820-42b9-a147-2e3319d8c119 tempest-FlavorsAdminTestJSON-1860961112 tempest-FlavorsAdminTestJSON-1860961112-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:10.109023 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=6,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:DELETE=3,nova_api:UPDATE=3 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:32:10.186359 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1bcae8bb-b820-42b9-a147-2e3319d8c119 tempest-FlavorsAdminTestJSON-1860961112 tempest-FlavorsAdminTestJSON-1860961112-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/2125686308" status: 202 len: 0 microversion: 2.1 time: 0.113795 Sep 23 04:32:10.187652 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 191/365] 10.222.0.33 () {58 vars in 1161 bytes} [Fri Sep 23 04:32:10 2022] DELETE /compute/v2.1/flavors/2125686308 => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:32:10.205720 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2258ac9d-5bfd-4610-b5b1-594a2b48bac7 tempest-FlavorsAdminTestJSON-1860961112 tempest-FlavorsAdminTestJSON-1860961112-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:10.253552 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2258ac9d-5bfd-4610-b5b1-594a2b48bac7 tempest-FlavorsAdminTestJSON-1860961112 tempest-FlavorsAdminTestJSON-1860961112-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.060177 Sep 23 04:32:10.253904 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 192/366] 10.222.0.33 () {58 vars in 1146 bytes} [Fri Sep 23 04:32:10 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:10.673130 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-854ef581-e823-4a91-a9f8-733b9b2d3e7d tempest-HypervisorAdminNegativeUnderV252Test-466828984 tempest-HypervisorAdminNegativeUnderV252Test-466828984-project-admin] Calling method '.version_select at 0x7ff1c038a8b0>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:10.675111 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-854ef581-e823-4a91-a9f8-733b9b2d3e7d tempest-HypervisorAdminNegativeUnderV252Test-466828984 tempest-HypervisorAdminNegativeUnderV252Test-466828984-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:10.675910 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-854ef581-e823-4a91-a9f8-733b9b2d3e7d tempest-HypervisorAdminNegativeUnderV252Test-466828984 tempest-HypervisorAdminNegativeUnderV252Test-466828984-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:10.676624 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-854ef581-e823-4a91-a9f8-733b9b2d3e7d tempest-HypervisorAdminNegativeUnderV252Test-466828984 tempest-HypervisorAdminNegativeUnderV252Test-466828984-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:10.695458 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-854ef581-e823-4a91-a9f8-733b9b2d3e7d tempest-HypervisorAdminNegativeUnderV252Test-466828984 tempest-HypervisorAdminNegativeUnderV252Test-466828984-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:10.696340 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-854ef581-e823-4a91-a9f8-733b9b2d3e7d tempest-HypervisorAdminNegativeUnderV252Test-466828984 tempest-HypervisorAdminNegativeUnderV252Test-466828984-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:10.697032 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-854ef581-e823-4a91-a9f8-733b9b2d3e7d tempest-HypervisorAdminNegativeUnderV252Test-466828984 tempest-HypervisorAdminNegativeUnderV252Test-466828984-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:10.713815 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-854ef581-e823-4a91-a9f8-733b9b2d3e7d tempest-HypervisorAdminNegativeUnderV252Test-466828984 tempest-HypervisorAdminNegativeUnderV252Test-466828984-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:10.714689 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-854ef581-e823-4a91-a9f8-733b9b2d3e7d tempest-HypervisorAdminNegativeUnderV252Test-466828984 tempest-HypervisorAdminNegativeUnderV252Test-466828984-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:10.715340 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-854ef581-e823-4a91-a9f8-733b9b2d3e7d tempest-HypervisorAdminNegativeUnderV252Test-466828984 tempest-HypervisorAdminNegativeUnderV252Test-466828984-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:10.719245 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=100 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:32:10.723559 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-854ef581-e823-4a91-a9f8-733b9b2d3e7d tempest-HypervisorAdminNegativeUnderV252Test-466828984 tempest-HypervisorAdminNegativeUnderV252Test-466828984-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.468385 Sep 23 04:32:10.724760 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 193/367] 10.222.0.33 () {58 vars in 1146 bytes} [Fri Sep 23 04:32:10 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:32:10.731902 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-42153341-b040-4445-8399-67ea9b09d5aa tempest-FlavorsAdminTestJSON-1860961112 tempest-FlavorsAdminTestJSON-1860961112-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-562318384", "id": 334007954, "os-flavor-access:is_public": "True"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:32:10.753922 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-244c7a27-d3c8-4d38-9743-c455780c1c75 tempest-QuotaClassesAdmin257Test-1842863548 tempest-QuotaClassesAdmin257Test-1842863548-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.928168 Sep 23 04:32:10.757201 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 175/368] 10.222.0.33 () {62 vars in 1247 bytes} [Fri Sep 23 04:32:09 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 04:32:10.766388 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-60c887c5-4fdc-47e2-bb4e-2c48619e933e req-f6826ca9-f36d-48fd-978d-863e96a2d55a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b09cd1e3-a561-47b1-9276-fdc378c475fc", "tag": "c54ae127-a059-41f3-8afa-26264c011570"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:32:10.777358 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-60c887c5-4fdc-47e2-bb4e-2c48619e933e req-f6826ca9-f36d-48fd-978d-863e96a2d55a service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:10.777841 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-60c887c5-4fdc-47e2-bb4e-2c48619e933e req-f6826ca9-f36d-48fd-978d-863e96a2d55a service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:10.778295 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-60c887c5-4fdc-47e2-bb4e-2c48619e933e req-f6826ca9-f36d-48fd-978d-863e96a2d55a service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:10.793080 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-60c887c5-4fdc-47e2-bb4e-2c48619e933e req-f6826ca9-f36d-48fd-978d-863e96a2d55a service nova] Creating event network-changed:c54ae127-a059-41f3-8afa-26264c011570 for instance b09cd1e3-a561-47b1-9276-fdc378c475fc on n-h2-846463-3 Sep 23 04:32:10.798950 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-60c887c5-4fdc-47e2-bb4e-2c48619e933e req-f6826ca9-f36d-48fd-978d-863e96a2d55a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040076 Sep 23 04:32:10.799825 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 176/369] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:32:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:32:10.808321 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-660308ee-04bd-4c31-a560-636b6a74a21a tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:10.809032 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-660308ee-04bd-4c31-a560-636b6a74a21a tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: bbf05a2b-af42-4f14-8956-4f6249c46974] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:10.820900 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-660308ee-04bd-4c31-a560-636b6a74a21a tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:10.821407 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-660308ee-04bd-4c31-a560-636b6a74a21a tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:10.821917 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-660308ee-04bd-4c31-a560-636b6a74a21a tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:10.822725 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-660308ee-04bd-4c31-a560-636b6a74a21a tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:10.823194 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-660308ee-04bd-4c31-a560-636b6a74a21a tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:10.823625 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-660308ee-04bd-4c31-a560-636b6a74a21a tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:10.879993 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-42153341-b040-4445-8399-67ea9b09d5aa tempest-FlavorsAdminTestJSON-1860961112 tempest-FlavorsAdminTestJSON-1860961112-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.153025 Sep 23 04:32:10.881146 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 194/370] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:32:10 2022] POST /compute/v2.1/flavors => generated 425 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:32:11.013933 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7e93ea80-c466-415a-aca7-df14f6b84ed7 tempest-HypervisorAdminNegativeUnderV252Test-519035710 tempest-HypervisorAdminNegativeUnderV252Test-519035710-project] Calling method '.version_select at 0x7ff1c0345940>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:11.016534 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-7e93ea80-c466-415a-aca7-df14f6b84ed7 tempest-HypervisorAdminNegativeUnderV252Test-519035710 tempest-HypervisorAdminNegativeUnderV252Test-519035710-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': 'd3dabd9976264ee2b1eba3e35fbc753c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ada1edbc8f4b218666fb6c56942694', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:11.020122 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7e93ea80-c466-415a-aca7-df14f6b84ed7 tempest-HypervisorAdminNegativeUnderV252Test-519035710 tempest-HypervisorAdminNegativeUnderV252Test-519035710-project] Request method failure captured: Sep 23 04:32:11.020122 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/os-hypervisors/n-h2-846463-3/search HTTP/1.1 Sep 23 04:32:11.020122 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:32:11.020122 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:32:11.020122 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:32:11.020122 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:32:11.020122 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:32:11.020122 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:32:11.020122 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:32:11.020122 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:32:11.020122 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTbIzH5smH0yZlsekWQP0U0iAFPBMvkcR13VRwFHpSdhNa3vBfViuwWVjSZYrf2n277flZ48iiiTF3Ku-4_-R_kRZF8MXacpgbSoImZlEOrQQXtaaWADVzrtQulCZTs3EjHN7t-LRCI1gpm8-z1ZmDL380H5LExguK0KLeOZq1vny2o Sep 23 04:32:11.020122 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:32:11.020122 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:32:11.020122 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:32:11.020122 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:32:11.020122 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:32:11.020122 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:32:11.020122 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 77ada1edbc8f4b218666fb6c56942694 Sep 23 04:32:11.020122 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-519035710 Sep 23 04:32:11.020122 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:32:11.020122 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:32:11.021651 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_77ada1edbc8f4b218666fb6c56942694", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/77ada1edbc8f4b218666fb6c56942694"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/77ada1edbc8f4b218666fb6c56942694"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/77ada1edbc8f4b218666fb6c56942694"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:32:11.021651 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-519035710 Sep 23 04:32:11.021651 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 77ada1edbc8f4b218666fb6c56942694 Sep 23 04:32:11.021651 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-519035710 Sep 23 04:32:11.021651 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-519035710-project Sep 23 04:32:11.021651 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:32:11.021651 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:32:11.021651 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: d3dabd9976264ee2b1eba3e35fbc753c Sep 23 04:32:11.021651 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-519035710-project Sep 23 04:32:11.021651 n-d-846463-3 devstack@n-api.service[122699]: method: Sep 23 04:32:11.021651 n-d-846463-3 devstack@n-api.service[122699]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Sep 23 04:32:11.021651 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': 'n-h2-846463-3'} Sep 23 04:32:11.022473 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:32:11.022473 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:32:11.022473 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:32:11.022473 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:32:11.022473 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:32:11.022473 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:32:11.022473 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:32:11.022473 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:32:11.022473 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:32:11.022473 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:32:11.022473 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Sep 23 04:32:11.022473 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Sep 23 04:32:11.022473 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 23 04:32:11.022473 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 23 04:32:11.022473 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 23 04:32:11.022473 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 23 04:32:11.022473 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 23 04:32:11.022473 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 23 04:32:11.022473 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 23 04:32:11.023623 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise self.value Sep 23 04:32:11.023623 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 23 04:32:11.023623 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 23 04:32:11.023623 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 23 04:32:11.023623 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 23 04:32:11.023623 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 23 04:32:11.023623 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 23 04:32:11.023623 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Sep 23 04:32:11.023623 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:32:11.023623 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:32:11.023623 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:32:11.023623 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:32:11.023623 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:32:11.023623 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:32:11.023623 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 23 04:32:11.023623 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 23 04:32:11.023623 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Sep 23 04:32:11.023623 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:32:11.026624 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7e93ea80-c466-415a-aca7-df14f6b84ed7 tempest-HypervisorAdminNegativeUnderV252Test-519035710 tempest-HypervisorAdminNegativeUnderV252Test-519035710-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:32:11.027719 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-7e93ea80-c466-415a-aca7-df14f6b84ed7 tempest-HypervisorAdminNegativeUnderV252Test-519035710 tempest-HypervisorAdminNegativeUnderV252Test-519035710-project] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/n-h2-846463-3/search" status: 403 len: 117 microversion: 2.1 time: 0.145262 Sep 23 04:32:11.034627 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 195/371] 10.222.0.33 () {58 vars in 1209 bytes} [Fri Sep 23 04:32:10 2022] GET /compute/v2.1/os-hypervisors/n-h2-846463-3/search => generated 117 bytes in 147 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:32:11.034627 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f670cdf0-65c0-401b-8205-47f6aa2fd9e3 tempest-QuotaClassesAdmin257Test-1842863548 tempest-QuotaClassesAdmin257Test-1842863548-project-admin] Calling method '.version_select at 0x7ff1c0376820>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:11.055691 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f670cdf0-65c0-401b-8205-47f6aa2fd9e3 tempest-QuotaClassesAdmin257Test-1842863548 tempest-QuotaClassesAdmin257Test-1842863548-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.025875 Sep 23 04:32:11.057657 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 196/372] 10.222.0.33 () {60 vars in 1226 bytes} [Fri Sep 23 04:32:11 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 04:32:11.068337 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-27aad54f-459f-40bc-9e23-d81ad53a66be tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:11.068337 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-27aad54f-459f-40bc-9e23-d81ad53a66be tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] [instance: b09cd1e3-a561-47b1-9276-fdc378c475fc] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:11.077050 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-27aad54f-459f-40bc-9e23-d81ad53a66be tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:11.078112 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-27aad54f-459f-40bc-9e23-d81ad53a66be tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:11.078752 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-27aad54f-459f-40bc-9e23-d81ad53a66be tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:11.079716 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-27aad54f-459f-40bc-9e23-d81ad53a66be tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:11.080615 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-27aad54f-459f-40bc-9e23-d81ad53a66be tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:11.081235 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-27aad54f-459f-40bc-9e23-d81ad53a66be tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:11.138708 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-660308ee-04bd-4c31-a560-636b6a74a21a tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:11.149397 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-660308ee-04bd-4c31-a560-636b6a74a21a tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:11.151401 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-660308ee-04bd-4c31-a560-636b6a74a21a tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:11.153041 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-660308ee-04bd-4c31-a560-636b6a74a21a tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/bbf05a2b-af42-4f14-8956-4f6249c46974" status: 200 len: 1569 microversion: 2.25 time: 0.352059 Sep 23 04:32:11.171554 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 177/373] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:32:10 2022] GET /compute/v2.1/servers/bbf05a2b-af42-4f14-8956-4f6249c46974 => generated 1569 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:32:11.176548 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-fc505a9d-308a-484c-ac02-d540ed5a9f95 tempest-FlavorsAdminTestJSON-1860961112 tempest-FlavorsAdminTestJSON-1860961112-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:11.351005 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-fc505a9d-308a-484c-ac02-d540ed5a9f95 tempest-FlavorsAdminTestJSON-1860961112 tempest-FlavorsAdminTestJSON-1860961112-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/334007954" status: 202 len: 0 microversion: 2.1 time: 0.177953 Sep 23 04:32:11.353552 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 178/374] 10.222.0.33 () {58 vars in 1158 bytes} [Fri Sep 23 04:32:11 2022] DELETE /compute/v2.1/flavors/334007954 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:32:11.362705 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a0253d2d-4bf0-45b1-9f03-56dc8ba9f604 tempest-HypervisorAdminNegativeUnderV252Test-466828984 tempest-HypervisorAdminNegativeUnderV252Test-466828984-project-admin] Calling method '.version_select at 0x7ff1c0218a60>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:11.366880 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a0253d2d-4bf0-45b1-9f03-56dc8ba9f604 tempest-HypervisorAdminNegativeUnderV252Test-466828984 tempest-HypervisorAdminNegativeUnderV252Test-466828984-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:11.367984 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a0253d2d-4bf0-45b1-9f03-56dc8ba9f604 tempest-HypervisorAdminNegativeUnderV252Test-466828984 tempest-HypervisorAdminNegativeUnderV252Test-466828984-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:11.370326 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a0253d2d-4bf0-45b1-9f03-56dc8ba9f604 tempest-HypervisorAdminNegativeUnderV252Test-466828984 tempest-HypervisorAdminNegativeUnderV252Test-466828984-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:11.386399 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-a0253d2d-4bf0-45b1-9f03-56dc8ba9f604 tempest-HypervisorAdminNegativeUnderV252Test-466828984 tempest-HypervisorAdminNegativeUnderV252Test-466828984-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Sep 23 04:32:11.407744 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-27aad54f-459f-40bc-9e23-d81ad53a66be tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54d1a7a9e4ee44b9992ff9362108b311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649eb80e1ea849868c651849047833e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:11.424273 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a0253d2d-4bf0-45b1-9f03-56dc8ba9f604 tempest-HypervisorAdminNegativeUnderV252Test-466828984 tempest-HypervisorAdminNegativeUnderV252Test-466828984-project-admin] Request method failure captured: Sep 23 04:32:11.424273 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Sep 23 04:32:11.424273 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:32:11.424273 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:32:11.424273 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:32:11.424273 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:32:11.424273 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:32:11.424273 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:32:11.424273 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:32:11.424273 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:32:11.424273 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTbK0hwdnJyE1XFXv_7_ZZeEAT6kBYsei_Z1lsJouJow4AC4DHwZZReXy5CV9wvUbUM3tjTxeFG7Qpn3O0X2dip5rLrxifP6MsCVG_FWXwvc3XNzOhEIboJzl3b4MRMcBKHuJKLvf_TgVV347di2oqQpl6K-pT3fba6GyYRLqYnv0_g Sep 23 04:32:11.424273 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:32:11.424273 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:32:11.424273 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:32:11.424273 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:32:11.424273 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:32:11.424273 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:32:11.424273 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 4589b49587c24b3e9e406da57e35cc25 Sep 23 04:32:11.424273 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-466828984 Sep 23 04:32:11.424273 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,admin,member Sep 23 04:32:11.424273 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,admin,member Sep 23 04:32:11.425548 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4589b49587c24b3e9e406da57e35cc25", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4589b49587c24b3e9e406da57e35cc25"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4589b49587c24b3e9e406da57e35cc25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4589b49587c24b3e9e406da57e35cc25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:32:11.425548 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-466828984 Sep 23 04:32:11.425548 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 4589b49587c24b3e9e406da57e35cc25 Sep 23 04:32:11.425548 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-466828984 Sep 23 04:32:11.425548 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-466828984-project-admin Sep 23 04:32:11.425548 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:32:11.425548 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:32:11.425548 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 2712600f23c3471e8844d750d240567e Sep 23 04:32:11.425548 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-466828984-project-admin Sep 23 04:32:11.425548 n-d-846463-3 devstack@n-api.service[122698]: method: Sep 23 04:32:11.425548 n-d-846463-3 devstack@n-api.service[122698]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Sep 23 04:32:11.425548 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': 'nonexistent_hypervisor_name'} Sep 23 04:32:11.426317 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:32:11.426317 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:32:11.426317 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:32:11.426317 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:32:11.426317 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:32:11.426317 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:32:11.426317 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:32:11.426317 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:32:11.426317 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:32:11.426317 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:32:11.426317 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Sep 23 04:32:11.426317 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Sep 23 04:32:11.426317 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Sep 23 04:32:11.426317 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 23 04:32:11.426317 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Sep 23 04:32:11.426317 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:32:11.426317 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:32:11.426317 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:32:11.426317 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:32:11.426317 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:32:11.427787 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:32:11.427787 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:32:11.427787 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:32:11.427787 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Sep 23 04:32:11.427787 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:32:11.436307 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a0253d2d-4bf0-45b1-9f03-56dc8ba9f604 tempest-HypervisorAdminNegativeUnderV252Test-466828984 tempest-HypervisorAdminNegativeUnderV252Test-466828984-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:32:11.441237 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a0253d2d-4bf0-45b1-9f03-56dc8ba9f604 tempest-HypervisorAdminNegativeUnderV252Test-466828984 tempest-HypervisorAdminNegativeUnderV252Test-466828984-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.085392 Sep 23 04:32:11.443148 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-27aad54f-459f-40bc-9e23-d81ad53a66be tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] 10.222.0.33 "GET /compute/v2.1/servers/b09cd1e3-a561-47b1-9276-fdc378c475fc" status: 200 len: 1321 microversion: 2.1 time: 0.383558 Sep 23 04:32:11.450051 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 179/375] 10.222.0.33 () {58 vars in 1251 bytes} [Fri Sep 23 04:32:11 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:32:11.454508 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 197/376] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:32:11 2022] GET /compute/v2.1/servers/b09cd1e3-a561-47b1-9276-fdc378c475fc => generated 1321 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:11.457969 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-edf8b99e-746e-430d-9a83-e9ceea2c418d tempest-QuotaClassesAdmin257Test-1842863548 tempest-QuotaClassesAdmin257Test-1842863548-project-admin] Action: 'update', calling method: .version_select at 0x7ff1c029d040>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:32:11.475523 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e1ba7882-68f0-418a-bc7a-d7a1f30ff76e tempest-FlavorsAdminTestJSON-1860961112 tempest-FlavorsAdminTestJSON-1860961112-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:11.503761 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e1ba7882-68f0-418a-bc7a-d7a1f30ff76e tempest-FlavorsAdminTestJSON-1860961112 tempest-FlavorsAdminTestJSON-1860961112-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.032571 Sep 23 04:32:11.506601 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 198/377] 10.222.0.33 () {58 vars in 1146 bytes} [Fri Sep 23 04:32:11 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:11.511955 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0c10579a-ac9f-40a4-892d-f83465dd9541 tempest-HypervisorAdminNegativeUnderV252Test-466828984 tempest-HypervisorAdminNegativeUnderV252Test-466828984-project-admin] Calling method '.version_select at 0x7ff1c058c3a0>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:11.513982 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0c10579a-ac9f-40a4-892d-f83465dd9541 tempest-HypervisorAdminNegativeUnderV252Test-466828984 tempest-HypervisorAdminNegativeUnderV252Test-466828984-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:11.514700 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0c10579a-ac9f-40a4-892d-f83465dd9541 tempest-HypervisorAdminNegativeUnderV252Test-466828984 tempest-HypervisorAdminNegativeUnderV252Test-466828984-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:11.515379 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0c10579a-ac9f-40a4-892d-f83465dd9541 tempest-HypervisorAdminNegativeUnderV252Test-466828984 tempest-HypervisorAdminNegativeUnderV252Test-466828984-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:11.533006 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0c10579a-ac9f-40a4-892d-f83465dd9541 tempest-HypervisorAdminNegativeUnderV252Test-466828984 tempest-HypervisorAdminNegativeUnderV252Test-466828984-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:11.533923 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0c10579a-ac9f-40a4-892d-f83465dd9541 tempest-HypervisorAdminNegativeUnderV252Test-466828984 tempest-HypervisorAdminNegativeUnderV252Test-466828984-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:11.537393 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0c10579a-ac9f-40a4-892d-f83465dd9541 tempest-HypervisorAdminNegativeUnderV252Test-466828984 tempest-HypervisorAdminNegativeUnderV252Test-466828984-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:11.548466 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0c10579a-ac9f-40a4-892d-f83465dd9541 tempest-HypervisorAdminNegativeUnderV252Test-466828984 tempest-HypervisorAdminNegativeUnderV252Test-466828984-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:11.549287 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0c10579a-ac9f-40a4-892d-f83465dd9541 tempest-HypervisorAdminNegativeUnderV252Test-466828984 tempest-HypervisorAdminNegativeUnderV252Test-466828984-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:11.550120 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0c10579a-ac9f-40a4-892d-f83465dd9541 tempest-HypervisorAdminNegativeUnderV252Test-466828984 tempest-HypervisorAdminNegativeUnderV252Test-466828984-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:11.556885 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0c10579a-ac9f-40a4-892d-f83465dd9541 tempest-HypervisorAdminNegativeUnderV252Test-466828984 tempest-HypervisorAdminNegativeUnderV252Test-466828984-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.049035 Sep 23 04:32:11.557814 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 199/378] 10.222.0.33 () {58 vars in 1146 bytes} [Fri Sep 23 04:32:11 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:32:11.562331 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-42132a57-e27f-4dcf-ab43-3df8260d239a tempest-FlavorsAdminTestJSON-1860961112 tempest-FlavorsAdminTestJSON-1860961112-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1246953927", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:32:11.688375 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-42132a57-e27f-4dcf-ab43-3df8260d239a tempest-FlavorsAdminTestJSON-1860961112 tempest-FlavorsAdminTestJSON-1860961112-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.128691 Sep 23 04:32:11.690461 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 200/379] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:32:11 2022] POST /compute/v2.1/flavors => generated 507 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:32:11.695954 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-cb37a2b5-8690-4209-b83e-cd28ea9b8280 tempest-HypervisorAdminNegativeUnderV252Test-519035710 tempest-HypervisorAdminNegativeUnderV252Test-519035710-project] Calling method '.version_select at 0x7ff1c03cc1f0>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:11.698040 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-cb37a2b5-8690-4209-b83e-cd28ea9b8280 tempest-HypervisorAdminNegativeUnderV252Test-519035710 tempest-HypervisorAdminNegativeUnderV252Test-519035710-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': 'd3dabd9976264ee2b1eba3e35fbc753c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ada1edbc8f4b218666fb6c56942694', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:11.700514 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-cb37a2b5-8690-4209-b83e-cd28ea9b8280 tempest-HypervisorAdminNegativeUnderV252Test-519035710 tempest-HypervisorAdminNegativeUnderV252Test-519035710-project] Request method failure captured: Sep 23 04:32:11.700514 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Sep 23 04:32:11.700514 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:32:11.700514 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:32:11.700514 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:32:11.700514 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:32:11.700514 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:32:11.700514 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:32:11.700514 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:32:11.700514 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:32:11.700514 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTbIzH5smH0yZlsekWQP0U0iAFPBMvkcR13VRwFHpSdhNa3vBfViuwWVjSZYrf2n277flZ48iiiTF3Ku-4_-R_kRZF8MXacpgbSoImZlEOrQQXtaaWADVzrtQulCZTs3EjHN7t-LRCI1gpm8-z1ZmDL380H5LExguK0KLeOZq1vny2o Sep 23 04:32:11.700514 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:32:11.700514 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:32:11.700514 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:32:11.700514 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:32:11.700514 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:32:11.700514 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:32:11.700514 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 77ada1edbc8f4b218666fb6c56942694 Sep 23 04:32:11.700514 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-519035710 Sep 23 04:32:11.700514 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:32:11.700514 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:32:11.701822 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_77ada1edbc8f4b218666fb6c56942694", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/77ada1edbc8f4b218666fb6c56942694"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/77ada1edbc8f4b218666fb6c56942694"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/77ada1edbc8f4b218666fb6c56942694"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:32:11.701822 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-519035710 Sep 23 04:32:11.701822 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 77ada1edbc8f4b218666fb6c56942694 Sep 23 04:32:11.701822 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-519035710 Sep 23 04:32:11.701822 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-519035710-project Sep 23 04:32:11.701822 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:32:11.701822 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:32:11.701822 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: d3dabd9976264ee2b1eba3e35fbc753c Sep 23 04:32:11.701822 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-519035710-project Sep 23 04:32:11.701822 n-d-846463-3 devstack@n-api.service[122699]: method: Sep 23 04:32:11.701822 n-d-846463-3 devstack@n-api.service[122699]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Sep 23 04:32:11.701822 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '1'} Sep 23 04:32:11.709112 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:32:11.709112 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:32:11.709112 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:32:11.709112 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:32:11.709112 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:32:11.709112 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:32:11.709112 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:32:11.709112 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:32:11.709112 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:32:11.709112 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:32:11.709112 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Sep 23 04:32:11.709112 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Sep 23 04:32:11.709112 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 23 04:32:11.709112 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 23 04:32:11.709112 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 23 04:32:11.709112 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 23 04:32:11.709112 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 23 04:32:11.709112 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 23 04:32:11.709112 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 23 04:32:11.717325 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise self.value Sep 23 04:32:11.717325 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 23 04:32:11.717325 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 23 04:32:11.717325 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 23 04:32:11.717325 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 23 04:32:11.717325 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 23 04:32:11.717325 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 23 04:32:11.717325 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Sep 23 04:32:11.717325 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:32:11.717325 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:32:11.717325 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:32:11.717325 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:32:11.717325 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:32:11.717325 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:32:11.717325 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 23 04:32:11.717325 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 23 04:32:11.717325 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Sep 23 04:32:11.717325 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:32:11.718389 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-cb37a2b5-8690-4209-b83e-cd28ea9b8280 tempest-HypervisorAdminNegativeUnderV252Test-519035710 tempest-HypervisorAdminNegativeUnderV252Test-519035710-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:32:11.718389 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-cb37a2b5-8690-4209-b83e-cd28ea9b8280 tempest-HypervisorAdminNegativeUnderV252Test-519035710 tempest-HypervisorAdminNegativeUnderV252Test-519035710-project] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.009758 Sep 23 04:32:11.718389 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 201/380] 10.222.0.33 () {58 vars in 1176 bytes} [Fri Sep 23 04:32:11 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:32:11.718389 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b4b31fd0-3dd7-4854-b08c-265dd120b859 tempest-FlavorsAdminTestJSON-1860961112 tempest-FlavorsAdminTestJSON-1860961112-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:11.819330 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b4b31fd0-3dd7-4854-b08c-265dd120b859 tempest-FlavorsAdminTestJSON-1860961112 tempest-FlavorsAdminTestJSON-1860961112-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/73777e06-687e-40b6-bd7e-486f6f866a7e" status: 202 len: 0 microversion: 2.1 time: 0.114724 Sep 23 04:32:11.819926 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 202/381] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:32:11 2022] DELETE /compute/v2.1/flavors/73777e06-687e-40b6-bd7e-486f6f866a7e => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:32:11.825279 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-bb614be7-d5b8-49a1-9383-4f624c1a717e tempest-HypervisorAdminNegativeUnderV252Test-466828984 tempest-HypervisorAdminNegativeUnderV252Test-466828984-project-admin] Calling method '.version_select at 0x7ff1c05e0af0>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:11.827351 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bb614be7-d5b8-49a1-9383-4f624c1a717e tempest-HypervisorAdminNegativeUnderV252Test-466828984 tempest-HypervisorAdminNegativeUnderV252Test-466828984-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:11.827810 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bb614be7-d5b8-49a1-9383-4f624c1a717e tempest-HypervisorAdminNegativeUnderV252Test-466828984 tempest-HypervisorAdminNegativeUnderV252Test-466828984-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:11.828338 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bb614be7-d5b8-49a1-9383-4f624c1a717e tempest-HypervisorAdminNegativeUnderV252Test-466828984 tempest-HypervisorAdminNegativeUnderV252Test-466828984-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:11.836425 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-bb614be7-d5b8-49a1-9383-4f624c1a717e tempest-HypervisorAdminNegativeUnderV252Test-466828984 tempest-HypervisorAdminNegativeUnderV252Test-466828984-project-admin] HTTP exception thrown: No hypervisor matching 'a7c73226-1c50-4530-b76c-aa53f15dc5f0' could be found. Sep 23 04:32:11.838321 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-bb614be7-d5b8-49a1-9383-4f624c1a717e tempest-HypervisorAdminNegativeUnderV252Test-466828984 tempest-HypervisorAdminNegativeUnderV252Test-466828984-project-admin] Request method failure captured: Sep 23 04:32:11.838321 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/os-hypervisors/a7c73226-1c50-4530-b76c-aa53f15dc5f0/servers HTTP/1.1 Sep 23 04:32:11.838321 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:32:11.838321 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:32:11.838321 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:32:11.838321 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:32:11.838321 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:32:11.838321 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:32:11.838321 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:32:11.838321 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:32:11.838321 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTbK0hwdnJyE1XFXv_7_ZZeEAT6kBYsei_Z1lsJouJow4AC4DHwZZReXy5CV9wvUbUM3tjTxeFG7Qpn3O0X2dip5rLrxifP6MsCVG_FWXwvc3XNzOhEIboJzl3b4MRMcBKHuJKLvf_TgVV347di2oqQpl6K-pT3fba6GyYRLqYnv0_g Sep 23 04:32:11.838321 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:32:11.838321 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:32:11.838321 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:32:11.838321 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:32:11.838321 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:32:11.838321 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:32:11.838321 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 4589b49587c24b3e9e406da57e35cc25 Sep 23 04:32:11.838321 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-466828984 Sep 23 04:32:11.838321 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,admin,member Sep 23 04:32:11.838321 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,admin,member Sep 23 04:32:11.839706 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4589b49587c24b3e9e406da57e35cc25", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4589b49587c24b3e9e406da57e35cc25"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4589b49587c24b3e9e406da57e35cc25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4589b49587c24b3e9e406da57e35cc25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:32:11.839706 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-466828984 Sep 23 04:32:11.839706 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 4589b49587c24b3e9e406da57e35cc25 Sep 23 04:32:11.839706 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-466828984 Sep 23 04:32:11.839706 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-466828984-project-admin Sep 23 04:32:11.839706 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:32:11.839706 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:32:11.839706 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 2712600f23c3471e8844d750d240567e Sep 23 04:32:11.839706 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-466828984-project-admin Sep 23 04:32:11.839706 n-d-846463-3 devstack@n-api.service[122699]: method: Sep 23 04:32:11.839706 n-d-846463-3 devstack@n-api.service[122699]: exception: No hypervisor matching 'a7c73226-1c50-4530-b76c-aa53f15dc5f0' could be found. Sep 23 04:32:11.839706 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': 'a7c73226-1c50-4530-b76c-aa53f15dc5f0'} Sep 23 04:32:11.840553 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:32:11.840553 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:32:11.840553 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:32:11.840553 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:32:11.840553 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:32:11.840553 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:32:11.840553 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:32:11.840553 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:32:11.840553 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:32:11.840553 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:32:11.840553 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Sep 23 04:32:11.840553 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Sep 23 04:32:11.840553 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Sep 23 04:32:11.840553 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 23 04:32:11.840553 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'a7c73226-1c50-4530-b76c-aa53f15dc5f0' could be found. Sep 23 04:32:11.840553 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:32:11.840553 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:32:11.840553 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:32:11.840553 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:32:11.841853 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:32:11.841853 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:32:11.841853 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:32:11.841853 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:32:11.841853 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'a7c73226-1c50-4530-b76c-aa53f15dc5f0' could be found. Sep 23 04:32:11.841853 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:32:11.843760 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-bb614be7-d5b8-49a1-9383-4f624c1a717e tempest-HypervisorAdminNegativeUnderV252Test-466828984 tempest-HypervisorAdminNegativeUnderV252Test-466828984-project-admin] Returning 404 to user: No hypervisor matching 'a7c73226-1c50-4530-b76c-aa53f15dc5f0' could be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:32:11.845297 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-bb614be7-d5b8-49a1-9383-4f624c1a717e tempest-HypervisorAdminNegativeUnderV252Test-466828984 tempest-HypervisorAdminNegativeUnderV252Test-466828984-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/a7c73226-1c50-4530-b76c-aa53f15dc5f0/servers" status: 404 len: 123 microversion: 2.1 time: 0.024148 Sep 23 04:32:11.846902 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 203/382] 10.222.0.33 () {58 vars in 1281 bytes} [Fri Sep 23 04:32:11 2022] GET /compute/v2.1/os-hypervisors/a7c73226-1c50-4530-b76c-aa53f15dc5f0/servers => generated 123 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:32:11.852555 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b6bfbdc4-bcb8-4653-a97a-e48ae68a242f tempest-FlavorsAdminTestJSON-1860961112 tempest-FlavorsAdminTestJSON-1860961112-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:11.884423 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b6bfbdc4-bcb8-4653-a97a-e48ae68a242f tempest-FlavorsAdminTestJSON-1860961112 tempest-FlavorsAdminTestJSON-1860961112-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.036016 Sep 23 04:32:11.901982 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 204/383] 10.222.0.33 () {58 vars in 1146 bytes} [Fri Sep 23 04:32:11 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:11.907088 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d7db06bc-d7a7-44e0-9cf7-15a9ee15ee7c tempest-FlavorsAdminTestJSON-1860961112 tempest-FlavorsAdminTestJSON-1860961112-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-43489320", "id": "7d3e36b0-25d8-43d5-9512-0a30375a40d3", "os-flavor-access:is_public": "True"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:32:12.052225 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d7db06bc-d7a7-44e0-9cf7-15a9ee15ee7c tempest-FlavorsAdminTestJSON-1860961112 tempest-FlavorsAdminTestJSON-1860961112-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 505 microversion: 2.1 time: 0.149024 Sep 23 04:32:12.056528 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 205/384] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:32:11 2022] POST /compute/v2.1/flavors => generated 505 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:32:12.068364 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1fd001aa-59d6-475c-b488-ff3647a64a5c tempest-FlavorsAdminTestJSON-1860961112 tempest-FlavorsAdminTestJSON-1860961112-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:12.162562 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1fd001aa-59d6-475c-b488-ff3647a64a5c tempest-FlavorsAdminTestJSON-1860961112 tempest-FlavorsAdminTestJSON-1860961112-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/7d3e36b0-25d8-43d5-9512-0a30375a40d3" status: 202 len: 0 microversion: 2.1 time: 0.100636 Sep 23 04:32:12.163151 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 206/385] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:32:12 2022] DELETE /compute/v2.1/flavors/7d3e36b0-25d8-43d5-9512-0a30375a40d3 => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:32:12.170888 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-05763adc-03d6-4828-bc37-580aa339f1c1 tempest-FlavorsAdminTestJSON-1860961112 tempest-FlavorsAdminTestJSON-1860961112-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:12.196205 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-05763adc-03d6-4828-bc37-580aa339f1c1 tempest-FlavorsAdminTestJSON-1860961112 tempest-FlavorsAdminTestJSON-1860961112-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.028593 Sep 23 04:32:12.210615 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 207/386] 10.222.0.33 () {58 vars in 1146 bytes} [Fri Sep 23 04:32:12 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:32:12.215553 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5fd8600c-02d8-48df-88e2-3a602c08e75d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:12.216160 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-5fd8600c-02d8-48df-88e2-3a602c08e75d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: bbf05a2b-af42-4f14-8956-4f6249c46974] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:12.218866 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-edf8b99e-746e-430d-9a83-e9ceea2c418d tempest-QuotaClassesAdmin257Test-1842863548 tempest-QuotaClassesAdmin257Test-1842863548-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.766505 Sep 23 04:32:12.219537 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 180/387] 10.222.0.33 () {62 vars in 1247 bytes} [Fri Sep 23 04:32:11 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 04:32:12.219861 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=7,nova_api:DELETE=12 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:32:12.225682 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5fd8600c-02d8-48df-88e2-3a602c08e75d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:12.226385 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5fd8600c-02d8-48df-88e2-3a602c08e75d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:12.227015 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5fd8600c-02d8-48df-88e2-3a602c08e75d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:12.227159 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-56134d2f-3905-43ce-bb37-c6c5cfc4d8dc tempest-FlavorsAdminTestJSON-1860961112 tempest-FlavorsAdminTestJSON-1860961112-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1765146017", "id": 905101795, "os-flavor-access:is_public": "True"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:32:12.228016 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5fd8600c-02d8-48df-88e2-3a602c08e75d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:12.229397 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5fd8600c-02d8-48df-88e2-3a602c08e75d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:12.230014 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5fd8600c-02d8-48df-88e2-3a602c08e75d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:12.307607 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-56134d2f-3905-43ce-bb37-c6c5cfc4d8dc tempest-FlavorsAdminTestJSON-1860961112 tempest-FlavorsAdminTestJSON-1860961112-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.085166 Sep 23 04:32:12.308913 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 181/388] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:32:12 2022] POST /compute/v2.1/flavors => generated 411 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:32:12.320544 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ff890200-9f19-48cd-8a01-17f25ba9f2f7 tempest-FlavorsAdminTestJSON-1860961112 tempest-FlavorsAdminTestJSON-1860961112-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:12.333409 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ff890200-9f19-48cd-8a01-17f25ba9f2f7 tempest-FlavorsAdminTestJSON-1860961112 tempest-FlavorsAdminTestJSON-1860961112-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/905101795" status: 200 len: 411 microversion: 2.1 time: 0.016387 Sep 23 04:32:12.336566 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 182/389] 10.222.0.33 () {58 vars in 1155 bytes} [Fri Sep 23 04:32:12 2022] GET /compute/v2.1/flavors/905101795 => generated 411 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:32:12.505127 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-5fd8600c-02d8-48df-88e2-3a602c08e75d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:12.517122 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-5fd8600c-02d8-48df-88e2-3a602c08e75d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:12.519850 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-5fd8600c-02d8-48df-88e2-3a602c08e75d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:12.521494 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5fd8600c-02d8-48df-88e2-3a602c08e75d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/bbf05a2b-af42-4f14-8956-4f6249c46974" status: 200 len: 1559 microversion: 2.25 time: 0.309853 Sep 23 04:32:12.545738 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 208/390] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:32:12 2022] GET /compute/v2.1/servers/bbf05a2b-af42-4f14-8956-4f6249c46974 => generated 1559 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:32:12.561497 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4eee2f29-dece-44af-bbf7-f62f2b94cc22 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:12.562063 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4eee2f29-dece-44af-bbf7-f62f2b94cc22 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] [instance: b09cd1e3-a561-47b1-9276-fdc378c475fc] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:12.570417 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4eee2f29-dece-44af-bbf7-f62f2b94cc22 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:12.571486 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4eee2f29-dece-44af-bbf7-f62f2b94cc22 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:12.572190 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4eee2f29-dece-44af-bbf7-f62f2b94cc22 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:12.573031 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4eee2f29-dece-44af-bbf7-f62f2b94cc22 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:12.573493 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4eee2f29-dece-44af-bbf7-f62f2b94cc22 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:12.573981 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4eee2f29-dece-44af-bbf7-f62f2b94cc22 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:12.817420 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-4eee2f29-dece-44af-bbf7-f62f2b94cc22 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54d1a7a9e4ee44b9992ff9362108b311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649eb80e1ea849868c651849047833e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:12.831598 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4eee2f29-dece-44af-bbf7-f62f2b94cc22 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] 10.222.0.33 "GET /compute/v2.1/servers/b09cd1e3-a561-47b1-9276-fdc378c475fc" status: 200 len: 1321 microversion: 2.1 time: 0.278085 Sep 23 04:32:12.833970 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 209/391] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:32:12 2022] GET /compute/v2.1/servers/b09cd1e3-a561-47b1-9276-fdc378c475fc => generated 1321 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:12.840980 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-665e9736-3cc7-4580-873e-23a9bcab859a tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Calling method '.version_select at 0x7ff1c058cf70>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:12.847800 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-665e9736-3cc7-4580-873e-23a9bcab859a tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:12.848301 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-665e9736-3cc7-4580-873e-23a9bcab859a tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:12.848740 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-665e9736-3cc7-4580-873e-23a9bcab859a tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:12.889658 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-665e9736-3cc7-4580-873e-23a9bcab859a tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] 10.222.0.33 "GET /compute/v2.1/os-migrations" status: 200 len: 680 microversion: 2.25 time: 0.053592 Sep 23 04:32:12.890506 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 210/392] 10.222.0.33 () {60 vars in 1184 bytes} [Fri Sep 23 04:32:12 2022] GET /compute/v2.1/os-migrations => generated 680 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 04:32:12.908712 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-88ed5c45-43c2-42e7-b7ad-e8f39f84d4cf tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:12.912458 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-88ed5c45-43c2-42e7-b7ad-e8f39f84d4cf tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] [instance: bbf05a2b-af42-4f14-8956-4f6249c46974] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:12.924506 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-88ed5c45-43c2-42e7-b7ad-e8f39f84d4cf tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:12.926478 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-88ed5c45-43c2-42e7-b7ad-e8f39f84d4cf tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:12.926478 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-88ed5c45-43c2-42e7-b7ad-e8f39f84d4cf tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:12.926868 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-88ed5c45-43c2-42e7-b7ad-e8f39f84d4cf tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:12.927755 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-88ed5c45-43c2-42e7-b7ad-e8f39f84d4cf tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:12.928385 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-88ed5c45-43c2-42e7-b7ad-e8f39f84d4cf tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:13.147767 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8614457c-41de-4b30-ac35-156485ec1763 tempest-FlavorsAdminTestJSON-877133207 tempest-FlavorsAdminTestJSON-877133207-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:13.170152 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-88ed5c45-43c2-42e7-b7ad-e8f39f84d4cf tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lazy-loading 'services' on Instance uuid bbf05a2b-af42-4f14-8956-4f6249c46974 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:32:13.185771 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-88ed5c45-43c2-42e7-b7ad-e8f39f84d4cf tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/bbf05a2b-af42-4f14-8956-4f6249c46974" status: 200 len: 2052 microversion: 2.25 time: 0.282052 Sep 23 04:32:13.187839 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 211/393] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:32:12 2022] GET /compute/v2.1/servers/bbf05a2b-af42-4f14-8956-4f6249c46974 => generated 2052 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:32:13.195870 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8614457c-41de-4b30-ac35-156485ec1763 tempest-FlavorsAdminTestJSON-877133207 tempest-FlavorsAdminTestJSON-877133207-project] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 6218 microversion: 2.1 time: 0.846290 Sep 23 04:32:13.206074 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 183/394] 10.222.0.33 () {58 vars in 1146 bytes} [Fri Sep 23 04:32:12 2022] GET /compute/v2.1/flavors/detail => generated 6218 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:32:13.218652 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d53b1f7a-09e9-4e14-a330-1ff0cd900d4b tempest-FlavorsAdminTestJSON-1860961112 tempest-FlavorsAdminTestJSON-1860961112-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:13.349162 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d53b1f7a-09e9-4e14-a330-1ff0cd900d4b tempest-FlavorsAdminTestJSON-1860961112 tempest-FlavorsAdminTestJSON-1860961112-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/905101795" status: 202 len: 0 microversion: 2.1 time: 0.134517 Sep 23 04:32:13.349790 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 212/395] 10.222.0.33 () {58 vars in 1158 bytes} [Fri Sep 23 04:32:13 2022] DELETE /compute/v2.1/flavors/905101795 => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:32:13.360542 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9c9ac8fa-6124-4b8d-9d9e-ab38dcaccfc8 tempest-FlavorsAdminTestJSON-1860961112 tempest-FlavorsAdminTestJSON-1860961112-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:13.408034 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9c9ac8fa-6124-4b8d-9d9e-ab38dcaccfc8 tempest-FlavorsAdminTestJSON-1860961112 tempest-FlavorsAdminTestJSON-1860961112-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.053095 Sep 23 04:32:13.409104 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 184/396] 10.222.0.33 () {58 vars in 1146 bytes} [Fri Sep 23 04:32:13 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:13.434199 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e68ad0f8-a754-4f36-9e43-f0042bd6a1c6 tempest-FlavorsAdminTestJSON-1860961112 tempest-FlavorsAdminTestJSON-1860961112-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1799365868", "id": 750208616, "os-flavor-access:is_public": "False"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:32:13.468831 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-393f2e44-853c-441e-a5b3-78074ee86ce4 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1609629201", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "networks": [{"uuid": "019d7df5-4f38-47cb-b9f3-1f0f6f2be581"}]}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:32:13.539829 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e68ad0f8-a754-4f36-9e43-f0042bd6a1c6 tempest-FlavorsAdminTestJSON-1860961112 tempest-FlavorsAdminTestJSON-1860961112-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.113209 Sep 23 04:32:13.541111 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 213/397] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:32:13 2022] POST /compute/v2.1/flavors => generated 427 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:32:13.545224 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.network.neutron [None req-393f2e44-853c-441e-a5b3-78074ee86ce4 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] validate_networks() for [('019d7df5-4f38-47cb-b9f3-1f0f6f2be581', None, None, None, None, None)] {{(pid=122698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:32:13.567465 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-65b2a4cf-f913-4a8f-8e63-ebb267daf48b tempest-FlavorsAdminTestJSON-877133207 tempest-FlavorsAdminTestJSON-877133207-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "750208616"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:32:13.583258 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-65b2a4cf-f913-4a8f-8e63-ebb267daf48b tempest-FlavorsAdminTestJSON-877133207 tempest-FlavorsAdminTestJSON-877133207-project] HTTP exception thrown: Flavor 750208616 could not be found. Sep 23 04:32:13.586239 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-65b2a4cf-f913-4a8f-8e63-ebb267daf48b tempest-FlavorsAdminTestJSON-877133207 tempest-FlavorsAdminTestJSON-877133207-project] Request method failure captured: Sep 23 04:32:13.586239 n-d-846463-3 devstack@n-api.service[122699]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 23 04:32:13.586239 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:32:13.586239 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:32:13.586239 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:32:13.586239 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 106 Sep 23 04:32:13.586239 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:32:13.586239 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:32:13.586239 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:32:13.586239 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:32:13.586239 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTbG8fgwj97QQNjLFEYxY22RhASTcIrZSyAq21ZWsXUEAUCLToOfWloehRmVR92zcgeGGSoRD6V0o16SwjllNsCC9xE6IsCNCtDh-dVZ_Oe5LK2HSiFmt5g4IhzzvvvQjKavjRkaafqWw9SHFEfnwzkpRUtZ0_65o0t1ymZqHKbBPyw Sep 23 04:32:13.586239 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:32:13.586239 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:32:13.586239 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:32:13.586239 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:32:13.586239 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:32:13.586239 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:32:13.586239 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: b427656f69c44b1ab40b3a7d961f7b81 Sep 23 04:32:13.586239 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-FlavorsAdminTestJSON-877133207 Sep 23 04:32:13.586239 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:32:13.586239 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:32:13.587728 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b427656f69c44b1ab40b3a7d961f7b81", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b427656f69c44b1ab40b3a7d961f7b81"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b427656f69c44b1ab40b3a7d961f7b81"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b427656f69c44b1ab40b3a7d961f7b81"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:32:13.587728 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-FlavorsAdminTestJSON-877133207 Sep 23 04:32:13.587728 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: b427656f69c44b1ab40b3a7d961f7b81 Sep 23 04:32:13.587728 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-877133207 Sep 23 04:32:13.587728 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-FlavorsAdminTestJSON-877133207-project Sep 23 04:32:13.587728 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:32:13.587728 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:32:13.587728 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 5ca679bee1a94d298f36f68abe86ef11 Sep 23 04:32:13.587728 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-FlavorsAdminTestJSON-877133207-project Sep 23 04:32:13.587728 n-d-846463-3 devstack@n-api.service[122699]: Sep 23 04:32:13.587728 n-d-846463-3 devstack@n-api.service[122699]: {"server": {"name": "test", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "750208616"}} Sep 23 04:32:13.587728 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:32:13.587728 n-d-846463-3 devstack@n-api.service[122699]: exception: Flavor 750208616 could not be found. Sep 23 04:32:13.588561 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'body': {'server': {'name': 'test', 'imageRef': 'b8dd79b9-f0b9-43a9-9605-17244137c0ee', 'flavorRef': '750208616'}}} Sep 23 04:32:13.588561 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:32:13.588561 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:32:13.588561 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Sep 23 04:32:13.588561 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Sep 23 04:32:13.588561 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 23 04:32:13.588561 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 23 04:32:13.588561 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 04:32:13.588561 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 04:32:13.588561 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 23 04:32:13.588561 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 23 04:32:13.588561 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 23 04:32:13.588561 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:32:13.588561 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 23 04:32:13.588561 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 23 04:32:13.588561 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 750208616 could not be found. Sep 23 04:32:13.588561 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:32:13.588561 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:32:13.588561 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:32:13.588561 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:32:13.589909 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:32:13.589909 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:32:13.589909 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:32:13.589909 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:32:13.589909 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:32:13.589909 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:32:13.589909 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:32:13.589909 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:32:13.589909 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:32:13.589909 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:32:13.589909 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:32:13.589909 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:32:13.589909 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 23 04:32:13.589909 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Sep 23 04:32:13.589909 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 23 04:32:13.589909 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 750208616 could not be found. Sep 23 04:32:13.589909 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:32:13.589909 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:32:13.589909 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:32:13.589909 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:32:13.589909 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:32:13.591321 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:32:13.591321 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:32:13.591321 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:32:13.591321 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 750208616 could not be found. Sep 23 04:32:13.591321 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:32:13.592569 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-65b2a4cf-f913-4a8f-8e63-ebb267daf48b tempest-FlavorsAdminTestJSON-877133207 tempest-FlavorsAdminTestJSON-877133207-project] Returning 400 to user: Flavor 750208616 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:32:13.593594 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-65b2a4cf-f913-4a8f-8e63-ebb267daf48b tempest-FlavorsAdminTestJSON-877133207 tempest-FlavorsAdminTestJSON-877133207-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 80 microversion: 2.1 time: 0.042069 Sep 23 04:32:13.598027 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 214/398] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:32:13 2022] POST /compute/v2.1/servers => generated 80 bytes in 44 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 23 04:32:13.604890 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3007d290-733a-4868-9ad1-f206d30d726a tempest-FlavorsAdminTestJSON-1860961112 tempest-FlavorsAdminTestJSON-1860961112-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:13.718793 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3007d290-733a-4868-9ad1-f206d30d726a tempest-FlavorsAdminTestJSON-1860961112 tempest-FlavorsAdminTestJSON-1860961112-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/750208616" status: 202 len: 0 microversion: 2.1 time: 0.119258 Sep 23 04:32:13.719379 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 215/399] 10.222.0.33 () {58 vars in 1158 bytes} [Fri Sep 23 04:32:13 2022] DELETE /compute/v2.1/flavors/750208616 => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 23 04:32:13.728960 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1b6ae7ac-c5e5-44f6-af01-e61c1c1244e3 tempest-FlavorsAdminTestJSON-1860961112 tempest-FlavorsAdminTestJSON-1860961112-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:13.765783 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1b6ae7ac-c5e5-44f6-af01-e61c1c1244e3 tempest-FlavorsAdminTestJSON-1860961112 tempest-FlavorsAdminTestJSON-1860961112-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.040519 Sep 23 04:32:13.774557 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 216/400] 10.222.0.33 () {58 vars in 1146 bytes} [Fri Sep 23 04:32:13 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:13.794109 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-df62518d-4fa6-4079-9b14-4b7d33588edc tempest-FlavorsAdminTestJSON-1860961112 tempest-FlavorsAdminTestJSON-1860961112-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-745110042", "id": 608904734, "os-flavor-access:is_public": "False"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:32:13.883594 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-df62518d-4fa6-4079-9b14-4b7d33588edc tempest-FlavorsAdminTestJSON-1860961112 tempest-FlavorsAdminTestJSON-1860961112-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.097099 Sep 23 04:32:13.884514 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 217/401] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:32:13 2022] POST /compute/v2.1/flavors => generated 411 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:32:13.889676 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-22a89466-d253-46aa-987f-1652aa58edc9 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:13.890330 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-22a89466-d253-46aa-987f-1652aa58edc9 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] [instance: b09cd1e3-a561-47b1-9276-fdc378c475fc] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:13.897440 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-22a89466-d253-46aa-987f-1652aa58edc9 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:13.898143 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-22a89466-d253-46aa-987f-1652aa58edc9 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:13.898776 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-22a89466-d253-46aa-987f-1652aa58edc9 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:13.902512 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-22a89466-d253-46aa-987f-1652aa58edc9 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:13.902512 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-22a89466-d253-46aa-987f-1652aa58edc9 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:13.902512 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-22a89466-d253-46aa-987f-1652aa58edc9 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:14.275717 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:32:14.309036 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-22a89466-d253-46aa-987f-1652aa58edc9 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54d1a7a9e4ee44b9992ff9362108b311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649eb80e1ea849868c651849047833e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:14.317663 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-22a89466-d253-46aa-987f-1652aa58edc9 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] 10.222.0.33 "GET /compute/v2.1/servers/b09cd1e3-a561-47b1-9276-fdc378c475fc" status: 200 len: 1321 microversion: 2.1 time: 0.431812 Sep 23 04:32:14.318276 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 218/402] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:32:13 2022] GET /compute/v2.1/servers/b09cd1e3-a561-47b1-9276-fdc378c475fc => generated 1321 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:14.336172 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-784a2cd6-142f-4c51-96de-ac0dee7c3cd2 tempest-FlavorsAdminTestJSON-1860961112 tempest-FlavorsAdminTestJSON-1860961112-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1982070644", "id": 1655877853, "os-flavor-access:is_public": "True"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:32:14.479975 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-784a2cd6-142f-4c51-96de-ac0dee7c3cd2 tempest-FlavorsAdminTestJSON-1860961112 tempest-FlavorsAdminTestJSON-1860961112-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.149321 Sep 23 04:32:14.482004 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 219/403] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:32:14 2022] POST /compute/v2.1/flavors => generated 414 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:32:14.496811 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c6e129bd-468d-44ed-a066-fe78df0c9c87 tempest-FlavorsAdminTestJSON-1860961112 tempest-FlavorsAdminTestJSON-1860961112-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:14.524422 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c6e129bd-468d-44ed-a066-fe78df0c9c87 tempest-FlavorsAdminTestJSON-1860961112 tempest-FlavorsAdminTestJSON-1860961112-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 414 microversion: 2.1 time: 0.033472 Sep 23 04:32:14.526039 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 220/404] 10.222.0.33 () {58 vars in 1169 bytes} [Fri Sep 23 04:32:14 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 414 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:32:14.541011 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6a8705bb-a970-460c-b5ad-75aa0c6477ec tempest-FlavorsAdminTestJSON-1860961112 tempest-FlavorsAdminTestJSON-1860961112-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:14.556402 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6a8705bb-a970-460c-b5ad-75aa0c6477ec tempest-FlavorsAdminTestJSON-1860961112 tempest-FlavorsAdminTestJSON-1860961112-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 414 microversion: 2.1 time: 0.020597 Sep 23 04:32:14.566594 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 221/405] 10.222.0.33 () {58 vars in 1177 bytes} [Fri Sep 23 04:32:14 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 414 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:32:14.582673 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3666e692-e371-4f7e-88bd-d84bd164ef18 tempest-FlavorsAdminTestJSON-1860961112 tempest-FlavorsAdminTestJSON-1860961112-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:14.607022 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3666e692-e371-4f7e-88bd-d84bd164ef18 tempest-FlavorsAdminTestJSON-1860961112 tempest-FlavorsAdminTestJSON-1860961112-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 414 microversion: 2.1 time: 0.038965 Sep 23 04:32:14.616926 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 222/406] 10.222.0.33 () {58 vars in 1171 bytes} [Fri Sep 23 04:32:14 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 414 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:32:14.632300 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2eb14a98-e503-41a6-b6a1-9e5490951e6f tempest-FlavorsAdminTestJSON-1860961112 tempest-FlavorsAdminTestJSON-1860961112-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:14.656374 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2eb14a98-e503-41a6-b6a1-9e5490951e6f tempest-FlavorsAdminTestJSON-1860961112 tempest-FlavorsAdminTestJSON-1860961112-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 414 microversion: 2.1 time: 0.029171 Sep 23 04:32:14.666521 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 223/407] 10.222.0.33 () {58 vars in 1169 bytes} [Fri Sep 23 04:32:14 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 414 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:32:14.686164 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-92cc3294-cad9-441a-b067-c46a87a73489 tempest-FlavorsAdminTestJSON-1860961112 tempest-FlavorsAdminTestJSON-1860961112-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:14.695637 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-92cc3294-cad9-441a-b067-c46a87a73489 tempest-FlavorsAdminTestJSON-1860961112 tempest-FlavorsAdminTestJSON-1860961112-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 6221 microversion: 2.1 time: 0.027763 Sep 23 04:32:14.696376 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 224/408] 10.222.0.33 () {58 vars in 1169 bytes} [Fri Sep 23 04:32:14 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 6221 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:14.717597 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c6b28490-cbcf-447b-a13a-dea03778a771 tempest-FlavorsAdminTestJSON-1860961112 tempest-FlavorsAdminTestJSON-1860961112-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:14.740581 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c6b28490-cbcf-447b-a13a-dea03778a771 tempest-FlavorsAdminTestJSON-1860961112 tempest-FlavorsAdminTestJSON-1860961112-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 6221 microversion: 2.1 time: 0.026962 Sep 23 04:32:14.979164 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 225/409] 10.222.0.33 () {58 vars in 1175 bytes} [Fri Sep 23 04:32:14 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 6221 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:32:14.979164 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-790c4408-539c-4ba7-9bd4-0e60c21d796d tempest-FlavorsAdminTestJSON-1860961112 tempest-FlavorsAdminTestJSON-1860961112-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:14.979164 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-790c4408-539c-4ba7-9bd4-0e60c21d796d tempest-FlavorsAdminTestJSON-1860961112 tempest-FlavorsAdminTestJSON-1860961112-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 6221 microversion: 2.1 time: 0.052530 Sep 23 04:32:14.979164 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 226/410] 10.222.0.33 () {58 vars in 1173 bytes} [Fri Sep 23 04:32:14 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 6221 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:32:14.982043 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-393f2e44-853c-441e-a5b3-78074ee86ce4 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Flavor limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:32:14.982043 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-393f2e44-853c-441e-a5b3-78074ee86ce4 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Image limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:32:14.982043 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-393f2e44-853c-441e-a5b3-78074ee86ce4 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Flavor pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:32:14.982043 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-393f2e44-853c-441e-a5b3-78074ee86ce4 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Image pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:32:14.982043 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-393f2e44-853c-441e-a5b3-78074ee86ce4 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:32:14.984991 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-393f2e44-853c-441e-a5b3-78074ee86ce4 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:14.987968 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-393f2e44-853c-441e-a5b3-78074ee86ce4 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:14.988550 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-393f2e44-853c-441e-a5b3-78074ee86ce4 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:14.989369 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-393f2e44-853c-441e-a5b3-78074ee86ce4 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:14.992420 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ec5edffa-ad98-47c0-88d5-524a2af1d8c4 tempest-FlavorsAdminTestJSON-1860961112 tempest-FlavorsAdminTestJSON-1860961112-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:14.993309 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-393f2e44-853c-441e-a5b3-78074ee86ce4 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:14.993840 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-393f2e44-853c-441e-a5b3-78074ee86ce4 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:15.020081 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ec5edffa-ad98-47c0-88d5-524a2af1d8c4 tempest-FlavorsAdminTestJSON-1860961112 tempest-FlavorsAdminTestJSON-1860961112-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 6221 microversion: 2.1 time: 0.031894 Sep 23 04:32:15.020686 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 227/411] 10.222.0.33 () {58 vars in 1169 bytes} [Fri Sep 23 04:32:14 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 6221 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:15.029757 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-393f2e44-853c-441e-a5b3-78074ee86ce4 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Getting quotas for project 0abccbbae40b47968a8dda6323b618e3. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:32:15.040691 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-fc055e18-3e56-4873-a279-4b36d21b065b tempest-FlavorsAdminTestJSON-1860961112 tempest-FlavorsAdminTestJSON-1860961112-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:15.070021 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-393f2e44-853c-441e-a5b3-78074ee86ce4 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Getting quotas for user 84d0c7a6520443d896f88069e91a2eb2 and project 0abccbbae40b47968a8dda6323b618e3. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:32:15.070021 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-393f2e44-853c-441e-a5b3-78074ee86ce4 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Going to run 1 instances... {{(pid=122698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:32:15.070021 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-393f2e44-853c-441e-a5b3-78074ee86ce4 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 9d255ae7-0aed-4692-8802-6733dfcccbd0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:32:15.270260 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-fc055e18-3e56-4873-a279-4b36d21b065b tempest-FlavorsAdminTestJSON-1860961112 tempest-FlavorsAdminTestJSON-1860961112-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/1655877853" status: 202 len: 0 microversion: 2.1 time: 0.233421 Sep 23 04:32:15.272834 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 228/412] 10.222.0.33 () {58 vars in 1161 bytes} [Fri Sep 23 04:32:15 2022] DELETE /compute/v2.1/flavors/1655877853 => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 23 04:32:15.278911 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-cc17e085-94a1-4338-95f0-eef4ee57d75b tempest-FlavorsAdminTestJSON-1860961112 tempest-FlavorsAdminTestJSON-1860961112-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:15.283566 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-393f2e44-853c-441e-a5b3-78074ee86ce4 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.820582 Sep 23 04:32:15.293766 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 185/413] 10.222.0.33 () {62 vars in 1188 bytes} [Fri Sep 23 04:32:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1831 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 23 04:32:15.299102 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-22ce8c6d-523a-4f34-9eb3-c90f452bdb5c tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:15.303846 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-22ce8c6d-523a-4f34-9eb3-c90f452bdb5c tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 9d255ae7-0aed-4692-8802-6733dfcccbd0] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:15.318116 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-cc17e085-94a1-4338-95f0-eef4ee57d75b tempest-FlavorsAdminTestJSON-1860961112 tempest-FlavorsAdminTestJSON-1860961112-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.042446 Sep 23 04:32:15.318880 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 229/414] 10.222.0.33 () {58 vars in 1146 bytes} [Fri Sep 23 04:32:15 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:32:15.341995 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b6131523-e572-45e1-8261-55f1410b8900 tempest-FlavorsAdminTestJSON-1860961112 tempest-FlavorsAdminTestJSON-1860961112-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:15.374983 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-22ce8c6d-523a-4f34-9eb3-c90f452bdb5c tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:15.386235 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-22ce8c6d-523a-4f34-9eb3-c90f452bdb5c tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:15.390040 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-22ce8c6d-523a-4f34-9eb3-c90f452bdb5c tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:15.390040 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-22ce8c6d-523a-4f34-9eb3-c90f452bdb5c tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/9d255ae7-0aed-4692-8802-6733dfcccbd0" status: 200 len: 1262 microversion: 2.25 time: 0.094015 Sep 23 04:32:15.390708 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 186/415] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:32:15 2022] GET /compute/v2.1/servers/9d255ae7-0aed-4692-8802-6733dfcccbd0 => generated 1262 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:32:15.397570 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-cecbabd6-5ed7-4bd4-910b-8aabb20596d8 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:15.398499 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-cecbabd6-5ed7-4bd4-910b-8aabb20596d8 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] [instance: b09cd1e3-a561-47b1-9276-fdc378c475fc] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:15.405974 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cecbabd6-5ed7-4bd4-910b-8aabb20596d8 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:15.406779 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cecbabd6-5ed7-4bd4-910b-8aabb20596d8 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:15.407920 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cecbabd6-5ed7-4bd4-910b-8aabb20596d8 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:15.408645 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cecbabd6-5ed7-4bd4-910b-8aabb20596d8 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:15.409103 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cecbabd6-5ed7-4bd4-910b-8aabb20596d8 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:15.409755 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cecbabd6-5ed7-4bd4-910b-8aabb20596d8 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:15.457056 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b6131523-e572-45e1-8261-55f1410b8900 tempest-FlavorsAdminTestJSON-1860961112 tempest-FlavorsAdminTestJSON-1860961112-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/608904734" status: 202 len: 0 microversion: 2.1 time: 0.118682 Sep 23 04:32:15.461319 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 230/416] 10.222.0.33 () {58 vars in 1158 bytes} [Fri Sep 23 04:32:15 2022] DELETE /compute/v2.1/flavors/608904734 => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 23 04:32:15.472102 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-13ced36d-d677-4690-a42c-aa072464752f tempest-FlavorsAdminTestJSON-1860961112 tempest-FlavorsAdminTestJSON-1860961112-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:15.515406 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-13ced36d-d677-4690-a42c-aa072464752f tempest-FlavorsAdminTestJSON-1860961112 tempest-FlavorsAdminTestJSON-1860961112-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.048779 Sep 23 04:32:15.529944 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 231/417] 10.222.0.33 () {58 vars in 1146 bytes} [Fri Sep 23 04:32:15 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:15.535200 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4acb6eeb-8271-4ee2-8bce-2416aab03626 tempest-FlavorsAdminTestJSON-1860961112 tempest-FlavorsAdminTestJSON-1860961112-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-314219947", "id": 1530825351, "os-flavor-access:is_public": "False"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:32:15.615387 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-cecbabd6-5ed7-4bd4-910b-8aabb20596d8 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54d1a7a9e4ee44b9992ff9362108b311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649eb80e1ea849868c651849047833e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:15.623481 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-cecbabd6-5ed7-4bd4-910b-8aabb20596d8 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] 10.222.0.33 "GET /compute/v2.1/servers/b09cd1e3-a561-47b1-9276-fdc378c475fc" status: 200 len: 1321 microversion: 2.1 time: 0.231293 Sep 23 04:32:15.624052 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 187/418] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:32:15 2022] GET /compute/v2.1/servers/b09cd1e3-a561-47b1-9276-fdc378c475fc => generated 1321 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:15.649568 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4acb6eeb-8271-4ee2-8bce-2416aab03626 tempest-FlavorsAdminTestJSON-1860961112 tempest-FlavorsAdminTestJSON-1860961112-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.118444 Sep 23 04:32:15.652703 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 232/419] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:32:15 2022] POST /compute/v2.1/flavors => generated 414 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:32:15.663402 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9a37825d-58c4-45f1-90e5-51f4de28a5fe tempest-FlavorsAdminTestJSON-1860961112 tempest-FlavorsAdminTestJSON-1860961112-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:15.724388 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9a37825d-58c4-45f1-90e5-51f4de28a5fe tempest-FlavorsAdminTestJSON-1860961112 tempest-FlavorsAdminTestJSON-1860961112-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.064437 Sep 23 04:32:15.725360 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 188/420] 10.222.0.33 () {58 vars in 1146 bytes} [Fri Sep 23 04:32:15 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:15.752366 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-25d3aa39-eeaa-45b2-a847-bb7ebb9dec2b tempest-FlavorsAdminTestJSON-877133207 tempest-FlavorsAdminTestJSON-877133207-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:15.775992 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-25d3aa39-eeaa-45b2-a847-bb7ebb9dec2b tempest-FlavorsAdminTestJSON-877133207 tempest-FlavorsAdminTestJSON-877133207-project] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.035087 Sep 23 04:32:15.776518 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 233/421] 10.222.0.33 () {58 vars in 1146 bytes} [Fri Sep 23 04:32:15 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:15.798717 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0523c9b7-16bb-435e-933c-4ef21b6b5de1 tempest-FlavorsAdminTestJSON-1860961112 tempest-FlavorsAdminTestJSON-1860961112-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:15.905557 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0523c9b7-16bb-435e-933c-4ef21b6b5de1 tempest-FlavorsAdminTestJSON-1860961112 tempest-FlavorsAdminTestJSON-1860961112-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/1530825351" status: 202 len: 0 microversion: 2.1 time: 0.110422 Sep 23 04:32:15.906313 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 189/422] 10.222.0.33 () {58 vars in 1161 bytes} [Fri Sep 23 04:32:15 2022] DELETE /compute/v2.1/flavors/1530825351 => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:32:15.916070 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c04d1ae5-f9bb-4170-91cd-785c058d3df3 tempest-FlavorsAdminTestJSON-1860961112 tempest-FlavorsAdminTestJSON-1860961112-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:15.966468 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c04d1ae5-f9bb-4170-91cd-785c058d3df3 tempest-FlavorsAdminTestJSON-1860961112 tempest-FlavorsAdminTestJSON-1860961112-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.026904 Sep 23 04:32:15.966468 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 234/423] 10.222.0.33 () {58 vars in 1146 bytes} [Fri Sep 23 04:32:15 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:32:15.967463 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-06526ff8-ed54-415f-9593-9e5fb45350c1 tempest-FlavorsAdminTestJSON-1860961112 tempest-FlavorsAdminTestJSON-1860961112-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-151826415", "id": 1560825695, "os-flavor-access:is_public": "True"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:32:16.068151 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-06526ff8-ed54-415f-9593-9e5fb45350c1 tempest-FlavorsAdminTestJSON-1860961112 tempest-FlavorsAdminTestJSON-1860961112-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.104948 Sep 23 04:32:16.069690 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 190/424] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:32:15 2022] POST /compute/v2.1/flavors => generated 413 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:32:16.081377 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5a539b84-ab41-4493-825b-06e17eab2d87 tempest-FlavorsAdminTestJSON-877133207 tempest-FlavorsAdminTestJSON-877133207-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:16.105413 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5a539b84-ab41-4493-825b-06e17eab2d87 tempest-FlavorsAdminTestJSON-877133207 tempest-FlavorsAdminTestJSON-877133207-project] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 6220 microversion: 2.1 time: 0.028297 Sep 23 04:32:16.106019 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 235/425] 10.222.0.33 () {58 vars in 1146 bytes} [Fri Sep 23 04:32:16 2022] GET /compute/v2.1/flavors/detail => generated 6220 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:16.127960 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-23612abd-822b-4e4d-a898-1866955f4ad8 tempest-FlavorsAdminTestJSON-1860961112 tempest-FlavorsAdminTestJSON-1860961112-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:16.134255 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=10,nova_api:UPDATE=11,nova_api:DELETE=7 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:32:16.233536 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-23612abd-822b-4e4d-a898-1866955f4ad8 tempest-FlavorsAdminTestJSON-1860961112 tempest-FlavorsAdminTestJSON-1860961112-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/1560825695" status: 202 len: 0 microversion: 2.1 time: 0.110279 Sep 23 04:32:16.234736 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 191/426] 10.222.0.33 () {58 vars in 1161 bytes} [Fri Sep 23 04:32:16 2022] DELETE /compute/v2.1/flavors/1560825695 => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:32:16.243276 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7ab9411a-fe42-4f7c-b345-4158f8963cc2 tempest-FlavorsAdminTestJSON-1860961112 tempest-FlavorsAdminTestJSON-1860961112-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:16.266466 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-7ab9411a-fe42-4f7c-b345-4158f8963cc2 tempest-FlavorsAdminTestJSON-1860961112 tempest-FlavorsAdminTestJSON-1860961112-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.027023 Sep 23 04:32:16.267506 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 236/427] 10.222.0.33 () {58 vars in 1146 bytes} [Fri Sep 23 04:32:16 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:16.414572 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6dfdf5ce-0093-4dfb-8a6a-51f73db042c5 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:16.415221 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-6dfdf5ce-0093-4dfb-8a6a-51f73db042c5 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 9d255ae7-0aed-4692-8802-6733dfcccbd0] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:16.421701 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6dfdf5ce-0093-4dfb-8a6a-51f73db042c5 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:16.427061 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6dfdf5ce-0093-4dfb-8a6a-51f73db042c5 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:16.427061 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6dfdf5ce-0093-4dfb-8a6a-51f73db042c5 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:16.427061 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6dfdf5ce-0093-4dfb-8a6a-51f73db042c5 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:16.427061 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6dfdf5ce-0093-4dfb-8a6a-51f73db042c5 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:16.427555 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6dfdf5ce-0093-4dfb-8a6a-51f73db042c5 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:16.490758 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6dfdf5ce-0093-4dfb-8a6a-51f73db042c5 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:16.504338 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6dfdf5ce-0093-4dfb-8a6a-51f73db042c5 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:16.507214 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6dfdf5ce-0093-4dfb-8a6a-51f73db042c5 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:16.507349 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-6dfdf5ce-0093-4dfb-8a6a-51f73db042c5 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/9d255ae7-0aed-4692-8802-6733dfcccbd0" status: 200 len: 1266 microversion: 2.25 time: 0.096635 Sep 23 04:32:16.522610 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 192/428] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:32:16 2022] GET /compute/v2.1/servers/9d255ae7-0aed-4692-8802-6733dfcccbd0 => generated 1266 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:32:16.649800 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5a6a3180-7fd9-46bd-91be-a6f467ad9efe tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:16.651232 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-5a6a3180-7fd9-46bd-91be-a6f467ad9efe tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] [instance: b09cd1e3-a561-47b1-9276-fdc378c475fc] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:16.660348 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5a6a3180-7fd9-46bd-91be-a6f467ad9efe tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:16.662387 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5a6a3180-7fd9-46bd-91be-a6f467ad9efe tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:16.662387 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5a6a3180-7fd9-46bd-91be-a6f467ad9efe tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:16.662387 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5a6a3180-7fd9-46bd-91be-a6f467ad9efe tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:16.662691 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5a6a3180-7fd9-46bd-91be-a6f467ad9efe tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:16.663043 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5a6a3180-7fd9-46bd-91be-a6f467ad9efe tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:16.867667 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-5a6a3180-7fd9-46bd-91be-a6f467ad9efe tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54d1a7a9e4ee44b9992ff9362108b311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649eb80e1ea849868c651849047833e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:16.875459 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5a6a3180-7fd9-46bd-91be-a6f467ad9efe tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] 10.222.0.33 "GET /compute/v2.1/servers/b09cd1e3-a561-47b1-9276-fdc378c475fc" status: 200 len: 1321 microversion: 2.1 time: 0.231769 Sep 23 04:32:16.891284 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 237/429] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:32:16 2022] GET /compute/v2.1/servers/b09cd1e3-a561-47b1-9276-fdc378c475fc => generated 1321 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:17.378211 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-b4ebaec4-6288-4f5e-b627-e03c0629da50 req-580dd460-91ae-4523-ba4c-912dd79a486a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b09cd1e3-a561-47b1-9276-fdc378c475fc", "name": "network-vif-plugged", "status": "completed", "tag": "c54ae127-a059-41f3-8afa-26264c011570"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:32:17.389202 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-b4ebaec4-6288-4f5e-b627-e03c0629da50 req-580dd460-91ae-4523-ba4c-912dd79a486a service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:17.394035 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-b4ebaec4-6288-4f5e-b627-e03c0629da50 req-580dd460-91ae-4523-ba4c-912dd79a486a service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:17.394035 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-b4ebaec4-6288-4f5e-b627-e03c0629da50 req-580dd460-91ae-4523-ba4c-912dd79a486a service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:17.401909 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-b4ebaec4-6288-4f5e-b627-e03c0629da50 req-580dd460-91ae-4523-ba4c-912dd79a486a service nova] Creating event network-vif-plugged:c54ae127-a059-41f3-8afa-26264c011570 for instance b09cd1e3-a561-47b1-9276-fdc378c475fc on n-h2-846463-3 Sep 23 04:32:17.406948 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-b4ebaec4-6288-4f5e-b627-e03c0629da50 req-580dd460-91ae-4523-ba4c-912dd79a486a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033434 Sep 23 04:32:17.407736 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 193/430] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:32:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:32:17.532817 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-037d7bb8-de99-4f80-a744-bea364260808 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:17.533448 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-037d7bb8-de99-4f80-a744-bea364260808 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 9d255ae7-0aed-4692-8802-6733dfcccbd0] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:17.540238 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-037d7bb8-de99-4f80-a744-bea364260808 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:17.541219 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-037d7bb8-de99-4f80-a744-bea364260808 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:17.541863 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-037d7bb8-de99-4f80-a744-bea364260808 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:17.542636 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-037d7bb8-de99-4f80-a744-bea364260808 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:17.543104 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-037d7bb8-de99-4f80-a744-bea364260808 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:17.543537 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-037d7bb8-de99-4f80-a744-bea364260808 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:17.612195 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-037d7bb8-de99-4f80-a744-bea364260808 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:17.634441 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-037d7bb8-de99-4f80-a744-bea364260808 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:17.648395 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-037d7bb8-de99-4f80-a744-bea364260808 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:17.648395 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-037d7bb8-de99-4f80-a744-bea364260808 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/9d255ae7-0aed-4692-8802-6733dfcccbd0" status: 200 len: 1314 microversion: 2.25 time: 0.108890 Sep 23 04:32:17.648395 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 238/431] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:32:17 2022] GET /compute/v2.1/servers/9d255ae7-0aed-4692-8802-6733dfcccbd0 => generated 1314 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:32:17.899549 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d94df3fc-4941-4ded-84f0-4d425852331f tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:17.900262 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d94df3fc-4941-4ded-84f0-4d425852331f tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] [instance: b09cd1e3-a561-47b1-9276-fdc378c475fc] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:17.911328 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d94df3fc-4941-4ded-84f0-4d425852331f tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:17.912232 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d94df3fc-4941-4ded-84f0-4d425852331f tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:17.917977 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d94df3fc-4941-4ded-84f0-4d425852331f tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:17.917977 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d94df3fc-4941-4ded-84f0-4d425852331f tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:17.917977 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d94df3fc-4941-4ded-84f0-4d425852331f tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:17.917977 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d94df3fc-4941-4ded-84f0-4d425852331f tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:18.146052 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d94df3fc-4941-4ded-84f0-4d425852331f tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54d1a7a9e4ee44b9992ff9362108b311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649eb80e1ea849868c651849047833e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:18.154349 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d94df3fc-4941-4ded-84f0-4d425852331f tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] 10.222.0.33 "GET /compute/v2.1/servers/b09cd1e3-a561-47b1-9276-fdc378c475fc" status: 200 len: 1321 microversion: 2.1 time: 0.259109 Sep 23 04:32:18.170271 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 194/432] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:32:17 2022] GET /compute/v2.1/servers/b09cd1e3-a561-47b1-9276-fdc378c475fc => generated 1321 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:18.663501 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-630e7b6d-97d4-44ac-957a-2a723d7f0ec5 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:18.664756 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-630e7b6d-97d4-44ac-957a-2a723d7f0ec5 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 9d255ae7-0aed-4692-8802-6733dfcccbd0] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:18.671039 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-630e7b6d-97d4-44ac-957a-2a723d7f0ec5 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:18.671813 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-630e7b6d-97d4-44ac-957a-2a723d7f0ec5 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:18.672498 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-630e7b6d-97d4-44ac-957a-2a723d7f0ec5 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:18.673523 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-630e7b6d-97d4-44ac-957a-2a723d7f0ec5 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:18.674207 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-630e7b6d-97d4-44ac-957a-2a723d7f0ec5 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:18.674853 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-630e7b6d-97d4-44ac-957a-2a723d7f0ec5 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:18.751190 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-630e7b6d-97d4-44ac-957a-2a723d7f0ec5 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:18.761000 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-630e7b6d-97d4-44ac-957a-2a723d7f0ec5 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:18.766727 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-630e7b6d-97d4-44ac-957a-2a723d7f0ec5 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:18.766727 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-630e7b6d-97d4-44ac-957a-2a723d7f0ec5 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/9d255ae7-0aed-4692-8802-6733dfcccbd0" status: 200 len: 1320 microversion: 2.25 time: 0.104018 Sep 23 04:32:18.766727 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 239/433] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:32:18 2022] GET /compute/v2.1/servers/9d255ae7-0aed-4692-8802-6733dfcccbd0 => generated 1320 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:32:19.177991 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-811ce2c7-f9ea-425f-9a53-6c304786c23e tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:19.179131 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-811ce2c7-f9ea-425f-9a53-6c304786c23e tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] [instance: b09cd1e3-a561-47b1-9276-fdc378c475fc] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:19.187349 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-811ce2c7-f9ea-425f-9a53-6c304786c23e tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:19.190840 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-811ce2c7-f9ea-425f-9a53-6c304786c23e tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:19.195826 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-811ce2c7-f9ea-425f-9a53-6c304786c23e tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:19.196870 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-811ce2c7-f9ea-425f-9a53-6c304786c23e tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:19.197346 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-811ce2c7-f9ea-425f-9a53-6c304786c23e tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:19.197775 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-811ce2c7-f9ea-425f-9a53-6c304786c23e tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:19.409722 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-811ce2c7-f9ea-425f-9a53-6c304786c23e tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54d1a7a9e4ee44b9992ff9362108b311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649eb80e1ea849868c651849047833e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:19.417979 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-811ce2c7-f9ea-425f-9a53-6c304786c23e tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] 10.222.0.33 "GET /compute/v2.1/servers/b09cd1e3-a561-47b1-9276-fdc378c475fc" status: 200 len: 1471 microversion: 2.1 time: 0.244004 Sep 23 04:32:19.419071 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 195/434] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:32:19 2022] GET /compute/v2.1/servers/b09cd1e3-a561-47b1-9276-fdc378c475fc => generated 1471 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:19.441462 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c93a49bb-53d7-4457-af2b-9635d80df170 tempest-ServersAdminNegativeTestJSON-609839287 tempest-ServersAdminNegativeTestJSON-609839287-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:32:19.442031 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c93a49bb-53d7-4457-af2b-9635d80df170 tempest-ServersAdminNegativeTestJSON-609839287 tempest-ServersAdminNegativeTestJSON-609839287-project-admin] [instance: b09cd1e3-a561-47b1-9276-fdc378c475fc] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:19.448139 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c93a49bb-53d7-4457-af2b-9635d80df170 tempest-ServersAdminNegativeTestJSON-609839287 tempest-ServersAdminNegativeTestJSON-609839287-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:19.454193 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c93a49bb-53d7-4457-af2b-9635d80df170 tempest-ServersAdminNegativeTestJSON-609839287 tempest-ServersAdminNegativeTestJSON-609839287-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:19.454193 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c93a49bb-53d7-4457-af2b-9635d80df170 tempest-ServersAdminNegativeTestJSON-609839287 tempest-ServersAdminNegativeTestJSON-609839287-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:19.454193 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c93a49bb-53d7-4457-af2b-9635d80df170 tempest-ServersAdminNegativeTestJSON-609839287 tempest-ServersAdminNegativeTestJSON-609839287-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:19.454193 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c93a49bb-53d7-4457-af2b-9635d80df170 tempest-ServersAdminNegativeTestJSON-609839287 tempest-ServersAdminNegativeTestJSON-609839287-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:19.454644 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c93a49bb-53d7-4457-af2b-9635d80df170 tempest-ServersAdminNegativeTestJSON-609839287 tempest-ServersAdminNegativeTestJSON-609839287-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:19.475753 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-c93a49bb-53d7-4457-af2b-9635d80df170 tempest-ServersAdminNegativeTestJSON-609839287 tempest-ServersAdminNegativeTestJSON-609839287-project-admin] Lazy-loading 'flavor' on Instance uuid b09cd1e3-a561-47b1-9276-fdc378c475fc {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:32:19.676965 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-35dcd438-6004-4559-ae60-2b4c83ca1d77 tempest-QuotasAdminTestJSON-590810396 tempest-QuotasAdminTestJSON-590810396-project-admin] Calling method '.version_select at 0x7ff1c02f98b0>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:19.757107 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c93a49bb-53d7-4457-af2b-9635d80df170 tempest-ServersAdminNegativeTestJSON-609839287 tempest-ServersAdminNegativeTestJSON-609839287-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/b09cd1e3-a561-47b1-9276-fdc378c475fc/action" status: 202 len: 0 microversion: 2.1 time: 0.319750 Sep 23 04:32:19.760903 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 196/435] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:32:19 2022] POST /compute/v2.1/servers/b09cd1e3-a561-47b1-9276-fdc378c475fc/action => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:32:19.766325 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7cbc690e-e05d-4635-aafe-a2a0216688c3 tempest-ServersAdminNegativeTestJSON-609839287 tempest-ServersAdminNegativeTestJSON-609839287-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:19.767735 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7cbc690e-e05d-4635-aafe-a2a0216688c3 tempest-ServersAdminNegativeTestJSON-609839287 tempest-ServersAdminNegativeTestJSON-609839287-project-admin] [instance: b09cd1e3-a561-47b1-9276-fdc378c475fc] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:19.775599 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7cbc690e-e05d-4635-aafe-a2a0216688c3 tempest-ServersAdminNegativeTestJSON-609839287 tempest-ServersAdminNegativeTestJSON-609839287-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:19.776101 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7cbc690e-e05d-4635-aafe-a2a0216688c3 tempest-ServersAdminNegativeTestJSON-609839287 tempest-ServersAdminNegativeTestJSON-609839287-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:19.776546 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7cbc690e-e05d-4635-aafe-a2a0216688c3 tempest-ServersAdminNegativeTestJSON-609839287 tempest-ServersAdminNegativeTestJSON-609839287-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:19.777501 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7cbc690e-e05d-4635-aafe-a2a0216688c3 tempest-ServersAdminNegativeTestJSON-609839287 tempest-ServersAdminNegativeTestJSON-609839287-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:19.777984 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7cbc690e-e05d-4635-aafe-a2a0216688c3 tempest-ServersAdminNegativeTestJSON-609839287 tempest-ServersAdminNegativeTestJSON-609839287-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:19.778421 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7cbc690e-e05d-4635-aafe-a2a0216688c3 tempest-ServersAdminNegativeTestJSON-609839287 tempest-ServersAdminNegativeTestJSON-609839287-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:20.174657 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7cbc690e-e05d-4635-aafe-a2a0216688c3 tempest-ServersAdminNegativeTestJSON-609839287 tempest-ServersAdminNegativeTestJSON-609839287-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/b09cd1e3-a561-47b1-9276-fdc378c475fc" status: 200 len: 1630 microversion: 2.1 time: 0.412326 Sep 23 04:32:20.175247 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 197/436] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:32:19 2022] GET /compute/v2.1/servers/b09cd1e3-a561-47b1-9276-fdc378c475fc => generated 1630 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:20.180186 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-48ffff94-9b33-4c3a-ba74-59ba3213ca05 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:20.180800 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-48ffff94-9b33-4c3a-ba74-59ba3213ca05 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 9d255ae7-0aed-4692-8802-6733dfcccbd0] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:20.188592 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-48ffff94-9b33-4c3a-ba74-59ba3213ca05 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:20.189464 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-48ffff94-9b33-4c3a-ba74-59ba3213ca05 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:20.190188 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-48ffff94-9b33-4c3a-ba74-59ba3213ca05 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:20.191107 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-48ffff94-9b33-4c3a-ba74-59ba3213ca05 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:20.191771 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-48ffff94-9b33-4c3a-ba74-59ba3213ca05 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:20.192288 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-48ffff94-9b33-4c3a-ba74-59ba3213ca05 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:20.336899 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-48ffff94-9b33-4c3a-ba74-59ba3213ca05 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:20.347713 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-48ffff94-9b33-4c3a-ba74-59ba3213ca05 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:20.350126 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-48ffff94-9b33-4c3a-ba74-59ba3213ca05 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:20.351462 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-48ffff94-9b33-4c3a-ba74-59ba3213ca05 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/9d255ae7-0aed-4692-8802-6733dfcccbd0" status: 200 len: 1362 microversion: 2.25 time: 0.175051 Sep 23 04:32:20.353617 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 198/437] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:32:20 2022] GET /compute/v2.1/servers/9d255ae7-0aed-4692-8802-6733dfcccbd0 => generated 1362 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:32:20.359003 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-ad75dc64-1717-42cb-ab91-74fd55f9a5d8 req-ca4fad27-e3e6-4f88-84e3-0aee8c7c3ecc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d255ae7-0aed-4692-8802-6733dfcccbd0", "tag": "76c7663b-b181-4528-b671-a0840df053e8"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:32:20.395934 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-ad75dc64-1717-42cb-ab91-74fd55f9a5d8 req-ca4fad27-e3e6-4f88-84e3-0aee8c7c3ecc service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:20.398484 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-ad75dc64-1717-42cb-ab91-74fd55f9a5d8 req-ca4fad27-e3e6-4f88-84e3-0aee8c7c3ecc service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:20.399113 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-ad75dc64-1717-42cb-ab91-74fd55f9a5d8 req-ca4fad27-e3e6-4f88-84e3-0aee8c7c3ecc service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:20.415657 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-ad75dc64-1717-42cb-ab91-74fd55f9a5d8 req-ca4fad27-e3e6-4f88-84e3-0aee8c7c3ecc service nova] Creating event network-changed:76c7663b-b181-4528-b671-a0840df053e8 for instance 9d255ae7-0aed-4692-8802-6733dfcccbd0 on n-h2-846463-3 Sep 23 04:32:20.421001 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-ad75dc64-1717-42cb-ab91-74fd55f9a5d8 req-ca4fad27-e3e6-4f88-84e3-0aee8c7c3ecc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066198 Sep 23 04:32:20.421792 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 199/438] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:32:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:32:20.564808 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-35dcd438-6004-4559-ae60-2b4c83ca1d77 tempest-QuotasAdminTestJSON-590810396 tempest-QuotasAdminTestJSON-590810396-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/c46cb5f54fdb4503bf1cd7f1c2a70981" status: 200 len: 371 microversion: 2.1 time: 1.281879 Sep 23 04:32:20.565951 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 240/439] 10.222.0.33 () {58 vars in 1242 bytes} [Fri Sep 23 04:32:19 2022] GET /compute/v2.1/os-quota-sets/c46cb5f54fdb4503bf1cd7f1c2a70981 => generated 371 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:32:20.582161 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-189412c3-733b-422e-8889-c25d65453f79 tempest-QuotasAdminTestJSON-590810396 tempest-QuotasAdminTestJSON-590810396-project-admin] Action: 'update', calling method: .version_select at 0x7ff1c02188b0>, body: {"quota_set": {"ram": "5120"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:32:21.105820 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-189412c3-733b-422e-8889-c25d65453f79 tempest-QuotasAdminTestJSON-590810396 tempest-QuotasAdminTestJSON-590810396-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:21.109693 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-189412c3-733b-422e-8889-c25d65453f79 tempest-QuotasAdminTestJSON-590810396 tempest-QuotasAdminTestJSON-590810396-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:21.109693 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-189412c3-733b-422e-8889-c25d65453f79 tempest-QuotasAdminTestJSON-590810396 tempest-QuotasAdminTestJSON-590810396-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:21.109693 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-189412c3-733b-422e-8889-c25d65453f79 tempest-QuotasAdminTestJSON-590810396 tempest-QuotasAdminTestJSON-590810396-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:21.109693 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-189412c3-733b-422e-8889-c25d65453f79 tempest-QuotasAdminTestJSON-590810396 tempest-QuotasAdminTestJSON-590810396-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:21.110200 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-189412c3-733b-422e-8889-c25d65453f79 tempest-QuotasAdminTestJSON-590810396 tempest-QuotasAdminTestJSON-590810396-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:21.196501 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-40f48a46-3a10-47bf-b232-249606fca840 tempest-ServersAdminNegativeTestJSON-609839287 tempest-ServersAdminNegativeTestJSON-609839287-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:21.197675 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-40f48a46-3a10-47bf-b232-249606fca840 tempest-ServersAdminNegativeTestJSON-609839287 tempest-ServersAdminNegativeTestJSON-609839287-project-admin] [instance: b09cd1e3-a561-47b1-9276-fdc378c475fc] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:21.205840 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-40f48a46-3a10-47bf-b232-249606fca840 tempest-ServersAdminNegativeTestJSON-609839287 tempest-ServersAdminNegativeTestJSON-609839287-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:21.206646 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-40f48a46-3a10-47bf-b232-249606fca840 tempest-ServersAdminNegativeTestJSON-609839287 tempest-ServersAdminNegativeTestJSON-609839287-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:21.207261 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-40f48a46-3a10-47bf-b232-249606fca840 tempest-ServersAdminNegativeTestJSON-609839287 tempest-ServersAdminNegativeTestJSON-609839287-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:21.208153 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-40f48a46-3a10-47bf-b232-249606fca840 tempest-ServersAdminNegativeTestJSON-609839287 tempest-ServersAdminNegativeTestJSON-609839287-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:21.208767 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-40f48a46-3a10-47bf-b232-249606fca840 tempest-ServersAdminNegativeTestJSON-609839287 tempest-ServersAdminNegativeTestJSON-609839287-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:21.209353 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-40f48a46-3a10-47bf-b232-249606fca840 tempest-ServersAdminNegativeTestJSON-609839287 tempest-ServersAdminNegativeTestJSON-609839287-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:21.337205 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-40f48a46-3a10-47bf-b232-249606fca840 tempest-ServersAdminNegativeTestJSON-609839287 tempest-ServersAdminNegativeTestJSON-609839287-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/b09cd1e3-a561-47b1-9276-fdc378c475fc" status: 200 len: 1613 microversion: 2.1 time: 0.141010 Sep 23 04:32:21.337205 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 241/440] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:32:21 2022] GET /compute/v2.1/servers/b09cd1e3-a561-47b1-9276-fdc378c475fc => generated 1613 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:21.355949 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-36799e4e-218d-4256-9e83-8a7b37cbd2eb tempest-ServersAdminNegativeTestJSON-609839287 tempest-ServersAdminNegativeTestJSON-609839287-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:32:21.356510 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-36799e4e-218d-4256-9e83-8a7b37cbd2eb tempest-ServersAdminNegativeTestJSON-609839287 tempest-ServersAdminNegativeTestJSON-609839287-project-admin] [instance: b09cd1e3-a561-47b1-9276-fdc378c475fc] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:21.363009 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-36799e4e-218d-4256-9e83-8a7b37cbd2eb tempest-ServersAdminNegativeTestJSON-609839287 tempest-ServersAdminNegativeTestJSON-609839287-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:21.363527 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-36799e4e-218d-4256-9e83-8a7b37cbd2eb tempest-ServersAdminNegativeTestJSON-609839287 tempest-ServersAdminNegativeTestJSON-609839287-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:21.363961 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-36799e4e-218d-4256-9e83-8a7b37cbd2eb tempest-ServersAdminNegativeTestJSON-609839287 tempest-ServersAdminNegativeTestJSON-609839287-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:21.364932 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-36799e4e-218d-4256-9e83-8a7b37cbd2eb tempest-ServersAdminNegativeTestJSON-609839287 tempest-ServersAdminNegativeTestJSON-609839287-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:21.365388 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-36799e4e-218d-4256-9e83-8a7b37cbd2eb tempest-ServersAdminNegativeTestJSON-609839287 tempest-ServersAdminNegativeTestJSON-609839287-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:21.365812 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-36799e4e-218d-4256-9e83-8a7b37cbd2eb tempest-ServersAdminNegativeTestJSON-609839287 tempest-ServersAdminNegativeTestJSON-609839287-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:21.439955 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-189412c3-733b-422e-8889-c25d65453f79 tempest-QuotasAdminTestJSON-590810396 tempest-QuotasAdminTestJSON-590810396-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/c46cb5f54fdb4503bf1cd7f1c2a70981" status: 200 len: 328 microversion: 2.1 time: 0.864060 Sep 23 04:32:21.442428 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 200/441] 10.222.0.33 () {60 vars in 1262 bytes} [Fri Sep 23 04:32:20 2022] PUT /compute/v2.1/os-quota-sets/c46cb5f54fdb4503bf1cd7f1c2a70981 => generated 328 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:32:21.451665 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9ac379b8-dee8-4518-831d-fc6c7e54fa4f tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:21.453831 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-9ac379b8-dee8-4518-831d-fc6c7e54fa4f tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] [instance: 074ac5a1-94af-4e9d-b458-107710ca0972] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:21.458128 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-36799e4e-218d-4256-9e83-8a7b37cbd2eb tempest-ServersAdminNegativeTestJSON-609839287 tempest-ServersAdminNegativeTestJSON-609839287-project-admin] HTTP exception thrown: Cannot 'migrate' instance b09cd1e3-a561-47b1-9276-fdc378c475fc while it is in vm_state suspended Sep 23 04:32:21.458763 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-36799e4e-218d-4256-9e83-8a7b37cbd2eb tempest-ServersAdminNegativeTestJSON-609839287 tempest-ServersAdminNegativeTestJSON-609839287-project-admin] Request method failure captured: Sep 23 04:32:21.458763 n-d-846463-3 devstack@n-api.service[122699]: request: POST /compute/v2.1/servers/b09cd1e3-a561-47b1-9276-fdc378c475fc/action HTTP/1.1 Sep 23 04:32:21.458763 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:32:21.458763 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:32:21.458763 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:32:21.458763 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 15 Sep 23 04:32:21.458763 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:32:21.458763 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:32:21.458763 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:32:21.458763 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:32:21.458763 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTaqvXdqw74382SxtAF02y7wVqfnlYcueFkovkv1cEgNfx8EVyrD_zGc3KpK1PFBY15axzL2p5o6fHzYmcaPrfof8pgbYejg3RN7Z_hoaT_tJolDuQLHoncWlIOw77TiO29ioCcJFYAsSIrV6zHC-VPlRqN_nALC_8i1bNbICXVhdNE Sep 23 04:32:21.458763 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:32:21.458763 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:32:21.458763 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:32:21.458763 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:32:21.458763 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:32:21.458763 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:32:21.458763 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 781acc8678e24264ba3f17a2b92c243a Sep 23 04:32:21.458763 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-609839287 Sep 23 04:32:21.458763 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,admin,member Sep 23 04:32:21.458763 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,admin,member Sep 23 04:32:21.460242 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_781acc8678e24264ba3f17a2b92c243a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/781acc8678e24264ba3f17a2b92c243a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/781acc8678e24264ba3f17a2b92c243a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/781acc8678e24264ba3f17a2b92c243a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:32:21.460242 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ServersAdminNegativeTestJSON-609839287 Sep 23 04:32:21.460242 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 781acc8678e24264ba3f17a2b92c243a Sep 23 04:32:21.460242 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-609839287 Sep 23 04:32:21.460242 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ServersAdminNegativeTestJSON-609839287-project-admin Sep 23 04:32:21.460242 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:32:21.460242 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:32:21.460242 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: a79acec9c9184778a28c138fac26167e Sep 23 04:32:21.460242 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ServersAdminNegativeTestJSON-609839287-project-admin Sep 23 04:32:21.460242 n-d-846463-3 devstack@n-api.service[122699]: Sep 23 04:32:21.460242 n-d-846463-3 devstack@n-api.service[122699]: {"migrate": {}} Sep 23 04:32:21.460242 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:32:21.460242 n-d-846463-3 devstack@n-api.service[122699]: exception: Cannot 'migrate' instance b09cd1e3-a561-47b1-9276-fdc378c475fc while it is in vm_state suspended Sep 23 04:32:21.460998 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': 'b09cd1e3-a561-47b1-9276-fdc378c475fc', 'body': {'migrate': {}}} Sep 23 04:32:21.460998 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:32:21.460998 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:32:21.460998 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Sep 23 04:32:21.460998 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Sep 23 04:32:21.460998 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 23 04:32:21.460998 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 23 04:32:21.460998 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 23 04:32:21.460998 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 23 04:32:21.460998 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 23 04:32:21.460998 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 23 04:32:21.460998 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 23 04:32:21.460998 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 23 04:32:21.460998 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 23 04:32:21.460998 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 23 04:32:21.460998 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b09cd1e3-a561-47b1-9276-fdc378c475fc in vm_state suspended. Cannot resize while the instance is in this state. Sep 23 04:32:21.460998 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:32:21.460998 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:32:21.460998 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:32:21.460998 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:32:21.462141 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:32:21.462141 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:32:21.462141 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:32:21.462141 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:32:21.462141 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:32:21.462141 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:32:21.462141 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:32:21.462141 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:32:21.462141 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Sep 23 04:32:21.462141 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 23 04:32:21.462141 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 23 04:32:21.462141 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 23 04:32:21.462141 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance b09cd1e3-a561-47b1-9276-fdc378c475fc while it is in vm_state suspended Sep 23 04:32:21.462141 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:32:21.462141 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:32:21.462141 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:32:21.462141 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:32:21.462141 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:32:21.462141 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:32:21.463261 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:32:21.463261 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:32:21.463261 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance b09cd1e3-a561-47b1-9276-fdc378c475fc while it is in vm_state suspended Sep 23 04:32:21.463261 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:32:21.463261 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-36799e4e-218d-4256-9e83-8a7b37cbd2eb tempest-ServersAdminNegativeTestJSON-609839287 tempest-ServersAdminNegativeTestJSON-609839287-project-admin] Returning 409 to user: Cannot 'migrate' instance b09cd1e3-a561-47b1-9276-fdc378c475fc while it is in vm_state suspended {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:32:21.463261 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-36799e4e-218d-4256-9e83-8a7b37cbd2eb tempest-ServersAdminNegativeTestJSON-609839287 tempest-ServersAdminNegativeTestJSON-609839287-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/b09cd1e3-a561-47b1-9276-fdc378c475fc/action" status: 409 len: 148 microversion: 2.1 time: 0.107942 Sep 23 04:32:21.463261 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 242/442] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:32:21 2022] POST /compute/v2.1/servers/b09cd1e3-a561-47b1-9276-fdc378c475fc/action => generated 148 bytes in 109 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 23 04:32:21.469498 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9ac379b8-dee8-4518-831d-fc6c7e54fa4f tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:21.470084 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9ac379b8-dee8-4518-831d-fc6c7e54fa4f tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:21.470574 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9ac379b8-dee8-4518-831d-fc6c7e54fa4f tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:21.471345 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9ac379b8-dee8-4518-831d-fc6c7e54fa4f tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:21.471473 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5b506c21-a4a0-48a2-a253-ea9619840264 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:21.471859 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9ac379b8-dee8-4518-831d-fc6c7e54fa4f tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:21.472285 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9ac379b8-dee8-4518-831d-fc6c7e54fa4f tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:21.472693 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-5b506c21-a4a0-48a2-a253-ea9619840264 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 9d255ae7-0aed-4692-8802-6733dfcccbd0] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:21.479508 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5b506c21-a4a0-48a2-a253-ea9619840264 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:21.479996 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5b506c21-a4a0-48a2-a253-ea9619840264 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:21.480429 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5b506c21-a4a0-48a2-a253-ea9619840264 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:21.481148 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5b506c21-a4a0-48a2-a253-ea9619840264 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:21.481720 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5b506c21-a4a0-48a2-a253-ea9619840264 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:21.482167 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5b506c21-a4a0-48a2-a253-ea9619840264 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:21.495690 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:32:21.503633 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-9ac379b8-dee8-4518-831d-fc6c7e54fa4f tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] [instance: 074ac5a1-94af-4e9d-b458-107710ca0972] Going to try to terminate instance {{(pid=122698) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:32:21.628182 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-5b506c21-a4a0-48a2-a253-ea9619840264 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:21.636519 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-5b506c21-a4a0-48a2-a253-ea9619840264 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:21.638122 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-5b506c21-a4a0-48a2-a253-ea9619840264 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:21.639179 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5b506c21-a4a0-48a2-a253-ea9619840264 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/9d255ae7-0aed-4692-8802-6733dfcccbd0" status: 200 len: 1362 microversion: 2.25 time: 0.177154 Sep 23 04:32:21.639725 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 243/443] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:32:21 2022] GET /compute/v2.1/servers/9d255ae7-0aed-4692-8802-6733dfcccbd0 => generated 1362 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:32:21.644637 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d7d2fed7-6547-488c-8b5f-b870fa1ea50f tempest-QuotasAdminTestJSON-590810396 tempest-QuotasAdminTestJSON-590810396-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:21.650021 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=12,nova_api:INSERT=4 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:32:21.734954 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d7d2fed7-6547-488c-8b5f-b870fa1ea50f tempest-QuotasAdminTestJSON-590810396 tempest-QuotasAdminTestJSON-590810396-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-quota-sets/c46cb5f54fdb4503bf1cd7f1c2a70981" status: 202 len: 0 microversion: 2.1 time: 0.093985 Sep 23 04:32:21.735563 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 244/444] 10.222.0.33 () {58 vars in 1245 bytes} [Fri Sep 23 04:32:21 2022] DELETE /compute/v2.1/os-quota-sets/c46cb5f54fdb4503bf1cd7f1c2a70981 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:32:21.740728 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-532ebeb3-2276-459a-b3af-6179a33609b7 tempest-ServersAdminNegativeTestJSON-609839287 tempest-ServersAdminNegativeTestJSON-609839287-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:32:21.761707 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-532ebeb3-2276-459a-b3af-6179a33609b7 tempest-ServersAdminNegativeTestJSON-609839287 tempest-ServersAdminNegativeTestJSON-609839287-project-admin] Request method failure captured: Sep 23 04:32:21.761707 n-d-846463-3 devstack@n-api.service[122699]: request: POST /compute/v2.1/servers/ed83bf5a-f3ce-4b5c-af6f-92b80599a022/action HTTP/1.1 Sep 23 04:32:21.761707 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:32:21.761707 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:32:21.761707 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:32:21.761707 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 39 Sep 23 04:32:21.761707 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:32:21.761707 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:32:21.761707 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:32:21.761707 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:32:21.761707 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTaqvXdqw74382SxtAF02y7wVqfnlYcueFkovkv1cEgNfx8EVyrD_zGc3KpK1PFBY15axzL2p5o6fHzYmcaPrfof8pgbYejg3RN7Z_hoaT_tJolDuQLHoncWlIOw77TiO29ioCcJFYAsSIrV6zHC-VPlRqN_nALC_8i1bNbICXVhdNE Sep 23 04:32:21.761707 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:32:21.761707 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:32:21.761707 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:32:21.761707 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:32:21.761707 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:32:21.761707 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:32:21.761707 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 781acc8678e24264ba3f17a2b92c243a Sep 23 04:32:21.761707 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-609839287 Sep 23 04:32:21.761707 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,admin,member Sep 23 04:32:21.761707 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,admin,member Sep 23 04:32:21.763211 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_781acc8678e24264ba3f17a2b92c243a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/781acc8678e24264ba3f17a2b92c243a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/781acc8678e24264ba3f17a2b92c243a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/781acc8678e24264ba3f17a2b92c243a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:32:21.763211 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ServersAdminNegativeTestJSON-609839287 Sep 23 04:32:21.763211 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 781acc8678e24264ba3f17a2b92c243a Sep 23 04:32:21.763211 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-609839287 Sep 23 04:32:21.763211 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ServersAdminNegativeTestJSON-609839287-project-admin Sep 23 04:32:21.763211 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:32:21.763211 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:32:21.763211 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: a79acec9c9184778a28c138fac26167e Sep 23 04:32:21.763211 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ServersAdminNegativeTestJSON-609839287-project-admin Sep 23 04:32:21.763211 n-d-846463-3 devstack@n-api.service[122699]: Sep 23 04:32:21.763211 n-d-846463-3 devstack@n-api.service[122699]: {"os-resetState": {"state": "invalid"}} Sep 23 04:32:21.763211 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:32:21.764032 n-d-846463-3 devstack@n-api.service[122699]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Sep 23 04:32:21.764032 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': 'ed83bf5a-f3ce-4b5c-af6f-92b80599a022', 'body': {'os-resetState': {'state': 'invalid'}}} Sep 23 04:32:21.764032 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:32:21.764032 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:32:21.764032 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 23 04:32:21.764032 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 23 04:32:21.764032 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 23 04:32:21.764032 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise error Sep 23 04:32:21.764032 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Sep 23 04:32:21.764032 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:32:21.764032 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Sep 23 04:32:21.764032 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Sep 23 04:32:21.764032 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:32:21.764032 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Sep 23 04:32:21.764032 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi 'invalid' Sep 23 04:32:21.764032 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:32:21.764032 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:32:21.764032 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:32:21.764032 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:32:21.764032 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:32:21.764032 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:32:21.764032 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:32:21.765521 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:32:21.765521 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:32:21.765521 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:32:21.765521 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 23 04:32:21.765521 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 23 04:32:21.765521 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 23 04:32:21.765521 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 23 04:32:21.765521 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 23 04:32:21.765521 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 23 04:32:21.765521 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Sep 23 04:32:21.765521 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:32:21.765521 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:32:21.765521 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:32:21.765521 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:32:21.765521 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:32:21.765521 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:32:21.765521 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 23 04:32:21.765521 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 23 04:32:21.765521 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Sep 23 04:32:21.767024 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:32:21.768113 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-532ebeb3-2276-459a-b3af-6179a33609b7 tempest-ServersAdminNegativeTestJSON-609839287 tempest-ServersAdminNegativeTestJSON-609839287-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:32:21.769069 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-532ebeb3-2276-459a-b3af-6179a33609b7 tempest-ServersAdminNegativeTestJSON-609839287 tempest-ServersAdminNegativeTestJSON-609839287-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/ed83bf5a-f3ce-4b5c-af6f-92b80599a022/action" status: 400 len: 144 microversion: 2.1 time: 0.031804 Sep 23 04:32:21.770529 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 245/445] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:32:21 2022] POST /compute/v2.1/servers/ed83bf5a-f3ce-4b5c-af6f-92b80599a022/action => generated 144 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 04:32:21.776056 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ddc702a4-dbfd-4032-8e8f-18cab2db0024 tempest-QuotasAdminTestJSON-590810396 tempest-QuotasAdminTestJSON-590810396-project-admin] Calling method '.version_select at 0x7ff1c02339d0>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:21.855884 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9ac379b8-dee8-4518-831d-fc6c7e54fa4f tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] 10.222.0.33 "DELETE /compute/v2.1/servers/074ac5a1-94af-4e9d-b458-107710ca0972" status: 204 len: 0 microversion: 2.1 time: 0.411936 Sep 23 04:32:21.856618 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 201/446] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:32:21 2022] DELETE /compute/v2.1/servers/074ac5a1-94af-4e9d-b458-107710ca0972 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:32:21.865748 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d389d0bf-b316-45d4-acf8-0a26de96760c tempest-ServersAdminNegativeTestJSON-609839287 tempest-ServersAdminNegativeTestJSON-609839287-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:32:21.870642 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d389d0bf-b316-45d4-acf8-0a26de96760c tempest-ServersAdminNegativeTestJSON-609839287 tempest-ServersAdminNegativeTestJSON-609839287-project-admin] Request method failure captured: Sep 23 04:32:21.870642 n-d-846463-3 devstack@n-api.service[122698]: request: POST /compute/v2.1/servers/ed83bf5a-f3ce-4b5c-af6f-92b80599a022/action HTTP/1.1 Sep 23 04:32:21.870642 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:32:21.870642 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:32:21.870642 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:32:21.870642 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 31 Sep 23 04:32:21.870642 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:32:21.870642 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:32:21.870642 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:32:21.870642 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:32:21.870642 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTaqvXdqw74382SxtAF02y7wVqfnlYcueFkovkv1cEgNfx8EVyrD_zGc3KpK1PFBY15axzL2p5o6fHzYmcaPrfof8pgbYejg3RN7Z_hoaT_tJolDuQLHoncWlIOw77TiO29ioCcJFYAsSIrV6zHC-VPlRqN_nALC_8i1bNbICXVhdNE Sep 23 04:32:21.870642 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:32:21.870642 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:32:21.870642 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:32:21.870642 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:32:21.870642 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:32:21.870642 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:32:21.870642 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 781acc8678e24264ba3f17a2b92c243a Sep 23 04:32:21.870642 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-609839287 Sep 23 04:32:21.870642 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,admin,member Sep 23 04:32:21.870642 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,admin,member Sep 23 04:32:21.872126 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_781acc8678e24264ba3f17a2b92c243a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/781acc8678e24264ba3f17a2b92c243a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/781acc8678e24264ba3f17a2b92c243a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/781acc8678e24264ba3f17a2b92c243a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:32:21.872126 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ServersAdminNegativeTestJSON-609839287 Sep 23 04:32:21.872126 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 781acc8678e24264ba3f17a2b92c243a Sep 23 04:32:21.872126 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-609839287 Sep 23 04:32:21.872126 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ServersAdminNegativeTestJSON-609839287-project-admin Sep 23 04:32:21.872126 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:32:21.872126 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:32:21.872126 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: a79acec9c9184778a28c138fac26167e Sep 23 04:32:21.872126 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ServersAdminNegativeTestJSON-609839287-project-admin Sep 23 04:32:21.872126 n-d-846463-3 devstack@n-api.service[122698]: Sep 23 04:32:21.872126 n-d-846463-3 devstack@n-api.service[122698]: {"os-resetState": {"state": 1}} Sep 23 04:32:21.872126 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:32:21.872126 n-d-846463-3 devstack@n-api.service[122698]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Sep 23 04:32:21.872928 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': 'ed83bf5a-f3ce-4b5c-af6f-92b80599a022', 'body': {'os-resetState': {'state': 1}}} Sep 23 04:32:21.872928 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:32:21.872928 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:32:21.872928 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 23 04:32:21.872928 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 23 04:32:21.872928 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 23 04:32:21.872928 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise error Sep 23 04:32:21.872928 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Sep 23 04:32:21.872928 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:32:21.872928 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Sep 23 04:32:21.872928 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Sep 23 04:32:21.872928 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:32:21.872928 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Sep 23 04:32:21.872928 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi 1 Sep 23 04:32:21.872928 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:32:21.872928 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:32:21.872928 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:32:21.872928 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:32:21.872928 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:32:21.872928 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:32:21.872928 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:32:21.872928 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:32:21.874390 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:32:21.874390 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:32:21.874390 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 23 04:32:21.874390 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 23 04:32:21.874390 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 23 04:32:21.874390 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 23 04:32:21.874390 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 23 04:32:21.874390 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 23 04:32:21.874390 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Sep 23 04:32:21.874390 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:32:21.874390 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:32:21.874390 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:32:21.874390 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:32:21.874390 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:32:21.874390 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:32:21.874390 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 23 04:32:21.874390 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 23 04:32:21.874390 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Sep 23 04:32:21.874390 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:32:21.876314 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d389d0bf-b316-45d4-acf8-0a26de96760c tempest-ServersAdminNegativeTestJSON-609839287 tempest-ServersAdminNegativeTestJSON-609839287-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:32:21.876314 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d389d0bf-b316-45d4-acf8-0a26de96760c tempest-ServersAdminNegativeTestJSON-609839287 tempest-ServersAdminNegativeTestJSON-609839287-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/ed83bf5a-f3ce-4b5c-af6f-92b80599a022/action" status: 400 len: 120 microversion: 2.1 time: 0.015140 Sep 23 04:32:21.876314 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 202/447] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:32:21 2022] POST /compute/v2.1/servers/ed83bf5a-f3ce-4b5c-af6f-92b80599a022/action => generated 120 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 04:32:21.885261 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-65c322b9-b34a-40b8-8edb-4e4e48109f3f tempest-ServersAdminNegativeTestJSON-609839287 tempest-ServersAdminNegativeTestJSON-609839287-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:32:21.890767 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-65c322b9-b34a-40b8-8edb-4e4e48109f3f tempest-ServersAdminNegativeTestJSON-609839287 tempest-ServersAdminNegativeTestJSON-609839287-project-admin] Failed to fetch instance by id 999 {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 23 04:32:21.894215 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-65c322b9-b34a-40b8-8edb-4e4e48109f3f tempest-ServersAdminNegativeTestJSON-609839287 tempest-ServersAdminNegativeTestJSON-609839287-project-admin] HTTP exception thrown: Instance 999 could not be found. Sep 23 04:32:21.895218 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-65c322b9-b34a-40b8-8edb-4e4e48109f3f tempest-ServersAdminNegativeTestJSON-609839287 tempest-ServersAdminNegativeTestJSON-609839287-project-admin] Request method failure captured: Sep 23 04:32:21.895218 n-d-846463-3 devstack@n-api.service[122698]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Sep 23 04:32:21.895218 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:32:21.895218 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:32:21.895218 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:32:21.895218 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 37 Sep 23 04:32:21.895218 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:32:21.895218 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:32:21.895218 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:32:21.895218 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:32:21.895218 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTaqvXdqw74382SxtAF02y7wVqfnlYcueFkovkv1cEgNfx8EVyrD_zGc3KpK1PFBY15axzL2p5o6fHzYmcaPrfof8pgbYejg3RN7Z_hoaT_tJolDuQLHoncWlIOw77TiO29ioCcJFYAsSIrV6zHC-VPlRqN_nALC_8i1bNbICXVhdNE Sep 23 04:32:21.895218 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:32:21.895218 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:32:21.895218 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:32:21.895218 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:32:21.895218 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:32:21.895218 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:32:21.895218 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 781acc8678e24264ba3f17a2b92c243a Sep 23 04:32:21.895218 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-609839287 Sep 23 04:32:21.895218 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,admin,member Sep 23 04:32:21.895218 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,admin,member Sep 23 04:32:21.897214 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_781acc8678e24264ba3f17a2b92c243a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/781acc8678e24264ba3f17a2b92c243a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/781acc8678e24264ba3f17a2b92c243a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/781acc8678e24264ba3f17a2b92c243a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:32:21.897214 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ServersAdminNegativeTestJSON-609839287 Sep 23 04:32:21.897214 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 781acc8678e24264ba3f17a2b92c243a Sep 23 04:32:21.897214 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-609839287 Sep 23 04:32:21.897214 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ServersAdminNegativeTestJSON-609839287-project-admin Sep 23 04:32:21.897214 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:32:21.897214 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:32:21.897214 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: a79acec9c9184778a28c138fac26167e Sep 23 04:32:21.897214 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ServersAdminNegativeTestJSON-609839287-project-admin Sep 23 04:32:21.897214 n-d-846463-3 devstack@n-api.service[122698]: Sep 23 04:32:21.897214 n-d-846463-3 devstack@n-api.service[122698]: {"os-resetState": {"state": "error"}} Sep 23 04:32:21.897214 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:32:21.897214 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 999 could not be found. Sep 23 04:32:21.898036 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Sep 23 04:32:21.898036 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:32:21.898036 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:32:21.898036 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:32:21.898036 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:32:21.898036 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 23 04:32:21.898036 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 23 04:32:21.898036 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Sep 23 04:32:21.898036 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:32:21.898036 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:32:21.898036 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:32:21.898036 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:32:21.898036 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:32:21.898036 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:32:21.898036 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:32:21.898036 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:32:21.898036 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:32:21.898036 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:32:21.898036 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:32:21.898036 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:32:21.898036 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Sep 23 04:32:21.899198 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 23 04:32:21.899198 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:32:21.899198 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:32:21.899198 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Sep 23 04:32:21.899198 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:32:21.899198 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:32:21.899198 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:32:21.899198 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:32:21.899198 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:32:21.899198 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:32:21.899198 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:32:21.899198 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:32:21.899198 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Sep 23 04:32:21.899198 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:32:21.899198 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-65c322b9-b34a-40b8-8edb-4e4e48109f3f tempest-ServersAdminNegativeTestJSON-609839287 tempest-ServersAdminNegativeTestJSON-609839287-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:32:21.899198 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-65c322b9-b34a-40b8-8edb-4e4e48109f3f tempest-ServersAdminNegativeTestJSON-609839287 tempest-ServersAdminNegativeTestJSON-609839287-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.015483 Sep 23 04:32:21.900160 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 203/448] 10.222.0.33 () {60 vars in 1179 bytes} [Fri Sep 23 04:32:21 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 23 04:32:21.906873 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c292c9a2-71dc-4f2f-9a0b-4f5aacf6b7ee tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:21.908076 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c292c9a2-71dc-4f2f-9a0b-4f5aacf6b7ee tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] [instance: b09cd1e3-a561-47b1-9276-fdc378c475fc] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:21.914668 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c292c9a2-71dc-4f2f-9a0b-4f5aacf6b7ee tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:21.915163 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c292c9a2-71dc-4f2f-9a0b-4f5aacf6b7ee tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:21.915619 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c292c9a2-71dc-4f2f-9a0b-4f5aacf6b7ee tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:21.916503 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c292c9a2-71dc-4f2f-9a0b-4f5aacf6b7ee tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:21.917094 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c292c9a2-71dc-4f2f-9a0b-4f5aacf6b7ee tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:21.917523 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c292c9a2-71dc-4f2f-9a0b-4f5aacf6b7ee tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:21.943663 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c292c9a2-71dc-4f2f-9a0b-4f5aacf6b7ee tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] [instance: b09cd1e3-a561-47b1-9276-fdc378c475fc] Going to try to terminate instance {{(pid=122698) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:32:22.276745 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c292c9a2-71dc-4f2f-9a0b-4f5aacf6b7ee tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b09cd1e3-a561-47b1-9276-fdc378c475fc" status: 204 len: 0 microversion: 2.1 time: 0.373324 Sep 23 04:32:22.277342 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 204/449] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:32:21 2022] DELETE /compute/v2.1/servers/b09cd1e3-a561-47b1-9276-fdc378c475fc => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:32:22.285589 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-38ce0826-facc-4e3c-8a89-918ee60adb2c tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1433765231", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "1110633300", "adminPass": "***", "networks": [{"uuid": "925b67df-b828-4400-a5a9-c03e0e7996fc"}], "security_groups": [{"name": "tempest-securitygroup--938214951"}], "key_name": "tempest-keypair-587713181", "user_data": "}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:32:22.421273 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.network.neutron [None req-38ce0826-facc-4e3c-8a89-918ee60adb2c tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] validate_networks() for [('925b67df-b828-4400-a5a9-c03e0e7996fc', None, None, None, None, None)] {{(pid=122698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:32:22.480882 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ddc702a4-dbfd-4032-8e8f-18cab2db0024 tempest-QuotasAdminTestJSON-590810396 tempest-QuotasAdminTestJSON-590810396-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/c46cb5f54fdb4503bf1cd7f1c2a70981" status: 200 len: 371 microversion: 2.1 time: 0.709097 Sep 23 04:32:22.489448 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 246/450] 10.222.0.33 () {58 vars in 1242 bytes} [Fri Sep 23 04:32:21 2022] GET /compute/v2.1/os-quota-sets/c46cb5f54fdb4503bf1cd7f1c2a70981 => generated 371 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:32:22.494627 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ed59e385-173f-44f3-ad35-c60231ace8fb tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:22.495433 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ed59e385-173f-44f3-ad35-c60231ace8fb tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] [instance: b09cd1e3-a561-47b1-9276-fdc378c475fc] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:22.502861 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ed59e385-173f-44f3-ad35-c60231ace8fb tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:22.503595 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ed59e385-173f-44f3-ad35-c60231ace8fb tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:22.504256 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ed59e385-173f-44f3-ad35-c60231ace8fb tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:22.505178 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ed59e385-173f-44f3-ad35-c60231ace8fb tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:22.505834 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ed59e385-173f-44f3-ad35-c60231ace8fb tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:22.506493 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ed59e385-173f-44f3-ad35-c60231ace8fb tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:22.722504 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ed59e385-173f-44f3-ad35-c60231ace8fb tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54d1a7a9e4ee44b9992ff9362108b311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649eb80e1ea849868c651849047833e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:22.733423 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ed59e385-173f-44f3-ad35-c60231ace8fb tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] 10.222.0.33 "GET /compute/v2.1/servers/b09cd1e3-a561-47b1-9276-fdc378c475fc" status: 200 len: 1468 microversion: 2.1 time: 0.242596 Sep 23 04:32:22.734546 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 247/451] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:32:22 2022] GET /compute/v2.1/servers/b09cd1e3-a561-47b1-9276-fdc378c475fc => generated 1468 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:22.739385 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c420c725-dadf-426b-b4e9-e23c52023bbc tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:22.740163 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c420c725-dadf-426b-b4e9-e23c52023bbc tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 9d255ae7-0aed-4692-8802-6733dfcccbd0] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:22.746381 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c420c725-dadf-426b-b4e9-e23c52023bbc tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:22.747040 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c420c725-dadf-426b-b4e9-e23c52023bbc tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:22.747636 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c420c725-dadf-426b-b4e9-e23c52023bbc tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:22.748475 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c420c725-dadf-426b-b4e9-e23c52023bbc tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:22.749081 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c420c725-dadf-426b-b4e9-e23c52023bbc tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:22.749675 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c420c725-dadf-426b-b4e9-e23c52023bbc tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:22.975639 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c420c725-dadf-426b-b4e9-e23c52023bbc tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:22.985022 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c420c725-dadf-426b-b4e9-e23c52023bbc tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:22.987643 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c420c725-dadf-426b-b4e9-e23c52023bbc tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:22.993207 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c420c725-dadf-426b-b4e9-e23c52023bbc tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/9d255ae7-0aed-4692-8802-6733dfcccbd0" status: 200 len: 1362 microversion: 2.25 time: 0.253039 Sep 23 04:32:22.993207 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 248/452] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:32:22 2022] GET /compute/v2.1/servers/9d255ae7-0aed-4692-8802-6733dfcccbd0 => generated 1362 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:32:22.993538 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-38ce0826-facc-4e3c-8a89-918ee60adb2c tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Flavor limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:32:22.994398 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-38ce0826-facc-4e3c-8a89-918ee60adb2c tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Image limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:32:22.994886 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-38ce0826-facc-4e3c-8a89-918ee60adb2c tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Flavor pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:32:22.995298 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-38ce0826-facc-4e3c-8a89-918ee60adb2c tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Image pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:32:22.995873 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-38ce0826-facc-4e3c-8a89-918ee60adb2c tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:32:23.005572 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-38ce0826-facc-4e3c-8a89-918ee60adb2c tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:23.006304 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-38ce0826-facc-4e3c-8a89-918ee60adb2c tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:23.006937 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-38ce0826-facc-4e3c-8a89-918ee60adb2c tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:23.007670 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-38ce0826-facc-4e3c-8a89-918ee60adb2c tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:23.008300 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-38ce0826-facc-4e3c-8a89-918ee60adb2c tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:23.008901 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-38ce0826-facc-4e3c-8a89-918ee60adb2c tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:23.026529 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-38ce0826-facc-4e3c-8a89-918ee60adb2c tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Getting quotas for project 98c7c21aa6b342b6bc52365cfdeb7c7b. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:32:23.031556 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-38ce0826-facc-4e3c-8a89-918ee60adb2c tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Getting quotas for user ffcc413bf53847b89cfe6bdf48909ea0 and project 98c7c21aa6b342b6bc52365cfdeb7c7b. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:32:23.043865 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-38ce0826-facc-4e3c-8a89-918ee60adb2c tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Going to run 1 instances... {{(pid=122698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:32:23.046516 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-38ce0826-facc-4e3c-8a89-918ee60adb2c tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] [instance: 699f43b8-e784-4553-836c-e8785632d903] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=122698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:32:23.155107 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-38ce0826-facc-4e3c-8a89-918ee60adb2c tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.876064 Sep 23 04:32:23.155690 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 205/453] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:32:22 2022] POST /compute/v2.1/servers => generated 401 bytes in 878 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:32:23.167178 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b747b4d3-bfdb-480e-8cd5-2341f7176551 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:23.168017 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b747b4d3-bfdb-480e-8cd5-2341f7176551 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] [instance: 699f43b8-e784-4553-836c-e8785632d903] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:23.230554 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b747b4d3-bfdb-480e-8cd5-2341f7176551 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcc413bf53847b89cfe6bdf48909ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c7c21aa6b342b6bc52365cfdeb7c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:23.239442 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b747b4d3-bfdb-480e-8cd5-2341f7176551 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] 10.222.0.33 "GET /compute/v2.1/servers/699f43b8-e784-4553-836c-e8785632d903" status: 200 len: 1264 microversion: 2.1 time: 0.076021 Sep 23 04:32:23.240007 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 206/454] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:32:23 2022] GET /compute/v2.1/servers/699f43b8-e784-4553-836c-e8785632d903 => generated 1264 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:23.251385 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c203a253-4a84-4060-81f3-1d60b19e1ff4 tempest-QuotasAdminTestJSON-590810396 tempest-QuotasAdminTestJSON-590810396-project-admin] Calling method '.version_select at 0x7ff1c01c7d30>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:23.468973 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3742d54c-d28e-46de-8469-f79341087f63 tempest-QuotasAdminNegativeTest-744404737 tempest-QuotasAdminNegativeTest-744404737-project-admin] Calling method '.version_select at 0x7ff1c0233940>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:23.788713 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c203a253-4a84-4060-81f3-1d60b19e1ff4 tempest-QuotasAdminTestJSON-590810396 tempest-QuotasAdminTestJSON-590810396-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/59adedb6001d443cb8a761b94106d86b/defaults" status: 200 len: 371 microversion: 2.1 time: 0.541427 Sep 23 04:32:23.789343 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 207/455] 10.222.0.33 () {58 vars in 1269 bytes} [Fri Sep 23 04:32:23 2022] GET /compute/v2.1/os-quota-sets/59adedb6001d443cb8a761b94106d86b/defaults => generated 371 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:32:23.798136 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2f288e57-f2ca-45b7-860a-5d9f89c27151 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:23.802080 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-2f288e57-f2ca-45b7-860a-5d9f89c27151 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] [instance: b09cd1e3-a561-47b1-9276-fdc378c475fc] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:23.812441 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2f288e57-f2ca-45b7-860a-5d9f89c27151 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:23.814317 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2f288e57-f2ca-45b7-860a-5d9f89c27151 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:23.814317 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2f288e57-f2ca-45b7-860a-5d9f89c27151 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:23.815348 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2f288e57-f2ca-45b7-860a-5d9f89c27151 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:23.820265 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2f288e57-f2ca-45b7-860a-5d9f89c27151 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:23.825129 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2f288e57-f2ca-45b7-860a-5d9f89c27151 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:23.885495 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3742d54c-d28e-46de-8469-f79341087f63 tempest-QuotasAdminNegativeTest-744404737 tempest-QuotasAdminNegativeTest-744404737-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/1c4be6203d8e4908bc001f56d7c431fc" status: 200 len: 371 microversion: 2.1 time: 0.894388 Sep 23 04:32:23.886473 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 249/456] 10.222.0.33 () {58 vars in 1242 bytes} [Fri Sep 23 04:32:22 2022] GET /compute/v2.1/os-quota-sets/1c4be6203d8e4908bc001f56d7c431fc => generated 371 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:32:23.904520 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-34fb26c0-b487-4745-b67f-b43de583dee4 tempest-QuotasAdminNegativeTest-744404737 tempest-QuotasAdminNegativeTest-744404737-project-admin] Action: 'update', calling method: .version_select at 0x7ff1c03765e0>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:32:24.035732 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-2f288e57-f2ca-45b7-860a-5d9f89c27151 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54d1a7a9e4ee44b9992ff9362108b311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649eb80e1ea849868c651849047833e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:24.043632 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2f288e57-f2ca-45b7-860a-5d9f89c27151 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] 10.222.0.33 "GET /compute/v2.1/servers/b09cd1e3-a561-47b1-9276-fdc378c475fc" status: 200 len: 1468 microversion: 2.1 time: 0.253221 Sep 23 04:32:24.046151 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 208/457] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:32:23 2022] GET /compute/v2.1/servers/b09cd1e3-a561-47b1-9276-fdc378c475fc => generated 1468 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:24.276951 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-34fb26c0-b487-4745-b67f-b43de583dee4 tempest-QuotasAdminNegativeTest-744404737 tempest-QuotasAdminNegativeTest-744404737-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:24.277542 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-34fb26c0-b487-4745-b67f-b43de583dee4 tempest-QuotasAdminNegativeTest-744404737 tempest-QuotasAdminNegativeTest-744404737-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:24.278840 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-34fb26c0-b487-4745-b67f-b43de583dee4 tempest-QuotasAdminNegativeTest-744404737 tempest-QuotasAdminNegativeTest-744404737-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:24.280623 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-34fb26c0-b487-4745-b67f-b43de583dee4 tempest-QuotasAdminNegativeTest-744404737 tempest-QuotasAdminNegativeTest-744404737-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:24.281294 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-34fb26c0-b487-4745-b67f-b43de583dee4 tempest-QuotasAdminNegativeTest-744404737 tempest-QuotasAdminNegativeTest-744404737-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:24.281983 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-34fb26c0-b487-4745-b67f-b43de583dee4 tempest-QuotasAdminNegativeTest-744404737 tempest-QuotasAdminNegativeTest-744404737-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:24.463203 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-34fb26c0-b487-4745-b67f-b43de583dee4 tempest-QuotasAdminNegativeTest-744404737 tempest-QuotasAdminNegativeTest-744404737-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/1c4be6203d8e4908bc001f56d7c431fc" status: 200 len: 328 microversion: 2.1 time: 0.567431 Sep 23 04:32:24.469681 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 250/458] 10.222.0.33 () {60 vars in 1262 bytes} [Fri Sep 23 04:32:23 2022] PUT /compute/v2.1/os-quota-sets/1c4be6203d8e4908bc001f56d7c431fc => generated 328 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:32:24.483387 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-133418d2-3bba-478c-92d6-f950fc621e7d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:24.484606 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-133418d2-3bba-478c-92d6-f950fc621e7d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 9d255ae7-0aed-4692-8802-6733dfcccbd0] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:24.493120 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-10ee9e41-d18f-4c3d-bf82-38181d8d6b8f tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1595703846", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:32:24.519016 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-133418d2-3bba-478c-92d6-f950fc621e7d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:24.522213 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-133418d2-3bba-478c-92d6-f950fc621e7d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:24.522674 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-133418d2-3bba-478c-92d6-f950fc621e7d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:24.526889 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-133418d2-3bba-478c-92d6-f950fc621e7d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:24.527388 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-133418d2-3bba-478c-92d6-f950fc621e7d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:24.528796 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-133418d2-3bba-478c-92d6-f950fc621e7d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:24.599574 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.network.neutron [None req-10ee9e41-d18f-4c3d-bf82-38181d8d6b8f tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] validate_networks() for None {{(pid=122698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:32:24.828023 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-133418d2-3bba-478c-92d6-f950fc621e7d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:24.870779 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-133418d2-3bba-478c-92d6-f950fc621e7d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:24.870779 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-133418d2-3bba-478c-92d6-f950fc621e7d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:24.870779 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-133418d2-3bba-478c-92d6-f950fc621e7d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/9d255ae7-0aed-4692-8802-6733dfcccbd0" status: 200 len: 1362 microversion: 2.25 time: 0.399544 Sep 23 04:32:24.909137 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 251/459] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:32:24 2022] GET /compute/v2.1/servers/9d255ae7-0aed-4692-8802-6733dfcccbd0 => generated 1362 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:32:24.918923 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-00fd3323-5b8d-4d41-952e-a39ed22ffb3b tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:24.929730 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-00fd3323-5b8d-4d41-952e-a39ed22ffb3b tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] [instance: 699f43b8-e784-4553-836c-e8785632d903] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:24.935797 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-10ee9e41-d18f-4c3d-bf82-38181d8d6b8f tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Flavor limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:32:24.936187 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-10ee9e41-d18f-4c3d-bf82-38181d8d6b8f tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Image limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:32:24.936671 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-10ee9e41-d18f-4c3d-bf82-38181d8d6b8f tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Flavor pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:32:24.937078 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-10ee9e41-d18f-4c3d-bf82-38181d8d6b8f tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Image pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:32:24.937687 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-10ee9e41-d18f-4c3d-bf82-38181d8d6b8f tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:32:24.941929 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-00fd3323-5b8d-4d41-952e-a39ed22ffb3b tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:24.942640 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-00fd3323-5b8d-4d41-952e-a39ed22ffb3b tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:24.943250 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-00fd3323-5b8d-4d41-952e-a39ed22ffb3b tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:24.944210 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-00fd3323-5b8d-4d41-952e-a39ed22ffb3b tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:24.944835 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-00fd3323-5b8d-4d41-952e-a39ed22ffb3b tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:24.945535 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-00fd3323-5b8d-4d41-952e-a39ed22ffb3b tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:24.955505 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-10ee9e41-d18f-4c3d-bf82-38181d8d6b8f tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:24.956004 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-10ee9e41-d18f-4c3d-bf82-38181d8d6b8f tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:24.956444 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-10ee9e41-d18f-4c3d-bf82-38181d8d6b8f tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:24.957188 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-10ee9e41-d18f-4c3d-bf82-38181d8d6b8f tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:24.957648 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-10ee9e41-d18f-4c3d-bf82-38181d8d6b8f tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:24.962317 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-10ee9e41-d18f-4c3d-bf82-38181d8d6b8f tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:24.972597 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=100 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:32:25.002288 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-10ee9e41-d18f-4c3d-bf82-38181d8d6b8f tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Getting quotas for project 54abd267d3c043e09f26f486823907e2. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:32:25.018019 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-10ee9e41-d18f-4c3d-bf82-38181d8d6b8f tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Getting quotas for user 13f5a913548445a09377847fd78a10a1 and project 54abd267d3c043e09f26f486823907e2. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:32:25.036307 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-10ee9e41-d18f-4c3d-bf82-38181d8d6b8f tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Going to run 1 instances... {{(pid=122698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:32:25.039490 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-10ee9e41-d18f-4c3d-bf82-38181d8d6b8f tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: 0dff1738-81f1-4619-af74-44b7adc805b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:32:25.063640 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-00fd3323-5b8d-4d41-952e-a39ed22ffb3b tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcc413bf53847b89cfe6bdf48909ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c7c21aa6b342b6bc52365cfdeb7c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:25.101844 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-00fd3323-5b8d-4d41-952e-a39ed22ffb3b tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] 10.222.0.33 "GET /compute/v2.1/servers/699f43b8-e784-4553-836c-e8785632d903" status: 200 len: 1260 microversion: 2.1 time: 0.184985 Sep 23 04:32:25.102956 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 252/460] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:32:24 2022] GET /compute/v2.1/servers/699f43b8-e784-4553-836c-e8785632d903 => generated 1260 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:25.114308 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-981335bd-80db-4ab3-afc4-4658ff148edd tempest-QuotasAdminTestJSON-590810396 tempest-QuotasAdminTestJSON-590810396-project-admin] Action: 'update', calling method: .version_select at 0x7ff1c0376700>, body: {"quota_set": {"ram": "5120"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:32:25.260627 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-10ee9e41-d18f-4c3d-bf82-38181d8d6b8f tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.215133 Sep 23 04:32:25.266095 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 209/461] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:32:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1221 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:32:25.539574 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-981335bd-80db-4ab3-afc4-4658ff148edd tempest-QuotasAdminTestJSON-590810396 tempest-QuotasAdminTestJSON-590810396-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:25.541465 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-981335bd-80db-4ab3-afc4-4658ff148edd tempest-QuotasAdminTestJSON-590810396 tempest-QuotasAdminTestJSON-590810396-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:25.542396 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-981335bd-80db-4ab3-afc4-4658ff148edd tempest-QuotasAdminTestJSON-590810396 tempest-QuotasAdminTestJSON-590810396-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:25.543623 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-981335bd-80db-4ab3-afc4-4658ff148edd tempest-QuotasAdminTestJSON-590810396 tempest-QuotasAdminTestJSON-590810396-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:25.544503 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-981335bd-80db-4ab3-afc4-4658ff148edd tempest-QuotasAdminTestJSON-590810396 tempest-QuotasAdminTestJSON-590810396-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:25.545704 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-981335bd-80db-4ab3-afc4-4658ff148edd tempest-QuotasAdminTestJSON-590810396 tempest-QuotasAdminTestJSON-590810396-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:25.566863 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-91f8e90d-f37c-4bad-a908-a84094019693 tempest-FlavorsExtraSpecsTestJSON-1852929920 tempest-FlavorsExtraSpecsTestJSON-1852929920-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1738304526", "ram": 512, "vcpus": 1, "disk": 10, "id": 801008169, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:32:25.663842 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-91f8e90d-f37c-4bad-a908-a84094019693 tempest-FlavorsExtraSpecsTestJSON-1852929920 tempest-FlavorsExtraSpecsTestJSON-1852929920-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.394576 Sep 23 04:32:25.665560 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 210/462] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:32:25 2022] POST /compute/v2.1/flavors => generated 413 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:32:25.725220 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-981335bd-80db-4ab3-afc4-4658ff148edd tempest-QuotasAdminTestJSON-590810396 tempest-QuotasAdminTestJSON-590810396-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/7228329d9eb14532a2fac5d22e7e0ff0" status: 200 len: 328 microversion: 2.1 time: 0.621074 Sep 23 04:32:25.725848 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 253/463] 10.222.0.33 () {60 vars in 1262 bytes} [Fri Sep 23 04:32:25 2022] PUT /compute/v2.1/os-quota-sets/7228329d9eb14532a2fac5d22e7e0ff0 => generated 328 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:32:25.736577 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d05788ee-4615-4ef6-a06e-f7e7e9078a34 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:25.737437 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d05788ee-4615-4ef6-a06e-f7e7e9078a34 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] [instance: b09cd1e3-a561-47b1-9276-fdc378c475fc] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:25.746206 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d05788ee-4615-4ef6-a06e-f7e7e9078a34 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:25.750327 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d05788ee-4615-4ef6-a06e-f7e7e9078a34 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:25.753166 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d05788ee-4615-4ef6-a06e-f7e7e9078a34 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:25.754129 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d05788ee-4615-4ef6-a06e-f7e7e9078a34 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:25.754749 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d05788ee-4615-4ef6-a06e-f7e7e9078a34 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:25.755380 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d05788ee-4615-4ef6-a06e-f7e7e9078a34 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:25.804628 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-53e3bdb8-4703-4994-b4dc-35444d200c60 tempest-QuotasAdminNegativeTest-985991856 tempest-QuotasAdminNegativeTest-985991856-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1304606683", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:32:25.865722 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d05788ee-4615-4ef6-a06e-f7e7e9078a34 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54d1a7a9e4ee44b9992ff9362108b311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649eb80e1ea849868c651849047833e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:25.875749 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d05788ee-4615-4ef6-a06e-f7e7e9078a34 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] 10.222.0.33 "GET /compute/v2.1/servers/b09cd1e3-a561-47b1-9276-fdc378c475fc" status: 200 len: 1297 microversion: 2.1 time: 0.148607 Sep 23 04:32:25.878255 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 254/464] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:32:25 2022] GET /compute/v2.1/servers/b09cd1e3-a561-47b1-9276-fdc378c475fc => generated 1297 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:25.884004 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5c116b30-a9fc-4926-8ea7-70e5e3569795 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:25.884914 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-5c116b30-a9fc-4926-8ea7-70e5e3569795 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: 0dff1738-81f1-4619-af74-44b7adc805b5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:25.918973 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.network.neutron [None req-53e3bdb8-4703-4994-b4dc-35444d200c60 tempest-QuotasAdminNegativeTest-985991856 tempest-QuotasAdminNegativeTest-985991856-project] validate_networks() for None {{(pid=122698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:32:25.983052 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-5c116b30-a9fc-4926-8ea7-70e5e3569795 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:26.007712 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5c116b30-a9fc-4926-8ea7-70e5e3569795 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/0dff1738-81f1-4619-af74-44b7adc805b5" status: 200 len: 1213 microversion: 2.1 time: 0.110144 Sep 23 04:32:26.009730 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 255/465] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:32:25 2022] GET /compute/v2.1/servers/0dff1738-81f1-4619-af74-44b7adc805b5 => generated 1213 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:26.021683 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-275d2da0-af7c-4fc6-ad8a-0b166d7f4dab req-d229799e-bcda-4e1b-b2d9-465dd7768ed0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b09cd1e3-a561-47b1-9276-fdc378c475fc", "name": "network-vif-deleted", "tag": "c54ae127-a059-41f3-8afa-26264c011570"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:32:26.058753 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-275d2da0-af7c-4fc6-ad8a-0b166d7f4dab req-d229799e-bcda-4e1b-b2d9-465dd7768ed0 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:26.061406 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-275d2da0-af7c-4fc6-ad8a-0b166d7f4dab req-d229799e-bcda-4e1b-b2d9-465dd7768ed0 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:26.061878 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-275d2da0-af7c-4fc6-ad8a-0b166d7f4dab req-d229799e-bcda-4e1b-b2d9-465dd7768ed0 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:26.089569 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-275d2da0-af7c-4fc6-ad8a-0b166d7f4dab req-d229799e-bcda-4e1b-b2d9-465dd7768ed0 service nova] Creating event network-vif-deleted:c54ae127-a059-41f3-8afa-26264c011570 for instance b09cd1e3-a561-47b1-9276-fdc378c475fc on n-h2-846463-3 Sep 23 04:32:26.100177 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-275d2da0-af7c-4fc6-ad8a-0b166d7f4dab req-d229799e-bcda-4e1b-b2d9-465dd7768ed0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086612 Sep 23 04:32:26.102286 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 256/466] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:32:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:32:26.116413 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-66b27f03-4c58-44de-9562-8d6aa25752ff tempest-FlavorsExtraSpecsTestJSON-1852929920 tempest-FlavorsExtraSpecsTestJSON-1852929920-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:32:26.309809 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-66b27f03-4c58-44de-9562-8d6aa25752ff tempest-FlavorsExtraSpecsTestJSON-1852929920 tempest-FlavorsExtraSpecsTestJSON-1852929920-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/801008169/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.202404 Sep 23 04:32:26.316217 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 257/467] 10.222.0.33 () {60 vars in 1221 bytes} [Fri Sep 23 04:32:26 2022] POST /compute/v2.1/flavors/801008169/os-extra_specs => generated 66 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 04:32:26.333187 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-30cb0e52-7eb0-45d1-8da6-6cdf1ed15147 tempest-QuotasAdminTestJSON-590810396 tempest-QuotasAdminTestJSON-590810396-project-admin] Calling method '.version_select at 0x7ff1c02d5b80>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:26.356086 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-53e3bdb8-4703-4994-b4dc-35444d200c60 tempest-QuotasAdminNegativeTest-985991856 tempest-QuotasAdminNegativeTest-985991856-project] Flavor limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:32:26.358860 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-53e3bdb8-4703-4994-b4dc-35444d200c60 tempest-QuotasAdminNegativeTest-985991856 tempest-QuotasAdminNegativeTest-985991856-project] Image limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:32:26.362476 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-53e3bdb8-4703-4994-b4dc-35444d200c60 tempest-QuotasAdminNegativeTest-985991856 tempest-QuotasAdminNegativeTest-985991856-project] Flavor pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:32:26.363112 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-53e3bdb8-4703-4994-b4dc-35444d200c60 tempest-QuotasAdminNegativeTest-985991856 tempest-QuotasAdminNegativeTest-985991856-project] Image pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:32:26.364764 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-53e3bdb8-4703-4994-b4dc-35444d200c60 tempest-QuotasAdminNegativeTest-985991856 tempest-QuotasAdminNegativeTest-985991856-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:32:26.380790 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:DELETE=2,nova_api:SELECT=88,nova_api:INSERT=8,nova_api:UPDATE=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:32:26.392898 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-53e3bdb8-4703-4994-b4dc-35444d200c60 tempest-QuotasAdminNegativeTest-985991856 tempest-QuotasAdminNegativeTest-985991856-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:26.394931 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-53e3bdb8-4703-4994-b4dc-35444d200c60 tempest-QuotasAdminNegativeTest-985991856 tempest-QuotasAdminNegativeTest-985991856-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:26.396928 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-53e3bdb8-4703-4994-b4dc-35444d200c60 tempest-QuotasAdminNegativeTest-985991856 tempest-QuotasAdminNegativeTest-985991856-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:26.400260 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-53e3bdb8-4703-4994-b4dc-35444d200c60 tempest-QuotasAdminNegativeTest-985991856 tempest-QuotasAdminNegativeTest-985991856-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:26.400893 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-53e3bdb8-4703-4994-b4dc-35444d200c60 tempest-QuotasAdminNegativeTest-985991856 tempest-QuotasAdminNegativeTest-985991856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:26.401991 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-53e3bdb8-4703-4994-b4dc-35444d200c60 tempest-QuotasAdminNegativeTest-985991856 tempest-QuotasAdminNegativeTest-985991856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:26.441275 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-53e3bdb8-4703-4994-b4dc-35444d200c60 tempest-QuotasAdminNegativeTest-985991856 tempest-QuotasAdminNegativeTest-985991856-project] Getting quotas for project 1c4be6203d8e4908bc001f56d7c431fc. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:32:26.449681 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-53e3bdb8-4703-4994-b4dc-35444d200c60 tempest-QuotasAdminNegativeTest-985991856 tempest-QuotasAdminNegativeTest-985991856-project] Getting quotas for user a7670b443aa04c38a40cc977f0e75625 and project 1c4be6203d8e4908bc001f56d7c431fc. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:32:26.464064 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.utils [None req-53e3bdb8-4703-4994-b4dc-35444d200c60 tempest-QuotasAdminNegativeTest-985991856 tempest-QuotasAdminNegativeTest-985991856-project] cores quota exceeded for 1c4be6203d8e4908bc001f56d7c431fc, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=122698) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Sep 23 04:32:26.465112 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-53e3bdb8-4703-4994-b4dc-35444d200c60 tempest-QuotasAdminNegativeTest-985991856 tempest-QuotasAdminNegativeTest-985991856-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 23 04:32:26.468967 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-53e3bdb8-4703-4994-b4dc-35444d200c60 tempest-QuotasAdminNegativeTest-985991856 tempest-QuotasAdminNegativeTest-985991856-project] Request method failure captured: Sep 23 04:32:26.468967 n-d-846463-3 devstack@n-api.service[122698]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 23 04:32:26.468967 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:32:26.468967 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:32:26.468967 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:32:26.468967 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 145 Sep 23 04:32:26.468967 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:32:26.468967 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:32:26.468967 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:32:26.468967 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:32:26.468967 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTbUpjFvTpcmdLtCoRcHToBKTHxhXxYVIfHaJEXZxRioFR-MeJOIUt1v-sSHVzkTjI9VUGeUM9uouFAHP9dTQ6yr8LT1GhuHy3AW-_weQtiEAHEvt0t8kbaKhgyYZz31uW3YYcqOrqyt39EFZTWj885NYTAF5BPu_p5dOAIxPcy1488 Sep 23 04:32:26.468967 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:32:26.468967 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:32:26.468967 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:32:26.468967 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:32:26.468967 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:32:26.468967 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:32:26.468967 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 1c4be6203d8e4908bc001f56d7c431fc Sep 23 04:32:26.468967 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-QuotasAdminNegativeTest-985991856 Sep 23 04:32:26.468967 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:32:26.468967 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:32:26.470870 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1c4be6203d8e4908bc001f56d7c431fc", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1c4be6203d8e4908bc001f56d7c431fc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1c4be6203d8e4908bc001f56d7c431fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1c4be6203d8e4908bc001f56d7c431fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:32:26.470870 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-QuotasAdminNegativeTest-985991856 Sep 23 04:32:26.470870 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 1c4be6203d8e4908bc001f56d7c431fc Sep 23 04:32:26.470870 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-985991856 Sep 23 04:32:26.470870 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-QuotasAdminNegativeTest-985991856-project Sep 23 04:32:26.470870 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:32:26.470870 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:32:26.470870 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: a7670b443aa04c38a40cc977f0e75625 Sep 23 04:32:26.470870 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-QuotasAdminNegativeTest-985991856-project Sep 23 04:32:26.470870 n-d-846463-3 devstack@n-api.service[122698]: Sep 23 04:32:26.470870 n-d-846463-3 devstack@n-api.service[122698]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1304606683", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452"}} Sep 23 04:32:26.470870 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:32:26.471611 n-d-846463-3 devstack@n-api.service[122698]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 23 04:32:26.471611 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1304606683', 'imageRef': 'b8dd79b9-f0b9-43a9-9605-17244137c0ee', 'flavorRef': '452'}}} Sep 23 04:32:26.471611 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:32:26.471611 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:32:26.471611 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Sep 23 04:32:26.471611 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Sep 23 04:32:26.471611 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 04:32:26.471611 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 04:32:26.471611 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 23 04:32:26.471611 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc Sep 23 04:32:26.471611 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 23 04:32:26.471611 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 23 04:32:26.471611 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 04:32:26.471611 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 04:32:26.471611 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 23 04:32:26.471611 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 23 04:32:26.471611 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 23 04:32:26.471611 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 23 04:32:26.472915 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Sep 23 04:32:26.472915 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 23 04:32:26.472915 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Sep 23 04:32:26.472915 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:32:26.472915 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:32:26.472915 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:32:26.472915 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:32:26.472915 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 23 04:32:26.472915 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 23 04:32:26.472915 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 23 04:32:26.472915 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 23 04:32:26.472915 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Sep 23 04:32:26.472915 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Sep 23 04:32:26.472915 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Sep 23 04:32:26.472915 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Sep 23 04:32:26.472915 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Sep 23 04:32:26.472915 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 23 04:32:26.472915 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 23 04:32:26.472915 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:32:26.472915 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:32:26.472915 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:32:26.474109 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:32:26.474109 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:32:26.474109 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:32:26.474109 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:32:26.474109 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:32:26.474109 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:32:26.474109 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:32:26.474109 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:32:26.474109 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:32:26.474109 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:32:26.474109 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:32:26.474109 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:32:26.474109 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:32:26.474109 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 23 04:32:26.474109 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Sep 23 04:32:26.474109 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 23 04:32:26.474109 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 23 04:32:26.474109 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:32:26.474109 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:32:26.474109 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:32:26.474109 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:32:26.475272 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:32:26.475272 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:32:26.475272 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:32:26.475272 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:32:26.475272 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 23 04:32:26.475272 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:32:26.475272 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-53e3bdb8-4703-4994-b4dc-35444d200c60 tempest-QuotasAdminNegativeTest-985991856 tempest-QuotasAdminNegativeTest-985991856-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:32:26.475272 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-53e3bdb8-4703-4994-b4dc-35444d200c60 tempest-QuotasAdminNegativeTest-985991856 tempest-QuotasAdminNegativeTest-985991856-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 0.804327 Sep 23 04:32:26.476036 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 211/468] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:32:25 2022] POST /compute/v2.1/servers => generated 111 bytes in 810 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:32:26.493085 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d7391836-d0e6-406d-b879-5d48d9748d74 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:26.493977 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d7391836-d0e6-406d-b879-5d48d9748d74 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 9d255ae7-0aed-4692-8802-6733dfcccbd0] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:26.501526 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d7391836-d0e6-406d-b879-5d48d9748d74 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:26.502129 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d7391836-d0e6-406d-b879-5d48d9748d74 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:26.502610 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d7391836-d0e6-406d-b879-5d48d9748d74 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:26.503338 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d7391836-d0e6-406d-b879-5d48d9748d74 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:26.503808 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d7391836-d0e6-406d-b879-5d48d9748d74 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:26.504336 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d7391836-d0e6-406d-b879-5d48d9748d74 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:26.511266 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-30cb0e52-7eb0-45d1-8da6-6cdf1ed15147 tempest-QuotasAdminTestJSON-590810396 tempest-QuotasAdminTestJSON-590810396-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:26.511779 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-30cb0e52-7eb0-45d1-8da6-6cdf1ed15147 tempest-QuotasAdminTestJSON-590810396 tempest-QuotasAdminTestJSON-590810396-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:26.512225 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-30cb0e52-7eb0-45d1-8da6-6cdf1ed15147 tempest-QuotasAdminTestJSON-590810396 tempest-QuotasAdminTestJSON-590810396-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:26.512966 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-30cb0e52-7eb0-45d1-8da6-6cdf1ed15147 tempest-QuotasAdminTestJSON-590810396 tempest-QuotasAdminTestJSON-590810396-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:26.513430 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-30cb0e52-7eb0-45d1-8da6-6cdf1ed15147 tempest-QuotasAdminTestJSON-590810396 tempest-QuotasAdminTestJSON-590810396-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:26.518037 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-30cb0e52-7eb0-45d1-8da6-6cdf1ed15147 tempest-QuotasAdminTestJSON-590810396 tempest-QuotasAdminTestJSON-590810396-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:26.577922 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-30cb0e52-7eb0-45d1-8da6-6cdf1ed15147 tempest-QuotasAdminTestJSON-590810396 tempest-QuotasAdminTestJSON-590810396-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/7228329d9eb14532a2fac5d22e7e0ff0/detail" status: 200 len: 916 microversion: 2.1 time: 0.261087 Sep 23 04:32:26.589916 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 258/469] 10.222.0.33 () {58 vars in 1263 bytes} [Fri Sep 23 04:32:26 2022] GET /compute/v2.1/os-quota-sets/7228329d9eb14532a2fac5d22e7e0ff0/detail => generated 916 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:32:26.601025 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-132ef5e3-3544-466c-9b85-eeae2c66a651 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:26.601952 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-132ef5e3-3544-466c-9b85-eeae2c66a651 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] [instance: 699f43b8-e784-4553-836c-e8785632d903] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:26.617538 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-132ef5e3-3544-466c-9b85-eeae2c66a651 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:26.618212 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-132ef5e3-3544-466c-9b85-eeae2c66a651 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:26.618731 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-132ef5e3-3544-466c-9b85-eeae2c66a651 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:26.620337 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-132ef5e3-3544-466c-9b85-eeae2c66a651 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:26.621538 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-132ef5e3-3544-466c-9b85-eeae2c66a651 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:26.630658 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-132ef5e3-3544-466c-9b85-eeae2c66a651 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:26.747077 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-132ef5e3-3544-466c-9b85-eeae2c66a651 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcc413bf53847b89cfe6bdf48909ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c7c21aa6b342b6bc52365cfdeb7c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:26.763356 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-132ef5e3-3544-466c-9b85-eeae2c66a651 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] 10.222.0.33 "GET /compute/v2.1/servers/699f43b8-e784-4553-836c-e8785632d903" status: 200 len: 1334 microversion: 2.1 time: 0.183336 Sep 23 04:32:26.764274 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 259/470] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:32:26 2022] GET /compute/v2.1/servers/699f43b8-e784-4553-836c-e8785632d903 => generated 1334 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:26.864698 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d7391836-d0e6-406d-b879-5d48d9748d74 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:26.874632 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d7391836-d0e6-406d-b879-5d48d9748d74 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:26.876158 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d7391836-d0e6-406d-b879-5d48d9748d74 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:26.881086 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d7391836-d0e6-406d-b879-5d48d9748d74 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/9d255ae7-0aed-4692-8802-6733dfcccbd0" status: 200 len: 1362 microversion: 2.25 time: 0.403521 Sep 23 04:32:26.904564 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 212/471] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:32:26 2022] GET /compute/v2.1/servers/9d255ae7-0aed-4692-8802-6733dfcccbd0 => generated 1362 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:32:26.911068 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-127bad9f-2082-4433-a2cf-641847996eb3 tempest-QuotasAdminNegativeTest-744404737 tempest-QuotasAdminNegativeTest-744404737-project-admin] Action: 'update', calling method: .version_select at 0x7ff1c01b6160>, body: {"quota_set": {"cores": 20}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:32:27.052305 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2e111a42-ea6f-4a40-ade6-3dc5b34801dd tempest-FlavorsExtraSpecsTestJSON-697500719 tempest-FlavorsExtraSpecsTestJSON-697500719-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:27.066593 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2e111a42-ea6f-4a40-ade6-3dc5b34801dd tempest-FlavorsExtraSpecsTestJSON-697500719 tempest-FlavorsExtraSpecsTestJSON-697500719-project] 10.222.0.33 "GET /compute/v2.1/flavors/801008169/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.301212 Sep 23 04:32:27.067738 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 260/472] 10.222.0.33 () {58 vars in 1200 bytes} [Fri Sep 23 04:32:26 2022] GET /compute/v2.1/flavors/801008169/os-extra_specs => generated 66 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 04:32:27.073715 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-eb17e555-94e1-4992-a107-3f6a8dc75ff2 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:27.074279 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-eb17e555-94e1-4992-a107-3f6a8dc75ff2 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] [instance: b09cd1e3-a561-47b1-9276-fdc378c475fc] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:27.087279 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eb17e555-94e1-4992-a107-3f6a8dc75ff2 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:27.088680 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eb17e555-94e1-4992-a107-3f6a8dc75ff2 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:27.095365 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eb17e555-94e1-4992-a107-3f6a8dc75ff2 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:27.095365 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eb17e555-94e1-4992-a107-3f6a8dc75ff2 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:27.095365 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eb17e555-94e1-4992-a107-3f6a8dc75ff2 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:27.095365 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eb17e555-94e1-4992-a107-3f6a8dc75ff2 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:27.142815 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eb17e555-94e1-4992-a107-3f6a8dc75ff2 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:27.143583 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eb17e555-94e1-4992-a107-3f6a8dc75ff2 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:27.144122 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eb17e555-94e1-4992-a107-3f6a8dc75ff2 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:27.144742 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-eb17e555-94e1-4992-a107-3f6a8dc75ff2 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lazy-loading 'fault' on Instance uuid b09cd1e3-a561-47b1-9276-fdc378c475fc {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:32:27.165302 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-127bad9f-2082-4433-a2cf-641847996eb3 tempest-QuotasAdminNegativeTest-744404737 tempest-QuotasAdminNegativeTest-744404737-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:27.166028 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-127bad9f-2082-4433-a2cf-641847996eb3 tempest-QuotasAdminNegativeTest-744404737 tempest-QuotasAdminNegativeTest-744404737-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:27.166776 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-127bad9f-2082-4433-a2cf-641847996eb3 tempest-QuotasAdminNegativeTest-744404737 tempest-QuotasAdminNegativeTest-744404737-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:27.167677 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-127bad9f-2082-4433-a2cf-641847996eb3 tempest-QuotasAdminNegativeTest-744404737 tempest-QuotasAdminNegativeTest-744404737-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:27.168327 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-127bad9f-2082-4433-a2cf-641847996eb3 tempest-QuotasAdminNegativeTest-744404737 tempest-QuotasAdminNegativeTest-744404737-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:27.168758 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-127bad9f-2082-4433-a2cf-641847996eb3 tempest-QuotasAdminNegativeTest-744404737 tempest-QuotasAdminNegativeTest-744404737-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:27.196717 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-eb17e555-94e1-4992-a107-3f6a8dc75ff2 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54d1a7a9e4ee44b9992ff9362108b311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649eb80e1ea849868c651849047833e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:27.227899 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-eb17e555-94e1-4992-a107-3f6a8dc75ff2 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] 10.222.0.33 "GET /compute/v2.1/servers/b09cd1e3-a561-47b1-9276-fdc378c475fc" status: 200 len: 1311 microversion: 2.1 time: 0.158922 Sep 23 04:32:27.244673 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 261/473] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:32:27 2022] GET /compute/v2.1/servers/b09cd1e3-a561-47b1-9276-fdc378c475fc => generated 1311 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:27.251998 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-80555930-7ba5-46ec-93c8-601482f2a71d tempest-QuotasAdminTestJSON-590810396 tempest-QuotasAdminTestJSON-590810396-project-admin] Action: 'update', calling method: .version_select at 0x7ff1c03761f0>, body: {"quota_set": {"ram": "2048"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:32:27.323430 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-80555930-7ba5-46ec-93c8-601482f2a71d tempest-QuotasAdminTestJSON-590810396 tempest-QuotasAdminTestJSON-590810396-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:27.324207 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-80555930-7ba5-46ec-93c8-601482f2a71d tempest-QuotasAdminTestJSON-590810396 tempest-QuotasAdminTestJSON-590810396-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:27.324828 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-80555930-7ba5-46ec-93c8-601482f2a71d tempest-QuotasAdminTestJSON-590810396 tempest-QuotasAdminTestJSON-590810396-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:27.325553 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-80555930-7ba5-46ec-93c8-601482f2a71d tempest-QuotasAdminTestJSON-590810396 tempest-QuotasAdminTestJSON-590810396-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:27.326036 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-80555930-7ba5-46ec-93c8-601482f2a71d tempest-QuotasAdminTestJSON-590810396 tempest-QuotasAdminTestJSON-590810396-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:27.326485 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-80555930-7ba5-46ec-93c8-601482f2a71d tempest-QuotasAdminTestJSON-590810396 tempest-QuotasAdminTestJSON-590810396-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:27.366618 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-80555930-7ba5-46ec-93c8-601482f2a71d tempest-QuotasAdminTestJSON-590810396 tempest-QuotasAdminTestJSON-590810396-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:27.367101 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-80555930-7ba5-46ec-93c8-601482f2a71d tempest-QuotasAdminTestJSON-590810396 tempest-QuotasAdminTestJSON-590810396-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:27.367537 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-80555930-7ba5-46ec-93c8-601482f2a71d tempest-QuotasAdminTestJSON-590810396 tempest-QuotasAdminTestJSON-590810396-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:27.373005 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-80555930-7ba5-46ec-93c8-601482f2a71d tempest-QuotasAdminTestJSON-590810396 tempest-QuotasAdminTestJSON-590810396-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:27.373005 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-80555930-7ba5-46ec-93c8-601482f2a71d tempest-QuotasAdminTestJSON-590810396 tempest-QuotasAdminTestJSON-590810396-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:27.373005 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-80555930-7ba5-46ec-93c8-601482f2a71d tempest-QuotasAdminTestJSON-590810396 tempest-QuotasAdminTestJSON-590810396-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:27.373301 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-127bad9f-2082-4433-a2cf-641847996eb3 tempest-QuotasAdminNegativeTest-744404737 tempest-QuotasAdminNegativeTest-744404737-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/1c4be6203d8e4908bc001f56d7c431fc" status: 200 len: 329 microversion: 2.1 time: 0.464894 Sep 23 04:32:27.373301 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 213/474] 10.222.0.33 () {60 vars in 1262 bytes} [Fri Sep 23 04:32:26 2022] PUT /compute/v2.1/os-quota-sets/1c4be6203d8e4908bc001f56d7c431fc => generated 329 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:32:27.380072 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-03d4b8b2-179e-43a1-b57f-efbf138ae32e tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:27.380963 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-03d4b8b2-179e-43a1-b57f-efbf138ae32e tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: 0dff1738-81f1-4619-af74-44b7adc805b5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:27.387681 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-03d4b8b2-179e-43a1-b57f-efbf138ae32e tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:27.388341 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-03d4b8b2-179e-43a1-b57f-efbf138ae32e tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:27.388792 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-03d4b8b2-179e-43a1-b57f-efbf138ae32e tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:27.389515 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-03d4b8b2-179e-43a1-b57f-efbf138ae32e tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:27.390001 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-03d4b8b2-179e-43a1-b57f-efbf138ae32e tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:27.390440 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-03d4b8b2-179e-43a1-b57f-efbf138ae32e tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:27.462710 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-03d4b8b2-179e-43a1-b57f-efbf138ae32e tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:27.473727 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-03d4b8b2-179e-43a1-b57f-efbf138ae32e tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/0dff1738-81f1-4619-af74-44b7adc805b5" status: 200 len: 1217 microversion: 2.1 time: 0.101123 Sep 23 04:32:27.474487 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 214/475] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:32:27 2022] GET /compute/v2.1/servers/0dff1738-81f1-4619-af74-44b7adc805b5 => generated 1217 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:27.480436 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7daf0722-cff2-4c25-a0a0-71a7c98da40c tempest-FlavorsExtraSpecsTestJSON-1852929920 tempest-FlavorsExtraSpecsTestJSON-1852929920-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:32:27.510247 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:DELETE=2,nova_api:SELECT=89,nova_api:INSERT=5,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:32:27.542874 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7daf0722-cff2-4c25-a0a0-71a7c98da40c tempest-FlavorsExtraSpecsTestJSON-1852929920 tempest-FlavorsExtraSpecsTestJSON-1852929920-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/801008169/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.065872 Sep 23 04:32:27.543646 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 215/476] 10.222.0.33 () {60 vars in 1221 bytes} [Fri Sep 23 04:32:27 2022] POST /compute/v2.1/flavors/801008169/os-extra_specs => generated 66 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 04:32:27.552037 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-80555930-7ba5-46ec-93c8-601482f2a71d tempest-QuotasAdminTestJSON-590810396 tempest-QuotasAdminTestJSON-590810396-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/7228329d9eb14532a2fac5d22e7e0ff0?user_id=61f5000cee0745d2bf1949d756fcb801" status: 200 len: 328 microversion: 2.1 time: 0.306109 Sep 23 04:32:27.553579 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a2a42d0f-e225-4d43-b618-43829fa01f48 tempest-QuotasAdminNegativeTest-744404737 tempest-QuotasAdminNegativeTest-744404737-project-admin] Calling method '.version_select at 0x7ff1c015c160>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:27.555408 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 262/477] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Sep 23 04:32:27 2022] PUT /compute/v2.1/os-quota-sets/7228329d9eb14532a2fac5d22e7e0ff0?user_id=61f5000cee0745d2bf1949d756fcb801 => generated 328 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:32:27.562125 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ff0a2918-38e3-450e-add9-8b7f28bc64d6 tempest-FlavorsExtraSpecsTestJSON-697500719 tempest-FlavorsExtraSpecsTestJSON-697500719-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:27.588607 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ff0a2918-38e3-450e-add9-8b7f28bc64d6 tempest-FlavorsExtraSpecsTestJSON-697500719 tempest-FlavorsExtraSpecsTestJSON-697500719-project] 10.222.0.33 "GET /compute/v2.1/flavors/801008169/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.029117 Sep 23 04:32:27.590737 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 263/478] 10.222.0.33 () {58 vars in 1242 bytes} [Fri Sep 23 04:32:27 2022] GET /compute/v2.1/flavors/801008169/os-extra_specs/hw:numa_nodes => generated 22 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 04:32:27.617570 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-75f6f777-9caa-4c4c-8c14-c1417f6920b3 tempest-QuotasAdminTestJSON-590810396 tempest-QuotasAdminTestJSON-590810396-project-admin] Calling method '.version_select at 0x7ff1c038a820>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:27.660196 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a2a42d0f-e225-4d43-b618-43829fa01f48 tempest-QuotasAdminNegativeTest-744404737 tempest-QuotasAdminNegativeTest-744404737-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/1c4be6203d8e4908bc001f56d7c431fc" status: 200 len: 371 microversion: 2.1 time: 0.114989 Sep 23 04:32:27.662119 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 216/479] 10.222.0.33 () {58 vars in 1242 bytes} [Fri Sep 23 04:32:27 2022] GET /compute/v2.1/os-quota-sets/1c4be6203d8e4908bc001f56d7c431fc => generated 371 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:32:27.667511 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f63de6cc-a902-425c-832e-0fa1adf2ec50 tempest-FlavorsExtraSpecsTestJSON-1852929920 tempest-FlavorsExtraSpecsTestJSON-1852929920-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:32:27.694715 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f63de6cc-a902-425c-832e-0fa1adf2ec50 tempest-FlavorsExtraSpecsTestJSON-1852929920 tempest-FlavorsExtraSpecsTestJSON-1852929920-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/801008169/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.031044 Sep 23 04:32:27.700318 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 217/480] 10.222.0.33 () {60 vars in 1221 bytes} [Fri Sep 23 04:32:27 2022] POST /compute/v2.1/flavors/801008169/os-extra_specs => generated 66 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 04:32:27.704983 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-ac93b881-5b1c-43b5-ba16-a44f22be7d16 req-69efdb1c-3884-4c08-88d4-bbcb072d31e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d255ae7-0aed-4692-8802-6733dfcccbd0", "name": "network-vif-plugged", "status": "completed", "tag": "76c7663b-b181-4528-b671-a0840df053e8"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:32:27.720418 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-ac93b881-5b1c-43b5-ba16-a44f22be7d16 req-69efdb1c-3884-4c08-88d4-bbcb072d31e6 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:27.720418 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-ac93b881-5b1c-43b5-ba16-a44f22be7d16 req-69efdb1c-3884-4c08-88d4-bbcb072d31e6 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:27.720418 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-ac93b881-5b1c-43b5-ba16-a44f22be7d16 req-69efdb1c-3884-4c08-88d4-bbcb072d31e6 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:27.732712 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-75f6f777-9caa-4c4c-8c14-c1417f6920b3 tempest-QuotasAdminTestJSON-590810396 tempest-QuotasAdminTestJSON-590810396-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/7228329d9eb14532a2fac5d22e7e0ff0?user_id=61f5000cee0745d2bf1949d756fcb801" status: 200 len: 370 microversion: 2.1 time: 0.140140 Sep 23 04:32:27.740569 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 264/481] 10.222.0.33 () {58 vars in 1323 bytes} [Fri Sep 23 04:32:27 2022] GET /compute/v2.1/os-quota-sets/7228329d9eb14532a2fac5d22e7e0ff0?user_id=61f5000cee0745d2bf1949d756fcb801 => generated 370 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:32:27.740569 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-650b94ec-8c28-44de-9bd8-19ff242de660 tempest-QuotasAdminNegativeTest-744404737 tempest-QuotasAdminNegativeTest-744404737-project-admin] Action: 'update', calling method: .version_select at 0x7ff1c07ec430>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:32:27.745762 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-ac93b881-5b1c-43b5-ba16-a44f22be7d16 req-69efdb1c-3884-4c08-88d4-bbcb072d31e6 service nova] Creating event network-vif-plugged:76c7663b-b181-4528-b671-a0840df053e8 for instance 9d255ae7-0aed-4692-8802-6733dfcccbd0 on n-h2-846463-3 Sep 23 04:32:27.758716 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-ac93b881-5b1c-43b5-ba16-a44f22be7d16 req-69efdb1c-3884-4c08-88d4-bbcb072d31e6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053874 Sep 23 04:32:27.765517 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 218/482] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:32:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:32:27.765517 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-300a274c-7a28-4e81-b287-e84c849343e8 tempest-FlavorsExtraSpecsTestJSON-1852929920 tempest-FlavorsExtraSpecsTestJSON-1852929920-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:27.775831 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-300a274c-7a28-4e81-b287-e84c849343e8 tempest-FlavorsExtraSpecsTestJSON-1852929920 tempest-FlavorsExtraSpecsTestJSON-1852929920-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/801008169/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.014975 Sep 23 04:32:27.783014 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 219/483] 10.222.0.33 () {58 vars in 1200 bytes} [Fri Sep 23 04:32:27 2022] GET /compute/v2.1/flavors/801008169/os-extra_specs => generated 66 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 04:32:27.788173 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ddada0ec-2db4-4c68-8d95-2044705028f1 tempest-FlavorsExtraSpecsTestJSON-1852929920 tempest-FlavorsExtraSpecsTestJSON-1852929920-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:32:27.877358 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-650b94ec-8c28-44de-9bd8-19ff242de660 tempest-QuotasAdminNegativeTest-744404737 tempest-QuotasAdminNegativeTest-744404737-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:27.882044 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-650b94ec-8c28-44de-9bd8-19ff242de660 tempest-QuotasAdminNegativeTest-744404737 tempest-QuotasAdminNegativeTest-744404737-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:27.882044 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-650b94ec-8c28-44de-9bd8-19ff242de660 tempest-QuotasAdminNegativeTest-744404737 tempest-QuotasAdminNegativeTest-744404737-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:27.882044 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-650b94ec-8c28-44de-9bd8-19ff242de660 tempest-QuotasAdminNegativeTest-744404737 tempest-QuotasAdminNegativeTest-744404737-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:27.882044 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-650b94ec-8c28-44de-9bd8-19ff242de660 tempest-QuotasAdminNegativeTest-744404737 tempest-QuotasAdminNegativeTest-744404737-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:27.882407 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-650b94ec-8c28-44de-9bd8-19ff242de660 tempest-QuotasAdminNegativeTest-744404737 tempest-QuotasAdminNegativeTest-744404737-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:27.907364 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ddada0ec-2db4-4c68-8d95-2044705028f1 tempest-FlavorsExtraSpecsTestJSON-1852929920 tempest-FlavorsExtraSpecsTestJSON-1852929920-project-admin] 10.222.0.33 "PUT /compute/v2.1/flavors/801008169/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.122732 Sep 23 04:32:27.912461 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 220/484] 10.222.0.33 () {60 vars in 1262 bytes} [Fri Sep 23 04:32:27 2022] PUT /compute/v2.1/flavors/801008169/os-extra_specs/hw:numa_nodes => generated 22 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 04:32:27.920374 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-bf5d4db6-2e36-4a97-8aee-9f7533dfbd20 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:27.924231 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-bf5d4db6-2e36-4a97-8aee-9f7533dfbd20 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] [instance: 699f43b8-e784-4553-836c-e8785632d903] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:27.934648 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bf5d4db6-2e36-4a97-8aee-9f7533dfbd20 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:27.940781 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bf5d4db6-2e36-4a97-8aee-9f7533dfbd20 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:27.941605 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bf5d4db6-2e36-4a97-8aee-9f7533dfbd20 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:27.942385 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bf5d4db6-2e36-4a97-8aee-9f7533dfbd20 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:27.942858 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bf5d4db6-2e36-4a97-8aee-9f7533dfbd20 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:27.943293 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bf5d4db6-2e36-4a97-8aee-9f7533dfbd20 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:28.050380 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-650b94ec-8c28-44de-9bd8-19ff242de660 tempest-QuotasAdminNegativeTest-744404737 tempest-QuotasAdminNegativeTest-744404737-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/1c4be6203d8e4908bc001f56d7c431fc" status: 200 len: 328 microversion: 2.1 time: 0.315546 Sep 23 04:32:28.051741 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 265/485] 10.222.0.33 () {60 vars in 1262 bytes} [Fri Sep 23 04:32:27 2022] PUT /compute/v2.1/os-quota-sets/1c4be6203d8e4908bc001f56d7c431fc => generated 328 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:32:28.068698 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ed4a6bc5-55a9-4c67-b820-c69f4f7a51e3 tempest-FlavorsExtraSpecsTestJSON-1852929920 tempest-FlavorsExtraSpecsTestJSON-1852929920-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:28.083416 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ed4a6bc5-55a9-4c67-b820-c69f4f7a51e3 tempest-FlavorsExtraSpecsTestJSON-1852929920 tempest-FlavorsExtraSpecsTestJSON-1852929920-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/801008169/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.030368 Sep 23 04:32:28.084718 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 266/486] 10.222.0.33 () {58 vars in 1200 bytes} [Fri Sep 23 04:32:28 2022] GET /compute/v2.1/flavors/801008169/os-extra_specs => generated 66 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 04:32:28.103020 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c38c72d2-1f61-45eb-ba89-3f5379e18752 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:28.103020 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c38c72d2-1f61-45eb-ba89-3f5379e18752 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 9d255ae7-0aed-4692-8802-6733dfcccbd0] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:28.115464 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c38c72d2-1f61-45eb-ba89-3f5379e18752 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:28.116315 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c38c72d2-1f61-45eb-ba89-3f5379e18752 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:28.117641 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c38c72d2-1f61-45eb-ba89-3f5379e18752 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:28.123844 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c38c72d2-1f61-45eb-ba89-3f5379e18752 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:28.124413 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c38c72d2-1f61-45eb-ba89-3f5379e18752 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:28.124853 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c38c72d2-1f61-45eb-ba89-3f5379e18752 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:28.131118 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-bf5d4db6-2e36-4a97-8aee-9f7533dfbd20 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcc413bf53847b89cfe6bdf48909ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c7c21aa6b342b6bc52365cfdeb7c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:28.140772 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-bf5d4db6-2e36-4a97-8aee-9f7533dfbd20 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] 10.222.0.33 "GET /compute/v2.1/servers/699f43b8-e784-4553-836c-e8785632d903" status: 200 len: 1389 microversion: 2.1 time: 0.226740 Sep 23 04:32:28.141968 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 221/487] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:32:27 2022] GET /compute/v2.1/servers/699f43b8-e784-4553-836c-e8785632d903 => generated 1389 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:28.146783 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6bf94fe9-1b0f-45a8-be32-15492e38a055 tempest-FlavorsExtraSpecsTestJSON-1852929920 tempest-FlavorsExtraSpecsTestJSON-1852929920-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:28.279533 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c38c72d2-1f61-45eb-ba89-3f5379e18752 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:28.280524 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-6bf94fe9-1b0f-45a8-be32-15492e38a055 tempest-FlavorsExtraSpecsTestJSON-1852929920 tempest-FlavorsExtraSpecsTestJSON-1852929920-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/801008169/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.137157 Sep 23 04:32:28.281264 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 222/488] 10.222.0.33 () {58 vars in 1245 bytes} [Fri Sep 23 04:32:28 2022] DELETE /compute/v2.1/flavors/801008169/os-extra_specs/hw:numa_nodes => generated 0 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 23 04:32:28.289665 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-17adc20b-7ab2-4ff0-b6dd-59fcdbd98a0c tempest-QuotasAdminNegativeTest-985991856 tempest-QuotasAdminNegativeTest-985991856-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-2019418219", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:32:28.289966 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c38c72d2-1f61-45eb-ba89-3f5379e18752 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:28.292311 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c38c72d2-1f61-45eb-ba89-3f5379e18752 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:28.294043 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c38c72d2-1f61-45eb-ba89-3f5379e18752 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/9d255ae7-0aed-4692-8802-6733dfcccbd0" status: 200 len: 1362 microversion: 2.25 time: 0.207619 Sep 23 04:32:28.296777 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 267/489] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:32:28 2022] GET /compute/v2.1/servers/9d255ae7-0aed-4692-8802-6733dfcccbd0 => generated 1362 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:32:28.303591 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-9bcf6364-454f-44dc-9a28-69e72551a04a req-2e863a73-c664-4ca7-a702-2e51461edf17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "074ac5a1-94af-4e9d-b458-107710ca0972", "name": "network-vif-deleted", "tag": "d2a87d8d-10e1-4e42-a88a-2baacccb1f56"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:32:28.315946 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-9bcf6364-454f-44dc-9a28-69e72551a04a req-2e863a73-c664-4ca7-a702-2e51461edf17 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:28.316457 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-9bcf6364-454f-44dc-9a28-69e72551a04a req-2e863a73-c664-4ca7-a702-2e51461edf17 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:28.317079 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-9bcf6364-454f-44dc-9a28-69e72551a04a req-2e863a73-c664-4ca7-a702-2e51461edf17 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:28.340541 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-9bcf6364-454f-44dc-9a28-69e72551a04a req-2e863a73-c664-4ca7-a702-2e51461edf17 service nova] Creating event network-vif-deleted:d2a87d8d-10e1-4e42-a88a-2baacccb1f56 for instance 074ac5a1-94af-4e9d-b458-107710ca0972 on n-h1-846463-3 Sep 23 04:32:28.346104 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-9bcf6364-454f-44dc-9a28-69e72551a04a req-2e863a73-c664-4ca7-a702-2e51461edf17 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048152 Sep 23 04:32:28.346829 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 268/490] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:32:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:32:28.352340 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-07ba5c09-88de-4d30-892b-57260137065e tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:28.353953 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-07ba5c09-88de-4d30-892b-57260137065e tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] [instance: b09cd1e3-a561-47b1-9276-fdc378c475fc] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:28.360936 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-07ba5c09-88de-4d30-892b-57260137065e tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:28.361754 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-07ba5c09-88de-4d30-892b-57260137065e tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:28.362240 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-07ba5c09-88de-4d30-892b-57260137065e tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:28.362958 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-07ba5c09-88de-4d30-892b-57260137065e tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:28.363424 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-07ba5c09-88de-4d30-892b-57260137065e tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:28.363856 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-07ba5c09-88de-4d30-892b-57260137065e tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:28.370947 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.network.neutron [None req-17adc20b-7ab2-4ff0-b6dd-59fcdbd98a0c tempest-QuotasAdminNegativeTest-985991856 tempest-QuotasAdminNegativeTest-985991856-project] validate_networks() for None {{(pid=122698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:32:28.381155 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-07ba5c09-88de-4d30-892b-57260137065e tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] HTTP exception thrown: Instance b09cd1e3-a561-47b1-9276-fdc378c475fc could not be found. Sep 23 04:32:28.383002 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-07ba5c09-88de-4d30-892b-57260137065e tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Request method failure captured: Sep 23 04:32:28.383002 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/b09cd1e3-a561-47b1-9276-fdc378c475fc HTTP/1.1 Sep 23 04:32:28.383002 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:32:28.383002 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:32:28.383002 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:32:28.383002 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:32:28.383002 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:32:28.383002 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:32:28.383002 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:32:28.383002 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:32:28.383002 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTaotd2IYzcO_4sjT2Wu1qIv2KGCuvro0KpKYSzqiRu60Ry6_ZevKKYXBrxjldNssaMOtrNZdX0yannlf_OMUE1Y2MF30WNeQQx7LL_-gqPxsRdgd2PGzDFLCkkq0ejYvXToGO4O3HmuZrJbbgwY8BWr2Rm0XOM-jAVtXf3kWuw3JZc Sep 23 04:32:28.383002 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:32:28.383002 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:32:28.383002 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:32:28.383002 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:32:28.383002 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:32:28.383002 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:32:28.383002 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 649eb80e1ea849868c651849047833e1 Sep 23 04:32:28.383002 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1032390530 Sep 23 04:32:28.383002 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:32:28.383002 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:32:28.384264 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_649eb80e1ea849868c651849047833e1", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/649eb80e1ea849868c651849047833e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/649eb80e1ea849868c651849047833e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/649eb80e1ea849868c651849047833e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:32:28.384264 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1032390530 Sep 23 04:32:28.384264 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 649eb80e1ea849868c651849047833e1 Sep 23 04:32:28.384264 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1032390530 Sep 23 04:32:28.384264 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ServersAdminNegativeTestJSON-1032390530-project Sep 23 04:32:28.384264 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:32:28.384264 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:32:28.384264 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 54d1a7a9e4ee44b9992ff9362108b311 Sep 23 04:32:28.384264 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1032390530-project Sep 23 04:32:28.384264 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:32:28.384264 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance b09cd1e3-a561-47b1-9276-fdc378c475fc could not be found. Sep 23 04:32:28.384264 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': 'b09cd1e3-a561-47b1-9276-fdc378c475fc'} Sep 23 04:32:28.385095 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:32:28.385095 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:32:28.385095 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:32:28.385095 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:32:28.385095 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:32:28.385095 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:32:28.385095 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:32:28.385095 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:32:28.385095 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:32:28.385095 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:32:28.385095 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b09cd1e3-a561-47b1-9276-fdc378c475fc could not be found. Sep 23 04:32:28.385095 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:32:28.385095 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:32:28.385095 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:32:28.385095 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:32:28.385095 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:32:28.385095 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:32:28.385095 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:32:28.385095 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:32:28.385095 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:32:28.386395 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:32:28.386395 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:32:28.386395 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:32:28.386395 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:32:28.386395 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:32:28.386395 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:32:28.386395 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:32:28.386395 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b09cd1e3-a561-47b1-9276-fdc378c475fc could not be found. Sep 23 04:32:28.386395 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:32:28.386395 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:32:28.386395 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:32:28.386395 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:32:28.386395 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:32:28.386395 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:32:28.386395 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:32:28.386395 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:32:28.386395 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b09cd1e3-a561-47b1-9276-fdc378c475fc could not be found. Sep 23 04:32:28.386395 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:32:28.389469 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-07ba5c09-88de-4d30-892b-57260137065e tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Returning 404 to user: Instance b09cd1e3-a561-47b1-9276-fdc378c475fc could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:32:28.389469 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-07ba5c09-88de-4d30-892b-57260137065e tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] 10.222.0.33 "GET /compute/v2.1/servers/b09cd1e3-a561-47b1-9276-fdc378c475fc" status: 404 len: 111 microversion: 2.1 time: 0.036584 Sep 23 04:32:28.389469 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 269/491] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:32:28 2022] GET /compute/v2.1/servers/b09cd1e3-a561-47b1-9276-fdc378c475fc => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:32:28.390380 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4da0d2c7-efbf-4399-94ad-2a718c768de5 tempest-FlavorsExtraSpecsTestJSON-1852929920 tempest-FlavorsExtraSpecsTestJSON-1852929920-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:28.475605 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4da0d2c7-efbf-4399-94ad-2a718c768de5 tempest-FlavorsExtraSpecsTestJSON-1852929920 tempest-FlavorsExtraSpecsTestJSON-1852929920-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/801008169/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.088868 Sep 23 04:32:28.479734 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 270/492] 10.222.0.33 () {58 vars in 1245 bytes} [Fri Sep 23 04:32:28 2022] DELETE /compute/v2.1/flavors/801008169/os-extra_specs/hw:cpu_policy => generated 0 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 23 04:32:28.484596 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1390d27d-d102-442c-9575-15140d4d2700 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:28.485196 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1390d27d-d102-442c-9575-15140d4d2700 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] [instance: ed83bf5a-f3ce-4b5c-af6f-92b80599a022] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:28.492280 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1390d27d-d102-442c-9575-15140d4d2700 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:28.492926 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1390d27d-d102-442c-9575-15140d4d2700 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:28.493393 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1390d27d-d102-442c-9575-15140d4d2700 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:28.494220 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1390d27d-d102-442c-9575-15140d4d2700 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:28.494683 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1390d27d-d102-442c-9575-15140d4d2700 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:28.495148 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1390d27d-d102-442c-9575-15140d4d2700 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:28.521196 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1390d27d-d102-442c-9575-15140d4d2700 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] [instance: ed83bf5a-f3ce-4b5c-af6f-92b80599a022] Going to try to terminate instance {{(pid=122699) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:32:28.596331 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-17adc20b-7ab2-4ff0-b6dd-59fcdbd98a0c tempest-QuotasAdminNegativeTest-985991856 tempest-QuotasAdminNegativeTest-985991856-project] Flavor limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:32:28.596963 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-17adc20b-7ab2-4ff0-b6dd-59fcdbd98a0c tempest-QuotasAdminNegativeTest-985991856 tempest-QuotasAdminNegativeTest-985991856-project] Image limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:32:28.597610 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-17adc20b-7ab2-4ff0-b6dd-59fcdbd98a0c tempest-QuotasAdminNegativeTest-985991856 tempest-QuotasAdminNegativeTest-985991856-project] Flavor pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:32:28.598146 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-17adc20b-7ab2-4ff0-b6dd-59fcdbd98a0c tempest-QuotasAdminNegativeTest-985991856 tempest-QuotasAdminNegativeTest-985991856-project] Image pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:32:28.598707 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-17adc20b-7ab2-4ff0-b6dd-59fcdbd98a0c tempest-QuotasAdminNegativeTest-985991856 tempest-QuotasAdminNegativeTest-985991856-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:32:28.613870 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-17adc20b-7ab2-4ff0-b6dd-59fcdbd98a0c tempest-QuotasAdminNegativeTest-985991856 tempest-QuotasAdminNegativeTest-985991856-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:28.614465 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-17adc20b-7ab2-4ff0-b6dd-59fcdbd98a0c tempest-QuotasAdminNegativeTest-985991856 tempest-QuotasAdminNegativeTest-985991856-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:28.614965 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-17adc20b-7ab2-4ff0-b6dd-59fcdbd98a0c tempest-QuotasAdminNegativeTest-985991856 tempest-QuotasAdminNegativeTest-985991856-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:28.615916 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-17adc20b-7ab2-4ff0-b6dd-59fcdbd98a0c tempest-QuotasAdminNegativeTest-985991856 tempest-QuotasAdminNegativeTest-985991856-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:28.617154 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-17adc20b-7ab2-4ff0-b6dd-59fcdbd98a0c tempest-QuotasAdminNegativeTest-985991856 tempest-QuotasAdminNegativeTest-985991856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:28.617734 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-17adc20b-7ab2-4ff0-b6dd-59fcdbd98a0c tempest-QuotasAdminNegativeTest-985991856 tempest-QuotasAdminNegativeTest-985991856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:28.638928 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-17adc20b-7ab2-4ff0-b6dd-59fcdbd98a0c tempest-QuotasAdminNegativeTest-985991856 tempest-QuotasAdminNegativeTest-985991856-project] Getting quotas for project 1c4be6203d8e4908bc001f56d7c431fc. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:32:28.644014 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-17adc20b-7ab2-4ff0-b6dd-59fcdbd98a0c tempest-QuotasAdminNegativeTest-985991856 tempest-QuotasAdminNegativeTest-985991856-project] Getting quotas for user a7670b443aa04c38a40cc977f0e75625 and project 1c4be6203d8e4908bc001f56d7c431fc. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:32:28.655336 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.utils [None req-17adc20b-7ab2-4ff0-b6dd-59fcdbd98a0c tempest-QuotasAdminNegativeTest-985991856 tempest-QuotasAdminNegativeTest-985991856-project] instances quota exceeded for 1c4be6203d8e4908bc001f56d7c431fc, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=122698) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Sep 23 04:32:28.655874 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-17adc20b-7ab2-4ff0-b6dd-59fcdbd98a0c tempest-QuotasAdminNegativeTest-985991856 tempest-QuotasAdminNegativeTest-985991856-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 23 04:32:28.659421 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-17adc20b-7ab2-4ff0-b6dd-59fcdbd98a0c tempest-QuotasAdminNegativeTest-985991856 tempest-QuotasAdminNegativeTest-985991856-project] Request method failure captured: Sep 23 04:32:28.659421 n-d-846463-3 devstack@n-api.service[122698]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 23 04:32:28.659421 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:32:28.659421 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:32:28.659421 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:32:28.659421 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 145 Sep 23 04:32:28.659421 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:32:28.659421 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:32:28.659421 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:32:28.659421 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:32:28.659421 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTbUpjFvTpcmdLtCoRcHToBKTHxhXxYVIfHaJEXZxRioFR-MeJOIUt1v-sSHVzkTjI9VUGeUM9uouFAHP9dTQ6yr8LT1GhuHy3AW-_weQtiEAHEvt0t8kbaKhgyYZz31uW3YYcqOrqyt39EFZTWj885NYTAF5BPu_p5dOAIxPcy1488 Sep 23 04:32:28.659421 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:32:28.659421 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:32:28.659421 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:32:28.659421 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:32:28.659421 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:32:28.659421 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:32:28.659421 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 1c4be6203d8e4908bc001f56d7c431fc Sep 23 04:32:28.659421 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-QuotasAdminNegativeTest-985991856 Sep 23 04:32:28.659421 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:32:28.659421 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:32:28.660771 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1c4be6203d8e4908bc001f56d7c431fc", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1c4be6203d8e4908bc001f56d7c431fc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1c4be6203d8e4908bc001f56d7c431fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1c4be6203d8e4908bc001f56d7c431fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:32:28.660771 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-QuotasAdminNegativeTest-985991856 Sep 23 04:32:28.660771 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 1c4be6203d8e4908bc001f56d7c431fc Sep 23 04:32:28.660771 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-985991856 Sep 23 04:32:28.660771 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-QuotasAdminNegativeTest-985991856-project Sep 23 04:32:28.660771 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:32:28.660771 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:32:28.660771 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: a7670b443aa04c38a40cc977f0e75625 Sep 23 04:32:28.660771 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-QuotasAdminNegativeTest-985991856-project Sep 23 04:32:28.660771 n-d-846463-3 devstack@n-api.service[122698]: Sep 23 04:32:28.660771 n-d-846463-3 devstack@n-api.service[122698]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-2019418219", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452"}} Sep 23 04:32:28.660771 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:32:28.661450 n-d-846463-3 devstack@n-api.service[122698]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 23 04:32:28.661450 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-2019418219', 'imageRef': 'b8dd79b9-f0b9-43a9-9605-17244137c0ee', 'flavorRef': '452'}}} Sep 23 04:32:28.661450 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:32:28.661450 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:32:28.661450 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Sep 23 04:32:28.661450 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Sep 23 04:32:28.661450 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 04:32:28.661450 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 04:32:28.661450 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 23 04:32:28.661450 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc Sep 23 04:32:28.661450 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 23 04:32:28.661450 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 23 04:32:28.661450 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 04:32:28.661450 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 04:32:28.661450 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 23 04:32:28.661450 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 23 04:32:28.661450 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 23 04:32:28.661450 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 23 04:32:28.662952 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Sep 23 04:32:28.662952 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 23 04:32:28.662952 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Sep 23 04:32:28.662952 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:32:28.662952 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:32:28.662952 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:32:28.662952 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:32:28.662952 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 23 04:32:28.662952 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 23 04:32:28.662952 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 23 04:32:28.662952 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 23 04:32:28.662952 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Sep 23 04:32:28.662952 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Sep 23 04:32:28.662952 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Sep 23 04:32:28.662952 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Sep 23 04:32:28.662952 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Sep 23 04:32:28.662952 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 23 04:32:28.662952 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 23 04:32:28.662952 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:32:28.662952 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:32:28.662952 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:32:28.664146 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:32:28.664146 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:32:28.664146 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:32:28.664146 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:32:28.664146 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:32:28.664146 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:32:28.664146 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:32:28.664146 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:32:28.664146 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:32:28.664146 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:32:28.664146 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:32:28.664146 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:32:28.664146 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:32:28.664146 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 23 04:32:28.664146 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Sep 23 04:32:28.664146 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 23 04:32:28.664146 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 23 04:32:28.664146 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:32:28.664146 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:32:28.664146 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:32:28.664146 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:32:28.665882 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:32:28.665882 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:32:28.665882 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:32:28.665882 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:32:28.665882 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 23 04:32:28.665882 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:32:28.665882 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-17adc20b-7ab2-4ff0-b6dd-59fcdbd98a0c tempest-QuotasAdminNegativeTest-985991856 tempest-QuotasAdminNegativeTest-985991856-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:32:28.665882 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-17adc20b-7ab2-4ff0-b6dd-59fcdbd98a0c tempest-QuotasAdminNegativeTest-985991856 tempest-QuotasAdminNegativeTest-985991856-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.378421 Sep 23 04:32:28.665882 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 223/493] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:32:28 2022] POST /compute/v2.1/servers => generated 119 bytes in 379 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:32:28.670623 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d6d8ff11-7fb5-4427-8784-c6160dfcc9ad tempest-FlavorsExtraSpecsTestJSON-1852929920 tempest-FlavorsExtraSpecsTestJSON-1852929920-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:28.673584 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d6d8ff11-7fb5-4427-8784-c6160dfcc9ad tempest-FlavorsExtraSpecsTestJSON-1852929920 tempest-FlavorsExtraSpecsTestJSON-1852929920-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/801008169/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.010587 Sep 23 04:32:28.674551 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 224/494] 10.222.0.33 () {58 vars in 1200 bytes} [Fri Sep 23 04:32:28 2022] GET /compute/v2.1/flavors/801008169/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 04:32:28.678920 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8d5b7625-5f28-4039-a5e7-b17340c1e850 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:28.679519 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8d5b7625-5f28-4039-a5e7-b17340c1e850 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: 0dff1738-81f1-4619-af74-44b7adc805b5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:28.685722 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8d5b7625-5f28-4039-a5e7-b17340c1e850 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:28.686251 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8d5b7625-5f28-4039-a5e7-b17340c1e850 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:28.686680 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8d5b7625-5f28-4039-a5e7-b17340c1e850 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:28.687434 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8d5b7625-5f28-4039-a5e7-b17340c1e850 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:28.687877 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8d5b7625-5f28-4039-a5e7-b17340c1e850 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:28.688484 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8d5b7625-5f28-4039-a5e7-b17340c1e850 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:28.728516 n-d-846463-3 devstack@n-api.service[122698]: ERROR sqlalchemy.pool.impl.QueuePool [-] Exception during reset or similar: AssertionError: do not call blocking functions from the mainloop Sep 23 04:32:28.728516 n-d-846463-3 devstack@n-api.service[122698]: ERROR sqlalchemy.pool.impl.QueuePool Traceback (most recent call last): Sep 23 04:32:28.728516 n-d-846463-3 devstack@n-api.service[122698]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 739, in _finalize_fairy Sep 23 04:32:28.728516 n-d-846463-3 devstack@n-api.service[122698]: ERROR sqlalchemy.pool.impl.QueuePool fairy._reset(pool) Sep 23 04:32:28.728516 n-d-846463-3 devstack@n-api.service[122698]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 988, in _reset Sep 23 04:32:28.728516 n-d-846463-3 devstack@n-api.service[122698]: ERROR sqlalchemy.pool.impl.QueuePool pool._dialect.do_rollback(self) Sep 23 04:32:28.728516 n-d-846463-3 devstack@n-api.service[122698]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 682, in do_rollback Sep 23 04:32:28.728516 n-d-846463-3 devstack@n-api.service[122698]: ERROR sqlalchemy.pool.impl.QueuePool dbapi_connection.rollback() Sep 23 04:32:28.728516 n-d-846463-3 devstack@n-api.service[122698]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 480, in rollback Sep 23 04:32:28.728516 n-d-846463-3 devstack@n-api.service[122698]: ERROR sqlalchemy.pool.impl.QueuePool self._read_ok_packet() Sep 23 04:32:28.728516 n-d-846463-3 devstack@n-api.service[122698]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 443, in _read_ok_packet Sep 23 04:32:28.728516 n-d-846463-3 devstack@n-api.service[122698]: ERROR sqlalchemy.pool.impl.QueuePool pkt = self._read_packet() Sep 23 04:32:28.728516 n-d-846463-3 devstack@n-api.service[122698]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 692, in _read_packet Sep 23 04:32:28.728516 n-d-846463-3 devstack@n-api.service[122698]: ERROR sqlalchemy.pool.impl.QueuePool packet_header = self._read_bytes(4) Sep 23 04:32:28.728516 n-d-846463-3 devstack@n-api.service[122698]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 732, in _read_bytes Sep 23 04:32:28.728516 n-d-846463-3 devstack@n-api.service[122698]: ERROR sqlalchemy.pool.impl.QueuePool data = self._rfile.read(num_bytes) Sep 23 04:32:28.728516 n-d-846463-3 devstack@n-api.service[122698]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/lib/python3.8/socket.py", line 669, in readinto Sep 23 04:32:28.729837 n-d-846463-3 devstack@n-api.service[122698]: ERROR sqlalchemy.pool.impl.QueuePool return self._sock.recv_into(b) Sep 23 04:32:28.729837 n-d-846463-3 devstack@n-api.service[122698]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/greenio/base.py", line 376, in recv_into Sep 23 04:32:28.729837 n-d-846463-3 devstack@n-api.service[122698]: ERROR sqlalchemy.pool.impl.QueuePool return self._recv_loop(self.fd.recv_into, 0, buffer, nbytes, flags) Sep 23 04:32:28.729837 n-d-846463-3 devstack@n-api.service[122698]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/greenio/base.py", line 364, in _recv_loop Sep 23 04:32:28.729837 n-d-846463-3 devstack@n-api.service[122698]: ERROR sqlalchemy.pool.impl.QueuePool self._read_trampoline() Sep 23 04:32:28.729837 n-d-846463-3 devstack@n-api.service[122698]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/greenio/base.py", line 332, in _read_trampoline Sep 23 04:32:28.729837 n-d-846463-3 devstack@n-api.service[122698]: ERROR sqlalchemy.pool.impl.QueuePool self._trampoline( Sep 23 04:32:28.729837 n-d-846463-3 devstack@n-api.service[122698]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/greenio/base.py", line 211, in _trampoline Sep 23 04:32:28.729837 n-d-846463-3 devstack@n-api.service[122698]: ERROR sqlalchemy.pool.impl.QueuePool return trampoline(fd, read=read, write=write, timeout=timeout, Sep 23 04:32:28.729837 n-d-846463-3 devstack@n-api.service[122698]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/__init__.py", line 141, in trampoline Sep 23 04:32:28.729837 n-d-846463-3 devstack@n-api.service[122698]: ERROR sqlalchemy.pool.impl.QueuePool assert hub.greenlet is not current, 'do not call blocking functions from the mainloop' Sep 23 04:32:28.729837 n-d-846463-3 devstack@n-api.service[122698]: ERROR sqlalchemy.pool.impl.QueuePool AssertionError: do not call blocking functions from the mainloop Sep 23 04:32:28.729837 n-d-846463-3 devstack@n-api.service[122698]: ERROR sqlalchemy.pool.impl.QueuePool Sep 23 04:32:28.729837 n-d-846463-3 devstack@n-api.service[122698]: Exception ignored in: . at 0x7ff1c01b68b0> Sep 23 04:32:28.729837 n-d-846463-3 devstack@n-api.service[122698]: Traceback (most recent call last): Sep 23 04:32:28.729837 n-d-846463-3 devstack@n-api.service[122698]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 488, in Sep 23 04:32:28.729837 n-d-846463-3 devstack@n-api.service[122698]: and _finalize_fairy(None, rec, pool, ref, echo, True), Sep 23 04:32:28.729837 n-d-846463-3 devstack@n-api.service[122698]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 774, in _finalize_fairy Sep 23 04:32:28.729837 n-d-846463-3 devstack@n-api.service[122698]: connection_record.checkin() Sep 23 04:32:28.729837 n-d-846463-3 devstack@n-api.service[122698]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 521, in checkin Sep 23 04:32:28.731316 n-d-846463-3 devstack@n-api.service[122698]: pool.dispatch.checkin(connection, self) Sep 23 04:32:28.731316 n-d-846463-3 devstack@n-api.service[122698]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/event/attr.py", line 343, in __call__ Sep 23 04:32:28.733716 n-d-846463-3 devstack@n-api.service[122698]: fn(*args, **kw) Sep 23 04:32:28.733716 n-d-846463-3 devstack@n-api.service[122698]: File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py", line 51, in _thread_yield Sep 23 04:32:28.739017 n-d-846463-3 devstack@n-api.service[122698]: time.sleep(0) Sep 23 04:32:28.739017 n-d-846463-3 devstack@n-api.service[122698]: File "/usr/local/lib/python3.8/dist-packages/eventlet/greenthread.py", line 33, in sleep Sep 23 04:32:28.745587 n-d-846463-3 devstack@n-api.service[122698]: assert hub.greenlet is not current, 'do not call blocking functions from the mainloop' Sep 23 04:32:28.745587 n-d-846463-3 devstack@n-api.service[122698]: AssertionError: do not call blocking functions from the mainloop Sep 23 04:32:28.834654 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8d5b7625-5f28-4039-a5e7-b17340c1e850 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:28.842296 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8d5b7625-5f28-4039-a5e7-b17340c1e850 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/0dff1738-81f1-4619-af74-44b7adc805b5" status: 200 len: 1265 microversion: 2.1 time: 0.166858 Sep 23 04:32:28.842864 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 225/495] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:32:28 2022] GET /compute/v2.1/servers/0dff1738-81f1-4619-af74-44b7adc805b5 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:28.848218 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-84e539b8-1f35-437e-bdf5-a8f3b69f8417 tempest-QuotasAdminNegativeTest-744404737 tempest-QuotasAdminNegativeTest-744404737-project-admin] Action: 'update', calling method: .version_select at 0x7ff1c0138430>, body: {"quota_set": {"instances": 10}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:32:28.918388 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1390d27d-d102-442c-9575-15140d4d2700 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ed83bf5a-f3ce-4b5c-af6f-92b80599a022" status: 204 len: 0 microversion: 2.1 time: 0.437291 Sep 23 04:32:28.919245 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 271/496] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:32:28 2022] DELETE /compute/v2.1/servers/ed83bf5a-f3ce-4b5c-af6f-92b80599a022 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:32:28.927723 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f2e31978-acee-47b9-be0c-c72c485c6538 tempest-FlavorsExtraSpecsTestJSON-1852929920 tempest-FlavorsExtraSpecsTestJSON-1852929920-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:29.061317 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-84e539b8-1f35-437e-bdf5-a8f3b69f8417 tempest-QuotasAdminNegativeTest-744404737 tempest-QuotasAdminNegativeTest-744404737-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:29.061803 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-84e539b8-1f35-437e-bdf5-a8f3b69f8417 tempest-QuotasAdminNegativeTest-744404737 tempest-QuotasAdminNegativeTest-744404737-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:29.062460 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-84e539b8-1f35-437e-bdf5-a8f3b69f8417 tempest-QuotasAdminNegativeTest-744404737 tempest-QuotasAdminNegativeTest-744404737-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:29.063192 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-84e539b8-1f35-437e-bdf5-a8f3b69f8417 tempest-QuotasAdminNegativeTest-744404737 tempest-QuotasAdminNegativeTest-744404737-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:29.063681 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-84e539b8-1f35-437e-bdf5-a8f3b69f8417 tempest-QuotasAdminNegativeTest-744404737 tempest-QuotasAdminNegativeTest-744404737-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:29.064112 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-84e539b8-1f35-437e-bdf5-a8f3b69f8417 tempest-QuotasAdminNegativeTest-744404737 tempest-QuotasAdminNegativeTest-744404737-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:29.071204 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f2e31978-acee-47b9-be0c-c72c485c6538 tempest-FlavorsExtraSpecsTestJSON-1852929920 tempest-FlavorsExtraSpecsTestJSON-1852929920-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/801008169" status: 202 len: 0 microversion: 2.1 time: 0.147409 Sep 23 04:32:29.071781 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 272/497] 10.222.0.33 () {58 vars in 1158 bytes} [Fri Sep 23 04:32:28 2022] DELETE /compute/v2.1/flavors/801008169 => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:32:29.077302 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-bfee390e-b7cb-46d6-9e32-6e20fd4470ee tempest-QuotasAdminTestJSON-590810396 tempest-QuotasAdminTestJSON-590810396-project-admin] Calling method '.version_select at 0x7ff1c07ecca0>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:29.232955 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-bfee390e-b7cb-46d6-9e32-6e20fd4470ee tempest-QuotasAdminTestJSON-590810396 tempest-QuotasAdminTestJSON-590810396-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/59adedb6001d443cb8a761b94106d86b/defaults" status: 200 len: 371 microversion: 2.1 time: 0.159568 Sep 23 04:32:29.236176 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 273/498] 10.222.0.33 () {58 vars in 1269 bytes} [Fri Sep 23 04:32:29 2022] GET /compute/v2.1/os-quota-sets/59adedb6001d443cb8a761b94106d86b/defaults => generated 371 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:32:29.240735 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-02be267a-4aac-4d38-b8fc-1693d9b092b6 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:29.241615 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-02be267a-4aac-4d38-b8fc-1693d9b092b6 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] [instance: ed83bf5a-f3ce-4b5c-af6f-92b80599a022] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:29.247665 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-02be267a-4aac-4d38-b8fc-1693d9b092b6 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:29.248165 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-02be267a-4aac-4d38-b8fc-1693d9b092b6 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:29.248606 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-02be267a-4aac-4d38-b8fc-1693d9b092b6 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:29.249466 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-02be267a-4aac-4d38-b8fc-1693d9b092b6 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:29.250167 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-02be267a-4aac-4d38-b8fc-1693d9b092b6 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:29.250593 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-02be267a-4aac-4d38-b8fc-1693d9b092b6 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:29.251514 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-84e539b8-1f35-437e-bdf5-a8f3b69f8417 tempest-QuotasAdminNegativeTest-744404737 tempest-QuotasAdminNegativeTest-744404737-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/1c4be6203d8e4908bc001f56d7c431fc" status: 200 len: 329 microversion: 2.1 time: 0.406795 Sep 23 04:32:29.252538 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 226/499] 10.222.0.33 () {60 vars in 1262 bytes} [Fri Sep 23 04:32:28 2022] PUT /compute/v2.1/os-quota-sets/1c4be6203d8e4908bc001f56d7c431fc => generated 329 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:32:29.257184 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-054578ed-d061-4580-8027-ffe3c2896f5e tempest-FlavorsExtraSpecsTestJSON-1852929920 tempest-FlavorsExtraSpecsTestJSON-1852929920-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:29.280795 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-054578ed-d061-4580-8027-ffe3c2896f5e tempest-FlavorsExtraSpecsTestJSON-1852929920 tempest-FlavorsExtraSpecsTestJSON-1852929920-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.027096 Sep 23 04:32:29.281717 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 227/500] 10.222.0.33 () {58 vars in 1146 bytes} [Fri Sep 23 04:32:29 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:29.287011 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b51fdfe9-acee-4743-ae81-aeaf7715fbaa tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:29.288003 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b51fdfe9-acee-4743-ae81-aeaf7715fbaa tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] [instance: 699f43b8-e784-4553-836c-e8785632d903] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:29.294376 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b51fdfe9-acee-4743-ae81-aeaf7715fbaa tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:29.295115 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b51fdfe9-acee-4743-ae81-aeaf7715fbaa tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:29.295842 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b51fdfe9-acee-4743-ae81-aeaf7715fbaa tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:29.302960 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b51fdfe9-acee-4743-ae81-aeaf7715fbaa tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:29.303543 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b51fdfe9-acee-4743-ae81-aeaf7715fbaa tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:29.304062 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b51fdfe9-acee-4743-ae81-aeaf7715fbaa tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:29.486306 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-02be267a-4aac-4d38-b8fc-1693d9b092b6 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54d1a7a9e4ee44b9992ff9362108b311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649eb80e1ea849868c651849047833e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:29.495204 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b51fdfe9-acee-4743-ae81-aeaf7715fbaa tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcc413bf53847b89cfe6bdf48909ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c7c21aa6b342b6bc52365cfdeb7c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:29.500137 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-02be267a-4aac-4d38-b8fc-1693d9b092b6 tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] 10.222.0.33 "GET /compute/v2.1/servers/ed83bf5a-f3ce-4b5c-af6f-92b80599a022" status: 200 len: 1478 microversion: 2.1 time: 0.258636 Sep 23 04:32:29.504182 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b51fdfe9-acee-4743-ae81-aeaf7715fbaa tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] 10.222.0.33 "GET /compute/v2.1/servers/699f43b8-e784-4553-836c-e8785632d903" status: 200 len: 1389 microversion: 2.1 time: 0.221220 Sep 23 04:32:29.504743 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 228/501] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:32:29 2022] GET /compute/v2.1/servers/699f43b8-e784-4553-836c-e8785632d903 => generated 1389 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:29.510050 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 274/502] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:32:29 2022] GET /compute/v2.1/servers/ed83bf5a-f3ce-4b5c-af6f-92b80599a022 => generated 1478 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:29.515604 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-72f9481b-7869-40d7-8305-30de6e76e83e tempest-QuotasAdminNegativeTest-744404737 tempest-QuotasAdminNegativeTest-744404737-project-admin] Calling method '.version_select at 0x7ff1c02f9700>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:29.519251 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-233b0fa4-17ad-4d5b-8e07-10960d7c60a1 tempest-QuotasAdminTestJSON-590810396 tempest-QuotasAdminTestJSON-590810396-project-admin] Action: 'update', calling method: .version_select at 0x7ff1c00e5310>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:32:29.586888 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-72f9481b-7869-40d7-8305-30de6e76e83e tempest-QuotasAdminNegativeTest-744404737 tempest-QuotasAdminNegativeTest-744404737-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/1c4be6203d8e4908bc001f56d7c431fc" status: 200 len: 371 microversion: 2.1 time: 0.075697 Sep 23 04:32:29.594015 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 275/503] 10.222.0.33 () {58 vars in 1242 bytes} [Fri Sep 23 04:32:29 2022] GET /compute/v2.1/os-quota-sets/1c4be6203d8e4908bc001f56d7c431fc => generated 371 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:32:29.594015 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c746baa1-d9c6-40c8-b031-b9ec3c92bb56 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:29.594408 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c746baa1-d9c6-40c8-b031-b9ec3c92bb56 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 9d255ae7-0aed-4692-8802-6733dfcccbd0] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:29.600452 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c746baa1-d9c6-40c8-b031-b9ec3c92bb56 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:29.601247 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c746baa1-d9c6-40c8-b031-b9ec3c92bb56 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:29.601692 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c746baa1-d9c6-40c8-b031-b9ec3c92bb56 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:29.602426 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c746baa1-d9c6-40c8-b031-b9ec3c92bb56 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:29.602888 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c746baa1-d9c6-40c8-b031-b9ec3c92bb56 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:29.603315 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c746baa1-d9c6-40c8-b031-b9ec3c92bb56 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:29.621803 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-233b0fa4-17ad-4d5b-8e07-10960d7c60a1 tempest-QuotasAdminTestJSON-590810396 tempest-QuotasAdminTestJSON-590810396-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:29.622490 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-233b0fa4-17ad-4d5b-8e07-10960d7c60a1 tempest-QuotasAdminTestJSON-590810396 tempest-QuotasAdminTestJSON-590810396-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:29.622945 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-233b0fa4-17ad-4d5b-8e07-10960d7c60a1 tempest-QuotasAdminTestJSON-590810396 tempest-QuotasAdminTestJSON-590810396-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:29.623671 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-233b0fa4-17ad-4d5b-8e07-10960d7c60a1 tempest-QuotasAdminTestJSON-590810396 tempest-QuotasAdminTestJSON-590810396-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:29.624157 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-233b0fa4-17ad-4d5b-8e07-10960d7c60a1 tempest-QuotasAdminTestJSON-590810396 tempest-QuotasAdminTestJSON-590810396-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:29.624584 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-233b0fa4-17ad-4d5b-8e07-10960d7c60a1 tempest-QuotasAdminTestJSON-590810396 tempest-QuotasAdminTestJSON-590810396-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:29.649707 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=93,nova_cell0:UPDATE=7 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:32:29.711499 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=1,nova_api:UPDATE=2,nova_api:SAVEPOINT=7,nova_api:RELEASE=7,nova_api:DELETE=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:32:29.734136 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c746baa1-d9c6-40c8-b031-b9ec3c92bb56 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:29.742787 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c746baa1-d9c6-40c8-b031-b9ec3c92bb56 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:29.744242 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c746baa1-d9c6-40c8-b031-b9ec3c92bb56 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:29.745401 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c746baa1-d9c6-40c8-b031-b9ec3c92bb56 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/9d255ae7-0aed-4692-8802-6733dfcccbd0" status: 200 len: 1559 microversion: 2.25 time: 0.156693 Sep 23 04:32:29.756089 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 276/504] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:32:29 2022] GET /compute/v2.1/servers/9d255ae7-0aed-4692-8802-6733dfcccbd0 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:32:29.759511 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-41bb3c40-3c9e-4663-b4b5-54fbc99c2a86 tempest-QuotasAdminNegativeTest-744404737 tempest-QuotasAdminNegativeTest-744404737-project-admin] Action: 'update', calling method: .version_select at 0x7ff1c021c940>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:32:29.949717 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-41bb3c40-3c9e-4663-b4b5-54fbc99c2a86 tempest-QuotasAdminNegativeTest-744404737 tempest-QuotasAdminNegativeTest-744404737-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:29.950250 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-41bb3c40-3c9e-4663-b4b5-54fbc99c2a86 tempest-QuotasAdminNegativeTest-744404737 tempest-QuotasAdminNegativeTest-744404737-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:29.950915 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-41bb3c40-3c9e-4663-b4b5-54fbc99c2a86 tempest-QuotasAdminNegativeTest-744404737 tempest-QuotasAdminNegativeTest-744404737-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:29.951603 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-41bb3c40-3c9e-4663-b4b5-54fbc99c2a86 tempest-QuotasAdminNegativeTest-744404737 tempest-QuotasAdminNegativeTest-744404737-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:29.956350 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-41bb3c40-3c9e-4663-b4b5-54fbc99c2a86 tempest-QuotasAdminNegativeTest-744404737 tempest-QuotasAdminNegativeTest-744404737-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:29.956350 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-41bb3c40-3c9e-4663-b4b5-54fbc99c2a86 tempest-QuotasAdminNegativeTest-744404737 tempest-QuotasAdminNegativeTest-744404737-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:30.105708 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-41bb3c40-3c9e-4663-b4b5-54fbc99c2a86 tempest-QuotasAdminNegativeTest-744404737 tempest-QuotasAdminNegativeTest-744404737-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/1c4be6203d8e4908bc001f56d7c431fc" status: 200 len: 325 microversion: 2.1 time: 0.357481 Sep 23 04:32:30.108437 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 277/505] 10.222.0.33 () {60 vars in 1262 bytes} [Fri Sep 23 04:32:29 2022] PUT /compute/v2.1/os-quota-sets/1c4be6203d8e4908bc001f56d7c431fc => generated 325 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:32:30.123277 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f4c88891-1e4a-4233-aef8-ac84ac871945 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:30.124310 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f4c88891-1e4a-4233-aef8-ac84ac871945 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] [instance: 9d255ae7-0aed-4692-8802-6733dfcccbd0] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:30.133016 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f4c88891-1e4a-4233-aef8-ac84ac871945 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:30.133536 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f4c88891-1e4a-4233-aef8-ac84ac871945 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:30.135094 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f4c88891-1e4a-4233-aef8-ac84ac871945 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:30.136142 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f4c88891-1e4a-4233-aef8-ac84ac871945 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:30.136777 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f4c88891-1e4a-4233-aef8-ac84ac871945 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:30.137718 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f4c88891-1e4a-4233-aef8-ac84ac871945 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:30.309963 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-f4c88891-1e4a-4233-aef8-ac84ac871945 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lazy-loading 'services' on Instance uuid 9d255ae7-0aed-4692-8802-6733dfcccbd0 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:32:30.328480 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f4c88891-1e4a-4233-aef8-ac84ac871945 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/9d255ae7-0aed-4692-8802-6733dfcccbd0" status: 200 len: 2052 microversion: 2.25 time: 0.218760 Sep 23 04:32:30.329548 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 278/506] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:32:30 2022] GET /compute/v2.1/servers/9d255ae7-0aed-4692-8802-6733dfcccbd0 => generated 2052 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:32:30.339205 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-41bac4ee-4aae-4375-aa54-47d3b3dbafa0 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:30.343273 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-41bac4ee-4aae-4375-aa54-47d3b3dbafa0 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: 0dff1738-81f1-4619-af74-44b7adc805b5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:30.346137 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-41bac4ee-4aae-4375-aa54-47d3b3dbafa0 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:30.346675 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-41bac4ee-4aae-4375-aa54-47d3b3dbafa0 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:30.347110 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-41bac4ee-4aae-4375-aa54-47d3b3dbafa0 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:30.347806 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-41bac4ee-4aae-4375-aa54-47d3b3dbafa0 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:30.348246 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-41bac4ee-4aae-4375-aa54-47d3b3dbafa0 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:30.348984 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-41bac4ee-4aae-4375-aa54-47d3b3dbafa0 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:30.414299 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-41bac4ee-4aae-4375-aa54-47d3b3dbafa0 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:30.422176 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-41bac4ee-4aae-4375-aa54-47d3b3dbafa0 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/0dff1738-81f1-4619-af74-44b7adc805b5" status: 200 len: 1271 microversion: 2.1 time: 0.086918 Sep 23 04:32:30.422781 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 279/507] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:32:30 2022] GET /compute/v2.1/servers/0dff1738-81f1-4619-af74-44b7adc805b5 => generated 1271 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:30.427233 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-02b7227c-162a-4279-a744-9ff585e223c3 tempest-QuotasAdminNegativeTest-985991856 tempest-QuotasAdminNegativeTest-985991856-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1835685373", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:32:30.480990 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.neutron [None req-02b7227c-162a-4279-a744-9ff585e223c3 tempest-QuotasAdminNegativeTest-985991856 tempest-QuotasAdminNegativeTest-985991856-project] validate_networks() for None {{(pid=122699) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:32:30.911110 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-02b7227c-162a-4279-a744-9ff585e223c3 tempest-QuotasAdminNegativeTest-985991856 tempest-QuotasAdminNegativeTest-985991856-project] Flavor limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:32:30.911531 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-02b7227c-162a-4279-a744-9ff585e223c3 tempest-QuotasAdminNegativeTest-985991856 tempest-QuotasAdminNegativeTest-985991856-project] Image limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:32:30.912019 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-02b7227c-162a-4279-a744-9ff585e223c3 tempest-QuotasAdminNegativeTest-985991856 tempest-QuotasAdminNegativeTest-985991856-project] Flavor pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:32:30.912426 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-02b7227c-162a-4279-a744-9ff585e223c3 tempest-QuotasAdminNegativeTest-985991856 tempest-QuotasAdminNegativeTest-985991856-project] Image pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:32:30.912835 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-02b7227c-162a-4279-a744-9ff585e223c3 tempest-QuotasAdminNegativeTest-985991856 tempest-QuotasAdminNegativeTest-985991856-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:32:30.922390 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-02b7227c-162a-4279-a744-9ff585e223c3 tempest-QuotasAdminNegativeTest-985991856 tempest-QuotasAdminNegativeTest-985991856-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:30.923008 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-02b7227c-162a-4279-a744-9ff585e223c3 tempest-QuotasAdminNegativeTest-985991856 tempest-QuotasAdminNegativeTest-985991856-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:30.925518 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-02b7227c-162a-4279-a744-9ff585e223c3 tempest-QuotasAdminNegativeTest-985991856 tempest-QuotasAdminNegativeTest-985991856-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:30.925518 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-02b7227c-162a-4279-a744-9ff585e223c3 tempest-QuotasAdminNegativeTest-985991856 tempest-QuotasAdminNegativeTest-985991856-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:30.925518 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-02b7227c-162a-4279-a744-9ff585e223c3 tempest-QuotasAdminNegativeTest-985991856 tempest-QuotasAdminNegativeTest-985991856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:30.925518 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-02b7227c-162a-4279-a744-9ff585e223c3 tempest-QuotasAdminNegativeTest-985991856 tempest-QuotasAdminNegativeTest-985991856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:30.944086 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-02b7227c-162a-4279-a744-9ff585e223c3 tempest-QuotasAdminNegativeTest-985991856 tempest-QuotasAdminNegativeTest-985991856-project] Getting quotas for project 1c4be6203d8e4908bc001f56d7c431fc. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:32:30.948785 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-02b7227c-162a-4279-a744-9ff585e223c3 tempest-QuotasAdminNegativeTest-985991856 tempest-QuotasAdminNegativeTest-985991856-project] Getting quotas for user a7670b443aa04c38a40cc977f0e75625 and project 1c4be6203d8e4908bc001f56d7c431fc. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:32:30.960615 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.utils [None req-02b7227c-162a-4279-a744-9ff585e223c3 tempest-QuotasAdminNegativeTest-985991856 tempest-QuotasAdminNegativeTest-985991856-project] ram quota exceeded for 1c4be6203d8e4908bc001f56d7c431fc, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=122699) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Sep 23 04:32:30.961430 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-02b7227c-162a-4279-a744-9ff585e223c3 tempest-QuotasAdminNegativeTest-985991856 tempest-QuotasAdminNegativeTest-985991856-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 23 04:32:30.965003 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-02b7227c-162a-4279-a744-9ff585e223c3 tempest-QuotasAdminNegativeTest-985991856 tempest-QuotasAdminNegativeTest-985991856-project] Request method failure captured: Sep 23 04:32:30.965003 n-d-846463-3 devstack@n-api.service[122699]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 23 04:32:30.965003 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:32:30.965003 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:32:30.965003 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:32:30.965003 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 145 Sep 23 04:32:30.965003 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:32:30.965003 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:32:30.965003 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:32:30.965003 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:32:30.965003 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTbUpjFvTpcmdLtCoRcHToBKTHxhXxYVIfHaJEXZxRioFR-MeJOIUt1v-sSHVzkTjI9VUGeUM9uouFAHP9dTQ6yr8LT1GhuHy3AW-_weQtiEAHEvt0t8kbaKhgyYZz31uW3YYcqOrqyt39EFZTWj885NYTAF5BPu_p5dOAIxPcy1488 Sep 23 04:32:30.965003 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:32:30.965003 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:32:30.965003 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:32:30.965003 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:32:30.965003 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:32:30.965003 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:32:30.965003 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 1c4be6203d8e4908bc001f56d7c431fc Sep 23 04:32:30.965003 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-QuotasAdminNegativeTest-985991856 Sep 23 04:32:30.965003 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:32:30.965003 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:32:30.966705 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1c4be6203d8e4908bc001f56d7c431fc", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1c4be6203d8e4908bc001f56d7c431fc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1c4be6203d8e4908bc001f56d7c431fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1c4be6203d8e4908bc001f56d7c431fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:32:30.966705 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-QuotasAdminNegativeTest-985991856 Sep 23 04:32:30.966705 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 1c4be6203d8e4908bc001f56d7c431fc Sep 23 04:32:30.966705 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-985991856 Sep 23 04:32:30.966705 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-QuotasAdminNegativeTest-985991856-project Sep 23 04:32:30.966705 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:32:30.966705 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:32:30.966705 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: a7670b443aa04c38a40cc977f0e75625 Sep 23 04:32:30.966705 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-QuotasAdminNegativeTest-985991856-project Sep 23 04:32:30.966705 n-d-846463-3 devstack@n-api.service[122699]: Sep 23 04:32:30.966705 n-d-846463-3 devstack@n-api.service[122699]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1835685373", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452"}} Sep 23 04:32:30.966705 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:32:30.967497 n-d-846463-3 devstack@n-api.service[122699]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 23 04:32:30.967497 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1835685373', 'imageRef': 'b8dd79b9-f0b9-43a9-9605-17244137c0ee', 'flavorRef': '452'}}} Sep 23 04:32:30.967497 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:32:30.967497 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:32:30.967497 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Sep 23 04:32:30.967497 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Sep 23 04:32:30.967497 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 04:32:30.967497 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 04:32:30.967497 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 23 04:32:30.967497 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc Sep 23 04:32:30.967497 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 23 04:32:30.967497 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 23 04:32:30.967497 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 04:32:30.967497 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 04:32:30.967497 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 23 04:32:30.967497 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 23 04:32:30.967497 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 23 04:32:30.967497 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 23 04:32:30.968727 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Sep 23 04:32:30.968727 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 23 04:32:30.968727 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Sep 23 04:32:30.968727 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:32:30.968727 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:32:30.968727 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:32:30.968727 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:32:30.968727 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 23 04:32:30.968727 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 23 04:32:30.968727 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 23 04:32:30.968727 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 23 04:32:30.968727 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Sep 23 04:32:30.968727 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Sep 23 04:32:30.968727 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Sep 23 04:32:30.968727 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Sep 23 04:32:30.968727 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Sep 23 04:32:30.968727 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 23 04:32:30.968727 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 23 04:32:30.968727 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:32:30.968727 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:32:30.968727 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:32:30.970208 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:32:30.970208 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:32:30.970208 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:32:30.970208 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:32:30.970208 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:32:30.970208 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:32:30.970208 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:32:30.970208 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:32:30.970208 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:32:30.970208 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:32:30.970208 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:32:30.970208 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:32:30.970208 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:32:30.970208 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 23 04:32:30.970208 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Sep 23 04:32:30.970208 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 23 04:32:30.970208 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 23 04:32:30.970208 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:32:30.970208 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:32:30.970208 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:32:30.970208 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:32:30.971435 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:32:30.971435 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:32:30.971435 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:32:30.971435 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:32:30.971435 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 23 04:32:30.971435 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:32:30.971435 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-02b7227c-162a-4279-a744-9ff585e223c3 tempest-QuotasAdminNegativeTest-985991856 tempest-QuotasAdminNegativeTest-985991856-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:32:30.971435 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-02b7227c-162a-4279-a744-9ff585e223c3 tempest-QuotasAdminNegativeTest-985991856 tempest-QuotasAdminNegativeTest-985991856-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.542764 Sep 23 04:32:30.971435 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 280/508] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:32:30 2022] POST /compute/v2.1/servers => generated 110 bytes in 544 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:32:30.975579 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f85f0c49-9854-434d-a7e9-e86c0063d6a8 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:30.975813 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f85f0c49-9854-434d-a7e9-e86c0063d6a8 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] [instance: 9d255ae7-0aed-4692-8802-6733dfcccbd0] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:30.982026 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f85f0c49-9854-434d-a7e9-e86c0063d6a8 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:30.982534 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f85f0c49-9854-434d-a7e9-e86c0063d6a8 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:30.983004 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f85f0c49-9854-434d-a7e9-e86c0063d6a8 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:30.983648 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f85f0c49-9854-434d-a7e9-e86c0063d6a8 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:30.984106 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f85f0c49-9854-434d-a7e9-e86c0063d6a8 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:30.984528 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f85f0c49-9854-434d-a7e9-e86c0063d6a8 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:31.023616 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-233b0fa4-17ad-4d5b-8e07-10960d7c60a1 tempest-QuotasAdminTestJSON-590810396 tempest-QuotasAdminTestJSON-590810396-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/59adedb6001d443cb8a761b94106d86b" status: 200 len: 329 microversion: 2.1 time: 1.509753 Sep 23 04:32:31.024920 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 229/509] 10.222.0.33 () {60 vars in 1263 bytes} [Fri Sep 23 04:32:29 2022] PUT /compute/v2.1/os-quota-sets/59adedb6001d443cb8a761b94106d86b => generated 329 bytes in 1520 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:32:31.029426 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-997da767-f519-4c63-83dc-28e546382363 req-af61a2f3-cbee-4f61-ad2d-35db07ea2a40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "699f43b8-e784-4553-836c-e8785632d903", "tag": "fd2ca279-498d-4084-acfd-485f86ccac66"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:32:31.041783 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-997da767-f519-4c63-83dc-28e546382363 req-af61a2f3-cbee-4f61-ad2d-35db07ea2a40 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:31.042375 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-997da767-f519-4c63-83dc-28e546382363 req-af61a2f3-cbee-4f61-ad2d-35db07ea2a40 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:31.042873 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-997da767-f519-4c63-83dc-28e546382363 req-af61a2f3-cbee-4f61-ad2d-35db07ea2a40 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:31.056371 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-997da767-f519-4c63-83dc-28e546382363 req-af61a2f3-cbee-4f61-ad2d-35db07ea2a40 service nova] Creating event network-changed:fd2ca279-498d-4084-acfd-485f86ccac66 for instance 699f43b8-e784-4553-836c-e8785632d903 on n-h2-846463-3 Sep 23 04:32:31.061666 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-997da767-f519-4c63-83dc-28e546382363 req-af61a2f3-cbee-4f61-ad2d-35db07ea2a40 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035414 Sep 23 04:32:31.062604 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 230/510] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:32:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:32:31.069433 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9de2d5a8-ec16-425c-9513-80ff407e9bea tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:31.069433 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-9de2d5a8-ec16-425c-9513-80ff407e9bea tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] [instance: ed83bf5a-f3ce-4b5c-af6f-92b80599a022] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:31.076322 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9de2d5a8-ec16-425c-9513-80ff407e9bea tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:31.076827 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9de2d5a8-ec16-425c-9513-80ff407e9bea tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:31.077267 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9de2d5a8-ec16-425c-9513-80ff407e9bea tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:31.077997 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9de2d5a8-ec16-425c-9513-80ff407e9bea tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:31.078486 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9de2d5a8-ec16-425c-9513-80ff407e9bea tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:31.078872 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9de2d5a8-ec16-425c-9513-80ff407e9bea tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:31.140921 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-f85f0c49-9854-434d-a7e9-e86c0063d6a8 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lazy-loading 'services' on Instance uuid 9d255ae7-0aed-4692-8802-6733dfcccbd0 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:32:31.148976 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:32:31.159622 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f85f0c49-9854-434d-a7e9-e86c0063d6a8 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/9d255ae7-0aed-4692-8802-6733dfcccbd0" status: 200 len: 2052 microversion: 2.25 time: 0.188303 Sep 23 04:32:31.160209 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 281/511] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:32:30 2022] GET /compute/v2.1/servers/9d255ae7-0aed-4692-8802-6733dfcccbd0 => generated 2052 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:32:31.165130 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e2ba4db6-3ebe-41db-9935-503964544e38 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:31.166330 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e2ba4db6-3ebe-41db-9935-503964544e38 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] [instance: 699f43b8-e784-4553-836c-e8785632d903] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:31.176596 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e2ba4db6-3ebe-41db-9935-503964544e38 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:31.177190 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e2ba4db6-3ebe-41db-9935-503964544e38 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:31.178417 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e2ba4db6-3ebe-41db-9935-503964544e38 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:31.179140 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e2ba4db6-3ebe-41db-9935-503964544e38 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:31.181458 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e2ba4db6-3ebe-41db-9935-503964544e38 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:31.182177 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e2ba4db6-3ebe-41db-9935-503964544e38 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:31.185264 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-9de2d5a8-ec16-425c-9513-80ff407e9bea tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54d1a7a9e4ee44b9992ff9362108b311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649eb80e1ea849868c651849047833e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:31.194006 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9de2d5a8-ec16-425c-9513-80ff407e9bea tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] 10.222.0.33 "GET /compute/v2.1/servers/ed83bf5a-f3ce-4b5c-af6f-92b80599a022" status: 200 len: 1436 microversion: 2.1 time: 0.129519 Sep 23 04:32:31.194910 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 231/512] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:32:31 2022] GET /compute/v2.1/servers/ed83bf5a-f3ce-4b5c-af6f-92b80599a022 => generated 1436 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:31.222592 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1963bad3-f888-4c8c-b2cd-4046814ebd03 tempest-QuotasAdminNegativeTest-744404737 tempest-QuotasAdminNegativeTest-744404737-project-admin] Action: 'update', calling method: .version_select at 0x7ff1c00e54c0>, body: {"quota_set": {"ram": 51200}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:32:31.396321 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e2ba4db6-3ebe-41db-9935-503964544e38 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcc413bf53847b89cfe6bdf48909ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c7c21aa6b342b6bc52365cfdeb7c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:31.410664 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e2ba4db6-3ebe-41db-9935-503964544e38 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] 10.222.0.33 "GET /compute/v2.1/servers/699f43b8-e784-4553-836c-e8785632d903" status: 200 len: 1389 microversion: 2.1 time: 0.249131 Sep 23 04:32:31.412558 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 282/513] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:32:31 2022] GET /compute/v2.1/servers/699f43b8-e784-4553-836c-e8785632d903 => generated 1389 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:31.430697 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-344034a0-01ea-4897-9fcc-1576fd57ab98 tempest-QuotasAdminTestJSON-590810396 tempest-QuotasAdminTestJSON-590810396-project-admin] Action: 'update', calling method: .version_select at 0x7ff1c0c22550>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:32:31.457317 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1963bad3-f888-4c8c-b2cd-4046814ebd03 tempest-QuotasAdminNegativeTest-744404737 tempest-QuotasAdminNegativeTest-744404737-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:31.458232 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1963bad3-f888-4c8c-b2cd-4046814ebd03 tempest-QuotasAdminNegativeTest-744404737 tempest-QuotasAdminNegativeTest-744404737-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:31.458937 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1963bad3-f888-4c8c-b2cd-4046814ebd03 tempest-QuotasAdminNegativeTest-744404737 tempest-QuotasAdminNegativeTest-744404737-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:31.460038 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1963bad3-f888-4c8c-b2cd-4046814ebd03 tempest-QuotasAdminNegativeTest-744404737 tempest-QuotasAdminNegativeTest-744404737-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:31.460510 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1963bad3-f888-4c8c-b2cd-4046814ebd03 tempest-QuotasAdminNegativeTest-744404737 tempest-QuotasAdminNegativeTest-744404737-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:31.460943 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1963bad3-f888-4c8c-b2cd-4046814ebd03 tempest-QuotasAdminNegativeTest-744404737 tempest-QuotasAdminNegativeTest-744404737-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:31.603243 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-344034a0-01ea-4897-9fcc-1576fd57ab98 tempest-QuotasAdminTestJSON-590810396 tempest-QuotasAdminTestJSON-590810396-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:31.603924 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-344034a0-01ea-4897-9fcc-1576fd57ab98 tempest-QuotasAdminTestJSON-590810396 tempest-QuotasAdminTestJSON-590810396-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:31.604372 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-344034a0-01ea-4897-9fcc-1576fd57ab98 tempest-QuotasAdminTestJSON-590810396 tempest-QuotasAdminTestJSON-590810396-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:31.605106 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-344034a0-01ea-4897-9fcc-1576fd57ab98 tempest-QuotasAdminTestJSON-590810396 tempest-QuotasAdminTestJSON-590810396-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:31.605844 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-344034a0-01ea-4897-9fcc-1576fd57ab98 tempest-QuotasAdminTestJSON-590810396 tempest-QuotasAdminTestJSON-590810396-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:31.606055 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-344034a0-01ea-4897-9fcc-1576fd57ab98 tempest-QuotasAdminTestJSON-590810396 tempest-QuotasAdminTestJSON-590810396-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:31.664639 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-1963bad3-f888-4c8c-b2cd-4046814ebd03 tempest-QuotasAdminNegativeTest-744404737 tempest-QuotasAdminNegativeTest-744404737-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/1c4be6203d8e4908bc001f56d7c431fc" status: 200 len: 329 microversion: 2.1 time: 0.468390 Sep 23 04:32:31.665856 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 232/514] 10.222.0.33 () {60 vars in 1262 bytes} [Fri Sep 23 04:32:31 2022] PUT /compute/v2.1/os-quota-sets/1c4be6203d8e4908bc001f56d7c431fc => generated 329 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:32:31.673411 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ec5f41b5-6864-4d0c-be8b-245d7ca6af04 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:31.678817 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ec5f41b5-6864-4d0c-be8b-245d7ca6af04 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:31.679573 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ec5f41b5-6864-4d0c-be8b-245d7ca6af04 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:31.690175 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ec5f41b5-6864-4d0c-be8b-245d7ca6af04 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:31.691330 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ec5f41b5-6864-4d0c-be8b-245d7ca6af04 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:31.692088 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ec5f41b5-6864-4d0c-be8b-245d7ca6af04 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:31.693086 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ec5f41b5-6864-4d0c-be8b-245d7ca6af04 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:31.740121 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ec5f41b5-6864-4d0c-be8b-245d7ca6af04 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.072627 Sep 23 04:32:31.741647 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 233/515] 10.222.0.33 () {60 vars in 1217 bytes} [Fri Sep 23 04:32:31 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 04:32:31.753858 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-79377c8f-1864-416f-8f4a-3774c8a40664 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:31.754507 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-79377c8f-1864-416f-8f4a-3774c8a40664 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: 0dff1738-81f1-4619-af74-44b7adc805b5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:31.762392 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-79377c8f-1864-416f-8f4a-3774c8a40664 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:31.763094 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-79377c8f-1864-416f-8f4a-3774c8a40664 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:31.764013 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-79377c8f-1864-416f-8f4a-3774c8a40664 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:31.764880 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-79377c8f-1864-416f-8f4a-3774c8a40664 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:31.765517 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-79377c8f-1864-416f-8f4a-3774c8a40664 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:31.768093 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-79377c8f-1864-416f-8f4a-3774c8a40664 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:31.816118 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=2,nova_api:DELETE=4,nova_api:UPDATE=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:32:31.983351 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-79377c8f-1864-416f-8f4a-3774c8a40664 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:31.994067 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-79377c8f-1864-416f-8f4a-3774c8a40664 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/0dff1738-81f1-4619-af74-44b7adc805b5" status: 200 len: 1313 microversion: 2.1 time: 0.251011 Sep 23 04:32:31.994963 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 234/516] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:32:31 2022] GET /compute/v2.1/servers/0dff1738-81f1-4619-af74-44b7adc805b5 => generated 1313 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:32.000678 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-50dc3b21-3994-4b97-9b76-18deb06ebe10 tempest-QuotasAdminNegativeTest-985991856 tempest-QuotasAdminNegativeTest-985991856-project] Action: 'update', calling method: .version_select at 0x7ff1c00a0040>, body: {"quota_set": {"ram": 0}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:32:32.007195 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-50dc3b21-3994-4b97-9b76-18deb06ebe10 tempest-QuotasAdminNegativeTest-985991856 tempest-QuotasAdminNegativeTest-985991856-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': 'a7670b443aa04c38a40cc977f0e75625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4be6203d8e4908bc001f56d7c431fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:32.009661 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-50dc3b21-3994-4b97-9b76-18deb06ebe10 tempest-QuotasAdminNegativeTest-985991856 tempest-QuotasAdminNegativeTest-985991856-project] Request method failure captured: Sep 23 04:32:32.009661 n-d-846463-3 devstack@n-api.service[122698]: request: PUT /compute/v2.1/os-quota-sets/1c4be6203d8e4908bc001f56d7c431fc HTTP/1.1 Sep 23 04:32:32.009661 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:32:32.009661 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:32:32.009661 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:32:32.009661 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 25 Sep 23 04:32:32.009661 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:32:32.009661 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:32:32.009661 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:32:32.009661 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:32:32.009661 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTbUpjFvTpcmdLtCoRcHToBKTHxhXxYVIfHaJEXZxRioFR-MeJOIUt1v-sSHVzkTjI9VUGeUM9uouFAHP9dTQ6yr8LT1GhuHy3AW-_weQtiEAHEvt0t8kbaKhgyYZz31uW3YYcqOrqyt39EFZTWj885NYTAF5BPu_p5dOAIxPcy1488 Sep 23 04:32:32.009661 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:32:32.009661 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:32:32.009661 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:32:32.009661 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:32:32.009661 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:32:32.009661 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:32:32.009661 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 1c4be6203d8e4908bc001f56d7c431fc Sep 23 04:32:32.009661 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-QuotasAdminNegativeTest-985991856 Sep 23 04:32:32.009661 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:32:32.009661 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:32:32.011608 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1c4be6203d8e4908bc001f56d7c431fc", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1c4be6203d8e4908bc001f56d7c431fc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1c4be6203d8e4908bc001f56d7c431fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1c4be6203d8e4908bc001f56d7c431fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:32:32.011608 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-QuotasAdminNegativeTest-985991856 Sep 23 04:32:32.011608 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 1c4be6203d8e4908bc001f56d7c431fc Sep 23 04:32:32.011608 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-985991856 Sep 23 04:32:32.011608 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-QuotasAdminNegativeTest-985991856-project Sep 23 04:32:32.011608 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:32:32.011608 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:32:32.011608 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: a7670b443aa04c38a40cc977f0e75625 Sep 23 04:32:32.011608 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-QuotasAdminNegativeTest-985991856-project Sep 23 04:32:32.011608 n-d-846463-3 devstack@n-api.service[122698]: Sep 23 04:32:32.011608 n-d-846463-3 devstack@n-api.service[122698]: {"quota_set": {"ram": 0}} Sep 23 04:32:32.011608 n-d-846463-3 devstack@n-api.service[122698]: method: Sep 23 04:32:32.011608 n-d-846463-3 devstack@n-api.service[122698]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Sep 23 04:32:32.011608 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '1c4be6203d8e4908bc001f56d7c431fc', 'body': {'quota_set': {'ram': 0}}} Sep 23 04:32:32.012476 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:32:32.012476 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:32:32.012476 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:32:32.012476 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:32:32.012476 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:32:32.012476 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:32:32.012476 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:32:32.012476 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:32:32.012476 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:32:32.012476 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:32:32.012476 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:32:32.012476 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:32:32.012476 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Sep 23 04:32:32.012476 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Sep 23 04:32:32.012476 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 23 04:32:32.012476 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:32:32.012476 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 23 04:32:32.012476 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:32:32.012476 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Sep 23 04:32:32.013546 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Sep 23 04:32:32.013546 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 23 04:32:32.013546 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 23 04:32:32.013546 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 23 04:32:32.013546 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 23 04:32:32.013546 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 23 04:32:32.013546 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 23 04:32:32.013546 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 23 04:32:32.013546 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise self.value Sep 23 04:32:32.013546 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 23 04:32:32.013546 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 23 04:32:32.013546 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 23 04:32:32.013546 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 23 04:32:32.013546 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 23 04:32:32.013546 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 23 04:32:32.013546 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Sep 23 04:32:32.013546 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:32:32.013546 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:32:32.013546 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:32:32.013546 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:32:32.026331 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:32:32.026331 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:32:32.026331 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 23 04:32:32.026331 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 23 04:32:32.026331 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Sep 23 04:32:32.026331 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:32:32.026331 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-50dc3b21-3994-4b97-9b76-18deb06ebe10 tempest-QuotasAdminNegativeTest-985991856 tempest-QuotasAdminNegativeTest-985991856-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:32:32.026331 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-50dc3b21-3994-4b97-9b76-18deb06ebe10 tempest-QuotasAdminNegativeTest-985991856 tempest-QuotasAdminNegativeTest-985991856-project] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/1c4be6203d8e4908bc001f56d7c431fc" status: 403 len: 116 microversion: 2.1 time: 0.020085 Sep 23 04:32:32.026331 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 235/517] 10.222.0.33 () {60 vars in 1262 bytes} [Fri Sep 23 04:32:31 2022] PUT /compute/v2.1/os-quota-sets/1c4be6203d8e4908bc001f56d7c431fc => generated 116 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:32:32.034324 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0f4aa770-f214-4a7c-a4f9-815042f8c6a8 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:32:32.034917 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-0f4aa770-f214-4a7c-a4f9-815042f8c6a8 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] [instance: 9d255ae7-0aed-4692-8802-6733dfcccbd0] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:32.052944 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0f4aa770-f214-4a7c-a4f9-815042f8c6a8 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:32.053488 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0f4aa770-f214-4a7c-a4f9-815042f8c6a8 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:32.054475 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0f4aa770-f214-4a7c-a4f9-815042f8c6a8 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:32.056222 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0f4aa770-f214-4a7c-a4f9-815042f8c6a8 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:32.057524 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0f4aa770-f214-4a7c-a4f9-815042f8c6a8 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:32.061528 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0f4aa770-f214-4a7c-a4f9-815042f8c6a8 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:32.070920 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:32:32.319311 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0f4aa770-f214-4a7c-a4f9-815042f8c6a8 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/9d255ae7-0aed-4692-8802-6733dfcccbd0/action" status: 202 len: 0 microversion: 2.25 time: 0.300488 Sep 23 04:32:32.323149 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 236/518] 10.222.0.33 () {62 vars in 1319 bytes} [Fri Sep 23 04:32:32 2022] POST /compute/v2.1/servers/9d255ae7-0aed-4692-8802-6733dfcccbd0/action => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:32:32.337533 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4a336cd4-f6f1-4ab2-ad6a-60483b73a6de tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:32.338279 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4a336cd4-f6f1-4ab2-ad6a-60483b73a6de tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] [instance: ed83bf5a-f3ce-4b5c-af6f-92b80599a022] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:32.349554 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4a336cd4-f6f1-4ab2-ad6a-60483b73a6de tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:32.353046 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4a336cd4-f6f1-4ab2-ad6a-60483b73a6de tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:32.357137 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4a336cd4-f6f1-4ab2-ad6a-60483b73a6de tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:32.362908 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4a336cd4-f6f1-4ab2-ad6a-60483b73a6de tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:32.362908 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4a336cd4-f6f1-4ab2-ad6a-60483b73a6de tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:32.362908 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4a336cd4-f6f1-4ab2-ad6a-60483b73a6de tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:32.395496 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4a336cd4-f6f1-4ab2-ad6a-60483b73a6de tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:32.403177 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4a336cd4-f6f1-4ab2-ad6a-60483b73a6de tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:32.404474 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4a336cd4-f6f1-4ab2-ad6a-60483b73a6de tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:32.404474 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-4a336cd4-f6f1-4ab2-ad6a-60483b73a6de tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lazy-loading 'fault' on Instance uuid ed83bf5a-f3ce-4b5c-af6f-92b80599a022 {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:32:32.450174 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4a336cd4-f6f1-4ab2-ad6a-60483b73a6de tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54d1a7a9e4ee44b9992ff9362108b311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649eb80e1ea849868c651849047833e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:32.462844 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4a336cd4-f6f1-4ab2-ad6a-60483b73a6de tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] 10.222.0.33 "GET /compute/v2.1/servers/ed83bf5a-f3ce-4b5c-af6f-92b80599a022" status: 200 len: 1312 microversion: 2.1 time: 0.141438 Sep 23 04:32:32.464941 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 237/519] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:32:32 2022] GET /compute/v2.1/servers/ed83bf5a-f3ce-4b5c-af6f-92b80599a022 => generated 1312 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:32.468577 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ff447688-59ef-4ec6-9db4-7f50043dfab4 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:32.469183 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-ff447688-59ef-4ec6-9db4-7f50043dfab4 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] [instance: 9d255ae7-0aed-4692-8802-6733dfcccbd0] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:32.475815 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ff447688-59ef-4ec6-9db4-7f50043dfab4 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:32.476302 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ff447688-59ef-4ec6-9db4-7f50043dfab4 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:32.477218 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ff447688-59ef-4ec6-9db4-7f50043dfab4 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:32.477927 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ff447688-59ef-4ec6-9db4-7f50043dfab4 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:32.478391 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ff447688-59ef-4ec6-9db4-7f50043dfab4 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:32.478797 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ff447688-59ef-4ec6-9db4-7f50043dfab4 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:32.629218 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-ff447688-59ef-4ec6-9db4-7f50043dfab4 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lazy-loading 'services' on Instance uuid 9d255ae7-0aed-4692-8802-6733dfcccbd0 {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:32:32.658309 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ff447688-59ef-4ec6-9db4-7f50043dfab4 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/9d255ae7-0aed-4692-8802-6733dfcccbd0" status: 200 len: 2057 microversion: 2.25 time: 0.193648 Sep 23 04:32:32.660847 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 238/520] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:32:32 2022] GET /compute/v2.1/servers/9d255ae7-0aed-4692-8802-6733dfcccbd0 => generated 2057 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:32:32.666401 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d3c9277c-fc55-4d58-a74b-7ca1b67aef3c tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:32.667205 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d3c9277c-fc55-4d58-a74b-7ca1b67aef3c tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] [instance: 699f43b8-e784-4553-836c-e8785632d903] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:32.691696 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d3c9277c-fc55-4d58-a74b-7ca1b67aef3c tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:32.692492 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d3c9277c-fc55-4d58-a74b-7ca1b67aef3c tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:32.693013 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d3c9277c-fc55-4d58-a74b-7ca1b67aef3c tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:32.693826 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d3c9277c-fc55-4d58-a74b-7ca1b67aef3c tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:32.694537 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d3c9277c-fc55-4d58-a74b-7ca1b67aef3c tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:32.695195 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d3c9277c-fc55-4d58-a74b-7ca1b67aef3c tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:32.869336 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d3c9277c-fc55-4d58-a74b-7ca1b67aef3c tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcc413bf53847b89cfe6bdf48909ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c7c21aa6b342b6bc52365cfdeb7c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:32.879649 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d3c9277c-fc55-4d58-a74b-7ca1b67aef3c tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] 10.222.0.33 "GET /compute/v2.1/servers/699f43b8-e784-4553-836c-e8785632d903" status: 200 len: 1389 microversion: 2.1 time: 0.217021 Sep 23 04:32:32.881489 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 239/521] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:32:32 2022] GET /compute/v2.1/servers/699f43b8-e784-4553-836c-e8785632d903 => generated 1389 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:33.022729 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f3f6b64a-a7a3-48bc-a912-26f37f320704 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:33.023344 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f3f6b64a-a7a3-48bc-a912-26f37f320704 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: 0dff1738-81f1-4619-af74-44b7adc805b5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:33.030741 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f3f6b64a-a7a3-48bc-a912-26f37f320704 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:33.031818 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f3f6b64a-a7a3-48bc-a912-26f37f320704 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:33.032296 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f3f6b64a-a7a3-48bc-a912-26f37f320704 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:33.032998 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f3f6b64a-a7a3-48bc-a912-26f37f320704 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:33.033459 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f3f6b64a-a7a3-48bc-a912-26f37f320704 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:33.033911 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f3f6b64a-a7a3-48bc-a912-26f37f320704 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:33.068198 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=100 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:32:33.230917 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f3f6b64a-a7a3-48bc-a912-26f37f320704 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:33.240536 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f3f6b64a-a7a3-48bc-a912-26f37f320704 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/0dff1738-81f1-4619-af74-44b7adc805b5" status: 200 len: 1313 microversion: 2.1 time: 0.225869 Sep 23 04:32:33.241435 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 240/522] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:32:33 2022] GET /compute/v2.1/servers/0dff1738-81f1-4619-af74-44b7adc805b5 => generated 1313 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:32:33.255756 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-df5cbd15-45aa-41c0-af0d-9ad0dce42484 req-ada260d8-5794-4cd0-aeb9-ab58c234b8d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed83bf5a-f3ce-4b5c-af6f-92b80599a022", "name": "network-vif-deleted", "tag": "76175fda-bb1d-4f82-bc8b-0c30bf8aee3f"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:32:33.286730 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-df5cbd15-45aa-41c0-af0d-9ad0dce42484 req-ada260d8-5794-4cd0-aeb9-ab58c234b8d8 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:33.287331 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-df5cbd15-45aa-41c0-af0d-9ad0dce42484 req-ada260d8-5794-4cd0-aeb9-ab58c234b8d8 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:33.288506 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-df5cbd15-45aa-41c0-af0d-9ad0dce42484 req-ada260d8-5794-4cd0-aeb9-ab58c234b8d8 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:33.304899 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-df5cbd15-45aa-41c0-af0d-9ad0dce42484 req-ada260d8-5794-4cd0-aeb9-ab58c234b8d8 service nova] Creating event network-vif-deleted:76175fda-bb1d-4f82-bc8b-0c30bf8aee3f for instance ed83bf5a-f3ce-4b5c-af6f-92b80599a022 on n-h1-846463-3 Sep 23 04:32:33.311291 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-df5cbd15-45aa-41c0-af0d-9ad0dce42484 req-ada260d8-5794-4cd0-aeb9-ab58c234b8d8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067516 Sep 23 04:32:33.312390 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 241/523] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:32:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:32:33.489036 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c83f3a23-859e-40b2-a1e7-e4eda66bfe6a tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:33.489740 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c83f3a23-859e-40b2-a1e7-e4eda66bfe6a tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] [instance: ed83bf5a-f3ce-4b5c-af6f-92b80599a022] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:33.498977 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c83f3a23-859e-40b2-a1e7-e4eda66bfe6a tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:33.499601 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c83f3a23-859e-40b2-a1e7-e4eda66bfe6a tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:33.500456 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c83f3a23-859e-40b2-a1e7-e4eda66bfe6a tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:33.502122 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c83f3a23-859e-40b2-a1e7-e4eda66bfe6a tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:33.502755 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c83f3a23-859e-40b2-a1e7-e4eda66bfe6a tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:33.503502 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c83f3a23-859e-40b2-a1e7-e4eda66bfe6a tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:33.520717 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-c83f3a23-859e-40b2-a1e7-e4eda66bfe6a tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] HTTP exception thrown: Instance ed83bf5a-f3ce-4b5c-af6f-92b80599a022 could not be found. Sep 23 04:32:33.522530 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c83f3a23-859e-40b2-a1e7-e4eda66bfe6a tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Request method failure captured: Sep 23 04:32:33.522530 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/ed83bf5a-f3ce-4b5c-af6f-92b80599a022 HTTP/1.1 Sep 23 04:32:33.522530 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:32:33.522530 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:32:33.522530 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:32:33.522530 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:32:33.522530 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:32:33.522530 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:32:33.522530 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:32:33.522530 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:32:33.522530 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTaotd2IYzcO_4sjT2Wu1qIv2KGCuvro0KpKYSzqiRu60Ry6_ZevKKYXBrxjldNssaMOtrNZdX0yannlf_OMUE1Y2MF30WNeQQx7LL_-gqPxsRdgd2PGzDFLCkkq0ejYvXToGO4O3HmuZrJbbgwY8BWr2Rm0XOM-jAVtXf3kWuw3JZc Sep 23 04:32:33.522530 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:32:33.522530 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:32:33.522530 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:32:33.522530 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:32:33.522530 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:32:33.522530 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:32:33.522530 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 649eb80e1ea849868c651849047833e1 Sep 23 04:32:33.522530 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1032390530 Sep 23 04:32:33.522530 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:32:33.522530 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:32:33.523788 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_649eb80e1ea849868c651849047833e1", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/649eb80e1ea849868c651849047833e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/649eb80e1ea849868c651849047833e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/649eb80e1ea849868c651849047833e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:32:33.523788 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1032390530 Sep 23 04:32:33.523788 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 649eb80e1ea849868c651849047833e1 Sep 23 04:32:33.523788 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1032390530 Sep 23 04:32:33.523788 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ServersAdminNegativeTestJSON-1032390530-project Sep 23 04:32:33.523788 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:32:33.523788 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:32:33.523788 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 54d1a7a9e4ee44b9992ff9362108b311 Sep 23 04:32:33.523788 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1032390530-project Sep 23 04:32:33.523788 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:32:33.523788 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance ed83bf5a-f3ce-4b5c-af6f-92b80599a022 could not be found. Sep 23 04:32:33.523788 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': 'ed83bf5a-f3ce-4b5c-af6f-92b80599a022'} Sep 23 04:32:33.524543 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:32:33.524543 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:32:33.524543 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:32:33.524543 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:32:33.524543 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:32:33.524543 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:32:33.524543 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:32:33.524543 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:32:33.524543 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:32:33.524543 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:32:33.524543 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed83bf5a-f3ce-4b5c-af6f-92b80599a022 could not be found. Sep 23 04:32:33.524543 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:32:33.524543 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:32:33.524543 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:32:33.524543 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:32:33.524543 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:32:33.524543 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:32:33.524543 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:32:33.524543 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:32:33.524543 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:32:33.525680 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:32:33.525680 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:32:33.525680 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:32:33.525680 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:32:33.525680 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:32:33.525680 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:32:33.525680 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:32:33.525680 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed83bf5a-f3ce-4b5c-af6f-92b80599a022 could not be found. Sep 23 04:32:33.525680 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:32:33.525680 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:32:33.525680 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:32:33.525680 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:32:33.525680 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:32:33.525680 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:32:33.525680 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:32:33.525680 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:32:33.525680 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed83bf5a-f3ce-4b5c-af6f-92b80599a022 could not be found. Sep 23 04:32:33.525680 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:32:33.526789 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c83f3a23-859e-40b2-a1e7-e4eda66bfe6a tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] Returning 404 to user: Instance ed83bf5a-f3ce-4b5c-af6f-92b80599a022 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:32:33.526789 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c83f3a23-859e-40b2-a1e7-e4eda66bfe6a tempest-ServersAdminNegativeTestJSON-1032390530 tempest-ServersAdminNegativeTestJSON-1032390530-project] 10.222.0.33 "GET /compute/v2.1/servers/ed83bf5a-f3ce-4b5c-af6f-92b80599a022" status: 404 len: 111 microversion: 2.1 time: 0.039657 Sep 23 04:32:33.526789 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 242/524] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:32:33 2022] GET /compute/v2.1/servers/ed83bf5a-f3ce-4b5c-af6f-92b80599a022 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 04:32:33.684721 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5ce940d0-a78b-4a54-94e6-4cd35512143a tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:33.685343 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5ce940d0-a78b-4a54-94e6-4cd35512143a tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] [instance: 9d255ae7-0aed-4692-8802-6733dfcccbd0] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:33.694334 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5ce940d0-a78b-4a54-94e6-4cd35512143a tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:33.695098 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5ce940d0-a78b-4a54-94e6-4cd35512143a tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:33.695879 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5ce940d0-a78b-4a54-94e6-4cd35512143a tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:33.697268 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5ce940d0-a78b-4a54-94e6-4cd35512143a tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:33.697471 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5ce940d0-a78b-4a54-94e6-4cd35512143a tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:33.698184 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5ce940d0-a78b-4a54-94e6-4cd35512143a tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:33.812318 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-344034a0-01ea-4897-9fcc-1576fd57ab98 tempest-QuotasAdminTestJSON-590810396 tempest-QuotasAdminTestJSON-590810396-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/59adedb6001d443cb8a761b94106d86b" status: 200 len: 329 microversion: 2.1 time: 2.398146 Sep 23 04:32:33.812918 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 283/525] 10.222.0.33 () {60 vars in 1263 bytes} [Fri Sep 23 04:32:31 2022] PUT /compute/v2.1/os-quota-sets/59adedb6001d443cb8a761b94106d86b => generated 329 bytes in 2399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:32:33.862340 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-5ce940d0-a78b-4a54-94e6-4cd35512143a tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lazy-loading 'services' on Instance uuid 9d255ae7-0aed-4692-8802-6733dfcccbd0 {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:32:33.882860 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5ce940d0-a78b-4a54-94e6-4cd35512143a tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/9d255ae7-0aed-4692-8802-6733dfcccbd0" status: 200 len: 2037 microversion: 2.25 time: 0.201318 Sep 23 04:32:33.883777 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 243/526] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:32:33 2022] GET /compute/v2.1/servers/9d255ae7-0aed-4692-8802-6733dfcccbd0 => generated 2037 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:32:33.905672 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b342aede-4a47-4843-9668-ae3f00059ffb tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:33.906220 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b342aede-4a47-4843-9668-ae3f00059ffb tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] [instance: 699f43b8-e784-4553-836c-e8785632d903] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:33.912605 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-89bf7bd3-0d02-45b5-ad2a-df2685ed58d2 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-846463-3", "block_migration": "auto"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:32:33.917411 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-89bf7bd3-0d02-45b5-ad2a-df2685ed58d2 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] [instance: 9d255ae7-0aed-4692-8802-6733dfcccbd0] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:33.928991 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b342aede-4a47-4843-9668-ae3f00059ffb tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:33.929722 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b342aede-4a47-4843-9668-ae3f00059ffb tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:33.930351 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b342aede-4a47-4843-9668-ae3f00059ffb tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:33.931431 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b342aede-4a47-4843-9668-ae3f00059ffb tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:33.932399 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b342aede-4a47-4843-9668-ae3f00059ffb tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:33.933147 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b342aede-4a47-4843-9668-ae3f00059ffb tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:33.937868 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-89bf7bd3-0d02-45b5-ad2a-df2685ed58d2 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:33.939493 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-89bf7bd3-0d02-45b5-ad2a-df2685ed58d2 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:33.951401 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-89bf7bd3-0d02-45b5-ad2a-df2685ed58d2 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:33.951401 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-89bf7bd3-0d02-45b5-ad2a-df2685ed58d2 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:33.951401 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-89bf7bd3-0d02-45b5-ad2a-df2685ed58d2 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:33.951401 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-89bf7bd3-0d02-45b5-ad2a-df2685ed58d2 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:33.981433 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-89bf7bd3-0d02-45b5-ad2a-df2685ed58d2 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lazy-loading 'flavor' on Instance uuid 9d255ae7-0aed-4692-8802-6733dfcccbd0 {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:32:33.996754 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-89bf7bd3-0d02-45b5-ad2a-df2685ed58d2 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] [instance: 9d255ae7-0aed-4692-8802-6733dfcccbd0] Going to try to live migrate instance to n-h1-846463-3 {{(pid=122698) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 23 04:32:34.091077 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b342aede-4a47-4843-9668-ae3f00059ffb tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcc413bf53847b89cfe6bdf48909ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c7c21aa6b342b6bc52365cfdeb7c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:34.122205 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b342aede-4a47-4843-9668-ae3f00059ffb tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] 10.222.0.33 "GET /compute/v2.1/servers/699f43b8-e784-4553-836c-e8785632d903" status: 200 len: 1389 microversion: 2.1 time: 0.206153 Sep 23 04:32:34.122205 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 284/527] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:32:33 2022] GET /compute/v2.1/servers/699f43b8-e784-4553-836c-e8785632d903 => generated 1389 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:34.265023 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-97a516f5-9b3a-47c3-ab11-61a626016490 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:34.265914 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-97a516f5-9b3a-47c3-ab11-61a626016490 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: 0dff1738-81f1-4619-af74-44b7adc805b5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:34.273754 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-97a516f5-9b3a-47c3-ab11-61a626016490 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:34.274296 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-97a516f5-9b3a-47c3-ab11-61a626016490 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:34.274737 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-97a516f5-9b3a-47c3-ab11-61a626016490 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:34.275564 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-97a516f5-9b3a-47c3-ab11-61a626016490 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:34.276154 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-97a516f5-9b3a-47c3-ab11-61a626016490 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:34.276976 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-97a516f5-9b3a-47c3-ab11-61a626016490 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:34.412304 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-97a516f5-9b3a-47c3-ab11-61a626016490 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:34.420580 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-97a516f5-9b3a-47c3-ab11-61a626016490 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/0dff1738-81f1-4619-af74-44b7adc805b5" status: 200 len: 1313 microversion: 2.1 time: 0.159693 Sep 23 04:32:34.421164 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 285/528] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:32:34 2022] GET /compute/v2.1/servers/0dff1738-81f1-4619-af74-44b7adc805b5 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:32:35.135968 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ce7f0317-21e2-48e8-8b0a-05d0e749d7a3 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:35.136604 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ce7f0317-21e2-48e8-8b0a-05d0e749d7a3 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] [instance: 699f43b8-e784-4553-836c-e8785632d903] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:35.152186 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ce7f0317-21e2-48e8-8b0a-05d0e749d7a3 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:35.152664 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ce7f0317-21e2-48e8-8b0a-05d0e749d7a3 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:35.153130 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ce7f0317-21e2-48e8-8b0a-05d0e749d7a3 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:35.159031 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ce7f0317-21e2-48e8-8b0a-05d0e749d7a3 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:35.159543 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ce7f0317-21e2-48e8-8b0a-05d0e749d7a3 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:35.159999 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ce7f0317-21e2-48e8-8b0a-05d0e749d7a3 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:35.451196 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ce7f0317-21e2-48e8-8b0a-05d0e749d7a3 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcc413bf53847b89cfe6bdf48909ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c7c21aa6b342b6bc52365cfdeb7c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:35.483558 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ce7f0317-21e2-48e8-8b0a-05d0e749d7a3 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] 10.222.0.33 "GET /compute/v2.1/servers/699f43b8-e784-4553-836c-e8785632d903" status: 200 len: 1389 microversion: 2.1 time: 0.352268 Sep 23 04:32:35.487733 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 286/529] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:32:35 2022] GET /compute/v2.1/servers/699f43b8-e784-4553-836c-e8785632d903 => generated 1389 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:35.763473 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=16,nova_api:UPDATE=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:32:35.823186 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f9fa94a6-a674-47a9-8358-5b59fdac5434 tempest-QuotasAdminTestV257-1016194150 tempest-QuotasAdminTestV257-1016194150-project-admin] Action: 'update', calling method: .version_select at 0x7ff1c0233dc0>, body: {"quota_set": {"ram": "5120"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:32:36.443335 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f9fa94a6-a674-47a9-8358-5b59fdac5434 tempest-QuotasAdminTestV257-1016194150 tempest-QuotasAdminTestV257-1016194150-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:36.443894 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f9fa94a6-a674-47a9-8358-5b59fdac5434 tempest-QuotasAdminTestV257-1016194150 tempest-QuotasAdminTestV257-1016194150-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:36.444260 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f9fa94a6-a674-47a9-8358-5b59fdac5434 tempest-QuotasAdminTestV257-1016194150 tempest-QuotasAdminTestV257-1016194150-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:36.444996 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f9fa94a6-a674-47a9-8358-5b59fdac5434 tempest-QuotasAdminTestV257-1016194150 tempest-QuotasAdminTestV257-1016194150-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:36.445467 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f9fa94a6-a674-47a9-8358-5b59fdac5434 tempest-QuotasAdminTestV257-1016194150 tempest-QuotasAdminTestV257-1016194150-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:36.445913 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f9fa94a6-a674-47a9-8358-5b59fdac5434 tempest-QuotasAdminTestV257-1016194150 tempest-QuotasAdminTestV257-1016194150-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:36.558661 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f9fa94a6-a674-47a9-8358-5b59fdac5434 tempest-QuotasAdminTestV257-1016194150 tempest-QuotasAdminTestV257-1016194150-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/6b1b1222a0154e2881ae5aca3924d766" status: 200 len: 148 microversion: 2.57 time: 1.069141 Sep 23 04:32:36.559287 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 287/530] 10.222.0.33 () {62 vars in 1303 bytes} [Fri Sep 23 04:32:35 2022] PUT /compute/v2.1/os-quota-sets/6b1b1222a0154e2881ae5aca3924d766 => generated 148 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 04:32:36.564471 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-9640587e-e0a5-49f6-bac5-5e911dadf6bb req-8b983693-ee7c-431a-b95b-8c34ca69f5af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0dff1738-81f1-4619-af74-44b7adc805b5", "tag": "583dbaa7-7626-49e7-8e4c-d1e81eea0115"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:32:36.574021 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-9640587e-e0a5-49f6-bac5-5e911dadf6bb req-8b983693-ee7c-431a-b95b-8c34ca69f5af service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:36.574487 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-9640587e-e0a5-49f6-bac5-5e911dadf6bb req-8b983693-ee7c-431a-b95b-8c34ca69f5af service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:36.574919 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-9640587e-e0a5-49f6-bac5-5e911dadf6bb req-8b983693-ee7c-431a-b95b-8c34ca69f5af service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:36.585250 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-9640587e-e0a5-49f6-bac5-5e911dadf6bb req-8b983693-ee7c-431a-b95b-8c34ca69f5af service nova] Creating event network-changed:583dbaa7-7626-49e7-8e4c-d1e81eea0115 for instance 0dff1738-81f1-4619-af74-44b7adc805b5 on n-h1-846463-3 Sep 23 04:32:36.590186 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-9640587e-e0a5-49f6-bac5-5e911dadf6bb req-8b983693-ee7c-431a-b95b-8c34ca69f5af service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029728 Sep 23 04:32:36.590754 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 288/531] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:32:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:32:36.595705 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c8c671e9-3634-479c-8265-4770004103f3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:36.596255 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c8c671e9-3634-479c-8265-4770004103f3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: 0dff1738-81f1-4619-af74-44b7adc805b5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:36.602225 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c8c671e9-3634-479c-8265-4770004103f3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:36.602719 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c8c671e9-3634-479c-8265-4770004103f3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:36.603156 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c8c671e9-3634-479c-8265-4770004103f3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:36.603850 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c8c671e9-3634-479c-8265-4770004103f3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:36.604312 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c8c671e9-3634-479c-8265-4770004103f3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:36.604733 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c8c671e9-3634-479c-8265-4770004103f3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:36.823461 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c8c671e9-3634-479c-8265-4770004103f3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:36.853647 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c8c671e9-3634-479c-8265-4770004103f3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/0dff1738-81f1-4619-af74-44b7adc805b5" status: 200 len: 1313 microversion: 2.1 time: 0.260346 Sep 23 04:32:36.854606 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 289/532] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:32:36 2022] GET /compute/v2.1/servers/0dff1738-81f1-4619-af74-44b7adc805b5 => generated 1313 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:36.871544 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-7ff161a7-43f7-4dc3-80b2-5e28bc993e40 req-577d2341-e61f-47b3-9a47-336b0d21aeb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "699f43b8-e784-4553-836c-e8785632d903", "name": "network-vif-plugged", "status": "completed", "tag": "fd2ca279-498d-4084-acfd-485f86ccac66"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:32:36.884180 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-7ff161a7-43f7-4dc3-80b2-5e28bc993e40 req-577d2341-e61f-47b3-9a47-336b0d21aeb0 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:36.885027 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-7ff161a7-43f7-4dc3-80b2-5e28bc993e40 req-577d2341-e61f-47b3-9a47-336b0d21aeb0 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:36.886221 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-7ff161a7-43f7-4dc3-80b2-5e28bc993e40 req-577d2341-e61f-47b3-9a47-336b0d21aeb0 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:36.901644 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-7ff161a7-43f7-4dc3-80b2-5e28bc993e40 req-577d2341-e61f-47b3-9a47-336b0d21aeb0 service nova] Creating event network-vif-plugged:fd2ca279-498d-4084-acfd-485f86ccac66 for instance 699f43b8-e784-4553-836c-e8785632d903 on n-h2-846463-3 Sep 23 04:32:36.910255 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-7ff161a7-43f7-4dc3-80b2-5e28bc993e40 req-577d2341-e61f-47b3-9a47-336b0d21aeb0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054109 Sep 23 04:32:36.911119 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 290/533] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:32:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:32:36.912527 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-7ff161a7-43f7-4dc3-80b2-5e28bc993e40 req-577d2341-e61f-47b3-9a47-336b0d21aeb0 service nova] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:36.915208 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-7ff161a7-43f7-4dc3-80b2-5e28bc993e40 req-577d2341-e61f-47b3-9a47-336b0d21aeb0 service nova] 10.222.0.33 "GET /compute//" status: 200 len: 377 microversion: - time: 0.003025 Sep 23 04:32:36.916059 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 291/534] 10.222.0.33 () {56 vars in 886 bytes} [Fri Sep 23 04:32:36 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 23 04:32:36.924222 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ba99640b-50c5-4bc9-a057-990e52f9f4b1 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:36.938853 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ba99640b-50c5-4bc9-a057-990e52f9f4b1 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] [instance: 699f43b8-e784-4553-836c-e8785632d903] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:36.959832 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ba99640b-50c5-4bc9-a057-990e52f9f4b1 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:36.960976 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ba99640b-50c5-4bc9-a057-990e52f9f4b1 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:36.961578 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ba99640b-50c5-4bc9-a057-990e52f9f4b1 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:36.962514 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ba99640b-50c5-4bc9-a057-990e52f9f4b1 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:36.963205 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ba99640b-50c5-4bc9-a057-990e52f9f4b1 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:36.966008 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ba99640b-50c5-4bc9-a057-990e52f9f4b1 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:37.176912 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ba99640b-50c5-4bc9-a057-990e52f9f4b1 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcc413bf53847b89cfe6bdf48909ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c7c21aa6b342b6bc52365cfdeb7c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:37.186060 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ba99640b-50c5-4bc9-a057-990e52f9f4b1 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] 10.222.0.33 "GET /compute/v2.1/servers/699f43b8-e784-4553-836c-e8785632d903" status: 200 len: 1389 microversion: 2.1 time: 0.268731 Sep 23 04:32:37.187220 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 292/535] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:32:36 2022] GET /compute/v2.1/servers/699f43b8-e784-4553-836c-e8785632d903 => generated 1389 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:37.194708 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c3601fcf-269b-4282-bd29-0085d7581a43 tempest-QuotasAdminTestV257-1016194150 tempest-QuotasAdminTestV257-1016194150-project-admin] Calling method '.version_select at 0x7ff1c021c430>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:38.062664 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c3601fcf-269b-4282-bd29-0085d7581a43 tempest-QuotasAdminTestV257-1016194150 tempest-QuotasAdminTestV257-1016194150-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:38.070125 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c3601fcf-269b-4282-bd29-0085d7581a43 tempest-QuotasAdminTestV257-1016194150 tempest-QuotasAdminTestV257-1016194150-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:38.070125 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c3601fcf-269b-4282-bd29-0085d7581a43 tempest-QuotasAdminTestV257-1016194150 tempest-QuotasAdminTestV257-1016194150-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:38.070125 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c3601fcf-269b-4282-bd29-0085d7581a43 tempest-QuotasAdminTestV257-1016194150 tempest-QuotasAdminTestV257-1016194150-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:38.070125 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c3601fcf-269b-4282-bd29-0085d7581a43 tempest-QuotasAdminTestV257-1016194150 tempest-QuotasAdminTestV257-1016194150-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:38.070509 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c3601fcf-269b-4282-bd29-0085d7581a43 tempest-QuotasAdminTestV257-1016194150 tempest-QuotasAdminTestV257-1016194150-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:38.082356 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=15,nova_api:UPDATE=14 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:32:38.086846 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c3601fcf-269b-4282-bd29-0085d7581a43 tempest-QuotasAdminTestV257-1016194150 tempest-QuotasAdminTestV257-1016194150-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/6b1b1222a0154e2881ae5aca3924d766/detail" status: 200 len: 463 microversion: 2.57 time: 0.898489 Sep 23 04:32:38.087705 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 293/536] 10.222.0.33 () {60 vars in 1304 bytes} [Fri Sep 23 04:32:37 2022] GET /compute/v2.1/os-quota-sets/6b1b1222a0154e2881ae5aca3924d766/detail => generated 463 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 04:32:38.103273 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-89bf7bd3-0d02-45b5-ad2a-df2685ed58d2 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/9d255ae7-0aed-4692-8802-6733dfcccbd0/action" status: 202 len: 0 microversion: 2.25 time: 4.198367 Sep 23 04:32:38.106873 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-775f8afa-da60-48e9-a087-fed19fd8eb85 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:38.108079 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 244/537] 10.222.0.33 () {62 vars in 1319 bytes} [Fri Sep 23 04:32:33 2022] POST /compute/v2.1/servers/9d255ae7-0aed-4692-8802-6733dfcccbd0/action => generated 0 bytes in 4204 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:32:38.109715 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-775f8afa-da60-48e9-a087-fed19fd8eb85 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: 0dff1738-81f1-4619-af74-44b7adc805b5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:38.114806 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-257cb0ab-7a80-4b26-9895-b04d201a1df8 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:38.115902 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-257cb0ab-7a80-4b26-9895-b04d201a1df8 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 9d255ae7-0aed-4692-8802-6733dfcccbd0] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:38.117298 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-775f8afa-da60-48e9-a087-fed19fd8eb85 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:38.120132 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-775f8afa-da60-48e9-a087-fed19fd8eb85 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:38.120132 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-775f8afa-da60-48e9-a087-fed19fd8eb85 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:38.120132 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-775f8afa-da60-48e9-a087-fed19fd8eb85 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:38.120132 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-775f8afa-da60-48e9-a087-fed19fd8eb85 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:38.120478 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-775f8afa-da60-48e9-a087-fed19fd8eb85 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:38.125007 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-257cb0ab-7a80-4b26-9895-b04d201a1df8 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:38.125818 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-257cb0ab-7a80-4b26-9895-b04d201a1df8 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:38.126507 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-257cb0ab-7a80-4b26-9895-b04d201a1df8 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:38.127487 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-257cb0ab-7a80-4b26-9895-b04d201a1df8 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:38.128148 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-257cb0ab-7a80-4b26-9895-b04d201a1df8 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:38.128953 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-257cb0ab-7a80-4b26-9895-b04d201a1df8 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:38.455171 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-775f8afa-da60-48e9-a087-fed19fd8eb85 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:38.466957 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-775f8afa-da60-48e9-a087-fed19fd8eb85 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/0dff1738-81f1-4619-af74-44b7adc805b5" status: 200 len: 1313 microversion: 2.1 time: 0.375226 Sep 23 04:32:38.469791 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 294/538] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:32:38 2022] GET /compute/v2.1/servers/0dff1738-81f1-4619-af74-44b7adc805b5 => generated 1313 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:38.474971 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-257cb0ab-7a80-4b26-9895-b04d201a1df8 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:38.481553 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d1183d97-2aef-49ae-b70a-b6b1b34138eb tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:38.482521 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d1183d97-2aef-49ae-b70a-b6b1b34138eb tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] [instance: 699f43b8-e784-4553-836c-e8785632d903] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:38.498238 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d1183d97-2aef-49ae-b70a-b6b1b34138eb tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:38.499415 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d1183d97-2aef-49ae-b70a-b6b1b34138eb tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:38.501115 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d1183d97-2aef-49ae-b70a-b6b1b34138eb tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:38.502550 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d1183d97-2aef-49ae-b70a-b6b1b34138eb tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:38.506061 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d1183d97-2aef-49ae-b70a-b6b1b34138eb tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:38.507339 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d1183d97-2aef-49ae-b70a-b6b1b34138eb tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:38.515855 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-257cb0ab-7a80-4b26-9895-b04d201a1df8 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:38.528951 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-257cb0ab-7a80-4b26-9895-b04d201a1df8 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:38.530268 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-257cb0ab-7a80-4b26-9895-b04d201a1df8 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/9d255ae7-0aed-4692-8802-6733dfcccbd0" status: 200 len: 1569 microversion: 2.25 time: 0.420429 Sep 23 04:32:38.558764 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 245/539] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:32:38 2022] GET /compute/v2.1/servers/9d255ae7-0aed-4692-8802-6733dfcccbd0 => generated 1569 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:32:38.797927 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d1183d97-2aef-49ae-b70a-b6b1b34138eb tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcc413bf53847b89cfe6bdf48909ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c7c21aa6b342b6bc52365cfdeb7c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:38.813673 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d1183d97-2aef-49ae-b70a-b6b1b34138eb tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] 10.222.0.33 "GET /compute/v2.1/servers/699f43b8-e784-4553-836c-e8785632d903" status: 200 len: 1389 microversion: 2.1 time: 0.337309 Sep 23 04:32:38.817399 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 295/540] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:32:38 2022] GET /compute/v2.1/servers/699f43b8-e784-4553-836c-e8785632d903 => generated 1389 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:38.902940 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a1111819-e467-48f4-ace7-53fc5c6bbfd4 tempest-QuotasAdminTestV257-1016194150 tempest-QuotasAdminTestV257-1016194150-project-admin] Action: 'update', calling method: .version_select at 0x7ff1c0046160>, body: {"quota_set": {"ram": "2048"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:32:39.501187 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-dde98af2-99b5-40fc-8b02-b90a1c70d04a tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:39.501865 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-dde98af2-99b5-40fc-8b02-b90a1c70d04a tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: 0dff1738-81f1-4619-af74-44b7adc805b5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:39.508320 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dde98af2-99b5-40fc-8b02-b90a1c70d04a tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:39.508802 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dde98af2-99b5-40fc-8b02-b90a1c70d04a tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:39.509239 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dde98af2-99b5-40fc-8b02-b90a1c70d04a tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:39.509980 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dde98af2-99b5-40fc-8b02-b90a1c70d04a tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:39.510439 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dde98af2-99b5-40fc-8b02-b90a1c70d04a tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:39.510870 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dde98af2-99b5-40fc-8b02-b90a1c70d04a tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:39.544421 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a1111819-e467-48f4-ace7-53fc5c6bbfd4 tempest-QuotasAdminTestV257-1016194150 tempest-QuotasAdminTestV257-1016194150-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:39.546322 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a1111819-e467-48f4-ace7-53fc5c6bbfd4 tempest-QuotasAdminTestV257-1016194150 tempest-QuotasAdminTestV257-1016194150-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:39.547900 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a1111819-e467-48f4-ace7-53fc5c6bbfd4 tempest-QuotasAdminTestV257-1016194150 tempest-QuotasAdminTestV257-1016194150-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:39.549094 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a1111819-e467-48f4-ace7-53fc5c6bbfd4 tempest-QuotasAdminTestV257-1016194150 tempest-QuotasAdminTestV257-1016194150-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:39.549796 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a1111819-e467-48f4-ace7-53fc5c6bbfd4 tempest-QuotasAdminTestV257-1016194150 tempest-QuotasAdminTestV257-1016194150-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:39.550570 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a1111819-e467-48f4-ace7-53fc5c6bbfd4 tempest-QuotasAdminTestV257-1016194150 tempest-QuotasAdminTestV257-1016194150-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:39.589472 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a1111819-e467-48f4-ace7-53fc5c6bbfd4 tempest-QuotasAdminTestV257-1016194150 tempest-QuotasAdminTestV257-1016194150-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:39.590484 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a1111819-e467-48f4-ace7-53fc5c6bbfd4 tempest-QuotasAdminTestV257-1016194150 tempest-QuotasAdminTestV257-1016194150-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:39.591113 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a1111819-e467-48f4-ace7-53fc5c6bbfd4 tempest-QuotasAdminTestV257-1016194150 tempest-QuotasAdminTestV257-1016194150-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:39.592139 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a1111819-e467-48f4-ace7-53fc5c6bbfd4 tempest-QuotasAdminTestV257-1016194150 tempest-QuotasAdminTestV257-1016194150-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:39.592804 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a1111819-e467-48f4-ace7-53fc5c6bbfd4 tempest-QuotasAdminTestV257-1016194150 tempest-QuotasAdminTestV257-1016194150-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:39.593329 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a1111819-e467-48f4-ace7-53fc5c6bbfd4 tempest-QuotasAdminTestV257-1016194150 tempest-QuotasAdminTestV257-1016194150-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:39.669342 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-dde98af2-99b5-40fc-8b02-b90a1c70d04a tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:39.677347 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-dde98af2-99b5-40fc-8b02-b90a1c70d04a tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/0dff1738-81f1-4619-af74-44b7adc805b5" status: 200 len: 1313 microversion: 2.1 time: 0.181772 Sep 23 04:32:39.677944 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 296/541] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:32:39 2022] GET /compute/v2.1/servers/0dff1738-81f1-4619-af74-44b7adc805b5 => generated 1313 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:39.683197 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-42e398c7-5c3e-4821-a88c-ff57be83e511 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:39.683796 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-42e398c7-5c3e-4821-a88c-ff57be83e511 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 9d255ae7-0aed-4692-8802-6733dfcccbd0] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:39.689359 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-42e398c7-5c3e-4821-a88c-ff57be83e511 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:39.690133 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-42e398c7-5c3e-4821-a88c-ff57be83e511 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:39.690754 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-42e398c7-5c3e-4821-a88c-ff57be83e511 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:39.691521 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-42e398c7-5c3e-4821-a88c-ff57be83e511 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:39.691905 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-42e398c7-5c3e-4821-a88c-ff57be83e511 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:39.692505 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-42e398c7-5c3e-4821-a88c-ff57be83e511 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:39.772956 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a1111819-e467-48f4-ace7-53fc5c6bbfd4 tempest-QuotasAdminTestV257-1016194150 tempest-QuotasAdminTestV257-1016194150-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/6b1b1222a0154e2881ae5aca3924d766?user_id=040d403bc2904888b0d44898caea27bf" status: 200 len: 148 microversion: 2.57 time: 0.874468 Sep 23 04:32:39.780439 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 246/542] 10.222.0.33 () {62 vars in 1384 bytes} [Fri Sep 23 04:32:38 2022] PUT /compute/v2.1/os-quota-sets/6b1b1222a0154e2881ae5aca3924d766?user_id=040d403bc2904888b0d44898caea27bf => generated 148 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 04:32:39.786071 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b29b7324-7338-4668-b704-f2eb4f05d19f tempest-QuotasAdminTestV257-1016194150 tempest-QuotasAdminTestV257-1016194150-project-admin] Calling method '.version_select at 0x7ff1c011f5e0>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:39.912433 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-42e398c7-5c3e-4821-a88c-ff57be83e511 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:39.922503 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-42e398c7-5c3e-4821-a88c-ff57be83e511 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:39.926180 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-42e398c7-5c3e-4821-a88c-ff57be83e511 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:39.928439 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-42e398c7-5c3e-4821-a88c-ff57be83e511 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/9d255ae7-0aed-4692-8802-6733dfcccbd0" status: 200 len: 1569 microversion: 2.25 time: 0.249278 Sep 23 04:32:39.930725 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 297/543] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:32:39 2022] GET /compute/v2.1/servers/9d255ae7-0aed-4692-8802-6733dfcccbd0 => generated 1569 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:32:39.936996 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-91db1117-ae23-4db8-ac61-b70658f9999c req-b4b0107a-9570-4f2f-b75e-31f1c6431ff2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d255ae7-0aed-4692-8802-6733dfcccbd0", "name": "network-vif-unplugged", "status": "completed", "tag": "76c7663b-b181-4528-b671-a0840df053e8"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:32:39.949035 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-91db1117-ae23-4db8-ac61-b70658f9999c req-b4b0107a-9570-4f2f-b75e-31f1c6431ff2 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:39.949968 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-91db1117-ae23-4db8-ac61-b70658f9999c req-b4b0107a-9570-4f2f-b75e-31f1c6431ff2 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:39.950608 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-91db1117-ae23-4db8-ac61-b70658f9999c req-b4b0107a-9570-4f2f-b75e-31f1c6431ff2 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:39.978226 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-91db1117-ae23-4db8-ac61-b70658f9999c req-b4b0107a-9570-4f2f-b75e-31f1c6431ff2 service nova] Creating event network-vif-unplugged:76c7663b-b181-4528-b671-a0840df053e8 for instance 9d255ae7-0aed-4692-8802-6733dfcccbd0 on n-h2-846463-3 Sep 23 04:32:39.986942 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-91db1117-ae23-4db8-ac61-b70658f9999c req-b4b0107a-9570-4f2f-b75e-31f1c6431ff2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055038 Sep 23 04:32:39.988168 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 298/544] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:32:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:32:39.995904 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e983e6bd-5d66-4f8a-960c-ba1898436ae1 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:39.996932 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e983e6bd-5d66-4f8a-960c-ba1898436ae1 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] [instance: 699f43b8-e784-4553-836c-e8785632d903] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:40.007489 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e983e6bd-5d66-4f8a-960c-ba1898436ae1 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:40.008421 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e983e6bd-5d66-4f8a-960c-ba1898436ae1 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:40.009365 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e983e6bd-5d66-4f8a-960c-ba1898436ae1 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:40.010332 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e983e6bd-5d66-4f8a-960c-ba1898436ae1 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:40.011023 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e983e6bd-5d66-4f8a-960c-ba1898436ae1 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:40.011740 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e983e6bd-5d66-4f8a-960c-ba1898436ae1 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:40.232859 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e983e6bd-5d66-4f8a-960c-ba1898436ae1 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcc413bf53847b89cfe6bdf48909ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c7c21aa6b342b6bc52365cfdeb7c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:40.254330 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e983e6bd-5d66-4f8a-960c-ba1898436ae1 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] 10.222.0.33 "GET /compute/v2.1/servers/699f43b8-e784-4553-836c-e8785632d903" status: 200 len: 1589 microversion: 2.1 time: 0.264545 Sep 23 04:32:40.258628 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 299/545] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:32:39 2022] GET /compute/v2.1/servers/699f43b8-e784-4553-836c-e8785632d903 => generated 1589 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:40.278441 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-3dbc0e5f-a2a6-4e51-9fc4-2c50be46ccc9 req-e7d5f603-f7da-4615-b2c0-43c7689d8b22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dff1738-81f1-4619-af74-44b7adc805b5", "name": "network-vif-plugged", "status": "completed", "tag": "583dbaa7-7626-49e7-8e4c-d1e81eea0115"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:32:40.291668 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-3dbc0e5f-a2a6-4e51-9fc4-2c50be46ccc9 req-e7d5f603-f7da-4615-b2c0-43c7689d8b22 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:40.292429 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-3dbc0e5f-a2a6-4e51-9fc4-2c50be46ccc9 req-e7d5f603-f7da-4615-b2c0-43c7689d8b22 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:40.293026 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-3dbc0e5f-a2a6-4e51-9fc4-2c50be46ccc9 req-e7d5f603-f7da-4615-b2c0-43c7689d8b22 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:40.318952 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-3dbc0e5f-a2a6-4e51-9fc4-2c50be46ccc9 req-e7d5f603-f7da-4615-b2c0-43c7689d8b22 service nova] Creating event network-vif-plugged:583dbaa7-7626-49e7-8e4c-d1e81eea0115 for instance 0dff1738-81f1-4619-af74-44b7adc805b5 on n-h1-846463-3 Sep 23 04:32:40.324926 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-3dbc0e5f-a2a6-4e51-9fc4-2c50be46ccc9 req-e7d5f603-f7da-4615-b2c0-43c7689d8b22 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064675 Sep 23 04:32:40.326690 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 300/546] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:32:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:32:40.334696 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9024ab29-b231-44b4-9d1e-b9c4f7c9d920 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:40.334696 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-9024ab29-b231-44b4-9d1e-b9c4f7c9d920 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] [instance: 699f43b8-e784-4553-836c-e8785632d903] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:40.342973 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9024ab29-b231-44b4-9d1e-b9c4f7c9d920 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:40.343787 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9024ab29-b231-44b4-9d1e-b9c4f7c9d920 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:40.344599 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9024ab29-b231-44b4-9d1e-b9c4f7c9d920 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:40.345481 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9024ab29-b231-44b4-9d1e-b9c4f7c9d920 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:40.346928 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9024ab29-b231-44b4-9d1e-b9c4f7c9d920 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:40.347551 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9024ab29-b231-44b4-9d1e-b9c4f7c9d920 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:40.548925 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-9024ab29-b231-44b4-9d1e-b9c4f7c9d920 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] 10.222.0.33 "GET /compute/v2.1/servers/699f43b8-e784-4553-836c-e8785632d903/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.220652 Sep 23 04:32:40.550508 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b29b7324-7338-4668-b704-f2eb4f05d19f tempest-QuotasAdminTestV257-1016194150 tempest-QuotasAdminTestV257-1016194150-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/6b1b1222a0154e2881ae5aca3924d766?user_id=040d403bc2904888b0d44898caea27bf" status: 200 len: 190 microversion: 2.57 time: 0.768523 Sep 23 04:32:40.551086 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 247/547] 10.222.0.33 () {60 vars in 1364 bytes} [Fri Sep 23 04:32:39 2022] GET /compute/v2.1/os-quota-sets/6b1b1222a0154e2881ae5aca3924d766?user_id=040d403bc2904888b0d44898caea27bf => generated 190 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 04:32:40.557309 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 301/548] 10.222.0.33 () {58 vars in 1275 bytes} [Fri Sep 23 04:32:40 2022] GET /compute/v2.1/servers/699f43b8-e784-4553-836c-e8785632d903/os-interface => generated 285 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:32:40.701031 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-69f572ef-e693-4610-a489-37a13574b7e4 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:40.701798 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-69f572ef-e693-4610-a489-37a13574b7e4 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: 0dff1738-81f1-4619-af74-44b7adc805b5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:40.712789 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-69f572ef-e693-4610-a489-37a13574b7e4 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:40.719799 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-69f572ef-e693-4610-a489-37a13574b7e4 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:40.719799 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-69f572ef-e693-4610-a489-37a13574b7e4 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:40.719799 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-69f572ef-e693-4610-a489-37a13574b7e4 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:40.719799 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-69f572ef-e693-4610-a489-37a13574b7e4 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:40.720233 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-69f572ef-e693-4610-a489-37a13574b7e4 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:40.963147 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4d3e1fdb-fc6f-440e-a35c-889e52335136 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:40.963767 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4d3e1fdb-fc6f-440e-a35c-889e52335136 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 9d255ae7-0aed-4692-8802-6733dfcccbd0] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:40.989585 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4d3e1fdb-fc6f-440e-a35c-889e52335136 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:40.991086 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4d3e1fdb-fc6f-440e-a35c-889e52335136 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:40.992191 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4d3e1fdb-fc6f-440e-a35c-889e52335136 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:40.992936 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4d3e1fdb-fc6f-440e-a35c-889e52335136 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:40.994346 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4d3e1fdb-fc6f-440e-a35c-889e52335136 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:40.996829 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4d3e1fdb-fc6f-440e-a35c-889e52335136 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:41.471597 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-69f572ef-e693-4610-a489-37a13574b7e4 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:41.495683 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-69f572ef-e693-4610-a489-37a13574b7e4 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/0dff1738-81f1-4619-af74-44b7adc805b5" status: 200 len: 1313 microversion: 2.1 time: 0.797433 Sep 23 04:32:41.499518 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 248/549] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:32:40 2022] GET /compute/v2.1/servers/0dff1738-81f1-4619-af74-44b7adc805b5 => generated 1313 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:41.724558 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-4d3e1fdb-fc6f-440e-a35c-889e52335136 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:41.733212 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-4d3e1fdb-fc6f-440e-a35c-889e52335136 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:41.737133 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-4d3e1fdb-fc6f-440e-a35c-889e52335136 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:41.754066 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4d3e1fdb-fc6f-440e-a35c-889e52335136 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/9d255ae7-0aed-4692-8802-6733dfcccbd0" status: 200 len: 1569 microversion: 2.25 time: 0.784907 Sep 23 04:32:41.754644 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 302/550] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:32:40 2022] GET /compute/v2.1/servers/9d255ae7-0aed-4692-8802-6733dfcccbd0 => generated 1569 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:32:42.030197 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-55534ffd-aa24-4ed2-881a-862f4895cc25 req-ac225afe-3aa1-4b9a-ba49-ee71ebdb0245 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d255ae7-0aed-4692-8802-6733dfcccbd0", "tag": "76c7663b-b181-4528-b671-a0840df053e8"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:32:42.043503 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-55534ffd-aa24-4ed2-881a-862f4895cc25 req-ac225afe-3aa1-4b9a-ba49-ee71ebdb0245 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:42.043985 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-55534ffd-aa24-4ed2-881a-862f4895cc25 req-ac225afe-3aa1-4b9a-ba49-ee71ebdb0245 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:42.044411 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-55534ffd-aa24-4ed2-881a-862f4895cc25 req-ac225afe-3aa1-4b9a-ba49-ee71ebdb0245 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:42.060184 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-55534ffd-aa24-4ed2-881a-862f4895cc25 req-ac225afe-3aa1-4b9a-ba49-ee71ebdb0245 service nova] Creating event network-changed:76c7663b-b181-4528-b671-a0840df053e8 for instance 9d255ae7-0aed-4692-8802-6733dfcccbd0 on n-h2-846463-3 Sep 23 04:32:42.066340 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-55534ffd-aa24-4ed2-881a-862f4895cc25 req-ac225afe-3aa1-4b9a-ba49-ee71ebdb0245 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039871 Sep 23 04:32:42.067402 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 249/551] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:32:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:32:42.530789 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6d140fb4-2ba9-4e26-b095-fd198ddb3fa6 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:42.531398 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-6d140fb4-2ba9-4e26-b095-fd198ddb3fa6 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: 0dff1738-81f1-4619-af74-44b7adc805b5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:42.538661 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6d140fb4-2ba9-4e26-b095-fd198ddb3fa6 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:42.539156 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6d140fb4-2ba9-4e26-b095-fd198ddb3fa6 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:42.539591 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6d140fb4-2ba9-4e26-b095-fd198ddb3fa6 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:42.540286 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6d140fb4-2ba9-4e26-b095-fd198ddb3fa6 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:42.541299 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6d140fb4-2ba9-4e26-b095-fd198ddb3fa6 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:42.541870 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6d140fb4-2ba9-4e26-b095-fd198ddb3fa6 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:42.765594 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4c1f4980-08f5-4eb6-8e20-8729cf09f04c tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:42.766512 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4c1f4980-08f5-4eb6-8e20-8729cf09f04c tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 9d255ae7-0aed-4692-8802-6733dfcccbd0] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:42.782028 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4c1f4980-08f5-4eb6-8e20-8729cf09f04c tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:42.786001 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4c1f4980-08f5-4eb6-8e20-8729cf09f04c tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:42.786474 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4c1f4980-08f5-4eb6-8e20-8729cf09f04c tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:42.788923 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4c1f4980-08f5-4eb6-8e20-8729cf09f04c tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:42.790450 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4c1f4980-08f5-4eb6-8e20-8729cf09f04c tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:42.791749 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4c1f4980-08f5-4eb6-8e20-8729cf09f04c tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:42.826599 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-6d140fb4-2ba9-4e26-b095-fd198ddb3fa6 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:42.836550 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6d140fb4-2ba9-4e26-b095-fd198ddb3fa6 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/0dff1738-81f1-4619-af74-44b7adc805b5" status: 200 len: 1463 microversion: 2.1 time: 0.309904 Sep 23 04:32:42.837165 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 303/552] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:32:42 2022] GET /compute/v2.1/servers/0dff1738-81f1-4619-af74-44b7adc805b5 => generated 1463 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:42.857637 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-89c89f01-04ea-403f-921c-6a39c0f9d22a tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:42.859481 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-89c89f01-04ea-403f-921c-6a39c0f9d22a tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] [instance: 699f43b8-e784-4553-836c-e8785632d903] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:42.867558 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-89c89f01-04ea-403f-921c-6a39c0f9d22a tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:42.868713 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-89c89f01-04ea-403f-921c-6a39c0f9d22a tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:42.869977 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-89c89f01-04ea-403f-921c-6a39c0f9d22a tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:42.870939 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-89c89f01-04ea-403f-921c-6a39c0f9d22a tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:42.871590 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-89c89f01-04ea-403f-921c-6a39c0f9d22a tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:42.872211 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-89c89f01-04ea-403f-921c-6a39c0f9d22a tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:42.902293 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=100 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:32:43.262859 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4c1f4980-08f5-4eb6-8e20-8729cf09f04c tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:43.275112 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4c1f4980-08f5-4eb6-8e20-8729cf09f04c tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:43.278025 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4c1f4980-08f5-4eb6-8e20-8729cf09f04c tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:43.279470 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4c1f4980-08f5-4eb6-8e20-8729cf09f04c tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/9d255ae7-0aed-4692-8802-6733dfcccbd0" status: 200 len: 1569 microversion: 2.25 time: 0.518643 Sep 23 04:32:43.290420 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 250/553] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:32:42 2022] GET /compute/v2.1/servers/9d255ae7-0aed-4692-8802-6733dfcccbd0 => generated 1569 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:32:43.356692 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-89c89f01-04ea-403f-921c-6a39c0f9d22a tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcc413bf53847b89cfe6bdf48909ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c7c21aa6b342b6bc52365cfdeb7c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:43.366866 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-89c89f01-04ea-403f-921c-6a39c0f9d22a tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] 10.222.0.33 "GET /compute/v2.1/servers/699f43b8-e784-4553-836c-e8785632d903" status: 200 len: 1589 microversion: 2.1 time: 0.515300 Sep 23 04:32:43.375964 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 304/554] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:32:42 2022] GET /compute/v2.1/servers/699f43b8-e784-4553-836c-e8785632d903 => generated 1589 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:32:43.394001 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-0f25bada-048c-4886-a248-426b58bc869e req-2761d1c8-5e49-4024-b1e7-c44c0c5b4ef7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "699f43b8-e784-4553-836c-e8785632d903", "tag": "fd2ca279-498d-4084-acfd-485f86ccac66"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:32:43.418243 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-0f25bada-048c-4886-a248-426b58bc869e req-2761d1c8-5e49-4024-b1e7-c44c0c5b4ef7 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:43.418740 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-0f25bada-048c-4886-a248-426b58bc869e req-2761d1c8-5e49-4024-b1e7-c44c0c5b4ef7 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:43.419174 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-0f25bada-048c-4886-a248-426b58bc869e req-2761d1c8-5e49-4024-b1e7-c44c0c5b4ef7 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:43.432838 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-0f25bada-048c-4886-a248-426b58bc869e req-2761d1c8-5e49-4024-b1e7-c44c0c5b4ef7 service nova] Creating event network-changed:fd2ca279-498d-4084-acfd-485f86ccac66 for instance 699f43b8-e784-4553-836c-e8785632d903 on n-h2-846463-3 Sep 23 04:32:43.440022 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-0f25bada-048c-4886-a248-426b58bc869e req-2761d1c8-5e49-4024-b1e7-c44c0c5b4ef7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060646 Sep 23 04:32:43.440994 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 305/555] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:32:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:32:43.725733 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-829880f2-7082-4836-9e98-4c23fa5eabc2 tempest-MigrationsAdminTest-295231043 tempest-MigrationsAdminTest-295231043-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:43.726343 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-829880f2-7082-4836-9e98-4c23fa5eabc2 tempest-MigrationsAdminTest-295231043 tempest-MigrationsAdminTest-295231043-project-admin] [instance: 0dff1738-81f1-4619-af74-44b7adc805b5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:43.732772 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-829880f2-7082-4836-9e98-4c23fa5eabc2 tempest-MigrationsAdminTest-295231043 tempest-MigrationsAdminTest-295231043-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:43.737107 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-829880f2-7082-4836-9e98-4c23fa5eabc2 tempest-MigrationsAdminTest-295231043 tempest-MigrationsAdminTest-295231043-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:43.737561 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-829880f2-7082-4836-9e98-4c23fa5eabc2 tempest-MigrationsAdminTest-295231043 tempest-MigrationsAdminTest-295231043-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:43.738339 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-829880f2-7082-4836-9e98-4c23fa5eabc2 tempest-MigrationsAdminTest-295231043 tempest-MigrationsAdminTest-295231043-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:43.738817 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-829880f2-7082-4836-9e98-4c23fa5eabc2 tempest-MigrationsAdminTest-295231043 tempest-MigrationsAdminTest-295231043-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:43.739249 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-829880f2-7082-4836-9e98-4c23fa5eabc2 tempest-MigrationsAdminTest-295231043 tempest-MigrationsAdminTest-295231043-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:44.363981 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-829880f2-7082-4836-9e98-4c23fa5eabc2 tempest-MigrationsAdminTest-295231043 tempest-MigrationsAdminTest-295231043-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/0dff1738-81f1-4619-af74-44b7adc805b5" status: 200 len: 1614 microversion: 2.1 time: 1.072194 Sep 23 04:32:44.365941 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 251/556] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:32:43 2022] GET /compute/v2.1/servers/0dff1738-81f1-4619-af74-44b7adc805b5 => generated 1614 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:44.372428 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d560180c-54e1-40b6-9675-7c1e30523c11 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:44.374144 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d560180c-54e1-40b6-9675-7c1e30523c11 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 9d255ae7-0aed-4692-8802-6733dfcccbd0] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:44.382740 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d560180c-54e1-40b6-9675-7c1e30523c11 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:44.389132 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d560180c-54e1-40b6-9675-7c1e30523c11 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:44.389733 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d560180c-54e1-40b6-9675-7c1e30523c11 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:44.391176 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d560180c-54e1-40b6-9675-7c1e30523c11 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:44.391894 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d560180c-54e1-40b6-9675-7c1e30523c11 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:44.392660 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d560180c-54e1-40b6-9675-7c1e30523c11 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:44.433374 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:32:44.529728 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5b8d22ff-a376-4b69-ad2a-753f383fc520 tempest-ServicesAdminTestJSON-1296882843 tempest-ServicesAdminTestJSON-1296882843-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:44.533769 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5b8d22ff-a376-4b69-ad2a-753f383fc520 tempest-ServicesAdminTestJSON-1296882843 tempest-ServicesAdminTestJSON-1296882843-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:44.534285 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5b8d22ff-a376-4b69-ad2a-753f383fc520 tempest-ServicesAdminTestJSON-1296882843 tempest-ServicesAdminTestJSON-1296882843-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:44.534721 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5b8d22ff-a376-4b69-ad2a-753f383fc520 tempest-ServicesAdminTestJSON-1296882843 tempest-ServicesAdminTestJSON-1296882843-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:44.535452 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5b8d22ff-a376-4b69-ad2a-753f383fc520 tempest-ServicesAdminTestJSON-1296882843 tempest-ServicesAdminTestJSON-1296882843-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:44.535900 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5b8d22ff-a376-4b69-ad2a-753f383fc520 tempest-ServicesAdminTestJSON-1296882843 tempest-ServicesAdminTestJSON-1296882843-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:44.538750 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5b8d22ff-a376-4b69-ad2a-753f383fc520 tempest-ServicesAdminTestJSON-1296882843 tempest-ServicesAdminTestJSON-1296882843-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:44.570891 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5b8d22ff-a376-4b69-ad2a-753f383fc520 tempest-ServicesAdminTestJSON-1296882843 tempest-ServicesAdminTestJSON-1296882843-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.626324 Sep 23 04:32:44.572326 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 306/557] 10.222.0.33 () {58 vars in 1137 bytes} [Fri Sep 23 04:32:43 2022] GET /compute/v2.1/os-services => generated 944 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:32:44.578082 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e2de621d-b1be-4230-92e9-17c8a3e96c43 tempest-MigrationsAdminTest-295231043 tempest-MigrationsAdminTest-295231043-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:32:44.580141 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e2de621d-b1be-4230-92e9-17c8a3e96c43 tempest-MigrationsAdminTest-295231043 tempest-MigrationsAdminTest-295231043-project-admin] [instance: 0dff1738-81f1-4619-af74-44b7adc805b5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:44.587655 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e2de621d-b1be-4230-92e9-17c8a3e96c43 tempest-MigrationsAdminTest-295231043 tempest-MigrationsAdminTest-295231043-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:44.588388 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e2de621d-b1be-4230-92e9-17c8a3e96c43 tempest-MigrationsAdminTest-295231043 tempest-MigrationsAdminTest-295231043-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:44.589154 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e2de621d-b1be-4230-92e9-17c8a3e96c43 tempest-MigrationsAdminTest-295231043 tempest-MigrationsAdminTest-295231043-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:44.590200 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e2de621d-b1be-4230-92e9-17c8a3e96c43 tempest-MigrationsAdminTest-295231043 tempest-MigrationsAdminTest-295231043-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:44.590863 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e2de621d-b1be-4230-92e9-17c8a3e96c43 tempest-MigrationsAdminTest-295231043 tempest-MigrationsAdminTest-295231043-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:44.591465 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e2de621d-b1be-4230-92e9-17c8a3e96c43 tempest-MigrationsAdminTest-295231043 tempest-MigrationsAdminTest-295231043-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:44.597205 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d560180c-54e1-40b6-9675-7c1e30523c11 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:44.603064 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d560180c-54e1-40b6-9675-7c1e30523c11 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:44.616044 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d560180c-54e1-40b6-9675-7c1e30523c11 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:44.617356 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d560180c-54e1-40b6-9675-7c1e30523c11 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/9d255ae7-0aed-4692-8802-6733dfcccbd0" status: 200 len: 1569 microversion: 2.25 time: 0.249930 Sep 23 04:32:44.619881 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 252/558] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:32:44 2022] GET /compute/v2.1/servers/9d255ae7-0aed-4692-8802-6733dfcccbd0 => generated 1569 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:32:44.626432 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f0d7e333-2dfd-49bf-aaa5-8314c3185f89 tempest-ServicesAdminTestJSON-1296882843 tempest-ServicesAdminTestJSON-1296882843-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:44.628767 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e2de621d-b1be-4230-92e9-17c8a3e96c43 tempest-MigrationsAdminTest-295231043 tempest-MigrationsAdminTest-295231043-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '3514d0172cf24a0ebaf2eb296c7e2945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9f5de88d7c249e28440dccc2e634253', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:44.629915 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e2de621d-b1be-4230-92e9-17c8a3e96c43 tempest-MigrationsAdminTest-295231043 tempest-MigrationsAdminTest-295231043-project-admin] [instance: 0dff1738-81f1-4619-af74-44b7adc805b5] flavor_id is None. Assuming migration. {{(pid=122699) resize /opt/stack/nova/nova/compute/api.py:4196}} Sep 23 04:32:44.630733 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e2de621d-b1be-4230-92e9-17c8a3e96c43 tempest-MigrationsAdminTest-295231043 tempest-MigrationsAdminTest-295231043-project-admin] [instance: 0dff1738-81f1-4619-af74-44b7adc805b5] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122699) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 23 04:32:44.635855 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f0d7e333-2dfd-49bf-aaa5-8314c3185f89 tempest-ServicesAdminTestJSON-1296882843 tempest-ServicesAdminTestJSON-1296882843-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:44.636353 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f0d7e333-2dfd-49bf-aaa5-8314c3185f89 tempest-ServicesAdminTestJSON-1296882843 tempest-ServicesAdminTestJSON-1296882843-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:44.636796 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f0d7e333-2dfd-49bf-aaa5-8314c3185f89 tempest-ServicesAdminTestJSON-1296882843 tempest-ServicesAdminTestJSON-1296882843-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:44.637542 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f0d7e333-2dfd-49bf-aaa5-8314c3185f89 tempest-ServicesAdminTestJSON-1296882843 tempest-ServicesAdminTestJSON-1296882843-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:44.638029 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f0d7e333-2dfd-49bf-aaa5-8314c3185f89 tempest-ServicesAdminTestJSON-1296882843 tempest-ServicesAdminTestJSON-1296882843-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:44.640280 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f0d7e333-2dfd-49bf-aaa5-8314c3185f89 tempest-ServicesAdminTestJSON-1296882843 tempest-ServicesAdminTestJSON-1296882843-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:44.678534 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=28 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:32:44.719533 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f0d7e333-2dfd-49bf-aaa5-8314c3185f89 tempest-ServicesAdminTestJSON-1296882843 tempest-ServicesAdminTestJSON-1296882843-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?host=n-d-846463-3" status: 200 len: 578 microversion: 2.1 time: 0.097159 Sep 23 04:32:44.730064 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 253/559] 10.222.0.33 () {58 vars in 1172 bytes} [Fri Sep 23 04:32:44 2022] GET /compute/v2.1/os-services?host=n-d-846463-3 => generated 578 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:32:44.735230 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-419f8b1d-5cba-454f-a6b3-a0dc79b96a93 tempest-ServicesAdminTestJSON-1296882843 tempest-ServicesAdminTestJSON-1296882843-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:44.740394 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-419f8b1d-5cba-454f-a6b3-a0dc79b96a93 tempest-ServicesAdminTestJSON-1296882843 tempest-ServicesAdminTestJSON-1296882843-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:44.741506 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-419f8b1d-5cba-454f-a6b3-a0dc79b96a93 tempest-ServicesAdminTestJSON-1296882843 tempest-ServicesAdminTestJSON-1296882843-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:44.742211 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-419f8b1d-5cba-454f-a6b3-a0dc79b96a93 tempest-ServicesAdminTestJSON-1296882843 tempest-ServicesAdminTestJSON-1296882843-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:44.742989 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-419f8b1d-5cba-454f-a6b3-a0dc79b96a93 tempest-ServicesAdminTestJSON-1296882843 tempest-ServicesAdminTestJSON-1296882843-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:44.743458 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-419f8b1d-5cba-454f-a6b3-a0dc79b96a93 tempest-ServicesAdminTestJSON-1296882843 tempest-ServicesAdminTestJSON-1296882843-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:44.744050 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-419f8b1d-5cba-454f-a6b3-a0dc79b96a93 tempest-ServicesAdminTestJSON-1296882843 tempest-ServicesAdminTestJSON-1296882843-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:44.772819 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-419f8b1d-5cba-454f-a6b3-a0dc79b96a93 tempest-ServicesAdminTestJSON-1296882843 tempest-ServicesAdminTestJSON-1296882843-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.041355 Sep 23 04:32:44.778050 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 254/560] 10.222.0.33 () {58 vars in 1176 bytes} [Fri Sep 23 04:32:44 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:32:44.791619 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1483778f-419e-4b52-9a57-5920472fc636 tempest-ServicesAdminTestJSON-1296882843 tempest-ServicesAdminTestJSON-1296882843-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:44.802082 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1483778f-419e-4b52-9a57-5920472fc636 tempest-ServicesAdminTestJSON-1296882843 tempest-ServicesAdminTestJSON-1296882843-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:44.802591 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1483778f-419e-4b52-9a57-5920472fc636 tempest-ServicesAdminTestJSON-1296882843 tempest-ServicesAdminTestJSON-1296882843-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:44.805713 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1483778f-419e-4b52-9a57-5920472fc636 tempest-ServicesAdminTestJSON-1296882843 tempest-ServicesAdminTestJSON-1296882843-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:44.805713 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1483778f-419e-4b52-9a57-5920472fc636 tempest-ServicesAdminTestJSON-1296882843 tempest-ServicesAdminTestJSON-1296882843-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:44.805713 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1483778f-419e-4b52-9a57-5920472fc636 tempest-ServicesAdminTestJSON-1296882843 tempest-ServicesAdminTestJSON-1296882843-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:44.805713 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1483778f-419e-4b52-9a57-5920472fc636 tempest-ServicesAdminTestJSON-1296882843 tempest-ServicesAdminTestJSON-1296882843-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:44.846866 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-1483778f-419e-4b52-9a57-5920472fc636 tempest-ServicesAdminTestJSON-1296882843 tempest-ServicesAdminTestJSON-1296882843-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.062328 Sep 23 04:32:44.848046 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 255/561] 10.222.0.33 () {58 vars in 1137 bytes} [Fri Sep 23 04:32:44 2022] GET /compute/v2.1/os-services => generated 944 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:32:45.069298 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e2de621d-b1be-4230-92e9-17c8a3e96c43 tempest-MigrationsAdminTest-295231043 tempest-MigrationsAdminTest-295231043-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/0dff1738-81f1-4619-af74-44b7adc805b5/action" status: 202 len: 0 microversion: 2.1 time: 0.495424 Sep 23 04:32:45.069930 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 307/562] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:32:44 2022] POST /compute/v2.1/servers/0dff1738-81f1-4619-af74-44b7adc805b5/action => generated 0 bytes in 497 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:32:45.081397 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-be05b512-68e5-42f5-883e-3fabf1303f09 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:45.082610 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-be05b512-68e5-42f5-883e-3fabf1303f09 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: 0dff1738-81f1-4619-af74-44b7adc805b5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:45.097244 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-be05b512-68e5-42f5-883e-3fabf1303f09 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:45.097745 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-be05b512-68e5-42f5-883e-3fabf1303f09 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:45.098213 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-be05b512-68e5-42f5-883e-3fabf1303f09 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:45.098924 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-be05b512-68e5-42f5-883e-3fabf1303f09 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:45.099379 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-be05b512-68e5-42f5-883e-3fabf1303f09 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:45.101123 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-be05b512-68e5-42f5-883e-3fabf1303f09 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:45.283271 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-be05b512-68e5-42f5-883e-3fabf1303f09 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:45.291715 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-be05b512-68e5-42f5-883e-3fabf1303f09 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/0dff1738-81f1-4619-af74-44b7adc805b5" status: 200 len: 1472 microversion: 2.1 time: 0.217092 Sep 23 04:32:45.298621 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 256/563] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:32:45 2022] GET /compute/v2.1/servers/0dff1738-81f1-4619-af74-44b7adc805b5 => generated 1472 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:45.647254 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-339cd7bd-b158-4489-ae4a-cec89f9b308d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:45.647986 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-339cd7bd-b158-4489-ae4a-cec89f9b308d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 9d255ae7-0aed-4692-8802-6733dfcccbd0] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:45.659120 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-339cd7bd-b158-4489-ae4a-cec89f9b308d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:45.662416 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-339cd7bd-b158-4489-ae4a-cec89f9b308d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:45.662416 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-339cd7bd-b158-4489-ae4a-cec89f9b308d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:45.663292 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-339cd7bd-b158-4489-ae4a-cec89f9b308d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:45.663813 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-339cd7bd-b158-4489-ae4a-cec89f9b308d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:45.665443 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-339cd7bd-b158-4489-ae4a-cec89f9b308d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:45.895651 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-339cd7bd-b158-4489-ae4a-cec89f9b308d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:45.903903 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-339cd7bd-b158-4489-ae4a-cec89f9b308d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:45.905815 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-339cd7bd-b158-4489-ae4a-cec89f9b308d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:45.908596 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-339cd7bd-b158-4489-ae4a-cec89f9b308d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/9d255ae7-0aed-4692-8802-6733dfcccbd0" status: 200 len: 1569 microversion: 2.25 time: 0.264705 Sep 23 04:32:45.908944 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 308/564] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:32:45 2022] GET /compute/v2.1/servers/9d255ae7-0aed-4692-8802-6733dfcccbd0 => generated 1569 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:32:46.317286 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-66285f97-e6e3-4be4-b5e8-4e65ed075557 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:46.317925 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-66285f97-e6e3-4be4-b5e8-4e65ed075557 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: 0dff1738-81f1-4619-af74-44b7adc805b5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:46.325585 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-66285f97-e6e3-4be4-b5e8-4e65ed075557 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:46.326178 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-66285f97-e6e3-4be4-b5e8-4e65ed075557 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:46.326623 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-66285f97-e6e3-4be4-b5e8-4e65ed075557 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:46.327415 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-66285f97-e6e3-4be4-b5e8-4e65ed075557 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:46.327883 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-66285f97-e6e3-4be4-b5e8-4e65ed075557 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:46.328808 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-66285f97-e6e3-4be4-b5e8-4e65ed075557 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:46.483611 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-66285f97-e6e3-4be4-b5e8-4e65ed075557 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:46.493178 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-66285f97-e6e3-4be4-b5e8-4e65ed075557 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/0dff1738-81f1-4619-af74-44b7adc805b5" status: 200 len: 1472 microversion: 2.1 time: 0.180410 Sep 23 04:32:46.493837 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 257/565] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:32:46 2022] GET /compute/v2.1/servers/0dff1738-81f1-4619-af74-44b7adc805b5 => generated 1472 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:46.937386 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6ebe55a5-27b0-4ac7-ad5a-c786a1d12c35 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:46.938910 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-6ebe55a5-27b0-4ac7-ad5a-c786a1d12c35 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 9d255ae7-0aed-4692-8802-6733dfcccbd0] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:46.960772 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6ebe55a5-27b0-4ac7-ad5a-c786a1d12c35 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:46.960772 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6ebe55a5-27b0-4ac7-ad5a-c786a1d12c35 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:46.960772 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6ebe55a5-27b0-4ac7-ad5a-c786a1d12c35 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:46.960772 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6ebe55a5-27b0-4ac7-ad5a-c786a1d12c35 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:46.961179 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6ebe55a5-27b0-4ac7-ad5a-c786a1d12c35 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:46.961179 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6ebe55a5-27b0-4ac7-ad5a-c786a1d12c35 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:47.140918 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6ebe55a5-27b0-4ac7-ad5a-c786a1d12c35 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:47.157241 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6ebe55a5-27b0-4ac7-ad5a-c786a1d12c35 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:47.159193 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6ebe55a5-27b0-4ac7-ad5a-c786a1d12c35 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:47.161287 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-6ebe55a5-27b0-4ac7-ad5a-c786a1d12c35 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/9d255ae7-0aed-4692-8802-6733dfcccbd0" status: 200 len: 1544 microversion: 2.25 time: 0.229996 Sep 23 04:32:47.162383 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 258/566] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:32:46 2022] GET /compute/v2.1/servers/9d255ae7-0aed-4692-8802-6733dfcccbd0 => generated 1544 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:32:47.192922 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d14f1342-d771-4260-8f4c-93b09d0f5e9a tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Calling method '.version_select at 0x7ff1c006f8b0>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:47.196567 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d14f1342-d771-4260-8f4c-93b09d0f5e9a tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:47.197240 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d14f1342-d771-4260-8f4c-93b09d0f5e9a tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:47.197878 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d14f1342-d771-4260-8f4c-93b09d0f5e9a tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:47.218437 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d14f1342-d771-4260-8f4c-93b09d0f5e9a tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] 10.222.0.33 "GET /compute/v2.1/os-migrations" status: 200 len: 1473 microversion: 2.25 time: 0.033904 Sep 23 04:32:47.220375 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 259/567] 10.222.0.33 () {60 vars in 1184 bytes} [Fri Sep 23 04:32:47 2022] GET /compute/v2.1/os-migrations => generated 1473 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:32:47.243060 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4cf15b63-70ab-49b1-97c2-2e3ad9f905f1 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:47.244449 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4cf15b63-70ab-49b1-97c2-2e3ad9f905f1 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] [instance: 9d255ae7-0aed-4692-8802-6733dfcccbd0] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:47.250860 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4cf15b63-70ab-49b1-97c2-2e3ad9f905f1 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:47.252565 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4cf15b63-70ab-49b1-97c2-2e3ad9f905f1 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:47.252565 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4cf15b63-70ab-49b1-97c2-2e3ad9f905f1 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:47.252565 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4cf15b63-70ab-49b1-97c2-2e3ad9f905f1 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:47.253056 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4cf15b63-70ab-49b1-97c2-2e3ad9f905f1 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:47.253537 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4cf15b63-70ab-49b1-97c2-2e3ad9f905f1 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:47.345239 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-612360fc-5270-4489-ac96-5e64c087e5cb tempest-QuotasAdminTestV236-1615446828 tempest-QuotasAdminTestV236-1615446828-project-admin] Action: 'update', calling method: .version_select at 0x7ff1c01c33a0>, body: {"quota_set": {"ram": "5120"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:32:47.438154 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-4cf15b63-70ab-49b1-97c2-2e3ad9f905f1 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lazy-loading 'services' on Instance uuid 9d255ae7-0aed-4692-8802-6733dfcccbd0 {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:32:47.453428 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4cf15b63-70ab-49b1-97c2-2e3ad9f905f1 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/9d255ae7-0aed-4692-8802-6733dfcccbd0" status: 200 len: 2037 microversion: 2.25 time: 0.214530 Sep 23 04:32:47.454519 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 260/568] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:32:47 2022] GET /compute/v2.1/servers/9d255ae7-0aed-4692-8802-6733dfcccbd0 => generated 2037 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:32:47.493603 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2fca8241-66df-48c8-ab97-0d7fabce5da7 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Action: 'create', calling method: .version_select at 0x7ff1c011f670>, body: {"keypair": {"name": "tempest-keypair-1397880170", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCaT7kTpnD3hz4dcwznn78xlS5pJ2uunEivja1O9+DVx4US1Gb1JvIILbPqqC5Vby+q4U9jfxFS4FBC/CAQ/2QoEUCIZii3QadZ/ZVwSiCAwbtf3GFdy2dlw6IHlff3/KA=="}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:32:47.511531 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-2fca8241-66df-48c8-ab97-0d7fabce5da7 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Getting quotas for project 0abccbbae40b47968a8dda6323b618e3. Resources: {'key_pairs'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:32:47.518817 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-2fca8241-66df-48c8-ab97-0d7fabce5da7 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Getting quotas for user 84d0c7a6520443d896f88069e91a2eb2 and project 0abccbbae40b47968a8dda6323b618e3. Resources: {'key_pairs'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:32:47.641851 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2fca8241-66df-48c8-ab97-0d7fabce5da7 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.25 time: 0.151155 Sep 23 04:32:47.646044 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 261/569] 10.222.0.33 () {62 vars in 1200 bytes} [Fri Sep 23 04:32:47 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 159 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 23 04:32:47.653030 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-cda65d32-c6af-4de5-a2e4-176b51aa3f3d tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:47.653778 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-cda65d32-c6af-4de5-a2e4-176b51aa3f3d tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: 0dff1738-81f1-4619-af74-44b7adc805b5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:47.661808 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cda65d32-c6af-4de5-a2e4-176b51aa3f3d tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:47.662320 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cda65d32-c6af-4de5-a2e4-176b51aa3f3d tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:47.662845 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cda65d32-c6af-4de5-a2e4-176b51aa3f3d tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:47.664380 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cda65d32-c6af-4de5-a2e4-176b51aa3f3d tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:47.665018 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cda65d32-c6af-4de5-a2e4-176b51aa3f3d tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:47.665739 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cda65d32-c6af-4de5-a2e4-176b51aa3f3d tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:47.861093 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-cda65d32-c6af-4de5-a2e4-176b51aa3f3d tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:47.874862 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-cda65d32-c6af-4de5-a2e4-176b51aa3f3d tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/0dff1738-81f1-4619-af74-44b7adc805b5" status: 200 len: 1472 microversion: 2.1 time: 0.225030 Sep 23 04:32:47.877217 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 262/570] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:32:47 2022] GET /compute/v2.1/servers/0dff1738-81f1-4619-af74-44b7adc805b5 => generated 1472 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:48.060501 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=18 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:32:48.090537 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-612360fc-5270-4489-ac96-5e64c087e5cb tempest-QuotasAdminTestV236-1615446828 tempest-QuotasAdminTestV236-1615446828-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:48.091024 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-612360fc-5270-4489-ac96-5e64c087e5cb tempest-QuotasAdminTestV236-1615446828 tempest-QuotasAdminTestV236-1615446828-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:48.091651 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-612360fc-5270-4489-ac96-5e64c087e5cb tempest-QuotasAdminTestV236-1615446828 tempest-QuotasAdminTestV236-1615446828-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:48.092383 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-612360fc-5270-4489-ac96-5e64c087e5cb tempest-QuotasAdminTestV236-1615446828 tempest-QuotasAdminTestV236-1615446828-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:48.093055 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-612360fc-5270-4489-ac96-5e64c087e5cb tempest-QuotasAdminTestV236-1615446828 tempest-QuotasAdminTestV236-1615446828-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:48.093655 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-612360fc-5270-4489-ac96-5e64c087e5cb tempest-QuotasAdminTestV236-1615446828 tempest-QuotasAdminTestV236-1615446828-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:48.104040 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=26 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:32:48.159269 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-d214af6e-4cfd-4133-930c-f1e090c51432 req-c5362ebe-c877-4a44-a489-309b66dad423 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d255ae7-0aed-4692-8802-6733dfcccbd0", "name": "network-vif-plugged", "status": "completed", "tag": "76c7663b-b181-4528-b671-a0840df053e8"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:32:48.192699 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-d214af6e-4cfd-4133-930c-f1e090c51432 req-c5362ebe-c877-4a44-a489-309b66dad423 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:48.197715 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-d214af6e-4cfd-4133-930c-f1e090c51432 req-c5362ebe-c877-4a44-a489-309b66dad423 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:48.198552 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-d214af6e-4cfd-4133-930c-f1e090c51432 req-c5362ebe-c877-4a44-a489-309b66dad423 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:48.212925 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-d214af6e-4cfd-4133-930c-f1e090c51432 req-c5362ebe-c877-4a44-a489-309b66dad423 service nova] Creating event network-vif-plugged:76c7663b-b181-4528-b671-a0840df053e8 for instance 9d255ae7-0aed-4692-8802-6733dfcccbd0 on n-h1-846463-3 Sep 23 04:32:48.218502 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-d214af6e-4cfd-4133-930c-f1e090c51432 req-c5362ebe-c877-4a44-a489-309b66dad423 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069301 Sep 23 04:32:48.219386 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 263/571] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:32:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:32:48.306517 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-612360fc-5270-4489-ac96-5e64c087e5cb tempest-QuotasAdminTestV236-1615446828 tempest-QuotasAdminTestV236-1615446828-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/546cef35136d4707bc76910a5dfafaa2" status: 200 len: 240 microversion: 2.36 time: 1.461777 Sep 23 04:32:48.307153 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 309/572] 10.222.0.33 () {62 vars in 1303 bytes} [Fri Sep 23 04:32:46 2022] PUT /compute/v2.1/os-quota-sets/546cef35136d4707bc76910a5dfafaa2 => generated 240 bytes in 1463 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 04:32:48.319696 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-845a0456-9c93-4467-b735-b40baabae262 tempest-QuotasAdminTestV236-1615446828 tempest-QuotasAdminTestV236-1615446828-project-admin] Calling method '.version_select at 0x7ff1c0033160>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:49.023712 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-845a0456-9c93-4467-b735-b40baabae262 tempest-QuotasAdminTestV236-1615446828 tempest-QuotasAdminTestV236-1615446828-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:49.023712 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-845a0456-9c93-4467-b735-b40baabae262 tempest-QuotasAdminTestV236-1615446828 tempest-QuotasAdminTestV236-1615446828-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:49.023712 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-845a0456-9c93-4467-b735-b40baabae262 tempest-QuotasAdminTestV236-1615446828 tempest-QuotasAdminTestV236-1615446828-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:49.023712 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-845a0456-9c93-4467-b735-b40baabae262 tempest-QuotasAdminTestV236-1615446828 tempest-QuotasAdminTestV236-1615446828-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:49.024734 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-845a0456-9c93-4467-b735-b40baabae262 tempest-QuotasAdminTestV236-1615446828 tempest-QuotasAdminTestV236-1615446828-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:49.024734 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-845a0456-9c93-4467-b735-b40baabae262 tempest-QuotasAdminTestV236-1615446828 tempest-QuotasAdminTestV236-1615446828-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:49.044661 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-845a0456-9c93-4467-b735-b40baabae262 tempest-QuotasAdminTestV236-1615446828 tempest-QuotasAdminTestV236-1615446828-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/546cef35136d4707bc76910a5dfafaa2/detail" status: 200 len: 672 microversion: 2.36 time: 0.729059 Sep 23 04:32:49.045277 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 264/573] 10.222.0.33 () {60 vars in 1304 bytes} [Fri Sep 23 04:32:48 2022] GET /compute/v2.1/os-quota-sets/546cef35136d4707bc76910a5dfafaa2/detail => generated 672 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 04:32:49.050733 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-fd5da6b2-c531-4bcd-b6a5-58795e7fa9ee tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:49.053369 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-fd5da6b2-c531-4bcd-b6a5-58795e7fa9ee tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: 0dff1738-81f1-4619-af74-44b7adc805b5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:49.057413 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fd5da6b2-c531-4bcd-b6a5-58795e7fa9ee tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:49.057972 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fd5da6b2-c531-4bcd-b6a5-58795e7fa9ee tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:49.058568 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fd5da6b2-c531-4bcd-b6a5-58795e7fa9ee tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:49.059442 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fd5da6b2-c531-4bcd-b6a5-58795e7fa9ee tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:49.059905 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fd5da6b2-c531-4bcd-b6a5-58795e7fa9ee tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:49.060335 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fd5da6b2-c531-4bcd-b6a5-58795e7fa9ee tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:49.150818 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c1890faa-eefc-4182-bbf5-ef0f2cb55d0f tempest-HostsAdminNegativeTestJSON-1995491037 tempest-HostsAdminNegativeTestJSON-1995491037-project-admin] Calling method '.version_select at 0x7ff1c02d5c10>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:49.159868 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c1890faa-eefc-4182-bbf5-ef0f2cb55d0f tempest-HostsAdminNegativeTestJSON-1995491037 tempest-HostsAdminNegativeTestJSON-1995491037-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:49.162298 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c1890faa-eefc-4182-bbf5-ef0f2cb55d0f tempest-HostsAdminNegativeTestJSON-1995491037 tempest-HostsAdminNegativeTestJSON-1995491037-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:49.163066 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c1890faa-eefc-4182-bbf5-ef0f2cb55d0f tempest-HostsAdminNegativeTestJSON-1995491037 tempest-HostsAdminNegativeTestJSON-1995491037-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:49.165359 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c1890faa-eefc-4182-bbf5-ef0f2cb55d0f tempest-HostsAdminNegativeTestJSON-1995491037 tempest-HostsAdminNegativeTestJSON-1995491037-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:49.166175 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c1890faa-eefc-4182-bbf5-ef0f2cb55d0f tempest-HostsAdminNegativeTestJSON-1995491037 tempest-HostsAdminNegativeTestJSON-1995491037-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:49.172708 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c1890faa-eefc-4182-bbf5-ef0f2cb55d0f tempest-HostsAdminNegativeTestJSON-1995491037 tempest-HostsAdminNegativeTestJSON-1995491037-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:49.241530 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c1890faa-eefc-4182-bbf5-ef0f2cb55d0f tempest-HostsAdminNegativeTestJSON-1995491037 tempest-HostsAdminNegativeTestJSON-1995491037-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.756874 Sep 23 04:32:49.243517 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 310/574] 10.222.0.33 () {58 vars in 1128 bytes} [Fri Sep 23 04:32:48 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:32:49.298570 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-fd5da6b2-c531-4bcd-b6a5-58795e7fa9ee tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:49.310756 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-fd5da6b2-c531-4bcd-b6a5-58795e7fa9ee tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/0dff1738-81f1-4619-af74-44b7adc805b5" status: 200 len: 1472 microversion: 2.1 time: 0.263580 Sep 23 04:32:49.311793 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 265/575] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:32:49 2022] GET /compute/v2.1/servers/0dff1738-81f1-4619-af74-44b7adc805b5 => generated 1472 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:49.532889 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d29403f9-c3d9-44b9-af34-7c10f15078d7 tempest-HostsAdminNegativeTestJSON-558600794 tempest-HostsAdminNegativeTestJSON-558600794-project] Calling method '.version_select at 0x7ff1c00e3c10>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:49.536483 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d29403f9-c3d9-44b9-af34-7c10f15078d7 tempest-HostsAdminNegativeTestJSON-558600794 tempest-HostsAdminNegativeTestJSON-558600794-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '7e8e83a574634ef38cd354d694ae2d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba84e9bc0fb04b7b835be432dc0620d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:49.539090 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d29403f9-c3d9-44b9-af34-7c10f15078d7 tempest-HostsAdminNegativeTestJSON-558600794 tempest-HostsAdminNegativeTestJSON-558600794-project] Request method failure captured: Sep 23 04:32:49.539090 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Sep 23 04:32:49.539090 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:32:49.539090 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:32:49.539090 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:32:49.539090 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:32:49.539090 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:32:49.539090 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:32:49.539090 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:32:49.539090 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:32:49.539090 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTbtCLdai5w1oFfNhuDLQHMQdIYyMrFAbVuR214tlmurmBdiAyfJTivDaX__GYgveddpp1EpGpf1x2r_-RAXC8rMp5hPcmstPRU-_C9Fn4n5659HOFQQaTMBQvgvHFxE64pXgsdU0Mt72Wc37vfuE2lN9ApFiSSsCS9ntd88uiMxouQ Sep 23 04:32:49.539090 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:32:49.539090 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:32:49.539090 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:32:49.539090 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:32:49.539090 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:32:49.539090 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:32:49.539090 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: ba84e9bc0fb04b7b835be432dc0620d8 Sep 23 04:32:49.539090 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-558600794 Sep 23 04:32:49.539090 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:32:49.539090 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:32:49.540587 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ba84e9bc0fb04b7b835be432dc0620d8", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ba84e9bc0fb04b7b835be432dc0620d8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ba84e9bc0fb04b7b835be432dc0620d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ba84e9bc0fb04b7b835be432dc0620d8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:32:49.540587 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-HostsAdminNegativeTestJSON-558600794 Sep 23 04:32:49.540587 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: ba84e9bc0fb04b7b835be432dc0620d8 Sep 23 04:32:49.540587 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-558600794 Sep 23 04:32:49.540587 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-HostsAdminNegativeTestJSON-558600794-project Sep 23 04:32:49.540587 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:32:49.540587 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:32:49.540587 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 7e8e83a574634ef38cd354d694ae2d41 Sep 23 04:32:49.540587 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-HostsAdminNegativeTestJSON-558600794-project Sep 23 04:32:49.540587 n-d-846463-3 devstack@n-api.service[122699]: method: Sep 23 04:32:49.540587 n-d-846463-3 devstack@n-api.service[122699]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Sep 23 04:32:49.540587 n-d-846463-3 devstack@n-api.service[122699]: action_args: {} Sep 23 04:32:49.540587 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:32:49.541955 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:32:49.541955 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:32:49.541955 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:32:49.541955 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:32:49.541955 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:32:49.541955 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:32:49.541955 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:32:49.541955 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 23 04:32:49.541955 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:32:49.541955 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:32:49.541955 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:32:49.541955 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Sep 23 04:32:49.541955 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Sep 23 04:32:49.541955 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 23 04:32:49.541955 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 23 04:32:49.541955 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 23 04:32:49.541955 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 23 04:32:49.541955 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 23 04:32:49.541955 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 23 04:32:49.543961 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 23 04:32:49.543961 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise self.value Sep 23 04:32:49.543961 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 23 04:32:49.543961 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 23 04:32:49.543961 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 23 04:32:49.543961 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 23 04:32:49.543961 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 23 04:32:49.543961 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 23 04:32:49.543961 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Sep 23 04:32:49.543961 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:32:49.543961 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:32:49.543961 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:32:49.543961 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:32:49.543961 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:32:49.543961 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:32:49.543961 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 23 04:32:49.543961 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 23 04:32:49.543961 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Sep 23 04:32:49.543961 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:32:49.545959 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d29403f9-c3d9-44b9-af34-7c10f15078d7 tempest-HostsAdminNegativeTestJSON-558600794 tempest-HostsAdminNegativeTestJSON-558600794-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:32:49.545959 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d29403f9-c3d9-44b9-af34-7c10f15078d7 tempest-HostsAdminNegativeTestJSON-558600794 tempest-HostsAdminNegativeTestJSON-558600794-project] 10.222.0.33 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.289766 Sep 23 04:32:49.545959 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 311/576] 10.222.0.33 () {58 vars in 1128 bytes} [Fri Sep 23 04:32:49 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 295 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Sep 23 04:32:49.550449 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1de515b8-953e-4d97-89ef-f9274267c9c2 tempest-HostsAdminNegativeTestJSON-558600794 tempest-HostsAdminNegativeTestJSON-558600794-project] Calling method '.version_select at 0x7ff1bbfeddc0>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:49.552178 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-1de515b8-953e-4d97-89ef-f9274267c9c2 tempest-HostsAdminNegativeTestJSON-558600794 tempest-HostsAdminNegativeTestJSON-558600794-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '7e8e83a574634ef38cd354d694ae2d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba84e9bc0fb04b7b835be432dc0620d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:49.554214 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1de515b8-953e-4d97-89ef-f9274267c9c2 tempest-HostsAdminNegativeTestJSON-558600794 tempest-HostsAdminNegativeTestJSON-558600794-project] Request method failure captured: Sep 23 04:32:49.554214 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/os-hosts/n-d-846463-3/reboot HTTP/1.1 Sep 23 04:32:49.554214 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:32:49.554214 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:32:49.554214 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:32:49.554214 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:32:49.554214 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:32:49.554214 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:32:49.554214 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:32:49.554214 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:32:49.554214 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTbtCLdai5w1oFfNhuDLQHMQdIYyMrFAbVuR214tlmurmBdiAyfJTivDaX__GYgveddpp1EpGpf1x2r_-RAXC8rMp5hPcmstPRU-_C9Fn4n5659HOFQQaTMBQvgvHFxE64pXgsdU0Mt72Wc37vfuE2lN9ApFiSSsCS9ntd88uiMxouQ Sep 23 04:32:49.554214 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:32:49.554214 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:32:49.554214 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:32:49.554214 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:32:49.554214 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:32:49.554214 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:32:49.554214 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: ba84e9bc0fb04b7b835be432dc0620d8 Sep 23 04:32:49.554214 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-558600794 Sep 23 04:32:49.554214 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:32:49.554214 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:32:49.556468 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ba84e9bc0fb04b7b835be432dc0620d8", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ba84e9bc0fb04b7b835be432dc0620d8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ba84e9bc0fb04b7b835be432dc0620d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ba84e9bc0fb04b7b835be432dc0620d8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:32:49.556468 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-HostsAdminNegativeTestJSON-558600794 Sep 23 04:32:49.556468 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: ba84e9bc0fb04b7b835be432dc0620d8 Sep 23 04:32:49.556468 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-558600794 Sep 23 04:32:49.556468 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-HostsAdminNegativeTestJSON-558600794-project Sep 23 04:32:49.556468 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:32:49.556468 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:32:49.556468 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 7e8e83a574634ef38cd354d694ae2d41 Sep 23 04:32:49.556468 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-HostsAdminNegativeTestJSON-558600794-project Sep 23 04:32:49.556468 n-d-846463-3 devstack@n-api.service[122698]: method: Sep 23 04:32:49.556468 n-d-846463-3 devstack@n-api.service[122698]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Sep 23 04:32:49.556468 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': 'n-d-846463-3'} Sep 23 04:32:49.556468 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:32:49.562290 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:32:49.562290 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:32:49.562290 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:32:49.562290 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:32:49.562290 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:32:49.562290 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:32:49.562290 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:32:49.562290 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:32:49.562290 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:32:49.562290 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Sep 23 04:32:49.562290 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Sep 23 04:32:49.562290 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 23 04:32:49.562290 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 23 04:32:49.562290 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 23 04:32:49.562290 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 23 04:32:49.562290 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 23 04:32:49.562290 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 23 04:32:49.562290 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 23 04:32:49.562290 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise self.value Sep 23 04:32:49.565182 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 23 04:32:49.565182 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 23 04:32:49.565182 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 23 04:32:49.565182 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 23 04:32:49.565182 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 23 04:32:49.565182 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 23 04:32:49.565182 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Sep 23 04:32:49.565182 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:32:49.565182 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:32:49.565182 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:32:49.565182 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:32:49.565182 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:32:49.565182 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:32:49.565182 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 23 04:32:49.565182 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 23 04:32:49.565182 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Sep 23 04:32:49.565182 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:32:49.568014 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1de515b8-953e-4d97-89ef-f9274267c9c2 tempest-HostsAdminNegativeTestJSON-558600794 tempest-HostsAdminNegativeTestJSON-558600794-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:32:49.568014 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-1de515b8-953e-4d97-89ef-f9274267c9c2 tempest-HostsAdminNegativeTestJSON-558600794 tempest-HostsAdminNegativeTestJSON-558600794-project] 10.222.0.33 "GET /compute/v2.1/os-hosts/n-d-846463-3/reboot" status: 403 len: 111 microversion: 2.1 time: 0.009091 Sep 23 04:32:49.568014 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 266/577] 10.222.0.33 () {58 vars in 1188 bytes} [Fri Sep 23 04:32:49 2022] GET /compute/v2.1/os-hosts/n-d-846463-3/reboot => generated 111 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:32:49.570332 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-965fde1a-d0cb-4c5f-852b-3a31238343e0 tempest-HostsAdminNegativeTestJSON-1995491037 tempest-HostsAdminNegativeTestJSON-1995491037-project-admin] Calling method '.version_select at 0x7ff1c00ea790>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:49.585003 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-965fde1a-d0cb-4c5f-852b-3a31238343e0 tempest-HostsAdminNegativeTestJSON-1995491037 tempest-HostsAdminNegativeTestJSON-1995491037-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 23 04:32:49.589099 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-965fde1a-d0cb-4c5f-852b-3a31238343e0 tempest-HostsAdminNegativeTestJSON-1995491037 tempest-HostsAdminNegativeTestJSON-1995491037-project-admin] Request method failure captured: Sep 23 04:32:49.589099 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Sep 23 04:32:49.589099 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:32:49.589099 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:32:49.589099 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:32:49.589099 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:32:49.589099 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:32:49.589099 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:32:49.589099 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:32:49.589099 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:32:49.589099 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTbwv-wfKNWZsamWPuoUv1ErRhli1CuWz3G-WH0k7-qldd528ZJJ3VGM_rF6j81Lqx8Qfu3K1L0OoYKD1kCc02fc7tjPSqn7qc5ELTlHcoT7CRWLo0tCdgyrRnKBN040VKkytnjPHvPWzh7FJNBne-Eub1wsBYK0PDw5wTZhMuOeaOE Sep 23 04:32:49.589099 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:32:49.589099 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:32:49.589099 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:32:49.589099 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:32:49.589099 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:32:49.589099 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:32:49.589099 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: f26d5bc9351846c4892c1f14743afc2e Sep 23 04:32:49.589099 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1995491037 Sep 23 04:32:49.589099 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,admin,member Sep 23 04:32:49.589099 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,admin,member Sep 23 04:32:49.590819 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f26d5bc9351846c4892c1f14743afc2e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f26d5bc9351846c4892c1f14743afc2e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f26d5bc9351846c4892c1f14743afc2e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f26d5bc9351846c4892c1f14743afc2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:32:49.590819 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1995491037 Sep 23 04:32:49.590819 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: f26d5bc9351846c4892c1f14743afc2e Sep 23 04:32:49.590819 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1995491037 Sep 23 04:32:49.590819 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-HostsAdminNegativeTestJSON-1995491037-project-admin Sep 23 04:32:49.590819 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:32:49.590819 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:32:49.590819 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 7ccfcb2bd2af427eb22313dd45e355d4 Sep 23 04:32:49.590819 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1995491037-project-admin Sep 23 04:32:49.590819 n-d-846463-3 devstack@n-api.service[122699]: method: Sep 23 04:32:49.590819 n-d-846463-3 devstack@n-api.service[122699]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 23 04:32:49.590819 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': 'nonexistent_hostname'} Sep 23 04:32:49.590819 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:32:49.591793 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:32:49.591793 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Sep 23 04:32:49.591793 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Sep 23 04:32:49.591793 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 23 04:32:49.591793 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 23 04:32:49.591793 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 23 04:32:49.591793 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 23 04:32:49.591793 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 23 04:32:49.591793 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise self.value Sep 23 04:32:49.591793 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 23 04:32:49.591793 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 23 04:32:49.591793 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Sep 23 04:32:49.591793 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Sep 23 04:32:49.591793 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 04:32:49.591793 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 04:32:49.591793 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 23 04:32:49.591793 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 23 04:32:49.591793 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 23 04:32:49.591793 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 23 04:32:49.593107 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 23 04:32:49.593107 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 23 04:32:49.593107 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 23 04:32:49.593107 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:32:49.593107 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:32:49.593107 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:32:49.593107 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:32:49.593107 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:32:49.593107 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:32:49.593107 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:32:49.593107 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:32:49.593107 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:32:49.593107 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:32:49.593107 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:32:49.593107 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:32:49.593107 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Sep 23 04:32:49.593107 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Sep 23 04:32:49.593107 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Sep 23 04:32:49.593107 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:32:49.596521 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 23 04:32:49.596521 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:32:49.596521 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:32:49.596521 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:32:49.596521 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:32:49.596521 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:32:49.596521 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:32:49.596521 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:32:49.596521 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:32:49.596521 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 23 04:32:49.596521 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:32:49.596521 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-965fde1a-d0cb-4c5f-852b-3a31238343e0 tempest-HostsAdminNegativeTestJSON-1995491037 tempest-HostsAdminNegativeTestJSON-1995491037-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:32:49.596521 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-965fde1a-d0cb-4c5f-852b-3a31238343e0 tempest-HostsAdminNegativeTestJSON-1995491037 tempest-HostsAdminNegativeTestJSON-1995491037-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.024423 Sep 23 04:32:49.596521 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 312/578] 10.222.0.33 () {58 vars in 1212 bytes} [Fri Sep 23 04:32:49 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 23 04:32:49.602606 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d2a31963-38a2-4107-b586-3a7b1bc78ea5 tempest-HostsAdminNegativeTestJSON-558600794 tempest-HostsAdminNegativeTestJSON-558600794-project] Calling method '.version_select at 0x7ff1c0033ca0>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:49.604940 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d2a31963-38a2-4107-b586-3a7b1bc78ea5 tempest-HostsAdminNegativeTestJSON-558600794 tempest-HostsAdminNegativeTestJSON-558600794-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '7e8e83a574634ef38cd354d694ae2d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba84e9bc0fb04b7b835be432dc0620d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:49.606588 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d2a31963-38a2-4107-b586-3a7b1bc78ea5 tempest-HostsAdminNegativeTestJSON-558600794 tempest-HostsAdminNegativeTestJSON-558600794-project] Request method failure captured: Sep 23 04:32:49.606588 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/os-hosts/n-d-846463-3 HTTP/1.1 Sep 23 04:32:49.606588 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:32:49.606588 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:32:49.606588 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:32:49.606588 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:32:49.606588 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:32:49.606588 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:32:49.606588 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:32:49.606588 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:32:49.606588 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTbtCLdai5w1oFfNhuDLQHMQdIYyMrFAbVuR214tlmurmBdiAyfJTivDaX__GYgveddpp1EpGpf1x2r_-RAXC8rMp5hPcmstPRU-_C9Fn4n5659HOFQQaTMBQvgvHFxE64pXgsdU0Mt72Wc37vfuE2lN9ApFiSSsCS9ntd88uiMxouQ Sep 23 04:32:49.606588 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:32:49.606588 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:32:49.606588 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:32:49.606588 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:32:49.606588 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:32:49.606588 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:32:49.606588 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: ba84e9bc0fb04b7b835be432dc0620d8 Sep 23 04:32:49.606588 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-558600794 Sep 23 04:32:49.606588 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:32:49.606588 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:32:49.608103 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ba84e9bc0fb04b7b835be432dc0620d8", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ba84e9bc0fb04b7b835be432dc0620d8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ba84e9bc0fb04b7b835be432dc0620d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ba84e9bc0fb04b7b835be432dc0620d8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:32:49.608103 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-HostsAdminNegativeTestJSON-558600794 Sep 23 04:32:49.608103 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: ba84e9bc0fb04b7b835be432dc0620d8 Sep 23 04:32:49.608103 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-558600794 Sep 23 04:32:49.608103 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-HostsAdminNegativeTestJSON-558600794-project Sep 23 04:32:49.608103 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:32:49.608103 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:32:49.608103 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 7e8e83a574634ef38cd354d694ae2d41 Sep 23 04:32:49.608103 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-HostsAdminNegativeTestJSON-558600794-project Sep 23 04:32:49.608103 n-d-846463-3 devstack@n-api.service[122698]: method: Sep 23 04:32:49.608103 n-d-846463-3 devstack@n-api.service[122698]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Sep 23 04:32:49.608103 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': 'n-d-846463-3'} Sep 23 04:32:49.608103 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:32:49.609096 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:32:49.609096 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:32:49.609096 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:32:49.609096 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:32:49.609096 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:32:49.609096 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:32:49.609096 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:32:49.609096 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:32:49.609096 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:32:49.609096 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Sep 23 04:32:49.609096 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Sep 23 04:32:49.609096 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 23 04:32:49.609096 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 23 04:32:49.609096 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 23 04:32:49.609096 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 23 04:32:49.609096 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 23 04:32:49.609096 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 23 04:32:49.609096 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 23 04:32:49.609096 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise self.value Sep 23 04:32:49.610491 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 23 04:32:49.610491 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 23 04:32:49.610491 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 23 04:32:49.610491 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 23 04:32:49.610491 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 23 04:32:49.610491 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 23 04:32:49.610491 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Sep 23 04:32:49.610491 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:32:49.610491 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:32:49.610491 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:32:49.610491 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:32:49.610491 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:32:49.610491 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:32:49.610491 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 23 04:32:49.610491 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 23 04:32:49.610491 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Sep 23 04:32:49.610491 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:32:49.611696 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d2a31963-38a2-4107-b586-3a7b1bc78ea5 tempest-HostsAdminNegativeTestJSON-558600794 tempest-HostsAdminNegativeTestJSON-558600794-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:32:49.611696 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d2a31963-38a2-4107-b586-3a7b1bc78ea5 tempest-HostsAdminNegativeTestJSON-558600794 tempest-HostsAdminNegativeTestJSON-558600794-project] 10.222.0.33 "GET /compute/v2.1/os-hosts/n-d-846463-3" status: 403 len: 109 microversion: 2.1 time: 0.012425 Sep 23 04:32:49.613928 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 267/579] 10.222.0.33 () {58 vars in 1167 bytes} [Fri Sep 23 04:32:49 2022] GET /compute/v2.1/os-hosts/n-d-846463-3 => generated 109 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:32:49.623343 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d630ca91-e28a-4163-9cb2-35a73038f800 tempest-HostsAdminNegativeTestJSON-1995491037 tempest-HostsAdminNegativeTestJSON-1995491037-project-admin] Calling method '.version_select at 0x7ff1c0233dc0>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:49.631293 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-d630ca91-e28a-4163-9cb2-35a73038f800 tempest-HostsAdminNegativeTestJSON-1995491037 tempest-HostsAdminNegativeTestJSON-1995491037-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 23 04:32:49.632816 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d630ca91-e28a-4163-9cb2-35a73038f800 tempest-HostsAdminNegativeTestJSON-1995491037 tempest-HostsAdminNegativeTestJSON-1995491037-project-admin] Request method failure captured: Sep 23 04:32:49.632816 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Sep 23 04:32:49.632816 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:32:49.632816 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:32:49.632816 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:32:49.632816 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:32:49.632816 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:32:49.632816 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:32:49.632816 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:32:49.632816 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:32:49.632816 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTbwv-wfKNWZsamWPuoUv1ErRhli1CuWz3G-WH0k7-qldd528ZJJ3VGM_rF6j81Lqx8Qfu3K1L0OoYKD1kCc02fc7tjPSqn7qc5ELTlHcoT7CRWLo0tCdgyrRnKBN040VKkytnjPHvPWzh7FJNBne-Eub1wsBYK0PDw5wTZhMuOeaOE Sep 23 04:32:49.632816 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:32:49.632816 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:32:49.632816 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:32:49.632816 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:32:49.632816 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:32:49.632816 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:32:49.632816 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: f26d5bc9351846c4892c1f14743afc2e Sep 23 04:32:49.632816 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1995491037 Sep 23 04:32:49.632816 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,admin,member Sep 23 04:32:49.632816 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,admin,member Sep 23 04:32:49.634341 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f26d5bc9351846c4892c1f14743afc2e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f26d5bc9351846c4892c1f14743afc2e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f26d5bc9351846c4892c1f14743afc2e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f26d5bc9351846c4892c1f14743afc2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:32:49.634341 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1995491037 Sep 23 04:32:49.634341 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: f26d5bc9351846c4892c1f14743afc2e Sep 23 04:32:49.634341 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1995491037 Sep 23 04:32:49.634341 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-HostsAdminNegativeTestJSON-1995491037-project-admin Sep 23 04:32:49.634341 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:32:49.634341 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:32:49.634341 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 7ccfcb2bd2af427eb22313dd45e355d4 Sep 23 04:32:49.634341 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1995491037-project-admin Sep 23 04:32:49.634341 n-d-846463-3 devstack@n-api.service[122699]: method: Sep 23 04:32:49.634341 n-d-846463-3 devstack@n-api.service[122699]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 23 04:32:49.634341 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': 'nonexistent_hostname'} Sep 23 04:32:49.634341 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:32:49.635266 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:32:49.635266 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Sep 23 04:32:49.635266 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Sep 23 04:32:49.635266 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 04:32:49.635266 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 04:32:49.635266 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 23 04:32:49.635266 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 23 04:32:49.635266 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 23 04:32:49.635266 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 23 04:32:49.635266 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 23 04:32:49.635266 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 23 04:32:49.635266 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 23 04:32:49.635266 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:32:49.635266 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:32:49.635266 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:32:49.635266 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:32:49.635266 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:32:49.635266 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:32:49.635266 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:32:49.636541 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:32:49.636541 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:32:49.636541 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:32:49.636541 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:32:49.636541 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:32:49.636541 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Sep 23 04:32:49.636541 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:32:49.636541 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 23 04:32:49.636541 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:32:49.636541 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:32:49.636541 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:32:49.636541 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:32:49.636541 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:32:49.636541 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:32:49.636541 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:32:49.636541 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:32:49.636541 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 23 04:32:49.636541 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:32:49.637639 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d630ca91-e28a-4163-9cb2-35a73038f800 tempest-HostsAdminNegativeTestJSON-1995491037 tempest-HostsAdminNegativeTestJSON-1995491037-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:32:49.637639 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d630ca91-e28a-4163-9cb2-35a73038f800 tempest-HostsAdminNegativeTestJSON-1995491037 tempest-HostsAdminNegativeTestJSON-1995491037-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.016175 Sep 23 04:32:49.639209 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 313/580] 10.222.0.33 () {58 vars in 1191 bytes} [Fri Sep 23 04:32:49 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 23 04:32:49.650907 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-02966f7e-6ef5-4019-8755-b3e1cf538bfb tempest-HostsAdminNegativeTestJSON-558600794 tempest-HostsAdminNegativeTestJSON-558600794-project] Calling method '.version_select at 0x7ff1c00331f0>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:49.650907 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-02966f7e-6ef5-4019-8755-b3e1cf538bfb tempest-HostsAdminNegativeTestJSON-558600794 tempest-HostsAdminNegativeTestJSON-558600794-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '7e8e83a574634ef38cd354d694ae2d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba84e9bc0fb04b7b835be432dc0620d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:49.651795 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-02966f7e-6ef5-4019-8755-b3e1cf538bfb tempest-HostsAdminNegativeTestJSON-558600794 tempest-HostsAdminNegativeTestJSON-558600794-project] Request method failure captured: Sep 23 04:32:49.651795 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/os-hosts/n-d-846463-3/shutdown HTTP/1.1 Sep 23 04:32:49.651795 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:32:49.651795 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:32:49.651795 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:32:49.651795 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:32:49.651795 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:32:49.651795 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:32:49.651795 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:32:49.651795 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:32:49.651795 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTbtCLdai5w1oFfNhuDLQHMQdIYyMrFAbVuR214tlmurmBdiAyfJTivDaX__GYgveddpp1EpGpf1x2r_-RAXC8rMp5hPcmstPRU-_C9Fn4n5659HOFQQaTMBQvgvHFxE64pXgsdU0Mt72Wc37vfuE2lN9ApFiSSsCS9ntd88uiMxouQ Sep 23 04:32:49.651795 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:32:49.651795 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:32:49.651795 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:32:49.651795 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:32:49.651795 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:32:49.651795 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:32:49.651795 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: ba84e9bc0fb04b7b835be432dc0620d8 Sep 23 04:32:49.651795 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-558600794 Sep 23 04:32:49.651795 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:32:49.651795 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:32:49.653065 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ba84e9bc0fb04b7b835be432dc0620d8", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ba84e9bc0fb04b7b835be432dc0620d8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ba84e9bc0fb04b7b835be432dc0620d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ba84e9bc0fb04b7b835be432dc0620d8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:32:49.653065 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-HostsAdminNegativeTestJSON-558600794 Sep 23 04:32:49.653065 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: ba84e9bc0fb04b7b835be432dc0620d8 Sep 23 04:32:49.653065 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-558600794 Sep 23 04:32:49.653065 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-HostsAdminNegativeTestJSON-558600794-project Sep 23 04:32:49.653065 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:32:49.653065 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:32:49.653065 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 7e8e83a574634ef38cd354d694ae2d41 Sep 23 04:32:49.653065 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-HostsAdminNegativeTestJSON-558600794-project Sep 23 04:32:49.653065 n-d-846463-3 devstack@n-api.service[122698]: method: Sep 23 04:32:49.653065 n-d-846463-3 devstack@n-api.service[122698]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Sep 23 04:32:49.653065 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': 'n-d-846463-3'} Sep 23 04:32:49.653065 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:32:49.653988 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:32:49.653988 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:32:49.653988 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:32:49.653988 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:32:49.653988 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:32:49.653988 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:32:49.653988 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:32:49.653988 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:32:49.653988 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:32:49.653988 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Sep 23 04:32:49.653988 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Sep 23 04:32:49.653988 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 23 04:32:49.653988 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 23 04:32:49.653988 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 23 04:32:49.653988 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 23 04:32:49.653988 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 23 04:32:49.653988 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 23 04:32:49.653988 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 23 04:32:49.653988 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise self.value Sep 23 04:32:49.655075 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 23 04:32:49.655075 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 23 04:32:49.655075 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 23 04:32:49.655075 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 23 04:32:49.655075 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 23 04:32:49.655075 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 23 04:32:49.655075 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Sep 23 04:32:49.655075 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:32:49.655075 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:32:49.655075 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:32:49.655075 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:32:49.655075 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:32:49.655075 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:32:49.655075 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 23 04:32:49.655075 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 23 04:32:49.655075 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Sep 23 04:32:49.655075 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:32:49.656020 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-02966f7e-6ef5-4019-8755-b3e1cf538bfb tempest-HostsAdminNegativeTestJSON-558600794 tempest-HostsAdminNegativeTestJSON-558600794-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:32:49.656020 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-02966f7e-6ef5-4019-8755-b3e1cf538bfb tempest-HostsAdminNegativeTestJSON-558600794 tempest-HostsAdminNegativeTestJSON-558600794-project] 10.222.0.33 "GET /compute/v2.1/os-hosts/n-d-846463-3/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.012490 Sep 23 04:32:49.660237 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 268/581] 10.222.0.33 () {58 vars in 1194 bytes} [Fri Sep 23 04:32:49 2022] GET /compute/v2.1/os-hosts/n-d-846463-3/shutdown => generated 113 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:32:49.671449 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0935f741-9933-4e32-a6b7-26daa6e33387 tempest-HostsAdminNegativeTestJSON-1995491037 tempest-HostsAdminNegativeTestJSON-1995491037-project-admin] Calling method '.version_select at 0x7ff1c00e3b80>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:49.682715 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-0935f741-9933-4e32-a6b7-26daa6e33387 tempest-HostsAdminNegativeTestJSON-1995491037 tempest-HostsAdminNegativeTestJSON-1995491037-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 23 04:32:49.684423 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0935f741-9933-4e32-a6b7-26daa6e33387 tempest-HostsAdminNegativeTestJSON-1995491037 tempest-HostsAdminNegativeTestJSON-1995491037-project-admin] Request method failure captured: Sep 23 04:32:49.684423 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Sep 23 04:32:49.684423 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:32:49.684423 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:32:49.684423 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:32:49.684423 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:32:49.684423 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:32:49.684423 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:32:49.684423 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:32:49.684423 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:32:49.684423 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTbwv-wfKNWZsamWPuoUv1ErRhli1CuWz3G-WH0k7-qldd528ZJJ3VGM_rF6j81Lqx8Qfu3K1L0OoYKD1kCc02fc7tjPSqn7qc5ELTlHcoT7CRWLo0tCdgyrRnKBN040VKkytnjPHvPWzh7FJNBne-Eub1wsBYK0PDw5wTZhMuOeaOE Sep 23 04:32:49.684423 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:32:49.684423 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:32:49.684423 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:32:49.684423 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:32:49.684423 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:32:49.684423 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:32:49.684423 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: f26d5bc9351846c4892c1f14743afc2e Sep 23 04:32:49.684423 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1995491037 Sep 23 04:32:49.684423 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,admin,member Sep 23 04:32:49.684423 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,admin,member Sep 23 04:32:49.685751 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f26d5bc9351846c4892c1f14743afc2e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f26d5bc9351846c4892c1f14743afc2e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f26d5bc9351846c4892c1f14743afc2e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f26d5bc9351846c4892c1f14743afc2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:32:49.685751 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1995491037 Sep 23 04:32:49.685751 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: f26d5bc9351846c4892c1f14743afc2e Sep 23 04:32:49.685751 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1995491037 Sep 23 04:32:49.685751 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-HostsAdminNegativeTestJSON-1995491037-project-admin Sep 23 04:32:49.685751 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:32:49.685751 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:32:49.685751 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 7ccfcb2bd2af427eb22313dd45e355d4 Sep 23 04:32:49.685751 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1995491037-project-admin Sep 23 04:32:49.685751 n-d-846463-3 devstack@n-api.service[122699]: method: Sep 23 04:32:49.685751 n-d-846463-3 devstack@n-api.service[122699]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 23 04:32:49.685751 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': 'nonexistent_hostname'} Sep 23 04:32:49.685751 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:32:49.686624 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:32:49.686624 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Sep 23 04:32:49.686624 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Sep 23 04:32:49.686624 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 23 04:32:49.686624 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 23 04:32:49.686624 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 23 04:32:49.686624 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 23 04:32:49.686624 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 23 04:32:49.686624 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise self.value Sep 23 04:32:49.686624 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 23 04:32:49.686624 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 23 04:32:49.686624 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Sep 23 04:32:49.686624 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Sep 23 04:32:49.686624 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 04:32:49.686624 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 04:32:49.686624 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 23 04:32:49.686624 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 23 04:32:49.686624 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 23 04:32:49.686624 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 23 04:32:49.688214 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 23 04:32:49.688214 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 23 04:32:49.688214 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 23 04:32:49.688214 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:32:49.688214 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:32:49.688214 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:32:49.688214 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:32:49.688214 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:32:49.688214 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:32:49.688214 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:32:49.688214 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:32:49.688214 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:32:49.688214 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:32:49.688214 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:32:49.688214 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:32:49.688214 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Sep 23 04:32:49.688214 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Sep 23 04:32:49.688214 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Sep 23 04:32:49.688214 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:32:49.689268 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 23 04:32:49.689268 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:32:49.689268 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:32:49.689268 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:32:49.689268 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:32:49.689268 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:32:49.689268 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:32:49.689268 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:32:49.689268 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:32:49.689268 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 23 04:32:49.689268 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:32:49.689268 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0935f741-9933-4e32-a6b7-26daa6e33387 tempest-HostsAdminNegativeTestJSON-1995491037 tempest-HostsAdminNegativeTestJSON-1995491037-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:32:49.689268 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0935f741-9933-4e32-a6b7-26daa6e33387 tempest-HostsAdminNegativeTestJSON-1995491037 tempest-HostsAdminNegativeTestJSON-1995491037-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.021366 Sep 23 04:32:49.691247 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 314/582] 10.222.0.33 () {58 vars in 1218 bytes} [Fri Sep 23 04:32:49 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 23 04:32:49.695917 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-57173fcc-222c-4774-9616-d782bb4f2fd1 tempest-HostsAdminNegativeTestJSON-558600794 tempest-HostsAdminNegativeTestJSON-558600794-project] Calling method '.version_select at 0x7ff1bbfed790>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:49.697797 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-57173fcc-222c-4774-9616-d782bb4f2fd1 tempest-HostsAdminNegativeTestJSON-558600794 tempest-HostsAdminNegativeTestJSON-558600794-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '7e8e83a574634ef38cd354d694ae2d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba84e9bc0fb04b7b835be432dc0620d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:49.699341 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-57173fcc-222c-4774-9616-d782bb4f2fd1 tempest-HostsAdminNegativeTestJSON-558600794 tempest-HostsAdminNegativeTestJSON-558600794-project] Request method failure captured: Sep 23 04:32:49.699341 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/os-hosts/n-d-846463-3/startup HTTP/1.1 Sep 23 04:32:49.699341 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:32:49.699341 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:32:49.699341 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:32:49.699341 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:32:49.699341 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:32:49.699341 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:32:49.699341 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:32:49.699341 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:32:49.699341 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTbtCLdai5w1oFfNhuDLQHMQdIYyMrFAbVuR214tlmurmBdiAyfJTivDaX__GYgveddpp1EpGpf1x2r_-RAXC8rMp5hPcmstPRU-_C9Fn4n5659HOFQQaTMBQvgvHFxE64pXgsdU0Mt72Wc37vfuE2lN9ApFiSSsCS9ntd88uiMxouQ Sep 23 04:32:49.699341 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:32:49.699341 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:32:49.699341 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:32:49.699341 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:32:49.699341 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:32:49.699341 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:32:49.699341 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: ba84e9bc0fb04b7b835be432dc0620d8 Sep 23 04:32:49.699341 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-558600794 Sep 23 04:32:49.699341 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:32:49.699341 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:32:49.700820 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ba84e9bc0fb04b7b835be432dc0620d8", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ba84e9bc0fb04b7b835be432dc0620d8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ba84e9bc0fb04b7b835be432dc0620d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ba84e9bc0fb04b7b835be432dc0620d8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:32:49.700820 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-HostsAdminNegativeTestJSON-558600794 Sep 23 04:32:49.700820 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: ba84e9bc0fb04b7b835be432dc0620d8 Sep 23 04:32:49.700820 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-558600794 Sep 23 04:32:49.700820 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-HostsAdminNegativeTestJSON-558600794-project Sep 23 04:32:49.700820 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:32:49.700820 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:32:49.700820 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 7e8e83a574634ef38cd354d694ae2d41 Sep 23 04:32:49.700820 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-HostsAdminNegativeTestJSON-558600794-project Sep 23 04:32:49.700820 n-d-846463-3 devstack@n-api.service[122698]: method: Sep 23 04:32:49.700820 n-d-846463-3 devstack@n-api.service[122698]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Sep 23 04:32:49.700820 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': 'n-d-846463-3'} Sep 23 04:32:49.700820 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:32:49.701724 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:32:49.701724 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:32:49.701724 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:32:49.701724 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:32:49.701724 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:32:49.701724 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:32:49.701724 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:32:49.701724 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:32:49.701724 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:32:49.701724 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Sep 23 04:32:49.701724 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Sep 23 04:32:49.701724 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 23 04:32:49.701724 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 23 04:32:49.701724 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 23 04:32:49.701724 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 23 04:32:49.701724 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 23 04:32:49.701724 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 23 04:32:49.701724 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 23 04:32:49.701724 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise self.value Sep 23 04:32:49.703793 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 23 04:32:49.703793 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 23 04:32:49.703793 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 23 04:32:49.703793 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 23 04:32:49.703793 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 23 04:32:49.703793 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 23 04:32:49.703793 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Sep 23 04:32:49.703793 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:32:49.703793 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:32:49.703793 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:32:49.703793 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:32:49.703793 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:32:49.703793 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:32:49.703793 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 23 04:32:49.703793 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 23 04:32:49.703793 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Sep 23 04:32:49.703793 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:32:49.704762 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-57173fcc-222c-4774-9616-d782bb4f2fd1 tempest-HostsAdminNegativeTestJSON-558600794 tempest-HostsAdminNegativeTestJSON-558600794-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:32:49.704762 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-57173fcc-222c-4774-9616-d782bb4f2fd1 tempest-HostsAdminNegativeTestJSON-558600794 tempest-HostsAdminNegativeTestJSON-558600794-project] 10.222.0.33 "GET /compute/v2.1/os-hosts/n-d-846463-3/startup" status: 403 len: 110 microversion: 2.1 time: 0.008577 Sep 23 04:32:49.704762 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 269/583] 10.222.0.33 () {58 vars in 1191 bytes} [Fri Sep 23 04:32:49 2022] GET /compute/v2.1/os-hosts/n-d-846463-3/startup => generated 110 bytes in 10 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:32:49.713779 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ecd44050-358b-48ab-b9ab-43ee84749791 tempest-HostsAdminNegativeTestJSON-1995491037 tempest-HostsAdminNegativeTestJSON-1995491037-project-admin] Calling method '.version_select at 0x7ff1c1af4ee0>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:49.723483 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-ecd44050-358b-48ab-b9ab-43ee84749791 tempest-HostsAdminNegativeTestJSON-1995491037 tempest-HostsAdminNegativeTestJSON-1995491037-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 23 04:32:49.725422 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ecd44050-358b-48ab-b9ab-43ee84749791 tempest-HostsAdminNegativeTestJSON-1995491037 tempest-HostsAdminNegativeTestJSON-1995491037-project-admin] Request method failure captured: Sep 23 04:32:49.725422 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Sep 23 04:32:49.725422 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:32:49.725422 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:32:49.725422 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:32:49.725422 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:32:49.725422 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:32:49.725422 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:32:49.725422 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:32:49.725422 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:32:49.725422 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTbwv-wfKNWZsamWPuoUv1ErRhli1CuWz3G-WH0k7-qldd528ZJJ3VGM_rF6j81Lqx8Qfu3K1L0OoYKD1kCc02fc7tjPSqn7qc5ELTlHcoT7CRWLo0tCdgyrRnKBN040VKkytnjPHvPWzh7FJNBne-Eub1wsBYK0PDw5wTZhMuOeaOE Sep 23 04:32:49.725422 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:32:49.725422 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:32:49.725422 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:32:49.725422 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:32:49.725422 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:32:49.725422 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:32:49.725422 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: f26d5bc9351846c4892c1f14743afc2e Sep 23 04:32:49.725422 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1995491037 Sep 23 04:32:49.725422 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,admin,member Sep 23 04:32:49.725422 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,admin,member Sep 23 04:32:49.727079 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f26d5bc9351846c4892c1f14743afc2e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f26d5bc9351846c4892c1f14743afc2e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f26d5bc9351846c4892c1f14743afc2e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f26d5bc9351846c4892c1f14743afc2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:32:49.727079 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1995491037 Sep 23 04:32:49.727079 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: f26d5bc9351846c4892c1f14743afc2e Sep 23 04:32:49.727079 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1995491037 Sep 23 04:32:49.727079 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-HostsAdminNegativeTestJSON-1995491037-project-admin Sep 23 04:32:49.727079 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:32:49.727079 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:32:49.727079 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 7ccfcb2bd2af427eb22313dd45e355d4 Sep 23 04:32:49.727079 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1995491037-project-admin Sep 23 04:32:49.727079 n-d-846463-3 devstack@n-api.service[122699]: method: Sep 23 04:32:49.727079 n-d-846463-3 devstack@n-api.service[122699]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 23 04:32:49.727079 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': 'nonexistent_hostname'} Sep 23 04:32:49.727079 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:32:49.727953 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:32:49.727953 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Sep 23 04:32:49.727953 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Sep 23 04:32:49.727953 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 23 04:32:49.727953 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 23 04:32:49.727953 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 23 04:32:49.727953 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 23 04:32:49.727953 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 23 04:32:49.727953 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise self.value Sep 23 04:32:49.727953 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 23 04:32:49.727953 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 23 04:32:49.727953 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Sep 23 04:32:49.727953 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Sep 23 04:32:49.727953 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 04:32:49.727953 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 04:32:49.727953 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 23 04:32:49.727953 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 23 04:32:49.727953 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 23 04:32:49.727953 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 23 04:32:49.729148 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 23 04:32:49.729148 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 23 04:32:49.729148 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 23 04:32:49.729148 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:32:49.729148 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:32:49.729148 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:32:49.729148 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:32:49.729148 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:32:49.729148 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:32:49.729148 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:32:49.729148 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:32:49.729148 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:32:49.729148 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:32:49.729148 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:32:49.729148 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:32:49.729148 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Sep 23 04:32:49.729148 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Sep 23 04:32:49.729148 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Sep 23 04:32:49.729148 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:32:49.731429 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 23 04:32:49.731429 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:32:49.731429 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:32:49.731429 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:32:49.731429 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:32:49.731429 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:32:49.731429 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:32:49.731429 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:32:49.731429 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:32:49.731429 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 23 04:32:49.731429 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:32:49.731429 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ecd44050-358b-48ab-b9ab-43ee84749791 tempest-HostsAdminNegativeTestJSON-1995491037 tempest-HostsAdminNegativeTestJSON-1995491037-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:32:49.731429 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ecd44050-358b-48ab-b9ab-43ee84749791 tempest-HostsAdminNegativeTestJSON-1995491037 tempest-HostsAdminNegativeTestJSON-1995491037-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.018897 Sep 23 04:32:49.731429 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 315/584] 10.222.0.33 () {58 vars in 1215 bytes} [Fri Sep 23 04:32:49 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 23 04:32:49.739012 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-055f25f7-0ebd-4215-a7f1-8e7ac84ad0b8 tempest-HostsAdminNegativeTestJSON-1995491037 tempest-HostsAdminNegativeTestJSON-1995491037-project-admin] Action: 'update', calling method: .version_select at 0x7ff1bbfed0d0>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:32:49.747165 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-055f25f7-0ebd-4215-a7f1-8e7ac84ad0b8 tempest-HostsAdminNegativeTestJSON-1995491037 tempest-HostsAdminNegativeTestJSON-1995491037-project-admin] Request method failure captured: Sep 23 04:32:49.747165 n-d-846463-3 devstack@n-api.service[122698]: request: PUT /compute/v2.1/os-hosts/n-d-846463-3 HTTP/1.1 Sep 23 04:32:49.747165 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:32:49.747165 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:32:49.747165 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:32:49.747165 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 51 Sep 23 04:32:49.747165 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:32:49.747165 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:32:49.747165 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:32:49.747165 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:32:49.747165 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTbwv-wfKNWZsamWPuoUv1ErRhli1CuWz3G-WH0k7-qldd528ZJJ3VGM_rF6j81Lqx8Qfu3K1L0OoYKD1kCc02fc7tjPSqn7qc5ELTlHcoT7CRWLo0tCdgyrRnKBN040VKkytnjPHvPWzh7FJNBne-Eub1wsBYK0PDw5wTZhMuOeaOE Sep 23 04:32:49.747165 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:32:49.747165 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:32:49.747165 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:32:49.747165 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:32:49.747165 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:32:49.747165 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:32:49.747165 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: f26d5bc9351846c4892c1f14743afc2e Sep 23 04:32:49.747165 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1995491037 Sep 23 04:32:49.747165 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,admin,member Sep 23 04:32:49.747165 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,admin,member Sep 23 04:32:49.748633 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f26d5bc9351846c4892c1f14743afc2e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f26d5bc9351846c4892c1f14743afc2e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f26d5bc9351846c4892c1f14743afc2e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f26d5bc9351846c4892c1f14743afc2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:32:49.748633 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1995491037 Sep 23 04:32:49.748633 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: f26d5bc9351846c4892c1f14743afc2e Sep 23 04:32:49.748633 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1995491037 Sep 23 04:32:49.748633 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-HostsAdminNegativeTestJSON-1995491037-project-admin Sep 23 04:32:49.748633 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:32:49.748633 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:32:49.748633 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 7ccfcb2bd2af427eb22313dd45e355d4 Sep 23 04:32:49.748633 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1995491037-project-admin Sep 23 04:32:49.748633 n-d-846463-3 devstack@n-api.service[122698]: Sep 23 04:32:49.748633 n-d-846463-3 devstack@n-api.service[122698]: {"status": "enable", "maintenance_mode": "invalid"} Sep 23 04:32:49.748633 n-d-846463-3 devstack@n-api.service[122698]: method: Sep 23 04:32:49.748633 n-d-846463-3 devstack@n-api.service[122698]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 23 04:32:49.749516 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': 'n-d-846463-3', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Sep 23 04:32:49.749516 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:32:49.749516 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:32:49.749516 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 23 04:32:49.749516 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 23 04:32:49.749516 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 23 04:32:49.749516 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise error Sep 23 04:32:49.749516 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 23 04:32:49.749516 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:32:49.749516 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Sep 23 04:32:49.749516 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Sep 23 04:32:49.749516 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi 'disable', Sep 23 04:32:49.749516 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi 'Enable', Sep 23 04:32:49.749516 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi 'Disable', Sep 23 04:32:49.749516 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi 'ENABLE', Sep 23 04:32:49.749516 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi 'DISABLE'], Sep 23 04:32:49.749516 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi 'type': 'string'} Sep 23 04:32:49.749516 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:32:49.749516 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi On instance: Sep 23 04:32:49.749516 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi 'invalid' Sep 23 04:32:49.749516 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:32:49.749516 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:32:49.749516 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:32:49.749516 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:32:49.749516 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:32:49.751846 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:32:49.751846 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:32:49.751846 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:32:49.751846 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:32:49.751846 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:32:49.751846 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:32:49.751846 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:32:49.751846 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 23 04:32:49.751846 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 23 04:32:49.751846 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 23 04:32:49.751846 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 23 04:32:49.751846 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 23 04:32:49.751846 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 23 04:32:49.751846 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 23 04:32:49.751846 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:32:49.751846 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:32:49.751846 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:32:49.751846 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:32:49.751846 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:32:49.753406 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:32:49.753406 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 23 04:32:49.753406 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 23 04:32:49.753406 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 23 04:32:49.753406 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:32:49.753406 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-055f25f7-0ebd-4215-a7f1-8e7ac84ad0b8 tempest-HostsAdminNegativeTestJSON-1995491037 tempest-HostsAdminNegativeTestJSON-1995491037-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:32:49.753406 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-055f25f7-0ebd-4215-a7f1-8e7ac84ad0b8 tempest-HostsAdminNegativeTestJSON-1995491037 tempest-HostsAdminNegativeTestJSON-1995491037-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-hosts/n-d-846463-3" status: 400 len: 199 microversion: 2.1 time: 0.015222 Sep 23 04:32:49.753406 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 270/585] 10.222.0.33 () {60 vars in 1187 bytes} [Fri Sep 23 04:32:49 2022] PUT /compute/v2.1/os-hosts/n-d-846463-3 => generated 199 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 04:32:49.762017 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6343fd47-fe22-49fc-b4cb-6f2dfb25b07a tempest-HostsAdminNegativeTestJSON-1995491037 tempest-HostsAdminNegativeTestJSON-1995491037-project-admin] Action: 'update', calling method: .version_select at 0x7ff1c00e38b0>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:32:49.768827 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6343fd47-fe22-49fc-b4cb-6f2dfb25b07a tempest-HostsAdminNegativeTestJSON-1995491037 tempest-HostsAdminNegativeTestJSON-1995491037-project-admin] Request method failure captured: Sep 23 04:32:49.768827 n-d-846463-3 devstack@n-api.service[122699]: request: PUT /compute/v2.1/os-hosts/n-d-846463-3 HTTP/1.1 Sep 23 04:32:49.768827 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:32:49.768827 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:32:49.768827 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:32:49.768827 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 51 Sep 23 04:32:49.768827 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:32:49.768827 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:32:49.768827 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:32:49.768827 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:32:49.768827 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTbwv-wfKNWZsamWPuoUv1ErRhli1CuWz3G-WH0k7-qldd528ZJJ3VGM_rF6j81Lqx8Qfu3K1L0OoYKD1kCc02fc7tjPSqn7qc5ELTlHcoT7CRWLo0tCdgyrRnKBN040VKkytnjPHvPWzh7FJNBne-Eub1wsBYK0PDw5wTZhMuOeaOE Sep 23 04:32:49.768827 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:32:49.768827 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:32:49.768827 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:32:49.768827 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:32:49.768827 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:32:49.768827 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:32:49.768827 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: f26d5bc9351846c4892c1f14743afc2e Sep 23 04:32:49.768827 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1995491037 Sep 23 04:32:49.768827 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,admin,member Sep 23 04:32:49.768827 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,admin,member Sep 23 04:32:49.772672 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f26d5bc9351846c4892c1f14743afc2e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f26d5bc9351846c4892c1f14743afc2e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f26d5bc9351846c4892c1f14743afc2e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f26d5bc9351846c4892c1f14743afc2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:32:49.772672 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1995491037 Sep 23 04:32:49.772672 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: f26d5bc9351846c4892c1f14743afc2e Sep 23 04:32:49.772672 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1995491037 Sep 23 04:32:49.772672 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-HostsAdminNegativeTestJSON-1995491037-project-admin Sep 23 04:32:49.772672 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:32:49.772672 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:32:49.772672 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 7ccfcb2bd2af427eb22313dd45e355d4 Sep 23 04:32:49.772672 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1995491037-project-admin Sep 23 04:32:49.772672 n-d-846463-3 devstack@n-api.service[122699]: Sep 23 04:32:49.772672 n-d-846463-3 devstack@n-api.service[122699]: {"status": "invalid", "maintenance_mode": "enable"} Sep 23 04:32:49.772672 n-d-846463-3 devstack@n-api.service[122699]: method: Sep 23 04:32:49.772672 n-d-846463-3 devstack@n-api.service[122699]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 23 04:32:49.773698 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': 'n-d-846463-3', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Sep 23 04:32:49.773698 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:32:49.773698 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:32:49.773698 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 23 04:32:49.773698 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 23 04:32:49.773698 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 23 04:32:49.773698 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise error Sep 23 04:32:49.773698 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 23 04:32:49.773698 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:32:49.773698 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Sep 23 04:32:49.773698 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Sep 23 04:32:49.773698 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi 'disable', Sep 23 04:32:49.773698 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi 'Enable', Sep 23 04:32:49.773698 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi 'Disable', Sep 23 04:32:49.773698 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi 'ENABLE', Sep 23 04:32:49.773698 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi 'DISABLE'], Sep 23 04:32:49.773698 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi 'type': 'string'} Sep 23 04:32:49.773698 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:32:49.773698 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi On instance: Sep 23 04:32:49.773698 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi 'invalid' Sep 23 04:32:49.773698 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:32:49.773698 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:32:49.773698 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:32:49.773698 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:32:49.773698 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:32:49.775151 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:32:49.775151 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:32:49.775151 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:32:49.775151 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:32:49.775151 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:32:49.775151 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:32:49.775151 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:32:49.775151 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 23 04:32:49.775151 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 23 04:32:49.775151 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 23 04:32:49.775151 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 23 04:32:49.775151 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 23 04:32:49.775151 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 23 04:32:49.775151 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 23 04:32:49.775151 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:32:49.775151 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:32:49.775151 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:32:49.775151 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:32:49.775151 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:32:49.776234 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:32:49.776234 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 23 04:32:49.776234 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 23 04:32:49.776234 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 23 04:32:49.776234 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:32:49.776234 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6343fd47-fe22-49fc-b4cb-6f2dfb25b07a tempest-HostsAdminNegativeTestJSON-1995491037 tempest-HostsAdminNegativeTestJSON-1995491037-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:32:49.776234 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6343fd47-fe22-49fc-b4cb-6f2dfb25b07a tempest-HostsAdminNegativeTestJSON-1995491037 tempest-HostsAdminNegativeTestJSON-1995491037-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-hosts/n-d-846463-3" status: 400 len: 189 microversion: 2.1 time: 0.013334 Sep 23 04:32:49.776234 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 316/586] 10.222.0.33 () {60 vars in 1187 bytes} [Fri Sep 23 04:32:49 2022] PUT /compute/v2.1/os-hosts/n-d-846463-3 => generated 189 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 04:32:49.784365 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ad4073bb-2819-4989-a481-bd14ab48f3e9 tempest-HostsAdminNegativeTestJSON-558600794 tempest-HostsAdminNegativeTestJSON-558600794-project] Action: 'update', calling method: .version_select at 0x7ff1c0062a60>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:32:49.788904 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ad4073bb-2819-4989-a481-bd14ab48f3e9 tempest-HostsAdminNegativeTestJSON-558600794 tempest-HostsAdminNegativeTestJSON-558600794-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '7e8e83a574634ef38cd354d694ae2d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba84e9bc0fb04b7b835be432dc0620d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:49.791059 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ad4073bb-2819-4989-a481-bd14ab48f3e9 tempest-HostsAdminNegativeTestJSON-558600794 tempest-HostsAdminNegativeTestJSON-558600794-project] Request method failure captured: Sep 23 04:32:49.791059 n-d-846463-3 devstack@n-api.service[122698]: request: PUT /compute/v2.1/os-hosts/n-d-846463-3 HTTP/1.1 Sep 23 04:32:49.791059 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:32:49.791059 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:32:49.791059 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:32:49.791059 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 50 Sep 23 04:32:49.791059 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:32:49.791059 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:32:49.791059 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:32:49.791059 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:32:49.791059 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTbtCLdai5w1oFfNhuDLQHMQdIYyMrFAbVuR214tlmurmBdiAyfJTivDaX__GYgveddpp1EpGpf1x2r_-RAXC8rMp5hPcmstPRU-_C9Fn4n5659HOFQQaTMBQvgvHFxE64pXgsdU0Mt72Wc37vfuE2lN9ApFiSSsCS9ntd88uiMxouQ Sep 23 04:32:49.791059 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:32:49.791059 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:32:49.791059 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:32:49.791059 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:32:49.791059 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:32:49.791059 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:32:49.791059 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: ba84e9bc0fb04b7b835be432dc0620d8 Sep 23 04:32:49.791059 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-558600794 Sep 23 04:32:49.791059 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:32:49.791059 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:32:49.792392 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ba84e9bc0fb04b7b835be432dc0620d8", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ba84e9bc0fb04b7b835be432dc0620d8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ba84e9bc0fb04b7b835be432dc0620d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ba84e9bc0fb04b7b835be432dc0620d8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:32:49.792392 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-HostsAdminNegativeTestJSON-558600794 Sep 23 04:32:49.792392 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: ba84e9bc0fb04b7b835be432dc0620d8 Sep 23 04:32:49.792392 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-558600794 Sep 23 04:32:49.792392 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-HostsAdminNegativeTestJSON-558600794-project Sep 23 04:32:49.792392 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:32:49.792392 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:32:49.792392 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 7e8e83a574634ef38cd354d694ae2d41 Sep 23 04:32:49.792392 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-HostsAdminNegativeTestJSON-558600794-project Sep 23 04:32:49.792392 n-d-846463-3 devstack@n-api.service[122698]: Sep 23 04:32:49.792392 n-d-846463-3 devstack@n-api.service[122698]: {"status": "enable", "maintenance_mode": "enable"} Sep 23 04:32:49.792392 n-d-846463-3 devstack@n-api.service[122698]: method: Sep 23 04:32:49.792392 n-d-846463-3 devstack@n-api.service[122698]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Sep 23 04:32:49.792392 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': 'n-d-846463-3', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Sep 23 04:32:49.793229 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:32:49.793229 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:32:49.793229 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:32:49.793229 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:32:49.793229 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:32:49.793229 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:32:49.793229 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:32:49.793229 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:32:49.793229 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:32:49.793229 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:32:49.793229 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:32:49.793229 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:32:49.793229 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Sep 23 04:32:49.793229 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Sep 23 04:32:49.793229 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 23 04:32:49.793229 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 23 04:32:49.793229 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 23 04:32:49.793229 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 23 04:32:49.793229 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 23 04:32:49.793229 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 23 04:32:49.794481 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 23 04:32:49.794481 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise self.value Sep 23 04:32:49.794481 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 23 04:32:49.794481 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 23 04:32:49.794481 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 23 04:32:49.794481 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 23 04:32:49.794481 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 23 04:32:49.794481 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 23 04:32:49.794481 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Sep 23 04:32:49.794481 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:32:49.794481 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:32:49.794481 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:32:49.794481 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:32:49.794481 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:32:49.794481 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:32:49.794481 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 23 04:32:49.794481 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 23 04:32:49.794481 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Sep 23 04:32:49.794481 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:32:49.795633 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ad4073bb-2819-4989-a481-bd14ab48f3e9 tempest-HostsAdminNegativeTestJSON-558600794 tempest-HostsAdminNegativeTestJSON-558600794-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:32:49.795633 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ad4073bb-2819-4989-a481-bd14ab48f3e9 tempest-HostsAdminNegativeTestJSON-558600794 tempest-HostsAdminNegativeTestJSON-558600794-project] 10.222.0.33 "PUT /compute/v2.1/os-hosts/n-d-846463-3" status: 403 len: 111 microversion: 2.1 time: 0.014383 Sep 23 04:32:49.795633 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 271/587] 10.222.0.33 () {60 vars in 1187 bytes} [Fri Sep 23 04:32:49 2022] PUT /compute/v2.1/os-hosts/n-d-846463-3 => generated 111 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:32:49.812412 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-76ac22c2-3038-4330-a51c-e11da71f1ce8 tempest-HostsAdminNegativeTestJSON-1995491037 tempest-HostsAdminNegativeTestJSON-1995491037-project-admin] Action: 'update', calling method: .version_select at 0x7ff1c0376c10>, body: {"status": null, "maintenance_mode": null} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:32:49.816608 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1cc3cc0f-59b5-423b-9dce-c2e1affce183 tempest-QuotasAdminTestV236-1615446828 tempest-QuotasAdminTestV236-1615446828-project-admin] Action: 'update', calling method: .version_select at 0x7ff1c00a0ca0>, body: {"quota_set": {"ram": "2048"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:32:49.824612 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-76ac22c2-3038-4330-a51c-e11da71f1ce8 tempest-HostsAdminNegativeTestJSON-1995491037 tempest-HostsAdminNegativeTestJSON-1995491037-project-admin] Request method failure captured: Sep 23 04:32:49.824612 n-d-846463-3 devstack@n-api.service[122699]: request: PUT /compute/v2.1/os-hosts/n-d-846463-3 HTTP/1.1 Sep 23 04:32:49.824612 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:32:49.824612 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:32:49.824612 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:32:49.824612 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 42 Sep 23 04:32:49.824612 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:32:49.824612 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:32:49.824612 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:32:49.824612 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:32:49.824612 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTbwv-wfKNWZsamWPuoUv1ErRhli1CuWz3G-WH0k7-qldd528ZJJ3VGM_rF6j81Lqx8Qfu3K1L0OoYKD1kCc02fc7tjPSqn7qc5ELTlHcoT7CRWLo0tCdgyrRnKBN040VKkytnjPHvPWzh7FJNBne-Eub1wsBYK0PDw5wTZhMuOeaOE Sep 23 04:32:49.824612 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:32:49.824612 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:32:49.824612 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:32:49.824612 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:32:49.824612 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:32:49.824612 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:32:49.824612 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: f26d5bc9351846c4892c1f14743afc2e Sep 23 04:32:49.824612 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1995491037 Sep 23 04:32:49.824612 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,admin,member Sep 23 04:32:49.824612 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,admin,member Sep 23 04:32:49.842558 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f26d5bc9351846c4892c1f14743afc2e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f26d5bc9351846c4892c1f14743afc2e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f26d5bc9351846c4892c1f14743afc2e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f26d5bc9351846c4892c1f14743afc2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:32:49.842558 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1995491037 Sep 23 04:32:49.842558 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: f26d5bc9351846c4892c1f14743afc2e Sep 23 04:32:49.842558 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1995491037 Sep 23 04:32:49.842558 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-HostsAdminNegativeTestJSON-1995491037-project-admin Sep 23 04:32:49.842558 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:32:49.842558 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:32:49.842558 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 7ccfcb2bd2af427eb22313dd45e355d4 Sep 23 04:32:49.842558 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1995491037-project-admin Sep 23 04:32:49.842558 n-d-846463-3 devstack@n-api.service[122699]: Sep 23 04:32:49.842558 n-d-846463-3 devstack@n-api.service[122699]: {"status": null, "maintenance_mode": null} Sep 23 04:32:49.842558 n-d-846463-3 devstack@n-api.service[122699]: method: Sep 23 04:32:49.842558 n-d-846463-3 devstack@n-api.service[122699]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Sep 23 04:32:49.842558 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': 'n-d-846463-3', 'body': {'status': None, 'maintenance_mode': None}} Sep 23 04:32:49.844454 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:32:49.844454 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:32:49.844454 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 23 04:32:49.844454 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 23 04:32:49.844454 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 23 04:32:49.844454 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise error Sep 23 04:32:49.844454 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Sep 23 04:32:49.844454 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:32:49.844454 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Sep 23 04:32:49.844454 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Sep 23 04:32:49.844454 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi 'disable', Sep 23 04:32:49.844454 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi 'Enable', Sep 23 04:32:49.844454 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi 'Disable', Sep 23 04:32:49.844454 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi 'ENABLE', Sep 23 04:32:49.844454 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi 'DISABLE'], Sep 23 04:32:49.844454 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi 'type': 'string'} Sep 23 04:32:49.844454 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:32:49.844454 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi On instance: Sep 23 04:32:49.844454 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi None Sep 23 04:32:49.844454 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:32:49.844454 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:32:49.844454 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:32:49.844454 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:32:49.844454 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:32:49.844454 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:32:49.846180 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:32:49.846180 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:32:49.846180 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:32:49.846180 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:32:49.846180 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:32:49.846180 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:32:49.846180 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 23 04:32:49.846180 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 23 04:32:49.846180 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 23 04:32:49.846180 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 23 04:32:49.846180 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 23 04:32:49.846180 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 23 04:32:49.846180 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Sep 23 04:32:49.846180 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:32:49.846180 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:32:49.846180 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:32:49.846180 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:32:49.846180 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:32:49.846180 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:32:49.847455 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 23 04:32:49.847455 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 23 04:32:49.847455 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Sep 23 04:32:49.847455 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:32:49.847455 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-76ac22c2-3038-4330-a51c-e11da71f1ce8 tempest-HostsAdminNegativeTestJSON-1995491037 tempest-HostsAdminNegativeTestJSON-1995491037-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:32:49.847455 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-76ac22c2-3038-4330-a51c-e11da71f1ce8 tempest-HostsAdminNegativeTestJSON-1995491037 tempest-HostsAdminNegativeTestJSON-1995491037-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-hosts/n-d-846463-3" status: 400 len: 127 microversion: 2.1 time: 0.021742 Sep 23 04:32:49.847455 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 317/588] 10.222.0.33 () {60 vars in 1187 bytes} [Fri Sep 23 04:32:49 2022] PUT /compute/v2.1/os-hosts/n-d-846463-3 => generated 127 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 04:32:49.850345 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-641c6845-9a12-4841-8493-ecce8ed4bc03 tempest-HostsAdminNegativeTestJSON-1995491037 tempest-HostsAdminNegativeTestJSON-1995491037-project-admin] Action: 'update', calling method: .version_select at 0x7ff1c00ea700>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:32:49.854167 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.hosts [None req-641c6845-9a12-4841-8493-ecce8ed4bc03 tempest-HostsAdminNegativeTestJSON-1995491037 tempest-HostsAdminNegativeTestJSON-1995491037-project-admin] Enabling host nonexistent_hostname. Sep 23 04:32:49.873560 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-641c6845-9a12-4841-8493-ecce8ed4bc03 tempest-HostsAdminNegativeTestJSON-1995491037 tempest-HostsAdminNegativeTestJSON-1995491037-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 23 04:32:49.878931 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-641c6845-9a12-4841-8493-ecce8ed4bc03 tempest-HostsAdminNegativeTestJSON-1995491037 tempest-HostsAdminNegativeTestJSON-1995491037-project-admin] Request method failure captured: Sep 23 04:32:49.878931 n-d-846463-3 devstack@n-api.service[122699]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Sep 23 04:32:49.878931 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:32:49.878931 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:32:49.878931 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:32:49.878931 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 50 Sep 23 04:32:49.878931 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:32:49.878931 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:32:49.878931 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:32:49.878931 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:32:49.878931 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTbwv-wfKNWZsamWPuoUv1ErRhli1CuWz3G-WH0k7-qldd528ZJJ3VGM_rF6j81Lqx8Qfu3K1L0OoYKD1kCc02fc7tjPSqn7qc5ELTlHcoT7CRWLo0tCdgyrRnKBN040VKkytnjPHvPWzh7FJNBne-Eub1wsBYK0PDw5wTZhMuOeaOE Sep 23 04:32:49.878931 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:32:49.878931 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:32:49.878931 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:32:49.878931 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:32:49.878931 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:32:49.878931 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:32:49.878931 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: f26d5bc9351846c4892c1f14743afc2e Sep 23 04:32:49.878931 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1995491037 Sep 23 04:32:49.878931 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,admin,member Sep 23 04:32:49.878931 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,admin,member Sep 23 04:32:49.880475 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f26d5bc9351846c4892c1f14743afc2e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f26d5bc9351846c4892c1f14743afc2e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f26d5bc9351846c4892c1f14743afc2e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f26d5bc9351846c4892c1f14743afc2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:32:49.880475 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1995491037 Sep 23 04:32:49.880475 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: f26d5bc9351846c4892c1f14743afc2e Sep 23 04:32:49.880475 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1995491037 Sep 23 04:32:49.880475 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-HostsAdminNegativeTestJSON-1995491037-project-admin Sep 23 04:32:49.880475 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:32:49.880475 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:32:49.880475 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 7ccfcb2bd2af427eb22313dd45e355d4 Sep 23 04:32:49.880475 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1995491037-project-admin Sep 23 04:32:49.880475 n-d-846463-3 devstack@n-api.service[122699]: Sep 23 04:32:49.880475 n-d-846463-3 devstack@n-api.service[122699]: {"status": "enable", "maintenance_mode": "enable"} Sep 23 04:32:49.880475 n-d-846463-3 devstack@n-api.service[122699]: method: Sep 23 04:32:49.880475 n-d-846463-3 devstack@n-api.service[122699]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 23 04:32:49.880475 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Sep 23 04:32:49.881459 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:32:49.881459 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:32:49.881459 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Sep 23 04:32:49.881459 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Sep 23 04:32:49.881459 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 23 04:32:49.881459 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 23 04:32:49.881459 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 23 04:32:49.881459 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 23 04:32:49.881459 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 23 04:32:49.881459 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise self.value Sep 23 04:32:49.881459 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 23 04:32:49.881459 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 23 04:32:49.881459 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Sep 23 04:32:49.881459 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Sep 23 04:32:49.881459 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 04:32:49.881459 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 04:32:49.881459 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 23 04:32:49.881459 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 23 04:32:49.882665 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 23 04:32:49.882665 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 23 04:32:49.882665 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 23 04:32:49.882665 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 23 04:32:49.882665 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 23 04:32:49.882665 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:32:49.882665 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:32:49.882665 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:32:49.882665 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:32:49.882665 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:32:49.882665 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:32:49.882665 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:32:49.882665 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:32:49.882665 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:32:49.882665 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:32:49.882665 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:32:49.882665 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:32:49.882665 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:32:49.882665 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:32:49.882665 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Sep 23 04:32:49.883807 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Sep 23 04:32:49.883807 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Sep 23 04:32:49.883807 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:32:49.883807 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 23 04:32:49.883807 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:32:49.883807 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:32:49.883807 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:32:49.883807 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:32:49.883807 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:32:49.883807 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:32:49.883807 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:32:49.883807 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:32:49.883807 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 23 04:32:49.883807 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:32:49.883807 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-641c6845-9a12-4841-8493-ecce8ed4bc03 tempest-HostsAdminNegativeTestJSON-1995491037 tempest-HostsAdminNegativeTestJSON-1995491037-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:32:49.884676 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-641c6845-9a12-4841-8493-ecce8ed4bc03 tempest-HostsAdminNegativeTestJSON-1995491037 tempest-HostsAdminNegativeTestJSON-1995491037-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.033735 Sep 23 04:32:49.884676 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 318/589] 10.222.0.33 () {60 vars in 1211 bytes} [Fri Sep 23 04:32:49 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 23 04:32:50.337774 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e945ceee-bef7-4950-9d4c-8caa803b1a04 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:50.338552 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e945ceee-bef7-4950-9d4c-8caa803b1a04 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: 0dff1738-81f1-4619-af74-44b7adc805b5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:50.345461 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e945ceee-bef7-4950-9d4c-8caa803b1a04 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:50.345973 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e945ceee-bef7-4950-9d4c-8caa803b1a04 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:50.346410 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e945ceee-bef7-4950-9d4c-8caa803b1a04 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:50.347254 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e945ceee-bef7-4950-9d4c-8caa803b1a04 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:50.347554 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e945ceee-bef7-4950-9d4c-8caa803b1a04 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:50.347971 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e945ceee-bef7-4950-9d4c-8caa803b1a04 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:50.526385 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e945ceee-bef7-4950-9d4c-8caa803b1a04 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:50.543130 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e945ceee-bef7-4950-9d4c-8caa803b1a04 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/0dff1738-81f1-4619-af74-44b7adc805b5" status: 200 len: 1472 microversion: 2.1 time: 0.209130 Sep 23 04:32:50.545413 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 319/590] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:32:50 2022] GET /compute/v2.1/servers/0dff1738-81f1-4619-af74-44b7adc805b5 => generated 1472 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:32:50.661615 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1cc3cc0f-59b5-423b-9dce-c2e1affce183 tempest-QuotasAdminTestV236-1615446828 tempest-QuotasAdminTestV236-1615446828-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:50.662712 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1cc3cc0f-59b5-423b-9dce-c2e1affce183 tempest-QuotasAdminTestV236-1615446828 tempest-QuotasAdminTestV236-1615446828-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:50.663343 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1cc3cc0f-59b5-423b-9dce-c2e1affce183 tempest-QuotasAdminTestV236-1615446828 tempest-QuotasAdminTestV236-1615446828-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:50.664282 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1cc3cc0f-59b5-423b-9dce-c2e1affce183 tempest-QuotasAdminTestV236-1615446828 tempest-QuotasAdminTestV236-1615446828-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:50.665026 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1cc3cc0f-59b5-423b-9dce-c2e1affce183 tempest-QuotasAdminTestV236-1615446828 tempest-QuotasAdminTestV236-1615446828-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:50.665645 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1cc3cc0f-59b5-423b-9dce-c2e1affce183 tempest-QuotasAdminTestV236-1615446828 tempest-QuotasAdminTestV236-1615446828-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:50.701828 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1cc3cc0f-59b5-423b-9dce-c2e1affce183 tempest-QuotasAdminTestV236-1615446828 tempest-QuotasAdminTestV236-1615446828-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:50.702427 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1cc3cc0f-59b5-423b-9dce-c2e1affce183 tempest-QuotasAdminTestV236-1615446828 tempest-QuotasAdminTestV236-1615446828-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:50.702930 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1cc3cc0f-59b5-423b-9dce-c2e1affce183 tempest-QuotasAdminTestV236-1615446828 tempest-QuotasAdminTestV236-1615446828-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:50.704174 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1cc3cc0f-59b5-423b-9dce-c2e1affce183 tempest-QuotasAdminTestV236-1615446828 tempest-QuotasAdminTestV236-1615446828-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:50.704626 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1cc3cc0f-59b5-423b-9dce-c2e1affce183 tempest-QuotasAdminTestV236-1615446828 tempest-QuotasAdminTestV236-1615446828-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:50.705049 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1cc3cc0f-59b5-423b-9dce-c2e1affce183 tempest-QuotasAdminTestV236-1615446828 tempest-QuotasAdminTestV236-1615446828-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:50.723453 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:32:50.785778 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a9ada6d2-699b-4142-a6e4-6ac2fc8bf882 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-2140560864", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "networks": [{"uuid": "019d7df5-4f38-47cb-b9f3-1f0f6f2be581"}], "security_groups": [{"name": "tempest-securitygroup--1731467200"}], "key_name": "tempest-keypair-1397880170", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:32:50.872613 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-1cc3cc0f-59b5-423b-9dce-c2e1affce183 tempest-QuotasAdminTestV236-1615446828 tempest-QuotasAdminTestV236-1615446828-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/546cef35136d4707bc76910a5dfafaa2?user_id=c8d35003f05e40fcb88956f52e1ecec8" status: 200 len: 240 microversion: 2.36 time: 1.061534 Sep 23 04:32:50.878229 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 272/591] 10.222.0.33 () {62 vars in 1384 bytes} [Fri Sep 23 04:32:49 2022] PUT /compute/v2.1/os-quota-sets/546cef35136d4707bc76910a5dfafaa2?user_id=c8d35003f05e40fcb88956f52e1ecec8 => generated 240 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 04:32:50.889498 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-bf532034-c8e1-436b-bf66-5da1834940f0 tempest-QuotasAdminTestV236-1615446828 tempest-QuotasAdminTestV236-1615446828-project-admin] Calling method '.version_select at 0x7ff1c02149d0>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:50.907968 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.neutron [None req-a9ada6d2-699b-4142-a6e4-6ac2fc8bf882 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] validate_networks() for [('019d7df5-4f38-47cb-b9f3-1f0f6f2be581', None, None, None, None, None)] {{(pid=122699) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:32:51.334655 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-bf532034-c8e1-436b-bf66-5da1834940f0 tempest-QuotasAdminTestV236-1615446828 tempest-QuotasAdminTestV236-1615446828-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/546cef35136d4707bc76910a5dfafaa2?user_id=c8d35003f05e40fcb88956f52e1ecec8" status: 200 len: 282 microversion: 2.36 time: 0.448787 Sep 23 04:32:51.335998 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 273/592] 10.222.0.33 () {60 vars in 1364 bytes} [Fri Sep 23 04:32:50 2022] GET /compute/v2.1/os-quota-sets/546cef35136d4707bc76910a5dfafaa2?user_id=c8d35003f05e40fcb88956f52e1ecec8 => generated 282 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 23 04:32:51.418503 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-a9ada6d2-699b-4142-a6e4-6ac2fc8bf882 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Flavor limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:32:51.419003 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-a9ada6d2-699b-4142-a6e4-6ac2fc8bf882 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Image limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:32:51.419390 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-a9ada6d2-699b-4142-a6e4-6ac2fc8bf882 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Flavor pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:32:51.419976 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-a9ada6d2-699b-4142-a6e4-6ac2fc8bf882 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Image pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:32:51.420560 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-a9ada6d2-699b-4142-a6e4-6ac2fc8bf882 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:32:51.431394 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a9ada6d2-699b-4142-a6e4-6ac2fc8bf882 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:51.431897 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a9ada6d2-699b-4142-a6e4-6ac2fc8bf882 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:51.432375 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a9ada6d2-699b-4142-a6e4-6ac2fc8bf882 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:51.433263 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a9ada6d2-699b-4142-a6e4-6ac2fc8bf882 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:51.433724 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a9ada6d2-699b-4142-a6e4-6ac2fc8bf882 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:51.434387 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a9ada6d2-699b-4142-a6e4-6ac2fc8bf882 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:51.452578 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-a9ada6d2-699b-4142-a6e4-6ac2fc8bf882 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Getting quotas for project 0abccbbae40b47968a8dda6323b618e3. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:32:51.457374 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-a9ada6d2-699b-4142-a6e4-6ac2fc8bf882 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Getting quotas for user 84d0c7a6520443d896f88069e91a2eb2 and project 0abccbbae40b47968a8dda6323b618e3. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:32:51.469339 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a9ada6d2-699b-4142-a6e4-6ac2fc8bf882 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Going to run 1 instances... {{(pid=122699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:32:51.471702 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a9ada6d2-699b-4142-a6e4-6ac2fc8bf882 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 205bf02b-1478-4765-b2a6-d7014d9f0a64] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:32:51.628006 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a9ada6d2-699b-4142-a6e4-6ac2fc8bf882 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.25 time: 0.847130 Sep 23 04:32:51.628658 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 320/593] 10.222.0.33 () {62 vars in 1188 bytes} [Fri Sep 23 04:32:50 2022] POST /compute/v2.1/servers => generated 406 bytes in 848 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 23 04:32:51.633531 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-88bcf050-a44d-47a2-b563-d607526d4f11 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:51.634349 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-88bcf050-a44d-47a2-b563-d607526d4f11 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: 0dff1738-81f1-4619-af74-44b7adc805b5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:51.642222 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-88bcf050-a44d-47a2-b563-d607526d4f11 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:51.642949 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-88bcf050-a44d-47a2-b563-d607526d4f11 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:51.643401 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-88bcf050-a44d-47a2-b563-d607526d4f11 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:51.644210 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-88bcf050-a44d-47a2-b563-d607526d4f11 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:51.644676 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-88bcf050-a44d-47a2-b563-d607526d4f11 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:51.645106 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-88bcf050-a44d-47a2-b563-d607526d4f11 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:51.711439 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5aeb1324-9d8c-4ff3-8c32-6c171bf0143b tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-2075066017", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:32:51.776286 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.network.neutron [None req-5aeb1324-9d8c-4ff3-8c32-6c171bf0143b tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] validate_networks() for None {{(pid=122698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:32:51.931779 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-88bcf050-a44d-47a2-b563-d607526d4f11 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:51.940109 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-88bcf050-a44d-47a2-b563-d607526d4f11 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/0dff1738-81f1-4619-af74-44b7adc805b5" status: 200 len: 1477 microversion: 2.1 time: 0.310144 Sep 23 04:32:51.940686 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 321/594] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:32:51 2022] GET /compute/v2.1/servers/0dff1738-81f1-4619-af74-44b7adc805b5 => generated 1477 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:51.948684 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-391a9126-86a3-4c8a-8a5a-0962459244c0 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:51.949240 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-391a9126-86a3-4c8a-8a5a-0962459244c0 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 205bf02b-1478-4765-b2a6-d7014d9f0a64] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:52.038311 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-391a9126-86a3-4c8a-8a5a-0962459244c0 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:52.047674 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-391a9126-86a3-4c8a-8a5a-0962459244c0 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:52.051802 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-391a9126-86a3-4c8a-8a5a-0962459244c0 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:52.051802 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-391a9126-86a3-4c8a-8a5a-0962459244c0 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/205bf02b-1478-4765-b2a6-d7014d9f0a64" status: 200 len: 1286 microversion: 2.25 time: 0.105267 Sep 23 04:32:52.051802 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 322/595] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:32:51 2022] GET /compute/v2.1/servers/205bf02b-1478-4765-b2a6-d7014d9f0a64 => generated 1286 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:32:52.108522 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-5aeb1324-9d8c-4ff3-8c32-6c171bf0143b tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Flavor limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:32:52.114797 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-5aeb1324-9d8c-4ff3-8c32-6c171bf0143b tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Image limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:32:52.114797 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-5aeb1324-9d8c-4ff3-8c32-6c171bf0143b tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Flavor pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:32:52.114797 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-5aeb1324-9d8c-4ff3-8c32-6c171bf0143b tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Image pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:32:52.114797 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-5aeb1324-9d8c-4ff3-8c32-6c171bf0143b tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:32:52.119750 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5aeb1324-9d8c-4ff3-8c32-6c171bf0143b tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:52.120221 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5aeb1324-9d8c-4ff3-8c32-6c171bf0143b tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:52.120697 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5aeb1324-9d8c-4ff3-8c32-6c171bf0143b tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:52.121437 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5aeb1324-9d8c-4ff3-8c32-6c171bf0143b tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:52.121910 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5aeb1324-9d8c-4ff3-8c32-6c171bf0143b tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:52.122351 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5aeb1324-9d8c-4ff3-8c32-6c171bf0143b tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:52.139846 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-5aeb1324-9d8c-4ff3-8c32-6c171bf0143b tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Getting quotas for project f98e78e2969a446b8fdbf772b36dd0c3. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:32:52.145427 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-5aeb1324-9d8c-4ff3-8c32-6c171bf0143b tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Getting quotas for user cb3ff8d26a3f4831b3ec766bea65e143 and project f98e78e2969a446b8fdbf772b36dd0c3. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:32:52.158752 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5aeb1324-9d8c-4ff3-8c32-6c171bf0143b tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Going to run 1 instances... {{(pid=122698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:32:52.161407 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5aeb1324-9d8c-4ff3-8c32-6c171bf0143b tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] [instance: 70213e65-9664-4df1-81d7-747c462fa434] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:32:52.296228 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5aeb1324-9d8c-4ff3-8c32-6c171bf0143b tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.951658 Sep 23 04:32:52.297371 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 274/596] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:32:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 961 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:32:52.308652 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-532b60b4-72d9-4cc3-84f0-5a07fcfc6b3c tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:52.309365 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-532b60b4-72d9-4cc3-84f0-5a07fcfc6b3c tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] [instance: 70213e65-9664-4df1-81d7-747c462fa434] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:52.367911 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-532b60b4-72d9-4cc3-84f0-5a07fcfc6b3c tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3ff8d26a3f4831b3ec766bea65e143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98e78e2969a446b8fdbf772b36dd0c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:52.377730 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-532b60b4-72d9-4cc3-84f0-5a07fcfc6b3c tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] 10.222.0.33 "GET /compute/v2.1/servers/70213e65-9664-4df1-81d7-747c462fa434" status: 200 len: 1217 microversion: 2.1 time: 0.072832 Sep 23 04:32:52.393585 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 323/597] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:32:52 2022] GET /compute/v2.1/servers/70213e65-9664-4df1-81d7-747c462fa434 => generated 1217 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:52.973268 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8c781506-1364-443a-b00a-91e62d7fc59f tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:52.974131 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8c781506-1364-443a-b00a-91e62d7fc59f tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: 0dff1738-81f1-4619-af74-44b7adc805b5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:52.983983 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8c781506-1364-443a-b00a-91e62d7fc59f tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:52.984741 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8c781506-1364-443a-b00a-91e62d7fc59f tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:52.985516 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8c781506-1364-443a-b00a-91e62d7fc59f tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:52.987074 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8c781506-1364-443a-b00a-91e62d7fc59f tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:52.988150 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8c781506-1364-443a-b00a-91e62d7fc59f tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:52.988747 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8c781506-1364-443a-b00a-91e62d7fc59f tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:53.172753 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8c781506-1364-443a-b00a-91e62d7fc59f tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:53.181734 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8c781506-1364-443a-b00a-91e62d7fc59f tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/0dff1738-81f1-4619-af74-44b7adc805b5" status: 200 len: 1477 microversion: 2.1 time: 0.213529 Sep 23 04:32:53.182383 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 275/598] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:32:52 2022] GET /compute/v2.1/servers/0dff1738-81f1-4619-af74-44b7adc805b5 => generated 1477 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:53.187371 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-30de0bab-60df-4d72-8832-3f050d585686 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:53.198650 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-30de0bab-60df-4d72-8832-3f050d585686 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 205bf02b-1478-4765-b2a6-d7014d9f0a64] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:53.198650 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-30de0bab-60df-4d72-8832-3f050d585686 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:53.198650 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-30de0bab-60df-4d72-8832-3f050d585686 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:53.198650 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-30de0bab-60df-4d72-8832-3f050d585686 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:53.199477 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-30de0bab-60df-4d72-8832-3f050d585686 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:53.199477 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-30de0bab-60df-4d72-8832-3f050d585686 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:53.199477 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-30de0bab-60df-4d72-8832-3f050d585686 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:53.306849 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-30de0bab-60df-4d72-8832-3f050d585686 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:53.321719 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-30de0bab-60df-4d72-8832-3f050d585686 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:53.326699 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-30de0bab-60df-4d72-8832-3f050d585686 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:53.329814 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-30de0bab-60df-4d72-8832-3f050d585686 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/205bf02b-1478-4765-b2a6-d7014d9f0a64" status: 200 len: 1290 microversion: 2.25 time: 0.146307 Sep 23 04:32:53.331853 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 276/599] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:32:53 2022] GET /compute/v2.1/servers/205bf02b-1478-4765-b2a6-d7014d9f0a64 => generated 1290 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:32:53.353694 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f6a0d9aa-14d4-4cc1-9a09-9d361092a961 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1466350826", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:32:53.408616 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e7382042-1331-4b42-8033-883491cf1936 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:53.409368 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e7382042-1331-4b42-8033-883491cf1936 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] [instance: 70213e65-9664-4df1-81d7-747c462fa434] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:53.462744 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.neutron [None req-f6a0d9aa-14d4-4cc1-9a09-9d361092a961 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] validate_networks() for None {{(pid=122699) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:32:53.535992 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e7382042-1331-4b42-8033-883491cf1936 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3ff8d26a3f4831b3ec766bea65e143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98e78e2969a446b8fdbf772b36dd0c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:53.555004 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e7382042-1331-4b42-8033-883491cf1936 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] 10.222.0.33 "GET /compute/v2.1/servers/70213e65-9664-4df1-81d7-747c462fa434" status: 200 len: 1217 microversion: 2.1 time: 0.151691 Sep 23 04:32:53.557750 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 277/600] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:32:53 2022] GET /compute/v2.1/servers/70213e65-9664-4df1-81d7-747c462fa434 => generated 1217 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:32:53.700904 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3ce1e0bd-c3e1-4d56-ad7a-1a6f46c16760 tempest-FlavorsV2TestJSON-1402232620 tempest-FlavorsV2TestJSON-1402232620-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:53.730417 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3ce1e0bd-c3e1-4d56-ad7a-1a6f46c16760 tempest-FlavorsV2TestJSON-1402232620 tempest-FlavorsV2TestJSON-1402232620-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.170864 Sep 23 04:32:53.731971 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 278/601] 10.222.0.33 () {58 vars in 1137 bytes} [Fri Sep 23 04:32:53 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:32:53.747164 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d9d73b22-e68e-45bc-9337-01c4702bee07 tempest-FlavorsV2TestJSON-1402232620 tempest-FlavorsV2TestJSON-1402232620-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:53.773183 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d9d73b22-e68e-45bc-9337-01c4702bee07 tempest-FlavorsV2TestJSON-1402232620 tempest-FlavorsV2TestJSON-1402232620-project] 10.222.0.33 "GET /compute/v2.1/flavors" status: 200 len: 3078 microversion: 2.1 time: 0.030706 Sep 23 04:32:53.774272 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 279/602] 10.222.0.33 () {58 vars in 1125 bytes} [Fri Sep 23 04:32:53 2022] GET /compute/v2.1/flavors => generated 3078 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:53.787308 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-f6a0d9aa-14d4-4cc1-9a09-9d361092a961 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Flavor limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:32:53.791139 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-f6a0d9aa-14d4-4cc1-9a09-9d361092a961 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Image limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:32:53.791139 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-f6a0d9aa-14d4-4cc1-9a09-9d361092a961 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Flavor pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:32:53.791139 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-f6a0d9aa-14d4-4cc1-9a09-9d361092a961 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Image pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:32:53.791139 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-f6a0d9aa-14d4-4cc1-9a09-9d361092a961 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:32:53.791955 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-69c3018f-6a1c-497c-90a9-942df1fa0926 tempest-FlavorsV2TestJSON-1402232620 tempest-FlavorsV2TestJSON-1402232620-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:53.799062 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f6a0d9aa-14d4-4cc1-9a09-9d361092a961 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:53.799559 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f6a0d9aa-14d4-4cc1-9a09-9d361092a961 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:53.800001 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f6a0d9aa-14d4-4cc1-9a09-9d361092a961 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:53.800732 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f6a0d9aa-14d4-4cc1-9a09-9d361092a961 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:53.801198 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f6a0d9aa-14d4-4cc1-9a09-9d361092a961 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:53.801851 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f6a0d9aa-14d4-4cc1-9a09-9d361092a961 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:53.804662 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-69c3018f-6a1c-497c-90a9-942df1fa0926 tempest-FlavorsV2TestJSON-1402232620 tempest-FlavorsV2TestJSON-1402232620-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017526 Sep 23 04:32:53.819921 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 280/603] 10.222.0.33 () {58 vars in 1137 bytes} [Fri Sep 23 04:32:53 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:32:53.823200 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-f6a0d9aa-14d4-4cc1-9a09-9d361092a961 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Getting quotas for project 44352a7a6d964530aa20ae83064b02e6. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:32:53.823377 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1e00322a-d7d2-428c-92d0-2d24690c5c53 tempest-FlavorsV2TestJSON-1402232620 tempest-FlavorsV2TestJSON-1402232620-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:53.825832 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:32:53.828922 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-f6a0d9aa-14d4-4cc1-9a09-9d361092a961 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Getting quotas for user d1c82752e1bc4fdb82e7f8391c7c129f and project 44352a7a6d964530aa20ae83064b02e6. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:32:53.842906 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f6a0d9aa-14d4-4cc1-9a09-9d361092a961 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Going to run 1 instances... {{(pid=122699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:32:53.843769 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-1e00322a-d7d2-428c-92d0-2d24690c5c53 tempest-FlavorsV2TestJSON-1402232620 tempest-FlavorsV2TestJSON-1402232620-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.024451 Sep 23 04:32:53.844347 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 281/604] 10.222.0.33 () {58 vars in 1137 bytes} [Fri Sep 23 04:32:53 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:32:53.848463 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f6a0d9aa-14d4-4cc1-9a09-9d361092a961 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] [instance: f392741f-f967-4c1c-930b-4eea7272bf64] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:32:53.858479 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-de5626db-1751-4e80-bb42-dc420f4f3f88 tempest-FlavorsV2TestJSON-1402232620 tempest-FlavorsV2TestJSON-1402232620-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:53.887488 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-de5626db-1751-4e80-bb42-dc420f4f3f88 tempest-FlavorsV2TestJSON-1402232620 tempest-FlavorsV2TestJSON-1402232620-project] 10.222.0.33 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.033076 Sep 23 04:32:53.888728 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 282/605] 10.222.0.33 () {58 vars in 1165 bytes} [Fri Sep 23 04:32:53 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:53.905539 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-689ad6c2-eefa-4c17-8e0f-d1e60807ae6c tempest-FlavorsV2TestJSON-1402232620 tempest-FlavorsV2TestJSON-1402232620-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:53.913351 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-689ad6c2-eefa-4c17-8e0f-d1e60807ae6c tempest-FlavorsV2TestJSON-1402232620 tempest-FlavorsV2TestJSON-1402232620-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.011703 Sep 23 04:32:53.913918 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 283/606] 10.222.0.33 () {58 vars in 1137 bytes} [Fri Sep 23 04:32:53 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:32:53.927403 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f6d83ce1-248c-4028-a242-f67cb406532e tempest-FlavorsV2TestJSON-1402232620 tempest-FlavorsV2TestJSON-1402232620-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:53.956793 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f6d83ce1-248c-4028-a242-f67cb406532e tempest-FlavorsV2TestJSON-1402232620 tempest-FlavorsV2TestJSON-1402232620-project] 10.222.0.33 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.033550 Sep 23 04:32:53.957417 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 284/607] 10.222.0.33 () {58 vars in 1169 bytes} [Fri Sep 23 04:32:53 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:32:53.974056 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c021b15a-939a-47ec-ac4a-c4f2594d2222 tempest-FlavorsV2TestJSON-1402232620 tempest-FlavorsV2TestJSON-1402232620-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:53.987213 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c021b15a-939a-47ec-ac4a-c4f2594d2222 tempest-FlavorsV2TestJSON-1402232620 tempest-FlavorsV2TestJSON-1402232620-project] 10.222.0.33 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.017106 Sep 23 04:32:53.989612 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 285/608] 10.222.0.33 () {58 vars in 1161 bytes} [Fri Sep 23 04:32:53 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:32:54.001860 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5dff0250-c4c2-400e-9dea-951867bfc33b tempest-FlavorsV2TestJSON-1402232620 tempest-FlavorsV2TestJSON-1402232620-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:54.009745 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5dff0250-c4c2-400e-9dea-951867bfc33b tempest-FlavorsV2TestJSON-1402232620 tempest-FlavorsV2TestJSON-1402232620-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.011763 Sep 23 04:32:54.011845 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 286/609] 10.222.0.33 () {58 vars in 1137 bytes} [Fri Sep 23 04:32:53 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:32:54.026802 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-09fd440a-45a7-4ab4-855b-6680d383cbbe tempest-FlavorsV2TestJSON-1402232620 tempest-FlavorsV2TestJSON-1402232620-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:54.058704 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f6a0d9aa-14d4-4cc1-9a09-9d361092a961 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.082336 Sep 23 04:32:54.060007 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 324/610] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:32:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1085 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 23 04:32:54.085385 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-09fd440a-45a7-4ab4-855b-6680d383cbbe tempest-FlavorsV2TestJSON-1402232620 tempest-FlavorsV2TestJSON-1402232620-project] 10.222.0.33 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.060819 Sep 23 04:32:54.086009 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 287/611] 10.222.0.33 () {58 vars in 1167 bytes} [Fri Sep 23 04:32:54 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:54.107376 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-282ccb73-4ac9-420a-8e96-82278a68fd56 tempest-FlavorsV2TestJSON-1402232620 tempest-FlavorsV2TestJSON-1402232620-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:54.128038 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-282ccb73-4ac9-420a-8e96-82278a68fd56 tempest-FlavorsV2TestJSON-1402232620 tempest-FlavorsV2TestJSON-1402232620-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.029427 Sep 23 04:32:54.131434 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 325/612] 10.222.0.33 () {58 vars in 1137 bytes} [Fri Sep 23 04:32:54 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:32:54.142887 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-512d025e-dd3f-4e9c-acd6-e00957e08754 tempest-FlavorsV2TestJSON-1402232620 tempest-FlavorsV2TestJSON-1402232620-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:54.161349 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-512d025e-dd3f-4e9c-acd6-e00957e08754 tempest-FlavorsV2TestJSON-1402232620 tempest-FlavorsV2TestJSON-1402232620-project] 10.222.0.33 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.022452 Sep 23 04:32:54.162269 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 288/613] 10.222.0.33 () {58 vars in 1144 bytes} [Fri Sep 23 04:32:54 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:54.182867 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e99719f0-1764-4060-b5e7-02ae62915b0c tempest-FlavorsV2TestJSON-1402232620 tempest-FlavorsV2TestJSON-1402232620-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:54.192630 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e99719f0-1764-4060-b5e7-02ae62915b0c tempest-FlavorsV2TestJSON-1402232620 tempest-FlavorsV2TestJSON-1402232620-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.018203 Sep 23 04:32:54.193841 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 326/614] 10.222.0.33 () {58 vars in 1137 bytes} [Fri Sep 23 04:32:54 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:32:54.208267 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e4a77428-92d0-4e59-a4e6-5c298b50b921 tempest-FlavorsV2TestJSON-1402232620 tempest-FlavorsV2TestJSON-1402232620-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:54.208616 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f4d08c15-3271-44da-9cb9-c27891a84af6 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:54.209851 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f4d08c15-3271-44da-9cb9-c27891a84af6 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: 0dff1738-81f1-4619-af74-44b7adc805b5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:54.219149 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f4d08c15-3271-44da-9cb9-c27891a84af6 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:54.220232 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f4d08c15-3271-44da-9cb9-c27891a84af6 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:54.225965 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f4d08c15-3271-44da-9cb9-c27891a84af6 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:54.229307 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f4d08c15-3271-44da-9cb9-c27891a84af6 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:54.229307 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f4d08c15-3271-44da-9cb9-c27891a84af6 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:54.229307 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f4d08c15-3271-44da-9cb9-c27891a84af6 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:54.259569 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e4a77428-92d0-4e59-a4e6-5c298b50b921 tempest-FlavorsV2TestJSON-1402232620 tempest-FlavorsV2TestJSON-1402232620-project] 10.222.0.33 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.046038 Sep 23 04:32:54.259569 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 327/615] 10.222.0.33 () {58 vars in 1148 bytes} [Fri Sep 23 04:32:54 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:54.259569 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f6462042-71e7-4a8d-9853-7aca9babcd1d tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1811493773", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:32:54.351017 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.neutron [None req-f6462042-71e7-4a8d-9853-7aca9babcd1d tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] validate_networks() for None {{(pid=122699) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:32:54.549986 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f4d08c15-3271-44da-9cb9-c27891a84af6 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:54.559347 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f4d08c15-3271-44da-9cb9-c27891a84af6 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/0dff1738-81f1-4619-af74-44b7adc805b5" status: 200 len: 1477 microversion: 2.1 time: 0.356897 Sep 23 04:32:54.560224 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 289/616] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:32:54 2022] GET /compute/v2.1/servers/0dff1738-81f1-4619-af74-44b7adc805b5 => generated 1477 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:54.565447 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-dfcda5a6-d213-49d1-a920-078017ab0c39 tempest-FlavorsV2TestJSON-1402232620 tempest-FlavorsV2TestJSON-1402232620-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:54.588894 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-dfcda5a6-d213-49d1-a920-078017ab0c39 tempest-FlavorsV2TestJSON-1402232620 tempest-FlavorsV2TestJSON-1402232620-project] 10.222.0.33 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.027374 Sep 23 04:32:54.590072 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 290/617] 10.222.0.33 () {58 vars in 1140 bytes} [Fri Sep 23 04:32:54 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:32:54.599194 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-563e6fd0-a3c1-44dc-b4ce-9a5b93cb84f8 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:54.600217 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-563e6fd0-a3c1-44dc-b4ce-9a5b93cb84f8 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 205bf02b-1478-4765-b2a6-d7014d9f0a64] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:54.609061 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-563e6fd0-a3c1-44dc-b4ce-9a5b93cb84f8 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:54.610595 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-563e6fd0-a3c1-44dc-b4ce-9a5b93cb84f8 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:54.611274 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-563e6fd0-a3c1-44dc-b4ce-9a5b93cb84f8 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:54.612711 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-563e6fd0-a3c1-44dc-b4ce-9a5b93cb84f8 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:54.613637 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-563e6fd0-a3c1-44dc-b4ce-9a5b93cb84f8 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:54.614611 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-563e6fd0-a3c1-44dc-b4ce-9a5b93cb84f8 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:54.701245 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-f6462042-71e7-4a8d-9853-7aca9babcd1d tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Flavor limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:32:54.701703 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-f6462042-71e7-4a8d-9853-7aca9babcd1d tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Image limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:32:54.702155 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-f6462042-71e7-4a8d-9853-7aca9babcd1d tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Flavor pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:32:54.702564 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-f6462042-71e7-4a8d-9853-7aca9babcd1d tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Image pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:32:54.703016 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-f6462042-71e7-4a8d-9853-7aca9babcd1d tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:32:54.703123 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-563e6fd0-a3c1-44dc-b4ce-9a5b93cb84f8 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:54.714156 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-563e6fd0-a3c1-44dc-b4ce-9a5b93cb84f8 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:54.716140 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-563e6fd0-a3c1-44dc-b4ce-9a5b93cb84f8 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:54.717724 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-563e6fd0-a3c1-44dc-b4ce-9a5b93cb84f8 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/205bf02b-1478-4765-b2a6-d7014d9f0a64" status: 200 len: 1346 microversion: 2.25 time: 0.126439 Sep 23 04:32:54.722936 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f6462042-71e7-4a8d-9853-7aca9babcd1d tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:54.724831 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f6462042-71e7-4a8d-9853-7aca9babcd1d tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:54.726282 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f6462042-71e7-4a8d-9853-7aca9babcd1d tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:54.729513 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f6462042-71e7-4a8d-9853-7aca9babcd1d tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:54.730219 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f6462042-71e7-4a8d-9853-7aca9babcd1d tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:54.730805 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f6462042-71e7-4a8d-9853-7aca9babcd1d tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:54.736967 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 291/618] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:32:54 2022] GET /compute/v2.1/servers/205bf02b-1478-4765-b2a6-d7014d9f0a64 => generated 1346 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:32:54.749941 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-f6462042-71e7-4a8d-9853-7aca9babcd1d tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Getting quotas for project 44352a7a6d964530aa20ae83064b02e6. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:32:54.755098 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-f6462042-71e7-4a8d-9853-7aca9babcd1d tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Getting quotas for user d1c82752e1bc4fdb82e7f8391c7c129f and project 44352a7a6d964530aa20ae83064b02e6. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:32:54.755475 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-06a62fb4-c841-479c-9d2d-4364b026f708 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:54.756194 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-06a62fb4-c841-479c-9d2d-4364b026f708 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] [instance: 70213e65-9664-4df1-81d7-747c462fa434] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:54.771806 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-06a62fb4-c841-479c-9d2d-4364b026f708 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:54.773634 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-06a62fb4-c841-479c-9d2d-4364b026f708 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:54.774119 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-06a62fb4-c841-479c-9d2d-4364b026f708 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:54.774838 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-06a62fb4-c841-479c-9d2d-4364b026f708 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:54.776237 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-06a62fb4-c841-479c-9d2d-4364b026f708 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:54.776752 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-06a62fb4-c841-479c-9d2d-4364b026f708 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:54.779774 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f6462042-71e7-4a8d-9853-7aca9babcd1d tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Going to run 1 instances... {{(pid=122699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:32:54.784886 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f6462042-71e7-4a8d-9853-7aca9babcd1d tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] [instance: 4f54b509-03bd-4fe1-9608-faaae848d5ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:32:54.874240 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-06a62fb4-c841-479c-9d2d-4364b026f708 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3ff8d26a3f4831b3ec766bea65e143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98e78e2969a446b8fdbf772b36dd0c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:54.882920 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-06a62fb4-c841-479c-9d2d-4364b026f708 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] 10.222.0.33 "GET /compute/v2.1/servers/70213e65-9664-4df1-81d7-747c462fa434" status: 200 len: 1269 microversion: 2.1 time: 0.144847 Sep 23 04:32:54.883872 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 292/619] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:32:54 2022] GET /compute/v2.1/servers/70213e65-9664-4df1-81d7-747c462fa434 => generated 1269 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:54.888473 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3e8e1894-530a-47c5-baf8-b0af317cb7da tempest-FlavorsV2TestJSON-1402232620 tempest-FlavorsV2TestJSON-1402232620-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:54.897370 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3e8e1894-530a-47c5-baf8-b0af317cb7da tempest-FlavorsV2TestJSON-1402232620 tempest-FlavorsV2TestJSON-1402232620-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.011721 Sep 23 04:32:54.905105 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 293/620] 10.222.0.33 () {58 vars in 1137 bytes} [Fri Sep 23 04:32:54 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:32:54.910377 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7484a951-1ce7-4ff4-8706-62e5e4cb91ae tempest-FlavorsV2TestJSON-1402232620 tempest-FlavorsV2TestJSON-1402232620-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:54.932270 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7484a951-1ce7-4ff4-8706-62e5e4cb91ae tempest-FlavorsV2TestJSON-1402232620 tempest-FlavorsV2TestJSON-1402232620-project] 10.222.0.33 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.026050 Sep 23 04:32:54.934025 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 294/621] 10.222.0.33 () {58 vars in 1146 bytes} [Fri Sep 23 04:32:54 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:54.947770 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a3552e65-d133-4551-ac00-64ac93c8e272 tempest-FlavorsV2TestJSON-1402232620 tempest-FlavorsV2TestJSON-1402232620-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:54.972069 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a3552e65-d133-4551-ac00-64ac93c8e272 tempest-FlavorsV2TestJSON-1402232620 tempest-FlavorsV2TestJSON-1402232620-project] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.028530 Sep 23 04:32:54.972655 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 295/622] 10.222.0.33 () {58 vars in 1146 bytes} [Fri Sep 23 04:32:54 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:32:54.976023 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f6462042-71e7-4a8d-9853-7aca9babcd1d tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.722699 Sep 23 04:32:54.978510 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 328/623] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:32:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 726 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:32:54.995241 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-76857974-c837-4168-982b-bdcd0cb89cb9 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:54.995683 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-76857974-c837-4168-982b-bdcd0cb89cb9 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] [instance: 4f54b509-03bd-4fe1-9608-faaae848d5ac] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:55.006304 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1eaae885-07e6-4269-a2ac-b8e1c28f6856 tempest-FlavorsV2TestJSON-1402232620 tempest-FlavorsV2TestJSON-1402232620-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:55.014702 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1eaae885-07e6-4269-a2ac-b8e1c28f6856 tempest-FlavorsV2TestJSON-1402232620 tempest-FlavorsV2TestJSON-1402232620-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.020989 Sep 23 04:32:55.015276 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 329/624] 10.222.0.33 () {58 vars in 1137 bytes} [Fri Sep 23 04:32:54 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:32:55.059212 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-76857974-c837-4168-982b-bdcd0cb89cb9 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c82752e1bc4fdb82e7f8391c7c129f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44352a7a6d964530aa20ae83064b02e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:55.070905 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-76857974-c837-4168-982b-bdcd0cb89cb9 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] 10.222.0.33 "GET /compute/v2.1/servers/4f54b509-03bd-4fe1-9608-faaae848d5ac" status: 200 len: 1214 microversion: 2.1 time: 0.081216 Sep 23 04:32:55.071494 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 296/625] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:32:54 2022] GET /compute/v2.1/servers/4f54b509-03bd-4fe1-9608-faaae848d5ac => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:55.586535 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e9e7acec-3a1d-41a8-93bf-f3cb3ede104f tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:55.587293 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e9e7acec-3a1d-41a8-93bf-f3cb3ede104f tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: 0dff1738-81f1-4619-af74-44b7adc805b5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:55.601842 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e9e7acec-3a1d-41a8-93bf-f3cb3ede104f tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:55.606296 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e9e7acec-3a1d-41a8-93bf-f3cb3ede104f tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:55.607115 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e9e7acec-3a1d-41a8-93bf-f3cb3ede104f tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:55.608081 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e9e7acec-3a1d-41a8-93bf-f3cb3ede104f tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:55.609579 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e9e7acec-3a1d-41a8-93bf-f3cb3ede104f tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:55.611463 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e9e7acec-3a1d-41a8-93bf-f3cb3ede104f tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:55.744522 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e5dab9ec-f9c3-4c69-a6b5-1395bae75275 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:55.745514 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e5dab9ec-f9c3-4c69-a6b5-1395bae75275 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 205bf02b-1478-4765-b2a6-d7014d9f0a64] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:55.753496 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e5dab9ec-f9c3-4c69-a6b5-1395bae75275 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:55.754348 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e5dab9ec-f9c3-4c69-a6b5-1395bae75275 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:55.755007 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e5dab9ec-f9c3-4c69-a6b5-1395bae75275 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:55.755944 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e5dab9ec-f9c3-4c69-a6b5-1395bae75275 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:55.756593 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e5dab9ec-f9c3-4c69-a6b5-1395bae75275 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:55.757328 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e5dab9ec-f9c3-4c69-a6b5-1395bae75275 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:56.452751 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e9e7acec-3a1d-41a8-93bf-f3cb3ede104f tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:56.464325 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e9e7acec-3a1d-41a8-93bf-f3cb3ede104f tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/0dff1738-81f1-4619-af74-44b7adc805b5" status: 200 len: 1477 microversion: 2.1 time: 0.882941 Sep 23 04:32:56.485984 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 330/626] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:32:55 2022] GET /compute/v2.1/servers/0dff1738-81f1-4619-af74-44b7adc805b5 => generated 1477 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:56.496823 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-cd4e8aa9-7b2f-4b65-afa5-a94633885ffa tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:56.498402 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-cd4e8aa9-7b2f-4b65-afa5-a94633885ffa tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] [instance: 70213e65-9664-4df1-81d7-747c462fa434] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:56.522216 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cd4e8aa9-7b2f-4b65-afa5-a94633885ffa tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:56.524679 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cd4e8aa9-7b2f-4b65-afa5-a94633885ffa tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:56.528732 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cd4e8aa9-7b2f-4b65-afa5-a94633885ffa tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:56.529507 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cd4e8aa9-7b2f-4b65-afa5-a94633885ffa tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:56.530625 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cd4e8aa9-7b2f-4b65-afa5-a94633885ffa tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:56.530625 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cd4e8aa9-7b2f-4b65-afa5-a94633885ffa tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:56.625743 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-cd4e8aa9-7b2f-4b65-afa5-a94633885ffa tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3ff8d26a3f4831b3ec766bea65e143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98e78e2969a446b8fdbf772b36dd0c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:56.628161 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e5dab9ec-f9c3-4c69-a6b5-1395bae75275 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:56.637623 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e5dab9ec-f9c3-4c69-a6b5-1395bae75275 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:56.638992 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-cd4e8aa9-7b2f-4b65-afa5-a94633885ffa tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] 10.222.0.33 "GET /compute/v2.1/servers/70213e65-9664-4df1-81d7-747c462fa434" status: 200 len: 1275 microversion: 2.1 time: 0.149094 Sep 23 04:32:56.639121 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e5dab9ec-f9c3-4c69-a6b5-1395bae75275 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:56.640054 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 331/627] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:32:56 2022] GET /compute/v2.1/servers/70213e65-9664-4df1-81d7-747c462fa434 => generated 1275 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:56.646238 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9eda4a89-c420-44f2-989b-e348f628bc74 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:56.647586 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-9eda4a89-c420-44f2-989b-e348f628bc74 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] [instance: 4f54b509-03bd-4fe1-9608-faaae848d5ac] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:56.650975 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e5dab9ec-f9c3-4c69-a6b5-1395bae75275 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/205bf02b-1478-4765-b2a6-d7014d9f0a64" status: 200 len: 1412 microversion: 2.25 time: 0.899602 Sep 23 04:32:56.655771 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9eda4a89-c420-44f2-989b-e348f628bc74 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:56.659801 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9eda4a89-c420-44f2-989b-e348f628bc74 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:56.659801 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9eda4a89-c420-44f2-989b-e348f628bc74 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:56.660026 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 297/628] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:32:55 2022] GET /compute/v2.1/servers/205bf02b-1478-4765-b2a6-d7014d9f0a64 => generated 1412 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:32:56.660125 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9eda4a89-c420-44f2-989b-e348f628bc74 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:56.660125 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9eda4a89-c420-44f2-989b-e348f628bc74 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:56.661046 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9eda4a89-c420-44f2-989b-e348f628bc74 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:56.767423 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-9eda4a89-c420-44f2-989b-e348f628bc74 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c82752e1bc4fdb82e7f8391c7c129f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44352a7a6d964530aa20ae83064b02e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:56.783290 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-9eda4a89-c420-44f2-989b-e348f628bc74 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] 10.222.0.33 "GET /compute/v2.1/servers/4f54b509-03bd-4fe1-9608-faaae848d5ac" status: 200 len: 1218 microversion: 2.1 time: 0.141479 Sep 23 04:32:56.784504 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 332/629] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:32:56 2022] GET /compute/v2.1/servers/4f54b509-03bd-4fe1-9608-faaae848d5ac => generated 1218 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:57.431198 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-c46349a6-17af-4c88-a0b3-9dfa21b1175f req-791891bf-0b89-4121-869d-ffffc4e2ff28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "205bf02b-1478-4765-b2a6-d7014d9f0a64", "tag": "06cbe8b1-7ee2-495a-8e80-7976cf75b2c6"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:32:57.451083 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-c46349a6-17af-4c88-a0b3-9dfa21b1175f req-791891bf-0b89-4121-869d-ffffc4e2ff28 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:57.452035 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-c46349a6-17af-4c88-a0b3-9dfa21b1175f req-791891bf-0b89-4121-869d-ffffc4e2ff28 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:57.452685 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-c46349a6-17af-4c88-a0b3-9dfa21b1175f req-791891bf-0b89-4121-869d-ffffc4e2ff28 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:57.460546 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=100 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:32:57.467826 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-c46349a6-17af-4c88-a0b3-9dfa21b1175f req-791891bf-0b89-4121-869d-ffffc4e2ff28 service nova] Creating event network-changed:06cbe8b1-7ee2-495a-8e80-7976cf75b2c6 for instance 205bf02b-1478-4765-b2a6-d7014d9f0a64 on n-h2-846463-3 Sep 23 04:32:57.473441 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-c46349a6-17af-4c88-a0b3-9dfa21b1175f req-791891bf-0b89-4121-869d-ffffc4e2ff28 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048843 Sep 23 04:32:57.474475 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 298/630] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:32:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:32:57.495752 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0bdd0db9-ff11-4611-8f71-66a341cbff2b tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:57.496375 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-0bdd0db9-ff11-4611-8f71-66a341cbff2b tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: 0dff1738-81f1-4619-af74-44b7adc805b5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:57.503620 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0bdd0db9-ff11-4611-8f71-66a341cbff2b tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:57.504112 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0bdd0db9-ff11-4611-8f71-66a341cbff2b tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:57.504572 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0bdd0db9-ff11-4611-8f71-66a341cbff2b tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:57.505278 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0bdd0db9-ff11-4611-8f71-66a341cbff2b tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:57.505728 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0bdd0db9-ff11-4611-8f71-66a341cbff2b tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:57.506419 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0bdd0db9-ff11-4611-8f71-66a341cbff2b tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:57.672323 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-282f9057-bb01-4ca6-b88c-c84fd50df150 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:57.673098 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-282f9057-bb01-4ca6-b88c-c84fd50df150 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] [instance: 70213e65-9664-4df1-81d7-747c462fa434] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:57.683961 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-282f9057-bb01-4ca6-b88c-c84fd50df150 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:57.689913 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-282f9057-bb01-4ca6-b88c-c84fd50df150 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:57.690537 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-282f9057-bb01-4ca6-b88c-c84fd50df150 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:57.691450 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-282f9057-bb01-4ca6-b88c-c84fd50df150 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:57.702645 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-282f9057-bb01-4ca6-b88c-c84fd50df150 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:57.703380 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-282f9057-bb01-4ca6-b88c-c84fd50df150 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:58.162774 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-0bdd0db9-ff11-4611-8f71-66a341cbff2b tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:58.173487 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0bdd0db9-ff11-4611-8f71-66a341cbff2b tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/0dff1738-81f1-4619-af74-44b7adc805b5" status: 200 len: 1477 microversion: 2.1 time: 0.681678 Sep 23 04:32:58.174850 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 333/631] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:32:57 2022] GET /compute/v2.1/servers/0dff1738-81f1-4619-af74-44b7adc805b5 => generated 1477 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:58.179956 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-282f9057-bb01-4ca6-b88c-c84fd50df150 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3ff8d26a3f4831b3ec766bea65e143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98e78e2969a446b8fdbf772b36dd0c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:58.188347 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-282f9057-bb01-4ca6-b88c-c84fd50df150 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] 10.222.0.33 "GET /compute/v2.1/servers/70213e65-9664-4df1-81d7-747c462fa434" status: 200 len: 1317 microversion: 2.1 time: 0.521031 Sep 23 04:32:58.191897 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 299/632] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:32:57 2022] GET /compute/v2.1/servers/70213e65-9664-4df1-81d7-747c462fa434 => generated 1317 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:58.204084 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-490726cf-bb00-46d0-9c16-959bc6121b73 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:58.208645 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-490726cf-bb00-46d0-9c16-959bc6121b73 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] [instance: 4f54b509-03bd-4fe1-9608-faaae848d5ac] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:58.223912 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ff7a3c8e-82a1-41ec-b5f7-89df9fcfb582 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:58.224438 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-490726cf-bb00-46d0-9c16-959bc6121b73 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:58.224557 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ff7a3c8e-82a1-41ec-b5f7-89df9fcfb582 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 205bf02b-1478-4765-b2a6-d7014d9f0a64] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:58.228758 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-490726cf-bb00-46d0-9c16-959bc6121b73 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:58.228758 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-490726cf-bb00-46d0-9c16-959bc6121b73 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:58.230642 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-490726cf-bb00-46d0-9c16-959bc6121b73 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:58.231355 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-490726cf-bb00-46d0-9c16-959bc6121b73 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:58.232179 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-490726cf-bb00-46d0-9c16-959bc6121b73 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:58.247375 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ff7a3c8e-82a1-41ec-b5f7-89df9fcfb582 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:58.247877 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ff7a3c8e-82a1-41ec-b5f7-89df9fcfb582 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:58.256209 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ff7a3c8e-82a1-41ec-b5f7-89df9fcfb582 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:58.257426 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ff7a3c8e-82a1-41ec-b5f7-89df9fcfb582 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:58.258240 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ff7a3c8e-82a1-41ec-b5f7-89df9fcfb582 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:58.259319 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ff7a3c8e-82a1-41ec-b5f7-89df9fcfb582 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:58.421191 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-490726cf-bb00-46d0-9c16-959bc6121b73 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c82752e1bc4fdb82e7f8391c7c129f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44352a7a6d964530aa20ae83064b02e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:58.433048 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-490726cf-bb00-46d0-9c16-959bc6121b73 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] 10.222.0.33 "GET /compute/v2.1/servers/4f54b509-03bd-4fe1-9608-faaae848d5ac" status: 200 len: 1266 microversion: 2.1 time: 0.238143 Sep 23 04:32:58.435081 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 300/633] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:32:58 2022] GET /compute/v2.1/servers/4f54b509-03bd-4fe1-9608-faaae848d5ac => generated 1266 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:58.580175 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ff7a3c8e-82a1-41ec-b5f7-89df9fcfb582 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:58.599499 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ff7a3c8e-82a1-41ec-b5f7-89df9fcfb582 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:58.601350 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ff7a3c8e-82a1-41ec-b5f7-89df9fcfb582 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:58.603208 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ff7a3c8e-82a1-41ec-b5f7-89df9fcfb582 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/205bf02b-1478-4765-b2a6-d7014d9f0a64" status: 200 len: 1412 microversion: 2.25 time: 0.426139 Sep 23 04:32:58.604086 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 334/634] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:32:58 2022] GET /compute/v2.1/servers/205bf02b-1478-4765-b2a6-d7014d9f0a64 => generated 1412 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:32:58.927396 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7b400fa1-602a-4d44-83b4-0f1f556d6a42 tempest-InstanceUsageAuditLogTestJSON-1822018074 tempest-InstanceUsageAuditLogTestJSON-1822018074-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:58.958657 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7b400fa1-602a-4d44-83b4-0f1f556d6a42 tempest-InstanceUsageAuditLogTestJSON-1822018074 tempest-InstanceUsageAuditLogTestJSON-1822018074-project-admin] 10.222.0.33 "GET /compute/v2.1/os-instance_usage_audit_log/2022-09-23 04:32:58" status: 200 len: 318 microversion: 2.1 time: 0.522339 Sep 23 04:32:58.959788 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 301/635] 10.222.0.33 () {58 vars in 1251 bytes} [Fri Sep 23 04:32:58 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-09-23%2004%3A32%3A58 => generated 318 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:32:58.972916 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c838431e-cf66-4438-8c5a-d27c7f1e3340 tempest-InstanceUsageAuditLogTestJSON-1822018074 tempest-InstanceUsageAuditLogTestJSON-1822018074-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:59.008915 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c838431e-cf66-4438-8c5a-d27c7f1e3340 tempest-InstanceUsageAuditLogTestJSON-1822018074 tempest-InstanceUsageAuditLogTestJSON-1822018074-project-admin] 10.222.0.33 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.039822 Sep 23 04:32:59.009696 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 335/636] 10.222.0.33 () {58 vars in 1185 bytes} [Fri Sep 23 04:32:58 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:32:59.210869 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c0d07ee3-b677-4f7a-929e-87b75a830892 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:59.210869 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c0d07ee3-b677-4f7a-929e-87b75a830892 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: 0dff1738-81f1-4619-af74-44b7adc805b5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:59.213402 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c0d07ee3-b677-4f7a-929e-87b75a830892 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:59.214111 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c0d07ee3-b677-4f7a-929e-87b75a830892 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:59.214680 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c0d07ee3-b677-4f7a-929e-87b75a830892 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:59.216213 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c0d07ee3-b677-4f7a-929e-87b75a830892 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:59.216789 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c0d07ee3-b677-4f7a-929e-87b75a830892 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:59.217356 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c0d07ee3-b677-4f7a-929e-87b75a830892 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:59.219695 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d7e76197-7d75-4e12-9bee-2369a532c9ab tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:59.220942 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d7e76197-7d75-4e12-9bee-2369a532c9ab tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] [instance: 70213e65-9664-4df1-81d7-747c462fa434] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:59.228068 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d7e76197-7d75-4e12-9bee-2369a532c9ab tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:59.229306 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d7e76197-7d75-4e12-9bee-2369a532c9ab tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:59.230611 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d7e76197-7d75-4e12-9bee-2369a532c9ab tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:59.235133 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d7e76197-7d75-4e12-9bee-2369a532c9ab tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:59.242975 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d7e76197-7d75-4e12-9bee-2369a532c9ab tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:59.242975 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d7e76197-7d75-4e12-9bee-2369a532c9ab tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:59.618361 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c0d07ee3-b677-4f7a-929e-87b75a830892 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:59.632140 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c0d07ee3-b677-4f7a-929e-87b75a830892 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/0dff1738-81f1-4619-af74-44b7adc805b5" status: 200 len: 1477 microversion: 2.1 time: 0.431079 Sep 23 04:32:59.633689 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 302/637] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:32:59 2022] GET /compute/v2.1/servers/0dff1738-81f1-4619-af74-44b7adc805b5 => generated 1477 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:59.638877 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8de26a71-acd4-4567-a337-ae3bcf7e3da6 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:59.644439 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8de26a71-acd4-4567-a337-ae3bcf7e3da6 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] [instance: 4f54b509-03bd-4fe1-9608-faaae848d5ac] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:59.645444 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d7e76197-7d75-4e12-9bee-2369a532c9ab tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3ff8d26a3f4831b3ec766bea65e143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98e78e2969a446b8fdbf772b36dd0c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:59.649707 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8de26a71-acd4-4567-a337-ae3bcf7e3da6 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:59.650519 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8de26a71-acd4-4567-a337-ae3bcf7e3da6 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:59.651258 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8de26a71-acd4-4567-a337-ae3bcf7e3da6 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:59.652124 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8de26a71-acd4-4567-a337-ae3bcf7e3da6 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:59.652742 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8de26a71-acd4-4567-a337-ae3bcf7e3da6 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:59.653375 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8de26a71-acd4-4567-a337-ae3bcf7e3da6 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:59.671318 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d7e76197-7d75-4e12-9bee-2369a532c9ab tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] 10.222.0.33 "GET /compute/v2.1/servers/70213e65-9664-4df1-81d7-747c462fa434" status: 200 len: 1317 microversion: 2.1 time: 0.456108 Sep 23 04:32:59.671957 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 336/638] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:32:59 2022] GET /compute/v2.1/servers/70213e65-9664-4df1-81d7-747c462fa434 => generated 1317 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:32:59.676711 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0351f263-d0a9-4de9-bfd2-39b38f6f214f tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:32:59.677307 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-0351f263-d0a9-4de9-bfd2-39b38f6f214f tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 205bf02b-1478-4765-b2a6-d7014d9f0a64] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:32:59.684248 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0351f263-d0a9-4de9-bfd2-39b38f6f214f tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:59.684829 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0351f263-d0a9-4de9-bfd2-39b38f6f214f tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:59.685710 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0351f263-d0a9-4de9-bfd2-39b38f6f214f tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:59.686965 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0351f263-d0a9-4de9-bfd2-39b38f6f214f tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:32:59.687537 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0351f263-d0a9-4de9-bfd2-39b38f6f214f tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:32:59.711862 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0351f263-d0a9-4de9-bfd2-39b38f6f214f tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:32:59.821637 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8de26a71-acd4-4567-a337-ae3bcf7e3da6 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c82752e1bc4fdb82e7f8391c7c129f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44352a7a6d964530aa20ae83064b02e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:32:59.830885 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8de26a71-acd4-4567-a337-ae3bcf7e3da6 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] 10.222.0.33 "GET /compute/v2.1/servers/4f54b509-03bd-4fe1-9608-faaae848d5ac" status: 200 len: 1272 microversion: 2.1 time: 0.195886 Sep 23 04:32:59.831948 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 303/639] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:32:59 2022] GET /compute/v2.1/servers/4f54b509-03bd-4fe1-9608-faaae848d5ac => generated 1272 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:00.054079 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-0351f263-d0a9-4de9-bfd2-39b38f6f214f tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:00.067614 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-0351f263-d0a9-4de9-bfd2-39b38f6f214f tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:00.071229 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-0351f263-d0a9-4de9-bfd2-39b38f6f214f tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:00.072107 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7efda1ad-c82b-4b11-93a7-378a8703ead0 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-698998266", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:33:00.076774 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0351f263-d0a9-4de9-bfd2-39b38f6f214f tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/205bf02b-1478-4765-b2a6-d7014d9f0a64" status: 200 len: 1412 microversion: 2.25 time: 0.403170 Sep 23 04:33:00.079606 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 337/640] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:32:59 2022] GET /compute/v2.1/servers/205bf02b-1478-4765-b2a6-d7014d9f0a64 => generated 1412 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:33:00.087059 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-170d14ba-6c9d-4381-ba90-a6dc430076f7 req-85a23c46-6f30-446b-ba2d-58af008f2d1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70213e65-9664-4df1-81d7-747c462fa434", "tag": "4070aee3-4e6a-47b5-ae56-ad309ddbad7b"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:33:00.100834 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-170d14ba-6c9d-4381-ba90-a6dc430076f7 req-85a23c46-6f30-446b-ba2d-58af008f2d1e service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:00.101504 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-170d14ba-6c9d-4381-ba90-a6dc430076f7 req-85a23c46-6f30-446b-ba2d-58af008f2d1e service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:00.102213 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-170d14ba-6c9d-4381-ba90-a6dc430076f7 req-85a23c46-6f30-446b-ba2d-58af008f2d1e service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:00.124302 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-170d14ba-6c9d-4381-ba90-a6dc430076f7 req-85a23c46-6f30-446b-ba2d-58af008f2d1e service nova] Creating event network-changed:4070aee3-4e6a-47b5-ae56-ad309ddbad7b for instance 70213e65-9664-4df1-81d7-747c462fa434 on n-h2-846463-3 Sep 23 04:33:00.129832 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-170d14ba-6c9d-4381-ba90-a6dc430076f7 req-85a23c46-6f30-446b-ba2d-58af008f2d1e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048456 Sep 23 04:33:00.130976 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 338/641] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:33:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:33:00.155770 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.network.neutron [None req-7efda1ad-c82b-4b11-93a7-378a8703ead0 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] validate_networks() for None {{(pid=122698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:33:00.629651 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-7efda1ad-c82b-4b11-93a7-378a8703ead0 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Flavor limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:33:00.630110 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-7efda1ad-c82b-4b11-93a7-378a8703ead0 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Image limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:33:00.630846 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-7efda1ad-c82b-4b11-93a7-378a8703ead0 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Flavor pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:33:00.631495 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-7efda1ad-c82b-4b11-93a7-378a8703ead0 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Image pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:33:00.632159 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-7efda1ad-c82b-4b11-93a7-378a8703ead0 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:33:00.646456 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7efda1ad-c82b-4b11-93a7-378a8703ead0 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:00.647066 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7efda1ad-c82b-4b11-93a7-378a8703ead0 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:00.647577 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7efda1ad-c82b-4b11-93a7-378a8703ead0 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:00.648405 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7efda1ad-c82b-4b11-93a7-378a8703ead0 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:00.649081 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7efda1ad-c82b-4b11-93a7-378a8703ead0 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:00.649810 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7efda1ad-c82b-4b11-93a7-378a8703ead0 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:00.663846 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-723688f2-56d8-4b44-89c5-8bc35b6850c3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:00.664496 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:33:00.665665 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-723688f2-56d8-4b44-89c5-8bc35b6850c3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: 0dff1738-81f1-4619-af74-44b7adc805b5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:00.671448 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-7efda1ad-c82b-4b11-93a7-378a8703ead0 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Getting quotas for project 9899ca05dc244a70a8bb265366780443. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:33:00.673513 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-723688f2-56d8-4b44-89c5-8bc35b6850c3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:00.674229 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-723688f2-56d8-4b44-89c5-8bc35b6850c3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:00.674831 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-723688f2-56d8-4b44-89c5-8bc35b6850c3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:00.676840 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-7efda1ad-c82b-4b11-93a7-378a8703ead0 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Getting quotas for user 16c8e1e5971342658447b25db5ec1df7 and project 9899ca05dc244a70a8bb265366780443. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:33:00.679454 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-723688f2-56d8-4b44-89c5-8bc35b6850c3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:00.680128 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-723688f2-56d8-4b44-89c5-8bc35b6850c3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:00.680931 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-723688f2-56d8-4b44-89c5-8bc35b6850c3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:00.695522 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7efda1ad-c82b-4b11-93a7-378a8703ead0 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Going to run 1 instances... {{(pid=122698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:33:00.698182 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7efda1ad-c82b-4b11-93a7-378a8703ead0 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] [instance: 676f62ac-f8f6-4f47-86f4-6baa8d3dfc4c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:33:00.893336 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7efda1ad-c82b-4b11-93a7-378a8703ead0 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.059571 Sep 23 04:33:00.896035 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 304/642] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:32:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1063 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:33:00.924155 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-791e0c12-5d1e-40ac-9d72-35d634270a44 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:00.924155 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-791e0c12-5d1e-40ac-9d72-35d634270a44 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] [instance: 70213e65-9664-4df1-81d7-747c462fa434] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:00.930866 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-791e0c12-5d1e-40ac-9d72-35d634270a44 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:00.932685 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-791e0c12-5d1e-40ac-9d72-35d634270a44 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:00.933540 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-791e0c12-5d1e-40ac-9d72-35d634270a44 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:00.934468 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-791e0c12-5d1e-40ac-9d72-35d634270a44 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:00.935187 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-791e0c12-5d1e-40ac-9d72-35d634270a44 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:00.935941 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-791e0c12-5d1e-40ac-9d72-35d634270a44 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:01.443400 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-723688f2-56d8-4b44-89c5-8bc35b6850c3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:01.456058 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:33:01.460245 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-723688f2-56d8-4b44-89c5-8bc35b6850c3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/0dff1738-81f1-4619-af74-44b7adc805b5" status: 200 len: 1477 microversion: 2.1 time: 0.801250 Sep 23 04:33:01.475688 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 339/643] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:00 2022] GET /compute/v2.1/servers/0dff1738-81f1-4619-af74-44b7adc805b5 => generated 1477 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:33:01.497306 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a6a0649b-a48a-43c2-9309-6f3d781a69cb tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:01.497306 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a6a0649b-a48a-43c2-9309-6f3d781a69cb tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] [instance: 4f54b509-03bd-4fe1-9608-faaae848d5ac] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:01.507990 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a6a0649b-a48a-43c2-9309-6f3d781a69cb tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:01.508673 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a6a0649b-a48a-43c2-9309-6f3d781a69cb tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:01.509461 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a6a0649b-a48a-43c2-9309-6f3d781a69cb tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:01.510349 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a6a0649b-a48a-43c2-9309-6f3d781a69cb tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:01.510983 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a6a0649b-a48a-43c2-9309-6f3d781a69cb tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:01.511559 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a6a0649b-a48a-43c2-9309-6f3d781a69cb tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:01.575794 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-791e0c12-5d1e-40ac-9d72-35d634270a44 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3ff8d26a3f4831b3ec766bea65e143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98e78e2969a446b8fdbf772b36dd0c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:01.593750 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-791e0c12-5d1e-40ac-9d72-35d634270a44 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] 10.222.0.33 "GET /compute/v2.1/servers/70213e65-9664-4df1-81d7-747c462fa434" status: 200 len: 1317 microversion: 2.1 time: 0.693932 Sep 23 04:33:01.596992 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 305/644] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:00 2022] GET /compute/v2.1/servers/70213e65-9664-4df1-81d7-747c462fa434 => generated 1317 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:01.607467 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d5c93bf9-89df-4e9c-922e-5809eee44ef3 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:01.610193 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d5c93bf9-89df-4e9c-922e-5809eee44ef3 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] [instance: 676f62ac-f8f6-4f47-86f4-6baa8d3dfc4c] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:01.725405 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d5c93bf9-89df-4e9c-922e-5809eee44ef3 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c8e1e5971342658447b25db5ec1df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9899ca05dc244a70a8bb265366780443', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:01.735781 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=97 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:33:01.738406 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d5c93bf9-89df-4e9c-922e-5809eee44ef3 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] 10.222.0.33 "GET /compute/v2.1/servers/676f62ac-f8f6-4f47-86f4-6baa8d3dfc4c" status: 200 len: 1222 microversion: 2.1 time: 0.137475 Sep 23 04:33:01.739175 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 306/645] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:01 2022] GET /compute/v2.1/servers/676f62ac-f8f6-4f47-86f4-6baa8d3dfc4c => generated 1222 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:01.763020 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-92a9450b-891f-4b90-9261-28f090a14e75 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:01.765383 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-92a9450b-891f-4b90-9261-28f090a14e75 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 205bf02b-1478-4765-b2a6-d7014d9f0a64] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:01.783966 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-92a9450b-891f-4b90-9261-28f090a14e75 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:01.789342 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-92a9450b-891f-4b90-9261-28f090a14e75 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:01.790211 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-92a9450b-891f-4b90-9261-28f090a14e75 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:01.791075 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-92a9450b-891f-4b90-9261-28f090a14e75 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:01.791676 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-92a9450b-891f-4b90-9261-28f090a14e75 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:01.792201 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-92a9450b-891f-4b90-9261-28f090a14e75 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:01.832653 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a6a0649b-a48a-43c2-9309-6f3d781a69cb tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c82752e1bc4fdb82e7f8391c7c129f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44352a7a6d964530aa20ae83064b02e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:01.845733 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a6a0649b-a48a-43c2-9309-6f3d781a69cb tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] 10.222.0.33 "GET /compute/v2.1/servers/4f54b509-03bd-4fe1-9608-faaae848d5ac" status: 200 len: 1314 microversion: 2.1 time: 0.367993 Sep 23 04:33:01.869332 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 340/646] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:01 2022] GET /compute/v2.1/servers/4f54b509-03bd-4fe1-9608-faaae848d5ac => generated 1314 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:02.135363 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-92a9450b-891f-4b90-9261-28f090a14e75 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:02.149573 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-92a9450b-891f-4b90-9261-28f090a14e75 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:02.152928 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-92a9450b-891f-4b90-9261-28f090a14e75 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:02.156313 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-92a9450b-891f-4b90-9261-28f090a14e75 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/205bf02b-1478-4765-b2a6-d7014d9f0a64" status: 200 len: 1412 microversion: 2.25 time: 0.414825 Sep 23 04:33:02.158075 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 307/647] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:33:01 2022] GET /compute/v2.1/servers/205bf02b-1478-4765-b2a6-d7014d9f0a64 => generated 1412 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:33:02.415191 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-976f4eea-ce63-4512-8964-103ab24b46a5 req-a33e82f6-2c19-4ffa-b6d8-1a92bd154e83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f392741f-f967-4c1c-930b-4eea7272bf64", "tag": "a8e6bde0-f854-4040-8b7f-b369ce18b326"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:33:02.425915 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-976f4eea-ce63-4512-8964-103ab24b46a5 req-a33e82f6-2c19-4ffa-b6d8-1a92bd154e83 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:02.426875 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-976f4eea-ce63-4512-8964-103ab24b46a5 req-a33e82f6-2c19-4ffa-b6d8-1a92bd154e83 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:02.427550 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-976f4eea-ce63-4512-8964-103ab24b46a5 req-a33e82f6-2c19-4ffa-b6d8-1a92bd154e83 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:02.440329 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-976f4eea-ce63-4512-8964-103ab24b46a5 req-a33e82f6-2c19-4ffa-b6d8-1a92bd154e83 service nova] Creating event network-changed:a8e6bde0-f854-4040-8b7f-b369ce18b326 for instance f392741f-f967-4c1c-930b-4eea7272bf64 on n-h1-846463-3 Sep 23 04:33:02.447925 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-976f4eea-ce63-4512-8964-103ab24b46a5 req-a33e82f6-2c19-4ffa-b6d8-1a92bd154e83 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036867 Sep 23 04:33:02.450766 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 341/648] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:33:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:33:02.494967 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-31953e77-b69d-4150-ba1b-e603dc870a5b tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:02.495621 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-31953e77-b69d-4150-ba1b-e603dc870a5b tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: 0dff1738-81f1-4619-af74-44b7adc805b5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:02.517372 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-31953e77-b69d-4150-ba1b-e603dc870a5b tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:02.517883 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-31953e77-b69d-4150-ba1b-e603dc870a5b tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:02.524170 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-31953e77-b69d-4150-ba1b-e603dc870a5b tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:02.524859 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-31953e77-b69d-4150-ba1b-e603dc870a5b tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:02.525364 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-31953e77-b69d-4150-ba1b-e603dc870a5b tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:02.526000 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-31953e77-b69d-4150-ba1b-e603dc870a5b tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:02.626737 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e77f162f-7a97-4c77-a9c0-4f86da2ac727 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:02.627458 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e77f162f-7a97-4c77-a9c0-4f86da2ac727 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] [instance: 70213e65-9664-4df1-81d7-747c462fa434] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:02.635042 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e77f162f-7a97-4c77-a9c0-4f86da2ac727 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:02.635803 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e77f162f-7a97-4c77-a9c0-4f86da2ac727 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:02.636451 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e77f162f-7a97-4c77-a9c0-4f86da2ac727 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:02.637363 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e77f162f-7a97-4c77-a9c0-4f86da2ac727 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:02.638053 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e77f162f-7a97-4c77-a9c0-4f86da2ac727 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:02.638669 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e77f162f-7a97-4c77-a9c0-4f86da2ac727 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:03.178686 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-31953e77-b69d-4150-ba1b-e603dc870a5b tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:03.197666 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-31953e77-b69d-4150-ba1b-e603dc870a5b tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/0dff1738-81f1-4619-af74-44b7adc805b5" status: 200 len: 1477 microversion: 2.1 time: 0.706534 Sep 23 04:33:03.202260 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 308/649] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:02 2022] GET /compute/v2.1/servers/0dff1738-81f1-4619-af74-44b7adc805b5 => generated 1477 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:03.223083 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d9a9e6ee-66b9-4dd2-8215-dee2433f9724 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:03.223735 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d9a9e6ee-66b9-4dd2-8215-dee2433f9724 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] [instance: 676f62ac-f8f6-4f47-86f4-6baa8d3dfc4c] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:03.242377 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d9a9e6ee-66b9-4dd2-8215-dee2433f9724 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:03.242975 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d9a9e6ee-66b9-4dd2-8215-dee2433f9724 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:03.243426 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d9a9e6ee-66b9-4dd2-8215-dee2433f9724 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:03.244687 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d9a9e6ee-66b9-4dd2-8215-dee2433f9724 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:03.245235 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d9a9e6ee-66b9-4dd2-8215-dee2433f9724 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:03.245671 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d9a9e6ee-66b9-4dd2-8215-dee2433f9724 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:03.296598 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e77f162f-7a97-4c77-a9c0-4f86da2ac727 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3ff8d26a3f4831b3ec766bea65e143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98e78e2969a446b8fdbf772b36dd0c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:03.306352 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e77f162f-7a97-4c77-a9c0-4f86da2ac727 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] 10.222.0.33 "GET /compute/v2.1/servers/70213e65-9664-4df1-81d7-747c462fa434" status: 200 len: 1317 microversion: 2.1 time: 0.684226 Sep 23 04:33:03.313008 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 342/650] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:02 2022] GET /compute/v2.1/servers/70213e65-9664-4df1-81d7-747c462fa434 => generated 1317 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:03.319113 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e3e70645-6701-4c3d-9048-ddce9f30d628 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:03.321975 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e3e70645-6701-4c3d-9048-ddce9f30d628 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] [instance: 4f54b509-03bd-4fe1-9608-faaae848d5ac] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:03.335463 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e3e70645-6701-4c3d-9048-ddce9f30d628 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:03.338301 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e3e70645-6701-4c3d-9048-ddce9f30d628 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:03.339113 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e3e70645-6701-4c3d-9048-ddce9f30d628 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:03.340506 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e3e70645-6701-4c3d-9048-ddce9f30d628 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:03.341138 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e3e70645-6701-4c3d-9048-ddce9f30d628 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:03.341755 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e3e70645-6701-4c3d-9048-ddce9f30d628 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:03.455225 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d9a9e6ee-66b9-4dd2-8215-dee2433f9724 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c8e1e5971342658447b25db5ec1df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9899ca05dc244a70a8bb265366780443', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:03.464936 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d9a9e6ee-66b9-4dd2-8215-dee2433f9724 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] 10.222.0.33 "GET /compute/v2.1/servers/676f62ac-f8f6-4f47-86f4-6baa8d3dfc4c" status: 200 len: 1274 microversion: 2.1 time: 0.260063 Sep 23 04:33:03.466196 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 309/651] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:03 2022] GET /compute/v2.1/servers/676f62ac-f8f6-4f47-86f4-6baa8d3dfc4c => generated 1274 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:03.498995 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-68636deb-ead0-4711-a7f8-3e4b39566a22 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:03.502122 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-68636deb-ead0-4711-a7f8-3e4b39566a22 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 205bf02b-1478-4765-b2a6-d7014d9f0a64] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:03.512976 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-68636deb-ead0-4711-a7f8-3e4b39566a22 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:03.517337 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-68636deb-ead0-4711-a7f8-3e4b39566a22 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:03.517337 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-68636deb-ead0-4711-a7f8-3e4b39566a22 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:03.517337 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-68636deb-ead0-4711-a7f8-3e4b39566a22 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:03.517337 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-68636deb-ead0-4711-a7f8-3e4b39566a22 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:03.517669 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-68636deb-ead0-4711-a7f8-3e4b39566a22 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:03.740580 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e3e70645-6701-4c3d-9048-ddce9f30d628 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c82752e1bc4fdb82e7f8391c7c129f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44352a7a6d964530aa20ae83064b02e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:03.755097 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e3e70645-6701-4c3d-9048-ddce9f30d628 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] 10.222.0.33 "GET /compute/v2.1/servers/4f54b509-03bd-4fe1-9608-faaae848d5ac" status: 200 len: 1314 microversion: 2.1 time: 0.440604 Sep 23 04:33:03.756763 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 343/652] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:03 2022] GET /compute/v2.1/servers/4f54b509-03bd-4fe1-9608-faaae848d5ac => generated 1314 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:03.778881 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-a2d55faf-5740-4730-9220-871826841717 req-e108e5fc-1e40-4528-9b5c-75558af68e98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f54b509-03bd-4fe1-9608-faaae848d5ac", "tag": "3ef36ecf-cbc6-4c5b-8a7a-ad331f2db8a3"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:33:03.802260 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-a2d55faf-5740-4730-9220-871826841717 req-e108e5fc-1e40-4528-9b5c-75558af68e98 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:03.802685 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-a2d55faf-5740-4730-9220-871826841717 req-e108e5fc-1e40-4528-9b5c-75558af68e98 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:03.803513 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-a2d55faf-5740-4730-9220-871826841717 req-e108e5fc-1e40-4528-9b5c-75558af68e98 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:03.826102 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-a2d55faf-5740-4730-9220-871826841717 req-e108e5fc-1e40-4528-9b5c-75558af68e98 service nova] Creating event network-changed:3ef36ecf-cbc6-4c5b-8a7a-ad331f2db8a3 for instance 4f54b509-03bd-4fe1-9608-faaae848d5ac on n-h1-846463-3 Sep 23 04:33:03.838182 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-a2d55faf-5740-4730-9220-871826841717 req-e108e5fc-1e40-4528-9b5c-75558af68e98 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066308 Sep 23 04:33:03.844468 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 344/653] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:33:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:33:03.849938 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-0fbc8fb8-5e9d-48fe-81f3-e814dc0c71fd req-30883412-20b6-456d-b404-8f96cb07c934 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "205bf02b-1478-4765-b2a6-d7014d9f0a64", "name": "network-vif-plugged", "status": "completed", "tag": "06cbe8b1-7ee2-495a-8e80-7976cf75b2c6"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:33:03.876978 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-0fbc8fb8-5e9d-48fe-81f3-e814dc0c71fd req-30883412-20b6-456d-b404-8f96cb07c934 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:03.877935 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-0fbc8fb8-5e9d-48fe-81f3-e814dc0c71fd req-30883412-20b6-456d-b404-8f96cb07c934 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:03.878665 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-0fbc8fb8-5e9d-48fe-81f3-e814dc0c71fd req-30883412-20b6-456d-b404-8f96cb07c934 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:03.906925 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-0fbc8fb8-5e9d-48fe-81f3-e814dc0c71fd req-30883412-20b6-456d-b404-8f96cb07c934 service nova] Creating event network-vif-plugged:06cbe8b1-7ee2-495a-8e80-7976cf75b2c6 for instance 205bf02b-1478-4765-b2a6-d7014d9f0a64 on n-h2-846463-3 Sep 23 04:33:03.912641 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-0fbc8fb8-5e9d-48fe-81f3-e814dc0c71fd req-30883412-20b6-456d-b404-8f96cb07c934 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066498 Sep 23 04:33:03.913994 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 345/654] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:33:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:33:03.958303 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-68636deb-ead0-4711-a7f8-3e4b39566a22 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:03.968959 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-68636deb-ead0-4711-a7f8-3e4b39566a22 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:03.970809 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-68636deb-ead0-4711-a7f8-3e4b39566a22 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:03.972273 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-68636deb-ead0-4711-a7f8-3e4b39566a22 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/205bf02b-1478-4765-b2a6-d7014d9f0a64" status: 200 len: 1412 microversion: 2.25 time: 0.504899 Sep 23 04:33:03.994289 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 310/655] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:33:03 2022] GET /compute/v2.1/servers/205bf02b-1478-4765-b2a6-d7014d9f0a64 => generated 1412 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:33:04.224568 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d5b71498-909e-4769-bd2a-9d923bfa889e tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:04.226024 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d5b71498-909e-4769-bd2a-9d923bfa889e tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: 0dff1738-81f1-4619-af74-44b7adc805b5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:04.246679 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d5b71498-909e-4769-bd2a-9d923bfa889e tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:04.247416 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d5b71498-909e-4769-bd2a-9d923bfa889e tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:04.247870 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d5b71498-909e-4769-bd2a-9d923bfa889e tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:04.249075 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d5b71498-909e-4769-bd2a-9d923bfa889e tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:04.249075 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d5b71498-909e-4769-bd2a-9d923bfa889e tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:04.250056 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d5b71498-909e-4769-bd2a-9d923bfa889e tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:04.335663 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-43c364a7-2a84-41b0-80e2-da49beccb2f8 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:04.336847 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-43c364a7-2a84-41b0-80e2-da49beccb2f8 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] [instance: 70213e65-9664-4df1-81d7-747c462fa434] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:04.344337 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-43c364a7-2a84-41b0-80e2-da49beccb2f8 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:04.345566 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-43c364a7-2a84-41b0-80e2-da49beccb2f8 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:04.346293 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-43c364a7-2a84-41b0-80e2-da49beccb2f8 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:04.348027 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-43c364a7-2a84-41b0-80e2-da49beccb2f8 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:04.348822 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-43c364a7-2a84-41b0-80e2-da49beccb2f8 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:04.352572 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-43c364a7-2a84-41b0-80e2-da49beccb2f8 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:04.741042 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=9 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:33:04.971360 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-43c364a7-2a84-41b0-80e2-da49beccb2f8 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3ff8d26a3f4831b3ec766bea65e143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98e78e2969a446b8fdbf772b36dd0c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:04.973464 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d5b71498-909e-4769-bd2a-9d923bfa889e tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:04.986161 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-43c364a7-2a84-41b0-80e2-da49beccb2f8 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] 10.222.0.33 "GET /compute/v2.1/servers/70213e65-9664-4df1-81d7-747c462fa434" status: 200 len: 1317 microversion: 2.1 time: 0.656788 Sep 23 04:33:04.986739 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 311/656] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:04 2022] GET /compute/v2.1/servers/70213e65-9664-4df1-81d7-747c462fa434 => generated 1317 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:04.998600 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d5b71498-909e-4769-bd2a-9d923bfa889e tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/0dff1738-81f1-4619-af74-44b7adc805b5" status: 200 len: 1477 microversion: 2.1 time: 0.770645 Sep 23 04:33:04.998600 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 346/657] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:04 2022] GET /compute/v2.1/servers/0dff1738-81f1-4619-af74-44b7adc805b5 => generated 1477 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:04.998775 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-37264d3c-fd7c-4e71-bab2-95210702ce44 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:04.998775 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-37264d3c-fd7c-4e71-bab2-95210702ce44 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] [instance: 676f62ac-f8f6-4f47-86f4-6baa8d3dfc4c] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:04.998940 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-24ba14a5-8ef1-4d68-a5fa-6e7b494b9a1d tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:04.998940 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-24ba14a5-8ef1-4d68-a5fa-6e7b494b9a1d tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] [instance: 4f54b509-03bd-4fe1-9608-faaae848d5ac] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:05.006840 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-37264d3c-fd7c-4e71-bab2-95210702ce44 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:05.007329 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-24ba14a5-8ef1-4d68-a5fa-6e7b494b9a1d tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:05.008079 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-24ba14a5-8ef1-4d68-a5fa-6e7b494b9a1d tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:05.008857 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-24ba14a5-8ef1-4d68-a5fa-6e7b494b9a1d tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:05.009493 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-37264d3c-fd7c-4e71-bab2-95210702ce44 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:05.009977 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-37264d3c-fd7c-4e71-bab2-95210702ce44 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:05.010723 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-37264d3c-fd7c-4e71-bab2-95210702ce44 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:05.011191 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-37264d3c-fd7c-4e71-bab2-95210702ce44 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:05.011693 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-24ba14a5-8ef1-4d68-a5fa-6e7b494b9a1d tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:05.012444 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-24ba14a5-8ef1-4d68-a5fa-6e7b494b9a1d tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:05.013091 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-24ba14a5-8ef1-4d68-a5fa-6e7b494b9a1d tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:05.014546 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-37264d3c-fd7c-4e71-bab2-95210702ce44 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:05.124068 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-37264d3c-fd7c-4e71-bab2-95210702ce44 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c8e1e5971342658447b25db5ec1df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9899ca05dc244a70a8bb265366780443', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:05.133345 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-37264d3c-fd7c-4e71-bab2-95210702ce44 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] 10.222.0.33 "GET /compute/v2.1/servers/676f62ac-f8f6-4f47-86f4-6baa8d3dfc4c" status: 200 len: 1280 microversion: 2.1 time: 0.145523 Sep 23 04:33:05.134264 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 312/658] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:04 2022] GET /compute/v2.1/servers/676f62ac-f8f6-4f47-86f4-6baa8d3dfc4c => generated 1280 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:05.138991 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ee028e4c-79d3-4583-9a7d-21e4a0fa6f67 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:05.139810 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-ee028e4c-79d3-4583-9a7d-21e4a0fa6f67 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 205bf02b-1478-4765-b2a6-d7014d9f0a64] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:05.146463 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ee028e4c-79d3-4583-9a7d-21e4a0fa6f67 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:05.146963 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ee028e4c-79d3-4583-9a7d-21e4a0fa6f67 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:05.147588 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ee028e4c-79d3-4583-9a7d-21e4a0fa6f67 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:05.148576 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ee028e4c-79d3-4583-9a7d-21e4a0fa6f67 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:05.149187 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ee028e4c-79d3-4583-9a7d-21e4a0fa6f67 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:05.149768 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ee028e4c-79d3-4583-9a7d-21e4a0fa6f67 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:05.298162 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-24ba14a5-8ef1-4d68-a5fa-6e7b494b9a1d tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c82752e1bc4fdb82e7f8391c7c129f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44352a7a6d964530aa20ae83064b02e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:05.309022 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-24ba14a5-8ef1-4d68-a5fa-6e7b494b9a1d tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] 10.222.0.33 "GET /compute/v2.1/servers/4f54b509-03bd-4fe1-9608-faaae848d5ac" status: 200 len: 1314 microversion: 2.1 time: 0.317997 Sep 23 04:33:05.318142 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 347/659] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:04 2022] GET /compute/v2.1/servers/4f54b509-03bd-4fe1-9608-faaae848d5ac => generated 1314 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:05.370515 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ee028e4c-79d3-4583-9a7d-21e4a0fa6f67 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:05.381155 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ee028e4c-79d3-4583-9a7d-21e4a0fa6f67 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:05.382678 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ee028e4c-79d3-4583-9a7d-21e4a0fa6f67 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:05.383906 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ee028e4c-79d3-4583-9a7d-21e4a0fa6f67 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/205bf02b-1478-4765-b2a6-d7014d9f0a64" status: 200 len: 1412 microversion: 2.25 time: 0.248475 Sep 23 04:33:05.385020 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 313/660] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:33:05 2022] GET /compute/v2.1/servers/205bf02b-1478-4765-b2a6-d7014d9f0a64 => generated 1412 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:33:06.038885 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2f614c64-4502-4f47-b70e-39a76dcc723d tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:06.039311 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-41f0bd89-10ff-4677-8e61-ee37f820be70 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:06.039750 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-2f614c64-4502-4f47-b70e-39a76dcc723d tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] [instance: 70213e65-9664-4df1-81d7-747c462fa434] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:06.039952 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-41f0bd89-10ff-4677-8e61-ee37f820be70 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: 0dff1738-81f1-4619-af74-44b7adc805b5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:06.053938 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2f614c64-4502-4f47-b70e-39a76dcc723d tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:06.054460 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2f614c64-4502-4f47-b70e-39a76dcc723d tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:06.058974 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2f614c64-4502-4f47-b70e-39a76dcc723d tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:06.059916 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2f614c64-4502-4f47-b70e-39a76dcc723d tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:06.060556 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2f614c64-4502-4f47-b70e-39a76dcc723d tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:06.060963 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-41f0bd89-10ff-4677-8e61-ee37f820be70 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:06.061147 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2f614c64-4502-4f47-b70e-39a76dcc723d tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:06.064407 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-41f0bd89-10ff-4677-8e61-ee37f820be70 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:06.065217 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-41f0bd89-10ff-4677-8e61-ee37f820be70 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:06.066305 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-41f0bd89-10ff-4677-8e61-ee37f820be70 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:06.067474 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-41f0bd89-10ff-4677-8e61-ee37f820be70 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:06.068881 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-41f0bd89-10ff-4677-8e61-ee37f820be70 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:06.386568 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-41f0bd89-10ff-4677-8e61-ee37f820be70 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:06.407960 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-2f614c64-4502-4f47-b70e-39a76dcc723d tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3ff8d26a3f4831b3ec766bea65e143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98e78e2969a446b8fdbf772b36dd0c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:06.429016 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-41f0bd89-10ff-4677-8e61-ee37f820be70 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/0dff1738-81f1-4619-af74-44b7adc805b5" status: 200 len: 1477 microversion: 2.1 time: 0.390235 Sep 23 04:33:06.430898 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 348/661] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:06 2022] GET /compute/v2.1/servers/0dff1738-81f1-4619-af74-44b7adc805b5 => generated 1477 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:06.440556 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2f614c64-4502-4f47-b70e-39a76dcc723d tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] 10.222.0.33 "GET /compute/v2.1/servers/70213e65-9664-4df1-81d7-747c462fa434" status: 200 len: 1317 microversion: 2.1 time: 0.404488 Sep 23 04:33:06.442942 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 314/662] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:06 2022] GET /compute/v2.1/servers/70213e65-9664-4df1-81d7-747c462fa434 => generated 1317 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:06.446108 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-81fd8b47-13c7-4ba8-abcc-3a7a9065bc68 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:06.448842 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-81fd8b47-13c7-4ba8-abcc-3a7a9065bc68 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] [instance: 676f62ac-f8f6-4f47-86f4-6baa8d3dfc4c] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:06.455768 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b366edfa-1333-42dd-a22e-abc893ec90d3 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:06.462179 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b366edfa-1333-42dd-a22e-abc893ec90d3 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] [instance: 4f54b509-03bd-4fe1-9608-faaae848d5ac] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:06.466921 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-81fd8b47-13c7-4ba8-abcc-3a7a9065bc68 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:06.467410 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-81fd8b47-13c7-4ba8-abcc-3a7a9065bc68 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:06.468098 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-81fd8b47-13c7-4ba8-abcc-3a7a9065bc68 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:06.468997 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-81fd8b47-13c7-4ba8-abcc-3a7a9065bc68 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:06.469596 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-81fd8b47-13c7-4ba8-abcc-3a7a9065bc68 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:06.470198 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-81fd8b47-13c7-4ba8-abcc-3a7a9065bc68 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:06.473081 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b366edfa-1333-42dd-a22e-abc893ec90d3 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:06.473820 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b366edfa-1333-42dd-a22e-abc893ec90d3 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:06.474535 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b366edfa-1333-42dd-a22e-abc893ec90d3 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:06.475623 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b366edfa-1333-42dd-a22e-abc893ec90d3 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:06.476235 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b366edfa-1333-42dd-a22e-abc893ec90d3 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:06.477257 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b366edfa-1333-42dd-a22e-abc893ec90d3 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:06.620266 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-81fd8b47-13c7-4ba8-abcc-3a7a9065bc68 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c8e1e5971342658447b25db5ec1df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9899ca05dc244a70a8bb265366780443', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:06.629495 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-81fd8b47-13c7-4ba8-abcc-3a7a9065bc68 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] 10.222.0.33 "GET /compute/v2.1/servers/676f62ac-f8f6-4f47-86f4-6baa8d3dfc4c" status: 200 len: 1280 microversion: 2.1 time: 0.193925 Sep 23 04:33:06.634942 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 349/663] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:06 2022] GET /compute/v2.1/servers/676f62ac-f8f6-4f47-86f4-6baa8d3dfc4c => generated 1280 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:06.645910 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-90a32baa-504a-467d-a167-e3cc3523da01 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:06.646529 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-90a32baa-504a-467d-a167-e3cc3523da01 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 205bf02b-1478-4765-b2a6-d7014d9f0a64] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:06.657533 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-90a32baa-504a-467d-a167-e3cc3523da01 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:06.658411 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-90a32baa-504a-467d-a167-e3cc3523da01 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:06.659081 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-90a32baa-504a-467d-a167-e3cc3523da01 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:06.660024 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-90a32baa-504a-467d-a167-e3cc3523da01 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:06.660743 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-90a32baa-504a-467d-a167-e3cc3523da01 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:06.661383 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-90a32baa-504a-467d-a167-e3cc3523da01 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:06.709944 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b366edfa-1333-42dd-a22e-abc893ec90d3 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c82752e1bc4fdb82e7f8391c7c129f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44352a7a6d964530aa20ae83064b02e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:06.718626 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b366edfa-1333-42dd-a22e-abc893ec90d3 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] 10.222.0.33 "GET /compute/v2.1/servers/4f54b509-03bd-4fe1-9608-faaae848d5ac" status: 200 len: 1314 microversion: 2.1 time: 0.273865 Sep 23 04:33:06.730515 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 315/664] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:06 2022] GET /compute/v2.1/servers/4f54b509-03bd-4fe1-9608-faaae848d5ac => generated 1314 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:06.872980 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-90a32baa-504a-467d-a167-e3cc3523da01 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:06.884611 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-90a32baa-504a-467d-a167-e3cc3523da01 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:06.890296 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-90a32baa-504a-467d-a167-e3cc3523da01 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:06.891627 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-90a32baa-504a-467d-a167-e3cc3523da01 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/205bf02b-1478-4765-b2a6-d7014d9f0a64" status: 200 len: 1608 microversion: 2.25 time: 0.258490 Sep 23 04:33:06.893785 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 350/665] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:33:06 2022] GET /compute/v2.1/servers/205bf02b-1478-4765-b2a6-d7014d9f0a64 => generated 1608 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:33:06.924249 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8d4d172b-d2f6-4ac2-ae0f-3aa7db808cfd tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:06.925014 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8d4d172b-d2f6-4ac2-ae0f-3aa7db808cfd tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 205bf02b-1478-4765-b2a6-d7014d9f0a64] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:06.935118 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8d4d172b-d2f6-4ac2-ae0f-3aa7db808cfd tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:06.936055 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8d4d172b-d2f6-4ac2-ae0f-3aa7db808cfd tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:06.937225 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8d4d172b-d2f6-4ac2-ae0f-3aa7db808cfd tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:06.938197 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8d4d172b-d2f6-4ac2-ae0f-3aa7db808cfd tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:06.941745 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8d4d172b-d2f6-4ac2-ae0f-3aa7db808cfd tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:06.941745 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8d4d172b-d2f6-4ac2-ae0f-3aa7db808cfd tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:07.177989 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8d4d172b-d2f6-4ac2-ae0f-3aa7db808cfd tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/205bf02b-1478-4765-b2a6-d7014d9f0a64/os-interface" status: 200 len: 284 microversion: 2.25 time: 0.260392 Sep 23 04:33:07.178939 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 316/666] 10.222.0.33 () {60 vars in 1316 bytes} [Fri Sep 23 04:33:06 2022] GET /compute/v2.1/servers/205bf02b-1478-4765-b2a6-d7014d9f0a64/os-interface => generated 284 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 04:33:07.470396 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-fb6f5226-4bb7-489f-8158-244d2ac07da1 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:07.471271 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-342e424d-36ee-4713-b46f-4d15482cb126 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:07.472736 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-fb6f5226-4bb7-489f-8158-244d2ac07da1 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] [instance: 70213e65-9664-4df1-81d7-747c462fa434] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:07.473436 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-342e424d-36ee-4713-b46f-4d15482cb126 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: 0dff1738-81f1-4619-af74-44b7adc805b5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:07.488497 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-342e424d-36ee-4713-b46f-4d15482cb126 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:07.490203 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fb6f5226-4bb7-489f-8158-244d2ac07da1 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:07.490928 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fb6f5226-4bb7-489f-8158-244d2ac07da1 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:07.491800 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-342e424d-36ee-4713-b46f-4d15482cb126 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:07.492462 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fb6f5226-4bb7-489f-8158-244d2ac07da1 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:07.493122 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-342e424d-36ee-4713-b46f-4d15482cb126 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:07.495464 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fb6f5226-4bb7-489f-8158-244d2ac07da1 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:07.495862 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-342e424d-36ee-4713-b46f-4d15482cb126 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:07.496583 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fb6f5226-4bb7-489f-8158-244d2ac07da1 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:07.497450 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-342e424d-36ee-4713-b46f-4d15482cb126 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:07.498160 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fb6f5226-4bb7-489f-8158-244d2ac07da1 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:07.498810 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-342e424d-36ee-4713-b46f-4d15482cb126 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:08.306847 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-342e424d-36ee-4713-b46f-4d15482cb126 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:08.332890 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-342e424d-36ee-4713-b46f-4d15482cb126 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/0dff1738-81f1-4619-af74-44b7adc805b5" status: 200 len: 1477 microversion: 2.1 time: 0.868676 Sep 23 04:33:08.333998 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 317/667] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:07 2022] GET /compute/v2.1/servers/0dff1738-81f1-4619-af74-44b7adc805b5 => generated 1477 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:33:08.339574 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7c9750fd-5bdb-44cc-9709-22d71c96cf1b tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:08.340436 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7c9750fd-5bdb-44cc-9709-22d71c96cf1b tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] [instance: 676f62ac-f8f6-4f47-86f4-6baa8d3dfc4c] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:08.347986 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7c9750fd-5bdb-44cc-9709-22d71c96cf1b tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:08.348741 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7c9750fd-5bdb-44cc-9709-22d71c96cf1b tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:08.349406 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7c9750fd-5bdb-44cc-9709-22d71c96cf1b tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:08.350475 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7c9750fd-5bdb-44cc-9709-22d71c96cf1b tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:08.351961 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7c9750fd-5bdb-44cc-9709-22d71c96cf1b tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:08.353057 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7c9750fd-5bdb-44cc-9709-22d71c96cf1b tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:08.369418 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-fb6f5226-4bb7-489f-8158-244d2ac07da1 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3ff8d26a3f4831b3ec766bea65e143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98e78e2969a446b8fdbf772b36dd0c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:08.378401 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-fb6f5226-4bb7-489f-8158-244d2ac07da1 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] 10.222.0.33 "GET /compute/v2.1/servers/70213e65-9664-4df1-81d7-747c462fa434" status: 200 len: 1317 microversion: 2.1 time: 0.918335 Sep 23 04:33:08.378997 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 351/668] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:07 2022] GET /compute/v2.1/servers/70213e65-9664-4df1-81d7-747c462fa434 => generated 1317 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:08.380684 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=100 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:33:08.395611 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-697f872f-decc-482f-992c-abd4bd964f3a tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:08.396570 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-697f872f-decc-482f-992c-abd4bd964f3a tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] [instance: 4f54b509-03bd-4fe1-9608-faaae848d5ac] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:08.416073 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-697f872f-decc-482f-992c-abd4bd964f3a tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:08.416586 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-697f872f-decc-482f-992c-abd4bd964f3a tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:08.417026 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-697f872f-decc-482f-992c-abd4bd964f3a tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:08.417749 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-697f872f-decc-482f-992c-abd4bd964f3a tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:08.418242 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-697f872f-decc-482f-992c-abd4bd964f3a tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:08.418877 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-697f872f-decc-482f-992c-abd4bd964f3a tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:09.005059 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=34 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:33:09.051429 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-697f872f-decc-482f-992c-abd4bd964f3a tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c82752e1bc4fdb82e7f8391c7c129f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44352a7a6d964530aa20ae83064b02e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:09.064790 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-697f872f-decc-482f-992c-abd4bd964f3a tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] 10.222.0.33 "GET /compute/v2.1/servers/4f54b509-03bd-4fe1-9608-faaae848d5ac" status: 200 len: 1314 microversion: 2.1 time: 0.684709 Sep 23 04:33:09.066412 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 352/669] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:08 2022] GET /compute/v2.1/servers/4f54b509-03bd-4fe1-9608-faaae848d5ac => generated 1314 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:09.076942 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-f353841f-0a91-499d-b22c-f091f9f91de3 req-148776d7-74f5-4e3e-9311-aa4d6f19d574 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70213e65-9664-4df1-81d7-747c462fa434", "name": "network-vif-plugged", "status": "completed", "tag": "4070aee3-4e6a-47b5-ae56-ad309ddbad7b"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:33:09.102177 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-f353841f-0a91-499d-b22c-f091f9f91de3 req-148776d7-74f5-4e3e-9311-aa4d6f19d574 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:09.103442 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-f353841f-0a91-499d-b22c-f091f9f91de3 req-148776d7-74f5-4e3e-9311-aa4d6f19d574 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:09.104117 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-f353841f-0a91-499d-b22c-f091f9f91de3 req-148776d7-74f5-4e3e-9311-aa4d6f19d574 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:09.123515 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-7c9750fd-5bdb-44cc-9709-22d71c96cf1b tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c8e1e5971342658447b25db5ec1df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9899ca05dc244a70a8bb265366780443', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:09.133875 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-f353841f-0a91-499d-b22c-f091f9f91de3 req-148776d7-74f5-4e3e-9311-aa4d6f19d574 service nova] Creating event network-vif-plugged:4070aee3-4e6a-47b5-ae56-ad309ddbad7b for instance 70213e65-9664-4df1-81d7-747c462fa434 on n-h2-846463-3 Sep 23 04:33:09.140026 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7c9750fd-5bdb-44cc-9709-22d71c96cf1b tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] 10.222.0.33 "GET /compute/v2.1/servers/676f62ac-f8f6-4f47-86f4-6baa8d3dfc4c" status: 200 len: 1322 microversion: 2.1 time: 0.800701 Sep 23 04:33:09.147006 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 318/670] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:08 2022] GET /compute/v2.1/servers/676f62ac-f8f6-4f47-86f4-6baa8d3dfc4c => generated 1322 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:09.150039 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-f353841f-0a91-499d-b22c-f091f9f91de3 req-148776d7-74f5-4e3e-9311-aa4d6f19d574 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082072 Sep 23 04:33:09.156186 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 353/671] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:33:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:33:09.159715 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-ab0d983e-00f9-477e-b673-5a23281c18cc req-a2ec8b14-d0cc-4c99-a51d-748fa99d2f95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "676f62ac-f8f6-4f47-86f4-6baa8d3dfc4c", "tag": "9e0c11d8-d93c-4eec-8faf-5678bbe7e659"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:33:09.171715 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-ab0d983e-00f9-477e-b673-5a23281c18cc req-a2ec8b14-d0cc-4c99-a51d-748fa99d2f95 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:09.173415 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-ab0d983e-00f9-477e-b673-5a23281c18cc req-a2ec8b14-d0cc-4c99-a51d-748fa99d2f95 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:09.173415 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-ab0d983e-00f9-477e-b673-5a23281c18cc req-a2ec8b14-d0cc-4c99-a51d-748fa99d2f95 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:09.194450 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-ab0d983e-00f9-477e-b673-5a23281c18cc req-a2ec8b14-d0cc-4c99-a51d-748fa99d2f95 service nova] Creating event network-changed:9e0c11d8-d93c-4eec-8faf-5678bbe7e659 for instance 676f62ac-f8f6-4f47-86f4-6baa8d3dfc4c on n-h2-846463-3 Sep 23 04:33:09.199753 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-ab0d983e-00f9-477e-b673-5a23281c18cc req-a2ec8b14-d0cc-4c99-a51d-748fa99d2f95 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051094 Sep 23 04:33:09.200743 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 319/672] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:33:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:33:09.356563 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ef10612e-6de1-42ec-a23e-dcd6725c46e0 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:09.357717 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ef10612e-6de1-42ec-a23e-dcd6725c46e0 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: 0dff1738-81f1-4619-af74-44b7adc805b5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:09.368955 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ef10612e-6de1-42ec-a23e-dcd6725c46e0 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:09.372141 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ef10612e-6de1-42ec-a23e-dcd6725c46e0 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:09.377356 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ef10612e-6de1-42ec-a23e-dcd6725c46e0 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:09.377356 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ef10612e-6de1-42ec-a23e-dcd6725c46e0 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:09.377356 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ef10612e-6de1-42ec-a23e-dcd6725c46e0 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:09.380172 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ef10612e-6de1-42ec-a23e-dcd6725c46e0 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:09.403609 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ddc63cf1-a2b4-4705-924f-49b832f2c8df tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:09.409002 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-ddc63cf1-a2b4-4705-924f-49b832f2c8df tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] [instance: 70213e65-9664-4df1-81d7-747c462fa434] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:09.422824 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ddc63cf1-a2b4-4705-924f-49b832f2c8df tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:09.428326 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ddc63cf1-a2b4-4705-924f-49b832f2c8df tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:09.428326 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ddc63cf1-a2b4-4705-924f-49b832f2c8df tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:09.428326 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ddc63cf1-a2b4-4705-924f-49b832f2c8df tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:09.428326 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ddc63cf1-a2b4-4705-924f-49b832f2c8df tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:09.428715 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ddc63cf1-a2b4-4705-924f-49b832f2c8df tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:10.146485 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ddc63cf1-a2b4-4705-924f-49b832f2c8df tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3ff8d26a3f4831b3ec766bea65e143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98e78e2969a446b8fdbf772b36dd0c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:10.148118 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ef10612e-6de1-42ec-a23e-dcd6725c46e0 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:10.158074 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ddc63cf1-a2b4-4705-924f-49b832f2c8df tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] 10.222.0.33 "GET /compute/v2.1/servers/70213e65-9664-4df1-81d7-747c462fa434" status: 200 len: 1317 microversion: 2.1 time: 0.758908 Sep 23 04:33:10.158674 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 320/673] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:09 2022] GET /compute/v2.1/servers/70213e65-9664-4df1-81d7-747c462fa434 => generated 1317 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:33:10.173252 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ef10612e-6de1-42ec-a23e-dcd6725c46e0 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/0dff1738-81f1-4619-af74-44b7adc805b5" status: 200 len: 1476 microversion: 2.1 time: 0.818491 Sep 23 04:33:10.174355 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ad9cb644-f8b5-460a-8572-f1ae8a4ad53e tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:10.175117 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-ad9cb644-f8b5-460a-8572-f1ae8a4ad53e tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] [instance: 4f54b509-03bd-4fe1-9608-faaae848d5ac] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:10.177152 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 354/674] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:09 2022] GET /compute/v2.1/servers/0dff1738-81f1-4619-af74-44b7adc805b5 => generated 1476 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:10.204281 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ad9cb644-f8b5-460a-8572-f1ae8a4ad53e tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:10.208392 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ad9cb644-f8b5-460a-8572-f1ae8a4ad53e tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:10.209061 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ad9cb644-f8b5-460a-8572-f1ae8a4ad53e tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:10.210016 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ad9cb644-f8b5-460a-8572-f1ae8a4ad53e tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:10.214158 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d94006cc-1988-4166-aba2-e44d32f56c73 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:10.214679 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ad9cb644-f8b5-460a-8572-f1ae8a4ad53e tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:10.215289 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ad9cb644-f8b5-460a-8572-f1ae8a4ad53e tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:10.217319 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d94006cc-1988-4166-aba2-e44d32f56c73 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] [instance: 676f62ac-f8f6-4f47-86f4-6baa8d3dfc4c] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:10.243380 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d94006cc-1988-4166-aba2-e44d32f56c73 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:10.244086 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d94006cc-1988-4166-aba2-e44d32f56c73 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:10.244701 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d94006cc-1988-4166-aba2-e44d32f56c73 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:10.245585 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d94006cc-1988-4166-aba2-e44d32f56c73 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:10.246250 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d94006cc-1988-4166-aba2-e44d32f56c73 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:10.246867 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d94006cc-1988-4166-aba2-e44d32f56c73 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:10.663067 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=16 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:33:10.715225 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ad9cb644-f8b5-460a-8572-f1ae8a4ad53e tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c82752e1bc4fdb82e7f8391c7c129f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44352a7a6d964530aa20ae83064b02e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:10.734192 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ad9cb644-f8b5-460a-8572-f1ae8a4ad53e tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] 10.222.0.33 "GET /compute/v2.1/servers/4f54b509-03bd-4fe1-9608-faaae848d5ac" status: 200 len: 1314 microversion: 2.1 time: 0.571825 Sep 23 04:33:10.738330 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 321/675] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:10 2022] GET /compute/v2.1/servers/4f54b509-03bd-4fe1-9608-faaae848d5ac => generated 1314 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:10.778938 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d94006cc-1988-4166-aba2-e44d32f56c73 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c8e1e5971342658447b25db5ec1df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9899ca05dc244a70a8bb265366780443', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:10.787628 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d94006cc-1988-4166-aba2-e44d32f56c73 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] 10.222.0.33 "GET /compute/v2.1/servers/676f62ac-f8f6-4f47-86f4-6baa8d3dfc4c" status: 200 len: 1322 microversion: 2.1 time: 0.609094 Sep 23 04:33:10.798346 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 355/676] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:10 2022] GET /compute/v2.1/servers/676f62ac-f8f6-4f47-86f4-6baa8d3dfc4c => generated 1322 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:10.970090 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-bc5c081a-c5f4-4a8f-b222-d0eaa2fc5934 req-f44e3bb2-8a27-471a-8e15-a69fb232a058 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "205bf02b-1478-4765-b2a6-d7014d9f0a64", "tag": "06cbe8b1-7ee2-495a-8e80-7976cf75b2c6"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:33:10.995784 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-bc5c081a-c5f4-4a8f-b222-d0eaa2fc5934 req-f44e3bb2-8a27-471a-8e15-a69fb232a058 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:10.996678 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-bc5c081a-c5f4-4a8f-b222-d0eaa2fc5934 req-f44e3bb2-8a27-471a-8e15-a69fb232a058 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:10.997351 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-bc5c081a-c5f4-4a8f-b222-d0eaa2fc5934 req-f44e3bb2-8a27-471a-8e15-a69fb232a058 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:11.037615 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-bc5c081a-c5f4-4a8f-b222-d0eaa2fc5934 req-f44e3bb2-8a27-471a-8e15-a69fb232a058 service nova] Creating event network-changed:06cbe8b1-7ee2-495a-8e80-7976cf75b2c6 for instance 205bf02b-1478-4765-b2a6-d7014d9f0a64 on n-h2-846463-3 Sep 23 04:33:11.043488 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-bc5c081a-c5f4-4a8f-b222-d0eaa2fc5934 req-f44e3bb2-8a27-471a-8e15-a69fb232a058 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077693 Sep 23 04:33:11.044516 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 322/677] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:33:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:33:11.183950 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-697ea324-1fa7-4796-9dc0-6e56ed8b1534 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:11.184554 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-697ea324-1fa7-4796-9dc0-6e56ed8b1534 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] [instance: 70213e65-9664-4df1-81d7-747c462fa434] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:11.196203 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-697ea324-1fa7-4796-9dc0-6e56ed8b1534 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:11.205081 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ddc8ced3-9d91-4375-8281-62a41275811d tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:11.206440 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-ddc8ced3-9d91-4375-8281-62a41275811d tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: 0dff1738-81f1-4619-af74-44b7adc805b5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:11.210156 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-697ea324-1fa7-4796-9dc0-6e56ed8b1534 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:11.213637 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-697ea324-1fa7-4796-9dc0-6e56ed8b1534 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:11.214818 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-697ea324-1fa7-4796-9dc0-6e56ed8b1534 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:11.215761 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-697ea324-1fa7-4796-9dc0-6e56ed8b1534 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:11.217274 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-697ea324-1fa7-4796-9dc0-6e56ed8b1534 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:11.222934 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ddc8ced3-9d91-4375-8281-62a41275811d tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:11.223838 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ddc8ced3-9d91-4375-8281-62a41275811d tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:11.228510 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ddc8ced3-9d91-4375-8281-62a41275811d tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:11.229586 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ddc8ced3-9d91-4375-8281-62a41275811d tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:11.232150 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ddc8ced3-9d91-4375-8281-62a41275811d tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:11.232741 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ddc8ced3-9d91-4375-8281-62a41275811d tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:11.612794 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-697ea324-1fa7-4796-9dc0-6e56ed8b1534 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3ff8d26a3f4831b3ec766bea65e143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98e78e2969a446b8fdbf772b36dd0c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:11.622357 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ddc8ced3-9d91-4375-8281-62a41275811d tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:11.650264 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-697ea324-1fa7-4796-9dc0-6e56ed8b1534 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] 10.222.0.33 "GET /compute/v2.1/servers/70213e65-9664-4df1-81d7-747c462fa434" status: 200 len: 1317 microversion: 2.1 time: 0.470876 Sep 23 04:33:11.651845 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 356/678] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:11 2022] GET /compute/v2.1/servers/70213e65-9664-4df1-81d7-747c462fa434 => generated 1317 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:11.652246 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ddc8ced3-9d91-4375-8281-62a41275811d tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/0dff1738-81f1-4619-af74-44b7adc805b5" status: 200 len: 1476 microversion: 2.1 time: 0.453082 Sep 23 04:33:11.655395 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 323/679] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:11 2022] GET /compute/v2.1/servers/0dff1738-81f1-4619-af74-44b7adc805b5 => generated 1476 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:11.688603 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-6bdd6b04-47d4-4963-8b10-b6b4a9ce99cd req-943b1f00-cc4c-4193-839d-ddc5ca154a22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f392741f-f967-4c1c-930b-4eea7272bf64", "name": "network-vif-plugged", "status": "completed", "tag": "a8e6bde0-f854-4040-8b7f-b369ce18b326"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:33:11.721640 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-6bdd6b04-47d4-4963-8b10-b6b4a9ce99cd req-943b1f00-cc4c-4193-839d-ddc5ca154a22 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:11.723810 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-6bdd6b04-47d4-4963-8b10-b6b4a9ce99cd req-943b1f00-cc4c-4193-839d-ddc5ca154a22 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:11.724474 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-6bdd6b04-47d4-4963-8b10-b6b4a9ce99cd req-943b1f00-cc4c-4193-839d-ddc5ca154a22 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:11.743483 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-6bdd6b04-47d4-4963-8b10-b6b4a9ce99cd req-943b1f00-cc4c-4193-839d-ddc5ca154a22 service nova] Creating event network-vif-plugged:a8e6bde0-f854-4040-8b7f-b369ce18b326 for instance f392741f-f967-4c1c-930b-4eea7272bf64 on n-h1-846463-3 Sep 23 04:33:11.752535 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-6bdd6b04-47d4-4963-8b10-b6b4a9ce99cd req-943b1f00-cc4c-4193-839d-ddc5ca154a22 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095296 Sep 23 04:33:11.753778 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 324/680] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:33:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:33:11.761586 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-6812671d-83b5-4358-8bfe-672341aa0878 req-069b4743-2fe2-4906-9b28-9795be596601 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dff1738-81f1-4619-af74-44b7adc805b5", "name": "network-vif-unplugged", "status": "completed", "tag": "583dbaa7-7626-49e7-8e4c-d1e81eea0115"}, {"name": "network-changed", "server_uuid": "0dff1738-81f1-4619-af74-44b7adc805b5", "tag": "583dbaa7-7626-49e7-8e4c-d1e81eea0115"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:33:11.805570 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-6812671d-83b5-4358-8bfe-672341aa0878 req-069b4743-2fe2-4906-9b28-9795be596601 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:11.808083 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-6812671d-83b5-4358-8bfe-672341aa0878 req-069b4743-2fe2-4906-9b28-9795be596601 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:11.808888 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-6812671d-83b5-4358-8bfe-672341aa0878 req-069b4743-2fe2-4906-9b28-9795be596601 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:11.827293 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-6812671d-83b5-4358-8bfe-672341aa0878 req-069b4743-2fe2-4906-9b28-9795be596601 service nova] Creating event network-vif-unplugged:583dbaa7-7626-49e7-8e4c-d1e81eea0115 for instance 0dff1738-81f1-4619-af74-44b7adc805b5 on n-h2-846463-3 Sep 23 04:33:11.828105 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-6812671d-83b5-4358-8bfe-672341aa0878 req-069b4743-2fe2-4906-9b28-9795be596601 service nova] Creating event network-changed:583dbaa7-7626-49e7-8e4c-d1e81eea0115 for instance 0dff1738-81f1-4619-af74-44b7adc805b5 on n-h2-846463-3 Sep 23 04:33:11.842930 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [req-6812671d-83b5-4358-8bfe-672341aa0878 req-069b4743-2fe2-4906-9b28-9795be596601 service nova] Instance 0dff1738-81f1-4619-af74-44b7adc805b5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846463-3', 'n-h2-846463-3'} {{(pid=122698) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 23 04:33:11.856325 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-6812671d-83b5-4358-8bfe-672341aa0878 req-069b4743-2fe2-4906-9b28-9795be596601 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.100135 Sep 23 04:33:11.862424 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 325/681] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:33:11 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:33:11.878309 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-fd5edd89-4b21-493b-8781-92f9b4eb0d91 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:11.881170 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-fd5edd89-4b21-493b-8781-92f9b4eb0d91 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] [instance: 4f54b509-03bd-4fe1-9608-faaae848d5ac] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:11.895179 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fd5edd89-4b21-493b-8781-92f9b4eb0d91 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:11.896746 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fd5edd89-4b21-493b-8781-92f9b4eb0d91 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:11.897537 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fd5edd89-4b21-493b-8781-92f9b4eb0d91 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:11.898632 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fd5edd89-4b21-493b-8781-92f9b4eb0d91 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:11.900059 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fd5edd89-4b21-493b-8781-92f9b4eb0d91 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:11.901016 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fd5edd89-4b21-493b-8781-92f9b4eb0d91 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:11.964835 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2fc021f0-778e-4afd-a702-ab6ec41e0c0c tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-994898854", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "networks": [{"uuid": "5e4e56e0-c3c5-411b-8ef5-0e167200f9bf"}]}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:33:12.042400 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.neutron [None req-2fc021f0-778e-4afd-a702-ab6ec41e0c0c tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] validate_networks() for [('5e4e56e0-c3c5-411b-8ef5-0e167200f9bf', None, None, None, None, None)] {{(pid=122699) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:33:12.659537 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:33:12.694832 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-fd5edd89-4b21-493b-8781-92f9b4eb0d91 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c82752e1bc4fdb82e7f8391c7c129f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44352a7a6d964530aa20ae83064b02e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:12.704196 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-fd5edd89-4b21-493b-8781-92f9b4eb0d91 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] 10.222.0.33 "GET /compute/v2.1/servers/4f54b509-03bd-4fe1-9608-faaae848d5ac" status: 200 len: 1314 microversion: 2.1 time: 0.840503 Sep 23 04:33:12.708273 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 326/682] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:11 2022] GET /compute/v2.1/servers/4f54b509-03bd-4fe1-9608-faaae848d5ac => generated 1314 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:12.725487 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-33042bde-db7e-4e93-9327-97330d81d3fc tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:12.726508 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-33042bde-db7e-4e93-9327-97330d81d3fc tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] [instance: 676f62ac-f8f6-4f47-86f4-6baa8d3dfc4c] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:12.741372 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-33042bde-db7e-4e93-9327-97330d81d3fc tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:12.742173 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-33042bde-db7e-4e93-9327-97330d81d3fc tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:12.742884 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-33042bde-db7e-4e93-9327-97330d81d3fc tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:12.743758 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-33042bde-db7e-4e93-9327-97330d81d3fc tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:12.744387 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-33042bde-db7e-4e93-9327-97330d81d3fc tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:12.745110 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-33042bde-db7e-4e93-9327-97330d81d3fc tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:13.739896 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-33042bde-db7e-4e93-9327-97330d81d3fc tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c8e1e5971342658447b25db5ec1df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9899ca05dc244a70a8bb265366780443', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:13.758809 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-33042bde-db7e-4e93-9327-97330d81d3fc tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] 10.222.0.33 "GET /compute/v2.1/servers/676f62ac-f8f6-4f47-86f4-6baa8d3dfc4c" status: 200 len: 1322 microversion: 2.1 time: 1.049283 Sep 23 04:33:13.759752 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 327/683] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:12 2022] GET /compute/v2.1/servers/676f62ac-f8f6-4f47-86f4-6baa8d3dfc4c => generated 1322 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:13.764376 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ee56a630-8113-4d58-9b6c-61d81cacccc9 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:13.765038 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-ee56a630-8113-4d58-9b6c-61d81cacccc9 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] [instance: 70213e65-9664-4df1-81d7-747c462fa434] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:13.778309 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ee56a630-8113-4d58-9b6c-61d81cacccc9 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:13.779084 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ee56a630-8113-4d58-9b6c-61d81cacccc9 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:13.779690 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ee56a630-8113-4d58-9b6c-61d81cacccc9 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:13.781110 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ee56a630-8113-4d58-9b6c-61d81cacccc9 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:13.782982 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ee56a630-8113-4d58-9b6c-61d81cacccc9 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:13.783586 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ee56a630-8113-4d58-9b6c-61d81cacccc9 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:14.317678 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-2fc021f0-778e-4afd-a702-ab6ec41e0c0c tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Flavor limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:33:14.318934 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-2fc021f0-778e-4afd-a702-ab6ec41e0c0c tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Image limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:33:14.319641 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-2fc021f0-778e-4afd-a702-ab6ec41e0c0c tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Flavor pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:33:14.320298 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-2fc021f0-778e-4afd-a702-ab6ec41e0c0c tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Image pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:33:14.321094 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-2fc021f0-778e-4afd-a702-ab6ec41e0c0c tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:33:14.329675 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ee56a630-8113-4d58-9b6c-61d81cacccc9 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3ff8d26a3f4831b3ec766bea65e143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98e78e2969a446b8fdbf772b36dd0c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:14.338556 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2fc021f0-778e-4afd-a702-ab6ec41e0c0c tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:14.341126 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2fc021f0-778e-4afd-a702-ab6ec41e0c0c tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:14.343492 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ee56a630-8113-4d58-9b6c-61d81cacccc9 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] 10.222.0.33 "GET /compute/v2.1/servers/70213e65-9664-4df1-81d7-747c462fa434" status: 200 len: 1467 microversion: 2.1 time: 0.582158 Sep 23 04:33:14.344135 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2fc021f0-778e-4afd-a702-ab6ec41e0c0c tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:14.357564 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2fc021f0-778e-4afd-a702-ab6ec41e0c0c tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:14.357564 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2fc021f0-778e-4afd-a702-ab6ec41e0c0c tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:14.357564 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2fc021f0-778e-4afd-a702-ab6ec41e0c0c tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:14.358950 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 328/684] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:13 2022] GET /compute/v2.1/servers/70213e65-9664-4df1-81d7-747c462fa434 => generated 1467 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:14.371588 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0ca9c0d5-7081-4d1f-bfad-4d8431d0eca0 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:14.372427 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-0ca9c0d5-7081-4d1f-bfad-4d8431d0eca0 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: 0dff1738-81f1-4619-af74-44b7adc805b5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:14.380006 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0ca9c0d5-7081-4d1f-bfad-4d8431d0eca0 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:14.380738 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0ca9c0d5-7081-4d1f-bfad-4d8431d0eca0 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:14.381648 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0ca9c0d5-7081-4d1f-bfad-4d8431d0eca0 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:14.382675 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0ca9c0d5-7081-4d1f-bfad-4d8431d0eca0 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:14.382941 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-2fc021f0-778e-4afd-a702-ab6ec41e0c0c tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Getting quotas for project 332a996884724d9eb16c79f46107c6af. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:33:14.383460 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0ca9c0d5-7081-4d1f-bfad-4d8431d0eca0 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:14.383893 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0ca9c0d5-7081-4d1f-bfad-4d8431d0eca0 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:14.390762 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-2fc021f0-778e-4afd-a702-ab6ec41e0c0c tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Getting quotas for user 3135a00fc94e488cb633b89d8768fe93 and project 332a996884724d9eb16c79f46107c6af. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:33:14.420395 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-2fc021f0-778e-4afd-a702-ab6ec41e0c0c tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Going to run 1 instances... {{(pid=122699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:33:14.424421 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-2fc021f0-778e-4afd-a702-ab6ec41e0c0c tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] [instance: e5237b14-ce44-43de-ab20-e6e456def723] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:33:14.472661 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:33:14.593455 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-0ca9c0d5-7081-4d1f-bfad-4d8431d0eca0 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:14.598237 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2fc021f0-778e-4afd-a702-ab6ec41e0c0c tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.940660 Sep 23 04:33:14.606061 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0ca9c0d5-7081-4d1f-bfad-4d8431d0eca0 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/0dff1738-81f1-4619-af74-44b7adc805b5" status: 200 len: 1474 microversion: 2.1 time: 0.245169 Sep 23 04:33:14.607279 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 357/685] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:33:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 2953 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:33:14.607658 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 329/686] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:14 2022] GET /compute/v2.1/servers/0dff1738-81f1-4619-af74-44b7adc805b5 => generated 1474 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:14.617788 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d033b8cb-50d3-40aa-b247-6582c9786b94 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:14.618000 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-bdf3a516-f0f7-4eb0-907b-180d1562b136 req-bf778d4d-714d-4733-a8d2-02e57539714e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f54b509-03bd-4fe1-9608-faaae848d5ac", "name": "network-vif-plugged", "status": "completed", "tag": "3ef36ecf-cbc6-4c5b-8a7a-ad331f2db8a3"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:33:14.623223 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d033b8cb-50d3-40aa-b247-6582c9786b94 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] [instance: 4f54b509-03bd-4fe1-9608-faaae848d5ac] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:14.632431 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d033b8cb-50d3-40aa-b247-6582c9786b94 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:14.632941 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d033b8cb-50d3-40aa-b247-6582c9786b94 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:14.633451 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d033b8cb-50d3-40aa-b247-6582c9786b94 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:14.634131 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d033b8cb-50d3-40aa-b247-6582c9786b94 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:14.634770 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d033b8cb-50d3-40aa-b247-6582c9786b94 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:14.635899 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d033b8cb-50d3-40aa-b247-6582c9786b94 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:14.663641 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-bdf3a516-f0f7-4eb0-907b-180d1562b136 req-bf778d4d-714d-4733-a8d2-02e57539714e service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:14.669014 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-bdf3a516-f0f7-4eb0-907b-180d1562b136 req-bf778d4d-714d-4733-a8d2-02e57539714e service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:14.670186 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-bdf3a516-f0f7-4eb0-907b-180d1562b136 req-bf778d4d-714d-4733-a8d2-02e57539714e service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:14.695228 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-bdf3a516-f0f7-4eb0-907b-180d1562b136 req-bf778d4d-714d-4733-a8d2-02e57539714e service nova] Creating event network-vif-plugged:3ef36ecf-cbc6-4c5b-8a7a-ad331f2db8a3 for instance 4f54b509-03bd-4fe1-9608-faaae848d5ac on n-h1-846463-3 Sep 23 04:33:14.706381 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-bdf3a516-f0f7-4eb0-907b-180d1562b136 req-bf778d4d-714d-4733-a8d2-02e57539714e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094419 Sep 23 04:33:14.707058 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 330/687] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:33:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:33:14.713962 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-794de4ca-a90d-4d3d-b65b-665c894f98b2 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-2064688048", "metadata": {"image_type": "test"}}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:33:14.716476 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-794de4ca-a90d-4d3d-b65b-665c894f98b2 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] [instance: 70213e65-9664-4df1-81d7-747c462fa434] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:14.731714 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-794de4ca-a90d-4d3d-b65b-665c894f98b2 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:14.732271 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-794de4ca-a90d-4d3d-b65b-665c894f98b2 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:14.732713 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-794de4ca-a90d-4d3d-b65b-665c894f98b2 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:14.734219 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-794de4ca-a90d-4d3d-b65b-665c894f98b2 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:14.734879 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-794de4ca-a90d-4d3d-b65b-665c894f98b2 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:14.735616 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-794de4ca-a90d-4d3d-b65b-665c894f98b2 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:14.808604 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-794de4ca-a90d-4d3d-b65b-665c894f98b2 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Getting quotas for project f98e78e2969a446b8fdbf772b36dd0c3. Resources: dict_keys(['metadata_items']) {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:33:14.816325 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-794de4ca-a90d-4d3d-b65b-665c894f98b2 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Getting quotas for user cb3ff8d26a3f4831b3ec766bea65e143 and project f98e78e2969a446b8fdbf772b36dd0c3. Resources: dict_keys(['metadata_items']) {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:33:15.018147 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d033b8cb-50d3-40aa-b247-6582c9786b94 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c82752e1bc4fdb82e7f8391c7c129f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44352a7a6d964530aa20ae83064b02e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:15.031654 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d033b8cb-50d3-40aa-b247-6582c9786b94 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] 10.222.0.33 "GET /compute/v2.1/servers/4f54b509-03bd-4fe1-9608-faaae848d5ac" status: 200 len: 1314 microversion: 2.1 time: 0.421188 Sep 23 04:33:15.033724 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 358/688] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:14 2022] GET /compute/v2.1/servers/4f54b509-03bd-4fe1-9608-faaae848d5ac => generated 1314 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:15.038699 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-26fb307b-d84b-4d3f-8fbb-eab82f51bad8 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:15.039696 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-26fb307b-d84b-4d3f-8fbb-eab82f51bad8 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] [instance: e5237b14-ce44-43de-ab20-e6e456def723] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:15.132316 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-26fb307b-d84b-4d3f-8fbb-eab82f51bad8 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3135a00fc94e488cb633b89d8768fe93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332a996884724d9eb16c79f46107c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:15.140926 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-26fb307b-d84b-4d3f-8fbb-eab82f51bad8 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] 10.222.0.33 "GET /compute/v2.1/servers/e5237b14-ce44-43de-ab20-e6e456def723" status: 200 len: 1223 microversion: 2.1 time: 0.105783 Sep 23 04:33:15.143839 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 359/689] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:15 2022] GET /compute/v2.1/servers/e5237b14-ce44-43de-ab20-e6e456def723 => generated 1223 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:15.154033 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d8c0be46-ae9c-4144-94bb-b072ac0f5a78 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:15.154788 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d8c0be46-ae9c-4144-94bb-b072ac0f5a78 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] [instance: 676f62ac-f8f6-4f47-86f4-6baa8d3dfc4c] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:15.168576 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d8c0be46-ae9c-4144-94bb-b072ac0f5a78 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:15.169337 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d8c0be46-ae9c-4144-94bb-b072ac0f5a78 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:15.169904 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d8c0be46-ae9c-4144-94bb-b072ac0f5a78 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:15.172669 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d8c0be46-ae9c-4144-94bb-b072ac0f5a78 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:15.172669 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d8c0be46-ae9c-4144-94bb-b072ac0f5a78 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:15.172669 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d8c0be46-ae9c-4144-94bb-b072ac0f5a78 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:15.354630 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-794de4ca-a90d-4d3d-b65b-665c894f98b2 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] 10.222.0.33 "POST /compute/v2.1/servers/70213e65-9664-4df1-81d7-747c462fa434/action" status: 202 len: 0 microversion: 2.1 time: 0.643091 Sep 23 04:33:15.355486 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 331/690] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:33:14 2022] POST /compute/v2.1/servers/70213e65-9664-4df1-81d7-747c462fa434/action => generated 0 bytes in 648 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 23 04:33:15.369420 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-416b2c84-50ee-48cb-8c93-17516844a15d tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Calling method '.version_select at 0x7ff1c00339d0>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:15.446215 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-416b2c84-50ee-48cb-8c93-17516844a15d tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] 10.222.0.33 "GET /compute/v2.1/images/df3e3bf4-7b42-4c67-9f3e-0d79fa06e685" status: 200 len: 1422 microversion: 2.1 time: 0.081805 Sep 23 04:33:15.448337 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 332/691] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:33:15 2022] GET /compute/v2.1/images/df3e3bf4-7b42-4c67-9f3e-0d79fa06e685 => generated 1422 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:15.632020 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8d357d85-6de5-4cc7-a81b-e221b8a5b494 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:15.632797 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8d357d85-6de5-4cc7-a81b-e221b8a5b494 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: 0dff1738-81f1-4619-af74-44b7adc805b5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:15.656222 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8d357d85-6de5-4cc7-a81b-e221b8a5b494 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:15.660175 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8d357d85-6de5-4cc7-a81b-e221b8a5b494 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:15.661976 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8d357d85-6de5-4cc7-a81b-e221b8a5b494 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:15.667826 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8d357d85-6de5-4cc7-a81b-e221b8a5b494 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:15.669404 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8d357d85-6de5-4cc7-a81b-e221b8a5b494 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:15.671474 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8d357d85-6de5-4cc7-a81b-e221b8a5b494 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:15.874008 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d8c0be46-ae9c-4144-94bb-b072ac0f5a78 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c8e1e5971342658447b25db5ec1df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9899ca05dc244a70a8bb265366780443', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:15.878594 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=100 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:33:15.894363 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d8c0be46-ae9c-4144-94bb-b072ac0f5a78 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] 10.222.0.33 "GET /compute/v2.1/servers/676f62ac-f8f6-4f47-86f4-6baa8d3dfc4c" status: 200 len: 1322 microversion: 2.1 time: 0.738131 Sep 23 04:33:15.895365 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 360/692] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:15 2022] GET /compute/v2.1/servers/676f62ac-f8f6-4f47-86f4-6baa8d3dfc4c => generated 1322 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:16.056069 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b9420b42-085f-49d7-89fa-7e079ea3bd8c tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:16.057082 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b9420b42-085f-49d7-89fa-7e079ea3bd8c tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] [instance: 4f54b509-03bd-4fe1-9608-faaae848d5ac] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:16.070015 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b9420b42-085f-49d7-89fa-7e079ea3bd8c tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:16.070746 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b9420b42-085f-49d7-89fa-7e079ea3bd8c tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:16.071218 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b9420b42-085f-49d7-89fa-7e079ea3bd8c tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:16.072790 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b9420b42-085f-49d7-89fa-7e079ea3bd8c tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:16.073540 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b9420b42-085f-49d7-89fa-7e079ea3bd8c tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:16.075119 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b9420b42-085f-49d7-89fa-7e079ea3bd8c tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:16.170391 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8d357d85-6de5-4cc7-a81b-e221b8a5b494 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:16.179817 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8d357d85-6de5-4cc7-a81b-e221b8a5b494 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/0dff1738-81f1-4619-af74-44b7adc805b5" status: 200 len: 1474 microversion: 2.1 time: 0.551961 Sep 23 04:33:16.181585 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 333/693] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:15 2022] GET /compute/v2.1/servers/0dff1738-81f1-4619-af74-44b7adc805b5 => generated 1474 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:16.190058 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0664f3e5-51e1-40b2-a43e-9c5324614d5d tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:16.203395 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-0664f3e5-51e1-40b2-a43e-9c5324614d5d tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] [instance: e5237b14-ce44-43de-ab20-e6e456def723] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:16.360746 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-0664f3e5-51e1-40b2-a43e-9c5324614d5d tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3135a00fc94e488cb633b89d8768fe93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332a996884724d9eb16c79f46107c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:16.369451 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0664f3e5-51e1-40b2-a43e-9c5324614d5d tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] 10.222.0.33 "GET /compute/v2.1/servers/e5237b14-ce44-43de-ab20-e6e456def723" status: 200 len: 1223 microversion: 2.1 time: 0.185257 Sep 23 04:33:16.370615 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 334/694] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:16 2022] GET /compute/v2.1/servers/e5237b14-ce44-43de-ab20-e6e456def723 => generated 1223 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:16.442646 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b9420b42-085f-49d7-89fa-7e079ea3bd8c tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c82752e1bc4fdb82e7f8391c7c129f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44352a7a6d964530aa20ae83064b02e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:16.454949 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b9420b42-085f-49d7-89fa-7e079ea3bd8c tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] 10.222.0.33 "GET /compute/v2.1/servers/4f54b509-03bd-4fe1-9608-faaae848d5ac" status: 200 len: 1314 microversion: 2.1 time: 0.402633 Sep 23 04:33:16.455704 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 361/695] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:16 2022] GET /compute/v2.1/servers/4f54b509-03bd-4fe1-9608-faaae848d5ac => generated 1314 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:33:16.471135 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-31b26540-314c-4628-8bfd-f2b70a384531 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Calling method '.version_select at 0x7ff1bbec2040>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:16.523598 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-31b26540-314c-4628-8bfd-f2b70a384531 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] 10.222.0.33 "GET /compute/v2.1/images/df3e3bf4-7b42-4c67-9f3e-0d79fa06e685" status: 200 len: 1422 microversion: 2.1 time: 0.056760 Sep 23 04:33:16.526489 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 335/696] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:33:16 2022] GET /compute/v2.1/images/df3e3bf4-7b42-4c67-9f3e-0d79fa06e685 => generated 1422 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:16.920515 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-679d5571-2cae-418c-b8aa-dcea44eb4252 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:16.944484 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-679d5571-2cae-418c-b8aa-dcea44eb4252 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] [instance: 676f62ac-f8f6-4f47-86f4-6baa8d3dfc4c] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:16.944484 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-679d5571-2cae-418c-b8aa-dcea44eb4252 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:16.944484 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-679d5571-2cae-418c-b8aa-dcea44eb4252 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:16.944484 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-679d5571-2cae-418c-b8aa-dcea44eb4252 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:16.945068 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-679d5571-2cae-418c-b8aa-dcea44eb4252 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:16.945259 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-679d5571-2cae-418c-b8aa-dcea44eb4252 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:16.945704 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-679d5571-2cae-418c-b8aa-dcea44eb4252 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:17.172995 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-679d5571-2cae-418c-b8aa-dcea44eb4252 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c8e1e5971342658447b25db5ec1df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9899ca05dc244a70a8bb265366780443', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:17.182830 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-679d5571-2cae-418c-b8aa-dcea44eb4252 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] 10.222.0.33 "GET /compute/v2.1/servers/676f62ac-f8f6-4f47-86f4-6baa8d3dfc4c" status: 200 len: 1322 microversion: 2.1 time: 0.267864 Sep 23 04:33:17.185919 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 362/697] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:16 2022] GET /compute/v2.1/servers/676f62ac-f8f6-4f47-86f4-6baa8d3dfc4c => generated 1322 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:17.207405 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9bbd26fa-0de3-4ad0-b28f-c0b921b6794f tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:17.208102 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-9bbd26fa-0de3-4ad0-b28f-c0b921b6794f tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: 0dff1738-81f1-4619-af74-44b7adc805b5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:17.220339 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9bbd26fa-0de3-4ad0-b28f-c0b921b6794f tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:17.222391 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9bbd26fa-0de3-4ad0-b28f-c0b921b6794f tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:17.223017 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9bbd26fa-0de3-4ad0-b28f-c0b921b6794f tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:17.224026 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9bbd26fa-0de3-4ad0-b28f-c0b921b6794f tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:17.224731 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9bbd26fa-0de3-4ad0-b28f-c0b921b6794f tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:17.225530 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9bbd26fa-0de3-4ad0-b28f-c0b921b6794f tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:17.354556 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e1d02b27-2f2c-4dab-a3e3-11f9213a0822 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:17.355507 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e1d02b27-2f2c-4dab-a3e3-11f9213a0822 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] [instance: 699f43b8-e784-4553-836c-e8785632d903] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:17.363577 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e1d02b27-2f2c-4dab-a3e3-11f9213a0822 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:17.364234 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e1d02b27-2f2c-4dab-a3e3-11f9213a0822 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:17.364681 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e1d02b27-2f2c-4dab-a3e3-11f9213a0822 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:17.365393 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e1d02b27-2f2c-4dab-a3e3-11f9213a0822 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:17.366131 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e1d02b27-2f2c-4dab-a3e3-11f9213a0822 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:17.366719 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e1d02b27-2f2c-4dab-a3e3-11f9213a0822 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:17.400319 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e1d02b27-2f2c-4dab-a3e3-11f9213a0822 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] [instance: 699f43b8-e784-4553-836c-e8785632d903] Going to try to terminate instance {{(pid=122699) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:33:17.543712 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-9bbd26fa-0de3-4ad0-b28f-c0b921b6794f tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:17.572630 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9bbd26fa-0de3-4ad0-b28f-c0b921b6794f tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/0dff1738-81f1-4619-af74-44b7adc805b5" status: 200 len: 1471 microversion: 2.1 time: 0.369008 Sep 23 04:33:17.579607 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 336/698] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:17 2022] GET /compute/v2.1/servers/0dff1738-81f1-4619-af74-44b7adc805b5 => generated 1471 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:17.581137 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0928ae98-2da7-4b97-999d-c7796b1791e2 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:17.584267 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-0928ae98-2da7-4b97-999d-c7796b1791e2 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] [instance: e5237b14-ce44-43de-ab20-e6e456def723] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:17.594274 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0928ae98-2da7-4b97-999d-c7796b1791e2 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:17.595110 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0928ae98-2da7-4b97-999d-c7796b1791e2 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:17.596341 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0928ae98-2da7-4b97-999d-c7796b1791e2 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:17.597275 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0928ae98-2da7-4b97-999d-c7796b1791e2 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:17.597976 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0928ae98-2da7-4b97-999d-c7796b1791e2 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:17.598617 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0928ae98-2da7-4b97-999d-c7796b1791e2 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:17.681720 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-0928ae98-2da7-4b97-999d-c7796b1791e2 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3135a00fc94e488cb633b89d8768fe93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332a996884724d9eb16c79f46107c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:17.700802 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0928ae98-2da7-4b97-999d-c7796b1791e2 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] 10.222.0.33 "GET /compute/v2.1/servers/e5237b14-ce44-43de-ab20-e6e456def723" status: 200 len: 1275 microversion: 2.1 time: 0.123456 Sep 23 04:33:17.702681 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 337/699] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:17 2022] GET /compute/v2.1/servers/e5237b14-ce44-43de-ab20-e6e456def723 => generated 1275 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:17.708108 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-82fe1101-1dfe-4dda-9ce8-7ddd8006613b tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:17.708721 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-82fe1101-1dfe-4dda-9ce8-7ddd8006613b tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] [instance: 4f54b509-03bd-4fe1-9608-faaae848d5ac] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:17.730154 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-82fe1101-1dfe-4dda-9ce8-7ddd8006613b tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:17.730804 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-82fe1101-1dfe-4dda-9ce8-7ddd8006613b tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:17.731466 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-82fe1101-1dfe-4dda-9ce8-7ddd8006613b tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:17.732250 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-82fe1101-1dfe-4dda-9ce8-7ddd8006613b tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:17.732716 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-82fe1101-1dfe-4dda-9ce8-7ddd8006613b tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:17.733176 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-82fe1101-1dfe-4dda-9ce8-7ddd8006613b tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:17.813910 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e1d02b27-2f2c-4dab-a3e3-11f9213a0822 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] 10.222.0.33 "DELETE /compute/v2.1/servers/699f43b8-e784-4553-836c-e8785632d903" status: 204 len: 0 microversion: 2.1 time: 0.464419 Sep 23 04:33:17.815563 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 363/700] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:33:17 2022] DELETE /compute/v2.1/servers/699f43b8-e784-4553-836c-e8785632d903 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:33:17.823461 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5deed11e-2ea1-4eab-9882-397056812ead tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Calling method '.version_select at 0x7ff1c021cd30>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:17.876916 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5deed11e-2ea1-4eab-9882-397056812ead tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] 10.222.0.33 "GET /compute/v2.1/images/df3e3bf4-7b42-4c67-9f3e-0d79fa06e685" status: 200 len: 1422 microversion: 2.1 time: 0.059653 Sep 23 04:33:17.877492 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 364/701] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:33:17 2022] GET /compute/v2.1/images/df3e3bf4-7b42-4c67-9f3e-0d79fa06e685 => generated 1422 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:17.882968 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-471fe55b-ab28-4036-9b6f-bb39207abc20 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:33:17.883811 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-471fe55b-ab28-4036-9b6f-bb39207abc20 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: 0dff1738-81f1-4619-af74-44b7adc805b5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:17.891018 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-471fe55b-ab28-4036-9b6f-bb39207abc20 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:17.891532 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-471fe55b-ab28-4036-9b6f-bb39207abc20 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:17.892415 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-471fe55b-ab28-4036-9b6f-bb39207abc20 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:17.893107 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-471fe55b-ab28-4036-9b6f-bb39207abc20 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:17.893716 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-471fe55b-ab28-4036-9b6f-bb39207abc20 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:17.894331 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-471fe55b-ab28-4036-9b6f-bb39207abc20 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:17.898799 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-82fe1101-1dfe-4dda-9ce8-7ddd8006613b tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c82752e1bc4fdb82e7f8391c7c129f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44352a7a6d964530aa20ae83064b02e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:17.907778 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-82fe1101-1dfe-4dda-9ce8-7ddd8006613b tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] 10.222.0.33 "GET /compute/v2.1/servers/4f54b509-03bd-4fe1-9608-faaae848d5ac" status: 200 len: 1464 microversion: 2.1 time: 0.204029 Sep 23 04:33:17.909237 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 338/702] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:17 2022] GET /compute/v2.1/servers/4f54b509-03bd-4fe1-9608-faaae848d5ac => generated 1464 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:17.914069 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-a518cd1e-b0e6-4bea-981c-998c2bb187db req-07c1086d-60b0-45ee-a99e-ce839c600a05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "676f62ac-f8f6-4f47-86f4-6baa8d3dfc4c", "name": "network-vif-plugged", "status": "completed", "tag": "9e0c11d8-d93c-4eec-8faf-5678bbe7e659"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:33:17.925812 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-a518cd1e-b0e6-4bea-981c-998c2bb187db req-07c1086d-60b0-45ee-a99e-ce839c600a05 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:17.926614 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-a518cd1e-b0e6-4bea-981c-998c2bb187db req-07c1086d-60b0-45ee-a99e-ce839c600a05 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:17.927424 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-a518cd1e-b0e6-4bea-981c-998c2bb187db req-07c1086d-60b0-45ee-a99e-ce839c600a05 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:17.932942 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:33:17.948431 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-a518cd1e-b0e6-4bea-981c-998c2bb187db req-07c1086d-60b0-45ee-a99e-ce839c600a05 service nova] Creating event network-vif-plugged:9e0c11d8-d93c-4eec-8faf-5678bbe7e659 for instance 676f62ac-f8f6-4f47-86f4-6baa8d3dfc4c on n-h2-846463-3 Sep 23 04:33:17.954294 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-a518cd1e-b0e6-4bea-981c-998c2bb187db req-07c1086d-60b0-45ee-a99e-ce839c600a05 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043470 Sep 23 04:33:17.955511 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 339/703] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:33:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:33:17.960870 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c34c9427-4ec9-4b1f-99e6-f5eeb01c9850 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:17.962616 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c34c9427-4ec9-4b1f-99e6-f5eeb01c9850 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] [instance: 699f43b8-e784-4553-836c-e8785632d903] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:17.971061 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c34c9427-4ec9-4b1f-99e6-f5eeb01c9850 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:17.972046 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c34c9427-4ec9-4b1f-99e6-f5eeb01c9850 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:17.972824 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c34c9427-4ec9-4b1f-99e6-f5eeb01c9850 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:17.974170 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c34c9427-4ec9-4b1f-99e6-f5eeb01c9850 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:17.974851 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c34c9427-4ec9-4b1f-99e6-f5eeb01c9850 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:17.978975 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c34c9427-4ec9-4b1f-99e6-f5eeb01c9850 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:18.203530 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-471fe55b-ab28-4036-9b6f-bb39207abc20 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "POST /compute/v2.1/servers/0dff1738-81f1-4619-af74-44b7adc805b5/action" status: 204 len: 0 microversion: 2.1 time: 0.324152 Sep 23 04:33:18.205077 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 365/704] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:33:17 2022] POST /compute/v2.1/servers/0dff1738-81f1-4619-af74-44b7adc805b5/action => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:33:18.226806 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e4b47904-2fa2-4261-908f-1660aca1a25d tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:18.227877 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e4b47904-2fa2-4261-908f-1660aca1a25d tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] [instance: f392741f-f967-4c1c-930b-4eea7272bf64] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:18.238861 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e4b47904-2fa2-4261-908f-1660aca1a25d tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:18.240406 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e4b47904-2fa2-4261-908f-1660aca1a25d tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:18.240884 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e4b47904-2fa2-4261-908f-1660aca1a25d tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:18.241875 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e4b47904-2fa2-4261-908f-1660aca1a25d tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:18.242663 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e4b47904-2fa2-4261-908f-1660aca1a25d tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:18.243193 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e4b47904-2fa2-4261-908f-1660aca1a25d tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:18.259453 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c34c9427-4ec9-4b1f-99e6-f5eeb01c9850 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcc413bf53847b89cfe6bdf48909ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c7c21aa6b342b6bc52365cfdeb7c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:18.293134 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c34c9427-4ec9-4b1f-99e6-f5eeb01c9850 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] 10.222.0.33 "GET /compute/v2.1/servers/699f43b8-e784-4553-836c-e8785632d903" status: 200 len: 1714 microversion: 2.1 time: 0.336190 Sep 23 04:33:18.310994 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 340/705] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:17 2022] GET /compute/v2.1/servers/699f43b8-e784-4553-836c-e8785632d903 => generated 1714 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:18.330133 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e5cd00d9-e192-4842-a974-6762b1a51b8f tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:18.330771 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e5cd00d9-e192-4842-a974-6762b1a51b8f tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] [instance: 676f62ac-f8f6-4f47-86f4-6baa8d3dfc4c] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:18.347584 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e5cd00d9-e192-4842-a974-6762b1a51b8f tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:18.353559 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e5cd00d9-e192-4842-a974-6762b1a51b8f tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:18.353559 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e5cd00d9-e192-4842-a974-6762b1a51b8f tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:18.353559 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e5cd00d9-e192-4842-a974-6762b1a51b8f tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:18.353559 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e5cd00d9-e192-4842-a974-6762b1a51b8f tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:18.354096 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e5cd00d9-e192-4842-a974-6762b1a51b8f tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:18.502469 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e4b47904-2fa2-4261-908f-1660aca1a25d tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c82752e1bc4fdb82e7f8391c7c129f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44352a7a6d964530aa20ae83064b02e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:18.512486 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e4b47904-2fa2-4261-908f-1660aca1a25d tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] 10.222.0.33 "GET /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64" status: 200 len: 1463 microversion: 2.1 time: 0.305873 Sep 23 04:33:18.521988 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 366/706] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:18 2022] GET /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64 => generated 1463 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:18.535396 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0bd3a9f3-5ae5-4109-8730-1f91397b4368 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:18.535895 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-0bd3a9f3-5ae5-4109-8730-1f91397b4368 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: 0dff1738-81f1-4619-af74-44b7adc805b5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:18.551603 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e5cd00d9-e192-4842-a974-6762b1a51b8f tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c8e1e5971342658447b25db5ec1df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9899ca05dc244a70a8bb265366780443', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:18.555380 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0bd3a9f3-5ae5-4109-8730-1f91397b4368 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:18.556057 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0bd3a9f3-5ae5-4109-8730-1f91397b4368 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:18.556446 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0bd3a9f3-5ae5-4109-8730-1f91397b4368 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:18.557353 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0bd3a9f3-5ae5-4109-8730-1f91397b4368 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:18.558208 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0bd3a9f3-5ae5-4109-8730-1f91397b4368 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:18.558786 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0bd3a9f3-5ae5-4109-8730-1f91397b4368 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:18.563306 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e5cd00d9-e192-4842-a974-6762b1a51b8f tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] 10.222.0.33 "GET /compute/v2.1/servers/676f62ac-f8f6-4f47-86f4-6baa8d3dfc4c" status: 200 len: 1322 microversion: 2.1 time: 0.250493 Sep 23 04:33:18.565286 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 341/707] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:18 2022] GET /compute/v2.1/servers/676f62ac-f8f6-4f47-86f4-6baa8d3dfc4c => generated 1322 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:18.700689 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4525e3cb-7405-4c76-915f-595042a83420 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-690697282", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "f392741f-f967-4c1c-930b-4eea7272bf64"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:33:18.787765 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.network.neutron [None req-4525e3cb-7405-4c76-915f-595042a83420 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] validate_networks() for None {{(pid=122698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:33:18.898871 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-0bd3a9f3-5ae5-4109-8730-1f91397b4368 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:18.918372 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0bd3a9f3-5ae5-4109-8730-1f91397b4368 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/0dff1738-81f1-4619-af74-44b7adc805b5" status: 200 len: 1471 microversion: 2.1 time: 0.387165 Sep 23 04:33:18.919398 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 367/708] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:18 2022] GET /compute/v2.1/servers/0dff1738-81f1-4619-af74-44b7adc805b5 => generated 1471 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:18.924394 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e3dd066a-a0ab-4414-92e8-975507c96a51 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:18.931907 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e3dd066a-a0ab-4414-92e8-975507c96a51 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] [instance: e5237b14-ce44-43de-ab20-e6e456def723] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:18.939954 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e3dd066a-a0ab-4414-92e8-975507c96a51 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:18.940515 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e3dd066a-a0ab-4414-92e8-975507c96a51 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:18.941000 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e3dd066a-a0ab-4414-92e8-975507c96a51 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:18.942557 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e3dd066a-a0ab-4414-92e8-975507c96a51 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:18.943033 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e3dd066a-a0ab-4414-92e8-975507c96a51 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:18.943465 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e3dd066a-a0ab-4414-92e8-975507c96a51 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:19.049108 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e3dd066a-a0ab-4414-92e8-975507c96a51 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3135a00fc94e488cb633b89d8768fe93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332a996884724d9eb16c79f46107c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:19.066255 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e3dd066a-a0ab-4414-92e8-975507c96a51 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] 10.222.0.33 "GET /compute/v2.1/servers/e5237b14-ce44-43de-ab20-e6e456def723" status: 200 len: 1281 microversion: 2.1 time: 0.145467 Sep 23 04:33:19.077556 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 368/709] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:18 2022] GET /compute/v2.1/servers/e5237b14-ce44-43de-ab20-e6e456def723 => generated 1281 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:19.089407 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e66e7338-4965-440b-92a8-a308b379eab5 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Calling method '.version_select at 0x7ff1c019eee0>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:19.163487 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e66e7338-4965-440b-92a8-a308b379eab5 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] 10.222.0.33 "GET /compute/v2.1/images/df3e3bf4-7b42-4c67-9f3e-0d79fa06e685" status: 200 len: 1422 microversion: 2.1 time: 0.082831 Sep 23 04:33:19.164243 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 369/710] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:33:19 2022] GET /compute/v2.1/images/df3e3bf4-7b42-4c67-9f3e-0d79fa06e685 => generated 1422 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:19.287569 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-4525e3cb-7405-4c76-915f-595042a83420 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Flavor limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:33:19.289182 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-4525e3cb-7405-4c76-915f-595042a83420 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Image limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:33:19.290564 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-4525e3cb-7405-4c76-915f-595042a83420 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Flavor pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:33:19.290998 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-4525e3cb-7405-4c76-915f-595042a83420 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Image pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:33:19.291430 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-4525e3cb-7405-4c76-915f-595042a83420 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:33:19.312660 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4525e3cb-7405-4c76-915f-595042a83420 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:19.313558 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4525e3cb-7405-4c76-915f-595042a83420 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:19.317275 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4525e3cb-7405-4c76-915f-595042a83420 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:19.319791 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4525e3cb-7405-4c76-915f-595042a83420 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:19.330930 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-70e6aaa8-54f4-4517-a198-0e13664abaf0 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:19.332844 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-70e6aaa8-54f4-4517-a198-0e13664abaf0 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] [instance: 699f43b8-e784-4553-836c-e8785632d903] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:19.337155 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4525e3cb-7405-4c76-915f-595042a83420 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:19.338044 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4525e3cb-7405-4c76-915f-595042a83420 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:19.347191 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-70e6aaa8-54f4-4517-a198-0e13664abaf0 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:19.348049 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-70e6aaa8-54f4-4517-a198-0e13664abaf0 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:19.353326 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-70e6aaa8-54f4-4517-a198-0e13664abaf0 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:19.356442 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-70e6aaa8-54f4-4517-a198-0e13664abaf0 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:19.363332 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-70e6aaa8-54f4-4517-a198-0e13664abaf0 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:19.363332 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-70e6aaa8-54f4-4517-a198-0e13664abaf0 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:19.433768 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-4525e3cb-7405-4c76-915f-595042a83420 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Getting quotas for project 44352a7a6d964530aa20ae83064b02e6. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:33:19.468979 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:33:19.470362 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-4525e3cb-7405-4c76-915f-595042a83420 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Getting quotas for user d1c82752e1bc4fdb82e7f8391c7c129f and project 44352a7a6d964530aa20ae83064b02e6. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:33:19.489136 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4525e3cb-7405-4c76-915f-595042a83420 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Going to run 1 instances... {{(pid=122698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:33:19.492421 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4525e3cb-7405-4c76-915f-595042a83420 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] [instance: 2d2de8ea-1016-4289-994f-59d8742f9b58] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:33:19.643995 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4525e3cb-7405-4c76-915f-595042a83420 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.944360 Sep 23 04:33:19.644728 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 342/711] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:33:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 950 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:33:19.656797 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-bda7455e-16da-44a7-847d-fa361edaa047 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:19.656973 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-bda7455e-16da-44a7-847d-fa361edaa047 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] [instance: 676f62ac-f8f6-4f47-86f4-6baa8d3dfc4c] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:19.697356 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bda7455e-16da-44a7-847d-fa361edaa047 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:19.698802 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bda7455e-16da-44a7-847d-fa361edaa047 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:19.699368 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bda7455e-16da-44a7-847d-fa361edaa047 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:19.701579 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bda7455e-16da-44a7-847d-fa361edaa047 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:19.702788 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bda7455e-16da-44a7-847d-fa361edaa047 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:19.704229 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bda7455e-16da-44a7-847d-fa361edaa047 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:19.742492 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-70e6aaa8-54f4-4517-a198-0e13664abaf0 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcc413bf53847b89cfe6bdf48909ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c7c21aa6b342b6bc52365cfdeb7c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:19.774246 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-70e6aaa8-54f4-4517-a198-0e13664abaf0 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] 10.222.0.33 "GET /compute/v2.1/servers/699f43b8-e784-4553-836c-e8785632d903" status: 200 len: 1714 microversion: 2.1 time: 0.449443 Sep 23 04:33:19.790384 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 370/712] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:19 2022] GET /compute/v2.1/servers/699f43b8-e784-4553-836c-e8785632d903 => generated 1714 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:33:19.797653 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c3eeece4-00cd-4875-80e8-e4ad9b7e410d tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:19.798614 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c3eeece4-00cd-4875-80e8-e4ad9b7e410d tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] [instance: 2d2de8ea-1016-4289-994f-59d8742f9b58] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:19.957728 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c3eeece4-00cd-4875-80e8-e4ad9b7e410d tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c82752e1bc4fdb82e7f8391c7c129f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44352a7a6d964530aa20ae83064b02e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:19.979842 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c3eeece4-00cd-4875-80e8-e4ad9b7e410d tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] 10.222.0.33 "GET /compute/v2.1/servers/2d2de8ea-1016-4289-994f-59d8742f9b58" status: 200 len: 1213 microversion: 2.1 time: 0.187375 Sep 23 04:33:19.980448 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 371/713] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:19 2022] GET /compute/v2.1/servers/2d2de8ea-1016-4289-994f-59d8742f9b58 => generated 1213 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:19.997928 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f6c6da0d-165e-4ecb-831d-e08f992d3e5a tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:19.999475 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f6c6da0d-165e-4ecb-831d-e08f992d3e5a tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: 0dff1738-81f1-4619-af74-44b7adc805b5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:20.007612 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f6c6da0d-165e-4ecb-831d-e08f992d3e5a tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:20.007612 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f6c6da0d-165e-4ecb-831d-e08f992d3e5a tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:20.007612 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f6c6da0d-165e-4ecb-831d-e08f992d3e5a tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:20.018779 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f6c6da0d-165e-4ecb-831d-e08f992d3e5a tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:20.019610 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f6c6da0d-165e-4ecb-831d-e08f992d3e5a tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:20.020217 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f6c6da0d-165e-4ecb-831d-e08f992d3e5a tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:20.157919 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-bda7455e-16da-44a7-847d-fa361edaa047 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c8e1e5971342658447b25db5ec1df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9899ca05dc244a70a8bb265366780443', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:20.168142 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-bda7455e-16da-44a7-847d-fa361edaa047 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] 10.222.0.33 "GET /compute/v2.1/servers/676f62ac-f8f6-4f47-86f4-6baa8d3dfc4c" status: 200 len: 1322 microversion: 2.1 time: 0.518952 Sep 23 04:33:20.175882 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 343/714] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:19 2022] GET /compute/v2.1/servers/676f62ac-f8f6-4f47-86f4-6baa8d3dfc4c => generated 1322 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:20.180918 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-36838c60-0c67-414a-8126-7caddd4adc58 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:20.183887 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-36838c60-0c67-414a-8126-7caddd4adc58 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] [instance: e5237b14-ce44-43de-ab20-e6e456def723] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:20.193547 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-36838c60-0c67-414a-8126-7caddd4adc58 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:20.194353 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-36838c60-0c67-414a-8126-7caddd4adc58 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:20.195226 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-36838c60-0c67-414a-8126-7caddd4adc58 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:20.196650 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-36838c60-0c67-414a-8126-7caddd4adc58 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:20.197229 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-36838c60-0c67-414a-8126-7caddd4adc58 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:20.197822 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-36838c60-0c67-414a-8126-7caddd4adc58 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:20.710364 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f6c6da0d-165e-4ecb-831d-e08f992d3e5a tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:20.718718 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f6c6da0d-165e-4ecb-831d-e08f992d3e5a tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/0dff1738-81f1-4619-af74-44b7adc805b5" status: 200 len: 1471 microversion: 2.1 time: 0.737252 Sep 23 04:33:20.719315 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 372/715] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:19 2022] GET /compute/v2.1/servers/0dff1738-81f1-4619-af74-44b7adc805b5 => generated 1471 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:20.742142 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ff2371da-9f7f-4965-88f5-17220cd202ea tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Calling method '.version_select at 0x7ff1c0049dc0>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:20.810258 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ff2371da-9f7f-4965-88f5-17220cd202ea tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] 10.222.0.33 "GET /compute/v2.1/images/df3e3bf4-7b42-4c67-9f3e-0d79fa06e685" status: 200 len: 1422 microversion: 2.1 time: 0.071868 Sep 23 04:33:20.811490 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 373/716] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:33:20 2022] GET /compute/v2.1/images/df3e3bf4-7b42-4c67-9f3e-0d79fa06e685 => generated 1422 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:20.825654 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1f0cc99c-2c37-41ef-860b-dd7e525202d3 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:20.827953 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1f0cc99c-2c37-41ef-860b-dd7e525202d3 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] [instance: 699f43b8-e784-4553-836c-e8785632d903] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:20.841918 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1f0cc99c-2c37-41ef-860b-dd7e525202d3 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:20.843059 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1f0cc99c-2c37-41ef-860b-dd7e525202d3 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:20.843674 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1f0cc99c-2c37-41ef-860b-dd7e525202d3 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:20.844458 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1f0cc99c-2c37-41ef-860b-dd7e525202d3 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:20.845745 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1f0cc99c-2c37-41ef-860b-dd7e525202d3 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:20.846355 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1f0cc99c-2c37-41ef-860b-dd7e525202d3 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:21.073716 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-36838c60-0c67-414a-8126-7caddd4adc58 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3135a00fc94e488cb633b89d8768fe93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332a996884724d9eb16c79f46107c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:21.097726 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-36838c60-0c67-414a-8126-7caddd4adc58 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] 10.222.0.33 "GET /compute/v2.1/servers/e5237b14-ce44-43de-ab20-e6e456def723" status: 200 len: 1323 microversion: 2.1 time: 0.918466 Sep 23 04:33:21.100979 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 344/717] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:20 2022] GET /compute/v2.1/servers/e5237b14-ce44-43de-ab20-e6e456def723 => generated 1323 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:21.114383 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5114664f-449b-4a47-9831-6262aab6ed3a tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:21.115274 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5114664f-449b-4a47-9831-6262aab6ed3a tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] [instance: 2d2de8ea-1016-4289-994f-59d8742f9b58] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:21.133080 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5114664f-449b-4a47-9831-6262aab6ed3a tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:21.133934 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5114664f-449b-4a47-9831-6262aab6ed3a tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:21.134556 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5114664f-449b-4a47-9831-6262aab6ed3a tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:21.137672 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5114664f-449b-4a47-9831-6262aab6ed3a tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:21.138434 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5114664f-449b-4a47-9831-6262aab6ed3a tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:21.139085 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5114664f-449b-4a47-9831-6262aab6ed3a tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:21.282787 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1f0cc99c-2c37-41ef-860b-dd7e525202d3 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcc413bf53847b89cfe6bdf48909ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c7c21aa6b342b6bc52365cfdeb7c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:21.295041 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1f0cc99c-2c37-41ef-860b-dd7e525202d3 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] 10.222.0.33 "GET /compute/v2.1/servers/699f43b8-e784-4553-836c-e8785632d903" status: 200 len: 1714 microversion: 2.1 time: 0.480388 Sep 23 04:33:21.303671 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 374/718] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:20 2022] GET /compute/v2.1/servers/699f43b8-e784-4553-836c-e8785632d903 => generated 1714 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:21.319194 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-5114664f-449b-4a47-9831-6262aab6ed3a tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c82752e1bc4fdb82e7f8391c7c129f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44352a7a6d964530aa20ae83064b02e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:21.322534 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-3480efc1-c959-4223-a1bb-b58757aeb5ad req-0fd7c6b0-0354-4817-9d71-ab1853e5a850 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dff1738-81f1-4619-af74-44b7adc805b5", "name": "network-vif-plugged", "status": "completed", "tag": "583dbaa7-7626-49e7-8e4c-d1e81eea0115"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:33:21.359319 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-3480efc1-c959-4223-a1bb-b58757aeb5ad req-0fd7c6b0-0354-4817-9d71-ab1853e5a850 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:21.370793 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5114664f-449b-4a47-9831-6262aab6ed3a tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] 10.222.0.33 "GET /compute/v2.1/servers/2d2de8ea-1016-4289-994f-59d8742f9b58" status: 200 len: 1217 microversion: 2.1 time: 0.244016 Sep 23 04:33:21.374644 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 345/719] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:21 2022] GET /compute/v2.1/servers/2d2de8ea-1016-4289-994f-59d8742f9b58 => generated 1217 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:21.376880 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-3480efc1-c959-4223-a1bb-b58757aeb5ad req-0fd7c6b0-0354-4817-9d71-ab1853e5a850 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:21.377923 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-3480efc1-c959-4223-a1bb-b58757aeb5ad req-0fd7c6b0-0354-4817-9d71-ab1853e5a850 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:21.381671 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3e65360a-0eaf-4360-b67b-d53383099c55 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:21.382826 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3e65360a-0eaf-4360-b67b-d53383099c55 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] [instance: 676f62ac-f8f6-4f47-86f4-6baa8d3dfc4c] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:21.424390 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-3480efc1-c959-4223-a1bb-b58757aeb5ad req-0fd7c6b0-0354-4817-9d71-ab1853e5a850 service nova] Creating event network-vif-plugged:583dbaa7-7626-49e7-8e4c-d1e81eea0115 for instance 0dff1738-81f1-4619-af74-44b7adc805b5 on n-h2-846463-3 Sep 23 04:33:21.431173 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3e65360a-0eaf-4360-b67b-d53383099c55 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:21.432292 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3e65360a-0eaf-4360-b67b-d53383099c55 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:21.432937 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-3480efc1-c959-4223-a1bb-b58757aeb5ad req-0fd7c6b0-0354-4817-9d71-ab1853e5a850 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131912 Sep 23 04:33:21.434139 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 375/720] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:33:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:33:21.435250 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3e65360a-0eaf-4360-b67b-d53383099c55 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:21.436908 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3e65360a-0eaf-4360-b67b-d53383099c55 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:21.437391 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3e65360a-0eaf-4360-b67b-d53383099c55 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:21.438050 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3e65360a-0eaf-4360-b67b-d53383099c55 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:21.749123 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b380c8ed-e4ad-4b74-a638-bb77799ba67a tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:21.749864 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b380c8ed-e4ad-4b74-a638-bb77799ba67a tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: 0dff1738-81f1-4619-af74-44b7adc805b5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:21.782338 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b380c8ed-e4ad-4b74-a638-bb77799ba67a tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:21.782861 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b380c8ed-e4ad-4b74-a638-bb77799ba67a tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:21.783306 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b380c8ed-e4ad-4b74-a638-bb77799ba67a tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:21.784041 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b380c8ed-e4ad-4b74-a638-bb77799ba67a tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:21.784497 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b380c8ed-e4ad-4b74-a638-bb77799ba67a tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:21.784922 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b380c8ed-e4ad-4b74-a638-bb77799ba67a tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:21.815644 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-3e65360a-0eaf-4360-b67b-d53383099c55 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c8e1e5971342658447b25db5ec1df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9899ca05dc244a70a8bb265366780443', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:21.827512 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3e65360a-0eaf-4360-b67b-d53383099c55 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] 10.222.0.33 "GET /compute/v2.1/servers/676f62ac-f8f6-4f47-86f4-6baa8d3dfc4c" status: 200 len: 1470 microversion: 2.1 time: 0.450963 Sep 23 04:33:21.828260 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 346/721] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:21 2022] GET /compute/v2.1/servers/676f62ac-f8f6-4f47-86f4-6baa8d3dfc4c => generated 1470 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:21.847788 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-49e1bd7a-72e8-4ac2-9276-19c11c391ad0 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Calling method '.version_select at 0x7ff1bbf10c10>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:21.928164 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-49e1bd7a-72e8-4ac2-9276-19c11c391ad0 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] 10.222.0.33 "GET /compute/v2.1/images/df3e3bf4-7b42-4c67-9f3e-0d79fa06e685" status: 200 len: 1422 microversion: 2.1 time: 0.095829 Sep 23 04:33:21.929076 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 347/722] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:33:21 2022] GET /compute/v2.1/images/df3e3bf4-7b42-4c67-9f3e-0d79fa06e685 => generated 1422 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:21.956736 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-cd3df0ab-e316-4ad7-8085-65dfdfb61ec3 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:21.958520 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-cd3df0ab-e316-4ad7-8085-65dfdfb61ec3 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] [instance: 676f62ac-f8f6-4f47-86f4-6baa8d3dfc4c] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:21.966287 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cd3df0ab-e316-4ad7-8085-65dfdfb61ec3 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:21.967179 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cd3df0ab-e316-4ad7-8085-65dfdfb61ec3 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:21.968179 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cd3df0ab-e316-4ad7-8085-65dfdfb61ec3 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:21.969568 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cd3df0ab-e316-4ad7-8085-65dfdfb61ec3 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:21.970313 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cd3df0ab-e316-4ad7-8085-65dfdfb61ec3 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:21.970968 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cd3df0ab-e316-4ad7-8085-65dfdfb61ec3 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:22.023415 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-cd3df0ab-e316-4ad7-8085-65dfdfb61ec3 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '16c8e1e5971342658447b25db5ec1df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9899ca05dc244a70a8bb265366780443', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:22.023585 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-cd3df0ab-e316-4ad7-8085-65dfdfb61ec3 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Request method failure captured: Sep 23 04:33:22.023585 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/676f62ac-f8f6-4f47-86f4-6baa8d3dfc4c/diagnostics HTTP/1.1 Sep 23 04:33:22.023585 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:33:22.023585 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:33:22.023585 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:33:22.023585 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:33:22.023585 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:33:22.023585 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:33:22.023585 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:33:22.023585 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:33:22.023585 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTb65j6pJ7fhhIlhfkjQ4lNASXwIAP7qhX1TuMF-UhD3xNWwSehK8TE3lDFWb01qwiodK2GRSOn0uFAoJMr5TjXtUfRQRlk27yLcJaMeo0-E2RxXhFLlP8x9GWNRYP2BzvaIZVVeC9cxhdP9_7_goexbCidUmV7u5jFtzNOG2GSu5ZE Sep 23 04:33:22.023585 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:33:22.023585 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:33:22.023585 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:33:22.023585 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:33:22.023585 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:33:22.023585 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:33:22.023585 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 9899ca05dc244a70a8bb265366780443 Sep 23 04:33:22.023585 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1028813486 Sep 23 04:33:22.023585 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:33:22.023585 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:33:22.025255 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9899ca05dc244a70a8bb265366780443", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9899ca05dc244a70a8bb265366780443"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9899ca05dc244a70a8bb265366780443"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9899ca05dc244a70a8bb265366780443"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:33:22.025255 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1028813486 Sep 23 04:33:22.025255 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 9899ca05dc244a70a8bb265366780443 Sep 23 04:33:22.025255 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1028813486 Sep 23 04:33:22.025255 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ServerDiagnosticsNegativeTest-1028813486-project Sep 23 04:33:22.025255 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:33:22.025255 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:33:22.025255 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 16c8e1e5971342658447b25db5ec1df7 Sep 23 04:33:22.025255 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1028813486-project Sep 23 04:33:22.025255 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:33:22.025255 n-d-846463-3 devstack@n-api.service[122698]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Sep 23 04:33:22.026035 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'server_id': '676f62ac-f8f6-4f47-86f4-6baa8d3dfc4c'} Sep 23 04:33:22.026035 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:33:22.026035 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:33:22.026035 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:33:22.026035 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:33:22.026035 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:33:22.026035 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:33:22.026035 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:33:22.026035 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:33:22.026035 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Sep 23 04:33:22.026035 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Sep 23 04:33:22.026035 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 23 04:33:22.026035 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 23 04:33:22.026035 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 23 04:33:22.026035 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 23 04:33:22.026035 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 23 04:33:22.026035 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 23 04:33:22.026035 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 23 04:33:22.026035 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise self.value Sep 23 04:33:22.026035 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 23 04:33:22.027285 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 23 04:33:22.027285 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 23 04:33:22.027285 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 23 04:33:22.027285 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 23 04:33:22.027285 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 23 04:33:22.027285 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Sep 23 04:33:22.027285 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:33:22.027285 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:33:22.027285 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:33:22.027285 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:33:22.027285 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:33:22.027285 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:33:22.027285 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 23 04:33:22.027285 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 23 04:33:22.027285 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Sep 23 04:33:22.027285 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:33:22.027285 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-cd3df0ab-e316-4ad7-8085-65dfdfb61ec3 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:33:22.028321 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-cd3df0ab-e316-4ad7-8085-65dfdfb61ec3 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] 10.222.0.33 "GET /compute/v2.1/servers/676f62ac-f8f6-4f47-86f4-6baa8d3dfc4c/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.096080 Sep 23 04:33:22.028321 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 348/723] 10.222.0.33 () {58 vars in 1272 bytes} [Fri Sep 23 04:33:21 2022] GET /compute/v2.1/servers/676f62ac-f8f6-4f47-86f4-6baa8d3dfc4c/diagnostics => generated 117 bytes in 98 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:33:22.043991 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1ca48415-da7c-4c1e-971a-756499e7c3de tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:22.044619 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-1ca48415-da7c-4c1e-971a-756499e7c3de tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] [instance: 676f62ac-f8f6-4f47-86f4-6baa8d3dfc4c] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:22.053760 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1ca48415-da7c-4c1e-971a-756499e7c3de tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:22.054650 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1ca48415-da7c-4c1e-971a-756499e7c3de tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:22.055300 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1ca48415-da7c-4c1e-971a-756499e7c3de tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:22.056435 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1ca48415-da7c-4c1e-971a-756499e7c3de tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:22.057185 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1ca48415-da7c-4c1e-971a-756499e7c3de tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:22.057841 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1ca48415-da7c-4c1e-971a-756499e7c3de tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:22.103058 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-1ca48415-da7c-4c1e-971a-756499e7c3de tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] [instance: 676f62ac-f8f6-4f47-86f4-6baa8d3dfc4c] Going to try to terminate instance {{(pid=122698) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:33:22.313859 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b380c8ed-e4ad-4b74-a638-bb77799ba67a tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:22.330985 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b380c8ed-e4ad-4b74-a638-bb77799ba67a tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/0dff1738-81f1-4619-af74-44b7adc805b5" status: 200 len: 1463 microversion: 2.1 time: 0.589592 Sep 23 04:33:22.332437 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 376/724] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:21 2022] GET /compute/v2.1/servers/0dff1738-81f1-4619-af74-44b7adc805b5 => generated 1463 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:22.337936 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-41a4a1cd-0f05-490f-af09-f5c958f35552 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:22.338932 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-41a4a1cd-0f05-490f-af09-f5c958f35552 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] [instance: e5237b14-ce44-43de-ab20-e6e456def723] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:22.354931 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-41a4a1cd-0f05-490f-af09-f5c958f35552 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:22.355812 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-41a4a1cd-0f05-490f-af09-f5c958f35552 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:22.356504 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-41a4a1cd-0f05-490f-af09-f5c958f35552 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:22.357450 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-41a4a1cd-0f05-490f-af09-f5c958f35552 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:22.358851 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-41a4a1cd-0f05-490f-af09-f5c958f35552 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:22.359601 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-41a4a1cd-0f05-490f-af09-f5c958f35552 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:22.472644 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-1ca48415-da7c-4c1e-971a-756499e7c3de tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] 10.222.0.33 "DELETE /compute/v2.1/servers/676f62ac-f8f6-4f47-86f4-6baa8d3dfc4c" status: 204 len: 0 microversion: 2.1 time: 0.431728 Sep 23 04:33:22.473610 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 349/725] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:33:22 2022] DELETE /compute/v2.1/servers/676f62ac-f8f6-4f47-86f4-6baa8d3dfc4c => generated 0 bytes in 435 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:33:22.488594 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-be4f2123-c6f2-4c21-b900-e3f4d250111e tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:22.495461 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-be4f2123-c6f2-4c21-b900-e3f4d250111e tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] [instance: 699f43b8-e784-4553-836c-e8785632d903] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:22.527214 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-be4f2123-c6f2-4c21-b900-e3f4d250111e tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:22.531791 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-be4f2123-c6f2-4c21-b900-e3f4d250111e tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:22.535303 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-be4f2123-c6f2-4c21-b900-e3f4d250111e tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:22.541290 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-be4f2123-c6f2-4c21-b900-e3f4d250111e tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:22.543290 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-be4f2123-c6f2-4c21-b900-e3f4d250111e tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:22.544048 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-be4f2123-c6f2-4c21-b900-e3f4d250111e tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:22.730247 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-41a4a1cd-0f05-490f-af09-f5c958f35552 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3135a00fc94e488cb633b89d8768fe93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332a996884724d9eb16c79f46107c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:22.741011 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-41a4a1cd-0f05-490f-af09-f5c958f35552 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] 10.222.0.33 "GET /compute/v2.1/servers/e5237b14-ce44-43de-ab20-e6e456def723" status: 200 len: 1323 microversion: 2.1 time: 0.407319 Sep 23 04:33:22.747469 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 377/726] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:22 2022] GET /compute/v2.1/servers/e5237b14-ce44-43de-ab20-e6e456def723 => generated 1323 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:22.755149 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2e0e246c-6d90-454b-9cc7-689589dd19f3 tempest-MigrationsAdminTest-295231043 tempest-MigrationsAdminTest-295231043-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:22.756408 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-2e0e246c-6d90-454b-9cc7-689589dd19f3 tempest-MigrationsAdminTest-295231043 tempest-MigrationsAdminTest-295231043-project-admin] [instance: 0dff1738-81f1-4619-af74-44b7adc805b5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:22.769945 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2e0e246c-6d90-454b-9cc7-689589dd19f3 tempest-MigrationsAdminTest-295231043 tempest-MigrationsAdminTest-295231043-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:22.777953 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2e0e246c-6d90-454b-9cc7-689589dd19f3 tempest-MigrationsAdminTest-295231043 tempest-MigrationsAdminTest-295231043-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:22.778616 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2e0e246c-6d90-454b-9cc7-689589dd19f3 tempest-MigrationsAdminTest-295231043 tempest-MigrationsAdminTest-295231043-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:22.779535 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2e0e246c-6d90-454b-9cc7-689589dd19f3 tempest-MigrationsAdminTest-295231043 tempest-MigrationsAdminTest-295231043-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:22.780698 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2e0e246c-6d90-454b-9cc7-689589dd19f3 tempest-MigrationsAdminTest-295231043 tempest-MigrationsAdminTest-295231043-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:22.781307 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2e0e246c-6d90-454b-9cc7-689589dd19f3 tempest-MigrationsAdminTest-295231043 tempest-MigrationsAdminTest-295231043-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:23.105521 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2e0e246c-6d90-454b-9cc7-689589dd19f3 tempest-MigrationsAdminTest-295231043 tempest-MigrationsAdminTest-295231043-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/0dff1738-81f1-4619-af74-44b7adc805b5" status: 200 len: 1614 microversion: 2.1 time: 0.356650 Sep 23 04:33:23.111053 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 378/727] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:22 2022] GET /compute/v2.1/servers/0dff1738-81f1-4619-af74-44b7adc805b5 => generated 1614 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:23.117871 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c6aa7d9b-8dfa-4282-bd84-4dc912a058ea tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:23.118585 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c6aa7d9b-8dfa-4282-bd84-4dc912a058ea tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] [instance: 2d2de8ea-1016-4289-994f-59d8742f9b58] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:23.154809 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-be4f2123-c6f2-4c21-b900-e3f4d250111e tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcc413bf53847b89cfe6bdf48909ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c7c21aa6b342b6bc52365cfdeb7c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:23.186090 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c6aa7d9b-8dfa-4282-bd84-4dc912a058ea tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:23.186090 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c6aa7d9b-8dfa-4282-bd84-4dc912a058ea tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:23.186090 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c6aa7d9b-8dfa-4282-bd84-4dc912a058ea tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:23.186090 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c6aa7d9b-8dfa-4282-bd84-4dc912a058ea tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:23.186914 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c6aa7d9b-8dfa-4282-bd84-4dc912a058ea tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:23.186914 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c6aa7d9b-8dfa-4282-bd84-4dc912a058ea tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:23.187647 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-be4f2123-c6f2-4c21-b900-e3f4d250111e tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] 10.222.0.33 "GET /compute/v2.1/servers/699f43b8-e784-4553-836c-e8785632d903" status: 200 len: 1714 microversion: 2.1 time: 0.691673 Sep 23 04:33:23.187647 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 350/728] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:22 2022] GET /compute/v2.1/servers/699f43b8-e784-4553-836c-e8785632d903 => generated 1714 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:23.187647 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7901f0ac-5b44-413e-a5f6-ba386106b1bd tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:23.187647 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7901f0ac-5b44-413e-a5f6-ba386106b1bd tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] [instance: 676f62ac-f8f6-4f47-86f4-6baa8d3dfc4c] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:23.202230 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7901f0ac-5b44-413e-a5f6-ba386106b1bd tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:23.202935 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7901f0ac-5b44-413e-a5f6-ba386106b1bd tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:23.203484 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7901f0ac-5b44-413e-a5f6-ba386106b1bd tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:23.206588 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7901f0ac-5b44-413e-a5f6-ba386106b1bd tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:23.207216 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7901f0ac-5b44-413e-a5f6-ba386106b1bd tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:23.210504 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7901f0ac-5b44-413e-a5f6-ba386106b1bd tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:23.222696 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:33:23.444621 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c6aa7d9b-8dfa-4282-bd84-4dc912a058ea tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c82752e1bc4fdb82e7f8391c7c129f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44352a7a6d964530aa20ae83064b02e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:23.454155 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c6aa7d9b-8dfa-4282-bd84-4dc912a058ea tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] 10.222.0.33 "GET /compute/v2.1/servers/2d2de8ea-1016-4289-994f-59d8742f9b58" status: 200 len: 1265 microversion: 2.1 time: 0.341932 Sep 23 04:33:23.461827 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 379/729] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:23 2022] GET /compute/v2.1/servers/2d2de8ea-1016-4289-994f-59d8742f9b58 => generated 1265 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:23.481050 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7fe7cdd2-4271-4f28-ae1a-9d706f79bac9 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Calling method '.version_select at 0x7ff1c00e30d0>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:23.591932 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-7fe7cdd2-4271-4f28-ae1a-9d706f79bac9 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] 10.222.0.33 "GET /compute/v2.1/images/df3e3bf4-7b42-4c67-9f3e-0d79fa06e685" status: 200 len: 1422 microversion: 2.1 time: 0.128581 Sep 23 04:33:23.594233 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 380/730] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:33:23 2022] GET /compute/v2.1/images/df3e3bf4-7b42-4c67-9f3e-0d79fa06e685 => generated 1422 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:23.602221 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0d85627f-0be1-45b1-8ec1-030fc74b617c tempest-MigrationsAdminTest-295231043 tempest-MigrationsAdminTest-295231043-project-admin] Calling method '.version_select at 0x7ff1c02d5820>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:23.625498 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0d85627f-0be1-45b1-8ec1-030fc74b617c tempest-MigrationsAdminTest-295231043 tempest-MigrationsAdminTest-295231043-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:23.630578 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0d85627f-0be1-45b1-8ec1-030fc74b617c tempest-MigrationsAdminTest-295231043 tempest-MigrationsAdminTest-295231043-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:23.631383 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0d85627f-0be1-45b1-8ec1-030fc74b617c tempest-MigrationsAdminTest-295231043 tempest-MigrationsAdminTest-295231043-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:23.655618 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0d85627f-0be1-45b1-8ec1-030fc74b617c tempest-MigrationsAdminTest-295231043 tempest-MigrationsAdminTest-295231043-project-admin] 10.222.0.33 "GET /compute/v2.1/os-migrations" status: 200 len: 1177 microversion: 2.1 time: 0.059645 Sep 23 04:33:23.661686 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 381/731] 10.222.0.33 () {58 vars in 1143 bytes} [Fri Sep 23 04:33:23 2022] GET /compute/v2.1/os-migrations => generated 1177 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:23.702825 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-b72da7c6-2a40-4f90-a51c-09e9ef2c5843 req-e444a3bd-abfa-496d-ba24-ca529b908e31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5237b14-ce44-43de-ab20-e6e456def723", "tag": "e1b845e7-999a-4e6a-b939-3cf715e6290e"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:33:23.725186 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-b72da7c6-2a40-4f90-a51c-09e9ef2c5843 req-e444a3bd-abfa-496d-ba24-ca529b908e31 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:23.734829 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-b72da7c6-2a40-4f90-a51c-09e9ef2c5843 req-e444a3bd-abfa-496d-ba24-ca529b908e31 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:23.734829 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-b72da7c6-2a40-4f90-a51c-09e9ef2c5843 req-e444a3bd-abfa-496d-ba24-ca529b908e31 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:23.772475 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-b72da7c6-2a40-4f90-a51c-09e9ef2c5843 req-e444a3bd-abfa-496d-ba24-ca529b908e31 service nova] Creating event network-changed:e1b845e7-999a-4e6a-b939-3cf715e6290e for instance e5237b14-ce44-43de-ab20-e6e456def723 on n-h1-846463-3 Sep 23 04:33:23.793593 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-b72da7c6-2a40-4f90-a51c-09e9ef2c5843 req-e444a3bd-abfa-496d-ba24-ca529b908e31 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095826 Sep 23 04:33:23.804396 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 382/732] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:33:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:33:23.816194 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f502361d-9f86-478f-bb0f-e4e2e37e5b0f tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:23.817533 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f502361d-9f86-478f-bb0f-e4e2e37e5b0f tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] [instance: e5237b14-ce44-43de-ab20-e6e456def723] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:23.838005 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f502361d-9f86-478f-bb0f-e4e2e37e5b0f tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:23.838795 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f502361d-9f86-478f-bb0f-e4e2e37e5b0f tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:23.839482 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f502361d-9f86-478f-bb0f-e4e2e37e5b0f tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:23.840453 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f502361d-9f86-478f-bb0f-e4e2e37e5b0f tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:23.841157 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f502361d-9f86-478f-bb0f-e4e2e37e5b0f tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:23.841812 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f502361d-9f86-478f-bb0f-e4e2e37e5b0f tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:24.258412 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f502361d-9f86-478f-bb0f-e4e2e37e5b0f tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3135a00fc94e488cb633b89d8768fe93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332a996884724d9eb16c79f46107c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:24.278973 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f502361d-9f86-478f-bb0f-e4e2e37e5b0f tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] 10.222.0.33 "GET /compute/v2.1/servers/e5237b14-ce44-43de-ab20-e6e456def723" status: 200 len: 1323 microversion: 2.1 time: 0.473044 Sep 23 04:33:24.286500 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 383/733] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:23 2022] GET /compute/v2.1/servers/e5237b14-ce44-43de-ab20-e6e456def723 => generated 1323 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:24.299455 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ccc4d800-82e0-4606-b066-570357587ea0 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1615716318", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:33:24.372282 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:33:24.427155 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.neutron [None req-ccc4d800-82e0-4606-b066-570357587ea0 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] validate_networks() for None {{(pid=122699) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:33:24.452260 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-7901f0ac-5b44-413e-a5f6-ba386106b1bd tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c8e1e5971342658447b25db5ec1df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9899ca05dc244a70a8bb265366780443', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:24.464828 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7901f0ac-5b44-413e-a5f6-ba386106b1bd tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] 10.222.0.33 "GET /compute/v2.1/servers/676f62ac-f8f6-4f47-86f4-6baa8d3dfc4c" status: 200 len: 1476 microversion: 2.1 time: 1.293200 Sep 23 04:33:24.473213 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 351/734] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:23 2022] GET /compute/v2.1/servers/676f62ac-f8f6-4f47-86f4-6baa8d3dfc4c => generated 1476 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:24.481797 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a746a46a-23e1-4555-86bd-ad965c67ee1e tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:24.487478 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a746a46a-23e1-4555-86bd-ad965c67ee1e tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] [instance: 699f43b8-e784-4553-836c-e8785632d903] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:24.514017 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a746a46a-23e1-4555-86bd-ad965c67ee1e tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:24.514893 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a746a46a-23e1-4555-86bd-ad965c67ee1e tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:24.515221 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a746a46a-23e1-4555-86bd-ad965c67ee1e tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:24.524153 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a746a46a-23e1-4555-86bd-ad965c67ee1e tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:24.526287 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a746a46a-23e1-4555-86bd-ad965c67ee1e tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:24.526750 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a746a46a-23e1-4555-86bd-ad965c67ee1e tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:24.693673 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a746a46a-23e1-4555-86bd-ad965c67ee1e tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcc413bf53847b89cfe6bdf48909ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c7c21aa6b342b6bc52365cfdeb7c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:24.716489 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a746a46a-23e1-4555-86bd-ad965c67ee1e tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] 10.222.0.33 "GET /compute/v2.1/servers/699f43b8-e784-4553-836c-e8785632d903" status: 200 len: 1647 microversion: 2.1 time: 0.242056 Sep 23 04:33:24.722097 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 352/735] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:24 2022] GET /compute/v2.1/servers/699f43b8-e784-4553-836c-e8785632d903 => generated 1647 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:24.726950 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a8748155-ef0f-4003-86b5-088f5028f278 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:24.732069 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a8748155-ef0f-4003-86b5-088f5028f278 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] [instance: 2d2de8ea-1016-4289-994f-59d8742f9b58] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:24.742879 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a8748155-ef0f-4003-86b5-088f5028f278 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:24.743343 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a8748155-ef0f-4003-86b5-088f5028f278 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:24.753118 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a8748155-ef0f-4003-86b5-088f5028f278 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:24.753883 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a8748155-ef0f-4003-86b5-088f5028f278 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:24.755043 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a8748155-ef0f-4003-86b5-088f5028f278 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:24.755479 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a8748155-ef0f-4003-86b5-088f5028f278 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:25.381213 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a8748155-ef0f-4003-86b5-088f5028f278 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c82752e1bc4fdb82e7f8391c7c129f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44352a7a6d964530aa20ae83064b02e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:25.395010 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a8748155-ef0f-4003-86b5-088f5028f278 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] 10.222.0.33 "GET /compute/v2.1/servers/2d2de8ea-1016-4289-994f-59d8742f9b58" status: 200 len: 1271 microversion: 2.1 time: 0.671641 Sep 23 04:33:25.396348 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 353/736] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:24 2022] GET /compute/v2.1/servers/2d2de8ea-1016-4289-994f-59d8742f9b58 => generated 1271 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:25.409578 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-f1056f94-209b-4913-b682-8cda91a5226f req-2ec1ca08-89cc-457b-9d03-075515f6fc54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70213e65-9664-4df1-81d7-747c462fa434", "name": "network-vif-plugged", "status": "completed", "tag": "4070aee3-4e6a-47b5-ae56-ad309ddbad7b"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:33:25.432342 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-f1056f94-209b-4913-b682-8cda91a5226f req-2ec1ca08-89cc-457b-9d03-075515f6fc54 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:25.433327 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-f1056f94-209b-4913-b682-8cda91a5226f req-2ec1ca08-89cc-457b-9d03-075515f6fc54 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:25.434858 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-f1056f94-209b-4913-b682-8cda91a5226f req-2ec1ca08-89cc-457b-9d03-075515f6fc54 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:25.462548 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-f1056f94-209b-4913-b682-8cda91a5226f req-2ec1ca08-89cc-457b-9d03-075515f6fc54 service nova] Creating event network-vif-plugged:4070aee3-4e6a-47b5-ae56-ad309ddbad7b for instance 70213e65-9664-4df1-81d7-747c462fa434 on n-h2-846463-3 Sep 23 04:33:25.477809 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-f1056f94-209b-4913-b682-8cda91a5226f req-2ec1ca08-89cc-457b-9d03-075515f6fc54 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079678 Sep 23 04:33:25.478822 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 354/737] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:33:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:33:25.497411 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1f2f79b9-515c-4f70-b0fb-652ca93905f0 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Calling method '.version_select at 0x7ff1bbf93a60>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:25.584413 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-1f2f79b9-515c-4f70-b0fb-652ca93905f0 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] 10.222.0.33 "GET /compute/v2.1/images/df3e3bf4-7b42-4c67-9f3e-0d79fa06e685" status: 200 len: 1422 microversion: 2.1 time: 0.099810 Sep 23 04:33:25.597169 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 355/738] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:33:25 2022] GET /compute/v2.1/images/df3e3bf4-7b42-4c67-9f3e-0d79fa06e685 => generated 1422 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:25.602939 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-43499af1-4340-4d0c-937c-dcffadc0f847 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:25.604280 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-43499af1-4340-4d0c-937c-dcffadc0f847 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] [instance: e5237b14-ce44-43de-ab20-e6e456def723] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:25.612088 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-43499af1-4340-4d0c-937c-dcffadc0f847 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:25.612973 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-43499af1-4340-4d0c-937c-dcffadc0f847 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:25.613700 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-43499af1-4340-4d0c-937c-dcffadc0f847 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:25.614652 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-43499af1-4340-4d0c-937c-dcffadc0f847 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:25.615532 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-43499af1-4340-4d0c-937c-dcffadc0f847 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:25.616168 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-43499af1-4340-4d0c-937c-dcffadc0f847 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:26.026709 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-ccc4d800-82e0-4606-b066-570357587ea0 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Flavor limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:33:26.027728 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-ccc4d800-82e0-4606-b066-570357587ea0 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Image limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:33:26.028672 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-ccc4d800-82e0-4606-b066-570357587ea0 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Flavor pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:33:26.029339 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-ccc4d800-82e0-4606-b066-570357587ea0 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Image pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:33:26.029988 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-ccc4d800-82e0-4606-b066-570357587ea0 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:33:26.054719 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ccc4d800-82e0-4606-b066-570357587ea0 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:26.067629 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ccc4d800-82e0-4606-b066-570357587ea0 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:26.068343 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ccc4d800-82e0-4606-b066-570357587ea0 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:26.068836 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-43499af1-4340-4d0c-937c-dcffadc0f847 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3135a00fc94e488cb633b89d8768fe93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332a996884724d9eb16c79f46107c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:26.069613 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ccc4d800-82e0-4606-b066-570357587ea0 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:26.082285 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ccc4d800-82e0-4606-b066-570357587ea0 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:26.082879 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ccc4d800-82e0-4606-b066-570357587ea0 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:26.083199 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-43499af1-4340-4d0c-937c-dcffadc0f847 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] 10.222.0.33 "GET /compute/v2.1/servers/e5237b14-ce44-43de-ab20-e6e456def723" status: 200 len: 1323 microversion: 2.1 time: 0.481560 Sep 23 04:33:26.083988 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 356/739] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:25 2022] GET /compute/v2.1/servers/e5237b14-ce44-43de-ab20-e6e456def723 => generated 1323 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:26.092603 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7a1940ef-b579-4990-a368-192de1afe135 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:26.093454 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7a1940ef-b579-4990-a368-192de1afe135 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] [instance: 676f62ac-f8f6-4f47-86f4-6baa8d3dfc4c] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:26.103945 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7a1940ef-b579-4990-a368-192de1afe135 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:26.107510 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7a1940ef-b579-4990-a368-192de1afe135 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:26.121122 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7a1940ef-b579-4990-a368-192de1afe135 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:26.124368 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7a1940ef-b579-4990-a368-192de1afe135 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:26.126067 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7a1940ef-b579-4990-a368-192de1afe135 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:26.126978 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7a1940ef-b579-4990-a368-192de1afe135 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:26.151581 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-ccc4d800-82e0-4606-b066-570357587ea0 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Getting quotas for project 54abd267d3c043e09f26f486823907e2. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:33:26.177294 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-ccc4d800-82e0-4606-b066-570357587ea0 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Getting quotas for user 13f5a913548445a09377847fd78a10a1 and project 54abd267d3c043e09f26f486823907e2. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:33:26.226562 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ccc4d800-82e0-4606-b066-570357587ea0 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Going to run 1 instances... {{(pid=122699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:33:26.228911 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ccc4d800-82e0-4606-b066-570357587ea0 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: 09076cfa-4632-43c3-919d-4a8fe1b1bd37] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:33:26.457741 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ccc4d800-82e0-4606-b066-570357587ea0 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.169861 Sep 23 04:33:26.458631 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 384/740] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:33:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 2171 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:33:26.481497 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2c54a5a3-5f48-4ee2-a8e5-b4f435e40b0b tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:26.482255 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-2c54a5a3-5f48-4ee2-a8e5-b4f435e40b0b tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] [instance: 699f43b8-e784-4553-836c-e8785632d903] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:26.526662 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2c54a5a3-5f48-4ee2-a8e5-b4f435e40b0b tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:26.527168 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2c54a5a3-5f48-4ee2-a8e5-b4f435e40b0b tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:26.527620 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2c54a5a3-5f48-4ee2-a8e5-b4f435e40b0b tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:26.528343 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2c54a5a3-5f48-4ee2-a8e5-b4f435e40b0b tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:26.528812 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2c54a5a3-5f48-4ee2-a8e5-b4f435e40b0b tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:26.529245 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2c54a5a3-5f48-4ee2-a8e5-b4f435e40b0b tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:26.533051 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-7a1940ef-b579-4990-a368-192de1afe135 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c8e1e5971342658447b25db5ec1df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9899ca05dc244a70a8bb265366780443', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:26.553918 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7a1940ef-b579-4990-a368-192de1afe135 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] 10.222.0.33 "GET /compute/v2.1/servers/676f62ac-f8f6-4f47-86f4-6baa8d3dfc4c" status: 200 len: 1476 microversion: 2.1 time: 0.468410 Sep 23 04:33:26.554687 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 357/741] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:26 2022] GET /compute/v2.1/servers/676f62ac-f8f6-4f47-86f4-6baa8d3dfc4c => generated 1476 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:26.565652 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-9ccf7f8c-d1bf-42d3-bc00-1adc1c6426a9 req-3317f103-ef21-4fba-a7fc-621ef38dfcc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "699f43b8-e784-4553-836c-e8785632d903", "name": "network-vif-deleted", "tag": "fd2ca279-498d-4084-acfd-485f86ccac66"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:33:26.577916 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-9ccf7f8c-d1bf-42d3-bc00-1adc1c6426a9 req-3317f103-ef21-4fba-a7fc-621ef38dfcc8 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:26.579903 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-9ccf7f8c-d1bf-42d3-bc00-1adc1c6426a9 req-3317f103-ef21-4fba-a7fc-621ef38dfcc8 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:26.579903 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-9ccf7f8c-d1bf-42d3-bc00-1adc1c6426a9 req-3317f103-ef21-4fba-a7fc-621ef38dfcc8 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:26.592654 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-9ccf7f8c-d1bf-42d3-bc00-1adc1c6426a9 req-3317f103-ef21-4fba-a7fc-621ef38dfcc8 service nova] Creating event network-vif-deleted:fd2ca279-498d-4084-acfd-485f86ccac66 for instance 699f43b8-e784-4553-836c-e8785632d903 on n-h2-846463-3 Sep 23 04:33:26.601348 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-9ccf7f8c-d1bf-42d3-bc00-1adc1c6426a9 req-3317f103-ef21-4fba-a7fc-621ef38dfcc8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045391 Sep 23 04:33:26.606419 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 358/742] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:33:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:33:26.618421 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-fcf74fbe-44b6-411b-8b3f-11ed0837d5bb tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:26.620645 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-fcf74fbe-44b6-411b-8b3f-11ed0837d5bb tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] [instance: 2d2de8ea-1016-4289-994f-59d8742f9b58] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:26.633974 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2c54a5a3-5f48-4ee2-a8e5-b4f435e40b0b tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:26.634737 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2c54a5a3-5f48-4ee2-a8e5-b4f435e40b0b tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:26.635346 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2c54a5a3-5f48-4ee2-a8e5-b4f435e40b0b tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:26.637253 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-2c54a5a3-5f48-4ee2-a8e5-b4f435e40b0b tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lazy-loading 'fault' on Instance uuid 699f43b8-e784-4553-836c-e8785632d903 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:33:26.638607 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fcf74fbe-44b6-411b-8b3f-11ed0837d5bb tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:26.642996 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fcf74fbe-44b6-411b-8b3f-11ed0837d5bb tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:26.642996 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fcf74fbe-44b6-411b-8b3f-11ed0837d5bb tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:26.644291 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fcf74fbe-44b6-411b-8b3f-11ed0837d5bb tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:26.646221 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fcf74fbe-44b6-411b-8b3f-11ed0837d5bb tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:26.649784 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fcf74fbe-44b6-411b-8b3f-11ed0837d5bb tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:26.719134 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:33:26.721058 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2c54a5a3-5f48-4ee2-a8e5-b4f435e40b0b tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffcc413bf53847b89cfe6bdf48909ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c7c21aa6b342b6bc52365cfdeb7c7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:26.781682 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2c54a5a3-5f48-4ee2-a8e5-b4f435e40b0b tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] 10.222.0.33 "GET /compute/v2.1/servers/699f43b8-e784-4553-836c-e8785632d903" status: 200 len: 1354 microversion: 2.1 time: 0.322118 Sep 23 04:33:26.786464 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 385/743] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:26 2022] GET /compute/v2.1/servers/699f43b8-e784-4553-836c-e8785632d903 => generated 1354 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:26.798981 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6e330022-233e-4b08-8c77-e360a969d228 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:26.799812 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-6e330022-233e-4b08-8c77-e360a969d228 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: 09076cfa-4632-43c3-919d-4a8fe1b1bd37] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:26.861359 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-fcf74fbe-44b6-411b-8b3f-11ed0837d5bb tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c82752e1bc4fdb82e7f8391c7c129f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44352a7a6d964530aa20ae83064b02e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:26.885618 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-fcf74fbe-44b6-411b-8b3f-11ed0837d5bb tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] 10.222.0.33 "GET /compute/v2.1/servers/2d2de8ea-1016-4289-994f-59d8742f9b58" status: 200 len: 1271 microversion: 2.1 time: 0.273577 Sep 23 04:33:26.885618 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 359/744] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:26 2022] GET /compute/v2.1/servers/2d2de8ea-1016-4289-994f-59d8742f9b58 => generated 1271 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:26.888712 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-84e08ccb-ca75-4409-a012-4804ff90958c tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Calling method '.version_select at 0x7ff1bbf933a0>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:26.943341 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-6e330022-233e-4b08-8c77-e360a969d228 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:26.952513 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6e330022-233e-4b08-8c77-e360a969d228 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/09076cfa-4632-43c3-919d-4a8fe1b1bd37" status: 200 len: 1213 microversion: 2.1 time: 0.166887 Sep 23 04:33:26.954356 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 386/745] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:26 2022] GET /compute/v2.1/servers/09076cfa-4632-43c3-919d-4a8fe1b1bd37 => generated 1213 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:26.958103 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-84e08ccb-ca75-4409-a012-4804ff90958c tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] 10.222.0.33 "GET /compute/v2.1/images/df3e3bf4-7b42-4c67-9f3e-0d79fa06e685" status: 200 len: 1422 microversion: 2.1 time: 0.074930 Sep 23 04:33:26.959090 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 360/746] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:33:26 2022] GET /compute/v2.1/images/df3e3bf4-7b42-4c67-9f3e-0d79fa06e685 => generated 1422 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:26.981552 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-1a8fc2c3-938a-4056-abe9-bfa1c2ead3bb req-c9d0801c-4b58-456e-ae50-936c492da0a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "676f62ac-f8f6-4f47-86f4-6baa8d3dfc4c", "name": "network-vif-deleted", "tag": "9e0c11d8-d93c-4eec-8faf-5678bbe7e659"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:33:27.000616 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-1a8fc2c3-938a-4056-abe9-bfa1c2ead3bb req-c9d0801c-4b58-456e-ae50-936c492da0a4 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:27.001123 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-1a8fc2c3-938a-4056-abe9-bfa1c2ead3bb req-c9d0801c-4b58-456e-ae50-936c492da0a4 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:27.001574 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-1a8fc2c3-938a-4056-abe9-bfa1c2ead3bb req-c9d0801c-4b58-456e-ae50-936c492da0a4 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:27.042887 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-1a8fc2c3-938a-4056-abe9-bfa1c2ead3bb req-c9d0801c-4b58-456e-ae50-936c492da0a4 service nova] Creating event network-vif-deleted:9e0c11d8-d93c-4eec-8faf-5678bbe7e659 for instance 676f62ac-f8f6-4f47-86f4-6baa8d3dfc4c on n-h2-846463-3 Sep 23 04:33:27.054015 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-1a8fc2c3-938a-4056-abe9-bfa1c2ead3bb req-c9d0801c-4b58-456e-ae50-936c492da0a4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096396 Sep 23 04:33:27.056709 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 387/747] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:33:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:33:27.110570 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3413155a-cba2-4742-b280-48a18201e2e7 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:27.111886 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3413155a-cba2-4742-b280-48a18201e2e7 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] [instance: e5237b14-ce44-43de-ab20-e6e456def723] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:27.120966 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3413155a-cba2-4742-b280-48a18201e2e7 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:27.129526 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3413155a-cba2-4742-b280-48a18201e2e7 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:27.130028 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3413155a-cba2-4742-b280-48a18201e2e7 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:27.130810 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3413155a-cba2-4742-b280-48a18201e2e7 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:27.135172 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3413155a-cba2-4742-b280-48a18201e2e7 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:27.135681 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3413155a-cba2-4742-b280-48a18201e2e7 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:27.363556 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-3413155a-cba2-4742-b280-48a18201e2e7 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3135a00fc94e488cb633b89d8768fe93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332a996884724d9eb16c79f46107c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:27.374766 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3413155a-cba2-4742-b280-48a18201e2e7 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] 10.222.0.33 "GET /compute/v2.1/servers/e5237b14-ce44-43de-ab20-e6e456def723" status: 200 len: 1323 microversion: 2.1 time: 0.268294 Sep 23 04:33:27.375969 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 361/748] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:27 2022] GET /compute/v2.1/servers/e5237b14-ce44-43de-ab20-e6e456def723 => generated 1323 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:27.585637 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-665f40b2-f895-4be5-be71-1f951686d233 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:27.586665 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-665f40b2-f895-4be5-be71-1f951686d233 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] [instance: 676f62ac-f8f6-4f47-86f4-6baa8d3dfc4c] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:27.614036 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-665f40b2-f895-4be5-be71-1f951686d233 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:27.614809 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-665f40b2-f895-4be5-be71-1f951686d233 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:27.615479 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-665f40b2-f895-4be5-be71-1f951686d233 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:27.616894 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-665f40b2-f895-4be5-be71-1f951686d233 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:27.617511 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-665f40b2-f895-4be5-be71-1f951686d233 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:27.618216 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-665f40b2-f895-4be5-be71-1f951686d233 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:27.666721 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-665f40b2-f895-4be5-be71-1f951686d233 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:27.667310 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-665f40b2-f895-4be5-be71-1f951686d233 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:27.667947 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-665f40b2-f895-4be5-be71-1f951686d233 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:27.668584 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-665f40b2-f895-4be5-be71-1f951686d233 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Lazy-loading 'fault' on Instance uuid 676f62ac-f8f6-4f47-86f4-6baa8d3dfc4c {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:33:27.812156 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8d63e75c-8c23-43aa-ab22-dee5531ddbc4 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:27.817127 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8d63e75c-8c23-43aa-ab22-dee5531ddbc4 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] [instance: 699f43b8-e784-4553-836c-e8785632d903] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:27.838641 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8d63e75c-8c23-43aa-ab22-dee5531ddbc4 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:27.840915 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8d63e75c-8c23-43aa-ab22-dee5531ddbc4 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:27.845488 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8d63e75c-8c23-43aa-ab22-dee5531ddbc4 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:27.848382 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8d63e75c-8c23-43aa-ab22-dee5531ddbc4 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:27.851950 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8d63e75c-8c23-43aa-ab22-dee5531ddbc4 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:27.853220 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8d63e75c-8c23-43aa-ab22-dee5531ddbc4 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:27.858377 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-665f40b2-f895-4be5-be71-1f951686d233 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16c8e1e5971342658447b25db5ec1df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9899ca05dc244a70a8bb265366780443', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:27.884902 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-665f40b2-f895-4be5-be71-1f951686d233 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] 10.222.0.33 "GET /compute/v2.1/servers/676f62ac-f8f6-4f47-86f4-6baa8d3dfc4c" status: 200 len: 1312 microversion: 2.1 time: 0.305446 Sep 23 04:33:27.885525 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 388/749] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:27 2022] GET /compute/v2.1/servers/676f62ac-f8f6-4f47-86f4-6baa8d3dfc4c => generated 1312 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:27.890650 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-8d63e75c-8c23-43aa-ab22-dee5531ddbc4 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] HTTP exception thrown: Instance 699f43b8-e784-4553-836c-e8785632d903 could not be found. Sep 23 04:33:27.893342 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8d63e75c-8c23-43aa-ab22-dee5531ddbc4 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Request method failure captured: Sep 23 04:33:27.893342 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/699f43b8-e784-4553-836c-e8785632d903 HTTP/1.1 Sep 23 04:33:27.893342 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:33:27.893342 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:33:27.893342 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:33:27.893342 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:33:27.893342 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:33:27.893342 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:33:27.893342 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:33:27.893342 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:33:27.893342 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTZ_53wuFk5N-xHONjU-0gvWg3fGR1E5PnlNXvFFh1aHBuFbSYKfyFikN29cV5tVhTFEo6q4yrMTeSIrGKDhUHlJGuquss8x1NPwuQVOOfjKfcbgKDHnSWpwPYy-JgLQsWj9EE9J6HDNxwo3wIYS1171KDtK_UMdMYjfUJWh2XPTk10 Sep 23 04:33:27.893342 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:33:27.893342 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:33:27.893342 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:33:27.893342 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:33:27.893342 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:33:27.893342 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:33:27.893342 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 98c7c21aa6b342b6bc52365cfdeb7c7b Sep 23 04:33:27.893342 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-867564724 Sep 23 04:33:27.893342 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:33:27.893342 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:33:27.894930 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_98c7c21aa6b342b6bc52365cfdeb7c7b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/98c7c21aa6b342b6bc52365cfdeb7c7b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/98c7c21aa6b342b6bc52365cfdeb7c7b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/98c7c21aa6b342b6bc52365cfdeb7c7b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:33:27.894930 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-867564724 Sep 23 04:33:27.894930 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 98c7c21aa6b342b6bc52365cfdeb7c7b Sep 23 04:33:27.894930 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-867564724 Sep 23 04:33:27.894930 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ServersWithSpecificFlavorTestJSON-867564724-project Sep 23 04:33:27.894930 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:33:27.894930 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:33:27.894930 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: ffcc413bf53847b89cfe6bdf48909ea0 Sep 23 04:33:27.894930 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-867564724-project Sep 23 04:33:27.894930 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:33:27.894930 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 699f43b8-e784-4553-836c-e8785632d903 could not be found. Sep 23 04:33:27.894930 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '699f43b8-e784-4553-836c-e8785632d903'} Sep 23 04:33:27.895830 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:33:27.895830 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:33:27.895830 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:33:27.895830 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:33:27.895830 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:33:27.895830 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:33:27.895830 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:33:27.895830 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:33:27.895830 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:33:27.895830 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:33:27.895830 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 699f43b8-e784-4553-836c-e8785632d903 could not be found. Sep 23 04:33:27.895830 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:33:27.895830 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:33:27.895830 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:33:27.895830 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:33:27.895830 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:33:27.895830 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:33:27.895830 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:33:27.895830 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:33:27.895830 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:33:27.897303 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:33:27.897303 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:33:27.897303 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:33:27.897303 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:33:27.897303 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:33:27.897303 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:33:27.897303 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:33:27.897303 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 699f43b8-e784-4553-836c-e8785632d903 could not be found. Sep 23 04:33:27.897303 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:33:27.897303 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:33:27.897303 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:33:27.897303 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:33:27.897303 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:33:27.897303 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:33:27.897303 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:33:27.897303 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:33:27.897303 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 699f43b8-e784-4553-836c-e8785632d903 could not be found. Sep 23 04:33:27.897303 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:33:27.899930 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8d63e75c-8c23-43aa-ab22-dee5531ddbc4 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Returning 404 to user: Instance 699f43b8-e784-4553-836c-e8785632d903 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:33:27.901691 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8d63e75c-8c23-43aa-ab22-dee5531ddbc4 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] 10.222.0.33 "GET /compute/v2.1/servers/699f43b8-e784-4553-836c-e8785632d903" status: 404 len: 111 microversion: 2.1 time: 0.098528 Sep 23 04:33:27.902908 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 362/750] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:27 2022] GET /compute/v2.1/servers/699f43b8-e784-4553-836c-e8785632d903 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:33:27.908204 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5b4f9ab6-d86b-4f3c-beab-8ddc8ebe9634 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:27.909057 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-5b4f9ab6-d86b-4f3c-beab-8ddc8ebe9634 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] [instance: 2d2de8ea-1016-4289-994f-59d8742f9b58] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:27.912559 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8f61a1d6-157b-49a7-9e14-bdf18ca03829 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:27.913216 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8f61a1d6-157b-49a7-9e14-bdf18ca03829 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] [instance: 074ac5a1-94af-4e9d-b458-107710ca0972] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:27.919661 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8f61a1d6-157b-49a7-9e14-bdf18ca03829 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:27.920589 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8f61a1d6-157b-49a7-9e14-bdf18ca03829 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:27.921556 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8f61a1d6-157b-49a7-9e14-bdf18ca03829 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:27.922768 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8f61a1d6-157b-49a7-9e14-bdf18ca03829 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:27.924213 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8f61a1d6-157b-49a7-9e14-bdf18ca03829 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:27.924855 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8f61a1d6-157b-49a7-9e14-bdf18ca03829 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:27.925080 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5b4f9ab6-d86b-4f3c-beab-8ddc8ebe9634 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:27.925593 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5b4f9ab6-d86b-4f3c-beab-8ddc8ebe9634 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:27.926465 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5b4f9ab6-d86b-4f3c-beab-8ddc8ebe9634 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:27.927191 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5b4f9ab6-d86b-4f3c-beab-8ddc8ebe9634 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:27.927658 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5b4f9ab6-d86b-4f3c-beab-8ddc8ebe9634 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:27.928091 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5b4f9ab6-d86b-4f3c-beab-8ddc8ebe9634 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:27.946992 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-8f61a1d6-157b-49a7-9e14-bdf18ca03829 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] HTTP exception thrown: Instance 074ac5a1-94af-4e9d-b458-107710ca0972 could not be found. Sep 23 04:33:27.948943 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8f61a1d6-157b-49a7-9e14-bdf18ca03829 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Request method failure captured: Sep 23 04:33:27.948943 n-d-846463-3 devstack@n-api.service[122698]: request: DELETE /compute/v2.1/servers/074ac5a1-94af-4e9d-b458-107710ca0972 HTTP/1.1 Sep 23 04:33:27.948943 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:33:27.948943 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:33:27.948943 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:33:27.948943 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:33:27.948943 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:33:27.948943 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:33:27.948943 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:33:27.948943 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:33:27.948943 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTZ_53wuFk5N-xHONjU-0gvWg3fGR1E5PnlNXvFFh1aHBuFbSYKfyFikN29cV5tVhTFEo6q4yrMTeSIrGKDhUHlJGuquss8x1NPwuQVOOfjKfcbgKDHnSWpwPYy-JgLQsWj9EE9J6HDNxwo3wIYS1171KDtK_UMdMYjfUJWh2XPTk10 Sep 23 04:33:27.948943 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:33:27.948943 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:33:27.948943 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:33:27.948943 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:33:27.948943 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:33:27.948943 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:33:27.948943 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 98c7c21aa6b342b6bc52365cfdeb7c7b Sep 23 04:33:27.948943 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-867564724 Sep 23 04:33:27.948943 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:33:27.948943 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:33:27.950263 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_98c7c21aa6b342b6bc52365cfdeb7c7b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/98c7c21aa6b342b6bc52365cfdeb7c7b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/98c7c21aa6b342b6bc52365cfdeb7c7b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/98c7c21aa6b342b6bc52365cfdeb7c7b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:33:27.950263 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-867564724 Sep 23 04:33:27.950263 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 98c7c21aa6b342b6bc52365cfdeb7c7b Sep 23 04:33:27.950263 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-867564724 Sep 23 04:33:27.950263 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ServersWithSpecificFlavorTestJSON-867564724-project Sep 23 04:33:27.950263 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:33:27.950263 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:33:27.950263 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: ffcc413bf53847b89cfe6bdf48909ea0 Sep 23 04:33:27.950263 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-867564724-project Sep 23 04:33:27.950263 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:33:27.950263 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 074ac5a1-94af-4e9d-b458-107710ca0972 could not be found. Sep 23 04:33:27.950263 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '074ac5a1-94af-4e9d-b458-107710ca0972'} Sep 23 04:33:27.950980 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:33:27.950980 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:33:27.950980 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:33:27.950980 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:33:27.950980 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:33:27.950980 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:33:27.950980 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:33:27.950980 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:33:27.950980 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:33:27.950980 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:33:27.950980 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 074ac5a1-94af-4e9d-b458-107710ca0972 could not be found. Sep 23 04:33:27.950980 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:33:27.950980 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:33:27.950980 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:33:27.950980 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:33:27.950980 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:33:27.950980 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:33:27.950980 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:33:27.950980 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:33:27.950980 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:33:27.952803 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:33:27.952803 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 04:33:27.952803 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 04:33:27.952803 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 04:33:27.952803 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 04:33:27.952803 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:33:27.952803 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:33:27.952803 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:33:27.952803 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:33:27.952803 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 074ac5a1-94af-4e9d-b458-107710ca0972 could not be found. Sep 23 04:33:27.952803 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:33:27.952803 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:33:27.952803 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:33:27.952803 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:33:27.952803 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:33:27.952803 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:33:27.952803 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:33:27.952803 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:33:27.952803 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 074ac5a1-94af-4e9d-b458-107710ca0972 could not be found. Sep 23 04:33:27.952803 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:33:27.966783 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8f61a1d6-157b-49a7-9e14-bdf18ca03829 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Returning 404 to user: Instance 074ac5a1-94af-4e9d-b458-107710ca0972 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:33:27.967701 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8f61a1d6-157b-49a7-9e14-bdf18ca03829 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] 10.222.0.33 "DELETE /compute/v2.1/servers/074ac5a1-94af-4e9d-b458-107710ca0972" status: 404 len: 111 microversion: 2.1 time: 0.059714 Sep 23 04:33:27.968274 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 363/751] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:33:27 2022] DELETE /compute/v2.1/servers/074ac5a1-94af-4e9d-b458-107710ca0972 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 04:33:27.984301 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-66aca2bf-e207-49af-8c4b-9f3a0d67ea06 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Calling method '.version_select at 0x7ff1bbe87040>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:28.039483 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-66aca2bf-e207-49af-8c4b-9f3a0d67ea06 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] 10.222.0.33 "GET /compute/v2.1/images/df3e3bf4-7b42-4c67-9f3e-0d79fa06e685" status: 200 len: 1422 microversion: 2.1 time: 0.069686 Sep 23 04:33:28.048391 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 364/752] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:33:27 2022] GET /compute/v2.1/images/df3e3bf4-7b42-4c67-9f3e-0d79fa06e685 => generated 1422 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:28.053582 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6bcd28f0-58b4-42af-a6fe-a40a30319d2d tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:28.054406 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-6bcd28f0-58b4-42af-a6fe-a40a30319d2d tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] [instance: 074ac5a1-94af-4e9d-b458-107710ca0972] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:28.061858 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6bcd28f0-58b4-42af-a6fe-a40a30319d2d tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:28.062599 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6bcd28f0-58b4-42af-a6fe-a40a30319d2d tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:28.063222 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6bcd28f0-58b4-42af-a6fe-a40a30319d2d tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:28.064108 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6bcd28f0-58b4-42af-a6fe-a40a30319d2d tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:28.064729 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6bcd28f0-58b4-42af-a6fe-a40a30319d2d tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:28.065511 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6bcd28f0-58b4-42af-a6fe-a40a30319d2d tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:28.084674 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-6bcd28f0-58b4-42af-a6fe-a40a30319d2d tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] HTTP exception thrown: Instance 074ac5a1-94af-4e9d-b458-107710ca0972 could not be found. Sep 23 04:33:28.086869 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6bcd28f0-58b4-42af-a6fe-a40a30319d2d tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Request method failure captured: Sep 23 04:33:28.086869 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/074ac5a1-94af-4e9d-b458-107710ca0972 HTTP/1.1 Sep 23 04:33:28.086869 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:33:28.086869 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:33:28.086869 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:33:28.086869 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:33:28.086869 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:33:28.086869 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:33:28.086869 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:33:28.086869 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:33:28.086869 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTZ_53wuFk5N-xHONjU-0gvWg3fGR1E5PnlNXvFFh1aHBuFbSYKfyFikN29cV5tVhTFEo6q4yrMTeSIrGKDhUHlJGuquss8x1NPwuQVOOfjKfcbgKDHnSWpwPYy-JgLQsWj9EE9J6HDNxwo3wIYS1171KDtK_UMdMYjfUJWh2XPTk10 Sep 23 04:33:28.086869 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:33:28.086869 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:33:28.086869 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:33:28.086869 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:33:28.086869 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:33:28.086869 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:33:28.086869 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 98c7c21aa6b342b6bc52365cfdeb7c7b Sep 23 04:33:28.086869 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-867564724 Sep 23 04:33:28.086869 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:33:28.086869 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:33:28.090484 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_98c7c21aa6b342b6bc52365cfdeb7c7b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/98c7c21aa6b342b6bc52365cfdeb7c7b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/98c7c21aa6b342b6bc52365cfdeb7c7b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/98c7c21aa6b342b6bc52365cfdeb7c7b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:33:28.090484 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-867564724 Sep 23 04:33:28.090484 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 98c7c21aa6b342b6bc52365cfdeb7c7b Sep 23 04:33:28.090484 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-867564724 Sep 23 04:33:28.090484 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ServersWithSpecificFlavorTestJSON-867564724-project Sep 23 04:33:28.090484 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:33:28.090484 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:33:28.090484 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: ffcc413bf53847b89cfe6bdf48909ea0 Sep 23 04:33:28.090484 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-867564724-project Sep 23 04:33:28.090484 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:33:28.090484 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 074ac5a1-94af-4e9d-b458-107710ca0972 could not be found. Sep 23 04:33:28.090484 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '074ac5a1-94af-4e9d-b458-107710ca0972'} Sep 23 04:33:28.091345 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:33:28.091345 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:33:28.091345 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:33:28.091345 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:33:28.091345 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:33:28.091345 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:33:28.091345 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:33:28.091345 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:33:28.091345 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:33:28.091345 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:33:28.091345 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 074ac5a1-94af-4e9d-b458-107710ca0972 could not be found. Sep 23 04:33:28.091345 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:33:28.091345 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:33:28.091345 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:33:28.091345 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:33:28.091345 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:33:28.091345 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:33:28.091345 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:33:28.091345 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:33:28.091345 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:33:28.094931 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:33:28.094931 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:33:28.094931 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:33:28.094931 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:33:28.094931 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:33:28.094931 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:33:28.094931 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:33:28.094931 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 074ac5a1-94af-4e9d-b458-107710ca0972 could not be found. Sep 23 04:33:28.094931 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:33:28.094931 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:33:28.094931 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:33:28.094931 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:33:28.094931 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:33:28.094931 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:33:28.094931 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:33:28.094931 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:33:28.094931 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 074ac5a1-94af-4e9d-b458-107710ca0972 could not be found. Sep 23 04:33:28.094931 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:33:28.096152 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6bcd28f0-58b4-42af-a6fe-a40a30319d2d tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Returning 404 to user: Instance 074ac5a1-94af-4e9d-b458-107710ca0972 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:33:28.096152 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-6bcd28f0-58b4-42af-a6fe-a40a30319d2d tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] 10.222.0.33 "GET /compute/v2.1/servers/074ac5a1-94af-4e9d-b458-107710ca0972" status: 404 len: 111 microversion: 2.1 time: 0.038829 Sep 23 04:33:28.097207 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 365/753] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:28 2022] GET /compute/v2.1/servers/074ac5a1-94af-4e9d-b458-107710ca0972 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:33:28.103903 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-536f0080-44e0-48c2-85e8-182b04e6c1ef tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:28.104745 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-536f0080-44e0-48c2-85e8-182b04e6c1ef tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: 09076cfa-4632-43c3-919d-4a8fe1b1bd37] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:28.184978 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-536f0080-44e0-48c2-85e8-182b04e6c1ef tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:28.216739 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-536f0080-44e0-48c2-85e8-182b04e6c1ef tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/09076cfa-4632-43c3-919d-4a8fe1b1bd37" status: 200 len: 1213 microversion: 2.1 time: 0.101969 Sep 23 04:33:28.216835 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-5b4f9ab6-d86b-4f3c-beab-8ddc8ebe9634 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c82752e1bc4fdb82e7f8391c7c129f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44352a7a6d964530aa20ae83064b02e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:28.223729 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5b4f9ab6-d86b-4f3c-beab-8ddc8ebe9634 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] 10.222.0.33 "GET /compute/v2.1/servers/2d2de8ea-1016-4289-994f-59d8742f9b58" status: 200 len: 1313 microversion: 2.1 time: 0.322793 Sep 23 04:33:28.224015 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 366/754] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:28 2022] GET /compute/v2.1/servers/09076cfa-4632-43c3-919d-4a8fe1b1bd37 => generated 1213 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:28.229663 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 389/755] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:27 2022] GET /compute/v2.1/servers/2d2de8ea-1016-4289-994f-59d8742f9b58 => generated 1313 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:28.234581 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b6ca88cb-ca7d-4032-a95d-bdb3356ce262 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Calling method '.version_select at 0x7ff1bbe87160>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:28.358438 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b6ca88cb-ca7d-4032-a95d-bdb3356ce262 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-587713181" status: 202 len: 0 microversion: 2.1 time: 0.132917 Sep 23 04:33:28.359393 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 367/756] 10.222.0.33 () {58 vars in 1218 bytes} [Fri Sep 23 04:33:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-587713181 => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:33:28.398215 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2f4dce33-5287-4636-a874-9c22f3bcf3ac tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:28.398915 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-2f4dce33-5287-4636-a874-9c22f3bcf3ac tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] [instance: e5237b14-ce44-43de-ab20-e6e456def723] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:28.407666 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2f4dce33-5287-4636-a874-9c22f3bcf3ac tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:28.410513 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2f4dce33-5287-4636-a874-9c22f3bcf3ac tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:28.410968 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2f4dce33-5287-4636-a874-9c22f3bcf3ac tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:28.411702 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2f4dce33-5287-4636-a874-9c22f3bcf3ac tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:28.414430 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2f4dce33-5287-4636-a874-9c22f3bcf3ac tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:28.414886 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2f4dce33-5287-4636-a874-9c22f3bcf3ac tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:28.905524 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2f4dce33-5287-4636-a874-9c22f3bcf3ac tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3135a00fc94e488cb633b89d8768fe93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332a996884724d9eb16c79f46107c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:28.915839 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7c07883a-4a25-49c8-a6c2-2b1fa9acbbf3 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:28.916461 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7c07883a-4a25-49c8-a6c2-2b1fa9acbbf3 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] [instance: 676f62ac-f8f6-4f47-86f4-6baa8d3dfc4c] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:28.918923 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2f4dce33-5287-4636-a874-9c22f3bcf3ac tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] 10.222.0.33 "GET /compute/v2.1/servers/e5237b14-ce44-43de-ab20-e6e456def723" status: 200 len: 1323 microversion: 2.1 time: 0.524783 Sep 23 04:33:28.929465 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 390/757] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:28 2022] GET /compute/v2.1/servers/e5237b14-ce44-43de-ab20-e6e456def723 => generated 1323 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:28.944876 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7c07883a-4a25-49c8-a6c2-2b1fa9acbbf3 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:28.945452 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7c07883a-4a25-49c8-a6c2-2b1fa9acbbf3 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:28.945859 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7c07883a-4a25-49c8-a6c2-2b1fa9acbbf3 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:28.946622 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7c07883a-4a25-49c8-a6c2-2b1fa9acbbf3 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:28.948626 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7c07883a-4a25-49c8-a6c2-2b1fa9acbbf3 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:28.950156 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7c07883a-4a25-49c8-a6c2-2b1fa9acbbf3 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:28.968856 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-7c07883a-4a25-49c8-a6c2-2b1fa9acbbf3 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] HTTP exception thrown: Instance 676f62ac-f8f6-4f47-86f4-6baa8d3dfc4c could not be found. Sep 23 04:33:28.970794 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7c07883a-4a25-49c8-a6c2-2b1fa9acbbf3 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Request method failure captured: Sep 23 04:33:28.970794 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/676f62ac-f8f6-4f47-86f4-6baa8d3dfc4c HTTP/1.1 Sep 23 04:33:28.970794 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:33:28.970794 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:33:28.970794 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:33:28.970794 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:33:28.970794 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:33:28.970794 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:33:28.970794 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:33:28.970794 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:33:28.970794 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTb65j6pJ7fhhIlhfkjQ4lNASXwIAP7qhX1TuMF-UhD3xNWwSehK8TE3lDFWb01qwiodK2GRSOn0uFAoJMr5TjXtUfRQRlk27yLcJaMeo0-E2RxXhFLlP8x9GWNRYP2BzvaIZVVeC9cxhdP9_7_goexbCidUmV7u5jFtzNOG2GSu5ZE Sep 23 04:33:28.970794 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:33:28.970794 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:33:28.970794 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:33:28.970794 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:33:28.970794 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:33:28.970794 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:33:28.970794 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 9899ca05dc244a70a8bb265366780443 Sep 23 04:33:28.970794 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1028813486 Sep 23 04:33:28.970794 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:33:28.970794 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:33:28.972327 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9899ca05dc244a70a8bb265366780443", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9899ca05dc244a70a8bb265366780443"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9899ca05dc244a70a8bb265366780443"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9899ca05dc244a70a8bb265366780443"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:33:28.972327 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1028813486 Sep 23 04:33:28.972327 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 9899ca05dc244a70a8bb265366780443 Sep 23 04:33:28.972327 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1028813486 Sep 23 04:33:28.972327 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ServerDiagnosticsNegativeTest-1028813486-project Sep 23 04:33:28.972327 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:33:28.972327 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:33:28.972327 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 16c8e1e5971342658447b25db5ec1df7 Sep 23 04:33:28.972327 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1028813486-project Sep 23 04:33:28.972327 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:33:28.972327 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 676f62ac-f8f6-4f47-86f4-6baa8d3dfc4c could not be found. Sep 23 04:33:28.972327 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '676f62ac-f8f6-4f47-86f4-6baa8d3dfc4c'} Sep 23 04:33:28.973177 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:33:28.973177 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:33:28.973177 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:33:28.973177 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:33:28.973177 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:33:28.973177 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:33:28.973177 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:33:28.973177 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:33:28.973177 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:33:28.973177 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:33:28.973177 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 676f62ac-f8f6-4f47-86f4-6baa8d3dfc4c could not be found. Sep 23 04:33:28.973177 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:33:28.973177 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:33:28.973177 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:33:28.973177 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:33:28.973177 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:33:28.973177 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:33:28.973177 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:33:28.973177 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:33:28.973177 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:33:28.974603 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:33:28.974603 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:33:28.974603 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:33:28.974603 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:33:28.974603 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:33:28.974603 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:33:28.974603 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:33:28.974603 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 676f62ac-f8f6-4f47-86f4-6baa8d3dfc4c could not be found. Sep 23 04:33:28.974603 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:33:28.974603 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:33:28.974603 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:33:28.974603 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:33:28.974603 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:33:28.974603 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:33:28.974603 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:33:28.974603 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:33:28.974603 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 676f62ac-f8f6-4f47-86f4-6baa8d3dfc4c could not be found. Sep 23 04:33:28.974603 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:33:28.976822 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7c07883a-4a25-49c8-a6c2-2b1fa9acbbf3 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] Returning 404 to user: Instance 676f62ac-f8f6-4f47-86f4-6baa8d3dfc4c could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:33:28.977839 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7c07883a-4a25-49c8-a6c2-2b1fa9acbbf3 tempest-ServerDiagnosticsNegativeTest-1028813486 tempest-ServerDiagnosticsNegativeTest-1028813486-project] 10.222.0.33 "GET /compute/v2.1/servers/676f62ac-f8f6-4f47-86f4-6baa8d3dfc4c" status: 404 len: 111 microversion: 2.1 time: 0.066694 Sep 23 04:33:28.978978 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 368/758] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:28 2022] GET /compute/v2.1/servers/676f62ac-f8f6-4f47-86f4-6baa8d3dfc4c => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 04:33:29.055268 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0032eeb9-d2fa-48d8-afbe-8d7f90e324dd tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Calling method '.version_select at 0x7ff1c00eab80>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:29.146366 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0032eeb9-d2fa-48d8-afbe-8d7f90e324dd tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] 10.222.0.33 "GET /compute/v2.1/images/df3e3bf4-7b42-4c67-9f3e-0d79fa06e685" status: 200 len: 1422 microversion: 2.1 time: 0.094881 Sep 23 04:33:29.156301 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 391/759] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:33:29 2022] GET /compute/v2.1/images/df3e3bf4-7b42-4c67-9f3e-0d79fa06e685 => generated 1422 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:29.232578 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2926de63-b0a3-4481-880c-bf13565d5fd7 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:29.234641 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-2926de63-b0a3-4481-880c-bf13565d5fd7 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: 09076cfa-4632-43c3-919d-4a8fe1b1bd37] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:29.247303 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2926de63-b0a3-4481-880c-bf13565d5fd7 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:29.250112 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2926de63-b0a3-4481-880c-bf13565d5fd7 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:29.251779 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2926de63-b0a3-4481-880c-bf13565d5fd7 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:29.254029 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2926de63-b0a3-4481-880c-bf13565d5fd7 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:29.254807 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2926de63-b0a3-4481-880c-bf13565d5fd7 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:29.256506 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2926de63-b0a3-4481-880c-bf13565d5fd7 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:29.259310 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1be7346e-4c79-4b21-a14e-31d44cbd1bdf tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:29.260518 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1be7346e-4c79-4b21-a14e-31d44cbd1bdf tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] [instance: 2d2de8ea-1016-4289-994f-59d8742f9b58] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:29.272085 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1be7346e-4c79-4b21-a14e-31d44cbd1bdf tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:29.275509 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1be7346e-4c79-4b21-a14e-31d44cbd1bdf tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:29.281564 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1be7346e-4c79-4b21-a14e-31d44cbd1bdf tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:29.282633 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1be7346e-4c79-4b21-a14e-31d44cbd1bdf tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:29.284244 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1be7346e-4c79-4b21-a14e-31d44cbd1bdf tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:29.288190 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1be7346e-4c79-4b21-a14e-31d44cbd1bdf tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:29.380399 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:33:29.518926 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-2926de63-b0a3-4481-880c-bf13565d5fd7 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:29.531185 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2926de63-b0a3-4481-880c-bf13565d5fd7 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/09076cfa-4632-43c3-919d-4a8fe1b1bd37" status: 200 len: 1265 microversion: 2.1 time: 0.304954 Sep 23 04:33:29.547437 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 369/760] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:29 2022] GET /compute/v2.1/servers/09076cfa-4632-43c3-919d-4a8fe1b1bd37 => generated 1265 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:29.636755 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1be7346e-4c79-4b21-a14e-31d44cbd1bdf tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c82752e1bc4fdb82e7f8391c7c129f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44352a7a6d964530aa20ae83064b02e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:29.650402 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1be7346e-4c79-4b21-a14e-31d44cbd1bdf tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] 10.222.0.33 "GET /compute/v2.1/servers/2d2de8ea-1016-4289-994f-59d8742f9b58" status: 200 len: 1313 microversion: 2.1 time: 0.393847 Sep 23 04:33:29.651195 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 392/761] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:29 2022] GET /compute/v2.1/servers/2d2de8ea-1016-4289-994f-59d8742f9b58 => generated 1313 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:29.949339 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a694272d-e7e4-4446-b5d7-7de3fadf252b tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:29.950883 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a694272d-e7e4-4446-b5d7-7de3fadf252b tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] [instance: e5237b14-ce44-43de-ab20-e6e456def723] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:29.964843 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a694272d-e7e4-4446-b5d7-7de3fadf252b tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:29.969688 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a694272d-e7e4-4446-b5d7-7de3fadf252b tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:29.976224 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a694272d-e7e4-4446-b5d7-7de3fadf252b tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:29.977169 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a694272d-e7e4-4446-b5d7-7de3fadf252b tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:29.982528 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a694272d-e7e4-4446-b5d7-7de3fadf252b tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:29.984477 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a694272d-e7e4-4446-b5d7-7de3fadf252b tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:30.153876 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-b458baba-f924-4105-a429-844c18ac2c6f req-802280c0-e01d-4014-99b8-e5dd74c308a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d2de8ea-1016-4289-994f-59d8742f9b58", "tag": "a1b3b8d8-27ea-471f-96fe-fbc5172fee43"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:33:30.172970 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-b458baba-f924-4105-a429-844c18ac2c6f req-802280c0-e01d-4014-99b8-e5dd74c308a0 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:30.175931 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-b458baba-f924-4105-a429-844c18ac2c6f req-802280c0-e01d-4014-99b8-e5dd74c308a0 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:30.176374 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-b458baba-f924-4105-a429-844c18ac2c6f req-802280c0-e01d-4014-99b8-e5dd74c308a0 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:30.203403 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-b458baba-f924-4105-a429-844c18ac2c6f req-802280c0-e01d-4014-99b8-e5dd74c308a0 service nova] Creating event network-changed:a1b3b8d8-27ea-471f-96fe-fbc5172fee43 for instance 2d2de8ea-1016-4289-994f-59d8742f9b58 on n-h1-846463-3 Sep 23 04:33:30.213179 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-b458baba-f924-4105-a429-844c18ac2c6f req-802280c0-e01d-4014-99b8-e5dd74c308a0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062823 Sep 23 04:33:30.213797 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 393/762] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:33:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:33:30.230810 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-daa10117-d811-4928-a255-75c33d8b798b tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Calling method '.version_select at 0x7ff1bbf84b80>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:30.340640 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-daa10117-d811-4928-a255-75c33d8b798b tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] 10.222.0.33 "GET /compute/v2.1/images/df3e3bf4-7b42-4c67-9f3e-0d79fa06e685" status: 200 len: 1422 microversion: 2.1 time: 0.125600 Sep 23 04:33:30.351970 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 394/763] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:33:30 2022] GET /compute/v2.1/images/df3e3bf4-7b42-4c67-9f3e-0d79fa06e685 => generated 1422 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:30.379971 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a694272d-e7e4-4446-b5d7-7de3fadf252b tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3135a00fc94e488cb633b89d8768fe93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332a996884724d9eb16c79f46107c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:30.392143 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a694272d-e7e4-4446-b5d7-7de3fadf252b tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] 10.222.0.33 "GET /compute/v2.1/servers/e5237b14-ce44-43de-ab20-e6e456def723" status: 200 len: 1323 microversion: 2.1 time: 0.447099 Sep 23 04:33:30.414304 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 370/764] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:29 2022] GET /compute/v2.1/servers/e5237b14-ce44-43de-ab20-e6e456def723 => generated 1323 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:30.556057 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8719578e-8c1c-4b6e-afb8-4bfc38eaad77 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:30.557168 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-8719578e-8c1c-4b6e-afb8-4bfc38eaad77 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: 09076cfa-4632-43c3-919d-4a8fe1b1bd37] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:30.575437 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8719578e-8c1c-4b6e-afb8-4bfc38eaad77 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:30.580490 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8719578e-8c1c-4b6e-afb8-4bfc38eaad77 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:30.581193 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8719578e-8c1c-4b6e-afb8-4bfc38eaad77 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:30.583612 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8719578e-8c1c-4b6e-afb8-4bfc38eaad77 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:30.584264 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8719578e-8c1c-4b6e-afb8-4bfc38eaad77 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:30.591166 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-db9dc58e-3c97-4421-8426-4d169f0b1c93 tempest-ServersWithSpecificFlavorTestJSON-390767506 tempest-ServersWithSpecificFlavorTestJSON-390767506-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:30.612812 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8719578e-8c1c-4b6e-afb8-4bfc38eaad77 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:30.763144 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-8719578e-8c1c-4b6e-afb8-4bfc38eaad77 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:30.763573 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-db9dc58e-3c97-4421-8426-4d169f0b1c93 tempest-ServersWithSpecificFlavorTestJSON-390767506 tempest-ServersWithSpecificFlavorTestJSON-390767506-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/320083998" status: 202 len: 0 microversion: 2.1 time: 0.176984 Sep 23 04:33:30.764198 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 371/765] 10.222.0.33 () {58 vars in 1158 bytes} [Fri Sep 23 04:33:30 2022] DELETE /compute/v2.1/flavors/320083998 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 23 04:33:30.771472 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-37dd71d6-3f6a-4264-8cc1-abde27129990 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:30.811103 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-37dd71d6-3f6a-4264-8cc1-abde27129990 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] [instance: 2d2de8ea-1016-4289-994f-59d8742f9b58] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:30.812124 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-8719578e-8c1c-4b6e-afb8-4bfc38eaad77 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/09076cfa-4632-43c3-919d-4a8fe1b1bd37" status: 200 len: 1283 microversion: 2.1 time: 0.237558 Sep 23 04:33:30.812124 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 395/766] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:30 2022] GET /compute/v2.1/servers/09076cfa-4632-43c3-919d-4a8fe1b1bd37 => generated 1283 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:30.812124 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1159a661-1262-4755-bad5-01aa736be04b tempest-ServersWithSpecificFlavorTestJSON-390767506 tempest-ServersWithSpecificFlavorTestJSON-390767506-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:30.812337 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-37dd71d6-3f6a-4264-8cc1-abde27129990 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:30.812337 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-37dd71d6-3f6a-4264-8cc1-abde27129990 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:30.812337 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-37dd71d6-3f6a-4264-8cc1-abde27129990 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:30.812337 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-37dd71d6-3f6a-4264-8cc1-abde27129990 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:30.812609 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-37dd71d6-3f6a-4264-8cc1-abde27129990 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:30.812609 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-37dd71d6-3f6a-4264-8cc1-abde27129990 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:30.892455 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1159a661-1262-4755-bad5-01aa736be04b tempest-ServersWithSpecificFlavorTestJSON-390767506 tempest-ServersWithSpecificFlavorTestJSON-390767506-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5406 microversion: 2.1 time: 0.093233 Sep 23 04:33:30.907130 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 396/767] 10.222.0.33 () {58 vars in 1146 bytes} [Fri Sep 23 04:33:30 2022] GET /compute/v2.1/flavors/detail => generated 5406 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:30.922560 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-482a1159-dbd2-43e2-b174-7f55d1c26e01 tempest-ServersWithSpecificFlavorTestJSON-390767506 tempest-ServersWithSpecificFlavorTestJSON-390767506-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:30.964007 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:33:31.174652 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-37dd71d6-3f6a-4264-8cc1-abde27129990 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c82752e1bc4fdb82e7f8391c7c129f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44352a7a6d964530aa20ae83064b02e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:31.193792 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-37dd71d6-3f6a-4264-8cc1-abde27129990 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] 10.222.0.33 "GET /compute/v2.1/servers/2d2de8ea-1016-4289-994f-59d8742f9b58" status: 200 len: 1313 microversion: 2.1 time: 0.428513 Sep 23 04:33:31.195046 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 372/768] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:30 2022] GET /compute/v2.1/servers/2d2de8ea-1016-4289-994f-59d8742f9b58 => generated 1313 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:31.356864 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-08882e98-ab9c-4403-b4ed-d8a846705286 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Calling method '.version_select at 0x7ff1bbe84940>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:31.425650 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-08882e98-ab9c-4403-b4ed-d8a846705286 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] 10.222.0.33 "GET /compute/v2.1/images/df3e3bf4-7b42-4c67-9f3e-0d79fa06e685" status: 200 len: 1422 microversion: 2.1 time: 0.072741 Sep 23 04:33:31.426913 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 373/769] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:33:31 2022] GET /compute/v2.1/images/df3e3bf4-7b42-4c67-9f3e-0d79fa06e685 => generated 1422 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:31.439503 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6e2da8f5-435e-4231-a304-9946324c3671 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:31.440347 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-6e2da8f5-435e-4231-a304-9946324c3671 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] [instance: e5237b14-ce44-43de-ab20-e6e456def723] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:31.445758 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-482a1159-dbd2-43e2-b174-7f55d1c26e01 tempest-ServersWithSpecificFlavorTestJSON-390767506 tempest-ServersWithSpecificFlavorTestJSON-390767506-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/1110633300" status: 202 len: 0 microversion: 2.1 time: 0.534007 Sep 23 04:33:31.445758 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 397/770] 10.222.0.33 () {58 vars in 1161 bytes} [Fri Sep 23 04:33:30 2022] DELETE /compute/v2.1/flavors/1110633300 => generated 0 bytes in 535 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:33:31.450249 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6e2da8f5-435e-4231-a304-9946324c3671 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:31.451093 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6e2da8f5-435e-4231-a304-9946324c3671 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:31.452352 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6e2da8f5-435e-4231-a304-9946324c3671 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:31.453222 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6e2da8f5-435e-4231-a304-9946324c3671 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:31.455969 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6e2da8f5-435e-4231-a304-9946324c3671 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:31.456946 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6e2da8f5-435e-4231-a304-9946324c3671 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:31.464853 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-685d9d87-fa7c-4ca6-ac7b-cc821679874c tempest-ServersWithSpecificFlavorTestJSON-390767506 tempest-ServersWithSpecificFlavorTestJSON-390767506-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:31.526707 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-685d9d87-fa7c-4ca6-ac7b-cc821679874c tempest-ServersWithSpecificFlavorTestJSON-390767506 tempest-ServersWithSpecificFlavorTestJSON-390767506-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.070858 Sep 23 04:33:31.534421 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 398/771] 10.222.0.33 () {58 vars in 1146 bytes} [Fri Sep 23 04:33:31 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:31.565702 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ee66da5e-8063-45cd-a969-cce9e0e0e42d tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:31.566239 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ee66da5e-8063-45cd-a969-cce9e0e0e42d tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] [instance: 699f43b8-e784-4553-836c-e8785632d903] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:31.572735 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ee66da5e-8063-45cd-a969-cce9e0e0e42d tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:31.573243 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ee66da5e-8063-45cd-a969-cce9e0e0e42d tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:31.573680 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ee66da5e-8063-45cd-a969-cce9e0e0e42d tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:31.574689 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ee66da5e-8063-45cd-a969-cce9e0e0e42d tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:31.575485 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ee66da5e-8063-45cd-a969-cce9e0e0e42d tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:31.576150 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ee66da5e-8063-45cd-a969-cce9e0e0e42d tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:31.609435 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-ee66da5e-8063-45cd-a969-cce9e0e0e42d tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] HTTP exception thrown: Instance 699f43b8-e784-4553-836c-e8785632d903 could not be found. Sep 23 04:33:31.609435 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ee66da5e-8063-45cd-a969-cce9e0e0e42d tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Request method failure captured: Sep 23 04:33:31.609435 n-d-846463-3 devstack@n-api.service[122699]: request: DELETE /compute/v2.1/servers/699f43b8-e784-4553-836c-e8785632d903 HTTP/1.1 Sep 23 04:33:31.609435 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:33:31.609435 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:33:31.609435 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:33:31.609435 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:33:31.609435 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:33:31.609435 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:33:31.609435 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:33:31.609435 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:33:31.609435 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTZ_53wuFk5N-xHONjU-0gvWg3fGR1E5PnlNXvFFh1aHBuFbSYKfyFikN29cV5tVhTFEo6q4yrMTeSIrGKDhUHlJGuquss8x1NPwuQVOOfjKfcbgKDHnSWpwPYy-JgLQsWj9EE9J6HDNxwo3wIYS1171KDtK_UMdMYjfUJWh2XPTk10 Sep 23 04:33:31.609435 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:33:31.609435 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:33:31.609435 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:33:31.609435 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:33:31.609435 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:33:31.609435 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:33:31.609435 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 98c7c21aa6b342b6bc52365cfdeb7c7b Sep 23 04:33:31.609435 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-867564724 Sep 23 04:33:31.609435 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:33:31.609435 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:33:31.611447 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_98c7c21aa6b342b6bc52365cfdeb7c7b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/98c7c21aa6b342b6bc52365cfdeb7c7b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/98c7c21aa6b342b6bc52365cfdeb7c7b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/98c7c21aa6b342b6bc52365cfdeb7c7b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:33:31.611447 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-867564724 Sep 23 04:33:31.611447 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 98c7c21aa6b342b6bc52365cfdeb7c7b Sep 23 04:33:31.611447 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-867564724 Sep 23 04:33:31.611447 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ServersWithSpecificFlavorTestJSON-867564724-project Sep 23 04:33:31.611447 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:33:31.611447 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:33:31.611447 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: ffcc413bf53847b89cfe6bdf48909ea0 Sep 23 04:33:31.611447 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-867564724-project Sep 23 04:33:31.611447 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:33:31.611447 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 699f43b8-e784-4553-836c-e8785632d903 could not be found. Sep 23 04:33:31.611447 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '699f43b8-e784-4553-836c-e8785632d903'} Sep 23 04:33:31.615178 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:33:31.615178 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:33:31.615178 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:33:31.615178 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:33:31.615178 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:33:31.615178 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:33:31.615178 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:33:31.615178 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:33:31.615178 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:33:31.615178 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:33:31.615178 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 699f43b8-e784-4553-836c-e8785632d903 could not be found. Sep 23 04:33:31.615178 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:33:31.615178 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:33:31.615178 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:33:31.615178 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:33:31.615178 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:33:31.615178 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:33:31.615178 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:33:31.615178 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:33:31.615178 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:33:31.616585 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:33:31.616585 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 04:33:31.616585 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 04:33:31.616585 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 04:33:31.616585 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 04:33:31.616585 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:33:31.616585 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:33:31.616585 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:33:31.616585 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:33:31.616585 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 699f43b8-e784-4553-836c-e8785632d903 could not be found. Sep 23 04:33:31.616585 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:33:31.616585 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:33:31.616585 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:33:31.616585 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:33:31.616585 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:33:31.616585 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:33:31.616585 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:33:31.616585 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:33:31.616585 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 699f43b8-e784-4553-836c-e8785632d903 could not be found. Sep 23 04:33:31.616585 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:33:31.618088 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ee66da5e-8063-45cd-a969-cce9e0e0e42d tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Returning 404 to user: Instance 699f43b8-e784-4553-836c-e8785632d903 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:33:31.618088 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ee66da5e-8063-45cd-a969-cce9e0e0e42d tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] 10.222.0.33 "DELETE /compute/v2.1/servers/699f43b8-e784-4553-836c-e8785632d903" status: 404 len: 111 microversion: 2.1 time: 0.050462 Sep 23 04:33:31.618088 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 399/772] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:33:31 2022] DELETE /compute/v2.1/servers/699f43b8-e784-4553-836c-e8785632d903 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:33:31.631762 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b82ccfe0-acef-461b-8823-dccce0ccc0a1 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:31.632721 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b82ccfe0-acef-461b-8823-dccce0ccc0a1 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] [instance: 699f43b8-e784-4553-836c-e8785632d903] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:31.641638 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b82ccfe0-acef-461b-8823-dccce0ccc0a1 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:31.642676 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b82ccfe0-acef-461b-8823-dccce0ccc0a1 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:31.643337 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b82ccfe0-acef-461b-8823-dccce0ccc0a1 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:31.644252 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b82ccfe0-acef-461b-8823-dccce0ccc0a1 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:31.644871 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b82ccfe0-acef-461b-8823-dccce0ccc0a1 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:31.645790 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b82ccfe0-acef-461b-8823-dccce0ccc0a1 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:31.666516 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-b82ccfe0-acef-461b-8823-dccce0ccc0a1 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] HTTP exception thrown: Instance 699f43b8-e784-4553-836c-e8785632d903 could not be found. Sep 23 04:33:31.668450 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b82ccfe0-acef-461b-8823-dccce0ccc0a1 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Request method failure captured: Sep 23 04:33:31.668450 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/699f43b8-e784-4553-836c-e8785632d903 HTTP/1.1 Sep 23 04:33:31.668450 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:33:31.668450 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:33:31.668450 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:33:31.668450 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:33:31.668450 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:33:31.668450 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:33:31.668450 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:33:31.668450 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:33:31.668450 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTZ_53wuFk5N-xHONjU-0gvWg3fGR1E5PnlNXvFFh1aHBuFbSYKfyFikN29cV5tVhTFEo6q4yrMTeSIrGKDhUHlJGuquss8x1NPwuQVOOfjKfcbgKDHnSWpwPYy-JgLQsWj9EE9J6HDNxwo3wIYS1171KDtK_UMdMYjfUJWh2XPTk10 Sep 23 04:33:31.668450 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:33:31.668450 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:33:31.668450 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:33:31.668450 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:33:31.668450 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:33:31.668450 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:33:31.668450 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 98c7c21aa6b342b6bc52365cfdeb7c7b Sep 23 04:33:31.668450 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-867564724 Sep 23 04:33:31.668450 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:33:31.668450 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:33:31.670149 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_98c7c21aa6b342b6bc52365cfdeb7c7b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/98c7c21aa6b342b6bc52365cfdeb7c7b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/98c7c21aa6b342b6bc52365cfdeb7c7b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/98c7c21aa6b342b6bc52365cfdeb7c7b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:33:31.670149 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-867564724 Sep 23 04:33:31.670149 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 98c7c21aa6b342b6bc52365cfdeb7c7b Sep 23 04:33:31.670149 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-867564724 Sep 23 04:33:31.670149 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ServersWithSpecificFlavorTestJSON-867564724-project Sep 23 04:33:31.670149 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:33:31.670149 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:33:31.670149 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: ffcc413bf53847b89cfe6bdf48909ea0 Sep 23 04:33:31.670149 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-867564724-project Sep 23 04:33:31.670149 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:33:31.670149 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 699f43b8-e784-4553-836c-e8785632d903 could not be found. Sep 23 04:33:31.670149 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '699f43b8-e784-4553-836c-e8785632d903'} Sep 23 04:33:31.673101 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:33:31.673101 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:33:31.673101 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:33:31.673101 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:33:31.673101 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:33:31.673101 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:33:31.673101 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:33:31.673101 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:33:31.673101 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:33:31.673101 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:33:31.673101 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 699f43b8-e784-4553-836c-e8785632d903 could not be found. Sep 23 04:33:31.673101 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:33:31.673101 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:33:31.673101 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:33:31.673101 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:33:31.673101 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:33:31.673101 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:33:31.673101 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:33:31.673101 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:33:31.673101 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:33:31.674544 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:33:31.674544 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:33:31.674544 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:33:31.674544 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:33:31.674544 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:33:31.674544 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:33:31.674544 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:33:31.674544 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 699f43b8-e784-4553-836c-e8785632d903 could not be found. Sep 23 04:33:31.674544 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:33:31.674544 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:33:31.674544 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:33:31.674544 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:33:31.674544 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:33:31.674544 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:33:31.674544 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:33:31.674544 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:33:31.674544 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 699f43b8-e784-4553-836c-e8785632d903 could not be found. Sep 23 04:33:31.674544 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:33:31.675958 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b82ccfe0-acef-461b-8823-dccce0ccc0a1 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Returning 404 to user: Instance 699f43b8-e784-4553-836c-e8785632d903 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:33:31.675958 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b82ccfe0-acef-461b-8823-dccce0ccc0a1 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] 10.222.0.33 "GET /compute/v2.1/servers/699f43b8-e784-4553-836c-e8785632d903" status: 404 len: 111 microversion: 2.1 time: 0.045942 Sep 23 04:33:31.681288 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 400/773] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:31 2022] GET /compute/v2.1/servers/699f43b8-e784-4553-836c-e8785632d903 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:33:31.687810 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-dff086a8-ca4b-4088-986d-afd5c885aa75 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:31.688647 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-dff086a8-ca4b-4088-986d-afd5c885aa75 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] [instance: 074ac5a1-94af-4e9d-b458-107710ca0972] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:31.693035 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6e2da8f5-435e-4231-a304-9946324c3671 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3135a00fc94e488cb633b89d8768fe93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332a996884724d9eb16c79f46107c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:31.712930 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dff086a8-ca4b-4088-986d-afd5c885aa75 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:31.713469 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-6e2da8f5-435e-4231-a304-9946324c3671 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] 10.222.0.33 "GET /compute/v2.1/servers/e5237b14-ce44-43de-ab20-e6e456def723" status: 200 len: 1323 microversion: 2.1 time: 0.285288 Sep 23 04:33:31.714148 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 374/774] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:31 2022] GET /compute/v2.1/servers/e5237b14-ce44-43de-ab20-e6e456def723 => generated 1323 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:31.714440 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dff086a8-ca4b-4088-986d-afd5c885aa75 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:31.715253 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dff086a8-ca4b-4088-986d-afd5c885aa75 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:31.717112 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dff086a8-ca4b-4088-986d-afd5c885aa75 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:31.719543 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dff086a8-ca4b-4088-986d-afd5c885aa75 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:31.720162 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dff086a8-ca4b-4088-986d-afd5c885aa75 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:31.756644 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-dff086a8-ca4b-4088-986d-afd5c885aa75 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] HTTP exception thrown: Instance 074ac5a1-94af-4e9d-b458-107710ca0972 could not be found. Sep 23 04:33:31.762488 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-dff086a8-ca4b-4088-986d-afd5c885aa75 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Request method failure captured: Sep 23 04:33:31.762488 n-d-846463-3 devstack@n-api.service[122699]: request: DELETE /compute/v2.1/servers/074ac5a1-94af-4e9d-b458-107710ca0972 HTTP/1.1 Sep 23 04:33:31.762488 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:33:31.762488 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:33:31.762488 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:33:31.762488 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:33:31.762488 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:33:31.762488 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:33:31.762488 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:33:31.762488 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:33:31.762488 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTZ_53wuFk5N-xHONjU-0gvWg3fGR1E5PnlNXvFFh1aHBuFbSYKfyFikN29cV5tVhTFEo6q4yrMTeSIrGKDhUHlJGuquss8x1NPwuQVOOfjKfcbgKDHnSWpwPYy-JgLQsWj9EE9J6HDNxwo3wIYS1171KDtK_UMdMYjfUJWh2XPTk10 Sep 23 04:33:31.762488 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:33:31.762488 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:33:31.762488 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:33:31.762488 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:33:31.762488 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:33:31.762488 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:33:31.762488 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 98c7c21aa6b342b6bc52365cfdeb7c7b Sep 23 04:33:31.762488 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-867564724 Sep 23 04:33:31.762488 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:33:31.762488 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:33:31.764554 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_98c7c21aa6b342b6bc52365cfdeb7c7b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/98c7c21aa6b342b6bc52365cfdeb7c7b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/98c7c21aa6b342b6bc52365cfdeb7c7b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/98c7c21aa6b342b6bc52365cfdeb7c7b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:33:31.764554 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-867564724 Sep 23 04:33:31.764554 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 98c7c21aa6b342b6bc52365cfdeb7c7b Sep 23 04:33:31.764554 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-867564724 Sep 23 04:33:31.764554 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ServersWithSpecificFlavorTestJSON-867564724-project Sep 23 04:33:31.764554 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:33:31.764554 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:33:31.764554 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: ffcc413bf53847b89cfe6bdf48909ea0 Sep 23 04:33:31.764554 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-867564724-project Sep 23 04:33:31.764554 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:33:31.764554 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 074ac5a1-94af-4e9d-b458-107710ca0972 could not be found. Sep 23 04:33:31.764554 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '074ac5a1-94af-4e9d-b458-107710ca0972'} Sep 23 04:33:31.765442 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:33:31.765442 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:33:31.765442 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:33:31.765442 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:33:31.765442 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:33:31.765442 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:33:31.765442 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:33:31.765442 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:33:31.765442 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:33:31.765442 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:33:31.765442 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 074ac5a1-94af-4e9d-b458-107710ca0972 could not be found. Sep 23 04:33:31.765442 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:33:31.765442 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:33:31.765442 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:33:31.765442 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:33:31.765442 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:33:31.765442 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:33:31.765442 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:33:31.765442 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:33:31.765442 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:33:31.767325 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:33:31.767325 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 04:33:31.767325 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 04:33:31.767325 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 04:33:31.767325 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 04:33:31.767325 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:33:31.767325 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:33:31.767325 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:33:31.767325 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:33:31.767325 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 074ac5a1-94af-4e9d-b458-107710ca0972 could not be found. Sep 23 04:33:31.767325 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:33:31.767325 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:33:31.767325 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:33:31.767325 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:33:31.767325 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:33:31.767325 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:33:31.767325 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:33:31.767325 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:33:31.767325 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 074ac5a1-94af-4e9d-b458-107710ca0972 could not be found. Sep 23 04:33:31.767325 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:33:31.768745 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-dff086a8-ca4b-4088-986d-afd5c885aa75 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Returning 404 to user: Instance 074ac5a1-94af-4e9d-b458-107710ca0972 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:33:31.768841 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-dff086a8-ca4b-4088-986d-afd5c885aa75 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] 10.222.0.33 "DELETE /compute/v2.1/servers/074ac5a1-94af-4e9d-b458-107710ca0972" status: 404 len: 111 microversion: 2.1 time: 0.086225 Sep 23 04:33:31.769402 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 401/775] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:33:31 2022] DELETE /compute/v2.1/servers/074ac5a1-94af-4e9d-b458-107710ca0972 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:33:31.778049 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f9ed2ba3-a79d-4182-a5f0-6b281a4b9868 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:31.778678 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f9ed2ba3-a79d-4182-a5f0-6b281a4b9868 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] [instance: 074ac5a1-94af-4e9d-b458-107710ca0972] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:31.785656 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f9ed2ba3-a79d-4182-a5f0-6b281a4b9868 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:31.786460 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f9ed2ba3-a79d-4182-a5f0-6b281a4b9868 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:31.787095 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f9ed2ba3-a79d-4182-a5f0-6b281a4b9868 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:31.788487 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f9ed2ba3-a79d-4182-a5f0-6b281a4b9868 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:31.789133 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f9ed2ba3-a79d-4182-a5f0-6b281a4b9868 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:31.789738 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f9ed2ba3-a79d-4182-a5f0-6b281a4b9868 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:31.817321 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-f9ed2ba3-a79d-4182-a5f0-6b281a4b9868 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] HTTP exception thrown: Instance 074ac5a1-94af-4e9d-b458-107710ca0972 could not be found. Sep 23 04:33:31.818995 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f9ed2ba3-a79d-4182-a5f0-6b281a4b9868 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Request method failure captured: Sep 23 04:33:31.818995 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/074ac5a1-94af-4e9d-b458-107710ca0972 HTTP/1.1 Sep 23 04:33:31.818995 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:33:31.818995 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:33:31.818995 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:33:31.818995 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:33:31.818995 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:33:31.818995 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:33:31.818995 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:33:31.818995 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:33:31.818995 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTZ_53wuFk5N-xHONjU-0gvWg3fGR1E5PnlNXvFFh1aHBuFbSYKfyFikN29cV5tVhTFEo6q4yrMTeSIrGKDhUHlJGuquss8x1NPwuQVOOfjKfcbgKDHnSWpwPYy-JgLQsWj9EE9J6HDNxwo3wIYS1171KDtK_UMdMYjfUJWh2XPTk10 Sep 23 04:33:31.818995 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:33:31.818995 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:33:31.818995 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:33:31.818995 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:33:31.818995 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:33:31.818995 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:33:31.818995 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 98c7c21aa6b342b6bc52365cfdeb7c7b Sep 23 04:33:31.818995 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-867564724 Sep 23 04:33:31.818995 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:33:31.818995 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:33:31.820516 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_98c7c21aa6b342b6bc52365cfdeb7c7b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/98c7c21aa6b342b6bc52365cfdeb7c7b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/98c7c21aa6b342b6bc52365cfdeb7c7b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/98c7c21aa6b342b6bc52365cfdeb7c7b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:33:31.820516 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-867564724 Sep 23 04:33:31.820516 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 98c7c21aa6b342b6bc52365cfdeb7c7b Sep 23 04:33:31.820516 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-867564724 Sep 23 04:33:31.820516 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ServersWithSpecificFlavorTestJSON-867564724-project Sep 23 04:33:31.820516 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:33:31.820516 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:33:31.820516 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: ffcc413bf53847b89cfe6bdf48909ea0 Sep 23 04:33:31.820516 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-867564724-project Sep 23 04:33:31.820516 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:33:31.820516 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 074ac5a1-94af-4e9d-b458-107710ca0972 could not be found. Sep 23 04:33:31.820516 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '074ac5a1-94af-4e9d-b458-107710ca0972'} Sep 23 04:33:31.821231 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:33:31.821231 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:33:31.821231 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:33:31.821231 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:33:31.821231 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:33:31.821231 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:33:31.821231 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:33:31.821231 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:33:31.821231 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:33:31.821231 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:33:31.821231 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 074ac5a1-94af-4e9d-b458-107710ca0972 could not be found. Sep 23 04:33:31.821231 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:33:31.821231 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:33:31.821231 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:33:31.821231 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:33:31.821231 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:33:31.821231 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:33:31.821231 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:33:31.821231 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:33:31.821231 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:33:31.822627 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:33:31.822627 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:33:31.822627 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:33:31.822627 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:33:31.822627 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:33:31.822627 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:33:31.822627 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:33:31.822627 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 074ac5a1-94af-4e9d-b458-107710ca0972 could not be found. Sep 23 04:33:31.822627 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:33:31.822627 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:33:31.822627 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:33:31.822627 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:33:31.822627 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:33:31.822627 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:33:31.822627 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:33:31.822627 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:33:31.822627 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 074ac5a1-94af-4e9d-b458-107710ca0972 could not be found. Sep 23 04:33:31.822627 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:33:31.825072 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f9ed2ba3-a79d-4182-a5f0-6b281a4b9868 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] Returning 404 to user: Instance 074ac5a1-94af-4e9d-b458-107710ca0972 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:33:31.825072 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f9ed2ba3-a79d-4182-a5f0-6b281a4b9868 tempest-ServersWithSpecificFlavorTestJSON-867564724 tempest-ServersWithSpecificFlavorTestJSON-867564724-project] 10.222.0.33 "GET /compute/v2.1/servers/074ac5a1-94af-4e9d-b458-107710ca0972" status: 404 len: 111 microversion: 2.1 time: 0.046587 Sep 23 04:33:31.834053 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 375/776] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:31 2022] GET /compute/v2.1/servers/074ac5a1-94af-4e9d-b458-107710ca0972 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:33:31.836189 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1bc8a05f-e0e4-45e3-9ffe-1b65c14ece6c tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:31.837025 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1bc8a05f-e0e4-45e3-9ffe-1b65c14ece6c tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: 09076cfa-4632-43c3-919d-4a8fe1b1bd37] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:31.843178 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1bc8a05f-e0e4-45e3-9ffe-1b65c14ece6c tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:31.843679 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1bc8a05f-e0e4-45e3-9ffe-1b65c14ece6c tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:31.844119 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1bc8a05f-e0e4-45e3-9ffe-1b65c14ece6c tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:31.852761 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1bc8a05f-e0e4-45e3-9ffe-1b65c14ece6c tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:31.855844 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1bc8a05f-e0e4-45e3-9ffe-1b65c14ece6c tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:31.856381 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1bc8a05f-e0e4-45e3-9ffe-1b65c14ece6c tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:32.019552 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1bc8a05f-e0e4-45e3-9ffe-1b65c14ece6c tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:32.033992 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1bc8a05f-e0e4-45e3-9ffe-1b65c14ece6c tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/09076cfa-4632-43c3-919d-4a8fe1b1bd37" status: 200 len: 1271 microversion: 2.1 time: 0.201556 Sep 23 04:33:32.035573 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 402/777] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:31 2022] GET /compute/v2.1/servers/09076cfa-4632-43c3-919d-4a8fe1b1bd37 => generated 1271 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:32.221217 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ece6d45a-fe0f-44c4-9094-bfcb5bc9dc78 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:32.222664 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-ece6d45a-fe0f-44c4-9094-bfcb5bc9dc78 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] [instance: 2d2de8ea-1016-4289-994f-59d8742f9b58] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:32.241828 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ece6d45a-fe0f-44c4-9094-bfcb5bc9dc78 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:32.242824 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ece6d45a-fe0f-44c4-9094-bfcb5bc9dc78 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:32.243477 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ece6d45a-fe0f-44c4-9094-bfcb5bc9dc78 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:32.247934 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ece6d45a-fe0f-44c4-9094-bfcb5bc9dc78 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:32.248969 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ece6d45a-fe0f-44c4-9094-bfcb5bc9dc78 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:32.249420 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ece6d45a-fe0f-44c4-9094-bfcb5bc9dc78 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:32.442830 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6feaebca-8633-435e-9599-c199b3d9f427 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Calling method '.version_select at 0x7ff1bbf84b80>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:32.538419 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ece6d45a-fe0f-44c4-9094-bfcb5bc9dc78 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c82752e1bc4fdb82e7f8391c7c129f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44352a7a6d964530aa20ae83064b02e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:32.554888 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ece6d45a-fe0f-44c4-9094-bfcb5bc9dc78 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] 10.222.0.33 "GET /compute/v2.1/servers/2d2de8ea-1016-4289-994f-59d8742f9b58" status: 200 len: 1313 microversion: 2.1 time: 0.337586 Sep 23 04:33:32.555726 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 376/778] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:32 2022] GET /compute/v2.1/servers/2d2de8ea-1016-4289-994f-59d8742f9b58 => generated 1313 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:32.561324 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-73ba3cb2-c231-4494-8921-f1a5221c757f req-05353bc5-c469-40d5-9e9c-029715b980f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5237b14-ce44-43de-ab20-e6e456def723", "name": "network-vif-plugged", "status": "completed", "tag": "e1b845e7-999a-4e6a-b939-3cf715e6290e"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:33:32.572048 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-73ba3cb2-c231-4494-8921-f1a5221c757f req-05353bc5-c469-40d5-9e9c-029715b980f7 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:32.572806 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-73ba3cb2-c231-4494-8921-f1a5221c757f req-05353bc5-c469-40d5-9e9c-029715b980f7 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:32.574350 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-73ba3cb2-c231-4494-8921-f1a5221c757f req-05353bc5-c469-40d5-9e9c-029715b980f7 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:32.588496 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6feaebca-8633-435e-9599-c199b3d9f427 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] 10.222.0.33 "GET /compute/v2.1/images/df3e3bf4-7b42-4c67-9f3e-0d79fa06e685" status: 200 len: 1422 microversion: 2.1 time: 0.149821 Sep 23 04:33:32.597844 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 403/779] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:33:32 2022] GET /compute/v2.1/images/df3e3bf4-7b42-4c67-9f3e-0d79fa06e685 => generated 1422 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:32.632115 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-73ba3cb2-c231-4494-8921-f1a5221c757f req-05353bc5-c469-40d5-9e9c-029715b980f7 service nova] Creating event network-vif-plugged:e1b845e7-999a-4e6a-b939-3cf715e6290e for instance e5237b14-ce44-43de-ab20-e6e456def723 on n-h1-846463-3 Sep 23 04:33:32.647854 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-73ba3cb2-c231-4494-8921-f1a5221c757f req-05353bc5-c469-40d5-9e9c-029715b980f7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090705 Sep 23 04:33:32.657277 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 377/780] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:33:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:33:32.739811 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ae1b3cca-2e77-4a74-b961-8770876dacad tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:32.740683 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ae1b3cca-2e77-4a74-b961-8770876dacad tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] [instance: e5237b14-ce44-43de-ab20-e6e456def723] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:32.754027 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ae1b3cca-2e77-4a74-b961-8770876dacad tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:32.754888 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ae1b3cca-2e77-4a74-b961-8770876dacad tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:32.755570 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ae1b3cca-2e77-4a74-b961-8770876dacad tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:32.756945 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ae1b3cca-2e77-4a74-b961-8770876dacad tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:32.758467 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ae1b3cca-2e77-4a74-b961-8770876dacad tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:32.762149 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ae1b3cca-2e77-4a74-b961-8770876dacad tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:33.057157 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-cb443bcf-d6f8-4006-9188-d68ea6b267d3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:33.058078 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-cb443bcf-d6f8-4006-9188-d68ea6b267d3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: 09076cfa-4632-43c3-919d-4a8fe1b1bd37] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:33.069852 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cb443bcf-d6f8-4006-9188-d68ea6b267d3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:33.081883 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cb443bcf-d6f8-4006-9188-d68ea6b267d3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:33.082594 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cb443bcf-d6f8-4006-9188-d68ea6b267d3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:33.083374 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cb443bcf-d6f8-4006-9188-d68ea6b267d3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:33.083865 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cb443bcf-d6f8-4006-9188-d68ea6b267d3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:33.084300 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cb443bcf-d6f8-4006-9188-d68ea6b267d3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:33.094516 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ae1b3cca-2e77-4a74-b961-8770876dacad tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3135a00fc94e488cb633b89d8768fe93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332a996884724d9eb16c79f46107c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:33.102916 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ae1b3cca-2e77-4a74-b961-8770876dacad tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] 10.222.0.33 "GET /compute/v2.1/servers/e5237b14-ce44-43de-ab20-e6e456def723" status: 200 len: 1323 microversion: 2.1 time: 0.367192 Sep 23 04:33:33.118292 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 404/781] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:32 2022] GET /compute/v2.1/servers/e5237b14-ce44-43de-ab20-e6e456def723 => generated 1323 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:33.548137 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-cb443bcf-d6f8-4006-9188-d68ea6b267d3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:33.564104 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-cb443bcf-d6f8-4006-9188-d68ea6b267d3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/09076cfa-4632-43c3-919d-4a8fe1b1bd37" status: 200 len: 1313 microversion: 2.1 time: 0.507805 Sep 23 04:33:33.570820 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 378/782] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:33 2022] GET /compute/v2.1/servers/09076cfa-4632-43c3-919d-4a8fe1b1bd37 => generated 1313 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:33:33.583173 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-217f39b0-a6e5-4491-874b-e4ea33d1a620 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:33.586599 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-217f39b0-a6e5-4491-874b-e4ea33d1a620 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] [instance: 2d2de8ea-1016-4289-994f-59d8742f9b58] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:33.595358 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-217f39b0-a6e5-4491-874b-e4ea33d1a620 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:33.595994 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-217f39b0-a6e5-4491-874b-e4ea33d1a620 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:33.596277 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-217f39b0-a6e5-4491-874b-e4ea33d1a620 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:33.596994 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-217f39b0-a6e5-4491-874b-e4ea33d1a620 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:33.604772 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e736fedd-a320-4acf-bc2c-2a571a96fe9e tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Calling method '.version_select at 0x7ff1bbfea040>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:33.606778 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-217f39b0-a6e5-4491-874b-e4ea33d1a620 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:33.607291 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-217f39b0-a6e5-4491-874b-e4ea33d1a620 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:33.679278 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e736fedd-a320-4acf-bc2c-2a571a96fe9e tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] 10.222.0.33 "GET /compute/v2.1/images/df3e3bf4-7b42-4c67-9f3e-0d79fa06e685" status: 200 len: 1422 microversion: 2.1 time: 0.078525 Sep 23 04:33:33.688171 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 379/783] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:33:33 2022] GET /compute/v2.1/images/df3e3bf4-7b42-4c67-9f3e-0d79fa06e685 => generated 1422 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:33:34.133526 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-54bf8830-40c1-439a-b7c2-9ba2351a09be tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:34.135556 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-54bf8830-40c1-439a-b7c2-9ba2351a09be tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] [instance: e5237b14-ce44-43de-ab20-e6e456def723] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:34.148809 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-54bf8830-40c1-439a-b7c2-9ba2351a09be tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:34.148809 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-54bf8830-40c1-439a-b7c2-9ba2351a09be tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:34.148809 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-54bf8830-40c1-439a-b7c2-9ba2351a09be tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:34.148809 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-54bf8830-40c1-439a-b7c2-9ba2351a09be tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:34.149164 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-54bf8830-40c1-439a-b7c2-9ba2351a09be tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:34.149164 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-54bf8830-40c1-439a-b7c2-9ba2351a09be tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:34.267612 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-217f39b0-a6e5-4491-874b-e4ea33d1a620 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c82752e1bc4fdb82e7f8391c7c129f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44352a7a6d964530aa20ae83064b02e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:34.280112 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-217f39b0-a6e5-4491-874b-e4ea33d1a620 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] 10.222.0.33 "GET /compute/v2.1/servers/2d2de8ea-1016-4289-994f-59d8742f9b58" status: 200 len: 1313 microversion: 2.1 time: 0.700604 Sep 23 04:33:34.297023 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 405/784] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:33 2022] GET /compute/v2.1/servers/2d2de8ea-1016-4289-994f-59d8742f9b58 => generated 1313 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:34.451101 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-54bf8830-40c1-439a-b7c2-9ba2351a09be tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3135a00fc94e488cb633b89d8768fe93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332a996884724d9eb16c79f46107c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:34.478102 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-54bf8830-40c1-439a-b7c2-9ba2351a09be tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] 10.222.0.33 "GET /compute/v2.1/servers/e5237b14-ce44-43de-ab20-e6e456def723" status: 200 len: 1323 microversion: 2.1 time: 0.351292 Sep 23 04:33:34.478703 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 380/785] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:34 2022] GET /compute/v2.1/servers/e5237b14-ce44-43de-ab20-e6e456def723 => generated 1323 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:34.588561 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7b8232b4-0261-4973-90df-c828d44d18bc tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:34.589513 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-7b8232b4-0261-4973-90df-c828d44d18bc tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: 09076cfa-4632-43c3-919d-4a8fe1b1bd37] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:34.601336 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7b8232b4-0261-4973-90df-c828d44d18bc tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:34.602031 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7b8232b4-0261-4973-90df-c828d44d18bc tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:34.613180 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7b8232b4-0261-4973-90df-c828d44d18bc tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:34.614002 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7b8232b4-0261-4973-90df-c828d44d18bc tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:34.614492 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7b8232b4-0261-4973-90df-c828d44d18bc tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:34.614930 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7b8232b4-0261-4973-90df-c828d44d18bc tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:34.698444 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9c705dbc-11e1-4059-ab25-45f0b0deee1d tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Calling method '.version_select at 0x7ff1c0033550>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:34.810165 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9c705dbc-11e1-4059-ab25-45f0b0deee1d tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] 10.222.0.33 "GET /compute/v2.1/images/df3e3bf4-7b42-4c67-9f3e-0d79fa06e685" status: 200 len: 1422 microversion: 2.1 time: 0.116566 Sep 23 04:33:34.818728 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 381/786] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:33:34 2022] GET /compute/v2.1/images/df3e3bf4-7b42-4c67-9f3e-0d79fa06e685 => generated 1422 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:34.982241 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-7b8232b4-0261-4973-90df-c828d44d18bc tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:34.988837 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-7b8232b4-0261-4973-90df-c828d44d18bc tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/09076cfa-4632-43c3-919d-4a8fe1b1bd37" status: 200 len: 1313 microversion: 2.1 time: 0.404100 Sep 23 04:33:34.989702 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 406/787] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:34 2022] GET /compute/v2.1/servers/09076cfa-4632-43c3-919d-4a8fe1b1bd37 => generated 1313 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:35.304496 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-72ecd42a-b7aa-4fce-a51f-dc744e71e6bd tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:35.305110 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-72ecd42a-b7aa-4fce-a51f-dc744e71e6bd tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] [instance: 2d2de8ea-1016-4289-994f-59d8742f9b58] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:35.315476 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-72ecd42a-b7aa-4fce-a51f-dc744e71e6bd tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:35.315983 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-72ecd42a-b7aa-4fce-a51f-dc744e71e6bd tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:35.316433 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-72ecd42a-b7aa-4fce-a51f-dc744e71e6bd tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:35.317147 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-72ecd42a-b7aa-4fce-a51f-dc744e71e6bd tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:35.317608 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-72ecd42a-b7aa-4fce-a51f-dc744e71e6bd tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:35.318076 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-72ecd42a-b7aa-4fce-a51f-dc744e71e6bd tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:35.409086 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-edb78c8b-e1a6-4056-9764-7106c52238ce tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-39527297", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "networks": [{"uuid": "c69ae9f6-7e1f-4037-b183-87d9ba3569e0"}]}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:33:35.517481 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.network.neutron [None req-edb78c8b-e1a6-4056-9764-7106c52238ce tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] validate_networks() for [('c69ae9f6-7e1f-4037-b183-87d9ba3569e0', None, None, None, None, None)] {{(pid=122698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:33:35.853869 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-72ecd42a-b7aa-4fce-a51f-dc744e71e6bd tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c82752e1bc4fdb82e7f8391c7c129f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44352a7a6d964530aa20ae83064b02e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:35.863460 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-72ecd42a-b7aa-4fce-a51f-dc744e71e6bd tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] 10.222.0.33 "GET /compute/v2.1/servers/2d2de8ea-1016-4289-994f-59d8742f9b58" status: 200 len: 1313 microversion: 2.1 time: 0.563814 Sep 23 04:33:35.878817 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 407/788] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:35 2022] GET /compute/v2.1/servers/2d2de8ea-1016-4289-994f-59d8742f9b58 => generated 1313 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:33:35.894625 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7669316b-af25-435f-b1d7-c3c54c37fa42 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:35.897791 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-7669316b-af25-435f-b1d7-c3c54c37fa42 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] [instance: e5237b14-ce44-43de-ab20-e6e456def723] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:35.911674 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7669316b-af25-435f-b1d7-c3c54c37fa42 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:35.912414 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7669316b-af25-435f-b1d7-c3c54c37fa42 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:35.916648 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7669316b-af25-435f-b1d7-c3c54c37fa42 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:35.917607 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7669316b-af25-435f-b1d7-c3c54c37fa42 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:35.918275 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7669316b-af25-435f-b1d7-c3c54c37fa42 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:35.919285 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7669316b-af25-435f-b1d7-c3c54c37fa42 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:36.124312 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:33:36.445388 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-7669316b-af25-435f-b1d7-c3c54c37fa42 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3135a00fc94e488cb633b89d8768fe93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332a996884724d9eb16c79f46107c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:36.452221 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=100 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:33:36.458450 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-7669316b-af25-435f-b1d7-c3c54c37fa42 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] 10.222.0.33 "GET /compute/v2.1/servers/e5237b14-ce44-43de-ab20-e6e456def723" status: 200 len: 1519 microversion: 2.1 time: 0.578375 Sep 23 04:33:36.461740 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 408/789] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:35 2022] GET /compute/v2.1/servers/e5237b14-ce44-43de-ab20-e6e456def723 => generated 1519 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:36.471800 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-41b9c7db-0264-4bcb-8b6c-4c1aca083474 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Calling method '.version_select at 0x7ff1c00843a0>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:36.541549 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-41b9c7db-0264-4bcb-8b6c-4c1aca083474 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] 10.222.0.33 "GET /compute/v2.1/images/df3e3bf4-7b42-4c67-9f3e-0d79fa06e685" status: 200 len: 1422 microversion: 2.1 time: 0.078561 Sep 23 04:33:36.542380 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 409/790] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:33:36 2022] GET /compute/v2.1/images/df3e3bf4-7b42-4c67-9f3e-0d79fa06e685 => generated 1422 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:36.566950 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4a097689-cb14-49a4-8d9b-b3275f60856e tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:36.567695 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4a097689-cb14-49a4-8d9b-b3275f60856e tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: 09076cfa-4632-43c3-919d-4a8fe1b1bd37] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:36.583267 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4a097689-cb14-49a4-8d9b-b3275f60856e tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:36.583777 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4a097689-cb14-49a4-8d9b-b3275f60856e tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:36.584227 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4a097689-cb14-49a4-8d9b-b3275f60856e tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:36.584952 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4a097689-cb14-49a4-8d9b-b3275f60856e tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:36.585418 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4a097689-cb14-49a4-8d9b-b3275f60856e tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:36.585849 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4a097689-cb14-49a4-8d9b-b3275f60856e tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:36.853098 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-edb78c8b-e1a6-4056-9764-7106c52238ce tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Flavor limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:33:36.853098 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-edb78c8b-e1a6-4056-9764-7106c52238ce tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Image limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:33:36.853643 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-edb78c8b-e1a6-4056-9764-7106c52238ce tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Flavor pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:33:36.854214 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-edb78c8b-e1a6-4056-9764-7106c52238ce tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Image pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:33:36.854725 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-edb78c8b-e1a6-4056-9764-7106c52238ce tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:33:36.877679 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-edb78c8b-e1a6-4056-9764-7106c52238ce tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:36.878403 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-edb78c8b-e1a6-4056-9764-7106c52238ce tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:36.881572 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-edb78c8b-e1a6-4056-9764-7106c52238ce tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:36.888285 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-edb78c8b-e1a6-4056-9764-7106c52238ce tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:36.890872 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-edb78c8b-e1a6-4056-9764-7106c52238ce tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:36.893311 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-edb78c8b-e1a6-4056-9764-7106c52238ce tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:36.937664 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-edb78c8b-e1a6-4056-9764-7106c52238ce tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Getting quotas for project 004af70c9f9a43c4a7be8136268e98f9. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:33:36.945564 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-edb78c8b-e1a6-4056-9764-7106c52238ce tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Getting quotas for user 82d04a55ba72452995e3b156325e0890 and project 004af70c9f9a43c4a7be8136268e98f9. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:33:36.950750 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=18 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:33:36.971865 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=4 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:33:36.975657 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-edb78c8b-e1a6-4056-9764-7106c52238ce tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Going to run 1 instances... {{(pid=122698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:33:36.978775 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-edb78c8b-e1a6-4056-9764-7106c52238ce tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: f77bb6f0-6ce7-40d8-9cb2-2fcb559353ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:33:37.078674 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-4a097689-cb14-49a4-8d9b-b3275f60856e tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:37.091485 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4a097689-cb14-49a4-8d9b-b3275f60856e tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/09076cfa-4632-43c3-919d-4a8fe1b1bd37" status: 200 len: 1313 microversion: 2.1 time: 0.539962 Sep 23 04:33:37.096562 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 410/791] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:36 2022] GET /compute/v2.1/servers/09076cfa-4632-43c3-919d-4a8fe1b1bd37 => generated 1313 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:37.116527 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-0b655ded-04a0-48db-a885-1358529444ed req-94804fa1-bbfa-4363-adff-ad07664bada0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09076cfa-4632-43c3-919d-4a8fe1b1bd37", "tag": "2103b7aa-15ef-4fad-b8eb-cd88ce8168a2"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:33:37.142188 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-0b655ded-04a0-48db-a885-1358529444ed req-94804fa1-bbfa-4363-adff-ad07664bada0 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:37.143806 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-0b655ded-04a0-48db-a885-1358529444ed req-94804fa1-bbfa-4363-adff-ad07664bada0 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:37.146258 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-0b655ded-04a0-48db-a885-1358529444ed req-94804fa1-bbfa-4363-adff-ad07664bada0 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:37.178028 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-0b655ded-04a0-48db-a885-1358529444ed req-94804fa1-bbfa-4363-adff-ad07664bada0 service nova] Creating event network-changed:2103b7aa-15ef-4fad-b8eb-cd88ce8168a2 for instance 09076cfa-4632-43c3-919d-4a8fe1b1bd37 on n-h2-846463-3 Sep 23 04:33:37.188145 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-0b655ded-04a0-48db-a885-1358529444ed req-94804fa1-bbfa-4363-adff-ad07664bada0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094960 Sep 23 04:33:37.190292 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 411/792] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:33:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:33:37.203028 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-02389802-c472-49ec-891f-36a342b52b0a tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Action: 'create', calling method: .version_select at 0x7ff1c021c550>, body: {"pool": null} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:33:37.236915 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-edb78c8b-e1a6-4056-9764-7106c52238ce tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.355436 Sep 23 04:33:37.238352 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 382/793] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:33:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 2357 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:33:37.538318 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d8db8117-36ed-4d2a-9131-ef07e1590cd1 tempest-FlavorsV2NegativeTest-1982961771 tempest-FlavorsV2NegativeTest-1982961771-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:37.561261 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d8db8117-36ed-4d2a-9131-ef07e1590cd1 tempest-FlavorsV2NegativeTest-1982961771 tempest-FlavorsV2NegativeTest-1982961771-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.321568 Sep 23 04:33:37.567584 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 383/794] 10.222.0.33 () {58 vars in 1137 bytes} [Fri Sep 23 04:33:37 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:33:37.585281 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-cd78891b-bf3a-40e0-8d48-9e8eca8a35d6 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:37.590298 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-cd78891b-bf3a-40e0-8d48-9e8eca8a35d6 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] [instance: 2d2de8ea-1016-4289-994f-59d8742f9b58] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:37.618607 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cd78891b-bf3a-40e0-8d48-9e8eca8a35d6 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:37.626162 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cd78891b-bf3a-40e0-8d48-9e8eca8a35d6 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:37.626883 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cd78891b-bf3a-40e0-8d48-9e8eca8a35d6 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:37.633050 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cd78891b-bf3a-40e0-8d48-9e8eca8a35d6 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:37.633756 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cd78891b-bf3a-40e0-8d48-9e8eca8a35d6 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:37.636026 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cd78891b-bf3a-40e0-8d48-9e8eca8a35d6 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:38.908168 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-cd78891b-bf3a-40e0-8d48-9e8eca8a35d6 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c82752e1bc4fdb82e7f8391c7c129f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44352a7a6d964530aa20ae83064b02e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:38.920931 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-cd78891b-bf3a-40e0-8d48-9e8eca8a35d6 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] 10.222.0.33 "GET /compute/v2.1/servers/2d2de8ea-1016-4289-994f-59d8742f9b58" status: 200 len: 1313 microversion: 2.1 time: 1.347906 Sep 23 04:33:38.923692 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 384/795] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:37 2022] GET /compute/v2.1/servers/2d2de8ea-1016-4289-994f-59d8742f9b58 => generated 1313 bytes in 1355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:38.942072 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d507f7cb-ed7f-4422-895a-2938b31c5c55 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:38.943580 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d507f7cb-ed7f-4422-895a-2938b31c5c55 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: f77bb6f0-6ce7-40d8-9cb2-2fcb559353ac] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:39.096763 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d507f7cb-ed7f-4422-895a-2938b31c5c55 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:39.105642 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d507f7cb-ed7f-4422-895a-2938b31c5c55 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/f77bb6f0-6ce7-40d8-9cb2-2fcb559353ac" status: 200 len: 1209 microversion: 2.1 time: 0.180337 Sep 23 04:33:39.118369 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 385/796] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:38 2022] GET /compute/v2.1/servers/f77bb6f0-6ce7-40d8-9cb2-2fcb559353ac => generated 1209 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:39.127284 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ded24ad2-2e8a-42a1-8d07-57db196402d5 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Calling method '.version_select at 0x7ff1bbe9fc10>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:39.796658 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ded24ad2-2e8a-42a1-8d07-57db196402d5 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] 10.222.0.33 "GET /compute/v2.1/images/df3e3bf4-7b42-4c67-9f3e-0d79fa06e685" status: 200 len: 1422 microversion: 2.1 time: 0.676562 Sep 23 04:33:39.801015 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 386/797] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:33:39 2022] GET /compute/v2.1/images/df3e3bf4-7b42-4c67-9f3e-0d79fa06e685 => generated 1422 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:39.811259 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-52f51064-5b03-4ea7-bbf3-ecdab425a392 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:39.812194 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-52f51064-5b03-4ea7-bbf3-ecdab425a392 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: 09076cfa-4632-43c3-919d-4a8fe1b1bd37] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:39.830415 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-52f51064-5b03-4ea7-bbf3-ecdab425a392 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:39.830904 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-52f51064-5b03-4ea7-bbf3-ecdab425a392 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:39.831346 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-52f51064-5b03-4ea7-bbf3-ecdab425a392 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:39.832056 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-52f51064-5b03-4ea7-bbf3-ecdab425a392 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:39.832513 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-52f51064-5b03-4ea7-bbf3-ecdab425a392 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:39.832929 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-52f51064-5b03-4ea7-bbf3-ecdab425a392 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:40.292574 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-52f51064-5b03-4ea7-bbf3-ecdab425a392 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:40.305070 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-52f51064-5b03-4ea7-bbf3-ecdab425a392 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/09076cfa-4632-43c3-919d-4a8fe1b1bd37" status: 200 len: 1313 microversion: 2.1 time: 0.501856 Sep 23 04:33:40.306046 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 387/798] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:39 2022] GET /compute/v2.1/servers/09076cfa-4632-43c3-919d-4a8fe1b1bd37 => generated 1313 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:40.334924 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-05b0a592-fe60-447d-a245-87a22489344c tempest-FlavorsV2NegativeTest-1982961771 tempest-FlavorsV2NegativeTest-1982961771-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-674163015", "imageRef": "a6bcb2ca-9dba-491f-8641-7ab43578a512", "flavorRef": "452"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:33:40.442616 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.network.neutron [None req-05b0a592-fe60-447d-a245-87a22489344c tempest-FlavorsV2NegativeTest-1982961771 tempest-FlavorsV2NegativeTest-1982961771-project] validate_networks() for None {{(pid=122698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:33:41.254838 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-05b0a592-fe60-447d-a245-87a22489344c tempest-FlavorsV2NegativeTest-1982961771 tempest-FlavorsV2NegativeTest-1982961771-project] HTTP exception thrown: Flavor's memory is too small for requested image. Sep 23 04:33:41.261383 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-05b0a592-fe60-447d-a245-87a22489344c tempest-FlavorsV2NegativeTest-1982961771 tempest-FlavorsV2NegativeTest-1982961771-project] Request method failure captured: Sep 23 04:33:41.261383 n-d-846463-3 devstack@n-api.service[122698]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 23 04:33:41.261383 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:33:41.261383 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:33:41.261383 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:33:41.261383 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 142 Sep 23 04:33:41.261383 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:33:41.261383 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:33:41.261383 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:33:41.261383 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:33:41.261383 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTcgJMCuiZGrhfWUm-yV9yRnMaJIJfm6s3WzDkw8IX3tLkpvVwbnDqTzRxrcHvY93xYoD3IXW36usPh-fBvae3gRoiOqOeFlzbDeweZ2ASuNpJZHjz6OseZoE3ltqQmCOArBrfkuEilwFIZ0pvcm8-XTYkplSdquhA04g5yr9bIuK-c Sep 23 04:33:41.261383 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:33:41.261383 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:33:41.261383 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:33:41.261383 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:33:41.261383 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:33:41.261383 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:33:41.261383 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: bf2dd6fa2b7844b4b2acf6cfd325aca1 Sep 23 04:33:41.261383 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-FlavorsV2NegativeTest-1982961771 Sep 23 04:33:41.261383 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:33:41.261383 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:33:41.263774 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bf2dd6fa2b7844b4b2acf6cfd325aca1", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bf2dd6fa2b7844b4b2acf6cfd325aca1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bf2dd6fa2b7844b4b2acf6cfd325aca1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bf2dd6fa2b7844b4b2acf6cfd325aca1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:33:41.263774 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-FlavorsV2NegativeTest-1982961771 Sep 23 04:33:41.263774 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: bf2dd6fa2b7844b4b2acf6cfd325aca1 Sep 23 04:33:41.263774 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-1982961771 Sep 23 04:33:41.263774 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-FlavorsV2NegativeTest-1982961771-project Sep 23 04:33:41.263774 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:33:41.263774 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:33:41.263774 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 4544103954ab4504bc338dbe605dd3c4 Sep 23 04:33:41.263774 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-FlavorsV2NegativeTest-1982961771-project Sep 23 04:33:41.263774 n-d-846463-3 devstack@n-api.service[122698]: Sep 23 04:33:41.263774 n-d-846463-3 devstack@n-api.service[122698]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-674163015", "imageRef": "a6bcb2ca-9dba-491f-8641-7ab43578a512", "flavorRef": "452"}} Sep 23 04:33:41.263774 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:33:41.264693 n-d-846463-3 devstack@n-api.service[122698]: exception: Flavor's memory is too small for requested image. Sep 23 04:33:41.264693 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-674163015', 'imageRef': 'a6bcb2ca-9dba-491f-8641-7ab43578a512', 'flavorRef': '452'}}} Sep 23 04:33:41.264693 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:33:41.264693 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:33:41.264693 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 23 04:33:41.264693 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 23 04:33:41.264693 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 23 04:33:41.264693 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 23 04:33:41.264693 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Sep 23 04:33:41.264693 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Sep 23 04:33:41.264693 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Sep 23 04:33:41.264693 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Sep 23 04:33:41.264693 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Sep 23 04:33:41.264693 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Sep 23 04:33:41.264693 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Sep 23 04:33:41.264693 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Sep 23 04:33:41.264693 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Sep 23 04:33:41.264693 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:33:41.264693 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:33:41.264693 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:33:41.266979 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:33:41.266979 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:33:41.266979 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:33:41.266979 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:33:41.266979 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:33:41.266979 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:33:41.266979 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:33:41.266979 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:33:41.266979 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:33:41.266979 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:33:41.266979 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:33:41.266979 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:33:41.266979 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:33:41.266979 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 23 04:33:41.266979 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Sep 23 04:33:41.266979 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 23 04:33:41.266979 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Sep 23 04:33:41.266979 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:33:41.266979 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:33:41.266979 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:33:41.266979 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:33:41.270876 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:33:41.270876 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:33:41.270876 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:33:41.270876 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:33:41.270876 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Sep 23 04:33:41.270876 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:33:41.270876 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-05b0a592-fe60-447d-a245-87a22489344c tempest-FlavorsV2NegativeTest-1982961771 tempest-FlavorsV2NegativeTest-1982961771-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:33:41.270876 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-05b0a592-fe60-447d-a245-87a22489344c tempest-FlavorsV2NegativeTest-1982961771 tempest-FlavorsV2NegativeTest-1982961771-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.946795 Sep 23 04:33:41.270876 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 388/799] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:33:40 2022] POST /compute/v2.1/servers => generated 93 bytes in 952 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 23 04:33:41.274203 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-87ae6a1c-5dd7-4745-97c9-91625f600c50 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:41.275002 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-87ae6a1c-5dd7-4745-97c9-91625f600c50 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] [instance: 2d2de8ea-1016-4289-994f-59d8742f9b58] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:41.283766 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-87ae6a1c-5dd7-4745-97c9-91625f600c50 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:41.290472 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-87ae6a1c-5dd7-4745-97c9-91625f600c50 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:41.290472 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-87ae6a1c-5dd7-4745-97c9-91625f600c50 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:41.290472 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-87ae6a1c-5dd7-4745-97c9-91625f600c50 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:41.290472 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-87ae6a1c-5dd7-4745-97c9-91625f600c50 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:41.291587 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-87ae6a1c-5dd7-4745-97c9-91625f600c50 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:41.765152 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-87ae6a1c-5dd7-4745-97c9-91625f600c50 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c82752e1bc4fdb82e7f8391c7c129f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44352a7a6d964530aa20ae83064b02e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:41.790771 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-87ae6a1c-5dd7-4745-97c9-91625f600c50 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] 10.222.0.33 "GET /compute/v2.1/servers/2d2de8ea-1016-4289-994f-59d8742f9b58" status: 200 len: 1313 microversion: 2.1 time: 0.529585 Sep 23 04:33:41.792841 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 389/800] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:41 2022] GET /compute/v2.1/servers/2d2de8ea-1016-4289-994f-59d8742f9b58 => generated 1313 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:41.823624 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-32d510c8-7193-4b6a-be38-ad2f121f948f tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:41.824492 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-32d510c8-7193-4b6a-be38-ad2f121f948f tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: f77bb6f0-6ce7-40d8-9cb2-2fcb559353ac] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:41.845056 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-32d510c8-7193-4b6a-be38-ad2f121f948f tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:41.846340 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-32d510c8-7193-4b6a-be38-ad2f121f948f tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:41.847010 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-32d510c8-7193-4b6a-be38-ad2f121f948f tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:41.847938 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-32d510c8-7193-4b6a-be38-ad2f121f948f tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:41.849056 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-32d510c8-7193-4b6a-be38-ad2f121f948f tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:41.849649 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-32d510c8-7193-4b6a-be38-ad2f121f948f tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:41.965052 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-32d510c8-7193-4b6a-be38-ad2f121f948f tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:41.978662 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-32d510c8-7193-4b6a-be38-ad2f121f948f tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/f77bb6f0-6ce7-40d8-9cb2-2fcb559353ac" status: 200 len: 1269 microversion: 2.1 time: 0.162196 Sep 23 04:33:41.979986 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 390/801] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:41 2022] GET /compute/v2.1/servers/f77bb6f0-6ce7-40d8-9cb2-2fcb559353ac => generated 1269 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:41.995808 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-65a83450-0757-40ea-9558-fe99dd57fe0a tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Calling method '.version_select at 0x7ff1bbe845e0>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:42.230966 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-65a83450-0757-40ea-9558-fe99dd57fe0a tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] 10.222.0.33 "GET /compute/v2.1/images/df3e3bf4-7b42-4c67-9f3e-0d79fa06e685" status: 200 len: 1422 microversion: 2.1 time: 0.247724 Sep 23 04:33:42.234189 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 391/802] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:33:41 2022] GET /compute/v2.1/images/df3e3bf4-7b42-4c67-9f3e-0d79fa06e685 => generated 1422 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:42.250954 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-d24611a7-2228-4987-aa57-77039b26fa20 req-25d46520-722d-4e52-abdc-bf3b0382196d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d2de8ea-1016-4289-994f-59d8742f9b58", "name": "network-vif-plugged", "status": "completed", "tag": "a1b3b8d8-27ea-471f-96fe-fbc5172fee43"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:33:42.297507 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-d24611a7-2228-4987-aa57-77039b26fa20 req-25d46520-722d-4e52-abdc-bf3b0382196d service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:42.301186 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-d24611a7-2228-4987-aa57-77039b26fa20 req-25d46520-722d-4e52-abdc-bf3b0382196d service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:42.302613 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-d24611a7-2228-4987-aa57-77039b26fa20 req-25d46520-722d-4e52-abdc-bf3b0382196d service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:42.347467 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-d24611a7-2228-4987-aa57-77039b26fa20 req-25d46520-722d-4e52-abdc-bf3b0382196d service nova] Creating event network-vif-plugged:a1b3b8d8-27ea-471f-96fe-fbc5172fee43 for instance 2d2de8ea-1016-4289-994f-59d8742f9b58 on n-h1-846463-3 Sep 23 04:33:42.353507 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-d24611a7-2228-4987-aa57-77039b26fa20 req-25d46520-722d-4e52-abdc-bf3b0382196d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117903 Sep 23 04:33:42.355170 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 392/803] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:33:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:33:42.366403 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f5555724-9bb9-4942-a092-6c51c29f1aef tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:42.368404 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f5555724-9bb9-4942-a092-6c51c29f1aef tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: 09076cfa-4632-43c3-919d-4a8fe1b1bd37] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:42.401911 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f5555724-9bb9-4942-a092-6c51c29f1aef tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:42.405966 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f5555724-9bb9-4942-a092-6c51c29f1aef tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:42.406647 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f5555724-9bb9-4942-a092-6c51c29f1aef tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:42.408196 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f5555724-9bb9-4942-a092-6c51c29f1aef tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:42.408873 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f5555724-9bb9-4942-a092-6c51c29f1aef tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:42.409472 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f5555724-9bb9-4942-a092-6c51c29f1aef tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:42.660629 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-02389802-c472-49ec-891f-36a342b52b0a tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] 10.222.0.33 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.468778 Sep 23 04:33:42.662063 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 412/804] 10.222.0.33 () {60 vars in 1170 bytes} [Fri Sep 23 04:33:37 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5471 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:33:42.767467 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f5555724-9bb9-4942-a092-6c51c29f1aef tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:42.779502 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f5555724-9bb9-4942-a092-6c51c29f1aef tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/09076cfa-4632-43c3-919d-4a8fe1b1bd37" status: 200 len: 1313 microversion: 2.1 time: 0.421351 Sep 23 04:33:42.796111 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 393/805] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:42 2022] GET /compute/v2.1/servers/09076cfa-4632-43c3-919d-4a8fe1b1bd37 => generated 1313 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:42.822742 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-753ba920-0e4c-41a5-9de1-1b2635711e5f tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:42.823711 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-753ba920-0e4c-41a5-9de1-1b2635711e5f tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] [instance: 2d2de8ea-1016-4289-994f-59d8742f9b58] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:42.853934 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-753ba920-0e4c-41a5-9de1-1b2635711e5f tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:42.858629 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-753ba920-0e4c-41a5-9de1-1b2635711e5f tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:42.859311 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-753ba920-0e4c-41a5-9de1-1b2635711e5f tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:42.860074 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-753ba920-0e4c-41a5-9de1-1b2635711e5f tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:42.860543 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-753ba920-0e4c-41a5-9de1-1b2635711e5f tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:42.867539 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-753ba920-0e4c-41a5-9de1-1b2635711e5f tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:42.911148 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4c92b038-72d4-44cf-b36b-e99e3a15fe0c tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-520624810", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "networks": [{"uuid": "5e4e56e0-c3c5-411b-8ef5-0e167200f9bf"}]}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:33:43.021457 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.network.neutron [None req-4c92b038-72d4-44cf-b36b-e99e3a15fe0c tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] validate_networks() for [('5e4e56e0-c3c5-411b-8ef5-0e167200f9bf', None, None, None, None, None)] {{(pid=122698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:33:43.282248 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-753ba920-0e4c-41a5-9de1-1b2635711e5f tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c82752e1bc4fdb82e7f8391c7c129f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44352a7a6d964530aa20ae83064b02e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:43.312445 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-753ba920-0e4c-41a5-9de1-1b2635711e5f tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] 10.222.0.33 "GET /compute/v2.1/servers/2d2de8ea-1016-4289-994f-59d8742f9b58" status: 200 len: 1313 microversion: 2.1 time: 0.482527 Sep 23 04:33:43.326616 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 413/806] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:42 2022] GET /compute/v2.1/servers/2d2de8ea-1016-4289-994f-59d8742f9b58 => generated 1313 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:43.349224 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2acd3e4d-22d4-4f6d-abfe-92afc0dc7c6d tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:43.350605 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-2acd3e4d-22d4-4f6d-abfe-92afc0dc7c6d tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: f77bb6f0-6ce7-40d8-9cb2-2fcb559353ac] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:43.359795 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2acd3e4d-22d4-4f6d-abfe-92afc0dc7c6d tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:43.361053 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2acd3e4d-22d4-4f6d-abfe-92afc0dc7c6d tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:43.361687 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2acd3e4d-22d4-4f6d-abfe-92afc0dc7c6d tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:43.363101 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2acd3e4d-22d4-4f6d-abfe-92afc0dc7c6d tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:43.363723 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2acd3e4d-22d4-4f6d-abfe-92afc0dc7c6d tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:43.364350 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2acd3e4d-22d4-4f6d-abfe-92afc0dc7c6d tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:43.516282 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2acd3e4d-22d4-4f6d-abfe-92afc0dc7c6d tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:43.528301 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2acd3e4d-22d4-4f6d-abfe-92afc0dc7c6d tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/f77bb6f0-6ce7-40d8-9cb2-2fcb559353ac" status: 200 len: 1267 microversion: 2.1 time: 0.200299 Sep 23 04:33:43.531395 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 414/807] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:43 2022] GET /compute/v2.1/servers/f77bb6f0-6ce7-40d8-9cb2-2fcb559353ac => generated 1267 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:43.548384 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-064ff077-6fe0-4146-9c9c-11d8f561f82f tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Calling method '.version_select at 0x7ff1bbf84550>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:43.625261 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-064ff077-6fe0-4146-9c9c-11d8f561f82f tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] 10.222.0.33 "GET /compute/v2.1/images/df3e3bf4-7b42-4c67-9f3e-0d79fa06e685" status: 200 len: 1422 microversion: 2.1 time: 0.092498 Sep 23 04:33:43.626590 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 415/808] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:33:43 2022] GET /compute/v2.1/images/df3e3bf4-7b42-4c67-9f3e-0d79fa06e685 => generated 1422 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:43.803532 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-36ce5885-5e91-4860-83bb-4f0f97ee81fe tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:43.805944 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-36ce5885-5e91-4860-83bb-4f0f97ee81fe tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: 09076cfa-4632-43c3-919d-4a8fe1b1bd37] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:43.819740 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-36ce5885-5e91-4860-83bb-4f0f97ee81fe tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:43.820681 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-36ce5885-5e91-4860-83bb-4f0f97ee81fe tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:43.822159 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-36ce5885-5e91-4860-83bb-4f0f97ee81fe tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:43.823157 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-36ce5885-5e91-4860-83bb-4f0f97ee81fe tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:43.823837 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-36ce5885-5e91-4860-83bb-4f0f97ee81fe tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:43.824337 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-36ce5885-5e91-4860-83bb-4f0f97ee81fe tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:43.860814 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-4c92b038-72d4-44cf-b36b-e99e3a15fe0c tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Flavor limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:33:43.861978 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-4c92b038-72d4-44cf-b36b-e99e3a15fe0c tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Image limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:33:43.863225 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-4c92b038-72d4-44cf-b36b-e99e3a15fe0c tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Flavor pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:33:43.863838 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-4c92b038-72d4-44cf-b36b-e99e3a15fe0c tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Image pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:33:43.864418 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-4c92b038-72d4-44cf-b36b-e99e3a15fe0c tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:33:43.877645 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=19 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:33:43.884521 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4c92b038-72d4-44cf-b36b-e99e3a15fe0c tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:43.887235 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4c92b038-72d4-44cf-b36b-e99e3a15fe0c tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:43.889119 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4c92b038-72d4-44cf-b36b-e99e3a15fe0c tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:43.896182 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4c92b038-72d4-44cf-b36b-e99e3a15fe0c tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:43.897101 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4c92b038-72d4-44cf-b36b-e99e3a15fe0c tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:43.897878 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4c92b038-72d4-44cf-b36b-e99e3a15fe0c tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:43.918970 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=100 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:33:43.963352 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-4c92b038-72d4-44cf-b36b-e99e3a15fe0c tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Getting quotas for project 332a996884724d9eb16c79f46107c6af. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:33:43.975172 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-4c92b038-72d4-44cf-b36b-e99e3a15fe0c tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Getting quotas for user 3135a00fc94e488cb633b89d8768fe93 and project 332a996884724d9eb16c79f46107c6af. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:33:43.995413 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4c92b038-72d4-44cf-b36b-e99e3a15fe0c tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Going to run 1 instances... {{(pid=122698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:33:44.004872 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4c92b038-72d4-44cf-b36b-e99e3a15fe0c tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] [instance: 9dede73d-62ac-481b-b990-41fd1039882a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:33:44.146340 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-36ce5885-5e91-4860-83bb-4f0f97ee81fe tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:44.159134 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-36ce5885-5e91-4860-83bb-4f0f97ee81fe tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/09076cfa-4632-43c3-919d-4a8fe1b1bd37" status: 200 len: 1313 microversion: 2.1 time: 0.359710 Sep 23 04:33:44.160461 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 416/809] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:43 2022] GET /compute/v2.1/servers/09076cfa-4632-43c3-919d-4a8fe1b1bd37 => generated 1313 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:33:44.179590 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4c92b038-72d4-44cf-b36b-e99e3a15fe0c tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.272763 Sep 23 04:33:44.182017 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 394/810] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:33:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1276 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 23 04:33:44.193492 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4a148cc2-48ab-49a9-9767-908e18ee2e34 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:44.196752 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4a148cc2-48ab-49a9-9767-908e18ee2e34 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] [instance: 9dede73d-62ac-481b-b990-41fd1039882a] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:44.339092 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f237114c-e0cf-49e3-b8e1-d3095183c1ab tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:44.340157 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f237114c-e0cf-49e3-b8e1-d3095183c1ab tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] [instance: 2d2de8ea-1016-4289-994f-59d8742f9b58] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:44.351704 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f237114c-e0cf-49e3-b8e1-d3095183c1ab tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:44.354989 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f237114c-e0cf-49e3-b8e1-d3095183c1ab tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:44.355742 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f237114c-e0cf-49e3-b8e1-d3095183c1ab tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:44.357808 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f237114c-e0cf-49e3-b8e1-d3095183c1ab tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:44.359829 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-4a148cc2-48ab-49a9-9767-908e18ee2e34 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3135a00fc94e488cb633b89d8768fe93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332a996884724d9eb16c79f46107c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:44.360493 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f237114c-e0cf-49e3-b8e1-d3095183c1ab tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:44.361042 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f237114c-e0cf-49e3-b8e1-d3095183c1ab tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:44.367195 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4a148cc2-48ab-49a9-9767-908e18ee2e34 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] 10.222.0.33 "GET /compute/v2.1/servers/9dede73d-62ac-481b-b990-41fd1039882a" status: 200 len: 1223 microversion: 2.1 time: 0.178056 Sep 23 04:33:44.367783 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 417/811] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:44 2022] GET /compute/v2.1/servers/9dede73d-62ac-481b-b990-41fd1039882a => generated 1223 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:44.390268 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-981a21fe-1de4-4f13-8bd6-f1ecc529ab99 req-ff718f90-6c92-4cd9-a2d0-77a5c36d014a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09076cfa-4632-43c3-919d-4a8fe1b1bd37", "name": "network-vif-plugged", "status": "completed", "tag": "2103b7aa-15ef-4fad-b8eb-cd88ce8168a2"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:33:44.421684 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-981a21fe-1de4-4f13-8bd6-f1ecc529ab99 req-ff718f90-6c92-4cd9-a2d0-77a5c36d014a service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:44.434754 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-981a21fe-1de4-4f13-8bd6-f1ecc529ab99 req-ff718f90-6c92-4cd9-a2d0-77a5c36d014a service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:44.435743 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-981a21fe-1de4-4f13-8bd6-f1ecc529ab99 req-ff718f90-6c92-4cd9-a2d0-77a5c36d014a service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:44.473563 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-981a21fe-1de4-4f13-8bd6-f1ecc529ab99 req-ff718f90-6c92-4cd9-a2d0-77a5c36d014a service nova] Creating event network-vif-plugged:2103b7aa-15ef-4fad-b8eb-cd88ce8168a2 for instance 09076cfa-4632-43c3-919d-4a8fe1b1bd37 on n-h2-846463-3 Sep 23 04:33:44.510191 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-981a21fe-1de4-4f13-8bd6-f1ecc529ab99 req-ff718f90-6c92-4cd9-a2d0-77a5c36d014a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123912 Sep 23 04:33:44.511292 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 418/812] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:33:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:33:44.559584 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5c3d0098-0ae5-456f-abd6-654d02540d91 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:44.560019 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-5c3d0098-0ae5-456f-abd6-654d02540d91 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: f77bb6f0-6ce7-40d8-9cb2-2fcb559353ac] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:44.580632 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5c3d0098-0ae5-456f-abd6-654d02540d91 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:44.581110 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5c3d0098-0ae5-456f-abd6-654d02540d91 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:44.581564 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5c3d0098-0ae5-456f-abd6-654d02540d91 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:44.582322 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5c3d0098-0ae5-456f-abd6-654d02540d91 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:44.582791 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5c3d0098-0ae5-456f-abd6-654d02540d91 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:44.588110 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5c3d0098-0ae5-456f-abd6-654d02540d91 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:44.675597 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f237114c-e0cf-49e3-b8e1-d3095183c1ab tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c82752e1bc4fdb82e7f8391c7c129f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44352a7a6d964530aa20ae83064b02e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:44.687224 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f237114c-e0cf-49e3-b8e1-d3095183c1ab tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] 10.222.0.33 "GET /compute/v2.1/servers/2d2de8ea-1016-4289-994f-59d8742f9b58" status: 200 len: 1462 microversion: 2.1 time: 0.353757 Sep 23 04:33:44.689974 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 395/813] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:44 2022] GET /compute/v2.1/servers/2d2de8ea-1016-4289-994f-59d8742f9b58 => generated 1462 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:44.714078 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4209d017-c2aa-46bc-85e0-d53a1b7c49a0 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Calling method '.version_select at 0x7ff1c0046820>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:44.805332 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4209d017-c2aa-46bc-85e0-d53a1b7c49a0 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] 10.222.0.33 "GET /compute/v2.1/images/df3e3bf4-7b42-4c67-9f3e-0d79fa06e685" status: 200 len: 1422 microversion: 2.1 time: 0.111666 Sep 23 04:33:44.812123 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 396/814] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:33:44 2022] GET /compute/v2.1/images/df3e3bf4-7b42-4c67-9f3e-0d79fa06e685 => generated 1422 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:44.826133 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-5c3d0098-0ae5-456f-abd6-654d02540d91 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:44.840316 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5c3d0098-0ae5-456f-abd6-654d02540d91 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/f77bb6f0-6ce7-40d8-9cb2-2fcb559353ac" status: 200 len: 1267 microversion: 2.1 time: 0.285265 Sep 23 04:33:44.854884 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 419/815] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:44 2022] GET /compute/v2.1/servers/f77bb6f0-6ce7-40d8-9cb2-2fcb559353ac => generated 1267 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:45.189927 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0aa181f5-7679-494e-97eb-3ce483757763 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:45.190552 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-0aa181f5-7679-494e-97eb-3ce483757763 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: 09076cfa-4632-43c3-919d-4a8fe1b1bd37] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:45.197533 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0aa181f5-7679-494e-97eb-3ce483757763 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:45.198171 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0aa181f5-7679-494e-97eb-3ce483757763 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:45.198622 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0aa181f5-7679-494e-97eb-3ce483757763 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:45.199314 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0aa181f5-7679-494e-97eb-3ce483757763 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:45.207979 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0aa181f5-7679-494e-97eb-3ce483757763 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:45.208724 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0aa181f5-7679-494e-97eb-3ce483757763 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:45.392264 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-28dc8ea0-6c36-417f-b9b5-dec2169fa73f tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:45.402043 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-28dc8ea0-6c36-417f-b9b5-dec2169fa73f tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Searching by: {'deleted': False, 'project_id': '1c14e949d0e9418984a8541319a43dec'} {{(pid=122698) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 04:33:45.455913 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-28dc8ea0-6c36-417f-b9b5-dec2169fa73f tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:45.459313 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-28dc8ea0-6c36-417f-b9b5-dec2169fa73f tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:45.461031 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-28dc8ea0-6c36-417f-b9b5-dec2169fa73f tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:45.463899 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-28dc8ea0-6c36-417f-b9b5-dec2169fa73f tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:45.471239 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-28dc8ea0-6c36-417f-b9b5-dec2169fa73f tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:45.472276 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-28dc8ea0-6c36-417f-b9b5-dec2169fa73f tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:45.527783 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-0aa181f5-7679-494e-97eb-3ce483757763 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:45.556823 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0aa181f5-7679-494e-97eb-3ce483757763 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/09076cfa-4632-43c3-919d-4a8fe1b1bd37" status: 200 len: 1313 microversion: 2.1 time: 0.374000 Sep 23 04:33:45.558470 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 420/816] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:45 2022] GET /compute/v2.1/servers/09076cfa-4632-43c3-919d-4a8fe1b1bd37 => generated 1313 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:45.576258 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-da0e4aca-2ef5-488d-ba07-9fd513447728 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:45.579078 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-da0e4aca-2ef5-488d-ba07-9fd513447728 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] [instance: 9dede73d-62ac-481b-b990-41fd1039882a] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:45.712299 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-da0e4aca-2ef5-488d-ba07-9fd513447728 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3135a00fc94e488cb633b89d8768fe93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332a996884724d9eb16c79f46107c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:45.712299 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-da0e4aca-2ef5-488d-ba07-9fd513447728 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] 10.222.0.33 "GET /compute/v2.1/servers/9dede73d-62ac-481b-b990-41fd1039882a" status: 200 len: 1223 microversion: 2.1 time: 0.140417 Sep 23 04:33:45.712299 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 421/817] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:45 2022] GET /compute/v2.1/servers/9dede73d-62ac-481b-b990-41fd1039882a => generated 1223 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:45.721272 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-28dc8ea0-6c36-417f-b9b5-dec2169fa73f tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.907981 Sep 23 04:33:45.723960 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 397/818] 10.222.0.33 () {58 vars in 1146 bytes} [Fri Sep 23 04:33:44 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 04:33:45.752663 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ec4226ff-7101-4545-8d3d-8c71f6b3337d tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:45.765985 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ec4226ff-7101-4545-8d3d-8c71f6b3337d tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Searching by: {'deleted': False} {{(pid=122699) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 04:33:45.797677 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ec4226ff-7101-4545-8d3d-8c71f6b3337d tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:45.798605 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ec4226ff-7101-4545-8d3d-8c71f6b3337d tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:45.799693 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ec4226ff-7101-4545-8d3d-8c71f6b3337d tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:45.800810 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ec4226ff-7101-4545-8d3d-8c71f6b3337d tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:45.801781 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ec4226ff-7101-4545-8d3d-8c71f6b3337d tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:45.802310 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ec4226ff-7101-4545-8d3d-8c71f6b3337d tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:45.825478 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-96f962fa-5127-4bf8-8f5f-63423852e5ee tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Calling method '.version_select at 0x7ff1c0138550>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:46.003588 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-96f962fa-5127-4bf8-8f5f-63423852e5ee tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] 10.222.0.33 "GET /compute/v2.1/images/df3e3bf4-7b42-4c67-9f3e-0d79fa06e685" status: 200 len: 1422 microversion: 2.1 time: 0.185388 Sep 23 04:33:46.016183 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 398/819] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:33:45 2022] GET /compute/v2.1/images/df3e3bf4-7b42-4c67-9f3e-0d79fa06e685 => generated 1422 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:33:46.026250 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-51cf75b7-9fb3-447a-a4d7-0a5aecdde0df tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:46.027167 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-51cf75b7-9fb3-447a-a4d7-0a5aecdde0df tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: f77bb6f0-6ce7-40d8-9cb2-2fcb559353ac] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:46.041729 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-51cf75b7-9fb3-447a-a4d7-0a5aecdde0df tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:46.046823 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-51cf75b7-9fb3-447a-a4d7-0a5aecdde0df tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:46.047419 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-51cf75b7-9fb3-447a-a4d7-0a5aecdde0df tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:46.048248 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-51cf75b7-9fb3-447a-a4d7-0a5aecdde0df tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:46.048814 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-51cf75b7-9fb3-447a-a4d7-0a5aecdde0df tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:46.049480 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-51cf75b7-9fb3-447a-a4d7-0a5aecdde0df tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:46.143925 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.multi_cell_list [None req-ec4226ff-7101-4545-8d3d-8c71f6b3337d tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Listed batch of 12 results from cell out of 1000 limit. Returned 12 total so far. {{(pid=122699) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 23 04:33:46.297289 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-51cf75b7-9fb3-447a-a4d7-0a5aecdde0df tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:46.307017 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-51cf75b7-9fb3-447a-a4d7-0a5aecdde0df tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/f77bb6f0-6ce7-40d8-9cb2-2fcb559353ac" status: 200 len: 1309 microversion: 2.1 time: 0.286682 Sep 23 04:33:46.308125 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 399/820] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:46 2022] GET /compute/v2.1/servers/f77bb6f0-6ce7-40d8-9cb2-2fcb559353ac => generated 1309 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:46.347861 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ec4226ff-7101-4545-8d3d-8c71f6b3337d tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:46.348527 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ec4226ff-7101-4545-8d3d-8c71f6b3337d tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:46.348978 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ec4226ff-7101-4545-8d3d-8c71f6b3337d tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:46.597385 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0a192b26-9746-4377-9878-3b316024b66d tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:46.599280 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-0a192b26-9746-4377-9878-3b316024b66d tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: 09076cfa-4632-43c3-919d-4a8fe1b1bd37] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:46.611220 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0a192b26-9746-4377-9878-3b316024b66d tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:46.612560 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0a192b26-9746-4377-9878-3b316024b66d tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:46.613625 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0a192b26-9746-4377-9878-3b316024b66d tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:46.618951 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0a192b26-9746-4377-9878-3b316024b66d tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:46.618951 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0a192b26-9746-4377-9878-3b316024b66d tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:46.618951 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0a192b26-9746-4377-9878-3b316024b66d tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:47.020090 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-0a192b26-9746-4377-9878-3b316024b66d tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:47.029165 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0a192b26-9746-4377-9878-3b316024b66d tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/09076cfa-4632-43c3-919d-4a8fe1b1bd37" status: 200 len: 1313 microversion: 2.1 time: 0.440267 Sep 23 04:33:47.033700 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 400/821] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:46 2022] GET /compute/v2.1/servers/09076cfa-4632-43c3-919d-4a8fe1b1bd37 => generated 1313 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:33:47.046429 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7189873d-f9df-4720-8d6e-91cb5d849a67 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:47.048117 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7189873d-f9df-4720-8d6e-91cb5d849a67 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] [instance: 9dede73d-62ac-481b-b990-41fd1039882a] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:47.061691 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7189873d-f9df-4720-8d6e-91cb5d849a67 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:47.063579 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7189873d-f9df-4720-8d6e-91cb5d849a67 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:47.065423 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7189873d-f9df-4720-8d6e-91cb5d849a67 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:47.067970 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7189873d-f9df-4720-8d6e-91cb5d849a67 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:47.068691 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7189873d-f9df-4720-8d6e-91cb5d849a67 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:47.072816 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7189873d-f9df-4720-8d6e-91cb5d849a67 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:47.275764 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-7189873d-f9df-4720-8d6e-91cb5d849a67 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3135a00fc94e488cb633b89d8768fe93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332a996884724d9eb16c79f46107c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:47.300642 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7189873d-f9df-4720-8d6e-91cb5d849a67 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] 10.222.0.33 "GET /compute/v2.1/servers/9dede73d-62ac-481b-b990-41fd1039882a" status: 200 len: 1275 microversion: 2.1 time: 0.265425 Sep 23 04:33:47.305264 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 401/822] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:47 2022] GET /compute/v2.1/servers/9dede73d-62ac-481b-b990-41fd1039882a => generated 1275 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:47.322453 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-45650643-a88d-41aa-bab9-c88d3bf52a0c tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Calling method '.version_select at 0x7ff1bbe87160>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:47.396648 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-45650643-a88d-41aa-bab9-c88d3bf52a0c tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] 10.222.0.33 "GET /compute/v2.1/images/df3e3bf4-7b42-4c67-9f3e-0d79fa06e685" status: 200 len: 1422 microversion: 2.1 time: 0.089141 Sep 23 04:33:47.399764 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 402/823] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:33:47 2022] GET /compute/v2.1/images/df3e3bf4-7b42-4c67-9f3e-0d79fa06e685 => generated 1422 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:47.408850 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e33bc47b-8ebb-4e07-84a5-472f7b9024cf tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:47.412944 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e33bc47b-8ebb-4e07-84a5-472f7b9024cf tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: f77bb6f0-6ce7-40d8-9cb2-2fcb559353ac] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:47.425681 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e33bc47b-8ebb-4e07-84a5-472f7b9024cf tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:47.426515 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e33bc47b-8ebb-4e07-84a5-472f7b9024cf tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:47.427224 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e33bc47b-8ebb-4e07-84a5-472f7b9024cf tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:47.428191 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e33bc47b-8ebb-4e07-84a5-472f7b9024cf tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:47.428880 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e33bc47b-8ebb-4e07-84a5-472f7b9024cf tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:47.429504 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e33bc47b-8ebb-4e07-84a5-472f7b9024cf tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:47.546894 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ec4226ff-7101-4545-8d3d-8c71f6b3337d tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 19099 microversion: 2.1 time: 1.797849 Sep 23 04:33:47.548127 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 422/824] 10.222.0.33 () {58 vars in 1171 bytes} [Fri Sep 23 04:33:45 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 19099 bytes in 1800 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 04:33:47.637716 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d4501450-4168-46a1-96cf-7e1338c45e03 tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:47.647198 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d4501450-4168-46a1-96cf-7e1338c45e03 tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Searching by: {'deleted': False, 'project_id': '1c14e949d0e9418984a8541319a43dec'} {{(pid=122699) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 04:33:47.653358 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d4501450-4168-46a1-96cf-7e1338c45e03 tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:47.654864 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d4501450-4168-46a1-96cf-7e1338c45e03 tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:47.655626 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d4501450-4168-46a1-96cf-7e1338c45e03 tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:47.656677 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d4501450-4168-46a1-96cf-7e1338c45e03 tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:47.657234 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d4501450-4168-46a1-96cf-7e1338c45e03 tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:47.659757 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d4501450-4168-46a1-96cf-7e1338c45e03 tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:47.763434 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d4501450-4168-46a1-96cf-7e1338c45e03 tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/detail?tenant_id=44352a7a6d964530aa20ae83064b02e6" status: 200 len: 15 microversion: 2.1 time: 0.131481 Sep 23 04:33:47.764096 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 423/825] 10.222.0.33 () {58 vars in 1231 bytes} [Fri Sep 23 04:33:47 2022] GET /compute/v2.1/servers/detail?tenant_id=44352a7a6d964530aa20ae83064b02e6 => generated 15 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 04:33:47.789413 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0e447b3e-7d20-470d-9dfb-f963edfcce1f tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:47.797595 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-0e447b3e-7d20-470d-9dfb-f963edfcce1f tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Searching by: {'tenant_id': '44352a7a6d964530aa20ae83064b02e6', 'deleted': False} {{(pid=122699) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 04:33:47.802679 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0e447b3e-7d20-470d-9dfb-f963edfcce1f tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:47.803286 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0e447b3e-7d20-470d-9dfb-f963edfcce1f tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:47.803938 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0e447b3e-7d20-470d-9dfb-f963edfcce1f tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:47.804924 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0e447b3e-7d20-470d-9dfb-f963edfcce1f tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:47.805592 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0e447b3e-7d20-470d-9dfb-f963edfcce1f tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:47.806116 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0e447b3e-7d20-470d-9dfb-f963edfcce1f tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:47.838609 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.multi_cell_list [None req-0e447b3e-7d20-470d-9dfb-f963edfcce1f tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122699) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 23 04:33:47.906190 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e33bc47b-8ebb-4e07-84a5-472f7b9024cf tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:47.914615 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e33bc47b-8ebb-4e07-84a5-472f7b9024cf tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/f77bb6f0-6ce7-40d8-9cb2-2fcb559353ac" status: 200 len: 1309 microversion: 2.1 time: 0.513531 Sep 23 04:33:47.918630 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 403/826] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:47 2022] GET /compute/v2.1/servers/f77bb6f0-6ce7-40d8-9cb2-2fcb559353ac => generated 1309 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:47.972465 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0e447b3e-7d20-470d-9dfb-f963edfcce1f tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:47.972958 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0e447b3e-7d20-470d-9dfb-f963edfcce1f tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:47.973400 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0e447b3e-7d20-470d-9dfb-f963edfcce1f tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:48.059014 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-30821933-8466-44c3-9bf7-af06739b3f5e tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:48.059949 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-30821933-8466-44c3-9bf7-af06739b3f5e tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: 09076cfa-4632-43c3-919d-4a8fe1b1bd37] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:48.072010 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-30821933-8466-44c3-9bf7-af06739b3f5e tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:48.073201 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-30821933-8466-44c3-9bf7-af06739b3f5e tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:48.076115 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-30821933-8466-44c3-9bf7-af06739b3f5e tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:48.077145 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-30821933-8466-44c3-9bf7-af06739b3f5e tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:48.078344 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-30821933-8466-44c3-9bf7-af06739b3f5e tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:48.080500 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-30821933-8466-44c3-9bf7-af06739b3f5e tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:48.218700 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0e447b3e-7d20-470d-9dfb-f963edfcce1f tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=44352a7a6d964530aa20ae83064b02e6" status: 200 len: 4825 microversion: 2.1 time: 0.432841 Sep 23 04:33:48.220259 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 424/827] 10.222.0.33 () {58 vars in 1257 bytes} [Fri Sep 23 04:33:47 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=44352a7a6d964530aa20ae83064b02e6 => generated 4825 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:33:48.247081 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3ba1e4b0-9aa2-4769-bc0a-8aea8c1f68b3 tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:48.253778 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-3ba1e4b0-9aa2-4769-bc0a-8aea8c1f68b3 tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Searching by: {'tenant_id': '1c14e949d0e9418984a8541319a43dec', 'deleted': False} {{(pid=122699) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 04:33:48.260216 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3ba1e4b0-9aa2-4769-bc0a-8aea8c1f68b3 tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:48.260960 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3ba1e4b0-9aa2-4769-bc0a-8aea8c1f68b3 tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:48.261615 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3ba1e4b0-9aa2-4769-bc0a-8aea8c1f68b3 tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:48.262875 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3ba1e4b0-9aa2-4769-bc0a-8aea8c1f68b3 tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:48.263731 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3ba1e4b0-9aa2-4769-bc0a-8aea8c1f68b3 tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:48.264368 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3ba1e4b0-9aa2-4769-bc0a-8aea8c1f68b3 tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:48.300397 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3ba1e4b0-9aa2-4769-bc0a-8aea8c1f68b3 tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=1c14e949d0e9418984a8541319a43dec" status: 200 len: 15 microversion: 2.1 time: 0.056864 Sep 23 04:33:48.320355 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 425/828] 10.222.0.33 () {58 vars in 1257 bytes} [Fri Sep 23 04:33:48 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=1c14e949d0e9418984a8541319a43dec => generated 15 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 23 04:33:48.325883 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2e3bbc0c-324e-4349-8cad-239a5b601ab6 tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:48.332073 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2e3bbc0c-324e-4349-8cad-239a5b601ab6 tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.010038 Sep 23 04:33:48.334426 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 426/829] 10.222.0.33 () {58 vars in 1189 bytes} [Fri Sep 23 04:33:48 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 04:33:48.350074 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c16c1788-2beb-4aab-9881-6ea2931445e4 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:48.352571 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c16c1788-2beb-4aab-9881-6ea2931445e4 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] [instance: 9dede73d-62ac-481b-b990-41fd1039882a] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:48.366362 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c16c1788-2beb-4aab-9881-6ea2931445e4 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:48.366874 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c16c1788-2beb-4aab-9881-6ea2931445e4 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:48.367421 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c16c1788-2beb-4aab-9881-6ea2931445e4 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:48.368147 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c16c1788-2beb-4aab-9881-6ea2931445e4 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:48.368609 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c16c1788-2beb-4aab-9881-6ea2931445e4 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:48.369087 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c16c1788-2beb-4aab-9881-6ea2931445e4 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:48.733203 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-30821933-8466-44c3-9bf7-af06739b3f5e tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:48.745510 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-30821933-8466-44c3-9bf7-af06739b3f5e tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/09076cfa-4632-43c3-919d-4a8fe1b1bd37" status: 200 len: 1463 microversion: 2.1 time: 0.690953 Sep 23 04:33:48.746444 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 404/830] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:48 2022] GET /compute/v2.1/servers/09076cfa-4632-43c3-919d-4a8fe1b1bd37 => generated 1463 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:48.754092 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c16c1788-2beb-4aab-9881-6ea2931445e4 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3135a00fc94e488cb633b89d8768fe93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332a996884724d9eb16c79f46107c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:48.776079 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-cc8a60fd-6c0d-49fa-ad15-79b78c39e22d tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:33:48.778469 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-cc8a60fd-6c0d-49fa-ad15-79b78c39e22d tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] [instance: f392741f-f967-4c1c-930b-4eea7272bf64] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:48.782376 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c16c1788-2beb-4aab-9881-6ea2931445e4 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] 10.222.0.33 "GET /compute/v2.1/servers/9dede73d-62ac-481b-b990-41fd1039882a" status: 200 len: 1283 microversion: 2.1 time: 0.427743 Sep 23 04:33:48.783607 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 427/831] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:48 2022] GET /compute/v2.1/servers/9dede73d-62ac-481b-b990-41fd1039882a => generated 1283 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:48.788560 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-13b93554-28f7-42cf-bd82-9ad38690fbde tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Calling method '.version_select at 0x7ff1c04d7a60>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:48.798874 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cc8a60fd-6c0d-49fa-ad15-79b78c39e22d tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:48.800040 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cc8a60fd-6c0d-49fa-ad15-79b78c39e22d tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:48.800921 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cc8a60fd-6c0d-49fa-ad15-79b78c39e22d tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:48.801944 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cc8a60fd-6c0d-49fa-ad15-79b78c39e22d tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:48.815494 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cc8a60fd-6c0d-49fa-ad15-79b78c39e22d tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:48.816385 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cc8a60fd-6c0d-49fa-ad15-79b78c39e22d tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:48.867417 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-13b93554-28f7-42cf-bd82-9ad38690fbde tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] 10.222.0.33 "GET /compute/v2.1/images/df3e3bf4-7b42-4c67-9f3e-0d79fa06e685" status: 200 len: 1431 microversion: 2.1 time: 0.082445 Sep 23 04:33:48.868663 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 428/832] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:33:48 2022] GET /compute/v2.1/images/df3e3bf4-7b42-4c67-9f3e-0d79fa06e685 => generated 1431 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:48.882578 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e08f58c5-91eb-4b0d-8b49-afcdb8885b80 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:33:48.885135 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e08f58c5-91eb-4b0d-8b49-afcdb8885b80 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: 09076cfa-4632-43c3-919d-4a8fe1b1bd37] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:48.893643 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e08f58c5-91eb-4b0d-8b49-afcdb8885b80 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:48.894429 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e08f58c5-91eb-4b0d-8b49-afcdb8885b80 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:48.897019 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e08f58c5-91eb-4b0d-8b49-afcdb8885b80 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:48.898057 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e08f58c5-91eb-4b0d-8b49-afcdb8885b80 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:48.898715 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e08f58c5-91eb-4b0d-8b49-afcdb8885b80 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:48.899348 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e08f58c5-91eb-4b0d-8b49-afcdb8885b80 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:49.008996 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e08f58c5-91eb-4b0d-8b49-afcdb8885b80 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:49.017188 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e08f58c5-91eb-4b0d-8b49-afcdb8885b80 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: 09076cfa-4632-43c3-919d-4a8fe1b1bd37] Old instance type m1.heat2, new instance type m1.heat {{(pid=122699) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 23 04:33:49.026070 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-e08f58c5-91eb-4b0d-8b49-afcdb8885b80 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Flavor limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:33:49.026766 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-e08f58c5-91eb-4b0d-8b49-afcdb8885b80 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Image limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:33:49.027503 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-e08f58c5-91eb-4b0d-8b49-afcdb8885b80 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Flavor pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:33:49.028155 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-e08f58c5-91eb-4b0d-8b49-afcdb8885b80 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Image pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:33:49.028810 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-e08f58c5-91eb-4b0d-8b49-afcdb8885b80 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:33:49.217870 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-cc8a60fd-6c0d-49fa-ad15-79b78c39e22d tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64/action" status: 202 len: 0 microversion: 2.1 time: 0.470126 Sep 23 04:33:49.222144 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 405/833] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:33:48 2022] POST /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64/action => generated 0 bytes in 475 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:33:49.227203 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-26f06ccb-acf5-463b-9ae3-626957452258 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Calling method '.version_select at 0x7ff1bbe699d0>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:49.292129 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-26f06ccb-acf5-463b-9ae3-626957452258 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] 10.222.0.33 "GET /compute/v2.1/images/df3e3bf4-7b42-4c67-9f3e-0d79fa06e685" status: 200 len: 1431 microversion: 2.1 time: 0.068682 Sep 23 04:33:49.292996 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 406/834] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:33:49 2022] GET /compute/v2.1/images/df3e3bf4-7b42-4c67-9f3e-0d79fa06e685 => generated 1431 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:49.301825 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a9b0dbf1-2579-447f-9771-158df3485757 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:49.303096 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a9b0dbf1-2579-447f-9771-158df3485757 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: f77bb6f0-6ce7-40d8-9cb2-2fcb559353ac] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:49.309921 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a9b0dbf1-2579-447f-9771-158df3485757 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:49.310465 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a9b0dbf1-2579-447f-9771-158df3485757 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:49.310915 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a9b0dbf1-2579-447f-9771-158df3485757 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:49.311665 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a9b0dbf1-2579-447f-9771-158df3485757 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:49.312132 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a9b0dbf1-2579-447f-9771-158df3485757 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:49.312572 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a9b0dbf1-2579-447f-9771-158df3485757 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:49.333643 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e08f58c5-91eb-4b0d-8b49-afcdb8885b80 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "POST /compute/v2.1/servers/09076cfa-4632-43c3-919d-4a8fe1b1bd37/action" status: 202 len: 0 microversion: 2.1 time: 0.461116 Sep 23 04:33:49.335223 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 429/835] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:33:48 2022] POST /compute/v2.1/servers/09076cfa-4632-43c3-919d-4a8fe1b1bd37/action => generated 0 bytes in 466 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:33:49.342612 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-048f88a4-17c3-425c-8266-9891eca5b9c7 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:49.351077 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-048f88a4-17c3-425c-8266-9891eca5b9c7 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd1c82752e1bc4fdb82e7f8391c7c129f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44352a7a6d964530aa20ae83064b02e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:49.352400 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-048f88a4-17c3-425c-8266-9891eca5b9c7 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '44352a7a6d964530aa20ae83064b02e6'} {{(pid=122699) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 04:33:49.370032 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-048f88a4-17c3-425c-8266-9891eca5b9c7 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:49.371031 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-048f88a4-17c3-425c-8266-9891eca5b9c7 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:49.375099 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-048f88a4-17c3-425c-8266-9891eca5b9c7 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:49.375099 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-048f88a4-17c3-425c-8266-9891eca5b9c7 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:49.375099 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-048f88a4-17c3-425c-8266-9891eca5b9c7 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:49.375099 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-048f88a4-17c3-425c-8266-9891eca5b9c7 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:49.493809 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.multi_cell_list [None req-048f88a4-17c3-425c-8266-9891eca5b9c7 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122699) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 23 04:33:49.609692 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-048f88a4-17c3-425c-8266-9891eca5b9c7 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] 10.222.0.33 "GET /compute/v2.1/servers?status=error" status: 200 len: 339 microversion: 2.1 time: 0.273196 Sep 23 04:33:49.613768 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 430/836] 10.222.0.33 () {58 vars in 1150 bytes} [Fri Sep 23 04:33:49 2022] GET /compute/v2.1/servers?status=error => generated 339 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:33:49.624234 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-6056027b-d368-43ea-ab4b-7ec0253e6638 req-0cc377de-de72-450e-ad4c-ce31b8a9ec90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f77bb6f0-6ce7-40d8-9cb2-2fcb559353ac", "tag": "f109c520-e5ff-40d8-a820-4cc8e75e5e84"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:33:49.636180 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-6056027b-d368-43ea-ab4b-7ec0253e6638 req-0cc377de-de72-450e-ad4c-ce31b8a9ec90 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:49.643149 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-6056027b-d368-43ea-ab4b-7ec0253e6638 req-0cc377de-de72-450e-ad4c-ce31b8a9ec90 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:49.643149 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-6056027b-d368-43ea-ab4b-7ec0253e6638 req-0cc377de-de72-450e-ad4c-ce31b8a9ec90 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:49.663248 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-6056027b-d368-43ea-ab4b-7ec0253e6638 req-0cc377de-de72-450e-ad4c-ce31b8a9ec90 service nova] Creating event network-changed:f109c520-e5ff-40d8-a820-4cc8e75e5e84 for instance f77bb6f0-6ce7-40d8-9cb2-2fcb559353ac on n-h2-846463-3 Sep 23 04:33:49.666250 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a9b0dbf1-2579-447f-9771-158df3485757 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:49.671279 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-6056027b-d368-43ea-ab4b-7ec0253e6638 req-0cc377de-de72-450e-ad4c-ce31b8a9ec90 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055645 Sep 23 04:33:49.672041 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 431/837] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:33:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:33:49.677780 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f3d532e9-52b1-4fd8-a930-e00ef26ef9bb tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:49.679452 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f3d532e9-52b1-4fd8-a930-e00ef26ef9bb tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] [instance: 70213e65-9664-4df1-81d7-747c462fa434] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:49.682191 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a9b0dbf1-2579-447f-9771-158df3485757 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/f77bb6f0-6ce7-40d8-9cb2-2fcb559353ac" status: 200 len: 1309 microversion: 2.1 time: 0.386251 Sep 23 04:33:49.687178 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f3d532e9-52b1-4fd8-a930-e00ef26ef9bb tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:49.687807 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f3d532e9-52b1-4fd8-a930-e00ef26ef9bb tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:49.688494 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f3d532e9-52b1-4fd8-a930-e00ef26ef9bb tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:49.689339 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f3d532e9-52b1-4fd8-a930-e00ef26ef9bb tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:49.690038 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f3d532e9-52b1-4fd8-a930-e00ef26ef9bb tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:49.690557 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f3d532e9-52b1-4fd8-a930-e00ef26ef9bb tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:49.696803 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 407/838] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:49 2022] GET /compute/v2.1/servers/f77bb6f0-6ce7-40d8-9cb2-2fcb559353ac => generated 1309 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:49.706805 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-22f7b037-0759-48f4-a942-dac62d905f90 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:49.707990 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-22f7b037-0759-48f4-a942-dac62d905f90 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: 09076cfa-4632-43c3-919d-4a8fe1b1bd37] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:49.718590 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-22f7b037-0759-48f4-a942-dac62d905f90 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:49.719079 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-22f7b037-0759-48f4-a942-dac62d905f90 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:49.719523 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-22f7b037-0759-48f4-a942-dac62d905f90 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:49.723522 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-22f7b037-0759-48f4-a942-dac62d905f90 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:49.723522 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-22f7b037-0759-48f4-a942-dac62d905f90 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:49.723522 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-22f7b037-0759-48f4-a942-dac62d905f90 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:49.937761 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-22f7b037-0759-48f4-a942-dac62d905f90 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:49.951161 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f3d532e9-52b1-4fd8-a930-e00ef26ef9bb tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3ff8d26a3f4831b3ec766bea65e143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98e78e2969a446b8fdbf772b36dd0c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:49.953567 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:33:49.961014 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-22f7b037-0759-48f4-a942-dac62d905f90 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/09076cfa-4632-43c3-919d-4a8fe1b1bd37" status: 200 len: 1472 microversion: 2.1 time: 0.258075 Sep 23 04:33:49.961213 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f3d532e9-52b1-4fd8-a930-e00ef26ef9bb tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] 10.222.0.33 "GET /compute/v2.1/servers/70213e65-9664-4df1-81d7-747c462fa434" status: 200 len: 1467 microversion: 2.1 time: 0.287808 Sep 23 04:33:49.961731 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 432/839] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:49 2022] GET /compute/v2.1/servers/70213e65-9664-4df1-81d7-747c462fa434 => generated 1467 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:49.964386 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 408/840] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:49 2022] GET /compute/v2.1/servers/09076cfa-4632-43c3-919d-4a8fe1b1bd37 => generated 1472 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:49.975919 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4a924fa2-911d-43a8-8b70-c6ee3fa783fb tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:49.976878 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4a924fa2-911d-43a8-8b70-c6ee3fa783fb tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] [instance: 9dede73d-62ac-481b-b990-41fd1039882a] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:49.986112 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6c8cc095-69eb-4822-aad4-971ae40373b2 tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:33:49.986254 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4a924fa2-911d-43a8-8b70-c6ee3fa783fb tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:49.986374 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-6c8cc095-69eb-4822-aad4-971ae40373b2 tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] [instance: f392741f-f967-4c1c-930b-4eea7272bf64] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:49.986484 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4a924fa2-911d-43a8-8b70-c6ee3fa783fb tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:49.986816 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4a924fa2-911d-43a8-8b70-c6ee3fa783fb tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:49.987767 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4a924fa2-911d-43a8-8b70-c6ee3fa783fb tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:49.988769 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4a924fa2-911d-43a8-8b70-c6ee3fa783fb tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:49.989916 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4a924fa2-911d-43a8-8b70-c6ee3fa783fb tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:49.996148 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6c8cc095-69eb-4822-aad4-971ae40373b2 tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:49.998030 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6c8cc095-69eb-4822-aad4-971ae40373b2 tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:49.998656 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6c8cc095-69eb-4822-aad4-971ae40373b2 tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:50.000325 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6c8cc095-69eb-4822-aad4-971ae40373b2 tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:50.002545 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6c8cc095-69eb-4822-aad4-971ae40373b2 tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:50.003158 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6c8cc095-69eb-4822-aad4-971ae40373b2 tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:50.076870 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4a924fa2-911d-43a8-8b70-c6ee3fa783fb tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3135a00fc94e488cb633b89d8768fe93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332a996884724d9eb16c79f46107c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:50.084644 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4a924fa2-911d-43a8-8b70-c6ee3fa783fb tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] 10.222.0.33 "GET /compute/v2.1/servers/9dede73d-62ac-481b-b990-41fd1039882a" status: 200 len: 1281 microversion: 2.1 time: 0.116442 Sep 23 04:33:50.085216 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 409/841] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:49 2022] GET /compute/v2.1/servers/9dede73d-62ac-481b-b990-41fd1039882a => generated 1281 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:50.089906 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7716615f-d423-4940-8297-c1b6d14958ea tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Calling method '.version_select at 0x7ff1bbfedca0>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:50.150980 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7716615f-d423-4940-8297-c1b6d14958ea tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] 10.222.0.33 "GET /compute/v2.1/images/b8dd79b9-f0b9-43a9-9605-17244137c0ee" status: 200 len: 784 microversion: 2.1 time: 0.064554 Sep 23 04:33:50.160999 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 410/842] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:33:50 2022] GET /compute/v2.1/images/b8dd79b9-f0b9-43a9-9605-17244137c0ee => generated 784 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:33:50.169662 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-532697c8-75f3-4fec-af1e-9a55658ce663 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:50.201050 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-532697c8-75f3-4fec-af1e-9a55658ce663 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.032037 Sep 23 04:33:50.202605 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 411/843] 10.222.0.33 () {58 vars in 1137 bytes} [Fri Sep 23 04:33:50 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:33:50.215424 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1e30c0ab-6e0c-4a0d-b8ba-002786c8a33d tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Calling method '.version_select at 0x7ff1bbfed160>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:50.425142 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6c8cc095-69eb-4822-aad4-971ae40373b2 tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64/action" status: 202 len: 0 microversion: 2.1 time: 0.460755 Sep 23 04:33:50.430143 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 433/844] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:33:49 2022] POST /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64/action => generated 0 bytes in 468 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:33:50.449794 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-02525f01-24a1-4e0b-9e88-72878139ffca tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:50.454999 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-02525f01-24a1-4e0b-9e88-72878139ffca tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] [instance: f392741f-f967-4c1c-930b-4eea7272bf64] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:50.477098 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-02525f01-24a1-4e0b-9e88-72878139ffca tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:50.477671 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-02525f01-24a1-4e0b-9e88-72878139ffca tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:50.478171 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-02525f01-24a1-4e0b-9e88-72878139ffca tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:50.479013 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-02525f01-24a1-4e0b-9e88-72878139ffca tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:50.479487 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-02525f01-24a1-4e0b-9e88-72878139ffca tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:50.479920 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-02525f01-24a1-4e0b-9e88-72878139ffca tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:51.039268 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-02525f01-24a1-4e0b-9e88-72878139ffca tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64" status: 200 len: 1614 microversion: 2.1 time: 0.604924 Sep 23 04:33:51.039862 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 434/845] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:50 2022] GET /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64 => generated 1614 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:51.055587 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-71b6457d-2954-406f-a007-859637f2f29d tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:51.056211 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-71b6457d-2954-406f-a007-859637f2f29d tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: f77bb6f0-6ce7-40d8-9cb2-2fcb559353ac] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:51.076610 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-71b6457d-2954-406f-a007-859637f2f29d tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:51.077378 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-71b6457d-2954-406f-a007-859637f2f29d tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:51.078741 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-71b6457d-2954-406f-a007-859637f2f29d tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:51.079762 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-71b6457d-2954-406f-a007-859637f2f29d tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:51.080974 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-71b6457d-2954-406f-a007-859637f2f29d tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:51.082015 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-71b6457d-2954-406f-a007-859637f2f29d tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:51.398486 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-71b6457d-2954-406f-a007-859637f2f29d tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:51.407319 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-71b6457d-2954-406f-a007-859637f2f29d tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/f77bb6f0-6ce7-40d8-9cb2-2fcb559353ac" status: 200 len: 1309 microversion: 2.1 time: 0.359466 Sep 23 04:33:51.432120 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 435/846] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:51 2022] GET /compute/v2.1/servers/f77bb6f0-6ce7-40d8-9cb2-2fcb559353ac => generated 1309 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:51.441022 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5742e727-ba71-4e95-9f1a-54737258b1f3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:51.442648 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-5742e727-ba71-4e95-9f1a-54737258b1f3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: 09076cfa-4632-43c3-919d-4a8fe1b1bd37] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:51.454863 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5742e727-ba71-4e95-9f1a-54737258b1f3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:51.455418 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5742e727-ba71-4e95-9f1a-54737258b1f3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:51.455967 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5742e727-ba71-4e95-9f1a-54737258b1f3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:51.456689 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5742e727-ba71-4e95-9f1a-54737258b1f3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:51.457372 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5742e727-ba71-4e95-9f1a-54737258b1f3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:51.458229 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5742e727-ba71-4e95-9f1a-54737258b1f3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:51.854361 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-5742e727-ba71-4e95-9f1a-54737258b1f3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:51.862176 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5742e727-ba71-4e95-9f1a-54737258b1f3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/09076cfa-4632-43c3-919d-4a8fe1b1bd37" status: 200 len: 1472 microversion: 2.1 time: 0.428316 Sep 23 04:33:51.862770 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 436/847] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:51 2022] GET /compute/v2.1/servers/09076cfa-4632-43c3-919d-4a8fe1b1bd37 => generated 1472 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:51.874070 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5f778a0f-8cc0-4c3a-97b8-b1bb645cea49 tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:51.874597 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-5f778a0f-8cc0-4c3a-97b8-b1bb645cea49 tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] [instance: f392741f-f967-4c1c-930b-4eea7272bf64] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:51.891372 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5f778a0f-8cc0-4c3a-97b8-b1bb645cea49 tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:51.892138 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5f778a0f-8cc0-4c3a-97b8-b1bb645cea49 tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:51.892581 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5f778a0f-8cc0-4c3a-97b8-b1bb645cea49 tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:51.893304 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5f778a0f-8cc0-4c3a-97b8-b1bb645cea49 tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:51.893770 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5f778a0f-8cc0-4c3a-97b8-b1bb645cea49 tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:51.898049 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5f778a0f-8cc0-4c3a-97b8-b1bb645cea49 tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:52.132045 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-1e30c0ab-6e0c-4a0d-b8ba-002786c8a33d tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] 10.222.0.33 "DELETE /compute/v2.1/images/df3e3bf4-7b42-4c67-9f3e-0d79fa06e685" status: 204 len: 0 microversion: 2.1 time: 1.914438 Sep 23 04:33:52.132045 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 412/848] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:50 2022] DELETE /compute/v2.1/images/df3e3bf4-7b42-4c67-9f3e-0d79fa06e685 => generated 0 bytes in 1916 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 23 04:33:52.134924 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-84fda1ef-9877-4367-8c61-837331efb616 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:52.135745 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-84fda1ef-9877-4367-8c61-837331efb616 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] [instance: 9dede73d-62ac-481b-b990-41fd1039882a] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:52.152737 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-84fda1ef-9877-4367-8c61-837331efb616 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:52.153251 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-84fda1ef-9877-4367-8c61-837331efb616 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:52.153737 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-84fda1ef-9877-4367-8c61-837331efb616 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:52.154585 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-84fda1ef-9877-4367-8c61-837331efb616 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:52.154964 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-84fda1ef-9877-4367-8c61-837331efb616 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:52.155399 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-84fda1ef-9877-4367-8c61-837331efb616 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:52.480863 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5f778a0f-8cc0-4c3a-97b8-b1bb645cea49 tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64" status: 200 len: 1614 microversion: 2.1 time: 0.616870 Sep 23 04:33:52.482992 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 437/849] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:51 2022] GET /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64 => generated 1614 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:52.488446 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c8fe11ba-5262-4346-a855-d46c0cee4d69 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Calling method '.version_select at 0x7ff1c00ea5e0>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:52.514817 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-c8fe11ba-5262-4346-a855-d46c0cee4d69 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] HTTP exception thrown: Image not found. Sep 23 04:33:52.524924 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c8fe11ba-5262-4346-a855-d46c0cee4d69 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Request method failure captured: Sep 23 04:33:52.524924 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/images/df3e3bf4-7b42-4c67-9f3e-0d79fa06e685 HTTP/1.1 Sep 23 04:33:52.524924 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:33:52.524924 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:33:52.524924 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:33:52.524924 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:33:52.524924 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:33:52.524924 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:33:52.524924 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:33:52.524924 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:33:52.524924 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTbyr0QAWrNVBHBdYJI8ZB0I-MdaPhfBbuUHn552mhoNCE7FKWgFrVCPdLHp6_RRB3WtJZFMjVi5D-2nEiDXiwHI2K_DZsxDzKWxHer_EllxjXQnw6BXm5Ybxb7rX2EwQmmXg-jSYoOTZeH1scJiFODZiqnLNODjjnbExkCpCsbMjKE Sep 23 04:33:52.524924 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:33:52.524924 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:33:52.524924 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:33:52.524924 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:33:52.524924 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:33:52.524924 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:33:52.524924 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: f98e78e2969a446b8fdbf772b36dd0c3 Sep 23 04:33:52.524924 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ImagesOneServerTestJSON-405748545 Sep 23 04:33:52.524924 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:33:52.524924 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:33:52.531465 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f98e78e2969a446b8fdbf772b36dd0c3", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f98e78e2969a446b8fdbf772b36dd0c3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f98e78e2969a446b8fdbf772b36dd0c3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f98e78e2969a446b8fdbf772b36dd0c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:33:52.531465 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ImagesOneServerTestJSON-405748545 Sep 23 04:33:52.531465 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: f98e78e2969a446b8fdbf772b36dd0c3 Sep 23 04:33:52.531465 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-405748545 Sep 23 04:33:52.531465 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ImagesOneServerTestJSON-405748545-project Sep 23 04:33:52.531465 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:33:52.531465 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:33:52.531465 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: cb3ff8d26a3f4831b3ec766bea65e143 Sep 23 04:33:52.531465 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ImagesOneServerTestJSON-405748545-project Sep 23 04:33:52.531465 n-d-846463-3 devstack@n-api.service[122699]: method: Sep 23 04:33:52.531465 n-d-846463-3 devstack@n-api.service[122699]: exception: Image not found. Sep 23 04:33:52.531465 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': 'df3e3bf4-7b42-4c67-9f3e-0d79fa06e685'} Sep 23 04:33:52.531465 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:33:52.532670 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:33:52.532670 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 23 04:33:52.532670 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 23 04:33:52.532670 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 23 04:33:52.532670 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 23 04:33:52.532670 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 23 04:33:52.532670 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 23 04:33:52.532670 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 23 04:33:52.532670 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 23 04:33:52.532670 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 23 04:33:52.532670 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 23 04:33:52.532670 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 23 04:33:52.532670 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 23 04:33:52.532670 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 23 04:33:52.532670 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 23 04:33:52.532670 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 23 04:33:52.532670 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 23 04:33:52.532670 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID df3e3bf4-7b42-4c67-9f3e-0d79fa06e685 Sep 23 04:33:52.534029 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:33:52.534029 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:33:52.534029 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:33:52.534029 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:33:52.534029 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Sep 23 04:33:52.534029 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Sep 23 04:33:52.534029 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 23 04:33:52.534029 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 23 04:33:52.534029 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 23 04:33:52.534029 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 23 04:33:52.534029 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 23 04:33:52.534029 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 23 04:33:52.534029 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 23 04:33:52.534029 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 23 04:33:52.534029 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 23 04:33:52.534029 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 23 04:33:52.534029 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 23 04:33:52.534029 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 23 04:33:52.534029 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 23 04:33:52.534029 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 23 04:33:52.535356 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 23 04:33:52.535356 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 23 04:33:52.535356 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 23 04:33:52.535356 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 23 04:33:52.535356 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 23 04:33:52.535356 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 23 04:33:52.535356 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 23 04:33:52.535356 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 23 04:33:52.535356 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image df3e3bf4-7b42-4c67-9f3e-0d79fa06e685 could not be found. Sep 23 04:33:52.535356 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:33:52.535356 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:33:52.535356 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:33:52.535356 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:33:52.535356 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:33:52.535356 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:33:52.535356 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:33:52.535356 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:33:52.535356 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:33:52.535356 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:33:52.537106 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:33:52.537106 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:33:52.537106 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Sep 23 04:33:52.537106 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 23 04:33:52.537106 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 23 04:33:52.537106 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:33:52.537106 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:33:52.537106 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:33:52.537106 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:33:52.537106 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:33:52.537106 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:33:52.537106 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:33:52.537106 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:33:52.537106 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 23 04:33:52.537106 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:33:52.537106 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c8fe11ba-5262-4346-a855-d46c0cee4d69 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Returning 404 to user: Image not found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:33:52.537106 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c8fe11ba-5262-4346-a855-d46c0cee4d69 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] 10.222.0.33 "GET /compute/v2.1/images/df3e3bf4-7b42-4c67-9f3e-0d79fa06e685" status: 404 len: 62 microversion: 2.1 time: 0.042244 Sep 23 04:33:52.538510 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 438/850] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:33:52 2022] GET /compute/v2.1/images/df3e3bf4-7b42-4c67-9f3e-0d79fa06e685 => generated 62 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 23 04:33:52.541911 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-73e67018-fdc6-4806-8d0b-5684ca989394 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:52.542565 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-73e67018-fdc6-4806-8d0b-5684ca989394 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: f77bb6f0-6ce7-40d8-9cb2-2fcb559353ac] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:52.554482 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-73e67018-fdc6-4806-8d0b-5684ca989394 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:52.555529 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-73e67018-fdc6-4806-8d0b-5684ca989394 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:52.569001 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-73e67018-fdc6-4806-8d0b-5684ca989394 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:52.569786 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-73e67018-fdc6-4806-8d0b-5684ca989394 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:52.571231 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-73e67018-fdc6-4806-8d0b-5684ca989394 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:52.572316 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-73e67018-fdc6-4806-8d0b-5684ca989394 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:52.705682 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-84fda1ef-9877-4367-8c61-837331efb616 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3135a00fc94e488cb633b89d8768fe93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332a996884724d9eb16c79f46107c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:52.719041 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-84fda1ef-9877-4367-8c61-837331efb616 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] 10.222.0.33 "GET /compute/v2.1/servers/9dede73d-62ac-481b-b990-41fd1039882a" status: 200 len: 1323 microversion: 2.1 time: 0.588884 Sep 23 04:33:52.720796 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 413/851] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:52 2022] GET /compute/v2.1/servers/9dede73d-62ac-481b-b990-41fd1039882a => generated 1323 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:52.726586 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-61ca3acf-d8f7-4293-a0c8-ee147837fa99 tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:52.735813 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-61ca3acf-d8f7-4293-a0c8-ee147837fa99 tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Searching by: {'host': 'n-h1-846463-3', 'deleted': False} {{(pid=122698) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 04:33:52.743938 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-61ca3acf-d8f7-4293-a0c8-ee147837fa99 tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:52.745100 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-61ca3acf-d8f7-4293-a0c8-ee147837fa99 tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:52.747145 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-61ca3acf-d8f7-4293-a0c8-ee147837fa99 tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:52.748279 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-61ca3acf-d8f7-4293-a0c8-ee147837fa99 tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:52.748957 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-61ca3acf-d8f7-4293-a0c8-ee147837fa99 tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:52.749860 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-61ca3acf-d8f7-4293-a0c8-ee147837fa99 tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:52.893129 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.multi_cell_list [None req-61ca3acf-d8f7-4293-a0c8-ee147837fa99 tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Listed batch of 7 results from cell out of 1000 limit. Returned 7 total so far. {{(pid=122698) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 23 04:33:53.044636 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-61ca3acf-d8f7-4293-a0c8-ee147837fa99 tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] 10.222.0.33 "GET /compute/v2.1/servers?host=n-h1-846463-3&all_tenants=1" status: 200 len: 2332 microversion: 2.1 time: 0.321750 Sep 23 04:33:53.046367 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 414/852] 10.222.0.33 () {58 vars in 1190 bytes} [Fri Sep 23 04:33:52 2022] GET /compute/v2.1/servers?host=n-h1-846463-3&all_tenants=1 => generated 2332 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:53.053550 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7a1aa13e-541f-47ee-a2ec-8c4c6fd8efa7 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-1159611137"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:33:53.057048 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7a1aa13e-541f-47ee-a2ec-8c4c6fd8efa7 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] [instance: 70213e65-9664-4df1-81d7-747c462fa434] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:53.065380 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7a1aa13e-541f-47ee-a2ec-8c4c6fd8efa7 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:53.066110 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7a1aa13e-541f-47ee-a2ec-8c4c6fd8efa7 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:53.067174 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7a1aa13e-541f-47ee-a2ec-8c4c6fd8efa7 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:53.068011 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7a1aa13e-541f-47ee-a2ec-8c4c6fd8efa7 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:53.068553 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7a1aa13e-541f-47ee-a2ec-8c4c6fd8efa7 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:53.069063 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7a1aa13e-541f-47ee-a2ec-8c4c6fd8efa7 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:53.129717 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-73e67018-fdc6-4806-8d0b-5684ca989394 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:53.144296 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-73e67018-fdc6-4806-8d0b-5684ca989394 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/f77bb6f0-6ce7-40d8-9cb2-2fcb559353ac" status: 200 len: 1309 microversion: 2.1 time: 0.614952 Sep 23 04:33:53.146048 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 439/853] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:52 2022] GET /compute/v2.1/servers/f77bb6f0-6ce7-40d8-9cb2-2fcb559353ac => generated 1309 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:53.152676 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e8f1b0ae-bc96-475c-87ca-af4ad2b02bd8 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:53.154108 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e8f1b0ae-bc96-475c-87ca-af4ad2b02bd8 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: 09076cfa-4632-43c3-919d-4a8fe1b1bd37] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:53.177220 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e8f1b0ae-bc96-475c-87ca-af4ad2b02bd8 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:53.178301 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e8f1b0ae-bc96-475c-87ca-af4ad2b02bd8 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:53.179679 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e8f1b0ae-bc96-475c-87ca-af4ad2b02bd8 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:53.182992 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e8f1b0ae-bc96-475c-87ca-af4ad2b02bd8 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:53.184796 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e8f1b0ae-bc96-475c-87ca-af4ad2b02bd8 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:53.186598 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e8f1b0ae-bc96-475c-87ca-af4ad2b02bd8 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:53.589406 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e8f1b0ae-bc96-475c-87ca-af4ad2b02bd8 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:53.599043 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e8f1b0ae-bc96-475c-87ca-af4ad2b02bd8 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/09076cfa-4632-43c3-919d-4a8fe1b1bd37" status: 200 len: 1472 microversion: 2.1 time: 0.450830 Sep 23 04:33:53.600121 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 440/854] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:53 2022] GET /compute/v2.1/servers/09076cfa-4632-43c3-919d-4a8fe1b1bd37 => generated 1472 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:53.612980 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b6cafef4-f3b8-4d75-9db8-9f37b9fdfcd0 tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:53.619597 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b6cafef4-f3b8-4d75-9db8-9f37b9fdfcd0 tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=122699) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 04:33:53.625016 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b6cafef4-f3b8-4d75-9db8-9f37b9fdfcd0 tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:53.625503 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b6cafef4-f3b8-4d75-9db8-9f37b9fdfcd0 tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:53.625969 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b6cafef4-f3b8-4d75-9db8-9f37b9fdfcd0 tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:53.626689 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b6cafef4-f3b8-4d75-9db8-9f37b9fdfcd0 tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:53.627403 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b6cafef4-f3b8-4d75-9db8-9f37b9fdfcd0 tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:53.627769 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b6cafef4-f3b8-4d75-9db8-9f37b9fdfcd0 tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:53.659498 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7a1aa13e-541f-47ee-a2ec-8c4c6fd8efa7 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] 10.222.0.33 "POST /compute/v2.1/servers/70213e65-9664-4df1-81d7-747c462fa434/action" status: 202 len: 0 microversion: 2.1 time: 0.611589 Sep 23 04:33:53.665917 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 415/855] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:33:53 2022] POST /compute/v2.1/servers/70213e65-9664-4df1-81d7-747c462fa434/action => generated 0 bytes in 619 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 23 04:33:53.672397 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-4ffe95cc-ffb2-4f44-9a16-f1c819bf7052 req-88c9a273-ea4b-46fc-8a3b-8dbdc982e6e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9dede73d-62ac-481b-b990-41fd1039882a", "tag": "a606ca45-c7dd-4f7c-90b2-1c6bd26525bf"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:33:53.697635 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-4ffe95cc-ffb2-4f44-9a16-f1c819bf7052 req-88c9a273-ea4b-46fc-8a3b-8dbdc982e6e5 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:53.698059 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-4ffe95cc-ffb2-4f44-9a16-f1c819bf7052 req-88c9a273-ea4b-46fc-8a3b-8dbdc982e6e5 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:53.698489 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-4ffe95cc-ffb2-4f44-9a16-f1c819bf7052 req-88c9a273-ea4b-46fc-8a3b-8dbdc982e6e5 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:53.714067 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:33:53.720856 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b6cafef4-f3b8-4d75-9db8-9f37b9fdfcd0 tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] 10.222.0.33 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.119324 Sep 23 04:33:53.721458 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 441/856] 10.222.0.33 () {58 vars in 1196 bytes} [Fri Sep 23 04:33:53 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 04:33:53.726895 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ae6c2208-104e-41cb-998d-db22a58b06ce tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:53.727786 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ae6c2208-104e-41cb-998d-db22a58b06ce tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] [instance: 205bf02b-1478-4765-b2a6-d7014d9f0a64] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:53.735862 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ae6c2208-104e-41cb-998d-db22a58b06ce tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:53.736367 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ae6c2208-104e-41cb-998d-db22a58b06ce tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:53.736808 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ae6c2208-104e-41cb-998d-db22a58b06ce tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:53.737528 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ae6c2208-104e-41cb-998d-db22a58b06ce tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:53.738009 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ae6c2208-104e-41cb-998d-db22a58b06ce tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:53.738434 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ae6c2208-104e-41cb-998d-db22a58b06ce tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:53.741581 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-4ffe95cc-ffb2-4f44-9a16-f1c819bf7052 req-88c9a273-ea4b-46fc-8a3b-8dbdc982e6e5 service nova] Creating event network-changed:a606ca45-c7dd-4f7c-90b2-1c6bd26525bf for instance 9dede73d-62ac-481b-b990-41fd1039882a on n-h1-846463-3 Sep 23 04:33:53.758867 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-4ffe95cc-ffb2-4f44-9a16-f1c819bf7052 req-88c9a273-ea4b-46fc-8a3b-8dbdc982e6e5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087477 Sep 23 04:33:53.760357 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 416/857] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:33:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:33:53.770047 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f81db022-81dd-4dd3-9037-2087ab2b9bdd tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Calling method '.version_select at 0x7ff1bbfed5e0>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:53.851291 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f81db022-81dd-4dd3-9037-2087ab2b9bdd tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] 10.222.0.33 "GET /compute/v2.1/images/a52cf834-d5f6-4c7a-9692-385e6f34b133" status: 200 len: 1427 microversion: 2.1 time: 0.086824 Sep 23 04:33:53.852980 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 417/858] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:33:53 2022] GET /compute/v2.1/images/a52cf834-d5f6-4c7a-9692-385e6f34b133 => generated 1427 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:53.870158 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9a856408-df55-4ad5-a4ad-14119cece7a2 tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:33:53.878901 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-9a856408-df55-4ad5-a4ad-14119cece7a2 tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] [instance: f392741f-f967-4c1c-930b-4eea7272bf64] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:53.895366 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9a856408-df55-4ad5-a4ad-14119cece7a2 tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:53.896007 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9a856408-df55-4ad5-a4ad-14119cece7a2 tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:53.896643 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9a856408-df55-4ad5-a4ad-14119cece7a2 tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:53.897439 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9a856408-df55-4ad5-a4ad-14119cece7a2 tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:53.899377 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9a856408-df55-4ad5-a4ad-14119cece7a2 tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:53.900056 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9a856408-df55-4ad5-a4ad-14119cece7a2 tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:53.944124 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-ae6c2208-104e-41cb-998d-db22a58b06ce tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lazy-loading 'services' on Instance uuid 205bf02b-1478-4765-b2a6-d7014d9f0a64 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:33:53.961370 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ae6c2208-104e-41cb-998d-db22a58b06ce tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/205bf02b-1478-4765-b2a6-d7014d9f0a64" status: 200 len: 2346 microversion: 2.25 time: 0.235495 Sep 23 04:33:53.962271 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 442/859] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:33:53 2022] GET /compute/v2.1/servers/205bf02b-1478-4765-b2a6-d7014d9f0a64 => generated 2346 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:33:53.975545 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-553373e1-6242-4450-97ad-dcd1eb06a454 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:53.976515 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-553373e1-6242-4450-97ad-dcd1eb06a454 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] [instance: 9dede73d-62ac-481b-b990-41fd1039882a] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:53.997842 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-553373e1-6242-4450-97ad-dcd1eb06a454 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:53.998616 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-553373e1-6242-4450-97ad-dcd1eb06a454 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:53.999311 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-553373e1-6242-4450-97ad-dcd1eb06a454 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:54.000417 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-553373e1-6242-4450-97ad-dcd1eb06a454 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:54.001023 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-553373e1-6242-4450-97ad-dcd1eb06a454 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:54.001642 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-553373e1-6242-4450-97ad-dcd1eb06a454 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:54.241944 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9a856408-df55-4ad5-a4ad-14119cece7a2 tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64/action" status: 202 len: 0 microversion: 2.1 time: 0.386672 Sep 23 04:33:54.246044 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 418/860] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:33:53 2022] POST /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64/action => generated 0 bytes in 389 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:33:54.252195 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-82895528-2b54-427a-a3e0-84c914c24349 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:54.256427 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-82895528-2b54-427a-a3e0-84c914c24349 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:54.263583 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-82895528-2b54-427a-a3e0-84c914c24349 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:54.264273 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-82895528-2b54-427a-a3e0-84c914c24349 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:54.265288 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-82895528-2b54-427a-a3e0-84c914c24349 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:54.265939 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-82895528-2b54-427a-a3e0-84c914c24349 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:54.268613 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-82895528-2b54-427a-a3e0-84c914c24349 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:54.354963 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-82895528-2b54-427a-a3e0-84c914c24349 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.094515 Sep 23 04:33:54.355703 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 419/861] 10.222.0.33 () {60 vars in 1217 bytes} [Fri Sep 23 04:33:54 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 04:33:54.371535 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-25ad3ac4-9684-4bc6-8d24-9429beda46d5 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:54.377081 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-25ad3ac4-9684-4bc6-8d24-9429beda46d5 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: f77bb6f0-6ce7-40d8-9cb2-2fcb559353ac] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:54.393228 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-25ad3ac4-9684-4bc6-8d24-9429beda46d5 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:54.394199 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-25ad3ac4-9684-4bc6-8d24-9429beda46d5 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:54.395959 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-25ad3ac4-9684-4bc6-8d24-9429beda46d5 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:54.396938 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-25ad3ac4-9684-4bc6-8d24-9429beda46d5 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:54.399324 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-25ad3ac4-9684-4bc6-8d24-9429beda46d5 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:54.399994 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-25ad3ac4-9684-4bc6-8d24-9429beda46d5 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:54.579524 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=5 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:33:54.754708 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-553373e1-6242-4450-97ad-dcd1eb06a454 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3135a00fc94e488cb633b89d8768fe93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332a996884724d9eb16c79f46107c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:54.768557 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-553373e1-6242-4450-97ad-dcd1eb06a454 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] 10.222.0.33 "GET /compute/v2.1/servers/9dede73d-62ac-481b-b990-41fd1039882a" status: 200 len: 1323 microversion: 2.1 time: 0.804402 Sep 23 04:33:54.778743 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 443/862] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:53 2022] GET /compute/v2.1/servers/9dede73d-62ac-481b-b990-41fd1039882a => generated 1323 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:54.778743 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-43ed171f-b5e5-4e04-88a4-c5f0010e71b2 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:33:54.786665 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-43ed171f-b5e5-4e04-88a4-c5f0010e71b2 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] [instance: f392741f-f967-4c1c-930b-4eea7272bf64] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:54.803152 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-43ed171f-b5e5-4e04-88a4-c5f0010e71b2 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:54.803649 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-43ed171f-b5e5-4e04-88a4-c5f0010e71b2 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:54.804089 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-43ed171f-b5e5-4e04-88a4-c5f0010e71b2 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:54.804790 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-43ed171f-b5e5-4e04-88a4-c5f0010e71b2 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:54.805412 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-43ed171f-b5e5-4e04-88a4-c5f0010e71b2 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:54.806045 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-43ed171f-b5e5-4e04-88a4-c5f0010e71b2 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:54.840530 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-25ad3ac4-9684-4bc6-8d24-9429beda46d5 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:54.855071 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-25ad3ac4-9684-4bc6-8d24-9429beda46d5 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/f77bb6f0-6ce7-40d8-9cb2-2fcb559353ac" status: 200 len: 1309 microversion: 2.1 time: 0.498253 Sep 23 04:33:54.859446 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 420/863] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:54 2022] GET /compute/v2.1/servers/f77bb6f0-6ce7-40d8-9cb2-2fcb559353ac => generated 1309 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:54.875602 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-9fbb7dce-cda2-41f2-b7e5-f648e1cd4c7f req-762c4a8d-1bd1-4a8b-a288-cbca9d9e9cbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70213e65-9664-4df1-81d7-747c462fa434", "name": "network-vif-unplugged", "status": "completed", "tag": "4070aee3-4e6a-47b5-ae56-ad309ddbad7b"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:33:54.900420 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-9fbb7dce-cda2-41f2-b7e5-f648e1cd4c7f req-762c4a8d-1bd1-4a8b-a288-cbca9d9e9cbe service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:54.902832 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-9fbb7dce-cda2-41f2-b7e5-f648e1cd4c7f req-762c4a8d-1bd1-4a8b-a288-cbca9d9e9cbe service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:54.903484 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-9fbb7dce-cda2-41f2-b7e5-f648e1cd4c7f req-762c4a8d-1bd1-4a8b-a288-cbca9d9e9cbe service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:54.936872 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-9fbb7dce-cda2-41f2-b7e5-f648e1cd4c7f req-762c4a8d-1bd1-4a8b-a288-cbca9d9e9cbe service nova] Creating event network-vif-unplugged:4070aee3-4e6a-47b5-ae56-ad309ddbad7b for instance 70213e65-9664-4df1-81d7-747c462fa434 on n-h2-846463-3 Sep 23 04:33:54.942830 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-9fbb7dce-cda2-41f2-b7e5-f648e1cd4c7f req-762c4a8d-1bd1-4a8b-a288-cbca9d9e9cbe service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.073154 Sep 23 04:33:54.943665 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 421/864] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:33:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:33:54.954446 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e9b3ea67-b557-45b5-8590-3e286f26acaf tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:54.957387 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e9b3ea67-b557-45b5-8590-3e286f26acaf tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: 09076cfa-4632-43c3-919d-4a8fe1b1bd37] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:54.970680 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e9b3ea67-b557-45b5-8590-3e286f26acaf tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:54.973665 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e9b3ea67-b557-45b5-8590-3e286f26acaf tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:54.974319 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e9b3ea67-b557-45b5-8590-3e286f26acaf tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:54.977934 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e9b3ea67-b557-45b5-8590-3e286f26acaf tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:54.978640 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e9b3ea67-b557-45b5-8590-3e286f26acaf tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:54.979569 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e9b3ea67-b557-45b5-8590-3e286f26acaf tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:54.992355 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-43ed171f-b5e5-4e04-88a4-c5f0010e71b2 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Flavor limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:33:54.993486 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-43ed171f-b5e5-4e04-88a4-c5f0010e71b2 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Image limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:33:54.994320 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-43ed171f-b5e5-4e04-88a4-c5f0010e71b2 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Flavor pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:33:54.995228 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-43ed171f-b5e5-4e04-88a4-c5f0010e71b2 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Image pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:33:54.995869 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-43ed171f-b5e5-4e04-88a4-c5f0010e71b2 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:33:55.297432 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-43ed171f-b5e5-4e04-88a4-c5f0010e71b2 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] [instance: f392741f-f967-4c1c-930b-4eea7272bf64] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:55.304427 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:DELETE=1,nova_api:SELECT=99 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:33:55.316741 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-43ed171f-b5e5-4e04-88a4-c5f0010e71b2 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:55.322822 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-43ed171f-b5e5-4e04-88a4-c5f0010e71b2 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:55.322822 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-43ed171f-b5e5-4e04-88a4-c5f0010e71b2 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:55.322822 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-43ed171f-b5e5-4e04-88a4-c5f0010e71b2 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:55.324437 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-43ed171f-b5e5-4e04-88a4-c5f0010e71b2 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:55.325367 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-43ed171f-b5e5-4e04-88a4-c5f0010e71b2 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:55.335499 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e9b3ea67-b557-45b5-8590-3e286f26acaf tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:55.347611 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e9b3ea67-b557-45b5-8590-3e286f26acaf tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/09076cfa-4632-43c3-919d-4a8fe1b1bd37" status: 200 len: 1472 microversion: 2.1 time: 0.402603 Sep 23 04:33:55.362518 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 422/865] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:54 2022] GET /compute/v2.1/servers/09076cfa-4632-43c3-919d-4a8fe1b1bd37 => generated 1472 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:55.370388 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9afc071d-7a34-4d08-84ef-b4d22eda450f tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Calling method '.version_select at 0x7ff1bbfedd30>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:55.399660 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-43ed171f-b5e5-4e04-88a4-c5f0010e71b2 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] 10.222.0.33 "POST /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64/action" status: 202 len: 1067 microversion: 2.1 time: 0.629022 Sep 23 04:33:55.402468 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 444/866] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:33:54 2022] POST /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64/action => generated 1067 bytes in 632 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 23 04:33:55.421796 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6a55042e-ee23-4455-8a94-5f364ebd16b4 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:55.422547 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-6a55042e-ee23-4455-8a94-5f364ebd16b4 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] [instance: f392741f-f967-4c1c-930b-4eea7272bf64] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:55.433056 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6a55042e-ee23-4455-8a94-5f364ebd16b4 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:55.437383 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6a55042e-ee23-4455-8a94-5f364ebd16b4 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:55.438079 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6a55042e-ee23-4455-8a94-5f364ebd16b4 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:55.438901 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6a55042e-ee23-4455-8a94-5f364ebd16b4 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:55.439683 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9afc071d-7a34-4d08-84ef-b4d22eda450f tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] 10.222.0.33 "GET /compute/v2.1/images/a52cf834-d5f6-4c7a-9692-385e6f34b133" status: 200 len: 1427 microversion: 2.1 time: 0.075835 Sep 23 04:33:55.439959 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6a55042e-ee23-4455-8a94-5f364ebd16b4 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:55.447506 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 423/867] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:33:55 2022] GET /compute/v2.1/images/a52cf834-d5f6-4c7a-9692-385e6f34b133 => generated 1427 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:55.447700 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6a55042e-ee23-4455-8a94-5f364ebd16b4 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:55.770820 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-6a55042e-ee23-4455-8a94-5f364ebd16b4 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c82752e1bc4fdb82e7f8391c7c129f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44352a7a6d964530aa20ae83064b02e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:55.786287 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6a55042e-ee23-4455-8a94-5f364ebd16b4 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] 10.222.0.33 "GET /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64" status: 200 len: 1471 microversion: 2.1 time: 0.369825 Sep 23 04:33:55.801757 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 445/868] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:55 2022] GET /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64 => generated 1471 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:33:55.811373 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c4d9fcc9-adeb-4c11-bfca-1c02c279191b tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:55.811373 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c4d9fcc9-adeb-4c11-bfca-1c02c279191b tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] [instance: 9dede73d-62ac-481b-b990-41fd1039882a] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:55.811373 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c4d9fcc9-adeb-4c11-bfca-1c02c279191b tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:55.811373 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c4d9fcc9-adeb-4c11-bfca-1c02c279191b tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:55.812191 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c4d9fcc9-adeb-4c11-bfca-1c02c279191b tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:55.812191 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c4d9fcc9-adeb-4c11-bfca-1c02c279191b tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:55.812191 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c4d9fcc9-adeb-4c11-bfca-1c02c279191b tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:55.812191 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c4d9fcc9-adeb-4c11-bfca-1c02c279191b tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:55.884824 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-34a79863-f89b-4295-940d-6d9a039edc30 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:55.885438 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-34a79863-f89b-4295-940d-6d9a039edc30 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: f77bb6f0-6ce7-40d8-9cb2-2fcb559353ac] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:55.911455 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-34a79863-f89b-4295-940d-6d9a039edc30 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:55.912894 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-34a79863-f89b-4295-940d-6d9a039edc30 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:55.913613 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-34a79863-f89b-4295-940d-6d9a039edc30 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:55.914960 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-34a79863-f89b-4295-940d-6d9a039edc30 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:55.915429 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-34a79863-f89b-4295-940d-6d9a039edc30 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:55.915857 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-34a79863-f89b-4295-940d-6d9a039edc30 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:56.246533 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c4d9fcc9-adeb-4c11-bfca-1c02c279191b tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3135a00fc94e488cb633b89d8768fe93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332a996884724d9eb16c79f46107c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:56.256451 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c4d9fcc9-adeb-4c11-bfca-1c02c279191b tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] 10.222.0.33 "GET /compute/v2.1/servers/9dede73d-62ac-481b-b990-41fd1039882a" status: 200 len: 1323 microversion: 2.1 time: 0.468491 Sep 23 04:33:56.262295 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 424/869] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:55 2022] GET /compute/v2.1/servers/9dede73d-62ac-481b-b990-41fd1039882a => generated 1323 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:33:56.290986 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-34a79863-f89b-4295-940d-6d9a039edc30 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:56.304032 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-34a79863-f89b-4295-940d-6d9a039edc30 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/f77bb6f0-6ce7-40d8-9cb2-2fcb559353ac" status: 200 len: 1309 microversion: 2.1 time: 0.423064 Sep 23 04:33:56.306886 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 446/870] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:55 2022] GET /compute/v2.1/servers/f77bb6f0-6ce7-40d8-9cb2-2fcb559353ac => generated 1309 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:56.376572 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-87fbc09c-c653-4093-bc3b-5836c3975e0b tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:56.377292 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-87fbc09c-c653-4093-bc3b-5836c3975e0b tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: 09076cfa-4632-43c3-919d-4a8fe1b1bd37] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:56.383866 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-87fbc09c-c653-4093-bc3b-5836c3975e0b tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:56.384456 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-87fbc09c-c653-4093-bc3b-5836c3975e0b tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:56.384972 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-87fbc09c-c653-4093-bc3b-5836c3975e0b tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:56.385826 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-87fbc09c-c653-4093-bc3b-5836c3975e0b tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:56.387318 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-87fbc09c-c653-4093-bc3b-5836c3975e0b tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:56.388115 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-87fbc09c-c653-4093-bc3b-5836c3975e0b tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:56.460504 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-cdc706c5-4c79-4517-89a6-339ad72f154b tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Calling method '.version_select at 0x7ff1c04d74c0>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:56.647246 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-cdc706c5-4c79-4517-89a6-339ad72f154b tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] 10.222.0.33 "GET /compute/v2.1/images/a52cf834-d5f6-4c7a-9692-385e6f34b133" status: 200 len: 1427 microversion: 2.1 time: 0.177664 Sep 23 04:33:56.647939 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 447/871] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:33:56 2022] GET /compute/v2.1/images/a52cf834-d5f6-4c7a-9692-385e6f34b133 => generated 1427 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:56.809637 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a4749675-3b81-44c6-962c-c4fa4d1394a1 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:56.811294 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a4749675-3b81-44c6-962c-c4fa4d1394a1 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] [instance: f392741f-f967-4c1c-930b-4eea7272bf64] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:56.828250 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a4749675-3b81-44c6-962c-c4fa4d1394a1 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:56.829024 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a4749675-3b81-44c6-962c-c4fa4d1394a1 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:56.829630 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a4749675-3b81-44c6-962c-c4fa4d1394a1 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:56.836492 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a4749675-3b81-44c6-962c-c4fa4d1394a1 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:56.837475 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a4749675-3b81-44c6-962c-c4fa4d1394a1 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:56.839327 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a4749675-3b81-44c6-962c-c4fa4d1394a1 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:56.840015 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-87fbc09c-c653-4093-bc3b-5836c3975e0b tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:56.861656 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-87fbc09c-c653-4093-bc3b-5836c3975e0b tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/09076cfa-4632-43c3-919d-4a8fe1b1bd37" status: 200 len: 1477 microversion: 2.1 time: 0.482523 Sep 23 04:33:56.861927 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:33:56.871604 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 425/872] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:56 2022] GET /compute/v2.1/servers/09076cfa-4632-43c3-919d-4a8fe1b1bd37 => generated 1477 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:33:56.981212 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-2e30a968-b472-4309-b66a-985e86794277 req-418ac051-501b-43e8-a845-9ffe092e25fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f77bb6f0-6ce7-40d8-9cb2-2fcb559353ac", "name": "network-vif-plugged", "status": "completed", "tag": "f109c520-e5ff-40d8-a820-4cc8e75e5e84"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:33:57.002599 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-2e30a968-b472-4309-b66a-985e86794277 req-418ac051-501b-43e8-a845-9ffe092e25fd service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:57.003978 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-2e30a968-b472-4309-b66a-985e86794277 req-418ac051-501b-43e8-a845-9ffe092e25fd service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:57.005057 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-2e30a968-b472-4309-b66a-985e86794277 req-418ac051-501b-43e8-a845-9ffe092e25fd service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:57.055797 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-2e30a968-b472-4309-b66a-985e86794277 req-418ac051-501b-43e8-a845-9ffe092e25fd service nova] Creating event network-vif-plugged:f109c520-e5ff-40d8-a820-4cc8e75e5e84 for instance f77bb6f0-6ce7-40d8-9cb2-2fcb559353ac on n-h2-846463-3 Sep 23 04:33:57.070851 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-2e30a968-b472-4309-b66a-985e86794277 req-418ac051-501b-43e8-a845-9ffe092e25fd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093250 Sep 23 04:33:57.072026 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 426/873] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:33:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:33:57.297060 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5ab61423-a297-4290-91f2-1eed219f107a tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:57.298045 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5ab61423-a297-4290-91f2-1eed219f107a tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] [instance: 9dede73d-62ac-481b-b990-41fd1039882a] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:57.323515 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5ab61423-a297-4290-91f2-1eed219f107a tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:57.325044 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5ab61423-a297-4290-91f2-1eed219f107a tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:57.326342 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5ab61423-a297-4290-91f2-1eed219f107a tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:57.328656 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5ab61423-a297-4290-91f2-1eed219f107a tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:57.330460 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5ab61423-a297-4290-91f2-1eed219f107a tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:57.331657 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5ab61423-a297-4290-91f2-1eed219f107a tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:57.333819 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a4749675-3b81-44c6-962c-c4fa4d1394a1 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c82752e1bc4fdb82e7f8391c7c129f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44352a7a6d964530aa20ae83064b02e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:57.350304 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a4749675-3b81-44c6-962c-c4fa4d1394a1 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] 10.222.0.33 "GET /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64" status: 200 len: 1471 microversion: 2.1 time: 0.538894 Sep 23 04:33:57.354322 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 448/874] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:56 2022] GET /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64 => generated 1471 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:57.362650 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-01938fef-96e6-462f-97ed-6bf8a0913579 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:57.363323 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-01938fef-96e6-462f-97ed-6bf8a0913579 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: f77bb6f0-6ce7-40d8-9cb2-2fcb559353ac] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:57.393512 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-01938fef-96e6-462f-97ed-6bf8a0913579 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:57.393935 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-01938fef-96e6-462f-97ed-6bf8a0913579 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:57.394390 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-01938fef-96e6-462f-97ed-6bf8a0913579 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:57.395112 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-01938fef-96e6-462f-97ed-6bf8a0913579 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:57.395582 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-01938fef-96e6-462f-97ed-6bf8a0913579 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:57.396010 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-01938fef-96e6-462f-97ed-6bf8a0913579 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:57.730734 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-01938fef-96e6-462f-97ed-6bf8a0913579 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:57.735535 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-5ab61423-a297-4290-91f2-1eed219f107a tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3135a00fc94e488cb633b89d8768fe93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332a996884724d9eb16c79f46107c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:57.740238 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-01938fef-96e6-462f-97ed-6bf8a0913579 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/f77bb6f0-6ce7-40d8-9cb2-2fcb559353ac" status: 200 len: 1309 microversion: 2.1 time: 0.384744 Sep 23 04:33:57.741078 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 449/875] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:57 2022] GET /compute/v2.1/servers/f77bb6f0-6ce7-40d8-9cb2-2fcb559353ac => generated 1309 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:57.744686 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5ab61423-a297-4290-91f2-1eed219f107a tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] 10.222.0.33 "GET /compute/v2.1/servers/9dede73d-62ac-481b-b990-41fd1039882a" status: 200 len: 1323 microversion: 2.1 time: 0.465212 Sep 23 04:33:57.746890 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c5c28e56-698b-4144-a40e-626f9acae528 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Calling method '.version_select at 0x7ff1bbb82310>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:57.754186 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 427/876] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:57 2022] GET /compute/v2.1/servers/9dede73d-62ac-481b-b990-41fd1039882a => generated 1323 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:33:57.796207 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c5c28e56-698b-4144-a40e-626f9acae528 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] 10.222.0.33 "GET /compute/v2.1/images/a52cf834-d5f6-4c7a-9692-385e6f34b133" status: 200 len: 1427 microversion: 2.1 time: 0.053171 Sep 23 04:33:57.796958 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 450/877] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:33:57 2022] GET /compute/v2.1/images/a52cf834-d5f6-4c7a-9692-385e6f34b133 => generated 1427 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:57.888327 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a751c946-67f9-46d5-988b-cf948e8e5c8a tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:57.889111 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a751c946-67f9-46d5-988b-cf948e8e5c8a tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: 09076cfa-4632-43c3-919d-4a8fe1b1bd37] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:57.898127 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a751c946-67f9-46d5-988b-cf948e8e5c8a tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:57.898884 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a751c946-67f9-46d5-988b-cf948e8e5c8a tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:57.899340 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a751c946-67f9-46d5-988b-cf948e8e5c8a tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:57.900377 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a751c946-67f9-46d5-988b-cf948e8e5c8a tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:57.901026 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a751c946-67f9-46d5-988b-cf948e8e5c8a tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:57.901622 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a751c946-67f9-46d5-988b-cf948e8e5c8a tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:58.274769 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a751c946-67f9-46d5-988b-cf948e8e5c8a tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:58.285582 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a751c946-67f9-46d5-988b-cf948e8e5c8a tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/09076cfa-4632-43c3-919d-4a8fe1b1bd37" status: 200 len: 1477 microversion: 2.1 time: 0.401732 Sep 23 04:33:58.287926 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 428/878] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:57 2022] GET /compute/v2.1/servers/09076cfa-4632-43c3-919d-4a8fe1b1bd37 => generated 1477 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:58.372198 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=8 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:33:58.377309 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-004e6437-adc7-4494-ade5-366dd832b4ea tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:58.379427 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-004e6437-adc7-4494-ade5-366dd832b4ea tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] [instance: f392741f-f967-4c1c-930b-4eea7272bf64] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:58.400677 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-004e6437-adc7-4494-ade5-366dd832b4ea tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:58.401816 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-004e6437-adc7-4494-ade5-366dd832b4ea tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:58.402596 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-004e6437-adc7-4494-ade5-366dd832b4ea tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:58.404264 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-004e6437-adc7-4494-ade5-366dd832b4ea tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:58.404969 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-004e6437-adc7-4494-ade5-366dd832b4ea tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:58.405618 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-004e6437-adc7-4494-ade5-366dd832b4ea tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:58.683960 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-004e6437-adc7-4494-ade5-366dd832b4ea tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c82752e1bc4fdb82e7f8391c7c129f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44352a7a6d964530aa20ae83064b02e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:58.702838 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-004e6437-adc7-4494-ade5-366dd832b4ea tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] 10.222.0.33 "GET /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64" status: 200 len: 1471 microversion: 2.1 time: 0.326629 Sep 23 04:33:58.702838 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 451/879] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:58 2022] GET /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64 => generated 1471 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:58.768590 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f6a31d4d-ebf9-4ff2-9021-9b6272a8c460 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:58.769296 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f6a31d4d-ebf9-4ff2-9021-9b6272a8c460 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: f77bb6f0-6ce7-40d8-9cb2-2fcb559353ac] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:58.769726 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-09aa05a9-9195-4977-8b89-7d344a517954 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:58.770580 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-09aa05a9-9195-4977-8b89-7d344a517954 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] [instance: 9dede73d-62ac-481b-b990-41fd1039882a] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:58.783075 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-09aa05a9-9195-4977-8b89-7d344a517954 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:58.783676 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f6a31d4d-ebf9-4ff2-9021-9b6272a8c460 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:58.783826 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-09aa05a9-9195-4977-8b89-7d344a517954 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:58.784249 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-09aa05a9-9195-4977-8b89-7d344a517954 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:58.784557 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f6a31d4d-ebf9-4ff2-9021-9b6272a8c460 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:58.787736 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f6a31d4d-ebf9-4ff2-9021-9b6272a8c460 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:58.787882 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-09aa05a9-9195-4977-8b89-7d344a517954 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:58.788414 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-09aa05a9-9195-4977-8b89-7d344a517954 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:58.790248 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-09aa05a9-9195-4977-8b89-7d344a517954 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:58.790927 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f6a31d4d-ebf9-4ff2-9021-9b6272a8c460 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:58.791451 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f6a31d4d-ebf9-4ff2-9021-9b6272a8c460 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:58.792222 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f6a31d4d-ebf9-4ff2-9021-9b6272a8c460 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:59.104689 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-09aa05a9-9195-4977-8b89-7d344a517954 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3135a00fc94e488cb633b89d8768fe93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332a996884724d9eb16c79f46107c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:59.119013 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-09aa05a9-9195-4977-8b89-7d344a517954 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] 10.222.0.33 "GET /compute/v2.1/servers/9dede73d-62ac-481b-b990-41fd1039882a" status: 200 len: 1323 microversion: 2.1 time: 0.352567 Sep 23 04:33:59.136706 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 452/880] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:58 2022] GET /compute/v2.1/servers/9dede73d-62ac-481b-b990-41fd1039882a => generated 1323 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:59.150265 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f50eb888-fc09-462a-94f6-0a9227e48f4b tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Calling method '.version_select at 0x7ff1bbb82940>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:59.181301 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f6a31d4d-ebf9-4ff2-9021-9b6272a8c460 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:59.190308 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f6a31d4d-ebf9-4ff2-9021-9b6272a8c460 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/f77bb6f0-6ce7-40d8-9cb2-2fcb559353ac" status: 200 len: 1309 microversion: 2.1 time: 0.426224 Sep 23 04:33:59.192541 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 429/881] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:58 2022] GET /compute/v2.1/servers/f77bb6f0-6ce7-40d8-9cb2-2fcb559353ac => generated 1309 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:59.217682 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f50eb888-fc09-462a-94f6-0a9227e48f4b tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] 10.222.0.33 "GET /compute/v2.1/images/a52cf834-d5f6-4c7a-9692-385e6f34b133" status: 200 len: 1427 microversion: 2.1 time: 0.079628 Sep 23 04:33:59.218639 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 453/882] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:33:59 2022] GET /compute/v2.1/images/a52cf834-d5f6-4c7a-9692-385e6f34b133 => generated 1427 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:59.310086 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e833a5bd-7ded-4895-9335-c22fa9cc8fed tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:59.311804 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e833a5bd-7ded-4895-9335-c22fa9cc8fed tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: 09076cfa-4632-43c3-919d-4a8fe1b1bd37] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:59.325787 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e833a5bd-7ded-4895-9335-c22fa9cc8fed tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:59.325787 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e833a5bd-7ded-4895-9335-c22fa9cc8fed tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:59.325787 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e833a5bd-7ded-4895-9335-c22fa9cc8fed tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:59.325787 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e833a5bd-7ded-4895-9335-c22fa9cc8fed tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:59.326112 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e833a5bd-7ded-4895-9335-c22fa9cc8fed tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:59.326112 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e833a5bd-7ded-4895-9335-c22fa9cc8fed tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:59.362207 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-925d3681-e86b-4850-9a14-51f004ec8cc7 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Action: 'create', calling method: .version_select at 0x7ff1c00a04c0>, body: {"keypair": {"name": "tempest-keypair-1290470256", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCJC/Hzc/UcEzPVuQCEqz3+TnK5TQFyRI//FXhdtYIhxc93oNaPkRcKYxkbj0cwjFlX3+gc+nLEfThE6wp0gZ0qVG2N/oYvODwAOIhPU5nHO24eYMqAzjEThDR80nBc4yg=="}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:33:59.373322 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:33:59.384836 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-925d3681-e86b-4850-9a14-51f004ec8cc7 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Getting quotas for project f661d071bed2459cba4aa91e2b8b0d28. Resources: {'key_pairs'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:33:59.391417 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-925d3681-e86b-4850-9a14-51f004ec8cc7 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Getting quotas for user 6c977d0e2ec64f8ca6b0923b9876c0c3 and project f661d071bed2459cba4aa91e2b8b0d28. Resources: {'key_pairs'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:33:59.510267 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-925d3681-e86b-4850-9a14-51f004ec8cc7 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.316505 Sep 23 04:33:59.511866 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 430/883] 10.222.0.33 () {60 vars in 1159 bytes} [Fri Sep 23 04:33:59 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:33:59.523984 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3e4da65b-8989-4cb5-aad9-82a5c7f1e478 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3c95fad3-89bf-4df1-ac53-107de940e36d", "device": "/dev/xvdb"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:33:59.526971 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3e4da65b-8989-4cb5-aad9-82a5c7f1e478 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 205bf02b-1478-4765-b2a6-d7014d9f0a64] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:59.534547 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3e4da65b-8989-4cb5-aad9-82a5c7f1e478 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:59.535452 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3e4da65b-8989-4cb5-aad9-82a5c7f1e478 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:59.536095 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3e4da65b-8989-4cb5-aad9-82a5c7f1e478 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:59.536985 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3e4da65b-8989-4cb5-aad9-82a5c7f1e478 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:59.537609 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3e4da65b-8989-4cb5-aad9-82a5c7f1e478 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:59.543380 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3e4da65b-8989-4cb5-aad9-82a5c7f1e478 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:59.553522 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e833a5bd-7ded-4895-9335-c22fa9cc8fed tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:59.563280 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e833a5bd-7ded-4895-9335-c22fa9cc8fed tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/09076cfa-4632-43c3-919d-4a8fe1b1bd37" status: 200 len: 1477 microversion: 2.1 time: 0.258345 Sep 23 04:33:59.564538 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 454/884] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:59 2022] GET /compute/v2.1/servers/09076cfa-4632-43c3-919d-4a8fe1b1bd37 => generated 1477 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:33:59.724598 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-50da1be3-06d1-45d3-a838-3793346f365f tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:33:59.725542 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-50da1be3-06d1-45d3-a838-3793346f365f tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] [instance: f392741f-f967-4c1c-930b-4eea7272bf64] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:33:59.741160 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-50da1be3-06d1-45d3-a838-3793346f365f tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:59.741669 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-50da1be3-06d1-45d3-a838-3793346f365f tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:59.742787 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-50da1be3-06d1-45d3-a838-3793346f365f tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:59.746302 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-50da1be3-06d1-45d3-a838-3793346f365f tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:33:59.748166 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-50da1be3-06d1-45d3-a838-3793346f365f tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:33:59.748628 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-50da1be3-06d1-45d3-a838-3793346f365f tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:33:59.905992 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-50da1be3-06d1-45d3-a838-3793346f365f tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c82752e1bc4fdb82e7f8391c7c129f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44352a7a6d964530aa20ae83064b02e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:33:59.915422 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-50da1be3-06d1-45d3-a838-3793346f365f tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] 10.222.0.33 "GET /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64" status: 200 len: 1471 microversion: 2.1 time: 0.196216 Sep 23 04:33:59.916014 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 455/885] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:33:59 2022] GET /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64 => generated 1471 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:34:00.095503 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0fb5294d-4c6d-4d27-8ffa-f450bca67d94 tempest-HostsAdminTestJSON-1563365945 tempest-HostsAdminTestJSON-1563365945-project-admin] Calling method '.version_select at 0x7ff1c0049c10>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:00.099256 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0fb5294d-4c6d-4d27-8ffa-f450bca67d94 tempest-HostsAdminTestJSON-1563365945 tempest-HostsAdminTestJSON-1563365945-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:00.100731 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0fb5294d-4c6d-4d27-8ffa-f450bca67d94 tempest-HostsAdminTestJSON-1563365945 tempest-HostsAdminTestJSON-1563365945-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:00.103106 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0fb5294d-4c6d-4d27-8ffa-f450bca67d94 tempest-HostsAdminTestJSON-1563365945 tempest-HostsAdminTestJSON-1563365945-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:00.105295 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0fb5294d-4c6d-4d27-8ffa-f450bca67d94 tempest-HostsAdminTestJSON-1563365945 tempest-HostsAdminTestJSON-1563365945-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:00.106046 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0fb5294d-4c6d-4d27-8ffa-f450bca67d94 tempest-HostsAdminTestJSON-1563365945 tempest-HostsAdminTestJSON-1563365945-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:00.106949 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0fb5294d-4c6d-4d27-8ffa-f450bca67d94 tempest-HostsAdminTestJSON-1563365945 tempest-HostsAdminTestJSON-1563365945-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:00.135855 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0fb5294d-4c6d-4d27-8ffa-f450bca67d94 tempest-HostsAdminTestJSON-1563365945 tempest-HostsAdminTestJSON-1563365945-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.218390 Sep 23 04:34:00.137120 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 456/886] 10.222.0.33 () {58 vars in 1128 bytes} [Fri Sep 23 04:33:59 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:34:00.148347 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-af271e15-0f6a-4685-8484-04c30707d437 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:00.149299 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-af271e15-0f6a-4685-8484-04c30707d437 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] [instance: 9dede73d-62ac-481b-b990-41fd1039882a] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:00.156660 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-af271e15-0f6a-4685-8484-04c30707d437 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:00.157663 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-af271e15-0f6a-4685-8484-04c30707d437 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:00.158402 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-af271e15-0f6a-4685-8484-04c30707d437 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:00.159398 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-af271e15-0f6a-4685-8484-04c30707d437 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:00.160205 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-af271e15-0f6a-4685-8484-04c30707d437 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:00.162332 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-af271e15-0f6a-4685-8484-04c30707d437 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:00.400749 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-af271e15-0f6a-4685-8484-04c30707d437 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3135a00fc94e488cb633b89d8768fe93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332a996884724d9eb16c79f46107c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:00.409407 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-af271e15-0f6a-4685-8484-04c30707d437 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] 10.222.0.33 "GET /compute/v2.1/servers/9dede73d-62ac-481b-b990-41fd1039882a" status: 200 len: 1323 microversion: 2.1 time: 0.270195 Sep 23 04:34:00.425278 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 457/887] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:00 2022] GET /compute/v2.1/servers/9dede73d-62ac-481b-b990-41fd1039882a => generated 1323 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:00.430488 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-42166774-1e97-4d27-a47b-0a9e04745289 tempest-HostsAdminTestJSON-1563365945 tempest-HostsAdminTestJSON-1563365945-project-admin] Calling method '.version_select at 0x7ff1bbcea670>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:00.435480 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-42166774-1e97-4d27-a47b-0a9e04745289 tempest-HostsAdminTestJSON-1563365945 tempest-HostsAdminTestJSON-1563365945-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:00.436610 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-42166774-1e97-4d27-a47b-0a9e04745289 tempest-HostsAdminTestJSON-1563365945 tempest-HostsAdminTestJSON-1563365945-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:00.437785 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-42166774-1e97-4d27-a47b-0a9e04745289 tempest-HostsAdminTestJSON-1563365945 tempest-HostsAdminTestJSON-1563365945-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:00.438687 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-42166774-1e97-4d27-a47b-0a9e04745289 tempest-HostsAdminTestJSON-1563365945 tempest-HostsAdminTestJSON-1563365945-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:00.439449 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-42166774-1e97-4d27-a47b-0a9e04745289 tempest-HostsAdminTestJSON-1563365945 tempest-HostsAdminTestJSON-1563365945-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:00.439978 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-42166774-1e97-4d27-a47b-0a9e04745289 tempest-HostsAdminTestJSON-1563365945 tempest-HostsAdminTestJSON-1563365945-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:00.471792 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-42166774-1e97-4d27-a47b-0a9e04745289 tempest-HostsAdminTestJSON-1563365945 tempest-HostsAdminTestJSON-1563365945-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 376 microversion: 2.1 time: 0.051651 Sep 23 04:34:00.473490 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 458/888] 10.222.0.33 () {58 vars in 1139 bytes} [Fri Sep 23 04:34:00 2022] GET /compute/v2.1/os-hosts?zone= => generated 376 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:34:00.484239 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-07f8edc3-dcf6-47b2-ba49-fedf84462ead tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:00.484913 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-07f8edc3-dcf6-47b2-ba49-fedf84462ead tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: f77bb6f0-6ce7-40d8-9cb2-2fcb559353ac] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:00.491169 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-07f8edc3-dcf6-47b2-ba49-fedf84462ead tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:00.491873 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-07f8edc3-dcf6-47b2-ba49-fedf84462ead tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:00.492186 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-07f8edc3-dcf6-47b2-ba49-fedf84462ead tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:00.492892 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-07f8edc3-dcf6-47b2-ba49-fedf84462ead tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:00.493350 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-07f8edc3-dcf6-47b2-ba49-fedf84462ead tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:00.493779 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-07f8edc3-dcf6-47b2-ba49-fedf84462ead tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:00.671483 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-07f8edc3-dcf6-47b2-ba49-fedf84462ead tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:00.679769 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-07f8edc3-dcf6-47b2-ba49-fedf84462ead tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/f77bb6f0-6ce7-40d8-9cb2-2fcb559353ac" status: 200 len: 1493 microversion: 2.1 time: 0.204565 Sep 23 04:34:00.680349 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 459/889] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:00 2022] GET /compute/v2.1/servers/f77bb6f0-6ce7-40d8-9cb2-2fcb559353ac => generated 1493 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:00.690003 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a4b09832-8857-4bac-b0c6-57eb4f9d0dec tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Calling method '.version_select at 0x7ff1bbc99310>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:00.697561 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3e4da65b-8989-4cb5-aad9-82a5c7f1e478 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "POST /compute/v2.1/servers/205bf02b-1478-4765-b2a6-d7014d9f0a64/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 1.177593 Sep 23 04:34:00.700853 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 431/890] 10.222.0.33 () {62 vars in 1364 bytes} [Fri Sep 23 04:33:59 2022] POST /compute/v2.1/servers/205bf02b-1478-4765-b2a6-d7014d9f0a64/os-volume_attachments => generated 194 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 04:34:00.711098 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-dc995140-b58c-400d-8c95-69cb7069cca2 tempest-HostsAdminTestJSON-1563365945 tempest-HostsAdminTestJSON-1563365945-project-admin] Calling method '.version_select at 0x7ff1bbfea430>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:00.719419 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dc995140-b58c-400d-8c95-69cb7069cca2 tempest-HostsAdminTestJSON-1563365945 tempest-HostsAdminTestJSON-1563365945-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:00.719928 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dc995140-b58c-400d-8c95-69cb7069cca2 tempest-HostsAdminTestJSON-1563365945 tempest-HostsAdminTestJSON-1563365945-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:00.720380 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dc995140-b58c-400d-8c95-69cb7069cca2 tempest-HostsAdminTestJSON-1563365945 tempest-HostsAdminTestJSON-1563365945-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:00.721133 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dc995140-b58c-400d-8c95-69cb7069cca2 tempest-HostsAdminTestJSON-1563365945 tempest-HostsAdminTestJSON-1563365945-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:00.721602 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dc995140-b58c-400d-8c95-69cb7069cca2 tempest-HostsAdminTestJSON-1563365945 tempest-HostsAdminTestJSON-1563365945-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:00.722081 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dc995140-b58c-400d-8c95-69cb7069cca2 tempest-HostsAdminTestJSON-1563365945 tempest-HostsAdminTestJSON-1563365945-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:00.750210 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=11 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:34:00.766921 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a4b09832-8857-4bac-b0c6-57eb4f9d0dec tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] 10.222.0.33 "GET /compute/v2.1/images/a52cf834-d5f6-4c7a-9692-385e6f34b133" status: 200 len: 1427 microversion: 2.1 time: 0.084517 Sep 23 04:34:00.767737 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 460/891] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:34:00 2022] GET /compute/v2.1/images/a52cf834-d5f6-4c7a-9692-385e6f34b133 => generated 1427 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:00.775993 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-ae1db742-138b-415f-b52d-a1cf0834fc6f req-bcdfa397-c8c3-4d14-992e-130982dc6c7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70213e65-9664-4df1-81d7-747c462fa434", "name": "network-vif-plugged", "status": "completed", "tag": "4070aee3-4e6a-47b5-ae56-ad309ddbad7b"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:34:00.790908 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-dc995140-b58c-400d-8c95-69cb7069cca2 tempest-HostsAdminTestJSON-1563365945 tempest-HostsAdminTestJSON-1563365945-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.090676 Sep 23 04:34:00.794653 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 432/892] 10.222.0.33 () {58 vars in 1145 bytes} [Fri Sep 23 04:34:00 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 04:34:00.805830 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d1b2f93c-0b56-4a83-a20b-47de8bd8eba1 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:00.809330 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d1b2f93c-0b56-4a83-a20b-47de8bd8eba1 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: 09076cfa-4632-43c3-919d-4a8fe1b1bd37] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:00.813275 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-ae1db742-138b-415f-b52d-a1cf0834fc6f req-bcdfa397-c8c3-4d14-992e-130982dc6c7a service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:00.813799 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-ae1db742-138b-415f-b52d-a1cf0834fc6f req-bcdfa397-c8c3-4d14-992e-130982dc6c7a service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:00.814334 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-ae1db742-138b-415f-b52d-a1cf0834fc6f req-bcdfa397-c8c3-4d14-992e-130982dc6c7a service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:00.826569 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-ae1db742-138b-415f-b52d-a1cf0834fc6f req-bcdfa397-c8c3-4d14-992e-130982dc6c7a service nova] Creating event network-vif-plugged:4070aee3-4e6a-47b5-ae56-ad309ddbad7b for instance 70213e65-9664-4df1-81d7-747c462fa434 on n-h2-846463-3 Sep 23 04:34:00.829236 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d1b2f93c-0b56-4a83-a20b-47de8bd8eba1 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:00.829782 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d1b2f93c-0b56-4a83-a20b-47de8bd8eba1 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:00.831100 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d1b2f93c-0b56-4a83-a20b-47de8bd8eba1 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:00.831983 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d1b2f93c-0b56-4a83-a20b-47de8bd8eba1 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:00.832470 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d1b2f93c-0b56-4a83-a20b-47de8bd8eba1 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:00.832887 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d1b2f93c-0b56-4a83-a20b-47de8bd8eba1 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:00.838124 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-ae1db742-138b-415f-b52d-a1cf0834fc6f req-bcdfa397-c8c3-4d14-992e-130982dc6c7a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068476 Sep 23 04:34:00.839856 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 461/893] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:34:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:34:01.071166 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-04edd3c7-5e5e-4687-a8c7-7a6b8fee5f84 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:01.071880 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-04edd3c7-5e5e-4687-a8c7-7a6b8fee5f84 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] [instance: f77bb6f0-6ce7-40d8-9cb2-2fcb559353ac] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:01.082563 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-04edd3c7-5e5e-4687-a8c7-7a6b8fee5f84 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:01.083142 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-04edd3c7-5e5e-4687-a8c7-7a6b8fee5f84 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:01.083621 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-04edd3c7-5e5e-4687-a8c7-7a6b8fee5f84 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:01.085207 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-04edd3c7-5e5e-4687-a8c7-7a6b8fee5f84 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:01.086721 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-04edd3c7-5e5e-4687-a8c7-7a6b8fee5f84 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:01.088855 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-04edd3c7-5e5e-4687-a8c7-7a6b8fee5f84 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:01.106189 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d1b2f93c-0b56-4a83-a20b-47de8bd8eba1 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:01.133769 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d1b2f93c-0b56-4a83-a20b-47de8bd8eba1 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/09076cfa-4632-43c3-919d-4a8fe1b1bd37" status: 200 len: 1477 microversion: 2.1 time: 0.335642 Sep 23 04:34:01.134994 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 433/894] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:00 2022] GET /compute/v2.1/servers/09076cfa-4632-43c3-919d-4a8fe1b1bd37 => generated 1477 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:01.157022 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e137cbac-dbd9-4349-b88a-82010e8dde9c tempest-HostsAdminTestJSON-1563365945 tempest-HostsAdminTestJSON-1563365945-project-admin] Calling method '.version_select at 0x7ff1c0778af0>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:01.169163 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e137cbac-dbd9-4349-b88a-82010e8dde9c tempest-HostsAdminTestJSON-1563365945 tempest-HostsAdminTestJSON-1563365945-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:01.172047 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e137cbac-dbd9-4349-b88a-82010e8dde9c tempest-HostsAdminTestJSON-1563365945 tempest-HostsAdminTestJSON-1563365945-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:01.173532 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e137cbac-dbd9-4349-b88a-82010e8dde9c tempest-HostsAdminTestJSON-1563365945 tempest-HostsAdminTestJSON-1563365945-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:01.176123 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e137cbac-dbd9-4349-b88a-82010e8dde9c tempest-HostsAdminTestJSON-1563365945 tempest-HostsAdminTestJSON-1563365945-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:01.178465 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e137cbac-dbd9-4349-b88a-82010e8dde9c tempest-HostsAdminTestJSON-1563365945 tempest-HostsAdminTestJSON-1563365945-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:01.179196 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e137cbac-dbd9-4349-b88a-82010e8dde9c tempest-HostsAdminTestJSON-1563365945 tempest-HostsAdminTestJSON-1563365945-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:01.284882 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e137cbac-dbd9-4349-b88a-82010e8dde9c tempest-HostsAdminTestJSON-1563365945 tempest-HostsAdminTestJSON-1563365945-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.148389 Sep 23 04:34:01.288300 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 434/895] 10.222.0.33 () {58 vars in 1128 bytes} [Fri Sep 23 04:34:01 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:34:01.301170 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4e58eb6b-bb18-44ea-9df7-1aa0d281e4a3 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:01.302608 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4e58eb6b-bb18-44ea-9df7-1aa0d281e4a3 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] [instance: f392741f-f967-4c1c-930b-4eea7272bf64] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:01.314715 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4e58eb6b-bb18-44ea-9df7-1aa0d281e4a3 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:01.315590 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4e58eb6b-bb18-44ea-9df7-1aa0d281e4a3 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:01.316308 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4e58eb6b-bb18-44ea-9df7-1aa0d281e4a3 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:01.316456 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-04edd3c7-5e5e-4687-a8c7-7a6b8fee5f84 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/f77bb6f0-6ce7-40d8-9cb2-2fcb559353ac" status: 200 len: 1644 microversion: 2.1 time: 0.473958 Sep 23 04:34:01.317246 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 462/896] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:00 2022] GET /compute/v2.1/servers/f77bb6f0-6ce7-40d8-9cb2-2fcb559353ac => generated 1644 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:01.317395 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4e58eb6b-bb18-44ea-9df7-1aa0d281e4a3 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:01.318226 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4e58eb6b-bb18-44ea-9df7-1aa0d281e4a3 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:01.318902 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4e58eb6b-bb18-44ea-9df7-1aa0d281e4a3 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:01.322263 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0551f78c-26d0-4a3c-96ca-5f05eba8ddfa tempest-HostsAdminTestJSON-1563365945 tempest-HostsAdminTestJSON-1563365945-project-admin] Calling method '.version_select at 0x7ff1c021cc10>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:01.327308 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0551f78c-26d0-4a3c-96ca-5f05eba8ddfa tempest-HostsAdminTestJSON-1563365945 tempest-HostsAdminTestJSON-1563365945-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:01.327816 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0551f78c-26d0-4a3c-96ca-5f05eba8ddfa tempest-HostsAdminTestJSON-1563365945 tempest-HostsAdminTestJSON-1563365945-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:01.328260 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0551f78c-26d0-4a3c-96ca-5f05eba8ddfa tempest-HostsAdminTestJSON-1563365945 tempest-HostsAdminTestJSON-1563365945-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:01.329003 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0551f78c-26d0-4a3c-96ca-5f05eba8ddfa tempest-HostsAdminTestJSON-1563365945 tempest-HostsAdminTestJSON-1563365945-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:01.329469 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0551f78c-26d0-4a3c-96ca-5f05eba8ddfa tempest-HostsAdminTestJSON-1563365945 tempest-HostsAdminTestJSON-1563365945-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:01.329991 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0551f78c-26d0-4a3c-96ca-5f05eba8ddfa tempest-HostsAdminTestJSON-1563365945 tempest-HostsAdminTestJSON-1563365945-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:01.404816 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0551f78c-26d0-4a3c-96ca-5f05eba8ddfa tempest-HostsAdminTestJSON-1563365945 tempest-HostsAdminTestJSON-1563365945-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.085809 Sep 23 04:34:01.405857 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 463/897] 10.222.0.33 () {58 vars in 1155 bytes} [Fri Sep 23 04:34:01 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:34:01.428184 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-053b00e6-450c-46e2-927c-dc46e1184bf2 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:01.428742 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-053b00e6-450c-46e2-927c-dc46e1184bf2 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] [instance: f77bb6f0-6ce7-40d8-9cb2-2fcb559353ac] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:01.437970 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-053b00e6-450c-46e2-927c-dc46e1184bf2 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:01.438482 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-053b00e6-450c-46e2-927c-dc46e1184bf2 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:01.441998 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-053b00e6-450c-46e2-927c-dc46e1184bf2 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:01.442754 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-053b00e6-450c-46e2-927c-dc46e1184bf2 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:01.443259 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-053b00e6-450c-46e2-927c-dc46e1184bf2 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:01.443780 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-053b00e6-450c-46e2-927c-dc46e1184bf2 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:01.647873 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4e58eb6b-bb18-44ea-9df7-1aa0d281e4a3 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c82752e1bc4fdb82e7f8391c7c129f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44352a7a6d964530aa20ae83064b02e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:01.662000 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4e58eb6b-bb18-44ea-9df7-1aa0d281e4a3 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] 10.222.0.33 "GET /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64" status: 200 len: 1471 microversion: 2.1 time: 0.370736 Sep 23 04:34:01.667705 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 435/898] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:01 2022] GET /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64 => generated 1471 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:01.674776 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2169cb3f-ff03-40e0-b52d-55937941e16e tempest-HostsAdminTestJSON-1563365945 tempest-HostsAdminTestJSON-1563365945-project-admin] Calling method '.version_select at 0x7ff1bbf144c0>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:01.683536 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2169cb3f-ff03-40e0-b52d-55937941e16e tempest-HostsAdminTestJSON-1563365945 tempest-HostsAdminTestJSON-1563365945-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:01.685318 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2169cb3f-ff03-40e0-b52d-55937941e16e tempest-HostsAdminTestJSON-1563365945 tempest-HostsAdminTestJSON-1563365945-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:01.685863 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2169cb3f-ff03-40e0-b52d-55937941e16e tempest-HostsAdminTestJSON-1563365945 tempest-HostsAdminTestJSON-1563365945-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:01.689675 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2169cb3f-ff03-40e0-b52d-55937941e16e tempest-HostsAdminTestJSON-1563365945 tempest-HostsAdminTestJSON-1563365945-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:01.690605 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2169cb3f-ff03-40e0-b52d-55937941e16e tempest-HostsAdminTestJSON-1563365945 tempest-HostsAdminTestJSON-1563365945-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:01.700602 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2169cb3f-ff03-40e0-b52d-55937941e16e tempest-HostsAdminTestJSON-1563365945 tempest-HostsAdminTestJSON-1563365945-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:01.760509 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-053b00e6-450c-46e2-927c-dc46e1184bf2 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/f77bb6f0-6ce7-40d8-9cb2-2fcb559353ac" status: 200 len: 1644 microversion: 2.1 time: 0.353615 Sep 23 04:34:01.761100 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 464/899] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:01 2022] GET /compute/v2.1/servers/f77bb6f0-6ce7-40d8-9cb2-2fcb559353ac => generated 1644 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:01.768687 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a5e04813-611f-4ef5-8feb-6dc2d55862fc tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:01.780105 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a5e04813-611f-4ef5-8feb-6dc2d55862fc tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] [instance: 9dede73d-62ac-481b-b990-41fd1039882a] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:01.784794 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2169cb3f-ff03-40e0-b52d-55937941e16e tempest-HostsAdminTestJSON-1563365945 tempest-HostsAdminTestJSON-1563365945-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.116038 Sep 23 04:34:01.793307 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 436/900] 10.222.0.33 () {58 vars in 1128 bytes} [Fri Sep 23 04:34:01 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:34:01.798379 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a5e04813-611f-4ef5-8feb-6dc2d55862fc tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:01.799112 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a5e04813-611f-4ef5-8feb-6dc2d55862fc tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:01.799320 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a5e04813-611f-4ef5-8feb-6dc2d55862fc tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:01.801303 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b90c7c0c-6a80-42a8-8d69-1d3331ee1c84 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Calling method '.version_select at 0x7ff1c00a0430>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:01.803059 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a5e04813-611f-4ef5-8feb-6dc2d55862fc tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:01.803554 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a5e04813-611f-4ef5-8feb-6dc2d55862fc tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:01.803998 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a5e04813-611f-4ef5-8feb-6dc2d55862fc tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:01.893208 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b90c7c0c-6a80-42a8-8d69-1d3331ee1c84 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] 10.222.0.33 "GET /compute/v2.1/images/a52cf834-d5f6-4c7a-9692-385e6f34b133" status: 200 len: 1427 microversion: 2.1 time: 0.099810 Sep 23 04:34:01.894431 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 437/901] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:34:01 2022] GET /compute/v2.1/images/a52cf834-d5f6-4c7a-9692-385e6f34b133 => generated 1427 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:01.900088 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9fc0398f-11ba-43af-a105-cc4171c341d0 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:01.904375 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9fc0398f-11ba-43af-a105-cc4171c341d0 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:01.905146 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9fc0398f-11ba-43af-a105-cc4171c341d0 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:01.905800 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9fc0398f-11ba-43af-a105-cc4171c341d0 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:01.906961 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9fc0398f-11ba-43af-a105-cc4171c341d0 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:01.907724 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9fc0398f-11ba-43af-a105-cc4171c341d0 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:01.908412 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9fc0398f-11ba-43af-a105-cc4171c341d0 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:01.946887 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9fc0398f-11ba-43af-a105-cc4171c341d0 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.051082 Sep 23 04:34:01.948121 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 438/902] 10.222.0.33 () {58 vars in 1176 bytes} [Fri Sep 23 04:34:01 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:34:01.954537 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-cc804d07-0168-41b4-9145-0550845fadab tempest-HostsAdminTestJSON-1563365945 tempest-HostsAdminTestJSON-1563365945-project-admin] Calling method '.version_select at 0x7ff1bbf14550>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:01.962951 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cc804d07-0168-41b4-9145-0550845fadab tempest-HostsAdminTestJSON-1563365945 tempest-HostsAdminTestJSON-1563365945-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:01.964185 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cc804d07-0168-41b4-9145-0550845fadab tempest-HostsAdminTestJSON-1563365945 tempest-HostsAdminTestJSON-1563365945-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:01.964914 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cc804d07-0168-41b4-9145-0550845fadab tempest-HostsAdminTestJSON-1563365945 tempest-HostsAdminTestJSON-1563365945-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:01.982764 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:34:02.000684 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cc804d07-0168-41b4-9145-0550845fadab tempest-HostsAdminTestJSON-1563365945 tempest-HostsAdminTestJSON-1563365945-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:02.001675 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cc804d07-0168-41b4-9145-0550845fadab tempest-HostsAdminTestJSON-1563365945 tempest-HostsAdminTestJSON-1563365945-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:02.002334 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cc804d07-0168-41b4-9145-0550845fadab tempest-HostsAdminTestJSON-1563365945 tempest-HostsAdminTestJSON-1563365945-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:02.052432 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-cc804d07-0168-41b4-9145-0550845fadab tempest-HostsAdminTestJSON-1563365945 tempest-HostsAdminTestJSON-1563365945-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hosts/n-h2-846463-3" status: 200 len: 860 microversion: 2.1 time: 0.102940 Sep 23 04:34:02.053638 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 439/903] 10.222.0.33 () {58 vars in 1170 bytes} [Fri Sep 23 04:34:01 2022] GET /compute/v2.1/os-hosts/n-h2-846463-3 => generated 860 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:34:02.059157 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-51e55aee-1ee6-4732-9ef2-ee76f34ebbb8 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-846463-3", "block_migration": true, "disk_over_commit": false}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:34:02.062930 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-51e55aee-1ee6-4732-9ef2-ee76f34ebbb8 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] [instance: f77bb6f0-6ce7-40d8-9cb2-2fcb559353ac] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:02.070350 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-51e55aee-1ee6-4732-9ef2-ee76f34ebbb8 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:02.071157 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-51e55aee-1ee6-4732-9ef2-ee76f34ebbb8 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:02.071840 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-51e55aee-1ee6-4732-9ef2-ee76f34ebbb8 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:02.074855 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-51e55aee-1ee6-4732-9ef2-ee76f34ebbb8 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:02.074855 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-51e55aee-1ee6-4732-9ef2-ee76f34ebbb8 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:02.074855 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-51e55aee-1ee6-4732-9ef2-ee76f34ebbb8 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:02.105782 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-51e55aee-1ee6-4732-9ef2-ee76f34ebbb8 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lazy-loading 'flavor' on Instance uuid f77bb6f0-6ce7-40d8-9cb2-2fcb559353ac {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:34:02.120202 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-51e55aee-1ee6-4732-9ef2-ee76f34ebbb8 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] [instance: f77bb6f0-6ce7-40d8-9cb2-2fcb559353ac] Going to try to live migrate instance to n-h1-846463-3 {{(pid=122698) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 23 04:34:02.152018 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a5e04813-611f-4ef5-8feb-6dc2d55862fc tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3135a00fc94e488cb633b89d8768fe93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332a996884724d9eb16c79f46107c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:02.162800 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a5e04813-611f-4ef5-8feb-6dc2d55862fc tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] 10.222.0.33 "GET /compute/v2.1/servers/9dede73d-62ac-481b-b990-41fd1039882a" status: 200 len: 1323 microversion: 2.1 time: 0.400059 Sep 23 04:34:02.178391 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 465/904] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:01 2022] GET /compute/v2.1/servers/9dede73d-62ac-481b-b990-41fd1039882a => generated 1323 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:02.184204 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-91f69088-8861-427e-8301-52eb4c58ae90 tempest-HostsAdminTestJSON-1563365945 tempest-HostsAdminTestJSON-1563365945-project-admin] Calling method '.version_select at 0x7ff1bbceae50>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:02.192469 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-91f69088-8861-427e-8301-52eb4c58ae90 tempest-HostsAdminTestJSON-1563365945 tempest-HostsAdminTestJSON-1563365945-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:02.193313 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-91f69088-8861-427e-8301-52eb4c58ae90 tempest-HostsAdminTestJSON-1563365945 tempest-HostsAdminTestJSON-1563365945-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:02.194027 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-91f69088-8861-427e-8301-52eb4c58ae90 tempest-HostsAdminTestJSON-1563365945 tempest-HostsAdminTestJSON-1563365945-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:02.228387 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-91f69088-8861-427e-8301-52eb4c58ae90 tempest-HostsAdminTestJSON-1563365945 tempest-HostsAdminTestJSON-1563365945-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:02.229017 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-91f69088-8861-427e-8301-52eb4c58ae90 tempest-HostsAdminTestJSON-1563365945 tempest-HostsAdminTestJSON-1563365945-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:02.229477 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-91f69088-8861-427e-8301-52eb4c58ae90 tempest-HostsAdminTestJSON-1563365945 tempest-HostsAdminTestJSON-1563365945-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:02.287858 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-91f69088-8861-427e-8301-52eb4c58ae90 tempest-HostsAdminTestJSON-1563365945 tempest-HostsAdminTestJSON-1563365945-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hosts/n-h1-846463-3" status: 200 len: 729 microversion: 2.1 time: 0.106206 Sep 23 04:34:02.301958 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 466/905] 10.222.0.33 () {58 vars in 1170 bytes} [Fri Sep 23 04:34:02 2022] GET /compute/v2.1/os-hosts/n-h1-846463-3 => generated 729 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:34:02.307589 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e10d87d6-dc32-4bf8-8858-10d783257ae6 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:02.308441 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e10d87d6-dc32-4bf8-8858-10d783257ae6 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: 09076cfa-4632-43c3-919d-4a8fe1b1bd37] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:02.316615 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e10d87d6-dc32-4bf8-8858-10d783257ae6 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:02.317552 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e10d87d6-dc32-4bf8-8858-10d783257ae6 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:02.318262 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e10d87d6-dc32-4bf8-8858-10d783257ae6 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:02.319164 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e10d87d6-dc32-4bf8-8858-10d783257ae6 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:02.319827 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e10d87d6-dc32-4bf8-8858-10d783257ae6 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:02.320424 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e10d87d6-dc32-4bf8-8858-10d783257ae6 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:02.600253 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e10d87d6-dc32-4bf8-8858-10d783257ae6 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:02.621316 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e10d87d6-dc32-4bf8-8858-10d783257ae6 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/09076cfa-4632-43c3-919d-4a8fe1b1bd37" status: 200 len: 1477 microversion: 2.1 time: 0.317924 Sep 23 04:34:02.627116 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 467/906] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:02 2022] GET /compute/v2.1/servers/09076cfa-4632-43c3-919d-4a8fe1b1bd37 => generated 1477 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:02.701104 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-40847e7e-f4af-4035-b235-49423dc3debf tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:02.725231 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-40847e7e-f4af-4035-b235-49423dc3debf tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] [instance: f392741f-f967-4c1c-930b-4eea7272bf64] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:02.746161 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-40847e7e-f4af-4035-b235-49423dc3debf tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:02.748270 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-40847e7e-f4af-4035-b235-49423dc3debf tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:02.754450 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-40847e7e-f4af-4035-b235-49423dc3debf tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:02.758239 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-40847e7e-f4af-4035-b235-49423dc3debf tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:02.763009 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-40847e7e-f4af-4035-b235-49423dc3debf tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:02.768321 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-40847e7e-f4af-4035-b235-49423dc3debf tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:03.119546 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-40847e7e-f4af-4035-b235-49423dc3debf tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c82752e1bc4fdb82e7f8391c7c129f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44352a7a6d964530aa20ae83064b02e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:03.132388 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-40847e7e-f4af-4035-b235-49423dc3debf tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] 10.222.0.33 "GET /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64" status: 200 len: 1471 microversion: 2.1 time: 0.441915 Sep 23 04:34:03.134275 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 468/907] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:02 2022] GET /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64 => generated 1471 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:03.146103 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-aa96d6ff-6139-45f8-bfd2-3dc416083fdf tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Calling method '.version_select at 0x7ff1c019e430>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:03.217222 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-aa96d6ff-6139-45f8-bfd2-3dc416083fdf tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] 10.222.0.33 "GET /compute/v2.1/images/a52cf834-d5f6-4c7a-9692-385e6f34b133" status: 200 len: 1427 microversion: 2.1 time: 0.081394 Sep 23 04:34:03.218917 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 469/908] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:34:03 2022] GET /compute/v2.1/images/a52cf834-d5f6-4c7a-9692-385e6f34b133 => generated 1427 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:03.225132 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-a2f6944f-3e42-4dc7-80cc-9ef886e7e944 req-98dd59a2-d414-4d7b-aef3-d27c59fc8c0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dede73d-62ac-481b-b990-41fd1039882a", "name": "network-vif-plugged", "status": "completed", "tag": "a606ca45-c7dd-4f7c-90b2-1c6bd26525bf"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:34:03.246510 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-a2f6944f-3e42-4dc7-80cc-9ef886e7e944 req-98dd59a2-d414-4d7b-aef3-d27c59fc8c0a service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:03.247890 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-a2f6944f-3e42-4dc7-80cc-9ef886e7e944 req-98dd59a2-d414-4d7b-aef3-d27c59fc8c0a service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:03.248683 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-a2f6944f-3e42-4dc7-80cc-9ef886e7e944 req-98dd59a2-d414-4d7b-aef3-d27c59fc8c0a service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:03.265311 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-a2f6944f-3e42-4dc7-80cc-9ef886e7e944 req-98dd59a2-d414-4d7b-aef3-d27c59fc8c0a service nova] Creating event network-vif-plugged:a606ca45-c7dd-4f7c-90b2-1c6bd26525bf for instance 9dede73d-62ac-481b-b990-41fd1039882a on n-h1-846463-3 Sep 23 04:34:03.272862 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-a2f6944f-3e42-4dc7-80cc-9ef886e7e944 req-98dd59a2-d414-4d7b-aef3-d27c59fc8c0a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052221 Sep 23 04:34:03.274731 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 470/909] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:34:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:34:03.282872 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d89f05ce-283f-4c04-8cce-d54fdb3dfc6d tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:03.284293 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d89f05ce-283f-4c04-8cce-d54fdb3dfc6d tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] [instance: 9dede73d-62ac-481b-b990-41fd1039882a] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:03.293323 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d89f05ce-283f-4c04-8cce-d54fdb3dfc6d tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:03.299416 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d89f05ce-283f-4c04-8cce-d54fdb3dfc6d tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:03.299416 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d89f05ce-283f-4c04-8cce-d54fdb3dfc6d tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:03.299416 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d89f05ce-283f-4c04-8cce-d54fdb3dfc6d tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:03.299416 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d89f05ce-283f-4c04-8cce-d54fdb3dfc6d tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:03.299751 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d89f05ce-283f-4c04-8cce-d54fdb3dfc6d tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:03.875088 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d89f05ce-283f-4c04-8cce-d54fdb3dfc6d tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3135a00fc94e488cb633b89d8768fe93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332a996884724d9eb16c79f46107c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:03.875088 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d89f05ce-283f-4c04-8cce-d54fdb3dfc6d tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] 10.222.0.33 "GET /compute/v2.1/servers/9dede73d-62ac-481b-b990-41fd1039882a" status: 200 len: 1323 microversion: 2.1 time: 0.446476 Sep 23 04:34:03.875088 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 471/910] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:03 2022] GET /compute/v2.1/servers/9dede73d-62ac-481b-b990-41fd1039882a => generated 1323 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:03.875088 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-23c4fa5c-8da7-4993-853e-e6474303e798 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:03.877352 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-23c4fa5c-8da7-4993-853e-e6474303e798 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: 09076cfa-4632-43c3-919d-4a8fe1b1bd37] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:03.877352 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-23c4fa5c-8da7-4993-853e-e6474303e798 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:03.877352 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-23c4fa5c-8da7-4993-853e-e6474303e798 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:03.877352 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-23c4fa5c-8da7-4993-853e-e6474303e798 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:03.877648 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-23c4fa5c-8da7-4993-853e-e6474303e798 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:03.877648 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-23c4fa5c-8da7-4993-853e-e6474303e798 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:03.877648 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-23c4fa5c-8da7-4993-853e-e6474303e798 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:03.877648 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=100 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:34:04.147826 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-23c4fa5c-8da7-4993-853e-e6474303e798 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:04.188081 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-23c4fa5c-8da7-4993-853e-e6474303e798 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/09076cfa-4632-43c3-919d-4a8fe1b1bd37" status: 200 len: 1477 microversion: 2.1 time: 0.436782 Sep 23 04:34:04.188081 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 472/911] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:03 2022] GET /compute/v2.1/servers/09076cfa-4632-43c3-919d-4a8fe1b1bd37 => generated 1477 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:04.188081 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-75638b84-bc58-4816-8866-5ec5334d85df tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:04.188081 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-75638b84-bc58-4816-8866-5ec5334d85df tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] [instance: f392741f-f967-4c1c-930b-4eea7272bf64] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:04.190890 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-75638b84-bc58-4816-8866-5ec5334d85df tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:04.191811 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-75638b84-bc58-4816-8866-5ec5334d85df tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:04.194536 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-75638b84-bc58-4816-8866-5ec5334d85df tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:04.200981 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-75638b84-bc58-4816-8866-5ec5334d85df tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:04.202057 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-75638b84-bc58-4816-8866-5ec5334d85df tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:04.204323 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-75638b84-bc58-4816-8866-5ec5334d85df tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:04.435092 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-75638b84-bc58-4816-8866-5ec5334d85df tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c82752e1bc4fdb82e7f8391c7c129f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44352a7a6d964530aa20ae83064b02e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:04.443416 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-75638b84-bc58-4816-8866-5ec5334d85df tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] 10.222.0.33 "GET /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64" status: 200 len: 1471 microversion: 2.1 time: 0.279217 Sep 23 04:34:04.444007 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 473/912] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:04 2022] GET /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64 => generated 1471 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:04.480763 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0843e237-270d-4ae2-9784-a5c969803f43 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Calling method '.version_select at 0x7ff1c04d7c10>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:04.583210 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0843e237-270d-4ae2-9784-a5c969803f43 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] 10.222.0.33 "GET /compute/v2.1/images/a52cf834-d5f6-4c7a-9692-385e6f34b133" status: 200 len: 1427 microversion: 2.1 time: 0.135543 Sep 23 04:34:04.584462 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 474/913] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:34:04 2022] GET /compute/v2.1/images/a52cf834-d5f6-4c7a-9692-385e6f34b133 => generated 1427 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:04.852572 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-274be746-1b59-41cb-9220-81f988327a97 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:04.857101 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-274be746-1b59-41cb-9220-81f988327a97 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] [instance: 9dede73d-62ac-481b-b990-41fd1039882a] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:04.870192 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-274be746-1b59-41cb-9220-81f988327a97 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:04.871172 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-274be746-1b59-41cb-9220-81f988327a97 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:04.876055 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-274be746-1b59-41cb-9220-81f988327a97 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:04.877570 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-274be746-1b59-41cb-9220-81f988327a97 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:04.878252 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-274be746-1b59-41cb-9220-81f988327a97 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:04.879017 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-274be746-1b59-41cb-9220-81f988327a97 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:05.135875 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-274be746-1b59-41cb-9220-81f988327a97 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3135a00fc94e488cb633b89d8768fe93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332a996884724d9eb16c79f46107c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:05.146669 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-274be746-1b59-41cb-9220-81f988327a97 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] 10.222.0.33 "GET /compute/v2.1/servers/9dede73d-62ac-481b-b990-41fd1039882a" status: 200 len: 1323 microversion: 2.1 time: 0.297938 Sep 23 04:34:05.149834 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 475/914] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:04 2022] GET /compute/v2.1/servers/9dede73d-62ac-481b-b990-41fd1039882a => generated 1323 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:34:05.203713 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-db194aff-6f20-4dae-a118-af6bcca9b5cd tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:05.204457 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-db194aff-6f20-4dae-a118-af6bcca9b5cd tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: 09076cfa-4632-43c3-919d-4a8fe1b1bd37] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:05.226829 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-db194aff-6f20-4dae-a118-af6bcca9b5cd tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:05.229380 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-db194aff-6f20-4dae-a118-af6bcca9b5cd tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:05.229837 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-db194aff-6f20-4dae-a118-af6bcca9b5cd tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:05.230604 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-db194aff-6f20-4dae-a118-af6bcca9b5cd tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:05.231098 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-db194aff-6f20-4dae-a118-af6bcca9b5cd tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:05.231539 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-db194aff-6f20-4dae-a118-af6bcca9b5cd tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:05.440744 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-db194aff-6f20-4dae-a118-af6bcca9b5cd tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:05.451936 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-db194aff-6f20-4dae-a118-af6bcca9b5cd tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/09076cfa-4632-43c3-919d-4a8fe1b1bd37" status: 200 len: 1477 microversion: 2.1 time: 0.252483 Sep 23 04:34:05.453570 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 476/915] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:05 2022] GET /compute/v2.1/servers/09076cfa-4632-43c3-919d-4a8fe1b1bd37 => generated 1477 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:05.477844 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-bd337b8f-99e6-4947-be64-f7e815513a99 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:05.478930 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-bd337b8f-99e6-4947-be64-f7e815513a99 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] [instance: f392741f-f967-4c1c-930b-4eea7272bf64] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:05.494771 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bd337b8f-99e6-4947-be64-f7e815513a99 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:05.494771 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bd337b8f-99e6-4947-be64-f7e815513a99 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:05.496253 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bd337b8f-99e6-4947-be64-f7e815513a99 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:05.498669 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bd337b8f-99e6-4947-be64-f7e815513a99 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:05.501047 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bd337b8f-99e6-4947-be64-f7e815513a99 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:05.501946 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bd337b8f-99e6-4947-be64-f7e815513a99 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:05.746243 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-bd337b8f-99e6-4947-be64-f7e815513a99 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c82752e1bc4fdb82e7f8391c7c129f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44352a7a6d964530aa20ae83064b02e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:05.755187 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-bd337b8f-99e6-4947-be64-f7e815513a99 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] 10.222.0.33 "GET /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64" status: 200 len: 1471 microversion: 2.1 time: 0.288425 Sep 23 04:34:05.759107 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 477/916] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:05 2022] GET /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64 => generated 1471 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:05.763829 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1d3dd957-0b7a-4e54-b2ee-ee42cca6502c tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Calling method '.version_select at 0x7ff1bbbcff70>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:05.834597 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1d3dd957-0b7a-4e54-b2ee-ee42cca6502c tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] 10.222.0.33 "GET /compute/v2.1/images/a52cf834-d5f6-4c7a-9692-385e6f34b133" status: 200 len: 1427 microversion: 2.1 time: 0.074343 Sep 23 04:34:05.842512 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 478/917] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:34:05 2022] GET /compute/v2.1/images/a52cf834-d5f6-4c7a-9692-385e6f34b133 => generated 1427 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:06.171580 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-98899ab0-44aa-408f-87ca-e0babf9b4d2e tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:06.175288 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-98899ab0-44aa-408f-87ca-e0babf9b4d2e tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] [instance: 9dede73d-62ac-481b-b990-41fd1039882a] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:06.199707 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-98899ab0-44aa-408f-87ca-e0babf9b4d2e tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:06.201138 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-98899ab0-44aa-408f-87ca-e0babf9b4d2e tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:06.202150 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-98899ab0-44aa-408f-87ca-e0babf9b4d2e tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:06.204397 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-98899ab0-44aa-408f-87ca-e0babf9b4d2e tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:06.209861 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-98899ab0-44aa-408f-87ca-e0babf9b4d2e tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:06.210344 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-98899ab0-44aa-408f-87ca-e0babf9b4d2e tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:06.544346 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-98899ab0-44aa-408f-87ca-e0babf9b4d2e tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3135a00fc94e488cb633b89d8768fe93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332a996884724d9eb16c79f46107c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:06.553828 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-98899ab0-44aa-408f-87ca-e0babf9b4d2e tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] 10.222.0.33 "GET /compute/v2.1/servers/9dede73d-62ac-481b-b990-41fd1039882a" status: 200 len: 1519 microversion: 2.1 time: 0.386696 Sep 23 04:34:06.571052 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 479/918] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:06 2022] GET /compute/v2.1/servers/9dede73d-62ac-481b-b990-41fd1039882a => generated 1519 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:34:06.680698 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-686c8e77-d556-426b-9ea7-46ac37a4a421 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:06.680698 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-686c8e77-d556-426b-9ea7-46ac37a4a421 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: 09076cfa-4632-43c3-919d-4a8fe1b1bd37] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:06.680698 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-686c8e77-d556-426b-9ea7-46ac37a4a421 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:06.680698 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-686c8e77-d556-426b-9ea7-46ac37a4a421 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:06.682346 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-686c8e77-d556-426b-9ea7-46ac37a4a421 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:06.682346 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-686c8e77-d556-426b-9ea7-46ac37a4a421 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:06.682346 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-686c8e77-d556-426b-9ea7-46ac37a4a421 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:06.682346 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-686c8e77-d556-426b-9ea7-46ac37a4a421 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:06.767889 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-686c8e77-d556-426b-9ea7-46ac37a4a421 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:06.776529 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-686c8e77-d556-426b-9ea7-46ac37a4a421 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/09076cfa-4632-43c3-919d-4a8fe1b1bd37" status: 200 len: 1477 microversion: 2.1 time: 0.203513 Sep 23 04:34:06.777515 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 480/919] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:06 2022] GET /compute/v2.1/servers/09076cfa-4632-43c3-919d-4a8fe1b1bd37 => generated 1477 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:06.798142 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0fb72cd1-a520-4023-bc1d-984e9441abaa tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Action: 'action', calling method: .version_select at 0x7ff1c22749d0>, body: {"addFloatingIp": {"address": "172.25.3.157"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:34:06.800961 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-0fb72cd1-a520-4023-bc1d-984e9441abaa tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] [instance: e5237b14-ce44-43de-ab20-e6e456def723] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:06.807655 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0fb72cd1-a520-4023-bc1d-984e9441abaa tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:06.808145 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0fb72cd1-a520-4023-bc1d-984e9441abaa tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:06.808636 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0fb72cd1-a520-4023-bc1d-984e9441abaa tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:06.809388 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0fb72cd1-a520-4023-bc1d-984e9441abaa tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:06.809849 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0fb72cd1-a520-4023-bc1d-984e9441abaa tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:06.810299 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0fb72cd1-a520-4023-bc1d-984e9441abaa tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:06.881319 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0fb72cd1-a520-4023-bc1d-984e9441abaa tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Acquiring lock "refresh_cache-e5237b14-ce44-43de-ab20-e6e456def723" {{(pid=122699) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 23 04:34:06.881725 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0fb72cd1-a520-4023-bc1d-984e9441abaa tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Acquired lock "refresh_cache-e5237b14-ce44-43de-ab20-e6e456def723" {{(pid=122699) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 23 04:34:07.079027 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-51e55aee-1ee6-4732-9ef2-ee76f34ebbb8 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/f77bb6f0-6ce7-40d8-9cb2-2fcb559353ac/action" status: 202 len: 0 microversion: 2.1 time: 5.023885 Sep 23 04:34:07.081702 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 440/920] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:34:02 2022] POST /compute/v2.1/servers/f77bb6f0-6ce7-40d8-9cb2-2fcb559353ac/action => generated 0 bytes in 5027 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:34:07.088533 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b6cf9c90-9bc2-40d5-8c07-dd6fc8374650 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:07.089442 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b6cf9c90-9bc2-40d5-8c07-dd6fc8374650 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] [instance: f392741f-f967-4c1c-930b-4eea7272bf64] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:07.116343 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b6cf9c90-9bc2-40d5-8c07-dd6fc8374650 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:07.116935 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b6cf9c90-9bc2-40d5-8c07-dd6fc8374650 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:07.117387 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b6cf9c90-9bc2-40d5-8c07-dd6fc8374650 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:07.118143 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b6cf9c90-9bc2-40d5-8c07-dd6fc8374650 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:07.118606 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b6cf9c90-9bc2-40d5-8c07-dd6fc8374650 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:07.119040 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b6cf9c90-9bc2-40d5-8c07-dd6fc8374650 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:07.742803 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b6cf9c90-9bc2-40d5-8c07-dd6fc8374650 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c82752e1bc4fdb82e7f8391c7c129f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44352a7a6d964530aa20ae83064b02e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:07.752321 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b6cf9c90-9bc2-40d5-8c07-dd6fc8374650 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] 10.222.0.33 "GET /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64" status: 200 len: 1471 microversion: 2.1 time: 0.669354 Sep 23 04:34:07.771651 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 441/921] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:07 2022] GET /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64 => generated 1471 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:07.783360 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9c399fc4-4fd3-47b3-b20a-033f90fe946b tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Calling method '.version_select at 0x7ff1bbf93b80>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:09.399236 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=4 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:34:09.437700 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.neutron [None req-0fb72cd1-a520-4023-bc1d-984e9441abaa tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] [instance: e5237b14-ce44-43de-ab20-e6e456def723] Building network info cache for instance {{(pid=122699) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 23 04:34:10.888733 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.neutron [None req-0fb72cd1-a520-4023-bc1d-984e9441abaa tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] [instance: e5237b14-ce44-43de-ab20-e6e456def723] Updating instance_info_cache with network_info: [{"id": "e1b845e7-999a-4e6a-b939-3cf715e6290e", "address": "fa:16:3e:e7:d0:7d", "network": {"id": "5e4e56e0-c3c5-411b-8ef5-0e167200f9bf", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1183423336-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.3.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "332a996884724d9eb16c79f46107c6af", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tape1b845e7-99", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122699) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 23 04:34:10.978490 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0fb72cd1-a520-4023-bc1d-984e9441abaa tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Releasing lock "refresh_cache-e5237b14-ce44-43de-ab20-e6e456def723" {{(pid=122699) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 23 04:34:10.979709 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0fb72cd1-a520-4023-bc1d-984e9441abaa tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] 10.222.0.33 "POST /compute/v2.1/servers/e5237b14-ce44-43de-ab20-e6e456def723/action" status: 202 len: 0 microversion: 2.1 time: 4.192397 Sep 23 04:34:10.989773 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 481/922] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:34:06 2022] POST /compute/v2.1/servers/e5237b14-ce44-43de-ab20-e6e456def723/action => generated 0 bytes in 4208 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 23 04:34:10.994241 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8fa0bcd6-ac49-482b-86eb-2f23fc92d174 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:10.997602 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-8fa0bcd6-ac49-482b-86eb-2f23fc92d174 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: f77bb6f0-6ce7-40d8-9cb2-2fcb559353ac] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:11.035240 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8fa0bcd6-ac49-482b-86eb-2f23fc92d174 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:11.038987 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8fa0bcd6-ac49-482b-86eb-2f23fc92d174 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:11.042572 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8fa0bcd6-ac49-482b-86eb-2f23fc92d174 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:11.044012 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8fa0bcd6-ac49-482b-86eb-2f23fc92d174 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:11.044528 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8fa0bcd6-ac49-482b-86eb-2f23fc92d174 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:11.044975 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8fa0bcd6-ac49-482b-86eb-2f23fc92d174 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:11.350316 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=18 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:34:11.413638 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-8fa0bcd6-ac49-482b-86eb-2f23fc92d174 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:11.426925 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-8fa0bcd6-ac49-482b-86eb-2f23fc92d174 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/f77bb6f0-6ce7-40d8-9cb2-2fcb559353ac" status: 200 len: 1503 microversion: 2.1 time: 0.438430 Sep 23 04:34:11.442444 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 482/923] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:10 2022] GET /compute/v2.1/servers/f77bb6f0-6ce7-40d8-9cb2-2fcb559353ac => generated 1503 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:11.451390 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-26c42a9f-b7c1-4527-9f7c-d5ffcb20c66c tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:11.452174 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-26c42a9f-b7c1-4527-9f7c-d5ffcb20c66c tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: 09076cfa-4632-43c3-919d-4a8fe1b1bd37] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:11.460046 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-26c42a9f-b7c1-4527-9f7c-d5ffcb20c66c tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:11.460906 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-26c42a9f-b7c1-4527-9f7c-d5ffcb20c66c tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:11.461724 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-26c42a9f-b7c1-4527-9f7c-d5ffcb20c66c tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:11.463029 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-26c42a9f-b7c1-4527-9f7c-d5ffcb20c66c tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:11.463807 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-26c42a9f-b7c1-4527-9f7c-d5ffcb20c66c tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:11.464657 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-26c42a9f-b7c1-4527-9f7c-d5ffcb20c66c tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:11.661490 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-26c42a9f-b7c1-4527-9f7c-d5ffcb20c66c tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:11.673363 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-26c42a9f-b7c1-4527-9f7c-d5ffcb20c66c tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/09076cfa-4632-43c3-919d-4a8fe1b1bd37" status: 200 len: 1477 microversion: 2.1 time: 0.228470 Sep 23 04:34:11.684775 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 483/924] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:11 2022] GET /compute/v2.1/servers/09076cfa-4632-43c3-919d-4a8fe1b1bd37 => generated 1477 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:11.698402 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-fc66930e-b625-4046-bcdf-f8e652e50314 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:11.699354 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-fc66930e-b625-4046-bcdf-f8e652e50314 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] [instance: f392741f-f967-4c1c-930b-4eea7272bf64] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:11.707201 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fc66930e-b625-4046-bcdf-f8e652e50314 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:11.707737 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fc66930e-b625-4046-bcdf-f8e652e50314 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:11.708201 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fc66930e-b625-4046-bcdf-f8e652e50314 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:11.708899 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fc66930e-b625-4046-bcdf-f8e652e50314 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:11.709581 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fc66930e-b625-4046-bcdf-f8e652e50314 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:11.710208 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fc66930e-b625-4046-bcdf-f8e652e50314 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:11.892667 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-fc66930e-b625-4046-bcdf-f8e652e50314 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c82752e1bc4fdb82e7f8391c7c129f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44352a7a6d964530aa20ae83064b02e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:11.901551 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-fc66930e-b625-4046-bcdf-f8e652e50314 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] 10.222.0.33 "GET /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64" status: 200 len: 1471 microversion: 2.1 time: 0.209965 Sep 23 04:34:11.917774 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 484/925] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:11 2022] GET /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64 => generated 1471 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:11.923556 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=7 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:34:11.926877 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-f5542572-844a-4cae-99ef-a4e5b9f74c41 req-1e7c405c-bed2-453a-9381-0bef9f9c414f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5237b14-ce44-43de-ab20-e6e456def723", "tag": "e1b845e7-999a-4e6a-b939-3cf715e6290e"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:34:11.958926 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-f5542572-844a-4cae-99ef-a4e5b9f74c41 req-1e7c405c-bed2-453a-9381-0bef9f9c414f service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:11.959706 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-f5542572-844a-4cae-99ef-a4e5b9f74c41 req-1e7c405c-bed2-453a-9381-0bef9f9c414f service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:11.960143 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-f5542572-844a-4cae-99ef-a4e5b9f74c41 req-1e7c405c-bed2-453a-9381-0bef9f9c414f service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:11.974523 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-f5542572-844a-4cae-99ef-a4e5b9f74c41 req-1e7c405c-bed2-453a-9381-0bef9f9c414f service nova] Creating event network-changed:e1b845e7-999a-4e6a-b939-3cf715e6290e for instance e5237b14-ce44-43de-ab20-e6e456def723 on n-h1-846463-3 Sep 23 04:34:11.980249 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-f5542572-844a-4cae-99ef-a4e5b9f74c41 req-1e7c405c-bed2-453a-9381-0bef9f9c414f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060652 Sep 23 04:34:11.981880 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 485/926] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:34:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:34:11.988061 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-23367469-3525-4004-9f1b-afdeefc5911c req-339a25c0-f90b-4e39-9d2f-4b239acd79b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f77bb6f0-6ce7-40d8-9cb2-2fcb559353ac", "name": "network-vif-unplugged", "status": "completed", "tag": "f109c520-e5ff-40d8-a820-4cc8e75e5e84"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:34:12.002040 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-23367469-3525-4004-9f1b-afdeefc5911c req-339a25c0-f90b-4e39-9d2f-4b239acd79b5 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:12.002906 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-23367469-3525-4004-9f1b-afdeefc5911c req-339a25c0-f90b-4e39-9d2f-4b239acd79b5 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:12.003546 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-23367469-3525-4004-9f1b-afdeefc5911c req-339a25c0-f90b-4e39-9d2f-4b239acd79b5 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:12.018909 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-23367469-3525-4004-9f1b-afdeefc5911c req-339a25c0-f90b-4e39-9d2f-4b239acd79b5 service nova] Creating event network-vif-unplugged:f109c520-e5ff-40d8-a820-4cc8e75e5e84 for instance f77bb6f0-6ce7-40d8-9cb2-2fcb559353ac on n-h2-846463-3 Sep 23 04:34:12.026501 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-23367469-3525-4004-9f1b-afdeefc5911c req-339a25c0-f90b-4e39-9d2f-4b239acd79b5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042694 Sep 23 04:34:12.028409 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 486/927] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:34:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:34:12.255951 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d9633fee-ddcf-4579-942d-da18ab54594e tempest-HypervisorAdminNegativeTestJSON-728382603 tempest-HypervisorAdminNegativeTestJSON-728382603-project] Calling method '.version_select at 0x7ff1bbc998b0>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:12.258587 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d9633fee-ddcf-4579-942d-da18ab54594e tempest-HypervisorAdminNegativeTestJSON-728382603 tempest-HypervisorAdminNegativeTestJSON-728382603-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': 'ef62b112a01d41be978336904e665c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352fcc27a585434ebf87099f27e69fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:12.263540 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d9633fee-ddcf-4579-942d-da18ab54594e tempest-HypervisorAdminNegativeTestJSON-728382603 tempest-HypervisorAdminNegativeTestJSON-728382603-project] Request method failure captured: Sep 23 04:34:12.263540 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Sep 23 04:34:12.263540 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:34:12.263540 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:34:12.263540 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:34:12.263540 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:34:12.263540 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:34:12.263540 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:34:12.263540 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:34:12.263540 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:34:12.263540 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTdAVzXEbW6HPU-cQwoy9UcMlumBicfGVOGPcuzQg83hxROUnxdI1LWtyod2bFto7SoNT7_Xgq6oAW5oZyq4R7yU0g-LbGZuEopjbmoFjI1mAnLqSDVA0QjFhfK8HlMZXLeAFjfNTXxaZ4raspJkldEvj0KfG3wsglYMrZ5A6LfG8QQ Sep 23 04:34:12.263540 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:34:12.263540 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:34:12.263540 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:34:12.263540 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:34:12.263540 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:34:12.263540 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:34:12.263540 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 352fcc27a585434ebf87099f27e69fb6 Sep 23 04:34:12.263540 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-728382603 Sep 23 04:34:12.263540 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:34:12.263540 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:34:12.267623 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_352fcc27a585434ebf87099f27e69fb6", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/352fcc27a585434ebf87099f27e69fb6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/352fcc27a585434ebf87099f27e69fb6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/352fcc27a585434ebf87099f27e69fb6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:34:12.267623 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-728382603 Sep 23 04:34:12.267623 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 352fcc27a585434ebf87099f27e69fb6 Sep 23 04:34:12.267623 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-728382603 Sep 23 04:34:12.267623 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-HypervisorAdminNegativeTestJSON-728382603-project Sep 23 04:34:12.267623 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:34:12.267623 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:34:12.267623 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: ef62b112a01d41be978336904e665c40 Sep 23 04:34:12.267623 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-728382603-project Sep 23 04:34:12.267623 n-d-846463-3 devstack@n-api.service[122699]: method: Sep 23 04:34:12.267623 n-d-846463-3 devstack@n-api.service[122699]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Sep 23 04:34:12.267623 n-d-846463-3 devstack@n-api.service[122699]: action_args: {} Sep 23 04:34:12.267623 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:34:12.268523 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:34:12.268523 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:34:12.268523 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:34:12.268523 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:34:12.268523 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:34:12.268523 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:34:12.268523 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:34:12.268523 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:34:12.268523 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:34:12.268523 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Sep 23 04:34:12.268523 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self._detail(req) Sep 23 04:34:12.268523 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Sep 23 04:34:12.268523 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Sep 23 04:34:12.268523 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 23 04:34:12.268523 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 23 04:34:12.268523 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 23 04:34:12.268523 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 23 04:34:12.268523 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 23 04:34:12.268523 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 23 04:34:12.270084 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 23 04:34:12.270084 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise self.value Sep 23 04:34:12.270084 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 23 04:34:12.270084 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 23 04:34:12.270084 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 23 04:34:12.270084 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 23 04:34:12.270084 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 23 04:34:12.270084 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 23 04:34:12.270084 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Sep 23 04:34:12.270084 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:34:12.270084 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:34:12.270084 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:34:12.270084 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:34:12.270084 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:34:12.270084 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:34:12.270084 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 23 04:34:12.270084 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 23 04:34:12.270084 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Sep 23 04:34:12.270084 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:34:12.271411 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d9633fee-ddcf-4579-942d-da18ab54594e tempest-HypervisorAdminNegativeTestJSON-728382603 tempest-HypervisorAdminNegativeTestJSON-728382603-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:34:12.271411 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d9633fee-ddcf-4579-942d-da18ab54594e tempest-HypervisorAdminNegativeTestJSON-728382603 tempest-HypervisorAdminNegativeTestJSON-728382603-project] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.235763 Sep 23 04:34:12.273496 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 487/928] 10.222.0.33 () {58 vars in 1167 bytes} [Fri Sep 23 04:34:12 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 244 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:34:12.278797 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-304622c5-6e54-4a47-bf3a-457659acd0a5 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.3.157"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:34:12.281815 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-304622c5-6e54-4a47-bf3a-457659acd0a5 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] [instance: 9dede73d-62ac-481b-b990-41fd1039882a] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:12.291805 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-304622c5-6e54-4a47-bf3a-457659acd0a5 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:12.294839 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-304622c5-6e54-4a47-bf3a-457659acd0a5 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:12.294839 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-304622c5-6e54-4a47-bf3a-457659acd0a5 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:12.294839 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-304622c5-6e54-4a47-bf3a-457659acd0a5 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:12.294839 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-304622c5-6e54-4a47-bf3a-457659acd0a5 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:12.295599 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-304622c5-6e54-4a47-bf3a-457659acd0a5 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:12.326786 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-304622c5-6e54-4a47-bf3a-457659acd0a5 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Acquiring lock "refresh_cache-9dede73d-62ac-481b-b990-41fd1039882a" {{(pid=122699) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 23 04:34:12.327531 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-304622c5-6e54-4a47-bf3a-457659acd0a5 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Acquired lock "refresh_cache-9dede73d-62ac-481b-b990-41fd1039882a" {{(pid=122699) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 23 04:34:15.061219 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.network.neutron [None req-304622c5-6e54-4a47-bf3a-457659acd0a5 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] [instance: 9dede73d-62ac-481b-b990-41fd1039882a] re-assign floating IP 172.25.3.157 from instance e5237b14-ce44-43de-ab20-e6e456def723 Sep 23 04:34:15.138217 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.neutron [None req-304622c5-6e54-4a47-bf3a-457659acd0a5 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] [instance: e5237b14-ce44-43de-ab20-e6e456def723] Building network info cache for instance {{(pid=122699) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 23 04:34:15.980407 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.neutron [None req-304622c5-6e54-4a47-bf3a-457659acd0a5 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] [instance: e5237b14-ce44-43de-ab20-e6e456def723] Updating instance_info_cache with network_info: [{"id": "e1b845e7-999a-4e6a-b939-3cf715e6290e", "address": "fa:16:3e:e7:d0:7d", "network": {"id": "5e4e56e0-c3c5-411b-8ef5-0e167200f9bf", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1183423336-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "332a996884724d9eb16c79f46107c6af", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tape1b845e7-99", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122699) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 23 04:34:16.178099 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.neutron [None req-304622c5-6e54-4a47-bf3a-457659acd0a5 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] [instance: 9dede73d-62ac-481b-b990-41fd1039882a] Building network info cache for instance {{(pid=122699) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 23 04:34:16.911302 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.neutron [None req-304622c5-6e54-4a47-bf3a-457659acd0a5 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] [instance: 9dede73d-62ac-481b-b990-41fd1039882a] Updating instance_info_cache with network_info: [{"id": "a606ca45-c7dd-4f7c-90b2-1c6bd26525bf", "address": "fa:16:3e:e6:29:b4", "network": {"id": "5e4e56e0-c3c5-411b-8ef5-0e167200f9bf", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1183423336-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.3.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "332a996884724d9eb16c79f46107c6af", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapa606ca45-c7", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122699) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 23 04:34:16.996067 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-304622c5-6e54-4a47-bf3a-457659acd0a5 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Releasing lock "refresh_cache-9dede73d-62ac-481b-b990-41fd1039882a" {{(pid=122699) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 23 04:34:16.997199 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-304622c5-6e54-4a47-bf3a-457659acd0a5 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] 10.222.0.33 "POST /compute/v2.1/servers/9dede73d-62ac-481b-b990-41fd1039882a/action" status: 202 len: 0 microversion: 2.1 time: 4.722429 Sep 23 04:34:16.998814 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 488/929] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:34:12 2022] POST /compute/v2.1/servers/9dede73d-62ac-481b-b990-41fd1039882a/action => generated 0 bytes in 4725 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 23 04:34:17.003744 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-91be36bf-da2b-4cc6-b363-897802dd61c4 tempest-HypervisorAdminNegativeTestJSON-728382603 tempest-HypervisorAdminNegativeTestJSON-728382603-project] Calling method '.version_select at 0x7ff1bbb82040>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:17.007349 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-91be36bf-da2b-4cc6-b363-897802dd61c4 tempest-HypervisorAdminNegativeTestJSON-728382603 tempest-HypervisorAdminNegativeTestJSON-728382603-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': 'ef62b112a01d41be978336904e665c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352fcc27a585434ebf87099f27e69fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:17.008128 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-91be36bf-da2b-4cc6-b363-897802dd61c4 tempest-HypervisorAdminNegativeTestJSON-728382603 tempest-HypervisorAdminNegativeTestJSON-728382603-project] Request method failure captured: Sep 23 04:34:17.008128 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Sep 23 04:34:17.008128 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:34:17.008128 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:34:17.008128 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:34:17.008128 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:34:17.008128 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:34:17.008128 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:34:17.008128 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:34:17.008128 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:34:17.008128 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTdAVzXEbW6HPU-cQwoy9UcMlumBicfGVOGPcuzQg83hxROUnxdI1LWtyod2bFto7SoNT7_Xgq6oAW5oZyq4R7yU0g-LbGZuEopjbmoFjI1mAnLqSDVA0QjFhfK8HlMZXLeAFjfNTXxaZ4raspJkldEvj0KfG3wsglYMrZ5A6LfG8QQ Sep 23 04:34:17.008128 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:34:17.008128 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:34:17.008128 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:34:17.008128 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:34:17.008128 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:34:17.008128 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:34:17.008128 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 352fcc27a585434ebf87099f27e69fb6 Sep 23 04:34:17.008128 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-728382603 Sep 23 04:34:17.008128 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:34:17.008128 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:34:17.009818 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_352fcc27a585434ebf87099f27e69fb6", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/352fcc27a585434ebf87099f27e69fb6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/352fcc27a585434ebf87099f27e69fb6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/352fcc27a585434ebf87099f27e69fb6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:34:17.009818 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-728382603 Sep 23 04:34:17.009818 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 352fcc27a585434ebf87099f27e69fb6 Sep 23 04:34:17.009818 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-728382603 Sep 23 04:34:17.009818 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-HypervisorAdminNegativeTestJSON-728382603-project Sep 23 04:34:17.009818 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:34:17.009818 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:34:17.009818 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: ef62b112a01d41be978336904e665c40 Sep 23 04:34:17.009818 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-728382603-project Sep 23 04:34:17.009818 n-d-846463-3 devstack@n-api.service[122699]: method: Sep 23 04:34:17.009818 n-d-846463-3 devstack@n-api.service[122699]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Sep 23 04:34:17.009818 n-d-846463-3 devstack@n-api.service[122699]: action_args: {} Sep 23 04:34:17.009818 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:34:17.010884 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:34:17.010884 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:34:17.010884 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:34:17.010884 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:34:17.010884 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:34:17.010884 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:34:17.010884 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:34:17.010884 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:34:17.010884 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:34:17.010884 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Sep 23 04:34:17.010884 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self._index(req) Sep 23 04:34:17.010884 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Sep 23 04:34:17.010884 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Sep 23 04:34:17.010884 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 23 04:34:17.010884 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 23 04:34:17.010884 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 23 04:34:17.010884 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 23 04:34:17.010884 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 23 04:34:17.010884 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 23 04:34:17.012403 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 23 04:34:17.012403 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise self.value Sep 23 04:34:17.012403 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 23 04:34:17.012403 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 23 04:34:17.012403 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 23 04:34:17.012403 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 23 04:34:17.012403 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 23 04:34:17.012403 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 23 04:34:17.012403 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Sep 23 04:34:17.012403 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:34:17.012403 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:34:17.012403 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:34:17.012403 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:34:17.012403 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:34:17.012403 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:34:17.012403 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 23 04:34:17.012403 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 23 04:34:17.012403 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Sep 23 04:34:17.012403 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:34:17.014572 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-91be36bf-da2b-4cc6-b363-897802dd61c4 tempest-HypervisorAdminNegativeTestJSON-728382603 tempest-HypervisorAdminNegativeTestJSON-728382603-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:34:17.015581 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-91be36bf-da2b-4cc6-b363-897802dd61c4 tempest-HypervisorAdminNegativeTestJSON-728382603 tempest-HypervisorAdminNegativeTestJSON-728382603-project] 10.222.0.33 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.015647 Sep 23 04:34:17.016857 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 489/930] 10.222.0.33 () {58 vars in 1146 bytes} [Fri Sep 23 04:34:16 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:34:17.021508 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-026d95e0-03fb-4f04-bb4a-b5390175c2a1 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:17.022386 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-026d95e0-03fb-4f04-bb4a-b5390175c2a1 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: f77bb6f0-6ce7-40d8-9cb2-2fcb559353ac] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:17.030406 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-026d95e0-03fb-4f04-bb4a-b5390175c2a1 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:17.031117 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-026d95e0-03fb-4f04-bb4a-b5390175c2a1 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:17.031826 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-026d95e0-03fb-4f04-bb4a-b5390175c2a1 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:17.032848 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-026d95e0-03fb-4f04-bb4a-b5390175c2a1 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:17.033470 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-026d95e0-03fb-4f04-bb4a-b5390175c2a1 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:17.034100 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-026d95e0-03fb-4f04-bb4a-b5390175c2a1 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:17.115807 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:34:17.260300 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-026d95e0-03fb-4f04-bb4a-b5390175c2a1 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:17.270073 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-026d95e0-03fb-4f04-bb4a-b5390175c2a1 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/f77bb6f0-6ce7-40d8-9cb2-2fcb559353ac" status: 200 len: 1503 microversion: 2.1 time: 0.251985 Sep 23 04:34:17.272402 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 490/931] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:17 2022] GET /compute/v2.1/servers/f77bb6f0-6ce7-40d8-9cb2-2fcb559353ac => generated 1503 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:17.277337 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e1b7bf49-b158-4bd6-8c9d-63ce7b2f8b2b tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:17.278787 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e1b7bf49-b158-4bd6-8c9d-63ce7b2f8b2b tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: 09076cfa-4632-43c3-919d-4a8fe1b1bd37] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:17.285384 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e1b7bf49-b158-4bd6-8c9d-63ce7b2f8b2b tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:17.286283 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e1b7bf49-b158-4bd6-8c9d-63ce7b2f8b2b tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:17.286959 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e1b7bf49-b158-4bd6-8c9d-63ce7b2f8b2b tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:17.288172 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e1b7bf49-b158-4bd6-8c9d-63ce7b2f8b2b tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:17.289089 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e1b7bf49-b158-4bd6-8c9d-63ce7b2f8b2b tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:17.289967 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e1b7bf49-b158-4bd6-8c9d-63ce7b2f8b2b tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:17.318513 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=91,nova_cell1:SAVEPOINT=3,nova_cell1:UPDATE=3,nova_cell1:RELEASE=3 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:34:17.483561 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e1b7bf49-b158-4bd6-8c9d-63ce7b2f8b2b tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:17.503677 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e1b7bf49-b158-4bd6-8c9d-63ce7b2f8b2b tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/09076cfa-4632-43c3-919d-4a8fe1b1bd37" status: 200 len: 1474 microversion: 2.1 time: 0.229754 Sep 23 04:34:17.505863 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 491/932] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:17 2022] GET /compute/v2.1/servers/09076cfa-4632-43c3-919d-4a8fe1b1bd37 => generated 1474 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:17.511228 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-88b30282-7add-41ee-ab6b-9fa2abb5aa6a tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:17.511969 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-88b30282-7add-41ee-ab6b-9fa2abb5aa6a tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] [instance: f392741f-f967-4c1c-930b-4eea7272bf64] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:17.518267 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-88b30282-7add-41ee-ab6b-9fa2abb5aa6a tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:17.518840 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-88b30282-7add-41ee-ab6b-9fa2abb5aa6a tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:17.519359 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-88b30282-7add-41ee-ab6b-9fa2abb5aa6a tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:17.521292 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-88b30282-7add-41ee-ab6b-9fa2abb5aa6a tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:17.521616 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-88b30282-7add-41ee-ab6b-9fa2abb5aa6a tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:17.522180 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-88b30282-7add-41ee-ab6b-9fa2abb5aa6a tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:17.753980 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:34:17.785869 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-88b30282-7add-41ee-ab6b-9fa2abb5aa6a tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c82752e1bc4fdb82e7f8391c7c129f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44352a7a6d964530aa20ae83064b02e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:17.796665 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-88b30282-7add-41ee-ab6b-9fa2abb5aa6a tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] 10.222.0.33 "GET /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64" status: 200 len: 1477 microversion: 2.1 time: 0.288951 Sep 23 04:34:17.797963 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 492/933] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:17 2022] GET /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64 => generated 1477 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:17.807219 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-3787a656-1b92-4183-a2bb-958b0977652c req-dc54d829-b459-4d40-b116-b59c253eaeba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f77bb6f0-6ce7-40d8-9cb2-2fcb559353ac", "tag": "f109c520-e5ff-40d8-a820-4cc8e75e5e84"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:34:17.855403 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-3787a656-1b92-4183-a2bb-958b0977652c req-dc54d829-b459-4d40-b116-b59c253eaeba service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:17.859367 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-3787a656-1b92-4183-a2bb-958b0977652c req-dc54d829-b459-4d40-b116-b59c253eaeba service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:17.860351 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-3787a656-1b92-4183-a2bb-958b0977652c req-dc54d829-b459-4d40-b116-b59c253eaeba service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:17.884989 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-3787a656-1b92-4183-a2bb-958b0977652c req-dc54d829-b459-4d40-b116-b59c253eaeba service nova] Creating event network-changed:f109c520-e5ff-40d8-a820-4cc8e75e5e84 for instance f77bb6f0-6ce7-40d8-9cb2-2fcb559353ac on n-h2-846463-3 Sep 23 04:34:17.892357 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-3787a656-1b92-4183-a2bb-958b0977652c req-dc54d829-b459-4d40-b116-b59c253eaeba service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092149 Sep 23 04:34:17.893528 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 493/934] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:34:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:34:17.899821 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-7d658338-2655-4430-8efd-6ebedf67c0e5 req-8a2f8af5-efe7-41c4-9546-dac7eb9ebaec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5237b14-ce44-43de-ab20-e6e456def723", "tag": "e1b845e7-999a-4e6a-b939-3cf715e6290e"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:34:17.916726 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-7d658338-2655-4430-8efd-6ebedf67c0e5 req-8a2f8af5-efe7-41c4-9546-dac7eb9ebaec service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:17.917526 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-7d658338-2655-4430-8efd-6ebedf67c0e5 req-8a2f8af5-efe7-41c4-9546-dac7eb9ebaec service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:17.918744 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-7d658338-2655-4430-8efd-6ebedf67c0e5 req-8a2f8af5-efe7-41c4-9546-dac7eb9ebaec service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:17.934656 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-7d658338-2655-4430-8efd-6ebedf67c0e5 req-8a2f8af5-efe7-41c4-9546-dac7eb9ebaec service nova] Creating event network-changed:e1b845e7-999a-4e6a-b939-3cf715e6290e for instance e5237b14-ce44-43de-ab20-e6e456def723 on n-h1-846463-3 Sep 23 04:34:17.942768 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-7d658338-2655-4430-8efd-6ebedf67c0e5 req-8a2f8af5-efe7-41c4-9546-dac7eb9ebaec service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047685 Sep 23 04:34:17.946776 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 494/935] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:34:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:34:17.971004 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9d4aaade-d7c1-4362-b83a-23c60eced066 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Action: 'action', calling method: .version_select at 0x7ff1c2274820>, body: {"removeFloatingIp": {"address": "172.25.3.157"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:34:18.205397 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-9d4aaade-d7c1-4362-b83a-23c60eced066 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] [instance: 9dede73d-62ac-481b-b990-41fd1039882a] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:18.224045 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9d4aaade-d7c1-4362-b83a-23c60eced066 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:18.224588 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9d4aaade-d7c1-4362-b83a-23c60eced066 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:18.227059 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9d4aaade-d7c1-4362-b83a-23c60eced066 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:18.232934 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9d4aaade-d7c1-4362-b83a-23c60eced066 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:18.232934 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9d4aaade-d7c1-4362-b83a-23c60eced066 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:18.232934 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9d4aaade-d7c1-4362-b83a-23c60eced066 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:18.689244 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-9d4aaade-d7c1-4362-b83a-23c60eced066 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] HTTP exception thrown: Floating IP 172.25.3.157 is not associated with instance e5237b14-ce44-43de-ab20-e6e456def723. Sep 23 04:34:18.691656 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9d4aaade-d7c1-4362-b83a-23c60eced066 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Request method failure captured: Sep 23 04:34:18.691656 n-d-846463-3 devstack@n-api.service[122699]: request: POST /compute/v2.1/servers/e5237b14-ce44-43de-ab20-e6e456def723/action HTTP/1.1 Sep 23 04:34:18.691656 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:34:18.691656 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:34:18.691656 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:34:18.691656 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 49 Sep 23 04:34:18.691656 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:34:18.691656 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:34:18.691656 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:34:18.691656 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:34:18.691656 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTcHNy6q1jovkTYRvB6Nd1Yn75ASiOTXg5P6FWNfMqfZsExkROsoJvfjzTWt1ewBvvhF7GNO3lXnOfc_-N9fOZu-4OBo5IfOZiZ2qxKSq6QkXqeSvVLRZU5bVykPO8lROcxqJSGn1N_UoxXezu6H8y5yxJtWtqmydu-QUKpzUJ2YFUc Sep 23 04:34:18.691656 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:34:18.691656 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:34:18.691656 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:34:18.691656 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:34:18.691656 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:34:18.691656 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:34:18.691656 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 332a996884724d9eb16c79f46107c6af Sep 23 04:34:18.691656 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1298389341 Sep 23 04:34:18.691656 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:34:18.691656 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:34:18.693026 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_332a996884724d9eb16c79f46107c6af", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/332a996884724d9eb16c79f46107c6af"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/332a996884724d9eb16c79f46107c6af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/332a996884724d9eb16c79f46107c6af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:34:18.693026 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1298389341 Sep 23 04:34:18.693026 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 332a996884724d9eb16c79f46107c6af Sep 23 04:34:18.693026 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1298389341 Sep 23 04:34:18.693026 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-FloatingIPsAssociationTestJSON-1298389341-project Sep 23 04:34:18.693026 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:34:18.693026 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:34:18.693026 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 3135a00fc94e488cb633b89d8768fe93 Sep 23 04:34:18.693026 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1298389341-project Sep 23 04:34:18.693026 n-d-846463-3 devstack@n-api.service[122699]: Sep 23 04:34:18.693026 n-d-846463-3 devstack@n-api.service[122699]: {"removeFloatingIp": {"address": "172.25.3.157"}} Sep 23 04:34:18.693026 n-d-846463-3 devstack@n-api.service[122699]: method: Sep 23 04:34:18.693026 n-d-846463-3 devstack@n-api.service[122699]: exception: Floating IP 172.25.3.157 is not associated with instance e5237b14-ce44-43de-ab20-e6e456def723. Sep 23 04:34:18.694278 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': 'e5237b14-ce44-43de-ab20-e6e456def723', 'body': {'removeFloatingIp': {'address': '172.25.3.157'}}} Sep 23 04:34:18.694278 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:34:18.694278 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:34:18.694278 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:34:18.694278 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:34:18.694278 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:34:18.694278 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:34:18.694278 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:34:18.694278 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:34:18.694278 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:34:18.694278 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:34:18.694278 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:34:18.694278 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:34:18.694278 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Sep 23 04:34:18.694278 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 23 04:34:18.694278 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.3.157 is not associated with instance e5237b14-ce44-43de-ab20-e6e456def723. Sep 23 04:34:18.694278 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:34:18.694278 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:34:18.694278 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:34:18.694278 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:34:18.695534 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:34:18.695534 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:34:18.695534 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:34:18.695534 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:34:18.695534 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.3.157 is not associated with instance e5237b14-ce44-43de-ab20-e6e456def723. Sep 23 04:34:18.695534 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:34:18.695534 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9d4aaade-d7c1-4362-b83a-23c60eced066 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Returning 409 to user: Floating IP 172.25.3.157 is not associated with instance e5237b14-ce44-43de-ab20-e6e456def723. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:34:18.695534 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-9d4aaade-d7c1-4362-b83a-23c60eced066 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] 10.222.0.33 "POST /compute/v2.1/servers/e5237b14-ce44-43de-ab20-e6e456def723/action" status: 409 len: 146 microversion: 2.1 time: 0.743908 Sep 23 04:34:18.697519 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 495/936] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:34:17 2022] POST /compute/v2.1/servers/e5237b14-ce44-43de-ab20-e6e456def723/action => generated 146 bytes in 750 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 23 04:34:18.702854 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c47d68f1-00da-4e02-8125-6b0977c32950 tempest-HypervisorAdminNegativeTestJSON-728382603 tempest-HypervisorAdminNegativeTestJSON-728382603-project] Calling method '.version_select at 0x7ff1bbc99f70>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:18.704661 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c47d68f1-00da-4e02-8125-6b0977c32950 tempest-HypervisorAdminNegativeTestJSON-728382603 tempest-HypervisorAdminNegativeTestJSON-728382603-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': 'ef62b112a01d41be978336904e665c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352fcc27a585434ebf87099f27e69fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:18.706326 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c47d68f1-00da-4e02-8125-6b0977c32950 tempest-HypervisorAdminNegativeTestJSON-728382603 tempest-HypervisorAdminNegativeTestJSON-728382603-project] Request method failure captured: Sep 23 04:34:18.706326 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Sep 23 04:34:18.706326 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:34:18.706326 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:34:18.706326 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:34:18.706326 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:34:18.706326 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:34:18.706326 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:34:18.706326 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:34:18.706326 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:34:18.706326 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTdAVzXEbW6HPU-cQwoy9UcMlumBicfGVOGPcuzQg83hxROUnxdI1LWtyod2bFto7SoNT7_Xgq6oAW5oZyq4R7yU0g-LbGZuEopjbmoFjI1mAnLqSDVA0QjFhfK8HlMZXLeAFjfNTXxaZ4raspJkldEvj0KfG3wsglYMrZ5A6LfG8QQ Sep 23 04:34:18.706326 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:34:18.706326 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:34:18.706326 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:34:18.706326 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:34:18.706326 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:34:18.706326 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:34:18.706326 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 352fcc27a585434ebf87099f27e69fb6 Sep 23 04:34:18.706326 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-728382603 Sep 23 04:34:18.706326 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:34:18.706326 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:34:18.707624 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_352fcc27a585434ebf87099f27e69fb6", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/352fcc27a585434ebf87099f27e69fb6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/352fcc27a585434ebf87099f27e69fb6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/352fcc27a585434ebf87099f27e69fb6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:34:18.707624 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-728382603 Sep 23 04:34:18.707624 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 352fcc27a585434ebf87099f27e69fb6 Sep 23 04:34:18.707624 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-728382603 Sep 23 04:34:18.707624 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-HypervisorAdminNegativeTestJSON-728382603-project Sep 23 04:34:18.707624 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:34:18.707624 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:34:18.707624 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: ef62b112a01d41be978336904e665c40 Sep 23 04:34:18.707624 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-728382603-project Sep 23 04:34:18.707624 n-d-846463-3 devstack@n-api.service[122699]: method: Sep 23 04:34:18.707624 n-d-846463-3 devstack@n-api.service[122699]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Sep 23 04:34:18.707624 n-d-846463-3 devstack@n-api.service[122699]: action_args: {} Sep 23 04:34:18.707624 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:34:18.708392 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:34:18.708392 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:34:18.708392 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:34:18.708392 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:34:18.708392 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:34:18.708392 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:34:18.708392 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:34:18.708392 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:34:18.708392 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:34:18.708392 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Sep 23 04:34:18.708392 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Sep 23 04:34:18.708392 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 23 04:34:18.708392 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 23 04:34:18.708392 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 23 04:34:18.708392 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 23 04:34:18.708392 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 23 04:34:18.708392 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 23 04:34:18.708392 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 23 04:34:18.708392 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise self.value Sep 23 04:34:18.718668 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 23 04:34:18.718668 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 23 04:34:18.718668 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 23 04:34:18.718668 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 23 04:34:18.718668 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 23 04:34:18.718668 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 23 04:34:18.718668 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Sep 23 04:34:18.718668 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:34:18.718668 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:34:18.718668 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:34:18.718668 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:34:18.718668 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:34:18.718668 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:34:18.718668 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 23 04:34:18.718668 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 23 04:34:18.718668 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Sep 23 04:34:18.718668 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:34:18.721314 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c47d68f1-00da-4e02-8125-6b0977c32950 tempest-HypervisorAdminNegativeTestJSON-728382603 tempest-HypervisorAdminNegativeTestJSON-728382603-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:34:18.721314 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c47d68f1-00da-4e02-8125-6b0977c32950 tempest-HypervisorAdminNegativeTestJSON-728382603 tempest-HypervisorAdminNegativeTestJSON-728382603-project] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.010146 Sep 23 04:34:18.721314 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 496/937] 10.222.0.33 () {58 vars in 1179 bytes} [Fri Sep 23 04:34:18 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:34:18.721314 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-6f181617-28b7-4e6f-8d7e-4a40d8d11e96 req-8d10664b-e7d1-49d3-a896-5ff677013fc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f392741f-f967-4c1c-930b-4eea7272bf64", "name": "network-vif-unplugged", "status": "completed", "tag": "a8e6bde0-f854-4040-8b7f-b369ce18b326"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:34:18.728373 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-6f181617-28b7-4e6f-8d7e-4a40d8d11e96 req-8d10664b-e7d1-49d3-a896-5ff677013fc8 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:18.728948 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-6f181617-28b7-4e6f-8d7e-4a40d8d11e96 req-8d10664b-e7d1-49d3-a896-5ff677013fc8 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:18.729397 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-6f181617-28b7-4e6f-8d7e-4a40d8d11e96 req-8d10664b-e7d1-49d3-a896-5ff677013fc8 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:18.742083 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-6f181617-28b7-4e6f-8d7e-4a40d8d11e96 req-8d10664b-e7d1-49d3-a896-5ff677013fc8 service nova] Creating event network-vif-unplugged:a8e6bde0-f854-4040-8b7f-b369ce18b326 for instance f392741f-f967-4c1c-930b-4eea7272bf64 on n-h1-846463-3 Sep 23 04:34:18.747854 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-6f181617-28b7-4e6f-8d7e-4a40d8d11e96 req-8d10664b-e7d1-49d3-a896-5ff677013fc8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037481 Sep 23 04:34:18.748890 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 497/938] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:34:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:34:18.755262 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-387a8d5c-3700-410b-8bf0-c48ae4619569 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:18.756910 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-387a8d5c-3700-410b-8bf0-c48ae4619569 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: f77bb6f0-6ce7-40d8-9cb2-2fcb559353ac] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:18.763748 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-387a8d5c-3700-410b-8bf0-c48ae4619569 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:18.764238 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-387a8d5c-3700-410b-8bf0-c48ae4619569 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:18.765327 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-387a8d5c-3700-410b-8bf0-c48ae4619569 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:18.765467 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-387a8d5c-3700-410b-8bf0-c48ae4619569 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:18.765858 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-387a8d5c-3700-410b-8bf0-c48ae4619569 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:18.766652 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-387a8d5c-3700-410b-8bf0-c48ae4619569 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:18.922771 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-387a8d5c-3700-410b-8bf0-c48ae4619569 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:18.947204 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-387a8d5c-3700-410b-8bf0-c48ae4619569 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/f77bb6f0-6ce7-40d8-9cb2-2fcb559353ac" status: 200 len: 1503 microversion: 2.1 time: 0.197254 Sep 23 04:34:18.959882 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 498/939] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:18 2022] GET /compute/v2.1/servers/f77bb6f0-6ce7-40d8-9cb2-2fcb559353ac => generated 1503 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:18.971039 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-453a3dc2-cbdc-424c-a42f-a2daa3960cd3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:18.975158 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-453a3dc2-cbdc-424c-a42f-a2daa3960cd3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: 09076cfa-4632-43c3-919d-4a8fe1b1bd37] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:18.992446 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-453a3dc2-cbdc-424c-a42f-a2daa3960cd3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:18.993137 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-453a3dc2-cbdc-424c-a42f-a2daa3960cd3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:18.993589 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-453a3dc2-cbdc-424c-a42f-a2daa3960cd3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:18.995329 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-453a3dc2-cbdc-424c-a42f-a2daa3960cd3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:18.995815 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-453a3dc2-cbdc-424c-a42f-a2daa3960cd3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:18.996804 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-453a3dc2-cbdc-424c-a42f-a2daa3960cd3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:19.186815 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-453a3dc2-cbdc-424c-a42f-a2daa3960cd3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:19.197174 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-453a3dc2-cbdc-424c-a42f-a2daa3960cd3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/09076cfa-4632-43c3-919d-4a8fe1b1bd37" status: 200 len: 1471 microversion: 2.1 time: 0.243461 Sep 23 04:34:19.198311 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 499/940] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:18 2022] GET /compute/v2.1/servers/09076cfa-4632-43c3-919d-4a8fe1b1bd37 => generated 1471 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:19.204281 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-821941c5-783e-4f2f-a7c2-6f6e4df00bf5 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.3.157"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:34:19.362948 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-821941c5-783e-4f2f-a7c2-6f6e4df00bf5 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] [instance: 9dede73d-62ac-481b-b990-41fd1039882a] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:19.368882 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=100 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:34:19.370512 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-821941c5-783e-4f2f-a7c2-6f6e4df00bf5 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:19.371086 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-821941c5-783e-4f2f-a7c2-6f6e4df00bf5 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:19.372869 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-821941c5-783e-4f2f-a7c2-6f6e4df00bf5 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:19.374207 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-821941c5-783e-4f2f-a7c2-6f6e4df00bf5 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:19.374670 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-821941c5-783e-4f2f-a7c2-6f6e4df00bf5 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:19.375113 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-821941c5-783e-4f2f-a7c2-6f6e4df00bf5 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:19.670701 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-821941c5-783e-4f2f-a7c2-6f6e4df00bf5 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Acquiring lock "refresh_cache-9dede73d-62ac-481b-b990-41fd1039882a" {{(pid=122699) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 23 04:34:19.671107 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-821941c5-783e-4f2f-a7c2-6f6e4df00bf5 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Acquired lock "refresh_cache-9dede73d-62ac-481b-b990-41fd1039882a" {{(pid=122699) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 23 04:34:20.882643 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9c399fc4-4fd3-47b3-b20a-033f90fe946b tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] 10.222.0.33 "GET /compute/v2.1/images/a52cf834-d5f6-4c7a-9692-385e6f34b133" status: 200 len: 1436 microversion: 2.1 time: 13.121608 Sep 23 04:34:20.883686 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 442/941] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:34:07 2022] GET /compute/v2.1/images/a52cf834-d5f6-4c7a-9692-385e6f34b133 => generated 1436 bytes in 13123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:20.949683 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.neutron [None req-821941c5-783e-4f2f-a7c2-6f6e4df00bf5 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] [instance: 9dede73d-62ac-481b-b990-41fd1039882a] Building network info cache for instance {{(pid=122699) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 23 04:34:20.965551 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-79ab9213-b082-4951-843c-3a44a2c25ea7 tempest-HypervisorAdminNegativeTestJSON-4082007 tempest-HypervisorAdminNegativeTestJSON-4082007-project-admin] Calling method '.version_select at 0x7ff1c0778af0>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:20.970826 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-79ab9213-b082-4951-843c-3a44a2c25ea7 tempest-HypervisorAdminNegativeTestJSON-4082007 tempest-HypervisorAdminNegativeTestJSON-4082007-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:20.976971 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-79ab9213-b082-4951-843c-3a44a2c25ea7 tempest-HypervisorAdminNegativeTestJSON-4082007 tempest-HypervisorAdminNegativeTestJSON-4082007-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:20.976971 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-79ab9213-b082-4951-843c-3a44a2c25ea7 tempest-HypervisorAdminNegativeTestJSON-4082007 tempest-HypervisorAdminNegativeTestJSON-4082007-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:20.993196 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-79ab9213-b082-4951-843c-3a44a2c25ea7 tempest-HypervisorAdminNegativeTestJSON-4082007 tempest-HypervisorAdminNegativeTestJSON-4082007-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:20.993704 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-79ab9213-b082-4951-843c-3a44a2c25ea7 tempest-HypervisorAdminNegativeTestJSON-4082007 tempest-HypervisorAdminNegativeTestJSON-4082007-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:21.007593 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-79ab9213-b082-4951-843c-3a44a2c25ea7 tempest-HypervisorAdminNegativeTestJSON-4082007 tempest-HypervisorAdminNegativeTestJSON-4082007-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:21.007593 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-79ab9213-b082-4951-843c-3a44a2c25ea7 tempest-HypervisorAdminNegativeTestJSON-4082007 tempest-HypervisorAdminNegativeTestJSON-4082007-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:21.007593 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-79ab9213-b082-4951-843c-3a44a2c25ea7 tempest-HypervisorAdminNegativeTestJSON-4082007 tempest-HypervisorAdminNegativeTestJSON-4082007-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:21.007593 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-79ab9213-b082-4951-843c-3a44a2c25ea7 tempest-HypervisorAdminNegativeTestJSON-4082007 tempest-HypervisorAdminNegativeTestJSON-4082007-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:21.013489 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-79ab9213-b082-4951-843c-3a44a2c25ea7 tempest-HypervisorAdminNegativeTestJSON-4082007 tempest-HypervisorAdminNegativeTestJSON-4082007-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.128439 Sep 23 04:34:21.014112 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 443/942] 10.222.0.33 () {58 vars in 1146 bytes} [Fri Sep 23 04:34:20 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:34:21.019172 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5b9e67cd-b70d-4174-a3bb-0019f4679a0d tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:21.019784 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5b9e67cd-b70d-4174-a3bb-0019f4679a0d tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] [instance: f392741f-f967-4c1c-930b-4eea7272bf64] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:21.027217 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5b9e67cd-b70d-4174-a3bb-0019f4679a0d tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:21.028610 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5b9e67cd-b70d-4174-a3bb-0019f4679a0d tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:21.029491 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5b9e67cd-b70d-4174-a3bb-0019f4679a0d tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:21.030697 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5b9e67cd-b70d-4174-a3bb-0019f4679a0d tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:21.031156 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5b9e67cd-b70d-4174-a3bb-0019f4679a0d tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:21.036509 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5b9e67cd-b70d-4174-a3bb-0019f4679a0d tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:21.635667 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-5b9e67cd-b70d-4174-a3bb-0019f4679a0d tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c82752e1bc4fdb82e7f8391c7c129f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44352a7a6d964530aa20ae83064b02e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:21.646227 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5b9e67cd-b70d-4174-a3bb-0019f4679a0d tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] 10.222.0.33 "GET /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64" status: 200 len: 1477 microversion: 2.1 time: 0.630326 Sep 23 04:34:21.647055 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 444/943] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:21 2022] GET /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64 => generated 1477 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:21.653717 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7333704c-b377-4869-a1d1-bc84f6d8188e tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:34:21.654742 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7333704c-b377-4869-a1d1-bc84f6d8188e tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: 09076cfa-4632-43c3-919d-4a8fe1b1bd37] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:21.663415 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7333704c-b377-4869-a1d1-bc84f6d8188e tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:21.664381 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7333704c-b377-4869-a1d1-bc84f6d8188e tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:21.665058 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7333704c-b377-4869-a1d1-bc84f6d8188e tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:21.666114 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7333704c-b377-4869-a1d1-bc84f6d8188e tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:21.666824 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7333704c-b377-4869-a1d1-bc84f6d8188e tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:21.667624 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7333704c-b377-4869-a1d1-bc84f6d8188e tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:21.904635 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7333704c-b377-4869-a1d1-bc84f6d8188e tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "POST /compute/v2.1/servers/09076cfa-4632-43c3-919d-4a8fe1b1bd37/action" status: 204 len: 0 microversion: 2.1 time: 0.255709 Sep 23 04:34:21.905669 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 445/944] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:34:21 2022] POST /compute/v2.1/servers/09076cfa-4632-43c3-919d-4a8fe1b1bd37/action => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:34:21.919717 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-95a352dd-0138-4aec-b934-aec6199d3830 req-42d57e1f-9f6d-49d3-ba89-aa303bc22547 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9dede73d-62ac-481b-b990-41fd1039882a", "tag": "a606ca45-c7dd-4f7c-90b2-1c6bd26525bf"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:34:21.920115 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.neutron [None req-821941c5-783e-4f2f-a7c2-6f6e4df00bf5 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] [instance: 9dede73d-62ac-481b-b990-41fd1039882a] Updating instance_info_cache with network_info: [{"id": "a606ca45-c7dd-4f7c-90b2-1c6bd26525bf", "address": "fa:16:3e:e6:29:b4", "network": {"id": "5e4e56e0-c3c5-411b-8ef5-0e167200f9bf", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1183423336-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "332a996884724d9eb16c79f46107c6af", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapa606ca45-c7", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122699) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 23 04:34:21.937832 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-95a352dd-0138-4aec-b934-aec6199d3830 req-42d57e1f-9f6d-49d3-ba89-aa303bc22547 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:21.938677 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-95a352dd-0138-4aec-b934-aec6199d3830 req-42d57e1f-9f6d-49d3-ba89-aa303bc22547 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:21.939385 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-95a352dd-0138-4aec-b934-aec6199d3830 req-42d57e1f-9f6d-49d3-ba89-aa303bc22547 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:21.953310 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-95a352dd-0138-4aec-b934-aec6199d3830 req-42d57e1f-9f6d-49d3-ba89-aa303bc22547 service nova] Creating event network-changed:a606ca45-c7dd-4f7c-90b2-1c6bd26525bf for instance 9dede73d-62ac-481b-b990-41fd1039882a on n-h1-846463-3 Sep 23 04:34:21.961739 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-95a352dd-0138-4aec-b934-aec6199d3830 req-42d57e1f-9f6d-49d3-ba89-aa303bc22547 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050856 Sep 23 04:34:21.961739 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 446/945] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:34:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:34:21.964728 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7d4c9524-727a-4bde-b277-ff6abb15999b tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:21.965431 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7d4c9524-727a-4bde-b277-ff6abb15999b tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: f77bb6f0-6ce7-40d8-9cb2-2fcb559353ac] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:21.972170 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7d4c9524-727a-4bde-b277-ff6abb15999b tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:21.972672 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7d4c9524-727a-4bde-b277-ff6abb15999b tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:21.973114 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7d4c9524-727a-4bde-b277-ff6abb15999b tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:21.974094 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7d4c9524-727a-4bde-b277-ff6abb15999b tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:21.974576 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7d4c9524-727a-4bde-b277-ff6abb15999b tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:21.975010 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7d4c9524-727a-4bde-b277-ff6abb15999b tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:22.006539 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-821941c5-783e-4f2f-a7c2-6f6e4df00bf5 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Releasing lock "refresh_cache-9dede73d-62ac-481b-b990-41fd1039882a" {{(pid=122699) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 23 04:34:22.013120 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-821941c5-783e-4f2f-a7c2-6f6e4df00bf5 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] 10.222.0.33 "POST /compute/v2.1/servers/9dede73d-62ac-481b-b990-41fd1039882a/action" status: 202 len: 0 microversion: 2.1 time: 2.807810 Sep 23 04:34:22.013120 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 500/946] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:34:19 2022] POST /compute/v2.1/servers/9dede73d-62ac-481b-b990-41fd1039882a/action => generated 0 bytes in 2810 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 23 04:34:22.015926 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4a7051a5-d6da-49d1-a0a8-af0a53e6c49c tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:22.018836 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4a7051a5-d6da-49d1-a0a8-af0a53e6c49c tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] [instance: 205bf02b-1478-4765-b2a6-d7014d9f0a64] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:22.037241 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4a7051a5-d6da-49d1-a0a8-af0a53e6c49c tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:22.042324 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4a7051a5-d6da-49d1-a0a8-af0a53e6c49c tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:22.042324 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4a7051a5-d6da-49d1-a0a8-af0a53e6c49c tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:22.042324 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4a7051a5-d6da-49d1-a0a8-af0a53e6c49c tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:22.042324 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4a7051a5-d6da-49d1-a0a8-af0a53e6c49c tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:22.042737 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4a7051a5-d6da-49d1-a0a8-af0a53e6c49c tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:22.584126 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-4a7051a5-d6da-49d1-a0a8-af0a53e6c49c tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lazy-loading 'services' on Instance uuid 205bf02b-1478-4765-b2a6-d7014d9f0a64 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:34:22.609772 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-7d4c9524-727a-4bde-b277-ff6abb15999b tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:22.612173 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4a7051a5-d6da-49d1-a0a8-af0a53e6c49c tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/205bf02b-1478-4765-b2a6-d7014d9f0a64" status: 200 len: 2424 microversion: 2.25 time: 0.598319 Sep 23 04:34:22.613627 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 501/947] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:34:22 2022] GET /compute/v2.1/servers/205bf02b-1478-4765-b2a6-d7014d9f0a64 => generated 2424 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:34:22.619022 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-9cc514bc-19c3-474d-b4ab-e5c866e119fe req-5be8359e-73c1-41c5-a5d5-eb2ec8b29a32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09076cfa-4632-43c3-919d-4a8fe1b1bd37", "name": "network-vif-unplugged", "status": "completed", "tag": "2103b7aa-15ef-4fad-b8eb-cd88ce8168a2"}, {"server_uuid": "f392741f-f967-4c1c-930b-4eea7272bf64", "name": "network-vif-plugged", "status": "completed", "tag": "a8e6bde0-f854-4040-8b7f-b369ce18b326"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:34:22.635584 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-9cc514bc-19c3-474d-b4ab-e5c866e119fe req-5be8359e-73c1-41c5-a5d5-eb2ec8b29a32 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:22.638570 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7d4c9524-727a-4bde-b277-ff6abb15999b tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/f77bb6f0-6ce7-40d8-9cb2-2fcb559353ac" status: 200 len: 1493 microversion: 2.1 time: 0.677826 Sep 23 04:34:22.639174 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 447/948] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:21 2022] GET /compute/v2.1/servers/f77bb6f0-6ce7-40d8-9cb2-2fcb559353ac => generated 1493 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:22.643275 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-9cc514bc-19c3-474d-b4ab-e5c866e119fe req-5be8359e-73c1-41c5-a5d5-eb2ec8b29a32 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:22.647686 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-9cc514bc-19c3-474d-b4ab-e5c866e119fe req-5be8359e-73c1-41c5-a5d5-eb2ec8b29a32 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:22.670977 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b1629446-d3bb-45c7-8060-390e8acf17b1 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Calling method '.version_select at 0x7ff1bbf144c0>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:22.687136 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-9cc514bc-19c3-474d-b4ab-e5c866e119fe req-5be8359e-73c1-41c5-a5d5-eb2ec8b29a32 service nova] Creating event network-vif-unplugged:2103b7aa-15ef-4fad-b8eb-cd88ce8168a2 for instance 09076cfa-4632-43c3-919d-4a8fe1b1bd37 on n-h2-846463-3 Sep 23 04:34:22.690729 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-9cc514bc-19c3-474d-b4ab-e5c866e119fe req-5be8359e-73c1-41c5-a5d5-eb2ec8b29a32 service nova] Creating event network-vif-plugged:a8e6bde0-f854-4040-8b7f-b369ce18b326 for instance f392741f-f967-4c1c-930b-4eea7272bf64 on n-h1-846463-3 Sep 23 04:34:22.715749 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [req-9cc514bc-19c3-474d-b4ab-e5c866e119fe req-5be8359e-73c1-41c5-a5d5-eb2ec8b29a32 service nova] Instance 09076cfa-4632-43c3-919d-4a8fe1b1bd37 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-846463-3'} {{(pid=122699) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 23 04:34:22.743160 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-9cc514bc-19c3-474d-b4ab-e5c866e119fe req-5be8359e-73c1-41c5-a5d5-eb2ec8b29a32 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.127899 Sep 23 04:34:22.747248 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 502/949] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:34:22 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:34:22.766132 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b1629446-d3bb-45c7-8060-390e8acf17b1 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] 10.222.0.33 "GET /compute/v2.1/images/a52cf834-d5f6-4c7a-9692-385e6f34b133" status: 200 len: 1436 microversion: 2.1 time: 0.115844 Sep 23 04:34:22.767499 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 448/950] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:34:22 2022] GET /compute/v2.1/images/a52cf834-d5f6-4c7a-9692-385e6f34b133 => generated 1436 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:22.781362 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2c5e7afc-2bc9-4370-95ac-26ec4d78def8 tempest-HypervisorAdminNegativeTestJSON-728382603 tempest-HypervisorAdminNegativeTestJSON-728382603-project] Calling method '.version_select at 0x7ff1bbb321f0>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:22.785043 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ddcc52b5-d3ac-46d8-b023-bda17f83b1c6 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:22.787877 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2c5e7afc-2bc9-4370-95ac-26ec4d78def8 tempest-HypervisorAdminNegativeTestJSON-728382603 tempest-HypervisorAdminNegativeTestJSON-728382603-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': 'ef62b112a01d41be978336904e665c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352fcc27a585434ebf87099f27e69fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:22.789568 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-ddcc52b5-d3ac-46d8-b023-bda17f83b1c6 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: 09076cfa-4632-43c3-919d-4a8fe1b1bd37] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:22.790810 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2c5e7afc-2bc9-4370-95ac-26ec4d78def8 tempest-HypervisorAdminNegativeTestJSON-728382603 tempest-HypervisorAdminNegativeTestJSON-728382603-project] Request method failure captured: Sep 23 04:34:22.790810 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Sep 23 04:34:22.790810 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:34:22.790810 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:34:22.790810 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:34:22.790810 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:34:22.790810 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:34:22.790810 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:34:22.790810 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:34:22.790810 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:34:22.790810 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTdAVzXEbW6HPU-cQwoy9UcMlumBicfGVOGPcuzQg83hxROUnxdI1LWtyod2bFto7SoNT7_Xgq6oAW5oZyq4R7yU0g-LbGZuEopjbmoFjI1mAnLqSDVA0QjFhfK8HlMZXLeAFjfNTXxaZ4raspJkldEvj0KfG3wsglYMrZ5A6LfG8QQ Sep 23 04:34:22.790810 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:34:22.790810 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:34:22.790810 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:34:22.790810 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:34:22.790810 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:34:22.790810 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:34:22.790810 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 352fcc27a585434ebf87099f27e69fb6 Sep 23 04:34:22.790810 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-728382603 Sep 23 04:34:22.790810 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:34:22.790810 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:34:22.792361 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_352fcc27a585434ebf87099f27e69fb6", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/352fcc27a585434ebf87099f27e69fb6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/352fcc27a585434ebf87099f27e69fb6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/352fcc27a585434ebf87099f27e69fb6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:34:22.792361 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-728382603 Sep 23 04:34:22.792361 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 352fcc27a585434ebf87099f27e69fb6 Sep 23 04:34:22.792361 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-728382603 Sep 23 04:34:22.792361 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-HypervisorAdminNegativeTestJSON-728382603-project Sep 23 04:34:22.792361 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:34:22.792361 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:34:22.792361 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: ef62b112a01d41be978336904e665c40 Sep 23 04:34:22.792361 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-728382603-project Sep 23 04:34:22.792361 n-d-846463-3 devstack@n-api.service[122699]: method: Sep 23 04:34:22.792361 n-d-846463-3 devstack@n-api.service[122699]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Sep 23 04:34:22.792361 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '1'} Sep 23 04:34:22.792361 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:34:22.797201 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:34:22.797201 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:34:22.797201 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:34:22.797201 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:34:22.797201 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:34:22.797201 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:34:22.797201 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:34:22.797201 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:34:22.797201 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:34:22.797201 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Sep 23 04:34:22.797201 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Sep 23 04:34:22.797201 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 23 04:34:22.797201 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 23 04:34:22.797201 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 23 04:34:22.797201 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 23 04:34:22.797201 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 23 04:34:22.797201 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 23 04:34:22.797201 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 23 04:34:22.797201 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise self.value Sep 23 04:34:22.798551 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 23 04:34:22.798551 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 23 04:34:22.798551 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 23 04:34:22.798551 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 23 04:34:22.798551 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 23 04:34:22.798551 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 23 04:34:22.798551 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Sep 23 04:34:22.798551 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:34:22.798551 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:34:22.798551 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:34:22.798551 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:34:22.798551 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:34:22.798551 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:34:22.798551 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 23 04:34:22.798551 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 23 04:34:22.798551 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Sep 23 04:34:22.798551 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:34:22.800557 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2c5e7afc-2bc9-4370-95ac-26ec4d78def8 tempest-HypervisorAdminNegativeTestJSON-728382603 tempest-HypervisorAdminNegativeTestJSON-728382603-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:34:22.800557 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2c5e7afc-2bc9-4370-95ac-26ec4d78def8 tempest-HypervisorAdminNegativeTestJSON-728382603 tempest-HypervisorAdminNegativeTestJSON-728382603-project] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.046725 Sep 23 04:34:22.802224 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 503/951] 10.222.0.33 () {58 vars in 1173 bytes} [Fri Sep 23 04:34:22 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 54 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:34:22.812547 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ddcc52b5-d3ac-46d8-b023-bda17f83b1c6 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:22.812547 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ddcc52b5-d3ac-46d8-b023-bda17f83b1c6 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:22.813756 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0ef7506d-3115-4e1d-862e-66fc92eb61cd tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:22.814486 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-0ef7506d-3115-4e1d-862e-66fc92eb61cd tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] [instance: 9dede73d-62ac-481b-b990-41fd1039882a] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:22.814767 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ddcc52b5-d3ac-46d8-b023-bda17f83b1c6 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:22.815567 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ddcc52b5-d3ac-46d8-b023-bda17f83b1c6 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:22.817724 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ddcc52b5-d3ac-46d8-b023-bda17f83b1c6 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:22.818268 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ddcc52b5-d3ac-46d8-b023-bda17f83b1c6 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:22.828353 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0ef7506d-3115-4e1d-862e-66fc92eb61cd tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:22.830190 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0ef7506d-3115-4e1d-862e-66fc92eb61cd tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:22.830190 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0ef7506d-3115-4e1d-862e-66fc92eb61cd tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:22.834469 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0ef7506d-3115-4e1d-862e-66fc92eb61cd tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:22.835078 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0ef7506d-3115-4e1d-862e-66fc92eb61cd tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:22.835591 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0ef7506d-3115-4e1d-862e-66fc92eb61cd tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:22.889861 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-0ef7506d-3115-4e1d-862e-66fc92eb61cd tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] [instance: 9dede73d-62ac-481b-b990-41fd1039882a] Going to try to terminate instance {{(pid=122699) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:34:23.202419 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ddcc52b5-d3ac-46d8-b023-bda17f83b1c6 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:23.212855 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ddcc52b5-d3ac-46d8-b023-bda17f83b1c6 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/09076cfa-4632-43c3-919d-4a8fe1b1bd37" status: 200 len: 1471 microversion: 2.1 time: 0.432016 Sep 23 04:34:23.231341 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 449/952] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:22 2022] GET /compute/v2.1/servers/09076cfa-4632-43c3-919d-4a8fe1b1bd37 => generated 1471 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:23.240972 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0c0ac2f0-ebee-4fca-b048-d338ed0086f0 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-846463-3", "block_migration": "auto"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:34:23.244151 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-0c0ac2f0-ebee-4fca-b048-d338ed0086f0 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] [instance: 205bf02b-1478-4765-b2a6-d7014d9f0a64] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:23.265234 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0c0ac2f0-ebee-4fca-b048-d338ed0086f0 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:23.271944 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0c0ac2f0-ebee-4fca-b048-d338ed0086f0 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:23.271944 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0c0ac2f0-ebee-4fca-b048-d338ed0086f0 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:23.271944 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0c0ac2f0-ebee-4fca-b048-d338ed0086f0 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:23.271944 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0c0ac2f0-ebee-4fca-b048-d338ed0086f0 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:23.272473 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0c0ac2f0-ebee-4fca-b048-d338ed0086f0 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:23.305804 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-0c0ac2f0-ebee-4fca-b048-d338ed0086f0 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lazy-loading 'flavor' on Instance uuid 205bf02b-1478-4765-b2a6-d7014d9f0a64 {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:34:23.324838 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-0c0ac2f0-ebee-4fca-b048-d338ed0086f0 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] [instance: 205bf02b-1478-4765-b2a6-d7014d9f0a64] Going to try to live migrate instance to n-h1-846463-3 {{(pid=122698) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 23 04:34:23.328286 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0ef7506d-3115-4e1d-862e-66fc92eb61cd tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9dede73d-62ac-481b-b990-41fd1039882a" status: 204 len: 0 microversion: 2.1 time: 0.523607 Sep 23 04:34:23.333969 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 504/953] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:34:22 2022] DELETE /compute/v2.1/servers/9dede73d-62ac-481b-b990-41fd1039882a => generated 0 bytes in 526 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:34:23.340930 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-fc38a858-b855-4358-8ee6-b53a60be4bd2 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Calling method '.version_select at 0x7ff1c019eca0>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:23.340930 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fc38a858-b855-4358-8ee6-b53a60be4bd2 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:23.340930 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fc38a858-b855-4358-8ee6-b53a60be4bd2 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:23.340930 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fc38a858-b855-4358-8ee6-b53a60be4bd2 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:23.356805 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-fc38a858-b855-4358-8ee6-b53a60be4bd2 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] 10.222.0.33 "GET /compute/v2.1/os-migrations" status: 200 len: 1953 microversion: 2.1 time: 0.026510 Sep 23 04:34:23.362866 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 505/954] 10.222.0.33 () {58 vars in 1143 bytes} [Fri Sep 23 04:34:23 2022] GET /compute/v2.1/os-migrations => generated 1953 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:23.370740 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b34915ff-53da-4563-a3b8-5619e01f2446 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:23.372057 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b34915ff-53da-4563-a3b8-5619e01f2446 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] [instance: f392741f-f967-4c1c-930b-4eea7272bf64] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:23.379278 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b34915ff-53da-4563-a3b8-5619e01f2446 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:23.379789 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b34915ff-53da-4563-a3b8-5619e01f2446 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:23.380237 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b34915ff-53da-4563-a3b8-5619e01f2446 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:23.380949 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b34915ff-53da-4563-a3b8-5619e01f2446 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:23.381416 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b34915ff-53da-4563-a3b8-5619e01f2446 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:23.381855 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b34915ff-53da-4563-a3b8-5619e01f2446 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:23.584421 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b34915ff-53da-4563-a3b8-5619e01f2446 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c82752e1bc4fdb82e7f8391c7c129f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44352a7a6d964530aa20ae83064b02e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:23.593121 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b34915ff-53da-4563-a3b8-5619e01f2446 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] 10.222.0.33 "GET /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64" status: 200 len: 1477 microversion: 2.1 time: 0.228381 Sep 23 04:34:23.598732 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 506/955] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:23 2022] GET /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64 => generated 1477 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:23.598732 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-be1f2c5e-cd90-4afc-86aa-1f8c55c77d25 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:23.598965 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-be1f2c5e-cd90-4afc-86aa-1f8c55c77d25 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] [instance: 70213e65-9664-4df1-81d7-747c462fa434] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:23.604755 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-be1f2c5e-cd90-4afc-86aa-1f8c55c77d25 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:23.605807 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-be1f2c5e-cd90-4afc-86aa-1f8c55c77d25 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:23.606461 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-be1f2c5e-cd90-4afc-86aa-1f8c55c77d25 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:23.607169 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-be1f2c5e-cd90-4afc-86aa-1f8c55c77d25 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:23.607634 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-be1f2c5e-cd90-4afc-86aa-1f8c55c77d25 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:23.608536 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-be1f2c5e-cd90-4afc-86aa-1f8c55c77d25 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:23.761359 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-be1f2c5e-cd90-4afc-86aa-1f8c55c77d25 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3ff8d26a3f4831b3ec766bea65e143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98e78e2969a446b8fdbf772b36dd0c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:23.770054 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-be1f2c5e-cd90-4afc-86aa-1f8c55c77d25 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] 10.222.0.33 "GET /compute/v2.1/servers/70213e65-9664-4df1-81d7-747c462fa434" status: 200 len: 1467 microversion: 2.1 time: 0.175243 Sep 23 04:34:23.773204 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 507/956] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:23 2022] GET /compute/v2.1/servers/70213e65-9664-4df1-81d7-747c462fa434 => generated 1467 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:23.779225 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-62ab4285-3633-402a-ad9f-96ba07a22a8a tempest-HypervisorAdminNegativeTestJSON-4082007 tempest-HypervisorAdminNegativeTestJSON-4082007-project-admin] Calling method '.version_select at 0x7ff1bbb9ff70>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:23.781026 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-62ab4285-3633-402a-ad9f-96ba07a22a8a tempest-HypervisorAdminNegativeTestJSON-4082007 tempest-HypervisorAdminNegativeTestJSON-4082007-project-admin] HTTP exception thrown: Hypervisor with ID '28d63524-ad60-4f93-829d-84d475c6f9e8' could not be found. Sep 23 04:34:23.792138 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-62ab4285-3633-402a-ad9f-96ba07a22a8a tempest-HypervisorAdminNegativeTestJSON-4082007 tempest-HypervisorAdminNegativeTestJSON-4082007-project-admin] Request method failure captured: Sep 23 04:34:23.792138 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/os-hypervisors/28d63524-ad60-4f93-829d-84d475c6f9e8/uptime HTTP/1.1 Sep 23 04:34:23.792138 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:34:23.792138 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:34:23.792138 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:34:23.792138 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:34:23.792138 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:34:23.792138 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:34:23.792138 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:34:23.792138 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:34:23.792138 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTdC20vUSta6dzj1XUl0iOovywZ-z8dXDkmWEdPUcIIbmMI2I8PqVLw3_rrl1Ah9SnC7oAYc7rRHKz0UhY-zhN1lvPQfu01gaysqdvDOpfyo1FrGK2jBTOlFr0swYUtqoD-ducqMly6O6BVQsvme6LXYDJYcx88NtSbj_rXI5eLNOFA Sep 23 04:34:23.792138 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:34:23.792138 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:34:23.792138 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:34:23.792138 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:34:23.792138 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:34:23.792138 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:34:23.792138 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 9bd6cdf04352485c910335eb1c35d225 Sep 23 04:34:23.792138 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-4082007 Sep 23 04:34:23.792138 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,admin,member Sep 23 04:34:23.792138 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,admin,member Sep 23 04:34:23.794133 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9bd6cdf04352485c910335eb1c35d225", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9bd6cdf04352485c910335eb1c35d225"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9bd6cdf04352485c910335eb1c35d225"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9bd6cdf04352485c910335eb1c35d225"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:34:23.794133 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-4082007 Sep 23 04:34:23.794133 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 9bd6cdf04352485c910335eb1c35d225 Sep 23 04:34:23.794133 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-4082007 Sep 23 04:34:23.794133 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-HypervisorAdminNegativeTestJSON-4082007-project-admin Sep 23 04:34:23.794133 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:34:23.794133 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:34:23.794133 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: ffc549ea42d546a49206ed4a68bb245d Sep 23 04:34:23.794133 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-4082007-project-admin Sep 23 04:34:23.794133 n-d-846463-3 devstack@n-api.service[122699]: method: Sep 23 04:34:23.794133 n-d-846463-3 devstack@n-api.service[122699]: exception: Hypervisor with ID '28d63524-ad60-4f93-829d-84d475c6f9e8' could not be found. Sep 23 04:34:23.794133 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '28d63524-ad60-4f93-829d-84d475c6f9e8'} Sep 23 04:34:23.794994 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:34:23.794994 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:34:23.794994 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Sep 23 04:34:23.794994 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi value = int(str(value)) Sep 23 04:34:23.794994 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '28d63524-ad60-4f93-829d-84d475c6f9e8' Sep 23 04:34:23.794994 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:34:23.794994 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:34:23.794994 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:34:23.794994 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:34:23.794994 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Sep 23 04:34:23.794994 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Sep 23 04:34:23.794994 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Sep 23 04:34:23.794994 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Sep 23 04:34:23.794994 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Sep 23 04:34:23.794994 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:34:23.794994 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:34:23.794994 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:34:23.794994 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:34:23.794994 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Sep 23 04:34:23.794994 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Sep 23 04:34:23.794994 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Sep 23 04:34:23.794994 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Sep 23 04:34:23.797507 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Sep 23 04:34:23.797507 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:34:23.797507 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:34:23.797507 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:34:23.797507 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:34:23.797507 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:34:23.797507 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:34:23.797507 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:34:23.797507 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:34:23.797507 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:34:23.797507 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:34:23.797507 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:34:23.797507 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:34:23.797507 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Sep 23 04:34:23.797507 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Sep 23 04:34:23.797507 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Sep 23 04:34:23.797507 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 23 04:34:23.797507 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '28d63524-ad60-4f93-829d-84d475c6f9e8' could not be found. Sep 23 04:34:23.797507 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:34:23.797507 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:34:23.797507 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:34:23.799695 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:34:23.799695 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:34:23.799695 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:34:23.799695 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:34:23.799695 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:34:23.799695 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '28d63524-ad60-4f93-829d-84d475c6f9e8' could not be found. Sep 23 04:34:23.799695 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:34:23.799695 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-62ab4285-3633-402a-ad9f-96ba07a22a8a tempest-HypervisorAdminNegativeTestJSON-4082007 tempest-HypervisorAdminNegativeTestJSON-4082007-project-admin] Returning 404 to user: Hypervisor with ID '28d63524-ad60-4f93-829d-84d475c6f9e8' could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:34:23.799695 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-62ab4285-3633-402a-ad9f-96ba07a22a8a tempest-HypervisorAdminNegativeTestJSON-4082007 tempest-HypervisorAdminNegativeTestJSON-4082007-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/28d63524-ad60-4f93-829d-84d475c6f9e8/uptime" status: 404 len: 123 microversion: 2.1 time: 0.019494 Sep 23 04:34:23.799695 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 508/957] 10.222.0.33 () {58 vars in 1278 bytes} [Fri Sep 23 04:34:23 2022] GET /compute/v2.1/os-hypervisors/28d63524-ad60-4f93-829d-84d475c6f9e8/uptime => generated 123 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:34:23.800568 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b2b73ef2-a234-4f20-93de-d538a24d47ea tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.3.157"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:34:23.802932 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b2b73ef2-a234-4f20-93de-d538a24d47ea tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] [instance: e5237b14-ce44-43de-ab20-e6e456def723] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:23.812811 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b2b73ef2-a234-4f20-93de-d538a24d47ea tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:23.813309 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b2b73ef2-a234-4f20-93de-d538a24d47ea tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:23.814002 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b2b73ef2-a234-4f20-93de-d538a24d47ea tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:23.814797 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b2b73ef2-a234-4f20-93de-d538a24d47ea tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:23.815460 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b2b73ef2-a234-4f20-93de-d538a24d47ea tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:23.815975 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b2b73ef2-a234-4f20-93de-d538a24d47ea tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:23.846586 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b2b73ef2-a234-4f20-93de-d538a24d47ea tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Acquiring lock "refresh_cache-e5237b14-ce44-43de-ab20-e6e456def723" {{(pid=122699) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 23 04:34:23.846904 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b2b73ef2-a234-4f20-93de-d538a24d47ea tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Acquired lock "refresh_cache-e5237b14-ce44-43de-ab20-e6e456def723" {{(pid=122699) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 23 04:34:25.088900 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.neutron [None req-b2b73ef2-a234-4f20-93de-d538a24d47ea tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] [instance: e5237b14-ce44-43de-ab20-e6e456def723] Building network info cache for instance {{(pid=122699) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 23 04:34:26.243827 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.neutron [None req-b2b73ef2-a234-4f20-93de-d538a24d47ea tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] [instance: e5237b14-ce44-43de-ab20-e6e456def723] Updating instance_info_cache with network_info: [{"id": "e1b845e7-999a-4e6a-b939-3cf715e6290e", "address": "fa:16:3e:e7:d0:7d", "network": {"id": "5e4e56e0-c3c5-411b-8ef5-0e167200f9bf", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1183423336-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.3.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "332a996884724d9eb16c79f46107c6af", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tape1b845e7-99", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122699) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 23 04:34:26.350657 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b2b73ef2-a234-4f20-93de-d538a24d47ea tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Releasing lock "refresh_cache-e5237b14-ce44-43de-ab20-e6e456def723" {{(pid=122699) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 23 04:34:26.354144 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b2b73ef2-a234-4f20-93de-d538a24d47ea tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] 10.222.0.33 "POST /compute/v2.1/servers/e5237b14-ce44-43de-ab20-e6e456def723/action" status: 202 len: 0 microversion: 2.1 time: 2.556121 Sep 23 04:34:26.354144 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 509/958] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:34:23 2022] POST /compute/v2.1/servers/e5237b14-ce44-43de-ab20-e6e456def723/action => generated 0 bytes in 2557 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 23 04:34:26.362029 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ee9b70ae-9e7d-49e7-bbe1-eb73afa09b5b tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:26.362764 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ee9b70ae-9e7d-49e7-bbe1-eb73afa09b5b tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] [instance: f77bb6f0-6ce7-40d8-9cb2-2fcb559353ac] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:26.375545 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ee9b70ae-9e7d-49e7-bbe1-eb73afa09b5b tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:26.377025 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ee9b70ae-9e7d-49e7-bbe1-eb73afa09b5b tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:26.378904 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ee9b70ae-9e7d-49e7-bbe1-eb73afa09b5b tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:26.379840 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ee9b70ae-9e7d-49e7-bbe1-eb73afa09b5b tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:26.382543 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ee9b70ae-9e7d-49e7-bbe1-eb73afa09b5b tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:26.383158 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ee9b70ae-9e7d-49e7-bbe1-eb73afa09b5b tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:26.412898 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=3,nova_cell1:RELEASE=2,nova_cell1:INSERT=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:34:26.751724 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ee9b70ae-9e7d-49e7-bbe1-eb73afa09b5b tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/f77bb6f0-6ce7-40d8-9cb2-2fcb559353ac" status: 200 len: 1644 microversion: 2.1 time: 0.397712 Sep 23 04:34:26.752534 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 510/959] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:26 2022] GET /compute/v2.1/servers/f77bb6f0-6ce7-40d8-9cb2-2fcb559353ac => generated 1644 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:26.758096 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-cd1aea81-81f9-40ff-895e-a9abf7889a4b tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Calling method '.version_select at 0x7ff1c07ca430>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:27.314143 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0c0ac2f0-ebee-4fca-b048-d338ed0086f0 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/205bf02b-1478-4765-b2a6-d7014d9f0a64/action" status: 202 len: 0 microversion: 2.25 time: 4.075821 Sep 23 04:34:27.314143 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 450/960] 10.222.0.33 () {62 vars in 1319 bytes} [Fri Sep 23 04:34:23 2022] POST /compute/v2.1/servers/205bf02b-1478-4765-b2a6-d7014d9f0a64/action => generated 0 bytes in 4078 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:34:27.315517 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f42d4514-bc2d-465e-baef-4c8107b648fc tempest-HypervisorAdminNegativeTestJSON-4082007 tempest-HypervisorAdminNegativeTestJSON-4082007-project-admin] Calling method '.version_select at 0x7ff1bbe808b0>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:27.338349 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f42d4514-bc2d-465e-baef-4c8107b648fc tempest-HypervisorAdminNegativeTestJSON-4082007 tempest-HypervisorAdminNegativeTestJSON-4082007-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:27.338349 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f42d4514-bc2d-465e-baef-4c8107b648fc tempest-HypervisorAdminNegativeTestJSON-4082007 tempest-HypervisorAdminNegativeTestJSON-4082007-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:27.338349 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f42d4514-bc2d-465e-baef-4c8107b648fc tempest-HypervisorAdminNegativeTestJSON-4082007 tempest-HypervisorAdminNegativeTestJSON-4082007-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:27.353868 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f42d4514-bc2d-465e-baef-4c8107b648fc tempest-HypervisorAdminNegativeTestJSON-4082007 tempest-HypervisorAdminNegativeTestJSON-4082007-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:27.354540 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f42d4514-bc2d-465e-baef-4c8107b648fc tempest-HypervisorAdminNegativeTestJSON-4082007 tempest-HypervisorAdminNegativeTestJSON-4082007-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:27.357445 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f42d4514-bc2d-465e-baef-4c8107b648fc tempest-HypervisorAdminNegativeTestJSON-4082007 tempest-HypervisorAdminNegativeTestJSON-4082007-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:27.367235 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f42d4514-bc2d-465e-baef-4c8107b648fc tempest-HypervisorAdminNegativeTestJSON-4082007 tempest-HypervisorAdminNegativeTestJSON-4082007-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:27.367715 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f42d4514-bc2d-465e-baef-4c8107b648fc tempest-HypervisorAdminNegativeTestJSON-4082007 tempest-HypervisorAdminNegativeTestJSON-4082007-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:27.368296 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f42d4514-bc2d-465e-baef-4c8107b648fc tempest-HypervisorAdminNegativeTestJSON-4082007 tempest-HypervisorAdminNegativeTestJSON-4082007-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:27.375053 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f42d4514-bc2d-465e-baef-4c8107b648fc tempest-HypervisorAdminNegativeTestJSON-4082007 tempest-HypervisorAdminNegativeTestJSON-4082007-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.062781 Sep 23 04:34:27.375418 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 451/961] 10.222.0.33 () {58 vars in 1146 bytes} [Fri Sep 23 04:34:27 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:34:27.379833 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-29825ff9-2d0d-411c-afae-e11e7b48d721 req-c9ec8792-a05b-4b3a-a0c0-dfc6dd1d00e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9dede73d-62ac-481b-b990-41fd1039882a", "tag": "a606ca45-c7dd-4f7c-90b2-1c6bd26525bf"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:34:27.390531 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-29825ff9-2d0d-411c-afae-e11e7b48d721 req-c9ec8792-a05b-4b3a-a0c0-dfc6dd1d00e0 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:27.391098 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-29825ff9-2d0d-411c-afae-e11e7b48d721 req-c9ec8792-a05b-4b3a-a0c0-dfc6dd1d00e0 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:27.391844 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-29825ff9-2d0d-411c-afae-e11e7b48d721 req-c9ec8792-a05b-4b3a-a0c0-dfc6dd1d00e0 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:27.403987 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-29825ff9-2d0d-411c-afae-e11e7b48d721 req-c9ec8792-a05b-4b3a-a0c0-dfc6dd1d00e0 service nova] Creating event network-changed:a606ca45-c7dd-4f7c-90b2-1c6bd26525bf for instance 9dede73d-62ac-481b-b990-41fd1039882a on n-h1-846463-3 Sep 23 04:34:27.408513 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-29825ff9-2d0d-411c-afae-e11e7b48d721 req-c9ec8792-a05b-4b3a-a0c0-dfc6dd1d00e0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031902 Sep 23 04:34:27.409100 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 452/962] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:34:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:34:27.414000 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8a28c7bd-4f9c-41a0-8d8f-6f7be32c609a tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:27.414702 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8a28c7bd-4f9c-41a0-8d8f-6f7be32c609a tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: 09076cfa-4632-43c3-919d-4a8fe1b1bd37] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:27.420778 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8a28c7bd-4f9c-41a0-8d8f-6f7be32c609a tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:27.421366 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8a28c7bd-4f9c-41a0-8d8f-6f7be32c609a tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:27.421813 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8a28c7bd-4f9c-41a0-8d8f-6f7be32c609a tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:27.422553 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8a28c7bd-4f9c-41a0-8d8f-6f7be32c609a tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:27.423015 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8a28c7bd-4f9c-41a0-8d8f-6f7be32c609a tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:27.423444 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8a28c7bd-4f9c-41a0-8d8f-6f7be32c609a tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:27.561136 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8a28c7bd-4f9c-41a0-8d8f-6f7be32c609a tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:27.571700 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8a28c7bd-4f9c-41a0-8d8f-6f7be32c609a tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/09076cfa-4632-43c3-919d-4a8fe1b1bd37" status: 200 len: 1463 microversion: 2.1 time: 0.160237 Sep 23 04:34:27.588699 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 453/963] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:27 2022] GET /compute/v2.1/servers/09076cfa-4632-43c3-919d-4a8fe1b1bd37 => generated 1463 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:27.588699 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-28582fba-a1fd-49be-91cf-6f4f5d674ed0 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:27.588699 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-28582fba-a1fd-49be-91cf-6f4f5d674ed0 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] [instance: f392741f-f967-4c1c-930b-4eea7272bf64] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:27.588699 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-28582fba-a1fd-49be-91cf-6f4f5d674ed0 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:27.588699 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-28582fba-a1fd-49be-91cf-6f4f5d674ed0 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:27.589290 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-28582fba-a1fd-49be-91cf-6f4f5d674ed0 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:27.589290 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-28582fba-a1fd-49be-91cf-6f4f5d674ed0 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:27.594034 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-28582fba-a1fd-49be-91cf-6f4f5d674ed0 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:27.594809 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-28582fba-a1fd-49be-91cf-6f4f5d674ed0 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:27.927900 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-28582fba-a1fd-49be-91cf-6f4f5d674ed0 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c82752e1bc4fdb82e7f8391c7c129f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44352a7a6d964530aa20ae83064b02e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:27.941655 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-28582fba-a1fd-49be-91cf-6f4f5d674ed0 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] 10.222.0.33 "GET /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64" status: 200 len: 1463 microversion: 2.1 time: 0.366113 Sep 23 04:34:27.944060 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 454/964] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:27 2022] GET /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64 => generated 1463 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:27.955961 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-23351ae1-2c8d-4f67-9dbb-765242a2a42c req-596dd96e-f339-411d-9c8f-48f3108ba6c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09076cfa-4632-43c3-919d-4a8fe1b1bd37", "name": "network-vif-plugged", "status": "completed", "tag": "2103b7aa-15ef-4fad-b8eb-cd88ce8168a2"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:34:27.968803 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-23351ae1-2c8d-4f67-9dbb-765242a2a42c req-596dd96e-f339-411d-9c8f-48f3108ba6c5 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:27.970378 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-23351ae1-2c8d-4f67-9dbb-765242a2a42c req-596dd96e-f339-411d-9c8f-48f3108ba6c5 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:27.971217 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-23351ae1-2c8d-4f67-9dbb-765242a2a42c req-596dd96e-f339-411d-9c8f-48f3108ba6c5 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:27.988776 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-23351ae1-2c8d-4f67-9dbb-765242a2a42c req-596dd96e-f339-411d-9c8f-48f3108ba6c5 service nova] Creating event network-vif-plugged:2103b7aa-15ef-4fad-b8eb-cd88ce8168a2 for instance 09076cfa-4632-43c3-919d-4a8fe1b1bd37 on n-h2-846463-3 Sep 23 04:34:27.998036 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-23351ae1-2c8d-4f67-9dbb-765242a2a42c req-596dd96e-f339-411d-9c8f-48f3108ba6c5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052100 Sep 23 04:34:27.999943 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 455/965] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:34:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:34:28.013612 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f8331b06-e2fa-4fe7-8242-3613b670498d tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Calling method '.version_select at 0x7ff1bbf93e50>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:28.172033 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-cd1aea81-81f9-40ff-895e-a9abf7889a4b tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] 10.222.0.33 "DELETE /compute/v2.1/images/a52cf834-d5f6-4c7a-9692-385e6f34b133" status: 204 len: 0 microversion: 2.1 time: 1.417928 Sep 23 04:34:28.173361 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 511/966] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:26 2022] DELETE /compute/v2.1/images/a52cf834-d5f6-4c7a-9692-385e6f34b133 => generated 0 bytes in 1420 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:34:28.180270 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8954ed70-2610-41cb-af60-74df9b5019e7 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1546965636", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "networks": [{"uuid": "c69ae9f6-7e1f-4037-b183-87d9ba3569e0"}]}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:34:28.258758 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f8331b06-e2fa-4fe7-8242-3613b670498d tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] 10.222.0.33 "GET /compute/v2.1/os-floating-ips/4fdb1381-9019-4859-940f-74836ea61fe0" status: 200 len: 184 microversion: 2.1 time: 0.254212 Sep 23 04:34:28.259242 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 456/967] 10.222.0.33 () {58 vars in 1260 bytes} [Fri Sep 23 04:34:28 2022] GET /compute/v2.1/os-floating-ips/4fdb1381-9019-4859-940f-74836ea61fe0 => generated 184 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:34:28.265676 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-54378bac-958d-4501-8a64-b70001bfa4c2 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:28.266751 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-54378bac-958d-4501-8a64-b70001bfa4c2 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 205bf02b-1478-4765-b2a6-d7014d9f0a64] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:28.270462 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.neutron [None req-8954ed70-2610-41cb-af60-74df9b5019e7 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] validate_networks() for [('c69ae9f6-7e1f-4037-b183-87d9ba3569e0', None, None, None, None, None)] {{(pid=122699) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:34:28.273761 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-54378bac-958d-4501-8a64-b70001bfa4c2 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:28.274277 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-54378bac-958d-4501-8a64-b70001bfa4c2 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:28.274714 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-54378bac-958d-4501-8a64-b70001bfa4c2 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:28.275403 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-54378bac-958d-4501-8a64-b70001bfa4c2 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:28.284706 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-54378bac-958d-4501-8a64-b70001bfa4c2 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:28.285301 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-54378bac-958d-4501-8a64-b70001bfa4c2 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:28.499410 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-54378bac-958d-4501-8a64-b70001bfa4c2 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:28.511733 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-54378bac-958d-4501-8a64-b70001bfa4c2 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:28.513997 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-54378bac-958d-4501-8a64-b70001bfa4c2 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:28.515520 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-54378bac-958d-4501-8a64-b70001bfa4c2 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/205bf02b-1478-4765-b2a6-d7014d9f0a64" status: 200 len: 1815 microversion: 2.25 time: 0.255307 Sep 23 04:34:28.519568 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 457/968] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:34:28 2022] GET /compute/v2.1/servers/205bf02b-1478-4765-b2a6-d7014d9f0a64 => generated 1815 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:34:28.521639 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-46499bdb-5793-47a5-a3ab-dc80a050057f tempest-HypervisorAdminNegativeTestJSON-728382603 tempest-HypervisorAdminNegativeTestJSON-728382603-project] Calling method '.version_select at 0x7ff1bbe849d0>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:28.524089 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-46499bdb-5793-47a5-a3ab-dc80a050057f tempest-HypervisorAdminNegativeTestJSON-728382603 tempest-HypervisorAdminNegativeTestJSON-728382603-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': 'ef62b112a01d41be978336904e665c40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '352fcc27a585434ebf87099f27e69fb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:28.525948 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-46499bdb-5793-47a5-a3ab-dc80a050057f tempest-HypervisorAdminNegativeTestJSON-728382603 tempest-HypervisorAdminNegativeTestJSON-728382603-project] Request method failure captured: Sep 23 04:34:28.525948 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Sep 23 04:34:28.525948 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:34:28.525948 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:34:28.525948 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:34:28.525948 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:34:28.525948 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:34:28.525948 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:34:28.525948 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:34:28.525948 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:34:28.525948 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTdAVzXEbW6HPU-cQwoy9UcMlumBicfGVOGPcuzQg83hxROUnxdI1LWtyod2bFto7SoNT7_Xgq6oAW5oZyq4R7yU0g-LbGZuEopjbmoFjI1mAnLqSDVA0QjFhfK8HlMZXLeAFjfNTXxaZ4raspJkldEvj0KfG3wsglYMrZ5A6LfG8QQ Sep 23 04:34:28.525948 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:34:28.525948 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:34:28.525948 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:34:28.525948 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:34:28.525948 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:34:28.525948 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:34:28.525948 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 352fcc27a585434ebf87099f27e69fb6 Sep 23 04:34:28.525948 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-728382603 Sep 23 04:34:28.525948 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:34:28.525948 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:34:28.527827 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_352fcc27a585434ebf87099f27e69fb6", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/352fcc27a585434ebf87099f27e69fb6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/352fcc27a585434ebf87099f27e69fb6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/352fcc27a585434ebf87099f27e69fb6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:34:28.527827 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-728382603 Sep 23 04:34:28.527827 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 352fcc27a585434ebf87099f27e69fb6 Sep 23 04:34:28.527827 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-728382603 Sep 23 04:34:28.527827 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-HypervisorAdminNegativeTestJSON-728382603-project Sep 23 04:34:28.527827 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:34:28.527827 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:34:28.527827 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: ef62b112a01d41be978336904e665c40 Sep 23 04:34:28.527827 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-728382603-project Sep 23 04:34:28.527827 n-d-846463-3 devstack@n-api.service[122698]: method: Sep 23 04:34:28.527827 n-d-846463-3 devstack@n-api.service[122698]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Sep 23 04:34:28.527827 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '1'} Sep 23 04:34:28.527827 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:34:28.528663 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:34:28.528663 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:34:28.528663 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:34:28.528663 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:34:28.528663 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:34:28.528663 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:34:28.528663 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:34:28.528663 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:34:28.528663 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:34:28.528663 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Sep 23 04:34:28.528663 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self._show(req, id) Sep 23 04:34:28.528663 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Sep 23 04:34:28.528663 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Sep 23 04:34:28.528663 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 23 04:34:28.528663 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 23 04:34:28.528663 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 23 04:34:28.528663 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 23 04:34:28.528663 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 23 04:34:28.528663 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 23 04:34:28.529955 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 23 04:34:28.529955 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise self.value Sep 23 04:34:28.529955 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 23 04:34:28.529955 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 23 04:34:28.529955 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 23 04:34:28.529955 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 23 04:34:28.529955 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 23 04:34:28.529955 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 23 04:34:28.529955 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Sep 23 04:34:28.529955 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:34:28.529955 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:34:28.529955 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:34:28.529955 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:34:28.529955 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:34:28.529955 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:34:28.529955 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 23 04:34:28.529955 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 23 04:34:28.529955 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Sep 23 04:34:28.529955 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:34:28.532969 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-46499bdb-5793-47a5-a3ab-dc80a050057f tempest-HypervisorAdminNegativeTestJSON-728382603 tempest-HypervisorAdminNegativeTestJSON-728382603-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:34:28.535234 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-46499bdb-5793-47a5-a3ab-dc80a050057f tempest-HypervisorAdminNegativeTestJSON-728382603 tempest-HypervisorAdminNegativeTestJSON-728382603-project] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.017758 Sep 23 04:34:28.540029 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 458/969] 10.222.0.33 () {58 vars in 1152 bytes} [Fri Sep 23 04:34:28 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:34:28.545542 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-99792819-eff9-4a6e-989a-07d0402c1b82 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:28.546892 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-99792819-eff9-4a6e-989a-07d0402c1b82 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: 09076cfa-4632-43c3-919d-4a8fe1b1bd37] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:28.554806 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-99792819-eff9-4a6e-989a-07d0402c1b82 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:28.555550 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-99792819-eff9-4a6e-989a-07d0402c1b82 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:28.555995 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-99792819-eff9-4a6e-989a-07d0402c1b82 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:28.556707 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-99792819-eff9-4a6e-989a-07d0402c1b82 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:28.557172 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-99792819-eff9-4a6e-989a-07d0402c1b82 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:28.557603 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-99792819-eff9-4a6e-989a-07d0402c1b82 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:28.809228 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-99792819-eff9-4a6e-989a-07d0402c1b82 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:28.817277 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-99792819-eff9-4a6e-989a-07d0402c1b82 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/09076cfa-4632-43c3-919d-4a8fe1b1bd37" status: 200 len: 1463 microversion: 2.1 time: 0.278268 Sep 23 04:34:28.817981 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 459/970] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:28 2022] GET /compute/v2.1/servers/09076cfa-4632-43c3-919d-4a8fe1b1bd37 => generated 1463 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:28.822775 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8b7b1b3a-7c4f-4370-aa47-54ec55a455f8 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:28.823483 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8b7b1b3a-7c4f-4370-aa47-54ec55a455f8 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] [instance: f392741f-f967-4c1c-930b-4eea7272bf64] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:28.829857 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8b7b1b3a-7c4f-4370-aa47-54ec55a455f8 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:28.830783 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8b7b1b3a-7c4f-4370-aa47-54ec55a455f8 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:28.831004 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8b7b1b3a-7c4f-4370-aa47-54ec55a455f8 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:28.831701 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8b7b1b3a-7c4f-4370-aa47-54ec55a455f8 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:28.832221 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8b7b1b3a-7c4f-4370-aa47-54ec55a455f8 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:28.832664 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8b7b1b3a-7c4f-4370-aa47-54ec55a455f8 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:28.848479 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-8954ed70-2610-41cb-af60-74df9b5019e7 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Flavor limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:34:28.848909 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-8954ed70-2610-41cb-af60-74df9b5019e7 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Image limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:34:28.849390 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-8954ed70-2610-41cb-af60-74df9b5019e7 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Flavor pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:34:28.849806 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-8954ed70-2610-41cb-af60-74df9b5019e7 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Image pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:34:28.850266 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-8954ed70-2610-41cb-af60-74df9b5019e7 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:34:28.860296 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8954ed70-2610-41cb-af60-74df9b5019e7 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:28.860794 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8954ed70-2610-41cb-af60-74df9b5019e7 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:28.861420 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8954ed70-2610-41cb-af60-74df9b5019e7 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:28.862401 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8954ed70-2610-41cb-af60-74df9b5019e7 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:28.863049 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8954ed70-2610-41cb-af60-74df9b5019e7 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:28.869421 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8954ed70-2610-41cb-af60-74df9b5019e7 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:28.882671 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-8954ed70-2610-41cb-af60-74df9b5019e7 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Getting quotas for project 004af70c9f9a43c4a7be8136268e98f9. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:34:28.892978 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-8954ed70-2610-41cb-af60-74df9b5019e7 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Getting quotas for user 82d04a55ba72452995e3b156325e0890 and project 004af70c9f9a43c4a7be8136268e98f9. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:34:28.906328 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-8954ed70-2610-41cb-af60-74df9b5019e7 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Going to run 1 instances... {{(pid=122699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:34:28.908606 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-8954ed70-2610-41cb-af60-74df9b5019e7 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: 36165f99-56fa-427b-98b4-c79d41f1fe28] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:34:28.982542 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8b7b1b3a-7c4f-4370-aa47-54ec55a455f8 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c82752e1bc4fdb82e7f8391c7c129f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44352a7a6d964530aa20ae83064b02e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:28.988409 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8b7b1b3a-7c4f-4370-aa47-54ec55a455f8 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] 10.222.0.33 "GET /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64" status: 200 len: 1463 microversion: 2.1 time: 0.169342 Sep 23 04:34:28.989183 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 460/971] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:28 2022] GET /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64 => generated 1463 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:28.993704 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c1df2480-9439-45fd-abc4-f918e23c3973 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Calling method '.version_select at 0x7ff1c010ddc0>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:29.042028 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-c1df2480-9439-45fd-abc4-f918e23c3973 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] HTTP exception thrown: Image not found. Sep 23 04:34:29.045588 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c1df2480-9439-45fd-abc4-f918e23c3973 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Request method failure captured: Sep 23 04:34:29.045588 n-d-846463-3 devstack@n-api.service[122698]: request: DELETE /compute/v2.1/images/df3e3bf4-7b42-4c67-9f3e-0d79fa06e685 HTTP/1.1 Sep 23 04:34:29.045588 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:34:29.045588 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:34:29.045588 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:34:29.045588 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:34:29.045588 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:34:29.045588 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:34:29.045588 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:34:29.045588 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:34:29.045588 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTbyr0QAWrNVBHBdYJI8ZB0I-MdaPhfBbuUHn552mhoNCE7FKWgFrVCPdLHp6_RRB3WtJZFMjVi5D-2nEiDXiwHI2K_DZsxDzKWxHer_EllxjXQnw6BXm5Ybxb7rX2EwQmmXg-jSYoOTZeH1scJiFODZiqnLNODjjnbExkCpCsbMjKE Sep 23 04:34:29.045588 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:34:29.045588 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:34:29.045588 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:34:29.045588 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:34:29.045588 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:34:29.045588 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:34:29.045588 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: f98e78e2969a446b8fdbf772b36dd0c3 Sep 23 04:34:29.045588 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ImagesOneServerTestJSON-405748545 Sep 23 04:34:29.045588 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:34:29.045588 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:34:29.046974 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f98e78e2969a446b8fdbf772b36dd0c3", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f98e78e2969a446b8fdbf772b36dd0c3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f98e78e2969a446b8fdbf772b36dd0c3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f98e78e2969a446b8fdbf772b36dd0c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:34:29.046974 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ImagesOneServerTestJSON-405748545 Sep 23 04:34:29.046974 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: f98e78e2969a446b8fdbf772b36dd0c3 Sep 23 04:34:29.046974 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-405748545 Sep 23 04:34:29.046974 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ImagesOneServerTestJSON-405748545-project Sep 23 04:34:29.046974 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:34:29.046974 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:34:29.046974 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: cb3ff8d26a3f4831b3ec766bea65e143 Sep 23 04:34:29.046974 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ImagesOneServerTestJSON-405748545-project Sep 23 04:34:29.046974 n-d-846463-3 devstack@n-api.service[122698]: method: Sep 23 04:34:29.046974 n-d-846463-3 devstack@n-api.service[122698]: exception: Image not found. Sep 23 04:34:29.046974 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': 'df3e3bf4-7b42-4c67-9f3e-0d79fa06e685'} Sep 23 04:34:29.046974 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:34:29.047746 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:34:29.047746 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 23 04:34:29.047746 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 23 04:34:29.047746 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 23 04:34:29.047746 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 23 04:34:29.047746 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 23 04:34:29.047746 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 23 04:34:29.047746 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 23 04:34:29.047746 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 23 04:34:29.047746 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 23 04:34:29.047746 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 23 04:34:29.047746 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 23 04:34:29.047746 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 23 04:34:29.047746 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 23 04:34:29.047746 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 23 04:34:29.047746 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image df3e3bf4-7b42-4c67-9f3e-0d79fa06e685 to delete Sep 23 04:34:29.047746 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:34:29.047746 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:34:29.047746 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:34:29.048987 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:34:29.048987 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 23 04:34:29.048987 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 23 04:34:29.048987 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 23 04:34:29.048987 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 23 04:34:29.048987 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 23 04:34:29.048987 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 23 04:34:29.048987 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image df3e3bf4-7b42-4c67-9f3e-0d79fa06e685 could not be found. Sep 23 04:34:29.048987 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:34:29.048987 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:34:29.048987 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:34:29.048987 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:34:29.048987 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:34:29.048987 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:34:29.048987 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:34:29.048987 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:34:29.048987 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:34:29.048987 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:34:29.048987 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:34:29.048987 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:34:29.050289 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 23 04:34:29.050289 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 23 04:34:29.050289 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 23 04:34:29.050289 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:34:29.050289 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:34:29.050289 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:34:29.050289 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:34:29.050289 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:34:29.050289 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:34:29.050289 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:34:29.050289 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:34:29.050289 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 23 04:34:29.050289 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:34:29.050289 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c1df2480-9439-45fd-abc4-f918e23c3973 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Returning 404 to user: Image not found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:34:29.050289 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c1df2480-9439-45fd-abc4-f918e23c3973 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] 10.222.0.33 "DELETE /compute/v2.1/images/df3e3bf4-7b42-4c67-9f3e-0d79fa06e685" status: 404 len: 62 microversion: 2.1 time: 0.056827 Sep 23 04:34:29.057728 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 461/972] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:28 2022] DELETE /compute/v2.1/images/df3e3bf4-7b42-4c67-9f3e-0d79fa06e685 => generated 62 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 23 04:34:29.058035 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-8954ed70-2610-41cb-af60-74df9b5019e7 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.874977 Sep 23 04:34:29.058035 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 512/973] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:34:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 876 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:34:29.058364 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a4dc1dcd-6c9c-483b-91ee-00786c4c0c5e tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Action: 'action', calling method: .version_select at 0x7ff1c18e1b80>, body: {"removeFloatingIp": {"address": "172.25.3.157"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:34:29.070359 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-00950e46-3471-4c38-9be1-13efa9a87454 tempest-HypervisorAdminNegativeTestJSON-4082007 tempest-HypervisorAdminNegativeTestJSON-4082007-project-admin] Calling method '.version_select at 0x7ff1c03a75e0>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:29.074450 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-00950e46-3471-4c38-9be1-13efa9a87454 tempest-HypervisorAdminNegativeTestJSON-4082007 tempest-HypervisorAdminNegativeTestJSON-4082007-project-admin] HTTP exception thrown: Hypervisor with ID '015bca4d-719b-4964-81d2-5a9e86002a13' could not be found. Sep 23 04:34:29.078680 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-00950e46-3471-4c38-9be1-13efa9a87454 tempest-HypervisorAdminNegativeTestJSON-4082007 tempest-HypervisorAdminNegativeTestJSON-4082007-project-admin] Request method failure captured: Sep 23 04:34:29.078680 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/os-hypervisors/015bca4d-719b-4964-81d2-5a9e86002a13 HTTP/1.1 Sep 23 04:34:29.078680 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:34:29.078680 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:34:29.078680 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:34:29.078680 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:34:29.078680 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:34:29.078680 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:34:29.078680 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:34:29.078680 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:34:29.078680 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTdC20vUSta6dzj1XUl0iOovywZ-z8dXDkmWEdPUcIIbmMI2I8PqVLw3_rrl1Ah9SnC7oAYc7rRHKz0UhY-zhN1lvPQfu01gaysqdvDOpfyo1FrGK2jBTOlFr0swYUtqoD-ducqMly6O6BVQsvme6LXYDJYcx88NtSbj_rXI5eLNOFA Sep 23 04:34:29.078680 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:34:29.078680 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:34:29.078680 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:34:29.078680 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:34:29.078680 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:34:29.078680 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:34:29.078680 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 9bd6cdf04352485c910335eb1c35d225 Sep 23 04:34:29.078680 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-4082007 Sep 23 04:34:29.078680 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,admin,member Sep 23 04:34:29.078680 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,admin,member Sep 23 04:34:29.080296 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9bd6cdf04352485c910335eb1c35d225", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9bd6cdf04352485c910335eb1c35d225"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9bd6cdf04352485c910335eb1c35d225"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9bd6cdf04352485c910335eb1c35d225"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:34:29.080296 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-4082007 Sep 23 04:34:29.080296 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 9bd6cdf04352485c910335eb1c35d225 Sep 23 04:34:29.080296 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-4082007 Sep 23 04:34:29.080296 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-HypervisorAdminNegativeTestJSON-4082007-project-admin Sep 23 04:34:29.080296 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:34:29.080296 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:34:29.080296 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: ffc549ea42d546a49206ed4a68bb245d Sep 23 04:34:29.080296 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-4082007-project-admin Sep 23 04:34:29.080296 n-d-846463-3 devstack@n-api.service[122699]: method: Sep 23 04:34:29.080296 n-d-846463-3 devstack@n-api.service[122699]: exception: Hypervisor with ID '015bca4d-719b-4964-81d2-5a9e86002a13' could not be found. Sep 23 04:34:29.080296 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '015bca4d-719b-4964-81d2-5a9e86002a13'} Sep 23 04:34:29.081074 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:34:29.081074 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:34:29.081074 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Sep 23 04:34:29.081074 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi value = int(str(value)) Sep 23 04:34:29.081074 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '015bca4d-719b-4964-81d2-5a9e86002a13' Sep 23 04:34:29.081074 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:34:29.081074 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:34:29.081074 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:34:29.081074 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:34:29.081074 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Sep 23 04:34:29.081074 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Sep 23 04:34:29.081074 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Sep 23 04:34:29.081074 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Sep 23 04:34:29.081074 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Sep 23 04:34:29.081074 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:34:29.081074 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:34:29.081074 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:34:29.081074 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:34:29.081074 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Sep 23 04:34:29.081074 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Sep 23 04:34:29.081074 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Sep 23 04:34:29.081074 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Sep 23 04:34:29.082432 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Sep 23 04:34:29.082432 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:34:29.082432 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:34:29.082432 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:34:29.082432 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:34:29.082432 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:34:29.082432 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:34:29.082432 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:34:29.082432 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:34:29.082432 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:34:29.082432 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:34:29.082432 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:34:29.082432 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:34:29.082432 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Sep 23 04:34:29.082432 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self._show(req, id) Sep 23 04:34:29.082432 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Sep 23 04:34:29.082432 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Sep 23 04:34:29.082432 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Sep 23 04:34:29.082432 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 23 04:34:29.082432 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '015bca4d-719b-4964-81d2-5a9e86002a13' could not be found. Sep 23 04:34:29.083618 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:34:29.083618 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:34:29.083618 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:34:29.083618 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:34:29.083618 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:34:29.083618 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:34:29.083618 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:34:29.083618 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:34:29.083618 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '015bca4d-719b-4964-81d2-5a9e86002a13' could not be found. Sep 23 04:34:29.083618 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:34:29.083618 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-00950e46-3471-4c38-9be1-13efa9a87454 tempest-HypervisorAdminNegativeTestJSON-4082007 tempest-HypervisorAdminNegativeTestJSON-4082007-project-admin] Returning 404 to user: Hypervisor with ID '015bca4d-719b-4964-81d2-5a9e86002a13' could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:34:29.083618 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-00950e46-3471-4c38-9be1-13efa9a87454 tempest-HypervisorAdminNegativeTestJSON-4082007 tempest-HypervisorAdminNegativeTestJSON-4082007-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/015bca4d-719b-4964-81d2-5a9e86002a13" status: 404 len: 123 microversion: 2.1 time: 0.028641 Sep 23 04:34:29.084354 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 513/974] 10.222.0.33 () {58 vars in 1257 bytes} [Fri Sep 23 04:34:29 2022] GET /compute/v2.1/os-hypervisors/015bca4d-719b-4964-81d2-5a9e86002a13 => generated 123 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:34:29.109961 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-12f4bfcf-11b7-4980-b58a-1d6c67fda910 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Action: 'create', calling method: .version_select at 0x7ff1c00498b0>, body: {"keypair": {"name": "tempest-keypair-1760615441", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBsNQT6OiALeSGyJQUlzMbEserwMkJH7atb969O5CEgq1qwZQMGrK3f65IdlOrIHAjSY6NCFCNxjK3TYwe2vAC4fC7Ll2CvDPm6dT/zmCfvMd/0W8RvsTryv9s7FyvEcOw=="}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:34:29.153039 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-12f4bfcf-11b7-4980-b58a-1d6c67fda910 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Getting quotas for project 54abd267d3c043e09f26f486823907e2. Resources: {'key_pairs'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:34:29.158761 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-12f4bfcf-11b7-4980-b58a-1d6c67fda910 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Getting quotas for user 13f5a913548445a09377847fd78a10a1 and project 54abd267d3c043e09f26f486823907e2. Resources: {'key_pairs'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:34:29.264145 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a4dc1dcd-6c9c-483b-91ee-00786c4c0c5e tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] [instance: e5237b14-ce44-43de-ab20-e6e456def723] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:29.266855 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-12f4bfcf-11b7-4980-b58a-1d6c67fda910 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.180644 Sep 23 04:34:29.268077 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 514/975] 10.222.0.33 () {60 vars in 1159 bytes} [Fri Sep 23 04:34:29 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:34:29.273908 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4a1f0f4d-23dc-4b9b-9a42-95f530b928f6 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:34:29.277730 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4a1f0f4d-23dc-4b9b-9a42-95f530b928f6 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] [instance: f392741f-f967-4c1c-930b-4eea7272bf64] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:29.278411 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a4dc1dcd-6c9c-483b-91ee-00786c4c0c5e tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:29.279513 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a4dc1dcd-6c9c-483b-91ee-00786c4c0c5e tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:29.279963 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a4dc1dcd-6c9c-483b-91ee-00786c4c0c5e tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:29.285370 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a4dc1dcd-6c9c-483b-91ee-00786c4c0c5e tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:29.285872 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a4dc1dcd-6c9c-483b-91ee-00786c4c0c5e tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:29.286350 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a4dc1dcd-6c9c-483b-91ee-00786c4c0c5e tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:29.288806 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4a1f0f4d-23dc-4b9b-9a42-95f530b928f6 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:29.290685 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4a1f0f4d-23dc-4b9b-9a42-95f530b928f6 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:29.291540 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4a1f0f4d-23dc-4b9b-9a42-95f530b928f6 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:29.292550 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4a1f0f4d-23dc-4b9b-9a42-95f530b928f6 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:29.293240 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4a1f0f4d-23dc-4b9b-9a42-95f530b928f6 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:29.293914 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4a1f0f4d-23dc-4b9b-9a42-95f530b928f6 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:29.420144 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-4a1f0f4d-23dc-4b9b-9a42-95f530b928f6 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Flavor limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:34:29.420751 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-4a1f0f4d-23dc-4b9b-9a42-95f530b928f6 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Image limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:34:29.421391 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-4a1f0f4d-23dc-4b9b-9a42-95f530b928f6 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Flavor pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:34:29.422152 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-4a1f0f4d-23dc-4b9b-9a42-95f530b928f6 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Image pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:34:29.422730 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-4a1f0f4d-23dc-4b9b-9a42-95f530b928f6 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:34:29.434343 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:34:29.693911 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4a1f0f4d-23dc-4b9b-9a42-95f530b928f6 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] [instance: f392741f-f967-4c1c-930b-4eea7272bf64] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:29.707360 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4a1f0f4d-23dc-4b9b-9a42-95f530b928f6 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:29.708179 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4a1f0f4d-23dc-4b9b-9a42-95f530b928f6 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:29.709164 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4a1f0f4d-23dc-4b9b-9a42-95f530b928f6 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:29.711417 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4a1f0f4d-23dc-4b9b-9a42-95f530b928f6 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:29.712180 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4a1f0f4d-23dc-4b9b-9a42-95f530b928f6 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:29.712850 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4a1f0f4d-23dc-4b9b-9a42-95f530b928f6 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:29.762521 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4a1f0f4d-23dc-4b9b-9a42-95f530b928f6 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] 10.222.0.33 "POST /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64/action" status: 202 len: 1067 microversion: 2.1 time: 0.484409 Sep 23 04:34:29.763469 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 515/976] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:34:29 2022] POST /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64/action => generated 1067 bytes in 495 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 23 04:34:29.770330 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-01a30808-0885-4d3c-a836-eac80cf359fd tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:29.774361 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-01a30808-0885-4d3c-a836-eac80cf359fd tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] [instance: 70213e65-9664-4df1-81d7-747c462fa434] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:29.776725 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a4dc1dcd-6c9c-483b-91ee-00786c4c0c5e tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Acquiring lock "refresh_cache-e5237b14-ce44-43de-ab20-e6e456def723" {{(pid=122698) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 23 04:34:29.777469 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a4dc1dcd-6c9c-483b-91ee-00786c4c0c5e tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Acquired lock "refresh_cache-e5237b14-ce44-43de-ab20-e6e456def723" {{(pid=122698) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 23 04:34:29.793666 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-01a30808-0885-4d3c-a836-eac80cf359fd tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:29.801560 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-01a30808-0885-4d3c-a836-eac80cf359fd tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:29.801560 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-01a30808-0885-4d3c-a836-eac80cf359fd tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:29.801560 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-01a30808-0885-4d3c-a836-eac80cf359fd tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:29.801560 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-01a30808-0885-4d3c-a836-eac80cf359fd tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:29.801984 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-01a30808-0885-4d3c-a836-eac80cf359fd tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:29.868611 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-01a30808-0885-4d3c-a836-eac80cf359fd tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] [instance: 70213e65-9664-4df1-81d7-747c462fa434] Going to try to terminate instance {{(pid=122699) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:34:30.247564 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-01a30808-0885-4d3c-a836-eac80cf359fd tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] 10.222.0.33 "DELETE /compute/v2.1/servers/70213e65-9664-4df1-81d7-747c462fa434" status: 204 len: 0 microversion: 2.1 time: 0.482383 Sep 23 04:34:30.251806 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 516/977] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:34:29 2022] DELETE /compute/v2.1/servers/70213e65-9664-4df1-81d7-747c462fa434 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:34:30.270553 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-61039881-db52-46ac-ad84-3ca0835efb17 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:30.271453 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-61039881-db52-46ac-ad84-3ca0835efb17 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: 36165f99-56fa-427b-98b4-c79d41f1fe28] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:30.368953 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-61039881-db52-46ac-ad84-3ca0835efb17 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:30.376695 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-61039881-db52-46ac-ad84-3ca0835efb17 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/36165f99-56fa-427b-98b4-c79d41f1fe28" status: 200 len: 1211 microversion: 2.1 time: 0.123194 Sep 23 04:34:30.377915 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 517/978] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:30 2022] GET /compute/v2.1/servers/36165f99-56fa-427b-98b4-c79d41f1fe28 => generated 1211 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:30.382914 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-92ad6b94-bd42-493d-95e6-0ef4a13cf3c2 req-a0fde0b3-a11e-4750-bdfd-74c4d24f020a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5237b14-ce44-43de-ab20-e6e456def723", "tag": "e1b845e7-999a-4e6a-b939-3cf715e6290e"}, {"server_uuid": "9dede73d-62ac-481b-b990-41fd1039882a", "name": "network-vif-deleted", "tag": "a606ca45-c7dd-4f7c-90b2-1c6bd26525bf"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:34:30.400728 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-92ad6b94-bd42-493d-95e6-0ef4a13cf3c2 req-a0fde0b3-a11e-4750-bdfd-74c4d24f020a service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:30.409054 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-92ad6b94-bd42-493d-95e6-0ef4a13cf3c2 req-a0fde0b3-a11e-4750-bdfd-74c4d24f020a service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:30.410746 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-92ad6b94-bd42-493d-95e6-0ef4a13cf3c2 req-a0fde0b3-a11e-4750-bdfd-74c4d24f020a service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:30.429822 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-92ad6b94-bd42-493d-95e6-0ef4a13cf3c2 req-a0fde0b3-a11e-4750-bdfd-74c4d24f020a service nova] Creating event network-changed:e1b845e7-999a-4e6a-b939-3cf715e6290e for instance e5237b14-ce44-43de-ab20-e6e456def723 on n-h1-846463-3 Sep 23 04:34:30.440598 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-92ad6b94-bd42-493d-95e6-0ef4a13cf3c2 req-a0fde0b3-a11e-4750-bdfd-74c4d24f020a service nova] Creating event network-vif-deleted:a606ca45-c7dd-4f7c-90b2-1c6bd26525bf for instance 9dede73d-62ac-481b-b990-41fd1039882a on n-h1-846463-3 Sep 23 04:34:30.458586 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-92ad6b94-bd42-493d-95e6-0ef4a13cf3c2 req-a0fde0b3-a11e-4750-bdfd-74c4d24f020a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.078743 Sep 23 04:34:30.459705 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 518/979] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:34:30 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:34:30.470773 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4cd06d20-0872-4900-9179-fbb408b711ec tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:30.471501 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4cd06d20-0872-4900-9179-fbb408b711ec tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 205bf02b-1478-4765-b2a6-d7014d9f0a64] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:30.487907 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4cd06d20-0872-4900-9179-fbb408b711ec tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:30.488419 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4cd06d20-0872-4900-9179-fbb408b711ec tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:30.492613 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4cd06d20-0872-4900-9179-fbb408b711ec tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:30.493430 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4cd06d20-0872-4900-9179-fbb408b711ec tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:30.493996 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4cd06d20-0872-4900-9179-fbb408b711ec tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:30.494436 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4cd06d20-0872-4900-9179-fbb408b711ec tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:30.766572 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-4cd06d20-0872-4900-9179-fbb408b711ec tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:30.783856 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-4cd06d20-0872-4900-9179-fbb408b711ec tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:30.785312 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-4cd06d20-0872-4900-9179-fbb408b711ec tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:30.786524 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4cd06d20-0872-4900-9179-fbb408b711ec tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/205bf02b-1478-4765-b2a6-d7014d9f0a64" status: 200 len: 1815 microversion: 2.25 time: 0.325722 Sep 23 04:34:30.787098 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 519/980] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:34:30 2022] GET /compute/v2.1/servers/205bf02b-1478-4765-b2a6-d7014d9f0a64 => generated 1815 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:34:30.794245 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-700bdf03-9f23-40f3-917a-87c76ff5b4e1 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:30.801106 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-700bdf03-9f23-40f3-917a-87c76ff5b4e1 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] [instance: f392741f-f967-4c1c-930b-4eea7272bf64] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:30.811320 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-700bdf03-9f23-40f3-917a-87c76ff5b4e1 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:30.813489 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-700bdf03-9f23-40f3-917a-87c76ff5b4e1 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:30.814191 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-700bdf03-9f23-40f3-917a-87c76ff5b4e1 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:30.821538 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-700bdf03-9f23-40f3-917a-87c76ff5b4e1 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:30.822304 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-700bdf03-9f23-40f3-917a-87c76ff5b4e1 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:30.823076 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-700bdf03-9f23-40f3-917a-87c76ff5b4e1 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:31.107246 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.network.neutron [None req-a4dc1dcd-6c9c-483b-91ee-00786c4c0c5e tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] [instance: e5237b14-ce44-43de-ab20-e6e456def723] Building network info cache for instance {{(pid=122698) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 23 04:34:31.659166 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-700bdf03-9f23-40f3-917a-87c76ff5b4e1 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c82752e1bc4fdb82e7f8391c7c129f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44352a7a6d964530aa20ae83064b02e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:31.673581 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-700bdf03-9f23-40f3-917a-87c76ff5b4e1 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] 10.222.0.33 "GET /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64" status: 200 len: 1472 microversion: 2.1 time: 0.885283 Sep 23 04:34:31.676050 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 520/981] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:30 2022] GET /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64 => generated 1472 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:31.682407 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-95637741-5d11-4374-99aa-5288e4655a58 req-705f51d7-0239-4a97-b0b5-ff93a78967e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70213e65-9664-4df1-81d7-747c462fa434", "name": "network-vif-unplugged", "status": "completed", "tag": "4070aee3-4e6a-47b5-ae56-ad309ddbad7b"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:34:31.708092 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-95637741-5d11-4374-99aa-5288e4655a58 req-705f51d7-0239-4a97-b0b5-ff93a78967e3 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:31.709509 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-95637741-5d11-4374-99aa-5288e4655a58 req-705f51d7-0239-4a97-b0b5-ff93a78967e3 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:31.710453 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-95637741-5d11-4374-99aa-5288e4655a58 req-705f51d7-0239-4a97-b0b5-ff93a78967e3 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:31.756238 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-95637741-5d11-4374-99aa-5288e4655a58 req-705f51d7-0239-4a97-b0b5-ff93a78967e3 service nova] Creating event network-vif-unplugged:4070aee3-4e6a-47b5-ae56-ad309ddbad7b for instance 70213e65-9664-4df1-81d7-747c462fa434 on n-h2-846463-3 Sep 23 04:34:31.788382 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-95637741-5d11-4374-99aa-5288e4655a58 req-705f51d7-0239-4a97-b0b5-ff93a78967e3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.107279 Sep 23 04:34:31.792851 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 521/982] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:34:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:34:31.806259 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-57c10d02-ffde-4030-a3e9-9ceddfca57b9 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:31.807760 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-57c10d02-ffde-4030-a3e9-9ceddfca57b9 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] [instance: 70213e65-9664-4df1-81d7-747c462fa434] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:31.821964 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-57c10d02-ffde-4030-a3e9-9ceddfca57b9 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:31.822925 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-57c10d02-ffde-4030-a3e9-9ceddfca57b9 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:31.830560 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-57c10d02-ffde-4030-a3e9-9ceddfca57b9 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:31.831558 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-57c10d02-ffde-4030-a3e9-9ceddfca57b9 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:31.832642 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-57c10d02-ffde-4030-a3e9-9ceddfca57b9 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:31.833240 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-57c10d02-ffde-4030-a3e9-9ceddfca57b9 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:32.441364 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-57c10d02-ffde-4030-a3e9-9ceddfca57b9 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3ff8d26a3f4831b3ec766bea65e143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98e78e2969a446b8fdbf772b36dd0c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:32.450992 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-57c10d02-ffde-4030-a3e9-9ceddfca57b9 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] 10.222.0.33 "GET /compute/v2.1/servers/70213e65-9664-4df1-81d7-747c462fa434" status: 200 len: 1473 microversion: 2.1 time: 0.655019 Sep 23 04:34:32.458433 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 522/983] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:31 2022] GET /compute/v2.1/servers/70213e65-9664-4df1-81d7-747c462fa434 => generated 1473 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:32.473719 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0241e807-d23b-4815-9c80-9f74ea2357f3 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:32.473719 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-0241e807-d23b-4815-9c80-9f74ea2357f3 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: 36165f99-56fa-427b-98b4-c79d41f1fe28] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:32.479617 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0241e807-d23b-4815-9c80-9f74ea2357f3 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:32.482123 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0241e807-d23b-4815-9c80-9f74ea2357f3 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:32.488186 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0241e807-d23b-4815-9c80-9f74ea2357f3 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:32.488186 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0241e807-d23b-4815-9c80-9f74ea2357f3 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:32.488186 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0241e807-d23b-4815-9c80-9f74ea2357f3 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:32.488737 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0241e807-d23b-4815-9c80-9f74ea2357f3 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:32.618438 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-0241e807-d23b-4815-9c80-9f74ea2357f3 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:32.641136 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0241e807-d23b-4815-9c80-9f74ea2357f3 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/36165f99-56fa-427b-98b4-c79d41f1fe28" status: 200 len: 1207 microversion: 2.1 time: 0.181293 Sep 23 04:34:32.642539 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 523/984] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:32 2022] GET /compute/v2.1/servers/36165f99-56fa-427b-98b4-c79d41f1fe28 => generated 1207 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:32.651430 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-00b49ae8-324d-4df6-a16d-2f5ba7b32662 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:32.652522 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-00b49ae8-324d-4df6-a16d-2f5ba7b32662 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 205bf02b-1478-4765-b2a6-d7014d9f0a64] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:32.661824 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-00b49ae8-324d-4df6-a16d-2f5ba7b32662 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:32.662568 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-00b49ae8-324d-4df6-a16d-2f5ba7b32662 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:32.662790 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-00b49ae8-324d-4df6-a16d-2f5ba7b32662 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:32.663513 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-00b49ae8-324d-4df6-a16d-2f5ba7b32662 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:32.663981 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-00b49ae8-324d-4df6-a16d-2f5ba7b32662 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:32.664421 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-00b49ae8-324d-4df6-a16d-2f5ba7b32662 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:32.923811 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.network.neutron [None req-a4dc1dcd-6c9c-483b-91ee-00786c4c0c5e tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] [instance: e5237b14-ce44-43de-ab20-e6e456def723] Updating instance_info_cache with network_info: [{"id": "e1b845e7-999a-4e6a-b939-3cf715e6290e", "address": "fa:16:3e:e7:d0:7d", "network": {"id": "5e4e56e0-c3c5-411b-8ef5-0e167200f9bf", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1183423336-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "332a996884724d9eb16c79f46107c6af", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tape1b845e7-99", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122698) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 23 04:34:32.932304 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a4dc1dcd-6c9c-483b-91ee-00786c4c0c5e tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Releasing lock "refresh_cache-e5237b14-ce44-43de-ab20-e6e456def723" {{(pid=122698) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 23 04:34:32.935195 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a4dc1dcd-6c9c-483b-91ee-00786c4c0c5e tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] 10.222.0.33 "POST /compute/v2.1/servers/e5237b14-ce44-43de-ab20-e6e456def723/action" status: 202 len: 0 microversion: 2.1 time: 3.883639 Sep 23 04:34:32.935984 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 462/985] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:34:29 2022] POST /compute/v2.1/servers/e5237b14-ce44-43de-ab20-e6e456def723/action => generated 0 bytes in 3888 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 23 04:34:32.946019 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-69a38def-0f5b-48d4-9516-b94cdece2534 req-80c63778-ca12-47cc-8a41-7d9a8fee0d6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5237b14-ce44-43de-ab20-e6e456def723", "tag": "e1b845e7-999a-4e6a-b939-3cf715e6290e"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:34:32.969620 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-69a38def-0f5b-48d4-9516-b94cdece2534 req-80c63778-ca12-47cc-8a41-7d9a8fee0d6c service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:32.970485 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-69a38def-0f5b-48d4-9516-b94cdece2534 req-80c63778-ca12-47cc-8a41-7d9a8fee0d6c service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:32.974146 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-69a38def-0f5b-48d4-9516-b94cdece2534 req-80c63778-ca12-47cc-8a41-7d9a8fee0d6c service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:32.998861 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-69a38def-0f5b-48d4-9516-b94cdece2534 req-80c63778-ca12-47cc-8a41-7d9a8fee0d6c service nova] Creating event network-changed:e1b845e7-999a-4e6a-b939-3cf715e6290e for instance e5237b14-ce44-43de-ab20-e6e456def723 on n-h1-846463-3 Sep 23 04:34:33.005390 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-69a38def-0f5b-48d4-9516-b94cdece2534 req-80c63778-ca12-47cc-8a41-7d9a8fee0d6c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062853 Sep 23 04:34:33.007016 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-00b49ae8-324d-4df6-a16d-2f5ba7b32662 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:33.010244 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 463/986] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:34:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:34:33.018769 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2ef0b77d-3d33-4391-ab3b-7f96783d04d4 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:33.019427 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-2ef0b77d-3d33-4391-ab3b-7f96783d04d4 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] [instance: f392741f-f967-4c1c-930b-4eea7272bf64] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:33.026593 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-00b49ae8-324d-4df6-a16d-2f5ba7b32662 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:33.029045 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-00b49ae8-324d-4df6-a16d-2f5ba7b32662 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:33.030479 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-00b49ae8-324d-4df6-a16d-2f5ba7b32662 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/205bf02b-1478-4765-b2a6-d7014d9f0a64" status: 200 len: 1815 microversion: 2.25 time: 0.383599 Sep 23 04:34:33.038990 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2ef0b77d-3d33-4391-ab3b-7f96783d04d4 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:33.039497 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2ef0b77d-3d33-4391-ab3b-7f96783d04d4 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:33.043616 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2ef0b77d-3d33-4391-ab3b-7f96783d04d4 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:33.048481 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2ef0b77d-3d33-4391-ab3b-7f96783d04d4 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:33.054588 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2ef0b77d-3d33-4391-ab3b-7f96783d04d4 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:33.054588 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2ef0b77d-3d33-4391-ab3b-7f96783d04d4 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:33.054805 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 524/987] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:34:32 2022] GET /compute/v2.1/servers/205bf02b-1478-4765-b2a6-d7014d9f0a64 => generated 1815 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:34:33.058119 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-976c9da1-f65c-4425-89d6-b11eede79eb9 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:33.058899 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-976c9da1-f65c-4425-89d6-b11eede79eb9 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] [instance: 9dede73d-62ac-481b-b990-41fd1039882a] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:33.065518 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-976c9da1-f65c-4425-89d6-b11eede79eb9 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:33.067532 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-976c9da1-f65c-4425-89d6-b11eede79eb9 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:33.068258 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-976c9da1-f65c-4425-89d6-b11eede79eb9 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:33.069220 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-976c9da1-f65c-4425-89d6-b11eede79eb9 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:33.069939 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-976c9da1-f65c-4425-89d6-b11eede79eb9 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:33.070629 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-976c9da1-f65c-4425-89d6-b11eede79eb9 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:33.107397 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-976c9da1-f65c-4425-89d6-b11eede79eb9 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] HTTP exception thrown: Instance 9dede73d-62ac-481b-b990-41fd1039882a could not be found. Sep 23 04:34:33.107397 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-976c9da1-f65c-4425-89d6-b11eede79eb9 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Request method failure captured: Sep 23 04:34:33.107397 n-d-846463-3 devstack@n-api.service[122699]: request: DELETE /compute/v2.1/servers/9dede73d-62ac-481b-b990-41fd1039882a HTTP/1.1 Sep 23 04:34:33.107397 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:34:33.107397 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:34:33.107397 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:34:33.107397 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:34:33.107397 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:34:33.107397 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:34:33.107397 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:34:33.107397 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:34:33.107397 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTcHNy6q1jovkTYRvB6Nd1Yn75ASiOTXg5P6FWNfMqfZsExkROsoJvfjzTWt1ewBvvhF7GNO3lXnOfc_-N9fOZu-4OBo5IfOZiZ2qxKSq6QkXqeSvVLRZU5bVykPO8lROcxqJSGn1N_UoxXezu6H8y5yxJtWtqmydu-QUKpzUJ2YFUc Sep 23 04:34:33.107397 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:34:33.107397 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:34:33.107397 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:34:33.107397 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:34:33.107397 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:34:33.107397 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:34:33.107397 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 332a996884724d9eb16c79f46107c6af Sep 23 04:34:33.107397 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1298389341 Sep 23 04:34:33.107397 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:34:33.107397 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:34:33.108718 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_332a996884724d9eb16c79f46107c6af", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/332a996884724d9eb16c79f46107c6af"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/332a996884724d9eb16c79f46107c6af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/332a996884724d9eb16c79f46107c6af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:34:33.108718 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1298389341 Sep 23 04:34:33.108718 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 332a996884724d9eb16c79f46107c6af Sep 23 04:34:33.108718 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1298389341 Sep 23 04:34:33.108718 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-FloatingIPsAssociationTestJSON-1298389341-project Sep 23 04:34:33.108718 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:34:33.108718 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:34:33.108718 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 3135a00fc94e488cb633b89d8768fe93 Sep 23 04:34:33.108718 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1298389341-project Sep 23 04:34:33.108718 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:34:33.108718 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 9dede73d-62ac-481b-b990-41fd1039882a could not be found. Sep 23 04:34:33.108718 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '9dede73d-62ac-481b-b990-41fd1039882a'} Sep 23 04:34:33.109471 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:34:33.109471 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:34:33.109471 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:34:33.109471 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:34:33.109471 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:34:33.109471 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:34:33.109471 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:34:33.109471 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:34:33.109471 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:34:33.109471 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:34:33.109471 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9dede73d-62ac-481b-b990-41fd1039882a could not be found. Sep 23 04:34:33.109471 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:34:33.109471 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:34:33.109471 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:34:33.109471 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:34:33.109471 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:34:33.109471 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:34:33.109471 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:34:33.109471 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:34:33.109471 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:34:33.110721 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:34:33.110721 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 04:34:33.110721 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 04:34:33.110721 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 04:34:33.110721 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 04:34:33.110721 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:34:33.110721 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:34:33.110721 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:34:33.110721 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:34:33.110721 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9dede73d-62ac-481b-b990-41fd1039882a could not be found. Sep 23 04:34:33.110721 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:34:33.110721 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:34:33.110721 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:34:33.110721 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:34:33.110721 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:34:33.110721 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:34:33.110721 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:34:33.110721 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:34:33.110721 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9dede73d-62ac-481b-b990-41fd1039882a could not be found. Sep 23 04:34:33.110721 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:34:33.111938 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-976c9da1-f65c-4425-89d6-b11eede79eb9 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Returning 404 to user: Instance 9dede73d-62ac-481b-b990-41fd1039882a could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:34:33.111938 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-976c9da1-f65c-4425-89d6-b11eede79eb9 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9dede73d-62ac-481b-b990-41fd1039882a" status: 404 len: 111 microversion: 2.1 time: 0.048409 Sep 23 04:34:33.111938 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 525/988] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:34:33 2022] DELETE /compute/v2.1/servers/9dede73d-62ac-481b-b990-41fd1039882a => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:34:33.118384 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-cfbebdff-8770-4d73-84f6-9d01ff9fd908 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:33.118965 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-cfbebdff-8770-4d73-84f6-9d01ff9fd908 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] [instance: 9dede73d-62ac-481b-b990-41fd1039882a] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:33.135497 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cfbebdff-8770-4d73-84f6-9d01ff9fd908 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:33.139139 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cfbebdff-8770-4d73-84f6-9d01ff9fd908 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:33.139764 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cfbebdff-8770-4d73-84f6-9d01ff9fd908 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:33.141653 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cfbebdff-8770-4d73-84f6-9d01ff9fd908 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:33.142319 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cfbebdff-8770-4d73-84f6-9d01ff9fd908 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:33.144266 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cfbebdff-8770-4d73-84f6-9d01ff9fd908 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:33.175229 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-cfbebdff-8770-4d73-84f6-9d01ff9fd908 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] HTTP exception thrown: Instance 9dede73d-62ac-481b-b990-41fd1039882a could not be found. Sep 23 04:34:33.178322 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-cfbebdff-8770-4d73-84f6-9d01ff9fd908 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Request method failure captured: Sep 23 04:34:33.178322 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/9dede73d-62ac-481b-b990-41fd1039882a HTTP/1.1 Sep 23 04:34:33.178322 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:34:33.178322 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:34:33.178322 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:34:33.178322 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:34:33.178322 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:34:33.178322 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:34:33.178322 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:34:33.178322 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:34:33.178322 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTcHNy6q1jovkTYRvB6Nd1Yn75ASiOTXg5P6FWNfMqfZsExkROsoJvfjzTWt1ewBvvhF7GNO3lXnOfc_-N9fOZu-4OBo5IfOZiZ2qxKSq6QkXqeSvVLRZU5bVykPO8lROcxqJSGn1N_UoxXezu6H8y5yxJtWtqmydu-QUKpzUJ2YFUc Sep 23 04:34:33.178322 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:34:33.178322 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:34:33.178322 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:34:33.178322 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:34:33.178322 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:34:33.178322 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:34:33.178322 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 332a996884724d9eb16c79f46107c6af Sep 23 04:34:33.178322 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1298389341 Sep 23 04:34:33.178322 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:34:33.178322 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:34:33.179810 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_332a996884724d9eb16c79f46107c6af", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/332a996884724d9eb16c79f46107c6af"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/332a996884724d9eb16c79f46107c6af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/332a996884724d9eb16c79f46107c6af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:34:33.179810 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1298389341 Sep 23 04:34:33.179810 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 332a996884724d9eb16c79f46107c6af Sep 23 04:34:33.179810 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1298389341 Sep 23 04:34:33.179810 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-FloatingIPsAssociationTestJSON-1298389341-project Sep 23 04:34:33.179810 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:34:33.179810 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:34:33.179810 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 3135a00fc94e488cb633b89d8768fe93 Sep 23 04:34:33.179810 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1298389341-project Sep 23 04:34:33.179810 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:34:33.179810 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 9dede73d-62ac-481b-b990-41fd1039882a could not be found. Sep 23 04:34:33.179810 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '9dede73d-62ac-481b-b990-41fd1039882a'} Sep 23 04:34:33.180812 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:34:33.180812 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:34:33.180812 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:34:33.180812 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:34:33.180812 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:34:33.180812 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:34:33.180812 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:34:33.180812 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:34:33.180812 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:34:33.180812 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:34:33.180812 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9dede73d-62ac-481b-b990-41fd1039882a could not be found. Sep 23 04:34:33.180812 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:34:33.180812 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:34:33.180812 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:34:33.180812 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:34:33.180812 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:34:33.180812 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:34:33.180812 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:34:33.180812 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:34:33.180812 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:34:33.182219 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:34:33.182219 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:34:33.182219 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:34:33.182219 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:34:33.182219 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:34:33.182219 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:34:33.182219 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:34:33.182219 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9dede73d-62ac-481b-b990-41fd1039882a could not be found. Sep 23 04:34:33.182219 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:34:33.182219 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:34:33.182219 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:34:33.182219 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:34:33.182219 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:34:33.182219 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:34:33.182219 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:34:33.182219 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:34:33.182219 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9dede73d-62ac-481b-b990-41fd1039882a could not be found. Sep 23 04:34:33.182219 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:34:33.188296 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-cfbebdff-8770-4d73-84f6-9d01ff9fd908 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Returning 404 to user: Instance 9dede73d-62ac-481b-b990-41fd1039882a could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:34:33.189382 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-cfbebdff-8770-4d73-84f6-9d01ff9fd908 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] 10.222.0.33 "GET /compute/v2.1/servers/9dede73d-62ac-481b-b990-41fd1039882a" status: 404 len: 111 microversion: 2.1 time: 0.074913 Sep 23 04:34:33.192934 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 526/989] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:33 2022] GET /compute/v2.1/servers/9dede73d-62ac-481b-b990-41fd1039882a => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:34:33.201844 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ddbfd7b6-048a-4caf-80eb-6ebd10ed94e3 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Calling method '.version_select at 0x7ff1bba58af0>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:33.469069 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-2ef0b77d-3d33-4391-ab3b-7f96783d04d4 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c82752e1bc4fdb82e7f8391c7c129f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44352a7a6d964530aa20ae83064b02e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:33.483897 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2ef0b77d-3d33-4391-ab3b-7f96783d04d4 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] 10.222.0.33 "GET /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64" status: 200 len: 1472 microversion: 2.1 time: 0.471021 Sep 23 04:34:33.501239 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 464/990] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:33 2022] GET /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64 => generated 1472 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:33.507232 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f9f22368-28c4-4c54-b345-87ebbb80f6d1 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:33.507854 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f9f22368-28c4-4c54-b345-87ebbb80f6d1 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] [instance: 70213e65-9664-4df1-81d7-747c462fa434] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:33.518886 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f9f22368-28c4-4c54-b345-87ebbb80f6d1 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:33.522232 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f9f22368-28c4-4c54-b345-87ebbb80f6d1 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:33.522797 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f9f22368-28c4-4c54-b345-87ebbb80f6d1 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:33.523616 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f9f22368-28c4-4c54-b345-87ebbb80f6d1 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:33.524291 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f9f22368-28c4-4c54-b345-87ebbb80f6d1 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:33.524812 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f9f22368-28c4-4c54-b345-87ebbb80f6d1 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:33.967672 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f9f22368-28c4-4c54-b345-87ebbb80f6d1 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3ff8d26a3f4831b3ec766bea65e143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98e78e2969a446b8fdbf772b36dd0c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:33.975058 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f9f22368-28c4-4c54-b345-87ebbb80f6d1 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] 10.222.0.33 "GET /compute/v2.1/servers/70213e65-9664-4df1-81d7-747c462fa434" status: 200 len: 1473 microversion: 2.1 time: 0.472418 Sep 23 04:34:33.976048 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 465/991] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:33 2022] GET /compute/v2.1/servers/70213e65-9664-4df1-81d7-747c462fa434 => generated 1473 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:33.989432 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b3fa7ab6-a2b6-49f3-88a5-f523eeac9798 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:33.994826 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b3fa7ab6-a2b6-49f3-88a5-f523eeac9798 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: 36165f99-56fa-427b-98b4-c79d41f1fe28] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:34.035050 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b3fa7ab6-a2b6-49f3-88a5-f523eeac9798 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:34.035820 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b3fa7ab6-a2b6-49f3-88a5-f523eeac9798 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:34.039593 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b3fa7ab6-a2b6-49f3-88a5-f523eeac9798 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:34.042630 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b3fa7ab6-a2b6-49f3-88a5-f523eeac9798 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:34.047371 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b3fa7ab6-a2b6-49f3-88a5-f523eeac9798 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:34.048384 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b3fa7ab6-a2b6-49f3-88a5-f523eeac9798 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:34.198917 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b3fa7ab6-a2b6-49f3-88a5-f523eeac9798 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:34.212903 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b3fa7ab6-a2b6-49f3-88a5-f523eeac9798 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/36165f99-56fa-427b-98b4-c79d41f1fe28" status: 200 len: 1281 microversion: 2.1 time: 0.235605 Sep 23 04:34:34.219108 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 466/992] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:33 2022] GET /compute/v2.1/servers/36165f99-56fa-427b-98b4-c79d41f1fe28 => generated 1281 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:34.221379 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-60758ceb-cc71-4107-8293-897de1d1dba2 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:34.222268 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-60758ceb-cc71-4107-8293-897de1d1dba2 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 205bf02b-1478-4765-b2a6-d7014d9f0a64] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:34.233421 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-60758ceb-cc71-4107-8293-897de1d1dba2 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:34.234202 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-60758ceb-cc71-4107-8293-897de1d1dba2 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:34.235611 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-60758ceb-cc71-4107-8293-897de1d1dba2 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:34.237397 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-60758ceb-cc71-4107-8293-897de1d1dba2 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:34.238340 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-60758ceb-cc71-4107-8293-897de1d1dba2 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:34.239224 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-60758ceb-cc71-4107-8293-897de1d1dba2 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:34.531864 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-60758ceb-cc71-4107-8293-897de1d1dba2 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:34.543026 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-60758ceb-cc71-4107-8293-897de1d1dba2 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:34.544960 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-60758ceb-cc71-4107-8293-897de1d1dba2 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:34.546213 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-60758ceb-cc71-4107-8293-897de1d1dba2 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/205bf02b-1478-4765-b2a6-d7014d9f0a64" status: 200 len: 1815 microversion: 2.25 time: 0.331204 Sep 23 04:34:34.562342 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 467/993] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:34:34 2022] GET /compute/v2.1/servers/205bf02b-1478-4765-b2a6-d7014d9f0a64 => generated 1815 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:34:34.562342 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-47a882fb-5bb3-4f65-9bbd-b07925325f4a tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:34.562342 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-47a882fb-5bb3-4f65-9bbd-b07925325f4a tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] [instance: f392741f-f967-4c1c-930b-4eea7272bf64] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:34.562342 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-47a882fb-5bb3-4f65-9bbd-b07925325f4a tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:34.562342 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-47a882fb-5bb3-4f65-9bbd-b07925325f4a tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:34.563021 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-47a882fb-5bb3-4f65-9bbd-b07925325f4a tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:34.563021 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-47a882fb-5bb3-4f65-9bbd-b07925325f4a tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:34.563873 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-47a882fb-5bb3-4f65-9bbd-b07925325f4a tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:34.564711 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-47a882fb-5bb3-4f65-9bbd-b07925325f4a tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:34.870118 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ddbfd7b6-048a-4caf-80eb-6ebd10ed94e3 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] 10.222.0.33 "DELETE /compute/v2.1/os-floating-ips/4fdb1381-9019-4859-940f-74836ea61fe0" status: 202 len: 0 microversion: 2.1 time: 1.675578 Sep 23 04:34:34.872095 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 527/994] 10.222.0.33 () {58 vars in 1263 bytes} [Fri Sep 23 04:34:33 2022] DELETE /compute/v2.1/os-floating-ips/4fdb1381-9019-4859-940f-74836ea61fe0 => generated 0 bytes in 1677 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:34:34.883550 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-47a882fb-5bb3-4f65-9bbd-b07925325f4a tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c82752e1bc4fdb82e7f8391c7c129f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44352a7a6d964530aa20ae83064b02e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:34.894479 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-47a882fb-5bb3-4f65-9bbd-b07925325f4a tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] 10.222.0.33 "GET /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64" status: 200 len: 1472 microversion: 2.1 time: 0.346558 Sep 23 04:34:34.895075 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 468/995] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:34 2022] GET /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64 => generated 1472 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:34.899309 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b0504510-a63c-4089-8428-2b3155e9a44e tempest-MigrationsAdminTest-295231043 tempest-MigrationsAdminTest-295231043-project-admin] Calling method '.version_select at 0x7ff1bba58310>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:34.907207 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-00280f4f-1b3c-459f-a363-281b7dbfcfc3 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:34.907743 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-00280f4f-1b3c-459f-a363-281b7dbfcfc3 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] [instance: e5237b14-ce44-43de-ab20-e6e456def723] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:34.915143 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b0504510-a63c-4089-8428-2b3155e9a44e tempest-MigrationsAdminTest-295231043 tempest-MigrationsAdminTest-295231043-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:34.917076 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b0504510-a63c-4089-8428-2b3155e9a44e tempest-MigrationsAdminTest-295231043 tempest-MigrationsAdminTest-295231043-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:34.917656 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b0504510-a63c-4089-8428-2b3155e9a44e tempest-MigrationsAdminTest-295231043 tempest-MigrationsAdminTest-295231043-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:34.922356 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-00280f4f-1b3c-459f-a363-281b7dbfcfc3 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:34.923681 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-00280f4f-1b3c-459f-a363-281b7dbfcfc3 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:34.927665 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-00280f4f-1b3c-459f-a363-281b7dbfcfc3 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:34.929406 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-00280f4f-1b3c-459f-a363-281b7dbfcfc3 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:34.929948 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-00280f4f-1b3c-459f-a363-281b7dbfcfc3 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:34.930593 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-00280f4f-1b3c-459f-a363-281b7dbfcfc3 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:34.942308 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b0504510-a63c-4089-8428-2b3155e9a44e tempest-MigrationsAdminTest-295231043 tempest-MigrationsAdminTest-295231043-project-admin] 10.222.0.33 "GET /compute/v2.1/os-migrations" status: 200 len: 2338 microversion: 2.1 time: 0.061229 Sep 23 04:34:34.943177 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 528/996] 10.222.0.33 () {58 vars in 1143 bytes} [Fri Sep 23 04:34:34 2022] GET /compute/v2.1/os-migrations => generated 2338 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:34.963231 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9093cabe-af3f-4c96-aa7c-9904c87bed1d tempest-MigrationsAdminTest-295231043 tempest-MigrationsAdminTest-295231043-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:34.975363 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-9093cabe-af3f-4c96-aa7c-9904c87bed1d tempest-MigrationsAdminTest-295231043 tempest-MigrationsAdminTest-295231043-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016028 Sep 23 04:34:34.981286 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 529/997] 10.222.0.33 () {58 vars in 1137 bytes} [Fri Sep 23 04:34:34 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:34:34.997379 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d97afa86-0101-4f18-b1df-990de515d46d tempest-MigrationsAdminTest-295231043 tempest-MigrationsAdminTest-295231043-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-694811385", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:34:35.012490 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-00280f4f-1b3c-459f-a363-281b7dbfcfc3 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] [instance: e5237b14-ce44-43de-ab20-e6e456def723] Going to try to terminate instance {{(pid=122698) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:34:35.134658 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d97afa86-0101-4f18-b1df-990de515d46d tempest-MigrationsAdminTest-295231043 tempest-MigrationsAdminTest-295231043-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 498 microversion: 2.1 time: 0.145246 Sep 23 04:34:35.135347 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 530/998] 10.222.0.33 () {60 vars in 1146 bytes} [Fri Sep 23 04:34:34 2022] POST /compute/v2.1/flavors => generated 498 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:34:35.149037 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7521213f-8d91-4ba6-b937-26430a8eed6a tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:35.149860 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-7521213f-8d91-4ba6-b937-26430a8eed6a tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] [instance: 70213e65-9664-4df1-81d7-747c462fa434] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:35.157146 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7521213f-8d91-4ba6-b937-26430a8eed6a tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:35.157805 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7521213f-8d91-4ba6-b937-26430a8eed6a tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:35.158389 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7521213f-8d91-4ba6-b937-26430a8eed6a tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:35.159211 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7521213f-8d91-4ba6-b937-26430a8eed6a tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:35.159784 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7521213f-8d91-4ba6-b937-26430a8eed6a tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:35.160348 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7521213f-8d91-4ba6-b937-26430a8eed6a tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:35.208453 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7521213f-8d91-4ba6-b937-26430a8eed6a tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:35.208953 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7521213f-8d91-4ba6-b937-26430a8eed6a tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:35.209639 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7521213f-8d91-4ba6-b937-26430a8eed6a tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:35.210365 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-7521213f-8d91-4ba6-b937-26430a8eed6a tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Lazy-loading 'fault' on Instance uuid 70213e65-9664-4df1-81d7-747c462fa434 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:34:35.270145 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-7521213f-8d91-4ba6-b937-26430a8eed6a tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb3ff8d26a3f4831b3ec766bea65e143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f98e78e2969a446b8fdbf772b36dd0c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:35.278726 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-7521213f-8d91-4ba6-b937-26430a8eed6a tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] 10.222.0.33 "GET /compute/v2.1/servers/70213e65-9664-4df1-81d7-747c462fa434" status: 200 len: 1307 microversion: 2.1 time: 0.133986 Sep 23 04:34:35.280111 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 531/999] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:35 2022] GET /compute/v2.1/servers/70213e65-9664-4df1-81d7-747c462fa434 => generated 1307 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:35.286541 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-76246054-1508-4039-bf37-ff5cc6eb2bdd req-97f96a72-08a6-4622-a9db-0a336ac98fb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70213e65-9664-4df1-81d7-747c462fa434", "name": "network-vif-deleted", "tag": "4070aee3-4e6a-47b5-ae56-ad309ddbad7b"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:34:35.305554 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-76246054-1508-4039-bf37-ff5cc6eb2bdd req-97f96a72-08a6-4622-a9db-0a336ac98fb6 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:35.306053 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-76246054-1508-4039-bf37-ff5cc6eb2bdd req-97f96a72-08a6-4622-a9db-0a336ac98fb6 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:35.306488 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-76246054-1508-4039-bf37-ff5cc6eb2bdd req-97f96a72-08a6-4622-a9db-0a336ac98fb6 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:35.327268 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-76246054-1508-4039-bf37-ff5cc6eb2bdd req-97f96a72-08a6-4622-a9db-0a336ac98fb6 service nova] Creating event network-vif-deleted:4070aee3-4e6a-47b5-ae56-ad309ddbad7b for instance 70213e65-9664-4df1-81d7-747c462fa434 on n-h2-846463-3 Sep 23 04:34:35.337651 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-76246054-1508-4039-bf37-ff5cc6eb2bdd req-97f96a72-08a6-4622-a9db-0a336ac98fb6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055533 Sep 23 04:34:35.339211 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 532/1000] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:34:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:34:35.347994 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c8e466b0-a4d8-4ddb-bd18-492e51146549 tempest-MigrationsAdminTest-295231043 tempest-MigrationsAdminTest-295231043-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:35.358429 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c8e466b0-a4d8-4ddb-bd18-492e51146549 tempest-MigrationsAdminTest-295231043 tempest-MigrationsAdminTest-295231043-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.015080 Sep 23 04:34:35.360125 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 533/1001] 10.222.0.33 () {58 vars in 1182 bytes} [Fri Sep 23 04:34:35 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 04:34:35.366381 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b4630bb7-2603-4365-af84-03d83438fc2d tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:35.367316 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b4630bb7-2603-4365-af84-03d83438fc2d tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: 36165f99-56fa-427b-98b4-c79d41f1fe28] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:35.370257 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:INSERT=5 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:34:35.391724 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b4630bb7-2603-4365-af84-03d83438fc2d tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:35.392229 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b4630bb7-2603-4365-af84-03d83438fc2d tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:35.397039 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b4630bb7-2603-4365-af84-03d83438fc2d tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:35.397039 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b4630bb7-2603-4365-af84-03d83438fc2d tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:35.397039 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b4630bb7-2603-4365-af84-03d83438fc2d tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:35.397039 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b4630bb7-2603-4365-af84-03d83438fc2d tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:35.479933 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b4630bb7-2603-4365-af84-03d83438fc2d tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:35.490595 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b4630bb7-2603-4365-af84-03d83438fc2d tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/36165f99-56fa-427b-98b4-c79d41f1fe28" status: 200 len: 1269 microversion: 2.1 time: 0.129201 Sep 23 04:34:35.491681 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 534/1002] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:35 2022] GET /compute/v2.1/servers/36165f99-56fa-427b-98b4-c79d41f1fe28 => generated 1269 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:35.504277 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1bb237cd-bf49-42fa-bc3e-6fd1777b1d62 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-852266512", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "3d855f86-77b7-407a-b659-aee8bca403f3"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:34:35.510539 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-00280f4f-1b3c-459f-a363-281b7dbfcfc3 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e5237b14-ce44-43de-ab20-e6e456def723" status: 204 len: 0 microversion: 2.1 time: 0.612810 Sep 23 04:34:35.514688 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 469/1003] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:34:34 2022] DELETE /compute/v2.1/servers/e5237b14-ce44-43de-ab20-e6e456def723 => generated 0 bytes in 616 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:34:35.524397 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-139fd758-989c-42f0-9011-eb21f93d90ed tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:35.525214 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-139fd758-989c-42f0-9011-eb21f93d90ed tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] [instance: e5237b14-ce44-43de-ab20-e6e456def723] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:35.531517 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-139fd758-989c-42f0-9011-eb21f93d90ed tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:35.532024 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-139fd758-989c-42f0-9011-eb21f93d90ed tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:35.532465 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-139fd758-989c-42f0-9011-eb21f93d90ed tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:35.533174 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-139fd758-989c-42f0-9011-eb21f93d90ed tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:35.533638 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-139fd758-989c-42f0-9011-eb21f93d90ed tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:35.534129 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-139fd758-989c-42f0-9011-eb21f93d90ed tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:35.599085 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.neutron [None req-1bb237cd-bf49-42fa-bc3e-6fd1777b1d62 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] validate_networks() for None {{(pid=122699) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:34:35.880949 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-139fd758-989c-42f0-9011-eb21f93d90ed tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3135a00fc94e488cb633b89d8768fe93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332a996884724d9eb16c79f46107c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:35.890912 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-139fd758-989c-42f0-9011-eb21f93d90ed tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] 10.222.0.33 "GET /compute/v2.1/servers/e5237b14-ce44-43de-ab20-e6e456def723" status: 200 len: 1525 microversion: 2.1 time: 0.371156 Sep 23 04:34:35.894600 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 470/1004] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:35 2022] GET /compute/v2.1/servers/e5237b14-ce44-43de-ab20-e6e456def723 => generated 1525 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:35.899575 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8920b9cf-4dc3-48ca-a01a-c5bbd41fabaa tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:35.902372 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8920b9cf-4dc3-48ca-a01a-c5bbd41fabaa tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 205bf02b-1478-4765-b2a6-d7014d9f0a64] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:35.917913 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8920b9cf-4dc3-48ca-a01a-c5bbd41fabaa tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:35.918683 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8920b9cf-4dc3-48ca-a01a-c5bbd41fabaa tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:35.919286 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8920b9cf-4dc3-48ca-a01a-c5bbd41fabaa tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:35.920318 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8920b9cf-4dc3-48ca-a01a-c5bbd41fabaa tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:35.922070 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8920b9cf-4dc3-48ca-a01a-c5bbd41fabaa tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:35.922875 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8920b9cf-4dc3-48ca-a01a-c5bbd41fabaa tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:36.033920 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-1bb237cd-bf49-42fa-bc3e-6fd1777b1d62 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Flavor limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:34:36.035055 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-1bb237cd-bf49-42fa-bc3e-6fd1777b1d62 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Image limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:34:36.035721 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-1bb237cd-bf49-42fa-bc3e-6fd1777b1d62 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Flavor pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:34:36.036257 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-1bb237cd-bf49-42fa-bc3e-6fd1777b1d62 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Image pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:34:36.036790 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-1bb237cd-bf49-42fa-bc3e-6fd1777b1d62 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:34:36.050242 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1bb237cd-bf49-42fa-bc3e-6fd1777b1d62 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:36.050848 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1bb237cd-bf49-42fa-bc3e-6fd1777b1d62 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:36.051365 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1bb237cd-bf49-42fa-bc3e-6fd1777b1d62 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:36.052197 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1bb237cd-bf49-42fa-bc3e-6fd1777b1d62 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:36.052910 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1bb237cd-bf49-42fa-bc3e-6fd1777b1d62 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:36.054348 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1bb237cd-bf49-42fa-bc3e-6fd1777b1d62 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:36.075884 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-1bb237cd-bf49-42fa-bc3e-6fd1777b1d62 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Getting quotas for project 54abd267d3c043e09f26f486823907e2. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:34:36.094408 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-1bb237cd-bf49-42fa-bc3e-6fd1777b1d62 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Getting quotas for user 13f5a913548445a09377847fd78a10a1 and project 54abd267d3c043e09f26f486823907e2. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:34:36.111335 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1bb237cd-bf49-42fa-bc3e-6fd1777b1d62 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Going to run 1 instances... {{(pid=122699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:34:36.113743 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1bb237cd-bf49-42fa-bc3e-6fd1777b1d62 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: fbbf8d58-8edb-4172-9d19-4b82804bf8e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:34:36.148376 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8920b9cf-4dc3-48ca-a01a-c5bbd41fabaa tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:36.161509 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8920b9cf-4dc3-48ca-a01a-c5bbd41fabaa tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:36.163610 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8920b9cf-4dc3-48ca-a01a-c5bbd41fabaa tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:36.165243 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8920b9cf-4dc3-48ca-a01a-c5bbd41fabaa tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/205bf02b-1478-4765-b2a6-d7014d9f0a64" status: 200 len: 1815 microversion: 2.25 time: 0.269429 Sep 23 04:34:36.183103 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 471/1005] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:34:35 2022] GET /compute/v2.1/servers/205bf02b-1478-4765-b2a6-d7014d9f0a64 => generated 1815 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:34:36.194257 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-97abcb64-cc8f-4806-8287-e8959457536e tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:36.195175 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-97abcb64-cc8f-4806-8287-e8959457536e tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] [instance: f392741f-f967-4c1c-930b-4eea7272bf64] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:36.202521 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-97abcb64-cc8f-4806-8287-e8959457536e tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:36.204371 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-97abcb64-cc8f-4806-8287-e8959457536e tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:36.205336 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-97abcb64-cc8f-4806-8287-e8959457536e tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:36.206290 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-97abcb64-cc8f-4806-8287-e8959457536e tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:36.206822 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-97abcb64-cc8f-4806-8287-e8959457536e tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:36.207365 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-97abcb64-cc8f-4806-8287-e8959457536e tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:36.265868 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1bb237cd-bf49-42fa-bc3e-6fd1777b1d62 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.772732 Sep 23 04:34:36.269628 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 535/1006] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:34:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 776 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:34:36.283011 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ac5eed3b-a275-4e12-b1c4-49b5149e412c tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:36.285931 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ac5eed3b-a275-4e12-b1c4-49b5149e412c tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: fbbf8d58-8edb-4172-9d19-4b82804bf8e9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:36.445566 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ac5eed3b-a275-4e12-b1c4-49b5149e412c tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:36.466378 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ac5eed3b-a275-4e12-b1c4-49b5149e412c tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/fbbf8d58-8edb-4172-9d19-4b82804bf8e9" status: 200 len: 1278 microversion: 2.1 time: 0.190894 Sep 23 04:34:36.481832 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 536/1007] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:36 2022] GET /compute/v2.1/servers/fbbf8d58-8edb-4172-9d19-4b82804bf8e9 => generated 1278 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:36.501985 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a17bfa1e-17d3-45f5-b292-cbf135ff53c1 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:36.507757 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a17bfa1e-17d3-45f5-b292-cbf135ff53c1 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] [instance: 70213e65-9664-4df1-81d7-747c462fa434] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:36.519332 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-97abcb64-cc8f-4806-8287-e8959457536e tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c82752e1bc4fdb82e7f8391c7c129f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44352a7a6d964530aa20ae83064b02e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:36.528464 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-97abcb64-cc8f-4806-8287-e8959457536e tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] 10.222.0.33 "GET /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64" status: 200 len: 1472 microversion: 2.1 time: 0.343841 Sep 23 04:34:36.538425 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 472/1008] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:36 2022] GET /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64 => generated 1472 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:36.538425 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c464754e-1265-4d69-ad71-618660f340e0 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:36.538425 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c464754e-1265-4d69-ad71-618660f340e0 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: 36165f99-56fa-427b-98b4-c79d41f1fe28] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:36.552715 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a17bfa1e-17d3-45f5-b292-cbf135ff53c1 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:36.553462 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a17bfa1e-17d3-45f5-b292-cbf135ff53c1 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:36.554143 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a17bfa1e-17d3-45f5-b292-cbf135ff53c1 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:36.555075 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a17bfa1e-17d3-45f5-b292-cbf135ff53c1 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:36.555739 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a17bfa1e-17d3-45f5-b292-cbf135ff53c1 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:36.556385 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a17bfa1e-17d3-45f5-b292-cbf135ff53c1 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:36.560176 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c464754e-1265-4d69-ad71-618660f340e0 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:36.560683 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c464754e-1265-4d69-ad71-618660f340e0 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:36.561124 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c464754e-1265-4d69-ad71-618660f340e0 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:36.561838 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c464754e-1265-4d69-ad71-618660f340e0 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:36.562326 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c464754e-1265-4d69-ad71-618660f340e0 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:36.562751 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c464754e-1265-4d69-ad71-618660f340e0 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:36.596941 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-a17bfa1e-17d3-45f5-b292-cbf135ff53c1 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] HTTP exception thrown: Instance 70213e65-9664-4df1-81d7-747c462fa434 could not be found. Sep 23 04:34:36.604817 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a17bfa1e-17d3-45f5-b292-cbf135ff53c1 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Request method failure captured: Sep 23 04:34:36.604817 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/70213e65-9664-4df1-81d7-747c462fa434 HTTP/1.1 Sep 23 04:34:36.604817 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:34:36.604817 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:34:36.604817 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:34:36.604817 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:34:36.604817 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:34:36.604817 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:34:36.604817 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:34:36.604817 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:34:36.604817 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTbyr0QAWrNVBHBdYJI8ZB0I-MdaPhfBbuUHn552mhoNCE7FKWgFrVCPdLHp6_RRB3WtJZFMjVi5D-2nEiDXiwHI2K_DZsxDzKWxHer_EllxjXQnw6BXm5Ybxb7rX2EwQmmXg-jSYoOTZeH1scJiFODZiqnLNODjjnbExkCpCsbMjKE Sep 23 04:34:36.604817 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:34:36.604817 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:34:36.604817 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:34:36.604817 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:34:36.604817 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:34:36.604817 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:34:36.604817 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: f98e78e2969a446b8fdbf772b36dd0c3 Sep 23 04:34:36.604817 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ImagesOneServerTestJSON-405748545 Sep 23 04:34:36.604817 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:34:36.604817 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:34:36.606219 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f98e78e2969a446b8fdbf772b36dd0c3", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f98e78e2969a446b8fdbf772b36dd0c3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f98e78e2969a446b8fdbf772b36dd0c3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f98e78e2969a446b8fdbf772b36dd0c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:34:36.606219 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ImagesOneServerTestJSON-405748545 Sep 23 04:34:36.606219 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: f98e78e2969a446b8fdbf772b36dd0c3 Sep 23 04:34:36.606219 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-405748545 Sep 23 04:34:36.606219 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ImagesOneServerTestJSON-405748545-project Sep 23 04:34:36.606219 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:34:36.606219 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:34:36.606219 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: cb3ff8d26a3f4831b3ec766bea65e143 Sep 23 04:34:36.606219 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ImagesOneServerTestJSON-405748545-project Sep 23 04:34:36.606219 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:34:36.606219 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 70213e65-9664-4df1-81d7-747c462fa434 could not be found. Sep 23 04:34:36.606219 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '70213e65-9664-4df1-81d7-747c462fa434'} Sep 23 04:34:36.606959 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:34:36.606959 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:34:36.606959 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:34:36.606959 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:34:36.606959 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:34:36.606959 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:34:36.606959 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:34:36.606959 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:34:36.606959 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:34:36.606959 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:34:36.606959 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70213e65-9664-4df1-81d7-747c462fa434 could not be found. Sep 23 04:34:36.606959 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:34:36.606959 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:34:36.606959 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:34:36.606959 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:34:36.606959 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:34:36.606959 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:34:36.606959 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:34:36.606959 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:34:36.606959 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:34:36.608262 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:34:36.608262 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:34:36.608262 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:34:36.608262 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:34:36.608262 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:34:36.608262 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:34:36.608262 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:34:36.608262 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70213e65-9664-4df1-81d7-747c462fa434 could not be found. Sep 23 04:34:36.608262 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:34:36.608262 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:34:36.608262 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:34:36.608262 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:34:36.608262 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:34:36.608262 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:34:36.608262 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:34:36.608262 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:34:36.608262 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70213e65-9664-4df1-81d7-747c462fa434 could not be found. Sep 23 04:34:36.608262 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:34:36.613045 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a17bfa1e-17d3-45f5-b292-cbf135ff53c1 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] Returning 404 to user: Instance 70213e65-9664-4df1-81d7-747c462fa434 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:34:36.614925 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a17bfa1e-17d3-45f5-b292-cbf135ff53c1 tempest-ImagesOneServerTestJSON-405748545 tempest-ImagesOneServerTestJSON-405748545-project] 10.222.0.33 "GET /compute/v2.1/servers/70213e65-9664-4df1-81d7-747c462fa434" status: 404 len: 111 microversion: 2.1 time: 0.126737 Sep 23 04:34:36.618731 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 537/1009] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:36 2022] GET /compute/v2.1/servers/70213e65-9664-4df1-81d7-747c462fa434 => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:34:36.837186 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c464754e-1265-4d69-ad71-618660f340e0 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:36.846625 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c464754e-1265-4d69-ad71-618660f340e0 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/36165f99-56fa-427b-98b4-c79d41f1fe28" status: 200 len: 1311 microversion: 2.1 time: 0.314822 Sep 23 04:34:36.847223 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 473/1010] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:36 2022] GET /compute/v2.1/servers/36165f99-56fa-427b-98b4-c79d41f1fe28 => generated 1311 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:36.871614 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a7f2deb9-e65c-437d-9357-21659e2e1775 tempest-ServicesAdminNegativeTestJSON-1594495081 tempest-ServicesAdminNegativeTestJSON-1594495081-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:36.875215 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a7f2deb9-e65c-437d-9357-21659e2e1775 tempest-ServicesAdminNegativeTestJSON-1594495081 tempest-ServicesAdminNegativeTestJSON-1594495081-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:36.875697 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a7f2deb9-e65c-437d-9357-21659e2e1775 tempest-ServicesAdminNegativeTestJSON-1594495081 tempest-ServicesAdminNegativeTestJSON-1594495081-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:36.876322 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a7f2deb9-e65c-437d-9357-21659e2e1775 tempest-ServicesAdminNegativeTestJSON-1594495081 tempest-ServicesAdminNegativeTestJSON-1594495081-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:36.877049 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a7f2deb9-e65c-437d-9357-21659e2e1775 tempest-ServicesAdminNegativeTestJSON-1594495081 tempest-ServicesAdminNegativeTestJSON-1594495081-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:36.877571 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a7f2deb9-e65c-437d-9357-21659e2e1775 tempest-ServicesAdminNegativeTestJSON-1594495081 tempest-ServicesAdminNegativeTestJSON-1594495081-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:36.878015 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a7f2deb9-e65c-437d-9357-21659e2e1775 tempest-ServicesAdminNegativeTestJSON-1594495081 tempest-ServicesAdminNegativeTestJSON-1594495081-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:36.883694 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:34:36.903708 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a7f2deb9-e65c-437d-9357-21659e2e1775 tempest-ServicesAdminNegativeTestJSON-1594495081 tempest-ServicesAdminNegativeTestJSON-1594495081-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.209718 Sep 23 04:34:36.904294 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 538/1011] 10.222.0.33 () {58 vars in 1137 bytes} [Fri Sep 23 04:34:36 2022] GET /compute/v2.1/os-services => generated 944 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:34:36.915904 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ea882c93-795e-4e4d-a5a7-7716bb3670a9 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:36.915904 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-ea882c93-795e-4e4d-a5a7-7716bb3670a9 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] [instance: e5237b14-ce44-43de-ab20-e6e456def723] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:36.916507 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-fe1f74bb-6d57-47f6-bbb6-5d6fdcaa76a1 tempest-ServicesAdminNegativeTestJSON-1594495081 tempest-ServicesAdminNegativeTestJSON-1594495081-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:36.920162 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fe1f74bb-6d57-47f6-bbb6-5d6fdcaa76a1 tempest-ServicesAdminNegativeTestJSON-1594495081 tempest-ServicesAdminNegativeTestJSON-1594495081-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:36.920640 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fe1f74bb-6d57-47f6-bbb6-5d6fdcaa76a1 tempest-ServicesAdminNegativeTestJSON-1594495081 tempest-ServicesAdminNegativeTestJSON-1594495081-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:36.921076 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fe1f74bb-6d57-47f6-bbb6-5d6fdcaa76a1 tempest-ServicesAdminNegativeTestJSON-1594495081 tempest-ServicesAdminNegativeTestJSON-1594495081-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:36.921675 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ea882c93-795e-4e4d-a5a7-7716bb3670a9 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:36.921787 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fe1f74bb-6d57-47f6-bbb6-5d6fdcaa76a1 tempest-ServicesAdminNegativeTestJSON-1594495081 tempest-ServicesAdminNegativeTestJSON-1594495081-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:36.922237 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ea882c93-795e-4e4d-a5a7-7716bb3670a9 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:36.922368 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fe1f74bb-6d57-47f6-bbb6-5d6fdcaa76a1 tempest-ServicesAdminNegativeTestJSON-1594495081 tempest-ServicesAdminNegativeTestJSON-1594495081-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:36.922672 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ea882c93-795e-4e4d-a5a7-7716bb3670a9 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:36.922783 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fe1f74bb-6d57-47f6-bbb6-5d6fdcaa76a1 tempest-ServicesAdminNegativeTestJSON-1594495081 tempest-ServicesAdminNegativeTestJSON-1594495081-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:36.923353 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ea882c93-795e-4e4d-a5a7-7716bb3670a9 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:36.923807 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ea882c93-795e-4e4d-a5a7-7716bb3670a9 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:36.924229 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ea882c93-795e-4e4d-a5a7-7716bb3670a9 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:36.946384 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-fe1f74bb-6d57-47f6-bbb6-5d6fdcaa76a1 tempest-ServicesAdminNegativeTestJSON-1594495081 tempest-ServicesAdminNegativeTestJSON-1594495081-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.033387 Sep 23 04:34:36.955690 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 539/1012] 10.222.0.33 () {58 vars in 1170 bytes} [Fri Sep 23 04:34:36 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 944 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:34:36.960368 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7cab7b01-91fe-4d87-a6f7-40635436022a tempest-ServicesAdminNegativeTestJSON-1594495081 tempest-ServicesAdminNegativeTestJSON-1594495081-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:36.964077 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7cab7b01-91fe-4d87-a6f7-40635436022a tempest-ServicesAdminNegativeTestJSON-1594495081 tempest-ServicesAdminNegativeTestJSON-1594495081-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:36.964819 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7cab7b01-91fe-4d87-a6f7-40635436022a tempest-ServicesAdminNegativeTestJSON-1594495081 tempest-ServicesAdminNegativeTestJSON-1594495081-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:36.965430 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7cab7b01-91fe-4d87-a6f7-40635436022a tempest-ServicesAdminNegativeTestJSON-1594495081 tempest-ServicesAdminNegativeTestJSON-1594495081-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:36.966017 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7cab7b01-91fe-4d87-a6f7-40635436022a tempest-ServicesAdminNegativeTestJSON-1594495081 tempest-ServicesAdminNegativeTestJSON-1594495081-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:36.966548 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7cab7b01-91fe-4d87-a6f7-40635436022a tempest-ServicesAdminNegativeTestJSON-1594495081 tempest-ServicesAdminNegativeTestJSON-1594495081-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:36.966976 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7cab7b01-91fe-4d87-a6f7-40635436022a tempest-ServicesAdminNegativeTestJSON-1594495081 tempest-ServicesAdminNegativeTestJSON-1594495081-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:36.992751 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-7cab7b01-91fe-4d87-a6f7-40635436022a tempest-ServicesAdminNegativeTestJSON-1594495081 tempest-ServicesAdminNegativeTestJSON-1594495081-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.035168 Sep 23 04:34:37.000556 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 540/1013] 10.222.0.33 () {58 vars in 1137 bytes} [Fri Sep 23 04:34:36 2022] GET /compute/v2.1/os-services => generated 944 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:34:37.006910 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6d2c382b-9d52-4fbd-aa84-8f4d06deafd0 tempest-ServicesAdminNegativeTestJSON-1594495081 tempest-ServicesAdminNegativeTestJSON-1594495081-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:37.011837 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6d2c382b-9d52-4fbd-aa84-8f4d06deafd0 tempest-ServicesAdminNegativeTestJSON-1594495081 tempest-ServicesAdminNegativeTestJSON-1594495081-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:37.012693 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6d2c382b-9d52-4fbd-aa84-8f4d06deafd0 tempest-ServicesAdminNegativeTestJSON-1594495081 tempest-ServicesAdminNegativeTestJSON-1594495081-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:37.013463 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6d2c382b-9d52-4fbd-aa84-8f4d06deafd0 tempest-ServicesAdminNegativeTestJSON-1594495081 tempest-ServicesAdminNegativeTestJSON-1594495081-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:37.014634 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6d2c382b-9d52-4fbd-aa84-8f4d06deafd0 tempest-ServicesAdminNegativeTestJSON-1594495081 tempest-ServicesAdminNegativeTestJSON-1594495081-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:37.015461 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6d2c382b-9d52-4fbd-aa84-8f4d06deafd0 tempest-ServicesAdminNegativeTestJSON-1594495081 tempest-ServicesAdminNegativeTestJSON-1594495081-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:37.016060 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6d2c382b-9d52-4fbd-aa84-8f4d06deafd0 tempest-ServicesAdminNegativeTestJSON-1594495081 tempest-ServicesAdminNegativeTestJSON-1594495081-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:37.041236 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6d2c382b-9d52-4fbd-aa84-8f4d06deafd0 tempest-ServicesAdminNegativeTestJSON-1594495081 tempest-ServicesAdminNegativeTestJSON-1594495081-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?host=n-d-846463-3&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.039157 Sep 23 04:34:37.042523 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 541/1014] 10.222.0.33 () {58 vars in 1194 bytes} [Fri Sep 23 04:34:37 2022] GET /compute/v2.1/os-services?host=n-d-846463-3&binary=xxx => generated 16 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 04:34:37.056058 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2e523388-3bab-4e3c-b3c7-aef805b1d96e tempest-ServicesAdminNegativeTestJSON-1594495081 tempest-ServicesAdminNegativeTestJSON-1594495081-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:37.060387 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2e523388-3bab-4e3c-b3c7-aef805b1d96e tempest-ServicesAdminNegativeTestJSON-1594495081 tempest-ServicesAdminNegativeTestJSON-1594495081-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:37.061107 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2e523388-3bab-4e3c-b3c7-aef805b1d96e tempest-ServicesAdminNegativeTestJSON-1594495081 tempest-ServicesAdminNegativeTestJSON-1594495081-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:37.061707 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2e523388-3bab-4e3c-b3c7-aef805b1d96e tempest-ServicesAdminNegativeTestJSON-1594495081 tempest-ServicesAdminNegativeTestJSON-1594495081-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:37.062696 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2e523388-3bab-4e3c-b3c7-aef805b1d96e tempest-ServicesAdminNegativeTestJSON-1594495081 tempest-ServicesAdminNegativeTestJSON-1594495081-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:37.063390 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2e523388-3bab-4e3c-b3c7-aef805b1d96e tempest-ServicesAdminNegativeTestJSON-1594495081 tempest-ServicesAdminNegativeTestJSON-1594495081-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:37.063989 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2e523388-3bab-4e3c-b3c7-aef805b1d96e tempest-ServicesAdminNegativeTestJSON-1594495081 tempest-ServicesAdminNegativeTestJSON-1594495081-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:37.091788 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2e523388-3bab-4e3c-b3c7-aef805b1d96e tempest-ServicesAdminNegativeTestJSON-1594495081 tempest-ServicesAdminNegativeTestJSON-1594495081-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.039302 Sep 23 04:34:37.092645 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 542/1015] 10.222.0.33 () {58 vars in 1137 bytes} [Fri Sep 23 04:34:37 2022] GET /compute/v2.1/os-services => generated 944 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:34:37.102280 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-d76ce84e-6b46-49e5-8eea-f2b64221dea1 req-686cc3d6-313e-4e8c-99f6-f348c4be36fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36165f99-56fa-427b-98b4-c79d41f1fe28", "tag": "0d971d87-a72a-48a8-adf7-e1b2b7f60e03"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:34:37.112968 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-d76ce84e-6b46-49e5-8eea-f2b64221dea1 req-686cc3d6-313e-4e8c-99f6-f348c4be36fe service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:37.113469 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-d76ce84e-6b46-49e5-8eea-f2b64221dea1 req-686cc3d6-313e-4e8c-99f6-f348c4be36fe service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:37.116214 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-d76ce84e-6b46-49e5-8eea-f2b64221dea1 req-686cc3d6-313e-4e8c-99f6-f348c4be36fe service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:37.126415 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-d76ce84e-6b46-49e5-8eea-f2b64221dea1 req-686cc3d6-313e-4e8c-99f6-f348c4be36fe service nova] Creating event network-changed:0d971d87-a72a-48a8-adf7-e1b2b7f60e03 for instance 36165f99-56fa-427b-98b4-c79d41f1fe28 on n-h2-846463-3 Sep 23 04:34:37.131377 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-d76ce84e-6b46-49e5-8eea-f2b64221dea1 req-686cc3d6-313e-4e8c-99f6-f348c4be36fe service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036155 Sep 23 04:34:37.132173 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 543/1016] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:34:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:34:37.137844 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8ac42305-3903-44c3-8b95-78ac62318845 tempest-ServicesAdminNegativeTestJSON-1594495081 tempest-ServicesAdminNegativeTestJSON-1594495081-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:37.141943 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8ac42305-3903-44c3-8b95-78ac62318845 tempest-ServicesAdminNegativeTestJSON-1594495081 tempest-ServicesAdminNegativeTestJSON-1594495081-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:37.142447 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8ac42305-3903-44c3-8b95-78ac62318845 tempest-ServicesAdminNegativeTestJSON-1594495081 tempest-ServicesAdminNegativeTestJSON-1594495081-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:37.145670 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ea882c93-795e-4e4d-a5a7-7716bb3670a9 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3135a00fc94e488cb633b89d8768fe93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332a996884724d9eb16c79f46107c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:37.146176 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8ac42305-3903-44c3-8b95-78ac62318845 tempest-ServicesAdminNegativeTestJSON-1594495081 tempest-ServicesAdminNegativeTestJSON-1594495081-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:37.148014 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8ac42305-3903-44c3-8b95-78ac62318845 tempest-ServicesAdminNegativeTestJSON-1594495081 tempest-ServicesAdminNegativeTestJSON-1594495081-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:37.148634 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8ac42305-3903-44c3-8b95-78ac62318845 tempest-ServicesAdminNegativeTestJSON-1594495081 tempest-ServicesAdminNegativeTestJSON-1594495081-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:37.150224 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8ac42305-3903-44c3-8b95-78ac62318845 tempest-ServicesAdminNegativeTestJSON-1594495081 tempest-ServicesAdminNegativeTestJSON-1594495081-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:37.156701 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ea882c93-795e-4e4d-a5a7-7716bb3670a9 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] 10.222.0.33 "GET /compute/v2.1/servers/e5237b14-ce44-43de-ab20-e6e456def723" status: 200 len: 1525 microversion: 2.1 time: 0.245797 Sep 23 04:34:37.157931 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 474/1017] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:36 2022] GET /compute/v2.1/servers/e5237b14-ce44-43de-ab20-e6e456def723 => generated 1525 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:37.184832 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-8ac42305-3903-44c3-8b95-78ac62318845 tempest-ServicesAdminNegativeTestJSON-1594495081 tempest-ServicesAdminNegativeTestJSON-1594495081-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.051075 Sep 23 04:34:37.185352 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 544/1018] 10.222.0.33 () {58 vars in 1198 bytes} [Fri Sep 23 04:34:37 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 04:34:37.203456 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-cbd4cc6e-72ef-431d-b3f7-f2e9311c0068 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:37.203924 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-cbd4cc6e-72ef-431d-b3f7-f2e9311c0068 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 205bf02b-1478-4765-b2a6-d7014d9f0a64] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:37.210658 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cbd4cc6e-72ef-431d-b3f7-f2e9311c0068 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:37.211145 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cbd4cc6e-72ef-431d-b3f7-f2e9311c0068 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:37.211576 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cbd4cc6e-72ef-431d-b3f7-f2e9311c0068 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:37.212269 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cbd4cc6e-72ef-431d-b3f7-f2e9311c0068 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:37.212720 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cbd4cc6e-72ef-431d-b3f7-f2e9311c0068 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:37.213165 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cbd4cc6e-72ef-431d-b3f7-f2e9311c0068 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:37.420218 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a32b0dff-c9a8-4c62-918f-793064cf260d tempest-ServicesAdminNegativeTestJSON-1956850210 tempest-ServicesAdminNegativeTestJSON-1956850210-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:37.424156 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a32b0dff-c9a8-4c62-918f-793064cf260d tempest-ServicesAdminNegativeTestJSON-1956850210 tempest-ServicesAdminNegativeTestJSON-1956850210-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'a311c347c7604028af35790eb85b0303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37be1f9a1ae41a88dce172b6a346978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:37.429036 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-cbd4cc6e-72ef-431d-b3f7-f2e9311c0068 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:37.441985 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a32b0dff-c9a8-4c62-918f-793064cf260d tempest-ServicesAdminNegativeTestJSON-1956850210 tempest-ServicesAdminNegativeTestJSON-1956850210-project] Request method failure captured: Sep 23 04:34:37.441985 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/os-services HTTP/1.1 Sep 23 04:34:37.441985 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:34:37.441985 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:34:37.441985 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:34:37.441985 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:34:37.441985 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:34:37.441985 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:34:37.441985 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:34:37.441985 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:34:37.441985 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTdb8zxWqZEm2HVVoUn-l6Xv4CfyeKRnVi4o7_1N5VXiHaJn20XSp97qYsOWfNgO4i2T4RlRm2FwAhXZ_UelJClBOq-G8n9hTFls-bcKwcszaLU1UmfPDDGpCsC8CF7rA2mj37fPzeWJO_dUlMzX1IxKlrijJaSaLIq7zhZsCoErf8s Sep 23 04:34:37.441985 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:34:37.441985 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:34:37.441985 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:34:37.441985 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:34:37.441985 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:34:37.441985 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:34:37.441985 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: e37be1f9a1ae41a88dce172b6a346978 Sep 23 04:34:37.441985 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-1956850210 Sep 23 04:34:37.441985 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:34:37.441985 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:34:37.443589 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e37be1f9a1ae41a88dce172b6a346978", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e37be1f9a1ae41a88dce172b6a346978"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e37be1f9a1ae41a88dce172b6a346978"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e37be1f9a1ae41a88dce172b6a346978"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:34:37.443589 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-1956850210 Sep 23 04:34:37.443589 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: e37be1f9a1ae41a88dce172b6a346978 Sep 23 04:34:37.443589 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-1956850210 Sep 23 04:34:37.443589 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ServicesAdminNegativeTestJSON-1956850210-project Sep 23 04:34:37.443589 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:34:37.443589 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:34:37.443589 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: a311c347c7604028af35790eb85b0303 Sep 23 04:34:37.443589 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-1956850210-project Sep 23 04:34:37.443589 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:34:37.443589 n-d-846463-3 devstack@n-api.service[122698]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 23 04:34:37.443589 n-d-846463-3 devstack@n-api.service[122698]: action_args: {} Sep 23 04:34:37.444692 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:34:37.444692 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:34:37.444692 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:34:37.444692 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:34:37.444692 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:34:37.444692 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:34:37.444692 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 23 04:34:37.444692 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:34:37.444692 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 23 04:34:37.444692 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:34:37.444692 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:34:37.444692 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:34:37.444692 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Sep 23 04:34:37.444692 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Sep 23 04:34:37.444692 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 23 04:34:37.444692 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 23 04:34:37.444692 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 23 04:34:37.444692 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 23 04:34:37.444692 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 23 04:34:37.446046 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 23 04:34:37.446046 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 23 04:34:37.446046 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise self.value Sep 23 04:34:37.446046 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 23 04:34:37.446046 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 23 04:34:37.446046 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 23 04:34:37.446046 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 23 04:34:37.446046 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 23 04:34:37.446046 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 23 04:34:37.446046 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 23 04:34:37.446046 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:34:37.446046 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:34:37.446046 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:34:37.446046 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:34:37.446046 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:34:37.446046 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:34:37.446046 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 23 04:34:37.446046 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 23 04:34:37.446046 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 23 04:34:37.446046 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:34:37.448189 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a32b0dff-c9a8-4c62-918f-793064cf260d tempest-ServicesAdminNegativeTestJSON-1956850210 tempest-ServicesAdminNegativeTestJSON-1956850210-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:34:37.448189 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a32b0dff-c9a8-4c62-918f-793064cf260d tempest-ServicesAdminNegativeTestJSON-1956850210 tempest-ServicesAdminNegativeTestJSON-1956850210-project] 10.222.0.33 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.245713 Sep 23 04:34:37.448189 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 475/1019] 10.222.0.33 () {58 vars in 1137 bytes} [Fri Sep 23 04:34:37 2022] GET /compute/v2.1/os-services => generated 112 bytes in 247 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:34:37.449254 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-cbd4cc6e-72ef-431d-b3f7-f2e9311c0068 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:37.451590 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-cbd4cc6e-72ef-431d-b3f7-f2e9311c0068 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:37.453177 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-cbd4cc6e-72ef-431d-b3f7-f2e9311c0068 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/205bf02b-1478-4765-b2a6-d7014d9f0a64" status: 200 len: 1815 microversion: 2.25 time: 0.257795 Sep 23 04:34:37.453959 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 545/1020] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:34:37 2022] GET /compute/v2.1/servers/205bf02b-1478-4765-b2a6-d7014d9f0a64 => generated 1815 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:34:37.508808 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0942f05e-02db-4098-99e0-748cee018074 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:37.509764 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-0942f05e-02db-4098-99e0-748cee018074 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: fbbf8d58-8edb-4172-9d19-4b82804bf8e9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:37.557642 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2498fab1-8e6c-4a60-9258-8029267bfd46 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:37.558319 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-2498fab1-8e6c-4a60-9258-8029267bfd46 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] [instance: f392741f-f967-4c1c-930b-4eea7272bf64] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:37.574540 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2498fab1-8e6c-4a60-9258-8029267bfd46 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:37.575767 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2498fab1-8e6c-4a60-9258-8029267bfd46 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:37.577099 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2498fab1-8e6c-4a60-9258-8029267bfd46 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:37.578054 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2498fab1-8e6c-4a60-9258-8029267bfd46 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:37.580801 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2498fab1-8e6c-4a60-9258-8029267bfd46 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:37.582845 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2498fab1-8e6c-4a60-9258-8029267bfd46 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:37.761827 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-0942f05e-02db-4098-99e0-748cee018074 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:37.769949 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0942f05e-02db-4098-99e0-748cee018074 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/fbbf8d58-8edb-4172-9d19-4b82804bf8e9" status: 200 len: 1278 microversion: 2.1 time: 0.265999 Sep 23 04:34:37.771180 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 476/1021] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:37 2022] GET /compute/v2.1/servers/fbbf8d58-8edb-4172-9d19-4b82804bf8e9 => generated 1278 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:37.858079 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2498fab1-8e6c-4a60-9258-8029267bfd46 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c82752e1bc4fdb82e7f8391c7c129f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44352a7a6d964530aa20ae83064b02e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:37.868841 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-bc188253-8efa-4fa3-9e32-ed677b8ce72b tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:37.869089 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2498fab1-8e6c-4a60-9258-8029267bfd46 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] 10.222.0.33 "GET /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64" status: 200 len: 1472 microversion: 2.1 time: 0.316939 Sep 23 04:34:37.869778 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-bc188253-8efa-4fa3-9e32-ed677b8ce72b tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: 36165f99-56fa-427b-98b4-c79d41f1fe28] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:37.869926 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 546/1022] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:37 2022] GET /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64 => generated 1472 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:37.880580 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bc188253-8efa-4fa3-9e32-ed677b8ce72b tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:37.881077 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bc188253-8efa-4fa3-9e32-ed677b8ce72b tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:37.881519 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bc188253-8efa-4fa3-9e32-ed677b8ce72b tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:37.883201 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bc188253-8efa-4fa3-9e32-ed677b8ce72b tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:37.883201 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bc188253-8efa-4fa3-9e32-ed677b8ce72b tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:37.883201 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bc188253-8efa-4fa3-9e32-ed677b8ce72b tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:38.069551 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-bc188253-8efa-4fa3-9e32-ed677b8ce72b tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:38.079515 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-bc188253-8efa-4fa3-9e32-ed677b8ce72b tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/36165f99-56fa-427b-98b4-c79d41f1fe28" status: 200 len: 1311 microversion: 2.1 time: 0.214696 Sep 23 04:34:38.080817 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 477/1023] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:37 2022] GET /compute/v2.1/servers/36165f99-56fa-427b-98b4-c79d41f1fe28 => generated 1311 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:34:38.183933 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-99ded440-b2c7-4fc2-aa11-2d400c6002fd tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:38.184803 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-99ded440-b2c7-4fc2-aa11-2d400c6002fd tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] [instance: e5237b14-ce44-43de-ab20-e6e456def723] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:38.198150 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-99ded440-b2c7-4fc2-aa11-2d400c6002fd tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:38.199762 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-99ded440-b2c7-4fc2-aa11-2d400c6002fd tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:38.200651 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-99ded440-b2c7-4fc2-aa11-2d400c6002fd tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:38.201720 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-99ded440-b2c7-4fc2-aa11-2d400c6002fd tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:38.203042 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-99ded440-b2c7-4fc2-aa11-2d400c6002fd tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:38.204061 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-99ded440-b2c7-4fc2-aa11-2d400c6002fd tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:38.284404 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-99ded440-b2c7-4fc2-aa11-2d400c6002fd tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3135a00fc94e488cb633b89d8768fe93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332a996884724d9eb16c79f46107c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:38.293781 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-99ded440-b2c7-4fc2-aa11-2d400c6002fd tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] 10.222.0.33 "GET /compute/v2.1/servers/e5237b14-ce44-43de-ab20-e6e456def723" status: 200 len: 1483 microversion: 2.1 time: 0.115882 Sep 23 04:34:38.294899 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 547/1024] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:38 2022] GET /compute/v2.1/servers/e5237b14-ce44-43de-ab20-e6e456def723 => generated 1483 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:38.482520 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-168c1e15-9514-4003-b0b4-0ddb2d899a7a tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:38.484094 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-168c1e15-9514-4003-b0b4-0ddb2d899a7a tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 205bf02b-1478-4765-b2a6-d7014d9f0a64] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:38.491885 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-168c1e15-9514-4003-b0b4-0ddb2d899a7a tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:38.492779 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-168c1e15-9514-4003-b0b4-0ddb2d899a7a tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:38.493746 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-168c1e15-9514-4003-b0b4-0ddb2d899a7a tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:38.497171 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-168c1e15-9514-4003-b0b4-0ddb2d899a7a tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:38.498081 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-168c1e15-9514-4003-b0b4-0ddb2d899a7a tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:38.503024 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-168c1e15-9514-4003-b0b4-0ddb2d899a7a tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:38.784105 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-168c1e15-9514-4003-b0b4-0ddb2d899a7a tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:38.797115 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4042f757-d5f3-4383-8ff3-77e72bb21e41 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:38.797722 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4042f757-d5f3-4383-8ff3-77e72bb21e41 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: fbbf8d58-8edb-4172-9d19-4b82804bf8e9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:38.798200 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-168c1e15-9514-4003-b0b4-0ddb2d899a7a tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:38.800090 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-168c1e15-9514-4003-b0b4-0ddb2d899a7a tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:38.801738 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-168c1e15-9514-4003-b0b4-0ddb2d899a7a tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/205bf02b-1478-4765-b2a6-d7014d9f0a64" status: 200 len: 1815 microversion: 2.25 time: 0.324833 Sep 23 04:34:38.802908 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 478/1025] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:34:38 2022] GET /compute/v2.1/servers/205bf02b-1478-4765-b2a6-d7014d9f0a64 => generated 1815 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:34:38.825847 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4042f757-d5f3-4383-8ff3-77e72bb21e41 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:38.829069 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4042f757-d5f3-4383-8ff3-77e72bb21e41 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:38.829790 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4042f757-d5f3-4383-8ff3-77e72bb21e41 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:38.847665 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4042f757-d5f3-4383-8ff3-77e72bb21e41 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:38.847665 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4042f757-d5f3-4383-8ff3-77e72bb21e41 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:38.847665 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4042f757-d5f3-4383-8ff3-77e72bb21e41 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:38.903215 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-db56b8d9-5c25-4abd-b8bd-e8382c5446ba tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:38.904331 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-db56b8d9-5c25-4abd-b8bd-e8382c5446ba tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] [instance: f392741f-f967-4c1c-930b-4eea7272bf64] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:38.913311 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-db56b8d9-5c25-4abd-b8bd-e8382c5446ba tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:38.914207 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-db56b8d9-5c25-4abd-b8bd-e8382c5446ba tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:38.914660 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-db56b8d9-5c25-4abd-b8bd-e8382c5446ba tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:38.915462 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-db56b8d9-5c25-4abd-b8bd-e8382c5446ba tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:38.916011 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-db56b8d9-5c25-4abd-b8bd-e8382c5446ba tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:38.916449 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-db56b8d9-5c25-4abd-b8bd-e8382c5446ba tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:38.927733 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-4042f757-d5f3-4383-8ff3-77e72bb21e41 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:38.936606 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=96,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:34:38.937124 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4042f757-d5f3-4383-8ff3-77e72bb21e41 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/fbbf8d58-8edb-4172-9d19-4b82804bf8e9" status: 200 len: 1274 microversion: 2.1 time: 0.144071 Sep 23 04:34:38.937840 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 548/1026] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:38 2022] GET /compute/v2.1/servers/fbbf8d58-8edb-4172-9d19-4b82804bf8e9 => generated 1274 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:39.087751 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-db56b8d9-5c25-4abd-b8bd-e8382c5446ba tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c82752e1bc4fdb82e7f8391c7c129f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44352a7a6d964530aa20ae83064b02e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:39.104709 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f952293b-ed50-4d1a-aab0-1826c49c46e2 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:39.106097 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f952293b-ed50-4d1a-aab0-1826c49c46e2 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: 36165f99-56fa-427b-98b4-c79d41f1fe28] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:39.110693 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-db56b8d9-5c25-4abd-b8bd-e8382c5446ba tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] 10.222.0.33 "GET /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64" status: 200 len: 1472 microversion: 2.1 time: 0.211856 Sep 23 04:34:39.113979 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 479/1027] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:38 2022] GET /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64 => generated 1472 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:34:39.117520 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f952293b-ed50-4d1a-aab0-1826c49c46e2 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:39.118385 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f952293b-ed50-4d1a-aab0-1826c49c46e2 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:39.121581 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f952293b-ed50-4d1a-aab0-1826c49c46e2 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:39.123620 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f952293b-ed50-4d1a-aab0-1826c49c46e2 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:39.125713 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f952293b-ed50-4d1a-aab0-1826c49c46e2 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:39.132728 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f952293b-ed50-4d1a-aab0-1826c49c46e2 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:39.154971 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-a4b4eaa9-557a-46c7-a8cb-8b0f8f3e3ed3 req-b6f5c0d2-1de4-4cdf-8dc7-2d579f0d202d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5237b14-ce44-43de-ab20-e6e456def723", "name": "network-vif-deleted", "tag": "e1b845e7-999a-4e6a-b939-3cf715e6290e"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:34:39.177529 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-a4b4eaa9-557a-46c7-a8cb-8b0f8f3e3ed3 req-b6f5c0d2-1de4-4cdf-8dc7-2d579f0d202d service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:39.178063 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-a4b4eaa9-557a-46c7-a8cb-8b0f8f3e3ed3 req-b6f5c0d2-1de4-4cdf-8dc7-2d579f0d202d service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:39.178496 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-a4b4eaa9-557a-46c7-a8cb-8b0f8f3e3ed3 req-b6f5c0d2-1de4-4cdf-8dc7-2d579f0d202d service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:39.197181 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-a4b4eaa9-557a-46c7-a8cb-8b0f8f3e3ed3 req-b6f5c0d2-1de4-4cdf-8dc7-2d579f0d202d service nova] Creating event network-vif-deleted:e1b845e7-999a-4e6a-b939-3cf715e6290e for instance e5237b14-ce44-43de-ab20-e6e456def723 on n-h1-846463-3 Sep 23 04:34:39.204132 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-a4b4eaa9-557a-46c7-a8cb-8b0f8f3e3ed3 req-b6f5c0d2-1de4-4cdf-8dc7-2d579f0d202d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054826 Sep 23 04:34:39.217800 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 480/1028] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:34:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:34:39.294462 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f952293b-ed50-4d1a-aab0-1826c49c46e2 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:39.306678 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f952293b-ed50-4d1a-aab0-1826c49c46e2 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/36165f99-56fa-427b-98b4-c79d41f1fe28" status: 200 len: 1311 microversion: 2.1 time: 0.202863 Sep 23 04:34:39.306678 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 549/1029] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:39 2022] GET /compute/v2.1/servers/36165f99-56fa-427b-98b4-c79d41f1fe28 => generated 1311 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:39.322464 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8b77d69f-6acf-4b9f-831b-55d560acb8d2 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:39.323439 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8b77d69f-6acf-4b9f-831b-55d560acb8d2 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] [instance: e5237b14-ce44-43de-ab20-e6e456def723] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:39.330978 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8b77d69f-6acf-4b9f-831b-55d560acb8d2 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:39.331583 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8b77d69f-6acf-4b9f-831b-55d560acb8d2 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:39.332132 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8b77d69f-6acf-4b9f-831b-55d560acb8d2 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:39.332929 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8b77d69f-6acf-4b9f-831b-55d560acb8d2 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:39.333454 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8b77d69f-6acf-4b9f-831b-55d560acb8d2 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:39.333987 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8b77d69f-6acf-4b9f-831b-55d560acb8d2 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:39.367109 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8b77d69f-6acf-4b9f-831b-55d560acb8d2 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:39.367595 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8b77d69f-6acf-4b9f-831b-55d560acb8d2 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:39.372422 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8b77d69f-6acf-4b9f-831b-55d560acb8d2 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:39.372422 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-8b77d69f-6acf-4b9f-831b-55d560acb8d2 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lazy-loading 'fault' on Instance uuid e5237b14-ce44-43de-ab20-e6e456def723 {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:34:39.410101 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8b77d69f-6acf-4b9f-831b-55d560acb8d2 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3135a00fc94e488cb633b89d8768fe93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332a996884724d9eb16c79f46107c6af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:39.417688 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8b77d69f-6acf-4b9f-831b-55d560acb8d2 tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] 10.222.0.33 "GET /compute/v2.1/servers/e5237b14-ce44-43de-ab20-e6e456def723" status: 200 len: 1313 microversion: 2.1 time: 0.099676 Sep 23 04:34:39.418281 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 481/1030] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:39 2022] GET /compute/v2.1/servers/e5237b14-ce44-43de-ab20-e6e456def723 => generated 1313 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:39.831042 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d83b36f4-2f92-41af-a19e-f253be5f5923 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:39.831951 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d83b36f4-2f92-41af-a19e-f253be5f5923 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 205bf02b-1478-4765-b2a6-d7014d9f0a64] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:39.838174 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d83b36f4-2f92-41af-a19e-f253be5f5923 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:39.838783 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d83b36f4-2f92-41af-a19e-f253be5f5923 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:39.839356 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d83b36f4-2f92-41af-a19e-f253be5f5923 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:39.840240 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d83b36f4-2f92-41af-a19e-f253be5f5923 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:39.840707 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d83b36f4-2f92-41af-a19e-f253be5f5923 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:39.841163 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d83b36f4-2f92-41af-a19e-f253be5f5923 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:39.963535 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-442e381d-613e-4130-ba46-3c2286214cd9 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:39.964539 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-442e381d-613e-4130-ba46-3c2286214cd9 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: fbbf8d58-8edb-4172-9d19-4b82804bf8e9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:39.987216 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-442e381d-613e-4130-ba46-3c2286214cd9 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:39.987710 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-442e381d-613e-4130-ba46-3c2286214cd9 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:39.988154 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-442e381d-613e-4130-ba46-3c2286214cd9 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:39.988861 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-442e381d-613e-4130-ba46-3c2286214cd9 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:39.989313 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-442e381d-613e-4130-ba46-3c2286214cd9 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:39.989735 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-442e381d-613e-4130-ba46-3c2286214cd9 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:39.998383 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d83b36f4-2f92-41af-a19e-f253be5f5923 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:40.009504 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d83b36f4-2f92-41af-a19e-f253be5f5923 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:40.011673 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d83b36f4-2f92-41af-a19e-f253be5f5923 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:40.013239 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d83b36f4-2f92-41af-a19e-f253be5f5923 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/205bf02b-1478-4765-b2a6-d7014d9f0a64" status: 200 len: 1815 microversion: 2.25 time: 0.186430 Sep 23 04:34:40.013802 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 550/1031] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:34:39 2022] GET /compute/v2.1/servers/205bf02b-1478-4765-b2a6-d7014d9f0a64 => generated 1815 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:34:40.061023 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-442e381d-613e-4130-ba46-3c2286214cd9 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:40.068501 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-442e381d-613e-4130-ba46-3c2286214cd9 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/fbbf8d58-8edb-4172-9d19-4b82804bf8e9" status: 200 len: 1330 microversion: 2.1 time: 0.112287 Sep 23 04:34:40.069225 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 482/1032] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:39 2022] GET /compute/v2.1/servers/fbbf8d58-8edb-4172-9d19-4b82804bf8e9 => generated 1330 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:40.139875 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-24cc63d4-c935-4419-9820-133f800867b9 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:40.140505 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-24cc63d4-c935-4419-9820-133f800867b9 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] [instance: f392741f-f967-4c1c-930b-4eea7272bf64] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:40.147345 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-24cc63d4-c935-4419-9820-133f800867b9 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:40.147901 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-24cc63d4-c935-4419-9820-133f800867b9 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:40.148561 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-24cc63d4-c935-4419-9820-133f800867b9 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:40.149393 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-24cc63d4-c935-4419-9820-133f800867b9 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:40.150053 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-24cc63d4-c935-4419-9820-133f800867b9 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:40.150487 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-24cc63d4-c935-4419-9820-133f800867b9 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:40.289351 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-06d7af4a-539a-4b5d-903b-1dda2691c24f tempest-AbsoluteLimitsTestJSON-1978101329 tempest-AbsoluteLimitsTestJSON-1978101329-project] Calling method '.version_select at 0x7ff1bbb2fee0>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:40.290245 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-24cc63d4-c935-4419-9820-133f800867b9 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c82752e1bc4fdb82e7f8391c7c129f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44352a7a6d964530aa20ae83064b02e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:40.302459 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-06d7af4a-539a-4b5d-903b-1dda2691c24f tempest-AbsoluteLimitsTestJSON-1978101329 tempest-AbsoluteLimitsTestJSON-1978101329-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:40.303543 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-06d7af4a-539a-4b5d-903b-1dda2691c24f tempest-AbsoluteLimitsTestJSON-1978101329 tempest-AbsoluteLimitsTestJSON-1978101329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:40.304201 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-06d7af4a-539a-4b5d-903b-1dda2691c24f tempest-AbsoluteLimitsTestJSON-1978101329 tempest-AbsoluteLimitsTestJSON-1978101329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:40.304929 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-06d7af4a-539a-4b5d-903b-1dda2691c24f tempest-AbsoluteLimitsTestJSON-1978101329 tempest-AbsoluteLimitsTestJSON-1978101329-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:40.305383 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-06d7af4a-539a-4b5d-903b-1dda2691c24f tempest-AbsoluteLimitsTestJSON-1978101329 tempest-AbsoluteLimitsTestJSON-1978101329-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:40.305833 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-06d7af4a-539a-4b5d-903b-1dda2691c24f tempest-AbsoluteLimitsTestJSON-1978101329 tempest-AbsoluteLimitsTestJSON-1978101329-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:40.314448 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-24cc63d4-c935-4419-9820-133f800867b9 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] 10.222.0.33 "GET /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64" status: 200 len: 1472 microversion: 2.1 time: 0.176869 Sep 23 04:34:40.315157 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 483/1033] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:40 2022] GET /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64 => generated 1472 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:34:40.330309 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-06d7af4a-539a-4b5d-903b-1dda2691c24f tempest-AbsoluteLimitsTestJSON-1978101329 tempest-AbsoluteLimitsTestJSON-1978101329-project] 10.222.0.33 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.227740 Sep 23 04:34:40.338442 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7cebb63f-1d7d-43c5-a45e-93060d7cf493 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:40.338593 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 551/1034] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 23 04:34:40 2022] GET /compute/v2.1/limits => generated 511 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:34:40.339068 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7cebb63f-1d7d-43c5-a45e-93060d7cf493 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: 36165f99-56fa-427b-98b4-c79d41f1fe28] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:40.346926 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7cebb63f-1d7d-43c5-a45e-93060d7cf493 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:40.347433 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7cebb63f-1d7d-43c5-a45e-93060d7cf493 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:40.347872 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7cebb63f-1d7d-43c5-a45e-93060d7cf493 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:40.348623 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7cebb63f-1d7d-43c5-a45e-93060d7cf493 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:40.349081 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7cebb63f-1d7d-43c5-a45e-93060d7cf493 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:40.349511 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7cebb63f-1d7d-43c5-a45e-93060d7cf493 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:40.440920 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d9bb7c48-20cd-4c0c-93c6-74060582e50f tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:40.441848 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d9bb7c48-20cd-4c0c-93c6-74060582e50f tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] [instance: e5237b14-ce44-43de-ab20-e6e456def723] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:40.459762 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d9bb7c48-20cd-4c0c-93c6-74060582e50f tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:40.461590 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d9bb7c48-20cd-4c0c-93c6-74060582e50f tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:40.462300 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d9bb7c48-20cd-4c0c-93c6-74060582e50f tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:40.465083 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d9bb7c48-20cd-4c0c-93c6-74060582e50f tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:40.467134 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d9bb7c48-20cd-4c0c-93c6-74060582e50f tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:40.468415 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d9bb7c48-20cd-4c0c-93c6-74060582e50f tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:40.502890 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-d9bb7c48-20cd-4c0c-93c6-74060582e50f tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] HTTP exception thrown: Instance e5237b14-ce44-43de-ab20-e6e456def723 could not be found. Sep 23 04:34:40.505123 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d9bb7c48-20cd-4c0c-93c6-74060582e50f tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Request method failure captured: Sep 23 04:34:40.505123 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/e5237b14-ce44-43de-ab20-e6e456def723 HTTP/1.1 Sep 23 04:34:40.505123 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:34:40.505123 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:34:40.505123 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:34:40.505123 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:34:40.505123 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:34:40.505123 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:34:40.505123 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:34:40.505123 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:34:40.505123 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTcHNy6q1jovkTYRvB6Nd1Yn75ASiOTXg5P6FWNfMqfZsExkROsoJvfjzTWt1ewBvvhF7GNO3lXnOfc_-N9fOZu-4OBo5IfOZiZ2qxKSq6QkXqeSvVLRZU5bVykPO8lROcxqJSGn1N_UoxXezu6H8y5yxJtWtqmydu-QUKpzUJ2YFUc Sep 23 04:34:40.505123 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:34:40.505123 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:34:40.505123 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:34:40.505123 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:34:40.505123 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:34:40.505123 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:34:40.505123 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 332a996884724d9eb16c79f46107c6af Sep 23 04:34:40.505123 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1298389341 Sep 23 04:34:40.505123 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:34:40.505123 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:34:40.506608 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_332a996884724d9eb16c79f46107c6af", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/332a996884724d9eb16c79f46107c6af"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/332a996884724d9eb16c79f46107c6af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/332a996884724d9eb16c79f46107c6af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:34:40.506608 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1298389341 Sep 23 04:34:40.506608 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 332a996884724d9eb16c79f46107c6af Sep 23 04:34:40.506608 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1298389341 Sep 23 04:34:40.506608 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-FloatingIPsAssociationTestJSON-1298389341-project Sep 23 04:34:40.506608 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:34:40.506608 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:34:40.506608 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 3135a00fc94e488cb633b89d8768fe93 Sep 23 04:34:40.506608 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1298389341-project Sep 23 04:34:40.506608 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:34:40.506608 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance e5237b14-ce44-43de-ab20-e6e456def723 could not be found. Sep 23 04:34:40.506608 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': 'e5237b14-ce44-43de-ab20-e6e456def723'} Sep 23 04:34:40.507454 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:34:40.507454 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:34:40.507454 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:34:40.507454 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:34:40.507454 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:34:40.507454 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:34:40.507454 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:34:40.507454 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:34:40.507454 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:34:40.507454 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:34:40.507454 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5237b14-ce44-43de-ab20-e6e456def723 could not be found. Sep 23 04:34:40.507454 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:34:40.507454 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:34:40.507454 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:34:40.507454 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:34:40.507454 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:34:40.507454 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:34:40.507454 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:34:40.507454 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:34:40.507454 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:34:40.508773 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:34:40.508773 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:34:40.508773 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:34:40.508773 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:34:40.508773 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:34:40.508773 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:34:40.508773 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:34:40.508773 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5237b14-ce44-43de-ab20-e6e456def723 could not be found. Sep 23 04:34:40.508773 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:34:40.508773 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:34:40.508773 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:34:40.508773 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:34:40.508773 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:34:40.508773 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:34:40.508773 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:34:40.508773 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:34:40.508773 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5237b14-ce44-43de-ab20-e6e456def723 could not be found. Sep 23 04:34:40.508773 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:34:40.510055 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d9bb7c48-20cd-4c0c-93c6-74060582e50f tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] Returning 404 to user: Instance e5237b14-ce44-43de-ab20-e6e456def723 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:34:40.511511 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d9bb7c48-20cd-4c0c-93c6-74060582e50f tempest-FloatingIPsAssociationTestJSON-1298389341 tempest-FloatingIPsAssociationTestJSON-1298389341-project] 10.222.0.33 "GET /compute/v2.1/servers/e5237b14-ce44-43de-ab20-e6e456def723" status: 404 len: 111 microversion: 2.1 time: 0.075367 Sep 23 04:34:40.512468 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 552/1035] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:40 2022] GET /compute/v2.1/servers/e5237b14-ce44-43de-ab20-e6e456def723 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 04:34:40.580966 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-7cebb63f-1d7d-43c5-a45e-93060d7cf493 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:40.589946 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7cebb63f-1d7d-43c5-a45e-93060d7cf493 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/36165f99-56fa-427b-98b4-c79d41f1fe28" status: 200 len: 1311 microversion: 2.1 time: 0.255179 Sep 23 04:34:40.601921 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 484/1036] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:40 2022] GET /compute/v2.1/servers/36165f99-56fa-427b-98b4-c79d41f1fe28 => generated 1311 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:41.042238 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f8ea9e1e-70dd-4c2b-9064-2e7c1e669adb tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:41.048164 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f8ea9e1e-70dd-4c2b-9064-2e7c1e669adb tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 205bf02b-1478-4765-b2a6-d7014d9f0a64] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:41.058445 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f8ea9e1e-70dd-4c2b-9064-2e7c1e669adb tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:41.059963 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f8ea9e1e-70dd-4c2b-9064-2e7c1e669adb tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:41.061914 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f8ea9e1e-70dd-4c2b-9064-2e7c1e669adb tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:41.062956 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f8ea9e1e-70dd-4c2b-9064-2e7c1e669adb tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:41.065036 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f8ea9e1e-70dd-4c2b-9064-2e7c1e669adb tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:41.066628 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f8ea9e1e-70dd-4c2b-9064-2e7c1e669adb tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:41.094842 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2e65baee-50eb-4fbd-8766-bff3c79fdf8e tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:41.096741 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-2e65baee-50eb-4fbd-8766-bff3c79fdf8e tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: fbbf8d58-8edb-4172-9d19-4b82804bf8e9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:41.115540 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2e65baee-50eb-4fbd-8766-bff3c79fdf8e tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:41.116057 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2e65baee-50eb-4fbd-8766-bff3c79fdf8e tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:41.124411 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2e65baee-50eb-4fbd-8766-bff3c79fdf8e tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:41.125239 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2e65baee-50eb-4fbd-8766-bff3c79fdf8e tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:41.125732 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2e65baee-50eb-4fbd-8766-bff3c79fdf8e tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:41.133152 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2e65baee-50eb-4fbd-8766-bff3c79fdf8e tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:41.282881 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-2e65baee-50eb-4fbd-8766-bff3c79fdf8e tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:41.292782 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2e65baee-50eb-4fbd-8766-bff3c79fdf8e tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/fbbf8d58-8edb-4172-9d19-4b82804bf8e9" status: 200 len: 1348 microversion: 2.1 time: 0.204129 Sep 23 04:34:41.295572 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 485/1037] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:41 2022] GET /compute/v2.1/servers/fbbf8d58-8edb-4172-9d19-4b82804bf8e9 => generated 1348 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:41.341971 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6e82b4e3-1c56-49fb-bfd0-a2fab2c01377 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:41.341971 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-6e82b4e3-1c56-49fb-bfd0-a2fab2c01377 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] [instance: f392741f-f967-4c1c-930b-4eea7272bf64] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:41.348857 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6e82b4e3-1c56-49fb-bfd0-a2fab2c01377 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:41.350362 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f8ea9e1e-70dd-4c2b-9064-2e7c1e669adb tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:41.351316 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6e82b4e3-1c56-49fb-bfd0-a2fab2c01377 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:41.351865 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6e82b4e3-1c56-49fb-bfd0-a2fab2c01377 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:41.353252 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6e82b4e3-1c56-49fb-bfd0-a2fab2c01377 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:41.356965 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6e82b4e3-1c56-49fb-bfd0-a2fab2c01377 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:41.357501 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6e82b4e3-1c56-49fb-bfd0-a2fab2c01377 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:41.365669 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f8ea9e1e-70dd-4c2b-9064-2e7c1e669adb tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:41.367560 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f8ea9e1e-70dd-4c2b-9064-2e7c1e669adb tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:41.369510 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f8ea9e1e-70dd-4c2b-9064-2e7c1e669adb tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/205bf02b-1478-4765-b2a6-d7014d9f0a64" status: 200 len: 1815 microversion: 2.25 time: 0.332803 Sep 23 04:34:41.373266 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 553/1038] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:34:41 2022] GET /compute/v2.1/servers/205bf02b-1478-4765-b2a6-d7014d9f0a64 => generated 1815 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:34:41.523068 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6e82b4e3-1c56-49fb-bfd0-a2fab2c01377 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c82752e1bc4fdb82e7f8391c7c129f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44352a7a6d964530aa20ae83064b02e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:41.531879 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-6e82b4e3-1c56-49fb-bfd0-a2fab2c01377 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] 10.222.0.33 "GET /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64" status: 200 len: 1472 microversion: 2.1 time: 0.198870 Sep 23 04:34:41.547177 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 486/1039] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:41 2022] GET /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64 => generated 1472 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:34:41.615359 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-27406b51-7916-48d2-b8b6-93fcbce69aff tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:41.616361 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-27406b51-7916-48d2-b8b6-93fcbce69aff tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: 36165f99-56fa-427b-98b4-c79d41f1fe28] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:41.624350 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-27406b51-7916-48d2-b8b6-93fcbce69aff tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:41.625301 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-27406b51-7916-48d2-b8b6-93fcbce69aff tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:41.625738 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-27406b51-7916-48d2-b8b6-93fcbce69aff tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:41.627694 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-27406b51-7916-48d2-b8b6-93fcbce69aff tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:41.627694 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-27406b51-7916-48d2-b8b6-93fcbce69aff tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:41.628427 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-27406b51-7916-48d2-b8b6-93fcbce69aff tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:41.772951 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-27406b51-7916-48d2-b8b6-93fcbce69aff tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:41.781530 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-27406b51-7916-48d2-b8b6-93fcbce69aff tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/36165f99-56fa-427b-98b4-c79d41f1fe28" status: 200 len: 1311 microversion: 2.1 time: 0.170576 Sep 23 04:34:41.782379 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 554/1040] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:41 2022] GET /compute/v2.1/servers/36165f99-56fa-427b-98b4-c79d41f1fe28 => generated 1311 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:42.336374 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f5fbee13-d029-4a85-8140-a01ad5b17dff tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:42.337565 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f5fbee13-d029-4a85-8140-a01ad5b17dff tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: fbbf8d58-8edb-4172-9d19-4b82804bf8e9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:42.358850 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f5fbee13-d029-4a85-8140-a01ad5b17dff tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:42.358850 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f5fbee13-d029-4a85-8140-a01ad5b17dff tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:42.358850 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f5fbee13-d029-4a85-8140-a01ad5b17dff tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:42.358850 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f5fbee13-d029-4a85-8140-a01ad5b17dff tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:42.359316 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f5fbee13-d029-4a85-8140-a01ad5b17dff tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:42.361176 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f5fbee13-d029-4a85-8140-a01ad5b17dff tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:42.399885 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ad0f8c03-295d-4257-b93c-f79faf226775 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:42.400558 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ad0f8c03-295d-4257-b93c-f79faf226775 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 205bf02b-1478-4765-b2a6-d7014d9f0a64] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:42.418808 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ad0f8c03-295d-4257-b93c-f79faf226775 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:42.419402 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ad0f8c03-295d-4257-b93c-f79faf226775 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:42.419857 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ad0f8c03-295d-4257-b93c-f79faf226775 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:42.422296 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ad0f8c03-295d-4257-b93c-f79faf226775 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:42.422945 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ad0f8c03-295d-4257-b93c-f79faf226775 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:42.423399 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ad0f8c03-295d-4257-b93c-f79faf226775 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:42.852656 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f5fbee13-d029-4a85-8140-a01ad5b17dff tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:42.863467 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f5fbee13-d029-4a85-8140-a01ad5b17dff tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/fbbf8d58-8edb-4172-9d19-4b82804bf8e9" status: 200 len: 1378 microversion: 2.1 time: 0.544317 Sep 23 04:34:42.864668 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 487/1041] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:42 2022] GET /compute/v2.1/servers/fbbf8d58-8edb-4172-9d19-4b82804bf8e9 => generated 1378 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:42.885124 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-670c46bc-f7bb-4207-b415-d2df0f3717cf tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:42.885124 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-670c46bc-f7bb-4207-b415-d2df0f3717cf tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] [instance: f392741f-f967-4c1c-930b-4eea7272bf64] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:42.890574 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-670c46bc-f7bb-4207-b415-d2df0f3717cf tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:42.891088 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-670c46bc-f7bb-4207-b415-d2df0f3717cf tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:42.891774 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-670c46bc-f7bb-4207-b415-d2df0f3717cf tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:42.892576 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-670c46bc-f7bb-4207-b415-d2df0f3717cf tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:42.892955 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-670c46bc-f7bb-4207-b415-d2df0f3717cf tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:42.893385 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-670c46bc-f7bb-4207-b415-d2df0f3717cf tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:43.040732 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ad0f8c03-295d-4257-b93c-f79faf226775 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:43.053053 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ad0f8c03-295d-4257-b93c-f79faf226775 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:43.055235 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ad0f8c03-295d-4257-b93c-f79faf226775 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:43.056989 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ad0f8c03-295d-4257-b93c-f79faf226775 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/205bf02b-1478-4765-b2a6-d7014d9f0a64" status: 200 len: 1815 microversion: 2.25 time: 0.662719 Sep 23 04:34:43.070722 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 555/1042] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:34:42 2022] GET /compute/v2.1/servers/205bf02b-1478-4765-b2a6-d7014d9f0a64 => generated 1815 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:34:43.084126 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-baa0442c-fb63-4121-b667-0473f9dcd70f tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:43.085121 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-baa0442c-fb63-4121-b667-0473f9dcd70f tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: 36165f99-56fa-427b-98b4-c79d41f1fe28] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:43.093267 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-baa0442c-fb63-4121-b667-0473f9dcd70f tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:43.094570 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-baa0442c-fb63-4121-b667-0473f9dcd70f tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:43.098366 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-baa0442c-fb63-4121-b667-0473f9dcd70f tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:43.099126 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-baa0442c-fb63-4121-b667-0473f9dcd70f tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:43.105244 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-baa0442c-fb63-4121-b667-0473f9dcd70f tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:43.105244 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-baa0442c-fb63-4121-b667-0473f9dcd70f tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:43.213029 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-670c46bc-f7bb-4207-b415-d2df0f3717cf tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c82752e1bc4fdb82e7f8391c7c129f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44352a7a6d964530aa20ae83064b02e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:43.227165 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-670c46bc-f7bb-4207-b415-d2df0f3717cf tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] 10.222.0.33 "GET /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64" status: 200 len: 1472 microversion: 2.1 time: 0.359476 Sep 23 04:34:43.228191 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 488/1043] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:42 2022] GET /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64 => generated 1472 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:43.235305 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-9836d385-4efb-4969-81fa-c4acaa604288 req-fe719c38-a48d-48bb-89b1-e3884d1c7cd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36165f99-56fa-427b-98b4-c79d41f1fe28", "name": "network-vif-plugged", "status": "completed", "tag": "0d971d87-a72a-48a8-adf7-e1b2b7f60e03"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:34:43.243024 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:34:43.247810 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-9836d385-4efb-4969-81fa-c4acaa604288 req-fe719c38-a48d-48bb-89b1-e3884d1c7cd8 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:43.248310 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-9836d385-4efb-4969-81fa-c4acaa604288 req-fe719c38-a48d-48bb-89b1-e3884d1c7cd8 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:43.248893 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-9836d385-4efb-4969-81fa-c4acaa604288 req-fe719c38-a48d-48bb-89b1-e3884d1c7cd8 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:43.262167 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-9836d385-4efb-4969-81fa-c4acaa604288 req-fe719c38-a48d-48bb-89b1-e3884d1c7cd8 service nova] Creating event network-vif-plugged:0d971d87-a72a-48a8-adf7-e1b2b7f60e03 for instance 36165f99-56fa-427b-98b4-c79d41f1fe28 on n-h2-846463-3 Sep 23 04:34:43.268595 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-9836d385-4efb-4969-81fa-c4acaa604288 req-fe719c38-a48d-48bb-89b1-e3884d1c7cd8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037813 Sep 23 04:34:43.292788 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 489/1044] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:34:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:34:43.392204 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-baa0442c-fb63-4121-b667-0473f9dcd70f tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:43.403367 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-baa0442c-fb63-4121-b667-0473f9dcd70f tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/36165f99-56fa-427b-98b4-c79d41f1fe28" status: 200 len: 1311 microversion: 2.1 time: 0.328445 Sep 23 04:34:43.405090 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 556/1045] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:43 2022] GET /compute/v2.1/servers/36165f99-56fa-427b-98b4-c79d41f1fe28 => generated 1311 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:43.899605 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-749e4de0-d46f-4699-a619-8f7d9ad4efbc tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:43.903792 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-51ac3ba7-f906-4c38-89ce-3c4f424b67cd tempest-ServicesAdminNegativeV253TestJSON-247019988 tempest-ServicesAdminNegativeV253TestJSON-247019988-project-admin] Action: 'update', calling method: .version_select at 0x7ff1bbf93310>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:34:43.905148 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-749e4de0-d46f-4699-a619-8f7d9ad4efbc tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: fbbf8d58-8edb-4172-9d19-4b82804bf8e9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:43.920809 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-51ac3ba7-f906-4c38-89ce-3c4f424b67cd tempest-ServicesAdminNegativeV253TestJSON-247019988 tempest-ServicesAdminNegativeV253TestJSON-247019988-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:43.921460 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-51ac3ba7-f906-4c38-89ce-3c4f424b67cd tempest-ServicesAdminNegativeV253TestJSON-247019988 tempest-ServicesAdminNegativeV253TestJSON-247019988-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:43.921934 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-51ac3ba7-f906-4c38-89ce-3c4f424b67cd tempest-ServicesAdminNegativeV253TestJSON-247019988 tempest-ServicesAdminNegativeV253TestJSON-247019988-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:43.925126 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-749e4de0-d46f-4699-a619-8f7d9ad4efbc tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:43.927873 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-749e4de0-d46f-4699-a619-8f7d9ad4efbc tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:43.929143 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-749e4de0-d46f-4699-a619-8f7d9ad4efbc tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:43.931371 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-749e4de0-d46f-4699-a619-8f7d9ad4efbc tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:43.932100 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-749e4de0-d46f-4699-a619-8f7d9ad4efbc tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:43.934554 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-749e4de0-d46f-4699-a619-8f7d9ad4efbc tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:43.943882 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-51ac3ba7-f906-4c38-89ce-3c4f424b67cd tempest-ServicesAdminNegativeV253TestJSON-247019988 tempest-ServicesAdminNegativeV253TestJSON-247019988-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:43.946068 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-51ac3ba7-f906-4c38-89ce-3c4f424b67cd tempest-ServicesAdminNegativeV253TestJSON-247019988 tempest-ServicesAdminNegativeV253TestJSON-247019988-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:43.946770 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-51ac3ba7-f906-4c38-89ce-3c4f424b67cd tempest-ServicesAdminNegativeV253TestJSON-247019988 tempest-ServicesAdminNegativeV253TestJSON-247019988-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:43.956431 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-51ac3ba7-f906-4c38-89ce-3c4f424b67cd tempest-ServicesAdminNegativeV253TestJSON-247019988 tempest-ServicesAdminNegativeV253TestJSON-247019988-project-admin] HTTP exception thrown: Service 5fd87c4f-1b50-4458-a642-fb5d0f197853 could not be found. Sep 23 04:34:43.958578 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-51ac3ba7-f906-4c38-89ce-3c4f424b67cd tempest-ServicesAdminNegativeV253TestJSON-247019988 tempest-ServicesAdminNegativeV253TestJSON-247019988-project-admin] Request method failure captured: Sep 23 04:34:43.958578 n-d-846463-3 devstack@n-api.service[122698]: request: PUT /compute/v2.1/os-services/5fd87c4f-1b50-4458-a642-fb5d0f197853 HTTP/1.1 Sep 23 04:34:43.958578 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:34:43.958578 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:34:43.958578 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:34:43.958578 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 56 Sep 23 04:34:43.958578 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:34:43.958578 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:34:43.958578 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:34:43.958578 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:34:43.958578 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTdjsHh-12PlMQzVmICkrPGnYqNpl8Nbu6pCIgFH378OMSIDjdaVvcrgbkct3AaJnzCGFKqb6kHrQTzeUugWy3T5R7PmvfE_jExTZCD7jFGvQQUFdvKyjEZnJebSe3jPr5iaYPzwn2ZGPty1Dqi6n1WXCoh6hmGJetnkSuBWDLGEbLM Sep 23 04:34:43.958578 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:34:43.958578 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:34:43.958578 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:34:43.958578 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:34:43.958578 n-d-846463-3 devstack@n-api.service[122698]: X-Openstack-Nova-Api-Version: 2.53 Sep 23 04:34:43.958578 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:34:43.958578 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:34:43.958578 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 8f26b5731ad446feaea320b78fe636d4 Sep 23 04:34:43.958578 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-247019988 Sep 23 04:34:43.958578 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,admin,member Sep 23 04:34:43.958578 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,admin,member Sep 23 04:34:43.960076 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8f26b5731ad446feaea320b78fe636d4", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8f26b5731ad446feaea320b78fe636d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8f26b5731ad446feaea320b78fe636d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8f26b5731ad446feaea320b78fe636d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:34:43.960076 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-247019988 Sep 23 04:34:43.960076 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 8f26b5731ad446feaea320b78fe636d4 Sep 23 04:34:43.960076 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-247019988 Sep 23 04:34:43.960076 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ServicesAdminNegativeV253TestJSON-247019988-project-admin Sep 23 04:34:43.960076 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:34:43.960076 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:34:43.960076 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: f660c7f63b874a968cc096a44a203b1b Sep 23 04:34:43.960076 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-247019988-project-admin Sep 23 04:34:43.960076 n-d-846463-3 devstack@n-api.service[122698]: Sep 23 04:34:43.960076 n-d-846463-3 devstack@n-api.service[122698]: {"status": "disabled", "disabled_reason": "maintenance"} Sep 23 04:34:43.960076 n-d-846463-3 devstack@n-api.service[122698]: method: Sep 23 04:34:43.960076 n-d-846463-3 devstack@n-api.service[122698]: exception: Service 5fd87c4f-1b50-4458-a642-fb5d0f197853 could not be found. Sep 23 04:34:43.960899 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '5fd87c4f-1b50-4458-a642-fb5d0f197853', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Sep 23 04:34:43.960899 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:34:43.960899 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:34:43.960899 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Sep 23 04:34:43.960899 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Sep 23 04:34:43.960899 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 23 04:34:43.960899 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 23 04:34:43.960899 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 23 04:34:43.960899 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:34:43.960899 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:34:43.960899 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:34:43.960899 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:34:43.960899 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Sep 23 04:34:43.960899 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Sep 23 04:34:43.960899 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Sep 23 04:34:43.960899 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Sep 23 04:34:43.960899 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 5fd87c4f-1b50-4458-a642-fb5d0f197853 could not be found. Sep 23 04:34:43.960899 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:34:43.960899 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:34:43.960899 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:34:43.960899 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:34:43.962222 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:34:43.962222 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:34:43.962222 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:34:43.962222 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:34:43.962222 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:34:43.962222 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:34:43.962222 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:34:43.962222 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:34:43.962222 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:34:43.962222 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:34:43.962222 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Sep 23 04:34:43.962222 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:34:43.962222 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 5fd87c4f-1b50-4458-a642-fb5d0f197853 could not be found. Sep 23 04:34:43.962222 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:34:43.962222 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:34:43.962222 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:34:43.962222 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:34:43.962222 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:34:43.962222 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:34:43.962222 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:34:43.963431 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:34:43.963431 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 5fd87c4f-1b50-4458-a642-fb5d0f197853 could not be found. Sep 23 04:34:43.963431 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:34:43.965689 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-51ac3ba7-f906-4c38-89ce-3c4f424b67cd tempest-ServicesAdminNegativeV253TestJSON-247019988 tempest-ServicesAdminNegativeV253TestJSON-247019988-project-admin] Returning 404 to user: Service 5fd87c4f-1b50-4458-a642-fb5d0f197853 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:34:43.966790 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-51ac3ba7-f906-4c38-89ce-3c4f424b67cd tempest-ServicesAdminNegativeV253TestJSON-247019988 tempest-ServicesAdminNegativeV253TestJSON-247019988-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-services/5fd87c4f-1b50-4458-a642-fb5d0f197853" status: 404 len: 110 microversion: 2.53 time: 0.227448 Sep 23 04:34:43.967582 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 490/1046] 10.222.0.33 () {62 vars in 1309 bytes} [Fri Sep 23 04:34:43 2022] PUT /compute/v2.1/os-services/5fd87c4f-1b50-4458-a642-fb5d0f197853 => generated 110 bytes in 229 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 23 04:34:43.977365 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2b844fab-cfca-4657-876a-abc2a157cc6c tempest-ServicesAdminNegativeV253TestJSON-247019988 tempest-ServicesAdminNegativeV253TestJSON-247019988-project-admin] Action: 'update', calling method: .version_select at 0x7ff1bbf93af0>, body: {"status": "disabled"} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:34:43.982246 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2b844fab-cfca-4657-876a-abc2a157cc6c tempest-ServicesAdminNegativeV253TestJSON-247019988 tempest-ServicesAdminNegativeV253TestJSON-247019988-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:43.982997 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2b844fab-cfca-4657-876a-abc2a157cc6c tempest-ServicesAdminNegativeV253TestJSON-247019988 tempest-ServicesAdminNegativeV253TestJSON-247019988-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:43.983699 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2b844fab-cfca-4657-876a-abc2a157cc6c tempest-ServicesAdminNegativeV253TestJSON-247019988 tempest-ServicesAdminNegativeV253TestJSON-247019988-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:43.991809 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2b844fab-cfca-4657-876a-abc2a157cc6c tempest-ServicesAdminNegativeV253TestJSON-247019988 tempest-ServicesAdminNegativeV253TestJSON-247019988-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:43.992524 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2b844fab-cfca-4657-876a-abc2a157cc6c tempest-ServicesAdminNegativeV253TestJSON-247019988 tempest-ServicesAdminNegativeV253TestJSON-247019988-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:43.993120 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2b844fab-cfca-4657-876a-abc2a157cc6c tempest-ServicesAdminNegativeV253TestJSON-247019988 tempest-ServicesAdminNegativeV253TestJSON-247019988-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:44.000611 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-2b844fab-cfca-4657-876a-abc2a157cc6c tempest-ServicesAdminNegativeV253TestJSON-247019988 tempest-ServicesAdminNegativeV253TestJSON-247019988-project-admin] HTTP exception thrown: Service 5fd87c4f-1b50-4458-a642-fb5d0f197853 could not be found. Sep 23 04:34:44.002366 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2b844fab-cfca-4657-876a-abc2a157cc6c tempest-ServicesAdminNegativeV253TestJSON-247019988 tempest-ServicesAdminNegativeV253TestJSON-247019988-project-admin] Request method failure captured: Sep 23 04:34:44.002366 n-d-846463-3 devstack@n-api.service[122698]: request: PUT /compute/v2.1/os-services/5fd87c4f-1b50-4458-a642-fb5d0f197853 HTTP/1.1 Sep 23 04:34:44.002366 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:34:44.002366 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:34:44.002366 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:34:44.002366 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 22 Sep 23 04:34:44.002366 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:34:44.002366 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:34:44.002366 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:34:44.002366 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:34:44.002366 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTdjsHh-12PlMQzVmICkrPGnYqNpl8Nbu6pCIgFH378OMSIDjdaVvcrgbkct3AaJnzCGFKqb6kHrQTzeUugWy3T5R7PmvfE_jExTZCD7jFGvQQUFdvKyjEZnJebSe3jPr5iaYPzwn2ZGPty1Dqi6n1WXCoh6hmGJetnkSuBWDLGEbLM Sep 23 04:34:44.002366 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:34:44.002366 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:34:44.002366 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:34:44.002366 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:34:44.002366 n-d-846463-3 devstack@n-api.service[122698]: X-Openstack-Nova-Api-Version: 2.53 Sep 23 04:34:44.002366 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:34:44.002366 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:34:44.002366 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 8f26b5731ad446feaea320b78fe636d4 Sep 23 04:34:44.002366 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-247019988 Sep 23 04:34:44.002366 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,admin,member Sep 23 04:34:44.002366 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,admin,member Sep 23 04:34:44.003821 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8f26b5731ad446feaea320b78fe636d4", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8f26b5731ad446feaea320b78fe636d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8f26b5731ad446feaea320b78fe636d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8f26b5731ad446feaea320b78fe636d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:34:44.003821 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-247019988 Sep 23 04:34:44.003821 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 8f26b5731ad446feaea320b78fe636d4 Sep 23 04:34:44.003821 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-247019988 Sep 23 04:34:44.003821 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ServicesAdminNegativeV253TestJSON-247019988-project-admin Sep 23 04:34:44.003821 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:34:44.003821 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:34:44.003821 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: f660c7f63b874a968cc096a44a203b1b Sep 23 04:34:44.003821 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-247019988-project-admin Sep 23 04:34:44.003821 n-d-846463-3 devstack@n-api.service[122698]: Sep 23 04:34:44.003821 n-d-846463-3 devstack@n-api.service[122698]: {"status": "disabled"} Sep 23 04:34:44.003821 n-d-846463-3 devstack@n-api.service[122698]: method: Sep 23 04:34:44.003821 n-d-846463-3 devstack@n-api.service[122698]: exception: Service 5fd87c4f-1b50-4458-a642-fb5d0f197853 could not be found. Sep 23 04:34:44.003821 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '5fd87c4f-1b50-4458-a642-fb5d0f197853', 'body': {'status': 'disabled'}} Sep 23 04:34:44.004656 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:34:44.004656 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:34:44.004656 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Sep 23 04:34:44.004656 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Sep 23 04:34:44.004656 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 23 04:34:44.004656 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 23 04:34:44.004656 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 23 04:34:44.004656 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:34:44.004656 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:34:44.004656 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:34:44.004656 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:34:44.004656 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Sep 23 04:34:44.004656 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Sep 23 04:34:44.004656 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Sep 23 04:34:44.004656 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Sep 23 04:34:44.004656 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 5fd87c4f-1b50-4458-a642-fb5d0f197853 could not be found. Sep 23 04:34:44.004656 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:34:44.004656 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:34:44.004656 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:34:44.004656 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:34:44.004656 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:34:44.005864 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:34:44.005864 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:34:44.005864 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:34:44.005864 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:34:44.005864 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:34:44.005864 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:34:44.005864 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:34:44.005864 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:34:44.005864 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:34:44.005864 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Sep 23 04:34:44.005864 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:34:44.005864 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 5fd87c4f-1b50-4458-a642-fb5d0f197853 could not be found. Sep 23 04:34:44.005864 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:34:44.005864 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:34:44.005864 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:34:44.005864 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:34:44.005864 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:34:44.005864 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:34:44.005864 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:34:44.005864 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:34:44.015113 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 5fd87c4f-1b50-4458-a642-fb5d0f197853 could not be found. Sep 23 04:34:44.015113 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:34:44.015113 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2b844fab-cfca-4657-876a-abc2a157cc6c tempest-ServicesAdminNegativeV253TestJSON-247019988 tempest-ServicesAdminNegativeV253TestJSON-247019988-project-admin] Returning 404 to user: Service 5fd87c4f-1b50-4458-a642-fb5d0f197853 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:34:44.015113 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2b844fab-cfca-4657-876a-abc2a157cc6c tempest-ServicesAdminNegativeV253TestJSON-247019988 tempest-ServicesAdminNegativeV253TestJSON-247019988-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-services/5fd87c4f-1b50-4458-a642-fb5d0f197853" status: 404 len: 110 microversion: 2.53 time: 0.035665 Sep 23 04:34:44.015113 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 491/1047] 10.222.0.33 () {62 vars in 1309 bytes} [Fri Sep 23 04:34:43 2022] PUT /compute/v2.1/os-services/5fd87c4f-1b50-4458-a642-fb5d0f197853 => generated 110 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 23 04:34:44.021273 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4221f66a-2ecd-4c4b-8c45-2aa74ea63078 tempest-ServicesAdminNegativeV253TestJSON-247019988 tempest-ServicesAdminNegativeV253TestJSON-247019988-project-admin] Action: 'update', calling method: .version_select at 0x7ff1bbec20d0>, body: {"status": "enabled"} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:34:44.027373 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4221f66a-2ecd-4c4b-8c45-2aa74ea63078 tempest-ServicesAdminNegativeV253TestJSON-247019988 tempest-ServicesAdminNegativeV253TestJSON-247019988-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:44.028124 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4221f66a-2ecd-4c4b-8c45-2aa74ea63078 tempest-ServicesAdminNegativeV253TestJSON-247019988 tempest-ServicesAdminNegativeV253TestJSON-247019988-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:44.029054 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4221f66a-2ecd-4c4b-8c45-2aa74ea63078 tempest-ServicesAdminNegativeV253TestJSON-247019988 tempest-ServicesAdminNegativeV253TestJSON-247019988-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:44.038591 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4221f66a-2ecd-4c4b-8c45-2aa74ea63078 tempest-ServicesAdminNegativeV253TestJSON-247019988 tempest-ServicesAdminNegativeV253TestJSON-247019988-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:44.040248 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4221f66a-2ecd-4c4b-8c45-2aa74ea63078 tempest-ServicesAdminNegativeV253TestJSON-247019988 tempest-ServicesAdminNegativeV253TestJSON-247019988-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:44.041085 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4221f66a-2ecd-4c4b-8c45-2aa74ea63078 tempest-ServicesAdminNegativeV253TestJSON-247019988 tempest-ServicesAdminNegativeV253TestJSON-247019988-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:44.053857 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-4221f66a-2ecd-4c4b-8c45-2aa74ea63078 tempest-ServicesAdminNegativeV253TestJSON-247019988 tempest-ServicesAdminNegativeV253TestJSON-247019988-project-admin] HTTP exception thrown: Service 5fd87c4f-1b50-4458-a642-fb5d0f197853 could not be found. Sep 23 04:34:44.055829 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4221f66a-2ecd-4c4b-8c45-2aa74ea63078 tempest-ServicesAdminNegativeV253TestJSON-247019988 tempest-ServicesAdminNegativeV253TestJSON-247019988-project-admin] Request method failure captured: Sep 23 04:34:44.055829 n-d-846463-3 devstack@n-api.service[122698]: request: PUT /compute/v2.1/os-services/5fd87c4f-1b50-4458-a642-fb5d0f197853 HTTP/1.1 Sep 23 04:34:44.055829 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:34:44.055829 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:34:44.055829 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:34:44.055829 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 21 Sep 23 04:34:44.055829 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:34:44.055829 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:34:44.055829 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:34:44.055829 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:34:44.055829 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTdjsHh-12PlMQzVmICkrPGnYqNpl8Nbu6pCIgFH378OMSIDjdaVvcrgbkct3AaJnzCGFKqb6kHrQTzeUugWy3T5R7PmvfE_jExTZCD7jFGvQQUFdvKyjEZnJebSe3jPr5iaYPzwn2ZGPty1Dqi6n1WXCoh6hmGJetnkSuBWDLGEbLM Sep 23 04:34:44.055829 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:34:44.055829 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:34:44.055829 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:34:44.055829 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:34:44.055829 n-d-846463-3 devstack@n-api.service[122698]: X-Openstack-Nova-Api-Version: 2.53 Sep 23 04:34:44.055829 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:34:44.055829 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:34:44.055829 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 8f26b5731ad446feaea320b78fe636d4 Sep 23 04:34:44.055829 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-247019988 Sep 23 04:34:44.055829 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,admin,member Sep 23 04:34:44.055829 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,admin,member Sep 23 04:34:44.057242 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8f26b5731ad446feaea320b78fe636d4", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8f26b5731ad446feaea320b78fe636d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8f26b5731ad446feaea320b78fe636d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8f26b5731ad446feaea320b78fe636d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:34:44.057242 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-247019988 Sep 23 04:34:44.057242 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 8f26b5731ad446feaea320b78fe636d4 Sep 23 04:34:44.057242 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-247019988 Sep 23 04:34:44.057242 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ServicesAdminNegativeV253TestJSON-247019988-project-admin Sep 23 04:34:44.057242 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:34:44.057242 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:34:44.057242 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: f660c7f63b874a968cc096a44a203b1b Sep 23 04:34:44.057242 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-247019988-project-admin Sep 23 04:34:44.057242 n-d-846463-3 devstack@n-api.service[122698]: Sep 23 04:34:44.057242 n-d-846463-3 devstack@n-api.service[122698]: {"status": "enabled"} Sep 23 04:34:44.057242 n-d-846463-3 devstack@n-api.service[122698]: method: Sep 23 04:34:44.057242 n-d-846463-3 devstack@n-api.service[122698]: exception: Service 5fd87c4f-1b50-4458-a642-fb5d0f197853 could not be found. Sep 23 04:34:44.057242 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '5fd87c4f-1b50-4458-a642-fb5d0f197853', 'body': {'status': 'enabled'}} Sep 23 04:34:44.058167 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:34:44.058167 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:34:44.058167 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Sep 23 04:34:44.058167 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Sep 23 04:34:44.058167 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 23 04:34:44.058167 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 23 04:34:44.058167 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 23 04:34:44.058167 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:34:44.058167 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:34:44.058167 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:34:44.058167 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:34:44.058167 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Sep 23 04:34:44.058167 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Sep 23 04:34:44.058167 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Sep 23 04:34:44.058167 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Sep 23 04:34:44.058167 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 5fd87c4f-1b50-4458-a642-fb5d0f197853 could not be found. Sep 23 04:34:44.058167 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:34:44.058167 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:34:44.058167 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:34:44.058167 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:34:44.058167 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:34:44.059439 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:34:44.059439 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:34:44.059439 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:34:44.059439 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:34:44.059439 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:34:44.059439 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:34:44.059439 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:34:44.059439 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:34:44.059439 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:34:44.059439 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Sep 23 04:34:44.059439 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:34:44.059439 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 5fd87c4f-1b50-4458-a642-fb5d0f197853 could not be found. Sep 23 04:34:44.059439 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:34:44.059439 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:34:44.059439 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:34:44.059439 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:34:44.059439 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:34:44.059439 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:34:44.059439 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:34:44.059439 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:34:44.060606 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 5fd87c4f-1b50-4458-a642-fb5d0f197853 could not be found. Sep 23 04:34:44.060606 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:34:44.063431 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4221f66a-2ecd-4c4b-8c45-2aa74ea63078 tempest-ServicesAdminNegativeV253TestJSON-247019988 tempest-ServicesAdminNegativeV253TestJSON-247019988-project-admin] Returning 404 to user: Service 5fd87c4f-1b50-4458-a642-fb5d0f197853 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:34:44.064642 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4221f66a-2ecd-4c4b-8c45-2aa74ea63078 tempest-ServicesAdminNegativeV253TestJSON-247019988 tempest-ServicesAdminNegativeV253TestJSON-247019988-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-services/5fd87c4f-1b50-4458-a642-fb5d0f197853" status: 404 len: 110 microversion: 2.53 time: 0.048080 Sep 23 04:34:44.065454 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 492/1048] 10.222.0.33 () {62 vars in 1309 bytes} [Fri Sep 23 04:34:44 2022] PUT /compute/v2.1/os-services/5fd87c4f-1b50-4458-a642-fb5d0f197853 => generated 110 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 23 04:34:44.076742 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-12c01e59-74d9-4770-8a7b-60ce37eb0ad9 tempest-ServicesAdminNegativeV253TestJSON-247019988 tempest-ServicesAdminNegativeV253TestJSON-247019988-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:44.083431 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-12c01e59-74d9-4770-8a7b-60ce37eb0ad9 tempest-ServicesAdminNegativeV253TestJSON-247019988 tempest-ServicesAdminNegativeV253TestJSON-247019988-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:44.084556 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-12c01e59-74d9-4770-8a7b-60ce37eb0ad9 tempest-ServicesAdminNegativeV253TestJSON-247019988 tempest-ServicesAdminNegativeV253TestJSON-247019988-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:44.085267 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-12c01e59-74d9-4770-8a7b-60ce37eb0ad9 tempest-ServicesAdminNegativeV253TestJSON-247019988 tempest-ServicesAdminNegativeV253TestJSON-247019988-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:44.086380 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-12c01e59-74d9-4770-8a7b-60ce37eb0ad9 tempest-ServicesAdminNegativeV253TestJSON-247019988 tempest-ServicesAdminNegativeV253TestJSON-247019988-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:44.087061 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-12c01e59-74d9-4770-8a7b-60ce37eb0ad9 tempest-ServicesAdminNegativeV253TestJSON-247019988 tempest-ServicesAdminNegativeV253TestJSON-247019988-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:44.087905 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-12c01e59-74d9-4770-8a7b-60ce37eb0ad9 tempest-ServicesAdminNegativeV253TestJSON-247019988 tempest-ServicesAdminNegativeV253TestJSON-247019988-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:44.120436 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-12c01e59-74d9-4770-8a7b-60ce37eb0ad9 tempest-ServicesAdminNegativeV253TestJSON-247019988 tempest-ServicesAdminNegativeV253TestJSON-247019988-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.048290 Sep 23 04:34:44.120436 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 493/1049] 10.222.0.33 () {60 vars in 1178 bytes} [Fri Sep 23 04:34:44 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:34:44.125605 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1e7db782-631d-449f-abeb-937a804a54d5 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:44.126468 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-1e7db782-631d-449f-abeb-937a804a54d5 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 205bf02b-1478-4765-b2a6-d7014d9f0a64] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:44.133327 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1e7db782-631d-449f-abeb-937a804a54d5 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:44.134361 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1e7db782-631d-449f-abeb-937a804a54d5 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:44.135160 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1e7db782-631d-449f-abeb-937a804a54d5 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:44.137338 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1e7db782-631d-449f-abeb-937a804a54d5 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:44.138240 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1e7db782-631d-449f-abeb-937a804a54d5 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:44.138947 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1e7db782-631d-449f-abeb-937a804a54d5 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:44.162566 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-749e4de0-d46f-4699-a619-8f7d9ad4efbc tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:44.171096 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-749e4de0-d46f-4699-a619-8f7d9ad4efbc tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/fbbf8d58-8edb-4172-9d19-4b82804bf8e9" status: 200 len: 1378 microversion: 2.1 time: 0.280903 Sep 23 04:34:44.174227 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 557/1050] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:43 2022] GET /compute/v2.1/servers/fbbf8d58-8edb-4172-9d19-4b82804bf8e9 => generated 1378 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:44.194870 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f6053559-8b85-422c-b9d3-08290ba67370 tempest-ServicesAdminNegativeV253TestJSON-247019988 tempest-ServicesAdminNegativeV253TestJSON-247019988-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:44.211447 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f6053559-8b85-422c-b9d3-08290ba67370 tempest-ServicesAdminNegativeV253TestJSON-247019988 tempest-ServicesAdminNegativeV253TestJSON-247019988-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:44.218322 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f6053559-8b85-422c-b9d3-08290ba67370 tempest-ServicesAdminNegativeV253TestJSON-247019988 tempest-ServicesAdminNegativeV253TestJSON-247019988-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:44.218836 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f6053559-8b85-422c-b9d3-08290ba67370 tempest-ServicesAdminNegativeV253TestJSON-247019988 tempest-ServicesAdminNegativeV253TestJSON-247019988-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:44.219651 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f6053559-8b85-422c-b9d3-08290ba67370 tempest-ServicesAdminNegativeV253TestJSON-247019988 tempest-ServicesAdminNegativeV253TestJSON-247019988-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:44.221080 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f6053559-8b85-422c-b9d3-08290ba67370 tempest-ServicesAdminNegativeV253TestJSON-247019988 tempest-ServicesAdminNegativeV253TestJSON-247019988-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:44.221080 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f6053559-8b85-422c-b9d3-08290ba67370 tempest-ServicesAdminNegativeV253TestJSON-247019988 tempest-ServicesAdminNegativeV253TestJSON-247019988-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:44.282811 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f6053559-8b85-422c-b9d3-08290ba67370 tempest-ServicesAdminNegativeV253TestJSON-247019988 tempest-ServicesAdminNegativeV253TestJSON-247019988-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.099087 Sep 23 04:34:44.298311 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 558/1051] 10.222.0.33 () {60 vars in 1211 bytes} [Fri Sep 23 04:34:44 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1239 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:34:44.303225 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-cbeaee3f-2def-4fd6-b8bb-c06ffafd8b7c tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:44.303843 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-cbeaee3f-2def-4fd6-b8bb-c06ffafd8b7c tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] [instance: f392741f-f967-4c1c-930b-4eea7272bf64] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:44.322909 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cbeaee3f-2def-4fd6-b8bb-c06ffafd8b7c tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:44.324415 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cbeaee3f-2def-4fd6-b8bb-c06ffafd8b7c tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:44.325003 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cbeaee3f-2def-4fd6-b8bb-c06ffafd8b7c tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:44.325935 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cbeaee3f-2def-4fd6-b8bb-c06ffafd8b7c tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:44.327083 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cbeaee3f-2def-4fd6-b8bb-c06ffafd8b7c tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:44.327682 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cbeaee3f-2def-4fd6-b8bb-c06ffafd8b7c tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:44.392691 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-1e7db782-631d-449f-abeb-937a804a54d5 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:44.402810 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-1e7db782-631d-449f-abeb-937a804a54d5 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:44.410240 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-1e7db782-631d-449f-abeb-937a804a54d5 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:44.414270 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-1e7db782-631d-449f-abeb-937a804a54d5 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/205bf02b-1478-4765-b2a6-d7014d9f0a64" status: 200 len: 1815 microversion: 2.25 time: 0.292242 Sep 23 04:34:44.427448 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 494/1052] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:34:44 2022] GET /compute/v2.1/servers/205bf02b-1478-4765-b2a6-d7014d9f0a64 => generated 1815 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:34:44.445061 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1a4c24a9-6e79-4879-a710-fe3912cae7e8 tempest-ServicesAdminNegativeV253TestJSON-247019988 tempest-ServicesAdminNegativeV253TestJSON-247019988-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:44.459880 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1a4c24a9-6e79-4879-a710-fe3912cae7e8 tempest-ServicesAdminNegativeV253TestJSON-247019988 tempest-ServicesAdminNegativeV253TestJSON-247019988-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:44.466690 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1a4c24a9-6e79-4879-a710-fe3912cae7e8 tempest-ServicesAdminNegativeV253TestJSON-247019988 tempest-ServicesAdminNegativeV253TestJSON-247019988-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:44.466690 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1a4c24a9-6e79-4879-a710-fe3912cae7e8 tempest-ServicesAdminNegativeV253TestJSON-247019988 tempest-ServicesAdminNegativeV253TestJSON-247019988-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:44.466690 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1a4c24a9-6e79-4879-a710-fe3912cae7e8 tempest-ServicesAdminNegativeV253TestJSON-247019988 tempest-ServicesAdminNegativeV253TestJSON-247019988-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:44.467124 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1a4c24a9-6e79-4879-a710-fe3912cae7e8 tempest-ServicesAdminNegativeV253TestJSON-247019988 tempest-ServicesAdminNegativeV253TestJSON-247019988-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:44.467124 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1a4c24a9-6e79-4879-a710-fe3912cae7e8 tempest-ServicesAdminNegativeV253TestJSON-247019988 tempest-ServicesAdminNegativeV253TestJSON-247019988-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:44.499827 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-1a4c24a9-6e79-4879-a710-fe3912cae7e8 tempest-ServicesAdminNegativeV253TestJSON-247019988 tempest-ServicesAdminNegativeV253TestJSON-247019988-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.071099 Sep 23 04:34:44.500440 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 495/1053] 10.222.0.33 () {60 vars in 1178 bytes} [Fri Sep 23 04:34:44 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:34:44.516840 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9cd623e9-6330-4ee4-9c61-05f4eed75c63 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:44.517921 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-9cd623e9-6330-4ee4-9c61-05f4eed75c63 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: 36165f99-56fa-427b-98b4-c79d41f1fe28] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:44.535384 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9cd623e9-6330-4ee4-9c61-05f4eed75c63 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:44.535883 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9cd623e9-6330-4ee4-9c61-05f4eed75c63 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:44.536320 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9cd623e9-6330-4ee4-9c61-05f4eed75c63 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:44.540458 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9cd623e9-6330-4ee4-9c61-05f4eed75c63 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:44.540458 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9cd623e9-6330-4ee4-9c61-05f4eed75c63 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:44.540458 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9cd623e9-6330-4ee4-9c61-05f4eed75c63 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:44.584113 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-cbeaee3f-2def-4fd6-b8bb-c06ffafd8b7c tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c82752e1bc4fdb82e7f8391c7c129f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44352a7a6d964530aa20ae83064b02e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:44.598493 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-cbeaee3f-2def-4fd6-b8bb-c06ffafd8b7c tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] 10.222.0.33 "GET /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64" status: 200 len: 1472 microversion: 2.1 time: 0.298999 Sep 23 04:34:44.599732 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 559/1054] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:44 2022] GET /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64 => generated 1472 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:44.605403 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-05b24023-df26-40ce-b074-9e68414e92ed tempest-ServicesAdminNegativeV253TestJSON-247019988 tempest-ServicesAdminNegativeV253TestJSON-247019988-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:44.609573 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-05b24023-df26-40ce-b074-9e68414e92ed tempest-ServicesAdminNegativeV253TestJSON-247019988 tempest-ServicesAdminNegativeV253TestJSON-247019988-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:44.610369 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-05b24023-df26-40ce-b074-9e68414e92ed tempest-ServicesAdminNegativeV253TestJSON-247019988 tempest-ServicesAdminNegativeV253TestJSON-247019988-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:44.611014 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-05b24023-df26-40ce-b074-9e68414e92ed tempest-ServicesAdminNegativeV253TestJSON-247019988 tempest-ServicesAdminNegativeV253TestJSON-247019988-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:44.611973 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-05b24023-df26-40ce-b074-9e68414e92ed tempest-ServicesAdminNegativeV253TestJSON-247019988 tempest-ServicesAdminNegativeV253TestJSON-247019988-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:44.612658 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-05b24023-df26-40ce-b074-9e68414e92ed tempest-ServicesAdminNegativeV253TestJSON-247019988 tempest-ServicesAdminNegativeV253TestJSON-247019988-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:44.613287 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-05b24023-df26-40ce-b074-9e68414e92ed tempest-ServicesAdminNegativeV253TestJSON-247019988 tempest-ServicesAdminNegativeV253TestJSON-247019988-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:44.643453 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-05b24023-df26-40ce-b074-9e68414e92ed tempest-ServicesAdminNegativeV253TestJSON-247019988 tempest-ServicesAdminNegativeV253TestJSON-247019988-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?host=n-d-846463-3&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.042357 Sep 23 04:34:44.644374 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 560/1055] 10.222.0.33 () {60 vars in 1235 bytes} [Fri Sep 23 04:34:44 2022] GET /compute/v2.1/os-services?host=n-d-846463-3&binary=xxx => generated 16 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:44.656807 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8e7678a1-d584-4177-8ccc-dd7640310886 tempest-ServicesAdminNegativeV253TestJSON-247019988 tempest-ServicesAdminNegativeV253TestJSON-247019988-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:44.660632 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8e7678a1-d584-4177-8ccc-dd7640310886 tempest-ServicesAdminNegativeV253TestJSON-247019988 tempest-ServicesAdminNegativeV253TestJSON-247019988-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:44.661127 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8e7678a1-d584-4177-8ccc-dd7640310886 tempest-ServicesAdminNegativeV253TestJSON-247019988 tempest-ServicesAdminNegativeV253TestJSON-247019988-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:44.661799 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8e7678a1-d584-4177-8ccc-dd7640310886 tempest-ServicesAdminNegativeV253TestJSON-247019988 tempest-ServicesAdminNegativeV253TestJSON-247019988-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:44.662592 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8e7678a1-d584-4177-8ccc-dd7640310886 tempest-ServicesAdminNegativeV253TestJSON-247019988 tempest-ServicesAdminNegativeV253TestJSON-247019988-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:44.663151 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8e7678a1-d584-4177-8ccc-dd7640310886 tempest-ServicesAdminNegativeV253TestJSON-247019988 tempest-ServicesAdminNegativeV253TestJSON-247019988-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:44.663532 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8e7678a1-d584-4177-8ccc-dd7640310886 tempest-ServicesAdminNegativeV253TestJSON-247019988 tempest-ServicesAdminNegativeV253TestJSON-247019988-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:44.688941 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-8e7678a1-d584-4177-8ccc-dd7640310886 tempest-ServicesAdminNegativeV253TestJSON-247019988 tempest-ServicesAdminNegativeV253TestJSON-247019988-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.035730 Sep 23 04:34:44.697364 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 561/1056] 10.222.0.33 () {60 vars in 1178 bytes} [Fri Sep 23 04:34:44 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:34:44.702478 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-49827bc1-2efd-478a-ba13-a16dfe5413c0 tempest-ServicesAdminNegativeV253TestJSON-247019988 tempest-ServicesAdminNegativeV253TestJSON-247019988-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:44.710442 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-49827bc1-2efd-478a-ba13-a16dfe5413c0 tempest-ServicesAdminNegativeV253TestJSON-247019988 tempest-ServicesAdminNegativeV253TestJSON-247019988-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:44.710442 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-49827bc1-2efd-478a-ba13-a16dfe5413c0 tempest-ServicesAdminNegativeV253TestJSON-247019988 tempest-ServicesAdminNegativeV253TestJSON-247019988-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:44.710442 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-49827bc1-2efd-478a-ba13-a16dfe5413c0 tempest-ServicesAdminNegativeV253TestJSON-247019988 tempest-ServicesAdminNegativeV253TestJSON-247019988-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:44.710892 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-49827bc1-2efd-478a-ba13-a16dfe5413c0 tempest-ServicesAdminNegativeV253TestJSON-247019988 tempest-ServicesAdminNegativeV253TestJSON-247019988-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:44.710892 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-49827bc1-2efd-478a-ba13-a16dfe5413c0 tempest-ServicesAdminNegativeV253TestJSON-247019988 tempest-ServicesAdminNegativeV253TestJSON-247019988-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:44.711297 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-49827bc1-2efd-478a-ba13-a16dfe5413c0 tempest-ServicesAdminNegativeV253TestJSON-247019988 tempest-ServicesAdminNegativeV253TestJSON-247019988-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:44.738482 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-49827bc1-2efd-478a-ba13-a16dfe5413c0 tempest-ServicesAdminNegativeV253TestJSON-247019988 tempest-ServicesAdminNegativeV253TestJSON-247019988-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.039582 Sep 23 04:34:44.747602 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 562/1057] 10.222.0.33 () {60 vars in 1239 bytes} [Fri Sep 23 04:34:44 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:45.064825 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e659805d-59d1-4d4b-b52d-730ecd4a586c tempest-ServicesAdminNegativeV253TestJSON-1517594949 tempest-ServicesAdminNegativeV253TestJSON-1517594949-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:45.069069 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e659805d-59d1-4d4b-b52d-730ecd4a586c tempest-ServicesAdminNegativeV253TestJSON-1517594949 tempest-ServicesAdminNegativeV253TestJSON-1517594949-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '1f698286adf54fb9b99de5ed2d0f1994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c21aa8145c440799f446de8afe8ea9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:45.071447 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e659805d-59d1-4d4b-b52d-730ecd4a586c tempest-ServicesAdminNegativeV253TestJSON-1517594949 tempest-ServicesAdminNegativeV253TestJSON-1517594949-project] Request method failure captured: Sep 23 04:34:45.071447 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/os-services HTTP/1.1 Sep 23 04:34:45.071447 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:34:45.071447 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:34:45.071447 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:34:45.071447 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:34:45.071447 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:34:45.071447 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:34:45.071447 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:34:45.071447 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:34:45.071447 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTdiOU1nG2aHwzPcamawJAxPS9KJ3cMdc1Snmmeq24HT9n7RMqPelqFRLa8CnUQgUFgcmiQlsz1tpvwdAI4JH8rXaQzUt2iLLT6ZULncOa-MV8_JagUpsDkdIbjPSB4g5YfvtKkOnprKWYzz1KRF7eW4EBanUZocN8S41OxQIj-l5LA Sep 23 04:34:45.071447 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:34:45.071447 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:34:45.071447 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:34:45.071447 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:34:45.071447 n-d-846463-3 devstack@n-api.service[122699]: X-Openstack-Nova-Api-Version: 2.53 Sep 23 04:34:45.071447 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:34:45.071447 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:34:45.071447 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: d2c21aa8145c440799f446de8afe8ea9 Sep 23 04:34:45.071447 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1517594949 Sep 23 04:34:45.071447 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:34:45.071447 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:34:45.072846 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d2c21aa8145c440799f446de8afe8ea9", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d2c21aa8145c440799f446de8afe8ea9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d2c21aa8145c440799f446de8afe8ea9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d2c21aa8145c440799f446de8afe8ea9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:34:45.072846 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1517594949 Sep 23 04:34:45.072846 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: d2c21aa8145c440799f446de8afe8ea9 Sep 23 04:34:45.072846 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1517594949 Sep 23 04:34:45.072846 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1517594949-project Sep 23 04:34:45.072846 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:34:45.072846 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:34:45.072846 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 1f698286adf54fb9b99de5ed2d0f1994 Sep 23 04:34:45.072846 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1517594949-project Sep 23 04:34:45.072846 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:34:45.072846 n-d-846463-3 devstack@n-api.service[122699]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 23 04:34:45.072846 n-d-846463-3 devstack@n-api.service[122699]: action_args: {} Sep 23 04:34:45.073730 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:34:45.073730 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:34:45.073730 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:34:45.073730 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:34:45.073730 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:34:45.073730 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:34:45.073730 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 23 04:34:45.073730 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:34:45.073730 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 23 04:34:45.073730 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:34:45.073730 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:34:45.073730 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:34:45.073730 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Sep 23 04:34:45.073730 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Sep 23 04:34:45.073730 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 23 04:34:45.073730 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 23 04:34:45.073730 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 23 04:34:45.073730 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 23 04:34:45.073730 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 23 04:34:45.075341 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 23 04:34:45.075341 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 23 04:34:45.075341 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise self.value Sep 23 04:34:45.075341 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 23 04:34:45.075341 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 23 04:34:45.075341 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 23 04:34:45.075341 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 23 04:34:45.075341 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 23 04:34:45.075341 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 23 04:34:45.075341 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 23 04:34:45.075341 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:34:45.075341 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:34:45.075341 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:34:45.075341 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:34:45.075341 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:34:45.075341 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:34:45.075341 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 23 04:34:45.075341 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 23 04:34:45.075341 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 23 04:34:45.075341 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:34:45.077811 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e659805d-59d1-4d4b-b52d-730ecd4a586c tempest-ServicesAdminNegativeV253TestJSON-1517594949 tempest-ServicesAdminNegativeV253TestJSON-1517594949-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:34:45.078943 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e659805d-59d1-4d4b-b52d-730ecd4a586c tempest-ServicesAdminNegativeV253TestJSON-1517594949 tempest-ServicesAdminNegativeV253TestJSON-1517594949-project] 10.222.0.33 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.329702 Sep 23 04:34:45.079733 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 563/1058] 10.222.0.33 () {60 vars in 1178 bytes} [Fri Sep 23 04:34:44 2022] GET /compute/v2.1/os-services => generated 112 bytes in 331 msecs (HTTP/1.1 403) 9 headers in 381 bytes (2 switches on core 0) Sep 23 04:34:45.196993 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2ea7114e-dec5-47e1-9401-e8dc60f886a6 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:45.199237 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-2ea7114e-dec5-47e1-9401-e8dc60f886a6 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: fbbf8d58-8edb-4172-9d19-4b82804bf8e9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:45.211571 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2ea7114e-dec5-47e1-9401-e8dc60f886a6 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:45.212141 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2ea7114e-dec5-47e1-9401-e8dc60f886a6 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:45.212648 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2ea7114e-dec5-47e1-9401-e8dc60f886a6 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:45.221365 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2ea7114e-dec5-47e1-9401-e8dc60f886a6 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:45.221365 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2ea7114e-dec5-47e1-9401-e8dc60f886a6 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:45.221365 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2ea7114e-dec5-47e1-9401-e8dc60f886a6 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:45.235995 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=100 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:34:45.417596 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-9cd623e9-6330-4ee4-9c61-05f4eed75c63 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:45.427301 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9cd623e9-6330-4ee4-9c61-05f4eed75c63 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/36165f99-56fa-427b-98b4-c79d41f1fe28" status: 200 len: 1311 microversion: 2.1 time: 0.925530 Sep 23 04:34:45.429041 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 496/1059] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:44 2022] GET /compute/v2.1/servers/36165f99-56fa-427b-98b4-c79d41f1fe28 => generated 1311 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:45.448554 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4a16e596-41ff-473f-a625-c482ef19c281 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:45.449175 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4a16e596-41ff-473f-a625-c482ef19c281 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 205bf02b-1478-4765-b2a6-d7014d9f0a64] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:45.455922 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4a16e596-41ff-473f-a625-c482ef19c281 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:45.456421 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4a16e596-41ff-473f-a625-c482ef19c281 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:45.456866 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4a16e596-41ff-473f-a625-c482ef19c281 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:45.457612 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4a16e596-41ff-473f-a625-c482ef19c281 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:45.458110 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4a16e596-41ff-473f-a625-c482ef19c281 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:45.458907 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4a16e596-41ff-473f-a625-c482ef19c281 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:45.595452 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2ea7114e-dec5-47e1-9401-e8dc60f886a6 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:45.607339 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2ea7114e-dec5-47e1-9401-e8dc60f886a6 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/fbbf8d58-8edb-4172-9d19-4b82804bf8e9" status: 200 len: 1378 microversion: 2.1 time: 0.415601 Sep 23 04:34:45.607927 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 564/1060] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:45 2022] GET /compute/v2.1/servers/fbbf8d58-8edb-4172-9d19-4b82804bf8e9 => generated 1378 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:34:45.630453 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f2b7b199-58aa-4ef5-87f7-b21fd6d04ae6 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:45.631210 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f2b7b199-58aa-4ef5-87f7-b21fd6d04ae6 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] [instance: f392741f-f967-4c1c-930b-4eea7272bf64] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:45.637651 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:34:45.639250 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f2b7b199-58aa-4ef5-87f7-b21fd6d04ae6 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:45.639946 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f2b7b199-58aa-4ef5-87f7-b21fd6d04ae6 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:45.642252 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f2b7b199-58aa-4ef5-87f7-b21fd6d04ae6 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:45.642252 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f2b7b199-58aa-4ef5-87f7-b21fd6d04ae6 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:45.642850 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f2b7b199-58aa-4ef5-87f7-b21fd6d04ae6 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:45.643735 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f2b7b199-58aa-4ef5-87f7-b21fd6d04ae6 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:45.931766 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4a16e596-41ff-473f-a625-c482ef19c281 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:45.942116 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4a16e596-41ff-473f-a625-c482ef19c281 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:45.950959 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4a16e596-41ff-473f-a625-c482ef19c281 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:45.952859 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4a16e596-41ff-473f-a625-c482ef19c281 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/205bf02b-1478-4765-b2a6-d7014d9f0a64" status: 200 len: 1815 microversion: 2.25 time: 0.507948 Sep 23 04:34:45.962344 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 497/1061] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:34:45 2022] GET /compute/v2.1/servers/205bf02b-1478-4765-b2a6-d7014d9f0a64 => generated 1815 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:34:45.962344 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-4a3f4342-8562-4653-96ae-687cff679165 req-4f33ffbc-f8ea-4ada-ad10-7d378b1ad8a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbbf8d58-8edb-4172-9d19-4b82804bf8e9", "tag": "1a75583d-4990-40e9-876b-807baa271a68"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:34:45.970649 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-4a3f4342-8562-4653-96ae-687cff679165 req-4f33ffbc-f8ea-4ada-ad10-7d378b1ad8a4 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:45.971256 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-4a3f4342-8562-4653-96ae-687cff679165 req-4f33ffbc-f8ea-4ada-ad10-7d378b1ad8a4 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:45.973856 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-4a3f4342-8562-4653-96ae-687cff679165 req-4f33ffbc-f8ea-4ada-ad10-7d378b1ad8a4 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:45.986594 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-4a3f4342-8562-4653-96ae-687cff679165 req-4f33ffbc-f8ea-4ada-ad10-7d378b1ad8a4 service nova] Creating event network-changed:1a75583d-4990-40e9-876b-807baa271a68 for instance fbbf8d58-8edb-4172-9d19-4b82804bf8e9 on n-h2-846463-3 Sep 23 04:34:45.991724 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-4a3f4342-8562-4653-96ae-687cff679165 req-4f33ffbc-f8ea-4ada-ad10-7d378b1ad8a4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036778 Sep 23 04:34:45.992497 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 498/1062] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:34:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:34:46.044967 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f2b7b199-58aa-4ef5-87f7-b21fd6d04ae6 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c82752e1bc4fdb82e7f8391c7c129f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44352a7a6d964530aa20ae83064b02e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:46.056845 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f2b7b199-58aa-4ef5-87f7-b21fd6d04ae6 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] 10.222.0.33 "GET /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64" status: 200 len: 1472 microversion: 2.1 time: 0.431942 Sep 23 04:34:46.058090 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 565/1063] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:45 2022] GET /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64 => generated 1472 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:46.178037 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-dda97144-e606-4df6-92fa-b02cbf785d65 req-5e416e5c-c40e-4f99-bab6-1d40a2ca3354 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "205bf02b-1478-4765-b2a6-d7014d9f0a64", "name": "network-vif-unplugged", "status": "completed", "tag": "06cbe8b1-7ee2-495a-8e80-7976cf75b2c6"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:34:46.188913 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-dda97144-e606-4df6-92fa-b02cbf785d65 req-5e416e5c-c40e-4f99-bab6-1d40a2ca3354 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:46.189408 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-dda97144-e606-4df6-92fa-b02cbf785d65 req-5e416e5c-c40e-4f99-bab6-1d40a2ca3354 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:46.189844 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-dda97144-e606-4df6-92fa-b02cbf785d65 req-5e416e5c-c40e-4f99-bab6-1d40a2ca3354 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:46.202149 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-dda97144-e606-4df6-92fa-b02cbf785d65 req-5e416e5c-c40e-4f99-bab6-1d40a2ca3354 service nova] Creating event network-vif-unplugged:06cbe8b1-7ee2-495a-8e80-7976cf75b2c6 for instance 205bf02b-1478-4765-b2a6-d7014d9f0a64 on n-h2-846463-3 Sep 23 04:34:46.210337 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-dda97144-e606-4df6-92fa-b02cbf785d65 req-5e416e5c-c40e-4f99-bab6-1d40a2ca3354 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033916 Sep 23 04:34:46.218094 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 499/1064] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:34:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:34:46.340958 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-42d1246b-5c8a-4171-a6ec-558b1c5cccce tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-183759692", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "ccb09464-fe48-484e-9903-cd00cee379be"}], "security_groups": [{"name": "tempest-securitygroup--1585660997"}], "key_name": "tempest-keypair-1290470256", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "b0fc9a25-f258-4aba-921b-6201fd76e1b4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:34:46.452750 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-733716d8-f6a8-4364-942f-b7844b61bdfb tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:46.453611 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-733716d8-f6a8-4364-942f-b7844b61bdfb tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: 36165f99-56fa-427b-98b4-c79d41f1fe28] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:46.462016 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-733716d8-f6a8-4364-942f-b7844b61bdfb tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:46.463495 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-733716d8-f6a8-4364-942f-b7844b61bdfb tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:46.464815 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-733716d8-f6a8-4364-942f-b7844b61bdfb tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:46.466036 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-733716d8-f6a8-4364-942f-b7844b61bdfb tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:46.466674 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-733716d8-f6a8-4364-942f-b7844b61bdfb tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:46.467235 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-733716d8-f6a8-4364-942f-b7844b61bdfb tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:46.654896 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.neutron [None req-42d1246b-5c8a-4171-a6ec-558b1c5cccce tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] validate_networks() for [('ccb09464-fe48-484e-9903-cd00cee379be', None, None, None, None, None)] {{(pid=122699) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:34:46.889263 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-733716d8-f6a8-4364-942f-b7844b61bdfb tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:46.900437 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-733716d8-f6a8-4364-942f-b7844b61bdfb tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/36165f99-56fa-427b-98b4-c79d41f1fe28" status: 200 len: 1494 microversion: 2.1 time: 0.452440 Sep 23 04:34:46.901991 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 500/1065] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:46 2022] GET /compute/v2.1/servers/36165f99-56fa-427b-98b4-c79d41f1fe28 => generated 1494 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:34:46.919122 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-658249d1-6376-488d-8d06-6d0390e3eed9 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:46.920142 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-658249d1-6376-488d-8d06-6d0390e3eed9 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: fbbf8d58-8edb-4172-9d19-4b82804bf8e9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:46.928422 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-658249d1-6376-488d-8d06-6d0390e3eed9 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:46.928915 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-658249d1-6376-488d-8d06-6d0390e3eed9 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:46.929347 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-658249d1-6376-488d-8d06-6d0390e3eed9 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:46.930113 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-658249d1-6376-488d-8d06-6d0390e3eed9 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:46.930568 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-658249d1-6376-488d-8d06-6d0390e3eed9 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:46.931836 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-658249d1-6376-488d-8d06-6d0390e3eed9 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:47.324560 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-658249d1-6376-488d-8d06-6d0390e3eed9 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:47.327697 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=100 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:34:47.339124 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-658249d1-6376-488d-8d06-6d0390e3eed9 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/fbbf8d58-8edb-4172-9d19-4b82804bf8e9" status: 200 len: 1378 microversion: 2.1 time: 0.435791 Sep 23 04:34:47.339752 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 501/1066] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:46 2022] GET /compute/v2.1/servers/fbbf8d58-8edb-4172-9d19-4b82804bf8e9 => generated 1378 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:47.344280 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f00c9e84-60ed-4ae5-9e89-e18b69925262 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:47.345790 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f00c9e84-60ed-4ae5-9e89-e18b69925262 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] [instance: 36165f99-56fa-427b-98b4-c79d41f1fe28] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:47.351297 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f00c9e84-60ed-4ae5-9e89-e18b69925262 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:47.352087 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f00c9e84-60ed-4ae5-9e89-e18b69925262 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:47.352708 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f00c9e84-60ed-4ae5-9e89-e18b69925262 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:47.353417 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f00c9e84-60ed-4ae5-9e89-e18b69925262 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:47.354060 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f00c9e84-60ed-4ae5-9e89-e18b69925262 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:47.354661 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f00c9e84-60ed-4ae5-9e89-e18b69925262 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:47.635005 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-42d1246b-5c8a-4171-a6ec-558b1c5cccce tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Getting quotas for project f661d071bed2459cba4aa91e2b8b0d28. Resources: dict_keys(['metadata_items']) {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:34:47.641905 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-42d1246b-5c8a-4171-a6ec-558b1c5cccce tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Getting quotas for user 6c977d0e2ec64f8ca6b0923b9876c0c3 and project f661d071bed2459cba4aa91e2b8b0d28. Resources: dict_keys(['metadata_items']) {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:34:47.657345 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-42d1246b-5c8a-4171-a6ec-558b1c5cccce tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Flavor limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:34:47.658045 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-42d1246b-5c8a-4171-a6ec-558b1c5cccce tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Image limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:34:47.658493 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-42d1246b-5c8a-4171-a6ec-558b1c5cccce tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Flavor pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:34:47.659004 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-42d1246b-5c8a-4171-a6ec-558b1c5cccce tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Image pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:34:47.659527 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-42d1246b-5c8a-4171-a6ec-558b1c5cccce tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:34:47.670751 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-42d1246b-5c8a-4171-a6ec-558b1c5cccce tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:47.670751 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-42d1246b-5c8a-4171-a6ec-558b1c5cccce tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:47.670751 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-42d1246b-5c8a-4171-a6ec-558b1c5cccce tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:47.671190 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-42d1246b-5c8a-4171-a6ec-558b1c5cccce tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:47.671607 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-42d1246b-5c8a-4171-a6ec-558b1c5cccce tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:47.672239 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-42d1246b-5c8a-4171-a6ec-558b1c5cccce tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:47.714740 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-42d1246b-5c8a-4171-a6ec-558b1c5cccce tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Getting quotas for project f661d071bed2459cba4aa91e2b8b0d28. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:34:47.730273 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-42d1246b-5c8a-4171-a6ec-558b1c5cccce tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Getting quotas for user 6c977d0e2ec64f8ca6b0923b9876c0c3 and project f661d071bed2459cba4aa91e2b8b0d28. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:34:47.749800 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f00c9e84-60ed-4ae5-9e89-e18b69925262 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/36165f99-56fa-427b-98b4-c79d41f1fe28" status: 200 len: 1645 microversion: 2.1 time: 0.408938 Sep 23 04:34:47.750412 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 502/1067] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:47 2022] GET /compute/v2.1/servers/36165f99-56fa-427b-98b4-c79d41f1fe28 => generated 1645 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:47.766985 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:34:47.785496 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2997c70b-0649-46f4-8106-9b5f4e5b00bb tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:47.785496 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-2997c70b-0649-46f4-8106-9b5f4e5b00bb tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 205bf02b-1478-4765-b2a6-d7014d9f0a64] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:47.785496 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2997c70b-0649-46f4-8106-9b5f4e5b00bb tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:47.785496 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2997c70b-0649-46f4-8106-9b5f4e5b00bb tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:47.786852 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2997c70b-0649-46f4-8106-9b5f4e5b00bb tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:47.786852 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2997c70b-0649-46f4-8106-9b5f4e5b00bb tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:47.786852 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2997c70b-0649-46f4-8106-9b5f4e5b00bb tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:47.786852 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2997c70b-0649-46f4-8106-9b5f4e5b00bb tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:47.867473 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-42d1246b-5c8a-4171-a6ec-558b1c5cccce tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Going to run 1 instances... {{(pid=122699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:34:47.869681 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-42d1246b-5c8a-4171-a6ec-558b1c5cccce tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] [instance: f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b0fc9a25-f258-4aba-921b-6201fd76e1b4',volume_size=None,volume_type=None)] {{(pid=122699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:34:48.006515 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-2997c70b-0649-46f4-8106-9b5f4e5b00bb tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:48.016761 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-2997c70b-0649-46f4-8106-9b5f4e5b00bb tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:48.020243 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-2997c70b-0649-46f4-8106-9b5f4e5b00bb tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:48.025715 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2997c70b-0649-46f4-8106-9b5f4e5b00bb tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/205bf02b-1478-4765-b2a6-d7014d9f0a64" status: 200 len: 1815 microversion: 2.25 time: 0.267237 Sep 23 04:34:48.029573 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 503/1068] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:34:47 2022] GET /compute/v2.1/servers/205bf02b-1478-4765-b2a6-d7014d9f0a64 => generated 1815 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:34:48.044551 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-243d9e2c-ad14-456c-9fdd-f0c6e66a154c tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:48.045442 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-243d9e2c-ad14-456c-9fdd-f0c6e66a154c tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] [instance: f392741f-f967-4c1c-930b-4eea7272bf64] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:48.053630 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-243d9e2c-ad14-456c-9fdd-f0c6e66a154c tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:48.054256 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-243d9e2c-ad14-456c-9fdd-f0c6e66a154c tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:48.054775 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-243d9e2c-ad14-456c-9fdd-f0c6e66a154c tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:48.056445 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-243d9e2c-ad14-456c-9fdd-f0c6e66a154c tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:48.057184 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-243d9e2c-ad14-456c-9fdd-f0c6e66a154c tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:48.057950 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-243d9e2c-ad14-456c-9fdd-f0c6e66a154c tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:48.307260 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-243d9e2c-ad14-456c-9fdd-f0c6e66a154c tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c82752e1bc4fdb82e7f8391c7c129f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44352a7a6d964530aa20ae83064b02e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:48.348505 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-243d9e2c-ad14-456c-9fdd-f0c6e66a154c tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] 10.222.0.33 "GET /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64" status: 200 len: 1472 microversion: 2.1 time: 0.316704 Sep 23 04:34:48.363344 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 504/1069] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:48 2022] GET /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64 => generated 1472 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:48.378227 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4ea224e4-5016-4581-a500-578845d2d19b tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:48.382189 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4ea224e4-5016-4581-a500-578845d2d19b tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] [instance: 36165f99-56fa-427b-98b4-c79d41f1fe28] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:48.397436 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4ea224e4-5016-4581-a500-578845d2d19b tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:48.397994 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4ea224e4-5016-4581-a500-578845d2d19b tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:48.398449 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4ea224e4-5016-4581-a500-578845d2d19b tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:48.407874 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4ea224e4-5016-4581-a500-578845d2d19b tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:48.408576 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4ea224e4-5016-4581-a500-578845d2d19b tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:48.409018 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4ea224e4-5016-4581-a500-578845d2d19b tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:48.599179 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-42d1246b-5c8a-4171-a6ec-558b1c5cccce tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.262590 Sep 23 04:34:48.600711 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 566/1070] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:34:46 2022] POST /compute/v2.1/servers => generated 407 bytes in 2266 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:34:48.608452 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-8e8fdb47-c288-44da-9a17-8c54a4cf670a req-0ac5bb15-c6fa-4877-b18a-e2f70bcfb205 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "205bf02b-1478-4765-b2a6-d7014d9f0a64", "tag": "06cbe8b1-7ee2-495a-8e80-7976cf75b2c6"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:34:48.627096 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-8e8fdb47-c288-44da-9a17-8c54a4cf670a req-0ac5bb15-c6fa-4877-b18a-e2f70bcfb205 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:48.628563 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-8e8fdb47-c288-44da-9a17-8c54a4cf670a req-0ac5bb15-c6fa-4877-b18a-e2f70bcfb205 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:48.629309 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-8e8fdb47-c288-44da-9a17-8c54a4cf670a req-0ac5bb15-c6fa-4877-b18a-e2f70bcfb205 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:48.646802 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-8e8fdb47-c288-44da-9a17-8c54a4cf670a req-0ac5bb15-c6fa-4877-b18a-e2f70bcfb205 service nova] Creating event network-changed:06cbe8b1-7ee2-495a-8e80-7976cf75b2c6 for instance 205bf02b-1478-4765-b2a6-d7014d9f0a64 on n-h2-846463-3 Sep 23 04:34:48.655109 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-8e8fdb47-c288-44da-9a17-8c54a4cf670a req-0ac5bb15-c6fa-4877-b18a-e2f70bcfb205 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052658 Sep 23 04:34:48.656213 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 567/1071] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:34:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:34:48.664565 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-59195e55-a02f-4d3a-b941-a3421fcb6dd3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:48.665202 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4ea224e4-5016-4581-a500-578845d2d19b tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/36165f99-56fa-427b-98b4-c79d41f1fe28" status: 200 len: 1645 microversion: 2.1 time: 0.300323 Sep 23 04:34:48.667690 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-59195e55-a02f-4d3a-b941-a3421fcb6dd3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: fbbf8d58-8edb-4172-9d19-4b82804bf8e9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:48.668829 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 505/1072] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:48 2022] GET /compute/v2.1/servers/36165f99-56fa-427b-98b4-c79d41f1fe28 => generated 1645 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:48.676562 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-59195e55-a02f-4d3a-b941-a3421fcb6dd3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:48.690346 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-59195e55-a02f-4d3a-b941-a3421fcb6dd3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:48.690346 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-59195e55-a02f-4d3a-b941-a3421fcb6dd3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:48.690346 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-59195e55-a02f-4d3a-b941-a3421fcb6dd3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:48.690346 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-59195e55-a02f-4d3a-b941-a3421fcb6dd3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:48.691090 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-59195e55-a02f-4d3a-b941-a3421fcb6dd3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:48.698569 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ab567dc7-4a5e-496a-a7c8-bea18f671ec8 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:48.699190 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-ab567dc7-4a5e-496a-a7c8-bea18f671ec8 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] [instance: f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:48.873901 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ab567dc7-4a5e-496a-a7c8-bea18f671ec8 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c977d0e2ec64f8ca6b0923b9876c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f661d071bed2459cba4aa91e2b8b0d28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:48.881411 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ab567dc7-4a5e-496a-a7c8-bea18f671ec8 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] 10.222.0.33 "GET /compute/v2.1/servers/f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b" status: 200 len: 1121 microversion: 2.1 time: 0.211511 Sep 23 04:34:48.884997 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 506/1073] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:48 2022] GET /compute/v2.1/servers/f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b => generated 1121 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:48.890432 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e9a57f86-29a6-4871-9330-22115adf8288 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:48.902757 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e9a57f86-29a6-4871-9330-22115adf8288 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:48.910054 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e9a57f86-29a6-4871-9330-22115adf8288 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:48.912001 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e9a57f86-29a6-4871-9330-22115adf8288 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:48.914605 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e9a57f86-29a6-4871-9330-22115adf8288 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:48.915559 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e9a57f86-29a6-4871-9330-22115adf8288 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:48.918521 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e9a57f86-29a6-4871-9330-22115adf8288 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:48.946124 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e9a57f86-29a6-4871-9330-22115adf8288 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.059096 Sep 23 04:34:48.947328 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 507/1074] 10.222.0.33 () {58 vars in 1176 bytes} [Fri Sep 23 04:34:48 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:34:48.962891 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-becea655-d4ac-4f3e-b8c4-0fe142fc64f3 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:34:48.963706 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-becea655-d4ac-4f3e-b8c4-0fe142fc64f3 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] [instance: 36165f99-56fa-427b-98b4-c79d41f1fe28] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:48.970151 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-becea655-d4ac-4f3e-b8c4-0fe142fc64f3 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:48.970931 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-becea655-d4ac-4f3e-b8c4-0fe142fc64f3 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:48.971590 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-becea655-d4ac-4f3e-b8c4-0fe142fc64f3 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:48.972709 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-becea655-d4ac-4f3e-b8c4-0fe142fc64f3 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:48.973968 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-becea655-d4ac-4f3e-b8c4-0fe142fc64f3 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:48.974567 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-becea655-d4ac-4f3e-b8c4-0fe142fc64f3 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:49.183458 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-59195e55-a02f-4d3a-b941-a3421fcb6dd3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:49.214687 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-59195e55-a02f-4d3a-b941-a3421fcb6dd3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/fbbf8d58-8edb-4172-9d19-4b82804bf8e9" status: 200 len: 1378 microversion: 2.1 time: 0.556392 Sep 23 04:34:49.216180 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 568/1075] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:48 2022] GET /compute/v2.1/servers/fbbf8d58-8edb-4172-9d19-4b82804bf8e9 => generated 1378 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:49.223254 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c57b4681-8915-49aa-bb35-1afa20e04f1b tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:49.224177 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c57b4681-8915-49aa-bb35-1afa20e04f1b tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 205bf02b-1478-4765-b2a6-d7014d9f0a64] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:49.236283 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c57b4681-8915-49aa-bb35-1afa20e04f1b tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:49.239363 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c57b4681-8915-49aa-bb35-1afa20e04f1b tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:49.239363 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c57b4681-8915-49aa-bb35-1afa20e04f1b tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:49.239363 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c57b4681-8915-49aa-bb35-1afa20e04f1b tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:49.239363 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c57b4681-8915-49aa-bb35-1afa20e04f1b tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:49.240117 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c57b4681-8915-49aa-bb35-1afa20e04f1b tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:49.314854 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-becea655-d4ac-4f3e-b8c4-0fe142fc64f3 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/36165f99-56fa-427b-98b4-c79d41f1fe28/action" status: 202 len: 0 microversion: 2.1 time: 0.353134 Sep 23 04:34:49.316271 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 508/1076] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:34:48 2022] POST /compute/v2.1/servers/36165f99-56fa-427b-98b4-c79d41f1fe28/action => generated 0 bytes in 358 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:34:49.329575 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b6acffc2-b64b-45a8-a700-b47057b9e820 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:49.332895 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b6acffc2-b64b-45a8-a700-b47057b9e820 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] [instance: 36165f99-56fa-427b-98b4-c79d41f1fe28] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:49.356071 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b6acffc2-b64b-45a8-a700-b47057b9e820 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:49.356923 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b6acffc2-b64b-45a8-a700-b47057b9e820 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:49.357651 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b6acffc2-b64b-45a8-a700-b47057b9e820 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:49.359947 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b6acffc2-b64b-45a8-a700-b47057b9e820 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:49.360621 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b6acffc2-b64b-45a8-a700-b47057b9e820 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:49.361533 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b6acffc2-b64b-45a8-a700-b47057b9e820 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:49.645666 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c57b4681-8915-49aa-bb35-1afa20e04f1b tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:49.656271 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c57b4681-8915-49aa-bb35-1afa20e04f1b tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:49.659362 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c57b4681-8915-49aa-bb35-1afa20e04f1b tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:49.671251 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c57b4681-8915-49aa-bb35-1afa20e04f1b tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/205bf02b-1478-4765-b2a6-d7014d9f0a64" status: 200 len: 1815 microversion: 2.25 time: 0.452901 Sep 23 04:34:49.671900 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 569/1077] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:34:49 2022] GET /compute/v2.1/servers/205bf02b-1478-4765-b2a6-d7014d9f0a64 => generated 1815 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:34:49.693330 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-320d41e7-a2b1-4646-85d0-941e0e349197 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:49.694082 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-320d41e7-a2b1-4646-85d0-941e0e349197 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] [instance: f392741f-f967-4c1c-930b-4eea7272bf64] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:49.708712 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-320d41e7-a2b1-4646-85d0-941e0e349197 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:49.718953 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-320d41e7-a2b1-4646-85d0-941e0e349197 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:49.720192 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-320d41e7-a2b1-4646-85d0-941e0e349197 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:49.723194 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-320d41e7-a2b1-4646-85d0-941e0e349197 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:49.725581 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-320d41e7-a2b1-4646-85d0-941e0e349197 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:49.732203 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-320d41e7-a2b1-4646-85d0-941e0e349197 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:50.211952 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b6acffc2-b64b-45a8-a700-b47057b9e820 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/36165f99-56fa-427b-98b4-c79d41f1fe28" status: 200 len: 1650 microversion: 2.1 time: 0.891063 Sep 23 04:34:50.213398 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 509/1078] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:49 2022] GET /compute/v2.1/servers/36165f99-56fa-427b-98b4-c79d41f1fe28 => generated 1650 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:50.222824 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-45a71900-3619-445f-a495-006494f5e4e5 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:50.223843 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-45a71900-3619-445f-a495-006494f5e4e5 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] [instance: f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:50.237883 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-45a71900-3619-445f-a495-006494f5e4e5 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:50.238797 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-45a71900-3619-445f-a495-006494f5e4e5 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:50.239242 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-45a71900-3619-445f-a495-006494f5e4e5 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:50.240416 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-45a71900-3619-445f-a495-006494f5e4e5 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:50.240888 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-45a71900-3619-445f-a495-006494f5e4e5 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:50.241315 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-45a71900-3619-445f-a495-006494f5e4e5 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:50.268928 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-320d41e7-a2b1-4646-85d0-941e0e349197 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c82752e1bc4fdb82e7f8391c7c129f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44352a7a6d964530aa20ae83064b02e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:50.282581 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-320d41e7-a2b1-4646-85d0-941e0e349197 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] 10.222.0.33 "GET /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64" status: 200 len: 1472 microversion: 2.1 time: 0.609663 Sep 23 04:34:50.283322 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 570/1079] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:49 2022] GET /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64 => generated 1472 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:50.291672 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-eb7db554-1b9b-4a2f-8dc6-c5c2ef716003 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:50.291672 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-eb7db554-1b9b-4a2f-8dc6-c5c2ef716003 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: fbbf8d58-8edb-4172-9d19-4b82804bf8e9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:50.312832 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eb7db554-1b9b-4a2f-8dc6-c5c2ef716003 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:50.313324 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eb7db554-1b9b-4a2f-8dc6-c5c2ef716003 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:50.313813 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eb7db554-1b9b-4a2f-8dc6-c5c2ef716003 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:50.314632 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eb7db554-1b9b-4a2f-8dc6-c5c2ef716003 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:50.315055 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eb7db554-1b9b-4a2f-8dc6-c5c2ef716003 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:50.315894 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eb7db554-1b9b-4a2f-8dc6-c5c2ef716003 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:50.400339 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-45a71900-3619-445f-a495-006494f5e4e5 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c977d0e2ec64f8ca6b0923b9876c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f661d071bed2459cba4aa91e2b8b0d28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:50.415077 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-45a71900-3619-445f-a495-006494f5e4e5 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] 10.222.0.33 "GET /compute/v2.1/servers/f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b" status: 200 len: 1171 microversion: 2.1 time: 0.199008 Sep 23 04:34:50.416027 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 510/1080] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:50 2022] GET /compute/v2.1/servers/f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b => generated 1171 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:50.644636 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-eb7db554-1b9b-4a2f-8dc6-c5c2ef716003 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:50.654795 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-eb7db554-1b9b-4a2f-8dc6-c5c2ef716003 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/fbbf8d58-8edb-4172-9d19-4b82804bf8e9" status: 200 len: 1378 microversion: 2.1 time: 0.370556 Sep 23 04:34:50.655604 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 571/1081] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:50 2022] GET /compute/v2.1/servers/fbbf8d58-8edb-4172-9d19-4b82804bf8e9 => generated 1378 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:50.696615 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-bc5f9ce2-3f5f-4536-8408-dbeaee1d9bdc tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:50.699933 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-bc5f9ce2-3f5f-4536-8408-dbeaee1d9bdc tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 205bf02b-1478-4765-b2a6-d7014d9f0a64] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:50.720721 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bc5f9ce2-3f5f-4536-8408-dbeaee1d9bdc tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:50.721221 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bc5f9ce2-3f5f-4536-8408-dbeaee1d9bdc tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:50.721654 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bc5f9ce2-3f5f-4536-8408-dbeaee1d9bdc tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:50.722550 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bc5f9ce2-3f5f-4536-8408-dbeaee1d9bdc tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:50.723178 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bc5f9ce2-3f5f-4536-8408-dbeaee1d9bdc tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:50.728246 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bc5f9ce2-3f5f-4536-8408-dbeaee1d9bdc tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:50.898283 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-ef8a48b6-fe21-45d1-b6bf-c69fd792bf89 req-a9c3e85d-13cd-4623-9ab4-87c0d08af554 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbbf8d58-8edb-4172-9d19-4b82804bf8e9", "name": "network-vif-plugged", "status": "completed", "tag": "1a75583d-4990-40e9-876b-807baa271a68"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:34:50.920598 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-ef8a48b6-fe21-45d1-b6bf-c69fd792bf89 req-a9c3e85d-13cd-4623-9ab4-87c0d08af554 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:50.922946 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-ef8a48b6-fe21-45d1-b6bf-c69fd792bf89 req-a9c3e85d-13cd-4623-9ab4-87c0d08af554 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:50.925025 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-ef8a48b6-fe21-45d1-b6bf-c69fd792bf89 req-a9c3e85d-13cd-4623-9ab4-87c0d08af554 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:50.966636 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-ef8a48b6-fe21-45d1-b6bf-c69fd792bf89 req-a9c3e85d-13cd-4623-9ab4-87c0d08af554 service nova] Creating event network-vif-plugged:1a75583d-4990-40e9-876b-807baa271a68 for instance fbbf8d58-8edb-4172-9d19-4b82804bf8e9 on n-h2-846463-3 Sep 23 04:34:50.977624 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-ef8a48b6-fe21-45d1-b6bf-c69fd792bf89 req-a9c3e85d-13cd-4623-9ab4-87c0d08af554 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083985 Sep 23 04:34:50.983699 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 572/1082] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:34:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:34:51.065310 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-bc5f9ce2-3f5f-4536-8408-dbeaee1d9bdc tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:51.077842 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-bc5f9ce2-3f5f-4536-8408-dbeaee1d9bdc tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:51.100786 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-bc5f9ce2-3f5f-4536-8408-dbeaee1d9bdc tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:51.100786 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-bc5f9ce2-3f5f-4536-8408-dbeaee1d9bdc tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/205bf02b-1478-4765-b2a6-d7014d9f0a64" status: 200 len: 1815 microversion: 2.25 time: 0.397259 Sep 23 04:34:51.100786 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 511/1083] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:34:50 2022] GET /compute/v2.1/servers/205bf02b-1478-4765-b2a6-d7014d9f0a64 => generated 1815 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:34:51.240929 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-aa0963ce-cce9-40fa-8d95-4b51fd01b4e9 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:51.242582 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-aa0963ce-cce9-40fa-8d95-4b51fd01b4e9 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] [instance: 36165f99-56fa-427b-98b4-c79d41f1fe28] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:51.259667 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aa0963ce-cce9-40fa-8d95-4b51fd01b4e9 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:51.260563 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aa0963ce-cce9-40fa-8d95-4b51fd01b4e9 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:51.261141 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aa0963ce-cce9-40fa-8d95-4b51fd01b4e9 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:51.262469 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aa0963ce-cce9-40fa-8d95-4b51fd01b4e9 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:51.263711 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aa0963ce-cce9-40fa-8d95-4b51fd01b4e9 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:51.264293 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aa0963ce-cce9-40fa-8d95-4b51fd01b4e9 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:51.308218 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8e0b44ce-cbdd-4d66-8e1e-61c722ae1978 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:51.309099 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8e0b44ce-cbdd-4d66-8e1e-61c722ae1978 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] [instance: f392741f-f967-4c1c-930b-4eea7272bf64] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:51.330912 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8e0b44ce-cbdd-4d66-8e1e-61c722ae1978 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:51.331422 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8e0b44ce-cbdd-4d66-8e1e-61c722ae1978 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:51.331864 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8e0b44ce-cbdd-4d66-8e1e-61c722ae1978 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:51.332658 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8e0b44ce-cbdd-4d66-8e1e-61c722ae1978 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:51.333116 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8e0b44ce-cbdd-4d66-8e1e-61c722ae1978 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:51.333612 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8e0b44ce-cbdd-4d66-8e1e-61c722ae1978 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:51.637439 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-aa0963ce-cce9-40fa-8d95-4b51fd01b4e9 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/36165f99-56fa-427b-98b4-c79d41f1fe28" status: 200 len: 1630 microversion: 2.1 time: 0.400510 Sep 23 04:34:51.643684 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 573/1084] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:51 2022] GET /compute/v2.1/servers/36165f99-56fa-427b-98b4-c79d41f1fe28 => generated 1630 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:51.650162 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4020f9b1-d345-4e97-aa48-35dde89bbd7a tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:51.651540 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4020f9b1-d345-4e97-aa48-35dde89bbd7a tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] [instance: f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:51.668115 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4020f9b1-d345-4e97-aa48-35dde89bbd7a tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:51.668629 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4020f9b1-d345-4e97-aa48-35dde89bbd7a tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:51.669070 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4020f9b1-d345-4e97-aa48-35dde89bbd7a tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:51.669784 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4020f9b1-d345-4e97-aa48-35dde89bbd7a tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:51.670279 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4020f9b1-d345-4e97-aa48-35dde89bbd7a tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:51.673202 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4020f9b1-d345-4e97-aa48-35dde89bbd7a tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:51.787156 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-4020f9b1-d345-4e97-aa48-35dde89bbd7a tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c977d0e2ec64f8ca6b0923b9876c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f661d071bed2459cba4aa91e2b8b0d28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:51.790022 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8e0b44ce-cbdd-4d66-8e1e-61c722ae1978 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c82752e1bc4fdb82e7f8391c7c129f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44352a7a6d964530aa20ae83064b02e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:51.798179 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4020f9b1-d345-4e97-aa48-35dde89bbd7a tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] 10.222.0.33 "GET /compute/v2.1/servers/f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b" status: 200 len: 1219 microversion: 2.1 time: 0.153200 Sep 23 04:34:51.809929 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 574/1085] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:51 2022] GET /compute/v2.1/servers/f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b => generated 1219 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:51.810333 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8e0b44ce-cbdd-4d66-8e1e-61c722ae1978 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] 10.222.0.33 "GET /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64" status: 200 len: 1472 microversion: 2.1 time: 0.497180 Sep 23 04:34:51.810333 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 512/1086] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:51 2022] GET /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64 => generated 1472 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:34:51.810333 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c99df9c3-721a-47e3-9170-febb5d074429 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-846463-3", "block_migration": true, "disk_over_commit": false}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:34:51.810333 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c99df9c3-721a-47e3-9170-febb5d074429 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] [instance: 36165f99-56fa-427b-98b4-c79d41f1fe28] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:51.817643 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c99df9c3-721a-47e3-9170-febb5d074429 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:51.818218 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c99df9c3-721a-47e3-9170-febb5d074429 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:51.818732 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c99df9c3-721a-47e3-9170-febb5d074429 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:51.819525 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c99df9c3-721a-47e3-9170-febb5d074429 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:51.820205 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c99df9c3-721a-47e3-9170-febb5d074429 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:51.820646 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c99df9c3-721a-47e3-9170-febb5d074429 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:51.851229 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-c99df9c3-721a-47e3-9170-febb5d074429 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lazy-loading 'flavor' on Instance uuid 36165f99-56fa-427b-98b4-c79d41f1fe28 {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:34:51.869111 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c99df9c3-721a-47e3-9170-febb5d074429 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] [instance: 36165f99-56fa-427b-98b4-c79d41f1fe28] Going to try to live migrate instance to n-h1-846463-3 {{(pid=122698) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 23 04:34:52.127182 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3af95ff3-cccb-40a0-8e38-3535850ea2f3 tempest-ImagesMetadataNegativeTestJSON-352182139 tempest-ImagesMetadataNegativeTestJSON-352182139-project] Calling method '.version_select at 0x7ff1bb9d8790>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:52.148667 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-3af95ff3-cccb-40a0-8e38-3535850ea2f3 tempest-ImagesMetadataNegativeTestJSON-352182139 tempest-ImagesMetadataNegativeTestJSON-352182139-project] HTTP exception thrown: Image not found. Sep 23 04:34:52.151699 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3af95ff3-cccb-40a0-8e38-3535850ea2f3 tempest-ImagesMetadataNegativeTestJSON-352182139 tempest-ImagesMetadataNegativeTestJSON-352182139-project] Request method failure captured: Sep 23 04:34:52.151699 n-d-846463-3 devstack@n-api.service[122699]: request: DELETE /compute/v2.1/images/bf7b329b-4d37-455c-9aaa-a593841bfe44/metadata/os_distro HTTP/1.1 Sep 23 04:34:52.151699 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:34:52.151699 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:34:52.151699 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:34:52.151699 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:34:52.151699 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:34:52.151699 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:34:52.151699 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:34:52.151699 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:34:52.151699 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTdrs9z6Rtj7uZHYp3YBboNni5B-MIh6HN7QZWDWys7kAOQcIMbh31IxIC2_tmMEZhoJdU4WB3jTX-PpOcgvADsxzlY8EYN4i4onfR28KSK3xcteZrZgqtsIz1hJ55lhNlNmefxOF_M7ACZ14-FlYtrOnx1QRQmFUkMBMBJFavjQraI Sep 23 04:34:52.151699 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:34:52.151699 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:34:52.151699 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:34:52.151699 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:34:52.151699 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:34:52.151699 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:34:52.151699 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: d26d89482d8c42fe86b17fbbd75ac26a Sep 23 04:34:52.151699 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-352182139 Sep 23 04:34:52.151699 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:34:52.151699 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:34:52.153107 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d26d89482d8c42fe86b17fbbd75ac26a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d26d89482d8c42fe86b17fbbd75ac26a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d26d89482d8c42fe86b17fbbd75ac26a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d26d89482d8c42fe86b17fbbd75ac26a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:34:52.153107 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-352182139 Sep 23 04:34:52.153107 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: d26d89482d8c42fe86b17fbbd75ac26a Sep 23 04:34:52.153107 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-352182139 Sep 23 04:34:52.153107 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ImagesMetadataNegativeTestJSON-352182139-project Sep 23 04:34:52.153107 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:34:52.153107 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:34:52.153107 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: be310097c5914cc5a1404f8af59587e2 Sep 23 04:34:52.153107 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-352182139-project Sep 23 04:34:52.153107 n-d-846463-3 devstack@n-api.service[122699]: method: Sep 23 04:34:52.153107 n-d-846463-3 devstack@n-api.service[122699]: exception: Image not found. Sep 23 04:34:52.153107 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'image_id': 'bf7b329b-4d37-455c-9aaa-a593841bfe44', 'id': 'os_distro'} Sep 23 04:34:52.153107 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:34:52.154375 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:34:52.154375 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 23 04:34:52.154375 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 23 04:34:52.154375 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 23 04:34:52.154375 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 23 04:34:52.154375 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 23 04:34:52.154375 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 23 04:34:52.154375 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 23 04:34:52.154375 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 23 04:34:52.154375 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 23 04:34:52.154375 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 23 04:34:52.154375 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 23 04:34:52.154375 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 23 04:34:52.154375 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 23 04:34:52.154375 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 23 04:34:52.154375 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 23 04:34:52.154375 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 23 04:34:52.154375 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID bf7b329b-4d37-455c-9aaa-a593841bfe44 Sep 23 04:34:52.157438 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:34:52.157438 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:34:52.157438 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:34:52.157438 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:34:52.157438 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 23 04:34:52.157438 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 23 04:34:52.157438 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 23 04:34:52.157438 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 23 04:34:52.157438 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 23 04:34:52.157438 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 23 04:34:52.157438 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 23 04:34:52.157438 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 23 04:34:52.157438 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 23 04:34:52.157438 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 23 04:34:52.157438 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 23 04:34:52.157438 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 23 04:34:52.157438 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 23 04:34:52.157438 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 23 04:34:52.157438 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 23 04:34:52.157438 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 23 04:34:52.159724 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 23 04:34:52.159724 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 23 04:34:52.159724 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 23 04:34:52.159724 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 23 04:34:52.159724 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 23 04:34:52.159724 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 23 04:34:52.159724 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 23 04:34:52.159724 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 23 04:34:52.159724 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image bf7b329b-4d37-455c-9aaa-a593841bfe44 could not be found. Sep 23 04:34:52.159724 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:34:52.159724 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:34:52.159724 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:34:52.159724 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:34:52.159724 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:34:52.159724 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:34:52.159724 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:34:52.159724 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:34:52.159724 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:34:52.159724 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:34:52.161330 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:34:52.161330 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:34:52.161330 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Sep 23 04:34:52.161330 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Sep 23 04:34:52.161330 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 23 04:34:52.161330 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 23 04:34:52.161330 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 23 04:34:52.161330 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:34:52.161330 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:34:52.161330 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:34:52.161330 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:34:52.161330 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:34:52.161330 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:34:52.161330 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:34:52.161330 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:34:52.161330 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 23 04:34:52.161330 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:34:52.161330 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3af95ff3-cccb-40a0-8e38-3535850ea2f3 tempest-ImagesMetadataNegativeTestJSON-352182139 tempest-ImagesMetadataNegativeTestJSON-352182139-project] Returning 404 to user: Image not found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:34:52.162961 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3af95ff3-cccb-40a0-8e38-3535850ea2f3 tempest-ImagesMetadataNegativeTestJSON-352182139 tempest-ImagesMetadataNegativeTestJSON-352182139-project] 10.222.0.33 "DELETE /compute/v2.1/images/bf7b329b-4d37-455c-9aaa-a593841bfe44/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.352897 Sep 23 04:34:52.162961 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 575/1087] 10.222.0.33 () {58 vars in 1293 bytes} [Fri Sep 23 04:34:51 2022] DELETE /compute/v2.1/images/bf7b329b-4d37-455c-9aaa-a593841bfe44/metadata/os_distro => generated 62 bytes in 354 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 23 04:34:52.176918 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-fec98834-5305-4ccd-8799-5a55f75e286e tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:52.177245 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-fec98834-5305-4ccd-8799-5a55f75e286e tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: fbbf8d58-8edb-4172-9d19-4b82804bf8e9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:52.184430 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fec98834-5305-4ccd-8799-5a55f75e286e tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:52.184928 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fec98834-5305-4ccd-8799-5a55f75e286e tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:52.185366 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fec98834-5305-4ccd-8799-5a55f75e286e tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:52.186332 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fec98834-5305-4ccd-8799-5a55f75e286e tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:52.187493 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fec98834-5305-4ccd-8799-5a55f75e286e tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:52.187938 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fec98834-5305-4ccd-8799-5a55f75e286e tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:52.505321 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-fec98834-5305-4ccd-8799-5a55f75e286e tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:52.514372 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-fec98834-5305-4ccd-8799-5a55f75e286e tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/fbbf8d58-8edb-4172-9d19-4b82804bf8e9" status: 200 len: 1378 microversion: 2.1 time: 0.359312 Sep 23 04:34:52.529945 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 576/1088] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:52 2022] GET /compute/v2.1/servers/fbbf8d58-8edb-4172-9d19-4b82804bf8e9 => generated 1378 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:52.534752 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0ff1d927-98f2-4ffc-94f3-ef3b2695459e tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:52.535578 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-0ff1d927-98f2-4ffc-94f3-ef3b2695459e tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 205bf02b-1478-4765-b2a6-d7014d9f0a64] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:52.542253 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0ff1d927-98f2-4ffc-94f3-ef3b2695459e tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:52.542976 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0ff1d927-98f2-4ffc-94f3-ef3b2695459e tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:52.543596 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0ff1d927-98f2-4ffc-94f3-ef3b2695459e tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:52.544472 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0ff1d927-98f2-4ffc-94f3-ef3b2695459e tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:52.545091 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0ff1d927-98f2-4ffc-94f3-ef3b2695459e tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:52.545809 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0ff1d927-98f2-4ffc-94f3-ef3b2695459e tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:52.935227 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-0ff1d927-98f2-4ffc-94f3-ef3b2695459e tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:52.945083 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-0ff1d927-98f2-4ffc-94f3-ef3b2695459e tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:52.948641 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-0ff1d927-98f2-4ffc-94f3-ef3b2695459e tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:52.950042 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0ff1d927-98f2-4ffc-94f3-ef3b2695459e tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/205bf02b-1478-4765-b2a6-d7014d9f0a64" status: 200 len: 1815 microversion: 2.25 time: 0.419097 Sep 23 04:34:52.951035 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 577/1089] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:34:52 2022] GET /compute/v2.1/servers/205bf02b-1478-4765-b2a6-d7014d9f0a64 => generated 1815 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:34:52.958101 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c4222db0-8901-4278-9ab3-8bd3b9373b30 tempest-ImagesMetadataNegativeTestJSON-352182139 tempest-ImagesMetadataNegativeTestJSON-352182139-project] Calling method '.version_select at 0x7ff1bb9f21f0>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:52.990469 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-c4222db0-8901-4278-9ab3-8bd3b9373b30 tempest-ImagesMetadataNegativeTestJSON-352182139 tempest-ImagesMetadataNegativeTestJSON-352182139-project] HTTP exception thrown: Image not found. Sep 23 04:34:52.994312 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c4222db0-8901-4278-9ab3-8bd3b9373b30 tempest-ImagesMetadataNegativeTestJSON-352182139 tempest-ImagesMetadataNegativeTestJSON-352182139-project] Request method failure captured: Sep 23 04:34:52.994312 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/images/2f6b0a51-4c5b-427e-b452-2dbde56d41a8/metadata/os_version HTTP/1.1 Sep 23 04:34:52.994312 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:34:52.994312 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:34:52.994312 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:34:52.994312 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:34:52.994312 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:34:52.994312 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:34:52.994312 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:34:52.994312 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:34:52.994312 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTdrs9z6Rtj7uZHYp3YBboNni5B-MIh6HN7QZWDWys7kAOQcIMbh31IxIC2_tmMEZhoJdU4WB3jTX-PpOcgvADsxzlY8EYN4i4onfR28KSK3xcteZrZgqtsIz1hJ55lhNlNmefxOF_M7ACZ14-FlYtrOnx1QRQmFUkMBMBJFavjQraI Sep 23 04:34:52.994312 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:34:52.994312 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:34:52.994312 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:34:52.994312 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:34:52.994312 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:34:52.994312 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:34:52.994312 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: d26d89482d8c42fe86b17fbbd75ac26a Sep 23 04:34:52.994312 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-352182139 Sep 23 04:34:52.994312 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:34:52.994312 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:34:52.996448 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d26d89482d8c42fe86b17fbbd75ac26a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d26d89482d8c42fe86b17fbbd75ac26a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d26d89482d8c42fe86b17fbbd75ac26a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d26d89482d8c42fe86b17fbbd75ac26a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:34:52.996448 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-352182139 Sep 23 04:34:52.996448 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: d26d89482d8c42fe86b17fbbd75ac26a Sep 23 04:34:52.996448 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-352182139 Sep 23 04:34:52.996448 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ImagesMetadataNegativeTestJSON-352182139-project Sep 23 04:34:52.996448 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:34:52.996448 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:34:52.996448 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: be310097c5914cc5a1404f8af59587e2 Sep 23 04:34:52.996448 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-352182139-project Sep 23 04:34:52.996448 n-d-846463-3 devstack@n-api.service[122699]: method: Sep 23 04:34:52.996448 n-d-846463-3 devstack@n-api.service[122699]: exception: Image not found. Sep 23 04:34:52.996448 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'image_id': '2f6b0a51-4c5b-427e-b452-2dbde56d41a8', 'id': 'os_version'} Sep 23 04:34:52.996448 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:34:52.997413 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:34:52.997413 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 23 04:34:52.997413 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 23 04:34:52.997413 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 23 04:34:52.997413 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 23 04:34:52.997413 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 23 04:34:52.997413 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 23 04:34:52.997413 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 23 04:34:52.997413 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 23 04:34:52.997413 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 23 04:34:52.997413 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 23 04:34:52.997413 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 23 04:34:52.997413 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 23 04:34:52.997413 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 23 04:34:52.997413 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 23 04:34:52.997413 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 23 04:34:52.997413 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 23 04:34:52.997413 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 2f6b0a51-4c5b-427e-b452-2dbde56d41a8 Sep 23 04:34:52.998707 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:34:52.998707 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:34:52.998707 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:34:52.998707 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:34:52.998707 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 23 04:34:52.998707 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 23 04:34:52.998707 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 23 04:34:52.998707 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 23 04:34:52.998707 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 23 04:34:52.998707 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 23 04:34:52.998707 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 23 04:34:52.998707 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 23 04:34:52.998707 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 23 04:34:52.998707 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 23 04:34:52.998707 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 23 04:34:52.998707 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 23 04:34:52.998707 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 23 04:34:52.998707 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 23 04:34:52.998707 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 23 04:34:52.998707 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 23 04:34:53.000130 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 23 04:34:53.000130 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 23 04:34:53.000130 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 23 04:34:53.000130 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 23 04:34:53.000130 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 23 04:34:53.000130 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 23 04:34:53.000130 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 23 04:34:53.000130 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 23 04:34:53.000130 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 2f6b0a51-4c5b-427e-b452-2dbde56d41a8 could not be found. Sep 23 04:34:53.000130 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:34:53.000130 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:34:53.000130 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:34:53.000130 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:34:53.000130 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:34:53.000130 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:34:53.000130 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:34:53.000130 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:34:53.000130 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:34:53.000130 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:34:53.001399 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:34:53.001399 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:34:53.001399 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Sep 23 04:34:53.001399 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Sep 23 04:34:53.001399 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 23 04:34:53.001399 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 23 04:34:53.001399 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 23 04:34:53.001399 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:34:53.001399 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:34:53.001399 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:34:53.001399 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:34:53.001399 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:34:53.001399 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:34:53.001399 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:34:53.001399 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:34:53.001399 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 23 04:34:53.001399 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:34:53.004810 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c4222db0-8901-4278-9ab3-8bd3b9373b30 tempest-ImagesMetadataNegativeTestJSON-352182139 tempest-ImagesMetadataNegativeTestJSON-352182139-project] Returning 404 to user: Image not found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:34:53.004810 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c4222db0-8901-4278-9ab3-8bd3b9373b30 tempest-ImagesMetadataNegativeTestJSON-352182139 tempest-ImagesMetadataNegativeTestJSON-352182139-project] 10.222.0.33 "GET /compute/v2.1/images/2f6b0a51-4c5b-427e-b452-2dbde56d41a8/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.051236 Sep 23 04:34:53.007600 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 578/1090] 10.222.0.33 () {58 vars in 1293 bytes} [Fri Sep 23 04:34:52 2022] GET /compute/v2.1/images/2f6b0a51-4c5b-427e-b452-2dbde56d41a8/metadata/os_version => generated 62 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 23 04:34:53.022649 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d11476fc-9eeb-4764-a46c-f7c3f59f1e90 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:53.024066 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d11476fc-9eeb-4764-a46c-f7c3f59f1e90 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] [instance: f392741f-f967-4c1c-930b-4eea7272bf64] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:53.044184 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d11476fc-9eeb-4764-a46c-f7c3f59f1e90 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:53.046614 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d11476fc-9eeb-4764-a46c-f7c3f59f1e90 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:53.047319 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d11476fc-9eeb-4764-a46c-f7c3f59f1e90 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:53.048184 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d11476fc-9eeb-4764-a46c-f7c3f59f1e90 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:53.050468 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d11476fc-9eeb-4764-a46c-f7c3f59f1e90 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:53.051023 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d11476fc-9eeb-4764-a46c-f7c3f59f1e90 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:53.705538 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d11476fc-9eeb-4764-a46c-f7c3f59f1e90 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c82752e1bc4fdb82e7f8391c7c129f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44352a7a6d964530aa20ae83064b02e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:53.726000 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d11476fc-9eeb-4764-a46c-f7c3f59f1e90 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] 10.222.0.33 "GET /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64" status: 200 len: 1472 microversion: 2.1 time: 0.715994 Sep 23 04:34:53.727034 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 579/1091] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:53 2022] GET /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64 => generated 1472 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:53.742988 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-65af95df-028f-4c6b-8e60-bed6c2ded852 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:53.771471 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-65af95df-028f-4c6b-8e60-bed6c2ded852 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] [instance: f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:53.787974 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-65af95df-028f-4c6b-8e60-bed6c2ded852 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:53.788868 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-65af95df-028f-4c6b-8e60-bed6c2ded852 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:53.789494 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-65af95df-028f-4c6b-8e60-bed6c2ded852 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:53.790688 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-65af95df-028f-4c6b-8e60-bed6c2ded852 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:53.791380 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-65af95df-028f-4c6b-8e60-bed6c2ded852 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:53.792717 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-65af95df-028f-4c6b-8e60-bed6c2ded852 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:53.881583 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-65af95df-028f-4c6b-8e60-bed6c2ded852 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c977d0e2ec64f8ca6b0923b9876c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f661d071bed2459cba4aa91e2b8b0d28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:53.902993 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-65af95df-028f-4c6b-8e60-bed6c2ded852 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] 10.222.0.33 "GET /compute/v2.1/servers/f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b" status: 200 len: 1237 microversion: 2.1 time: 0.164894 Sep 23 04:34:53.902993 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 580/1092] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:53 2022] GET /compute/v2.1/servers/f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b => generated 1237 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:53.915139 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a3a5dd3c-37ad-4064-8181-acdbed7ed4df tempest-ImagesMetadataNegativeTestJSON-352182139 tempest-ImagesMetadataNegativeTestJSON-352182139-project] Calling method '.version_select at 0x7ff1bb9d8670>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:53.942002 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-a3a5dd3c-37ad-4064-8181-acdbed7ed4df tempest-ImagesMetadataNegativeTestJSON-352182139 tempest-ImagesMetadataNegativeTestJSON-352182139-project] HTTP exception thrown: Image not found. Sep 23 04:34:53.947247 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a3a5dd3c-37ad-4064-8181-acdbed7ed4df tempest-ImagesMetadataNegativeTestJSON-352182139 tempest-ImagesMetadataNegativeTestJSON-352182139-project] Request method failure captured: Sep 23 04:34:53.947247 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/images/5d1cd017-3d7a-42b2-b5ea-04beeb56b29f/metadata HTTP/1.1 Sep 23 04:34:53.947247 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:34:53.947247 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:34:53.947247 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:34:53.947247 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:34:53.947247 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:34:53.947247 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:34:53.947247 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:34:53.947247 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:34:53.947247 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTdrs9z6Rtj7uZHYp3YBboNni5B-MIh6HN7QZWDWys7kAOQcIMbh31IxIC2_tmMEZhoJdU4WB3jTX-PpOcgvADsxzlY8EYN4i4onfR28KSK3xcteZrZgqtsIz1hJ55lhNlNmefxOF_M7ACZ14-FlYtrOnx1QRQmFUkMBMBJFavjQraI Sep 23 04:34:53.947247 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:34:53.947247 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:34:53.947247 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:34:53.947247 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:34:53.947247 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:34:53.947247 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:34:53.947247 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: d26d89482d8c42fe86b17fbbd75ac26a Sep 23 04:34:53.947247 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-352182139 Sep 23 04:34:53.947247 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:34:53.947247 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:34:53.948900 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d26d89482d8c42fe86b17fbbd75ac26a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d26d89482d8c42fe86b17fbbd75ac26a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d26d89482d8c42fe86b17fbbd75ac26a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d26d89482d8c42fe86b17fbbd75ac26a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:34:53.948900 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-352182139 Sep 23 04:34:53.948900 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: d26d89482d8c42fe86b17fbbd75ac26a Sep 23 04:34:53.948900 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-352182139 Sep 23 04:34:53.948900 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ImagesMetadataNegativeTestJSON-352182139-project Sep 23 04:34:53.948900 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:34:53.948900 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:34:53.948900 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: be310097c5914cc5a1404f8af59587e2 Sep 23 04:34:53.948900 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-352182139-project Sep 23 04:34:53.948900 n-d-846463-3 devstack@n-api.service[122699]: method: Sep 23 04:34:53.948900 n-d-846463-3 devstack@n-api.service[122699]: exception: Image not found. Sep 23 04:34:53.948900 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'image_id': '5d1cd017-3d7a-42b2-b5ea-04beeb56b29f'} Sep 23 04:34:53.948900 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:34:53.949748 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:34:53.949748 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 23 04:34:53.949748 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 23 04:34:53.949748 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 23 04:34:53.949748 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 23 04:34:53.949748 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 23 04:34:53.949748 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 23 04:34:53.949748 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 23 04:34:53.949748 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 23 04:34:53.949748 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 23 04:34:53.949748 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 23 04:34:53.949748 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 23 04:34:53.949748 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 23 04:34:53.949748 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 23 04:34:53.949748 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 23 04:34:53.949748 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 23 04:34:53.949748 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 23 04:34:53.949748 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 5d1cd017-3d7a-42b2-b5ea-04beeb56b29f Sep 23 04:34:53.951034 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:34:53.951034 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:34:53.951034 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:34:53.951034 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:34:53.951034 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 23 04:34:53.951034 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 23 04:34:53.951034 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 23 04:34:53.951034 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 23 04:34:53.951034 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 23 04:34:53.951034 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 23 04:34:53.951034 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 23 04:34:53.951034 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 23 04:34:53.951034 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 23 04:34:53.951034 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 23 04:34:53.951034 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 23 04:34:53.951034 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 23 04:34:53.951034 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 23 04:34:53.951034 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 23 04:34:53.951034 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 23 04:34:53.951034 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 23 04:34:53.953037 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 23 04:34:53.953037 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 23 04:34:53.953037 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 23 04:34:53.953037 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 23 04:34:53.953037 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 23 04:34:53.953037 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 23 04:34:53.953037 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 23 04:34:53.953037 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 23 04:34:53.953037 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5d1cd017-3d7a-42b2-b5ea-04beeb56b29f could not be found. Sep 23 04:34:53.953037 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:34:53.953037 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:34:53.953037 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:34:53.953037 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:34:53.953037 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:34:53.953037 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:34:53.953037 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:34:53.953037 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:34:53.953037 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:34:53.953037 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:34:53.954212 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:34:53.954212 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:34:53.954212 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Sep 23 04:34:53.954212 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Sep 23 04:34:53.954212 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 23 04:34:53.954212 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 23 04:34:53.954212 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 23 04:34:53.954212 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:34:53.954212 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:34:53.954212 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:34:53.954212 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:34:53.954212 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:34:53.954212 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:34:53.954212 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:34:53.954212 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:34:53.954212 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 23 04:34:53.954212 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:34:53.957220 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a3a5dd3c-37ad-4064-8181-acdbed7ed4df tempest-ImagesMetadataNegativeTestJSON-352182139 tempest-ImagesMetadataNegativeTestJSON-352182139-project] Returning 404 to user: Image not found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:34:53.958307 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a3a5dd3c-37ad-4064-8181-acdbed7ed4df tempest-ImagesMetadataNegativeTestJSON-352182139 tempest-ImagesMetadataNegativeTestJSON-352182139-project] 10.222.0.33 "GET /compute/v2.1/images/5d1cd017-3d7a-42b2-b5ea-04beeb56b29f/metadata" status: 404 len: 62 microversion: 2.1 time: 0.058472 Sep 23 04:34:53.959357 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 581/1093] 10.222.0.33 () {58 vars in 1260 bytes} [Fri Sep 23 04:34:53 2022] GET /compute/v2.1/images/5d1cd017-3d7a-42b2-b5ea-04beeb56b29f/metadata => generated 62 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 23 04:34:53.965187 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4a57517e-7713-4185-a741-f7b3ce0f6779 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:53.966329 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4a57517e-7713-4185-a741-f7b3ce0f6779 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: fbbf8d58-8edb-4172-9d19-4b82804bf8e9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:53.981576 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4a57517e-7713-4185-a741-f7b3ce0f6779 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:53.982622 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4a57517e-7713-4185-a741-f7b3ce0f6779 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:53.983341 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4a57517e-7713-4185-a741-f7b3ce0f6779 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:53.984305 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4a57517e-7713-4185-a741-f7b3ce0f6779 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:53.985063 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4a57517e-7713-4185-a741-f7b3ce0f6779 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:53.985680 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4a57517e-7713-4185-a741-f7b3ce0f6779 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:54.302954 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-4a57517e-7713-4185-a741-f7b3ce0f6779 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:54.326988 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4a57517e-7713-4185-a741-f7b3ce0f6779 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/fbbf8d58-8edb-4172-9d19-4b82804bf8e9" status: 200 len: 1528 microversion: 2.1 time: 0.365606 Sep 23 04:34:54.330809 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 582/1094] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:53 2022] GET /compute/v2.1/servers/fbbf8d58-8edb-4172-9d19-4b82804bf8e9 => generated 1528 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:54.339472 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3759a6bd-663c-446c-86b2-39937415de14 tempest-ImagesMetadataNegativeTestJSON-352182139 tempest-ImagesMetadataNegativeTestJSON-352182139-project] Action: 'update_all', calling method: .version_select at 0x7ff1bb9d88b0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:34:54.380956 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-3759a6bd-663c-446c-86b2-39937415de14 tempest-ImagesMetadataNegativeTestJSON-352182139 tempest-ImagesMetadataNegativeTestJSON-352182139-project] HTTP exception thrown: Image not found. Sep 23 04:34:54.384410 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3759a6bd-663c-446c-86b2-39937415de14 tempest-ImagesMetadataNegativeTestJSON-352182139 tempest-ImagesMetadataNegativeTestJSON-352182139-project] Request method failure captured: Sep 23 04:34:54.384410 n-d-846463-3 devstack@n-api.service[122699]: request: PUT /compute/v2.1/images/f169411f-dcfd-490c-8c8c-80c9dcf2cd08/metadata HTTP/1.1 Sep 23 04:34:54.384410 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:34:54.384410 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:34:54.384410 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:34:54.384410 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 57 Sep 23 04:34:54.384410 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:34:54.384410 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:34:54.384410 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:34:54.384410 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:34:54.384410 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTdrs9z6Rtj7uZHYp3YBboNni5B-MIh6HN7QZWDWys7kAOQcIMbh31IxIC2_tmMEZhoJdU4WB3jTX-PpOcgvADsxzlY8EYN4i4onfR28KSK3xcteZrZgqtsIz1hJ55lhNlNmefxOF_M7ACZ14-FlYtrOnx1QRQmFUkMBMBJFavjQraI Sep 23 04:34:54.384410 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:34:54.384410 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:34:54.384410 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:34:54.384410 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:34:54.384410 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:34:54.384410 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:34:54.384410 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: d26d89482d8c42fe86b17fbbd75ac26a Sep 23 04:34:54.384410 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-352182139 Sep 23 04:34:54.384410 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:34:54.384410 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:34:54.386409 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d26d89482d8c42fe86b17fbbd75ac26a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d26d89482d8c42fe86b17fbbd75ac26a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d26d89482d8c42fe86b17fbbd75ac26a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d26d89482d8c42fe86b17fbbd75ac26a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:34:54.386409 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-352182139 Sep 23 04:34:54.386409 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: d26d89482d8c42fe86b17fbbd75ac26a Sep 23 04:34:54.386409 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-352182139 Sep 23 04:34:54.386409 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ImagesMetadataNegativeTestJSON-352182139-project Sep 23 04:34:54.386409 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:34:54.386409 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:34:54.386409 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: be310097c5914cc5a1404f8af59587e2 Sep 23 04:34:54.386409 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-352182139-project Sep 23 04:34:54.386409 n-d-846463-3 devstack@n-api.service[122699]: Sep 23 04:34:54.386409 n-d-846463-3 devstack@n-api.service[122699]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Sep 23 04:34:54.386409 n-d-846463-3 devstack@n-api.service[122699]: method: Sep 23 04:34:54.386409 n-d-846463-3 devstack@n-api.service[122699]: exception: Image not found. Sep 23 04:34:54.386409 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'image_id': 'f169411f-dcfd-490c-8c8c-80c9dcf2cd08', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Sep 23 04:34:54.387321 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:34:54.387321 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:34:54.387321 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 23 04:34:54.387321 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 23 04:34:54.387321 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 23 04:34:54.387321 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 23 04:34:54.387321 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 23 04:34:54.387321 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 23 04:34:54.387321 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 23 04:34:54.387321 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 23 04:34:54.387321 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 23 04:34:54.387321 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 23 04:34:54.387321 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 23 04:34:54.387321 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 23 04:34:54.387321 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 23 04:34:54.387321 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 23 04:34:54.387321 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 23 04:34:54.387321 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 23 04:34:54.390338 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID f169411f-dcfd-490c-8c8c-80c9dcf2cd08 Sep 23 04:34:54.390338 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:34:54.390338 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:34:54.390338 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:34:54.390338 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:34:54.390338 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 23 04:34:54.390338 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 23 04:34:54.390338 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 23 04:34:54.390338 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 23 04:34:54.390338 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 23 04:34:54.390338 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 23 04:34:54.390338 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 23 04:34:54.390338 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 23 04:34:54.390338 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 23 04:34:54.390338 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 23 04:34:54.390338 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 23 04:34:54.390338 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 23 04:34:54.390338 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 23 04:34:54.390338 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 23 04:34:54.393655 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 23 04:34:54.393655 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 23 04:34:54.393655 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 23 04:34:54.393655 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 23 04:34:54.393655 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 23 04:34:54.393655 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 23 04:34:54.393655 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 23 04:34:54.393655 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 23 04:34:54.393655 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 23 04:34:54.393655 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 23 04:34:54.393655 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f169411f-dcfd-490c-8c8c-80c9dcf2cd08 could not be found. Sep 23 04:34:54.393655 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:34:54.393655 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:34:54.393655 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:34:54.393655 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:34:54.393655 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:34:54.393655 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:34:54.393655 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:34:54.393655 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:34:54.396529 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:34:54.396529 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:34:54.396529 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:34:54.396529 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:34:54.396529 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:34:54.396529 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:34:54.396529 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Sep 23 04:34:54.396529 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Sep 23 04:34:54.396529 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 23 04:34:54.396529 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 23 04:34:54.396529 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 23 04:34:54.396529 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:34:54.396529 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:34:54.396529 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:34:54.396529 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:34:54.396529 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:34:54.396529 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:34:54.396529 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:34:54.396529 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:34:54.396529 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 23 04:34:54.396529 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:34:54.402999 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3759a6bd-663c-446c-86b2-39937415de14 tempest-ImagesMetadataNegativeTestJSON-352182139 tempest-ImagesMetadataNegativeTestJSON-352182139-project] Returning 404 to user: Image not found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:34:54.404098 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3759a6bd-663c-446c-86b2-39937415de14 tempest-ImagesMetadataNegativeTestJSON-352182139 tempest-ImagesMetadataNegativeTestJSON-352182139-project] 10.222.0.33 "PUT /compute/v2.1/images/f169411f-dcfd-490c-8c8c-80c9dcf2cd08/metadata" status: 404 len: 62 microversion: 2.1 time: 0.074299 Sep 23 04:34:54.414579 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 583/1095] 10.222.0.33 () {60 vars in 1280 bytes} [Fri Sep 23 04:34:54 2022] PUT /compute/v2.1/images/f169411f-dcfd-490c-8c8c-80c9dcf2cd08/metadata => generated 62 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 23 04:34:54.414579 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-cd3e8155-855c-4c7e-bd27-071e3c7c8acf tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:54.442947 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-cd3e8155-855c-4c7e-bd27-071e3c7c8acf tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 205bf02b-1478-4765-b2a6-d7014d9f0a64] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:54.455704 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cd3e8155-855c-4c7e-bd27-071e3c7c8acf tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:54.456212 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cd3e8155-855c-4c7e-bd27-071e3c7c8acf tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:54.456661 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cd3e8155-855c-4c7e-bd27-071e3c7c8acf tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:54.457388 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cd3e8155-855c-4c7e-bd27-071e3c7c8acf tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:54.457852 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cd3e8155-855c-4c7e-bd27-071e3c7c8acf tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:54.458443 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cd3e8155-855c-4c7e-bd27-071e3c7c8acf tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:55.455759 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-cd3e8155-855c-4c7e-bd27-071e3c7c8acf tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:55.473004 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-cd3e8155-855c-4c7e-bd27-071e3c7c8acf tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:55.490198 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-cd3e8155-855c-4c7e-bd27-071e3c7c8acf tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:55.491634 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-cd3e8155-855c-4c7e-bd27-071e3c7c8acf tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/205bf02b-1478-4765-b2a6-d7014d9f0a64" status: 200 len: 1815 microversion: 2.25 time: 1.083720 Sep 23 04:34:55.492221 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 584/1096] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:34:54 2022] GET /compute/v2.1/servers/205bf02b-1478-4765-b2a6-d7014d9f0a64 => generated 1815 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:34:55.522758 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-15f96e48-9483-4204-91b9-e1716ae4a870 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:55.525287 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-15f96e48-9483-4204-91b9-e1716ae4a870 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: fbbf8d58-8edb-4172-9d19-4b82804bf8e9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:55.545840 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-15f96e48-9483-4204-91b9-e1716ae4a870 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:55.548755 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-15f96e48-9483-4204-91b9-e1716ae4a870 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:55.550029 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-15f96e48-9483-4204-91b9-e1716ae4a870 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:55.552777 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-15f96e48-9483-4204-91b9-e1716ae4a870 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:55.553441 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-15f96e48-9483-4204-91b9-e1716ae4a870 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:55.558035 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-15f96e48-9483-4204-91b9-e1716ae4a870 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:56.056023 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-15f96e48-9483-4204-91b9-e1716ae4a870 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:56.068410 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-15f96e48-9483-4204-91b9-e1716ae4a870 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/fbbf8d58-8edb-4172-9d19-4b82804bf8e9" status: 200 len: 1528 microversion: 2.1 time: 0.555445 Sep 23 04:34:56.068410 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 585/1097] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:55 2022] GET /compute/v2.1/servers/fbbf8d58-8edb-4172-9d19-4b82804bf8e9 => generated 1528 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:56.077712 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-28c78486-1cc9-457f-b79d-0ae005bf6691 tempest-ImagesMetadataNegativeTestJSON-352182139 tempest-ImagesMetadataNegativeTestJSON-352182139-project] Action: 'update', calling method: .version_select at 0x7ff1bb9d89d0>, body: {"meta": {"os_distro": "alt"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:34:56.136982 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-28c78486-1cc9-457f-b79d-0ae005bf6691 tempest-ImagesMetadataNegativeTestJSON-352182139 tempest-ImagesMetadataNegativeTestJSON-352182139-project] HTTP exception thrown: Image not found. Sep 23 04:34:56.140267 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-28c78486-1cc9-457f-b79d-0ae005bf6691 tempest-ImagesMetadataNegativeTestJSON-352182139 tempest-ImagesMetadataNegativeTestJSON-352182139-project] Request method failure captured: Sep 23 04:34:56.140267 n-d-846463-3 devstack@n-api.service[122699]: request: PUT /compute/v2.1/images/1f454d6d-4f8f-4cc3-9b3b-b350c9b61fcf/metadata/os_distro HTTP/1.1 Sep 23 04:34:56.140267 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:34:56.140267 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:34:56.140267 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:34:56.140267 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 30 Sep 23 04:34:56.140267 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:34:56.140267 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:34:56.140267 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:34:56.140267 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:34:56.140267 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTdrs9z6Rtj7uZHYp3YBboNni5B-MIh6HN7QZWDWys7kAOQcIMbh31IxIC2_tmMEZhoJdU4WB3jTX-PpOcgvADsxzlY8EYN4i4onfR28KSK3xcteZrZgqtsIz1hJ55lhNlNmefxOF_M7ACZ14-FlYtrOnx1QRQmFUkMBMBJFavjQraI Sep 23 04:34:56.140267 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:34:56.140267 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:34:56.140267 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:34:56.140267 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:34:56.140267 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:34:56.140267 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:34:56.140267 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: d26d89482d8c42fe86b17fbbd75ac26a Sep 23 04:34:56.140267 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-352182139 Sep 23 04:34:56.140267 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:34:56.140267 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:34:56.142136 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d26d89482d8c42fe86b17fbbd75ac26a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d26d89482d8c42fe86b17fbbd75ac26a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d26d89482d8c42fe86b17fbbd75ac26a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d26d89482d8c42fe86b17fbbd75ac26a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:34:56.142136 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-352182139 Sep 23 04:34:56.142136 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: d26d89482d8c42fe86b17fbbd75ac26a Sep 23 04:34:56.142136 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-352182139 Sep 23 04:34:56.142136 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ImagesMetadataNegativeTestJSON-352182139-project Sep 23 04:34:56.142136 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:34:56.142136 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:34:56.142136 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: be310097c5914cc5a1404f8af59587e2 Sep 23 04:34:56.142136 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-352182139-project Sep 23 04:34:56.142136 n-d-846463-3 devstack@n-api.service[122699]: Sep 23 04:34:56.142136 n-d-846463-3 devstack@n-api.service[122699]: {"meta": {"os_distro": "alt"}} Sep 23 04:34:56.142136 n-d-846463-3 devstack@n-api.service[122699]: method: Sep 23 04:34:56.142136 n-d-846463-3 devstack@n-api.service[122699]: exception: Image not found. Sep 23 04:34:56.142136 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'image_id': '1f454d6d-4f8f-4cc3-9b3b-b350c9b61fcf', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Sep 23 04:34:56.143145 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:34:56.143145 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:34:56.143145 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 23 04:34:56.143145 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 23 04:34:56.143145 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 23 04:34:56.143145 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 23 04:34:56.143145 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 23 04:34:56.143145 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 23 04:34:56.143145 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 23 04:34:56.143145 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 23 04:34:56.143145 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 23 04:34:56.143145 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 23 04:34:56.143145 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 23 04:34:56.143145 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 23 04:34:56.143145 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 23 04:34:56.143145 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 23 04:34:56.143145 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 23 04:34:56.143145 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 23 04:34:56.144416 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 1f454d6d-4f8f-4cc3-9b3b-b350c9b61fcf Sep 23 04:34:56.144416 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:34:56.144416 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:34:56.144416 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:34:56.144416 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:34:56.144416 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 23 04:34:56.144416 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 23 04:34:56.144416 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 23 04:34:56.144416 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 23 04:34:56.144416 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 23 04:34:56.144416 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 23 04:34:56.144416 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 23 04:34:56.144416 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 23 04:34:56.144416 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 23 04:34:56.144416 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 23 04:34:56.144416 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 23 04:34:56.144416 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 23 04:34:56.144416 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 23 04:34:56.144416 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 23 04:34:56.145738 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 23 04:34:56.145738 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 23 04:34:56.145738 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 23 04:34:56.145738 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 23 04:34:56.145738 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 23 04:34:56.145738 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 23 04:34:56.145738 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 23 04:34:56.145738 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 23 04:34:56.145738 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 23 04:34:56.145738 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 23 04:34:56.145738 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 1f454d6d-4f8f-4cc3-9b3b-b350c9b61fcf could not be found. Sep 23 04:34:56.145738 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:34:56.145738 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:34:56.145738 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:34:56.145738 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:34:56.145738 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:34:56.145738 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:34:56.145738 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:34:56.145738 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:34:56.147328 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:34:56.147328 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:34:56.147328 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:34:56.147328 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:34:56.147328 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:34:56.147328 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:34:56.147328 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Sep 23 04:34:56.147328 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Sep 23 04:34:56.147328 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 23 04:34:56.147328 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 23 04:34:56.147328 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 23 04:34:56.147328 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:34:56.147328 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:34:56.147328 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:34:56.147328 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:34:56.147328 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:34:56.147328 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:34:56.147328 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:34:56.147328 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:34:56.147328 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 23 04:34:56.147328 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:34:56.150033 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-28c78486-1cc9-457f-b79d-0ae005bf6691 tempest-ImagesMetadataNegativeTestJSON-352182139 tempest-ImagesMetadataNegativeTestJSON-352182139-project] Returning 404 to user: Image not found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:34:56.151812 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-28c78486-1cc9-457f-b79d-0ae005bf6691 tempest-ImagesMetadataNegativeTestJSON-352182139 tempest-ImagesMetadataNegativeTestJSON-352182139-project] 10.222.0.33 "PUT /compute/v2.1/images/1f454d6d-4f8f-4cc3-9b3b-b350c9b61fcf/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.077977 Sep 23 04:34:56.157639 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 586/1098] 10.222.0.33 () {60 vars in 1310 bytes} [Fri Sep 23 04:34:56 2022] PUT /compute/v2.1/images/1f454d6d-4f8f-4cc3-9b3b-b350c9b61fcf/metadata/os_distro => generated 62 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 23 04:34:56.165050 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-23e7c8aa-b9f6-46da-be0e-05ffe7adeb23 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:56.165902 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-23e7c8aa-b9f6-46da-be0e-05ffe7adeb23 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] [instance: f392741f-f967-4c1c-930b-4eea7272bf64] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:56.175288 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-23e7c8aa-b9f6-46da-be0e-05ffe7adeb23 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:56.176147 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-23e7c8aa-b9f6-46da-be0e-05ffe7adeb23 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:56.176783 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-23e7c8aa-b9f6-46da-be0e-05ffe7adeb23 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:56.178248 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-23e7c8aa-b9f6-46da-be0e-05ffe7adeb23 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:56.179269 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-23e7c8aa-b9f6-46da-be0e-05ffe7adeb23 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:56.179914 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-23e7c8aa-b9f6-46da-be0e-05ffe7adeb23 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:56.633993 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-23e7c8aa-b9f6-46da-be0e-05ffe7adeb23 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c82752e1bc4fdb82e7f8391c7c129f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44352a7a6d964530aa20ae83064b02e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:56.646035 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-23e7c8aa-b9f6-46da-be0e-05ffe7adeb23 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] 10.222.0.33 "GET /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64" status: 200 len: 1472 microversion: 2.1 time: 0.486834 Sep 23 04:34:56.649398 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 587/1099] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:56 2022] GET /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64 => generated 1472 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:56.658003 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-993ee885-8295-442f-a38b-8399bb82b277 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:56.658977 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-993ee885-8295-442f-a38b-8399bb82b277 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] [instance: f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:56.667066 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-993ee885-8295-442f-a38b-8399bb82b277 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:56.667866 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-993ee885-8295-442f-a38b-8399bb82b277 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:56.668691 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-993ee885-8295-442f-a38b-8399bb82b277 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:56.669829 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-993ee885-8295-442f-a38b-8399bb82b277 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:56.671383 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-993ee885-8295-442f-a38b-8399bb82b277 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:56.672180 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-993ee885-8295-442f-a38b-8399bb82b277 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:56.677174 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=100 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:34:57.038612 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c99df9c3-721a-47e3-9170-febb5d074429 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/36165f99-56fa-427b-98b4-c79d41f1fe28/action" status: 202 len: 0 microversion: 2.1 time: 5.236585 Sep 23 04:34:57.042214 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 513/1100] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:34:51 2022] POST /compute/v2.1/servers/36165f99-56fa-427b-98b4-c79d41f1fe28/action => generated 0 bytes in 5240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:34:57.049020 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-de233e5b-c34e-44b0-9c50-a60deb6b73d2 tempest-MigrationsAdminTest-295231043 tempest-MigrationsAdminTest-295231043-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:57.138462 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-993ee885-8295-442f-a38b-8399bb82b277 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c977d0e2ec64f8ca6b0923b9876c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f661d071bed2459cba4aa91e2b8b0d28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:57.151303 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-993ee885-8295-442f-a38b-8399bb82b277 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] 10.222.0.33 "GET /compute/v2.1/servers/f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b" status: 200 len: 1305 microversion: 2.1 time: 0.497536 Sep 23 04:34:57.154411 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 588/1101] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:56 2022] GET /compute/v2.1/servers/f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b => generated 1305 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:57.200560 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0167b344-1182-4c32-bebf-18caa59d274a tempest-ImagesMetadataNegativeTestJSON-352182139 tempest-ImagesMetadataNegativeTestJSON-352182139-project] Action: 'create', calling method: .version_select at 0x7ff1bb9d88b0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:34:57.200784 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-de233e5b-c34e-44b0-9c50-a60deb6b73d2 tempest-MigrationsAdminTest-295231043 tempest-MigrationsAdminTest-295231043-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/3d855f86-77b7-407a-b659-aee8bca403f3" status: 202 len: 0 microversion: 2.1 time: 0.151918 Sep 23 04:34:57.200784 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 514/1102] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:34:57 2022] DELETE /compute/v2.1/flavors/3d855f86-77b7-407a-b659-aee8bca403f3 => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:34:57.203742 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e95dae54-cd04-4074-b0cb-fa274196557c tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:57.204520 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e95dae54-cd04-4074-b0cb-fa274196557c tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 205bf02b-1478-4765-b2a6-d7014d9f0a64] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:57.229588 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e95dae54-cd04-4074-b0cb-fa274196557c tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:57.229588 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e95dae54-cd04-4074-b0cb-fa274196557c tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:57.230132 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e95dae54-cd04-4074-b0cb-fa274196557c tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:57.241068 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e95dae54-cd04-4074-b0cb-fa274196557c tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:57.242050 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e95dae54-cd04-4074-b0cb-fa274196557c tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:57.242866 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e95dae54-cd04-4074-b0cb-fa274196557c tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:57.301357 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-0167b344-1182-4c32-bebf-18caa59d274a tempest-ImagesMetadataNegativeTestJSON-352182139 tempest-ImagesMetadataNegativeTestJSON-352182139-project] HTTP exception thrown: Image not found. Sep 23 04:34:57.303495 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0167b344-1182-4c32-bebf-18caa59d274a tempest-ImagesMetadataNegativeTestJSON-352182139 tempest-ImagesMetadataNegativeTestJSON-352182139-project] Request method failure captured: Sep 23 04:34:57.303495 n-d-846463-3 devstack@n-api.service[122699]: request: POST /compute/v2.1/images/71ff7201-6fed-436a-969f-21b7e4564aad/metadata HTTP/1.1 Sep 23 04:34:57.303495 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:34:57.303495 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:34:57.303495 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:34:57.303495 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 57 Sep 23 04:34:57.303495 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:34:57.303495 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:34:57.303495 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:34:57.303495 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:34:57.303495 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTdrs9z6Rtj7uZHYp3YBboNni5B-MIh6HN7QZWDWys7kAOQcIMbh31IxIC2_tmMEZhoJdU4WB3jTX-PpOcgvADsxzlY8EYN4i4onfR28KSK3xcteZrZgqtsIz1hJ55lhNlNmefxOF_M7ACZ14-FlYtrOnx1QRQmFUkMBMBJFavjQraI Sep 23 04:34:57.303495 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:34:57.303495 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:34:57.303495 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:34:57.303495 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:34:57.303495 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:34:57.303495 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:34:57.303495 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: d26d89482d8c42fe86b17fbbd75ac26a Sep 23 04:34:57.303495 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-352182139 Sep 23 04:34:57.303495 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:34:57.303495 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:34:57.305124 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d26d89482d8c42fe86b17fbbd75ac26a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d26d89482d8c42fe86b17fbbd75ac26a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d26d89482d8c42fe86b17fbbd75ac26a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d26d89482d8c42fe86b17fbbd75ac26a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:34:57.305124 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-352182139 Sep 23 04:34:57.305124 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: d26d89482d8c42fe86b17fbbd75ac26a Sep 23 04:34:57.305124 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-352182139 Sep 23 04:34:57.305124 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ImagesMetadataNegativeTestJSON-352182139-project Sep 23 04:34:57.305124 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:34:57.305124 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:34:57.305124 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: be310097c5914cc5a1404f8af59587e2 Sep 23 04:34:57.305124 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-352182139-project Sep 23 04:34:57.305124 n-d-846463-3 devstack@n-api.service[122699]: Sep 23 04:34:57.305124 n-d-846463-3 devstack@n-api.service[122699]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Sep 23 04:34:57.305124 n-d-846463-3 devstack@n-api.service[122699]: method: Sep 23 04:34:57.305124 n-d-846463-3 devstack@n-api.service[122699]: exception: Image not found. Sep 23 04:34:57.305124 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'image_id': '71ff7201-6fed-436a-969f-21b7e4564aad', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Sep 23 04:34:57.306527 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:34:57.306527 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:34:57.306527 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 23 04:34:57.306527 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 23 04:34:57.306527 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 23 04:34:57.306527 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 23 04:34:57.306527 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 23 04:34:57.306527 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 23 04:34:57.306527 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 23 04:34:57.306527 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 23 04:34:57.306527 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 23 04:34:57.306527 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 23 04:34:57.306527 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 23 04:34:57.306527 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 23 04:34:57.306527 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 23 04:34:57.306527 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 23 04:34:57.306527 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 23 04:34:57.306527 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 23 04:34:57.307964 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 71ff7201-6fed-436a-969f-21b7e4564aad Sep 23 04:34:57.307964 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:34:57.307964 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:34:57.307964 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:34:57.307964 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:34:57.307964 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 23 04:34:57.307964 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 23 04:34:57.307964 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 23 04:34:57.307964 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 23 04:34:57.307964 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 23 04:34:57.307964 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 23 04:34:57.307964 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 23 04:34:57.307964 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 23 04:34:57.307964 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 23 04:34:57.307964 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 23 04:34:57.307964 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 23 04:34:57.307964 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 23 04:34:57.307964 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 23 04:34:57.307964 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 23 04:34:57.309369 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 23 04:34:57.309369 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 23 04:34:57.309369 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 23 04:34:57.309369 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 23 04:34:57.309369 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 23 04:34:57.309369 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 23 04:34:57.309369 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 23 04:34:57.309369 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 23 04:34:57.309369 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 23 04:34:57.309369 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 23 04:34:57.309369 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 71ff7201-6fed-436a-969f-21b7e4564aad could not be found. Sep 23 04:34:57.309369 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:34:57.309369 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:34:57.309369 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:34:57.309369 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:34:57.309369 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:34:57.309369 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:34:57.309369 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:34:57.309369 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:34:57.310799 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:34:57.310799 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:34:57.310799 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:34:57.310799 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:34:57.310799 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:34:57.310799 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:34:57.310799 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Sep 23 04:34:57.310799 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Sep 23 04:34:57.310799 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 23 04:34:57.310799 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 23 04:34:57.310799 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 23 04:34:57.310799 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:34:57.310799 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:34:57.310799 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:34:57.310799 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:34:57.310799 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:34:57.310799 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:34:57.310799 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:34:57.310799 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:34:57.310799 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 23 04:34:57.310799 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:34:57.314400 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0167b344-1182-4c32-bebf-18caa59d274a tempest-ImagesMetadataNegativeTestJSON-352182139 tempest-ImagesMetadataNegativeTestJSON-352182139-project] Returning 404 to user: Image not found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:34:57.314925 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0167b344-1182-4c32-bebf-18caa59d274a tempest-ImagesMetadataNegativeTestJSON-352182139 tempest-ImagesMetadataNegativeTestJSON-352182139-project] 10.222.0.33 "POST /compute/v2.1/images/71ff7201-6fed-436a-969f-21b7e4564aad/metadata" status: 404 len: 62 microversion: 2.1 time: 0.159082 Sep 23 04:34:57.315769 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 589/1103] 10.222.0.33 () {60 vars in 1281 bytes} [Fri Sep 23 04:34:57 2022] POST /compute/v2.1/images/71ff7201-6fed-436a-969f-21b7e4564aad/metadata => generated 62 bytes in 161 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 23 04:34:57.337587 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e30ee1ae-d008-45d3-ae2b-eef1de75b8f2 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:57.338804 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e30ee1ae-d008-45d3-ae2b-eef1de75b8f2 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: 36165f99-56fa-427b-98b4-c79d41f1fe28] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:57.375630 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e30ee1ae-d008-45d3-ae2b-eef1de75b8f2 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:57.376148 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e30ee1ae-d008-45d3-ae2b-eef1de75b8f2 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:57.376661 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e30ee1ae-d008-45d3-ae2b-eef1de75b8f2 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:57.377405 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e30ee1ae-d008-45d3-ae2b-eef1de75b8f2 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:57.377880 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e30ee1ae-d008-45d3-ae2b-eef1de75b8f2 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:57.378342 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e30ee1ae-d008-45d3-ae2b-eef1de75b8f2 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:57.684527 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=28 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:34:57.748991 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=32 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:34:57.865581 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e30ee1ae-d008-45d3-ae2b-eef1de75b8f2 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:57.876971 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e30ee1ae-d008-45d3-ae2b-eef1de75b8f2 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/36165f99-56fa-427b-98b4-c79d41f1fe28" status: 200 len: 1504 microversion: 2.1 time: 0.559990 Sep 23 04:34:57.877766 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 590/1104] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:57 2022] GET /compute/v2.1/servers/36165f99-56fa-427b-98b4-c79d41f1fe28 => generated 1504 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:57.894901 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ba0e2d20-76e8-4839-af37-0c271e266f82 tempest-MigrationsAdminTest-295231043 tempest-MigrationsAdminTest-295231043-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:57.935267 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ba0e2d20-76e8-4839-af37-0c271e266f82 tempest-MigrationsAdminTest-295231043 tempest-MigrationsAdminTest-295231043-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.054824 Sep 23 04:34:57.938443 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 591/1105] 10.222.0.33 () {58 vars in 1146 bytes} [Fri Sep 23 04:34:57 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:57.948874 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-83bf55f6-6d23-43f6-b28a-b41eeecec1f8 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:57.948874 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-83bf55f6-6d23-43f6-b28a-b41eeecec1f8 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] [instance: f392741f-f967-4c1c-930b-4eea7272bf64] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:57.974848 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-83bf55f6-6d23-43f6-b28a-b41eeecec1f8 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:57.975615 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-83bf55f6-6d23-43f6-b28a-b41eeecec1f8 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:57.976405 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-83bf55f6-6d23-43f6-b28a-b41eeecec1f8 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:57.977311 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-83bf55f6-6d23-43f6-b28a-b41eeecec1f8 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:57.978532 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-83bf55f6-6d23-43f6-b28a-b41eeecec1f8 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:57.979722 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-83bf55f6-6d23-43f6-b28a-b41eeecec1f8 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:58.006283 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e95dae54-cd04-4074-b0cb-fa274196557c tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:58.019313 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e95dae54-cd04-4074-b0cb-fa274196557c tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:58.029290 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e95dae54-cd04-4074-b0cb-fa274196557c tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:58.036150 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e95dae54-cd04-4074-b0cb-fa274196557c tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/205bf02b-1478-4765-b2a6-d7014d9f0a64" status: 200 len: 1815 microversion: 2.25 time: 0.838393 Sep 23 04:34:58.039249 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 515/1106] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:34:57 2022] GET /compute/v2.1/servers/205bf02b-1478-4765-b2a6-d7014d9f0a64 => generated 1815 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:34:58.051572 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0ad85313-bf19-4f8c-925c-3dc4a29015e3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:34:58.067906 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-0ad85313-bf19-4f8c-925c-3dc4a29015e3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: fbbf8d58-8edb-4172-9d19-4b82804bf8e9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:58.086822 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0ad85313-bf19-4f8c-925c-3dc4a29015e3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:58.093263 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0ad85313-bf19-4f8c-925c-3dc4a29015e3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:58.094885 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0ad85313-bf19-4f8c-925c-3dc4a29015e3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:58.096376 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0ad85313-bf19-4f8c-925c-3dc4a29015e3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:58.104696 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0ad85313-bf19-4f8c-925c-3dc4a29015e3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:58.104696 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0ad85313-bf19-4f8c-925c-3dc4a29015e3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:58.366654 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-0ad85313-bf19-4f8c-925c-3dc4a29015e3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:58.366654 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-0ad85313-bf19-4f8c-925c-3dc4a29015e3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: fbbf8d58-8edb-4172-9d19-4b82804bf8e9] Old instance type tempest-test_resize_flavor_-694811385, new instance type m1.heat {{(pid=122698) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 23 04:34:58.378354 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-0ad85313-bf19-4f8c-925c-3dc4a29015e3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Flavor limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:34:58.378776 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-0ad85313-bf19-4f8c-925c-3dc4a29015e3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Image limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:34:58.383704 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-0ad85313-bf19-4f8c-925c-3dc4a29015e3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Flavor pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:34:58.384206 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-0ad85313-bf19-4f8c-925c-3dc4a29015e3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Image pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:34:58.384638 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-0ad85313-bf19-4f8c-925c-3dc4a29015e3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:34:58.524726 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-83bf55f6-6d23-43f6-b28a-b41eeecec1f8 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c82752e1bc4fdb82e7f8391c7c129f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44352a7a6d964530aa20ae83064b02e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:58.537549 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-83bf55f6-6d23-43f6-b28a-b41eeecec1f8 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] 10.222.0.33 "GET /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64" status: 200 len: 1472 microversion: 2.1 time: 0.594965 Sep 23 04:34:58.538830 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 592/1107] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:57 2022] GET /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64 => generated 1472 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:58.544847 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9277145f-95f2-41b5-b971-4026325a31b8 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:58.550224 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-9277145f-95f2-41b5-b971-4026325a31b8 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] [instance: f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:58.563332 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9277145f-95f2-41b5-b971-4026325a31b8 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:58.566649 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9277145f-95f2-41b5-b971-4026325a31b8 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:58.567295 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9277145f-95f2-41b5-b971-4026325a31b8 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:58.570565 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9277145f-95f2-41b5-b971-4026325a31b8 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:58.571291 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9277145f-95f2-41b5-b971-4026325a31b8 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:58.572032 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9277145f-95f2-41b5-b971-4026325a31b8 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:58.598055 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:34:58.696210 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0ad85313-bf19-4f8c-925c-3dc4a29015e3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "POST /compute/v2.1/servers/fbbf8d58-8edb-4172-9d19-4b82804bf8e9/action" status: 202 len: 0 microversion: 2.1 time: 0.653087 Sep 23 04:34:58.696844 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 516/1108] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:34:58 2022] POST /compute/v2.1/servers/fbbf8d58-8edb-4172-9d19-4b82804bf8e9/action => generated 0 bytes in 654 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:34:58.711099 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4a2795f9-1c09-4701-b214-97c1cd62b619 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:58.712601 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4a2795f9-1c09-4701-b214-97c1cd62b619 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: fbbf8d58-8edb-4172-9d19-4b82804bf8e9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:58.725581 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4a2795f9-1c09-4701-b214-97c1cd62b619 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:58.726163 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4a2795f9-1c09-4701-b214-97c1cd62b619 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:58.730367 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4a2795f9-1c09-4701-b214-97c1cd62b619 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:58.731144 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4a2795f9-1c09-4701-b214-97c1cd62b619 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:58.731633 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4a2795f9-1c09-4701-b214-97c1cd62b619 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:58.732082 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4a2795f9-1c09-4701-b214-97c1cd62b619 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:58.929339 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=12 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:34:59.058066 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:34:59.427267 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-9277145f-95f2-41b5-b971-4026325a31b8 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c977d0e2ec64f8ca6b0923b9876c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f661d071bed2459cba4aa91e2b8b0d28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:59.440051 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-9277145f-95f2-41b5-b971-4026325a31b8 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] 10.222.0.33 "GET /compute/v2.1/servers/f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b" status: 200 len: 1305 microversion: 2.1 time: 0.899849 Sep 23 04:34:59.442988 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 593/1109] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:58 2022] GET /compute/v2.1/servers/f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b => generated 1305 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:34:59.470397 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-219e4934-0391-4e79-bc63-ff74e769ab0e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:59.474641 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-219e4934-0391-4e79-bc63-ff74e769ab0e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: 36165f99-56fa-427b-98b4-c79d41f1fe28] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:59.489774 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-219e4934-0391-4e79-bc63-ff74e769ab0e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:59.490812 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-219e4934-0391-4e79-bc63-ff74e769ab0e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:59.492389 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-219e4934-0391-4e79-bc63-ff74e769ab0e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:59.498320 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-219e4934-0391-4e79-bc63-ff74e769ab0e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:59.499845 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-219e4934-0391-4e79-bc63-ff74e769ab0e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:59.500606 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-219e4934-0391-4e79-bc63-ff74e769ab0e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:59.659070 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4a2795f9-1c09-4701-b214-97c1cd62b619 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:34:59.694213 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4a2795f9-1c09-4701-b214-97c1cd62b619 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/fbbf8d58-8edb-4172-9d19-4b82804bf8e9" status: 200 len: 1537 microversion: 2.1 time: 0.967290 Sep 23 04:34:59.694213 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 517/1110] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:58 2022] GET /compute/v2.1/servers/fbbf8d58-8edb-4172-9d19-4b82804bf8e9 => generated 1537 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:34:59.694213 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b9fc09a5-4426-49a9-89aa-bea1ba4e7ef4 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:34:59.694960 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b9fc09a5-4426-49a9-89aa-bea1ba4e7ef4 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 205bf02b-1478-4765-b2a6-d7014d9f0a64] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:34:59.709176 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b9fc09a5-4426-49a9-89aa-bea1ba4e7ef4 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:59.709677 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b9fc09a5-4426-49a9-89aa-bea1ba4e7ef4 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:59.711821 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b9fc09a5-4426-49a9-89aa-bea1ba4e7ef4 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:34:59.712569 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b9fc09a5-4426-49a9-89aa-bea1ba4e7ef4 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:34:59.713033 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b9fc09a5-4426-49a9-89aa-bea1ba4e7ef4 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:34:59.717219 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b9fc09a5-4426-49a9-89aa-bea1ba4e7ef4 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:00.119694 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b9fc09a5-4426-49a9-89aa-bea1ba4e7ef4 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:00.131984 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b9fc09a5-4426-49a9-89aa-bea1ba4e7ef4 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:00.136876 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b9fc09a5-4426-49a9-89aa-bea1ba4e7ef4 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:00.143409 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b9fc09a5-4426-49a9-89aa-bea1ba4e7ef4 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/205bf02b-1478-4765-b2a6-d7014d9f0a64" status: 200 len: 1815 microversion: 2.25 time: 0.458976 Sep 23 04:35:00.144262 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 518/1111] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:34:59 2022] GET /compute/v2.1/servers/205bf02b-1478-4765-b2a6-d7014d9f0a64 => generated 1815 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:35:00.152392 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-d6cb4e9b-f41a-4edc-9d2f-4b294dd4e2b4 req-37daf115-c989-4694-988a-4741366c5a82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b", "tag": "9bfa56f7-d0ab-43c9-a2c9-14af449e0f1e"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:35:00.190669 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-d6cb4e9b-f41a-4edc-9d2f-4b294dd4e2b4 req-37daf115-c989-4694-988a-4741366c5a82 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:00.191369 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-d6cb4e9b-f41a-4edc-9d2f-4b294dd4e2b4 req-37daf115-c989-4694-988a-4741366c5a82 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:00.192006 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-d6cb4e9b-f41a-4edc-9d2f-4b294dd4e2b4 req-37daf115-c989-4694-988a-4741366c5a82 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:00.192607 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-219e4934-0391-4e79-bc63-ff74e769ab0e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:00.203714 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-219e4934-0391-4e79-bc63-ff74e769ab0e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/36165f99-56fa-427b-98b4-c79d41f1fe28" status: 200 len: 1504 microversion: 2.1 time: 0.759257 Sep 23 04:35:00.215228 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 594/1112] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:34:59 2022] GET /compute/v2.1/servers/36165f99-56fa-427b-98b4-c79d41f1fe28 => generated 1504 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:00.229919 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-d6cb4e9b-f41a-4edc-9d2f-4b294dd4e2b4 req-37daf115-c989-4694-988a-4741366c5a82 service nova] Creating event network-changed:9bfa56f7-d0ab-43c9-a2c9-14af449e0f1e for instance f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b on n-h1-846463-3 Sep 23 04:35:00.231044 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f8a40730-c0ba-42ec-a36e-5c3ed41b0aff tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:00.232657 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f8a40730-c0ba-42ec-a36e-5c3ed41b0aff tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] [instance: f392741f-f967-4c1c-930b-4eea7272bf64] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:00.237232 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-d6cb4e9b-f41a-4edc-9d2f-4b294dd4e2b4 req-37daf115-c989-4694-988a-4741366c5a82 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090701 Sep 23 04:35:00.237837 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 519/1113] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:35:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:35:00.241459 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f8a40730-c0ba-42ec-a36e-5c3ed41b0aff tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:00.243000 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f8a40730-c0ba-42ec-a36e-5c3ed41b0aff tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:00.243684 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f8a40730-c0ba-42ec-a36e-5c3ed41b0aff tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:00.245703 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f8a40730-c0ba-42ec-a36e-5c3ed41b0aff tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:00.246464 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f8a40730-c0ba-42ec-a36e-5c3ed41b0aff tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:00.247407 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f8a40730-c0ba-42ec-a36e-5c3ed41b0aff tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:00.503905 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9f6a70cd-727e-4b66-9c93-728430c32edd tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Action: 'create', calling method: .version_select at 0x7ff1bbbfb040>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1770220148", "description": "tempest-description-1051323567"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:35:00.892351 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f8a40730-c0ba-42ec-a36e-5c3ed41b0aff tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c82752e1bc4fdb82e7f8391c7c129f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44352a7a6d964530aa20ae83064b02e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:00.900165 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f8a40730-c0ba-42ec-a36e-5c3ed41b0aff tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] 10.222.0.33 "GET /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64" status: 200 len: 1472 microversion: 2.1 time: 0.683326 Sep 23 04:35:00.904133 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 595/1114] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:00 2022] GET /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64 => generated 1472 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:00.912254 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1ac73856-f967-4008-bb3a-d80b10c0dc48 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:00.912817 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1ac73856-f967-4008-bb3a-d80b10c0dc48 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] [instance: f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:00.949978 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1ac73856-f967-4008-bb3a-d80b10c0dc48 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:00.950937 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1ac73856-f967-4008-bb3a-d80b10c0dc48 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:00.951595 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1ac73856-f967-4008-bb3a-d80b10c0dc48 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:00.952695 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1ac73856-f967-4008-bb3a-d80b10c0dc48 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:00.953328 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1ac73856-f967-4008-bb3a-d80b10c0dc48 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:00.953949 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1ac73856-f967-4008-bb3a-d80b10c0dc48 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:01.428263 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1ac73856-f967-4008-bb3a-d80b10c0dc48 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c977d0e2ec64f8ca6b0923b9876c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f661d071bed2459cba4aa91e2b8b0d28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:01.442241 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1ac73856-f967-4008-bb3a-d80b10c0dc48 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] 10.222.0.33 "GET /compute/v2.1/servers/f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b" status: 200 len: 1305 microversion: 2.1 time: 0.536760 Sep 23 04:35:01.462058 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 596/1115] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:00 2022] GET /compute/v2.1/servers/f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b => generated 1305 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:01.527858 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a69a14b1-a794-4458-bda6-c941a1e2d824 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:01.543023 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a69a14b1-a794-4458-bda6-c941a1e2d824 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: fbbf8d58-8edb-4172-9d19-4b82804bf8e9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:01.570030 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a69a14b1-a794-4458-bda6-c941a1e2d824 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:01.570622 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a69a14b1-a794-4458-bda6-c941a1e2d824 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:01.571066 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a69a14b1-a794-4458-bda6-c941a1e2d824 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:01.571783 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a69a14b1-a794-4458-bda6-c941a1e2d824 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:01.572238 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a69a14b1-a794-4458-bda6-c941a1e2d824 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:01.573212 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a69a14b1-a794-4458-bda6-c941a1e2d824 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:01.598438 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9f6a70cd-727e-4b66-9c93-728430c32edd tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 1.356888 Sep 23 04:35:01.599397 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 520/1116] 10.222.0.33 () {60 vars in 1180 bytes} [Fri Sep 23 04:35:00 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 1359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:35:01.610831 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-14ba9f35-cee0-46de-a6b0-8518a2d54b30 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:01.616723 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-14ba9f35-cee0-46de-a6b0-8518a2d54b30 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 205bf02b-1478-4765-b2a6-d7014d9f0a64] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:01.644072 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-14ba9f35-cee0-46de-a6b0-8518a2d54b30 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:01.644633 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-14ba9f35-cee0-46de-a6b0-8518a2d54b30 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:01.645181 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-14ba9f35-cee0-46de-a6b0-8518a2d54b30 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:01.645924 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-14ba9f35-cee0-46de-a6b0-8518a2d54b30 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:01.646372 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-14ba9f35-cee0-46de-a6b0-8518a2d54b30 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:01.646795 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-14ba9f35-cee0-46de-a6b0-8518a2d54b30 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:02.198528 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a69a14b1-a794-4458-bda6-c941a1e2d824 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:02.207886 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a69a14b1-a794-4458-bda6-c941a1e2d824 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/fbbf8d58-8edb-4172-9d19-4b82804bf8e9" status: 200 len: 1537 microversion: 2.1 time: 0.744493 Sep 23 04:35:02.208475 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 597/1117] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:01 2022] GET /compute/v2.1/servers/fbbf8d58-8edb-4172-9d19-4b82804bf8e9 => generated 1537 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:02.228122 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-93bd3bf9-ec8c-4440-aa0c-9415444bb29c tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:02.229768 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-93bd3bf9-ec8c-4440-aa0c-9415444bb29c tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: 36165f99-56fa-427b-98b4-c79d41f1fe28] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:02.237665 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-93bd3bf9-ec8c-4440-aa0c-9415444bb29c tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:02.238927 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-93bd3bf9-ec8c-4440-aa0c-9415444bb29c tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:02.239549 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-93bd3bf9-ec8c-4440-aa0c-9415444bb29c tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:02.240519 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-93bd3bf9-ec8c-4440-aa0c-9415444bb29c tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:02.241631 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-93bd3bf9-ec8c-4440-aa0c-9415444bb29c tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:02.242546 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-93bd3bf9-ec8c-4440-aa0c-9415444bb29c tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:02.325059 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-14ba9f35-cee0-46de-a6b0-8518a2d54b30 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:02.341309 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-14ba9f35-cee0-46de-a6b0-8518a2d54b30 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:02.347195 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-14ba9f35-cee0-46de-a6b0-8518a2d54b30 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:02.348763 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-14ba9f35-cee0-46de-a6b0-8518a2d54b30 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/205bf02b-1478-4765-b2a6-d7014d9f0a64" status: 200 len: 1815 microversion: 2.25 time: 0.748122 Sep 23 04:35:02.350067 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 521/1118] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:35:01 2022] GET /compute/v2.1/servers/205bf02b-1478-4765-b2a6-d7014d9f0a64 => generated 1815 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:35:02.679731 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-93bd3bf9-ec8c-4440-aa0c-9415444bb29c tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:02.699428 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-93bd3bf9-ec8c-4440-aa0c-9415444bb29c tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/36165f99-56fa-427b-98b4-c79d41f1fe28" status: 200 len: 1504 microversion: 2.1 time: 0.483104 Sep 23 04:35:02.714525 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 598/1119] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:02 2022] GET /compute/v2.1/servers/36165f99-56fa-427b-98b4-c79d41f1fe28 => generated 1504 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:02.726283 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-989c0335-5e41-4e93-a7d0-af24458a3294 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Action: 'create', calling method: .version_select at 0x7ff1bb9ad4c0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-505576635", "description": "tempest-description-1375190871"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:35:03.003402 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-656bffe4-3a38-4a74-b6d3-5417a4f9b421 tempest-FloatingIPsNegativeTestJSON-1652295977 tempest-FloatingIPsNegativeTestJSON-1652295977-project] Calling method '.version_select at 0x7ff1bbb4df70>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:03.217444 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-656bffe4-3a38-4a74-b6d3-5417a4f9b421 tempest-FloatingIPsNegativeTestJSON-1652295977 tempest-FloatingIPsNegativeTestJSON-1652295977-project] 10.222.0.33 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.865999 Sep 23 04:35:03.227437 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 522/1120] 10.222.0.33 () {58 vars in 1149 bytes} [Fri Sep 23 04:35:02 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 04:35:03.233768 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4efc4db3-9337-43d6-babc-a1339aee2b41 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:03.234485 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4efc4db3-9337-43d6-babc-a1339aee2b41 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] [instance: f392741f-f967-4c1c-930b-4eea7272bf64] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:03.257089 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4efc4db3-9337-43d6-babc-a1339aee2b41 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:03.259071 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4efc4db3-9337-43d6-babc-a1339aee2b41 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:03.260423 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4efc4db3-9337-43d6-babc-a1339aee2b41 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:03.276585 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4efc4db3-9337-43d6-babc-a1339aee2b41 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:03.278897 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4efc4db3-9337-43d6-babc-a1339aee2b41 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:03.283049 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4efc4db3-9337-43d6-babc-a1339aee2b41 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:03.601191 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4efc4db3-9337-43d6-babc-a1339aee2b41 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c82752e1bc4fdb82e7f8391c7c129f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44352a7a6d964530aa20ae83064b02e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:03.611488 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4efc4db3-9337-43d6-babc-a1339aee2b41 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] 10.222.0.33 "GET /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64" status: 200 len: 1478 microversion: 2.1 time: 0.382581 Sep 23 04:35:03.625180 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 523/1121] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:03 2022] GET /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64 => generated 1478 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:03.630268 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-73c2e82b-188e-4079-9cc7-0e838f3ff240 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:03.631378 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-73c2e82b-188e-4079-9cc7-0e838f3ff240 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] [instance: f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:03.635660 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-989c0335-5e41-4e93-a7d0-af24458a3294 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.919952 Sep 23 04:35:03.636901 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 599/1122] 10.222.0.33 () {60 vars in 1180 bytes} [Fri Sep 23 04:35:02 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:35:03.646615 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-73c2e82b-188e-4079-9cc7-0e838f3ff240 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:03.647130 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-73c2e82b-188e-4079-9cc7-0e838f3ff240 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:03.647583 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-73c2e82b-188e-4079-9cc7-0e838f3ff240 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:03.648348 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-73c2e82b-188e-4079-9cc7-0e838f3ff240 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:03.648746 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-73c2e82b-188e-4079-9cc7-0e838f3ff240 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:03.649177 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-73c2e82b-188e-4079-9cc7-0e838f3ff240 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:03.787452 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d209fda8-b0f8-4444-9cd0-3c1b669f39ad tempest-ImagesDeleteNegativeTestJSON-761829360 tempest-ImagesDeleteNegativeTestJSON-761829360-project] 10.222.0.33 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.148644 Sep 23 04:35:03.788566 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 600/1123] 10.222.0.33 () {58 vars in 1128 bytes} [Fri Sep 23 04:35:03 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 23 04:35:03.796780 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-861c9e4c-d8f6-463c-917b-b821606bda09 tempest-FloatingIPsNegativeTestJSON-1652295977 tempest-FloatingIPsNegativeTestJSON-1652295977-project] Action: 'create', calling method: .version_select at 0x7ff1bb9f2ee0>, body: {"pool": "non_exist_pool"} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:35:03.876471 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-861c9e4c-d8f6-463c-917b-b821606bda09 tempest-FloatingIPsNegativeTestJSON-1652295977 tempest-FloatingIPsNegativeTestJSON-1652295977-project] HTTP exception thrown: Floating IP pool not found. Sep 23 04:35:03.881219 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-861c9e4c-d8f6-463c-917b-b821606bda09 tempest-FloatingIPsNegativeTestJSON-1652295977 tempest-FloatingIPsNegativeTestJSON-1652295977-project] Request method failure captured: Sep 23 04:35:03.881219 n-d-846463-3 devstack@n-api.service[122699]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Sep 23 04:35:03.881219 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:35:03.881219 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:35:03.881219 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:35:03.881219 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 26 Sep 23 04:35:03.881219 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:35:03.881219 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:35:03.881219 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:35:03.881219 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:35:03.881219 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTd1lc6mhH3AmMZ9bMhEny2lwixIe5iMCFGfNgKrXR5gSChM2P9OM5VBy4R9WqqPlhnwqWtLl27gGhuCfXNLof5NNCYdSFaPCU7ngur4HJK_5er9UBKmuBjT68mw4eZgG5Q4xtJTnRoh5bOfl6qHEAt85AuFjlBwAeaD6poRfPXCumM Sep 23 04:35:03.881219 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:35:03.881219 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:35:03.881219 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:35:03.881219 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:35:03.881219 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:35:03.881219 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:35:03.881219 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: edca30e5edfd4aa7831a0f671a27d7ea Sep 23 04:35:03.881219 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1652295977 Sep 23 04:35:03.881219 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:35:03.881219 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:35:03.883495 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_edca30e5edfd4aa7831a0f671a27d7ea", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/edca30e5edfd4aa7831a0f671a27d7ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/edca30e5edfd4aa7831a0f671a27d7ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/edca30e5edfd4aa7831a0f671a27d7ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:35:03.883495 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1652295977 Sep 23 04:35:03.883495 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: edca30e5edfd4aa7831a0f671a27d7ea Sep 23 04:35:03.883495 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1652295977 Sep 23 04:35:03.883495 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-FloatingIPsNegativeTestJSON-1652295977-project Sep 23 04:35:03.883495 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:35:03.883495 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:35:03.883495 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: edd1352ecf7b4022b874de06abe1c718 Sep 23 04:35:03.883495 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1652295977-project Sep 23 04:35:03.883495 n-d-846463-3 devstack@n-api.service[122699]: Sep 23 04:35:03.883495 n-d-846463-3 devstack@n-api.service[122699]: {"pool": "non_exist_pool"} Sep 23 04:35:03.883495 n-d-846463-3 devstack@n-api.service[122699]: method: Sep 23 04:35:03.883495 n-d-846463-3 devstack@n-api.service[122699]: exception: Floating IP pool not found. Sep 23 04:35:03.883495 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'body': {'pool': 'non_exist_pool'}} Sep 23 04:35:03.883495 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:35:03.884461 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:35:03.884461 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Sep 23 04:35:03.884461 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Sep 23 04:35:03.884461 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2972, in allocate_floating_ip Sep 23 04:35:03.884461 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Sep 23 04:35:03.884461 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2962, in _get_floating_ip_pool_id_by_name_or_id Sep 23 04:35:03.884461 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Sep 23 04:35:03.884461 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Sep 23 04:35:03.884461 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:35:03.884461 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:35:03.884461 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:35:03.884461 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:35:03.884461 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:35:03.884461 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:35:03.884461 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:35:03.884461 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:35:03.884461 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:35:03.884461 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:35:03.884461 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:35:03.884461 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:35:03.885827 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Sep 23 04:35:03.885827 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:35:03.885827 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Sep 23 04:35:03.885827 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:35:03.885827 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:35:03.885827 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:35:03.885827 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:35:03.885827 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:35:03.885827 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:35:03.885827 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:35:03.885827 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:35:03.885827 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Sep 23 04:35:03.885827 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:35:03.885827 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-861c9e4c-d8f6-463c-917b-b821606bda09 tempest-FloatingIPsNegativeTestJSON-1652295977 tempest-FloatingIPsNegativeTestJSON-1652295977-project] Returning 404 to user: Floating IP pool not found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:35:03.885827 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-861c9e4c-d8f6-463c-917b-b821606bda09 tempest-FloatingIPsNegativeTestJSON-1652295977 tempest-FloatingIPsNegativeTestJSON-1652295977-project] 10.222.0.33 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.095204 Sep 23 04:35:03.886764 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 601/1124] 10.222.0.33 () {60 vars in 1170 bytes} [Fri Sep 23 04:35:03 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 23 04:35:03.898415 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e90c81d9-361b-4ec9-9f61-7f445ba19795 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:03.899285 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e90c81d9-361b-4ec9-9f61-7f445ba19795 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: fbbf8d58-8edb-4172-9d19-4b82804bf8e9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:03.911529 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e90c81d9-361b-4ec9-9f61-7f445ba19795 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:03.912300 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e90c81d9-361b-4ec9-9f61-7f445ba19795 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:03.912823 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e90c81d9-361b-4ec9-9f61-7f445ba19795 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:03.913626 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e90c81d9-361b-4ec9-9f61-7f445ba19795 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:03.914217 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e90c81d9-361b-4ec9-9f61-7f445ba19795 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:03.915121 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e90c81d9-361b-4ec9-9f61-7f445ba19795 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:03.956567 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-73c2e82b-188e-4079-9cc7-0e838f3ff240 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c977d0e2ec64f8ca6b0923b9876c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f661d071bed2459cba4aa91e2b8b0d28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:03.967274 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-73c2e82b-188e-4079-9cc7-0e838f3ff240 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] 10.222.0.33 "GET /compute/v2.1/servers/f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b" status: 200 len: 1305 microversion: 2.1 time: 0.343047 Sep 23 04:35:03.968698 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 524/1125] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:03 2022] GET /compute/v2.1/servers/f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b => generated 1305 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:03.977654 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-181b6a38-9c30-4055-a712-be2d0a5a4a83 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:03.979256 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-181b6a38-9c30-4055-a712-be2d0a5a4a83 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 205bf02b-1478-4765-b2a6-d7014d9f0a64] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:03.999497 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-181b6a38-9c30-4055-a712-be2d0a5a4a83 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:04.000784 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-181b6a38-9c30-4055-a712-be2d0a5a4a83 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:04.001618 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-181b6a38-9c30-4055-a712-be2d0a5a4a83 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:04.004372 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-181b6a38-9c30-4055-a712-be2d0a5a4a83 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:04.005650 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-181b6a38-9c30-4055-a712-be2d0a5a4a83 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:04.006420 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-181b6a38-9c30-4055-a712-be2d0a5a4a83 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:04.284912 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e90c81d9-361b-4ec9-9f61-7f445ba19795 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:04.293613 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e90c81d9-361b-4ec9-9f61-7f445ba19795 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/fbbf8d58-8edb-4172-9d19-4b82804bf8e9" status: 200 len: 1537 microversion: 2.1 time: 0.406517 Sep 23 04:35:04.294157 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 602/1126] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:03 2022] GET /compute/v2.1/servers/fbbf8d58-8edb-4172-9d19-4b82804bf8e9 => generated 1537 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:04.299237 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-22349ca9-a439-4bb0-b34c-0a05af2ae1e1 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:04.300153 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-22349ca9-a439-4bb0-b34c-0a05af2ae1e1 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: 36165f99-56fa-427b-98b4-c79d41f1fe28] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:04.307462 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-22349ca9-a439-4bb0-b34c-0a05af2ae1e1 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:04.308305 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-22349ca9-a439-4bb0-b34c-0a05af2ae1e1 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:04.308968 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-22349ca9-a439-4bb0-b34c-0a05af2ae1e1 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:04.310192 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-22349ca9-a439-4bb0-b34c-0a05af2ae1e1 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:04.311103 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-22349ca9-a439-4bb0-b34c-0a05af2ae1e1 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:04.311782 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-22349ca9-a439-4bb0-b34c-0a05af2ae1e1 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:04.334306 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-181b6a38-9c30-4055-a712-be2d0a5a4a83 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:04.345804 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-181b6a38-9c30-4055-a712-be2d0a5a4a83 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:04.347307 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-181b6a38-9c30-4055-a712-be2d0a5a4a83 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:04.356655 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-181b6a38-9c30-4055-a712-be2d0a5a4a83 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/205bf02b-1478-4765-b2a6-d7014d9f0a64" status: 200 len: 1815 microversion: 2.25 time: 0.382507 Sep 23 04:35:04.368236 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 525/1127] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:35:03 2022] GET /compute/v2.1/servers/205bf02b-1478-4765-b2a6-d7014d9f0a64 => generated 1815 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:35:04.383302 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-802d729e-25f8-49df-abaf-9d169dd4e9f9 tempest-ImagesDeleteNegativeTestJSON-761829360 tempest-ImagesDeleteNegativeTestJSON-761829360-project] Calling method '.version_select at 0x7ff1bbc25af0>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:04.415637 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-802d729e-25f8-49df-abaf-9d169dd4e9f9 tempest-ImagesDeleteNegativeTestJSON-761829360 tempest-ImagesDeleteNegativeTestJSON-761829360-project] HTTP exception thrown: Image not found. Sep 23 04:35:04.418756 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-802d729e-25f8-49df-abaf-9d169dd4e9f9 tempest-ImagesDeleteNegativeTestJSON-761829360 tempest-ImagesDeleteNegativeTestJSON-761829360-project] Request method failure captured: Sep 23 04:35:04.418756 n-d-846463-3 devstack@n-api.service[122698]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Sep 23 04:35:04.418756 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:35:04.418756 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:35:04.418756 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:35:04.418756 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:35:04.418756 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:35:04.418756 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:35:04.418756 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:35:04.418756 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:35:04.418756 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTd23zPeYvGdgTNTDamdMz6nfUMffhSnbvUeXEtNLFcdrt44Bk3Gmlq_W6igr5zHhKvseKs7JhJ4WxdkX7TyvKm4MANJC75_qJ38Fj4CRZrhDHL2qvRYXWgLXnNl8O30U7V3hey1IsIStIF5m7e6QWmOeN4OK64wwZA1arlwbeXA-aw Sep 23 04:35:04.418756 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:35:04.418756 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:35:04.418756 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:35:04.418756 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:35:04.418756 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:35:04.418756 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:35:04.418756 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: e0831886759644fd8bd4c4b69f7dae47 Sep 23 04:35:04.418756 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-761829360 Sep 23 04:35:04.418756 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:35:04.418756 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:35:04.420356 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e0831886759644fd8bd4c4b69f7dae47", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e0831886759644fd8bd4c4b69f7dae47"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e0831886759644fd8bd4c4b69f7dae47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e0831886759644fd8bd4c4b69f7dae47"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:35:04.420356 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-761829360 Sep 23 04:35:04.420356 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: e0831886759644fd8bd4c4b69f7dae47 Sep 23 04:35:04.420356 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-761829360 Sep 23 04:35:04.420356 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ImagesDeleteNegativeTestJSON-761829360-project Sep 23 04:35:04.420356 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:35:04.420356 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:35:04.420356 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 4458c1e88cba44969c7dc06aae2ea114 Sep 23 04:35:04.420356 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-761829360-project Sep 23 04:35:04.420356 n-d-846463-3 devstack@n-api.service[122698]: method: Sep 23 04:35:04.420356 n-d-846463-3 devstack@n-api.service[122698]: exception: Image not found. Sep 23 04:35:04.420356 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '-1'} Sep 23 04:35:04.420356 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:35:04.420356 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:35:04.421631 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 23 04:35:04.421631 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 23 04:35:04.421631 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 23 04:35:04.421631 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 23 04:35:04.421631 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 23 04:35:04.421631 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 23 04:35:04.421631 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 23 04:35:04.421631 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 23 04:35:04.421631 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 23 04:35:04.421631 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 23 04:35:04.421631 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 23 04:35:04.421631 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 23 04:35:04.421631 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 23 04:35:04.421631 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 23 04:35:04.421631 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Sep 23 04:35:04.421631 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:35:04.421631 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:35:04.421631 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:35:04.421631 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:35:04.423071 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 23 04:35:04.423071 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 23 04:35:04.423071 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 23 04:35:04.423071 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 23 04:35:04.423071 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 23 04:35:04.423071 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 23 04:35:04.423071 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Sep 23 04:35:04.423071 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:35:04.423071 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:35:04.423071 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:35:04.423071 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:35:04.423071 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:35:04.423071 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:35:04.423071 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:35:04.423071 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:35:04.423071 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:35:04.423071 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:35:04.423071 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:35:04.423071 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:35:04.423071 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 23 04:35:04.424901 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 23 04:35:04.424901 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 23 04:35:04.424901 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:35:04.424901 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:35:04.424901 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:35:04.424901 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:35:04.424901 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:35:04.424901 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:35:04.424901 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:35:04.424901 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:35:04.424901 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 23 04:35:04.424901 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:35:04.424901 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-802d729e-25f8-49df-abaf-9d169dd4e9f9 tempest-ImagesDeleteNegativeTestJSON-761829360 tempest-ImagesDeleteNegativeTestJSON-761829360-project] Returning 404 to user: Image not found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:35:04.424901 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-802d729e-25f8-49df-abaf-9d169dd4e9f9 tempest-ImagesDeleteNegativeTestJSON-761829360 tempest-ImagesDeleteNegativeTestJSON-761829360-project] 10.222.0.33 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.048047 Sep 23 04:35:04.424901 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 526/1128] 10.222.0.33 () {58 vars in 1134 bytes} [Fri Sep 23 04:35:04 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 23 04:35:04.431458 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2bc37fa8-97fb-420b-b037-7ed24591841e tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-236007443", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "networks": [{"uuid": "2ff95ca0-aee5-4508-863c-ab6e447f0afd"}]}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:35:04.501737 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.network.neutron [None req-2bc37fa8-97fb-420b-b037-7ed24591841e tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] validate_networks() for [('2ff95ca0-aee5-4508-863c-ab6e447f0afd', None, None, None, None, None)] {{(pid=122698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:35:04.689988 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-22349ca9-a439-4bb0-b34c-0a05af2ae1e1 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:04.702461 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-22349ca9-a439-4bb0-b34c-0a05af2ae1e1 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/36165f99-56fa-427b-98b4-c79d41f1fe28" status: 200 len: 1504 microversion: 2.1 time: 0.406210 Sep 23 04:35:04.703730 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 603/1129] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:04 2022] GET /compute/v2.1/servers/36165f99-56fa-427b-98b4-c79d41f1fe28 => generated 1504 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:04.709152 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-965d6a80-1576-48ee-8dd1-79e8a563fc3c tempest-FloatingIPsNegativeTestJSON-1652295977 tempest-FloatingIPsNegativeTestJSON-1652295977-project] Calling method '.version_select at 0x7ff1bb9f25e0>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:04.813748 n-d-846463-3 devstack@n-api.service[122699]: DEBUG neutronclient.v2_0.client [None req-965d6a80-1576-48ee-8dd1-79e8a563fc3c tempest-FloatingIPsNegativeTestJSON-1652295977 tempest-FloatingIPsNegativeTestJSON-1652295977-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 6b5e76d1-28b1-42bd-9504-8a444a1398e7 could not be found", "detail": ""}} {{(pid=122699) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 23 04:35:04.815136 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-965d6a80-1576-48ee-8dd1-79e8a563fc3c tempest-FloatingIPsNegativeTestJSON-1652295977 tempest-FloatingIPsNegativeTestJSON-1652295977-project] HTTP exception thrown: Floating IP not found for ID 6b5e76d1-28b1-42bd-9504-8a444a1398e7 Sep 23 04:35:04.827438 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-965d6a80-1576-48ee-8dd1-79e8a563fc3c tempest-FloatingIPsNegativeTestJSON-1652295977 tempest-FloatingIPsNegativeTestJSON-1652295977-project] Request method failure captured: Sep 23 04:35:04.827438 n-d-846463-3 devstack@n-api.service[122699]: request: DELETE /compute/v2.1/os-floating-ips/6b5e76d1-28b1-42bd-9504-8a444a1398e7 HTTP/1.1 Sep 23 04:35:04.827438 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:35:04.827438 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:35:04.827438 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:35:04.827438 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:35:04.827438 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:35:04.827438 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:35:04.827438 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:35:04.827438 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:35:04.827438 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTd1lc6mhH3AmMZ9bMhEny2lwixIe5iMCFGfNgKrXR5gSChM2P9OM5VBy4R9WqqPlhnwqWtLl27gGhuCfXNLof5NNCYdSFaPCU7ngur4HJK_5er9UBKmuBjT68mw4eZgG5Q4xtJTnRoh5bOfl6qHEAt85AuFjlBwAeaD6poRfPXCumM Sep 23 04:35:04.827438 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:35:04.827438 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:35:04.827438 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:35:04.827438 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:35:04.827438 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:35:04.827438 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:35:04.827438 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: edca30e5edfd4aa7831a0f671a27d7ea Sep 23 04:35:04.827438 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1652295977 Sep 23 04:35:04.827438 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:35:04.827438 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:35:04.829024 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_edca30e5edfd4aa7831a0f671a27d7ea", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/edca30e5edfd4aa7831a0f671a27d7ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/edca30e5edfd4aa7831a0f671a27d7ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/edca30e5edfd4aa7831a0f671a27d7ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:35:04.829024 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1652295977 Sep 23 04:35:04.829024 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: edca30e5edfd4aa7831a0f671a27d7ea Sep 23 04:35:04.829024 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1652295977 Sep 23 04:35:04.829024 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-FloatingIPsNegativeTestJSON-1652295977-project Sep 23 04:35:04.829024 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:35:04.829024 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:35:04.829024 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: edd1352ecf7b4022b874de06abe1c718 Sep 23 04:35:04.829024 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1652295977-project Sep 23 04:35:04.829024 n-d-846463-3 devstack@n-api.service[122699]: method: Sep 23 04:35:04.829024 n-d-846463-3 devstack@n-api.service[122699]: exception: Floating IP not found for ID 6b5e76d1-28b1-42bd-9504-8a444a1398e7 Sep 23 04:35:04.829024 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '6b5e76d1-28b1-42bd-9504-8a444a1398e7'} Sep 23 04:35:04.829024 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:35:04.829965 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:35:04.829965 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Sep 23 04:35:04.829965 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Sep 23 04:35:04.829965 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:35:04.829965 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:35:04.829965 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Sep 23 04:35:04.829965 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Sep 23 04:35:04.829965 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:35:04.829965 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:35:04.829965 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 23 04:35:04.829965 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 23 04:35:04.829965 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:35:04.829965 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:35:04.829965 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 23 04:35:04.829965 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 23 04:35:04.829965 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:35:04.829965 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:35:04.829965 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 23 04:35:04.829965 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 23 04:35:04.831209 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:35:04.831209 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:35:04.831209 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 23 04:35:04.831209 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 23 04:35:04.831209 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 23 04:35:04.831209 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 23 04:35:04.831209 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 6b5e76d1-28b1-42bd-9504-8a444a1398e7 could not be found Sep 23 04:35:04.831209 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-273cebca-0708-4ae0-9a38-a2d394d7228e'] Sep 23 04:35:04.831209 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:35:04.831209 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:35:04.831209 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:35:04.831209 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:35:04.831209 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Sep 23 04:35:04.831209 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Sep 23 04:35:04.831209 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Sep 23 04:35:04.831209 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Sep 23 04:35:04.831209 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 6b5e76d1-28b1-42bd-9504-8a444a1398e7. Sep 23 04:35:04.831209 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:35:04.831209 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:35:04.831209 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:35:04.832636 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:35:04.832636 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:35:04.832636 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:35:04.832636 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:35:04.832636 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:35:04.832636 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:35:04.832636 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:35:04.832636 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:35:04.832636 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:35:04.832636 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Sep 23 04:35:04.832636 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 23 04:35:04.832636 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 6b5e76d1-28b1-42bd-9504-8a444a1398e7 Sep 23 04:35:04.832636 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:35:04.832636 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:35:04.832636 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:35:04.832636 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:35:04.832636 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:35:04.832636 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:35:04.832636 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:35:04.832636 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:35:04.835224 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 6b5e76d1-28b1-42bd-9504-8a444a1398e7 Sep 23 04:35:04.835224 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:35:04.835224 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-965d6a80-1576-48ee-8dd1-79e8a563fc3c tempest-FloatingIPsNegativeTestJSON-1652295977 tempest-FloatingIPsNegativeTestJSON-1652295977-project] Returning 404 to user: Floating IP not found for ID 6b5e76d1-28b1-42bd-9504-8a444a1398e7 {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:35:04.835224 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-965d6a80-1576-48ee-8dd1-79e8a563fc3c tempest-FloatingIPsNegativeTestJSON-1652295977 tempest-FloatingIPsNegativeTestJSON-1652295977-project] 10.222.0.33 "DELETE /compute/v2.1/os-floating-ips/6b5e76d1-28b1-42bd-9504-8a444a1398e7" status: 404 len: 111 microversion: 2.1 time: 0.124080 Sep 23 04:35:04.835224 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 604/1130] 10.222.0.33 () {58 vars in 1263 bytes} [Fri Sep 23 04:35:04 2022] DELETE /compute/v2.1/os-floating-ips/6b5e76d1-28b1-42bd-9504-8a444a1398e7 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:35:04.838230 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-55c0de0e-1a56-49f8-99e4-5e2ea3fed13e tempest-ImagesDeleteNegativeTestJSON-761829360 tempest-ImagesDeleteNegativeTestJSON-761829360-project] Calling method '.version_select at 0x7ff1bb9addc0>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:04.873816 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-55c0de0e-1a56-49f8-99e4-5e2ea3fed13e tempest-ImagesDeleteNegativeTestJSON-761829360 tempest-ImagesDeleteNegativeTestJSON-761829360-project] HTTP exception thrown: Image not found. Sep 23 04:35:04.875814 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-55c0de0e-1a56-49f8-99e4-5e2ea3fed13e tempest-ImagesDeleteNegativeTestJSON-761829360 tempest-ImagesDeleteNegativeTestJSON-761829360-project] Request method failure captured: Sep 23 04:35:04.875814 n-d-846463-3 devstack@n-api.service[122699]: request: DELETE /compute/v2.1/images/553be4d0-f82d-4d10-8281-f54023c2903j HTTP/1.1 Sep 23 04:35:04.875814 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:35:04.875814 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:35:04.875814 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:35:04.875814 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:35:04.875814 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:35:04.875814 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:35:04.875814 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:35:04.875814 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:35:04.875814 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTd23zPeYvGdgTNTDamdMz6nfUMffhSnbvUeXEtNLFcdrt44Bk3Gmlq_W6igr5zHhKvseKs7JhJ4WxdkX7TyvKm4MANJC75_qJ38Fj4CRZrhDHL2qvRYXWgLXnNl8O30U7V3hey1IsIStIF5m7e6QWmOeN4OK64wwZA1arlwbeXA-aw Sep 23 04:35:04.875814 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:35:04.875814 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:35:04.875814 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:35:04.875814 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:35:04.875814 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:35:04.875814 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:35:04.875814 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: e0831886759644fd8bd4c4b69f7dae47 Sep 23 04:35:04.875814 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-761829360 Sep 23 04:35:04.875814 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:35:04.875814 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:35:04.877648 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e0831886759644fd8bd4c4b69f7dae47", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e0831886759644fd8bd4c4b69f7dae47"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e0831886759644fd8bd4c4b69f7dae47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e0831886759644fd8bd4c4b69f7dae47"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:35:04.877648 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-761829360 Sep 23 04:35:04.877648 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: e0831886759644fd8bd4c4b69f7dae47 Sep 23 04:35:04.877648 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-761829360 Sep 23 04:35:04.877648 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ImagesDeleteNegativeTestJSON-761829360-project Sep 23 04:35:04.877648 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:35:04.877648 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:35:04.877648 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 4458c1e88cba44969c7dc06aae2ea114 Sep 23 04:35:04.877648 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-761829360-project Sep 23 04:35:04.877648 n-d-846463-3 devstack@n-api.service[122699]: method: Sep 23 04:35:04.877648 n-d-846463-3 devstack@n-api.service[122699]: exception: Image not found. Sep 23 04:35:04.877648 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '553be4d0-f82d-4d10-8281-f54023c2903j'} Sep 23 04:35:04.877648 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:35:04.878941 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:35:04.878941 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 23 04:35:04.878941 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 23 04:35:04.878941 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 23 04:35:04.878941 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 23 04:35:04.878941 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 23 04:35:04.878941 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 23 04:35:04.878941 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 23 04:35:04.878941 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 23 04:35:04.878941 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 23 04:35:04.878941 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 23 04:35:04.878941 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 23 04:35:04.878941 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 23 04:35:04.878941 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 23 04:35:04.878941 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 23 04:35:04.878941 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 553be4d0-f82d-4d10-8281-f54023c2903j to delete Sep 23 04:35:04.878941 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:35:04.878941 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:35:04.878941 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:35:04.880299 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:35:04.880299 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 23 04:35:04.880299 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 23 04:35:04.880299 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 23 04:35:04.880299 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 23 04:35:04.880299 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 23 04:35:04.880299 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 23 04:35:04.880299 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 553be4d0-f82d-4d10-8281-f54023c2903j could not be found. Sep 23 04:35:04.880299 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:35:04.880299 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:35:04.880299 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:35:04.880299 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:35:04.880299 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:35:04.880299 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:35:04.880299 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:35:04.880299 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:35:04.880299 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:35:04.880299 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:35:04.880299 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:35:04.880299 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:35:04.881523 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 23 04:35:04.881523 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 23 04:35:04.881523 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 23 04:35:04.881523 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:35:04.881523 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:35:04.881523 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:35:04.881523 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:35:04.881523 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:35:04.881523 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:35:04.881523 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:35:04.881523 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:35:04.881523 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 23 04:35:04.881523 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:35:04.881523 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-55c0de0e-1a56-49f8-99e4-5e2ea3fed13e tempest-ImagesDeleteNegativeTestJSON-761829360 tempest-ImagesDeleteNegativeTestJSON-761829360-project] Returning 404 to user: Image not found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:35:04.884299 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-55c0de0e-1a56-49f8-99e4-5e2ea3fed13e tempest-ImagesDeleteNegativeTestJSON-761829360 tempest-ImagesDeleteNegativeTestJSON-761829360-project] 10.222.0.33 "DELETE /compute/v2.1/images/553be4d0-f82d-4d10-8281-f54023c2903j" status: 404 len: 62 microversion: 2.1 time: 0.050697 Sep 23 04:35:04.884299 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 605/1131] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:04 2022] DELETE /compute/v2.1/images/553be4d0-f82d-4d10-8281-f54023c2903j => generated 62 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 23 04:35:04.901874 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-828de0f5-8d35-49cd-a5b1-59e398ae5cf1 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:04.902532 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-828de0f5-8d35-49cd-a5b1-59e398ae5cf1 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] [instance: f392741f-f967-4c1c-930b-4eea7272bf64] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:04.921104 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-828de0f5-8d35-49cd-a5b1-59e398ae5cf1 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:04.921605 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-828de0f5-8d35-49cd-a5b1-59e398ae5cf1 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:04.922185 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-828de0f5-8d35-49cd-a5b1-59e398ae5cf1 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:04.922915 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-828de0f5-8d35-49cd-a5b1-59e398ae5cf1 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:04.923371 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-828de0f5-8d35-49cd-a5b1-59e398ae5cf1 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:04.923799 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-828de0f5-8d35-49cd-a5b1-59e398ae5cf1 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:05.271381 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-828de0f5-8d35-49cd-a5b1-59e398ae5cf1 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c82752e1bc4fdb82e7f8391c7c129f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44352a7a6d964530aa20ae83064b02e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:05.285758 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-828de0f5-8d35-49cd-a5b1-59e398ae5cf1 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] 10.222.0.33 "GET /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64" status: 200 len: 1478 microversion: 2.1 time: 0.400172 Sep 23 04:35:05.286605 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 606/1132] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:04 2022] GET /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64 => generated 1478 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:05.296421 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-952634ed-2a01-471c-94dc-0f0e3cfa2dc2 tempest-ImagesDeleteNegativeTestJSON-761829360 tempest-ImagesDeleteNegativeTestJSON-761829360-project] Calling method '.version_select at 0x7ff1bbc99160>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:05.345442 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-952634ed-2a01-471c-94dc-0f0e3cfa2dc2 tempest-ImagesDeleteNegativeTestJSON-761829360 tempest-ImagesDeleteNegativeTestJSON-761829360-project] HTTP exception thrown: Image not found. Sep 23 04:35:05.345442 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-952634ed-2a01-471c-94dc-0f0e3cfa2dc2 tempest-ImagesDeleteNegativeTestJSON-761829360 tempest-ImagesDeleteNegativeTestJSON-761829360-project] Request method failure captured: Sep 23 04:35:05.345442 n-d-846463-3 devstack@n-api.service[122699]: request: DELETE /compute/v2.1/images/220eff83-124a-4810-b160-df21e01178f61 HTTP/1.1 Sep 23 04:35:05.345442 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:35:05.345442 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:35:05.345442 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:35:05.345442 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:35:05.345442 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:35:05.345442 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:35:05.345442 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:35:05.345442 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:35:05.345442 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTd23zPeYvGdgTNTDamdMz6nfUMffhSnbvUeXEtNLFcdrt44Bk3Gmlq_W6igr5zHhKvseKs7JhJ4WxdkX7TyvKm4MANJC75_qJ38Fj4CRZrhDHL2qvRYXWgLXnNl8O30U7V3hey1IsIStIF5m7e6QWmOeN4OK64wwZA1arlwbeXA-aw Sep 23 04:35:05.345442 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:35:05.345442 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:35:05.345442 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:35:05.345442 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:35:05.345442 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:35:05.345442 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:35:05.345442 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: e0831886759644fd8bd4c4b69f7dae47 Sep 23 04:35:05.345442 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-761829360 Sep 23 04:35:05.345442 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:35:05.345442 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:35:05.347075 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e0831886759644fd8bd4c4b69f7dae47", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e0831886759644fd8bd4c4b69f7dae47"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e0831886759644fd8bd4c4b69f7dae47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e0831886759644fd8bd4c4b69f7dae47"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:35:05.347075 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-761829360 Sep 23 04:35:05.347075 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: e0831886759644fd8bd4c4b69f7dae47 Sep 23 04:35:05.347075 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-761829360 Sep 23 04:35:05.347075 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ImagesDeleteNegativeTestJSON-761829360-project Sep 23 04:35:05.347075 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:35:05.347075 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:35:05.347075 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 4458c1e88cba44969c7dc06aae2ea114 Sep 23 04:35:05.347075 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-761829360-project Sep 23 04:35:05.347075 n-d-846463-3 devstack@n-api.service[122699]: method: Sep 23 04:35:05.347075 n-d-846463-3 devstack@n-api.service[122699]: exception: Image not found. Sep 23 04:35:05.347075 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '220eff83-124a-4810-b160-df21e01178f61'} Sep 23 04:35:05.347075 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:35:05.347865 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:35:05.347865 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 23 04:35:05.347865 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 23 04:35:05.347865 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 23 04:35:05.347865 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 23 04:35:05.347865 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 23 04:35:05.347865 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 23 04:35:05.347865 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 23 04:35:05.347865 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 23 04:35:05.347865 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 23 04:35:05.347865 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 23 04:35:05.347865 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 23 04:35:05.347865 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 23 04:35:05.347865 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 23 04:35:05.347865 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 23 04:35:05.347865 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 220eff83-124a-4810-b160-df21e01178f61 to delete Sep 23 04:35:05.347865 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:35:05.347865 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:35:05.347865 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:35:05.350569 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:35:05.350569 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 23 04:35:05.350569 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 23 04:35:05.350569 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 23 04:35:05.350569 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 23 04:35:05.350569 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 23 04:35:05.350569 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 23 04:35:05.350569 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 220eff83-124a-4810-b160-df21e01178f61 could not be found. Sep 23 04:35:05.350569 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:35:05.350569 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:35:05.350569 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:35:05.350569 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:35:05.350569 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:35:05.350569 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:35:05.350569 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:35:05.350569 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:35:05.350569 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:35:05.350569 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:35:05.350569 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:35:05.350569 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:35:05.352140 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 23 04:35:05.352140 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 23 04:35:05.352140 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 23 04:35:05.352140 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:35:05.352140 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:35:05.352140 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:35:05.352140 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:35:05.352140 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:35:05.352140 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:35:05.352140 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:35:05.352140 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:35:05.352140 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 23 04:35:05.352140 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:35:05.352140 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-952634ed-2a01-471c-94dc-0f0e3cfa2dc2 tempest-ImagesDeleteNegativeTestJSON-761829360 tempest-ImagesDeleteNegativeTestJSON-761829360-project] Returning 404 to user: Image not found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:35:05.352140 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-952634ed-2a01-471c-94dc-0f0e3cfa2dc2 tempest-ImagesDeleteNegativeTestJSON-761829360 tempest-ImagesDeleteNegativeTestJSON-761829360-project] 10.222.0.33 "DELETE /compute/v2.1/images/220eff83-124a-4810-b160-df21e01178f61" status: 404 len: 62 microversion: 2.1 time: 0.055200 Sep 23 04:35:05.353208 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 607/1133] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:35:05 2022] DELETE /compute/v2.1/images/220eff83-124a-4810-b160-df21e01178f61 => generated 62 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 23 04:35:05.354690 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4ad38954-e5d1-4ead-a8c1-86dc0f6130d5 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:05.355319 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4ad38954-e5d1-4ead-a8c1-86dc0f6130d5 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] [instance: f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:05.362126 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4ad38954-e5d1-4ead-a8c1-86dc0f6130d5 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:05.362624 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4ad38954-e5d1-4ead-a8c1-86dc0f6130d5 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:05.363062 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4ad38954-e5d1-4ead-a8c1-86dc0f6130d5 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:05.363768 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4ad38954-e5d1-4ead-a8c1-86dc0f6130d5 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:05.364227 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4ad38954-e5d1-4ead-a8c1-86dc0f6130d5 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:05.364643 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4ad38954-e5d1-4ead-a8c1-86dc0f6130d5 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:05.488481 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-2bc37fa8-97fb-420b-b037-7ed24591841e tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Flavor limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:35:05.490382 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-2bc37fa8-97fb-420b-b037-7ed24591841e tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Image limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:35:05.491417 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-2bc37fa8-97fb-420b-b037-7ed24591841e tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Flavor pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:35:05.493651 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-2bc37fa8-97fb-420b-b037-7ed24591841e tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Image pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:35:05.494614 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-2bc37fa8-97fb-420b-b037-7ed24591841e tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:35:05.517288 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2bc37fa8-97fb-420b-b037-7ed24591841e tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:05.517792 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2bc37fa8-97fb-420b-b037-7ed24591841e tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:05.518254 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2bc37fa8-97fb-420b-b037-7ed24591841e tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:05.523812 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2bc37fa8-97fb-420b-b037-7ed24591841e tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:05.524597 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2bc37fa8-97fb-420b-b037-7ed24591841e tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:05.525240 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2bc37fa8-97fb-420b-b037-7ed24591841e tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:05.547038 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-2bc37fa8-97fb-420b-b037-7ed24591841e tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Getting quotas for project a3f931b8de0b4402a3833577fbb15607. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:35:05.553419 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-2bc37fa8-97fb-420b-b037-7ed24591841e tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Getting quotas for user 8a00bc3e62774185b48120832e80476d and project a3f931b8de0b4402a3833577fbb15607. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:35:05.573033 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-2bc37fa8-97fb-420b-b037-7ed24591841e tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Going to run 1 instances... {{(pid=122698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:35:05.576100 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-2bc37fa8-97fb-420b-b037-7ed24591841e tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] [instance: 19a775ff-efab-43d1-9a67-9ed31f6d1fc4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:35:05.632451 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-4ad38954-e5d1-4ead-a8c1-86dc0f6130d5 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c977d0e2ec64f8ca6b0923b9876c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f661d071bed2459cba4aa91e2b8b0d28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:05.642473 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4ad38954-e5d1-4ead-a8c1-86dc0f6130d5 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] 10.222.0.33 "GET /compute/v2.1/servers/f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b" status: 200 len: 1293 microversion: 2.1 time: 0.296700 Sep 23 04:35:05.643549 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 608/1134] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:05 2022] GET /compute/v2.1/servers/f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b => generated 1293 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:05.649962 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1e2fe2fc-664d-4cf2-bdaf-33c281c2e4ed tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:05.652193 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1e2fe2fc-664d-4cf2-bdaf-33c281c2e4ed tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: fbbf8d58-8edb-4172-9d19-4b82804bf8e9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:05.663317 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e2fe2fc-664d-4cf2-bdaf-33c281c2e4ed tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:05.664183 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e2fe2fc-664d-4cf2-bdaf-33c281c2e4ed tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:05.665015 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e2fe2fc-664d-4cf2-bdaf-33c281c2e4ed tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:05.666649 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e2fe2fc-664d-4cf2-bdaf-33c281c2e4ed tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:05.667231 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e2fe2fc-664d-4cf2-bdaf-33c281c2e4ed tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:05.667688 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e2fe2fc-664d-4cf2-bdaf-33c281c2e4ed tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:05.728217 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2bc37fa8-97fb-420b-b037-7ed24591841e tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.303698 Sep 23 04:35:05.729413 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 527/1135] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:35:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1305 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:35:05.739728 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-cb1bd9d3-2bef-4d93-8b31-d8528a0066ba tempest-ImagesDeleteNegativeTestJSON-761829360 tempest-ImagesDeleteNegativeTestJSON-761829360-project] Calling method '.version_select at 0x7ff1bbb4d700>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:05.767630 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-cb1bd9d3-2bef-4d93-8b31-d8528a0066ba tempest-ImagesDeleteNegativeTestJSON-761829360 tempest-ImagesDeleteNegativeTestJSON-761829360-project] HTTP exception thrown: Image not found. Sep 23 04:35:05.769668 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-cb1bd9d3-2bef-4d93-8b31-d8528a0066ba tempest-ImagesDeleteNegativeTestJSON-761829360 tempest-ImagesDeleteNegativeTestJSON-761829360-project] Request method failure captured: Sep 23 04:35:05.769668 n-d-846463-3 devstack@n-api.service[122698]: request: DELETE /compute/v2.1/images/tempest-invalid-1106599423 HTTP/1.1 Sep 23 04:35:05.769668 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:35:05.769668 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:35:05.769668 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:35:05.769668 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:35:05.769668 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:35:05.769668 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:35:05.769668 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:35:05.769668 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:35:05.769668 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTd23zPeYvGdgTNTDamdMz6nfUMffhSnbvUeXEtNLFcdrt44Bk3Gmlq_W6igr5zHhKvseKs7JhJ4WxdkX7TyvKm4MANJC75_qJ38Fj4CRZrhDHL2qvRYXWgLXnNl8O30U7V3hey1IsIStIF5m7e6QWmOeN4OK64wwZA1arlwbeXA-aw Sep 23 04:35:05.769668 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:35:05.769668 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:35:05.769668 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:35:05.769668 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:35:05.769668 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:35:05.769668 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:35:05.769668 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: e0831886759644fd8bd4c4b69f7dae47 Sep 23 04:35:05.769668 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-761829360 Sep 23 04:35:05.769668 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:35:05.769668 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:35:05.771108 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e0831886759644fd8bd4c4b69f7dae47", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e0831886759644fd8bd4c4b69f7dae47"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e0831886759644fd8bd4c4b69f7dae47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e0831886759644fd8bd4c4b69f7dae47"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:35:05.771108 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-761829360 Sep 23 04:35:05.771108 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: e0831886759644fd8bd4c4b69f7dae47 Sep 23 04:35:05.771108 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-761829360 Sep 23 04:35:05.771108 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ImagesDeleteNegativeTestJSON-761829360-project Sep 23 04:35:05.771108 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:35:05.771108 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:35:05.771108 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 4458c1e88cba44969c7dc06aae2ea114 Sep 23 04:35:05.771108 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-761829360-project Sep 23 04:35:05.771108 n-d-846463-3 devstack@n-api.service[122698]: method: Sep 23 04:35:05.771108 n-d-846463-3 devstack@n-api.service[122698]: exception: Image not found. Sep 23 04:35:05.771108 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': 'tempest-invalid-1106599423'} Sep 23 04:35:05.771108 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:35:05.771947 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:35:05.771947 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 23 04:35:05.771947 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 23 04:35:05.771947 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 23 04:35:05.771947 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 23 04:35:05.771947 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 23 04:35:05.771947 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 23 04:35:05.771947 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 23 04:35:05.771947 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 23 04:35:05.771947 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 23 04:35:05.771947 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 23 04:35:05.771947 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 23 04:35:05.771947 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 23 04:35:05.771947 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 23 04:35:05.771947 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 23 04:35:05.771947 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-1106599423 to delete Sep 23 04:35:05.771947 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:35:05.771947 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:35:05.771947 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:35:05.773643 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:35:05.773643 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 23 04:35:05.773643 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 23 04:35:05.773643 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 23 04:35:05.773643 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 23 04:35:05.773643 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 23 04:35:05.773643 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 23 04:35:05.773643 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-1106599423 could not be found. Sep 23 04:35:05.773643 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:35:05.773643 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:35:05.773643 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:35:05.773643 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:35:05.773643 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:35:05.773643 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:35:05.773643 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:35:05.773643 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:35:05.773643 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:35:05.773643 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:35:05.773643 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:35:05.773643 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:35:05.774937 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 23 04:35:05.774937 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 23 04:35:05.774937 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 23 04:35:05.774937 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:35:05.774937 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:35:05.774937 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:35:05.774937 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:35:05.774937 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:35:05.774937 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:35:05.774937 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:35:05.774937 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:35:05.774937 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 23 04:35:05.774937 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:35:05.774937 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-cb1bd9d3-2bef-4d93-8b31-d8528a0066ba tempest-ImagesDeleteNegativeTestJSON-761829360 tempest-ImagesDeleteNegativeTestJSON-761829360-project] Returning 404 to user: Image not found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:35:05.774937 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-cb1bd9d3-2bef-4d93-8b31-d8528a0066ba tempest-ImagesDeleteNegativeTestJSON-761829360 tempest-ImagesDeleteNegativeTestJSON-761829360-project] 10.222.0.33 "DELETE /compute/v2.1/images/tempest-invalid-1106599423" status: 404 len: 62 microversion: 2.1 time: 0.039527 Sep 23 04:35:05.776533 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 528/1136] 10.222.0.33 () {58 vars in 1206 bytes} [Fri Sep 23 04:35:05 2022] DELETE /compute/v2.1/images/tempest-invalid-1106599423 => generated 62 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 23 04:35:05.779572 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-67503e5a-ad0a-4169-8b29-122e85f86aa2 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:05.790612 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-67503e5a-ad0a-4169-8b29-122e85f86aa2 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 205bf02b-1478-4765-b2a6-d7014d9f0a64] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:05.799170 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-67503e5a-ad0a-4169-8b29-122e85f86aa2 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:05.799674 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-67503e5a-ad0a-4169-8b29-122e85f86aa2 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:05.800122 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-67503e5a-ad0a-4169-8b29-122e85f86aa2 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:05.801226 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-67503e5a-ad0a-4169-8b29-122e85f86aa2 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:05.801704 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-67503e5a-ad0a-4169-8b29-122e85f86aa2 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:05.802162 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-67503e5a-ad0a-4169-8b29-122e85f86aa2 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:06.011068 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1e2fe2fc-664d-4cf2-bdaf-33c281c2e4ed tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:06.020766 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1e2fe2fc-664d-4cf2-bdaf-33c281c2e4ed tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/fbbf8d58-8edb-4172-9d19-4b82804bf8e9" status: 200 len: 1542 microversion: 2.1 time: 0.375783 Sep 23 04:35:06.022374 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 609/1137] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:05 2022] GET /compute/v2.1/servers/fbbf8d58-8edb-4172-9d19-4b82804bf8e9 => generated 1542 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:06.027442 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d75e90a7-f860-4ce2-ac71-b10fff75c99c tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:06.028397 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d75e90a7-f860-4ce2-ac71-b10fff75c99c tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: 36165f99-56fa-427b-98b4-c79d41f1fe28] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:06.035556 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d75e90a7-f860-4ce2-ac71-b10fff75c99c tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:06.036727 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d75e90a7-f860-4ce2-ac71-b10fff75c99c tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:06.037726 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d75e90a7-f860-4ce2-ac71-b10fff75c99c tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:06.039086 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d75e90a7-f860-4ce2-ac71-b10fff75c99c tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:06.039777 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d75e90a7-f860-4ce2-ac71-b10fff75c99c tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:06.040808 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d75e90a7-f860-4ce2-ac71-b10fff75c99c tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:06.136481 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-67503e5a-ad0a-4169-8b29-122e85f86aa2 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:06.146429 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-67503e5a-ad0a-4169-8b29-122e85f86aa2 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:06.148107 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-67503e5a-ad0a-4169-8b29-122e85f86aa2 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:06.150105 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-67503e5a-ad0a-4169-8b29-122e85f86aa2 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/205bf02b-1478-4765-b2a6-d7014d9f0a64" status: 200 len: 1805 microversion: 2.25 time: 0.377100 Sep 23 04:35:06.151199 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 529/1138] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:35:05 2022] GET /compute/v2.1/servers/205bf02b-1478-4765-b2a6-d7014d9f0a64 => generated 1805 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:35:06.157703 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7915ac05-19ac-4754-bef1-3774345b3c9e tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:06.158610 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7915ac05-19ac-4754-bef1-3774345b3c9e tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] [instance: 19a775ff-efab-43d1-9a67-9ed31f6d1fc4] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:06.166306 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=3,nova_api:INSERT=3 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:35:06.265078 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-7915ac05-19ac-4754-bef1-3774345b3c9e tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a00bc3e62774185b48120832e80476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f931b8de0b4402a3833577fbb15607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:06.276526 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7915ac05-19ac-4754-bef1-3774345b3c9e tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] 10.222.0.33 "GET /compute/v2.1/servers/19a775ff-efab-43d1-9a67-9ed31f6d1fc4" status: 200 len: 1215 microversion: 2.1 time: 0.123900 Sep 23 04:35:06.290102 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 530/1139] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:06 2022] GET /compute/v2.1/servers/19a775ff-efab-43d1-9a67-9ed31f6d1fc4 => generated 1215 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:06.296275 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f425b3aa-a15f-417c-8fa5-14864c4f37bf tempest-ImagesDeleteNegativeTestJSON-761829360 tempest-ImagesDeleteNegativeTestJSON-761829360-project] Calling method '.version_select at 0x7ff1bbbf9790>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:06.308515 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d75e90a7-f860-4ce2-ac71-b10fff75c99c tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:06.317656 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d75e90a7-f860-4ce2-ac71-b10fff75c99c tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/36165f99-56fa-427b-98b4-c79d41f1fe28" status: 200 len: 1504 microversion: 2.1 time: 0.294065 Sep 23 04:35:06.319315 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 610/1140] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:06 2022] GET /compute/v2.1/servers/36165f99-56fa-427b-98b4-c79d41f1fe28 => generated 1504 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:06.341613 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3d1a2ee0-acb3-49eb-b329-3f8aaa06ae61 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Calling method '.version_select at 0x7ff1bb9adf70>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:06.347497 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-f425b3aa-a15f-417c-8fa5-14864c4f37bf tempest-ImagesDeleteNegativeTestJSON-761829360 tempest-ImagesDeleteNegativeTestJSON-761829360-project] HTTP exception thrown: Image not found. Sep 23 04:35:06.349474 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f425b3aa-a15f-417c-8fa5-14864c4f37bf tempest-ImagesDeleteNegativeTestJSON-761829360 tempest-ImagesDeleteNegativeTestJSON-761829360-project] Request method failure captured: Sep 23 04:35:06.349474 n-d-846463-3 devstack@n-api.service[122698]: request: DELETE /compute/v2.1/images/222b1945-4b40-4de1-941a-3754b3004387 HTTP/1.1 Sep 23 04:35:06.349474 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:35:06.349474 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:35:06.349474 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:35:06.349474 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:35:06.349474 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:35:06.349474 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:35:06.349474 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:35:06.349474 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:35:06.349474 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTd23zPeYvGdgTNTDamdMz6nfUMffhSnbvUeXEtNLFcdrt44Bk3Gmlq_W6igr5zHhKvseKs7JhJ4WxdkX7TyvKm4MANJC75_qJ38Fj4CRZrhDHL2qvRYXWgLXnNl8O30U7V3hey1IsIStIF5m7e6QWmOeN4OK64wwZA1arlwbeXA-aw Sep 23 04:35:06.349474 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:35:06.349474 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:35:06.349474 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:35:06.349474 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:35:06.349474 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:35:06.349474 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:35:06.349474 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: e0831886759644fd8bd4c4b69f7dae47 Sep 23 04:35:06.349474 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-761829360 Sep 23 04:35:06.349474 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:35:06.349474 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:35:06.350903 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e0831886759644fd8bd4c4b69f7dae47", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e0831886759644fd8bd4c4b69f7dae47"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e0831886759644fd8bd4c4b69f7dae47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e0831886759644fd8bd4c4b69f7dae47"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:35:06.350903 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-761829360 Sep 23 04:35:06.350903 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: e0831886759644fd8bd4c4b69f7dae47 Sep 23 04:35:06.350903 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-761829360 Sep 23 04:35:06.350903 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ImagesDeleteNegativeTestJSON-761829360-project Sep 23 04:35:06.350903 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:35:06.350903 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:35:06.350903 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 4458c1e88cba44969c7dc06aae2ea114 Sep 23 04:35:06.350903 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-761829360-project Sep 23 04:35:06.350903 n-d-846463-3 devstack@n-api.service[122698]: method: Sep 23 04:35:06.350903 n-d-846463-3 devstack@n-api.service[122698]: exception: Image not found. Sep 23 04:35:06.350903 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '222b1945-4b40-4de1-941a-3754b3004387'} Sep 23 04:35:06.350903 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:35:06.351777 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:35:06.351777 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 23 04:35:06.351777 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 23 04:35:06.351777 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 23 04:35:06.351777 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 23 04:35:06.351777 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 23 04:35:06.351777 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 23 04:35:06.351777 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 23 04:35:06.351777 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 23 04:35:06.351777 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 23 04:35:06.351777 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 23 04:35:06.351777 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 23 04:35:06.351777 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 23 04:35:06.351777 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 23 04:35:06.351777 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 23 04:35:06.351777 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 222b1945-4b40-4de1-941a-3754b3004387 to delete Sep 23 04:35:06.351777 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:35:06.351777 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:35:06.351777 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:35:06.358902 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:35:06.358902 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 23 04:35:06.358902 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 23 04:35:06.358902 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 23 04:35:06.358902 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 23 04:35:06.358902 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 23 04:35:06.358902 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 23 04:35:06.358902 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 222b1945-4b40-4de1-941a-3754b3004387 could not be found. Sep 23 04:35:06.358902 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:35:06.358902 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:35:06.358902 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:35:06.358902 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:35:06.358902 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:35:06.358902 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:35:06.358902 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:35:06.358902 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:35:06.358902 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:35:06.358902 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:35:06.358902 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:35:06.358902 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:35:06.361874 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 23 04:35:06.361874 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 23 04:35:06.361874 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 23 04:35:06.361874 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:35:06.361874 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:35:06.361874 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:35:06.361874 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:35:06.361874 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:35:06.361874 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:35:06.361874 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:35:06.361874 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:35:06.361874 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 23 04:35:06.361874 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:35:06.361874 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f425b3aa-a15f-417c-8fa5-14864c4f37bf tempest-ImagesDeleteNegativeTestJSON-761829360 tempest-ImagesDeleteNegativeTestJSON-761829360-project] Returning 404 to user: Image not found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:35:06.361874 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f425b3aa-a15f-417c-8fa5-14864c4f37bf tempest-ImagesDeleteNegativeTestJSON-761829360 tempest-ImagesDeleteNegativeTestJSON-761829360-project] 10.222.0.33 "DELETE /compute/v2.1/images/222b1945-4b40-4de1-941a-3754b3004387" status: 404 len: 62 microversion: 2.1 time: 0.060094 Sep 23 04:35:06.370280 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 531/1141] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:06 2022] DELETE /compute/v2.1/images/222b1945-4b40-4de1-941a-3754b3004387 => generated 62 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 23 04:35:06.375519 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3d1a2ee0-acb3-49eb-b329-3f8aaa06ae61 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:06.376691 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-d8f0511e-d94b-4bc3-877b-44657584a929 req-bcdd61ff-fa7a-4b38-9cf0-b43e5de92301 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f392741f-f967-4c1c-930b-4eea7272bf64", "name": "network-vif-unplugged", "status": "completed", "tag": "a8e6bde0-f854-4040-8b7f-b369ce18b326"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:35:06.377725 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3d1a2ee0-acb3-49eb-b329-3f8aaa06ae61 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:06.378878 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3d1a2ee0-acb3-49eb-b329-3f8aaa06ae61 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:06.402696 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-d8f0511e-d94b-4bc3-877b-44657584a929 req-bcdd61ff-fa7a-4b38-9cf0-b43e5de92301 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:06.405778 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3d1a2ee0-acb3-49eb-b329-3f8aaa06ae61 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] 10.222.0.33 "GET /compute/v2.1/os-migrations" status: 200 len: 3869 microversion: 2.25 time: 0.085177 Sep 23 04:35:06.406175 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-d8f0511e-d94b-4bc3-877b-44657584a929 req-bcdd61ff-fa7a-4b38-9cf0-b43e5de92301 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:06.406917 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-d8f0511e-d94b-4bc3-877b-44657584a929 req-bcdd61ff-fa7a-4b38-9cf0-b43e5de92301 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:06.410336 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 611/1142] 10.222.0.33 () {60 vars in 1184 bytes} [Fri Sep 23 04:35:06 2022] GET /compute/v2.1/os-migrations => generated 3869 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:35:06.415722 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-66a485e5-b64e-4b2c-ad05-9ac8cf073bfe tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:06.422888 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-66a485e5-b64e-4b2c-ad05-9ac8cf073bfe tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] [instance: f392741f-f967-4c1c-930b-4eea7272bf64] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:06.426910 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-d8f0511e-d94b-4bc3-877b-44657584a929 req-bcdd61ff-fa7a-4b38-9cf0-b43e5de92301 service nova] Creating event network-vif-unplugged:a8e6bde0-f854-4040-8b7f-b369ce18b326 for instance f392741f-f967-4c1c-930b-4eea7272bf64 on n-h1-846463-3 Sep 23 04:35:06.436627 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-66a485e5-b64e-4b2c-ad05-9ac8cf073bfe tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:06.437638 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-66a485e5-b64e-4b2c-ad05-9ac8cf073bfe tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:06.439789 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-66a485e5-b64e-4b2c-ad05-9ac8cf073bfe tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:06.440352 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-66a485e5-b64e-4b2c-ad05-9ac8cf073bfe tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:06.440858 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-66a485e5-b64e-4b2c-ad05-9ac8cf073bfe tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:06.441308 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-d8f0511e-d94b-4bc3-877b-44657584a929 req-bcdd61ff-fa7a-4b38-9cf0-b43e5de92301 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.085892 Sep 23 04:35:06.441954 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 532/1143] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:35:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:35:06.442636 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-66a485e5-b64e-4b2c-ad05-9ac8cf073bfe tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:06.456946 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-758909d5-ab81-43d1-bc5a-44e399db9e64 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:06.461444 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-758909d5-ab81-43d1-bc5a-44e399db9e64 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] [instance: 205bf02b-1478-4765-b2a6-d7014d9f0a64] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:06.484330 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-758909d5-ab81-43d1-bc5a-44e399db9e64 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:06.484853 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-758909d5-ab81-43d1-bc5a-44e399db9e64 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:06.485362 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-758909d5-ab81-43d1-bc5a-44e399db9e64 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:06.486136 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-758909d5-ab81-43d1-bc5a-44e399db9e64 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:06.486605 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-758909d5-ab81-43d1-bc5a-44e399db9e64 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:06.487041 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-758909d5-ab81-43d1-bc5a-44e399db9e64 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:07.057149 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-758909d5-ab81-43d1-bc5a-44e399db9e64 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lazy-loading 'services' on Instance uuid 205bf02b-1478-4765-b2a6-d7014d9f0a64 {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:35:07.066178 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-66a485e5-b64e-4b2c-ad05-9ac8cf073bfe tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c82752e1bc4fdb82e7f8391c7c129f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44352a7a6d964530aa20ae83064b02e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:07.076323 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-66a485e5-b64e-4b2c-ad05-9ac8cf073bfe tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] 10.222.0.33 "GET /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64" status: 200 len: 1478 microversion: 2.1 time: 0.664231 Sep 23 04:35:07.080633 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 612/1144] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:06 2022] GET /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64 => generated 1478 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:07.090053 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1b25f115-f952-4579-9cb0-a731e8f5ca64 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:07.091854 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1b25f115-f952-4579-9cb0-a731e8f5ca64 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] [instance: f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:07.099030 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1b25f115-f952-4579-9cb0-a731e8f5ca64 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:07.100060 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1b25f115-f952-4579-9cb0-a731e8f5ca64 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:07.100728 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1b25f115-f952-4579-9cb0-a731e8f5ca64 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:07.101651 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1b25f115-f952-4579-9cb0-a731e8f5ca64 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:07.102502 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1b25f115-f952-4579-9cb0-a731e8f5ca64 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:07.104737 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1b25f115-f952-4579-9cb0-a731e8f5ca64 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:07.106604 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-758909d5-ab81-43d1-bc5a-44e399db9e64 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/205bf02b-1478-4765-b2a6-d7014d9f0a64" status: 200 len: 2424 microversion: 2.25 time: 0.661274 Sep 23 04:35:07.107217 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 533/1145] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:35:06 2022] GET /compute/v2.1/servers/205bf02b-1478-4765-b2a6-d7014d9f0a64 => generated 2424 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:35:07.122487 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e4e7241e-2754-4e67-a8bf-e858501aefe7 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:07.124067 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e4e7241e-2754-4e67-a8bf-e858501aefe7 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: fbbf8d58-8edb-4172-9d19-4b82804bf8e9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:07.131973 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e4e7241e-2754-4e67-a8bf-e858501aefe7 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:07.132738 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e4e7241e-2754-4e67-a8bf-e858501aefe7 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:07.133395 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e4e7241e-2754-4e67-a8bf-e858501aefe7 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:07.140021 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e4e7241e-2754-4e67-a8bf-e858501aefe7 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:07.140771 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e4e7241e-2754-4e67-a8bf-e858501aefe7 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:07.143704 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e4e7241e-2754-4e67-a8bf-e858501aefe7 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:07.145142 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=100 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:35:07.521836 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1b25f115-f952-4579-9cb0-a731e8f5ca64 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c977d0e2ec64f8ca6b0923b9876c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f661d071bed2459cba4aa91e2b8b0d28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:07.532452 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1b25f115-f952-4579-9cb0-a731e8f5ca64 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] 10.222.0.33 "GET /compute/v2.1/servers/f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b" status: 200 len: 1293 microversion: 2.1 time: 0.453421 Sep 23 04:35:07.533697 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 613/1146] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:07 2022] GET /compute/v2.1/servers/f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b => generated 1293 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:07.539256 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2e3a05a5-3cd4-48b9-b886-4ed9a8abc53f tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:07.540169 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-2e3a05a5-3cd4-48b9-b886-4ed9a8abc53f tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] [instance: 205bf02b-1478-4765-b2a6-d7014d9f0a64] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:07.541217 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e4e7241e-2754-4e67-a8bf-e858501aefe7 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:07.548369 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2e3a05a5-3cd4-48b9-b886-4ed9a8abc53f tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:07.549948 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2e3a05a5-3cd4-48b9-b886-4ed9a8abc53f tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:07.550807 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2e3a05a5-3cd4-48b9-b886-4ed9a8abc53f tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:07.551842 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e4e7241e-2754-4e67-a8bf-e858501aefe7 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/fbbf8d58-8edb-4172-9d19-4b82804bf8e9" status: 200 len: 1542 microversion: 2.1 time: 0.439600 Sep 23 04:35:07.552551 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2e3a05a5-3cd4-48b9-b886-4ed9a8abc53f tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:07.553000 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 534/1147] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:07 2022] GET /compute/v2.1/servers/fbbf8d58-8edb-4172-9d19-4b82804bf8e9 => generated 1542 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:07.553700 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2e3a05a5-3cd4-48b9-b886-4ed9a8abc53f tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:07.554466 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2e3a05a5-3cd4-48b9-b886-4ed9a8abc53f tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:07.561582 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7b1c1a04-e7f2-4636-9f79-ac2a7b773274 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:07.566307 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7b1c1a04-e7f2-4636-9f79-ac2a7b773274 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] [instance: 19a775ff-efab-43d1-9a67-9ed31f6d1fc4] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:07.574103 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7b1c1a04-e7f2-4636-9f79-ac2a7b773274 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:07.574666 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7b1c1a04-e7f2-4636-9f79-ac2a7b773274 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:07.579834 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7b1c1a04-e7f2-4636-9f79-ac2a7b773274 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:07.579834 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7b1c1a04-e7f2-4636-9f79-ac2a7b773274 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:07.580059 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7b1c1a04-e7f2-4636-9f79-ac2a7b773274 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:07.580454 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7b1c1a04-e7f2-4636-9f79-ac2a7b773274 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:07.675981 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-7b1c1a04-e7f2-4636-9f79-ac2a7b773274 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a00bc3e62774185b48120832e80476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f931b8de0b4402a3833577fbb15607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:07.695461 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7b1c1a04-e7f2-4636-9f79-ac2a7b773274 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] 10.222.0.33 "GET /compute/v2.1/servers/19a775ff-efab-43d1-9a67-9ed31f6d1fc4" status: 200 len: 1219 microversion: 2.1 time: 0.141286 Sep 23 04:35:07.696304 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 535/1148] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:07 2022] GET /compute/v2.1/servers/19a775ff-efab-43d1-9a67-9ed31f6d1fc4 => generated 1219 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:07.701935 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d10d44eb-4f6c-418a-9c11-b1a281e7bb39 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:07.702740 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d10d44eb-4f6c-418a-9c11-b1a281e7bb39 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: 36165f99-56fa-427b-98b4-c79d41f1fe28] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:07.716270 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d10d44eb-4f6c-418a-9c11-b1a281e7bb39 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:07.717012 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d10d44eb-4f6c-418a-9c11-b1a281e7bb39 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:07.717663 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d10d44eb-4f6c-418a-9c11-b1a281e7bb39 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:07.718498 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d10d44eb-4f6c-418a-9c11-b1a281e7bb39 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:07.720385 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d10d44eb-4f6c-418a-9c11-b1a281e7bb39 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:07.721028 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d10d44eb-4f6c-418a-9c11-b1a281e7bb39 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:07.992430 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d10d44eb-4f6c-418a-9c11-b1a281e7bb39 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:07.993038 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-2e3a05a5-3cd4-48b9-b886-4ed9a8abc53f tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lazy-loading 'services' on Instance uuid 205bf02b-1478-4765-b2a6-d7014d9f0a64 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:35:08.006169 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d10d44eb-4f6c-418a-9c11-b1a281e7bb39 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/36165f99-56fa-427b-98b4-c79d41f1fe28" status: 200 len: 1504 microversion: 2.1 time: 0.305367 Sep 23 04:35:08.012237 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 536/1149] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:07 2022] GET /compute/v2.1/servers/36165f99-56fa-427b-98b4-c79d41f1fe28 => generated 1504 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:08.029790 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2e3a05a5-3cd4-48b9-b886-4ed9a8abc53f tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/205bf02b-1478-4765-b2a6-d7014d9f0a64" status: 200 len: 2424 microversion: 2.25 time: 0.494694 Sep 23 04:35:08.030420 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 614/1150] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:35:07 2022] GET /compute/v2.1/servers/205bf02b-1478-4765-b2a6-d7014d9f0a64 => generated 2424 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:35:08.100738 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a5149bff-157a-4406-ab6c-08da359c6439 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:08.101349 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a5149bff-157a-4406-ab6c-08da359c6439 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] [instance: f392741f-f967-4c1c-930b-4eea7272bf64] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:08.113548 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a5149bff-157a-4406-ab6c-08da359c6439 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:08.114144 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a5149bff-157a-4406-ab6c-08da359c6439 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:08.114598 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a5149bff-157a-4406-ab6c-08da359c6439 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:08.115328 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a5149bff-157a-4406-ab6c-08da359c6439 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:08.117740 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a5149bff-157a-4406-ab6c-08da359c6439 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:08.122546 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a5149bff-157a-4406-ab6c-08da359c6439 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:08.154300 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8b4e6f22-4b04-497b-b636-f62295273f34 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:08.154300 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-8b4e6f22-4b04-497b-b636-f62295273f34 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 205bf02b-1478-4765-b2a6-d7014d9f0a64] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:08.172895 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8b4e6f22-4b04-497b-b636-f62295273f34 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:08.177369 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8b4e6f22-4b04-497b-b636-f62295273f34 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:08.177369 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8b4e6f22-4b04-497b-b636-f62295273f34 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:08.177369 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8b4e6f22-4b04-497b-b636-f62295273f34 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:08.178218 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8b4e6f22-4b04-497b-b636-f62295273f34 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:08.180681 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8b4e6f22-4b04-497b-b636-f62295273f34 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:08.443987 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-8b4e6f22-4b04-497b-b636-f62295273f34 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lazy-loading 'services' on Instance uuid 205bf02b-1478-4765-b2a6-d7014d9f0a64 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:35:08.554683 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a5149bff-157a-4406-ab6c-08da359c6439 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c82752e1bc4fdb82e7f8391c7c129f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44352a7a6d964530aa20ae83064b02e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:08.568378 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a5149bff-157a-4406-ab6c-08da359c6439 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] 10.222.0.33 "GET /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64" status: 200 len: 1478 microversion: 2.1 time: 0.471538 Sep 23 04:35:08.571372 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 537/1151] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:08 2022] GET /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64 => generated 1478 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:08.593221 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-fb02526a-4460-4244-b87c-efb9e0a7ecdf tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:08.593221 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-fb02526a-4460-4244-b87c-efb9e0a7ecdf tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] [instance: f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:08.599637 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fb02526a-4460-4244-b87c-efb9e0a7ecdf tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:08.600366 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fb02526a-4460-4244-b87c-efb9e0a7ecdf tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:08.600990 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fb02526a-4460-4244-b87c-efb9e0a7ecdf tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:08.601820 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fb02526a-4460-4244-b87c-efb9e0a7ecdf tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:08.602395 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fb02526a-4460-4244-b87c-efb9e0a7ecdf tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:08.603048 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fb02526a-4460-4244-b87c-efb9e0a7ecdf tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:08.818382 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-8b4e6f22-4b04-497b-b636-f62295273f34 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "DELETE /compute/v2.1/servers/205bf02b-1478-4765-b2a6-d7014d9f0a64/os-volume_attachments/3c95fad3-89bf-4df1-ac53-107de940e36d" status: 202 len: 0 microversion: 2.25 time: 0.671829 Sep 23 04:35:08.821722 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 615/1152] 10.222.0.33 () {60 vars in 1457 bytes} [Fri Sep 23 04:35:08 2022] DELETE /compute/v2.1/servers/205bf02b-1478-4765-b2a6-d7014d9f0a64/os-volume_attachments/3c95fad3-89bf-4df1-ac53-107de940e36d => generated 0 bytes in 676 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:35:08.829606 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-99a32465-3152-463d-ac85-86de35010079 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:08.833844 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-99a32465-3152-463d-ac85-86de35010079 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: fbbf8d58-8edb-4172-9d19-4b82804bf8e9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:08.837416 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:35:08.844782 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-99a32465-3152-463d-ac85-86de35010079 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:08.846061 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-99a32465-3152-463d-ac85-86de35010079 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:08.846871 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-99a32465-3152-463d-ac85-86de35010079 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:08.847826 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-99a32465-3152-463d-ac85-86de35010079 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:08.849085 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-99a32465-3152-463d-ac85-86de35010079 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:08.849739 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-99a32465-3152-463d-ac85-86de35010079 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:08.873343 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-fb02526a-4460-4244-b87c-efb9e0a7ecdf tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c977d0e2ec64f8ca6b0923b9876c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f661d071bed2459cba4aa91e2b8b0d28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:08.881469 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-fb02526a-4460-4244-b87c-efb9e0a7ecdf tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] 10.222.0.33 "GET /compute/v2.1/servers/f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b" status: 200 len: 1293 microversion: 2.1 time: 0.298413 Sep 23 04:35:08.882199 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 538/1153] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:08 2022] GET /compute/v2.1/servers/f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b => generated 1293 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:08.888953 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9523a185-a3c1-4510-b740-ab539a9d7fa8 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:08.889843 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-9523a185-a3c1-4510-b740-ab539a9d7fa8 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] [instance: 19a775ff-efab-43d1-9a67-9ed31f6d1fc4] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:08.896725 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9523a185-a3c1-4510-b740-ab539a9d7fa8 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:08.897483 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9523a185-a3c1-4510-b740-ab539a9d7fa8 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:08.898242 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9523a185-a3c1-4510-b740-ab539a9d7fa8 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:08.899229 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9523a185-a3c1-4510-b740-ab539a9d7fa8 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:08.908441 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9523a185-a3c1-4510-b740-ab539a9d7fa8 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:08.908441 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9523a185-a3c1-4510-b740-ab539a9d7fa8 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:08.990527 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-9523a185-a3c1-4510-b740-ab539a9d7fa8 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a00bc3e62774185b48120832e80476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f931b8de0b4402a3833577fbb15607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:09.002186 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9523a185-a3c1-4510-b740-ab539a9d7fa8 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] 10.222.0.33 "GET /compute/v2.1/servers/19a775ff-efab-43d1-9a67-9ed31f6d1fc4" status: 200 len: 1267 microversion: 2.1 time: 0.118407 Sep 23 04:35:09.002854 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 539/1154] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:08 2022] GET /compute/v2.1/servers/19a775ff-efab-43d1-9a67-9ed31f6d1fc4 => generated 1267 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:09.027616 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-bc8a9c53-5d59-4e92-b5e3-f37e09a48d9d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:09.029454 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-bc8a9c53-5d59-4e92-b5e3-f37e09a48d9d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 205bf02b-1478-4765-b2a6-d7014d9f0a64] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:09.052872 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bc8a9c53-5d59-4e92-b5e3-f37e09a48d9d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:09.052872 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bc8a9c53-5d59-4e92-b5e3-f37e09a48d9d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:09.055913 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bc8a9c53-5d59-4e92-b5e3-f37e09a48d9d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:09.058255 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bc8a9c53-5d59-4e92-b5e3-f37e09a48d9d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:09.060503 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bc8a9c53-5d59-4e92-b5e3-f37e09a48d9d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:09.061132 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bc8a9c53-5d59-4e92-b5e3-f37e09a48d9d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:09.099955 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-bc8a9c53-5d59-4e92-b5e3-f37e09a48d9d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/205bf02b-1478-4765-b2a6-d7014d9f0a64/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.095930 Sep 23 04:35:09.105419 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 540/1155] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Sep 23 04:35:09 2022] GET /compute/v2.1/servers/205bf02b-1478-4765-b2a6-d7014d9f0a64/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 04:35:09.142666 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8bb4042b-9b19-4353-a68c-fb47db222188 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:09.142666 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8bb4042b-9b19-4353-a68c-fb47db222188 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: 36165f99-56fa-427b-98b4-c79d41f1fe28] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:09.153251 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8bb4042b-9b19-4353-a68c-fb47db222188 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:09.153993 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8bb4042b-9b19-4353-a68c-fb47db222188 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:09.154620 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8bb4042b-9b19-4353-a68c-fb47db222188 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:09.155541 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8bb4042b-9b19-4353-a68c-fb47db222188 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:09.156196 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8bb4042b-9b19-4353-a68c-fb47db222188 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:09.156815 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8bb4042b-9b19-4353-a68c-fb47db222188 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:09.160187 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:35:09.179248 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-99a32465-3152-463d-ac85-86de35010079 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:09.189682 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-99a32465-3152-463d-ac85-86de35010079 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/fbbf8d58-8edb-4172-9d19-4b82804bf8e9" status: 200 len: 1542 microversion: 2.1 time: 0.365354 Sep 23 04:35:09.201289 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 616/1156] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:08 2022] GET /compute/v2.1/servers/fbbf8d58-8edb-4172-9d19-4b82804bf8e9 => generated 1542 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:09.449043 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8bb4042b-9b19-4353-a68c-fb47db222188 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:09.459119 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8bb4042b-9b19-4353-a68c-fb47db222188 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/36165f99-56fa-427b-98b4-c79d41f1fe28" status: 200 len: 1504 microversion: 2.1 time: 0.349373 Sep 23 04:35:09.459119 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 541/1157] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:09 2022] GET /compute/v2.1/servers/36165f99-56fa-427b-98b4-c79d41f1fe28 => generated 1504 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:09.596988 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4e059284-e7ca-419e-a28b-95804a1545b5 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:09.597620 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4e059284-e7ca-419e-a28b-95804a1545b5 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] [instance: f392741f-f967-4c1c-930b-4eea7272bf64] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:09.606966 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4e059284-e7ca-419e-a28b-95804a1545b5 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:09.607463 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4e059284-e7ca-419e-a28b-95804a1545b5 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:09.609915 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4e059284-e7ca-419e-a28b-95804a1545b5 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:09.610681 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4e059284-e7ca-419e-a28b-95804a1545b5 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:09.611159 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4e059284-e7ca-419e-a28b-95804a1545b5 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:09.613596 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4e059284-e7ca-419e-a28b-95804a1545b5 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:09.837501 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-4e059284-e7ca-419e-a28b-95804a1545b5 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c82752e1bc4fdb82e7f8391c7c129f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44352a7a6d964530aa20ae83064b02e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:09.848112 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4e059284-e7ca-419e-a28b-95804a1545b5 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] 10.222.0.33 "GET /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64" status: 200 len: 1478 microversion: 2.1 time: 0.255001 Sep 23 04:35:09.849437 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 617/1158] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:09 2022] GET /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64 => generated 1478 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:09.907225 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-68f9ce61-0509-4a65-ba64-725d1865aabb tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:09.908106 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-68f9ce61-0509-4a65-ba64-725d1865aabb tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] [instance: f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:09.926489 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-68f9ce61-0509-4a65-ba64-725d1865aabb tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:09.927205 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-68f9ce61-0509-4a65-ba64-725d1865aabb tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:09.927806 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-68f9ce61-0509-4a65-ba64-725d1865aabb tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:09.928688 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-68f9ce61-0509-4a65-ba64-725d1865aabb tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:09.929307 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-68f9ce61-0509-4a65-ba64-725d1865aabb tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:09.930031 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-68f9ce61-0509-4a65-ba64-725d1865aabb tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:10.035404 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-59967e52-bd19-4b82-9ce5-66c09b0b82b4 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:10.036219 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-59967e52-bd19-4b82-9ce5-66c09b0b82b4 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] [instance: 19a775ff-efab-43d1-9a67-9ed31f6d1fc4] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:10.050425 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-59967e52-bd19-4b82-9ce5-66c09b0b82b4 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:10.052677 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-59967e52-bd19-4b82-9ce5-66c09b0b82b4 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:10.053237 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-59967e52-bd19-4b82-9ce5-66c09b0b82b4 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:10.058865 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-59967e52-bd19-4b82-9ce5-66c09b0b82b4 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:10.059676 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-59967e52-bd19-4b82-9ce5-66c09b0b82b4 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:10.060340 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-59967e52-bd19-4b82-9ce5-66c09b0b82b4 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:10.287574 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-59967e52-bd19-4b82-9ce5-66c09b0b82b4 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a00bc3e62774185b48120832e80476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f931b8de0b4402a3833577fbb15607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:10.307784 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-59967e52-bd19-4b82-9ce5-66c09b0b82b4 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] 10.222.0.33 "GET /compute/v2.1/servers/19a775ff-efab-43d1-9a67-9ed31f6d1fc4" status: 200 len: 1273 microversion: 2.1 time: 0.276561 Sep 23 04:35:10.331330 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 618/1159] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:10 2022] GET /compute/v2.1/servers/19a775ff-efab-43d1-9a67-9ed31f6d1fc4 => generated 1273 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:10.350179 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-db82481c-753d-42b9-badd-2f9d48463b4c req-3b1559b5-676b-45f1-ac99-4c9482d97a02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f392741f-f967-4c1c-930b-4eea7272bf64", "name": "network-vif-plugged", "status": "completed", "tag": "a8e6bde0-f854-4040-8b7f-b369ce18b326"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:35:10.368092 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-68f9ce61-0509-4a65-ba64-725d1865aabb tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c977d0e2ec64f8ca6b0923b9876c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f661d071bed2459cba4aa91e2b8b0d28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:10.374354 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-db82481c-753d-42b9-badd-2f9d48463b4c req-3b1559b5-676b-45f1-ac99-4c9482d97a02 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:10.375018 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-db82481c-753d-42b9-badd-2f9d48463b4c req-3b1559b5-676b-45f1-ac99-4c9482d97a02 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:10.377984 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-68f9ce61-0509-4a65-ba64-725d1865aabb tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] 10.222.0.33 "GET /compute/v2.1/servers/f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b" status: 200 len: 1293 microversion: 2.1 time: 0.474520 Sep 23 04:35:10.378136 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-db82481c-753d-42b9-badd-2f9d48463b4c req-3b1559b5-676b-45f1-ac99-4c9482d97a02 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:10.379867 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 542/1160] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:09 2022] GET /compute/v2.1/servers/f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b => generated 1293 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:10.386610 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3e2b1635-bff2-4a99-9443-752f09ad51bd tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:10.389461 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3e2b1635-bff2-4a99-9443-752f09ad51bd tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 205bf02b-1478-4765-b2a6-d7014d9f0a64] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:10.400836 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3e2b1635-bff2-4a99-9443-752f09ad51bd tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:10.404878 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3e2b1635-bff2-4a99-9443-752f09ad51bd tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:10.404878 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3e2b1635-bff2-4a99-9443-752f09ad51bd tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:10.404878 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3e2b1635-bff2-4a99-9443-752f09ad51bd tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:10.404878 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3e2b1635-bff2-4a99-9443-752f09ad51bd tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:10.405220 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3e2b1635-bff2-4a99-9443-752f09ad51bd tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:10.418947 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-db82481c-753d-42b9-badd-2f9d48463b4c req-3b1559b5-676b-45f1-ac99-4c9482d97a02 service nova] Creating event network-vif-plugged:a8e6bde0-f854-4040-8b7f-b369ce18b326 for instance f392741f-f967-4c1c-930b-4eea7272bf64 on n-h1-846463-3 Sep 23 04:35:10.430840 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-db82481c-753d-42b9-badd-2f9d48463b4c req-3b1559b5-676b-45f1-ac99-4c9482d97a02 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105447 Sep 23 04:35:10.439273 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 619/1161] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:35:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:35:10.445469 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f3a0b204-b3f3-4912-a8ce-cc798a82ea45 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:10.446763 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f3a0b204-b3f3-4912-a8ce-cc798a82ea45 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: fbbf8d58-8edb-4172-9d19-4b82804bf8e9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:10.461293 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f3a0b204-b3f3-4912-a8ce-cc798a82ea45 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:10.461799 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f3a0b204-b3f3-4912-a8ce-cc798a82ea45 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:10.465468 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f3a0b204-b3f3-4912-a8ce-cc798a82ea45 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:10.470853 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3e2b1635-bff2-4a99-9443-752f09ad51bd tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/205bf02b-1478-4765-b2a6-d7014d9f0a64/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.089545 Sep 23 04:35:10.475837 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f3a0b204-b3f3-4912-a8ce-cc798a82ea45 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:10.475837 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f3a0b204-b3f3-4912-a8ce-cc798a82ea45 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:10.475837 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f3a0b204-b3f3-4912-a8ce-cc798a82ea45 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:10.476290 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 543/1162] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Sep 23 04:35:10 2022] GET /compute/v2.1/servers/205bf02b-1478-4765-b2a6-d7014d9f0a64/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 04:35:10.496436 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1329d779-ce62-46ad-8381-8ebc844700af tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:10.497090 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-1329d779-ce62-46ad-8381-8ebc844700af tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: 36165f99-56fa-427b-98b4-c79d41f1fe28] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:10.512840 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1329d779-ce62-46ad-8381-8ebc844700af tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:10.513350 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1329d779-ce62-46ad-8381-8ebc844700af tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:10.513797 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1329d779-ce62-46ad-8381-8ebc844700af tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:10.514546 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1329d779-ce62-46ad-8381-8ebc844700af tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:10.515014 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1329d779-ce62-46ad-8381-8ebc844700af tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:10.515443 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1329d779-ce62-46ad-8381-8ebc844700af tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:10.976374 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f3a0b204-b3f3-4912-a8ce-cc798a82ea45 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:10.989147 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f3a0b204-b3f3-4912-a8ce-cc798a82ea45 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/fbbf8d58-8edb-4172-9d19-4b82804bf8e9" status: 200 len: 1542 microversion: 2.1 time: 0.555809 Sep 23 04:35:10.990002 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 620/1163] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:10 2022] GET /compute/v2.1/servers/fbbf8d58-8edb-4172-9d19-4b82804bf8e9 => generated 1542 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:10.996082 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-fb415efd-6803-4527-961c-869d80312867 req-4a2c1cf5-94ad-4d3a-ad06-f6d80e4de758 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36165f99-56fa-427b-98b4-c79d41f1fe28", "name": "network-vif-unplugged", "status": "completed", "tag": "0d971d87-a72a-48a8-adf7-e1b2b7f60e03"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:35:11.008758 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-fb415efd-6803-4527-961c-869d80312867 req-4a2c1cf5-94ad-4d3a-ad06-f6d80e4de758 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:11.010305 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-fb415efd-6803-4527-961c-869d80312867 req-4a2c1cf5-94ad-4d3a-ad06-f6d80e4de758 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:11.013937 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-fb415efd-6803-4527-961c-869d80312867 req-4a2c1cf5-94ad-4d3a-ad06-f6d80e4de758 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:11.035161 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-fb415efd-6803-4527-961c-869d80312867 req-4a2c1cf5-94ad-4d3a-ad06-f6d80e4de758 service nova] Creating event network-vif-unplugged:0d971d87-a72a-48a8-adf7-e1b2b7f60e03 for instance 36165f99-56fa-427b-98b4-c79d41f1fe28 on n-h2-846463-3 Sep 23 04:35:11.043490 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-fb415efd-6803-4527-961c-869d80312867 req-4a2c1cf5-94ad-4d3a-ad06-f6d80e4de758 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052100 Sep 23 04:35:11.045708 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 621/1164] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:35:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:35:11.060026 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-47584ddb-bff8-44db-b11e-4c551b745220 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:11.060026 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-47584ddb-bff8-44db-b11e-4c551b745220 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] [instance: f392741f-f967-4c1c-930b-4eea7272bf64] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:11.061052 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-1329d779-ce62-46ad-8381-8ebc844700af tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:11.065284 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-1329d779-ce62-46ad-8381-8ebc844700af tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/36165f99-56fa-427b-98b4-c79d41f1fe28" status: 200 len: 1504 microversion: 2.1 time: 0.581407 Sep 23 04:35:11.074455 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-47584ddb-bff8-44db-b11e-4c551b745220 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:11.075271 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-47584ddb-bff8-44db-b11e-4c551b745220 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:11.076481 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-47584ddb-bff8-44db-b11e-4c551b745220 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:11.077674 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-47584ddb-bff8-44db-b11e-4c551b745220 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:11.078849 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-47584ddb-bff8-44db-b11e-4c551b745220 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:11.079489 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-47584ddb-bff8-44db-b11e-4c551b745220 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:11.082377 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 544/1165] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:10 2022] GET /compute/v2.1/servers/36165f99-56fa-427b-98b4-c79d41f1fe28 => generated 1504 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:11.341230 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-13090592-37e6-4318-9379-034ba16ca78b tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:11.341859 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-13090592-37e6-4318-9379-034ba16ca78b tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] [instance: 19a775ff-efab-43d1-9a67-9ed31f6d1fc4] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:11.352852 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-13090592-37e6-4318-9379-034ba16ca78b tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:11.353966 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-13090592-37e6-4318-9379-034ba16ca78b tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:11.357741 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-47584ddb-bff8-44db-b11e-4c551b745220 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c82752e1bc4fdb82e7f8391c7c129f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44352a7a6d964530aa20ae83064b02e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:11.359816 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-13090592-37e6-4318-9379-034ba16ca78b tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:11.362240 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-13090592-37e6-4318-9379-034ba16ca78b tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:11.362545 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-13090592-37e6-4318-9379-034ba16ca78b tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:11.362990 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-13090592-37e6-4318-9379-034ba16ca78b tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:11.374140 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-47584ddb-bff8-44db-b11e-4c551b745220 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] 10.222.0.33 "GET /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64" status: 200 len: 1478 microversion: 2.1 time: 0.325668 Sep 23 04:35:11.377161 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 622/1166] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:11 2022] GET /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64 => generated 1478 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:11.406246 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4ca4242c-7288-4e8f-ac17-02bdd6c171e9 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:11.407539 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4ca4242c-7288-4e8f-ac17-02bdd6c171e9 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] [instance: f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:11.422279 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4ca4242c-7288-4e8f-ac17-02bdd6c171e9 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:11.424002 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4ca4242c-7288-4e8f-ac17-02bdd6c171e9 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:11.426053 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4ca4242c-7288-4e8f-ac17-02bdd6c171e9 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:11.429073 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4ca4242c-7288-4e8f-ac17-02bdd6c171e9 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:11.435845 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4ca4242c-7288-4e8f-ac17-02bdd6c171e9 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:11.435845 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4ca4242c-7288-4e8f-ac17-02bdd6c171e9 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:12.115487 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-13090592-37e6-4318-9379-034ba16ca78b tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a00bc3e62774185b48120832e80476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f931b8de0b4402a3833577fbb15607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:12.125304 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-13090592-37e6-4318-9379-034ba16ca78b tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] 10.222.0.33 "GET /compute/v2.1/servers/19a775ff-efab-43d1-9a67-9ed31f6d1fc4" status: 200 len: 1315 microversion: 2.1 time: 0.789341 Sep 23 04:35:12.125918 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 545/1167] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:11 2022] GET /compute/v2.1/servers/19a775ff-efab-43d1-9a67-9ed31f6d1fc4 => generated 1315 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:12.136394 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4f40c613-537e-4246-9074-d17672a93e74 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:12.146254 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4f40c613-537e-4246-9074-d17672a93e74 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 205bf02b-1478-4765-b2a6-d7014d9f0a64] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:12.158584 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4f40c613-537e-4246-9074-d17672a93e74 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:12.159092 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4f40c613-537e-4246-9074-d17672a93e74 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:12.159538 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4f40c613-537e-4246-9074-d17672a93e74 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:12.160344 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4f40c613-537e-4246-9074-d17672a93e74 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:12.162161 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4f40c613-537e-4246-9074-d17672a93e74 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:12.162627 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4f40c613-537e-4246-9074-d17672a93e74 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:12.174578 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-4ca4242c-7288-4e8f-ac17-02bdd6c171e9 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c977d0e2ec64f8ca6b0923b9876c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f661d071bed2459cba4aa91e2b8b0d28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:12.184422 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4ca4242c-7288-4e8f-ac17-02bdd6c171e9 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] 10.222.0.33 "GET /compute/v2.1/servers/f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b" status: 200 len: 1293 microversion: 2.1 time: 0.782130 Sep 23 04:35:12.186673 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 623/1168] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:11 2022] GET /compute/v2.1/servers/f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b => generated 1293 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:12.205937 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-498c84bc-66b6-430c-af02-f63751da493c tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:12.206856 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-498c84bc-66b6-430c-af02-f63751da493c tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: fbbf8d58-8edb-4172-9d19-4b82804bf8e9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:12.219896 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-498c84bc-66b6-430c-af02-f63751da493c tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:12.223923 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-498c84bc-66b6-430c-af02-f63751da493c tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:12.224556 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4f40c613-537e-4246-9074-d17672a93e74 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/205bf02b-1478-4765-b2a6-d7014d9f0a64/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.094842 Sep 23 04:35:12.224755 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-498c84bc-66b6-430c-af02-f63751da493c tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:12.226079 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-498c84bc-66b6-430c-af02-f63751da493c tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:12.226558 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-498c84bc-66b6-430c-af02-f63751da493c tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:12.226994 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-498c84bc-66b6-430c-af02-f63751da493c tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:12.230920 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 546/1169] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Sep 23 04:35:12 2022] GET /compute/v2.1/servers/205bf02b-1478-4765-b2a6-d7014d9f0a64/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 04:35:12.239514 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9dfa29ef-b250-4627-800f-d37c57d37db1 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:12.244272 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-9dfa29ef-b250-4627-800f-d37c57d37db1 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: 36165f99-56fa-427b-98b4-c79d41f1fe28] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:12.255700 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9dfa29ef-b250-4627-800f-d37c57d37db1 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:12.256462 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9dfa29ef-b250-4627-800f-d37c57d37db1 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:12.262568 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9dfa29ef-b250-4627-800f-d37c57d37db1 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:12.263327 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9dfa29ef-b250-4627-800f-d37c57d37db1 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:12.263809 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9dfa29ef-b250-4627-800f-d37c57d37db1 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:12.264240 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9dfa29ef-b250-4627-800f-d37c57d37db1 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:12.870176 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-498c84bc-66b6-430c-af02-f63751da493c tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:12.878150 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-498c84bc-66b6-430c-af02-f63751da493c tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/fbbf8d58-8edb-4172-9d19-4b82804bf8e9" status: 200 len: 1542 microversion: 2.1 time: 0.689740 Sep 23 04:35:12.878748 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 624/1170] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:12 2022] GET /compute/v2.1/servers/fbbf8d58-8edb-4172-9d19-4b82804bf8e9 => generated 1542 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:12.895063 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-eeddd8b3-18f6-47ce-b8e5-c56f409bae51 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:12.899865 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-eeddd8b3-18f6-47ce-b8e5-c56f409bae51 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] [instance: f392741f-f967-4c1c-930b-4eea7272bf64] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:12.919845 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eeddd8b3-18f6-47ce-b8e5-c56f409bae51 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:12.920548 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eeddd8b3-18f6-47ce-b8e5-c56f409bae51 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:12.921004 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eeddd8b3-18f6-47ce-b8e5-c56f409bae51 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:12.921746 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eeddd8b3-18f6-47ce-b8e5-c56f409bae51 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:12.922403 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eeddd8b3-18f6-47ce-b8e5-c56f409bae51 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:12.923026 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eeddd8b3-18f6-47ce-b8e5-c56f409bae51 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:12.999711 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-9dfa29ef-b250-4627-800f-d37c57d37db1 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:13.013205 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9dfa29ef-b250-4627-800f-d37c57d37db1 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/36165f99-56fa-427b-98b4-c79d41f1fe28" status: 200 len: 1504 microversion: 2.1 time: 0.780918 Sep 23 04:35:13.017133 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 547/1171] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:12 2022] GET /compute/v2.1/servers/36165f99-56fa-427b-98b4-c79d41f1fe28 => generated 1504 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:13.148487 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-dfb7b5ce-4471-4f9a-bd19-0ef72800499c tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:13.149998 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-dfb7b5ce-4471-4f9a-bd19-0ef72800499c tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] [instance: 19a775ff-efab-43d1-9a67-9ed31f6d1fc4] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:13.164610 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dfb7b5ce-4471-4f9a-bd19-0ef72800499c tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:13.166582 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dfb7b5ce-4471-4f9a-bd19-0ef72800499c tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:13.168079 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dfb7b5ce-4471-4f9a-bd19-0ef72800499c tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:13.168977 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dfb7b5ce-4471-4f9a-bd19-0ef72800499c tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:13.170730 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dfb7b5ce-4471-4f9a-bd19-0ef72800499c tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:13.175037 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dfb7b5ce-4471-4f9a-bd19-0ef72800499c tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:13.354150 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-eeddd8b3-18f6-47ce-b8e5-c56f409bae51 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c82752e1bc4fdb82e7f8391c7c129f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44352a7a6d964530aa20ae83064b02e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:13.372693 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-eeddd8b3-18f6-47ce-b8e5-c56f409bae51 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] 10.222.0.33 "GET /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64" status: 200 len: 1478 microversion: 2.1 time: 0.486036 Sep 23 04:35:13.373611 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 625/1172] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:12 2022] GET /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64 => generated 1478 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:13.378178 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-28537fef-84c2-4d03-a435-e11c42447885 req-e6177dfc-c673-4867-8033-67a19867b9ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36165f99-56fa-427b-98b4-c79d41f1fe28", "tag": "0d971d87-a72a-48a8-adf7-e1b2b7f60e03"}, {"name": "network-changed", "server_uuid": "19a775ff-efab-43d1-9a67-9ed31f6d1fc4", "tag": "f1fb3ae7-413d-4c1c-a6ae-6f6d50cb1cf1"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:35:13.398472 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-28537fef-84c2-4d03-a435-e11c42447885 req-e6177dfc-c673-4867-8033-67a19867b9ba service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:13.398960 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-28537fef-84c2-4d03-a435-e11c42447885 req-e6177dfc-c673-4867-8033-67a19867b9ba service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:13.399396 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-28537fef-84c2-4d03-a435-e11c42447885 req-e6177dfc-c673-4867-8033-67a19867b9ba service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:13.421725 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-28537fef-84c2-4d03-a435-e11c42447885 req-e6177dfc-c673-4867-8033-67a19867b9ba service nova] Creating event network-changed:0d971d87-a72a-48a8-adf7-e1b2b7f60e03 for instance 36165f99-56fa-427b-98b4-c79d41f1fe28 on n-h2-846463-3 Sep 23 04:35:13.422593 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-28537fef-84c2-4d03-a435-e11c42447885 req-e6177dfc-c673-4867-8033-67a19867b9ba service nova] Creating event network-changed:f1fb3ae7-413d-4c1c-a6ae-6f6d50cb1cf1 for instance 19a775ff-efab-43d1-9a67-9ed31f6d1fc4 on n-h2-846463-3 Sep 23 04:35:13.447888 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-28537fef-84c2-4d03-a435-e11c42447885 req-e6177dfc-c673-4867-8033-67a19867b9ba service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.072921 Sep 23 04:35:13.448763 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 626/1173] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:35:13 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:35:13.453962 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d437b4ce-8e58-4ac3-9bae-c947ea5072a3 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:13.454909 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d437b4ce-8e58-4ac3-9bae-c947ea5072a3 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] [instance: f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:13.469727 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d437b4ce-8e58-4ac3-9bae-c947ea5072a3 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:13.470466 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d437b4ce-8e58-4ac3-9bae-c947ea5072a3 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:13.475884 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d437b4ce-8e58-4ac3-9bae-c947ea5072a3 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:13.475884 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d437b4ce-8e58-4ac3-9bae-c947ea5072a3 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:13.475884 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d437b4ce-8e58-4ac3-9bae-c947ea5072a3 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:13.475884 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d437b4ce-8e58-4ac3-9bae-c947ea5072a3 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:13.677839 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-dfb7b5ce-4471-4f9a-bd19-0ef72800499c tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a00bc3e62774185b48120832e80476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f931b8de0b4402a3833577fbb15607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:13.687749 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-dfb7b5ce-4471-4f9a-bd19-0ef72800499c tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] 10.222.0.33 "GET /compute/v2.1/servers/19a775ff-efab-43d1-9a67-9ed31f6d1fc4" status: 200 len: 1315 microversion: 2.1 time: 0.544267 Sep 23 04:35:13.699274 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 548/1174] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:13 2022] GET /compute/v2.1/servers/19a775ff-efab-43d1-9a67-9ed31f6d1fc4 => generated 1315 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:13.706320 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1ae57ab7-c08e-4fb2-aecb-d6c9865d28d9 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:13.718101 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-1ae57ab7-c08e-4fb2-aecb-d6c9865d28d9 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 205bf02b-1478-4765-b2a6-d7014d9f0a64] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:13.724544 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1ae57ab7-c08e-4fb2-aecb-d6c9865d28d9 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:13.725034 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1ae57ab7-c08e-4fb2-aecb-d6c9865d28d9 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:13.725480 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1ae57ab7-c08e-4fb2-aecb-d6c9865d28d9 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:13.726215 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1ae57ab7-c08e-4fb2-aecb-d6c9865d28d9 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:13.726664 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1ae57ab7-c08e-4fb2-aecb-d6c9865d28d9 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:13.729325 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1ae57ab7-c08e-4fb2-aecb-d6c9865d28d9 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:13.788534 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-1ae57ab7-c08e-4fb2-aecb-d6c9865d28d9 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/205bf02b-1478-4765-b2a6-d7014d9f0a64/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.087795 Sep 23 04:35:13.798355 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 549/1175] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Sep 23 04:35:13 2022] GET /compute/v2.1/servers/205bf02b-1478-4765-b2a6-d7014d9f0a64/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 04:35:13.903975 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-04f93ef4-8f3b-4955-8863-464fecd72c9e tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:13.904831 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-04f93ef4-8f3b-4955-8863-464fecd72c9e tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: fbbf8d58-8edb-4172-9d19-4b82804bf8e9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:13.911696 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-04f93ef4-8f3b-4955-8863-464fecd72c9e tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:13.912466 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-04f93ef4-8f3b-4955-8863-464fecd72c9e tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:13.913174 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-04f93ef4-8f3b-4955-8863-464fecd72c9e tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:13.914213 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-04f93ef4-8f3b-4955-8863-464fecd72c9e tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:13.915215 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-04f93ef4-8f3b-4955-8863-464fecd72c9e tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:13.916636 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-04f93ef4-8f3b-4955-8863-464fecd72c9e tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:13.961340 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d437b4ce-8e58-4ac3-9bae-c947ea5072a3 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c977d0e2ec64f8ca6b0923b9876c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f661d071bed2459cba4aa91e2b8b0d28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:13.974735 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d437b4ce-8e58-4ac3-9bae-c947ea5072a3 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] 10.222.0.33 "GET /compute/v2.1/servers/f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b" status: 200 len: 1293 microversion: 2.1 time: 0.524594 Sep 23 04:35:13.993871 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 627/1176] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:13 2022] GET /compute/v2.1/servers/f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b => generated 1293 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:14.041441 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-29767a83-b0f5-4dae-9d37-a713055481c7 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:14.042702 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-29767a83-b0f5-4dae-9d37-a713055481c7 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: 36165f99-56fa-427b-98b4-c79d41f1fe28] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:14.052859 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-29767a83-b0f5-4dae-9d37-a713055481c7 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:14.054642 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-29767a83-b0f5-4dae-9d37-a713055481c7 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:14.055340 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-29767a83-b0f5-4dae-9d37-a713055481c7 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:14.057432 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-29767a83-b0f5-4dae-9d37-a713055481c7 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:14.058110 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-29767a83-b0f5-4dae-9d37-a713055481c7 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:14.059099 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-29767a83-b0f5-4dae-9d37-a713055481c7 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:14.178537 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-04f93ef4-8f3b-4955-8863-464fecd72c9e tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:14.186061 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-04f93ef4-8f3b-4955-8863-464fecd72c9e tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/fbbf8d58-8edb-4172-9d19-4b82804bf8e9" status: 200 len: 1542 microversion: 2.1 time: 0.286990 Sep 23 04:35:14.186910 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 550/1177] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:13 2022] GET /compute/v2.1/servers/fbbf8d58-8edb-4172-9d19-4b82804bf8e9 => generated 1542 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:14.343171 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-29767a83-b0f5-4dae-9d37-a713055481c7 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:14.351965 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-29767a83-b0f5-4dae-9d37-a713055481c7 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/36165f99-56fa-427b-98b4-c79d41f1fe28" status: 200 len: 1504 microversion: 2.1 time: 0.315128 Sep 23 04:35:14.374686 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 628/1178] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:14 2022] GET /compute/v2.1/servers/36165f99-56fa-427b-98b4-c79d41f1fe28 => generated 1504 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:14.396026 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-05c6d7bc-39dd-4beb-a713-a42b28bdfb30 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:14.396663 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-05c6d7bc-39dd-4beb-a713-a42b28bdfb30 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] [instance: f392741f-f967-4c1c-930b-4eea7272bf64] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:14.410535 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-05c6d7bc-39dd-4beb-a713-a42b28bdfb30 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:14.411053 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-05c6d7bc-39dd-4beb-a713-a42b28bdfb30 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:14.411499 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-05c6d7bc-39dd-4beb-a713-a42b28bdfb30 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:14.412226 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-05c6d7bc-39dd-4beb-a713-a42b28bdfb30 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:14.412690 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-05c6d7bc-39dd-4beb-a713-a42b28bdfb30 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:14.413128 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-05c6d7bc-39dd-4beb-a713-a42b28bdfb30 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:14.645936 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-b7d0d4ba-f789-4229-ab02-a73d7bd36a80 req-ef8eb4cf-89e5-48c0-9fda-65902750b8ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b", "name": "network-vif-plugged", "status": "completed", "tag": "9bfa56f7-d0ab-43c9-a2c9-14af449e0f1e"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:35:14.663583 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-b7d0d4ba-f789-4229-ab02-a73d7bd36a80 req-ef8eb4cf-89e5-48c0-9fda-65902750b8ab service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:14.695578 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-b7d0d4ba-f789-4229-ab02-a73d7bd36a80 req-ef8eb4cf-89e5-48c0-9fda-65902750b8ab service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:14.699997 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-b7d0d4ba-f789-4229-ab02-a73d7bd36a80 req-ef8eb4cf-89e5-48c0-9fda-65902750b8ab service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:14.720550 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-05c6d7bc-39dd-4beb-a713-a42b28bdfb30 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c82752e1bc4fdb82e7f8391c7c129f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44352a7a6d964530aa20ae83064b02e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:14.729832 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-b7d0d4ba-f789-4229-ab02-a73d7bd36a80 req-ef8eb4cf-89e5-48c0-9fda-65902750b8ab service nova] Creating event network-vif-plugged:9bfa56f7-d0ab-43c9-a2c9-14af449e0f1e for instance f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b on n-h1-846463-3 Sep 23 04:35:14.730031 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-05c6d7bc-39dd-4beb-a713-a42b28bdfb30 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] 10.222.0.33 "GET /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64" status: 200 len: 1463 microversion: 2.1 time: 0.337645 Sep 23 04:35:14.732428 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 551/1179] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:14 2022] GET /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64 => generated 1463 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:14.740958 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-b7d0d4ba-f789-4229-ab02-a73d7bd36a80 req-ef8eb4cf-89e5-48c0-9fda-65902750b8ab service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099450 Sep 23 04:35:14.741745 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 629/1180] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:35:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:35:14.742527 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9abba8e3-a56b-46e1-a5de-5f01990b7e5f tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:14.745296 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-9abba8e3-a56b-46e1-a5de-5f01990b7e5f tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] [instance: 19a775ff-efab-43d1-9a67-9ed31f6d1fc4] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:14.773671 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d0ad013e-e023-458d-9e48-30fced565dee tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:35:14.783857 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d0ad013e-e023-458d-9e48-30fced565dee tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] [instance: f392741f-f967-4c1c-930b-4eea7272bf64] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:14.787678 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9abba8e3-a56b-46e1-a5de-5f01990b7e5f tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:14.793321 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9abba8e3-a56b-46e1-a5de-5f01990b7e5f tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:14.801508 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9abba8e3-a56b-46e1-a5de-5f01990b7e5f tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:14.806380 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9abba8e3-a56b-46e1-a5de-5f01990b7e5f tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:14.806888 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9abba8e3-a56b-46e1-a5de-5f01990b7e5f tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:14.807341 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9abba8e3-a56b-46e1-a5de-5f01990b7e5f tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:14.812627 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d0ad013e-e023-458d-9e48-30fced565dee tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:14.818206 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d0ad013e-e023-458d-9e48-30fced565dee tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:14.818844 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d0ad013e-e023-458d-9e48-30fced565dee tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:14.819519 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d0ad013e-e023-458d-9e48-30fced565dee tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:14.823642 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d0ad013e-e023-458d-9e48-30fced565dee tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:14.824182 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d0ad013e-e023-458d-9e48-30fced565dee tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:15.061044 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:35:15.096368 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-9abba8e3-a56b-46e1-a5de-5f01990b7e5f tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a00bc3e62774185b48120832e80476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f931b8de0b4402a3833577fbb15607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:15.108808 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9abba8e3-a56b-46e1-a5de-5f01990b7e5f tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] 10.222.0.33 "GET /compute/v2.1/servers/19a775ff-efab-43d1-9a67-9ed31f6d1fc4" status: 200 len: 1315 microversion: 2.1 time: 0.374360 Sep 23 04:35:15.112426 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 552/1181] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:14 2022] GET /compute/v2.1/servers/19a775ff-efab-43d1-9a67-9ed31f6d1fc4 => generated 1315 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:15.126813 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-413298d2-6513-4423-8297-660ed35bdfcf tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:15.131187 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-413298d2-6513-4423-8297-660ed35bdfcf tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 205bf02b-1478-4765-b2a6-d7014d9f0a64] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:15.143957 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-413298d2-6513-4423-8297-660ed35bdfcf tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:15.144616 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-413298d2-6513-4423-8297-660ed35bdfcf tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:15.145402 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-413298d2-6513-4423-8297-660ed35bdfcf tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:15.147748 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-413298d2-6513-4423-8297-660ed35bdfcf tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:15.150174 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-413298d2-6513-4423-8297-660ed35bdfcf tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:15.150174 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-413298d2-6513-4423-8297-660ed35bdfcf tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:15.191978 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-413298d2-6513-4423-8297-660ed35bdfcf tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/205bf02b-1478-4765-b2a6-d7014d9f0a64/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.077764 Sep 23 04:35:15.192878 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 553/1182] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Sep 23 04:35:15 2022] GET /compute/v2.1/servers/205bf02b-1478-4765-b2a6-d7014d9f0a64/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 04:35:15.198922 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-69e9fd85-6e86-4234-9d0f-271ab5957e71 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:15.199732 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-69e9fd85-6e86-4234-9d0f-271ab5957e71 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] [instance: f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:15.207465 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-69e9fd85-6e86-4234-9d0f-271ab5957e71 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:15.207996 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-69e9fd85-6e86-4234-9d0f-271ab5957e71 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:15.208442 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-69e9fd85-6e86-4234-9d0f-271ab5957e71 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:15.209212 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-69e9fd85-6e86-4234-9d0f-271ab5957e71 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:15.209710 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-69e9fd85-6e86-4234-9d0f-271ab5957e71 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:15.210209 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-69e9fd85-6e86-4234-9d0f-271ab5957e71 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:15.294382 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d0ad013e-e023-458d-9e48-30fced565dee tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64/action" status: 202 len: 0 microversion: 2.1 time: 0.531273 Sep 23 04:35:15.296347 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 630/1183] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:35:14 2022] POST /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64/action => generated 0 bytes in 534 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:35:15.301798 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0a40732f-e713-4690-9644-cf52a33f89e6 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:15.303039 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-0a40732f-e713-4690-9644-cf52a33f89e6 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: fbbf8d58-8edb-4172-9d19-4b82804bf8e9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:15.318325 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0a40732f-e713-4690-9644-cf52a33f89e6 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:15.335632 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0a40732f-e713-4690-9644-cf52a33f89e6 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:15.338169 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0a40732f-e713-4690-9644-cf52a33f89e6 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:15.339140 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0a40732f-e713-4690-9644-cf52a33f89e6 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:15.342490 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0a40732f-e713-4690-9644-cf52a33f89e6 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:15.352189 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0a40732f-e713-4690-9644-cf52a33f89e6 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:15.536716 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:35:15.551402 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-69e9fd85-6e86-4234-9d0f-271ab5957e71 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c977d0e2ec64f8ca6b0923b9876c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f661d071bed2459cba4aa91e2b8b0d28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:15.569880 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-69e9fd85-6e86-4234-9d0f-271ab5957e71 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] 10.222.0.33 "GET /compute/v2.1/servers/f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b" status: 200 len: 1293 microversion: 2.1 time: 0.371358 Sep 23 04:35:15.569880 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 554/1184] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:15 2022] GET /compute/v2.1/servers/f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b => generated 1293 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:15.581508 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7626d69f-d3a8-4137-8b97-80b01ccbaf6f tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:15.582896 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7626d69f-d3a8-4137-8b97-80b01ccbaf6f tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] [instance: f392741f-f967-4c1c-930b-4eea7272bf64] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:15.599058 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7626d69f-d3a8-4137-8b97-80b01ccbaf6f tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:15.602609 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7626d69f-d3a8-4137-8b97-80b01ccbaf6f tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:15.603892 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7626d69f-d3a8-4137-8b97-80b01ccbaf6f tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:15.605041 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7626d69f-d3a8-4137-8b97-80b01ccbaf6f tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:15.605530 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7626d69f-d3a8-4137-8b97-80b01ccbaf6f tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:15.606001 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7626d69f-d3a8-4137-8b97-80b01ccbaf6f tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:15.680730 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7626d69f-d3a8-4137-8b97-80b01ccbaf6f tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:15.682498 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7626d69f-d3a8-4137-8b97-80b01ccbaf6f tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:15.683125 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7626d69f-d3a8-4137-8b97-80b01ccbaf6f tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:15.683887 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-7626d69f-d3a8-4137-8b97-80b01ccbaf6f tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Lazy-loading 'fault' on Instance uuid f392741f-f967-4c1c-930b-4eea7272bf64 {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:35:15.922093 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-0a40732f-e713-4690-9644-cf52a33f89e6 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:15.934594 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0a40732f-e713-4690-9644-cf52a33f89e6 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/fbbf8d58-8edb-4172-9d19-4b82804bf8e9" status: 200 len: 1542 microversion: 2.1 time: 0.636486 Sep 23 04:35:15.939031 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 631/1185] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:15 2022] GET /compute/v2.1/servers/fbbf8d58-8edb-4172-9d19-4b82804bf8e9 => generated 1542 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:15.944471 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-59ac4df8-64f3-40cd-a157-ffae3e7530a1 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:15.945361 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-59ac4df8-64f3-40cd-a157-ffae3e7530a1 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: 36165f99-56fa-427b-98b4-c79d41f1fe28] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:15.953054 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-59ac4df8-64f3-40cd-a157-ffae3e7530a1 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:15.953799 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-59ac4df8-64f3-40cd-a157-ffae3e7530a1 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:15.954574 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-59ac4df8-64f3-40cd-a157-ffae3e7530a1 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:15.955498 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-59ac4df8-64f3-40cd-a157-ffae3e7530a1 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:15.956174 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-59ac4df8-64f3-40cd-a157-ffae3e7530a1 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:15.956957 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-59ac4df8-64f3-40cd-a157-ffae3e7530a1 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:15.972924 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7626d69f-d3a8-4137-8b97-80b01ccbaf6f tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64" status: 200 len: 1597 microversion: 2.1 time: 0.402265 Sep 23 04:35:15.973513 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 555/1186] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:15 2022] GET /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64 => generated 1597 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:16.005143 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4402514e-f8af-44f6-b0d8-7fa9b72301c1 tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:35:16.007793 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4402514e-f8af-44f6-b0d8-7fa9b72301c1 tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] [instance: f392741f-f967-4c1c-930b-4eea7272bf64] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:16.015270 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4402514e-f8af-44f6-b0d8-7fa9b72301c1 tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:16.015948 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4402514e-f8af-44f6-b0d8-7fa9b72301c1 tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:16.018726 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4402514e-f8af-44f6-b0d8-7fa9b72301c1 tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:16.019965 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4402514e-f8af-44f6-b0d8-7fa9b72301c1 tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:16.020613 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4402514e-f8af-44f6-b0d8-7fa9b72301c1 tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:16.021233 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4402514e-f8af-44f6-b0d8-7fa9b72301c1 tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:16.238387 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:35:16.271437 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=8 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:35:16.301603 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-59ac4df8-64f3-40cd-a157-ffae3e7530a1 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:16.311527 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-59ac4df8-64f3-40cd-a157-ffae3e7530a1 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/36165f99-56fa-427b-98b4-c79d41f1fe28" status: 200 len: 1504 microversion: 2.1 time: 0.371277 Sep 23 04:35:16.330125 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 632/1187] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:15 2022] GET /compute/v2.1/servers/36165f99-56fa-427b-98b4-c79d41f1fe28 => generated 1504 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:16.346632 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2ee19722-319e-42be-83d4-ce4e1f801161 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:16.351651 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-2ee19722-319e-42be-83d4-ce4e1f801161 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] [instance: 19a775ff-efab-43d1-9a67-9ed31f6d1fc4] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:16.364906 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2ee19722-319e-42be-83d4-ce4e1f801161 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:16.365666 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2ee19722-319e-42be-83d4-ce4e1f801161 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:16.366504 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2ee19722-319e-42be-83d4-ce4e1f801161 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:16.369141 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2ee19722-319e-42be-83d4-ce4e1f801161 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:16.369793 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2ee19722-319e-42be-83d4-ce4e1f801161 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:16.371292 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2ee19722-319e-42be-83d4-ce4e1f801161 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:16.457639 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4402514e-f8af-44f6-b0d8-7fa9b72301c1 tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64/action" status: 202 len: 0 microversion: 2.1 time: 0.455543 Sep 23 04:35:16.458051 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 556/1188] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:35:15 2022] POST /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64/action => generated 0 bytes in 460 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:35:16.472930 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9e21bd11-74d9-451b-b66a-764f554bac4c tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:16.475750 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-9e21bd11-74d9-451b-b66a-764f554bac4c tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 205bf02b-1478-4765-b2a6-d7014d9f0a64] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:16.507323 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9e21bd11-74d9-451b-b66a-764f554bac4c tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:16.514865 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9e21bd11-74d9-451b-b66a-764f554bac4c tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:16.515631 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9e21bd11-74d9-451b-b66a-764f554bac4c tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:16.516873 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9e21bd11-74d9-451b-b66a-764f554bac4c tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:16.519571 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9e21bd11-74d9-451b-b66a-764f554bac4c tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:16.526805 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9e21bd11-74d9-451b-b66a-764f554bac4c tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:16.604608 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9e21bd11-74d9-451b-b66a-764f554bac4c tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/205bf02b-1478-4765-b2a6-d7014d9f0a64/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.145164 Sep 23 04:35:16.605554 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 557/1189] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Sep 23 04:35:16 2022] GET /compute/v2.1/servers/205bf02b-1478-4765-b2a6-d7014d9f0a64/os-volume_attachments => generated 25 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:16.611121 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-bc308e61-c262-4be4-88a5-327e7ffb9140 tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:16.612068 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-bc308e61-c262-4be4-88a5-327e7ffb9140 tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] [instance: f392741f-f967-4c1c-930b-4eea7272bf64] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:16.622341 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bc308e61-c262-4be4-88a5-327e7ffb9140 tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:16.623411 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bc308e61-c262-4be4-88a5-327e7ffb9140 tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:16.624175 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bc308e61-c262-4be4-88a5-327e7ffb9140 tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:16.626049 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bc308e61-c262-4be4-88a5-327e7ffb9140 tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:16.627198 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bc308e61-c262-4be4-88a5-327e7ffb9140 tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:16.628382 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bc308e61-c262-4be4-88a5-327e7ffb9140 tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:16.799155 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2ee19722-319e-42be-83d4-ce4e1f801161 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a00bc3e62774185b48120832e80476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f931b8de0b4402a3833577fbb15607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:16.809263 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2ee19722-319e-42be-83d4-ce4e1f801161 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] 10.222.0.33 "GET /compute/v2.1/servers/19a775ff-efab-43d1-9a67-9ed31f6d1fc4" status: 200 len: 1315 microversion: 2.1 time: 0.475384 Sep 23 04:35:16.810401 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 633/1190] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:16 2022] GET /compute/v2.1/servers/19a775ff-efab-43d1-9a67-9ed31f6d1fc4 => generated 1315 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:16.815968 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5f9cef37-909c-4a44-af49-2bd9d717d673 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:16.816806 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-5f9cef37-909c-4a44-af49-2bd9d717d673 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] [instance: f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:16.824904 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5f9cef37-909c-4a44-af49-2bd9d717d673 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:16.825629 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5f9cef37-909c-4a44-af49-2bd9d717d673 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:16.826278 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5f9cef37-909c-4a44-af49-2bd9d717d673 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:16.827197 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5f9cef37-909c-4a44-af49-2bd9d717d673 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:16.827836 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5f9cef37-909c-4a44-af49-2bd9d717d673 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:16.828914 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5f9cef37-909c-4a44-af49-2bd9d717d673 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:16.865323 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-bc308e61-c262-4be4-88a5-327e7ffb9140 tempest-ServersAdminTestJSON-764812067 tempest-ServersAdminTestJSON-764812067-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64" status: 200 len: 1614 microversion: 2.1 time: 0.258360 Sep 23 04:35:16.866315 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 558/1191] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:16 2022] GET /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64 => generated 1614 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:17.080906 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-5f9cef37-909c-4a44-af49-2bd9d717d673 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c977d0e2ec64f8ca6b0923b9876c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f661d071bed2459cba4aa91e2b8b0d28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:17.089521 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5f9cef37-909c-4a44-af49-2bd9d717d673 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] 10.222.0.33 "GET /compute/v2.1/servers/f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b" status: 200 len: 1484 microversion: 2.1 time: 0.277782 Sep 23 04:35:17.093137 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 634/1192] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:16 2022] GET /compute/v2.1/servers/f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b => generated 1484 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:17.099765 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7a31debe-45ea-442f-8600-9ae085949c5b tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:17.102157 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-7a31debe-45ea-442f-8600-9ae085949c5b tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] [instance: 2d2de8ea-1016-4289-994f-59d8742f9b58] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:17.117738 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7a31debe-45ea-442f-8600-9ae085949c5b tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:17.117738 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7a31debe-45ea-442f-8600-9ae085949c5b tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:17.117738 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7a31debe-45ea-442f-8600-9ae085949c5b tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:17.125144 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7a31debe-45ea-442f-8600-9ae085949c5b tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:17.125688 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7a31debe-45ea-442f-8600-9ae085949c5b tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:17.126187 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7a31debe-45ea-442f-8600-9ae085949c5b tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:17.161631 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-7a31debe-45ea-442f-8600-9ae085949c5b tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] [instance: 2d2de8ea-1016-4289-994f-59d8742f9b58] Going to try to terminate instance {{(pid=122699) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:35:17.206884 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a99eda06-8251-4eb3-bf8d-1f8d427a02f0 tempest-ListImagesTestJSON-1491681934 tempest-ListImagesTestJSON-1491681934-project] Calling method '.version_select at 0x7ff1bbb4d940>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:17.260890 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a99eda06-8251-4eb3-bf8d-1f8d427a02f0 tempest-ListImagesTestJSON-1491681934 tempest-ListImagesTestJSON-1491681934-project] 10.222.0.33 "GET /compute/v2.1/images/b8dd79b9-f0b9-43a9-9605-17244137c0ee" status: 200 len: 784 microversion: 2.1 time: 0.393235 Sep 23 04:35:17.272157 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 559/1193] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:35:16 2022] GET /compute/v2.1/images/b8dd79b9-f0b9-43a9-9605-17244137c0ee => generated 784 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:35:17.279396 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-534ec0b9-1ffc-4362-a4c2-35b94463cf8c tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:17.280023 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-534ec0b9-1ffc-4362-a4c2-35b94463cf8c tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: fbbf8d58-8edb-4172-9d19-4b82804bf8e9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:17.289363 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-534ec0b9-1ffc-4362-a4c2-35b94463cf8c tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:17.294419 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-534ec0b9-1ffc-4362-a4c2-35b94463cf8c tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:17.294419 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-534ec0b9-1ffc-4362-a4c2-35b94463cf8c tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:17.294419 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-534ec0b9-1ffc-4362-a4c2-35b94463cf8c tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:17.294419 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-534ec0b9-1ffc-4362-a4c2-35b94463cf8c tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:17.294913 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-534ec0b9-1ffc-4362-a4c2-35b94463cf8c tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:17.470583 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-534ec0b9-1ffc-4362-a4c2-35b94463cf8c tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:17.481520 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-534ec0b9-1ffc-4362-a4c2-35b94463cf8c tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/fbbf8d58-8edb-4172-9d19-4b82804bf8e9" status: 200 len: 1542 microversion: 2.1 time: 0.217132 Sep 23 04:35:17.482468 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 560/1194] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:17 2022] GET /compute/v2.1/servers/fbbf8d58-8edb-4172-9d19-4b82804bf8e9 => generated 1542 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:17.487690 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ccf094f6-aabc-4bfd-b6eb-081354c742e1 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:17.488375 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-ccf094f6-aabc-4bfd-b6eb-081354c742e1 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] [instance: f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:17.494360 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ccf094f6-aabc-4bfd-b6eb-081354c742e1 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:17.495220 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ccf094f6-aabc-4bfd-b6eb-081354c742e1 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:17.495663 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ccf094f6-aabc-4bfd-b6eb-081354c742e1 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:17.496531 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ccf094f6-aabc-4bfd-b6eb-081354c742e1 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:17.497002 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ccf094f6-aabc-4bfd-b6eb-081354c742e1 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:17.497433 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ccf094f6-aabc-4bfd-b6eb-081354c742e1 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:17.581221 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ccf094f6-aabc-4bfd-b6eb-081354c742e1 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] 10.222.0.33 "GET /compute/v2.1/servers/f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097343 Sep 23 04:35:17.581961 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 561/1195] 10.222.0.33 () {58 vars in 1275 bytes} [Fri Sep 23 04:35:17 2022] GET /compute/v2.1/servers/f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:35:17.592058 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-7a31debe-45ea-442f-8600-9ae085949c5b tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] 10.222.0.33 "DELETE /compute/v2.1/servers/2d2de8ea-1016-4289-994f-59d8742f9b58" status: 204 len: 0 microversion: 2.1 time: 0.494892 Sep 23 04:35:17.599983 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 635/1196] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:35:17 2022] DELETE /compute/v2.1/servers/2d2de8ea-1016-4289-994f-59d8742f9b58 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:35:17.600211 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-eba763eb-04d2-4a21-aba3-1056ce2d50b3 tempest-ListImagesTestJSON-1491681934 tempest-ListImagesTestJSON-1491681934-project] Calling method '.version_select at 0x7ff1bbae80d0>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:17.600300 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ee86cbad-3d44-43ae-83f2-04ba9b6fa536 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:17.600300 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ee86cbad-3d44-43ae-83f2-04ba9b6fa536 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: 36165f99-56fa-427b-98b4-c79d41f1fe28] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:17.614331 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ee86cbad-3d44-43ae-83f2-04ba9b6fa536 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:17.615484 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ee86cbad-3d44-43ae-83f2-04ba9b6fa536 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:17.616159 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ee86cbad-3d44-43ae-83f2-04ba9b6fa536 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:17.617261 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ee86cbad-3d44-43ae-83f2-04ba9b6fa536 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:17.618026 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ee86cbad-3d44-43ae-83f2-04ba9b6fa536 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:17.619314 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ee86cbad-3d44-43ae-83f2-04ba9b6fa536 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:17.737302 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-eba763eb-04d2-4a21-aba3-1056ce2d50b3 tempest-ListImagesTestJSON-1491681934 tempest-ListImagesTestJSON-1491681934-project] 10.222.0.33 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.154054 Sep 23 04:35:17.738872 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 562/1197] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 23 04:35:17 2022] GET /compute/v2.1/images => generated 445 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:35:17.761962 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e7a00df3-c228-44bf-a344-bd3cc2d9512d tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:17.763057 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e7a00df3-c228-44bf-a344-bd3cc2d9512d tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] [instance: 2d2de8ea-1016-4289-994f-59d8742f9b58] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:17.770682 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e7a00df3-c228-44bf-a344-bd3cc2d9512d tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:17.771616 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e7a00df3-c228-44bf-a344-bd3cc2d9512d tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:17.772287 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e7a00df3-c228-44bf-a344-bd3cc2d9512d tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:17.773417 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e7a00df3-c228-44bf-a344-bd3cc2d9512d tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:17.774406 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e7a00df3-c228-44bf-a344-bd3cc2d9512d tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:17.775283 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e7a00df3-c228-44bf-a344-bd3cc2d9512d tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:18.531866 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ee86cbad-3d44-43ae-83f2-04ba9b6fa536 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:18.543498 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ee86cbad-3d44-43ae-83f2-04ba9b6fa536 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/36165f99-56fa-427b-98b4-c79d41f1fe28" status: 200 len: 1504 microversion: 2.1 time: 0.948799 Sep 23 04:35:18.560713 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 636/1198] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:17 2022] GET /compute/v2.1/servers/36165f99-56fa-427b-98b4-c79d41f1fe28 => generated 1504 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:18.568394 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0964a469-c71b-4d74-873c-77aea9a40acc tempest-ListImagesTestJSON-1491681934 tempest-ListImagesTestJSON-1491681934-project] Calling method '.version_select at 0x7ff1bb8d50d0>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:18.690768 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e7a00df3-c228-44bf-a344-bd3cc2d9512d tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c82752e1bc4fdb82e7f8391c7c129f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44352a7a6d964530aa20ae83064b02e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:18.718645 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e7a00df3-c228-44bf-a344-bd3cc2d9512d tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] 10.222.0.33 "GET /compute/v2.1/servers/2d2de8ea-1016-4289-994f-59d8742f9b58" status: 200 len: 1468 microversion: 2.1 time: 0.978469 Sep 23 04:35:18.720585 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0964a469-c71b-4d74-873c-77aea9a40acc tempest-ListImagesTestJSON-1491681934 tempest-ListImagesTestJSON-1491681934-project] 10.222.0.33 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.158582 Sep 23 04:35:18.721106 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 563/1199] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:17 2022] GET /compute/v2.1/servers/2d2de8ea-1016-4289-994f-59d8742f9b58 => generated 1468 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:18.723558 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 637/1200] 10.222.0.33 () {58 vars in 1143 bytes} [Fri Sep 23 04:35:18 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:35:18.729440 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ff2da2d2-93c5-4744-bfed-8c4146c214bb tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:18.731050 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ff2da2d2-93c5-4744-bfed-8c4146c214bb tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: fbbf8d58-8edb-4172-9d19-4b82804bf8e9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:18.737437 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-91425c60-cfee-4d49-b4e5-277c8a38a3c3 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:18.738316 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-91425c60-cfee-4d49-b4e5-277c8a38a3c3 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] [instance: 19a775ff-efab-43d1-9a67-9ed31f6d1fc4] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:18.772155 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ff2da2d2-93c5-4744-bfed-8c4146c214bb tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:18.772705 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ff2da2d2-93c5-4744-bfed-8c4146c214bb tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:18.773158 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ff2da2d2-93c5-4744-bfed-8c4146c214bb tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:18.774811 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-91425c60-cfee-4d49-b4e5-277c8a38a3c3 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:18.775330 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-91425c60-cfee-4d49-b4e5-277c8a38a3c3 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:18.777566 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-91425c60-cfee-4d49-b4e5-277c8a38a3c3 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:18.779077 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ff2da2d2-93c5-4744-bfed-8c4146c214bb tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:18.779651 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ff2da2d2-93c5-4744-bfed-8c4146c214bb tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:18.785710 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-91425c60-cfee-4d49-b4e5-277c8a38a3c3 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:18.785710 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-91425c60-cfee-4d49-b4e5-277c8a38a3c3 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:18.785710 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-91425c60-cfee-4d49-b4e5-277c8a38a3c3 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:18.786068 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ff2da2d2-93c5-4744-bfed-8c4146c214bb tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:19.599144 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ff2da2d2-93c5-4744-bfed-8c4146c214bb tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:19.612910 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ff2da2d2-93c5-4744-bfed-8c4146c214bb tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/fbbf8d58-8edb-4172-9d19-4b82804bf8e9" status: 200 len: 1542 microversion: 2.1 time: 0.884345 Sep 23 04:35:19.631316 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 638/1201] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:18 2022] GET /compute/v2.1/servers/fbbf8d58-8edb-4172-9d19-4b82804bf8e9 => generated 1542 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:19.638011 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-df76285f-b2fd-4494-932b-e8d9e58797f1 req-b9267f7b-1377-4f2b-9ba6-8f429ea7e273 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19a775ff-efab-43d1-9a67-9ed31f6d1fc4", "name": "network-vif-plugged", "status": "completed", "tag": "f1fb3ae7-413d-4c1c-a6ae-6f6d50cb1cf1"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:35:19.650070 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-df76285f-b2fd-4494-932b-e8d9e58797f1 req-b9267f7b-1377-4f2b-9ba6-8f429ea7e273 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:19.653404 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-df76285f-b2fd-4494-932b-e8d9e58797f1 req-b9267f7b-1377-4f2b-9ba6-8f429ea7e273 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:19.653404 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-df76285f-b2fd-4494-932b-e8d9e58797f1 req-b9267f7b-1377-4f2b-9ba6-8f429ea7e273 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:19.658221 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-91425c60-cfee-4d49-b4e5-277c8a38a3c3 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a00bc3e62774185b48120832e80476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f931b8de0b4402a3833577fbb15607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:19.666001 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-df76285f-b2fd-4494-932b-e8d9e58797f1 req-b9267f7b-1377-4f2b-9ba6-8f429ea7e273 service nova] Creating event network-vif-plugged:f1fb3ae7-413d-4c1c-a6ae-6f6d50cb1cf1 for instance 19a775ff-efab-43d1-9a67-9ed31f6d1fc4 on n-h2-846463-3 Sep 23 04:35:19.672708 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-91425c60-cfee-4d49-b4e5-277c8a38a3c3 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] 10.222.0.33 "GET /compute/v2.1/servers/19a775ff-efab-43d1-9a67-9ed31f6d1fc4" status: 200 len: 1315 microversion: 2.1 time: 0.949451 Sep 23 04:35:19.674770 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-df76285f-b2fd-4494-932b-e8d9e58797f1 req-b9267f7b-1377-4f2b-9ba6-8f429ea7e273 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041750 Sep 23 04:35:19.675903 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 639/1202] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:35:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:35:19.676925 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 564/1203] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:18 2022] GET /compute/v2.1/servers/19a775ff-efab-43d1-9a67-9ed31f6d1fc4 => generated 1315 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:19.683788 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-58c89579-3aaa-4bcd-9eef-098a400357f9 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:19.684302 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-58c89579-3aaa-4bcd-9eef-098a400357f9 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: 36165f99-56fa-427b-98b4-c79d41f1fe28] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:19.705128 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-58c89579-3aaa-4bcd-9eef-098a400357f9 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:19.706381 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-58c89579-3aaa-4bcd-9eef-098a400357f9 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:19.707182 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-58c89579-3aaa-4bcd-9eef-098a400357f9 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:19.708889 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-58c89579-3aaa-4bcd-9eef-098a400357f9 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:19.709585 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-58c89579-3aaa-4bcd-9eef-098a400357f9 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:19.710804 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-58c89579-3aaa-4bcd-9eef-098a400357f9 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:19.750146 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a4ea35a5-a238-4f5f-acc8-f7d68a828878 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:19.750631 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a4ea35a5-a238-4f5f-acc8-f7d68a828878 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] [instance: 2d2de8ea-1016-4289-994f-59d8742f9b58] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:19.764018 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a4ea35a5-a238-4f5f-acc8-f7d68a828878 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:19.764538 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a4ea35a5-a238-4f5f-acc8-f7d68a828878 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:19.764976 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a4ea35a5-a238-4f5f-acc8-f7d68a828878 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:19.766714 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a4ea35a5-a238-4f5f-acc8-f7d68a828878 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:19.767680 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a4ea35a5-a238-4f5f-acc8-f7d68a828878 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:19.768344 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a4ea35a5-a238-4f5f-acc8-f7d68a828878 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:20.397104 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-58c89579-3aaa-4bcd-9eef-098a400357f9 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:20.406350 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-58c89579-3aaa-4bcd-9eef-098a400357f9 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/36165f99-56fa-427b-98b4-c79d41f1fe28" status: 200 len: 1504 microversion: 2.1 time: 0.728936 Sep 23 04:35:20.422226 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 640/1204] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:19 2022] GET /compute/v2.1/servers/36165f99-56fa-427b-98b4-c79d41f1fe28 => generated 1504 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:20.490607 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a4ea35a5-a238-4f5f-acc8-f7d68a828878 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c82752e1bc4fdb82e7f8391c7c129f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44352a7a6d964530aa20ae83064b02e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:20.499313 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a4ea35a5-a238-4f5f-acc8-f7d68a828878 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] 10.222.0.33 "GET /compute/v2.1/servers/2d2de8ea-1016-4289-994f-59d8742f9b58" status: 200 len: 1468 microversion: 2.1 time: 0.754456 Sep 23 04:35:20.503090 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 565/1205] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:19 2022] GET /compute/v2.1/servers/2d2de8ea-1016-4289-994f-59d8742f9b58 => generated 1468 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:35:20.638905 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-31788351-aab0-4e88-896c-0dd2a246ab10 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:20.639788 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-31788351-aab0-4e88-896c-0dd2a246ab10 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: fbbf8d58-8edb-4172-9d19-4b82804bf8e9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:20.649501 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-31788351-aab0-4e88-896c-0dd2a246ab10 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:20.650664 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-31788351-aab0-4e88-896c-0dd2a246ab10 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:20.651093 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-31788351-aab0-4e88-896c-0dd2a246ab10 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:20.660217 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-31788351-aab0-4e88-896c-0dd2a246ab10 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:20.661114 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-31788351-aab0-4e88-896c-0dd2a246ab10 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:20.663350 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-31788351-aab0-4e88-896c-0dd2a246ab10 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:20.700909 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-89d8f67b-ab52-4967-9b3c-cd7a50303f35 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:20.702151 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-89d8f67b-ab52-4967-9b3c-cd7a50303f35 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] [instance: 19a775ff-efab-43d1-9a67-9ed31f6d1fc4] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:20.710500 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-89d8f67b-ab52-4967-9b3c-cd7a50303f35 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:20.714211 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-89d8f67b-ab52-4967-9b3c-cd7a50303f35 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:20.714994 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-89d8f67b-ab52-4967-9b3c-cd7a50303f35 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:20.715969 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-89d8f67b-ab52-4967-9b3c-cd7a50303f35 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:20.717588 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-89d8f67b-ab52-4967-9b3c-cd7a50303f35 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:20.718905 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-89d8f67b-ab52-4967-9b3c-cd7a50303f35 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:21.173996 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-31788351-aab0-4e88-896c-0dd2a246ab10 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:21.185802 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-31788351-aab0-4e88-896c-0dd2a246ab10 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/fbbf8d58-8edb-4172-9d19-4b82804bf8e9" status: 200 len: 1542 microversion: 2.1 time: 0.551387 Sep 23 04:35:21.188606 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 641/1206] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:20 2022] GET /compute/v2.1/servers/fbbf8d58-8edb-4172-9d19-4b82804bf8e9 => generated 1542 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:21.199800 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-89d8f67b-ab52-4967-9b3c-cd7a50303f35 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a00bc3e62774185b48120832e80476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f931b8de0b4402a3833577fbb15607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:21.207342 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-cbbe5b4d-2c38-4062-9061-34f8c00f9edc tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:21.210275 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-cbbe5b4d-2c38-4062-9061-34f8c00f9edc tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] [instance: f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:21.221824 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-89d8f67b-ab52-4967-9b3c-cd7a50303f35 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] 10.222.0.33 "GET /compute/v2.1/servers/19a775ff-efab-43d1-9a67-9ed31f6d1fc4" status: 200 len: 1315 microversion: 2.1 time: 0.526811 Sep 23 04:35:21.224378 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cbbe5b4d-2c38-4062-9061-34f8c00f9edc tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:21.225352 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 566/1207] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:20 2022] GET /compute/v2.1/servers/19a775ff-efab-43d1-9a67-9ed31f6d1fc4 => generated 1315 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:35:21.228639 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cbbe5b4d-2c38-4062-9061-34f8c00f9edc tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:21.230513 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cbbe5b4d-2c38-4062-9061-34f8c00f9edc tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:21.235639 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cbbe5b4d-2c38-4062-9061-34f8c00f9edc tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:21.236360 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cbbe5b4d-2c38-4062-9061-34f8c00f9edc tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:21.241159 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cbbe5b4d-2c38-4062-9061-34f8c00f9edc tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:21.245231 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-65854c2f-2e1b-4119-ac98-626b420f665c req-a8ef8cb8-1a10-4e46-92bb-3cdfa62f6acb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b", "tag": "9bfa56f7-d0ab-43c9-a2c9-14af449e0f1e"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:35:21.261938 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-65854c2f-2e1b-4119-ac98-626b420f665c req-a8ef8cb8-1a10-4e46-92bb-3cdfa62f6acb service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:21.264055 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-65854c2f-2e1b-4119-ac98-626b420f665c req-a8ef8cb8-1a10-4e46-92bb-3cdfa62f6acb service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:21.268783 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-65854c2f-2e1b-4119-ac98-626b420f665c req-a8ef8cb8-1a10-4e46-92bb-3cdfa62f6acb service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:21.307337 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-65854c2f-2e1b-4119-ac98-626b420f665c req-a8ef8cb8-1a10-4e46-92bb-3cdfa62f6acb service nova] Creating event network-changed:9bfa56f7-d0ab-43c9-a2c9-14af449e0f1e for instance f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b on n-h1-846463-3 Sep 23 04:35:21.323238 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-65854c2f-2e1b-4119-ac98-626b420f665c req-a8ef8cb8-1a10-4e46-92bb-3cdfa62f6acb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095511 Sep 23 04:35:21.327544 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 567/1208] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:35:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:35:21.442596 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8ab7cc23-97bb-4cce-9c26-0024028ec2e1 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:21.442596 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8ab7cc23-97bb-4cce-9c26-0024028ec2e1 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: 36165f99-56fa-427b-98b4-c79d41f1fe28] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:21.466075 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8ab7cc23-97bb-4cce-9c26-0024028ec2e1 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:21.467763 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8ab7cc23-97bb-4cce-9c26-0024028ec2e1 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:21.468934 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8ab7cc23-97bb-4cce-9c26-0024028ec2e1 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:21.473138 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8ab7cc23-97bb-4cce-9c26-0024028ec2e1 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:21.480613 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8ab7cc23-97bb-4cce-9c26-0024028ec2e1 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:21.481198 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8ab7cc23-97bb-4cce-9c26-0024028ec2e1 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:22.003222 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-cbbe5b4d-2c38-4062-9061-34f8c00f9edc tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c977d0e2ec64f8ca6b0923b9876c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f661d071bed2459cba4aa91e2b8b0d28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:22.015279 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-cbbe5b4d-2c38-4062-9061-34f8c00f9edc tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] 10.222.0.33 "GET /compute/v2.1/servers/f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b" status: 200 len: 1484 microversion: 2.1 time: 0.824209 Sep 23 04:35:22.022039 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 642/1209] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:21 2022] GET /compute/v2.1/servers/f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b => generated 1484 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:22.046317 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8ab7cc23-97bb-4cce-9c26-0024028ec2e1 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:22.046659 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2e332d53-137a-49ad-a780-3b95c79e88df tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:22.055411 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8ab7cc23-97bb-4cce-9c26-0024028ec2e1 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/36165f99-56fa-427b-98b4-c79d41f1fe28" status: 200 len: 1479 microversion: 2.1 time: 0.621364 Sep 23 04:35:22.057042 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-2e332d53-137a-49ad-a780-3b95c79e88df tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] [instance: 2d2de8ea-1016-4289-994f-59d8742f9b58] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:22.086473 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2e332d53-137a-49ad-a780-3b95c79e88df tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:22.088773 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 568/1210] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:21 2022] GET /compute/v2.1/servers/36165f99-56fa-427b-98b4-c79d41f1fe28 => generated 1479 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:22.091309 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2e332d53-137a-49ad-a780-3b95c79e88df tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:22.091868 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2e332d53-137a-49ad-a780-3b95c79e88df tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:22.097091 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ba641e6f-e923-412a-a478-d8461d40adaf tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Calling method '.version_select at 0x7ff1bbae83a0>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:22.097993 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2e332d53-137a-49ad-a780-3b95c79e88df tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:22.109624 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2e332d53-137a-49ad-a780-3b95c79e88df tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:22.109624 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2e332d53-137a-49ad-a780-3b95c79e88df tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:22.117580 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ba641e6f-e923-412a-a478-d8461d40adaf tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:22.118529 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ba641e6f-e923-412a-a478-d8461d40adaf tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:22.119946 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ba641e6f-e923-412a-a478-d8461d40adaf tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:22.153961 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ba641e6f-e923-412a-a478-d8461d40adaf tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] 10.222.0.33 "GET /compute/v2.1/os-migrations" status: 200 len: 3113 microversion: 2.1 time: 0.063147 Sep 23 04:35:22.159202 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 569/1211] 10.222.0.33 () {58 vars in 1143 bytes} [Fri Sep 23 04:35:22 2022] GET /compute/v2.1/os-migrations => generated 3113 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:22.205027 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2e332d53-137a-49ad-a780-3b95c79e88df tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:22.205846 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2e332d53-137a-49ad-a780-3b95c79e88df tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:22.207039 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2e332d53-137a-49ad-a780-3b95c79e88df tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:22.208135 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-2e332d53-137a-49ad-a780-3b95c79e88df tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lazy-loading 'fault' on Instance uuid 2d2de8ea-1016-4289-994f-59d8742f9b58 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:35:22.278172 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2e332d53-137a-49ad-a780-3b95c79e88df tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c82752e1bc4fdb82e7f8391c7c129f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44352a7a6d964530aa20ae83064b02e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:22.292639 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2e332d53-137a-49ad-a780-3b95c79e88df tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] 10.222.0.33 "GET /compute/v2.1/servers/2d2de8ea-1016-4289-994f-59d8742f9b58" status: 200 len: 1303 microversion: 2.1 time: 0.268970 Sep 23 04:35:22.293902 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 643/1212] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:22 2022] GET /compute/v2.1/servers/2d2de8ea-1016-4289-994f-59d8742f9b58 => generated 1303 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:22.303859 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a9c304a8-9631-4843-8b70-21ca7837211e tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:22.304900 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a9c304a8-9631-4843-8b70-21ca7837211e tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] [instance: 36165f99-56fa-427b-98b4-c79d41f1fe28] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:22.326021 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a9c304a8-9631-4843-8b70-21ca7837211e tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:22.327287 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a9c304a8-9631-4843-8b70-21ca7837211e tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:22.328076 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a9c304a8-9631-4843-8b70-21ca7837211e tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:22.329209 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a9c304a8-9631-4843-8b70-21ca7837211e tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:22.331027 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a9c304a8-9631-4843-8b70-21ca7837211e tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:22.331927 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a9c304a8-9631-4843-8b70-21ca7837211e tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:22.664152 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a9c304a8-9631-4843-8b70-21ca7837211e tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/36165f99-56fa-427b-98b4-c79d41f1fe28" status: 200 len: 1630 microversion: 2.1 time: 0.366161 Sep 23 04:35:22.664152 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 644/1213] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:22 2022] GET /compute/v2.1/servers/36165f99-56fa-427b-98b4-c79d41f1fe28 => generated 1630 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:22.688570 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6dd7cafd-8089-4ff0-9778-7b100dbba1ff tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:22.690931 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-6dd7cafd-8089-4ff0-9778-7b100dbba1ff tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: fbbf8d58-8edb-4172-9d19-4b82804bf8e9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:22.703463 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6dd7cafd-8089-4ff0-9778-7b100dbba1ff tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:22.704187 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6dd7cafd-8089-4ff0-9778-7b100dbba1ff tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:22.705006 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6dd7cafd-8089-4ff0-9778-7b100dbba1ff tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:22.706447 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6dd7cafd-8089-4ff0-9778-7b100dbba1ff tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:22.707457 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6dd7cafd-8089-4ff0-9778-7b100dbba1ff tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:22.707828 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6dd7cafd-8089-4ff0-9778-7b100dbba1ff tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:22.897867 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-43e26919-e363-41a0-9767-98ac299b54e8 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-471469847", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "networks": [{"uuid": "26baf31d-f7d2-4b1e-9354-12e0f65b29ea"}]}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:35:23.000035 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-6dd7cafd-8089-4ff0-9778-7b100dbba1ff tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:23.026281 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6dd7cafd-8089-4ff0-9778-7b100dbba1ff tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/fbbf8d58-8edb-4172-9d19-4b82804bf8e9" status: 200 len: 1542 microversion: 2.1 time: 0.356157 Sep 23 04:35:23.029419 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 645/1214] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:22 2022] GET /compute/v2.1/servers/fbbf8d58-8edb-4172-9d19-4b82804bf8e9 => generated 1542 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:23.047672 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c341d2a4-ce15-4a95-bad6-3f2aff5b009e tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:23.055106 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c341d2a4-ce15-4a95-bad6-3f2aff5b009e tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] [instance: 19a775ff-efab-43d1-9a67-9ed31f6d1fc4] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:23.074627 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c341d2a4-ce15-4a95-bad6-3f2aff5b009e tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:23.079964 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c341d2a4-ce15-4a95-bad6-3f2aff5b009e tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:23.080428 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c341d2a4-ce15-4a95-bad6-3f2aff5b009e tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:23.084875 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.network.neutron [None req-43e26919-e363-41a0-9767-98ac299b54e8 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] validate_networks() for [('26baf31d-f7d2-4b1e-9354-12e0f65b29ea', None, None, None, None, None)] {{(pid=122698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:35:23.086955 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c341d2a4-ce15-4a95-bad6-3f2aff5b009e tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:23.087461 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c341d2a4-ce15-4a95-bad6-3f2aff5b009e tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:23.087884 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c341d2a4-ce15-4a95-bad6-3f2aff5b009e tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:23.148425 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:35:23.442938 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c341d2a4-ce15-4a95-bad6-3f2aff5b009e tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a00bc3e62774185b48120832e80476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f931b8de0b4402a3833577fbb15607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:23.451864 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c341d2a4-ce15-4a95-bad6-3f2aff5b009e tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] 10.222.0.33 "GET /compute/v2.1/servers/19a775ff-efab-43d1-9a67-9ed31f6d1fc4" status: 200 len: 1504 microversion: 2.1 time: 0.421138 Sep 23 04:35:23.452459 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 646/1215] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:23 2022] GET /compute/v2.1/servers/19a775ff-efab-43d1-9a67-9ed31f6d1fc4 => generated 1504 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:23.457029 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8ea0093f-587a-4efc-828c-fe60d1119141 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Action: 'create', calling method: .version_select at 0x7ff1bb9f2040>, body: {"keypair": {"name": "tempest-keypair-1997278881", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCi8HaXoy2SFJ9tP+BBttO/TGZKr+VvP/OwetrEdtIHG69S3+1oih+8Cj47QEPuUm05nEZcvAlilWQh79yBzlSdsdcUFZ6yvtXDSReE6pKXOpYkGTBtvzK1jWTvoV/Mprw=="}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:35:23.504917 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-8ea0093f-587a-4efc-828c-fe60d1119141 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Getting quotas for project 004af70c9f9a43c4a7be8136268e98f9. Resources: {'key_pairs'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:35:23.518965 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-8ea0093f-587a-4efc-828c-fe60d1119141 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Getting quotas for user 82d04a55ba72452995e3b156325e0890 and project 004af70c9f9a43c4a7be8136268e98f9. Resources: {'key_pairs'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:35:23.647629 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-8ea0093f-587a-4efc-828c-fe60d1119141 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.194085 Sep 23 04:35:23.650534 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 647/1216] 10.222.0.33 () {60 vars in 1159 bytes} [Fri Sep 23 04:35:23 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:35:23.656546 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2651bf5c-b139-46ac-90c4-5304d04a6c2f tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:23.657580 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-2651bf5c-b139-46ac-90c4-5304d04a6c2f tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] [instance: 2d2de8ea-1016-4289-994f-59d8742f9b58] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:23.673769 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2651bf5c-b139-46ac-90c4-5304d04a6c2f tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:23.675613 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2651bf5c-b139-46ac-90c4-5304d04a6c2f tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:23.677392 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2651bf5c-b139-46ac-90c4-5304d04a6c2f tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:23.680194 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2651bf5c-b139-46ac-90c4-5304d04a6c2f tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:23.681226 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2651bf5c-b139-46ac-90c4-5304d04a6c2f tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:23.685093 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2651bf5c-b139-46ac-90c4-5304d04a6c2f tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:23.713037 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-2651bf5c-b139-46ac-90c4-5304d04a6c2f tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] HTTP exception thrown: Instance 2d2de8ea-1016-4289-994f-59d8742f9b58 could not be found. Sep 23 04:35:23.716762 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2651bf5c-b139-46ac-90c4-5304d04a6c2f tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Request method failure captured: Sep 23 04:35:23.716762 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/2d2de8ea-1016-4289-994f-59d8742f9b58 HTTP/1.1 Sep 23 04:35:23.716762 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:35:23.716762 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:35:23.716762 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:35:23.716762 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:35:23.716762 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:35:23.716762 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:35:23.716762 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:35:23.716762 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:35:23.716762 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTbxD9e0HHktcgCeoKpaygA4XG4-8WuiVVsPDx3Gpy0VDy2jizvEn7F7GrzReh2wQ45bGCN03yFyTwSPyyvpJLxrlWYX82LnQ8ty0sa3O2IcnPBsYDsbarM3_GL-Oc-Z4gDxhU6j1B5vIn7C57vv1JqWXozSDORdCqSYgT7JoNR6Zc0 Sep 23 04:35:23.716762 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:35:23.716762 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:35:23.716762 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:35:23.716762 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:35:23.716762 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:35:23.716762 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:35:23.716762 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 44352a7a6d964530aa20ae83064b02e6 Sep 23 04:35:23.716762 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ServersAdminTestJSON-1041363324 Sep 23 04:35:23.716762 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:35:23.716762 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:35:23.718479 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_44352a7a6d964530aa20ae83064b02e6", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/44352a7a6d964530aa20ae83064b02e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/44352a7a6d964530aa20ae83064b02e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/44352a7a6d964530aa20ae83064b02e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:35:23.718479 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ServersAdminTestJSON-1041363324 Sep 23 04:35:23.718479 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 44352a7a6d964530aa20ae83064b02e6 Sep 23 04:35:23.718479 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ServersAdminTestJSON-1041363324 Sep 23 04:35:23.718479 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ServersAdminTestJSON-1041363324-project Sep 23 04:35:23.718479 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:35:23.718479 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:35:23.718479 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: d1c82752e1bc4fdb82e7f8391c7c129f Sep 23 04:35:23.718479 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ServersAdminTestJSON-1041363324-project Sep 23 04:35:23.718479 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:35:23.718479 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 2d2de8ea-1016-4289-994f-59d8742f9b58 could not be found. Sep 23 04:35:23.718479 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '2d2de8ea-1016-4289-994f-59d8742f9b58'} Sep 23 04:35:23.719443 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:35:23.719443 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:35:23.719443 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:35:23.719443 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:35:23.719443 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:35:23.719443 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:35:23.719443 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:35:23.719443 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:35:23.719443 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:35:23.719443 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:35:23.719443 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d2de8ea-1016-4289-994f-59d8742f9b58 could not be found. Sep 23 04:35:23.719443 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:35:23.719443 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:35:23.719443 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:35:23.719443 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:35:23.719443 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:35:23.719443 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:35:23.719443 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:35:23.719443 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:35:23.719443 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:35:23.721104 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:35:23.721104 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:35:23.721104 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:35:23.721104 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:35:23.721104 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:35:23.721104 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:35:23.721104 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:35:23.721104 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d2de8ea-1016-4289-994f-59d8742f9b58 could not be found. Sep 23 04:35:23.721104 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:35:23.721104 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:35:23.721104 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:35:23.721104 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:35:23.721104 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:35:23.721104 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:35:23.721104 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:35:23.721104 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:35:23.721104 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d2de8ea-1016-4289-994f-59d8742f9b58 could not be found. Sep 23 04:35:23.721104 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:35:23.724981 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2651bf5c-b139-46ac-90c4-5304d04a6c2f tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Returning 404 to user: Instance 2d2de8ea-1016-4289-994f-59d8742f9b58 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:35:23.725849 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2651bf5c-b139-46ac-90c4-5304d04a6c2f tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] 10.222.0.33 "GET /compute/v2.1/servers/2d2de8ea-1016-4289-994f-59d8742f9b58" status: 404 len: 111 microversion: 2.1 time: 0.074104 Sep 23 04:35:23.735053 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 648/1217] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:23 2022] GET /compute/v2.1/servers/2d2de8ea-1016-4289-994f-59d8742f9b58 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:35:23.735053 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-27105851-896c-4a10-92fa-4148c11b5a11 req-32659672-4738-41ec-bbc9-650415a78d52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d2de8ea-1016-4289-994f-59d8742f9b58", "name": "network-vif-deleted", "tag": "a1b3b8d8-27ea-471f-96fe-fbc5172fee43"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:35:23.750372 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-27105851-896c-4a10-92fa-4148c11b5a11 req-32659672-4738-41ec-bbc9-650415a78d52 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:23.751461 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-27105851-896c-4a10-92fa-4148c11b5a11 req-32659672-4738-41ec-bbc9-650415a78d52 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:23.752066 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-27105851-896c-4a10-92fa-4148c11b5a11 req-32659672-4738-41ec-bbc9-650415a78d52 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:23.764637 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-27105851-896c-4a10-92fa-4148c11b5a11 req-32659672-4738-41ec-bbc9-650415a78d52 service nova] Creating event network-vif-deleted:a1b3b8d8-27ea-471f-96fe-fbc5172fee43 for instance 2d2de8ea-1016-4289-994f-59d8742f9b58 on n-h1-846463-3 Sep 23 04:35:23.772670 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-27105851-896c-4a10-92fa-4148c11b5a11 req-32659672-4738-41ec-bbc9-650415a78d52 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044786 Sep 23 04:35:23.773569 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 649/1218] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:35:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:35:23.881166 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-43e26919-e363-41a0-9767-98ac299b54e8 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Flavor limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:35:23.881595 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-43e26919-e363-41a0-9767-98ac299b54e8 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Image limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:35:23.882104 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-43e26919-e363-41a0-9767-98ac299b54e8 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Flavor pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:35:23.882515 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-43e26919-e363-41a0-9767-98ac299b54e8 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Image pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:35:23.883237 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-43e26919-e363-41a0-9767-98ac299b54e8 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:35:23.910070 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-43e26919-e363-41a0-9767-98ac299b54e8 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:23.912343 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-43e26919-e363-41a0-9767-98ac299b54e8 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:23.912343 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-43e26919-e363-41a0-9767-98ac299b54e8 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:23.912343 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-43e26919-e363-41a0-9767-98ac299b54e8 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:23.912343 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-43e26919-e363-41a0-9767-98ac299b54e8 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:23.912715 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-43e26919-e363-41a0-9767-98ac299b54e8 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:23.964426 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-43e26919-e363-41a0-9767-98ac299b54e8 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Getting quotas for project 60d1259e4a2a4d07a7becd15aa8891bd. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:35:23.964644 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-43e26919-e363-41a0-9767-98ac299b54e8 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Getting quotas for user ef5d8ac586e04707acec235c122e5bac and project 60d1259e4a2a4d07a7becd15aa8891bd. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:35:23.979288 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-43e26919-e363-41a0-9767-98ac299b54e8 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Going to run 1 instances... {{(pid=122698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:35:23.981621 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-43e26919-e363-41a0-9767-98ac299b54e8 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] [instance: 533efe90-e3aa-416f-a268-c7b779614c7e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:35:23.982786 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-03bc3a1f-6777-4bbf-b66e-8c3658301215 tempest-KeyPairsV2TestJSON-334025566 tempest-KeyPairsV2TestJSON-334025566-project] Action: 'create', calling method: .version_select at 0x7ff1bb9addc0>, body: {"keypair": {"name": "tempest-keypair-2100147947", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMBgu9jxxs1w0Dplw+PYSpvAl3ZuInxMcuK3BLdk16zWtBfYGFw8jogYhMYKCl3LO3F4bK7EdDYbBWopMaNK3FFjQ7vdr9m2FfYUvPqOIrGi6HScHznJvIkfwVXtvCjSUQ=="}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:35:23.999770 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-03bc3a1f-6777-4bbf-b66e-8c3658301215 tempest-KeyPairsV2TestJSON-334025566 tempest-KeyPairsV2TestJSON-334025566-project] Getting quotas for project d759f5ae3ec541d288200ddfb5b3a0bd. Resources: {'key_pairs'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:35:24.008318 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-03bc3a1f-6777-4bbf-b66e-8c3658301215 tempest-KeyPairsV2TestJSON-334025566 tempest-KeyPairsV2TestJSON-334025566-project] Getting quotas for user ababfd45cb41426c8ae2086b56b7237b and project d759f5ae3ec541d288200ddfb5b3a0bd. Resources: {'key_pairs'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:35:24.089443 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-43e26919-e363-41a0-9767-98ac299b54e8 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.928986 Sep 23 04:35:24.090458 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 570/1219] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:35:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1931 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:35:24.095145 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-78e2debb-4f58-47cb-9379-7a3b8af5fd9a tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1770220148"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:35:24.095686 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-78e2debb-4f58-47cb-9379-7a3b8af5fd9a tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] [instance: 19a775ff-efab-43d1-9a67-9ed31f6d1fc4] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:24.101342 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-03bc3a1f-6777-4bbf-b66e-8c3658301215 tempest-KeyPairsV2TestJSON-334025566 tempest-KeyPairsV2TestJSON-334025566-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.325890 Sep 23 04:35:24.103216 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 650/1220] 10.222.0.33 () {60 vars in 1159 bytes} [Fri Sep 23 04:35:23 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:35:24.106637 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-78e2debb-4f58-47cb-9379-7a3b8af5fd9a tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:24.106637 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-78e2debb-4f58-47cb-9379-7a3b8af5fd9a tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:24.106637 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-78e2debb-4f58-47cb-9379-7a3b8af5fd9a tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:24.106637 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-78e2debb-4f58-47cb-9379-7a3b8af5fd9a tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:24.107014 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-78e2debb-4f58-47cb-9379-7a3b8af5fd9a tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:24.107264 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-78e2debb-4f58-47cb-9379-7a3b8af5fd9a tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:24.109596 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-dfe2f578-90d7-4647-a00d-4c95afbb8e00 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:24.110302 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-dfe2f578-90d7-4647-a00d-4c95afbb8e00 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] [instance: 4f54b509-03bd-4fe1-9608-faaae848d5ac] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:24.126027 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dfe2f578-90d7-4647-a00d-4c95afbb8e00 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:24.126027 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dfe2f578-90d7-4647-a00d-4c95afbb8e00 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:24.126811 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dfe2f578-90d7-4647-a00d-4c95afbb8e00 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:24.127806 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dfe2f578-90d7-4647-a00d-4c95afbb8e00 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:24.128359 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dfe2f578-90d7-4647-a00d-4c95afbb8e00 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:24.128931 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dfe2f578-90d7-4647-a00d-4c95afbb8e00 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:24.187644 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-dfe2f578-90d7-4647-a00d-4c95afbb8e00 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] [instance: 4f54b509-03bd-4fe1-9608-faaae848d5ac] Going to try to terminate instance {{(pid=122699) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:35:24.322971 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.network.security_group_api [None req-78e2debb-4f58-47cb-9379-7a3b8af5fd9a tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Adding security group f3918647-7ac8-412c-893d-11e3349ae9e3 to port f1fb3ae7-413d-4c1c-a6ae-6f6d50cb1cf1 Sep 23 04:35:24.482972 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:35:24.578809 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-dfe2f578-90d7-4647-a00d-4c95afbb8e00 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4f54b509-03bd-4fe1-9608-faaae848d5ac" status: 204 len: 0 microversion: 2.1 time: 0.475644 Sep 23 04:35:24.583047 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 651/1221] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:35:24 2022] DELETE /compute/v2.1/servers/4f54b509-03bd-4fe1-9608-faaae848d5ac => generated 0 bytes in 478 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:35:24.588313 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-985f612b-40a6-4eae-b425-b428d4d9cbe9 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:24.591815 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-985f612b-40a6-4eae-b425-b428d4d9cbe9 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: fbbf8d58-8edb-4172-9d19-4b82804bf8e9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:24.598018 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-985f612b-40a6-4eae-b425-b428d4d9cbe9 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:24.598518 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-985f612b-40a6-4eae-b425-b428d4d9cbe9 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:24.598959 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-985f612b-40a6-4eae-b425-b428d4d9cbe9 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:24.599681 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-985f612b-40a6-4eae-b425-b428d4d9cbe9 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:24.600141 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-985f612b-40a6-4eae-b425-b428d4d9cbe9 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:24.600758 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-985f612b-40a6-4eae-b425-b428d4d9cbe9 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:24.814735 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-985f612b-40a6-4eae-b425-b428d4d9cbe9 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:24.861354 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-985f612b-40a6-4eae-b425-b428d4d9cbe9 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/fbbf8d58-8edb-4172-9d19-4b82804bf8e9" status: 200 len: 1542 microversion: 2.1 time: 0.274432 Sep 23 04:35:24.862002 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 652/1222] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:24 2022] GET /compute/v2.1/servers/fbbf8d58-8edb-4172-9d19-4b82804bf8e9 => generated 1542 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:24.877063 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-151c3622-b03f-4095-bb1e-4a177cddfedd tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:24.878052 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-151c3622-b03f-4095-bb1e-4a177cddfedd tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] [instance: 533efe90-e3aa-416f-a268-c7b779614c7e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:24.921581 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-78e2debb-4f58-47cb-9379-7a3b8af5fd9a tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] 10.222.0.33 "POST /compute/v2.1/servers/19a775ff-efab-43d1-9a67-9ed31f6d1fc4/action" status: 202 len: 0 microversion: 2.1 time: 0.830036 Sep 23 04:35:24.922220 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 571/1223] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:35:24 2022] POST /compute/v2.1/servers/19a775ff-efab-43d1-9a67-9ed31f6d1fc4/action => generated 0 bytes in 831 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:35:24.927077 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ccaa4424-6ac5-4a40-b3d5-01b5391e9df7 tempest-KeyPairsV2TestJSON-334025566 tempest-KeyPairsV2TestJSON-334025566-project] Calling method '.version_select at 0x7ff1bbab7550>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:24.944668 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ccaa4424-6ac5-4a40-b3d5-01b5391e9df7 tempest-KeyPairsV2TestJSON-334025566 tempest-KeyPairsV2TestJSON-334025566-project] 10.222.0.33 "GET /compute/v2.1/os-keypairs/tempest-keypair-2100147947" status: 200 len: 497 microversion: 2.1 time: 0.021227 Sep 23 04:35:24.945663 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 572/1224] 10.222.0.33 () {58 vars in 1218 bytes} [Fri Sep 23 04:35:24 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-2100147947 => generated 497 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:35:24.960951 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-84f2e1f4-5aa7-4761-b993-b16d6522a207 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:24.961674 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-84f2e1f4-5aa7-4761-b993-b16d6522a207 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] [instance: 4f54b509-03bd-4fe1-9608-faaae848d5ac] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:24.968966 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-84f2e1f4-5aa7-4761-b993-b16d6522a207 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:24.969766 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-84f2e1f4-5aa7-4761-b993-b16d6522a207 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:24.973106 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-84f2e1f4-5aa7-4761-b993-b16d6522a207 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:24.973106 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-84f2e1f4-5aa7-4761-b993-b16d6522a207 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:24.973106 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-84f2e1f4-5aa7-4761-b993-b16d6522a207 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:24.973106 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-84f2e1f4-5aa7-4761-b993-b16d6522a207 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:24.977648 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-151c3622-b03f-4095-bb1e-4a177cddfedd tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5d8ac586e04707acec235c122e5bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60d1259e4a2a4d07a7becd15aa8891bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:24.988641 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-151c3622-b03f-4095-bb1e-4a177cddfedd tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] 10.222.0.33 "GET /compute/v2.1/servers/533efe90-e3aa-416f-a268-c7b779614c7e" status: 200 len: 1215 microversion: 2.1 time: 0.125522 Sep 23 04:35:24.989431 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 653/1225] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:24 2022] GET /compute/v2.1/servers/533efe90-e3aa-416f-a268-c7b779614c7e => generated 1215 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:24.994827 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4e1aab57-097a-4bef-8704-9e5ec90dc730 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-505576635"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:35:24.995330 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4e1aab57-097a-4bef-8704-9e5ec90dc730 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] [instance: 19a775ff-efab-43d1-9a67-9ed31f6d1fc4] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:25.002790 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4e1aab57-097a-4bef-8704-9e5ec90dc730 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:25.003475 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4e1aab57-097a-4bef-8704-9e5ec90dc730 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:25.004309 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4e1aab57-097a-4bef-8704-9e5ec90dc730 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:25.005180 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4e1aab57-097a-4bef-8704-9e5ec90dc730 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:25.005981 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4e1aab57-097a-4bef-8704-9e5ec90dc730 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:25.006609 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4e1aab57-097a-4bef-8704-9e5ec90dc730 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:25.256524 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-84f2e1f4-5aa7-4761-b993-b16d6522a207 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c82752e1bc4fdb82e7f8391c7c129f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44352a7a6d964530aa20ae83064b02e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:25.267737 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-84f2e1f4-5aa7-4761-b993-b16d6522a207 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] 10.222.0.33 "GET /compute/v2.1/servers/4f54b509-03bd-4fe1-9608-faaae848d5ac" status: 200 len: 1470 microversion: 2.1 time: 0.320739 Sep 23 04:35:25.270967 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 573/1226] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:24 2022] GET /compute/v2.1/servers/4f54b509-03bd-4fe1-9608-faaae848d5ac => generated 1470 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:25.277598 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8a29ee6b-7f2b-4b4d-8b0f-02f1fca786bb tempest-KeyPairsV2TestJSON-334025566 tempest-KeyPairsV2TestJSON-334025566-project] Calling method '.version_select at 0x7ff1bbaa7700>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:25.282901 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.network.security_group_api [None req-4e1aab57-097a-4bef-8704-9e5ec90dc730 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Adding security group 4d89f5c9-f26a-47f4-b260-9163e190e777 to port f1fb3ae7-413d-4c1c-a6ae-6f6d50cb1cf1 Sep 23 04:35:25.292796 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:35:25.477678 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8a29ee6b-7f2b-4b4d-8b0f-02f1fca786bb tempest-KeyPairsV2TestJSON-334025566 tempest-KeyPairsV2TestJSON-334025566-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2100147947" status: 202 len: 0 microversion: 2.1 time: 0.205063 Sep 23 04:35:25.478610 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 574/1227] 10.222.0.33 () {58 vars in 1221 bytes} [Fri Sep 23 04:35:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2100147947 => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:35:25.491877 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d00be56d-ee54-4f38-bfef-3003f7f4e8a4 tempest-KeyPairsV2TestJSON-334025566 tempest-KeyPairsV2TestJSON-334025566-project] Action: 'create', calling method: .version_select at 0x7ff1bbaa9dc0>, body: {"keypair": {"name": "tempest-keypair-1553925684", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNkW+0bLi3xKKhUx+oKwRq+2uq+seCNXiJcATugQViN2l8VRHxpwL/vB9JjZ8aA5cdlZkIRfyn3S+q4bU1L+kF7PC4mhzyLZNRVFtvR4vK1i0QTVOjfeq1vCyqO6HqfPCA=="}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:35:25.544528 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-d00be56d-ee54-4f38-bfef-3003f7f4e8a4 tempest-KeyPairsV2TestJSON-334025566 tempest-KeyPairsV2TestJSON-334025566-project] Getting quotas for project d759f5ae3ec541d288200ddfb5b3a0bd. Resources: {'key_pairs'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:35:25.553982 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-d00be56d-ee54-4f38-bfef-3003f7f4e8a4 tempest-KeyPairsV2TestJSON-334025566 tempest-KeyPairsV2TestJSON-334025566-project] Getting quotas for user ababfd45cb41426c8ae2086b56b7237b and project d759f5ae3ec541d288200ddfb5b3a0bd. Resources: {'key_pairs'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:35:25.677964 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d00be56d-ee54-4f38-bfef-3003f7f4e8a4 tempest-KeyPairsV2TestJSON-334025566 tempest-KeyPairsV2TestJSON-334025566-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.190317 Sep 23 04:35:25.679968 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 575/1228] 10.222.0.33 () {60 vars in 1159 bytes} [Fri Sep 23 04:35:25 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:35:25.692908 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-94f6c24c-229f-413d-a716-3391abcded82 tempest-KeyPairsV2TestJSON-334025566 tempest-KeyPairsV2TestJSON-334025566-project] Calling method '.version_select at 0x7ff1bbb4d430>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:25.764750 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4e1aab57-097a-4bef-8704-9e5ec90dc730 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] 10.222.0.33 "POST /compute/v2.1/servers/19a775ff-efab-43d1-9a67-9ed31f6d1fc4/action" status: 202 len: 0 microversion: 2.1 time: 0.774012 Sep 23 04:35:25.765668 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 654/1229] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:35:24 2022] POST /compute/v2.1/servers/19a775ff-efab-43d1-9a67-9ed31f6d1fc4/action => generated 0 bytes in 775 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:35:25.774216 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ce2ae20c-e771-483b-86ac-cebb93ad5101 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:25.775087 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ce2ae20c-e771-483b-86ac-cebb93ad5101 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] [instance: 19a775ff-efab-43d1-9a67-9ed31f6d1fc4] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:25.784550 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ce2ae20c-e771-483b-86ac-cebb93ad5101 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:25.788436 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ce2ae20c-e771-483b-86ac-cebb93ad5101 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:25.788436 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ce2ae20c-e771-483b-86ac-cebb93ad5101 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:25.788436 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ce2ae20c-e771-483b-86ac-cebb93ad5101 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:25.788436 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ce2ae20c-e771-483b-86ac-cebb93ad5101 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:25.788803 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ce2ae20c-e771-483b-86ac-cebb93ad5101 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:25.813035 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-94f6c24c-229f-413d-a716-3391abcded82 tempest-KeyPairsV2TestJSON-334025566 tempest-KeyPairsV2TestJSON-334025566-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1553925684" status: 202 len: 0 microversion: 2.1 time: 0.126184 Sep 23 04:35:25.813665 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 576/1230] 10.222.0.33 () {58 vars in 1221 bytes} [Fri Sep 23 04:35:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1553925684 => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 23 04:35:25.825765 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-1219d5a3-fb90-44d3-a4f8-d54d2e45550f req-792c10e5-9bab-46d5-8c4a-edcaca7d6d15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19a775ff-efab-43d1-9a67-9ed31f6d1fc4", "tag": "f1fb3ae7-413d-4c1c-a6ae-6f6d50cb1cf1"}, {"name": "network-changed", "server_uuid": "19a775ff-efab-43d1-9a67-9ed31f6d1fc4", "tag": "f1fb3ae7-413d-4c1c-a6ae-6f6d50cb1cf1"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:35:25.847707 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-1219d5a3-fb90-44d3-a4f8-d54d2e45550f req-792c10e5-9bab-46d5-8c4a-edcaca7d6d15 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:25.850109 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-1219d5a3-fb90-44d3-a4f8-d54d2e45550f req-792c10e5-9bab-46d5-8c4a-edcaca7d6d15 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:25.850560 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-1219d5a3-fb90-44d3-a4f8-d54d2e45550f req-792c10e5-9bab-46d5-8c4a-edcaca7d6d15 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:25.873650 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-1219d5a3-fb90-44d3-a4f8-d54d2e45550f req-792c10e5-9bab-46d5-8c4a-edcaca7d6d15 service nova] Creating event network-changed:f1fb3ae7-413d-4c1c-a6ae-6f6d50cb1cf1 for instance 19a775ff-efab-43d1-9a67-9ed31f6d1fc4 on n-h2-846463-3 Sep 23 04:35:25.874471 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-1219d5a3-fb90-44d3-a4f8-d54d2e45550f req-792c10e5-9bab-46d5-8c4a-edcaca7d6d15 service nova] Creating event network-changed:f1fb3ae7-413d-4c1c-a6ae-6f6d50cb1cf1 for instance 19a775ff-efab-43d1-9a67-9ed31f6d1fc4 on n-h2-846463-3 Sep 23 04:35:25.880913 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-1219d5a3-fb90-44d3-a4f8-d54d2e45550f req-792c10e5-9bab-46d5-8c4a-edcaca7d6d15 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.061590 Sep 23 04:35:25.882752 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 577/1231] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:35:25 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:35:25.889075 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-abbbfabd-2621-4405-9ffe-bdb7a9bc321e tempest-KeyPairsV2TestJSON-334025566 tempest-KeyPairsV2TestJSON-334025566-project] Action: 'create', calling method: .version_select at 0x7ff1bbab7160>, body: {"keypair": {"name": "tempest-keypair-198853317", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:35:25.918380 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-abbbfabd-2621-4405-9ffe-bdb7a9bc321e tempest-KeyPairsV2TestJSON-334025566 tempest-KeyPairsV2TestJSON-334025566-project] Getting quotas for project d759f5ae3ec541d288200ddfb5b3a0bd. Resources: {'key_pairs'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:35:25.927799 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-abbbfabd-2621-4405-9ffe-bdb7a9bc321e tempest-KeyPairsV2TestJSON-334025566 tempest-KeyPairsV2TestJSON-334025566-project] Getting quotas for user ababfd45cb41426c8ae2086b56b7237b and project d759f5ae3ec541d288200ddfb5b3a0bd. Resources: {'key_pairs'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:35:26.043197 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ce2ae20c-e771-483b-86ac-cebb93ad5101 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] 10.222.0.33 "GET /compute/v2.1/servers/19a775ff-efab-43d1-9a67-9ed31f6d1fc4/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 0.272569 Sep 23 04:35:26.047295 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-abbbfabd-2621-4405-9ffe-bdb7a9bc321e tempest-KeyPairsV2TestJSON-334025566 tempest-KeyPairsV2TestJSON-334025566-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 573 microversion: 2.1 time: 0.163133 Sep 23 04:35:26.048639 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 578/1232] 10.222.0.33 () {60 vars in 1159 bytes} [Fri Sep 23 04:35:25 2022] POST /compute/v2.1/os-keypairs => generated 573 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:35:26.057521 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 655/1233] 10.222.0.33 () {58 vars in 1293 bytes} [Fri Sep 23 04:35:25 2022] GET /compute/v2.1/servers/19a775ff-efab-43d1-9a67-9ed31f6d1fc4/os-security-groups => generated 1158 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:26.062884 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c24c50f5-23ef-4407-9a92-e73a47b32687 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:26.066994 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c24c50f5-23ef-4407-9a92-e73a47b32687 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] [instance: 533efe90-e3aa-416f-a268-c7b779614c7e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:26.067301 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7b8474ee-4a6e-4bc0-a3eb-6508fe437638 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:26.067301 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7b8474ee-4a6e-4bc0-a3eb-6508fe437638 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: fbbf8d58-8edb-4172-9d19-4b82804bf8e9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:26.073356 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c24c50f5-23ef-4407-9a92-e73a47b32687 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:26.074155 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c24c50f5-23ef-4407-9a92-e73a47b32687 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:26.074779 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c24c50f5-23ef-4407-9a92-e73a47b32687 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:26.075989 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c24c50f5-23ef-4407-9a92-e73a47b32687 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:26.076626 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c24c50f5-23ef-4407-9a92-e73a47b32687 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:26.077219 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c24c50f5-23ef-4407-9a92-e73a47b32687 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:26.093736 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7b8474ee-4a6e-4bc0-a3eb-6508fe437638 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:26.095764 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7b8474ee-4a6e-4bc0-a3eb-6508fe437638 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:26.095764 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7b8474ee-4a6e-4bc0-a3eb-6508fe437638 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:26.099938 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7b8474ee-4a6e-4bc0-a3eb-6508fe437638 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:26.100646 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7b8474ee-4a6e-4bc0-a3eb-6508fe437638 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:26.104059 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7b8474ee-4a6e-4bc0-a3eb-6508fe437638 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:26.170605 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c24c50f5-23ef-4407-9a92-e73a47b32687 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5d8ac586e04707acec235c122e5bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60d1259e4a2a4d07a7becd15aa8891bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:26.205449 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c24c50f5-23ef-4407-9a92-e73a47b32687 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] 10.222.0.33 "GET /compute/v2.1/servers/533efe90-e3aa-416f-a268-c7b779614c7e" status: 200 len: 1219 microversion: 2.1 time: 0.146448 Sep 23 04:35:26.213676 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 656/1234] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:26 2022] GET /compute/v2.1/servers/533efe90-e3aa-416f-a268-c7b779614c7e => generated 1219 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:26.218813 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ccf8b939-4d54-494e-bbf2-37285c29795f tempest-KeyPairsV2TestJSON-334025566 tempest-KeyPairsV2TestJSON-334025566-project] Calling method '.version_select at 0x7ff1bbb2f310>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:26.353709 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ccf8b939-4d54-494e-bbf2-37285c29795f tempest-KeyPairsV2TestJSON-334025566 tempest-KeyPairsV2TestJSON-334025566-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-198853317" status: 202 len: 0 microversion: 2.1 time: 0.134732 Sep 23 04:35:26.358544 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 657/1235] 10.222.0.33 () {58 vars in 1218 bytes} [Fri Sep 23 04:35:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-198853317 => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:35:26.365577 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ce87fef0-561d-45f0-a328-fb813aaeb52a tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Action: 'create', calling method: .version_select at 0x7ff1bb8d8940>, body: {"security_group": {"name": " tempest-securitygroup -1516388364 ", "description": "tempest-description-1383472664"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:35:26.504274 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-7b8474ee-4a6e-4bc0-a3eb-6508fe437638 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:26.520748 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7b8474ee-4a6e-4bc0-a3eb-6508fe437638 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/fbbf8d58-8edb-4172-9d19-4b82804bf8e9" status: 200 len: 1542 microversion: 2.1 time: 0.470620 Sep 23 04:35:26.522322 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 579/1236] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:26 2022] GET /compute/v2.1/servers/fbbf8d58-8edb-4172-9d19-4b82804bf8e9 => generated 1542 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:26.533782 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6a897e55-063b-4e23-b73b-37b66458a445 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:26.536726 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-6a897e55-063b-4e23-b73b-37b66458a445 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] [instance: 4f54b509-03bd-4fe1-9608-faaae848d5ac] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:26.567140 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6a897e55-063b-4e23-b73b-37b66458a445 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:26.568395 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6a897e55-063b-4e23-b73b-37b66458a445 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:26.570661 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6a897e55-063b-4e23-b73b-37b66458a445 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:26.574404 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6a897e55-063b-4e23-b73b-37b66458a445 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:26.574404 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6a897e55-063b-4e23-b73b-37b66458a445 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:26.574404 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6a897e55-063b-4e23-b73b-37b66458a445 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:27.428712 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6a897e55-063b-4e23-b73b-37b66458a445 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c82752e1bc4fdb82e7f8391c7c129f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44352a7a6d964530aa20ae83064b02e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:27.439820 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-6a897e55-063b-4e23-b73b-37b66458a445 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] 10.222.0.33 "GET /compute/v2.1/servers/4f54b509-03bd-4fe1-9608-faaae848d5ac" status: 200 len: 1470 microversion: 2.1 time: 0.916712 Sep 23 04:35:27.440827 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 580/1237] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:26 2022] GET /compute/v2.1/servers/4f54b509-03bd-4fe1-9608-faaae848d5ac => generated 1470 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:27.455052 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-fbf6d598-ab36-4dc2-8e0d-4883935d66a0 tempest-KeyPairsV2TestJSON-334025566 tempest-KeyPairsV2TestJSON-334025566-project] Action: 'create', calling method: .version_select at 0x7ff1bbaf2430>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-858579875", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD9fSCXBam0hXxi6rsSlJYIWdGieH1rrAKpWkU0IkoYeSa6Ol3nKVTNtZnnqL3yI/kcPn2vQv2slcia/86dSyHpKJsAn3rRP6d0HhAsRkY23Rd2m5SgcQuC7dvW0oLFrWg=="}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:35:27.475905 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-fbf6d598-ab36-4dc2-8e0d-4883935d66a0 tempest-KeyPairsV2TestJSON-334025566 tempest-KeyPairsV2TestJSON-334025566-project] Getting quotas for project d759f5ae3ec541d288200ddfb5b3a0bd. Resources: {'key_pairs'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:35:27.487633 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-fbf6d598-ab36-4dc2-8e0d-4883935d66a0 tempest-KeyPairsV2TestJSON-334025566 tempest-KeyPairsV2TestJSON-334025566-project] Getting quotas for user ababfd45cb41426c8ae2086b56b7237b and project d759f5ae3ec541d288200ddfb5b3a0bd. Resources: {'key_pairs'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:35:27.559478 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ce87fef0-561d-45f0-a328-fb813aaeb52a tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 224 microversion: 2.1 time: 1.199569 Sep 23 04:35:27.560623 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 658/1238] 10.222.0.33 () {60 vars in 1180 bytes} [Fri Sep 23 04:35:26 2022] POST /compute/v2.1/os-security-groups => generated 224 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:35:27.565931 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a0d5a6dd-4493-4f61-af19-ad59920d9fe3 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:27.567854 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a0d5a6dd-4493-4f61-af19-ad59920d9fe3 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] [instance: 533efe90-e3aa-416f-a268-c7b779614c7e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:27.588164 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a0d5a6dd-4493-4f61-af19-ad59920d9fe3 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:27.589046 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a0d5a6dd-4493-4f61-af19-ad59920d9fe3 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:27.589741 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a0d5a6dd-4493-4f61-af19-ad59920d9fe3 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:27.592617 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a0d5a6dd-4493-4f61-af19-ad59920d9fe3 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:27.593184 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a0d5a6dd-4493-4f61-af19-ad59920d9fe3 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:27.593699 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a0d5a6dd-4493-4f61-af19-ad59920d9fe3 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:27.648167 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-fbf6d598-ab36-4dc2-8e0d-4883935d66a0 tempest-KeyPairsV2TestJSON-334025566 tempest-KeyPairsV2TestJSON-334025566-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.193133 Sep 23 04:35:27.648803 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 581/1239] 10.222.0.33 () {60 vars in 1159 bytes} [Fri Sep 23 04:35:27 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:35:27.653711 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4c804b62-4e67-4f47-a21f-bca370203dcb tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:27.654361 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4c804b62-4e67-4f47-a21f-bca370203dcb tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: fbbf8d58-8edb-4172-9d19-4b82804bf8e9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:27.666891 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4c804b62-4e67-4f47-a21f-bca370203dcb tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:27.670996 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4c804b62-4e67-4f47-a21f-bca370203dcb tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:27.670996 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4c804b62-4e67-4f47-a21f-bca370203dcb tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:27.670996 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4c804b62-4e67-4f47-a21f-bca370203dcb tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:27.670996 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4c804b62-4e67-4f47-a21f-bca370203dcb tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:27.671380 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4c804b62-4e67-4f47-a21f-bca370203dcb tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:27.732114 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a0d5a6dd-4493-4f61-af19-ad59920d9fe3 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5d8ac586e04707acec235c122e5bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60d1259e4a2a4d07a7becd15aa8891bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:27.767806 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a0d5a6dd-4493-4f61-af19-ad59920d9fe3 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] 10.222.0.33 "GET /compute/v2.1/servers/533efe90-e3aa-416f-a268-c7b779614c7e" status: 200 len: 1267 microversion: 2.1 time: 0.205751 Sep 23 04:35:27.786747 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 659/1240] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:27 2022] GET /compute/v2.1/servers/533efe90-e3aa-416f-a268-c7b779614c7e => generated 1267 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:27.794645 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-11a1c56b-ae93-4af3-aaaf-738b9e0cd5a5 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Calling method '.version_select at 0x7ff1bb91a040>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:27.939260 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-11a1c56b-ae93-4af3-aaaf-738b9e0cd5a5 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] 10.222.0.33 "GET /compute/v2.1/os-security-groups/2d927e30-5ff7-4ded-990d-0c684ffcec12" status: 200 len: 224 microversion: 2.1 time: 0.150940 Sep 23 04:35:27.941173 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 660/1241] 10.222.0.33 () {58 vars in 1269 bytes} [Fri Sep 23 04:35:27 2022] GET /compute/v2.1/os-security-groups/2d927e30-5ff7-4ded-990d-0c684ffcec12 => generated 224 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:35:27.949520 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-96fae104-7494-4465-9254-a983450846d9 tempest-KeyPairsV2TestJSON-334025566 tempest-KeyPairsV2TestJSON-334025566-project] Action: 'create', calling method: .version_select at 0x7ff1c030b4c0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1509261722", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLxHx8wuAHeXpkMSVCvSlGmu4gY7mqR0s7z4cKpPV9Q4u0Y8TRbT41/CzbAHrFm2lNu2pLn2H82ubuq/QV/iYDaWBbGX5KSMms5Iw/2D0kB3dyTUTVSpcasvf26lM9E/fA=="}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:35:27.982987 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-96fae104-7494-4465-9254-a983450846d9 tempest-KeyPairsV2TestJSON-334025566 tempest-KeyPairsV2TestJSON-334025566-project] Getting quotas for project d759f5ae3ec541d288200ddfb5b3a0bd. Resources: {'key_pairs'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:35:27.995262 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-96fae104-7494-4465-9254-a983450846d9 tempest-KeyPairsV2TestJSON-334025566 tempest-KeyPairsV2TestJSON-334025566-project] Getting quotas for user ababfd45cb41426c8ae2086b56b7237b and project d759f5ae3ec541d288200ddfb5b3a0bd. Resources: {'key_pairs'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:35:28.044204 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4c804b62-4e67-4f47-a21f-bca370203dcb tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:28.059911 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4c804b62-4e67-4f47-a21f-bca370203dcb tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/fbbf8d58-8edb-4172-9d19-4b82804bf8e9" status: 200 len: 1542 microversion: 2.1 time: 0.409159 Sep 23 04:35:28.061288 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 582/1242] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:27 2022] GET /compute/v2.1/servers/fbbf8d58-8edb-4172-9d19-4b82804bf8e9 => generated 1542 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:28.067363 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d456adac-0464-4ca1-9f88-1efef0fbba7f tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Calling method '.version_select at 0x7ff1bbbc1280>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:28.166871 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-96fae104-7494-4465-9254-a983450846d9 tempest-KeyPairsV2TestJSON-334025566 tempest-KeyPairsV2TestJSON-334025566-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.223984 Sep 23 04:35:28.173914 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 661/1243] 10.222.0.33 () {60 vars in 1159 bytes} [Fri Sep 23 04:35:27 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:35:28.187102 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-9eeeaedd-b814-40d6-bdb9-596ce0167d6c req-7eebeba8-ce03-4f17-a786-5386bb0e0c56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f54b509-03bd-4fe1-9608-faaae848d5ac", "name": "network-vif-deleted", "tag": "3ef36ecf-cbc6-4c5b-8a7a-ad331f2db8a3"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:35:28.224088 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-9eeeaedd-b814-40d6-bdb9-596ce0167d6c req-7eebeba8-ce03-4f17-a786-5386bb0e0c56 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:28.227881 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-9eeeaedd-b814-40d6-bdb9-596ce0167d6c req-7eebeba8-ce03-4f17-a786-5386bb0e0c56 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:28.228360 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-9eeeaedd-b814-40d6-bdb9-596ce0167d6c req-7eebeba8-ce03-4f17-a786-5386bb0e0c56 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:28.258079 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-9eeeaedd-b814-40d6-bdb9-596ce0167d6c req-7eebeba8-ce03-4f17-a786-5386bb0e0c56 service nova] Creating event network-vif-deleted:3ef36ecf-cbc6-4c5b-8a7a-ad331f2db8a3 for instance 4f54b509-03bd-4fe1-9608-faaae848d5ac on n-h1-846463-3 Sep 23 04:35:28.272500 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-9eeeaedd-b814-40d6-bdb9-596ce0167d6c req-7eebeba8-ce03-4f17-a786-5386bb0e0c56 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101701 Sep 23 04:35:28.276051 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 662/1244] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:35:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:35:28.315145 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0609b82c-9c9e-499f-82aa-cb6b26ef45ef tempest-KeyPairsV2TestJSON-334025566 tempest-KeyPairsV2TestJSON-334025566-project] Action: 'create', calling method: .version_select at 0x7ff1bb9addc0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1878437137", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPz2ToOw+WVfXrEUmFjsmGX3cskW4fllzop7NN3C0bhlhPuQUWeQmUUszZbIQ67qoq7XT5qg9pULFnwil6FHVa/335j/vvWU/1Lb5+jD8x3nk9hfQfcF/52bj1uxIrd1Kg=="}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:35:28.388285 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-0609b82c-9c9e-499f-82aa-cb6b26ef45ef tempest-KeyPairsV2TestJSON-334025566 tempest-KeyPairsV2TestJSON-334025566-project] Getting quotas for project d759f5ae3ec541d288200ddfb5b3a0bd. Resources: {'key_pairs'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:35:28.395139 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-0609b82c-9c9e-499f-82aa-cb6b26ef45ef tempest-KeyPairsV2TestJSON-334025566 tempest-KeyPairsV2TestJSON-334025566-project] Getting quotas for user ababfd45cb41426c8ae2086b56b7237b and project d759f5ae3ec541d288200ddfb5b3a0bd. Resources: {'key_pairs'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:35:28.496651 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0609b82c-9c9e-499f-82aa-cb6b26ef45ef tempest-KeyPairsV2TestJSON-334025566 tempest-KeyPairsV2TestJSON-334025566-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.215387 Sep 23 04:35:28.498396 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 663/1245] 10.222.0.33 () {60 vars in 1159 bytes} [Fri Sep 23 04:35:28 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:35:28.513123 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a9633313-5c82-4a1d-9692-610fc5eff28e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1827787576", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "networks": [{"uuid": "c69ae9f6-7e1f-4037-b183-87d9ba3569e0"}], "security_groups": [{"name": "tempest-securitygroup--174412469"}], "key_name": "tempest-keypair-1997278881", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:35:28.703414 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d456adac-0464-4ca1-9f88-1efef0fbba7f tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/2d927e30-5ff7-4ded-990d-0c684ffcec12" status: 202 len: 0 microversion: 2.1 time: 0.639972 Sep 23 04:35:28.713391 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 583/1246] 10.222.0.33 () {58 vars in 1272 bytes} [Fri Sep 23 04:35:28 2022] DELETE /compute/v2.1/os-security-groups/2d927e30-5ff7-4ded-990d-0c684ffcec12 => generated 0 bytes in 647 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:35:28.717057 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-166c5467-543f-46d7-abe8-c1bcb435fe88 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:28.718009 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-166c5467-543f-46d7-abe8-c1bcb435fe88 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] [instance: 4f54b509-03bd-4fe1-9608-faaae848d5ac] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:28.724970 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-166c5467-543f-46d7-abe8-c1bcb435fe88 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:28.725853 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-166c5467-543f-46d7-abe8-c1bcb435fe88 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:28.726612 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-166c5467-543f-46d7-abe8-c1bcb435fe88 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:28.728166 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-166c5467-543f-46d7-abe8-c1bcb435fe88 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:28.728923 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-166c5467-543f-46d7-abe8-c1bcb435fe88 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:28.729635 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-166c5467-543f-46d7-abe8-c1bcb435fe88 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:28.795450 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-166c5467-543f-46d7-abe8-c1bcb435fe88 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:28.795450 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-166c5467-543f-46d7-abe8-c1bcb435fe88 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:28.795696 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-166c5467-543f-46d7-abe8-c1bcb435fe88 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:28.796422 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-166c5467-543f-46d7-abe8-c1bcb435fe88 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lazy-loading 'fault' on Instance uuid 4f54b509-03bd-4fe1-9608-faaae848d5ac {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:35:28.800531 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:35:28.819827 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.neutron [None req-a9633313-5c82-4a1d-9692-610fc5eff28e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] validate_networks() for [('c69ae9f6-7e1f-4037-b183-87d9ba3569e0', None, None, None, None, None)] {{(pid=122699) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:35:28.922840 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-166c5467-543f-46d7-abe8-c1bcb435fe88 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c82752e1bc4fdb82e7f8391c7c129f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44352a7a6d964530aa20ae83064b02e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:28.934193 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-166c5467-543f-46d7-abe8-c1bcb435fe88 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] 10.222.0.33 "GET /compute/v2.1/servers/4f54b509-03bd-4fe1-9608-faaae848d5ac" status: 200 len: 1304 microversion: 2.1 time: 0.223896 Sep 23 04:35:28.935340 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 584/1247] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:28 2022] GET /compute/v2.1/servers/4f54b509-03bd-4fe1-9608-faaae848d5ac => generated 1304 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:28.942129 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6fb3870a-1e18-4775-a2db-f30652b57d9c tempest-KeyPairsV2TestJSON-334025566 tempest-KeyPairsV2TestJSON-334025566-project] Calling method '.version_select at 0x7ff1bbc25820>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:28.950443 n-d-846463-3 devstack@n-api.service[122698]: WARNING oslo_db.sqlalchemy.utils [None req-6fb3870a-1e18-4775-a2db-f30652b57d9c tempest-KeyPairsV2TestJSON-334025566 tempest-KeyPairsV2TestJSON-334025566-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 23 04:35:28.954783 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-6fb3870a-1e18-4775-a2db-f30652b57d9c tempest-KeyPairsV2TestJSON-334025566 tempest-KeyPairsV2TestJSON-334025566-project] 10.222.0.33 "GET /compute/v2.1/os-keypairs" status: 200 len: 1093 microversion: 2.1 time: 0.017856 Sep 23 04:35:28.956544 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 585/1248] 10.222.0.33 () {58 vars in 1137 bytes} [Fri Sep 23 04:35:28 2022] GET /compute/v2.1/os-keypairs => generated 1093 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:28.963463 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-fc49c327-3554-4d99-949e-eceb02e1f0a4 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Calling method '.version_select at 0x7ff1bbaa8160>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:29.001736 n-d-846463-3 devstack@n-api.service[122698]: DEBUG neutronclient.v2_0.client [None req-fc49c327-3554-4d99-949e-eceb02e1f0a4 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 2d927e30-5ff7-4ded-990d-0c684ffcec12 does not exist", "detail": ""}} {{(pid=122698) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 23 04:35:29.002582 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.network.security_group_api [None req-fc49c327-3554-4d99-949e-eceb02e1f0a4 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Neutron security group 2d927e30-5ff7-4ded-990d-0c684ffcec12 not found {{(pid=122698) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 23 04:35:29.004197 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-fc49c327-3554-4d99-949e-eceb02e1f0a4 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] HTTP exception thrown: Security group 2d927e30-5ff7-4ded-990d-0c684ffcec12 does not exist Sep 23 04:35:29.004197 n-d-846463-3 devstack@n-api.service[122698]: Neutron server returns request_ids: ['req-771ff3a2-f0bd-4a43-944a-c9df0406c45f'] Sep 23 04:35:29.014777 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-fc49c327-3554-4d99-949e-eceb02e1f0a4 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Request method failure captured: Sep 23 04:35:29.014777 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/os-security-groups/2d927e30-5ff7-4ded-990d-0c684ffcec12 HTTP/1.1 Sep 23 04:35:29.014777 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:35:29.014777 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:35:29.014777 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:35:29.014777 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:35:29.014777 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:35:29.014777 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:35:29.014777 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:35:29.014777 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:35:29.014777 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTdzwKLwM5Huuc3OkGbV0-q8wtlsijivZwHLFFvwUn7aqwjwo0Mvf0QANB4RO3tvB8rSgFY67c2VjxeEJzRrvjiDhhi9XOqh7sPsdzyKRA33MX1kyET93FlWBs-I4ky6udbWqL2rlse4AqwXx6x3kt0moKWN4SwJfbsgKX9smPZbJsM Sep 23 04:35:29.014777 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:35:29.014777 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:35:29.014777 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:35:29.014777 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:35:29.014777 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:35:29.014777 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:35:29.014777 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: a3f931b8de0b4402a3833577fbb15607 Sep 23 04:35:29.014777 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-SecurityGroupsTestJSON-1588002272 Sep 23 04:35:29.014777 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:35:29.014777 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:35:29.016866 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a3f931b8de0b4402a3833577fbb15607", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a3f931b8de0b4402a3833577fbb15607"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a3f931b8de0b4402a3833577fbb15607"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a3f931b8de0b4402a3833577fbb15607"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:35:29.016866 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-SecurityGroupsTestJSON-1588002272 Sep 23 04:35:29.016866 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: a3f931b8de0b4402a3833577fbb15607 Sep 23 04:35:29.016866 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1588002272 Sep 23 04:35:29.016866 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-SecurityGroupsTestJSON-1588002272-project Sep 23 04:35:29.016866 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:35:29.016866 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:35:29.016866 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 8a00bc3e62774185b48120832e80476d Sep 23 04:35:29.016866 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-SecurityGroupsTestJSON-1588002272-project Sep 23 04:35:29.016866 n-d-846463-3 devstack@n-api.service[122698]: method: Sep 23 04:35:29.016866 n-d-846463-3 devstack@n-api.service[122698]: exception: Security group 2d927e30-5ff7-4ded-990d-0c684ffcec12 does not exist Sep 23 04:35:29.016866 n-d-846463-3 devstack@n-api.service[122698]: Neutron server returns request_ids: ['req-771ff3a2-f0bd-4a43-944a-c9df0406c45f'] Sep 23 04:35:29.016866 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '2d927e30-5ff7-4ded-990d-0c684ffcec12'} Sep 23 04:35:29.017932 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:35:29.017932 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:35:29.017932 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 23 04:35:29.017932 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 23 04:35:29.017932 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:35:29.017932 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:35:29.017932 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 23 04:35:29.017932 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 23 04:35:29.017932 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:35:29.017932 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:35:29.017932 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 23 04:35:29.017932 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 23 04:35:29.017932 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:35:29.017932 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:35:29.017932 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 23 04:35:29.017932 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 23 04:35:29.017932 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:35:29.017932 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:35:29.017932 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 23 04:35:29.019437 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 23 04:35:29.019437 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:35:29.019437 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:35:29.019437 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 23 04:35:29.019437 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 23 04:35:29.019437 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 23 04:35:29.019437 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 23 04:35:29.019437 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 2d927e30-5ff7-4ded-990d-0c684ffcec12 does not exist Sep 23 04:35:29.019437 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-771ff3a2-f0bd-4a43-944a-c9df0406c45f'] Sep 23 04:35:29.019437 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:35:29.019437 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:35:29.019437 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:35:29.019437 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:35:29.019437 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 23 04:35:29.019437 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 23 04:35:29.019437 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 23 04:35:29.019437 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 23 04:35:29.019437 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 2d927e30-5ff7-4ded-990d-0c684ffcec12 does not exist Sep 23 04:35:29.020767 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-771ff3a2-f0bd-4a43-944a-c9df0406c45f'] Sep 23 04:35:29.020767 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:35:29.020767 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:35:29.020767 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:35:29.020767 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:35:29.020767 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:35:29.020767 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:35:29.020767 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:35:29.020767 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:35:29.020767 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:35:29.020767 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:35:29.020767 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:35:29.020767 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:35:29.020767 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 23 04:35:29.020767 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 23 04:35:29.020767 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 2d927e30-5ff7-4ded-990d-0c684ffcec12 does not exist Sep 23 04:35:29.020767 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-771ff3a2-f0bd-4a43-944a-c9df0406c45f'] Sep 23 04:35:29.020767 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:35:29.020767 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:35:29.020767 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:35:29.020767 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:35:29.022398 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:35:29.022398 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:35:29.022398 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:35:29.022398 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:35:29.022398 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 2d927e30-5ff7-4ded-990d-0c684ffcec12 does not exist Sep 23 04:35:29.022398 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-771ff3a2-f0bd-4a43-944a-c9df0406c45f'] Sep 23 04:35:29.022398 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:35:29.022398 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-fc49c327-3554-4d99-949e-eceb02e1f0a4 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Returning 404 to user: Security group 2d927e30-5ff7-4ded-990d-0c684ffcec12 does not exist Sep 23 04:35:29.022398 n-d-846463-3 devstack@n-api.service[122698]: Neutron server returns request_ids: ['req-771ff3a2-f0bd-4a43-944a-c9df0406c45f'] {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:35:29.022398 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-fc49c327-3554-4d99-949e-eceb02e1f0a4 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] 10.222.0.33 "GET /compute/v2.1/os-security-groups/2d927e30-5ff7-4ded-990d-0c684ffcec12" status: 404 len: 194 microversion: 2.1 time: 0.061663 Sep 23 04:35:29.025060 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 586/1249] 10.222.0.33 () {58 vars in 1269 bytes} [Fri Sep 23 04:35:28 2022] GET /compute/v2.1/os-security-groups/2d927e30-5ff7-4ded-990d-0c684ffcec12 => generated 194 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:35:29.034894 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-63cd6333-f21a-41c1-a92e-69955c02aec6 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:29.036156 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-63cd6333-f21a-41c1-a92e-69955c02aec6 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] [instance: 533efe90-e3aa-416f-a268-c7b779614c7e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:29.043153 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-63cd6333-f21a-41c1-a92e-69955c02aec6 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:29.044548 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-63cd6333-f21a-41c1-a92e-69955c02aec6 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:29.045474 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-63cd6333-f21a-41c1-a92e-69955c02aec6 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:29.046664 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-63cd6333-f21a-41c1-a92e-69955c02aec6 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:29.047294 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-63cd6333-f21a-41c1-a92e-69955c02aec6 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:29.048329 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-63cd6333-f21a-41c1-a92e-69955c02aec6 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:29.160540 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-63cd6333-f21a-41c1-a92e-69955c02aec6 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5d8ac586e04707acec235c122e5bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60d1259e4a2a4d07a7becd15aa8891bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:29.173936 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-63cd6333-f21a-41c1-a92e-69955c02aec6 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] 10.222.0.33 "GET /compute/v2.1/servers/533efe90-e3aa-416f-a268-c7b779614c7e" status: 200 len: 1273 microversion: 2.1 time: 0.148077 Sep 23 04:35:29.176969 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 587/1250] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:29 2022] GET /compute/v2.1/servers/533efe90-e3aa-416f-a268-c7b779614c7e => generated 1273 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:29.186739 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-cc7fdbba-6028-4b47-b856-8c336c972d22 tempest-KeyPairsV2TestJSON-334025566 tempest-KeyPairsV2TestJSON-334025566-project] Calling method '.version_select at 0x7ff1bbaa8790>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:29.321509 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-cc7fdbba-6028-4b47-b856-8c336c972d22 tempest-KeyPairsV2TestJSON-334025566 tempest-KeyPairsV2TestJSON-334025566-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1878437137" status: 202 len: 0 microversion: 2.1 time: 0.142581 Sep 23 04:35:29.326978 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 588/1251] 10.222.0.33 () {58 vars in 1278 bytes} [Fri Sep 23 04:35:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1878437137 => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:35:29.335488 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-216b979c-2a59-4cf3-bb9e-60c8acc07b9f tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Action: 'create', calling method: .version_select at 0x7ff1bbbfe5e0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-928852353", "description": "tempest-description-344159436"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:35:29.704407 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-a9633313-5c82-4a1d-9692-610fc5eff28e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Flavor limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:35:29.705132 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-a9633313-5c82-4a1d-9692-610fc5eff28e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Image limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:35:29.706232 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-a9633313-5c82-4a1d-9692-610fc5eff28e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Flavor pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:35:29.706905 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-a9633313-5c82-4a1d-9692-610fc5eff28e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Image pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:35:29.707871 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-a9633313-5c82-4a1d-9692-610fc5eff28e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:35:29.721426 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a9633313-5c82-4a1d-9692-610fc5eff28e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:29.721987 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a9633313-5c82-4a1d-9692-610fc5eff28e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:29.722605 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a9633313-5c82-4a1d-9692-610fc5eff28e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:29.723232 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a9633313-5c82-4a1d-9692-610fc5eff28e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:29.723732 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a9633313-5c82-4a1d-9692-610fc5eff28e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:29.724168 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a9633313-5c82-4a1d-9692-610fc5eff28e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:29.752911 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-a9633313-5c82-4a1d-9692-610fc5eff28e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Getting quotas for project 004af70c9f9a43c4a7be8136268e98f9. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:35:29.762615 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-a9633313-5c82-4a1d-9692-610fc5eff28e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Getting quotas for user 82d04a55ba72452995e3b156325e0890 and project 004af70c9f9a43c4a7be8136268e98f9. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:35:29.786807 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a9633313-5c82-4a1d-9692-610fc5eff28e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Going to run 1 instances... {{(pid=122699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:35:29.790599 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a9633313-5c82-4a1d-9692-610fc5eff28e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: 04e9b262-d9e0-434a-bcbb-a85ef9180ee9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:35:29.922545 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a9633313-5c82-4a1d-9692-610fc5eff28e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.422377 Sep 23 04:35:29.924258 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 664/1252] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:35:28 2022] POST /compute/v2.1/servers => generated 405 bytes in 1425 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:35:29.931830 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ec44d45a-4402-47b8-a7cb-f04f74bad14d tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:29.937515 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ec44d45a-4402-47b8-a7cb-f04f74bad14d tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: fbbf8d58-8edb-4172-9d19-4b82804bf8e9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:29.941671 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ec44d45a-4402-47b8-a7cb-f04f74bad14d tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:29.942671 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ec44d45a-4402-47b8-a7cb-f04f74bad14d tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:29.943913 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-216b979c-2a59-4cf3-bb9e-60c8acc07b9f tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.614975 Sep 23 04:35:29.944491 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ec44d45a-4402-47b8-a7cb-f04f74bad14d tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:29.945245 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ec44d45a-4402-47b8-a7cb-f04f74bad14d tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:29.945721 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ec44d45a-4402-47b8-a7cb-f04f74bad14d tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:29.946316 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ec44d45a-4402-47b8-a7cb-f04f74bad14d tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:29.950069 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 589/1253] 10.222.0.33 () {60 vars in 1180 bytes} [Fri Sep 23 04:35:29 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:35:29.960175 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-50a634d8-3064-4529-af28-c44269fbe974 tempest-KeyPairsV2TestJSON-334025566 tempest-KeyPairsV2TestJSON-334025566-project] Calling method '.version_select at 0x7ff1bba92f70>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:30.046137 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-50a634d8-3064-4529-af28-c44269fbe974 tempest-KeyPairsV2TestJSON-334025566 tempest-KeyPairsV2TestJSON-334025566-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1509261722" status: 202 len: 0 microversion: 2.1 time: 0.094110 Sep 23 04:35:30.049734 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 590/1254] 10.222.0.33 () {58 vars in 1278 bytes} [Fri Sep 23 04:35:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1509261722 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:35:30.055712 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c358832c-b6e3-40b0-a467-29dae5012686 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:30.056778 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c358832c-b6e3-40b0-a467-29dae5012686 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: 04e9b262-d9e0-434a-bcbb-a85ef9180ee9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:30.139206 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c358832c-b6e3-40b0-a467-29dae5012686 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:30.157135 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c358832c-b6e3-40b0-a467-29dae5012686 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9" status: 200 len: 1235 microversion: 2.1 time: 0.106038 Sep 23 04:35:30.166059 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 591/1255] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:30 2022] GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9 => generated 1235 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:30.172406 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b44f9448-b234-4980-88fd-3774b0c20448 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:30.173260 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b44f9448-b234-4980-88fd-3774b0c20448 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] [instance: 4f54b509-03bd-4fe1-9608-faaae848d5ac] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:30.183014 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ec44d45a-4402-47b8-a7cb-f04f74bad14d tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:30.188440 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b44f9448-b234-4980-88fd-3774b0c20448 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:30.189739 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b44f9448-b234-4980-88fd-3774b0c20448 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:30.189739 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b44f9448-b234-4980-88fd-3774b0c20448 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:30.192636 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b44f9448-b234-4980-88fd-3774b0c20448 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:30.193130 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b44f9448-b234-4980-88fd-3774b0c20448 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:30.193574 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b44f9448-b234-4980-88fd-3774b0c20448 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:30.200403 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ec44d45a-4402-47b8-a7cb-f04f74bad14d tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/fbbf8d58-8edb-4172-9d19-4b82804bf8e9" status: 200 len: 1473 microversion: 2.1 time: 0.274826 Sep 23 04:35:30.201292 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 665/1256] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:29 2022] GET /compute/v2.1/servers/fbbf8d58-8edb-4172-9d19-4b82804bf8e9 => generated 1473 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:30.206049 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-cc31fc3b-518b-4ab7-82c3-df455253aa5f tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Action: 'create', calling method: .version_select at 0x7ff1bb875670>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2051845819", "description": "tempest-description-1257118777"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:35:30.226991 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-b44f9448-b234-4980-88fd-3774b0c20448 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] HTTP exception thrown: Instance 4f54b509-03bd-4fe1-9608-faaae848d5ac could not be found. Sep 23 04:35:30.229865 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b44f9448-b234-4980-88fd-3774b0c20448 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Request method failure captured: Sep 23 04:35:30.229865 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/4f54b509-03bd-4fe1-9608-faaae848d5ac HTTP/1.1 Sep 23 04:35:30.229865 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:35:30.229865 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:35:30.229865 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:35:30.229865 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:35:30.229865 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:35:30.229865 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:35:30.229865 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:35:30.229865 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:35:30.229865 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTbxD9e0HHktcgCeoKpaygA4XG4-8WuiVVsPDx3Gpy0VDy2jizvEn7F7GrzReh2wQ45bGCN03yFyTwSPyyvpJLxrlWYX82LnQ8ty0sa3O2IcnPBsYDsbarM3_GL-Oc-Z4gDxhU6j1B5vIn7C57vv1JqWXozSDORdCqSYgT7JoNR6Zc0 Sep 23 04:35:30.229865 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:35:30.229865 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:35:30.229865 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:35:30.229865 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:35:30.229865 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:35:30.229865 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:35:30.229865 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 44352a7a6d964530aa20ae83064b02e6 Sep 23 04:35:30.229865 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ServersAdminTestJSON-1041363324 Sep 23 04:35:30.229865 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:35:30.229865 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:35:30.234816 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_44352a7a6d964530aa20ae83064b02e6", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/44352a7a6d964530aa20ae83064b02e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/44352a7a6d964530aa20ae83064b02e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/44352a7a6d964530aa20ae83064b02e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:35:30.234816 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ServersAdminTestJSON-1041363324 Sep 23 04:35:30.234816 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 44352a7a6d964530aa20ae83064b02e6 Sep 23 04:35:30.234816 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ServersAdminTestJSON-1041363324 Sep 23 04:35:30.234816 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ServersAdminTestJSON-1041363324-project Sep 23 04:35:30.234816 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:35:30.234816 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:35:30.234816 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: d1c82752e1bc4fdb82e7f8391c7c129f Sep 23 04:35:30.234816 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ServersAdminTestJSON-1041363324-project Sep 23 04:35:30.234816 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:35:30.234816 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 4f54b509-03bd-4fe1-9608-faaae848d5ac could not be found. Sep 23 04:35:30.234816 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '4f54b509-03bd-4fe1-9608-faaae848d5ac'} Sep 23 04:35:30.235797 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:35:30.235797 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:35:30.235797 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:35:30.235797 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:35:30.235797 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:35:30.235797 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:35:30.235797 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:35:30.235797 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:35:30.235797 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:35:30.235797 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:35:30.235797 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f54b509-03bd-4fe1-9608-faaae848d5ac could not be found. Sep 23 04:35:30.235797 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:35:30.235797 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:35:30.235797 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:35:30.235797 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:35:30.235797 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:35:30.235797 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:35:30.235797 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:35:30.235797 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:35:30.235797 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:35:30.237045 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:35:30.237045 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:35:30.237045 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:35:30.237045 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:35:30.237045 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:35:30.237045 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:35:30.237045 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:35:30.237045 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f54b509-03bd-4fe1-9608-faaae848d5ac could not be found. Sep 23 04:35:30.237045 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:35:30.237045 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:35:30.237045 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:35:30.237045 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:35:30.237045 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:35:30.237045 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:35:30.237045 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:35:30.237045 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:35:30.237045 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f54b509-03bd-4fe1-9608-faaae848d5ac could not be found. Sep 23 04:35:30.237045 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:35:30.239267 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b44f9448-b234-4980-88fd-3774b0c20448 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Returning 404 to user: Instance 4f54b509-03bd-4fe1-9608-faaae848d5ac could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:35:30.239267 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b44f9448-b234-4980-88fd-3774b0c20448 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] 10.222.0.33 "GET /compute/v2.1/servers/4f54b509-03bd-4fe1-9608-faaae848d5ac" status: 404 len: 111 microversion: 2.1 time: 0.064064 Sep 23 04:35:30.241412 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 592/1257] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:30 2022] GET /compute/v2.1/servers/4f54b509-03bd-4fe1-9608-faaae848d5ac => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:35:30.253612 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e91b8169-6ddb-4bda-b3f7-4dd7baee8395 tempest-KeyPairsV2TestJSON-334025566 tempest-KeyPairsV2TestJSON-334025566-project] Calling method '.version_select at 0x7ff1bbbfeca0>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:30.389360 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e91b8169-6ddb-4bda-b3f7-4dd7baee8395 tempest-KeyPairsV2TestJSON-334025566 tempest-KeyPairsV2TestJSON-334025566-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-858579875" status: 202 len: 0 microversion: 2.1 time: 0.146580 Sep 23 04:35:30.390081 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 593/1258] 10.222.0.33 () {58 vars in 1275 bytes} [Fri Sep 23 04:35:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-858579875 => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:35:30.405001 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7515e8ed-514d-4bfe-8c04-d97f839df22a tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:30.405630 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7515e8ed-514d-4bfe-8c04-d97f839df22a tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] [instance: 533efe90-e3aa-416f-a268-c7b779614c7e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:30.414939 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7515e8ed-514d-4bfe-8c04-d97f839df22a tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:30.416332 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7515e8ed-514d-4bfe-8c04-d97f839df22a tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:30.417360 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7515e8ed-514d-4bfe-8c04-d97f839df22a tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:30.419282 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7515e8ed-514d-4bfe-8c04-d97f839df22a tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:30.421096 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7515e8ed-514d-4bfe-8c04-d97f839df22a tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:30.421765 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7515e8ed-514d-4bfe-8c04-d97f839df22a tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:30.651973 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-7515e8ed-514d-4bfe-8c04-d97f839df22a tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5d8ac586e04707acec235c122e5bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60d1259e4a2a4d07a7becd15aa8891bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:30.667730 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7515e8ed-514d-4bfe-8c04-d97f839df22a tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] 10.222.0.33 "GET /compute/v2.1/servers/533efe90-e3aa-416f-a268-c7b779614c7e" status: 200 len: 1315 microversion: 2.1 time: 0.272708 Sep 23 04:35:30.668992 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 594/1259] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:30 2022] GET /compute/v2.1/servers/533efe90-e3aa-416f-a268-c7b779614c7e => generated 1315 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:30.676925 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e5feecd9-47a8-4477-bee6-94b6100d22b1 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:30.677663 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e5feecd9-47a8-4477-bee6-94b6100d22b1 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] [instance: f392741f-f967-4c1c-930b-4eea7272bf64] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:30.695351 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e5feecd9-47a8-4477-bee6-94b6100d22b1 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:30.695876 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e5feecd9-47a8-4477-bee6-94b6100d22b1 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:30.696813 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e5feecd9-47a8-4477-bee6-94b6100d22b1 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:30.697530 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e5feecd9-47a8-4477-bee6-94b6100d22b1 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:30.698024 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e5feecd9-47a8-4477-bee6-94b6100d22b1 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:30.698455 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e5feecd9-47a8-4477-bee6-94b6100d22b1 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:30.744874 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e5feecd9-47a8-4477-bee6-94b6100d22b1 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] [instance: f392741f-f967-4c1c-930b-4eea7272bf64] Going to try to terminate instance {{(pid=122698) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:35:30.747425 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-cc31fc3b-518b-4ab7-82c3-df455253aa5f tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.545077 Sep 23 04:35:30.748017 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 666/1260] 10.222.0.33 () {60 vars in 1180 bytes} [Fri Sep 23 04:35:30 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:35:30.761068 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b35fbecf-e1e6-4cf8-bb5c-0ba6b874d222 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Action: 'create', calling method: .version_select at 0x7ff1bb8d5f70>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1548219032", "description": "tempest-description-2006749765"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:35:31.115583 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e5feecd9-47a8-4477-bee6-94b6100d22b1 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64" status: 204 len: 0 microversion: 2.1 time: 0.444802 Sep 23 04:35:31.119968 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 595/1261] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:35:30 2022] DELETE /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:35:31.125905 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-f08d196a-90dd-4947-94eb-f6b1b5121edb req-ac324561-3fb4-4843-819c-672d92dab3c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbbf8d58-8edb-4172-9d19-4b82804bf8e9", "name": "network-vif-unplugged", "status": "completed", "tag": "1a75583d-4990-40e9-876b-807baa271a68"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:35:31.140908 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-f08d196a-90dd-4947-94eb-f6b1b5121edb req-ac324561-3fb4-4843-819c-672d92dab3c1 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:31.141298 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-f08d196a-90dd-4947-94eb-f6b1b5121edb req-ac324561-3fb4-4843-819c-672d92dab3c1 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:31.143332 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-f08d196a-90dd-4947-94eb-f6b1b5121edb req-ac324561-3fb4-4843-819c-672d92dab3c1 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:31.161306 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-f08d196a-90dd-4947-94eb-f6b1b5121edb req-ac324561-3fb4-4843-819c-672d92dab3c1 service nova] Creating event network-vif-unplugged:1a75583d-4990-40e9-876b-807baa271a68 for instance fbbf8d58-8edb-4172-9d19-4b82804bf8e9 on n-h2-846463-3 Sep 23 04:35:31.169536 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [req-f08d196a-90dd-4947-94eb-f6b1b5121edb req-ac324561-3fb4-4843-819c-672d92dab3c1 service nova] Instance fbbf8d58-8edb-4172-9d19-4b82804bf8e9 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-846463-3'} {{(pid=122698) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 23 04:35:31.187168 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-f08d196a-90dd-4947-94eb-f6b1b5121edb req-ac324561-3fb4-4843-819c-672d92dab3c1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.064569 Sep 23 04:35:31.192676 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 596/1262] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:35:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:35:31.199473 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-925d4a2a-86a7-4513-8ac3-b40fcf497fee req-0acf4d4f-beb5-4bb5-98ee-67b02ffa2831 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "533efe90-e3aa-416f-a268-c7b779614c7e", "tag": "93e66eb8-2bcd-48fd-905c-eb9ba724cd6e"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:35:31.221518 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-925d4a2a-86a7-4513-8ac3-b40fcf497fee req-0acf4d4f-beb5-4bb5-98ee-67b02ffa2831 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:31.221518 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-925d4a2a-86a7-4513-8ac3-b40fcf497fee req-0acf4d4f-beb5-4bb5-98ee-67b02ffa2831 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:31.221518 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-925d4a2a-86a7-4513-8ac3-b40fcf497fee req-0acf4d4f-beb5-4bb5-98ee-67b02ffa2831 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:31.229848 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-925d4a2a-86a7-4513-8ac3-b40fcf497fee req-0acf4d4f-beb5-4bb5-98ee-67b02ffa2831 service nova] Creating event network-changed:93e66eb8-2bcd-48fd-905c-eb9ba724cd6e for instance 533efe90-e3aa-416f-a268-c7b779614c7e on n-h2-846463-3 Sep 23 04:35:31.235845 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-925d4a2a-86a7-4513-8ac3-b40fcf497fee req-0acf4d4f-beb5-4bb5-98ee-67b02ffa2831 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041004 Sep 23 04:35:31.236783 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 597/1263] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:35:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:35:31.251857 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b35fbecf-e1e6-4cf8-bb5c-0ba6b874d222 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.494925 Sep 23 04:35:31.253278 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 667/1264] 10.222.0.33 () {60 vars in 1180 bytes} [Fri Sep 23 04:35:30 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:35:31.255733 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-59374393-35ce-4158-a048-88b8add80e0c tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:31.256619 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-59374393-35ce-4158-a048-88b8add80e0c tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] [instance: f392741f-f967-4c1c-930b-4eea7272bf64] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:31.258665 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-741dd88f-cd73-45b6-a730-19f7bd24f821 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:31.259864 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-741dd88f-cd73-45b6-a730-19f7bd24f821 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: 04e9b262-d9e0-434a-bcbb-a85ef9180ee9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:31.264839 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-59374393-35ce-4158-a048-88b8add80e0c tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:31.265580 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-59374393-35ce-4158-a048-88b8add80e0c tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:31.270835 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-59374393-35ce-4158-a048-88b8add80e0c tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:31.280004 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-741dd88f-cd73-45b6-a730-19f7bd24f821 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:31.280140 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-59374393-35ce-4158-a048-88b8add80e0c tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:31.280230 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-741dd88f-cd73-45b6-a730-19f7bd24f821 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:31.280326 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-59374393-35ce-4158-a048-88b8add80e0c tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:31.280422 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-741dd88f-cd73-45b6-a730-19f7bd24f821 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:31.280883 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-59374393-35ce-4158-a048-88b8add80e0c tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:31.283241 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-741dd88f-cd73-45b6-a730-19f7bd24f821 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:31.283789 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-741dd88f-cd73-45b6-a730-19f7bd24f821 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:31.286111 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-741dd88f-cd73-45b6-a730-19f7bd24f821 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:31.389179 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-741dd88f-cd73-45b6-a730-19f7bd24f821 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:31.398154 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-741dd88f-cd73-45b6-a730-19f7bd24f821 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9" status: 200 len: 1239 microversion: 2.1 time: 0.143467 Sep 23 04:35:31.399187 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 668/1265] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:31 2022] GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9 => generated 1239 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:31.404194 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b7439ee9-ef29-42fd-8784-5eda20e51af3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:31.404889 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b7439ee9-ef29-42fd-8784-5eda20e51af3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: fbbf8d58-8edb-4172-9d19-4b82804bf8e9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:31.411111 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b7439ee9-ef29-42fd-8784-5eda20e51af3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:31.411725 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b7439ee9-ef29-42fd-8784-5eda20e51af3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:31.412243 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b7439ee9-ef29-42fd-8784-5eda20e51af3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:31.413026 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b7439ee9-ef29-42fd-8784-5eda20e51af3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:31.413565 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b7439ee9-ef29-42fd-8784-5eda20e51af3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:31.414135 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b7439ee9-ef29-42fd-8784-5eda20e51af3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:31.585475 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-59374393-35ce-4158-a048-88b8add80e0c tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c82752e1bc4fdb82e7f8391c7c129f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44352a7a6d964530aa20ae83064b02e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:31.595364 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-59374393-35ce-4158-a048-88b8add80e0c tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] 10.222.0.33 "GET /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64" status: 200 len: 1469 microversion: 2.1 time: 0.356963 Sep 23 04:35:31.595964 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 598/1266] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:31 2022] GET /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64 => generated 1469 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:31.623571 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-135b1900-13cf-4c99-b496-798c0f384461 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Calling method '.version_select at 0x7ff1bbb4d700>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:31.631080 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b7439ee9-ef29-42fd-8784-5eda20e51af3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:31.642811 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b7439ee9-ef29-42fd-8784-5eda20e51af3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/fbbf8d58-8edb-4172-9d19-4b82804bf8e9" status: 200 len: 1473 microversion: 2.1 time: 0.242269 Sep 23 04:35:31.644092 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 669/1267] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:31 2022] GET /compute/v2.1/servers/fbbf8d58-8edb-4172-9d19-4b82804bf8e9 => generated 1473 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:31.693025 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-00a88557-785c-45e2-af0c-391a3f494f51 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:31.695751 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-00a88557-785c-45e2-af0c-391a3f494f51 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] [instance: 533efe90-e3aa-416f-a268-c7b779614c7e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:31.708106 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-00a88557-785c-45e2-af0c-391a3f494f51 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:31.711133 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-00a88557-785c-45e2-af0c-391a3f494f51 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:31.712358 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-00a88557-785c-45e2-af0c-391a3f494f51 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:31.716392 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-00a88557-785c-45e2-af0c-391a3f494f51 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:31.717227 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-00a88557-785c-45e2-af0c-391a3f494f51 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:31.718064 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-00a88557-785c-45e2-af0c-391a3f494f51 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:31.964788 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-00a88557-785c-45e2-af0c-391a3f494f51 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5d8ac586e04707acec235c122e5bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60d1259e4a2a4d07a7becd15aa8891bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:31.980519 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-00a88557-785c-45e2-af0c-391a3f494f51 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] 10.222.0.33 "GET /compute/v2.1/servers/533efe90-e3aa-416f-a268-c7b779614c7e" status: 200 len: 1315 microversion: 2.1 time: 0.285428 Sep 23 04:35:31.986078 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 670/1268] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:31 2022] GET /compute/v2.1/servers/533efe90-e3aa-416f-a268-c7b779614c7e => generated 1315 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:32.012319 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-135b1900-13cf-4c99-b496-798c0f384461 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] 10.222.0.33 "GET /compute/v2.1/os-security-groups" status: 200 len: 1834 microversion: 2.1 time: 0.403540 Sep 23 04:35:32.013500 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 599/1269] 10.222.0.33 () {58 vars in 1158 bytes} [Fri Sep 23 04:35:31 2022] GET /compute/v2.1/os-security-groups => generated 1834 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:32.028086 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1b4c4aec-5347-48b7-add0-18a7dd6a7085 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Calling method '.version_select at 0x7ff1bb9ade50>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:32.358844 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1b4c4aec-5347-48b7-add0-18a7dd6a7085 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/6ede2b50-364e-4609-b1a1-4e84181483d2" status: 202 len: 0 microversion: 2.1 time: 0.334962 Sep 23 04:35:32.360023 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 671/1270] 10.222.0.33 () {58 vars in 1272 bytes} [Fri Sep 23 04:35:32 2022] DELETE /compute/v2.1/os-security-groups/6ede2b50-364e-4609-b1a1-4e84181483d2 => generated 0 bytes in 337 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:35:32.377709 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d7aa8671-536c-4d2c-94bb-50fdfdf48452 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Calling method '.version_select at 0x7ff1bbaa7790>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:32.417216 n-d-846463-3 devstack@n-api.service[122698]: DEBUG neutronclient.v2_0.client [None req-d7aa8671-536c-4d2c-94bb-50fdfdf48452 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 6ede2b50-364e-4609-b1a1-4e84181483d2 does not exist", "detail": ""}} {{(pid=122698) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 23 04:35:32.417808 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.network.security_group_api [None req-d7aa8671-536c-4d2c-94bb-50fdfdf48452 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Neutron security group 6ede2b50-364e-4609-b1a1-4e84181483d2 not found {{(pid=122698) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 23 04:35:32.418605 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-d7aa8671-536c-4d2c-94bb-50fdfdf48452 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] HTTP exception thrown: Security group 6ede2b50-364e-4609-b1a1-4e84181483d2 does not exist Sep 23 04:35:32.418605 n-d-846463-3 devstack@n-api.service[122698]: Neutron server returns request_ids: ['req-e6a34853-2c82-46cd-95a8-f0adf5bff970'] Sep 23 04:35:32.421399 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a9afd1b9-da09-4e08-9752-fb41a90d825b tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:32.421724 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d7aa8671-536c-4d2c-94bb-50fdfdf48452 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Request method failure captured: Sep 23 04:35:32.421724 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/os-security-groups/6ede2b50-364e-4609-b1a1-4e84181483d2 HTTP/1.1 Sep 23 04:35:32.421724 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:35:32.421724 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:35:32.421724 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:35:32.421724 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:35:32.421724 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:35:32.421724 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:35:32.421724 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:35:32.421724 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:35:32.421724 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTdzwKLwM5Huuc3OkGbV0-q8wtlsijivZwHLFFvwUn7aqwjwo0Mvf0QANB4RO3tvB8rSgFY67c2VjxeEJzRrvjiDhhi9XOqh7sPsdzyKRA33MX1kyET93FlWBs-I4ky6udbWqL2rlse4AqwXx6x3kt0moKWN4SwJfbsgKX9smPZbJsM Sep 23 04:35:32.421724 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:35:32.421724 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:35:32.421724 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:35:32.421724 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:35:32.421724 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:35:32.421724 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:35:32.421724 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: a3f931b8de0b4402a3833577fbb15607 Sep 23 04:35:32.421724 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-SecurityGroupsTestJSON-1588002272 Sep 23 04:35:32.421724 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:35:32.421724 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:35:32.423135 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a3f931b8de0b4402a3833577fbb15607", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a3f931b8de0b4402a3833577fbb15607"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a3f931b8de0b4402a3833577fbb15607"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a3f931b8de0b4402a3833577fbb15607"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:35:32.423135 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-SecurityGroupsTestJSON-1588002272 Sep 23 04:35:32.423135 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: a3f931b8de0b4402a3833577fbb15607 Sep 23 04:35:32.423135 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1588002272 Sep 23 04:35:32.423135 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-SecurityGroupsTestJSON-1588002272-project Sep 23 04:35:32.423135 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:35:32.423135 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:35:32.423135 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 8a00bc3e62774185b48120832e80476d Sep 23 04:35:32.423135 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-SecurityGroupsTestJSON-1588002272-project Sep 23 04:35:32.423135 n-d-846463-3 devstack@n-api.service[122698]: method: Sep 23 04:35:32.423135 n-d-846463-3 devstack@n-api.service[122698]: exception: Security group 6ede2b50-364e-4609-b1a1-4e84181483d2 does not exist Sep 23 04:35:32.423135 n-d-846463-3 devstack@n-api.service[122698]: Neutron server returns request_ids: ['req-e6a34853-2c82-46cd-95a8-f0adf5bff970'] Sep 23 04:35:32.423135 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '6ede2b50-364e-4609-b1a1-4e84181483d2'} Sep 23 04:35:32.423965 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:35:32.423965 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:35:32.423965 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 23 04:35:32.423965 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 23 04:35:32.423965 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:35:32.423965 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:35:32.423965 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 23 04:35:32.423965 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 23 04:35:32.423965 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:35:32.423965 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:35:32.423965 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 23 04:35:32.423965 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 23 04:35:32.423965 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:35:32.423965 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:35:32.423965 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 23 04:35:32.423965 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 23 04:35:32.423965 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:35:32.423965 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:35:32.423965 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 23 04:35:32.425159 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 23 04:35:32.425159 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:35:32.425159 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:35:32.425159 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 23 04:35:32.425159 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 23 04:35:32.425159 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 23 04:35:32.425159 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 23 04:35:32.425159 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 6ede2b50-364e-4609-b1a1-4e84181483d2 does not exist Sep 23 04:35:32.425159 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e6a34853-2c82-46cd-95a8-f0adf5bff970'] Sep 23 04:35:32.425159 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:35:32.425159 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:35:32.425159 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:35:32.425159 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:35:32.425159 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 23 04:35:32.425159 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 23 04:35:32.425159 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 23 04:35:32.425159 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 23 04:35:32.425159 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 6ede2b50-364e-4609-b1a1-4e84181483d2 does not exist Sep 23 04:35:32.426516 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e6a34853-2c82-46cd-95a8-f0adf5bff970'] Sep 23 04:35:32.426516 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:35:32.426516 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:35:32.426516 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:35:32.426516 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:35:32.426516 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:35:32.426516 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:35:32.426516 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:35:32.426516 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:35:32.426516 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:35:32.426516 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:35:32.426516 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:35:32.426516 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:35:32.426516 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 23 04:35:32.426516 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 23 04:35:32.426516 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 6ede2b50-364e-4609-b1a1-4e84181483d2 does not exist Sep 23 04:35:32.426516 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e6a34853-2c82-46cd-95a8-f0adf5bff970'] Sep 23 04:35:32.426516 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:35:32.426516 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:35:32.426516 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:35:32.426516 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:35:32.429342 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:35:32.429342 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:35:32.429342 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:35:32.429342 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:35:32.429342 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 6ede2b50-364e-4609-b1a1-4e84181483d2 does not exist Sep 23 04:35:32.429342 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e6a34853-2c82-46cd-95a8-f0adf5bff970'] Sep 23 04:35:32.429342 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:35:32.431351 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a9afd1b9-da09-4e08-9752-fb41a90d825b tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: 04e9b262-d9e0-434a-bcbb-a85ef9180ee9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:32.431513 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d7aa8671-536c-4d2c-94bb-50fdfdf48452 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Returning 404 to user: Security group 6ede2b50-364e-4609-b1a1-4e84181483d2 does not exist Sep 23 04:35:32.431513 n-d-846463-3 devstack@n-api.service[122698]: Neutron server returns request_ids: ['req-e6a34853-2c82-46cd-95a8-f0adf5bff970'] {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:35:32.431513 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d7aa8671-536c-4d2c-94bb-50fdfdf48452 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] 10.222.0.33 "GET /compute/v2.1/os-security-groups/6ede2b50-364e-4609-b1a1-4e84181483d2" status: 404 len: 194 microversion: 2.1 time: 0.059702 Sep 23 04:35:32.431513 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 600/1271] 10.222.0.33 () {58 vars in 1269 bytes} [Fri Sep 23 04:35:32 2022] GET /compute/v2.1/os-security-groups/6ede2b50-364e-4609-b1a1-4e84181483d2 => generated 194 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:35:32.444819 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a9afd1b9-da09-4e08-9752-fb41a90d825b tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:32.445401 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d1ffc3fa-d1ba-41b7-9090-2c37962c22dc tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Calling method '.version_select at 0x7ff1bbbfb700>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:32.445731 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a9afd1b9-da09-4e08-9752-fb41a90d825b tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:32.445731 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a9afd1b9-da09-4e08-9752-fb41a90d825b tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:32.445731 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a9afd1b9-da09-4e08-9752-fb41a90d825b tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:32.446713 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a9afd1b9-da09-4e08-9752-fb41a90d825b tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:32.447015 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a9afd1b9-da09-4e08-9752-fb41a90d825b tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:32.554105 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a9afd1b9-da09-4e08-9752-fb41a90d825b tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:32.565473 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a9afd1b9-da09-4e08-9752-fb41a90d825b tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9" status: 200 len: 1287 microversion: 2.1 time: 0.148625 Sep 23 04:35:32.566620 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 672/1272] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:32 2022] GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9 => generated 1287 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:32.623477 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-78646791-a302-4e04-809f-c939ec75c579 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:32.624245 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-78646791-a302-4e04-809f-c939ec75c579 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] [instance: f392741f-f967-4c1c-930b-4eea7272bf64] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:32.634209 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-78646791-a302-4e04-809f-c939ec75c579 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:32.634832 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-78646791-a302-4e04-809f-c939ec75c579 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:32.635301 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-78646791-a302-4e04-809f-c939ec75c579 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:32.636043 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-78646791-a302-4e04-809f-c939ec75c579 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:32.636521 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-78646791-a302-4e04-809f-c939ec75c579 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:32.637076 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-78646791-a302-4e04-809f-c939ec75c579 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:32.788251 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-78646791-a302-4e04-809f-c939ec75c579 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c82752e1bc4fdb82e7f8391c7c129f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44352a7a6d964530aa20ae83064b02e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:32.797650 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-78646791-a302-4e04-809f-c939ec75c579 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] 10.222.0.33 "GET /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64" status: 200 len: 1469 microversion: 2.1 time: 0.179548 Sep 23 04:35:32.798540 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 673/1273] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:32 2022] GET /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64 => generated 1469 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:35:32.804440 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-cb79f363-6d7e-4346-9062-772404890b01 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:32.805041 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-cb79f363-6d7e-4346-9062-772404890b01 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: fbbf8d58-8edb-4172-9d19-4b82804bf8e9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:32.811984 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cb79f363-6d7e-4346-9062-772404890b01 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:32.816066 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cb79f363-6d7e-4346-9062-772404890b01 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:32.816066 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cb79f363-6d7e-4346-9062-772404890b01 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:32.816066 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cb79f363-6d7e-4346-9062-772404890b01 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:32.816066 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cb79f363-6d7e-4346-9062-772404890b01 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:32.816451 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cb79f363-6d7e-4346-9062-772404890b01 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:32.851239 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d1ffc3fa-d1ba-41b7-9090-2c37962c22dc tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/f6a1f146-2d7c-4e94-a516-4ed9f3564181" status: 202 len: 0 microversion: 2.1 time: 0.418024 Sep 23 04:35:32.851239 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 601/1274] 10.222.0.33 () {58 vars in 1272 bytes} [Fri Sep 23 04:35:32 2022] DELETE /compute/v2.1/os-security-groups/f6a1f146-2d7c-4e94-a516-4ed9f3564181 => generated 0 bytes in 419 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:35:32.856331 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a4abd362-d21b-4faf-bf05-863b24d288d5 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Calling method '.version_select at 0x7ff1bbae83a0>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:32.941958 n-d-846463-3 devstack@n-api.service[122698]: DEBUG neutronclient.v2_0.client [None req-a4abd362-d21b-4faf-bf05-863b24d288d5 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f6a1f146-2d7c-4e94-a516-4ed9f3564181 does not exist", "detail": ""}} {{(pid=122698) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 23 04:35:32.942764 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.network.security_group_api [None req-a4abd362-d21b-4faf-bf05-863b24d288d5 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Neutron security group f6a1f146-2d7c-4e94-a516-4ed9f3564181 not found {{(pid=122698) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 23 04:35:32.943453 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-a4abd362-d21b-4faf-bf05-863b24d288d5 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] HTTP exception thrown: Security group f6a1f146-2d7c-4e94-a516-4ed9f3564181 does not exist Sep 23 04:35:32.943453 n-d-846463-3 devstack@n-api.service[122698]: Neutron server returns request_ids: ['req-064e3abb-bfda-455d-8f1a-e5450fb9e9d2'] Sep 23 04:35:32.945989 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a4abd362-d21b-4faf-bf05-863b24d288d5 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Request method failure captured: Sep 23 04:35:32.945989 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/os-security-groups/f6a1f146-2d7c-4e94-a516-4ed9f3564181 HTTP/1.1 Sep 23 04:35:32.945989 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:35:32.945989 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:35:32.945989 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:35:32.945989 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:35:32.945989 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:35:32.945989 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:35:32.945989 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:35:32.945989 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:35:32.945989 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTdzwKLwM5Huuc3OkGbV0-q8wtlsijivZwHLFFvwUn7aqwjwo0Mvf0QANB4RO3tvB8rSgFY67c2VjxeEJzRrvjiDhhi9XOqh7sPsdzyKRA33MX1kyET93FlWBs-I4ky6udbWqL2rlse4AqwXx6x3kt0moKWN4SwJfbsgKX9smPZbJsM Sep 23 04:35:32.945989 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:35:32.945989 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:35:32.945989 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:35:32.945989 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:35:32.945989 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:35:32.945989 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:35:32.945989 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: a3f931b8de0b4402a3833577fbb15607 Sep 23 04:35:32.945989 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-SecurityGroupsTestJSON-1588002272 Sep 23 04:35:32.945989 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:35:32.945989 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:35:32.947349 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a3f931b8de0b4402a3833577fbb15607", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a3f931b8de0b4402a3833577fbb15607"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a3f931b8de0b4402a3833577fbb15607"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a3f931b8de0b4402a3833577fbb15607"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:35:32.947349 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-SecurityGroupsTestJSON-1588002272 Sep 23 04:35:32.947349 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: a3f931b8de0b4402a3833577fbb15607 Sep 23 04:35:32.947349 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1588002272 Sep 23 04:35:32.947349 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-SecurityGroupsTestJSON-1588002272-project Sep 23 04:35:32.947349 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:35:32.947349 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:35:32.947349 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 8a00bc3e62774185b48120832e80476d Sep 23 04:35:32.947349 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-SecurityGroupsTestJSON-1588002272-project Sep 23 04:35:32.947349 n-d-846463-3 devstack@n-api.service[122698]: method: Sep 23 04:35:32.947349 n-d-846463-3 devstack@n-api.service[122698]: exception: Security group f6a1f146-2d7c-4e94-a516-4ed9f3564181 does not exist Sep 23 04:35:32.947349 n-d-846463-3 devstack@n-api.service[122698]: Neutron server returns request_ids: ['req-064e3abb-bfda-455d-8f1a-e5450fb9e9d2'] Sep 23 04:35:32.947349 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': 'f6a1f146-2d7c-4e94-a516-4ed9f3564181'} Sep 23 04:35:32.951921 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:35:32.951921 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:35:32.951921 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 23 04:35:32.951921 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 23 04:35:32.951921 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:35:32.951921 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:35:32.951921 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 23 04:35:32.951921 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 23 04:35:32.951921 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:35:32.951921 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:35:32.951921 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 23 04:35:32.951921 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 23 04:35:32.951921 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:35:32.951921 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:35:32.951921 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 23 04:35:32.951921 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 23 04:35:32.951921 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:35:32.951921 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:35:32.951921 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 23 04:35:32.953260 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 23 04:35:32.953260 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:35:32.953260 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:35:32.953260 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 23 04:35:32.953260 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 23 04:35:32.953260 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 23 04:35:32.953260 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 23 04:35:32.953260 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f6a1f146-2d7c-4e94-a516-4ed9f3564181 does not exist Sep 23 04:35:32.953260 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-064e3abb-bfda-455d-8f1a-e5450fb9e9d2'] Sep 23 04:35:32.953260 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:35:32.953260 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:35:32.953260 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:35:32.953260 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:35:32.953260 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 23 04:35:32.953260 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 23 04:35:32.953260 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 23 04:35:32.953260 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 23 04:35:32.953260 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f6a1f146-2d7c-4e94-a516-4ed9f3564181 does not exist Sep 23 04:35:32.954434 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-064e3abb-bfda-455d-8f1a-e5450fb9e9d2'] Sep 23 04:35:32.954434 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:35:32.954434 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:35:32.954434 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:35:32.954434 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:35:32.954434 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:35:32.954434 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:35:32.954434 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:35:32.954434 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:35:32.954434 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:35:32.954434 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:35:32.954434 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:35:32.954434 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:35:32.954434 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 23 04:35:32.954434 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 23 04:35:32.954434 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f6a1f146-2d7c-4e94-a516-4ed9f3564181 does not exist Sep 23 04:35:32.954434 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-064e3abb-bfda-455d-8f1a-e5450fb9e9d2'] Sep 23 04:35:32.954434 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:35:32.954434 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:35:32.954434 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:35:32.954434 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:35:32.955701 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:35:32.955701 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:35:32.955701 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:35:32.955701 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:35:32.955701 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f6a1f146-2d7c-4e94-a516-4ed9f3564181 does not exist Sep 23 04:35:32.955701 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-064e3abb-bfda-455d-8f1a-e5450fb9e9d2'] Sep 23 04:35:32.955701 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:35:32.955701 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a4abd362-d21b-4faf-bf05-863b24d288d5 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Returning 404 to user: Security group f6a1f146-2d7c-4e94-a516-4ed9f3564181 does not exist Sep 23 04:35:32.955701 n-d-846463-3 devstack@n-api.service[122698]: Neutron server returns request_ids: ['req-064e3abb-bfda-455d-8f1a-e5450fb9e9d2'] {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:35:32.955701 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a4abd362-d21b-4faf-bf05-863b24d288d5 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] 10.222.0.33 "GET /compute/v2.1/os-security-groups/f6a1f146-2d7c-4e94-a516-4ed9f3564181" status: 404 len: 194 microversion: 2.1 time: 0.096628 Sep 23 04:35:32.955701 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 602/1275] 10.222.0.33 () {58 vars in 1269 bytes} [Fri Sep 23 04:35:32 2022] GET /compute/v2.1/os-security-groups/f6a1f146-2d7c-4e94-a516-4ed9f3564181 => generated 194 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 04:35:32.963043 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-21164089-96f1-4711-9bbf-756e5f4c23a1 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Calling method '.version_select at 0x7ff1bbaa9ca0>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:33.030448 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-cb79f363-6d7e-4346-9062-772404890b01 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:33.042738 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-cb79f363-6d7e-4346-9062-772404890b01 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/fbbf8d58-8edb-4172-9d19-4b82804bf8e9" status: 200 len: 1470 microversion: 2.1 time: 0.242742 Sep 23 04:35:33.043343 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 674/1276] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:32 2022] GET /compute/v2.1/servers/fbbf8d58-8edb-4172-9d19-4b82804bf8e9 => generated 1470 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:33.053575 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-66077bdd-adfb-43ef-9e14-38b4f6ba3b7b tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:33.054293 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-66077bdd-adfb-43ef-9e14-38b4f6ba3b7b tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] [instance: 533efe90-e3aa-416f-a268-c7b779614c7e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:33.062943 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-66077bdd-adfb-43ef-9e14-38b4f6ba3b7b tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:33.065709 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-66077bdd-adfb-43ef-9e14-38b4f6ba3b7b tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:33.065709 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-66077bdd-adfb-43ef-9e14-38b4f6ba3b7b tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:33.065709 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-66077bdd-adfb-43ef-9e14-38b4f6ba3b7b tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:33.066662 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-66077bdd-adfb-43ef-9e14-38b4f6ba3b7b tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:33.068239 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-66077bdd-adfb-43ef-9e14-38b4f6ba3b7b tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:33.266741 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-66077bdd-adfb-43ef-9e14-38b4f6ba3b7b tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5d8ac586e04707acec235c122e5bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60d1259e4a2a4d07a7becd15aa8891bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:33.279743 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:35:33.282367 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-66077bdd-adfb-43ef-9e14-38b4f6ba3b7b tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] 10.222.0.33 "GET /compute/v2.1/servers/533efe90-e3aa-416f-a268-c7b779614c7e" status: 200 len: 1315 microversion: 2.1 time: 0.234881 Sep 23 04:35:33.283506 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 675/1277] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:33 2022] GET /compute/v2.1/servers/533efe90-e3aa-416f-a268-c7b779614c7e => generated 1315 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:33.288649 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-07818de1-0b2d-4100-9dc4-e4e331430cc9 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:35:33.289123 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-07818de1-0b2d-4100-9dc4-e4e331430cc9 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: fbbf8d58-8edb-4172-9d19-4b82804bf8e9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:33.314563 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-07818de1-0b2d-4100-9dc4-e4e331430cc9 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:33.319103 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-07818de1-0b2d-4100-9dc4-e4e331430cc9 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:33.325939 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-07818de1-0b2d-4100-9dc4-e4e331430cc9 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:33.325939 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-07818de1-0b2d-4100-9dc4-e4e331430cc9 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:33.325939 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-07818de1-0b2d-4100-9dc4-e4e331430cc9 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:33.325939 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-07818de1-0b2d-4100-9dc4-e4e331430cc9 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:33.328136 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-21164089-96f1-4711-9bbf-756e5f4c23a1 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/116d00a3-99cf-44b8-88a8-d6c549423529" status: 202 len: 0 microversion: 2.1 time: 0.375540 Sep 23 04:35:33.331870 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 603/1278] 10.222.0.33 () {58 vars in 1272 bytes} [Fri Sep 23 04:35:32 2022] DELETE /compute/v2.1/os-security-groups/116d00a3-99cf-44b8-88a8-d6c549423529 => generated 0 bytes in 377 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:35:33.341134 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-71f4195f-ed90-42ad-b5e3-8e3e893a5aa7 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Calling method '.version_select at 0x7ff1bbab70d0>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:33.419087 n-d-846463-3 devstack@n-api.service[122698]: DEBUG neutronclient.v2_0.client [None req-71f4195f-ed90-42ad-b5e3-8e3e893a5aa7 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 116d00a3-99cf-44b8-88a8-d6c549423529 does not exist", "detail": ""}} {{(pid=122698) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 23 04:35:33.419741 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.network.security_group_api [None req-71f4195f-ed90-42ad-b5e3-8e3e893a5aa7 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Neutron security group 116d00a3-99cf-44b8-88a8-d6c549423529 not found {{(pid=122698) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 23 04:35:33.421968 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-71f4195f-ed90-42ad-b5e3-8e3e893a5aa7 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] HTTP exception thrown: Security group 116d00a3-99cf-44b8-88a8-d6c549423529 does not exist Sep 23 04:35:33.421968 n-d-846463-3 devstack@n-api.service[122698]: Neutron server returns request_ids: ['req-01ddc2e6-2315-49e6-9b76-b5341cbe279e'] Sep 23 04:35:33.426488 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-07818de1-0b2d-4100-9dc4-e4e331430cc9 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:33.426988 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-07818de1-0b2d-4100-9dc4-e4e331430cc9 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:33.427602 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-07818de1-0b2d-4100-9dc4-e4e331430cc9 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:33.428509 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-07818de1-0b2d-4100-9dc4-e4e331430cc9 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:33.428983 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-07818de1-0b2d-4100-9dc4-e4e331430cc9 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:33.429113 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-71f4195f-ed90-42ad-b5e3-8e3e893a5aa7 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Request method failure captured: Sep 23 04:35:33.429113 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/os-security-groups/116d00a3-99cf-44b8-88a8-d6c549423529 HTTP/1.1 Sep 23 04:35:33.429113 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:35:33.429113 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:35:33.429113 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:35:33.429113 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:35:33.429113 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:35:33.429113 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:35:33.429113 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:35:33.429113 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:35:33.429113 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTdzwKLwM5Huuc3OkGbV0-q8wtlsijivZwHLFFvwUn7aqwjwo0Mvf0QANB4RO3tvB8rSgFY67c2VjxeEJzRrvjiDhhi9XOqh7sPsdzyKRA33MX1kyET93FlWBs-I4ky6udbWqL2rlse4AqwXx6x3kt0moKWN4SwJfbsgKX9smPZbJsM Sep 23 04:35:33.429113 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:35:33.429113 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:35:33.429113 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:35:33.429113 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:35:33.429113 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:35:33.429113 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:35:33.429113 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: a3f931b8de0b4402a3833577fbb15607 Sep 23 04:35:33.429113 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-SecurityGroupsTestJSON-1588002272 Sep 23 04:35:33.429113 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:35:33.429113 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:35:33.430492 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a3f931b8de0b4402a3833577fbb15607", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a3f931b8de0b4402a3833577fbb15607"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a3f931b8de0b4402a3833577fbb15607"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a3f931b8de0b4402a3833577fbb15607"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:35:33.430492 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-SecurityGroupsTestJSON-1588002272 Sep 23 04:35:33.430492 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: a3f931b8de0b4402a3833577fbb15607 Sep 23 04:35:33.430492 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1588002272 Sep 23 04:35:33.430492 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-SecurityGroupsTestJSON-1588002272-project Sep 23 04:35:33.430492 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:35:33.430492 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:35:33.430492 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 8a00bc3e62774185b48120832e80476d Sep 23 04:35:33.430492 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-SecurityGroupsTestJSON-1588002272-project Sep 23 04:35:33.430492 n-d-846463-3 devstack@n-api.service[122698]: method: Sep 23 04:35:33.430492 n-d-846463-3 devstack@n-api.service[122698]: exception: Security group 116d00a3-99cf-44b8-88a8-d6c549423529 does not exist Sep 23 04:35:33.430492 n-d-846463-3 devstack@n-api.service[122698]: Neutron server returns request_ids: ['req-01ddc2e6-2315-49e6-9b76-b5341cbe279e'] Sep 23 04:35:33.430492 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '116d00a3-99cf-44b8-88a8-d6c549423529'} Sep 23 04:35:33.431308 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:35:33.431308 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:35:33.431308 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 23 04:35:33.431308 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 23 04:35:33.431308 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:35:33.431308 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:35:33.431308 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 23 04:35:33.431308 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 23 04:35:33.431308 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:35:33.431308 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:35:33.431308 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 23 04:35:33.431308 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 23 04:35:33.431308 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:35:33.431308 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:35:33.431308 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 23 04:35:33.431308 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 23 04:35:33.431308 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:35:33.431308 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:35:33.431308 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 23 04:35:33.432431 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 23 04:35:33.432431 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:35:33.432431 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:35:33.432431 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 23 04:35:33.432431 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 23 04:35:33.432431 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 23 04:35:33.432431 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 23 04:35:33.432431 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 116d00a3-99cf-44b8-88a8-d6c549423529 does not exist Sep 23 04:35:33.432431 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-01ddc2e6-2315-49e6-9b76-b5341cbe279e'] Sep 23 04:35:33.432431 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:35:33.432431 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:35:33.432431 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:35:33.432431 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:35:33.432431 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 23 04:35:33.432431 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 23 04:35:33.432431 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 23 04:35:33.432431 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 23 04:35:33.432431 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 116d00a3-99cf-44b8-88a8-d6c549423529 does not exist Sep 23 04:35:33.433539 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-01ddc2e6-2315-49e6-9b76-b5341cbe279e'] Sep 23 04:35:33.433539 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:35:33.433539 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:35:33.433539 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:35:33.433539 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:35:33.433539 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:35:33.433539 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:35:33.433539 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:35:33.433539 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:35:33.433539 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:35:33.433539 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:35:33.433539 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:35:33.433539 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:35:33.433539 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 23 04:35:33.433539 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 23 04:35:33.433539 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 116d00a3-99cf-44b8-88a8-d6c549423529 does not exist Sep 23 04:35:33.433539 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-01ddc2e6-2315-49e6-9b76-b5341cbe279e'] Sep 23 04:35:33.433539 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:35:33.433539 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:35:33.433539 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:35:33.433539 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:35:33.434897 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:35:33.434897 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:35:33.434897 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:35:33.434897 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:35:33.434897 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 116d00a3-99cf-44b8-88a8-d6c549423529 does not exist Sep 23 04:35:33.434897 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-01ddc2e6-2315-49e6-9b76-b5341cbe279e'] Sep 23 04:35:33.434897 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:35:33.435381 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-07818de1-0b2d-4100-9dc4-e4e331430cc9 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:33.435465 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-71f4195f-ed90-42ad-b5e3-8e3e893a5aa7 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Returning 404 to user: Security group 116d00a3-99cf-44b8-88a8-d6c549423529 does not exist Sep 23 04:35:33.435465 n-d-846463-3 devstack@n-api.service[122698]: Neutron server returns request_ids: ['req-01ddc2e6-2315-49e6-9b76-b5341cbe279e'] {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:35:33.435465 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-71f4195f-ed90-42ad-b5e3-8e3e893a5aa7 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] 10.222.0.33 "GET /compute/v2.1/os-security-groups/116d00a3-99cf-44b8-88a8-d6c549423529" status: 404 len: 194 microversion: 2.1 time: 0.097897 Sep 23 04:35:33.435465 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 604/1279] 10.222.0.33 () {58 vars in 1269 bytes} [Fri Sep 23 04:35:33 2022] GET /compute/v2.1/os-security-groups/116d00a3-99cf-44b8-88a8-d6c549423529 => generated 194 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 04:35:33.442810 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-6e6dee93-347a-4763-b1c3-e8489ae1b1d3 req-cadb2f61-6bf2-49c8-91bb-ce36f141b7c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f392741f-f967-4c1c-930b-4eea7272bf64", "name": "network-vif-deleted", "tag": "a8e6bde0-f854-4040-8b7f-b369ce18b326"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:35:33.460435 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-07818de1-0b2d-4100-9dc4-e4e331430cc9 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Getting quotas for project 54abd267d3c043e09f26f486823907e2. Resources: {'cores', 'ram'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:35:33.464801 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-6e6dee93-347a-4763-b1c3-e8489ae1b1d3 req-cadb2f61-6bf2-49c8-91bb-ce36f141b7c4 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:33.468026 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-6e6dee93-347a-4763-b1c3-e8489ae1b1d3 req-cadb2f61-6bf2-49c8-91bb-ce36f141b7c4 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:33.469229 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-6e6dee93-347a-4763-b1c3-e8489ae1b1d3 req-cadb2f61-6bf2-49c8-91bb-ce36f141b7c4 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:33.470452 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-07818de1-0b2d-4100-9dc4-e4e331430cc9 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Getting quotas for user 13f5a913548445a09377847fd78a10a1 and project 54abd267d3c043e09f26f486823907e2. Resources: {'cores', 'ram'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:35:33.493576 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-6e6dee93-347a-4763-b1c3-e8489ae1b1d3 req-cadb2f61-6bf2-49c8-91bb-ce36f141b7c4 service nova] Creating event network-vif-deleted:a8e6bde0-f854-4040-8b7f-b369ce18b326 for instance f392741f-f967-4c1c-930b-4eea7272bf64 on n-h1-846463-3 Sep 23 04:35:33.510413 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-6e6dee93-347a-4763-b1c3-e8489ae1b1d3 req-cadb2f61-6bf2-49c8-91bb-ce36f141b7c4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074699 Sep 23 04:35:33.513225 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 605/1280] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:35:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:35:33.525928 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-76c4686b-ad26-4aba-932e-2b4f0f64b97c tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Calling method '.version_select at 0x7ff1c00474c0>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:33.772340 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-76c4686b-ad26-4aba-932e-2b4f0f64b97c tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] 10.222.0.33 "GET /compute/v2.1/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 0.255098 Sep 23 04:35:33.772930 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 606/1281] 10.222.0.33 () {58 vars in 1158 bytes} [Fri Sep 23 04:35:33 2022] GET /compute/v2.1/os-security-groups => generated 1158 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:33.778271 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b35d2970-8569-4994-aa5d-ac12f9d2ea55 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:33.779226 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b35d2970-8569-4994-aa5d-ac12f9d2ea55 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: 04e9b262-d9e0-434a-bcbb-a85ef9180ee9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:33.788838 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b35d2970-8569-4994-aa5d-ac12f9d2ea55 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:33.789591 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b35d2970-8569-4994-aa5d-ac12f9d2ea55 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:33.790247 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b35d2970-8569-4994-aa5d-ac12f9d2ea55 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:33.790958 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b35d2970-8569-4994-aa5d-ac12f9d2ea55 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:33.793051 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b35d2970-8569-4994-aa5d-ac12f9d2ea55 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:33.793529 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b35d2970-8569-4994-aa5d-ac12f9d2ea55 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:33.863047 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b35d2970-8569-4994-aa5d-ac12f9d2ea55 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:33.873237 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b35d2970-8569-4994-aa5d-ac12f9d2ea55 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9" status: 200 len: 1287 microversion: 2.1 time: 0.097420 Sep 23 04:35:33.874195 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 607/1282] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:33 2022] GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9 => generated 1287 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:33.879041 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-12314bb5-c281-4f91-9f1f-ef06ee716e40 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Action: 'create', calling method: .version_select at 0x7ff1bbae8700>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1351410333", "description": "tempest-description-128604773"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:35:33.925366 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-07818de1-0b2d-4100-9dc4-e4e331430cc9 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "POST /compute/v2.1/servers/fbbf8d58-8edb-4172-9d19-4b82804bf8e9/action" status: 202 len: 0 microversion: 2.1 time: 0.640528 Sep 23 04:35:33.929600 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 676/1283] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:35:33 2022] POST /compute/v2.1/servers/fbbf8d58-8edb-4172-9d19-4b82804bf8e9/action => generated 0 bytes in 645 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:35:33.937440 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:35:33.950030 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-dfc24b64-88f4-4680-8ff4-5020150cb1c5 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:33.951269 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-dfc24b64-88f4-4680-8ff4-5020150cb1c5 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] [instance: f392741f-f967-4c1c-930b-4eea7272bf64] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:33.958628 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=5 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:35:33.961912 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dfc24b64-88f4-4680-8ff4-5020150cb1c5 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:33.963003 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dfc24b64-88f4-4680-8ff4-5020150cb1c5 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:33.964106 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dfc24b64-88f4-4680-8ff4-5020150cb1c5 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:33.965079 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dfc24b64-88f4-4680-8ff4-5020150cb1c5 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:33.965598 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dfc24b64-88f4-4680-8ff4-5020150cb1c5 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:33.966234 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dfc24b64-88f4-4680-8ff4-5020150cb1c5 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:34.011763 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dfc24b64-88f4-4680-8ff4-5020150cb1c5 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:34.012643 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dfc24b64-88f4-4680-8ff4-5020150cb1c5 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:34.013294 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dfc24b64-88f4-4680-8ff4-5020150cb1c5 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:34.013750 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-dfc24b64-88f4-4680-8ff4-5020150cb1c5 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lazy-loading 'fault' on Instance uuid f392741f-f967-4c1c-930b-4eea7272bf64 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:35:34.098962 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-dfc24b64-88f4-4680-8ff4-5020150cb1c5 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c82752e1bc4fdb82e7f8391c7c129f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44352a7a6d964530aa20ae83064b02e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:34.106174 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-dfc24b64-88f4-4680-8ff4-5020150cb1c5 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] 10.222.0.33 "GET /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64" status: 200 len: 1304 microversion: 2.1 time: 0.174434 Sep 23 04:35:34.106758 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 677/1284] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:33 2022] GET /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64 => generated 1304 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:34.113458 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-56a54532-1fc5-4903-b124-e8d0f3b45f68 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:34.114295 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-56a54532-1fc5-4903-b124-e8d0f3b45f68 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: fbbf8d58-8edb-4172-9d19-4b82804bf8e9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:34.127188 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-56a54532-1fc5-4903-b124-e8d0f3b45f68 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:34.132104 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-56a54532-1fc5-4903-b124-e8d0f3b45f68 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:34.132104 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-56a54532-1fc5-4903-b124-e8d0f3b45f68 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:34.132104 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-56a54532-1fc5-4903-b124-e8d0f3b45f68 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:34.132104 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-56a54532-1fc5-4903-b124-e8d0f3b45f68 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:34.132534 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-56a54532-1fc5-4903-b124-e8d0f3b45f68 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:34.363633 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-56a54532-1fc5-4903-b124-e8d0f3b45f68 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:34.375274 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-56a54532-1fc5-4903-b124-e8d0f3b45f68 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/fbbf8d58-8edb-4172-9d19-4b82804bf8e9" status: 200 len: 1469 microversion: 2.1 time: 0.267184 Sep 23 04:35:34.375868 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 678/1285] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:34 2022] GET /compute/v2.1/servers/fbbf8d58-8edb-4172-9d19-4b82804bf8e9 => generated 1469 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:34.382604 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-af993139-2586-4139-820d-d968ae216abe tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:34.383557 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-af993139-2586-4139-820d-d968ae216abe tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] [instance: 533efe90-e3aa-416f-a268-c7b779614c7e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:34.391736 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-af993139-2586-4139-820d-d968ae216abe tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:34.392539 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-af993139-2586-4139-820d-d968ae216abe tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:34.393216 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-af993139-2586-4139-820d-d968ae216abe tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:34.394241 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-af993139-2586-4139-820d-d968ae216abe tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:34.395055 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-af993139-2586-4139-820d-d968ae216abe tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:34.395496 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-af993139-2586-4139-820d-d968ae216abe tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:34.480450 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-12314bb5-c281-4f91-9f1f-ef06ee716e40 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.604970 Sep 23 04:35:34.481949 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 608/1286] 10.222.0.33 () {60 vars in 1180 bytes} [Fri Sep 23 04:35:33 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:35:34.494550 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6a337a86-cd6b-4856-b808-f0be767ba77f tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Action: 'create', calling method: .version_select at 0x7ff1bbab7280>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-569806708", "description": "tempest-description-1984011262"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:35:34.601946 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-af993139-2586-4139-820d-d968ae216abe tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5d8ac586e04707acec235c122e5bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60d1259e4a2a4d07a7becd15aa8891bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:34.611478 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-af993139-2586-4139-820d-d968ae216abe tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] 10.222.0.33 "GET /compute/v2.1/servers/533efe90-e3aa-416f-a268-c7b779614c7e" status: 200 len: 1315 microversion: 2.1 time: 0.234418 Sep 23 04:35:34.612107 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 679/1287] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:34 2022] GET /compute/v2.1/servers/533efe90-e3aa-416f-a268-c7b779614c7e => generated 1315 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:34.897684 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e3e138a1-0a04-4314-887f-9e82a69fe89f tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:34.898421 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e3e138a1-0a04-4314-887f-9e82a69fe89f tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: 04e9b262-d9e0-434a-bcbb-a85ef9180ee9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:34.914687 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e3e138a1-0a04-4314-887f-9e82a69fe89f tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:34.915725 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e3e138a1-0a04-4314-887f-9e82a69fe89f tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:34.916192 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e3e138a1-0a04-4314-887f-9e82a69fe89f tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:34.918550 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e3e138a1-0a04-4314-887f-9e82a69fe89f tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:34.920494 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e3e138a1-0a04-4314-887f-9e82a69fe89f tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:34.921880 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e3e138a1-0a04-4314-887f-9e82a69fe89f tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:35.015427 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e3e138a1-0a04-4314-887f-9e82a69fe89f tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:35.029241 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e3e138a1-0a04-4314-887f-9e82a69fe89f tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9" status: 200 len: 1293 microversion: 2.1 time: 0.136004 Sep 23 04:35:35.034500 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 680/1288] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:34 2022] GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9 => generated 1293 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:35:35.143764 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-6a337a86-cd6b-4856-b808-f0be767ba77f tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.633950 Sep 23 04:35:35.143764 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 609/1289] 10.222.0.33 () {60 vars in 1180 bytes} [Fri Sep 23 04:35:34 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:35:35.144000 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d6d4912f-f01b-4128-acb7-32463e2649e8 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:35.144000 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d6d4912f-f01b-4128-acb7-32463e2649e8 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] [instance: f392741f-f967-4c1c-930b-4eea7272bf64] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:35.144000 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d6d4912f-f01b-4128-acb7-32463e2649e8 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:35.144000 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d6d4912f-f01b-4128-acb7-32463e2649e8 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:35.144376 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d6d4912f-f01b-4128-acb7-32463e2649e8 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:35.144376 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d6d4912f-f01b-4128-acb7-32463e2649e8 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:35.144376 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d6d4912f-f01b-4128-acb7-32463e2649e8 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:35.144376 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d6d4912f-f01b-4128-acb7-32463e2649e8 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:35.192783 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d6d4912f-f01b-4128-acb7-32463e2649e8 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:35.193391 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d6d4912f-f01b-4128-acb7-32463e2649e8 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:35.194185 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d6d4912f-f01b-4128-acb7-32463e2649e8 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:35.194712 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-d6d4912f-f01b-4128-acb7-32463e2649e8 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lazy-loading 'fault' on Instance uuid f392741f-f967-4c1c-930b-4eea7272bf64 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:35:35.254525 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d6d4912f-f01b-4128-acb7-32463e2649e8 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c82752e1bc4fdb82e7f8391c7c129f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44352a7a6d964530aa20ae83064b02e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:35.263327 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d6d4912f-f01b-4128-acb7-32463e2649e8 tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] 10.222.0.33 "GET /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64" status: 200 len: 1304 microversion: 2.1 time: 0.135952 Sep 23 04:35:35.269753 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 681/1290] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:35 2022] GET /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64 => generated 1304 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:35.274913 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-167dc594-3ddc-45bf-b4c6-15f9d103366b tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1446317320", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "networks": [{"uuid": "2ff95ca0-aee5-4508-863c-ab6e447f0afd"}]}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:35:35.352748 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.network.neutron [None req-167dc594-3ddc-45bf-b4c6-15f9d103366b tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] validate_networks() for [('2ff95ca0-aee5-4508-863c-ab6e447f0afd', None, None, None, None, None)] {{(pid=122698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:35:35.400299 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-fb3afb3a-d6f2-40fb-8612-26a30124362a tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:35.400841 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-fb3afb3a-d6f2-40fb-8612-26a30124362a tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: fbbf8d58-8edb-4172-9d19-4b82804bf8e9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:35.412488 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fb3afb3a-d6f2-40fb-8612-26a30124362a tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:35.413149 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fb3afb3a-d6f2-40fb-8612-26a30124362a tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:35.414321 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fb3afb3a-d6f2-40fb-8612-26a30124362a tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:35.415346 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fb3afb3a-d6f2-40fb-8612-26a30124362a tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:35.415809 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fb3afb3a-d6f2-40fb-8612-26a30124362a tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:35.416581 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fb3afb3a-d6f2-40fb-8612-26a30124362a tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:35.706925 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-fb3afb3a-d6f2-40fb-8612-26a30124362a tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:35.715477 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-fb3afb3a-d6f2-40fb-8612-26a30124362a tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/fbbf8d58-8edb-4172-9d19-4b82804bf8e9" status: 200 len: 1469 microversion: 2.1 time: 0.320367 Sep 23 04:35:35.720942 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 682/1291] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:35 2022] GET /compute/v2.1/servers/fbbf8d58-8edb-4172-9d19-4b82804bf8e9 => generated 1469 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:35:35.727058 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-91a65e31-89ef-47ec-91b9-8cca9f52e969 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:35.734427 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-91a65e31-89ef-47ec-91b9-8cca9f52e969 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] [instance: 533efe90-e3aa-416f-a268-c7b779614c7e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:35.750093 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-91a65e31-89ef-47ec-91b9-8cca9f52e969 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:35.751222 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-91a65e31-89ef-47ec-91b9-8cca9f52e969 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:35.751961 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-91a65e31-89ef-47ec-91b9-8cca9f52e969 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:35.753623 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-91a65e31-89ef-47ec-91b9-8cca9f52e969 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:35.754668 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-91a65e31-89ef-47ec-91b9-8cca9f52e969 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:35.756629 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-91a65e31-89ef-47ec-91b9-8cca9f52e969 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:35.990604 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-91a65e31-89ef-47ec-91b9-8cca9f52e969 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5d8ac586e04707acec235c122e5bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60d1259e4a2a4d07a7becd15aa8891bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:36.021801 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-91a65e31-89ef-47ec-91b9-8cca9f52e969 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] 10.222.0.33 "GET /compute/v2.1/servers/533efe90-e3aa-416f-a268-c7b779614c7e" status: 200 len: 1315 microversion: 2.1 time: 0.298688 Sep 23 04:35:36.024696 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 683/1292] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:35 2022] GET /compute/v2.1/servers/533efe90-e3aa-416f-a268-c7b779614c7e => generated 1315 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:36.027424 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-167dc594-3ddc-45bf-b4c6-15f9d103366b tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Flavor limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:35:36.028398 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-167dc594-3ddc-45bf-b4c6-15f9d103366b tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Image limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:35:36.029053 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-167dc594-3ddc-45bf-b4c6-15f9d103366b tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Flavor pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:35:36.029469 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-167dc594-3ddc-45bf-b4c6-15f9d103366b tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Image pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:35:36.030582 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-167dc594-3ddc-45bf-b4c6-15f9d103366b tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:35:36.041569 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-167dc594-3ddc-45bf-b4c6-15f9d103366b tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:36.042351 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-167dc594-3ddc-45bf-b4c6-15f9d103366b tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:36.042977 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-167dc594-3ddc-45bf-b4c6-15f9d103366b tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:36.044505 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-167dc594-3ddc-45bf-b4c6-15f9d103366b tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:36.044505 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-167dc594-3ddc-45bf-b4c6-15f9d103366b tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:36.044831 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-167dc594-3ddc-45bf-b4c6-15f9d103366b tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:36.062138 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:DELETE=5,nova_api:SELECT=91,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:35:36.062387 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-55c06fe8-c43b-4b9b-884e-c19e30514159 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:36.063210 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-55c06fe8-c43b-4b9b-884e-c19e30514159 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: 04e9b262-d9e0-434a-bcbb-a85ef9180ee9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:36.071106 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-167dc594-3ddc-45bf-b4c6-15f9d103366b tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Getting quotas for project a3f931b8de0b4402a3833577fbb15607. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:35:36.080036 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-167dc594-3ddc-45bf-b4c6-15f9d103366b tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Getting quotas for user 8a00bc3e62774185b48120832e80476d and project a3f931b8de0b4402a3833577fbb15607. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:35:36.083743 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-55c06fe8-c43b-4b9b-884e-c19e30514159 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:36.089624 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-55c06fe8-c43b-4b9b-884e-c19e30514159 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:36.089624 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-55c06fe8-c43b-4b9b-884e-c19e30514159 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:36.089624 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-55c06fe8-c43b-4b9b-884e-c19e30514159 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:36.089624 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-55c06fe8-c43b-4b9b-884e-c19e30514159 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:36.095059 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-167dc594-3ddc-45bf-b4c6-15f9d103366b tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Going to run 1 instances... {{(pid=122698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:35:36.097514 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-55c06fe8-c43b-4b9b-884e-c19e30514159 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:36.097654 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-167dc594-3ddc-45bf-b4c6-15f9d103366b tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] [instance: 1bf70366-2b4c-4df9-a6be-1c9145fb3862] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:35:36.321832 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-167dc594-3ddc-45bf-b4c6-15f9d103366b tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.050791 Sep 23 04:35:36.331804 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 610/1293] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:35:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1056 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 23 04:35:36.337212 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-55c06fe8-c43b-4b9b-884e-c19e30514159 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:36.339471 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c0e38f48-0ae3-410b-ba8b-08911a9b14fd tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:36.344262 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c0e38f48-0ae3-410b-ba8b-08911a9b14fd tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] [instance: f392741f-f967-4c1c-930b-4eea7272bf64] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:36.348911 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-55c06fe8-c43b-4b9b-884e-c19e30514159 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9" status: 200 len: 1360 microversion: 2.1 time: 0.297015 Sep 23 04:35:36.350151 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 684/1294] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:36 2022] GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9 => generated 1360 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:36.358431 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c0e38f48-0ae3-410b-ba8b-08911a9b14fd tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:36.359034 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c0e38f48-0ae3-410b-ba8b-08911a9b14fd tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:36.359491 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c0e38f48-0ae3-410b-ba8b-08911a9b14fd tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:36.360218 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c0e38f48-0ae3-410b-ba8b-08911a9b14fd tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:36.360686 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c0e38f48-0ae3-410b-ba8b-08911a9b14fd tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:36.361171 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c0e38f48-0ae3-410b-ba8b-08911a9b14fd tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:36.361664 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f06a3560-65c2-4a7e-a40a-666a48e7694b tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:36.362650 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f06a3560-65c2-4a7e-a40a-666a48e7694b tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] [instance: 1bf70366-2b4c-4df9-a6be-1c9145fb3862] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:36.410365 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-c0e38f48-0ae3-410b-ba8b-08911a9b14fd tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] HTTP exception thrown: Instance f392741f-f967-4c1c-930b-4eea7272bf64 could not be found. Sep 23 04:35:36.410365 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c0e38f48-0ae3-410b-ba8b-08911a9b14fd tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Request method failure captured: Sep 23 04:35:36.410365 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64 HTTP/1.1 Sep 23 04:35:36.410365 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:35:36.410365 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:35:36.410365 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:35:36.410365 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:35:36.410365 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:35:36.410365 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:35:36.410365 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:35:36.410365 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:35:36.410365 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTbxD9e0HHktcgCeoKpaygA4XG4-8WuiVVsPDx3Gpy0VDy2jizvEn7F7GrzReh2wQ45bGCN03yFyTwSPyyvpJLxrlWYX82LnQ8ty0sa3O2IcnPBsYDsbarM3_GL-Oc-Z4gDxhU6j1B5vIn7C57vv1JqWXozSDORdCqSYgT7JoNR6Zc0 Sep 23 04:35:36.410365 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:35:36.410365 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:35:36.410365 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:35:36.410365 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:35:36.410365 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:35:36.410365 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:35:36.410365 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 44352a7a6d964530aa20ae83064b02e6 Sep 23 04:35:36.410365 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ServersAdminTestJSON-1041363324 Sep 23 04:35:36.410365 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:35:36.410365 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:35:36.412058 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_44352a7a6d964530aa20ae83064b02e6", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/44352a7a6d964530aa20ae83064b02e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/44352a7a6d964530aa20ae83064b02e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/44352a7a6d964530aa20ae83064b02e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:35:36.412058 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ServersAdminTestJSON-1041363324 Sep 23 04:35:36.412058 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 44352a7a6d964530aa20ae83064b02e6 Sep 23 04:35:36.412058 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ServersAdminTestJSON-1041363324 Sep 23 04:35:36.412058 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ServersAdminTestJSON-1041363324-project Sep 23 04:35:36.412058 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:35:36.412058 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:35:36.412058 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: d1c82752e1bc4fdb82e7f8391c7c129f Sep 23 04:35:36.412058 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ServersAdminTestJSON-1041363324-project Sep 23 04:35:36.412058 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:35:36.412058 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance f392741f-f967-4c1c-930b-4eea7272bf64 could not be found. Sep 23 04:35:36.412058 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': 'f392741f-f967-4c1c-930b-4eea7272bf64'} Sep 23 04:35:36.413048 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:35:36.413048 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:35:36.413048 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:35:36.413048 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:35:36.413048 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:35:36.413048 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:35:36.413048 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:35:36.413048 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:35:36.413048 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:35:36.413048 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:35:36.413048 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f392741f-f967-4c1c-930b-4eea7272bf64 could not be found. Sep 23 04:35:36.413048 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:35:36.413048 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:35:36.413048 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:35:36.413048 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:35:36.413048 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:35:36.413048 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:35:36.413048 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:35:36.413048 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:35:36.413048 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:35:36.414751 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:35:36.414751 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:35:36.414751 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:35:36.414751 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:35:36.414751 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:35:36.414751 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:35:36.414751 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:35:36.414751 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f392741f-f967-4c1c-930b-4eea7272bf64 could not be found. Sep 23 04:35:36.414751 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:35:36.414751 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:35:36.414751 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:35:36.414751 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:35:36.414751 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:35:36.414751 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:35:36.414751 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:35:36.414751 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:35:36.414751 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f392741f-f967-4c1c-930b-4eea7272bf64 could not be found. Sep 23 04:35:36.414751 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:35:36.416787 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c0e38f48-0ae3-410b-ba8b-08911a9b14fd tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] Returning 404 to user: Instance f392741f-f967-4c1c-930b-4eea7272bf64 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:35:36.416787 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c0e38f48-0ae3-410b-ba8b-08911a9b14fd tempest-ServersAdminTestJSON-1041363324 tempest-ServersAdminTestJSON-1041363324-project] 10.222.0.33 "GET /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64" status: 404 len: 111 microversion: 2.1 time: 0.081963 Sep 23 04:35:36.416787 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 611/1295] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:36 2022] GET /compute/v2.1/servers/f392741f-f967-4c1c-930b-4eea7272bf64 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:35:36.435715 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f06a3560-65c2-4a7e-a40a-666a48e7694b tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a00bc3e62774185b48120832e80476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f931b8de0b4402a3833577fbb15607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:36.443895 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f06a3560-65c2-4a7e-a40a-666a48e7694b tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] 10.222.0.33 "GET /compute/v2.1/servers/1bf70366-2b4c-4df9-a6be-1c9145fb3862" status: 200 len: 1216 microversion: 2.1 time: 0.090023 Sep 23 04:35:36.445703 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 685/1296] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:36 2022] GET /compute/v2.1/servers/1bf70366-2b4c-4df9-a6be-1c9145fb3862 => generated 1216 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:36.746146 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-eee5adc1-8c2b-457e-98e5-676069759e62 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:36.747251 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-eee5adc1-8c2b-457e-98e5-676069759e62 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: fbbf8d58-8edb-4172-9d19-4b82804bf8e9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:36.757745 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-eee5adc1-8c2b-457e-98e5-676069759e62 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:36.761168 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-eee5adc1-8c2b-457e-98e5-676069759e62 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:36.761809 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-eee5adc1-8c2b-457e-98e5-676069759e62 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:36.762731 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-eee5adc1-8c2b-457e-98e5-676069759e62 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:36.763546 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-eee5adc1-8c2b-457e-98e5-676069759e62 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:36.764137 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-eee5adc1-8c2b-457e-98e5-676069759e62 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:37.048828 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-522c4319-e08f-4b6c-99bc-c35dfdeb0660 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:37.049469 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-522c4319-e08f-4b6c-99bc-c35dfdeb0660 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] [instance: 533efe90-e3aa-416f-a268-c7b779614c7e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:37.078989 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-522c4319-e08f-4b6c-99bc-c35dfdeb0660 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:37.084681 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-522c4319-e08f-4b6c-99bc-c35dfdeb0660 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:37.084681 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-522c4319-e08f-4b6c-99bc-c35dfdeb0660 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:37.084681 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-522c4319-e08f-4b6c-99bc-c35dfdeb0660 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:37.084681 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-522c4319-e08f-4b6c-99bc-c35dfdeb0660 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:37.085814 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-522c4319-e08f-4b6c-99bc-c35dfdeb0660 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:37.110678 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-eee5adc1-8c2b-457e-98e5-676069759e62 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:37.120579 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-eee5adc1-8c2b-457e-98e5-676069759e62 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/fbbf8d58-8edb-4172-9d19-4b82804bf8e9" status: 200 len: 1469 microversion: 2.1 time: 0.379312 Sep 23 04:35:37.125066 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 612/1297] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:36 2022] GET /compute/v2.1/servers/fbbf8d58-8edb-4172-9d19-4b82804bf8e9 => generated 1469 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:37.224590 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-b9c0d682-b672-40c5-9790-97eefc0da9a4 req-21702d2b-21cd-4916-b5f2-48d320fdbe1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbbf8d58-8edb-4172-9d19-4b82804bf8e9", "name": "network-vif-plugged", "status": "completed", "tag": "1a75583d-4990-40e9-876b-807baa271a68"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:35:37.245769 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-b9c0d682-b672-40c5-9790-97eefc0da9a4 req-21702d2b-21cd-4916-b5f2-48d320fdbe1a service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:37.246890 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-b9c0d682-b672-40c5-9790-97eefc0da9a4 req-21702d2b-21cd-4916-b5f2-48d320fdbe1a service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:37.247554 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-b9c0d682-b672-40c5-9790-97eefc0da9a4 req-21702d2b-21cd-4916-b5f2-48d320fdbe1a service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:37.280744 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-b9c0d682-b672-40c5-9790-97eefc0da9a4 req-21702d2b-21cd-4916-b5f2-48d320fdbe1a service nova] Creating event network-vif-plugged:1a75583d-4990-40e9-876b-807baa271a68 for instance fbbf8d58-8edb-4172-9d19-4b82804bf8e9 on n-h2-846463-3 Sep 23 04:35:37.288992 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [req-b9c0d682-b672-40c5-9790-97eefc0da9a4 req-21702d2b-21cd-4916-b5f2-48d320fdbe1a service nova] Instance fbbf8d58-8edb-4172-9d19-4b82804bf8e9 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-846463-3'} {{(pid=122698) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 23 04:35:37.310572 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-b9c0d682-b672-40c5-9790-97eefc0da9a4 req-21702d2b-21cd-4916-b5f2-48d320fdbe1a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088314 Sep 23 04:35:37.315973 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 613/1298] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:35:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:35:37.426746 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-85dee486-e682-4a6a-8c7c-0f06f1264d49 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:37.426746 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-85dee486-e682-4a6a-8c7c-0f06f1264d49 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: 04e9b262-d9e0-434a-bcbb-a85ef9180ee9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:37.426746 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-85dee486-e682-4a6a-8c7c-0f06f1264d49 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:37.426746 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-85dee486-e682-4a6a-8c7c-0f06f1264d49 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:37.427375 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-85dee486-e682-4a6a-8c7c-0f06f1264d49 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:37.427375 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-85dee486-e682-4a6a-8c7c-0f06f1264d49 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:37.427375 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-85dee486-e682-4a6a-8c7c-0f06f1264d49 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:37.427375 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-85dee486-e682-4a6a-8c7c-0f06f1264d49 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:37.573168 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-522c4319-e08f-4b6c-99bc-c35dfdeb0660 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5d8ac586e04707acec235c122e5bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60d1259e4a2a4d07a7becd15aa8891bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:37.583607 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-522c4319-e08f-4b6c-99bc-c35dfdeb0660 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] 10.222.0.33 "GET /compute/v2.1/servers/533efe90-e3aa-416f-a268-c7b779614c7e" status: 200 len: 1315 microversion: 2.1 time: 0.539734 Sep 23 04:35:37.587529 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 686/1299] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:37 2022] GET /compute/v2.1/servers/533efe90-e3aa-416f-a268-c7b779614c7e => generated 1315 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:35:37.629541 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-80dfab09-8440-42ed-81e4-fbfa864b9ba3 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:37.629541 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-80dfab09-8440-42ed-81e4-fbfa864b9ba3 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] [instance: 1bf70366-2b4c-4df9-a6be-1c9145fb3862] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:37.629541 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-80dfab09-8440-42ed-81e4-fbfa864b9ba3 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:37.629541 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-80dfab09-8440-42ed-81e4-fbfa864b9ba3 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:37.630465 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-80dfab09-8440-42ed-81e4-fbfa864b9ba3 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:37.630465 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-80dfab09-8440-42ed-81e4-fbfa864b9ba3 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:37.630465 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-80dfab09-8440-42ed-81e4-fbfa864b9ba3 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:37.630465 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-80dfab09-8440-42ed-81e4-fbfa864b9ba3 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:37.798178 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-80dfab09-8440-42ed-81e4-fbfa864b9ba3 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a00bc3e62774185b48120832e80476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f931b8de0b4402a3833577fbb15607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:37.813160 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-80dfab09-8440-42ed-81e4-fbfa864b9ba3 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] 10.222.0.33 "GET /compute/v2.1/servers/1bf70366-2b4c-4df9-a6be-1c9145fb3862" status: 200 len: 1220 microversion: 2.1 time: 0.223609 Sep 23 04:35:37.814432 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 687/1300] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:37 2022] GET /compute/v2.1/servers/1bf70366-2b4c-4df9-a6be-1c9145fb3862 => generated 1220 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:37.894633 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-85dee486-e682-4a6a-8c7c-0f06f1264d49 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:37.904043 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-85dee486-e682-4a6a-8c7c-0f06f1264d49 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9" status: 200 len: 1360 microversion: 2.1 time: 0.531649 Sep 23 04:35:37.918972 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 614/1301] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:37 2022] GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9 => generated 1360 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:35:38.147564 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-eeaa5097-1e8d-4087-86d1-72e8d14250f3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:38.148709 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-eeaa5097-1e8d-4087-86d1-72e8d14250f3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: fbbf8d58-8edb-4172-9d19-4b82804bf8e9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:38.158968 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eeaa5097-1e8d-4087-86d1-72e8d14250f3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:38.160078 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eeaa5097-1e8d-4087-86d1-72e8d14250f3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:38.160078 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eeaa5097-1e8d-4087-86d1-72e8d14250f3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:38.160617 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eeaa5097-1e8d-4087-86d1-72e8d14250f3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:38.161097 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eeaa5097-1e8d-4087-86d1-72e8d14250f3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:38.161516 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eeaa5097-1e8d-4087-86d1-72e8d14250f3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:38.612313 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-05f5ea97-d2bb-492e-b0bd-07996903c542 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:38.612961 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-05f5ea97-d2bb-492e-b0bd-07996903c542 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] [instance: 533efe90-e3aa-416f-a268-c7b779614c7e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:38.638755 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-05f5ea97-d2bb-492e-b0bd-07996903c542 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:38.643972 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-05f5ea97-d2bb-492e-b0bd-07996903c542 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:38.644539 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-05f5ea97-d2bb-492e-b0bd-07996903c542 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:38.647007 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-05f5ea97-d2bb-492e-b0bd-07996903c542 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:38.647759 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-05f5ea97-d2bb-492e-b0bd-07996903c542 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:38.651632 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-05f5ea97-d2bb-492e-b0bd-07996903c542 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:39.560927 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-eeaa5097-1e8d-4087-86d1-72e8d14250f3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:39.572925 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-eeaa5097-1e8d-4087-86d1-72e8d14250f3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/fbbf8d58-8edb-4172-9d19-4b82804bf8e9" status: 200 len: 1469 microversion: 2.1 time: 1.429142 Sep 23 04:35:39.577857 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 688/1302] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:38 2022] GET /compute/v2.1/servers/fbbf8d58-8edb-4172-9d19-4b82804bf8e9 => generated 1469 bytes in 1435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:39.592183 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-40f04f3a-e215-46f7-bbec-91d01fd5f4b0 req-6a9b8d62-15f9-489f-806a-f9ce1d9b562f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04e9b262-d9e0-434a-bcbb-a85ef9180ee9", "tag": "ef809f4d-5127-48f1-a968-99867a38928e"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:35:39.610134 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-40f04f3a-e215-46f7-bbec-91d01fd5f4b0 req-6a9b8d62-15f9-489f-806a-f9ce1d9b562f service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:39.611387 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-40f04f3a-e215-46f7-bbec-91d01fd5f4b0 req-6a9b8d62-15f9-489f-806a-f9ce1d9b562f service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:39.612210 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-40f04f3a-e215-46f7-bbec-91d01fd5f4b0 req-6a9b8d62-15f9-489f-806a-f9ce1d9b562f service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:39.628114 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-40f04f3a-e215-46f7-bbec-91d01fd5f4b0 req-6a9b8d62-15f9-489f-806a-f9ce1d9b562f service nova] Creating event network-changed:ef809f4d-5127-48f1-a968-99867a38928e for instance 04e9b262-d9e0-434a-bcbb-a85ef9180ee9 on n-h2-846463-3 Sep 23 04:35:39.635505 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-40f04f3a-e215-46f7-bbec-91d01fd5f4b0 req-6a9b8d62-15f9-489f-806a-f9ce1d9b562f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055969 Sep 23 04:35:39.636388 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 689/1303] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:35:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:35:39.645080 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4978e219-fe2a-4324-afed-948c90fec6f3 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:39.646217 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4978e219-fe2a-4324-afed-948c90fec6f3 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] [instance: 1bf70366-2b4c-4df9-a6be-1c9145fb3862] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:39.655096 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4978e219-fe2a-4324-afed-948c90fec6f3 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:39.656089 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4978e219-fe2a-4324-afed-948c90fec6f3 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:39.656827 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4978e219-fe2a-4324-afed-948c90fec6f3 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:39.657734 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4978e219-fe2a-4324-afed-948c90fec6f3 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:39.658453 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4978e219-fe2a-4324-afed-948c90fec6f3 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:39.659146 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4978e219-fe2a-4324-afed-948c90fec6f3 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:39.685116 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:35:39.776380 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-05f5ea97-d2bb-492e-b0bd-07996903c542 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5d8ac586e04707acec235c122e5bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60d1259e4a2a4d07a7becd15aa8891bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:39.789722 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-4978e219-fe2a-4324-afed-948c90fec6f3 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a00bc3e62774185b48120832e80476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f931b8de0b4402a3833577fbb15607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:39.796258 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-05f5ea97-d2bb-492e-b0bd-07996903c542 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] 10.222.0.33 "GET /compute/v2.1/servers/533efe90-e3aa-416f-a268-c7b779614c7e" status: 200 len: 1315 microversion: 2.1 time: 1.190054 Sep 23 04:35:39.818273 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 615/1304] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:38 2022] GET /compute/v2.1/servers/533efe90-e3aa-416f-a268-c7b779614c7e => generated 1315 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:39.830503 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4978e219-fe2a-4324-afed-948c90fec6f3 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] 10.222.0.33 "GET /compute/v2.1/servers/1bf70366-2b4c-4df9-a6be-1c9145fb3862" status: 200 len: 1268 microversion: 2.1 time: 0.192654 Sep 23 04:35:39.832307 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 690/1305] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:39 2022] GET /compute/v2.1/servers/1bf70366-2b4c-4df9-a6be-1c9145fb3862 => generated 1268 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:39.835142 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1f251589-0d63-454c-9cd5-8bd5456d3afe tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:39.836049 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-1f251589-0d63-454c-9cd5-8bd5456d3afe tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: 04e9b262-d9e0-434a-bcbb-a85ef9180ee9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:39.846222 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1f251589-0d63-454c-9cd5-8bd5456d3afe tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:39.849358 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1f251589-0d63-454c-9cd5-8bd5456d3afe tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:39.850096 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1f251589-0d63-454c-9cd5-8bd5456d3afe tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:39.851081 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1f251589-0d63-454c-9cd5-8bd5456d3afe tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:39.851778 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1f251589-0d63-454c-9cd5-8bd5456d3afe tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:39.852687 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1f251589-0d63-454c-9cd5-8bd5456d3afe tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:40.202744 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-1f251589-0d63-454c-9cd5-8bd5456d3afe tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:40.212736 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-1f251589-0d63-454c-9cd5-8bd5456d3afe tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9" status: 200 len: 1360 microversion: 2.1 time: 0.393076 Sep 23 04:35:40.213369 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 616/1306] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:39 2022] GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9 => generated 1360 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:40.612363 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2d8af9c2-2b1f-4c1a-993f-485f60734d17 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:40.617853 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-2d8af9c2-2b1f-4c1a-993f-485f60734d17 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: fbbf8d58-8edb-4172-9d19-4b82804bf8e9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:40.627455 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2d8af9c2-2b1f-4c1a-993f-485f60734d17 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:40.628277 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2d8af9c2-2b1f-4c1a-993f-485f60734d17 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:40.629486 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2d8af9c2-2b1f-4c1a-993f-485f60734d17 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:40.631884 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2d8af9c2-2b1f-4c1a-993f-485f60734d17 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:40.634752 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2d8af9c2-2b1f-4c1a-993f-485f60734d17 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:40.636079 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2d8af9c2-2b1f-4c1a-993f-485f60734d17 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:40.830188 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-895cdf02-2c4d-45a4-8dba-9ed77d79644c tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:40.830188 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-895cdf02-2c4d-45a4-8dba-9ed77d79644c tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] [instance: 533efe90-e3aa-416f-a268-c7b779614c7e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:40.835126 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-895cdf02-2c4d-45a4-8dba-9ed77d79644c tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:40.835631 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-895cdf02-2c4d-45a4-8dba-9ed77d79644c tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:40.836073 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-895cdf02-2c4d-45a4-8dba-9ed77d79644c tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:40.839523 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-895cdf02-2c4d-45a4-8dba-9ed77d79644c tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:40.841510 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-895cdf02-2c4d-45a4-8dba-9ed77d79644c tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:40.842423 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-895cdf02-2c4d-45a4-8dba-9ed77d79644c tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:40.874545 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2d8af9c2-2b1f-4c1a-993f-485f60734d17 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:40.895078 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2d8af9c2-2b1f-4c1a-993f-485f60734d17 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/fbbf8d58-8edb-4172-9d19-4b82804bf8e9" status: 200 len: 1535 microversion: 2.1 time: 0.289165 Sep 23 04:35:40.912681 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 691/1307] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:40 2022] GET /compute/v2.1/servers/fbbf8d58-8edb-4172-9d19-4b82804bf8e9 => generated 1535 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:40.930633 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8b00ac17-5871-47e6-ad17-bef8e8a3adf6 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:40.931762 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-8b00ac17-5871-47e6-ad17-bef8e8a3adf6 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] [instance: 1bf70366-2b4c-4df9-a6be-1c9145fb3862] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:40.946405 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8b00ac17-5871-47e6-ad17-bef8e8a3adf6 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:40.948840 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8b00ac17-5871-47e6-ad17-bef8e8a3adf6 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:40.948840 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8b00ac17-5871-47e6-ad17-bef8e8a3adf6 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:40.949275 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8b00ac17-5871-47e6-ad17-bef8e8a3adf6 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:40.950022 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8b00ac17-5871-47e6-ad17-bef8e8a3adf6 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:40.950701 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8b00ac17-5871-47e6-ad17-bef8e8a3adf6 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:41.099369 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-8b00ac17-5871-47e6-ad17-bef8e8a3adf6 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a00bc3e62774185b48120832e80476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f931b8de0b4402a3833577fbb15607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:41.116328 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-8b00ac17-5871-47e6-ad17-bef8e8a3adf6 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] 10.222.0.33 "GET /compute/v2.1/servers/1bf70366-2b4c-4df9-a6be-1c9145fb3862" status: 200 len: 1286 microversion: 2.1 time: 0.200526 Sep 23 04:35:41.119999 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 692/1308] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:40 2022] GET /compute/v2.1/servers/1bf70366-2b4c-4df9-a6be-1c9145fb3862 => generated 1286 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:41.214514 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-895cdf02-2c4d-45a4-8dba-9ed77d79644c tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5d8ac586e04707acec235c122e5bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60d1259e4a2a4d07a7becd15aa8891bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:41.225057 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-895cdf02-2c4d-45a4-8dba-9ed77d79644c tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] 10.222.0.33 "GET /compute/v2.1/servers/533efe90-e3aa-416f-a268-c7b779614c7e" status: 200 len: 1315 microversion: 2.1 time: 0.403996 Sep 23 04:35:41.225674 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 617/1309] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:40 2022] GET /compute/v2.1/servers/533efe90-e3aa-416f-a268-c7b779614c7e => generated 1315 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:41.241290 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2f4beac4-f50d-4ffc-8a2f-e71c83cb1797 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:41.241923 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-2f4beac4-f50d-4ffc-8a2f-e71c83cb1797 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: 04e9b262-d9e0-434a-bcbb-a85ef9180ee9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:41.252754 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2f4beac4-f50d-4ffc-8a2f-e71c83cb1797 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:41.253269 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2f4beac4-f50d-4ffc-8a2f-e71c83cb1797 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:41.253708 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2f4beac4-f50d-4ffc-8a2f-e71c83cb1797 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:41.263269 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2f4beac4-f50d-4ffc-8a2f-e71c83cb1797 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:41.264200 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2f4beac4-f50d-4ffc-8a2f-e71c83cb1797 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:41.269086 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2f4beac4-f50d-4ffc-8a2f-e71c83cb1797 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:41.510390 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2f4beac4-f50d-4ffc-8a2f-e71c83cb1797 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:41.532398 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2f4beac4-f50d-4ffc-8a2f-e71c83cb1797 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9" status: 200 len: 1360 microversion: 2.1 time: 0.294784 Sep 23 04:35:41.534435 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 693/1310] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:41 2022] GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9 => generated 1360 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:41.701160 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-853cb93b-39ef-40d0-ada5-572a47bed186 req-55ce4ef8-74d7-41b1-a587-76e8645f1985 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "533efe90-e3aa-416f-a268-c7b779614c7e", "name": "network-vif-plugged", "status": "completed", "tag": "93e66eb8-2bcd-48fd-905c-eb9ba724cd6e"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:35:41.716182 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-853cb93b-39ef-40d0-ada5-572a47bed186 req-55ce4ef8-74d7-41b1-a587-76e8645f1985 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:41.716671 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-853cb93b-39ef-40d0-ada5-572a47bed186 req-55ce4ef8-74d7-41b1-a587-76e8645f1985 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:41.719203 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-853cb93b-39ef-40d0-ada5-572a47bed186 req-55ce4ef8-74d7-41b1-a587-76e8645f1985 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:41.739870 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-853cb93b-39ef-40d0-ada5-572a47bed186 req-55ce4ef8-74d7-41b1-a587-76e8645f1985 service nova] Creating event network-vif-plugged:93e66eb8-2bcd-48fd-905c-eb9ba724cd6e for instance 533efe90-e3aa-416f-a268-c7b779614c7e on n-h2-846463-3 Sep 23 04:35:41.755254 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-853cb93b-39ef-40d0-ada5-572a47bed186 req-55ce4ef8-74d7-41b1-a587-76e8645f1985 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057446 Sep 23 04:35:41.759328 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 618/1311] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:35:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:35:41.935951 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3cb2e165-3c12-46d9-8a96-4dbc4c9143f4 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:41.939310 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-3cb2e165-3c12-46d9-8a96-4dbc4c9143f4 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: fbbf8d58-8edb-4172-9d19-4b82804bf8e9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:41.973493 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3cb2e165-3c12-46d9-8a96-4dbc4c9143f4 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:41.974742 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3cb2e165-3c12-46d9-8a96-4dbc4c9143f4 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:41.976664 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3cb2e165-3c12-46d9-8a96-4dbc4c9143f4 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:41.980871 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3cb2e165-3c12-46d9-8a96-4dbc4c9143f4 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:41.983159 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3cb2e165-3c12-46d9-8a96-4dbc4c9143f4 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:41.983789 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3cb2e165-3c12-46d9-8a96-4dbc4c9143f4 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:42.144665 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-38c25914-cfd0-4836-a6ba-fbfd02eccff5 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:42.145535 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-38c25914-cfd0-4836-a6ba-fbfd02eccff5 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] [instance: 1bf70366-2b4c-4df9-a6be-1c9145fb3862] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:42.166599 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-38c25914-cfd0-4836-a6ba-fbfd02eccff5 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:42.171705 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-38c25914-cfd0-4836-a6ba-fbfd02eccff5 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:42.176442 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-38c25914-cfd0-4836-a6ba-fbfd02eccff5 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:42.176442 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-38c25914-cfd0-4836-a6ba-fbfd02eccff5 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:42.176442 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-38c25914-cfd0-4836-a6ba-fbfd02eccff5 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:42.176442 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-38c25914-cfd0-4836-a6ba-fbfd02eccff5 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:42.237916 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-3cb2e165-3c12-46d9-8a96-4dbc4c9143f4 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:42.251444 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3cb2e165-3c12-46d9-8a96-4dbc4c9143f4 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/fbbf8d58-8edb-4172-9d19-4b82804bf8e9" status: 200 len: 1535 microversion: 2.1 time: 0.326961 Sep 23 04:35:42.251444 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 694/1312] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:41 2022] GET /compute/v2.1/servers/fbbf8d58-8edb-4172-9d19-4b82804bf8e9 => generated 1535 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:42.261397 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a7b44d1f-7658-46bd-82ea-40f488cec50d tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:42.261397 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a7b44d1f-7658-46bd-82ea-40f488cec50d tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] [instance: 533efe90-e3aa-416f-a268-c7b779614c7e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:42.270824 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a7b44d1f-7658-46bd-82ea-40f488cec50d tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:42.270824 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a7b44d1f-7658-46bd-82ea-40f488cec50d tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:42.270824 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a7b44d1f-7658-46bd-82ea-40f488cec50d tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:42.270824 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a7b44d1f-7658-46bd-82ea-40f488cec50d tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:42.271201 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a7b44d1f-7658-46bd-82ea-40f488cec50d tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:42.271717 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a7b44d1f-7658-46bd-82ea-40f488cec50d tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:42.359811 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-38c25914-cfd0-4836-a6ba-fbfd02eccff5 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a00bc3e62774185b48120832e80476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f931b8de0b4402a3833577fbb15607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:42.372734 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-38c25914-cfd0-4836-a6ba-fbfd02eccff5 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] 10.222.0.33 "GET /compute/v2.1/servers/1bf70366-2b4c-4df9-a6be-1c9145fb3862" status: 200 len: 1274 microversion: 2.1 time: 0.233418 Sep 23 04:35:42.373512 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 619/1313] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:42 2022] GET /compute/v2.1/servers/1bf70366-2b4c-4df9-a6be-1c9145fb3862 => generated 1274 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:42.560518 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-98117560-f52d-49ef-aaf5-368b03cc355d tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:42.561581 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-98117560-f52d-49ef-aaf5-368b03cc355d tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: 04e9b262-d9e0-434a-bcbb-a85ef9180ee9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:42.568426 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a7b44d1f-7658-46bd-82ea-40f488cec50d tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5d8ac586e04707acec235c122e5bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60d1259e4a2a4d07a7becd15aa8891bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:42.572020 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-98117560-f52d-49ef-aaf5-368b03cc355d tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:42.575439 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-98117560-f52d-49ef-aaf5-368b03cc355d tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:42.575439 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-98117560-f52d-49ef-aaf5-368b03cc355d tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:42.575439 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-98117560-f52d-49ef-aaf5-368b03cc355d tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:42.575439 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-98117560-f52d-49ef-aaf5-368b03cc355d tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:42.576794 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-98117560-f52d-49ef-aaf5-368b03cc355d tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:42.579387 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a7b44d1f-7658-46bd-82ea-40f488cec50d tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] 10.222.0.33 "GET /compute/v2.1/servers/533efe90-e3aa-416f-a268-c7b779614c7e" status: 200 len: 1315 microversion: 2.1 time: 0.326641 Sep 23 04:35:42.583486 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:35:42.591877 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 695/1314] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:42 2022] GET /compute/v2.1/servers/533efe90-e3aa-416f-a268-c7b779614c7e => generated 1315 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:35:42.820203 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-98117560-f52d-49ef-aaf5-368b03cc355d tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:42.830154 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-98117560-f52d-49ef-aaf5-368b03cc355d tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9" status: 200 len: 1360 microversion: 2.1 time: 0.274277 Sep 23 04:35:42.831602 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 620/1315] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:42 2022] GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9 => generated 1360 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:35:43.277310 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ab9b10a6-087d-42e7-a34f-ead2d67a3da6 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:43.288290 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ab9b10a6-087d-42e7-a34f-ead2d67a3da6 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: fbbf8d58-8edb-4172-9d19-4b82804bf8e9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:43.298714 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ab9b10a6-087d-42e7-a34f-ead2d67a3da6 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:43.299550 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ab9b10a6-087d-42e7-a34f-ead2d67a3da6 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:43.300132 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ab9b10a6-087d-42e7-a34f-ead2d67a3da6 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:43.301859 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ab9b10a6-087d-42e7-a34f-ead2d67a3da6 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:43.302606 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ab9b10a6-087d-42e7-a34f-ead2d67a3da6 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:43.303129 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ab9b10a6-087d-42e7-a34f-ead2d67a3da6 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:43.406707 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7bf2a6fe-f260-4835-a251-c461adf84b13 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:43.408180 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7bf2a6fe-f260-4835-a251-c461adf84b13 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] [instance: 1bf70366-2b4c-4df9-a6be-1c9145fb3862] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:43.446773 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=5 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:35:43.460332 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7bf2a6fe-f260-4835-a251-c461adf84b13 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:43.464422 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7bf2a6fe-f260-4835-a251-c461adf84b13 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:43.466354 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7bf2a6fe-f260-4835-a251-c461adf84b13 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:43.471413 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7bf2a6fe-f260-4835-a251-c461adf84b13 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:43.473815 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7bf2a6fe-f260-4835-a251-c461adf84b13 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:43.475533 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7bf2a6fe-f260-4835-a251-c461adf84b13 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:43.607488 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ab9b10a6-087d-42e7-a34f-ead2d67a3da6 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:43.615766 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ab9b10a6-087d-42e7-a34f-ead2d67a3da6 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/fbbf8d58-8edb-4172-9d19-4b82804bf8e9" status: 200 len: 1535 microversion: 2.1 time: 0.342649 Sep 23 04:35:43.619941 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 696/1316] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:43 2022] GET /compute/v2.1/servers/fbbf8d58-8edb-4172-9d19-4b82804bf8e9 => generated 1535 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:43.774952 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-7bf2a6fe-f260-4835-a251-c461adf84b13 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a00bc3e62774185b48120832e80476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f931b8de0b4402a3833577fbb15607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:43.786574 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7bf2a6fe-f260-4835-a251-c461adf84b13 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] 10.222.0.33 "GET /compute/v2.1/servers/1bf70366-2b4c-4df9-a6be-1c9145fb3862" status: 200 len: 1316 microversion: 2.1 time: 0.387884 Sep 23 04:35:43.798984 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 621/1317] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:43 2022] GET /compute/v2.1/servers/1bf70366-2b4c-4df9-a6be-1c9145fb3862 => generated 1316 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:43.810190 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1cf9b824-539f-4b0b-9070-d525f38af92f tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:43.811339 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-1cf9b824-539f-4b0b-9070-d525f38af92f tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] [instance: 533efe90-e3aa-416f-a268-c7b779614c7e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:43.820826 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1cf9b824-539f-4b0b-9070-d525f38af92f tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:43.821863 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1cf9b824-539f-4b0b-9070-d525f38af92f tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:43.823315 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1cf9b824-539f-4b0b-9070-d525f38af92f tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:43.824456 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1cf9b824-539f-4b0b-9070-d525f38af92f tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:43.830444 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1cf9b824-539f-4b0b-9070-d525f38af92f tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:43.831303 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1cf9b824-539f-4b0b-9070-d525f38af92f tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:43.835421 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-27765f6a-a74c-4c86-8eb0-87f86359ffd9 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-2140969081", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:35:43.909477 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.neutron [None req-27765f6a-a74c-4c86-8eb0-87f86359ffd9 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] validate_networks() for None {{(pid=122699) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:35:44.230270 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-1cf9b824-539f-4b0b-9070-d525f38af92f tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5d8ac586e04707acec235c122e5bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60d1259e4a2a4d07a7becd15aa8891bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:44.238423 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-1cf9b824-539f-4b0b-9070-d525f38af92f tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] 10.222.0.33 "GET /compute/v2.1/servers/533efe90-e3aa-416f-a268-c7b779614c7e" status: 200 len: 1315 microversion: 2.1 time: 0.438073 Sep 23 04:35:44.244794 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 622/1318] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:43 2022] GET /compute/v2.1/servers/533efe90-e3aa-416f-a268-c7b779614c7e => generated 1315 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:44.281837 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-e5e4d7ca-6aeb-4e09-a689-9dc319203d30 req-46e04bca-b1c2-4d7a-ae4a-8308dcb74659 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbbf8d58-8edb-4172-9d19-4b82804bf8e9", "name": "network-vif-unplugged", "status": "completed", "tag": "1a75583d-4990-40e9-876b-807baa271a68"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:35:44.318866 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-e5e4d7ca-6aeb-4e09-a689-9dc319203d30 req-46e04bca-b1c2-4d7a-ae4a-8308dcb74659 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:44.319378 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-e5e4d7ca-6aeb-4e09-a689-9dc319203d30 req-46e04bca-b1c2-4d7a-ae4a-8308dcb74659 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:44.319815 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-e5e4d7ca-6aeb-4e09-a689-9dc319203d30 req-46e04bca-b1c2-4d7a-ae4a-8308dcb74659 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:44.371304 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-e5e4d7ca-6aeb-4e09-a689-9dc319203d30 req-46e04bca-b1c2-4d7a-ae4a-8308dcb74659 service nova] Creating event network-vif-unplugged:1a75583d-4990-40e9-876b-807baa271a68 for instance fbbf8d58-8edb-4172-9d19-4b82804bf8e9 on n-h2-846463-3 Sep 23 04:35:44.392208 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [req-e5e4d7ca-6aeb-4e09-a689-9dc319203d30 req-46e04bca-b1c2-4d7a-ae4a-8308dcb74659 service nova] Instance fbbf8d58-8edb-4172-9d19-4b82804bf8e9 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-846463-3'} {{(pid=122698) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 23 04:35:44.427059 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-e5e4d7ca-6aeb-4e09-a689-9dc319203d30 req-46e04bca-b1c2-4d7a-ae4a-8308dcb74659 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.148823 Sep 23 04:35:44.443466 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 623/1319] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:35:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:35:44.462786 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f19c0b59-3581-4b26-b8a1-5eb6d827f007 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:44.468110 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f19c0b59-3581-4b26-b8a1-5eb6d827f007 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: 04e9b262-d9e0-434a-bcbb-a85ef9180ee9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:44.487565 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f19c0b59-3581-4b26-b8a1-5eb6d827f007 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:44.489117 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f19c0b59-3581-4b26-b8a1-5eb6d827f007 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:44.489759 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f19c0b59-3581-4b26-b8a1-5eb6d827f007 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:44.491165 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f19c0b59-3581-4b26-b8a1-5eb6d827f007 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:44.494583 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f19c0b59-3581-4b26-b8a1-5eb6d827f007 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:44.495416 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f19c0b59-3581-4b26-b8a1-5eb6d827f007 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:44.537448 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-27765f6a-a74c-4c86-8eb0-87f86359ffd9 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Flavor limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:35:44.538005 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-27765f6a-a74c-4c86-8eb0-87f86359ffd9 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Image limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:35:44.538591 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-27765f6a-a74c-4c86-8eb0-87f86359ffd9 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Flavor pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:35:44.539169 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-27765f6a-a74c-4c86-8eb0-87f86359ffd9 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Image pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:35:44.541106 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-27765f6a-a74c-4c86-8eb0-87f86359ffd9 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:35:44.560445 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-27765f6a-a74c-4c86-8eb0-87f86359ffd9 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:44.561075 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-27765f6a-a74c-4c86-8eb0-87f86359ffd9 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:44.561600 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-27765f6a-a74c-4c86-8eb0-87f86359ffd9 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:44.563021 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-27765f6a-a74c-4c86-8eb0-87f86359ffd9 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:44.564660 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-27765f6a-a74c-4c86-8eb0-87f86359ffd9 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:44.565109 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-27765f6a-a74c-4c86-8eb0-87f86359ffd9 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:44.625021 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-27765f6a-a74c-4c86-8eb0-87f86359ffd9 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Getting quotas for project f5db359a60174c45afa2bf06e23a46c4. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:35:44.651915 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-27765f6a-a74c-4c86-8eb0-87f86359ffd9 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Getting quotas for user da08af8193dd490b93278385583f24c0 and project f5db359a60174c45afa2bf06e23a46c4. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:35:44.690690 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-27765f6a-a74c-4c86-8eb0-87f86359ffd9 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Going to run 1 instances... {{(pid=122699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:35:44.711628 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-27765f6a-a74c-4c86-8eb0-87f86359ffd9 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 1180ceb9-a888-4a3b-ba9d-a35afa8dc279] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:35:44.741958 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f19c0b59-3581-4b26-b8a1-5eb6d827f007 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:44.755356 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f19c0b59-3581-4b26-b8a1-5eb6d827f007 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9" status: 200 len: 1360 microversion: 2.1 time: 0.306900 Sep 23 04:35:44.757418 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 624/1320] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:44 2022] GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9 => generated 1360 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:44.774842 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8a0659ea-4ebe-4480-8833-d86d4e38dd15 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:44.775893 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8a0659ea-4ebe-4480-8833-d86d4e38dd15 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: fbbf8d58-8edb-4172-9d19-4b82804bf8e9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:44.787622 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8a0659ea-4ebe-4480-8833-d86d4e38dd15 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:44.792603 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8a0659ea-4ebe-4480-8833-d86d4e38dd15 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:44.793212 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8a0659ea-4ebe-4480-8833-d86d4e38dd15 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:44.795540 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8a0659ea-4ebe-4480-8833-d86d4e38dd15 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:44.796720 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8a0659ea-4ebe-4480-8833-d86d4e38dd15 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:44.797177 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8a0659ea-4ebe-4480-8833-d86d4e38dd15 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:44.914027 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-27765f6a-a74c-4c86-8eb0-87f86359ffd9 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.291237 Sep 23 04:35:44.920304 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 697/1321] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:35:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1300 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:35:44.933561 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1e6786c3-df9c-4db2-980a-92ba0fc29a84 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:44.934568 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1e6786c3-df9c-4db2-980a-92ba0fc29a84 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] [instance: 1bf70366-2b4c-4df9-a6be-1c9145fb3862] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:44.947731 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e6786c3-df9c-4db2-980a-92ba0fc29a84 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:44.971164 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e6786c3-df9c-4db2-980a-92ba0fc29a84 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:44.976181 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e6786c3-df9c-4db2-980a-92ba0fc29a84 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:44.979272 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e6786c3-df9c-4db2-980a-92ba0fc29a84 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:44.980060 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e6786c3-df9c-4db2-980a-92ba0fc29a84 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:44.982180 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e6786c3-df9c-4db2-980a-92ba0fc29a84 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:45.118712 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8a0659ea-4ebe-4480-8833-d86d4e38dd15 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:45.129505 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8a0659ea-4ebe-4480-8833-d86d4e38dd15 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/fbbf8d58-8edb-4172-9d19-4b82804bf8e9" status: 200 len: 1535 microversion: 2.1 time: 0.367759 Sep 23 04:35:45.151843 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 625/1322] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:44 2022] GET /compute/v2.1/servers/fbbf8d58-8edb-4172-9d19-4b82804bf8e9 => generated 1535 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:45.173408 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b7248ee2-b39d-416c-b6d7-637187856baf tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:45.174125 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b7248ee2-b39d-416c-b6d7-637187856baf tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 1180ceb9-a888-4a3b-ba9d-a35afa8dc279] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:45.341851 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b7248ee2-b39d-416c-b6d7-637187856baf tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:45.350203 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b7248ee2-b39d-416c-b6d7-637187856baf tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/1180ceb9-a888-4a3b-ba9d-a35afa8dc279" status: 200 len: 1217 microversion: 2.1 time: 0.187842 Sep 23 04:35:45.350870 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 626/1323] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:45 2022] GET /compute/v2.1/servers/1180ceb9-a888-4a3b-ba9d-a35afa8dc279 => generated 1217 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:45.372856 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-485a78a5-9554-46d8-a665-2cd3716c80b7 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:45.373761 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-485a78a5-9554-46d8-a665-2cd3716c80b7 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] [instance: 533efe90-e3aa-416f-a268-c7b779614c7e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:45.381122 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-485a78a5-9554-46d8-a665-2cd3716c80b7 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:45.381834 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-485a78a5-9554-46d8-a665-2cd3716c80b7 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:45.382670 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-485a78a5-9554-46d8-a665-2cd3716c80b7 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:45.384324 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-485a78a5-9554-46d8-a665-2cd3716c80b7 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:45.384971 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-485a78a5-9554-46d8-a665-2cd3716c80b7 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:45.385567 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-485a78a5-9554-46d8-a665-2cd3716c80b7 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:45.429083 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1e6786c3-df9c-4db2-980a-92ba0fc29a84 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a00bc3e62774185b48120832e80476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f931b8de0b4402a3833577fbb15607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:45.458042 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1e6786c3-df9c-4db2-980a-92ba0fc29a84 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] 10.222.0.33 "GET /compute/v2.1/servers/1bf70366-2b4c-4df9-a6be-1c9145fb3862" status: 200 len: 1316 microversion: 2.1 time: 0.521417 Sep 23 04:35:45.458042 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 698/1324] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:44 2022] GET /compute/v2.1/servers/1bf70366-2b4c-4df9-a6be-1c9145fb3862 => generated 1316 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:45.644569 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-485a78a5-9554-46d8-a665-2cd3716c80b7 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5d8ac586e04707acec235c122e5bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60d1259e4a2a4d07a7becd15aa8891bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:45.653623 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-485a78a5-9554-46d8-a665-2cd3716c80b7 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] 10.222.0.33 "GET /compute/v2.1/servers/533efe90-e3aa-416f-a268-c7b779614c7e" status: 200 len: 1504 microversion: 2.1 time: 0.290360 Sep 23 04:35:45.654580 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 627/1325] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:45 2022] GET /compute/v2.1/servers/533efe90-e3aa-416f-a268-c7b779614c7e => generated 1504 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:45.678546 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-952faebd-8595-45c7-b2ac-968cee191010 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:45.679975 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-952faebd-8595-45c7-b2ac-968cee191010 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] [instance: 533efe90-e3aa-416f-a268-c7b779614c7e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:45.687256 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-952faebd-8595-45c7-b2ac-968cee191010 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:45.688033 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-952faebd-8595-45c7-b2ac-968cee191010 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:45.688674 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-952faebd-8595-45c7-b2ac-968cee191010 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:45.689832 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-952faebd-8595-45c7-b2ac-968cee191010 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:45.690335 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-952faebd-8595-45c7-b2ac-968cee191010 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:45.696760 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-952faebd-8595-45c7-b2ac-968cee191010 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:45.719045 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-952faebd-8595-45c7-b2ac-968cee191010 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] [instance: 533efe90-e3aa-416f-a268-c7b779614c7e] Going to try to terminate instance {{(pid=122699) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:35:45.781614 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a4291be8-bcd7-47b9-bed7-4215eb3358bb tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:45.782474 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a4291be8-bcd7-47b9-bed7-4215eb3358bb tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: 04e9b262-d9e0-434a-bcbb-a85ef9180ee9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:45.800943 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a4291be8-bcd7-47b9-bed7-4215eb3358bb tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:45.801755 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a4291be8-bcd7-47b9-bed7-4215eb3358bb tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:45.802396 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a4291be8-bcd7-47b9-bed7-4215eb3358bb tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:45.812970 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a4291be8-bcd7-47b9-bed7-4215eb3358bb tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:45.812970 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a4291be8-bcd7-47b9-bed7-4215eb3358bb tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:45.812970 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a4291be8-bcd7-47b9-bed7-4215eb3358bb tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:46.051481 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a4291be8-bcd7-47b9-bed7-4215eb3358bb tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:46.056215 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:35:46.067196 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a4291be8-bcd7-47b9-bed7-4215eb3358bb tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9" status: 200 len: 1360 microversion: 2.1 time: 0.290096 Sep 23 04:35:46.068481 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 628/1326] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:45 2022] GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9 => generated 1360 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:46.159200 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-952faebd-8595-45c7-b2ac-968cee191010 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] 10.222.0.33 "DELETE /compute/v2.1/servers/533efe90-e3aa-416f-a268-c7b779614c7e" status: 204 len: 0 microversion: 2.1 time: 0.485543 Sep 23 04:35:46.163154 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 699/1327] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:35:45 2022] DELETE /compute/v2.1/servers/533efe90-e3aa-416f-a268-c7b779614c7e => generated 0 bytes in 487 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 23 04:35:46.170227 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-67de64ca-d15e-4b13-81d0-d33b8526626c tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:46.171082 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-67de64ca-d15e-4b13-81d0-d33b8526626c tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: fbbf8d58-8edb-4172-9d19-4b82804bf8e9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:46.175174 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7b5c044d-2b21-47cd-b8d7-d589b0012165 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:46.176086 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-7b5c044d-2b21-47cd-b8d7-d589b0012165 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] [instance: 533efe90-e3aa-416f-a268-c7b779614c7e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:46.181092 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-67de64ca-d15e-4b13-81d0-d33b8526626c tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:46.182218 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-67de64ca-d15e-4b13-81d0-d33b8526626c tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:46.182842 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-67de64ca-d15e-4b13-81d0-d33b8526626c tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:46.183939 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-67de64ca-d15e-4b13-81d0-d33b8526626c tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:46.184592 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-67de64ca-d15e-4b13-81d0-d33b8526626c tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:46.185363 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-67de64ca-d15e-4b13-81d0-d33b8526626c tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:46.185818 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7b5c044d-2b21-47cd-b8d7-d589b0012165 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:46.193167 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7b5c044d-2b21-47cd-b8d7-d589b0012165 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:46.193167 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7b5c044d-2b21-47cd-b8d7-d589b0012165 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:46.193167 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7b5c044d-2b21-47cd-b8d7-d589b0012165 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:46.193167 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7b5c044d-2b21-47cd-b8d7-d589b0012165 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:46.193617 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7b5c044d-2b21-47cd-b8d7-d589b0012165 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:46.496487 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-7b5c044d-2b21-47cd-b8d7-d589b0012165 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5d8ac586e04707acec235c122e5bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60d1259e4a2a4d07a7becd15aa8891bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:46.508120 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-7b5c044d-2b21-47cd-b8d7-d589b0012165 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] 10.222.0.33 "GET /compute/v2.1/servers/533efe90-e3aa-416f-a268-c7b779614c7e" status: 200 len: 1510 microversion: 2.1 time: 0.341357 Sep 23 04:35:46.514719 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 700/1328] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:46 2022] GET /compute/v2.1/servers/533efe90-e3aa-416f-a268-c7b779614c7e => generated 1510 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:46.538973 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-82645964-e2ce-4f87-9ee2-4ba280915acd tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:46.543798 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-82645964-e2ce-4f87-9ee2-4ba280915acd tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 1180ceb9-a888-4a3b-ba9d-a35afa8dc279] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:46.572223 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-67de64ca-d15e-4b13-81d0-d33b8526626c tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:46.580984 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-67de64ca-d15e-4b13-81d0-d33b8526626c tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/fbbf8d58-8edb-4172-9d19-4b82804bf8e9" status: 200 len: 1528 microversion: 2.1 time: 0.428208 Sep 23 04:35:46.595001 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 629/1329] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:46 2022] GET /compute/v2.1/servers/fbbf8d58-8edb-4172-9d19-4b82804bf8e9 => generated 1528 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:46.611020 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-0099b86b-6586-436e-9fe3-ff3675a66059 req-59985354-bbba-43dc-b286-e9ab9ed96c85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bf70366-2b4c-4df9-a6be-1c9145fb3862", "tag": "c99566be-c1ff-41dd-9148-37f8e480c982"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:35:46.643071 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-0099b86b-6586-436e-9fe3-ff3675a66059 req-59985354-bbba-43dc-b286-e9ab9ed96c85 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:46.643071 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-0099b86b-6586-436e-9fe3-ff3675a66059 req-59985354-bbba-43dc-b286-e9ab9ed96c85 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:46.646454 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-0099b86b-6586-436e-9fe3-ff3675a66059 req-59985354-bbba-43dc-b286-e9ab9ed96c85 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:46.660981 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-82645964-e2ce-4f87-9ee2-4ba280915acd tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:46.668821 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-0099b86b-6586-436e-9fe3-ff3675a66059 req-59985354-bbba-43dc-b286-e9ab9ed96c85 service nova] Creating event network-changed:c99566be-c1ff-41dd-9148-37f8e480c982 for instance 1bf70366-2b4c-4df9-a6be-1c9145fb3862 on n-h1-846463-3 Sep 23 04:35:46.671286 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-82645964-e2ce-4f87-9ee2-4ba280915acd tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/1180ceb9-a888-4a3b-ba9d-a35afa8dc279" status: 200 len: 1217 microversion: 2.1 time: 0.146585 Sep 23 04:35:46.671286 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 701/1330] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:46 2022] GET /compute/v2.1/servers/1180ceb9-a888-4a3b-ba9d-a35afa8dc279 => generated 1217 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:46.675897 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2c99eb5b-2859-4cae-a6f1-98321a49ff0d tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:46.676561 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-2c99eb5b-2859-4cae-a6f1-98321a49ff0d tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] [instance: 1bf70366-2b4c-4df9-a6be-1c9145fb3862] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:46.683139 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2c99eb5b-2859-4cae-a6f1-98321a49ff0d tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:46.696868 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-0099b86b-6586-436e-9fe3-ff3675a66059 req-59985354-bbba-43dc-b286-e9ab9ed96c85 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086940 Sep 23 04:35:46.696868 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 630/1331] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:35:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:35:46.698249 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2c99eb5b-2859-4cae-a6f1-98321a49ff0d tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:46.699041 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2c99eb5b-2859-4cae-a6f1-98321a49ff0d tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:46.699861 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2c99eb5b-2859-4cae-a6f1-98321a49ff0d tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:46.700388 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2c99eb5b-2859-4cae-a6f1-98321a49ff0d tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:46.700994 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2c99eb5b-2859-4cae-a6f1-98321a49ff0d tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:46.704705 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1aa504ea-4a05-438f-bb7a-21c2c001063d tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:46.706077 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-1aa504ea-4a05-438f-bb7a-21c2c001063d tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: fbbf8d58-8edb-4172-9d19-4b82804bf8e9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:46.715510 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1aa504ea-4a05-438f-bb7a-21c2c001063d tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:46.716606 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1aa504ea-4a05-438f-bb7a-21c2c001063d tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:46.717444 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1aa504ea-4a05-438f-bb7a-21c2c001063d tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:46.721789 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1aa504ea-4a05-438f-bb7a-21c2c001063d tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:46.721789 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1aa504ea-4a05-438f-bb7a-21c2c001063d tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:46.721789 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1aa504ea-4a05-438f-bb7a-21c2c001063d tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:47.050853 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-1aa504ea-4a05-438f-bb7a-21c2c001063d tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:47.061200 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-1aa504ea-4a05-438f-bb7a-21c2c001063d tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/fbbf8d58-8edb-4172-9d19-4b82804bf8e9" status: 200 len: 1528 microversion: 2.1 time: 0.363793 Sep 23 04:35:47.063213 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 631/1332] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:46 2022] GET /compute/v2.1/servers/fbbf8d58-8edb-4172-9d19-4b82804bf8e9 => generated 1528 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:47.087527 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d89f95e2-c65e-4a06-acf1-1fe6c630faff tempest-MigrationsAdminTest-295231043 tempest-MigrationsAdminTest-295231043-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:47.126441 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-d89f95e2-c65e-4a06-acf1-1fe6c630faff tempest-MigrationsAdminTest-295231043 tempest-MigrationsAdminTest-295231043-project-admin] HTTP exception thrown: Flavor 3d855f86-77b7-407a-b659-aee8bca403f3 could not be found. Sep 23 04:35:47.128994 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d89f95e2-c65e-4a06-acf1-1fe6c630faff tempest-MigrationsAdminTest-295231043 tempest-MigrationsAdminTest-295231043-project-admin] Request method failure captured: Sep 23 04:35:47.128994 n-d-846463-3 devstack@n-api.service[122698]: request: DELETE /compute/v2.1/flavors/3d855f86-77b7-407a-b659-aee8bca403f3 HTTP/1.1 Sep 23 04:35:47.128994 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:35:47.128994 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:35:47.128994 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:35:47.128994 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:35:47.128994 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:35:47.128994 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:35:47.128994 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:35:47.128994 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:35:47.128994 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTbXBngdsnzTx05N-_fy0HcyTo615sVQii8ji1XGgfcUV6YbYbfgZ5_M1rnHRzpN_2oSqouSP7mIZczeQEoLwdd_hHlzpn4r-N_CAiUxeaZeeQVM71QeqQF5_IHlc_E97lowTtnycVQjmnTLTemVCTSEGQnlIEnOtFTA-qCFV1JX0kg Sep 23 04:35:47.128994 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:35:47.128994 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:35:47.128994 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:35:47.128994 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:35:47.128994 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:35:47.128994 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:35:47.128994 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: b9f5de88d7c249e28440dccc2e634253 Sep 23 04:35:47.128994 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-MigrationsAdminTest-295231043 Sep 23 04:35:47.128994 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,admin,member Sep 23 04:35:47.128994 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,admin,member Sep 23 04:35:47.130838 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b9f5de88d7c249e28440dccc2e634253", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b9f5de88d7c249e28440dccc2e634253"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b9f5de88d7c249e28440dccc2e634253"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b9f5de88d7c249e28440dccc2e634253"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:35:47.130838 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-MigrationsAdminTest-295231043 Sep 23 04:35:47.130838 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: b9f5de88d7c249e28440dccc2e634253 Sep 23 04:35:47.130838 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-MigrationsAdminTest-295231043 Sep 23 04:35:47.130838 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-MigrationsAdminTest-295231043-project-admin Sep 23 04:35:47.130838 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:35:47.130838 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:35:47.130838 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 3514d0172cf24a0ebaf2eb296c7e2945 Sep 23 04:35:47.130838 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-MigrationsAdminTest-295231043-project-admin Sep 23 04:35:47.130838 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:35:47.130838 n-d-846463-3 devstack@n-api.service[122698]: exception: Flavor 3d855f86-77b7-407a-b659-aee8bca403f3 could not be found. Sep 23 04:35:47.130838 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '3d855f86-77b7-407a-b659-aee8bca403f3'} Sep 23 04:35:47.131889 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:35:47.131889 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:35:47.131889 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Sep 23 04:35:47.131889 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi flavor.destroy() Sep 23 04:35:47.131889 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 23 04:35:47.131889 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 23 04:35:47.131889 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Sep 23 04:35:47.131889 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Sep 23 04:35:47.131889 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Sep 23 04:35:47.131889 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Sep 23 04:35:47.131889 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 23 04:35:47.131889 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 23 04:35:47.131889 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Sep 23 04:35:47.131889 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Sep 23 04:35:47.131889 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 3d855f86-77b7-407a-b659-aee8bca403f3 could not be found. Sep 23 04:35:47.131889 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:35:47.131889 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:35:47.131889 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:35:47.131889 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:35:47.131889 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:35:47.134444 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:35:47.134444 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:35:47.134444 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:35:47.134444 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:35:47.134444 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:35:47.134444 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Sep 23 04:35:47.134444 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:35:47.134444 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 3d855f86-77b7-407a-b659-aee8bca403f3 could not be found. Sep 23 04:35:47.134444 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:35:47.134444 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:35:47.134444 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:35:47.134444 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:35:47.134444 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:35:47.134444 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:35:47.134444 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:35:47.134444 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:35:47.134444 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 3d855f86-77b7-407a-b659-aee8bca403f3 could not be found. Sep 23 04:35:47.134444 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:35:47.135965 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d89f95e2-c65e-4a06-acf1-1fe6c630faff tempest-MigrationsAdminTest-295231043 tempest-MigrationsAdminTest-295231043-project-admin] Returning 404 to user: Flavor 3d855f86-77b7-407a-b659-aee8bca403f3 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:35:47.135965 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d89f95e2-c65e-4a06-acf1-1fe6c630faff tempest-MigrationsAdminTest-295231043 tempest-MigrationsAdminTest-295231043-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/3d855f86-77b7-407a-b659-aee8bca403f3" status: 404 len: 109 microversion: 2.1 time: 0.050303 Sep 23 04:35:47.144788 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 632/1333] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:35:47 2022] DELETE /compute/v2.1/flavors/3d855f86-77b7-407a-b659-aee8bca403f3 => generated 109 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 04:35:47.173222 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c1f64aff-4c86-4ef7-94d7-7b6f41c2d9a4 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:47.178663 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c1f64aff-4c86-4ef7-94d7-7b6f41c2d9a4 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: 04e9b262-d9e0-434a-bcbb-a85ef9180ee9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:47.210316 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c1f64aff-4c86-4ef7-94d7-7b6f41c2d9a4 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:47.213800 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c1f64aff-4c86-4ef7-94d7-7b6f41c2d9a4 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:47.215642 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c1f64aff-4c86-4ef7-94d7-7b6f41c2d9a4 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:47.217120 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c1f64aff-4c86-4ef7-94d7-7b6f41c2d9a4 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:47.221159 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c1f64aff-4c86-4ef7-94d7-7b6f41c2d9a4 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:47.224005 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c1f64aff-4c86-4ef7-94d7-7b6f41c2d9a4 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:47.294557 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2c99eb5b-2859-4cae-a6f1-98321a49ff0d tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a00bc3e62774185b48120832e80476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f931b8de0b4402a3833577fbb15607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:47.303845 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2c99eb5b-2859-4cae-a6f1-98321a49ff0d tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] 10.222.0.33 "GET /compute/v2.1/servers/1bf70366-2b4c-4df9-a6be-1c9145fb3862" status: 200 len: 1316 microversion: 2.1 time: 0.632061 Sep 23 04:35:47.310230 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 702/1334] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:46 2022] GET /compute/v2.1/servers/1bf70366-2b4c-4df9-a6be-1c9145fb3862 => generated 1316 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:47.476895 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-79cd9974-eff9-4246-9fe6-df32c9f013c7 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1561626242", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:35:47.575481 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c1f64aff-4c86-4ef7-94d7-7b6f41c2d9a4 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:47.585198 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c1f64aff-4c86-4ef7-94d7-7b6f41c2d9a4 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9" status: 200 len: 1360 microversion: 2.1 time: 0.437232 Sep 23 04:35:47.588055 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 633/1335] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:47 2022] GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9 => generated 1360 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:47.594158 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c4b3944b-59ca-4004-b1cb-5d1b8bbc9350 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:47.595142 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c4b3944b-59ca-4004-b1cb-5d1b8bbc9350 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] [instance: 533efe90-e3aa-416f-a268-c7b779614c7e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:47.603554 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c4b3944b-59ca-4004-b1cb-5d1b8bbc9350 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:47.604374 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c4b3944b-59ca-4004-b1cb-5d1b8bbc9350 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:47.605051 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c4b3944b-59ca-4004-b1cb-5d1b8bbc9350 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:47.606082 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c4b3944b-59ca-4004-b1cb-5d1b8bbc9350 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:47.606275 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.neutron [None req-79cd9974-eff9-4246-9fe6-df32c9f013c7 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] validate_networks() for None {{(pid=122699) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:35:47.606964 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c4b3944b-59ca-4004-b1cb-5d1b8bbc9350 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:47.607604 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c4b3944b-59ca-4004-b1cb-5d1b8bbc9350 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:48.099135 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c4b3944b-59ca-4004-b1cb-5d1b8bbc9350 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5d8ac586e04707acec235c122e5bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60d1259e4a2a4d07a7becd15aa8891bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:48.109267 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c4b3944b-59ca-4004-b1cb-5d1b8bbc9350 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] 10.222.0.33 "GET /compute/v2.1/servers/533efe90-e3aa-416f-a268-c7b779614c7e" status: 200 len: 1510 microversion: 2.1 time: 0.519470 Sep 23 04:35:48.122920 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 634/1336] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:47 2022] GET /compute/v2.1/servers/533efe90-e3aa-416f-a268-c7b779614c7e => generated 1510 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:48.128263 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0783e526-15d1-457a-a7d9-fe6f25ddf356 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:48.128872 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-0783e526-15d1-457a-a7d9-fe6f25ddf356 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 1180ceb9-a888-4a3b-ba9d-a35afa8dc279] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:48.139296 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0783e526-15d1-457a-a7d9-fe6f25ddf356 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:48.140062 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0783e526-15d1-457a-a7d9-fe6f25ddf356 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:48.140512 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0783e526-15d1-457a-a7d9-fe6f25ddf356 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:48.143479 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0783e526-15d1-457a-a7d9-fe6f25ddf356 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:48.143479 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0783e526-15d1-457a-a7d9-fe6f25ddf356 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:48.143479 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0783e526-15d1-457a-a7d9-fe6f25ddf356 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:48.167000 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-79cd9974-eff9-4246-9fe6-df32c9f013c7 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Flavor limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:35:48.168047 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-79cd9974-eff9-4246-9fe6-df32c9f013c7 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Image limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:35:48.168680 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-79cd9974-eff9-4246-9fe6-df32c9f013c7 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Flavor pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:35:48.169242 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-79cd9974-eff9-4246-9fe6-df32c9f013c7 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Image pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:35:48.175710 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-79cd9974-eff9-4246-9fe6-df32c9f013c7 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:35:48.181633 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=35 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:35:48.183607 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-79cd9974-eff9-4246-9fe6-df32c9f013c7 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:48.184502 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-79cd9974-eff9-4246-9fe6-df32c9f013c7 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:48.185110 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-79cd9974-eff9-4246-9fe6-df32c9f013c7 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:48.186245 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-79cd9974-eff9-4246-9fe6-df32c9f013c7 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:48.186916 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-79cd9974-eff9-4246-9fe6-df32c9f013c7 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:48.187518 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-79cd9974-eff9-4246-9fe6-df32c9f013c7 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:48.212034 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-79cd9974-eff9-4246-9fe6-df32c9f013c7 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Getting quotas for project 54abd267d3c043e09f26f486823907e2. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:35:48.231789 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-79cd9974-eff9-4246-9fe6-df32c9f013c7 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Getting quotas for user 13f5a913548445a09377847fd78a10a1 and project 54abd267d3c043e09f26f486823907e2. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:35:48.261736 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-79cd9974-eff9-4246-9fe6-df32c9f013c7 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Going to run 1 instances... {{(pid=122699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:35:48.267714 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-79cd9974-eff9-4246-9fe6-df32c9f013c7 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:35:48.276985 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-0783e526-15d1-457a-a7d9-fe6f25ddf356 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:48.292823 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0783e526-15d1-457a-a7d9-fe6f25ddf356 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/1180ceb9-a888-4a3b-ba9d-a35afa8dc279" status: 200 len: 1269 microversion: 2.1 time: 0.168483 Sep 23 04:35:48.293658 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 635/1337] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:48 2022] GET /compute/v2.1/servers/1180ceb9-a888-4a3b-ba9d-a35afa8dc279 => generated 1269 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:48.298265 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-9af32600-1206-4748-b1e6-ba551a0e4f7a req-b39ea304-ce8b-47b3-a9c2-418df8cfd175 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04e9b262-d9e0-434a-bcbb-a85ef9180ee9", "name": "network-vif-plugged", "status": "completed", "tag": "ef809f4d-5127-48f1-a968-99867a38928e"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:35:48.334685 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-9af32600-1206-4748-b1e6-ba551a0e4f7a req-b39ea304-ce8b-47b3-a9c2-418df8cfd175 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:48.335007 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-9af32600-1206-4748-b1e6-ba551a0e4f7a req-b39ea304-ce8b-47b3-a9c2-418df8cfd175 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:48.335292 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-9af32600-1206-4748-b1e6-ba551a0e4f7a req-b39ea304-ce8b-47b3-a9c2-418df8cfd175 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:48.387090 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-9af32600-1206-4748-b1e6-ba551a0e4f7a req-b39ea304-ce8b-47b3-a9c2-418df8cfd175 service nova] Creating event network-vif-plugged:ef809f4d-5127-48f1-a968-99867a38928e for instance 04e9b262-d9e0-434a-bcbb-a85ef9180ee9 on n-h2-846463-3 Sep 23 04:35:48.397142 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-9af32600-1206-4748-b1e6-ba551a0e4f7a req-b39ea304-ce8b-47b3-a9c2-418df8cfd175 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101622 Sep 23 04:35:48.398005 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 636/1338] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:35:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:35:48.421355 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-84f67a76-6792-44d7-9a94-ff5bdcf55bed tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:48.422656 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-84f67a76-6792-44d7-9a94-ff5bdcf55bed tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] [instance: 1bf70366-2b4c-4df9-a6be-1c9145fb3862] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:48.437541 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-84f67a76-6792-44d7-9a94-ff5bdcf55bed tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:48.438343 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-84f67a76-6792-44d7-9a94-ff5bdcf55bed tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:48.438857 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-84f67a76-6792-44d7-9a94-ff5bdcf55bed tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:48.439657 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-84f67a76-6792-44d7-9a94-ff5bdcf55bed tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:48.440534 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-84f67a76-6792-44d7-9a94-ff5bdcf55bed tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:48.440975 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-84f67a76-6792-44d7-9a94-ff5bdcf55bed tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:48.626950 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-79cd9974-eff9-4246-9fe6-df32c9f013c7 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.153352 Sep 23 04:35:48.629534 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 703/1339] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:35:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1158 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:35:48.642855 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-43882a74-ede1-435a-921b-e2387d1e699b tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:48.642855 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-43882a74-ede1-435a-921b-e2387d1e699b tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: 04e9b262-d9e0-434a-bcbb-a85ef9180ee9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:48.644097 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-84f67a76-6792-44d7-9a94-ff5bdcf55bed tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a00bc3e62774185b48120832e80476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f931b8de0b4402a3833577fbb15607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:48.650885 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-43882a74-ede1-435a-921b-e2387d1e699b tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:48.651955 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-43882a74-ede1-435a-921b-e2387d1e699b tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:48.652806 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-43882a74-ede1-435a-921b-e2387d1e699b tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:48.653941 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-84f67a76-6792-44d7-9a94-ff5bdcf55bed tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] 10.222.0.33 "GET /compute/v2.1/servers/1bf70366-2b4c-4df9-a6be-1c9145fb3862" status: 200 len: 1316 microversion: 2.1 time: 0.253137 Sep 23 04:35:48.654509 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-43882a74-ede1-435a-921b-e2387d1e699b tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:48.654659 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 637/1340] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:48 2022] GET /compute/v2.1/servers/1bf70366-2b4c-4df9-a6be-1c9145fb3862 => generated 1316 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:48.655359 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-43882a74-ede1-435a-921b-e2387d1e699b tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:48.656657 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-43882a74-ede1-435a-921b-e2387d1e699b tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:48.660273 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e782ed0b-70f5-4c6b-b394-eb475786bc21 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:48.661092 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e782ed0b-70f5-4c6b-b394-eb475786bc21 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:48.721198 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e782ed0b-70f5-4c6b-b394-eb475786bc21 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:48.724726 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=29 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:35:48.731889 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e782ed0b-70f5-4c6b-b394-eb475786bc21 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea" status: 200 len: 1213 microversion: 2.1 time: 0.075701 Sep 23 04:35:48.733977 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 638/1341] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:48 2022] GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea => generated 1213 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:48.983143 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-52e23565-b30e-439a-ae3f-2c3e08a0fcfa req-a666233d-b2ee-4e5a-b377-c39409287ed5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "533efe90-e3aa-416f-a268-c7b779614c7e", "name": "network-vif-deleted", "tag": "93e66eb8-2bcd-48fd-905c-eb9ba724cd6e"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:35:49.019021 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-52e23565-b30e-439a-ae3f-2c3e08a0fcfa req-a666233d-b2ee-4e5a-b377-c39409287ed5 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:49.021607 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-52e23565-b30e-439a-ae3f-2c3e08a0fcfa req-a666233d-b2ee-4e5a-b377-c39409287ed5 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:49.022096 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-52e23565-b30e-439a-ae3f-2c3e08a0fcfa req-a666233d-b2ee-4e5a-b377-c39409287ed5 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:49.072375 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-52e23565-b30e-439a-ae3f-2c3e08a0fcfa req-a666233d-b2ee-4e5a-b377-c39409287ed5 service nova] Creating event network-vif-deleted:93e66eb8-2bcd-48fd-905c-eb9ba724cd6e for instance 533efe90-e3aa-416f-a268-c7b779614c7e on n-h2-846463-3 Sep 23 04:35:49.092579 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-52e23565-b30e-439a-ae3f-2c3e08a0fcfa req-a666233d-b2ee-4e5a-b377-c39409287ed5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113584 Sep 23 04:35:49.096867 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 639/1342] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:35:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:35:49.170675 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-17a114b5-50dd-4835-80a2-b85046dddb86 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:49.170675 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-17a114b5-50dd-4835-80a2-b85046dddb86 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] [instance: 533efe90-e3aa-416f-a268-c7b779614c7e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:49.170675 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-17a114b5-50dd-4835-80a2-b85046dddb86 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:49.170675 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-17a114b5-50dd-4835-80a2-b85046dddb86 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:49.172119 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-17a114b5-50dd-4835-80a2-b85046dddb86 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:49.172119 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-17a114b5-50dd-4835-80a2-b85046dddb86 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:49.172119 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-17a114b5-50dd-4835-80a2-b85046dddb86 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:49.177460 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-17a114b5-50dd-4835-80a2-b85046dddb86 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:49.348907 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-17a114b5-50dd-4835-80a2-b85046dddb86 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5d8ac586e04707acec235c122e5bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60d1259e4a2a4d07a7becd15aa8891bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:49.365624 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-17a114b5-50dd-4835-80a2-b85046dddb86 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] 10.222.0.33 "GET /compute/v2.1/servers/533efe90-e3aa-416f-a268-c7b779614c7e" status: 200 len: 1468 microversion: 2.1 time: 0.220330 Sep 23 04:35:49.378306 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 640/1343] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:49 2022] GET /compute/v2.1/servers/533efe90-e3aa-416f-a268-c7b779614c7e => generated 1468 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:49.384659 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-826f86e5-40e7-4fbb-a41a-e2af43428df8 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:49.384659 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-826f86e5-40e7-4fbb-a41a-e2af43428df8 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 1180ceb9-a888-4a3b-ba9d-a35afa8dc279] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:49.404262 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-826f86e5-40e7-4fbb-a41a-e2af43428df8 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:49.406033 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-826f86e5-40e7-4fbb-a41a-e2af43428df8 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:49.408799 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-826f86e5-40e7-4fbb-a41a-e2af43428df8 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:49.408799 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-826f86e5-40e7-4fbb-a41a-e2af43428df8 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:49.411837 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-826f86e5-40e7-4fbb-a41a-e2af43428df8 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:49.416713 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-826f86e5-40e7-4fbb-a41a-e2af43428df8 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:49.568251 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-826f86e5-40e7-4fbb-a41a-e2af43428df8 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:49.583061 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-826f86e5-40e7-4fbb-a41a-e2af43428df8 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/1180ceb9-a888-4a3b-ba9d-a35afa8dc279" status: 200 len: 1269 microversion: 2.1 time: 0.213416 Sep 23 04:35:49.584418 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 641/1344] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:49 2022] GET /compute/v2.1/servers/1180ceb9-a888-4a3b-ba9d-a35afa8dc279 => generated 1269 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:49.620064 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-43882a74-ede1-435a-921b-e2387d1e699b tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:49.630346 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-43882a74-ede1-435a-921b-e2387d1e699b tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9" status: 200 len: 1360 microversion: 2.1 time: 0.998830 Sep 23 04:35:49.638224 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 704/1345] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:48 2022] GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9 => generated 1360 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:49.678940 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4107b4a6-7000-4411-b2af-b21668139aaa tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:49.679964 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4107b4a6-7000-4411-b2af-b21668139aaa tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] [instance: 1bf70366-2b4c-4df9-a6be-1c9145fb3862] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:49.686654 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4107b4a6-7000-4411-b2af-b21668139aaa tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:49.687088 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4107b4a6-7000-4411-b2af-b21668139aaa tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:49.687551 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4107b4a6-7000-4411-b2af-b21668139aaa tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:49.688298 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4107b4a6-7000-4411-b2af-b21668139aaa tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:49.688755 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4107b4a6-7000-4411-b2af-b21668139aaa tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:49.689185 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4107b4a6-7000-4411-b2af-b21668139aaa tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:49.693581 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=100 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:35:49.758302 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8832913e-9994-4e5d-b441-6088b82795af tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:49.759067 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-8832913e-9994-4e5d-b441-6088b82795af tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:49.781625 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:35:49.896382 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-8832913e-9994-4e5d-b441-6088b82795af tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:49.908544 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-8832913e-9994-4e5d-b441-6088b82795af tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea" status: 200 len: 1213 microversion: 2.1 time: 0.154451 Sep 23 04:35:49.909631 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 705/1346] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:49 2022] GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea => generated 1213 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:35:50.056709 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4107b4a6-7000-4411-b2af-b21668139aaa tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a00bc3e62774185b48120832e80476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f931b8de0b4402a3833577fbb15607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:50.065421 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4107b4a6-7000-4411-b2af-b21668139aaa tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] 10.222.0.33 "GET /compute/v2.1/servers/1bf70366-2b4c-4df9-a6be-1c9145fb3862" status: 200 len: 1316 microversion: 2.1 time: 0.391486 Sep 23 04:35:50.081501 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 642/1347] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:49 2022] GET /compute/v2.1/servers/1bf70366-2b4c-4df9-a6be-1c9145fb3862 => generated 1316 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:50.393495 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-845749ca-9427-4830-9429-2301331e6a6f tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:50.394541 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-845749ca-9427-4830-9429-2301331e6a6f tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] [instance: 533efe90-e3aa-416f-a268-c7b779614c7e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:50.401860 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-845749ca-9427-4830-9429-2301331e6a6f tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:50.402409 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-845749ca-9427-4830-9429-2301331e6a6f tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:50.402869 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-845749ca-9427-4830-9429-2301331e6a6f tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:50.405188 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-845749ca-9427-4830-9429-2301331e6a6f tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:50.405908 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-845749ca-9427-4830-9429-2301331e6a6f tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:50.406553 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-845749ca-9427-4830-9429-2301331e6a6f tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:50.441103 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-39eccb1a-853d-4985-8a6c-edb1834dd993 req-d9ad1fc4-6ae0-4195-822d-602d739a4a11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbbf8d58-8edb-4172-9d19-4b82804bf8e9", "name": "network-vif-plugged", "status": "completed", "tag": "1a75583d-4990-40e9-876b-807baa271a68"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:35:50.461119 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-39eccb1a-853d-4985-8a6c-edb1834dd993 req-d9ad1fc4-6ae0-4195-822d-602d739a4a11 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:50.461942 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-39eccb1a-853d-4985-8a6c-edb1834dd993 req-d9ad1fc4-6ae0-4195-822d-602d739a4a11 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:50.462807 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-39eccb1a-853d-4985-8a6c-edb1834dd993 req-d9ad1fc4-6ae0-4195-822d-602d739a4a11 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:50.464567 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-845749ca-9427-4830-9429-2301331e6a6f tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:50.466517 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-845749ca-9427-4830-9429-2301331e6a6f tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:50.466981 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-845749ca-9427-4830-9429-2301331e6a6f tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:50.467443 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-845749ca-9427-4830-9429-2301331e6a6f tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Lazy-loading 'fault' on Instance uuid 533efe90-e3aa-416f-a268-c7b779614c7e {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:35:50.480999 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-39eccb1a-853d-4985-8a6c-edb1834dd993 req-d9ad1fc4-6ae0-4195-822d-602d739a4a11 service nova] Creating event network-vif-plugged:1a75583d-4990-40e9-876b-807baa271a68 for instance fbbf8d58-8edb-4172-9d19-4b82804bf8e9 on n-h2-846463-3 Sep 23 04:35:50.501148 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-39eccb1a-853d-4985-8a6c-edb1834dd993 req-d9ad1fc4-6ae0-4195-822d-602d739a4a11 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062783 Sep 23 04:35:50.502084 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 643/1348] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:35:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:35:50.579588 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-845749ca-9427-4830-9429-2301331e6a6f tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5d8ac586e04707acec235c122e5bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60d1259e4a2a4d07a7becd15aa8891bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:50.609798 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-677dfcbe-9dfd-494c-b99c-fbe2cc212581 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:50.611610 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-677dfcbe-9dfd-494c-b99c-fbe2cc212581 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 1180ceb9-a888-4a3b-ba9d-a35afa8dc279] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:50.620567 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-677dfcbe-9dfd-494c-b99c-fbe2cc212581 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:50.621363 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-677dfcbe-9dfd-494c-b99c-fbe2cc212581 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:50.622007 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-677dfcbe-9dfd-494c-b99c-fbe2cc212581 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:50.622920 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-845749ca-9427-4830-9429-2301331e6a6f tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] 10.222.0.33 "GET /compute/v2.1/servers/533efe90-e3aa-416f-a268-c7b779614c7e" status: 200 len: 1305 microversion: 2.1 time: 0.234544 Sep 23 04:35:50.623638 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-677dfcbe-9dfd-494c-b99c-fbe2cc212581 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:50.623979 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 706/1349] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:50 2022] GET /compute/v2.1/servers/533efe90-e3aa-416f-a268-c7b779614c7e => generated 1305 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:50.624542 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-677dfcbe-9dfd-494c-b99c-fbe2cc212581 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:50.625111 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-677dfcbe-9dfd-494c-b99c-fbe2cc212581 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:50.665482 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a9d70fe2-0db1-4413-ae7c-4eca67e134cc tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:50.666242 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a9d70fe2-0db1-4413-ae7c-4eca67e134cc tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: 04e9b262-d9e0-434a-bcbb-a85ef9180ee9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:50.679232 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a9d70fe2-0db1-4413-ae7c-4eca67e134cc tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:50.682710 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a9d70fe2-0db1-4413-ae7c-4eca67e134cc tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:50.683976 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a9d70fe2-0db1-4413-ae7c-4eca67e134cc tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:50.687487 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a9d70fe2-0db1-4413-ae7c-4eca67e134cc tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:50.688832 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a9d70fe2-0db1-4413-ae7c-4eca67e134cc tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:50.691099 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a9d70fe2-0db1-4413-ae7c-4eca67e134cc tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:50.709028 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-677dfcbe-9dfd-494c-b99c-fbe2cc212581 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:50.718204 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-677dfcbe-9dfd-494c-b99c-fbe2cc212581 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/1180ceb9-a888-4a3b-ba9d-a35afa8dc279" status: 200 len: 1287 microversion: 2.1 time: 0.113111 Sep 23 04:35:50.718817 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 644/1350] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:50 2022] GET /compute/v2.1/servers/1180ceb9-a888-4a3b-ba9d-a35afa8dc279 => generated 1287 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:35:50.933603 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e4f3effa-6b8c-41e3-90e1-beb66b6ab947 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:50.934251 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e4f3effa-6b8c-41e3-90e1-beb66b6ab947 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:50.940839 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e4f3effa-6b8c-41e3-90e1-beb66b6ab947 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:50.941576 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e4f3effa-6b8c-41e3-90e1-beb66b6ab947 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:50.942245 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e4f3effa-6b8c-41e3-90e1-beb66b6ab947 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:50.942933 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e4f3effa-6b8c-41e3-90e1-beb66b6ab947 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:50.943543 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e4f3effa-6b8c-41e3-90e1-beb66b6ab947 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:50.943985 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e4f3effa-6b8c-41e3-90e1-beb66b6ab947 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:50.994534 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a9d70fe2-0db1-4413-ae7c-4eca67e134cc tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:51.007636 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a9d70fe2-0db1-4413-ae7c-4eca67e134cc tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9" status: 200 len: 1544 microversion: 2.1 time: 0.345317 Sep 23 04:35:51.017975 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e4f3effa-6b8c-41e3-90e1-beb66b6ab947 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:51.026389 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e4f3effa-6b8c-41e3-90e1-beb66b6ab947 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea" status: 200 len: 1217 microversion: 2.1 time: 0.091970 Sep 23 04:35:51.026389 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 645/1351] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:50 2022] GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea => generated 1217 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:51.030483 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 707/1352] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:50 2022] GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9 => generated 1544 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:51.035849 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3f4e0be5-55a2-47d2-8f78-731e76c6a8d3 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:51.036378 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3f4e0be5-55a2-47d2-8f78-731e76c6a8d3 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: 04e9b262-d9e0-434a-bcbb-a85ef9180ee9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:51.048592 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3f4e0be5-55a2-47d2-8f78-731e76c6a8d3 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:51.049081 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3f4e0be5-55a2-47d2-8f78-731e76c6a8d3 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:51.049528 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3f4e0be5-55a2-47d2-8f78-731e76c6a8d3 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:51.050302 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3f4e0be5-55a2-47d2-8f78-731e76c6a8d3 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:51.050769 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3f4e0be5-55a2-47d2-8f78-731e76c6a8d3 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:51.051199 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3f4e0be5-55a2-47d2-8f78-731e76c6a8d3 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:51.090633 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-138eb79a-72f9-4cbc-9f76-66145bfe3654 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:51.094189 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-138eb79a-72f9-4cbc-9f76-66145bfe3654 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] [instance: 1bf70366-2b4c-4df9-a6be-1c9145fb3862] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:51.105749 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-138eb79a-72f9-4cbc-9f76-66145bfe3654 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:51.106729 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-138eb79a-72f9-4cbc-9f76-66145bfe3654 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:51.107435 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-138eb79a-72f9-4cbc-9f76-66145bfe3654 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:51.108391 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-138eb79a-72f9-4cbc-9f76-66145bfe3654 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:51.109004 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-138eb79a-72f9-4cbc-9f76-66145bfe3654 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:51.109674 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-138eb79a-72f9-4cbc-9f76-66145bfe3654 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:51.139407 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:35:51.217956 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3f4e0be5-55a2-47d2-8f78-731e76c6a8d3 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.186035 Sep 23 04:35:51.219097 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 646/1353] 10.222.0.33 () {58 vars in 1275 bytes} [Fri Sep 23 04:35:51 2022] GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9/os-interface => generated 285 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:35:51.473860 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-138eb79a-72f9-4cbc-9f76-66145bfe3654 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a00bc3e62774185b48120832e80476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f931b8de0b4402a3833577fbb15607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:51.482023 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-138eb79a-72f9-4cbc-9f76-66145bfe3654 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] 10.222.0.33 "GET /compute/v2.1/servers/1bf70366-2b4c-4df9-a6be-1c9145fb3862" status: 200 len: 1316 microversion: 2.1 time: 0.396656 Sep 23 04:35:51.485930 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 708/1354] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:51 2022] GET /compute/v2.1/servers/1bf70366-2b4c-4df9-a6be-1c9145fb3862 => generated 1316 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:51.650691 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-955a8b9a-8f92-482d-9c57-13039a47f84d tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:51.650691 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-955a8b9a-8f92-482d-9c57-13039a47f84d tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] [instance: 533efe90-e3aa-416f-a268-c7b779614c7e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:51.668812 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-955a8b9a-8f92-482d-9c57-13039a47f84d tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:51.670105 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-955a8b9a-8f92-482d-9c57-13039a47f84d tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:51.672043 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-955a8b9a-8f92-482d-9c57-13039a47f84d tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:51.674034 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-955a8b9a-8f92-482d-9c57-13039a47f84d tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:51.676093 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-955a8b9a-8f92-482d-9c57-13039a47f84d tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:51.676588 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-955a8b9a-8f92-482d-9c57-13039a47f84d tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:51.743540 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ddef5f00-a2fb-4b28-83e7-ab6205b4883f tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:51.744142 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ddef5f00-a2fb-4b28-83e7-ab6205b4883f tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 1180ceb9-a888-4a3b-ba9d-a35afa8dc279] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:51.751520 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ddef5f00-a2fb-4b28-83e7-ab6205b4883f tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:51.752027 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ddef5f00-a2fb-4b28-83e7-ab6205b4883f tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:51.752466 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ddef5f00-a2fb-4b28-83e7-ab6205b4883f tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:51.753177 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ddef5f00-a2fb-4b28-83e7-ab6205b4883f tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:51.753636 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ddef5f00-a2fb-4b28-83e7-ab6205b4883f tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:51.754139 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-955a8b9a-8f92-482d-9c57-13039a47f84d tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:51.754847 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-955a8b9a-8f92-482d-9c57-13039a47f84d tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:51.759005 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-955a8b9a-8f92-482d-9c57-13039a47f84d tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:51.759579 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-955a8b9a-8f92-482d-9c57-13039a47f84d tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Lazy-loading 'fault' on Instance uuid 533efe90-e3aa-416f-a268-c7b779614c7e {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:35:51.759783 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ddef5f00-a2fb-4b28-83e7-ab6205b4883f tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:51.961714 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-955a8b9a-8f92-482d-9c57-13039a47f84d tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5d8ac586e04707acec235c122e5bac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60d1259e4a2a4d07a7becd15aa8891bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:51.975813 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-955a8b9a-8f92-482d-9c57-13039a47f84d tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] 10.222.0.33 "GET /compute/v2.1/servers/533efe90-e3aa-416f-a268-c7b779614c7e" status: 200 len: 1305 microversion: 2.1 time: 0.331893 Sep 23 04:35:51.995424 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 647/1355] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:51 2022] GET /compute/v2.1/servers/533efe90-e3aa-416f-a268-c7b779614c7e => generated 1305 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:51.999802 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ddef5f00-a2fb-4b28-83e7-ab6205b4883f tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:52.010675 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ddef5f00-a2fb-4b28-83e7-ab6205b4883f tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/1180ceb9-a888-4a3b-ba9d-a35afa8dc279" status: 200 len: 1275 microversion: 2.1 time: 0.271923 Sep 23 04:35:52.013899 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 709/1356] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:51 2022] GET /compute/v2.1/servers/1180ceb9-a888-4a3b-ba9d-a35afa8dc279 => generated 1275 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:35:52.044814 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-364cb666-2ff3-443e-b9cf-1c62c4b68501 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:52.045792 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-364cb666-2ff3-443e-b9cf-1c62c4b68501 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:52.059745 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-364cb666-2ff3-443e-b9cf-1c62c4b68501 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:52.060262 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-364cb666-2ff3-443e-b9cf-1c62c4b68501 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:52.063615 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-364cb666-2ff3-443e-b9cf-1c62c4b68501 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:52.064610 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-364cb666-2ff3-443e-b9cf-1c62c4b68501 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:52.066060 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-364cb666-2ff3-443e-b9cf-1c62c4b68501 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:52.066704 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-364cb666-2ff3-443e-b9cf-1c62c4b68501 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:52.193940 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-364cb666-2ff3-443e-b9cf-1c62c4b68501 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:52.203438 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-364cb666-2ff3-443e-b9cf-1c62c4b68501 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea" status: 200 len: 1265 microversion: 2.1 time: 0.162469 Sep 23 04:35:52.225663 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 648/1357] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:52 2022] GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea => generated 1265 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:52.526423 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d85e7a83-681c-42da-8e20-04dc988bc4a4 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:52.531278 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d85e7a83-681c-42da-8e20-04dc988bc4a4 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] [instance: 1bf70366-2b4c-4df9-a6be-1c9145fb3862] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:52.545068 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d85e7a83-681c-42da-8e20-04dc988bc4a4 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:52.547332 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d85e7a83-681c-42da-8e20-04dc988bc4a4 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:52.548592 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d85e7a83-681c-42da-8e20-04dc988bc4a4 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:52.550375 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d85e7a83-681c-42da-8e20-04dc988bc4a4 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:52.551187 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d85e7a83-681c-42da-8e20-04dc988bc4a4 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:52.551849 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d85e7a83-681c-42da-8e20-04dc988bc4a4 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:52.788031 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d85e7a83-681c-42da-8e20-04dc988bc4a4 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a00bc3e62774185b48120832e80476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f931b8de0b4402a3833577fbb15607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:52.800991 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d85e7a83-681c-42da-8e20-04dc988bc4a4 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] 10.222.0.33 "GET /compute/v2.1/servers/1bf70366-2b4c-4df9-a6be-1c9145fb3862" status: 200 len: 1316 microversion: 2.1 time: 0.290428 Sep 23 04:35:52.814961 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 710/1358] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:52 2022] GET /compute/v2.1/servers/1bf70366-2b4c-4df9-a6be-1c9145fb3862 => generated 1316 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:53.004302 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f1817d7d-4f8f-4984-97a6-222291ee8723 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:53.006829 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f1817d7d-4f8f-4984-97a6-222291ee8723 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] [instance: 533efe90-e3aa-416f-a268-c7b779614c7e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:53.025109 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f1817d7d-4f8f-4984-97a6-222291ee8723 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:53.025627 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f1817d7d-4f8f-4984-97a6-222291ee8723 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:53.026114 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f1817d7d-4f8f-4984-97a6-222291ee8723 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:53.026839 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f1817d7d-4f8f-4984-97a6-222291ee8723 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:53.027355 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f1817d7d-4f8f-4984-97a6-222291ee8723 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:53.028992 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f1817d7d-4f8f-4984-97a6-222291ee8723 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:53.042957 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-05d11d27-d4c0-47e3-aed6-dad868a35877 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:53.043646 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-05d11d27-d4c0-47e3-aed6-dad868a35877 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 1180ceb9-a888-4a3b-ba9d-a35afa8dc279] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:53.059667 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-05d11d27-d4c0-47e3-aed6-dad868a35877 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:53.060652 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-05d11d27-d4c0-47e3-aed6-dad868a35877 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:53.061337 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-05d11d27-d4c0-47e3-aed6-dad868a35877 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:53.063214 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-05d11d27-d4c0-47e3-aed6-dad868a35877 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:53.064111 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-f1817d7d-4f8f-4984-97a6-222291ee8723 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] HTTP exception thrown: Instance 533efe90-e3aa-416f-a268-c7b779614c7e could not be found. Sep 23 04:35:53.064728 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-05d11d27-d4c0-47e3-aed6-dad868a35877 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:53.065276 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-05d11d27-d4c0-47e3-aed6-dad868a35877 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:53.071711 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f1817d7d-4f8f-4984-97a6-222291ee8723 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Request method failure captured: Sep 23 04:35:53.071711 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/533efe90-e3aa-416f-a268-c7b779614c7e HTTP/1.1 Sep 23 04:35:53.071711 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:35:53.071711 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:35:53.071711 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:35:53.071711 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:35:53.071711 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:35:53.071711 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:35:53.071711 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:35:53.071711 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:35:53.071711 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTeJaWO8azzpbc8RyNeBjxxmQMfqP0e0wNpeoAFytRn44rs_E_MzI9MKBAKEAncJI1hSh49Fj4sMPAL8j4aNf5WyWfH2fqRmVgui2fEpno2T-c6p0krcD8RyK0PRmDZ4OSY4n3ZQ4XhhqOLlMDbaQ2S3SzCl2SqteHtX-iNXgmkshWM Sep 23 04:35:53.071711 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:35:53.071711 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:35:53.071711 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:35:53.071711 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:35:53.071711 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:35:53.071711 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:35:53.071711 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 60d1259e4a2a4d07a7becd15aa8891bd Sep 23 04:35:53.071711 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ImagesNegativeTestJSON-1836855650 Sep 23 04:35:53.071711 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:35:53.071711 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:35:53.073579 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_60d1259e4a2a4d07a7becd15aa8891bd", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/60d1259e4a2a4d07a7becd15aa8891bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/60d1259e4a2a4d07a7becd15aa8891bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/60d1259e4a2a4d07a7becd15aa8891bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:35:53.073579 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ImagesNegativeTestJSON-1836855650 Sep 23 04:35:53.073579 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 60d1259e4a2a4d07a7becd15aa8891bd Sep 23 04:35:53.073579 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1836855650 Sep 23 04:35:53.073579 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ImagesNegativeTestJSON-1836855650-project Sep 23 04:35:53.073579 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:35:53.073579 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:35:53.073579 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: ef5d8ac586e04707acec235c122e5bac Sep 23 04:35:53.073579 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ImagesNegativeTestJSON-1836855650-project Sep 23 04:35:53.073579 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:35:53.073579 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 533efe90-e3aa-416f-a268-c7b779614c7e could not be found. Sep 23 04:35:53.073579 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '533efe90-e3aa-416f-a268-c7b779614c7e'} Sep 23 04:35:53.078480 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:35:53.078480 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:35:53.078480 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:35:53.078480 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:35:53.078480 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:35:53.078480 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:35:53.078480 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:35:53.078480 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:35:53.078480 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:35:53.078480 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:35:53.078480 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 533efe90-e3aa-416f-a268-c7b779614c7e could not be found. Sep 23 04:35:53.078480 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:35:53.078480 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:35:53.078480 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:35:53.078480 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:35:53.078480 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:35:53.078480 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:35:53.078480 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:35:53.078480 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:35:53.078480 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:35:53.080606 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:35:53.080606 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:35:53.080606 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:35:53.080606 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:35:53.080606 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:35:53.080606 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:35:53.080606 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:35:53.080606 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 533efe90-e3aa-416f-a268-c7b779614c7e could not be found. Sep 23 04:35:53.080606 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:35:53.080606 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:35:53.080606 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:35:53.080606 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:35:53.080606 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:35:53.080606 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:35:53.080606 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:35:53.080606 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:35:53.080606 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 533efe90-e3aa-416f-a268-c7b779614c7e could not be found. Sep 23 04:35:53.080606 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:35:53.082083 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f1817d7d-4f8f-4984-97a6-222291ee8723 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Returning 404 to user: Instance 533efe90-e3aa-416f-a268-c7b779614c7e could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:35:53.082083 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f1817d7d-4f8f-4984-97a6-222291ee8723 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] 10.222.0.33 "GET /compute/v2.1/servers/533efe90-e3aa-416f-a268-c7b779614c7e" status: 404 len: 111 microversion: 2.1 time: 0.073246 Sep 23 04:35:53.082083 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 649/1359] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:52 2022] GET /compute/v2.1/servers/533efe90-e3aa-416f-a268-c7b779614c7e => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:35:53.083249 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7f7263ad-2206-4792-8fc9-9d9672039aac tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1969958039", "metadata": {"image_type": "test"}}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:35:53.094452 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7f7263ad-2206-4792-8fc9-9d9672039aac tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] [instance: 533efe90-e3aa-416f-a268-c7b779614c7e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:53.105175 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7f7263ad-2206-4792-8fc9-9d9672039aac tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:53.105536 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7f7263ad-2206-4792-8fc9-9d9672039aac tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:53.106013 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7f7263ad-2206-4792-8fc9-9d9672039aac tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:53.106831 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7f7263ad-2206-4792-8fc9-9d9672039aac tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:53.107369 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7f7263ad-2206-4792-8fc9-9d9672039aac tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:53.107800 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7f7263ad-2206-4792-8fc9-9d9672039aac tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:53.159566 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-7f7263ad-2206-4792-8fc9-9d9672039aac tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] HTTP exception thrown: Instance 533efe90-e3aa-416f-a268-c7b779614c7e could not be found. Sep 23 04:35:53.161348 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7f7263ad-2206-4792-8fc9-9d9672039aac tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Request method failure captured: Sep 23 04:35:53.161348 n-d-846463-3 devstack@n-api.service[122698]: request: POST /compute/v2.1/servers/533efe90-e3aa-416f-a268-c7b779614c7e/action HTTP/1.1 Sep 23 04:35:53.161348 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:35:53.161348 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:35:53.161348 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:35:53.161348 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 112 Sep 23 04:35:53.161348 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:35:53.161348 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:35:53.161348 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:35:53.161348 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:35:53.161348 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTeJaWO8azzpbc8RyNeBjxxmQMfqP0e0wNpeoAFytRn44rs_E_MzI9MKBAKEAncJI1hSh49Fj4sMPAL8j4aNf5WyWfH2fqRmVgui2fEpno2T-c6p0krcD8RyK0PRmDZ4OSY4n3ZQ4XhhqOLlMDbaQ2S3SzCl2SqteHtX-iNXgmkshWM Sep 23 04:35:53.161348 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:35:53.161348 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:35:53.161348 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:35:53.161348 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:35:53.161348 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:35:53.161348 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:35:53.161348 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 60d1259e4a2a4d07a7becd15aa8891bd Sep 23 04:35:53.161348 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ImagesNegativeTestJSON-1836855650 Sep 23 04:35:53.161348 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:35:53.161348 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:35:53.162997 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_60d1259e4a2a4d07a7becd15aa8891bd", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/60d1259e4a2a4d07a7becd15aa8891bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/60d1259e4a2a4d07a7becd15aa8891bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/60d1259e4a2a4d07a7becd15aa8891bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:35:53.162997 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ImagesNegativeTestJSON-1836855650 Sep 23 04:35:53.162997 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 60d1259e4a2a4d07a7becd15aa8891bd Sep 23 04:35:53.162997 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1836855650 Sep 23 04:35:53.162997 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ImagesNegativeTestJSON-1836855650-project Sep 23 04:35:53.162997 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:35:53.162997 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:35:53.162997 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: ef5d8ac586e04707acec235c122e5bac Sep 23 04:35:53.162997 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ImagesNegativeTestJSON-1836855650-project Sep 23 04:35:53.162997 n-d-846463-3 devstack@n-api.service[122698]: Sep 23 04:35:53.162997 n-d-846463-3 devstack@n-api.service[122698]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1969958039", "metadata": {"image_type": "test"}}} Sep 23 04:35:53.162997 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:35:53.164459 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 533efe90-e3aa-416f-a268-c7b779614c7e could not be found. Sep 23 04:35:53.164459 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '533efe90-e3aa-416f-a268-c7b779614c7e', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1969958039', 'metadata': {'image_type': 'test'}}}} Sep 23 04:35:53.164459 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:35:53.164459 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:35:53.164459 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:35:53.164459 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:35:53.164459 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:35:53.164459 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:35:53.164459 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:35:53.164459 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:35:53.164459 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:35:53.164459 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:35:53.164459 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 533efe90-e3aa-416f-a268-c7b779614c7e could not be found. Sep 23 04:35:53.164459 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:35:53.164459 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:35:53.164459 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:35:53.164459 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:35:53.164459 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:35:53.164459 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:35:53.165883 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:35:53.165883 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:35:53.165883 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:35:53.165883 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:35:53.165883 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:35:53.165883 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:35:53.165883 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:35:53.165883 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:35:53.165883 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Sep 23 04:35:53.165883 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 23 04:35:53.165883 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:35:53.165883 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:35:53.165883 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:35:53.165883 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:35:53.165883 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 533efe90-e3aa-416f-a268-c7b779614c7e could not be found. Sep 23 04:35:53.165883 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:35:53.165883 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:35:53.165883 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:35:53.165883 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:35:53.165883 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:35:53.167530 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:35:53.167530 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:35:53.167530 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:35:53.167530 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 533efe90-e3aa-416f-a268-c7b779614c7e could not be found. Sep 23 04:35:53.167530 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:35:53.178955 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7f7263ad-2206-4792-8fc9-9d9672039aac tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Returning 404 to user: Instance 533efe90-e3aa-416f-a268-c7b779614c7e could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:35:53.180408 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7f7263ad-2206-4792-8fc9-9d9672039aac tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] 10.222.0.33 "POST /compute/v2.1/servers/533efe90-e3aa-416f-a268-c7b779614c7e/action" status: 404 len: 111 microversion: 2.1 time: 0.100916 Sep 23 04:35:53.182656 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 650/1360] 10.222.0.33 () {60 vars in 1279 bytes} [Fri Sep 23 04:35:53 2022] POST /compute/v2.1/servers/533efe90-e3aa-416f-a268-c7b779614c7e/action => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 04:35:53.196762 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-05799b07-72ef-416e-808e-87fe457d718f tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1851048349", "metadata": {"image_type": "test"}}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:35:53.201174 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-05799b07-72ef-416e-808e-87fe457d718f tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Failed to fetch instance by id tempest-invalid-1583708471 {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 23 04:35:53.201174 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-05799b07-72ef-416e-808e-87fe457d718f tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] HTTP exception thrown: Instance tempest-invalid-1583708471 could not be found. Sep 23 04:35:53.201382 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-05799b07-72ef-416e-808e-87fe457d718f tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Request method failure captured: Sep 23 04:35:53.201382 n-d-846463-3 devstack@n-api.service[122698]: request: POST /compute/v2.1/servers/tempest-invalid-1583708471/action HTTP/1.1 Sep 23 04:35:53.201382 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:35:53.201382 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:35:53.201382 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:35:53.201382 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 112 Sep 23 04:35:53.201382 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:35:53.201382 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:35:53.201382 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:35:53.201382 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:35:53.201382 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTeJaWO8azzpbc8RyNeBjxxmQMfqP0e0wNpeoAFytRn44rs_E_MzI9MKBAKEAncJI1hSh49Fj4sMPAL8j4aNf5WyWfH2fqRmVgui2fEpno2T-c6p0krcD8RyK0PRmDZ4OSY4n3ZQ4XhhqOLlMDbaQ2S3SzCl2SqteHtX-iNXgmkshWM Sep 23 04:35:53.201382 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:35:53.201382 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:35:53.201382 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:35:53.201382 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:35:53.201382 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:35:53.201382 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:35:53.201382 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 60d1259e4a2a4d07a7becd15aa8891bd Sep 23 04:35:53.201382 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ImagesNegativeTestJSON-1836855650 Sep 23 04:35:53.201382 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:35:53.201382 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:35:53.203097 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_60d1259e4a2a4d07a7becd15aa8891bd", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/60d1259e4a2a4d07a7becd15aa8891bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/60d1259e4a2a4d07a7becd15aa8891bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/60d1259e4a2a4d07a7becd15aa8891bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:35:53.203097 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ImagesNegativeTestJSON-1836855650 Sep 23 04:35:53.203097 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 60d1259e4a2a4d07a7becd15aa8891bd Sep 23 04:35:53.203097 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1836855650 Sep 23 04:35:53.203097 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ImagesNegativeTestJSON-1836855650-project Sep 23 04:35:53.203097 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:35:53.203097 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:35:53.203097 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: ef5d8ac586e04707acec235c122e5bac Sep 23 04:35:53.203097 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ImagesNegativeTestJSON-1836855650-project Sep 23 04:35:53.203097 n-d-846463-3 devstack@n-api.service[122698]: Sep 23 04:35:53.203097 n-d-846463-3 devstack@n-api.service[122698]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1851048349", "metadata": {"image_type": "test"}}} Sep 23 04:35:53.203097 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:35:53.203999 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance tempest-invalid-1583708471 could not be found. Sep 23 04:35:53.203999 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': 'tempest-invalid-1583708471', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1851048349', 'metadata': {'image_type': 'test'}}}} Sep 23 04:35:53.203999 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:35:53.203999 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:35:53.203999 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:35:53.203999 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:35:53.203999 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 23 04:35:53.203999 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 23 04:35:53.203999 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-1583708471 could not be found. Sep 23 04:35:53.203999 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:35:53.203999 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:35:53.203999 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:35:53.203999 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:35:53.203999 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:35:53.203999 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:35:53.203999 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:35:53.203999 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:35:53.203999 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:35:53.203999 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:35:53.203999 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:35:53.206919 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:35:53.206919 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:35:53.206919 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:35:53.206919 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Sep 23 04:35:53.206919 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 23 04:35:53.206919 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:35:53.206919 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:35:53.206919 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:35:53.206919 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:35:53.206919 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-1583708471 could not be found. Sep 23 04:35:53.206919 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:35:53.206919 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:35:53.206919 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:35:53.206919 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:35:53.206919 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:35:53.206919 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:35:53.206919 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:35:53.206919 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:35:53.206919 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-1583708471 could not be found. Sep 23 04:35:53.206919 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:35:53.208479 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-05799b07-72ef-416e-808e-87fe457d718f tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Returning 404 to user: Instance tempest-invalid-1583708471 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:35:53.208479 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-05799b07-72ef-416e-808e-87fe457d718f tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] 10.222.0.33 "POST /compute/v2.1/servers/tempest-invalid-1583708471/action" status: 404 len: 101 microversion: 2.1 time: 0.010036 Sep 23 04:35:53.208479 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 651/1361] 10.222.0.33 () {60 vars in 1249 bytes} [Fri Sep 23 04:35:53 2022] POST /compute/v2.1/servers/tempest-invalid-1583708471/action => generated 101 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 04:35:53.219640 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5c2f5115-47ca-465f-9104-ba2aefa933d7 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-915461597"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:35:53.236166 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5c2f5115-47ca-465f-9104-ba2aefa933d7 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 23 04:35:53.236701 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-5c2f5115-47ca-465f-9104-ba2aefa933d7 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 23 04:35:53.244732 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5c2f5115-47ca-465f-9104-ba2aefa933d7 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Request method failure captured: Sep 23 04:35:53.244732 n-d-846463-3 devstack@n-api.service[122698]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Sep 23 04:35:53.244732 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:35:53.244732 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:35:53.244732 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:35:53.244732 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 56 Sep 23 04:35:53.244732 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:35:53.244732 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:35:53.244732 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:35:53.244732 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:35:53.244732 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTeJaWO8azzpbc8RyNeBjxxmQMfqP0e0wNpeoAFytRn44rs_E_MzI9MKBAKEAncJI1hSh49Fj4sMPAL8j4aNf5WyWfH2fqRmVgui2fEpno2T-c6p0krcD8RyK0PRmDZ4OSY4n3ZQ4XhhqOLlMDbaQ2S3SzCl2SqteHtX-iNXgmkshWM Sep 23 04:35:53.244732 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:35:53.244732 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:35:53.244732 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:35:53.244732 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:35:53.244732 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:35:53.244732 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:35:53.244732 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 60d1259e4a2a4d07a7becd15aa8891bd Sep 23 04:35:53.244732 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ImagesNegativeTestJSON-1836855650 Sep 23 04:35:53.244732 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:35:53.244732 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:35:53.246540 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_60d1259e4a2a4d07a7becd15aa8891bd", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/60d1259e4a2a4d07a7becd15aa8891bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/60d1259e4a2a4d07a7becd15aa8891bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/60d1259e4a2a4d07a7becd15aa8891bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:35:53.246540 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ImagesNegativeTestJSON-1836855650 Sep 23 04:35:53.246540 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 60d1259e4a2a4d07a7becd15aa8891bd Sep 23 04:35:53.246540 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1836855650 Sep 23 04:35:53.246540 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ImagesNegativeTestJSON-1836855650-project Sep 23 04:35:53.246540 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:35:53.246540 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:35:53.246540 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: ef5d8ac586e04707acec235c122e5bac Sep 23 04:35:53.246540 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ImagesNegativeTestJSON-1836855650-project Sep 23 04:35:53.246540 n-d-846463-3 devstack@n-api.service[122698]: Sep 23 04:35:53.246540 n-d-846463-3 devstack@n-api.service[122698]: {"createImage": {"name": "tempest-test-snap-915461597"}} Sep 23 04:35:53.246540 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:35:53.246540 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 23 04:35:53.247387 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-915461597'}}} Sep 23 04:35:53.247387 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:35:53.247387 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:35:53.247387 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:35:53.247387 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:35:53.247387 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 23 04:35:53.247387 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 23 04:35:53.247387 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 23 04:35:53.247387 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:35:53.247387 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:35:53.247387 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:35:53.247387 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:35:53.247387 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:35:53.247387 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:35:53.247387 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:35:53.247387 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:35:53.247387 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:35:53.247387 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:35:53.247387 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:35:53.247387 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:35:53.248670 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:35:53.248670 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:35:53.248670 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Sep 23 04:35:53.248670 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 23 04:35:53.248670 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:35:53.248670 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:35:53.248670 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:35:53.248670 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:35:53.248670 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 23 04:35:53.248670 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:35:53.248670 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:35:53.248670 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:35:53.248670 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:35:53.248670 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:35:53.248670 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:35:53.248670 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:35:53.248670 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:35:53.248670 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 23 04:35:53.248670 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:35:53.253063 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5c2f5115-47ca-465f-9104-ba2aefa933d7 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:35:53.253063 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5c2f5115-47ca-465f-9104-ba2aefa933d7 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] 10.222.0.33 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.034130 Sep 23 04:35:53.253063 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 652/1362] 10.222.0.33 () {60 vars in 1275 bytes} [Fri Sep 23 04:35:53 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:35:53.256236 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-f6f3f854-5cb1-4ec1-a235-5e8f1f0cd2fd req-7d2aa040-eae5-4413-b04b-75c9a87701fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bf70366-2b4c-4df9-a6be-1c9145fb3862", "name": "network-vif-plugged", "status": "completed", "tag": "c99566be-c1ff-41dd-9148-37f8e480c982"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:35:53.281910 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-f6f3f854-5cb1-4ec1-a235-5e8f1f0cd2fd req-7d2aa040-eae5-4413-b04b-75c9a87701fc service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:53.282421 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-f6f3f854-5cb1-4ec1-a235-5e8f1f0cd2fd req-7d2aa040-eae5-4413-b04b-75c9a87701fc service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:53.282868 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-f6f3f854-5cb1-4ec1-a235-5e8f1f0cd2fd req-7d2aa040-eae5-4413-b04b-75c9a87701fc service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:53.300771 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-f6f3f854-5cb1-4ec1-a235-5e8f1f0cd2fd req-7d2aa040-eae5-4413-b04b-75c9a87701fc service nova] Creating event network-vif-plugged:c99566be-c1ff-41dd-9148-37f8e480c982 for instance 1bf70366-2b4c-4df9-a6be-1c9145fb3862 on n-h1-846463-3 Sep 23 04:35:53.311945 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-f6f3f854-5cb1-4ec1-a235-5e8f1f0cd2fd req-7d2aa040-eae5-4413-b04b-75c9a87701fc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060535 Sep 23 04:35:53.319022 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 653/1363] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:35:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:35:53.337615 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-de624761-352e-4db2-90fb-b03efee5a12b tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:53.338491 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-de624761-352e-4db2-90fb-b03efee5a12b tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:53.344290 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:35:53.346000 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-de624761-352e-4db2-90fb-b03efee5a12b tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:53.346512 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-de624761-352e-4db2-90fb-b03efee5a12b tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:53.346957 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-de624761-352e-4db2-90fb-b03efee5a12b tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:53.347691 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-de624761-352e-4db2-90fb-b03efee5a12b tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:53.348162 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-de624761-352e-4db2-90fb-b03efee5a12b tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:53.348591 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-de624761-352e-4db2-90fb-b03efee5a12b tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:53.637594 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-de624761-352e-4db2-90fb-b03efee5a12b tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:53.651894 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-de624761-352e-4db2-90fb-b03efee5a12b tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea" status: 200 len: 1273 microversion: 2.1 time: 0.331422 Sep 23 04:35:53.653796 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 654/1364] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:53 2022] GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea => generated 1273 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:53.665088 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4b6086b0-160a-469e-9ef9-6aea2d202044 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-251047207"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:35:53.668657 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4b6086b0-160a-469e-9ef9-6aea2d202044 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 23 04:35:53.669229 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-4b6086b0-160a-469e-9ef9-6aea2d202044 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 23 04:35:53.671920 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4b6086b0-160a-469e-9ef9-6aea2d202044 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Request method failure captured: Sep 23 04:35:53.671920 n-d-846463-3 devstack@n-api.service[122698]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Sep 23 04:35:53.671920 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:35:53.671920 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:35:53.671920 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:35:53.671920 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 56 Sep 23 04:35:53.671920 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:35:53.671920 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:35:53.671920 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:35:53.671920 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:35:53.671920 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTeJaWO8azzpbc8RyNeBjxxmQMfqP0e0wNpeoAFytRn44rs_E_MzI9MKBAKEAncJI1hSh49Fj4sMPAL8j4aNf5WyWfH2fqRmVgui2fEpno2T-c6p0krcD8RyK0PRmDZ4OSY4n3ZQ4XhhqOLlMDbaQ2S3SzCl2SqteHtX-iNXgmkshWM Sep 23 04:35:53.671920 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:35:53.671920 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:35:53.671920 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:35:53.671920 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:35:53.671920 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:35:53.671920 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:35:53.671920 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 60d1259e4a2a4d07a7becd15aa8891bd Sep 23 04:35:53.671920 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ImagesNegativeTestJSON-1836855650 Sep 23 04:35:53.671920 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:35:53.671920 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:35:53.676807 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_60d1259e4a2a4d07a7becd15aa8891bd", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/60d1259e4a2a4d07a7becd15aa8891bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/60d1259e4a2a4d07a7becd15aa8891bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/60d1259e4a2a4d07a7becd15aa8891bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:35:53.676807 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ImagesNegativeTestJSON-1836855650 Sep 23 04:35:53.676807 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 60d1259e4a2a4d07a7becd15aa8891bd Sep 23 04:35:53.676807 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1836855650 Sep 23 04:35:53.676807 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ImagesNegativeTestJSON-1836855650-project Sep 23 04:35:53.676807 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:35:53.676807 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:35:53.676807 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: ef5d8ac586e04707acec235c122e5bac Sep 23 04:35:53.676807 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ImagesNegativeTestJSON-1836855650-project Sep 23 04:35:53.676807 n-d-846463-3 devstack@n-api.service[122698]: Sep 23 04:35:53.676807 n-d-846463-3 devstack@n-api.service[122698]: {"createImage": {"name": "tempest-test-snap-251047207"}} Sep 23 04:35:53.676807 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:35:53.676807 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 23 04:35:53.677615 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-251047207'}}} Sep 23 04:35:53.677615 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:35:53.677615 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:35:53.677615 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:35:53.677615 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:35:53.677615 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 23 04:35:53.677615 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 23 04:35:53.677615 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 23 04:35:53.677615 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:35:53.677615 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:35:53.677615 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:35:53.677615 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:35:53.677615 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:35:53.677615 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:35:53.677615 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:35:53.677615 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:35:53.677615 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:35:53.677615 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:35:53.677615 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:35:53.677615 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:35:53.682849 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:35:53.682849 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:35:53.682849 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Sep 23 04:35:53.682849 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 23 04:35:53.682849 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:35:53.682849 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:35:53.682849 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:35:53.682849 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:35:53.682849 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 23 04:35:53.682849 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:35:53.682849 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:35:53.682849 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:35:53.682849 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:35:53.682849 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:35:53.682849 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:35:53.682849 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:35:53.682849 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:35:53.682849 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 23 04:35:53.682849 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:35:53.685159 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4b6086b0-160a-469e-9ef9-6aea2d202044 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:35:53.685159 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4b6086b0-160a-469e-9ef9-6aea2d202044 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] 10.222.0.33 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.018373 Sep 23 04:35:53.685159 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 655/1365] 10.222.0.33 () {60 vars in 1281 bytes} [Fri Sep 23 04:35:53 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:35:53.687218 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-49c86f5c-b55a-438f-8b01-8c39bf4e76ff tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:53.688873 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-49c86f5c-b55a-438f-8b01-8c39bf4e76ff tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] [instance: 533efe90-e3aa-416f-a268-c7b779614c7e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:53.698134 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-49c86f5c-b55a-438f-8b01-8c39bf4e76ff tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:53.698134 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-49c86f5c-b55a-438f-8b01-8c39bf4e76ff tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:53.698809 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-49c86f5c-b55a-438f-8b01-8c39bf4e76ff tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:53.699599 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-49c86f5c-b55a-438f-8b01-8c39bf4e76ff tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:53.700131 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-49c86f5c-b55a-438f-8b01-8c39bf4e76ff tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:53.700982 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-49c86f5c-b55a-438f-8b01-8c39bf4e76ff tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:53.718098 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-49c86f5c-b55a-438f-8b01-8c39bf4e76ff tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] HTTP exception thrown: Instance 533efe90-e3aa-416f-a268-c7b779614c7e could not be found. Sep 23 04:35:53.720071 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-49c86f5c-b55a-438f-8b01-8c39bf4e76ff tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Request method failure captured: Sep 23 04:35:53.720071 n-d-846463-3 devstack@n-api.service[122698]: request: DELETE /compute/v2.1/servers/533efe90-e3aa-416f-a268-c7b779614c7e HTTP/1.1 Sep 23 04:35:53.720071 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:35:53.720071 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:35:53.720071 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:35:53.720071 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:35:53.720071 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:35:53.720071 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:35:53.720071 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:35:53.720071 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:35:53.720071 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTeJaWO8azzpbc8RyNeBjxxmQMfqP0e0wNpeoAFytRn44rs_E_MzI9MKBAKEAncJI1hSh49Fj4sMPAL8j4aNf5WyWfH2fqRmVgui2fEpno2T-c6p0krcD8RyK0PRmDZ4OSY4n3ZQ4XhhqOLlMDbaQ2S3SzCl2SqteHtX-iNXgmkshWM Sep 23 04:35:53.720071 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:35:53.720071 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:35:53.720071 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:35:53.720071 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:35:53.720071 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:35:53.720071 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:35:53.720071 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 60d1259e4a2a4d07a7becd15aa8891bd Sep 23 04:35:53.720071 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ImagesNegativeTestJSON-1836855650 Sep 23 04:35:53.720071 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:35:53.720071 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:35:53.722363 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_60d1259e4a2a4d07a7becd15aa8891bd", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/60d1259e4a2a4d07a7becd15aa8891bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/60d1259e4a2a4d07a7becd15aa8891bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/60d1259e4a2a4d07a7becd15aa8891bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:35:53.722363 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ImagesNegativeTestJSON-1836855650 Sep 23 04:35:53.722363 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 60d1259e4a2a4d07a7becd15aa8891bd Sep 23 04:35:53.722363 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1836855650 Sep 23 04:35:53.722363 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ImagesNegativeTestJSON-1836855650-project Sep 23 04:35:53.722363 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:35:53.722363 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:35:53.722363 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: ef5d8ac586e04707acec235c122e5bac Sep 23 04:35:53.722363 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ImagesNegativeTestJSON-1836855650-project Sep 23 04:35:53.722363 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:35:53.722363 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 533efe90-e3aa-416f-a268-c7b779614c7e could not be found. Sep 23 04:35:53.722363 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '533efe90-e3aa-416f-a268-c7b779614c7e'} Sep 23 04:35:53.723136 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:35:53.723136 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:35:53.723136 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:35:53.723136 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:35:53.723136 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:35:53.723136 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:35:53.723136 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:35:53.723136 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:35:53.723136 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:35:53.723136 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:35:53.723136 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 533efe90-e3aa-416f-a268-c7b779614c7e could not be found. Sep 23 04:35:53.723136 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:35:53.723136 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:35:53.723136 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:35:53.723136 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:35:53.723136 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:35:53.723136 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:35:53.723136 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:35:53.723136 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:35:53.723136 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:35:53.724364 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:35:53.724364 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 04:35:53.724364 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 04:35:53.724364 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 04:35:53.724364 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 04:35:53.724364 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:35:53.724364 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:35:53.724364 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:35:53.724364 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:35:53.724364 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 533efe90-e3aa-416f-a268-c7b779614c7e could not be found. Sep 23 04:35:53.724364 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:35:53.724364 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:35:53.724364 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:35:53.724364 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:35:53.724364 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:35:53.724364 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:35:53.724364 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:35:53.724364 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:35:53.724364 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 533efe90-e3aa-416f-a268-c7b779614c7e could not be found. Sep 23 04:35:53.724364 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:35:53.727245 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-49c86f5c-b55a-438f-8b01-8c39bf4e76ff tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Returning 404 to user: Instance 533efe90-e3aa-416f-a268-c7b779614c7e could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:35:53.728667 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-49c86f5c-b55a-438f-8b01-8c39bf4e76ff tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] 10.222.0.33 "DELETE /compute/v2.1/servers/533efe90-e3aa-416f-a268-c7b779614c7e" status: 404 len: 111 microversion: 2.1 time: 0.049143 Sep 23 04:35:53.732954 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 656/1366] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:35:53 2022] DELETE /compute/v2.1/servers/533efe90-e3aa-416f-a268-c7b779614c7e => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:35:53.752197 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-14de8759-e285-41dc-935d-b72cc171aa70 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:53.754044 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-14de8759-e285-41dc-935d-b72cc171aa70 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] [instance: 533efe90-e3aa-416f-a268-c7b779614c7e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:53.762108 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-14de8759-e285-41dc-935d-b72cc171aa70 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:53.763765 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-14de8759-e285-41dc-935d-b72cc171aa70 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:53.764462 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-14de8759-e285-41dc-935d-b72cc171aa70 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:53.765424 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-14de8759-e285-41dc-935d-b72cc171aa70 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:53.766386 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-14de8759-e285-41dc-935d-b72cc171aa70 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:53.767325 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-14de8759-e285-41dc-935d-b72cc171aa70 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:53.799840 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-14de8759-e285-41dc-935d-b72cc171aa70 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] HTTP exception thrown: Instance 533efe90-e3aa-416f-a268-c7b779614c7e could not be found. Sep 23 04:35:53.801857 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-14de8759-e285-41dc-935d-b72cc171aa70 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Request method failure captured: Sep 23 04:35:53.801857 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/533efe90-e3aa-416f-a268-c7b779614c7e HTTP/1.1 Sep 23 04:35:53.801857 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:35:53.801857 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:35:53.801857 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:35:53.801857 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:35:53.801857 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:35:53.801857 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:35:53.801857 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:35:53.801857 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:35:53.801857 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTeJaWO8azzpbc8RyNeBjxxmQMfqP0e0wNpeoAFytRn44rs_E_MzI9MKBAKEAncJI1hSh49Fj4sMPAL8j4aNf5WyWfH2fqRmVgui2fEpno2T-c6p0krcD8RyK0PRmDZ4OSY4n3ZQ4XhhqOLlMDbaQ2S3SzCl2SqteHtX-iNXgmkshWM Sep 23 04:35:53.801857 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:35:53.801857 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:35:53.801857 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:35:53.801857 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:35:53.801857 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:35:53.801857 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:35:53.801857 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 60d1259e4a2a4d07a7becd15aa8891bd Sep 23 04:35:53.801857 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ImagesNegativeTestJSON-1836855650 Sep 23 04:35:53.801857 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:35:53.801857 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:35:53.803412 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_60d1259e4a2a4d07a7becd15aa8891bd", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/60d1259e4a2a4d07a7becd15aa8891bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/60d1259e4a2a4d07a7becd15aa8891bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/60d1259e4a2a4d07a7becd15aa8891bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:35:53.803412 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ImagesNegativeTestJSON-1836855650 Sep 23 04:35:53.803412 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 60d1259e4a2a4d07a7becd15aa8891bd Sep 23 04:35:53.803412 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1836855650 Sep 23 04:35:53.803412 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ImagesNegativeTestJSON-1836855650-project Sep 23 04:35:53.803412 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:35:53.803412 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:35:53.803412 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: ef5d8ac586e04707acec235c122e5bac Sep 23 04:35:53.803412 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ImagesNegativeTestJSON-1836855650-project Sep 23 04:35:53.803412 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:35:53.803412 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 533efe90-e3aa-416f-a268-c7b779614c7e could not be found. Sep 23 04:35:53.803412 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '533efe90-e3aa-416f-a268-c7b779614c7e'} Sep 23 04:35:53.804184 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:35:53.804184 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:35:53.804184 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:35:53.804184 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:35:53.804184 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:35:53.804184 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:35:53.804184 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:35:53.804184 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:35:53.804184 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:35:53.804184 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:35:53.804184 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 533efe90-e3aa-416f-a268-c7b779614c7e could not be found. Sep 23 04:35:53.804184 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:35:53.804184 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:35:53.804184 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:35:53.804184 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:35:53.804184 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:35:53.804184 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:35:53.804184 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:35:53.804184 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:35:53.804184 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:35:53.805439 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:35:53.805439 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:35:53.805439 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:35:53.805439 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:35:53.805439 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:35:53.805439 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:35:53.805439 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:35:53.805439 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 533efe90-e3aa-416f-a268-c7b779614c7e could not be found. Sep 23 04:35:53.805439 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:35:53.805439 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:35:53.805439 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:35:53.805439 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:35:53.805439 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:35:53.805439 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:35:53.805439 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:35:53.805439 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:35:53.805439 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 533efe90-e3aa-416f-a268-c7b779614c7e could not be found. Sep 23 04:35:53.805439 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:35:53.807187 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-14de8759-e285-41dc-935d-b72cc171aa70 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] Returning 404 to user: Instance 533efe90-e3aa-416f-a268-c7b779614c7e could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:35:53.807187 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-14de8759-e285-41dc-935d-b72cc171aa70 tempest-ImagesNegativeTestJSON-1836855650 tempest-ImagesNegativeTestJSON-1836855650-project] 10.222.0.33 "GET /compute/v2.1/servers/533efe90-e3aa-416f-a268-c7b779614c7e" status: 404 len: 111 microversion: 2.1 time: 0.069275 Sep 23 04:35:53.807187 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 657/1367] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:53 2022] GET /compute/v2.1/servers/533efe90-e3aa-416f-a268-c7b779614c7e => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:35:53.828377 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-4256f221-d370-46da-87e6-b8782f7494fc req-7a8ef00d-28ca-4467-862e-2e3cf014eafd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04e9b262-d9e0-434a-bcbb-a85ef9180ee9", "tag": "ef809f4d-5127-48f1-a968-99867a38928e"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:35:53.842858 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-4256f221-d370-46da-87e6-b8782f7494fc req-7a8ef00d-28ca-4467-862e-2e3cf014eafd service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:53.843444 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-4256f221-d370-46da-87e6-b8782f7494fc req-7a8ef00d-28ca-4467-862e-2e3cf014eafd service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:53.843956 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-4256f221-d370-46da-87e6-b8782f7494fc req-7a8ef00d-28ca-4467-862e-2e3cf014eafd service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:53.860519 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-4256f221-d370-46da-87e6-b8782f7494fc req-7a8ef00d-28ca-4467-862e-2e3cf014eafd service nova] Creating event network-changed:ef809f4d-5127-48f1-a968-99867a38928e for instance 04e9b262-d9e0-434a-bcbb-a85ef9180ee9 on n-h2-846463-3 Sep 23 04:35:53.868044 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-4256f221-d370-46da-87e6-b8782f7494fc req-7a8ef00d-28ca-4467-862e-2e3cf014eafd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050512 Sep 23 04:35:53.869114 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 658/1368] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:35:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:35:53.877495 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b64cbe38-fb2d-4763-8b0a-23a12b853e45 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:53.880583 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b64cbe38-fb2d-4763-8b0a-23a12b853e45 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] [instance: 1bf70366-2b4c-4df9-a6be-1c9145fb3862] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:53.891613 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b64cbe38-fb2d-4763-8b0a-23a12b853e45 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:53.892246 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b64cbe38-fb2d-4763-8b0a-23a12b853e45 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:53.892744 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b64cbe38-fb2d-4763-8b0a-23a12b853e45 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:53.893998 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b64cbe38-fb2d-4763-8b0a-23a12b853e45 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:53.894662 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b64cbe38-fb2d-4763-8b0a-23a12b853e45 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:53.895353 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b64cbe38-fb2d-4763-8b0a-23a12b853e45 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:54.068124 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-05d11d27-d4c0-47e3-aed6-dad868a35877 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:54.081136 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-05d11d27-d4c0-47e3-aed6-dad868a35877 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/1180ceb9-a888-4a3b-ba9d-a35afa8dc279" status: 200 len: 1317 microversion: 2.1 time: 1.047956 Sep 23 04:35:54.097917 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 711/1369] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:53 2022] GET /compute/v2.1/servers/1180ceb9-a888-4a3b-ba9d-a35afa8dc279 => generated 1317 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:54.207065 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b64cbe38-fb2d-4763-8b0a-23a12b853e45 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a00bc3e62774185b48120832e80476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f931b8de0b4402a3833577fbb15607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:54.217792 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b64cbe38-fb2d-4763-8b0a-23a12b853e45 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] 10.222.0.33 "GET /compute/v2.1/servers/1bf70366-2b4c-4df9-a6be-1c9145fb3862" status: 200 len: 1316 microversion: 2.1 time: 0.346659 Sep 23 04:35:54.230652 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 659/1370] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:53 2022] GET /compute/v2.1/servers/1bf70366-2b4c-4df9-a6be-1c9145fb3862 => generated 1316 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:54.685701 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-658a4c2c-8662-4e2f-94a1-219d34f9a15e tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:54.686355 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-658a4c2c-8662-4e2f-94a1-219d34f9a15e tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:54.703385 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-658a4c2c-8662-4e2f-94a1-219d34f9a15e tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:54.703900 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-658a4c2c-8662-4e2f-94a1-219d34f9a15e tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:54.705869 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-658a4c2c-8662-4e2f-94a1-219d34f9a15e tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:54.705869 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-658a4c2c-8662-4e2f-94a1-219d34f9a15e tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:54.705869 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-658a4c2c-8662-4e2f-94a1-219d34f9a15e tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:54.706169 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-658a4c2c-8662-4e2f-94a1-219d34f9a15e tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:54.797129 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-2061476d-f589-4b5b-a976-e248d8219de6 req-59fd3961-e1d7-4abb-937d-2a90ddce9496 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1180ceb9-a888-4a3b-ba9d-a35afa8dc279", "tag": "5c735cca-a034-4fe0-b71e-1857868758c7"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:35:54.815556 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-2061476d-f589-4b5b-a976-e248d8219de6 req-59fd3961-e1d7-4abb-937d-2a90ddce9496 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:54.816248 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-2061476d-f589-4b5b-a976-e248d8219de6 req-59fd3961-e1d7-4abb-937d-2a90ddce9496 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:54.818537 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-2061476d-f589-4b5b-a976-e248d8219de6 req-59fd3961-e1d7-4abb-937d-2a90ddce9496 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:54.833915 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-658a4c2c-8662-4e2f-94a1-219d34f9a15e tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:54.836608 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-2061476d-f589-4b5b-a976-e248d8219de6 req-59fd3961-e1d7-4abb-937d-2a90ddce9496 service nova] Creating event network-changed:5c735cca-a034-4fe0-b71e-1857868758c7 for instance 1180ceb9-a888-4a3b-ba9d-a35afa8dc279 on n-h1-846463-3 Sep 23 04:35:54.842349 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-2061476d-f589-4b5b-a976-e248d8219de6 req-59fd3961-e1d7-4abb-937d-2a90ddce9496 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051227 Sep 23 04:35:54.843152 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-658a4c2c-8662-4e2f-94a1-219d34f9a15e tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea" status: 200 len: 1271 microversion: 2.1 time: 0.163065 Sep 23 04:35:54.843677 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 712/1371] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:54 2022] GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea => generated 1271 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:54.851124 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 660/1372] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:35:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:35:55.114712 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7a79db27-6a31-4f9e-9dcd-7c904fb1fb3c tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:55.115446 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7a79db27-6a31-4f9e-9dcd-7c904fb1fb3c tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 1180ceb9-a888-4a3b-ba9d-a35afa8dc279] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:55.143796 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7a79db27-6a31-4f9e-9dcd-7c904fb1fb3c tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:55.148762 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7a79db27-6a31-4f9e-9dcd-7c904fb1fb3c tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:55.149468 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7a79db27-6a31-4f9e-9dcd-7c904fb1fb3c tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:55.150433 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7a79db27-6a31-4f9e-9dcd-7c904fb1fb3c tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:55.150962 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7a79db27-6a31-4f9e-9dcd-7c904fb1fb3c tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:55.154609 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7a79db27-6a31-4f9e-9dcd-7c904fb1fb3c tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:55.245635 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d1090926-1811-411f-9c5f-de7da3bc82c8 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:55.247351 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d1090926-1811-411f-9c5f-de7da3bc82c8 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] [instance: 1bf70366-2b4c-4df9-a6be-1c9145fb3862] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:55.254827 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d1090926-1811-411f-9c5f-de7da3bc82c8 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:55.255706 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d1090926-1811-411f-9c5f-de7da3bc82c8 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:55.256641 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d1090926-1811-411f-9c5f-de7da3bc82c8 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:55.257758 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d1090926-1811-411f-9c5f-de7da3bc82c8 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:55.258761 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d1090926-1811-411f-9c5f-de7da3bc82c8 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:55.259432 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d1090926-1811-411f-9c5f-de7da3bc82c8 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:55.639944 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-7a79db27-6a31-4f9e-9dcd-7c904fb1fb3c tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:55.662036 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7a79db27-6a31-4f9e-9dcd-7c904fb1fb3c tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/1180ceb9-a888-4a3b-ba9d-a35afa8dc279" status: 200 len: 1317 microversion: 2.1 time: 0.553790 Sep 23 04:35:55.673261 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 661/1373] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:55 2022] GET /compute/v2.1/servers/1180ceb9-a888-4a3b-ba9d-a35afa8dc279 => generated 1317 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:55.762981 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d1090926-1811-411f-9c5f-de7da3bc82c8 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a00bc3e62774185b48120832e80476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f931b8de0b4402a3833577fbb15607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:55.779558 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d1090926-1811-411f-9c5f-de7da3bc82c8 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] 10.222.0.33 "GET /compute/v2.1/servers/1bf70366-2b4c-4df9-a6be-1c9145fb3862" status: 200 len: 1316 microversion: 2.1 time: 0.538777 Sep 23 04:35:55.780845 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 713/1374] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:55 2022] GET /compute/v2.1/servers/1bf70366-2b4c-4df9-a6be-1c9145fb3862 => generated 1316 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:55.874908 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3dff7ee0-7501-41ee-bacf-4eb3f4112590 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:55.874908 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3dff7ee0-7501-41ee-bacf-4eb3f4112590 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:55.880434 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3dff7ee0-7501-41ee-bacf-4eb3f4112590 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:55.881812 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3dff7ee0-7501-41ee-bacf-4eb3f4112590 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:55.883112 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3dff7ee0-7501-41ee-bacf-4eb3f4112590 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:55.884010 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3dff7ee0-7501-41ee-bacf-4eb3f4112590 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:55.884480 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3dff7ee0-7501-41ee-bacf-4eb3f4112590 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:55.884940 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3dff7ee0-7501-41ee-bacf-4eb3f4112590 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:56.163027 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-3dff7ee0-7501-41ee-bacf-4eb3f4112590 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:56.173049 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3dff7ee0-7501-41ee-bacf-4eb3f4112590 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea" status: 200 len: 1313 microversion: 2.1 time: 0.306448 Sep 23 04:35:56.175229 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 662/1375] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:55 2022] GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea => generated 1313 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:56.696922 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-04e9a4f6-e441-4c9b-a427-e22d6baca014 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:56.700307 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-04e9a4f6-e441-4c9b-a427-e22d6baca014 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 1180ceb9-a888-4a3b-ba9d-a35afa8dc279] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:56.709939 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-04e9a4f6-e441-4c9b-a427-e22d6baca014 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:56.710947 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-04e9a4f6-e441-4c9b-a427-e22d6baca014 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:56.711460 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-04e9a4f6-e441-4c9b-a427-e22d6baca014 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:56.712241 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-04e9a4f6-e441-4c9b-a427-e22d6baca014 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:56.712777 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-04e9a4f6-e441-4c9b-a427-e22d6baca014 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:56.713304 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-04e9a4f6-e441-4c9b-a427-e22d6baca014 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:56.811116 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-cac35c7b-32ba-4776-b3c1-9912b7729c1c tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:56.812884 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-cac35c7b-32ba-4776-b3c1-9912b7729c1c tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] [instance: 1bf70366-2b4c-4df9-a6be-1c9145fb3862] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:56.822086 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cac35c7b-32ba-4776-b3c1-9912b7729c1c tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:56.823475 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cac35c7b-32ba-4776-b3c1-9912b7729c1c tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:56.825139 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cac35c7b-32ba-4776-b3c1-9912b7729c1c tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:56.827083 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cac35c7b-32ba-4776-b3c1-9912b7729c1c tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:56.827961 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cac35c7b-32ba-4776-b3c1-9912b7729c1c tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:56.828683 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cac35c7b-32ba-4776-b3c1-9912b7729c1c tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:56.865360 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-04e9a4f6-e441-4c9b-a427-e22d6baca014 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:56.875652 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-04e9a4f6-e441-4c9b-a427-e22d6baca014 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/1180ceb9-a888-4a3b-ba9d-a35afa8dc279" status: 200 len: 1317 microversion: 2.1 time: 0.183464 Sep 23 04:35:56.876725 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 714/1376] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:56 2022] GET /compute/v2.1/servers/1180ceb9-a888-4a3b-ba9d-a35afa8dc279 => generated 1317 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:57.001289 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-cac35c7b-32ba-4776-b3c1-9912b7729c1c tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a00bc3e62774185b48120832e80476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f931b8de0b4402a3833577fbb15607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:57.029985 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-cac35c7b-32ba-4776-b3c1-9912b7729c1c tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] 10.222.0.33 "GET /compute/v2.1/servers/1bf70366-2b4c-4df9-a6be-1c9145fb3862" status: 200 len: 1505 microversion: 2.1 time: 0.226221 Sep 23 04:35:57.047781 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 663/1377] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:56 2022] GET /compute/v2.1/servers/1bf70366-2b4c-4df9-a6be-1c9145fb3862 => generated 1505 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:35:57.058006 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-265ff083-41eb-4cfc-b006-950c77f8f439 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1351410333"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:35:57.059240 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-265ff083-41eb-4cfc-b006-950c77f8f439 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] [instance: 1bf70366-2b4c-4df9-a6be-1c9145fb3862] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:57.067618 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-265ff083-41eb-4cfc-b006-950c77f8f439 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:57.068118 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-265ff083-41eb-4cfc-b006-950c77f8f439 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:57.068740 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-265ff083-41eb-4cfc-b006-950c77f8f439 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:57.069678 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-265ff083-41eb-4cfc-b006-950c77f8f439 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:57.070234 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-265ff083-41eb-4cfc-b006-950c77f8f439 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:57.072196 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-265ff083-41eb-4cfc-b006-950c77f8f439 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:57.201976 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a6a1bad5-49f8-49bb-ad83-2f090fc60f78 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:57.203723 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a6a1bad5-49f8-49bb-ad83-2f090fc60f78 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:57.224496 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a6a1bad5-49f8-49bb-ad83-2f090fc60f78 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:57.227073 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a6a1bad5-49f8-49bb-ad83-2f090fc60f78 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:57.227670 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a6a1bad5-49f8-49bb-ad83-2f090fc60f78 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:57.228876 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a6a1bad5-49f8-49bb-ad83-2f090fc60f78 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:57.229816 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a6a1bad5-49f8-49bb-ad83-2f090fc60f78 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:57.230677 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a6a1bad5-49f8-49bb-ad83-2f090fc60f78 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:57.233949 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.network.security_group_api [None req-265ff083-41eb-4cfc-b006-950c77f8f439 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Adding security group ac6c071f-b48d-4383-a2e9-e5de9103136d to port c99566be-c1ff-41dd-9148-37f8e480c982 Sep 23 04:35:57.520976 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a6a1bad5-49f8-49bb-ad83-2f090fc60f78 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:57.530012 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a6a1bad5-49f8-49bb-ad83-2f090fc60f78 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea" status: 200 len: 1313 microversion: 2.1 time: 0.335330 Sep 23 04:35:57.546353 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 664/1378] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:57 2022] GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea => generated 1313 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:57.946667 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5907be73-e16e-4690-b12f-3a0fe791231f tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:57.950140 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5907be73-e16e-4690-b12f-3a0fe791231f tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 1180ceb9-a888-4a3b-ba9d-a35afa8dc279] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:57.963502 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5907be73-e16e-4690-b12f-3a0fe791231f tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:57.964016 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5907be73-e16e-4690-b12f-3a0fe791231f tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:57.964468 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5907be73-e16e-4690-b12f-3a0fe791231f tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:57.965196 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5907be73-e16e-4690-b12f-3a0fe791231f tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:57.965665 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5907be73-e16e-4690-b12f-3a0fe791231f tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:57.969164 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5907be73-e16e-4690-b12f-3a0fe791231f tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:58.199138 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=4 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:35:58.348527 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-265ff083-41eb-4cfc-b006-950c77f8f439 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] 10.222.0.33 "POST /compute/v2.1/servers/1bf70366-2b4c-4df9-a6be-1c9145fb3862/action" status: 202 len: 0 microversion: 2.1 time: 1.299594 Sep 23 04:35:58.352865 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 715/1379] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:35:57 2022] POST /compute/v2.1/servers/1bf70366-2b4c-4df9-a6be-1c9145fb3862/action => generated 0 bytes in 1302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 23 04:35:58.359207 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-5d77bd8a-36fc-43e1-8bb0-34ac1f449445 req-eeb7abeb-8939-4a52-915f-3431a10fba95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bf70366-2b4c-4df9-a6be-1c9145fb3862", "tag": "c99566be-c1ff-41dd-9148-37f8e480c982"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:35:58.383341 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-5d77bd8a-36fc-43e1-8bb0-34ac1f449445 req-eeb7abeb-8939-4a52-915f-3431a10fba95 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:58.384193 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-5d77bd8a-36fc-43e1-8bb0-34ac1f449445 req-eeb7abeb-8939-4a52-915f-3431a10fba95 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:58.385063 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-5d77bd8a-36fc-43e1-8bb0-34ac1f449445 req-eeb7abeb-8939-4a52-915f-3431a10fba95 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:58.419530 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-5d77bd8a-36fc-43e1-8bb0-34ac1f449445 req-eeb7abeb-8939-4a52-915f-3431a10fba95 service nova] Creating event network-changed:c99566be-c1ff-41dd-9148-37f8e480c982 for instance 1bf70366-2b4c-4df9-a6be-1c9145fb3862 on n-h1-846463-3 Sep 23 04:35:58.427307 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-5d77bd8a-36fc-43e1-8bb0-34ac1f449445 req-eeb7abeb-8939-4a52-915f-3431a10fba95 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073092 Sep 23 04:35:58.428700 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 716/1380] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:35:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:35:58.437218 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0ebcbba8-9ced-4052-a45b-721af1297fdc tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Calling method '.version_select at 0x7ff1bb824820>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:58.531198 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-5907be73-e16e-4690-b12f-3a0fe791231f tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:58.588016 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5907be73-e16e-4690-b12f-3a0fe791231f tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/1180ceb9-a888-4a3b-ba9d-a35afa8dc279" status: 200 len: 1317 microversion: 2.1 time: 0.685980 Sep 23 04:35:58.591563 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 665/1381] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:57 2022] GET /compute/v2.1/servers/1180ceb9-a888-4a3b-ba9d-a35afa8dc279 => generated 1317 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:58.598065 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2778e5e2-1a7a-4b5e-b42b-8c754115aebb tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:58.599002 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-2778e5e2-1a7a-4b5e-b42b-8c754115aebb tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:58.611227 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2778e5e2-1a7a-4b5e-b42b-8c754115aebb tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:58.612465 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2778e5e2-1a7a-4b5e-b42b-8c754115aebb tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:58.613231 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2778e5e2-1a7a-4b5e-b42b-8c754115aebb tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:58.615145 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2778e5e2-1a7a-4b5e-b42b-8c754115aebb tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:58.615847 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2778e5e2-1a7a-4b5e-b42b-8c754115aebb tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:58.616591 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2778e5e2-1a7a-4b5e-b42b-8c754115aebb tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:59.129122 n-d-846463-3 devstack@n-api.service[122699]: DEBUG neutronclient.v2_0.client [None req-0ebcbba8-9ced-4052-a45b-721af1297fdc tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group ac6c071f-b48d-4383-a2e9-e5de9103136d in use.", "detail": ""}} {{(pid=122699) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 23 04:35:59.130142 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-0ebcbba8-9ced-4052-a45b-721af1297fdc tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] HTTP exception thrown: Security Group ac6c071f-b48d-4383-a2e9-e5de9103136d in use. Sep 23 04:35:59.130142 n-d-846463-3 devstack@n-api.service[122699]: Neutron server returns request_ids: ['req-f35811c2-a612-493b-b0c9-7c8e09bc5d23'] Sep 23 04:35:59.135276 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0ebcbba8-9ced-4052-a45b-721af1297fdc tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Request method failure captured: Sep 23 04:35:59.135276 n-d-846463-3 devstack@n-api.service[122699]: request: DELETE /compute/v2.1/os-security-groups/ac6c071f-b48d-4383-a2e9-e5de9103136d HTTP/1.1 Sep 23 04:35:59.135276 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:35:59.135276 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:35:59.135276 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:35:59.135276 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:35:59.135276 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:35:59.135276 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:35:59.135276 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:35:59.135276 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:35:59.135276 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTdzwKLwM5Huuc3OkGbV0-q8wtlsijivZwHLFFvwUn7aqwjwo0Mvf0QANB4RO3tvB8rSgFY67c2VjxeEJzRrvjiDhhi9XOqh7sPsdzyKRA33MX1kyET93FlWBs-I4ky6udbWqL2rlse4AqwXx6x3kt0moKWN4SwJfbsgKX9smPZbJsM Sep 23 04:35:59.135276 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:35:59.135276 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:35:59.135276 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:35:59.135276 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:35:59.135276 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:35:59.135276 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:35:59.135276 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: a3f931b8de0b4402a3833577fbb15607 Sep 23 04:35:59.135276 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-SecurityGroupsTestJSON-1588002272 Sep 23 04:35:59.135276 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:35:59.135276 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:35:59.136688 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a3f931b8de0b4402a3833577fbb15607", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a3f931b8de0b4402a3833577fbb15607"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a3f931b8de0b4402a3833577fbb15607"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a3f931b8de0b4402a3833577fbb15607"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:35:59.136688 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-SecurityGroupsTestJSON-1588002272 Sep 23 04:35:59.136688 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: a3f931b8de0b4402a3833577fbb15607 Sep 23 04:35:59.136688 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1588002272 Sep 23 04:35:59.136688 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-SecurityGroupsTestJSON-1588002272-project Sep 23 04:35:59.136688 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:35:59.136688 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:35:59.136688 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 8a00bc3e62774185b48120832e80476d Sep 23 04:35:59.136688 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-SecurityGroupsTestJSON-1588002272-project Sep 23 04:35:59.136688 n-d-846463-3 devstack@n-api.service[122699]: method: Sep 23 04:35:59.136688 n-d-846463-3 devstack@n-api.service[122699]: exception: Security Group ac6c071f-b48d-4383-a2e9-e5de9103136d in use. Sep 23 04:35:59.136688 n-d-846463-3 devstack@n-api.service[122699]: Neutron server returns request_ids: ['req-f35811c2-a612-493b-b0c9-7c8e09bc5d23'] Sep 23 04:35:59.136688 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': 'ac6c071f-b48d-4383-a2e9-e5de9103136d'} Sep 23 04:35:59.137579 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:35:59.137579 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:35:59.137579 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Sep 23 04:35:59.137579 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Sep 23 04:35:59.137579 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:35:59.137579 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:35:59.137579 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Sep 23 04:35:59.137579 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Sep 23 04:35:59.137579 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:35:59.137579 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:35:59.137579 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Sep 23 04:35:59.137579 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Sep 23 04:35:59.137579 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:35:59.137579 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:35:59.137579 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 23 04:35:59.137579 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 23 04:35:59.137579 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:35:59.137579 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:35:59.137579 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 23 04:35:59.139064 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 23 04:35:59.139064 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:35:59.139064 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:35:59.139064 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 23 04:35:59.139064 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 23 04:35:59.139064 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 23 04:35:59.139064 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 23 04:35:59.139064 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group ac6c071f-b48d-4383-a2e9-e5de9103136d in use. Sep 23 04:35:59.139064 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f35811c2-a612-493b-b0c9-7c8e09bc5d23'] Sep 23 04:35:59.139064 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:35:59.139064 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:35:59.139064 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:35:59.139064 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:35:59.139064 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Sep 23 04:35:59.139064 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Sep 23 04:35:59.139064 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Sep 23 04:35:59.139064 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Sep 23 04:35:59.139064 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group ac6c071f-b48d-4383-a2e9-e5de9103136d in use. Sep 23 04:35:59.139064 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f35811c2-a612-493b-b0c9-7c8e09bc5d23'] Sep 23 04:35:59.140490 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:35:59.140490 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:35:59.140490 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:35:59.140490 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:35:59.140490 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:35:59.140490 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:35:59.140490 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:35:59.140490 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:35:59.140490 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:35:59.140490 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:35:59.140490 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:35:59.140490 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:35:59.140490 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Sep 23 04:35:59.140490 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 23 04:35:59.140490 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group ac6c071f-b48d-4383-a2e9-e5de9103136d in use. Sep 23 04:35:59.140490 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f35811c2-a612-493b-b0c9-7c8e09bc5d23'] Sep 23 04:35:59.140490 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:35:59.140490 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:35:59.140490 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:35:59.140490 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:35:59.140490 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:35:59.142332 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:35:59.142332 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:35:59.142332 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:35:59.142332 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group ac6c071f-b48d-4383-a2e9-e5de9103136d in use. Sep 23 04:35:59.142332 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f35811c2-a612-493b-b0c9-7c8e09bc5d23'] Sep 23 04:35:59.142332 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:35:59.144729 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0ebcbba8-9ced-4052-a45b-721af1297fdc tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Returning 400 to user: Security Group ac6c071f-b48d-4383-a2e9-e5de9103136d in use. Sep 23 04:35:59.144729 n-d-846463-3 devstack@n-api.service[122699]: Neutron server returns request_ids: ['req-f35811c2-a612-493b-b0c9-7c8e09bc5d23'] {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:35:59.145130 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0ebcbba8-9ced-4052-a45b-721af1297fdc tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/ac6c071f-b48d-4383-a2e9-e5de9103136d" status: 400 len: 185 microversion: 2.1 time: 0.713848 Sep 23 04:35:59.146191 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 717/1382] 10.222.0.33 () {58 vars in 1272 bytes} [Fri Sep 23 04:35:58 2022] DELETE /compute/v2.1/os-security-groups/ac6c071f-b48d-4383-a2e9-e5de9103136d => generated 185 bytes in 717 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 04:35:59.157691 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f504ae5d-fd9f-4284-8482-4477cb505454 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:35:59.163072 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f504ae5d-fd9f-4284-8482-4477cb505454 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] [instance: 1bf70366-2b4c-4df9-a6be-1c9145fb3862] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:59.179381 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f504ae5d-fd9f-4284-8482-4477cb505454 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:59.181526 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f504ae5d-fd9f-4284-8482-4477cb505454 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:59.182207 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f504ae5d-fd9f-4284-8482-4477cb505454 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:59.184732 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f504ae5d-fd9f-4284-8482-4477cb505454 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:59.185981 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f504ae5d-fd9f-4284-8482-4477cb505454 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:59.186464 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f504ae5d-fd9f-4284-8482-4477cb505454 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:59.249498 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-2778e5e2-1a7a-4b5e-b42b-8c754115aebb tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:59.283916 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2778e5e2-1a7a-4b5e-b42b-8c754115aebb tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea" status: 200 len: 1313 microversion: 2.1 time: 0.687226 Sep 23 04:35:59.285290 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 666/1383] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:58 2022] GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea => generated 1313 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:59.301981 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-9567e44d-532c-46d3-af24-787aa41339c3 req-f645f36e-4168-40f1-ba34-38b76b0396b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea", "tag": "4270b6dd-6896-414f-8926-bc0f7819f6f7"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:35:59.324470 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-9567e44d-532c-46d3-af24-787aa41339c3 req-f645f36e-4168-40f1-ba34-38b76b0396b4 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:59.325510 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-9567e44d-532c-46d3-af24-787aa41339c3 req-f645f36e-4168-40f1-ba34-38b76b0396b4 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:59.326732 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-9567e44d-532c-46d3-af24-787aa41339c3 req-f645f36e-4168-40f1-ba34-38b76b0396b4 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:59.332575 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=100 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:35:59.346051 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-9567e44d-532c-46d3-af24-787aa41339c3 req-f645f36e-4168-40f1-ba34-38b76b0396b4 service nova] Creating event network-changed:4270b6dd-6896-414f-8926-bc0f7819f6f7 for instance f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea on n-h2-846463-3 Sep 23 04:35:59.354589 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-9567e44d-532c-46d3-af24-787aa41339c3 req-f645f36e-4168-40f1-ba34-38b76b0396b4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065891 Sep 23 04:35:59.355209 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 667/1384] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:35:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:35:59.600140 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f504ae5d-fd9f-4284-8482-4477cb505454 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] 10.222.0.33 "POST /compute/v2.1/servers/1bf70366-2b4c-4df9-a6be-1c9145fb3862/action" status: 202 len: 0 microversion: 2.1 time: 0.448880 Sep 23 04:35:59.604602 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 718/1385] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:35:59 2022] POST /compute/v2.1/servers/1bf70366-2b4c-4df9-a6be-1c9145fb3862/action => generated 0 bytes in 451 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 23 04:35:59.611183 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1216333e-ad9f-4a55-8614-54cbbde103bc tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:59.612037 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-1216333e-ad9f-4a55-8614-54cbbde103bc tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] [instance: 1bf70366-2b4c-4df9-a6be-1c9145fb3862] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:59.615789 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-54f7f771-bcda-49e8-928b-9c427f03bed8 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:35:59.617316 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-54f7f771-bcda-49e8-928b-9c427f03bed8 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 1180ceb9-a888-4a3b-ba9d-a35afa8dc279] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:35:59.625348 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1216333e-ad9f-4a55-8614-54cbbde103bc tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:59.625916 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1216333e-ad9f-4a55-8614-54cbbde103bc tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:59.626365 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1216333e-ad9f-4a55-8614-54cbbde103bc tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:59.627103 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1216333e-ad9f-4a55-8614-54cbbde103bc tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:59.627568 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1216333e-ad9f-4a55-8614-54cbbde103bc tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:59.627712 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-54f7f771-bcda-49e8-928b-9c427f03bed8 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:59.627993 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1216333e-ad9f-4a55-8614-54cbbde103bc tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:59.628588 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-54f7f771-bcda-49e8-928b-9c427f03bed8 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:59.629201 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-54f7f771-bcda-49e8-928b-9c427f03bed8 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:59.630109 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-54f7f771-bcda-49e8-928b-9c427f03bed8 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:35:59.632126 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-54f7f771-bcda-49e8-928b-9c427f03bed8 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:35:59.632789 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-54f7f771-bcda-49e8-928b-9c427f03bed8 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:35:59.909860 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-54f7f771-bcda-49e8-928b-9c427f03bed8 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:59.926495 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-54f7f771-bcda-49e8-928b-9c427f03bed8 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/1180ceb9-a888-4a3b-ba9d-a35afa8dc279" status: 200 len: 1317 microversion: 2.1 time: 0.314498 Sep 23 04:35:59.938892 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 719/1386] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:59 2022] GET /compute/v2.1/servers/1180ceb9-a888-4a3b-ba9d-a35afa8dc279 => generated 1317 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:35:59.967331 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-1216333e-ad9f-4a55-8614-54cbbde103bc tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a00bc3e62774185b48120832e80476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f931b8de0b4402a3833577fbb15607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:35:59.978074 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-1216333e-ad9f-4a55-8614-54cbbde103bc tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] 10.222.0.33 "GET /compute/v2.1/servers/1bf70366-2b4c-4df9-a6be-1c9145fb3862" status: 200 len: 1576 microversion: 2.1 time: 0.370802 Sep 23 04:35:59.995797 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 668/1387] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:35:59 2022] GET /compute/v2.1/servers/1bf70366-2b4c-4df9-a6be-1c9145fb3862 => generated 1576 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:00.313258 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ba48a342-4daa-40a7-a5a8-42f0c6a08607 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:00.314496 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ba48a342-4daa-40a7-a5a8-42f0c6a08607 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:00.331280 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ba48a342-4daa-40a7-a5a8-42f0c6a08607 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:00.331428 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ba48a342-4daa-40a7-a5a8-42f0c6a08607 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:00.344478 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ba48a342-4daa-40a7-a5a8-42f0c6a08607 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:00.345473 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ba48a342-4daa-40a7-a5a8-42f0c6a08607 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:00.346310 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ba48a342-4daa-40a7-a5a8-42f0c6a08607 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:00.346926 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ba48a342-4daa-40a7-a5a8-42f0c6a08607 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:00.698384 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ba48a342-4daa-40a7-a5a8-42f0c6a08607 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:00.705619 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=7 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:36:00.716740 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ba48a342-4daa-40a7-a5a8-42f0c6a08607 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea" status: 200 len: 1313 microversion: 2.1 time: 0.408628 Sep 23 04:36:00.718884 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 720/1388] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:00 2022] GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea => generated 1313 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:00.965641 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3fe8eebf-9205-44ed-9bc9-c1a1df9cc67a tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:00.966301 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3fe8eebf-9205-44ed-9bc9-c1a1df9cc67a tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 1180ceb9-a888-4a3b-ba9d-a35afa8dc279] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:00.978444 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3fe8eebf-9205-44ed-9bc9-c1a1df9cc67a tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:00.980567 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3fe8eebf-9205-44ed-9bc9-c1a1df9cc67a tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:00.984450 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3fe8eebf-9205-44ed-9bc9-c1a1df9cc67a tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:00.985629 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3fe8eebf-9205-44ed-9bc9-c1a1df9cc67a tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:00.986397 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3fe8eebf-9205-44ed-9bc9-c1a1df9cc67a tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:00.987116 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3fe8eebf-9205-44ed-9bc9-c1a1df9cc67a tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:01.002678 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a54ee79b-4f56-40b5-ba59-ffe4a9adc9e5 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:01.003705 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a54ee79b-4f56-40b5-ba59-ffe4a9adc9e5 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] [instance: 1bf70366-2b4c-4df9-a6be-1c9145fb3862] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:01.017299 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a54ee79b-4f56-40b5-ba59-ffe4a9adc9e5 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:01.019064 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a54ee79b-4f56-40b5-ba59-ffe4a9adc9e5 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:01.019631 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a54ee79b-4f56-40b5-ba59-ffe4a9adc9e5 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:01.021497 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a54ee79b-4f56-40b5-ba59-ffe4a9adc9e5 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:01.024125 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a54ee79b-4f56-40b5-ba59-ffe4a9adc9e5 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:01.024727 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a54ee79b-4f56-40b5-ba59-ffe4a9adc9e5 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:01.546140 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-3fe8eebf-9205-44ed-9bc9-c1a1df9cc67a tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:01.557623 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3fe8eebf-9205-44ed-9bc9-c1a1df9cc67a tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/1180ceb9-a888-4a3b-ba9d-a35afa8dc279" status: 200 len: 1317 microversion: 2.1 time: 0.596646 Sep 23 04:36:01.561184 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 669/1389] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:00 2022] GET /compute/v2.1/servers/1180ceb9-a888-4a3b-ba9d-a35afa8dc279 => generated 1317 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:01.568063 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a54ee79b-4f56-40b5-ba59-ffe4a9adc9e5 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a00bc3e62774185b48120832e80476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f931b8de0b4402a3833577fbb15607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:01.579039 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a54ee79b-4f56-40b5-ba59-ffe4a9adc9e5 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] 10.222.0.33 "GET /compute/v2.1/servers/1bf70366-2b4c-4df9-a6be-1c9145fb3862" status: 200 len: 1576 microversion: 2.1 time: 0.580913 Sep 23 04:36:01.579630 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 721/1390] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:00 2022] GET /compute/v2.1/servers/1bf70366-2b4c-4df9-a6be-1c9145fb3862 => generated 1576 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:01.744068 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-bd408cca-1a8f-4a52-8419-1d4a0677f8d5 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:01.744868 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-bd408cca-1a8f-4a52-8419-1d4a0677f8d5 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:01.747155 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:36:01.758020 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bd408cca-1a8f-4a52-8419-1d4a0677f8d5 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:01.759023 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bd408cca-1a8f-4a52-8419-1d4a0677f8d5 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:01.759623 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bd408cca-1a8f-4a52-8419-1d4a0677f8d5 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:01.760552 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bd408cca-1a8f-4a52-8419-1d4a0677f8d5 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:01.761242 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bd408cca-1a8f-4a52-8419-1d4a0677f8d5 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:01.761856 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bd408cca-1a8f-4a52-8419-1d4a0677f8d5 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:02.043898 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-bd408cca-1a8f-4a52-8419-1d4a0677f8d5 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:02.051954 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-bd408cca-1a8f-4a52-8419-1d4a0677f8d5 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea" status: 200 len: 1313 microversion: 2.1 time: 0.312472 Sep 23 04:36:02.052528 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 670/1391] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:01 2022] GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea => generated 1313 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:02.588412 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c7fd4e69-bd1e-41a0-9f8c-1a218fca1a32 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:02.589031 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c7fd4e69-bd1e-41a0-9f8c-1a218fca1a32 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 1180ceb9-a888-4a3b-ba9d-a35afa8dc279] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:02.595630 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c7fd4e69-bd1e-41a0-9f8c-1a218fca1a32 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:02.596170 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c7fd4e69-bd1e-41a0-9f8c-1a218fca1a32 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:02.597002 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c7fd4e69-bd1e-41a0-9f8c-1a218fca1a32 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:02.597880 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c7fd4e69-bd1e-41a0-9f8c-1a218fca1a32 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:02.598424 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c7fd4e69-bd1e-41a0-9f8c-1a218fca1a32 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:02.598860 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c7fd4e69-bd1e-41a0-9f8c-1a218fca1a32 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:02.606955 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-278a4ff4-3d3d-4283-a338-1ef65d3f187b tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:02.608061 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-278a4ff4-3d3d-4283-a338-1ef65d3f187b tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] [instance: 1bf70366-2b4c-4df9-a6be-1c9145fb3862] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:02.617278 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-278a4ff4-3d3d-4283-a338-1ef65d3f187b tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:02.618324 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-278a4ff4-3d3d-4283-a338-1ef65d3f187b tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:02.619381 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-278a4ff4-3d3d-4283-a338-1ef65d3f187b tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:02.620307 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-278a4ff4-3d3d-4283-a338-1ef65d3f187b tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:02.620766 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-278a4ff4-3d3d-4283-a338-1ef65d3f187b tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:02.621382 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-278a4ff4-3d3d-4283-a338-1ef65d3f187b tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:02.825491 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c7fd4e69-bd1e-41a0-9f8c-1a218fca1a32 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:02.835920 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-278a4ff4-3d3d-4283-a338-1ef65d3f187b tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a00bc3e62774185b48120832e80476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f931b8de0b4402a3833577fbb15607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:02.836722 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c7fd4e69-bd1e-41a0-9f8c-1a218fca1a32 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/1180ceb9-a888-4a3b-ba9d-a35afa8dc279" status: 200 len: 1317 microversion: 2.1 time: 0.252624 Sep 23 04:36:02.844500 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 722/1392] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:02 2022] GET /compute/v2.1/servers/1180ceb9-a888-4a3b-ba9d-a35afa8dc279 => generated 1317 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:02.847312 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-278a4ff4-3d3d-4283-a338-1ef65d3f187b tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] 10.222.0.33 "GET /compute/v2.1/servers/1bf70366-2b4c-4df9-a6be-1c9145fb3862" status: 200 len: 1574 microversion: 2.1 time: 0.246694 Sep 23 04:36:02.848186 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 671/1393] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:02 2022] GET /compute/v2.1/servers/1bf70366-2b4c-4df9-a6be-1c9145fb3862 => generated 1574 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:02.872084 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a2fe4339-5653-4296-a870-0663cbbe24bd tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-569806708"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:36:02.872624 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a2fe4339-5653-4296-a870-0663cbbe24bd tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] [instance: 1bf70366-2b4c-4df9-a6be-1c9145fb3862] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:02.879110 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a2fe4339-5653-4296-a870-0663cbbe24bd tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:02.879602 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a2fe4339-5653-4296-a870-0663cbbe24bd tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:02.880245 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a2fe4339-5653-4296-a870-0663cbbe24bd tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:02.880956 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a2fe4339-5653-4296-a870-0663cbbe24bd tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:02.881586 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a2fe4339-5653-4296-a870-0663cbbe24bd tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:02.882063 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a2fe4339-5653-4296-a870-0663cbbe24bd tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:03.015203 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.network.security_group_api [None req-a2fe4339-5653-4296-a870-0663cbbe24bd tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Adding security group 4af791f9-f06f-4b60-ba7c-8ef76cb6893c to port c99566be-c1ff-41dd-9148-37f8e480c982 Sep 23 04:36:03.080297 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-785dffd9-e123-478c-b777-d1e7b4c11a8b tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:03.081593 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-785dffd9-e123-478c-b777-d1e7b4c11a8b tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:03.095002 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-785dffd9-e123-478c-b777-d1e7b4c11a8b tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:03.095714 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-785dffd9-e123-478c-b777-d1e7b4c11a8b tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:03.096385 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-785dffd9-e123-478c-b777-d1e7b4c11a8b tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:03.097365 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-785dffd9-e123-478c-b777-d1e7b4c11a8b tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:03.098080 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-785dffd9-e123-478c-b777-d1e7b4c11a8b tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:03.098877 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-785dffd9-e123-478c-b777-d1e7b4c11a8b tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:03.333091 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-785dffd9-e123-478c-b777-d1e7b4c11a8b tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:03.344677 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-785dffd9-e123-478c-b777-d1e7b4c11a8b tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea" status: 200 len: 1313 microversion: 2.1 time: 0.270120 Sep 23 04:36:03.346445 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 672/1394] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:03 2022] GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea => generated 1313 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:03.351786 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-515d9a0b-7f19-421b-ad07-05f1aceb33e5 req-6e751494-e981-49e6-a34b-ff20ca52d4a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1180ceb9-a888-4a3b-ba9d-a35afa8dc279", "name": "network-vif-plugged", "status": "completed", "tag": "5c735cca-a034-4fe0-b71e-1857868758c7"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:36:03.365056 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-515d9a0b-7f19-421b-ad07-05f1aceb33e5 req-6e751494-e981-49e6-a34b-ff20ca52d4a9 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:03.372650 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-515d9a0b-7f19-421b-ad07-05f1aceb33e5 req-6e751494-e981-49e6-a34b-ff20ca52d4a9 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:03.372650 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-515d9a0b-7f19-421b-ad07-05f1aceb33e5 req-6e751494-e981-49e6-a34b-ff20ca52d4a9 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:03.391997 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-515d9a0b-7f19-421b-ad07-05f1aceb33e5 req-6e751494-e981-49e6-a34b-ff20ca52d4a9 service nova] Creating event network-vif-plugged:5c735cca-a034-4fe0-b71e-1857868758c7 for instance 1180ceb9-a888-4a3b-ba9d-a35afa8dc279 on n-h1-846463-3 Sep 23 04:36:03.401394 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-515d9a0b-7f19-421b-ad07-05f1aceb33e5 req-6e751494-e981-49e6-a34b-ff20ca52d4a9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053460 Sep 23 04:36:03.402416 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 673/1395] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:36:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:36:03.758782 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a2fe4339-5653-4296-a870-0663cbbe24bd tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] 10.222.0.33 "POST /compute/v2.1/servers/1bf70366-2b4c-4df9-a6be-1c9145fb3862/action" status: 202 len: 0 microversion: 2.1 time: 0.890434 Sep 23 04:36:03.760557 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 723/1396] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:36:02 2022] POST /compute/v2.1/servers/1bf70366-2b4c-4df9-a6be-1c9145fb3862/action => generated 0 bytes in 893 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:36:03.771657 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-56729974-510c-4ae4-848a-96b103b16985 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Calling method '.version_select at 0x7ff1bb9485e0>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:03.777089 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-005c1e46-25ca-47a0-a8be-fafd0f282cc5 req-388031af-719c-4d21-baef-9d07d914f948 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bf70366-2b4c-4df9-a6be-1c9145fb3862", "tag": "c99566be-c1ff-41dd-9148-37f8e480c982"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:36:03.788074 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-005c1e46-25ca-47a0-a8be-fafd0f282cc5 req-388031af-719c-4d21-baef-9d07d914f948 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:03.789246 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-005c1e46-25ca-47a0-a8be-fafd0f282cc5 req-388031af-719c-4d21-baef-9d07d914f948 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:03.789692 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-005c1e46-25ca-47a0-a8be-fafd0f282cc5 req-388031af-719c-4d21-baef-9d07d914f948 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:03.803153 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-005c1e46-25ca-47a0-a8be-fafd0f282cc5 req-388031af-719c-4d21-baef-9d07d914f948 service nova] Creating event network-changed:c99566be-c1ff-41dd-9148-37f8e480c982 for instance 1bf70366-2b4c-4df9-a6be-1c9145fb3862 on n-h1-846463-3 Sep 23 04:36:03.808742 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-005c1e46-25ca-47a0-a8be-fafd0f282cc5 req-388031af-719c-4d21-baef-9d07d914f948 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037059 Sep 23 04:36:03.809522 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 724/1397] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:36:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:36:03.874939 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3c9bb034-a883-43b1-bdec-af24197e7491 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:03.875671 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-3c9bb034-a883-43b1-bdec-af24197e7491 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 1180ceb9-a888-4a3b-ba9d-a35afa8dc279] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:03.885337 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3c9bb034-a883-43b1-bdec-af24197e7491 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:03.886046 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3c9bb034-a883-43b1-bdec-af24197e7491 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:03.886552 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3c9bb034-a883-43b1-bdec-af24197e7491 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:03.901842 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3c9bb034-a883-43b1-bdec-af24197e7491 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:03.902737 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3c9bb034-a883-43b1-bdec-af24197e7491 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:03.903658 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3c9bb034-a883-43b1-bdec-af24197e7491 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:04.032909 n-d-846463-3 devstack@n-api.service[122698]: DEBUG neutronclient.v2_0.client [None req-56729974-510c-4ae4-848a-96b103b16985 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 4af791f9-f06f-4b60-ba7c-8ef76cb6893c in use.", "detail": ""}} {{(pid=122698) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 23 04:36:04.033721 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-56729974-510c-4ae4-848a-96b103b16985 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] HTTP exception thrown: Security Group 4af791f9-f06f-4b60-ba7c-8ef76cb6893c in use. Sep 23 04:36:04.033721 n-d-846463-3 devstack@n-api.service[122698]: Neutron server returns request_ids: ['req-054f3917-ca55-4572-ba58-40dc47a61d57'] Sep 23 04:36:04.037274 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-56729974-510c-4ae4-848a-96b103b16985 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Request method failure captured: Sep 23 04:36:04.037274 n-d-846463-3 devstack@n-api.service[122698]: request: DELETE /compute/v2.1/os-security-groups/4af791f9-f06f-4b60-ba7c-8ef76cb6893c HTTP/1.1 Sep 23 04:36:04.037274 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:36:04.037274 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:36:04.037274 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:36:04.037274 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:36:04.037274 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:36:04.037274 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:36:04.037274 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:36:04.037274 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:36:04.037274 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTdzwKLwM5Huuc3OkGbV0-q8wtlsijivZwHLFFvwUn7aqwjwo0Mvf0QANB4RO3tvB8rSgFY67c2VjxeEJzRrvjiDhhi9XOqh7sPsdzyKRA33MX1kyET93FlWBs-I4ky6udbWqL2rlse4AqwXx6x3kt0moKWN4SwJfbsgKX9smPZbJsM Sep 23 04:36:04.037274 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:36:04.037274 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:36:04.037274 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:36:04.037274 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:36:04.037274 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:36:04.037274 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:36:04.037274 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: a3f931b8de0b4402a3833577fbb15607 Sep 23 04:36:04.037274 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-SecurityGroupsTestJSON-1588002272 Sep 23 04:36:04.037274 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:36:04.037274 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:36:04.039528 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a3f931b8de0b4402a3833577fbb15607", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a3f931b8de0b4402a3833577fbb15607"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a3f931b8de0b4402a3833577fbb15607"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a3f931b8de0b4402a3833577fbb15607"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:36:04.039528 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-SecurityGroupsTestJSON-1588002272 Sep 23 04:36:04.039528 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: a3f931b8de0b4402a3833577fbb15607 Sep 23 04:36:04.039528 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1588002272 Sep 23 04:36:04.039528 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-SecurityGroupsTestJSON-1588002272-project Sep 23 04:36:04.039528 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:36:04.039528 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:36:04.039528 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 8a00bc3e62774185b48120832e80476d Sep 23 04:36:04.039528 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-SecurityGroupsTestJSON-1588002272-project Sep 23 04:36:04.039528 n-d-846463-3 devstack@n-api.service[122698]: method: Sep 23 04:36:04.039528 n-d-846463-3 devstack@n-api.service[122698]: exception: Security Group 4af791f9-f06f-4b60-ba7c-8ef76cb6893c in use. Sep 23 04:36:04.039528 n-d-846463-3 devstack@n-api.service[122698]: Neutron server returns request_ids: ['req-054f3917-ca55-4572-ba58-40dc47a61d57'] Sep 23 04:36:04.039528 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '4af791f9-f06f-4b60-ba7c-8ef76cb6893c'} Sep 23 04:36:04.040447 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:36:04.040447 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:36:04.040447 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Sep 23 04:36:04.040447 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Sep 23 04:36:04.040447 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:36:04.040447 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:36:04.040447 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Sep 23 04:36:04.040447 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Sep 23 04:36:04.040447 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:36:04.040447 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:36:04.040447 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Sep 23 04:36:04.040447 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Sep 23 04:36:04.040447 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:36:04.040447 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:36:04.040447 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 23 04:36:04.040447 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 23 04:36:04.040447 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:36:04.040447 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:36:04.040447 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 23 04:36:04.041607 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 23 04:36:04.041607 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:36:04.041607 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:36:04.041607 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 23 04:36:04.041607 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 23 04:36:04.041607 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 23 04:36:04.041607 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 23 04:36:04.041607 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 4af791f9-f06f-4b60-ba7c-8ef76cb6893c in use. Sep 23 04:36:04.041607 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-054f3917-ca55-4572-ba58-40dc47a61d57'] Sep 23 04:36:04.041607 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:36:04.041607 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:36:04.041607 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:36:04.041607 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:36:04.041607 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Sep 23 04:36:04.041607 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Sep 23 04:36:04.041607 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Sep 23 04:36:04.041607 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Sep 23 04:36:04.041607 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 4af791f9-f06f-4b60-ba7c-8ef76cb6893c in use. Sep 23 04:36:04.041607 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-054f3917-ca55-4572-ba58-40dc47a61d57'] Sep 23 04:36:04.049395 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:36:04.049395 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:36:04.049395 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:36:04.049395 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:36:04.049395 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:36:04.049395 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:36:04.049395 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:36:04.049395 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:36:04.049395 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:36:04.049395 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:36:04.049395 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:36:04.049395 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:36:04.049395 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Sep 23 04:36:04.049395 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 23 04:36:04.049395 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 4af791f9-f06f-4b60-ba7c-8ef76cb6893c in use. Sep 23 04:36:04.049395 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-054f3917-ca55-4572-ba58-40dc47a61d57'] Sep 23 04:36:04.049395 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:36:04.049395 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:36:04.049395 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:36:04.049395 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:36:04.049395 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:36:04.050703 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:36:04.050703 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:36:04.050703 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:36:04.050703 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 4af791f9-f06f-4b60-ba7c-8ef76cb6893c in use. Sep 23 04:36:04.050703 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-054f3917-ca55-4572-ba58-40dc47a61d57'] Sep 23 04:36:04.050703 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:36:04.050703 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-56729974-510c-4ae4-848a-96b103b16985 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Returning 400 to user: Security Group 4af791f9-f06f-4b60-ba7c-8ef76cb6893c in use. Sep 23 04:36:04.050703 n-d-846463-3 devstack@n-api.service[122698]: Neutron server returns request_ids: ['req-054f3917-ca55-4572-ba58-40dc47a61d57'] {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:36:04.050703 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-56729974-510c-4ae4-848a-96b103b16985 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/4af791f9-f06f-4b60-ba7c-8ef76cb6893c" status: 400 len: 185 microversion: 2.1 time: 0.275934 Sep 23 04:36:04.050703 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 674/1398] 10.222.0.33 () {58 vars in 1272 bytes} [Fri Sep 23 04:36:03 2022] DELETE /compute/v2.1/os-security-groups/4af791f9-f06f-4b60-ba7c-8ef76cb6893c => generated 185 bytes in 280 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 04:36:04.055840 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1337a27a-287a-40b4-9713-f50d04f7eda7 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:04.057964 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-1337a27a-287a-40b4-9713-f50d04f7eda7 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] [instance: 1bf70366-2b4c-4df9-a6be-1c9145fb3862] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:04.082217 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1337a27a-287a-40b4-9713-f50d04f7eda7 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:04.082859 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1337a27a-287a-40b4-9713-f50d04f7eda7 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:04.086992 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1337a27a-287a-40b4-9713-f50d04f7eda7 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:04.088869 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1337a27a-287a-40b4-9713-f50d04f7eda7 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:04.091032 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1337a27a-287a-40b4-9713-f50d04f7eda7 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:04.092864 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1337a27a-287a-40b4-9713-f50d04f7eda7 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:04.133853 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-3c9bb034-a883-43b1-bdec-af24197e7491 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:04.145842 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3c9bb034-a883-43b1-bdec-af24197e7491 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/1180ceb9-a888-4a3b-ba9d-a35afa8dc279" status: 200 len: 1317 microversion: 2.1 time: 0.286589 Sep 23 04:36:04.149172 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 725/1399] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:03 2022] GET /compute/v2.1/servers/1180ceb9-a888-4a3b-ba9d-a35afa8dc279 => generated 1317 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:04.161336 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-1337a27a-287a-40b4-9713-f50d04f7eda7 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] [instance: 1bf70366-2b4c-4df9-a6be-1c9145fb3862] Going to try to terminate instance {{(pid=122698) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:36:04.369591 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6ea39a1c-bcea-42b6-ae54-7e0ba63678af tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:04.370467 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-6ea39a1c-bcea-42b6-ae54-7e0ba63678af tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:04.379254 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6ea39a1c-bcea-42b6-ae54-7e0ba63678af tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:04.379757 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6ea39a1c-bcea-42b6-ae54-7e0ba63678af tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:04.380565 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6ea39a1c-bcea-42b6-ae54-7e0ba63678af tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:04.381454 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6ea39a1c-bcea-42b6-ae54-7e0ba63678af tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:04.382626 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6ea39a1c-bcea-42b6-ae54-7e0ba63678af tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:04.383246 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6ea39a1c-bcea-42b6-ae54-7e0ba63678af tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:04.580853 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-6ea39a1c-bcea-42b6-ae54-7e0ba63678af tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:04.596979 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6ea39a1c-bcea-42b6-ae54-7e0ba63678af tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea" status: 200 len: 1313 microversion: 2.1 time: 0.228167 Sep 23 04:36:04.596979 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 726/1400] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:04 2022] GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea => generated 1313 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:04.680175 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-1337a27a-287a-40b4-9713-f50d04f7eda7 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] 10.222.0.33 "DELETE /compute/v2.1/servers/1bf70366-2b4c-4df9-a6be-1c9145fb3862" status: 204 len: 0 microversion: 2.1 time: 0.627306 Sep 23 04:36:04.681473 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 675/1401] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:36:04 2022] DELETE /compute/v2.1/servers/1bf70366-2b4c-4df9-a6be-1c9145fb3862 => generated 0 bytes in 630 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:36:04.690391 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c0c2079b-02bd-42b9-a06a-d4543ef98fd4 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:04.693251 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c0c2079b-02bd-42b9-a06a-d4543ef98fd4 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] [instance: 1bf70366-2b4c-4df9-a6be-1c9145fb3862] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:04.703533 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c0c2079b-02bd-42b9-a06a-d4543ef98fd4 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:04.704262 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c0c2079b-02bd-42b9-a06a-d4543ef98fd4 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:04.705278 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c0c2079b-02bd-42b9-a06a-d4543ef98fd4 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:04.706565 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c0c2079b-02bd-42b9-a06a-d4543ef98fd4 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:04.707280 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c0c2079b-02bd-42b9-a06a-d4543ef98fd4 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:04.708340 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c0c2079b-02bd-42b9-a06a-d4543ef98fd4 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:04.792324 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4ecac547-09e1-4b8b-a443-44a13735cbf8 tempest-ListImageFiltersNegativeTestJSON-351084829 tempest-ListImageFiltersNegativeTestJSON-351084829-project] Calling method '.version_select at 0x7ff1bb8d53a0>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:04.821836 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-4ecac547-09e1-4b8b-a443-44a13735cbf8 tempest-ListImageFiltersNegativeTestJSON-351084829 tempest-ListImageFiltersNegativeTestJSON-351084829-project] HTTP exception thrown: Image not found. Sep 23 04:36:04.824133 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4ecac547-09e1-4b8b-a443-44a13735cbf8 tempest-ListImageFiltersNegativeTestJSON-351084829 tempest-ListImageFiltersNegativeTestJSON-351084829-project] Request method failure captured: Sep 23 04:36:04.824133 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/images/20142dc1-99a4-47a0-9925-8ca534a8e8b5 HTTP/1.1 Sep 23 04:36:04.824133 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:36:04.824133 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:36:04.824133 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:36:04.824133 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:36:04.824133 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:36:04.824133 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:36:04.824133 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:36:04.824133 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:36:04.824133 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTe0dSFLafvQUV9zN4c89IaTfcIW0JshCVe_u8adP56k9lT_qYh0PCzGPXKRClRP96JjuZ4eiFcZaKA7qLKfT2aO3Ud_VK_bvhcxlGwUtng1zmk7euA08PPEmT08X_ngXofFBX96sGnAPbSGR_whu9u39-75SZtL8BWahn1PCvhOyBw Sep 23 04:36:04.824133 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:36:04.824133 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:36:04.824133 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:36:04.824133 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:36:04.824133 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:36:04.824133 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:36:04.824133 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 9e6bdd998e8048f086f97e35a2518340 Sep 23 04:36:04.824133 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-351084829 Sep 23 04:36:04.824133 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:36:04.824133 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:36:04.825623 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9e6bdd998e8048f086f97e35a2518340", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9e6bdd998e8048f086f97e35a2518340"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9e6bdd998e8048f086f97e35a2518340"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9e6bdd998e8048f086f97e35a2518340"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:36:04.825623 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-351084829 Sep 23 04:36:04.825623 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 9e6bdd998e8048f086f97e35a2518340 Sep 23 04:36:04.825623 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-351084829 Sep 23 04:36:04.825623 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ListImageFiltersNegativeTestJSON-351084829-project Sep 23 04:36:04.825623 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:36:04.825623 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:36:04.825623 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 09a5e2b7239143889ce2ed381c877f55 Sep 23 04:36:04.825623 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-351084829-project Sep 23 04:36:04.825623 n-d-846463-3 devstack@n-api.service[122699]: method: Sep 23 04:36:04.825623 n-d-846463-3 devstack@n-api.service[122699]: exception: Image not found. Sep 23 04:36:04.825623 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '20142dc1-99a4-47a0-9925-8ca534a8e8b5'} Sep 23 04:36:04.825623 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:36:04.826506 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:36:04.826506 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 23 04:36:04.826506 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 23 04:36:04.826506 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 23 04:36:04.826506 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 23 04:36:04.826506 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 23 04:36:04.826506 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 23 04:36:04.826506 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 23 04:36:04.826506 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 23 04:36:04.826506 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 23 04:36:04.826506 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 23 04:36:04.826506 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 23 04:36:04.826506 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 23 04:36:04.826506 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 23 04:36:04.826506 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 23 04:36:04.826506 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 23 04:36:04.826506 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 23 04:36:04.826506 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 20142dc1-99a4-47a0-9925-8ca534a8e8b5 Sep 23 04:36:04.827673 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:36:04.827673 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:36:04.827673 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:36:04.827673 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:36:04.827673 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Sep 23 04:36:04.827673 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Sep 23 04:36:04.827673 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 23 04:36:04.827673 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 23 04:36:04.827673 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 23 04:36:04.827673 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 23 04:36:04.827673 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 23 04:36:04.827673 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 23 04:36:04.827673 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 23 04:36:04.827673 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 23 04:36:04.827673 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 23 04:36:04.827673 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 23 04:36:04.827673 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 23 04:36:04.827673 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 23 04:36:04.827673 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 23 04:36:04.827673 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 23 04:36:04.830514 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 23 04:36:04.830514 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 23 04:36:04.830514 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 23 04:36:04.830514 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 23 04:36:04.830514 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 23 04:36:04.830514 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 23 04:36:04.830514 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 23 04:36:04.830514 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 23 04:36:04.830514 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 20142dc1-99a4-47a0-9925-8ca534a8e8b5 could not be found. Sep 23 04:36:04.830514 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:36:04.830514 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:36:04.830514 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:36:04.830514 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:36:04.830514 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:36:04.830514 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:36:04.830514 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:36:04.830514 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:36:04.830514 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:36:04.830514 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:36:04.832946 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:36:04.832946 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:36:04.832946 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Sep 23 04:36:04.832946 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 23 04:36:04.832946 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 23 04:36:04.832946 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:36:04.832946 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:36:04.832946 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:36:04.832946 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:36:04.832946 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:36:04.832946 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:36:04.832946 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:36:04.832946 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:36:04.832946 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 23 04:36:04.832946 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:36:04.832946 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4ecac547-09e1-4b8b-a443-44a13735cbf8 tempest-ListImageFiltersNegativeTestJSON-351084829 tempest-ListImageFiltersNegativeTestJSON-351084829-project] Returning 404 to user: Image not found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:36:04.835047 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4ecac547-09e1-4b8b-a443-44a13735cbf8 tempest-ListImageFiltersNegativeTestJSON-351084829 tempest-ListImageFiltersNegativeTestJSON-351084829-project] 10.222.0.33 "GET /compute/v2.1/images/20142dc1-99a4-47a0-9925-8ca534a8e8b5" status: 404 len: 62 microversion: 2.1 time: 0.213978 Sep 23 04:36:04.835047 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 727/1402] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:36:04 2022] GET /compute/v2.1/images/20142dc1-99a4-47a0-9925-8ca534a8e8b5 => generated 62 bytes in 235 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 23 04:36:04.960081 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c0c2079b-02bd-42b9-a06a-d4543ef98fd4 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a00bc3e62774185b48120832e80476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f931b8de0b4402a3833577fbb15607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:04.973438 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c0c2079b-02bd-42b9-a06a-d4543ef98fd4 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] 10.222.0.33 "GET /compute/v2.1/servers/1bf70366-2b4c-4df9-a6be-1c9145fb3862" status: 200 len: 1648 microversion: 2.1 time: 0.287600 Sep 23 04:36:04.974589 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 676/1403] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:04 2022] GET /compute/v2.1/servers/1bf70366-2b4c-4df9-a6be-1c9145fb3862 => generated 1648 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:36:05.174239 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c6ddd2b7-6768-4109-8b90-2153564ff6c4 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:05.174858 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c6ddd2b7-6768-4109-8b90-2153564ff6c4 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 1180ceb9-a888-4a3b-ba9d-a35afa8dc279] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:05.183033 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c6ddd2b7-6768-4109-8b90-2153564ff6c4 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:05.183539 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c6ddd2b7-6768-4109-8b90-2153564ff6c4 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:05.183993 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c6ddd2b7-6768-4109-8b90-2153564ff6c4 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:05.184709 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c6ddd2b7-6768-4109-8b90-2153564ff6c4 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:05.185176 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c6ddd2b7-6768-4109-8b90-2153564ff6c4 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:05.185609 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c6ddd2b7-6768-4109-8b90-2153564ff6c4 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:05.190166 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:36:05.366825 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c6ddd2b7-6768-4109-8b90-2153564ff6c4 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:05.376885 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c6ddd2b7-6768-4109-8b90-2153564ff6c4 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/1180ceb9-a888-4a3b-ba9d-a35afa8dc279" status: 200 len: 1317 microversion: 2.1 time: 0.206100 Sep 23 04:36:05.378176 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 728/1404] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:05 2022] GET /compute/v2.1/servers/1180ceb9-a888-4a3b-ba9d-a35afa8dc279 => generated 1317 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:05.621839 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c340456f-474e-402b-83d7-5ba00583b76d tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:05.624551 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c340456f-474e-402b-83d7-5ba00583b76d tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:05.646357 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c340456f-474e-402b-83d7-5ba00583b76d tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:05.648840 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c340456f-474e-402b-83d7-5ba00583b76d tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:05.648840 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c340456f-474e-402b-83d7-5ba00583b76d tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:05.649425 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c340456f-474e-402b-83d7-5ba00583b76d tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:05.650133 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c340456f-474e-402b-83d7-5ba00583b76d tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:05.650862 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c340456f-474e-402b-83d7-5ba00583b76d tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:05.905616 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c340456f-474e-402b-83d7-5ba00583b76d tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:05.915710 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c340456f-474e-402b-83d7-5ba00583b76d tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea" status: 200 len: 1313 microversion: 2.1 time: 0.300515 Sep 23 04:36:05.916614 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 677/1405] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:05 2022] GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea => generated 1313 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:05.997422 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2807cf19-7d7e-4a1a-80f5-25f30a18cdbe tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:05.999597 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-2807cf19-7d7e-4a1a-80f5-25f30a18cdbe tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] [instance: 1bf70366-2b4c-4df9-a6be-1c9145fb3862] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:06.017261 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2807cf19-7d7e-4a1a-80f5-25f30a18cdbe tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:06.019112 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2807cf19-7d7e-4a1a-80f5-25f30a18cdbe tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:06.020224 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2807cf19-7d7e-4a1a-80f5-25f30a18cdbe tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:06.027311 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2807cf19-7d7e-4a1a-80f5-25f30a18cdbe tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:06.028025 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2807cf19-7d7e-4a1a-80f5-25f30a18cdbe tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:06.028531 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2807cf19-7d7e-4a1a-80f5-25f30a18cdbe tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:06.388004 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2807cf19-7d7e-4a1a-80f5-25f30a18cdbe tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a00bc3e62774185b48120832e80476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f931b8de0b4402a3833577fbb15607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:06.403480 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6a9f9544-e0f8-4290-af07-99aae6a2841a tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:06.406900 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-6a9f9544-e0f8-4290-af07-99aae6a2841a tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 1180ceb9-a888-4a3b-ba9d-a35afa8dc279] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:06.413126 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2807cf19-7d7e-4a1a-80f5-25f30a18cdbe tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] 10.222.0.33 "GET /compute/v2.1/servers/1bf70366-2b4c-4df9-a6be-1c9145fb3862" status: 200 len: 1648 microversion: 2.1 time: 0.404831 Sep 23 04:36:06.415587 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 729/1406] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:05 2022] GET /compute/v2.1/servers/1bf70366-2b4c-4df9-a6be-1c9145fb3862 => generated 1648 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:06.416711 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6a9f9544-e0f8-4290-af07-99aae6a2841a tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:06.417800 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6a9f9544-e0f8-4290-af07-99aae6a2841a tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:06.418084 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6a9f9544-e0f8-4290-af07-99aae6a2841a tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:06.418975 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6a9f9544-e0f8-4290-af07-99aae6a2841a tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:06.419769 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6a9f9544-e0f8-4290-af07-99aae6a2841a tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:06.420363 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6a9f9544-e0f8-4290-af07-99aae6a2841a tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:06.547071 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-61b86c50-9da5-4189-bd25-e41eee01b3d4 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-665636611", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "019d7df5-4f38-47cb-b9f3-1f0f6f2be581"}], "block_device_mapping_v2": [{"uuid": "84ab9033-1a60-41e9-bf8e-f1b226570235", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:36:06.641327 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.neutron [None req-61b86c50-9da5-4189-bd25-e41eee01b3d4 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] validate_networks() for [('019d7df5-4f38-47cb-b9f3-1f0f6f2be581', None, None, None, None, None)] {{(pid=122699) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:36:06.932831 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6a9f9544-e0f8-4290-af07-99aae6a2841a tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:06.950077 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-6a9f9544-e0f8-4290-af07-99aae6a2841a tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/1180ceb9-a888-4a3b-ba9d-a35afa8dc279" status: 200 len: 1467 microversion: 2.1 time: 0.553228 Sep 23 04:36:06.951960 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 678/1407] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:06 2022] GET /compute/v2.1/servers/1180ceb9-a888-4a3b-ba9d-a35afa8dc279 => generated 1467 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:06.969041 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-09e7899a-8026-470e-a03d-a28bd4746a90 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:06.969718 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-09e7899a-8026-470e-a03d-a28bd4746a90 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:07.001279 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-09e7899a-8026-470e-a03d-a28bd4746a90 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:07.001856 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-09e7899a-8026-470e-a03d-a28bd4746a90 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:07.002786 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-09e7899a-8026-470e-a03d-a28bd4746a90 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:07.003575 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-09e7899a-8026-470e-a03d-a28bd4746a90 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:07.004393 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-09e7899a-8026-470e-a03d-a28bd4746a90 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:07.004836 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-09e7899a-8026-470e-a03d-a28bd4746a90 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:07.489969 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-09e7899a-8026-470e-a03d-a28bd4746a90 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:07.498021 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-09e7899a-8026-470e-a03d-a28bd4746a90 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea" status: 200 len: 1313 microversion: 2.1 time: 0.544790 Sep 23 04:36:07.498615 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 679/1408] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:06 2022] GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea => generated 1313 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:07.713073 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-61b86c50-9da5-4189-bd25-e41eee01b3d4 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Flavor limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:36:07.714656 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-61b86c50-9da5-4189-bd25-e41eee01b3d4 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Image limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:36:07.715388 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-61b86c50-9da5-4189-bd25-e41eee01b3d4 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Flavor pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:36:07.716067 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-61b86c50-9da5-4189-bd25-e41eee01b3d4 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Image pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:36:07.716717 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-61b86c50-9da5-4189-bd25-e41eee01b3d4 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:36:07.736947 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-61b86c50-9da5-4189-bd25-e41eee01b3d4 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:07.740557 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-61b86c50-9da5-4189-bd25-e41eee01b3d4 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:07.741124 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-61b86c50-9da5-4189-bd25-e41eee01b3d4 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:07.742988 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-61b86c50-9da5-4189-bd25-e41eee01b3d4 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:07.743713 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-61b86c50-9da5-4189-bd25-e41eee01b3d4 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:07.744383 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-61b86c50-9da5-4189-bd25-e41eee01b3d4 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:07.769266 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-61b86c50-9da5-4189-bd25-e41eee01b3d4 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Getting quotas for project 0abccbbae40b47968a8dda6323b618e3. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:36:07.778094 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-61b86c50-9da5-4189-bd25-e41eee01b3d4 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Getting quotas for user 84d0c7a6520443d896f88069e91a2eb2 and project 0abccbbae40b47968a8dda6323b618e3. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:36:07.829573 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-21787b13-eb19-45f6-9998-d9c8adc4aff1 tempest-ServersOnMultiNodesTest-617918424 tempest-ServersOnMultiNodesTest-617918424-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:07.831073 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-21787b13-eb19-45f6-9998-d9c8adc4aff1 tempest-ServersOnMultiNodesTest-617918424 tempest-ServersOnMultiNodesTest-617918424-project-admin] [instance: 1180ceb9-a888-4a3b-ba9d-a35afa8dc279] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:07.867289 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-21787b13-eb19-45f6-9998-d9c8adc4aff1 tempest-ServersOnMultiNodesTest-617918424 tempest-ServersOnMultiNodesTest-617918424-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:07.867799 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-21787b13-eb19-45f6-9998-d9c8adc4aff1 tempest-ServersOnMultiNodesTest-617918424 tempest-ServersOnMultiNodesTest-617918424-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:07.868244 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-21787b13-eb19-45f6-9998-d9c8adc4aff1 tempest-ServersOnMultiNodesTest-617918424 tempest-ServersOnMultiNodesTest-617918424-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:07.869219 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-21787b13-eb19-45f6-9998-d9c8adc4aff1 tempest-ServersOnMultiNodesTest-617918424 tempest-ServersOnMultiNodesTest-617918424-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:07.869689 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-21787b13-eb19-45f6-9998-d9c8adc4aff1 tempest-ServersOnMultiNodesTest-617918424 tempest-ServersOnMultiNodesTest-617918424-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:07.870810 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-21787b13-eb19-45f6-9998-d9c8adc4aff1 tempest-ServersOnMultiNodesTest-617918424 tempest-ServersOnMultiNodesTest-617918424-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:07.910566 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-61b86c50-9da5-4189-bd25-e41eee01b3d4 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Going to run 1 instances... {{(pid=122699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:36:07.921007 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-61b86c50-9da5-4189-bd25-e41eee01b3d4 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 9e9a41f2-ff28-4c2a-80aa-193e0ebce466] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='84ab9033-1a60-41e9-bf8e-f1b226570235',volume_size=None,volume_type=None)] {{(pid=122699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:36:08.328955 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-21787b13-eb19-45f6-9998-d9c8adc4aff1 tempest-ServersOnMultiNodesTest-617918424 tempest-ServersOnMultiNodesTest-617918424-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/1180ceb9-a888-4a3b-ba9d-a35afa8dc279" status: 200 len: 1618 microversion: 2.1 time: 0.828532 Sep 23 04:36:08.332974 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 680/1409] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:07 2022] GET /compute/v2.1/servers/1180ceb9-a888-4a3b-ba9d-a35afa8dc279 => generated 1618 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:08.336133 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-46caf015-2297-48ee-b82e-7aa1c2b46a65 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:08.337056 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-46caf015-2297-48ee-b82e-7aa1c2b46a65 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] [instance: 1bf70366-2b4c-4df9-a6be-1c9145fb3862] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:08.350647 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-46caf015-2297-48ee-b82e-7aa1c2b46a65 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:08.351186 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-46caf015-2297-48ee-b82e-7aa1c2b46a65 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:08.351632 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-46caf015-2297-48ee-b82e-7aa1c2b46a65 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:08.352570 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-46caf015-2297-48ee-b82e-7aa1c2b46a65 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:08.353043 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-46caf015-2297-48ee-b82e-7aa1c2b46a65 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:08.353476 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-46caf015-2297-48ee-b82e-7aa1c2b46a65 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:08.391995 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-46caf015-2297-48ee-b82e-7aa1c2b46a65 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:08.392697 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-46caf015-2297-48ee-b82e-7aa1c2b46a65 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:08.393291 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-46caf015-2297-48ee-b82e-7aa1c2b46a65 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:08.393952 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-46caf015-2297-48ee-b82e-7aa1c2b46a65 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lazy-loading 'fault' on Instance uuid 1bf70366-2b4c-4df9-a6be-1c9145fb3862 {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:36:08.438603 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-46caf015-2297-48ee-b82e-7aa1c2b46a65 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a00bc3e62774185b48120832e80476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f931b8de0b4402a3833577fbb15607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:08.446986 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-46caf015-2297-48ee-b82e-7aa1c2b46a65 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] 10.222.0.33 "GET /compute/v2.1/servers/1bf70366-2b4c-4df9-a6be-1c9145fb3862" status: 200 len: 1306 microversion: 2.1 time: 0.115698 Sep 23 04:36:08.447754 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 681/1410] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:08 2022] GET /compute/v2.1/servers/1bf70366-2b4c-4df9-a6be-1c9145fb3862 => generated 1306 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:08.537943 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-61b86c50-9da5-4189-bd25-e41eee01b3d4 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.994569 Sep 23 04:36:08.546384 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 730/1411] 10.222.0.33 () {62 vars in 1188 bytes} [Fri Sep 23 04:36:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 2004 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 23 04:36:08.553581 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-bec66d3a-7d58-4942-945f-e4a04326751e req-742294b0-e6b9-4d6c-a2b5-08221bb59b56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea", "name": "network-vif-plugged", "status": "completed", "tag": "4270b6dd-6896-414f-8926-bc0f7819f6f7"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:36:08.578941 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-bec66d3a-7d58-4942-945f-e4a04326751e req-742294b0-e6b9-4d6c-a2b5-08221bb59b56 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:08.579605 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-bec66d3a-7d58-4942-945f-e4a04326751e req-742294b0-e6b9-4d6c-a2b5-08221bb59b56 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:08.582304 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-bec66d3a-7d58-4942-945f-e4a04326751e req-742294b0-e6b9-4d6c-a2b5-08221bb59b56 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:08.599929 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-bec66d3a-7d58-4942-945f-e4a04326751e req-742294b0-e6b9-4d6c-a2b5-08221bb59b56 service nova] Creating event network-vif-plugged:4270b6dd-6896-414f-8926-bc0f7819f6f7 for instance f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea on n-h2-846463-3 Sep 23 04:36:08.607016 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-bec66d3a-7d58-4942-945f-e4a04326751e req-742294b0-e6b9-4d6c-a2b5-08221bb59b56 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058836 Sep 23 04:36:08.608192 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 731/1412] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:36:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:36:08.618810 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-25aae47b-4ee7-456f-9c09-8e9cb2e81144 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Action: 'create', calling method: .version_select at 0x7ff1bb9d8e50>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1026478135", "policies": ["affinity"]}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:36:08.620444 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-104798b0-7c36-4a06-b010-93cd58e74317 req-a7f4af41-2337-422e-abea-bf540058ae43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bf70366-2b4c-4df9-a6be-1c9145fb3862", "name": "network-vif-deleted", "tag": "c99566be-c1ff-41dd-9148-37f8e480c982"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:36:08.634555 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-25aae47b-4ee7-456f-9c09-8e9cb2e81144 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Getting quotas for project f5db359a60174c45afa2bf06e23a46c4. Resources: {'server_groups'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:36:08.648089 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-104798b0-7c36-4a06-b010-93cd58e74317 req-a7f4af41-2337-422e-abea-bf540058ae43 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:08.648089 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-104798b0-7c36-4a06-b010-93cd58e74317 req-a7f4af41-2337-422e-abea-bf540058ae43 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:08.648089 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-104798b0-7c36-4a06-b010-93cd58e74317 req-a7f4af41-2337-422e-abea-bf540058ae43 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:08.648502 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-25aae47b-4ee7-456f-9c09-8e9cb2e81144 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Getting quotas for user da08af8193dd490b93278385583f24c0 and project f5db359a60174c45afa2bf06e23a46c4. Resources: {'server_groups'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:36:08.668323 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-104798b0-7c36-4a06-b010-93cd58e74317 req-a7f4af41-2337-422e-abea-bf540058ae43 service nova] Creating event network-vif-deleted:c99566be-c1ff-41dd-9148-37f8e480c982 for instance 1bf70366-2b4c-4df9-a6be-1c9145fb3862 on n-h1-846463-3 Sep 23 04:36:08.679851 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-104798b0-7c36-4a06-b010-93cd58e74317 req-a7f4af41-2337-422e-abea-bf540058ae43 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.229958 Sep 23 04:36:08.681520 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 682/1413] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:36:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:36:08.690942 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d3850a4a-4d42-464d-b412-2494326d92f2 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:08.691749 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d3850a4a-4d42-464d-b412-2494326d92f2 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:08.699588 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d3850a4a-4d42-464d-b412-2494326d92f2 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:08.700734 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d3850a4a-4d42-464d-b412-2494326d92f2 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:08.701584 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d3850a4a-4d42-464d-b412-2494326d92f2 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:08.702548 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d3850a4a-4d42-464d-b412-2494326d92f2 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:08.703178 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d3850a4a-4d42-464d-b412-2494326d92f2 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:08.703922 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d3850a4a-4d42-464d-b412-2494326d92f2 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:08.772321 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-25aae47b-4ee7-456f-9c09-8e9cb2e81144 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Getting quotas for project f5db359a60174c45afa2bf06e23a46c4. Resources: {'server_groups'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:36:08.777985 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-25aae47b-4ee7-456f-9c09-8e9cb2e81144 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Getting quotas for user da08af8193dd490b93278385583f24c0 and project f5db359a60174c45afa2bf06e23a46c4. Resources: {'server_groups'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:36:08.792959 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-25aae47b-4ee7-456f-9c09-8e9cb2e81144 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "POST /compute/v2.1/os-server-groups" status: 200 len: 188 microversion: 2.1 time: 0.183341 Sep 23 04:36:08.794377 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 732/1414] 10.222.0.33 () {60 vars in 1174 bytes} [Fri Sep 23 04:36:08 2022] POST /compute/v2.1/os-server-groups => generated 188 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:36:08.801460 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7730eeee-9c29-4b65-b0db-b5297b080cbe tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:08.802415 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-7730eeee-9c29-4b65-b0db-b5297b080cbe tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 9e9a41f2-ff28-4c2a-80aa-193e0ebce466] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:08.955479 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-7730eeee-9c29-4b65-b0db-b5297b080cbe tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:08.971224 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-7730eeee-9c29-4b65-b0db-b5297b080cbe tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:08.975540 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-7730eeee-9c29-4b65-b0db-b5297b080cbe tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:08.980607 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-7730eeee-9c29-4b65-b0db-b5297b080cbe tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466" status: 200 len: 1103 microversion: 2.25 time: 0.184513 Sep 23 04:36:08.981547 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 733/1415] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:36:08 2022] GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466 => generated 1103 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:36:08.996572 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-113f3d2f-2a1a-491f-a190-78f320531193 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1329936898", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "a3bd0e69-7ea7-4fa0-8be9-2d7b06373cbc"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:36:09.036097 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d3850a4a-4d42-464d-b412-2494326d92f2 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:09.054954 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d3850a4a-4d42-464d-b412-2494326d92f2 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea" status: 200 len: 1313 microversion: 2.1 time: 0.369873 Sep 23 04:36:09.070641 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 683/1416] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:08 2022] GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea => generated 1313 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:09.100754 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.neutron [None req-113f3d2f-2a1a-491f-a190-78f320531193 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] validate_networks() for None {{(pid=122699) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:36:09.472893 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b23e0be2-1698-4bbf-9e92-eb2e77497077 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:09.473546 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b23e0be2-1698-4bbf-9e92-eb2e77497077 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] [instance: 1bf70366-2b4c-4df9-a6be-1c9145fb3862] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:09.488819 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b23e0be2-1698-4bbf-9e92-eb2e77497077 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:09.490360 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b23e0be2-1698-4bbf-9e92-eb2e77497077 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:09.491079 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b23e0be2-1698-4bbf-9e92-eb2e77497077 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:09.493500 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b23e0be2-1698-4bbf-9e92-eb2e77497077 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:09.495285 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b23e0be2-1698-4bbf-9e92-eb2e77497077 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:09.497809 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b23e0be2-1698-4bbf-9e92-eb2e77497077 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:09.531258 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-b23e0be2-1698-4bbf-9e92-eb2e77497077 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] HTTP exception thrown: Instance 1bf70366-2b4c-4df9-a6be-1c9145fb3862 could not be found. Sep 23 04:36:09.535423 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b23e0be2-1698-4bbf-9e92-eb2e77497077 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Request method failure captured: Sep 23 04:36:09.535423 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/1bf70366-2b4c-4df9-a6be-1c9145fb3862 HTTP/1.1 Sep 23 04:36:09.535423 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:36:09.535423 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:36:09.535423 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:36:09.535423 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:36:09.535423 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:36:09.535423 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:36:09.535423 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:36:09.535423 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:36:09.535423 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTdzwKLwM5Huuc3OkGbV0-q8wtlsijivZwHLFFvwUn7aqwjwo0Mvf0QANB4RO3tvB8rSgFY67c2VjxeEJzRrvjiDhhi9XOqh7sPsdzyKRA33MX1kyET93FlWBs-I4ky6udbWqL2rlse4AqwXx6x3kt0moKWN4SwJfbsgKX9smPZbJsM Sep 23 04:36:09.535423 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:36:09.535423 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:36:09.535423 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:36:09.535423 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:36:09.535423 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:36:09.535423 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:36:09.535423 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: a3f931b8de0b4402a3833577fbb15607 Sep 23 04:36:09.535423 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-SecurityGroupsTestJSON-1588002272 Sep 23 04:36:09.535423 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:36:09.535423 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:36:09.537045 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a3f931b8de0b4402a3833577fbb15607", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a3f931b8de0b4402a3833577fbb15607"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a3f931b8de0b4402a3833577fbb15607"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a3f931b8de0b4402a3833577fbb15607"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:36:09.537045 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-SecurityGroupsTestJSON-1588002272 Sep 23 04:36:09.537045 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: a3f931b8de0b4402a3833577fbb15607 Sep 23 04:36:09.537045 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1588002272 Sep 23 04:36:09.537045 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-SecurityGroupsTestJSON-1588002272-project Sep 23 04:36:09.537045 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:36:09.537045 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:36:09.537045 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 8a00bc3e62774185b48120832e80476d Sep 23 04:36:09.537045 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-SecurityGroupsTestJSON-1588002272-project Sep 23 04:36:09.537045 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:36:09.537045 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 1bf70366-2b4c-4df9-a6be-1c9145fb3862 could not be found. Sep 23 04:36:09.537045 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '1bf70366-2b4c-4df9-a6be-1c9145fb3862'} Sep 23 04:36:09.538015 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:36:09.538015 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:36:09.538015 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:36:09.538015 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:36:09.538015 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:36:09.538015 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:36:09.538015 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:36:09.538015 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:36:09.538015 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:36:09.538015 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:36:09.538015 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1bf70366-2b4c-4df9-a6be-1c9145fb3862 could not be found. Sep 23 04:36:09.538015 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:36:09.538015 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:36:09.538015 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:36:09.538015 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:36:09.538015 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:36:09.538015 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:36:09.538015 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:36:09.538015 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:36:09.538015 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:36:09.540032 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:36:09.540032 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:36:09.540032 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:36:09.540032 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:36:09.540032 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:36:09.540032 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:36:09.540032 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:36:09.540032 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1bf70366-2b4c-4df9-a6be-1c9145fb3862 could not be found. Sep 23 04:36:09.540032 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:36:09.540032 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:36:09.540032 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:36:09.540032 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:36:09.540032 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:36:09.540032 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:36:09.540032 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:36:09.540032 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:36:09.540032 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1bf70366-2b4c-4df9-a6be-1c9145fb3862 could not be found. Sep 23 04:36:09.540032 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:36:09.545360 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b23e0be2-1698-4bbf-9e92-eb2e77497077 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Returning 404 to user: Instance 1bf70366-2b4c-4df9-a6be-1c9145fb3862 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:36:09.548044 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b23e0be2-1698-4bbf-9e92-eb2e77497077 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] 10.222.0.33 "GET /compute/v2.1/servers/1bf70366-2b4c-4df9-a6be-1c9145fb3862" status: 404 len: 111 microversion: 2.1 time: 0.080057 Sep 23 04:36:09.549436 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 684/1417] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:09 2022] GET /compute/v2.1/servers/1bf70366-2b4c-4df9-a6be-1c9145fb3862 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 04:36:09.561360 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f11be595-24ed-4e5a-b02a-c052d5ddea50 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Calling method '.version_select at 0x7ff1bb909430>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:09.691621 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-113f3d2f-2a1a-491f-a190-78f320531193 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Flavor limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:36:09.692048 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-113f3d2f-2a1a-491f-a190-78f320531193 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Image limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:36:09.692702 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-113f3d2f-2a1a-491f-a190-78f320531193 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Flavor pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:36:09.693304 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-113f3d2f-2a1a-491f-a190-78f320531193 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Image pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:36:09.693951 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-113f3d2f-2a1a-491f-a190-78f320531193 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:36:09.713531 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:36:09.724730 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-113f3d2f-2a1a-491f-a190-78f320531193 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:09.724730 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-113f3d2f-2a1a-491f-a190-78f320531193 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:09.724730 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-113f3d2f-2a1a-491f-a190-78f320531193 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:09.724730 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-113f3d2f-2a1a-491f-a190-78f320531193 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:09.725169 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-113f3d2f-2a1a-491f-a190-78f320531193 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:09.725169 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-113f3d2f-2a1a-491f-a190-78f320531193 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:09.743552 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-113f3d2f-2a1a-491f-a190-78f320531193 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Getting quotas for project f5db359a60174c45afa2bf06e23a46c4. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:36:09.751498 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-113f3d2f-2a1a-491f-a190-78f320531193 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Getting quotas for user da08af8193dd490b93278385583f24c0 and project f5db359a60174c45afa2bf06e23a46c4. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:36:09.774131 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-113f3d2f-2a1a-491f-a190-78f320531193 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Going to run 2 instances... {{(pid=122699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:36:09.776925 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-113f3d2f-2a1a-491f-a190-78f320531193 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 19e41421-3550-49fe-90d0-64b07a5efefa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:36:09.929548 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f11be595-24ed-4e5a-b02a-c052d5ddea50 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/ac6c071f-b48d-4383-a2e9-e5de9103136d" status: 202 len: 0 microversion: 2.1 time: 0.375472 Sep 23 04:36:09.930388 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 685/1418] 10.222.0.33 () {58 vars in 1272 bytes} [Fri Sep 23 04:36:09 2022] DELETE /compute/v2.1/os-security-groups/ac6c071f-b48d-4383-a2e9-e5de9103136d => generated 0 bytes in 377 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:36:09.938320 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-75f35b80-2e05-478c-b3b9-a2d5f0014237 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Calling method '.version_select at 0x7ff1bbbfb4c0>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:09.970858 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-113f3d2f-2a1a-491f-a190-78f320531193 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=122699) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Sep 23 04:36:09.992998 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-113f3d2f-2a1a-491f-a190-78f320531193 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Getting quotas for project f5db359a60174c45afa2bf06e23a46c4. Resources: {'server_group_members'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:36:09.998005 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-113f3d2f-2a1a-491f-a190-78f320531193 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Getting quotas for user da08af8193dd490b93278385583f24c0 and project f5db359a60174c45afa2bf06e23a46c4. Resources: {'server_group_members'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:36:10.203781 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-113f3d2f-2a1a-491f-a190-78f320531193 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Getting quotas for project f5db359a60174c45afa2bf06e23a46c4. Resources: {'server_group_members'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:36:10.212050 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-113f3d2f-2a1a-491f-a190-78f320531193 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Getting quotas for user da08af8193dd490b93278385583f24c0 and project f5db359a60174c45afa2bf06e23a46c4. Resources: {'server_group_members'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:36:10.228052 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-113f3d2f-2a1a-491f-a190-78f320531193 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: b4a75706-ba44-4b2c-8767-071502169d5a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=19e41421-3550-49fe-90d0-64b07a5efefa,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:36:10.344872 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-75f35b80-2e05-478c-b3b9-a2d5f0014237 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/4af791f9-f06f-4b60-ba7c-8ef76cb6893c" status: 202 len: 0 microversion: 2.1 time: 0.409985 Sep 23 04:36:10.352126 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 686/1419] 10.222.0.33 () {58 vars in 1272 bytes} [Fri Sep 23 04:36:09 2022] DELETE /compute/v2.1/os-security-groups/4af791f9-f06f-4b60-ba7c-8ef76cb6893c => generated 0 bytes in 418 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 23 04:36:10.358227 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d46a6cf3-b92d-4f92-bf5f-8a291e0c8aee tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:10.359371 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d46a6cf3-b92d-4f92-bf5f-8a291e0c8aee tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 9e9a41f2-ff28-4c2a-80aa-193e0ebce466] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:10.379853 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d46a6cf3-b92d-4f92-bf5f-8a291e0c8aee tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:10.380551 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d46a6cf3-b92d-4f92-bf5f-8a291e0c8aee tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:10.381102 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d46a6cf3-b92d-4f92-bf5f-8a291e0c8aee tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:10.396853 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d46a6cf3-b92d-4f92-bf5f-8a291e0c8aee tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:10.398735 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d46a6cf3-b92d-4f92-bf5f-8a291e0c8aee tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:10.401066 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d46a6cf3-b92d-4f92-bf5f-8a291e0c8aee tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:10.422432 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-113f3d2f-2a1a-491f-a190-78f320531193 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Getting quotas for project f5db359a60174c45afa2bf06e23a46c4. Resources: {'server_group_members'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:36:10.427830 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-113f3d2f-2a1a-491f-a190-78f320531193 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Getting quotas for user da08af8193dd490b93278385583f24c0 and project f5db359a60174c45afa2bf06e23a46c4. Resources: {'server_group_members'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:36:10.437541 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:36:10.496193 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d46a6cf3-b92d-4f92-bf5f-8a291e0c8aee tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:10.505986 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d46a6cf3-b92d-4f92-bf5f-8a291e0c8aee tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:10.508384 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d46a6cf3-b92d-4f92-bf5f-8a291e0c8aee tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:10.510103 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d46a6cf3-b92d-4f92-bf5f-8a291e0c8aee tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466" status: 200 len: 1184 microversion: 2.25 time: 0.156520 Sep 23 04:36:10.511066 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 687/1420] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:36:10 2022] GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466 => generated 1184 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:36:10.515719 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e45acf85-6f7a-4426-b0d8-b85eb2a38580 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:10.516615 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e45acf85-6f7a-4426-b0d8-b85eb2a38580 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:10.522874 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e45acf85-6f7a-4426-b0d8-b85eb2a38580 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:10.523363 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e45acf85-6f7a-4426-b0d8-b85eb2a38580 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:10.523800 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e45acf85-6f7a-4426-b0d8-b85eb2a38580 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:10.524500 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e45acf85-6f7a-4426-b0d8-b85eb2a38580 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:10.524954 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e45acf85-6f7a-4426-b0d8-b85eb2a38580 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:10.525370 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e45acf85-6f7a-4426-b0d8-b85eb2a38580 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:10.606413 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-113f3d2f-2a1a-491f-a190-78f320531193 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Getting quotas for project f5db359a60174c45afa2bf06e23a46c4. Resources: {'server_group_members'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:36:10.611611 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-113f3d2f-2a1a-491f-a190-78f320531193 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Getting quotas for user da08af8193dd490b93278385583f24c0 and project f5db359a60174c45afa2bf06e23a46c4. Resources: {'server_group_members'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:36:10.651335 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-113f3d2f-2a1a-491f-a190-78f320531193 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.667962 Sep 23 04:36:10.651973 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 734/1421] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:36:08 2022] POST /compute/v2.1/servers => generated 32 bytes in 1670 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Sep 23 04:36:10.657633 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-48d71952-9dc5-4e5a-ae5b-c0b356e05172 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Action: 'create', calling method: .version_select at 0x7ff1bb7d2e50>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-427167884", "description": "tempest-description-1349269269"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:36:10.766349 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e45acf85-6f7a-4426-b0d8-b85eb2a38580 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:10.777595 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e45acf85-6f7a-4426-b0d8-b85eb2a38580 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea" status: 200 len: 1313 microversion: 2.1 time: 0.265304 Sep 23 04:36:10.780431 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 688/1422] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:10 2022] GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea => generated 1313 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:10.790390 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1375870e-482f-4d3a-9293-ef3ccb361db5 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:10.813783 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-1375870e-482f-4d3a-9293-ef3ccb361db5 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:10.814672 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-1375870e-482f-4d3a-9293-ef3ccb361db5 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Searching by: {'deleted': False, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4'} {{(pid=122698) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 04:36:10.834151 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1375870e-482f-4d3a-9293-ef3ccb361db5 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:10.834709 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1375870e-482f-4d3a-9293-ef3ccb361db5 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:10.835197 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1375870e-482f-4d3a-9293-ef3ccb361db5 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:10.835937 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1375870e-482f-4d3a-9293-ef3ccb361db5 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:10.836490 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1375870e-482f-4d3a-9293-ef3ccb361db5 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:10.836990 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1375870e-482f-4d3a-9293-ef3ccb361db5 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:10.941237 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.multi_cell_list [None req-1375870e-482f-4d3a-9293-ef3ccb361db5 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=122698) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 23 04:36:11.013091 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-1375870e-482f-4d3a-9293-ef3ccb361db5 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 1004 microversion: 2.1 time: 0.231314 Sep 23 04:36:11.013779 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 689/1423] 10.222.0.33 () {58 vars in 1125 bytes} [Fri Sep 23 04:36:10 2022] GET /compute/v2.1/servers => generated 1004 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:11.029021 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2715345b-d855-4e3c-9c8f-8d7fabada2e4 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:11.029694 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-2715345b-d855-4e3c-9c8f-8d7fabada2e4 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: b4a75706-ba44-4b2c-8767-071502169d5a] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:11.155245 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-2715345b-d855-4e3c-9c8f-8d7fabada2e4 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:11.164076 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2715345b-d855-4e3c-9c8f-8d7fabada2e4 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/b4a75706-ba44-4b2c-8767-071502169d5a" status: 200 len: 1219 microversion: 2.1 time: 0.138619 Sep 23 04:36:11.164692 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 690/1424] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:11 2022] GET /compute/v2.1/servers/b4a75706-ba44-4b2c-8767-071502169d5a => generated 1219 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:11.240250 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-48d71952-9dc5-4e5a-ae5b-c0b356e05172 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.587180 Sep 23 04:36:11.240855 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 735/1425] 10.222.0.33 () {60 vars in 1180 bytes} [Fri Sep 23 04:36:10 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:36:11.255873 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5ff4d531-5b15-4a4f-8cd4-df311cf88288 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Action: 'update', calling method: .version_select at 0x7ff1bb9094c0>, body: {"security_group": {"name": "tempest-sg-hth-1579291416", "description": "tempest-description-hth-120516164"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:36:11.540016 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-37a2e43c-41e3-45c5-a86d-215500a74042 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:11.540642 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-37a2e43c-41e3-45c5-a86d-215500a74042 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 9e9a41f2-ff28-4c2a-80aa-193e0ebce466] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:11.611656 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5ff4d531-5b15-4a4f-8cd4-df311cf88288 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] 10.222.0.33 "PUT /compute/v2.1/os-security-groups/d7155d42-1420-4952-bb25-6faec712d16b" status: 200 len: 217 microversion: 2.1 time: 0.360385 Sep 23 04:36:11.612717 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 691/1426] 10.222.0.33 () {60 vars in 1290 bytes} [Fri Sep 23 04:36:11 2022] PUT /compute/v2.1/os-security-groups/d7155d42-1420-4952-bb25-6faec712d16b => generated 217 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:36:11.631100 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3f4ce0b3-0bd8-42ea-99b4-4812ec2675ff tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Calling method '.version_select at 0x7ff1bb94e8b0>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:11.784741 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3f4ce0b3-0bd8-42ea-99b4-4812ec2675ff tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] 10.222.0.33 "GET /compute/v2.1/os-security-groups/d7155d42-1420-4952-bb25-6faec712d16b" status: 200 len: 217 microversion: 2.1 time: 0.162651 Sep 23 04:36:11.785606 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 692/1427] 10.222.0.33 () {58 vars in 1269 bytes} [Fri Sep 23 04:36:11 2022] GET /compute/v2.1/os-security-groups/d7155d42-1420-4952-bb25-6faec712d16b => generated 217 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:36:11.799990 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-31eb1e1a-9f3a-43c5-8ce8-e28101634c9b tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Calling method '.version_select at 0x7ff1bb96a9d0>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:11.852510 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-37a2e43c-41e3-45c5-a86d-215500a74042 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:11.855261 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-37a2e43c-41e3-45c5-a86d-215500a74042 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:11.855261 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-37a2e43c-41e3-45c5-a86d-215500a74042 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:11.855261 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-37a2e43c-41e3-45c5-a86d-215500a74042 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:11.855261 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-37a2e43c-41e3-45c5-a86d-215500a74042 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:11.855664 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-37a2e43c-41e3-45c5-a86d-215500a74042 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:11.943964 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-37a2e43c-41e3-45c5-a86d-215500a74042 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:11.966057 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-37a2e43c-41e3-45c5-a86d-215500a74042 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:11.967524 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-37a2e43c-41e3-45c5-a86d-215500a74042 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:11.968968 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-37a2e43c-41e3-45c5-a86d-215500a74042 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466" status: 200 len: 1232 microversion: 2.25 time: 0.437207 Sep 23 04:36:11.985540 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 736/1428] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:36:11 2022] GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466 => generated 1232 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:36:11.985540 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b8cc45d5-97b4-4a6c-989d-52ef6593be21 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:11.985540 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b8cc45d5-97b4-4a6c-989d-52ef6593be21 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:11.992285 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b8cc45d5-97b4-4a6c-989d-52ef6593be21 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:11.993013 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b8cc45d5-97b4-4a6c-989d-52ef6593be21 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:11.993824 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b8cc45d5-97b4-4a6c-989d-52ef6593be21 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:11.995652 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b8cc45d5-97b4-4a6c-989d-52ef6593be21 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:11.996297 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b8cc45d5-97b4-4a6c-989d-52ef6593be21 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:11.996966 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b8cc45d5-97b4-4a6c-989d-52ef6593be21 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:12.176841 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b8cc45d5-97b4-4a6c-989d-52ef6593be21 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:12.191965 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b8cc45d5-97b4-4a6c-989d-52ef6593be21 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea" status: 200 len: 1463 microversion: 2.1 time: 0.220887 Sep 23 04:36:12.193045 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 737/1429] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:11 2022] GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea => generated 1463 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:12.199963 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ee8b7327-f41f-4ef7-ab12-c2ef9fb2deb9 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:12.219648 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ee8b7327-f41f-4ef7-ab12-c2ef9fb2deb9 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: b4a75706-ba44-4b2c-8767-071502169d5a] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:12.224165 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-31eb1e1a-9f3a-43c5-8ce8-e28101634c9b tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/d7155d42-1420-4952-bb25-6faec712d16b" status: 202 len: 0 microversion: 2.1 time: 0.428713 Sep 23 04:36:12.229227 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 693/1430] 10.222.0.33 () {58 vars in 1272 bytes} [Fri Sep 23 04:36:11 2022] DELETE /compute/v2.1/os-security-groups/d7155d42-1420-4952-bb25-6faec712d16b => generated 0 bytes in 434 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:36:12.238042 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b49432da-4ec8-484e-b638-8b2e9ec25856 tempest-MigrationsAdminTest-295231043 tempest-MigrationsAdminTest-295231043-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:12.239637 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b49432da-4ec8-484e-b638-8b2e9ec25856 tempest-MigrationsAdminTest-295231043 tempest-MigrationsAdminTest-295231043-project-admin] [instance: f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:12.268104 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b49432da-4ec8-484e-b638-8b2e9ec25856 tempest-MigrationsAdminTest-295231043 tempest-MigrationsAdminTest-295231043-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:12.283954 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b49432da-4ec8-484e-b638-8b2e9ec25856 tempest-MigrationsAdminTest-295231043 tempest-MigrationsAdminTest-295231043-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:12.284554 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b49432da-4ec8-484e-b638-8b2e9ec25856 tempest-MigrationsAdminTest-295231043 tempest-MigrationsAdminTest-295231043-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:12.286350 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b49432da-4ec8-484e-b638-8b2e9ec25856 tempest-MigrationsAdminTest-295231043 tempest-MigrationsAdminTest-295231043-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:12.291364 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b49432da-4ec8-484e-b638-8b2e9ec25856 tempest-MigrationsAdminTest-295231043 tempest-MigrationsAdminTest-295231043-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:12.297106 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b49432da-4ec8-484e-b638-8b2e9ec25856 tempest-MigrationsAdminTest-295231043 tempest-MigrationsAdminTest-295231043-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:12.297360 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ee8b7327-f41f-4ef7-ab12-c2ef9fb2deb9 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:12.303015 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ee8b7327-f41f-4ef7-ab12-c2ef9fb2deb9 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/b4a75706-ba44-4b2c-8767-071502169d5a" status: 200 len: 1219 microversion: 2.1 time: 0.108475 Sep 23 04:36:12.319217 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 738/1431] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:12 2022] GET /compute/v2.1/servers/b4a75706-ba44-4b2c-8767-071502169d5a => generated 1219 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:12.330698 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-730cf820-6f30-44f2-98ac-4000ac0c6cfc tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:12.331453 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-730cf820-6f30-44f2-98ac-4000ac0c6cfc tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] [instance: 1bf70366-2b4c-4df9-a6be-1c9145fb3862] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:12.338138 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-730cf820-6f30-44f2-98ac-4000ac0c6cfc tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:12.338653 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-730cf820-6f30-44f2-98ac-4000ac0c6cfc tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:12.339092 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-730cf820-6f30-44f2-98ac-4000ac0c6cfc tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:12.339809 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-730cf820-6f30-44f2-98ac-4000ac0c6cfc tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:12.340271 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-730cf820-6f30-44f2-98ac-4000ac0c6cfc tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:12.340702 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-730cf820-6f30-44f2-98ac-4000ac0c6cfc tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:12.381183 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-730cf820-6f30-44f2-98ac-4000ac0c6cfc tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] HTTP exception thrown: Instance 1bf70366-2b4c-4df9-a6be-1c9145fb3862 could not be found. Sep 23 04:36:12.384112 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-730cf820-6f30-44f2-98ac-4000ac0c6cfc tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Request method failure captured: Sep 23 04:36:12.384112 n-d-846463-3 devstack@n-api.service[122699]: request: DELETE /compute/v2.1/servers/1bf70366-2b4c-4df9-a6be-1c9145fb3862 HTTP/1.1 Sep 23 04:36:12.384112 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:36:12.384112 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:36:12.384112 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:36:12.384112 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:36:12.384112 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:36:12.384112 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:36:12.384112 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:36:12.384112 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:36:12.384112 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTdzwKLwM5Huuc3OkGbV0-q8wtlsijivZwHLFFvwUn7aqwjwo0Mvf0QANB4RO3tvB8rSgFY67c2VjxeEJzRrvjiDhhi9XOqh7sPsdzyKRA33MX1kyET93FlWBs-I4ky6udbWqL2rlse4AqwXx6x3kt0moKWN4SwJfbsgKX9smPZbJsM Sep 23 04:36:12.384112 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:36:12.384112 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:36:12.384112 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:36:12.384112 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:36:12.384112 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:36:12.384112 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:36:12.384112 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: a3f931b8de0b4402a3833577fbb15607 Sep 23 04:36:12.384112 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-SecurityGroupsTestJSON-1588002272 Sep 23 04:36:12.384112 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:36:12.384112 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:36:12.385761 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a3f931b8de0b4402a3833577fbb15607", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a3f931b8de0b4402a3833577fbb15607"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a3f931b8de0b4402a3833577fbb15607"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a3f931b8de0b4402a3833577fbb15607"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:36:12.385761 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-SecurityGroupsTestJSON-1588002272 Sep 23 04:36:12.385761 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: a3f931b8de0b4402a3833577fbb15607 Sep 23 04:36:12.385761 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1588002272 Sep 23 04:36:12.385761 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-SecurityGroupsTestJSON-1588002272-project Sep 23 04:36:12.385761 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:36:12.385761 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:36:12.385761 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 8a00bc3e62774185b48120832e80476d Sep 23 04:36:12.385761 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-SecurityGroupsTestJSON-1588002272-project Sep 23 04:36:12.385761 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:36:12.385761 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 1bf70366-2b4c-4df9-a6be-1c9145fb3862 could not be found. Sep 23 04:36:12.385761 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '1bf70366-2b4c-4df9-a6be-1c9145fb3862'} Sep 23 04:36:12.386745 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:36:12.386745 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:36:12.386745 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:36:12.386745 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:36:12.386745 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:36:12.386745 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:36:12.386745 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:36:12.386745 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:36:12.386745 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:36:12.386745 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:36:12.386745 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1bf70366-2b4c-4df9-a6be-1c9145fb3862 could not be found. Sep 23 04:36:12.386745 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:36:12.386745 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:36:12.386745 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:36:12.386745 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:36:12.386745 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:36:12.386745 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:36:12.386745 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:36:12.386745 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:36:12.386745 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:36:12.388249 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:36:12.388249 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 04:36:12.388249 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 04:36:12.388249 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 04:36:12.388249 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 04:36:12.388249 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:36:12.388249 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:36:12.388249 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:36:12.388249 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:36:12.388249 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1bf70366-2b4c-4df9-a6be-1c9145fb3862 could not be found. Sep 23 04:36:12.388249 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:36:12.388249 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:36:12.388249 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:36:12.388249 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:36:12.388249 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:36:12.388249 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:36:12.388249 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:36:12.388249 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:36:12.388249 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1bf70366-2b4c-4df9-a6be-1c9145fb3862 could not be found. Sep 23 04:36:12.388249 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:36:12.391226 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-730cf820-6f30-44f2-98ac-4000ac0c6cfc tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Returning 404 to user: Instance 1bf70366-2b4c-4df9-a6be-1c9145fb3862 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:36:12.392304 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-730cf820-6f30-44f2-98ac-4000ac0c6cfc tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] 10.222.0.33 "DELETE /compute/v2.1/servers/1bf70366-2b4c-4df9-a6be-1c9145fb3862" status: 404 len: 111 microversion: 2.1 time: 0.071251 Sep 23 04:36:12.393185 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 739/1432] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:36:12 2022] DELETE /compute/v2.1/servers/1bf70366-2b4c-4df9-a6be-1c9145fb3862 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:36:12.402581 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8ab941a2-ff80-4487-9762-91c3f4769bd3 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:12.403652 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-8ab941a2-ff80-4487-9762-91c3f4769bd3 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] [instance: 1bf70366-2b4c-4df9-a6be-1c9145fb3862] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:12.411602 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8ab941a2-ff80-4487-9762-91c3f4769bd3 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:12.416564 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8ab941a2-ff80-4487-9762-91c3f4769bd3 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:12.418129 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8ab941a2-ff80-4487-9762-91c3f4769bd3 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:12.421658 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8ab941a2-ff80-4487-9762-91c3f4769bd3 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:12.423612 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8ab941a2-ff80-4487-9762-91c3f4769bd3 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:12.424106 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8ab941a2-ff80-4487-9762-91c3f4769bd3 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:12.442095 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-8ab941a2-ff80-4487-9762-91c3f4769bd3 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] HTTP exception thrown: Instance 1bf70366-2b4c-4df9-a6be-1c9145fb3862 could not be found. Sep 23 04:36:12.444306 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8ab941a2-ff80-4487-9762-91c3f4769bd3 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Request method failure captured: Sep 23 04:36:12.444306 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/1bf70366-2b4c-4df9-a6be-1c9145fb3862 HTTP/1.1 Sep 23 04:36:12.444306 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:36:12.444306 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:36:12.444306 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:36:12.444306 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:36:12.444306 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:36:12.444306 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:36:12.444306 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:36:12.444306 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:36:12.444306 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTdzwKLwM5Huuc3OkGbV0-q8wtlsijivZwHLFFvwUn7aqwjwo0Mvf0QANB4RO3tvB8rSgFY67c2VjxeEJzRrvjiDhhi9XOqh7sPsdzyKRA33MX1kyET93FlWBs-I4ky6udbWqL2rlse4AqwXx6x3kt0moKWN4SwJfbsgKX9smPZbJsM Sep 23 04:36:12.444306 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:36:12.444306 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:36:12.444306 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:36:12.444306 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:36:12.444306 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:36:12.444306 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:36:12.444306 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: a3f931b8de0b4402a3833577fbb15607 Sep 23 04:36:12.444306 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-SecurityGroupsTestJSON-1588002272 Sep 23 04:36:12.444306 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:36:12.444306 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:36:12.446227 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a3f931b8de0b4402a3833577fbb15607", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a3f931b8de0b4402a3833577fbb15607"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a3f931b8de0b4402a3833577fbb15607"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a3f931b8de0b4402a3833577fbb15607"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:36:12.446227 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-SecurityGroupsTestJSON-1588002272 Sep 23 04:36:12.446227 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: a3f931b8de0b4402a3833577fbb15607 Sep 23 04:36:12.446227 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1588002272 Sep 23 04:36:12.446227 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-SecurityGroupsTestJSON-1588002272-project Sep 23 04:36:12.446227 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:36:12.446227 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:36:12.446227 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 8a00bc3e62774185b48120832e80476d Sep 23 04:36:12.446227 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-SecurityGroupsTestJSON-1588002272-project Sep 23 04:36:12.446227 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:36:12.446227 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 1bf70366-2b4c-4df9-a6be-1c9145fb3862 could not be found. Sep 23 04:36:12.446227 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '1bf70366-2b4c-4df9-a6be-1c9145fb3862'} Sep 23 04:36:12.447194 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:36:12.447194 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:36:12.447194 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:36:12.447194 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:36:12.447194 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:36:12.447194 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:36:12.447194 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:36:12.447194 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:36:12.447194 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:36:12.447194 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:36:12.447194 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1bf70366-2b4c-4df9-a6be-1c9145fb3862 could not be found. Sep 23 04:36:12.447194 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:36:12.447194 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:36:12.447194 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:36:12.447194 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:36:12.447194 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:36:12.447194 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:36:12.447194 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:36:12.447194 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:36:12.447194 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:36:12.448671 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:36:12.448671 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:36:12.448671 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:36:12.448671 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:36:12.448671 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:36:12.448671 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:36:12.448671 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:36:12.448671 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1bf70366-2b4c-4df9-a6be-1c9145fb3862 could not be found. Sep 23 04:36:12.448671 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:36:12.448671 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:36:12.448671 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:36:12.448671 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:36:12.448671 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:36:12.448671 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:36:12.448671 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:36:12.448671 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:36:12.448671 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1bf70366-2b4c-4df9-a6be-1c9145fb3862 could not be found. Sep 23 04:36:12.448671 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:36:12.458286 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8ab941a2-ff80-4487-9762-91c3f4769bd3 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Returning 404 to user: Instance 1bf70366-2b4c-4df9-a6be-1c9145fb3862 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:36:12.459226 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-8ab941a2-ff80-4487-9762-91c3f4769bd3 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] 10.222.0.33 "GET /compute/v2.1/servers/1bf70366-2b4c-4df9-a6be-1c9145fb3862" status: 404 len: 111 microversion: 2.1 time: 0.061851 Sep 23 04:36:12.463121 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 740/1433] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:12 2022] GET /compute/v2.1/servers/1bf70366-2b4c-4df9-a6be-1c9145fb3862 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:36:12.468296 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d705099a-3122-4ac7-afe0-9bb0e5ec4679 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Calling method '.version_select at 0x7ff1bb8d5670>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:12.550307 n-d-846463-3 devstack@n-api.service[122699]: DEBUG neutronclient.v2_0.client [None req-d705099a-3122-4ac7-afe0-9bb0e5ec4679 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 4af791f9-f06f-4b60-ba7c-8ef76cb6893c does not exist", "detail": ""}} {{(pid=122699) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 23 04:36:12.551693 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.security_group_api [None req-d705099a-3122-4ac7-afe0-9bb0e5ec4679 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Neutron security group 4af791f9-f06f-4b60-ba7c-8ef76cb6893c not found {{(pid=122699) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 23 04:36:12.552961 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-d705099a-3122-4ac7-afe0-9bb0e5ec4679 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] HTTP exception thrown: Security group 4af791f9-f06f-4b60-ba7c-8ef76cb6893c does not exist Sep 23 04:36:12.552961 n-d-846463-3 devstack@n-api.service[122699]: Neutron server returns request_ids: ['req-8ae23d66-20b5-4aa6-b202-cf1ee61c0ed1'] Sep 23 04:36:12.559141 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d705099a-3122-4ac7-afe0-9bb0e5ec4679 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Request method failure captured: Sep 23 04:36:12.559141 n-d-846463-3 devstack@n-api.service[122699]: request: DELETE /compute/v2.1/os-security-groups/4af791f9-f06f-4b60-ba7c-8ef76cb6893c HTTP/1.1 Sep 23 04:36:12.559141 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:36:12.559141 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:36:12.559141 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:36:12.559141 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:36:12.559141 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:36:12.559141 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:36:12.559141 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:36:12.559141 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:36:12.559141 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTdzwKLwM5Huuc3OkGbV0-q8wtlsijivZwHLFFvwUn7aqwjwo0Mvf0QANB4RO3tvB8rSgFY67c2VjxeEJzRrvjiDhhi9XOqh7sPsdzyKRA33MX1kyET93FlWBs-I4ky6udbWqL2rlse4AqwXx6x3kt0moKWN4SwJfbsgKX9smPZbJsM Sep 23 04:36:12.559141 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:36:12.559141 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:36:12.559141 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:36:12.559141 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:36:12.559141 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:36:12.559141 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:36:12.559141 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: a3f931b8de0b4402a3833577fbb15607 Sep 23 04:36:12.559141 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-SecurityGroupsTestJSON-1588002272 Sep 23 04:36:12.559141 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:36:12.559141 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:36:12.560757 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a3f931b8de0b4402a3833577fbb15607", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a3f931b8de0b4402a3833577fbb15607"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a3f931b8de0b4402a3833577fbb15607"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a3f931b8de0b4402a3833577fbb15607"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:36:12.560757 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-SecurityGroupsTestJSON-1588002272 Sep 23 04:36:12.560757 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: a3f931b8de0b4402a3833577fbb15607 Sep 23 04:36:12.560757 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1588002272 Sep 23 04:36:12.560757 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-SecurityGroupsTestJSON-1588002272-project Sep 23 04:36:12.560757 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:36:12.560757 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:36:12.560757 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 8a00bc3e62774185b48120832e80476d Sep 23 04:36:12.560757 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-SecurityGroupsTestJSON-1588002272-project Sep 23 04:36:12.560757 n-d-846463-3 devstack@n-api.service[122699]: method: Sep 23 04:36:12.560757 n-d-846463-3 devstack@n-api.service[122699]: exception: Security group 4af791f9-f06f-4b60-ba7c-8ef76cb6893c does not exist Sep 23 04:36:12.560757 n-d-846463-3 devstack@n-api.service[122699]: Neutron server returns request_ids: ['req-8ae23d66-20b5-4aa6-b202-cf1ee61c0ed1'] Sep 23 04:36:12.560757 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '4af791f9-f06f-4b60-ba7c-8ef76cb6893c'} Sep 23 04:36:12.561710 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:36:12.561710 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:36:12.561710 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 23 04:36:12.561710 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 23 04:36:12.561710 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:36:12.561710 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:36:12.561710 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 23 04:36:12.561710 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 23 04:36:12.561710 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:36:12.561710 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:36:12.561710 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 23 04:36:12.561710 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 23 04:36:12.561710 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:36:12.561710 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:36:12.561710 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 23 04:36:12.561710 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 23 04:36:12.561710 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:36:12.561710 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:36:12.561710 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 23 04:36:12.563714 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 23 04:36:12.563714 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:36:12.563714 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:36:12.563714 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 23 04:36:12.563714 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 23 04:36:12.563714 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 23 04:36:12.563714 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 23 04:36:12.563714 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 4af791f9-f06f-4b60-ba7c-8ef76cb6893c does not exist Sep 23 04:36:12.563714 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8ae23d66-20b5-4aa6-b202-cf1ee61c0ed1'] Sep 23 04:36:12.563714 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:36:12.563714 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:36:12.563714 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:36:12.563714 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:36:12.563714 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 23 04:36:12.563714 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 23 04:36:12.563714 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 23 04:36:12.563714 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 23 04:36:12.563714 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 4af791f9-f06f-4b60-ba7c-8ef76cb6893c does not exist Sep 23 04:36:12.565131 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8ae23d66-20b5-4aa6-b202-cf1ee61c0ed1'] Sep 23 04:36:12.565131 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:36:12.565131 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:36:12.565131 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:36:12.565131 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:36:12.565131 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:36:12.565131 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:36:12.565131 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:36:12.565131 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:36:12.565131 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:36:12.565131 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:36:12.565131 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:36:12.565131 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:36:12.565131 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 23 04:36:12.565131 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 23 04:36:12.565131 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 4af791f9-f06f-4b60-ba7c-8ef76cb6893c does not exist Sep 23 04:36:12.565131 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8ae23d66-20b5-4aa6-b202-cf1ee61c0ed1'] Sep 23 04:36:12.565131 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:36:12.565131 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:36:12.565131 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:36:12.565131 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:36:12.568144 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:36:12.568144 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:36:12.568144 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:36:12.568144 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:36:12.568144 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 4af791f9-f06f-4b60-ba7c-8ef76cb6893c does not exist Sep 23 04:36:12.568144 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8ae23d66-20b5-4aa6-b202-cf1ee61c0ed1'] Sep 23 04:36:12.568144 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:36:12.569131 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d705099a-3122-4ac7-afe0-9bb0e5ec4679 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Returning 404 to user: Security group 4af791f9-f06f-4b60-ba7c-8ef76cb6893c does not exist Sep 23 04:36:12.569131 n-d-846463-3 devstack@n-api.service[122699]: Neutron server returns request_ids: ['req-8ae23d66-20b5-4aa6-b202-cf1ee61c0ed1'] {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:36:12.569131 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d705099a-3122-4ac7-afe0-9bb0e5ec4679 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/4af791f9-f06f-4b60-ba7c-8ef76cb6893c" status: 404 len: 194 microversion: 2.1 time: 0.105027 Sep 23 04:36:12.570346 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 741/1434] 10.222.0.33 () {58 vars in 1272 bytes} [Fri Sep 23 04:36:12 2022] DELETE /compute/v2.1/os-security-groups/4af791f9-f06f-4b60-ba7c-8ef76cb6893c => generated 194 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:36:12.583136 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f35a5101-b437-4d52-8ee9-4b9e28e3ad79 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Calling method '.version_select at 0x7ff1bbaac670>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:12.639827 n-d-846463-3 devstack@n-api.service[122699]: DEBUG neutronclient.v2_0.client [None req-f35a5101-b437-4d52-8ee9-4b9e28e3ad79 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ac6c071f-b48d-4383-a2e9-e5de9103136d does not exist", "detail": ""}} {{(pid=122699) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 23 04:36:12.640443 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.security_group_api [None req-f35a5101-b437-4d52-8ee9-4b9e28e3ad79 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Neutron security group ac6c071f-b48d-4383-a2e9-e5de9103136d not found {{(pid=122699) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 23 04:36:12.642728 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-f35a5101-b437-4d52-8ee9-4b9e28e3ad79 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] HTTP exception thrown: Security group ac6c071f-b48d-4383-a2e9-e5de9103136d does not exist Sep 23 04:36:12.642728 n-d-846463-3 devstack@n-api.service[122699]: Neutron server returns request_ids: ['req-c52cb3c2-23f6-49c9-b6d1-5c19e84088fb'] Sep 23 04:36:12.645755 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f35a5101-b437-4d52-8ee9-4b9e28e3ad79 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Request method failure captured: Sep 23 04:36:12.645755 n-d-846463-3 devstack@n-api.service[122699]: request: DELETE /compute/v2.1/os-security-groups/ac6c071f-b48d-4383-a2e9-e5de9103136d HTTP/1.1 Sep 23 04:36:12.645755 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:36:12.645755 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:36:12.645755 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:36:12.645755 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:36:12.645755 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:36:12.645755 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:36:12.645755 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:36:12.645755 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:36:12.645755 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTdzwKLwM5Huuc3OkGbV0-q8wtlsijivZwHLFFvwUn7aqwjwo0Mvf0QANB4RO3tvB8rSgFY67c2VjxeEJzRrvjiDhhi9XOqh7sPsdzyKRA33MX1kyET93FlWBs-I4ky6udbWqL2rlse4AqwXx6x3kt0moKWN4SwJfbsgKX9smPZbJsM Sep 23 04:36:12.645755 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:36:12.645755 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:36:12.645755 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:36:12.645755 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:36:12.645755 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:36:12.645755 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:36:12.645755 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: a3f931b8de0b4402a3833577fbb15607 Sep 23 04:36:12.645755 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-SecurityGroupsTestJSON-1588002272 Sep 23 04:36:12.645755 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:36:12.645755 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:36:12.647539 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a3f931b8de0b4402a3833577fbb15607", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a3f931b8de0b4402a3833577fbb15607"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a3f931b8de0b4402a3833577fbb15607"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a3f931b8de0b4402a3833577fbb15607"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:36:12.647539 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-SecurityGroupsTestJSON-1588002272 Sep 23 04:36:12.647539 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: a3f931b8de0b4402a3833577fbb15607 Sep 23 04:36:12.647539 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1588002272 Sep 23 04:36:12.647539 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-SecurityGroupsTestJSON-1588002272-project Sep 23 04:36:12.647539 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:36:12.647539 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:36:12.647539 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 8a00bc3e62774185b48120832e80476d Sep 23 04:36:12.647539 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-SecurityGroupsTestJSON-1588002272-project Sep 23 04:36:12.647539 n-d-846463-3 devstack@n-api.service[122699]: method: Sep 23 04:36:12.647539 n-d-846463-3 devstack@n-api.service[122699]: exception: Security group ac6c071f-b48d-4383-a2e9-e5de9103136d does not exist Sep 23 04:36:12.647539 n-d-846463-3 devstack@n-api.service[122699]: Neutron server returns request_ids: ['req-c52cb3c2-23f6-49c9-b6d1-5c19e84088fb'] Sep 23 04:36:12.647539 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': 'ac6c071f-b48d-4383-a2e9-e5de9103136d'} Sep 23 04:36:12.648470 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:36:12.648470 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:36:12.648470 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 23 04:36:12.648470 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 23 04:36:12.648470 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:36:12.648470 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:36:12.648470 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 23 04:36:12.648470 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 23 04:36:12.648470 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:36:12.648470 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:36:12.648470 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 23 04:36:12.648470 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 23 04:36:12.648470 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:36:12.648470 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:36:12.648470 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 23 04:36:12.648470 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 23 04:36:12.648470 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:36:12.648470 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:36:12.648470 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 23 04:36:12.651252 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 23 04:36:12.651252 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:36:12.651252 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:36:12.651252 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 23 04:36:12.651252 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 23 04:36:12.651252 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 23 04:36:12.651252 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 23 04:36:12.651252 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group ac6c071f-b48d-4383-a2e9-e5de9103136d does not exist Sep 23 04:36:12.651252 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c52cb3c2-23f6-49c9-b6d1-5c19e84088fb'] Sep 23 04:36:12.651252 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:36:12.651252 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:36:12.651252 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:36:12.651252 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:36:12.651252 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 23 04:36:12.651252 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 23 04:36:12.651252 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 23 04:36:12.651252 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 23 04:36:12.651252 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group ac6c071f-b48d-4383-a2e9-e5de9103136d does not exist Sep 23 04:36:12.653623 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c52cb3c2-23f6-49c9-b6d1-5c19e84088fb'] Sep 23 04:36:12.653623 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:36:12.653623 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:36:12.653623 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:36:12.653623 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:36:12.653623 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:36:12.653623 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:36:12.653623 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:36:12.653623 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:36:12.653623 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:36:12.653623 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:36:12.653623 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:36:12.653623 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:36:12.653623 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 23 04:36:12.653623 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 23 04:36:12.653623 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group ac6c071f-b48d-4383-a2e9-e5de9103136d does not exist Sep 23 04:36:12.653623 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c52cb3c2-23f6-49c9-b6d1-5c19e84088fb'] Sep 23 04:36:12.653623 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:36:12.653623 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:36:12.653623 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:36:12.653623 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:36:12.656624 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:36:12.656624 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:36:12.656624 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:36:12.656624 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:36:12.656624 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group ac6c071f-b48d-4383-a2e9-e5de9103136d does not exist Sep 23 04:36:12.656624 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c52cb3c2-23f6-49c9-b6d1-5c19e84088fb'] Sep 23 04:36:12.656624 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:36:12.660080 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f35a5101-b437-4d52-8ee9-4b9e28e3ad79 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Returning 404 to user: Security group ac6c071f-b48d-4383-a2e9-e5de9103136d does not exist Sep 23 04:36:12.660080 n-d-846463-3 devstack@n-api.service[122699]: Neutron server returns request_ids: ['req-c52cb3c2-23f6-49c9-b6d1-5c19e84088fb'] {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:36:12.661694 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f35a5101-b437-4d52-8ee9-4b9e28e3ad79 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/ac6c071f-b48d-4383-a2e9-e5de9103136d" status: 404 len: 194 microversion: 2.1 time: 0.087224 Sep 23 04:36:12.663521 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 742/1435] 10.222.0.33 () {58 vars in 1272 bytes} [Fri Sep 23 04:36:12 2022] DELETE /compute/v2.1/os-security-groups/ac6c071f-b48d-4383-a2e9-e5de9103136d => generated 194 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:36:12.673678 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-352bd126-0dc6-4540-b8dc-2ab6e0e914d3 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Calling method '.version_select at 0x7ff1bb91a430>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:12.677346 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b49432da-4ec8-484e-b638-8b2e9ec25856 tempest-MigrationsAdminTest-295231043 tempest-MigrationsAdminTest-295231043-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea" status: 200 len: 1614 microversion: 2.1 time: 0.446321 Sep 23 04:36:12.678729 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 694/1436] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:12 2022] GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea => generated 1614 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:12.701999 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-015786fe-553b-43aa-a108-9d0f50f7f554 tempest-MigrationsAdminTest-295231043 tempest-MigrationsAdminTest-295231043-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:36:12.702591 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-015786fe-553b-43aa-a108-9d0f50f7f554 tempest-MigrationsAdminTest-295231043 tempest-MigrationsAdminTest-295231043-project-admin] [instance: f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:12.718127 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-015786fe-553b-43aa-a108-9d0f50f7f554 tempest-MigrationsAdminTest-295231043 tempest-MigrationsAdminTest-295231043-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:12.718632 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-015786fe-553b-43aa-a108-9d0f50f7f554 tempest-MigrationsAdminTest-295231043 tempest-MigrationsAdminTest-295231043-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:12.719075 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-015786fe-553b-43aa-a108-9d0f50f7f554 tempest-MigrationsAdminTest-295231043 tempest-MigrationsAdminTest-295231043-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:12.719777 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-015786fe-553b-43aa-a108-9d0f50f7f554 tempest-MigrationsAdminTest-295231043 tempest-MigrationsAdminTest-295231043-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:12.720239 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-015786fe-553b-43aa-a108-9d0f50f7f554 tempest-MigrationsAdminTest-295231043 tempest-MigrationsAdminTest-295231043-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:12.720664 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-015786fe-553b-43aa-a108-9d0f50f7f554 tempest-MigrationsAdminTest-295231043 tempest-MigrationsAdminTest-295231043-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:12.735532 n-d-846463-3 devstack@n-api.service[122699]: DEBUG neutronclient.v2_0.client [None req-352bd126-0dc6-4540-b8dc-2ab6e0e914d3 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 116d00a3-99cf-44b8-88a8-d6c549423529 does not exist", "detail": ""}} {{(pid=122699) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 23 04:36:12.735532 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.security_group_api [None req-352bd126-0dc6-4540-b8dc-2ab6e0e914d3 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Neutron security group 116d00a3-99cf-44b8-88a8-d6c549423529 not found {{(pid=122699) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 23 04:36:12.735532 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-352bd126-0dc6-4540-b8dc-2ab6e0e914d3 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] HTTP exception thrown: Security group 116d00a3-99cf-44b8-88a8-d6c549423529 does not exist Sep 23 04:36:12.735532 n-d-846463-3 devstack@n-api.service[122699]: Neutron server returns request_ids: ['req-39ce489f-cc63-47bd-b0e6-6dd48b284cce'] Sep 23 04:36:12.736826 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-352bd126-0dc6-4540-b8dc-2ab6e0e914d3 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Request method failure captured: Sep 23 04:36:12.736826 n-d-846463-3 devstack@n-api.service[122699]: request: DELETE /compute/v2.1/os-security-groups/116d00a3-99cf-44b8-88a8-d6c549423529 HTTP/1.1 Sep 23 04:36:12.736826 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:36:12.736826 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:36:12.736826 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:36:12.736826 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:36:12.736826 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:36:12.736826 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:36:12.736826 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:36:12.736826 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:36:12.736826 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTdzwKLwM5Huuc3OkGbV0-q8wtlsijivZwHLFFvwUn7aqwjwo0Mvf0QANB4RO3tvB8rSgFY67c2VjxeEJzRrvjiDhhi9XOqh7sPsdzyKRA33MX1kyET93FlWBs-I4ky6udbWqL2rlse4AqwXx6x3kt0moKWN4SwJfbsgKX9smPZbJsM Sep 23 04:36:12.736826 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:36:12.736826 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:36:12.736826 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:36:12.736826 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:36:12.736826 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:36:12.736826 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:36:12.736826 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: a3f931b8de0b4402a3833577fbb15607 Sep 23 04:36:12.736826 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-SecurityGroupsTestJSON-1588002272 Sep 23 04:36:12.736826 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:36:12.736826 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:36:12.738246 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a3f931b8de0b4402a3833577fbb15607", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a3f931b8de0b4402a3833577fbb15607"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a3f931b8de0b4402a3833577fbb15607"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a3f931b8de0b4402a3833577fbb15607"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:36:12.738246 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-SecurityGroupsTestJSON-1588002272 Sep 23 04:36:12.738246 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: a3f931b8de0b4402a3833577fbb15607 Sep 23 04:36:12.738246 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1588002272 Sep 23 04:36:12.738246 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-SecurityGroupsTestJSON-1588002272-project Sep 23 04:36:12.738246 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:36:12.738246 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:36:12.738246 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 8a00bc3e62774185b48120832e80476d Sep 23 04:36:12.738246 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-SecurityGroupsTestJSON-1588002272-project Sep 23 04:36:12.738246 n-d-846463-3 devstack@n-api.service[122699]: method: Sep 23 04:36:12.738246 n-d-846463-3 devstack@n-api.service[122699]: exception: Security group 116d00a3-99cf-44b8-88a8-d6c549423529 does not exist Sep 23 04:36:12.738246 n-d-846463-3 devstack@n-api.service[122699]: Neutron server returns request_ids: ['req-39ce489f-cc63-47bd-b0e6-6dd48b284cce'] Sep 23 04:36:12.738246 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '116d00a3-99cf-44b8-88a8-d6c549423529'} Sep 23 04:36:12.739084 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:36:12.739084 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:36:12.739084 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 23 04:36:12.739084 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 23 04:36:12.739084 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:36:12.739084 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:36:12.739084 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 23 04:36:12.739084 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 23 04:36:12.739084 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:36:12.739084 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:36:12.739084 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 23 04:36:12.739084 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 23 04:36:12.739084 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:36:12.739084 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:36:12.739084 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 23 04:36:12.739084 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 23 04:36:12.739084 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:36:12.739084 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:36:12.739084 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 23 04:36:12.740268 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 23 04:36:12.740268 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:36:12.740268 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:36:12.740268 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 23 04:36:12.740268 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 23 04:36:12.740268 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 23 04:36:12.740268 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 23 04:36:12.740268 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 116d00a3-99cf-44b8-88a8-d6c549423529 does not exist Sep 23 04:36:12.740268 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-39ce489f-cc63-47bd-b0e6-6dd48b284cce'] Sep 23 04:36:12.740268 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:36:12.740268 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:36:12.740268 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:36:12.740268 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:36:12.740268 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 23 04:36:12.740268 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 23 04:36:12.740268 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 23 04:36:12.740268 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 23 04:36:12.740268 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 116d00a3-99cf-44b8-88a8-d6c549423529 does not exist Sep 23 04:36:12.741532 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-39ce489f-cc63-47bd-b0e6-6dd48b284cce'] Sep 23 04:36:12.741532 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:36:12.741532 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:36:12.741532 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:36:12.741532 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:36:12.741532 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:36:12.741532 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:36:12.741532 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:36:12.741532 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:36:12.741532 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:36:12.741532 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:36:12.741532 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:36:12.741532 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:36:12.741532 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 23 04:36:12.741532 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 23 04:36:12.741532 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 116d00a3-99cf-44b8-88a8-d6c549423529 does not exist Sep 23 04:36:12.741532 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-39ce489f-cc63-47bd-b0e6-6dd48b284cce'] Sep 23 04:36:12.741532 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:36:12.741532 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:36:12.741532 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:36:12.741532 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:36:12.746900 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:36:12.746900 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:36:12.746900 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:36:12.746900 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:36:12.746900 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 116d00a3-99cf-44b8-88a8-d6c549423529 does not exist Sep 23 04:36:12.746900 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-39ce489f-cc63-47bd-b0e6-6dd48b284cce'] Sep 23 04:36:12.746900 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:36:12.746900 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-352bd126-0dc6-4540-b8dc-2ab6e0e914d3 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Returning 404 to user: Security group 116d00a3-99cf-44b8-88a8-d6c549423529 does not exist Sep 23 04:36:12.746900 n-d-846463-3 devstack@n-api.service[122699]: Neutron server returns request_ids: ['req-39ce489f-cc63-47bd-b0e6-6dd48b284cce'] {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:36:12.746900 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-352bd126-0dc6-4540-b8dc-2ab6e0e914d3 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/116d00a3-99cf-44b8-88a8-d6c549423529" status: 404 len: 194 microversion: 2.1 time: 0.068859 Sep 23 04:36:12.746900 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 743/1437] 10.222.0.33 () {58 vars in 1272 bytes} [Fri Sep 23 04:36:12 2022] DELETE /compute/v2.1/os-security-groups/116d00a3-99cf-44b8-88a8-d6c549423529 => generated 194 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:36:12.748456 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a49036c4-1471-4065-ad49-81b7d55bd892 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Calling method '.version_select at 0x7ff1bbaac940>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:12.824318 n-d-846463-3 devstack@n-api.service[122699]: DEBUG neutronclient.v2_0.client [None req-a49036c4-1471-4065-ad49-81b7d55bd892 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f6a1f146-2d7c-4e94-a516-4ed9f3564181 does not exist", "detail": ""}} {{(pid=122699) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 23 04:36:12.825239 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.security_group_api [None req-a49036c4-1471-4065-ad49-81b7d55bd892 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Neutron security group f6a1f146-2d7c-4e94-a516-4ed9f3564181 not found {{(pid=122699) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 23 04:36:12.826270 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-a49036c4-1471-4065-ad49-81b7d55bd892 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] HTTP exception thrown: Security group f6a1f146-2d7c-4e94-a516-4ed9f3564181 does not exist Sep 23 04:36:12.826270 n-d-846463-3 devstack@n-api.service[122699]: Neutron server returns request_ids: ['req-99b80343-352f-4d76-88c8-289d4e105be7'] Sep 23 04:36:12.828664 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a49036c4-1471-4065-ad49-81b7d55bd892 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Request method failure captured: Sep 23 04:36:12.828664 n-d-846463-3 devstack@n-api.service[122699]: request: DELETE /compute/v2.1/os-security-groups/f6a1f146-2d7c-4e94-a516-4ed9f3564181 HTTP/1.1 Sep 23 04:36:12.828664 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:36:12.828664 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:36:12.828664 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:36:12.828664 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:36:12.828664 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:36:12.828664 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:36:12.828664 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:36:12.828664 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:36:12.828664 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTdzwKLwM5Huuc3OkGbV0-q8wtlsijivZwHLFFvwUn7aqwjwo0Mvf0QANB4RO3tvB8rSgFY67c2VjxeEJzRrvjiDhhi9XOqh7sPsdzyKRA33MX1kyET93FlWBs-I4ky6udbWqL2rlse4AqwXx6x3kt0moKWN4SwJfbsgKX9smPZbJsM Sep 23 04:36:12.828664 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:36:12.828664 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:36:12.828664 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:36:12.828664 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:36:12.828664 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:36:12.828664 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:36:12.828664 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: a3f931b8de0b4402a3833577fbb15607 Sep 23 04:36:12.828664 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-SecurityGroupsTestJSON-1588002272 Sep 23 04:36:12.828664 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:36:12.828664 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:36:12.836422 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a3f931b8de0b4402a3833577fbb15607", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a3f931b8de0b4402a3833577fbb15607"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a3f931b8de0b4402a3833577fbb15607"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a3f931b8de0b4402a3833577fbb15607"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:36:12.836422 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-SecurityGroupsTestJSON-1588002272 Sep 23 04:36:12.836422 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: a3f931b8de0b4402a3833577fbb15607 Sep 23 04:36:12.836422 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1588002272 Sep 23 04:36:12.836422 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-SecurityGroupsTestJSON-1588002272-project Sep 23 04:36:12.836422 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:36:12.836422 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:36:12.836422 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 8a00bc3e62774185b48120832e80476d Sep 23 04:36:12.836422 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-SecurityGroupsTestJSON-1588002272-project Sep 23 04:36:12.836422 n-d-846463-3 devstack@n-api.service[122699]: method: Sep 23 04:36:12.836422 n-d-846463-3 devstack@n-api.service[122699]: exception: Security group f6a1f146-2d7c-4e94-a516-4ed9f3564181 does not exist Sep 23 04:36:12.836422 n-d-846463-3 devstack@n-api.service[122699]: Neutron server returns request_ids: ['req-99b80343-352f-4d76-88c8-289d4e105be7'] Sep 23 04:36:12.836422 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': 'f6a1f146-2d7c-4e94-a516-4ed9f3564181'} Sep 23 04:36:12.837648 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:36:12.837648 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:36:12.837648 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 23 04:36:12.837648 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 23 04:36:12.837648 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:36:12.837648 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:36:12.837648 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 23 04:36:12.837648 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 23 04:36:12.837648 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:36:12.837648 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:36:12.837648 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 23 04:36:12.837648 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 23 04:36:12.837648 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:36:12.837648 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:36:12.837648 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 23 04:36:12.837648 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 23 04:36:12.837648 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:36:12.837648 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:36:12.837648 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 23 04:36:12.839285 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 23 04:36:12.839285 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:36:12.839285 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:36:12.839285 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 23 04:36:12.839285 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 23 04:36:12.839285 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 23 04:36:12.839285 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 23 04:36:12.839285 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f6a1f146-2d7c-4e94-a516-4ed9f3564181 does not exist Sep 23 04:36:12.839285 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-99b80343-352f-4d76-88c8-289d4e105be7'] Sep 23 04:36:12.839285 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:36:12.839285 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:36:12.839285 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:36:12.839285 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:36:12.839285 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 23 04:36:12.839285 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 23 04:36:12.839285 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 23 04:36:12.839285 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 23 04:36:12.839285 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f6a1f146-2d7c-4e94-a516-4ed9f3564181 does not exist Sep 23 04:36:12.840964 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-99b80343-352f-4d76-88c8-289d4e105be7'] Sep 23 04:36:12.840964 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:36:12.840964 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:36:12.840964 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:36:12.840964 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:36:12.840964 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:36:12.840964 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:36:12.840964 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:36:12.840964 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:36:12.840964 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:36:12.840964 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:36:12.840964 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:36:12.840964 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:36:12.840964 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 23 04:36:12.840964 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 23 04:36:12.840964 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f6a1f146-2d7c-4e94-a516-4ed9f3564181 does not exist Sep 23 04:36:12.840964 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-99b80343-352f-4d76-88c8-289d4e105be7'] Sep 23 04:36:12.840964 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:36:12.840964 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:36:12.840964 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:36:12.840964 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:36:12.842721 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:36:12.842721 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:36:12.842721 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:36:12.842721 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:36:12.842721 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f6a1f146-2d7c-4e94-a516-4ed9f3564181 does not exist Sep 23 04:36:12.842721 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-99b80343-352f-4d76-88c8-289d4e105be7'] Sep 23 04:36:12.842721 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:36:12.842721 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a49036c4-1471-4065-ad49-81b7d55bd892 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Returning 404 to user: Security group f6a1f146-2d7c-4e94-a516-4ed9f3564181 does not exist Sep 23 04:36:12.842721 n-d-846463-3 devstack@n-api.service[122699]: Neutron server returns request_ids: ['req-99b80343-352f-4d76-88c8-289d4e105be7'] {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:36:12.842721 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a49036c4-1471-4065-ad49-81b7d55bd892 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/f6a1f146-2d7c-4e94-a516-4ed9f3564181" status: 404 len: 194 microversion: 2.1 time: 0.089150 Sep 23 04:36:12.842721 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 744/1438] 10.222.0.33 () {58 vars in 1272 bytes} [Fri Sep 23 04:36:12 2022] DELETE /compute/v2.1/os-security-groups/f6a1f146-2d7c-4e94-a516-4ed9f3564181 => generated 194 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 04:36:12.848694 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4f2073e9-c8dc-428e-99c6-5554d906866f tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Calling method '.version_select at 0x7ff1bbb828b0>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:12.903748 n-d-846463-3 devstack@n-api.service[122699]: DEBUG neutronclient.v2_0.client [None req-4f2073e9-c8dc-428e-99c6-5554d906866f tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 6ede2b50-364e-4609-b1a1-4e84181483d2 does not exist", "detail": ""}} {{(pid=122699) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 23 04:36:12.904605 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.security_group_api [None req-4f2073e9-c8dc-428e-99c6-5554d906866f tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Neutron security group 6ede2b50-364e-4609-b1a1-4e84181483d2 not found {{(pid=122699) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 23 04:36:12.905330 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-4f2073e9-c8dc-428e-99c6-5554d906866f tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] HTTP exception thrown: Security group 6ede2b50-364e-4609-b1a1-4e84181483d2 does not exist Sep 23 04:36:12.905330 n-d-846463-3 devstack@n-api.service[122699]: Neutron server returns request_ids: ['req-06747a84-9204-48f8-ab26-2163ba291f4c'] Sep 23 04:36:12.908189 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4f2073e9-c8dc-428e-99c6-5554d906866f tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Request method failure captured: Sep 23 04:36:12.908189 n-d-846463-3 devstack@n-api.service[122699]: request: DELETE /compute/v2.1/os-security-groups/6ede2b50-364e-4609-b1a1-4e84181483d2 HTTP/1.1 Sep 23 04:36:12.908189 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:36:12.908189 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:36:12.908189 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:36:12.908189 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:36:12.908189 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:36:12.908189 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:36:12.908189 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:36:12.908189 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:36:12.908189 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTdzwKLwM5Huuc3OkGbV0-q8wtlsijivZwHLFFvwUn7aqwjwo0Mvf0QANB4RO3tvB8rSgFY67c2VjxeEJzRrvjiDhhi9XOqh7sPsdzyKRA33MX1kyET93FlWBs-I4ky6udbWqL2rlse4AqwXx6x3kt0moKWN4SwJfbsgKX9smPZbJsM Sep 23 04:36:12.908189 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:36:12.908189 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:36:12.908189 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:36:12.908189 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:36:12.908189 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:36:12.908189 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:36:12.908189 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: a3f931b8de0b4402a3833577fbb15607 Sep 23 04:36:12.908189 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-SecurityGroupsTestJSON-1588002272 Sep 23 04:36:12.908189 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:36:12.908189 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:36:12.909782 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a3f931b8de0b4402a3833577fbb15607", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a3f931b8de0b4402a3833577fbb15607"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a3f931b8de0b4402a3833577fbb15607"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a3f931b8de0b4402a3833577fbb15607"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:36:12.909782 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-SecurityGroupsTestJSON-1588002272 Sep 23 04:36:12.909782 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: a3f931b8de0b4402a3833577fbb15607 Sep 23 04:36:12.909782 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1588002272 Sep 23 04:36:12.909782 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-SecurityGroupsTestJSON-1588002272-project Sep 23 04:36:12.909782 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:36:12.909782 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:36:12.909782 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 8a00bc3e62774185b48120832e80476d Sep 23 04:36:12.909782 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-SecurityGroupsTestJSON-1588002272-project Sep 23 04:36:12.909782 n-d-846463-3 devstack@n-api.service[122699]: method: Sep 23 04:36:12.909782 n-d-846463-3 devstack@n-api.service[122699]: exception: Security group 6ede2b50-364e-4609-b1a1-4e84181483d2 does not exist Sep 23 04:36:12.909782 n-d-846463-3 devstack@n-api.service[122699]: Neutron server returns request_ids: ['req-06747a84-9204-48f8-ab26-2163ba291f4c'] Sep 23 04:36:12.909782 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '6ede2b50-364e-4609-b1a1-4e84181483d2'} Sep 23 04:36:12.910829 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:36:12.910829 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:36:12.910829 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 23 04:36:12.910829 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 23 04:36:12.910829 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:36:12.910829 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:36:12.910829 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 23 04:36:12.910829 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 23 04:36:12.910829 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:36:12.910829 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:36:12.910829 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 23 04:36:12.910829 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 23 04:36:12.910829 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:36:12.910829 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:36:12.910829 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 23 04:36:12.910829 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 23 04:36:12.910829 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:36:12.910829 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:36:12.910829 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 23 04:36:12.912274 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 23 04:36:12.912274 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:36:12.912274 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:36:12.912274 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 23 04:36:12.912274 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 23 04:36:12.912274 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 23 04:36:12.912274 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 23 04:36:12.912274 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 6ede2b50-364e-4609-b1a1-4e84181483d2 does not exist Sep 23 04:36:12.912274 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-06747a84-9204-48f8-ab26-2163ba291f4c'] Sep 23 04:36:12.912274 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:36:12.912274 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:36:12.912274 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:36:12.912274 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:36:12.912274 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 23 04:36:12.912274 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 23 04:36:12.912274 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 23 04:36:12.912274 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 23 04:36:12.912274 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 6ede2b50-364e-4609-b1a1-4e84181483d2 does not exist Sep 23 04:36:12.914100 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-06747a84-9204-48f8-ab26-2163ba291f4c'] Sep 23 04:36:12.914100 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:36:12.914100 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:36:12.914100 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:36:12.914100 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:36:12.914100 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:36:12.914100 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:36:12.914100 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:36:12.914100 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:36:12.914100 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:36:12.914100 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:36:12.914100 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:36:12.914100 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:36:12.914100 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 23 04:36:12.914100 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 23 04:36:12.914100 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 6ede2b50-364e-4609-b1a1-4e84181483d2 does not exist Sep 23 04:36:12.914100 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-06747a84-9204-48f8-ab26-2163ba291f4c'] Sep 23 04:36:12.914100 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:36:12.914100 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:36:12.914100 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:36:12.914100 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:36:12.915935 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:36:12.915935 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:36:12.915935 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:36:12.915935 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:36:12.915935 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 6ede2b50-364e-4609-b1a1-4e84181483d2 does not exist Sep 23 04:36:12.915935 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-06747a84-9204-48f8-ab26-2163ba291f4c'] Sep 23 04:36:12.915935 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:36:12.917186 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-015786fe-553b-43aa-a108-9d0f50f7f554 tempest-MigrationsAdminTest-295231043 tempest-MigrationsAdminTest-295231043-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '3514d0172cf24a0ebaf2eb296c7e2945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9f5de88d7c249e28440dccc2e634253', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:12.917186 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-015786fe-553b-43aa-a108-9d0f50f7f554 tempest-MigrationsAdminTest-295231043 tempest-MigrationsAdminTest-295231043-project-admin] [instance: f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea] flavor_id is None. Assuming migration. {{(pid=122698) resize /opt/stack/nova/nova/compute/api.py:4196}} Sep 23 04:36:12.917186 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-015786fe-553b-43aa-a108-9d0f50f7f554 tempest-MigrationsAdminTest-295231043 tempest-MigrationsAdminTest-295231043-project-admin] [instance: f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122698) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 23 04:36:12.918441 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4f2073e9-c8dc-428e-99c6-5554d906866f tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Returning 404 to user: Security group 6ede2b50-364e-4609-b1a1-4e84181483d2 does not exist Sep 23 04:36:12.918441 n-d-846463-3 devstack@n-api.service[122699]: Neutron server returns request_ids: ['req-06747a84-9204-48f8-ab26-2163ba291f4c'] {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:36:12.919659 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4f2073e9-c8dc-428e-99c6-5554d906866f tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/6ede2b50-364e-4609-b1a1-4e84181483d2" status: 404 len: 194 microversion: 2.1 time: 0.074899 Sep 23 04:36:12.920447 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 745/1439] 10.222.0.33 () {58 vars in 1272 bytes} [Fri Sep 23 04:36:12 2022] DELETE /compute/v2.1/os-security-groups/6ede2b50-364e-4609-b1a1-4e84181483d2 => generated 194 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:36:12.929709 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4f870bdc-f34e-4898-befd-96dc6be79805 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Calling method '.version_select at 0x7ff1bbb2fe50>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:13.001582 n-d-846463-3 devstack@n-api.service[122699]: DEBUG neutronclient.v2_0.client [None req-4f870bdc-f34e-4898-befd-96dc6be79805 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 2d927e30-5ff7-4ded-990d-0c684ffcec12 does not exist", "detail": ""}} {{(pid=122699) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 23 04:36:13.002371 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.security_group_api [None req-4f870bdc-f34e-4898-befd-96dc6be79805 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Neutron security group 2d927e30-5ff7-4ded-990d-0c684ffcec12 not found {{(pid=122699) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 23 04:36:13.003632 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-4f870bdc-f34e-4898-befd-96dc6be79805 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] HTTP exception thrown: Security group 2d927e30-5ff7-4ded-990d-0c684ffcec12 does not exist Sep 23 04:36:13.003632 n-d-846463-3 devstack@n-api.service[122699]: Neutron server returns request_ids: ['req-377eacb3-1fe1-4d8a-a484-d1accc9c01d9'] Sep 23 04:36:13.005973 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4f870bdc-f34e-4898-befd-96dc6be79805 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Request method failure captured: Sep 23 04:36:13.005973 n-d-846463-3 devstack@n-api.service[122699]: request: DELETE /compute/v2.1/os-security-groups/2d927e30-5ff7-4ded-990d-0c684ffcec12 HTTP/1.1 Sep 23 04:36:13.005973 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:36:13.005973 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:36:13.005973 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:36:13.005973 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:36:13.005973 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:36:13.005973 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:36:13.005973 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:36:13.005973 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:36:13.005973 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTdzwKLwM5Huuc3OkGbV0-q8wtlsijivZwHLFFvwUn7aqwjwo0Mvf0QANB4RO3tvB8rSgFY67c2VjxeEJzRrvjiDhhi9XOqh7sPsdzyKRA33MX1kyET93FlWBs-I4ky6udbWqL2rlse4AqwXx6x3kt0moKWN4SwJfbsgKX9smPZbJsM Sep 23 04:36:13.005973 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:36:13.005973 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:36:13.005973 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:36:13.005973 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:36:13.005973 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:36:13.005973 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:36:13.005973 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: a3f931b8de0b4402a3833577fbb15607 Sep 23 04:36:13.005973 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-SecurityGroupsTestJSON-1588002272 Sep 23 04:36:13.005973 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:36:13.005973 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:36:13.007682 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a3f931b8de0b4402a3833577fbb15607", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a3f931b8de0b4402a3833577fbb15607"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a3f931b8de0b4402a3833577fbb15607"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a3f931b8de0b4402a3833577fbb15607"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:36:13.007682 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-SecurityGroupsTestJSON-1588002272 Sep 23 04:36:13.007682 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: a3f931b8de0b4402a3833577fbb15607 Sep 23 04:36:13.007682 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1588002272 Sep 23 04:36:13.007682 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-SecurityGroupsTestJSON-1588002272-project Sep 23 04:36:13.007682 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:36:13.007682 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:36:13.007682 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 8a00bc3e62774185b48120832e80476d Sep 23 04:36:13.007682 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-SecurityGroupsTestJSON-1588002272-project Sep 23 04:36:13.007682 n-d-846463-3 devstack@n-api.service[122699]: method: Sep 23 04:36:13.007682 n-d-846463-3 devstack@n-api.service[122699]: exception: Security group 2d927e30-5ff7-4ded-990d-0c684ffcec12 does not exist Sep 23 04:36:13.007682 n-d-846463-3 devstack@n-api.service[122699]: Neutron server returns request_ids: ['req-377eacb3-1fe1-4d8a-a484-d1accc9c01d9'] Sep 23 04:36:13.007682 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '2d927e30-5ff7-4ded-990d-0c684ffcec12'} Sep 23 04:36:13.008826 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:36:13.008826 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:36:13.008826 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 23 04:36:13.008826 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 23 04:36:13.008826 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:36:13.008826 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:36:13.008826 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 23 04:36:13.008826 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 23 04:36:13.008826 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:36:13.008826 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:36:13.008826 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 23 04:36:13.008826 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 23 04:36:13.008826 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:36:13.008826 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:36:13.008826 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 23 04:36:13.008826 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 23 04:36:13.008826 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:36:13.008826 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:36:13.008826 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 23 04:36:13.010122 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 23 04:36:13.010122 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:36:13.010122 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:36:13.010122 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 23 04:36:13.010122 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 23 04:36:13.010122 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 23 04:36:13.010122 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 23 04:36:13.010122 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 2d927e30-5ff7-4ded-990d-0c684ffcec12 does not exist Sep 23 04:36:13.010122 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-377eacb3-1fe1-4d8a-a484-d1accc9c01d9'] Sep 23 04:36:13.010122 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:36:13.010122 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:36:13.010122 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:36:13.010122 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:36:13.010122 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 23 04:36:13.010122 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 23 04:36:13.010122 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 23 04:36:13.010122 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 23 04:36:13.010122 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 2d927e30-5ff7-4ded-990d-0c684ffcec12 does not exist Sep 23 04:36:13.013316 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-377eacb3-1fe1-4d8a-a484-d1accc9c01d9'] Sep 23 04:36:13.013316 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:36:13.013316 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:36:13.013316 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:36:13.013316 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:36:13.013316 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:36:13.013316 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:36:13.013316 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:36:13.013316 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:36:13.013316 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:36:13.013316 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:36:13.013316 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:36:13.013316 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:36:13.013316 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 23 04:36:13.013316 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 23 04:36:13.013316 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 2d927e30-5ff7-4ded-990d-0c684ffcec12 does not exist Sep 23 04:36:13.013316 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-377eacb3-1fe1-4d8a-a484-d1accc9c01d9'] Sep 23 04:36:13.013316 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:36:13.013316 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:36:13.013316 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:36:13.013316 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:36:13.017771 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:36:13.017771 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:36:13.017771 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:36:13.017771 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:36:13.017771 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 2d927e30-5ff7-4ded-990d-0c684ffcec12 does not exist Sep 23 04:36:13.017771 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-377eacb3-1fe1-4d8a-a484-d1accc9c01d9'] Sep 23 04:36:13.017771 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:36:13.017771 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4f870bdc-f34e-4898-befd-96dc6be79805 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Returning 404 to user: Security group 2d927e30-5ff7-4ded-990d-0c684ffcec12 does not exist Sep 23 04:36:13.017771 n-d-846463-3 devstack@n-api.service[122699]: Neutron server returns request_ids: ['req-377eacb3-1fe1-4d8a-a484-d1accc9c01d9'] {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:36:13.017771 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4f870bdc-f34e-4898-befd-96dc6be79805 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/2d927e30-5ff7-4ded-990d-0c684ffcec12" status: 404 len: 194 microversion: 2.1 time: 0.082408 Sep 23 04:36:13.017771 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 746/1440] 10.222.0.33 () {58 vars in 1272 bytes} [Fri Sep 23 04:36:12 2022] DELETE /compute/v2.1/os-security-groups/2d927e30-5ff7-4ded-990d-0c684ffcec12 => generated 194 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:36:13.022230 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-72d248c2-71c6-487a-b3f3-ce4b03d50bb5 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:13.023683 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-72d248c2-71c6-487a-b3f3-ce4b03d50bb5 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 9e9a41f2-ff28-4c2a-80aa-193e0ebce466] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:13.047644 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-72d248c2-71c6-487a-b3f3-ce4b03d50bb5 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:13.048177 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-72d248c2-71c6-487a-b3f3-ce4b03d50bb5 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:13.048638 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-72d248c2-71c6-487a-b3f3-ce4b03d50bb5 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:13.049374 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-72d248c2-71c6-487a-b3f3-ce4b03d50bb5 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:13.049847 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-72d248c2-71c6-487a-b3f3-ce4b03d50bb5 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:13.050320 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-72d248c2-71c6-487a-b3f3-ce4b03d50bb5 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:13.203674 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-72d248c2-71c6-487a-b3f3-ce4b03d50bb5 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:13.218604 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-72d248c2-71c6-487a-b3f3-ce4b03d50bb5 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:13.223641 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-72d248c2-71c6-487a-b3f3-ce4b03d50bb5 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:13.229431 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-72d248c2-71c6-487a-b3f3-ce4b03d50bb5 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466" status: 200 len: 1250 microversion: 2.25 time: 0.219904 Sep 23 04:36:13.249649 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 747/1441] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:36:13 2022] GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466 => generated 1250 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:36:13.276532 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-dc739b22-d04e-4baa-891b-19fb4a5e0c8a tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:13.277101 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-dc739b22-d04e-4baa-891b-19fb4a5e0c8a tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] [instance: 19a775ff-efab-43d1-9a67-9ed31f6d1fc4] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:13.284425 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dc739b22-d04e-4baa-891b-19fb4a5e0c8a tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:13.288800 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dc739b22-d04e-4baa-891b-19fb4a5e0c8a tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:13.290468 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dc739b22-d04e-4baa-891b-19fb4a5e0c8a tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:13.293694 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dc739b22-d04e-4baa-891b-19fb4a5e0c8a tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:13.294413 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dc739b22-d04e-4baa-891b-19fb4a5e0c8a tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:13.295023 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dc739b22-d04e-4baa-891b-19fb4a5e0c8a tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:13.358647 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-dc739b22-d04e-4baa-891b-19fb4a5e0c8a tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] [instance: 19a775ff-efab-43d1-9a67-9ed31f6d1fc4] Going to try to terminate instance {{(pid=122699) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:36:13.407151 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-015786fe-553b-43aa-a108-9d0f50f7f554 tempest-MigrationsAdminTest-295231043 tempest-MigrationsAdminTest-295231043-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea/action" status: 202 len: 0 microversion: 2.1 time: 0.709116 Sep 23 04:36:13.414097 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 695/1442] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:36:12 2022] POST /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea/action => generated 0 bytes in 717 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:36:13.439795 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d3bf4a3d-2d08-4bba-bd71-b5900102d3ae tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:13.443775 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d3bf4a3d-2d08-4bba-bd71-b5900102d3ae tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: b4a75706-ba44-4b2c-8767-071502169d5a] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:13.460536 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d3bf4a3d-2d08-4bba-bd71-b5900102d3ae tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:13.464221 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d3bf4a3d-2d08-4bba-bd71-b5900102d3ae tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:13.464945 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d3bf4a3d-2d08-4bba-bd71-b5900102d3ae tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:13.467427 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d3bf4a3d-2d08-4bba-bd71-b5900102d3ae tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:13.469923 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d3bf4a3d-2d08-4bba-bd71-b5900102d3ae tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:13.470706 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d3bf4a3d-2d08-4bba-bd71-b5900102d3ae tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:13.583538 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d3bf4a3d-2d08-4bba-bd71-b5900102d3ae tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:13.601053 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d3bf4a3d-2d08-4bba-bd71-b5900102d3ae tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/b4a75706-ba44-4b2c-8767-071502169d5a" status: 200 len: 1223 microversion: 2.1 time: 0.180636 Sep 23 04:36:13.602998 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 696/1443] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:13 2022] GET /compute/v2.1/servers/b4a75706-ba44-4b2c-8767-071502169d5a => generated 1223 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:13.612629 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-746a3004-cef5-45dc-a8e1-3bc46bbec568 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:13.614282 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-746a3004-cef5-45dc-a8e1-3bc46bbec568 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:13.627387 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-746a3004-cef5-45dc-a8e1-3bc46bbec568 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:13.628410 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-746a3004-cef5-45dc-a8e1-3bc46bbec568 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:13.629649 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-746a3004-cef5-45dc-a8e1-3bc46bbec568 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:13.630773 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-746a3004-cef5-45dc-a8e1-3bc46bbec568 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:13.631807 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-746a3004-cef5-45dc-a8e1-3bc46bbec568 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:13.634591 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-746a3004-cef5-45dc-a8e1-3bc46bbec568 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:13.942682 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-dc739b22-d04e-4baa-891b-19fb4a5e0c8a tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] 10.222.0.33 "DELETE /compute/v2.1/servers/19a775ff-efab-43d1-9a67-9ed31f6d1fc4" status: 204 len: 0 microversion: 2.1 time: 0.680678 Sep 23 04:36:13.943912 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 748/1444] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:36:13 2022] DELETE /compute/v2.1/servers/19a775ff-efab-43d1-9a67-9ed31f6d1fc4 => generated 0 bytes in 694 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:36:13.960945 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-319779ea-7935-4bbb-9a45-6ff4dcb4586d tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:13.962408 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-319779ea-7935-4bbb-9a45-6ff4dcb4586d tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] [instance: 19a775ff-efab-43d1-9a67-9ed31f6d1fc4] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:13.982262 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-319779ea-7935-4bbb-9a45-6ff4dcb4586d tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:13.985077 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-319779ea-7935-4bbb-9a45-6ff4dcb4586d tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:13.986218 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-319779ea-7935-4bbb-9a45-6ff4dcb4586d tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:13.993386 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-319779ea-7935-4bbb-9a45-6ff4dcb4586d tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:13.994429 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-319779ea-7935-4bbb-9a45-6ff4dcb4586d tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:13.995401 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-319779ea-7935-4bbb-9a45-6ff4dcb4586d tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:14.389211 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-746a3004-cef5-45dc-a8e1-3bc46bbec568 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:14.419081 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-746a3004-cef5-45dc-a8e1-3bc46bbec568 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea" status: 200 len: 1472 microversion: 2.1 time: 0.814602 Sep 23 04:36:14.423132 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 697/1445] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:13 2022] GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea => generated 1472 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:14.432546 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c594104d-a858-491f-8235-3aa578f9cddd tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:14.434590 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c594104d-a858-491f-8235-3aa578f9cddd tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 9e9a41f2-ff28-4c2a-80aa-193e0ebce466] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:14.450186 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c594104d-a858-491f-8235-3aa578f9cddd tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:14.450782 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c594104d-a858-491f-8235-3aa578f9cddd tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:14.451204 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c594104d-a858-491f-8235-3aa578f9cddd tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:14.453130 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c594104d-a858-491f-8235-3aa578f9cddd tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:14.453632 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c594104d-a858-491f-8235-3aa578f9cddd tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:14.456607 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c594104d-a858-491f-8235-3aa578f9cddd tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:14.513358 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-319779ea-7935-4bbb-9a45-6ff4dcb4586d tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a00bc3e62774185b48120832e80476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f931b8de0b4402a3833577fbb15607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:14.521634 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-319779ea-7935-4bbb-9a45-6ff4dcb4586d tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] 10.222.0.33 "GET /compute/v2.1/servers/19a775ff-efab-43d1-9a67-9ed31f6d1fc4" status: 200 len: 1647 microversion: 2.1 time: 0.569843 Sep 23 04:36:14.526606 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 749/1446] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:13 2022] GET /compute/v2.1/servers/19a775ff-efab-43d1-9a67-9ed31f6d1fc4 => generated 1647 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:14.632841 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d169d434-9116-4d4a-a4e4-85d2fe187905 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:14.633630 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d169d434-9116-4d4a-a4e4-85d2fe187905 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: b4a75706-ba44-4b2c-8767-071502169d5a] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:14.653926 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d169d434-9116-4d4a-a4e4-85d2fe187905 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:14.655689 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d169d434-9116-4d4a-a4e4-85d2fe187905 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:14.656140 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d169d434-9116-4d4a-a4e4-85d2fe187905 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:14.661165 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d169d434-9116-4d4a-a4e4-85d2fe187905 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:14.661660 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d169d434-9116-4d4a-a4e4-85d2fe187905 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:14.662130 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d169d434-9116-4d4a-a4e4-85d2fe187905 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:14.864139 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d169d434-9116-4d4a-a4e4-85d2fe187905 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:14.878640 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d169d434-9116-4d4a-a4e4-85d2fe187905 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/b4a75706-ba44-4b2c-8767-071502169d5a" status: 200 len: 1215 microversion: 2.1 time: 0.257684 Sep 23 04:36:14.879687 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 750/1447] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:14 2022] GET /compute/v2.1/servers/b4a75706-ba44-4b2c-8767-071502169d5a => generated 1215 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:36:14.922624 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c594104d-a858-491f-8235-3aa578f9cddd tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:14.939345 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c594104d-a858-491f-8235-3aa578f9cddd tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:14.940815 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c594104d-a858-491f-8235-3aa578f9cddd tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:14.942077 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c594104d-a858-491f-8235-3aa578f9cddd tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466" status: 200 len: 1292 microversion: 2.25 time: 0.517734 Sep 23 04:36:14.942631 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 698/1448] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:36:14 2022] GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466 => generated 1292 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:36:15.450919 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4552d32a-2f86-45ac-8b18-53d7b3e5ec54 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:15.451537 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4552d32a-2f86-45ac-8b18-53d7b3e5ec54 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:15.467003 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4552d32a-2f86-45ac-8b18-53d7b3e5ec54 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:15.468201 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4552d32a-2f86-45ac-8b18-53d7b3e5ec54 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:15.469211 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4552d32a-2f86-45ac-8b18-53d7b3e5ec54 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:15.471386 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4552d32a-2f86-45ac-8b18-53d7b3e5ec54 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:15.471863 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4552d32a-2f86-45ac-8b18-53d7b3e5ec54 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:15.472302 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4552d32a-2f86-45ac-8b18-53d7b3e5ec54 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:15.557932 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3957e172-ef72-4086-a3b1-a33b7193b4b8 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:15.559577 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3957e172-ef72-4086-a3b1-a33b7193b4b8 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] [instance: 19a775ff-efab-43d1-9a67-9ed31f6d1fc4] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:15.573488 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3957e172-ef72-4086-a3b1-a33b7193b4b8 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:15.574401 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3957e172-ef72-4086-a3b1-a33b7193b4b8 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:15.575261 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3957e172-ef72-4086-a3b1-a33b7193b4b8 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:15.576422 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3957e172-ef72-4086-a3b1-a33b7193b4b8 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:15.577190 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3957e172-ef72-4086-a3b1-a33b7193b4b8 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:15.577823 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3957e172-ef72-4086-a3b1-a33b7193b4b8 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:15.960732 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-4552d32a-2f86-45ac-8b18-53d7b3e5ec54 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:15.982917 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4552d32a-2f86-45ac-8b18-53d7b3e5ec54 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea" status: 200 len: 1472 microversion: 2.1 time: 0.534963 Sep 23 04:36:15.989048 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 751/1449] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:15 2022] GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea => generated 1472 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:16.012330 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-bdc965dd-3b30-4f01-9a15-bce929a86471 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:16.013583 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-bdc965dd-3b30-4f01-9a15-bce929a86471 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: b4a75706-ba44-4b2c-8767-071502169d5a] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:16.030322 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bdc965dd-3b30-4f01-9a15-bce929a86471 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:16.031122 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bdc965dd-3b30-4f01-9a15-bce929a86471 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:16.033702 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bdc965dd-3b30-4f01-9a15-bce929a86471 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:16.034678 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bdc965dd-3b30-4f01-9a15-bce929a86471 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:16.037660 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bdc965dd-3b30-4f01-9a15-bce929a86471 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:16.051061 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bdc965dd-3b30-4f01-9a15-bce929a86471 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:16.087168 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-3957e172-ef72-4086-a3b1-a33b7193b4b8 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a00bc3e62774185b48120832e80476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f931b8de0b4402a3833577fbb15607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:16.097365 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3957e172-ef72-4086-a3b1-a33b7193b4b8 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] 10.222.0.33 "GET /compute/v2.1/servers/19a775ff-efab-43d1-9a67-9ed31f6d1fc4" status: 200 len: 1647 microversion: 2.1 time: 0.544599 Sep 23 04:36:16.102199 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 699/1450] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:15 2022] GET /compute/v2.1/servers/19a775ff-efab-43d1-9a67-9ed31f6d1fc4 => generated 1647 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:36:16.126563 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b988cf1c-5ae6-4e08-b5f7-cd3d15b761d0 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:16.133111 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b988cf1c-5ae6-4e08-b5f7-cd3d15b761d0 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 9e9a41f2-ff28-4c2a-80aa-193e0ebce466] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:16.165303 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b988cf1c-5ae6-4e08-b5f7-cd3d15b761d0 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:16.165303 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b988cf1c-5ae6-4e08-b5f7-cd3d15b761d0 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:16.165303 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b988cf1c-5ae6-4e08-b5f7-cd3d15b761d0 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:16.165303 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b988cf1c-5ae6-4e08-b5f7-cd3d15b761d0 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:16.169761 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b988cf1c-5ae6-4e08-b5f7-cd3d15b761d0 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:16.174502 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b988cf1c-5ae6-4e08-b5f7-cd3d15b761d0 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:16.367899 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-bdc965dd-3b30-4f01-9a15-bce929a86471 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:16.387480 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-bdc965dd-3b30-4f01-9a15-bce929a86471 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/b4a75706-ba44-4b2c-8767-071502169d5a" status: 200 len: 1271 microversion: 2.1 time: 0.391855 Sep 23 04:36:16.390600 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 752/1451] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:15 2022] GET /compute/v2.1/servers/b4a75706-ba44-4b2c-8767-071502169d5a => generated 1271 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:16.442791 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b988cf1c-5ae6-4e08-b5f7-cd3d15b761d0 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:16.465239 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b988cf1c-5ae6-4e08-b5f7-cd3d15b761d0 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:16.469483 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b988cf1c-5ae6-4e08-b5f7-cd3d15b761d0 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:16.476915 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b988cf1c-5ae6-4e08-b5f7-cd3d15b761d0 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466" status: 200 len: 1292 microversion: 2.25 time: 0.368494 Sep 23 04:36:16.478307 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 700/1452] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:36:16 2022] GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466 => generated 1292 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:36:17.014770 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-596d39d4-7cd7-43de-bc66-2a2dacc8ef40 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:17.015403 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-596d39d4-7cd7-43de-bc66-2a2dacc8ef40 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:17.026935 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-596d39d4-7cd7-43de-bc66-2a2dacc8ef40 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:17.027458 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-596d39d4-7cd7-43de-bc66-2a2dacc8ef40 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:17.029877 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-596d39d4-7cd7-43de-bc66-2a2dacc8ef40 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:17.033861 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-596d39d4-7cd7-43de-bc66-2a2dacc8ef40 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:17.034425 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-596d39d4-7cd7-43de-bc66-2a2dacc8ef40 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:17.034934 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-596d39d4-7cd7-43de-bc66-2a2dacc8ef40 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:17.122752 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0fed1cf2-7d4d-4c82-9bc6-3f35184eb2fb tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:17.125296 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-0fed1cf2-7d4d-4c82-9bc6-3f35184eb2fb tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] [instance: 19a775ff-efab-43d1-9a67-9ed31f6d1fc4] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:17.146811 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0fed1cf2-7d4d-4c82-9bc6-3f35184eb2fb tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:17.148908 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0fed1cf2-7d4d-4c82-9bc6-3f35184eb2fb tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:17.151734 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0fed1cf2-7d4d-4c82-9bc6-3f35184eb2fb tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:17.152782 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0fed1cf2-7d4d-4c82-9bc6-3f35184eb2fb tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:17.153638 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0fed1cf2-7d4d-4c82-9bc6-3f35184eb2fb tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:17.158159 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0fed1cf2-7d4d-4c82-9bc6-3f35184eb2fb tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:17.392725 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-0fed1cf2-7d4d-4c82-9bc6-3f35184eb2fb tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a00bc3e62774185b48120832e80476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f931b8de0b4402a3833577fbb15607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:17.410810 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0fed1cf2-7d4d-4c82-9bc6-3f35184eb2fb tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] 10.222.0.33 "GET /compute/v2.1/servers/19a775ff-efab-43d1-9a67-9ed31f6d1fc4" status: 200 len: 1468 microversion: 2.1 time: 0.287377 Sep 23 04:36:17.412660 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 701/1453] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:17 2022] GET /compute/v2.1/servers/19a775ff-efab-43d1-9a67-9ed31f6d1fc4 => generated 1468 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:17.423943 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-f8c9e09e-adfe-4c06-b6b3-ac4250cc794d req-848634bb-9645-4dbe-829b-cfed8e549d0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e9a41f2-ff28-4c2a-80aa-193e0ebce466", "tag": "11d5e398-f101-4c1d-8d16-8553226b7947"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:36:17.472592 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-f8c9e09e-adfe-4c06-b6b3-ac4250cc794d req-848634bb-9645-4dbe-829b-cfed8e549d0f service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:17.473526 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-f8c9e09e-adfe-4c06-b6b3-ac4250cc794d req-848634bb-9645-4dbe-829b-cfed8e549d0f service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:17.474002 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-f8c9e09e-adfe-4c06-b6b3-ac4250cc794d req-848634bb-9645-4dbe-829b-cfed8e549d0f service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:17.504646 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-f8c9e09e-adfe-4c06-b6b3-ac4250cc794d req-848634bb-9645-4dbe-829b-cfed8e549d0f service nova] Creating event network-changed:11d5e398-f101-4c1d-8d16-8553226b7947 for instance 9e9a41f2-ff28-4c2a-80aa-193e0ebce466 on n-h1-846463-3 Sep 23 04:36:17.513114 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-f8c9e09e-adfe-4c06-b6b3-ac4250cc794d req-848634bb-9645-4dbe-829b-cfed8e549d0f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098744 Sep 23 04:36:17.514338 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 702/1454] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:36:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:36:17.535323 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-63ee21c7-6df0-45b8-b5ae-683840e084cd tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:17.536237 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-63ee21c7-6df0-45b8-b5ae-683840e084cd tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: b4a75706-ba44-4b2c-8767-071502169d5a] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:17.548385 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-63ee21c7-6df0-45b8-b5ae-683840e084cd tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:17.549666 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-63ee21c7-6df0-45b8-b5ae-683840e084cd tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:17.552407 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-63ee21c7-6df0-45b8-b5ae-683840e084cd tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:17.554278 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-63ee21c7-6df0-45b8-b5ae-683840e084cd tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:17.554919 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-63ee21c7-6df0-45b8-b5ae-683840e084cd tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:17.555672 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-63ee21c7-6df0-45b8-b5ae-683840e084cd tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:17.732387 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-63ee21c7-6df0-45b8-b5ae-683840e084cd tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:17.750353 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-63ee21c7-6df0-45b8-b5ae-683840e084cd tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/b4a75706-ba44-4b2c-8767-071502169d5a" status: 200 len: 1279 microversion: 2.1 time: 0.229066 Sep 23 04:36:17.751483 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 703/1455] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:17 2022] GET /compute/v2.1/servers/b4a75706-ba44-4b2c-8767-071502169d5a => generated 1279 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:17.775578 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7d85db9c-09c0-4398-97fd-fbfdbbd23e15 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:17.775578 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7d85db9c-09c0-4398-97fd-fbfdbbd23e15 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 9e9a41f2-ff28-4c2a-80aa-193e0ebce466] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:17.801501 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7d85db9c-09c0-4398-97fd-fbfdbbd23e15 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:17.805508 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7d85db9c-09c0-4398-97fd-fbfdbbd23e15 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:17.806145 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7d85db9c-09c0-4398-97fd-fbfdbbd23e15 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:17.813231 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7d85db9c-09c0-4398-97fd-fbfdbbd23e15 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:17.813231 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7d85db9c-09c0-4398-97fd-fbfdbbd23e15 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:17.813231 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7d85db9c-09c0-4398-97fd-fbfdbbd23e15 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:17.879111 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-596d39d4-7cd7-43de-bc66-2a2dacc8ef40 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:17.902279 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-596d39d4-7cd7-43de-bc66-2a2dacc8ef40 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea" status: 200 len: 1472 microversion: 2.1 time: 0.888895 Sep 23 04:36:17.904289 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 753/1456] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:17 2022] GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea => generated 1472 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:18.094525 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-e842289a-bea3-4d87-b4dc-b56a8681e74a req-ffcf9e07-ee12-4a5d-af76-ff9fadc4fc67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19a775ff-efab-43d1-9a67-9ed31f6d1fc4", "name": "network-vif-deleted", "tag": "f1fb3ae7-413d-4c1c-a6ae-6f6d50cb1cf1"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:36:18.105583 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=8,nova_api:UPDATE=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:36:18.143488 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-e842289a-bea3-4d87-b4dc-b56a8681e74a req-ffcf9e07-ee12-4a5d-af76-ff9fadc4fc67 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:18.144500 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-e842289a-bea3-4d87-b4dc-b56a8681e74a req-ffcf9e07-ee12-4a5d-af76-ff9fadc4fc67 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:18.145654 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-e842289a-bea3-4d87-b4dc-b56a8681e74a req-ffcf9e07-ee12-4a5d-af76-ff9fadc4fc67 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:18.178609 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-e842289a-bea3-4d87-b4dc-b56a8681e74a req-ffcf9e07-ee12-4a5d-af76-ff9fadc4fc67 service nova] Creating event network-vif-deleted:f1fb3ae7-413d-4c1c-a6ae-6f6d50cb1cf1 for instance 19a775ff-efab-43d1-9a67-9ed31f6d1fc4 on n-h2-846463-3 Sep 23 04:36:18.193008 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-e842289a-bea3-4d87-b4dc-b56a8681e74a req-ffcf9e07-ee12-4a5d-af76-ff9fadc4fc67 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.285970 Sep 23 04:36:18.195907 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 754/1457] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:36:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:36:18.277380 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-7d85db9c-09c0-4398-97fd-fbfdbbd23e15 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:18.294044 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-7d85db9c-09c0-4398-97fd-fbfdbbd23e15 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:18.295758 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-7d85db9c-09c0-4398-97fd-fbfdbbd23e15 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:18.297148 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7d85db9c-09c0-4398-97fd-fbfdbbd23e15 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466" status: 200 len: 1292 microversion: 2.25 time: 0.544505 Sep 23 04:36:18.310702 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 704/1458] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:36:17 2022] GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466 => generated 1292 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:36:18.443197 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-84cc09ce-bb40-48c9-9974-3f22525a8b67 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:18.448702 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-84cc09ce-bb40-48c9-9974-3f22525a8b67 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] [instance: 19a775ff-efab-43d1-9a67-9ed31f6d1fc4] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:18.457257 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-84cc09ce-bb40-48c9-9974-3f22525a8b67 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:18.457759 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-84cc09ce-bb40-48c9-9974-3f22525a8b67 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:18.458224 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-84cc09ce-bb40-48c9-9974-3f22525a8b67 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:18.458940 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-84cc09ce-bb40-48c9-9974-3f22525a8b67 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:18.459400 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-84cc09ce-bb40-48c9-9974-3f22525a8b67 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:18.459890 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-84cc09ce-bb40-48c9-9974-3f22525a8b67 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:18.501605 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-84cc09ce-bb40-48c9-9974-3f22525a8b67 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:18.502287 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-84cc09ce-bb40-48c9-9974-3f22525a8b67 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:18.502914 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-84cc09ce-bb40-48c9-9974-3f22525a8b67 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:18.503735 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-84cc09ce-bb40-48c9-9974-3f22525a8b67 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lazy-loading 'fault' on Instance uuid 19a775ff-efab-43d1-9a67-9ed31f6d1fc4 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:36:18.716576 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-84cc09ce-bb40-48c9-9974-3f22525a8b67 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a00bc3e62774185b48120832e80476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f931b8de0b4402a3833577fbb15607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:18.744981 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-84cc09ce-bb40-48c9-9974-3f22525a8b67 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] 10.222.0.33 "GET /compute/v2.1/servers/19a775ff-efab-43d1-9a67-9ed31f6d1fc4" status: 200 len: 1305 microversion: 2.1 time: 0.310445 Sep 23 04:36:18.746506 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 755/1459] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:18 2022] GET /compute/v2.1/servers/19a775ff-efab-43d1-9a67-9ed31f6d1fc4 => generated 1305 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:18.781464 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-dfa7f199-0425-4832-a759-9100678c0e3c tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:18.783613 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-dfa7f199-0425-4832-a759-9100678c0e3c tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: b4a75706-ba44-4b2c-8767-071502169d5a] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:18.801599 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:36:18.803783 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dfa7f199-0425-4832-a759-9100678c0e3c tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:18.804499 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dfa7f199-0425-4832-a759-9100678c0e3c tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:18.805116 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dfa7f199-0425-4832-a759-9100678c0e3c tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:18.806230 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dfa7f199-0425-4832-a759-9100678c0e3c tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:18.809449 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dfa7f199-0425-4832-a759-9100678c0e3c tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:18.810275 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dfa7f199-0425-4832-a759-9100678c0e3c tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:18.930054 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-47351e98-5814-42e2-8a1a-b9c08858da34 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:18.931405 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-47351e98-5814-42e2-8a1a-b9c08858da34 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:18.951471 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-47351e98-5814-42e2-8a1a-b9c08858da34 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:18.952014 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-47351e98-5814-42e2-8a1a-b9c08858da34 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:18.952414 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-47351e98-5814-42e2-8a1a-b9c08858da34 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:18.953243 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-47351e98-5814-42e2-8a1a-b9c08858da34 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:18.953710 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-47351e98-5814-42e2-8a1a-b9c08858da34 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:18.954176 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-47351e98-5814-42e2-8a1a-b9c08858da34 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:18.987783 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-dfa7f199-0425-4832-a759-9100678c0e3c tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:19.006312 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-dfa7f199-0425-4832-a759-9100678c0e3c tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/b4a75706-ba44-4b2c-8767-071502169d5a" status: 200 len: 1277 microversion: 2.1 time: 0.230593 Sep 23 04:36:19.012782 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 705/1460] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:18 2022] GET /compute/v2.1/servers/b4a75706-ba44-4b2c-8767-071502169d5a => generated 1277 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:19.324515 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-13fe389f-2856-4683-ab77-42d4a59ef786 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:19.327609 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-13fe389f-2856-4683-ab77-42d4a59ef786 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 9e9a41f2-ff28-4c2a-80aa-193e0ebce466] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:19.343330 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-13fe389f-2856-4683-ab77-42d4a59ef786 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:19.343762 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-13fe389f-2856-4683-ab77-42d4a59ef786 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:19.344209 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-13fe389f-2856-4683-ab77-42d4a59ef786 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:19.344999 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-13fe389f-2856-4683-ab77-42d4a59ef786 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:19.345467 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-13fe389f-2856-4683-ab77-42d4a59ef786 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:19.351763 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-13fe389f-2856-4683-ab77-42d4a59ef786 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:19.623380 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-47351e98-5814-42e2-8a1a-b9c08858da34 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:19.636648 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:36:19.645656 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-47351e98-5814-42e2-8a1a-b9c08858da34 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea" status: 200 len: 1472 microversion: 2.1 time: 0.718761 Sep 23 04:36:19.645656 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 756/1461] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:18 2022] GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea => generated 1472 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:19.706661 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-13fe389f-2856-4683-ab77-42d4a59ef786 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:19.715602 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:36:19.723907 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-13fe389f-2856-4683-ab77-42d4a59ef786 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:19.731153 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-13fe389f-2856-4683-ab77-42d4a59ef786 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:19.739941 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-13fe389f-2856-4683-ab77-42d4a59ef786 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466" status: 200 len: 1292 microversion: 2.25 time: 0.417232 Sep 23 04:36:19.745139 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 706/1462] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:36:19 2022] GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466 => generated 1292 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:36:19.777261 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-407bfe81-51c7-4264-9588-df6f29a100aa tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:19.777901 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-407bfe81-51c7-4264-9588-df6f29a100aa tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] [instance: 19a775ff-efab-43d1-9a67-9ed31f6d1fc4] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:19.781158 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=4 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:36:19.797728 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-407bfe81-51c7-4264-9588-df6f29a100aa tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:19.798364 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-407bfe81-51c7-4264-9588-df6f29a100aa tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:19.801538 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-407bfe81-51c7-4264-9588-df6f29a100aa tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:19.806045 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-407bfe81-51c7-4264-9588-df6f29a100aa tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:19.808011 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-407bfe81-51c7-4264-9588-df6f29a100aa tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:19.808716 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-407bfe81-51c7-4264-9588-df6f29a100aa tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:19.903474 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-407bfe81-51c7-4264-9588-df6f29a100aa tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:19.903474 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-407bfe81-51c7-4264-9588-df6f29a100aa tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:19.903474 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-407bfe81-51c7-4264-9588-df6f29a100aa tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:19.903474 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-407bfe81-51c7-4264-9588-df6f29a100aa tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lazy-loading 'fault' on Instance uuid 19a775ff-efab-43d1-9a67-9ed31f6d1fc4 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:36:19.972312 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-407bfe81-51c7-4264-9588-df6f29a100aa tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a00bc3e62774185b48120832e80476d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f931b8de0b4402a3833577fbb15607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:19.989929 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-407bfe81-51c7-4264-9588-df6f29a100aa tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] 10.222.0.33 "GET /compute/v2.1/servers/19a775ff-efab-43d1-9a67-9ed31f6d1fc4" status: 200 len: 1305 microversion: 2.1 time: 0.220040 Sep 23 04:36:19.993592 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 757/1463] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:19 2022] GET /compute/v2.1/servers/19a775ff-efab-43d1-9a67-9ed31f6d1fc4 => generated 1305 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:20.042940 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-efb4f2d1-407c-4c97-8340-b67813bcfa36 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:20.043904 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-efb4f2d1-407c-4c97-8340-b67813bcfa36 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: b4a75706-ba44-4b2c-8767-071502169d5a] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:20.067890 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-efb4f2d1-407c-4c97-8340-b67813bcfa36 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:20.067890 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-efb4f2d1-407c-4c97-8340-b67813bcfa36 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:20.067890 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-efb4f2d1-407c-4c97-8340-b67813bcfa36 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:20.070349 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-efb4f2d1-407c-4c97-8340-b67813bcfa36 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:20.070916 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-efb4f2d1-407c-4c97-8340-b67813bcfa36 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:20.071400 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-efb4f2d1-407c-4c97-8340-b67813bcfa36 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:20.157357 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-efb4f2d1-407c-4c97-8340-b67813bcfa36 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:20.168619 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-efb4f2d1-407c-4c97-8340-b67813bcfa36 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/b4a75706-ba44-4b2c-8767-071502169d5a" status: 200 len: 1277 microversion: 2.1 time: 0.129647 Sep 23 04:36:20.171882 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 707/1464] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:20 2022] GET /compute/v2.1/servers/b4a75706-ba44-4b2c-8767-071502169d5a => generated 1277 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:20.675221 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-565958a6-d316-4c30-8ac1-107315cfeea3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:20.675848 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-565958a6-d316-4c30-8ac1-107315cfeea3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:20.684887 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-565958a6-d316-4c30-8ac1-107315cfeea3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:20.686450 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-565958a6-d316-4c30-8ac1-107315cfeea3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:20.688731 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-565958a6-d316-4c30-8ac1-107315cfeea3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:20.690083 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-565958a6-d316-4c30-8ac1-107315cfeea3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:20.697715 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-565958a6-d316-4c30-8ac1-107315cfeea3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:20.698492 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-565958a6-d316-4c30-8ac1-107315cfeea3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:20.776379 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6125effc-ce1f-4359-8731-755650abaa48 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:20.778671 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-6125effc-ce1f-4359-8731-755650abaa48 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 9e9a41f2-ff28-4c2a-80aa-193e0ebce466] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:20.798836 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6125effc-ce1f-4359-8731-755650abaa48 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:20.799777 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6125effc-ce1f-4359-8731-755650abaa48 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:20.800236 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6125effc-ce1f-4359-8731-755650abaa48 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:20.801297 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6125effc-ce1f-4359-8731-755650abaa48 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:20.802092 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6125effc-ce1f-4359-8731-755650abaa48 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:20.802793 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6125effc-ce1f-4359-8731-755650abaa48 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:20.884976 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:36:21.162582 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:36:21.381548 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6125effc-ce1f-4359-8731-755650abaa48 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:21.389845 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-565958a6-d316-4c30-8ac1-107315cfeea3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:21.395612 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6125effc-ce1f-4359-8731-755650abaa48 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:21.400127 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-565958a6-d316-4c30-8ac1-107315cfeea3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea" status: 200 len: 1472 microversion: 2.1 time: 0.728790 Sep 23 04:36:21.401506 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 758/1465] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:20 2022] GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea => generated 1472 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:21.410292 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-251f8d2a-ce24-4ff3-ac59-88b709143d74 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:21.411942 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6125effc-ce1f-4359-8731-755650abaa48 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:21.419302 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-6125effc-ce1f-4359-8731-755650abaa48 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466" status: 200 len: 1292 microversion: 2.25 time: 0.644663 Sep 23 04:36:21.424308 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-251f8d2a-ce24-4ff3-ac59-88b709143d74 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] [instance: 19a775ff-efab-43d1-9a67-9ed31f6d1fc4] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:21.432057 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-251f8d2a-ce24-4ff3-ac59-88b709143d74 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:21.432550 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-251f8d2a-ce24-4ff3-ac59-88b709143d74 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:21.432993 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-251f8d2a-ce24-4ff3-ac59-88b709143d74 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:21.438741 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-251f8d2a-ce24-4ff3-ac59-88b709143d74 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:21.439758 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-251f8d2a-ce24-4ff3-ac59-88b709143d74 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:21.446070 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-251f8d2a-ce24-4ff3-ac59-88b709143d74 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:21.446242 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 708/1466] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:36:20 2022] GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466 => generated 1292 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:36:21.451664 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-14a4a726-aef8-48f2-91c2-fb0e1f9b5290 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:21.453490 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-14a4a726-aef8-48f2-91c2-fb0e1f9b5290 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: b4a75706-ba44-4b2c-8767-071502169d5a] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:21.464384 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-14a4a726-aef8-48f2-91c2-fb0e1f9b5290 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:21.466168 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-14a4a726-aef8-48f2-91c2-fb0e1f9b5290 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:21.466875 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-14a4a726-aef8-48f2-91c2-fb0e1f9b5290 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:21.467855 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-14a4a726-aef8-48f2-91c2-fb0e1f9b5290 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:21.468828 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-14a4a726-aef8-48f2-91c2-fb0e1f9b5290 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:21.469445 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-14a4a726-aef8-48f2-91c2-fb0e1f9b5290 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:21.490199 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-251f8d2a-ce24-4ff3-ac59-88b709143d74 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] HTTP exception thrown: Instance 19a775ff-efab-43d1-9a67-9ed31f6d1fc4 could not be found. Sep 23 04:36:21.493451 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-251f8d2a-ce24-4ff3-ac59-88b709143d74 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Request method failure captured: Sep 23 04:36:21.493451 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/19a775ff-efab-43d1-9a67-9ed31f6d1fc4 HTTP/1.1 Sep 23 04:36:21.493451 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:36:21.493451 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:36:21.493451 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:36:21.493451 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:36:21.493451 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:36:21.493451 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:36:21.493451 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:36:21.493451 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:36:21.493451 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTdzwKLwM5Huuc3OkGbV0-q8wtlsijivZwHLFFvwUn7aqwjwo0Mvf0QANB4RO3tvB8rSgFY67c2VjxeEJzRrvjiDhhi9XOqh7sPsdzyKRA33MX1kyET93FlWBs-I4ky6udbWqL2rlse4AqwXx6x3kt0moKWN4SwJfbsgKX9smPZbJsM Sep 23 04:36:21.493451 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:36:21.493451 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:36:21.493451 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:36:21.493451 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:36:21.493451 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:36:21.493451 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:36:21.493451 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: a3f931b8de0b4402a3833577fbb15607 Sep 23 04:36:21.493451 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-SecurityGroupsTestJSON-1588002272 Sep 23 04:36:21.493451 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:36:21.493451 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:36:21.498981 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a3f931b8de0b4402a3833577fbb15607", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a3f931b8de0b4402a3833577fbb15607"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a3f931b8de0b4402a3833577fbb15607"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a3f931b8de0b4402a3833577fbb15607"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:36:21.498981 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-SecurityGroupsTestJSON-1588002272 Sep 23 04:36:21.498981 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: a3f931b8de0b4402a3833577fbb15607 Sep 23 04:36:21.498981 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1588002272 Sep 23 04:36:21.498981 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-SecurityGroupsTestJSON-1588002272-project Sep 23 04:36:21.498981 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:36:21.498981 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:36:21.498981 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 8a00bc3e62774185b48120832e80476d Sep 23 04:36:21.498981 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-SecurityGroupsTestJSON-1588002272-project Sep 23 04:36:21.498981 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:36:21.498981 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 19a775ff-efab-43d1-9a67-9ed31f6d1fc4 could not be found. Sep 23 04:36:21.498981 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '19a775ff-efab-43d1-9a67-9ed31f6d1fc4'} Sep 23 04:36:21.500333 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:36:21.500333 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:36:21.500333 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:36:21.500333 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:36:21.500333 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:36:21.500333 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:36:21.500333 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:36:21.500333 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:36:21.500333 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:36:21.500333 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:36:21.500333 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19a775ff-efab-43d1-9a67-9ed31f6d1fc4 could not be found. Sep 23 04:36:21.500333 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:36:21.500333 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:36:21.500333 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:36:21.500333 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:36:21.500333 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:36:21.500333 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:36:21.500333 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:36:21.500333 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:36:21.500333 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:36:21.501957 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:36:21.501957 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:36:21.501957 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:36:21.501957 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:36:21.501957 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:36:21.501957 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:36:21.501957 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:36:21.501957 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19a775ff-efab-43d1-9a67-9ed31f6d1fc4 could not be found. Sep 23 04:36:21.501957 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:36:21.501957 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:36:21.501957 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:36:21.501957 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:36:21.501957 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:36:21.501957 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:36:21.501957 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:36:21.501957 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:36:21.501957 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19a775ff-efab-43d1-9a67-9ed31f6d1fc4 could not be found. Sep 23 04:36:21.501957 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:36:21.503374 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-251f8d2a-ce24-4ff3-ac59-88b709143d74 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Returning 404 to user: Instance 19a775ff-efab-43d1-9a67-9ed31f6d1fc4 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:36:21.503374 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-251f8d2a-ce24-4ff3-ac59-88b709143d74 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] 10.222.0.33 "GET /compute/v2.1/servers/19a775ff-efab-43d1-9a67-9ed31f6d1fc4" status: 404 len: 111 microversion: 2.1 time: 0.092141 Sep 23 04:36:21.503374 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 759/1467] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:21 2022] GET /compute/v2.1/servers/19a775ff-efab-43d1-9a67-9ed31f6d1fc4 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:36:21.510244 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5de9bde0-3d6d-4c0b-934b-7b6458d0b610 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Calling method '.version_select at 0x7ff1bb875940>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:22.255064 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-14a4a726-aef8-48f2-91c2-fb0e1f9b5290 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:22.266891 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-14a4a726-aef8-48f2-91c2-fb0e1f9b5290 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/b4a75706-ba44-4b2c-8767-071502169d5a" status: 200 len: 1319 microversion: 2.1 time: 0.818960 Sep 23 04:36:22.286301 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 709/1468] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:21 2022] GET /compute/v2.1/servers/b4a75706-ba44-4b2c-8767-071502169d5a => generated 1319 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:22.298992 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=40 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:36:22.434238 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-463b055f-bcc7-4cc5-9432-9b52012ac056 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:22.437067 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-463b055f-bcc7-4cc5-9432-9b52012ac056 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:22.462235 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-463b055f-bcc7-4cc5-9432-9b52012ac056 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:22.463028 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-463b055f-bcc7-4cc5-9432-9b52012ac056 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:22.463650 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-463b055f-bcc7-4cc5-9432-9b52012ac056 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:22.464627 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-463b055f-bcc7-4cc5-9432-9b52012ac056 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:22.465260 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-463b055f-bcc7-4cc5-9432-9b52012ac056 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:22.465866 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-463b055f-bcc7-4cc5-9432-9b52012ac056 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:22.589316 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5de9bde0-3d6d-4c0b-934b-7b6458d0b610 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/4d89f5c9-f26a-47f4-b260-9163e190e777" status: 202 len: 0 microversion: 2.1 time: 1.082852 Sep 23 04:36:22.594187 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 760/1469] 10.222.0.33 () {58 vars in 1272 bytes} [Fri Sep 23 04:36:21 2022] DELETE /compute/v2.1/os-security-groups/4d89f5c9-f26a-47f4-b260-9163e190e777 => generated 0 bytes in 1088 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:36:22.600897 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3892a261-6020-4b1c-a585-194209d57d56 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:22.602908 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-3892a261-6020-4b1c-a585-194209d57d56 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 9e9a41f2-ff28-4c2a-80aa-193e0ebce466] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:22.610606 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3892a261-6020-4b1c-a585-194209d57d56 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:22.611546 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3892a261-6020-4b1c-a585-194209d57d56 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:22.612314 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3892a261-6020-4b1c-a585-194209d57d56 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:22.613488 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3892a261-6020-4b1c-a585-194209d57d56 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:22.623132 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3892a261-6020-4b1c-a585-194209d57d56 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:22.624479 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3892a261-6020-4b1c-a585-194209d57d56 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:22.798709 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-463b055f-bcc7-4cc5-9432-9b52012ac056 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:22.808761 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-463b055f-bcc7-4cc5-9432-9b52012ac056 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea" status: 200 len: 1472 microversion: 2.1 time: 0.384076 Sep 23 04:36:22.814165 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 710/1470] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:22 2022] GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea => generated 1472 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:22.824483 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-afa42924-e70e-4c1b-a981-4a1fdfd5bd37 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] Calling method '.version_select at 0x7ff1bb98fa60>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:23.077126 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-3892a261-6020-4b1c-a585-194209d57d56 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:23.096956 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-3892a261-6020-4b1c-a585-194209d57d56 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:23.098767 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-3892a261-6020-4b1c-a585-194209d57d56 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:23.101223 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3892a261-6020-4b1c-a585-194209d57d56 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466" status: 200 len: 1292 microversion: 2.25 time: 0.505535 Sep 23 04:36:23.102368 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 761/1471] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:36:22 2022] GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466 => generated 1292 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:36:23.109662 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-6308256a-68f3-4299-bb40-76513aeee65d req-0c9ca674-909a-4542-920c-dff108de018f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4a75706-ba44-4b2c-8767-071502169d5a", "tag": "c801336e-f7d9-417d-b4b8-478b0d2b1236"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:36:23.127913 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-6308256a-68f3-4299-bb40-76513aeee65d req-0c9ca674-909a-4542-920c-dff108de018f service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:23.128531 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-6308256a-68f3-4299-bb40-76513aeee65d req-0c9ca674-909a-4542-920c-dff108de018f service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:23.128992 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-6308256a-68f3-4299-bb40-76513aeee65d req-0c9ca674-909a-4542-920c-dff108de018f service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:23.154636 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-6308256a-68f3-4299-bb40-76513aeee65d req-0c9ca674-909a-4542-920c-dff108de018f service nova] Creating event network-changed:c801336e-f7d9-417d-b4b8-478b0d2b1236 for instance b4a75706-ba44-4b2c-8767-071502169d5a on n-h1-846463-3 Sep 23 04:36:23.157257 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-6308256a-68f3-4299-bb40-76513aeee65d req-0c9ca674-909a-4542-920c-dff108de018f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050382 Sep 23 04:36:23.159065 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 762/1472] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:36:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:36:23.324914 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-de904170-1afc-4cad-90fa-5ab2d9fa45af tempest-SecurityGroupRulesNegativeTestJSON-67141960 tempest-SecurityGroupRulesNegativeTestJSON-67141960-project] Action: 'create', calling method: .version_select at 0x7ff1bb9f2280>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1872219959", "description": "tempest-description-542981065"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:36:23.577718 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-afa42924-e70e-4c1b-a981-4a1fdfd5bd37 tempest-SecurityGroupsTestJSON-1588002272 tempest-SecurityGroupsTestJSON-1588002272-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/f3918647-7ac8-412c-893d-11e3349ae9e3" status: 202 len: 0 microversion: 2.1 time: 0.762272 Sep 23 04:36:23.578652 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 711/1473] 10.222.0.33 () {58 vars in 1272 bytes} [Fri Sep 23 04:36:22 2022] DELETE /compute/v2.1/os-security-groups/f3918647-7ac8-412c-893d-11e3349ae9e3 => generated 0 bytes in 764 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:36:23.587372 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3fea1178-d13c-40bf-b5a3-f933a7ced97e tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:23.598147 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3fea1178-d13c-40bf-b5a3-f933a7ced97e tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: b4a75706-ba44-4b2c-8767-071502169d5a] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:23.626565 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3fea1178-d13c-40bf-b5a3-f933a7ced97e tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:23.628389 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3fea1178-d13c-40bf-b5a3-f933a7ced97e tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:23.629763 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3fea1178-d13c-40bf-b5a3-f933a7ced97e tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:23.635916 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3fea1178-d13c-40bf-b5a3-f933a7ced97e tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:23.637563 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3fea1178-d13c-40bf-b5a3-f933a7ced97e tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:23.638797 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3fea1178-d13c-40bf-b5a3-f933a7ced97e tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:23.892636 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-3fea1178-d13c-40bf-b5a3-f933a7ced97e tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:23.906015 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3fea1178-d13c-40bf-b5a3-f933a7ced97e tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/b4a75706-ba44-4b2c-8767-071502169d5a" status: 200 len: 1319 microversion: 2.1 time: 0.322539 Sep 23 04:36:23.906889 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 712/1474] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:23 2022] GET /compute/v2.1/servers/b4a75706-ba44-4b2c-8767-071502169d5a => generated 1319 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:23.914023 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-de904170-1afc-4cad-90fa-5ab2d9fa45af tempest-SecurityGroupRulesNegativeTestJSON-67141960 tempest-SecurityGroupRulesNegativeTestJSON-67141960-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.747524 Sep 23 04:36:23.914023 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 763/1475] 10.222.0.33 () {60 vars in 1180 bytes} [Fri Sep 23 04:36:23 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:36:23.915716 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-898b4874-5536-453b-a6e6-1703e470db80 req-1fb3babc-868c-4646-9b1b-3e5d965f75f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19e41421-3550-49fe-90d0-64b07a5efefa", "tag": "0a2f7d6d-75cc-4bea-a611-434074b855d9"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:36:23.917622 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9ad7beca-1cac-4f78-b52a-7c34b187fdf2 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:23.918446 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-9ad7beca-1cac-4f78-b52a-7c34b187fdf2 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:23.925745 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-898b4874-5536-453b-a6e6-1703e470db80 req-1fb3babc-868c-4646-9b1b-3e5d965f75f8 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:23.926270 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-898b4874-5536-453b-a6e6-1703e470db80 req-1fb3babc-868c-4646-9b1b-3e5d965f75f8 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:23.926969 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-898b4874-5536-453b-a6e6-1703e470db80 req-1fb3babc-868c-4646-9b1b-3e5d965f75f8 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:23.931162 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9ad7beca-1cac-4f78-b52a-7c34b187fdf2 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:23.931669 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9ad7beca-1cac-4f78-b52a-7c34b187fdf2 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:23.932110 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9ad7beca-1cac-4f78-b52a-7c34b187fdf2 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:23.939602 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9ad7beca-1cac-4f78-b52a-7c34b187fdf2 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:23.940215 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9ad7beca-1cac-4f78-b52a-7c34b187fdf2 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:23.940647 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9ad7beca-1cac-4f78-b52a-7c34b187fdf2 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:23.941644 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-898b4874-5536-453b-a6e6-1703e470db80 req-1fb3babc-868c-4646-9b1b-3e5d965f75f8 service nova] Creating event network-changed:0a2f7d6d-75cc-4bea-a611-434074b855d9 for instance 19e41421-3550-49fe-90d0-64b07a5efefa on n-h1-846463-3 Sep 23 04:36:23.949786 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-898b4874-5536-453b-a6e6-1703e470db80 req-1fb3babc-868c-4646-9b1b-3e5d965f75f8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040649 Sep 23 04:36:23.953042 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 713/1476] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:36:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:36:23.959189 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-89e6aeae-4b2c-45fd-8b5a-e114bcb21783 tempest-SecurityGroupRulesNegativeTestJSON-67141960 tempest-SecurityGroupRulesNegativeTestJSON-67141960-project] Action: 'create', calling method: .version_select at 0x7ff1bb98f310>, body: {"security_group_rule": {"parent_group_id": "a47042fe-1d22-4f62-b775-2bbce4c317da", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:36:24.173248 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-9ad7beca-1cac-4f78-b52a-7c34b187fdf2 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:24.188368 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-9ad7beca-1cac-4f78-b52a-7c34b187fdf2 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea" status: 200 len: 1477 microversion: 2.1 time: 0.274314 Sep 23 04:36:24.189196 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 764/1477] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:23 2022] GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea => generated 1477 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:24.195143 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e76244f3-659a-4755-8891-1aea2ddc8300 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:24.195756 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e76244f3-659a-4755-8891-1aea2ddc8300 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 9e9a41f2-ff28-4c2a-80aa-193e0ebce466] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:24.202145 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e76244f3-659a-4755-8891-1aea2ddc8300 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:24.202887 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e76244f3-659a-4755-8891-1aea2ddc8300 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:24.203319 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e76244f3-659a-4755-8891-1aea2ddc8300 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:24.204086 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e76244f3-659a-4755-8891-1aea2ddc8300 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:24.204868 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e76244f3-659a-4755-8891-1aea2ddc8300 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:24.205474 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e76244f3-659a-4755-8891-1aea2ddc8300 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:24.437028 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e76244f3-659a-4755-8891-1aea2ddc8300 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:24.446384 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e76244f3-659a-4755-8891-1aea2ddc8300 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:24.447836 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e76244f3-659a-4755-8891-1aea2ddc8300 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:24.449271 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e76244f3-659a-4755-8891-1aea2ddc8300 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466" status: 200 len: 1292 microversion: 2.25 time: 0.258930 Sep 23 04:36:24.450597 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 765/1478] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:36:24 2022] GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466 => generated 1292 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:36:24.972111 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-37fd0d82-9044-42f0-a7d8-86afe8d33375 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:24.972111 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-37fd0d82-9044-42f0-a7d8-86afe8d33375 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: b4a75706-ba44-4b2c-8767-071502169d5a] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:24.972111 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-37fd0d82-9044-42f0-a7d8-86afe8d33375 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:24.972111 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-37fd0d82-9044-42f0-a7d8-86afe8d33375 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:24.972547 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-37fd0d82-9044-42f0-a7d8-86afe8d33375 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:24.972547 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-37fd0d82-9044-42f0-a7d8-86afe8d33375 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:24.972547 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-37fd0d82-9044-42f0-a7d8-86afe8d33375 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:24.972547 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-37fd0d82-9044-42f0-a7d8-86afe8d33375 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:25.229810 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-37fd0d82-9044-42f0-a7d8-86afe8d33375 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:25.229810 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-37fd0d82-9044-42f0-a7d8-86afe8d33375 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/b4a75706-ba44-4b2c-8767-071502169d5a" status: 200 len: 1319 microversion: 2.1 time: 0.291524 Sep 23 04:36:25.229810 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 766/1479] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:24 2022] GET /compute/v2.1/servers/b4a75706-ba44-4b2c-8767-071502169d5a => generated 1319 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:36:25.233544 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6270df81-625f-4d3c-900b-d730b4863612 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:25.234338 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-6270df81-625f-4d3c-900b-d730b4863612 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:25.246988 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6270df81-625f-4d3c-900b-d730b4863612 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:25.247579 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6270df81-625f-4d3c-900b-d730b4863612 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:25.249216 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6270df81-625f-4d3c-900b-d730b4863612 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:25.250377 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6270df81-625f-4d3c-900b-d730b4863612 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:25.251127 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6270df81-625f-4d3c-900b-d730b4863612 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:25.251795 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6270df81-625f-4d3c-900b-d730b4863612 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:25.429749 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-6270df81-625f-4d3c-900b-d730b4863612 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:25.437780 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6270df81-625f-4d3c-900b-d730b4863612 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea" status: 200 len: 1477 microversion: 2.1 time: 0.210097 Sep 23 04:36:25.439155 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 767/1480] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:25 2022] GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea => generated 1477 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:25.475019 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3f6f3805-4b4a-4882-acc1-d81420ef9205 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:25.475743 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-3f6f3805-4b4a-4882-acc1-d81420ef9205 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 9e9a41f2-ff28-4c2a-80aa-193e0ebce466] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:25.481932 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3f6f3805-4b4a-4882-acc1-d81420ef9205 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:25.482502 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3f6f3805-4b4a-4882-acc1-d81420ef9205 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:25.483004 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3f6f3805-4b4a-4882-acc1-d81420ef9205 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:25.483776 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3f6f3805-4b4a-4882-acc1-d81420ef9205 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:25.484299 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3f6f3805-4b4a-4882-acc1-d81420ef9205 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:25.484793 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3f6f3805-4b4a-4882-acc1-d81420ef9205 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:25.639476 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-89e6aeae-4b2c-45fd-8b5a-e114bcb21783 tempest-SecurityGroupRulesNegativeTestJSON-67141960 tempest-SecurityGroupRulesNegativeTestJSON-67141960-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.685133 Sep 23 04:36:25.647948 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 714/1481] 10.222.0.33 () {60 vars in 1195 bytes} [Fri Sep 23 04:36:23 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1694 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:36:25.655278 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d32c79f6-b025-4804-86c6-1f28e2be4af7 tempest-SecurityGroupRulesNegativeTestJSON-67141960 tempest-SecurityGroupRulesNegativeTestJSON-67141960-project] Action: 'create', calling method: .version_select at 0x7ff1bb94e700>, body: {"security_group_rule": {"parent_group_id": "a47042fe-1d22-4f62-b775-2bbce4c317da", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:36:25.731580 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-3f6f3805-4b4a-4882-acc1-d81420ef9205 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:25.744245 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-3f6f3805-4b4a-4882-acc1-d81420ef9205 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:25.745649 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-3f6f3805-4b4a-4882-acc1-d81420ef9205 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:25.746814 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3f6f3805-4b4a-4882-acc1-d81420ef9205 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466" status: 200 len: 1292 microversion: 2.25 time: 0.275671 Sep 23 04:36:25.763164 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 768/1482] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:36:25 2022] GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466 => generated 1292 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:36:25.763557 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-d32c79f6-b025-4804-86c6-1f28e2be4af7 tempest-SecurityGroupRulesNegativeTestJSON-67141960 tempest-SecurityGroupRulesNegativeTestJSON-67141960-project] HTTP exception thrown: This rule already exists in group a47042fe-1d22-4f62-b775-2bbce4c317da Sep 23 04:36:25.765419 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d32c79f6-b025-4804-86c6-1f28e2be4af7 tempest-SecurityGroupRulesNegativeTestJSON-67141960 tempest-SecurityGroupRulesNegativeTestJSON-67141960-project] Request method failure captured: Sep 23 04:36:25.765419 n-d-846463-3 devstack@n-api.service[122698]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 23 04:36:25.765419 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:36:25.765419 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:36:25.765419 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:36:25.765419 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 138 Sep 23 04:36:25.765419 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:36:25.765419 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:36:25.765419 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:36:25.765419 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:36:25.765419 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTfG6EWi6j-CGFLPDAGWY9XJbMBFd_1BZo7VHHhhUiN3PTYnAuvL00mkAP25coiaFwhGfEWIGrdqPkm8UZ4EXZZ67cAG6t39z9R16I3-I9rfnbrVOKhBQDyFIHdZsAe61JGj4smUcQ0Bq3J4_LzjcPFRuO9_SNXs60bPHRgj3RflA30 Sep 23 04:36:25.765419 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:36:25.765419 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:36:25.765419 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:36:25.765419 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:36:25.765419 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:36:25.765419 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:36:25.765419 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: b29469fc5ab2437e811614e26d951948 Sep 23 04:36:25.765419 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-67141960 Sep 23 04:36:25.765419 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:36:25.765419 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:36:25.767507 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b29469fc5ab2437e811614e26d951948", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b29469fc5ab2437e811614e26d951948"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b29469fc5ab2437e811614e26d951948"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b29469fc5ab2437e811614e26d951948"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:36:25.767507 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-67141960 Sep 23 04:36:25.767507 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: b29469fc5ab2437e811614e26d951948 Sep 23 04:36:25.767507 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-67141960 Sep 23 04:36:25.767507 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-67141960-project Sep 23 04:36:25.767507 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:36:25.767507 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:36:25.767507 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: d467da509e5347ea945bbeaffdd998ce Sep 23 04:36:25.767507 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-67141960-project Sep 23 04:36:25.767507 n-d-846463-3 devstack@n-api.service[122698]: Sep 23 04:36:25.767507 n-d-846463-3 devstack@n-api.service[122698]: {"security_group_rule": {"parent_group_id": "a47042fe-1d22-4f62-b775-2bbce4c317da", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Sep 23 04:36:25.767507 n-d-846463-3 devstack@n-api.service[122698]: method: Sep 23 04:36:25.768522 n-d-846463-3 devstack@n-api.service[122698]: exception: This rule already exists in group a47042fe-1d22-4f62-b775-2bbce4c317da Sep 23 04:36:25.768522 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'a47042fe-1d22-4f62-b775-2bbce4c317da', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Sep 23 04:36:25.768522 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:36:25.768522 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:36:25.768522 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Sep 23 04:36:25.768522 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Sep 23 04:36:25.768522 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Sep 23 04:36:25.768522 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Sep 23 04:36:25.768522 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group a47042fe-1d22-4f62-b775-2bbce4c317da Sep 23 04:36:25.768522 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:36:25.768522 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:36:25.768522 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:36:25.768522 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:36:25.768522 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:36:25.768522 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:36:25.768522 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:36:25.768522 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:36:25.768522 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:36:25.768522 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:36:25.768522 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:36:25.770265 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:36:25.770265 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Sep 23 04:36:25.770265 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 23 04:36:25.770265 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group a47042fe-1d22-4f62-b775-2bbce4c317da Sep 23 04:36:25.770265 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:36:25.770265 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:36:25.770265 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:36:25.770265 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:36:25.770265 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:36:25.770265 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:36:25.770265 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:36:25.770265 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:36:25.770265 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group a47042fe-1d22-4f62-b775-2bbce4c317da Sep 23 04:36:25.770265 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:36:25.770265 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d32c79f6-b025-4804-86c6-1f28e2be4af7 tempest-SecurityGroupRulesNegativeTestJSON-67141960 tempest-SecurityGroupRulesNegativeTestJSON-67141960-project] Returning 400 to user: This rule already exists in group a47042fe-1d22-4f62-b775-2bbce4c317da {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:36:25.771514 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d32c79f6-b025-4804-86c6-1f28e2be4af7 tempest-SecurityGroupRulesNegativeTestJSON-67141960 tempest-SecurityGroupRulesNegativeTestJSON-67141960-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.116623 Sep 23 04:36:25.771514 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 715/1483] 10.222.0.33 () {60 vars in 1195 bytes} [Fri Sep 23 04:36:25 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 122 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 04:36:25.777292 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1c5670ca-b0c4-4bb7-8f85-8ca9d41d556b tempest-SecurityGroupRulesNegativeTestJSON-67141960 tempest-SecurityGroupRulesNegativeTestJSON-67141960-project] Calling method '.version_select at 0x7ff1bb8d5790>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:26.139088 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1c5670ca-b0c4-4bb7-8f85-8ca9d41d556b tempest-SecurityGroupRulesNegativeTestJSON-67141960 tempest-SecurityGroupRulesNegativeTestJSON-67141960-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-group-rules/9b5b4ba6-6231-4bd9-9626-70048b3ef3a3" status: 202 len: 0 microversion: 2.1 time: 0.365638 Sep 23 04:36:26.140316 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 769/1484] 10.222.0.33 () {58 vars in 1287 bytes} [Fri Sep 23 04:36:25 2022] DELETE /compute/v2.1/os-security-group-rules/9b5b4ba6-6231-4bd9-9626-70048b3ef3a3 => generated 0 bytes in 369 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 23 04:36:26.152144 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2c644447-0916-4e20-a456-28259dcfde75 tempest-SecurityGroupRulesNegativeTestJSON-67141960 tempest-SecurityGroupRulesNegativeTestJSON-67141960-project] Action: 'create', calling method: .version_select at 0x7ff1bb9484c0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1905131842", "description": "tempest-description-1233092862"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:36:26.252819 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ffe6f419-00f6-4a8e-b189-f3e18a84cee8 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:26.252819 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ffe6f419-00f6-4a8e-b189-f3e18a84cee8 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: b4a75706-ba44-4b2c-8767-071502169d5a] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:26.265266 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ffe6f419-00f6-4a8e-b189-f3e18a84cee8 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:26.266577 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ffe6f419-00f6-4a8e-b189-f3e18a84cee8 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:26.278036 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ffe6f419-00f6-4a8e-b189-f3e18a84cee8 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:26.284465 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ffe6f419-00f6-4a8e-b189-f3e18a84cee8 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:26.284465 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ffe6f419-00f6-4a8e-b189-f3e18a84cee8 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:26.284465 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ffe6f419-00f6-4a8e-b189-f3e18a84cee8 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:26.515161 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ffe6f419-00f6-4a8e-b189-f3e18a84cee8 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:26.529961 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ffe6f419-00f6-4a8e-b189-f3e18a84cee8 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/b4a75706-ba44-4b2c-8767-071502169d5a" status: 200 len: 1319 microversion: 2.1 time: 0.282182 Sep 23 04:36:26.540301 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 770/1485] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:26 2022] GET /compute/v2.1/servers/b4a75706-ba44-4b2c-8767-071502169d5a => generated 1319 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:26.551506 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6a79c67e-934c-4ee4-80b4-d06376018093 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:26.552141 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-6a79c67e-934c-4ee4-80b4-d06376018093 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:26.560226 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6a79c67e-934c-4ee4-80b4-d06376018093 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:26.564869 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6a79c67e-934c-4ee4-80b4-d06376018093 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:26.572086 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6a79c67e-934c-4ee4-80b4-d06376018093 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:26.572086 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6a79c67e-934c-4ee4-80b4-d06376018093 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:26.572086 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6a79c67e-934c-4ee4-80b4-d06376018093 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:26.572086 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6a79c67e-934c-4ee4-80b4-d06376018093 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:26.861128 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2c644447-0916-4e20-a456-28259dcfde75 tempest-SecurityGroupRulesNegativeTestJSON-67141960 tempest-SecurityGroupRulesNegativeTestJSON-67141960-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.714992 Sep 23 04:36:26.862426 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 716/1486] 10.222.0.33 () {60 vars in 1180 bytes} [Fri Sep 23 04:36:26 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:36:26.868666 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f5af03dc-833d-4e73-a457-3086ae26e0e2 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:26.872107 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f5af03dc-833d-4e73-a457-3086ae26e0e2 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 9e9a41f2-ff28-4c2a-80aa-193e0ebce466] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:26.887721 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f5af03dc-833d-4e73-a457-3086ae26e0e2 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:26.898062 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f5af03dc-833d-4e73-a457-3086ae26e0e2 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:26.898062 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f5af03dc-833d-4e73-a457-3086ae26e0e2 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:26.898062 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f5af03dc-833d-4e73-a457-3086ae26e0e2 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:26.898062 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f5af03dc-833d-4e73-a457-3086ae26e0e2 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:26.898492 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f5af03dc-833d-4e73-a457-3086ae26e0e2 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:26.939369 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-6a79c67e-934c-4ee4-80b4-d06376018093 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:26.957547 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6a79c67e-934c-4ee4-80b4-d06376018093 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea" status: 200 len: 1477 microversion: 2.1 time: 0.407599 Sep 23 04:36:26.957547 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 771/1487] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:26 2022] GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea => generated 1477 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:26.964334 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e1fca2f7-b0ab-42aa-b9d1-f6dd6e0c2469 tempest-SecurityGroupRulesNegativeTestJSON-67141960 tempest-SecurityGroupRulesNegativeTestJSON-67141960-project] Action: 'create', calling method: .version_select at 0x7ff1bbc990d0>, body: {"security_group_rule": {"parent_group_id": "499e3e94-6be7-49ce-a3ed-bf0ecd5ad936", "ip_protocol": "tcp", "from_port": 780088668, "to_port": 22}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:36:27.064002 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-e1fca2f7-b0ab-42aa-b9d1-f6dd6e0c2469 tempest-SecurityGroupRulesNegativeTestJSON-67141960 tempest-SecurityGroupRulesNegativeTestJSON-67141960-project] HTTP exception thrown: Invalid port range 780088668:22. Former value cannot be greater than the later Sep 23 04:36:27.066901 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e1fca2f7-b0ab-42aa-b9d1-f6dd6e0c2469 tempest-SecurityGroupRulesNegativeTestJSON-67141960 tempest-SecurityGroupRulesNegativeTestJSON-67141960-project] Request method failure captured: Sep 23 04:36:27.066901 n-d-846463-3 devstack@n-api.service[122699]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 23 04:36:27.066901 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:36:27.066901 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:36:27.066901 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:36:27.066901 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 145 Sep 23 04:36:27.066901 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:36:27.066901 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:36:27.066901 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:36:27.066901 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:36:27.066901 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTfG6EWi6j-CGFLPDAGWY9XJbMBFd_1BZo7VHHhhUiN3PTYnAuvL00mkAP25coiaFwhGfEWIGrdqPkm8UZ4EXZZ67cAG6t39z9R16I3-I9rfnbrVOKhBQDyFIHdZsAe61JGj4smUcQ0Bq3J4_LzjcPFRuO9_SNXs60bPHRgj3RflA30 Sep 23 04:36:27.066901 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:36:27.066901 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:36:27.066901 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:36:27.066901 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:36:27.066901 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:36:27.066901 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:36:27.066901 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: b29469fc5ab2437e811614e26d951948 Sep 23 04:36:27.066901 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-67141960 Sep 23 04:36:27.066901 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:36:27.066901 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:36:27.068592 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b29469fc5ab2437e811614e26d951948", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b29469fc5ab2437e811614e26d951948"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b29469fc5ab2437e811614e26d951948"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b29469fc5ab2437e811614e26d951948"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:36:27.068592 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-67141960 Sep 23 04:36:27.068592 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: b29469fc5ab2437e811614e26d951948 Sep 23 04:36:27.068592 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-67141960 Sep 23 04:36:27.068592 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-67141960-project Sep 23 04:36:27.068592 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:36:27.068592 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:36:27.068592 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: d467da509e5347ea945bbeaffdd998ce Sep 23 04:36:27.068592 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-67141960-project Sep 23 04:36:27.068592 n-d-846463-3 devstack@n-api.service[122699]: Sep 23 04:36:27.068592 n-d-846463-3 devstack@n-api.service[122699]: {"security_group_rule": {"parent_group_id": "499e3e94-6be7-49ce-a3ed-bf0ecd5ad936", "ip_protocol": "tcp", "from_port": 780088668, "to_port": 22}} Sep 23 04:36:27.068592 n-d-846463-3 devstack@n-api.service[122699]: method: Sep 23 04:36:27.069671 n-d-846463-3 devstack@n-api.service[122699]: exception: Invalid port range 780088668:22. Former value cannot be greater than the later Sep 23 04:36:27.069671 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'body': {'security_group_rule': {'parent_group_id': '499e3e94-6be7-49ce-a3ed-bf0ecd5ad936', 'ip_protocol': 'tcp', 'from_port': 780088668, 'to_port': 22}}} Sep 23 04:36:27.069671 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:36:27.069671 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:36:27.069671 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Sep 23 04:36:27.069671 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Sep 23 04:36:27.069671 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Sep 23 04:36:27.069671 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Sep 23 04:36:27.069671 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Sep 23 04:36:27.069671 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Sep 23 04:36:27.069671 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Sep 23 04:36:27.069671 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Sep 23 04:36:27.069671 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 780088668:22. Former value cannot be greater than the later Sep 23 04:36:27.069671 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:36:27.069671 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:36:27.069671 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:36:27.069671 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:36:27.069671 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:36:27.069671 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:36:27.071229 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:36:27.071229 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:36:27.071229 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:36:27.071229 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:36:27.071229 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:36:27.071229 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:36:27.071229 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 23 04:36:27.071229 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 23 04:36:27.071229 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 780088668:22. Former value cannot be greater than the later Sep 23 04:36:27.071229 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:36:27.071229 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:36:27.071229 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:36:27.071229 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:36:27.071229 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:36:27.071229 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:36:27.071229 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:36:27.071229 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:36:27.071229 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 780088668:22. Former value cannot be greater than the later Sep 23 04:36:27.071229 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:36:27.073779 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e1fca2f7-b0ab-42aa-b9d1-f6dd6e0c2469 tempest-SecurityGroupRulesNegativeTestJSON-67141960 tempest-SecurityGroupRulesNegativeTestJSON-67141960-project] Returning 400 to user: Invalid port range 780088668:22. Former value cannot be greater than the later {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:36:27.075829 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e1fca2f7-b0ab-42aa-b9d1-f6dd6e0c2469 tempest-SecurityGroupRulesNegativeTestJSON-67141960 tempest-SecurityGroupRulesNegativeTestJSON-67141960-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 122 microversion: 2.1 time: 0.116842 Sep 23 04:36:27.082909 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 772/1488] 10.222.0.33 () {60 vars in 1195 bytes} [Fri Sep 23 04:36:26 2022] POST /compute/v2.1/os-security-group-rules => generated 122 bytes in 122 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 04:36:27.106047 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-51c8b295-0279-4e07-ad08-8f64b270c998 tempest-SecurityGroupRulesNegativeTestJSON-67141960 tempest-SecurityGroupRulesNegativeTestJSON-67141960-project] Action: 'create', calling method: .version_select at 0x7ff1bb7d2f70>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-253056346", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:36:27.110680 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-51c8b295-0279-4e07-ad08-8f64b270c998 tempest-SecurityGroupRulesNegativeTestJSON-67141960 tempest-SecurityGroupRulesNegativeTestJSON-67141960-project] HTTP exception thrown: Security group id should be uuid Sep 23 04:36:27.114870 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-51c8b295-0279-4e07-ad08-8f64b270c998 tempest-SecurityGroupRulesNegativeTestJSON-67141960 tempest-SecurityGroupRulesNegativeTestJSON-67141960-project] Request method failure captured: Sep 23 04:36:27.114870 n-d-846463-3 devstack@n-api.service[122699]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 23 04:36:27.114870 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:36:27.114870 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:36:27.114870 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:36:27.114870 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 130 Sep 23 04:36:27.114870 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:36:27.114870 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:36:27.114870 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:36:27.114870 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:36:27.114870 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTfG6EWi6j-CGFLPDAGWY9XJbMBFd_1BZo7VHHhhUiN3PTYnAuvL00mkAP25coiaFwhGfEWIGrdqPkm8UZ4EXZZ67cAG6t39z9R16I3-I9rfnbrVOKhBQDyFIHdZsAe61JGj4smUcQ0Bq3J4_LzjcPFRuO9_SNXs60bPHRgj3RflA30 Sep 23 04:36:27.114870 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:36:27.114870 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:36:27.114870 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:36:27.114870 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:36:27.114870 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:36:27.114870 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:36:27.114870 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: b29469fc5ab2437e811614e26d951948 Sep 23 04:36:27.114870 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-67141960 Sep 23 04:36:27.114870 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:36:27.114870 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:36:27.116610 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b29469fc5ab2437e811614e26d951948", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b29469fc5ab2437e811614e26d951948"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b29469fc5ab2437e811614e26d951948"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b29469fc5ab2437e811614e26d951948"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:36:27.116610 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-67141960 Sep 23 04:36:27.116610 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: b29469fc5ab2437e811614e26d951948 Sep 23 04:36:27.116610 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-67141960 Sep 23 04:36:27.116610 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-67141960-project Sep 23 04:36:27.116610 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:36:27.116610 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:36:27.116610 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: d467da509e5347ea945bbeaffdd998ce Sep 23 04:36:27.116610 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-67141960-project Sep 23 04:36:27.116610 n-d-846463-3 devstack@n-api.service[122699]: Sep 23 04:36:27.116610 n-d-846463-3 devstack@n-api.service[122699]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-253056346", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Sep 23 04:36:27.116610 n-d-846463-3 devstack@n-api.service[122699]: method: Sep 23 04:36:27.116610 n-d-846463-3 devstack@n-api.service[122699]: exception: Security group id should be uuid Sep 23 04:36:27.117725 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-253056346', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Sep 23 04:36:27.117725 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:36:27.117725 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:36:27.117725 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Sep 23 04:36:27.117725 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Sep 23 04:36:27.117725 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Sep 23 04:36:27.117725 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Sep 23 04:36:27.117725 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Sep 23 04:36:27.117725 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:36:27.117725 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:36:27.117725 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:36:27.117725 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:36:27.117725 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:36:27.117725 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:36:27.117725 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:36:27.117725 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:36:27.117725 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:36:27.117725 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:36:27.117725 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:36:27.117725 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:36:27.119299 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 23 04:36:27.119299 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 23 04:36:27.119299 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Sep 23 04:36:27.119299 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:36:27.119299 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:36:27.119299 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:36:27.119299 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:36:27.119299 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:36:27.119299 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:36:27.119299 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:36:27.119299 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:36:27.119299 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Sep 23 04:36:27.119299 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:36:27.120859 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-51c8b295-0279-4e07-ad08-8f64b270c998 tempest-SecurityGroupRulesNegativeTestJSON-67141960 tempest-SecurityGroupRulesNegativeTestJSON-67141960-project] Returning 400 to user: Security group id should be uuid {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:36:27.123357 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-51c8b295-0279-4e07-ad08-8f64b270c998 tempest-SecurityGroupRulesNegativeTestJSON-67141960 tempest-SecurityGroupRulesNegativeTestJSON-67141960-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.035641 Sep 23 04:36:27.129836 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 773/1489] 10.222.0.33 () {60 vars in 1195 bytes} [Fri Sep 23 04:36:27 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 23 04:36:27.149242 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3adb0636-17fa-4408-8e4e-fba8c5bc1961 tempest-SecurityGroupRulesNegativeTestJSON-67141960 tempest-SecurityGroupRulesNegativeTestJSON-67141960-project] Action: 'create', calling method: .version_select at 0x7ff1c04d7c10>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1469864620", "description": "tempest-description-961195370"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:36:27.163757 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f5af03dc-833d-4e73-a457-3086ae26e0e2 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:27.175164 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f5af03dc-833d-4e73-a457-3086ae26e0e2 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:27.190867 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f5af03dc-833d-4e73-a457-3086ae26e0e2 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:27.192125 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f5af03dc-833d-4e73-a457-3086ae26e0e2 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466" status: 200 len: 1280 microversion: 2.25 time: 0.328389 Sep 23 04:36:27.192689 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 717/1490] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:36:26 2022] GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466 => generated 1280 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:36:27.554973 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0c33d0ca-b15b-4780-b70b-e51bfbe87b1e tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:27.555881 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-0c33d0ca-b15b-4780-b70b-e51bfbe87b1e tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: b4a75706-ba44-4b2c-8767-071502169d5a] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:27.566055 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0c33d0ca-b15b-4780-b70b-e51bfbe87b1e tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:27.569740 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0c33d0ca-b15b-4780-b70b-e51bfbe87b1e tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:27.572404 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0c33d0ca-b15b-4780-b70b-e51bfbe87b1e tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:27.572404 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0c33d0ca-b15b-4780-b70b-e51bfbe87b1e tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:27.573917 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0c33d0ca-b15b-4780-b70b-e51bfbe87b1e tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:27.574488 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0c33d0ca-b15b-4780-b70b-e51bfbe87b1e tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:27.777945 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3adb0636-17fa-4408-8e4e-fba8c5bc1961 tempest-SecurityGroupRulesNegativeTestJSON-67141960 tempest-SecurityGroupRulesNegativeTestJSON-67141960-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.645430 Sep 23 04:36:27.779409 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 774/1491] 10.222.0.33 () {60 vars in 1180 bytes} [Fri Sep 23 04:36:27 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:36:27.792930 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-73d7e9c7-2925-4fe4-b5fb-76cd2c2da221 tempest-SecurityGroupRulesNegativeTestJSON-67141960 tempest-SecurityGroupRulesNegativeTestJSON-67141960-project] Action: 'create', calling method: .version_select at 0x7ff1bb9d8e50>, body: {"security_group_rule": {"parent_group_id": "d2beb904-55e3-4f49-bf53-e5087a12001a", "ip_protocol": "tempest-999-694162497", "from_port": 22, "to_port": 22}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:36:27.919555 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-0c33d0ca-b15b-4780-b70b-e51bfbe87b1e tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:27.931659 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0c33d0ca-b15b-4780-b70b-e51bfbe87b1e tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/b4a75706-ba44-4b2c-8767-071502169d5a" status: 200 len: 1319 microversion: 2.1 time: 0.381947 Sep 23 04:36:27.934370 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 718/1492] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:27 2022] GET /compute/v2.1/servers/b4a75706-ba44-4b2c-8767-071502169d5a => generated 1319 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:36:27.956517 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-73d7e9c7-2925-4fe4-b5fb-76cd2c2da221 tempest-SecurityGroupRulesNegativeTestJSON-67141960 tempest-SecurityGroupRulesNegativeTestJSON-67141960-project] HTTP exception thrown: Invalid IP protocol tempest-999-694162497. Sep 23 04:36:27.959154 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-73d7e9c7-2925-4fe4-b5fb-76cd2c2da221 tempest-SecurityGroupRulesNegativeTestJSON-67141960 tempest-SecurityGroupRulesNegativeTestJSON-67141960-project] Request method failure captured: Sep 23 04:36:27.959154 n-d-846463-3 devstack@n-api.service[122699]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 23 04:36:27.959154 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:36:27.959154 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:36:27.959154 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:36:27.959154 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 156 Sep 23 04:36:27.959154 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:36:27.959154 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:36:27.959154 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:36:27.959154 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:36:27.959154 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTfG6EWi6j-CGFLPDAGWY9XJbMBFd_1BZo7VHHhhUiN3PTYnAuvL00mkAP25coiaFwhGfEWIGrdqPkm8UZ4EXZZ67cAG6t39z9R16I3-I9rfnbrVOKhBQDyFIHdZsAe61JGj4smUcQ0Bq3J4_LzjcPFRuO9_SNXs60bPHRgj3RflA30 Sep 23 04:36:27.959154 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:36:27.959154 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:36:27.959154 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:36:27.959154 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:36:27.959154 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:36:27.959154 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:36:27.959154 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: b29469fc5ab2437e811614e26d951948 Sep 23 04:36:27.959154 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-67141960 Sep 23 04:36:27.959154 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:36:27.959154 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:36:27.961430 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b29469fc5ab2437e811614e26d951948", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b29469fc5ab2437e811614e26d951948"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b29469fc5ab2437e811614e26d951948"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b29469fc5ab2437e811614e26d951948"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:36:27.961430 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-67141960 Sep 23 04:36:27.961430 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: b29469fc5ab2437e811614e26d951948 Sep 23 04:36:27.961430 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-67141960 Sep 23 04:36:27.961430 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-67141960-project Sep 23 04:36:27.961430 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:36:27.961430 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:36:27.961430 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: d467da509e5347ea945bbeaffdd998ce Sep 23 04:36:27.961430 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-67141960-project Sep 23 04:36:27.961430 n-d-846463-3 devstack@n-api.service[122699]: Sep 23 04:36:27.961430 n-d-846463-3 devstack@n-api.service[122699]: {"security_group_rule": {"parent_group_id": "d2beb904-55e3-4f49-bf53-e5087a12001a", "ip_protocol": "tempest-999-694162497", "from_port": 22, "to_port": 22}} Sep 23 04:36:27.961430 n-d-846463-3 devstack@n-api.service[122699]: method: Sep 23 04:36:27.962403 n-d-846463-3 devstack@n-api.service[122699]: exception: Invalid IP protocol tempest-999-694162497. Sep 23 04:36:27.962403 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'd2beb904-55e3-4f49-bf53-e5087a12001a', 'ip_protocol': 'tempest-999-694162497', 'from_port': 22, 'to_port': 22}}} Sep 23 04:36:27.962403 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:36:27.962403 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:36:27.962403 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Sep 23 04:36:27.962403 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Sep 23 04:36:27.962403 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Sep 23 04:36:27.962403 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Sep 23 04:36:27.962403 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Sep 23 04:36:27.962403 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Sep 23 04:36:27.962403 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Sep 23 04:36:27.962403 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Sep 23 04:36:27.962403 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-694162497. Sep 23 04:36:27.962403 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:36:27.962403 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:36:27.962403 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:36:27.962403 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:36:27.962403 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:36:27.962403 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:36:27.963884 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:36:27.963884 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:36:27.963884 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:36:27.963884 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:36:27.963884 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:36:27.963884 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:36:27.963884 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 23 04:36:27.963884 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 23 04:36:27.963884 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-694162497. Sep 23 04:36:27.963884 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:36:27.963884 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:36:27.963884 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:36:27.963884 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:36:27.963884 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:36:27.963884 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:36:27.963884 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:36:27.963884 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:36:27.963884 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-694162497. Sep 23 04:36:27.963884 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:36:27.967292 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-73d7e9c7-2925-4fe4-b5fb-76cd2c2da221 tempest-SecurityGroupRulesNegativeTestJSON-67141960 tempest-SecurityGroupRulesNegativeTestJSON-67141960-project] Returning 400 to user: Invalid IP protocol tempest-999-694162497. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:36:27.968416 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-73d7e9c7-2925-4fe4-b5fb-76cd2c2da221 tempest-SecurityGroupRulesNegativeTestJSON-67141960 tempest-SecurityGroupRulesNegativeTestJSON-67141960-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 86 microversion: 2.1 time: 0.179544 Sep 23 04:36:27.969541 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 775/1493] 10.222.0.33 () {60 vars in 1195 bytes} [Fri Sep 23 04:36:27 2022] POST /compute/v2.1/os-security-group-rules => generated 86 bytes in 182 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 23 04:36:27.981100 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6167ec02-8987-47f5-828b-d2d7c1c7ddc2 tempest-SecurityGroupRulesNegativeTestJSON-67141960 tempest-SecurityGroupRulesNegativeTestJSON-67141960-project] Action: 'create', calling method: .version_select at 0x7ff1bbb2f670>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1288704771", "description": "tempest-description-1112214428"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:36:27.981339 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7d150aad-c268-455d-8fe9-53f46fa0bc31 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:27.982093 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7d150aad-c268-455d-8fe9-53f46fa0bc31 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:28.007108 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7d150aad-c268-455d-8fe9-53f46fa0bc31 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:28.014011 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7d150aad-c268-455d-8fe9-53f46fa0bc31 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:28.014595 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7d150aad-c268-455d-8fe9-53f46fa0bc31 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:28.018546 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7d150aad-c268-455d-8fe9-53f46fa0bc31 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:28.019045 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7d150aad-c268-455d-8fe9-53f46fa0bc31 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:28.019491 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7d150aad-c268-455d-8fe9-53f46fa0bc31 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:28.243862 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-7d150aad-c268-455d-8fe9-53f46fa0bc31 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:28.254452 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7d150aad-c268-455d-8fe9-53f46fa0bc31 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea" status: 200 len: 1477 microversion: 2.1 time: 0.278269 Sep 23 04:36:28.255414 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 719/1494] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:27 2022] GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea => generated 1477 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:28.273500 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6879ded8-91a4-4428-9e83-32dc3476ce91 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:28.274340 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-6879ded8-91a4-4428-9e83-32dc3476ce91 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 9e9a41f2-ff28-4c2a-80aa-193e0ebce466] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:28.280482 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6879ded8-91a4-4428-9e83-32dc3476ce91 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:28.280979 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6879ded8-91a4-4428-9e83-32dc3476ce91 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:28.281431 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6879ded8-91a4-4428-9e83-32dc3476ce91 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:28.282162 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6879ded8-91a4-4428-9e83-32dc3476ce91 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:28.282625 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6879ded8-91a4-4428-9e83-32dc3476ce91 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:28.283059 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6879ded8-91a4-4428-9e83-32dc3476ce91 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:28.496865 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6879ded8-91a4-4428-9e83-32dc3476ce91 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:28.511758 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6879ded8-91a4-4428-9e83-32dc3476ce91 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:28.514621 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6879ded8-91a4-4428-9e83-32dc3476ce91 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:28.516973 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-6879ded8-91a4-4428-9e83-32dc3476ce91 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466" status: 200 len: 1280 microversion: 2.25 time: 0.249432 Sep 23 04:36:28.517920 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 720/1495] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:36:28 2022] GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466 => generated 1280 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:36:28.552595 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6167ec02-8987-47f5-828b-d2d7c1c7ddc2 tempest-SecurityGroupRulesNegativeTestJSON-67141960 tempest-SecurityGroupRulesNegativeTestJSON-67141960-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.574462 Sep 23 04:36:28.554813 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 776/1496] 10.222.0.33 () {60 vars in 1180 bytes} [Fri Sep 23 04:36:27 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:36:28.571225 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5d90d979-ad4b-4b67-b5e5-a332ec89cb73 tempest-SecurityGroupRulesNegativeTestJSON-67141960 tempest-SecurityGroupRulesNegativeTestJSON-67141960-project] Action: 'create', calling method: .version_select at 0x7ff1bbaa75e0>, body: {"security_group_rule": {"parent_group_id": "e7f34da6-6ac4-4417-9cb3-a36a96c654dd", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:36:28.633635 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-5d90d979-ad4b-4b67-b5e5-a332ec89cb73 tempest-SecurityGroupRulesNegativeTestJSON-67141960 tempest-SecurityGroupRulesNegativeTestJSON-67141960-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Sep 23 04:36:28.638441 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5d90d979-ad4b-4b67-b5e5-a332ec89cb73 tempest-SecurityGroupRulesNegativeTestJSON-67141960 tempest-SecurityGroupRulesNegativeTestJSON-67141960-project] Request method failure captured: Sep 23 04:36:28.638441 n-d-846463-3 devstack@n-api.service[122698]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 23 04:36:28.638441 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:36:28.638441 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:36:28.638441 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:36:28.638441 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 138 Sep 23 04:36:28.638441 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:36:28.638441 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:36:28.638441 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:36:28.638441 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:36:28.638441 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTfG6EWi6j-CGFLPDAGWY9XJbMBFd_1BZo7VHHhhUiN3PTYnAuvL00mkAP25coiaFwhGfEWIGrdqPkm8UZ4EXZZ67cAG6t39z9R16I3-I9rfnbrVOKhBQDyFIHdZsAe61JGj4smUcQ0Bq3J4_LzjcPFRuO9_SNXs60bPHRgj3RflA30 Sep 23 04:36:28.638441 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:36:28.638441 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:36:28.638441 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:36:28.638441 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:36:28.638441 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:36:28.638441 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:36:28.638441 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: b29469fc5ab2437e811614e26d951948 Sep 23 04:36:28.638441 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-67141960 Sep 23 04:36:28.638441 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:36:28.638441 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:36:28.640081 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b29469fc5ab2437e811614e26d951948", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b29469fc5ab2437e811614e26d951948"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b29469fc5ab2437e811614e26d951948"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b29469fc5ab2437e811614e26d951948"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:36:28.640081 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-67141960 Sep 23 04:36:28.640081 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: b29469fc5ab2437e811614e26d951948 Sep 23 04:36:28.640081 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-67141960 Sep 23 04:36:28.640081 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-67141960-project Sep 23 04:36:28.640081 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:36:28.640081 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:36:28.640081 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: d467da509e5347ea945bbeaffdd998ce Sep 23 04:36:28.640081 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-67141960-project Sep 23 04:36:28.640081 n-d-846463-3 devstack@n-api.service[122698]: Sep 23 04:36:28.640081 n-d-846463-3 devstack@n-api.service[122698]: {"security_group_rule": {"parent_group_id": "e7f34da6-6ac4-4417-9cb3-a36a96c654dd", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Sep 23 04:36:28.640081 n-d-846463-3 devstack@n-api.service[122698]: method: Sep 23 04:36:28.641269 n-d-846463-3 devstack@n-api.service[122698]: exception: Invalid port range 22:21. Former value cannot be greater than the later Sep 23 04:36:28.641269 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'e7f34da6-6ac4-4417-9cb3-a36a96c654dd', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Sep 23 04:36:28.641269 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:36:28.641269 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:36:28.641269 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Sep 23 04:36:28.641269 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Sep 23 04:36:28.641269 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Sep 23 04:36:28.641269 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Sep 23 04:36:28.641269 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Sep 23 04:36:28.641269 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Sep 23 04:36:28.641269 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Sep 23 04:36:28.641269 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Sep 23 04:36:28.641269 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Sep 23 04:36:28.641269 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:36:28.641269 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:36:28.641269 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:36:28.641269 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:36:28.641269 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:36:28.641269 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:36:28.642750 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:36:28.642750 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:36:28.642750 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:36:28.642750 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:36:28.642750 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:36:28.642750 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:36:28.642750 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 23 04:36:28.642750 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 23 04:36:28.642750 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Sep 23 04:36:28.642750 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:36:28.642750 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:36:28.642750 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:36:28.642750 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:36:28.642750 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:36:28.642750 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:36:28.642750 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:36:28.642750 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:36:28.642750 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Sep 23 04:36:28.642750 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:36:28.644176 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5d90d979-ad4b-4b67-b5e5-a332ec89cb73 tempest-SecurityGroupRulesNegativeTestJSON-67141960 tempest-SecurityGroupRulesNegativeTestJSON-67141960-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:36:28.644176 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5d90d979-ad4b-4b67-b5e5-a332ec89cb73 tempest-SecurityGroupRulesNegativeTestJSON-67141960 tempest-SecurityGroupRulesNegativeTestJSON-67141960-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.075960 Sep 23 04:36:28.644839 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 721/1497] 10.222.0.33 () {60 vars in 1195 bytes} [Fri Sep 23 04:36:28 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 79 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 04:36:28.659012 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c0e4a16f-d511-4f48-a63b-0d7de99ac7fc tempest-SecurityGroupRulesNegativeTestJSON-67141960 tempest-SecurityGroupRulesNegativeTestJSON-67141960-project] Action: 'create', calling method: .version_select at 0x7ff1bb9f24c0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-429012175", "description": "tempest-description-1765232453"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:36:28.961951 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-74270f6a-2a98-4473-880d-257e2e254406 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:28.969640 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-74270f6a-2a98-4473-880d-257e2e254406 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: b4a75706-ba44-4b2c-8767-071502169d5a] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:28.974132 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-74270f6a-2a98-4473-880d-257e2e254406 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:28.978416 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-74270f6a-2a98-4473-880d-257e2e254406 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:28.982222 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-74270f6a-2a98-4473-880d-257e2e254406 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:28.983265 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-74270f6a-2a98-4473-880d-257e2e254406 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:28.986248 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-74270f6a-2a98-4473-880d-257e2e254406 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:28.987085 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-74270f6a-2a98-4473-880d-257e2e254406 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:29.198191 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c0e4a16f-d511-4f48-a63b-0d7de99ac7fc tempest-SecurityGroupRulesNegativeTestJSON-67141960 tempest-SecurityGroupRulesNegativeTestJSON-67141960-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.547160 Sep 23 04:36:29.199853 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 777/1498] 10.222.0.33 () {60 vars in 1180 bytes} [Fri Sep 23 04:36:28 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:36:29.213320 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-92e2d2f9-b712-4430-b33b-2956a1e9bcf8 tempest-SecurityGroupRulesNegativeTestJSON-67141960 tempest-SecurityGroupRulesNegativeTestJSON-67141960-project] Action: 'create', calling method: .version_select at 0x7ff1bb875b80>, body: {"security_group_rule": {"parent_group_id": "ed238362-14a4-4516-b4b7-a0e618eeafb3", "ip_protocol": "tcp", "from_port": 22, "to_port": 1499307428}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:36:29.345815 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-92e2d2f9-b712-4430-b33b-2956a1e9bcf8 tempest-SecurityGroupRulesNegativeTestJSON-67141960 tempest-SecurityGroupRulesNegativeTestJSON-67141960-project] HTTP exception thrown: Invalid port range 22:1499307428. Valid TCP ports should be between 1-65535 Sep 23 04:36:29.348355 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-92e2d2f9-b712-4430-b33b-2956a1e9bcf8 tempest-SecurityGroupRulesNegativeTestJSON-67141960 tempest-SecurityGroupRulesNegativeTestJSON-67141960-project] Request method failure captured: Sep 23 04:36:29.348355 n-d-846463-3 devstack@n-api.service[122699]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 23 04:36:29.348355 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:36:29.348355 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:36:29.348355 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:36:29.348355 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 146 Sep 23 04:36:29.348355 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:36:29.348355 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:36:29.348355 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:36:29.348355 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:36:29.348355 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTfG6EWi6j-CGFLPDAGWY9XJbMBFd_1BZo7VHHhhUiN3PTYnAuvL00mkAP25coiaFwhGfEWIGrdqPkm8UZ4EXZZ67cAG6t39z9R16I3-I9rfnbrVOKhBQDyFIHdZsAe61JGj4smUcQ0Bq3J4_LzjcPFRuO9_SNXs60bPHRgj3RflA30 Sep 23 04:36:29.348355 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:36:29.348355 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:36:29.348355 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:36:29.348355 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:36:29.348355 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:36:29.348355 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:36:29.348355 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: b29469fc5ab2437e811614e26d951948 Sep 23 04:36:29.348355 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-67141960 Sep 23 04:36:29.348355 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:36:29.348355 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:36:29.350740 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b29469fc5ab2437e811614e26d951948", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b29469fc5ab2437e811614e26d951948"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b29469fc5ab2437e811614e26d951948"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b29469fc5ab2437e811614e26d951948"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:36:29.350740 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-67141960 Sep 23 04:36:29.350740 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: b29469fc5ab2437e811614e26d951948 Sep 23 04:36:29.350740 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-67141960 Sep 23 04:36:29.350740 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-67141960-project Sep 23 04:36:29.350740 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:36:29.350740 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:36:29.350740 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: d467da509e5347ea945bbeaffdd998ce Sep 23 04:36:29.350740 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-67141960-project Sep 23 04:36:29.350740 n-d-846463-3 devstack@n-api.service[122699]: Sep 23 04:36:29.350740 n-d-846463-3 devstack@n-api.service[122699]: {"security_group_rule": {"parent_group_id": "ed238362-14a4-4516-b4b7-a0e618eeafb3", "ip_protocol": "tcp", "from_port": 22, "to_port": 1499307428}} Sep 23 04:36:29.350740 n-d-846463-3 devstack@n-api.service[122699]: method: Sep 23 04:36:29.351716 n-d-846463-3 devstack@n-api.service[122699]: exception: Invalid port range 22:1499307428. Valid TCP ports should be between 1-65535 Sep 23 04:36:29.351716 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'ed238362-14a4-4516-b4b7-a0e618eeafb3', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 1499307428}}} Sep 23 04:36:29.351716 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:36:29.351716 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:36:29.351716 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Sep 23 04:36:29.351716 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Sep 23 04:36:29.351716 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Sep 23 04:36:29.351716 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Sep 23 04:36:29.351716 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Sep 23 04:36:29.351716 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Sep 23 04:36:29.351716 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Sep 23 04:36:29.351716 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Sep 23 04:36:29.351716 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:1499307428. Valid TCP ports should be between 1-65535 Sep 23 04:36:29.351716 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:36:29.351716 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:36:29.351716 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:36:29.351716 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:36:29.351716 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:36:29.351716 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:36:29.353909 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:36:29.353909 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:36:29.353909 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:36:29.353909 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:36:29.353909 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:36:29.353909 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:36:29.353909 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 23 04:36:29.353909 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 23 04:36:29.353909 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:1499307428. Valid TCP ports should be between 1-65535 Sep 23 04:36:29.353909 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:36:29.353909 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:36:29.353909 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:36:29.353909 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:36:29.353909 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:36:29.353909 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:36:29.353909 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:36:29.353909 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:36:29.353909 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:1499307428. Valid TCP ports should be between 1-65535 Sep 23 04:36:29.353909 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:36:29.358454 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-92e2d2f9-b712-4430-b33b-2956a1e9bcf8 tempest-SecurityGroupRulesNegativeTestJSON-67141960 tempest-SecurityGroupRulesNegativeTestJSON-67141960-project] Returning 400 to user: Invalid port range 22:1499307428. Valid TCP ports should be between 1-65535 {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:36:29.358454 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-92e2d2f9-b712-4430-b33b-2956a1e9bcf8 tempest-SecurityGroupRulesNegativeTestJSON-67141960 tempest-SecurityGroupRulesNegativeTestJSON-67141960-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.147984 Sep 23 04:36:29.360579 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 778/1499] 10.222.0.33 () {60 vars in 1195 bytes} [Fri Sep 23 04:36:29 2022] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 152 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 04:36:29.370183 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4d70ba69-455a-4407-aad1-f68c553bf820 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:29.371289 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4d70ba69-455a-4407-aad1-f68c553bf820 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:29.371949 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-74270f6a-2a98-4473-880d-257e2e254406 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:29.384161 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-74270f6a-2a98-4473-880d-257e2e254406 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/b4a75706-ba44-4b2c-8767-071502169d5a" status: 200 len: 1319 microversion: 2.1 time: 0.427564 Sep 23 04:36:29.393776 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 722/1500] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:28 2022] GET /compute/v2.1/servers/b4a75706-ba44-4b2c-8767-071502169d5a => generated 1319 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:29.393776 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c2e1e2c2-8d00-41cf-99a1-d7a26b0aab3e tempest-SecurityGroupRulesNegativeTestJSON-67141960 tempest-SecurityGroupRulesNegativeTestJSON-67141960-project] Action: 'create', calling method: .version_select at 0x7ff1bbaa73a0>, body: {"security_group_rule": {"parent_group_id": "bb14fe05-ab44-454e-89e8-b642b3d67ddb", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:36:29.394522 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4d70ba69-455a-4407-aad1-f68c553bf820 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:29.395029 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4d70ba69-455a-4407-aad1-f68c553bf820 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:29.395468 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4d70ba69-455a-4407-aad1-f68c553bf820 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:29.396178 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4d70ba69-455a-4407-aad1-f68c553bf820 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:29.397164 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4d70ba69-455a-4407-aad1-f68c553bf820 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:29.397597 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4d70ba69-455a-4407-aad1-f68c553bf820 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:29.418542 n-d-846463-3 devstack@n-api.service[122698]: DEBUG neutronclient.v2_0.client [None req-c2e1e2c2-8d00-41cf-99a1-d7a26b0aab3e tempest-SecurityGroupRulesNegativeTestJSON-67141960 tempest-SecurityGroupRulesNegativeTestJSON-67141960-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group bb14fe05-ab44-454e-89e8-b642b3d67ddb does not exist", "detail": ""}} {{(pid=122698) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 23 04:36:29.419251 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.network.security_group_api [None req-c2e1e2c2-8d00-41cf-99a1-d7a26b0aab3e tempest-SecurityGroupRulesNegativeTestJSON-67141960 tempest-SecurityGroupRulesNegativeTestJSON-67141960-project] Neutron security group bb14fe05-ab44-454e-89e8-b642b3d67ddb not found {{(pid=122698) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 23 04:36:29.420023 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-c2e1e2c2-8d00-41cf-99a1-d7a26b0aab3e tempest-SecurityGroupRulesNegativeTestJSON-67141960 tempest-SecurityGroupRulesNegativeTestJSON-67141960-project] HTTP exception thrown: Security group bb14fe05-ab44-454e-89e8-b642b3d67ddb does not exist Sep 23 04:36:29.420023 n-d-846463-3 devstack@n-api.service[122698]: Neutron server returns request_ids: ['req-72e9fafa-7751-45d7-a320-77dec4f62529'] Sep 23 04:36:29.422110 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c2e1e2c2-8d00-41cf-99a1-d7a26b0aab3e tempest-SecurityGroupRulesNegativeTestJSON-67141960 tempest-SecurityGroupRulesNegativeTestJSON-67141960-project] Request method failure captured: Sep 23 04:36:29.422110 n-d-846463-3 devstack@n-api.service[122698]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 23 04:36:29.422110 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:36:29.422110 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:36:29.422110 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:36:29.422110 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 138 Sep 23 04:36:29.422110 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:36:29.422110 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:36:29.422110 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:36:29.422110 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:36:29.422110 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTfG6EWi6j-CGFLPDAGWY9XJbMBFd_1BZo7VHHhhUiN3PTYnAuvL00mkAP25coiaFwhGfEWIGrdqPkm8UZ4EXZZ67cAG6t39z9R16I3-I9rfnbrVOKhBQDyFIHdZsAe61JGj4smUcQ0Bq3J4_LzjcPFRuO9_SNXs60bPHRgj3RflA30 Sep 23 04:36:29.422110 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:36:29.422110 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:36:29.422110 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:36:29.422110 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:36:29.422110 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:36:29.422110 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:36:29.422110 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: b29469fc5ab2437e811614e26d951948 Sep 23 04:36:29.422110 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-67141960 Sep 23 04:36:29.422110 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:36:29.422110 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:36:29.423801 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b29469fc5ab2437e811614e26d951948", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b29469fc5ab2437e811614e26d951948"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b29469fc5ab2437e811614e26d951948"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b29469fc5ab2437e811614e26d951948"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:36:29.423801 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-67141960 Sep 23 04:36:29.423801 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: b29469fc5ab2437e811614e26d951948 Sep 23 04:36:29.423801 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-67141960 Sep 23 04:36:29.423801 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-67141960-project Sep 23 04:36:29.423801 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:36:29.423801 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:36:29.423801 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: d467da509e5347ea945bbeaffdd998ce Sep 23 04:36:29.423801 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-67141960-project Sep 23 04:36:29.423801 n-d-846463-3 devstack@n-api.service[122698]: Sep 23 04:36:29.423801 n-d-846463-3 devstack@n-api.service[122698]: {"security_group_rule": {"parent_group_id": "bb14fe05-ab44-454e-89e8-b642b3d67ddb", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Sep 23 04:36:29.423801 n-d-846463-3 devstack@n-api.service[122698]: method: Sep 23 04:36:29.424779 n-d-846463-3 devstack@n-api.service[122698]: exception: Security group bb14fe05-ab44-454e-89e8-b642b3d67ddb does not exist Sep 23 04:36:29.424779 n-d-846463-3 devstack@n-api.service[122698]: Neutron server returns request_ids: ['req-72e9fafa-7751-45d7-a320-77dec4f62529'] Sep 23 04:36:29.424779 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'bb14fe05-ab44-454e-89e8-b642b3d67ddb', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Sep 23 04:36:29.424779 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:36:29.424779 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:36:29.424779 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 23 04:36:29.424779 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 23 04:36:29.424779 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:36:29.424779 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:36:29.424779 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 23 04:36:29.424779 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 23 04:36:29.424779 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:36:29.424779 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:36:29.424779 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 23 04:36:29.424779 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 23 04:36:29.424779 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:36:29.424779 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:36:29.424779 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 23 04:36:29.424779 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 23 04:36:29.426385 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:36:29.426385 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:36:29.426385 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 23 04:36:29.426385 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 23 04:36:29.426385 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:36:29.426385 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:36:29.426385 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 23 04:36:29.426385 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 23 04:36:29.426385 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 23 04:36:29.426385 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 23 04:36:29.426385 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group bb14fe05-ab44-454e-89e8-b642b3d67ddb does not exist Sep 23 04:36:29.426385 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-72e9fafa-7751-45d7-a320-77dec4f62529'] Sep 23 04:36:29.426385 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:36:29.426385 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:36:29.426385 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:36:29.426385 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:36:29.426385 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Sep 23 04:36:29.426385 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Sep 23 04:36:29.426385 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 23 04:36:29.428891 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 23 04:36:29.428891 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group bb14fe05-ab44-454e-89e8-b642b3d67ddb does not exist Sep 23 04:36:29.428891 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-72e9fafa-7751-45d7-a320-77dec4f62529'] Sep 23 04:36:29.428891 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:36:29.428891 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:36:29.428891 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:36:29.428891 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:36:29.428891 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:36:29.428891 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:36:29.428891 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:36:29.428891 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:36:29.428891 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:36:29.428891 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:36:29.428891 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:36:29.428891 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:36:29.428891 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Sep 23 04:36:29.428891 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 23 04:36:29.428891 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group bb14fe05-ab44-454e-89e8-b642b3d67ddb does not exist Sep 23 04:36:29.428891 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-72e9fafa-7751-45d7-a320-77dec4f62529'] Sep 23 04:36:29.428891 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:36:29.431548 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:36:29.431548 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:36:29.431548 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:36:29.431548 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:36:29.431548 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:36:29.431548 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:36:29.431548 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:36:29.431548 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group bb14fe05-ab44-454e-89e8-b642b3d67ddb does not exist Sep 23 04:36:29.431548 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-72e9fafa-7751-45d7-a320-77dec4f62529'] Sep 23 04:36:29.431548 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:36:29.431548 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c2e1e2c2-8d00-41cf-99a1-d7a26b0aab3e tempest-SecurityGroupRulesNegativeTestJSON-67141960 tempest-SecurityGroupRulesNegativeTestJSON-67141960-project] Returning 404 to user: Security group bb14fe05-ab44-454e-89e8-b642b3d67ddb does not exist Sep 23 04:36:29.431548 n-d-846463-3 devstack@n-api.service[122698]: Neutron server returns request_ids: ['req-72e9fafa-7751-45d7-a320-77dec4f62529'] {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:36:29.431548 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c2e1e2c2-8d00-41cf-99a1-d7a26b0aab3e tempest-SecurityGroupRulesNegativeTestJSON-67141960 tempest-SecurityGroupRulesNegativeTestJSON-67141960-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.039477 Sep 23 04:36:29.432419 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 723/1501] 10.222.0.33 () {60 vars in 1195 bytes} [Fri Sep 23 04:36:29 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:36:29.524120 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-4c4d6d28-ac82-4877-9e90-655cb7f4d255 req-d678bea6-7d49-4cf5-8949-3d404f8354d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4a75706-ba44-4b2c-8767-071502169d5a", "name": "network-vif-plugged", "status": "completed", "tag": "c801336e-f7d9-417d-b4b8-478b0d2b1236"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:36:29.542965 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-4c4d6d28-ac82-4877-9e90-655cb7f4d255 req-d678bea6-7d49-4cf5-8949-3d404f8354d1 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:29.544273 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-4c4d6d28-ac82-4877-9e90-655cb7f4d255 req-d678bea6-7d49-4cf5-8949-3d404f8354d1 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:29.544922 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-4c4d6d28-ac82-4877-9e90-655cb7f4d255 req-d678bea6-7d49-4cf5-8949-3d404f8354d1 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:29.561988 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-4c4d6d28-ac82-4877-9e90-655cb7f4d255 req-d678bea6-7d49-4cf5-8949-3d404f8354d1 service nova] Creating event network-vif-plugged:c801336e-f7d9-417d-b4b8-478b0d2b1236 for instance b4a75706-ba44-4b2c-8767-071502169d5a on n-h1-846463-3 Sep 23 04:36:29.569771 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-4c4d6d28-ac82-4877-9e90-655cb7f4d255 req-d678bea6-7d49-4cf5-8949-3d404f8354d1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134345 Sep 23 04:36:29.570941 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 724/1502] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:36:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:36:29.584698 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-06e6a0b4-72ab-4c3d-a136-96ba20c1f1c3 tempest-SecurityGroupRulesNegativeTestJSON-67141960 tempest-SecurityGroupRulesNegativeTestJSON-67141960-project] Calling method '.version_select at 0x7ff1bbaa7e50>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:29.654070 n-d-846463-3 devstack@n-api.service[122698]: DEBUG neutronclient.v2_0.client [None req-06e6a0b4-72ab-4c3d-a136-96ba20c1f1c3 tempest-SecurityGroupRulesNegativeTestJSON-67141960 tempest-SecurityGroupRulesNegativeTestJSON-67141960-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 6250762e-f5c7-47bb-9f7a-1238630e4fa8 does not exist", "detail": ""}} {{(pid=122698) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 23 04:36:29.655521 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.network.security_group_api [None req-06e6a0b4-72ab-4c3d-a136-96ba20c1f1c3 tempest-SecurityGroupRulesNegativeTestJSON-67141960 tempest-SecurityGroupRulesNegativeTestJSON-67141960-project] Neutron security group rule 6250762e-f5c7-47bb-9f7a-1238630e4fa8 not found {{(pid=122698) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Sep 23 04:36:29.656302 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-06e6a0b4-72ab-4c3d-a136-96ba20c1f1c3 tempest-SecurityGroupRulesNegativeTestJSON-67141960 tempest-SecurityGroupRulesNegativeTestJSON-67141960-project] HTTP exception thrown: Security group rule 6250762e-f5c7-47bb-9f7a-1238630e4fa8 does not exist Sep 23 04:36:29.656302 n-d-846463-3 devstack@n-api.service[122698]: Neutron server returns request_ids: ['req-2135981b-ad82-4004-bf03-1fd05295a5e5'] Sep 23 04:36:29.659244 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-06e6a0b4-72ab-4c3d-a136-96ba20c1f1c3 tempest-SecurityGroupRulesNegativeTestJSON-67141960 tempest-SecurityGroupRulesNegativeTestJSON-67141960-project] Request method failure captured: Sep 23 04:36:29.659244 n-d-846463-3 devstack@n-api.service[122698]: request: DELETE /compute/v2.1/os-security-group-rules/6250762e-f5c7-47bb-9f7a-1238630e4fa8 HTTP/1.1 Sep 23 04:36:29.659244 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:36:29.659244 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:36:29.659244 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:36:29.659244 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:36:29.659244 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:36:29.659244 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:36:29.659244 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:36:29.659244 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:36:29.659244 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTfG6EWi6j-CGFLPDAGWY9XJbMBFd_1BZo7VHHhhUiN3PTYnAuvL00mkAP25coiaFwhGfEWIGrdqPkm8UZ4EXZZ67cAG6t39z9R16I3-I9rfnbrVOKhBQDyFIHdZsAe61JGj4smUcQ0Bq3J4_LzjcPFRuO9_SNXs60bPHRgj3RflA30 Sep 23 04:36:29.659244 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:36:29.659244 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:36:29.659244 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:36:29.659244 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:36:29.659244 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:36:29.659244 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:36:29.659244 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: b29469fc5ab2437e811614e26d951948 Sep 23 04:36:29.659244 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-67141960 Sep 23 04:36:29.659244 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:36:29.659244 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:36:29.665337 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b29469fc5ab2437e811614e26d951948", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b29469fc5ab2437e811614e26d951948"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b29469fc5ab2437e811614e26d951948"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b29469fc5ab2437e811614e26d951948"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:36:29.665337 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-67141960 Sep 23 04:36:29.665337 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: b29469fc5ab2437e811614e26d951948 Sep 23 04:36:29.665337 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-67141960 Sep 23 04:36:29.665337 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-67141960-project Sep 23 04:36:29.665337 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:36:29.665337 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:36:29.665337 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: d467da509e5347ea945bbeaffdd998ce Sep 23 04:36:29.665337 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-67141960-project Sep 23 04:36:29.665337 n-d-846463-3 devstack@n-api.service[122698]: method: Sep 23 04:36:29.665337 n-d-846463-3 devstack@n-api.service[122698]: exception: Security group rule 6250762e-f5c7-47bb-9f7a-1238630e4fa8 does not exist Sep 23 04:36:29.665337 n-d-846463-3 devstack@n-api.service[122698]: Neutron server returns request_ids: ['req-2135981b-ad82-4004-bf03-1fd05295a5e5'] Sep 23 04:36:29.666609 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '6250762e-f5c7-47bb-9f7a-1238630e4fa8'} Sep 23 04:36:29.666609 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:36:29.666609 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:36:29.666609 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Sep 23 04:36:29.666609 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Sep 23 04:36:29.666609 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:36:29.666609 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:36:29.666609 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1092, in show_security_group_rule Sep 23 04:36:29.666609 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Sep 23 04:36:29.666609 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:36:29.666609 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:36:29.666609 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 23 04:36:29.666609 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 23 04:36:29.666609 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:36:29.666609 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:36:29.666609 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 23 04:36:29.666609 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 23 04:36:29.666609 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:36:29.666609 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:36:29.668237 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 23 04:36:29.668237 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 23 04:36:29.668237 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:36:29.668237 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:36:29.668237 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 23 04:36:29.668237 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 23 04:36:29.668237 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 23 04:36:29.668237 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 23 04:36:29.668237 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 6250762e-f5c7-47bb-9f7a-1238630e4fa8 does not exist Sep 23 04:36:29.668237 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2135981b-ad82-4004-bf03-1fd05295a5e5'] Sep 23 04:36:29.668237 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:36:29.668237 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:36:29.668237 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:36:29.668237 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:36:29.668237 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Sep 23 04:36:29.668237 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Sep 23 04:36:29.668237 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Sep 23 04:36:29.668237 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 23 04:36:29.669821 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 6250762e-f5c7-47bb-9f7a-1238630e4fa8 does not exist Sep 23 04:36:29.669821 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2135981b-ad82-4004-bf03-1fd05295a5e5'] Sep 23 04:36:29.669821 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:36:29.669821 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:36:29.669821 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:36:29.669821 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:36:29.669821 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:36:29.669821 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:36:29.669821 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:36:29.669821 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:36:29.669821 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:36:29.669821 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:36:29.669821 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:36:29.669821 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:36:29.669821 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Sep 23 04:36:29.669821 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 23 04:36:29.669821 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 6250762e-f5c7-47bb-9f7a-1238630e4fa8 does not exist Sep 23 04:36:29.669821 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2135981b-ad82-4004-bf03-1fd05295a5e5'] Sep 23 04:36:29.669821 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:36:29.669821 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:36:29.671536 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:36:29.671536 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:36:29.671536 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:36:29.671536 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:36:29.671536 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:36:29.671536 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:36:29.671536 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 6250762e-f5c7-47bb-9f7a-1238630e4fa8 does not exist Sep 23 04:36:29.671536 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2135981b-ad82-4004-bf03-1fd05295a5e5'] Sep 23 04:36:29.671536 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:36:29.671536 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-06e6a0b4-72ab-4c3d-a136-96ba20c1f1c3 tempest-SecurityGroupRulesNegativeTestJSON-67141960 tempest-SecurityGroupRulesNegativeTestJSON-67141960-project] Returning 404 to user: Security group rule 6250762e-f5c7-47bb-9f7a-1238630e4fa8 does not exist Sep 23 04:36:29.671536 n-d-846463-3 devstack@n-api.service[122698]: Neutron server returns request_ids: ['req-2135981b-ad82-4004-bf03-1fd05295a5e5'] {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:36:29.671536 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-06e6a0b4-72ab-4c3d-a136-96ba20c1f1c3 tempest-SecurityGroupRulesNegativeTestJSON-67141960 tempest-SecurityGroupRulesNegativeTestJSON-67141960-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-group-rules/6250762e-f5c7-47bb-9f7a-1238630e4fa8" status: 404 len: 199 microversion: 2.1 time: 0.088666 Sep 23 04:36:29.671536 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 725/1503] 10.222.0.33 () {58 vars in 1287 bytes} [Fri Sep 23 04:36:29 2022] DELETE /compute/v2.1/os-security-group-rules/6250762e-f5c7-47bb-9f7a-1238630e4fa8 => generated 199 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:36:29.672580 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2e359134-51fb-4c59-822f-295d9b1373ae tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:29.672580 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-2e359134-51fb-4c59-822f-295d9b1373ae tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 9e9a41f2-ff28-4c2a-80aa-193e0ebce466] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:29.694957 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-4d70ba69-455a-4407-aad1-f68c553bf820 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:29.697001 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2e359134-51fb-4c59-822f-295d9b1373ae tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:29.697482 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2e359134-51fb-4c59-822f-295d9b1373ae tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:29.697997 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2e359134-51fb-4c59-822f-295d9b1373ae tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:29.698802 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2e359134-51fb-4c59-822f-295d9b1373ae tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:29.699896 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2e359134-51fb-4c59-822f-295d9b1373ae tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:29.700355 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2e359134-51fb-4c59-822f-295d9b1373ae tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:29.708553 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4d70ba69-455a-4407-aad1-f68c553bf820 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea" status: 200 len: 1477 microversion: 2.1 time: 0.346177 Sep 23 04:36:29.710525 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 779/1504] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:29 2022] GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea => generated 1477 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:29.727184 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7c1274da-276e-463e-9d01-9cbfe5d3f5eb tempest-SecurityGroupRulesNegativeTestJSON-67141960 tempest-SecurityGroupRulesNegativeTestJSON-67141960-project] Calling method '.version_select at 0x7ff1bb7d29d0>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:29.985311 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-2e359134-51fb-4c59-822f-295d9b1373ae tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:29.999929 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-2e359134-51fb-4c59-822f-295d9b1373ae tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:30.003471 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-2e359134-51fb-4c59-822f-295d9b1373ae tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:30.007773 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2e359134-51fb-4c59-822f-295d9b1373ae tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466" status: 200 len: 1280 microversion: 2.25 time: 0.339903 Sep 23 04:36:30.009302 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 726/1505] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:36:29 2022] GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466 => generated 1280 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:36:30.167871 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-7c1274da-276e-463e-9d01-9cbfe5d3f5eb tempest-SecurityGroupRulesNegativeTestJSON-67141960 tempest-SecurityGroupRulesNegativeTestJSON-67141960-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/ed238362-14a4-4516-b4b7-a0e618eeafb3" status: 202 len: 0 microversion: 2.1 time: 0.448254 Sep 23 04:36:30.168481 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 780/1506] 10.222.0.33 () {58 vars in 1272 bytes} [Fri Sep 23 04:36:29 2022] DELETE /compute/v2.1/os-security-groups/ed238362-14a4-4516-b4b7-a0e618eeafb3 => generated 0 bytes in 457 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:36:30.180409 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-574da8f9-f1ff-4132-bc13-5340e788e06b tempest-SecurityGroupRulesNegativeTestJSON-67141960 tempest-SecurityGroupRulesNegativeTestJSON-67141960-project] Calling method '.version_select at 0x7ff1bb95cee0>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:30.413669 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2d09a414-4afb-4180-a324-772d061d87ce tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:30.414924 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-2d09a414-4afb-4180-a324-772d061d87ce tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: b4a75706-ba44-4b2c-8767-071502169d5a] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:30.426617 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2d09a414-4afb-4180-a324-772d061d87ce tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:30.426749 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2d09a414-4afb-4180-a324-772d061d87ce tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:30.427374 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2d09a414-4afb-4180-a324-772d061d87ce tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:30.429163 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2d09a414-4afb-4180-a324-772d061d87ce tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:30.429914 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2d09a414-4afb-4180-a324-772d061d87ce tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:30.430406 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2d09a414-4afb-4180-a324-772d061d87ce tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:30.569503 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-574da8f9-f1ff-4132-bc13-5340e788e06b tempest-SecurityGroupRulesNegativeTestJSON-67141960 tempest-SecurityGroupRulesNegativeTestJSON-67141960-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/e7f34da6-6ac4-4417-9cb3-a36a96c654dd" status: 202 len: 0 microversion: 2.1 time: 0.394476 Sep 23 04:36:30.573382 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 727/1507] 10.222.0.33 () {58 vars in 1272 bytes} [Fri Sep 23 04:36:30 2022] DELETE /compute/v2.1/os-security-groups/e7f34da6-6ac4-4417-9cb3-a36a96c654dd => generated 0 bytes in 400 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:36:30.584092 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0fba26ea-8522-4d69-9e42-af5cdde07d19 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:30.589286 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-0fba26ea-8522-4d69-9e42-af5cdde07d19 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] [instance: 04e9b262-d9e0-434a-bcbb-a85ef9180ee9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:30.598158 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2d09a414-4afb-4180-a324-772d061d87ce tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:30.598770 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0fba26ea-8522-4d69-9e42-af5cdde07d19 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:30.600791 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0fba26ea-8522-4d69-9e42-af5cdde07d19 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:30.601477 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0fba26ea-8522-4d69-9e42-af5cdde07d19 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:30.602506 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0fba26ea-8522-4d69-9e42-af5cdde07d19 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:30.603181 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0fba26ea-8522-4d69-9e42-af5cdde07d19 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:30.603866 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0fba26ea-8522-4d69-9e42-af5cdde07d19 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:30.608856 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2d09a414-4afb-4180-a324-772d061d87ce tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/b4a75706-ba44-4b2c-8767-071502169d5a" status: 200 len: 1319 microversion: 2.1 time: 0.199241 Sep 23 04:36:30.610637 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 781/1508] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:30 2022] GET /compute/v2.1/servers/b4a75706-ba44-4b2c-8767-071502169d5a => generated 1319 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:36:30.616863 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-05735e28-18b3-4211-913e-216024b7d466 tempest-SecurityGroupRulesNegativeTestJSON-67141960 tempest-SecurityGroupRulesNegativeTestJSON-67141960-project] Calling method '.version_select at 0x7ff1bbb2fb80>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:30.834884 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0fba26ea-8522-4d69-9e42-af5cdde07d19 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9" status: 200 len: 1814 microversion: 2.1 time: 0.259753 Sep 23 04:36:30.835590 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 728/1509] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:30 2022] GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9 => generated 1814 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:30.840335 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c5be8e36-9ed9-4ca0-9e45-9772ea6a4381 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:30.841046 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c5be8e36-9ed9-4ca0-9e45-9772ea6a4381 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:30.848791 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c5be8e36-9ed9-4ca0-9e45-9772ea6a4381 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:30.849738 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c5be8e36-9ed9-4ca0-9e45-9772ea6a4381 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:30.851615 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c5be8e36-9ed9-4ca0-9e45-9772ea6a4381 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:30.852592 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c5be8e36-9ed9-4ca0-9e45-9772ea6a4381 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:30.853290 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c5be8e36-9ed9-4ca0-9e45-9772ea6a4381 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:30.853965 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c5be8e36-9ed9-4ca0-9e45-9772ea6a4381 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:30.991028 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-05735e28-18b3-4211-913e-216024b7d466 tempest-SecurityGroupRulesNegativeTestJSON-67141960 tempest-SecurityGroupRulesNegativeTestJSON-67141960-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/d2beb904-55e3-4f49-bf53-e5087a12001a" status: 202 len: 0 microversion: 2.1 time: 0.378725 Sep 23 04:36:30.993704 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 782/1510] 10.222.0.33 () {58 vars in 1272 bytes} [Fri Sep 23 04:36:30 2022] DELETE /compute/v2.1/os-security-groups/d2beb904-55e3-4f49-bf53-e5087a12001a => generated 0 bytes in 382 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:36:31.013006 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2e1adf2e-7c9b-4148-a81f-00c5aee4e24a tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:31.023333 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2e1adf2e-7c9b-4148-a81f-00c5aee4e24a tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:31.024513 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2e1adf2e-7c9b-4148-a81f-00c5aee4e24a tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:31.040289 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2e1adf2e-7c9b-4148-a81f-00c5aee4e24a tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:31.043859 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2e1adf2e-7c9b-4148-a81f-00c5aee4e24a tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:31.045483 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2e1adf2e-7c9b-4148-a81f-00c5aee4e24a tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:31.046912 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c5be8e36-9ed9-4ca0-9e45-9772ea6a4381 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:31.048080 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2e1adf2e-7c9b-4148-a81f-00c5aee4e24a tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:31.057250 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c5be8e36-9ed9-4ca0-9e45-9772ea6a4381 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea" status: 200 len: 1477 microversion: 2.1 time: 0.220193 Sep 23 04:36:31.057705 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 729/1511] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:30 2022] GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea => generated 1477 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:31.073441 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5cd2c62a-dafe-450b-9db0-aa4c1f5438c6 tempest-SecurityGroupRulesNegativeTestJSON-67141960 tempest-SecurityGroupRulesNegativeTestJSON-67141960-project] Calling method '.version_select at 0x7ff1bb94ed30>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:31.158254 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2e1adf2e-7c9b-4148-a81f-00c5aee4e24a tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.163085 Sep 23 04:36:31.159249 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 783/1512] 10.222.0.33 () {58 vars in 1176 bytes} [Fri Sep 23 04:36:30 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:36:31.461156 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e7a53683-c659-495f-9a83-d225a156e69a tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:31.461810 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e7a53683-c659-495f-9a83-d225a156e69a tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 9e9a41f2-ff28-4c2a-80aa-193e0ebce466] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:31.469189 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e7a53683-c659-495f-9a83-d225a156e69a tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:31.470074 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e7a53683-c659-495f-9a83-d225a156e69a tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:31.470765 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e7a53683-c659-495f-9a83-d225a156e69a tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:31.475469 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e7a53683-c659-495f-9a83-d225a156e69a tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:31.475469 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e7a53683-c659-495f-9a83-d225a156e69a tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:31.475469 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e7a53683-c659-495f-9a83-d225a156e69a tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:31.502933 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5cd2c62a-dafe-450b-9db0-aa4c1f5438c6 tempest-SecurityGroupRulesNegativeTestJSON-67141960 tempest-SecurityGroupRulesNegativeTestJSON-67141960-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/499e3e94-6be7-49ce-a3ed-bf0ecd5ad936" status: 202 len: 0 microversion: 2.1 time: 0.439582 Sep 23 04:36:31.506196 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 730/1513] 10.222.0.33 () {58 vars in 1272 bytes} [Fri Sep 23 04:36:31 2022] DELETE /compute/v2.1/os-security-groups/499e3e94-6be7-49ce-a3ed-bf0ecd5ad936 => generated 0 bytes in 448 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:36:31.516519 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-90d4338f-276d-4745-9710-3e85cbfba9d3 tempest-SecurityGroupRulesNegativeTestJSON-67141960 tempest-SecurityGroupRulesNegativeTestJSON-67141960-project] Calling method '.version_select at 0x7ff1bb94ec10>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:31.753143 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e7a53683-c659-495f-9a83-d225a156e69a tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:31.762910 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e7a53683-c659-495f-9a83-d225a156e69a tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:31.764406 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e7a53683-c659-495f-9a83-d225a156e69a tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:31.765601 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e7a53683-c659-495f-9a83-d225a156e69a tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466" status: 200 len: 1280 microversion: 2.25 time: 0.601732 Sep 23 04:36:31.766591 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 784/1514] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:36:31 2022] GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466 => generated 1280 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:36:31.773022 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-4d4ee36b-b852-4429-bde7-68902ae51426 req-a38ce77e-c92e-4898-8608-fc696beba5af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19e41421-3550-49fe-90d0-64b07a5efefa", "name": "network-vif-plugged", "status": "completed", "tag": "0a2f7d6d-75cc-4bea-a611-434074b855d9"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:36:31.784404 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-4d4ee36b-b852-4429-bde7-68902ae51426 req-a38ce77e-c92e-4898-8608-fc696beba5af service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:31.785003 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-4d4ee36b-b852-4429-bde7-68902ae51426 req-a38ce77e-c92e-4898-8608-fc696beba5af service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:31.785534 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-4d4ee36b-b852-4429-bde7-68902ae51426 req-a38ce77e-c92e-4898-8608-fc696beba5af service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:31.803956 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-4d4ee36b-b852-4429-bde7-68902ae51426 req-a38ce77e-c92e-4898-8608-fc696beba5af service nova] Creating event network-vif-plugged:0a2f7d6d-75cc-4bea-a611-434074b855d9 for instance 19e41421-3550-49fe-90d0-64b07a5efefa on n-h1-846463-3 Sep 23 04:36:31.819299 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-4d4ee36b-b852-4429-bde7-68902ae51426 req-a38ce77e-c92e-4898-8608-fc696beba5af service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043952 Sep 23 04:36:31.819299 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 785/1515] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:36:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:36:31.819299 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7c4d7367-1bc6-4ddb-a74d-bde0898eeaf0 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:31.819691 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-7c4d7367-1bc6-4ddb-a74d-bde0898eeaf0 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: b4a75706-ba44-4b2c-8767-071502169d5a] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:31.828082 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7c4d7367-1bc6-4ddb-a74d-bde0898eeaf0 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:31.828729 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7c4d7367-1bc6-4ddb-a74d-bde0898eeaf0 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:31.829241 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7c4d7367-1bc6-4ddb-a74d-bde0898eeaf0 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:31.830190 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7c4d7367-1bc6-4ddb-a74d-bde0898eeaf0 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:31.830728 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7c4d7367-1bc6-4ddb-a74d-bde0898eeaf0 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:31.831221 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7c4d7367-1bc6-4ddb-a74d-bde0898eeaf0 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:31.986960 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-7c4d7367-1bc6-4ddb-a74d-bde0898eeaf0 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:32.017280 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-7c4d7367-1bc6-4ddb-a74d-bde0898eeaf0 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/b4a75706-ba44-4b2c-8767-071502169d5a" status: 200 len: 1469 microversion: 2.1 time: 0.203444 Sep 23 04:36:32.036801 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 786/1516] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:31 2022] GET /compute/v2.1/servers/b4a75706-ba44-4b2c-8767-071502169d5a => generated 1469 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:32.042715 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-fa6e2a53-c21c-4a8d-b084-37dba1a63a62 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:32.043227 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-fa6e2a53-c21c-4a8d-b084-37dba1a63a62 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 19e41421-3550-49fe-90d0-64b07a5efefa] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:32.058377 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-90d4338f-276d-4745-9710-3e85cbfba9d3 tempest-SecurityGroupRulesNegativeTestJSON-67141960 tempest-SecurityGroupRulesNegativeTestJSON-67141960-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/a47042fe-1d22-4f62-b775-2bbce4c317da" status: 202 len: 0 microversion: 2.1 time: 0.547779 Sep 23 04:36:32.059668 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 731/1517] 10.222.0.33 () {58 vars in 1272 bytes} [Fri Sep 23 04:36:31 2022] DELETE /compute/v2.1/os-security-groups/a47042fe-1d22-4f62-b775-2bbce4c317da => generated 0 bytes in 550 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:36:32.067859 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fa6e2a53-c21c-4a8d-b084-37dba1a63a62 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:32.068898 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fa6e2a53-c21c-4a8d-b084-37dba1a63a62 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:32.069377 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fa6e2a53-c21c-4a8d-b084-37dba1a63a62 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:32.070668 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fa6e2a53-c21c-4a8d-b084-37dba1a63a62 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:32.070993 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fa6e2a53-c21c-4a8d-b084-37dba1a63a62 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:32.071506 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fa6e2a53-c21c-4a8d-b084-37dba1a63a62 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:32.081678 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-07f0e194-93ff-4a4b-aaea-678d1857e374 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:32.082471 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-07f0e194-93ff-4a4b-aaea-678d1857e374 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:32.113875 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-07f0e194-93ff-4a4b-aaea-678d1857e374 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:32.114700 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-07f0e194-93ff-4a4b-aaea-678d1857e374 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:32.115553 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-07f0e194-93ff-4a4b-aaea-678d1857e374 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:32.116580 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-07f0e194-93ff-4a4b-aaea-678d1857e374 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:32.117344 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-07f0e194-93ff-4a4b-aaea-678d1857e374 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:32.118737 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-07f0e194-93ff-4a4b-aaea-678d1857e374 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:32.327899 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-fa6e2a53-c21c-4a8d-b084-37dba1a63a62 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:32.332280 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=100 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:36:32.343481 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-fa6e2a53-c21c-4a8d-b084-37dba1a63a62 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/19e41421-3550-49fe-90d0-64b07a5efefa" status: 200 len: 1319 microversion: 2.1 time: 0.300309 Sep 23 04:36:32.343481 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 787/1518] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:32 2022] GET /compute/v2.1/servers/19e41421-3550-49fe-90d0-64b07a5efefa => generated 1319 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:36:32.364376 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-07f0e194-93ff-4a4b-aaea-678d1857e374 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:32.373113 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-07f0e194-93ff-4a4b-aaea-678d1857e374 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea" status: 200 len: 1477 microversion: 2.1 time: 0.296301 Sep 23 04:36:32.378014 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 732/1519] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:32 2022] GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea => generated 1477 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:36:32.793403 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-897381aa-3e1e-4805-add7-a27de0e9d3be tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:32.798199 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-897381aa-3e1e-4805-add7-a27de0e9d3be tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 9e9a41f2-ff28-4c2a-80aa-193e0ebce466] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:32.802186 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-897381aa-3e1e-4805-add7-a27de0e9d3be tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:32.803537 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-897381aa-3e1e-4805-add7-a27de0e9d3be tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:32.805165 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-897381aa-3e1e-4805-add7-a27de0e9d3be tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:32.805925 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-897381aa-3e1e-4805-add7-a27de0e9d3be tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:32.806668 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-897381aa-3e1e-4805-add7-a27de0e9d3be tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:32.807299 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-897381aa-3e1e-4805-add7-a27de0e9d3be tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:33.024636 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-897381aa-3e1e-4805-add7-a27de0e9d3be tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:33.057853 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-897381aa-3e1e-4805-add7-a27de0e9d3be tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:33.060800 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-897381aa-3e1e-4805-add7-a27de0e9d3be tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:33.071272 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-897381aa-3e1e-4805-add7-a27de0e9d3be tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466" status: 200 len: 1280 microversion: 2.25 time: 0.282053 Sep 23 04:36:33.071867 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 788/1520] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:36:32 2022] GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466 => generated 1280 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:36:33.361285 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1d2b62c8-8a1a-450f-843c-b5cda04faa46 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:33.362612 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-1d2b62c8-8a1a-450f-843c-b5cda04faa46 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 19e41421-3550-49fe-90d0-64b07a5efefa] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:33.370106 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1d2b62c8-8a1a-450f-843c-b5cda04faa46 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:33.370946 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1d2b62c8-8a1a-450f-843c-b5cda04faa46 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:33.371390 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1d2b62c8-8a1a-450f-843c-b5cda04faa46 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:33.372111 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1d2b62c8-8a1a-450f-843c-b5cda04faa46 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:33.372731 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1d2b62c8-8a1a-450f-843c-b5cda04faa46 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:33.373201 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1d2b62c8-8a1a-450f-843c-b5cda04faa46 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:33.400372 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-64f4daf1-1c47-4a57-98da-f5ba4ff979ef tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:33.402794 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-64f4daf1-1c47-4a57-98da-f5ba4ff979ef tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:33.410135 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-64f4daf1-1c47-4a57-98da-f5ba4ff979ef tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:33.413924 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-64f4daf1-1c47-4a57-98da-f5ba4ff979ef tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:33.414527 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-64f4daf1-1c47-4a57-98da-f5ba4ff979ef tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:33.415360 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-64f4daf1-1c47-4a57-98da-f5ba4ff979ef tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:33.419744 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-64f4daf1-1c47-4a57-98da-f5ba4ff979ef tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:33.420286 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-64f4daf1-1c47-4a57-98da-f5ba4ff979ef tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:33.606829 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-1d2b62c8-8a1a-450f-843c-b5cda04faa46 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:33.617871 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-1d2b62c8-8a1a-450f-843c-b5cda04faa46 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/19e41421-3550-49fe-90d0-64b07a5efefa" status: 200 len: 1319 microversion: 2.1 time: 0.259585 Sep 23 04:36:33.617871 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 733/1521] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:33 2022] GET /compute/v2.1/servers/19e41421-3550-49fe-90d0-64b07a5efefa => generated 1319 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:33.632377 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-64f4daf1-1c47-4a57-98da-f5ba4ff979ef tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:33.649242 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-64f4daf1-1c47-4a57-98da-f5ba4ff979ef tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea" status: 200 len: 1477 microversion: 2.1 time: 0.252239 Sep 23 04:36:33.651885 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 789/1522] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:33 2022] GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea => generated 1477 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:36:34.101152 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-53651dc0-53ec-4161-9d79-338401f5466d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:34.101974 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-53651dc0-53ec-4161-9d79-338401f5466d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 9e9a41f2-ff28-4c2a-80aa-193e0ebce466] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:34.108849 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-53651dc0-53ec-4161-9d79-338401f5466d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:34.109594 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-53651dc0-53ec-4161-9d79-338401f5466d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:34.110152 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-53651dc0-53ec-4161-9d79-338401f5466d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:34.111114 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-53651dc0-53ec-4161-9d79-338401f5466d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:34.111688 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-53651dc0-53ec-4161-9d79-338401f5466d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:34.112236 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-53651dc0-53ec-4161-9d79-338401f5466d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:34.267060 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0b725787-2b44-4a62-b9e3-7b83b82d76cc tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fef9a2d9-4276-414e-9023-74e906555af6", "device": "/dev/xvdb"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:36:34.269490 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-53651dc0-53ec-4161-9d79-338401f5466d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:34.270053 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-0b725787-2b44-4a62-b9e3-7b83b82d76cc tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: 04e9b262-d9e0-434a-bcbb-a85ef9180ee9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:34.273153 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=100 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:36:34.280274 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-53651dc0-53ec-4161-9d79-338401f5466d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:34.282369 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-53651dc0-53ec-4161-9d79-338401f5466d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:34.283740 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-53651dc0-53ec-4161-9d79-338401f5466d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466" status: 200 len: 1280 microversion: 2.25 time: 0.187231 Sep 23 04:36:34.284756 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 734/1523] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:36:34 2022] GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466 => generated 1280 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:36:34.287612 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0b725787-2b44-4a62-b9e3-7b83b82d76cc tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:34.288342 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0b725787-2b44-4a62-b9e3-7b83b82d76cc tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:34.288791 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0b725787-2b44-4a62-b9e3-7b83b82d76cc tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:34.289518 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0b725787-2b44-4a62-b9e3-7b83b82d76cc tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:34.290010 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0b725787-2b44-4a62-b9e3-7b83b82d76cc tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:34.290445 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0b725787-2b44-4a62-b9e3-7b83b82d76cc tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:34.646937 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-eb01ff54-8eba-4348-8494-a6f9798d533e tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:34.646937 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-eb01ff54-8eba-4348-8494-a6f9798d533e tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 19e41421-3550-49fe-90d0-64b07a5efefa] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:34.651108 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-eb01ff54-8eba-4348-8494-a6f9798d533e tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:34.651867 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-eb01ff54-8eba-4348-8494-a6f9798d533e tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:34.652432 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-eb01ff54-8eba-4348-8494-a6f9798d533e tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:34.653383 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-eb01ff54-8eba-4348-8494-a6f9798d533e tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:34.653949 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-eb01ff54-8eba-4348-8494-a6f9798d533e tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:34.654458 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-eb01ff54-8eba-4348-8494-a6f9798d533e tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:34.812048 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-eb01ff54-8eba-4348-8494-a6f9798d533e tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:34.820250 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-eb01ff54-8eba-4348-8494-a6f9798d533e tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/19e41421-3550-49fe-90d0-64b07a5efefa" status: 200 len: 1469 microversion: 2.1 time: 0.183207 Sep 23 04:36:34.820870 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 735/1524] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:34 2022] GET /compute/v2.1/servers/19e41421-3550-49fe-90d0-64b07a5efefa => generated 1469 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:36:34.827449 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8e1e683d-d888-4349-8dd7-00d6bbed4052 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:34.827449 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8e1e683d-d888-4349-8dd7-00d6bbed4052 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:34.833327 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8e1e683d-d888-4349-8dd7-00d6bbed4052 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:34.834726 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8e1e683d-d888-4349-8dd7-00d6bbed4052 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:34.835461 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8e1e683d-d888-4349-8dd7-00d6bbed4052 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:34.836341 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8e1e683d-d888-4349-8dd7-00d6bbed4052 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:34.836807 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8e1e683d-d888-4349-8dd7-00d6bbed4052 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:34.837242 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8e1e683d-d888-4349-8dd7-00d6bbed4052 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:34.993289 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8e1e683d-d888-4349-8dd7-00d6bbed4052 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:35.002667 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8e1e683d-d888-4349-8dd7-00d6bbed4052 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea" status: 200 len: 1477 microversion: 2.1 time: 0.180528 Sep 23 04:36:35.014428 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 736/1525] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:34 2022] GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea => generated 1477 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:35.025925 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-eb249e51-b8e4-4424-a5aa-c9375bc77b62 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:35.032922 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-eb249e51-b8e4-4424-a5aa-c9375bc77b62 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:35.034196 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-eb249e51-b8e4-4424-a5aa-c9375bc77b62 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Searching by: {'reservation_id': 'r-s5jjnxvp', 'deleted': False, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4'} {{(pid=122698) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 04:36:35.041121 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-eb249e51-b8e4-4424-a5aa-c9375bc77b62 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:35.041927 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-eb249e51-b8e4-4424-a5aa-c9375bc77b62 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:35.042677 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-eb249e51-b8e4-4424-a5aa-c9375bc77b62 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:35.043729 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-eb249e51-b8e4-4424-a5aa-c9375bc77b62 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:35.044274 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-eb249e51-b8e4-4424-a5aa-c9375bc77b62 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:35.044880 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-eb249e51-b8e4-4424-a5aa-c9375bc77b62 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:35.243910 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.multi_cell_list [None req-eb249e51-b8e4-4424-a5aa-c9375bc77b62 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122698) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 23 04:36:35.376168 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-eb249e51-b8e4-4424-a5aa-c9375bc77b62 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:35.388783 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-eb249e51-b8e4-4424-a5aa-c9375bc77b62 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:35.389343 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-eb249e51-b8e4-4424-a5aa-c9375bc77b62 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:35.390128 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-eb249e51-b8e4-4424-a5aa-c9375bc77b62 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:35.579495 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0b725787-2b44-4a62-b9e3-7b83b82d76cc tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "POST /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.312692 Sep 23 04:36:35.581734 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 790/1526] 10.222.0.33 () {60 vars in 1323 bytes} [Fri Sep 23 04:36:34 2022] POST /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9/os-volume_attachments => generated 194 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:36:35.591838 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-bc2ef842-8a44-4148-9ba8-87e31f612dc2 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:35.593766 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-bc2ef842-8a44-4148-9ba8-87e31f612dc2 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 9e9a41f2-ff28-4c2a-80aa-193e0ebce466] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:35.605723 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bc2ef842-8a44-4148-9ba8-87e31f612dc2 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:35.606381 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bc2ef842-8a44-4148-9ba8-87e31f612dc2 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:35.606930 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bc2ef842-8a44-4148-9ba8-87e31f612dc2 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:35.607809 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bc2ef842-8a44-4148-9ba8-87e31f612dc2 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:35.608273 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bc2ef842-8a44-4148-9ba8-87e31f612dc2 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:35.608727 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bc2ef842-8a44-4148-9ba8-87e31f612dc2 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:35.696449 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-eb249e51-b8e4-4424-a5aa-c9375bc77b62 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/detail?reservation_id=r-s5jjnxvp" status: 200 len: 2931 microversion: 2.1 time: 0.680765 Sep 23 04:36:35.697047 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 737/1527] 10.222.0.33 () {58 vars in 1197 bytes} [Fri Sep 23 04:36:35 2022] GET /compute/v2.1/servers/detail?reservation_id=r-s5jjnxvp => generated 2931 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:35.726441 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-298e14ee-eee3-4ff6-bd55-889fa58a7a78 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:35.776334 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.compute.server_groups [None req-298e14ee-eee3-4ff6-bd55-889fa58a7a78 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Querying cell feac528b-4983-4e61-aae7-f1973fe5bc2c(cell1) for 2 instances {{(pid=122698) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 23 04:36:35.777143 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-298e14ee-eee3-4ff6-bd55-889fa58a7a78 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:35.777609 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-298e14ee-eee3-4ff6-bd55-889fa58a7a78 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:35.778075 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-298e14ee-eee3-4ff6-bd55-889fa58a7a78 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:35.813826 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-298e14ee-eee3-4ff6-bd55-889fa58a7a78 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/os-server-groups/a3bd0e69-7ea7-4fa0-8be9-2d7b06373cbc" status: 200 len: 266 microversion: 2.1 time: 0.091969 Sep 23 04:36:35.814843 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 738/1528] 10.222.0.33 () {58 vars in 1263 bytes} [Fri Sep 23 04:36:35 2022] GET /compute/v2.1/os-server-groups/a3bd0e69-7ea7-4fa0-8be9-2d7b06373cbc => generated 266 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:36:35.826690 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7e16f608-808c-47ca-86a8-653027e5293c tempest-ServersOnMultiNodesTest-617918424 tempest-ServersOnMultiNodesTest-617918424-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:35.827316 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7e16f608-808c-47ca-86a8-653027e5293c tempest-ServersOnMultiNodesTest-617918424 tempest-ServersOnMultiNodesTest-617918424-project-admin] [instance: b4a75706-ba44-4b2c-8767-071502169d5a] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:35.833910 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7e16f608-808c-47ca-86a8-653027e5293c tempest-ServersOnMultiNodesTest-617918424 tempest-ServersOnMultiNodesTest-617918424-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:35.834409 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7e16f608-808c-47ca-86a8-653027e5293c tempest-ServersOnMultiNodesTest-617918424 tempest-ServersOnMultiNodesTest-617918424-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:35.834848 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7e16f608-808c-47ca-86a8-653027e5293c tempest-ServersOnMultiNodesTest-617918424 tempest-ServersOnMultiNodesTest-617918424-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:35.835549 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7e16f608-808c-47ca-86a8-653027e5293c tempest-ServersOnMultiNodesTest-617918424 tempest-ServersOnMultiNodesTest-617918424-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:35.836037 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7e16f608-808c-47ca-86a8-653027e5293c tempest-ServersOnMultiNodesTest-617918424 tempest-ServersOnMultiNodesTest-617918424-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:35.836448 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7e16f608-808c-47ca-86a8-653027e5293c tempest-ServersOnMultiNodesTest-617918424 tempest-ServersOnMultiNodesTest-617918424-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:36.036821 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-bc2ef842-8a44-4148-9ba8-87e31f612dc2 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:36.046286 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-bc2ef842-8a44-4148-9ba8-87e31f612dc2 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:36.048428 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-bc2ef842-8a44-4148-9ba8-87e31f612dc2 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:36.049980 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-bc2ef842-8a44-4148-9ba8-87e31f612dc2 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466" status: 200 len: 1280 microversion: 2.25 time: 0.466345 Sep 23 04:36:36.050791 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 791/1529] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:36:35 2022] GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466 => generated 1280 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:36:36.056396 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d998e38a-5e5d-494a-b887-69ed0c495d31 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:36.057291 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d998e38a-5e5d-494a-b887-69ed0c495d31 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:36.065211 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d998e38a-5e5d-494a-b887-69ed0c495d31 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:36.066072 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d998e38a-5e5d-494a-b887-69ed0c495d31 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:36.068731 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d998e38a-5e5d-494a-b887-69ed0c495d31 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:36.068731 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d998e38a-5e5d-494a-b887-69ed0c495d31 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:36.068731 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d998e38a-5e5d-494a-b887-69ed0c495d31 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:36.069314 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d998e38a-5e5d-494a-b887-69ed0c495d31 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:36.101104 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7e16f608-808c-47ca-86a8-653027e5293c tempest-ServersOnMultiNodesTest-617918424 tempest-ServersOnMultiNodesTest-617918424-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/b4a75706-ba44-4b2c-8767-071502169d5a" status: 200 len: 1620 microversion: 2.1 time: 0.279095 Sep 23 04:36:36.102402 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 739/1530] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:35 2022] GET /compute/v2.1/servers/b4a75706-ba44-4b2c-8767-071502169d5a => generated 1620 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:36.125790 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-42c25281-34f5-4635-8754-bfdadd471433 tempest-ServersOnMultiNodesTest-617918424 tempest-ServersOnMultiNodesTest-617918424-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:36.126505 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-42c25281-34f5-4635-8754-bfdadd471433 tempest-ServersOnMultiNodesTest-617918424 tempest-ServersOnMultiNodesTest-617918424-project-admin] [instance: 19e41421-3550-49fe-90d0-64b07a5efefa] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:36.132839 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-42c25281-34f5-4635-8754-bfdadd471433 tempest-ServersOnMultiNodesTest-617918424 tempest-ServersOnMultiNodesTest-617918424-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:36.133537 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-42c25281-34f5-4635-8754-bfdadd471433 tempest-ServersOnMultiNodesTest-617918424 tempest-ServersOnMultiNodesTest-617918424-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:36.134019 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-42c25281-34f5-4635-8754-bfdadd471433 tempest-ServersOnMultiNodesTest-617918424 tempest-ServersOnMultiNodesTest-617918424-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:36.134743 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-42c25281-34f5-4635-8754-bfdadd471433 tempest-ServersOnMultiNodesTest-617918424 tempest-ServersOnMultiNodesTest-617918424-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:36.135281 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-42c25281-34f5-4635-8754-bfdadd471433 tempest-ServersOnMultiNodesTest-617918424 tempest-ServersOnMultiNodesTest-617918424-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:36.138526 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-42c25281-34f5-4635-8754-bfdadd471433 tempest-ServersOnMultiNodesTest-617918424 tempest-ServersOnMultiNodesTest-617918424-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:36.783384 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d998e38a-5e5d-494a-b887-69ed0c495d31 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:36.791696 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-42c25281-34f5-4635-8754-bfdadd471433 tempest-ServersOnMultiNodesTest-617918424 tempest-ServersOnMultiNodesTest-617918424-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/19e41421-3550-49fe-90d0-64b07a5efefa" status: 200 len: 1620 microversion: 2.1 time: 0.670802 Sep 23 04:36:36.792925 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 740/1531] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:36 2022] GET /compute/v2.1/servers/19e41421-3550-49fe-90d0-64b07a5efefa => generated 1620 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:36:36.803579 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d998e38a-5e5d-494a-b887-69ed0c495d31 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea" status: 200 len: 1477 microversion: 2.1 time: 0.743940 Sep 23 04:36:36.810433 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 792/1532] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:36 2022] GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea => generated 1477 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:36.833578 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7795ed07-7bf8-4e1e-8736-46f907b01d2c tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Action: 'create', calling method: .version_select at 0x7ff1bb7f4f70>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1977167761", "policies": ["anti-affinity"]}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:36:36.872761 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-7795ed07-7bf8-4e1e-8736-46f907b01d2c tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Getting quotas for project f5db359a60174c45afa2bf06e23a46c4. Resources: {'server_groups'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:36:36.875395 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-7795ed07-7bf8-4e1e-8736-46f907b01d2c tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Getting quotas for user da08af8193dd490b93278385583f24c0 and project f5db359a60174c45afa2bf06e23a46c4. Resources: {'server_groups'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:36:37.061383 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-7795ed07-7bf8-4e1e-8736-46f907b01d2c tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Getting quotas for project f5db359a60174c45afa2bf06e23a46c4. Resources: {'server_groups'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:36:37.071964 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-7795ed07-7bf8-4e1e-8736-46f907b01d2c tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Getting quotas for user da08af8193dd490b93278385583f24c0 and project f5db359a60174c45afa2bf06e23a46c4. Resources: {'server_groups'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:36:37.080876 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-53d28db3-bdb8-4ce2-acc2-cadbbd001255 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:37.081806 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-53d28db3-bdb8-4ce2-acc2-cadbbd001255 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 9e9a41f2-ff28-4c2a-80aa-193e0ebce466] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:37.113247 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-53d28db3-bdb8-4ce2-acc2-cadbbd001255 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:37.118103 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-53d28db3-bdb8-4ce2-acc2-cadbbd001255 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:37.119288 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-53d28db3-bdb8-4ce2-acc2-cadbbd001255 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:37.121035 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-7795ed07-7bf8-4e1e-8736-46f907b01d2c tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.298822 Sep 23 04:36:37.123074 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 793/1533] 10.222.0.33 () {60 vars in 1174 bytes} [Fri Sep 23 04:36:36 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:36:37.133419 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-53d28db3-bdb8-4ce2-acc2-cadbbd001255 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:37.149093 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-53d28db3-bdb8-4ce2-acc2-cadbbd001255 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:37.149093 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-53d28db3-bdb8-4ce2-acc2-cadbbd001255 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:37.401478 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-63eed6f9-9ed7-4dea-917e-a94ecf2d9813 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1074420909", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "c508385a-c6e2-44c7-a8ab-02b03657d36e"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:36:37.500222 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.neutron [None req-63eed6f9-9ed7-4dea-917e-a94ecf2d9813 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] validate_networks() for None {{(pid=122699) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:36:37.549603 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-53d28db3-bdb8-4ce2-acc2-cadbbd001255 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:37.555732 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-53d28db3-bdb8-4ce2-acc2-cadbbd001255 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:37.570460 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-53d28db3-bdb8-4ce2-acc2-cadbbd001255 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:37.571894 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-53d28db3-bdb8-4ce2-acc2-cadbbd001255 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466" status: 200 len: 1280 microversion: 2.25 time: 0.497064 Sep 23 04:36:37.586376 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 741/1534] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:36:37 2022] GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466 => generated 1280 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:36:37.830352 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a94b37b4-2c16-4705-9f90-bf0d83c342e1 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:37.830967 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a94b37b4-2c16-4705-9f90-bf0d83c342e1 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:37.846362 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a94b37b4-2c16-4705-9f90-bf0d83c342e1 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:37.846872 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a94b37b4-2c16-4705-9f90-bf0d83c342e1 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:37.847377 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a94b37b4-2c16-4705-9f90-bf0d83c342e1 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:37.848041 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a94b37b4-2c16-4705-9f90-bf0d83c342e1 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:37.848508 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a94b37b4-2c16-4705-9f90-bf0d83c342e1 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:37.848933 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a94b37b4-2c16-4705-9f90-bf0d83c342e1 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:38.268933 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-63eed6f9-9ed7-4dea-917e-a94ecf2d9813 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Flavor limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:36:38.269559 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-63eed6f9-9ed7-4dea-917e-a94ecf2d9813 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Image limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:36:38.269837 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-63eed6f9-9ed7-4dea-917e-a94ecf2d9813 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Flavor pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:36:38.274296 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-63eed6f9-9ed7-4dea-917e-a94ecf2d9813 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Image pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:36:38.274296 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-63eed6f9-9ed7-4dea-917e-a94ecf2d9813 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:36:38.302078 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-63eed6f9-9ed7-4dea-917e-a94ecf2d9813 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:38.302614 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-63eed6f9-9ed7-4dea-917e-a94ecf2d9813 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:38.303065 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-63eed6f9-9ed7-4dea-917e-a94ecf2d9813 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:38.303810 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-63eed6f9-9ed7-4dea-917e-a94ecf2d9813 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:38.304280 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-63eed6f9-9ed7-4dea-917e-a94ecf2d9813 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:38.304715 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-63eed6f9-9ed7-4dea-917e-a94ecf2d9813 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:38.406943 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-63eed6f9-9ed7-4dea-917e-a94ecf2d9813 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Getting quotas for project f5db359a60174c45afa2bf06e23a46c4. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:36:38.416212 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a94b37b4-2c16-4705-9f90-bf0d83c342e1 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:38.430086 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a94b37b4-2c16-4705-9f90-bf0d83c342e1 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea" status: 200 len: 1477 microversion: 2.1 time: 0.602428 Sep 23 04:36:38.432995 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 742/1535] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:37 2022] GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea => generated 1477 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:36:38.434810 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-63eed6f9-9ed7-4dea-917e-a94ecf2d9813 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Getting quotas for user da08af8193dd490b93278385583f24c0 and project f5db359a60174c45afa2bf06e23a46c4. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:36:38.465401 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:36:38.467580 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-63eed6f9-9ed7-4dea-917e-a94ecf2d9813 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Going to run 2 instances... {{(pid=122699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:36:38.470119 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-63eed6f9-9ed7-4dea-917e-a94ecf2d9813 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 1058d2c6-a5c4-41f2-8b63-40079d80419c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:36:38.528706 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-e6f337c8-a75a-4654-99f8-90f4426dbbb0 req-884f63da-92eb-42ff-8c1e-3960c4bb07a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e9a41f2-ff28-4c2a-80aa-193e0ebce466", "name": "network-vif-plugged", "status": "completed", "tag": "11d5e398-f101-4c1d-8d16-8553226b7947"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:36:38.540412 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-e6f337c8-a75a-4654-99f8-90f4426dbbb0 req-884f63da-92eb-42ff-8c1e-3960c4bb07a6 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:38.540412 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-e6f337c8-a75a-4654-99f8-90f4426dbbb0 req-884f63da-92eb-42ff-8c1e-3960c4bb07a6 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:38.540412 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-e6f337c8-a75a-4654-99f8-90f4426dbbb0 req-884f63da-92eb-42ff-8c1e-3960c4bb07a6 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:38.553263 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-e6f337c8-a75a-4654-99f8-90f4426dbbb0 req-884f63da-92eb-42ff-8c1e-3960c4bb07a6 service nova] Creating event network-vif-plugged:11d5e398-f101-4c1d-8d16-8553226b7947 for instance 9e9a41f2-ff28-4c2a-80aa-193e0ebce466 on n-h1-846463-3 Sep 23 04:36:38.558278 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-e6f337c8-a75a-4654-99f8-90f4426dbbb0 req-884f63da-92eb-42ff-8c1e-3960c4bb07a6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033192 Sep 23 04:36:38.559233 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 743/1536] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:36:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:36:38.604485 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-40dc88ad-c5d9-483c-aaa8-4b2f0baa8a23 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:38.605086 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-40dc88ad-c5d9-483c-aaa8-4b2f0baa8a23 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 9e9a41f2-ff28-4c2a-80aa-193e0ebce466] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:38.623805 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-40dc88ad-c5d9-483c-aaa8-4b2f0baa8a23 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:38.626394 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-40dc88ad-c5d9-483c-aaa8-4b2f0baa8a23 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:38.626394 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-40dc88ad-c5d9-483c-aaa8-4b2f0baa8a23 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:38.626394 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-40dc88ad-c5d9-483c-aaa8-4b2f0baa8a23 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:38.626394 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-40dc88ad-c5d9-483c-aaa8-4b2f0baa8a23 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:38.626889 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-40dc88ad-c5d9-483c-aaa8-4b2f0baa8a23 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:38.718475 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-63eed6f9-9ed7-4dea-917e-a94ecf2d9813 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Getting quotas for project f5db359a60174c45afa2bf06e23a46c4. Resources: {'server_group_members'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:36:38.737662 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-63eed6f9-9ed7-4dea-917e-a94ecf2d9813 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Getting quotas for user da08af8193dd490b93278385583f24c0 and project f5db359a60174c45afa2bf06e23a46c4. Resources: {'server_group_members'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:36:38.914017 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-63eed6f9-9ed7-4dea-917e-a94ecf2d9813 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Getting quotas for project f5db359a60174c45afa2bf06e23a46c4. Resources: {'server_group_members'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:36:38.931861 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-63eed6f9-9ed7-4dea-917e-a94ecf2d9813 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Getting quotas for user da08af8193dd490b93278385583f24c0 and project f5db359a60174c45afa2bf06e23a46c4. Resources: {'server_group_members'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:36:38.967113 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-63eed6f9-9ed7-4dea-917e-a94ecf2d9813 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 4997661d-a262-4bfa-994f-3615df7a8180] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=1058d2c6-a5c4-41f2-8b63-40079d80419c,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:36:39.011203 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-40dc88ad-c5d9-483c-aaa8-4b2f0baa8a23 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:39.022520 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-40dc88ad-c5d9-483c-aaa8-4b2f0baa8a23 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:39.028340 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-40dc88ad-c5d9-483c-aaa8-4b2f0baa8a23 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:39.029590 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-40dc88ad-c5d9-483c-aaa8-4b2f0baa8a23 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466" status: 200 len: 1280 microversion: 2.25 time: 0.435350 Sep 23 04:36:39.034433 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 744/1537] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:36:38 2022] GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466 => generated 1280 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:36:39.180998 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-63eed6f9-9ed7-4dea-917e-a94ecf2d9813 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Getting quotas for project f5db359a60174c45afa2bf06e23a46c4. Resources: {'server_group_members'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:36:39.191773 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-63eed6f9-9ed7-4dea-917e-a94ecf2d9813 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Getting quotas for user da08af8193dd490b93278385583f24c0 and project f5db359a60174c45afa2bf06e23a46c4. Resources: {'server_group_members'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:36:39.348479 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-63eed6f9-9ed7-4dea-917e-a94ecf2d9813 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Getting quotas for project f5db359a60174c45afa2bf06e23a46c4. Resources: {'server_group_members'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:36:39.362997 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-63eed6f9-9ed7-4dea-917e-a94ecf2d9813 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Getting quotas for user da08af8193dd490b93278385583f24c0 and project f5db359a60174c45afa2bf06e23a46c4. Resources: {'server_group_members'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:36:39.456608 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-01fcb4d3-f620-49eb-bf5a-d6d94dce7f75 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:39.457274 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-01fcb4d3-f620-49eb-bf5a-d6d94dce7f75 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:39.471369 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-63eed6f9-9ed7-4dea-917e-a94ecf2d9813 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.078825 Sep 23 04:36:39.472334 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 794/1538] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:36:37 2022] POST /compute/v2.1/servers => generated 32 bytes in 2081 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Sep 23 04:36:39.481147 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-339fc1c0-eec5-4840-a52f-4235f666a5d3 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:39.484198 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-01fcb4d3-f620-49eb-bf5a-d6d94dce7f75 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:39.484710 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-01fcb4d3-f620-49eb-bf5a-d6d94dce7f75 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:39.491076 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-01fcb4d3-f620-49eb-bf5a-d6d94dce7f75 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:39.492543 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-01fcb4d3-f620-49eb-bf5a-d6d94dce7f75 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:39.492741 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-339fc1c0-eec5-4840-a52f-4235f666a5d3 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:39.493586 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-339fc1c0-eec5-4840-a52f-4235f666a5d3 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Searching by: {'deleted': False, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4'} {{(pid=122699) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 04:36:39.494090 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-01fcb4d3-f620-49eb-bf5a-d6d94dce7f75 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:39.501443 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-01fcb4d3-f620-49eb-bf5a-d6d94dce7f75 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:39.524161 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-339fc1c0-eec5-4840-a52f-4235f666a5d3 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:39.524665 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-339fc1c0-eec5-4840-a52f-4235f666a5d3 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:39.525119 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-339fc1c0-eec5-4840-a52f-4235f666a5d3 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:39.525864 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-339fc1c0-eec5-4840-a52f-4235f666a5d3 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:39.526363 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-339fc1c0-eec5-4840-a52f-4235f666a5d3 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:39.526794 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-339fc1c0-eec5-4840-a52f-4235f666a5d3 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:39.694120 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.multi_cell_list [None req-339fc1c0-eec5-4840-a52f-4235f666a5d3 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=122699) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 23 04:36:39.811720 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-339fc1c0-eec5-4840-a52f-4235f666a5d3 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 1666 microversion: 2.1 time: 0.331192 Sep 23 04:36:39.812452 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 795/1539] 10.222.0.33 () {58 vars in 1125 bytes} [Fri Sep 23 04:36:39 2022] GET /compute/v2.1/servers => generated 1666 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:36:39.834350 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5dfca2f3-0af0-49b0-b21f-75170f625461 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:39.835320 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-5dfca2f3-0af0-49b0-b21f-75170f625461 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 4997661d-a262-4bfa-994f-3615df7a8180] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:39.860425 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-01fcb4d3-f620-49eb-bf5a-d6d94dce7f75 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:39.876176 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-01fcb4d3-f620-49eb-bf5a-d6d94dce7f75 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea" status: 200 len: 1477 microversion: 2.1 time: 0.418523 Sep 23 04:36:39.878158 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 745/1540] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:39 2022] GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea => generated 1477 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:36:39.956131 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-5dfca2f3-0af0-49b0-b21f-75170f625461 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:39.974012 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5dfca2f3-0af0-49b0-b21f-75170f625461 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/4997661d-a262-4bfa-994f-3615df7a8180" status: 200 len: 1219 microversion: 2.1 time: 0.151280 Sep 23 04:36:39.975920 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 796/1541] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:39 2022] GET /compute/v2.1/servers/4997661d-a262-4bfa-994f-3615df7a8180 => generated 1219 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:40.063880 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-51b609b7-e500-4ec0-a99c-b2196f803b5b tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:40.065478 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-51b609b7-e500-4ec0-a99c-b2196f803b5b tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 9e9a41f2-ff28-4c2a-80aa-193e0ebce466] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:40.087776 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-51b609b7-e500-4ec0-a99c-b2196f803b5b tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:40.088139 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-51b609b7-e500-4ec0-a99c-b2196f803b5b tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:40.088788 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-51b609b7-e500-4ec0-a99c-b2196f803b5b tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:40.089528 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-51b609b7-e500-4ec0-a99c-b2196f803b5b tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:40.090574 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-51b609b7-e500-4ec0-a99c-b2196f803b5b tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:40.091285 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-51b609b7-e500-4ec0-a99c-b2196f803b5b tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:40.259490 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-51b609b7-e500-4ec0-a99c-b2196f803b5b tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:40.269079 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-51b609b7-e500-4ec0-a99c-b2196f803b5b tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:40.270926 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-51b609b7-e500-4ec0-a99c-b2196f803b5b tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:40.273479 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-51b609b7-e500-4ec0-a99c-b2196f803b5b tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466" status: 200 len: 1280 microversion: 2.25 time: 0.214405 Sep 23 04:36:40.287408 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 746/1542] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:36:40 2022] GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466 => generated 1280 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:36:40.905590 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-29ccde47-87c0-4095-bcbe-0a1d09a5d4fe tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:40.905590 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-29ccde47-87c0-4095-bcbe-0a1d09a5d4fe tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:40.907679 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-29ccde47-87c0-4095-bcbe-0a1d09a5d4fe tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:40.908793 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-29ccde47-87c0-4095-bcbe-0a1d09a5d4fe tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:40.909523 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-29ccde47-87c0-4095-bcbe-0a1d09a5d4fe tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:40.910599 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-29ccde47-87c0-4095-bcbe-0a1d09a5d4fe tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:40.911601 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-29ccde47-87c0-4095-bcbe-0a1d09a5d4fe tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:40.912873 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-29ccde47-87c0-4095-bcbe-0a1d09a5d4fe tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:41.010405 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b14168e8-1268-45e1-85b4-71020c96bf48 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:41.011027 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b14168e8-1268-45e1-85b4-71020c96bf48 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 4997661d-a262-4bfa-994f-3615df7a8180] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:41.128920 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b14168e8-1268-45e1-85b4-71020c96bf48 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:41.138262 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b14168e8-1268-45e1-85b4-71020c96bf48 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/4997661d-a262-4bfa-994f-3615df7a8180" status: 200 len: 1219 microversion: 2.1 time: 0.130757 Sep 23 04:36:41.154791 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 747/1543] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:41 2022] GET /compute/v2.1/servers/4997661d-a262-4bfa-994f-3615df7a8180 => generated 1219 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:41.238696 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-29ccde47-87c0-4095-bcbe-0a1d09a5d4fe tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:41.249680 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-29ccde47-87c0-4095-bcbe-0a1d09a5d4fe tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea" status: 200 len: 1476 microversion: 2.1 time: 0.360455 Sep 23 04:36:41.250988 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 797/1544] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:40 2022] GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea => generated 1476 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:41.300588 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c497ff0d-d920-4729-a520-0701f3b7a0ce tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:41.301241 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c497ff0d-d920-4729-a520-0701f3b7a0ce tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 9e9a41f2-ff28-4c2a-80aa-193e0ebce466] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:41.309085 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c497ff0d-d920-4729-a520-0701f3b7a0ce tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:41.310026 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c497ff0d-d920-4729-a520-0701f3b7a0ce tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:41.311360 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c497ff0d-d920-4729-a520-0701f3b7a0ce tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:41.312312 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c497ff0d-d920-4729-a520-0701f3b7a0ce tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:41.312979 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c497ff0d-d920-4729-a520-0701f3b7a0ce tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:41.313624 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c497ff0d-d920-4729-a520-0701f3b7a0ce tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:41.525202 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-fd0862cb-d142-46b2-ac79-bef6604291fe req-dec47102-f02a-4902-8277-cc42cf175136 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea", "name": "network-vif-unplugged", "status": "completed", "tag": "4270b6dd-6896-414f-8926-bc0f7819f6f7"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:36:41.539262 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c497ff0d-d920-4729-a520-0701f3b7a0ce tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:41.562052 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c497ff0d-d920-4729-a520-0701f3b7a0ce tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:41.562186 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-fd0862cb-d142-46b2-ac79-bef6604291fe req-dec47102-f02a-4902-8277-cc42cf175136 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:41.562653 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-fd0862cb-d142-46b2-ac79-bef6604291fe req-dec47102-f02a-4902-8277-cc42cf175136 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:41.563101 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-fd0862cb-d142-46b2-ac79-bef6604291fe req-dec47102-f02a-4902-8277-cc42cf175136 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:41.565432 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c497ff0d-d920-4729-a520-0701f3b7a0ce tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:41.570636 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c497ff0d-d920-4729-a520-0701f3b7a0ce tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466" status: 200 len: 1476 microversion: 2.25 time: 0.273856 Sep 23 04:36:41.571266 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 748/1545] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:36:41 2022] GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466 => generated 1476 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:36:41.591802 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-fd0862cb-d142-46b2-ac79-bef6604291fe req-dec47102-f02a-4902-8277-cc42cf175136 service nova] Creating event network-vif-unplugged:4270b6dd-6896-414f-8926-bc0f7819f6f7 for instance f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea on n-h1-846463-3 Sep 23 04:36:41.603331 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ce1b049c-38bb-43bc-8297-67b453e1d63f tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:41.603950 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-ce1b049c-38bb-43bc-8297-67b453e1d63f tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] [instance: 9e9a41f2-ff28-4c2a-80aa-193e0ebce466] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:41.613311 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ce1b049c-38bb-43bc-8297-67b453e1d63f tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:41.613816 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ce1b049c-38bb-43bc-8297-67b453e1d63f tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:41.617247 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ce1b049c-38bb-43bc-8297-67b453e1d63f tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:41.617247 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ce1b049c-38bb-43bc-8297-67b453e1d63f tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:41.625533 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [req-fd0862cb-d142-46b2-ac79-bef6604291fe req-dec47102-f02a-4902-8277-cc42cf175136 service nova] Instance f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846463-3', 'n-h2-846463-3'} {{(pid=122699) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 23 04:36:41.628992 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ce1b049c-38bb-43bc-8297-67b453e1d63f tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:41.629992 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ce1b049c-38bb-43bc-8297-67b453e1d63f tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:41.656448 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-fd0862cb-d142-46b2-ac79-bef6604291fe req-dec47102-f02a-4902-8277-cc42cf175136 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.135959 Sep 23 04:36:41.657440 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 798/1546] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:36:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:36:41.826052 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-ce1b049c-38bb-43bc-8297-67b453e1d63f tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lazy-loading 'services' on Instance uuid 9e9a41f2-ff28-4c2a-80aa-193e0ebce466 {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:36:41.856844 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ce1b049c-38bb-43bc-8297-67b453e1d63f tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466" status: 200 len: 1968 microversion: 2.25 time: 0.258518 Sep 23 04:36:41.862010 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 749/1547] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:36:41 2022] GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466 => generated 1968 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:36:41.890463 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7e3ce542-5374-4ecf-9f0d-29d0761518cc tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:41.891601 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-7e3ce542-5374-4ecf-9f0d-29d0761518cc tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] [instance: 9e9a41f2-ff28-4c2a-80aa-193e0ebce466] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:41.906581 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7e3ce542-5374-4ecf-9f0d-29d0761518cc tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:41.907246 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7e3ce542-5374-4ecf-9f0d-29d0761518cc tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:41.907680 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7e3ce542-5374-4ecf-9f0d-29d0761518cc tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:41.908446 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7e3ce542-5374-4ecf-9f0d-29d0761518cc tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:41.911036 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7e3ce542-5374-4ecf-9f0d-29d0761518cc tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:41.911516 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7e3ce542-5374-4ecf-9f0d-29d0761518cc tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:42.125870 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-7e3ce542-5374-4ecf-9f0d-29d0761518cc tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lazy-loading 'services' on Instance uuid 9e9a41f2-ff28-4c2a-80aa-193e0ebce466 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:36:42.142185 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-7e3ce542-5374-4ecf-9f0d-29d0761518cc tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466" status: 200 len: 1968 microversion: 2.25 time: 0.256298 Sep 23 04:36:42.143113 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 799/1548] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:36:41 2022] GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466 => generated 1968 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:36:42.166597 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8aaba942-b6a2-425b-ab03-467c72fe88cf tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:42.174330 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8aaba942-b6a2-425b-ab03-467c72fe88cf tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 4997661d-a262-4bfa-994f-3615df7a8180] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:42.181936 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-bec0b9c8-3281-4dde-87cf-2bbd818a88b7 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:42.194196 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bec0b9c8-3281-4dde-87cf-2bbd818a88b7 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:42.196383 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bec0b9c8-3281-4dde-87cf-2bbd818a88b7 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:42.196712 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bec0b9c8-3281-4dde-87cf-2bbd818a88b7 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:42.197482 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bec0b9c8-3281-4dde-87cf-2bbd818a88b7 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:42.197964 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bec0b9c8-3281-4dde-87cf-2bbd818a88b7 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:42.201589 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bec0b9c8-3281-4dde-87cf-2bbd818a88b7 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:42.268644 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8aaba942-b6a2-425b-ab03-467c72fe88cf tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:42.270777 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-bec0b9c8-3281-4dde-87cf-2bbd818a88b7 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.094565 Sep 23 04:36:42.279909 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 800/1549] 10.222.0.33 () {60 vars in 1217 bytes} [Fri Sep 23 04:36:42 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 04:36:42.280993 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8aaba942-b6a2-425b-ab03-467c72fe88cf tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/4997661d-a262-4bfa-994f-3615df7a8180" status: 200 len: 1219 microversion: 2.1 time: 0.119397 Sep 23 04:36:42.283069 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 750/1550] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:42 2022] GET /compute/v2.1/servers/4997661d-a262-4bfa-994f-3615df7a8180 => generated 1219 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:42.301306 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ede8b266-e6cd-42da-a41d-8b5347d4ebd0 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:42.301306 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ede8b266-e6cd-42da-a41d-8b5347d4ebd0 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:42.306516 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5ca1cc61-8a42-4ff5-9e71-3fd5a555bcd4 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-846463-3", "block_migration": "auto"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:36:42.309693 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5ca1cc61-8a42-4ff5-9e71-3fd5a555bcd4 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] [instance: 9e9a41f2-ff28-4c2a-80aa-193e0ebce466] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:42.310377 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ede8b266-e6cd-42da-a41d-8b5347d4ebd0 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:42.310889 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ede8b266-e6cd-42da-a41d-8b5347d4ebd0 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:42.311339 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ede8b266-e6cd-42da-a41d-8b5347d4ebd0 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:42.312123 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ede8b266-e6cd-42da-a41d-8b5347d4ebd0 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:42.312597 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ede8b266-e6cd-42da-a41d-8b5347d4ebd0 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:42.313124 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ede8b266-e6cd-42da-a41d-8b5347d4ebd0 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:42.320432 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5ca1cc61-8a42-4ff5-9e71-3fd5a555bcd4 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:42.321175 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5ca1cc61-8a42-4ff5-9e71-3fd5a555bcd4 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:42.322890 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5ca1cc61-8a42-4ff5-9e71-3fd5a555bcd4 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:42.322890 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5ca1cc61-8a42-4ff5-9e71-3fd5a555bcd4 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:42.323529 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5ca1cc61-8a42-4ff5-9e71-3fd5a555bcd4 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:42.324435 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5ca1cc61-8a42-4ff5-9e71-3fd5a555bcd4 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:42.361855 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-5ca1cc61-8a42-4ff5-9e71-3fd5a555bcd4 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lazy-loading 'flavor' on Instance uuid 9e9a41f2-ff28-4c2a-80aa-193e0ebce466 {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:36:42.394158 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5ca1cc61-8a42-4ff5-9e71-3fd5a555bcd4 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] [instance: 9e9a41f2-ff28-4c2a-80aa-193e0ebce466] Going to try to live migrate instance to n-h2-846463-3 {{(pid=122698) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 23 04:36:42.576029 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ede8b266-e6cd-42da-a41d-8b5347d4ebd0 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:42.588949 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ede8b266-e6cd-42da-a41d-8b5347d4ebd0 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea" status: 200 len: 1476 microversion: 2.1 time: 0.310180 Sep 23 04:36:42.590740 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 801/1551] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:42 2022] GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea => generated 1476 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:42.673516 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:36:43.324972 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b4699808-97de-40a3-8140-058623647e15 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:43.326259 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b4699808-97de-40a3-8140-058623647e15 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 4997661d-a262-4bfa-994f-3615df7a8180] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:43.344349 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b4699808-97de-40a3-8140-058623647e15 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:43.348797 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b4699808-97de-40a3-8140-058623647e15 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:43.349310 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b4699808-97de-40a3-8140-058623647e15 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:43.350091 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b4699808-97de-40a3-8140-058623647e15 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:43.354997 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b4699808-97de-40a3-8140-058623647e15 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:43.355730 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b4699808-97de-40a3-8140-058623647e15 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:43.482881 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b4699808-97de-40a3-8140-058623647e15 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:43.482881 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b4699808-97de-40a3-8140-058623647e15 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/4997661d-a262-4bfa-994f-3615df7a8180" status: 200 len: 1223 microversion: 2.1 time: 0.170273 Sep 23 04:36:43.482881 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 802/1552] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:43 2022] GET /compute/v2.1/servers/4997661d-a262-4bfa-994f-3615df7a8180 => generated 1223 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:43.681785 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f06f4541-8e67-4240-809c-c9377c8a278a tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:43.682491 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f06f4541-8e67-4240-809c-c9377c8a278a tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:43.695917 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f06f4541-8e67-4240-809c-c9377c8a278a tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:43.696455 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f06f4541-8e67-4240-809c-c9377c8a278a tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:43.696912 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f06f4541-8e67-4240-809c-c9377c8a278a tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:43.697640 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f06f4541-8e67-4240-809c-c9377c8a278a tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:43.698148 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f06f4541-8e67-4240-809c-c9377c8a278a tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:43.698621 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f06f4541-8e67-4240-809c-c9377c8a278a tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:43.931965 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f06f4541-8e67-4240-809c-c9377c8a278a tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:43.942582 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f06f4541-8e67-4240-809c-c9377c8a278a tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea" status: 200 len: 1476 microversion: 2.1 time: 0.265397 Sep 23 04:36:43.954281 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 803/1553] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:43 2022] GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea => generated 1476 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:43.969500 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-207ad248-d124-4f50-8a80-74368aca76a9 req-afc35d8d-773f-43e7-ae1a-d52d32ca38f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea", "tag": "4270b6dd-6896-414f-8926-bc0f7819f6f7"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:36:43.992472 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-207ad248-d124-4f50-8a80-74368aca76a9 req-afc35d8d-773f-43e7-ae1a-d52d32ca38f2 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:43.992472 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-207ad248-d124-4f50-8a80-74368aca76a9 req-afc35d8d-773f-43e7-ae1a-d52d32ca38f2 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:43.992472 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-207ad248-d124-4f50-8a80-74368aca76a9 req-afc35d8d-773f-43e7-ae1a-d52d32ca38f2 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:44.008169 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-207ad248-d124-4f50-8a80-74368aca76a9 req-afc35d8d-773f-43e7-ae1a-d52d32ca38f2 service nova] Creating event network-changed:4270b6dd-6896-414f-8926-bc0f7819f6f7 for instance f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea on n-h1-846463-3 Sep 23 04:36:44.022053 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [req-207ad248-d124-4f50-8a80-74368aca76a9 req-afc35d8d-773f-43e7-ae1a-d52d32ca38f2 service nova] Instance f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846463-3', 'n-h2-846463-3'} {{(pid=122699) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 23 04:36:44.035434 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-207ad248-d124-4f50-8a80-74368aca76a9 req-afc35d8d-773f-43e7-ae1a-d52d32ca38f2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078364 Sep 23 04:36:44.035434 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 804/1554] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:36:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:36:44.504351 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ee761bec-2416-491b-bafb-829e2ebec5a1 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:44.510009 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ee761bec-2416-491b-bafb-829e2ebec5a1 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 4997661d-a262-4bfa-994f-3615df7a8180] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:44.513601 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ee761bec-2416-491b-bafb-829e2ebec5a1 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:44.514246 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ee761bec-2416-491b-bafb-829e2ebec5a1 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:44.514769 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ee761bec-2416-491b-bafb-829e2ebec5a1 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:44.515398 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ee761bec-2416-491b-bafb-829e2ebec5a1 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:44.517111 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ee761bec-2416-491b-bafb-829e2ebec5a1 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:44.518540 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ee761bec-2416-491b-bafb-829e2ebec5a1 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:44.696976 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ee761bec-2416-491b-bafb-829e2ebec5a1 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:44.705660 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ee761bec-2416-491b-bafb-829e2ebec5a1 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/4997661d-a262-4bfa-994f-3615df7a8180" status: 200 len: 1215 microversion: 2.1 time: 0.206106 Sep 23 04:36:44.706287 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 805/1555] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:44 2022] GET /compute/v2.1/servers/4997661d-a262-4bfa-994f-3615df7a8180 => generated 1215 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:36:44.977218 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-05aa3a92-a957-4878-b066-15a159edc4d4 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:44.978281 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-05aa3a92-a957-4878-b066-15a159edc4d4 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:45.023147 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-05aa3a92-a957-4878-b066-15a159edc4d4 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:45.027568 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-05aa3a92-a957-4878-b066-15a159edc4d4 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:45.028412 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-05aa3a92-a957-4878-b066-15a159edc4d4 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:45.030403 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-05aa3a92-a957-4878-b066-15a159edc4d4 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:45.034236 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-05aa3a92-a957-4878-b066-15a159edc4d4 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:45.036006 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-05aa3a92-a957-4878-b066-15a159edc4d4 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:45.108504 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:36:45.112997 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:36:45.593566 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-05aa3a92-a957-4878-b066-15a159edc4d4 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:45.607249 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-05aa3a92-a957-4878-b066-15a159edc4d4 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea" status: 200 len: 1476 microversion: 2.1 time: 0.644339 Sep 23 04:36:45.609379 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 806/1556] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:44 2022] GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea => generated 1476 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:45.730342 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2d0dcee5-e097-4937-8913-9f72b99a78a0 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:45.731275 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-2d0dcee5-e097-4937-8913-9f72b99a78a0 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 4997661d-a262-4bfa-994f-3615df7a8180] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:45.747290 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2d0dcee5-e097-4937-8913-9f72b99a78a0 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:45.748079 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2d0dcee5-e097-4937-8913-9f72b99a78a0 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:45.748753 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2d0dcee5-e097-4937-8913-9f72b99a78a0 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:45.749684 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2d0dcee5-e097-4937-8913-9f72b99a78a0 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:45.750435 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2d0dcee5-e097-4937-8913-9f72b99a78a0 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:45.751238 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2d0dcee5-e097-4937-8913-9f72b99a78a0 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:46.212506 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2d0dcee5-e097-4937-8913-9f72b99a78a0 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:46.220987 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2d0dcee5-e097-4937-8913-9f72b99a78a0 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/4997661d-a262-4bfa-994f-3615df7a8180" status: 200 len: 1271 microversion: 2.1 time: 0.495396 Sep 23 04:36:46.222322 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 807/1557] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:45 2022] GET /compute/v2.1/servers/4997661d-a262-4bfa-994f-3615df7a8180 => generated 1271 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:46.753167 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7fefbc0f-9443-4de5-a713-71d4a0b79e7f tempest-SecurityGroupsNegativeTestJSON-1755601520 tempest-SecurityGroupsNegativeTestJSON-1755601520-project] Calling method '.version_select at 0x7ff1bb824b80>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:46.824542 n-d-846463-3 devstack@n-api.service[122699]: DEBUG neutronclient.v2_0.client [None req-7fefbc0f-9443-4de5-a713-71d4a0b79e7f tempest-SecurityGroupsNegativeTestJSON-1755601520 tempest-SecurityGroupsNegativeTestJSON-1755601520-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f5fe1d5e-20f3-46f0-a4c5-3f82a34cadf5 does not exist", "detail": ""}} {{(pid=122699) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 23 04:36:46.825422 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.security_group_api [None req-7fefbc0f-9443-4de5-a713-71d4a0b79e7f tempest-SecurityGroupsNegativeTestJSON-1755601520 tempest-SecurityGroupsNegativeTestJSON-1755601520-project] Neutron security group f5fe1d5e-20f3-46f0-a4c5-3f82a34cadf5 not found {{(pid=122699) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 23 04:36:46.826315 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-7fefbc0f-9443-4de5-a713-71d4a0b79e7f tempest-SecurityGroupsNegativeTestJSON-1755601520 tempest-SecurityGroupsNegativeTestJSON-1755601520-project] HTTP exception thrown: Security group f5fe1d5e-20f3-46f0-a4c5-3f82a34cadf5 does not exist Sep 23 04:36:46.826315 n-d-846463-3 devstack@n-api.service[122699]: Neutron server returns request_ids: ['req-d53ba658-93b0-43b9-8203-0c44e1903c46'] Sep 23 04:36:46.836258 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7fefbc0f-9443-4de5-a713-71d4a0b79e7f tempest-SecurityGroupsNegativeTestJSON-1755601520 tempest-SecurityGroupsNegativeTestJSON-1755601520-project] Request method failure captured: Sep 23 04:36:46.836258 n-d-846463-3 devstack@n-api.service[122699]: request: DELETE /compute/v2.1/os-security-groups/f5fe1d5e-20f3-46f0-a4c5-3f82a34cadf5 HTTP/1.1 Sep 23 04:36:46.836258 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:36:46.836258 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:36:46.836258 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:36:46.836258 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:36:46.836258 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:36:46.836258 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:36:46.836258 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:36:46.836258 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:36:46.836258 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTfeRFao2gwodtt9fEVkrWV8P-UuX_ojSvnY8e5i0DM_pLsIEe-YGgVxuNr0jMDWyoiiY0hmDzTIF2tKVGFffB7Z4TdlyqS1GIEGeQBC-MXSSJZkc-F0ueOe6LjZTU8pLiOmu-QXr3JVPUGDOjd--81sZ6CJipye8lYw23bfGolDbsE Sep 23 04:36:46.836258 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:36:46.836258 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:36:46.836258 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:36:46.836258 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:36:46.836258 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:36:46.836258 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:36:46.836258 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 66bfe33b3de640b3872d0670ffd3ae99 Sep 23 04:36:46.836258 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1755601520 Sep 23 04:36:46.836258 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:36:46.836258 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:36:46.838170 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_66bfe33b3de640b3872d0670ffd3ae99", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/66bfe33b3de640b3872d0670ffd3ae99"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/66bfe33b3de640b3872d0670ffd3ae99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/66bfe33b3de640b3872d0670ffd3ae99"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:36:46.838170 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1755601520 Sep 23 04:36:46.838170 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 66bfe33b3de640b3872d0670ffd3ae99 Sep 23 04:36:46.838170 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1755601520 Sep 23 04:36:46.838170 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-SecurityGroupsNegativeTestJSON-1755601520-project Sep 23 04:36:46.838170 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:36:46.838170 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:36:46.838170 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 046d9b723b994961b6ddb2ca73e7c427 Sep 23 04:36:46.838170 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1755601520-project Sep 23 04:36:46.838170 n-d-846463-3 devstack@n-api.service[122699]: method: Sep 23 04:36:46.838170 n-d-846463-3 devstack@n-api.service[122699]: exception: Security group f5fe1d5e-20f3-46f0-a4c5-3f82a34cadf5 does not exist Sep 23 04:36:46.838170 n-d-846463-3 devstack@n-api.service[122699]: Neutron server returns request_ids: ['req-d53ba658-93b0-43b9-8203-0c44e1903c46'] Sep 23 04:36:46.838170 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': 'f5fe1d5e-20f3-46f0-a4c5-3f82a34cadf5'} Sep 23 04:36:46.839389 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:36:46.839389 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:36:46.839389 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 23 04:36:46.839389 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 23 04:36:46.839389 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:36:46.839389 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:36:46.839389 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 23 04:36:46.839389 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 23 04:36:46.839389 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:36:46.839389 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:36:46.839389 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 23 04:36:46.839389 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 23 04:36:46.839389 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:36:46.839389 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:36:46.839389 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 23 04:36:46.839389 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 23 04:36:46.839389 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:36:46.839389 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:36:46.839389 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 23 04:36:46.840948 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 23 04:36:46.840948 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:36:46.840948 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:36:46.840948 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 23 04:36:46.840948 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 23 04:36:46.840948 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 23 04:36:46.840948 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 23 04:36:46.840948 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f5fe1d5e-20f3-46f0-a4c5-3f82a34cadf5 does not exist Sep 23 04:36:46.840948 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d53ba658-93b0-43b9-8203-0c44e1903c46'] Sep 23 04:36:46.840948 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:36:46.840948 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:36:46.840948 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:36:46.840948 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:36:46.840948 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 23 04:36:46.840948 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 23 04:36:46.840948 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 23 04:36:46.840948 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 23 04:36:46.840948 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f5fe1d5e-20f3-46f0-a4c5-3f82a34cadf5 does not exist Sep 23 04:36:46.842698 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d53ba658-93b0-43b9-8203-0c44e1903c46'] Sep 23 04:36:46.842698 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:36:46.842698 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:36:46.842698 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:36:46.842698 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:36:46.842698 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:36:46.842698 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:36:46.842698 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:36:46.842698 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:36:46.842698 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:36:46.842698 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:36:46.842698 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:36:46.842698 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:36:46.842698 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 23 04:36:46.842698 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 23 04:36:46.842698 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f5fe1d5e-20f3-46f0-a4c5-3f82a34cadf5 does not exist Sep 23 04:36:46.842698 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d53ba658-93b0-43b9-8203-0c44e1903c46'] Sep 23 04:36:46.842698 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:36:46.842698 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:36:46.842698 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:36:46.842698 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:36:46.845105 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:36:46.845105 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:36:46.845105 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:36:46.845105 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:36:46.845105 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f5fe1d5e-20f3-46f0-a4c5-3f82a34cadf5 does not exist Sep 23 04:36:46.845105 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d53ba658-93b0-43b9-8203-0c44e1903c46'] Sep 23 04:36:46.845105 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:36:46.847874 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7fefbc0f-9443-4de5-a713-71d4a0b79e7f tempest-SecurityGroupsNegativeTestJSON-1755601520 tempest-SecurityGroupsNegativeTestJSON-1755601520-project] Returning 404 to user: Security group f5fe1d5e-20f3-46f0-a4c5-3f82a34cadf5 does not exist Sep 23 04:36:46.847874 n-d-846463-3 devstack@n-api.service[122699]: Neutron server returns request_ids: ['req-d53ba658-93b0-43b9-8203-0c44e1903c46'] {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:36:46.850076 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-7fefbc0f-9443-4de5-a713-71d4a0b79e7f tempest-SecurityGroupsNegativeTestJSON-1755601520 tempest-SecurityGroupsNegativeTestJSON-1755601520-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/f5fe1d5e-20f3-46f0-a4c5-3f82a34cadf5" status: 404 len: 194 microversion: 2.1 time: 0.355392 Sep 23 04:36:46.850847 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 808/1558] 10.222.0.33 () {58 vars in 1272 bytes} [Fri Sep 23 04:36:46 2022] DELETE /compute/v2.1/os-security-groups/f5fe1d5e-20f3-46f0-a4c5-3f82a34cadf5 => generated 194 bytes in 357 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 04:36:46.856800 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b412ab26-3a59-4b9f-8904-f12b0e897e32 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:46.862865 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b412ab26-3a59-4b9f-8904-f12b0e897e32 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:46.874763 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b412ab26-3a59-4b9f-8904-f12b0e897e32 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:46.875762 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b412ab26-3a59-4b9f-8904-f12b0e897e32 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:46.876797 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b412ab26-3a59-4b9f-8904-f12b0e897e32 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:46.881120 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b412ab26-3a59-4b9f-8904-f12b0e897e32 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:46.881920 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b412ab26-3a59-4b9f-8904-f12b0e897e32 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:46.882534 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b412ab26-3a59-4b9f-8904-f12b0e897e32 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:47.203268 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b412ab26-3a59-4b9f-8904-f12b0e897e32 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:47.212891 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b412ab26-3a59-4b9f-8904-f12b0e897e32 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea" status: 200 len: 1474 microversion: 2.1 time: 0.360699 Sep 23 04:36:47.218259 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 809/1559] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:46 2022] GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea => generated 1474 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:47.228046 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-dcf1dfa7-1d84-4396-95c3-37d445c50e20 tempest-SecurityGroupsNegativeTestJSON-1755601520 tempest-SecurityGroupsNegativeTestJSON-1755601520-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.008456 Sep 23 04:36:47.229239 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 810/1560] 10.222.0.33 () {58 vars in 1164 bytes} [Fri Sep 23 04:36:47 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 23 04:36:47.246212 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6c2ec92e-c26a-4a71-af91-4495c22dcfc0 tempest-SecurityGroupsNegativeTestJSON-1755601520 tempest-SecurityGroupsNegativeTestJSON-1755601520-project] Calling method '.version_select at 0x7ff1bb8753a0>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:48.060912 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6c2ec92e-c26a-4a71-af91-4495c22dcfc0 tempest-SecurityGroupsNegativeTestJSON-1755601520 tempest-SecurityGroupsNegativeTestJSON-1755601520-project] 10.222.0.33 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.825973 Sep 23 04:36:48.064016 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 811/1561] 10.222.0.33 () {58 vars in 1158 bytes} [Fri Sep 23 04:36:47 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:36:48.071199 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ce53bc7b-583f-467a-9f23-e61f2e9685bf tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:48.072341 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ce53bc7b-583f-467a-9f23-e61f2e9685bf tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 4997661d-a262-4bfa-994f-3615df7a8180] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:48.087197 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ce53bc7b-583f-467a-9f23-e61f2e9685bf tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:48.088808 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ce53bc7b-583f-467a-9f23-e61f2e9685bf tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:48.089667 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ce53bc7b-583f-467a-9f23-e61f2e9685bf tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:48.090617 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ce53bc7b-583f-467a-9f23-e61f2e9685bf tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:48.091688 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ce53bc7b-583f-467a-9f23-e61f2e9685bf tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:48.092815 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ce53bc7b-583f-467a-9f23-e61f2e9685bf tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:48.361591 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ce53bc7b-583f-467a-9f23-e61f2e9685bf tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:48.371369 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ce53bc7b-583f-467a-9f23-e61f2e9685bf tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/4997661d-a262-4bfa-994f-3615df7a8180" status: 200 len: 1271 microversion: 2.1 time: 0.305861 Sep 23 04:36:48.376783 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 812/1562] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:48 2022] GET /compute/v2.1/servers/4997661d-a262-4bfa-994f-3615df7a8180 => generated 1271 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:48.382071 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-84e6225d-7b26-4938-9602-81fddafcb25d tempest-SecurityGroupsNegativeTestJSON-1755601520 tempest-SecurityGroupsNegativeTestJSON-1755601520-project] Calling method '.version_select at 0x7ff1bb7050d0>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:49.477765 n-d-846463-3 devstack@n-api.service[122699]: DEBUG neutronclient.v2_0.client [None req-84e6225d-7b26-4938-9602-81fddafcb25d tempest-SecurityGroupsNegativeTestJSON-1755601520 tempest-SecurityGroupsNegativeTestJSON-1755601520-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=122699) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 23 04:36:49.480289 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-84e6225d-7b26-4938-9602-81fddafcb25d tempest-SecurityGroupsNegativeTestJSON-1755601520 tempest-SecurityGroupsNegativeTestJSON-1755601520-project] HTTP exception thrown: Insufficient rights for removing default security group. Sep 23 04:36:49.480289 n-d-846463-3 devstack@n-api.service[122699]: Neutron server returns request_ids: ['req-8535069b-a083-4cd9-86a0-1ac2c94517ca'] Sep 23 04:36:49.487633 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-84e6225d-7b26-4938-9602-81fddafcb25d tempest-SecurityGroupsNegativeTestJSON-1755601520 tempest-SecurityGroupsNegativeTestJSON-1755601520-project] Request method failure captured: Sep 23 04:36:49.487633 n-d-846463-3 devstack@n-api.service[122699]: request: DELETE /compute/v2.1/os-security-groups/17c658ba-1ec4-4ad2-a129-1e8d8511d52d HTTP/1.1 Sep 23 04:36:49.487633 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:36:49.487633 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:36:49.487633 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:36:49.487633 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:36:49.487633 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:36:49.487633 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:36:49.487633 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:36:49.487633 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:36:49.487633 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTfeRFao2gwodtt9fEVkrWV8P-UuX_ojSvnY8e5i0DM_pLsIEe-YGgVxuNr0jMDWyoiiY0hmDzTIF2tKVGFffB7Z4TdlyqS1GIEGeQBC-MXSSJZkc-F0ueOe6LjZTU8pLiOmu-QXr3JVPUGDOjd--81sZ6CJipye8lYw23bfGolDbsE Sep 23 04:36:49.487633 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:36:49.487633 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:36:49.487633 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:36:49.487633 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:36:49.487633 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:36:49.487633 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:36:49.487633 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 66bfe33b3de640b3872d0670ffd3ae99 Sep 23 04:36:49.487633 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1755601520 Sep 23 04:36:49.487633 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:36:49.487633 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:36:49.489356 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_66bfe33b3de640b3872d0670ffd3ae99", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/66bfe33b3de640b3872d0670ffd3ae99"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/66bfe33b3de640b3872d0670ffd3ae99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/66bfe33b3de640b3872d0670ffd3ae99"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:36:49.489356 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1755601520 Sep 23 04:36:49.489356 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 66bfe33b3de640b3872d0670ffd3ae99 Sep 23 04:36:49.489356 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1755601520 Sep 23 04:36:49.489356 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-SecurityGroupsNegativeTestJSON-1755601520-project Sep 23 04:36:49.489356 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:36:49.489356 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:36:49.489356 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 046d9b723b994961b6ddb2ca73e7c427 Sep 23 04:36:49.489356 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1755601520-project Sep 23 04:36:49.489356 n-d-846463-3 devstack@n-api.service[122699]: method: Sep 23 04:36:49.489356 n-d-846463-3 devstack@n-api.service[122699]: exception: Insufficient rights for removing default security group. Sep 23 04:36:49.489356 n-d-846463-3 devstack@n-api.service[122699]: Neutron server returns request_ids: ['req-8535069b-a083-4cd9-86a0-1ac2c94517ca'] Sep 23 04:36:49.489356 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '17c658ba-1ec4-4ad2-a129-1e8d8511d52d'} Sep 23 04:36:49.490334 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:36:49.490334 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:36:49.490334 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Sep 23 04:36:49.490334 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Sep 23 04:36:49.490334 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:36:49.490334 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:36:49.490334 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Sep 23 04:36:49.490334 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Sep 23 04:36:49.490334 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:36:49.490334 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:36:49.490334 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Sep 23 04:36:49.490334 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Sep 23 04:36:49.490334 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:36:49.490334 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:36:49.490334 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 23 04:36:49.490334 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 23 04:36:49.490334 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:36:49.490334 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:36:49.490334 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 23 04:36:49.494851 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 23 04:36:49.494851 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:36:49.494851 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:36:49.494851 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 23 04:36:49.494851 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 23 04:36:49.494851 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 23 04:36:49.494851 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 23 04:36:49.494851 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Sep 23 04:36:49.494851 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8535069b-a083-4cd9-86a0-1ac2c94517ca'] Sep 23 04:36:49.494851 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:36:49.494851 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:36:49.494851 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:36:49.494851 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:36:49.494851 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Sep 23 04:36:49.494851 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Sep 23 04:36:49.494851 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Sep 23 04:36:49.494851 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Sep 23 04:36:49.494851 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Sep 23 04:36:49.494851 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8535069b-a083-4cd9-86a0-1ac2c94517ca'] Sep 23 04:36:49.498049 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:36:49.498049 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:36:49.498049 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:36:49.498049 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:36:49.498049 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:36:49.498049 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:36:49.498049 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:36:49.498049 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:36:49.498049 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:36:49.498049 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:36:49.498049 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:36:49.498049 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:36:49.498049 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Sep 23 04:36:49.498049 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 23 04:36:49.498049 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Sep 23 04:36:49.498049 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8535069b-a083-4cd9-86a0-1ac2c94517ca'] Sep 23 04:36:49.498049 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:36:49.498049 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:36:49.498049 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:36:49.498049 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:36:49.498049 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:36:49.501179 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:36:49.501179 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:36:49.501179 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:36:49.501179 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Sep 23 04:36:49.501179 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8535069b-a083-4cd9-86a0-1ac2c94517ca'] Sep 23 04:36:49.501179 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:36:49.504359 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-84e6225d-7b26-4938-9602-81fddafcb25d tempest-SecurityGroupsNegativeTestJSON-1755601520 tempest-SecurityGroupsNegativeTestJSON-1755601520-project] Returning 400 to user: Insufficient rights for removing default security group. Sep 23 04:36:49.504359 n-d-846463-3 devstack@n-api.service[122699]: Neutron server returns request_ids: ['req-8535069b-a083-4cd9-86a0-1ac2c94517ca'] {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:36:49.506110 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-84e6225d-7b26-4938-9602-81fddafcb25d tempest-SecurityGroupsNegativeTestJSON-1755601520 tempest-SecurityGroupsNegativeTestJSON-1755601520-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/17c658ba-1ec4-4ad2-a129-1e8d8511d52d" status: 400 len: 182 microversion: 2.1 time: 1.127917 Sep 23 04:36:49.508054 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 813/1563] 10.222.0.33 () {58 vars in 1272 bytes} [Fri Sep 23 04:36:48 2022] DELETE /compute/v2.1/os-security-groups/17c658ba-1ec4-4ad2-a129-1e8d8511d52d => generated 182 bytes in 1130 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 04:36:49.532626 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6149edeb-46f3-4b0a-afd2-05b2db9cd71b tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:49.533438 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-6149edeb-46f3-4b0a-afd2-05b2db9cd71b tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:49.548732 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6149edeb-46f3-4b0a-afd2-05b2db9cd71b tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:49.553001 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6149edeb-46f3-4b0a-afd2-05b2db9cd71b tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:49.553567 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6149edeb-46f3-4b0a-afd2-05b2db9cd71b tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:49.559906 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6149edeb-46f3-4b0a-afd2-05b2db9cd71b tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:49.560106 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6149edeb-46f3-4b0a-afd2-05b2db9cd71b tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:49.576567 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6149edeb-46f3-4b0a-afd2-05b2db9cd71b tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:49.931951 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-6149edeb-46f3-4b0a-afd2-05b2db9cd71b tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:49.946209 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6149edeb-46f3-4b0a-afd2-05b2db9cd71b tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea" status: 200 len: 1471 microversion: 2.1 time: 0.436542 Sep 23 04:36:49.947123 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 814/1564] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:49 2022] GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea => generated 1471 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:49.957070 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-53cf3962-b188-4411-9d1f-cf76f4ea15ed tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:49.962195 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-53cf3962-b188-4411-9d1f-cf76f4ea15ed tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 4997661d-a262-4bfa-994f-3615df7a8180] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:49.975840 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=32 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:36:49.980210 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-53cf3962-b188-4411-9d1f-cf76f4ea15ed tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:49.980915 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-53cf3962-b188-4411-9d1f-cf76f4ea15ed tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:49.981796 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-53cf3962-b188-4411-9d1f-cf76f4ea15ed tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:49.982843 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-53cf3962-b188-4411-9d1f-cf76f4ea15ed tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:49.983474 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-53cf3962-b188-4411-9d1f-cf76f4ea15ed tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:49.985581 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-53cf3962-b188-4411-9d1f-cf76f4ea15ed tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:50.217865 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-53cf3962-b188-4411-9d1f-cf76f4ea15ed tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:50.233282 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-53cf3962-b188-4411-9d1f-cf76f4ea15ed tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/4997661d-a262-4bfa-994f-3615df7a8180" status: 200 len: 1277 microversion: 2.1 time: 0.284732 Sep 23 04:36:50.235457 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 815/1565] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:49 2022] GET /compute/v2.1/servers/4997661d-a262-4bfa-994f-3615df7a8180 => generated 1277 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:50.242145 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-58e8d3ce-9635-48b2-b18d-08efe7b97a88 tempest-SecurityGroupsNegativeTestJSON-1755601520 tempest-SecurityGroupsNegativeTestJSON-1755601520-project] Calling method '.version_select at 0x7ff1bb8753a0>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:50.389599 n-d-846463-3 devstack@n-api.service[122699]: DEBUG neutronclient.v2_0.client [None req-58e8d3ce-9635-48b2-b18d-08efe7b97a88 tempest-SecurityGroupsNegativeTestJSON-1755601520 tempest-SecurityGroupsNegativeTestJSON-1755601520-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group bb27e5c0-8119-478f-bbb0-9947158fc204 does not exist", "detail": ""}} {{(pid=122699) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 23 04:36:50.390890 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.security_group_api [None req-58e8d3ce-9635-48b2-b18d-08efe7b97a88 tempest-SecurityGroupsNegativeTestJSON-1755601520 tempest-SecurityGroupsNegativeTestJSON-1755601520-project] Neutron security group bb27e5c0-8119-478f-bbb0-9947158fc204 not found {{(pid=122699) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 23 04:36:50.392770 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-58e8d3ce-9635-48b2-b18d-08efe7b97a88 tempest-SecurityGroupsNegativeTestJSON-1755601520 tempest-SecurityGroupsNegativeTestJSON-1755601520-project] HTTP exception thrown: Security group bb27e5c0-8119-478f-bbb0-9947158fc204 does not exist Sep 23 04:36:50.392770 n-d-846463-3 devstack@n-api.service[122699]: Neutron server returns request_ids: ['req-46ab56f9-fd15-4d05-92d9-8966a366aa9d'] Sep 23 04:36:50.399640 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-58e8d3ce-9635-48b2-b18d-08efe7b97a88 tempest-SecurityGroupsNegativeTestJSON-1755601520 tempest-SecurityGroupsNegativeTestJSON-1755601520-project] Request method failure captured: Sep 23 04:36:50.399640 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/os-security-groups/bb27e5c0-8119-478f-bbb0-9947158fc204 HTTP/1.1 Sep 23 04:36:50.399640 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:36:50.399640 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:36:50.399640 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:36:50.399640 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:36:50.399640 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:36:50.399640 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:36:50.399640 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:36:50.399640 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:36:50.399640 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTfeRFao2gwodtt9fEVkrWV8P-UuX_ojSvnY8e5i0DM_pLsIEe-YGgVxuNr0jMDWyoiiY0hmDzTIF2tKVGFffB7Z4TdlyqS1GIEGeQBC-MXSSJZkc-F0ueOe6LjZTU8pLiOmu-QXr3JVPUGDOjd--81sZ6CJipye8lYw23bfGolDbsE Sep 23 04:36:50.399640 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:36:50.399640 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:36:50.399640 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:36:50.399640 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:36:50.399640 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:36:50.399640 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:36:50.399640 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 66bfe33b3de640b3872d0670ffd3ae99 Sep 23 04:36:50.399640 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1755601520 Sep 23 04:36:50.399640 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:36:50.399640 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:36:50.401437 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_66bfe33b3de640b3872d0670ffd3ae99", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/66bfe33b3de640b3872d0670ffd3ae99"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/66bfe33b3de640b3872d0670ffd3ae99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/66bfe33b3de640b3872d0670ffd3ae99"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:36:50.401437 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1755601520 Sep 23 04:36:50.401437 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 66bfe33b3de640b3872d0670ffd3ae99 Sep 23 04:36:50.401437 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1755601520 Sep 23 04:36:50.401437 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-SecurityGroupsNegativeTestJSON-1755601520-project Sep 23 04:36:50.401437 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:36:50.401437 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:36:50.401437 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 046d9b723b994961b6ddb2ca73e7c427 Sep 23 04:36:50.401437 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1755601520-project Sep 23 04:36:50.401437 n-d-846463-3 devstack@n-api.service[122699]: method: Sep 23 04:36:50.401437 n-d-846463-3 devstack@n-api.service[122699]: exception: Security group bb27e5c0-8119-478f-bbb0-9947158fc204 does not exist Sep 23 04:36:50.401437 n-d-846463-3 devstack@n-api.service[122699]: Neutron server returns request_ids: ['req-46ab56f9-fd15-4d05-92d9-8966a366aa9d'] Sep 23 04:36:50.401437 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': 'bb27e5c0-8119-478f-bbb0-9947158fc204'} Sep 23 04:36:50.402635 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:36:50.402635 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:36:50.402635 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 23 04:36:50.402635 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 23 04:36:50.402635 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:36:50.402635 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:36:50.402635 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 23 04:36:50.402635 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 23 04:36:50.402635 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:36:50.402635 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:36:50.402635 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 23 04:36:50.402635 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 23 04:36:50.402635 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:36:50.402635 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:36:50.402635 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 23 04:36:50.402635 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 23 04:36:50.402635 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:36:50.402635 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:36:50.402635 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 23 04:36:50.404334 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 23 04:36:50.404334 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:36:50.404334 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:36:50.404334 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 23 04:36:50.404334 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 23 04:36:50.404334 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 23 04:36:50.404334 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 23 04:36:50.404334 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group bb27e5c0-8119-478f-bbb0-9947158fc204 does not exist Sep 23 04:36:50.404334 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-46ab56f9-fd15-4d05-92d9-8966a366aa9d'] Sep 23 04:36:50.404334 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:36:50.404334 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:36:50.404334 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:36:50.404334 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:36:50.404334 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 23 04:36:50.404334 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 23 04:36:50.404334 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 23 04:36:50.404334 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 23 04:36:50.404334 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group bb27e5c0-8119-478f-bbb0-9947158fc204 does not exist Sep 23 04:36:50.405809 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-46ab56f9-fd15-4d05-92d9-8966a366aa9d'] Sep 23 04:36:50.405809 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:36:50.405809 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:36:50.405809 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:36:50.405809 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:36:50.405809 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:36:50.405809 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:36:50.405809 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:36:50.405809 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:36:50.405809 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:36:50.405809 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:36:50.405809 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:36:50.405809 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:36:50.405809 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 23 04:36:50.405809 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 23 04:36:50.405809 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group bb27e5c0-8119-478f-bbb0-9947158fc204 does not exist Sep 23 04:36:50.405809 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-46ab56f9-fd15-4d05-92d9-8966a366aa9d'] Sep 23 04:36:50.405809 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:36:50.405809 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:36:50.405809 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:36:50.405809 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:36:50.408089 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:36:50.408089 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:36:50.408089 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:36:50.408089 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:36:50.408089 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group bb27e5c0-8119-478f-bbb0-9947158fc204 does not exist Sep 23 04:36:50.408089 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-46ab56f9-fd15-4d05-92d9-8966a366aa9d'] Sep 23 04:36:50.408089 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:36:50.408089 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-58e8d3ce-9635-48b2-b18d-08efe7b97a88 tempest-SecurityGroupsNegativeTestJSON-1755601520 tempest-SecurityGroupsNegativeTestJSON-1755601520-project] Returning 404 to user: Security group bb27e5c0-8119-478f-bbb0-9947158fc204 does not exist Sep 23 04:36:50.408089 n-d-846463-3 devstack@n-api.service[122699]: Neutron server returns request_ids: ['req-46ab56f9-fd15-4d05-92d9-8966a366aa9d'] {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:36:50.408089 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-58e8d3ce-9635-48b2-b18d-08efe7b97a88 tempest-SecurityGroupsNegativeTestJSON-1755601520 tempest-SecurityGroupsNegativeTestJSON-1755601520-project] 10.222.0.33 "GET /compute/v2.1/os-security-groups/bb27e5c0-8119-478f-bbb0-9947158fc204" status: 404 len: 194 microversion: 2.1 time: 0.169529 Sep 23 04:36:50.414154 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 816/1566] 10.222.0.33 () {58 vars in 1269 bytes} [Fri Sep 23 04:36:50 2022] GET /compute/v2.1/os-security-groups/bb27e5c0-8119-478f-bbb0-9947158fc204 => generated 194 bytes in 178 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:36:50.419540 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d1c966d8-9dbd-4695-a005-94f28af2e995 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:36:50.420236 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d1c966d8-9dbd-4695-a005-94f28af2e995 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:50.430104 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d1c966d8-9dbd-4695-a005-94f28af2e995 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:50.434649 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d1c966d8-9dbd-4695-a005-94f28af2e995 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:50.434649 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d1c966d8-9dbd-4695-a005-94f28af2e995 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:50.434649 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d1c966d8-9dbd-4695-a005-94f28af2e995 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:50.434649 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d1c966d8-9dbd-4695-a005-94f28af2e995 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:50.435042 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d1c966d8-9dbd-4695-a005-94f28af2e995 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:50.435752 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5ca1cc61-8a42-4ff5-9e71-3fd5a555bcd4 tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466/action" status: 202 len: 0 microversion: 2.25 time: 8.143268 Sep 23 04:36:50.445036 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 751/1567] 10.222.0.33 () {62 vars in 1319 bytes} [Fri Sep 23 04:36:42 2022] POST /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466/action => generated 0 bytes in 8153 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:36:50.456954 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8496e5b3-5467-4c81-b0db-0bdfeeee895a tempest-SecurityGroupsNegativeTestJSON-1755601520 tempest-SecurityGroupsNegativeTestJSON-1755601520-project] Action: 'update', calling method: .version_select at 0x7ff1bbbe5ee0>, body: {"security_group": {"name": "tempest-sg-1938947877", "description": "tempest-description-741161189"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:36:50.522673 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:36:50.610426 n-d-846463-3 devstack@n-api.service[122698]: DEBUG neutronclient.v2_0.client [None req-8496e5b3-5467-4c81-b0db-0bdfeeee895a tempest-SecurityGroupsNegativeTestJSON-1755601520 tempest-SecurityGroupsNegativeTestJSON-1755601520-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 0f56d192-fb13-48fd-aea0-ace39b701461 does not exist", "detail": ""}} {{(pid=122698) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 23 04:36:50.611992 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.network.security_group_api [None req-8496e5b3-5467-4c81-b0db-0bdfeeee895a tempest-SecurityGroupsNegativeTestJSON-1755601520 tempest-SecurityGroupsNegativeTestJSON-1755601520-project] Neutron security group 0f56d192-fb13-48fd-aea0-ace39b701461 not found {{(pid=122698) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 23 04:36:50.613490 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-8496e5b3-5467-4c81-b0db-0bdfeeee895a tempest-SecurityGroupsNegativeTestJSON-1755601520 tempest-SecurityGroupsNegativeTestJSON-1755601520-project] HTTP exception thrown: Security group 0f56d192-fb13-48fd-aea0-ace39b701461 does not exist Sep 23 04:36:50.613490 n-d-846463-3 devstack@n-api.service[122698]: Neutron server returns request_ids: ['req-6cd147ee-044a-4c70-a4f2-dd821737c977'] Sep 23 04:36:50.632608 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8496e5b3-5467-4c81-b0db-0bdfeeee895a tempest-SecurityGroupsNegativeTestJSON-1755601520 tempest-SecurityGroupsNegativeTestJSON-1755601520-project] Request method failure captured: Sep 23 04:36:50.632608 n-d-846463-3 devstack@n-api.service[122698]: request: PUT /compute/v2.1/os-security-groups/0f56d192-fb13-48fd-aea0-ace39b701461 HTTP/1.1 Sep 23 04:36:50.632608 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:36:50.632608 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:36:50.632608 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:36:50.632608 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 101 Sep 23 04:36:50.632608 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:36:50.632608 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:36:50.632608 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:36:50.632608 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:36:50.632608 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTfeRFao2gwodtt9fEVkrWV8P-UuX_ojSvnY8e5i0DM_pLsIEe-YGgVxuNr0jMDWyoiiY0hmDzTIF2tKVGFffB7Z4TdlyqS1GIEGeQBC-MXSSJZkc-F0ueOe6LjZTU8pLiOmu-QXr3JVPUGDOjd--81sZ6CJipye8lYw23bfGolDbsE Sep 23 04:36:50.632608 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:36:50.632608 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:36:50.632608 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:36:50.632608 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:36:50.632608 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:36:50.632608 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:36:50.632608 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 66bfe33b3de640b3872d0670ffd3ae99 Sep 23 04:36:50.632608 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1755601520 Sep 23 04:36:50.632608 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:36:50.632608 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:36:50.634149 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_66bfe33b3de640b3872d0670ffd3ae99", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/66bfe33b3de640b3872d0670ffd3ae99"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/66bfe33b3de640b3872d0670ffd3ae99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/66bfe33b3de640b3872d0670ffd3ae99"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:36:50.634149 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1755601520 Sep 23 04:36:50.634149 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 66bfe33b3de640b3872d0670ffd3ae99 Sep 23 04:36:50.634149 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1755601520 Sep 23 04:36:50.634149 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-SecurityGroupsNegativeTestJSON-1755601520-project Sep 23 04:36:50.634149 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:36:50.634149 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:36:50.634149 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 046d9b723b994961b6ddb2ca73e7c427 Sep 23 04:36:50.634149 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1755601520-project Sep 23 04:36:50.634149 n-d-846463-3 devstack@n-api.service[122698]: Sep 23 04:36:50.634149 n-d-846463-3 devstack@n-api.service[122698]: {"security_group": {"name": "tempest-sg-1938947877", "description": "tempest-description-741161189"}} Sep 23 04:36:50.634149 n-d-846463-3 devstack@n-api.service[122698]: method: Sep 23 04:36:50.634149 n-d-846463-3 devstack@n-api.service[122698]: exception: Security group 0f56d192-fb13-48fd-aea0-ace39b701461 does not exist Sep 23 04:36:50.635237 n-d-846463-3 devstack@n-api.service[122698]: Neutron server returns request_ids: ['req-6cd147ee-044a-4c70-a4f2-dd821737c977'] Sep 23 04:36:50.635237 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '0f56d192-fb13-48fd-aea0-ace39b701461', 'body': {'security_group': {'name': 'tempest-sg-1938947877', 'description': 'tempest-description-741161189'}}} Sep 23 04:36:50.635237 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:36:50.635237 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:36:50.635237 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 23 04:36:50.635237 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 23 04:36:50.635237 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:36:50.635237 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:36:50.635237 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 23 04:36:50.635237 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 23 04:36:50.635237 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:36:50.635237 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:36:50.635237 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 23 04:36:50.635237 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 23 04:36:50.635237 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:36:50.635237 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:36:50.635237 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 23 04:36:50.635237 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 23 04:36:50.636448 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:36:50.636448 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:36:50.636448 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 23 04:36:50.636448 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 23 04:36:50.636448 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:36:50.636448 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:36:50.636448 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 23 04:36:50.636448 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 23 04:36:50.636448 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 23 04:36:50.636448 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 23 04:36:50.636448 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 0f56d192-fb13-48fd-aea0-ace39b701461 does not exist Sep 23 04:36:50.636448 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6cd147ee-044a-4c70-a4f2-dd821737c977'] Sep 23 04:36:50.636448 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:36:50.636448 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:36:50.636448 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:36:50.636448 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:36:50.636448 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Sep 23 04:36:50.636448 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 23 04:36:50.636448 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 23 04:36:50.637732 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 23 04:36:50.637732 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 0f56d192-fb13-48fd-aea0-ace39b701461 does not exist Sep 23 04:36:50.637732 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6cd147ee-044a-4c70-a4f2-dd821737c977'] Sep 23 04:36:50.637732 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:36:50.637732 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:36:50.637732 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:36:50.637732 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:36:50.637732 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:36:50.637732 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:36:50.637732 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:36:50.637732 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:36:50.637732 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:36:50.637732 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:36:50.637732 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:36:50.637732 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:36:50.637732 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Sep 23 04:36:50.637732 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 23 04:36:50.637732 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 0f56d192-fb13-48fd-aea0-ace39b701461 does not exist Sep 23 04:36:50.637732 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6cd147ee-044a-4c70-a4f2-dd821737c977'] Sep 23 04:36:50.637732 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:36:50.643056 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:36:50.643056 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:36:50.643056 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:36:50.643056 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:36:50.643056 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:36:50.643056 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:36:50.643056 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:36:50.643056 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 0f56d192-fb13-48fd-aea0-ace39b701461 does not exist Sep 23 04:36:50.643056 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6cd147ee-044a-4c70-a4f2-dd821737c977'] Sep 23 04:36:50.643056 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:36:50.643056 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8496e5b3-5467-4c81-b0db-0bdfeeee895a tempest-SecurityGroupsNegativeTestJSON-1755601520 tempest-SecurityGroupsNegativeTestJSON-1755601520-project] Returning 404 to user: Security group 0f56d192-fb13-48fd-aea0-ace39b701461 does not exist Sep 23 04:36:50.643056 n-d-846463-3 devstack@n-api.service[122698]: Neutron server returns request_ids: ['req-6cd147ee-044a-4c70-a4f2-dd821737c977'] {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:36:50.643056 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8496e5b3-5467-4c81-b0db-0bdfeeee895a tempest-SecurityGroupsNegativeTestJSON-1755601520 tempest-SecurityGroupsNegativeTestJSON-1755601520-project] 10.222.0.33 "PUT /compute/v2.1/os-security-groups/0f56d192-fb13-48fd-aea0-ace39b701461" status: 404 len: 194 microversion: 2.1 time: 0.185894 Sep 23 04:36:50.646522 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 752/1568] 10.222.0.33 () {60 vars in 1290 bytes} [Fri Sep 23 04:36:50 2022] PUT /compute/v2.1/os-security-groups/0f56d192-fb13-48fd-aea0-ace39b701461 => generated 194 bytes in 191 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:36:50.659195 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-633b9c9a-e096-4aa6-a503-ca379ebc3170 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:50.660111 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-633b9c9a-e096-4aa6-a503-ca379ebc3170 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 9e9a41f2-ff28-4c2a-80aa-193e0ebce466] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:50.676327 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-633b9c9a-e096-4aa6-a503-ca379ebc3170 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:50.676841 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-633b9c9a-e096-4aa6-a503-ca379ebc3170 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:50.677936 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-633b9c9a-e096-4aa6-a503-ca379ebc3170 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:50.678675 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-633b9c9a-e096-4aa6-a503-ca379ebc3170 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:50.679145 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-633b9c9a-e096-4aa6-a503-ca379ebc3170 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:50.679578 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-633b9c9a-e096-4aa6-a503-ca379ebc3170 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:51.088071 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d1c966d8-9dbd-4695-a005-94f28af2e995 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "POST /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea/action" status: 202 len: 0 microversion: 2.1 time: 0.663753 Sep 23 04:36:51.088799 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 817/1569] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:36:50 2022] POST /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea/action => generated 0 bytes in 674 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:36:51.116902 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e2017cb7-2d1e-4315-8a85-ba9f77f3d2bd tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:51.119184 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e2017cb7-2d1e-4315-8a85-ba9f77f3d2bd tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:51.134798 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e2017cb7-2d1e-4315-8a85-ba9f77f3d2bd tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:51.151183 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e2017cb7-2d1e-4315-8a85-ba9f77f3d2bd tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:51.171225 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e2017cb7-2d1e-4315-8a85-ba9f77f3d2bd tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:51.181421 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e2017cb7-2d1e-4315-8a85-ba9f77f3d2bd tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:51.182076 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e2017cb7-2d1e-4315-8a85-ba9f77f3d2bd tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:51.182545 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e2017cb7-2d1e-4315-8a85-ba9f77f3d2bd tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:51.925855 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-633b9c9a-e096-4aa6-a503-ca379ebc3170 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:51.937792 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-633b9c9a-e096-4aa6-a503-ca379ebc3170 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:51.939828 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-633b9c9a-e096-4aa6-a503-ca379ebc3170 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:51.941039 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-633b9c9a-e096-4aa6-a503-ca379ebc3170 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466" status: 200 len: 1486 microversion: 2.25 time: 1.303490 Sep 23 04:36:51.941828 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 753/1570] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:36:50 2022] GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466 => generated 1486 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:36:51.946840 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-50c57028-3a86-4fae-8369-4f5995438fa6 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:51.947631 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-50c57028-3a86-4fae-8369-4f5995438fa6 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 4997661d-a262-4bfa-994f-3615df7a8180] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:51.951987 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=86 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:36:51.969938 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-50c57028-3a86-4fae-8369-4f5995438fa6 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:51.970532 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-50c57028-3a86-4fae-8369-4f5995438fa6 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:51.972206 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-50c57028-3a86-4fae-8369-4f5995438fa6 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:51.972206 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-50c57028-3a86-4fae-8369-4f5995438fa6 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:51.972206 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-50c57028-3a86-4fae-8369-4f5995438fa6 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:51.979725 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-50c57028-3a86-4fae-8369-4f5995438fa6 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:52.090283 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e2017cb7-2d1e-4315-8a85-ba9f77f3d2bd tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:52.101313 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e2017cb7-2d1e-4315-8a85-ba9f77f3d2bd tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea" status: 200 len: 1470 microversion: 2.1 time: 0.995877 Sep 23 04:36:52.103611 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 818/1571] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:51 2022] GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea => generated 1470 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:52.128881 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2414f957-9a64-49a6-92dd-e0e3b026869a tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:52.133583 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-2414f957-9a64-49a6-92dd-e0e3b026869a tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] [instance: 04e9b262-d9e0-434a-bcbb-a85ef9180ee9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:52.154011 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2414f957-9a64-49a6-92dd-e0e3b026869a tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:52.155718 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2414f957-9a64-49a6-92dd-e0e3b026869a tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:52.156306 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2414f957-9a64-49a6-92dd-e0e3b026869a tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:52.157142 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2414f957-9a64-49a6-92dd-e0e3b026869a tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:52.158836 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2414f957-9a64-49a6-92dd-e0e3b026869a tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:52.161651 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2414f957-9a64-49a6-92dd-e0e3b026869a tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:52.225500 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=8 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:36:52.277652 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=6 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:36:52.945829 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-50c57028-3a86-4fae-8369-4f5995438fa6 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:52.955805 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-50c57028-3a86-4fae-8369-4f5995438fa6 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/4997661d-a262-4bfa-994f-3615df7a8180" status: 200 len: 1319 microversion: 2.1 time: 1.012392 Sep 23 04:36:52.961321 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 754/1572] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:51 2022] GET /compute/v2.1/servers/4997661d-a262-4bfa-994f-3615df7a8180 => generated 1319 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:52.976214 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-7d9ed206-ef14-4c8b-97c3-0fc0b16f42fe req-0649d419-21ac-47fb-8ec7-ec12a118dcf9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1058d2c6-a5c4-41f2-8b63-40079d80419c", "tag": "093fa6be-7b6f-4cd2-93e0-851baa75b110"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:36:53.002147 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-7d9ed206-ef14-4c8b-97c3-0fc0b16f42fe req-0649d419-21ac-47fb-8ec7-ec12a118dcf9 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:53.002813 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-7d9ed206-ef14-4c8b-97c3-0fc0b16f42fe req-0649d419-21ac-47fb-8ec7-ec12a118dcf9 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:53.005561 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-7d9ed206-ef14-4c8b-97c3-0fc0b16f42fe req-0649d419-21ac-47fb-8ec7-ec12a118dcf9 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:53.034106 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-7d9ed206-ef14-4c8b-97c3-0fc0b16f42fe req-0649d419-21ac-47fb-8ec7-ec12a118dcf9 service nova] Creating event network-changed:093fa6be-7b6f-4cd2-93e0-851baa75b110 for instance 1058d2c6-a5c4-41f2-8b63-40079d80419c on n-h2-846463-3 Sep 23 04:36:53.048972 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-7d9ed206-ef14-4c8b-97c3-0fc0b16f42fe req-0649d419-21ac-47fb-8ec7-ec12a118dcf9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086177 Sep 23 04:36:53.055181 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 755/1573] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:36:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:36:53.070109 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-91741c89-f5eb-4ca1-a12e-d07caeb8c43b tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:53.074076 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-91741c89-f5eb-4ca1-a12e-d07caeb8c43b tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 9e9a41f2-ff28-4c2a-80aa-193e0ebce466] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:53.091539 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-91741c89-f5eb-4ca1-a12e-d07caeb8c43b tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:53.092409 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-91741c89-f5eb-4ca1-a12e-d07caeb8c43b tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:53.093132 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-91741c89-f5eb-4ca1-a12e-d07caeb8c43b tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:53.094213 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-91741c89-f5eb-4ca1-a12e-d07caeb8c43b tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:53.094967 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-91741c89-f5eb-4ca1-a12e-d07caeb8c43b tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:53.095631 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-91741c89-f5eb-4ca1-a12e-d07caeb8c43b tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:53.132744 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2414f957-9a64-49a6-92dd-e0e3b026869a tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9" status: 200 len: 1860 microversion: 2.1 time: 1.025921 Sep 23 04:36:53.132744 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 819/1574] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:52 2022] GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9 => generated 1860 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:53.145621 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f3b54f83-75b1-48ad-9b26-cf79a0d5e36d tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:53.149370 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f3b54f83-75b1-48ad-9b26-cf79a0d5e36d tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:53.168258 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f3b54f83-75b1-48ad-9b26-cf79a0d5e36d tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:53.168885 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f3b54f83-75b1-48ad-9b26-cf79a0d5e36d tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:53.169442 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f3b54f83-75b1-48ad-9b26-cf79a0d5e36d tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:53.170827 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f3b54f83-75b1-48ad-9b26-cf79a0d5e36d tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:53.172563 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f3b54f83-75b1-48ad-9b26-cf79a0d5e36d tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:53.174349 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f3b54f83-75b1-48ad-9b26-cf79a0d5e36d tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:53.704574 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-91741c89-f5eb-4ca1-a12e-d07caeb8c43b tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:53.720662 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-91741c89-f5eb-4ca1-a12e-d07caeb8c43b tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:53.726690 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-91741c89-f5eb-4ca1-a12e-d07caeb8c43b tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:53.733786 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-91741c89-f5eb-4ca1-a12e-d07caeb8c43b tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466" status: 200 len: 1486 microversion: 2.25 time: 0.675827 Sep 23 04:36:53.738072 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 756/1575] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:36:53 2022] GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466 => generated 1486 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:36:53.763601 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7faa4593-d64b-44df-864d-6955228058c4 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-846463-3", "block_migration": true, "disk_over_commit": false}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:36:53.772869 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7faa4593-d64b-44df-864d-6955228058c4 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] [instance: 04e9b262-d9e0-434a-bcbb-a85ef9180ee9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:53.798124 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7faa4593-d64b-44df-864d-6955228058c4 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:53.799729 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7faa4593-d64b-44df-864d-6955228058c4 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:53.806304 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7faa4593-d64b-44df-864d-6955228058c4 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:53.806304 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7faa4593-d64b-44df-864d-6955228058c4 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:53.806304 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7faa4593-d64b-44df-864d-6955228058c4 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:53.806304 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7faa4593-d64b-44df-864d-6955228058c4 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:53.871598 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-7faa4593-d64b-44df-864d-6955228058c4 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lazy-loading 'flavor' on Instance uuid 04e9b262-d9e0-434a-bcbb-a85ef9180ee9 {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:36:53.885576 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f3b54f83-75b1-48ad-9b26-cf79a0d5e36d tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:53.886772 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7faa4593-d64b-44df-864d-6955228058c4 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] [instance: 04e9b262-d9e0-434a-bcbb-a85ef9180ee9] Going to try to live migrate instance to n-h1-846463-3 {{(pid=122698) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 23 04:36:53.893978 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f3b54f83-75b1-48ad-9b26-cf79a0d5e36d tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea" status: 200 len: 1470 microversion: 2.1 time: 0.761351 Sep 23 04:36:53.894499 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 820/1576] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:53 2022] GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea => generated 1470 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:53.909451 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-82335a48-3810-464c-91ff-449fe20709a9 req-c5752f81-c896-42a5-9383-b547ba1b4180 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4997661d-a262-4bfa-994f-3615df7a8180", "tag": "0721b7eb-714f-4781-bcd0-667c3afcaa9e"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:36:53.942048 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-82335a48-3810-464c-91ff-449fe20709a9 req-c5752f81-c896-42a5-9383-b547ba1b4180 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:53.943369 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-82335a48-3810-464c-91ff-449fe20709a9 req-c5752f81-c896-42a5-9383-b547ba1b4180 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:53.943817 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-82335a48-3810-464c-91ff-449fe20709a9 req-c5752f81-c896-42a5-9383-b547ba1b4180 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:53.957232 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-82335a48-3810-464c-91ff-449fe20709a9 req-c5752f81-c896-42a5-9383-b547ba1b4180 service nova] Creating event network-changed:0721b7eb-714f-4781-bcd0-667c3afcaa9e for instance 4997661d-a262-4bfa-994f-3615df7a8180 on n-h1-846463-3 Sep 23 04:36:53.974573 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-82335a48-3810-464c-91ff-449fe20709a9 req-c5752f81-c896-42a5-9383-b547ba1b4180 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068573 Sep 23 04:36:53.975506 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 821/1577] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:36:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:36:53.983792 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c3281e63-5282-40a2-acd9-b4a424546d6a tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:53.997726 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c3281e63-5282-40a2-acd9-b4a424546d6a tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6c977d0e2ec64f8ca6b0923b9876c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f661d071bed2459cba4aa91e2b8b0d28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:53.998587 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c3281e63-5282-40a2-acd9-b4a424546d6a tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Searching by: {'deleted': False, 'project_id': 'f661d071bed2459cba4aa91e2b8b0d28'} {{(pid=122699) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 04:36:54.019913 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c3281e63-5282-40a2-acd9-b4a424546d6a tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:54.020525 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c3281e63-5282-40a2-acd9-b4a424546d6a tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:54.021003 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c3281e63-5282-40a2-acd9-b4a424546d6a tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:54.021741 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c3281e63-5282-40a2-acd9-b4a424546d6a tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:54.022233 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c3281e63-5282-40a2-acd9-b4a424546d6a tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:54.022749 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c3281e63-5282-40a2-acd9-b4a424546d6a tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:54.069218 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.multi_cell_list [None req-c3281e63-5282-40a2-acd9-b4a424546d6a tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122699) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 23 04:36:54.141002 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c3281e63-5282-40a2-acd9-b4a424546d6a tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.163337 Sep 23 04:36:54.150906 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 822/1578] 10.222.0.33 () {58 vars in 1125 bytes} [Fri Sep 23 04:36:53 2022] GET /compute/v2.1/servers => generated 343 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:36:54.163993 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-fa151b1e-e466-4508-87fc-1ce394fec117 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:54.164855 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-fa151b1e-e466-4508-87fc-1ce394fec117 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 4997661d-a262-4bfa-994f-3615df7a8180] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:54.172900 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fa151b1e-e466-4508-87fc-1ce394fec117 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:54.173879 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fa151b1e-e466-4508-87fc-1ce394fec117 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:54.174708 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fa151b1e-e466-4508-87fc-1ce394fec117 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:54.175642 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fa151b1e-e466-4508-87fc-1ce394fec117 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:54.176332 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fa151b1e-e466-4508-87fc-1ce394fec117 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:54.177503 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fa151b1e-e466-4508-87fc-1ce394fec117 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:54.742076 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-fa151b1e-e466-4508-87fc-1ce394fec117 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:54.752934 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-fa151b1e-e466-4508-87fc-1ce394fec117 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/4997661d-a262-4bfa-994f-3615df7a8180" status: 200 len: 1319 microversion: 2.1 time: 0.600746 Sep 23 04:36:54.777454 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 823/1579] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:54 2022] GET /compute/v2.1/servers/4997661d-a262-4bfa-994f-3615df7a8180 => generated 1319 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:54.783685 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-851a6054-320e-48b0-979b-c7522c0bbfaf req-4b726b6e-0238-4dac-97b9-a9266a31ac54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea", "name": "network-vif-plugged", "status": "completed", "tag": "4270b6dd-6896-414f-8926-bc0f7819f6f7"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:36:54.805075 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-851a6054-320e-48b0-979b-c7522c0bbfaf req-4b726b6e-0238-4dac-97b9-a9266a31ac54 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:54.808071 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-851a6054-320e-48b0-979b-c7522c0bbfaf req-4b726b6e-0238-4dac-97b9-a9266a31ac54 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:54.810392 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-851a6054-320e-48b0-979b-c7522c0bbfaf req-4b726b6e-0238-4dac-97b9-a9266a31ac54 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:54.833532 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-851a6054-320e-48b0-979b-c7522c0bbfaf req-4b726b6e-0238-4dac-97b9-a9266a31ac54 service nova] Creating event network-vif-plugged:4270b6dd-6896-414f-8926-bc0f7819f6f7 for instance f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea on n-h1-846463-3 Sep 23 04:36:54.844103 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [req-851a6054-320e-48b0-979b-c7522c0bbfaf req-4b726b6e-0238-4dac-97b9-a9266a31ac54 service nova] Instance f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846463-3', 'n-h2-846463-3'} {{(pid=122699) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 23 04:36:54.866096 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-851a6054-320e-48b0-979b-c7522c0bbfaf req-4b726b6e-0238-4dac-97b9-a9266a31ac54 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086081 Sep 23 04:36:54.875488 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 824/1580] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:36:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:36:54.881828 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-771b58f4-89a3-48cb-a507-979e0a655d2f tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:54.888371 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-771b58f4-89a3-48cb-a507-979e0a655d2f tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6c977d0e2ec64f8ca6b0923b9876c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f661d071bed2459cba4aa91e2b8b0d28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:54.892314 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-771b58f4-89a3-48cb-a507-979e0a655d2f tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Searching by: {'deleted': False, 'project_id': 'f661d071bed2459cba4aa91e2b8b0d28'} {{(pid=122699) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 04:36:54.900034 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-771b58f4-89a3-48cb-a507-979e0a655d2f tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:54.901030 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-771b58f4-89a3-48cb-a507-979e0a655d2f tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:54.906670 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-771b58f4-89a3-48cb-a507-979e0a655d2f tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:54.906670 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-771b58f4-89a3-48cb-a507-979e0a655d2f tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:54.906670 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-771b58f4-89a3-48cb-a507-979e0a655d2f tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:54.906670 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-771b58f4-89a3-48cb-a507-979e0a655d2f tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:54.952181 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.multi_cell_list [None req-771b58f4-89a3-48cb-a507-979e0a655d2f tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122699) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 23 04:36:54.999692 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-771b58f4-89a3-48cb-a507-979e0a655d2f tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c977d0e2ec64f8ca6b0923b9876c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f661d071bed2459cba4aa91e2b8b0d28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:55.008297 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-771b58f4-89a3-48cb-a507-979e0a655d2f tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:55.009161 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-771b58f4-89a3-48cb-a507-979e0a655d2f tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:55.009798 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-771b58f4-89a3-48cb-a507-979e0a655d2f tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:55.501347 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-771b58f4-89a3-48cb-a507-979e0a655d2f tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] 10.222.0.33 "GET /compute/v2.1/servers/detail" status: 200 len: 1605 microversion: 2.1 time: 0.628051 Sep 23 04:36:55.502313 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 825/1581] 10.222.0.33 () {58 vars in 1146 bytes} [Fri Sep 23 04:36:54 2022] GET /compute/v2.1/servers/detail => generated 1605 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:55.507135 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-914e7d85-abfe-45a6-9083-2c813b2a629d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:55.507892 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-914e7d85-abfe-45a6-9083-2c813b2a629d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 9e9a41f2-ff28-4c2a-80aa-193e0ebce466] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:55.519946 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-914e7d85-abfe-45a6-9083-2c813b2a629d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:55.521019 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-914e7d85-abfe-45a6-9083-2c813b2a629d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:55.526103 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-914e7d85-abfe-45a6-9083-2c813b2a629d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:55.539029 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-914e7d85-abfe-45a6-9083-2c813b2a629d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:55.541307 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-914e7d85-abfe-45a6-9083-2c813b2a629d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:55.542075 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-914e7d85-abfe-45a6-9083-2c813b2a629d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:55.579232 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:36:56.415802 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-914e7d85-abfe-45a6-9083-2c813b2a629d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:56.424544 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-914e7d85-abfe-45a6-9083-2c813b2a629d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:56.426032 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-914e7d85-abfe-45a6-9083-2c813b2a629d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:56.427800 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-914e7d85-abfe-45a6-9083-2c813b2a629d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466" status: 200 len: 1486 microversion: 2.25 time: 0.924523 Sep 23 04:36:56.428360 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 826/1582] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:36:55 2022] GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466 => generated 1486 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:36:56.432978 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f6eae94f-5c40-4a7c-abfd-7e750a64e4c9 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:56.433588 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f6eae94f-5c40-4a7c-abfd-7e750a64e4c9 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:56.440147 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f6eae94f-5c40-4a7c-abfd-7e750a64e4c9 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:56.441154 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f6eae94f-5c40-4a7c-abfd-7e750a64e4c9 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:56.441787 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f6eae94f-5c40-4a7c-abfd-7e750a64e4c9 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:56.443803 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f6eae94f-5c40-4a7c-abfd-7e750a64e4c9 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:56.444541 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f6eae94f-5c40-4a7c-abfd-7e750a64e4c9 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:56.445129 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f6eae94f-5c40-4a7c-abfd-7e750a64e4c9 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:57.481366 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f6eae94f-5c40-4a7c-abfd-7e750a64e4c9 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:57.498509 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f6eae94f-5c40-4a7c-abfd-7e750a64e4c9 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea" status: 200 len: 1470 microversion: 2.1 time: 1.068831 Sep 23 04:36:57.499711 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 827/1583] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:56 2022] GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea => generated 1470 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:57.523914 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-94c36610-ab94-474c-a7ce-383d8e78453a tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:57.539624 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-94c36610-ab94-474c-a7ce-383d8e78453a tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.038548 Sep 23 04:36:57.542473 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 828/1584] 10.222.0.33 () {58 vars in 1137 bytes} [Fri Sep 23 04:36:57 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:36:57.561016 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-31631c32-48fb-47a7-a6de-ab229976cf17 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:57.561870 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-31631c32-48fb-47a7-a6de-ab229976cf17 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 4997661d-a262-4bfa-994f-3615df7a8180] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:57.578415 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-31631c32-48fb-47a7-a6de-ab229976cf17 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:57.580774 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-31631c32-48fb-47a7-a6de-ab229976cf17 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:57.582442 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-31631c32-48fb-47a7-a6de-ab229976cf17 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:57.584795 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-31631c32-48fb-47a7-a6de-ab229976cf17 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:57.585519 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-31631c32-48fb-47a7-a6de-ab229976cf17 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:57.588533 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-31631c32-48fb-47a7-a6de-ab229976cf17 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:57.917149 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-31631c32-48fb-47a7-a6de-ab229976cf17 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:57.925301 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-31631c32-48fb-47a7-a6de-ab229976cf17 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/4997661d-a262-4bfa-994f-3615df7a8180" status: 200 len: 1319 microversion: 2.1 time: 0.377259 Sep 23 04:36:57.939692 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 829/1585] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:57 2022] GET /compute/v2.1/servers/4997661d-a262-4bfa-994f-3615df7a8180 => generated 1319 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:36:57.951578 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1cdf487e-6f83-4616-9396-f8ba28839eeb tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:57.952269 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1cdf487e-6f83-4616-9396-f8ba28839eeb tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 9e9a41f2-ff28-4c2a-80aa-193e0ebce466] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:57.960416 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1cdf487e-6f83-4616-9396-f8ba28839eeb tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:57.960416 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1cdf487e-6f83-4616-9396-f8ba28839eeb tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:57.960416 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1cdf487e-6f83-4616-9396-f8ba28839eeb tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:57.961090 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1cdf487e-6f83-4616-9396-f8ba28839eeb tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:57.961594 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1cdf487e-6f83-4616-9396-f8ba28839eeb tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:57.962111 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1cdf487e-6f83-4616-9396-f8ba28839eeb tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:58.906750 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1cdf487e-6f83-4616-9396-f8ba28839eeb tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:58.922545 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1cdf487e-6f83-4616-9396-f8ba28839eeb tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:58.928974 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1cdf487e-6f83-4616-9396-f8ba28839eeb tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:36:58.932459 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1cdf487e-6f83-4616-9396-f8ba28839eeb tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466" status: 200 len: 1486 microversion: 2.25 time: 0.991461 Sep 23 04:36:58.942305 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 830/1586] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:36:57 2022] GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466 => generated 1486 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:36:58.951691 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-79c88b58-d275-468a-9df5-15d8ed874fd1 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:58.952451 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-79c88b58-d275-468a-9df5-15d8ed874fd1 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] [instance: f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:58.966659 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-79c88b58-d275-468a-9df5-15d8ed874fd1 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:58.967455 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-79c88b58-d275-468a-9df5-15d8ed874fd1 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:58.968108 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-79c88b58-d275-468a-9df5-15d8ed874fd1 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:58.969022 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-79c88b58-d275-468a-9df5-15d8ed874fd1 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:58.981635 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-79c88b58-d275-468a-9df5-15d8ed874fd1 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:58.981635 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-79c88b58-d275-468a-9df5-15d8ed874fd1 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:59.032128 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-79c88b58-d275-468a-9df5-15d8ed874fd1 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] [instance: f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b] Going to try to terminate instance {{(pid=122699) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:36:59.515296 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-79c88b58-d275-468a-9df5-15d8ed874fd1 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b" status: 204 len: 0 microversion: 2.1 time: 0.574475 Sep 23 04:36:59.516758 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 831/1587] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:36:58 2022] DELETE /compute/v2.1/servers/f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b => generated 0 bytes in 577 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:36:59.522788 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0dd43da7-9f30-432b-92fb-5a0bc8f72d89 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:59.523815 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-0dd43da7-9f30-432b-92fb-5a0bc8f72d89 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:59.541078 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0dd43da7-9f30-432b-92fb-5a0bc8f72d89 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:59.541940 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0dd43da7-9f30-432b-92fb-5a0bc8f72d89 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:59.542561 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0dd43da7-9f30-432b-92fb-5a0bc8f72d89 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:59.543504 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0dd43da7-9f30-432b-92fb-5a0bc8f72d89 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:59.544149 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0dd43da7-9f30-432b-92fb-5a0bc8f72d89 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:59.544763 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0dd43da7-9f30-432b-92fb-5a0bc8f72d89 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:59.621062 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7faa4593-d64b-44df-864d-6955228058c4 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9/action" status: 202 len: 0 microversion: 2.1 time: 5.875483 Sep 23 04:36:59.631853 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 757/1588] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:36:53 2022] POST /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9/action => generated 0 bytes in 5881 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:36:59.631853 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-d7ecbb66-ac0b-4cc9-8ac2-1ce66b95d412 req-acf5397a-3565-48fe-b356-67487551b73a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea", "name": "network-vif-unplugged", "status": "completed", "tag": "4270b6dd-6896-414f-8926-bc0f7819f6f7"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:36:59.664414 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-d7ecbb66-ac0b-4cc9-8ac2-1ce66b95d412 req-acf5397a-3565-48fe-b356-67487551b73a service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:59.664932 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-d7ecbb66-ac0b-4cc9-8ac2-1ce66b95d412 req-acf5397a-3565-48fe-b356-67487551b73a service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:59.666267 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-d7ecbb66-ac0b-4cc9-8ac2-1ce66b95d412 req-acf5397a-3565-48fe-b356-67487551b73a service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:59.685140 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-d7ecbb66-ac0b-4cc9-8ac2-1ce66b95d412 req-acf5397a-3565-48fe-b356-67487551b73a service nova] Creating event network-vif-unplugged:4270b6dd-6896-414f-8926-bc0f7819f6f7 for instance f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea on n-h2-846463-3 Sep 23 04:36:59.697301 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [req-d7ecbb66-ac0b-4cc9-8ac2-1ce66b95d412 req-acf5397a-3565-48fe-b356-67487551b73a service nova] Instance f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846463-3', 'n-h2-846463-3'} {{(pid=122698) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 23 04:36:59.724284 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-d7ecbb66-ac0b-4cc9-8ac2-1ce66b95d412 req-acf5397a-3565-48fe-b356-67487551b73a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.100612 Sep 23 04:36:59.725213 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 758/1589] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:36:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:36:59.742794 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e610529e-2308-41f5-b228-accf718327d0 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:36:59.744080 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e610529e-2308-41f5-b228-accf718327d0 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 4997661d-a262-4bfa-994f-3615df7a8180] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:36:59.754720 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e610529e-2308-41f5-b228-accf718327d0 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:59.756352 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e610529e-2308-41f5-b228-accf718327d0 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:59.763094 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e610529e-2308-41f5-b228-accf718327d0 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:36:59.764062 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e610529e-2308-41f5-b228-accf718327d0 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:36:59.764720 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e610529e-2308-41f5-b228-accf718327d0 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:36:59.765329 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e610529e-2308-41f5-b228-accf718327d0 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:00.417400 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-0dd43da7-9f30-432b-92fb-5a0bc8f72d89 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:00.433272 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0dd43da7-9f30-432b-92fb-5a0bc8f72d89 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea" status: 200 len: 1470 microversion: 2.1 time: 0.914723 Sep 23 04:37:00.439181 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 832/1590] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:59 2022] GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea => generated 1470 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:00.450996 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e9994a6c-67d9-4eb1-94c0-d579d90634e7 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:00.451154 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e9994a6c-67d9-4eb1-94c0-d579d90634e7 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] [instance: f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:00.463086 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e610529e-2308-41f5-b228-accf718327d0 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:00.471500 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e610529e-2308-41f5-b228-accf718327d0 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/4997661d-a262-4bfa-994f-3615df7a8180" status: 200 len: 1319 microversion: 2.1 time: 0.745155 Sep 23 04:37:00.490113 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 759/1591] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:36:59 2022] GET /compute/v2.1/servers/4997661d-a262-4bfa-994f-3615df7a8180 => generated 1319 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:00.502413 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b8f61075-6acb-4256-85b3-0a7a6013e87e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:00.506336 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b8f61075-6acb-4256-85b3-0a7a6013e87e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: 04e9b262-d9e0-434a-bcbb-a85ef9180ee9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:00.508653 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e9994a6c-67d9-4eb1-94c0-d579d90634e7 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:00.513301 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e9994a6c-67d9-4eb1-94c0-d579d90634e7 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:00.514654 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e9994a6c-67d9-4eb1-94c0-d579d90634e7 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:00.516564 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e9994a6c-67d9-4eb1-94c0-d579d90634e7 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:00.517762 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b8f61075-6acb-4256-85b3-0a7a6013e87e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:00.518320 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b8f61075-6acb-4256-85b3-0a7a6013e87e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:00.518767 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b8f61075-6acb-4256-85b3-0a7a6013e87e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:00.518924 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e9994a6c-67d9-4eb1-94c0-d579d90634e7 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:00.519503 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e9994a6c-67d9-4eb1-94c0-d579d90634e7 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:00.531177 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b8f61075-6acb-4256-85b3-0a7a6013e87e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:00.531988 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b8f61075-6acb-4256-85b3-0a7a6013e87e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:00.532612 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b8f61075-6acb-4256-85b3-0a7a6013e87e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:00.915416 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b8f61075-6acb-4256-85b3-0a7a6013e87e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:00.932596 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b8f61075-6acb-4256-85b3-0a7a6013e87e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9" status: 200 len: 1719 microversion: 2.1 time: 0.441040 Sep 23 04:37:00.938288 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 760/1592] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:00 2022] GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9 => generated 1719 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:00.950192 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-995f5ffd-6242-4ff3-9f88-a0bb864f91db tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:00.950826 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-995f5ffd-6242-4ff3-9f88-a0bb864f91db tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 9e9a41f2-ff28-4c2a-80aa-193e0ebce466] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:00.972583 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-995f5ffd-6242-4ff3-9f88-a0bb864f91db tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:00.973090 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-995f5ffd-6242-4ff3-9f88-a0bb864f91db tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:00.973576 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-995f5ffd-6242-4ff3-9f88-a0bb864f91db tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:00.977117 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-995f5ffd-6242-4ff3-9f88-a0bb864f91db tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:00.977833 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-995f5ffd-6242-4ff3-9f88-a0bb864f91db tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:00.981810 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-995f5ffd-6242-4ff3-9f88-a0bb864f91db tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:01.019929 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e9994a6c-67d9-4eb1-94c0-d579d90634e7 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c977d0e2ec64f8ca6b0923b9876c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f661d071bed2459cba4aa91e2b8b0d28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:01.043527 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e9994a6c-67d9-4eb1-94c0-d579d90634e7 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] 10.222.0.33 "GET /compute/v2.1/servers/f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b" status: 200 len: 1608 microversion: 2.1 time: 0.603580 Sep 23 04:37:01.064408 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 833/1593] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:00 2022] GET /compute/v2.1/servers/f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b => generated 1608 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:01.082093 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e9994a6c-67d9-4eb1-94c0-d579d90634e7 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:01.082093 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e9994a6c-67d9-4eb1-94c0-d579d90634e7 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] 10.222.0.33 "GET /compute//" status: 200 len: 377 microversion: - time: 0.004975 Sep 23 04:37:01.082093 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 834/1594] 10.222.0.33 () {56 vars in 886 bytes} [Fri Sep 23 04:37:01 2022] GET /compute/ => generated 377 bytes in 8 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 23 04:37:01.364643 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-995f5ffd-6242-4ff3-9f88-a0bb864f91db tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:01.387960 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-995f5ffd-6242-4ff3-9f88-a0bb864f91db tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:01.390044 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-995f5ffd-6242-4ff3-9f88-a0bb864f91db tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:01.391848 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-995f5ffd-6242-4ff3-9f88-a0bb864f91db tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466" status: 200 len: 1486 microversion: 2.25 time: 0.452357 Sep 23 04:37:01.396225 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 761/1595] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:37:00 2022] GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466 => generated 1486 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:37:01.466449 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-80ed69a5-a85f-40d8-b9fb-e0a2824763f0 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:01.468049 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-80ed69a5-a85f-40d8-b9fb-e0a2824763f0 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:01.485770 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-80ed69a5-a85f-40d8-b9fb-e0a2824763f0 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:01.489013 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-80ed69a5-a85f-40d8-b9fb-e0a2824763f0 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:01.490370 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-80ed69a5-a85f-40d8-b9fb-e0a2824763f0 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:01.492253 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-80ed69a5-a85f-40d8-b9fb-e0a2824763f0 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:01.493965 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-80ed69a5-a85f-40d8-b9fb-e0a2824763f0 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:01.497882 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-80ed69a5-a85f-40d8-b9fb-e0a2824763f0 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:01.504966 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-920a5d34-c1d6-47c8-81f5-93b53951be8e tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:01.506122 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-920a5d34-c1d6-47c8-81f5-93b53951be8e tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 4997661d-a262-4bfa-994f-3615df7a8180] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:01.522201 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-920a5d34-c1d6-47c8-81f5-93b53951be8e tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:01.526155 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-920a5d34-c1d6-47c8-81f5-93b53951be8e tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:01.527238 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-920a5d34-c1d6-47c8-81f5-93b53951be8e tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:01.532950 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-920a5d34-c1d6-47c8-81f5-93b53951be8e tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:01.534416 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-920a5d34-c1d6-47c8-81f5-93b53951be8e tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:01.536674 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-920a5d34-c1d6-47c8-81f5-93b53951be8e tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:02.059607 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-80ed69a5-a85f-40d8-b9fb-e0a2824763f0 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:02.109586 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-920a5d34-c1d6-47c8-81f5-93b53951be8e tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:02.110774 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-80ed69a5-a85f-40d8-b9fb-e0a2824763f0 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea" status: 200 len: 1470 microversion: 2.1 time: 0.652529 Sep 23 04:37:02.113309 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 835/1596] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:01 2022] GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea => generated 1470 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:02.121776 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-920a5d34-c1d6-47c8-81f5-93b53951be8e tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/4997661d-a262-4bfa-994f-3615df7a8180" status: 200 len: 1319 microversion: 2.1 time: 0.621033 Sep 23 04:37:02.124202 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 762/1597] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:01 2022] GET /compute/v2.1/servers/4997661d-a262-4bfa-994f-3615df7a8180 => generated 1319 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:02.136236 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-52323c3a-6957-4b47-9497-43736c505dc0 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:02.137373 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-52323c3a-6957-4b47-9497-43736c505dc0 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: 04e9b262-d9e0-434a-bcbb-a85ef9180ee9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:02.143296 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-8734079c-bc02-41a9-8cdc-146dc1ff4e6a req-d6c50cec-94d5-4407-bb00-32fd21d09027 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea", "tag": "4270b6dd-6896-414f-8926-bc0f7819f6f7"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:37:02.147657 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-52323c3a-6957-4b47-9497-43736c505dc0 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:02.148407 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-52323c3a-6957-4b47-9497-43736c505dc0 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:02.149076 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-52323c3a-6957-4b47-9497-43736c505dc0 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:02.151618 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-52323c3a-6957-4b47-9497-43736c505dc0 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:02.152442 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-52323c3a-6957-4b47-9497-43736c505dc0 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:02.153109 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-52323c3a-6957-4b47-9497-43736c505dc0 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:02.168974 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-8734079c-bc02-41a9-8cdc-146dc1ff4e6a req-d6c50cec-94d5-4407-bb00-32fd21d09027 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:02.174385 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-8734079c-bc02-41a9-8cdc-146dc1ff4e6a req-d6c50cec-94d5-4407-bb00-32fd21d09027 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:02.175397 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-8734079c-bc02-41a9-8cdc-146dc1ff4e6a req-d6c50cec-94d5-4407-bb00-32fd21d09027 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:02.208859 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-8734079c-bc02-41a9-8cdc-146dc1ff4e6a req-d6c50cec-94d5-4407-bb00-32fd21d09027 service nova] Creating event network-changed:4270b6dd-6896-414f-8926-bc0f7819f6f7 for instance f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea on n-h2-846463-3 Sep 23 04:37:02.221259 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [req-8734079c-bc02-41a9-8cdc-146dc1ff4e6a req-d6c50cec-94d5-4407-bb00-32fd21d09027 service nova] Instance f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846463-3', 'n-h2-846463-3'} {{(pid=122699) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 23 04:37:02.252120 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-8734079c-bc02-41a9-8cdc-146dc1ff4e6a req-d6c50cec-94d5-4407-bb00-32fd21d09027 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135684 Sep 23 04:37:02.255589 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 836/1598] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:37:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:37:02.272443 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-abbeec1d-882a-42d3-a173-f361580d6b2a tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:02.279219 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-abbeec1d-882a-42d3-a173-f361580d6b2a tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] [instance: f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:02.291508 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-abbeec1d-882a-42d3-a173-f361580d6b2a tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:02.294144 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-abbeec1d-882a-42d3-a173-f361580d6b2a tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:02.294789 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-abbeec1d-882a-42d3-a173-f361580d6b2a tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:02.297993 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-abbeec1d-882a-42d3-a173-f361580d6b2a tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:02.298832 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-abbeec1d-882a-42d3-a173-f361580d6b2a tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:02.302531 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-abbeec1d-882a-42d3-a173-f361580d6b2a tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:03.310889 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-52323c3a-6957-4b47-9497-43736c505dc0 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:03.314968 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-abbeec1d-882a-42d3-a173-f361580d6b2a tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c977d0e2ec64f8ca6b0923b9876c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f661d071bed2459cba4aa91e2b8b0d28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:03.338793 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-52323c3a-6957-4b47-9497-43736c505dc0 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9" status: 200 len: 1719 microversion: 2.1 time: 1.213330 Sep 23 04:37:03.346601 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 763/1599] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:02 2022] GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9 => generated 1719 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:03.348154 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-abbeec1d-882a-42d3-a173-f361580d6b2a tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] 10.222.0.33 "GET /compute/v2.1/servers/f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b" status: 200 len: 1608 microversion: 2.1 time: 1.087259 Sep 23 04:37:03.354132 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 837/1600] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:02 2022] GET /compute/v2.1/servers/f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b => generated 1608 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:03.363492 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-89c8fca5-fcde-44cc-bd3b-a206851e2570 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:03.367373 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-0203038b-8709-484e-8118-d1fb2b897a7e req-2595983e-59b1-4516-a371-b29dc8238fcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1058d2c6-a5c4-41f2-8b63-40079d80419c", "name": "network-vif-plugged", "status": "completed", "tag": "093fa6be-7b6f-4cd2-93e0-851baa75b110"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:37:03.375000 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-89c8fca5-fcde-44cc-bd3b-a206851e2570 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 9e9a41f2-ff28-4c2a-80aa-193e0ebce466] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:03.383038 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-0203038b-8709-484e-8118-d1fb2b897a7e req-2595983e-59b1-4516-a371-b29dc8238fcf service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:03.385048 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-0203038b-8709-484e-8118-d1fb2b897a7e req-2595983e-59b1-4516-a371-b29dc8238fcf service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:03.386180 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-0203038b-8709-484e-8118-d1fb2b897a7e req-2595983e-59b1-4516-a371-b29dc8238fcf service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:03.402321 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-0203038b-8709-484e-8118-d1fb2b897a7e req-2595983e-59b1-4516-a371-b29dc8238fcf service nova] Creating event network-vif-plugged:093fa6be-7b6f-4cd2-93e0-851baa75b110 for instance 1058d2c6-a5c4-41f2-8b63-40079d80419c on n-h2-846463-3 Sep 23 04:37:03.405167 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-89c8fca5-fcde-44cc-bd3b-a206851e2570 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:03.405969 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-89c8fca5-fcde-44cc-bd3b-a206851e2570 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:03.406426 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-89c8fca5-fcde-44cc-bd3b-a206851e2570 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:03.408397 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-0203038b-8709-484e-8118-d1fb2b897a7e req-2595983e-59b1-4516-a371-b29dc8238fcf service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052060 Sep 23 04:37:03.409633 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 838/1601] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:37:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:37:03.410939 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-89c8fca5-fcde-44cc-bd3b-a206851e2570 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:03.419910 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-89c8fca5-fcde-44cc-bd3b-a206851e2570 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:03.420650 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-89c8fca5-fcde-44cc-bd3b-a206851e2570 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:03.472025 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-90f7e047-ce1a-4c11-a471-09913cf6a240 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:03.473361 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-90f7e047-ce1a-4c11-a471-09913cf6a240 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:03.542097 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-90f7e047-ce1a-4c11-a471-09913cf6a240 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:03.546940 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-90f7e047-ce1a-4c11-a471-09913cf6a240 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:03.546940 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-90f7e047-ce1a-4c11-a471-09913cf6a240 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:03.546940 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-90f7e047-ce1a-4c11-a471-09913cf6a240 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:03.549082 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-90f7e047-ce1a-4c11-a471-09913cf6a240 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:03.549585 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-90f7e047-ce1a-4c11-a471-09913cf6a240 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:04.661699 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-89c8fca5-fcde-44cc-bd3b-a206851e2570 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:04.679513 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-89c8fca5-fcde-44cc-bd3b-a206851e2570 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:04.695338 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-89c8fca5-fcde-44cc-bd3b-a206851e2570 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:04.696697 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-89c8fca5-fcde-44cc-bd3b-a206851e2570 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466" status: 200 len: 1486 microversion: 2.25 time: 1.348158 Sep 23 04:37:04.698134 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 764/1602] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:37:03 2022] GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466 => generated 1486 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:37:04.715094 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-20129ac3-3e7b-4164-80a7-4b3d1b32011a tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:04.715094 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-20129ac3-3e7b-4164-80a7-4b3d1b32011a tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 4997661d-a262-4bfa-994f-3615df7a8180] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:04.723865 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-20129ac3-3e7b-4164-80a7-4b3d1b32011a tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:04.724386 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-20129ac3-3e7b-4164-80a7-4b3d1b32011a tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:04.724887 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-20129ac3-3e7b-4164-80a7-4b3d1b32011a tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:04.725993 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-20129ac3-3e7b-4164-80a7-4b3d1b32011a tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:04.726854 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-20129ac3-3e7b-4164-80a7-4b3d1b32011a tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:04.727508 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-20129ac3-3e7b-4164-80a7-4b3d1b32011a tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:04.829755 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-90f7e047-ce1a-4c11-a471-09913cf6a240 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:04.859319 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-90f7e047-ce1a-4c11-a471-09913cf6a240 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea" status: 200 len: 1470 microversion: 2.1 time: 1.447914 Sep 23 04:37:04.873732 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 839/1603] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:03 2022] GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea => generated 1470 bytes in 1455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:04.890818 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f9d7bcfb-23ea-4239-aceb-18f701ff05fd tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:04.891631 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f9d7bcfb-23ea-4239-aceb-18f701ff05fd tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] [instance: f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:04.908425 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f9d7bcfb-23ea-4239-aceb-18f701ff05fd tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:04.908928 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f9d7bcfb-23ea-4239-aceb-18f701ff05fd tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:04.909372 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f9d7bcfb-23ea-4239-aceb-18f701ff05fd tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:04.910120 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f9d7bcfb-23ea-4239-aceb-18f701ff05fd tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:04.910584 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f9d7bcfb-23ea-4239-aceb-18f701ff05fd tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:04.920560 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f9d7bcfb-23ea-4239-aceb-18f701ff05fd tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:04.984482 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=4 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:37:05.015206 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:37:05.882699 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f9d7bcfb-23ea-4239-aceb-18f701ff05fd tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c977d0e2ec64f8ca6b0923b9876c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f661d071bed2459cba4aa91e2b8b0d28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:05.895490 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f9d7bcfb-23ea-4239-aceb-18f701ff05fd tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] 10.222.0.33 "GET /compute/v2.1/servers/f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b" status: 200 len: 1608 microversion: 2.1 time: 1.028628 Sep 23 04:37:05.898277 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 840/1604] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:04 2022] GET /compute/v2.1/servers/f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b => generated 1608 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:05.934539 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-da69da32-9ecd-4812-92df-0365c15b899f tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:05.940356 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-da69da32-9ecd-4812-92df-0365c15b899f tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: 04e9b262-d9e0-434a-bcbb-a85ef9180ee9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:05.956186 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-da69da32-9ecd-4812-92df-0365c15b899f tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:05.958321 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-da69da32-9ecd-4812-92df-0365c15b899f tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:05.958798 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-da69da32-9ecd-4812-92df-0365c15b899f tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:05.961016 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-da69da32-9ecd-4812-92df-0365c15b899f tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:05.963230 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-da69da32-9ecd-4812-92df-0365c15b899f tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:05.964048 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-da69da32-9ecd-4812-92df-0365c15b899f tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:06.173258 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-20129ac3-3e7b-4164-80a7-4b3d1b32011a tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:06.185585 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-20129ac3-3e7b-4164-80a7-4b3d1b32011a tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/4997661d-a262-4bfa-994f-3615df7a8180" status: 200 len: 1319 microversion: 2.1 time: 1.485713 Sep 23 04:37:06.186239 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 765/1605] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:04 2022] GET /compute/v2.1/servers/4997661d-a262-4bfa-994f-3615df7a8180 => generated 1319 bytes in 1488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:06.237706 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0ec6680a-11a8-4aae-a545-830cb4f05953 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:06.238754 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-0ec6680a-11a8-4aae-a545-830cb4f05953 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 9e9a41f2-ff28-4c2a-80aa-193e0ebce466] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:06.273272 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0ec6680a-11a8-4aae-a545-830cb4f05953 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:06.284383 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0ec6680a-11a8-4aae-a545-830cb4f05953 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:06.285670 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0ec6680a-11a8-4aae-a545-830cb4f05953 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:06.286333 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0ec6680a-11a8-4aae-a545-830cb4f05953 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:06.286990 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0ec6680a-11a8-4aae-a545-830cb4f05953 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:06.293360 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0ec6680a-11a8-4aae-a545-830cb4f05953 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:06.776208 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-da69da32-9ecd-4812-92df-0365c15b899f tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:06.791731 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-da69da32-9ecd-4812-92df-0365c15b899f tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9" status: 200 len: 1719 microversion: 2.1 time: 0.886221 Sep 23 04:37:06.792919 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 841/1606] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:05 2022] GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9 => generated 1719 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:06.799097 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-89ad1379-8353-4963-ac8c-b682cb860ebc tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:06.799971 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-89ad1379-8353-4963-ac8c-b682cb860ebc tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:06.812079 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-89ad1379-8353-4963-ac8c-b682cb860ebc tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:06.813018 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-89ad1379-8353-4963-ac8c-b682cb860ebc tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:06.817922 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-89ad1379-8353-4963-ac8c-b682cb860ebc tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:06.822857 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-89ad1379-8353-4963-ac8c-b682cb860ebc tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:06.822857 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-89ad1379-8353-4963-ac8c-b682cb860ebc tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:06.822857 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-89ad1379-8353-4963-ac8c-b682cb860ebc tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:06.911760 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-0ec6680a-11a8-4aae-a545-830cb4f05953 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:06.928639 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-0ec6680a-11a8-4aae-a545-830cb4f05953 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:06.933780 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-0ec6680a-11a8-4aae-a545-830cb4f05953 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:06.938133 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0ec6680a-11a8-4aae-a545-830cb4f05953 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466" status: 200 len: 1486 microversion: 2.25 time: 0.719310 Sep 23 04:37:06.939297 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 766/1607] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:37:06 2022] GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466 => generated 1486 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:37:06.950550 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-4203561e-2ae7-4ee3-b95a-e0bb0c15af4b req-bd59655a-ab30-4ab9-809f-5b393eb31980 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4997661d-a262-4bfa-994f-3615df7a8180", "name": "network-vif-plugged", "status": "completed", "tag": "0721b7eb-714f-4781-bcd0-667c3afcaa9e"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:37:06.981335 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-4203561e-2ae7-4ee3-b95a-e0bb0c15af4b req-bd59655a-ab30-4ab9-809f-5b393eb31980 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:06.982323 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-4203561e-2ae7-4ee3-b95a-e0bb0c15af4b req-bd59655a-ab30-4ab9-809f-5b393eb31980 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:06.983537 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-4203561e-2ae7-4ee3-b95a-e0bb0c15af4b req-bd59655a-ab30-4ab9-809f-5b393eb31980 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:07.015307 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-4203561e-2ae7-4ee3-b95a-e0bb0c15af4b req-bd59655a-ab30-4ab9-809f-5b393eb31980 service nova] Creating event network-vif-plugged:0721b7eb-714f-4781-bcd0-667c3afcaa9e for instance 4997661d-a262-4bfa-994f-3615df7a8180 on n-h1-846463-3 Sep 23 04:37:07.027656 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-4203561e-2ae7-4ee3-b95a-e0bb0c15af4b req-bd59655a-ab30-4ab9-809f-5b393eb31980 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086420 Sep 23 04:37:07.028285 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 767/1608] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:37:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:37:07.033360 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-2b70f491-956c-48d7-8b4f-32549c7c6aae req-c4815547-9e43-4638-927d-82f4220e467b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b", "name": "network-vif-deleted", "tag": "9bfa56f7-d0ab-43c9-a2c9-14af449e0f1e"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:37:07.058555 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-2b70f491-956c-48d7-8b4f-32549c7c6aae req-c4815547-9e43-4638-927d-82f4220e467b service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:07.059050 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-2b70f491-956c-48d7-8b4f-32549c7c6aae req-c4815547-9e43-4638-927d-82f4220e467b service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:07.059497 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-2b70f491-956c-48d7-8b4f-32549c7c6aae req-c4815547-9e43-4638-927d-82f4220e467b service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:07.081601 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-2b70f491-956c-48d7-8b4f-32549c7c6aae req-c4815547-9e43-4638-927d-82f4220e467b service nova] Creating event network-vif-deleted:9bfa56f7-d0ab-43c9-a2c9-14af449e0f1e for instance f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b on n-h1-846463-3 Sep 23 04:37:07.094017 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-2b70f491-956c-48d7-8b4f-32549c7c6aae req-c4815547-9e43-4638-927d-82f4220e467b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064156 Sep 23 04:37:07.095162 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 768/1609] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:37:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:37:07.109073 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1444950d-4820-4c11-8a24-a107ff3798c8 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:07.110141 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-1444950d-4820-4c11-8a24-a107ff3798c8 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] [instance: f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:07.117330 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1444950d-4820-4c11-8a24-a107ff3798c8 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:07.123105 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1444950d-4820-4c11-8a24-a107ff3798c8 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:07.123105 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1444950d-4820-4c11-8a24-a107ff3798c8 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:07.123105 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1444950d-4820-4c11-8a24-a107ff3798c8 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:07.123105 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1444950d-4820-4c11-8a24-a107ff3798c8 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:07.123547 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1444950d-4820-4c11-8a24-a107ff3798c8 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:07.158538 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:37:07.268122 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-89ad1379-8353-4963-ac8c-b682cb860ebc tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:07.275840 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-1444950d-4820-4c11-8a24-a107ff3798c8 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c977d0e2ec64f8ca6b0923b9876c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f661d071bed2459cba4aa91e2b8b0d28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:07.287885 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-89ad1379-8353-4963-ac8c-b682cb860ebc tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea" status: 200 len: 1463 microversion: 2.1 time: 0.493209 Sep 23 04:37:07.290251 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-1444950d-4820-4c11-8a24-a107ff3798c8 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] 10.222.0.33 "GET /compute/v2.1/servers/f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b" status: 200 len: 1252 microversion: 2.1 time: 0.193643 Sep 23 04:37:07.291188 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 769/1610] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:07 2022] GET /compute/v2.1/servers/f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b => generated 1252 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:07.307466 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6c0b1892-7e26-43f9-a768-cfaf0c1e11fd tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:07.308851 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 842/1611] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:06 2022] GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea => generated 1463 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:07.311188 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-6c0b1892-7e26-43f9-a768-cfaf0c1e11fd tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 4997661d-a262-4bfa-994f-3615df7a8180] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:07.328743 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6c0b1892-7e26-43f9-a768-cfaf0c1e11fd tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:07.329260 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6c0b1892-7e26-43f9-a768-cfaf0c1e11fd tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:07.336890 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0c1f98dd-f0c1-4a84-8aa1-dd10c4f022d8 tempest-MigrationsAdminTest-295231043 tempest-MigrationsAdminTest-295231043-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:07.338217 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-0c1f98dd-f0c1-4a84-8aa1-dd10c4f022d8 tempest-MigrationsAdminTest-295231043 tempest-MigrationsAdminTest-295231043-project-admin] [instance: f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:07.338909 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6c0b1892-7e26-43f9-a768-cfaf0c1e11fd tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:07.343050 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6c0b1892-7e26-43f9-a768-cfaf0c1e11fd tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:07.344163 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6c0b1892-7e26-43f9-a768-cfaf0c1e11fd tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:07.344625 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6c0b1892-7e26-43f9-a768-cfaf0c1e11fd tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:07.348224 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0c1f98dd-f0c1-4a84-8aa1-dd10c4f022d8 tempest-MigrationsAdminTest-295231043 tempest-MigrationsAdminTest-295231043-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:07.350185 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0c1f98dd-f0c1-4a84-8aa1-dd10c4f022d8 tempest-MigrationsAdminTest-295231043 tempest-MigrationsAdminTest-295231043-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:07.351050 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0c1f98dd-f0c1-4a84-8aa1-dd10c4f022d8 tempest-MigrationsAdminTest-295231043 tempest-MigrationsAdminTest-295231043-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:07.353685 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0c1f98dd-f0c1-4a84-8aa1-dd10c4f022d8 tempest-MigrationsAdminTest-295231043 tempest-MigrationsAdminTest-295231043-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:07.355971 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0c1f98dd-f0c1-4a84-8aa1-dd10c4f022d8 tempest-MigrationsAdminTest-295231043 tempest-MigrationsAdminTest-295231043-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:07.357381 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0c1f98dd-f0c1-4a84-8aa1-dd10c4f022d8 tempest-MigrationsAdminTest-295231043 tempest-MigrationsAdminTest-295231043-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:08.261654 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0c1f98dd-f0c1-4a84-8aa1-dd10c4f022d8 tempest-MigrationsAdminTest-295231043 tempest-MigrationsAdminTest-295231043-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea" status: 200 len: 1614 microversion: 2.1 time: 0.931195 Sep 23 04:37:08.262320 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 843/1612] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:07 2022] GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea => generated 1614 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:08.277867 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-14e2ad4c-306d-49f3-ab51-e475e0cb9996 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:08.282566 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-14e2ad4c-306d-49f3-ab51-e475e0cb9996 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: 04e9b262-d9e0-434a-bcbb-a85ef9180ee9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:08.296707 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-14e2ad4c-306d-49f3-ab51-e475e0cb9996 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:08.297472 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-14e2ad4c-306d-49f3-ab51-e475e0cb9996 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:08.298223 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-14e2ad4c-306d-49f3-ab51-e475e0cb9996 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:08.299123 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-14e2ad4c-306d-49f3-ab51-e475e0cb9996 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:08.299762 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-14e2ad4c-306d-49f3-ab51-e475e0cb9996 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:08.300363 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-14e2ad4c-306d-49f3-ab51-e475e0cb9996 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:08.316769 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:37:08.631561 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-14e2ad4c-306d-49f3-ab51-e475e0cb9996 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:08.648646 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-14e2ad4c-306d-49f3-ab51-e475e0cb9996 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9" status: 200 len: 1719 microversion: 2.1 time: 0.382177 Sep 23 04:37:08.649295 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 844/1613] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:08 2022] GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9 => generated 1719 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:08.666201 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9f9658e0-23ab-44c6-a707-a9a339f527b8 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:08.667195 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-9f9658e0-23ab-44c6-a707-a9a339f527b8 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 9e9a41f2-ff28-4c2a-80aa-193e0ebce466] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:08.682416 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9f9658e0-23ab-44c6-a707-a9a339f527b8 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:08.682916 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9f9658e0-23ab-44c6-a707-a9a339f527b8 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:08.683368 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9f9658e0-23ab-44c6-a707-a9a339f527b8 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:08.688089 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9f9658e0-23ab-44c6-a707-a9a339f527b8 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:08.688594 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9f9658e0-23ab-44c6-a707-a9a339f527b8 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:08.689042 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9f9658e0-23ab-44c6-a707-a9a339f527b8 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:08.790545 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6c0b1892-7e26-43f9-a768-cfaf0c1e11fd tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:08.799863 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-6c0b1892-7e26-43f9-a768-cfaf0c1e11fd tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/4997661d-a262-4bfa-994f-3615df7a8180" status: 200 len: 1319 microversion: 2.1 time: 1.506168 Sep 23 04:37:08.814938 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 770/1614] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:07 2022] GET /compute/v2.1/servers/4997661d-a262-4bfa-994f-3615df7a8180 => generated 1319 bytes in 1522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:08.824928 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6552bf37-4880-4f49-a1a6-5e29b6674a85 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:08.825801 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-6552bf37-4880-4f49-a1a6-5e29b6674a85 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:08.842117 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6552bf37-4880-4f49-a1a6-5e29b6674a85 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:08.844795 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6552bf37-4880-4f49-a1a6-5e29b6674a85 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:08.845350 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6552bf37-4880-4f49-a1a6-5e29b6674a85 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:08.846261 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6552bf37-4880-4f49-a1a6-5e29b6674a85 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:08.854653 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6552bf37-4880-4f49-a1a6-5e29b6674a85 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:08.855568 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6552bf37-4880-4f49-a1a6-5e29b6674a85 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:08.914410 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-6552bf37-4880-4f49-a1a6-5e29b6674a85 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea] Going to try to terminate instance {{(pid=122698) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:37:09.146809 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-9f9658e0-23ab-44c6-a707-a9a339f527b8 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:09.159791 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-9f9658e0-23ab-44c6-a707-a9a339f527b8 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:09.161872 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-9f9658e0-23ab-44c6-a707-a9a339f527b8 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:09.163330 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-9f9658e0-23ab-44c6-a707-a9a339f527b8 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466" status: 200 len: 1486 microversion: 2.25 time: 0.501559 Sep 23 04:37:09.175560 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 845/1615] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:37:08 2022] GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466 => generated 1486 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:37:09.192603 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a50a120f-2700-4d9a-8e7b-b294ff0d9119 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:09.194196 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a50a120f-2700-4d9a-8e7b-b294ff0d9119 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] [instance: f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:09.208091 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a50a120f-2700-4d9a-8e7b-b294ff0d9119 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:09.208771 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a50a120f-2700-4d9a-8e7b-b294ff0d9119 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:09.209636 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a50a120f-2700-4d9a-8e7b-b294ff0d9119 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:09.213446 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a50a120f-2700-4d9a-8e7b-b294ff0d9119 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:09.214141 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a50a120f-2700-4d9a-8e7b-b294ff0d9119 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:09.219864 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a50a120f-2700-4d9a-8e7b-b294ff0d9119 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:09.320523 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-6552bf37-4880-4f49-a1a6-5e29b6674a85 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea" status: 204 len: 0 microversion: 2.1 time: 0.503772 Sep 23 04:37:09.321428 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 771/1616] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:37:08 2022] DELETE /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea => generated 0 bytes in 505 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:37:09.326586 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-75b6d9e2-1600-4dfa-8c42-294159394941 req-242cdfb4-8989-4e4a-aa3a-25315f9785ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea", "name": "network-vif-plugged", "status": "completed", "tag": "4270b6dd-6896-414f-8926-bc0f7819f6f7"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:37:09.353882 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-75b6d9e2-1600-4dfa-8c42-294159394941 req-242cdfb4-8989-4e4a-aa3a-25315f9785ff service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:09.354398 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-75b6d9e2-1600-4dfa-8c42-294159394941 req-242cdfb4-8989-4e4a-aa3a-25315f9785ff service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:09.355318 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-75b6d9e2-1600-4dfa-8c42-294159394941 req-242cdfb4-8989-4e4a-aa3a-25315f9785ff service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:09.366570 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a50a120f-2700-4d9a-8e7b-b294ff0d9119 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c977d0e2ec64f8ca6b0923b9876c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f661d071bed2459cba4aa91e2b8b0d28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:09.367399 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-75b6d9e2-1600-4dfa-8c42-294159394941 req-242cdfb4-8989-4e4a-aa3a-25315f9785ff service nova] Creating event network-vif-plugged:4270b6dd-6896-414f-8926-bc0f7819f6f7 for instance f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea on n-h2-846463-3 Sep 23 04:37:09.382838 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a50a120f-2700-4d9a-8e7b-b294ff0d9119 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] 10.222.0.33 "GET /compute/v2.1/servers/f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b" status: 200 len: 1252 microversion: 2.1 time: 0.205050 Sep 23 04:37:09.402053 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-75b6d9e2-1600-4dfa-8c42-294159394941 req-242cdfb4-8989-4e4a-aa3a-25315f9785ff service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060674 Sep 23 04:37:09.402366 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 846/1617] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:09 2022] GET /compute/v2.1/servers/f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b => generated 1252 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:09.402461 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 772/1618] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:37:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:37:09.402547 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-e73c6ba1-7971-4ee4-a8e7-90860927bad0 req-0c49c832-12a8-4b90-84f8-b1e04a411dff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e9a41f2-ff28-4c2a-80aa-193e0ebce466", "name": "network-vif-unplugged", "status": "completed", "tag": "11d5e398-f101-4c1d-8d16-8553226b7947"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:37:09.402645 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ac40a0ca-161c-4e39-88e4-a77293ca5de8 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Action: 'create', calling method: .version_select at 0x7ff1bbbe5280>, body: {"keypair": {"name": "tempest-keypair-2111355749", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIgfa8kcK0gUl/vfSHqJGftfr4JtTKYZWu+TpLNVLKeLuGENVkRjucrvXlraJ0a8LEw+SY48EU0sxGqzRiUXPBlpwvXIExJjzRiX+shDzJUI7O77qa6tJ6WEnHfS/WMwbg=="}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:37:09.410217 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-e73c6ba1-7971-4ee4-a8e7-90860927bad0 req-0c49c832-12a8-4b90-84f8-b1e04a411dff service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:09.411282 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-e73c6ba1-7971-4ee4-a8e7-90860927bad0 req-0c49c832-12a8-4b90-84f8-b1e04a411dff service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:09.411746 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-e73c6ba1-7971-4ee4-a8e7-90860927bad0 req-0c49c832-12a8-4b90-84f8-b1e04a411dff service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:09.423868 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-ac40a0ca-161c-4e39-88e4-a77293ca5de8 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Getting quotas for project 9c853e6ab59d45c084f6f7349f3ef87c. Resources: {'key_pairs'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:37:09.429519 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-ac40a0ca-161c-4e39-88e4-a77293ca5de8 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Getting quotas for user 99d8fe44ad7c412d8629159f7529ba81 and project 9c853e6ab59d45c084f6f7349f3ef87c. Resources: {'key_pairs'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:37:09.440066 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-e73c6ba1-7971-4ee4-a8e7-90860927bad0 req-0c49c832-12a8-4b90-84f8-b1e04a411dff service nova] Creating event network-vif-unplugged:11d5e398-f101-4c1d-8d16-8553226b7947 for instance 9e9a41f2-ff28-4c2a-80aa-193e0ebce466 on n-h1-846463-3 Sep 23 04:37:09.448965 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-e73c6ba1-7971-4ee4-a8e7-90860927bad0 req-0c49c832-12a8-4b90-84f8-b1e04a411dff service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.064003 Sep 23 04:37:09.455193 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 847/1619] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:37:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:37:09.466046 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-90254286-e200-4e87-a966-4e8cae8c3750 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:09.466792 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-90254286-e200-4e87-a966-4e8cae8c3750 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:09.481880 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-90254286-e200-4e87-a966-4e8cae8c3750 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:09.482413 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-90254286-e200-4e87-a966-4e8cae8c3750 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:09.482871 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-90254286-e200-4e87-a966-4e8cae8c3750 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:09.483603 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-90254286-e200-4e87-a966-4e8cae8c3750 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:09.487324 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-90254286-e200-4e87-a966-4e8cae8c3750 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:09.487769 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-90254286-e200-4e87-a966-4e8cae8c3750 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:09.524719 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ac40a0ca-161c-4e39-88e4-a77293ca5de8 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.139081 Sep 23 04:37:09.525596 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 773/1620] 10.222.0.33 () {62 vars in 1200 bytes} [Fri Sep 23 04:37:09 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 141 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 23 04:37:09.676100 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1fef4288-89c3-4e80-8b42-99be6958c76d tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:09.678027 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-1fef4288-89c3-4e80-8b42-99be6958c76d tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: 04e9b262-d9e0-434a-bcbb-a85ef9180ee9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:09.688459 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1fef4288-89c3-4e80-8b42-99be6958c76d tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:09.688960 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1fef4288-89c3-4e80-8b42-99be6958c76d tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:09.689415 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1fef4288-89c3-4e80-8b42-99be6958c76d tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:09.691862 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1fef4288-89c3-4e80-8b42-99be6958c76d tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:09.694356 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1fef4288-89c3-4e80-8b42-99be6958c76d tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:09.697946 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1fef4288-89c3-4e80-8b42-99be6958c76d tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:09.904450 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-90254286-e200-4e87-a966-4e8cae8c3750 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:09.913513 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-90254286-e200-4e87-a966-4e8cae8c3750 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea" status: 200 len: 1469 microversion: 2.1 time: 0.456860 Sep 23 04:37:09.930194 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 848/1621] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:09 2022] GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea => generated 1469 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:09.930720 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2844294d-058b-46c5-b290-370dc8d4edc2 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:09.931630 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-2844294d-058b-46c5-b290-370dc8d4edc2 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 4997661d-a262-4bfa-994f-3615df7a8180] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:09.946520 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2844294d-058b-46c5-b290-370dc8d4edc2 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:09.947596 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2844294d-058b-46c5-b290-370dc8d4edc2 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:09.948460 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2844294d-058b-46c5-b290-370dc8d4edc2 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:09.949305 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2844294d-058b-46c5-b290-370dc8d4edc2 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:09.949878 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2844294d-058b-46c5-b290-370dc8d4edc2 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:09.950465 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2844294d-058b-46c5-b290-370dc8d4edc2 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:10.096478 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-1fef4288-89c3-4e80-8b42-99be6958c76d tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:10.110405 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-1fef4288-89c3-4e80-8b42-99be6958c76d tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9" status: 200 len: 1719 microversion: 2.1 time: 0.438811 Sep 23 04:37:10.111002 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 774/1622] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:09 2022] GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9 => generated 1719 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:10.203261 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ad76af52-9cd2-4a5f-8816-d1b4702afc0d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:10.203885 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-ad76af52-9cd2-4a5f-8816-d1b4702afc0d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 9e9a41f2-ff28-4c2a-80aa-193e0ebce466] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:10.213833 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ad76af52-9cd2-4a5f-8816-d1b4702afc0d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:10.214351 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ad76af52-9cd2-4a5f-8816-d1b4702afc0d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:10.221498 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ad76af52-9cd2-4a5f-8816-d1b4702afc0d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:10.222720 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ad76af52-9cd2-4a5f-8816-d1b4702afc0d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:10.223887 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ad76af52-9cd2-4a5f-8816-d1b4702afc0d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:10.224514 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ad76af52-9cd2-4a5f-8816-d1b4702afc0d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:10.473849 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2844294d-058b-46c5-b290-370dc8d4edc2 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:10.516929 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2844294d-058b-46c5-b290-370dc8d4edc2 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/4997661d-a262-4bfa-994f-3615df7a8180" status: 200 len: 1469 microversion: 2.1 time: 0.601582 Sep 23 04:37:10.536853 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 849/1623] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:09 2022] GET /compute/v2.1/servers/4997661d-a262-4bfa-994f-3615df7a8180 => generated 1469 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:10.562025 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0c0c6316-b7e3-4180-97c9-db01bfd2b287 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:10.564990 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-0c0c6316-b7e3-4180-97c9-db01bfd2b287 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] [instance: f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:10.580598 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0c0c6316-b7e3-4180-97c9-db01bfd2b287 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:10.583910 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0c0c6316-b7e3-4180-97c9-db01bfd2b287 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:10.584699 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0c0c6316-b7e3-4180-97c9-db01bfd2b287 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:10.586857 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0c0c6316-b7e3-4180-97c9-db01bfd2b287 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:10.587348 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0c0c6316-b7e3-4180-97c9-db01bfd2b287 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:10.590055 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0c0c6316-b7e3-4180-97c9-db01bfd2b287 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:10.656024 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ad76af52-9cd2-4a5f-8816-d1b4702afc0d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:10.666814 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ad76af52-9cd2-4a5f-8816-d1b4702afc0d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:10.667308 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ad76af52-9cd2-4a5f-8816-d1b4702afc0d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:10.674858 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ad76af52-9cd2-4a5f-8816-d1b4702afc0d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466" status: 200 len: 1486 microversion: 2.25 time: 0.476480 Sep 23 04:37:10.698288 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 775/1624] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:37:10 2022] GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466 => generated 1486 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:37:10.710447 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-532401dc-08d2-4413-8eb3-66bd94869138 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:10.711174 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-532401dc-08d2-4413-8eb3-66bd94869138 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 1058d2c6-a5c4-41f2-8b63-40079d80419c] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:10.729500 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-532401dc-08d2-4413-8eb3-66bd94869138 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:10.730404 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-0c0c6316-b7e3-4180-97c9-db01bfd2b287 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c977d0e2ec64f8ca6b0923b9876c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f661d071bed2459cba4aa91e2b8b0d28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:10.730577 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-532401dc-08d2-4413-8eb3-66bd94869138 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:10.731059 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-532401dc-08d2-4413-8eb3-66bd94869138 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:10.732032 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-532401dc-08d2-4413-8eb3-66bd94869138 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:10.732722 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-532401dc-08d2-4413-8eb3-66bd94869138 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:10.733379 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-532401dc-08d2-4413-8eb3-66bd94869138 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:10.750012 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0c0c6316-b7e3-4180-97c9-db01bfd2b287 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] 10.222.0.33 "GET /compute/v2.1/servers/f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b" status: 200 len: 1252 microversion: 2.1 time: 0.211818 Sep 23 04:37:10.752232 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 850/1625] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:10 2022] GET /compute/v2.1/servers/f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b => generated 1252 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:10.942007 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-606cee6a-cf7d-46f5-ab6f-3688f776d557 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:10.942828 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-606cee6a-cf7d-46f5-ab6f-3688f776d557 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:10.956302 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-606cee6a-cf7d-46f5-ab6f-3688f776d557 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:10.957087 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-606cee6a-cf7d-46f5-ab6f-3688f776d557 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:10.957754 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-606cee6a-cf7d-46f5-ab6f-3688f776d557 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:10.958682 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-606cee6a-cf7d-46f5-ab6f-3688f776d557 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:10.960283 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-606cee6a-cf7d-46f5-ab6f-3688f776d557 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:10.960283 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-606cee6a-cf7d-46f5-ab6f-3688f776d557 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:11.021635 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-532401dc-08d2-4413-8eb3-66bd94869138 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:11.034808 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-532401dc-08d2-4413-8eb3-66bd94869138 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/1058d2c6-a5c4-41f2-8b63-40079d80419c" status: 200 len: 1469 microversion: 2.1 time: 0.330716 Sep 23 04:37:11.047903 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 776/1626] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:10 2022] GET /compute/v2.1/servers/1058d2c6-a5c4-41f2-8b63-40079d80419c => generated 1469 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:11.060895 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4ab37d23-def0-40c0-aca7-3436bebda067 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:11.066981 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4ab37d23-def0-40c0-aca7-3436bebda067 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:11.068275 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4ab37d23-def0-40c0-aca7-3436bebda067 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Searching by: {'reservation_id': 'r-0ul0d0or', 'deleted': False, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4'} {{(pid=122698) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 04:37:11.074381 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4ab37d23-def0-40c0-aca7-3436bebda067 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:11.075184 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4ab37d23-def0-40c0-aca7-3436bebda067 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:11.075886 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4ab37d23-def0-40c0-aca7-3436bebda067 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:11.076857 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4ab37d23-def0-40c0-aca7-3436bebda067 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:11.077772 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4ab37d23-def0-40c0-aca7-3436bebda067 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:11.077944 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4ab37d23-def0-40c0-aca7-3436bebda067 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:11.213177 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-606cee6a-cf7d-46f5-ab6f-3688f776d557 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:11.225560 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-606cee6a-cf7d-46f5-ab6f-3688f776d557 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea" status: 200 len: 1469 microversion: 2.1 time: 0.288695 Sep 23 04:37:11.227796 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 851/1627] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:10 2022] GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea => generated 1469 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:37:11.241106 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-64780b0d-70a6-49e3-b40f-28b80dcc8ee7 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:11.241694 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-64780b0d-70a6-49e3-b40f-28b80dcc8ee7 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: 04e9b262-d9e0-434a-bcbb-a85ef9180ee9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:11.246096 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.multi_cell_list [None req-4ab37d23-def0-40c0-aca7-3436bebda067 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122698) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 23 04:37:11.259411 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-64780b0d-70a6-49e3-b40f-28b80dcc8ee7 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:11.259984 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-64780b0d-70a6-49e3-b40f-28b80dcc8ee7 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:11.260439 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-64780b0d-70a6-49e3-b40f-28b80dcc8ee7 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:11.261865 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-64780b0d-70a6-49e3-b40f-28b80dcc8ee7 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:11.262363 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-64780b0d-70a6-49e3-b40f-28b80dcc8ee7 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:11.262803 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-64780b0d-70a6-49e3-b40f-28b80dcc8ee7 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:11.371942 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4ab37d23-def0-40c0-aca7-3436bebda067 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:11.381838 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4ab37d23-def0-40c0-aca7-3436bebda067 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:11.382556 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4ab37d23-def0-40c0-aca7-3436bebda067 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:11.383106 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4ab37d23-def0-40c0-aca7-3436bebda067 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:11.589640 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-64780b0d-70a6-49e3-b40f-28b80dcc8ee7 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:11.599786 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-64780b0d-70a6-49e3-b40f-28b80dcc8ee7 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9" status: 200 len: 1719 microversion: 2.1 time: 0.370907 Sep 23 04:37:11.603603 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 852/1628] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:11 2022] GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9 => generated 1719 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:11.610018 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-4be581ac-98d3-4210-a44e-10bdc3e07958 req-e628f377-c945-43a9-b9fc-7b77c6a08796 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e9a41f2-ff28-4c2a-80aa-193e0ebce466", "tag": "11d5e398-f101-4c1d-8d16-8553226b7947"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:37:11.629132 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4ab37d23-def0-40c0-aca7-3436bebda067 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/detail?reservation_id=r-0ul0d0or" status: 200 len: 2931 microversion: 2.1 time: 0.572298 Sep 23 04:37:11.630297 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 777/1629] 10.222.0.33 () {58 vars in 1197 bytes} [Fri Sep 23 04:37:11 2022] GET /compute/v2.1/servers/detail?reservation_id=r-0ul0d0or => generated 2931 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:37:11.633370 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-4be581ac-98d3-4210-a44e-10bdc3e07958 req-e628f377-c945-43a9-b9fc-7b77c6a08796 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:11.633862 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-4be581ac-98d3-4210-a44e-10bdc3e07958 req-e628f377-c945-43a9-b9fc-7b77c6a08796 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:11.634324 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-4be581ac-98d3-4210-a44e-10bdc3e07958 req-e628f377-c945-43a9-b9fc-7b77c6a08796 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:11.658459 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c9333dc5-f49e-43d7-9349-977cf32bfc7c tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:11.675805 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-4be581ac-98d3-4210-a44e-10bdc3e07958 req-e628f377-c945-43a9-b9fc-7b77c6a08796 service nova] Creating event network-changed:11d5e398-f101-4c1d-8d16-8553226b7947 for instance 9e9a41f2-ff28-4c2a-80aa-193e0ebce466 on n-h1-846463-3 Sep 23 04:37:11.692743 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-4be581ac-98d3-4210-a44e-10bdc3e07958 req-e628f377-c945-43a9-b9fc-7b77c6a08796 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085660 Sep 23 04:37:11.694717 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 853/1630] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:37:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:37:11.708471 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3d041576-cd76-49a0-ad72-4e20e04bbf09 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:11.718134 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-3d041576-cd76-49a0-ad72-4e20e04bbf09 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 9e9a41f2-ff28-4c2a-80aa-193e0ebce466] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:11.724897 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3d041576-cd76-49a0-ad72-4e20e04bbf09 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:11.725643 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3d041576-cd76-49a0-ad72-4e20e04bbf09 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:11.726659 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3d041576-cd76-49a0-ad72-4e20e04bbf09 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:11.727763 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3d041576-cd76-49a0-ad72-4e20e04bbf09 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:11.728477 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3d041576-cd76-49a0-ad72-4e20e04bbf09 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:11.729412 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3d041576-cd76-49a0-ad72-4e20e04bbf09 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:11.737377 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.compute.server_groups [None req-c9333dc5-f49e-43d7-9349-977cf32bfc7c tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Querying cell feac528b-4983-4e61-aae7-f1973fe5bc2c(cell1) for 2 instances {{(pid=122698) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 23 04:37:11.751229 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c9333dc5-f49e-43d7-9349-977cf32bfc7c tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:11.751229 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c9333dc5-f49e-43d7-9349-977cf32bfc7c tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:11.751229 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c9333dc5-f49e-43d7-9349-977cf32bfc7c tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:11.801727 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c9333dc5-f49e-43d7-9349-977cf32bfc7c tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/os-server-groups/c508385a-c6e2-44c7-a8ab-02b03657d36e" status: 200 len: 271 microversion: 2.1 time: 0.146979 Sep 23 04:37:11.802736 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 778/1631] 10.222.0.33 () {58 vars in 1263 bytes} [Fri Sep 23 04:37:11 2022] GET /compute/v2.1/os-server-groups/c508385a-c6e2-44c7-a8ab-02b03657d36e => generated 271 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:37:11.814933 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-bb2d3445-4efa-440b-92c1-580d9c8ff631 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:11.815641 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-bb2d3445-4efa-440b-92c1-580d9c8ff631 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] [instance: f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:11.840822 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bb2d3445-4efa-440b-92c1-580d9c8ff631 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:11.841324 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bb2d3445-4efa-440b-92c1-580d9c8ff631 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:11.841835 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bb2d3445-4efa-440b-92c1-580d9c8ff631 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:11.842590 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bb2d3445-4efa-440b-92c1-580d9c8ff631 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:11.843048 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bb2d3445-4efa-440b-92c1-580d9c8ff631 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:11.843693 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bb2d3445-4efa-440b-92c1-580d9c8ff631 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:12.078309 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-bb2d3445-4efa-440b-92c1-580d9c8ff631 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c977d0e2ec64f8ca6b0923b9876c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f661d071bed2459cba4aa91e2b8b0d28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:12.091330 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-bb2d3445-4efa-440b-92c1-580d9c8ff631 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] 10.222.0.33 "GET /compute/v2.1/servers/f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b" status: 200 len: 1252 microversion: 2.1 time: 0.285793 Sep 23 04:37:12.112156 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 779/1632] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:11 2022] GET /compute/v2.1/servers/f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b => generated 1252 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:12.134342 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-55001e1a-55e6-4717-a3fe-7b17cf33ca70 tempest-ServersOnMultiNodesTest-617918424 tempest-ServersOnMultiNodesTest-617918424-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:12.141041 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-55001e1a-55e6-4717-a3fe-7b17cf33ca70 tempest-ServersOnMultiNodesTest-617918424 tempest-ServersOnMultiNodesTest-617918424-project-admin] [instance: 4997661d-a262-4bfa-994f-3615df7a8180] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:12.172597 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-55001e1a-55e6-4717-a3fe-7b17cf33ca70 tempest-ServersOnMultiNodesTest-617918424 tempest-ServersOnMultiNodesTest-617918424-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:12.174864 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-55001e1a-55e6-4717-a3fe-7b17cf33ca70 tempest-ServersOnMultiNodesTest-617918424 tempest-ServersOnMultiNodesTest-617918424-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:12.180337 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-55001e1a-55e6-4717-a3fe-7b17cf33ca70 tempest-ServersOnMultiNodesTest-617918424 tempest-ServersOnMultiNodesTest-617918424-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:12.180337 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-55001e1a-55e6-4717-a3fe-7b17cf33ca70 tempest-ServersOnMultiNodesTest-617918424 tempest-ServersOnMultiNodesTest-617918424-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:12.182676 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-55001e1a-55e6-4717-a3fe-7b17cf33ca70 tempest-ServersOnMultiNodesTest-617918424 tempest-ServersOnMultiNodesTest-617918424-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:12.184859 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-55001e1a-55e6-4717-a3fe-7b17cf33ca70 tempest-ServersOnMultiNodesTest-617918424 tempest-ServersOnMultiNodesTest-617918424-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:12.564718 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-3d041576-cd76-49a0-ad72-4e20e04bbf09 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:12.574917 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-3d041576-cd76-49a0-ad72-4e20e04bbf09 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:12.576398 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-3d041576-cd76-49a0-ad72-4e20e04bbf09 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:12.591422 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3d041576-cd76-49a0-ad72-4e20e04bbf09 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466" status: 200 len: 1486 microversion: 2.25 time: 0.889954 Sep 23 04:37:12.593180 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 854/1633] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:37:11 2022] GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466 => generated 1486 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:37:12.599088 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-85ba9cad-c1cf-48b8-9da2-d5b677555ca3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:12.599918 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-85ba9cad-c1cf-48b8-9da2-d5b677555ca3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:12.617148 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-85ba9cad-c1cf-48b8-9da2-d5b677555ca3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:12.617857 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-85ba9cad-c1cf-48b8-9da2-d5b677555ca3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:12.618555 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-85ba9cad-c1cf-48b8-9da2-d5b677555ca3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:12.619475 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-85ba9cad-c1cf-48b8-9da2-d5b677555ca3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:12.620147 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-85ba9cad-c1cf-48b8-9da2-d5b677555ca3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:12.620740 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-85ba9cad-c1cf-48b8-9da2-d5b677555ca3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:12.653516 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-55001e1a-55e6-4717-a3fe-7b17cf33ca70 tempest-ServersOnMultiNodesTest-617918424 tempest-ServersOnMultiNodesTest-617918424-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/4997661d-a262-4bfa-994f-3615df7a8180" status: 200 len: 1620 microversion: 2.1 time: 0.532942 Sep 23 04:37:12.654240 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 780/1634] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:12 2022] GET /compute/v2.1/servers/4997661d-a262-4bfa-994f-3615df7a8180 => generated 1620 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:12.674892 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-892c4de0-afdb-4ab3-b266-9d3bcf8322e2 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:12.675933 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-892c4de0-afdb-4ab3-b266-9d3bcf8322e2 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: 04e9b262-d9e0-434a-bcbb-a85ef9180ee9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:12.713612 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-892c4de0-afdb-4ab3-b266-9d3bcf8322e2 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:12.716313 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-892c4de0-afdb-4ab3-b266-9d3bcf8322e2 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:12.718442 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-892c4de0-afdb-4ab3-b266-9d3bcf8322e2 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:12.719414 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-892c4de0-afdb-4ab3-b266-9d3bcf8322e2 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:12.721331 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-892c4de0-afdb-4ab3-b266-9d3bcf8322e2 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:12.721910 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-892c4de0-afdb-4ab3-b266-9d3bcf8322e2 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:12.759943 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-85ba9cad-c1cf-48b8-9da2-d5b677555ca3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:12.760447 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-85ba9cad-c1cf-48b8-9da2-d5b677555ca3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:12.760892 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-85ba9cad-c1cf-48b8-9da2-d5b677555ca3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:12.761349 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-85ba9cad-c1cf-48b8-9da2-d5b677555ca3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lazy-loading 'fault' on Instance uuid f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:37:12.932595 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-85ba9cad-c1cf-48b8-9da2-d5b677555ca3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:12.943583 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-85ba9cad-c1cf-48b8-9da2-d5b677555ca3 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea" status: 200 len: 1303 microversion: 2.1 time: 0.349040 Sep 23 04:37:12.946226 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 855/1635] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:12 2022] GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea => generated 1303 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:12.960971 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-332c751f-17ae-48d7-a0fc-6eb5c93f781d tempest-ServersOnMultiNodesTest-617918424 tempest-ServersOnMultiNodesTest-617918424-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:12.964949 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-332c751f-17ae-48d7-a0fc-6eb5c93f781d tempest-ServersOnMultiNodesTest-617918424 tempest-ServersOnMultiNodesTest-617918424-project-admin] [instance: 1058d2c6-a5c4-41f2-8b63-40079d80419c] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:12.983830 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-332c751f-17ae-48d7-a0fc-6eb5c93f781d tempest-ServersOnMultiNodesTest-617918424 tempest-ServersOnMultiNodesTest-617918424-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:12.984675 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-332c751f-17ae-48d7-a0fc-6eb5c93f781d tempest-ServersOnMultiNodesTest-617918424 tempest-ServersOnMultiNodesTest-617918424-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:12.985371 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-332c751f-17ae-48d7-a0fc-6eb5c93f781d tempest-ServersOnMultiNodesTest-617918424 tempest-ServersOnMultiNodesTest-617918424-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:12.987259 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-332c751f-17ae-48d7-a0fc-6eb5c93f781d tempest-ServersOnMultiNodesTest-617918424 tempest-ServersOnMultiNodesTest-617918424-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:12.989460 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-332c751f-17ae-48d7-a0fc-6eb5c93f781d tempest-ServersOnMultiNodesTest-617918424 tempest-ServersOnMultiNodesTest-617918424-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:12.996960 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-332c751f-17ae-48d7-a0fc-6eb5c93f781d tempest-ServersOnMultiNodesTest-617918424 tempest-ServersOnMultiNodesTest-617918424-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:13.389790 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-892c4de0-afdb-4ab3-b266-9d3bcf8322e2 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:13.402812 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-892c4de0-afdb-4ab3-b266-9d3bcf8322e2 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9" status: 200 len: 1719 microversion: 2.1 time: 0.728057 Sep 23 04:37:13.403920 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 781/1636] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:12 2022] GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9 => generated 1719 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:13.421227 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-187b4bda-3950-44ca-8e3d-d01b1871c85c tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:13.421863 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-187b4bda-3950-44ca-8e3d-d01b1871c85c tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] [instance: f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:13.431992 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-187b4bda-3950-44ca-8e3d-d01b1871c85c tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:13.432648 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-187b4bda-3950-44ca-8e3d-d01b1871c85c tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:13.433373 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-187b4bda-3950-44ca-8e3d-d01b1871c85c tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:13.434191 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-187b4bda-3950-44ca-8e3d-d01b1871c85c tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:13.434659 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-187b4bda-3950-44ca-8e3d-d01b1871c85c tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:13.435092 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-187b4bda-3950-44ca-8e3d-d01b1871c85c tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:13.448380 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-332c751f-17ae-48d7-a0fc-6eb5c93f781d tempest-ServersOnMultiNodesTest-617918424 tempest-ServersOnMultiNodesTest-617918424-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/1058d2c6-a5c4-41f2-8b63-40079d80419c" status: 200 len: 1620 microversion: 2.1 time: 0.497211 Sep 23 04:37:13.464676 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 856/1637] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:12 2022] GET /compute/v2.1/servers/1058d2c6-a5c4-41f2-8b63-40079d80419c => generated 1620 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:13.623376 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-698d6ccf-b45c-4468-9583-c506fd524928 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:13.624122 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-698d6ccf-b45c-4468-9583-c506fd524928 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 9e9a41f2-ff28-4c2a-80aa-193e0ebce466] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:13.635167 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-698d6ccf-b45c-4468-9583-c506fd524928 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:13.636062 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-698d6ccf-b45c-4468-9583-c506fd524928 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:13.638810 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-698d6ccf-b45c-4468-9583-c506fd524928 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:13.639691 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-698d6ccf-b45c-4468-9583-c506fd524928 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:13.640182 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-698d6ccf-b45c-4468-9583-c506fd524928 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:13.640875 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-698d6ccf-b45c-4468-9583-c506fd524928 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:13.768681 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-187b4bda-3950-44ca-8e3d-d01b1871c85c tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c977d0e2ec64f8ca6b0923b9876c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f661d071bed2459cba4aa91e2b8b0d28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:13.786375 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-187b4bda-3950-44ca-8e3d-d01b1871c85c tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] 10.222.0.33 "GET /compute/v2.1/servers/f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b" status: 200 len: 1252 microversion: 2.1 time: 0.380065 Sep 23 04:37:13.801916 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 782/1638] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:13 2022] GET /compute/v2.1/servers/f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b => generated 1252 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:13.801916 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3453306a-6482-45f0-8c12-952ea3cc6d20 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-594852278", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "1180ceb9-a888-4a3b-ba9d-a35afa8dc279"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:37:13.886240 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.network.neutron [None req-3453306a-6482-45f0-8c12-952ea3cc6d20 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] validate_networks() for None {{(pid=122698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:37:14.263183 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-698d6ccf-b45c-4468-9583-c506fd524928 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:14.278434 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-698d6ccf-b45c-4468-9583-c506fd524928 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:14.278434 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-698d6ccf-b45c-4468-9583-c506fd524928 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:14.281773 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-698d6ccf-b45c-4468-9583-c506fd524928 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466" status: 200 len: 1486 microversion: 2.25 time: 0.659509 Sep 23 04:37:14.283765 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 857/1639] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:37:13 2022] GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466 => generated 1486 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:37:14.333696 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-de20c48f-1b12-49b5-a96a-05e9449ecb9a tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:14.334742 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-de20c48f-1b12-49b5-a96a-05e9449ecb9a tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:14.342630 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-de20c48f-1b12-49b5-a96a-05e9449ecb9a tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:14.343751 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-de20c48f-1b12-49b5-a96a-05e9449ecb9a tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:14.344597 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-de20c48f-1b12-49b5-a96a-05e9449ecb9a tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:14.345569 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-de20c48f-1b12-49b5-a96a-05e9449ecb9a tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:14.346296 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-de20c48f-1b12-49b5-a96a-05e9449ecb9a tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:14.346952 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-de20c48f-1b12-49b5-a96a-05e9449ecb9a tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:14.364082 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-de20c48f-1b12-49b5-a96a-05e9449ecb9a tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] HTTP exception thrown: Instance f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea could not be found. Sep 23 04:37:14.366869 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-de20c48f-1b12-49b5-a96a-05e9449ecb9a tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Request method failure captured: Sep 23 04:37:14.366869 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea HTTP/1.1 Sep 23 04:37:14.366869 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:37:14.366869 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:37:14.366869 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:37:14.366869 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:37:14.366869 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:37:14.366869 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:37:14.366869 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:37:14.366869 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:37:14.366869 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTbVYJ52adAJ9FheNo4laGscIedhjQbJFOPau48A1AEr2s0iaN9LeefHC7L67iMyGsjmMLdPqATLlkb5I62UP_x_BbGK82ZOrjFJn0VvU_oxwpjgQlBkTumkEKg5lhV-GSi40Q3ydTifg6UNTnNJYkNIbsqEMRtSs8uF-SAwyPe086c Sep 23 04:37:14.366869 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:37:14.366869 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:37:14.366869 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:37:14.366869 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:37:14.366869 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:37:14.366869 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:37:14.366869 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 54abd267d3c043e09f26f486823907e2 Sep 23 04:37:14.366869 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-MigrationsAdminTest-898134375 Sep 23 04:37:14.366869 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:37:14.366869 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:37:14.368545 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_54abd267d3c043e09f26f486823907e2", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/54abd267d3c043e09f26f486823907e2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/54abd267d3c043e09f26f486823907e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/54abd267d3c043e09f26f486823907e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:37:14.368545 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-MigrationsAdminTest-898134375 Sep 23 04:37:14.368545 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 54abd267d3c043e09f26f486823907e2 Sep 23 04:37:14.368545 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-MigrationsAdminTest-898134375 Sep 23 04:37:14.368545 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-MigrationsAdminTest-898134375-project Sep 23 04:37:14.368545 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:37:14.368545 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:37:14.368545 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 13f5a913548445a09377847fd78a10a1 Sep 23 04:37:14.368545 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-MigrationsAdminTest-898134375-project Sep 23 04:37:14.368545 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:37:14.368545 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea could not be found. Sep 23 04:37:14.368545 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': 'f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea'} Sep 23 04:37:14.369522 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:37:14.369522 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:37:14.369522 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:37:14.369522 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:37:14.369522 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:37:14.369522 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:37:14.369522 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:37:14.369522 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:37:14.369522 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:37:14.369522 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:37:14.369522 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea could not be found. Sep 23 04:37:14.369522 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:37:14.369522 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:37:14.369522 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:37:14.369522 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:37:14.369522 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:37:14.369522 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:37:14.369522 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:37:14.369522 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:37:14.369522 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:37:14.371018 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:37:14.371018 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:37:14.371018 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:37:14.371018 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:37:14.371018 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:37:14.371018 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:37:14.371018 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:37:14.371018 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea could not be found. Sep 23 04:37:14.371018 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:37:14.371018 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:37:14.371018 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:37:14.371018 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:37:14.371018 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:37:14.371018 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:37:14.371018 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:37:14.371018 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:37:14.371018 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea could not be found. Sep 23 04:37:14.371018 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:37:14.374418 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-de20c48f-1b12-49b5-a96a-05e9449ecb9a tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Returning 404 to user: Instance f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:37:14.375723 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-de20c48f-1b12-49b5-a96a-05e9449ecb9a tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea" status: 404 len: 111 microversion: 2.1 time: 0.059700 Sep 23 04:37:14.377110 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 858/1640] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:14 2022] GET /compute/v2.1/servers/f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:37:14.382770 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-562c4189-450b-46ac-9b4c-d5744c5cd082 req-d76be73e-c79b-4577-8fe8-9151208ee10b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea", "name": "network-vif-deleted", "tag": "4270b6dd-6896-414f-8926-bc0f7819f6f7"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:37:14.403538 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-562c4189-450b-46ac-9b4c-d5744c5cd082 req-d76be73e-c79b-4577-8fe8-9151208ee10b service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:14.404112 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-562c4189-450b-46ac-9b4c-d5744c5cd082 req-d76be73e-c79b-4577-8fe8-9151208ee10b service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:14.404669 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-562c4189-450b-46ac-9b4c-d5744c5cd082 req-d76be73e-c79b-4577-8fe8-9151208ee10b service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:14.419996 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-562c4189-450b-46ac-9b4c-d5744c5cd082 req-d76be73e-c79b-4577-8fe8-9151208ee10b service nova] Creating event network-vif-deleted:4270b6dd-6896-414f-8926-bc0f7819f6f7 for instance f0f7e4f7-ea0f-4945-bb55-6982f36dc1ea on n-h2-846463-3 Sep 23 04:37:14.425313 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-562c4189-450b-46ac-9b4c-d5744c5cd082 req-d76be73e-c79b-4577-8fe8-9151208ee10b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046736 Sep 23 04:37:14.427074 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 859/1641] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:37:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:37:14.437268 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-fd4545d1-763e-47e7-8262-5c6c1056607f tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:14.438071 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-fd4545d1-763e-47e7-8262-5c6c1056607f tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: fbbf8d58-8edb-4172-9d19-4b82804bf8e9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:14.455687 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fd4545d1-763e-47e7-8262-5c6c1056607f tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:14.464627 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fd4545d1-763e-47e7-8262-5c6c1056607f tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:14.465601 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fd4545d1-763e-47e7-8262-5c6c1056607f tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:14.466722 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fd4545d1-763e-47e7-8262-5c6c1056607f tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:14.467406 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fd4545d1-763e-47e7-8262-5c6c1056607f tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:14.467963 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fd4545d1-763e-47e7-8262-5c6c1056607f tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:14.502473 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-fd4545d1-763e-47e7-8262-5c6c1056607f tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: fbbf8d58-8edb-4172-9d19-4b82804bf8e9] Going to try to terminate instance {{(pid=122699) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:37:14.798200 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:37:14.902256 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-fd4545d1-763e-47e7-8262-5c6c1056607f tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "DELETE /compute/v2.1/servers/fbbf8d58-8edb-4172-9d19-4b82804bf8e9" status: 204 len: 0 microversion: 2.1 time: 0.473249 Sep 23 04:37:14.902869 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 860/1642] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:37:14 2022] DELETE /compute/v2.1/servers/fbbf8d58-8edb-4172-9d19-4b82804bf8e9 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:37:14.910893 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d5871699-97e1-4e33-b41b-5fbea9c8aeee tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:14.912174 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d5871699-97e1-4e33-b41b-5fbea9c8aeee tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: 04e9b262-d9e0-434a-bcbb-a85ef9180ee9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:14.925144 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d5871699-97e1-4e33-b41b-5fbea9c8aeee tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:14.941097 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d5871699-97e1-4e33-b41b-5fbea9c8aeee tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:14.950069 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d5871699-97e1-4e33-b41b-5fbea9c8aeee tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:14.951206 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d5871699-97e1-4e33-b41b-5fbea9c8aeee tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:14.953232 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d5871699-97e1-4e33-b41b-5fbea9c8aeee tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:14.953784 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d5871699-97e1-4e33-b41b-5fbea9c8aeee tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:14.960320 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-3453306a-6482-45f0-8c12-952ea3cc6d20 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Flavor limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:37:14.961412 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-3453306a-6482-45f0-8c12-952ea3cc6d20 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Image limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:37:14.962168 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-3453306a-6482-45f0-8c12-952ea3cc6d20 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Flavor pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:37:14.962781 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-3453306a-6482-45f0-8c12-952ea3cc6d20 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Image pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:37:14.963517 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-3453306a-6482-45f0-8c12-952ea3cc6d20 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:37:14.974526 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3453306a-6482-45f0-8c12-952ea3cc6d20 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:14.975028 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3453306a-6482-45f0-8c12-952ea3cc6d20 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:14.975476 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3453306a-6482-45f0-8c12-952ea3cc6d20 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:14.976217 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3453306a-6482-45f0-8c12-952ea3cc6d20 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:14.976884 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3453306a-6482-45f0-8c12-952ea3cc6d20 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:14.977551 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3453306a-6482-45f0-8c12-952ea3cc6d20 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:15.005043 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-3453306a-6482-45f0-8c12-952ea3cc6d20 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Getting quotas for project f5db359a60174c45afa2bf06e23a46c4. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:37:15.014312 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-3453306a-6482-45f0-8c12-952ea3cc6d20 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Getting quotas for user da08af8193dd490b93278385583f24c0 and project f5db359a60174c45afa2bf06e23a46c4. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:37:15.029738 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3453306a-6482-45f0-8c12-952ea3cc6d20 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Going to run 1 instances... {{(pid=122698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:37:15.032240 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3453306a-6482-45f0-8c12-952ea3cc6d20 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 7b84f450-5c05-4468-b17a-2cd30f2c7f55] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:37:15.200424 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d5871699-97e1-4e33-b41b-5fbea9c8aeee tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:15.203270 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:37:15.219657 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d5871699-97e1-4e33-b41b-5fbea9c8aeee tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9" status: 200 len: 1719 microversion: 2.1 time: 0.314267 Sep 23 04:37:15.223587 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 861/1643] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:14 2022] GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9 => generated 1719 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:15.234146 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3453306a-6482-45f0-8c12-952ea3cc6d20 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.440281 Sep 23 04:37:15.235062 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 783/1644] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:37:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1444 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:37:15.241345 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6d4a1d47-6fd3-4279-8e58-7d856e78d849 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:15.242183 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-6d4a1d47-6fd3-4279-8e58-7d856e78d849 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: fbbf8d58-8edb-4172-9d19-4b82804bf8e9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:15.244027 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-310b8b12-851d-44b4-9e95-02a2e918c18e tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:15.244862 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-310b8b12-851d-44b4-9e95-02a2e918c18e tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] [instance: f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:15.254470 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-310b8b12-851d-44b4-9e95-02a2e918c18e tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:15.255125 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-310b8b12-851d-44b4-9e95-02a2e918c18e tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:15.255680 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-310b8b12-851d-44b4-9e95-02a2e918c18e tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:15.256065 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6d4a1d47-6fd3-4279-8e58-7d856e78d849 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:15.256575 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6d4a1d47-6fd3-4279-8e58-7d856e78d849 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:15.256797 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-310b8b12-851d-44b4-9e95-02a2e918c18e tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:15.257019 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6d4a1d47-6fd3-4279-8e58-7d856e78d849 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:15.257182 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-310b8b12-851d-44b4-9e95-02a2e918c18e tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:15.257541 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-310b8b12-851d-44b4-9e95-02a2e918c18e tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:15.260346 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6d4a1d47-6fd3-4279-8e58-7d856e78d849 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:15.260828 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6d4a1d47-6fd3-4279-8e58-7d856e78d849 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:15.261563 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6d4a1d47-6fd3-4279-8e58-7d856e78d849 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:15.470539 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-310b8b12-851d-44b4-9e95-02a2e918c18e tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c977d0e2ec64f8ca6b0923b9876c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f661d071bed2459cba4aa91e2b8b0d28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:15.480802 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-310b8b12-851d-44b4-9e95-02a2e918c18e tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] 10.222.0.33 "GET /compute/v2.1/servers/f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b" status: 200 len: 1252 microversion: 2.1 time: 0.257561 Sep 23 04:37:15.492171 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 862/1645] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:15 2022] GET /compute/v2.1/servers/f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b => generated 1252 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:15.501840 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-171955ca-8a8b-48f5-9b02-ef75bc2aa5b3 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-75155997", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "e5fc2057-7359-48db-8997-74c9d86bb4ac"}, {"port": "8d4fddcb-265b-482d-b84d-6fe44445b855", "tag": "port-1"}, {"port": "2abf97e6-d464-4cf6-a441-15ced1cece90", "tag": "port-2"}, {"uuid": "f25edbae-88d4-4e73-9a60-82838f5d5aa1", "tag": "net-1"}, {"uuid": "f25edbae-88d4-4e73-9a60-82838f5d5aa1"}, {"uuid": "560e86e6-e777-4c27-8f18-8b822b1f5944", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "560e86e6-e777-4c27-8f18-8b822b1f5944", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "8b468b7a-6c3b-4534-9150-7d78c453ca7a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "61c40555-40bd-4185-a129-ba3e52a069e5", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "8a9425c3-8e70-46ae-b109-36ef3def96ee", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--779417760"}], "key_name": "tempest-keypair-2111355749", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:37:15.802266 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6d4a1d47-6fd3-4279-8e58-7d856e78d849 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:15.814323 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-6d4a1d47-6fd3-4279-8e58-7d856e78d849 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/fbbf8d58-8edb-4172-9d19-4b82804bf8e9" status: 200 len: 1534 microversion: 2.1 time: 0.576923 Sep 23 04:37:15.817143 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 784/1646] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:15 2022] GET /compute/v2.1/servers/fbbf8d58-8edb-4172-9d19-4b82804bf8e9 => generated 1534 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:15.836988 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4e67bf4b-1e46-4b9b-a206-f6324dfbc06d tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:15.838406 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4e67bf4b-1e46-4b9b-a206-f6324dfbc06d tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 7b84f450-5c05-4468-b17a-2cd30f2c7f55] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:15.860400 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.neutron [None req-171955ca-8a8b-48f5-9b02-ef75bc2aa5b3 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] validate_networks() for [('e5fc2057-7359-48db-8997-74c9d86bb4ac', None, None, None, None, None), (None, None, '8d4fddcb-265b-482d-b84d-6fe44445b855', None, None, None), (None, None, '2abf97e6-d464-4cf6-a441-15ced1cece90', None, None, None), ('f25edbae-88d4-4e73-9a60-82838f5d5aa1', None, None, None, None, None), ('f25edbae-88d4-4e73-9a60-82838f5d5aa1', None, None, None, None, None), ('560e86e6-e777-4c27-8f18-8b822b1f5944', '10.2.2.100', None, None, None, None), ('560e86e6-e777-4c27-8f18-8b822b1f5944', '10.2.2.200', None, None, None, None)] {{(pid=122699) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:37:15.873160 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:37:16.228182 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4e67bf4b-1e46-4b9b-a206-f6324dfbc06d tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:16.235536 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4e67bf4b-1e46-4b9b-a206-f6324dfbc06d tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/7b84f450-5c05-4468-b17a-2cd30f2c7f55" status: 200 len: 1216 microversion: 2.1 time: 0.417017 Sep 23 04:37:16.241254 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 785/1647] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:15 2022] GET /compute/v2.1/servers/7b84f450-5c05-4468-b17a-2cd30f2c7f55 => generated 1216 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:16.246433 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a764b8a6-5801-43a5-9c5b-814690930558 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:16.251530 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a764b8a6-5801-43a5-9c5b-814690930558 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 9e9a41f2-ff28-4c2a-80aa-193e0ebce466] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:16.267710 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a764b8a6-5801-43a5-9c5b-814690930558 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:16.268228 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a764b8a6-5801-43a5-9c5b-814690930558 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:16.268814 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a764b8a6-5801-43a5-9c5b-814690930558 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:16.269619 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a764b8a6-5801-43a5-9c5b-814690930558 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:16.270218 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a764b8a6-5801-43a5-9c5b-814690930558 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:16.270667 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a764b8a6-5801-43a5-9c5b-814690930558 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:16.861603 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a764b8a6-5801-43a5-9c5b-814690930558 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:16.874090 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a764b8a6-5801-43a5-9c5b-814690930558 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:16.880014 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a764b8a6-5801-43a5-9c5b-814690930558 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:16.884013 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a764b8a6-5801-43a5-9c5b-814690930558 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466" status: 200 len: 1486 microversion: 2.25 time: 0.641296 Sep 23 04:37:16.885189 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 786/1648] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:37:16 2022] GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466 => generated 1486 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:37:16.901752 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d4c4d823-e962-48a8-b5c0-c105b2b9b0e5 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:16.902974 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d4c4d823-e962-48a8-b5c0-c105b2b9b0e5 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: 04e9b262-d9e0-434a-bcbb-a85ef9180ee9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:16.916126 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d4c4d823-e962-48a8-b5c0-c105b2b9b0e5 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:16.916947 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d4c4d823-e962-48a8-b5c0-c105b2b9b0e5 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:16.917717 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d4c4d823-e962-48a8-b5c0-c105b2b9b0e5 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:16.920685 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d4c4d823-e962-48a8-b5c0-c105b2b9b0e5 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:16.921156 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d4c4d823-e962-48a8-b5c0-c105b2b9b0e5 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:16.921579 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d4c4d823-e962-48a8-b5c0-c105b2b9b0e5 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:16.950355 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:37:17.282495 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d4c4d823-e962-48a8-b5c0-c105b2b9b0e5 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:17.293530 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d4c4d823-e962-48a8-b5c0-c105b2b9b0e5 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9" status: 200 len: 1719 microversion: 2.1 time: 0.405723 Sep 23 04:37:17.315115 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 787/1649] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:16 2022] GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9 => generated 1719 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:17.322240 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-acdbed74-6ee0-4470-906c-9d1de9f1c70e tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:17.327796 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-acdbed74-6ee0-4470-906c-9d1de9f1c70e tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] [instance: f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:17.345546 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-acdbed74-6ee0-4470-906c-9d1de9f1c70e tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:17.348320 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-acdbed74-6ee0-4470-906c-9d1de9f1c70e tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:17.348811 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-acdbed74-6ee0-4470-906c-9d1de9f1c70e tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:17.350796 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-acdbed74-6ee0-4470-906c-9d1de9f1c70e tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:17.351863 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-acdbed74-6ee0-4470-906c-9d1de9f1c70e tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:17.352705 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-acdbed74-6ee0-4470-906c-9d1de9f1c70e tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:17.507973 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-acdbed74-6ee0-4470-906c-9d1de9f1c70e tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c977d0e2ec64f8ca6b0923b9876c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f661d071bed2459cba4aa91e2b8b0d28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:17.527412 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-acdbed74-6ee0-4470-906c-9d1de9f1c70e tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] 10.222.0.33 "GET /compute/v2.1/servers/f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b" status: 200 len: 1252 microversion: 2.1 time: 0.216084 Sep 23 04:37:17.542085 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 788/1650] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:17 2022] GET /compute/v2.1/servers/f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b => generated 1252 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:17.543807 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-acdbed74-6ee0-4470-906c-9d1de9f1c70e tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:17.545016 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-acdbed74-6ee0-4470-906c-9d1de9f1c70e tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] 10.222.0.33 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001570 Sep 23 04:37:17.553679 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 789/1651] 10.222.0.33 () {56 vars in 886 bytes} [Fri Sep 23 04:37:17 2022] GET /compute/ => generated 377 bytes in 25 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 23 04:37:17.564358 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3dcdbbf8-ac4e-4ddf-a5c7-6de2a12d7f9d tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:17.567325 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3dcdbbf8-ac4e-4ddf-a5c7-6de2a12d7f9d tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: fbbf8d58-8edb-4172-9d19-4b82804bf8e9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:17.600627 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3dcdbbf8-ac4e-4ddf-a5c7-6de2a12d7f9d tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:17.602334 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3dcdbbf8-ac4e-4ddf-a5c7-6de2a12d7f9d tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:17.606204 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3dcdbbf8-ac4e-4ddf-a5c7-6de2a12d7f9d tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:17.608872 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3dcdbbf8-ac4e-4ddf-a5c7-6de2a12d7f9d tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:17.608872 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3dcdbbf8-ac4e-4ddf-a5c7-6de2a12d7f9d tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:17.610652 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3dcdbbf8-ac4e-4ddf-a5c7-6de2a12d7f9d tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:17.790009 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-3dcdbbf8-ac4e-4ddf-a5c7-6de2a12d7f9d tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:17.806974 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3dcdbbf8-ac4e-4ddf-a5c7-6de2a12d7f9d tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/fbbf8d58-8edb-4172-9d19-4b82804bf8e9" status: 200 len: 1363 microversion: 2.1 time: 0.251904 Sep 23 04:37:17.816812 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 790/1652] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:17 2022] GET /compute/v2.1/servers/fbbf8d58-8edb-4172-9d19-4b82804bf8e9 => generated 1363 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:17.816812 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-54f02f0c-002a-46b2-be56-f6233d71c866 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:17.816812 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-54f02f0c-002a-46b2-be56-f6233d71c866 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 7b84f450-5c05-4468-b17a-2cd30f2c7f55] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:17.830742 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-54f02f0c-002a-46b2-be56-f6233d71c866 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:17.831245 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-54f02f0c-002a-46b2-be56-f6233d71c866 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:17.831723 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-54f02f0c-002a-46b2-be56-f6233d71c866 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:17.832406 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-54f02f0c-002a-46b2-be56-f6233d71c866 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:17.832849 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-54f02f0c-002a-46b2-be56-f6233d71c866 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:17.833276 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-54f02f0c-002a-46b2-be56-f6233d71c866 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:17.940403 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-54f02f0c-002a-46b2-be56-f6233d71c866 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:17.960579 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-54f02f0c-002a-46b2-be56-f6233d71c866 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/7b84f450-5c05-4468-b17a-2cd30f2c7f55" status: 200 len: 1268 microversion: 2.1 time: 0.139985 Sep 23 04:37:17.990605 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 791/1653] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:17 2022] GET /compute/v2.1/servers/7b84f450-5c05-4468-b17a-2cd30f2c7f55 => generated 1268 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:18.001709 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-e4a5b3aa-3607-428d-b7a1-87b1f1d198f8 req-971579a5-83bc-498a-9394-ff1f3b9ddfad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbbf8d58-8edb-4172-9d19-4b82804bf8e9", "name": "network-vif-deleted", "tag": "1a75583d-4990-40e9-876b-807baa271a68"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:37:18.040308 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-e4a5b3aa-3607-428d-b7a1-87b1f1d198f8 req-971579a5-83bc-498a-9394-ff1f3b9ddfad service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:18.047147 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-e4a5b3aa-3607-428d-b7a1-87b1f1d198f8 req-971579a5-83bc-498a-9394-ff1f3b9ddfad service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:18.047559 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-e4a5b3aa-3607-428d-b7a1-87b1f1d198f8 req-971579a5-83bc-498a-9394-ff1f3b9ddfad service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:18.068684 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-e4a5b3aa-3607-428d-b7a1-87b1f1d198f8 req-971579a5-83bc-498a-9394-ff1f3b9ddfad service nova] Creating event network-vif-deleted:1a75583d-4990-40e9-876b-807baa271a68 for instance fbbf8d58-8edb-4172-9d19-4b82804bf8e9 on n-h2-846463-3 Sep 23 04:37:18.076385 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-e4a5b3aa-3607-428d-b7a1-87b1f1d198f8 req-971579a5-83bc-498a-9394-ff1f3b9ddfad service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083277 Sep 23 04:37:18.077976 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 792/1654] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:37:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:37:18.080108 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-e4a5b3aa-3607-428d-b7a1-87b1f1d198f8 req-971579a5-83bc-498a-9394-ff1f3b9ddfad service nova] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:18.081250 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-e4a5b3aa-3607-428d-b7a1-87b1f1d198f8 req-971579a5-83bc-498a-9394-ff1f3b9ddfad service nova] 10.222.0.33 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.002115 Sep 23 04:37:18.081970 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 793/1655] 10.222.0.33 () {54 vars in 1035 bytes} [Fri Sep 23 04:37:18 2022] GET /compute/v2/ => generated 379 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Sep 23 04:37:18.103799 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-612d1d81-18d5-46a5-b1e9-c3934819725c tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:18.111085 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-612d1d81-18d5-46a5-b1e9-c3934819725c tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 9e9a41f2-ff28-4c2a-80aa-193e0ebce466] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:18.128767 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-612d1d81-18d5-46a5-b1e9-c3934819725c tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:18.128767 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-612d1d81-18d5-46a5-b1e9-c3934819725c tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:18.128767 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-612d1d81-18d5-46a5-b1e9-c3934819725c tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:18.128767 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-612d1d81-18d5-46a5-b1e9-c3934819725c tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:18.130871 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-612d1d81-18d5-46a5-b1e9-c3934819725c tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:18.131528 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-612d1d81-18d5-46a5-b1e9-c3934819725c tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:18.649962 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-612d1d81-18d5-46a5-b1e9-c3934819725c tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:18.658406 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-612d1d81-18d5-46a5-b1e9-c3934819725c tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:18.659852 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-612d1d81-18d5-46a5-b1e9-c3934819725c tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:18.665854 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-612d1d81-18d5-46a5-b1e9-c3934819725c tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466" status: 200 len: 1486 microversion: 2.25 time: 0.580485 Sep 23 04:37:18.668019 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 794/1656] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:37:18 2022] GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466 => generated 1486 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:37:18.669325 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-612d1d81-18d5-46a5-b1e9-c3934819725c tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:18.670463 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-612d1d81-18d5-46a5-b1e9-c3934819725c tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001378 Sep 23 04:37:18.682262 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 795/1657] 10.222.0.33 () {54 vars in 1041 bytes} [Fri Sep 23 04:37:18 2022] GET /compute/v2.1/ => generated 388 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:37:18.687251 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8cefd39b-f855-4022-b888-6c5b34cbf94b tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:18.687863 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8cefd39b-f855-4022-b888-6c5b34cbf94b tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: 04e9b262-d9e0-434a-bcbb-a85ef9180ee9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:18.703609 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8cefd39b-f855-4022-b888-6c5b34cbf94b tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:18.704114 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8cefd39b-f855-4022-b888-6c5b34cbf94b tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:18.706732 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8cefd39b-f855-4022-b888-6c5b34cbf94b tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:18.708026 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8cefd39b-f855-4022-b888-6c5b34cbf94b tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:18.708593 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8cefd39b-f855-4022-b888-6c5b34cbf94b tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:18.708932 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8cefd39b-f855-4022-b888-6c5b34cbf94b tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:19.125611 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8cefd39b-f855-4022-b888-6c5b34cbf94b tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:19.155679 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8cefd39b-f855-4022-b888-6c5b34cbf94b tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9" status: 200 len: 1719 microversion: 2.1 time: 0.458892 Sep 23 04:37:19.158579 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 796/1658] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:18 2022] GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9 => generated 1719 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:19.178052 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a93ad0d3-58f4-46e9-bcaf-dbb375b199de tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:19.178678 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a93ad0d3-58f4-46e9-bcaf-dbb375b199de tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] [instance: f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:19.205176 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a93ad0d3-58f4-46e9-bcaf-dbb375b199de tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:19.205689 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a93ad0d3-58f4-46e9-bcaf-dbb375b199de tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:19.206639 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a93ad0d3-58f4-46e9-bcaf-dbb375b199de tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:19.207312 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a93ad0d3-58f4-46e9-bcaf-dbb375b199de tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:19.209320 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a93ad0d3-58f4-46e9-bcaf-dbb375b199de tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:19.209783 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a93ad0d3-58f4-46e9-bcaf-dbb375b199de tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:19.299025 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a93ad0d3-58f4-46e9-bcaf-dbb375b199de tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:19.299957 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a93ad0d3-58f4-46e9-bcaf-dbb375b199de tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:19.301550 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a93ad0d3-58f4-46e9-bcaf-dbb375b199de tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:19.302500 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-a93ad0d3-58f4-46e9-bcaf-dbb375b199de tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lazy-loading 'fault' on Instance uuid f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:37:19.392647 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a93ad0d3-58f4-46e9-bcaf-dbb375b199de tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c977d0e2ec64f8ca6b0923b9876c0c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f661d071bed2459cba4aa91e2b8b0d28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:19.409454 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a93ad0d3-58f4-46e9-bcaf-dbb375b199de tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] 10.222.0.33 "GET /compute/v2.1/servers/f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b" status: 200 len: 1257 microversion: 2.1 time: 0.244016 Sep 23 04:37:19.410942 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 797/1659] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:19 2022] GET /compute/v2.1/servers/f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b => generated 1257 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:19.412594 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a93ad0d3-58f4-46e9-bcaf-dbb375b199de tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:19.414681 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a93ad0d3-58f4-46e9-bcaf-dbb375b199de tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] 10.222.0.33 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002468 Sep 23 04:37:19.430130 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 798/1660] 10.222.0.33 () {56 vars in 886 bytes} [Fri Sep 23 04:37:19 2022] GET /compute/ => generated 377 bytes in 15 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 23 04:37:19.441653 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8387c5de-13e3-47c8-a78c-2cef2dabc76b tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:19.446915 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8387c5de-13e3-47c8-a78c-2cef2dabc76b tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: fbbf8d58-8edb-4172-9d19-4b82804bf8e9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:19.461087 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8387c5de-13e3-47c8-a78c-2cef2dabc76b tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:19.462467 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8387c5de-13e3-47c8-a78c-2cef2dabc76b tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:19.464110 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8387c5de-13e3-47c8-a78c-2cef2dabc76b tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:19.467064 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8387c5de-13e3-47c8-a78c-2cef2dabc76b tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:19.469464 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8387c5de-13e3-47c8-a78c-2cef2dabc76b tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:19.470191 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8387c5de-13e3-47c8-a78c-2cef2dabc76b tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:19.571661 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8387c5de-13e3-47c8-a78c-2cef2dabc76b tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:19.572613 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8387c5de-13e3-47c8-a78c-2cef2dabc76b tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:19.573681 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8387c5de-13e3-47c8-a78c-2cef2dabc76b tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:19.574855 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-8387c5de-13e3-47c8-a78c-2cef2dabc76b tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lazy-loading 'fault' on Instance uuid fbbf8d58-8edb-4172-9d19-4b82804bf8e9 {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:37:19.671830 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8387c5de-13e3-47c8-a78c-2cef2dabc76b tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:19.709133 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8387c5de-13e3-47c8-a78c-2cef2dabc76b tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/fbbf8d58-8edb-4172-9d19-4b82804bf8e9" status: 200 len: 1368 microversion: 2.1 time: 0.275566 Sep 23 04:37:19.711761 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 799/1661] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:19 2022] GET /compute/v2.1/servers/fbbf8d58-8edb-4172-9d19-4b82804bf8e9 => generated 1368 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:19.734886 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-15ee2dad-8b40-4409-805f-3675521a730f tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:19.735525 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-15ee2dad-8b40-4409-805f-3675521a730f tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 7b84f450-5c05-4468-b17a-2cd30f2c7f55] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:19.743402 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-15ee2dad-8b40-4409-805f-3675521a730f tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:19.743975 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-15ee2dad-8b40-4409-805f-3675521a730f tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:19.745715 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-15ee2dad-8b40-4409-805f-3675521a730f tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:19.746579 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-15ee2dad-8b40-4409-805f-3675521a730f tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:19.747098 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-15ee2dad-8b40-4409-805f-3675521a730f tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:19.747482 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-15ee2dad-8b40-4409-805f-3675521a730f tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:19.839673 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-15ee2dad-8b40-4409-805f-3675521a730f tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:19.861303 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-15ee2dad-8b40-4409-805f-3675521a730f tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/7b84f450-5c05-4468-b17a-2cd30f2c7f55" status: 200 len: 1274 microversion: 2.1 time: 0.145560 Sep 23 04:37:19.862322 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 800/1662] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:19 2022] GET /compute/v2.1/servers/7b84f450-5c05-4468-b17a-2cd30f2c7f55 => generated 1274 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:19.879280 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-935343df-07a7-476a-b851-03f231e2b70a tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:19.880006 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-935343df-07a7-476a-b851-03f231e2b70a tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 9e9a41f2-ff28-4c2a-80aa-193e0ebce466] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:19.895913 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-935343df-07a7-476a-b851-03f231e2b70a tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:19.897518 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-935343df-07a7-476a-b851-03f231e2b70a tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:19.899016 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-935343df-07a7-476a-b851-03f231e2b70a tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:19.904646 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-935343df-07a7-476a-b851-03f231e2b70a tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:19.904646 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-935343df-07a7-476a-b851-03f231e2b70a tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:19.904646 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-935343df-07a7-476a-b851-03f231e2b70a tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:20.189312 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-935343df-07a7-476a-b851-03f231e2b70a tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:20.203989 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-935343df-07a7-476a-b851-03f231e2b70a tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:20.207849 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-935343df-07a7-476a-b851-03f231e2b70a tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:20.213496 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-935343df-07a7-476a-b851-03f231e2b70a tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466" status: 200 len: 1486 microversion: 2.25 time: 0.349948 Sep 23 04:37:20.217752 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 801/1663] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:37:19 2022] GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466 => generated 1486 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:37:20.229473 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f790638c-9da2-4d7c-8bc8-e9f3b7a8f835 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:20.230673 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f790638c-9da2-4d7c-8bc8-e9f3b7a8f835 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: 04e9b262-d9e0-434a-bcbb-a85ef9180ee9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:20.245530 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f790638c-9da2-4d7c-8bc8-e9f3b7a8f835 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:20.246799 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f790638c-9da2-4d7c-8bc8-e9f3b7a8f835 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:20.247504 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f790638c-9da2-4d7c-8bc8-e9f3b7a8f835 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:20.255650 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f790638c-9da2-4d7c-8bc8-e9f3b7a8f835 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:20.257699 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f790638c-9da2-4d7c-8bc8-e9f3b7a8f835 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:20.260404 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f790638c-9da2-4d7c-8bc8-e9f3b7a8f835 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:20.631312 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f790638c-9da2-4d7c-8bc8-e9f3b7a8f835 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:20.641825 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f790638c-9da2-4d7c-8bc8-e9f3b7a8f835 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9" status: 200 len: 1719 microversion: 2.1 time: 0.422653 Sep 23 04:37:20.651671 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 802/1664] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:20 2022] GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9 => generated 1719 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:20.666590 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-db387a15-6d07-4eec-ae84-0d7af6acf702 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:20.667546 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-db387a15-6d07-4eec-ae84-0d7af6acf702 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] [instance: f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:20.689545 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-db387a15-6d07-4eec-ae84-0d7af6acf702 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:20.690265 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-db387a15-6d07-4eec-ae84-0d7af6acf702 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:20.690529 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-db387a15-6d07-4eec-ae84-0d7af6acf702 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:20.691776 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-db387a15-6d07-4eec-ae84-0d7af6acf702 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:20.693531 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-db387a15-6d07-4eec-ae84-0d7af6acf702 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:20.693990 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-db387a15-6d07-4eec-ae84-0d7af6acf702 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:20.741621 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-db387a15-6d07-4eec-ae84-0d7af6acf702 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] HTTP exception thrown: Instance f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b could not be found. Sep 23 04:37:20.754874 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-db387a15-6d07-4eec-ae84-0d7af6acf702 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Request method failure captured: Sep 23 04:37:20.754874 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b HTTP/1.1 Sep 23 04:37:20.754874 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:37:20.754874 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:37:20.754874 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:37:20.754874 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:37:20.754874 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:37:20.754874 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:37:20.754874 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:37:20.754874 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:37:20.754874 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTc23zyLuVuWM9dNHw_DPusw7NAeL9TmL5ykEt3BdKEehrdQTT5jIA03b-AEirICcbkgTqesgU1WqsnAKuCxfVsc6_ZJU_Jq5jf4KxIrZeGwGlhS53iDv44fOf4EPzD-3jXBB1lV_IQ4jnVhunEJGPx1cIMylRnCluovFXUB2tz535A Sep 23 04:37:20.754874 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:37:20.754874 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:37:20.754874 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:37:20.754874 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:37:20.754874 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:37:20.754874 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:37:20.754874 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: f661d071bed2459cba4aa91e2b8b0d28 Sep 23 04:37:20.754874 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ServersTestBootFromVolume-71280634 Sep 23 04:37:20.754874 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:37:20.754874 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:37:20.756644 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f661d071bed2459cba4aa91e2b8b0d28", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f661d071bed2459cba4aa91e2b8b0d28"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f661d071bed2459cba4aa91e2b8b0d28"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f661d071bed2459cba4aa91e2b8b0d28"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:37:20.756644 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ServersTestBootFromVolume-71280634 Sep 23 04:37:20.756644 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: f661d071bed2459cba4aa91e2b8b0d28 Sep 23 04:37:20.756644 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ServersTestBootFromVolume-71280634 Sep 23 04:37:20.756644 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ServersTestBootFromVolume-71280634-project Sep 23 04:37:20.756644 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:37:20.756644 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:37:20.756644 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 6c977d0e2ec64f8ca6b0923b9876c0c3 Sep 23 04:37:20.756644 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ServersTestBootFromVolume-71280634-project Sep 23 04:37:20.756644 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:37:20.756644 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b could not be found. Sep 23 04:37:20.756644 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': 'f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b'} Sep 23 04:37:20.757557 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:37:20.757557 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:37:20.757557 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:37:20.757557 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:37:20.757557 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:37:20.757557 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:37:20.757557 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:37:20.757557 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:37:20.757557 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:37:20.757557 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:37:20.757557 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b could not be found. Sep 23 04:37:20.757557 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:37:20.757557 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:37:20.757557 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:37:20.757557 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:37:20.757557 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:37:20.757557 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:37:20.757557 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:37:20.757557 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:37:20.757557 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:37:20.759337 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:37:20.759337 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:37:20.759337 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:37:20.759337 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:37:20.759337 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:37:20.759337 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:37:20.759337 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:37:20.759337 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b could not be found. Sep 23 04:37:20.759337 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:37:20.759337 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:37:20.759337 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:37:20.759337 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:37:20.759337 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:37:20.759337 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:37:20.759337 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:37:20.759337 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:37:20.759337 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b could not be found. Sep 23 04:37:20.759337 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:37:20.763923 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-db387a15-6d07-4eec-ae84-0d7af6acf702 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Returning 404 to user: Instance f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:37:20.763923 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-db387a15-6d07-4eec-ae84-0d7af6acf702 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] 10.222.0.33 "GET /compute/v2.1/servers/f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b" status: 404 len: 111 microversion: 2.1 time: 0.110112 Sep 23 04:37:20.772665 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 803/1665] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:20 2022] GET /compute/v2.1/servers/f5236a4b-17ec-4c7c-8ea0-aa33602a6c7b => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:37:20.789553 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-74708169-5775-49c5-8b54-de209f205598 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:20.790446 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-74708169-5775-49c5-8b54-de209f205598 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: fbbf8d58-8edb-4172-9d19-4b82804bf8e9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:20.799912 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-74708169-5775-49c5-8b54-de209f205598 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:20.800783 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-74708169-5775-49c5-8b54-de209f205598 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:20.802561 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-74708169-5775-49c5-8b54-de209f205598 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:20.803564 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-74708169-5775-49c5-8b54-de209f205598 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:20.805730 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-74708169-5775-49c5-8b54-de209f205598 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:20.815857 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-74708169-5775-49c5-8b54-de209f205598 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:20.869210 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-74708169-5775-49c5-8b54-de209f205598 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] HTTP exception thrown: Instance fbbf8d58-8edb-4172-9d19-4b82804bf8e9 could not be found. Sep 23 04:37:20.871107 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-74708169-5775-49c5-8b54-de209f205598 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Request method failure captured: Sep 23 04:37:20.871107 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/fbbf8d58-8edb-4172-9d19-4b82804bf8e9 HTTP/1.1 Sep 23 04:37:20.871107 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:37:20.871107 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:37:20.871107 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:37:20.871107 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:37:20.871107 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:37:20.871107 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:37:20.871107 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:37:20.871107 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:37:20.871107 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTbVYJ52adAJ9FheNo4laGscIedhjQbJFOPau48A1AEr2s0iaN9LeefHC7L67iMyGsjmMLdPqATLlkb5I62UP_x_BbGK82ZOrjFJn0VvU_oxwpjgQlBkTumkEKg5lhV-GSi40Q3ydTifg6UNTnNJYkNIbsqEMRtSs8uF-SAwyPe086c Sep 23 04:37:20.871107 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:37:20.871107 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:37:20.871107 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:37:20.871107 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:37:20.871107 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:37:20.871107 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:37:20.871107 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 54abd267d3c043e09f26f486823907e2 Sep 23 04:37:20.871107 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-MigrationsAdminTest-898134375 Sep 23 04:37:20.871107 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:37:20.871107 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:37:20.872958 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_54abd267d3c043e09f26f486823907e2", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/54abd267d3c043e09f26f486823907e2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/54abd267d3c043e09f26f486823907e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/54abd267d3c043e09f26f486823907e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:37:20.872958 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-MigrationsAdminTest-898134375 Sep 23 04:37:20.872958 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 54abd267d3c043e09f26f486823907e2 Sep 23 04:37:20.872958 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-MigrationsAdminTest-898134375 Sep 23 04:37:20.872958 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-MigrationsAdminTest-898134375-project Sep 23 04:37:20.872958 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:37:20.872958 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:37:20.872958 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 13f5a913548445a09377847fd78a10a1 Sep 23 04:37:20.872958 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-MigrationsAdminTest-898134375-project Sep 23 04:37:20.872958 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:37:20.872958 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance fbbf8d58-8edb-4172-9d19-4b82804bf8e9 could not be found. Sep 23 04:37:20.872958 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': 'fbbf8d58-8edb-4172-9d19-4b82804bf8e9'} Sep 23 04:37:20.874309 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:37:20.874309 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:37:20.874309 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:37:20.874309 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:37:20.874309 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:37:20.874309 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:37:20.874309 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:37:20.874309 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:37:20.874309 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:37:20.874309 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:37:20.874309 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbbf8d58-8edb-4172-9d19-4b82804bf8e9 could not be found. Sep 23 04:37:20.874309 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:37:20.874309 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:37:20.874309 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:37:20.874309 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:37:20.874309 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:37:20.874309 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:37:20.874309 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:37:20.874309 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:37:20.874309 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:37:20.876121 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:37:20.876121 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:37:20.876121 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:37:20.876121 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:37:20.876121 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:37:20.876121 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:37:20.876121 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:37:20.876121 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbbf8d58-8edb-4172-9d19-4b82804bf8e9 could not be found. Sep 23 04:37:20.876121 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:37:20.876121 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:37:20.876121 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:37:20.876121 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:37:20.876121 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:37:20.876121 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:37:20.876121 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:37:20.876121 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:37:20.876121 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbbf8d58-8edb-4172-9d19-4b82804bf8e9 could not be found. Sep 23 04:37:20.876121 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:37:20.879578 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-74708169-5775-49c5-8b54-de209f205598 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Returning 404 to user: Instance fbbf8d58-8edb-4172-9d19-4b82804bf8e9 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:37:20.880597 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-74708169-5775-49c5-8b54-de209f205598 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/fbbf8d58-8edb-4172-9d19-4b82804bf8e9" status: 404 len: 111 microversion: 2.1 time: 0.100917 Sep 23 04:37:20.885688 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 804/1666] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:20 2022] GET /compute/v2.1/servers/fbbf8d58-8edb-4172-9d19-4b82804bf8e9 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:37:20.896154 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-16eddda1-8858-45cf-ba89-62a213c26840 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] Calling method '.version_select at 0x7ff1bb95c550>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:21.029854 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-16eddda1-8858-45cf-ba89-62a213c26840 tempest-ServersTestBootFromVolume-71280634 tempest-ServersTestBootFromVolume-71280634-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1290470256" status: 202 len: 0 microversion: 2.1 time: 0.147306 Sep 23 04:37:21.031022 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 805/1667] 10.222.0.33 () {58 vars in 1221 bytes} [Fri Sep 23 04:37:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1290470256 => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:37:21.042604 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e78a4689-9242-4f59-b70b-2d9857b0bbbe tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '.version_select at 0x7ff1bbb4d5e0>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:21.212516 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e78a4689-9242-4f59-b70b-2d9857b0bbbe tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1760615441" status: 202 len: 0 microversion: 2.1 time: 0.179786 Sep 23 04:37:21.213693 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 806/1668] 10.222.0.33 () {58 vars in 1221 bytes} [Fri Sep 23 04:37:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1760615441 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:37:21.220428 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-13dac7a0-b0d2-4fc9-bade-4da92d6c5dd0 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:21.221318 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-13dac7a0-b0d2-4fc9-bade-4da92d6c5dd0 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 7b84f450-5c05-4468-b17a-2cd30f2c7f55] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:21.234132 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-13dac7a0-b0d2-4fc9-bade-4da92d6c5dd0 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:21.240072 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-13dac7a0-b0d2-4fc9-bade-4da92d6c5dd0 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:21.240798 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-13dac7a0-b0d2-4fc9-bade-4da92d6c5dd0 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:21.241734 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-13dac7a0-b0d2-4fc9-bade-4da92d6c5dd0 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:21.242407 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-13dac7a0-b0d2-4fc9-bade-4da92d6c5dd0 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:21.243049 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-13dac7a0-b0d2-4fc9-bade-4da92d6c5dd0 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:21.832374 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-171955ca-8a8b-48f5-9b02-ef75bc2aa5b3 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Flavor limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:37:21.832909 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-171955ca-8a8b-48f5-9b02-ef75bc2aa5b3 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Image limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:37:21.833600 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-171955ca-8a8b-48f5-9b02-ef75bc2aa5b3 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Flavor pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:37:21.834231 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-171955ca-8a8b-48f5-9b02-ef75bc2aa5b3 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Image pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:37:21.837435 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-171955ca-8a8b-48f5-9b02-ef75bc2aa5b3 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:37:21.851695 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-171955ca-8a8b-48f5-9b02-ef75bc2aa5b3 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:21.855111 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-171955ca-8a8b-48f5-9b02-ef75bc2aa5b3 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:21.855901 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-171955ca-8a8b-48f5-9b02-ef75bc2aa5b3 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:21.857075 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-171955ca-8a8b-48f5-9b02-ef75bc2aa5b3 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:21.859555 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-171955ca-8a8b-48f5-9b02-ef75bc2aa5b3 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:21.863234 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-171955ca-8a8b-48f5-9b02-ef75bc2aa5b3 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:21.893090 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-171955ca-8a8b-48f5-9b02-ef75bc2aa5b3 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Getting quotas for project 9c853e6ab59d45c084f6f7349f3ef87c. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:37:21.909413 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-171955ca-8a8b-48f5-9b02-ef75bc2aa5b3 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Getting quotas for user 99d8fe44ad7c412d8629159f7529ba81 and project 9c853e6ab59d45c084f6f7349f3ef87c. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:37:21.945261 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-13dac7a0-b0d2-4fc9-bade-4da92d6c5dd0 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:21.984047 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-13dac7a0-b0d2-4fc9-bade-4da92d6c5dd0 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/7b84f450-5c05-4468-b17a-2cd30f2c7f55" status: 200 len: 1316 microversion: 2.1 time: 0.765910 Sep 23 04:37:21.988148 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 807/1669] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:21 2022] GET /compute/v2.1/servers/7b84f450-5c05-4468-b17a-2cd30f2c7f55 => generated 1316 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:22.009262 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7cd10b62-a89c-49cc-a15e-7ec3771c74be tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:22.010031 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7cd10b62-a89c-49cc-a15e-7ec3771c74be tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 9e9a41f2-ff28-4c2a-80aa-193e0ebce466] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:22.042341 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7cd10b62-a89c-49cc-a15e-7ec3771c74be tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:22.043287 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7cd10b62-a89c-49cc-a15e-7ec3771c74be tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:22.047315 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7cd10b62-a89c-49cc-a15e-7ec3771c74be tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:22.049992 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7cd10b62-a89c-49cc-a15e-7ec3771c74be tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:22.052997 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7cd10b62-a89c-49cc-a15e-7ec3771c74be tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:22.055259 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7cd10b62-a89c-49cc-a15e-7ec3771c74be tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:22.279128 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-171955ca-8a8b-48f5-9b02-ef75bc2aa5b3 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Going to run 1 instances... {{(pid=122699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:37:22.289574 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-171955ca-8a8b-48f5-9b02-ef75bc2aa5b3 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] [instance: 53745879-9973-4217-b1c5-b45f917db80e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='8b468b7a-6c3b-4534-9150-7d78c453ca7a',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='61c40555-40bd-4185-a129-ba3e52a069e5',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8a9425c3-8e70-46ae-b109-36ef3def96ee',volume_size=None,volume_type=None)] {{(pid=122699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:37:22.596280 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-7cd10b62-a89c-49cc-a15e-7ec3771c74be tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:22.634876 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-7cd10b62-a89c-49cc-a15e-7ec3771c74be tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:22.638040 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-7cd10b62-a89c-49cc-a15e-7ec3771c74be tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:22.648575 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7cd10b62-a89c-49cc-a15e-7ec3771c74be tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466" status: 200 len: 1486 microversion: 2.25 time: 0.657447 Sep 23 04:37:22.671103 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 808/1670] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:37:21 2022] GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466 => generated 1486 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:37:22.693225 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b6a676e4-725d-4b9c-b86e-e2d752aace89 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:22.693915 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b6a676e4-725d-4b9c-b86e-e2d752aace89 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: 04e9b262-d9e0-434a-bcbb-a85ef9180ee9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:22.709360 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b6a676e4-725d-4b9c-b86e-e2d752aace89 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:22.709875 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b6a676e4-725d-4b9c-b86e-e2d752aace89 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:22.710470 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b6a676e4-725d-4b9c-b86e-e2d752aace89 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:22.711245 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b6a676e4-725d-4b9c-b86e-e2d752aace89 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:22.711704 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b6a676e4-725d-4b9c-b86e-e2d752aace89 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:22.712146 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b6a676e4-725d-4b9c-b86e-e2d752aace89 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:23.063668 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b6a676e4-725d-4b9c-b86e-e2d752aace89 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:23.081602 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b6a676e4-725d-4b9c-b86e-e2d752aace89 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9" status: 200 len: 1719 microversion: 2.1 time: 0.409241 Sep 23 04:37:23.083549 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 809/1671] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:22 2022] GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9 => generated 1719 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:23.090027 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-79fd55a6-c151-4b51-8cd3-20f2049672a1 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:23.107282 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-79fd55a6-c151-4b51-8cd3-20f2049672a1 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 7b84f450-5c05-4468-b17a-2cd30f2c7f55] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:23.119760 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-79fd55a6-c151-4b51-8cd3-20f2049672a1 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:23.129098 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-79fd55a6-c151-4b51-8cd3-20f2049672a1 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:23.129873 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-79fd55a6-c151-4b51-8cd3-20f2049672a1 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:23.134045 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-79fd55a6-c151-4b51-8cd3-20f2049672a1 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:23.135547 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-79fd55a6-c151-4b51-8cd3-20f2049672a1 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:23.137245 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-79fd55a6-c151-4b51-8cd3-20f2049672a1 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:23.426178 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-79fd55a6-c151-4b51-8cd3-20f2049672a1 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:23.438815 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-79fd55a6-c151-4b51-8cd3-20f2049672a1 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/7b84f450-5c05-4468-b17a-2cd30f2c7f55" status: 200 len: 1316 microversion: 2.1 time: 0.353708 Sep 23 04:37:23.439927 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 810/1672] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:23 2022] GET /compute/v2.1/servers/7b84f450-5c05-4468-b17a-2cd30f2c7f55 => generated 1316 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:23.783576 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-98ec67f2-56fc-42a4-bf80-dc87bb20c18b tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-341718377", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "networks": [{"uuid": "a989594a-cd71-405f-a7ac-42f529a758f7"}]}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:37:23.894098 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.network.neutron [None req-98ec67f2-56fc-42a4-bf80-dc87bb20c18b tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] validate_networks() for [('a989594a-cd71-405f-a7ac-42f529a758f7', None, None, None, None, None)] {{(pid=122698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:37:23.943267 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-171955ca-8a8b-48f5-9b02-ef75bc2aa5b3 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.42 time: 8.446949 Sep 23 04:37:23.944821 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 863/1673] 10.222.0.33 () {62 vars in 1189 bytes} [Fri Sep 23 04:37:15 2022] POST /compute/v2.1/servers => generated 405 bytes in 8449 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 23 04:37:23.949694 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-07c75e88-82f7-4507-aa46-4f4b79567aaf tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:23.955136 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-07c75e88-82f7-4507-aa46-4f4b79567aaf tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 9e9a41f2-ff28-4c2a-80aa-193e0ebce466] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:23.970760 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-07c75e88-82f7-4507-aa46-4f4b79567aaf tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:23.974828 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-07c75e88-82f7-4507-aa46-4f4b79567aaf tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:23.975435 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-07c75e88-82f7-4507-aa46-4f4b79567aaf tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:23.976298 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-07c75e88-82f7-4507-aa46-4f4b79567aaf tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:23.976888 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-07c75e88-82f7-4507-aa46-4f4b79567aaf tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:23.983069 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-07c75e88-82f7-4507-aa46-4f4b79567aaf tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:24.498571 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-07c75e88-82f7-4507-aa46-4f4b79567aaf tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:24.514908 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-07c75e88-82f7-4507-aa46-4f4b79567aaf tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:24.521842 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-07c75e88-82f7-4507-aa46-4f4b79567aaf tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:24.523528 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-07c75e88-82f7-4507-aa46-4f4b79567aaf tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466" status: 200 len: 1486 microversion: 2.25 time: 0.577547 Sep 23 04:37:24.529306 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 864/1674] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:37:23 2022] GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466 => generated 1486 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:37:24.937127 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0172b9ca-d25b-432d-8b2e-261a0a9bfe11 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:24.938143 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-0172b9ca-d25b-432d-8b2e-261a0a9bfe11 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: 09076cfa-4632-43c3-919d-4a8fe1b1bd37] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:24.951680 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0172b9ca-d25b-432d-8b2e-261a0a9bfe11 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:24.955636 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0172b9ca-d25b-432d-8b2e-261a0a9bfe11 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:24.956305 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0172b9ca-d25b-432d-8b2e-261a0a9bfe11 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:24.962638 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0172b9ca-d25b-432d-8b2e-261a0a9bfe11 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:24.963287 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0172b9ca-d25b-432d-8b2e-261a0a9bfe11 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:24.963931 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0172b9ca-d25b-432d-8b2e-261a0a9bfe11 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:24.997571 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=4 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:37:25.051099 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-0172b9ca-d25b-432d-8b2e-261a0a9bfe11 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: 09076cfa-4632-43c3-919d-4a8fe1b1bd37] Going to try to terminate instance {{(pid=122699) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:37:25.059470 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-98ec67f2-56fc-42a4-bf80-dc87bb20c18b tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Flavor limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:37:25.060197 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-98ec67f2-56fc-42a4-bf80-dc87bb20c18b tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Image limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:37:25.060708 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-98ec67f2-56fc-42a4-bf80-dc87bb20c18b tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Flavor pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:37:25.061126 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-98ec67f2-56fc-42a4-bf80-dc87bb20c18b tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Image pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:37:25.061547 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-98ec67f2-56fc-42a4-bf80-dc87bb20c18b tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:37:25.080317 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-98ec67f2-56fc-42a4-bf80-dc87bb20c18b tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:25.082012 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-98ec67f2-56fc-42a4-bf80-dc87bb20c18b tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:25.082525 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-98ec67f2-56fc-42a4-bf80-dc87bb20c18b tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:25.084508 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-98ec67f2-56fc-42a4-bf80-dc87bb20c18b tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:25.086757 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-98ec67f2-56fc-42a4-bf80-dc87bb20c18b tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:25.088376 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-98ec67f2-56fc-42a4-bf80-dc87bb20c18b tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:25.131242 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-98ec67f2-56fc-42a4-bf80-dc87bb20c18b tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Getting quotas for project fe698721372f40888dc2918c46e65f2f. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:37:25.167849 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-98ec67f2-56fc-42a4-bf80-dc87bb20c18b tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Getting quotas for user 36526fe612c840fb907e1992d8e62538 and project fe698721372f40888dc2918c46e65f2f. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:37:25.197789 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-98ec67f2-56fc-42a4-bf80-dc87bb20c18b tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Going to run 1 instances... {{(pid=122698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:37:25.205631 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-98ec67f2-56fc-42a4-bf80-dc87bb20c18b tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 19d7387c-9776-4e8e-801d-c959ba47af7f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:37:25.437267 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-98ec67f2-56fc-42a4-bf80-dc87bb20c18b tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.927500 Sep 23 04:37:25.447368 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 811/1675] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:37:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1939 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:37:25.463607 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a9455572-31a9-48d9-b13f-5cd42f62d615 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:25.466747 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a9455572-31a9-48d9-b13f-5cd42f62d615 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] [instance: 53745879-9973-4217-b1c5-b45f917db80e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:25.566630 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0172b9ca-d25b-432d-8b2e-261a0a9bfe11 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "DELETE /compute/v2.1/servers/09076cfa-4632-43c3-919d-4a8fe1b1bd37" status: 204 len: 0 microversion: 2.1 time: 1.031086 Sep 23 04:37:25.566630 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 865/1676] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:37:24 2022] DELETE /compute/v2.1/servers/09076cfa-4632-43c3-919d-4a8fe1b1bd37 => generated 0 bytes in 1036 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:37:25.573943 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4464fbe2-8e28-4849-b500-64ce84f8ab0d tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:25.574657 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4464fbe2-8e28-4849-b500-64ce84f8ab0d tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: 04e9b262-d9e0-434a-bcbb-a85ef9180ee9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:25.575073 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a9455572-31a9-48d9-b13f-5cd42f62d615 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:25.586645 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a9455572-31a9-48d9-b13f-5cd42f62d615 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:25.588376 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a9455572-31a9-48d9-b13f-5cd42f62d615 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:25.590080 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a9455572-31a9-48d9-b13f-5cd42f62d615 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] 10.222.0.33 "GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e" status: 200 len: 1284 microversion: 2.42 time: 0.141397 Sep 23 04:37:25.591869 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 812/1677] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:37:25 2022] GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e => generated 1284 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:37:25.592898 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4464fbe2-8e28-4849-b500-64ce84f8ab0d tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:25.593460 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4464fbe2-8e28-4849-b500-64ce84f8ab0d tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:25.593937 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4464fbe2-8e28-4849-b500-64ce84f8ab0d tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:25.594682 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4464fbe2-8e28-4849-b500-64ce84f8ab0d tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:25.595147 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4464fbe2-8e28-4849-b500-64ce84f8ab0d tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:25.595579 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4464fbe2-8e28-4849-b500-64ce84f8ab0d tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:25.598953 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-78da9e45-28e5-4596-87c5-21ee7a480b95 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:25.599883 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-78da9e45-28e5-4596-87c5-21ee7a480b95 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 7b84f450-5c05-4468-b17a-2cd30f2c7f55] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:25.607782 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-78da9e45-28e5-4596-87c5-21ee7a480b95 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:25.608831 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-78da9e45-28e5-4596-87c5-21ee7a480b95 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:25.609450 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-78da9e45-28e5-4596-87c5-21ee7a480b95 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:25.610387 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-78da9e45-28e5-4596-87c5-21ee7a480b95 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:25.613878 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-78da9e45-28e5-4596-87c5-21ee7a480b95 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:25.619449 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-78da9e45-28e5-4596-87c5-21ee7a480b95 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:25.646999 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=100 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:37:25.942293 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-4464fbe2-8e28-4849-b500-64ce84f8ab0d tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:25.963622 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4464fbe2-8e28-4849-b500-64ce84f8ab0d tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9" status: 200 len: 1719 microversion: 2.1 time: 0.396148 Sep 23 04:37:25.967659 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 866/1678] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:25 2022] GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9 => generated 1719 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:25.982312 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9f2bb471-332d-482c-8956-bb96638d41b6 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:25.984495 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-9f2bb471-332d-482c-8956-bb96638d41b6 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 19d7387c-9776-4e8e-801d-c959ba47af7f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:25.999823 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-78da9e45-28e5-4596-87c5-21ee7a480b95 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:26.009431 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-78da9e45-28e5-4596-87c5-21ee7a480b95 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/7b84f450-5c05-4468-b17a-2cd30f2c7f55" status: 200 len: 1316 microversion: 2.1 time: 0.416229 Sep 23 04:37:26.010055 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 813/1679] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:25 2022] GET /compute/v2.1/servers/7b84f450-5c05-4468-b17a-2cd30f2c7f55 => generated 1316 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:26.017537 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-11117244-5051-4b18-8450-a3c761bd29f6 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:26.018616 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-11117244-5051-4b18-8450-a3c761bd29f6 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 9e9a41f2-ff28-4c2a-80aa-193e0ebce466] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:26.038434 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-11117244-5051-4b18-8450-a3c761bd29f6 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:26.045706 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-11117244-5051-4b18-8450-a3c761bd29f6 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:26.046542 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-11117244-5051-4b18-8450-a3c761bd29f6 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:26.047553 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-11117244-5051-4b18-8450-a3c761bd29f6 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:26.052077 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-11117244-5051-4b18-8450-a3c761bd29f6 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:26.052792 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-11117244-5051-4b18-8450-a3c761bd29f6 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:26.110467 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-9f2bb471-332d-482c-8956-bb96638d41b6 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:26.117823 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-9f2bb471-332d-482c-8956-bb96638d41b6 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/19d7387c-9776-4e8e-801d-c959ba47af7f" status: 200 len: 1214 microversion: 2.1 time: 0.139767 Sep 23 04:37:26.126735 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 867/1680] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:25 2022] GET /compute/v2.1/servers/19d7387c-9776-4e8e-801d-c959ba47af7f => generated 1214 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:26.132462 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0b217602-c761-4b23-a82b-331a29e44798 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:26.133281 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-0b217602-c761-4b23-a82b-331a29e44798 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: 09076cfa-4632-43c3-919d-4a8fe1b1bd37] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:26.148731 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0b217602-c761-4b23-a82b-331a29e44798 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:26.149510 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0b217602-c761-4b23-a82b-331a29e44798 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:26.151071 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0b217602-c761-4b23-a82b-331a29e44798 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:26.151071 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0b217602-c761-4b23-a82b-331a29e44798 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:26.151267 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0b217602-c761-4b23-a82b-331a29e44798 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:26.151688 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0b217602-c761-4b23-a82b-331a29e44798 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:26.532575 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-11117244-5051-4b18-8450-a3c761bd29f6 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:26.549361 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-11117244-5051-4b18-8450-a3c761bd29f6 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:26.556061 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-11117244-5051-4b18-8450-a3c761bd29f6 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:26.557851 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-11117244-5051-4b18-8450-a3c761bd29f6 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466" status: 200 len: 1486 microversion: 2.25 time: 0.544260 Sep 23 04:37:26.559285 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 814/1681] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:37:26 2022] GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466 => generated 1486 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:37:26.590925 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-36b98ba2-36e8-490c-bb31-5d5d85498061 req-ba945fa0-fd7a-413b-83cc-705c2fa445d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b84f450-5c05-4468-b17a-2cd30f2c7f55", "tag": "f0e6646b-bac8-416d-8099-7beba99a6c8c"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:37:26.667286 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-36b98ba2-36e8-490c-bb31-5d5d85498061 req-ba945fa0-fd7a-413b-83cc-705c2fa445d4 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:26.670649 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-36b98ba2-36e8-490c-bb31-5d5d85498061 req-ba945fa0-fd7a-413b-83cc-705c2fa445d4 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.045s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:26.676012 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-36b98ba2-36e8-490c-bb31-5d5d85498061 req-ba945fa0-fd7a-413b-83cc-705c2fa445d4 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:26.706404 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-0b217602-c761-4b23-a82b-331a29e44798 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:26.716510 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-36b98ba2-36e8-490c-bb31-5d5d85498061 req-ba945fa0-fd7a-413b-83cc-705c2fa445d4 service nova] Creating event network-changed:f0e6646b-bac8-416d-8099-7beba99a6c8c for instance 7b84f450-5c05-4468-b17a-2cd30f2c7f55 on n-h2-846463-3 Sep 23 04:37:26.757776 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-36b98ba2-36e8-490c-bb31-5d5d85498061 req-ba945fa0-fd7a-413b-83cc-705c2fa445d4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.194119 Sep 23 04:37:26.758709 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 815/1682] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:37:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:37:26.771344 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0b217602-c761-4b23-a82b-331a29e44798 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/09076cfa-4632-43c3-919d-4a8fe1b1bd37" status: 200 len: 1469 microversion: 2.1 time: 0.643058 Sep 23 04:37:26.789249 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 868/1683] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:26 2022] GET /compute/v2.1/servers/09076cfa-4632-43c3-919d-4a8fe1b1bd37 => generated 1469 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:26.793930 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7de9198c-9dec-4287-87cd-f6e6c201f6de tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:26.799369 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7de9198c-9dec-4287-87cd-f6e6c201f6de tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] [instance: 53745879-9973-4217-b1c5-b45f917db80e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:27.000135 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ee8df9d2-ddc2-43ac-ad13-0cdd0fe6e4d7 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:27.000763 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ee8df9d2-ddc2-43ac-ad13-0cdd0fe6e4d7 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: 04e9b262-d9e0-434a-bcbb-a85ef9180ee9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:27.003019 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-7de9198c-9dec-4287-87cd-f6e6c201f6de tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:27.015228 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-7de9198c-9dec-4287-87cd-f6e6c201f6de tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:27.020672 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-7de9198c-9dec-4287-87cd-f6e6c201f6de tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:27.020672 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7de9198c-9dec-4287-87cd-f6e6c201f6de tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] 10.222.0.33 "GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e" status: 200 len: 1284 microversion: 2.42 time: 0.255418 Sep 23 04:37:27.037157 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ee8df9d2-ddc2-43ac-ad13-0cdd0fe6e4d7 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:27.039673 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ee8df9d2-ddc2-43ac-ad13-0cdd0fe6e4d7 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:27.049174 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ee8df9d2-ddc2-43ac-ad13-0cdd0fe6e4d7 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:27.049174 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ee8df9d2-ddc2-43ac-ad13-0cdd0fe6e4d7 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:27.049174 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ee8df9d2-ddc2-43ac-ad13-0cdd0fe6e4d7 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:27.049174 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ee8df9d2-ddc2-43ac-ad13-0cdd0fe6e4d7 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:27.049732 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 816/1684] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:37:26 2022] GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e => generated 1284 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:37:27.055748 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-90b9a6f6-2041-4524-aa8d-9ab96e1acd12 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:27.062352 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-90b9a6f6-2041-4524-aa8d-9ab96e1acd12 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 7b84f450-5c05-4468-b17a-2cd30f2c7f55] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:27.078849 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-90b9a6f6-2041-4524-aa8d-9ab96e1acd12 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:27.086868 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-90b9a6f6-2041-4524-aa8d-9ab96e1acd12 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:27.089287 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-90b9a6f6-2041-4524-aa8d-9ab96e1acd12 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:27.090388 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-90b9a6f6-2041-4524-aa8d-9ab96e1acd12 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:27.093822 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-90b9a6f6-2041-4524-aa8d-9ab96e1acd12 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:27.094891 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-90b9a6f6-2041-4524-aa8d-9ab96e1acd12 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:27.558375 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ee8df9d2-ddc2-43ac-ad13-0cdd0fe6e4d7 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:27.570825 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ee8df9d2-ddc2-43ac-ad13-0cdd0fe6e4d7 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9" status: 200 len: 1719 microversion: 2.1 time: 0.579520 Sep 23 04:37:27.594831 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 869/1685] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:26 2022] GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9 => generated 1719 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:27.601126 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-eb8ab739-1cec-4dec-833a-56bf702d8585 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:27.611861 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-eb8ab739-1cec-4dec-833a-56bf702d8585 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 19d7387c-9776-4e8e-801d-c959ba47af7f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:27.630314 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-90b9a6f6-2041-4524-aa8d-9ab96e1acd12 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:27.639760 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-90b9a6f6-2041-4524-aa8d-9ab96e1acd12 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/7b84f450-5c05-4468-b17a-2cd30f2c7f55" status: 200 len: 1316 microversion: 2.1 time: 0.594269 Sep 23 04:37:27.649372 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 817/1686] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:27 2022] GET /compute/v2.1/servers/7b84f450-5c05-4468-b17a-2cd30f2c7f55 => generated 1316 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:27.682418 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-fb462d98-8ebc-4824-85d3-a57b5d05d01a tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:27.689640 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-fb462d98-8ebc-4824-85d3-a57b5d05d01a tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 9e9a41f2-ff28-4c2a-80aa-193e0ebce466] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:27.692441 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fb462d98-8ebc-4824-85d3-a57b5d05d01a tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:27.694493 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fb462d98-8ebc-4824-85d3-a57b5d05d01a tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:27.699351 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fb462d98-8ebc-4824-85d3-a57b5d05d01a tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:27.700492 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fb462d98-8ebc-4824-85d3-a57b5d05d01a tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:27.704867 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fb462d98-8ebc-4824-85d3-a57b5d05d01a tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:27.705606 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fb462d98-8ebc-4824-85d3-a57b5d05d01a tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:27.779686 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-eb8ab739-1cec-4dec-833a-56bf702d8585 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:27.794310 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-eb8ab739-1cec-4dec-833a-56bf702d8585 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/19d7387c-9776-4e8e-801d-c959ba47af7f" status: 200 len: 1214 microversion: 2.1 time: 0.200523 Sep 23 04:37:27.795203 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 870/1687] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:27 2022] GET /compute/v2.1/servers/19d7387c-9776-4e8e-801d-c959ba47af7f => generated 1214 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:27.811406 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-41c3f089-ecb1-4654-9d04-cac732f06dab tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:27.812524 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-41c3f089-ecb1-4654-9d04-cac732f06dab tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: 09076cfa-4632-43c3-919d-4a8fe1b1bd37] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:27.823817 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-41c3f089-ecb1-4654-9d04-cac732f06dab tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:27.829698 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-41c3f089-ecb1-4654-9d04-cac732f06dab tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:27.829698 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-41c3f089-ecb1-4654-9d04-cac732f06dab tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:27.829698 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-41c3f089-ecb1-4654-9d04-cac732f06dab tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:27.830371 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-41c3f089-ecb1-4654-9d04-cac732f06dab tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:27.831063 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-41c3f089-ecb1-4654-9d04-cac732f06dab tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:28.391841 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-fb462d98-8ebc-4824-85d3-a57b5d05d01a tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:28.401087 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-fb462d98-8ebc-4824-85d3-a57b5d05d01a tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:28.402589 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-fb462d98-8ebc-4824-85d3-a57b5d05d01a tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:28.403776 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-fb462d98-8ebc-4824-85d3-a57b5d05d01a tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466" status: 200 len: 1486 microversion: 2.25 time: 0.733629 Sep 23 04:37:28.415449 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 818/1688] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:37:27 2022] GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466 => generated 1486 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:37:28.420793 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f7d38d74-1593-4b1c-a54a-466af46b6cce tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:28.427315 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f7d38d74-1593-4b1c-a54a-466af46b6cce tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] [instance: 53745879-9973-4217-b1c5-b45f917db80e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:28.429299 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-41c3f089-ecb1-4654-9d04-cac732f06dab tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:28.440191 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-41c3f089-ecb1-4654-9d04-cac732f06dab tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/09076cfa-4632-43c3-919d-4a8fe1b1bd37" status: 200 len: 1469 microversion: 2.1 time: 0.643938 Sep 23 04:37:28.441868 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f7d38d74-1593-4b1c-a54a-466af46b6cce tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:28.442408 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f7d38d74-1593-4b1c-a54a-466af46b6cce tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:28.442906 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f7d38d74-1593-4b1c-a54a-466af46b6cce tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:28.444407 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f7d38d74-1593-4b1c-a54a-466af46b6cce tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:28.448181 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f7d38d74-1593-4b1c-a54a-466af46b6cce tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:28.449239 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 871/1689] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:27 2022] GET /compute/v2.1/servers/09076cfa-4632-43c3-919d-4a8fe1b1bd37 => generated 1469 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:28.453353 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f7d38d74-1593-4b1c-a54a-466af46b6cce tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:28.604065 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-cdd8c3c5-a299-4c31-9025-409bcac2b488 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:28.608834 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-cdd8c3c5-a299-4c31-9025-409bcac2b488 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: 04e9b262-d9e0-434a-bcbb-a85ef9180ee9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:28.643211 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cdd8c3c5-a299-4c31-9025-409bcac2b488 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:28.649059 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cdd8c3c5-a299-4c31-9025-409bcac2b488 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:28.649810 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cdd8c3c5-a299-4c31-9025-409bcac2b488 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:28.650792 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cdd8c3c5-a299-4c31-9025-409bcac2b488 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:28.652745 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cdd8c3c5-a299-4c31-9025-409bcac2b488 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:28.653182 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cdd8c3c5-a299-4c31-9025-409bcac2b488 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:28.687455 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f7d38d74-1593-4b1c-a54a-466af46b6cce tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:28.711018 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f7d38d74-1593-4b1c-a54a-466af46b6cce tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:28.711018 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f7d38d74-1593-4b1c-a54a-466af46b6cce tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:28.714700 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f7d38d74-1593-4b1c-a54a-466af46b6cce tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] 10.222.0.33 "GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e" status: 200 len: 1518 microversion: 2.42 time: 0.292695 Sep 23 04:37:28.715352 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 819/1690] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:37:28 2022] GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e => generated 1518 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:37:28.733528 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1f1cc58d-e854-4582-a725-027815bdb0de tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:28.737077 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-1f1cc58d-e854-4582-a725-027815bdb0de tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 7b84f450-5c05-4468-b17a-2cd30f2c7f55] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:28.754335 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1f1cc58d-e854-4582-a725-027815bdb0de tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:28.755003 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1f1cc58d-e854-4582-a725-027815bdb0de tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:28.755532 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1f1cc58d-e854-4582-a725-027815bdb0de tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:28.757845 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1f1cc58d-e854-4582-a725-027815bdb0de tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:28.758422 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1f1cc58d-e854-4582-a725-027815bdb0de tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:28.758861 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1f1cc58d-e854-4582-a725-027815bdb0de tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:28.943781 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-cdd8c3c5-a299-4c31-9025-409bcac2b488 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:28.955594 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-cdd8c3c5-a299-4c31-9025-409bcac2b488 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9" status: 200 len: 1719 microversion: 2.1 time: 0.361259 Sep 23 04:37:28.959447 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 872/1691] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:28 2022] GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9 => generated 1719 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:37:28.965245 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-1f1cc58d-e854-4582-a725-027815bdb0de tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:28.967333 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-492476ca-1a7e-4f4f-8583-30d46d494c08 req-5b6a98b2-3f95-4ac0-9de6-c1b8c15fc32f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04e9b262-d9e0-434a-bcbb-a85ef9180ee9", "name": "network-vif-unplugged", "status": "completed", "tag": "ef809f4d-5127-48f1-a968-99867a38928e"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:37:28.978221 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-1f1cc58d-e854-4582-a725-027815bdb0de tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/7b84f450-5c05-4468-b17a-2cd30f2c7f55" status: 200 len: 1316 microversion: 2.1 time: 0.261606 Sep 23 04:37:28.981539 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 820/1692] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:28 2022] GET /compute/v2.1/servers/7b84f450-5c05-4468-b17a-2cd30f2c7f55 => generated 1316 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:28.991980 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-492476ca-1a7e-4f4f-8583-30d46d494c08 req-5b6a98b2-3f95-4ac0-9de6-c1b8c15fc32f service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:28.995184 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-da252bf2-4b33-4f36-8f52-b0da15c80493 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:28.995791 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-492476ca-1a7e-4f4f-8583-30d46d494c08 req-5b6a98b2-3f95-4ac0-9de6-c1b8c15fc32f service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:28.996320 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-492476ca-1a7e-4f4f-8583-30d46d494c08 req-5b6a98b2-3f95-4ac0-9de6-c1b8c15fc32f service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:28.996461 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-da252bf2-4b33-4f36-8f52-b0da15c80493 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 19d7387c-9776-4e8e-801d-c959ba47af7f] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:29.003685 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-da252bf2-4b33-4f36-8f52-b0da15c80493 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:29.004328 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-da252bf2-4b33-4f36-8f52-b0da15c80493 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:29.005021 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-da252bf2-4b33-4f36-8f52-b0da15c80493 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:29.007344 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-da252bf2-4b33-4f36-8f52-b0da15c80493 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:29.008088 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-da252bf2-4b33-4f36-8f52-b0da15c80493 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:29.011217 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-da252bf2-4b33-4f36-8f52-b0da15c80493 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:29.021291 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-492476ca-1a7e-4f4f-8583-30d46d494c08 req-5b6a98b2-3f95-4ac0-9de6-c1b8c15fc32f service nova] Creating event network-vif-unplugged:ef809f4d-5127-48f1-a968-99867a38928e for instance 04e9b262-d9e0-434a-bcbb-a85ef9180ee9 on n-h2-846463-3 Sep 23 04:37:29.035539 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-492476ca-1a7e-4f4f-8583-30d46d494c08 req-5b6a98b2-3f95-4ac0-9de6-c1b8c15fc32f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.073983 Sep 23 04:37:29.036536 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 873/1693] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:37:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:37:29.097986 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-da252bf2-4b33-4f36-8f52-b0da15c80493 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:29.108819 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-da252bf2-4b33-4f36-8f52-b0da15c80493 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/19d7387c-9776-4e8e-801d-c959ba47af7f" status: 200 len: 1210 microversion: 2.1 time: 0.118133 Sep 23 04:37:29.110662 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 821/1694] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:28 2022] GET /compute/v2.1/servers/19d7387c-9776-4e8e-801d-c959ba47af7f => generated 1210 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:29.445494 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b3d36920-11c6-4b94-9673-0dd9bc39f949 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:29.446231 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b3d36920-11c6-4b94-9673-0dd9bc39f949 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 9e9a41f2-ff28-4c2a-80aa-193e0ebce466] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:29.452581 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b3d36920-11c6-4b94-9673-0dd9bc39f949 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:29.453302 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b3d36920-11c6-4b94-9673-0dd9bc39f949 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:29.453747 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b3d36920-11c6-4b94-9673-0dd9bc39f949 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:29.454534 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b3d36920-11c6-4b94-9673-0dd9bc39f949 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:29.455172 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b3d36920-11c6-4b94-9673-0dd9bc39f949 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:29.455761 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b3d36920-11c6-4b94-9673-0dd9bc39f949 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:29.484284 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4646558e-c0f8-4b46-bfc8-1cf3235f9566 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:29.485258 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4646558e-c0f8-4b46-bfc8-1cf3235f9566 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: 09076cfa-4632-43c3-919d-4a8fe1b1bd37] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:29.496171 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4646558e-c0f8-4b46-bfc8-1cf3235f9566 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:29.496822 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4646558e-c0f8-4b46-bfc8-1cf3235f9566 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:29.497762 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4646558e-c0f8-4b46-bfc8-1cf3235f9566 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:29.499616 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4646558e-c0f8-4b46-bfc8-1cf3235f9566 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:29.501293 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4646558e-c0f8-4b46-bfc8-1cf3235f9566 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:29.502003 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4646558e-c0f8-4b46-bfc8-1cf3235f9566 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:29.604577 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4646558e-c0f8-4b46-bfc8-1cf3235f9566 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:29.632012 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4646558e-c0f8-4b46-bfc8-1cf3235f9566 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/09076cfa-4632-43c3-919d-4a8fe1b1bd37" status: 200 len: 1427 microversion: 2.1 time: 0.155743 Sep 23 04:37:29.632504 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 822/1695] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:29 2022] GET /compute/v2.1/servers/09076cfa-4632-43c3-919d-4a8fe1b1bd37 => generated 1427 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:29.679401 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b3d36920-11c6-4b94-9673-0dd9bc39f949 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:29.687262 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b3d36920-11c6-4b94-9673-0dd9bc39f949 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:29.689549 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b3d36920-11c6-4b94-9673-0dd9bc39f949 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:29.691666 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b3d36920-11c6-4b94-9673-0dd9bc39f949 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466" status: 200 len: 1486 microversion: 2.25 time: 0.249851 Sep 23 04:37:29.692975 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 874/1696] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:37:29 2022] GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466 => generated 1486 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:37:29.757689 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ae94d09b-9039-4689-9775-ee8d0a4c122c tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:29.758349 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-ae94d09b-9039-4689-9775-ee8d0a4c122c tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] [instance: 53745879-9973-4217-b1c5-b45f917db80e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:29.764995 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ae94d09b-9039-4689-9775-ee8d0a4c122c tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:29.765768 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ae94d09b-9039-4689-9775-ee8d0a4c122c tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:29.766296 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ae94d09b-9039-4689-9775-ee8d0a4c122c tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:29.767191 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ae94d09b-9039-4689-9775-ee8d0a4c122c tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:29.767674 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ae94d09b-9039-4689-9775-ee8d0a4c122c tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:29.768094 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ae94d09b-9039-4689-9775-ee8d0a4c122c tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:29.851967 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ae94d09b-9039-4689-9775-ee8d0a4c122c tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:29.863320 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ae94d09b-9039-4689-9775-ee8d0a4c122c tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:29.864963 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ae94d09b-9039-4689-9775-ee8d0a4c122c tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:29.866297 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ae94d09b-9039-4689-9775-ee8d0a4c122c tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] 10.222.0.33 "GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e" status: 200 len: 1574 microversion: 2.42 time: 0.118062 Sep 23 04:37:29.880774 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 823/1697] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:37:29 2022] GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e => generated 1574 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:37:29.985212 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-57111abb-b8d5-42de-9354-5b0629224eb9 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:29.985212 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-57111abb-b8d5-42de-9354-5b0629224eb9 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: 04e9b262-d9e0-434a-bcbb-a85ef9180ee9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:29.991754 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-57111abb-b8d5-42de-9354-5b0629224eb9 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:29.992260 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-57111abb-b8d5-42de-9354-5b0629224eb9 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:29.992705 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-57111abb-b8d5-42de-9354-5b0629224eb9 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:29.993573 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-57111abb-b8d5-42de-9354-5b0629224eb9 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:29.994104 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-57111abb-b8d5-42de-9354-5b0629224eb9 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:29.994556 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-57111abb-b8d5-42de-9354-5b0629224eb9 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:30.013263 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a89fd150-f523-4f48-a7ba-32fdea7d9e4e tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:30.014270 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a89fd150-f523-4f48-a7ba-32fdea7d9e4e tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 7b84f450-5c05-4468-b17a-2cd30f2c7f55] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:30.020952 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a89fd150-f523-4f48-a7ba-32fdea7d9e4e tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:30.021718 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a89fd150-f523-4f48-a7ba-32fdea7d9e4e tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:30.022404 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a89fd150-f523-4f48-a7ba-32fdea7d9e4e tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:30.023336 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a89fd150-f523-4f48-a7ba-32fdea7d9e4e tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:30.024012 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a89fd150-f523-4f48-a7ba-32fdea7d9e4e tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:30.024641 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a89fd150-f523-4f48-a7ba-32fdea7d9e4e tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:30.187477 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-57111abb-b8d5-42de-9354-5b0629224eb9 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:30.208688 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-57111abb-b8d5-42de-9354-5b0629224eb9 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9" status: 200 len: 1719 microversion: 2.1 time: 0.232172 Sep 23 04:37:30.222315 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 875/1698] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:29 2022] GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9 => generated 1719 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:30.222315 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-15186814-1c32-459b-95bc-4b34c8f10c5f tempest-VolumesTestJSON-1808526912 tempest-VolumesTestJSON-1808526912-project] Calling method '.version_select at 0x7ff1bb733af0>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:30.227399 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a89fd150-f523-4f48-a7ba-32fdea7d9e4e tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:30.235706 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a89fd150-f523-4f48-a7ba-32fdea7d9e4e tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/7b84f450-5c05-4468-b17a-2cd30f2c7f55" status: 200 len: 1316 microversion: 2.1 time: 0.228292 Sep 23 04:37:30.236574 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 824/1699] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:30 2022] GET /compute/v2.1/servers/7b84f450-5c05-4468-b17a-2cd30f2c7f55 => generated 1316 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:30.241600 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-215805b6-2a84-4d08-ae94-1d5bc6b797aa tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:30.242234 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-215805b6-2a84-4d08-ae94-1d5bc6b797aa tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 19d7387c-9776-4e8e-801d-c959ba47af7f] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:30.248584 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-215805b6-2a84-4d08-ae94-1d5bc6b797aa tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:30.249285 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-215805b6-2a84-4d08-ae94-1d5bc6b797aa tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:30.249999 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-215805b6-2a84-4d08-ae94-1d5bc6b797aa tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:30.250880 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-215805b6-2a84-4d08-ae94-1d5bc6b797aa tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:30.251508 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-215805b6-2a84-4d08-ae94-1d5bc6b797aa tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:30.252103 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-215805b6-2a84-4d08-ae94-1d5bc6b797aa tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:30.277274 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-15186814-1c32-459b-95bc-4b34c8f10c5f tempest-VolumesTestJSON-1808526912 tempest-VolumesTestJSON-1808526912-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/09cb8a35-a721-4beb-99d8-f0b94fcbae07" status: 200 len: 350 microversion: 2.1 time: 0.063920 Sep 23 04:37:30.278269 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 876/1700] 10.222.0.33 () {58 vars in 1245 bytes} [Fri Sep 23 04:37:30 2022] GET /compute/v2.1/os-volumes/09cb8a35-a721-4beb-99d8-f0b94fcbae07 => generated 350 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:37:30.319656 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-215805b6-2a84-4d08-ae94-1d5bc6b797aa tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:30.328779 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-215805b6-2a84-4d08-ae94-1d5bc6b797aa tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/19d7387c-9776-4e8e-801d-c959ba47af7f" status: 200 len: 1210 microversion: 2.1 time: 0.090369 Sep 23 04:37:30.334482 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 825/1701] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:30 2022] GET /compute/v2.1/servers/19d7387c-9776-4e8e-801d-c959ba47af7f => generated 1210 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:30.657989 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7ad56387-fd7a-4487-8fe6-ec083c956021 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:30.659319 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-7ad56387-fd7a-4487-8fe6-ec083c956021 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: 09076cfa-4632-43c3-919d-4a8fe1b1bd37] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:30.668091 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7ad56387-fd7a-4487-8fe6-ec083c956021 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:30.668909 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7ad56387-fd7a-4487-8fe6-ec083c956021 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:30.670471 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7ad56387-fd7a-4487-8fe6-ec083c956021 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:30.672157 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7ad56387-fd7a-4487-8fe6-ec083c956021 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:30.672902 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7ad56387-fd7a-4487-8fe6-ec083c956021 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:30.682050 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7ad56387-fd7a-4487-8fe6-ec083c956021 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:30.717279 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b3f314d0-2f38-4f77-acfd-4e74d43c1c50 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:30.717879 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b3f314d0-2f38-4f77-acfd-4e74d43c1c50 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 9e9a41f2-ff28-4c2a-80aa-193e0ebce466] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:30.720557 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:37:30.730736 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b3f314d0-2f38-4f77-acfd-4e74d43c1c50 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:30.731361 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b3f314d0-2f38-4f77-acfd-4e74d43c1c50 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:30.731854 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7ad56387-fd7a-4487-8fe6-ec083c956021 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:30.732477 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b3f314d0-2f38-4f77-acfd-4e74d43c1c50 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:30.732972 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7ad56387-fd7a-4487-8fe6-ec083c956021 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:30.733426 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7ad56387-fd7a-4487-8fe6-ec083c956021 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:30.734128 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-7ad56387-fd7a-4487-8fe6-ec083c956021 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lazy-loading 'fault' on Instance uuid 09076cfa-4632-43c3-919d-4a8fe1b1bd37 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:37:30.734699 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b3f314d0-2f38-4f77-acfd-4e74d43c1c50 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:30.735244 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b3f314d0-2f38-4f77-acfd-4e74d43c1c50 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:30.737425 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b3f314d0-2f38-4f77-acfd-4e74d43c1c50 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:30.830099 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-7ad56387-fd7a-4487-8fe6-ec083c956021 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:30.841450 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-7ad56387-fd7a-4487-8fe6-ec083c956021 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/09076cfa-4632-43c3-919d-4a8fe1b1bd37" status: 200 len: 1303 microversion: 2.1 time: 0.188211 Sep 23 04:37:30.842951 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 877/1702] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:30 2022] GET /compute/v2.1/servers/09076cfa-4632-43c3-919d-4a8fe1b1bd37 => generated 1303 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:30.907765 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-dd7cd1a0-d214-4a54-8083-38b511c984ed tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:30.911460 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-dd7cd1a0-d214-4a54-8083-38b511c984ed tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] [instance: 53745879-9973-4217-b1c5-b45f917db80e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:30.932045 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dd7cd1a0-d214-4a54-8083-38b511c984ed tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:30.935054 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dd7cd1a0-d214-4a54-8083-38b511c984ed tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:30.935839 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dd7cd1a0-d214-4a54-8083-38b511c984ed tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:30.936778 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dd7cd1a0-d214-4a54-8083-38b511c984ed tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:30.938157 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dd7cd1a0-d214-4a54-8083-38b511c984ed tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:30.939404 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dd7cd1a0-d214-4a54-8083-38b511c984ed tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:31.169652 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b3f314d0-2f38-4f77-acfd-4e74d43c1c50 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:31.179033 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b3f314d0-2f38-4f77-acfd-4e74d43c1c50 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:31.185038 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b3f314d0-2f38-4f77-acfd-4e74d43c1c50 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:31.190242 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b3f314d0-2f38-4f77-acfd-4e74d43c1c50 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466" status: 200 len: 1486 microversion: 2.25 time: 0.476775 Sep 23 04:37:31.191402 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 826/1703] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:37:30 2022] GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466 => generated 1486 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:37:31.197459 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-616e9a0d-e5d3-4ad7-ba4d-bd3b28b4065b req-63c3bf17-60a6-4bfc-99d9-b5819ee863ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04e9b262-d9e0-434a-bcbb-a85ef9180ee9", "tag": "ef809f4d-5127-48f1-a968-99867a38928e"}, {"server_uuid": "09076cfa-4632-43c3-919d-4a8fe1b1bd37", "name": "network-vif-deleted", "tag": "2103b7aa-15ef-4fad-b8eb-cd88ce8168a2"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:37:31.214817 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-616e9a0d-e5d3-4ad7-ba4d-bd3b28b4065b req-63c3bf17-60a6-4bfc-99d9-b5819ee863ab service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:31.215771 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-616e9a0d-e5d3-4ad7-ba4d-bd3b28b4065b req-63c3bf17-60a6-4bfc-99d9-b5819ee863ab service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:31.216429 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-616e9a0d-e5d3-4ad7-ba4d-bd3b28b4065b req-63c3bf17-60a6-4bfc-99d9-b5819ee863ab service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:31.217913 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-dd7cd1a0-d214-4a54-8083-38b511c984ed tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:31.236259 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-dd7cd1a0-d214-4a54-8083-38b511c984ed tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:31.238664 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-dd7cd1a0-d214-4a54-8083-38b511c984ed tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:31.239925 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-dd7cd1a0-d214-4a54-8083-38b511c984ed tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] 10.222.0.33 "GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e" status: 200 len: 1582 microversion: 2.42 time: 0.347307 Sep 23 04:37:31.240505 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 878/1704] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:37:30 2022] GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e => generated 1582 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:37:31.264116 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-616e9a0d-e5d3-4ad7-ba4d-bd3b28b4065b req-63c3bf17-60a6-4bfc-99d9-b5819ee863ab service nova] Creating event network-changed:ef809f4d-5127-48f1-a968-99867a38928e for instance 04e9b262-d9e0-434a-bcbb-a85ef9180ee9 on n-h2-846463-3 Sep 23 04:37:31.266081 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f87d173f-2427-4e38-8a30-871d6ca1313e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:31.266900 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f87d173f-2427-4e38-8a30-871d6ca1313e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: 04e9b262-d9e0-434a-bcbb-a85ef9180ee9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:31.287280 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-616e9a0d-e5d3-4ad7-ba4d-bd3b28b4065b req-63c3bf17-60a6-4bfc-99d9-b5819ee863ab service nova] Creating event network-vif-deleted:2103b7aa-15ef-4fad-b8eb-cd88ce8168a2 for instance 09076cfa-4632-43c3-919d-4a8fe1b1bd37 on n-h2-846463-3 Sep 23 04:37:31.301336 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-616e9a0d-e5d3-4ad7-ba4d-bd3b28b4065b req-63c3bf17-60a6-4bfc-99d9-b5819ee863ab service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.108105 Sep 23 04:37:31.303433 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 827/1705] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:37:31 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:37:31.307510 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f87d173f-2427-4e38-8a30-871d6ca1313e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:31.308076 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f87d173f-2427-4e38-8a30-871d6ca1313e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:31.308528 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f87d173f-2427-4e38-8a30-871d6ca1313e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:31.309303 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-729fb866-cd74-464b-a863-b0a4b1aef33a tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:31.309480 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f87d173f-2427-4e38-8a30-871d6ca1313e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:31.310012 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f87d173f-2427-4e38-8a30-871d6ca1313e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:31.310454 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f87d173f-2427-4e38-8a30-871d6ca1313e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:31.310787 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-729fb866-cd74-464b-a863-b0a4b1aef33a tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 7b84f450-5c05-4468-b17a-2cd30f2c7f55] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:31.325698 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-729fb866-cd74-464b-a863-b0a4b1aef33a tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:31.327444 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-729fb866-cd74-464b-a863-b0a4b1aef33a tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:31.330876 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-729fb866-cd74-464b-a863-b0a4b1aef33a tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:31.334961 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-729fb866-cd74-464b-a863-b0a4b1aef33a tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:31.335730 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-729fb866-cd74-464b-a863-b0a4b1aef33a tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:31.336292 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-729fb866-cd74-464b-a863-b0a4b1aef33a tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:31.740427 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f87d173f-2427-4e38-8a30-871d6ca1313e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:31.751370 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f87d173f-2427-4e38-8a30-871d6ca1313e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9" status: 200 len: 1719 microversion: 2.1 time: 0.508195 Sep 23 04:37:31.758734 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-729fb866-cd74-464b-a863-b0a4b1aef33a tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:31.768130 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-729fb866-cd74-464b-a863-b0a4b1aef33a tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/7b84f450-5c05-4468-b17a-2cd30f2c7f55" status: 200 len: 1316 microversion: 2.1 time: 0.463397 Sep 23 04:37:31.771600 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 828/1706] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:31 2022] GET /compute/v2.1/servers/7b84f450-5c05-4468-b17a-2cd30f2c7f55 => generated 1316 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:31.787262 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-298c205f-a752-4aa5-8a9f-b3c5afaa763f tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:31.788214 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-298c205f-a752-4aa5-8a9f-b3c5afaa763f tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 19d7387c-9776-4e8e-801d-c959ba47af7f] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:31.789310 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 879/1707] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:31 2022] GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9 => generated 1719 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:31.800700 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-298c205f-a752-4aa5-8a9f-b3c5afaa763f tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:31.801511 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-298c205f-a752-4aa5-8a9f-b3c5afaa763f tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:31.803825 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-298c205f-a752-4aa5-8a9f-b3c5afaa763f tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:31.804774 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-298c205f-a752-4aa5-8a9f-b3c5afaa763f tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:31.806569 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-298c205f-a752-4aa5-8a9f-b3c5afaa763f tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:31.813524 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-298c205f-a752-4aa5-8a9f-b3c5afaa763f tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:31.866772 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4d667e08-17b1-498c-b7de-d74653eefc20 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:31.868180 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4d667e08-17b1-498c-b7de-d74653eefc20 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: 09076cfa-4632-43c3-919d-4a8fe1b1bd37] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:31.883290 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4d667e08-17b1-498c-b7de-d74653eefc20 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:31.884697 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4d667e08-17b1-498c-b7de-d74653eefc20 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:31.885429 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4d667e08-17b1-498c-b7de-d74653eefc20 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:31.886972 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4d667e08-17b1-498c-b7de-d74653eefc20 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:31.888922 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4d667e08-17b1-498c-b7de-d74653eefc20 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:31.890852 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4d667e08-17b1-498c-b7de-d74653eefc20 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:31.893276 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:37:31.957113 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-298c205f-a752-4aa5-8a9f-b3c5afaa763f tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:31.972128 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-298c205f-a752-4aa5-8a9f-b3c5afaa763f tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/19d7387c-9776-4e8e-801d-c959ba47af7f" status: 200 len: 1266 microversion: 2.1 time: 0.198806 Sep 23 04:37:31.981352 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 829/1708] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:31 2022] GET /compute/v2.1/servers/19d7387c-9776-4e8e-801d-c959ba47af7f => generated 1266 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:32.001590 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4d667e08-17b1-498c-b7de-d74653eefc20 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:32.011931 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4d667e08-17b1-498c-b7de-d74653eefc20 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:32.011931 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4d667e08-17b1-498c-b7de-d74653eefc20 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:32.012200 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-4d667e08-17b1-498c-b7de-d74653eefc20 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lazy-loading 'fault' on Instance uuid 09076cfa-4632-43c3-919d-4a8fe1b1bd37 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:37:32.023256 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:37:32.201672 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-4d667e08-17b1-498c-b7de-d74653eefc20 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:32.216261 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f1803eb9-bd07-4fd1-9c87-572a5bb75b49 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:32.216789 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f1803eb9-bd07-4fd1-9c87-572a5bb75b49 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 9e9a41f2-ff28-4c2a-80aa-193e0ebce466] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:32.220075 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4d667e08-17b1-498c-b7de-d74653eefc20 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/09076cfa-4632-43c3-919d-4a8fe1b1bd37" status: 200 len: 1303 microversion: 2.1 time: 0.357650 Sep 23 04:37:32.221229 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 880/1709] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:31 2022] GET /compute/v2.1/servers/09076cfa-4632-43c3-919d-4a8fe1b1bd37 => generated 1303 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:32.229979 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f1803eb9-bd07-4fd1-9c87-572a5bb75b49 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:32.233479 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f1803eb9-bd07-4fd1-9c87-572a5bb75b49 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:32.233479 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f1803eb9-bd07-4fd1-9c87-572a5bb75b49 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:32.233479 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f1803eb9-bd07-4fd1-9c87-572a5bb75b49 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:32.233479 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f1803eb9-bd07-4fd1-9c87-572a5bb75b49 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:32.233479 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f1803eb9-bd07-4fd1-9c87-572a5bb75b49 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:32.268067 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-55ae9c3e-9a5e-456b-8a8e-90171b851eff tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:32.268795 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-55ae9c3e-9a5e-456b-8a8e-90171b851eff tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] [instance: 53745879-9973-4217-b1c5-b45f917db80e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:32.284662 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-55ae9c3e-9a5e-456b-8a8e-90171b851eff tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:32.285187 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-55ae9c3e-9a5e-456b-8a8e-90171b851eff tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:32.285632 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-55ae9c3e-9a5e-456b-8a8e-90171b851eff tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:32.286497 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-55ae9c3e-9a5e-456b-8a8e-90171b851eff tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:32.294996 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-55ae9c3e-9a5e-456b-8a8e-90171b851eff tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:32.295708 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-55ae9c3e-9a5e-456b-8a8e-90171b851eff tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:33.038825 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-55ae9c3e-9a5e-456b-8a8e-90171b851eff tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:33.064443 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-55ae9c3e-9a5e-456b-8a8e-90171b851eff tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:33.066753 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-55ae9c3e-9a5e-456b-8a8e-90171b851eff tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:33.071392 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-55ae9c3e-9a5e-456b-8a8e-90171b851eff tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] 10.222.0.33 "GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e" status: 200 len: 1592 microversion: 2.42 time: 0.804325 Sep 23 04:37:33.071392 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 881/1710] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:37:32 2022] GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e => generated 1592 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:37:33.077721 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-29e3f913-a737-4dd1-8029-62b07bf0e552 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:33.078660 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-29e3f913-a737-4dd1-8029-62b07bf0e552 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: 04e9b262-d9e0-434a-bcbb-a85ef9180ee9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:33.088034 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-29e3f913-a737-4dd1-8029-62b07bf0e552 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:33.089821 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-29e3f913-a737-4dd1-8029-62b07bf0e552 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:33.090664 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-29e3f913-a737-4dd1-8029-62b07bf0e552 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:33.091537 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-29e3f913-a737-4dd1-8029-62b07bf0e552 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:33.092060 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-29e3f913-a737-4dd1-8029-62b07bf0e552 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:33.092755 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-29e3f913-a737-4dd1-8029-62b07bf0e552 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:33.177098 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f1803eb9-bd07-4fd1-9c87-572a5bb75b49 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:33.210747 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f1803eb9-bd07-4fd1-9c87-572a5bb75b49 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:33.212623 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f1803eb9-bd07-4fd1-9c87-572a5bb75b49 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:33.218674 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f1803eb9-bd07-4fd1-9c87-572a5bb75b49 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466" status: 200 len: 1486 microversion: 2.25 time: 1.006230 Sep 23 04:37:33.219234 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 830/1711] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:37:32 2022] GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466 => generated 1486 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:37:33.227967 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0f1f4b8f-8ee6-476a-93d7-6aed11dd68c7 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:33.229111 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-0f1f4b8f-8ee6-476a-93d7-6aed11dd68c7 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 7b84f450-5c05-4468-b17a-2cd30f2c7f55] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:33.238879 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0f1f4b8f-8ee6-476a-93d7-6aed11dd68c7 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:33.238879 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0f1f4b8f-8ee6-476a-93d7-6aed11dd68c7 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:33.238879 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0f1f4b8f-8ee6-476a-93d7-6aed11dd68c7 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:33.239448 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0f1f4b8f-8ee6-476a-93d7-6aed11dd68c7 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:33.239737 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0f1f4b8f-8ee6-476a-93d7-6aed11dd68c7 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:33.240280 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0f1f4b8f-8ee6-476a-93d7-6aed11dd68c7 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:33.546432 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-29e3f913-a737-4dd1-8029-62b07bf0e552 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:33.562847 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-29e3f913-a737-4dd1-8029-62b07bf0e552 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9" status: 200 len: 1719 microversion: 2.1 time: 0.491711 Sep 23 04:37:33.568358 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 882/1712] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:33 2022] GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9 => generated 1719 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:33.591255 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-fabaf896-034a-4694-a5e0-74a4268201a1 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:33.591893 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-fabaf896-034a-4694-a5e0-74a4268201a1 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 19d7387c-9776-4e8e-801d-c959ba47af7f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:33.613236 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fabaf896-034a-4694-a5e0-74a4268201a1 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:33.613734 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fabaf896-034a-4694-a5e0-74a4268201a1 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:33.614213 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fabaf896-034a-4694-a5e0-74a4268201a1 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:33.614933 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fabaf896-034a-4694-a5e0-74a4268201a1 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:33.615399 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fabaf896-034a-4694-a5e0-74a4268201a1 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:33.615837 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fabaf896-034a-4694-a5e0-74a4268201a1 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:33.778867 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-fabaf896-034a-4694-a5e0-74a4268201a1 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:33.786893 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-fabaf896-034a-4694-a5e0-74a4268201a1 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/19d7387c-9776-4e8e-801d-c959ba47af7f" status: 200 len: 1272 microversion: 2.1 time: 0.212806 Sep 23 04:37:33.794285 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 883/1713] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:33 2022] GET /compute/v2.1/servers/19d7387c-9776-4e8e-801d-c959ba47af7f => generated 1272 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:33.799364 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b097c476-be18-4d54-950a-c7cf90896678 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:33.799998 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b097c476-be18-4d54-950a-c7cf90896678 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: 09076cfa-4632-43c3-919d-4a8fe1b1bd37] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:33.813994 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-0f1f4b8f-8ee6-476a-93d7-6aed11dd68c7 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:33.822321 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0f1f4b8f-8ee6-476a-93d7-6aed11dd68c7 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/7b84f450-5c05-4468-b17a-2cd30f2c7f55" status: 200 len: 1316 microversion: 2.1 time: 0.600554 Sep 23 04:37:33.822920 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 831/1714] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:33 2022] GET /compute/v2.1/servers/7b84f450-5c05-4468-b17a-2cd30f2c7f55 => generated 1316 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:33.829027 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b097c476-be18-4d54-950a-c7cf90896678 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:33.829537 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b097c476-be18-4d54-950a-c7cf90896678 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:33.830080 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b097c476-be18-4d54-950a-c7cf90896678 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:33.834923 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b097c476-be18-4d54-950a-c7cf90896678 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:33.834923 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b097c476-be18-4d54-950a-c7cf90896678 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:33.834923 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b097c476-be18-4d54-950a-c7cf90896678 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:33.837586 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a2025ecb-6ab8-4ae2-a6c8-5a001e605c24 tempest-VolumesTestJSON-1808526912 tempest-VolumesTestJSON-1808526912-project] Calling method '.version_select at 0x7ff1bbcce790>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:33.871600 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-b097c476-be18-4d54-950a-c7cf90896678 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] HTTP exception thrown: Instance 09076cfa-4632-43c3-919d-4a8fe1b1bd37 could not be found. Sep 23 04:37:33.873267 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b097c476-be18-4d54-950a-c7cf90896678 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Request method failure captured: Sep 23 04:37:33.873267 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/09076cfa-4632-43c3-919d-4a8fe1b1bd37 HTTP/1.1 Sep 23 04:37:33.873267 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:37:33.873267 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:37:33.873267 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:37:33.873267 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:37:33.873267 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:37:33.873267 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:37:33.873267 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:37:33.873267 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:37:33.873267 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTbVYJ52adAJ9FheNo4laGscIedhjQbJFOPau48A1AEr2s0iaN9LeefHC7L67iMyGsjmMLdPqATLlkb5I62UP_x_BbGK82ZOrjFJn0VvU_oxwpjgQlBkTumkEKg5lhV-GSi40Q3ydTifg6UNTnNJYkNIbsqEMRtSs8uF-SAwyPe086c Sep 23 04:37:33.873267 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:37:33.873267 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:37:33.873267 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:37:33.873267 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:37:33.873267 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:37:33.873267 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:37:33.873267 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 54abd267d3c043e09f26f486823907e2 Sep 23 04:37:33.873267 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-MigrationsAdminTest-898134375 Sep 23 04:37:33.873267 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:37:33.873267 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:37:33.873267 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_54abd267d3c043e09f26f486823907e2", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/54abd267d3c043e09f26f486823907e2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/54abd267d3c043e09f26f486823907e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/54abd267d3c043e09f26f486823907e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:37:33.873267 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-MigrationsAdminTest-898134375 Sep 23 04:37:33.873267 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 54abd267d3c043e09f26f486823907e2 Sep 23 04:37:33.873267 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-MigrationsAdminTest-898134375 Sep 23 04:37:33.873267 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-MigrationsAdminTest-898134375-project Sep 23 04:37:33.873267 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:37:33.873267 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:37:33.873267 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 13f5a913548445a09377847fd78a10a1 Sep 23 04:37:33.873267 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-MigrationsAdminTest-898134375-project Sep 23 04:37:33.873267 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:37:33.873267 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 09076cfa-4632-43c3-919d-4a8fe1b1bd37 could not be found. Sep 23 04:37:33.873267 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '09076cfa-4632-43c3-919d-4a8fe1b1bd37'} Sep 23 04:37:33.873267 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:37:33.873267 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:37:33.873267 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:37:33.873267 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:37:33.873267 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:37:33.873267 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:37:33.873267 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:37:33.873267 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:37:33.873267 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:37:33.873267 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:37:33.873267 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09076cfa-4632-43c3-919d-4a8fe1b1bd37 could not be found. Sep 23 04:37:33.873267 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:37:33.873267 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:37:33.873267 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:37:33.873267 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:37:33.873267 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:37:33.873267 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:37:33.873267 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:37:33.873267 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:37:33.873267 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:37:33.873267 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:37:33.873267 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:37:33.873267 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:37:33.873267 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:37:33.873267 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:37:33.873267 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:37:33.873267 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:37:33.873267 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09076cfa-4632-43c3-919d-4a8fe1b1bd37 could not be found. Sep 23 04:37:33.873267 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:37:33.873267 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:37:33.873267 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:37:33.881738 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:37:33.881738 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:37:33.881738 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:37:33.881738 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:37:33.881738 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:37:33.881738 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09076cfa-4632-43c3-919d-4a8fe1b1bd37 could not be found. Sep 23 04:37:33.881738 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:37:33.881738 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b097c476-be18-4d54-950a-c7cf90896678 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Returning 404 to user: Instance 09076cfa-4632-43c3-919d-4a8fe1b1bd37 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:37:33.881738 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b097c476-be18-4d54-950a-c7cf90896678 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/09076cfa-4632-43c3-919d-4a8fe1b1bd37" status: 404 len: 111 microversion: 2.1 time: 0.080826 Sep 23 04:37:33.886102 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 884/1715] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:33 2022] GET /compute/v2.1/servers/09076cfa-4632-43c3-919d-4a8fe1b1bd37 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:37:33.897290 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1f99bf43-9ec3-45ed-a83d-4458a06c4e61 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:33.902913 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1f99bf43-9ec3-45ed-a83d-4458a06c4e61 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: 0dff1738-81f1-4619-af74-44b7adc805b5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:33.912358 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1f99bf43-9ec3-45ed-a83d-4458a06c4e61 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:33.916512 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1f99bf43-9ec3-45ed-a83d-4458a06c4e61 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:33.917229 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1f99bf43-9ec3-45ed-a83d-4458a06c4e61 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:33.918195 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1f99bf43-9ec3-45ed-a83d-4458a06c4e61 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:33.918837 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1f99bf43-9ec3-45ed-a83d-4458a06c4e61 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:33.920459 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1f99bf43-9ec3-45ed-a83d-4458a06c4e61 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:33.940373 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a2025ecb-6ab8-4ae2-a6c8-5a001e605c24 tempest-VolumesTestJSON-1808526912 tempest-VolumesTestJSON-1808526912-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/be780b1b-300e-4bb4-9d54-03b025e4c84f" status: 200 len: 349 microversion: 2.1 time: 0.116403 Sep 23 04:37:33.941522 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 832/1716] 10.222.0.33 () {58 vars in 1245 bytes} [Fri Sep 23 04:37:33 2022] GET /compute/v2.1/os-volumes/be780b1b-300e-4bb4-9d54-03b025e4c84f => generated 349 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:37:33.983562 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1f99bf43-9ec3-45ed-a83d-4458a06c4e61 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: 0dff1738-81f1-4619-af74-44b7adc805b5] Going to try to terminate instance {{(pid=122699) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:37:34.096027 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8835fa75-c544-42b0-a3d0-ab5b0246c480 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:34.097435 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8835fa75-c544-42b0-a3d0-ab5b0246c480 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] [instance: 53745879-9973-4217-b1c5-b45f917db80e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:34.114122 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8835fa75-c544-42b0-a3d0-ab5b0246c480 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:34.114632 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8835fa75-c544-42b0-a3d0-ab5b0246c480 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:34.115082 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8835fa75-c544-42b0-a3d0-ab5b0246c480 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:34.115812 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8835fa75-c544-42b0-a3d0-ab5b0246c480 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:34.116276 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8835fa75-c544-42b0-a3d0-ab5b0246c480 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:34.116731 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8835fa75-c544-42b0-a3d0-ab5b0246c480 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:34.174637 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=100 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:37:34.405259 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1f99bf43-9ec3-45ed-a83d-4458a06c4e61 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "DELETE /compute/v2.1/servers/0dff1738-81f1-4619-af74-44b7adc805b5" status: 204 len: 0 microversion: 2.1 time: 0.517799 Sep 23 04:37:34.410292 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 885/1717] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:37:33 2022] DELETE /compute/v2.1/servers/0dff1738-81f1-4619-af74-44b7adc805b5 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:37:34.415983 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6edc53e1-dac9-4588-b74e-99dc85d969e6 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:34.420808 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-6edc53e1-dac9-4588-b74e-99dc85d969e6 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 9e9a41f2-ff28-4c2a-80aa-193e0ebce466] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:34.438852 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6edc53e1-dac9-4588-b74e-99dc85d969e6 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:34.444988 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6edc53e1-dac9-4588-b74e-99dc85d969e6 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:34.444988 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6edc53e1-dac9-4588-b74e-99dc85d969e6 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:34.444988 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6edc53e1-dac9-4588-b74e-99dc85d969e6 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:34.444988 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6edc53e1-dac9-4588-b74e-99dc85d969e6 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:34.444988 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6edc53e1-dac9-4588-b74e-99dc85d969e6 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:34.656031 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8835fa75-c544-42b0-a3d0-ab5b0246c480 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:34.667248 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8835fa75-c544-42b0-a3d0-ab5b0246c480 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:34.668883 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8835fa75-c544-42b0-a3d0-ab5b0246c480 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:34.670467 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8835fa75-c544-42b0-a3d0-ab5b0246c480 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] 10.222.0.33 "GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e" status: 200 len: 1659 microversion: 2.42 time: 0.577993 Sep 23 04:37:34.686612 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 833/1718] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:37:34 2022] GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e => generated 1659 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:37:34.696174 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7fe2f214-ed5c-418a-b3a3-f6fca924fe0b tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:34.696980 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7fe2f214-ed5c-418a-b3a3-f6fca924fe0b tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: 0dff1738-81f1-4619-af74-44b7adc805b5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:34.714157 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7fe2f214-ed5c-418a-b3a3-f6fca924fe0b tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:34.715019 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7fe2f214-ed5c-418a-b3a3-f6fca924fe0b tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:34.715663 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7fe2f214-ed5c-418a-b3a3-f6fca924fe0b tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:34.716625 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7fe2f214-ed5c-418a-b3a3-f6fca924fe0b tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:34.717262 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7fe2f214-ed5c-418a-b3a3-f6fca924fe0b tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:34.717869 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7fe2f214-ed5c-418a-b3a3-f6fca924fe0b tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:34.749044 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-6edc53e1-dac9-4588-b74e-99dc85d969e6 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:34.767255 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-6edc53e1-dac9-4588-b74e-99dc85d969e6 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:34.771099 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-6edc53e1-dac9-4588-b74e-99dc85d969e6 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:34.775964 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6edc53e1-dac9-4588-b74e-99dc85d969e6 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466" status: 200 len: 1476 microversion: 2.25 time: 0.361065 Sep 23 04:37:34.777190 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 886/1719] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:37:34 2022] GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466 => generated 1476 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:37:34.791794 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-57acbc94-60b6-4490-9481-3e9861e27ca1 req-7797f79a-3048-40e0-89fa-9a2c21a1cd1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b84f450-5c05-4468-b17a-2cd30f2c7f55", "name": "network-vif-plugged", "status": "completed", "tag": "f0e6646b-bac8-416d-8099-7beba99a6c8c"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:37:34.830681 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-57acbc94-60b6-4490-9481-3e9861e27ca1 req-7797f79a-3048-40e0-89fa-9a2c21a1cd1e service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:34.831416 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-57acbc94-60b6-4490-9481-3e9861e27ca1 req-7797f79a-3048-40e0-89fa-9a2c21a1cd1e service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:34.831872 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-57acbc94-60b6-4490-9481-3e9861e27ca1 req-7797f79a-3048-40e0-89fa-9a2c21a1cd1e service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:34.880865 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-57acbc94-60b6-4490-9481-3e9861e27ca1 req-7797f79a-3048-40e0-89fa-9a2c21a1cd1e service nova] Creating event network-vif-plugged:f0e6646b-bac8-416d-8099-7beba99a6c8c for instance 7b84f450-5c05-4468-b17a-2cd30f2c7f55 on n-h2-846463-3 Sep 23 04:37:34.898812 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-57acbc94-60b6-4490-9481-3e9861e27ca1 req-7797f79a-3048-40e0-89fa-9a2c21a1cd1e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117994 Sep 23 04:37:34.899436 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 887/1720] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:37:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:37:34.914955 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-cba0d7fa-a1bb-4f1e-af9f-f38ee91fad76 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:34.923020 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-cba0d7fa-a1bb-4f1e-af9f-f38ee91fad76 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: 04e9b262-d9e0-434a-bcbb-a85ef9180ee9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:34.933911 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cba0d7fa-a1bb-4f1e-af9f-f38ee91fad76 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:34.936540 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cba0d7fa-a1bb-4f1e-af9f-f38ee91fad76 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:34.937258 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cba0d7fa-a1bb-4f1e-af9f-f38ee91fad76 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:34.938990 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cba0d7fa-a1bb-4f1e-af9f-f38ee91fad76 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:34.939992 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cba0d7fa-a1bb-4f1e-af9f-f38ee91fad76 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:34.940875 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cba0d7fa-a1bb-4f1e-af9f-f38ee91fad76 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:35.227814 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-7fe2f214-ed5c-418a-b3a3-f6fca924fe0b tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:35.248097 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7fe2f214-ed5c-418a-b3a3-f6fca924fe0b tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/0dff1738-81f1-4619-af74-44b7adc805b5" status: 200 len: 1469 microversion: 2.1 time: 0.560051 Sep 23 04:37:35.249920 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 834/1721] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:34 2022] GET /compute/v2.1/servers/0dff1738-81f1-4619-af74-44b7adc805b5 => generated 1469 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:35.270887 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-44f6d1cd-f0fb-4e47-827d-5506df45c75e tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Calling method '.version_select at 0x7ff1c00f4310>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:35.275812 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-44f6d1cd-f0fb-4e47-827d-5506df45c75e tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:35.276312 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-44f6d1cd-f0fb-4e47-827d-5506df45c75e tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:35.276754 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-44f6d1cd-f0fb-4e47-827d-5506df45c75e tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:35.291472 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-44f6d1cd-f0fb-4e47-827d-5506df45c75e tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] 10.222.0.33 "GET /compute/v2.1/os-migrations" status: 200 len: 3874 microversion: 2.25 time: 0.024622 Sep 23 04:37:35.304206 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 835/1722] 10.222.0.33 () {60 vars in 1184 bytes} [Fri Sep 23 04:37:35 2022] GET /compute/v2.1/os-migrations => generated 3874 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:37:35.304206 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7be69f7b-3bbb-4111-b6ef-bd8dc8741dbb tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:35.304206 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7be69f7b-3bbb-4111-b6ef-bd8dc8741dbb tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 19d7387c-9776-4e8e-801d-c959ba47af7f] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:35.305352 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7be69f7b-3bbb-4111-b6ef-bd8dc8741dbb tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:35.305949 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7be69f7b-3bbb-4111-b6ef-bd8dc8741dbb tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:35.306498 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7be69f7b-3bbb-4111-b6ef-bd8dc8741dbb tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:35.307322 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7be69f7b-3bbb-4111-b6ef-bd8dc8741dbb tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:35.308155 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7be69f7b-3bbb-4111-b6ef-bd8dc8741dbb tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:35.308891 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7be69f7b-3bbb-4111-b6ef-bd8dc8741dbb tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:35.443929 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-7be69f7b-3bbb-4111-b6ef-bd8dc8741dbb tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:35.444075 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-cba0d7fa-a1bb-4f1e-af9f-f38ee91fad76 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:35.453486 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7be69f7b-3bbb-4111-b6ef-bd8dc8741dbb tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/19d7387c-9776-4e8e-801d-c959ba47af7f" status: 200 len: 1272 microversion: 2.1 time: 0.159837 Sep 23 04:37:35.455110 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 836/1723] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:35 2022] GET /compute/v2.1/servers/19d7387c-9776-4e8e-801d-c959ba47af7f => generated 1272 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:35.461264 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7e67af36-5542-4281-aa80-b13430c80e8f tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:35.462111 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7e67af36-5542-4281-aa80-b13430c80e8f tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 7b84f450-5c05-4468-b17a-2cd30f2c7f55] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:35.470128 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-cba0d7fa-a1bb-4f1e-af9f-f38ee91fad76 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9" status: 200 len: 1719 microversion: 2.1 time: 0.555958 Sep 23 04:37:35.470128 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 888/1724] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:34 2022] GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9 => generated 1719 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:35.471692 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7e67af36-5542-4281-aa80-b13430c80e8f tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:35.472219 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7e67af36-5542-4281-aa80-b13430c80e8f tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:35.472660 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7e67af36-5542-4281-aa80-b13430c80e8f tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:35.473377 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7e67af36-5542-4281-aa80-b13430c80e8f tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:35.476315 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7e67af36-5542-4281-aa80-b13430c80e8f tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:35.476810 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7e67af36-5542-4281-aa80-b13430c80e8f tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:35.498645 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3c20d678-f5de-4000-9622-cf85a10755af tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:35.504248 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-3c20d678-f5de-4000-9622-cf85a10755af tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] [instance: 9e9a41f2-ff28-4c2a-80aa-193e0ebce466] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:35.518338 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3c20d678-f5de-4000-9622-cf85a10755af tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:35.519078 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3c20d678-f5de-4000-9622-cf85a10755af tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:35.520829 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3c20d678-f5de-4000-9622-cf85a10755af tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:35.525288 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3c20d678-f5de-4000-9622-cf85a10755af tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:35.526735 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3c20d678-f5de-4000-9622-cf85a10755af tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:35.527288 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3c20d678-f5de-4000-9622-cf85a10755af tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:36.138469 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-7e67af36-5542-4281-aa80-b13430c80e8f tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:36.151652 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7e67af36-5542-4281-aa80-b13430c80e8f tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/7b84f450-5c05-4468-b17a-2cd30f2c7f55" status: 200 len: 1316 microversion: 2.1 time: 0.695288 Sep 23 04:37:36.152246 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 837/1725] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:35 2022] GET /compute/v2.1/servers/7b84f450-5c05-4468-b17a-2cd30f2c7f55 => generated 1316 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:36.164125 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-bda7e7b9-127c-4c67-974c-b29f83c83d77 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:36.173704 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-bda7e7b9-127c-4c67-974c-b29f83c83d77 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] [instance: 53745879-9973-4217-b1c5-b45f917db80e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:36.184943 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:37:36.186836 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bda7e7b9-127c-4c67-974c-b29f83c83d77 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:36.189654 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bda7e7b9-127c-4c67-974c-b29f83c83d77 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:36.191233 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bda7e7b9-127c-4c67-974c-b29f83c83d77 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:36.194174 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bda7e7b9-127c-4c67-974c-b29f83c83d77 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:36.199195 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bda7e7b9-127c-4c67-974c-b29f83c83d77 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:36.199195 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bda7e7b9-127c-4c67-974c-b29f83c83d77 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:36.340931 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-3c20d678-f5de-4000-9622-cf85a10755af tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] Lazy-loading 'services' on Instance uuid 9e9a41f2-ff28-4c2a-80aa-193e0ebce466 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:37:36.388010 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3c20d678-f5de-4000-9622-cf85a10755af tempest-LiveAutoBlockMigrationV225Test-763749965 tempest-LiveAutoBlockMigrationV225Test-763749965-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466" status: 200 len: 1968 microversion: 2.25 time: 0.896178 Sep 23 04:37:36.409306 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 889/1726] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:37:35 2022] GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466 => generated 1968 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:37:36.443864 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-783b030c-f0b7-43f1-a426-00cdcacba70b tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:36.444841 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-783b030c-f0b7-43f1-a426-00cdcacba70b tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: 0dff1738-81f1-4619-af74-44b7adc805b5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:36.455725 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-783b030c-f0b7-43f1-a426-00cdcacba70b tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:36.457084 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-783b030c-f0b7-43f1-a426-00cdcacba70b tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:36.457709 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-783b030c-f0b7-43f1-a426-00cdcacba70b tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:36.459284 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-783b030c-f0b7-43f1-a426-00cdcacba70b tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:36.460027 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-783b030c-f0b7-43f1-a426-00cdcacba70b tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:36.461446 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-783b030c-f0b7-43f1-a426-00cdcacba70b tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:36.786216 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-bda7e7b9-127c-4c67-974c-b29f83c83d77 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:36.795931 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-bda7e7b9-127c-4c67-974c-b29f83c83d77 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:36.799204 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-bda7e7b9-127c-4c67-974c-b29f83c83d77 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:36.801631 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-bda7e7b9-127c-4c67-974c-b29f83c83d77 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] 10.222.0.33 "GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e" status: 200 len: 1705 microversion: 2.42 time: 0.643510 Sep 23 04:37:36.812465 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 838/1727] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:37:36 2022] GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e => generated 1705 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:37:36.820976 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0188523b-228e-44ef-8196-34f773109a2c tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:36.826367 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-0188523b-228e-44ef-8196-34f773109a2c tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 9e9a41f2-ff28-4c2a-80aa-193e0ebce466] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:36.835530 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0188523b-228e-44ef-8196-34f773109a2c tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:36.836446 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0188523b-228e-44ef-8196-34f773109a2c tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:36.837087 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0188523b-228e-44ef-8196-34f773109a2c tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:36.838483 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0188523b-228e-44ef-8196-34f773109a2c tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:36.839187 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0188523b-228e-44ef-8196-34f773109a2c tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:36.840935 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0188523b-228e-44ef-8196-34f773109a2c tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:36.888680 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-0188523b-228e-44ef-8196-34f773109a2c tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 9e9a41f2-ff28-4c2a-80aa-193e0ebce466] Going to try to terminate instance {{(pid=122698) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:37:36.919303 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-783b030c-f0b7-43f1-a426-00cdcacba70b tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:36.941977 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-783b030c-f0b7-43f1-a426-00cdcacba70b tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/0dff1738-81f1-4619-af74-44b7adc805b5" status: 200 len: 1469 microversion: 2.1 time: 0.521984 Sep 23 04:37:36.941977 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 890/1728] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:36 2022] GET /compute/v2.1/servers/0dff1738-81f1-4619-af74-44b7adc805b5 => generated 1469 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:36.946044 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2057323a-e9e1-4d64-8c15-9e97cb93bd6a tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:36.946938 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-2057323a-e9e1-4d64-8c15-9e97cb93bd6a tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 19d7387c-9776-4e8e-801d-c959ba47af7f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:36.966436 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2057323a-e9e1-4d64-8c15-9e97cb93bd6a tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:36.970768 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2057323a-e9e1-4d64-8c15-9e97cb93bd6a tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:36.971958 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2057323a-e9e1-4d64-8c15-9e97cb93bd6a tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:36.974285 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2057323a-e9e1-4d64-8c15-9e97cb93bd6a tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:36.975287 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2057323a-e9e1-4d64-8c15-9e97cb93bd6a tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:36.977704 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2057323a-e9e1-4d64-8c15-9e97cb93bd6a tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:37.013447 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=24 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:37:37.350490 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2057323a-e9e1-4d64-8c15-9e97cb93bd6a tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:37.364393 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2057323a-e9e1-4d64-8c15-9e97cb93bd6a tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/19d7387c-9776-4e8e-801d-c959ba47af7f" status: 200 len: 1314 microversion: 2.1 time: 0.426749 Sep 23 04:37:37.366462 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 891/1729] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:36 2022] GET /compute/v2.1/servers/19d7387c-9776-4e8e-801d-c959ba47af7f => generated 1314 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:37.386798 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b6331ef4-ae68-4390-ab6b-7afb1447bb01 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:37.389100 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b6331ef4-ae68-4390-ab6b-7afb1447bb01 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: 04e9b262-d9e0-434a-bcbb-a85ef9180ee9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:37.399178 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b6331ef4-ae68-4390-ab6b-7afb1447bb01 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:37.403480 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b6331ef4-ae68-4390-ab6b-7afb1447bb01 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:37.404441 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b6331ef4-ae68-4390-ab6b-7afb1447bb01 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:37.405449 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b6331ef4-ae68-4390-ab6b-7afb1447bb01 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:37.406203 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b6331ef4-ae68-4390-ab6b-7afb1447bb01 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:37.406880 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b6331ef4-ae68-4390-ab6b-7afb1447bb01 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:37.448353 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0188523b-228e-44ef-8196-34f773109a2c tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466" status: 204 len: 0 microversion: 2.25 time: 0.634161 Sep 23 04:37:37.449095 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 839/1730] 10.222.0.33 () {60 vars in 1280 bytes} [Fri Sep 23 04:37:36 2022] DELETE /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466 => generated 0 bytes in 636 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 23 04:37:37.455069 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-24d61128-2e69-4361-8866-c2854cacf47e tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:37.455843 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-24d61128-2e69-4361-8866-c2854cacf47e tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 7b84f450-5c05-4468-b17a-2cd30f2c7f55] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:37.485199 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-24d61128-2e69-4361-8866-c2854cacf47e tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:37.485762 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-24d61128-2e69-4361-8866-c2854cacf47e tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:37.486270 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-24d61128-2e69-4361-8866-c2854cacf47e tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:37.487011 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-24d61128-2e69-4361-8866-c2854cacf47e tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:37.488018 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-24d61128-2e69-4361-8866-c2854cacf47e tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:37.488461 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-24d61128-2e69-4361-8866-c2854cacf47e tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:37.792617 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=10 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:37:37.920837 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b6331ef4-ae68-4390-ab6b-7afb1447bb01 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:37.931513 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b6331ef4-ae68-4390-ab6b-7afb1447bb01 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9" status: 200 len: 1719 microversion: 2.1 time: 0.563040 Sep 23 04:37:37.934034 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 892/1731] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:37 2022] GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9 => generated 1719 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:37.953997 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-999a6999-600a-403c-8831-df2b4bf0ead2 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:37.953997 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-999a6999-600a-403c-8831-df2b4bf0ead2 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 9e9a41f2-ff28-4c2a-80aa-193e0ebce466] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:37.955749 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:37:37.958261 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-999a6999-600a-403c-8831-df2b4bf0ead2 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:37.959076 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-999a6999-600a-403c-8831-df2b4bf0ead2 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:37.959524 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-999a6999-600a-403c-8831-df2b4bf0ead2 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:37.960240 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-999a6999-600a-403c-8831-df2b4bf0ead2 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:37.960696 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-999a6999-600a-403c-8831-df2b4bf0ead2 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:37.961119 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-999a6999-600a-403c-8831-df2b4bf0ead2 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:37.973623 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-24d61128-2e69-4361-8866-c2854cacf47e tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:37.998223 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-24d61128-2e69-4361-8866-c2854cacf47e tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/7b84f450-5c05-4468-b17a-2cd30f2c7f55" status: 200 len: 1316 microversion: 2.1 time: 0.544414 Sep 23 04:37:38.021457 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 840/1732] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:37 2022] GET /compute/v2.1/servers/7b84f450-5c05-4468-b17a-2cd30f2c7f55 => generated 1316 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:38.042668 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b5cd79a4-81f6-4339-aaa0-20bd02d23144 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:38.044196 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b5cd79a4-81f6-4339-aaa0-20bd02d23144 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] [instance: 53745879-9973-4217-b1c5-b45f917db80e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:38.066607 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b5cd79a4-81f6-4339-aaa0-20bd02d23144 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:38.067616 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b5cd79a4-81f6-4339-aaa0-20bd02d23144 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:38.072302 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b5cd79a4-81f6-4339-aaa0-20bd02d23144 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:38.072302 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b5cd79a4-81f6-4339-aaa0-20bd02d23144 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:38.072302 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b5cd79a4-81f6-4339-aaa0-20bd02d23144 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:38.072302 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b5cd79a4-81f6-4339-aaa0-20bd02d23144 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:38.606253 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-999a6999-600a-403c-8831-df2b4bf0ead2 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:38.617081 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-999a6999-600a-403c-8831-df2b4bf0ead2 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:38.623880 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-999a6999-600a-403c-8831-df2b4bf0ead2 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:38.641552 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-999a6999-600a-403c-8831-df2b4bf0ead2 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466" status: 200 len: 1482 microversion: 2.25 time: 0.688060 Sep 23 04:37:38.642268 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 893/1733] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:37:37 2022] GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466 => generated 1482 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:37:38.657753 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-b317de29-65c1-4ee7-8895-aa2b7ff2f810 req-8d43750d-ad27-4a11-8b51-c2d54d3562e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dff1738-81f1-4619-af74-44b7adc805b5", "name": "network-vif-deleted", "tag": "583dbaa7-7626-49e7-8e4c-d1e81eea0115"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:37:38.687564 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-b317de29-65c1-4ee7-8895-aa2b7ff2f810 req-8d43750d-ad27-4a11-8b51-c2d54d3562e0 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:38.689110 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-b317de29-65c1-4ee7-8895-aa2b7ff2f810 req-8d43750d-ad27-4a11-8b51-c2d54d3562e0 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:38.689738 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-b317de29-65c1-4ee7-8895-aa2b7ff2f810 req-8d43750d-ad27-4a11-8b51-c2d54d3562e0 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:38.703445 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-b317de29-65c1-4ee7-8895-aa2b7ff2f810 req-8d43750d-ad27-4a11-8b51-c2d54d3562e0 service nova] Creating event network-vif-deleted:583dbaa7-7626-49e7-8e4c-d1e81eea0115 for instance 0dff1738-81f1-4619-af74-44b7adc805b5 on n-h2-846463-3 Sep 23 04:37:38.717838 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-b317de29-65c1-4ee7-8895-aa2b7ff2f810 req-8d43750d-ad27-4a11-8b51-c2d54d3562e0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074294 Sep 23 04:37:38.720343 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 894/1734] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:37:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:37:38.726468 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9314aafb-a324-4f9c-a445-8bd94fb16055 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:38.733169 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-9314aafb-a324-4f9c-a445-8bd94fb16055 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: 0dff1738-81f1-4619-af74-44b7adc805b5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:38.752276 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b5cd79a4-81f6-4339-aaa0-20bd02d23144 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:38.753112 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9314aafb-a324-4f9c-a445-8bd94fb16055 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:38.753659 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9314aafb-a324-4f9c-a445-8bd94fb16055 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:38.755599 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9314aafb-a324-4f9c-a445-8bd94fb16055 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:38.756338 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9314aafb-a324-4f9c-a445-8bd94fb16055 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:38.756802 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9314aafb-a324-4f9c-a445-8bd94fb16055 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:38.757232 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9314aafb-a324-4f9c-a445-8bd94fb16055 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:38.773010 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b5cd79a4-81f6-4339-aaa0-20bd02d23144 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:38.782055 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b5cd79a4-81f6-4339-aaa0-20bd02d23144 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:38.787853 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b5cd79a4-81f6-4339-aaa0-20bd02d23144 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] 10.222.0.33 "GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e" status: 200 len: 1751 microversion: 2.42 time: 0.765119 Sep 23 04:37:38.790289 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 841/1735] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:37:38 2022] GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e => generated 1751 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:37:38.807427 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-07f9fa0d-4e5b-4128-9b60-c1d5898c4d57 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:38.808364 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-07f9fa0d-4e5b-4128-9b60-c1d5898c4d57 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 19d7387c-9776-4e8e-801d-c959ba47af7f] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:38.830646 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-07f9fa0d-4e5b-4128-9b60-c1d5898c4d57 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:38.831579 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-07f9fa0d-4e5b-4128-9b60-c1d5898c4d57 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:38.832229 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-07f9fa0d-4e5b-4128-9b60-c1d5898c4d57 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:38.833214 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-07f9fa0d-4e5b-4128-9b60-c1d5898c4d57 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:38.833904 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-07f9fa0d-4e5b-4128-9b60-c1d5898c4d57 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:38.834542 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-07f9fa0d-4e5b-4128-9b60-c1d5898c4d57 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:38.843963 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9314aafb-a324-4f9c-a445-8bd94fb16055 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:38.847689 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9314aafb-a324-4f9c-a445-8bd94fb16055 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:38.848074 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9314aafb-a324-4f9c-a445-8bd94fb16055 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:38.852712 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-9314aafb-a324-4f9c-a445-8bd94fb16055 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lazy-loading 'fault' on Instance uuid 0dff1738-81f1-4619-af74-44b7adc805b5 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:37:39.111043 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-9314aafb-a324-4f9c-a445-8bd94fb16055 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f5a913548445a09377847fd78a10a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54abd267d3c043e09f26f486823907e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:39.128388 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-9314aafb-a324-4f9c-a445-8bd94fb16055 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/0dff1738-81f1-4619-af74-44b7adc805b5" status: 200 len: 1303 microversion: 2.1 time: 0.406320 Sep 23 04:37:39.129666 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 895/1736] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:38 2022] GET /compute/v2.1/servers/0dff1738-81f1-4619-af74-44b7adc805b5 => generated 1303 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:39.138583 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5c952b1c-9c13-49cd-9b94-2dafa3d674ce tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:39.139471 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-5c952b1c-9c13-49cd-9b94-2dafa3d674ce tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: 04e9b262-d9e0-434a-bcbb-a85ef9180ee9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:39.152775 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5c952b1c-9c13-49cd-9b94-2dafa3d674ce tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:39.153474 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5c952b1c-9c13-49cd-9b94-2dafa3d674ce tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:39.154433 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5c952b1c-9c13-49cd-9b94-2dafa3d674ce tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:39.156708 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5c952b1c-9c13-49cd-9b94-2dafa3d674ce tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:39.157946 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5c952b1c-9c13-49cd-9b94-2dafa3d674ce tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:39.158956 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5c952b1c-9c13-49cd-9b94-2dafa3d674ce tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:39.513831 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-07f9fa0d-4e5b-4128-9b60-c1d5898c4d57 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:39.524718 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-07f9fa0d-4e5b-4128-9b60-c1d5898c4d57 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/19d7387c-9776-4e8e-801d-c959ba47af7f" status: 200 len: 1314 microversion: 2.1 time: 0.731929 Sep 23 04:37:39.528927 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 842/1737] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:38 2022] GET /compute/v2.1/servers/19d7387c-9776-4e8e-801d-c959ba47af7f => generated 1314 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:39.542094 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-fddf453b-190b-4a49-9a96-7c2b752b5798 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:39.542957 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-fddf453b-190b-4a49-9a96-7c2b752b5798 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 7b84f450-5c05-4468-b17a-2cd30f2c7f55] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:39.553957 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fddf453b-190b-4a49-9a96-7c2b752b5798 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:39.558781 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fddf453b-190b-4a49-9a96-7c2b752b5798 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:39.559514 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fddf453b-190b-4a49-9a96-7c2b752b5798 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:39.565821 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fddf453b-190b-4a49-9a96-7c2b752b5798 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:39.565821 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fddf453b-190b-4a49-9a96-7c2b752b5798 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:39.565821 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fddf453b-190b-4a49-9a96-7c2b752b5798 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:40.100613 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-5c952b1c-9c13-49cd-9b94-2dafa3d674ce tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:40.105808 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:37:40.118696 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5c952b1c-9c13-49cd-9b94-2dafa3d674ce tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9" status: 200 len: 1719 microversion: 2.1 time: 0.987090 Sep 23 04:37:40.120205 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 896/1738] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:39 2022] GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9 => generated 1719 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:40.125678 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3694ada3-4aa5-464b-adcc-d70447c7fc63 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:40.139637 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-3694ada3-4aa5-464b-adcc-d70447c7fc63 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 9e9a41f2-ff28-4c2a-80aa-193e0ebce466] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:40.145993 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3694ada3-4aa5-464b-adcc-d70447c7fc63 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:40.148191 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3694ada3-4aa5-464b-adcc-d70447c7fc63 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:40.149006 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3694ada3-4aa5-464b-adcc-d70447c7fc63 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:40.150399 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3694ada3-4aa5-464b-adcc-d70447c7fc63 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:40.151245 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3694ada3-4aa5-464b-adcc-d70447c7fc63 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:40.152959 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3694ada3-4aa5-464b-adcc-d70447c7fc63 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:40.364368 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-fddf453b-190b-4a49-9a96-7c2b752b5798 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:40.379293 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-fddf453b-190b-4a49-9a96-7c2b752b5798 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/7b84f450-5c05-4468-b17a-2cd30f2c7f55" status: 200 len: 1465 microversion: 2.1 time: 0.849274 Sep 23 04:37:40.381445 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 843/1739] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:39 2022] GET /compute/v2.1/servers/7b84f450-5c05-4468-b17a-2cd30f2c7f55 => generated 1465 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:40.393177 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-783f7441-6799-401d-8c07-489936707bd0 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:40.397625 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-783f7441-6799-401d-8c07-489936707bd0 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] [instance: 53745879-9973-4217-b1c5-b45f917db80e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:40.419893 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-783f7441-6799-401d-8c07-489936707bd0 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:40.420785 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-783f7441-6799-401d-8c07-489936707bd0 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:40.421452 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-783f7441-6799-401d-8c07-489936707bd0 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:40.422650 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-783f7441-6799-401d-8c07-489936707bd0 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:40.423332 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-783f7441-6799-401d-8c07-489936707bd0 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:40.423982 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-783f7441-6799-401d-8c07-489936707bd0 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:40.681002 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-3694ada3-4aa5-464b-adcc-d70447c7fc63 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:40.690273 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-3694ada3-4aa5-464b-adcc-d70447c7fc63 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:40.706565 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-3694ada3-4aa5-464b-adcc-d70447c7fc63 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:40.706565 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3694ada3-4aa5-464b-adcc-d70447c7fc63 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466" status: 200 len: 1482 microversion: 2.25 time: 0.572173 Sep 23 04:37:40.708395 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 897/1740] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:37:40 2022] GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466 => generated 1482 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:37:40.718469 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-19da2000-365e-40aa-852c-a74ece8b9253 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:40.725221 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-19da2000-365e-40aa-852c-a74ece8b9253 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] [instance: 0dff1738-81f1-4619-af74-44b7adc805b5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:40.728144 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-19da2000-365e-40aa-852c-a74ece8b9253 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:40.728842 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-19da2000-365e-40aa-852c-a74ece8b9253 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:40.729454 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-19da2000-365e-40aa-852c-a74ece8b9253 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:40.730581 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-19da2000-365e-40aa-852c-a74ece8b9253 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:40.731214 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-19da2000-365e-40aa-852c-a74ece8b9253 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:40.731814 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-19da2000-365e-40aa-852c-a74ece8b9253 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:40.767318 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-19da2000-365e-40aa-852c-a74ece8b9253 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] HTTP exception thrown: Instance 0dff1738-81f1-4619-af74-44b7adc805b5 could not be found. Sep 23 04:37:40.769365 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-19da2000-365e-40aa-852c-a74ece8b9253 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Request method failure captured: Sep 23 04:37:40.769365 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/0dff1738-81f1-4619-af74-44b7adc805b5 HTTP/1.1 Sep 23 04:37:40.769365 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:37:40.769365 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:37:40.769365 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:37:40.769365 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:37:40.769365 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:37:40.769365 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:37:40.769365 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:37:40.769365 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:37:40.769365 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTbVYJ52adAJ9FheNo4laGscIedhjQbJFOPau48A1AEr2s0iaN9LeefHC7L67iMyGsjmMLdPqATLlkb5I62UP_x_BbGK82ZOrjFJn0VvU_oxwpjgQlBkTumkEKg5lhV-GSi40Q3ydTifg6UNTnNJYkNIbsqEMRtSs8uF-SAwyPe086c Sep 23 04:37:40.769365 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:37:40.769365 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:37:40.769365 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:37:40.769365 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:37:40.769365 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:37:40.769365 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:37:40.769365 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 54abd267d3c043e09f26f486823907e2 Sep 23 04:37:40.769365 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-MigrationsAdminTest-898134375 Sep 23 04:37:40.769365 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:37:40.769365 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:37:40.769365 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_54abd267d3c043e09f26f486823907e2", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/54abd267d3c043e09f26f486823907e2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/54abd267d3c043e09f26f486823907e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/54abd267d3c043e09f26f486823907e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:37:40.769365 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-MigrationsAdminTest-898134375 Sep 23 04:37:40.769365 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 54abd267d3c043e09f26f486823907e2 Sep 23 04:37:40.769365 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-MigrationsAdminTest-898134375 Sep 23 04:37:40.769365 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-MigrationsAdminTest-898134375-project Sep 23 04:37:40.769365 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:37:40.769365 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:37:40.769365 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 13f5a913548445a09377847fd78a10a1 Sep 23 04:37:40.769365 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-MigrationsAdminTest-898134375-project Sep 23 04:37:40.769365 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:37:40.769365 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 0dff1738-81f1-4619-af74-44b7adc805b5 could not be found. Sep 23 04:37:40.769365 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '0dff1738-81f1-4619-af74-44b7adc805b5'} Sep 23 04:37:40.769365 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:37:40.769365 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:37:40.769365 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:37:40.769365 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:37:40.769365 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:37:40.769365 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:37:40.769365 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:37:40.769365 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:37:40.769365 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:37:40.769365 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:37:40.769365 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0dff1738-81f1-4619-af74-44b7adc805b5 could not be found. Sep 23 04:37:40.769365 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:37:40.769365 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:37:40.769365 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:37:40.769365 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:37:40.769365 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:37:40.769365 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:37:40.769365 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:37:40.769365 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:37:40.769365 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:37:40.769365 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:37:40.769365 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:37:40.769365 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:37:40.769365 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:37:40.769365 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:37:40.769365 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:37:40.769365 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:37:40.769365 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0dff1738-81f1-4619-af74-44b7adc805b5 could not be found. Sep 23 04:37:40.769365 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:37:40.769365 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:37:40.769365 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:37:40.775742 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:37:40.775742 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:37:40.775742 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:37:40.775742 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:37:40.775742 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:37:40.775742 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0dff1738-81f1-4619-af74-44b7adc805b5 could not be found. Sep 23 04:37:40.775742 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:37:40.775742 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-19da2000-365e-40aa-852c-a74ece8b9253 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] Returning 404 to user: Instance 0dff1738-81f1-4619-af74-44b7adc805b5 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:37:40.775742 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-19da2000-365e-40aa-852c-a74ece8b9253 tempest-MigrationsAdminTest-898134375 tempest-MigrationsAdminTest-898134375-project] 10.222.0.33 "GET /compute/v2.1/servers/0dff1738-81f1-4619-af74-44b7adc805b5" status: 404 len: 111 microversion: 2.1 time: 0.060912 Sep 23 04:37:40.775742 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 898/1741] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:40 2022] GET /compute/v2.1/servers/0dff1738-81f1-4619-af74-44b7adc805b5 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:37:40.788301 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e3c7c73f-1d83-48da-a820-12353dded006 tempest-VolumesTestJSON-1808526912 tempest-VolumesTestJSON-1808526912-project] Calling method '.version_select at 0x7ff1bb737940>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:40.877709 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-783f7441-6799-401d-8c07-489936707bd0 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:40.900788 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e3c7c73f-1d83-48da-a820-12353dded006 tempest-VolumesTestJSON-1808526912 tempest-VolumesTestJSON-1808526912-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/cf1c02fe-ff84-4ad5-ad4c-4a124016e779" status: 200 len: 351 microversion: 2.1 time: 0.128238 Sep 23 04:37:40.910026 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 899/1742] 10.222.0.33 () {58 vars in 1245 bytes} [Fri Sep 23 04:37:40 2022] GET /compute/v2.1/os-volumes/cf1c02fe-ff84-4ad5-ad4c-4a124016e779 => generated 351 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:37:40.910026 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3a9778bf-f97b-4745-9ec8-dcd44500cf7a tempest-ServersOnMultiNodesTest-617918424 tempest-ServersOnMultiNodesTest-617918424-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:40.910026 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-3a9778bf-f97b-4745-9ec8-dcd44500cf7a tempest-ServersOnMultiNodesTest-617918424 tempest-ServersOnMultiNodesTest-617918424-project-admin] [instance: 7b84f450-5c05-4468-b17a-2cd30f2c7f55] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:40.913989 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3a9778bf-f97b-4745-9ec8-dcd44500cf7a tempest-ServersOnMultiNodesTest-617918424 tempest-ServersOnMultiNodesTest-617918424-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:40.914494 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3a9778bf-f97b-4745-9ec8-dcd44500cf7a tempest-ServersOnMultiNodesTest-617918424 tempest-ServersOnMultiNodesTest-617918424-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:40.914942 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3a9778bf-f97b-4745-9ec8-dcd44500cf7a tempest-ServersOnMultiNodesTest-617918424 tempest-ServersOnMultiNodesTest-617918424-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:40.919956 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3a9778bf-f97b-4745-9ec8-dcd44500cf7a tempest-ServersOnMultiNodesTest-617918424 tempest-ServersOnMultiNodesTest-617918424-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:40.925762 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3a9778bf-f97b-4745-9ec8-dcd44500cf7a tempest-ServersOnMultiNodesTest-617918424 tempest-ServersOnMultiNodesTest-617918424-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:40.925762 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3a9778bf-f97b-4745-9ec8-dcd44500cf7a tempest-ServersOnMultiNodesTest-617918424 tempest-ServersOnMultiNodesTest-617918424-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:40.942609 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-783f7441-6799-401d-8c07-489936707bd0 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:40.956446 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-783f7441-6799-401d-8c07-489936707bd0 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:40.966302 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-783f7441-6799-401d-8c07-489936707bd0 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] 10.222.0.33 "GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e" status: 200 len: 1797 microversion: 2.42 time: 0.579006 Sep 23 04:37:40.969283 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 844/1743] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:37:40 2022] GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e => generated 1797 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:37:40.997217 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6438733c-4b18-4519-9217-bb5f911180f7 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:40.997845 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-6438733c-4b18-4519-9217-bb5f911180f7 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 19d7387c-9776-4e8e-801d-c959ba47af7f] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:41.022265 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6438733c-4b18-4519-9217-bb5f911180f7 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:41.022999 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6438733c-4b18-4519-9217-bb5f911180f7 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:41.023629 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6438733c-4b18-4519-9217-bb5f911180f7 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:41.026698 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6438733c-4b18-4519-9217-bb5f911180f7 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:41.028606 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6438733c-4b18-4519-9217-bb5f911180f7 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:41.029054 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6438733c-4b18-4519-9217-bb5f911180f7 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:41.353316 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3a9778bf-f97b-4745-9ec8-dcd44500cf7a tempest-ServersOnMultiNodesTest-617918424 tempest-ServersOnMultiNodesTest-617918424-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/7b84f450-5c05-4468-b17a-2cd30f2c7f55" status: 200 len: 1616 microversion: 2.1 time: 0.450558 Sep 23 04:37:41.354141 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 900/1744] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:40 2022] GET /compute/v2.1/servers/7b84f450-5c05-4468-b17a-2cd30f2c7f55 => generated 1616 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:41.367035 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-5728f9d5-feb4-49bc-8c13-df9f9be68e96 req-e39530fd-931d-4797-b9cb-f1e95528e5a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19d7387c-9776-4e8e-801d-c959ba47af7f", "tag": "dab2de18-5f6f-4711-9a26-d38a68a18157"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:37:41.396045 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-5728f9d5-feb4-49bc-8c13-df9f9be68e96 req-e39530fd-931d-4797-b9cb-f1e95528e5a1 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:41.397132 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-5728f9d5-feb4-49bc-8c13-df9f9be68e96 req-e39530fd-931d-4797-b9cb-f1e95528e5a1 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:41.398078 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-5728f9d5-feb4-49bc-8c13-df9f9be68e96 req-e39530fd-931d-4797-b9cb-f1e95528e5a1 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:41.411740 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-5728f9d5-feb4-49bc-8c13-df9f9be68e96 req-e39530fd-931d-4797-b9cb-f1e95528e5a1 service nova] Creating event network-changed:dab2de18-5f6f-4711-9a26-d38a68a18157 for instance 19d7387c-9776-4e8e-801d-c959ba47af7f on n-h2-846463-3 Sep 23 04:37:41.419348 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-5728f9d5-feb4-49bc-8c13-df9f9be68e96 req-e39530fd-931d-4797-b9cb-f1e95528e5a1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064011 Sep 23 04:37:41.420559 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 901/1745] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:37:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:37:41.434358 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-48ab2f44-6f17-4528-b4a0-9774a3721489 tempest-VolumesTestJSON-1808526912 tempest-VolumesTestJSON-1808526912-project] Calling method '.version_select at 0x7ff1c3f11550>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:41.528076 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6438733c-4b18-4519-9217-bb5f911180f7 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:41.535775 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-6438733c-4b18-4519-9217-bb5f911180f7 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/19d7387c-9776-4e8e-801d-c959ba47af7f" status: 200 len: 1314 microversion: 2.1 time: 0.563781 Sep 23 04:37:41.536364 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 845/1746] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:40 2022] GET /compute/v2.1/servers/19d7387c-9776-4e8e-801d-c959ba47af7f => generated 1314 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:41.553119 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6380683e-2248-43c1-bc72-14c07da79f79 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:41.560258 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-6380683e-2248-43c1-bc72-14c07da79f79 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: 04e9b262-d9e0-434a-bcbb-a85ef9180ee9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:41.578699 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6380683e-2248-43c1-bc72-14c07da79f79 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:41.579206 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6380683e-2248-43c1-bc72-14c07da79f79 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:41.579656 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6380683e-2248-43c1-bc72-14c07da79f79 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:41.585172 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6380683e-2248-43c1-bc72-14c07da79f79 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:41.585711 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6380683e-2248-43c1-bc72-14c07da79f79 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:41.600347 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-48ab2f44-6f17-4528-b4a0-9774a3721489 tempest-VolumesTestJSON-1808526912 tempest-VolumesTestJSON-1808526912-project] 10.222.0.33 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.178437 Sep 23 04:37:41.601587 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 902/1747] 10.222.0.33 () {58 vars in 1134 bytes} [Fri Sep 23 04:37:41 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:41.602280 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6380683e-2248-43c1-bc72-14c07da79f79 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:41.607680 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-734748f1-e82a-4a00-a83f-11668d36169f tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1390729455", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["1180ceb9-a888-4a3b-ba9d-a35afa8dc279"]}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:37:41.707738 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.neutron [None req-734748f1-e82a-4a00-a83f-11668d36169f tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] validate_networks() for None {{(pid=122699) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:37:42.019573 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6380683e-2248-43c1-bc72-14c07da79f79 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:42.029240 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-6380683e-2248-43c1-bc72-14c07da79f79 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9" status: 200 len: 1719 microversion: 2.1 time: 0.491847 Sep 23 04:37:42.029915 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 846/1748] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:41 2022] GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9 => generated 1719 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:42.035268 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-19babb55-265f-4eb8-af58-783191921e5d tempest-VolumesTestJSON-1808526912 tempest-VolumesTestJSON-1808526912-project] Calling method '.version_select at 0x7ff1bb95c550>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:42.142891 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-19babb55-265f-4eb8-af58-783191921e5d tempest-VolumesTestJSON-1808526912 tempest-VolumesTestJSON-1808526912-project] 10.222.0.33 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.111754 Sep 23 04:37:42.144167 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 847/1749] 10.222.0.33 () {58 vars in 1149 bytes} [Fri Sep 23 04:37:42 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:37:42.149361 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-af745ace-ea66-4c04-aee9-97acbde10f0b tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:42.150317 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-af745ace-ea66-4c04-aee9-97acbde10f0b tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 9e9a41f2-ff28-4c2a-80aa-193e0ebce466] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:42.167297 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-af745ace-ea66-4c04-aee9-97acbde10f0b tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:42.167839 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-af745ace-ea66-4c04-aee9-97acbde10f0b tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:42.168294 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-af745ace-ea66-4c04-aee9-97acbde10f0b tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:42.169025 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-af745ace-ea66-4c04-aee9-97acbde10f0b tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:42.169496 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-af745ace-ea66-4c04-aee9-97acbde10f0b tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:42.175549 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-af745ace-ea66-4c04-aee9-97acbde10f0b tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:42.177518 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-734748f1-e82a-4a00-a83f-11668d36169f tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Flavor limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:37:42.177921 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-734748f1-e82a-4a00-a83f-11668d36169f tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Image limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:37:42.178457 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-734748f1-e82a-4a00-a83f-11668d36169f tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Flavor pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:37:42.180508 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-734748f1-e82a-4a00-a83f-11668d36169f tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Image pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:37:42.180933 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-734748f1-e82a-4a00-a83f-11668d36169f tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:37:42.192931 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-734748f1-e82a-4a00-a83f-11668d36169f tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:42.193879 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-734748f1-e82a-4a00-a83f-11668d36169f tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:42.194758 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-734748f1-e82a-4a00-a83f-11668d36169f tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:42.195925 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-734748f1-e82a-4a00-a83f-11668d36169f tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:42.196817 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-734748f1-e82a-4a00-a83f-11668d36169f tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:42.197580 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-734748f1-e82a-4a00-a83f-11668d36169f tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:42.224506 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-734748f1-e82a-4a00-a83f-11668d36169f tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Getting quotas for project f5db359a60174c45afa2bf06e23a46c4. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:37:42.233056 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-734748f1-e82a-4a00-a83f-11668d36169f tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Getting quotas for user da08af8193dd490b93278385583f24c0 and project f5db359a60174c45afa2bf06e23a46c4. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:37:42.260580 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-734748f1-e82a-4a00-a83f-11668d36169f tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Going to run 1 instances... {{(pid=122699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:37:42.263150 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-734748f1-e82a-4a00-a83f-11668d36169f tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: dc2293d8-bde5-4b6a-a59f-6238703e83cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:37:42.267319 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-af745ace-ea66-4c04-aee9-97acbde10f0b tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:42.282350 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-af745ace-ea66-4c04-aee9-97acbde10f0b tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:42.298224 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-af745ace-ea66-4c04-aee9-97acbde10f0b tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:42.302269 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-af745ace-ea66-4c04-aee9-97acbde10f0b tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466" status: 200 len: 1265 microversion: 2.25 time: 0.156542 Sep 23 04:37:42.305263 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 848/1750] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:37:42 2022] GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:37:42.317435 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-075f753b-6653-4218-b5f5-1b5392bc705b tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:42.318910 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-075f753b-6653-4218-b5f5-1b5392bc705b tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] [instance: 53745879-9973-4217-b1c5-b45f917db80e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:42.327977 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-075f753b-6653-4218-b5f5-1b5392bc705b tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:42.328939 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-075f753b-6653-4218-b5f5-1b5392bc705b tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:42.329614 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-075f753b-6653-4218-b5f5-1b5392bc705b tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:42.334824 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-075f753b-6653-4218-b5f5-1b5392bc705b tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:42.335555 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-075f753b-6653-4218-b5f5-1b5392bc705b tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:42.337163 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-075f753b-6653-4218-b5f5-1b5392bc705b tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:42.500032 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-734748f1-e82a-4a00-a83f-11668d36169f tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.896731 Sep 23 04:37:42.500705 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 903/1751] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:37:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 898 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:37:42.521439 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-db88db22-fdac-4d1e-a69f-87cc02eb1c9e tempest-VolumesTestJSON-1808526912 tempest-VolumesTestJSON-1808526912-project] Calling method '.version_select at 0x7ff1bb6fdc10>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:42.614278 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-075f753b-6653-4218-b5f5-1b5392bc705b tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:42.629759 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:37:42.629759 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-075f753b-6653-4218-b5f5-1b5392bc705b tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:42.629759 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-075f753b-6653-4218-b5f5-1b5392bc705b tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:42.630901 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-075f753b-6653-4218-b5f5-1b5392bc705b tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] 10.222.0.33 "GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e" status: 200 len: 1843 microversion: 2.42 time: 0.326569 Sep 23 04:37:42.633773 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 849/1752] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:37:42 2022] GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e => generated 1843 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:37:42.651997 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-faf5da4a-6c42-4265-8756-3e5733ef6082 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:42.652994 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-faf5da4a-6c42-4265-8756-3e5733ef6082 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: dc2293d8-bde5-4b6a-a59f-6238703e83cc] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:42.756202 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-faf5da4a-6c42-4265-8756-3e5733ef6082 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:42.759369 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-faf5da4a-6c42-4265-8756-3e5733ef6082 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/dc2293d8-bde5-4b6a-a59f-6238703e83cc" status: 200 len: 1217 microversion: 2.1 time: 0.126008 Sep 23 04:37:42.785750 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 850/1753] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:42 2022] GET /compute/v2.1/servers/dc2293d8-bde5-4b6a-a59f-6238703e83cc => generated 1217 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:42.799847 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-62f88874-17e7-4b26-bfe1-331146fd11b6 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:42.804004 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-62f88874-17e7-4b26-bfe1-331146fd11b6 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 19d7387c-9776-4e8e-801d-c959ba47af7f] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:42.819796 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-62f88874-17e7-4b26-bfe1-331146fd11b6 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:42.822271 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-62f88874-17e7-4b26-bfe1-331146fd11b6 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:42.823909 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-62f88874-17e7-4b26-bfe1-331146fd11b6 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:42.824781 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-62f88874-17e7-4b26-bfe1-331146fd11b6 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:42.840390 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-62f88874-17e7-4b26-bfe1-331146fd11b6 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:42.842079 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-62f88874-17e7-4b26-bfe1-331146fd11b6 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:43.018059 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-62f88874-17e7-4b26-bfe1-331146fd11b6 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:43.033353 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-62f88874-17e7-4b26-bfe1-331146fd11b6 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/19d7387c-9776-4e8e-801d-c959ba47af7f" status: 200 len: 1314 microversion: 2.1 time: 0.246550 Sep 23 04:37:43.043863 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 851/1754] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:42 2022] GET /compute/v2.1/servers/19d7387c-9776-4e8e-801d-c959ba47af7f => generated 1314 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:43.349419 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0e91db9a-bf4d-448a-91b5-dd12b7bfdf01 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1612956669", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "networks": [{"uuid": "e5b26c89-25a8-4c47-bae6-64da5c00ae96"}]}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:37:43.362468 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-db88db22-fdac-4d1e-a69f-87cc02eb1c9e tempest-VolumesTestJSON-1808526912 tempest-VolumesTestJSON-1808526912-project] 10.222.0.33 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.858332 Sep 23 04:37:43.363597 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 904/1755] 10.222.0.33 () {58 vars in 1134 bytes} [Fri Sep 23 04:37:42 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:43.368631 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-71ab339f-4244-4b9d-9c91-15994bce633f tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:43.369245 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-71ab339f-4244-4b9d-9c91-15994bce633f tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: 04e9b262-d9e0-434a-bcbb-a85ef9180ee9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:43.385537 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-71ab339f-4244-4b9d-9c91-15994bce633f tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:43.388847 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-71ab339f-4244-4b9d-9c91-15994bce633f tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:43.391282 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-71ab339f-4244-4b9d-9c91-15994bce633f tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:43.392388 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-71ab339f-4244-4b9d-9c91-15994bce633f tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:43.394822 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-71ab339f-4244-4b9d-9c91-15994bce633f tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:43.395824 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-71ab339f-4244-4b9d-9c91-15994bce633f tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:43.444043 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.network.neutron [None req-0e91db9a-bf4d-448a-91b5-dd12b7bfdf01 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] validate_networks() for [('e5b26c89-25a8-4c47-bae6-64da5c00ae96', None, None, None, None, None)] {{(pid=122698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:37:44.056680 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-71ab339f-4244-4b9d-9c91-15994bce633f tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:44.080967 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-71ab339f-4244-4b9d-9c91-15994bce633f tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9" status: 200 len: 1719 microversion: 2.1 time: 0.716075 Sep 23 04:37:44.083871 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 905/1756] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:43 2022] GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9 => generated 1719 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:44.095904 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5783a80b-3fd7-4e18-b18e-6e7a62e37670 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:44.102696 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-5783a80b-3fd7-4e18-b18e-6e7a62e37670 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 9e9a41f2-ff28-4c2a-80aa-193e0ebce466] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:44.119676 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5783a80b-3fd7-4e18-b18e-6e7a62e37670 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:44.120528 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5783a80b-3fd7-4e18-b18e-6e7a62e37670 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:44.121189 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5783a80b-3fd7-4e18-b18e-6e7a62e37670 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:44.122150 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5783a80b-3fd7-4e18-b18e-6e7a62e37670 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:44.122824 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5783a80b-3fd7-4e18-b18e-6e7a62e37670 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:44.123467 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5783a80b-3fd7-4e18-b18e-6e7a62e37670 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:44.305569 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-5783a80b-3fd7-4e18-b18e-6e7a62e37670 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:44.314347 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-5783a80b-3fd7-4e18-b18e-6e7a62e37670 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:44.323867 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-5783a80b-3fd7-4e18-b18e-6e7a62e37670 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:44.325756 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5783a80b-3fd7-4e18-b18e-6e7a62e37670 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466" status: 200 len: 1265 microversion: 2.25 time: 0.242323 Sep 23 04:37:44.327435 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 906/1757] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:37:44 2022] GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466 => generated 1265 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:37:44.341454 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-254374de-785b-475a-9917-8a3982cddd92 tempest-VolumesTestJSON-1808526912 tempest-VolumesTestJSON-1808526912-project] Calling method '.version_select at 0x7ff1bb77dca0>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:44.388871 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-0e91db9a-bf4d-448a-91b5-dd12b7bfdf01 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Flavor limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:37:44.389328 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-0e91db9a-bf4d-448a-91b5-dd12b7bfdf01 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Image limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:37:44.389566 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-0e91db9a-bf4d-448a-91b5-dd12b7bfdf01 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Flavor pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:37:44.393185 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-0e91db9a-bf4d-448a-91b5-dd12b7bfdf01 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Image pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:37:44.394549 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-0e91db9a-bf4d-448a-91b5-dd12b7bfdf01 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:37:44.426312 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0e91db9a-bf4d-448a-91b5-dd12b7bfdf01 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:44.427271 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0e91db9a-bf4d-448a-91b5-dd12b7bfdf01 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:44.427946 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0e91db9a-bf4d-448a-91b5-dd12b7bfdf01 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:44.431776 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0e91db9a-bf4d-448a-91b5-dd12b7bfdf01 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:44.432469 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0e91db9a-bf4d-448a-91b5-dd12b7bfdf01 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:44.433094 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0e91db9a-bf4d-448a-91b5-dd12b7bfdf01 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:44.520495 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-0e91db9a-bf4d-448a-91b5-dd12b7bfdf01 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Getting quotas for project 721b412c874d4e668b4a1a33dedb2c9b. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:37:44.536406 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-0e91db9a-bf4d-448a-91b5-dd12b7bfdf01 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Getting quotas for user 1244f3db540441a28d8413e510cfccad and project 721b412c874d4e668b4a1a33dedb2c9b. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:37:44.565332 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-0e91db9a-bf4d-448a-91b5-dd12b7bfdf01 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Going to run 1 instances... {{(pid=122698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:37:44.568719 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-0e91db9a-bf4d-448a-91b5-dd12b7bfdf01 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] [instance: 7e90c852-5f27-4861-9b25-9ea1e475c0a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:37:44.886938 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0e91db9a-bf4d-448a-91b5-dd12b7bfdf01 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.841369 Sep 23 04:37:44.887752 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 852/1758] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:37:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1843 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:37:44.893309 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-5675873d-6f34-41c7-811e-fd0d226274c0 req-f24354ba-ae79-4092-845f-259d47b16b36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e9a41f2-ff28-4c2a-80aa-193e0ebce466", "name": "network-vif-deleted", "tag": "11d5e398-f101-4c1d-8d16-8553226b7947"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:37:44.908712 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-5675873d-6f34-41c7-811e-fd0d226274c0 req-f24354ba-ae79-4092-845f-259d47b16b36 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:44.910084 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-5675873d-6f34-41c7-811e-fd0d226274c0 req-f24354ba-ae79-4092-845f-259d47b16b36 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:44.910859 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-5675873d-6f34-41c7-811e-fd0d226274c0 req-f24354ba-ae79-4092-845f-259d47b16b36 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:44.946016 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-5675873d-6f34-41c7-811e-fd0d226274c0 req-f24354ba-ae79-4092-845f-259d47b16b36 service nova] Creating event network-vif-deleted:11d5e398-f101-4c1d-8d16-8553226b7947 for instance 9e9a41f2-ff28-4c2a-80aa-193e0ebce466 on n-h2-846463-3 Sep 23 04:37:44.980563 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-5675873d-6f34-41c7-811e-fd0d226274c0 req-f24354ba-ae79-4092-845f-259d47b16b36 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081250 Sep 23 04:37:44.981725 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 853/1759] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:37:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:37:44.999061 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9d5b94c4-84df-4365-add6-13e22f36043c tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:45.004354 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-9d5b94c4-84df-4365-add6-13e22f36043c tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] [instance: 53745879-9973-4217-b1c5-b45f917db80e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:45.023233 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9d5b94c4-84df-4365-add6-13e22f36043c tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:45.025040 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9d5b94c4-84df-4365-add6-13e22f36043c tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:45.028397 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9d5b94c4-84df-4365-add6-13e22f36043c tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:45.029380 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9d5b94c4-84df-4365-add6-13e22f36043c tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:45.031829 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9d5b94c4-84df-4365-add6-13e22f36043c tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:45.032684 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9d5b94c4-84df-4365-add6-13e22f36043c tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:45.598621 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-9d5b94c4-84df-4365-add6-13e22f36043c tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:45.609541 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-9d5b94c4-84df-4365-add6-13e22f36043c tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:45.615620 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-9d5b94c4-84df-4365-add6-13e22f36043c tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:45.617117 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9d5b94c4-84df-4365-add6-13e22f36043c tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] 10.222.0.33 "GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e" status: 200 len: 1843 microversion: 2.42 time: 0.634084 Sep 23 04:37:45.626939 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 854/1760] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:37:44 2022] GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e => generated 1843 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:37:45.632192 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0e4eb002-4303-4798-9903-2ef7aa67160a tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:45.633689 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-0e4eb002-4303-4798-9903-2ef7aa67160a tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: dc2293d8-bde5-4b6a-a59f-6238703e83cc] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:45.645011 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0e4eb002-4303-4798-9903-2ef7aa67160a tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:45.648251 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0e4eb002-4303-4798-9903-2ef7aa67160a tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:45.649082 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0e4eb002-4303-4798-9903-2ef7aa67160a tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:45.650005 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0e4eb002-4303-4798-9903-2ef7aa67160a tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:45.652002 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0e4eb002-4303-4798-9903-2ef7aa67160a tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:45.652613 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0e4eb002-4303-4798-9903-2ef7aa67160a tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:45.756003 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-0e4eb002-4303-4798-9903-2ef7aa67160a tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:45.765026 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0e4eb002-4303-4798-9903-2ef7aa67160a tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/dc2293d8-bde5-4b6a-a59f-6238703e83cc" status: 200 len: 1269 microversion: 2.1 time: 0.136666 Sep 23 04:37:45.786643 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 855/1761] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:45 2022] GET /compute/v2.1/servers/dc2293d8-bde5-4b6a-a59f-6238703e83cc => generated 1269 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:45.792661 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7410df3c-2047-4375-874d-abacab7f421f tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:45.800447 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7410df3c-2047-4375-874d-abacab7f421f tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 19d7387c-9776-4e8e-801d-c959ba47af7f] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:45.801341 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7410df3c-2047-4375-874d-abacab7f421f tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:45.802066 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7410df3c-2047-4375-874d-abacab7f421f tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:45.802754 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7410df3c-2047-4375-874d-abacab7f421f tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:45.803645 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7410df3c-2047-4375-874d-abacab7f421f tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:45.804272 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7410df3c-2047-4375-874d-abacab7f421f tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:45.805028 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7410df3c-2047-4375-874d-abacab7f421f tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:46.082626 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-7410df3c-2047-4375-874d-abacab7f421f tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:46.097504 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7410df3c-2047-4375-874d-abacab7f421f tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/19d7387c-9776-4e8e-801d-c959ba47af7f" status: 200 len: 1314 microversion: 2.1 time: 0.308251 Sep 23 04:37:46.098601 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 856/1762] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:45 2022] GET /compute/v2.1/servers/19d7387c-9776-4e8e-801d-c959ba47af7f => generated 1314 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:46.103240 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-739ce7ec-7b40-4b6a-828c-83b86bef6763 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:46.113867 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-739ce7ec-7b40-4b6a-828c-83b86bef6763 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: 04e9b262-d9e0-434a-bcbb-a85ef9180ee9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:46.124645 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-739ce7ec-7b40-4b6a-828c-83b86bef6763 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:46.125446 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-739ce7ec-7b40-4b6a-828c-83b86bef6763 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:46.125923 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-739ce7ec-7b40-4b6a-828c-83b86bef6763 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:46.126656 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-739ce7ec-7b40-4b6a-828c-83b86bef6763 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:46.127118 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-739ce7ec-7b40-4b6a-828c-83b86bef6763 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:46.127546 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-739ce7ec-7b40-4b6a-828c-83b86bef6763 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:46.407764 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-739ce7ec-7b40-4b6a-828c-83b86bef6763 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:46.420176 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-739ce7ec-7b40-4b6a-828c-83b86bef6763 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9" status: 200 len: 1719 microversion: 2.1 time: 0.320115 Sep 23 04:37:46.429581 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 857/1763] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:46 2022] GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9 => generated 1719 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:46.444478 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ed91188a-247e-4585-a8ef-eb1d4d94be98 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-551733554", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "networks": [{"uuid": "e5b26c89-25a8-4c47-bae6-64da5c00ae96"}]}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:37:46.564063 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.network.neutron [None req-ed91188a-247e-4585-a8ef-eb1d4d94be98 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] validate_networks() for [('e5b26c89-25a8-4c47-bae6-64da5c00ae96', None, None, None, None, None)] {{(pid=122698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:37:47.280964 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-ed91188a-247e-4585-a8ef-eb1d4d94be98 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Flavor limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:37:47.284684 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-ed91188a-247e-4585-a8ef-eb1d4d94be98 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Image limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:37:47.284684 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-ed91188a-247e-4585-a8ef-eb1d4d94be98 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Flavor pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:37:47.284684 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-ed91188a-247e-4585-a8ef-eb1d4d94be98 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Image pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:37:47.285238 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-ed91188a-247e-4585-a8ef-eb1d4d94be98 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:37:47.321201 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ed91188a-247e-4585-a8ef-eb1d4d94be98 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:47.323112 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ed91188a-247e-4585-a8ef-eb1d4d94be98 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:47.323958 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ed91188a-247e-4585-a8ef-eb1d4d94be98 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:47.325384 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ed91188a-247e-4585-a8ef-eb1d4d94be98 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:47.326376 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ed91188a-247e-4585-a8ef-eb1d4d94be98 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:47.329141 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ed91188a-247e-4585-a8ef-eb1d4d94be98 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:47.413070 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-ed91188a-247e-4585-a8ef-eb1d4d94be98 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Getting quotas for project 721b412c874d4e668b4a1a33dedb2c9b. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:37:47.436709 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-ed91188a-247e-4585-a8ef-eb1d4d94be98 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Getting quotas for user 1244f3db540441a28d8413e510cfccad and project 721b412c874d4e668b4a1a33dedb2c9b. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:37:47.510961 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-ed91188a-247e-4585-a8ef-eb1d4d94be98 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Going to run 1 instances... {{(pid=122698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:37:47.513623 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-ed91188a-247e-4585-a8ef-eb1d4d94be98 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] [instance: 94e8c141-ef33-4bb2-929f-7f7d0d10ff2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:37:47.713822 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ed91188a-247e-4585-a8ef-eb1d4d94be98 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.278903 Sep 23 04:37:47.737191 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 858/1764] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:37:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1301 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:37:47.749138 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-93e31c9b-e261-4f4c-81bd-f58533d698f1 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:47.752425 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-93e31c9b-e261-4f4c-81bd-f58533d698f1 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 9e9a41f2-ff28-4c2a-80aa-193e0ebce466] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:47.772694 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-93e31c9b-e261-4f4c-81bd-f58533d698f1 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:47.773211 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-93e31c9b-e261-4f4c-81bd-f58533d698f1 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:47.773658 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-93e31c9b-e261-4f4c-81bd-f58533d698f1 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:47.774409 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-93e31c9b-e261-4f4c-81bd-f58533d698f1 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:47.774875 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-93e31c9b-e261-4f4c-81bd-f58533d698f1 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:47.775305 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-93e31c9b-e261-4f4c-81bd-f58533d698f1 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:47.895795 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-93e31c9b-e261-4f4c-81bd-f58533d698f1 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:47.911083 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-93e31c9b-e261-4f4c-81bd-f58533d698f1 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:47.916520 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-93e31c9b-e261-4f4c-81bd-f58533d698f1 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:47.919218 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-93e31c9b-e261-4f4c-81bd-f58533d698f1 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466" status: 200 len: 1265 microversion: 2.25 time: 0.179893 Sep 23 04:37:47.933648 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 859/1765] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:37:47 2022] GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466 => generated 1265 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:37:47.940420 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-45a8172e-21c1-4120-a57f-8c4b71f5520a req-7b7e8930-f3f4-4e80-9e11-e4585e5ae9d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53745879-9973-4217-b1c5-b45f917db80e", "tag": "04ec7c4f-3b61-4a17-a7c1-0ebd792d85ae"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:37:47.962934 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-45a8172e-21c1-4120-a57f-8c4b71f5520a req-7b7e8930-f3f4-4e80-9e11-e4585e5ae9d9 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:47.964528 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-45a8172e-21c1-4120-a57f-8c4b71f5520a req-7b7e8930-f3f4-4e80-9e11-e4585e5ae9d9 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:47.964992 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-45a8172e-21c1-4120-a57f-8c4b71f5520a req-7b7e8930-f3f4-4e80-9e11-e4585e5ae9d9 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:47.979900 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-45a8172e-21c1-4120-a57f-8c4b71f5520a req-7b7e8930-f3f4-4e80-9e11-e4585e5ae9d9 service nova] Creating event network-changed:04ec7c4f-3b61-4a17-a7c1-0ebd792d85ae for instance 53745879-9973-4217-b1c5-b45f917db80e on n-h2-846463-3 Sep 23 04:37:47.986091 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-45a8172e-21c1-4120-a57f-8c4b71f5520a req-7b7e8930-f3f4-4e80-9e11-e4585e5ae9d9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060887 Sep 23 04:37:47.987284 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 860/1766] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:37:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:37:48.000336 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c7a84c4d-2cd9-4d65-bdb9-f9dafb94d64e tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:48.000336 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c7a84c4d-2cd9-4d65-bdb9-f9dafb94d64e tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] [instance: 53745879-9973-4217-b1c5-b45f917db80e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:48.003613 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:37:48.006031 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c7a84c4d-2cd9-4d65-bdb9-f9dafb94d64e tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:48.006711 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c7a84c4d-2cd9-4d65-bdb9-f9dafb94d64e tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:48.007470 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c7a84c4d-2cd9-4d65-bdb9-f9dafb94d64e tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:48.008458 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c7a84c4d-2cd9-4d65-bdb9-f9dafb94d64e tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:48.009135 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c7a84c4d-2cd9-4d65-bdb9-f9dafb94d64e tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:48.010323 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c7a84c4d-2cd9-4d65-bdb9-f9dafb94d64e tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:48.742444 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c7a84c4d-2cd9-4d65-bdb9-f9dafb94d64e tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:48.753670 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c7a84c4d-2cd9-4d65-bdb9-f9dafb94d64e tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:48.755606 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c7a84c4d-2cd9-4d65-bdb9-f9dafb94d64e tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:48.756999 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c7a84c4d-2cd9-4d65-bdb9-f9dafb94d64e tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] 10.222.0.33 "GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e" status: 200 len: 1864 microversion: 2.42 time: 0.768440 Sep 23 04:37:48.757748 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 861/1767] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:37:47 2022] GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e => generated 1864 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:37:48.781332 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-fadd0988-2fa3-49b3-a8e0-07104ca9cf35 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:48.782241 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-fadd0988-2fa3-49b3-a8e0-07104ca9cf35 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: dc2293d8-bde5-4b6a-a59f-6238703e83cc] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:48.788583 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fadd0988-2fa3-49b3-a8e0-07104ca9cf35 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:48.789382 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fadd0988-2fa3-49b3-a8e0-07104ca9cf35 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:48.790047 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fadd0988-2fa3-49b3-a8e0-07104ca9cf35 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:48.790962 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fadd0988-2fa3-49b3-a8e0-07104ca9cf35 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:48.791811 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fadd0988-2fa3-49b3-a8e0-07104ca9cf35 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:48.792602 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fadd0988-2fa3-49b3-a8e0-07104ca9cf35 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:48.903661 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-fadd0988-2fa3-49b3-a8e0-07104ca9cf35 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:48.933700 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-fadd0988-2fa3-49b3-a8e0-07104ca9cf35 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/dc2293d8-bde5-4b6a-a59f-6238703e83cc" status: 200 len: 1275 microversion: 2.1 time: 0.160880 Sep 23 04:37:48.939696 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 862/1768] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:48 2022] GET /compute/v2.1/servers/dc2293d8-bde5-4b6a-a59f-6238703e83cc => generated 1275 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:48.952158 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d695afa2-776d-4e56-ae99-e7b9bf51e726 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:48.955074 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d695afa2-776d-4e56-ae99-e7b9bf51e726 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 19d7387c-9776-4e8e-801d-c959ba47af7f] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:48.964400 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d695afa2-776d-4e56-ae99-e7b9bf51e726 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:48.965391 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d695afa2-776d-4e56-ae99-e7b9bf51e726 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:48.965911 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d695afa2-776d-4e56-ae99-e7b9bf51e726 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:48.967112 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d695afa2-776d-4e56-ae99-e7b9bf51e726 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:48.967736 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d695afa2-776d-4e56-ae99-e7b9bf51e726 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:48.968327 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d695afa2-776d-4e56-ae99-e7b9bf51e726 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:49.569472 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d695afa2-776d-4e56-ae99-e7b9bf51e726 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:49.578130 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d695afa2-776d-4e56-ae99-e7b9bf51e726 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/19d7387c-9776-4e8e-801d-c959ba47af7f" status: 200 len: 1314 microversion: 2.1 time: 0.636446 Sep 23 04:37:49.582477 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 863/1769] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:48 2022] GET /compute/v2.1/servers/19d7387c-9776-4e8e-801d-c959ba47af7f => generated 1314 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:49.609957 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-bb2d930d-36f2-4f75-99b2-2d58b83e085d tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:49.610614 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-bb2d930d-36f2-4f75-99b2-2d58b83e085d tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: 04e9b262-d9e0-434a-bcbb-a85ef9180ee9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:49.617940 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bb2d930d-36f2-4f75-99b2-2d58b83e085d tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:49.619462 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bb2d930d-36f2-4f75-99b2-2d58b83e085d tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:49.620206 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bb2d930d-36f2-4f75-99b2-2d58b83e085d tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:49.621260 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bb2d930d-36f2-4f75-99b2-2d58b83e085d tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:49.622741 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bb2d930d-36f2-4f75-99b2-2d58b83e085d tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:49.623591 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bb2d930d-36f2-4f75-99b2-2d58b83e085d tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:50.018559 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-bb2d930d-36f2-4f75-99b2-2d58b83e085d tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:50.030169 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-bb2d930d-36f2-4f75-99b2-2d58b83e085d tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9" status: 200 len: 1709 microversion: 2.1 time: 0.446263 Sep 23 04:37:50.040662 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 864/1770] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:49 2022] GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9 => generated 1709 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:50.047027 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6b8d6053-8e87-44cb-ad70-4e4cde638c6c tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-78192589", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "451", "networks": [{"uuid": "e5b26c89-25a8-4c47-bae6-64da5c00ae96"}]}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:37:50.154805 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-254374de-785b-475a-9917-8a3982cddd92 tempest-VolumesTestJSON-1808526912 tempest-VolumesTestJSON-1808526912-project] 10.222.0.33 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 352 microversion: 2.1 time: 5.825851 Sep 23 04:37:50.161274 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 907/1771] 10.222.0.33 () {58 vars in 1167 bytes} [Fri Sep 23 04:37:44 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 352 bytes in 5832 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:37:50.185056 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-48605dde-947f-4c88-8dea-26d1b8579fa8 req-ca4935f3-6b50-4441-9710-35d47d904fd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19d7387c-9776-4e8e-801d-c959ba47af7f", "name": "network-vif-plugged", "status": "completed", "tag": "dab2de18-5f6f-4711-9a26-d38a68a18157"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:37:50.192120 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.network.neutron [None req-6b8d6053-8e87-44cb-ad70-4e4cde638c6c tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] validate_networks() for [('e5b26c89-25a8-4c47-bae6-64da5c00ae96', None, None, None, None, None)] {{(pid=122698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:37:50.197265 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-48605dde-947f-4c88-8dea-26d1b8579fa8 req-ca4935f3-6b50-4441-9710-35d47d904fd3 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:50.197993 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-48605dde-947f-4c88-8dea-26d1b8579fa8 req-ca4935f3-6b50-4441-9710-35d47d904fd3 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:50.198622 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-48605dde-947f-4c88-8dea-26d1b8579fa8 req-ca4935f3-6b50-4441-9710-35d47d904fd3 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:50.220246 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-48605dde-947f-4c88-8dea-26d1b8579fa8 req-ca4935f3-6b50-4441-9710-35d47d904fd3 service nova] Creating event network-vif-plugged:dab2de18-5f6f-4711-9a26-d38a68a18157 for instance 19d7387c-9776-4e8e-801d-c959ba47af7f on n-h2-846463-3 Sep 23 04:37:50.235273 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-48605dde-947f-4c88-8dea-26d1b8579fa8 req-ca4935f3-6b50-4441-9710-35d47d904fd3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058049 Sep 23 04:37:50.238499 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 908/1772] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:37:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:37:50.536064 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5e43bd51-03e3-4e59-984e-29c065874c3b tempest-NetworksTest-65506290 tempest-NetworksTest-65506290-project-admin] Calling method '.version_select at 0x7ff1bb9f2160>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:51.112606 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5e43bd51-03e3-4e59-984e-29c065874c3b tempest-NetworksTest-65506290 tempest-NetworksTest-65506290-project-admin] 10.222.0.33 "GET /compute/v2.1/os-networks" status: 200 len: 8769 microversion: 2.1 time: 0.871923 Sep 23 04:37:51.113647 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 909/1773] 10.222.0.33 () {58 vars in 1137 bytes} [Fri Sep 23 04:37:50 2022] GET /compute/v2.1/os-networks => generated 8769 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:51.119166 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-11e98566-b5bd-4556-a0c2-0b3ed32a01d9 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:51.120239 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-11e98566-b5bd-4556-a0c2-0b3ed32a01d9 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 9e9a41f2-ff28-4c2a-80aa-193e0ebce466] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:51.136730 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-11e98566-b5bd-4556-a0c2-0b3ed32a01d9 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:51.138504 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-11e98566-b5bd-4556-a0c2-0b3ed32a01d9 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:51.141607 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-11e98566-b5bd-4556-a0c2-0b3ed32a01d9 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:51.142630 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-11e98566-b5bd-4556-a0c2-0b3ed32a01d9 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:51.143401 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-11e98566-b5bd-4556-a0c2-0b3ed32a01d9 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:51.144824 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-11e98566-b5bd-4556-a0c2-0b3ed32a01d9 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:51.235222 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-11e98566-b5bd-4556-a0c2-0b3ed32a01d9 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:51.236663 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-11e98566-b5bd-4556-a0c2-0b3ed32a01d9 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:51.238661 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-11e98566-b5bd-4556-a0c2-0b3ed32a01d9 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:51.239893 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-11e98566-b5bd-4556-a0c2-0b3ed32a01d9 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lazy-loading 'fault' on Instance uuid 9e9a41f2-ff28-4c2a-80aa-193e0ebce466 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:37:51.363320 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-11e98566-b5bd-4556-a0c2-0b3ed32a01d9 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:51.379735 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-11e98566-b5bd-4556-a0c2-0b3ed32a01d9 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:51.381207 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-11e98566-b5bd-4556-a0c2-0b3ed32a01d9 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:51.382428 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-11e98566-b5bd-4556-a0c2-0b3ed32a01d9 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466" status: 200 len: 1270 microversion: 2.25 time: 0.267392 Sep 23 04:37:51.382997 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 910/1774] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:37:51 2022] GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466 => generated 1270 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:37:51.393976 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e25f2b2d-6729-410c-b65a-215a8fc86f0d tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:51.394620 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e25f2b2d-6729-410c-b65a-215a8fc86f0d tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] [instance: 53745879-9973-4217-b1c5-b45f917db80e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:51.404349 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e25f2b2d-6729-410c-b65a-215a8fc86f0d tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:51.404785 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e25f2b2d-6729-410c-b65a-215a8fc86f0d tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:51.410132 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e25f2b2d-6729-410c-b65a-215a8fc86f0d tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:51.411137 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e25f2b2d-6729-410c-b65a-215a8fc86f0d tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:51.411887 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e25f2b2d-6729-410c-b65a-215a8fc86f0d tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:51.412547 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e25f2b2d-6729-410c-b65a-215a8fc86f0d tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:51.535411 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-6b8d6053-8e87-44cb-ad70-4e4cde638c6c tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Flavor limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:37:51.536429 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-6b8d6053-8e87-44cb-ad70-4e4cde638c6c tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Image limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:37:51.537299 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-6b8d6053-8e87-44cb-ad70-4e4cde638c6c tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Flavor pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:37:51.537986 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-6b8d6053-8e87-44cb-ad70-4e4cde638c6c tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Image pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:37:51.538635 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-6b8d6053-8e87-44cb-ad70-4e4cde638c6c tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:37:51.548342 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6b8d6053-8e87-44cb-ad70-4e4cde638c6c tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:51.549193 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6b8d6053-8e87-44cb-ad70-4e4cde638c6c tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:51.550446 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6b8d6053-8e87-44cb-ad70-4e4cde638c6c tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:51.551564 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6b8d6053-8e87-44cb-ad70-4e4cde638c6c tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:51.552911 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6b8d6053-8e87-44cb-ad70-4e4cde638c6c tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:51.553576 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6b8d6053-8e87-44cb-ad70-4e4cde638c6c tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:51.573284 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-6b8d6053-8e87-44cb-ad70-4e4cde638c6c tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Getting quotas for project 721b412c874d4e668b4a1a33dedb2c9b. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:37:51.579230 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-6b8d6053-8e87-44cb-ad70-4e4cde638c6c tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Getting quotas for user 1244f3db540441a28d8413e510cfccad and project 721b412c874d4e668b4a1a33dedb2c9b. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:37:51.593136 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-6b8d6053-8e87-44cb-ad70-4e4cde638c6c tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Going to run 1 instances... {{(pid=122698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:37:51.597373 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-6b8d6053-8e87-44cb-ad70-4e4cde638c6c tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] [instance: e203a3bb-aff0-41d9-b8ba-750797cab055] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:37:51.702443 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-6b8d6053-8e87-44cb-ad70-4e4cde638c6c tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.660429 Sep 23 04:37:51.718189 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 865/1775] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:37:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1677 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:37:51.749995 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b3f6935e-74b4-4467-af44-08346e76bd47 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:51.755616 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b3f6935e-74b4-4467-af44-08346e76bd47 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: dc2293d8-bde5-4b6a-a59f-6238703e83cc] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:51.770933 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b3f6935e-74b4-4467-af44-08346e76bd47 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:51.771602 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b3f6935e-74b4-4467-af44-08346e76bd47 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:51.774118 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b3f6935e-74b4-4467-af44-08346e76bd47 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:51.775203 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b3f6935e-74b4-4467-af44-08346e76bd47 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:51.777080 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b3f6935e-74b4-4467-af44-08346e76bd47 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:51.778297 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b3f6935e-74b4-4467-af44-08346e76bd47 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:51.931575 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e25f2b2d-6729-410c-b65a-215a8fc86f0d tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:51.953210 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e25f2b2d-6729-410c-b65a-215a8fc86f0d tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:51.961234 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e25f2b2d-6729-410c-b65a-215a8fc86f0d tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:51.972033 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e25f2b2d-6729-410c-b65a-215a8fc86f0d tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] 10.222.0.33 "GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e" status: 200 len: 1885 microversion: 2.42 time: 0.587376 Sep 23 04:37:51.976968 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 911/1776] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:37:51 2022] GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e => generated 1885 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:37:52.006253 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-79e7cac7-cc87-4b08-be90-4c3078f9d340 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Calling method '.version_select at 0x7ff1bb737d30>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:52.021682 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-79e7cac7-cc87-4b08-be90-4c3078f9d340 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:52.028429 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-79e7cac7-cc87-4b08-be90-4c3078f9d340 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:52.033030 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-79e7cac7-cc87-4b08-be90-4c3078f9d340 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:52.079144 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-79e7cac7-cc87-4b08-be90-4c3078f9d340 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] 10.222.0.33 "GET /compute/v2.1/os-migrations" status: 200 len: 2706 microversion: 2.1 time: 0.100736 Sep 23 04:37:52.079781 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 912/1777] 10.222.0.33 () {58 vars in 1143 bytes} [Fri Sep 23 04:37:51 2022] GET /compute/v2.1/os-migrations => generated 2706 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:52.095126 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-bd818746-1f8c-4e6b-8a1f-01490dc8c653 req-00bcc48f-f597-459e-b300-9327534d166c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53745879-9973-4217-b1c5-b45f917db80e", "tag": "8d4fddcb-265b-482d-b84d-6fe44445b855"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:37:52.124486 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-bd818746-1f8c-4e6b-8a1f-01490dc8c653 req-00bcc48f-f597-459e-b300-9327534d166c service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:52.127220 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-bd818746-1f8c-4e6b-8a1f-01490dc8c653 req-00bcc48f-f597-459e-b300-9327534d166c service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:52.127220 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-bd818746-1f8c-4e6b-8a1f-01490dc8c653 req-00bcc48f-f597-459e-b300-9327534d166c service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:52.152025 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-bd818746-1f8c-4e6b-8a1f-01490dc8c653 req-00bcc48f-f597-459e-b300-9327534d166c service nova] Creating event network-changed:8d4fddcb-265b-482d-b84d-6fe44445b855 for instance 53745879-9973-4217-b1c5-b45f917db80e on n-h2-846463-3 Sep 23 04:37:52.159266 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-bd818746-1f8c-4e6b-8a1f-01490dc8c653 req-00bcc48f-f597-459e-b300-9327534d166c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075838 Sep 23 04:37:52.161365 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 913/1778] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:37:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:37:52.168373 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b0c9a6a3-5e31-4311-873d-3d3835113ed0 tempest-VolumesTestJSON-1808526912 tempest-VolumesTestJSON-1808526912-project] Calling method '.version_select at 0x7ff1c3f118b0>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:52.171896 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b3f6935e-74b4-4467-af44-08346e76bd47 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:52.182513 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b3f6935e-74b4-4467-af44-08346e76bd47 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/dc2293d8-bde5-4b6a-a59f-6238703e83cc" status: 200 len: 1317 microversion: 2.1 time: 0.456081 Sep 23 04:37:52.185611 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 866/1779] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:51 2022] GET /compute/v2.1/servers/dc2293d8-bde5-4b6a-a59f-6238703e83cc => generated 1317 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:52.198619 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-60d38058-c40c-4876-bd52-bfebd9cc2cfc tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:52.201821 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-60d38058-c40c-4876-bd52-bfebd9cc2cfc tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 19d7387c-9776-4e8e-801d-c959ba47af7f] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:52.210171 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:37:52.238723 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-60d38058-c40c-4876-bd52-bfebd9cc2cfc tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:52.239443 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-60d38058-c40c-4876-bd52-bfebd9cc2cfc tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:52.240024 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-60d38058-c40c-4876-bd52-bfebd9cc2cfc tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:52.240843 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-60d38058-c40c-4876-bd52-bfebd9cc2cfc tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:52.241372 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-60d38058-c40c-4876-bd52-bfebd9cc2cfc tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:52.241865 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-60d38058-c40c-4876-bd52-bfebd9cc2cfc tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:52.249025 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=6 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:37:52.295294 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b0c9a6a3-5e31-4311-873d-3d3835113ed0 tempest-VolumesTestJSON-1808526912 tempest-VolumesTestJSON-1808526912-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.133155 Sep 23 04:37:52.296174 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 914/1780] 10.222.0.33 () {58 vars in 1170 bytes} [Fri Sep 23 04:37:52 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:37:52.303760 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c2dc3121-b4aa-45d4-98bf-1dba55dc8104 tempest-NetworksTest-65506290 tempest-NetworksTest-65506290-project-admin] Calling method '.version_select at 0x7ff1c3f31ee0>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:52.713651 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c2dc3121-b4aa-45d4-98bf-1dba55dc8104 tempest-NetworksTest-65506290 tempest-NetworksTest-65506290-project-admin] 10.222.0.33 "GET /compute/v2.1/os-networks/343ef4fa-fca9-4453-b062-2fa3eb6972c1" status: 200 len: 652 microversion: 2.1 time: 0.416316 Sep 23 04:37:52.714985 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 915/1781] 10.222.0.33 () {58 vars in 1248 bytes} [Fri Sep 23 04:37:52 2022] GET /compute/v2.1/os-networks/343ef4fa-fca9-4453-b062-2fa3eb6972c1 => generated 652 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:37:52.722980 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3b5f4cbc-43b5-4646-babf-182554769a35 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:52.725492 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-3b5f4cbc-43b5-4646-babf-182554769a35 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] [instance: e203a3bb-aff0-41d9-b8ba-750797cab055] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:52.797777 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-60d38058-c40c-4876-bd52-bfebd9cc2cfc tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:52.808035 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-60d38058-c40c-4876-bd52-bfebd9cc2cfc tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/19d7387c-9776-4e8e-801d-c959ba47af7f" status: 200 len: 1314 microversion: 2.1 time: 0.620750 Sep 23 04:37:52.815225 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 867/1782] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:52 2022] GET /compute/v2.1/servers/19d7387c-9776-4e8e-801d-c959ba47af7f => generated 1314 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:52.826363 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-979a438f-3097-4087-9c71-19419b485257 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:52.827881 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-979a438f-3097-4087-9c71-19419b485257 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] [instance: 04e9b262-d9e0-434a-bcbb-a85ef9180ee9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:52.841522 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-3b5f4cbc-43b5-4646-babf-182554769a35 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1244f3db540441a28d8413e510cfccad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b412c874d4e668b4a1a33dedb2c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:52.845704 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-979a438f-3097-4087-9c71-19419b485257 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:52.845704 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-979a438f-3097-4087-9c71-19419b485257 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:52.848157 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-979a438f-3097-4087-9c71-19419b485257 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:52.848978 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-979a438f-3097-4087-9c71-19419b485257 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:52.849469 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-979a438f-3097-4087-9c71-19419b485257 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:52.851753 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-979a438f-3097-4087-9c71-19419b485257 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:52.864818 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3b5f4cbc-43b5-4646-babf-182554769a35 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] 10.222.0.33 "GET /compute/v2.1/servers/e203a3bb-aff0-41d9-b8ba-750797cab055" status: 200 len: 1219 microversion: 2.1 time: 0.141874 Sep 23 04:37:52.865553 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 916/1783] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:52 2022] GET /compute/v2.1/servers/e203a3bb-aff0-41d9-b8ba-750797cab055 => generated 1219 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:52.882730 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-699a0163-f297-4f21-9a93-5ead7d26cac9 tempest-VolumesTestJSON-1808526912 tempest-VolumesTestJSON-1808526912-project] Calling method '.version_select at 0x7ff1c3f314c0>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:53.004527 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-699a0163-f297-4f21-9a93-5ead7d26cac9 tempest-VolumesTestJSON-1808526912 tempest-VolumesTestJSON-1808526912-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.137424 Sep 23 04:37:53.005311 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 917/1784] 10.222.0.33 () {58 vars in 1155 bytes} [Fri Sep 23 04:37:52 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:53.010902 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0da6c23d-4abb-414b-a85e-019cc8e8be13 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:53.010902 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-0da6c23d-4abb-414b-a85e-019cc8e8be13 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 9e9a41f2-ff28-4c2a-80aa-193e0ebce466] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:53.019418 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0da6c23d-4abb-414b-a85e-019cc8e8be13 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:53.020082 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0da6c23d-4abb-414b-a85e-019cc8e8be13 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:53.020621 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0da6c23d-4abb-414b-a85e-019cc8e8be13 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:53.021599 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0da6c23d-4abb-414b-a85e-019cc8e8be13 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:53.022316 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0da6c23d-4abb-414b-a85e-019cc8e8be13 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:53.022977 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0da6c23d-4abb-414b-a85e-019cc8e8be13 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:53.041436 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-0da6c23d-4abb-414b-a85e-019cc8e8be13 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] HTTP exception thrown: Instance 9e9a41f2-ff28-4c2a-80aa-193e0ebce466 could not be found. Sep 23 04:37:53.045386 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0da6c23d-4abb-414b-a85e-019cc8e8be13 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Request method failure captured: Sep 23 04:37:53.045386 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466 HTTP/1.1 Sep 23 04:37:53.045386 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:37:53.045386 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:37:53.045386 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:37:53.045386 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:37:53.045386 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:37:53.045386 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:37:53.045386 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:37:53.045386 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:37:53.045386 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTaWXIXl3tR50j--lXaisfCvv96a-7yx5HAyhGUeC4fYQynUZPebyv8wFHzuAmaMbuHW8OYaivLn4U8NnQxMPu0yv189bThsscsy-IZHYf0cR3kfCKZke0BgT4gCn55jGv_RGgcBQZIrro9w30OswoUQBe63DbCzmjWipZnCAwKgjE4 Sep 23 04:37:53.045386 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:37:53.045386 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:37:53.045386 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:37:53.045386 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:37:53.045386 n-d-846463-3 devstack@n-api.service[122699]: X-Openstack-Nova-Api-Version: 2.25 Sep 23 04:37:53.045386 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:37:53.045386 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:37:53.045386 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 0abccbbae40b47968a8dda6323b618e3 Sep 23 04:37:53.045386 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1923115962 Sep 23 04:37:53.045386 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:37:53.045386 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:37:53.045386 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0abccbbae40b47968a8dda6323b618e3", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0abccbbae40b47968a8dda6323b618e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0abccbbae40b47968a8dda6323b618e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0abccbbae40b47968a8dda6323b618e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:37:53.045386 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1923115962 Sep 23 04:37:53.045386 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 0abccbbae40b47968a8dda6323b618e3 Sep 23 04:37:53.045386 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1923115962 Sep 23 04:37:53.045386 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-LiveAutoBlockMigrationV225Test-1923115962-project Sep 23 04:37:53.045386 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:37:53.045386 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:37:53.045386 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 84d0c7a6520443d896f88069e91a2eb2 Sep 23 04:37:53.045386 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1923115962-project Sep 23 04:37:53.045386 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:37:53.045386 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 9e9a41f2-ff28-4c2a-80aa-193e0ebce466 could not be found. Sep 23 04:37:53.045386 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '9e9a41f2-ff28-4c2a-80aa-193e0ebce466'} Sep 23 04:37:53.045386 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:37:53.045386 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:37:53.045386 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:37:53.045386 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:37:53.045386 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:37:53.045386 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:37:53.045386 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:37:53.045386 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:37:53.045386 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:37:53.045386 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:37:53.045386 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e9a41f2-ff28-4c2a-80aa-193e0ebce466 could not be found. Sep 23 04:37:53.045386 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:37:53.045386 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:37:53.045386 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:37:53.045386 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:37:53.045386 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:37:53.045386 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:37:53.045386 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:37:53.045386 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:37:53.045386 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:37:53.045386 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:37:53.045386 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:37:53.045386 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:37:53.045386 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:37:53.045386 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:37:53.045386 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:37:53.045386 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:37:53.045386 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e9a41f2-ff28-4c2a-80aa-193e0ebce466 could not be found. Sep 23 04:37:53.045386 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:37:53.051103 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:37:53.051103 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:37:53.051103 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:37:53.051103 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:37:53.051103 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:37:53.051103 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:37:53.051103 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:37:53.051103 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e9a41f2-ff28-4c2a-80aa-193e0ebce466 could not be found. Sep 23 04:37:53.051103 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:37:53.051103 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0da6c23d-4abb-414b-a85e-019cc8e8be13 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Returning 404 to user: Instance 9e9a41f2-ff28-4c2a-80aa-193e0ebce466 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:37:53.051103 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0da6c23d-4abb-414b-a85e-019cc8e8be13 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466" status: 404 len: 111 microversion: 2.25 time: 0.038871 Sep 23 04:37:53.056618 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 918/1785] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:37:53 2022] GET /compute/v2.1/servers/9e9a41f2-ff28-4c2a-80aa-193e0ebce466 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 23 04:37:53.058088 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4186a9a6-c4b8-4f5f-a58e-845a3c3f385d tempest-NetworksTest-65506290 tempest-NetworksTest-65506290-project-admin] Calling method '.version_select at 0x7ff1bb737f70>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:53.142180 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-979a438f-3097-4087-9c71-19419b485257 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9" status: 200 len: 1860 microversion: 2.1 time: 0.325575 Sep 23 04:37:53.142892 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 868/1786] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:52 2022] GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9 => generated 1860 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:53.149317 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-736a270e-b477-462d-b2d5-091b6333f352 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:53.150963 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-736a270e-b477-462d-b2d5-091b6333f352 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] [instance: 53745879-9973-4217-b1c5-b45f917db80e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:53.159016 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-736a270e-b477-462d-b2d5-091b6333f352 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:53.166699 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-736a270e-b477-462d-b2d5-091b6333f352 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:53.166699 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-736a270e-b477-462d-b2d5-091b6333f352 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:53.166699 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-736a270e-b477-462d-b2d5-091b6333f352 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:53.166699 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-736a270e-b477-462d-b2d5-091b6333f352 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:53.166699 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-736a270e-b477-462d-b2d5-091b6333f352 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:53.454292 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4186a9a6-c4b8-4f5f-a58e-845a3c3f385d tempest-NetworksTest-65506290 tempest-NetworksTest-65506290-project-admin] 10.222.0.33 "GET /compute/v2.1/os-networks" status: 200 len: 8769 microversion: 2.1 time: 0.401396 Sep 23 04:37:53.454961 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 919/1787] 10.222.0.33 () {58 vars in 1137 bytes} [Fri Sep 23 04:37:53 2022] GET /compute/v2.1/os-networks => generated 8769 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:53.467818 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-251eeb50-a9fc-481d-b002-3df9bb301bb5 tempest-VolumesTestJSON-1808526912 tempest-VolumesTestJSON-1808526912-project] Calling method '.version_select at 0x7ff1c3f11700>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:53.512846 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-736a270e-b477-462d-b2d5-091b6333f352 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:53.530040 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-736a270e-b477-462d-b2d5-091b6333f352 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:53.531539 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-736a270e-b477-462d-b2d5-091b6333f352 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:53.532745 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-736a270e-b477-462d-b2d5-091b6333f352 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] 10.222.0.33 "GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e" status: 200 len: 1885 microversion: 2.42 time: 0.387966 Sep 23 04:37:53.533930 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 869/1788] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:37:53 2022] GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e => generated 1885 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:37:53.552826 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d40c403b-8059-4ba7-81b1-4651eea89b35 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:53.553464 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d40c403b-8059-4ba7-81b1-4651eea89b35 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] [instance: 04e9b262-d9e0-434a-bcbb-a85ef9180ee9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:53.566632 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d40c403b-8059-4ba7-81b1-4651eea89b35 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:53.567132 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d40c403b-8059-4ba7-81b1-4651eea89b35 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:53.567632 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d40c403b-8059-4ba7-81b1-4651eea89b35 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:53.568352 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d40c403b-8059-4ba7-81b1-4651eea89b35 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:53.568810 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d40c403b-8059-4ba7-81b1-4651eea89b35 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:53.569591 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d40c403b-8059-4ba7-81b1-4651eea89b35 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:53.655911 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-251eeb50-a9fc-481d-b002-3df9bb301bb5 tempest-VolumesTestJSON-1808526912 tempest-VolumesTestJSON-1808526912-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 352 microversion: 2.1 time: 0.192267 Sep 23 04:37:53.656903 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 920/1789] 10.222.0.33 () {58 vars in 1188 bytes} [Fri Sep 23 04:37:53 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 352 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:37:53.662451 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d5ad87da-9649-4303-8e7d-c446e70aaa3c tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:53.663273 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d5ad87da-9649-4303-8e7d-c446e70aaa3c tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: dc2293d8-bde5-4b6a-a59f-6238703e83cc] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:53.678733 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d5ad87da-9649-4303-8e7d-c446e70aaa3c tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:53.679468 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d5ad87da-9649-4303-8e7d-c446e70aaa3c tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:53.682019 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d5ad87da-9649-4303-8e7d-c446e70aaa3c tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:53.682971 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d5ad87da-9649-4303-8e7d-c446e70aaa3c tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:53.683649 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d5ad87da-9649-4303-8e7d-c446e70aaa3c tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:53.685795 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d5ad87da-9649-4303-8e7d-c446e70aaa3c tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:53.835571 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=100 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:37:53.843392 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d40c403b-8059-4ba7-81b1-4651eea89b35 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9" status: 200 len: 1860 microversion: 2.1 time: 0.309013 Sep 23 04:37:53.844725 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 870/1790] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:53 2022] GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9 => generated 1860 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:53.851345 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-77fbb5c0-421a-490a-a5b1-8cd9e916fea9 tempest-VolumesTestJSON-1808526912 tempest-VolumesTestJSON-1808526912-project] Calling method '.version_select at 0x7ff1bbd58430>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:53.965019 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d5ad87da-9649-4303-8e7d-c446e70aaa3c tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:53.996981 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d5ad87da-9649-4303-8e7d-c446e70aaa3c tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/dc2293d8-bde5-4b6a-a59f-6238703e83cc" status: 200 len: 1317 microversion: 2.1 time: 0.334375 Sep 23 04:37:53.998229 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 921/1791] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:53 2022] GET /compute/v2.1/servers/dc2293d8-bde5-4b6a-a59f-6238703e83cc => generated 1317 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:54.021510 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0a7fc733-9d6e-41ae-8bcf-bb1a81c9118a tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:54.023226 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-0a7fc733-9d6e-41ae-8bcf-bb1a81c9118a tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 19d7387c-9776-4e8e-801d-c959ba47af7f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:54.039639 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0a7fc733-9d6e-41ae-8bcf-bb1a81c9118a tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:54.042394 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0a7fc733-9d6e-41ae-8bcf-bb1a81c9118a tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:54.043365 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0a7fc733-9d6e-41ae-8bcf-bb1a81c9118a tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:54.044870 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0a7fc733-9d6e-41ae-8bcf-bb1a81c9118a tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:54.045559 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0a7fc733-9d6e-41ae-8bcf-bb1a81c9118a tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:54.046831 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0a7fc733-9d6e-41ae-8bcf-bb1a81c9118a tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:54.186402 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-77fbb5c0-421a-490a-a5b1-8cd9e916fea9 tempest-VolumesTestJSON-1808526912 tempest-VolumesTestJSON-1808526912-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.340160 Sep 23 04:37:54.187071 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 871/1792] 10.222.0.33 () {58 vars in 1155 bytes} [Fri Sep 23 04:37:53 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:54.193087 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9b097be7-f6fc-44e1-a259-8aa0097d08b4 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:54.194534 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-9b097be7-f6fc-44e1-a259-8aa0097d08b4 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] [instance: e203a3bb-aff0-41d9-b8ba-750797cab055] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:54.211222 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9b097be7-f6fc-44e1-a259-8aa0097d08b4 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:54.214828 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9b097be7-f6fc-44e1-a259-8aa0097d08b4 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:54.215702 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9b097be7-f6fc-44e1-a259-8aa0097d08b4 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:54.219809 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9b097be7-f6fc-44e1-a259-8aa0097d08b4 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:54.220331 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9b097be7-f6fc-44e1-a259-8aa0097d08b4 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:54.221776 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9b097be7-f6fc-44e1-a259-8aa0097d08b4 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:54.362588 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-9b097be7-f6fc-44e1-a259-8aa0097d08b4 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1244f3db540441a28d8413e510cfccad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b412c874d4e668b4a1a33dedb2c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:54.371408 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9b097be7-f6fc-44e1-a259-8aa0097d08b4 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] 10.222.0.33 "GET /compute/v2.1/servers/e203a3bb-aff0-41d9-b8ba-750797cab055" status: 200 len: 1215 microversion: 2.1 time: 0.183173 Sep 23 04:37:54.376280 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 872/1793] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:54 2022] GET /compute/v2.1/servers/e203a3bb-aff0-41d9-b8ba-750797cab055 => generated 1215 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:54.387708 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a7d01e93-efb0-4d5a-ab14-f0733fd20e61 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:54.389238 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a7d01e93-efb0-4d5a-ab14-f0733fd20e61 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: 04e9b262-d9e0-434a-bcbb-a85ef9180ee9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:54.403007 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a7d01e93-efb0-4d5a-ab14-f0733fd20e61 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:54.404984 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a7d01e93-efb0-4d5a-ab14-f0733fd20e61 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:54.407425 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a7d01e93-efb0-4d5a-ab14-f0733fd20e61 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:54.409685 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a7d01e93-efb0-4d5a-ab14-f0733fd20e61 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:54.412709 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a7d01e93-efb0-4d5a-ab14-f0733fd20e61 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:54.415215 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a7d01e93-efb0-4d5a-ab14-f0733fd20e61 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:54.421656 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-0a7fc733-9d6e-41ae-8bcf-bb1a81c9118a tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:54.439124 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0a7fc733-9d6e-41ae-8bcf-bb1a81c9118a tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/19d7387c-9776-4e8e-801d-c959ba47af7f" status: 200 len: 1500 microversion: 2.1 time: 0.435504 Sep 23 04:37:54.442530 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 922/1794] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:53 2022] GET /compute/v2.1/servers/19d7387c-9776-4e8e-801d-c959ba47af7f => generated 1500 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:54.456574 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-3af7ff07-0eef-4e26-9494-cbcc205fb5ab req-f88e915e-c954-4489-af90-c6373723ec90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53745879-9973-4217-b1c5-b45f917db80e", "tag": "2abf97e6-d464-4cf6-a441-15ced1cece90"}, {"name": "network-changed", "server_uuid": "dc2293d8-bde5-4b6a-a59f-6238703e83cc", "tag": "0a4b3693-a138-4a5e-8d2c-125c9ca84cf4"}, {"name": "network-changed", "server_uuid": "53745879-9973-4217-b1c5-b45f917db80e", "tag": "ee2c6848-15f1-4da5-b9cb-45460ca2720e"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:37:54.487359 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-3af7ff07-0eef-4e26-9494-cbcc205fb5ab req-f88e915e-c954-4489-af90-c6373723ec90 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:54.490442 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-3af7ff07-0eef-4e26-9494-cbcc205fb5ab req-f88e915e-c954-4489-af90-c6373723ec90 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:54.491105 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-3af7ff07-0eef-4e26-9494-cbcc205fb5ab req-f88e915e-c954-4489-af90-c6373723ec90 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:54.522874 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-3af7ff07-0eef-4e26-9494-cbcc205fb5ab req-f88e915e-c954-4489-af90-c6373723ec90 service nova] Creating event network-changed:2abf97e6-d464-4cf6-a441-15ced1cece90 for instance 53745879-9973-4217-b1c5-b45f917db80e on n-h2-846463-3 Sep 23 04:37:54.533311 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-3af7ff07-0eef-4e26-9494-cbcc205fb5ab req-f88e915e-c954-4489-af90-c6373723ec90 service nova] Creating event network-changed:0a4b3693-a138-4a5e-8d2c-125c9ca84cf4 for instance dc2293d8-bde5-4b6a-a59f-6238703e83cc on n-h2-846463-3 Sep 23 04:37:54.534208 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-3af7ff07-0eef-4e26-9494-cbcc205fb5ab req-f88e915e-c954-4489-af90-c6373723ec90 service nova] Creating event network-changed:ee2c6848-15f1-4da5-b9cb-45460ca2720e for instance 53745879-9973-4217-b1c5-b45f917db80e on n-h2-846463-3 Sep 23 04:37:54.550121 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-3af7ff07-0eef-4e26-9494-cbcc205fb5ab req-f88e915e-c954-4489-af90-c6373723ec90 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.102488 Sep 23 04:37:54.551974 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 923/1795] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:37:54 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:37:54.573988 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a13feda1-ab5a-497d-8854-cfed33013b75 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:54.577457 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a13feda1-ab5a-497d-8854-cfed33013b75 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 19d7387c-9776-4e8e-801d-c959ba47af7f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:54.593876 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a13feda1-ab5a-497d-8854-cfed33013b75 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:54.596014 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a13feda1-ab5a-497d-8854-cfed33013b75 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:54.597520 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a13feda1-ab5a-497d-8854-cfed33013b75 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:54.601821 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a13feda1-ab5a-497d-8854-cfed33013b75 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:54.604305 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a13feda1-ab5a-497d-8854-cfed33013b75 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:54.605003 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a13feda1-ab5a-497d-8854-cfed33013b75 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:54.698367 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a13feda1-ab5a-497d-8854-cfed33013b75 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 19d7387c-9776-4e8e-801d-c959ba47af7f] Going to try to terminate instance {{(pid=122699) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:37:54.811828 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-a7d01e93-efb0-4d5a-ab14-f0733fd20e61 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lazy-loading 'services' on Instance uuid 04e9b262-d9e0-434a-bcbb-a85ef9180ee9 {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:37:55.206206 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a13feda1-ab5a-497d-8854-cfed33013b75 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "DELETE /compute/v2.1/servers/19d7387c-9776-4e8e-801d-c959ba47af7f" status: 204 len: 0 microversion: 2.1 time: 0.650886 Sep 23 04:37:55.209538 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 924/1796] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:37:54 2022] DELETE /compute/v2.1/servers/19d7387c-9776-4e8e-801d-c959ba47af7f => generated 0 bytes in 657 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:37:55.215814 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-103d5925-92d9-4cfe-b714-8b792a3bbf0b tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:55.216820 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-103d5925-92d9-4cfe-b714-8b792a3bbf0b tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] [instance: 53745879-9973-4217-b1c5-b45f917db80e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:55.222771 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a7d01e93-efb0-4d5a-ab14-f0733fd20e61 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "DELETE /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9/os-volume_attachments/fef9a2d9-4276-414e-9023-74e906555af6" status: 202 len: 0 microversion: 2.1 time: 0.836696 Sep 23 04:37:55.223448 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 873/1797] 10.222.0.33 () {58 vars in 1416 bytes} [Fri Sep 23 04:37:54 2022] DELETE /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9/os-volume_attachments/fef9a2d9-4276-414e-9023-74e906555af6 => generated 0 bytes in 846 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:37:55.244223 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-103d5925-92d9-4cfe-b714-8b792a3bbf0b tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:55.254197 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-24fb37d0-ba6d-4410-98af-c61f16fdbcc2 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:55.254197 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-24fb37d0-ba6d-4410-98af-c61f16fdbcc2 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: dc2293d8-bde5-4b6a-a59f-6238703e83cc] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:55.255536 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-103d5925-92d9-4cfe-b714-8b792a3bbf0b tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:55.255536 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-103d5925-92d9-4cfe-b714-8b792a3bbf0b tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:55.255536 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-103d5925-92d9-4cfe-b714-8b792a3bbf0b tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:55.255536 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-103d5925-92d9-4cfe-b714-8b792a3bbf0b tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:55.255536 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-103d5925-92d9-4cfe-b714-8b792a3bbf0b tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:55.272099 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-24fb37d0-ba6d-4410-98af-c61f16fdbcc2 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:55.272858 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-24fb37d0-ba6d-4410-98af-c61f16fdbcc2 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:55.274814 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-24fb37d0-ba6d-4410-98af-c61f16fdbcc2 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:55.275726 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-24fb37d0-ba6d-4410-98af-c61f16fdbcc2 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:55.279086 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-24fb37d0-ba6d-4410-98af-c61f16fdbcc2 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:55.279862 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-24fb37d0-ba6d-4410-98af-c61f16fdbcc2 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:55.642488 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-103d5925-92d9-4cfe-b714-8b792a3bbf0b tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:55.665436 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-103d5925-92d9-4cfe-b714-8b792a3bbf0b tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:55.667173 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-103d5925-92d9-4cfe-b714-8b792a3bbf0b tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:55.671521 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-103d5925-92d9-4cfe-b714-8b792a3bbf0b tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] 10.222.0.33 "GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e" status: 200 len: 1885 microversion: 2.42 time: 0.457659 Sep 23 04:37:55.672246 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 925/1798] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:37:55 2022] GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e => generated 1885 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:37:55.697287 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-31e1eb28-28b7-4de6-b9bd-5e4181adb161 req-a0a434f9-4733-4661-b6d2-62c222d9a88a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e90c852-5f27-4861-9b25-9ea1e475c0a9", "tag": "8b6ae886-5681-4d62-a4c2-d887ae24dcca"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:37:55.717953 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-31e1eb28-28b7-4de6-b9bd-5e4181adb161 req-a0a434f9-4733-4661-b6d2-62c222d9a88a service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:55.720758 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-31e1eb28-28b7-4de6-b9bd-5e4181adb161 req-a0a434f9-4733-4661-b6d2-62c222d9a88a service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:55.723892 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-31e1eb28-28b7-4de6-b9bd-5e4181adb161 req-a0a434f9-4733-4661-b6d2-62c222d9a88a service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:55.757846 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-31e1eb28-28b7-4de6-b9bd-5e4181adb161 req-a0a434f9-4733-4661-b6d2-62c222d9a88a service nova] Creating event network-changed:8b6ae886-5681-4d62-a4c2-d887ae24dcca for instance 7e90c852-5f27-4861-9b25-9ea1e475c0a9 on n-h1-846463-3 Sep 23 04:37:55.769391 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-31e1eb28-28b7-4de6-b9bd-5e4181adb161 req-a0a434f9-4733-4661-b6d2-62c222d9a88a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095088 Sep 23 04:37:55.773855 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 926/1799] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:37:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:37:55.789557 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-fda638ea-e4e6-4c43-86a4-566a8c9a113f tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:55.793448 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-fda638ea-e4e6-4c43-86a4-566a8c9a113f tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 19d7387c-9776-4e8e-801d-c959ba47af7f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:55.810426 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fda638ea-e4e6-4c43-86a4-566a8c9a113f tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:55.819323 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fda638ea-e4e6-4c43-86a4-566a8c9a113f tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:55.819323 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fda638ea-e4e6-4c43-86a4-566a8c9a113f tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:55.819323 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fda638ea-e4e6-4c43-86a4-566a8c9a113f tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:55.819323 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fda638ea-e4e6-4c43-86a4-566a8c9a113f tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:55.819323 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fda638ea-e4e6-4c43-86a4-566a8c9a113f tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:55.846530 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-24fb37d0-ba6d-4410-98af-c61f16fdbcc2 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:55.859857 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-24fb37d0-ba6d-4410-98af-c61f16fdbcc2 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/dc2293d8-bde5-4b6a-a59f-6238703e83cc" status: 200 len: 1317 microversion: 2.1 time: 0.631168 Sep 23 04:37:55.866218 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 874/1800] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:55 2022] GET /compute/v2.1/servers/dc2293d8-bde5-4b6a-a59f-6238703e83cc => generated 1317 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:55.873878 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-278e9f0c-8ad6-42e2-ab5a-8dee3861e857 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:55.916696 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-278e9f0c-8ad6-42e2-ab5a-8dee3861e857 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: 04e9b262-d9e0-434a-bcbb-a85ef9180ee9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:55.933429 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-278e9f0c-8ad6-42e2-ab5a-8dee3861e857 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:55.935541 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-278e9f0c-8ad6-42e2-ab5a-8dee3861e857 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:55.936225 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-278e9f0c-8ad6-42e2-ab5a-8dee3861e857 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:55.939072 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-278e9f0c-8ad6-42e2-ab5a-8dee3861e857 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:55.940776 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-278e9f0c-8ad6-42e2-ab5a-8dee3861e857 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:55.942104 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-278e9f0c-8ad6-42e2-ab5a-8dee3861e857 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:56.008010 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-278e9f0c-8ad6-42e2-ab5a-8dee3861e857 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.139128 Sep 23 04:37:56.010237 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 875/1801] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Sep 23 04:37:55 2022] GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9/os-volume_attachments => generated 197 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:37:56.018774 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4828e0fd-e6f2-429d-a3c0-016e07b8477d tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:56.021495 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4828e0fd-e6f2-429d-a3c0-016e07b8477d tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] [instance: e203a3bb-aff0-41d9-b8ba-750797cab055] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:56.030596 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4828e0fd-e6f2-429d-a3c0-016e07b8477d tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:56.031303 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4828e0fd-e6f2-429d-a3c0-016e07b8477d tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:56.031948 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4828e0fd-e6f2-429d-a3c0-016e07b8477d tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:56.033240 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4828e0fd-e6f2-429d-a3c0-016e07b8477d tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:56.034537 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4828e0fd-e6f2-429d-a3c0-016e07b8477d tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:56.035166 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4828e0fd-e6f2-429d-a3c0-016e07b8477d tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:57.376002 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4828e0fd-e6f2-429d-a3c0-016e07b8477d tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1244f3db540441a28d8413e510cfccad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b412c874d4e668b4a1a33dedb2c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:57.397909 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4828e0fd-e6f2-429d-a3c0-016e07b8477d tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] 10.222.0.33 "GET /compute/v2.1/servers/e203a3bb-aff0-41d9-b8ba-750797cab055" status: 200 len: 1271 microversion: 2.1 time: 1.381183 Sep 23 04:37:57.400431 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 876/1802] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:56 2022] GET /compute/v2.1/servers/e203a3bb-aff0-41d9-b8ba-750797cab055 => generated 1271 bytes in 1389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:57.422322 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6f9cbbb6-429c-46fb-9df1-144acef15a0b tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:57.427580 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-6f9cbbb6-429c-46fb-9df1-144acef15a0b tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] [instance: 53745879-9973-4217-b1c5-b45f917db80e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:57.448923 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6f9cbbb6-429c-46fb-9df1-144acef15a0b tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:57.453979 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6f9cbbb6-429c-46fb-9df1-144acef15a0b tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:57.455941 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6f9cbbb6-429c-46fb-9df1-144acef15a0b tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:57.457252 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6f9cbbb6-429c-46fb-9df1-144acef15a0b tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:57.462554 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6f9cbbb6-429c-46fb-9df1-144acef15a0b tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:57.463248 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6f9cbbb6-429c-46fb-9df1-144acef15a0b tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:57.883326 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-fda638ea-e4e6-4c43-86a4-566a8c9a113f tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:57.901785 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-fda638ea-e4e6-4c43-86a4-566a8c9a113f tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/19d7387c-9776-4e8e-801d-c959ba47af7f" status: 200 len: 1506 microversion: 2.1 time: 2.122817 Sep 23 04:37:57.913922 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 927/1803] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:55 2022] GET /compute/v2.1/servers/19d7387c-9776-4e8e-801d-c959ba47af7f => generated 1506 bytes in 2131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:57.927522 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9c6295f0-fe5c-4916-b97c-15e2c6ff453d tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:57.929284 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-9c6295f0-fe5c-4916-b97c-15e2c6ff453d tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: dc2293d8-bde5-4b6a-a59f-6238703e83cc] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:57.967316 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9c6295f0-fe5c-4916-b97c-15e2c6ff453d tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:57.967991 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9c6295f0-fe5c-4916-b97c-15e2c6ff453d tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:57.969564 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9c6295f0-fe5c-4916-b97c-15e2c6ff453d tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:57.970756 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9c6295f0-fe5c-4916-b97c-15e2c6ff453d tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:57.972160 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9c6295f0-fe5c-4916-b97c-15e2c6ff453d tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:57.973746 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9c6295f0-fe5c-4916-b97c-15e2c6ff453d tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:58.020961 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:37:58.575753 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6f9cbbb6-429c-46fb-9df1-144acef15a0b tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:58.590407 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6f9cbbb6-429c-46fb-9df1-144acef15a0b tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:58.598829 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6f9cbbb6-429c-46fb-9df1-144acef15a0b tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:58.600299 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-6f9cbbb6-429c-46fb-9df1-144acef15a0b tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] 10.222.0.33 "GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e" status: 200 len: 1885 microversion: 2.42 time: 1.196572 Sep 23 04:37:58.600964 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 877/1804] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:37:57 2022] GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e => generated 1885 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:37:58.609192 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-92e41858-2f3b-4085-9b68-3cf0656ca57b tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:58.619130 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-92e41858-2f3b-4085-9b68-3cf0656ca57b tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: 04e9b262-d9e0-434a-bcbb-a85ef9180ee9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:58.630808 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-92e41858-2f3b-4085-9b68-3cf0656ca57b tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:58.637992 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-92e41858-2f3b-4085-9b68-3cf0656ca57b tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:58.638583 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-92e41858-2f3b-4085-9b68-3cf0656ca57b tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:58.639408 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-92e41858-2f3b-4085-9b68-3cf0656ca57b tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:58.639950 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-92e41858-2f3b-4085-9b68-3cf0656ca57b tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:58.640828 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-92e41858-2f3b-4085-9b68-3cf0656ca57b tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:58.687634 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-9c6295f0-fe5c-4916-b97c-15e2c6ff453d tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:58.706078 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-92e41858-2f3b-4085-9b68-3cf0656ca57b tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103362 Sep 23 04:37:58.713729 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-9c6295f0-fe5c-4916-b97c-15e2c6ff453d tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/dc2293d8-bde5-4b6a-a59f-6238703e83cc" status: 200 len: 1317 microversion: 2.1 time: 0.807003 Sep 23 04:37:58.718143 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 878/1805] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Sep 23 04:37:58 2022] GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9/os-volume_attachments => generated 197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:37:58.729393 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-df064e34-2b48-4f1f-ae01-866d905994e2 req-d1fd6e22-c9e6-4cfe-964d-e93b4434c65a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94e8c141-ef33-4bb2-929f-7f7d0d10ff2c", "tag": "c3659f36-9ff9-42b5-bba7-a92fbe8f0703"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:37:58.732234 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 928/1806] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:57 2022] GET /compute/v2.1/servers/dc2293d8-bde5-4b6a-a59f-6238703e83cc => generated 1317 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:58.739544 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-a5c9ac3a-5817-40d6-a928-e5cd16d9a436 req-2c150e1d-7253-4528-9bff-7f3630694511 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc2293d8-bde5-4b6a-a59f-6238703e83cc", "name": "network-vif-plugged", "status": "completed", "tag": "0a4b3693-a138-4a5e-8d2c-125c9ca84cf4"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:37:58.742036 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-df064e34-2b48-4f1f-ae01-866d905994e2 req-d1fd6e22-c9e6-4cfe-964d-e93b4434c65a service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:58.742658 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-df064e34-2b48-4f1f-ae01-866d905994e2 req-d1fd6e22-c9e6-4cfe-964d-e93b4434c65a service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:58.743233 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-df064e34-2b48-4f1f-ae01-866d905994e2 req-d1fd6e22-c9e6-4cfe-964d-e93b4434c65a service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:58.753738 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-a5c9ac3a-5817-40d6-a928-e5cd16d9a436 req-2c150e1d-7253-4528-9bff-7f3630694511 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:58.754350 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-a5c9ac3a-5817-40d6-a928-e5cd16d9a436 req-2c150e1d-7253-4528-9bff-7f3630694511 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:58.754801 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-a5c9ac3a-5817-40d6-a928-e5cd16d9a436 req-2c150e1d-7253-4528-9bff-7f3630694511 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:58.757228 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-df064e34-2b48-4f1f-ae01-866d905994e2 req-d1fd6e22-c9e6-4cfe-964d-e93b4434c65a service nova] Creating event network-changed:c3659f36-9ff9-42b5-bba7-a92fbe8f0703 for instance 94e8c141-ef33-4bb2-929f-7f7d0d10ff2c on n-h1-846463-3 Sep 23 04:37:58.763592 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-df064e34-2b48-4f1f-ae01-866d905994e2 req-d1fd6e22-c9e6-4cfe-964d-e93b4434c65a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042219 Sep 23 04:37:58.763755 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 879/1807] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:37:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:37:58.771296 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0fc839f6-1f53-4cad-a3a1-1a51c6de155a tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:58.772002 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-0fc839f6-1f53-4cad-a3a1-1a51c6de155a tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] [instance: e203a3bb-aff0-41d9-b8ba-750797cab055] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:58.778895 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0fc839f6-1f53-4cad-a3a1-1a51c6de155a tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:58.779394 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0fc839f6-1f53-4cad-a3a1-1a51c6de155a tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:58.779834 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0fc839f6-1f53-4cad-a3a1-1a51c6de155a tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:58.780541 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0fc839f6-1f53-4cad-a3a1-1a51c6de155a tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:58.781001 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0fc839f6-1f53-4cad-a3a1-1a51c6de155a tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:58.781285 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-a5c9ac3a-5817-40d6-a928-e5cd16d9a436 req-2c150e1d-7253-4528-9bff-7f3630694511 service nova] Creating event network-vif-plugged:0a4b3693-a138-4a5e-8d2c-125c9ca84cf4 for instance dc2293d8-bde5-4b6a-a59f-6238703e83cc on n-h2-846463-3 Sep 23 04:37:58.781662 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0fc839f6-1f53-4cad-a3a1-1a51c6de155a tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:58.792889 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-a5c9ac3a-5817-40d6-a928-e5cd16d9a436 req-2c150e1d-7253-4528-9bff-7f3630694511 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056909 Sep 23 04:37:58.794229 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 929/1808] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:37:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:37:58.932799 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-41b5fbc7-15a0-4f9e-a277-57346a6d68a8 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:58.933614 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-41b5fbc7-15a0-4f9e-a277-57346a6d68a8 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 19d7387c-9776-4e8e-801d-c959ba47af7f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:58.954784 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-41b5fbc7-15a0-4f9e-a277-57346a6d68a8 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:58.954784 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-41b5fbc7-15a0-4f9e-a277-57346a6d68a8 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:58.954784 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-41b5fbc7-15a0-4f9e-a277-57346a6d68a8 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:58.954784 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-41b5fbc7-15a0-4f9e-a277-57346a6d68a8 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:58.954784 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-41b5fbc7-15a0-4f9e-a277-57346a6d68a8 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:58.969776 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-41b5fbc7-15a0-4f9e-a277-57346a6d68a8 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:59.299792 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-0fc839f6-1f53-4cad-a3a1-1a51c6de155a tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1244f3db540441a28d8413e510cfccad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b412c874d4e668b4a1a33dedb2c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:59.344569 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0fc839f6-1f53-4cad-a3a1-1a51c6de155a tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] 10.222.0.33 "GET /compute/v2.1/servers/e203a3bb-aff0-41d9-b8ba-750797cab055" status: 200 len: 1277 microversion: 2.1 time: 0.579488 Sep 23 04:37:59.345161 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 880/1809] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:58 2022] GET /compute/v2.1/servers/e203a3bb-aff0-41d9-b8ba-750797cab055 => generated 1277 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:37:59.587639 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-41b5fbc7-15a0-4f9e-a277-57346a6d68a8 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:37:59.599339 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-41b5fbc7-15a0-4f9e-a277-57346a6d68a8 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/19d7387c-9776-4e8e-801d-c959ba47af7f" status: 200 len: 1506 microversion: 2.1 time: 0.674550 Sep 23 04:37:59.600538 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 930/1810] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:58 2022] GET /compute/v2.1/servers/19d7387c-9776-4e8e-801d-c959ba47af7f => generated 1506 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:37:59.655701 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-040cf207-df6a-4f91-a8ef-f976b0a2f3ee tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:59.656435 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-040cf207-df6a-4f91-a8ef-f976b0a2f3ee tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] [instance: 53745879-9973-4217-b1c5-b45f917db80e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:59.670806 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-040cf207-df6a-4f91-a8ef-f976b0a2f3ee tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:59.674301 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-040cf207-df6a-4f91-a8ef-f976b0a2f3ee tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:59.676373 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-040cf207-df6a-4f91-a8ef-f976b0a2f3ee tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:59.679867 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-040cf207-df6a-4f91-a8ef-f976b0a2f3ee tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:59.681631 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-040cf207-df6a-4f91-a8ef-f976b0a2f3ee tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:59.683878 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-040cf207-df6a-4f91-a8ef-f976b0a2f3ee tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:59.719525 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-76e2080f-c194-49c5-a388-7a01072da901 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:59.722979 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-76e2080f-c194-49c5-a388-7a01072da901 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: 04e9b262-d9e0-434a-bcbb-a85ef9180ee9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:59.743962 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-76e2080f-c194-49c5-a388-7a01072da901 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:59.748925 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-76e2080f-c194-49c5-a388-7a01072da901 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:59.754635 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-76e2080f-c194-49c5-a388-7a01072da901 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:59.756026 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-76e2080f-c194-49c5-a388-7a01072da901 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:59.757599 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-76e2080f-c194-49c5-a388-7a01072da901 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:59.759227 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-76e2080f-c194-49c5-a388-7a01072da901 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:59.862600 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-76e2080f-c194-49c5-a388-7a01072da901 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.147847 Sep 23 04:37:59.864912 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 931/1811] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Sep 23 04:37:59 2022] GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9/os-volume_attachments => generated 197 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:37:59.870899 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-88d69418-d0d4-4458-9f99-ac176c2a2c09 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:37:59.871876 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-88d69418-d0d4-4458-9f99-ac176c2a2c09 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: dc2293d8-bde5-4b6a-a59f-6238703e83cc] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:37:59.881062 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-88d69418-d0d4-4458-9f99-ac176c2a2c09 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:59.881849 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-88d69418-d0d4-4458-9f99-ac176c2a2c09 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:59.883927 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-88d69418-d0d4-4458-9f99-ac176c2a2c09 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:37:59.885578 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-88d69418-d0d4-4458-9f99-ac176c2a2c09 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:37:59.887428 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-88d69418-d0d4-4458-9f99-ac176c2a2c09 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:37:59.898890 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-88d69418-d0d4-4458-9f99-ac176c2a2c09 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:00.661282 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-040cf207-df6a-4f91-a8ef-f976b0a2f3ee tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:00.691569 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-040cf207-df6a-4f91-a8ef-f976b0a2f3ee tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:00.701494 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-040cf207-df6a-4f91-a8ef-f976b0a2f3ee tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:00.711699 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-040cf207-df6a-4f91-a8ef-f976b0a2f3ee tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] 10.222.0.33 "GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e" status: 200 len: 1885 microversion: 2.42 time: 1.057577 Sep 23 04:38:00.714994 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 881/1812] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:37:59 2022] GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e => generated 1885 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:38:00.730492 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-71b2d36a-2e74-4bf6-a325-0d54080bf7d8 req-26d33ff1-3b41-430d-a75c-2837a2efa8c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19d7387c-9776-4e8e-801d-c959ba47af7f", "name": "network-vif-deleted", "tag": "dab2de18-5f6f-4711-9a26-d38a68a18157"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:38:00.754546 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-88d69418-d0d4-4458-9f99-ac176c2a2c09 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:00.766507 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-88d69418-d0d4-4458-9f99-ac176c2a2c09 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/dc2293d8-bde5-4b6a-a59f-6238703e83cc" status: 200 len: 1317 microversion: 2.1 time: 0.899682 Sep 23 04:38:00.770229 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 932/1813] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:37:59 2022] GET /compute/v2.1/servers/dc2293d8-bde5-4b6a-a59f-6238703e83cc => generated 1317 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:00.789204 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-54f90b5d-2851-4750-9649-b6d8d06b3476 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:00.790649 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-54f90b5d-2851-4750-9649-b6d8d06b3476 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] [instance: e203a3bb-aff0-41d9-b8ba-750797cab055] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:00.797060 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-71b2d36a-2e74-4bf6-a325-0d54080bf7d8 req-26d33ff1-3b41-430d-a75c-2837a2efa8c6 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:00.806075 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-71b2d36a-2e74-4bf6-a325-0d54080bf7d8 req-26d33ff1-3b41-430d-a75c-2837a2efa8c6 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:00.807063 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-71b2d36a-2e74-4bf6-a325-0d54080bf7d8 req-26d33ff1-3b41-430d-a75c-2837a2efa8c6 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:00.826966 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-54f90b5d-2851-4750-9649-b6d8d06b3476 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:00.827614 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-54f90b5d-2851-4750-9649-b6d8d06b3476 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:00.831525 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-54f90b5d-2851-4750-9649-b6d8d06b3476 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:00.832834 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-54f90b5d-2851-4750-9649-b6d8d06b3476 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:00.839083 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-54f90b5d-2851-4750-9649-b6d8d06b3476 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:00.841153 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-54f90b5d-2851-4750-9649-b6d8d06b3476 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:00.866912 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-71b2d36a-2e74-4bf6-a325-0d54080bf7d8 req-26d33ff1-3b41-430d-a75c-2837a2efa8c6 service nova] Creating event network-vif-deleted:dab2de18-5f6f-4711-9a26-d38a68a18157 for instance 19d7387c-9776-4e8e-801d-c959ba47af7f on n-h2-846463-3 Sep 23 04:38:00.892477 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-71b2d36a-2e74-4bf6-a325-0d54080bf7d8 req-26d33ff1-3b41-430d-a75c-2837a2efa8c6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.176122 Sep 23 04:38:00.901415 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 882/1814] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:38:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:38:00.925473 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-86a11307-e0bc-4612-9ada-f79e7ffcf2f9 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:00.926249 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-86a11307-e0bc-4612-9ada-f79e7ffcf2f9 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 19d7387c-9776-4e8e-801d-c959ba47af7f] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:00.952397 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-86a11307-e0bc-4612-9ada-f79e7ffcf2f9 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:00.952970 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-86a11307-e0bc-4612-9ada-f79e7ffcf2f9 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:00.954291 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-86a11307-e0bc-4612-9ada-f79e7ffcf2f9 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:00.956730 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-86a11307-e0bc-4612-9ada-f79e7ffcf2f9 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:00.959460 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-86a11307-e0bc-4612-9ada-f79e7ffcf2f9 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:00.961143 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-86a11307-e0bc-4612-9ada-f79e7ffcf2f9 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:01.108431 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-86a11307-e0bc-4612-9ada-f79e7ffcf2f9 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:01.110607 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-86a11307-e0bc-4612-9ada-f79e7ffcf2f9 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:01.112078 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-86a11307-e0bc-4612-9ada-f79e7ffcf2f9 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:01.112579 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-86a11307-e0bc-4612-9ada-f79e7ffcf2f9 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lazy-loading 'fault' on Instance uuid 19d7387c-9776-4e8e-801d-c959ba47af7f {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:38:01.388367 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-86a11307-e0bc-4612-9ada-f79e7ffcf2f9 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:01.403548 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-86a11307-e0bc-4612-9ada-f79e7ffcf2f9 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/19d7387c-9776-4e8e-801d-c959ba47af7f" status: 200 len: 1304 microversion: 2.1 time: 0.494958 Sep 23 04:38:01.404139 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 883/1815] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:00 2022] GET /compute/v2.1/servers/19d7387c-9776-4e8e-801d-c959ba47af7f => generated 1304 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:01.424989 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-fb6cd96d-1ec1-452c-b5e7-c0e2391cc8f2 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:01.446907 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-fb6cd96d-1ec1-452c-b5e7-c0e2391cc8f2 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: 04e9b262-d9e0-434a-bcbb-a85ef9180ee9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:01.469115 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fb6cd96d-1ec1-452c-b5e7-c0e2391cc8f2 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:01.473098 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fb6cd96d-1ec1-452c-b5e7-c0e2391cc8f2 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:01.473824 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fb6cd96d-1ec1-452c-b5e7-c0e2391cc8f2 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:01.477300 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fb6cd96d-1ec1-452c-b5e7-c0e2391cc8f2 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:01.480080 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fb6cd96d-1ec1-452c-b5e7-c0e2391cc8f2 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:01.484159 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fb6cd96d-1ec1-452c-b5e7-c0e2391cc8f2 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:01.577440 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=6 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:38:01.600608 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-54f90b5d-2851-4750-9649-b6d8d06b3476 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1244f3db540441a28d8413e510cfccad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b412c874d4e668b4a1a33dedb2c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:01.620139 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-54f90b5d-2851-4750-9649-b6d8d06b3476 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] 10.222.0.33 "GET /compute/v2.1/servers/e203a3bb-aff0-41d9-b8ba-750797cab055" status: 200 len: 1319 microversion: 2.1 time: 0.842276 Sep 23 04:38:01.620408 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=20 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:38:01.620781 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 933/1816] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:00 2022] GET /compute/v2.1/servers/e203a3bb-aff0-41d9-b8ba-750797cab055 => generated 1319 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:01.635180 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-44c895e6-b070-4948-9088-01ef41860cb8 req-a117f461-6ab1-4527-9290-6e5016f39067 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53745879-9973-4217-b1c5-b45f917db80e", "tag": "94e28598-1406-4598-9b02-0050f6bb7fcd"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:38:01.641695 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-fb6cd96d-1ec1-452c-b5e7-c0e2391cc8f2 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.229025 Sep 23 04:38:01.651767 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 884/1817] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Sep 23 04:38:01 2022] GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9/os-volume_attachments => generated 197 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:38:01.682709 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-44c895e6-b070-4948-9088-01ef41860cb8 req-a117f461-6ab1-4527-9290-6e5016f39067 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:01.684762 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-44c895e6-b070-4948-9088-01ef41860cb8 req-a117f461-6ab1-4527-9290-6e5016f39067 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:01.687368 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-44c895e6-b070-4948-9088-01ef41860cb8 req-a117f461-6ab1-4527-9290-6e5016f39067 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:01.725820 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-44c895e6-b070-4948-9088-01ef41860cb8 req-a117f461-6ab1-4527-9290-6e5016f39067 service nova] Creating event network-changed:94e28598-1406-4598-9b02-0050f6bb7fcd for instance 53745879-9973-4217-b1c5-b45f917db80e on n-h2-846463-3 Sep 23 04:38:01.740054 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-44c895e6-b070-4948-9088-01ef41860cb8 req-a117f461-6ab1-4527-9290-6e5016f39067 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115454 Sep 23 04:38:01.742225 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 934/1818] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:38:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:38:01.743177 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4bbc3031-cd42-45f2-befe-b2075fd10332 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:01.744865 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4bbc3031-cd42-45f2-befe-b2075fd10332 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] [instance: 53745879-9973-4217-b1c5-b45f917db80e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:01.760769 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4bbc3031-cd42-45f2-befe-b2075fd10332 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:01.768838 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4bbc3031-cd42-45f2-befe-b2075fd10332 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:01.769624 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4bbc3031-cd42-45f2-befe-b2075fd10332 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:01.772515 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4bbc3031-cd42-45f2-befe-b2075fd10332 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:01.773741 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4bbc3031-cd42-45f2-befe-b2075fd10332 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:01.775841 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4bbc3031-cd42-45f2-befe-b2075fd10332 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:01.799941 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1dfd9186-e56c-4d2f-a71f-a4fad051b55d tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:01.801739 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1dfd9186-e56c-4d2f-a71f-a4fad051b55d tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: dc2293d8-bde5-4b6a-a59f-6238703e83cc] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:01.825754 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1dfd9186-e56c-4d2f-a71f-a4fad051b55d tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:01.832724 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1dfd9186-e56c-4d2f-a71f-a4fad051b55d tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:01.833488 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1dfd9186-e56c-4d2f-a71f-a4fad051b55d tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:01.836487 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1dfd9186-e56c-4d2f-a71f-a4fad051b55d tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:01.839378 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1dfd9186-e56c-4d2f-a71f-a4fad051b55d tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:01.841114 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1dfd9186-e56c-4d2f-a71f-a4fad051b55d tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:03.032685 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:38:03.134569 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4bbc3031-cd42-45f2-befe-b2075fd10332 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:03.177741 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4bbc3031-cd42-45f2-befe-b2075fd10332 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:03.180593 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4bbc3031-cd42-45f2-befe-b2075fd10332 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:03.192601 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4bbc3031-cd42-45f2-befe-b2075fd10332 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] 10.222.0.33 "GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e" status: 200 len: 1885 microversion: 2.42 time: 1.443575 Sep 23 04:38:03.201467 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 885/1819] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:38:01 2022] GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e => generated 1885 bytes in 1456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:38:03.230145 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4ae65ef3-03df-49d7-a9c3-786c2f2dcfdb tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:03.244811 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4ae65ef3-03df-49d7-a9c3-786c2f2dcfdb tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 205bf02b-1478-4765-b2a6-d7014d9f0a64] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:03.258203 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4ae65ef3-03df-49d7-a9c3-786c2f2dcfdb tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:03.263773 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4ae65ef3-03df-49d7-a9c3-786c2f2dcfdb tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:03.264279 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4ae65ef3-03df-49d7-a9c3-786c2f2dcfdb tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:03.269730 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4ae65ef3-03df-49d7-a9c3-786c2f2dcfdb tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:03.270270 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4ae65ef3-03df-49d7-a9c3-786c2f2dcfdb tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:03.270721 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4ae65ef3-03df-49d7-a9c3-786c2f2dcfdb tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:03.386841 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4ae65ef3-03df-49d7-a9c3-786c2f2dcfdb tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 205bf02b-1478-4765-b2a6-d7014d9f0a64] Going to try to terminate instance {{(pid=122698) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:38:03.445736 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1dfd9186-e56c-4d2f-a71f-a4fad051b55d tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:03.465575 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1dfd9186-e56c-4d2f-a71f-a4fad051b55d tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/dc2293d8-bde5-4b6a-a59f-6238703e83cc" status: 200 len: 1467 microversion: 2.1 time: 1.662029 Sep 23 04:38:03.470011 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 935/1820] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:01 2022] GET /compute/v2.1/servers/dc2293d8-bde5-4b6a-a59f-6238703e83cc => generated 1467 bytes in 1676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:38:03.489646 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e09fcf10-beca-4d8a-8960-3b84a064c790 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:03.494201 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e09fcf10-beca-4d8a-8960-3b84a064c790 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 19d7387c-9776-4e8e-801d-c959ba47af7f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:03.499199 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e09fcf10-beca-4d8a-8960-3b84a064c790 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:03.500327 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e09fcf10-beca-4d8a-8960-3b84a064c790 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:03.500960 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e09fcf10-beca-4d8a-8960-3b84a064c790 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:03.502027 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e09fcf10-beca-4d8a-8960-3b84a064c790 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:03.502668 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e09fcf10-beca-4d8a-8960-3b84a064c790 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:03.503293 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e09fcf10-beca-4d8a-8960-3b84a064c790 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:03.533094 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-e09fcf10-beca-4d8a-8960-3b84a064c790 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] HTTP exception thrown: Instance 19d7387c-9776-4e8e-801d-c959ba47af7f could not be found. Sep 23 04:38:03.539974 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e09fcf10-beca-4d8a-8960-3b84a064c790 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Request method failure captured: Sep 23 04:38:03.539974 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/19d7387c-9776-4e8e-801d-c959ba47af7f HTTP/1.1 Sep 23 04:38:03.539974 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:38:03.539974 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:38:03.539974 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:38:03.539974 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:38:03.539974 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:38:03.539974 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:38:03.539974 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:38:03.539974 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:38:03.539974 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTgD-AJZNKtluGEJNjQKU0pcHtUCc1AZ8Ycz4MPGIeanw2_GglRmvn8LiMCEayIX86yw_RpyCC_JZrlVGSjhSgenUVZhpJ_MqN5SLmcv6Qnl3N6cXWJgtCK8N_ffRhD1dYgLIdHHgnmyTAptDZsjatOWU1ocTU40JP9XOpkK3deqL7A Sep 23 04:38:03.539974 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:38:03.539974 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:38:03.539974 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:38:03.539974 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:38:03.539974 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:38:03.539974 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:38:03.539974 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: fe698721372f40888dc2918c46e65f2f Sep 23 04:38:03.539974 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-DeleteServersTestJSON-347759205 Sep 23 04:38:03.539974 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:38:03.539974 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:38:03.539974 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fe698721372f40888dc2918c46e65f2f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe698721372f40888dc2918c46e65f2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fe698721372f40888dc2918c46e65f2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe698721372f40888dc2918c46e65f2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:38:03.539974 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-DeleteServersTestJSON-347759205 Sep 23 04:38:03.539974 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: fe698721372f40888dc2918c46e65f2f Sep 23 04:38:03.539974 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-DeleteServersTestJSON-347759205 Sep 23 04:38:03.539974 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-DeleteServersTestJSON-347759205-project Sep 23 04:38:03.539974 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:38:03.539974 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:38:03.539974 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 36526fe612c840fb907e1992d8e62538 Sep 23 04:38:03.539974 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-DeleteServersTestJSON-347759205-project Sep 23 04:38:03.539974 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:38:03.539974 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 19d7387c-9776-4e8e-801d-c959ba47af7f could not be found. Sep 23 04:38:03.539974 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '19d7387c-9776-4e8e-801d-c959ba47af7f'} Sep 23 04:38:03.539974 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:38:03.539974 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:38:03.539974 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:38:03.539974 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:38:03.539974 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:38:03.539974 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:38:03.539974 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:38:03.539974 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:38:03.539974 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:38:03.539974 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:38:03.539974 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19d7387c-9776-4e8e-801d-c959ba47af7f could not be found. Sep 23 04:38:03.539974 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:38:03.539974 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:38:03.539974 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:38:03.539974 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:38:03.539974 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:38:03.539974 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:38:03.539974 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:38:03.539974 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:38:03.539974 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:38:03.539974 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:38:03.539974 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:38:03.539974 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:38:03.539974 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:38:03.539974 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:38:03.539974 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:38:03.539974 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:38:03.539974 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19d7387c-9776-4e8e-801d-c959ba47af7f could not be found. Sep 23 04:38:03.539974 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:38:03.539974 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:38:03.539974 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:38:03.546111 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:38:03.546111 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:38:03.546111 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:38:03.546111 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:38:03.546111 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:38:03.546111 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19d7387c-9776-4e8e-801d-c959ba47af7f could not be found. Sep 23 04:38:03.546111 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:38:03.551956 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e09fcf10-beca-4d8a-8960-3b84a064c790 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Returning 404 to user: Instance 19d7387c-9776-4e8e-801d-c959ba47af7f could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:38:03.551956 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e09fcf10-beca-4d8a-8960-3b84a064c790 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/19d7387c-9776-4e8e-801d-c959ba47af7f" status: 404 len: 111 microversion: 2.1 time: 0.080201 Sep 23 04:38:03.555725 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 936/1821] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:03 2022] GET /compute/v2.1/servers/19d7387c-9776-4e8e-801d-c959ba47af7f => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:38:03.564183 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-962c6c21-d60d-4f6e-84f2-27cd548a564c tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:03.571170 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-962c6c21-d60d-4f6e-84f2-27cd548a564c tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] [instance: e203a3bb-aff0-41d9-b8ba-750797cab055] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:03.591759 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-962c6c21-d60d-4f6e-84f2-27cd548a564c tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:03.591759 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-962c6c21-d60d-4f6e-84f2-27cd548a564c tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:03.591759 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-962c6c21-d60d-4f6e-84f2-27cd548a564c tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:03.591759 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-962c6c21-d60d-4f6e-84f2-27cd548a564c tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:03.595213 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-962c6c21-d60d-4f6e-84f2-27cd548a564c tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:03.596195 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-962c6c21-d60d-4f6e-84f2-27cd548a564c tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:03.827244 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4ae65ef3-03df-49d7-a9c3-786c2f2dcfdb tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "DELETE /compute/v2.1/servers/205bf02b-1478-4765-b2a6-d7014d9f0a64" status: 204 len: 0 microversion: 2.25 time: 0.607089 Sep 23 04:38:03.827845 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 886/1822] 10.222.0.33 () {60 vars in 1280 bytes} [Fri Sep 23 04:38:03 2022] DELETE /compute/v2.1/servers/205bf02b-1478-4765-b2a6-d7014d9f0a64 => generated 0 bytes in 634 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 23 04:38:03.833960 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-74e2d6d0-5076-4550-9bda-e5ec32a13169 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:03.837184 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-74e2d6d0-5076-4550-9bda-e5ec32a13169 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: 04e9b262-d9e0-434a-bcbb-a85ef9180ee9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:03.863788 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-74e2d6d0-5076-4550-9bda-e5ec32a13169 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:03.864626 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-74e2d6d0-5076-4550-9bda-e5ec32a13169 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:03.865273 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-74e2d6d0-5076-4550-9bda-e5ec32a13169 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:03.866266 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-74e2d6d0-5076-4550-9bda-e5ec32a13169 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:03.866933 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-74e2d6d0-5076-4550-9bda-e5ec32a13169 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:03.868152 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-74e2d6d0-5076-4550-9bda-e5ec32a13169 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:03.875453 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:38:03.995586 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-74e2d6d0-5076-4550-9bda-e5ec32a13169 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.151463 Sep 23 04:38:03.995586 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 887/1823] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Sep 23 04:38:03 2022] GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9/os-volume_attachments => generated 197 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:38:03.995586 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-dc0c4f63-0c72-4cb8-a68c-3820587d63ef tempest-ServersOnMultiNodesTest-617918424 tempest-ServersOnMultiNodesTest-617918424-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:04.017234 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-dc0c4f63-0c72-4cb8-a68c-3820587d63ef tempest-ServersOnMultiNodesTest-617918424 tempest-ServersOnMultiNodesTest-617918424-project-admin] [instance: dc2293d8-bde5-4b6a-a59f-6238703e83cc] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:04.045511 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dc0c4f63-0c72-4cb8-a68c-3820587d63ef tempest-ServersOnMultiNodesTest-617918424 tempest-ServersOnMultiNodesTest-617918424-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:04.045511 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dc0c4f63-0c72-4cb8-a68c-3820587d63ef tempest-ServersOnMultiNodesTest-617918424 tempest-ServersOnMultiNodesTest-617918424-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:04.045511 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dc0c4f63-0c72-4cb8-a68c-3820587d63ef tempest-ServersOnMultiNodesTest-617918424 tempest-ServersOnMultiNodesTest-617918424-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:04.045511 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dc0c4f63-0c72-4cb8-a68c-3820587d63ef tempest-ServersOnMultiNodesTest-617918424 tempest-ServersOnMultiNodesTest-617918424-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:04.045511 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dc0c4f63-0c72-4cb8-a68c-3820587d63ef tempest-ServersOnMultiNodesTest-617918424 tempest-ServersOnMultiNodesTest-617918424-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:04.045511 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dc0c4f63-0c72-4cb8-a68c-3820587d63ef tempest-ServersOnMultiNodesTest-617918424 tempest-ServersOnMultiNodesTest-617918424-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:04.270035 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-962c6c21-d60d-4f6e-84f2-27cd548a564c tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1244f3db540441a28d8413e510cfccad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b412c874d4e668b4a1a33dedb2c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:04.279791 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-962c6c21-d60d-4f6e-84f2-27cd548a564c tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] 10.222.0.33 "GET /compute/v2.1/servers/e203a3bb-aff0-41d9-b8ba-750797cab055" status: 200 len: 1319 microversion: 2.1 time: 0.722178 Sep 23 04:38:04.294356 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 937/1824] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:03 2022] GET /compute/v2.1/servers/e203a3bb-aff0-41d9-b8ba-750797cab055 => generated 1319 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:04.305934 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f542e53d-4dbf-43c2-91c2-1021fba52bf8 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-452493943", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "networks": [{"uuid": "a989594a-cd71-405f-a7ac-42f529a758f7"}]}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:38:04.410330 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.neutron [None req-f542e53d-4dbf-43c2-91c2-1021fba52bf8 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] validate_networks() for [('a989594a-cd71-405f-a7ac-42f529a758f7', None, None, None, None, None)] {{(pid=122699) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:38:04.769633 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-dc0c4f63-0c72-4cb8-a68c-3820587d63ef tempest-ServersOnMultiNodesTest-617918424 tempest-ServersOnMultiNodesTest-617918424-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/dc2293d8-bde5-4b6a-a59f-6238703e83cc" status: 200 len: 1618 microversion: 2.1 time: 0.777695 Sep 23 04:38:04.783996 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 888/1825] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:03 2022] GET /compute/v2.1/servers/dc2293d8-bde5-4b6a-a59f-6238703e83cc => generated 1618 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:04.795058 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d1c5d56a-f4b8-44cf-a28a-3064a4f43a23 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:04.796033 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d1c5d56a-f4b8-44cf-a28a-3064a4f43a23 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 205bf02b-1478-4765-b2a6-d7014d9f0a64] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:04.813992 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d1c5d56a-f4b8-44cf-a28a-3064a4f43a23 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:04.815484 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d1c5d56a-f4b8-44cf-a28a-3064a4f43a23 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:04.816440 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d1c5d56a-f4b8-44cf-a28a-3064a4f43a23 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:04.818592 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d1c5d56a-f4b8-44cf-a28a-3064a4f43a23 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:04.821642 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d1c5d56a-f4b8-44cf-a28a-3064a4f43a23 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:04.822357 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d1c5d56a-f4b8-44cf-a28a-3064a4f43a23 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:05.266284 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d1c5d56a-f4b8-44cf-a28a-3064a4f43a23 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:05.281970 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d1c5d56a-f4b8-44cf-a28a-3064a4f43a23 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:05.287802 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d1c5d56a-f4b8-44cf-a28a-3064a4f43a23 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:05.295650 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d1c5d56a-f4b8-44cf-a28a-3064a4f43a23 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/205bf02b-1478-4765-b2a6-d7014d9f0a64" status: 200 len: 1733 microversion: 2.25 time: 0.510235 Sep 23 04:38:05.310520 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 889/1826] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:38:04 2022] GET /compute/v2.1/servers/205bf02b-1478-4765-b2a6-d7014d9f0a64 => generated 1733 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:38:05.354785 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a70b05cc-32e6-4c5c-add9-de5b944f6ca1 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:05.358544 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a70b05cc-32e6-4c5c-add9-de5b944f6ca1 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] [instance: 53745879-9973-4217-b1c5-b45f917db80e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:05.375651 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a70b05cc-32e6-4c5c-add9-de5b944f6ca1 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:05.376475 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a70b05cc-32e6-4c5c-add9-de5b944f6ca1 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:05.377291 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a70b05cc-32e6-4c5c-add9-de5b944f6ca1 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:05.378244 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a70b05cc-32e6-4c5c-add9-de5b944f6ca1 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:05.378884 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a70b05cc-32e6-4c5c-add9-de5b944f6ca1 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:05.385482 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a70b05cc-32e6-4c5c-add9-de5b944f6ca1 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:05.422091 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-f542e53d-4dbf-43c2-91c2-1021fba52bf8 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Flavor limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:38:05.423067 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-f542e53d-4dbf-43c2-91c2-1021fba52bf8 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Image limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:38:05.423761 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-f542e53d-4dbf-43c2-91c2-1021fba52bf8 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Flavor pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:38:05.424340 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-f542e53d-4dbf-43c2-91c2-1021fba52bf8 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Image pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:38:05.424986 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-f542e53d-4dbf-43c2-91c2-1021fba52bf8 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:38:05.447822 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f542e53d-4dbf-43c2-91c2-1021fba52bf8 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:05.448700 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f542e53d-4dbf-43c2-91c2-1021fba52bf8 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:05.456107 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f542e53d-4dbf-43c2-91c2-1021fba52bf8 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:05.458984 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f542e53d-4dbf-43c2-91c2-1021fba52bf8 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:05.459678 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f542e53d-4dbf-43c2-91c2-1021fba52bf8 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:05.466218 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f542e53d-4dbf-43c2-91c2-1021fba52bf8 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:05.511807 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-f542e53d-4dbf-43c2-91c2-1021fba52bf8 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Getting quotas for project fe698721372f40888dc2918c46e65f2f. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:38:05.524444 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:38:05.526040 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-f542e53d-4dbf-43c2-91c2-1021fba52bf8 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Getting quotas for user 36526fe612c840fb907e1992d8e62538 and project fe698721372f40888dc2918c46e65f2f. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:38:05.552933 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f542e53d-4dbf-43c2-91c2-1021fba52bf8 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Going to run 1 instances... {{(pid=122699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:38:05.558468 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f542e53d-4dbf-43c2-91c2-1021fba52bf8 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 9d2757b5-8933-4d44-bfa5-cb5054cd05c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:38:05.728434 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f542e53d-4dbf-43c2-91c2-1021fba52bf8 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.432631 Sep 23 04:38:05.737700 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 938/1827] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:38:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1443 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:38:05.743620 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-971459ad-d6d5-4ff2-8cd5-c9a6ad0fce85 req-db88518c-e794-46a7-9289-b6c552b020fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53745879-9973-4217-b1c5-b45f917db80e", "tag": "2e21d383-3d28-4e86-b810-b78bf2b6d003"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:38:05.797020 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-971459ad-d6d5-4ff2-8cd5-c9a6ad0fce85 req-db88518c-e794-46a7-9289-b6c552b020fb service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:05.802209 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-971459ad-d6d5-4ff2-8cd5-c9a6ad0fce85 req-db88518c-e794-46a7-9289-b6c552b020fb service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:05.802702 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-971459ad-d6d5-4ff2-8cd5-c9a6ad0fce85 req-db88518c-e794-46a7-9289-b6c552b020fb service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:05.833599 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-971459ad-d6d5-4ff2-8cd5-c9a6ad0fce85 req-db88518c-e794-46a7-9289-b6c552b020fb service nova] Creating event network-changed:2e21d383-3d28-4e86-b810-b78bf2b6d003 for instance 53745879-9973-4217-b1c5-b45f917db80e on n-h2-846463-3 Sep 23 04:38:05.842631 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-971459ad-d6d5-4ff2-8cd5-c9a6ad0fce85 req-db88518c-e794-46a7-9289-b6c552b020fb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101005 Sep 23 04:38:05.847642 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 939/1828] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:38:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:38:05.857154 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a70b05cc-32e6-4c5c-add9-de5b944f6ca1 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:05.872411 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3d6b341a-9fa8-4d46-bec6-9273cb8d6731 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:05.874388 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a70b05cc-32e6-4c5c-add9-de5b944f6ca1 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:05.874797 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-3d6b341a-9fa8-4d46-bec6-9273cb8d6731 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: 04e9b262-d9e0-434a-bcbb-a85ef9180ee9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:05.878484 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a70b05cc-32e6-4c5c-add9-de5b944f6ca1 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:05.880542 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a70b05cc-32e6-4c5c-add9-de5b944f6ca1 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] 10.222.0.33 "GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e" status: 200 len: 1885 microversion: 2.42 time: 0.568487 Sep 23 04:38:05.891613 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3d6b341a-9fa8-4d46-bec6-9273cb8d6731 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:05.893920 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3d6b341a-9fa8-4d46-bec6-9273cb8d6731 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:05.893920 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3d6b341a-9fa8-4d46-bec6-9273cb8d6731 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:05.894688 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3d6b341a-9fa8-4d46-bec6-9273cb8d6731 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:05.895324 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3d6b341a-9fa8-4d46-bec6-9273cb8d6731 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:05.895939 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3d6b341a-9fa8-4d46-bec6-9273cb8d6731 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:05.906242 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 890/1829] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:38:05 2022] GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e => generated 1885 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:38:05.926170 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5e051a77-ed8e-408a-a030-d27a554aa5a6 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-726535500", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "1180ceb9-a888-4a3b-ba9d-a35afa8dc279"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:38:05.993643 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3d6b341a-9fa8-4d46-bec6-9273cb8d6731 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.144418 Sep 23 04:38:05.994813 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 940/1830] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Sep 23 04:38:05 2022] GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9/os-volume_attachments => generated 197 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:38:06.089198 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.network.neutron [None req-5e051a77-ed8e-408a-a030-d27a554aa5a6 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] validate_networks() for None {{(pid=122698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:38:06.296611 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-adf6f605-c2b5-4d25-9787-4e6e5fe03b22 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-1349082803", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "networks": "none"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:38:06.456831 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-adf6f605-c2b5-4d25-9787-4e6e5fe03b22 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Flavor limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:38:06.457506 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-adf6f605-c2b5-4d25-9787-4e6e5fe03b22 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Image limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:38:06.457980 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-adf6f605-c2b5-4d25-9787-4e6e5fe03b22 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Flavor pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:38:06.458498 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-adf6f605-c2b5-4d25-9787-4e6e5fe03b22 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Image pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:38:06.459020 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-adf6f605-c2b5-4d25-9787-4e6e5fe03b22 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:38:06.474961 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-adf6f605-c2b5-4d25-9787-4e6e5fe03b22 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:06.475775 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-adf6f605-c2b5-4d25-9787-4e6e5fe03b22 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:06.476426 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-adf6f605-c2b5-4d25-9787-4e6e5fe03b22 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:06.477437 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-adf6f605-c2b5-4d25-9787-4e6e5fe03b22 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:06.478127 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-adf6f605-c2b5-4d25-9787-4e6e5fe03b22 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:06.479294 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-adf6f605-c2b5-4d25-9787-4e6e5fe03b22 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:06.510336 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-adf6f605-c2b5-4d25-9787-4e6e5fe03b22 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Getting quotas for project b05671a2f19d42d49aa676680e998b33. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:38:06.519165 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-adf6f605-c2b5-4d25-9787-4e6e5fe03b22 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Getting quotas for user 6504948146c94487a7357025b8e47860 and project b05671a2f19d42d49aa676680e998b33. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:38:06.538589 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-adf6f605-c2b5-4d25-9787-4e6e5fe03b22 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Going to run 1 instances... {{(pid=122699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:38:06.542150 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-adf6f605-c2b5-4d25-9787-4e6e5fe03b22 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] [instance: 94fc4134-9b8e-4dcd-bd96-5545bfd51c97] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:38:06.750045 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-adf6f605-c2b5-4d25-9787-4e6e5fe03b22 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.751224 Sep 23 04:38:06.751823 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 941/1831] 10.222.0.33 () {62 vars in 1188 bytes} [Fri Sep 23 04:38:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 756 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 23 04:38:06.770586 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f1c4a892-7a41-4a70-8cef-d4b6bacdec85 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:06.774467 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f1c4a892-7a41-4a70-8cef-d4b6bacdec85 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] [instance: e203a3bb-aff0-41d9-b8ba-750797cab055] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:06.789203 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f1c4a892-7a41-4a70-8cef-d4b6bacdec85 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:06.799263 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f1c4a892-7a41-4a70-8cef-d4b6bacdec85 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:06.815142 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f1c4a892-7a41-4a70-8cef-d4b6bacdec85 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:06.816190 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f1c4a892-7a41-4a70-8cef-d4b6bacdec85 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:06.821339 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f1c4a892-7a41-4a70-8cef-d4b6bacdec85 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:06.823258 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f1c4a892-7a41-4a70-8cef-d4b6bacdec85 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:07.326128 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-5e051a77-ed8e-408a-a030-d27a554aa5a6 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Flavor limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:38:07.327381 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-5e051a77-ed8e-408a-a030-d27a554aa5a6 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Image limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:38:07.328049 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-5e051a77-ed8e-408a-a030-d27a554aa5a6 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Flavor pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:38:07.329303 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-5e051a77-ed8e-408a-a030-d27a554aa5a6 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Image pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:38:07.331187 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-5e051a77-ed8e-408a-a030-d27a554aa5a6 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:38:07.338142 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f1c4a892-7a41-4a70-8cef-d4b6bacdec85 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1244f3db540441a28d8413e510cfccad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b412c874d4e668b4a1a33dedb2c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:07.356542 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f1c4a892-7a41-4a70-8cef-d4b6bacdec85 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] 10.222.0.33 "GET /compute/v2.1/servers/e203a3bb-aff0-41d9-b8ba-750797cab055" status: 200 len: 1319 microversion: 2.1 time: 0.599780 Sep 23 04:38:07.364025 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 942/1832] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:06 2022] GET /compute/v2.1/servers/e203a3bb-aff0-41d9-b8ba-750797cab055 => generated 1319 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:07.369155 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-08bd5a2b-06ab-4696-949d-3659bf0f1d99 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:07.371913 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-08bd5a2b-06ab-4696-949d-3659bf0f1d99 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 9d2757b5-8933-4d44-bfa5-cb5054cd05c6] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:07.373971 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5e051a77-ed8e-408a-a030-d27a554aa5a6 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:07.374521 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5e051a77-ed8e-408a-a030-d27a554aa5a6 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:07.375941 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5e051a77-ed8e-408a-a030-d27a554aa5a6 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:07.379744 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5e051a77-ed8e-408a-a030-d27a554aa5a6 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:07.380382 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5e051a77-ed8e-408a-a030-d27a554aa5a6 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:07.385190 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5e051a77-ed8e-408a-a030-d27a554aa5a6 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:07.388851 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-08bd5a2b-06ab-4696-949d-3659bf0f1d99 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:07.389361 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-08bd5a2b-06ab-4696-949d-3659bf0f1d99 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:07.389808 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-08bd5a2b-06ab-4696-949d-3659bf0f1d99 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:07.390816 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-08bd5a2b-06ab-4696-949d-3659bf0f1d99 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:07.391275 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-08bd5a2b-06ab-4696-949d-3659bf0f1d99 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:07.392210 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-08bd5a2b-06ab-4696-949d-3659bf0f1d99 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:07.446691 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-5e051a77-ed8e-408a-a030-d27a554aa5a6 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Getting quotas for project f5db359a60174c45afa2bf06e23a46c4. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:38:07.460854 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-5e051a77-ed8e-408a-a030-d27a554aa5a6 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Getting quotas for user da08af8193dd490b93278385583f24c0 and project f5db359a60174c45afa2bf06e23a46c4. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:38:07.485267 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5e051a77-ed8e-408a-a030-d27a554aa5a6 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Going to run 1 instances... {{(pid=122698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:38:07.488954 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5e051a77-ed8e-408a-a030-d27a554aa5a6 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 13cee31b-8715-45f1-9aa7-37e885dcf785] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:38:07.495285 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-08bd5a2b-06ab-4696-949d-3659bf0f1d99 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:07.511943 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-08bd5a2b-06ab-4696-949d-3659bf0f1d99 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/9d2757b5-8933-4d44-bfa5-cb5054cd05c6" status: 200 len: 1218 microversion: 2.1 time: 0.146442 Sep 23 04:38:07.512542 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 943/1833] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:07 2022] GET /compute/v2.1/servers/9d2757b5-8933-4d44-bfa5-cb5054cd05c6 => generated 1218 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:07.537446 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-7c363d69-f660-49bb-8e72-f4737d3f6d20 req-bac532c9-7f84-4475-bc86-62bda8f4b869 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94e8c141-ef33-4bb2-929f-7f7d0d10ff2c", "name": "network-vif-plugged", "status": "completed", "tag": "c3659f36-9ff9-42b5-bba7-a92fbe8f0703"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:38:07.549732 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-7c363d69-f660-49bb-8e72-f4737d3f6d20 req-bac532c9-7f84-4475-bc86-62bda8f4b869 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:07.554685 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-7c363d69-f660-49bb-8e72-f4737d3f6d20 req-bac532c9-7f84-4475-bc86-62bda8f4b869 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:07.556051 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-7c363d69-f660-49bb-8e72-f4737d3f6d20 req-bac532c9-7f84-4475-bc86-62bda8f4b869 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:07.595409 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-7c363d69-f660-49bb-8e72-f4737d3f6d20 req-bac532c9-7f84-4475-bc86-62bda8f4b869 service nova] Creating event network-vif-plugged:c3659f36-9ff9-42b5-bba7-a92fbe8f0703 for instance 94e8c141-ef33-4bb2-929f-7f7d0d10ff2c on n-h1-846463-3 Sep 23 04:38:07.609655 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-7c363d69-f660-49bb-8e72-f4737d3f6d20 req-bac532c9-7f84-4475-bc86-62bda8f4b869 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076957 Sep 23 04:38:07.609655 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 944/1834] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:38:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:38:07.631798 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2c23b640-d1c5-441c-9226-7bc4d965e6b1 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:07.632815 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-2c23b640-d1c5-441c-9226-7bc4d965e6b1 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 205bf02b-1478-4765-b2a6-d7014d9f0a64] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:07.639874 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2c23b640-d1c5-441c-9226-7bc4d965e6b1 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:07.640825 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2c23b640-d1c5-441c-9226-7bc4d965e6b1 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:07.667690 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2c23b640-d1c5-441c-9226-7bc4d965e6b1 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:07.668545 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2c23b640-d1c5-441c-9226-7bc4d965e6b1 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:07.669041 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2c23b640-d1c5-441c-9226-7bc4d965e6b1 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:07.669487 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2c23b640-d1c5-441c-9226-7bc4d965e6b1 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:07.703194 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5e051a77-ed8e-408a-a030-d27a554aa5a6 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.794884 Sep 23 04:38:07.723267 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 891/1835] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:38:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1816 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:38:07.734681 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4ac7bee7-5445-48e7-ac7c-424ef49cbefc tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:38:07.749360 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4ac7bee7-5445-48e7-ac7c-424ef49cbefc tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] [instance: 94fc4134-9b8e-4dcd-bd96-5545bfd51c97] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:07.837486 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:38:07.941281 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2c23b640-d1c5-441c-9226-7bc4d965e6b1 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:07.955676 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2c23b640-d1c5-441c-9226-7bc4d965e6b1 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:07.956897 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2c23b640-d1c5-441c-9226-7bc4d965e6b1 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:07.958254 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2c23b640-d1c5-441c-9226-7bc4d965e6b1 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/205bf02b-1478-4765-b2a6-d7014d9f0a64" status: 200 len: 1665 microversion: 2.25 time: 0.344093 Sep 23 04:38:07.959421 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 945/1836] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:38:07 2022] GET /compute/v2.1/servers/205bf02b-1478-4765-b2a6-d7014d9f0a64 => generated 1665 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:38:07.979932 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c51b9603-bfbb-473c-8ae1-f18a36ae0ce4 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:07.980840 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c51b9603-bfbb-473c-8ae1-f18a36ae0ce4 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] [instance: 53745879-9973-4217-b1c5-b45f917db80e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:07.996390 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4ac7bee7-5445-48e7-ac7c-424ef49cbefc tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:08.012381 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4ac7bee7-5445-48e7-ac7c-424ef49cbefc tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:08.012381 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4ac7bee7-5445-48e7-ac7c-424ef49cbefc tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:08.024630 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4ac7bee7-5445-48e7-ac7c-424ef49cbefc tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] 10.222.0.33 "PUT /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97" status: 200 len: 1359 microversion: 2.75 time: 0.300199 Sep 23 04:38:08.025246 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 892/1837] 10.222.0.33 () {62 vars in 1297 bytes} [Fri Sep 23 04:38:07 2022] PUT /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97 => generated 1359 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:38:08.034781 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c51b9603-bfbb-473c-8ae1-f18a36ae0ce4 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:08.035593 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c51b9603-bfbb-473c-8ae1-f18a36ae0ce4 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:08.037730 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c51b9603-bfbb-473c-8ae1-f18a36ae0ce4 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:08.039955 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c51b9603-bfbb-473c-8ae1-f18a36ae0ce4 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:08.044694 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c51b9603-bfbb-473c-8ae1-f18a36ae0ce4 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:08.045363 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c51b9603-bfbb-473c-8ae1-f18a36ae0ce4 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:08.053561 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-384265aa-1716-45a5-b838-ebb8efa6028c tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:08.057962 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-384265aa-1716-45a5-b838-ebb8efa6028c tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: 04e9b262-d9e0-434a-bcbb-a85ef9180ee9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:08.085315 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-384265aa-1716-45a5-b838-ebb8efa6028c tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:08.098927 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-384265aa-1716-45a5-b838-ebb8efa6028c tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:08.098927 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-384265aa-1716-45a5-b838-ebb8efa6028c tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:08.098927 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-384265aa-1716-45a5-b838-ebb8efa6028c tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:08.098927 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-384265aa-1716-45a5-b838-ebb8efa6028c tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:08.098927 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-384265aa-1716-45a5-b838-ebb8efa6028c tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:08.248556 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-384265aa-1716-45a5-b838-ebb8efa6028c tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.222203 Sep 23 04:38:08.251467 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 893/1838] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Sep 23 04:38:08 2022] GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9/os-volume_attachments => generated 197 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:38:08.265314 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-99b7cc32-ed1f-48eb-b2db-c873a1ba9c2b tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:08.268579 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-99b7cc32-ed1f-48eb-b2db-c873a1ba9c2b tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 13cee31b-8715-45f1-9aa7-37e885dcf785] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:08.409131 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-99b7cc32-ed1f-48eb-b2db-c873a1ba9c2b tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:08.421294 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-99b7cc32-ed1f-48eb-b2db-c873a1ba9c2b tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/13cee31b-8715-45f1-9aa7-37e885dcf785" status: 200 len: 1216 microversion: 2.1 time: 0.167820 Sep 23 04:38:08.422660 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 894/1839] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:08 2022] GET /compute/v2.1/servers/13cee31b-8715-45f1-9aa7-37e885dcf785 => generated 1216 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:08.440835 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-6bccb822-fda8-440b-a998-2354297892f7 req-0ec5b2c9-f8f5-484f-8a11-75674e3d3042 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e203a3bb-aff0-41d9-b8ba-750797cab055", "tag": "1c12120e-9187-4292-a89f-42ea15c1cbc3"}, {"name": "network-changed", "server_uuid": "53745879-9973-4217-b1c5-b45f917db80e", "tag": "db361959-8361-465d-9cf6-0cddc23eb745"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:38:08.487359 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-6bccb822-fda8-440b-a998-2354297892f7 req-0ec5b2c9-f8f5-484f-8a11-75674e3d3042 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:08.488021 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-6bccb822-fda8-440b-a998-2354297892f7 req-0ec5b2c9-f8f5-484f-8a11-75674e3d3042 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:08.489756 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-6bccb822-fda8-440b-a998-2354297892f7 req-0ec5b2c9-f8f5-484f-8a11-75674e3d3042 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:08.550640 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-6bccb822-fda8-440b-a998-2354297892f7 req-0ec5b2c9-f8f5-484f-8a11-75674e3d3042 service nova] Creating event network-changed:1c12120e-9187-4292-a89f-42ea15c1cbc3 for instance e203a3bb-aff0-41d9-b8ba-750797cab055 on n-h2-846463-3 Sep 23 04:38:08.553477 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-6bccb822-fda8-440b-a998-2354297892f7 req-0ec5b2c9-f8f5-484f-8a11-75674e3d3042 service nova] Creating event network-changed:db361959-8361-465d-9cf6-0cddc23eb745 for instance 53745879-9973-4217-b1c5-b45f917db80e on n-h2-846463-3 Sep 23 04:38:08.558548 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c51b9603-bfbb-473c-8ae1-f18a36ae0ce4 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:08.567498 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-6bccb822-fda8-440b-a998-2354297892f7 req-0ec5b2c9-f8f5-484f-8a11-75674e3d3042 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.141897 Sep 23 04:38:08.568627 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 895/1840] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:38:08 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:38:08.573816 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c51b9603-bfbb-473c-8ae1-f18a36ae0ce4 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:08.577577 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-689e655d-521a-46a8-af0a-abc61af7ca3d tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:08.578481 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c51b9603-bfbb-473c-8ae1-f18a36ae0ce4 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:08.579424 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-689e655d-521a-46a8-af0a-abc61af7ca3d tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] [instance: 94fc4134-9b8e-4dcd-bd96-5545bfd51c97] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:08.581112 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c51b9603-bfbb-473c-8ae1-f18a36ae0ce4 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] 10.222.0.33 "GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e" status: 200 len: 1885 microversion: 2.42 time: 0.620241 Sep 23 04:38:08.585294 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 946/1841] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:38:07 2022] GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e => generated 1885 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:38:08.589600 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-689e655d-521a-46a8-af0a-abc61af7ca3d tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:08.590596 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-689e655d-521a-46a8-af0a-abc61af7ca3d tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:08.591276 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-689e655d-521a-46a8-af0a-abc61af7ca3d tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:08.592304 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-689e655d-521a-46a8-af0a-abc61af7ca3d tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:08.592971 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-689e655d-521a-46a8-af0a-abc61af7ca3d tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:08.593738 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-689e655d-521a-46a8-af0a-abc61af7ca3d tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:08.594013 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e69ed3a7-4059-4108-92f1-0f313b45b6ad tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:08.598406 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e69ed3a7-4059-4108-92f1-0f313b45b6ad tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] [instance: e203a3bb-aff0-41d9-b8ba-750797cab055] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:08.623623 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e69ed3a7-4059-4108-92f1-0f313b45b6ad tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:08.629874 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e69ed3a7-4059-4108-92f1-0f313b45b6ad tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:08.631263 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e69ed3a7-4059-4108-92f1-0f313b45b6ad tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:08.636444 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e69ed3a7-4059-4108-92f1-0f313b45b6ad tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:08.639948 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e69ed3a7-4059-4108-92f1-0f313b45b6ad tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:08.641043 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e69ed3a7-4059-4108-92f1-0f313b45b6ad tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:08.974225 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-689e655d-521a-46a8-af0a-abc61af7ca3d tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:08.992234 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-689e655d-521a-46a8-af0a-abc61af7ca3d tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:08.995107 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-689e655d-521a-46a8-af0a-abc61af7ca3d tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:09.010762 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-689e655d-521a-46a8-af0a-abc61af7ca3d tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] 10.222.0.33 "GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97" status: 200 len: 1363 microversion: 2.75 time: 0.439369 Sep 23 04:38:09.019667 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 896/1842] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:38:08 2022] GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97 => generated 1363 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:38:09.024508 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1438c4cb-b59b-4ad9-967e-d95537c483d1 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:09.025245 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-1438c4cb-b59b-4ad9-967e-d95537c483d1 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 9d2757b5-8933-4d44-bfa5-cb5054cd05c6] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:09.047514 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1438c4cb-b59b-4ad9-967e-d95537c483d1 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:09.048383 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1438c4cb-b59b-4ad9-967e-d95537c483d1 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:09.049061 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1438c4cb-b59b-4ad9-967e-d95537c483d1 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:09.049663 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1438c4cb-b59b-4ad9-967e-d95537c483d1 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:09.050178 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1438c4cb-b59b-4ad9-967e-d95537c483d1 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:09.050609 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1438c4cb-b59b-4ad9-967e-d95537c483d1 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:09.230909 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-1438c4cb-b59b-4ad9-967e-d95537c483d1 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:09.248537 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-1438c4cb-b59b-4ad9-967e-d95537c483d1 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/9d2757b5-8933-4d44-bfa5-cb5054cd05c6" status: 200 len: 1266 microversion: 2.1 time: 0.226129 Sep 23 04:38:09.254182 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e69ed3a7-4059-4108-92f1-0f313b45b6ad tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1244f3db540441a28d8413e510cfccad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b412c874d4e668b4a1a33dedb2c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:09.267942 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 897/1843] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:09 2022] GET /compute/v2.1/servers/9d2757b5-8933-4d44-bfa5-cb5054cd05c6 => generated 1266 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:09.280138 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e69ed3a7-4059-4108-92f1-0f313b45b6ad tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] 10.222.0.33 "GET /compute/v2.1/servers/e203a3bb-aff0-41d9-b8ba-750797cab055" status: 200 len: 1319 microversion: 2.1 time: 0.693328 Sep 23 04:38:09.295713 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 947/1844] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:08 2022] GET /compute/v2.1/servers/e203a3bb-aff0-41d9-b8ba-750797cab055 => generated 1319 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:09.297374 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-27a3bd0e-5b7f-4f68-b1af-a77915264dca tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:09.297374 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-27a3bd0e-5b7f-4f68-b1af-a77915264dca tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 205bf02b-1478-4765-b2a6-d7014d9f0a64] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:09.297605 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7bcbf4a3-b10b-476b-88a3-14a2874302f0 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:09.310365 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-27a3bd0e-5b7f-4f68-b1af-a77915264dca tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:09.310879 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-27a3bd0e-5b7f-4f68-b1af-a77915264dca tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:09.311327 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-27a3bd0e-5b7f-4f68-b1af-a77915264dca tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:09.311899 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-7bcbf4a3-b10b-476b-88a3-14a2874302f0 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: 04e9b262-d9e0-434a-bcbb-a85ef9180ee9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:09.319219 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-27a3bd0e-5b7f-4f68-b1af-a77915264dca tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:09.319753 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-27a3bd0e-5b7f-4f68-b1af-a77915264dca tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:09.320207 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-27a3bd0e-5b7f-4f68-b1af-a77915264dca tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:09.333914 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7bcbf4a3-b10b-476b-88a3-14a2874302f0 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:09.336615 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7bcbf4a3-b10b-476b-88a3-14a2874302f0 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:09.337277 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7bcbf4a3-b10b-476b-88a3-14a2874302f0 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:09.339783 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7bcbf4a3-b10b-476b-88a3-14a2874302f0 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:09.340617 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7bcbf4a3-b10b-476b-88a3-14a2874302f0 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:09.344774 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7bcbf4a3-b10b-476b-88a3-14a2874302f0 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:09.412769 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-7bcbf4a3-b10b-476b-88a3-14a2874302f0 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.128126 Sep 23 04:38:09.414209 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 948/1845] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Sep 23 04:38:09 2022] GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9/os-volume_attachments => generated 197 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:38:09.426351 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-27a3bd0e-5b7f-4f68-b1af-a77915264dca tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:09.427426 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-27a3bd0e-5b7f-4f68-b1af-a77915264dca tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:09.428077 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-27a3bd0e-5b7f-4f68-b1af-a77915264dca tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:09.428732 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-27a3bd0e-5b7f-4f68-b1af-a77915264dca tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lazy-loading 'fault' on Instance uuid 205bf02b-1478-4765-b2a6-d7014d9f0a64 {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:38:09.446645 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-92f8ce72-7d5d-4fbd-95ca-76ccdf4b86c1 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:09.447601 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-92f8ce72-7d5d-4fbd-95ca-76ccdf4b86c1 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 13cee31b-8715-45f1-9aa7-37e885dcf785] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:09.467224 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-92f8ce72-7d5d-4fbd-95ca-76ccdf4b86c1 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:09.469661 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-92f8ce72-7d5d-4fbd-95ca-76ccdf4b86c1 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:09.471246 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-92f8ce72-7d5d-4fbd-95ca-76ccdf4b86c1 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:09.472171 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-92f8ce72-7d5d-4fbd-95ca-76ccdf4b86c1 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:09.475040 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-92f8ce72-7d5d-4fbd-95ca-76ccdf4b86c1 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:09.476128 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-92f8ce72-7d5d-4fbd-95ca-76ccdf4b86c1 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:09.636332 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-27a3bd0e-5b7f-4f68-b1af-a77915264dca tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:09.642089 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-92f8ce72-7d5d-4fbd-95ca-76ccdf4b86c1 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:09.645113 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=100 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:38:09.646342 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-27a3bd0e-5b7f-4f68-b1af-a77915264dca tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:09.648665 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-27a3bd0e-5b7f-4f68-b1af-a77915264dca tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:09.650794 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-27a3bd0e-5b7f-4f68-b1af-a77915264dca tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/205bf02b-1478-4765-b2a6-d7014d9f0a64" status: 200 len: 1376 microversion: 2.25 time: 0.375395 Sep 23 04:38:09.665500 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 898/1846] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:38:09 2022] GET /compute/v2.1/servers/205bf02b-1478-4765-b2a6-d7014d9f0a64 => generated 1376 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:38:09.666315 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-92f8ce72-7d5d-4fbd-95ca-76ccdf4b86c1 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/13cee31b-8715-45f1-9aa7-37e885dcf785" status: 200 len: 1220 microversion: 2.1 time: 0.220966 Sep 23 04:38:09.666315 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 949/1847] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:09 2022] GET /compute/v2.1/servers/13cee31b-8715-45f1-9aa7-37e885dcf785 => generated 1220 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:09.673638 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e2e11ca0-4fc9-48ea-83bc-e4de50e3c4cf tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:09.675876 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e2e11ca0-4fc9-48ea-83bc-e4de50e3c4cf tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] [instance: 53745879-9973-4217-b1c5-b45f917db80e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:09.684899 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-c59d9fc0-35d5-4d08-8c26-5c1c2b85c5b7 req-42515fa6-3540-4901-9309-6cf6ce121f19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e90c852-5f27-4861-9b25-9ea1e475c0a9", "name": "network-vif-plugged", "status": "completed", "tag": "8b6ae886-5681-4d62-a4c2-d887ae24dcca"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:38:09.687909 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e2e11ca0-4fc9-48ea-83bc-e4de50e3c4cf tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:09.688760 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e2e11ca0-4fc9-48ea-83bc-e4de50e3c4cf tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:09.690443 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e2e11ca0-4fc9-48ea-83bc-e4de50e3c4cf tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:09.691538 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e2e11ca0-4fc9-48ea-83bc-e4de50e3c4cf tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:09.692226 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e2e11ca0-4fc9-48ea-83bc-e4de50e3c4cf tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:09.692908 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e2e11ca0-4fc9-48ea-83bc-e4de50e3c4cf tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:09.716107 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-c59d9fc0-35d5-4d08-8c26-5c1c2b85c5b7 req-42515fa6-3540-4901-9309-6cf6ce121f19 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:09.716915 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-c59d9fc0-35d5-4d08-8c26-5c1c2b85c5b7 req-42515fa6-3540-4901-9309-6cf6ce121f19 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:09.721393 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-c59d9fc0-35d5-4d08-8c26-5c1c2b85c5b7 req-42515fa6-3540-4901-9309-6cf6ce121f19 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:09.743734 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-c59d9fc0-35d5-4d08-8c26-5c1c2b85c5b7 req-42515fa6-3540-4901-9309-6cf6ce121f19 service nova] Creating event network-vif-plugged:8b6ae886-5681-4d62-a4c2-d887ae24dcca for instance 7e90c852-5f27-4861-9b25-9ea1e475c0a9 on n-h1-846463-3 Sep 23 04:38:09.751326 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-c59d9fc0-35d5-4d08-8c26-5c1c2b85c5b7 req-42515fa6-3540-4901-9309-6cf6ce121f19 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078980 Sep 23 04:38:09.752948 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 950/1848] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:38:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:38:10.052102 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-76673e14-9cdb-457e-a668-6f7fa50e02a9 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:10.053534 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-76673e14-9cdb-457e-a668-6f7fa50e02a9 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] [instance: 94fc4134-9b8e-4dcd-bd96-5545bfd51c97] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:10.074134 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-76673e14-9cdb-457e-a668-6f7fa50e02a9 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:10.075152 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-76673e14-9cdb-457e-a668-6f7fa50e02a9 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:10.075877 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-76673e14-9cdb-457e-a668-6f7fa50e02a9 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:10.076745 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-76673e14-9cdb-457e-a668-6f7fa50e02a9 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:10.077326 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-76673e14-9cdb-457e-a668-6f7fa50e02a9 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:10.077866 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-76673e14-9cdb-457e-a668-6f7fa50e02a9 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:10.168733 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e2e11ca0-4fc9-48ea-83bc-e4de50e3c4cf tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:10.196877 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e2e11ca0-4fc9-48ea-83bc-e4de50e3c4cf tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:10.198356 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e2e11ca0-4fc9-48ea-83bc-e4de50e3c4cf tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:10.199529 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e2e11ca0-4fc9-48ea-83bc-e4de50e3c4cf tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] 10.222.0.33 "GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e" status: 200 len: 1885 microversion: 2.42 time: 0.538588 Sep 23 04:38:10.200091 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 899/1849] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:38:09 2022] GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e => generated 1885 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:38:10.292739 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4942a15a-a9cd-4c28-abe6-ee7c6ae8b86b tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:10.293621 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4942a15a-a9cd-4c28-abe6-ee7c6ae8b86b tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 9d2757b5-8933-4d44-bfa5-cb5054cd05c6] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:10.307510 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4942a15a-a9cd-4c28-abe6-ee7c6ae8b86b tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:10.314773 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4942a15a-a9cd-4c28-abe6-ee7c6ae8b86b tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:10.314773 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4942a15a-a9cd-4c28-abe6-ee7c6ae8b86b tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:10.314773 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4942a15a-a9cd-4c28-abe6-ee7c6ae8b86b tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:10.314773 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4942a15a-a9cd-4c28-abe6-ee7c6ae8b86b tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:10.314773 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4942a15a-a9cd-4c28-abe6-ee7c6ae8b86b tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:10.531356 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-76673e14-9cdb-457e-a668-6f7fa50e02a9 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:10.549651 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-76673e14-9cdb-457e-a668-6f7fa50e02a9 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:10.572928 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-76673e14-9cdb-457e-a668-6f7fa50e02a9 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:10.586930 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4942a15a-a9cd-4c28-abe6-ee7c6ae8b86b tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:10.597015 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4942a15a-a9cd-4c28-abe6-ee7c6ae8b86b tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/9d2757b5-8933-4d44-bfa5-cb5054cd05c6" status: 200 len: 1274 microversion: 2.1 time: 0.308211 Sep 23 04:38:10.607910 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-76673e14-9cdb-457e-a668-6f7fa50e02a9 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] 10.222.0.33 "GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97" status: 200 len: 1411 microversion: 2.75 time: 0.561545 Sep 23 04:38:10.615724 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 951/1850] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:38:10 2022] GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97 => generated 1411 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:38:10.616350 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 900/1851] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:10 2022] GET /compute/v2.1/servers/9d2757b5-8933-4d44-bfa5-cb5054cd05c6 => generated 1274 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:10.620644 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-75f180c8-6ecc-4984-9c54-914ef21ebaf2 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:10.621263 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-75f180c8-6ecc-4984-9c54-914ef21ebaf2 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] [instance: e203a3bb-aff0-41d9-b8ba-750797cab055] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:10.629977 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-11f7a90b-06dc-45ce-b400-b6c2078eab85 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:10.643442 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-11f7a90b-06dc-45ce-b400-b6c2078eab85 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: 04e9b262-d9e0-434a-bcbb-a85ef9180ee9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:10.649641 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-75f180c8-6ecc-4984-9c54-914ef21ebaf2 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:10.653187 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-75f180c8-6ecc-4984-9c54-914ef21ebaf2 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:10.653187 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-75f180c8-6ecc-4984-9c54-914ef21ebaf2 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:10.653187 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-75f180c8-6ecc-4984-9c54-914ef21ebaf2 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:10.653187 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-75f180c8-6ecc-4984-9c54-914ef21ebaf2 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:10.653187 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-75f180c8-6ecc-4984-9c54-914ef21ebaf2 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:10.669457 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-11f7a90b-06dc-45ce-b400-b6c2078eab85 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:10.671196 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-11f7a90b-06dc-45ce-b400-b6c2078eab85 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:10.671650 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-11f7a90b-06dc-45ce-b400-b6c2078eab85 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:10.672367 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-11f7a90b-06dc-45ce-b400-b6c2078eab85 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:10.676527 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-11f7a90b-06dc-45ce-b400-b6c2078eab85 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:10.677259 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-11f7a90b-06dc-45ce-b400-b6c2078eab85 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:10.788557 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-11f7a90b-06dc-45ce-b400-b6c2078eab85 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.171008 Sep 23 04:38:10.789160 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 901/1852] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Sep 23 04:38:10 2022] GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9/os-volume_attachments => generated 25 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 04:38:10.805838 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-81d74456-2433-4f92-94d5-bd79baa937d8 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:10.806476 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-81d74456-2433-4f92-94d5-bd79baa937d8 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 13cee31b-8715-45f1-9aa7-37e885dcf785] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:10.823646 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-81d74456-2433-4f92-94d5-bd79baa937d8 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:10.824172 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-81d74456-2433-4f92-94d5-bd79baa937d8 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:10.824611 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-81d74456-2433-4f92-94d5-bd79baa937d8 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:10.825324 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-81d74456-2433-4f92-94d5-bd79baa937d8 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:10.835054 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-81d74456-2433-4f92-94d5-bd79baa937d8 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:10.835054 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-81d74456-2433-4f92-94d5-bd79baa937d8 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:10.999524 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-81d74456-2433-4f92-94d5-bd79baa937d8 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:11.007584 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-81d74456-2433-4f92-94d5-bd79baa937d8 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/13cee31b-8715-45f1-9aa7-37e885dcf785" status: 200 len: 1268 microversion: 2.1 time: 0.208914 Sep 23 04:38:11.008390 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 902/1853] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:10 2022] GET /compute/v2.1/servers/13cee31b-8715-45f1-9aa7-37e885dcf785 => generated 1268 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:11.013933 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-25ca4f3d-648b-4604-b278-38ab2ecab5c7 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:11.014763 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-25ca4f3d-648b-4604-b278-38ab2ecab5c7 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 205bf02b-1478-4765-b2a6-d7014d9f0a64] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:11.023351 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-75f180c8-6ecc-4984-9c54-914ef21ebaf2 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1244f3db540441a28d8413e510cfccad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b412c874d4e668b4a1a33dedb2c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:11.039468 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-25ca4f3d-648b-4604-b278-38ab2ecab5c7 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:11.039968 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-25ca4f3d-648b-4604-b278-38ab2ecab5c7 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:11.040407 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-25ca4f3d-648b-4604-b278-38ab2ecab5c7 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:11.041116 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-25ca4f3d-648b-4604-b278-38ab2ecab5c7 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:11.041316 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-75f180c8-6ecc-4984-9c54-914ef21ebaf2 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] 10.222.0.33 "GET /compute/v2.1/servers/e203a3bb-aff0-41d9-b8ba-750797cab055" status: 200 len: 1319 microversion: 2.1 time: 0.424412 Sep 23 04:38:11.041580 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-25ca4f3d-648b-4604-b278-38ab2ecab5c7 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:11.042022 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-25ca4f3d-648b-4604-b278-38ab2ecab5c7 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:11.047555 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 952/1854] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:10 2022] GET /compute/v2.1/servers/e203a3bb-aff0-41d9-b8ba-750797cab055 => generated 1319 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:11.077954 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-ce7ca7c4-ffa0-40ca-b53a-0b9e4d890088 req-0976f108-f7f1-4344-824b-a9bb26f6ab86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "205bf02b-1478-4765-b2a6-d7014d9f0a64", "name": "network-vif-deleted", "tag": "06cbe8b1-7ee2-495a-8e80-7976cf75b2c6"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:38:11.086578 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-25ca4f3d-648b-4604-b278-38ab2ecab5c7 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] HTTP exception thrown: Instance 205bf02b-1478-4765-b2a6-d7014d9f0a64 could not be found. Sep 23 04:38:11.096630 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-25ca4f3d-648b-4604-b278-38ab2ecab5c7 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Request method failure captured: Sep 23 04:38:11.096630 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/205bf02b-1478-4765-b2a6-d7014d9f0a64 HTTP/1.1 Sep 23 04:38:11.096630 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:38:11.096630 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:38:11.096630 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:38:11.096630 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:38:11.096630 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:38:11.096630 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:38:11.096630 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:38:11.096630 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:38:11.096630 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTaWXIXl3tR50j--lXaisfCvv96a-7yx5HAyhGUeC4fYQynUZPebyv8wFHzuAmaMbuHW8OYaivLn4U8NnQxMPu0yv189bThsscsy-IZHYf0cR3kfCKZke0BgT4gCn55jGv_RGgcBQZIrro9w30OswoUQBe63DbCzmjWipZnCAwKgjE4 Sep 23 04:38:11.096630 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:38:11.096630 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:38:11.096630 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:38:11.096630 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:38:11.096630 n-d-846463-3 devstack@n-api.service[122698]: X-Openstack-Nova-Api-Version: 2.25 Sep 23 04:38:11.096630 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:38:11.096630 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:38:11.096630 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 0abccbbae40b47968a8dda6323b618e3 Sep 23 04:38:11.096630 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1923115962 Sep 23 04:38:11.096630 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:38:11.096630 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:38:11.096630 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0abccbbae40b47968a8dda6323b618e3", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0abccbbae40b47968a8dda6323b618e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0abccbbae40b47968a8dda6323b618e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0abccbbae40b47968a8dda6323b618e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:38:11.096630 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1923115962 Sep 23 04:38:11.096630 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 0abccbbae40b47968a8dda6323b618e3 Sep 23 04:38:11.096630 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1923115962 Sep 23 04:38:11.096630 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-LiveAutoBlockMigrationV225Test-1923115962-project Sep 23 04:38:11.096630 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:38:11.096630 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:38:11.096630 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 84d0c7a6520443d896f88069e91a2eb2 Sep 23 04:38:11.096630 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1923115962-project Sep 23 04:38:11.096630 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:38:11.096630 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 205bf02b-1478-4765-b2a6-d7014d9f0a64 could not be found. Sep 23 04:38:11.096630 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '205bf02b-1478-4765-b2a6-d7014d9f0a64'} Sep 23 04:38:11.096630 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:38:11.096630 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:38:11.096630 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:38:11.096630 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:38:11.096630 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:38:11.096630 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:38:11.096630 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:38:11.096630 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:38:11.096630 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:38:11.096630 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:38:11.096630 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 205bf02b-1478-4765-b2a6-d7014d9f0a64 could not be found. Sep 23 04:38:11.096630 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:38:11.096630 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:38:11.096630 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:38:11.096630 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:38:11.096630 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:38:11.096630 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:38:11.096630 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:38:11.096630 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:38:11.096630 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:38:11.096630 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:38:11.096630 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:38:11.096630 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:38:11.096630 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:38:11.096630 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:38:11.096630 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:38:11.096630 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:38:11.096630 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 205bf02b-1478-4765-b2a6-d7014d9f0a64 could not be found. Sep 23 04:38:11.096630 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:38:11.101980 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:38:11.101980 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:38:11.101980 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:38:11.101980 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:38:11.101980 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:38:11.101980 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:38:11.101980 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:38:11.101980 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 205bf02b-1478-4765-b2a6-d7014d9f0a64 could not be found. Sep 23 04:38:11.101980 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:38:11.109084 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-25ca4f3d-648b-4604-b278-38ab2ecab5c7 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Returning 404 to user: Instance 205bf02b-1478-4765-b2a6-d7014d9f0a64 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:38:11.110233 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-25ca4f3d-648b-4604-b278-38ab2ecab5c7 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/205bf02b-1478-4765-b2a6-d7014d9f0a64" status: 404 len: 111 microversion: 2.25 time: 0.100754 Sep 23 04:38:11.110452 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-ce7ca7c4-ffa0-40ca-b53a-0b9e4d890088 req-0976f108-f7f1-4344-824b-a9bb26f6ab86 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:11.111785 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 903/1855] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:38:11 2022] GET /compute/v2.1/servers/205bf02b-1478-4765-b2a6-d7014d9f0a64 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 23 04:38:11.116466 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-ce7ca7c4-ffa0-40ca-b53a-0b9e4d890088 req-0976f108-f7f1-4344-824b-a9bb26f6ab86 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:11.119816 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-ce7ca7c4-ffa0-40ca-b53a-0b9e4d890088 req-0976f108-f7f1-4344-824b-a9bb26f6ab86 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:11.121501 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-fd944589-a495-40da-9fe7-2d295e95ff99 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '.version_select at 0x7ff1c3f013a0>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:11.166221 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-ce7ca7c4-ffa0-40ca-b53a-0b9e4d890088 req-0976f108-f7f1-4344-824b-a9bb26f6ab86 service nova] Creating event network-vif-deleted:06cbe8b1-7ee2-495a-8e80-7976cf75b2c6 for instance 205bf02b-1478-4765-b2a6-d7014d9f0a64 on n-h1-846463-3 Sep 23 04:38:11.176954 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-ce7ca7c4-ffa0-40ca-b53a-0b9e4d890088 req-0976f108-f7f1-4344-824b-a9bb26f6ab86 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125467 Sep 23 04:38:11.182970 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 953/1856] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:38:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:38:11.231902 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-370e0da6-7446-4772-81ae-a26107b61234 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:11.232608 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-370e0da6-7446-4772-81ae-a26107b61234 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] [instance: 53745879-9973-4217-b1c5-b45f917db80e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:11.249734 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-370e0da6-7446-4772-81ae-a26107b61234 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:11.250270 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-370e0da6-7446-4772-81ae-a26107b61234 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:11.250709 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-370e0da6-7446-4772-81ae-a26107b61234 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:11.251429 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-370e0da6-7446-4772-81ae-a26107b61234 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:11.251934 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-370e0da6-7446-4772-81ae-a26107b61234 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:11.252358 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-370e0da6-7446-4772-81ae-a26107b61234 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:11.285272 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-fd944589-a495-40da-9fe7-2d295e95ff99 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1397880170" status: 204 len: 0 microversion: 2.25 time: 0.165444 Sep 23 04:38:11.285272 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 904/1857] 10.222.0.33 () {60 vars in 1262 bytes} [Fri Sep 23 04:38:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1397880170 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 23 04:38:11.558740 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-370e0da6-7446-4772-81ae-a26107b61234 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:11.572077 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-370e0da6-7446-4772-81ae-a26107b61234 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:11.573868 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-370e0da6-7446-4772-81ae-a26107b61234 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:11.575489 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-370e0da6-7446-4772-81ae-a26107b61234 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] 10.222.0.33 "GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e" status: 200 len: 1885 microversion: 2.42 time: 0.347943 Sep 23 04:38:11.576964 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 954/1858] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:38:11 2022] GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e => generated 1885 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:38:11.624749 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3092f844-66e8-41e2-8192-2a730006331d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:11.626378 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3092f844-66e8-41e2-8192-2a730006331d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 9d2757b5-8933-4d44-bfa5-cb5054cd05c6] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:11.648129 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6b4f7c68-5c6d-42c3-9a38-73baf62d380f tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:11.649115 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-6b4f7c68-5c6d-42c3-9a38-73baf62d380f tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] [instance: 94fc4134-9b8e-4dcd-bd96-5545bfd51c97] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:11.655322 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3092f844-66e8-41e2-8192-2a730006331d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:11.658474 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3092f844-66e8-41e2-8192-2a730006331d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:11.659880 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3092f844-66e8-41e2-8192-2a730006331d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:11.664581 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6b4f7c68-5c6d-42c3-9a38-73baf62d380f tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:11.680004 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3092f844-66e8-41e2-8192-2a730006331d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:11.680840 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6b4f7c68-5c6d-42c3-9a38-73baf62d380f tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:11.683269 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3092f844-66e8-41e2-8192-2a730006331d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:11.683758 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3092f844-66e8-41e2-8192-2a730006331d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:11.684444 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6b4f7c68-5c6d-42c3-9a38-73baf62d380f tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:11.687356 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6b4f7c68-5c6d-42c3-9a38-73baf62d380f tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:11.691169 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6b4f7c68-5c6d-42c3-9a38-73baf62d380f tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:11.694711 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6b4f7c68-5c6d-42c3-9a38-73baf62d380f tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:11.894738 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-3092f844-66e8-41e2-8192-2a730006331d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:11.919235 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3092f844-66e8-41e2-8192-2a730006331d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/9d2757b5-8933-4d44-bfa5-cb5054cd05c6" status: 200 len: 1272 microversion: 2.1 time: 0.299340 Sep 23 04:38:11.921150 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 905/1859] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:11 2022] GET /compute/v2.1/servers/9d2757b5-8933-4d44-bfa5-cb5054cd05c6 => generated 1272 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:11.987700 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-6b4f7c68-5c6d-42c3-9a38-73baf62d380f tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:11.999147 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-6b4f7c68-5c6d-42c3-9a38-73baf62d380f tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:12.001245 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-6b4f7c68-5c6d-42c3-9a38-73baf62d380f tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:12.007928 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6b4f7c68-5c6d-42c3-9a38-73baf62d380f tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] 10.222.0.33 "GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97" status: 200 len: 1419 microversion: 2.75 time: 0.364253 Sep 23 04:38:12.008963 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 955/1860] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:38:11 2022] GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97 => generated 1419 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:38:12.055364 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a8d2d5b3-5d89-40ba-a200-64566298393d tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:12.058834 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a8d2d5b3-5d89-40ba-a200-64566298393d tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 13cee31b-8715-45f1-9aa7-37e885dcf785] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:12.085610 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a8d2d5b3-5d89-40ba-a200-64566298393d tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:12.090176 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a8d2d5b3-5d89-40ba-a200-64566298393d tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:12.090953 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a8d2d5b3-5d89-40ba-a200-64566298393d tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:12.091082 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-cd5ef242-b699-4bfc-aadf-0f060fd05533 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:12.092064 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a8d2d5b3-5d89-40ba-a200-64566298393d tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:12.092848 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-cd5ef242-b699-4bfc-aadf-0f060fd05533 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] [instance: e203a3bb-aff0-41d9-b8ba-750797cab055] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:12.093984 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a8d2d5b3-5d89-40ba-a200-64566298393d tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:12.096275 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a8d2d5b3-5d89-40ba-a200-64566298393d tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:12.110725 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cd5ef242-b699-4bfc-aadf-0f060fd05533 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:12.116991 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cd5ef242-b699-4bfc-aadf-0f060fd05533 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:12.116991 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cd5ef242-b699-4bfc-aadf-0f060fd05533 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:12.116991 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cd5ef242-b699-4bfc-aadf-0f060fd05533 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:12.116991 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cd5ef242-b699-4bfc-aadf-0f060fd05533 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:12.116991 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cd5ef242-b699-4bfc-aadf-0f060fd05533 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:12.209979 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a8d2d5b3-5d89-40ba-a200-64566298393d tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:12.229478 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a8d2d5b3-5d89-40ba-a200-64566298393d tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/13cee31b-8715-45f1-9aa7-37e885dcf785" status: 200 len: 1268 microversion: 2.1 time: 0.184956 Sep 23 04:38:12.259049 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 906/1861] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:12 2022] GET /compute/v2.1/servers/13cee31b-8715-45f1-9aa7-37e885dcf785 => generated 1268 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:12.272707 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-6281e691-66d2-4409-816e-a998f28c374d req-37d1a662-6dbc-45ae-8a7d-d3670df585ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e203a3bb-aff0-41d9-b8ba-750797cab055", "name": "network-vif-plugged", "status": "completed", "tag": "1c12120e-9187-4292-a89f-42ea15c1cbc3"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:38:12.296925 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-6281e691-66d2-4409-816e-a998f28c374d req-37d1a662-6dbc-45ae-8a7d-d3670df585ed service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:12.298959 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-6281e691-66d2-4409-816e-a998f28c374d req-37d1a662-6dbc-45ae-8a7d-d3670df585ed service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:12.299404 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-6281e691-66d2-4409-816e-a998f28c374d req-37d1a662-6dbc-45ae-8a7d-d3670df585ed service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:12.338877 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-6281e691-66d2-4409-816e-a998f28c374d req-37d1a662-6dbc-45ae-8a7d-d3670df585ed service nova] Creating event network-vif-plugged:1c12120e-9187-4292-a89f-42ea15c1cbc3 for instance e203a3bb-aff0-41d9-b8ba-750797cab055 on n-h2-846463-3 Sep 23 04:38:12.352323 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-6281e691-66d2-4409-816e-a998f28c374d req-37d1a662-6dbc-45ae-8a7d-d3670df585ed service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091022 Sep 23 04:38:12.353834 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 907/1862] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:38:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:38:12.607834 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8350ee49-6014-4a80-94e4-dd1a6be3eac4 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:12.608552 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8350ee49-6014-4a80-94e4-dd1a6be3eac4 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] [instance: 53745879-9973-4217-b1c5-b45f917db80e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:12.615884 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8350ee49-6014-4a80-94e4-dd1a6be3eac4 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:12.616386 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8350ee49-6014-4a80-94e4-dd1a6be3eac4 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:12.616831 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8350ee49-6014-4a80-94e4-dd1a6be3eac4 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:12.617555 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8350ee49-6014-4a80-94e4-dd1a6be3eac4 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:12.618108 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8350ee49-6014-4a80-94e4-dd1a6be3eac4 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:12.618548 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8350ee49-6014-4a80-94e4-dd1a6be3eac4 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:12.935345 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-cd5ef242-b699-4bfc-aadf-0f060fd05533 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1244f3db540441a28d8413e510cfccad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b412c874d4e668b4a1a33dedb2c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:12.949513 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-cd5ef242-b699-4bfc-aadf-0f060fd05533 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] 10.222.0.33 "GET /compute/v2.1/servers/e203a3bb-aff0-41d9-b8ba-750797cab055" status: 200 len: 1319 microversion: 2.1 time: 0.872818 Sep 23 04:38:12.969149 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 956/1863] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:12 2022] GET /compute/v2.1/servers/e203a3bb-aff0-41d9-b8ba-750797cab055 => generated 1319 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:12.976869 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d73fa79e-7b8e-4af4-bb6f-e7dea4983d7b tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:12.983797 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d73fa79e-7b8e-4af4-bb6f-e7dea4983d7b tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 9d2757b5-8933-4d44-bfa5-cb5054cd05c6] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:13.006398 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d73fa79e-7b8e-4af4-bb6f-e7dea4983d7b tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:13.010193 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d73fa79e-7b8e-4af4-bb6f-e7dea4983d7b tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:13.010847 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d73fa79e-7b8e-4af4-bb6f-e7dea4983d7b tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:13.019934 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d73fa79e-7b8e-4af4-bb6f-e7dea4983d7b tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:13.019934 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d73fa79e-7b8e-4af4-bb6f-e7dea4983d7b tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:13.019934 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d73fa79e-7b8e-4af4-bb6f-e7dea4983d7b tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:13.473234 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8350ee49-6014-4a80-94e4-dd1a6be3eac4 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:13.498642 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8350ee49-6014-4a80-94e4-dd1a6be3eac4 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:13.500741 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8350ee49-6014-4a80-94e4-dd1a6be3eac4 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:13.508782 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8350ee49-6014-4a80-94e4-dd1a6be3eac4 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] 10.222.0.33 "GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e" status: 200 len: 1885 microversion: 2.42 time: 0.905389 Sep 23 04:38:13.513033 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 908/1864] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:38:12 2022] GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e => generated 1885 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:38:13.528774 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3d1f4fd8-4894-4d09-be81-8392ee65360d tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:13.539129 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3d1f4fd8-4894-4d09-be81-8392ee65360d tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] [instance: 94fc4134-9b8e-4dcd-bd96-5545bfd51c97] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:13.553685 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3d1f4fd8-4894-4d09-be81-8392ee65360d tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:13.557843 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3d1f4fd8-4894-4d09-be81-8392ee65360d tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:13.558423 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3d1f4fd8-4894-4d09-be81-8392ee65360d tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:13.561433 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3d1f4fd8-4894-4d09-be81-8392ee65360d tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:13.562113 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3d1f4fd8-4894-4d09-be81-8392ee65360d tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:13.562593 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3d1f4fd8-4894-4d09-be81-8392ee65360d tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:13.577259 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=100 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:38:13.723745 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-3d1f4fd8-4894-4d09-be81-8392ee65360d tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:13.736953 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-3d1f4fd8-4894-4d09-be81-8392ee65360d tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:13.742138 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-3d1f4fd8-4894-4d09-be81-8392ee65360d tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:13.754699 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3d1f4fd8-4894-4d09-be81-8392ee65360d tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] 10.222.0.33 "GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97" status: 200 len: 1417 microversion: 2.75 time: 0.239923 Sep 23 04:38:13.755305 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 909/1865] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:38:13 2022] GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97 => generated 1417 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:38:13.759123 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d73fa79e-7b8e-4af4-bb6f-e7dea4983d7b tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:13.769705 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d73fa79e-7b8e-4af4-bb6f-e7dea4983d7b tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/9d2757b5-8933-4d44-bfa5-cb5054cd05c6" status: 200 len: 1314 microversion: 2.1 time: 0.799190 Sep 23 04:38:13.770607 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 957/1866] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:12 2022] GET /compute/v2.1/servers/9d2757b5-8933-4d44-bfa5-cb5054cd05c6 => generated 1314 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:13.780612 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b096b56a-3cce-4d6a-a9a0-8c7355151ee8 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:13.786332 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b096b56a-3cce-4d6a-a9a0-8c7355151ee8 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 9d255ae7-0aed-4692-8802-6733dfcccbd0] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:13.786614 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-35347714-0dc9-4899-9313-be3c1c74e601 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:13.786614 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-35347714-0dc9-4899-9313-be3c1c74e601 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 13cee31b-8715-45f1-9aa7-37e885dcf785] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:13.794964 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-35347714-0dc9-4899-9313-be3c1c74e601 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:13.795816 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-35347714-0dc9-4899-9313-be3c1c74e601 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:13.796441 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-35347714-0dc9-4899-9313-be3c1c74e601 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:13.797370 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-35347714-0dc9-4899-9313-be3c1c74e601 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:13.798004 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b096b56a-3cce-4d6a-a9a0-8c7355151ee8 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:13.798237 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-35347714-0dc9-4899-9313-be3c1c74e601 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:13.798881 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-35347714-0dc9-4899-9313-be3c1c74e601 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:13.803751 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b096b56a-3cce-4d6a-a9a0-8c7355151ee8 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:13.804960 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b096b56a-3cce-4d6a-a9a0-8c7355151ee8 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:13.806419 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b096b56a-3cce-4d6a-a9a0-8c7355151ee8 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:13.808243 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b096b56a-3cce-4d6a-a9a0-8c7355151ee8 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:13.808877 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b096b56a-3cce-4d6a-a9a0-8c7355151ee8 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:13.866279 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b096b56a-3cce-4d6a-a9a0-8c7355151ee8 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 9d255ae7-0aed-4692-8802-6733dfcccbd0] Going to try to terminate instance {{(pid=122699) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:38:13.930024 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-35347714-0dc9-4899-9313-be3c1c74e601 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:13.941544 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-35347714-0dc9-4899-9313-be3c1c74e601 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/13cee31b-8715-45f1-9aa7-37e885dcf785" status: 200 len: 1274 microversion: 2.1 time: 0.184480 Sep 23 04:38:13.942473 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 910/1867] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:13 2022] GET /compute/v2.1/servers/13cee31b-8715-45f1-9aa7-37e885dcf785 => generated 1274 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:13.976203 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a77d2815-ef60-4542-8f33-22b27b019026 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:13.976818 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a77d2815-ef60-4542-8f33-22b27b019026 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] [instance: e203a3bb-aff0-41d9-b8ba-750797cab055] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:13.983575 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a77d2815-ef60-4542-8f33-22b27b019026 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:13.984305 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a77d2815-ef60-4542-8f33-22b27b019026 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:13.988145 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a77d2815-ef60-4542-8f33-22b27b019026 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:13.988145 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a77d2815-ef60-4542-8f33-22b27b019026 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:13.988145 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a77d2815-ef60-4542-8f33-22b27b019026 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:13.988145 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a77d2815-ef60-4542-8f33-22b27b019026 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:14.238990 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a77d2815-ef60-4542-8f33-22b27b019026 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1244f3db540441a28d8413e510cfccad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b412c874d4e668b4a1a33dedb2c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:14.253964 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a77d2815-ef60-4542-8f33-22b27b019026 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] 10.222.0.33 "GET /compute/v2.1/servers/e203a3bb-aff0-41d9-b8ba-750797cab055" status: 200 len: 1319 microversion: 2.1 time: 0.281631 Sep 23 04:38:14.267786 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 911/1868] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:13 2022] GET /compute/v2.1/servers/e203a3bb-aff0-41d9-b8ba-750797cab055 => generated 1319 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:38:14.316342 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b096b56a-3cce-4d6a-a9a0-8c7355151ee8 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9d255ae7-0aed-4692-8802-6733dfcccbd0" status: 204 len: 0 microversion: 2.25 time: 0.544090 Sep 23 04:38:14.317506 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 958/1869] 10.222.0.33 () {60 vars in 1280 bytes} [Fri Sep 23 04:38:13 2022] DELETE /compute/v2.1/servers/9d255ae7-0aed-4692-8802-6733dfcccbd0 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 23 04:38:14.331361 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c5eb73c7-2ea0-44fd-8980-f1371f78c6fb tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:14.332141 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c5eb73c7-2ea0-44fd-8980-f1371f78c6fb tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 9d255ae7-0aed-4692-8802-6733dfcccbd0] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:14.339438 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c5eb73c7-2ea0-44fd-8980-f1371f78c6fb tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:14.339840 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c5eb73c7-2ea0-44fd-8980-f1371f78c6fb tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:14.340359 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c5eb73c7-2ea0-44fd-8980-f1371f78c6fb tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:14.341370 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c5eb73c7-2ea0-44fd-8980-f1371f78c6fb tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:14.343767 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c5eb73c7-2ea0-44fd-8980-f1371f78c6fb tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:14.344465 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c5eb73c7-2ea0-44fd-8980-f1371f78c6fb tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:14.542130 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5bf353c4-bb89-4e19-a709-b933cefa1d99 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:14.542967 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-5bf353c4-bb89-4e19-a709-b933cefa1d99 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] [instance: 53745879-9973-4217-b1c5-b45f917db80e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:14.561214 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5bf353c4-bb89-4e19-a709-b933cefa1d99 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:14.563761 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5bf353c4-bb89-4e19-a709-b933cefa1d99 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:14.565170 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5bf353c4-bb89-4e19-a709-b933cefa1d99 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:14.570308 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5bf353c4-bb89-4e19-a709-b933cefa1d99 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:14.571163 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5bf353c4-bb89-4e19-a709-b933cefa1d99 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:14.571874 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5bf353c4-bb89-4e19-a709-b933cefa1d99 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:14.582536 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c5eb73c7-2ea0-44fd-8980-f1371f78c6fb tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:14.620586 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c5eb73c7-2ea0-44fd-8980-f1371f78c6fb tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:14.630117 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c5eb73c7-2ea0-44fd-8980-f1371f78c6fb tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:14.633343 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c5eb73c7-2ea0-44fd-8980-f1371f78c6fb tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/9d255ae7-0aed-4692-8802-6733dfcccbd0" status: 200 len: 1550 microversion: 2.25 time: 0.307479 Sep 23 04:38:14.637928 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 912/1870] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:38:14 2022] GET /compute/v2.1/servers/9d255ae7-0aed-4692-8802-6733dfcccbd0 => generated 1550 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:38:14.794727 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-78e58911-c04e-49fb-b016-16ce1e82353a tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:14.795406 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-78e58911-c04e-49fb-b016-16ce1e82353a tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] [instance: 94fc4134-9b8e-4dcd-bd96-5545bfd51c97] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:14.803684 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-78e58911-c04e-49fb-b016-16ce1e82353a tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:14.804812 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-78e58911-c04e-49fb-b016-16ce1e82353a tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:14.805493 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-78e58911-c04e-49fb-b016-16ce1e82353a tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:14.806510 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-78e58911-c04e-49fb-b016-16ce1e82353a tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:14.807224 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-78e58911-c04e-49fb-b016-16ce1e82353a tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:14.807890 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-78e58911-c04e-49fb-b016-16ce1e82353a tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:14.943199 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-78e58911-c04e-49fb-b016-16ce1e82353a tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:14.957483 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-78e58911-c04e-49fb-b016-16ce1e82353a tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:14.960289 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-78e58911-c04e-49fb-b016-16ce1e82353a tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:14.978963 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-78e58911-c04e-49fb-b016-16ce1e82353a tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] 10.222.0.33 "GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97" status: 200 len: 1417 microversion: 2.75 time: 0.188692 Sep 23 04:38:14.993920 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 913/1871] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:38:14 2022] GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97 => generated 1417 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:38:14.994474 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a6e46fd8-8abb-4ace-87d0-340be3959461 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:14.994683 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a6e46fd8-8abb-4ace-87d0-340be3959461 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 9d2757b5-8933-4d44-bfa5-cb5054cd05c6] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:15.020949 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a6e46fd8-8abb-4ace-87d0-340be3959461 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:15.021595 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a6e46fd8-8abb-4ace-87d0-340be3959461 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:15.024272 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a6e46fd8-8abb-4ace-87d0-340be3959461 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:15.027017 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a6e46fd8-8abb-4ace-87d0-340be3959461 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:15.031032 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a6e46fd8-8abb-4ace-87d0-340be3959461 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:15.033480 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a6e46fd8-8abb-4ace-87d0-340be3959461 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:15.471860 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-5bf353c4-bb89-4e19-a709-b933cefa1d99 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:15.494411 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-5bf353c4-bb89-4e19-a709-b933cefa1d99 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:15.502838 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-5bf353c4-bb89-4e19-a709-b933cefa1d99 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:15.504855 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5bf353c4-bb89-4e19-a709-b933cefa1d99 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] 10.222.0.33 "GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e" status: 200 len: 1885 microversion: 2.42 time: 0.967584 Sep 23 04:38:15.524152 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 959/1872] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:38:14 2022] GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e => generated 1885 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:38:15.545594 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-54098cf0-a4e1-452c-9fde-6dbe3250b2d5 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:15.553698 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-54098cf0-a4e1-452c-9fde-6dbe3250b2d5 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 13cee31b-8715-45f1-9aa7-37e885dcf785] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:15.573808 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-54098cf0-a4e1-452c-9fde-6dbe3250b2d5 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:15.576292 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-54098cf0-a4e1-452c-9fde-6dbe3250b2d5 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:15.576292 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-54098cf0-a4e1-452c-9fde-6dbe3250b2d5 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:15.576292 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-54098cf0-a4e1-452c-9fde-6dbe3250b2d5 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:15.576292 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-54098cf0-a4e1-452c-9fde-6dbe3250b2d5 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:15.582763 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-54098cf0-a4e1-452c-9fde-6dbe3250b2d5 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:15.734049 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a6e46fd8-8abb-4ace-87d0-340be3959461 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:15.742834 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a6e46fd8-8abb-4ace-87d0-340be3959461 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/9d2757b5-8933-4d44-bfa5-cb5054cd05c6" status: 200 len: 1314 microversion: 2.1 time: 0.760749 Sep 23 04:38:15.750534 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 914/1873] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:14 2022] GET /compute/v2.1/servers/9d2757b5-8933-4d44-bfa5-cb5054cd05c6 => generated 1314 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:15.768109 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f5792e61-295e-4b93-b68f-5ae26d17cdfc tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:15.768774 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f5792e61-295e-4b93-b68f-5ae26d17cdfc tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] [instance: e203a3bb-aff0-41d9-b8ba-750797cab055] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:15.795900 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f5792e61-295e-4b93-b68f-5ae26d17cdfc tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:15.796418 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f5792e61-295e-4b93-b68f-5ae26d17cdfc tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:15.796864 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f5792e61-295e-4b93-b68f-5ae26d17cdfc tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:15.797593 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f5792e61-295e-4b93-b68f-5ae26d17cdfc tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:15.798082 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f5792e61-295e-4b93-b68f-5ae26d17cdfc tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:15.800062 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f5792e61-295e-4b93-b68f-5ae26d17cdfc tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:16.246177 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-54098cf0-a4e1-452c-9fde-6dbe3250b2d5 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:16.258198 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-54098cf0-a4e1-452c-9fde-6dbe3250b2d5 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/13cee31b-8715-45f1-9aa7-37e885dcf785" status: 200 len: 1316 microversion: 2.1 time: 0.726139 Sep 23 04:38:16.258804 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 960/1874] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:15 2022] GET /compute/v2.1/servers/13cee31b-8715-45f1-9aa7-37e885dcf785 => generated 1316 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:16.270796 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ea8811ab-cb35-430c-ba80-583fce7ce811 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:16.274495 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ea8811ab-cb35-430c-ba80-583fce7ce811 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 9d255ae7-0aed-4692-8802-6733dfcccbd0] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:16.279628 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f5792e61-295e-4b93-b68f-5ae26d17cdfc tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1244f3db540441a28d8413e510cfccad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b412c874d4e668b4a1a33dedb2c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:16.292443 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ea8811ab-cb35-430c-ba80-583fce7ce811 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:16.293025 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ea8811ab-cb35-430c-ba80-583fce7ce811 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:16.293466 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ea8811ab-cb35-430c-ba80-583fce7ce811 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:16.294316 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ea8811ab-cb35-430c-ba80-583fce7ce811 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:16.306721 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ea8811ab-cb35-430c-ba80-583fce7ce811 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:16.306895 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f5792e61-295e-4b93-b68f-5ae26d17cdfc tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] 10.222.0.33 "GET /compute/v2.1/servers/e203a3bb-aff0-41d9-b8ba-750797cab055" status: 200 len: 1510 microversion: 2.1 time: 0.542963 Sep 23 04:38:16.306998 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ea8811ab-cb35-430c-ba80-583fce7ce811 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:16.307103 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 915/1875] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:15 2022] GET /compute/v2.1/servers/e203a3bb-aff0-41d9-b8ba-750797cab055 => generated 1510 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:16.323815 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2b09186a-2b12-4f55-aab5-25f7ce87db7c tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:16.325099 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-2b09186a-2b12-4f55-aab5-25f7ce87db7c tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] [instance: 94fc4134-9b8e-4dcd-bd96-5545bfd51c97] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:16.351877 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2b09186a-2b12-4f55-aab5-25f7ce87db7c tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:16.354743 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2b09186a-2b12-4f55-aab5-25f7ce87db7c tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:16.355668 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2b09186a-2b12-4f55-aab5-25f7ce87db7c tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:16.359432 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2b09186a-2b12-4f55-aab5-25f7ce87db7c tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:16.360248 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2b09186a-2b12-4f55-aab5-25f7ce87db7c tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:16.361695 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2b09186a-2b12-4f55-aab5-25f7ce87db7c tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:16.496826 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=4 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:38:16.532966 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=12 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:38:16.558531 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-2b09186a-2b12-4f55-aab5-25f7ce87db7c tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:16.574773 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-2b09186a-2b12-4f55-aab5-25f7ce87db7c tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:16.582184 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-2b09186a-2b12-4f55-aab5-25f7ce87db7c tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:16.596274 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2b09186a-2b12-4f55-aab5-25f7ce87db7c tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] 10.222.0.33 "GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97" status: 200 len: 1438 microversion: 2.75 time: 0.276198 Sep 23 04:38:16.598856 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 916/1876] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:38:16 2022] GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97 => generated 1438 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:38:16.609302 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-05b3062a-478a-41bc-98cc-1bf6d8b7925a tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:16.611410 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-05b3062a-478a-41bc-98cc-1bf6d8b7925a tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] [instance: 7e90c852-5f27-4861-9b25-9ea1e475c0a9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:16.655381 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ea8811ab-cb35-430c-ba80-583fce7ce811 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:16.665039 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-05b3062a-478a-41bc-98cc-1bf6d8b7925a tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:16.668257 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-05b3062a-478a-41bc-98cc-1bf6d8b7925a tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:16.669102 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-05b3062a-478a-41bc-98cc-1bf6d8b7925a tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:16.670899 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-05b3062a-478a-41bc-98cc-1bf6d8b7925a tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:16.671096 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ea8811ab-cb35-430c-ba80-583fce7ce811 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:16.672616 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-05b3062a-478a-41bc-98cc-1bf6d8b7925a tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:16.674497 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-05b3062a-478a-41bc-98cc-1bf6d8b7925a tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:16.680387 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ea8811ab-cb35-430c-ba80-583fce7ce811 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:16.682895 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ea8811ab-cb35-430c-ba80-583fce7ce811 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/9d255ae7-0aed-4692-8802-6733dfcccbd0" status: 200 len: 1550 microversion: 2.25 time: 0.423137 Sep 23 04:38:16.696773 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 961/1877] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:38:16 2022] GET /compute/v2.1/servers/9d255ae7-0aed-4692-8802-6733dfcccbd0 => generated 1550 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:38:16.708549 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-492afbec-f442-4a16-9c8a-6f0f6ffe2dda tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:16.710815 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-492afbec-f442-4a16-9c8a-6f0f6ffe2dda tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] [instance: 53745879-9973-4217-b1c5-b45f917db80e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:16.746613 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-492afbec-f442-4a16-9c8a-6f0f6ffe2dda tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:16.747511 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-492afbec-f442-4a16-9c8a-6f0f6ffe2dda tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:16.749098 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-492afbec-f442-4a16-9c8a-6f0f6ffe2dda tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:16.750767 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-492afbec-f442-4a16-9c8a-6f0f6ffe2dda tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:16.754786 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-492afbec-f442-4a16-9c8a-6f0f6ffe2dda tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:16.758133 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-492afbec-f442-4a16-9c8a-6f0f6ffe2dda tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:17.300248 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-05b3062a-478a-41bc-98cc-1bf6d8b7925a tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1244f3db540441a28d8413e510cfccad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b412c874d4e668b4a1a33dedb2c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:17.312176 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-05b3062a-478a-41bc-98cc-1bf6d8b7925a tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] 10.222.0.33 "GET /compute/v2.1/servers/7e90c852-5f27-4861-9b25-9ea1e475c0a9" status: 200 len: 1512 microversion: 2.1 time: 0.711202 Sep 23 04:38:17.312797 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 917/1878] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:16 2022] GET /compute/v2.1/servers/7e90c852-5f27-4861-9b25-9ea1e475c0a9 => generated 1512 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:17.324862 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6256080a-3607-4c6b-9efa-c86e6377c82b tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:38:17.331784 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-6256080a-3607-4c6b-9efa-c86e6377c82b tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] [instance: 94fc4134-9b8e-4dcd-bd96-5545bfd51c97] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:17.347212 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-492afbec-f442-4a16-9c8a-6f0f6ffe2dda tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:17.348986 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6256080a-3607-4c6b-9efa-c86e6377c82b tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:17.349495 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6256080a-3607-4c6b-9efa-c86e6377c82b tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:17.350116 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6256080a-3607-4c6b-9efa-c86e6377c82b tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:17.350822 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6256080a-3607-4c6b-9efa-c86e6377c82b tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:17.351287 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6256080a-3607-4c6b-9efa-c86e6377c82b tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:17.351725 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6256080a-3607-4c6b-9efa-c86e6377c82b tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:17.359662 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-492afbec-f442-4a16-9c8a-6f0f6ffe2dda tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:17.361611 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-492afbec-f442-4a16-9c8a-6f0f6ffe2dda tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:17.365789 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-492afbec-f442-4a16-9c8a-6f0f6ffe2dda tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] 10.222.0.33 "GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e" status: 200 len: 1885 microversion: 2.42 time: 0.665296 Sep 23 04:38:17.365789 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 962/1879] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:38:16 2022] GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e => generated 1885 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:38:17.388930 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-01979f8d-df7e-41fb-876e-3676c848e9de tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:17.390288 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-01979f8d-df7e-41fb-876e-3676c848e9de tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 9d2757b5-8933-4d44-bfa5-cb5054cd05c6] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:17.399115 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-01979f8d-df7e-41fb-876e-3676c848e9de tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:17.399812 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-01979f8d-df7e-41fb-876e-3676c848e9de tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:17.400363 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-01979f8d-df7e-41fb-876e-3676c848e9de tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:17.401582 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-01979f8d-df7e-41fb-876e-3676c848e9de tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:17.402206 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-01979f8d-df7e-41fb-876e-3676c848e9de tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:17.403157 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-01979f8d-df7e-41fb-876e-3676c848e9de tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:17.424022 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:38:17.479295 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-6256080a-3607-4c6b-9efa-c86e6377c82b tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Flavor limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:38:17.480437 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-6256080a-3607-4c6b-9efa-c86e6377c82b tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Image limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:38:17.483089 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-6256080a-3607-4c6b-9efa-c86e6377c82b tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Flavor pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:38:17.484438 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-6256080a-3607-4c6b-9efa-c86e6377c82b tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Image pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:38:17.485209 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-6256080a-3607-4c6b-9efa-c86e6377c82b tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:38:17.629149 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-01979f8d-df7e-41fb-876e-3676c848e9de tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:17.638230 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-01979f8d-df7e-41fb-876e-3676c848e9de tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/9d2757b5-8933-4d44-bfa5-cb5054cd05c6" status: 200 len: 1314 microversion: 2.1 time: 0.254047 Sep 23 04:38:17.639116 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 963/1880] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:17 2022] GET /compute/v2.1/servers/9d2757b5-8933-4d44-bfa5-cb5054cd05c6 => generated 1314 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:17.654818 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-70e88cc7-f108-4eb5-9355-8bf20108b590 req-0d32f88f-83b0-4d24-a1c4-8038c41fb481 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d255ae7-0aed-4692-8802-6733dfcccbd0", "name": "network-vif-deleted", "tag": "76c7663b-b181-4528-b671-a0840df053e8"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:38:17.678170 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-70e88cc7-f108-4eb5-9355-8bf20108b590 req-0d32f88f-83b0-4d24-a1c4-8038c41fb481 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:17.680792 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-70e88cc7-f108-4eb5-9355-8bf20108b590 req-0d32f88f-83b0-4d24-a1c4-8038c41fb481 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:17.681577 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-70e88cc7-f108-4eb5-9355-8bf20108b590 req-0d32f88f-83b0-4d24-a1c4-8038c41fb481 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:17.733798 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-70e88cc7-f108-4eb5-9355-8bf20108b590 req-0d32f88f-83b0-4d24-a1c4-8038c41fb481 service nova] Creating event network-vif-deleted:76c7663b-b181-4528-b671-a0840df053e8 for instance 9d255ae7-0aed-4692-8802-6733dfcccbd0 on n-h1-846463-3 Sep 23 04:38:17.745926 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-70e88cc7-f108-4eb5-9355-8bf20108b590 req-0d32f88f-83b0-4d24-a1c4-8038c41fb481 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102855 Sep 23 04:38:17.748653 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 964/1881] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:38:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:38:17.762410 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-367ab736-5f7b-470a-9e2f-d41ebaf29988 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:17.763720 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-367ab736-5f7b-470a-9e2f-d41ebaf29988 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 13cee31b-8715-45f1-9aa7-37e885dcf785] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:17.783579 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-367ab736-5f7b-470a-9e2f-d41ebaf29988 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:17.784563 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-367ab736-5f7b-470a-9e2f-d41ebaf29988 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:17.791597 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-367ab736-5f7b-470a-9e2f-d41ebaf29988 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:17.791597 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-367ab736-5f7b-470a-9e2f-d41ebaf29988 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:17.791597 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-367ab736-5f7b-470a-9e2f-d41ebaf29988 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:17.791597 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-367ab736-5f7b-470a-9e2f-d41ebaf29988 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:17.831079 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-6256080a-3607-4c6b-9efa-c86e6377c82b tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] [instance: 94fc4134-9b8e-4dcd-bd96-5545bfd51c97] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:17.851796 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6256080a-3607-4c6b-9efa-c86e6377c82b tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:17.852683 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6256080a-3607-4c6b-9efa-c86e6377c82b tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:17.854218 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6256080a-3607-4c6b-9efa-c86e6377c82b tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:17.856066 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6256080a-3607-4c6b-9efa-c86e6377c82b tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:17.857222 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6256080a-3607-4c6b-9efa-c86e6377c82b tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:17.857837 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6256080a-3607-4c6b-9efa-c86e6377c82b tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:18.015993 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6256080a-3607-4c6b-9efa-c86e6377c82b tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:18.054108 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6256080a-3607-4c6b-9efa-c86e6377c82b tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:18.058719 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6256080a-3607-4c6b-9efa-c86e6377c82b tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:18.075175 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-6256080a-3607-4c6b-9efa-c86e6377c82b tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] 10.222.0.33 "POST /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97/action" status: 202 len: 1495 microversion: 2.75 time: 0.761347 Sep 23 04:38:18.078479 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 918/1882] 10.222.0.33 () {62 vars in 1319 bytes} [Fri Sep 23 04:38:17 2022] POST /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97/action => generated 1495 bytes in 765 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Sep 23 04:38:18.086576 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-367ab736-5f7b-470a-9e2f-d41ebaf29988 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:18.094349 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ce6899d8-2bc5-4ef1-b587-0163a7afa191 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:18.095104 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-ce6899d8-2bc5-4ef1-b587-0163a7afa191 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] [instance: 94e8c141-ef33-4bb2-929f-7f7d0d10ff2c] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:18.096297 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-367ab736-5f7b-470a-9e2f-d41ebaf29988 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/13cee31b-8715-45f1-9aa7-37e885dcf785" status: 200 len: 1316 microversion: 2.1 time: 0.345265 Sep 23 04:38:18.098565 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 965/1883] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:17 2022] GET /compute/v2.1/servers/13cee31b-8715-45f1-9aa7-37e885dcf785 => generated 1316 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:18.110368 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-6eac50d6-3278-4da6-8bea-7b135f834bc0 req-e3220434-211f-457e-80ab-2e85e3d54897 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d2757b5-8933-4d44-bfa5-cb5054cd05c6", "tag": "c40cf720-53d3-445c-8509-cb2614d8aa78"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:38:18.113037 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ce6899d8-2bc5-4ef1-b587-0163a7afa191 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:18.113875 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ce6899d8-2bc5-4ef1-b587-0163a7afa191 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:18.114503 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ce6899d8-2bc5-4ef1-b587-0163a7afa191 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:18.115410 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ce6899d8-2bc5-4ef1-b587-0163a7afa191 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:18.115881 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ce6899d8-2bc5-4ef1-b587-0163a7afa191 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:18.116314 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ce6899d8-2bc5-4ef1-b587-0163a7afa191 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:18.145187 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-6eac50d6-3278-4da6-8bea-7b135f834bc0 req-e3220434-211f-457e-80ab-2e85e3d54897 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:18.166708 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-6eac50d6-3278-4da6-8bea-7b135f834bc0 req-e3220434-211f-457e-80ab-2e85e3d54897 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:18.170584 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-6eac50d6-3278-4da6-8bea-7b135f834bc0 req-e3220434-211f-457e-80ab-2e85e3d54897 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:18.227996 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-6eac50d6-3278-4da6-8bea-7b135f834bc0 req-e3220434-211f-457e-80ab-2e85e3d54897 service nova] Creating event network-changed:c40cf720-53d3-445c-8509-cb2614d8aa78 for instance 9d2757b5-8933-4d44-bfa5-cb5054cd05c6 on n-h2-846463-3 Sep 23 04:38:18.241982 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-6eac50d6-3278-4da6-8bea-7b135f834bc0 req-e3220434-211f-457e-80ab-2e85e3d54897 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141341 Sep 23 04:38:18.242215 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 966/1884] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:38:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:38:18.249146 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2e8a3abe-63fa-4001-941f-e7fec324474d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:18.249856 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-2e8a3abe-63fa-4001-941f-e7fec324474d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 9d255ae7-0aed-4692-8802-6733dfcccbd0] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:18.269012 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2e8a3abe-63fa-4001-941f-e7fec324474d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:18.274598 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2e8a3abe-63fa-4001-941f-e7fec324474d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:18.275068 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2e8a3abe-63fa-4001-941f-e7fec324474d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:18.275825 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2e8a3abe-63fa-4001-941f-e7fec324474d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:18.276299 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2e8a3abe-63fa-4001-941f-e7fec324474d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:18.276739 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2e8a3abe-63fa-4001-941f-e7fec324474d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:18.299882 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:38:18.353854 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2e8a3abe-63fa-4001-941f-e7fec324474d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:18.358661 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2e8a3abe-63fa-4001-941f-e7fec324474d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:18.359874 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2e8a3abe-63fa-4001-941f-e7fec324474d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:18.370113 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-2e8a3abe-63fa-4001-941f-e7fec324474d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lazy-loading 'fault' on Instance uuid 9d255ae7-0aed-4692-8802-6733dfcccbd0 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:38:18.407158 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ce6899d8-2bc5-4ef1-b587-0163a7afa191 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1244f3db540441a28d8413e510cfccad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b412c874d4e668b4a1a33dedb2c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:18.417426 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ce6899d8-2bc5-4ef1-b587-0163a7afa191 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] 10.222.0.33 "GET /compute/v2.1/servers/94e8c141-ef33-4bb2-929f-7f7d0d10ff2c" status: 200 len: 1512 microversion: 2.1 time: 0.337720 Sep 23 04:38:18.418680 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 919/1885] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:18 2022] GET /compute/v2.1/servers/94e8c141-ef33-4bb2-929f-7f7d0d10ff2c => generated 1512 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:18.434023 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-02dbfac4-745a-4354-8f7b-530fa7cd490b tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:18.434023 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-02dbfac4-745a-4354-8f7b-530fa7cd490b tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] [instance: 94fc4134-9b8e-4dcd-bd96-5545bfd51c97] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:18.444520 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=10 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:38:18.455977 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-02dbfac4-745a-4354-8f7b-530fa7cd490b tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:18.456519 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-02dbfac4-745a-4354-8f7b-530fa7cd490b tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:18.456981 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-02dbfac4-745a-4354-8f7b-530fa7cd490b tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:18.460503 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-02dbfac4-745a-4354-8f7b-530fa7cd490b tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:18.460503 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-02dbfac4-745a-4354-8f7b-530fa7cd490b tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:18.460503 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-02dbfac4-745a-4354-8f7b-530fa7cd490b tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:18.501495 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2e8a3abe-63fa-4001-941f-e7fec324474d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:18.514167 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2e8a3abe-63fa-4001-941f-e7fec324474d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:18.516803 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2e8a3abe-63fa-4001-941f-e7fec324474d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:18.518363 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2e8a3abe-63fa-4001-941f-e7fec324474d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/9d255ae7-0aed-4692-8802-6733dfcccbd0" status: 200 len: 1352 microversion: 2.25 time: 0.274667 Sep 23 04:38:18.519025 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 967/1886] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:38:18 2022] GET /compute/v2.1/servers/9d255ae7-0aed-4692-8802-6733dfcccbd0 => generated 1352 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:38:18.524556 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-67d94705-0c62-4b18-9334-ea794c0ef487 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:18.542063 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-67d94705-0c62-4b18-9334-ea794c0ef487 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] [instance: 53745879-9973-4217-b1c5-b45f917db80e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:18.542063 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-67d94705-0c62-4b18-9334-ea794c0ef487 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:18.542063 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-67d94705-0c62-4b18-9334-ea794c0ef487 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:18.542063 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-67d94705-0c62-4b18-9334-ea794c0ef487 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:18.542063 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-67d94705-0c62-4b18-9334-ea794c0ef487 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:18.542063 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-67d94705-0c62-4b18-9334-ea794c0ef487 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:18.542063 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-67d94705-0c62-4b18-9334-ea794c0ef487 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:18.559132 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-02dbfac4-745a-4354-8f7b-530fa7cd490b tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:18.596219 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-02dbfac4-745a-4354-8f7b-530fa7cd490b tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:18.597809 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-02dbfac4-745a-4354-8f7b-530fa7cd490b tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:18.604794 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-02dbfac4-745a-4354-8f7b-530fa7cd490b tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] 10.222.0.33 "GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97" status: 200 len: 1447 microversion: 2.75 time: 0.185010 Sep 23 04:38:18.607946 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 920/1887] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:38:18 2022] GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97 => generated 1447 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:38:18.610511 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b6bc26e2-cafc-4747-bfc2-bccb344cd392 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:18.617083 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b6bc26e2-cafc-4747-bfc2-bccb344cd392 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1244f3db540441a28d8413e510cfccad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b412c874d4e668b4a1a33dedb2c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:18.617987 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b6bc26e2-cafc-4747-bfc2-bccb344cd392 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '721b412c874d4e668b4a1a33dedb2c9b'} {{(pid=122698) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 04:38:18.667136 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b6bc26e2-cafc-4747-bfc2-bccb344cd392 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:18.667648 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b6bc26e2-cafc-4747-bfc2-bccb344cd392 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:18.668099 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b6bc26e2-cafc-4747-bfc2-bccb344cd392 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:18.671464 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b6bc26e2-cafc-4747-bfc2-bccb344cd392 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:18.671942 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b6bc26e2-cafc-4747-bfc2-bccb344cd392 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:18.672383 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b6bc26e2-cafc-4747-bfc2-bccb344cd392 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:18.822893 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-67d94705-0c62-4b18-9334-ea794c0ef487 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:18.839721 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.multi_cell_list [None req-b6bc26e2-cafc-4747-bfc2-bccb344cd392 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122698) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 23 04:38:18.841338 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-67d94705-0c62-4b18-9334-ea794c0ef487 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:18.843049 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-67d94705-0c62-4b18-9334-ea794c0ef487 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:18.858771 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-67d94705-0c62-4b18-9334-ea794c0ef487 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] 10.222.0.33 "GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e" status: 200 len: 1885 microversion: 2.42 time: 0.337861 Sep 23 04:38:18.878431 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 968/1888] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:38:18 2022] GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e => generated 1885 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:38:18.878431 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-34295a85-0f01-4802-bf5f-f824c161b021 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:18.878431 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-34295a85-0f01-4802-bf5f-f824c161b021 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 9d2757b5-8933-4d44-bfa5-cb5054cd05c6] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:18.890973 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-34295a85-0f01-4802-bf5f-f824c161b021 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:18.892564 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-34295a85-0f01-4802-bf5f-f824c161b021 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:18.892564 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-34295a85-0f01-4802-bf5f-f824c161b021 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:18.893411 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-34295a85-0f01-4802-bf5f-f824c161b021 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:18.894264 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-34295a85-0f01-4802-bf5f-f824c161b021 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:18.895209 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-34295a85-0f01-4802-bf5f-f824c161b021 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:19.005836 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b6bc26e2-cafc-4747-bfc2-bccb344cd392 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1244f3db540441a28d8413e510cfccad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b412c874d4e668b4a1a33dedb2c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:19.023301 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b6bc26e2-cafc-4747-bfc2-bccb344cd392 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:19.023852 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b6bc26e2-cafc-4747-bfc2-bccb344cd392 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:19.024510 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b6bc26e2-cafc-4747-bfc2-bccb344cd392 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:19.223354 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-34295a85-0f01-4802-bf5f-f824c161b021 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:19.225587 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b6bc26e2-cafc-4747-bfc2-bccb344cd392 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] 10.222.0.33 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1513 microversion: 2.1 time: 0.616945 Sep 23 04:38:19.228155 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 921/1889] 10.222.0.33 () {58 vars in 1167 bytes} [Fri Sep 23 04:38:18 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1513 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:19.235666 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-306931b5-b44b-41a9-83d2-00146302bf7c tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:19.237313 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-306931b5-b44b-41a9-83d2-00146302bf7c tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 13cee31b-8715-45f1-9aa7-37e885dcf785] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:19.254494 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-34295a85-0f01-4802-bf5f-f824c161b021 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/9d2757b5-8933-4d44-bfa5-cb5054cd05c6" status: 200 len: 1314 microversion: 2.1 time: 0.390352 Sep 23 04:38:19.255084 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 969/1890] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:18 2022] GET /compute/v2.1/servers/9d2757b5-8933-4d44-bfa5-cb5054cd05c6 => generated 1314 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:19.260430 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7e83e152-50d3-4e8b-938a-d2b31688855d tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:19.266458 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-7e83e152-50d3-4e8b-938a-d2b31688855d tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1244f3db540441a28d8413e510cfccad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b412c874d4e668b4a1a33dedb2c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:19.268099 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-7e83e152-50d3-4e8b-938a-d2b31688855d tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1612956669', 'deleted': False, 'project_id': '721b412c874d4e668b4a1a33dedb2c9b'} {{(pid=122699) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 04:38:19.275174 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7e83e152-50d3-4e8b-938a-d2b31688855d tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:19.275894 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7e83e152-50d3-4e8b-938a-d2b31688855d tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:19.276323 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7e83e152-50d3-4e8b-938a-d2b31688855d tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:19.280792 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7e83e152-50d3-4e8b-938a-d2b31688855d tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:19.280792 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7e83e152-50d3-4e8b-938a-d2b31688855d tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:19.280792 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7e83e152-50d3-4e8b-938a-d2b31688855d tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:19.304428 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-306931b5-b44b-41a9-83d2-00146302bf7c tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:19.306531 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-306931b5-b44b-41a9-83d2-00146302bf7c tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:19.307075 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-306931b5-b44b-41a9-83d2-00146302bf7c tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:19.311585 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-306931b5-b44b-41a9-83d2-00146302bf7c tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:19.311585 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-306931b5-b44b-41a9-83d2-00146302bf7c tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:19.311585 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-306931b5-b44b-41a9-83d2-00146302bf7c tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:19.371677 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.multi_cell_list [None req-7e83e152-50d3-4e8b-938a-d2b31688855d tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122699) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 23 04:38:19.459488 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-7e83e152-50d3-4e8b-938a-d2b31688855d tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1244f3db540441a28d8413e510cfccad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b412c874d4e668b4a1a33dedb2c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:19.465277 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:38:19.467608 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7e83e152-50d3-4e8b-938a-d2b31688855d tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:19.468167 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7e83e152-50d3-4e8b-938a-d2b31688855d tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:19.468809 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7e83e152-50d3-4e8b-938a-d2b31688855d tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:19.495479 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-306931b5-b44b-41a9-83d2-00146302bf7c tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:19.501262 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:38:19.506160 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-306931b5-b44b-41a9-83d2-00146302bf7c tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/13cee31b-8715-45f1-9aa7-37e885dcf785" status: 200 len: 1316 microversion: 2.1 time: 0.276121 Sep 23 04:38:19.508203 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 922/1891] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:19 2022] GET /compute/v2.1/servers/13cee31b-8715-45f1-9aa7-37e885dcf785 => generated 1316 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:19.558250 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b3ddbaca-c236-4235-b2e5-869beb410ece tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:19.560034 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b3ddbaca-c236-4235-b2e5-869beb410ece tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: 9d255ae7-0aed-4692-8802-6733dfcccbd0] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:19.577030 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b3ddbaca-c236-4235-b2e5-869beb410ece tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:19.578178 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b3ddbaca-c236-4235-b2e5-869beb410ece tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:19.580832 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b3ddbaca-c236-4235-b2e5-869beb410ece tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:19.582607 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b3ddbaca-c236-4235-b2e5-869beb410ece tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:19.583511 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b3ddbaca-c236-4235-b2e5-869beb410ece tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:19.585135 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b3ddbaca-c236-4235-b2e5-869beb410ece tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:19.614234 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-b3ddbaca-c236-4235-b2e5-869beb410ece tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] HTTP exception thrown: Instance 9d255ae7-0aed-4692-8802-6733dfcccbd0 could not be found. Sep 23 04:38:19.616172 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b3ddbaca-c236-4235-b2e5-869beb410ece tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Request method failure captured: Sep 23 04:38:19.616172 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/9d255ae7-0aed-4692-8802-6733dfcccbd0 HTTP/1.1 Sep 23 04:38:19.616172 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:38:19.616172 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:38:19.616172 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:38:19.616172 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:38:19.616172 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:38:19.616172 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:38:19.616172 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:38:19.616172 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:38:19.616172 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTaWXIXl3tR50j--lXaisfCvv96a-7yx5HAyhGUeC4fYQynUZPebyv8wFHzuAmaMbuHW8OYaivLn4U8NnQxMPu0yv189bThsscsy-IZHYf0cR3kfCKZke0BgT4gCn55jGv_RGgcBQZIrro9w30OswoUQBe63DbCzmjWipZnCAwKgjE4 Sep 23 04:38:19.616172 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:38:19.616172 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:38:19.616172 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:38:19.616172 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:38:19.616172 n-d-846463-3 devstack@n-api.service[122698]: X-Openstack-Nova-Api-Version: 2.25 Sep 23 04:38:19.616172 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:38:19.616172 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:38:19.616172 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 0abccbbae40b47968a8dda6323b618e3 Sep 23 04:38:19.616172 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1923115962 Sep 23 04:38:19.616172 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:38:19.616172 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:38:19.616172 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0abccbbae40b47968a8dda6323b618e3", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0abccbbae40b47968a8dda6323b618e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0abccbbae40b47968a8dda6323b618e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0abccbbae40b47968a8dda6323b618e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:38:19.616172 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1923115962 Sep 23 04:38:19.616172 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 0abccbbae40b47968a8dda6323b618e3 Sep 23 04:38:19.616172 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1923115962 Sep 23 04:38:19.616172 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-LiveAutoBlockMigrationV225Test-1923115962-project Sep 23 04:38:19.616172 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:38:19.616172 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:38:19.616172 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 84d0c7a6520443d896f88069e91a2eb2 Sep 23 04:38:19.616172 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1923115962-project Sep 23 04:38:19.616172 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:38:19.616172 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 9d255ae7-0aed-4692-8802-6733dfcccbd0 could not be found. Sep 23 04:38:19.616172 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '9d255ae7-0aed-4692-8802-6733dfcccbd0'} Sep 23 04:38:19.616172 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:38:19.616172 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:38:19.616172 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:38:19.616172 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:38:19.616172 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:38:19.616172 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:38:19.616172 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:38:19.616172 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:38:19.616172 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:38:19.616172 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:38:19.616172 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d255ae7-0aed-4692-8802-6733dfcccbd0 could not be found. Sep 23 04:38:19.616172 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:38:19.616172 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:38:19.616172 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:38:19.616172 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:38:19.616172 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:38:19.616172 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:38:19.616172 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:38:19.616172 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:38:19.616172 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:38:19.616172 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:38:19.616172 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:38:19.616172 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:38:19.616172 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:38:19.616172 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:38:19.616172 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:38:19.616172 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:38:19.616172 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d255ae7-0aed-4692-8802-6733dfcccbd0 could not be found. Sep 23 04:38:19.616172 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:38:19.621061 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:38:19.621061 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:38:19.621061 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:38:19.621061 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:38:19.621061 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:38:19.621061 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:38:19.621061 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:38:19.621061 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d255ae7-0aed-4692-8802-6733dfcccbd0 could not be found. Sep 23 04:38:19.621061 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:38:19.621061 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b3ddbaca-c236-4235-b2e5-869beb410ece tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Returning 404 to user: Instance 9d255ae7-0aed-4692-8802-6733dfcccbd0 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:38:19.621061 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b3ddbaca-c236-4235-b2e5-869beb410ece tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/9d255ae7-0aed-4692-8802-6733dfcccbd0" status: 404 len: 111 microversion: 2.25 time: 0.072907 Sep 23 04:38:19.621061 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 923/1892] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:38:19 2022] GET /compute/v2.1/servers/9d255ae7-0aed-4692-8802-6733dfcccbd0 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 23 04:38:19.626890 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2216f2e1-f095-408d-a62d-fe7d7407282d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:19.627394 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-2216f2e1-f095-408d-a62d-fe7d7407282d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: bbf05a2b-af42-4f14-8956-4f6249c46974] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:19.637952 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2216f2e1-f095-408d-a62d-fe7d7407282d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:19.637952 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2216f2e1-f095-408d-a62d-fe7d7407282d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:19.637952 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2216f2e1-f095-408d-a62d-fe7d7407282d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:19.638394 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2216f2e1-f095-408d-a62d-fe7d7407282d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:19.638854 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2216f2e1-f095-408d-a62d-fe7d7407282d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:19.639282 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2216f2e1-f095-408d-a62d-fe7d7407282d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:19.649161 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-7e83e152-50d3-4e8b-938a-d2b31688855d tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] 10.222.0.33 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1612956669" status: 200 len: 1515 microversion: 2.1 time: 0.392791 Sep 23 04:38:19.650370 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 970/1893] 10.222.0.33 () {58 vars in 1263 bytes} [Fri Sep 23 04:38:19 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1612956669 => generated 1515 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:19.655407 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5b32fe2b-4627-412a-b869-9ece474dba09 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:19.656379 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-5b32fe2b-4627-412a-b869-9ece474dba09 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] [instance: 94fc4134-9b8e-4dcd-bd96-5545bfd51c97] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:19.665009 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5b32fe2b-4627-412a-b869-9ece474dba09 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:19.665751 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5b32fe2b-4627-412a-b869-9ece474dba09 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:19.666690 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5b32fe2b-4627-412a-b869-9ece474dba09 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:19.667612 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5b32fe2b-4627-412a-b869-9ece474dba09 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:19.668483 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5b32fe2b-4627-412a-b869-9ece474dba09 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:19.669121 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5b32fe2b-4627-412a-b869-9ece474dba09 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:19.673638 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-2216f2e1-f095-408d-a62d-fe7d7407282d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: bbf05a2b-af42-4f14-8956-4f6249c46974] Going to try to terminate instance {{(pid=122698) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:38:19.740934 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-5b32fe2b-4627-412a-b869-9ece474dba09 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:19.749617 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-5b32fe2b-4627-412a-b869-9ece474dba09 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:19.751474 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-5b32fe2b-4627-412a-b869-9ece474dba09 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:19.757208 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5b32fe2b-4627-412a-b869-9ece474dba09 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] 10.222.0.33 "GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97" status: 200 len: 1447 microversion: 2.75 time: 0.105590 Sep 23 04:38:19.757762 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 971/1894] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:38:19 2022] GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97 => generated 1447 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:38:19.762817 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ff9860c9-567f-424a-8dac-39f21c8a232d tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:19.768741 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ff9860c9-567f-424a-8dac-39f21c8a232d tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1244f3db540441a28d8413e510cfccad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b412c874d4e668b4a1a33dedb2c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:19.769555 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ff9860c9-567f-424a-8dac-39f21c8a232d tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '721b412c874d4e668b4a1a33dedb2c9b'} {{(pid=122699) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 04:38:19.774763 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ff9860c9-567f-424a-8dac-39f21c8a232d tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:19.775250 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ff9860c9-567f-424a-8dac-39f21c8a232d tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:19.775688 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ff9860c9-567f-424a-8dac-39f21c8a232d tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:19.776661 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ff9860c9-567f-424a-8dac-39f21c8a232d tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:19.777009 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ff9860c9-567f-424a-8dac-39f21c8a232d tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:19.777625 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ff9860c9-567f-424a-8dac-39f21c8a232d tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:19.881535 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.multi_cell_list [None req-ff9860c9-567f-424a-8dac-39f21c8a232d tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122699) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 23 04:38:19.907769 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:38:19.949651 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ff9860c9-567f-424a-8dac-39f21c8a232d tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1244f3db540441a28d8413e510cfccad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b412c874d4e668b4a1a33dedb2c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:19.957313 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ff9860c9-567f-424a-8dac-39f21c8a232d tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:19.957812 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ff9860c9-567f-424a-8dac-39f21c8a232d tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:19.963799 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ff9860c9-567f-424a-8dac-39f21c8a232d tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:20.012535 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2216f2e1-f095-408d-a62d-fe7d7407282d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "DELETE /compute/v2.1/servers/bbf05a2b-af42-4f14-8956-4f6249c46974" status: 204 len: 0 microversion: 2.25 time: 0.389421 Sep 23 04:38:20.013392 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 924/1895] 10.222.0.33 () {60 vars in 1280 bytes} [Fri Sep 23 04:38:19 2022] DELETE /compute/v2.1/servers/bbf05a2b-af42-4f14-8956-4f6249c46974 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 23 04:38:20.102654 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ff9860c9-567f-424a-8dac-39f21c8a232d tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] 10.222.0.33 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4517 microversion: 2.1 time: 0.343447 Sep 23 04:38:20.103259 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 972/1896] 10.222.0.33 () {58 vars in 1173 bytes} [Fri Sep 23 04:38:19 2022] GET /compute/v2.1/servers/detail?status=active => generated 4517 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:20.119739 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ea3d28c6-8f5d-4e0b-883f-512fa1308b92 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:20.120913 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ea3d28c6-8f5d-4e0b-883f-512fa1308b92 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] [instance: 53745879-9973-4217-b1c5-b45f917db80e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:20.128350 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ea3d28c6-8f5d-4e0b-883f-512fa1308b92 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:20.136822 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ea3d28c6-8f5d-4e0b-883f-512fa1308b92 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:20.136822 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ea3d28c6-8f5d-4e0b-883f-512fa1308b92 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:20.136822 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ea3d28c6-8f5d-4e0b-883f-512fa1308b92 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:20.136822 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ea3d28c6-8f5d-4e0b-883f-512fa1308b92 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:20.136822 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ea3d28c6-8f5d-4e0b-883f-512fa1308b92 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:20.190244 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0ff07b30-b587-44d1-976e-e86d44835bcd tempest-VolumesNegativeTest-261466445 tempest-VolumesNegativeTest-261466445-project] Action: 'create', calling method: .version_select at 0x7ff1c3ef0e50>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1159802070", "metadata": {"Type": "work"}}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:38:20.196488 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0ff07b30-b587-44d1-976e-e86d44835bcd tempest-VolumesNegativeTest-261466445 tempest-VolumesNegativeTest-261466445-project] Request method failure captured: Sep 23 04:38:20.196488 n-d-846463-3 devstack@n-api.service[122698]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 23 04:38:20.196488 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:38:20.196488 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:38:20.196488 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:38:20.196488 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 122 Sep 23 04:38:20.196488 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:38:20.196488 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:38:20.196488 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:38:20.196488 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:38:20.196488 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTg7oS34NeiMbZvWE8UhzM8255aLAKGfMTYXIT7bd3K1laf72yvv9ULzHpD_zOY5coF9B5wuNKItO_xDFyRHjrIdHQQ1wozB-h8vRDKIYfTRdV0LlJc41xcuWc7oqYFfhlu64IXvQuaDxIKZo6Sn-fvFVDAZELeD9h_ZGFFtOYemE9Q Sep 23 04:38:20.196488 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:38:20.196488 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:38:20.196488 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:38:20.196488 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:38:20.196488 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:38:20.196488 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:38:20.196488 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 6e98c64a89d0403195592a4ebbcada3b Sep 23 04:38:20.196488 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-VolumesNegativeTest-261466445 Sep 23 04:38:20.196488 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:38:20.196488 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:38:20.196488 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_6e98c64a89d0403195592a4ebbcada3b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6e98c64a89d0403195592a4ebbcada3b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/6e98c64a89d0403195592a4ebbcada3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6e98c64a89d0403195592a4ebbcada3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:38:20.196488 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-VolumesNegativeTest-261466445 Sep 23 04:38:20.196488 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 6e98c64a89d0403195592a4ebbcada3b Sep 23 04:38:20.196488 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-VolumesNegativeTest-261466445 Sep 23 04:38:20.196488 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-VolumesNegativeTest-261466445-project Sep 23 04:38:20.196488 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:38:20.196488 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:38:20.196488 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: d3938fdd782a40f8b18d413946a687b9 Sep 23 04:38:20.196488 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-VolumesNegativeTest-261466445-project Sep 23 04:38:20.196488 n-d-846463-3 devstack@n-api.service[122698]: Sep 23 04:38:20.196488 n-d-846463-3 devstack@n-api.service[122698]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1159802070", "metadata": {"Type": "work"}}} Sep 23 04:38:20.196488 n-d-846463-3 devstack@n-api.service[122698]: method: Sep 23 04:38:20.196488 n-d-846463-3 devstack@n-api.service[122698]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 23 04:38:20.196488 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1159802070', 'metadata': {'Type': 'work'}}}} Sep 23 04:38:20.196488 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:38:20.196488 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:38:20.196488 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 23 04:38:20.196488 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 23 04:38:20.196488 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 23 04:38:20.196488 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise error Sep 23 04:38:20.196488 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 23 04:38:20.196488 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:38:20.196488 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 23 04:38:20.196488 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 23 04:38:20.196488 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:38:20.196488 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 23 04:38:20.196488 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi '#$%' Sep 23 04:38:20.196488 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:38:20.196488 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:38:20.196488 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:38:20.196488 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:38:20.196488 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:38:20.196488 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:38:20.196488 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:38:20.196488 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:38:20.196488 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:38:20.196488 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:38:20.196488 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:38:20.196488 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:38:20.196488 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 23 04:38:20.196488 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 23 04:38:20.196488 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 23 04:38:20.196488 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 23 04:38:20.196488 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 23 04:38:20.196488 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 23 04:38:20.202253 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 23 04:38:20.202253 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:38:20.202253 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:38:20.202253 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:38:20.202253 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:38:20.202253 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:38:20.202253 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:38:20.202253 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 23 04:38:20.202253 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 23 04:38:20.202253 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 23 04:38:20.202253 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:38:20.202253 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0ff07b30-b587-44d1-976e-e86d44835bcd tempest-VolumesNegativeTest-261466445 tempest-VolumesNegativeTest-261466445-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:38:20.204093 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0ff07b30-b587-44d1-976e-e86d44835bcd tempest-VolumesNegativeTest-261466445 tempest-VolumesNegativeTest-261466445-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.181811 Sep 23 04:38:20.210769 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 925/1897] 10.222.0.33 () {60 vars in 1156 bytes} [Fri Sep 23 04:38:20 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 197 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 04:38:20.225719 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9257b5ed-833c-4da3-bc0f-62101017efe5 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:20.229407 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-9257b5ed-833c-4da3-bc0f-62101017efe5 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: bbf05a2b-af42-4f14-8956-4f6249c46974] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:20.236951 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9257b5ed-833c-4da3-bc0f-62101017efe5 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:20.238133 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9257b5ed-833c-4da3-bc0f-62101017efe5 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:20.238133 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9257b5ed-833c-4da3-bc0f-62101017efe5 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:20.239775 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9257b5ed-833c-4da3-bc0f-62101017efe5 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:20.240241 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9257b5ed-833c-4da3-bc0f-62101017efe5 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:20.240748 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9257b5ed-833c-4da3-bc0f-62101017efe5 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:20.436196 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ea3d28c6-8f5d-4e0b-883f-512fa1308b92 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:20.451928 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ea3d28c6-8f5d-4e0b-883f-512fa1308b92 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:20.453435 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ea3d28c6-8f5d-4e0b-883f-512fa1308b92 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:20.455192 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ea3d28c6-8f5d-4e0b-883f-512fa1308b92 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] 10.222.0.33 "GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e" status: 200 len: 1873 microversion: 2.42 time: 0.339131 Sep 23 04:38:20.456285 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 973/1898] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:38:20 2022] GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e => generated 1873 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:38:20.461956 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6c702a03-f971-4895-8ed4-9ce9d23b32c8 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:20.471948 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-9257b5ed-833c-4da3-bc0f-62101017efe5 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:20.475611 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-6c702a03-f971-4895-8ed4-9ce9d23b32c8 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1244f3db540441a28d8413e510cfccad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b412c874d4e668b4a1a33dedb2c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:20.480356 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.compute.servers [None req-6c702a03-f971-4895-8ed4-9ce9d23b32c8 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Removing options 'limit' from query {{(pid=122699) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 23 04:38:20.480356 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-6c702a03-f971-4895-8ed4-9ce9d23b32c8 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Searching by: {'deleted': False, 'project_id': '721b412c874d4e668b4a1a33dedb2c9b'} {{(pid=122699) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 04:38:20.483616 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-9257b5ed-833c-4da3-bc0f-62101017efe5 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:20.485061 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-9257b5ed-833c-4da3-bc0f-62101017efe5 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:20.486337 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9257b5ed-833c-4da3-bc0f-62101017efe5 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/bbf05a2b-af42-4f14-8956-4f6249c46974" status: 200 len: 1565 microversion: 2.25 time: 0.274354 Sep 23 04:38:20.489303 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6c702a03-f971-4895-8ed4-9ce9d23b32c8 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:20.489950 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6c702a03-f971-4895-8ed4-9ce9d23b32c8 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:20.490579 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6c702a03-f971-4895-8ed4-9ce9d23b32c8 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:20.491484 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6c702a03-f971-4895-8ed4-9ce9d23b32c8 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:20.492201 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6c702a03-f971-4895-8ed4-9ce9d23b32c8 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:20.492821 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6c702a03-f971-4895-8ed4-9ce9d23b32c8 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:20.499940 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 926/1899] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:38:20 2022] GET /compute/v2.1/servers/bbf05a2b-af42-4f14-8956-4f6249c46974 => generated 1565 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:38:20.510847 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a70d36e7-d990-43b5-a580-92f39cb472db tempest-VolumesNegativeTest-261466445 tempest-VolumesNegativeTest-261466445-project] Action: 'create', calling method: .version_select at 0x7ff1c3dd4700>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-621597327", "metadata": {"Type": "work"}}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:38:20.514918 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a70d36e7-d990-43b5-a580-92f39cb472db tempest-VolumesNegativeTest-261466445 tempest-VolumesNegativeTest-261466445-project] Request method failure captured: Sep 23 04:38:20.514918 n-d-846463-3 devstack@n-api.service[122698]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 23 04:38:20.514918 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:38:20.514918 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:38:20.514918 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:38:20.514918 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 119 Sep 23 04:38:20.514918 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:38:20.514918 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:38:20.514918 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:38:20.514918 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:38:20.514918 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTg7oS34NeiMbZvWE8UhzM8255aLAKGfMTYXIT7bd3K1laf72yvv9ULzHpD_zOY5coF9B5wuNKItO_xDFyRHjrIdHQQ1wozB-h8vRDKIYfTRdV0LlJc41xcuWc7oqYFfhlu64IXvQuaDxIKZo6Sn-fvFVDAZELeD9h_ZGFFtOYemE9Q Sep 23 04:38:20.514918 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:38:20.514918 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:38:20.514918 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:38:20.514918 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:38:20.514918 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:38:20.514918 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:38:20.514918 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 6e98c64a89d0403195592a4ebbcada3b Sep 23 04:38:20.514918 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-VolumesNegativeTest-261466445 Sep 23 04:38:20.514918 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:38:20.514918 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:38:20.514918 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_6e98c64a89d0403195592a4ebbcada3b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6e98c64a89d0403195592a4ebbcada3b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/6e98c64a89d0403195592a4ebbcada3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6e98c64a89d0403195592a4ebbcada3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:38:20.514918 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-VolumesNegativeTest-261466445 Sep 23 04:38:20.514918 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 6e98c64a89d0403195592a4ebbcada3b Sep 23 04:38:20.514918 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-VolumesNegativeTest-261466445 Sep 23 04:38:20.514918 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-VolumesNegativeTest-261466445-project Sep 23 04:38:20.514918 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:38:20.514918 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:38:20.514918 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: d3938fdd782a40f8b18d413946a687b9 Sep 23 04:38:20.514918 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-VolumesNegativeTest-261466445-project Sep 23 04:38:20.514918 n-d-846463-3 devstack@n-api.service[122698]: Sep 23 04:38:20.514918 n-d-846463-3 devstack@n-api.service[122698]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-621597327", "metadata": {"Type": "work"}}} Sep 23 04:38:20.514918 n-d-846463-3 devstack@n-api.service[122698]: method: Sep 23 04:38:20.514918 n-d-846463-3 devstack@n-api.service[122698]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 23 04:38:20.514918 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-621597327', 'metadata': {'Type': 'work'}}}} Sep 23 04:38:20.514918 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:38:20.514918 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:38:20.514918 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 23 04:38:20.514918 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 23 04:38:20.514918 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 23 04:38:20.514918 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise error Sep 23 04:38:20.514918 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 23 04:38:20.514918 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:38:20.514918 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 23 04:38:20.514918 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 23 04:38:20.514918 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:38:20.514918 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 23 04:38:20.514918 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi '0' Sep 23 04:38:20.514918 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:38:20.514918 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:38:20.514918 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:38:20.514918 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:38:20.514918 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:38:20.514918 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:38:20.514918 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:38:20.514918 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:38:20.514918 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:38:20.514918 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:38:20.514918 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:38:20.514918 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:38:20.514918 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 23 04:38:20.514918 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 23 04:38:20.514918 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 23 04:38:20.514918 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 23 04:38:20.514918 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 23 04:38:20.514918 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 23 04:38:20.521421 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 23 04:38:20.521421 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:38:20.521421 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:38:20.521421 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:38:20.521421 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:38:20.521421 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:38:20.521421 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:38:20.521421 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 23 04:38:20.521421 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 23 04:38:20.521421 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 23 04:38:20.521421 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:38:20.521421 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a70d36e7-d990-43b5-a580-92f39cb472db tempest-VolumesNegativeTest-261466445 tempest-VolumesNegativeTest-261466445-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:38:20.521421 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a70d36e7-d990-43b5-a580-92f39cb472db tempest-VolumesNegativeTest-261466445 tempest-VolumesNegativeTest-261466445-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.016159 Sep 23 04:38:20.521421 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 927/1900] 10.222.0.33 () {60 vars in 1156 bytes} [Fri Sep 23 04:38:20 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 04:38:20.523380 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a6c44eef-a9fa-4754-9fc7-bf07834c7243 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:20.523552 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a6c44eef-a9fa-4754-9fc7-bf07834c7243 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 9d2757b5-8933-4d44-bfa5-cb5054cd05c6] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:20.532240 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a6c44eef-a9fa-4754-9fc7-bf07834c7243 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:20.533286 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a6c44eef-a9fa-4754-9fc7-bf07834c7243 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:20.534008 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a6c44eef-a9fa-4754-9fc7-bf07834c7243 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:20.534729 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a6c44eef-a9fa-4754-9fc7-bf07834c7243 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:20.535448 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a6c44eef-a9fa-4754-9fc7-bf07834c7243 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:20.535888 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a6c44eef-a9fa-4754-9fc7-bf07834c7243 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:20.542201 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-6c702a03-f971-4895-8ed4-9ce9d23b32c8 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1244f3db540441a28d8413e510cfccad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b412c874d4e668b4a1a33dedb2c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:20.548334 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6c702a03-f971-4895-8ed4-9ce9d23b32c8 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:20.548821 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6c702a03-f971-4895-8ed4-9ce9d23b32c8 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:20.549263 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6c702a03-f971-4895-8ed4-9ce9d23b32c8 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:20.745745 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6c702a03-f971-4895-8ed4-9ce9d23b32c8 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] 10.222.0.33 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1659 microversion: 2.1 time: 0.288396 Sep 23 04:38:20.747477 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 974/1901] 10.222.0.33 () {58 vars in 1161 bytes} [Fri Sep 23 04:38:20 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1659 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:20.754627 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a6c44eef-a9fa-4754-9fc7-bf07834c7243 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:20.770484 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-fe8c62cc-5c48-4c6a-b3c0-304f77b36907 req-90eb38b1-2913-413c-a53e-aad4e5048c83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13cee31b-8715-45f1-9aa7-37e885dcf785", "tag": "29201119-4365-4bac-abee-5b7e094cfca7"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:38:20.777597 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a6c44eef-a9fa-4754-9fc7-bf07834c7243 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/9d2757b5-8933-4d44-bfa5-cb5054cd05c6" status: 200 len: 1314 microversion: 2.1 time: 0.258281 Sep 23 04:38:20.778903 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 928/1902] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:20 2022] GET /compute/v2.1/servers/9d2757b5-8933-4d44-bfa5-cb5054cd05c6 => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:20.797217 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-277e7db4-4452-43e4-89f0-0f727e5803e5 tempest-VolumesNegativeTest-261466445 tempest-VolumesNegativeTest-261466445-project] Action: 'create', calling method: .version_select at 0x7ff1c3de1b80>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1414207507", "metadata": {"Type": "work"}}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:38:20.797473 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-fe8c62cc-5c48-4c6a-b3c0-304f77b36907 req-90eb38b1-2913-413c-a53e-aad4e5048c83 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:20.797473 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-fe8c62cc-5c48-4c6a-b3c0-304f77b36907 req-90eb38b1-2913-413c-a53e-aad4e5048c83 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:20.797473 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-fe8c62cc-5c48-4c6a-b3c0-304f77b36907 req-90eb38b1-2913-413c-a53e-aad4e5048c83 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:20.797789 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-277e7db4-4452-43e4-89f0-0f727e5803e5 tempest-VolumesNegativeTest-261466445 tempest-VolumesNegativeTest-261466445-project] Request method failure captured: Sep 23 04:38:20.797789 n-d-846463-3 devstack@n-api.service[122698]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 23 04:38:20.797789 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:38:20.797789 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:38:20.797789 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:38:20.797789 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 119 Sep 23 04:38:20.797789 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:38:20.797789 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:38:20.797789 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:38:20.797789 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:38:20.797789 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTg7oS34NeiMbZvWE8UhzM8255aLAKGfMTYXIT7bd3K1laf72yvv9ULzHpD_zOY5coF9B5wuNKItO_xDFyRHjrIdHQQ1wozB-h8vRDKIYfTRdV0LlJc41xcuWc7oqYFfhlu64IXvQuaDxIKZo6Sn-fvFVDAZELeD9h_ZGFFtOYemE9Q Sep 23 04:38:20.797789 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:38:20.797789 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:38:20.797789 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:38:20.797789 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:38:20.797789 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:38:20.797789 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:38:20.797789 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 6e98c64a89d0403195592a4ebbcada3b Sep 23 04:38:20.797789 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-VolumesNegativeTest-261466445 Sep 23 04:38:20.797789 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:38:20.797789 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:38:20.797789 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_6e98c64a89d0403195592a4ebbcada3b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6e98c64a89d0403195592a4ebbcada3b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/6e98c64a89d0403195592a4ebbcada3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6e98c64a89d0403195592a4ebbcada3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:38:20.797789 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-VolumesNegativeTest-261466445 Sep 23 04:38:20.797789 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 6e98c64a89d0403195592a4ebbcada3b Sep 23 04:38:20.797789 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-VolumesNegativeTest-261466445 Sep 23 04:38:20.797789 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-VolumesNegativeTest-261466445-project Sep 23 04:38:20.797789 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:38:20.797789 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:38:20.797789 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: d3938fdd782a40f8b18d413946a687b9 Sep 23 04:38:20.797789 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-VolumesNegativeTest-261466445-project Sep 23 04:38:20.797789 n-d-846463-3 devstack@n-api.service[122698]: Sep 23 04:38:20.797789 n-d-846463-3 devstack@n-api.service[122698]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1414207507", "metadata": {"Type": "work"}}} Sep 23 04:38:20.797789 n-d-846463-3 devstack@n-api.service[122698]: method: Sep 23 04:38:20.797789 n-d-846463-3 devstack@n-api.service[122698]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 23 04:38:20.797789 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1414207507', 'metadata': {'Type': 'work'}}}} Sep 23 04:38:20.797789 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:38:20.797789 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:38:20.797789 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 23 04:38:20.797789 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 23 04:38:20.797789 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 23 04:38:20.797789 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise error Sep 23 04:38:20.797789 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 23 04:38:20.797789 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:38:20.797789 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 23 04:38:20.797789 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 23 04:38:20.797789 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:38:20.797789 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 23 04:38:20.797789 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi '' Sep 23 04:38:20.797789 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:38:20.797789 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:38:20.797789 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:38:20.797789 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:38:20.797789 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:38:20.797789 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:38:20.797789 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:38:20.797789 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:38:20.797789 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:38:20.797789 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:38:20.797789 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:38:20.797789 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:38:20.797789 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 23 04:38:20.797789 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 23 04:38:20.797789 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 23 04:38:20.797789 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 23 04:38:20.797789 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 23 04:38:20.797789 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 23 04:38:20.803589 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 23 04:38:20.803589 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:38:20.803589 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:38:20.803589 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:38:20.803589 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:38:20.803589 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:38:20.803589 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:38:20.803589 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 23 04:38:20.803589 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 23 04:38:20.803589 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 23 04:38:20.803589 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:38:20.803589 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-277e7db4-4452-43e4-89f0-0f727e5803e5 tempest-VolumesNegativeTest-261466445 tempest-VolumesNegativeTest-261466445-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:38:20.803589 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-277e7db4-4452-43e4-89f0-0f727e5803e5 tempest-VolumesNegativeTest-261466445 tempest-VolumesNegativeTest-261466445-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.011479 Sep 23 04:38:20.803589 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 929/1903] 10.222.0.33 () {60 vars in 1156 bytes} [Fri Sep 23 04:38:20 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 04:38:20.803589 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0f9550c1-1e39-4da2-87de-f3740fc0ea15 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:20.803589 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-0f9550c1-1e39-4da2-87de-f3740fc0ea15 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 13cee31b-8715-45f1-9aa7-37e885dcf785] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:20.804958 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-fe8c62cc-5c48-4c6a-b3c0-304f77b36907 req-90eb38b1-2913-413c-a53e-aad4e5048c83 service nova] Creating event network-changed:29201119-4365-4bac-abee-5b7e094cfca7 for instance 13cee31b-8715-45f1-9aa7-37e885dcf785 on n-h1-846463-3 Sep 23 04:38:20.805081 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0f9550c1-1e39-4da2-87de-f3740fc0ea15 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:20.805343 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0f9550c1-1e39-4da2-87de-f3740fc0ea15 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:20.806059 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0f9550c1-1e39-4da2-87de-f3740fc0ea15 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:20.808194 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0f9550c1-1e39-4da2-87de-f3740fc0ea15 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:20.808682 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0f9550c1-1e39-4da2-87de-f3740fc0ea15 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:20.809124 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0f9550c1-1e39-4da2-87de-f3740fc0ea15 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:20.811506 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-fe8c62cc-5c48-4c6a-b3c0-304f77b36907 req-90eb38b1-2913-413c-a53e-aad4e5048c83 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062304 Sep 23 04:38:20.812509 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 975/1904] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:38:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:38:20.819166 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-768a37d4-2fd0-4f68-971d-258859822fea tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:20.824928 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-768a37d4-2fd0-4f68-971d-258859822fea tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1244f3db540441a28d8413e510cfccad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b412c874d4e668b4a1a33dedb2c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:20.825356 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-768a37d4-2fd0-4f68-971d-258859822fea tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '721b412c874d4e668b4a1a33dedb2c9b'} {{(pid=122699) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 04:38:20.832753 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-768a37d4-2fd0-4f68-971d-258859822fea tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:20.833516 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-768a37d4-2fd0-4f68-971d-258859822fea tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:20.834397 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-768a37d4-2fd0-4f68-971d-258859822fea tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:20.835534 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-768a37d4-2fd0-4f68-971d-258859822fea tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:20.836001 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-768a37d4-2fd0-4f68-971d-258859822fea tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:20.836605 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-768a37d4-2fd0-4f68-971d-258859822fea tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:20.872124 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.multi_cell_list [None req-768a37d4-2fd0-4f68-971d-258859822fea tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122699) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 23 04:38:20.913436 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-768a37d4-2fd0-4f68-971d-258859822fea tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] 10.222.0.33 "GET /compute/v2.1/servers?status=active" status: 200 len: 1009 microversion: 2.1 time: 0.098454 Sep 23 04:38:20.918225 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 976/1905] 10.222.0.33 () {58 vars in 1152 bytes} [Fri Sep 23 04:38:20 2022] GET /compute/v2.1/servers?status=active => generated 1009 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:20.924579 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4fa08cad-51d7-486f-884a-5d4e26e9c40b tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:20.926261 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4fa08cad-51d7-486f-884a-5d4e26e9c40b tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] [instance: 94fc4134-9b8e-4dcd-bd96-5545bfd51c97] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:20.933536 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4fa08cad-51d7-486f-884a-5d4e26e9c40b tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:20.934083 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4fa08cad-51d7-486f-884a-5d4e26e9c40b tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:20.934810 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4fa08cad-51d7-486f-884a-5d4e26e9c40b tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:20.935721 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4fa08cad-51d7-486f-884a-5d4e26e9c40b tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:20.936198 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4fa08cad-51d7-486f-884a-5d4e26e9c40b tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:20.936632 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4fa08cad-51d7-486f-884a-5d4e26e9c40b tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:20.996093 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-0f9550c1-1e39-4da2-87de-f3740fc0ea15 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:21.005875 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0f9550c1-1e39-4da2-87de-f3740fc0ea15 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/13cee31b-8715-45f1-9aa7-37e885dcf785" status: 200 len: 1316 microversion: 2.1 time: 0.212617 Sep 23 04:38:21.007253 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 930/1906] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:20 2022] GET /compute/v2.1/servers/13cee31b-8715-45f1-9aa7-37e885dcf785 => generated 1316 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:21.013014 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-72570b1a-5e7f-4b18-91ff-3128d3b37ab0 tempest-VolumesNegativeTest-261466445 tempest-VolumesNegativeTest-261466445-project] Calling method '.version_select at 0x7ff1bb7e03a0>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:21.017679 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-4fa08cad-51d7-486f-884a-5d4e26e9c40b tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:21.031272 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-4fa08cad-51d7-486f-884a-5d4e26e9c40b tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:21.033596 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-4fa08cad-51d7-486f-884a-5d4e26e9c40b tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:21.043058 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4fa08cad-51d7-486f-884a-5d4e26e9c40b tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] 10.222.0.33 "GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97" status: 200 len: 1447 microversion: 2.75 time: 0.123080 Sep 23 04:38:21.057355 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 977/1907] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:38:20 2022] GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97 => generated 1447 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:38:21.057355 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b1988cca-7da6-47cb-9f27-ee59f55d0c6a tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:21.057355 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b1988cca-7da6-47cb-9f27-ee59f55d0c6a tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1244f3db540441a28d8413e510cfccad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b412c874d4e668b4a1a33dedb2c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:21.057355 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.compute.servers [None req-b1988cca-7da6-47cb-9f27-ee59f55d0c6a tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Removing options 'limit' from query {{(pid=122699) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 23 04:38:21.057355 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b1988cca-7da6-47cb-9f27-ee59f55d0c6a tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Searching by: {'deleted': False, 'project_id': '721b412c874d4e668b4a1a33dedb2c9b'} {{(pid=122699) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 04:38:21.061685 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b1988cca-7da6-47cb-9f27-ee59f55d0c6a tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:21.062215 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b1988cca-7da6-47cb-9f27-ee59f55d0c6a tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:21.062659 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b1988cca-7da6-47cb-9f27-ee59f55d0c6a tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:21.068871 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b1988cca-7da6-47cb-9f27-ee59f55d0c6a tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:21.069534 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b1988cca-7da6-47cb-9f27-ee59f55d0c6a tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:21.070024 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b1988cca-7da6-47cb-9f27-ee59f55d0c6a tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:21.079197 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-72570b1a-5e7f-4b18-91ff-3128d3b37ab0 tempest-VolumesNegativeTest-261466445 tempest-VolumesNegativeTest-261466445-project] HTTP exception thrown: Volume tempest-invalid-1637371296 could not be found. Sep 23 04:38:21.091331 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-72570b1a-5e7f-4b18-91ff-3128d3b37ab0 tempest-VolumesNegativeTest-261466445 tempest-VolumesNegativeTest-261466445-project] Request method failure captured: Sep 23 04:38:21.091331 n-d-846463-3 devstack@n-api.service[122698]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1637371296 HTTP/1.1 Sep 23 04:38:21.091331 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:38:21.091331 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:38:21.091331 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:38:21.091331 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:38:21.091331 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:38:21.091331 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:38:21.091331 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:38:21.091331 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:38:21.091331 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTg7oS34NeiMbZvWE8UhzM8255aLAKGfMTYXIT7bd3K1laf72yvv9ULzHpD_zOY5coF9B5wuNKItO_xDFyRHjrIdHQQ1wozB-h8vRDKIYfTRdV0LlJc41xcuWc7oqYFfhlu64IXvQuaDxIKZo6Sn-fvFVDAZELeD9h_ZGFFtOYemE9Q Sep 23 04:38:21.091331 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:38:21.091331 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:38:21.091331 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:38:21.091331 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:38:21.091331 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:38:21.091331 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:38:21.091331 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 6e98c64a89d0403195592a4ebbcada3b Sep 23 04:38:21.091331 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-VolumesNegativeTest-261466445 Sep 23 04:38:21.091331 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:38:21.091331 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:38:21.091331 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_6e98c64a89d0403195592a4ebbcada3b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6e98c64a89d0403195592a4ebbcada3b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/6e98c64a89d0403195592a4ebbcada3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6e98c64a89d0403195592a4ebbcada3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:38:21.091331 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-VolumesNegativeTest-261466445 Sep 23 04:38:21.091331 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 6e98c64a89d0403195592a4ebbcada3b Sep 23 04:38:21.091331 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-VolumesNegativeTest-261466445 Sep 23 04:38:21.091331 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-VolumesNegativeTest-261466445-project Sep 23 04:38:21.091331 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:38:21.091331 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:38:21.091331 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: d3938fdd782a40f8b18d413946a687b9 Sep 23 04:38:21.091331 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-VolumesNegativeTest-261466445-project Sep 23 04:38:21.091331 n-d-846463-3 devstack@n-api.service[122698]: method: Sep 23 04:38:21.091331 n-d-846463-3 devstack@n-api.service[122698]: exception: Volume tempest-invalid-1637371296 could not be found. Sep 23 04:38:21.091331 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': 'tempest-invalid-1637371296'} Sep 23 04:38:21.091331 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:38:21.091331 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:38:21.091331 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 23 04:38:21.091331 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 23 04:38:21.091331 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 23 04:38:21.091331 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 23 04:38:21.091331 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 23 04:38:21.091331 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 23 04:38:21.091331 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 23 04:38:21.091331 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 23 04:38:21.091331 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 23 04:38:21.091331 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 23 04:38:21.091331 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 23 04:38:21.091331 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 23 04:38:21.091331 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 23 04:38:21.091331 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 23 04:38:21.091331 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1637371296 could not be found. (HTTP 404) (Request-ID: req-1c194fcc-340d-4497-9cfc-c9ff3499e86c) Sep 23 04:38:21.091331 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:38:21.091331 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:38:21.091331 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:38:21.091331 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:38:21.091331 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 23 04:38:21.091331 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 23 04:38:21.091331 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 23 04:38:21.091331 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 23 04:38:21.091331 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 23 04:38:21.091331 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 23 04:38:21.091331 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 23 04:38:21.091331 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 23 04:38:21.091331 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 23 04:38:21.098227 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 23 04:38:21.098227 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 23 04:38:21.098227 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 23 04:38:21.098227 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 23 04:38:21.098227 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 23 04:38:21.098227 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 23 04:38:21.098227 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 23 04:38:21.098227 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 23 04:38:21.098227 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 23 04:38:21.098227 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 23 04:38:21.098227 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 23 04:38:21.098227 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 23 04:38:21.098227 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 23 04:38:21.098227 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1637371296 could not be found. Sep 23 04:38:21.098227 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:38:21.098227 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:38:21.098227 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:38:21.098227 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:38:21.098227 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:38:21.098227 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:38:21.098227 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:38:21.098227 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:38:21.098227 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:38:21.098227 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:38:21.098227 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:38:21.098227 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:38:21.098227 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 23 04:38:21.098227 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:38:21.098227 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1637371296 could not be found. Sep 23 04:38:21.098227 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:38:21.098227 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:38:21.098227 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:38:21.098227 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:38:21.098227 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:38:21.098227 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:38:21.098227 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:38:21.098227 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:38:21.098227 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1637371296 could not be found. Sep 23 04:38:21.098227 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:38:21.098227 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-72570b1a-5e7f-4b18-91ff-3128d3b37ab0 tempest-VolumesNegativeTest-261466445 tempest-VolumesNegativeTest-261466445-project] Returning 404 to user: Volume tempest-invalid-1637371296 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:38:21.102072 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-72570b1a-5e7f-4b18-91ff-3128d3b37ab0 tempest-VolumesNegativeTest-261466445 tempest-VolumesNegativeTest-261466445-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1637371296" status: 404 len: 99 microversion: 2.1 time: 0.092348 Sep 23 04:38:21.102613 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 931/1908] 10.222.0.33 () {58 vars in 1218 bytes} [Fri Sep 23 04:38:21 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1637371296 => generated 99 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 23 04:38:21.106305 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.multi_cell_list [None req-b1988cca-7da6-47cb-9f27-ee59f55d0c6a tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122699) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 23 04:38:21.114443 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9f4249f9-140b-41d0-9c51-46321478fd05 tempest-VolumesNegativeTest-261466445 tempest-VolumesNegativeTest-261466445-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006368 Sep 23 04:38:21.115380 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 932/1909] 10.222.0.33 () {58 vars in 1140 bytes} [Fri Sep 23 04:38:21 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 23 04:38:21.126058 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9f3e3dee-18b0-4bb1-a4bb-aad3e3aa47f3 tempest-VolumesNegativeTest-261466445 tempest-VolumesNegativeTest-261466445-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005922 Sep 23 04:38:21.132038 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 933/1910] 10.222.0.33 () {58 vars in 1137 bytes} [Fri Sep 23 04:38:21 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Sep 23 04:38:21.140518 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b1988cca-7da6-47cb-9f27-ee59f55d0c6a tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] 10.222.0.33 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1009 microversion: 2.1 time: 0.094565 Sep 23 04:38:21.141226 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 978/1911] 10.222.0.33 () {58 vars in 1150 bytes} [Fri Sep 23 04:38:21 2022] GET /compute/v2.1/servers?limit=100000 => generated 1009 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:21.143355 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-36e7749f-46e2-405d-bb71-5ce8ddcc75a2 tempest-VolumesNegativeTest-261466445 tempest-VolumesNegativeTest-261466445-project] Calling method '.version_select at 0x7ff1c3ef0ee0>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:21.153735 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c8c6ec43-a0db-4e55-9dae-04ca415e63b1 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:21.160925 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c8c6ec43-a0db-4e55-9dae-04ca415e63b1 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1244f3db540441a28d8413e510cfccad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b412c874d4e668b4a1a33dedb2c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:21.162117 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c8c6ec43-a0db-4e55-9dae-04ca415e63b1 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Searching by: {'deleted': False, 'project_id': '721b412c874d4e668b4a1a33dedb2c9b'} {{(pid=122699) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 04:38:21.167815 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c8c6ec43-a0db-4e55-9dae-04ca415e63b1 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:21.169481 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c8c6ec43-a0db-4e55-9dae-04ca415e63b1 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:21.169481 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c8c6ec43-a0db-4e55-9dae-04ca415e63b1 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:21.169691 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c8c6ec43-a0db-4e55-9dae-04ca415e63b1 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:21.170121 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c8c6ec43-a0db-4e55-9dae-04ca415e63b1 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:21.170942 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c8c6ec43-a0db-4e55-9dae-04ca415e63b1 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:21.188889 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-36e7749f-46e2-405d-bb71-5ce8ddcc75a2 tempest-VolumesNegativeTest-261466445 tempest-VolumesNegativeTest-261466445-project] HTTP exception thrown: Volume 495d9fde-f17e-47f1-b459-42f79a8ca028 could not be found. Sep 23 04:38:21.191985 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-36e7749f-46e2-405d-bb71-5ce8ddcc75a2 tempest-VolumesNegativeTest-261466445 tempest-VolumesNegativeTest-261466445-project] Request method failure captured: Sep 23 04:38:21.191985 n-d-846463-3 devstack@n-api.service[122698]: request: DELETE /compute/v2.1/os-volumes/495d9fde-f17e-47f1-b459-42f79a8ca028 HTTP/1.1 Sep 23 04:38:21.191985 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:38:21.191985 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:38:21.191985 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:38:21.191985 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:38:21.191985 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:38:21.191985 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:38:21.191985 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:38:21.191985 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:38:21.191985 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTg7oS34NeiMbZvWE8UhzM8255aLAKGfMTYXIT7bd3K1laf72yvv9ULzHpD_zOY5coF9B5wuNKItO_xDFyRHjrIdHQQ1wozB-h8vRDKIYfTRdV0LlJc41xcuWc7oqYFfhlu64IXvQuaDxIKZo6Sn-fvFVDAZELeD9h_ZGFFtOYemE9Q Sep 23 04:38:21.191985 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:38:21.191985 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:38:21.191985 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:38:21.191985 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:38:21.191985 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:38:21.191985 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:38:21.191985 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 6e98c64a89d0403195592a4ebbcada3b Sep 23 04:38:21.191985 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-VolumesNegativeTest-261466445 Sep 23 04:38:21.191985 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:38:21.191985 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:38:21.191985 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_6e98c64a89d0403195592a4ebbcada3b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6e98c64a89d0403195592a4ebbcada3b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/6e98c64a89d0403195592a4ebbcada3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6e98c64a89d0403195592a4ebbcada3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:38:21.191985 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-VolumesNegativeTest-261466445 Sep 23 04:38:21.191985 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 6e98c64a89d0403195592a4ebbcada3b Sep 23 04:38:21.191985 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-VolumesNegativeTest-261466445 Sep 23 04:38:21.191985 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-VolumesNegativeTest-261466445-project Sep 23 04:38:21.191985 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:38:21.191985 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:38:21.191985 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: d3938fdd782a40f8b18d413946a687b9 Sep 23 04:38:21.191985 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-VolumesNegativeTest-261466445-project Sep 23 04:38:21.191985 n-d-846463-3 devstack@n-api.service[122698]: method: Sep 23 04:38:21.191985 n-d-846463-3 devstack@n-api.service[122698]: exception: Volume 495d9fde-f17e-47f1-b459-42f79a8ca028 could not be found. Sep 23 04:38:21.191985 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '495d9fde-f17e-47f1-b459-42f79a8ca028'} Sep 23 04:38:21.191985 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:38:21.191985 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:38:21.191985 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 23 04:38:21.191985 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 23 04:38:21.191985 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 23 04:38:21.191985 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 23 04:38:21.191985 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 23 04:38:21.191985 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 23 04:38:21.191985 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 23 04:38:21.191985 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 23 04:38:21.191985 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 23 04:38:21.191985 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 23 04:38:21.191985 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 23 04:38:21.191985 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 23 04:38:21.191985 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 23 04:38:21.191985 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 23 04:38:21.191985 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 495d9fde-f17e-47f1-b459-42f79a8ca028 could not be found. (HTTP 404) (Request-ID: req-400cd255-7101-4c40-ac4d-514f37bb807e) Sep 23 04:38:21.191985 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:38:21.191985 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:38:21.191985 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:38:21.191985 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:38:21.191985 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 23 04:38:21.191985 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 23 04:38:21.191985 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 23 04:38:21.191985 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 23 04:38:21.191985 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 23 04:38:21.191985 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 23 04:38:21.191985 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 23 04:38:21.191985 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 23 04:38:21.191985 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 23 04:38:21.197056 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 23 04:38:21.197056 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 23 04:38:21.197056 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 23 04:38:21.197056 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 23 04:38:21.197056 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 23 04:38:21.197056 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 23 04:38:21.197056 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 23 04:38:21.197056 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 23 04:38:21.197056 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 23 04:38:21.197056 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 23 04:38:21.197056 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 23 04:38:21.197056 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 23 04:38:21.197056 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 23 04:38:21.197056 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 495d9fde-f17e-47f1-b459-42f79a8ca028 could not be found. Sep 23 04:38:21.197056 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:38:21.197056 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:38:21.197056 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:38:21.197056 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:38:21.197056 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:38:21.197056 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:38:21.197056 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:38:21.197056 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:38:21.197056 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:38:21.197056 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:38:21.197056 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:38:21.197056 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:38:21.197056 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 23 04:38:21.197056 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:38:21.197056 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 495d9fde-f17e-47f1-b459-42f79a8ca028 could not be found. Sep 23 04:38:21.197056 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:38:21.197056 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:38:21.197056 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:38:21.197056 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:38:21.197056 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:38:21.197056 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:38:21.197056 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:38:21.197056 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:38:21.197056 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 495d9fde-f17e-47f1-b459-42f79a8ca028 could not be found. Sep 23 04:38:21.197056 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:38:21.197056 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-36e7749f-46e2-405d-bb71-5ce8ddcc75a2 tempest-VolumesNegativeTest-261466445 tempest-VolumesNegativeTest-261466445-project] Returning 404 to user: Volume 495d9fde-f17e-47f1-b459-42f79a8ca028 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:38:21.197056 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-36e7749f-46e2-405d-bb71-5ce8ddcc75a2 tempest-VolumesNegativeTest-261466445 tempest-VolumesNegativeTest-261466445-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/495d9fde-f17e-47f1-b459-42f79a8ca028" status: 404 len: 109 microversion: 2.1 time: 0.057137 Sep 23 04:38:21.206720 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 934/1912] 10.222.0.33 () {58 vars in 1248 bytes} [Fri Sep 23 04:38:21 2022] DELETE /compute/v2.1/os-volumes/495d9fde-f17e-47f1-b459-42f79a8ca028 => generated 109 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:38:21.206861 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4c839c5a-9da4-4a11-bfcb-a903ba4914ff tempest-VolumesNegativeTest-261466445 tempest-VolumesNegativeTest-261466445-project] Calling method '.version_select at 0x7ff1c3e6f430>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:21.214102 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.multi_cell_list [None req-c8c6ec43-a0db-4e55-9dae-04ca415e63b1 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122699) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 23 04:38:21.242089 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-4c839c5a-9da4-4a11-bfcb-a903ba4914ff tempest-VolumesNegativeTest-261466445 tempest-VolumesNegativeTest-261466445-project] HTTP exception thrown: Volume 5b5186f5-70ee-499c-b97b-332f628e1f45 could not be found. Sep 23 04:38:21.245340 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4c839c5a-9da4-4a11-bfcb-a903ba4914ff tempest-VolumesNegativeTest-261466445 tempest-VolumesNegativeTest-261466445-project] Request method failure captured: Sep 23 04:38:21.245340 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/os-volumes/5b5186f5-70ee-499c-b97b-332f628e1f45 HTTP/1.1 Sep 23 04:38:21.245340 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:38:21.245340 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:38:21.245340 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:38:21.245340 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:38:21.245340 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:38:21.245340 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:38:21.245340 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:38:21.245340 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:38:21.245340 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTg7oS34NeiMbZvWE8UhzM8255aLAKGfMTYXIT7bd3K1laf72yvv9ULzHpD_zOY5coF9B5wuNKItO_xDFyRHjrIdHQQ1wozB-h8vRDKIYfTRdV0LlJc41xcuWc7oqYFfhlu64IXvQuaDxIKZo6Sn-fvFVDAZELeD9h_ZGFFtOYemE9Q Sep 23 04:38:21.245340 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:38:21.245340 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:38:21.245340 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:38:21.245340 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:38:21.245340 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:38:21.245340 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:38:21.245340 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 6e98c64a89d0403195592a4ebbcada3b Sep 23 04:38:21.245340 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-VolumesNegativeTest-261466445 Sep 23 04:38:21.245340 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:38:21.245340 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:38:21.245340 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_6e98c64a89d0403195592a4ebbcada3b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6e98c64a89d0403195592a4ebbcada3b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/6e98c64a89d0403195592a4ebbcada3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6e98c64a89d0403195592a4ebbcada3b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:38:21.245340 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-VolumesNegativeTest-261466445 Sep 23 04:38:21.245340 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 6e98c64a89d0403195592a4ebbcada3b Sep 23 04:38:21.245340 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-VolumesNegativeTest-261466445 Sep 23 04:38:21.245340 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-VolumesNegativeTest-261466445-project Sep 23 04:38:21.245340 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:38:21.245340 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:38:21.245340 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: d3938fdd782a40f8b18d413946a687b9 Sep 23 04:38:21.245340 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-VolumesNegativeTest-261466445-project Sep 23 04:38:21.245340 n-d-846463-3 devstack@n-api.service[122698]: method: Sep 23 04:38:21.245340 n-d-846463-3 devstack@n-api.service[122698]: exception: Volume 5b5186f5-70ee-499c-b97b-332f628e1f45 could not be found. Sep 23 04:38:21.245340 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '5b5186f5-70ee-499c-b97b-332f628e1f45'} Sep 23 04:38:21.245340 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:38:21.245340 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:38:21.245340 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 23 04:38:21.245340 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 23 04:38:21.245340 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 23 04:38:21.245340 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 23 04:38:21.245340 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 23 04:38:21.245340 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 23 04:38:21.245340 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 23 04:38:21.245340 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 23 04:38:21.245340 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 23 04:38:21.245340 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 23 04:38:21.245340 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 23 04:38:21.245340 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 23 04:38:21.245340 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 23 04:38:21.245340 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 23 04:38:21.245340 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5b5186f5-70ee-499c-b97b-332f628e1f45 could not be found. (HTTP 404) (Request-ID: req-83a98bbb-598b-4450-af8e-a50fb2610e55) Sep 23 04:38:21.245340 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:38:21.245340 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:38:21.245340 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:38:21.245340 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:38:21.245340 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 23 04:38:21.245340 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 23 04:38:21.245340 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 23 04:38:21.245340 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 23 04:38:21.245340 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 23 04:38:21.245340 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 23 04:38:21.245340 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 23 04:38:21.245340 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 23 04:38:21.245340 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 23 04:38:21.250200 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 23 04:38:21.250200 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 23 04:38:21.250200 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 23 04:38:21.250200 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 23 04:38:21.250200 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 23 04:38:21.250200 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 23 04:38:21.250200 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 23 04:38:21.250200 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 23 04:38:21.250200 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 23 04:38:21.250200 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 23 04:38:21.250200 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 23 04:38:21.250200 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 23 04:38:21.250200 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 23 04:38:21.250200 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5b5186f5-70ee-499c-b97b-332f628e1f45 could not be found. Sep 23 04:38:21.250200 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:38:21.250200 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:38:21.250200 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:38:21.250200 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:38:21.250200 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:38:21.250200 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:38:21.250200 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:38:21.250200 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:38:21.250200 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:38:21.250200 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:38:21.250200 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:38:21.250200 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:38:21.250200 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 23 04:38:21.250200 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:38:21.250200 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5b5186f5-70ee-499c-b97b-332f628e1f45 could not be found. Sep 23 04:38:21.250200 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:38:21.250200 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:38:21.250200 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:38:21.250200 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:38:21.250200 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:38:21.250200 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:38:21.250200 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:38:21.250200 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:38:21.250200 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5b5186f5-70ee-499c-b97b-332f628e1f45 could not be found. Sep 23 04:38:21.250200 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:38:21.250200 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4c839c5a-9da4-4a11-bfcb-a903ba4914ff tempest-VolumesNegativeTest-261466445 tempest-VolumesNegativeTest-261466445-project] Returning 404 to user: Volume 5b5186f5-70ee-499c-b97b-332f628e1f45 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:38:21.250200 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4c839c5a-9da4-4a11-bfcb-a903ba4914ff tempest-VolumesNegativeTest-261466445 tempest-VolumesNegativeTest-261466445-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/5b5186f5-70ee-499c-b97b-332f628e1f45" status: 404 len: 109 microversion: 2.1 time: 0.046340 Sep 23 04:38:21.250200 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 935/1913] 10.222.0.33 () {58 vars in 1245 bytes} [Fri Sep 23 04:38:21 2022] GET /compute/v2.1/os-volumes/5b5186f5-70ee-499c-b97b-332f628e1f45 => generated 109 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:38:21.253168 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c8c6ec43-a0db-4e55-9dae-04ca415e63b1 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 1009 microversion: 2.1 time: 0.098553 Sep 23 04:38:21.253168 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 979/1914] 10.222.0.33 () {58 vars in 1125 bytes} [Fri Sep 23 04:38:21 2022] GET /compute/v2.1/servers => generated 1009 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:21.263342 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3a988c87-b8d1-47e0-bb1c-30d0670142ab tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:21.283511 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-3a988c87-b8d1-47e0-bb1c-30d0670142ab tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1244f3db540441a28d8413e510cfccad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b412c874d4e668b4a1a33dedb2c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:21.285139 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3a988c87-b8d1-47e0-bb1c-30d0670142ab tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '721b412c874d4e668b4a1a33dedb2c9b'} {{(pid=122698) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 04:38:21.310684 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3a988c87-b8d1-47e0-bb1c-30d0670142ab tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:21.315391 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3a988c87-b8d1-47e0-bb1c-30d0670142ab tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:21.317322 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3a988c87-b8d1-47e0-bb1c-30d0670142ab tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:21.319516 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3a988c87-b8d1-47e0-bb1c-30d0670142ab tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:21.321155 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3a988c87-b8d1-47e0-bb1c-30d0670142ab tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:21.326240 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3a988c87-b8d1-47e0-bb1c-30d0670142ab tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:21.425476 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.multi_cell_list [None req-3a988c87-b8d1-47e0-bb1c-30d0670142ab tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122698) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 23 04:38:21.488428 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3a988c87-b8d1-47e0-bb1c-30d0670142ab tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] 10.222.0.33 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 344 microversion: 2.1 time: 0.230017 Sep 23 04:38:21.489003 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 936/1915] 10.222.0.33 () {58 vars in 1146 bytes} [Fri Sep 23 04:38:21 2022] GET /compute/v2.1/servers?flavor=451 => generated 344 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:38:21.494829 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1bdd6717-cb6d-43be-a695-39516aa6247a tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:21.494829 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1bdd6717-cb6d-43be-a695-39516aa6247a tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] [instance: 53745879-9973-4217-b1c5-b45f917db80e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:21.496542 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1bdd6717-cb6d-43be-a695-39516aa6247a tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:21.497157 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1bdd6717-cb6d-43be-a695-39516aa6247a tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:21.497669 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1bdd6717-cb6d-43be-a695-39516aa6247a tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:21.498484 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1bdd6717-cb6d-43be-a695-39516aa6247a tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:21.499005 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1bdd6717-cb6d-43be-a695-39516aa6247a tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:21.499574 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1bdd6717-cb6d-43be-a695-39516aa6247a tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:21.505268 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5773a576-b04d-4f21-b05b-2f011e104def tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:21.510702 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-5773a576-b04d-4f21-b05b-2f011e104def tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1244f3db540441a28d8413e510cfccad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b412c874d4e668b4a1a33dedb2c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:21.511161 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.compute.servers [None req-5773a576-b04d-4f21-b05b-2f011e104def tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Removing options 'limit' from query {{(pid=122698) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 23 04:38:21.513720 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5773a576-b04d-4f21-b05b-2f011e104def tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Searching by: {'deleted': False, 'project_id': '721b412c874d4e668b4a1a33dedb2c9b'} {{(pid=122698) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 04:38:21.520443 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5773a576-b04d-4f21-b05b-2f011e104def tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:21.520943 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5773a576-b04d-4f21-b05b-2f011e104def tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:21.521977 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5773a576-b04d-4f21-b05b-2f011e104def tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:21.522863 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5773a576-b04d-4f21-b05b-2f011e104def tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:21.523327 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5773a576-b04d-4f21-b05b-2f011e104def tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:21.523829 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5773a576-b04d-4f21-b05b-2f011e104def tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:21.548776 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5773a576-b04d-4f21-b05b-2f011e104def tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] 10.222.0.33 "GET /compute/v2.1/servers?limit=1" status: 200 len: 483 microversion: 2.1 time: 0.047786 Sep 23 04:38:21.550038 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 937/1916] 10.222.0.33 () {58 vars in 1140 bytes} [Fri Sep 23 04:38:21 2022] GET /compute/v2.1/servers?limit=1 => generated 483 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:38:21.558187 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-51554f22-5eec-4b2f-b845-dcf25c12cea2 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:21.559266 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-51554f22-5eec-4b2f-b845-dcf25c12cea2 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: bbf05a2b-af42-4f14-8956-4f6249c46974] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:21.569451 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-51554f22-5eec-4b2f-b845-dcf25c12cea2 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:21.569451 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-51554f22-5eec-4b2f-b845-dcf25c12cea2 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:21.569451 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-51554f22-5eec-4b2f-b845-dcf25c12cea2 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:21.569451 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-51554f22-5eec-4b2f-b845-dcf25c12cea2 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:21.569953 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-51554f22-5eec-4b2f-b845-dcf25c12cea2 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:21.570784 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-51554f22-5eec-4b2f-b845-dcf25c12cea2 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:21.965699 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1bdd6717-cb6d-43be-a695-39516aa6247a tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:21.968704 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-51554f22-5eec-4b2f-b845-dcf25c12cea2 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:21.982690 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1bdd6717-cb6d-43be-a695-39516aa6247a tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:21.983984 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1bdd6717-cb6d-43be-a695-39516aa6247a tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:21.984126 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-51554f22-5eec-4b2f-b845-dcf25c12cea2 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:21.985437 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-51554f22-5eec-4b2f-b845-dcf25c12cea2 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:21.986750 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1bdd6717-cb6d-43be-a695-39516aa6247a tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] 10.222.0.33 "GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e" status: 200 len: 1873 microversion: 2.42 time: 0.500980 Sep 23 04:38:21.997912 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 980/1917] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:38:21 2022] GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e => generated 1873 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:38:21.998102 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-51554f22-5eec-4b2f-b845-dcf25c12cea2 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/bbf05a2b-af42-4f14-8956-4f6249c46974" status: 200 len: 1565 microversion: 2.25 time: 0.436144 Sep 23 04:38:21.998102 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 938/1918] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:38:21 2022] GET /compute/v2.1/servers/bbf05a2b-af42-4f14-8956-4f6249c46974 => generated 1565 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:38:22.016862 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ef041e2b-5407-45be-b79a-850ba14d63cd tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:22.017508 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-78611e22-9466-42c9-bff6-b996276b4e48 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:22.019970 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-ef041e2b-5407-45be-b79a-850ba14d63cd tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 9d2757b5-8933-4d44-bfa5-cb5054cd05c6] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:22.023818 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-78611e22-9466-42c9-bff6-b996276b4e48 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1244f3db540441a28d8413e510cfccad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b412c874d4e668b4a1a33dedb2c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:22.024576 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-78611e22-9466-42c9-bff6-b996276b4e48 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1612956669', 'deleted': False, 'project_id': '721b412c874d4e668b4a1a33dedb2c9b'} {{(pid=122699) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 04:38:22.030704 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-78611e22-9466-42c9-bff6-b996276b4e48 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:22.031527 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-78611e22-9466-42c9-bff6-b996276b4e48 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:22.032224 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-78611e22-9466-42c9-bff6-b996276b4e48 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:22.033235 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-78611e22-9466-42c9-bff6-b996276b4e48 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:22.037290 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-78611e22-9466-42c9-bff6-b996276b4e48 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:22.038129 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-78611e22-9466-42c9-bff6-b996276b4e48 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:22.045238 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ef041e2b-5407-45be-b79a-850ba14d63cd tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:22.045584 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ef041e2b-5407-45be-b79a-850ba14d63cd tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:22.046749 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ef041e2b-5407-45be-b79a-850ba14d63cd tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:22.050821 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ef041e2b-5407-45be-b79a-850ba14d63cd tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:22.051402 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ef041e2b-5407-45be-b79a-850ba14d63cd tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:22.054740 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ef041e2b-5407-45be-b79a-850ba14d63cd tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:22.144256 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.multi_cell_list [None req-78611e22-9466-42c9-bff6-b996276b4e48 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122699) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 23 04:38:22.192035 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=100 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:38:22.211877 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-78611e22-9466-42c9-bff6-b996276b4e48 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] 10.222.0.33 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1612956669" status: 200 len: 346 microversion: 2.1 time: 0.198711 Sep 23 04:38:22.212756 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 981/1919] 10.222.0.33 () {58 vars in 1242 bytes} [Fri Sep 23 04:38:21 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1612956669 => generated 346 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:38:22.220481 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1a6f7993-f699-4665-b54b-8dcdfe53b759 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:22.221372 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1a6f7993-f699-4665-b54b-8dcdfe53b759 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 13cee31b-8715-45f1-9aa7-37e885dcf785] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:22.227766 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1a6f7993-f699-4665-b54b-8dcdfe53b759 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:22.228509 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1a6f7993-f699-4665-b54b-8dcdfe53b759 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:22.229148 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1a6f7993-f699-4665-b54b-8dcdfe53b759 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:22.231057 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1a6f7993-f699-4665-b54b-8dcdfe53b759 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:22.231703 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1a6f7993-f699-4665-b54b-8dcdfe53b759 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:22.232307 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1a6f7993-f699-4665-b54b-8dcdfe53b759 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:22.802051 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ef041e2b-5407-45be-b79a-850ba14d63cd tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:22.809917 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ef041e2b-5407-45be-b79a-850ba14d63cd tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/9d2757b5-8933-4d44-bfa5-cb5054cd05c6" status: 200 len: 1314 microversion: 2.1 time: 0.818239 Sep 23 04:38:22.810760 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 939/1920] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:21 2022] GET /compute/v2.1/servers/9d2757b5-8933-4d44-bfa5-cb5054cd05c6 => generated 1314 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:22.815838 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9b1801f9-c74a-4d31-ba0a-f8d64088d908 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:22.816633 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-9b1801f9-c74a-4d31-ba0a-f8d64088d908 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] [instance: 94fc4134-9b8e-4dcd-bd96-5545bfd51c97] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:22.822124 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9b1801f9-c74a-4d31-ba0a-f8d64088d908 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:22.823367 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9b1801f9-c74a-4d31-ba0a-f8d64088d908 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:22.823367 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9b1801f9-c74a-4d31-ba0a-f8d64088d908 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:22.823958 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9b1801f9-c74a-4d31-ba0a-f8d64088d908 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:22.824421 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9b1801f9-c74a-4d31-ba0a-f8d64088d908 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:22.824991 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9b1801f9-c74a-4d31-ba0a-f8d64088d908 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:22.850613 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1a6f7993-f699-4665-b54b-8dcdfe53b759 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:22.859790 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1a6f7993-f699-4665-b54b-8dcdfe53b759 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/13cee31b-8715-45f1-9aa7-37e885dcf785" status: 200 len: 1316 microversion: 2.1 time: 0.645797 Sep 23 04:38:22.867816 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 982/1921] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:22 2022] GET /compute/v2.1/servers/13cee31b-8715-45f1-9aa7-37e885dcf785 => generated 1316 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:22.872891 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ef6b4bd6-d7c0-427f-8dcb-f9c710a59c4c tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:38:22.880035 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ef6b4bd6-d7c0-427f-8dcb-f9c710a59c4c tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:22.880628 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ef6b4bd6-d7c0-427f-8dcb-f9c710a59c4c tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:22.881067 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ef6b4bd6-d7c0-427f-8dcb-f9c710a59c4c tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:22.917609 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-9b1801f9-c74a-4d31-ba0a-f8d64088d908 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:22.929199 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-9b1801f9-c74a-4d31-ba0a-f8d64088d908 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:22.931983 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-9b1801f9-c74a-4d31-ba0a-f8d64088d908 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:22.939694 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9b1801f9-c74a-4d31-ba0a-f8d64088d908 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] 10.222.0.33 "GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97" status: 200 len: 1447 microversion: 2.75 time: 0.128164 Sep 23 04:38:22.945952 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 940/1922] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:38:22 2022] GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97 => generated 1447 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:38:22.948031 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ef6b4bd6-d7c0-427f-8dcb-f9c710a59c4c tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] [instance: 7e90c852-5f27-4861-9b25-9ea1e475c0a9] Going to try to stop instance {{(pid=122699) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 23 04:38:23.018280 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-244e73ab-da2e-4b10-a41c-b1a8d6f6a20e tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:23.019159 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-244e73ab-da2e-4b10-a41c-b1a8d6f6a20e tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] [instance: 53745879-9973-4217-b1c5-b45f917db80e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:23.032127 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-244e73ab-da2e-4b10-a41c-b1a8d6f6a20e tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:23.037805 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-244e73ab-da2e-4b10-a41c-b1a8d6f6a20e tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:23.038750 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-244e73ab-da2e-4b10-a41c-b1a8d6f6a20e tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:23.039742 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-244e73ab-da2e-4b10-a41c-b1a8d6f6a20e tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:23.040716 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-244e73ab-da2e-4b10-a41c-b1a8d6f6a20e tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:23.041395 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-244e73ab-da2e-4b10-a41c-b1a8d6f6a20e tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:23.187327 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ef6b4bd6-d7c0-427f-8dcb-f9c710a59c4c tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] 10.222.0.33 "POST /compute/v2.1/servers/7e90c852-5f27-4861-9b25-9ea1e475c0a9/action" status: 202 len: 0 microversion: 2.1 time: 0.318134 Sep 23 04:38:23.189338 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 983/1923] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:38:22 2022] POST /compute/v2.1/servers/7e90c852-5f27-4861-9b25-9ea1e475c0a9/action => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:38:23.209597 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f8130cc8-a420-4ba8-83ed-7439a71ff35d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:23.225986 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f8130cc8-a420-4ba8-83ed-7439a71ff35d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: bbf05a2b-af42-4f14-8956-4f6249c46974] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:23.225986 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f8130cc8-a420-4ba8-83ed-7439a71ff35d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:23.225986 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f8130cc8-a420-4ba8-83ed-7439a71ff35d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:23.225986 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f8130cc8-a420-4ba8-83ed-7439a71ff35d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:23.225986 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f8130cc8-a420-4ba8-83ed-7439a71ff35d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:23.225986 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f8130cc8-a420-4ba8-83ed-7439a71ff35d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:23.225986 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f8130cc8-a420-4ba8-83ed-7439a71ff35d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:23.299376 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f8130cc8-a420-4ba8-83ed-7439a71ff35d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:23.308723 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f8130cc8-a420-4ba8-83ed-7439a71ff35d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:23.310291 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f8130cc8-a420-4ba8-83ed-7439a71ff35d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:23.311953 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f8130cc8-a420-4ba8-83ed-7439a71ff35d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/bbf05a2b-af42-4f14-8956-4f6249c46974" status: 200 len: 1523 microversion: 2.25 time: 0.119849 Sep 23 04:38:23.312456 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 984/1924] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:38:23 2022] GET /compute/v2.1/servers/bbf05a2b-af42-4f14-8956-4f6249c46974 => generated 1523 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:38:23.317670 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-b9e88d31-b99e-447b-9d37-43c6ba8620fa req-f8ab5d3d-263c-45f7-94fb-d7619f1da04c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbf05a2b-af42-4f14-8956-4f6249c46974", "name": "network-vif-deleted", "tag": "e5083905-a132-4abf-8cec-deb2f60a1547"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:38:23.321939 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-244e73ab-da2e-4b10-a41c-b1a8d6f6a20e tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:23.331871 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-b9e88d31-b99e-447b-9d37-43c6ba8620fa req-f8ab5d3d-263c-45f7-94fb-d7619f1da04c service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:23.332451 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-b9e88d31-b99e-447b-9d37-43c6ba8620fa req-f8ab5d3d-263c-45f7-94fb-d7619f1da04c service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:23.333069 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-b9e88d31-b99e-447b-9d37-43c6ba8620fa req-f8ab5d3d-263c-45f7-94fb-d7619f1da04c service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:23.333699 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-244e73ab-da2e-4b10-a41c-b1a8d6f6a20e tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:23.336523 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-244e73ab-da2e-4b10-a41c-b1a8d6f6a20e tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:23.338620 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-244e73ab-da2e-4b10-a41c-b1a8d6f6a20e tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] 10.222.0.33 "GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e" status: 200 len: 1873 microversion: 2.42 time: 0.325877 Sep 23 04:38:23.340776 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 941/1925] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:38:23 2022] GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e => generated 1873 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:38:23.364540 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-b9e88d31-b99e-447b-9d37-43c6ba8620fa req-f8ab5d3d-263c-45f7-94fb-d7619f1da04c service nova] Creating event network-vif-deleted:e5083905-a132-4abf-8cec-deb2f60a1547 for instance bbf05a2b-af42-4f14-8956-4f6249c46974 on n-h1-846463-3 Sep 23 04:38:23.369600 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-b9e88d31-b99e-447b-9d37-43c6ba8620fa req-f8ab5d3d-263c-45f7-94fb-d7619f1da04c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055905 Sep 23 04:38:23.373421 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 985/1926] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:38:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:38:23.373557 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-726670b1-a169-43ea-8cfd-f7246ca44702 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:23.378758 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-726670b1-a169-43ea-8cfd-f7246ca44702 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] [instance: 7e90c852-5f27-4861-9b25-9ea1e475c0a9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:23.397780 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-726670b1-a169-43ea-8cfd-f7246ca44702 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:23.401370 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-726670b1-a169-43ea-8cfd-f7246ca44702 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:23.402540 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-726670b1-a169-43ea-8cfd-f7246ca44702 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:23.405044 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-726670b1-a169-43ea-8cfd-f7246ca44702 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:23.405625 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-726670b1-a169-43ea-8cfd-f7246ca44702 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:23.406104 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-726670b1-a169-43ea-8cfd-f7246ca44702 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:23.563329 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-726670b1-a169-43ea-8cfd-f7246ca44702 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1244f3db540441a28d8413e510cfccad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b412c874d4e668b4a1a33dedb2c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:23.573420 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-726670b1-a169-43ea-8cfd-f7246ca44702 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] 10.222.0.33 "GET /compute/v2.1/servers/7e90c852-5f27-4861-9b25-9ea1e475c0a9" status: 200 len: 1522 microversion: 2.1 time: 0.232875 Sep 23 04:38:23.574833 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 942/1927] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:23 2022] GET /compute/v2.1/servers/7e90c852-5f27-4861-9b25-9ea1e475c0a9 => generated 1522 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:23.833648 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-211a8355-2145-4a55-889d-87f5d769e263 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:23.834582 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-211a8355-2145-4a55-889d-87f5d769e263 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 9d2757b5-8933-4d44-bfa5-cb5054cd05c6] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:23.845984 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-211a8355-2145-4a55-889d-87f5d769e263 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:23.857790 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-211a8355-2145-4a55-889d-87f5d769e263 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:23.857790 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-211a8355-2145-4a55-889d-87f5d769e263 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:23.857790 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-211a8355-2145-4a55-889d-87f5d769e263 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:23.857790 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-211a8355-2145-4a55-889d-87f5d769e263 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:23.857790 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-211a8355-2145-4a55-889d-87f5d769e263 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:23.883095 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-95c80c33-f43e-48b4-b598-da14309f8a96 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:23.886559 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-95c80c33-f43e-48b4-b598-da14309f8a96 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 13cee31b-8715-45f1-9aa7-37e885dcf785] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:23.894480 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-95c80c33-f43e-48b4-b598-da14309f8a96 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:23.894954 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-95c80c33-f43e-48b4-b598-da14309f8a96 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:23.895392 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-95c80c33-f43e-48b4-b598-da14309f8a96 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:23.896101 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-95c80c33-f43e-48b4-b598-da14309f8a96 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:23.896555 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-95c80c33-f43e-48b4-b598-da14309f8a96 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:23.896976 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-95c80c33-f43e-48b4-b598-da14309f8a96 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:24.115988 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-211a8355-2145-4a55-889d-87f5d769e263 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:24.127834 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-211a8355-2145-4a55-889d-87f5d769e263 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/9d2757b5-8933-4d44-bfa5-cb5054cd05c6" status: 200 len: 1314 microversion: 2.1 time: 0.294663 Sep 23 04:38:24.127834 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 986/1928] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:23 2022] GET /compute/v2.1/servers/9d2757b5-8933-4d44-bfa5-cb5054cd05c6 => generated 1314 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:24.139659 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-95c80c33-f43e-48b4-b598-da14309f8a96 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:24.144725 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f282827f-b806-4619-9d87-eaee8e064cf9 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:24.145590 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f282827f-b806-4619-9d87-eaee8e064cf9 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] [instance: 94fc4134-9b8e-4dcd-bd96-5545bfd51c97] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:24.153394 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f282827f-b806-4619-9d87-eaee8e064cf9 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:24.153916 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f282827f-b806-4619-9d87-eaee8e064cf9 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:24.154365 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f282827f-b806-4619-9d87-eaee8e064cf9 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:24.155272 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f282827f-b806-4619-9d87-eaee8e064cf9 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:24.155901 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f282827f-b806-4619-9d87-eaee8e064cf9 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:24.156497 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f282827f-b806-4619-9d87-eaee8e064cf9 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:24.157150 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-95c80c33-f43e-48b4-b598-da14309f8a96 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/13cee31b-8715-45f1-9aa7-37e885dcf785" status: 200 len: 1316 microversion: 2.1 time: 0.277864 Sep 23 04:38:24.158511 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 943/1929] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:23 2022] GET /compute/v2.1/servers/13cee31b-8715-45f1-9aa7-37e885dcf785 => generated 1316 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:24.229047 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f282827f-b806-4619-9d87-eaee8e064cf9 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:24.237338 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f282827f-b806-4619-9d87-eaee8e064cf9 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:24.239114 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f282827f-b806-4619-9d87-eaee8e064cf9 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:24.244360 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f282827f-b806-4619-9d87-eaee8e064cf9 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] 10.222.0.33 "GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97" status: 200 len: 1447 microversion: 2.75 time: 0.104317 Sep 23 04:38:24.244938 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 987/1930] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:38:24 2022] GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97 => generated 1447 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:38:24.338641 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-61b1773c-d369-4c03-bb9d-b7a82457572d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:24.339950 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-61b1773c-d369-4c03-bb9d-b7a82457572d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: bbf05a2b-af42-4f14-8956-4f6249c46974] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:24.349155 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-61b1773c-d369-4c03-bb9d-b7a82457572d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:24.349996 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-61b1773c-d369-4c03-bb9d-b7a82457572d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:24.350660 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-61b1773c-d369-4c03-bb9d-b7a82457572d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:24.352016 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-61b1773c-d369-4c03-bb9d-b7a82457572d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:24.353131 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-61b1773c-d369-4c03-bb9d-b7a82457572d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:24.353577 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-61b1773c-d369-4c03-bb9d-b7a82457572d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:24.371722 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-82b31292-e2cf-440a-b3c5-456d024435e2 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:24.372792 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-82b31292-e2cf-440a-b3c5-456d024435e2 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] [instance: 53745879-9973-4217-b1c5-b45f917db80e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:24.381514 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-82b31292-e2cf-440a-b3c5-456d024435e2 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:24.382250 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-82b31292-e2cf-440a-b3c5-456d024435e2 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:24.384011 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-82b31292-e2cf-440a-b3c5-456d024435e2 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:24.384934 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-82b31292-e2cf-440a-b3c5-456d024435e2 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:24.385566 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-82b31292-e2cf-440a-b3c5-456d024435e2 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:24.386204 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-82b31292-e2cf-440a-b3c5-456d024435e2 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:24.425390 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-61b1773c-d369-4c03-bb9d-b7a82457572d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:24.426297 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-61b1773c-d369-4c03-bb9d-b7a82457572d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:24.426948 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-61b1773c-d369-4c03-bb9d-b7a82457572d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:24.427774 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-61b1773c-d369-4c03-bb9d-b7a82457572d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lazy-loading 'fault' on Instance uuid bbf05a2b-af42-4f14-8956-4f6249c46974 {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:38:24.482429 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-61b1773c-d369-4c03-bb9d-b7a82457572d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:24.492863 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-61b1773c-d369-4c03-bb9d-b7a82457572d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:24.494667 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-61b1773c-d369-4c03-bb9d-b7a82457572d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '84d0c7a6520443d896f88069e91a2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0abccbbae40b47968a8dda6323b618e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:24.495860 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-61b1773c-d369-4c03-bb9d-b7a82457572d tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/bbf05a2b-af42-4f14-8956-4f6249c46974" status: 200 len: 1352 microversion: 2.25 time: 0.161947 Sep 23 04:38:24.496412 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 944/1931] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:38:24 2022] GET /compute/v2.1/servers/bbf05a2b-af42-4f14-8956-4f6249c46974 => generated 1352 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:38:24.600016 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f78a82bd-f9d7-4d1e-ac25-ef3c7946c977 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:24.601624 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f78a82bd-f9d7-4d1e-ac25-ef3c7946c977 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] [instance: 7e90c852-5f27-4861-9b25-9ea1e475c0a9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:24.609722 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f78a82bd-f9d7-4d1e-ac25-ef3c7946c977 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:24.611237 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f78a82bd-f9d7-4d1e-ac25-ef3c7946c977 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:24.611918 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f78a82bd-f9d7-4d1e-ac25-ef3c7946c977 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:24.615202 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f78a82bd-f9d7-4d1e-ac25-ef3c7946c977 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:24.619072 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f78a82bd-f9d7-4d1e-ac25-ef3c7946c977 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:24.619072 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f78a82bd-f9d7-4d1e-ac25-ef3c7946c977 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:24.667365 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-82b31292-e2cf-440a-b3c5-456d024435e2 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:24.688425 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-82b31292-e2cf-440a-b3c5-456d024435e2 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:24.692393 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-82b31292-e2cf-440a-b3c5-456d024435e2 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:24.698858 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-82b31292-e2cf-440a-b3c5-456d024435e2 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] 10.222.0.33 "GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e" status: 200 len: 1873 microversion: 2.42 time: 0.333895 Sep 23 04:38:24.698858 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 988/1932] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:38:24 2022] GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e => generated 1873 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:38:24.767205 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-6f3ab853-8195-42cc-ac89-7c918b7dae25 req-70549ac1-7325-4f3c-8292-9b21a0c9e1c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13cee31b-8715-45f1-9aa7-37e885dcf785", "name": "network-vif-plugged", "status": "completed", "tag": "29201119-4365-4bac-abee-5b7e094cfca7"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:38:24.786591 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-6f3ab853-8195-42cc-ac89-7c918b7dae25 req-70549ac1-7325-4f3c-8292-9b21a0c9e1c6 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:24.787399 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-6f3ab853-8195-42cc-ac89-7c918b7dae25 req-70549ac1-7325-4f3c-8292-9b21a0c9e1c6 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:24.787997 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-6f3ab853-8195-42cc-ac89-7c918b7dae25 req-70549ac1-7325-4f3c-8292-9b21a0c9e1c6 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:24.805647 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-6f3ab853-8195-42cc-ac89-7c918b7dae25 req-70549ac1-7325-4f3c-8292-9b21a0c9e1c6 service nova] Creating event network-vif-plugged:29201119-4365-4bac-abee-5b7e094cfca7 for instance 13cee31b-8715-45f1-9aa7-37e885dcf785 on n-h1-846463-3 Sep 23 04:38:24.812932 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-6f3ab853-8195-42cc-ac89-7c918b7dae25 req-70549ac1-7325-4f3c-8292-9b21a0c9e1c6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050398 Sep 23 04:38:24.814533 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 989/1933] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:38:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:38:24.840362 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f78a82bd-f9d7-4d1e-ac25-ef3c7946c977 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1244f3db540441a28d8413e510cfccad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b412c874d4e668b4a1a33dedb2c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:24.862934 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f78a82bd-f9d7-4d1e-ac25-ef3c7946c977 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] 10.222.0.33 "GET /compute/v2.1/servers/7e90c852-5f27-4861-9b25-9ea1e475c0a9" status: 200 len: 1522 microversion: 2.1 time: 0.268903 Sep 23 04:38:24.879835 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 945/1934] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:24 2022] GET /compute/v2.1/servers/7e90c852-5f27-4861-9b25-9ea1e475c0a9 => generated 1522 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:38:25.147088 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e3cfdd32-0093-4102-9e6a-220e02b0b2d0 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:25.147820 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e3cfdd32-0093-4102-9e6a-220e02b0b2d0 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 9d2757b5-8933-4d44-bfa5-cb5054cd05c6] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:25.154827 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e3cfdd32-0093-4102-9e6a-220e02b0b2d0 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:25.155320 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e3cfdd32-0093-4102-9e6a-220e02b0b2d0 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:25.155758 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e3cfdd32-0093-4102-9e6a-220e02b0b2d0 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:25.156659 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e3cfdd32-0093-4102-9e6a-220e02b0b2d0 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:25.157120 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e3cfdd32-0093-4102-9e6a-220e02b0b2d0 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:25.158145 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e3cfdd32-0093-4102-9e6a-220e02b0b2d0 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:25.182042 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a4b62ccd-02b2-4cbf-a938-c22fa32f463d tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:25.183352 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a4b62ccd-02b2-4cbf-a938-c22fa32f463d tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 13cee31b-8715-45f1-9aa7-37e885dcf785] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:25.190091 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a4b62ccd-02b2-4cbf-a938-c22fa32f463d tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:25.190744 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a4b62ccd-02b2-4cbf-a938-c22fa32f463d tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:25.191185 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a4b62ccd-02b2-4cbf-a938-c22fa32f463d tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:25.191895 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a4b62ccd-02b2-4cbf-a938-c22fa32f463d tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:25.192605 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a4b62ccd-02b2-4cbf-a938-c22fa32f463d tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:25.193039 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a4b62ccd-02b2-4cbf-a938-c22fa32f463d tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:25.210501 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:38:25.359490 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e3cfdd32-0093-4102-9e6a-220e02b0b2d0 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:25.368120 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e3cfdd32-0093-4102-9e6a-220e02b0b2d0 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/9d2757b5-8933-4d44-bfa5-cb5054cd05c6" status: 200 len: 1314 microversion: 2.1 time: 0.225328 Sep 23 04:38:25.370078 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 990/1935] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:25 2022] GET /compute/v2.1/servers/9d2757b5-8933-4d44-bfa5-cb5054cd05c6 => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:25.382048 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a4b62ccd-02b2-4cbf-a938-c22fa32f463d tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:25.389306 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-37644e1b-4783-4b7b-9806-3c84f0df5d38 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:25.390192 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-37644e1b-4783-4b7b-9806-3c84f0df5d38 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] [instance: 94fc4134-9b8e-4dcd-bd96-5545bfd51c97] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:25.390356 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a4b62ccd-02b2-4cbf-a938-c22fa32f463d tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/13cee31b-8715-45f1-9aa7-37e885dcf785" status: 200 len: 1316 microversion: 2.1 time: 0.211792 Sep 23 04:38:25.390991 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 946/1936] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:25 2022] GET /compute/v2.1/servers/13cee31b-8715-45f1-9aa7-37e885dcf785 => generated 1316 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:38:25.405455 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-37644e1b-4783-4b7b-9806-3c84f0df5d38 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:25.405455 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-37644e1b-4783-4b7b-9806-3c84f0df5d38 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:25.405455 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-37644e1b-4783-4b7b-9806-3c84f0df5d38 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:25.405455 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-37644e1b-4783-4b7b-9806-3c84f0df5d38 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:25.405455 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-37644e1b-4783-4b7b-9806-3c84f0df5d38 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:25.405455 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-37644e1b-4783-4b7b-9806-3c84f0df5d38 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:25.479138 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-37644e1b-4783-4b7b-9806-3c84f0df5d38 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:25.497853 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-37644e1b-4783-4b7b-9806-3c84f0df5d38 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:25.497853 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-37644e1b-4783-4b7b-9806-3c84f0df5d38 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:25.497853 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-37644e1b-4783-4b7b-9806-3c84f0df5d38 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] 10.222.0.33 "GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97" status: 200 len: 1447 microversion: 2.75 time: 0.127833 Sep 23 04:38:25.498319 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 991/1937] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:38:25 2022] GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97 => generated 1447 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:38:25.524139 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e2a7865b-3b75-4945-a362-b39659685f33 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:25.524784 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e2a7865b-3b75-4945-a362-b39659685f33 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] [instance: bbf05a2b-af42-4f14-8956-4f6249c46974] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:25.531663 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e2a7865b-3b75-4945-a362-b39659685f33 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:25.532922 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e2a7865b-3b75-4945-a362-b39659685f33 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:25.533778 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e2a7865b-3b75-4945-a362-b39659685f33 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:25.534544 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e2a7865b-3b75-4945-a362-b39659685f33 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:25.535003 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e2a7865b-3b75-4945-a362-b39659685f33 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:25.535585 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e2a7865b-3b75-4945-a362-b39659685f33 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:25.549870 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-e2a7865b-3b75-4945-a362-b39659685f33 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] HTTP exception thrown: Instance bbf05a2b-af42-4f14-8956-4f6249c46974 could not be found. Sep 23 04:38:25.551472 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e2a7865b-3b75-4945-a362-b39659685f33 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Request method failure captured: Sep 23 04:38:25.551472 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/bbf05a2b-af42-4f14-8956-4f6249c46974 HTTP/1.1 Sep 23 04:38:25.551472 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:38:25.551472 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:38:25.551472 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:38:25.551472 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:38:25.551472 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:38:25.551472 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:38:25.551472 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:38:25.551472 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:38:25.551472 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTaWXIXl3tR50j--lXaisfCvv96a-7yx5HAyhGUeC4fYQynUZPebyv8wFHzuAmaMbuHW8OYaivLn4U8NnQxMPu0yv189bThsscsy-IZHYf0cR3kfCKZke0BgT4gCn55jGv_RGgcBQZIrro9w30OswoUQBe63DbCzmjWipZnCAwKgjE4 Sep 23 04:38:25.551472 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:38:25.551472 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:38:25.551472 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:38:25.551472 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:38:25.551472 n-d-846463-3 devstack@n-api.service[122698]: X-Openstack-Nova-Api-Version: 2.25 Sep 23 04:38:25.551472 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:38:25.551472 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:38:25.551472 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 0abccbbae40b47968a8dda6323b618e3 Sep 23 04:38:25.551472 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1923115962 Sep 23 04:38:25.551472 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:38:25.551472 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:38:25.551472 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0abccbbae40b47968a8dda6323b618e3", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0abccbbae40b47968a8dda6323b618e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0abccbbae40b47968a8dda6323b618e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0abccbbae40b47968a8dda6323b618e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:38:25.551472 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1923115962 Sep 23 04:38:25.551472 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 0abccbbae40b47968a8dda6323b618e3 Sep 23 04:38:25.551472 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1923115962 Sep 23 04:38:25.551472 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-LiveAutoBlockMigrationV225Test-1923115962-project Sep 23 04:38:25.551472 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:38:25.551472 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:38:25.551472 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 84d0c7a6520443d896f88069e91a2eb2 Sep 23 04:38:25.551472 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1923115962-project Sep 23 04:38:25.551472 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:38:25.551472 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance bbf05a2b-af42-4f14-8956-4f6249c46974 could not be found. Sep 23 04:38:25.551472 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': 'bbf05a2b-af42-4f14-8956-4f6249c46974'} Sep 23 04:38:25.551472 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:38:25.551472 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:38:25.551472 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:38:25.551472 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:38:25.551472 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:38:25.551472 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:38:25.551472 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:38:25.551472 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:38:25.551472 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:38:25.551472 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:38:25.551472 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbf05a2b-af42-4f14-8956-4f6249c46974 could not be found. Sep 23 04:38:25.551472 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:38:25.551472 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:38:25.551472 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:38:25.551472 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:38:25.551472 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:38:25.551472 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:38:25.551472 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:38:25.551472 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:38:25.551472 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:38:25.551472 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:38:25.551472 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:38:25.551472 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:38:25.551472 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:38:25.551472 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:38:25.551472 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:38:25.551472 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:38:25.551472 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbf05a2b-af42-4f14-8956-4f6249c46974 could not be found. Sep 23 04:38:25.551472 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:38:25.557694 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:38:25.557694 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:38:25.557694 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:38:25.557694 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:38:25.557694 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:38:25.557694 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:38:25.557694 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:38:25.557694 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbf05a2b-af42-4f14-8956-4f6249c46974 could not be found. Sep 23 04:38:25.557694 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:38:25.557694 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e2a7865b-3b75-4945-a362-b39659685f33 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] Returning 404 to user: Instance bbf05a2b-af42-4f14-8956-4f6249c46974 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:38:25.557694 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e2a7865b-3b75-4945-a362-b39659685f33 tempest-LiveAutoBlockMigrationV225Test-1923115962 tempest-LiveAutoBlockMigrationV225Test-1923115962-project] 10.222.0.33 "GET /compute/v2.1/servers/bbf05a2b-af42-4f14-8956-4f6249c46974" status: 404 len: 111 microversion: 2.25 time: 0.032604 Sep 23 04:38:25.557694 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 947/1938] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:38:25 2022] GET /compute/v2.1/servers/bbf05a2b-af42-4f14-8956-4f6249c46974 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 23 04:38:25.724808 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6a400b4d-1d2e-4599-bbc7-1295ca0ac2d3 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:25.725851 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-6a400b4d-1d2e-4599-bbc7-1295ca0ac2d3 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] [instance: 53745879-9973-4217-b1c5-b45f917db80e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:25.739398 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6a400b4d-1d2e-4599-bbc7-1295ca0ac2d3 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:25.739874 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6a400b4d-1d2e-4599-bbc7-1295ca0ac2d3 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:25.740597 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6a400b4d-1d2e-4599-bbc7-1295ca0ac2d3 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:25.741331 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6a400b4d-1d2e-4599-bbc7-1295ca0ac2d3 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:25.742369 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6a400b4d-1d2e-4599-bbc7-1295ca0ac2d3 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:25.742814 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6a400b4d-1d2e-4599-bbc7-1295ca0ac2d3 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:25.893783 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-252179e0-c6a4-41bb-8e93-0f14691f575f tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:25.894856 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-252179e0-c6a4-41bb-8e93-0f14691f575f tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] [instance: 7e90c852-5f27-4861-9b25-9ea1e475c0a9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:25.912020 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-252179e0-c6a4-41bb-8e93-0f14691f575f tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:25.912936 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-252179e0-c6a4-41bb-8e93-0f14691f575f tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:25.913563 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-252179e0-c6a4-41bb-8e93-0f14691f575f tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:25.914364 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-252179e0-c6a4-41bb-8e93-0f14691f575f tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:25.915138 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-252179e0-c6a4-41bb-8e93-0f14691f575f tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:25.916352 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-252179e0-c6a4-41bb-8e93-0f14691f575f tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:25.997558 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-6a400b4d-1d2e-4599-bbc7-1295ca0ac2d3 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:26.009881 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-6a400b4d-1d2e-4599-bbc7-1295ca0ac2d3 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:26.011652 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-6a400b4d-1d2e-4599-bbc7-1295ca0ac2d3 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:26.013857 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6a400b4d-1d2e-4599-bbc7-1295ca0ac2d3 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] 10.222.0.33 "GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e" status: 200 len: 1873 microversion: 2.42 time: 0.292889 Sep 23 04:38:26.015234 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 992/1939] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:38:25 2022] GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e => generated 1873 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:38:26.130249 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-252179e0-c6a4-41bb-8e93-0f14691f575f tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1244f3db540441a28d8413e510cfccad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b412c874d4e668b4a1a33dedb2c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:26.138451 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-252179e0-c6a4-41bb-8e93-0f14691f575f tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] 10.222.0.33 "GET /compute/v2.1/servers/7e90c852-5f27-4861-9b25-9ea1e475c0a9" status: 200 len: 1522 microversion: 2.1 time: 0.250026 Sep 23 04:38:26.158032 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 948/1940] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:25 2022] GET /compute/v2.1/servers/7e90c852-5f27-4861-9b25-9ea1e475c0a9 => generated 1522 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:26.393408 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e28eefcc-0c83-4b31-8505-ae4ea6537a72 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:26.395426 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e28eefcc-0c83-4b31-8505-ae4ea6537a72 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 9d2757b5-8933-4d44-bfa5-cb5054cd05c6] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:26.402592 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e28eefcc-0c83-4b31-8505-ae4ea6537a72 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:26.403348 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e28eefcc-0c83-4b31-8505-ae4ea6537a72 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:26.404034 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e28eefcc-0c83-4b31-8505-ae4ea6537a72 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:26.404783 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e28eefcc-0c83-4b31-8505-ae4ea6537a72 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:26.405251 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e28eefcc-0c83-4b31-8505-ae4ea6537a72 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:26.406357 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e28eefcc-0c83-4b31-8505-ae4ea6537a72 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:26.413456 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2c3d40c9-8836-4568-871a-c3391b48711e tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:26.414260 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-2c3d40c9-8836-4568-871a-c3391b48711e tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 13cee31b-8715-45f1-9aa7-37e885dcf785] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:26.422492 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2c3d40c9-8836-4568-871a-c3391b48711e tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:26.423371 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2c3d40c9-8836-4568-871a-c3391b48711e tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:26.424062 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2c3d40c9-8836-4568-871a-c3391b48711e tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:26.425285 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2c3d40c9-8836-4568-871a-c3391b48711e tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:26.426167 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2c3d40c9-8836-4568-871a-c3391b48711e tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:26.426848 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2c3d40c9-8836-4568-871a-c3391b48711e tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:26.639246 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e28eefcc-0c83-4b31-8505-ae4ea6537a72 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:26.647989 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e28eefcc-0c83-4b31-8505-ae4ea6537a72 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/9d2757b5-8933-4d44-bfa5-cb5054cd05c6" status: 200 len: 1314 microversion: 2.1 time: 0.259570 Sep 23 04:38:26.662162 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 993/1941] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:26 2022] GET /compute/v2.1/servers/9d2757b5-8933-4d44-bfa5-cb5054cd05c6 => generated 1314 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:26.669668 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3d5ffee4-fbca-4dec-acf4-b6ad7c8e4eaf tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:26.670654 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-3d5ffee4-fbca-4dec-acf4-b6ad7c8e4eaf tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] [instance: 94fc4134-9b8e-4dcd-bd96-5545bfd51c97] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:26.677584 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3d5ffee4-fbca-4dec-acf4-b6ad7c8e4eaf tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:26.678732 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3d5ffee4-fbca-4dec-acf4-b6ad7c8e4eaf tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:26.679423 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3d5ffee4-fbca-4dec-acf4-b6ad7c8e4eaf tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:26.680471 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3d5ffee4-fbca-4dec-acf4-b6ad7c8e4eaf tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:26.681294 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3d5ffee4-fbca-4dec-acf4-b6ad7c8e4eaf tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:26.682056 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3d5ffee4-fbca-4dec-acf4-b6ad7c8e4eaf tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:26.752076 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-2c3d40c9-8836-4568-871a-c3391b48711e tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:26.763191 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2c3d40c9-8836-4568-871a-c3391b48711e tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/13cee31b-8715-45f1-9aa7-37e885dcf785" status: 200 len: 1316 microversion: 2.1 time: 0.353710 Sep 23 04:38:26.763923 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 949/1942] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:26 2022] GET /compute/v2.1/servers/13cee31b-8715-45f1-9aa7-37e885dcf785 => generated 1316 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:26.777584 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-3d5ffee4-fbca-4dec-acf4-b6ad7c8e4eaf tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:26.783057 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-3d5ffee4-fbca-4dec-acf4-b6ad7c8e4eaf tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:26.784645 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-3d5ffee4-fbca-4dec-acf4-b6ad7c8e4eaf tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:26.790360 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3d5ffee4-fbca-4dec-acf4-b6ad7c8e4eaf tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] 10.222.0.33 "GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97" status: 200 len: 1447 microversion: 2.75 time: 0.126552 Sep 23 04:38:26.791296 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 994/1943] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:38:26 2022] GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97 => generated 1447 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:38:26.828354 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-a14a642d-ceec-449d-89b9-90d2685ce73f req-08c899e9-fa9c-4f10-9d73-7a783cb2245c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d2757b5-8933-4d44-bfa5-cb5054cd05c6", "name": "network-vif-plugged", "status": "completed", "tag": "c40cf720-53d3-445c-8509-cb2614d8aa78"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:38:26.838638 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-a14a642d-ceec-449d-89b9-90d2685ce73f req-08c899e9-fa9c-4f10-9d73-7a783cb2245c service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:26.839124 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-a14a642d-ceec-449d-89b9-90d2685ce73f req-08c899e9-fa9c-4f10-9d73-7a783cb2245c service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:26.839562 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-a14a642d-ceec-449d-89b9-90d2685ce73f req-08c899e9-fa9c-4f10-9d73-7a783cb2245c service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:27.040918 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f0221d67-4571-4ba2-b3fd-dfc173c73527 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:27.041541 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f0221d67-4571-4ba2-b3fd-dfc173c73527 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] [instance: 53745879-9973-4217-b1c5-b45f917db80e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:27.087598 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-a14a642d-ceec-449d-89b9-90d2685ce73f req-08c899e9-fa9c-4f10-9d73-7a783cb2245c service nova] Creating event network-vif-plugged:c40cf720-53d3-445c-8509-cb2614d8aa78 for instance 9d2757b5-8933-4d44-bfa5-cb5054cd05c6 on n-h2-846463-3 Sep 23 04:38:27.094302 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-a14a642d-ceec-449d-89b9-90d2685ce73f req-08c899e9-fa9c-4f10-9d73-7a783cb2245c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.269219 Sep 23 04:38:27.094494 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f0221d67-4571-4ba2-b3fd-dfc173c73527 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:27.096007 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 950/1944] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:38:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:38:27.100291 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f0221d67-4571-4ba2-b3fd-dfc173c73527 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:27.100786 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f0221d67-4571-4ba2-b3fd-dfc173c73527 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:27.101592 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f0221d67-4571-4ba2-b3fd-dfc173c73527 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:27.102100 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f0221d67-4571-4ba2-b3fd-dfc173c73527 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:27.102727 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f0221d67-4571-4ba2-b3fd-dfc173c73527 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:27.170234 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-cb142773-6ef4-4d17-b1c7-f2566419834f tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:27.170948 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-cb142773-6ef4-4d17-b1c7-f2566419834f tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] [instance: 7e90c852-5f27-4861-9b25-9ea1e475c0a9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:27.182007 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cb142773-6ef4-4d17-b1c7-f2566419834f tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:27.183437 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cb142773-6ef4-4d17-b1c7-f2566419834f tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:27.184730 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cb142773-6ef4-4d17-b1c7-f2566419834f tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:27.185615 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cb142773-6ef4-4d17-b1c7-f2566419834f tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:27.186344 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cb142773-6ef4-4d17-b1c7-f2566419834f tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:27.186940 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cb142773-6ef4-4d17-b1c7-f2566419834f tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:27.467894 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f0221d67-4571-4ba2-b3fd-dfc173c73527 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:27.482780 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f0221d67-4571-4ba2-b3fd-dfc173c73527 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:27.486767 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f0221d67-4571-4ba2-b3fd-dfc173c73527 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:27.488006 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f0221d67-4571-4ba2-b3fd-dfc173c73527 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] 10.222.0.33 "GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e" status: 200 len: 1873 microversion: 2.42 time: 0.451108 Sep 23 04:38:27.488580 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 995/1945] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:38:27 2022] GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e => generated 1873 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:38:27.521780 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-cb142773-6ef4-4d17-b1c7-f2566419834f tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1244f3db540441a28d8413e510cfccad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b412c874d4e668b4a1a33dedb2c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:27.529631 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-cb142773-6ef4-4d17-b1c7-f2566419834f tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] 10.222.0.33 "GET /compute/v2.1/servers/7e90c852-5f27-4861-9b25-9ea1e475c0a9" status: 200 len: 1522 microversion: 2.1 time: 0.368500 Sep 23 04:38:27.530855 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 951/1946] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:27 2022] GET /compute/v2.1/servers/7e90c852-5f27-4861-9b25-9ea1e475c0a9 => generated 1522 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:38:27.675452 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-87c5d0e4-7aa9-45d8-a4f3-47922837d81f tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:27.676360 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-87c5d0e4-7aa9-45d8-a4f3-47922837d81f tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 9d2757b5-8933-4d44-bfa5-cb5054cd05c6] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:27.683614 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-87c5d0e4-7aa9-45d8-a4f3-47922837d81f tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:27.684272 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-87c5d0e4-7aa9-45d8-a4f3-47922837d81f tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:27.684850 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-87c5d0e4-7aa9-45d8-a4f3-47922837d81f tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:27.685726 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-87c5d0e4-7aa9-45d8-a4f3-47922837d81f tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:27.686273 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-87c5d0e4-7aa9-45d8-a4f3-47922837d81f tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:27.687457 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-87c5d0e4-7aa9-45d8-a4f3-47922837d81f tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:27.822747 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3b05916b-9e15-4ba0-9211-7bad31903d2a tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:27.822747 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3b05916b-9e15-4ba0-9211-7bad31903d2a tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 13cee31b-8715-45f1-9aa7-37e885dcf785] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:27.865327 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3b05916b-9e15-4ba0-9211-7bad31903d2a tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:27.865327 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3b05916b-9e15-4ba0-9211-7bad31903d2a tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:27.865327 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3b05916b-9e15-4ba0-9211-7bad31903d2a tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:27.865327 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3b05916b-9e15-4ba0-9211-7bad31903d2a tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:27.865327 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3b05916b-9e15-4ba0-9211-7bad31903d2a tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:27.865327 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3b05916b-9e15-4ba0-9211-7bad31903d2a tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:27.923848 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-87c5d0e4-7aa9-45d8-a4f3-47922837d81f tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:27.935109 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-87c5d0e4-7aa9-45d8-a4f3-47922837d81f tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/9d2757b5-8933-4d44-bfa5-cb5054cd05c6" status: 200 len: 1314 microversion: 2.1 time: 0.264008 Sep 23 04:38:27.936445 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 996/1947] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:27 2022] GET /compute/v2.1/servers/9d2757b5-8933-4d44-bfa5-cb5054cd05c6 => generated 1314 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:27.942253 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-946b3d12-1d58-49e2-9d98-2d7b3073ca01 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:27.943072 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-946b3d12-1d58-49e2-9d98-2d7b3073ca01 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] [instance: 94fc4134-9b8e-4dcd-bd96-5545bfd51c97] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:27.955983 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-946b3d12-1d58-49e2-9d98-2d7b3073ca01 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:27.956952 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-946b3d12-1d58-49e2-9d98-2d7b3073ca01 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:27.957589 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-946b3d12-1d58-49e2-9d98-2d7b3073ca01 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:27.958805 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-946b3d12-1d58-49e2-9d98-2d7b3073ca01 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:27.959470 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-946b3d12-1d58-49e2-9d98-2d7b3073ca01 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:27.960277 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-946b3d12-1d58-49e2-9d98-2d7b3073ca01 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:28.078257 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-946b3d12-1d58-49e2-9d98-2d7b3073ca01 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:28.092870 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-946b3d12-1d58-49e2-9d98-2d7b3073ca01 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:28.097153 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-946b3d12-1d58-49e2-9d98-2d7b3073ca01 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:28.134167 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-946b3d12-1d58-49e2-9d98-2d7b3073ca01 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] 10.222.0.33 "GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97" status: 200 len: 1447 microversion: 2.75 time: 0.185047 Sep 23 04:38:28.134167 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 997/1948] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:38:27 2022] GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97 => generated 1447 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:38:28.134442 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-3b05916b-9e15-4ba0-9211-7bad31903d2a tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:28.139598 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3b05916b-9e15-4ba0-9211-7bad31903d2a tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/13cee31b-8715-45f1-9aa7-37e885dcf785" status: 200 len: 1465 microversion: 2.1 time: 0.335758 Sep 23 04:38:28.140432 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 952/1949] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:27 2022] GET /compute/v2.1/servers/13cee31b-8715-45f1-9aa7-37e885dcf785 => generated 1465 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:28.162918 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5fed658a-1627-4f0c-a177-5b2dd3b825e1 tempest-ServersOnMultiNodesTest-617918424 tempest-ServersOnMultiNodesTest-617918424-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:28.163539 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-5fed658a-1627-4f0c-a177-5b2dd3b825e1 tempest-ServersOnMultiNodesTest-617918424 tempest-ServersOnMultiNodesTest-617918424-project-admin] [instance: 13cee31b-8715-45f1-9aa7-37e885dcf785] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:28.173128 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5fed658a-1627-4f0c-a177-5b2dd3b825e1 tempest-ServersOnMultiNodesTest-617918424 tempest-ServersOnMultiNodesTest-617918424-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:28.173733 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5fed658a-1627-4f0c-a177-5b2dd3b825e1 tempest-ServersOnMultiNodesTest-617918424 tempest-ServersOnMultiNodesTest-617918424-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:28.174273 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5fed658a-1627-4f0c-a177-5b2dd3b825e1 tempest-ServersOnMultiNodesTest-617918424 tempest-ServersOnMultiNodesTest-617918424-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:28.175348 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5fed658a-1627-4f0c-a177-5b2dd3b825e1 tempest-ServersOnMultiNodesTest-617918424 tempest-ServersOnMultiNodesTest-617918424-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:28.176180 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5fed658a-1627-4f0c-a177-5b2dd3b825e1 tempest-ServersOnMultiNodesTest-617918424 tempest-ServersOnMultiNodesTest-617918424-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:28.183415 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5fed658a-1627-4f0c-a177-5b2dd3b825e1 tempest-ServersOnMultiNodesTest-617918424 tempest-ServersOnMultiNodesTest-617918424-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:28.332703 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:38:28.339530 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5fed658a-1627-4f0c-a177-5b2dd3b825e1 tempest-ServersOnMultiNodesTest-617918424 tempest-ServersOnMultiNodesTest-617918424-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/13cee31b-8715-45f1-9aa7-37e885dcf785" status: 200 len: 1616 microversion: 2.1 time: 0.180593 Sep 23 04:38:28.340679 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 998/1950] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:28 2022] GET /compute/v2.1/servers/13cee31b-8715-45f1-9aa7-37e885dcf785 => generated 1616 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:28.368800 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-75f2695c-cd01-47af-9502-86a591db3cb2 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:28.369312 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-75f2695c-cd01-47af-9502-86a591db3cb2 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 13cee31b-8715-45f1-9aa7-37e885dcf785] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:28.388469 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-75f2695c-cd01-47af-9502-86a591db3cb2 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:28.391128 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-75f2695c-cd01-47af-9502-86a591db3cb2 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:28.391128 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-75f2695c-cd01-47af-9502-86a591db3cb2 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:28.395467 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-75f2695c-cd01-47af-9502-86a591db3cb2 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:28.395977 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-75f2695c-cd01-47af-9502-86a591db3cb2 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:28.399602 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-75f2695c-cd01-47af-9502-86a591db3cb2 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:28.444278 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-75f2695c-cd01-47af-9502-86a591db3cb2 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 13cee31b-8715-45f1-9aa7-37e885dcf785] Going to try to terminate instance {{(pid=122698) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:38:28.516695 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-42a7e38a-8433-40c6-a085-c6eae3a644f9 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:28.518976 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-42a7e38a-8433-40c6-a085-c6eae3a644f9 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] [instance: 53745879-9973-4217-b1c5-b45f917db80e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:28.527361 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-42a7e38a-8433-40c6-a085-c6eae3a644f9 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:28.532082 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-42a7e38a-8433-40c6-a085-c6eae3a644f9 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:28.532082 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-42a7e38a-8433-40c6-a085-c6eae3a644f9 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:28.532082 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-42a7e38a-8433-40c6-a085-c6eae3a644f9 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:28.532082 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-42a7e38a-8433-40c6-a085-c6eae3a644f9 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:28.532082 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-42a7e38a-8433-40c6-a085-c6eae3a644f9 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:28.785465 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-42a7e38a-8433-40c6-a085-c6eae3a644f9 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:28.798822 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-42a7e38a-8433-40c6-a085-c6eae3a644f9 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:28.800942 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-42a7e38a-8433-40c6-a085-c6eae3a644f9 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:28.802397 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-42a7e38a-8433-40c6-a085-c6eae3a644f9 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] 10.222.0.33 "GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e" status: 200 len: 1873 microversion: 2.42 time: 0.292526 Sep 23 04:38:28.803231 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 999/1951] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:38:28 2022] GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e => generated 1873 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:38:28.808702 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-bc96d927-c408-40a4-af85-f8e9a435785c tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:28.814163 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-bc96d927-c408-40a4-af85-f8e9a435785c tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] [instance: 7e90c852-5f27-4861-9b25-9ea1e475c0a9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:28.816098 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bc96d927-c408-40a4-af85-f8e9a435785c tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:28.816906 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bc96d927-c408-40a4-af85-f8e9a435785c tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:28.817352 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bc96d927-c408-40a4-af85-f8e9a435785c tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:28.818105 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bc96d927-c408-40a4-af85-f8e9a435785c tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:28.818577 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bc96d927-c408-40a4-af85-f8e9a435785c tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:28.818992 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bc96d927-c408-40a4-af85-f8e9a435785c tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:28.860096 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-75f2695c-cd01-47af-9502-86a591db3cb2 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "DELETE /compute/v2.1/servers/13cee31b-8715-45f1-9aa7-37e885dcf785" status: 204 len: 0 microversion: 2.1 time: 0.487335 Sep 23 04:38:28.860096 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 953/1952] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:38:28 2022] DELETE /compute/v2.1/servers/13cee31b-8715-45f1-9aa7-37e885dcf785 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 23 04:38:28.871193 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5b4751e0-5b34-48fa-8eec-50a27a7bb8bc tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:28.873109 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5b4751e0-5b34-48fa-8eec-50a27a7bb8bc tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 13cee31b-8715-45f1-9aa7-37e885dcf785] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:28.881827 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5b4751e0-5b34-48fa-8eec-50a27a7bb8bc tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:28.882791 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5b4751e0-5b34-48fa-8eec-50a27a7bb8bc tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:28.884123 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5b4751e0-5b34-48fa-8eec-50a27a7bb8bc tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:28.885095 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5b4751e0-5b34-48fa-8eec-50a27a7bb8bc tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:28.885963 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5b4751e0-5b34-48fa-8eec-50a27a7bb8bc tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:28.886626 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5b4751e0-5b34-48fa-8eec-50a27a7bb8bc tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:29.147928 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-bc96d927-c408-40a4-af85-f8e9a435785c tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1244f3db540441a28d8413e510cfccad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b412c874d4e668b4a1a33dedb2c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:29.165567 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-5b4751e0-5b34-48fa-8eec-50a27a7bb8bc tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:29.175921 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-bc96d927-c408-40a4-af85-f8e9a435785c tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] 10.222.0.33 "GET /compute/v2.1/servers/7e90c852-5f27-4861-9b25-9ea1e475c0a9" status: 200 len: 1522 microversion: 2.1 time: 0.371264 Sep 23 04:38:29.179856 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5b4751e0-5b34-48fa-8eec-50a27a7bb8bc tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/13cee31b-8715-45f1-9aa7-37e885dcf785" status: 200 len: 1471 microversion: 2.1 time: 0.319565 Sep 23 04:38:29.180042 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1000/1953] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:28 2022] GET /compute/v2.1/servers/7e90c852-5f27-4861-9b25-9ea1e475c0a9 => generated 1522 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:29.194454 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 954/1954] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:28 2022] GET /compute/v2.1/servers/13cee31b-8715-45f1-9aa7-37e885dcf785 => generated 1471 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:29.194454 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6f0ee016-96e3-4ddc-af5f-47bebd4b495b tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:29.194454 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-6f0ee016-96e3-4ddc-af5f-47bebd4b495b tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] [instance: 94fc4134-9b8e-4dcd-bd96-5545bfd51c97] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:29.205695 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6f0ee016-96e3-4ddc-af5f-47bebd4b495b tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:29.208849 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a269f5d6-e91c-4a67-b830-1a70c727389e tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:29.209019 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6f0ee016-96e3-4ddc-af5f-47bebd4b495b tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:29.209499 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6f0ee016-96e3-4ddc-af5f-47bebd4b495b tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:29.210332 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a269f5d6-e91c-4a67-b830-1a70c727389e tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 9d2757b5-8933-4d44-bfa5-cb5054cd05c6] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:29.210472 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6f0ee016-96e3-4ddc-af5f-47bebd4b495b tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:29.214584 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6f0ee016-96e3-4ddc-af5f-47bebd4b495b tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:29.216845 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6f0ee016-96e3-4ddc-af5f-47bebd4b495b tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:29.221388 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a269f5d6-e91c-4a67-b830-1a70c727389e tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:29.225961 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a269f5d6-e91c-4a67-b830-1a70c727389e tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:29.225961 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a269f5d6-e91c-4a67-b830-1a70c727389e tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:29.225961 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a269f5d6-e91c-4a67-b830-1a70c727389e tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:29.225961 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a269f5d6-e91c-4a67-b830-1a70c727389e tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:29.225961 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a269f5d6-e91c-4a67-b830-1a70c727389e tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:29.349197 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6f0ee016-96e3-4ddc-af5f-47bebd4b495b tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:29.358023 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6f0ee016-96e3-4ddc-af5f-47bebd4b495b tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:29.359767 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6f0ee016-96e3-4ddc-af5f-47bebd4b495b tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:29.365273 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-6f0ee016-96e3-4ddc-af5f-47bebd4b495b tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] 10.222.0.33 "GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97" status: 200 len: 1447 microversion: 2.75 time: 0.181198 Sep 23 04:38:29.366210 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 955/1955] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:38:29 2022] GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97 => generated 1447 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:38:29.554015 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a269f5d6-e91c-4a67-b830-1a70c727389e tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:29.562267 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a269f5d6-e91c-4a67-b830-1a70c727389e tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/9d2757b5-8933-4d44-bfa5-cb5054cd05c6" status: 200 len: 1500 microversion: 2.1 time: 0.361291 Sep 23 04:38:29.562850 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1001/1956] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:29 2022] GET /compute/v2.1/servers/9d2757b5-8933-4d44-bfa5-cb5054cd05c6 => generated 1500 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:29.830074 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3e09838c-8fe0-4529-916d-298c40f12230 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:29.830886 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3e09838c-8fe0-4529-916d-298c40f12230 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] [instance: 53745879-9973-4217-b1c5-b45f917db80e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:29.840278 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:38:29.845266 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3e09838c-8fe0-4529-916d-298c40f12230 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:29.846067 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3e09838c-8fe0-4529-916d-298c40f12230 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:29.846866 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3e09838c-8fe0-4529-916d-298c40f12230 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:29.847788 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3e09838c-8fe0-4529-916d-298c40f12230 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:29.848474 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3e09838c-8fe0-4529-916d-298c40f12230 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:29.849197 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3e09838c-8fe0-4529-916d-298c40f12230 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:30.214475 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a6d6f086-ec35-416f-9cf6-0096bee78898 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:30.214475 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a6d6f086-ec35-416f-9cf6-0096bee78898 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] [instance: 7e90c852-5f27-4861-9b25-9ea1e475c0a9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:30.215351 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a6d6f086-ec35-416f-9cf6-0096bee78898 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:30.216074 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a6d6f086-ec35-416f-9cf6-0096bee78898 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:30.216720 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a6d6f086-ec35-416f-9cf6-0096bee78898 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:30.217616 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a6d6f086-ec35-416f-9cf6-0096bee78898 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:30.218278 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a6d6f086-ec35-416f-9cf6-0096bee78898 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:30.218882 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a6d6f086-ec35-416f-9cf6-0096bee78898 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:30.269083 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-3e09838c-8fe0-4529-916d-298c40f12230 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:30.286286 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-3e09838c-8fe0-4529-916d-298c40f12230 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:30.291142 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-3e09838c-8fe0-4529-916d-298c40f12230 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:30.293526 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3e09838c-8fe0-4529-916d-298c40f12230 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] 10.222.0.33 "GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e" status: 200 len: 1873 microversion: 2.42 time: 0.468867 Sep 23 04:38:30.295395 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 956/1957] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:38:29 2022] GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e => generated 1873 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:38:30.320081 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2cd567f9-5efc-4d68-bd43-0b4c4b31fc5a tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:30.333348 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-2cd567f9-5efc-4d68-bd43-0b4c4b31fc5a tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 13cee31b-8715-45f1-9aa7-37e885dcf785] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:30.358878 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2cd567f9-5efc-4d68-bd43-0b4c4b31fc5a tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:30.362419 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2cd567f9-5efc-4d68-bd43-0b4c4b31fc5a tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:30.364218 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2cd567f9-5efc-4d68-bd43-0b4c4b31fc5a tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:30.366651 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2cd567f9-5efc-4d68-bd43-0b4c4b31fc5a tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:30.367424 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2cd567f9-5efc-4d68-bd43-0b4c4b31fc5a tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:30.369717 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2cd567f9-5efc-4d68-bd43-0b4c4b31fc5a tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:30.542377 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=6 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:38:30.587199 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a6d6f086-ec35-416f-9cf6-0096bee78898 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1244f3db540441a28d8413e510cfccad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b412c874d4e668b4a1a33dedb2c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:30.613305 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a6d6f086-ec35-416f-9cf6-0096bee78898 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] 10.222.0.33 "GET /compute/v2.1/servers/7e90c852-5f27-4861-9b25-9ea1e475c0a9" status: 200 len: 1522 microversion: 2.1 time: 0.412455 Sep 23 04:38:30.614314 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1002/1958] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:30 2022] GET /compute/v2.1/servers/7e90c852-5f27-4861-9b25-9ea1e475c0a9 => generated 1522 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:38:30.619595 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b3b45e37-d3fb-4fb4-8cac-4ec455c14962 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:30.620319 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b3b45e37-d3fb-4fb4-8cac-4ec455c14962 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] [instance: 94fc4134-9b8e-4dcd-bd96-5545bfd51c97] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:30.627781 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b3b45e37-d3fb-4fb4-8cac-4ec455c14962 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:30.628656 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b3b45e37-d3fb-4fb4-8cac-4ec455c14962 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:30.629390 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b3b45e37-d3fb-4fb4-8cac-4ec455c14962 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:30.631083 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b3b45e37-d3fb-4fb4-8cac-4ec455c14962 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:30.631937 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b3b45e37-d3fb-4fb4-8cac-4ec455c14962 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:30.632849 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b3b45e37-d3fb-4fb4-8cac-4ec455c14962 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:30.671106 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-2cd567f9-5efc-4d68-bd43-0b4c4b31fc5a tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:30.685059 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2cd567f9-5efc-4d68-bd43-0b4c4b31fc5a tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/13cee31b-8715-45f1-9aa7-37e885dcf785" status: 200 len: 1471 microversion: 2.1 time: 0.387572 Sep 23 04:38:30.685999 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 957/1959] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:30 2022] GET /compute/v2.1/servers/13cee31b-8715-45f1-9aa7-37e885dcf785 => generated 1471 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:30.769609 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b3b45e37-d3fb-4fb4-8cac-4ec455c14962 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:30.778454 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b3b45e37-d3fb-4fb4-8cac-4ec455c14962 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:30.780950 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b3b45e37-d3fb-4fb4-8cac-4ec455c14962 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:30.785275 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b3b45e37-d3fb-4fb4-8cac-4ec455c14962 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] 10.222.0.33 "GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97" status: 200 len: 1447 microversion: 2.75 time: 0.169636 Sep 23 04:38:30.786228 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1003/1960] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:38:30 2022] GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97 => generated 1447 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:38:31.349424 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-50603967-e206-4551-a994-4bcac9525fe5 req-2aed7c95-c40c-4faf-99a5-b39ca03f22c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13cee31b-8715-45f1-9aa7-37e885dcf785", "name": "network-vif-deleted", "tag": "29201119-4365-4bac-abee-5b7e094cfca7"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:38:31.362755 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0b89af08-3aba-47dc-a9fe-ce22ae5bfd28 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:31.369631 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-0b89af08-3aba-47dc-a9fe-ce22ae5bfd28 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] [instance: 53745879-9973-4217-b1c5-b45f917db80e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:31.405155 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0b89af08-3aba-47dc-a9fe-ce22ae5bfd28 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:31.413334 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-50603967-e206-4551-a994-4bcac9525fe5 req-2aed7c95-c40c-4faf-99a5-b39ca03f22c9 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:31.413334 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-50603967-e206-4551-a994-4bcac9525fe5 req-2aed7c95-c40c-4faf-99a5-b39ca03f22c9 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:31.413599 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0b89af08-3aba-47dc-a9fe-ce22ae5bfd28 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:31.413599 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0b89af08-3aba-47dc-a9fe-ce22ae5bfd28 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:31.413599 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0b89af08-3aba-47dc-a9fe-ce22ae5bfd28 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:31.414512 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-50603967-e206-4551-a994-4bcac9525fe5 req-2aed7c95-c40c-4faf-99a5-b39ca03f22c9 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:31.414696 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0b89af08-3aba-47dc-a9fe-ce22ae5bfd28 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:31.414696 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0b89af08-3aba-47dc-a9fe-ce22ae5bfd28 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:31.445865 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-50603967-e206-4551-a994-4bcac9525fe5 req-2aed7c95-c40c-4faf-99a5-b39ca03f22c9 service nova] Creating event network-vif-deleted:29201119-4365-4bac-abee-5b7e094cfca7 for instance 13cee31b-8715-45f1-9aa7-37e885dcf785 on n-h1-846463-3 Sep 23 04:38:31.453339 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-50603967-e206-4551-a994-4bcac9525fe5 req-2aed7c95-c40c-4faf-99a5-b39ca03f22c9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111331 Sep 23 04:38:31.454970 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1004/1961] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:38:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:38:31.535041 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=6 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:38:31.640535 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-84c16c4a-845b-49d1-ba79-c4d64c1cc432 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:31.642000 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-84c16c4a-845b-49d1-ba79-c4d64c1cc432 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] [instance: 7e90c852-5f27-4861-9b25-9ea1e475c0a9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:31.662801 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-84c16c4a-845b-49d1-ba79-c4d64c1cc432 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:31.663557 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-84c16c4a-845b-49d1-ba79-c4d64c1cc432 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:31.664227 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-84c16c4a-845b-49d1-ba79-c4d64c1cc432 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:31.665178 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-84c16c4a-845b-49d1-ba79-c4d64c1cc432 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:31.665958 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-84c16c4a-845b-49d1-ba79-c4d64c1cc432 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:31.666957 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-84c16c4a-845b-49d1-ba79-c4d64c1cc432 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:31.866162 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-0b89af08-3aba-47dc-a9fe-ce22ae5bfd28 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:31.883495 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-0b89af08-3aba-47dc-a9fe-ce22ae5bfd28 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:31.908088 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-0b89af08-3aba-47dc-a9fe-ce22ae5bfd28 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:31.918042 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0b89af08-3aba-47dc-a9fe-ce22ae5bfd28 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] 10.222.0.33 "GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e" status: 200 len: 1873 microversion: 2.42 time: 0.581498 Sep 23 04:38:31.934688 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 958/1962] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:38:31 2022] GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e => generated 1873 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:38:31.950085 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a7b92db3-549b-4356-a0cd-4724b6fae7c3 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:31.950710 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a7b92db3-549b-4356-a0cd-4724b6fae7c3 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 13cee31b-8715-45f1-9aa7-37e885dcf785] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:31.966295 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a7b92db3-549b-4356-a0cd-4724b6fae7c3 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:31.967066 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a7b92db3-549b-4356-a0cd-4724b6fae7c3 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:31.967708 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a7b92db3-549b-4356-a0cd-4724b6fae7c3 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:31.968823 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a7b92db3-549b-4356-a0cd-4724b6fae7c3 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:31.969995 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a7b92db3-549b-4356-a0cd-4724b6fae7c3 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:31.971200 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a7b92db3-549b-4356-a0cd-4724b6fae7c3 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:32.038300 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a7b92db3-549b-4356-a0cd-4724b6fae7c3 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:32.039118 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a7b92db3-549b-4356-a0cd-4724b6fae7c3 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:32.039759 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a7b92db3-549b-4356-a0cd-4724b6fae7c3 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:32.040419 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-a7b92db3-549b-4356-a0cd-4724b6fae7c3 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lazy-loading 'fault' on Instance uuid 13cee31b-8715-45f1-9aa7-37e885dcf785 {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:38:32.091329 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=14 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:38:32.450663 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a7b92db3-549b-4356-a0cd-4724b6fae7c3 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:32.462254 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a7b92db3-549b-4356-a0cd-4724b6fae7c3 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/13cee31b-8715-45f1-9aa7-37e885dcf785" status: 200 len: 1306 microversion: 2.1 time: 0.525801 Sep 23 04:38:32.463708 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 959/1963] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:31 2022] GET /compute/v2.1/servers/13cee31b-8715-45f1-9aa7-37e885dcf785 => generated 1306 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:32.468689 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-204d800a-9d9b-4edc-980d-bacb9c8cc3d7 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:32.470085 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-204d800a-9d9b-4edc-980d-bacb9c8cc3d7 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] [instance: 94fc4134-9b8e-4dcd-bd96-5545bfd51c97] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:32.476408 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-204d800a-9d9b-4edc-980d-bacb9c8cc3d7 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:32.477128 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-204d800a-9d9b-4edc-980d-bacb9c8cc3d7 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:32.477564 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-204d800a-9d9b-4edc-980d-bacb9c8cc3d7 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:32.478298 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-204d800a-9d9b-4edc-980d-bacb9c8cc3d7 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:32.478938 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-204d800a-9d9b-4edc-980d-bacb9c8cc3d7 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:32.479543 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-204d800a-9d9b-4edc-980d-bacb9c8cc3d7 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:32.559028 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-84c16c4a-845b-49d1-ba79-c4d64c1cc432 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1244f3db540441a28d8413e510cfccad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b412c874d4e668b4a1a33dedb2c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:32.570772 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-84c16c4a-845b-49d1-ba79-c4d64c1cc432 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] 10.222.0.33 "GET /compute/v2.1/servers/7e90c852-5f27-4861-9b25-9ea1e475c0a9" status: 200 len: 1522 microversion: 2.1 time: 0.934373 Sep 23 04:38:32.589075 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1005/1964] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:31 2022] GET /compute/v2.1/servers/7e90c852-5f27-4861-9b25-9ea1e475c0a9 => generated 1522 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:38:32.610999 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-204d800a-9d9b-4edc-980d-bacb9c8cc3d7 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:32.622236 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-204d800a-9d9b-4edc-980d-bacb9c8cc3d7 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:32.623566 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-204d800a-9d9b-4edc-980d-bacb9c8cc3d7 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:32.631369 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-204d800a-9d9b-4edc-980d-bacb9c8cc3d7 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] 10.222.0.33 "GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97" status: 200 len: 1447 microversion: 2.75 time: 0.166397 Sep 23 04:38:32.641968 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 960/1965] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:38:32 2022] GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97 => generated 1447 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:38:32.958649 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-81e09bc4-e96e-443c-bf69-df508855c91c tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:32.959277 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-81e09bc4-e96e-443c-bf69-df508855c91c tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] [instance: 53745879-9973-4217-b1c5-b45f917db80e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:32.995981 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-81e09bc4-e96e-443c-bf69-df508855c91c tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:32.998322 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-81e09bc4-e96e-443c-bf69-df508855c91c tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:33.000280 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-81e09bc4-e96e-443c-bf69-df508855c91c tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:33.002697 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-81e09bc4-e96e-443c-bf69-df508855c91c tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:33.003365 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-81e09bc4-e96e-443c-bf69-df508855c91c tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:33.005034 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-81e09bc4-e96e-443c-bf69-df508855c91c tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:33.310800 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-36109fca-8241-4158-97be-58a0cd4c965c tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "057f0a46-80ac-4869-95fe-3d35af3d0ec1"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:38:33.313872 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-36109fca-8241-4158-97be-58a0cd4c965c tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 9d2757b5-8933-4d44-bfa5-cb5054cd05c6] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:33.327883 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-81e09bc4-e96e-443c-bf69-df508855c91c tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:33.340190 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-36109fca-8241-4158-97be-58a0cd4c965c tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:33.340926 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-36109fca-8241-4158-97be-58a0cd4c965c tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:33.341380 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-36109fca-8241-4158-97be-58a0cd4c965c tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:33.342319 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-36109fca-8241-4158-97be-58a0cd4c965c tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:33.342961 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-36109fca-8241-4158-97be-58a0cd4c965c tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:33.343976 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-36109fca-8241-4158-97be-58a0cd4c965c tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:33.348362 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-81e09bc4-e96e-443c-bf69-df508855c91c tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:33.350709 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-81e09bc4-e96e-443c-bf69-df508855c91c tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:33.352752 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-81e09bc4-e96e-443c-bf69-df508855c91c tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] 10.222.0.33 "GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e" status: 200 len: 1873 microversion: 2.42 time: 0.405695 Sep 23 04:38:33.354086 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1006/1966] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:38:32 2022] GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e => generated 1873 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:38:33.488587 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c241b952-868c-49dd-987b-6a343bce5555 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:33.489216 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c241b952-868c-49dd-987b-6a343bce5555 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 13cee31b-8715-45f1-9aa7-37e885dcf785] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:33.501181 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c241b952-868c-49dd-987b-6a343bce5555 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:33.501181 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c241b952-868c-49dd-987b-6a343bce5555 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:33.501181 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c241b952-868c-49dd-987b-6a343bce5555 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:33.504684 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c241b952-868c-49dd-987b-6a343bce5555 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:33.504996 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c241b952-868c-49dd-987b-6a343bce5555 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:33.505479 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c241b952-868c-49dd-987b-6a343bce5555 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:33.521067 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-c241b952-868c-49dd-987b-6a343bce5555 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] HTTP exception thrown: Instance 13cee31b-8715-45f1-9aa7-37e885dcf785 could not be found. Sep 23 04:38:33.522752 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c241b952-868c-49dd-987b-6a343bce5555 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Request method failure captured: Sep 23 04:38:33.522752 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/13cee31b-8715-45f1-9aa7-37e885dcf785 HTTP/1.1 Sep 23 04:38:33.522752 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:38:33.522752 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:38:33.522752 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:38:33.522752 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:38:33.522752 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:38:33.522752 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:38:33.522752 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:38:33.522752 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:38:33.522752 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTedAlFPeFmnDF7aT3i0aUDQGJFgGZnI-hp3AgXCkcO3hSwSmXlMqV4YX4M2zE_tzLZBCRNva2-mnxAIXvcDQ4ADhbq0RDumL2tq0UzsAkBd3JY4bJ4oVHe0Nm8SGB15yLY37BALihKvv5H7mxEOffoAs77PenOe-f2xwUXiU1RwOEo Sep 23 04:38:33.522752 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:38:33.522752 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:38:33.522752 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:38:33.522752 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:38:33.522752 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:38:33.522752 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:38:33.522752 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: f5db359a60174c45afa2bf06e23a46c4 Sep 23 04:38:33.522752 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ServersOnMultiNodesTest-604470560 Sep 23 04:38:33.522752 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:38:33.522752 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:38:33.522752 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f5db359a60174c45afa2bf06e23a46c4", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f5db359a60174c45afa2bf06e23a46c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f5db359a60174c45afa2bf06e23a46c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f5db359a60174c45afa2bf06e23a46c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:38:33.522752 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ServersOnMultiNodesTest-604470560 Sep 23 04:38:33.522752 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: f5db359a60174c45afa2bf06e23a46c4 Sep 23 04:38:33.522752 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-604470560 Sep 23 04:38:33.522752 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ServersOnMultiNodesTest-604470560-project Sep 23 04:38:33.522752 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:38:33.522752 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:38:33.522752 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: da08af8193dd490b93278385583f24c0 Sep 23 04:38:33.522752 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ServersOnMultiNodesTest-604470560-project Sep 23 04:38:33.522752 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:38:33.522752 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 13cee31b-8715-45f1-9aa7-37e885dcf785 could not be found. Sep 23 04:38:33.522752 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '13cee31b-8715-45f1-9aa7-37e885dcf785'} Sep 23 04:38:33.522752 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:38:33.522752 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:38:33.522752 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:38:33.522752 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:38:33.522752 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:38:33.522752 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:38:33.522752 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:38:33.522752 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:38:33.522752 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:38:33.522752 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:38:33.522752 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13cee31b-8715-45f1-9aa7-37e885dcf785 could not be found. Sep 23 04:38:33.522752 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:38:33.522752 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:38:33.522752 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:38:33.522752 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:38:33.522752 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:38:33.522752 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:38:33.522752 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:38:33.522752 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:38:33.522752 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:38:33.522752 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:38:33.522752 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:38:33.522752 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:38:33.522752 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:38:33.522752 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:38:33.522752 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:38:33.522752 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:38:33.522752 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13cee31b-8715-45f1-9aa7-37e885dcf785 could not be found. Sep 23 04:38:33.522752 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:38:33.522752 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:38:33.522752 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:38:33.534989 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:38:33.534989 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:38:33.534989 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:38:33.534989 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:38:33.534989 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:38:33.534989 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13cee31b-8715-45f1-9aa7-37e885dcf785 could not be found. Sep 23 04:38:33.534989 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:38:33.534989 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c241b952-868c-49dd-987b-6a343bce5555 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Returning 404 to user: Instance 13cee31b-8715-45f1-9aa7-37e885dcf785 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:38:33.534989 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c241b952-868c-49dd-987b-6a343bce5555 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/13cee31b-8715-45f1-9aa7-37e885dcf785" status: 404 len: 111 microversion: 2.1 time: 0.041216 Sep 23 04:38:33.534989 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1007/1967] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:33 2022] GET /compute/v2.1/servers/13cee31b-8715-45f1-9aa7-37e885dcf785 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 04:38:33.534989 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-871966a6-ba2f-4b5e-ae01-5a7ced47be68 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:33.534989 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-871966a6-ba2f-4b5e-ae01-5a7ced47be68 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: dc2293d8-bde5-4b6a-a59f-6238703e83cc] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:33.539524 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-871966a6-ba2f-4b5e-ae01-5a7ced47be68 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:33.540014 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-871966a6-ba2f-4b5e-ae01-5a7ced47be68 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:33.540454 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-871966a6-ba2f-4b5e-ae01-5a7ced47be68 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:33.541148 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-871966a6-ba2f-4b5e-ae01-5a7ced47be68 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:33.541605 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-871966a6-ba2f-4b5e-ae01-5a7ced47be68 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:33.542062 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-871966a6-ba2f-4b5e-ae01-5a7ced47be68 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:33.568973 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-871966a6-ba2f-4b5e-ae01-5a7ced47be68 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: dc2293d8-bde5-4b6a-a59f-6238703e83cc] Going to try to terminate instance {{(pid=122699) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:38:33.612683 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:38:33.807055 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:38:33.866463 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-871966a6-ba2f-4b5e-ae01-5a7ced47be68 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "DELETE /compute/v2.1/servers/dc2293d8-bde5-4b6a-a59f-6238703e83cc" status: 204 len: 0 microversion: 2.1 time: 0.337326 Sep 23 04:38:33.867064 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1008/1968] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:38:33 2022] DELETE /compute/v2.1/servers/dc2293d8-bde5-4b6a-a59f-6238703e83cc => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 23 04:38:33.873560 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-df5b3742-a4de-4575-9d81-d97490bda591 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:33.876859 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-df5b3742-a4de-4575-9d81-d97490bda591 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] [instance: 7e90c852-5f27-4861-9b25-9ea1e475c0a9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:33.884597 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-df5b3742-a4de-4575-9d81-d97490bda591 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:33.885102 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-df5b3742-a4de-4575-9d81-d97490bda591 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:33.885619 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-df5b3742-a4de-4575-9d81-d97490bda591 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:33.886492 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-df5b3742-a4de-4575-9d81-d97490bda591 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:33.887433 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-df5b3742-a4de-4575-9d81-d97490bda591 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:33.887871 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-df5b3742-a4de-4575-9d81-d97490bda591 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:34.242437 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-36109fca-8241-4158-97be-58a0cd4c965c tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "POST /compute/v2.1/servers/9d2757b5-8933-4d44-bfa5-cb5054cd05c6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.935564 Sep 23 04:38:34.242999 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 961/1969] 10.222.0.33 () {60 vars in 1323 bytes} [Fri Sep 23 04:38:33 2022] POST /compute/v2.1/servers/9d2757b5-8933-4d44-bfa5-cb5054cd05c6/os-volume_attachments => generated 194 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:38:34.257347 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f7244053-f48c-4202-a3ff-7ff88bfd790d tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:34.258710 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f7244053-f48c-4202-a3ff-7ff88bfd790d tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] [instance: 94fc4134-9b8e-4dcd-bd96-5545bfd51c97] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:34.266764 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f7244053-f48c-4202-a3ff-7ff88bfd790d tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:34.267557 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f7244053-f48c-4202-a3ff-7ff88bfd790d tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:34.268182 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f7244053-f48c-4202-a3ff-7ff88bfd790d tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:34.272626 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f7244053-f48c-4202-a3ff-7ff88bfd790d tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:34.273580 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f7244053-f48c-4202-a3ff-7ff88bfd790d tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:34.274248 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f7244053-f48c-4202-a3ff-7ff88bfd790d tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:34.484954 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f7244053-f48c-4202-a3ff-7ff88bfd790d tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:34.499024 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f7244053-f48c-4202-a3ff-7ff88bfd790d tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:34.499024 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f7244053-f48c-4202-a3ff-7ff88bfd790d tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:34.510399 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f7244053-f48c-4202-a3ff-7ff88bfd790d tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] 10.222.0.33 "GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97" status: 200 len: 1447 microversion: 2.75 time: 0.265936 Sep 23 04:38:34.510994 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 962/1970] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:38:34 2022] GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97 => generated 1447 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:38:34.516936 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-45cbed40-c38a-4a82-a0f1-d5cd065ca274 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:34.517679 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-45cbed40-c38a-4a82-a0f1-d5cd065ca274 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: dc2293d8-bde5-4b6a-a59f-6238703e83cc] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:34.534484 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-df5b3742-a4de-4575-9d81-d97490bda591 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1244f3db540441a28d8413e510cfccad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b412c874d4e668b4a1a33dedb2c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:34.539513 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-45cbed40-c38a-4a82-a0f1-d5cd065ca274 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:34.540102 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-45cbed40-c38a-4a82-a0f1-d5cd065ca274 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:34.540634 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-45cbed40-c38a-4a82-a0f1-d5cd065ca274 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:34.541424 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-45cbed40-c38a-4a82-a0f1-d5cd065ca274 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:34.541987 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-45cbed40-c38a-4a82-a0f1-d5cd065ca274 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:34.542653 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-45cbed40-c38a-4a82-a0f1-d5cd065ca274 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:34.554841 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-df5b3742-a4de-4575-9d81-d97490bda591 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] 10.222.0.33 "GET /compute/v2.1/servers/7e90c852-5f27-4861-9b25-9ea1e475c0a9" status: 200 len: 1522 microversion: 2.1 time: 0.683326 Sep 23 04:38:34.555471 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1009/1971] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:33 2022] GET /compute/v2.1/servers/7e90c852-5f27-4861-9b25-9ea1e475c0a9 => generated 1522 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:34.562113 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d019eae8-367d-47f2-a1cc-780d54449dbc tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:34.563009 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d019eae8-367d-47f2-a1cc-780d54449dbc tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] [instance: 53745879-9973-4217-b1c5-b45f917db80e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:34.569230 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d019eae8-367d-47f2-a1cc-780d54449dbc tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:34.577707 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d019eae8-367d-47f2-a1cc-780d54449dbc tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:34.578290 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d019eae8-367d-47f2-a1cc-780d54449dbc tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:34.579725 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d019eae8-367d-47f2-a1cc-780d54449dbc tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:34.580452 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d019eae8-367d-47f2-a1cc-780d54449dbc tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:34.580956 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d019eae8-367d-47f2-a1cc-780d54449dbc tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:34.869760 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-45cbed40-c38a-4a82-a0f1-d5cd065ca274 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:34.885467 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-45cbed40-c38a-4a82-a0f1-d5cd065ca274 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/dc2293d8-bde5-4b6a-a59f-6238703e83cc" status: 200 len: 1473 microversion: 2.1 time: 0.372885 Sep 23 04:38:34.886353 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 963/1972] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:34 2022] GET /compute/v2.1/servers/dc2293d8-bde5-4b6a-a59f-6238703e83cc => generated 1473 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:34.937656 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d019eae8-367d-47f2-a1cc-780d54449dbc tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:34.949801 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d019eae8-367d-47f2-a1cc-780d54449dbc tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:34.951558 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d019eae8-367d-47f2-a1cc-780d54449dbc tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:34.954811 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d019eae8-367d-47f2-a1cc-780d54449dbc tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] 10.222.0.33 "GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e" status: 200 len: 1873 microversion: 2.42 time: 0.396044 Sep 23 04:38:34.957270 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1010/1973] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:38:34 2022] GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e => generated 1873 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:38:35.537713 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-35807150-6641-4f58-b64f-d856ea34ca4b tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:35.538353 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-35807150-6641-4f58-b64f-d856ea34ca4b tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] [instance: 94fc4134-9b8e-4dcd-bd96-5545bfd51c97] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:35.559003 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-35807150-6641-4f58-b64f-d856ea34ca4b tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:35.559525 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-35807150-6641-4f58-b64f-d856ea34ca4b tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:35.560056 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-35807150-6641-4f58-b64f-d856ea34ca4b tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:35.560788 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-35807150-6641-4f58-b64f-d856ea34ca4b tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:35.561254 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-35807150-6641-4f58-b64f-d856ea34ca4b tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:35.561690 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-35807150-6641-4f58-b64f-d856ea34ca4b tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:35.579940 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-641fa2aa-e1e9-43d4-a5d7-1b9cc3a2a5e5 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:35.581215 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-641fa2aa-e1e9-43d4-a5d7-1b9cc3a2a5e5 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] [instance: 7e90c852-5f27-4861-9b25-9ea1e475c0a9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:35.595297 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-641fa2aa-e1e9-43d4-a5d7-1b9cc3a2a5e5 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:35.596824 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-641fa2aa-e1e9-43d4-a5d7-1b9cc3a2a5e5 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:35.597556 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-641fa2aa-e1e9-43d4-a5d7-1b9cc3a2a5e5 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:35.599596 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-641fa2aa-e1e9-43d4-a5d7-1b9cc3a2a5e5 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:35.602234 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-641fa2aa-e1e9-43d4-a5d7-1b9cc3a2a5e5 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:35.604174 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-641fa2aa-e1e9-43d4-a5d7-1b9cc3a2a5e5 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:35.749756 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-35807150-6641-4f58-b64f-d856ea34ca4b tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:35.758952 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-35807150-6641-4f58-b64f-d856ea34ca4b tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:35.763329 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-35807150-6641-4f58-b64f-d856ea34ca4b tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:35.782813 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-35807150-6641-4f58-b64f-d856ea34ca4b tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] 10.222.0.33 "GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97" status: 200 len: 1447 microversion: 2.75 time: 0.248272 Sep 23 04:38:35.783815 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 964/1974] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:38:35 2022] GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97 => generated 1447 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:38:35.917291 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-00d3d4b5-c318-48f8-bfd8-f389546a0012 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:35.918034 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-00d3d4b5-c318-48f8-bfd8-f389546a0012 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: dc2293d8-bde5-4b6a-a59f-6238703e83cc] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:35.921597 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-641fa2aa-e1e9-43d4-a5d7-1b9cc3a2a5e5 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1244f3db540441a28d8413e510cfccad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b412c874d4e668b4a1a33dedb2c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:35.930527 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-00d3d4b5-c318-48f8-bfd8-f389546a0012 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:35.931045 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-00d3d4b5-c318-48f8-bfd8-f389546a0012 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:35.931499 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-00d3d4b5-c318-48f8-bfd8-f389546a0012 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:35.932242 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-00d3d4b5-c318-48f8-bfd8-f389546a0012 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:35.932713 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-00d3d4b5-c318-48f8-bfd8-f389546a0012 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:35.933149 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-00d3d4b5-c318-48f8-bfd8-f389546a0012 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:35.933845 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-641fa2aa-e1e9-43d4-a5d7-1b9cc3a2a5e5 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] 10.222.0.33 "GET /compute/v2.1/servers/7e90c852-5f27-4861-9b25-9ea1e475c0a9" status: 200 len: 1522 microversion: 2.1 time: 0.358243 Sep 23 04:38:35.934653 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1011/1975] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:35 2022] GET /compute/v2.1/servers/7e90c852-5f27-4861-9b25-9ea1e475c0a9 => generated 1522 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:38:35.981307 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5252244f-c938-4afd-81ea-b6ca3a6d78eb tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:35.982008 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-5252244f-c938-4afd-81ea-b6ca3a6d78eb tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] [instance: 53745879-9973-4217-b1c5-b45f917db80e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:35.991340 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5252244f-c938-4afd-81ea-b6ca3a6d78eb tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:35.991841 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5252244f-c938-4afd-81ea-b6ca3a6d78eb tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:36.004189 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5252244f-c938-4afd-81ea-b6ca3a6d78eb tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:36.005080 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5252244f-c938-4afd-81ea-b6ca3a6d78eb tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:36.005577 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5252244f-c938-4afd-81ea-b6ca3a6d78eb tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:36.006892 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5252244f-c938-4afd-81ea-b6ca3a6d78eb tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:36.272016 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-00d3d4b5-c318-48f8-bfd8-f389546a0012 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:36.286725 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-00d3d4b5-c318-48f8-bfd8-f389546a0012 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/dc2293d8-bde5-4b6a-a59f-6238703e83cc" status: 200 len: 1473 microversion: 2.1 time: 0.372692 Sep 23 04:38:36.287516 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 965/1976] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:35 2022] GET /compute/v2.1/servers/dc2293d8-bde5-4b6a-a59f-6238703e83cc => generated 1473 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:36.495817 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-5252244f-c938-4afd-81ea-b6ca3a6d78eb tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:36.518083 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-5252244f-c938-4afd-81ea-b6ca3a6d78eb tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:36.519839 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-5252244f-c938-4afd-81ea-b6ca3a6d78eb tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:36.521044 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5252244f-c938-4afd-81ea-b6ca3a6d78eb tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] 10.222.0.33 "GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e" status: 200 len: 1873 microversion: 2.42 time: 0.544073 Sep 23 04:38:36.521964 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1012/1977] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:38:35 2022] GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e => generated 1873 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:38:36.818063 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ef16acfc-5a64-4d54-a183-f64f92e085e1 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:36.818791 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-ef16acfc-5a64-4d54-a183-f64f92e085e1 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] [instance: 94fc4134-9b8e-4dcd-bd96-5545bfd51c97] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:36.830177 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ef16acfc-5a64-4d54-a183-f64f92e085e1 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:36.834247 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ef16acfc-5a64-4d54-a183-f64f92e085e1 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:36.836633 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ef16acfc-5a64-4d54-a183-f64f92e085e1 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:36.837789 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ef16acfc-5a64-4d54-a183-f64f92e085e1 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:36.838567 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ef16acfc-5a64-4d54-a183-f64f92e085e1 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:36.845370 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ef16acfc-5a64-4d54-a183-f64f92e085e1 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:36.961445 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9e82aaf8-79ec-4d18-91d1-d3a8ca6f4a1f tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:36.962206 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-9e82aaf8-79ec-4d18-91d1-d3a8ca6f4a1f tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] [instance: 7e90c852-5f27-4861-9b25-9ea1e475c0a9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:36.972773 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9e82aaf8-79ec-4d18-91d1-d3a8ca6f4a1f tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:36.973418 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9e82aaf8-79ec-4d18-91d1-d3a8ca6f4a1f tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:36.974600 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9e82aaf8-79ec-4d18-91d1-d3a8ca6f4a1f tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:36.978747 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9e82aaf8-79ec-4d18-91d1-d3a8ca6f4a1f tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:36.979354 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9e82aaf8-79ec-4d18-91d1-d3a8ca6f4a1f tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:36.980507 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9e82aaf8-79ec-4d18-91d1-d3a8ca6f4a1f tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:37.022706 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ef16acfc-5a64-4d54-a183-f64f92e085e1 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:37.037498 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ef16acfc-5a64-4d54-a183-f64f92e085e1 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:37.039264 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ef16acfc-5a64-4d54-a183-f64f92e085e1 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:37.069347 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ef16acfc-5a64-4d54-a183-f64f92e085e1 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] 10.222.0.33 "GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97" status: 200 len: 1447 microversion: 2.75 time: 0.257139 Sep 23 04:38:37.070345 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 966/1978] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:38:36 2022] GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97 => generated 1447 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:38:37.082641 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-078a2b6e-8d8f-4944-af3e-a074d3e1bef6 req-6ba2e499-509a-4e28-a751-c139368bbdf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc2293d8-bde5-4b6a-a59f-6238703e83cc", "name": "network-vif-deleted", "tag": "0a4b3693-a138-4a5e-8d2c-125c9ca84cf4"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:38:37.105143 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-078a2b6e-8d8f-4944-af3e-a074d3e1bef6 req-6ba2e499-509a-4e28-a751-c139368bbdf9 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:37.106489 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-078a2b6e-8d8f-4944-af3e-a074d3e1bef6 req-6ba2e499-509a-4e28-a751-c139368bbdf9 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:37.107194 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-078a2b6e-8d8f-4944-af3e-a074d3e1bef6 req-6ba2e499-509a-4e28-a751-c139368bbdf9 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:37.134474 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-078a2b6e-8d8f-4944-af3e-a074d3e1bef6 req-6ba2e499-509a-4e28-a751-c139368bbdf9 service nova] Creating event network-vif-deleted:0a4b3693-a138-4a5e-8d2c-125c9ca84cf4 for instance dc2293d8-bde5-4b6a-a59f-6238703e83cc on n-h2-846463-3 Sep 23 04:38:37.149111 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-078a2b6e-8d8f-4944-af3e-a074d3e1bef6 req-6ba2e499-509a-4e28-a751-c139368bbdf9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071224 Sep 23 04:38:37.149802 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 967/1979] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:38:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:38:37.315435 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-817435f0-19e9-4b2d-9c1e-7a42e97e78df tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:37.316297 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-817435f0-19e9-4b2d-9c1e-7a42e97e78df tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: dc2293d8-bde5-4b6a-a59f-6238703e83cc] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:37.345742 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-817435f0-19e9-4b2d-9c1e-7a42e97e78df tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:37.346277 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-817435f0-19e9-4b2d-9c1e-7a42e97e78df tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:37.346726 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-817435f0-19e9-4b2d-9c1e-7a42e97e78df tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:37.347451 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-817435f0-19e9-4b2d-9c1e-7a42e97e78df tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:37.347908 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-817435f0-19e9-4b2d-9c1e-7a42e97e78df tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:37.368369 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-817435f0-19e9-4b2d-9c1e-7a42e97e78df tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:37.458558 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-9e82aaf8-79ec-4d18-91d1-d3a8ca6f4a1f tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1244f3db540441a28d8413e510cfccad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b412c874d4e668b4a1a33dedb2c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:37.475932 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-817435f0-19e9-4b2d-9c1e-7a42e97e78df tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:37.478482 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-817435f0-19e9-4b2d-9c1e-7a42e97e78df tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:37.478668 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-9e82aaf8-79ec-4d18-91d1-d3a8ca6f4a1f tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] 10.222.0.33 "GET /compute/v2.1/servers/7e90c852-5f27-4861-9b25-9ea1e475c0a9" status: 200 len: 1522 microversion: 2.1 time: 0.516134 Sep 23 04:38:37.481504 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1013/1980] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:36 2022] GET /compute/v2.1/servers/7e90c852-5f27-4861-9b25-9ea1e475c0a9 => generated 1522 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:37.484645 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-817435f0-19e9-4b2d-9c1e-7a42e97e78df tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:37.485860 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-817435f0-19e9-4b2d-9c1e-7a42e97e78df tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lazy-loading 'fault' on Instance uuid dc2293d8-bde5-4b6a-a59f-6238703e83cc {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:38:37.549691 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d400d4d0-9664-4cad-a3d6-fd6a900fb2b6 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:37.550574 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d400d4d0-9664-4cad-a3d6-fd6a900fb2b6 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] [instance: 53745879-9973-4217-b1c5-b45f917db80e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:37.571138 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d400d4d0-9664-4cad-a3d6-fd6a900fb2b6 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:37.571643 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d400d4d0-9664-4cad-a3d6-fd6a900fb2b6 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:37.576522 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d400d4d0-9664-4cad-a3d6-fd6a900fb2b6 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:37.579407 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d400d4d0-9664-4cad-a3d6-fd6a900fb2b6 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:37.579923 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d400d4d0-9664-4cad-a3d6-fd6a900fb2b6 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:37.583426 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d400d4d0-9664-4cad-a3d6-fd6a900fb2b6 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:37.601517 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-817435f0-19e9-4b2d-9c1e-7a42e97e78df tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:37.615835 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-817435f0-19e9-4b2d-9c1e-7a42e97e78df tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/dc2293d8-bde5-4b6a-a59f-6238703e83cc" status: 200 len: 1307 microversion: 2.1 time: 0.303476 Sep 23 04:38:37.618377 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 968/1981] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:37 2022] GET /compute/v2.1/servers/dc2293d8-bde5-4b6a-a59f-6238703e83cc => generated 1307 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:38.085381 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d400d4d0-9664-4cad-a3d6-fd6a900fb2b6 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:38.098910 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-053c6c5f-225e-486e-8824-2a9a29f42885 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:38.101768 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-053c6c5f-225e-486e-8824-2a9a29f42885 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] [instance: 94fc4134-9b8e-4dcd-bd96-5545bfd51c97] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:38.105412 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:38:38.122317 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d400d4d0-9664-4cad-a3d6-fd6a900fb2b6 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:38.124113 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d400d4d0-9664-4cad-a3d6-fd6a900fb2b6 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:38.127605 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-053c6c5f-225e-486e-8824-2a9a29f42885 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:38.128268 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-053c6c5f-225e-486e-8824-2a9a29f42885 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:38.129758 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d400d4d0-9664-4cad-a3d6-fd6a900fb2b6 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] 10.222.0.33 "GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e" status: 200 len: 1873 microversion: 2.42 time: 0.585273 Sep 23 04:38:38.130380 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-053c6c5f-225e-486e-8824-2a9a29f42885 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:38.133326 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-053c6c5f-225e-486e-8824-2a9a29f42885 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:38.134706 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-053c6c5f-225e-486e-8824-2a9a29f42885 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:38.135114 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1014/1982] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:38:37 2022] GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e => generated 1873 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:38:38.135631 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-053c6c5f-225e-486e-8824-2a9a29f42885 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:38.305045 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-053c6c5f-225e-486e-8824-2a9a29f42885 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:38.315651 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-053c6c5f-225e-486e-8824-2a9a29f42885 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:38.317262 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-053c6c5f-225e-486e-8824-2a9a29f42885 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:38.349685 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-053c6c5f-225e-486e-8824-2a9a29f42885 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] 10.222.0.33 "GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97" status: 200 len: 1447 microversion: 2.75 time: 0.254003 Sep 23 04:38:38.350712 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 969/1983] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:38:38 2022] GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97 => generated 1447 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:38:38.503842 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-bb8978cb-aa2a-4734-9904-67b5c35f93ef tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:38.506605 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-bb8978cb-aa2a-4734-9904-67b5c35f93ef tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] [instance: 7e90c852-5f27-4861-9b25-9ea1e475c0a9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:38.511919 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bb8978cb-aa2a-4734-9904-67b5c35f93ef tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:38.515318 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bb8978cb-aa2a-4734-9904-67b5c35f93ef tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:38.516523 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bb8978cb-aa2a-4734-9904-67b5c35f93ef tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:38.518204 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bb8978cb-aa2a-4734-9904-67b5c35f93ef tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:38.520630 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bb8978cb-aa2a-4734-9904-67b5c35f93ef tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:38.521089 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bb8978cb-aa2a-4734-9904-67b5c35f93ef tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:38.532281 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:38:38.644229 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-baa5df2d-cccc-4f7b-b65b-2e2a85ef4a3c tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:38.644779 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-baa5df2d-cccc-4f7b-b65b-2e2a85ef4a3c tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: dc2293d8-bde5-4b6a-a59f-6238703e83cc] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:38.655246 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-baa5df2d-cccc-4f7b-b65b-2e2a85ef4a3c tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:38.655751 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-baa5df2d-cccc-4f7b-b65b-2e2a85ef4a3c tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:38.656200 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-baa5df2d-cccc-4f7b-b65b-2e2a85ef4a3c tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:38.657448 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-baa5df2d-cccc-4f7b-b65b-2e2a85ef4a3c tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:38.657935 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-baa5df2d-cccc-4f7b-b65b-2e2a85ef4a3c tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:38.658376 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-baa5df2d-cccc-4f7b-b65b-2e2a85ef4a3c tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:38.756834 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-baa5df2d-cccc-4f7b-b65b-2e2a85ef4a3c tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:38.757549 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-baa5df2d-cccc-4f7b-b65b-2e2a85ef4a3c tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:38.758731 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-baa5df2d-cccc-4f7b-b65b-2e2a85ef4a3c tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:38.760427 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-baa5df2d-cccc-4f7b-b65b-2e2a85ef4a3c tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lazy-loading 'fault' on Instance uuid dc2293d8-bde5-4b6a-a59f-6238703e83cc {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:38:38.795645 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-bb8978cb-aa2a-4734-9904-67b5c35f93ef tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1244f3db540441a28d8413e510cfccad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b412c874d4e668b4a1a33dedb2c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:38.810065 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-bb8978cb-aa2a-4734-9904-67b5c35f93ef tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] 10.222.0.33 "GET /compute/v2.1/servers/7e90c852-5f27-4861-9b25-9ea1e475c0a9" status: 200 len: 1522 microversion: 2.1 time: 0.309452 Sep 23 04:38:38.810065 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1015/1984] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:38 2022] GET /compute/v2.1/servers/7e90c852-5f27-4861-9b25-9ea1e475c0a9 => generated 1522 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:38.862040 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-baa5df2d-cccc-4f7b-b65b-2e2a85ef4a3c tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:38.870444 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-baa5df2d-cccc-4f7b-b65b-2e2a85ef4a3c tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/dc2293d8-bde5-4b6a-a59f-6238703e83cc" status: 200 len: 1307 microversion: 2.1 time: 0.230645 Sep 23 04:38:38.873506 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 970/1985] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:38 2022] GET /compute/v2.1/servers/dc2293d8-bde5-4b6a-a59f-6238703e83cc => generated 1307 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:38:39.164739 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b030021a-7056-4814-9469-60751a2c3484 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:39.165533 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b030021a-7056-4814-9469-60751a2c3484 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] [instance: 53745879-9973-4217-b1c5-b45f917db80e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:39.172557 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b030021a-7056-4814-9469-60751a2c3484 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:39.177403 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b030021a-7056-4814-9469-60751a2c3484 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:39.177403 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b030021a-7056-4814-9469-60751a2c3484 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:39.177403 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b030021a-7056-4814-9469-60751a2c3484 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:39.177403 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b030021a-7056-4814-9469-60751a2c3484 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:39.177403 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b030021a-7056-4814-9469-60751a2c3484 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:39.377965 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-139f050d-c2a5-471b-966e-7fe1c8e41327 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:39.379281 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-139f050d-c2a5-471b-966e-7fe1c8e41327 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] [instance: 94fc4134-9b8e-4dcd-bd96-5545bfd51c97] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:39.387041 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-139f050d-c2a5-471b-966e-7fe1c8e41327 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:39.396468 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-139f050d-c2a5-471b-966e-7fe1c8e41327 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:39.396468 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-139f050d-c2a5-471b-966e-7fe1c8e41327 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:39.396468 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-139f050d-c2a5-471b-966e-7fe1c8e41327 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:39.396468 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-139f050d-c2a5-471b-966e-7fe1c8e41327 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:39.396468 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-139f050d-c2a5-471b-966e-7fe1c8e41327 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:39.518731 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-139f050d-c2a5-471b-966e-7fe1c8e41327 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:39.537987 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-139f050d-c2a5-471b-966e-7fe1c8e41327 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:39.542508 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-139f050d-c2a5-471b-966e-7fe1c8e41327 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:39.547210 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-139f050d-c2a5-471b-966e-7fe1c8e41327 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] 10.222.0.33 "GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97" status: 200 len: 1447 microversion: 2.75 time: 0.174329 Sep 23 04:38:39.548205 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 971/1986] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:38:39 2022] GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97 => generated 1447 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:38:39.595641 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b030021a-7056-4814-9469-60751a2c3484 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:39.607808 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b030021a-7056-4814-9469-60751a2c3484 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:39.610117 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b030021a-7056-4814-9469-60751a2c3484 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:39.611706 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b030021a-7056-4814-9469-60751a2c3484 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] 10.222.0.33 "GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e" status: 200 len: 1873 microversion: 2.42 time: 0.451504 Sep 23 04:38:39.613869 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1016/1987] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:38:39 2022] GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e => generated 1873 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:38:39.838769 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7d15d4d0-26f2-4108-aa8d-e699d5c77804 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:39.840120 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7d15d4d0-26f2-4108-aa8d-e699d5c77804 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] [instance: 7e90c852-5f27-4861-9b25-9ea1e475c0a9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:39.856073 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7d15d4d0-26f2-4108-aa8d-e699d5c77804 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:39.856749 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7d15d4d0-26f2-4108-aa8d-e699d5c77804 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:39.857208 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7d15d4d0-26f2-4108-aa8d-e699d5c77804 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:39.861825 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7d15d4d0-26f2-4108-aa8d-e699d5c77804 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:39.861825 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7d15d4d0-26f2-4108-aa8d-e699d5c77804 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:39.861825 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7d15d4d0-26f2-4108-aa8d-e699d5c77804 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:39.900125 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d27342b1-80a5-4601-a13d-7ea38bb20551 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:39.901972 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d27342b1-80a5-4601-a13d-7ea38bb20551 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: dc2293d8-bde5-4b6a-a59f-6238703e83cc] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:39.914004 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d27342b1-80a5-4601-a13d-7ea38bb20551 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:39.914914 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d27342b1-80a5-4601-a13d-7ea38bb20551 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:39.915496 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d27342b1-80a5-4601-a13d-7ea38bb20551 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:39.919116 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d27342b1-80a5-4601-a13d-7ea38bb20551 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:39.922921 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d27342b1-80a5-4601-a13d-7ea38bb20551 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:39.922921 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d27342b1-80a5-4601-a13d-7ea38bb20551 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:39.963802 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d27342b1-80a5-4601-a13d-7ea38bb20551 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:39.964300 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d27342b1-80a5-4601-a13d-7ea38bb20551 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:39.964805 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d27342b1-80a5-4601-a13d-7ea38bb20551 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:39.965326 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-d27342b1-80a5-4601-a13d-7ea38bb20551 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lazy-loading 'fault' on Instance uuid dc2293d8-bde5-4b6a-a59f-6238703e83cc {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:38:40.028182 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d27342b1-80a5-4601-a13d-7ea38bb20551 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:40.041197 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d27342b1-80a5-4601-a13d-7ea38bb20551 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/dc2293d8-bde5-4b6a-a59f-6238703e83cc" status: 200 len: 1307 microversion: 2.1 time: 0.145280 Sep 23 04:38:40.042038 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1017/1988] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:39 2022] GET /compute/v2.1/servers/dc2293d8-bde5-4b6a-a59f-6238703e83cc => generated 1307 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:38:40.149032 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-7d15d4d0-26f2-4108-aa8d-e699d5c77804 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1244f3db540441a28d8413e510cfccad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b412c874d4e668b4a1a33dedb2c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:40.158555 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7d15d4d0-26f2-4108-aa8d-e699d5c77804 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] 10.222.0.33 "GET /compute/v2.1/servers/7e90c852-5f27-4861-9b25-9ea1e475c0a9" status: 200 len: 1522 microversion: 2.1 time: 0.324802 Sep 23 04:38:40.161941 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 972/1989] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:39 2022] GET /compute/v2.1/servers/7e90c852-5f27-4861-9b25-9ea1e475c0a9 => generated 1522 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:40.577729 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-67cd92e6-c2d2-42ba-9d9d-5a5836df2c51 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:40.578445 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-67cd92e6-c2d2-42ba-9d9d-5a5836df2c51 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] [instance: 94fc4134-9b8e-4dcd-bd96-5545bfd51c97] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:40.585414 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-67cd92e6-c2d2-42ba-9d9d-5a5836df2c51 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:40.585922 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-67cd92e6-c2d2-42ba-9d9d-5a5836df2c51 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:40.586367 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-67cd92e6-c2d2-42ba-9d9d-5a5836df2c51 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:40.587052 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-67cd92e6-c2d2-42ba-9d9d-5a5836df2c51 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:40.587517 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-67cd92e6-c2d2-42ba-9d9d-5a5836df2c51 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:40.587940 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-67cd92e6-c2d2-42ba-9d9d-5a5836df2c51 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:40.641883 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-60123871-6700-4dd3-9254-742bd1fe8769 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:40.642524 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-60123871-6700-4dd3-9254-742bd1fe8769 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] [instance: 53745879-9973-4217-b1c5-b45f917db80e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:40.649755 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-60123871-6700-4dd3-9254-742bd1fe8769 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:40.650293 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-60123871-6700-4dd3-9254-742bd1fe8769 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:40.650739 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-60123871-6700-4dd3-9254-742bd1fe8769 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:40.651460 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-60123871-6700-4dd3-9254-742bd1fe8769 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:40.652016 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-60123871-6700-4dd3-9254-742bd1fe8769 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:40.652443 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-60123871-6700-4dd3-9254-742bd1fe8769 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:40.658165 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-67cd92e6-c2d2-42ba-9d9d-5a5836df2c51 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:40.668015 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-67cd92e6-c2d2-42ba-9d9d-5a5836df2c51 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:40.669911 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-67cd92e6-c2d2-42ba-9d9d-5a5836df2c51 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:40.677811 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-67cd92e6-c2d2-42ba-9d9d-5a5836df2c51 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] 10.222.0.33 "GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97" status: 200 len: 1447 microversion: 2.75 time: 0.104288 Sep 23 04:38:40.688067 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1018/1990] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:38:40 2022] GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97 => generated 1447 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:38:40.918915 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-60123871-6700-4dd3-9254-742bd1fe8769 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:40.929913 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-60123871-6700-4dd3-9254-742bd1fe8769 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:40.931547 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-60123871-6700-4dd3-9254-742bd1fe8769 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:40.933066 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-60123871-6700-4dd3-9254-742bd1fe8769 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] 10.222.0.33 "GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e" status: 200 len: 1873 microversion: 2.42 time: 0.296848 Sep 23 04:38:40.933723 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 973/1991] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:38:40 2022] GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e => generated 1873 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:38:41.076523 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-98f18b5d-7fdc-49ba-9a14-875f49a0ba15 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:41.076523 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-98f18b5d-7fdc-49ba-9a14-875f49a0ba15 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: dc2293d8-bde5-4b6a-a59f-6238703e83cc] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:41.077843 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-98f18b5d-7fdc-49ba-9a14-875f49a0ba15 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:41.079093 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-98f18b5d-7fdc-49ba-9a14-875f49a0ba15 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:41.079936 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-98f18b5d-7fdc-49ba-9a14-875f49a0ba15 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:41.080774 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-98f18b5d-7fdc-49ba-9a14-875f49a0ba15 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:41.081343 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-98f18b5d-7fdc-49ba-9a14-875f49a0ba15 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:41.081928 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-98f18b5d-7fdc-49ba-9a14-875f49a0ba15 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:41.099079 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-98f18b5d-7fdc-49ba-9a14-875f49a0ba15 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] HTTP exception thrown: Instance dc2293d8-bde5-4b6a-a59f-6238703e83cc could not be found. Sep 23 04:38:41.101295 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-98f18b5d-7fdc-49ba-9a14-875f49a0ba15 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Request method failure captured: Sep 23 04:38:41.101295 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/dc2293d8-bde5-4b6a-a59f-6238703e83cc HTTP/1.1 Sep 23 04:38:41.101295 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:38:41.101295 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:38:41.101295 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:38:41.101295 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:38:41.101295 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:38:41.101295 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:38:41.101295 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:38:41.101295 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:38:41.101295 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTedAlFPeFmnDF7aT3i0aUDQGJFgGZnI-hp3AgXCkcO3hSwSmXlMqV4YX4M2zE_tzLZBCRNva2-mnxAIXvcDQ4ADhbq0RDumL2tq0UzsAkBd3JY4bJ4oVHe0Nm8SGB15yLY37BALihKvv5H7mxEOffoAs77PenOe-f2xwUXiU1RwOEo Sep 23 04:38:41.101295 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:38:41.101295 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:38:41.101295 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:38:41.101295 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:38:41.101295 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:38:41.101295 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:38:41.101295 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: f5db359a60174c45afa2bf06e23a46c4 Sep 23 04:38:41.101295 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ServersOnMultiNodesTest-604470560 Sep 23 04:38:41.101295 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:38:41.101295 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:38:41.101295 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f5db359a60174c45afa2bf06e23a46c4", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f5db359a60174c45afa2bf06e23a46c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f5db359a60174c45afa2bf06e23a46c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f5db359a60174c45afa2bf06e23a46c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:38:41.101295 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ServersOnMultiNodesTest-604470560 Sep 23 04:38:41.101295 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: f5db359a60174c45afa2bf06e23a46c4 Sep 23 04:38:41.101295 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-604470560 Sep 23 04:38:41.101295 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ServersOnMultiNodesTest-604470560-project Sep 23 04:38:41.101295 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:38:41.101295 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:38:41.101295 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: da08af8193dd490b93278385583f24c0 Sep 23 04:38:41.101295 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ServersOnMultiNodesTest-604470560-project Sep 23 04:38:41.101295 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:38:41.101295 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance dc2293d8-bde5-4b6a-a59f-6238703e83cc could not be found. Sep 23 04:38:41.101295 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': 'dc2293d8-bde5-4b6a-a59f-6238703e83cc'} Sep 23 04:38:41.101295 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:38:41.101295 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:38:41.101295 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:38:41.101295 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:38:41.101295 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:38:41.101295 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:38:41.101295 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:38:41.101295 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:38:41.101295 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:38:41.101295 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:38:41.101295 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc2293d8-bde5-4b6a-a59f-6238703e83cc could not be found. Sep 23 04:38:41.101295 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:38:41.101295 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:38:41.101295 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:38:41.101295 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:38:41.101295 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:38:41.101295 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:38:41.101295 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:38:41.101295 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:38:41.101295 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:38:41.101295 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:38:41.101295 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:38:41.101295 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:38:41.101295 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:38:41.101295 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:38:41.101295 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:38:41.101295 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:38:41.101295 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc2293d8-bde5-4b6a-a59f-6238703e83cc could not be found. Sep 23 04:38:41.101295 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:38:41.101295 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:38:41.101295 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:38:41.107003 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:38:41.107003 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:38:41.107003 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:38:41.107003 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:38:41.107003 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:38:41.107003 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc2293d8-bde5-4b6a-a59f-6238703e83cc could not be found. Sep 23 04:38:41.107003 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:38:41.109005 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-98f18b5d-7fdc-49ba-9a14-875f49a0ba15 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Returning 404 to user: Instance dc2293d8-bde5-4b6a-a59f-6238703e83cc could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:38:41.110787 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-98f18b5d-7fdc-49ba-9a14-875f49a0ba15 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/dc2293d8-bde5-4b6a-a59f-6238703e83cc" status: 404 len: 111 microversion: 2.1 time: 0.045389 Sep 23 04:38:41.117882 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1019/1992] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:41 2022] GET /compute/v2.1/servers/dc2293d8-bde5-4b6a-a59f-6238703e83cc => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:38:41.127655 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d3de3a98-86eb-43a0-b9f1-40783df7046c tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:41.140086 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d3de3a98-86eb-43a0-b9f1-40783df7046c tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 7b84f450-5c05-4468-b17a-2cd30f2c7f55] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:41.152736 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d3de3a98-86eb-43a0-b9f1-40783df7046c tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:41.153246 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d3de3a98-86eb-43a0-b9f1-40783df7046c tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:41.153696 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d3de3a98-86eb-43a0-b9f1-40783df7046c tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:41.154440 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d3de3a98-86eb-43a0-b9f1-40783df7046c tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:41.154904 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d3de3a98-86eb-43a0-b9f1-40783df7046c tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:41.155328 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d3de3a98-86eb-43a0-b9f1-40783df7046c tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:41.186308 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9523db02-5591-4269-96a3-ef26053d57f2 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:41.187709 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-9523db02-5591-4269-96a3-ef26053d57f2 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] [instance: 7e90c852-5f27-4861-9b25-9ea1e475c0a9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:41.191173 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d3de3a98-86eb-43a0-b9f1-40783df7046c tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 7b84f450-5c05-4468-b17a-2cd30f2c7f55] Going to try to terminate instance {{(pid=122698) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:38:41.198878 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9523db02-5591-4269-96a3-ef26053d57f2 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:41.199758 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9523db02-5591-4269-96a3-ef26053d57f2 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:41.200567 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9523db02-5591-4269-96a3-ef26053d57f2 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:41.201734 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9523db02-5591-4269-96a3-ef26053d57f2 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:41.202721 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9523db02-5591-4269-96a3-ef26053d57f2 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:41.203437 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9523db02-5591-4269-96a3-ef26053d57f2 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:41.361805 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-9523db02-5591-4269-96a3-ef26053d57f2 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1244f3db540441a28d8413e510cfccad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b412c874d4e668b4a1a33dedb2c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:41.377466 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-9523db02-5591-4269-96a3-ef26053d57f2 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] 10.222.0.33 "GET /compute/v2.1/servers/7e90c852-5f27-4861-9b25-9ea1e475c0a9" status: 200 len: 1522 microversion: 2.1 time: 0.196983 Sep 23 04:38:41.395517 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1020/1993] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:41 2022] GET /compute/v2.1/servers/7e90c852-5f27-4861-9b25-9ea1e475c0a9 => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:38:41.714477 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-07263ddd-d549-45e1-904d-74523a05b86d tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:41.716432 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-07263ddd-d549-45e1-904d-74523a05b86d tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] [instance: 94fc4134-9b8e-4dcd-bd96-5545bfd51c97] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:41.739249 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d3de3a98-86eb-43a0-b9f1-40783df7046c tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "DELETE /compute/v2.1/servers/7b84f450-5c05-4468-b17a-2cd30f2c7f55" status: 204 len: 0 microversion: 2.1 time: 0.622410 Sep 23 04:38:41.740912 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 974/1994] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:38:41 2022] DELETE /compute/v2.1/servers/7b84f450-5c05-4468-b17a-2cd30f2c7f55 => generated 0 bytes in 625 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:38:41.752600 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-07263ddd-d549-45e1-904d-74523a05b86d tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:41.753588 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-07263ddd-d549-45e1-904d-74523a05b86d tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:41.754677 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-07263ddd-d549-45e1-904d-74523a05b86d tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:41.756367 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-07263ddd-d549-45e1-904d-74523a05b86d tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:41.757401 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-fdcec3c8-261c-402e-b8c5-884bac7aa6e8 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:41.757693 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-07263ddd-d549-45e1-904d-74523a05b86d tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:41.758434 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-07263ddd-d549-45e1-904d-74523a05b86d tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:41.760462 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-fdcec3c8-261c-402e-b8c5-884bac7aa6e8 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 7b84f450-5c05-4468-b17a-2cd30f2c7f55] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:41.775644 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fdcec3c8-261c-402e-b8c5-884bac7aa6e8 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:41.788950 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fdcec3c8-261c-402e-b8c5-884bac7aa6e8 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:41.788950 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fdcec3c8-261c-402e-b8c5-884bac7aa6e8 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:41.788950 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fdcec3c8-261c-402e-b8c5-884bac7aa6e8 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:41.788950 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fdcec3c8-261c-402e-b8c5-884bac7aa6e8 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:41.788950 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fdcec3c8-261c-402e-b8c5-884bac7aa6e8 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:41.883559 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-07263ddd-d549-45e1-904d-74523a05b86d tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:41.893991 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-07263ddd-d549-45e1-904d-74523a05b86d tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:41.896085 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-07263ddd-d549-45e1-904d-74523a05b86d tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:41.903402 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-07263ddd-d549-45e1-904d-74523a05b86d tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] 10.222.0.33 "GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97" status: 200 len: 1447 microversion: 2.75 time: 0.197390 Sep 23 04:38:41.917915 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1021/1995] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:38:41 2022] GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97 => generated 1447 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:38:41.968183 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d5761180-8821-44eb-ac8f-fcf8e43e4fe6 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:41.968602 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d5761180-8821-44eb-ac8f-fcf8e43e4fe6 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] [instance: 53745879-9973-4217-b1c5-b45f917db80e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:41.977208 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d5761180-8821-44eb-ac8f-fcf8e43e4fe6 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:41.977736 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d5761180-8821-44eb-ac8f-fcf8e43e4fe6 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:41.978206 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d5761180-8821-44eb-ac8f-fcf8e43e4fe6 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:41.978922 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d5761180-8821-44eb-ac8f-fcf8e43e4fe6 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:41.979385 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d5761180-8821-44eb-ac8f-fcf8e43e4fe6 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:41.979815 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d5761180-8821-44eb-ac8f-fcf8e43e4fe6 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:41.995146 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-fdcec3c8-261c-402e-b8c5-884bac7aa6e8 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:42.005089 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-fdcec3c8-261c-402e-b8c5-884bac7aa6e8 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/7b84f450-5c05-4468-b17a-2cd30f2c7f55" status: 200 len: 1471 microversion: 2.1 time: 0.259373 Sep 23 04:38:42.007550 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 975/1996] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:41 2022] GET /compute/v2.1/servers/7b84f450-5c05-4468-b17a-2cd30f2c7f55 => generated 1471 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:42.352739 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d5761180-8821-44eb-ac8f-fcf8e43e4fe6 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:42.363297 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d5761180-8821-44eb-ac8f-fcf8e43e4fe6 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:42.364768 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d5761180-8821-44eb-ac8f-fcf8e43e4fe6 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:42.366064 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d5761180-8821-44eb-ac8f-fcf8e43e4fe6 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] 10.222.0.33 "GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e" status: 200 len: 1873 microversion: 2.42 time: 0.404916 Sep 23 04:38:42.366652 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1022/1997] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:38:41 2022] GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e => generated 1873 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:38:42.402681 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8162fc14-c126-4ffb-bf31-584be8d002b5 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:42.403577 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8162fc14-c126-4ffb-bf31-584be8d002b5 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] [instance: 7e90c852-5f27-4861-9b25-9ea1e475c0a9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:42.412234 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8162fc14-c126-4ffb-bf31-584be8d002b5 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:42.412741 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8162fc14-c126-4ffb-bf31-584be8d002b5 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:42.413188 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8162fc14-c126-4ffb-bf31-584be8d002b5 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:42.413924 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8162fc14-c126-4ffb-bf31-584be8d002b5 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:42.414592 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8162fc14-c126-4ffb-bf31-584be8d002b5 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:42.415031 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8162fc14-c126-4ffb-bf31-584be8d002b5 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:42.419648 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:38:42.627356 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8162fc14-c126-4ffb-bf31-584be8d002b5 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1244f3db540441a28d8413e510cfccad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b412c874d4e668b4a1a33dedb2c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:42.638006 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8162fc14-c126-4ffb-bf31-584be8d002b5 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] 10.222.0.33 "GET /compute/v2.1/servers/7e90c852-5f27-4861-9b25-9ea1e475c0a9" status: 200 len: 1522 microversion: 2.1 time: 0.237495 Sep 23 04:38:42.638006 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 976/1998] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:42 2022] GET /compute/v2.1/servers/7e90c852-5f27-4861-9b25-9ea1e475c0a9 => generated 1522 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:42.935367 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3727ec91-0ce4-4a14-8371-375ce9b6f01e tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:42.936161 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-3727ec91-0ce4-4a14-8371-375ce9b6f01e tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] [instance: 94fc4134-9b8e-4dcd-bd96-5545bfd51c97] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:42.948034 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3727ec91-0ce4-4a14-8371-375ce9b6f01e tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:42.948635 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3727ec91-0ce4-4a14-8371-375ce9b6f01e tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:42.949157 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3727ec91-0ce4-4a14-8371-375ce9b6f01e tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:42.950286 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3727ec91-0ce4-4a14-8371-375ce9b6f01e tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:42.950823 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3727ec91-0ce4-4a14-8371-375ce9b6f01e tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:42.951340 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3727ec91-0ce4-4a14-8371-375ce9b6f01e tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:43.034789 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4a9165ad-244d-47b7-b53a-f4ea60b9a768 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:43.035446 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4a9165ad-244d-47b7-b53a-f4ea60b9a768 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 7b84f450-5c05-4468-b17a-2cd30f2c7f55] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:43.043575 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-3727ec91-0ce4-4a14-8371-375ce9b6f01e tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:43.053620 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4a9165ad-244d-47b7-b53a-f4ea60b9a768 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:43.054420 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4a9165ad-244d-47b7-b53a-f4ea60b9a768 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:43.055068 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4a9165ad-244d-47b7-b53a-f4ea60b9a768 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:43.055196 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-3727ec91-0ce4-4a14-8371-375ce9b6f01e tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:43.056377 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4a9165ad-244d-47b7-b53a-f4ea60b9a768 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:43.056999 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-3727ec91-0ce4-4a14-8371-375ce9b6f01e tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:43.057781 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4a9165ad-244d-47b7-b53a-f4ea60b9a768 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:43.058426 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4a9165ad-244d-47b7-b53a-f4ea60b9a768 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:43.064660 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3727ec91-0ce4-4a14-8371-375ce9b6f01e tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] 10.222.0.33 "GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97" status: 200 len: 1447 microversion: 2.75 time: 0.133530 Sep 23 04:38:43.065641 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1023/1999] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:38:42 2022] GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97 => generated 1447 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:38:43.310384 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4a9165ad-244d-47b7-b53a-f4ea60b9a768 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:43.321295 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4a9165ad-244d-47b7-b53a-f4ea60b9a768 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/7b84f450-5c05-4468-b17a-2cd30f2c7f55" status: 200 len: 1471 microversion: 2.1 time: 0.291312 Sep 23 04:38:43.321951 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 977/2000] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:43 2022] GET /compute/v2.1/servers/7b84f450-5c05-4468-b17a-2cd30f2c7f55 => generated 1471 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:43.393747 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0d57f5a3-2838-4650-94ed-3798b0dc08a6 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:43.393747 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-0d57f5a3-2838-4650-94ed-3798b0dc08a6 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] [instance: 53745879-9973-4217-b1c5-b45f917db80e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:43.399799 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0d57f5a3-2838-4650-94ed-3798b0dc08a6 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:43.400564 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0d57f5a3-2838-4650-94ed-3798b0dc08a6 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:43.401008 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0d57f5a3-2838-4650-94ed-3798b0dc08a6 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:43.401703 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0d57f5a3-2838-4650-94ed-3798b0dc08a6 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:43.402371 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0d57f5a3-2838-4650-94ed-3798b0dc08a6 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:43.402792 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0d57f5a3-2838-4650-94ed-3798b0dc08a6 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:43.644976 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-0d57f5a3-2838-4650-94ed-3798b0dc08a6 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:43.646622 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-0d57f5a3-2838-4650-94ed-3798b0dc08a6 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:43.648081 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-0d57f5a3-2838-4650-94ed-3798b0dc08a6 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:43.649261 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0d57f5a3-2838-4650-94ed-3798b0dc08a6 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] 10.222.0.33 "GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e" status: 200 len: 1873 microversion: 2.42 time: 0.261230 Sep 23 04:38:43.650405 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1024/2001] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:38:43 2022] GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e => generated 1873 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:38:43.674340 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5795d586-b79d-4c37-8a51-127eb20b1dfd tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:43.674993 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5795d586-b79d-4c37-8a51-127eb20b1dfd tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] [instance: 7e90c852-5f27-4861-9b25-9ea1e475c0a9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:43.682430 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5795d586-b79d-4c37-8a51-127eb20b1dfd tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:43.683301 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5795d586-b79d-4c37-8a51-127eb20b1dfd tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:43.684005 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5795d586-b79d-4c37-8a51-127eb20b1dfd tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:43.684948 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5795d586-b79d-4c37-8a51-127eb20b1dfd tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:43.685702 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5795d586-b79d-4c37-8a51-127eb20b1dfd tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:43.686412 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5795d586-b79d-4c37-8a51-127eb20b1dfd tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:43.888270 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-5795d586-b79d-4c37-8a51-127eb20b1dfd tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1244f3db540441a28d8413e510cfccad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b412c874d4e668b4a1a33dedb2c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:43.914511 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5795d586-b79d-4c37-8a51-127eb20b1dfd tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] 10.222.0.33 "GET /compute/v2.1/servers/7e90c852-5f27-4861-9b25-9ea1e475c0a9" status: 200 len: 1522 microversion: 2.1 time: 0.248271 Sep 23 04:38:43.915746 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 978/2002] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:43 2022] GET /compute/v2.1/servers/7e90c852-5f27-4861-9b25-9ea1e475c0a9 => generated 1522 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:44.004692 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-813b7e1f-190b-4291-8dfa-dd3aa5386e87 req-23ada121-e7bb-4786-a787-02f8af2bd780 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b84f450-5c05-4468-b17a-2cd30f2c7f55", "name": "network-vif-deleted", "tag": "f0e6646b-bac8-416d-8099-7beba99a6c8c"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:38:44.021209 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-813b7e1f-190b-4291-8dfa-dd3aa5386e87 req-23ada121-e7bb-4786-a787-02f8af2bd780 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:44.021683 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-813b7e1f-190b-4291-8dfa-dd3aa5386e87 req-23ada121-e7bb-4786-a787-02f8af2bd780 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:44.022134 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-813b7e1f-190b-4291-8dfa-dd3aa5386e87 req-23ada121-e7bb-4786-a787-02f8af2bd780 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:44.035429 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-813b7e1f-190b-4291-8dfa-dd3aa5386e87 req-23ada121-e7bb-4786-a787-02f8af2bd780 service nova] Creating event network-vif-deleted:f0e6646b-bac8-416d-8099-7beba99a6c8c for instance 7b84f450-5c05-4468-b17a-2cd30f2c7f55 on n-h2-846463-3 Sep 23 04:38:44.040211 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-813b7e1f-190b-4291-8dfa-dd3aa5386e87 req-23ada121-e7bb-4786-a787-02f8af2bd780 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039798 Sep 23 04:38:44.040811 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1025/2003] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:38:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:38:44.093331 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2b0691b1-32d3-443e-a7e3-7eba9fb0fe62 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:44.094123 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-2b0691b1-32d3-443e-a7e3-7eba9fb0fe62 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] [instance: 94fc4134-9b8e-4dcd-bd96-5545bfd51c97] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:44.101115 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2b0691b1-32d3-443e-a7e3-7eba9fb0fe62 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:44.101621 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2b0691b1-32d3-443e-a7e3-7eba9fb0fe62 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:44.102099 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2b0691b1-32d3-443e-a7e3-7eba9fb0fe62 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:44.102989 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2b0691b1-32d3-443e-a7e3-7eba9fb0fe62 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:44.103661 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2b0691b1-32d3-443e-a7e3-7eba9fb0fe62 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:44.104168 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2b0691b1-32d3-443e-a7e3-7eba9fb0fe62 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:44.209182 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-2b0691b1-32d3-443e-a7e3-7eba9fb0fe62 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:44.218997 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-2b0691b1-32d3-443e-a7e3-7eba9fb0fe62 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:44.226737 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-2b0691b1-32d3-443e-a7e3-7eba9fb0fe62 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:44.236040 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2b0691b1-32d3-443e-a7e3-7eba9fb0fe62 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] 10.222.0.33 "GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97" status: 200 len: 1447 microversion: 2.75 time: 0.146345 Sep 23 04:38:44.248260 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 979/2004] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:38:44 2022] GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97 => generated 1447 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:38:44.345728 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6b88f20e-665f-46df-8b99-338a04478550 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:44.346858 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-6b88f20e-665f-46df-8b99-338a04478550 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 7b84f450-5c05-4468-b17a-2cd30f2c7f55] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:44.356135 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6b88f20e-665f-46df-8b99-338a04478550 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:44.356949 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6b88f20e-665f-46df-8b99-338a04478550 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:44.357621 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6b88f20e-665f-46df-8b99-338a04478550 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:44.358893 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6b88f20e-665f-46df-8b99-338a04478550 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:44.360087 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6b88f20e-665f-46df-8b99-338a04478550 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:44.360828 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6b88f20e-665f-46df-8b99-338a04478550 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:44.461799 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-6b88f20e-665f-46df-8b99-338a04478550 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:44.471691 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6b88f20e-665f-46df-8b99-338a04478550 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/7b84f450-5c05-4468-b17a-2cd30f2c7f55" status: 200 len: 1301 microversion: 2.1 time: 0.130669 Sep 23 04:38:44.473406 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1026/2005] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:44 2022] GET /compute/v2.1/servers/7b84f450-5c05-4468-b17a-2cd30f2c7f55 => generated 1301 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:44.678056 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e151e4fb-ea16-466d-84c3-befbf4f67ff4 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:44.679197 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e151e4fb-ea16-466d-84c3-befbf4f67ff4 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] [instance: 53745879-9973-4217-b1c5-b45f917db80e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:44.686441 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e151e4fb-ea16-466d-84c3-befbf4f67ff4 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:44.687268 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e151e4fb-ea16-466d-84c3-befbf4f67ff4 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:44.688424 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e151e4fb-ea16-466d-84c3-befbf4f67ff4 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:44.689712 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e151e4fb-ea16-466d-84c3-befbf4f67ff4 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:44.690856 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e151e4fb-ea16-466d-84c3-befbf4f67ff4 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:44.691579 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e151e4fb-ea16-466d-84c3-befbf4f67ff4 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:44.915488 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e151e4fb-ea16-466d-84c3-befbf4f67ff4 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:44.935881 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e151e4fb-ea16-466d-84c3-befbf4f67ff4 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:44.937096 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e151e4fb-ea16-466d-84c3-befbf4f67ff4 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:44.939425 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e151e4fb-ea16-466d-84c3-befbf4f67ff4 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] 10.222.0.33 "GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e" status: 200 len: 1873 microversion: 2.42 time: 0.265322 Sep 23 04:38:44.940213 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 980/2006] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:38:44 2022] GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e => generated 1873 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:38:44.960222 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-24f621df-fc08-4ec9-8cdd-95779a110bb8 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:44.963084 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-24f621df-fc08-4ec9-8cdd-95779a110bb8 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] [instance: 7e90c852-5f27-4861-9b25-9ea1e475c0a9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:44.974030 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-24f621df-fc08-4ec9-8cdd-95779a110bb8 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:44.974944 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-24f621df-fc08-4ec9-8cdd-95779a110bb8 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:44.976405 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-24f621df-fc08-4ec9-8cdd-95779a110bb8 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:44.978145 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-24f621df-fc08-4ec9-8cdd-95779a110bb8 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:44.979450 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-24f621df-fc08-4ec9-8cdd-95779a110bb8 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:44.981100 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-24f621df-fc08-4ec9-8cdd-95779a110bb8 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:45.202498 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-24f621df-fc08-4ec9-8cdd-95779a110bb8 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1244f3db540441a28d8413e510cfccad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b412c874d4e668b4a1a33dedb2c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:45.212754 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-24f621df-fc08-4ec9-8cdd-95779a110bb8 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] 10.222.0.33 "GET /compute/v2.1/servers/7e90c852-5f27-4861-9b25-9ea1e475c0a9" status: 200 len: 1499 microversion: 2.1 time: 0.274579 Sep 23 04:38:45.213531 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1027/2007] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:44 2022] GET /compute/v2.1/servers/7e90c852-5f27-4861-9b25-9ea1e475c0a9 => generated 1499 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:38:45.236696 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-43833acb-5120-4e95-9208-48d997306ad2 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:45.241582 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-43833acb-5120-4e95-9208-48d997306ad2 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1244f3db540441a28d8413e510cfccad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b412c874d4e668b4a1a33dedb2c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:45.242420 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-43833acb-5120-4e95-9208-48d997306ad2 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '721b412c874d4e668b4a1a33dedb2c9b'} {{(pid=122698) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 04:38:45.252409 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-43833acb-5120-4e95-9208-48d997306ad2 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:45.253162 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-43833acb-5120-4e95-9208-48d997306ad2 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:45.253975 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-43833acb-5120-4e95-9208-48d997306ad2 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:45.255275 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-43833acb-5120-4e95-9208-48d997306ad2 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:45.256096 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-43833acb-5120-4e95-9208-48d997306ad2 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:45.256791 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-43833acb-5120-4e95-9208-48d997306ad2 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:45.267521 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-306efeb3-4e0d-432c-9537-4442d7603fc8 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:45.268845 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-306efeb3-4e0d-432c-9537-4442d7603fc8 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] [instance: 94fc4134-9b8e-4dcd-bd96-5545bfd51c97] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:45.294435 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-306efeb3-4e0d-432c-9537-4442d7603fc8 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:45.295750 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-306efeb3-4e0d-432c-9537-4442d7603fc8 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:45.296407 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-306efeb3-4e0d-432c-9537-4442d7603fc8 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:45.297737 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-306efeb3-4e0d-432c-9537-4442d7603fc8 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:45.299534 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-306efeb3-4e0d-432c-9537-4442d7603fc8 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:45.302772 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-306efeb3-4e0d-432c-9537-4442d7603fc8 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:45.412007 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-306efeb3-4e0d-432c-9537-4442d7603fc8 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:45.425619 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-306efeb3-4e0d-432c-9537-4442d7603fc8 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:45.427815 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-306efeb3-4e0d-432c-9537-4442d7603fc8 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:45.450533 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-306efeb3-4e0d-432c-9537-4442d7603fc8 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] 10.222.0.33 "GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97" status: 200 len: 1447 microversion: 2.75 time: 0.189415 Sep 23 04:38:45.451171 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1028/2008] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:38:45 2022] GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97 => generated 1447 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:38:45.496469 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-258ffe58-1e7d-4a33-8881-4b945b708593 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:45.497088 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-258ffe58-1e7d-4a33-8881-4b945b708593 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 7b84f450-5c05-4468-b17a-2cd30f2c7f55] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:45.504468 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-258ffe58-1e7d-4a33-8881-4b945b708593 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:45.504975 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-258ffe58-1e7d-4a33-8881-4b945b708593 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:45.505421 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-258ffe58-1e7d-4a33-8881-4b945b708593 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:45.506171 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-258ffe58-1e7d-4a33-8881-4b945b708593 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:45.506637 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-258ffe58-1e7d-4a33-8881-4b945b708593 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:45.507074 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-258ffe58-1e7d-4a33-8881-4b945b708593 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:45.528248 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.multi_cell_list [None req-43833acb-5120-4e95-9208-48d997306ad2 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122698) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 23 04:38:45.559491 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-258ffe58-1e7d-4a33-8881-4b945b708593 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:45.560503 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-258ffe58-1e7d-4a33-8881-4b945b708593 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:45.561381 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-258ffe58-1e7d-4a33-8881-4b945b708593 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:45.562061 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-258ffe58-1e7d-4a33-8881-4b945b708593 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lazy-loading 'fault' on Instance uuid 7b84f450-5c05-4468-b17a-2cd30f2c7f55 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:38:45.612116 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-43833acb-5120-4e95-9208-48d997306ad2 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] 10.222.0.33 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.379423 Sep 23 04:38:45.621040 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 981/2009] 10.222.0.33 () {58 vars in 1154 bytes} [Fri Sep 23 04:38:45 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:38:45.629675 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-258ffe58-1e7d-4a33-8881-4b945b708593 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:45.631145 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3f82bd51-4b5c-4473-beca-9c631a8c9ef6 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:38:45.642002 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-258ffe58-1e7d-4a33-8881-4b945b708593 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/7b84f450-5c05-4468-b17a-2cd30f2c7f55" status: 200 len: 1306 microversion: 2.1 time: 0.149322 Sep 23 04:38:45.646598 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1029/2010] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:45 2022] GET /compute/v2.1/servers/7b84f450-5c05-4468-b17a-2cd30f2c7f55 => generated 1306 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:38:45.651910 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3f82bd51-4b5c-4473-beca-9c631a8c9ef6 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:45.651910 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3f82bd51-4b5c-4473-beca-9c631a8c9ef6 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:45.651910 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3f82bd51-4b5c-4473-beca-9c631a8c9ef6 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:45.722831 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3f82bd51-4b5c-4473-beca-9c631a8c9ef6 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] [instance: 7e90c852-5f27-4861-9b25-9ea1e475c0a9] Going to try to start instance {{(pid=122698) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 23 04:38:45.968405 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c7fd05fe-632b-4956-ba1b-8a3b9f95600b tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:45.969057 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c7fd05fe-632b-4956-ba1b-8a3b9f95600b tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] [instance: 53745879-9973-4217-b1c5-b45f917db80e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:45.979110 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c7fd05fe-632b-4956-ba1b-8a3b9f95600b tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:45.979613 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c7fd05fe-632b-4956-ba1b-8a3b9f95600b tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:45.980068 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c7fd05fe-632b-4956-ba1b-8a3b9f95600b tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:45.980773 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c7fd05fe-632b-4956-ba1b-8a3b9f95600b tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:45.983677 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c7fd05fe-632b-4956-ba1b-8a3b9f95600b tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:45.991755 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c7fd05fe-632b-4956-ba1b-8a3b9f95600b tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:45.999113 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3f82bd51-4b5c-4473-beca-9c631a8c9ef6 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] 10.222.0.33 "POST /compute/v2.1/servers/7e90c852-5f27-4861-9b25-9ea1e475c0a9/action" status: 202 len: 0 microversion: 2.1 time: 0.375270 Sep 23 04:38:46.000710 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 982/2011] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:38:45 2022] POST /compute/v2.1/servers/7e90c852-5f27-4861-9b25-9ea1e475c0a9/action => generated 0 bytes in 380 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:38:46.027285 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7b952e31-4a78-4f61-903c-0f588ca4bcd7 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:46.030595 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7b952e31-4a78-4f61-903c-0f588ca4bcd7 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] [instance: 7e90c852-5f27-4861-9b25-9ea1e475c0a9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:46.052643 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7b952e31-4a78-4f61-903c-0f588ca4bcd7 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:46.060649 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7b952e31-4a78-4f61-903c-0f588ca4bcd7 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:46.060649 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7b952e31-4a78-4f61-903c-0f588ca4bcd7 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:46.060649 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7b952e31-4a78-4f61-903c-0f588ca4bcd7 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:46.064592 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7b952e31-4a78-4f61-903c-0f588ca4bcd7 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:46.065528 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7b952e31-4a78-4f61-903c-0f588ca4bcd7 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:46.553724 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-7b952e31-4a78-4f61-903c-0f588ca4bcd7 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1244f3db540441a28d8413e510cfccad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b412c874d4e668b4a1a33dedb2c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:46.563443 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7b952e31-4a78-4f61-903c-0f588ca4bcd7 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] 10.222.0.33 "GET /compute/v2.1/servers/7e90c852-5f27-4861-9b25-9ea1e475c0a9" status: 200 len: 1508 microversion: 2.1 time: 0.546432 Sep 23 04:38:46.564333 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 983/2012] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:46 2022] GET /compute/v2.1/servers/7e90c852-5f27-4861-9b25-9ea1e475c0a9 => generated 1508 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:46.653961 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c7fd05fe-632b-4956-ba1b-8a3b9f95600b tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:46.666831 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c7fd05fe-632b-4956-ba1b-8a3b9f95600b tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:46.671104 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c7fd05fe-632b-4956-ba1b-8a3b9f95600b tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:46.672381 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c7fd05fe-632b-4956-ba1b-8a3b9f95600b tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] 10.222.0.33 "GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e" status: 200 len: 1873 microversion: 2.42 time: 0.708321 Sep 23 04:38:46.676715 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1030/2013] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:38:45 2022] GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e => generated 1873 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:38:46.683940 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-cb63f6f8-961c-44a1-b702-63e9fd387557 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:46.684859 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-cb63f6f8-961c-44a1-b702-63e9fd387557 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] [instance: 94fc4134-9b8e-4dcd-bd96-5545bfd51c97] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:46.691695 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cb63f6f8-961c-44a1-b702-63e9fd387557 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:46.692177 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cb63f6f8-961c-44a1-b702-63e9fd387557 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:46.692623 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cb63f6f8-961c-44a1-b702-63e9fd387557 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:46.693480 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cb63f6f8-961c-44a1-b702-63e9fd387557 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:46.693981 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cb63f6f8-961c-44a1-b702-63e9fd387557 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:46.694408 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cb63f6f8-961c-44a1-b702-63e9fd387557 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:46.775974 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-cb63f6f8-961c-44a1-b702-63e9fd387557 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:46.802019 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-cb63f6f8-961c-44a1-b702-63e9fd387557 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:46.808689 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-cb63f6f8-961c-44a1-b702-63e9fd387557 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:46.818235 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-cb63f6f8-961c-44a1-b702-63e9fd387557 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] 10.222.0.33 "GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97" status: 200 len: 1447 microversion: 2.75 time: 0.140184 Sep 23 04:38:46.819193 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1031/2014] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:38:46 2022] GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97 => generated 1447 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:38:46.825662 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d4da4220-c101-43b3-a2d0-449f3906cd50 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:46.827070 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d4da4220-c101-43b3-a2d0-449f3906cd50 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 7b84f450-5c05-4468-b17a-2cd30f2c7f55] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:46.835524 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d4da4220-c101-43b3-a2d0-449f3906cd50 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:46.836428 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d4da4220-c101-43b3-a2d0-449f3906cd50 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:46.837482 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d4da4220-c101-43b3-a2d0-449f3906cd50 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:46.838375 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d4da4220-c101-43b3-a2d0-449f3906cd50 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:46.839086 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d4da4220-c101-43b3-a2d0-449f3906cd50 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:46.839750 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d4da4220-c101-43b3-a2d0-449f3906cd50 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:46.879092 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-d4da4220-c101-43b3-a2d0-449f3906cd50 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] HTTP exception thrown: Instance 7b84f450-5c05-4468-b17a-2cd30f2c7f55 could not be found. Sep 23 04:38:46.880883 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d4da4220-c101-43b3-a2d0-449f3906cd50 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Request method failure captured: Sep 23 04:38:46.880883 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/7b84f450-5c05-4468-b17a-2cd30f2c7f55 HTTP/1.1 Sep 23 04:38:46.880883 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:38:46.880883 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:38:46.880883 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:38:46.880883 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:38:46.880883 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:38:46.880883 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:38:46.880883 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:38:46.880883 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:38:46.880883 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTedAlFPeFmnDF7aT3i0aUDQGJFgGZnI-hp3AgXCkcO3hSwSmXlMqV4YX4M2zE_tzLZBCRNva2-mnxAIXvcDQ4ADhbq0RDumL2tq0UzsAkBd3JY4bJ4oVHe0Nm8SGB15yLY37BALihKvv5H7mxEOffoAs77PenOe-f2xwUXiU1RwOEo Sep 23 04:38:46.880883 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:38:46.880883 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:38:46.880883 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:38:46.880883 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:38:46.880883 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:38:46.880883 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:38:46.880883 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: f5db359a60174c45afa2bf06e23a46c4 Sep 23 04:38:46.880883 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ServersOnMultiNodesTest-604470560 Sep 23 04:38:46.880883 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:38:46.880883 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:38:46.880883 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f5db359a60174c45afa2bf06e23a46c4", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f5db359a60174c45afa2bf06e23a46c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f5db359a60174c45afa2bf06e23a46c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f5db359a60174c45afa2bf06e23a46c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:38:46.880883 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ServersOnMultiNodesTest-604470560 Sep 23 04:38:46.880883 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: f5db359a60174c45afa2bf06e23a46c4 Sep 23 04:38:46.880883 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-604470560 Sep 23 04:38:46.880883 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ServersOnMultiNodesTest-604470560-project Sep 23 04:38:46.880883 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:38:46.880883 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:38:46.880883 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: da08af8193dd490b93278385583f24c0 Sep 23 04:38:46.880883 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ServersOnMultiNodesTest-604470560-project Sep 23 04:38:46.880883 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:38:46.880883 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 7b84f450-5c05-4468-b17a-2cd30f2c7f55 could not be found. Sep 23 04:38:46.880883 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '7b84f450-5c05-4468-b17a-2cd30f2c7f55'} Sep 23 04:38:46.880883 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:38:46.880883 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:38:46.880883 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:38:46.880883 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:38:46.880883 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:38:46.880883 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:38:46.880883 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:38:46.880883 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:38:46.880883 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:38:46.880883 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:38:46.880883 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b84f450-5c05-4468-b17a-2cd30f2c7f55 could not be found. Sep 23 04:38:46.880883 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:38:46.880883 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:38:46.880883 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:38:46.880883 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:38:46.880883 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:38:46.880883 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:38:46.880883 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:38:46.880883 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:38:46.880883 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:38:46.880883 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:38:46.880883 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:38:46.880883 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:38:46.880883 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:38:46.880883 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:38:46.880883 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:38:46.880883 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:38:46.880883 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b84f450-5c05-4468-b17a-2cd30f2c7f55 could not be found. Sep 23 04:38:46.880883 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:38:46.880883 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:38:46.880883 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:38:46.885663 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:38:46.885663 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:38:46.885663 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:38:46.885663 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:38:46.885663 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:38:46.885663 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b84f450-5c05-4468-b17a-2cd30f2c7f55 could not be found. Sep 23 04:38:46.885663 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:38:46.885663 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d4da4220-c101-43b3-a2d0-449f3906cd50 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Returning 404 to user: Instance 7b84f450-5c05-4468-b17a-2cd30f2c7f55 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:38:46.887761 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d4da4220-c101-43b3-a2d0-449f3906cd50 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/7b84f450-5c05-4468-b17a-2cd30f2c7f55" status: 404 len: 111 microversion: 2.1 time: 0.065665 Sep 23 04:38:46.892907 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1032/2015] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:46 2022] GET /compute/v2.1/servers/7b84f450-5c05-4468-b17a-2cd30f2c7f55 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:38:46.904366 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-36af5dfa-1646-4b76-a9fa-7737bb3f79fb tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:46.905409 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-36af5dfa-1646-4b76-a9fa-7737bb3f79fb tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 1058d2c6-a5c4-41f2-8b63-40079d80419c] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:46.919669 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-36af5dfa-1646-4b76-a9fa-7737bb3f79fb tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:46.920221 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-36af5dfa-1646-4b76-a9fa-7737bb3f79fb tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:46.921984 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-36af5dfa-1646-4b76-a9fa-7737bb3f79fb tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:46.922742 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-36af5dfa-1646-4b76-a9fa-7737bb3f79fb tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:46.923221 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-36af5dfa-1646-4b76-a9fa-7737bb3f79fb tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:46.923657 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-36af5dfa-1646-4b76-a9fa-7737bb3f79fb tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:46.951099 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=100 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:38:46.982801 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-36af5dfa-1646-4b76-a9fa-7737bb3f79fb tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 1058d2c6-a5c4-41f2-8b63-40079d80419c] Going to try to terminate instance {{(pid=122699) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:38:47.052397 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9739dd0b-0c8f-439c-9e47-ed3b455df476 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1830400350", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:38:47.117581 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.network.neutron [None req-9739dd0b-0c8f-439c-9e47-ed3b455df476 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] validate_networks() for None {{(pid=122698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:38:47.320680 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-36af5dfa-1646-4b76-a9fa-7737bb3f79fb tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "DELETE /compute/v2.1/servers/1058d2c6-a5c4-41f2-8b63-40079d80419c" status: 204 len: 0 microversion: 2.1 time: 0.424851 Sep 23 04:38:47.321624 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1033/2016] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:38:46 2022] DELETE /compute/v2.1/servers/1058d2c6-a5c4-41f2-8b63-40079d80419c => generated 0 bytes in 427 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:38:47.331164 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3ff37791-f5e4-4809-b193-3add1b7517d4 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:47.334773 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-3ff37791-f5e4-4809-b193-3add1b7517d4 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 4997661d-a262-4bfa-994f-3615df7a8180] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:47.338352 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3ff37791-f5e4-4809-b193-3add1b7517d4 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:47.338849 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3ff37791-f5e4-4809-b193-3add1b7517d4 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:47.339289 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3ff37791-f5e4-4809-b193-3add1b7517d4 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:47.339991 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3ff37791-f5e4-4809-b193-3add1b7517d4 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:47.340456 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3ff37791-f5e4-4809-b193-3add1b7517d4 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:47.340885 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3ff37791-f5e4-4809-b193-3add1b7517d4 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:47.369783 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-3ff37791-f5e4-4809-b193-3add1b7517d4 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 4997661d-a262-4bfa-994f-3615df7a8180] Going to try to terminate instance {{(pid=122699) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:38:47.439426 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-9739dd0b-0c8f-439c-9e47-ed3b455df476 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Flavor limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:38:47.440065 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-9739dd0b-0c8f-439c-9e47-ed3b455df476 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Image limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:38:47.440553 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-9739dd0b-0c8f-439c-9e47-ed3b455df476 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Flavor pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:38:47.440962 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-9739dd0b-0c8f-439c-9e47-ed3b455df476 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Image pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:38:47.441583 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-9739dd0b-0c8f-439c-9e47-ed3b455df476 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:38:47.450982 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9739dd0b-0c8f-439c-9e47-ed3b455df476 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:47.451405 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9739dd0b-0c8f-439c-9e47-ed3b455df476 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:47.451839 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9739dd0b-0c8f-439c-9e47-ed3b455df476 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:47.452777 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9739dd0b-0c8f-439c-9e47-ed3b455df476 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:47.453453 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9739dd0b-0c8f-439c-9e47-ed3b455df476 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:47.454145 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9739dd0b-0c8f-439c-9e47-ed3b455df476 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:47.471212 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-9739dd0b-0c8f-439c-9e47-ed3b455df476 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Getting quotas for project fc56537160d349aab8f5e6499ca8ab99. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:38:47.476024 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-9739dd0b-0c8f-439c-9e47-ed3b455df476 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Getting quotas for user ee6477e60b54491baff0a7dbee062ed6 and project fc56537160d349aab8f5e6499ca8ab99. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:38:47.488572 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-9739dd0b-0c8f-439c-9e47-ed3b455df476 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Going to run 1 instances... {{(pid=122698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:38:47.490974 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-9739dd0b-0c8f-439c-9e47-ed3b455df476 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] [instance: 3871f20c-2d2b-4918-9381-73e73651a586] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:38:47.634628 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3ff37791-f5e4-4809-b193-3add1b7517d4 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4997661d-a262-4bfa-994f-3615df7a8180" status: 204 len: 0 microversion: 2.1 time: 0.307301 Sep 23 04:38:47.635405 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1034/2017] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:38:47 2022] DELETE /compute/v2.1/servers/4997661d-a262-4bfa-994f-3615df7a8180 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:38:47.644340 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a08aa1d1-6830-4ccc-963b-0e3bd47a5137 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:47.645315 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a08aa1d1-6830-4ccc-963b-0e3bd47a5137 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] [instance: 7e90c852-5f27-4861-9b25-9ea1e475c0a9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:47.650068 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9739dd0b-0c8f-439c-9e47-ed3b455df476 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.084410 Sep 23 04:38:47.651356 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 984/2018] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:38:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1086 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:38:47.656142 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4722e579-0f80-4b26-975a-7e4399b71fee tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:47.657582 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4722e579-0f80-4b26-975a-7e4399b71fee tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 1058d2c6-a5c4-41f2-8b63-40079d80419c] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:47.660448 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a08aa1d1-6830-4ccc-963b-0e3bd47a5137 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:47.660968 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a08aa1d1-6830-4ccc-963b-0e3bd47a5137 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:47.661425 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a08aa1d1-6830-4ccc-963b-0e3bd47a5137 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:47.662186 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a08aa1d1-6830-4ccc-963b-0e3bd47a5137 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:47.662697 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a08aa1d1-6830-4ccc-963b-0e3bd47a5137 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:47.663130 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a08aa1d1-6830-4ccc-963b-0e3bd47a5137 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:47.666499 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4722e579-0f80-4b26-975a-7e4399b71fee tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:47.667003 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4722e579-0f80-4b26-975a-7e4399b71fee tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:47.670780 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4722e579-0f80-4b26-975a-7e4399b71fee tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:47.670780 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4722e579-0f80-4b26-975a-7e4399b71fee tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:47.670780 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4722e579-0f80-4b26-975a-7e4399b71fee tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:47.670780 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4722e579-0f80-4b26-975a-7e4399b71fee tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:47.895169 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4722e579-0f80-4b26-975a-7e4399b71fee tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:47.899097 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a08aa1d1-6830-4ccc-963b-0e3bd47a5137 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1244f3db540441a28d8413e510cfccad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b412c874d4e668b4a1a33dedb2c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:47.903277 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4722e579-0f80-4b26-975a-7e4399b71fee tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/1058d2c6-a5c4-41f2-8b63-40079d80419c" status: 200 len: 1475 microversion: 2.1 time: 0.250688 Sep 23 04:38:47.903868 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 985/2019] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:47 2022] GET /compute/v2.1/servers/1058d2c6-a5c4-41f2-8b63-40079d80419c => generated 1475 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:47.907599 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a08aa1d1-6830-4ccc-963b-0e3bd47a5137 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] 10.222.0.33 "GET /compute/v2.1/servers/7e90c852-5f27-4861-9b25-9ea1e475c0a9" status: 200 len: 1508 microversion: 2.1 time: 0.267979 Sep 23 04:38:47.908159 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1035/2020] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:47 2022] GET /compute/v2.1/servers/7e90c852-5f27-4861-9b25-9ea1e475c0a9 => generated 1508 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:47.913361 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3a8a5ab5-4ebc-4fa8-84d6-d83998d35977 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:47.914310 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-3a8a5ab5-4ebc-4fa8-84d6-d83998d35977 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] [instance: 53745879-9973-4217-b1c5-b45f917db80e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:47.922519 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4a9face4-81e5-4a25-b07b-c59282cd6b17 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:47.922519 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4a9face4-81e5-4a25-b07b-c59282cd6b17 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] [instance: 3871f20c-2d2b-4918-9381-73e73651a586] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:47.922739 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3a8a5ab5-4ebc-4fa8-84d6-d83998d35977 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:47.922739 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3a8a5ab5-4ebc-4fa8-84d6-d83998d35977 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:47.922739 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3a8a5ab5-4ebc-4fa8-84d6-d83998d35977 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:47.922739 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3a8a5ab5-4ebc-4fa8-84d6-d83998d35977 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:47.923090 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3a8a5ab5-4ebc-4fa8-84d6-d83998d35977 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:47.923361 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3a8a5ab5-4ebc-4fa8-84d6-d83998d35977 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:47.976482 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4a9face4-81e5-4a25-b07b-c59282cd6b17 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6477e60b54491baff0a7dbee062ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc56537160d349aab8f5e6499ca8ab99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:47.987850 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4a9face4-81e5-4a25-b07b-c59282cd6b17 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] 10.222.0.33 "GET /compute/v2.1/servers/3871f20c-2d2b-4918-9381-73e73651a586" status: 200 len: 1219 microversion: 2.1 time: 0.080084 Sep 23 04:38:47.987850 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 986/2021] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:47 2022] GET /compute/v2.1/servers/3871f20c-2d2b-4918-9381-73e73651a586 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:47.999150 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-815dded1-c059-4de1-9886-23f5dba8d186 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:48.000600 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-815dded1-c059-4de1-9886-23f5dba8d186 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] [instance: 94fc4134-9b8e-4dcd-bd96-5545bfd51c97] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:48.010393 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-815dded1-c059-4de1-9886-23f5dba8d186 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:48.011967 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-815dded1-c059-4de1-9886-23f5dba8d186 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:48.013376 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-815dded1-c059-4de1-9886-23f5dba8d186 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:48.020342 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-815dded1-c059-4de1-9886-23f5dba8d186 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:48.020342 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-815dded1-c059-4de1-9886-23f5dba8d186 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:48.020342 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-815dded1-c059-4de1-9886-23f5dba8d186 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:48.113445 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-815dded1-c059-4de1-9886-23f5dba8d186 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:48.122085 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-815dded1-c059-4de1-9886-23f5dba8d186 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:48.123559 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-815dded1-c059-4de1-9886-23f5dba8d186 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:48.128720 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-815dded1-c059-4de1-9886-23f5dba8d186 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] 10.222.0.33 "GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97" status: 200 len: 1447 microversion: 2.75 time: 0.141859 Sep 23 04:38:48.129310 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 987/2022] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:38:47 2022] GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97 => generated 1447 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:38:48.134333 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c2ee5a4a-24e1-4a13-b456-2a2e4b5691fe tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1121255841", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "c69ae9f6-7e1f-4037-b183-87d9ba3569e0"}], "block_device_mapping_v2": [{"uuid": "3c25b9f2-bfe3-4f9f-97bd-056d9f09cd3a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:38:48.169254 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-3a8a5ab5-4ebc-4fa8-84d6-d83998d35977 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:48.178670 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-3a8a5ab5-4ebc-4fa8-84d6-d83998d35977 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:48.180820 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-3a8a5ab5-4ebc-4fa8-84d6-d83998d35977 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:48.182111 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3a8a5ab5-4ebc-4fa8-84d6-d83998d35977 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] 10.222.0.33 "GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e" status: 200 len: 1873 microversion: 2.42 time: 0.272810 Sep 23 04:38:48.182669 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1036/2023] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:38:47 2022] GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e => generated 1873 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:38:48.209234 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.network.neutron [None req-c2ee5a4a-24e1-4a13-b456-2a2e4b5691fe tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] validate_networks() for [('c69ae9f6-7e1f-4037-b183-87d9ba3569e0', None, None, None, None, None)] {{(pid=122698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:38:48.516598 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-c1a5fa70-4156-44f6-b4a1-b0a1d9d8fcea req-9c5e958d-d7e0-4d29-9923-9255b2d497f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53745879-9973-4217-b1c5-b45f917db80e", "name": "network-vif-plugged", "status": "completed", "tag": "db361959-8361-465d-9cf6-0cddc23eb745"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:38:48.530772 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-c1a5fa70-4156-44f6-b4a1-b0a1d9d8fcea req-9c5e958d-d7e0-4d29-9923-9255b2d497f1 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:48.537314 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-c1a5fa70-4156-44f6-b4a1-b0a1d9d8fcea req-9c5e958d-d7e0-4d29-9923-9255b2d497f1 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:48.538194 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-c1a5fa70-4156-44f6-b4a1-b0a1d9d8fcea req-9c5e958d-d7e0-4d29-9923-9255b2d497f1 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:48.551635 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-c1a5fa70-4156-44f6-b4a1-b0a1d9d8fcea req-9c5e958d-d7e0-4d29-9923-9255b2d497f1 service nova] Creating event network-vif-plugged:db361959-8361-465d-9cf6-0cddc23eb745 for instance 53745879-9973-4217-b1c5-b45f917db80e on n-h2-846463-3 Sep 23 04:38:48.558785 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-c1a5fa70-4156-44f6-b4a1-b0a1d9d8fcea req-9c5e958d-d7e0-4d29-9923-9255b2d497f1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047007 Sep 23 04:38:48.559551 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1037/2024] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:38:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:38:48.650724 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-c2ee5a4a-24e1-4a13-b456-2a2e4b5691fe tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Flavor limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:38:48.651218 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-c2ee5a4a-24e1-4a13-b456-2a2e4b5691fe tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Image limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:38:48.651791 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-c2ee5a4a-24e1-4a13-b456-2a2e4b5691fe tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Flavor pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:38:48.652349 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-c2ee5a4a-24e1-4a13-b456-2a2e4b5691fe tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Image pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:38:48.652825 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-c2ee5a4a-24e1-4a13-b456-2a2e4b5691fe tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:38:48.663475 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c2ee5a4a-24e1-4a13-b456-2a2e4b5691fe tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:48.669541 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c2ee5a4a-24e1-4a13-b456-2a2e4b5691fe tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:48.669541 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c2ee5a4a-24e1-4a13-b456-2a2e4b5691fe tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:48.670020 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c2ee5a4a-24e1-4a13-b456-2a2e4b5691fe tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:48.670804 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c2ee5a4a-24e1-4a13-b456-2a2e4b5691fe tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:48.671408 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c2ee5a4a-24e1-4a13-b456-2a2e4b5691fe tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:48.697784 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-c2ee5a4a-24e1-4a13-b456-2a2e4b5691fe tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Getting quotas for project 004af70c9f9a43c4a7be8136268e98f9. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:38:48.703179 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-c2ee5a4a-24e1-4a13-b456-2a2e4b5691fe tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Getting quotas for user 82d04a55ba72452995e3b156325e0890 and project 004af70c9f9a43c4a7be8136268e98f9. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:38:48.764657 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c2ee5a4a-24e1-4a13-b456-2a2e4b5691fe tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Going to run 1 instances... {{(pid=122698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:38:48.767121 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c2ee5a4a-24e1-4a13-b456-2a2e4b5691fe tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: aa35cea0-4f7f-4d03-9436-f15264b9f713] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3c25b9f2-bfe3-4f9f-97bd-056d9f09cd3a',volume_size=None,volume_type=None)] {{(pid=122698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:38:48.928638 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-fe76abce-7a99-4844-ad1f-84f9399a75e5 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:48.929338 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-fe76abce-7a99-4844-ad1f-84f9399a75e5 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 1058d2c6-a5c4-41f2-8b63-40079d80419c] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:48.935545 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fe76abce-7a99-4844-ad1f-84f9399a75e5 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:48.936226 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fe76abce-7a99-4844-ad1f-84f9399a75e5 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:48.936694 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fe76abce-7a99-4844-ad1f-84f9399a75e5 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:48.937381 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fe76abce-7a99-4844-ad1f-84f9399a75e5 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:48.938656 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fe76abce-7a99-4844-ad1f-84f9399a75e5 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:48.939099 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fe76abce-7a99-4844-ad1f-84f9399a75e5 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:49.090995 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-fe76abce-7a99-4844-ad1f-84f9399a75e5 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:49.099467 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-fe76abce-7a99-4844-ad1f-84f9399a75e5 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/1058d2c6-a5c4-41f2-8b63-40079d80419c" status: 200 len: 1475 microversion: 2.1 time: 0.175361 Sep 23 04:38:49.100034 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1038/2025] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:48 2022] GET /compute/v2.1/servers/1058d2c6-a5c4-41f2-8b63-40079d80419c => generated 1475 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:38:49.104426 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-993cbc54-53f7-454e-8c0e-484aea7e26b6 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:49.105035 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-993cbc54-53f7-454e-8c0e-484aea7e26b6 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] [instance: 7e90c852-5f27-4861-9b25-9ea1e475c0a9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:49.110907 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-993cbc54-53f7-454e-8c0e-484aea7e26b6 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:49.111400 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-993cbc54-53f7-454e-8c0e-484aea7e26b6 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:49.112109 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-993cbc54-53f7-454e-8c0e-484aea7e26b6 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:49.112995 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-993cbc54-53f7-454e-8c0e-484aea7e26b6 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:49.113466 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-993cbc54-53f7-454e-8c0e-484aea7e26b6 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:49.113926 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-993cbc54-53f7-454e-8c0e-484aea7e26b6 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:49.281153 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-993cbc54-53f7-454e-8c0e-484aea7e26b6 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1244f3db540441a28d8413e510cfccad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b412c874d4e668b4a1a33dedb2c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:49.290807 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-993cbc54-53f7-454e-8c0e-484aea7e26b6 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] 10.222.0.33 "GET /compute/v2.1/servers/7e90c852-5f27-4861-9b25-9ea1e475c0a9" status: 200 len: 1508 microversion: 2.1 time: 0.189111 Sep 23 04:38:49.306272 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1039/2026] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:49 2022] GET /compute/v2.1/servers/7e90c852-5f27-4861-9b25-9ea1e475c0a9 => generated 1508 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:49.307327 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c2ee5a4a-24e1-4a13-b456-2a2e4b5691fe tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.175871 Sep 23 04:38:49.309013 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 988/2027] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:38:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1179 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:38:49.312956 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-07729f99-0420-4108-953f-d99e6451d22e tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:49.313681 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-07729f99-0420-4108-953f-d99e6451d22e tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] [instance: 3871f20c-2d2b-4918-9381-73e73651a586] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:49.338575 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-07729f99-0420-4108-953f-d99e6451d22e tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:49.339891 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-07729f99-0420-4108-953f-d99e6451d22e tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:49.340591 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-07729f99-0420-4108-953f-d99e6451d22e tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:49.341561 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-07729f99-0420-4108-953f-d99e6451d22e tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:49.342287 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-07729f99-0420-4108-953f-d99e6451d22e tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:49.342963 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-07729f99-0420-4108-953f-d99e6451d22e tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:49.353223 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-86f31109-e99e-4392-a53f-760f73044739 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:49.361167 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-86f31109-e99e-4392-a53f-760f73044739 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] [instance: 94fc4134-9b8e-4dcd-bd96-5545bfd51c97] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:49.382054 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-86f31109-e99e-4392-a53f-760f73044739 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:49.382563 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-86f31109-e99e-4392-a53f-760f73044739 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:49.390283 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-86f31109-e99e-4392-a53f-760f73044739 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:49.391976 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-86f31109-e99e-4392-a53f-760f73044739 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:49.398505 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-86f31109-e99e-4392-a53f-760f73044739 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:49.399188 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-86f31109-e99e-4392-a53f-760f73044739 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:49.506565 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-07729f99-0420-4108-953f-d99e6451d22e tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6477e60b54491baff0a7dbee062ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc56537160d349aab8f5e6499ca8ab99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:49.516443 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-07729f99-0420-4108-953f-d99e6451d22e tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] 10.222.0.33 "GET /compute/v2.1/servers/3871f20c-2d2b-4918-9381-73e73651a586" status: 200 len: 1223 microversion: 2.1 time: 0.208750 Sep 23 04:38:49.521664 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1040/2028] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:49 2022] GET /compute/v2.1/servers/3871f20c-2d2b-4918-9381-73e73651a586 => generated 1223 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:49.529849 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3cef3685-3d99-413f-9593-85c55b32205d tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:49.531700 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-3cef3685-3d99-413f-9593-85c55b32205d tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] [instance: 53745879-9973-4217-b1c5-b45f917db80e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:49.552533 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-86f31109-e99e-4392-a53f-760f73044739 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:49.567944 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-86f31109-e99e-4392-a53f-760f73044739 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:49.568339 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3cef3685-3d99-413f-9593-85c55b32205d tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:49.568339 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3cef3685-3d99-413f-9593-85c55b32205d tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:49.570035 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3cef3685-3d99-413f-9593-85c55b32205d tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:49.570764 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-86f31109-e99e-4392-a53f-760f73044739 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:49.571612 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3cef3685-3d99-413f-9593-85c55b32205d tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:49.573922 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3cef3685-3d99-413f-9593-85c55b32205d tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:49.575093 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3cef3685-3d99-413f-9593-85c55b32205d tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:49.583364 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-86f31109-e99e-4392-a53f-760f73044739 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] 10.222.0.33 "GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97" status: 200 len: 1447 microversion: 2.75 time: 0.264827 Sep 23 04:38:49.586532 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 989/2029] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:38:49 2022] GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97 => generated 1447 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:38:49.599356 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9ffa4e78-c052-41f9-b534-15d794a2114a tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:49.600469 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-9ffa4e78-c052-41f9-b534-15d794a2114a tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: aa35cea0-4f7f-4d03-9436-f15264b9f713] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:49.802238 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-9ffa4e78-c052-41f9-b534-15d794a2114a tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:49.816526 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9ffa4e78-c052-41f9-b534-15d794a2114a tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713" status: 200 len: 1053 microversion: 2.1 time: 0.226397 Sep 23 04:38:49.822584 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 990/2030] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:49 2022] GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713 => generated 1053 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:49.989768 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-3cef3685-3d99-413f-9593-85c55b32205d tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:50.000915 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-3cef3685-3d99-413f-9593-85c55b32205d tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:50.002461 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-3cef3685-3d99-413f-9593-85c55b32205d tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:50.003829 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3cef3685-3d99-413f-9593-85c55b32205d tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] 10.222.0.33 "GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e" status: 200 len: 1873 microversion: 2.42 time: 0.480785 Sep 23 04:38:50.019469 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1041/2031] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:38:49 2022] GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e => generated 1873 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:38:50.125555 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4a392987-eaaa-48b3-a84a-f796242086b5 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:50.126371 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4a392987-eaaa-48b3-a84a-f796242086b5 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 1058d2c6-a5c4-41f2-8b63-40079d80419c] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:50.134339 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4a392987-eaaa-48b3-a84a-f796242086b5 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:50.134853 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4a392987-eaaa-48b3-a84a-f796242086b5 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:50.136595 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4a392987-eaaa-48b3-a84a-f796242086b5 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:50.137438 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4a392987-eaaa-48b3-a84a-f796242086b5 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:50.137923 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4a392987-eaaa-48b3-a84a-f796242086b5 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:50.138530 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4a392987-eaaa-48b3-a84a-f796242086b5 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:50.314936 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c3fbfacd-4f43-4309-aadb-f71cae5c2bd4 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:50.315513 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c3fbfacd-4f43-4309-aadb-f71cae5c2bd4 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] [instance: 7e90c852-5f27-4861-9b25-9ea1e475c0a9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:50.335766 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c3fbfacd-4f43-4309-aadb-f71cae5c2bd4 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:50.336281 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c3fbfacd-4f43-4309-aadb-f71cae5c2bd4 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:50.336779 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c3fbfacd-4f43-4309-aadb-f71cae5c2bd4 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:50.337449 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c3fbfacd-4f43-4309-aadb-f71cae5c2bd4 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:50.338468 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c3fbfacd-4f43-4309-aadb-f71cae5c2bd4 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:50.344498 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c3fbfacd-4f43-4309-aadb-f71cae5c2bd4 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:50.529303 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4a392987-eaaa-48b3-a84a-f796242086b5 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:50.543110 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4a392987-eaaa-48b3-a84a-f796242086b5 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/1058d2c6-a5c4-41f2-8b63-40079d80419c" status: 200 len: 1475 microversion: 2.1 time: 0.418246 Sep 23 04:38:50.547040 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 991/2032] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:50 2022] GET /compute/v2.1/servers/1058d2c6-a5c4-41f2-8b63-40079d80419c => generated 1475 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:50.551943 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-b1ae0fcb-fbe2-42fa-b152-a033395a9aca req-7f331001-2167-4773-8047-b2b900e7418e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4997661d-a262-4bfa-994f-3615df7a8180", "name": "network-vif-deleted", "tag": "0721b7eb-714f-4781-bcd0-667c3afcaa9e"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:38:50.576987 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-b1ae0fcb-fbe2-42fa-b152-a033395a9aca req-7f331001-2167-4773-8047-b2b900e7418e service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:50.577478 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-b1ae0fcb-fbe2-42fa-b152-a033395a9aca req-7f331001-2167-4773-8047-b2b900e7418e service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:50.579744 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-b1ae0fcb-fbe2-42fa-b152-a033395a9aca req-7f331001-2167-4773-8047-b2b900e7418e service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:50.665533 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-b1ae0fcb-fbe2-42fa-b152-a033395a9aca req-7f331001-2167-4773-8047-b2b900e7418e service nova] Creating event network-vif-deleted:0721b7eb-714f-4781-bcd0-667c3afcaa9e for instance 4997661d-a262-4bfa-994f-3615df7a8180 on n-h1-846463-3 Sep 23 04:38:50.676695 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-b1ae0fcb-fbe2-42fa-b152-a033395a9aca req-7f331001-2167-4773-8047-b2b900e7418e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128187 Sep 23 04:38:50.680631 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 992/2033] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:38:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:38:50.690046 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c3fbfacd-4f43-4309-aadb-f71cae5c2bd4 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1244f3db540441a28d8413e510cfccad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b412c874d4e668b4a1a33dedb2c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:50.694938 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-193ddf30-2f40-4f95-8cb7-7c994a62bff7 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:50.699222 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-193ddf30-2f40-4f95-8cb7-7c994a62bff7 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] [instance: 3871f20c-2d2b-4918-9381-73e73651a586] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:50.699789 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c3fbfacd-4f43-4309-aadb-f71cae5c2bd4 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] 10.222.0.33 "GET /compute/v2.1/servers/7e90c852-5f27-4861-9b25-9ea1e475c0a9" status: 200 len: 1512 microversion: 2.1 time: 0.388369 Sep 23 04:38:50.700842 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1042/2034] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:50 2022] GET /compute/v2.1/servers/7e90c852-5f27-4861-9b25-9ea1e475c0a9 => generated 1512 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:50.706154 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-7e86fee7-64db-46c6-bd49-99cb13f9b216 req-b6c7c635-c920-4ead-87cd-dca60b4c51d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53745879-9973-4217-b1c5-b45f917db80e", "name": "network-vif-plugged", "status": "completed", "tag": "ee2c6848-15f1-4da5-b9cb-45460ca2720e"}, {"server_uuid": "53745879-9973-4217-b1c5-b45f917db80e", "name": "network-vif-plugged", "status": "completed", "tag": "8d4fddcb-265b-482d-b84d-6fe44445b855"}, {"server_uuid": "53745879-9973-4217-b1c5-b45f917db80e", "name": "network-vif-plugged", "status": "completed", "tag": "04ec7c4f-3b61-4a17-a7c1-0ebd792d85ae"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:38:50.713579 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-193ddf30-2f40-4f95-8cb7-7c994a62bff7 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:50.714115 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-193ddf30-2f40-4f95-8cb7-7c994a62bff7 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:50.714561 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-193ddf30-2f40-4f95-8cb7-7c994a62bff7 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:50.717483 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-7e86fee7-64db-46c6-bd49-99cb13f9b216 req-b6c7c635-c920-4ead-87cd-dca60b4c51d4 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:50.718409 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-7e86fee7-64db-46c6-bd49-99cb13f9b216 req-b6c7c635-c920-4ead-87cd-dca60b4c51d4 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:50.719058 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-7e86fee7-64db-46c6-bd49-99cb13f9b216 req-b6c7c635-c920-4ead-87cd-dca60b4c51d4 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:50.720305 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-193ddf30-2f40-4f95-8cb7-7c994a62bff7 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:50.720804 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-193ddf30-2f40-4f95-8cb7-7c994a62bff7 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:50.726280 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-193ddf30-2f40-4f95-8cb7-7c994a62bff7 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:50.732672 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-7e86fee7-64db-46c6-bd49-99cb13f9b216 req-b6c7c635-c920-4ead-87cd-dca60b4c51d4 service nova] Creating event network-vif-plugged:ee2c6848-15f1-4da5-b9cb-45460ca2720e for instance 53745879-9973-4217-b1c5-b45f917db80e on n-h2-846463-3 Sep 23 04:38:50.733389 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-7e86fee7-64db-46c6-bd49-99cb13f9b216 req-b6c7c635-c920-4ead-87cd-dca60b4c51d4 service nova] Creating event network-vif-plugged:8d4fddcb-265b-482d-b84d-6fe44445b855 for instance 53745879-9973-4217-b1c5-b45f917db80e on n-h2-846463-3 Sep 23 04:38:50.734341 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-7e86fee7-64db-46c6-bd49-99cb13f9b216 req-b6c7c635-c920-4ead-87cd-dca60b4c51d4 service nova] Creating event network-vif-plugged:04ec7c4f-3b61-4a17-a7c1-0ebd792d85ae for instance 53745879-9973-4217-b1c5-b45f917db80e on n-h2-846463-3 Sep 23 04:38:50.740166 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-7e86fee7-64db-46c6-bd49-99cb13f9b216 req-b6c7c635-c920-4ead-87cd-dca60b4c51d4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.037987 Sep 23 04:38:50.741517 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1043/2035] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:38:50 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:38:50.749726 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-82865c03-8ad8-4d86-8ef4-d43c3649e3c0 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:50.751396 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-82865c03-8ad8-4d86-8ef4-d43c3649e3c0 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] [instance: 94fc4134-9b8e-4dcd-bd96-5545bfd51c97] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:50.760340 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-82865c03-8ad8-4d86-8ef4-d43c3649e3c0 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:50.761733 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-82865c03-8ad8-4d86-8ef4-d43c3649e3c0 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:50.762432 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-82865c03-8ad8-4d86-8ef4-d43c3649e3c0 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:50.763316 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-82865c03-8ad8-4d86-8ef4-d43c3649e3c0 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:50.763990 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-82865c03-8ad8-4d86-8ef4-d43c3649e3c0 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:50.764656 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-82865c03-8ad8-4d86-8ef4-d43c3649e3c0 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:50.850238 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-193ddf30-2f40-4f95-8cb7-7c994a62bff7 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6477e60b54491baff0a7dbee062ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc56537160d349aab8f5e6499ca8ab99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:50.885502 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-193ddf30-2f40-4f95-8cb7-7c994a62bff7 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] 10.222.0.33 "GET /compute/v2.1/servers/3871f20c-2d2b-4918-9381-73e73651a586" status: 200 len: 1271 microversion: 2.1 time: 0.196952 Sep 23 04:38:50.887232 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 993/2036] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:50 2022] GET /compute/v2.1/servers/3871f20c-2d2b-4918-9381-73e73651a586 => generated 1271 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:50.901433 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b4ab9e31-7a88-4750-8e49-f1a8d748445f tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:50.902626 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-82865c03-8ad8-4d86-8ef4-d43c3649e3c0 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:50.912081 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b4ab9e31-7a88-4750-8e49-f1a8d748445f tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1244f3db540441a28d8413e510cfccad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b412c874d4e668b4a1a33dedb2c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:50.912687 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.compute.servers [None req-b4ab9e31-7a88-4750-8e49-f1a8d748445f tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Removing options 'limit' from query {{(pid=122698) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 23 04:38:50.914431 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-82865c03-8ad8-4d86-8ef4-d43c3649e3c0 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:50.915872 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b4ab9e31-7a88-4750-8e49-f1a8d748445f tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Searching by: {'deleted': False, 'project_id': '721b412c874d4e668b4a1a33dedb2c9b'} {{(pid=122698) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 04:38:50.916926 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-82865c03-8ad8-4d86-8ef4-d43c3649e3c0 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:50.917142 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b4ab9e31-7a88-4750-8e49-f1a8d748445f tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:50.920417 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b4ab9e31-7a88-4750-8e49-f1a8d748445f tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:50.921066 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b4ab9e31-7a88-4750-8e49-f1a8d748445f tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:50.924686 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:38:50.926534 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-82865c03-8ad8-4d86-8ef4-d43c3649e3c0 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] 10.222.0.33 "GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97" status: 200 len: 1447 microversion: 2.75 time: 0.182362 Sep 23 04:38:50.927604 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1044/2037] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:38:50 2022] GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97 => generated 1447 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:38:50.928622 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b4ab9e31-7a88-4750-8e49-f1a8d748445f tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:50.929119 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b4ab9e31-7a88-4750-8e49-f1a8d748445f tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:50.936127 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b4ab9e31-7a88-4750-8e49-f1a8d748445f tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:50.938858 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b4ab9e31-7a88-4750-8e49-f1a8d748445f tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] 10.222.0.33 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.050131 Sep 23 04:38:50.939978 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 994/2038] 10.222.0.33 () {58 vars in 1140 bytes} [Fri Sep 23 04:38:50 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 04:38:50.947834 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-225e5c14-8830-4c6b-8f25-787a5f69cdbc tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:50.957055 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-225e5c14-8830-4c6b-8f25-787a5f69cdbc tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: aa35cea0-4f7f-4d03-9436-f15264b9f713] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:50.970295 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f322fc1a-7862-4d06-adee-dd67de5827cb tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:50.971022 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f322fc1a-7862-4d06-adee-dd67de5827cb tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] [instance: 7e90c852-5f27-4861-9b25-9ea1e475c0a9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:50.980434 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:38:50.994672 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-225e5c14-8830-4c6b-8f25-787a5f69cdbc tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:50.996933 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-225e5c14-8830-4c6b-8f25-787a5f69cdbc tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:50.998615 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-225e5c14-8830-4c6b-8f25-787a5f69cdbc tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:51.003423 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-225e5c14-8830-4c6b-8f25-787a5f69cdbc tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:51.005298 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-225e5c14-8830-4c6b-8f25-787a5f69cdbc tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:51.005612 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f322fc1a-7862-4d06-adee-dd67de5827cb tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:51.006342 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f322fc1a-7862-4d06-adee-dd67de5827cb tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:51.008738 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f322fc1a-7862-4d06-adee-dd67de5827cb tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:51.008876 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-225e5c14-8830-4c6b-8f25-787a5f69cdbc tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:51.008993 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f322fc1a-7862-4d06-adee-dd67de5827cb tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:51.008993 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f322fc1a-7862-4d06-adee-dd67de5827cb tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:51.009661 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f322fc1a-7862-4d06-adee-dd67de5827cb tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:51.218132 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-225e5c14-8830-4c6b-8f25-787a5f69cdbc tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:51.233273 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-225e5c14-8830-4c6b-8f25-787a5f69cdbc tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713" status: 200 len: 1103 microversion: 2.1 time: 0.300536 Sep 23 04:38:51.244741 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1045/2039] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:50 2022] GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713 => generated 1103 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:51.250501 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a53430f3-72ba-4a16-b85d-80dda97eeff8 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:51.253320 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a53430f3-72ba-4a16-b85d-80dda97eeff8 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] [instance: 53745879-9973-4217-b1c5-b45f917db80e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:51.276616 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a53430f3-72ba-4a16-b85d-80dda97eeff8 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:51.277093 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a53430f3-72ba-4a16-b85d-80dda97eeff8 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:51.277557 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a53430f3-72ba-4a16-b85d-80dda97eeff8 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:51.278343 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a53430f3-72ba-4a16-b85d-80dda97eeff8 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:51.284662 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a53430f3-72ba-4a16-b85d-80dda97eeff8 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:51.292025 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a53430f3-72ba-4a16-b85d-80dda97eeff8 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:51.361933 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f322fc1a-7862-4d06-adee-dd67de5827cb tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1244f3db540441a28d8413e510cfccad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b412c874d4e668b4a1a33dedb2c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:51.371324 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f322fc1a-7862-4d06-adee-dd67de5827cb tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] 10.222.0.33 "GET /compute/v2.1/servers/7e90c852-5f27-4861-9b25-9ea1e475c0a9" status: 200 len: 1512 microversion: 2.1 time: 0.413425 Sep 23 04:38:51.387784 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 995/2040] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:50 2022] GET /compute/v2.1/servers/7e90c852-5f27-4861-9b25-9ea1e475c0a9 => generated 1512 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:51.398444 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-15ef2a5b-904f-4626-907e-b154c5274475 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:51.399290 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-15ef2a5b-904f-4626-907e-b154c5274475 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] [instance: 94e8c141-ef33-4bb2-929f-7f7d0d10ff2c] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:51.408004 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-15ef2a5b-904f-4626-907e-b154c5274475 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:51.409034 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-15ef2a5b-904f-4626-907e-b154c5274475 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:51.409778 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-15ef2a5b-904f-4626-907e-b154c5274475 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:51.410904 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-15ef2a5b-904f-4626-907e-b154c5274475 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:51.411579 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-15ef2a5b-904f-4626-907e-b154c5274475 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:51.412274 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-15ef2a5b-904f-4626-907e-b154c5274475 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:51.454507 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:38:51.885268 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a53430f3-72ba-4a16-b85d-80dda97eeff8 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:51.907838 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a53430f3-72ba-4a16-b85d-80dda97eeff8 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:51.914512 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a53430f3-72ba-4a16-b85d-80dda97eeff8 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:51.914512 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a53430f3-72ba-4a16-b85d-80dda97eeff8 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] 10.222.0.33 "GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e" status: 200 len: 1873 microversion: 2.42 time: 0.671659 Sep 23 04:38:51.914512 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1046/2041] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:38:51 2022] GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e => generated 1873 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:38:51.928972 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-15ef2a5b-904f-4626-907e-b154c5274475 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1244f3db540441a28d8413e510cfccad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b412c874d4e668b4a1a33dedb2c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:51.931070 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2960ea02-b619-4306-affd-6d6e125e17ba tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:51.932007 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-2960ea02-b619-4306-affd-6d6e125e17ba tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 1058d2c6-a5c4-41f2-8b63-40079d80419c] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:51.940204 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-15ef2a5b-904f-4626-907e-b154c5274475 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] 10.222.0.33 "GET /compute/v2.1/servers/94e8c141-ef33-4bb2-929f-7f7d0d10ff2c" status: 200 len: 1512 microversion: 2.1 time: 0.547431 Sep 23 04:38:51.940898 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2960ea02-b619-4306-affd-6d6e125e17ba tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:51.954159 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2960ea02-b619-4306-affd-6d6e125e17ba tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:51.954159 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2960ea02-b619-4306-affd-6d6e125e17ba tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:51.954159 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2960ea02-b619-4306-affd-6d6e125e17ba tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:51.954159 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2960ea02-b619-4306-affd-6d6e125e17ba tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:51.954159 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2960ea02-b619-4306-affd-6d6e125e17ba tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:51.956080 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 996/2042] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:51 2022] GET /compute/v2.1/servers/94e8c141-ef33-4bb2-929f-7f7d0d10ff2c => generated 1512 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:38:51.967297 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e8495102-7b7d-473d-84e0-2cdb9fc2727d tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:51.971571 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e8495102-7b7d-473d-84e0-2cdb9fc2727d tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] [instance: 3871f20c-2d2b-4918-9381-73e73651a586] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:51.974104 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e8495102-7b7d-473d-84e0-2cdb9fc2727d tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:51.974599 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e8495102-7b7d-473d-84e0-2cdb9fc2727d tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:51.975041 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e8495102-7b7d-473d-84e0-2cdb9fc2727d tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:51.975754 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e8495102-7b7d-473d-84e0-2cdb9fc2727d tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:51.976533 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e8495102-7b7d-473d-84e0-2cdb9fc2727d tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:51.977842 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e8495102-7b7d-473d-84e0-2cdb9fc2727d tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:52.029532 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2960ea02-b619-4306-affd-6d6e125e17ba tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:52.039284 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:38:52.042901 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2960ea02-b619-4306-affd-6d6e125e17ba tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/1058d2c6-a5c4-41f2-8b63-40079d80419c" status: 200 len: 1433 microversion: 2.1 time: 0.128555 Sep 23 04:38:52.043809 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1047/2043] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:51 2022] GET /compute/v2.1/servers/1058d2c6-a5c4-41f2-8b63-40079d80419c => generated 1433 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:52.063933 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e48e4558-685d-4e5d-85dd-be0b4a3c959e tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:52.064589 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e48e4558-685d-4e5d-85dd-be0b4a3c959e tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] [instance: 94fc4134-9b8e-4dcd-bd96-5545bfd51c97] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:52.075639 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e48e4558-685d-4e5d-85dd-be0b4a3c959e tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:52.076088 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e48e4558-685d-4e5d-85dd-be0b4a3c959e tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:52.076530 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e48e4558-685d-4e5d-85dd-be0b4a3c959e tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:52.077312 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e48e4558-685d-4e5d-85dd-be0b4a3c959e tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:52.077841 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e48e4558-685d-4e5d-85dd-be0b4a3c959e tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:52.078335 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e48e4558-685d-4e5d-85dd-be0b4a3c959e tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:52.108592 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e8495102-7b7d-473d-84e0-2cdb9fc2727d tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6477e60b54491baff0a7dbee062ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc56537160d349aab8f5e6499ca8ab99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:52.119578 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e8495102-7b7d-473d-84e0-2cdb9fc2727d tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] 10.222.0.33 "GET /compute/v2.1/servers/3871f20c-2d2b-4918-9381-73e73651a586" status: 200 len: 1289 microversion: 2.1 time: 0.162310 Sep 23 04:38:52.124708 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 997/2044] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:51 2022] GET /compute/v2.1/servers/3871f20c-2d2b-4918-9381-73e73651a586 => generated 1289 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:52.142737 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-99d70cc4-3931-4e3a-abed-1698c1495ae2 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:52.143783 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-99d70cc4-3931-4e3a-abed-1698c1495ae2 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] [instance: e203a3bb-aff0-41d9-b8ba-750797cab055] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:52.164511 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-99d70cc4-3931-4e3a-abed-1698c1495ae2 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:52.165230 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-99d70cc4-3931-4e3a-abed-1698c1495ae2 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:52.166857 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-99d70cc4-3931-4e3a-abed-1698c1495ae2 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:52.167651 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-99d70cc4-3931-4e3a-abed-1698c1495ae2 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:52.168132 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-99d70cc4-3931-4e3a-abed-1698c1495ae2 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:52.168573 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-99d70cc4-3931-4e3a-abed-1698c1495ae2 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:52.238682 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e48e4558-685d-4e5d-85dd-be0b4a3c959e tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:52.260793 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e48e4558-685d-4e5d-85dd-be0b4a3c959e tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:52.267929 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e48e4558-685d-4e5d-85dd-be0b4a3c959e tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:52.289003 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e48e4558-685d-4e5d-85dd-be0b4a3c959e tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] 10.222.0.33 "GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97" status: 200 len: 1453 microversion: 2.75 time: 0.243654 Sep 23 04:38:52.289760 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1048/2045] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:38:52 2022] GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97 => generated 1453 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:38:52.316165 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-11abb29d-cb69-4d20-9982-5b44737b7df3 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:52.316165 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-11abb29d-cb69-4d20-9982-5b44737b7df3 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: aa35cea0-4f7f-4d03-9436-f15264b9f713] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:52.340247 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-11abb29d-cb69-4d20-9982-5b44737b7df3 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:52.342530 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-11abb29d-cb69-4d20-9982-5b44737b7df3 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:52.344767 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-11abb29d-cb69-4d20-9982-5b44737b7df3 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:52.346722 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-11abb29d-cb69-4d20-9982-5b44737b7df3 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:52.347220 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-11abb29d-cb69-4d20-9982-5b44737b7df3 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:52.350202 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-11abb29d-cb69-4d20-9982-5b44737b7df3 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:52.868316 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-11abb29d-cb69-4d20-9982-5b44737b7df3 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:52.876906 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-11abb29d-cb69-4d20-9982-5b44737b7df3 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713" status: 200 len: 1095 microversion: 2.1 time: 0.580181 Sep 23 04:38:52.881349 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1049/2046] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:52 2022] GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713 => generated 1095 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:52.886131 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-bbc2e550-9ab8-4a52-84e5-1a52a8f8355e tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:52.886626 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-bbc2e550-9ab8-4a52-84e5-1a52a8f8355e tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 9d2757b5-8933-4d44-bfa5-cb5054cd05c6] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:52.906677 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bbc2e550-9ab8-4a52-84e5-1a52a8f8355e tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:52.907265 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bbc2e550-9ab8-4a52-84e5-1a52a8f8355e tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:52.907919 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bbc2e550-9ab8-4a52-84e5-1a52a8f8355e tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:52.908658 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bbc2e550-9ab8-4a52-84e5-1a52a8f8355e tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:52.909125 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bbc2e550-9ab8-4a52-84e5-1a52a8f8355e tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:52.909558 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bbc2e550-9ab8-4a52-84e5-1a52a8f8355e tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:52.966464 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-bbc2e550-9ab8-4a52-84e5-1a52a8f8355e tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 9d2757b5-8933-4d44-bfa5-cb5054cd05c6] Going to try to terminate instance {{(pid=122699) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:38:53.032138 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-99d70cc4-3931-4e3a-abed-1698c1495ae2 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1244f3db540441a28d8413e510cfccad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b412c874d4e668b4a1a33dedb2c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:53.044462 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-99d70cc4-3931-4e3a-abed-1698c1495ae2 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] 10.222.0.33 "GET /compute/v2.1/servers/e203a3bb-aff0-41d9-b8ba-750797cab055" status: 200 len: 1510 microversion: 2.1 time: 0.918215 Sep 23 04:38:53.058042 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 998/2047] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:52 2022] GET /compute/v2.1/servers/e203a3bb-aff0-41d9-b8ba-750797cab055 => generated 1510 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:53.058042 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-cfc5367f-4846-4e64-888d-cd4e79206cb1 req-6d1f8cf7-6b16-4374-9f20-9811a6ebdd5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1058d2c6-a5c4-41f2-8b63-40079d80419c", "name": "network-vif-deleted", "tag": "093fa6be-7b6f-4cd2-93e0-851baa75b110"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:38:53.069042 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-cfc5367f-4846-4e64-888d-cd4e79206cb1 req-6d1f8cf7-6b16-4374-9f20-9811a6ebdd5a service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:53.069559 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-cfc5367f-4846-4e64-888d-cd4e79206cb1 req-6d1f8cf7-6b16-4374-9f20-9811a6ebdd5a service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:53.070323 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-cfc5367f-4846-4e64-888d-cd4e79206cb1 req-6d1f8cf7-6b16-4374-9f20-9811a6ebdd5a service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:53.084176 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-cfc5367f-4846-4e64-888d-cd4e79206cb1 req-6d1f8cf7-6b16-4374-9f20-9811a6ebdd5a service nova] Creating event network-vif-deleted:093fa6be-7b6f-4cd2-93e0-851baa75b110 for instance 1058d2c6-a5c4-41f2-8b63-40079d80419c on n-h2-846463-3 Sep 23 04:38:53.090228 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-cfc5367f-4846-4e64-888d-cd4e79206cb1 req-6d1f8cf7-6b16-4374-9f20-9811a6ebdd5a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043313 Sep 23 04:38:53.091437 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 999/2048] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:38:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:38:53.103067 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-44e73094-4403-4af5-a781-97819a395dda req-891a72bf-dc26-4aed-9cb4-17208c6a4382 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53745879-9973-4217-b1c5-b45f917db80e", "name": "network-vif-plugged", "status": "completed", "tag": "2e21d383-3d28-4e86-b810-b78bf2b6d003"}, {"server_uuid": "53745879-9973-4217-b1c5-b45f917db80e", "name": "network-vif-plugged", "status": "completed", "tag": "2abf97e6-d464-4cf6-a441-15ced1cece90"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:38:53.112312 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-44e73094-4403-4af5-a781-97819a395dda req-891a72bf-dc26-4aed-9cb4-17208c6a4382 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:53.113046 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-44e73094-4403-4af5-a781-97819a395dda req-891a72bf-dc26-4aed-9cb4-17208c6a4382 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:53.114024 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-44e73094-4403-4af5-a781-97819a395dda req-891a72bf-dc26-4aed-9cb4-17208c6a4382 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:53.132530 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-44e73094-4403-4af5-a781-97819a395dda req-891a72bf-dc26-4aed-9cb4-17208c6a4382 service nova] Creating event network-vif-plugged:2e21d383-3d28-4e86-b810-b78bf2b6d003 for instance 53745879-9973-4217-b1c5-b45f917db80e on n-h2-846463-3 Sep 23 04:38:53.132530 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-44e73094-4403-4af5-a781-97819a395dda req-891a72bf-dc26-4aed-9cb4-17208c6a4382 service nova] Creating event network-vif-plugged:2abf97e6-d464-4cf6-a441-15ced1cece90 for instance 53745879-9973-4217-b1c5-b45f917db80e on n-h2-846463-3 Sep 23 04:38:53.138552 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-44e73094-4403-4af5-a781-97819a395dda req-891a72bf-dc26-4aed-9cb4-17208c6a4382 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.045262 Sep 23 04:38:53.139175 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1000/2049] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:38:53 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:38:53.146447 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-21a6498c-30ef-42bd-8a36-9700de20055a tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:53.147372 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-21a6498c-30ef-42bd-8a36-9700de20055a tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] [instance: 53745879-9973-4217-b1c5-b45f917db80e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:53.155785 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-21a6498c-30ef-42bd-8a36-9700de20055a tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:53.156520 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-21a6498c-30ef-42bd-8a36-9700de20055a tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:53.156970 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-21a6498c-30ef-42bd-8a36-9700de20055a tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:53.157733 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-21a6498c-30ef-42bd-8a36-9700de20055a tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:53.158401 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-21a6498c-30ef-42bd-8a36-9700de20055a tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:53.159473 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-21a6498c-30ef-42bd-8a36-9700de20055a tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:53.406118 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-21a6498c-30ef-42bd-8a36-9700de20055a tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:53.415306 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-21a6498c-30ef-42bd-8a36-9700de20055a tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:53.416805 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-21a6498c-30ef-42bd-8a36-9700de20055a tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:53.417995 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-21a6498c-30ef-42bd-8a36-9700de20055a tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] 10.222.0.33 "GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e" status: 200 len: 1873 microversion: 2.42 time: 0.277367 Sep 23 04:38:53.418564 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1001/2050] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:38:53 2022] GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e => generated 1873 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:38:53.423635 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-16478d84-6768-4734-ba1e-f2b5066a5b89 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:53.424256 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-16478d84-6768-4734-ba1e-f2b5066a5b89 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 1058d2c6-a5c4-41f2-8b63-40079d80419c] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:53.429739 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-16478d84-6768-4734-ba1e-f2b5066a5b89 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:53.430272 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-16478d84-6768-4734-ba1e-f2b5066a5b89 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:53.430718 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-16478d84-6768-4734-ba1e-f2b5066a5b89 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:53.431418 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-16478d84-6768-4734-ba1e-f2b5066a5b89 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:53.431882 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-16478d84-6768-4734-ba1e-f2b5066a5b89 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:53.432313 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-16478d84-6768-4734-ba1e-f2b5066a5b89 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:53.470673 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-16478d84-6768-4734-ba1e-f2b5066a5b89 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:53.471628 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-16478d84-6768-4734-ba1e-f2b5066a5b89 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:53.472197 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-16478d84-6768-4734-ba1e-f2b5066a5b89 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:53.472848 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-16478d84-6768-4734-ba1e-f2b5066a5b89 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lazy-loading 'fault' on Instance uuid 1058d2c6-a5c4-41f2-8b63-40079d80419c {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:38:53.481525 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-bbc2e550-9ab8-4a52-84e5-1a52a8f8355e tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9d2757b5-8933-4d44-bfa5-cb5054cd05c6" status: 204 len: 0 microversion: 2.1 time: 0.598767 Sep 23 04:38:53.483895 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1050/2051] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:38:52 2022] DELETE /compute/v2.1/servers/9d2757b5-8933-4d44-bfa5-cb5054cd05c6 => generated 0 bytes in 600 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:38:53.489792 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c5fdc6f0-b11d-440a-9ff2-00f6417bddd6 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:53.494965 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c5fdc6f0-b11d-440a-9ff2-00f6417bddd6 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1244f3db540441a28d8413e510cfccad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b412c874d4e668b4a1a33dedb2c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:53.495725 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c5fdc6f0-b11d-440a-9ff2-00f6417bddd6 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Searching by: {'ip': '172.20.0.10', 'deleted': False, 'project_id': '721b412c874d4e668b4a1a33dedb2c9b'} {{(pid=122699) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 04:38:53.575296 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-16478d84-6768-4734-ba1e-f2b5066a5b89 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:53.584185 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-16478d84-6768-4734-ba1e-f2b5066a5b89 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/1058d2c6-a5c4-41f2-8b63-40079d80419c" status: 200 len: 1309 microversion: 2.1 time: 0.163843 Sep 23 04:38:53.584185 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1002/2052] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:53 2022] GET /compute/v2.1/servers/1058d2c6-a5c4-41f2-8b63-40079d80419c => generated 1309 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:53.588801 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4282b147-bfd7-4f96-84f8-1b7e3cca8871 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:53.589444 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4282b147-bfd7-4f96-84f8-1b7e3cca8871 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] [instance: 3871f20c-2d2b-4918-9381-73e73651a586] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:53.595909 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4282b147-bfd7-4f96-84f8-1b7e3cca8871 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:53.596469 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4282b147-bfd7-4f96-84f8-1b7e3cca8871 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:53.596882 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4282b147-bfd7-4f96-84f8-1b7e3cca8871 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:53.597544 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4282b147-bfd7-4f96-84f8-1b7e3cca8871 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:53.598032 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4282b147-bfd7-4f96-84f8-1b7e3cca8871 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:53.598599 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4282b147-bfd7-4f96-84f8-1b7e3cca8871 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:53.724519 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4282b147-bfd7-4f96-84f8-1b7e3cca8871 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6477e60b54491baff0a7dbee062ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc56537160d349aab8f5e6499ca8ab99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:53.730857 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c5fdc6f0-b11d-440a-9ff2-00f6417bddd6 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:53.732460 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c5fdc6f0-b11d-440a-9ff2-00f6417bddd6 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:53.732923 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c5fdc6f0-b11d-440a-9ff2-00f6417bddd6 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:53.733779 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c5fdc6f0-b11d-440a-9ff2-00f6417bddd6 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:53.734875 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c5fdc6f0-b11d-440a-9ff2-00f6417bddd6 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:53.735216 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c5fdc6f0-b11d-440a-9ff2-00f6417bddd6 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:53.736502 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4282b147-bfd7-4f96-84f8-1b7e3cca8871 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] 10.222.0.33 "GET /compute/v2.1/servers/3871f20c-2d2b-4918-9381-73e73651a586" status: 200 len: 1277 microversion: 2.1 time: 0.151360 Sep 23 04:38:53.739907 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1003/2053] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:53 2022] GET /compute/v2.1/servers/3871f20c-2d2b-4918-9381-73e73651a586 => generated 1277 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:53.751348 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3b304593-005c-4df1-a832-ea758466b567 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:53.751803 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3b304593-005c-4df1-a832-ea758466b567 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] [instance: 94fc4134-9b8e-4dcd-bd96-5545bfd51c97] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:53.785614 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3b304593-005c-4df1-a832-ea758466b567 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:53.789986 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3b304593-005c-4df1-a832-ea758466b567 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:53.789986 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3b304593-005c-4df1-a832-ea758466b567 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:53.789986 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3b304593-005c-4df1-a832-ea758466b567 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:53.789986 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3b304593-005c-4df1-a832-ea758466b567 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:53.789986 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3b304593-005c-4df1-a832-ea758466b567 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:53.824238 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.multi_cell_list [None req-c5fdc6f0-b11d-440a-9ff2-00f6417bddd6 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122699) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 23 04:38:53.921456 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-3b304593-005c-4df1-a832-ea758466b567 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:53.934551 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-3b304593-005c-4df1-a832-ea758466b567 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:53.939610 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-3b304593-005c-4df1-a832-ea758466b567 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:53.946310 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3b304593-005c-4df1-a832-ea758466b567 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] 10.222.0.33 "GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97" status: 200 len: 1453 microversion: 2.75 time: 0.205234 Sep 23 04:38:53.962797 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1004/2054] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:38:53 2022] GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97 => generated 1453 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:38:53.975135 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-24753206-1797-4ed9-b295-cfe97961df2d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:53.976196 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-24753206-1797-4ed9-b295-cfe97961df2d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 9d2757b5-8933-4d44-bfa5-cb5054cd05c6] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:53.984392 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-24753206-1797-4ed9-b295-cfe97961df2d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:53.985302 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-24753206-1797-4ed9-b295-cfe97961df2d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:53.986002 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-24753206-1797-4ed9-b295-cfe97961df2d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:53.987008 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-24753206-1797-4ed9-b295-cfe97961df2d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:53.987687 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-24753206-1797-4ed9-b295-cfe97961df2d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:53.988369 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-24753206-1797-4ed9-b295-cfe97961df2d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:54.152295 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c5fdc6f0-b11d-440a-9ff2-00f6417bddd6 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] 10.222.0.33 "GET /compute/v2.1/servers?ip=172.20.0.10" status: 200 len: 345 microversion: 2.1 time: 0.668717 Sep 23 04:38:54.152999 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1051/2055] 10.222.0.33 () {58 vars in 1154 bytes} [Fri Sep 23 04:38:53 2022] GET /compute/v2.1/servers?ip=172.20.0.10 => generated 345 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:38:54.159042 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3c8ef270-1307-41b3-86e7-d8a02d5483ea tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:54.160753 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-3c8ef270-1307-41b3-86e7-d8a02d5483ea tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: aa35cea0-4f7f-4d03-9436-f15264b9f713] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:54.167784 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3c8ef270-1307-41b3-86e7-d8a02d5483ea tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:54.169277 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3c8ef270-1307-41b3-86e7-d8a02d5483ea tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:54.170005 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3c8ef270-1307-41b3-86e7-d8a02d5483ea tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:54.170915 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3c8ef270-1307-41b3-86e7-d8a02d5483ea tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:54.171997 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3c8ef270-1307-41b3-86e7-d8a02d5483ea tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:54.172807 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3c8ef270-1307-41b3-86e7-d8a02d5483ea tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:54.179452 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-24753206-1797-4ed9-b295-cfe97961df2d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:54.190070 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-24753206-1797-4ed9-b295-cfe97961df2d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/9d2757b5-8933-4d44-bfa5-cb5054cd05c6" status: 200 len: 1552 microversion: 2.1 time: 0.225701 Sep 23 04:38:54.205916 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1005/2056] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:53 2022] GET /compute/v2.1/servers/9d2757b5-8933-4d44-bfa5-cb5054cd05c6 => generated 1552 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:54.212041 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9451a3c3-722d-43d5-a130-fbcbb27e8ca9 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:54.216781 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-9451a3c3-722d-43d5-a130-fbcbb27e8ca9 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] [instance: 7e90c852-5f27-4861-9b25-9ea1e475c0a9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:54.224335 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9451a3c3-722d-43d5-a130-fbcbb27e8ca9 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:54.224977 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9451a3c3-722d-43d5-a130-fbcbb27e8ca9 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:54.225530 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9451a3c3-722d-43d5-a130-fbcbb27e8ca9 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:54.226385 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9451a3c3-722d-43d5-a130-fbcbb27e8ca9 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:54.226951 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9451a3c3-722d-43d5-a130-fbcbb27e8ca9 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:54.228086 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9451a3c3-722d-43d5-a130-fbcbb27e8ca9 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:54.243227 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-3c8ef270-1307-41b3-86e7-d8a02d5483ea tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:54.251436 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3c8ef270-1307-41b3-86e7-d8a02d5483ea tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713" status: 200 len: 1159 microversion: 2.1 time: 0.097146 Sep 23 04:38:54.252395 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1052/2057] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:54 2022] GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713 => generated 1159 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:54.446932 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8d9c2802-47c2-4ff5-88f2-ef155f99a740 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:54.451713 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-8d9c2802-47c2-4ff5-88f2-ef155f99a740 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] [instance: 53745879-9973-4217-b1c5-b45f917db80e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:54.461503 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8d9c2802-47c2-4ff5-88f2-ef155f99a740 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:54.462475 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8d9c2802-47c2-4ff5-88f2-ef155f99a740 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:54.462933 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8d9c2802-47c2-4ff5-88f2-ef155f99a740 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:54.463682 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8d9c2802-47c2-4ff5-88f2-ef155f99a740 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:54.464316 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8d9c2802-47c2-4ff5-88f2-ef155f99a740 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:54.464574 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8d9c2802-47c2-4ff5-88f2-ef155f99a740 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:54.497510 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-9451a3c3-722d-43d5-a130-fbcbb27e8ca9 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1244f3db540441a28d8413e510cfccad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b412c874d4e668b4a1a33dedb2c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:54.508228 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9451a3c3-722d-43d5-a130-fbcbb27e8ca9 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] 10.222.0.33 "GET /compute/v2.1/servers/7e90c852-5f27-4861-9b25-9ea1e475c0a9" status: 200 len: 1512 microversion: 2.1 time: 0.305413 Sep 23 04:38:54.511542 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1006/2058] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:54 2022] GET /compute/v2.1/servers/7e90c852-5f27-4861-9b25-9ea1e475c0a9 => generated 1512 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:54.535770 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0d80c12c-1954-496e-a640-ff4249a51e4f tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:54.536656 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-0d80c12c-1954-496e-a640-ff4249a51e4f tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] [instance: 94e8c141-ef33-4bb2-929f-7f7d0d10ff2c] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:54.547343 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0d80c12c-1954-496e-a640-ff4249a51e4f tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:54.550296 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0d80c12c-1954-496e-a640-ff4249a51e4f tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:54.550924 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0d80c12c-1954-496e-a640-ff4249a51e4f tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:54.551846 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0d80c12c-1954-496e-a640-ff4249a51e4f tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:54.552480 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0d80c12c-1954-496e-a640-ff4249a51e4f tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:54.553080 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0d80c12c-1954-496e-a640-ff4249a51e4f tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:54.945093 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-8d9c2802-47c2-4ff5-88f2-ef155f99a740 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:54.954636 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-8d9c2802-47c2-4ff5-88f2-ef155f99a740 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:54.959961 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-8d9c2802-47c2-4ff5-88f2-ef155f99a740 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:54.964954 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-8d9c2802-47c2-4ff5-88f2-ef155f99a740 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] 10.222.0.33 "GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e" status: 200 len: 1873 microversion: 2.42 time: 0.524333 Sep 23 04:38:54.968031 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1053/2059] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:38:54 2022] GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e => generated 1873 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:38:54.976928 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7ae23c14-8257-418e-916a-f754c6bb7fb1 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:54.977549 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-7ae23c14-8257-418e-916a-f754c6bb7fb1 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 1058d2c6-a5c4-41f2-8b63-40079d80419c] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:54.997232 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7ae23c14-8257-418e-916a-f754c6bb7fb1 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:54.997748 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7ae23c14-8257-418e-916a-f754c6bb7fb1 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:54.998617 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7ae23c14-8257-418e-916a-f754c6bb7fb1 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:55.001204 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7ae23c14-8257-418e-916a-f754c6bb7fb1 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:55.001682 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7ae23c14-8257-418e-916a-f754c6bb7fb1 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:55.002165 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7ae23c14-8257-418e-916a-f754c6bb7fb1 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:55.040908 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7ae23c14-8257-418e-916a-f754c6bb7fb1 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:55.041399 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7ae23c14-8257-418e-916a-f754c6bb7fb1 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:55.041837 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7ae23c14-8257-418e-916a-f754c6bb7fb1 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:55.042322 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-7ae23c14-8257-418e-916a-f754c6bb7fb1 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lazy-loading 'fault' on Instance uuid 1058d2c6-a5c4-41f2-8b63-40079d80419c {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:38:55.048338 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-0d80c12c-1954-496e-a640-ff4249a51e4f tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1244f3db540441a28d8413e510cfccad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b412c874d4e668b4a1a33dedb2c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:55.056535 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0d80c12c-1954-496e-a640-ff4249a51e4f tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] 10.222.0.33 "GET /compute/v2.1/servers/94e8c141-ef33-4bb2-929f-7f7d0d10ff2c" status: 200 len: 1512 microversion: 2.1 time: 0.524798 Sep 23 04:38:55.071001 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1007/2060] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:54 2022] GET /compute/v2.1/servers/94e8c141-ef33-4bb2-929f-7f7d0d10ff2c => generated 1512 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:55.082821 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-bb6a7ad0-dc42-4c21-b16d-092c5c21f817 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:55.083852 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-bb6a7ad0-dc42-4c21-b16d-092c5c21f817 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] [instance: 3871f20c-2d2b-4918-9381-73e73651a586] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:55.090581 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bb6a7ad0-dc42-4c21-b16d-092c5c21f817 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:55.091436 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bb6a7ad0-dc42-4c21-b16d-092c5c21f817 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:55.106527 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bb6a7ad0-dc42-4c21-b16d-092c5c21f817 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:55.106527 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bb6a7ad0-dc42-4c21-b16d-092c5c21f817 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:55.106527 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bb6a7ad0-dc42-4c21-b16d-092c5c21f817 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:55.106527 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bb6a7ad0-dc42-4c21-b16d-092c5c21f817 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:55.144611 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-7ae23c14-8257-418e-916a-f754c6bb7fb1 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:55.167968 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-7ae23c14-8257-418e-916a-f754c6bb7fb1 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/1058d2c6-a5c4-41f2-8b63-40079d80419c" status: 200 len: 1309 microversion: 2.1 time: 0.198330 Sep 23 04:38:55.169138 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1054/2061] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:54 2022] GET /compute/v2.1/servers/1058d2c6-a5c4-41f2-8b63-40079d80419c => generated 1309 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:55.189960 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a8af74a0-84a8-4837-8e97-87d585de1a89 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:55.190583 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a8af74a0-84a8-4837-8e97-87d585de1a89 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] [instance: 94fc4134-9b8e-4dcd-bd96-5545bfd51c97] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:55.213515 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a8af74a0-84a8-4837-8e97-87d585de1a89 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:55.213780 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a8af74a0-84a8-4837-8e97-87d585de1a89 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:55.214257 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a8af74a0-84a8-4837-8e97-87d585de1a89 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:55.214982 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a8af74a0-84a8-4837-8e97-87d585de1a89 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:55.215438 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a8af74a0-84a8-4837-8e97-87d585de1a89 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:55.215866 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a8af74a0-84a8-4837-8e97-87d585de1a89 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:55.366899 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a8af74a0-84a8-4837-8e97-87d585de1a89 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:55.376414 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a8af74a0-84a8-4837-8e97-87d585de1a89 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:55.395356 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a8af74a0-84a8-4837-8e97-87d585de1a89 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:55.413596 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a8af74a0-84a8-4837-8e97-87d585de1a89 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] 10.222.0.33 "GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97" status: 200 len: 1453 microversion: 2.75 time: 0.243054 Sep 23 04:38:55.416768 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1055/2062] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:38:55 2022] GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97 => generated 1453 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:38:55.435555 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-051e3b2c-94e3-4af8-b85c-74a21efd0e97 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:55.436138 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-051e3b2c-94e3-4af8-b85c-74a21efd0e97 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] [instance: e203a3bb-aff0-41d9-b8ba-750797cab055] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:55.445813 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-051e3b2c-94e3-4af8-b85c-74a21efd0e97 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:55.446626 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-051e3b2c-94e3-4af8-b85c-74a21efd0e97 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:55.447424 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-051e3b2c-94e3-4af8-b85c-74a21efd0e97 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:55.448438 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-051e3b2c-94e3-4af8-b85c-74a21efd0e97 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:55.449256 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-051e3b2c-94e3-4af8-b85c-74a21efd0e97 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:55.449876 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-051e3b2c-94e3-4af8-b85c-74a21efd0e97 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:55.454108 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-bb6a7ad0-dc42-4c21-b16d-092c5c21f817 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6477e60b54491baff0a7dbee062ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc56537160d349aab8f5e6499ca8ab99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:55.467199 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-bb6a7ad0-dc42-4c21-b16d-092c5c21f817 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] 10.222.0.33 "GET /compute/v2.1/servers/3871f20c-2d2b-4918-9381-73e73651a586" status: 200 len: 1319 microversion: 2.1 time: 0.395192 Sep 23 04:38:55.470669 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1008/2063] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:55 2022] GET /compute/v2.1/servers/3871f20c-2d2b-4918-9381-73e73651a586 => generated 1319 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:55.491738 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-ceb68e93-2083-438b-afb7-f0b2c7314de6 req-e7b9627a-4b08-4fe8-b4f6-c39386ad8c4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53745879-9973-4217-b1c5-b45f917db80e", "name": "network-vif-plugged", "status": "completed", "tag": "94e28598-1406-4598-9b02-0050f6bb7fcd"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:38:55.517403 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-ceb68e93-2083-438b-afb7-f0b2c7314de6 req-e7b9627a-4b08-4fe8-b4f6-c39386ad8c4c service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:55.517932 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-ceb68e93-2083-438b-afb7-f0b2c7314de6 req-e7b9627a-4b08-4fe8-b4f6-c39386ad8c4c service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:55.518374 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-ceb68e93-2083-438b-afb7-f0b2c7314de6 req-e7b9627a-4b08-4fe8-b4f6-c39386ad8c4c service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:55.551920 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-ceb68e93-2083-438b-afb7-f0b2c7314de6 req-e7b9627a-4b08-4fe8-b4f6-c39386ad8c4c service nova] Creating event network-vif-plugged:94e28598-1406-4598-9b02-0050f6bb7fcd for instance 53745879-9973-4217-b1c5-b45f917db80e on n-h2-846463-3 Sep 23 04:38:55.566619 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-ceb68e93-2083-438b-afb7-f0b2c7314de6 req-e7b9627a-4b08-4fe8-b4f6-c39386ad8c4c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083166 Sep 23 04:38:55.567237 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1009/2064] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:38:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:38:55.580917 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ba7cd87d-537f-428a-93b6-ee53b4d2d65b tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:55.581644 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-ba7cd87d-537f-428a-93b6-ee53b4d2d65b tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 9d2757b5-8933-4d44-bfa5-cb5054cd05c6] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:55.594150 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ba7cd87d-537f-428a-93b6-ee53b4d2d65b tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:55.594792 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ba7cd87d-537f-428a-93b6-ee53b4d2d65b tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:55.599908 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ba7cd87d-537f-428a-93b6-ee53b4d2d65b tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:55.600737 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ba7cd87d-537f-428a-93b6-ee53b4d2d65b tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:55.601513 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ba7cd87d-537f-428a-93b6-ee53b4d2d65b tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:55.602027 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ba7cd87d-537f-428a-93b6-ee53b4d2d65b tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:55.869247 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-051e3b2c-94e3-4af8-b85c-74a21efd0e97 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1244f3db540441a28d8413e510cfccad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b412c874d4e668b4a1a33dedb2c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:55.878903 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-051e3b2c-94e3-4af8-b85c-74a21efd0e97 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] 10.222.0.33 "GET /compute/v2.1/servers/e203a3bb-aff0-41d9-b8ba-750797cab055" status: 200 len: 1510 microversion: 2.1 time: 0.461028 Sep 23 04:38:55.884396 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1056/2065] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:55 2022] GET /compute/v2.1/servers/e203a3bb-aff0-41d9-b8ba-750797cab055 => generated 1510 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:55.885148 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8e34afa5-8f6d-49dd-8c98-fbe9c66b73c6 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:55.885822 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-8e34afa5-8f6d-49dd-8c98-fbe9c66b73c6 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: aa35cea0-4f7f-4d03-9436-f15264b9f713] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:55.892940 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8e34afa5-8f6d-49dd-8c98-fbe9c66b73c6 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:55.893644 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8e34afa5-8f6d-49dd-8c98-fbe9c66b73c6 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:55.894392 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8e34afa5-8f6d-49dd-8c98-fbe9c66b73c6 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:55.895283 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8e34afa5-8f6d-49dd-8c98-fbe9c66b73c6 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:55.895920 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8e34afa5-8f6d-49dd-8c98-fbe9c66b73c6 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:55.896553 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8e34afa5-8f6d-49dd-8c98-fbe9c66b73c6 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:55.918503 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ba7cd87d-537f-428a-93b6-ee53b4d2d65b tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:55.930632 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ba7cd87d-537f-428a-93b6-ee53b4d2d65b tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/9d2757b5-8933-4d44-bfa5-cb5054cd05c6" status: 200 len: 1552 microversion: 2.1 time: 0.362152 Sep 23 04:38:55.931890 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1010/2066] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:55 2022] GET /compute/v2.1/servers/9d2757b5-8933-4d44-bfa5-cb5054cd05c6 => generated 1552 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:55.936764 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e186818f-3f9f-426f-9523-73e4d1385714 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:55.941956 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e186818f-3f9f-426f-9523-73e4d1385714 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1244f3db540441a28d8413e510cfccad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b412c874d4e668b4a1a33dedb2c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:55.943158 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e186818f-3f9f-426f-9523-73e4d1385714 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Searching by: {'deleted': False, 'project_id': '721b412c874d4e668b4a1a33dedb2c9b'} {{(pid=122698) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 04:38:55.949473 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e186818f-3f9f-426f-9523-73e4d1385714 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:55.950135 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e186818f-3f9f-426f-9523-73e4d1385714 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:55.950903 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e186818f-3f9f-426f-9523-73e4d1385714 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:55.954697 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e186818f-3f9f-426f-9523-73e4d1385714 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:55.956157 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e186818f-3f9f-426f-9523-73e4d1385714 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:55.956157 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e186818f-3f9f-426f-9523-73e4d1385714 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:55.999685 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.multi_cell_list [None req-e186818f-3f9f-426f-9523-73e4d1385714 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122698) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 23 04:38:56.113777 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e186818f-3f9f-426f-9523-73e4d1385714 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1244f3db540441a28d8413e510cfccad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b412c874d4e668b4a1a33dedb2c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:56.122543 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e186818f-3f9f-426f-9523-73e4d1385714 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:56.123953 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e186818f-3f9f-426f-9523-73e4d1385714 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:56.124679 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e186818f-3f9f-426f-9523-73e4d1385714 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:56.357597 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-8e34afa5-8f6d-49dd-8c98-fbe9c66b73c6 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:56.369014 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-8e34afa5-8f6d-49dd-8c98-fbe9c66b73c6 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713" status: 200 len: 1211 microversion: 2.1 time: 0.487816 Sep 23 04:38:56.369975 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1057/2067] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:55 2022] GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713 => generated 1211 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:56.386802 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-dc770165-2053-499f-b798-2d0cdd614296 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:56.387756 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-dc770165-2053-499f-b798-2d0cdd614296 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] [instance: 53745879-9973-4217-b1c5-b45f917db80e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:56.397226 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dc770165-2053-499f-b798-2d0cdd614296 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:56.402007 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dc770165-2053-499f-b798-2d0cdd614296 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:56.402564 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dc770165-2053-499f-b798-2d0cdd614296 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:56.403490 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dc770165-2053-499f-b798-2d0cdd614296 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:56.403984 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dc770165-2053-499f-b798-2d0cdd614296 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:56.406518 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dc770165-2053-499f-b798-2d0cdd614296 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:56.490729 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e186818f-3f9f-426f-9523-73e4d1385714 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] 10.222.0.33 "GET /compute/v2.1/servers/detail" status: 200 len: 4517 microversion: 2.1 time: 0.557445 Sep 23 04:38:56.501996 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1011/2068] 10.222.0.33 () {58 vars in 1146 bytes} [Fri Sep 23 04:38:55 2022] GET /compute/v2.1/servers/detail => generated 4517 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:56.501996 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2c5144aa-3d2e-4c3e-b5b5-9362bd7da4d6 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:56.501996 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-2c5144aa-3d2e-4c3e-b5b5-9362bd7da4d6 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 1058d2c6-a5c4-41f2-8b63-40079d80419c] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:56.522110 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2c5144aa-3d2e-4c3e-b5b5-9362bd7da4d6 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:56.522940 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2c5144aa-3d2e-4c3e-b5b5-9362bd7da4d6 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:56.523515 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2c5144aa-3d2e-4c3e-b5b5-9362bd7da4d6 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:56.524335 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2c5144aa-3d2e-4c3e-b5b5-9362bd7da4d6 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:56.525123 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2c5144aa-3d2e-4c3e-b5b5-9362bd7da4d6 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:56.525684 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2c5144aa-3d2e-4c3e-b5b5-9362bd7da4d6 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:56.564017 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2c5144aa-3d2e-4c3e-b5b5-9362bd7da4d6 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:56.564801 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2c5144aa-3d2e-4c3e-b5b5-9362bd7da4d6 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:56.565424 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2c5144aa-3d2e-4c3e-b5b5-9362bd7da4d6 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:56.566114 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-2c5144aa-3d2e-4c3e-b5b5-9362bd7da4d6 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lazy-loading 'fault' on Instance uuid 1058d2c6-a5c4-41f2-8b63-40079d80419c {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:38:56.682941 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-2c5144aa-3d2e-4c3e-b5b5-9362bd7da4d6 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:56.691535 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2c5144aa-3d2e-4c3e-b5b5-9362bd7da4d6 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/1058d2c6-a5c4-41f2-8b63-40079d80419c" status: 200 len: 1309 microversion: 2.1 time: 0.198784 Sep 23 04:38:56.698547 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1012/2069] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:56 2022] GET /compute/v2.1/servers/1058d2c6-a5c4-41f2-8b63-40079d80419c => generated 1309 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:56.704163 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0e598c6f-0155-4ec3-b5ce-cf223d52153d tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:56.704783 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-0e598c6f-0155-4ec3-b5ce-cf223d52153d tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] [instance: 94fc4134-9b8e-4dcd-bd96-5545bfd51c97] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:56.717827 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0e598c6f-0155-4ec3-b5ce-cf223d52153d tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:56.718673 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0e598c6f-0155-4ec3-b5ce-cf223d52153d tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:56.719306 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0e598c6f-0155-4ec3-b5ce-cf223d52153d tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:56.720341 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0e598c6f-0155-4ec3-b5ce-cf223d52153d tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:56.720966 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0e598c6f-0155-4ec3-b5ce-cf223d52153d tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:56.721559 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0e598c6f-0155-4ec3-b5ce-cf223d52153d tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:56.814959 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-dc770165-2053-499f-b798-2d0cdd614296 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:56.835616 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-0e598c6f-0155-4ec3-b5ce-cf223d52153d tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:56.842667 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-dc770165-2053-499f-b798-2d0cdd614296 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:56.844325 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=100 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:38:56.852210 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-dc770165-2053-499f-b798-2d0cdd614296 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:56.858330 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-dc770165-2053-499f-b798-2d0cdd614296 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] 10.222.0.33 "GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e" status: 200 len: 1873 microversion: 2.42 time: 0.480597 Sep 23 04:38:56.865941 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1058/2070] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:38:56 2022] GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e => generated 1873 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:38:56.870178 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-989bec4a-6914-40e6-8d37-88ffad67fd9e tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:56.870802 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-989bec4a-6914-40e6-8d37-88ffad67fd9e tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] [instance: 3871f20c-2d2b-4918-9381-73e73651a586] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:56.875303 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-0e598c6f-0155-4ec3-b5ce-cf223d52153d tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:56.884770 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-0e598c6f-0155-4ec3-b5ce-cf223d52153d tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:56.885814 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-989bec4a-6914-40e6-8d37-88ffad67fd9e tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:56.886939 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-989bec4a-6914-40e6-8d37-88ffad67fd9e tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:56.887471 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-989bec4a-6914-40e6-8d37-88ffad67fd9e tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:56.888270 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-989bec4a-6914-40e6-8d37-88ffad67fd9e tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:56.889139 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-989bec4a-6914-40e6-8d37-88ffad67fd9e tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:56.889691 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-989bec4a-6914-40e6-8d37-88ffad67fd9e tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:56.897351 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0e598c6f-0155-4ec3-b5ce-cf223d52153d tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] 10.222.0.33 "GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97" status: 200 len: 1438 microversion: 2.75 time: 0.197510 Sep 23 04:38:56.897970 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1013/2071] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:38:56 2022] GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97 => generated 1438 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:38:56.914130 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5d7dbeb8-de92-4192-b286-21abfe83af07 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:56.914130 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-5d7dbeb8-de92-4192-b286-21abfe83af07 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1244f3db540441a28d8413e510cfccad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b412c874d4e668b4a1a33dedb2c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:56.916615 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5d7dbeb8-de92-4192-b286-21abfe83af07 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '721b412c874d4e668b4a1a33dedb2c9b'} {{(pid=122698) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 04:38:57.102549 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5d7dbeb8-de92-4192-b286-21abfe83af07 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:57.103267 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5d7dbeb8-de92-4192-b286-21abfe83af07 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:57.103910 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5d7dbeb8-de92-4192-b286-21abfe83af07 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:57.107025 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5d7dbeb8-de92-4192-b286-21abfe83af07 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:57.107025 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5d7dbeb8-de92-4192-b286-21abfe83af07 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:57.107025 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5d7dbeb8-de92-4192-b286-21abfe83af07 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:57.213609 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-989bec4a-6914-40e6-8d37-88ffad67fd9e tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6477e60b54491baff0a7dbee062ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc56537160d349aab8f5e6499ca8ab99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:57.225195 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-989bec4a-6914-40e6-8d37-88ffad67fd9e tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] 10.222.0.33 "GET /compute/v2.1/servers/3871f20c-2d2b-4918-9381-73e73651a586" status: 200 len: 1319 microversion: 2.1 time: 0.358670 Sep 23 04:38:57.228472 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1059/2072] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:56 2022] GET /compute/v2.1/servers/3871f20c-2d2b-4918-9381-73e73651a586 => generated 1319 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:57.372024 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.multi_cell_list [None req-5d7dbeb8-de92-4192-b286-21abfe83af07 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122698) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 23 04:38:57.476343 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5d7dbeb8-de92-4192-b286-21abfe83af07 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] 10.222.0.33 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1009 microversion: 2.1 time: 0.577275 Sep 23 04:38:57.477613 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1014/2073] 10.222.0.33 () {58 vars in 1150 bytes} [Fri Sep 23 04:38:56 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1009 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:57.483069 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c6f69c9e-9f4c-4034-a5fb-0ec21aa8aba5 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:57.484567 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c6f69c9e-9f4c-4034-a5fb-0ec21aa8aba5 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 9d2757b5-8933-4d44-bfa5-cb5054cd05c6] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:57.494666 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c6f69c9e-9f4c-4034-a5fb-0ec21aa8aba5 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:57.496089 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c6f69c9e-9f4c-4034-a5fb-0ec21aa8aba5 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:57.496992 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c6f69c9e-9f4c-4034-a5fb-0ec21aa8aba5 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:57.502166 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c6f69c9e-9f4c-4034-a5fb-0ec21aa8aba5 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:57.503566 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c6f69c9e-9f4c-4034-a5fb-0ec21aa8aba5 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:57.504799 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c6f69c9e-9f4c-4034-a5fb-0ec21aa8aba5 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:57.643137 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0f640118-a877-4c28-b1e4-1d4fdd4cb79b tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:38:57.646137 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-0f640118-a877-4c28-b1e4-1d4fdd4cb79b tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] [instance: 94fc4134-9b8e-4dcd-bd96-5545bfd51c97] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:57.664858 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0f640118-a877-4c28-b1e4-1d4fdd4cb79b tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:57.670675 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0f640118-a877-4c28-b1e4-1d4fdd4cb79b tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:57.671361 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0f640118-a877-4c28-b1e4-1d4fdd4cb79b tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:57.672943 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0f640118-a877-4c28-b1e4-1d4fdd4cb79b tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:57.673588 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0f640118-a877-4c28-b1e4-1d4fdd4cb79b tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:57.674259 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0f640118-a877-4c28-b1e4-1d4fdd4cb79b tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:57.682343 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c6f69c9e-9f4c-4034-a5fb-0ec21aa8aba5 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:57.691047 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c6f69c9e-9f4c-4034-a5fb-0ec21aa8aba5 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/9d2757b5-8933-4d44-bfa5-cb5054cd05c6" status: 200 len: 1510 microversion: 2.1 time: 0.211934 Sep 23 04:38:57.696550 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1015/2074] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:57 2022] GET /compute/v2.1/servers/9d2757b5-8933-4d44-bfa5-cb5054cd05c6 => generated 1510 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:57.704211 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-296d2dd0-30a0-48bf-a95a-2372c5f4c744 req-ca98abcb-c52e-4fbd-be47-f50463d3418f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3871f20c-2d2b-4918-9381-73e73651a586", "tag": "7db4e8d1-e181-46a0-8a28-968c1fad7a75"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:38:57.732441 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-296d2dd0-30a0-48bf-a95a-2372c5f4c744 req-ca98abcb-c52e-4fbd-be47-f50463d3418f service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:57.733145 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-296d2dd0-30a0-48bf-a95a-2372c5f4c744 req-ca98abcb-c52e-4fbd-be47-f50463d3418f service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:57.733775 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-296d2dd0-30a0-48bf-a95a-2372c5f4c744 req-ca98abcb-c52e-4fbd-be47-f50463d3418f service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:57.759574 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-296d2dd0-30a0-48bf-a95a-2372c5f4c744 req-ca98abcb-c52e-4fbd-be47-f50463d3418f service nova] Creating event network-changed:7db4e8d1-e181-46a0-8a28-968c1fad7a75 for instance 3871f20c-2d2b-4918-9381-73e73651a586 on n-h1-846463-3 Sep 23 04:38:57.787737 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-296d2dd0-30a0-48bf-a95a-2372c5f4c744 req-ca98abcb-c52e-4fbd-be47-f50463d3418f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087537 Sep 23 04:38:57.788352 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1016/2075] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:38:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:38:57.793478 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4232d122-9737-4048-94e0-305d54086d20 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:57.794221 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4232d122-9737-4048-94e0-305d54086d20 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: aa35cea0-4f7f-4d03-9436-f15264b9f713] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:57.807343 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4232d122-9737-4048-94e0-305d54086d20 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:57.807854 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4232d122-9737-4048-94e0-305d54086d20 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:57.808298 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4232d122-9737-4048-94e0-305d54086d20 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:57.810017 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4232d122-9737-4048-94e0-305d54086d20 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:57.810017 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4232d122-9737-4048-94e0-305d54086d20 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:57.810017 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4232d122-9737-4048-94e0-305d54086d20 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:57.841957 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-0f640118-a877-4c28-b1e4-1d4fdd4cb79b tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Flavor limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:38:57.842402 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-0f640118-a877-4c28-b1e4-1d4fdd4cb79b tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Image limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:38:57.842878 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-0f640118-a877-4c28-b1e4-1d4fdd4cb79b tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Flavor pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:38:57.845831 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-0f640118-a877-4c28-b1e4-1d4fdd4cb79b tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Image pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:38:57.846362 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-0f640118-a877-4c28-b1e4-1d4fdd4cb79b tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:38:58.007293 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:38:58.105488 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4232d122-9737-4048-94e0-305d54086d20 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:58.113921 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4232d122-9737-4048-94e0-305d54086d20 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713" status: 200 len: 1211 microversion: 2.1 time: 0.324341 Sep 23 04:38:58.115138 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1017/2076] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:57 2022] GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713 => generated 1211 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:58.130259 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6f64fc04-0e16-4101-9db5-000cafd72e41 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:58.149432 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-0f640118-a877-4c28-b1e4-1d4fdd4cb79b tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] [instance: 94fc4134-9b8e-4dcd-bd96-5545bfd51c97] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:58.154681 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6f64fc04-0e16-4101-9db5-000cafd72e41 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1244f3db540441a28d8413e510cfccad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b412c874d4e668b4a1a33dedb2c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:58.157560 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-6f64fc04-0e16-4101-9db5-000cafd72e41 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '721b412c874d4e668b4a1a33dedb2c9b'} {{(pid=122698) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 04:38:58.162059 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0f640118-a877-4c28-b1e4-1d4fdd4cb79b tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:58.167385 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0f640118-a877-4c28-b1e4-1d4fdd4cb79b tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:58.173303 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0f640118-a877-4c28-b1e4-1d4fdd4cb79b tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:58.174180 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0f640118-a877-4c28-b1e4-1d4fdd4cb79b tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:58.174666 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0f640118-a877-4c28-b1e4-1d4fdd4cb79b tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:58.176953 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6f64fc04-0e16-4101-9db5-000cafd72e41 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:58.177627 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0f640118-a877-4c28-b1e4-1d4fdd4cb79b tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:58.188572 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6f64fc04-0e16-4101-9db5-000cafd72e41 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:58.192334 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6f64fc04-0e16-4101-9db5-000cafd72e41 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:58.192334 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6f64fc04-0e16-4101-9db5-000cafd72e41 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:58.192334 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6f64fc04-0e16-4101-9db5-000cafd72e41 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:58.192334 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6f64fc04-0e16-4101-9db5-000cafd72e41 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:58.287583 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.multi_cell_list [None req-6f64fc04-0e16-4101-9db5-000cafd72e41 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122698) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 23 04:38:58.335136 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-0f640118-a877-4c28-b1e4-1d4fdd4cb79b tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lazy-loading 'services' on Instance uuid 94fc4134-9b8e-4dcd-bd96-5545bfd51c97 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:38:58.357008 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0f640118-a877-4c28-b1e4-1d4fdd4cb79b tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97/action" status: 202 len: 1942 microversion: 2.75 time: 1.127190 Sep 23 04:38:58.358196 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1060/2077] 10.222.0.33 () {62 vars in 1319 bytes} [Fri Sep 23 04:38:57 2022] POST /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97/action => generated 1942 bytes in 1129 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Sep 23 04:38:58.361810 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-6f64fc04-0e16-4101-9db5-000cafd72e41 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] 10.222.0.33 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1009 microversion: 2.1 time: 0.245346 Sep 23 04:38:58.371626 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1018/2078] 10.222.0.33 () {58 vars in 1212 bytes} [Fri Sep 23 04:38:58 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1009 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:58.377177 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8133aaeb-6baa-4b34-8b27-b1cd258b9ed0 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:58.378028 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8133aaeb-6baa-4b34-8b27-b1cd258b9ed0 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 1058d2c6-a5c4-41f2-8b63-40079d80419c] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:58.383432 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-1ddc10b0-1e06-4fd6-b9a7-20a9426ad464 req-df925d38-0efd-480f-b495-9e57b71ed21b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa35cea0-4f7f-4d03-9436-f15264b9f713", "tag": "bc9fa346-7e65-43be-854e-637e4641d7f9"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:38:58.385444 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8133aaeb-6baa-4b34-8b27-b1cd258b9ed0 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:58.386170 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8133aaeb-6baa-4b34-8b27-b1cd258b9ed0 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:58.386815 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8133aaeb-6baa-4b34-8b27-b1cd258b9ed0 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:58.387706 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8133aaeb-6baa-4b34-8b27-b1cd258b9ed0 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:58.388967 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8133aaeb-6baa-4b34-8b27-b1cd258b9ed0 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:58.390058 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8133aaeb-6baa-4b34-8b27-b1cd258b9ed0 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:58.401246 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-1ddc10b0-1e06-4fd6-b9a7-20a9426ad464 req-df925d38-0efd-480f-b495-9e57b71ed21b service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:58.403646 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-1ddc10b0-1e06-4fd6-b9a7-20a9426ad464 req-df925d38-0efd-480f-b495-9e57b71ed21b service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:58.407565 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-8133aaeb-6baa-4b34-8b27-b1cd258b9ed0 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] HTTP exception thrown: Instance 1058d2c6-a5c4-41f2-8b63-40079d80419c could not be found. Sep 23 04:38:58.408391 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-1ddc10b0-1e06-4fd6-b9a7-20a9426ad464 req-df925d38-0efd-480f-b495-9e57b71ed21b service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:58.410263 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8133aaeb-6baa-4b34-8b27-b1cd258b9ed0 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Request method failure captured: Sep 23 04:38:58.410263 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/1058d2c6-a5c4-41f2-8b63-40079d80419c HTTP/1.1 Sep 23 04:38:58.410263 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:38:58.410263 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:38:58.410263 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:38:58.410263 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:38:58.410263 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:38:58.410263 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:38:58.410263 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:38:58.410263 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:38:58.410263 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTedAlFPeFmnDF7aT3i0aUDQGJFgGZnI-hp3AgXCkcO3hSwSmXlMqV4YX4M2zE_tzLZBCRNva2-mnxAIXvcDQ4ADhbq0RDumL2tq0UzsAkBd3JY4bJ4oVHe0Nm8SGB15yLY37BALihKvv5H7mxEOffoAs77PenOe-f2xwUXiU1RwOEo Sep 23 04:38:58.410263 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:38:58.410263 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:38:58.410263 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:38:58.410263 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:38:58.410263 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:38:58.410263 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:38:58.410263 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: f5db359a60174c45afa2bf06e23a46c4 Sep 23 04:38:58.410263 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ServersOnMultiNodesTest-604470560 Sep 23 04:38:58.410263 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:38:58.410263 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:38:58.410263 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f5db359a60174c45afa2bf06e23a46c4", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f5db359a60174c45afa2bf06e23a46c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f5db359a60174c45afa2bf06e23a46c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f5db359a60174c45afa2bf06e23a46c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:38:58.410263 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ServersOnMultiNodesTest-604470560 Sep 23 04:38:58.410263 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: f5db359a60174c45afa2bf06e23a46c4 Sep 23 04:38:58.410263 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-604470560 Sep 23 04:38:58.410263 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ServersOnMultiNodesTest-604470560-project Sep 23 04:38:58.410263 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:38:58.410263 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:38:58.410263 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: da08af8193dd490b93278385583f24c0 Sep 23 04:38:58.410263 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ServersOnMultiNodesTest-604470560-project Sep 23 04:38:58.410263 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:38:58.410263 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 1058d2c6-a5c4-41f2-8b63-40079d80419c could not be found. Sep 23 04:38:58.410263 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '1058d2c6-a5c4-41f2-8b63-40079d80419c'} Sep 23 04:38:58.410263 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:38:58.410263 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:38:58.410263 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:38:58.410263 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:38:58.410263 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:38:58.410263 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:38:58.410263 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:38:58.410263 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:38:58.410263 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:38:58.410263 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:38:58.410263 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1058d2c6-a5c4-41f2-8b63-40079d80419c could not be found. Sep 23 04:38:58.410263 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:38:58.410263 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:38:58.410263 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:38:58.410263 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:38:58.410263 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:38:58.410263 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:38:58.410263 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:38:58.410263 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:38:58.410263 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:38:58.410263 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:38:58.410263 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:38:58.410263 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:38:58.410263 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:38:58.410263 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:38:58.410263 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:38:58.410263 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:38:58.410263 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1058d2c6-a5c4-41f2-8b63-40079d80419c could not be found. Sep 23 04:38:58.410263 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:38:58.410263 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:38:58.410263 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:38:58.421472 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:38:58.421472 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:38:58.421472 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:38:58.421472 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:38:58.421472 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:38:58.421472 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1058d2c6-a5c4-41f2-8b63-40079d80419c could not be found. Sep 23 04:38:58.421472 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:38:58.421472 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8133aaeb-6baa-4b34-8b27-b1cd258b9ed0 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Returning 404 to user: Instance 1058d2c6-a5c4-41f2-8b63-40079d80419c could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:38:58.421472 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8133aaeb-6baa-4b34-8b27-b1cd258b9ed0 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/1058d2c6-a5c4-41f2-8b63-40079d80419c" status: 404 len: 111 microversion: 2.1 time: 0.042882 Sep 23 04:38:58.424068 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1019/2079] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:58 2022] GET /compute/v2.1/servers/1058d2c6-a5c4-41f2-8b63-40079d80419c => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:38:58.429171 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-61a68a3f-a30e-405b-8cdf-6fa65301df92 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:58.429700 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-61a68a3f-a30e-405b-8cdf-6fa65301df92 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] [instance: 53745879-9973-4217-b1c5-b45f917db80e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:58.437394 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-61a68a3f-a30e-405b-8cdf-6fa65301df92 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:58.438230 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-61a68a3f-a30e-405b-8cdf-6fa65301df92 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:58.438866 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-61a68a3f-a30e-405b-8cdf-6fa65301df92 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:58.439893 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-61a68a3f-a30e-405b-8cdf-6fa65301df92 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:58.440536 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-61a68a3f-a30e-405b-8cdf-6fa65301df92 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:58.441141 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-61a68a3f-a30e-405b-8cdf-6fa65301df92 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:58.442596 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-1ddc10b0-1e06-4fd6-b9a7-20a9426ad464 req-df925d38-0efd-480f-b495-9e57b71ed21b service nova] Creating event network-changed:bc9fa346-7e65-43be-854e-637e4641d7f9 for instance aa35cea0-4f7f-4d03-9436-f15264b9f713 on n-h1-846463-3 Sep 23 04:38:58.448338 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-1ddc10b0-1e06-4fd6-b9a7-20a9426ad464 req-df925d38-0efd-480f-b495-9e57b71ed21b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087903 Sep 23 04:38:58.453137 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1061/2080] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:38:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:38:58.464749 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-16267861-da76-471d-b49c-39809b3298cb tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:58.474169 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-16267861-da76-471d-b49c-39809b3298cb tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] [instance: 3871f20c-2d2b-4918-9381-73e73651a586] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:58.484360 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-16267861-da76-471d-b49c-39809b3298cb tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:58.486602 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-16267861-da76-471d-b49c-39809b3298cb tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:58.486602 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-16267861-da76-471d-b49c-39809b3298cb tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:58.486602 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-16267861-da76-471d-b49c-39809b3298cb tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:58.487309 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-16267861-da76-471d-b49c-39809b3298cb tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:58.488028 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-16267861-da76-471d-b49c-39809b3298cb tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:58.703411 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-61a68a3f-a30e-405b-8cdf-6fa65301df92 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:58.721784 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-61a68a3f-a30e-405b-8cdf-6fa65301df92 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:58.723496 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-61a68a3f-a30e-405b-8cdf-6fa65301df92 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:58.724767 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-61a68a3f-a30e-405b-8cdf-6fa65301df92 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] 10.222.0.33 "GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e" status: 200 len: 2828 microversion: 2.42 time: 0.299631 Sep 23 04:38:58.725079 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-16267861-da76-471d-b49c-39809b3298cb tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6477e60b54491baff0a7dbee062ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc56537160d349aab8f5e6499ca8ab99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:58.733253 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-16267861-da76-471d-b49c-39809b3298cb tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] 10.222.0.33 "GET /compute/v2.1/servers/3871f20c-2d2b-4918-9381-73e73651a586" status: 200 len: 1319 microversion: 2.1 time: 0.273175 Sep 23 04:38:58.734112 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1062/2081] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:58 2022] GET /compute/v2.1/servers/3871f20c-2d2b-4918-9381-73e73651a586 => generated 1319 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:58.738316 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1020/2082] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:38:58 2022] GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e => generated 2828 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:38:58.739489 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f019b657-2b44-4f33-9522-d6bd4020a611 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:58.744810 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f019b657-2b44-4f33-9522-d6bd4020a611 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1244f3db540441a28d8413e510cfccad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b412c874d4e668b4a1a33dedb2c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:58.745846 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f019b657-2b44-4f33-9522-d6bd4020a611 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '721b412c874d4e668b4a1a33dedb2c9b'} {{(pid=122699) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 04:38:58.750412 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7b1a4708-8c60-4d08-8c99-bcd988ddb773 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:58.751045 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7b1a4708-8c60-4d08-8c99-bcd988ddb773 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] [instance: 94fc4134-9b8e-4dcd-bd96-5545bfd51c97] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:58.752747 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f019b657-2b44-4f33-9522-d6bd4020a611 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:58.753808 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f019b657-2b44-4f33-9522-d6bd4020a611 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:58.754513 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f019b657-2b44-4f33-9522-d6bd4020a611 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:58.755704 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f019b657-2b44-4f33-9522-d6bd4020a611 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:58.756346 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f019b657-2b44-4f33-9522-d6bd4020a611 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:58.756952 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f019b657-2b44-4f33-9522-d6bd4020a611 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:58.759409 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7b1a4708-8c60-4d08-8c99-bcd988ddb773 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:58.759905 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7b1a4708-8c60-4d08-8c99-bcd988ddb773 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:58.760543 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7b1a4708-8c60-4d08-8c99-bcd988ddb773 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:58.761709 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7b1a4708-8c60-4d08-8c99-bcd988ddb773 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:58.762385 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7b1a4708-8c60-4d08-8c99-bcd988ddb773 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:58.762980 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7b1a4708-8c60-4d08-8c99-bcd988ddb773 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:58.858589 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.multi_cell_list [None req-f019b657-2b44-4f33-9522-d6bd4020a611 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122699) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 23 04:38:58.933376 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f019b657-2b44-4f33-9522-d6bd4020a611 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] 10.222.0.33 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1009 microversion: 2.1 time: 0.197729 Sep 23 04:38:58.934372 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1063/2083] 10.222.0.33 () {58 vars in 1196 bytes} [Fri Sep 23 04:38:58 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1009 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:58.939834 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-831a2606-4ccf-4e07-9713-062ffd7b9924 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:58.940641 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-831a2606-4ccf-4e07-9713-062ffd7b9924 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 4997661d-a262-4bfa-994f-3615df7a8180] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:58.946997 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-7b1a4708-8c60-4d08-8c99-bcd988ddb773 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lazy-loading 'services' on Instance uuid 94fc4134-9b8e-4dcd-bd96-5545bfd51c97 {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:38:58.948508 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-831a2606-4ccf-4e07-9713-062ffd7b9924 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:58.949065 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-831a2606-4ccf-4e07-9713-062ffd7b9924 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:58.949526 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-831a2606-4ccf-4e07-9713-062ffd7b9924 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:58.950250 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-831a2606-4ccf-4e07-9713-062ffd7b9924 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:58.950705 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-831a2606-4ccf-4e07-9713-062ffd7b9924 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:58.951129 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-831a2606-4ccf-4e07-9713-062ffd7b9924 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:58.973167 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-831a2606-4ccf-4e07-9713-062ffd7b9924 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] HTTP exception thrown: Instance 4997661d-a262-4bfa-994f-3615df7a8180 could not be found. Sep 23 04:38:58.974927 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-831a2606-4ccf-4e07-9713-062ffd7b9924 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Request method failure captured: Sep 23 04:38:58.974927 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/4997661d-a262-4bfa-994f-3615df7a8180 HTTP/1.1 Sep 23 04:38:58.974927 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:38:58.974927 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:38:58.974927 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:38:58.974927 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:38:58.974927 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:38:58.974927 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:38:58.974927 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:38:58.974927 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:38:58.974927 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTedAlFPeFmnDF7aT3i0aUDQGJFgGZnI-hp3AgXCkcO3hSwSmXlMqV4YX4M2zE_tzLZBCRNva2-mnxAIXvcDQ4ADhbq0RDumL2tq0UzsAkBd3JY4bJ4oVHe0Nm8SGB15yLY37BALihKvv5H7mxEOffoAs77PenOe-f2xwUXiU1RwOEo Sep 23 04:38:58.974927 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:38:58.974927 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:38:58.974927 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:38:58.974927 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:38:58.974927 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:38:58.974927 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:38:58.974927 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: f5db359a60174c45afa2bf06e23a46c4 Sep 23 04:38:58.974927 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ServersOnMultiNodesTest-604470560 Sep 23 04:38:58.974927 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:38:58.974927 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:38:58.974927 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f5db359a60174c45afa2bf06e23a46c4", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f5db359a60174c45afa2bf06e23a46c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f5db359a60174c45afa2bf06e23a46c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f5db359a60174c45afa2bf06e23a46c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:38:58.974927 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ServersOnMultiNodesTest-604470560 Sep 23 04:38:58.974927 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: f5db359a60174c45afa2bf06e23a46c4 Sep 23 04:38:58.974927 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-604470560 Sep 23 04:38:58.974927 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ServersOnMultiNodesTest-604470560-project Sep 23 04:38:58.974927 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:38:58.974927 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:38:58.974927 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: da08af8193dd490b93278385583f24c0 Sep 23 04:38:58.974927 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ServersOnMultiNodesTest-604470560-project Sep 23 04:38:58.974927 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:38:58.974927 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 4997661d-a262-4bfa-994f-3615df7a8180 could not be found. Sep 23 04:38:58.974927 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '4997661d-a262-4bfa-994f-3615df7a8180'} Sep 23 04:38:58.974927 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:38:58.974927 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:38:58.974927 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:38:58.974927 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:38:58.974927 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:38:58.974927 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:38:58.974927 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:38:58.974927 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:38:58.974927 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:38:58.974927 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:38:58.974927 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4997661d-a262-4bfa-994f-3615df7a8180 could not be found. Sep 23 04:38:58.974927 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:38:58.974927 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:38:58.974927 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:38:58.974927 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:38:58.974927 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:38:58.974927 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:38:58.974927 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:38:58.974927 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:38:58.974927 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:38:58.974927 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:38:58.974927 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:38:58.974927 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:38:58.974927 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:38:58.974927 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:38:58.974927 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:38:58.974927 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:38:58.974927 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4997661d-a262-4bfa-994f-3615df7a8180 could not be found. Sep 23 04:38:58.974927 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:38:58.974927 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:38:58.974927 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:38:58.983585 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:38:58.983585 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:38:58.983585 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:38:58.983585 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:38:58.983585 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:38:58.983585 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4997661d-a262-4bfa-994f-3615df7a8180 could not be found. Sep 23 04:38:58.983585 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:38:58.983585 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-831a2606-4ccf-4e07-9713-062ffd7b9924 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Returning 404 to user: Instance 4997661d-a262-4bfa-994f-3615df7a8180 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:38:58.983585 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-831a2606-4ccf-4e07-9713-062ffd7b9924 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/4997661d-a262-4bfa-994f-3615df7a8180" status: 404 len: 111 microversion: 2.1 time: 0.040761 Sep 23 04:38:58.983585 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1064/2084] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:58 2022] GET /compute/v2.1/servers/4997661d-a262-4bfa-994f-3615df7a8180 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:38:58.983585 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-edc9924e-4d8f-453e-a596-1001da3a3926 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:58.983585 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-edc9924e-4d8f-453e-a596-1001da3a3926 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 9d2757b5-8933-4d44-bfa5-cb5054cd05c6] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:58.987806 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7b1a4708-8c60-4d08-8c99-bcd988ddb773 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97" status: 200 len: 1929 microversion: 2.75 time: 0.247521 Sep 23 04:38:58.988405 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1021/2085] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:38:58 2022] GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97 => generated 1929 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:38:58.995284 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-edc9924e-4d8f-453e-a596-1001da3a3926 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:58.995284 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-edc9924e-4d8f-453e-a596-1001da3a3926 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:58.995284 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-edc9924e-4d8f-453e-a596-1001da3a3926 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:58.995284 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-edc9924e-4d8f-453e-a596-1001da3a3926 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:58.995284 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-edc9924e-4d8f-453e-a596-1001da3a3926 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:58.995284 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-edc9924e-4d8f-453e-a596-1001da3a3926 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:58.995875 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e2b63ae8-38b4-4987-b0e3-faeddfec62a5 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:58.995875 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e2b63ae8-38b4-4987-b0e3-faeddfec62a5 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] [instance: 53745879-9973-4217-b1c5-b45f917db80e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:59.018185 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e2b63ae8-38b4-4987-b0e3-faeddfec62a5 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:59.018688 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e2b63ae8-38b4-4987-b0e3-faeddfec62a5 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:59.019175 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e2b63ae8-38b4-4987-b0e3-faeddfec62a5 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:59.020010 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e2b63ae8-38b4-4987-b0e3-faeddfec62a5 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:59.022609 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e2b63ae8-38b4-4987-b0e3-faeddfec62a5 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:59.024806 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e2b63ae8-38b4-4987-b0e3-faeddfec62a5 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:59.088055 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-edc9924e-4d8f-453e-a596-1001da3a3926 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:59.097184 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-edc9924e-4d8f-453e-a596-1001da3a3926 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/9d2757b5-8933-4d44-bfa5-cb5054cd05c6" status: 200 len: 1345 microversion: 2.1 time: 0.119022 Sep 23 04:38:59.097757 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1065/2086] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:58 2022] GET /compute/v2.1/servers/9d2757b5-8933-4d44-bfa5-cb5054cd05c6 => generated 1345 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:59.102631 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a93594c5-ed39-4b1f-bedc-972e349e2a4f tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:59.107735 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a93594c5-ed39-4b1f-bedc-972e349e2a4f tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1244f3db540441a28d8413e510cfccad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b412c874d4e668b4a1a33dedb2c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:59.108400 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a93594c5-ed39-4b1f-bedc-972e349e2a4f tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Searching by: {'name': '1612956669', 'deleted': False, 'project_id': '721b412c874d4e668b4a1a33dedb2c9b'} {{(pid=122699) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 04:38:59.113596 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a93594c5-ed39-4b1f-bedc-972e349e2a4f tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:59.114121 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a93594c5-ed39-4b1f-bedc-972e349e2a4f tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:59.117942 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a93594c5-ed39-4b1f-bedc-972e349e2a4f tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:59.117942 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a93594c5-ed39-4b1f-bedc-972e349e2a4f tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:59.117942 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a93594c5-ed39-4b1f-bedc-972e349e2a4f tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:59.117942 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a93594c5-ed39-4b1f-bedc-972e349e2a4f tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:59.194524 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e2b63ae8-38b4-4987-b0e3-faeddfec62a5 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] 10.222.0.33 "GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e/os-interface" status: 200 len: 1828 microversion: 2.42 time: 0.204774 Sep 23 04:38:59.195132 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1022/2087] 10.222.0.33 () {60 vars in 1316 bytes} [Fri Sep 23 04:38:58 2022] GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e/os-interface => generated 1828 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:38:59.200074 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-23c187c7-7e50-46d7-8cd3-60057b89b69c tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:59.215699 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.multi_cell_list [None req-a93594c5-ed39-4b1f-bedc-972e349e2a4f tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122699) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 23 04:38:59.287636 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a93594c5-ed39-4b1f-bedc-972e349e2a4f tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] 10.222.0.33 "GET /compute/v2.1/servers?name=1612956669" status: 200 len: 346 microversion: 2.1 time: 0.188534 Sep 23 04:38:59.288460 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1066/2088] 10.222.0.33 () {58 vars in 1156 bytes} [Fri Sep 23 04:38:59 2022] GET /compute/v2.1/servers?name=1612956669 => generated 346 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:38:59.293236 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-842b75af-cad3-4165-979f-6ca555241dc8 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:59.295985 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-842b75af-cad3-4165-979f-6ca555241dc8 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: aa35cea0-4f7f-4d03-9436-f15264b9f713] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:59.302957 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-842b75af-cad3-4165-979f-6ca555241dc8 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:59.303458 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-842b75af-cad3-4165-979f-6ca555241dc8 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:59.303897 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-842b75af-cad3-4165-979f-6ca555241dc8 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:59.304664 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-842b75af-cad3-4165-979f-6ca555241dc8 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:59.305127 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-842b75af-cad3-4165-979f-6ca555241dc8 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:59.305555 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-842b75af-cad3-4165-979f-6ca555241dc8 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:59.324841 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-23c187c7-7e50-46d7-8cd3-60057b89b69c tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "DELETE /compute/v2.1/os-server-groups/c508385a-c6e2-44c7-a8ab-02b03657d36e" status: 204 len: 0 microversion: 2.1 time: 0.128642 Sep 23 04:38:59.328953 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1023/2089] 10.222.0.33 () {58 vars in 1266 bytes} [Fri Sep 23 04:38:59 2022] DELETE /compute/v2.1/os-server-groups/c508385a-c6e2-44c7-a8ab-02b03657d36e => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:38:59.335992 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-646416a2-799a-40b4-9afa-f4ae1c7be175 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:59.346425 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-646416a2-799a-40b4-9afa-f4ae1c7be175 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1244f3db540441a28d8413e510cfccad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b412c874d4e668b4a1a33dedb2c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:59.347155 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-646416a2-799a-40b4-9afa-f4ae1c7be175 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '721b412c874d4e668b4a1a33dedb2c9b'} {{(pid=122698) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 04:38:59.358597 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-646416a2-799a-40b4-9afa-f4ae1c7be175 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:59.359746 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-646416a2-799a-40b4-9afa-f4ae1c7be175 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:59.360495 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-646416a2-799a-40b4-9afa-f4ae1c7be175 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:59.361436 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-646416a2-799a-40b4-9afa-f4ae1c7be175 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:59.362670 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-646416a2-799a-40b4-9afa-f4ae1c7be175 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:59.363292 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-646416a2-799a-40b4-9afa-f4ae1c7be175 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:59.494373 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.multi_cell_list [None req-646416a2-799a-40b4-9afa-f4ae1c7be175 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122698) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 23 04:38:59.605250 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-646416a2-799a-40b4-9afa-f4ae1c7be175 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] 10.222.0.33 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1009 microversion: 2.1 time: 0.275053 Sep 23 04:38:59.611526 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1024/2090] 10.222.0.33 () {58 vars in 1154 bytes} [Fri Sep 23 04:38:59 2022] GET /compute/v2.1/servers?name=-instance => generated 1009 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:38:59.626589 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3ed9aaa9-e897-4d4c-aa88-63120efd3781 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:38:59.627325 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3ed9aaa9-e897-4d4c-aa88-63120efd3781 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 19e41421-3550-49fe-90d0-64b07a5efefa] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:38:59.635322 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3ed9aaa9-e897-4d4c-aa88-63120efd3781 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:59.636134 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3ed9aaa9-e897-4d4c-aa88-63120efd3781 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:59.636835 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3ed9aaa9-e897-4d4c-aa88-63120efd3781 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:59.637783 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3ed9aaa9-e897-4d4c-aa88-63120efd3781 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:38:59.638460 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3ed9aaa9-e897-4d4c-aa88-63120efd3781 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:38:59.639265 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3ed9aaa9-e897-4d4c-aa88-63120efd3781 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:38:59.685719 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3ed9aaa9-e897-4d4c-aa88-63120efd3781 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 19e41421-3550-49fe-90d0-64b07a5efefa] Going to try to terminate instance {{(pid=122698) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:38:59.972869 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-842b75af-cad3-4165-979f-6ca555241dc8 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:38:59.982275 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-842b75af-cad3-4165-979f-6ca555241dc8 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713" status: 200 len: 1211 microversion: 2.1 time: 0.692956 Sep 23 04:38:59.987473 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1067/2091] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:38:59 2022] GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713 => generated 1211 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:00.005946 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-23c0687f-d7df-4302-a092-73190eb47680 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:00.015891 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-23c0687f-d7df-4302-a092-73190eb47680 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1244f3db540441a28d8413e510cfccad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b412c874d4e668b4a1a33dedb2c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:00.016923 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-23c0687f-d7df-4302-a092-73190eb47680 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-161295666', 'deleted': False, 'project_id': '721b412c874d4e668b4a1a33dedb2c9b'} {{(pid=122699) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 04:39:00.023588 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-23c0687f-d7df-4302-a092-73190eb47680 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:00.024215 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-23c0687f-d7df-4302-a092-73190eb47680 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:00.025393 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-23c0687f-d7df-4302-a092-73190eb47680 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:00.026230 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-23c0687f-d7df-4302-a092-73190eb47680 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:00.026894 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-23c0687f-d7df-4302-a092-73190eb47680 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:00.027395 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-23c0687f-d7df-4302-a092-73190eb47680 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:00.067530 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3ed9aaa9-e897-4d4c-aa88-63120efd3781 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "DELETE /compute/v2.1/servers/19e41421-3550-49fe-90d0-64b07a5efefa" status: 204 len: 0 microversion: 2.1 time: 0.446958 Sep 23 04:39:00.068497 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1025/2092] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:38:59 2022] DELETE /compute/v2.1/servers/19e41421-3550-49fe-90d0-64b07a5efefa => generated 0 bytes in 449 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:39:00.075409 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9359d36e-8d54-4e6c-b3e1-f306357cd651 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:00.076247 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-9359d36e-8d54-4e6c-b3e1-f306357cd651 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] [instance: 3871f20c-2d2b-4918-9381-73e73651a586] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:00.093447 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9359d36e-8d54-4e6c-b3e1-f306357cd651 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:00.093983 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9359d36e-8d54-4e6c-b3e1-f306357cd651 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:00.096265 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9359d36e-8d54-4e6c-b3e1-f306357cd651 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:00.097877 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9359d36e-8d54-4e6c-b3e1-f306357cd651 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:00.098363 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9359d36e-8d54-4e6c-b3e1-f306357cd651 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:00.102635 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9359d36e-8d54-4e6c-b3e1-f306357cd651 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:00.128228 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.multi_cell_list [None req-23c0687f-d7df-4302-a092-73190eb47680 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122699) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 23 04:39:00.206832 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-23c0687f-d7df-4302-a092-73190eb47680 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] 10.222.0.33 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-161295666" status: 200 len: 346 microversion: 2.1 time: 0.217891 Sep 23 04:39:00.207651 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1068/2093] 10.222.0.33 () {58 vars in 1228 bytes} [Fri Sep 23 04:38:59 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-161295666 => generated 346 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:39:00.219596 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3a41c1a2-631a-4bf7-9cf1-a50de288c1a8 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:00.220596 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-3a41c1a2-631a-4bf7-9cf1-a50de288c1a8 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] [instance: 94fc4134-9b8e-4dcd-bd96-5545bfd51c97] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:00.228445 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3a41c1a2-631a-4bf7-9cf1-a50de288c1a8 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:00.229605 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3a41c1a2-631a-4bf7-9cf1-a50de288c1a8 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:00.230289 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3a41c1a2-631a-4bf7-9cf1-a50de288c1a8 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:00.231305 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3a41c1a2-631a-4bf7-9cf1-a50de288c1a8 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:00.233352 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3a41c1a2-631a-4bf7-9cf1-a50de288c1a8 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:00.234653 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3a41c1a2-631a-4bf7-9cf1-a50de288c1a8 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:00.621542 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-3a41c1a2-631a-4bf7-9cf1-a50de288c1a8 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lazy-loading 'services' on Instance uuid 94fc4134-9b8e-4dcd-bd96-5545bfd51c97 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:39:00.651568 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3a41c1a2-631a-4bf7-9cf1-a50de288c1a8 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97" status: 200 len: 1929 microversion: 2.75 time: 0.440440 Sep 23 04:39:00.652753 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1069/2094] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:39:00 2022] GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97 => generated 1929 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:39:00.658554 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-301d498f-3bff-4a3e-9b9d-9bfb839170e9 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:00.659057 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-301d498f-3bff-4a3e-9b9d-9bfb839170e9 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: b4a75706-ba44-4b2c-8767-071502169d5a] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:00.666340 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-301d498f-3bff-4a3e-9b9d-9bfb839170e9 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:00.666839 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-301d498f-3bff-4a3e-9b9d-9bfb839170e9 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:00.667414 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-301d498f-3bff-4a3e-9b9d-9bfb839170e9 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:00.668136 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-301d498f-3bff-4a3e-9b9d-9bfb839170e9 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:00.668602 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-301d498f-3bff-4a3e-9b9d-9bfb839170e9 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:00.669205 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-301d498f-3bff-4a3e-9b9d-9bfb839170e9 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:00.698413 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-301d498f-3bff-4a3e-9b9d-9bfb839170e9 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: b4a75706-ba44-4b2c-8767-071502169d5a] Going to try to terminate instance {{(pid=122699) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:39:00.721942 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-9359d36e-8d54-4e6c-b3e1-f306357cd651 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6477e60b54491baff0a7dbee062ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc56537160d349aab8f5e6499ca8ab99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:00.731205 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9359d36e-8d54-4e6c-b3e1-f306357cd651 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] 10.222.0.33 "GET /compute/v2.1/servers/3871f20c-2d2b-4918-9381-73e73651a586" status: 200 len: 1319 microversion: 2.1 time: 0.661221 Sep 23 04:39:00.742011 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1026/2095] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:00 2022] GET /compute/v2.1/servers/3871f20c-2d2b-4918-9381-73e73651a586 => generated 1319 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:00.752635 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5f298021-862e-437b-b8c6-b82ae9aee7f9 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:00.753492 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5f298021-862e-437b-b8c6-b82ae9aee7f9 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 9d2757b5-8933-4d44-bfa5-cb5054cd05c6] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:00.761183 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5f298021-862e-437b-b8c6-b82ae9aee7f9 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:00.761786 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5f298021-862e-437b-b8c6-b82ae9aee7f9 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:00.762335 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5f298021-862e-437b-b8c6-b82ae9aee7f9 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:00.763193 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5f298021-862e-437b-b8c6-b82ae9aee7f9 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:00.763731 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5f298021-862e-437b-b8c6-b82ae9aee7f9 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:00.764242 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5f298021-862e-437b-b8c6-b82ae9aee7f9 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:00.848889 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-5f298021-862e-437b-b8c6-b82ae9aee7f9 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:01.114915 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5f298021-862e-437b-b8c6-b82ae9aee7f9 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/9d2757b5-8933-4d44-bfa5-cb5054cd05c6" status: 200 len: 1345 microversion: 2.1 time: 0.123458 Sep 23 04:39:01.114915 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1027/2096] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:00 2022] GET /compute/v2.1/servers/9d2757b5-8933-4d44-bfa5-cb5054cd05c6 => generated 1345 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:01.114915 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7108d826-4d01-4de7-bc09-404dc231a569 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:01.114915 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7108d826-4d01-4de7-bc09-404dc231a569 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] [instance: e203a3bb-aff0-41d9-b8ba-750797cab055] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:01.114915 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7108d826-4d01-4de7-bc09-404dc231a569 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:01.114915 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7108d826-4d01-4de7-bc09-404dc231a569 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:01.114915 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7108d826-4d01-4de7-bc09-404dc231a569 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:01.114915 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7108d826-4d01-4de7-bc09-404dc231a569 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:01.114915 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7108d826-4d01-4de7-bc09-404dc231a569 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:01.114915 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7108d826-4d01-4de7-bc09-404dc231a569 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:01.114915 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7108d826-4d01-4de7-bc09-404dc231a569 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] [instance: e203a3bb-aff0-41d9-b8ba-750797cab055] Going to try to terminate instance {{(pid=122698) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:39:01.114915 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:39:01.116539 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-301d498f-3bff-4a3e-9b9d-9bfb839170e9 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b4a75706-ba44-4b2c-8767-071502169d5a" status: 204 len: 0 microversion: 2.1 time: 0.455564 Sep 23 04:39:01.116539 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1070/2097] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:39:00 2022] DELETE /compute/v2.1/servers/b4a75706-ba44-4b2c-8767-071502169d5a => generated 0 bytes in 457 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:39:01.123781 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-3752e821-f5a9-4a2f-88ad-48c8bd7869f2 req-ef8080c2-1bba-4d68-a993-dc8e1d8dc615 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d2757b5-8933-4d44-bfa5-cb5054cd05c6", "name": "network-vif-deleted", "tag": "c40cf720-53d3-445c-8509-cb2614d8aa78"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:39:01.151779 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-3752e821-f5a9-4a2f-88ad-48c8bd7869f2 req-ef8080c2-1bba-4d68-a993-dc8e1d8dc615 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:01.152370 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-3752e821-f5a9-4a2f-88ad-48c8bd7869f2 req-ef8080c2-1bba-4d68-a993-dc8e1d8dc615 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:01.152883 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-3752e821-f5a9-4a2f-88ad-48c8bd7869f2 req-ef8080c2-1bba-4d68-a993-dc8e1d8dc615 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:01.165930 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-3752e821-f5a9-4a2f-88ad-48c8bd7869f2 req-ef8080c2-1bba-4d68-a993-dc8e1d8dc615 service nova] Creating event network-vif-deleted:c40cf720-53d3-445c-8509-cb2614d8aa78 for instance 9d2757b5-8933-4d44-bfa5-cb5054cd05c6 on n-h2-846463-3 Sep 23 04:39:01.174473 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-3752e821-f5a9-4a2f-88ad-48c8bd7869f2 req-ef8080c2-1bba-4d68-a993-dc8e1d8dc615 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058454 Sep 23 04:39:01.175095 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1071/2098] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:39:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:39:01.186287 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-aaf098f3-dfda-4f6d-9cae-b685f5051514 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:01.187856 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-aaf098f3-dfda-4f6d-9cae-b685f5051514 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: aa35cea0-4f7f-4d03-9436-f15264b9f713] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:01.200152 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aaf098f3-dfda-4f6d-9cae-b685f5051514 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:01.201132 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aaf098f3-dfda-4f6d-9cae-b685f5051514 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:01.201606 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aaf098f3-dfda-4f6d-9cae-b685f5051514 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:01.203131 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aaf098f3-dfda-4f6d-9cae-b685f5051514 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:01.203961 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aaf098f3-dfda-4f6d-9cae-b685f5051514 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:01.204502 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aaf098f3-dfda-4f6d-9cae-b685f5051514 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:01.477910 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7108d826-4d01-4de7-bc09-404dc231a569 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e203a3bb-aff0-41d9-b8ba-750797cab055" status: 204 len: 0 microversion: 2.1 time: 0.617013 Sep 23 04:39:01.478815 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1028/2099] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:39:00 2022] DELETE /compute/v2.1/servers/e203a3bb-aff0-41d9-b8ba-750797cab055 => generated 0 bytes in 620 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:39:01.487157 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-bf59d19b-b805-4255-b476-1c62035a0b27 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:01.488155 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-bf59d19b-b805-4255-b476-1c62035a0b27 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 19e41421-3550-49fe-90d0-64b07a5efefa] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:01.496895 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-aaf098f3-dfda-4f6d-9cae-b685f5051514 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:01.498003 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bf59d19b-b805-4255-b476-1c62035a0b27 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:01.498686 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bf59d19b-b805-4255-b476-1c62035a0b27 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:01.499365 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bf59d19b-b805-4255-b476-1c62035a0b27 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:01.501145 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bf59d19b-b805-4255-b476-1c62035a0b27 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:01.501780 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bf59d19b-b805-4255-b476-1c62035a0b27 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:01.509592 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bf59d19b-b805-4255-b476-1c62035a0b27 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:01.509718 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-aaf098f3-dfda-4f6d-9cae-b685f5051514 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713" status: 200 len: 1211 microversion: 2.1 time: 0.333027 Sep 23 04:39:01.510532 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1072/2100] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:01 2022] GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713 => generated 1211 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:01.516636 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d608f210-8bea-4bd9-aac1-eb6b1a2a85d7 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:01.517430 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d608f210-8bea-4bd9-aac1-eb6b1a2a85d7 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] [instance: e203a3bb-aff0-41d9-b8ba-750797cab055] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:01.524791 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d608f210-8bea-4bd9-aac1-eb6b1a2a85d7 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:01.525439 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d608f210-8bea-4bd9-aac1-eb6b1a2a85d7 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:01.526032 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d608f210-8bea-4bd9-aac1-eb6b1a2a85d7 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:01.526854 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d608f210-8bea-4bd9-aac1-eb6b1a2a85d7 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:01.527420 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d608f210-8bea-4bd9-aac1-eb6b1a2a85d7 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:01.529060 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d608f210-8bea-4bd9-aac1-eb6b1a2a85d7 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:01.825845 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-bf59d19b-b805-4255-b476-1c62035a0b27 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:01.829305 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d608f210-8bea-4bd9-aac1-eb6b1a2a85d7 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1244f3db540441a28d8413e510cfccad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b412c874d4e668b4a1a33dedb2c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:01.838360 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d608f210-8bea-4bd9-aac1-eb6b1a2a85d7 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] 10.222.0.33 "GET /compute/v2.1/servers/e203a3bb-aff0-41d9-b8ba-750797cab055" status: 200 len: 1516 microversion: 2.1 time: 0.325520 Sep 23 04:39:01.844911 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-bf59d19b-b805-4255-b476-1c62035a0b27 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/19e41421-3550-49fe-90d0-64b07a5efefa" status: 200 len: 1475 microversion: 2.1 time: 0.364573 Sep 23 04:39:01.849784 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1029/2101] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:01 2022] GET /compute/v2.1/servers/19e41421-3550-49fe-90d0-64b07a5efefa => generated 1475 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:01.850789 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1073/2102] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:01 2022] GET /compute/v2.1/servers/e203a3bb-aff0-41d9-b8ba-750797cab055 => generated 1516 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:01.858192 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a7742ec9-2eac-4e52-86a0-2dd6f51443f8 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:01.859708 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a7742ec9-2eac-4e52-86a0-2dd6f51443f8 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] [instance: 3871f20c-2d2b-4918-9381-73e73651a586] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:01.864909 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-19fe3d08-6940-4f4a-a4b9-3c0ec12b7653 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:01.865242 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-19fe3d08-6940-4f4a-a4b9-3c0ec12b7653 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] [instance: 94fc4134-9b8e-4dcd-bd96-5545bfd51c97] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:01.865926 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a7742ec9-2eac-4e52-86a0-2dd6f51443f8 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:01.866423 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a7742ec9-2eac-4e52-86a0-2dd6f51443f8 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:01.866871 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a7742ec9-2eac-4e52-86a0-2dd6f51443f8 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:01.867583 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a7742ec9-2eac-4e52-86a0-2dd6f51443f8 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:01.868043 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a7742ec9-2eac-4e52-86a0-2dd6f51443f8 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:01.868615 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a7742ec9-2eac-4e52-86a0-2dd6f51443f8 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:01.885630 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-19fe3d08-6940-4f4a-a4b9-3c0ec12b7653 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:01.891435 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-19fe3d08-6940-4f4a-a4b9-3c0ec12b7653 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:01.898369 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-19fe3d08-6940-4f4a-a4b9-3c0ec12b7653 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:01.898369 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-19fe3d08-6940-4f4a-a4b9-3c0ec12b7653 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:01.898369 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-19fe3d08-6940-4f4a-a4b9-3c0ec12b7653 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:01.898369 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-19fe3d08-6940-4f4a-a4b9-3c0ec12b7653 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:02.023165 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-19fe3d08-6940-4f4a-a4b9-3c0ec12b7653 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lazy-loading 'services' on Instance uuid 94fc4134-9b8e-4dcd-bd96-5545bfd51c97 {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:39:02.055910 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=3,nova_api:UPDATE=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:39:02.059648 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-19fe3d08-6940-4f4a-a4b9-3c0ec12b7653 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97" status: 200 len: 1929 microversion: 2.75 time: 0.208468 Sep 23 04:39:02.075070 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1030/2103] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:39:01 2022] GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97 => generated 1929 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:39:02.088440 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-aacd6f83-36f1-4863-a2a2-37c355bef7b8 req-2381c994-c63e-498d-a960-68b4d6591edb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53745879-9973-4217-b1c5-b45f917db80e", "tag": "04ec7c4f-3b61-4a17-a7c1-0ebd792d85ae"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:39:02.099275 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-aacd6f83-36f1-4863-a2a2-37c355bef7b8 req-2381c994-c63e-498d-a960-68b4d6591edb service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:02.099897 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-aacd6f83-36f1-4863-a2a2-37c355bef7b8 req-2381c994-c63e-498d-a960-68b4d6591edb service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:02.100393 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-aacd6f83-36f1-4863-a2a2-37c355bef7b8 req-2381c994-c63e-498d-a960-68b4d6591edb service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:02.102443 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a7742ec9-2eac-4e52-86a0-2dd6f51443f8 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6477e60b54491baff0a7dbee062ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc56537160d349aab8f5e6499ca8ab99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:02.117631 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-aacd6f83-36f1-4863-a2a2-37c355bef7b8 req-2381c994-c63e-498d-a960-68b4d6591edb service nova] Creating event network-changed:04ec7c4f-3b61-4a17-a7c1-0ebd792d85ae for instance 53745879-9973-4217-b1c5-b45f917db80e on n-h2-846463-3 Sep 23 04:39:02.118101 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a7742ec9-2eac-4e52-86a0-2dd6f51443f8 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] 10.222.0.33 "GET /compute/v2.1/servers/3871f20c-2d2b-4918-9381-73e73651a586" status: 200 len: 1319 microversion: 2.1 time: 0.264915 Sep 23 04:39:02.120828 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1074/2104] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:01 2022] GET /compute/v2.1/servers/3871f20c-2d2b-4918-9381-73e73651a586 => generated 1319 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:02.123591 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-aacd6f83-36f1-4863-a2a2-37c355bef7b8 req-2381c994-c63e-498d-a960-68b4d6591edb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045066 Sep 23 04:39:02.124773 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1031/2105] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:39:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:39:02.133808 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-944cdac1-94bf-4842-8fb1-9da24d21fad2 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:02.134500 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-944cdac1-94bf-4842-8fb1-9da24d21fad2 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 9d2757b5-8933-4d44-bfa5-cb5054cd05c6] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:02.144447 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-944cdac1-94bf-4842-8fb1-9da24d21fad2 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:02.144447 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-944cdac1-94bf-4842-8fb1-9da24d21fad2 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:02.144447 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-944cdac1-94bf-4842-8fb1-9da24d21fad2 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:02.144447 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-944cdac1-94bf-4842-8fb1-9da24d21fad2 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:02.144447 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-944cdac1-94bf-4842-8fb1-9da24d21fad2 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:02.144733 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-944cdac1-94bf-4842-8fb1-9da24d21fad2 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:02.150166 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:39:02.227041 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-944cdac1-94bf-4842-8fb1-9da24d21fad2 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:02.237921 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-944cdac1-94bf-4842-8fb1-9da24d21fad2 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/9d2757b5-8933-4d44-bfa5-cb5054cd05c6" status: 200 len: 1345 microversion: 2.1 time: 0.116018 Sep 23 04:39:02.241922 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1075/2106] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:02 2022] GET /compute/v2.1/servers/9d2757b5-8933-4d44-bfa5-cb5054cd05c6 => generated 1345 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:02.535120 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-905470b4-bba9-495c-96d4-d7ebbdb4d19e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:02.535828 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-905470b4-bba9-495c-96d4-d7ebbdb4d19e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: aa35cea0-4f7f-4d03-9436-f15264b9f713] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:02.545807 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-905470b4-bba9-495c-96d4-d7ebbdb4d19e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:02.546373 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-905470b4-bba9-495c-96d4-d7ebbdb4d19e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:02.546811 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-905470b4-bba9-495c-96d4-d7ebbdb4d19e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:02.562155 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-905470b4-bba9-495c-96d4-d7ebbdb4d19e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:02.563967 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-905470b4-bba9-495c-96d4-d7ebbdb4d19e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:02.566250 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-905470b4-bba9-495c-96d4-d7ebbdb4d19e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:02.868247 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e3125a62-0d97-4db3-a087-affba8a9e3f3 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:02.869014 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e3125a62-0d97-4db3-a087-affba8a9e3f3 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] [instance: e203a3bb-aff0-41d9-b8ba-750797cab055] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:02.876938 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e3125a62-0d97-4db3-a087-affba8a9e3f3 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:02.886580 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e3125a62-0d97-4db3-a087-affba8a9e3f3 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:02.887191 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e3125a62-0d97-4db3-a087-affba8a9e3f3 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:02.892589 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e3125a62-0d97-4db3-a087-affba8a9e3f3 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:02.895848 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e3125a62-0d97-4db3-a087-affba8a9e3f3 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:02.896554 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e3125a62-0d97-4db3-a087-affba8a9e3f3 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:02.950400 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-905470b4-bba9-495c-96d4-d7ebbdb4d19e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:02.987661 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-905470b4-bba9-495c-96d4-d7ebbdb4d19e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713" status: 200 len: 1211 microversion: 2.1 time: 0.453866 Sep 23 04:39:02.995314 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1032/2107] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:02 2022] GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713 => generated 1211 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:03.009146 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-17ac81a2-3865-49f4-b0e7-7cac4c38171a tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:03.011580 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-17ac81a2-3865-49f4-b0e7-7cac4c38171a tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 19e41421-3550-49fe-90d0-64b07a5efefa] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:03.039156 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-17ac81a2-3865-49f4-b0e7-7cac4c38171a tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:03.039917 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-17ac81a2-3865-49f4-b0e7-7cac4c38171a tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:03.040116 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-17ac81a2-3865-49f4-b0e7-7cac4c38171a tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:03.040835 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-17ac81a2-3865-49f4-b0e7-7cac4c38171a tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:03.046948 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-17ac81a2-3865-49f4-b0e7-7cac4c38171a tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:03.047416 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-17ac81a2-3865-49f4-b0e7-7cac4c38171a tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:03.430105 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e3125a62-0d97-4db3-a087-affba8a9e3f3 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1244f3db540441a28d8413e510cfccad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b412c874d4e668b4a1a33dedb2c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:03.443774 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e3125a62-0d97-4db3-a087-affba8a9e3f3 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] 10.222.0.33 "GET /compute/v2.1/servers/e203a3bb-aff0-41d9-b8ba-750797cab055" status: 200 len: 1516 microversion: 2.1 time: 0.577619 Sep 23 04:39:03.458584 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1076/2108] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:02 2022] GET /compute/v2.1/servers/e203a3bb-aff0-41d9-b8ba-750797cab055 => generated 1516 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:03.464408 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c98dc7e5-8f55-4fae-ab0e-f0e3c495c7ff tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:03.465043 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c98dc7e5-8f55-4fae-ab0e-f0e3c495c7ff tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] [instance: 94fc4134-9b8e-4dcd-bd96-5545bfd51c97] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:03.472300 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c98dc7e5-8f55-4fae-ab0e-f0e3c495c7ff tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:03.472814 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c98dc7e5-8f55-4fae-ab0e-f0e3c495c7ff tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:03.473263 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c98dc7e5-8f55-4fae-ab0e-f0e3c495c7ff tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:03.474019 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c98dc7e5-8f55-4fae-ab0e-f0e3c495c7ff tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:03.474490 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c98dc7e5-8f55-4fae-ab0e-f0e3c495c7ff tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:03.475601 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c98dc7e5-8f55-4fae-ab0e-f0e3c495c7ff tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:03.591324 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-17ac81a2-3865-49f4-b0e7-7cac4c38171a tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:03.601452 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-17ac81a2-3865-49f4-b0e7-7cac4c38171a tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/19e41421-3550-49fe-90d0-64b07a5efefa" status: 200 len: 1475 microversion: 2.1 time: 0.604921 Sep 23 04:39:03.605551 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1033/2109] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:02 2022] GET /compute/v2.1/servers/19e41421-3550-49fe-90d0-64b07a5efefa => generated 1475 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:03.618790 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-da5894f0-20df-4f38-9e27-c7010001b783 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:03.619743 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-da5894f0-20df-4f38-9e27-c7010001b783 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] [instance: 3871f20c-2d2b-4918-9381-73e73651a586] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:03.630864 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-da5894f0-20df-4f38-9e27-c7010001b783 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:03.633296 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-da5894f0-20df-4f38-9e27-c7010001b783 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:03.634523 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-da5894f0-20df-4f38-9e27-c7010001b783 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:03.638691 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-da5894f0-20df-4f38-9e27-c7010001b783 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:03.648618 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-da5894f0-20df-4f38-9e27-c7010001b783 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:03.649367 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-da5894f0-20df-4f38-9e27-c7010001b783 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:03.713592 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-c98dc7e5-8f55-4fae-ab0e-f0e3c495c7ff tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lazy-loading 'services' on Instance uuid 94fc4134-9b8e-4dcd-bd96-5545bfd51c97 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:39:03.735622 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c98dc7e5-8f55-4fae-ab0e-f0e3c495c7ff tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97" status: 200 len: 1929 microversion: 2.75 time: 0.276087 Sep 23 04:39:03.745999 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1077/2110] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:39:03 2022] GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97 => generated 1929 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:39:03.745999 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c5db0aca-7933-44c3-87d1-ec1163ffa923 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:03.745999 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c5db0aca-7933-44c3-87d1-ec1163ffa923 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 9d2757b5-8933-4d44-bfa5-cb5054cd05c6] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:03.753099 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c5db0aca-7933-44c3-87d1-ec1163ffa923 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:03.753099 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c5db0aca-7933-44c3-87d1-ec1163ffa923 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:03.753099 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c5db0aca-7933-44c3-87d1-ec1163ffa923 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:03.753099 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c5db0aca-7933-44c3-87d1-ec1163ffa923 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:03.753099 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c5db0aca-7933-44c3-87d1-ec1163ffa923 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:03.753099 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c5db0aca-7933-44c3-87d1-ec1163ffa923 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:03.863043 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c5db0aca-7933-44c3-87d1-ec1163ffa923 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:03.872396 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c5db0aca-7933-44c3-87d1-ec1163ffa923 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/9d2757b5-8933-4d44-bfa5-cb5054cd05c6" status: 200 len: 1345 microversion: 2.1 time: 0.135136 Sep 23 04:39:03.888669 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1078/2111] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:03 2022] GET /compute/v2.1/servers/9d2757b5-8933-4d44-bfa5-cb5054cd05c6 => generated 1345 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:03.993037 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-da5894f0-20df-4f38-9e27-c7010001b783 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6477e60b54491baff0a7dbee062ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc56537160d349aab8f5e6499ca8ab99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:04.002116 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-da5894f0-20df-4f38-9e27-c7010001b783 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] 10.222.0.33 "GET /compute/v2.1/servers/3871f20c-2d2b-4918-9381-73e73651a586" status: 200 len: 1319 microversion: 2.1 time: 0.393425 Sep 23 04:39:04.021003 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1034/2112] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:03 2022] GET /compute/v2.1/servers/3871f20c-2d2b-4918-9381-73e73651a586 => generated 1319 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:04.032720 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b9e5ce9a-dd8c-4ee3-a2a2-63da733fd0a8 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:04.034143 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b9e5ce9a-dd8c-4ee3-a2a2-63da733fd0a8 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: aa35cea0-4f7f-4d03-9436-f15264b9f713] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:04.049801 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b9e5ce9a-dd8c-4ee3-a2a2-63da733fd0a8 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:04.051096 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b9e5ce9a-dd8c-4ee3-a2a2-63da733fd0a8 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:04.051096 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b9e5ce9a-dd8c-4ee3-a2a2-63da733fd0a8 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:04.051467 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b9e5ce9a-dd8c-4ee3-a2a2-63da733fd0a8 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:04.051934 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b9e5ce9a-dd8c-4ee3-a2a2-63da733fd0a8 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:04.052363 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b9e5ce9a-dd8c-4ee3-a2a2-63da733fd0a8 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:04.281743 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b9e5ce9a-dd8c-4ee3-a2a2-63da733fd0a8 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:04.296241 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b9e5ce9a-dd8c-4ee3-a2a2-63da733fd0a8 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713" status: 200 len: 1211 microversion: 2.1 time: 0.271337 Sep 23 04:39:04.297121 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1079/2113] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:04 2022] GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713 => generated 1211 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:04.461323 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-7996e7d7-d6d6-4540-a808-fc854453666c req-c0cff6fc-6c7e-4e41-95f4-66cf36b339af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3871f20c-2d2b-4918-9381-73e73651a586", "name": "network-vif-plugged", "status": "completed", "tag": "7db4e8d1-e181-46a0-8a28-968c1fad7a75"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:39:04.471820 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2a0a89e6-71bc-4a52-8f70-a7a7d2ca4b4c tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:04.472655 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-2a0a89e6-71bc-4a52-8f70-a7a7d2ca4b4c tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] [instance: e203a3bb-aff0-41d9-b8ba-750797cab055] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:04.492692 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2a0a89e6-71bc-4a52-8f70-a7a7d2ca4b4c tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:04.493204 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2a0a89e6-71bc-4a52-8f70-a7a7d2ca4b4c tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:04.493654 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2a0a89e6-71bc-4a52-8f70-a7a7d2ca4b4c tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:04.494416 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2a0a89e6-71bc-4a52-8f70-a7a7d2ca4b4c tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:04.494882 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2a0a89e6-71bc-4a52-8f70-a7a7d2ca4b4c tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:04.495315 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2a0a89e6-71bc-4a52-8f70-a7a7d2ca4b4c tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:04.501582 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-7996e7d7-d6d6-4540-a808-fc854453666c req-c0cff6fc-6c7e-4e41-95f4-66cf36b339af service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:04.502278 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-7996e7d7-d6d6-4540-a808-fc854453666c req-c0cff6fc-6c7e-4e41-95f4-66cf36b339af service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:04.503046 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-7996e7d7-d6d6-4540-a808-fc854453666c req-c0cff6fc-6c7e-4e41-95f4-66cf36b339af service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:04.531495 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-7996e7d7-d6d6-4540-a808-fc854453666c req-c0cff6fc-6c7e-4e41-95f4-66cf36b339af service nova] Creating event network-vif-plugged:7db4e8d1-e181-46a0-8a28-968c1fad7a75 for instance 3871f20c-2d2b-4918-9381-73e73651a586 on n-h1-846463-3 Sep 23 04:39:04.543549 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-7996e7d7-d6d6-4540-a808-fc854453666c req-c0cff6fc-6c7e-4e41-95f4-66cf36b339af service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085194 Sep 23 04:39:04.546810 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1035/2114] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:39:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:39:04.565874 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-2e13f3bc-ec4f-4b6e-b3fe-726d487ecc62 req-191493bc-6853-4a63-8258-570b49e90bd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4a75706-ba44-4b2c-8767-071502169d5a", "name": "network-vif-deleted", "tag": "c801336e-f7d9-417d-b4b8-478b0d2b1236"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:39:04.590959 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-2e13f3bc-ec4f-4b6e-b3fe-726d487ecc62 req-191493bc-6853-4a63-8258-570b49e90bd0 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:04.599643 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-2e13f3bc-ec4f-4b6e-b3fe-726d487ecc62 req-191493bc-6853-4a63-8258-570b49e90bd0 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:04.600667 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-2e13f3bc-ec4f-4b6e-b3fe-726d487ecc62 req-191493bc-6853-4a63-8258-570b49e90bd0 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:04.619982 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-2e13f3bc-ec4f-4b6e-b3fe-726d487ecc62 req-191493bc-6853-4a63-8258-570b49e90bd0 service nova] Creating event network-vif-deleted:c801336e-f7d9-417d-b4b8-478b0d2b1236 for instance b4a75706-ba44-4b2c-8767-071502169d5a on n-h1-846463-3 Sep 23 04:39:04.630760 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2a0a89e6-71bc-4a52-8f70-a7a7d2ca4b4c tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1244f3db540441a28d8413e510cfccad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b412c874d4e668b4a1a33dedb2c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:04.641541 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2a0a89e6-71bc-4a52-8f70-a7a7d2ca4b4c tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] 10.222.0.33 "GET /compute/v2.1/servers/e203a3bb-aff0-41d9-b8ba-750797cab055" status: 200 len: 1474 microversion: 2.1 time: 0.173805 Sep 23 04:39:04.651589 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1080/2115] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:04 2022] GET /compute/v2.1/servers/e203a3bb-aff0-41d9-b8ba-750797cab055 => generated 1474 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:04.662743 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-eef491a7-46ad-4c31-950d-e06edc9dd901 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:04.665723 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-eef491a7-46ad-4c31-950d-e06edc9dd901 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 19e41421-3550-49fe-90d0-64b07a5efefa] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:04.674331 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:39:04.678032 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eef491a7-46ad-4c31-950d-e06edc9dd901 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:04.678685 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eef491a7-46ad-4c31-950d-e06edc9dd901 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:04.679264 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eef491a7-46ad-4c31-950d-e06edc9dd901 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:04.680151 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eef491a7-46ad-4c31-950d-e06edc9dd901 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:04.680918 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eef491a7-46ad-4c31-950d-e06edc9dd901 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:04.693585 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eef491a7-46ad-4c31-950d-e06edc9dd901 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:04.694176 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-2e13f3bc-ec4f-4b6e-b3fe-726d487ecc62 req-191493bc-6853-4a63-8258-570b49e90bd0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138582 Sep 23 04:39:04.694176 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1036/2116] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:39:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:39:04.770968 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1653026a-8b9c-41cc-ab82-46b965e16c80 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:04.772075 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-1653026a-8b9c-41cc-ab82-46b965e16c80 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] [instance: 94fc4134-9b8e-4dcd-bd96-5545bfd51c97] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:04.781195 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1653026a-8b9c-41cc-ab82-46b965e16c80 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:04.782006 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1653026a-8b9c-41cc-ab82-46b965e16c80 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:04.782668 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1653026a-8b9c-41cc-ab82-46b965e16c80 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:04.783976 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1653026a-8b9c-41cc-ab82-46b965e16c80 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:04.784656 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1653026a-8b9c-41cc-ab82-46b965e16c80 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:04.785371 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1653026a-8b9c-41cc-ab82-46b965e16c80 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:04.824202 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-eef491a7-46ad-4c31-950d-e06edc9dd901 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:04.846295 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-eef491a7-46ad-4c31-950d-e06edc9dd901 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/19e41421-3550-49fe-90d0-64b07a5efefa" status: 200 len: 1433 microversion: 2.1 time: 0.193305 Sep 23 04:39:04.854216 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1081/2117] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:04 2022] GET /compute/v2.1/servers/19e41421-3550-49fe-90d0-64b07a5efefa => generated 1433 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:04.899369 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7dc064f6-50e0-4ef0-a89d-61bd3566ebf3 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:04.900003 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-7dc064f6-50e0-4ef0-a89d-61bd3566ebf3 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 9d2757b5-8933-4d44-bfa5-cb5054cd05c6] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:04.906640 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7dc064f6-50e0-4ef0-a89d-61bd3566ebf3 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:04.907138 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7dc064f6-50e0-4ef0-a89d-61bd3566ebf3 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:04.917123 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7dc064f6-50e0-4ef0-a89d-61bd3566ebf3 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:04.922974 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7dc064f6-50e0-4ef0-a89d-61bd3566ebf3 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:04.923830 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7dc064f6-50e0-4ef0-a89d-61bd3566ebf3 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:04.924579 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7dc064f6-50e0-4ef0-a89d-61bd3566ebf3 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:04.952605 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-1653026a-8b9c-41cc-ab82-46b965e16c80 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lazy-loading 'services' on Instance uuid 94fc4134-9b8e-4dcd-bd96-5545bfd51c97 {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:39:04.989563 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7dc064f6-50e0-4ef0-a89d-61bd3566ebf3 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:04.990404 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7dc064f6-50e0-4ef0-a89d-61bd3566ebf3 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:04.991062 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7dc064f6-50e0-4ef0-a89d-61bd3566ebf3 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:04.994170 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-1653026a-8b9c-41cc-ab82-46b965e16c80 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97" status: 200 len: 1929 microversion: 2.75 time: 0.232927 Sep 23 04:39:04.995046 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-7dc064f6-50e0-4ef0-a89d-61bd3566ebf3 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lazy-loading 'fault' on Instance uuid 9d2757b5-8933-4d44-bfa5-cb5054cd05c6 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:39:04.995153 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1037/2118] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:39:04 2022] GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97 => generated 1929 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:39:05.032943 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-47985709-d6ba-4f93-bfba-34e20d62506e tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:05.033569 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-47985709-d6ba-4f93-bfba-34e20d62506e tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] [instance: 3871f20c-2d2b-4918-9381-73e73651a586] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:05.052278 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-47985709-d6ba-4f93-bfba-34e20d62506e tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:05.052781 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-47985709-d6ba-4f93-bfba-34e20d62506e tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:05.053226 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-47985709-d6ba-4f93-bfba-34e20d62506e tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:05.058134 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-47985709-d6ba-4f93-bfba-34e20d62506e tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:05.058334 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-47985709-d6ba-4f93-bfba-34e20d62506e tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:05.069763 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-47985709-d6ba-4f93-bfba-34e20d62506e tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:05.101653 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-7dc064f6-50e0-4ef0-a89d-61bd3566ebf3 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:05.113923 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-7dc064f6-50e0-4ef0-a89d-61bd3566ebf3 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/9d2757b5-8933-4d44-bfa5-cb5054cd05c6" status: 200 len: 1350 microversion: 2.1 time: 0.218435 Sep 23 04:39:05.119141 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1082/2119] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:04 2022] GET /compute/v2.1/servers/9d2757b5-8933-4d44-bfa5-cb5054cd05c6 => generated 1350 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:05.124089 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-66e2c728-4d54-43ee-a00c-ba731351720e req-78fe7e46-8c12-460b-ac8e-337af8a79013 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e203a3bb-aff0-41d9-b8ba-750797cab055", "name": "network-vif-deleted", "tag": "1c12120e-9187-4292-a89f-42ea15c1cbc3"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:39:05.147282 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-66e2c728-4d54-43ee-a00c-ba731351720e req-78fe7e46-8c12-460b-ac8e-337af8a79013 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:05.149585 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-66e2c728-4d54-43ee-a00c-ba731351720e req-78fe7e46-8c12-460b-ac8e-337af8a79013 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:05.150923 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-66e2c728-4d54-43ee-a00c-ba731351720e req-78fe7e46-8c12-460b-ac8e-337af8a79013 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:05.193340 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-66e2c728-4d54-43ee-a00c-ba731351720e req-78fe7e46-8c12-460b-ac8e-337af8a79013 service nova] Creating event network-vif-deleted:1c12120e-9187-4292-a89f-42ea15c1cbc3 for instance e203a3bb-aff0-41d9-b8ba-750797cab055 on n-h2-846463-3 Sep 23 04:39:05.219454 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-66e2c728-4d54-43ee-a00c-ba731351720e req-78fe7e46-8c12-460b-ac8e-337af8a79013 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098158 Sep 23 04:39:05.223783 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1083/2120] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:39:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:39:05.320961 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2a044550-594d-4501-a6a4-6c8cd294cf99 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:05.321668 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-2a044550-594d-4501-a6a4-6c8cd294cf99 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: aa35cea0-4f7f-4d03-9436-f15264b9f713] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:05.333484 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2a044550-594d-4501-a6a4-6c8cd294cf99 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:05.334086 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2a044550-594d-4501-a6a4-6c8cd294cf99 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:05.335315 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2a044550-594d-4501-a6a4-6c8cd294cf99 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:05.336175 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2a044550-594d-4501-a6a4-6c8cd294cf99 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:05.336836 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2a044550-594d-4501-a6a4-6c8cd294cf99 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:05.337500 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2a044550-594d-4501-a6a4-6c8cd294cf99 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:05.365640 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-47985709-d6ba-4f93-bfba-34e20d62506e tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6477e60b54491baff0a7dbee062ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc56537160d349aab8f5e6499ca8ab99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:05.375852 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-47985709-d6ba-4f93-bfba-34e20d62506e tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] 10.222.0.33 "GET /compute/v2.1/servers/3871f20c-2d2b-4918-9381-73e73651a586" status: 200 len: 1319 microversion: 2.1 time: 0.346713 Sep 23 04:39:05.377054 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1038/2121] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:05 2022] GET /compute/v2.1/servers/3871f20c-2d2b-4918-9381-73e73651a586 => generated 1319 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:05.521006 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2a044550-594d-4501-a6a4-6c8cd294cf99 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:05.531422 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2a044550-594d-4501-a6a4-6c8cd294cf99 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713" status: 200 len: 1211 microversion: 2.1 time: 0.214024 Sep 23 04:39:05.532460 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1084/2122] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:05 2022] GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713 => generated 1211 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:39:05.669030 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6096cee0-6ceb-44f5-955e-acf971a79724 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:05.670051 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-6096cee0-6ceb-44f5-955e-acf971a79724 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] [instance: e203a3bb-aff0-41d9-b8ba-750797cab055] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:05.679229 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6096cee0-6ceb-44f5-955e-acf971a79724 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:05.681011 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6096cee0-6ceb-44f5-955e-acf971a79724 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:05.681804 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6096cee0-6ceb-44f5-955e-acf971a79724 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:05.683268 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6096cee0-6ceb-44f5-955e-acf971a79724 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:05.684394 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6096cee0-6ceb-44f5-955e-acf971a79724 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:05.685049 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6096cee0-6ceb-44f5-955e-acf971a79724 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:05.752511 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6096cee0-6ceb-44f5-955e-acf971a79724 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:05.753117 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6096cee0-6ceb-44f5-955e-acf971a79724 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:05.753790 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6096cee0-6ceb-44f5-955e-acf971a79724 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:05.754461 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-6096cee0-6ceb-44f5-955e-acf971a79724 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lazy-loading 'fault' on Instance uuid e203a3bb-aff0-41d9-b8ba-750797cab055 {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:39:05.827115 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6096cee0-6ceb-44f5-955e-acf971a79724 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1244f3db540441a28d8413e510cfccad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b412c874d4e668b4a1a33dedb2c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:05.837986 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-6096cee0-6ceb-44f5-955e-acf971a79724 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] 10.222.0.33 "GET /compute/v2.1/servers/e203a3bb-aff0-41d9-b8ba-750797cab055" status: 200 len: 1309 microversion: 2.1 time: 0.174242 Sep 23 04:39:05.853685 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1039/2123] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:05 2022] GET /compute/v2.1/servers/e203a3bb-aff0-41d9-b8ba-750797cab055 => generated 1309 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:05.871978 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-842486e3-c2cd-4d39-a497-b2ad48e4e841 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:05.872326 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-842486e3-c2cd-4d39-a497-b2ad48e4e841 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 19e41421-3550-49fe-90d0-64b07a5efefa] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:05.879103 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-842486e3-c2cd-4d39-a497-b2ad48e4e841 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:05.881504 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-842486e3-c2cd-4d39-a497-b2ad48e4e841 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:05.891341 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-842486e3-c2cd-4d39-a497-b2ad48e4e841 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:05.892411 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-842486e3-c2cd-4d39-a497-b2ad48e4e841 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:05.893151 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-842486e3-c2cd-4d39-a497-b2ad48e4e841 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:05.893773 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-842486e3-c2cd-4d39-a497-b2ad48e4e841 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:05.938239 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-842486e3-c2cd-4d39-a497-b2ad48e4e841 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:05.939034 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-842486e3-c2cd-4d39-a497-b2ad48e4e841 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:05.939570 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-842486e3-c2cd-4d39-a497-b2ad48e4e841 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:05.940163 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-842486e3-c2cd-4d39-a497-b2ad48e4e841 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lazy-loading 'fault' on Instance uuid 19e41421-3550-49fe-90d0-64b07a5efefa {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:39:05.989746 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-842486e3-c2cd-4d39-a497-b2ad48e4e841 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:05.998022 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-842486e3-c2cd-4d39-a497-b2ad48e4e841 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/19e41421-3550-49fe-90d0-64b07a5efefa" status: 200 len: 1309 microversion: 2.1 time: 0.130032 Sep 23 04:39:06.002604 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1085/2124] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:05 2022] GET /compute/v2.1/servers/19e41421-3550-49fe-90d0-64b07a5efefa => generated 1309 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:06.038362 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-701b9bb5-3bb4-46f1-bca0-4c768854e19d tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:06.038362 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-701b9bb5-3bb4-46f1-bca0-4c768854e19d tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] [instance: 94fc4134-9b8e-4dcd-bd96-5545bfd51c97] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:06.038362 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-701b9bb5-3bb4-46f1-bca0-4c768854e19d tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:06.038927 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-701b9bb5-3bb4-46f1-bca0-4c768854e19d tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:06.039391 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-701b9bb5-3bb4-46f1-bca0-4c768854e19d tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:06.040184 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-701b9bb5-3bb4-46f1-bca0-4c768854e19d tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:06.040732 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-701b9bb5-3bb4-46f1-bca0-4c768854e19d tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:06.041222 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-701b9bb5-3bb4-46f1-bca0-4c768854e19d tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:06.112601 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=18 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:39:06.119341 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-701b9bb5-3bb4-46f1-bca0-4c768854e19d tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lazy-loading 'services' on Instance uuid 94fc4134-9b8e-4dcd-bd96-5545bfd51c97 {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:39:06.140000 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-701b9bb5-3bb4-46f1-bca0-4c768854e19d tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97" status: 200 len: 1929 microversion: 2.75 time: 0.114881 Sep 23 04:39:06.143889 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1040/2125] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:39:06 2022] GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97 => generated 1929 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:39:06.151804 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ed7547dd-0a7e-421e-bcc0-7960244f4a4c tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:06.152430 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ed7547dd-0a7e-421e-bcc0-7960244f4a4c tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 9d2757b5-8933-4d44-bfa5-cb5054cd05c6] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:06.181198 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ed7547dd-0a7e-421e-bcc0-7960244f4a4c tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:06.181198 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ed7547dd-0a7e-421e-bcc0-7960244f4a4c tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:06.181198 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ed7547dd-0a7e-421e-bcc0-7960244f4a4c tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:06.181198 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ed7547dd-0a7e-421e-bcc0-7960244f4a4c tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:06.181198 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ed7547dd-0a7e-421e-bcc0-7960244f4a4c tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:06.181198 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ed7547dd-0a7e-421e-bcc0-7960244f4a4c tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:06.200802 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-ed7547dd-0a7e-421e-bcc0-7960244f4a4c tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] HTTP exception thrown: Instance 9d2757b5-8933-4d44-bfa5-cb5054cd05c6 could not be found. Sep 23 04:39:06.202567 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ed7547dd-0a7e-421e-bcc0-7960244f4a4c tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Request method failure captured: Sep 23 04:39:06.202567 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/9d2757b5-8933-4d44-bfa5-cb5054cd05c6 HTTP/1.1 Sep 23 04:39:06.202567 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:39:06.202567 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:39:06.202567 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:39:06.202567 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:39:06.202567 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:39:06.202567 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:39:06.202567 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:39:06.202567 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:39:06.202567 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTgD-AJZNKtluGEJNjQKU0pcHtUCc1AZ8Ycz4MPGIeanw2_GglRmvn8LiMCEayIX86yw_RpyCC_JZrlVGSjhSgenUVZhpJ_MqN5SLmcv6Qnl3N6cXWJgtCK8N_ffRhD1dYgLIdHHgnmyTAptDZsjatOWU1ocTU40JP9XOpkK3deqL7A Sep 23 04:39:06.202567 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:39:06.202567 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:39:06.202567 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:39:06.202567 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:39:06.202567 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:39:06.202567 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:39:06.202567 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: fe698721372f40888dc2918c46e65f2f Sep 23 04:39:06.202567 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-DeleteServersTestJSON-347759205 Sep 23 04:39:06.202567 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:39:06.202567 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:39:06.202567 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fe698721372f40888dc2918c46e65f2f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe698721372f40888dc2918c46e65f2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fe698721372f40888dc2918c46e65f2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe698721372f40888dc2918c46e65f2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:39:06.202567 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-DeleteServersTestJSON-347759205 Sep 23 04:39:06.202567 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: fe698721372f40888dc2918c46e65f2f Sep 23 04:39:06.202567 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-DeleteServersTestJSON-347759205 Sep 23 04:39:06.202567 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-DeleteServersTestJSON-347759205-project Sep 23 04:39:06.202567 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:39:06.202567 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:39:06.202567 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 36526fe612c840fb907e1992d8e62538 Sep 23 04:39:06.202567 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-DeleteServersTestJSON-347759205-project Sep 23 04:39:06.202567 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:39:06.202567 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 9d2757b5-8933-4d44-bfa5-cb5054cd05c6 could not be found. Sep 23 04:39:06.202567 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '9d2757b5-8933-4d44-bfa5-cb5054cd05c6'} Sep 23 04:39:06.202567 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:39:06.202567 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:39:06.202567 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:39:06.202567 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:39:06.202567 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:39:06.202567 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:39:06.202567 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:39:06.202567 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:39:06.202567 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:39:06.202567 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:39:06.202567 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d2757b5-8933-4d44-bfa5-cb5054cd05c6 could not be found. Sep 23 04:39:06.202567 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:39:06.202567 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:39:06.202567 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:39:06.202567 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:39:06.202567 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:39:06.202567 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:39:06.202567 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:39:06.202567 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:39:06.202567 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:39:06.202567 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:39:06.202567 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:39:06.202567 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:39:06.202567 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:39:06.202567 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:39:06.202567 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:39:06.202567 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:39:06.202567 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d2757b5-8933-4d44-bfa5-cb5054cd05c6 could not be found. Sep 23 04:39:06.202567 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:39:06.202567 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:39:06.202567 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:39:06.213398 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:39:06.213398 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:39:06.213398 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:39:06.213398 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:39:06.213398 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:39:06.213398 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d2757b5-8933-4d44-bfa5-cb5054cd05c6 could not be found. Sep 23 04:39:06.213398 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:39:06.213398 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ed7547dd-0a7e-421e-bcc0-7960244f4a4c tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Returning 404 to user: Instance 9d2757b5-8933-4d44-bfa5-cb5054cd05c6 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:39:06.213398 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ed7547dd-0a7e-421e-bcc0-7960244f4a4c tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/9d2757b5-8933-4d44-bfa5-cb5054cd05c6" status: 404 len: 111 microversion: 2.1 time: 0.065541 Sep 23 04:39:06.213398 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1086/2126] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:06 2022] GET /compute/v2.1/servers/9d2757b5-8933-4d44-bfa5-cb5054cd05c6 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:39:06.358998 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f30d4d5e-86ae-4f74-882c-78e6ed51f8aa tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:06.361506 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f30d4d5e-86ae-4f74-882c-78e6ed51f8aa tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 9d2757b5-8933-4d44-bfa5-cb5054cd05c6] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:06.367880 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f30d4d5e-86ae-4f74-882c-78e6ed51f8aa tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:06.368549 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f30d4d5e-86ae-4f74-882c-78e6ed51f8aa tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:06.369169 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f30d4d5e-86ae-4f74-882c-78e6ed51f8aa tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:06.370056 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f30d4d5e-86ae-4f74-882c-78e6ed51f8aa tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:06.370960 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f30d4d5e-86ae-4f74-882c-78e6ed51f8aa tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:06.371405 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f30d4d5e-86ae-4f74-882c-78e6ed51f8aa tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:06.389389 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-f30d4d5e-86ae-4f74-882c-78e6ed51f8aa tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] HTTP exception thrown: Instance 9d2757b5-8933-4d44-bfa5-cb5054cd05c6 could not be found. Sep 23 04:39:06.392973 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f30d4d5e-86ae-4f74-882c-78e6ed51f8aa tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Request method failure captured: Sep 23 04:39:06.392973 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/9d2757b5-8933-4d44-bfa5-cb5054cd05c6/os-volume_attachments HTTP/1.1 Sep 23 04:39:06.392973 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:39:06.392973 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:39:06.392973 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:39:06.392973 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:39:06.392973 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:39:06.392973 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:39:06.392973 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:39:06.392973 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:39:06.392973 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTgD-AJZNKtluGEJNjQKU0pcHtUCc1AZ8Ycz4MPGIeanw2_GglRmvn8LiMCEayIX86yw_RpyCC_JZrlVGSjhSgenUVZhpJ_MqN5SLmcv6Qnl3N6cXWJgtCK8N_ffRhD1dYgLIdHHgnmyTAptDZsjatOWU1ocTU40JP9XOpkK3deqL7A Sep 23 04:39:06.392973 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:39:06.392973 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:39:06.392973 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:39:06.392973 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:39:06.392973 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:39:06.392973 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:39:06.392973 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: fe698721372f40888dc2918c46e65f2f Sep 23 04:39:06.392973 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-DeleteServersTestJSON-347759205 Sep 23 04:39:06.392973 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:39:06.392973 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:39:06.392973 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fe698721372f40888dc2918c46e65f2f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe698721372f40888dc2918c46e65f2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fe698721372f40888dc2918c46e65f2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe698721372f40888dc2918c46e65f2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:39:06.392973 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-DeleteServersTestJSON-347759205 Sep 23 04:39:06.392973 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: fe698721372f40888dc2918c46e65f2f Sep 23 04:39:06.392973 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-DeleteServersTestJSON-347759205 Sep 23 04:39:06.392973 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-DeleteServersTestJSON-347759205-project Sep 23 04:39:06.392973 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:39:06.392973 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:39:06.392973 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 36526fe612c840fb907e1992d8e62538 Sep 23 04:39:06.392973 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-DeleteServersTestJSON-347759205-project Sep 23 04:39:06.392973 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:39:06.392973 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 9d2757b5-8933-4d44-bfa5-cb5054cd05c6 could not be found. Sep 23 04:39:06.392973 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'server_id': '9d2757b5-8933-4d44-bfa5-cb5054cd05c6'} Sep 23 04:39:06.392973 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:39:06.392973 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:39:06.392973 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:39:06.392973 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:39:06.392973 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:39:06.392973 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:39:06.392973 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:39:06.392973 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:39:06.392973 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:39:06.392973 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:39:06.392973 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d2757b5-8933-4d44-bfa5-cb5054cd05c6 could not be found. Sep 23 04:39:06.392973 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:39:06.392973 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:39:06.392973 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:39:06.392973 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:39:06.392973 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:39:06.392973 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:39:06.392973 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:39:06.392973 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:39:06.392973 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:39:06.392973 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:39:06.392973 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 23 04:39:06.392973 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:39:06.392973 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 23 04:39:06.392973 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:39:06.392973 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 23 04:39:06.392973 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 23 04:39:06.392973 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:39:06.392973 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:39:06.396632 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d2757b5-8933-4d44-bfa5-cb5054cd05c6 could not be found. Sep 23 04:39:06.396632 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:39:06.396632 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:39:06.396632 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:39:06.396632 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:39:06.396632 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:39:06.396632 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:39:06.396632 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:39:06.396632 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:39:06.396632 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d2757b5-8933-4d44-bfa5-cb5054cd05c6 could not be found. Sep 23 04:39:06.396632 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:39:06.396632 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f30d4d5e-86ae-4f74-882c-78e6ed51f8aa tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Returning 404 to user: Instance 9d2757b5-8933-4d44-bfa5-cb5054cd05c6 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:39:06.404036 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7093839b-ce37-4edc-b3aa-51007baceda8 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:06.404783 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-7093839b-ce37-4edc-b3aa-51007baceda8 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] [instance: 3871f20c-2d2b-4918-9381-73e73651a586] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:06.412026 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f30d4d5e-86ae-4f74-882c-78e6ed51f8aa tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/9d2757b5-8933-4d44-bfa5-cb5054cd05c6/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.040547 Sep 23 04:39:06.413507 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1041/2127] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Sep 23 04:39:06 2022] GET /compute/v2.1/servers/9d2757b5-8933-4d44-bfa5-cb5054cd05c6/os-volume_attachments => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:39:06.416136 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7093839b-ce37-4edc-b3aa-51007baceda8 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:06.416860 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7093839b-ce37-4edc-b3aa-51007baceda8 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:06.417788 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7093839b-ce37-4edc-b3aa-51007baceda8 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:06.418796 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7093839b-ce37-4edc-b3aa-51007baceda8 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:06.419572 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7093839b-ce37-4edc-b3aa-51007baceda8 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:06.420034 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7093839b-ce37-4edc-b3aa-51007baceda8 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:06.553654 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b67241b1-257f-44ba-96f5-321cf614f398 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:06.555485 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b67241b1-257f-44ba-96f5-321cf614f398 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: aa35cea0-4f7f-4d03-9436-f15264b9f713] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:06.571883 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b67241b1-257f-44ba-96f5-321cf614f398 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:06.576567 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b67241b1-257f-44ba-96f5-321cf614f398 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:06.576567 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b67241b1-257f-44ba-96f5-321cf614f398 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:06.576567 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b67241b1-257f-44ba-96f5-321cf614f398 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:06.576567 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b67241b1-257f-44ba-96f5-321cf614f398 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:06.576567 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b67241b1-257f-44ba-96f5-321cf614f398 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:06.637426 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-7093839b-ce37-4edc-b3aa-51007baceda8 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6477e60b54491baff0a7dbee062ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc56537160d349aab8f5e6499ca8ab99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:06.650333 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-7093839b-ce37-4edc-b3aa-51007baceda8 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] 10.222.0.33 "GET /compute/v2.1/servers/3871f20c-2d2b-4918-9381-73e73651a586" status: 200 len: 1319 microversion: 2.1 time: 0.250839 Sep 23 04:39:06.653345 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1087/2128] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:06 2022] GET /compute/v2.1/servers/3871f20c-2d2b-4918-9381-73e73651a586 => generated 1319 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:06.685639 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4ef41204-5890-4807-a0be-9fba7f2d548e tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1855557333", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "networks": [{"uuid": "a989594a-cd71-405f-a7ac-42f529a758f7"}]}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:39:06.764187 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b67241b1-257f-44ba-96f5-321cf614f398 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:06.778261 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b67241b1-257f-44ba-96f5-321cf614f398 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713" status: 200 len: 1211 microversion: 2.1 time: 0.224570 Sep 23 04:39:06.779344 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1042/2129] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:06 2022] GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713 => generated 1211 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:39:06.791004 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.neutron [None req-4ef41204-5890-4807-a0be-9fba7f2d548e tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] validate_networks() for [('a989594a-cd71-405f-a7ac-42f529a758f7', None, None, None, None, None)] {{(pid=122699) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:39:06.861269 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-57710861-a725-4794-b9a6-3ee0ebda8753 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:06.862061 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-57710861-a725-4794-b9a6-3ee0ebda8753 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] [instance: e203a3bb-aff0-41d9-b8ba-750797cab055] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:06.871332 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-57710861-a725-4794-b9a6-3ee0ebda8753 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:06.872183 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-57710861-a725-4794-b9a6-3ee0ebda8753 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:06.873115 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-57710861-a725-4794-b9a6-3ee0ebda8753 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:06.874003 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-57710861-a725-4794-b9a6-3ee0ebda8753 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:06.874672 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-57710861-a725-4794-b9a6-3ee0ebda8753 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:06.875246 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-57710861-a725-4794-b9a6-3ee0ebda8753 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:06.892105 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-57710861-a725-4794-b9a6-3ee0ebda8753 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] HTTP exception thrown: Instance e203a3bb-aff0-41d9-b8ba-750797cab055 could not be found. Sep 23 04:39:06.893861 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-57710861-a725-4794-b9a6-3ee0ebda8753 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Request method failure captured: Sep 23 04:39:06.893861 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/e203a3bb-aff0-41d9-b8ba-750797cab055 HTTP/1.1 Sep 23 04:39:06.893861 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:39:06.893861 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:39:06.893861 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:39:06.893861 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:39:06.893861 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:39:06.893861 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:39:06.893861 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:39:06.893861 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:39:06.893861 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTgWByaYCNfiozp93GTtCpOkF_ZetaRjW-aEvVvDqWh2DMrlv1lso1NTsSgjh1ZvSdLlP-vsw3YDLCoS9_gyATagJR0jnHvxte6MbAT0tODvhSTaSyG8K-2FwzCK5EL3rUxCawsMEMDi_tXXiIVJo_iG9cqKTH-fC_8VFyEnqeiI-38 Sep 23 04:39:06.893861 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:39:06.893861 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:39:06.893861 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:39:06.893861 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:39:06.893861 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:39:06.893861 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:39:06.893861 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 721b412c874d4e668b4a1a33dedb2c9b Sep 23 04:39:06.893861 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ListServerFiltersTestJSON-25983859 Sep 23 04:39:06.893861 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:39:06.893861 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:39:06.893861 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_721b412c874d4e668b4a1a33dedb2c9b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/721b412c874d4e668b4a1a33dedb2c9b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/721b412c874d4e668b4a1a33dedb2c9b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/721b412c874d4e668b4a1a33dedb2c9b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:39:06.893861 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ListServerFiltersTestJSON-25983859 Sep 23 04:39:06.893861 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 721b412c874d4e668b4a1a33dedb2c9b Sep 23 04:39:06.893861 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-25983859 Sep 23 04:39:06.893861 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ListServerFiltersTestJSON-25983859-project Sep 23 04:39:06.893861 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:39:06.893861 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:39:06.893861 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 1244f3db540441a28d8413e510cfccad Sep 23 04:39:06.893861 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ListServerFiltersTestJSON-25983859-project Sep 23 04:39:06.893861 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:39:06.893861 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance e203a3bb-aff0-41d9-b8ba-750797cab055 could not be found. Sep 23 04:39:06.893861 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': 'e203a3bb-aff0-41d9-b8ba-750797cab055'} Sep 23 04:39:06.893861 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:39:06.893861 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:39:06.893861 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:39:06.893861 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:39:06.893861 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:39:06.893861 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:39:06.893861 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:39:06.893861 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:39:06.893861 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:39:06.893861 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:39:06.893861 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e203a3bb-aff0-41d9-b8ba-750797cab055 could not be found. Sep 23 04:39:06.893861 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:39:06.893861 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:39:06.893861 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:39:06.893861 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:39:06.893861 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:39:06.893861 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:39:06.893861 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:39:06.893861 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:39:06.893861 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:39:06.893861 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:39:06.893861 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:39:06.893861 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:39:06.893861 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:39:06.893861 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:39:06.893861 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:39:06.893861 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:39:06.893861 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e203a3bb-aff0-41d9-b8ba-750797cab055 could not be found. Sep 23 04:39:06.893861 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:39:06.893861 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:39:06.893861 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:39:06.897782 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:39:06.897782 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:39:06.897782 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:39:06.897782 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:39:06.897782 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:39:06.897782 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e203a3bb-aff0-41d9-b8ba-750797cab055 could not be found. Sep 23 04:39:06.897782 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:39:06.897782 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-57710861-a725-4794-b9a6-3ee0ebda8753 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Returning 404 to user: Instance e203a3bb-aff0-41d9-b8ba-750797cab055 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:39:06.897782 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-57710861-a725-4794-b9a6-3ee0ebda8753 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] 10.222.0.33 "GET /compute/v2.1/servers/e203a3bb-aff0-41d9-b8ba-750797cab055" status: 404 len: 111 microversion: 2.1 time: 0.040882 Sep 23 04:39:06.898356 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1043/2130] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:06 2022] GET /compute/v2.1/servers/e203a3bb-aff0-41d9-b8ba-750797cab055 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 04:39:06.908823 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-25acc25c-442d-44a0-8432-6d48ee28ba6f tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:06.908823 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-25acc25c-442d-44a0-8432-6d48ee28ba6f tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] [instance: 94e8c141-ef33-4bb2-929f-7f7d0d10ff2c] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:06.913771 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-25acc25c-442d-44a0-8432-6d48ee28ba6f tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:06.914297 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-25acc25c-442d-44a0-8432-6d48ee28ba6f tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:06.914733 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-25acc25c-442d-44a0-8432-6d48ee28ba6f tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:06.915428 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-25acc25c-442d-44a0-8432-6d48ee28ba6f tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:06.915880 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-25acc25c-442d-44a0-8432-6d48ee28ba6f tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:06.916308 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-25acc25c-442d-44a0-8432-6d48ee28ba6f tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:06.954679 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-25acc25c-442d-44a0-8432-6d48ee28ba6f tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] [instance: 94e8c141-ef33-4bb2-929f-7f7d0d10ff2c] Going to try to terminate instance {{(pid=122698) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:39:07.267906 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-4ef41204-5890-4807-a0be-9fba7f2d548e tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Flavor limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:39:07.268337 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-4ef41204-5890-4807-a0be-9fba7f2d548e tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Image limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:39:07.268816 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-4ef41204-5890-4807-a0be-9fba7f2d548e tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Flavor pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:39:07.269263 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-4ef41204-5890-4807-a0be-9fba7f2d548e tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Image pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:39:07.269665 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-4ef41204-5890-4807-a0be-9fba7f2d548e tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:39:07.278676 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4ef41204-5890-4807-a0be-9fba7f2d548e tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:07.279175 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4ef41204-5890-4807-a0be-9fba7f2d548e tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:07.279645 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4ef41204-5890-4807-a0be-9fba7f2d548e tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:07.280390 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4ef41204-5890-4807-a0be-9fba7f2d548e tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:07.280862 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4ef41204-5890-4807-a0be-9fba7f2d548e tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:07.281296 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4ef41204-5890-4807-a0be-9fba7f2d548e tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:07.298904 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-25acc25c-442d-44a0-8432-6d48ee28ba6f tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] 10.222.0.33 "DELETE /compute/v2.1/servers/94e8c141-ef33-4bb2-929f-7f7d0d10ff2c" status: 204 len: 0 microversion: 2.1 time: 0.388958 Sep 23 04:39:07.298904 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1044/2131] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:39:06 2022] DELETE /compute/v2.1/servers/94e8c141-ef33-4bb2-929f-7f7d0d10ff2c => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:39:07.298904 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1921d423-254e-4e8e-a003-c4859780edf9 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:07.299105 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-4ef41204-5890-4807-a0be-9fba7f2d548e tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Getting quotas for project fe698721372f40888dc2918c46e65f2f. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:39:07.302546 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-1921d423-254e-4e8e-a003-c4859780edf9 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 19e41421-3550-49fe-90d0-64b07a5efefa] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:07.303675 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-4ef41204-5890-4807-a0be-9fba7f2d548e tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Getting quotas for user 36526fe612c840fb907e1992d8e62538 and project fe698721372f40888dc2918c46e65f2f. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:39:07.309370 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1921d423-254e-4e8e-a003-c4859780edf9 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:07.309899 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1921d423-254e-4e8e-a003-c4859780edf9 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:07.310348 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1921d423-254e-4e8e-a003-c4859780edf9 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:07.311059 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1921d423-254e-4e8e-a003-c4859780edf9 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:07.311515 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1921d423-254e-4e8e-a003-c4859780edf9 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:07.312568 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1921d423-254e-4e8e-a003-c4859780edf9 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:07.316582 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4ef41204-5890-4807-a0be-9fba7f2d548e tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Going to run 1 instances... {{(pid=122699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:39:07.318983 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4ef41204-5890-4807-a0be-9fba7f2d548e tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 0add84f7-600c-46b6-a3ff-c64db803e4f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:39:07.328690 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:39:07.350200 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1921d423-254e-4e8e-a003-c4859780edf9 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:07.350695 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1921d423-254e-4e8e-a003-c4859780edf9 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:07.351145 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1921d423-254e-4e8e-a003-c4859780edf9 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:07.351758 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-1921d423-254e-4e8e-a003-c4859780edf9 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lazy-loading 'fault' on Instance uuid 19e41421-3550-49fe-90d0-64b07a5efefa {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:39:07.397048 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-1921d423-254e-4e8e-a003-c4859780edf9 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:07.406784 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-1921d423-254e-4e8e-a003-c4859780edf9 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/19e41421-3550-49fe-90d0-64b07a5efefa" status: 200 len: 1309 microversion: 2.1 time: 0.112914 Sep 23 04:39:07.407337 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1045/2132] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:07 2022] GET /compute/v2.1/servers/19e41421-3550-49fe-90d0-64b07a5efefa => generated 1309 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:07.411843 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-bbb61e99-cbc5-4143-a82e-565270dc7bcc tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:07.413240 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-bbb61e99-cbc5-4143-a82e-565270dc7bcc tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] [instance: 94fc4134-9b8e-4dcd-bd96-5545bfd51c97] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:07.432404 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bbb61e99-cbc5-4143-a82e-565270dc7bcc tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:07.432935 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bbb61e99-cbc5-4143-a82e-565270dc7bcc tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:07.433380 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bbb61e99-cbc5-4143-a82e-565270dc7bcc tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:07.434126 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bbb61e99-cbc5-4143-a82e-565270dc7bcc tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:07.434642 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bbb61e99-cbc5-4143-a82e-565270dc7bcc tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:07.435075 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bbb61e99-cbc5-4143-a82e-565270dc7bcc tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:07.512955 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-bbb61e99-cbc5-4143-a82e-565270dc7bcc tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lazy-loading 'services' on Instance uuid 94fc4134-9b8e-4dcd-bd96-5545bfd51c97 {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:39:07.516236 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4ef41204-5890-4807-a0be-9fba7f2d548e tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.834678 Sep 23 04:39:07.518571 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1088/2133] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:39:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 836 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:39:07.522135 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-2243ff97-5d4c-4516-97b2-49caee197331 req-1c34a159-1dbe-4c7b-86a2-4b4909824aa8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19e41421-3550-49fe-90d0-64b07a5efefa", "name": "network-vif-deleted", "tag": "0a2f7d6d-75cc-4bea-a611-434074b855d9"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:39:07.534107 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-2243ff97-5d4c-4516-97b2-49caee197331 req-1c34a159-1dbe-4c7b-86a2-4b4909824aa8 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:07.534511 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-bbb61e99-cbc5-4143-a82e-565270dc7bcc tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97" status: 200 len: 1929 microversion: 2.75 time: 0.125924 Sep 23 04:39:07.534631 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-2243ff97-5d4c-4516-97b2-49caee197331 req-1c34a159-1dbe-4c7b-86a2-4b4909824aa8 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:07.535018 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-2243ff97-5d4c-4516-97b2-49caee197331 req-1c34a159-1dbe-4c7b-86a2-4b4909824aa8 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:07.535442 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1046/2134] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:39:07 2022] GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97 => generated 1929 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:39:07.541546 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-bb5b84fd-6554-4904-8cad-486885c0108a tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:07.542367 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-bb5b84fd-6554-4904-8cad-486885c0108a tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] [instance: 94e8c141-ef33-4bb2-929f-7f7d0d10ff2c] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:07.547554 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-2243ff97-5d4c-4516-97b2-49caee197331 req-1c34a159-1dbe-4c7b-86a2-4b4909824aa8 service nova] Creating event network-vif-deleted:0a2f7d6d-75cc-4bea-a611-434074b855d9 for instance 19e41421-3550-49fe-90d0-64b07a5efefa on n-h1-846463-3 Sep 23 04:39:07.550188 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bb5b84fd-6554-4904-8cad-486885c0108a tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:07.550764 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bb5b84fd-6554-4904-8cad-486885c0108a tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:07.551899 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bb5b84fd-6554-4904-8cad-486885c0108a tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:07.552631 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bb5b84fd-6554-4904-8cad-486885c0108a tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:07.553002 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-2243ff97-5d4c-4516-97b2-49caee197331 req-1c34a159-1dbe-4c7b-86a2-4b4909824aa8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034467 Sep 23 04:39:07.553239 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bb5b84fd-6554-4904-8cad-486885c0108a tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:07.553731 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bb5b84fd-6554-4904-8cad-486885c0108a tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:07.554211 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1089/2135] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:39:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:39:07.567401 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-aec3e0b1-807e-4ff2-8624-d32724d30677 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:07.569404 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-aec3e0b1-807e-4ff2-8624-d32724d30677 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 0add84f7-600c-46b6-a3ff-c64db803e4f8] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:07.645713 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-aec3e0b1-807e-4ff2-8624-d32724d30677 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:07.656864 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-aec3e0b1-807e-4ff2-8624-d32724d30677 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/0add84f7-600c-46b6-a3ff-c64db803e4f8" status: 200 len: 1215 microversion: 2.1 time: 0.100955 Sep 23 04:39:07.657735 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1090/2136] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:07 2022] GET /compute/v2.1/servers/0add84f7-600c-46b6-a3ff-c64db803e4f8 => generated 1215 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:07.673179 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-69d67648-aa1c-41e2-859c-bdfa535cdc53 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:07.673716 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-69d67648-aa1c-41e2-859c-bdfa535cdc53 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] [instance: 3871f20c-2d2b-4918-9381-73e73651a586] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:07.683790 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-69d67648-aa1c-41e2-859c-bdfa535cdc53 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:07.684286 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-69d67648-aa1c-41e2-859c-bdfa535cdc53 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:07.684744 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-69d67648-aa1c-41e2-859c-bdfa535cdc53 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:07.685404 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-69d67648-aa1c-41e2-859c-bdfa535cdc53 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:07.687346 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-69d67648-aa1c-41e2-859c-bdfa535cdc53 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:07.687872 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-69d67648-aa1c-41e2-859c-bdfa535cdc53 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:07.801297 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-bb5b84fd-6554-4904-8cad-486885c0108a tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1244f3db540441a28d8413e510cfccad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b412c874d4e668b4a1a33dedb2c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:07.810268 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-bb5b84fd-6554-4904-8cad-486885c0108a tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] 10.222.0.33 "GET /compute/v2.1/servers/94e8c141-ef33-4bb2-929f-7f7d0d10ff2c" status: 200 len: 1518 microversion: 2.1 time: 0.272979 Sep 23 04:39:07.811674 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1047/2137] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:07 2022] GET /compute/v2.1/servers/94e8c141-ef33-4bb2-929f-7f7d0d10ff2c => generated 1518 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:07.817397 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5980dd1e-f690-4e6b-a28c-2c49b633f9a4 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:07.817997 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5980dd1e-f690-4e6b-a28c-2c49b633f9a4 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 0add84f7-600c-46b6-a3ff-c64db803e4f8] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:07.835876 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5980dd1e-f690-4e6b-a28c-2c49b633f9a4 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 0add84f7-600c-46b6-a3ff-c64db803e4f8] Going to try to terminate instance {{(pid=122698) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:39:07.880031 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-69d67648-aa1c-41e2-859c-bdfa535cdc53 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6477e60b54491baff0a7dbee062ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc56537160d349aab8f5e6499ca8ab99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:07.888112 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-69d67648-aa1c-41e2-859c-bdfa535cdc53 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] 10.222.0.33 "GET /compute/v2.1/servers/3871f20c-2d2b-4918-9381-73e73651a586" status: 200 len: 1468 microversion: 2.1 time: 0.219499 Sep 23 04:39:07.888694 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1091/2138] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:07 2022] GET /compute/v2.1/servers/3871f20c-2d2b-4918-9381-73e73651a586 => generated 1468 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:39:07.894140 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-bc44cca2-8841-435a-ae85-809b3ee320a1 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:07.895693 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-bc44cca2-8841-435a-ae85-809b3ee320a1 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: aa35cea0-4f7f-4d03-9436-f15264b9f713] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:07.901433 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bc44cca2-8841-435a-ae85-809b3ee320a1 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:07.902186 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bc44cca2-8841-435a-ae85-809b3ee320a1 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:07.902950 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bc44cca2-8841-435a-ae85-809b3ee320a1 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:07.903593 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bc44cca2-8841-435a-ae85-809b3ee320a1 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:07.904066 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bc44cca2-8841-435a-ae85-809b3ee320a1 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:07.904504 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bc44cca2-8841-435a-ae85-809b3ee320a1 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:08.048117 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-bc44cca2-8841-435a-ae85-809b3ee320a1 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:08.060568 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-bc44cca2-8841-435a-ae85-809b3ee320a1 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713" status: 200 len: 1199 microversion: 2.1 time: 0.169518 Sep 23 04:39:08.061848 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1092/2139] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:07 2022] GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713 => generated 1199 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:08.356159 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.scheduler.client.report [None req-5980dd1e-f690-4e6b-a28c-2c49b633f9a4 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Deleted allocations for instance 0add84f7-600c-46b6-a3ff-c64db803e4f8 Sep 23 04:39:08.361876 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.compute.api [None req-5980dd1e-f690-4e6b-a28c-2c49b633f9a4 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 0add84f7-600c-46b6-a3ff-c64db803e4f8] Instance Mapping does not exist while attempting local delete cleanup. Sep 23 04:39:08.362908 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5980dd1e-f690-4e6b-a28c-2c49b633f9a4 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "DELETE /compute/v2.1/servers/0add84f7-600c-46b6-a3ff-c64db803e4f8" status: 204 len: 0 microversion: 2.1 time: 0.549422 Sep 23 04:39:08.363567 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1048/2140] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:39:07 2022] DELETE /compute/v2.1/servers/0add84f7-600c-46b6-a3ff-c64db803e4f8 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:39:08.371281 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-53f4052c-955b-4a04-a540-3332f5ee263e tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:08.371890 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-53f4052c-955b-4a04-a540-3332f5ee263e tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 0add84f7-600c-46b6-a3ff-c64db803e4f8] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:08.377143 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-53f4052c-955b-4a04-a540-3332f5ee263e tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] HTTP exception thrown: Instance 0add84f7-600c-46b6-a3ff-c64db803e4f8 could not be found. Sep 23 04:39:08.378770 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-53f4052c-955b-4a04-a540-3332f5ee263e tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Request method failure captured: Sep 23 04:39:08.378770 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/0add84f7-600c-46b6-a3ff-c64db803e4f8 HTTP/1.1 Sep 23 04:39:08.378770 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:39:08.378770 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:39:08.378770 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:39:08.378770 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:39:08.378770 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:39:08.378770 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:39:08.378770 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:39:08.378770 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:39:08.378770 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTgD-AJZNKtluGEJNjQKU0pcHtUCc1AZ8Ycz4MPGIeanw2_GglRmvn8LiMCEayIX86yw_RpyCC_JZrlVGSjhSgenUVZhpJ_MqN5SLmcv6Qnl3N6cXWJgtCK8N_ffRhD1dYgLIdHHgnmyTAptDZsjatOWU1ocTU40JP9XOpkK3deqL7A Sep 23 04:39:08.378770 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:39:08.378770 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:39:08.378770 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:39:08.378770 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:39:08.378770 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:39:08.378770 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:39:08.378770 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: fe698721372f40888dc2918c46e65f2f Sep 23 04:39:08.378770 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-DeleteServersTestJSON-347759205 Sep 23 04:39:08.378770 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:39:08.378770 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:39:08.378770 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fe698721372f40888dc2918c46e65f2f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe698721372f40888dc2918c46e65f2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fe698721372f40888dc2918c46e65f2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe698721372f40888dc2918c46e65f2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:39:08.378770 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-DeleteServersTestJSON-347759205 Sep 23 04:39:08.378770 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: fe698721372f40888dc2918c46e65f2f Sep 23 04:39:08.378770 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-DeleteServersTestJSON-347759205 Sep 23 04:39:08.378770 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-DeleteServersTestJSON-347759205-project Sep 23 04:39:08.378770 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:39:08.378770 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:39:08.378770 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 36526fe612c840fb907e1992d8e62538 Sep 23 04:39:08.378770 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-DeleteServersTestJSON-347759205-project Sep 23 04:39:08.378770 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:39:08.378770 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 0add84f7-600c-46b6-a3ff-c64db803e4f8 could not be found. Sep 23 04:39:08.378770 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '0add84f7-600c-46b6-a3ff-c64db803e4f8'} Sep 23 04:39:08.378770 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:39:08.378770 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:39:08.378770 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:39:08.378770 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:39:08.378770 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:39:08.378770 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:39:08.378770 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 23 04:39:08.378770 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 23 04:39:08.378770 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0add84f7-600c-46b6-a3ff-c64db803e4f8 could not be found. Sep 23 04:39:08.378770 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:39:08.378770 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:39:08.378770 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:39:08.378770 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:39:08.378770 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:39:08.378770 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:39:08.378770 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:39:08.378770 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:39:08.378770 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:39:08.378770 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:39:08.378770 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:39:08.378770 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:39:08.378770 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:39:08.378770 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:39:08.378770 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:39:08.378770 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:39:08.378770 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0add84f7-600c-46b6-a3ff-c64db803e4f8 could not be found. Sep 23 04:39:08.378770 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:39:08.378770 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:39:08.378770 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:39:08.378770 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:39:08.378770 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:39:08.382851 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:39:08.382851 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:39:08.382851 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:39:08.382851 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0add84f7-600c-46b6-a3ff-c64db803e4f8 could not be found. Sep 23 04:39:08.382851 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:39:08.382851 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-53f4052c-955b-4a04-a540-3332f5ee263e tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Returning 404 to user: Instance 0add84f7-600c-46b6-a3ff-c64db803e4f8 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:39:08.382851 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-53f4052c-955b-4a04-a540-3332f5ee263e tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/0add84f7-600c-46b6-a3ff-c64db803e4f8" status: 404 len: 111 microversion: 2.1 time: 0.012921 Sep 23 04:39:08.382851 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1049/2141] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:08 2022] GET /compute/v2.1/servers/0add84f7-600c-46b6-a3ff-c64db803e4f8 => generated 111 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:39:08.388636 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e4fee345-7d79-412e-aefc-e77a76d0fbd0 tempest-LiveMigrationNegativeTest-398671155 tempest-LiveMigrationNegativeTest-398671155-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-1933008379", "block_migration": true, "disk_over_commit": false}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:39:08.395810 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e4fee345-7d79-412e-aefc-e77a76d0fbd0 tempest-LiveMigrationNegativeTest-398671155 tempest-LiveMigrationNegativeTest-398671155-project-admin] [instance: 3871f20c-2d2b-4918-9381-73e73651a586] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:08.400952 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e4fee345-7d79-412e-aefc-e77a76d0fbd0 tempest-LiveMigrationNegativeTest-398671155 tempest-LiveMigrationNegativeTest-398671155-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:08.401678 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e4fee345-7d79-412e-aefc-e77a76d0fbd0 tempest-LiveMigrationNegativeTest-398671155 tempest-LiveMigrationNegativeTest-398671155-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:08.402389 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e4fee345-7d79-412e-aefc-e77a76d0fbd0 tempest-LiveMigrationNegativeTest-398671155 tempest-LiveMigrationNegativeTest-398671155-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:08.404500 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e4fee345-7d79-412e-aefc-e77a76d0fbd0 tempest-LiveMigrationNegativeTest-398671155 tempest-LiveMigrationNegativeTest-398671155-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:08.405200 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e4fee345-7d79-412e-aefc-e77a76d0fbd0 tempest-LiveMigrationNegativeTest-398671155 tempest-LiveMigrationNegativeTest-398671155-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:08.406320 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e4fee345-7d79-412e-aefc-e77a76d0fbd0 tempest-LiveMigrationNegativeTest-398671155 tempest-LiveMigrationNegativeTest-398671155-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:08.429966 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a1ea1fa5-d39d-4194-a428-0aeb49ff52ca tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:08.431038 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a1ea1fa5-d39d-4194-a428-0aeb49ff52ca tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 19e41421-3550-49fe-90d0-64b07a5efefa] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:08.441316 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a1ea1fa5-d39d-4194-a428-0aeb49ff52ca tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:08.441316 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a1ea1fa5-d39d-4194-a428-0aeb49ff52ca tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:08.441316 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a1ea1fa5-d39d-4194-a428-0aeb49ff52ca tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:08.441856 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a1ea1fa5-d39d-4194-a428-0aeb49ff52ca tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:08.442531 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a1ea1fa5-d39d-4194-a428-0aeb49ff52ca tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:08.443176 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a1ea1fa5-d39d-4194-a428-0aeb49ff52ca tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:08.471614 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-e4fee345-7d79-412e-aefc-e77a76d0fbd0 tempest-LiveMigrationNegativeTest-398671155 tempest-LiveMigrationNegativeTest-398671155-project-admin] Lazy-loading 'flavor' on Instance uuid 3871f20c-2d2b-4918-9381-73e73651a586 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:39:08.483597 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a1ea1fa5-d39d-4194-a428-0aeb49ff52ca tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:08.484164 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a1ea1fa5-d39d-4194-a428-0aeb49ff52ca tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:08.484666 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a1ea1fa5-d39d-4194-a428-0aeb49ff52ca tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:08.485186 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-a1ea1fa5-d39d-4194-a428-0aeb49ff52ca tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lazy-loading 'fault' on Instance uuid 19e41421-3550-49fe-90d0-64b07a5efefa {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:39:08.518686 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e4fee345-7d79-412e-aefc-e77a76d0fbd0 tempest-LiveMigrationNegativeTest-398671155 tempest-LiveMigrationNegativeTest-398671155-project-admin] [instance: 3871f20c-2d2b-4918-9381-73e73651a586] Going to try to live migrate instance to tempest-host-1933008379 {{(pid=122699) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 23 04:39:08.526225 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-e4fee345-7d79-412e-aefc-e77a76d0fbd0 tempest-LiveMigrationNegativeTest-398671155 tempest-LiveMigrationNegativeTest-398671155-project-admin] HTTP exception thrown: Compute host tempest-host-1933008379 could not be found. Sep 23 04:39:08.528811 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a1ea1fa5-d39d-4194-a428-0aeb49ff52ca tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:08.534575 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e4fee345-7d79-412e-aefc-e77a76d0fbd0 tempest-LiveMigrationNegativeTest-398671155 tempest-LiveMigrationNegativeTest-398671155-project-admin] Request method failure captured: Sep 23 04:39:08.534575 n-d-846463-3 devstack@n-api.service[122699]: request: POST /compute/v2.1/servers/3871f20c-2d2b-4918-9381-73e73651a586/action HTTP/1.1 Sep 23 04:39:08.534575 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:39:08.534575 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:39:08.534575 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:39:08.534575 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 107 Sep 23 04:39:08.534575 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:39:08.534575 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:39:08.534575 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:39:08.534575 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:39:08.534575 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLThVl3Wy41sXaIKhqcNsywP0htkorf25lNH0Lyqn2iM5v520y3gwwySLo9PjfKtIywGDnrGdWhqgkqwURZUUrrVmeDQKkketEKVP4m3YFbOKz08VF0BV-izkqA7zPRpBQq1_u_IdZIfMnW05v41xrizQqVW01O3hrwDmLFmJU96UkiU Sep 23 04:39:08.534575 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:39:08.534575 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:39:08.534575 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:39:08.534575 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:39:08.534575 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:39:08.534575 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:39:08.534575 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 0bf1dc89fe914b36a2898db46a723aff Sep 23 04:39:08.534575 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-LiveMigrationNegativeTest-398671155 Sep 23 04:39:08.534575 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,admin,member Sep 23 04:39:08.534575 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,admin,member Sep 23 04:39:08.534575 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0bf1dc89fe914b36a2898db46a723aff", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0bf1dc89fe914b36a2898db46a723aff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0bf1dc89fe914b36a2898db46a723aff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0bf1dc89fe914b36a2898db46a723aff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:39:08.534575 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-LiveMigrationNegativeTest-398671155 Sep 23 04:39:08.534575 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 0bf1dc89fe914b36a2898db46a723aff Sep 23 04:39:08.534575 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-398671155 Sep 23 04:39:08.534575 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-LiveMigrationNegativeTest-398671155-project-admin Sep 23 04:39:08.534575 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:39:08.534575 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:39:08.534575 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: b9b581e5ca5a47c3845187ddabafa707 Sep 23 04:39:08.534575 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-LiveMigrationNegativeTest-398671155-project-admin Sep 23 04:39:08.534575 n-d-846463-3 devstack@n-api.service[122699]: Sep 23 04:39:08.534575 n-d-846463-3 devstack@n-api.service[122699]: {"os-migrateLive": {"host": "tempest-host-1933008379", "block_migration": true, "disk_over_commit": false}} Sep 23 04:39:08.534575 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:39:08.534575 n-d-846463-3 devstack@n-api.service[122699]: exception: Compute host tempest-host-1933008379 could not be found. Sep 23 04:39:08.534575 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '3871f20c-2d2b-4918-9381-73e73651a586', 'body': {'os-migrateLive': {'host': 'tempest-host-1933008379', 'block_migration': True, 'disk_over_commit': False}}} Sep 23 04:39:08.534575 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:39:08.534575 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:39:08.534575 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Sep 23 04:39:08.534575 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Sep 23 04:39:08.534575 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 23 04:39:08.534575 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 23 04:39:08.534575 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 23 04:39:08.534575 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 23 04:39:08.534575 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Sep 23 04:39:08.534575 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 23 04:39:08.534575 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 23 04:39:08.534575 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 23 04:39:08.534575 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 23 04:39:08.534575 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 23 04:39:08.534575 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Sep 23 04:39:08.534575 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 23 04:39:08.534575 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 23 04:39:08.534575 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 23 04:39:08.534575 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 23 04:39:08.534575 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 23 04:39:08.534575 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5488, in live_migrate Sep 23 04:39:08.534575 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Sep 23 04:39:08.534575 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 04:39:08.534575 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 04:39:08.534575 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Sep 23 04:39:08.534575 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Sep 23 04:39:08.537538 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Sep 23 04:39:08.537538 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:39:08.537538 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Sep 23 04:39:08.537538 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Sep 23 04:39:08.537538 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Sep 23 04:39:08.537538 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Sep 23 04:39:08.537538 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Sep 23 04:39:08.537538 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Sep 23 04:39:08.537538 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-1933008379 could not be found. Sep 23 04:39:08.537538 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:39:08.537538 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:39:08.537538 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:39:08.537538 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:39:08.537538 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:39:08.537538 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:39:08.537538 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:39:08.537538 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:39:08.537538 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:39:08.537538 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:39:08.537538 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:39:08.537538 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:39:08.537538 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:39:08.537538 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:39:08.537538 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:39:08.537538 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:39:08.537538 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 23 04:39:08.537538 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Sep 23 04:39:08.537538 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 23 04:39:08.537538 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-1933008379 could not be found. Sep 23 04:39:08.537538 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:39:08.537538 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:39:08.537538 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:39:08.537538 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:39:08.537538 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:39:08.537538 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:39:08.537538 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:39:08.537538 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:39:08.537538 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-1933008379 could not be found. Sep 23 04:39:08.537538 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:39:08.537538 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e4fee345-7d79-412e-aefc-e77a76d0fbd0 tempest-LiveMigrationNegativeTest-398671155 tempest-LiveMigrationNegativeTest-398671155-project-admin] Returning 400 to user: Compute host tempest-host-1933008379 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:39:08.537538 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e4fee345-7d79-412e-aefc-e77a76d0fbd0 tempest-LiveMigrationNegativeTest-398671155 tempest-LiveMigrationNegativeTest-398671155-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/3871f20c-2d2b-4918-9381-73e73651a586/action" status: 400 len: 100 microversion: 2.1 time: 0.473116 Sep 23 04:39:08.544183 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a1ea1fa5-d39d-4194-a428-0aeb49ff52ca tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/19e41421-3550-49fe-90d0-64b07a5efefa" status: 200 len: 1309 microversion: 2.1 time: 0.111538 Sep 23 04:39:08.544183 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1050/2142] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:08 2022] GET /compute/v2.1/servers/19e41421-3550-49fe-90d0-64b07a5efefa => generated 1309 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:39:08.544439 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1093/2143] 10.222.0.33 () {60 vars in 1279 bytes} [Fri Sep 23 04:39:08 2022] POST /compute/v2.1/servers/3871f20c-2d2b-4918-9381-73e73651a586/action => generated 100 bytes in 477 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 04:39:08.544616 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9b27677b-b853-4f90-a855-17276f8251e0 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1923170153", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "networks": [{"uuid": "a989594a-cd71-405f-a7ac-42f529a758f7"}]}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:39:08.558444 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-52604d29-6d87-4a51-a52d-20674d68928d tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:08.559301 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-52604d29-6d87-4a51-a52d-20674d68928d tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] [instance: 3871f20c-2d2b-4918-9381-73e73651a586] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:08.566120 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-52604d29-6d87-4a51-a52d-20674d68928d tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:08.566704 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-52604d29-6d87-4a51-a52d-20674d68928d tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:08.567637 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-52604d29-6d87-4a51-a52d-20674d68928d tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:08.568354 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-52604d29-6d87-4a51-a52d-20674d68928d tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:08.569245 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-52604d29-6d87-4a51-a52d-20674d68928d tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:08.569685 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-52604d29-6d87-4a51-a52d-20674d68928d tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:08.574071 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=100 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:39:08.604394 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.network.neutron [None req-9b27677b-b853-4f90-a855-17276f8251e0 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] validate_networks() for [('a989594a-cd71-405f-a7ac-42f529a758f7', None, None, None, None, None)] {{(pid=122698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:39:08.792415 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-52604d29-6d87-4a51-a52d-20674d68928d tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6477e60b54491baff0a7dbee062ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc56537160d349aab8f5e6499ca8ab99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:08.800795 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-52604d29-6d87-4a51-a52d-20674d68928d tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] 10.222.0.33 "GET /compute/v2.1/servers/3871f20c-2d2b-4918-9381-73e73651a586" status: 200 len: 1468 microversion: 2.1 time: 0.245809 Sep 23 04:39:08.801908 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1094/2144] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:08 2022] GET /compute/v2.1/servers/3871f20c-2d2b-4918-9381-73e73651a586 => generated 1468 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:39:08.807109 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-14d23dcb-d6c8-493c-8ff9-22e2b9f2b973 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:08.807712 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-14d23dcb-d6c8-493c-8ff9-22e2b9f2b973 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] [instance: 94fc4134-9b8e-4dcd-bd96-5545bfd51c97] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:08.815218 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-14d23dcb-d6c8-493c-8ff9-22e2b9f2b973 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:08.815712 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-14d23dcb-d6c8-493c-8ff9-22e2b9f2b973 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:08.816155 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-14d23dcb-d6c8-493c-8ff9-22e2b9f2b973 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:08.816859 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-14d23dcb-d6c8-493c-8ff9-22e2b9f2b973 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:08.817327 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-14d23dcb-d6c8-493c-8ff9-22e2b9f2b973 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:08.817758 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-14d23dcb-d6c8-493c-8ff9-22e2b9f2b973 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:08.932539 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-14d23dcb-d6c8-493c-8ff9-22e2b9f2b973 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lazy-loading 'services' on Instance uuid 94fc4134-9b8e-4dcd-bd96-5545bfd51c97 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:39:08.951503 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-14d23dcb-d6c8-493c-8ff9-22e2b9f2b973 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97" status: 200 len: 1929 microversion: 2.75 time: 0.148262 Sep 23 04:39:08.953871 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1095/2145] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:39:08 2022] GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97 => generated 1929 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:39:08.973453 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8e02dc08-bb96-4d6b-8756-a03a0cf70c4a tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:08.974546 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-8e02dc08-bb96-4d6b-8756-a03a0cf70c4a tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] [instance: 94e8c141-ef33-4bb2-929f-7f7d0d10ff2c] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:08.984570 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8e02dc08-bb96-4d6b-8756-a03a0cf70c4a tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:08.985375 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8e02dc08-bb96-4d6b-8756-a03a0cf70c4a tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:08.986142 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8e02dc08-bb96-4d6b-8756-a03a0cf70c4a tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:08.987467 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8e02dc08-bb96-4d6b-8756-a03a0cf70c4a tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:08.988499 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8e02dc08-bb96-4d6b-8756-a03a0cf70c4a tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:08.989241 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8e02dc08-bb96-4d6b-8756-a03a0cf70c4a tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:09.178970 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-9b27677b-b853-4f90-a855-17276f8251e0 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Flavor limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:39:09.179425 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-9b27677b-b853-4f90-a855-17276f8251e0 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Image limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:39:09.179850 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-9b27677b-b853-4f90-a855-17276f8251e0 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Flavor pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:39:09.180256 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-9b27677b-b853-4f90-a855-17276f8251e0 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Image pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:39:09.180692 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-9b27677b-b853-4f90-a855-17276f8251e0 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:39:09.190156 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9b27677b-b853-4f90-a855-17276f8251e0 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:09.190689 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9b27677b-b853-4f90-a855-17276f8251e0 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:09.191125 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9b27677b-b853-4f90-a855-17276f8251e0 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:09.191853 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9b27677b-b853-4f90-a855-17276f8251e0 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:09.192395 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9b27677b-b853-4f90-a855-17276f8251e0 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:09.192829 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9b27677b-b853-4f90-a855-17276f8251e0 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:09.195692 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-8e02dc08-bb96-4d6b-8756-a03a0cf70c4a tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1244f3db540441a28d8413e510cfccad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b412c874d4e668b4a1a33dedb2c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:09.205063 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-8e02dc08-bb96-4d6b-8756-a03a0cf70c4a tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] 10.222.0.33 "GET /compute/v2.1/servers/94e8c141-ef33-4bb2-929f-7f7d0d10ff2c" status: 200 len: 1518 microversion: 2.1 time: 0.248857 Sep 23 04:39:09.205063 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1096/2146] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:08 2022] GET /compute/v2.1/servers/94e8c141-ef33-4bb2-929f-7f7d0d10ff2c => generated 1518 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:09.213054 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0fc216b7-57c8-4aa3-8ae4-6420712d825d tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-11812672", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:39:09.215950 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-9b27677b-b853-4f90-a855-17276f8251e0 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Getting quotas for project fe698721372f40888dc2918c46e65f2f. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:39:09.221525 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-9b27677b-b853-4f90-a855-17276f8251e0 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Getting quotas for user 36526fe612c840fb907e1992d8e62538 and project fe698721372f40888dc2918c46e65f2f. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:39:09.235282 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-9b27677b-b853-4f90-a855-17276f8251e0 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Going to run 1 instances... {{(pid=122698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:39:09.237649 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-9b27677b-b853-4f90-a855-17276f8251e0 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:39:09.275526 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.neutron [None req-0fc216b7-57c8-4aa3-8ae4-6420712d825d tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] validate_networks() for None {{(pid=122699) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:39:09.403179 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9b27677b-b853-4f90-a855-17276f8251e0 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.863070 Sep 23 04:39:09.404660 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1051/2147] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:39:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 865 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:39:09.410213 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-33cf41e8-31f5-4c26-93e1-177afe664730 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:09.411498 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-33cf41e8-31f5-4c26-93e1-177afe664730 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: aa35cea0-4f7f-4d03-9436-f15264b9f713] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:09.422586 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-33cf41e8-31f5-4c26-93e1-177afe664730 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:09.423402 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-33cf41e8-31f5-4c26-93e1-177afe664730 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:09.424047 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-33cf41e8-31f5-4c26-93e1-177afe664730 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:09.424966 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-33cf41e8-31f5-4c26-93e1-177afe664730 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:09.425631 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-33cf41e8-31f5-4c26-93e1-177afe664730 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:09.426362 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-33cf41e8-31f5-4c26-93e1-177afe664730 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:09.629681 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-0fc216b7-57c8-4aa3-8ae4-6420712d825d tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Flavor limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:39:09.629681 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-0fc216b7-57c8-4aa3-8ae4-6420712d825d tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Image limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:39:09.629681 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-0fc216b7-57c8-4aa3-8ae4-6420712d825d tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Flavor pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:39:09.629944 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-0fc216b7-57c8-4aa3-8ae4-6420712d825d tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Image pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:39:09.630241 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-0fc216b7-57c8-4aa3-8ae4-6420712d825d tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:39:09.644431 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0fc216b7-57c8-4aa3-8ae4-6420712d825d tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:09.644893 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0fc216b7-57c8-4aa3-8ae4-6420712d825d tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:09.645379 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0fc216b7-57c8-4aa3-8ae4-6420712d825d tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:09.646293 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0fc216b7-57c8-4aa3-8ae4-6420712d825d tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:09.646751 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0fc216b7-57c8-4aa3-8ae4-6420712d825d tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:09.647316 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0fc216b7-57c8-4aa3-8ae4-6420712d825d tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:09.657418 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-33cf41e8-31f5-4c26-93e1-177afe664730 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:09.667017 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-33cf41e8-31f5-4c26-93e1-177afe664730 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713" status: 200 len: 1199 microversion: 2.1 time: 0.260321 Sep 23 04:39:09.668084 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1052/2148] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:09 2022] GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713 => generated 1199 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:09.673510 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-0fc216b7-57c8-4aa3-8ae4-6420712d825d tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Getting quotas for project fc56537160d349aab8f5e6499ca8ab99. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:39:09.675819 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4e5ae766-2ebd-4074-b8e1-f79588dfcf7d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:09.676747 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4e5ae766-2ebd-4074-b8e1-f79588dfcf7d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:09.692437 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-0fc216b7-57c8-4aa3-8ae4-6420712d825d tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Getting quotas for user ee6477e60b54491baff0a7dbee062ed6 and project fc56537160d349aab8f5e6499ca8ab99. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:39:09.707943 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-0fc216b7-57c8-4aa3-8ae4-6420712d825d tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Going to run 1 instances... {{(pid=122699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:39:09.710807 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-0fc216b7-57c8-4aa3-8ae4-6420712d825d tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] [instance: 7cc18563-ad1f-4050-818b-880782814c23] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:39:09.744349 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4e5ae766-2ebd-4074-b8e1-f79588dfcf7d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:09.751951 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4e5ae766-2ebd-4074-b8e1-f79588dfcf7d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6" status: 200 len: 1215 microversion: 2.1 time: 0.082682 Sep 23 04:39:09.752565 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1053/2149] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:09 2022] GET /compute/v2.1/servers/cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6 => generated 1215 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:09.762806 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-328c4e73-282c-4265-bce3-404057616596 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:09.763431 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-328c4e73-282c-4265-bce3-404057616596 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 19e41421-3550-49fe-90d0-64b07a5efefa] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:09.772049 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-328c4e73-282c-4265-bce3-404057616596 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:09.772754 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-328c4e73-282c-4265-bce3-404057616596 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:09.775894 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-328c4e73-282c-4265-bce3-404057616596 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:09.775894 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-328c4e73-282c-4265-bce3-404057616596 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:09.775894 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-328c4e73-282c-4265-bce3-404057616596 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:09.775894 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-328c4e73-282c-4265-bce3-404057616596 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:09.794016 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-328c4e73-282c-4265-bce3-404057616596 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] HTTP exception thrown: Instance 19e41421-3550-49fe-90d0-64b07a5efefa could not be found. Sep 23 04:39:09.796169 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-328c4e73-282c-4265-bce3-404057616596 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Request method failure captured: Sep 23 04:39:09.796169 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/19e41421-3550-49fe-90d0-64b07a5efefa HTTP/1.1 Sep 23 04:39:09.796169 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:39:09.796169 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:39:09.796169 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:39:09.796169 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:39:09.796169 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:39:09.796169 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:39:09.796169 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:39:09.796169 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:39:09.796169 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTedAlFPeFmnDF7aT3i0aUDQGJFgGZnI-hp3AgXCkcO3hSwSmXlMqV4YX4M2zE_tzLZBCRNva2-mnxAIXvcDQ4ADhbq0RDumL2tq0UzsAkBd3JY4bJ4oVHe0Nm8SGB15yLY37BALihKvv5H7mxEOffoAs77PenOe-f2xwUXiU1RwOEo Sep 23 04:39:09.796169 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:39:09.796169 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:39:09.796169 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:39:09.796169 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:39:09.796169 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:39:09.796169 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:39:09.796169 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: f5db359a60174c45afa2bf06e23a46c4 Sep 23 04:39:09.796169 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ServersOnMultiNodesTest-604470560 Sep 23 04:39:09.796169 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:39:09.796169 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:39:09.796169 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f5db359a60174c45afa2bf06e23a46c4", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f5db359a60174c45afa2bf06e23a46c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f5db359a60174c45afa2bf06e23a46c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f5db359a60174c45afa2bf06e23a46c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:39:09.796169 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ServersOnMultiNodesTest-604470560 Sep 23 04:39:09.796169 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: f5db359a60174c45afa2bf06e23a46c4 Sep 23 04:39:09.796169 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-604470560 Sep 23 04:39:09.796169 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ServersOnMultiNodesTest-604470560-project Sep 23 04:39:09.796169 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:39:09.796169 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:39:09.796169 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: da08af8193dd490b93278385583f24c0 Sep 23 04:39:09.796169 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ServersOnMultiNodesTest-604470560-project Sep 23 04:39:09.796169 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:39:09.796169 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 19e41421-3550-49fe-90d0-64b07a5efefa could not be found. Sep 23 04:39:09.796169 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '19e41421-3550-49fe-90d0-64b07a5efefa'} Sep 23 04:39:09.796169 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:39:09.796169 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:39:09.796169 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:39:09.796169 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:39:09.796169 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:39:09.796169 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:39:09.796169 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:39:09.796169 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:39:09.796169 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:39:09.796169 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:39:09.796169 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19e41421-3550-49fe-90d0-64b07a5efefa could not be found. Sep 23 04:39:09.796169 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:39:09.796169 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:39:09.796169 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:39:09.796169 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:39:09.796169 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:39:09.796169 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:39:09.796169 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:39:09.796169 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:39:09.796169 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:39:09.796169 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:39:09.796169 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:39:09.796169 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:39:09.796169 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:39:09.796169 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:39:09.796169 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:39:09.796169 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:39:09.796169 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19e41421-3550-49fe-90d0-64b07a5efefa could not be found. Sep 23 04:39:09.796169 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:39:09.796169 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:39:09.796169 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:39:09.800078 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:39:09.800078 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:39:09.800078 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:39:09.800078 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:39:09.800078 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:39:09.800078 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19e41421-3550-49fe-90d0-64b07a5efefa could not be found. Sep 23 04:39:09.800078 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:39:09.800078 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-328c4e73-282c-4265-bce3-404057616596 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Returning 404 to user: Instance 19e41421-3550-49fe-90d0-64b07a5efefa could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:39:09.800078 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-328c4e73-282c-4265-bce3-404057616596 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/19e41421-3550-49fe-90d0-64b07a5efefa" status: 404 len: 111 microversion: 2.1 time: 0.045833 Sep 23 04:39:09.800846 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1054/2150] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:09 2022] GET /compute/v2.1/servers/19e41421-3550-49fe-90d0-64b07a5efefa => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:39:09.811220 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a8ca1fb1-af7f-4fba-9f76-36e738e7a4bd tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:09.811896 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a8ca1fb1-af7f-4fba-9f76-36e738e7a4bd tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: b4a75706-ba44-4b2c-8767-071502169d5a] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:09.820856 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a8ca1fb1-af7f-4fba-9f76-36e738e7a4bd tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:09.821329 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a8ca1fb1-af7f-4fba-9f76-36e738e7a4bd tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:09.821777 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a8ca1fb1-af7f-4fba-9f76-36e738e7a4bd tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:09.822851 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a8ca1fb1-af7f-4fba-9f76-36e738e7a4bd tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:09.823334 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a8ca1fb1-af7f-4fba-9f76-36e738e7a4bd tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:09.823770 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a8ca1fb1-af7f-4fba-9f76-36e738e7a4bd tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:09.844189 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0fc216b7-57c8-4aa3-8ae4-6420712d825d tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.636549 Sep 23 04:39:09.845946 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1097/2151] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:39:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 641 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:39:09.858803 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-90da916d-10a6-4bfe-a9dd-63336ebab330 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:09.858803 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-90da916d-10a6-4bfe-a9dd-63336ebab330 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] [instance: 7cc18563-ad1f-4050-818b-880782814c23] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:09.860744 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-a8ca1fb1-af7f-4fba-9f76-36e738e7a4bd tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] HTTP exception thrown: Instance b4a75706-ba44-4b2c-8767-071502169d5a could not be found. Sep 23 04:39:09.866410 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a8ca1fb1-af7f-4fba-9f76-36e738e7a4bd tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Request method failure captured: Sep 23 04:39:09.866410 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/b4a75706-ba44-4b2c-8767-071502169d5a HTTP/1.1 Sep 23 04:39:09.866410 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:39:09.866410 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:39:09.866410 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:39:09.866410 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:39:09.866410 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:39:09.866410 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:39:09.866410 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:39:09.866410 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:39:09.866410 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTedAlFPeFmnDF7aT3i0aUDQGJFgGZnI-hp3AgXCkcO3hSwSmXlMqV4YX4M2zE_tzLZBCRNva2-mnxAIXvcDQ4ADhbq0RDumL2tq0UzsAkBd3JY4bJ4oVHe0Nm8SGB15yLY37BALihKvv5H7mxEOffoAs77PenOe-f2xwUXiU1RwOEo Sep 23 04:39:09.866410 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:39:09.866410 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:39:09.866410 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:39:09.866410 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:39:09.866410 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:39:09.866410 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:39:09.866410 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: f5db359a60174c45afa2bf06e23a46c4 Sep 23 04:39:09.866410 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ServersOnMultiNodesTest-604470560 Sep 23 04:39:09.866410 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:39:09.866410 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:39:09.866410 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f5db359a60174c45afa2bf06e23a46c4", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f5db359a60174c45afa2bf06e23a46c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f5db359a60174c45afa2bf06e23a46c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f5db359a60174c45afa2bf06e23a46c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:39:09.866410 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ServersOnMultiNodesTest-604470560 Sep 23 04:39:09.866410 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: f5db359a60174c45afa2bf06e23a46c4 Sep 23 04:39:09.866410 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-604470560 Sep 23 04:39:09.866410 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ServersOnMultiNodesTest-604470560-project Sep 23 04:39:09.866410 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:39:09.866410 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:39:09.866410 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: da08af8193dd490b93278385583f24c0 Sep 23 04:39:09.866410 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ServersOnMultiNodesTest-604470560-project Sep 23 04:39:09.866410 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:39:09.866410 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance b4a75706-ba44-4b2c-8767-071502169d5a could not be found. Sep 23 04:39:09.866410 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': 'b4a75706-ba44-4b2c-8767-071502169d5a'} Sep 23 04:39:09.866410 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:39:09.866410 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:39:09.866410 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:39:09.866410 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:39:09.866410 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:39:09.866410 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:39:09.866410 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:39:09.866410 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:39:09.866410 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:39:09.866410 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:39:09.866410 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4a75706-ba44-4b2c-8767-071502169d5a could not be found. Sep 23 04:39:09.866410 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:39:09.866410 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:39:09.866410 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:39:09.866410 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:39:09.866410 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:39:09.866410 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:39:09.866410 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:39:09.866410 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:39:09.866410 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:39:09.866410 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:39:09.866410 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:39:09.866410 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:39:09.866410 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:39:09.866410 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:39:09.866410 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:39:09.866410 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:39:09.866410 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4a75706-ba44-4b2c-8767-071502169d5a could not be found. Sep 23 04:39:09.866410 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:39:09.866410 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:39:09.866410 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:39:09.870612 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:39:09.870612 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:39:09.870612 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:39:09.870612 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:39:09.870612 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:39:09.870612 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4a75706-ba44-4b2c-8767-071502169d5a could not be found. Sep 23 04:39:09.870612 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:39:09.871631 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a8ca1fb1-af7f-4fba-9f76-36e738e7a4bd tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Returning 404 to user: Instance b4a75706-ba44-4b2c-8767-071502169d5a could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:39:09.875169 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a8ca1fb1-af7f-4fba-9f76-36e738e7a4bd tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/b4a75706-ba44-4b2c-8767-071502169d5a" status: 404 len: 111 microversion: 2.1 time: 0.069344 Sep 23 04:39:09.879897 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1055/2152] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:09 2022] GET /compute/v2.1/servers/b4a75706-ba44-4b2c-8767-071502169d5a => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:39:09.893849 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-69c215e5-d003-44c3-a814-cbc509548e4b tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:09.928467 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:39:09.937347 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-90da916d-10a6-4bfe-a9dd-63336ebab330 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6477e60b54491baff0a7dbee062ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc56537160d349aab8f5e6499ca8ab99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:09.947903 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-90da916d-10a6-4bfe-a9dd-63336ebab330 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] 10.222.0.33 "GET /compute/v2.1/servers/7cc18563-ad1f-4050-818b-880782814c23" status: 200 len: 1217 microversion: 2.1 time: 0.094588 Sep 23 04:39:09.961920 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1098/2153] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:09 2022] GET /compute/v2.1/servers/7cc18563-ad1f-4050-818b-880782814c23 => generated 1217 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:09.982150 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-16c6c187-1bca-4038-82e2-883bd67e8b55 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:09.982775 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-16c6c187-1bca-4038-82e2-883bd67e8b55 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] [instance: 94fc4134-9b8e-4dcd-bd96-5545bfd51c97] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:09.989399 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-16c6c187-1bca-4038-82e2-883bd67e8b55 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:09.989995 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-16c6c187-1bca-4038-82e2-883bd67e8b55 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:09.990453 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-16c6c187-1bca-4038-82e2-883bd67e8b55 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:09.991194 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-16c6c187-1bca-4038-82e2-883bd67e8b55 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:09.991655 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-16c6c187-1bca-4038-82e2-883bd67e8b55 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:09.992198 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-16c6c187-1bca-4038-82e2-883bd67e8b55 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:10.025427 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-69c215e5-d003-44c3-a814-cbc509548e4b tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "DELETE /compute/v2.1/os-server-groups/a3bd0e69-7ea7-4fa0-8be9-2d7b06373cbc" status: 204 len: 0 microversion: 2.1 time: 0.143302 Sep 23 04:39:10.026446 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1056/2154] 10.222.0.33 () {58 vars in 1266 bytes} [Fri Sep 23 04:39:09 2022] DELETE /compute/v2.1/os-server-groups/a3bd0e69-7ea7-4fa0-8be9-2d7b06373cbc => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 23 04:39:10.043045 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b86963c2-7a69-4aee-a217-9062ab6e0834 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:10.049997 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b86963c2-7a69-4aee-a217-9062ab6e0834 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 1180ceb9-a888-4a3b-ba9d-a35afa8dc279] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:10.070605 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b86963c2-7a69-4aee-a217-9062ab6e0834 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:10.071120 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b86963c2-7a69-4aee-a217-9062ab6e0834 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:10.071567 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b86963c2-7a69-4aee-a217-9062ab6e0834 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:10.072297 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b86963c2-7a69-4aee-a217-9062ab6e0834 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:10.072764 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b86963c2-7a69-4aee-a217-9062ab6e0834 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:10.073197 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b86963c2-7a69-4aee-a217-9062ab6e0834 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:10.082547 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-16c6c187-1bca-4038-82e2-883bd67e8b55 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lazy-loading 'services' on Instance uuid 94fc4134-9b8e-4dcd-bd96-5545bfd51c97 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:39:10.109105 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-16c6c187-1bca-4038-82e2-883bd67e8b55 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97" status: 200 len: 1929 microversion: 2.75 time: 0.131509 Sep 23 04:39:10.109687 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1099/2155] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:39:09 2022] GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97 => generated 1929 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:39:10.135554 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b86963c2-7a69-4aee-a217-9062ab6e0834 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 1180ceb9-a888-4a3b-ba9d-a35afa8dc279] Going to try to terminate instance {{(pid=122698) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:39:10.227570 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-05aac56a-a52a-4952-90c6-9779b54b5d67 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:10.228825 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-05aac56a-a52a-4952-90c6-9779b54b5d67 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] [instance: 94e8c141-ef33-4bb2-929f-7f7d0d10ff2c] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:10.237829 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-05aac56a-a52a-4952-90c6-9779b54b5d67 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:10.238800 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-05aac56a-a52a-4952-90c6-9779b54b5d67 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:10.239208 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-05aac56a-a52a-4952-90c6-9779b54b5d67 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:10.241316 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-05aac56a-a52a-4952-90c6-9779b54b5d67 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:10.242074 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-05aac56a-a52a-4952-90c6-9779b54b5d67 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:10.243264 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-05aac56a-a52a-4952-90c6-9779b54b5d67 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:10.309967 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-05aac56a-a52a-4952-90c6-9779b54b5d67 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1244f3db540441a28d8413e510cfccad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b412c874d4e668b4a1a33dedb2c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:10.318890 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-05aac56a-a52a-4952-90c6-9779b54b5d67 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] 10.222.0.33 "GET /compute/v2.1/servers/94e8c141-ef33-4bb2-929f-7f7d0d10ff2c" status: 200 len: 1476 microversion: 2.1 time: 0.096209 Sep 23 04:39:10.319478 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1100/2156] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:10 2022] GET /compute/v2.1/servers/94e8c141-ef33-4bb2-929f-7f7d0d10ff2c => generated 1476 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:39:10.324323 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-f07cf53e-7bbc-4e4e-89c9-de22672f4f68 req-8ca3ad03-66c3-4acd-9857-c4dc40d6da24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94e8c141-ef33-4bb2-929f-7f7d0d10ff2c", "name": "network-vif-deleted", "tag": "c3659f36-9ff9-42b5-bba7-a92fbe8f0703"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:39:10.335805 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-f07cf53e-7bbc-4e4e-89c9-de22672f4f68 req-8ca3ad03-66c3-4acd-9857-c4dc40d6da24 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:10.336508 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-f07cf53e-7bbc-4e4e-89c9-de22672f4f68 req-8ca3ad03-66c3-4acd-9857-c4dc40d6da24 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:10.337138 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-f07cf53e-7bbc-4e4e-89c9-de22672f4f68 req-8ca3ad03-66c3-4acd-9857-c4dc40d6da24 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:10.354459 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-f07cf53e-7bbc-4e4e-89c9-de22672f4f68 req-8ca3ad03-66c3-4acd-9857-c4dc40d6da24 service nova] Creating event network-vif-deleted:c3659f36-9ff9-42b5-bba7-a92fbe8f0703 for instance 94e8c141-ef33-4bb2-929f-7f7d0d10ff2c on n-h1-846463-3 Sep 23 04:39:10.359642 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-f07cf53e-7bbc-4e4e-89c9-de22672f4f68 req-8ca3ad03-66c3-4acd-9857-c4dc40d6da24 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038961 Sep 23 04:39:10.360221 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1101/2157] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:39:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:39:10.594834 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b86963c2-7a69-4aee-a217-9062ab6e0834 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "DELETE /compute/v2.1/servers/1180ceb9-a888-4a3b-ba9d-a35afa8dc279" status: 204 len: 0 microversion: 2.1 time: 0.563822 Sep 23 04:39:10.597564 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1057/2158] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:39:10 2022] DELETE /compute/v2.1/servers/1180ceb9-a888-4a3b-ba9d-a35afa8dc279 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 23 04:39:10.609346 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c3a3ae13-d726-49f1-91a8-a841e2c8b2ed tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:10.610172 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c3a3ae13-d726-49f1-91a8-a841e2c8b2ed tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 1180ceb9-a888-4a3b-ba9d-a35afa8dc279] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:10.622352 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c3a3ae13-d726-49f1-91a8-a841e2c8b2ed tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:10.623063 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c3a3ae13-d726-49f1-91a8-a841e2c8b2ed tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:10.623644 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c3a3ae13-d726-49f1-91a8-a841e2c8b2ed tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:10.626141 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c3a3ae13-d726-49f1-91a8-a841e2c8b2ed tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:10.626141 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c3a3ae13-d726-49f1-91a8-a841e2c8b2ed tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:10.626690 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c3a3ae13-d726-49f1-91a8-a841e2c8b2ed tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:10.695542 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9cc22395-2c8f-4389-88ae-894b4c72db0b tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:10.696384 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-9cc22395-2c8f-4389-88ae-894b4c72db0b tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: aa35cea0-4f7f-4d03-9436-f15264b9f713] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:10.703561 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9cc22395-2c8f-4389-88ae-894b4c72db0b tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:10.704416 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9cc22395-2c8f-4389-88ae-894b4c72db0b tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:10.705131 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9cc22395-2c8f-4389-88ae-894b4c72db0b tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:10.706331 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9cc22395-2c8f-4389-88ae-894b4c72db0b tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:10.707066 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9cc22395-2c8f-4389-88ae-894b4c72db0b tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:10.707691 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9cc22395-2c8f-4389-88ae-894b4c72db0b tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:11.182101 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c3a3ae13-d726-49f1-91a8-a841e2c8b2ed tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:11.184904 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-9cc22395-2c8f-4389-88ae-894b4c72db0b tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:11.191995 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c3a3ae13-d726-49f1-91a8-a841e2c8b2ed tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/1180ceb9-a888-4a3b-ba9d-a35afa8dc279" status: 200 len: 1473 microversion: 2.1 time: 0.590464 Sep 23 04:39:11.192813 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1102/2159] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:10 2022] GET /compute/v2.1/servers/1180ceb9-a888-4a3b-ba9d-a35afa8dc279 => generated 1473 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:11.194310 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9cc22395-2c8f-4389-88ae-894b4c72db0b tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713" status: 200 len: 1199 microversion: 2.1 time: 0.503472 Sep 23 04:39:11.195393 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1058/2160] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:10 2022] GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713 => generated 1199 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:39:11.198203 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8ff38266-a7b7-43e1-b1e0-c66d081d735a tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:11.198830 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-8ff38266-a7b7-43e1-b1e0-c66d081d735a tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:11.200660 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7143f865-7a95-4706-9e50-7d4ff434317a tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:11.201532 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7143f865-7a95-4706-9e50-7d4ff434317a tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] [instance: 7cc18563-ad1f-4050-818b-880782814c23] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:11.206804 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8ff38266-a7b7-43e1-b1e0-c66d081d735a tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:11.207305 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8ff38266-a7b7-43e1-b1e0-c66d081d735a tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:11.207826 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8ff38266-a7b7-43e1-b1e0-c66d081d735a tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:11.208640 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8ff38266-a7b7-43e1-b1e0-c66d081d735a tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:11.209104 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8ff38266-a7b7-43e1-b1e0-c66d081d735a tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:11.209397 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7143f865-7a95-4706-9e50-7d4ff434317a tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:11.209553 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8ff38266-a7b7-43e1-b1e0-c66d081d735a tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:11.210219 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7143f865-7a95-4706-9e50-7d4ff434317a tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:11.210867 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7143f865-7a95-4706-9e50-7d4ff434317a tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:11.212113 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7143f865-7a95-4706-9e50-7d4ff434317a tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:11.212841 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7143f865-7a95-4706-9e50-7d4ff434317a tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:11.213524 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7143f865-7a95-4706-9e50-7d4ff434317a tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:11.312442 n-d-846463-3 devstack@n-api.service[122699]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 04:39:11.312639 n-d-846463-3 devstack@n-api.service[122699]: Fri Sep 23 04:39:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6 (ip 10.222.0.33) !!! Sep 23 04:39:11.324077 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-7143f865-7a95-4706-9e50-7d4ff434317a tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6477e60b54491baff0a7dbee062ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc56537160d349aab8f5e6499ca8ab99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:11.324255 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-8ff38266-a7b7-43e1-b1e0-c66d081d735a tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:11.333411 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-8ff38266-a7b7-43e1-b1e0-c66d081d735a tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6" status: 200 len: 1219 microversion: 2.1 time: 0.139233 Sep 23 04:39:11.334021 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1103/2161] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:11 2022] GET /compute/v2.1/servers/cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6 => generated 1219 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:11.336066 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7143f865-7a95-4706-9e50-7d4ff434317a tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] 10.222.0.33 "GET /compute/v2.1/servers/7cc18563-ad1f-4050-818b-880782814c23" status: 200 len: 1221 microversion: 2.1 time: 0.139399 Sep 23 04:39:11.348554 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f3b78455-6ecd-4e62-858a-f35154ec77bf tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:11.349379 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f3b78455-6ecd-4e62-858a-f35154ec77bf tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] [instance: 94fc4134-9b8e-4dcd-bd96-5545bfd51c97] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:11.351554 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1059/2162] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:11 2022] GET /compute/v2.1/servers/7cc18563-ad1f-4050-818b-880782814c23 => generated 1221 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:11.356000 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f3b78455-6ecd-4e62-858a-f35154ec77bf tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:11.356498 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f3b78455-6ecd-4e62-858a-f35154ec77bf tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:11.356600 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d1a604e9-adec-49fa-b3c5-8e6199d744b1 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:11.357017 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f3b78455-6ecd-4e62-858a-f35154ec77bf tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:11.357164 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d1a604e9-adec-49fa-b3c5-8e6199d744b1 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] [instance: 94e8c141-ef33-4bb2-929f-7f7d0d10ff2c] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:11.357931 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f3b78455-6ecd-4e62-858a-f35154ec77bf tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:11.358654 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f3b78455-6ecd-4e62-858a-f35154ec77bf tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:11.359095 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f3b78455-6ecd-4e62-858a-f35154ec77bf tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:11.363608 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d1a604e9-adec-49fa-b3c5-8e6199d744b1 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:11.364101 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d1a604e9-adec-49fa-b3c5-8e6199d744b1 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:11.364572 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d1a604e9-adec-49fa-b3c5-8e6199d744b1 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:11.365526 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d1a604e9-adec-49fa-b3c5-8e6199d744b1 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:11.366029 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d1a604e9-adec-49fa-b3c5-8e6199d744b1 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:11.366468 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d1a604e9-adec-49fa-b3c5-8e6199d744b1 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:11.409857 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d1a604e9-adec-49fa-b3c5-8e6199d744b1 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:11.410370 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d1a604e9-adec-49fa-b3c5-8e6199d744b1 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:11.410808 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d1a604e9-adec-49fa-b3c5-8e6199d744b1 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:11.411259 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-d1a604e9-adec-49fa-b3c5-8e6199d744b1 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lazy-loading 'fault' on Instance uuid 94e8c141-ef33-4bb2-929f-7f7d0d10ff2c {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:39:11.441238 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-f3b78455-6ecd-4e62-858a-f35154ec77bf tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lazy-loading 'services' on Instance uuid 94fc4134-9b8e-4dcd-bd96-5545bfd51c97 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:39:11.457158 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d1a604e9-adec-49fa-b3c5-8e6199d744b1 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1244f3db540441a28d8413e510cfccad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b412c874d4e668b4a1a33dedb2c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:11.460229 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f3b78455-6ecd-4e62-858a-f35154ec77bf tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97" status: 200 len: 1929 microversion: 2.75 time: 0.125023 Sep 23 04:39:11.460821 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1104/2163] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:39:11 2022] GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97 => generated 1929 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:39:11.466008 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d1a604e9-adec-49fa-b3c5-8e6199d744b1 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] 10.222.0.33 "GET /compute/v2.1/servers/94e8c141-ef33-4bb2-929f-7f7d0d10ff2c" status: 200 len: 1310 microversion: 2.1 time: 0.113102 Sep 23 04:39:11.466588 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1060/2164] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:11 2022] GET /compute/v2.1/servers/94e8c141-ef33-4bb2-929f-7f7d0d10ff2c => generated 1310 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:12.236605 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c1e3f162-177c-43e8-abab-22dc707e58ac tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:12.237156 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0aa18414-2650-4953-96bb-68fcda4ee1b1 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:12.237491 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c1e3f162-177c-43e8-abab-22dc707e58ac tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 1180ceb9-a888-4a3b-ba9d-a35afa8dc279] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:12.237562 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-0aa18414-2650-4953-96bb-68fcda4ee1b1 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: aa35cea0-4f7f-4d03-9436-f15264b9f713] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:12.247286 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c1e3f162-177c-43e8-abab-22dc707e58ac tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:12.250559 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c1e3f162-177c-43e8-abab-22dc707e58ac tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:12.250559 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c1e3f162-177c-43e8-abab-22dc707e58ac tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:12.250559 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c1e3f162-177c-43e8-abab-22dc707e58ac tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:12.252145 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c1e3f162-177c-43e8-abab-22dc707e58ac tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:12.253439 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c1e3f162-177c-43e8-abab-22dc707e58ac tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:12.264123 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0aa18414-2650-4953-96bb-68fcda4ee1b1 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:12.266089 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0aa18414-2650-4953-96bb-68fcda4ee1b1 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:12.266994 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0aa18414-2650-4953-96bb-68fcda4ee1b1 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:12.270693 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0aa18414-2650-4953-96bb-68fcda4ee1b1 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:12.271203 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0aa18414-2650-4953-96bb-68fcda4ee1b1 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:12.273078 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0aa18414-2650-4953-96bb-68fcda4ee1b1 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:12.539877 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c1e3f162-177c-43e8-abab-22dc707e58ac tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:12.552336 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-0aa18414-2650-4953-96bb-68fcda4ee1b1 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:12.560771 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0aa18414-2650-4953-96bb-68fcda4ee1b1 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713" status: 200 len: 1199 microversion: 2.1 time: 0.327986 Sep 23 04:39:12.561902 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1061/2165] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:12 2022] GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713 => generated 1199 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:12.564729 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c1e3f162-177c-43e8-abab-22dc707e58ac tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/1180ceb9-a888-4a3b-ba9d-a35afa8dc279" status: 200 len: 1473 microversion: 2.1 time: 0.331956 Sep 23 04:39:12.565492 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1105/2166] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:12 2022] GET /compute/v2.1/servers/1180ceb9-a888-4a3b-ba9d-a35afa8dc279 => generated 1473 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:12.573684 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d4f502b5-07af-476b-9e53-03b9e1590feb tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:12.576267 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b4689a0a-b709-4b82-b4d3-237acdc456d9 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:12.577618 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b4689a0a-b709-4b82-b4d3-237acdc456d9 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] [instance: 7cc18563-ad1f-4050-818b-880782814c23] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:12.579057 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d4f502b5-07af-476b-9e53-03b9e1590feb tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:12.599735 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d4f502b5-07af-476b-9e53-03b9e1590feb tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:12.603045 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d4f502b5-07af-476b-9e53-03b9e1590feb tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:12.603045 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d4f502b5-07af-476b-9e53-03b9e1590feb tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:12.604068 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d4f502b5-07af-476b-9e53-03b9e1590feb tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:12.604476 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b4689a0a-b709-4b82-b4d3-237acdc456d9 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:12.605051 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b4689a0a-b709-4b82-b4d3-237acdc456d9 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:12.605655 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d4f502b5-07af-476b-9e53-03b9e1590feb tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:12.606189 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d4f502b5-07af-476b-9e53-03b9e1590feb tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:12.607467 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b4689a0a-b709-4b82-b4d3-237acdc456d9 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:12.610947 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b4689a0a-b709-4b82-b4d3-237acdc456d9 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:12.612443 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b4689a0a-b709-4b82-b4d3-237acdc456d9 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:12.612924 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b4689a0a-b709-4b82-b4d3-237acdc456d9 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:12.706869 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d4f502b5-07af-476b-9e53-03b9e1590feb tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:12.718425 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d4f502b5-07af-476b-9e53-03b9e1590feb tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6" status: 200 len: 1285 microversion: 2.1 time: 0.149284 Sep 23 04:39:12.720161 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1062/2167] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:12 2022] GET /compute/v2.1/servers/cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6 => generated 1285 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:12.726055 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c241a826-09b5-4ac3-9e27-625d338d4437 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:12.726824 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c241a826-09b5-4ac3-9e27-625d338d4437 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] [instance: 94e8c141-ef33-4bb2-929f-7f7d0d10ff2c] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:12.735198 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c241a826-09b5-4ac3-9e27-625d338d4437 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:12.735705 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c241a826-09b5-4ac3-9e27-625d338d4437 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:12.736147 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c241a826-09b5-4ac3-9e27-625d338d4437 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:12.736901 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c241a826-09b5-4ac3-9e27-625d338d4437 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:12.737361 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c241a826-09b5-4ac3-9e27-625d338d4437 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:12.740525 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c241a826-09b5-4ac3-9e27-625d338d4437 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:12.776441 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c241a826-09b5-4ac3-9e27-625d338d4437 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:12.776940 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c241a826-09b5-4ac3-9e27-625d338d4437 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:12.777443 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c241a826-09b5-4ac3-9e27-625d338d4437 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:12.777951 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-c241a826-09b5-4ac3-9e27-625d338d4437 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lazy-loading 'fault' on Instance uuid 94e8c141-ef33-4bb2-929f-7f7d0d10ff2c {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:39:12.786386 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b4689a0a-b709-4b82-b4d3-237acdc456d9 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6477e60b54491baff0a7dbee062ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc56537160d349aab8f5e6499ca8ab99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:12.797800 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b4689a0a-b709-4b82-b4d3-237acdc456d9 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] 10.222.0.33 "GET /compute/v2.1/servers/7cc18563-ad1f-4050-818b-880782814c23" status: 200 len: 1269 microversion: 2.1 time: 0.228009 Sep 23 04:39:12.798749 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1106/2168] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:12 2022] GET /compute/v2.1/servers/7cc18563-ad1f-4050-818b-880782814c23 => generated 1269 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:12.803549 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-04f1e0b4-7465-461d-9e1d-68e8a1c92b53 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:12.804414 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-04f1e0b4-7465-461d-9e1d-68e8a1c92b53 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] [instance: 94fc4134-9b8e-4dcd-bd96-5545bfd51c97] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:12.811283 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-04f1e0b4-7465-461d-9e1d-68e8a1c92b53 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:12.812571 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-04f1e0b4-7465-461d-9e1d-68e8a1c92b53 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:12.813145 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-04f1e0b4-7465-461d-9e1d-68e8a1c92b53 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:12.814032 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-04f1e0b4-7465-461d-9e1d-68e8a1c92b53 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:12.814627 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-04f1e0b4-7465-461d-9e1d-68e8a1c92b53 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:12.815188 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-04f1e0b4-7465-461d-9e1d-68e8a1c92b53 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:12.850201 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c241a826-09b5-4ac3-9e27-625d338d4437 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1244f3db540441a28d8413e510cfccad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b412c874d4e668b4a1a33dedb2c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:12.868015 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c241a826-09b5-4ac3-9e27-625d338d4437 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] 10.222.0.33 "GET /compute/v2.1/servers/94e8c141-ef33-4bb2-929f-7f7d0d10ff2c" status: 200 len: 1310 microversion: 2.1 time: 0.146463 Sep 23 04:39:12.872418 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1063/2169] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:12 2022] GET /compute/v2.1/servers/94e8c141-ef33-4bb2-929f-7f7d0d10ff2c => generated 1310 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:12.884495 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-5c12c8da-1a99-4198-b477-8efbaca57470 req-e8871e24-e27a-4499-b8c0-3e6adfbafc59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1180ceb9-a888-4a3b-ba9d-a35afa8dc279", "name": "network-vif-unplugged", "status": "completed", "tag": "5c735cca-a034-4fe0-b71e-1857868758c7"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:39:12.908427 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-5c12c8da-1a99-4198-b477-8efbaca57470 req-e8871e24-e27a-4499-b8c0-3e6adfbafc59 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:12.919496 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-5c12c8da-1a99-4198-b477-8efbaca57470 req-e8871e24-e27a-4499-b8c0-3e6adfbafc59 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:12.919496 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-5c12c8da-1a99-4198-b477-8efbaca57470 req-e8871e24-e27a-4499-b8c0-3e6adfbafc59 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:12.943844 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-5c12c8da-1a99-4198-b477-8efbaca57470 req-e8871e24-e27a-4499-b8c0-3e6adfbafc59 service nova] Creating event network-vif-unplugged:5c735cca-a034-4fe0-b71e-1857868758c7 for instance 1180ceb9-a888-4a3b-ba9d-a35afa8dc279 on n-h1-846463-3 Sep 23 04:39:12.954447 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-5c12c8da-1a99-4198-b477-8efbaca57470 req-e8871e24-e27a-4499-b8c0-3e6adfbafc59 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.080342 Sep 23 04:39:12.958707 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1064/2170] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:39:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:39:12.978695 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-04f1e0b4-7465-461d-9e1d-68e8a1c92b53 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lazy-loading 'services' on Instance uuid 94fc4134-9b8e-4dcd-bd96-5545bfd51c97 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:39:13.005376 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-04f1e0b4-7465-461d-9e1d-68e8a1c92b53 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97" status: 200 len: 1929 microversion: 2.75 time: 0.205253 Sep 23 04:39:13.006164 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1107/2171] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:39:12 2022] GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97 => generated 1929 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:39:13.589475 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e2031941-53dd-4fe8-9259-bf9f63cdaba3 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:13.590036 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1f07e303-76af-4261-9c4f-f1e3e8040801 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:13.590366 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e2031941-53dd-4fe8-9259-bf9f63cdaba3 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 1180ceb9-a888-4a3b-ba9d-a35afa8dc279] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:13.590612 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-1f07e303-76af-4261-9c4f-f1e3e8040801 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: aa35cea0-4f7f-4d03-9436-f15264b9f713] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:13.597430 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e2031941-53dd-4fe8-9259-bf9f63cdaba3 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:13.597997 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e2031941-53dd-4fe8-9259-bf9f63cdaba3 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:13.604721 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1f07e303-76af-4261-9c4f-f1e3e8040801 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:13.605523 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e2031941-53dd-4fe8-9259-bf9f63cdaba3 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:13.605825 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1f07e303-76af-4261-9c4f-f1e3e8040801 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:13.606313 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e2031941-53dd-4fe8-9259-bf9f63cdaba3 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:13.609248 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e2031941-53dd-4fe8-9259-bf9f63cdaba3 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:13.609869 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e2031941-53dd-4fe8-9259-bf9f63cdaba3 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:13.614691 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1f07e303-76af-4261-9c4f-f1e3e8040801 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:13.615481 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1f07e303-76af-4261-9c4f-f1e3e8040801 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:13.616531 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1f07e303-76af-4261-9c4f-f1e3e8040801 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:13.617007 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1f07e303-76af-4261-9c4f-f1e3e8040801 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:13.633253 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:39:13.692273 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e2031941-53dd-4fe8-9259-bf9f63cdaba3 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:13.703668 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e2031941-53dd-4fe8-9259-bf9f63cdaba3 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/1180ceb9-a888-4a3b-ba9d-a35afa8dc279" status: 200 len: 1431 microversion: 2.1 time: 0.118183 Sep 23 04:39:13.704828 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1108/2172] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:13 2022] GET /compute/v2.1/servers/1180ceb9-a888-4a3b-ba9d-a35afa8dc279 => generated 1431 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:39:13.711342 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-316bef98-b015-4b76-821c-809cb7b3cf38 req-c2e48c22-e9a5-44ce-a312-ba151c1b3a0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1180ceb9-a888-4a3b-ba9d-a35afa8dc279", "name": "network-vif-deleted", "tag": "5c735cca-a034-4fe0-b71e-1857868758c7"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:39:13.719740 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:39:13.724671 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-316bef98-b015-4b76-821c-809cb7b3cf38 req-c2e48c22-e9a5-44ce-a312-ba151c1b3a0f service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:13.725590 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-316bef98-b015-4b76-821c-809cb7b3cf38 req-c2e48c22-e9a5-44ce-a312-ba151c1b3a0f service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:13.726465 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-316bef98-b015-4b76-821c-809cb7b3cf38 req-c2e48c22-e9a5-44ce-a312-ba151c1b3a0f service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:13.743659 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-316bef98-b015-4b76-821c-809cb7b3cf38 req-c2e48c22-e9a5-44ce-a312-ba151c1b3a0f service nova] Creating event network-vif-deleted:5c735cca-a034-4fe0-b71e-1857868758c7 for instance 1180ceb9-a888-4a3b-ba9d-a35afa8dc279 on n-h1-846463-3 Sep 23 04:39:13.755755 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-316bef98-b015-4b76-821c-809cb7b3cf38 req-c2e48c22-e9a5-44ce-a312-ba151c1b3a0f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049505 Sep 23 04:39:13.756752 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1109/2173] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:39:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:39:13.763289 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-478ce274-793e-4906-8b10-ade7da6c4e33 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:13.764279 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-478ce274-793e-4906-8b10-ade7da6c4e33 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:13.773030 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-478ce274-793e-4906-8b10-ade7da6c4e33 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:13.773561 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-478ce274-793e-4906-8b10-ade7da6c4e33 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:13.774084 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-478ce274-793e-4906-8b10-ade7da6c4e33 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:13.775020 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-478ce274-793e-4906-8b10-ade7da6c4e33 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:13.775483 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-478ce274-793e-4906-8b10-ade7da6c4e33 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:13.775910 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-478ce274-793e-4906-8b10-ade7da6c4e33 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:13.818133 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-1f07e303-76af-4261-9c4f-f1e3e8040801 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:13.826749 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-1f07e303-76af-4261-9c4f-f1e3e8040801 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713" status: 200 len: 1199 microversion: 2.1 time: 0.242456 Sep 23 04:39:13.838944 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1065/2174] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:13 2022] GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713 => generated 1199 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:13.842117 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2785147f-8e21-4d7e-bf06-03062b6d6b3e tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:13.843371 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-2785147f-8e21-4d7e-bf06-03062b6d6b3e tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] [instance: 7cc18563-ad1f-4050-818b-880782814c23] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:13.853092 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2785147f-8e21-4d7e-bf06-03062b6d6b3e tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:13.853597 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2785147f-8e21-4d7e-bf06-03062b6d6b3e tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:13.854070 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2785147f-8e21-4d7e-bf06-03062b6d6b3e tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:13.858955 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-478ce274-793e-4906-8b10-ade7da6c4e33 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:13.869745 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2785147f-8e21-4d7e-bf06-03062b6d6b3e tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:13.870316 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2785147f-8e21-4d7e-bf06-03062b6d6b3e tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:13.870762 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2785147f-8e21-4d7e-bf06-03062b6d6b3e tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:13.873604 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-478ce274-793e-4906-8b10-ade7da6c4e33 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6" status: 200 len: 1273 microversion: 2.1 time: 0.115568 Sep 23 04:39:13.878594 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1110/2175] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:13 2022] GET /compute/v2.1/servers/cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6 => generated 1273 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:13.899794 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-61e4aa5f-e8f5-4048-a30d-75087d6334d3 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:13.900428 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-61e4aa5f-e8f5-4048-a30d-75087d6334d3 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] [instance: 94e8c141-ef33-4bb2-929f-7f7d0d10ff2c] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:13.929254 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-61e4aa5f-e8f5-4048-a30d-75087d6334d3 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:13.930240 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-61e4aa5f-e8f5-4048-a30d-75087d6334d3 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:13.930344 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-61e4aa5f-e8f5-4048-a30d-75087d6334d3 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:13.934501 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-61e4aa5f-e8f5-4048-a30d-75087d6334d3 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:13.942784 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-61e4aa5f-e8f5-4048-a30d-75087d6334d3 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:13.943247 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-61e4aa5f-e8f5-4048-a30d-75087d6334d3 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:13.967335 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-61e4aa5f-e8f5-4048-a30d-75087d6334d3 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] HTTP exception thrown: Instance 94e8c141-ef33-4bb2-929f-7f7d0d10ff2c could not be found. Sep 23 04:39:13.969505 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-61e4aa5f-e8f5-4048-a30d-75087d6334d3 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Request method failure captured: Sep 23 04:39:13.969505 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/94e8c141-ef33-4bb2-929f-7f7d0d10ff2c HTTP/1.1 Sep 23 04:39:13.969505 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:39:13.969505 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:39:13.969505 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:39:13.969505 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:39:13.969505 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:39:13.969505 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:39:13.969505 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:39:13.969505 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:39:13.969505 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTgWByaYCNfiozp93GTtCpOkF_ZetaRjW-aEvVvDqWh2DMrlv1lso1NTsSgjh1ZvSdLlP-vsw3YDLCoS9_gyATagJR0jnHvxte6MbAT0tODvhSTaSyG8K-2FwzCK5EL3rUxCawsMEMDi_tXXiIVJo_iG9cqKTH-fC_8VFyEnqeiI-38 Sep 23 04:39:13.969505 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:39:13.969505 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:39:13.969505 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:39:13.969505 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:39:13.969505 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:39:13.969505 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:39:13.969505 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 721b412c874d4e668b4a1a33dedb2c9b Sep 23 04:39:13.969505 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ListServerFiltersTestJSON-25983859 Sep 23 04:39:13.969505 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:39:13.969505 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:39:13.969505 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_721b412c874d4e668b4a1a33dedb2c9b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/721b412c874d4e668b4a1a33dedb2c9b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/721b412c874d4e668b4a1a33dedb2c9b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/721b412c874d4e668b4a1a33dedb2c9b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:39:13.969505 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ListServerFiltersTestJSON-25983859 Sep 23 04:39:13.969505 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 721b412c874d4e668b4a1a33dedb2c9b Sep 23 04:39:13.969505 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-25983859 Sep 23 04:39:13.969505 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ListServerFiltersTestJSON-25983859-project Sep 23 04:39:13.969505 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:39:13.969505 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:39:13.969505 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 1244f3db540441a28d8413e510cfccad Sep 23 04:39:13.969505 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ListServerFiltersTestJSON-25983859-project Sep 23 04:39:13.969505 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:39:13.969505 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 94e8c141-ef33-4bb2-929f-7f7d0d10ff2c could not be found. Sep 23 04:39:13.969505 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '94e8c141-ef33-4bb2-929f-7f7d0d10ff2c'} Sep 23 04:39:13.969505 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:39:13.969505 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:39:13.969505 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:39:13.969505 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:39:13.969505 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:39:13.969505 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:39:13.969505 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:39:13.969505 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:39:13.969505 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:39:13.969505 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:39:13.969505 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94e8c141-ef33-4bb2-929f-7f7d0d10ff2c could not be found. Sep 23 04:39:13.969505 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:39:13.969505 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:39:13.969505 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:39:13.969505 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:39:13.969505 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:39:13.969505 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:39:13.969505 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:39:13.969505 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:39:13.969505 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:39:13.969505 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:39:13.969505 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:39:13.969505 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:39:13.969505 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:39:13.969505 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:39:13.969505 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:39:13.969505 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:39:13.969505 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94e8c141-ef33-4bb2-929f-7f7d0d10ff2c could not be found. Sep 23 04:39:13.969505 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:39:13.969505 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:39:13.969505 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:39:13.973415 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:39:13.973415 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:39:13.973415 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:39:13.973415 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:39:13.973415 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:39:13.973415 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94e8c141-ef33-4bb2-929f-7f7d0d10ff2c could not be found. Sep 23 04:39:13.973415 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:39:13.983130 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-61e4aa5f-e8f5-4048-a30d-75087d6334d3 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Returning 404 to user: Instance 94e8c141-ef33-4bb2-929f-7f7d0d10ff2c could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:39:13.985219 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-61e4aa5f-e8f5-4048-a30d-75087d6334d3 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] 10.222.0.33 "GET /compute/v2.1/servers/94e8c141-ef33-4bb2-929f-7f7d0d10ff2c" status: 404 len: 111 microversion: 2.1 time: 0.093385 Sep 23 04:39:13.988746 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1111/2176] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:13 2022] GET /compute/v2.1/servers/94e8c141-ef33-4bb2-929f-7f7d0d10ff2c => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 04:39:13.994152 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-aee28162-1068-49a2-8552-45f05f87266c tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:13.998246 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-aee28162-1068-49a2-8552-45f05f87266c tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] [instance: 7e90c852-5f27-4861-9b25-9ea1e475c0a9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:14.007729 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aee28162-1068-49a2-8552-45f05f87266c tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:14.008236 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aee28162-1068-49a2-8552-45f05f87266c tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:14.008682 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aee28162-1068-49a2-8552-45f05f87266c tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:14.009406 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aee28162-1068-49a2-8552-45f05f87266c tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:14.009868 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aee28162-1068-49a2-8552-45f05f87266c tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:14.010328 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aee28162-1068-49a2-8552-45f05f87266c tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:14.016045 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-2785147f-8e21-4d7e-bf06-03062b6d6b3e tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6477e60b54491baff0a7dbee062ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc56537160d349aab8f5e6499ca8ab99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:14.025813 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2785147f-8e21-4d7e-bf06-03062b6d6b3e tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] 10.222.0.33 "GET /compute/v2.1/servers/7cc18563-ad1f-4050-818b-880782814c23" status: 200 len: 1275 microversion: 2.1 time: 0.196954 Sep 23 04:39:14.028790 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1066/2177] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:13 2022] GET /compute/v2.1/servers/7cc18563-ad1f-4050-818b-880782814c23 => generated 1275 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:14.036200 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e654b020-7d98-422d-8b06-4e2746149440 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:14.038417 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e654b020-7d98-422d-8b06-4e2746149440 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] [instance: 94fc4134-9b8e-4dcd-bd96-5545bfd51c97] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:14.049688 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e654b020-7d98-422d-8b06-4e2746149440 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:14.050373 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e654b020-7d98-422d-8b06-4e2746149440 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:14.050922 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e654b020-7d98-422d-8b06-4e2746149440 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:14.051910 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e654b020-7d98-422d-8b06-4e2746149440 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:14.052327 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e654b020-7d98-422d-8b06-4e2746149440 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:14.052764 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e654b020-7d98-422d-8b06-4e2746149440 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:14.055217 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-aee28162-1068-49a2-8552-45f05f87266c tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] [instance: 7e90c852-5f27-4861-9b25-9ea1e475c0a9] Going to try to terminate instance {{(pid=122699) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:39:14.072934 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=100 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:39:14.151829 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-e654b020-7d98-422d-8b06-4e2746149440 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lazy-loading 'services' on Instance uuid 94fc4134-9b8e-4dcd-bd96-5545bfd51c97 {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:39:14.172219 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e654b020-7d98-422d-8b06-4e2746149440 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97" status: 200 len: 1929 microversion: 2.75 time: 0.141910 Sep 23 04:39:14.172887 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1067/2178] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:39:14 2022] GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97 => generated 1929 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:39:14.465318 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-aee28162-1068-49a2-8552-45f05f87266c tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] 10.222.0.33 "DELETE /compute/v2.1/servers/7e90c852-5f27-4861-9b25-9ea1e475c0a9" status: 204 len: 0 microversion: 2.1 time: 0.474831 Sep 23 04:39:14.465872 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1112/2179] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:39:13 2022] DELETE /compute/v2.1/servers/7e90c852-5f27-4861-9b25-9ea1e475c0a9 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 23 04:39:14.475172 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ee1c2249-cf4e-4deb-b05f-1ecda4f7079a tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:14.475878 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-ee1c2249-cf4e-4deb-b05f-1ecda4f7079a tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] [instance: 7e90c852-5f27-4861-9b25-9ea1e475c0a9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:14.487886 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ee1c2249-cf4e-4deb-b05f-1ecda4f7079a tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:14.488425 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ee1c2249-cf4e-4deb-b05f-1ecda4f7079a tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:14.489850 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ee1c2249-cf4e-4deb-b05f-1ecda4f7079a tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:14.493678 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ee1c2249-cf4e-4deb-b05f-1ecda4f7079a tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:14.493678 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ee1c2249-cf4e-4deb-b05f-1ecda4f7079a tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:14.493678 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ee1c2249-cf4e-4deb-b05f-1ecda4f7079a tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:14.666332 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ee1c2249-cf4e-4deb-b05f-1ecda4f7079a tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1244f3db540441a28d8413e510cfccad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b412c874d4e668b4a1a33dedb2c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:14.674884 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ee1c2249-cf4e-4deb-b05f-1ecda4f7079a tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] 10.222.0.33 "GET /compute/v2.1/servers/7e90c852-5f27-4861-9b25-9ea1e475c0a9" status: 200 len: 1518 microversion: 2.1 time: 0.204253 Sep 23 04:39:14.689914 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1068/2180] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:14 2022] GET /compute/v2.1/servers/7e90c852-5f27-4861-9b25-9ea1e475c0a9 => generated 1518 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:14.731553 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-fe7b5969-753b-420d-a5be-6efe9ac3dad1 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:14.731553 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-fe7b5969-753b-420d-a5be-6efe9ac3dad1 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 1180ceb9-a888-4a3b-ba9d-a35afa8dc279] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:14.743789 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fe7b5969-753b-420d-a5be-6efe9ac3dad1 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:14.744581 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fe7b5969-753b-420d-a5be-6efe9ac3dad1 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:14.745252 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fe7b5969-753b-420d-a5be-6efe9ac3dad1 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:14.746229 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fe7b5969-753b-420d-a5be-6efe9ac3dad1 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:14.746921 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fe7b5969-753b-420d-a5be-6efe9ac3dad1 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:14.747745 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fe7b5969-753b-420d-a5be-6efe9ac3dad1 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:14.787223 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fe7b5969-753b-420d-a5be-6efe9ac3dad1 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:14.788266 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fe7b5969-753b-420d-a5be-6efe9ac3dad1 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:14.789083 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fe7b5969-753b-420d-a5be-6efe9ac3dad1 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:14.789766 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-fe7b5969-753b-420d-a5be-6efe9ac3dad1 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lazy-loading 'fault' on Instance uuid 1180ceb9-a888-4a3b-ba9d-a35afa8dc279 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:39:14.851195 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-cf2c253b-198f-4d28-bae1-371d1f729607 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:14.851769 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-fe7b5969-753b-420d-a5be-6efe9ac3dad1 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:14.855608 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-cf2c253b-198f-4d28-bae1-371d1f729607 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: aa35cea0-4f7f-4d03-9436-f15264b9f713] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:14.870695 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cf2c253b-198f-4d28-bae1-371d1f729607 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:14.871363 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cf2c253b-198f-4d28-bae1-371d1f729607 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:14.872305 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-fe7b5969-753b-420d-a5be-6efe9ac3dad1 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/1180ceb9-a888-4a3b-ba9d-a35afa8dc279" status: 200 len: 1307 microversion: 2.1 time: 0.141981 Sep 23 04:39:14.872943 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1113/2181] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:14 2022] GET /compute/v2.1/servers/1180ceb9-a888-4a3b-ba9d-a35afa8dc279 => generated 1307 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:14.873180 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cf2c253b-198f-4d28-bae1-371d1f729607 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:14.874479 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cf2c253b-198f-4d28-bae1-371d1f729607 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:14.874951 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cf2c253b-198f-4d28-bae1-371d1f729607 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:14.875381 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cf2c253b-198f-4d28-bae1-371d1f729607 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:14.908352 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0b125e22-0e41-4d21-b0bd-7666aa55c220 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:14.909374 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-0b125e22-0e41-4d21-b0bd-7666aa55c220 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:14.916516 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0b125e22-0e41-4d21-b0bd-7666aa55c220 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:14.917358 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0b125e22-0e41-4d21-b0bd-7666aa55c220 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:14.917973 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0b125e22-0e41-4d21-b0bd-7666aa55c220 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:14.919002 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0b125e22-0e41-4d21-b0bd-7666aa55c220 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:14.919659 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0b125e22-0e41-4d21-b0bd-7666aa55c220 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:14.920412 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0b125e22-0e41-4d21-b0bd-7666aa55c220 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:15.100075 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-cf2c253b-198f-4d28-bae1-371d1f729607 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:15.109081 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-cf2c253b-198f-4d28-bae1-371d1f729607 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713" status: 200 len: 1199 microversion: 2.1 time: 0.261405 Sep 23 04:39:15.114107 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1069/2182] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:14 2022] GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713 => generated 1199 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:15.115307 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e3402212-3c9e-4ac5-a975-14d9d3af9d4f tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:15.115925 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e3402212-3c9e-4ac5-a975-14d9d3af9d4f tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] [instance: 7cc18563-ad1f-4050-818b-880782814c23] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:15.138654 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-0b125e22-0e41-4d21-b0bd-7666aa55c220 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:15.144357 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e3402212-3c9e-4ac5-a975-14d9d3af9d4f tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:15.145648 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e3402212-3c9e-4ac5-a975-14d9d3af9d4f tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:15.146107 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e3402212-3c9e-4ac5-a975-14d9d3af9d4f tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:15.152009 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e3402212-3c9e-4ac5-a975-14d9d3af9d4f tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:15.152009 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e3402212-3c9e-4ac5-a975-14d9d3af9d4f tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:15.152009 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e3402212-3c9e-4ac5-a975-14d9d3af9d4f tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:15.152332 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0b125e22-0e41-4d21-b0bd-7666aa55c220 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6" status: 200 len: 1315 microversion: 2.1 time: 0.247151 Sep 23 04:39:15.152332 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1114/2183] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:14 2022] GET /compute/v2.1/servers/cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6 => generated 1315 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:39:15.204679 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ce3af210-9b9f-4fd2-bdb6-d2c1bc0dd179 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:15.205583 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ce3af210-9b9f-4fd2-bdb6-d2c1bc0dd179 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] [instance: 94fc4134-9b8e-4dcd-bd96-5545bfd51c97] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:15.217309 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ce3af210-9b9f-4fd2-bdb6-d2c1bc0dd179 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:15.218150 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ce3af210-9b9f-4fd2-bdb6-d2c1bc0dd179 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:15.218845 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ce3af210-9b9f-4fd2-bdb6-d2c1bc0dd179 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:15.219289 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ce3af210-9b9f-4fd2-bdb6-d2c1bc0dd179 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:15.219769 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ce3af210-9b9f-4fd2-bdb6-d2c1bc0dd179 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:15.220390 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ce3af210-9b9f-4fd2-bdb6-d2c1bc0dd179 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:15.332202 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-ce3af210-9b9f-4fd2-bdb6-d2c1bc0dd179 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lazy-loading 'services' on Instance uuid 94fc4134-9b8e-4dcd-bd96-5545bfd51c97 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:39:15.355061 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e3402212-3c9e-4ac5-a975-14d9d3af9d4f tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6477e60b54491baff0a7dbee062ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc56537160d349aab8f5e6499ca8ab99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:15.357244 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ce3af210-9b9f-4fd2-bdb6-d2c1bc0dd179 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97" status: 200 len: 1929 microversion: 2.75 time: 0.162020 Sep 23 04:39:15.365987 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1115/2184] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:39:15 2022] GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97 => generated 1929 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:39:15.366139 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e3402212-3c9e-4ac5-a975-14d9d3af9d4f tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] 10.222.0.33 "GET /compute/v2.1/servers/7cc18563-ad1f-4050-818b-880782814c23" status: 200 len: 1317 microversion: 2.1 time: 0.252619 Sep 23 04:39:15.366139 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1070/2185] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:15 2022] GET /compute/v2.1/servers/7cc18563-ad1f-4050-818b-880782814c23 => generated 1317 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:15.701549 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5e9d8f0f-19be-426e-b515-4c04404d184d tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:15.702979 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-5e9d8f0f-19be-426e-b515-4c04404d184d tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] [instance: 7e90c852-5f27-4861-9b25-9ea1e475c0a9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:15.709005 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5e9d8f0f-19be-426e-b515-4c04404d184d tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:15.709498 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5e9d8f0f-19be-426e-b515-4c04404d184d tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:15.709964 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5e9d8f0f-19be-426e-b515-4c04404d184d tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:15.710670 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5e9d8f0f-19be-426e-b515-4c04404d184d tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:15.711139 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5e9d8f0f-19be-426e-b515-4c04404d184d tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:15.711558 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5e9d8f0f-19be-426e-b515-4c04404d184d tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:15.871155 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-5e9d8f0f-19be-426e-b515-4c04404d184d tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1244f3db540441a28d8413e510cfccad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b412c874d4e668b4a1a33dedb2c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:15.879288 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5e9d8f0f-19be-426e-b515-4c04404d184d tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] 10.222.0.33 "GET /compute/v2.1/servers/7e90c852-5f27-4861-9b25-9ea1e475c0a9" status: 200 len: 1518 microversion: 2.1 time: 0.182523 Sep 23 04:39:15.880320 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1116/2186] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:15 2022] GET /compute/v2.1/servers/7e90c852-5f27-4861-9b25-9ea1e475c0a9 => generated 1518 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:15.901701 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-1af33573-45c7-41e4-b7c7-a97d6c5aec48 req-44b77efc-632b-4ff3-8acb-fe5d85187e5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6", "tag": "c738b507-0460-44ab-8aa6-5019592de190"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:39:15.907069 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-daa74571-2284-44a9-b462-0fdfe10241de tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:15.907838 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-daa74571-2284-44a9-b462-0fdfe10241de tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 1180ceb9-a888-4a3b-ba9d-a35afa8dc279] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:15.913652 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-1af33573-45c7-41e4-b7c7-a97d6c5aec48 req-44b77efc-632b-4ff3-8acb-fe5d85187e5a service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:15.914141 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-1af33573-45c7-41e4-b7c7-a97d6c5aec48 req-44b77efc-632b-4ff3-8acb-fe5d85187e5a service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:15.914637 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-1af33573-45c7-41e4-b7c7-a97d6c5aec48 req-44b77efc-632b-4ff3-8acb-fe5d85187e5a service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:15.917449 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-daa74571-2284-44a9-b462-0fdfe10241de tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:15.918062 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-daa74571-2284-44a9-b462-0fdfe10241de tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:15.919964 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-daa74571-2284-44a9-b462-0fdfe10241de tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:15.920302 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-daa74571-2284-44a9-b462-0fdfe10241de tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:15.920904 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-daa74571-2284-44a9-b462-0fdfe10241de tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:15.921451 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-daa74571-2284-44a9-b462-0fdfe10241de tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:15.927348 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-1af33573-45c7-41e4-b7c7-a97d6c5aec48 req-44b77efc-632b-4ff3-8acb-fe5d85187e5a service nova] Creating event network-changed:c738b507-0460-44ab-8aa6-5019592de190 for instance cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6 on n-h2-846463-3 Sep 23 04:39:15.932412 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-1af33573-45c7-41e4-b7c7-a97d6c5aec48 req-44b77efc-632b-4ff3-8acb-fe5d85187e5a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034219 Sep 23 04:39:15.933022 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1117/2187] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:39:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:39:15.962919 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-daa74571-2284-44a9-b462-0fdfe10241de tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:15.963422 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-daa74571-2284-44a9-b462-0fdfe10241de tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:15.963859 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-daa74571-2284-44a9-b462-0fdfe10241de tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:15.964594 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-daa74571-2284-44a9-b462-0fdfe10241de tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lazy-loading 'fault' on Instance uuid 1180ceb9-a888-4a3b-ba9d-a35afa8dc279 {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:39:16.013421 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-daa74571-2284-44a9-b462-0fdfe10241de tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:16.023703 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-daa74571-2284-44a9-b462-0fdfe10241de tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/1180ceb9-a888-4a3b-ba9d-a35afa8dc279" status: 200 len: 1307 microversion: 2.1 time: 0.129765 Sep 23 04:39:16.024301 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1071/2188] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:15 2022] GET /compute/v2.1/servers/1180ceb9-a888-4a3b-ba9d-a35afa8dc279 => generated 1307 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:16.138972 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b1c3309c-27d0-42c6-9872-b1e81cbeb1f7 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:16.138972 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b1c3309c-27d0-42c6-9872-b1e81cbeb1f7 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: aa35cea0-4f7f-4d03-9436-f15264b9f713] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:16.143554 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b1c3309c-27d0-42c6-9872-b1e81cbeb1f7 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:16.144133 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b1c3309c-27d0-42c6-9872-b1e81cbeb1f7 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:16.167914 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b1c3309c-27d0-42c6-9872-b1e81cbeb1f7 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:16.169191 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b1c3309c-27d0-42c6-9872-b1e81cbeb1f7 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:16.169693 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b1c3309c-27d0-42c6-9872-b1e81cbeb1f7 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:16.170969 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b1c3309c-27d0-42c6-9872-b1e81cbeb1f7 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:16.176416 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d6eb41b3-6b2b-4eda-94f5-60e7673414c0 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:16.177116 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d6eb41b3-6b2b-4eda-94f5-60e7673414c0 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:16.189635 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d6eb41b3-6b2b-4eda-94f5-60e7673414c0 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:16.190244 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d6eb41b3-6b2b-4eda-94f5-60e7673414c0 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:16.190858 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d6eb41b3-6b2b-4eda-94f5-60e7673414c0 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:16.191919 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d6eb41b3-6b2b-4eda-94f5-60e7673414c0 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:16.193829 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d6eb41b3-6b2b-4eda-94f5-60e7673414c0 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:16.195342 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d6eb41b3-6b2b-4eda-94f5-60e7673414c0 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:16.439890 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d6eb41b3-6b2b-4eda-94f5-60e7673414c0 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:16.446682 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b1c3309c-27d0-42c6-9872-b1e81cbeb1f7 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:16.457384 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b1c3309c-27d0-42c6-9872-b1e81cbeb1f7 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713" status: 200 len: 1199 microversion: 2.1 time: 0.327703 Sep 23 04:39:16.458566 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1118/2189] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:16 2022] GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713 => generated 1199 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:39:16.459800 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d6eb41b3-6b2b-4eda-94f5-60e7673414c0 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6" status: 200 len: 1315 microversion: 2.1 time: 0.290198 Sep 23 04:39:16.469716 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1072/2190] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:16 2022] GET /compute/v2.1/servers/cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6 => generated 1315 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:39:16.469716 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0640b722-274d-4453-aba8-ade79ec88b4e tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:16.469716 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-0640b722-274d-4453-aba8-ade79ec88b4e tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] [instance: 7cc18563-ad1f-4050-818b-880782814c23] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:16.475678 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0640b722-274d-4453-aba8-ade79ec88b4e tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:16.476430 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0640b722-274d-4453-aba8-ade79ec88b4e tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:16.476967 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0640b722-274d-4453-aba8-ade79ec88b4e tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:16.477875 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0640b722-274d-4453-aba8-ade79ec88b4e tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:16.478418 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0640b722-274d-4453-aba8-ade79ec88b4e tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:16.478851 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0640b722-274d-4453-aba8-ade79ec88b4e tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:16.495633 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-bbcbf6b1-bfb0-4d6e-bf34-61bac02307d9 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:16.496262 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-bbcbf6b1-bfb0-4d6e-bf34-61bac02307d9 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] [instance: 94fc4134-9b8e-4dcd-bd96-5545bfd51c97] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:16.509271 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bbcbf6b1-bfb0-4d6e-bf34-61bac02307d9 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:16.510051 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bbcbf6b1-bfb0-4d6e-bf34-61bac02307d9 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:16.510834 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bbcbf6b1-bfb0-4d6e-bf34-61bac02307d9 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:16.512527 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bbcbf6b1-bfb0-4d6e-bf34-61bac02307d9 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:16.513177 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bbcbf6b1-bfb0-4d6e-bf34-61bac02307d9 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:16.513781 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bbcbf6b1-bfb0-4d6e-bf34-61bac02307d9 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:16.639435 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-bbcbf6b1-bfb0-4d6e-bf34-61bac02307d9 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lazy-loading 'services' on Instance uuid 94fc4134-9b8e-4dcd-bd96-5545bfd51c97 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:39:16.661348 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-bbcbf6b1-bfb0-4d6e-bf34-61bac02307d9 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97" status: 200 len: 1929 microversion: 2.75 time: 0.173438 Sep 23 04:39:16.662081 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1119/2191] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:39:16 2022] GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97 => generated 1929 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:39:16.709556 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-0640b722-274d-4453-aba8-ade79ec88b4e tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6477e60b54491baff0a7dbee062ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc56537160d349aab8f5e6499ca8ab99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:16.722456 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0640b722-274d-4453-aba8-ade79ec88b4e tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] 10.222.0.33 "GET /compute/v2.1/servers/7cc18563-ad1f-4050-818b-880782814c23" status: 200 len: 1317 microversion: 2.1 time: 0.259967 Sep 23 04:39:16.739140 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1073/2192] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:16 2022] GET /compute/v2.1/servers/7cc18563-ad1f-4050-818b-880782814c23 => generated 1317 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:16.905629 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b0255b44-3d9b-46bc-9787-abda89e67601 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:16.906291 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b0255b44-3d9b-46bc-9787-abda89e67601 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] [instance: 7e90c852-5f27-4861-9b25-9ea1e475c0a9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:16.913197 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b0255b44-3d9b-46bc-9787-abda89e67601 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:16.913694 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b0255b44-3d9b-46bc-9787-abda89e67601 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:16.914167 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b0255b44-3d9b-46bc-9787-abda89e67601 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:16.915048 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b0255b44-3d9b-46bc-9787-abda89e67601 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:16.915510 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b0255b44-3d9b-46bc-9787-abda89e67601 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:16.915943 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b0255b44-3d9b-46bc-9787-abda89e67601 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:17.047071 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ec4233ea-67f4-4ed4-a338-11a21d0e2ed4 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:17.047697 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-ec4233ea-67f4-4ed4-a338-11a21d0e2ed4 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 1180ceb9-a888-4a3b-ba9d-a35afa8dc279] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:17.055639 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ec4233ea-67f4-4ed4-a338-11a21d0e2ed4 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:17.055639 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ec4233ea-67f4-4ed4-a338-11a21d0e2ed4 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:17.055807 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ec4233ea-67f4-4ed4-a338-11a21d0e2ed4 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:17.056454 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ec4233ea-67f4-4ed4-a338-11a21d0e2ed4 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:17.056839 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ec4233ea-67f4-4ed4-a338-11a21d0e2ed4 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:17.057495 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ec4233ea-67f4-4ed4-a338-11a21d0e2ed4 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:17.084243 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b0255b44-3d9b-46bc-9787-abda89e67601 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1244f3db540441a28d8413e510cfccad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b412c874d4e668b4a1a33dedb2c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:17.092007 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ec4233ea-67f4-4ed4-a338-11a21d0e2ed4 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:17.093119 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b0255b44-3d9b-46bc-9787-abda89e67601 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] 10.222.0.33 "GET /compute/v2.1/servers/7e90c852-5f27-4861-9b25-9ea1e475c0a9" status: 200 len: 1518 microversion: 2.1 time: 0.192833 Sep 23 04:39:17.093458 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ec4233ea-67f4-4ed4-a338-11a21d0e2ed4 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:17.094086 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ec4233ea-67f4-4ed4-a338-11a21d0e2ed4 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:17.094681 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-ec4233ea-67f4-4ed4-a338-11a21d0e2ed4 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lazy-loading 'fault' on Instance uuid 1180ceb9-a888-4a3b-ba9d-a35afa8dc279 {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:39:17.113741 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1120/2193] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:16 2022] GET /compute/v2.1/servers/7e90c852-5f27-4861-9b25-9ea1e475c0a9 => generated 1518 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:17.139192 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ec4233ea-67f4-4ed4-a338-11a21d0e2ed4 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da08af8193dd490b93278385583f24c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5db359a60174c45afa2bf06e23a46c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:17.147485 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ec4233ea-67f4-4ed4-a338-11a21d0e2ed4 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/1180ceb9-a888-4a3b-ba9d-a35afa8dc279" status: 200 len: 1307 microversion: 2.1 time: 0.104848 Sep 23 04:39:17.148118 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1074/2194] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:17 2022] GET /compute/v2.1/servers/1180ceb9-a888-4a3b-ba9d-a35afa8dc279 => generated 1307 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:39:17.486182 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8cc2da73-6545-428a-b005-1bb451d0a02a tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:17.486934 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-8cc2da73-6545-428a-b005-1bb451d0a02a tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: aa35cea0-4f7f-4d03-9436-f15264b9f713] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:17.487310 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5f2da06a-37e7-465f-930d-9f633e4a30db tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:17.487946 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5f2da06a-37e7-465f-930d-9f633e4a30db tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:17.493623 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8cc2da73-6545-428a-b005-1bb451d0a02a tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:17.494506 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8cc2da73-6545-428a-b005-1bb451d0a02a tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:17.495169 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5f2da06a-37e7-465f-930d-9f633e4a30db tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:17.495283 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8cc2da73-6545-428a-b005-1bb451d0a02a tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:17.495671 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5f2da06a-37e7-465f-930d-9f633e4a30db tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:17.496114 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5f2da06a-37e7-465f-930d-9f633e4a30db tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:17.496297 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8cc2da73-6545-428a-b005-1bb451d0a02a tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:17.497152 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8cc2da73-6545-428a-b005-1bb451d0a02a tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:17.498223 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8cc2da73-6545-428a-b005-1bb451d0a02a tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:17.499149 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5f2da06a-37e7-465f-930d-9f633e4a30db tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:17.499704 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5f2da06a-37e7-465f-930d-9f633e4a30db tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:17.500153 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5f2da06a-37e7-465f-930d-9f633e4a30db tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:17.722156 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-8cc2da73-6545-428a-b005-1bb451d0a02a tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:17.725239 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-5f2da06a-37e7-465f-930d-9f633e4a30db tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:17.734248 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5f2da06a-37e7-465f-930d-9f633e4a30db tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6" status: 200 len: 1315 microversion: 2.1 time: 0.250306 Sep 23 04:39:17.735357 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1075/2195] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:17 2022] GET /compute/v2.1/servers/cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6 => generated 1315 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:17.751812 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-8cc2da73-6545-428a-b005-1bb451d0a02a tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713" status: 200 len: 1199 microversion: 2.1 time: 0.270854 Sep 23 04:39:17.753824 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8e0526c5-f1da-4c82-811b-fb2a13722b52 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:17.754947 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1121/2196] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:17 2022] GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713 => generated 1199 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:17.756635 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8e0526c5-f1da-4c82-811b-fb2a13722b52 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] [instance: 94fc4134-9b8e-4dcd-bd96-5545bfd51c97] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:17.760472 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-edbf00c5-7be1-4e44-9a2c-e8b22211679d tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:17.766857 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-edbf00c5-7be1-4e44-9a2c-e8b22211679d tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] [instance: 7cc18563-ad1f-4050-818b-880782814c23] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:17.772146 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8e0526c5-f1da-4c82-811b-fb2a13722b52 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:17.772899 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8e0526c5-f1da-4c82-811b-fb2a13722b52 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:17.773614 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8e0526c5-f1da-4c82-811b-fb2a13722b52 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:17.775652 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8e0526c5-f1da-4c82-811b-fb2a13722b52 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:17.776181 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8e0526c5-f1da-4c82-811b-fb2a13722b52 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:17.777572 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8e0526c5-f1da-4c82-811b-fb2a13722b52 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:17.784475 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-edbf00c5-7be1-4e44-9a2c-e8b22211679d tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:17.784475 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-edbf00c5-7be1-4e44-9a2c-e8b22211679d tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:17.784475 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-edbf00c5-7be1-4e44-9a2c-e8b22211679d tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:17.784475 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-edbf00c5-7be1-4e44-9a2c-e8b22211679d tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:17.785433 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-edbf00c5-7be1-4e44-9a2c-e8b22211679d tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:17.789329 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-edbf00c5-7be1-4e44-9a2c-e8b22211679d tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:17.913759 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-8e0526c5-f1da-4c82-811b-fb2a13722b52 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lazy-loading 'services' on Instance uuid 94fc4134-9b8e-4dcd-bd96-5545bfd51c97 {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:39:17.938938 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8e0526c5-f1da-4c82-811b-fb2a13722b52 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97" status: 200 len: 1929 microversion: 2.75 time: 0.202278 Sep 23 04:39:17.940408 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1076/2197] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:39:17 2022] GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97 => generated 1929 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:39:17.964705 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-99e06e50-2b8f-408d-a493-5bb730c35de9 req-8fbee716-ccea-4da6-a706-faf262565324 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cc18563-ad1f-4050-818b-880782814c23", "tag": "144b628b-c2cf-4574-a054-4e019408e692"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:39:17.976286 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-edbf00c5-7be1-4e44-9a2c-e8b22211679d tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6477e60b54491baff0a7dbee062ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc56537160d349aab8f5e6499ca8ab99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:17.983773 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-99e06e50-2b8f-408d-a493-5bb730c35de9 req-8fbee716-ccea-4da6-a706-faf262565324 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:17.984274 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-99e06e50-2b8f-408d-a493-5bb730c35de9 req-8fbee716-ccea-4da6-a706-faf262565324 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:17.984877 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-99e06e50-2b8f-408d-a493-5bb730c35de9 req-8fbee716-ccea-4da6-a706-faf262565324 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:17.985343 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-edbf00c5-7be1-4e44-9a2c-e8b22211679d tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] 10.222.0.33 "GET /compute/v2.1/servers/7cc18563-ad1f-4050-818b-880782814c23" status: 200 len: 1317 microversion: 2.1 time: 0.229406 Sep 23 04:39:17.986070 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1122/2198] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:17 2022] GET /compute/v2.1/servers/7cc18563-ad1f-4050-818b-880782814c23 => generated 1317 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:18.000582 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-99e06e50-2b8f-408d-a493-5bb730c35de9 req-8fbee716-ccea-4da6-a706-faf262565324 service nova] Creating event network-changed:144b628b-c2cf-4574-a054-4e019408e692 for instance 7cc18563-ad1f-4050-818b-880782814c23 on n-h2-846463-3 Sep 23 04:39:18.007289 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-99e06e50-2b8f-408d-a493-5bb730c35de9 req-8fbee716-ccea-4da6-a706-faf262565324 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050225 Sep 23 04:39:18.008121 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1077/2199] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:39:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:39:18.122157 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-71afa19d-01f9-4857-82fc-e765921e8ade tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:18.122157 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-71afa19d-01f9-4857-82fc-e765921e8ade tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] [instance: 7e90c852-5f27-4861-9b25-9ea1e475c0a9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:18.128126 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-71afa19d-01f9-4857-82fc-e765921e8ade tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:18.128632 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-71afa19d-01f9-4857-82fc-e765921e8ade tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:18.129077 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-71afa19d-01f9-4857-82fc-e765921e8ade tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:18.129958 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-71afa19d-01f9-4857-82fc-e765921e8ade tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:18.130423 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-71afa19d-01f9-4857-82fc-e765921e8ade tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:18.131031 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-71afa19d-01f9-4857-82fc-e765921e8ade tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:18.171465 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ff82f75e-37ed-4bc4-b7e9-420de9febda8 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:18.172181 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-ff82f75e-37ed-4bc4-b7e9-420de9febda8 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] [instance: 1180ceb9-a888-4a3b-ba9d-a35afa8dc279] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:18.180914 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ff82f75e-37ed-4bc4-b7e9-420de9febda8 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:18.181419 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ff82f75e-37ed-4bc4-b7e9-420de9febda8 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:18.181864 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ff82f75e-37ed-4bc4-b7e9-420de9febda8 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:18.182608 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ff82f75e-37ed-4bc4-b7e9-420de9febda8 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:18.183072 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ff82f75e-37ed-4bc4-b7e9-420de9febda8 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:18.183502 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ff82f75e-37ed-4bc4-b7e9-420de9febda8 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:18.198378 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-ff82f75e-37ed-4bc4-b7e9-420de9febda8 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] HTTP exception thrown: Instance 1180ceb9-a888-4a3b-ba9d-a35afa8dc279 could not be found. Sep 23 04:39:18.200616 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ff82f75e-37ed-4bc4-b7e9-420de9febda8 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Request method failure captured: Sep 23 04:39:18.200616 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/1180ceb9-a888-4a3b-ba9d-a35afa8dc279 HTTP/1.1 Sep 23 04:39:18.200616 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:39:18.200616 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:39:18.200616 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:39:18.200616 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:39:18.200616 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:39:18.200616 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:39:18.200616 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:39:18.200616 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:39:18.200616 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTedAlFPeFmnDF7aT3i0aUDQGJFgGZnI-hp3AgXCkcO3hSwSmXlMqV4YX4M2zE_tzLZBCRNva2-mnxAIXvcDQ4ADhbq0RDumL2tq0UzsAkBd3JY4bJ4oVHe0Nm8SGB15yLY37BALihKvv5H7mxEOffoAs77PenOe-f2xwUXiU1RwOEo Sep 23 04:39:18.200616 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:39:18.200616 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:39:18.200616 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:39:18.200616 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:39:18.200616 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:39:18.200616 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:39:18.200616 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: f5db359a60174c45afa2bf06e23a46c4 Sep 23 04:39:18.200616 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ServersOnMultiNodesTest-604470560 Sep 23 04:39:18.200616 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:39:18.200616 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:39:18.200616 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f5db359a60174c45afa2bf06e23a46c4", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f5db359a60174c45afa2bf06e23a46c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f5db359a60174c45afa2bf06e23a46c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f5db359a60174c45afa2bf06e23a46c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:39:18.200616 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ServersOnMultiNodesTest-604470560 Sep 23 04:39:18.200616 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: f5db359a60174c45afa2bf06e23a46c4 Sep 23 04:39:18.200616 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-604470560 Sep 23 04:39:18.200616 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ServersOnMultiNodesTest-604470560-project Sep 23 04:39:18.200616 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:39:18.200616 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:39:18.200616 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: da08af8193dd490b93278385583f24c0 Sep 23 04:39:18.200616 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ServersOnMultiNodesTest-604470560-project Sep 23 04:39:18.200616 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:39:18.200616 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 1180ceb9-a888-4a3b-ba9d-a35afa8dc279 could not be found. Sep 23 04:39:18.200616 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '1180ceb9-a888-4a3b-ba9d-a35afa8dc279'} Sep 23 04:39:18.200616 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:39:18.200616 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:39:18.200616 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:39:18.200616 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:39:18.200616 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:39:18.200616 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:39:18.200616 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:39:18.200616 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:39:18.200616 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:39:18.200616 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:39:18.200616 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1180ceb9-a888-4a3b-ba9d-a35afa8dc279 could not be found. Sep 23 04:39:18.200616 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:39:18.200616 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:39:18.200616 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:39:18.200616 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:39:18.200616 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:39:18.200616 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:39:18.200616 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:39:18.200616 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:39:18.200616 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:39:18.200616 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:39:18.200616 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:39:18.200616 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:39:18.200616 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:39:18.200616 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:39:18.200616 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:39:18.200616 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:39:18.200616 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1180ceb9-a888-4a3b-ba9d-a35afa8dc279 could not be found. Sep 23 04:39:18.200616 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:39:18.200616 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:39:18.200616 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:39:18.205598 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:39:18.205598 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:39:18.205598 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:39:18.205598 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:39:18.205598 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:39:18.205598 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1180ceb9-a888-4a3b-ba9d-a35afa8dc279 could not be found. Sep 23 04:39:18.205598 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:39:18.205598 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ff82f75e-37ed-4bc4-b7e9-420de9febda8 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] Returning 404 to user: Instance 1180ceb9-a888-4a3b-ba9d-a35afa8dc279 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:39:18.205598 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ff82f75e-37ed-4bc4-b7e9-420de9febda8 tempest-ServersOnMultiNodesTest-604470560 tempest-ServersOnMultiNodesTest-604470560-project] 10.222.0.33 "GET /compute/v2.1/servers/1180ceb9-a888-4a3b-ba9d-a35afa8dc279" status: 404 len: 111 microversion: 2.1 time: 0.036647 Sep 23 04:39:18.205598 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1078/2200] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:18 2022] GET /compute/v2.1/servers/1180ceb9-a888-4a3b-ba9d-a35afa8dc279 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 04:39:18.212964 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-71afa19d-01f9-4857-82fc-e765921e8ade tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1244f3db540441a28d8413e510cfccad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b412c874d4e668b4a1a33dedb2c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:18.222603 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-71afa19d-01f9-4857-82fc-e765921e8ade tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] 10.222.0.33 "GET /compute/v2.1/servers/7e90c852-5f27-4861-9b25-9ea1e475c0a9" status: 200 len: 1476 microversion: 2.1 time: 0.106568 Sep 23 04:39:18.223178 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1123/2201] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:18 2022] GET /compute/v2.1/servers/7e90c852-5f27-4861-9b25-9ea1e475c0a9 => generated 1476 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:18.758869 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b8c124f5-b0c6-459b-ab25-73df9664d4e0 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:18.759905 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b8c124f5-b0c6-459b-ab25-73df9664d4e0 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:18.771115 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b8c124f5-b0c6-459b-ab25-73df9664d4e0 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:18.771631 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b8c124f5-b0c6-459b-ab25-73df9664d4e0 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:18.772084 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b8c124f5-b0c6-459b-ab25-73df9664d4e0 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:18.772871 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b8c124f5-b0c6-459b-ab25-73df9664d4e0 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:18.773336 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b8c124f5-b0c6-459b-ab25-73df9664d4e0 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:18.774012 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b8c124f5-b0c6-459b-ab25-73df9664d4e0 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:18.782350 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-01cd81e5-0c44-4e79-87f5-f94355c1d537 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:18.783016 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-01cd81e5-0c44-4e79-87f5-f94355c1d537 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: aa35cea0-4f7f-4d03-9436-f15264b9f713] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:18.789924 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-01cd81e5-0c44-4e79-87f5-f94355c1d537 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:18.790428 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-01cd81e5-0c44-4e79-87f5-f94355c1d537 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:18.790915 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-01cd81e5-0c44-4e79-87f5-f94355c1d537 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:18.791806 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-01cd81e5-0c44-4e79-87f5-f94355c1d537 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:18.792356 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-01cd81e5-0c44-4e79-87f5-f94355c1d537 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:18.792829 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-01cd81e5-0c44-4e79-87f5-f94355c1d537 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:19.044966 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-01cd81e5-0c44-4e79-87f5-f94355c1d537 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:19.052618 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b8c124f5-b0c6-459b-ab25-73df9664d4e0 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:19.058873 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-01cd81e5-0c44-4e79-87f5-f94355c1d537 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713" status: 200 len: 1199 microversion: 2.1 time: 0.281005 Sep 23 04:39:19.060280 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1124/2202] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:18 2022] GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713 => generated 1199 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:19.074097 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b8c124f5-b0c6-459b-ab25-73df9664d4e0 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6" status: 200 len: 1315 microversion: 2.1 time: 0.308422 Sep 23 04:39:19.074097 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1079/2203] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:18 2022] GET /compute/v2.1/servers/cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6 => generated 1315 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:19.074097 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-b6b70125-798c-4900-8ac9-6b25add88887 req-dee16bba-8d82-4d9f-881c-e1115b98a6a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa35cea0-4f7f-4d03-9436-f15264b9f713", "name": "network-vif-plugged", "status": "completed", "tag": "bc9fa346-7e65-43be-854e-637e4641d7f9"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:39:19.080722 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7d02cfdc-ed9a-4094-a487-9df1d38ba71f tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:19.081349 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-7d02cfdc-ed9a-4094-a487-9df1d38ba71f tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] [instance: 94fc4134-9b8e-4dcd-bd96-5545bfd51c97] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:19.083887 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-b6b70125-798c-4900-8ac9-6b25add88887 req-dee16bba-8d82-4d9f-881c-e1115b98a6a9 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:19.084368 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-b6b70125-798c-4900-8ac9-6b25add88887 req-dee16bba-8d82-4d9f-881c-e1115b98a6a9 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:19.090071 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-b6b70125-798c-4900-8ac9-6b25add88887 req-dee16bba-8d82-4d9f-881c-e1115b98a6a9 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:19.095870 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7d02cfdc-ed9a-4094-a487-9df1d38ba71f tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:19.096472 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7d02cfdc-ed9a-4094-a487-9df1d38ba71f tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:19.096930 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7d02cfdc-ed9a-4094-a487-9df1d38ba71f tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:19.097262 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-b6b70125-798c-4900-8ac9-6b25add88887 req-dee16bba-8d82-4d9f-881c-e1115b98a6a9 service nova] Creating event network-vif-plugged:bc9fa346-7e65-43be-854e-637e4641d7f9 for instance aa35cea0-4f7f-4d03-9436-f15264b9f713 on n-h1-846463-3 Sep 23 04:39:19.097640 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7d02cfdc-ed9a-4094-a487-9df1d38ba71f tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:19.098137 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7d02cfdc-ed9a-4094-a487-9df1d38ba71f tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:19.098566 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7d02cfdc-ed9a-4094-a487-9df1d38ba71f tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:19.102520 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-b6b70125-798c-4900-8ac9-6b25add88887 req-dee16bba-8d82-4d9f-881c-e1115b98a6a9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037697 Sep 23 04:39:19.103411 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1080/2204] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:39:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:39:19.109217 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-43d35c68-529a-4a59-82a9-345463015340 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:19.110079 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-43d35c68-529a-4a59-82a9-345463015340 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] [instance: 7cc18563-ad1f-4050-818b-880782814c23] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:19.116673 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-43d35c68-529a-4a59-82a9-345463015340 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:19.117419 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-43d35c68-529a-4a59-82a9-345463015340 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:19.118053 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-43d35c68-529a-4a59-82a9-345463015340 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:19.124479 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-43d35c68-529a-4a59-82a9-345463015340 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:19.124479 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-43d35c68-529a-4a59-82a9-345463015340 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:19.124479 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-43d35c68-529a-4a59-82a9-345463015340 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:19.200680 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=16 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:39:19.257133 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-7d02cfdc-ed9a-4094-a487-9df1d38ba71f tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lazy-loading 'services' on Instance uuid 94fc4134-9b8e-4dcd-bd96-5545bfd51c97 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:39:19.282578 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-7d02cfdc-ed9a-4094-a487-9df1d38ba71f tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97" status: 200 len: 1929 microversion: 2.75 time: 0.207391 Sep 23 04:39:19.284747 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1125/2205] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:39:19 2022] GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97 => generated 1929 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:39:19.292019 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2229a5eb-0a5a-4db0-bb5d-806fcbebb4e7 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:19.292973 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-2229a5eb-0a5a-4db0-bb5d-806fcbebb4e7 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] [instance: 7e90c852-5f27-4861-9b25-9ea1e475c0a9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:19.304904 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2229a5eb-0a5a-4db0-bb5d-806fcbebb4e7 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:19.305646 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2229a5eb-0a5a-4db0-bb5d-806fcbebb4e7 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:19.306728 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2229a5eb-0a5a-4db0-bb5d-806fcbebb4e7 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:19.310019 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2229a5eb-0a5a-4db0-bb5d-806fcbebb4e7 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:19.310019 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2229a5eb-0a5a-4db0-bb5d-806fcbebb4e7 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:19.310019 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2229a5eb-0a5a-4db0-bb5d-806fcbebb4e7 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:19.372800 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2229a5eb-0a5a-4db0-bb5d-806fcbebb4e7 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:19.373533 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2229a5eb-0a5a-4db0-bb5d-806fcbebb4e7 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:19.374767 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2229a5eb-0a5a-4db0-bb5d-806fcbebb4e7 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:19.375937 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-2229a5eb-0a5a-4db0-bb5d-806fcbebb4e7 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lazy-loading 'fault' on Instance uuid 7e90c852-5f27-4861-9b25-9ea1e475c0a9 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:39:19.387352 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-43d35c68-529a-4a59-82a9-345463015340 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6477e60b54491baff0a7dbee062ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc56537160d349aab8f5e6499ca8ab99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:19.396477 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-43d35c68-529a-4a59-82a9-345463015340 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] 10.222.0.33 "GET /compute/v2.1/servers/7cc18563-ad1f-4050-818b-880782814c23" status: 200 len: 1317 microversion: 2.1 time: 0.291582 Sep 23 04:39:19.397390 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1081/2206] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:19 2022] GET /compute/v2.1/servers/7cc18563-ad1f-4050-818b-880782814c23 => generated 1317 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:19.432231 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2229a5eb-0a5a-4db0-bb5d-806fcbebb4e7 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1244f3db540441a28d8413e510cfccad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b412c874d4e668b4a1a33dedb2c9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:19.440192 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2229a5eb-0a5a-4db0-bb5d-806fcbebb4e7 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] 10.222.0.33 "GET /compute/v2.1/servers/7e90c852-5f27-4861-9b25-9ea1e475c0a9" status: 200 len: 1311 microversion: 2.1 time: 0.153043 Sep 23 04:39:19.440782 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1126/2207] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:19 2022] GET /compute/v2.1/servers/7e90c852-5f27-4861-9b25-9ea1e475c0a9 => generated 1311 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:20.026594 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-875b6dae-47bb-4aa3-adf5-3626db734b7d req-db75508f-3ffb-4a92-b17e-d4c83dd18691 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e90c852-5f27-4861-9b25-9ea1e475c0a9", "name": "network-vif-deleted", "tag": "8b6ae886-5681-4d62-a4c2-d887ae24dcca"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:39:20.037431 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=10 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:39:20.043585 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-875b6dae-47bb-4aa3-adf5-3626db734b7d req-db75508f-3ffb-4a92-b17e-d4c83dd18691 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:20.046536 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-875b6dae-47bb-4aa3-adf5-3626db734b7d req-db75508f-3ffb-4a92-b17e-d4c83dd18691 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:20.047084 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-875b6dae-47bb-4aa3-adf5-3626db734b7d req-db75508f-3ffb-4a92-b17e-d4c83dd18691 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:20.061615 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-875b6dae-47bb-4aa3-adf5-3626db734b7d req-db75508f-3ffb-4a92-b17e-d4c83dd18691 service nova] Creating event network-vif-deleted:8b6ae886-5681-4d62-a4c2-d887ae24dcca for instance 7e90c852-5f27-4861-9b25-9ea1e475c0a9 on n-h1-846463-3 Sep 23 04:39:20.066932 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-875b6dae-47bb-4aa3-adf5-3626db734b7d req-db75508f-3ffb-4a92-b17e-d4c83dd18691 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045525 Sep 23 04:39:20.067534 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1082/2208] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:39:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:39:20.085563 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-85fbb541-04ec-4073-9f26-66f74933d696 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:20.086709 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-85fbb541-04ec-4073-9f26-66f74933d696 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: aa35cea0-4f7f-4d03-9436-f15264b9f713] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:20.093786 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=12 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:39:20.098661 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-282029c7-3027-4620-8f16-42c421c60a48 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:20.099369 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-282029c7-3027-4620-8f16-42c421c60a48 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:20.103272 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=16 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:39:20.105066 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-85fbb541-04ec-4073-9f26-66f74933d696 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:20.105561 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-85fbb541-04ec-4073-9f26-66f74933d696 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:20.106034 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-85fbb541-04ec-4073-9f26-66f74933d696 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:20.106748 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-85fbb541-04ec-4073-9f26-66f74933d696 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:20.107210 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-85fbb541-04ec-4073-9f26-66f74933d696 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:20.107638 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-85fbb541-04ec-4073-9f26-66f74933d696 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:20.112562 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:39:20.116610 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-282029c7-3027-4620-8f16-42c421c60a48 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:20.117115 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-282029c7-3027-4620-8f16-42c421c60a48 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:20.117726 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-282029c7-3027-4620-8f16-42c421c60a48 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:20.118472 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-282029c7-3027-4620-8f16-42c421c60a48 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:20.118940 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-282029c7-3027-4620-8f16-42c421c60a48 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:20.119375 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-282029c7-3027-4620-8f16-42c421c60a48 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:20.135744 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=100 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:39:20.325282 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-282029c7-3027-4620-8f16-42c421c60a48 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:20.334211 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-282029c7-3027-4620-8f16-42c421c60a48 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6" status: 200 len: 1315 microversion: 2.1 time: 0.240760 Sep 23 04:39:20.334837 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1083/2209] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:20 2022] GET /compute/v2.1/servers/cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6 => generated 1315 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:20.339699 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-bb52560d-5d8f-4cf4-a59e-5c4c11d7f054 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:20.340500 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-bb52560d-5d8f-4cf4-a59e-5c4c11d7f054 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] [instance: 94fc4134-9b8e-4dcd-bd96-5545bfd51c97] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:20.347132 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bb52560d-5d8f-4cf4-a59e-5c4c11d7f054 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:20.348180 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bb52560d-5d8f-4cf4-a59e-5c4c11d7f054 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:20.348790 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bb52560d-5d8f-4cf4-a59e-5c4c11d7f054 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:20.349505 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bb52560d-5d8f-4cf4-a59e-5c4c11d7f054 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:20.350003 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bb52560d-5d8f-4cf4-a59e-5c4c11d7f054 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:20.350772 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bb52560d-5d8f-4cf4-a59e-5c4c11d7f054 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:20.354289 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-85fbb541-04ec-4073-9f26-66f74933d696 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:20.362644 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-85fbb541-04ec-4073-9f26-66f74933d696 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713" status: 200 len: 1199 microversion: 2.1 time: 0.281367 Sep 23 04:39:20.363304 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1127/2210] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:20 2022] GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713 => generated 1199 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:20.423955 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ac2637a8-d76a-4218-a7e2-6c8b25ecba93 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:20.424753 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ac2637a8-d76a-4218-a7e2-6c8b25ecba93 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] [instance: 7cc18563-ad1f-4050-818b-880782814c23] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:20.432685 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-bb52560d-5d8f-4cf4-a59e-5c4c11d7f054 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lazy-loading 'services' on Instance uuid 94fc4134-9b8e-4dcd-bd96-5545bfd51c97 {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:39:20.433528 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ac2637a8-d76a-4218-a7e2-6c8b25ecba93 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:20.434278 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ac2637a8-d76a-4218-a7e2-6c8b25ecba93 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:20.434895 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ac2637a8-d76a-4218-a7e2-6c8b25ecba93 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:20.435778 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ac2637a8-d76a-4218-a7e2-6c8b25ecba93 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:20.436454 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ac2637a8-d76a-4218-a7e2-6c8b25ecba93 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:20.437264 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ac2637a8-d76a-4218-a7e2-6c8b25ecba93 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:20.451602 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-bb52560d-5d8f-4cf4-a59e-5c4c11d7f054 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97" status: 200 len: 1929 microversion: 2.75 time: 0.115556 Sep 23 04:39:20.453176 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1084/2211] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:39:20 2022] GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97 => generated 1929 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:39:20.471307 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0142863c-3483-4fdb-bfd6-ea4fbacdc483 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:20.474710 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-0142863c-3483-4fdb-bfd6-ea4fbacdc483 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] [instance: 7e90c852-5f27-4861-9b25-9ea1e475c0a9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:20.483991 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0142863c-3483-4fdb-bfd6-ea4fbacdc483 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:20.485389 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0142863c-3483-4fdb-bfd6-ea4fbacdc483 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:20.485846 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0142863c-3483-4fdb-bfd6-ea4fbacdc483 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:20.486596 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0142863c-3483-4fdb-bfd6-ea4fbacdc483 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:20.492939 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0142863c-3483-4fdb-bfd6-ea4fbacdc483 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:20.492939 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0142863c-3483-4fdb-bfd6-ea4fbacdc483 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:20.506224 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-0142863c-3483-4fdb-bfd6-ea4fbacdc483 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] HTTP exception thrown: Instance 7e90c852-5f27-4861-9b25-9ea1e475c0a9 could not be found. Sep 23 04:39:20.508161 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0142863c-3483-4fdb-bfd6-ea4fbacdc483 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Request method failure captured: Sep 23 04:39:20.508161 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/7e90c852-5f27-4861-9b25-9ea1e475c0a9 HTTP/1.1 Sep 23 04:39:20.508161 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:39:20.508161 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:39:20.508161 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:39:20.508161 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:39:20.508161 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:39:20.508161 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:39:20.508161 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:39:20.508161 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:39:20.508161 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTgWByaYCNfiozp93GTtCpOkF_ZetaRjW-aEvVvDqWh2DMrlv1lso1NTsSgjh1ZvSdLlP-vsw3YDLCoS9_gyATagJR0jnHvxte6MbAT0tODvhSTaSyG8K-2FwzCK5EL3rUxCawsMEMDi_tXXiIVJo_iG9cqKTH-fC_8VFyEnqeiI-38 Sep 23 04:39:20.508161 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:39:20.508161 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:39:20.508161 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:39:20.508161 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:39:20.508161 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:39:20.508161 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:39:20.508161 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 721b412c874d4e668b4a1a33dedb2c9b Sep 23 04:39:20.508161 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ListServerFiltersTestJSON-25983859 Sep 23 04:39:20.508161 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:39:20.508161 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:39:20.508161 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_721b412c874d4e668b4a1a33dedb2c9b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/721b412c874d4e668b4a1a33dedb2c9b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/721b412c874d4e668b4a1a33dedb2c9b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/721b412c874d4e668b4a1a33dedb2c9b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:39:20.508161 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ListServerFiltersTestJSON-25983859 Sep 23 04:39:20.508161 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 721b412c874d4e668b4a1a33dedb2c9b Sep 23 04:39:20.508161 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-25983859 Sep 23 04:39:20.508161 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ListServerFiltersTestJSON-25983859-project Sep 23 04:39:20.508161 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:39:20.508161 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:39:20.508161 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 1244f3db540441a28d8413e510cfccad Sep 23 04:39:20.508161 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ListServerFiltersTestJSON-25983859-project Sep 23 04:39:20.508161 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:39:20.508161 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 7e90c852-5f27-4861-9b25-9ea1e475c0a9 could not be found. Sep 23 04:39:20.508161 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '7e90c852-5f27-4861-9b25-9ea1e475c0a9'} Sep 23 04:39:20.508161 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:39:20.508161 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:39:20.508161 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:39:20.508161 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:39:20.508161 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:39:20.508161 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:39:20.508161 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:39:20.508161 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:39:20.508161 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:39:20.508161 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:39:20.508161 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e90c852-5f27-4861-9b25-9ea1e475c0a9 could not be found. Sep 23 04:39:20.508161 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:39:20.508161 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:39:20.508161 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:39:20.508161 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:39:20.508161 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:39:20.508161 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:39:20.508161 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:39:20.508161 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:39:20.508161 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:39:20.508161 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:39:20.508161 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:39:20.508161 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:39:20.508161 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:39:20.508161 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:39:20.508161 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:39:20.508161 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:39:20.508161 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e90c852-5f27-4861-9b25-9ea1e475c0a9 could not be found. Sep 23 04:39:20.508161 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:39:20.508161 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:39:20.508161 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:39:20.511494 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:39:20.511494 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:39:20.511494 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:39:20.511494 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:39:20.511494 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:39:20.511494 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e90c852-5f27-4861-9b25-9ea1e475c0a9 could not be found. Sep 23 04:39:20.511494 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:39:20.513309 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0142863c-3483-4fdb-bfd6-ea4fbacdc483 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] Returning 404 to user: Instance 7e90c852-5f27-4861-9b25-9ea1e475c0a9 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:39:20.515367 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0142863c-3483-4fdb-bfd6-ea4fbacdc483 tempest-ListServerFiltersTestJSON-25983859 tempest-ListServerFiltersTestJSON-25983859-project] 10.222.0.33 "GET /compute/v2.1/servers/7e90c852-5f27-4861-9b25-9ea1e475c0a9" status: 404 len: 111 microversion: 2.1 time: 0.054120 Sep 23 04:39:20.523938 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1085/2212] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:20 2022] GET /compute/v2.1/servers/7e90c852-5f27-4861-9b25-9ea1e475c0a9 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:39:20.629266 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ac2637a8-d76a-4218-a7e2-6c8b25ecba93 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6477e60b54491baff0a7dbee062ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc56537160d349aab8f5e6499ca8ab99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:20.638790 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ac2637a8-d76a-4218-a7e2-6c8b25ecba93 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] 10.222.0.33 "GET /compute/v2.1/servers/7cc18563-ad1f-4050-818b-880782814c23" status: 200 len: 1317 microversion: 2.1 time: 0.220937 Sep 23 04:39:20.653945 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1128/2213] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:20 2022] GET /compute/v2.1/servers/7cc18563-ad1f-4050-818b-880782814c23 => generated 1317 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:39:21.357698 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8e95f509-8866-48cb-8db7-08512facef45 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:21.359146 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8e95f509-8866-48cb-8db7-08512facef45 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:21.367098 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8e95f509-8866-48cb-8db7-08512facef45 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:21.367508 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8e95f509-8866-48cb-8db7-08512facef45 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:21.368159 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8e95f509-8866-48cb-8db7-08512facef45 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:21.369109 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8e95f509-8866-48cb-8db7-08512facef45 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:21.369773 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8e95f509-8866-48cb-8db7-08512facef45 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:21.370447 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8e95f509-8866-48cb-8db7-08512facef45 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:21.391897 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b1b427b2-67a7-4539-bf1c-9d5335ed708f tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:21.392525 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b1b427b2-67a7-4539-bf1c-9d5335ed708f tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: aa35cea0-4f7f-4d03-9436-f15264b9f713] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:21.409661 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b1b427b2-67a7-4539-bf1c-9d5335ed708f tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:21.410476 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b1b427b2-67a7-4539-bf1c-9d5335ed708f tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:21.411087 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b1b427b2-67a7-4539-bf1c-9d5335ed708f tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:21.412579 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b1b427b2-67a7-4539-bf1c-9d5335ed708f tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:21.413243 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b1b427b2-67a7-4539-bf1c-9d5335ed708f tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:21.413878 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b1b427b2-67a7-4539-bf1c-9d5335ed708f tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:21.732769 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8e95f509-8866-48cb-8db7-08512facef45 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:21.744847 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8e95f509-8866-48cb-8db7-08512facef45 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6" status: 200 len: 1315 microversion: 2.1 time: 0.390873 Sep 23 04:39:21.745988 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1086/2214] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:21 2022] GET /compute/v2.1/servers/cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6 => generated 1315 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:21.750606 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-91560f1d-b54b-45b7-af30-1ca4a057b4f1 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:21.759201 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-91560f1d-b54b-45b7-af30-1ca4a057b4f1 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] [instance: 94fc4134-9b8e-4dcd-bd96-5545bfd51c97] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:21.776819 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-91560f1d-b54b-45b7-af30-1ca4a057b4f1 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:21.777559 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-91560f1d-b54b-45b7-af30-1ca4a057b4f1 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:21.778713 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-91560f1d-b54b-45b7-af30-1ca4a057b4f1 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:21.779608 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-91560f1d-b54b-45b7-af30-1ca4a057b4f1 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:21.780940 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-91560f1d-b54b-45b7-af30-1ca4a057b4f1 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:21.781520 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-91560f1d-b54b-45b7-af30-1ca4a057b4f1 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:21.859380 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b1b427b2-67a7-4539-bf1c-9d5335ed708f tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:21.867968 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b1b427b2-67a7-4539-bf1c-9d5335ed708f tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713" status: 200 len: 1382 microversion: 2.1 time: 0.485693 Sep 23 04:39:21.869139 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1129/2215] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:21 2022] GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713 => generated 1382 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:21.890562 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-65f11b87-beda-4e52-b5e8-aacebc4bf7eb tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:21.890562 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-65f11b87-beda-4e52-b5e8-aacebc4bf7eb tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] [instance: 7cc18563-ad1f-4050-818b-880782814c23] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:21.898193 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-65f11b87-beda-4e52-b5e8-aacebc4bf7eb tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:21.898986 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-65f11b87-beda-4e52-b5e8-aacebc4bf7eb tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:21.899622 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-65f11b87-beda-4e52-b5e8-aacebc4bf7eb tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:21.900533 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-65f11b87-beda-4e52-b5e8-aacebc4bf7eb tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:21.901204 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-65f11b87-beda-4e52-b5e8-aacebc4bf7eb tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:21.901854 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-65f11b87-beda-4e52-b5e8-aacebc4bf7eb tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:21.989684 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-91560f1d-b54b-45b7-af30-1ca4a057b4f1 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lazy-loading 'services' on Instance uuid 94fc4134-9b8e-4dcd-bd96-5545bfd51c97 {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:39:22.008268 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-91560f1d-b54b-45b7-af30-1ca4a057b4f1 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97" status: 200 len: 1929 microversion: 2.75 time: 0.261087 Sep 23 04:39:22.008952 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1087/2216] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:39:21 2022] GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97 => generated 1929 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:39:22.103597 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-65f11b87-beda-4e52-b5e8-aacebc4bf7eb tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6477e60b54491baff0a7dbee062ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc56537160d349aab8f5e6499ca8ab99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:22.112970 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-65f11b87-beda-4e52-b5e8-aacebc4bf7eb tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] 10.222.0.33 "GET /compute/v2.1/servers/7cc18563-ad1f-4050-818b-880782814c23" status: 200 len: 1317 microversion: 2.1 time: 0.242579 Sep 23 04:39:22.126925 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1130/2217] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:21 2022] GET /compute/v2.1/servers/7cc18563-ad1f-4050-818b-880782814c23 => generated 1317 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:22.333448 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1736228f-f2bd-440d-8b82-082505de7bb6 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:22.334105 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-1736228f-f2bd-440d-8b82-082505de7bb6 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] [instance: aa35cea0-4f7f-4d03-9436-f15264b9f713] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:22.341127 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1736228f-f2bd-440d-8b82-082505de7bb6 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:22.341127 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1736228f-f2bd-440d-8b82-082505de7bb6 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:22.341672 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1736228f-f2bd-440d-8b82-082505de7bb6 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:22.343056 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1736228f-f2bd-440d-8b82-082505de7bb6 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:22.343752 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1736228f-f2bd-440d-8b82-082505de7bb6 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:22.344277 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1736228f-f2bd-440d-8b82-082505de7bb6 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:22.510751 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-1736228f-f2bd-440d-8b82-082505de7bb6 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713" status: 200 len: 1533 microversion: 2.1 time: 0.487260 Sep 23 04:39:22.511358 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1088/2218] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:22 2022] GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713 => generated 1533 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:22.533909 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-559c875c-188a-4e8b-bbd8-d6269dc0946b tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:22.534600 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-559c875c-188a-4e8b-bbd8-d6269dc0946b tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] [instance: aa35cea0-4f7f-4d03-9436-f15264b9f713] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:22.542360 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-559c875c-188a-4e8b-bbd8-d6269dc0946b tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:22.542854 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-559c875c-188a-4e8b-bbd8-d6269dc0946b tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:22.543305 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-559c875c-188a-4e8b-bbd8-d6269dc0946b tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:22.544711 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-559c875c-188a-4e8b-bbd8-d6269dc0946b tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:22.544711 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-559c875c-188a-4e8b-bbd8-d6269dc0946b tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:22.544922 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-559c875c-188a-4e8b-bbd8-d6269dc0946b tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:22.710881 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-559c875c-188a-4e8b-bbd8-d6269dc0946b tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713" status: 200 len: 1533 microversion: 2.1 time: 0.181705 Sep 23 04:39:22.712503 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1131/2219] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:22 2022] GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713 => generated 1533 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:22.738101 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c7143f17-b39d-471b-9854-f2725a390936 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:22.743923 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c7143f17-b39d-471b-9854-f2725a390936 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:22.744731 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c7143f17-b39d-471b-9854-f2725a390936 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:22.745326 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c7143f17-b39d-471b-9854-f2725a390936 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:22.746263 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c7143f17-b39d-471b-9854-f2725a390936 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:22.746904 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c7143f17-b39d-471b-9854-f2725a390936 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:22.747742 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c7143f17-b39d-471b-9854-f2725a390936 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:22.768730 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1aade8be-5240-4665-9bd6-0582ddc0bc13 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:22.769593 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1aade8be-5240-4665-9bd6-0582ddc0bc13 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:22.776047 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1aade8be-5240-4665-9bd6-0582ddc0bc13 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:22.777373 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1aade8be-5240-4665-9bd6-0582ddc0bc13 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:22.777989 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1aade8be-5240-4665-9bd6-0582ddc0bc13 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:22.778856 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1aade8be-5240-4665-9bd6-0582ddc0bc13 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:22.779525 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1aade8be-5240-4665-9bd6-0582ddc0bc13 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:22.780151 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1aade8be-5240-4665-9bd6-0582ddc0bc13 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:22.807226 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c7143f17-b39d-471b-9854-f2725a390936 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.074222 Sep 23 04:39:22.818122 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1089/2220] 10.222.0.33 () {58 vars in 1176 bytes} [Fri Sep 23 04:39:22 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:39:22.827130 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-51617914-70f9-4d87-a7fd-e0a14c646882 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-846463-3", "block_migration": false, "disk_over_commit": false}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:39:22.831297 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-51617914-70f9-4d87-a7fd-e0a14c646882 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] [instance: aa35cea0-4f7f-4d03-9436-f15264b9f713] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:22.841000 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-51617914-70f9-4d87-a7fd-e0a14c646882 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:22.841878 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-51617914-70f9-4d87-a7fd-e0a14c646882 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:22.843049 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-51617914-70f9-4d87-a7fd-e0a14c646882 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:22.844832 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-51617914-70f9-4d87-a7fd-e0a14c646882 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:22.845468 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-51617914-70f9-4d87-a7fd-e0a14c646882 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:22.846083 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-51617914-70f9-4d87-a7fd-e0a14c646882 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:22.877832 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-51617914-70f9-4d87-a7fd-e0a14c646882 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lazy-loading 'flavor' on Instance uuid aa35cea0-4f7f-4d03-9436-f15264b9f713 {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:39:22.896432 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-51617914-70f9-4d87-a7fd-e0a14c646882 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] [instance: aa35cea0-4f7f-4d03-9436-f15264b9f713] Going to try to live migrate instance to n-h2-846463-3 {{(pid=122698) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 23 04:39:22.975348 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1aade8be-5240-4665-9bd6-0582ddc0bc13 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:22.985495 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1aade8be-5240-4665-9bd6-0582ddc0bc13 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6" status: 200 len: 1315 microversion: 2.1 time: 0.221444 Sep 23 04:39:22.986105 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1132/2221] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:22 2022] GET /compute/v2.1/servers/cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6 => generated 1315 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:23.038659 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9c8a311b-f32d-43f3-837c-8a406e7a3c9f tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:23.039250 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-9c8a311b-f32d-43f3-837c-8a406e7a3c9f tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] [instance: 94fc4134-9b8e-4dcd-bd96-5545bfd51c97] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:23.045943 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9c8a311b-f32d-43f3-837c-8a406e7a3c9f tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:23.046457 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9c8a311b-f32d-43f3-837c-8a406e7a3c9f tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:23.046898 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9c8a311b-f32d-43f3-837c-8a406e7a3c9f tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:23.047602 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9c8a311b-f32d-43f3-837c-8a406e7a3c9f tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:23.048061 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9c8a311b-f32d-43f3-837c-8a406e7a3c9f tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:23.048505 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9c8a311b-f32d-43f3-837c-8a406e7a3c9f tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:23.124196 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-9c8a311b-f32d-43f3-837c-8a406e7a3c9f tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lazy-loading 'services' on Instance uuid 94fc4134-9b8e-4dcd-bd96-5545bfd51c97 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:39:23.140734 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-9c8a311b-f32d-43f3-837c-8a406e7a3c9f tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97" status: 200 len: 1929 microversion: 2.75 time: 0.106489 Sep 23 04:39:23.141310 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1133/2222] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:39:23 2022] GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97 => generated 1929 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:39:23.145753 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-dd0ed832-0e24-4d9f-b614-012b247d3b6e tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:23.146387 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-dd0ed832-0e24-4d9f-b614-012b247d3b6e tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] [instance: 7cc18563-ad1f-4050-818b-880782814c23] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:23.152373 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dd0ed832-0e24-4d9f-b614-012b247d3b6e tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:23.152881 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dd0ed832-0e24-4d9f-b614-012b247d3b6e tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:23.153320 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dd0ed832-0e24-4d9f-b614-012b247d3b6e tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:23.154054 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dd0ed832-0e24-4d9f-b614-012b247d3b6e tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:23.154519 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dd0ed832-0e24-4d9f-b614-012b247d3b6e tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:23.155467 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dd0ed832-0e24-4d9f-b614-012b247d3b6e tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:23.307945 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-dd0ed832-0e24-4d9f-b614-012b247d3b6e tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6477e60b54491baff0a7dbee062ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc56537160d349aab8f5e6499ca8ab99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:23.316939 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-dd0ed832-0e24-4d9f-b614-012b247d3b6e tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] 10.222.0.33 "GET /compute/v2.1/servers/7cc18563-ad1f-4050-818b-880782814c23" status: 200 len: 1317 microversion: 2.1 time: 0.174625 Sep 23 04:39:23.317796 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1134/2223] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:23 2022] GET /compute/v2.1/servers/7cc18563-ad1f-4050-818b-880782814c23 => generated 1317 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:24.010006 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-91205f6f-1224-4936-922f-7eaaca63c4fd tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:24.012507 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-91205f6f-1224-4936-922f-7eaaca63c4fd tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:24.022039 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-91205f6f-1224-4936-922f-7eaaca63c4fd tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:24.022812 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-91205f6f-1224-4936-922f-7eaaca63c4fd tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:24.023610 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-91205f6f-1224-4936-922f-7eaaca63c4fd tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:24.024509 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-91205f6f-1224-4936-922f-7eaaca63c4fd tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:24.025171 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-91205f6f-1224-4936-922f-7eaaca63c4fd tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:24.025799 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-91205f6f-1224-4936-922f-7eaaca63c4fd tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:24.207187 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-91205f6f-1224-4936-922f-7eaaca63c4fd tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:24.219292 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-91205f6f-1224-4936-922f-7eaaca63c4fd tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6" status: 200 len: 1315 microversion: 2.1 time: 0.210769 Sep 23 04:39:24.221018 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1135/2224] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:24 2022] GET /compute/v2.1/servers/cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6 => generated 1315 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:24.233109 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4c7debba-1630-48ae-8ffd-5d7003e680a4 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:24.234635 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4c7debba-1630-48ae-8ffd-5d7003e680a4 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] [instance: 94fc4134-9b8e-4dcd-bd96-5545bfd51c97] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:24.249577 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4c7debba-1630-48ae-8ffd-5d7003e680a4 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:24.250350 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4c7debba-1630-48ae-8ffd-5d7003e680a4 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:24.251244 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4c7debba-1630-48ae-8ffd-5d7003e680a4 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:24.252638 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4c7debba-1630-48ae-8ffd-5d7003e680a4 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:24.253145 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4c7debba-1630-48ae-8ffd-5d7003e680a4 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:24.253672 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4c7debba-1630-48ae-8ffd-5d7003e680a4 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:24.349527 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-4c7debba-1630-48ae-8ffd-5d7003e680a4 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lazy-loading 'services' on Instance uuid 94fc4134-9b8e-4dcd-bd96-5545bfd51c97 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:39:24.366167 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4c7debba-1630-48ae-8ffd-5d7003e680a4 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97" status: 200 len: 1929 microversion: 2.75 time: 0.139162 Sep 23 04:39:24.366756 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1136/2225] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:39:24 2022] GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97 => generated 1929 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:39:24.559761 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0a96564d-8fb3-45fb-8c50-635c7c128856 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-UnshelveToHostMultiNodesTest-server-761621051", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "networks": "none"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:39:24.623025 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-0a96564d-8fb3-45fb-8c50-635c7c128856 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Flavor limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:39:24.624003 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-0a96564d-8fb3-45fb-8c50-635c7c128856 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Image limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:39:24.625253 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-0a96564d-8fb3-45fb-8c50-635c7c128856 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Flavor pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:39:24.628985 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-0a96564d-8fb3-45fb-8c50-635c7c128856 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Image pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:39:24.630424 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-0a96564d-8fb3-45fb-8c50-635c7c128856 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:39:24.642399 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0a96564d-8fb3-45fb-8c50-635c7c128856 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:24.643048 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0a96564d-8fb3-45fb-8c50-635c7c128856 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:24.644009 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0a96564d-8fb3-45fb-8c50-635c7c128856 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:24.645141 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0a96564d-8fb3-45fb-8c50-635c7c128856 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:24.646470 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0a96564d-8fb3-45fb-8c50-635c7c128856 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:24.647229 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0a96564d-8fb3-45fb-8c50-635c7c128856 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:24.682760 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-0a96564d-8fb3-45fb-8c50-635c7c128856 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Getting quotas for project ccefc8bfaa7b4209b2e46503bc5f91f7. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:39:24.690036 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-0a96564d-8fb3-45fb-8c50-635c7c128856 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Getting quotas for user b9aaffb5b70d4890a9d41c6127affb9d and project ccefc8bfaa7b4209b2e46503bc5f91f7. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:39:24.703217 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-0a96564d-8fb3-45fb-8c50-635c7c128856 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Going to run 1 instances... {{(pid=122699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:39:24.705572 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-0a96564d-8fb3-45fb-8c50-635c7c128856 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:39:24.824878 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0a96564d-8fb3-45fb-8c50-635c7c128856 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.91 time: 0.457006 Sep 23 04:39:24.825739 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1137/2226] 10.222.0.33 () {62 vars in 1188 bytes} [Fri Sep 23 04:39:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 458 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 23 04:39:24.832204 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e5d449e3-f3da-43e7-b4b1-e653a5be77ed tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:24.833306 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e5d449e3-f3da-43e7-b4b1-e653a5be77ed tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] [instance: 7cc18563-ad1f-4050-818b-880782814c23] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:24.840884 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e5d449e3-f3da-43e7-b4b1-e653a5be77ed tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:24.841851 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e5d449e3-f3da-43e7-b4b1-e653a5be77ed tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:24.842737 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e5d449e3-f3da-43e7-b4b1-e653a5be77ed tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:24.843825 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e5d449e3-f3da-43e7-b4b1-e653a5be77ed tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:24.844691 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e5d449e3-f3da-43e7-b4b1-e653a5be77ed tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:24.845295 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e5d449e3-f3da-43e7-b4b1-e653a5be77ed tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:25.046294 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e5d449e3-f3da-43e7-b4b1-e653a5be77ed tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6477e60b54491baff0a7dbee062ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc56537160d349aab8f5e6499ca8ab99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:25.062598 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e5d449e3-f3da-43e7-b4b1-e653a5be77ed tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] 10.222.0.33 "GET /compute/v2.1/servers/7cc18563-ad1f-4050-818b-880782814c23" status: 200 len: 1317 microversion: 2.1 time: 0.235292 Sep 23 04:39:25.080357 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1138/2227] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:24 2022] GET /compute/v2.1/servers/7cc18563-ad1f-4050-818b-880782814c23 => generated 1317 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:25.087826 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-0a7d963e-554d-486c-9d8a-c53d09a1e1f0 req-a4c523d9-285d-44c7-b1cc-f38c0dc7e4e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cc18563-ad1f-4050-818b-880782814c23", "name": "network-vif-plugged", "status": "completed", "tag": "144b628b-c2cf-4574-a054-4e019408e692"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:39:25.101696 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-0a7d963e-554d-486c-9d8a-c53d09a1e1f0 req-a4c523d9-285d-44c7-b1cc-f38c0dc7e4e8 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:25.102909 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-0a7d963e-554d-486c-9d8a-c53d09a1e1f0 req-a4c523d9-285d-44c7-b1cc-f38c0dc7e4e8 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:25.103723 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-0a7d963e-554d-486c-9d8a-c53d09a1e1f0 req-a4c523d9-285d-44c7-b1cc-f38c0dc7e4e8 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:25.130646 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-0a7d963e-554d-486c-9d8a-c53d09a1e1f0 req-a4c523d9-285d-44c7-b1cc-f38c0dc7e4e8 service nova] Creating event network-vif-plugged:144b628b-c2cf-4574-a054-4e019408e692 for instance 7cc18563-ad1f-4050-818b-880782814c23 on n-h2-846463-3 Sep 23 04:39:25.137268 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-0a7d963e-554d-486c-9d8a-c53d09a1e1f0 req-a4c523d9-285d-44c7-b1cc-f38c0dc7e4e8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055578 Sep 23 04:39:25.139001 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1139/2228] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:39:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:39:25.144525 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9b2b0d39-c02d-47ed-9bbf-233869efa551 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:25.145237 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-9b2b0d39-c02d-47ed-9bbf-233869efa551 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:25.234921 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-9b2b0d39-c02d-47ed-9bbf-233869efa551 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:25.245509 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-9b2b0d39-c02d-47ed-9bbf-233869efa551 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:25.247236 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-9b2b0d39-c02d-47ed-9bbf-233869efa551 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:25.257494 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:39:25.269857 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-9b2b0d39-c02d-47ed-9bbf-233869efa551 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1452 microversion: 2.91 time: 0.120830 Sep 23 04:39:25.269857 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1140/2229] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:39:25 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1452 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:39:25.278665 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-db0e2b57-8149-406c-bc7d-c85621d9ecb1 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:25.281151 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-db0e2b57-8149-406c-bc7d-c85621d9ecb1 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:25.296730 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-db0e2b57-8149-406c-bc7d-c85621d9ecb1 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:25.298442 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-db0e2b57-8149-406c-bc7d-c85621d9ecb1 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:25.298442 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-db0e2b57-8149-406c-bc7d-c85621d9ecb1 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:25.298684 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-db0e2b57-8149-406c-bc7d-c85621d9ecb1 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:25.299076 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-db0e2b57-8149-406c-bc7d-c85621d9ecb1 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:25.299581 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-db0e2b57-8149-406c-bc7d-c85621d9ecb1 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:25.583927 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-db0e2b57-8149-406c-bc7d-c85621d9ecb1 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:25.593979 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-db0e2b57-8149-406c-bc7d-c85621d9ecb1 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6" status: 200 len: 1315 microversion: 2.1 time: 0.331024 Sep 23 04:39:25.594879 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1141/2230] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:25 2022] GET /compute/v2.1/servers/cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6 => generated 1315 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:25.600760 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-96881170-3a14-48ce-9aeb-2fd43f3a8cb5 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:25.601708 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-96881170-3a14-48ce-9aeb-2fd43f3a8cb5 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] [instance: 94fc4134-9b8e-4dcd-bd96-5545bfd51c97] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:25.609749 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-96881170-3a14-48ce-9aeb-2fd43f3a8cb5 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:25.610553 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-96881170-3a14-48ce-9aeb-2fd43f3a8cb5 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:25.616075 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-96881170-3a14-48ce-9aeb-2fd43f3a8cb5 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:25.616075 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-96881170-3a14-48ce-9aeb-2fd43f3a8cb5 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:25.616075 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-96881170-3a14-48ce-9aeb-2fd43f3a8cb5 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:25.616075 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-96881170-3a14-48ce-9aeb-2fd43f3a8cb5 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:25.730177 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-96881170-3a14-48ce-9aeb-2fd43f3a8cb5 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lazy-loading 'services' on Instance uuid 94fc4134-9b8e-4dcd-bd96-5545bfd51c97 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:39:25.751593 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-96881170-3a14-48ce-9aeb-2fd43f3a8cb5 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97" status: 200 len: 1929 microversion: 2.75 time: 0.155481 Sep 23 04:39:25.752265 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1142/2231] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:39:25 2022] GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97 => generated 1929 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:39:26.068488 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-51617914-70f9-4d87-a7fd-e0a14c646882 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713/action" status: 202 len: 0 microversion: 2.1 time: 3.246429 Sep 23 04:39:26.070499 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1090/2232] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:39:22 2022] POST /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713/action => generated 0 bytes in 3250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:39:26.080808 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b7337c52-75b8-47ab-8843-f37613a58da4 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:26.081447 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b7337c52-75b8-47ab-8843-f37613a58da4 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: aa35cea0-4f7f-4d03-9436-f15264b9f713] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:26.088608 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b7337c52-75b8-47ab-8843-f37613a58da4 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:26.089109 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b7337c52-75b8-47ab-8843-f37613a58da4 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:26.089549 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b7337c52-75b8-47ab-8843-f37613a58da4 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:26.090319 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b7337c52-75b8-47ab-8843-f37613a58da4 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:26.090783 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b7337c52-75b8-47ab-8843-f37613a58da4 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:26.091214 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b7337c52-75b8-47ab-8843-f37613a58da4 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:26.092105 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-38240301-35e5-4642-b0c5-4d11403c2df4 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:26.093002 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-38240301-35e5-4642-b0c5-4d11403c2df4 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] [instance: 7cc18563-ad1f-4050-818b-880782814c23] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:26.108794 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-38240301-35e5-4642-b0c5-4d11403c2df4 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:26.109271 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-38240301-35e5-4642-b0c5-4d11403c2df4 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:26.109783 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-38240301-35e5-4642-b0c5-4d11403c2df4 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:26.110522 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-38240301-35e5-4642-b0c5-4d11403c2df4 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:26.110979 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-38240301-35e5-4642-b0c5-4d11403c2df4 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:26.111405 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-38240301-35e5-4642-b0c5-4d11403c2df4 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:26.315785 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b7337c52-75b8-47ab-8843-f37613a58da4 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:26.327273 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-38240301-35e5-4642-b0c5-4d11403c2df4 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6477e60b54491baff0a7dbee062ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc56537160d349aab8f5e6499ca8ab99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:26.330511 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b7337c52-75b8-47ab-8843-f37613a58da4 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713" status: 200 len: 1392 microversion: 2.1 time: 0.254330 Sep 23 04:39:26.331180 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1143/2233] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:26 2022] GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713 => generated 1392 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:26.336033 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b72f4bcc-d24a-422e-8c9d-52f09d637235 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:26.336742 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b72f4bcc-d24a-422e-8c9d-52f09d637235 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:26.342658 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b72f4bcc-d24a-422e-8c9d-52f09d637235 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:26.343212 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b72f4bcc-d24a-422e-8c9d-52f09d637235 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:26.343657 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b72f4bcc-d24a-422e-8c9d-52f09d637235 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:26.344357 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b72f4bcc-d24a-422e-8c9d-52f09d637235 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:26.344818 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b72f4bcc-d24a-422e-8c9d-52f09d637235 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:26.346285 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b72f4bcc-d24a-422e-8c9d-52f09d637235 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:26.358997 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-38240301-35e5-4642-b0c5-4d11403c2df4 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] 10.222.0.33 "GET /compute/v2.1/servers/7cc18563-ad1f-4050-818b-880782814c23" status: 200 len: 1317 microversion: 2.1 time: 0.270700 Sep 23 04:39:26.359813 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1091/2234] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:26 2022] GET /compute/v2.1/servers/7cc18563-ad1f-4050-818b-880782814c23 => generated 1317 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:39:26.410454 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b72f4bcc-d24a-422e-8c9d-52f09d637235 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:26.419509 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b72f4bcc-d24a-422e-8c9d-52f09d637235 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:26.421758 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b72f4bcc-d24a-422e-8c9d-52f09d637235 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:26.427239 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b72f4bcc-d24a-422e-8c9d-52f09d637235 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1456 microversion: 2.91 time: 0.094714 Sep 23 04:39:26.427828 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1144/2235] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:39:26 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1456 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:39:26.618189 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c65f09f2-2ac2-47f5-be6a-cc45e1122ab9 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:26.618811 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c65f09f2-2ac2-47f5-be6a-cc45e1122ab9 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:26.621501 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:DELETE=3,nova_api:SELECT=96,nova_api:UPDATE=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:39:26.626212 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c65f09f2-2ac2-47f5-be6a-cc45e1122ab9 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:26.626709 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c65f09f2-2ac2-47f5-be6a-cc45e1122ab9 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:26.627156 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c65f09f2-2ac2-47f5-be6a-cc45e1122ab9 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:26.627854 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c65f09f2-2ac2-47f5-be6a-cc45e1122ab9 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:26.628320 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c65f09f2-2ac2-47f5-be6a-cc45e1122ab9 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:26.628826 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c65f09f2-2ac2-47f5-be6a-cc45e1122ab9 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:26.782757 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b5d3f58f-5f33-4f61-9606-4144cb40fc47 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:26.783757 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b5d3f58f-5f33-4f61-9606-4144cb40fc47 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] [instance: 94fc4134-9b8e-4dcd-bd96-5545bfd51c97] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:26.793394 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b5d3f58f-5f33-4f61-9606-4144cb40fc47 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:26.794215 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b5d3f58f-5f33-4f61-9606-4144cb40fc47 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:26.795029 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b5d3f58f-5f33-4f61-9606-4144cb40fc47 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:26.796905 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b5d3f58f-5f33-4f61-9606-4144cb40fc47 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:26.797834 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b5d3f58f-5f33-4f61-9606-4144cb40fc47 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:26.798045 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c65f09f2-2ac2-47f5-be6a-cc45e1122ab9 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:26.798645 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b5d3f58f-5f33-4f61-9606-4144cb40fc47 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:26.805095 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=100 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:39:26.810265 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c65f09f2-2ac2-47f5-be6a-cc45e1122ab9 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6" status: 200 len: 1315 microversion: 2.1 time: 0.195937 Sep 23 04:39:26.811131 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1092/2236] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:26 2022] GET /compute/v2.1/servers/cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6 => generated 1315 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:26.919083 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-b5d3f58f-5f33-4f61-9606-4144cb40fc47 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lazy-loading 'services' on Instance uuid 94fc4134-9b8e-4dcd-bd96-5545bfd51c97 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:39:26.943292 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b5d3f58f-5f33-4f61-9606-4144cb40fc47 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97" status: 200 len: 1929 microversion: 2.75 time: 0.166368 Sep 23 04:39:26.944203 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1145/2237] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:39:26 2022] GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97 => generated 1929 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:39:27.182602 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-076fca3d-75d3-4597-af8f-4031209e280c req-1c3e7732-32f0-437d-8f48-d6e3f584d494 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6", "name": "network-vif-plugged", "status": "completed", "tag": "c738b507-0460-44ab-8aa6-5019592de190"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:39:27.193100 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-076fca3d-75d3-4597-af8f-4031209e280c req-1c3e7732-32f0-437d-8f48-d6e3f584d494 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:27.193589 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-076fca3d-75d3-4597-af8f-4031209e280c req-1c3e7732-32f0-437d-8f48-d6e3f584d494 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:27.194050 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-076fca3d-75d3-4597-af8f-4031209e280c req-1c3e7732-32f0-437d-8f48-d6e3f584d494 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:27.206357 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-076fca3d-75d3-4597-af8f-4031209e280c req-1c3e7732-32f0-437d-8f48-d6e3f584d494 service nova] Creating event network-vif-plugged:c738b507-0460-44ab-8aa6-5019592de190 for instance cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6 on n-h2-846463-3 Sep 23 04:39:27.211239 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-076fca3d-75d3-4597-af8f-4031209e280c req-1c3e7732-32f0-437d-8f48-d6e3f584d494 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032357 Sep 23 04:39:27.212345 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1093/2238] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:39:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:39:27.358394 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-99911db9-9d59-4cb1-a46d-4a520143b5a0 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:27.359015 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-99911db9-9d59-4cb1-a46d-4a520143b5a0 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: aa35cea0-4f7f-4d03-9436-f15264b9f713] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:27.366053 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-99911db9-9d59-4cb1-a46d-4a520143b5a0 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:27.366768 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-99911db9-9d59-4cb1-a46d-4a520143b5a0 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:27.367419 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-99911db9-9d59-4cb1-a46d-4a520143b5a0 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:27.368312 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-99911db9-9d59-4cb1-a46d-4a520143b5a0 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:27.368951 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-99911db9-9d59-4cb1-a46d-4a520143b5a0 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:27.369555 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-99911db9-9d59-4cb1-a46d-4a520143b5a0 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:27.385041 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-fb38061b-5800-4d81-98eb-a3fc2b3d1da2 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:27.386065 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-fb38061b-5800-4d81-98eb-a3fc2b3d1da2 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] [instance: 7cc18563-ad1f-4050-818b-880782814c23] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:27.396941 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fb38061b-5800-4d81-98eb-a3fc2b3d1da2 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:27.398475 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fb38061b-5800-4d81-98eb-a3fc2b3d1da2 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:27.400438 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fb38061b-5800-4d81-98eb-a3fc2b3d1da2 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:27.402220 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fb38061b-5800-4d81-98eb-a3fc2b3d1da2 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:27.403991 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fb38061b-5800-4d81-98eb-a3fc2b3d1da2 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:27.408105 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fb38061b-5800-4d81-98eb-a3fc2b3d1da2 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:27.831848 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-fb38061b-5800-4d81-98eb-a3fc2b3d1da2 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6477e60b54491baff0a7dbee062ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc56537160d349aab8f5e6499ca8ab99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:27.835632 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-99911db9-9d59-4cb1-a46d-4a520143b5a0 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:27.845667 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-99911db9-9d59-4cb1-a46d-4a520143b5a0 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713" status: 200 len: 1392 microversion: 2.1 time: 0.491446 Sep 23 04:39:27.848433 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1146/2239] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:27 2022] GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713 => generated 1392 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:27.865301 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-fb38061b-5800-4d81-98eb-a3fc2b3d1da2 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] 10.222.0.33 "GET /compute/v2.1/servers/7cc18563-ad1f-4050-818b-880782814c23" status: 200 len: 1466 microversion: 2.1 time: 0.485821 Sep 23 04:39:27.866586 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-fc5555cc-8cf3-408f-9302-217c79c0edfa tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:27.867487 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-fc5555cc-8cf3-408f-9302-217c79c0edfa tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:27.878916 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fc5555cc-8cf3-408f-9302-217c79c0edfa tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:27.879659 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fc5555cc-8cf3-408f-9302-217c79c0edfa tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:27.880197 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fc5555cc-8cf3-408f-9302-217c79c0edfa tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:27.881047 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fc5555cc-8cf3-408f-9302-217c79c0edfa tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:27.881651 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fc5555cc-8cf3-408f-9302-217c79c0edfa tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:27.882256 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1094/2240] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:27 2022] GET /compute/v2.1/servers/7cc18563-ad1f-4050-818b-880782814c23 => generated 1466 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:39:27.882424 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fc5555cc-8cf3-408f-9302-217c79c0edfa tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:27.892244 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-42819914-79c2-464a-97c3-eb70b4989e10 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:27.893035 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-42819914-79c2-464a-97c3-eb70b4989e10 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:27.899351 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-42819914-79c2-464a-97c3-eb70b4989e10 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:27.900179 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-42819914-79c2-464a-97c3-eb70b4989e10 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:27.901038 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-42819914-79c2-464a-97c3-eb70b4989e10 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:27.902300 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-42819914-79c2-464a-97c3-eb70b4989e10 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:27.902870 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-42819914-79c2-464a-97c3-eb70b4989e10 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:27.903397 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-42819914-79c2-464a-97c3-eb70b4989e10 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:28.085000 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-fc5555cc-8cf3-408f-9302-217c79c0edfa tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:28.086974 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-fc5555cc-8cf3-408f-9302-217c79c0edfa tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:28.088429 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-fc5555cc-8cf3-408f-9302-217c79c0edfa tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:28.122010 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-fc5555cc-8cf3-408f-9302-217c79c0edfa tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1504 microversion: 2.91 time: 0.270329 Sep 23 04:39:28.123901 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1147/2241] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:39:27 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1504 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:39:28.138590 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c4afccad-40f7-438e-8c87-e56cf066978b tempest-LiveMigrationNegativeTest-398671155 tempest-LiveMigrationNegativeTest-398671155-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:39:28.141797 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c4afccad-40f7-438e-8c87-e56cf066978b tempest-LiveMigrationNegativeTest-398671155 tempest-LiveMigrationNegativeTest-398671155-project-admin] [instance: 7cc18563-ad1f-4050-818b-880782814c23] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:28.165266 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c4afccad-40f7-438e-8c87-e56cf066978b tempest-LiveMigrationNegativeTest-398671155 tempest-LiveMigrationNegativeTest-398671155-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:28.165266 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c4afccad-40f7-438e-8c87-e56cf066978b tempest-LiveMigrationNegativeTest-398671155 tempest-LiveMigrationNegativeTest-398671155-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:28.165266 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c4afccad-40f7-438e-8c87-e56cf066978b tempest-LiveMigrationNegativeTest-398671155 tempest-LiveMigrationNegativeTest-398671155-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:28.166736 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c4afccad-40f7-438e-8c87-e56cf066978b tempest-LiveMigrationNegativeTest-398671155 tempest-LiveMigrationNegativeTest-398671155-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:28.167785 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c4afccad-40f7-438e-8c87-e56cf066978b tempest-LiveMigrationNegativeTest-398671155 tempest-LiveMigrationNegativeTest-398671155-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:28.168244 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c4afccad-40f7-438e-8c87-e56cf066978b tempest-LiveMigrationNegativeTest-398671155 tempest-LiveMigrationNegativeTest-398671155-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:28.226719 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-c4afccad-40f7-438e-8c87-e56cf066978b tempest-LiveMigrationNegativeTest-398671155 tempest-LiveMigrationNegativeTest-398671155-project-admin] Lazy-loading 'flavor' on Instance uuid 7cc18563-ad1f-4050-818b-880782814c23 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:39:28.363964 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-42819914-79c2-464a-97c3-eb70b4989e10 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:28.384911 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-42819914-79c2-464a-97c3-eb70b4989e10 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6" status: 200 len: 1315 microversion: 2.1 time: 0.494542 Sep 23 04:39:28.384911 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1095/2242] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:27 2022] GET /compute/v2.1/servers/cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6 => generated 1315 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:28.390253 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-78b750a5-9a02-440c-980f-7f3be11fef7e tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:28.394872 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-78b750a5-9a02-440c-980f-7f3be11fef7e tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] [instance: 94fc4134-9b8e-4dcd-bd96-5545bfd51c97] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:28.419871 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-78b750a5-9a02-440c-980f-7f3be11fef7e tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:28.425750 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-78b750a5-9a02-440c-980f-7f3be11fef7e tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:28.426692 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-78b750a5-9a02-440c-980f-7f3be11fef7e tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:28.429430 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-78b750a5-9a02-440c-980f-7f3be11fef7e tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:28.430161 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-78b750a5-9a02-440c-980f-7f3be11fef7e tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:28.430808 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-78b750a5-9a02-440c-980f-7f3be11fef7e tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:28.530980 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-78b750a5-9a02-440c-980f-7f3be11fef7e tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lazy-loading 'services' on Instance uuid 94fc4134-9b8e-4dcd-bd96-5545bfd51c97 {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:39:28.585993 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-78b750a5-9a02-440c-980f-7f3be11fef7e tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97" status: 200 len: 1929 microversion: 2.75 time: 0.202512 Sep 23 04:39:28.587144 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1096/2243] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:39:28 2022] GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97 => generated 1929 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:39:28.711579 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c4afccad-40f7-438e-8c87-e56cf066978b tempest-LiveMigrationNegativeTest-398671155 tempest-LiveMigrationNegativeTest-398671155-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/7cc18563-ad1f-4050-818b-880782814c23/action" status: 202 len: 0 microversion: 2.1 time: 0.586059 Sep 23 04:39:28.722981 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8dcc8bb4-5ef4-4512-b39c-9598a91a585a tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:28.723624 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8dcc8bb4-5ef4-4512-b39c-9598a91a585a tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] [instance: 7cc18563-ad1f-4050-818b-880782814c23] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:28.738540 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1148/2244] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:39:28 2022] POST /compute/v2.1/servers/7cc18563-ad1f-4050-818b-880782814c23/action => generated 0 bytes in 614 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:39:28.745042 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8dcc8bb4-5ef4-4512-b39c-9598a91a585a tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:28.745537 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8dcc8bb4-5ef4-4512-b39c-9598a91a585a tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:28.746018 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8dcc8bb4-5ef4-4512-b39c-9598a91a585a tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:28.747307 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8dcc8bb4-5ef4-4512-b39c-9598a91a585a tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:28.747780 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8dcc8bb4-5ef4-4512-b39c-9598a91a585a tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:28.748277 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8dcc8bb4-5ef4-4512-b39c-9598a91a585a tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:28.869258 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-17103b5a-06d8-4e1b-8c3f-44c7c28f048c tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:28.870015 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-17103b5a-06d8-4e1b-8c3f-44c7c28f048c tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: aa35cea0-4f7f-4d03-9436-f15264b9f713] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:28.882381 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-17103b5a-06d8-4e1b-8c3f-44c7c28f048c tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:28.888168 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-17103b5a-06d8-4e1b-8c3f-44c7c28f048c tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:28.889254 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-17103b5a-06d8-4e1b-8c3f-44c7c28f048c tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:28.890871 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-17103b5a-06d8-4e1b-8c3f-44c7c28f048c tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:28.899017 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-17103b5a-06d8-4e1b-8c3f-44c7c28f048c tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:28.899017 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-17103b5a-06d8-4e1b-8c3f-44c7c28f048c tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:29.113815 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8dcc8bb4-5ef4-4512-b39c-9598a91a585a tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6477e60b54491baff0a7dbee062ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc56537160d349aab8f5e6499ca8ab99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:29.126662 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8dcc8bb4-5ef4-4512-b39c-9598a91a585a tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] 10.222.0.33 "GET /compute/v2.1/servers/7cc18563-ad1f-4050-818b-880782814c23" status: 200 len: 1474 microversion: 2.1 time: 0.404909 Sep 23 04:39:29.128488 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1097/2245] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:28 2022] GET /compute/v2.1/servers/7cc18563-ad1f-4050-818b-880782814c23 => generated 1474 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:29.152856 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c008814d-c322-4df4-8477-00475bbc8cf0 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:29.153497 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c008814d-c322-4df4-8477-00475bbc8cf0 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:29.168188 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c008814d-c322-4df4-8477-00475bbc8cf0 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:29.169206 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c008814d-c322-4df4-8477-00475bbc8cf0 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:29.169844 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c008814d-c322-4df4-8477-00475bbc8cf0 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:29.171466 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c008814d-c322-4df4-8477-00475bbc8cf0 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:29.172347 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c008814d-c322-4df4-8477-00475bbc8cf0 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:29.173107 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c008814d-c322-4df4-8477-00475bbc8cf0 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:29.732017 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c008814d-c322-4df4-8477-00475bbc8cf0 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:29.742736 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c008814d-c322-4df4-8477-00475bbc8cf0 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:29.749708 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c008814d-c322-4df4-8477-00475bbc8cf0 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:29.752462 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-17103b5a-06d8-4e1b-8c3f-44c7c28f048c tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:29.766317 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c008814d-c322-4df4-8477-00475bbc8cf0 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1510 microversion: 2.91 time: 0.616227 Sep 23 04:39:29.769006 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-17103b5a-06d8-4e1b-8c3f-44c7c28f048c tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713" status: 200 len: 1392 microversion: 2.1 time: 0.904035 Sep 23 04:39:29.770735 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1098/2246] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:39:29 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1510 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:39:29.790809 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1149/2247] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:28 2022] GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713 => generated 1392 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:39:29.793473 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a58552a5-7912-49c5-b93b-f0e4195e8d42 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:29.794274 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a58552a5-7912-49c5-b93b-f0e4195e8d42 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:29.803593 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a58552a5-7912-49c5-b93b-f0e4195e8d42 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:29.803882 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f273f3c9-df3c-4a5b-b18c-731621a244c8 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:29.804471 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a58552a5-7912-49c5-b93b-f0e4195e8d42 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:29.804595 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f273f3c9-df3c-4a5b-b18c-731621a244c8 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] [instance: 94fc4134-9b8e-4dcd-bd96-5545bfd51c97] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:29.805191 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a58552a5-7912-49c5-b93b-f0e4195e8d42 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:29.806115 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a58552a5-7912-49c5-b93b-f0e4195e8d42 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:29.807336 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a58552a5-7912-49c5-b93b-f0e4195e8d42 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:29.808124 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a58552a5-7912-49c5-b93b-f0e4195e8d42 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:29.812361 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f273f3c9-df3c-4a5b-b18c-731621a244c8 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:29.814516 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f273f3c9-df3c-4a5b-b18c-731621a244c8 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:29.819100 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f273f3c9-df3c-4a5b-b18c-731621a244c8 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:29.819220 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:39:29.819312 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f273f3c9-df3c-4a5b-b18c-731621a244c8 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:29.819312 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f273f3c9-df3c-4a5b-b18c-731621a244c8 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:29.819312 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f273f3c9-df3c-4a5b-b18c-731621a244c8 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:29.913545 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-f273f3c9-df3c-4a5b-b18c-731621a244c8 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lazy-loading 'services' on Instance uuid 94fc4134-9b8e-4dcd-bd96-5545bfd51c97 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:39:29.952958 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f273f3c9-df3c-4a5b-b18c-731621a244c8 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97" status: 200 len: 1929 microversion: 2.75 time: 0.151642 Sep 23 04:39:29.969473 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1150/2248] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:39:29 2022] GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97 => generated 1929 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:39:30.158285 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2dea562f-a283-46ef-8cba-a2b9c1ac125a tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:30.159242 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-2dea562f-a283-46ef-8cba-a2b9c1ac125a tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] [instance: 7cc18563-ad1f-4050-818b-880782814c23] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:30.175676 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2dea562f-a283-46ef-8cba-a2b9c1ac125a tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:30.175676 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2dea562f-a283-46ef-8cba-a2b9c1ac125a tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:30.175676 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2dea562f-a283-46ef-8cba-a2b9c1ac125a tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:30.181852 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a58552a5-7912-49c5-b93b-f0e4195e8d42 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:30.197094 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2dea562f-a283-46ef-8cba-a2b9c1ac125a tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:30.197697 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2dea562f-a283-46ef-8cba-a2b9c1ac125a tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:30.198163 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2dea562f-a283-46ef-8cba-a2b9c1ac125a tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:30.200448 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a58552a5-7912-49c5-b93b-f0e4195e8d42 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6" status: 200 len: 1501 microversion: 2.1 time: 0.428386 Sep 23 04:39:30.204482 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1099/2249] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:29 2022] GET /compute/v2.1/servers/cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6 => generated 1501 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:30.236923 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-248bb716-8a1c-4ad2-a8d8-80201db0cfda tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:39:30.249239 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-248bb716-8a1c-4ad2-a8d8-80201db0cfda tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:30.265219 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-248bb716-8a1c-4ad2-a8d8-80201db0cfda tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:30.266172 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-248bb716-8a1c-4ad2-a8d8-80201db0cfda tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:30.269505 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-248bb716-8a1c-4ad2-a8d8-80201db0cfda tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:30.271369 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-248bb716-8a1c-4ad2-a8d8-80201db0cfda tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:30.274134 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-248bb716-8a1c-4ad2-a8d8-80201db0cfda tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:30.274799 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-248bb716-8a1c-4ad2-a8d8-80201db0cfda tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:30.553920 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2dea562f-a283-46ef-8cba-a2b9c1ac125a tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6477e60b54491baff0a7dbee062ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc56537160d349aab8f5e6499ca8ab99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:30.566280 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2dea562f-a283-46ef-8cba-a2b9c1ac125a tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] 10.222.0.33 "GET /compute/v2.1/servers/7cc18563-ad1f-4050-818b-880782814c23" status: 200 len: 1457 microversion: 2.1 time: 0.413167 Sep 23 04:39:30.568365 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-248bb716-8a1c-4ad2-a8d8-80201db0cfda tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "POST /compute/v2.1/servers/cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6/action" status: 202 len: 0 microversion: 2.1 time: 0.341019 Sep 23 04:39:30.570056 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1100/2250] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:39:30 2022] POST /compute/v2.1/servers/cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6/action => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:39:30.585404 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1151/2251] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:30 2022] GET /compute/v2.1/servers/7cc18563-ad1f-4050-818b-880782814c23 => generated 1457 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:30.586683 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-425678e5-587b-40a9-99bc-191b4e9f5239 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:30.587623 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-425678e5-587b-40a9-99bc-191b4e9f5239 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:30.596635 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-527d6813-3d32-441e-b558-dc4f40711fc4 tempest-LiveMigrationNegativeTest-398671155 tempest-LiveMigrationNegativeTest-398671155-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:30.597255 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-527d6813-3d32-441e-b558-dc4f40711fc4 tempest-LiveMigrationNegativeTest-398671155 tempest-LiveMigrationNegativeTest-398671155-project-admin] [instance: 7cc18563-ad1f-4050-818b-880782814c23] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:30.606665 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-425678e5-587b-40a9-99bc-191b4e9f5239 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:30.607016 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-425678e5-587b-40a9-99bc-191b4e9f5239 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:30.609129 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-527d6813-3d32-441e-b558-dc4f40711fc4 tempest-LiveMigrationNegativeTest-398671155 tempest-LiveMigrationNegativeTest-398671155-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:30.609635 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-527d6813-3d32-441e-b558-dc4f40711fc4 tempest-LiveMigrationNegativeTest-398671155 tempest-LiveMigrationNegativeTest-398671155-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:30.610108 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-527d6813-3d32-441e-b558-dc4f40711fc4 tempest-LiveMigrationNegativeTest-398671155 tempest-LiveMigrationNegativeTest-398671155-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:30.610988 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-527d6813-3d32-441e-b558-dc4f40711fc4 tempest-LiveMigrationNegativeTest-398671155 tempest-LiveMigrationNegativeTest-398671155-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:30.611236 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-425678e5-587b-40a9-99bc-191b4e9f5239 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:30.611757 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-527d6813-3d32-441e-b558-dc4f40711fc4 tempest-LiveMigrationNegativeTest-398671155 tempest-LiveMigrationNegativeTest-398671155-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:30.612341 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-527d6813-3d32-441e-b558-dc4f40711fc4 tempest-LiveMigrationNegativeTest-398671155 tempest-LiveMigrationNegativeTest-398671155-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:30.612506 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-425678e5-587b-40a9-99bc-191b4e9f5239 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:30.613683 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-425678e5-587b-40a9-99bc-191b4e9f5239 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:30.615123 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-425678e5-587b-40a9-99bc-191b4e9f5239 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:30.972198 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-425678e5-587b-40a9-99bc-191b4e9f5239 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:31.008238 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-425678e5-587b-40a9-99bc-191b4e9f5239 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6" status: 200 len: 1506 microversion: 2.1 time: 0.424797 Sep 23 04:39:31.009660 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1101/2252] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:30 2022] GET /compute/v2.1/servers/cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6 => generated 1506 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:31.028029 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-910b2cb0-523b-49dd-a6cc-f4e9de190a1c tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:31.029998 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-910b2cb0-523b-49dd-a6cc-f4e9de190a1c tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: aa35cea0-4f7f-4d03-9436-f15264b9f713] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:31.044907 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-910b2cb0-523b-49dd-a6cc-f4e9de190a1c tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:31.048778 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-910b2cb0-523b-49dd-a6cc-f4e9de190a1c tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:31.049356 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-910b2cb0-523b-49dd-a6cc-f4e9de190a1c tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:31.050233 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-910b2cb0-523b-49dd-a6cc-f4e9de190a1c tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:31.052095 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-910b2cb0-523b-49dd-a6cc-f4e9de190a1c tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:31.052688 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-910b2cb0-523b-49dd-a6cc-f4e9de190a1c tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:31.307930 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-910b2cb0-523b-49dd-a6cc-f4e9de190a1c tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:31.320539 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-910b2cb0-523b-49dd-a6cc-f4e9de190a1c tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713" status: 200 len: 1392 microversion: 2.1 time: 0.305452 Sep 23 04:39:31.325049 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-527d6813-3d32-441e-b558-dc4f40711fc4 tempest-LiveMigrationNegativeTest-398671155 tempest-LiveMigrationNegativeTest-398671155-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/7cc18563-ad1f-4050-818b-880782814c23" status: 200 len: 1608 microversion: 2.1 time: 0.730451 Sep 23 04:39:31.327270 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1152/2253] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:30 2022] GET /compute/v2.1/servers/7cc18563-ad1f-4050-818b-880782814c23 => generated 1608 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:31.330528 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1102/2254] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:31 2022] GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713 => generated 1392 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:31.342042 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1a5a3f17-7245-400a-b3de-ef07825f5d80 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:31.348757 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1a5a3f17-7245-400a-b3de-ef07825f5d80 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:31.357336 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c7787172-28d1-4819-84e6-901f84fd3351 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:31.358127 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c7787172-28d1-4819-84e6-901f84fd3351 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] [instance: 94fc4134-9b8e-4dcd-bd96-5545bfd51c97] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:31.365251 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1a5a3f17-7245-400a-b3de-ef07825f5d80 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:31.366036 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1a5a3f17-7245-400a-b3de-ef07825f5d80 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:31.368749 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1a5a3f17-7245-400a-b3de-ef07825f5d80 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:31.371419 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1a5a3f17-7245-400a-b3de-ef07825f5d80 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:31.376680 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1a5a3f17-7245-400a-b3de-ef07825f5d80 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:31.376680 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1a5a3f17-7245-400a-b3de-ef07825f5d80 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:31.377728 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c7787172-28d1-4819-84e6-901f84fd3351 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:31.378280 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c7787172-28d1-4819-84e6-901f84fd3351 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:31.378736 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c7787172-28d1-4819-84e6-901f84fd3351 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:31.379498 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c7787172-28d1-4819-84e6-901f84fd3351 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:31.379962 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c7787172-28d1-4819-84e6-901f84fd3351 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:31.380392 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c7787172-28d1-4819-84e6-901f84fd3351 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:31.461809 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1a5a3f17-7245-400a-b3de-ef07825f5d80 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:31.474280 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1a5a3f17-7245-400a-b3de-ef07825f5d80 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:31.483482 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1a5a3f17-7245-400a-b3de-ef07825f5d80 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:31.496780 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1a5a3f17-7245-400a-b3de-ef07825f5d80 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1531 microversion: 2.91 time: 0.168107 Sep 23 04:39:31.497306 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1153/2255] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:39:31 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1531 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:39:31.521662 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8639367e-f11a-4709-91c5-d3cb9721828e tempest-LiveMigrationNegativeTest-398671155 tempest-LiveMigrationNegativeTest-398671155-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:31.526373 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8639367e-f11a-4709-91c5-d3cb9721828e tempest-LiveMigrationNegativeTest-398671155 tempest-LiveMigrationNegativeTest-398671155-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:31.526876 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8639367e-f11a-4709-91c5-d3cb9721828e tempest-LiveMigrationNegativeTest-398671155 tempest-LiveMigrationNegativeTest-398671155-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:31.527325 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8639367e-f11a-4709-91c5-d3cb9721828e tempest-LiveMigrationNegativeTest-398671155 tempest-LiveMigrationNegativeTest-398671155-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:31.528070 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8639367e-f11a-4709-91c5-d3cb9721828e tempest-LiveMigrationNegativeTest-398671155 tempest-LiveMigrationNegativeTest-398671155-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:31.528548 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8639367e-f11a-4709-91c5-d3cb9721828e tempest-LiveMigrationNegativeTest-398671155 tempest-LiveMigrationNegativeTest-398671155-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:31.536992 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8639367e-f11a-4709-91c5-d3cb9721828e tempest-LiveMigrationNegativeTest-398671155 tempest-LiveMigrationNegativeTest-398671155-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:31.543965 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-c7787172-28d1-4819-84e6-901f84fd3351 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lazy-loading 'services' on Instance uuid 94fc4134-9b8e-4dcd-bd96-5545bfd51c97 {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:39:31.580320 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-8639367e-f11a-4709-91c5-d3cb9721828e tempest-LiveMigrationNegativeTest-398671155 tempest-LiveMigrationNegativeTest-398671155-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.081908 Sep 23 04:39:31.586095 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1154/2256] 10.222.0.33 () {58 vars in 1176 bytes} [Fri Sep 23 04:39:31 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:39:31.589626 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c7787172-28d1-4819-84e6-901f84fd3351 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97" status: 200 len: 1947 microversion: 2.75 time: 0.256810 Sep 23 04:39:31.591800 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1103/2257] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:39:31 2022] GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97 => generated 1947 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:39:31.602314 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-be3f2d53-9e6a-4723-bfb4-6c294f36e63b tempest-LiveMigrationNegativeTest-398671155 tempest-LiveMigrationNegativeTest-398671155-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-846463-3", "block_migration": true, "disk_over_commit": false}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:39:31.606125 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-be3f2d53-9e6a-4723-bfb4-6c294f36e63b tempest-LiveMigrationNegativeTest-398671155 tempest-LiveMigrationNegativeTest-398671155-project-admin] [instance: 7cc18563-ad1f-4050-818b-880782814c23] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:31.615537 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-be3f2d53-9e6a-4723-bfb4-6c294f36e63b tempest-LiveMigrationNegativeTest-398671155 tempest-LiveMigrationNegativeTest-398671155-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:31.616538 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-be3f2d53-9e6a-4723-bfb4-6c294f36e63b tempest-LiveMigrationNegativeTest-398671155 tempest-LiveMigrationNegativeTest-398671155-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:31.617348 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-be3f2d53-9e6a-4723-bfb4-6c294f36e63b tempest-LiveMigrationNegativeTest-398671155 tempest-LiveMigrationNegativeTest-398671155-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:31.618805 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-be3f2d53-9e6a-4723-bfb4-6c294f36e63b tempest-LiveMigrationNegativeTest-398671155 tempest-LiveMigrationNegativeTest-398671155-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:31.619456 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-be3f2d53-9e6a-4723-bfb4-6c294f36e63b tempest-LiveMigrationNegativeTest-398671155 tempest-LiveMigrationNegativeTest-398671155-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:31.620321 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-be3f2d53-9e6a-4723-bfb4-6c294f36e63b tempest-LiveMigrationNegativeTest-398671155 tempest-LiveMigrationNegativeTest-398671155-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:31.661095 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-be3f2d53-9e6a-4723-bfb4-6c294f36e63b tempest-LiveMigrationNegativeTest-398671155 tempest-LiveMigrationNegativeTest-398671155-project-admin] Lazy-loading 'flavor' on Instance uuid 7cc18563-ad1f-4050-818b-880782814c23 {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:39:31.681698 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-be3f2d53-9e6a-4723-bfb4-6c294f36e63b tempest-LiveMigrationNegativeTest-398671155 tempest-LiveMigrationNegativeTest-398671155-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 7cc18563-ad1f-4050-818b-880782814c23 while it is in vm_state suspended Sep 23 04:39:31.684033 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-be3f2d53-9e6a-4723-bfb4-6c294f36e63b tempest-LiveMigrationNegativeTest-398671155 tempest-LiveMigrationNegativeTest-398671155-project-admin] Request method failure captured: Sep 23 04:39:31.684033 n-d-846463-3 devstack@n-api.service[122698]: request: POST /compute/v2.1/servers/7cc18563-ad1f-4050-818b-880782814c23/action HTTP/1.1 Sep 23 04:39:31.684033 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:39:31.684033 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:39:31.684033 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:39:31.684033 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 97 Sep 23 04:39:31.684033 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:39:31.684033 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:39:31.684033 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:39:31.684033 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:39:31.684033 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLThVl3Wy41sXaIKhqcNsywP0htkorf25lNH0Lyqn2iM5v520y3gwwySLo9PjfKtIywGDnrGdWhqgkqwURZUUrrVmeDQKkketEKVP4m3YFbOKz08VF0BV-izkqA7zPRpBQq1_u_IdZIfMnW05v41xrizQqVW01O3hrwDmLFmJU96UkiU Sep 23 04:39:31.684033 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:39:31.684033 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:39:31.684033 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:39:31.684033 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:39:31.684033 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:39:31.684033 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:39:31.684033 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 0bf1dc89fe914b36a2898db46a723aff Sep 23 04:39:31.684033 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-LiveMigrationNegativeTest-398671155 Sep 23 04:39:31.684033 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,admin,member Sep 23 04:39:31.684033 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,admin,member Sep 23 04:39:31.684033 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0bf1dc89fe914b36a2898db46a723aff", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0bf1dc89fe914b36a2898db46a723aff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0bf1dc89fe914b36a2898db46a723aff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0bf1dc89fe914b36a2898db46a723aff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:39:31.684033 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-LiveMigrationNegativeTest-398671155 Sep 23 04:39:31.684033 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 0bf1dc89fe914b36a2898db46a723aff Sep 23 04:39:31.684033 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-398671155 Sep 23 04:39:31.684033 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-LiveMigrationNegativeTest-398671155-project-admin Sep 23 04:39:31.684033 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:39:31.684033 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:39:31.684033 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: b9b581e5ca5a47c3845187ddabafa707 Sep 23 04:39:31.684033 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-LiveMigrationNegativeTest-398671155-project-admin Sep 23 04:39:31.684033 n-d-846463-3 devstack@n-api.service[122698]: Sep 23 04:39:31.684033 n-d-846463-3 devstack@n-api.service[122698]: {"os-migrateLive": {"host": "n-h1-846463-3", "block_migration": true, "disk_over_commit": false}} Sep 23 04:39:31.684033 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:39:31.684033 n-d-846463-3 devstack@n-api.service[122698]: exception: Cannot 'os-migrateLive' instance 7cc18563-ad1f-4050-818b-880782814c23 while it is in vm_state suspended Sep 23 04:39:31.684033 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '7cc18563-ad1f-4050-818b-880782814c23', 'body': {'os-migrateLive': {'host': 'n-h1-846463-3', 'block_migration': True, 'disk_over_commit': False}}} Sep 23 04:39:31.684033 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:39:31.684033 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:39:31.684033 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Sep 23 04:39:31.684033 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Sep 23 04:39:31.684033 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 23 04:39:31.684033 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 23 04:39:31.684033 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 23 04:39:31.684033 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 23 04:39:31.684033 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Sep 23 04:39:31.684033 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 23 04:39:31.684033 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 23 04:39:31.684033 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 23 04:39:31.684033 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 23 04:39:31.684033 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 23 04:39:31.684033 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Sep 23 04:39:31.684033 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 23 04:39:31.684033 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 23 04:39:31.684033 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 23 04:39:31.684033 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 23 04:39:31.684033 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 23 04:39:31.684033 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7cc18563-ad1f-4050-818b-880782814c23 in vm_state suspended. Cannot live_migrate while the instance is in this state. Sep 23 04:39:31.684033 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:39:31.684033 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:39:31.684033 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:39:31.684033 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:39:31.684033 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:39:31.687817 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:39:31.687817 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:39:31.687817 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:39:31.687817 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:39:31.687817 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:39:31.687817 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:39:31.687817 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:39:31.687817 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:39:31.687817 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:39:31.687817 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:39:31.687817 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:39:31.687817 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 23 04:39:31.687817 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Sep 23 04:39:31.687817 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 23 04:39:31.687817 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 23 04:39:31.687817 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 23 04:39:31.687817 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance 7cc18563-ad1f-4050-818b-880782814c23 while it is in vm_state suspended Sep 23 04:39:31.687817 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:39:31.687817 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:39:31.687817 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:39:31.687817 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:39:31.687817 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:39:31.687817 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:39:31.687817 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:39:31.687817 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:39:31.687817 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance 7cc18563-ad1f-4050-818b-880782814c23 while it is in vm_state suspended Sep 23 04:39:31.687817 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:39:31.698463 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-be3f2d53-9e6a-4723-bfb4-6c294f36e63b tempest-LiveMigrationNegativeTest-398671155 tempest-LiveMigrationNegativeTest-398671155-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 7cc18563-ad1f-4050-818b-880782814c23 while it is in vm_state suspended {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:39:31.698463 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-be3f2d53-9e6a-4723-bfb4-6c294f36e63b tempest-LiveMigrationNegativeTest-398671155 tempest-LiveMigrationNegativeTest-398671155-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/7cc18563-ad1f-4050-818b-880782814c23/action" status: 409 len: 155 microversion: 2.1 time: 0.101725 Sep 23 04:39:31.698463 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1104/2258] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:39:31 2022] POST /compute/v2.1/servers/7cc18563-ad1f-4050-818b-880782814c23/action => generated 155 bytes in 105 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 23 04:39:31.713122 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-662cef33-1249-4ef2-a844-30277c2400be tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:31.715351 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-662cef33-1249-4ef2-a844-30277c2400be tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] [instance: 7cc18563-ad1f-4050-818b-880782814c23] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:31.728521 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-662cef33-1249-4ef2-a844-30277c2400be tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:31.730309 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-662cef33-1249-4ef2-a844-30277c2400be tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:31.731848 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-662cef33-1249-4ef2-a844-30277c2400be tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:31.733460 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-662cef33-1249-4ef2-a844-30277c2400be tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:31.734906 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-662cef33-1249-4ef2-a844-30277c2400be tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:31.736577 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-662cef33-1249-4ef2-a844-30277c2400be tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:31.776322 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-662cef33-1249-4ef2-a844-30277c2400be tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] [instance: 7cc18563-ad1f-4050-818b-880782814c23] Going to try to terminate instance {{(pid=122698) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:39:31.921357 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-81dab34f-8275-41f4-96c1-4ac275baef56 tempest-UnshelveToHostMultiNodesTest-1629091521 tempest-UnshelveToHostMultiNodesTest-1629091521-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:31.922016 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-81dab34f-8275-41f4-96c1-4ac275baef56 tempest-UnshelveToHostMultiNodesTest-1629091521 tempest-UnshelveToHostMultiNodesTest-1629091521-project-admin] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:31.929043 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-81dab34f-8275-41f4-96c1-4ac275baef56 tempest-UnshelveToHostMultiNodesTest-1629091521 tempest-UnshelveToHostMultiNodesTest-1629091521-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:31.929942 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-81dab34f-8275-41f4-96c1-4ac275baef56 tempest-UnshelveToHostMultiNodesTest-1629091521 tempest-UnshelveToHostMultiNodesTest-1629091521-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:31.930759 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-81dab34f-8275-41f4-96c1-4ac275baef56 tempest-UnshelveToHostMultiNodesTest-1629091521 tempest-UnshelveToHostMultiNodesTest-1629091521-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:31.931719 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-81dab34f-8275-41f4-96c1-4ac275baef56 tempest-UnshelveToHostMultiNodesTest-1629091521 tempest-UnshelveToHostMultiNodesTest-1629091521-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:31.932263 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-81dab34f-8275-41f4-96c1-4ac275baef56 tempest-UnshelveToHostMultiNodesTest-1629091521 tempest-UnshelveToHostMultiNodesTest-1629091521-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:31.932893 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-81dab34f-8275-41f4-96c1-4ac275baef56 tempest-UnshelveToHostMultiNodesTest-1629091521 tempest-UnshelveToHostMultiNodesTest-1629091521-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:32.038371 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-81dab34f-8275-41f4-96c1-4ac275baef56 tempest-UnshelveToHostMultiNodesTest-1629091521 tempest-UnshelveToHostMultiNodesTest-1629091521-project-admin] Lazy-loading 'services' on Instance uuid 11ba0b77-8202-461d-8fdf-16528c7fa831 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:39:32.061840 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-81dab34f-8275-41f4-96c1-4ac275baef56 tempest-UnshelveToHostMultiNodesTest-1629091521 tempest-UnshelveToHostMultiNodesTest-1629091521-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1936 microversion: 2.91 time: 0.479178 Sep 23 04:39:32.067024 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1155/2259] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:39:31 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1936 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:39:32.073308 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-692ebdcc-649b-40e3-9a5f-84e2bd6c4950 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:32.074403 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-692ebdcc-649b-40e3-9a5f-84e2bd6c4950 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:32.084211 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-692ebdcc-649b-40e3-9a5f-84e2bd6c4950 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:32.084961 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-692ebdcc-649b-40e3-9a5f-84e2bd6c4950 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:32.085916 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-692ebdcc-649b-40e3-9a5f-84e2bd6c4950 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:32.086856 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-692ebdcc-649b-40e3-9a5f-84e2bd6c4950 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:32.087473 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-692ebdcc-649b-40e3-9a5f-84e2bd6c4950 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:32.088362 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-692ebdcc-649b-40e3-9a5f-84e2bd6c4950 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:32.186073 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-662cef33-1249-4ef2-a844-30277c2400be tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] 10.222.0.33 "DELETE /compute/v2.1/servers/7cc18563-ad1f-4050-818b-880782814c23" status: 204 len: 0 microversion: 2.1 time: 0.478300 Sep 23 04:39:32.187311 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1105/2260] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:39:31 2022] DELETE /compute/v2.1/servers/7cc18563-ad1f-4050-818b-880782814c23 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:39:32.195588 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a13be19d-4a06-486f-8e43-55b0f0463653 tempest-UnshelveToHostMultiNodesTest-1629091521 tempest-UnshelveToHostMultiNodesTest-1629091521-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:32.196377 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a13be19d-4a06-486f-8e43-55b0f0463653 tempest-UnshelveToHostMultiNodesTest-1629091521 tempest-UnshelveToHostMultiNodesTest-1629091521-project-admin] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:32.212567 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a13be19d-4a06-486f-8e43-55b0f0463653 tempest-UnshelveToHostMultiNodesTest-1629091521 tempest-UnshelveToHostMultiNodesTest-1629091521-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:32.213203 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a13be19d-4a06-486f-8e43-55b0f0463653 tempest-UnshelveToHostMultiNodesTest-1629091521 tempest-UnshelveToHostMultiNodesTest-1629091521-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:32.213596 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a13be19d-4a06-486f-8e43-55b0f0463653 tempest-UnshelveToHostMultiNodesTest-1629091521 tempest-UnshelveToHostMultiNodesTest-1629091521-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:32.214512 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a13be19d-4a06-486f-8e43-55b0f0463653 tempest-UnshelveToHostMultiNodesTest-1629091521 tempest-UnshelveToHostMultiNodesTest-1629091521-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:32.215170 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a13be19d-4a06-486f-8e43-55b0f0463653 tempest-UnshelveToHostMultiNodesTest-1629091521 tempest-UnshelveToHostMultiNodesTest-1629091521-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:32.215750 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a13be19d-4a06-486f-8e43-55b0f0463653 tempest-UnshelveToHostMultiNodesTest-1629091521 tempest-UnshelveToHostMultiNodesTest-1629091521-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:32.348090 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-692ebdcc-649b-40e3-9a5f-84e2bd6c4950 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:32.350227 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-a13be19d-4a06-486f-8e43-55b0f0463653 tempest-UnshelveToHostMultiNodesTest-1629091521 tempest-UnshelveToHostMultiNodesTest-1629091521-project-admin] Lazy-loading 'services' on Instance uuid 11ba0b77-8202-461d-8fdf-16528c7fa831 {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:39:32.357345 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-692ebdcc-649b-40e3-9a5f-84e2bd6c4950 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6" status: 200 len: 1486 microversion: 2.1 time: 0.288540 Sep 23 04:39:32.358482 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1156/2261] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:32 2022] GET /compute/v2.1/servers/cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6 => generated 1486 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:32.362864 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6164b5e9-389f-4a1a-93e9-2217d7ed1ecd tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:32.363480 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-6164b5e9-389f-4a1a-93e9-2217d7ed1ecd tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] [instance: 7cc18563-ad1f-4050-818b-880782814c23] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:32.369872 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6164b5e9-389f-4a1a-93e9-2217d7ed1ecd tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:32.376535 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6164b5e9-389f-4a1a-93e9-2217d7ed1ecd tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:32.378338 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6164b5e9-389f-4a1a-93e9-2217d7ed1ecd tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:32.379485 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6164b5e9-389f-4a1a-93e9-2217d7ed1ecd tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:32.380279 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6164b5e9-389f-4a1a-93e9-2217d7ed1ecd tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:32.380448 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6164b5e9-389f-4a1a-93e9-2217d7ed1ecd tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:32.385232 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a13be19d-4a06-486f-8e43-55b0f0463653 tempest-UnshelveToHostMultiNodesTest-1629091521 tempest-UnshelveToHostMultiNodesTest-1629091521-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1936 microversion: 2.91 time: 0.195455 Sep 23 04:39:32.386589 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1106/2262] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:39:32 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1936 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:39:32.394177 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0af63954-13bb-471e-a41d-46ee648e3305 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:32.395193 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-0af63954-13bb-471e-a41d-46ee648e3305 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: aa35cea0-4f7f-4d03-9436-f15264b9f713] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:32.403299 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0af63954-13bb-471e-a41d-46ee648e3305 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:32.404154 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0af63954-13bb-471e-a41d-46ee648e3305 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:32.406492 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0af63954-13bb-471e-a41d-46ee648e3305 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:32.408271 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0af63954-13bb-471e-a41d-46ee648e3305 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:32.408944 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0af63954-13bb-471e-a41d-46ee648e3305 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:32.409776 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0af63954-13bb-471e-a41d-46ee648e3305 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:32.619570 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-0af63954-13bb-471e-a41d-46ee648e3305 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:32.628517 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0af63954-13bb-471e-a41d-46ee648e3305 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713" status: 200 len: 1392 microversion: 2.1 time: 0.240179 Sep 23 04:39:32.629734 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1107/2263] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:32 2022] GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713 => generated 1392 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:32.640465 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f41d1171-bb45-49f7-b7e2-6768028c6647 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:32.645033 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f41d1171-bb45-49f7-b7e2-6768028c6647 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:32.652400 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f41d1171-bb45-49f7-b7e2-6768028c6647 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:32.653035 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f41d1171-bb45-49f7-b7e2-6768028c6647 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:32.653569 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f41d1171-bb45-49f7-b7e2-6768028c6647 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:32.654520 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f41d1171-bb45-49f7-b7e2-6768028c6647 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:32.655077 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f41d1171-bb45-49f7-b7e2-6768028c6647 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:32.655625 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f41d1171-bb45-49f7-b7e2-6768028c6647 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:32.693202 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f41d1171-bb45-49f7-b7e2-6768028c6647 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6] Going to try to terminate instance {{(pid=122698) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:39:32.756857 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-6164b5e9-389f-4a1a-93e9-2217d7ed1ecd tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6477e60b54491baff0a7dbee062ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc56537160d349aab8f5e6499ca8ab99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:32.758421 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:39:32.793596 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6164b5e9-389f-4a1a-93e9-2217d7ed1ecd tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] 10.222.0.33 "GET /compute/v2.1/servers/7cc18563-ad1f-4050-818b-880782814c23" status: 200 len: 1463 microversion: 2.1 time: 0.434164 Sep 23 04:39:32.794211 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1157/2264] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:32 2022] GET /compute/v2.1/servers/7cc18563-ad1f-4050-818b-880782814c23 => generated 1463 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:32.821586 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7a05dacb-2219-45b2-8539-7b12722d98df tempest-UnshelveToHostMultiNodesTest-1629091521 tempest-UnshelveToHostMultiNodesTest-1629091521-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:32.829468 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7a05dacb-2219-45b2-8539-7b12722d98df tempest-UnshelveToHostMultiNodesTest-1629091521 tempest-UnshelveToHostMultiNodesTest-1629091521-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:32.835118 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7a05dacb-2219-45b2-8539-7b12722d98df tempest-UnshelveToHostMultiNodesTest-1629091521 tempest-UnshelveToHostMultiNodesTest-1629091521-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:32.835118 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7a05dacb-2219-45b2-8539-7b12722d98df tempest-UnshelveToHostMultiNodesTest-1629091521 tempest-UnshelveToHostMultiNodesTest-1629091521-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:32.835118 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7a05dacb-2219-45b2-8539-7b12722d98df tempest-UnshelveToHostMultiNodesTest-1629091521 tempest-UnshelveToHostMultiNodesTest-1629091521-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:32.835118 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7a05dacb-2219-45b2-8539-7b12722d98df tempest-UnshelveToHostMultiNodesTest-1629091521 tempest-UnshelveToHostMultiNodesTest-1629091521-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:32.835118 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7a05dacb-2219-45b2-8539-7b12722d98df tempest-UnshelveToHostMultiNodesTest-1629091521 tempest-UnshelveToHostMultiNodesTest-1629091521-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:32.861122 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-7a05dacb-2219-45b2-8539-7b12722d98df tempest-UnshelveToHostMultiNodesTest-1629091521 tempest-UnshelveToHostMultiNodesTest-1629091521-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 498 microversion: 2.91 time: 0.049221 Sep 23 04:39:32.866070 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1158/2265] 10.222.0.33 () {60 vars in 1217 bytes} [Fri Sep 23 04:39:32 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 498 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 04:39:32.876988 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b03cda18-f339-46f5-a71d-6f43ebd47a66 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:32.877695 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b03cda18-f339-46f5-a71d-6f43ebd47a66 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] [instance: 94fc4134-9b8e-4dcd-bd96-5545bfd51c97] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:32.885497 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b03cda18-f339-46f5-a71d-6f43ebd47a66 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:32.886210 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b03cda18-f339-46f5-a71d-6f43ebd47a66 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:32.886454 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b03cda18-f339-46f5-a71d-6f43ebd47a66 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:32.887175 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b03cda18-f339-46f5-a71d-6f43ebd47a66 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:32.887640 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b03cda18-f339-46f5-a71d-6f43ebd47a66 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:32.888140 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b03cda18-f339-46f5-a71d-6f43ebd47a66 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:33.029528 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-b03cda18-f339-46f5-a71d-6f43ebd47a66 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lazy-loading 'services' on Instance uuid 94fc4134-9b8e-4dcd-bd96-5545bfd51c97 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:39:33.069158 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b03cda18-f339-46f5-a71d-6f43ebd47a66 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97" status: 200 len: 1935 microversion: 2.75 time: 0.201274 Sep 23 04:39:33.069795 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1159/2266] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:39:32 2022] GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97 => generated 1935 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:39:33.089870 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4a48e7ca-2158-4d52-9a2b-c144082e42ac tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:39:33.090644 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4a48e7ca-2158-4d52-9a2b-c144082e42ac tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:33.104279 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4a48e7ca-2158-4d52-9a2b-c144082e42ac tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:33.104279 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4a48e7ca-2158-4d52-9a2b-c144082e42ac tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:33.104279 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4a48e7ca-2158-4d52-9a2b-c144082e42ac tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:33.104279 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4a48e7ca-2158-4d52-9a2b-c144082e42ac tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:33.105303 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4a48e7ca-2158-4d52-9a2b-c144082e42ac tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:33.105752 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4a48e7ca-2158-4d52-9a2b-c144082e42ac tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:33.111209 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:39:33.133615 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-4a48e7ca-2158-4d52-9a2b-c144082e42ac tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lazy-loading 'flavor' on Instance uuid 11ba0b77-8202-461d-8fdf-16528c7fa831 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:39:33.188113 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f41d1171-bb45-49f7-b7e2-6768028c6647 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "DELETE /compute/v2.1/servers/cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6" status: 204 len: 0 microversion: 2.1 time: 0.556803 Sep 23 04:39:33.189166 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1108/2267] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:39:32 2022] DELETE /compute/v2.1/servers/cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:39:33.205537 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7cd556bf-a0c9-4e88-9bc9-05bd16f877e2 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:33.206492 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7cd556bf-a0c9-4e88-9bc9-05bd16f877e2 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:33.224059 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7cd556bf-a0c9-4e88-9bc9-05bd16f877e2 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:33.224592 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7cd556bf-a0c9-4e88-9bc9-05bd16f877e2 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:33.225074 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7cd556bf-a0c9-4e88-9bc9-05bd16f877e2 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:33.225752 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7cd556bf-a0c9-4e88-9bc9-05bd16f877e2 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:33.226264 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7cd556bf-a0c9-4e88-9bc9-05bd16f877e2 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:33.226772 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7cd556bf-a0c9-4e88-9bc9-05bd16f877e2 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:33.457720 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-7cd556bf-a0c9-4e88-9bc9-05bd16f877e2 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:33.473654 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7cd556bf-a0c9-4e88-9bc9-05bd16f877e2 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6" status: 200 len: 1492 microversion: 2.1 time: 0.277269 Sep 23 04:39:33.475014 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1109/2268] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:33 2022] GET /compute/v2.1/servers/cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6 => generated 1492 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:33.657068 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-75102e34-86f4-46b3-a890-d2f00f925829 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:33.657704 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-75102e34-86f4-46b3-a890-d2f00f925829 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: aa35cea0-4f7f-4d03-9436-f15264b9f713] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:33.684252 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-75102e34-86f4-46b3-a890-d2f00f925829 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:33.684777 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-75102e34-86f4-46b3-a890-d2f00f925829 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:33.685225 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-75102e34-86f4-46b3-a890-d2f00f925829 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:33.687841 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-75102e34-86f4-46b3-a890-d2f00f925829 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:33.687841 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-75102e34-86f4-46b3-a890-d2f00f925829 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:33.687841 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-75102e34-86f4-46b3-a890-d2f00f925829 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:34.038737 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4a48e7ca-2158-4d52-9a2b-c144082e42ac tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "POST /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831/action" status: 202 len: 0 microversion: 2.91 time: 0.962090 Sep 23 04:39:34.040969 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1160/2269] 10.222.0.33 () {62 vars in 1319 bytes} [Fri Sep 23 04:39:33 2022] POST /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831/action => generated 0 bytes in 970 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:39:34.050002 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-75102e34-86f4-46b3-a890-d2f00f925829 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:34.058110 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:39:34.068727 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-75102e34-86f4-46b3-a890-d2f00f925829 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713" status: 200 len: 1392 microversion: 2.1 time: 0.412344 Sep 23 04:39:34.071531 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1110/2270] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:33 2022] GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713 => generated 1392 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:39:34.072547 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5b0e6522-2b1f-4df8-a09a-9280f2e3261a tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:34.074598 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-5b0e6522-2b1f-4df8-a09a-9280f2e3261a tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] [instance: 7cc18563-ad1f-4050-818b-880782814c23] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:34.086455 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-32f6e924-69d5-490a-ba1f-e46eee85b593 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:34.087375 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-32f6e924-69d5-490a-ba1f-e46eee85b593 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:34.096687 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5b0e6522-2b1f-4df8-a09a-9280f2e3261a tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:34.106733 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5b0e6522-2b1f-4df8-a09a-9280f2e3261a tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:34.110153 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5b0e6522-2b1f-4df8-a09a-9280f2e3261a tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:34.112049 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-32f6e924-69d5-490a-ba1f-e46eee85b593 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:34.114124 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5b0e6522-2b1f-4df8-a09a-9280f2e3261a tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:34.114923 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5b0e6522-2b1f-4df8-a09a-9280f2e3261a tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:34.115572 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5b0e6522-2b1f-4df8-a09a-9280f2e3261a tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:34.116485 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-32f6e924-69d5-490a-ba1f-e46eee85b593 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:34.122546 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-32f6e924-69d5-490a-ba1f-e46eee85b593 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:34.125411 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-32f6e924-69d5-490a-ba1f-e46eee85b593 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:34.126785 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-32f6e924-69d5-490a-ba1f-e46eee85b593 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:34.128719 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-32f6e924-69d5-490a-ba1f-e46eee85b593 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:34.251535 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-32f6e924-69d5-490a-ba1f-e46eee85b593 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:34.273514 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-32f6e924-69d5-490a-ba1f-e46eee85b593 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:34.273514 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-32f6e924-69d5-490a-ba1f-e46eee85b593 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:34.276379 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-32f6e924-69d5-490a-ba1f-e46eee85b593 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1537 microversion: 2.91 time: 0.202865 Sep 23 04:39:34.286065 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1111/2271] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:39:34 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1537 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:39:34.286065 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-93ee7621-7ef4-47d7-baf7-76b862a6fcc6 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:34.286065 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-93ee7621-7ef4-47d7-baf7-76b862a6fcc6 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] [instance: 94fc4134-9b8e-4dcd-bd96-5545bfd51c97] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:34.299971 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-93ee7621-7ef4-47d7-baf7-76b862a6fcc6 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:34.299971 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-93ee7621-7ef4-47d7-baf7-76b862a6fcc6 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:34.299971 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-93ee7621-7ef4-47d7-baf7-76b862a6fcc6 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:34.299971 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-93ee7621-7ef4-47d7-baf7-76b862a6fcc6 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:34.299971 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-93ee7621-7ef4-47d7-baf7-76b862a6fcc6 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:34.299971 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-93ee7621-7ef4-47d7-baf7-76b862a6fcc6 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:34.440763 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-93ee7621-7ef4-47d7-baf7-76b862a6fcc6 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lazy-loading 'services' on Instance uuid 94fc4134-9b8e-4dcd-bd96-5545bfd51c97 {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:39:34.481601 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-93ee7621-7ef4-47d7-baf7-76b862a6fcc6 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97" status: 200 len: 1935 microversion: 2.75 time: 0.202791 Sep 23 04:39:34.486039 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1112/2272] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:39:34 2022] GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97 => generated 1935 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:39:34.500620 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3f53523d-e1b7-4b19-859b-021b0a8a84fa tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:34.502908 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3f53523d-e1b7-4b19-859b-021b0a8a84fa tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:34.516713 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3f53523d-e1b7-4b19-859b-021b0a8a84fa tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:34.517629 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3f53523d-e1b7-4b19-859b-021b0a8a84fa tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:34.518184 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3f53523d-e1b7-4b19-859b-021b0a8a84fa tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:34.519144 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3f53523d-e1b7-4b19-859b-021b0a8a84fa tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:34.519838 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3f53523d-e1b7-4b19-859b-021b0a8a84fa tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:34.520358 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3f53523d-e1b7-4b19-859b-021b0a8a84fa tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:34.590405 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-5b0e6522-2b1f-4df8-a09a-9280f2e3261a tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6477e60b54491baff0a7dbee062ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc56537160d349aab8f5e6499ca8ab99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:34.621920 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5b0e6522-2b1f-4df8-a09a-9280f2e3261a tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] 10.222.0.33 "GET /compute/v2.1/servers/7cc18563-ad1f-4050-818b-880782814c23" status: 200 len: 1463 microversion: 2.1 time: 0.570440 Sep 23 04:39:34.626013 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1161/2273] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:34 2022] GET /compute/v2.1/servers/7cc18563-ad1f-4050-818b-880782814c23 => generated 1463 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:34.825044 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-3f53523d-e1b7-4b19-859b-021b0a8a84fa tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:34.835956 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3f53523d-e1b7-4b19-859b-021b0a8a84fa tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6" status: 200 len: 1492 microversion: 2.1 time: 0.340226 Sep 23 04:39:34.836993 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1113/2274] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:34 2022] GET /compute/v2.1/servers/cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6 => generated 1492 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:35.095226 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-882ca9e7-80e2-43e4-a41f-ca78d31c035e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:35.095837 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-882ca9e7-80e2-43e4-a41f-ca78d31c035e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: aa35cea0-4f7f-4d03-9436-f15264b9f713] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:35.114802 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-882ca9e7-80e2-43e4-a41f-ca78d31c035e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:35.115321 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-882ca9e7-80e2-43e4-a41f-ca78d31c035e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:35.115792 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-882ca9e7-80e2-43e4-a41f-ca78d31c035e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:35.116517 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-882ca9e7-80e2-43e4-a41f-ca78d31c035e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:35.116985 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-882ca9e7-80e2-43e4-a41f-ca78d31c035e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:35.117417 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-882ca9e7-80e2-43e4-a41f-ca78d31c035e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:35.241592 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=8 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:39:35.325998 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-882ca9e7-80e2-43e4-a41f-ca78d31c035e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:35.335329 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-882ca9e7-80e2-43e4-a41f-ca78d31c035e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713" status: 200 len: 1392 microversion: 2.1 time: 0.243276 Sep 23 04:39:35.337081 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1114/2275] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:35 2022] GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713 => generated 1392 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:35.346805 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-fd9d4572-08dc-4ec0-adaf-0ceffd2179d3 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:35.347723 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-fd9d4572-08dc-4ec0-adaf-0ceffd2179d3 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:35.356018 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fd9d4572-08dc-4ec0-adaf-0ceffd2179d3 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:35.356950 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fd9d4572-08dc-4ec0-adaf-0ceffd2179d3 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:35.357205 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fd9d4572-08dc-4ec0-adaf-0ceffd2179d3 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:35.358486 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fd9d4572-08dc-4ec0-adaf-0ceffd2179d3 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:35.358961 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fd9d4572-08dc-4ec0-adaf-0ceffd2179d3 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:35.359399 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fd9d4572-08dc-4ec0-adaf-0ceffd2179d3 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:35.369178 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2ca8cf50-c920-40f6-8176-5c4a4da407f4 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Action: 'create', calling method: .version_select at 0x7ff1bb731430>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-373578348", "policies": ["affinity"]}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:39:35.393974 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-2ca8cf50-c920-40f6-8176-5c4a4da407f4 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Getting quotas for project 8c54af2d42a04748b9c52c4a4846c03e. Resources: {'server_groups'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:39:35.401691 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-2ca8cf50-c920-40f6-8176-5c4a4da407f4 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Getting quotas for user 21d5e06dc2ba4f779359c55804ed79a8 and project 8c54af2d42a04748b9c52c4a4846c03e. Resources: {'server_groups'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:39:35.443883 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-fd9d4572-08dc-4ec0-adaf-0ceffd2179d3 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:35.454417 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-fd9d4572-08dc-4ec0-adaf-0ceffd2179d3 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:35.456269 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-fd9d4572-08dc-4ec0-adaf-0ceffd2179d3 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:35.462030 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-fd9d4572-08dc-4ec0-adaf-0ceffd2179d3 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1537 microversion: 2.91 time: 0.123400 Sep 23 04:39:35.462628 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1115/2276] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:39:35 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1537 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:39:35.521796 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3eb74c52-4f9e-4435-865c-f1787a417f29 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:35.522504 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3eb74c52-4f9e-4435-865c-f1787a417f29 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] [instance: 94fc4134-9b8e-4dcd-bd96-5545bfd51c97] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:35.527227 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-2ca8cf50-c920-40f6-8176-5c4a4da407f4 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Getting quotas for project 8c54af2d42a04748b9c52c4a4846c03e. Resources: {'server_groups'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:39:35.528655 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3eb74c52-4f9e-4435-865c-f1787a417f29 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:35.529153 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3eb74c52-4f9e-4435-865c-f1787a417f29 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:35.530275 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3eb74c52-4f9e-4435-865c-f1787a417f29 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:35.531093 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3eb74c52-4f9e-4435-865c-f1787a417f29 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:35.531458 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3eb74c52-4f9e-4435-865c-f1787a417f29 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:35.531892 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3eb74c52-4f9e-4435-865c-f1787a417f29 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:35.534475 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-2ca8cf50-c920-40f6-8176-5c4a4da407f4 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Getting quotas for user 21d5e06dc2ba4f779359c55804ed79a8 and project 8c54af2d42a04748b9c52c4a4846c03e. Resources: {'server_groups'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:39:35.551502 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2ca8cf50-c920-40f6-8176-5c4a4da407f4 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] 10.222.0.33 "POST /compute/v2.1/os-server-groups" status: 200 len: 183 microversion: 2.1 time: 0.531125 Sep 23 04:39:35.552603 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1162/2277] 10.222.0.33 () {60 vars in 1174 bytes} [Fri Sep 23 04:39:35 2022] POST /compute/v2.1/os-server-groups => generated 183 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:39:35.564792 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-273892f6-b7de-43e8-accf-0f9901386894 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Action: 'create', calling method: .version_select at 0x7ff1bb8d85e0>, body: {"server_group": {"name": "tempest-server-group-391578736", "policies": ["affinity"]}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:39:35.590642 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-273892f6-b7de-43e8-accf-0f9901386894 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Getting quotas for project 8c54af2d42a04748b9c52c4a4846c03e. Resources: {'server_groups'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:39:35.595673 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-273892f6-b7de-43e8-accf-0f9901386894 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Getting quotas for user 21d5e06dc2ba4f779359c55804ed79a8 and project 8c54af2d42a04748b9c52c4a4846c03e. Resources: {'server_groups'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:39:35.606948 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:39:35.624194 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-3eb74c52-4f9e-4435-865c-f1787a417f29 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lazy-loading 'services' on Instance uuid 94fc4134-9b8e-4dcd-bd96-5545bfd51c97 {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:39:35.651358 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3eb74c52-4f9e-4435-865c-f1787a417f29 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97" status: 200 len: 1935 microversion: 2.75 time: 0.133188 Sep 23 04:39:35.652325 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1116/2278] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:39:35 2022] GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97 => generated 1935 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:39:35.658504 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-026b8a19-9e84-44bb-950b-40bcdecc57b7 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:35.658653 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-026b8a19-9e84-44bb-950b-40bcdecc57b7 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] [instance: 7cc18563-ad1f-4050-818b-880782814c23] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:35.665613 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-026b8a19-9e84-44bb-950b-40bcdecc57b7 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:35.666466 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-026b8a19-9e84-44bb-950b-40bcdecc57b7 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:35.666731 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-026b8a19-9e84-44bb-950b-40bcdecc57b7 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:35.667436 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-026b8a19-9e84-44bb-950b-40bcdecc57b7 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:35.667982 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-026b8a19-9e84-44bb-950b-40bcdecc57b7 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:35.668410 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-026b8a19-9e84-44bb-950b-40bcdecc57b7 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:35.731344 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-273892f6-b7de-43e8-accf-0f9901386894 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Getting quotas for project 8c54af2d42a04748b9c52c4a4846c03e. Resources: {'server_groups'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:39:35.742518 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-273892f6-b7de-43e8-accf-0f9901386894 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Getting quotas for user 21d5e06dc2ba4f779359c55804ed79a8 and project 8c54af2d42a04748b9c52c4a4846c03e. Resources: {'server_groups'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:39:35.755196 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-273892f6-b7de-43e8-accf-0f9901386894 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] 10.222.0.33 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.194761 Sep 23 04:39:35.756204 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1163/2279] 10.222.0.33 () {60 vars in 1173 bytes} [Fri Sep 23 04:39:35 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:39:35.768652 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ee3eecac-6f15-45cc-af9d-b2a19530af85 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Action: 'create', calling method: .version_select at 0x7ff1bb824550>, body: {"server_group": {"name": "tempest-server-group-391578736", "policies": ["affinity"]}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:39:35.826384 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-ee3eecac-6f15-45cc-af9d-b2a19530af85 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Getting quotas for project 8c54af2d42a04748b9c52c4a4846c03e. Resources: {'server_groups'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:39:35.833656 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-ee3eecac-6f15-45cc-af9d-b2a19530af85 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Getting quotas for user 21d5e06dc2ba4f779359c55804ed79a8 and project 8c54af2d42a04748b9c52c4a4846c03e. Resources: {'server_groups'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:39:35.866466 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-026b8a19-9e84-44bb-950b-40bcdecc57b7 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6477e60b54491baff0a7dbee062ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc56537160d349aab8f5e6499ca8ab99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:35.874794 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-026b8a19-9e84-44bb-950b-40bcdecc57b7 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] 10.222.0.33 "GET /compute/v2.1/servers/7cc18563-ad1f-4050-818b-880782814c23" status: 200 len: 1463 microversion: 2.1 time: 0.221517 Sep 23 04:39:35.875383 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1117/2280] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:35 2022] GET /compute/v2.1/servers/7cc18563-ad1f-4050-818b-880782814c23 => generated 1463 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:35.880849 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7c6a1762-ea54-415c-af1e-6ed8e8bdabfd tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:35.881636 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7c6a1762-ea54-415c-af1e-6ed8e8bdabfd tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:35.895927 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7c6a1762-ea54-415c-af1e-6ed8e8bdabfd tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:35.896424 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7c6a1762-ea54-415c-af1e-6ed8e8bdabfd tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:35.896870 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7c6a1762-ea54-415c-af1e-6ed8e8bdabfd tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:35.897644 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7c6a1762-ea54-415c-af1e-6ed8e8bdabfd tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:35.898144 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7c6a1762-ea54-415c-af1e-6ed8e8bdabfd tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:35.898584 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7c6a1762-ea54-415c-af1e-6ed8e8bdabfd tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:36.067641 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-7c6a1762-ea54-415c-af1e-6ed8e8bdabfd tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:36.090274 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7c6a1762-ea54-415c-af1e-6ed8e8bdabfd tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6" status: 200 len: 1492 microversion: 2.1 time: 0.213659 Sep 23 04:39:36.092925 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1118/2281] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:35 2022] GET /compute/v2.1/servers/cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6 => generated 1492 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:36.131664 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-ee3eecac-6f15-45cc-af9d-b2a19530af85 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Getting quotas for project 8c54af2d42a04748b9c52c4a4846c03e. Resources: {'server_groups'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:39:36.144280 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-ee3eecac-6f15-45cc-af9d-b2a19530af85 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Getting quotas for user 21d5e06dc2ba4f779359c55804ed79a8 and project 8c54af2d42a04748b9c52c4a4846c03e. Resources: {'server_groups'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:39:36.168963 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ee3eecac-6f15-45cc-af9d-b2a19530af85 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] 10.222.0.33 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.405280 Sep 23 04:39:36.175555 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1164/2282] 10.222.0.33 () {60 vars in 1173 bytes} [Fri Sep 23 04:39:35 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:39:36.183081 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-dc82f748-2a38-4734-99a7-18edc5027474 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:36.360813 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-11200764-52ed-4196-9a18-d8b8f9a06997 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:36.364911 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-11200764-52ed-4196-9a18-d8b8f9a06997 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: aa35cea0-4f7f-4d03-9436-f15264b9f713] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:36.367620 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-11200764-52ed-4196-9a18-d8b8f9a06997 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:36.368136 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-11200764-52ed-4196-9a18-d8b8f9a06997 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:36.368572 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-11200764-52ed-4196-9a18-d8b8f9a06997 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:36.369280 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-11200764-52ed-4196-9a18-d8b8f9a06997 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:36.369738 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-11200764-52ed-4196-9a18-d8b8f9a06997 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:36.370517 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-11200764-52ed-4196-9a18-d8b8f9a06997 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:36.387023 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-dc82f748-2a38-4734-99a7-18edc5027474 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] 10.222.0.33 "DELETE /compute/v2.1/os-server-groups/d0f4a685-b8d8-49ed-bc22-b018e663be81" status: 204 len: 0 microversion: 2.1 time: 0.209248 Sep 23 04:39:36.391696 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1119/2283] 10.222.0.33 () {58 vars in 1266 bytes} [Fri Sep 23 04:39:36 2022] DELETE /compute/v2.1/os-server-groups/d0f4a685-b8d8-49ed-bc22-b018e663be81 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:39:36.396699 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4abac460-15dc-4c68-99dd-f95721a1e1b8 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:36.428455 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4abac460-15dc-4c68-99dd-f95721a1e1b8 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] 10.222.0.33 "GET /compute/v2.1/os-server-groups" status: 200 len: 333 microversion: 2.1 time: 0.035477 Sep 23 04:39:36.435977 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1120/2284] 10.222.0.33 () {58 vars in 1152 bytes} [Fri Sep 23 04:39:36 2022] GET /compute/v2.1/os-server-groups => generated 333 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:39:36.452991 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7f518f0a-d856-490d-9f1e-161f56c6a428 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:36.598127 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-11200764-52ed-4196-9a18-d8b8f9a06997 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:36.610567 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-11200764-52ed-4196-9a18-d8b8f9a06997 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713" status: 200 len: 1392 microversion: 2.1 time: 0.254102 Sep 23 04:39:36.617956 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7f518f0a-d856-490d-9f1e-161f56c6a428 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] 10.222.0.33 "DELETE /compute/v2.1/os-server-groups/19f6eb78-f635-4ba3-a5db-96086a219717" status: 204 len: 0 microversion: 2.1 time: 0.177621 Sep 23 04:39:36.617956 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1121/2285] 10.222.0.33 () {58 vars in 1266 bytes} [Fri Sep 23 04:39:36 2022] DELETE /compute/v2.1/os-server-groups/19f6eb78-f635-4ba3-a5db-96086a219717 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:39:36.622130 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-88ddc099-5cd5-47b8-965f-10a177b62a73 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:36.622773 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-88ddc099-5cd5-47b8-965f-10a177b62a73 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:36.634952 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1165/2286] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:36 2022] GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713 => generated 1392 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:39:36.634952 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-678b380c-631c-4969-a19c-84644206d156 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:36.635231 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:DELETE=6 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:39:36.641599 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-88ddc099-5cd5-47b8-965f-10a177b62a73 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:36.642597 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-88ddc099-5cd5-47b8-965f-10a177b62a73 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:36.653698 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-88ddc099-5cd5-47b8-965f-10a177b62a73 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:36.654771 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-88ddc099-5cd5-47b8-965f-10a177b62a73 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:36.655334 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-88ddc099-5cd5-47b8-965f-10a177b62a73 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:36.655783 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-88ddc099-5cd5-47b8-965f-10a177b62a73 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:36.672987 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-678b380c-631c-4969-a19c-84644206d156 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] 10.222.0.33 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.043164 Sep 23 04:39:36.673903 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1166/2287] 10.222.0.33 () {58 vars in 1152 bytes} [Fri Sep 23 04:39:36 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:39:36.689935 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-270967ef-773c-460e-a189-e4dd0032dcd6 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:36.690963 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-270967ef-773c-460e-a189-e4dd0032dcd6 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] [instance: 94fc4134-9b8e-4dcd-bd96-5545bfd51c97] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:36.698530 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-270967ef-773c-460e-a189-e4dd0032dcd6 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:36.699299 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-270967ef-773c-460e-a189-e4dd0032dcd6 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:36.700158 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-270967ef-773c-460e-a189-e4dd0032dcd6 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:36.702127 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-270967ef-773c-460e-a189-e4dd0032dcd6 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:36.702955 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-270967ef-773c-460e-a189-e4dd0032dcd6 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:36.703630 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-270967ef-773c-460e-a189-e4dd0032dcd6 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:36.749408 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-88ddc099-5cd5-47b8-965f-10a177b62a73 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:36.758069 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-88ddc099-5cd5-47b8-965f-10a177b62a73 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:36.759642 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-88ddc099-5cd5-47b8-965f-10a177b62a73 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:36.765434 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-88ddc099-5cd5-47b8-965f-10a177b62a73 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1537 microversion: 2.91 time: 0.147803 Sep 23 04:39:36.766251 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1122/2288] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:39:36 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1537 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:39:36.793777 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-da037e1c-e74c-485c-ba1e-6a163831cd7b tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Action: 'create', calling method: .version_select at 0x7ff1bb9173a0>, body: {"server_group": {"name": "tempest-server-group-1165195953", "policies": ["affinity"]}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:39:36.795509 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-270967ef-773c-460e-a189-e4dd0032dcd6 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] Lazy-loading 'services' on Instance uuid 94fc4134-9b8e-4dcd-bd96-5545bfd51c97 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:39:36.815452 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-270967ef-773c-460e-a189-e4dd0032dcd6 tempest-ServersAdmin275Test-1844140738 tempest-ServersAdmin275Test-1844140738-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97" status: 200 len: 1920 microversion: 2.75 time: 0.132541 Sep 23 04:39:36.826371 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1167/2289] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:39:36 2022] GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97 => generated 1920 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:39:36.847882 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-da037e1c-e74c-485c-ba1e-6a163831cd7b tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Getting quotas for project 8c54af2d42a04748b9c52c4a4846c03e. Resources: {'server_groups'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:39:36.853393 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-da037e1c-e74c-485c-ba1e-6a163831cd7b tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Getting quotas for user 21d5e06dc2ba4f779359c55804ed79a8 and project 8c54af2d42a04748b9c52c4a4846c03e. Resources: {'server_groups'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:39:36.858615 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c2a20c20-0e01-4760-be01-43762fcf3d62 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:36.859311 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c2a20c20-0e01-4760-be01-43762fcf3d62 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] [instance: 94fc4134-9b8e-4dcd-bd96-5545bfd51c97] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:36.867352 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c2a20c20-0e01-4760-be01-43762fcf3d62 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:36.867890 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c2a20c20-0e01-4760-be01-43762fcf3d62 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:36.868326 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c2a20c20-0e01-4760-be01-43762fcf3d62 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:36.869520 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c2a20c20-0e01-4760-be01-43762fcf3d62 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:36.870003 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c2a20c20-0e01-4760-be01-43762fcf3d62 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:36.870424 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c2a20c20-0e01-4760-be01-43762fcf3d62 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:36.908584 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c2a20c20-0e01-4760-be01-43762fcf3d62 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] [instance: 94fc4134-9b8e-4dcd-bd96-5545bfd51c97] Going to try to terminate instance {{(pid=122699) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:39:37.011724 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-da037e1c-e74c-485c-ba1e-6a163831cd7b tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Getting quotas for project 8c54af2d42a04748b9c52c4a4846c03e. Resources: {'server_groups'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:39:37.018547 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-da037e1c-e74c-485c-ba1e-6a163831cd7b tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Getting quotas for user 21d5e06dc2ba4f779359c55804ed79a8 and project 8c54af2d42a04748b9c52c4a4846c03e. Resources: {'server_groups'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:39:37.064236 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-da037e1c-e74c-485c-ba1e-6a163831cd7b tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] 10.222.0.33 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.284918 Sep 23 04:39:37.075410 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1123/2290] 10.222.0.33 () {60 vars in 1173 bytes} [Fri Sep 23 04:39:36 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:39:37.082912 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d7df9bc4-40e3-4f9c-859b-0eede8ec3ee6 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:37.086097 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d7df9bc4-40e3-4f9c-859b-0eede8ec3ee6 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] [instance: 7cc18563-ad1f-4050-818b-880782814c23] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:37.102918 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d7df9bc4-40e3-4f9c-859b-0eede8ec3ee6 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:37.103668 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d7df9bc4-40e3-4f9c-859b-0eede8ec3ee6 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:37.104348 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d7df9bc4-40e3-4f9c-859b-0eede8ec3ee6 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:37.105301 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d7df9bc4-40e3-4f9c-859b-0eede8ec3ee6 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:37.115974 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d7df9bc4-40e3-4f9c-859b-0eede8ec3ee6 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:37.118694 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d7df9bc4-40e3-4f9c-859b-0eede8ec3ee6 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:37.213233 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d7df9bc4-40e3-4f9c-859b-0eede8ec3ee6 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6477e60b54491baff0a7dbee062ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc56537160d349aab8f5e6499ca8ab99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:37.235786 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d7df9bc4-40e3-4f9c-859b-0eede8ec3ee6 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] 10.222.0.33 "GET /compute/v2.1/servers/7cc18563-ad1f-4050-818b-880782814c23" status: 200 len: 1421 microversion: 2.1 time: 0.150995 Sep 23 04:39:37.235786 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1124/2291] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:37 2022] GET /compute/v2.1/servers/7cc18563-ad1f-4050-818b-880782814c23 => generated 1421 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:37.235786 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-771e180e-14d1-4963-bdb8-e74c03e5b58a tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:37.369019 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-771e180e-14d1-4963-bdb8-e74c03e5b58a tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] 10.222.0.33 "DELETE /compute/v2.1/os-server-groups/0fd904e7-7ee0-46d1-a062-6ce539a9f36f" status: 204 len: 0 microversion: 2.1 time: 0.142780 Sep 23 04:39:37.370225 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1125/2292] 10.222.0.33 () {58 vars in 1266 bytes} [Fri Sep 23 04:39:37 2022] DELETE /compute/v2.1/os-server-groups/0fd904e7-7ee0-46d1-a062-6ce539a9f36f => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:39:37.376224 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-6dbe9024-84ee-4bdc-9494-6c1b536e122d req-fb28c4d7-103d-4604-8a25-3d32c50c2e2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cc18563-ad1f-4050-818b-880782814c23", "name": "network-vif-deleted", "tag": "144b628b-c2cf-4574-a054-4e019408e692"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:39:37.391979 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-6dbe9024-84ee-4bdc-9494-6c1b536e122d req-fb28c4d7-103d-4604-8a25-3d32c50c2e2b service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:37.392560 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-6dbe9024-84ee-4bdc-9494-6c1b536e122d req-fb28c4d7-103d-4604-8a25-3d32c50c2e2b service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:37.394266 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-6dbe9024-84ee-4bdc-9494-6c1b536e122d req-fb28c4d7-103d-4604-8a25-3d32c50c2e2b service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:37.409163 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-6dbe9024-84ee-4bdc-9494-6c1b536e122d req-fb28c4d7-103d-4604-8a25-3d32c50c2e2b service nova] Creating event network-vif-deleted:144b628b-c2cf-4574-a054-4e019408e692 for instance 7cc18563-ad1f-4050-818b-880782814c23 on n-h2-846463-3 Sep 23 04:39:37.414411 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-6dbe9024-84ee-4bdc-9494-6c1b536e122d req-fb28c4d7-103d-4604-8a25-3d32c50c2e2b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042608 Sep 23 04:39:37.415858 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1126/2293] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:39:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:39:37.422626 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2e6307a6-19a6-4f94-b04a-fd739eae081d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:37.423881 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-2e6307a6-19a6-4f94-b04a-fd739eae081d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:37.430179 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2e6307a6-19a6-4f94-b04a-fd739eae081d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:37.430724 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2e6307a6-19a6-4f94-b04a-fd739eae081d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:37.431255 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2e6307a6-19a6-4f94-b04a-fd739eae081d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:37.432388 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2e6307a6-19a6-4f94-b04a-fd739eae081d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:37.433101 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2e6307a6-19a6-4f94-b04a-fd739eae081d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:37.434926 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2e6307a6-19a6-4f94-b04a-fd739eae081d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:37.505750 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c2a20c20-0e01-4760-be01-43762fcf3d62 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] 10.222.0.33 "DELETE /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97" status: 204 len: 0 microversion: 2.75 time: 0.651806 Sep 23 04:39:37.511421 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1168/2294] 10.222.0.33 () {60 vars in 1280 bytes} [Fri Sep 23 04:39:36 2022] DELETE /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97 => generated 0 bytes in 658 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 23 04:39:37.516958 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-2e6307a6-19a6-4f94-b04a-fd739eae081d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:37.549990 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2e6307a6-19a6-4f94-b04a-fd739eae081d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6" status: 200 len: 1450 microversion: 2.1 time: 0.114087 Sep 23 04:39:37.549990 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1127/2295] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:37 2022] GET /compute/v2.1/servers/cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6 => generated 1450 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:37.549990 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-bc6b3143-6ebd-4ddf-ac28-dea0df5d0141 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:37.549990 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-bc6b3143-6ebd-4ddf-ac28-dea0df5d0141 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] [instance: 94fc4134-9b8e-4dcd-bd96-5545bfd51c97] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:37.549990 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bc6b3143-6ebd-4ddf-ac28-dea0df5d0141 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:37.549990 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bc6b3143-6ebd-4ddf-ac28-dea0df5d0141 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:37.549990 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bc6b3143-6ebd-4ddf-ac28-dea0df5d0141 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:37.549990 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bc6b3143-6ebd-4ddf-ac28-dea0df5d0141 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:37.552363 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bc6b3143-6ebd-4ddf-ac28-dea0df5d0141 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:37.552363 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bc6b3143-6ebd-4ddf-ac28-dea0df5d0141 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:37.555211 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e43c8848-63f3-45c4-b20e-94c5ce6e4891 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:37.599296 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e43c8848-63f3-45c4-b20e-94c5ce6e4891 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] 10.222.0.33 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.076177 Sep 23 04:39:37.609739 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1169/2296] 10.222.0.33 () {58 vars in 1152 bytes} [Fri Sep 23 04:39:37 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:39:37.622426 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-442a2443-c649-4e76-bf55-9475bbf090fe tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Action: 'create', calling method: .version_select at 0x7ff1bb733310>, body: {"server_group": {"name": "tempest-server-group-1569228534", "policies": ["anti-affinity"]}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:39:37.644789 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-442a2443-c649-4e76-bf55-9475bbf090fe tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Getting quotas for project 8c54af2d42a04748b9c52c4a4846c03e. Resources: {'server_groups'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:39:37.644920 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-bc6b3143-6ebd-4ddf-ac28-dea0df5d0141 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:37.651040 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-442a2443-c649-4e76-bf55-9475bbf090fe tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Getting quotas for user 21d5e06dc2ba4f779359c55804ed79a8 and project 8c54af2d42a04748b9c52c4a4846c03e. Resources: {'server_groups'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:39:37.655574 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-bc6b3143-6ebd-4ddf-ac28-dea0df5d0141 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:37.657055 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-bc6b3143-6ebd-4ddf-ac28-dea0df5d0141 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:37.663319 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-bc6b3143-6ebd-4ddf-ac28-dea0df5d0141 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] 10.222.0.33 "GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97" status: 200 len: 1444 microversion: 2.75 time: 0.129483 Sep 23 04:39:37.663960 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1128/2297] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:39:37 2022] GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97 => generated 1444 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:39:37.677927 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6892265e-65cf-459b-932c-0d4acdc33a1e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:37.677927 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-6892265e-65cf-459b-932c-0d4acdc33a1e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: aa35cea0-4f7f-4d03-9436-f15264b9f713] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:37.677927 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6892265e-65cf-459b-932c-0d4acdc33a1e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:37.684773 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6892265e-65cf-459b-932c-0d4acdc33a1e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:37.685696 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6892265e-65cf-459b-932c-0d4acdc33a1e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:37.687092 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6892265e-65cf-459b-932c-0d4acdc33a1e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:37.688838 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6892265e-65cf-459b-932c-0d4acdc33a1e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:37.695971 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6892265e-65cf-459b-932c-0d4acdc33a1e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:37.818854 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-442a2443-c649-4e76-bf55-9475bbf090fe tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Getting quotas for project 8c54af2d42a04748b9c52c4a4846c03e. Resources: {'server_groups'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:39:37.831431 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-442a2443-c649-4e76-bf55-9475bbf090fe tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Getting quotas for user 21d5e06dc2ba4f779359c55804ed79a8 and project 8c54af2d42a04748b9c52c4a4846c03e. Resources: {'server_groups'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:39:37.891257 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-442a2443-c649-4e76-bf55-9475bbf090fe tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] 10.222.0.33 "POST /compute/v2.1/os-server-groups" status: 200 len: 169 microversion: 2.1 time: 0.273779 Sep 23 04:39:37.891257 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1170/2298] 10.222.0.33 () {60 vars in 1173 bytes} [Fri Sep 23 04:39:37 2022] POST /compute/v2.1/os-server-groups => generated 169 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:39:37.903743 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e305fda0-2c88-4029-badc-7977b05ce5bd tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:37.906214 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e305fda0-2c88-4029-badc-7977b05ce5bd tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:37.917451 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e305fda0-2c88-4029-badc-7977b05ce5bd tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:37.919868 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e305fda0-2c88-4029-badc-7977b05ce5bd tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:37.919868 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e305fda0-2c88-4029-badc-7977b05ce5bd tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:37.920415 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e305fda0-2c88-4029-badc-7977b05ce5bd tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:37.920989 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e305fda0-2c88-4029-badc-7977b05ce5bd tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:37.921581 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e305fda0-2c88-4029-badc-7977b05ce5bd tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:37.963260 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6892265e-65cf-459b-932c-0d4acdc33a1e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:37.978615 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-6892265e-65cf-459b-932c-0d4acdc33a1e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713" status: 200 len: 1392 microversion: 2.1 time: 0.313385 Sep 23 04:39:37.994044 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1129/2299] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:37 2022] GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713 => generated 1392 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:38.010817 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-fb1a10b3-bfc0-417b-86a8-f94e8e8d3b99 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:38.072646 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e305fda0-2c88-4029-badc-7977b05ce5bd tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:38.084312 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e305fda0-2c88-4029-badc-7977b05ce5bd tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:38.088224 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e305fda0-2c88-4029-badc-7977b05ce5bd tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:38.095453 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e305fda0-2c88-4029-badc-7977b05ce5bd tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1537 microversion: 2.91 time: 0.198782 Sep 23 04:39:38.106442 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1171/2300] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:39:37 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1537 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:39:38.204055 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-fb1a10b3-bfc0-417b-86a8-f94e8e8d3b99 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] 10.222.0.33 "DELETE /compute/v2.1/os-server-groups/33d68a52-0f07-4540-a8b3-bad376eb2e78" status: 204 len: 0 microversion: 2.1 time: 0.207662 Sep 23 04:39:38.204979 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1130/2301] 10.222.0.33 () {58 vars in 1266 bytes} [Fri Sep 23 04:39:37 2022] DELETE /compute/v2.1/os-server-groups/33d68a52-0f07-4540-a8b3-bad376eb2e78 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:39:38.213670 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6b6cb339-0f6a-430b-97ae-5f1a43172754 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:38.224316 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6b6cb339-0f6a-430b-97ae-5f1a43172754 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] 10.222.0.33 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.014608 Sep 23 04:39:38.225098 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1172/2302] 10.222.0.33 () {58 vars in 1152 bytes} [Fri Sep 23 04:39:38 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:39:38.251496 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e0876605-9b6d-4125-9515-19745e2e70c9 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:38.252229 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e0876605-9b6d-4125-9515-19745e2e70c9 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] [instance: 7cc18563-ad1f-4050-818b-880782814c23] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:38.266758 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e0876605-9b6d-4125-9515-19745e2e70c9 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:38.267358 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e0876605-9b6d-4125-9515-19745e2e70c9 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:38.267810 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e0876605-9b6d-4125-9515-19745e2e70c9 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:38.268536 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e0876605-9b6d-4125-9515-19745e2e70c9 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:38.270187 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e0876605-9b6d-4125-9515-19745e2e70c9 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:38.270973 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e0876605-9b6d-4125-9515-19745e2e70c9 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:38.322217 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e0876605-9b6d-4125-9515-19745e2e70c9 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:38.322217 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e0876605-9b6d-4125-9515-19745e2e70c9 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:38.322499 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e0876605-9b6d-4125-9515-19745e2e70c9 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:38.323007 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-e0876605-9b6d-4125-9515-19745e2e70c9 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lazy-loading 'fault' on Instance uuid 7cc18563-ad1f-4050-818b-880782814c23 {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:39:38.399057 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e0876605-9b6d-4125-9515-19745e2e70c9 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6477e60b54491baff0a7dbee062ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc56537160d349aab8f5e6499ca8ab99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:38.415762 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e0876605-9b6d-4125-9515-19745e2e70c9 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] 10.222.0.33 "GET /compute/v2.1/servers/7cc18563-ad1f-4050-818b-880782814c23" status: 200 len: 1307 microversion: 2.1 time: 0.168230 Sep 23 04:39:38.435309 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1131/2303] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:38 2022] GET /compute/v2.1/servers/7cc18563-ad1f-4050-818b-880782814c23 => generated 1307 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:38.512670 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7b51e4fd-856d-475d-bae5-b130275d3c15 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-2052371455", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "networks": [{"uuid": "a672c6f5-7d69-4e6a-bfb2-257028d8821b"}]}, "os:scheduler_hints": {"group": "9a387ef9-8706-4119-8155-93d3e8f66e16"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:39:38.564024 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-da8102f6-d604-490c-9580-95775281efae tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:38.564758 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-da8102f6-d604-490c-9580-95775281efae tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:38.571150 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-da8102f6-d604-490c-9580-95775281efae tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:38.571791 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-da8102f6-d604-490c-9580-95775281efae tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:38.572241 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-da8102f6-d604-490c-9580-95775281efae tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:38.573013 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-da8102f6-d604-490c-9580-95775281efae tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:38.573541 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-da8102f6-d604-490c-9580-95775281efae tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:38.573914 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-da8102f6-d604-490c-9580-95775281efae tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:38.590503 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.neutron [None req-7b51e4fd-856d-475d-bae5-b130275d3c15 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] validate_networks() for [('a672c6f5-7d69-4e6a-bfb2-257028d8821b', None, None, None, None, None)] {{(pid=122699) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:39:38.615643 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-da8102f6-d604-490c-9580-95775281efae tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:38.616138 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-da8102f6-d604-490c-9580-95775281efae tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:38.616580 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-da8102f6-d604-490c-9580-95775281efae tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:38.617036 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-da8102f6-d604-490c-9580-95775281efae tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lazy-loading 'fault' on Instance uuid cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6 {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:39:38.696436 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-da8102f6-d604-490c-9580-95775281efae tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:38.698762 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=100 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:39:38.710496 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-da8102f6-d604-490c-9580-95775281efae tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6" status: 200 len: 1305 microversion: 2.1 time: 0.151237 Sep 23 04:39:38.711155 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1132/2304] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:38 2022] GET /compute/v2.1/servers/cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6 => generated 1305 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:38.715677 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a24d7268-88e7-4fa0-96da-ff0dafed920b tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:38.716288 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a24d7268-88e7-4fa0-96da-ff0dafed920b tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] [instance: 94fc4134-9b8e-4dcd-bd96-5545bfd51c97] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:38.731267 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a24d7268-88e7-4fa0-96da-ff0dafed920b tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:38.731706 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a24d7268-88e7-4fa0-96da-ff0dafed920b tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:38.732804 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a24d7268-88e7-4fa0-96da-ff0dafed920b tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:38.733439 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a24d7268-88e7-4fa0-96da-ff0dafed920b tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:38.733938 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a24d7268-88e7-4fa0-96da-ff0dafed920b tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:38.734436 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a24d7268-88e7-4fa0-96da-ff0dafed920b tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:38.865393 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a24d7268-88e7-4fa0-96da-ff0dafed920b tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:38.877111 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a24d7268-88e7-4fa0-96da-ff0dafed920b tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:38.879349 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a24d7268-88e7-4fa0-96da-ff0dafed920b tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:38.887568 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a24d7268-88e7-4fa0-96da-ff0dafed920b tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] 10.222.0.33 "GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97" status: 200 len: 1444 microversion: 2.75 time: 0.175459 Sep 23 04:39:38.888152 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1133/2305] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:39:38 2022] GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97 => generated 1444 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:39:39.002872 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-abb71a70-a38f-45fa-8656-10dd5cdfe69f tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:39.003590 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-abb71a70-a38f-45fa-8656-10dd5cdfe69f tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: aa35cea0-4f7f-4d03-9436-f15264b9f713] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:39.010017 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-abb71a70-a38f-45fa-8656-10dd5cdfe69f tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:39.010649 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-abb71a70-a38f-45fa-8656-10dd5cdfe69f tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:39.011255 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-abb71a70-a38f-45fa-8656-10dd5cdfe69f tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:39.012109 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-abb71a70-a38f-45fa-8656-10dd5cdfe69f tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:39.012725 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-abb71a70-a38f-45fa-8656-10dd5cdfe69f tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:39.013149 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-abb71a70-a38f-45fa-8656-10dd5cdfe69f tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:39.195256 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-7b51e4fd-856d-475d-bae5-b130275d3c15 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Flavor limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:39:39.195724 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-7b51e4fd-856d-475d-bae5-b130275d3c15 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Image limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:39:39.196355 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-7b51e4fd-856d-475d-bae5-b130275d3c15 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Flavor pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:39:39.196820 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-7b51e4fd-856d-475d-bae5-b130275d3c15 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Image pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:39:39.197269 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-7b51e4fd-856d-475d-bae5-b130275d3c15 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:39:39.209296 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:39:39.220677 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7b51e4fd-856d-475d-bae5-b130275d3c15 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:39.221205 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7b51e4fd-856d-475d-bae5-b130275d3c15 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:39.221776 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7b51e4fd-856d-475d-bae5-b130275d3c15 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:39.222597 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7b51e4fd-856d-475d-bae5-b130275d3c15 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:39.222778 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-abb71a70-a38f-45fa-8656-10dd5cdfe69f tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:39.223062 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7b51e4fd-856d-475d-bae5-b130275d3c15 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:39.223505 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7b51e4fd-856d-475d-bae5-b130275d3c15 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:39.231663 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-abb71a70-a38f-45fa-8656-10dd5cdfe69f tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713" status: 200 len: 1392 microversion: 2.1 time: 0.232899 Sep 23 04:39:39.232863 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1134/2306] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:38 2022] GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713 => generated 1392 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:39:39.242013 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ba3e1122-b6b8-483b-bc43-683f91315cf7 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:39.242013 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-ba3e1122-b6b8-483b-bc43-683f91315cf7 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:39.247492 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-7b51e4fd-856d-475d-bae5-b130275d3c15 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Getting quotas for project 8c54af2d42a04748b9c52c4a4846c03e. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:39:39.253487 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-7b51e4fd-856d-475d-bae5-b130275d3c15 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Getting quotas for user 21d5e06dc2ba4f779359c55804ed79a8 and project 8c54af2d42a04748b9c52c4a4846c03e. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:39:39.254492 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ba3e1122-b6b8-483b-bc43-683f91315cf7 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:39.255661 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ba3e1122-b6b8-483b-bc43-683f91315cf7 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:39.256293 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ba3e1122-b6b8-483b-bc43-683f91315cf7 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:39.260740 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ba3e1122-b6b8-483b-bc43-683f91315cf7 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:39.260740 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ba3e1122-b6b8-483b-bc43-683f91315cf7 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:39.260740 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ba3e1122-b6b8-483b-bc43-683f91315cf7 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:39.284314 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-7b51e4fd-856d-475d-bae5-b130275d3c15 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Going to run 1 instances... {{(pid=122699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:39:39.290055 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-7b51e4fd-856d-475d-bae5-b130275d3c15 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] [instance: 82f0e20e-0209-42dc-bbdc-15d6c0c030d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:39:39.349681 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ba3e1122-b6b8-483b-bc43-683f91315cf7 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:39.359863 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ba3e1122-b6b8-483b-bc43-683f91315cf7 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:39.361247 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ba3e1122-b6b8-483b-bc43-683f91315cf7 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:39.369907 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ba3e1122-b6b8-483b-bc43-683f91315cf7 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1537 microversion: 2.91 time: 0.134727 Sep 23 04:39:39.370764 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1135/2307] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:39:39 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1537 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:39:39.440137 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-74b14a8e-7d85-47af-a506-9dab76da9d9a req-5e851772-2296-498f-ac25-8e41f0d408b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6", "name": "network-vif-deleted", "tag": "c738b507-0460-44ab-8aa6-5019592de190"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:39:39.453615 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-74b14a8e-7d85-47af-a506-9dab76da9d9a req-5e851772-2296-498f-ac25-8e41f0d408b6 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:39.454550 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-74b14a8e-7d85-47af-a506-9dab76da9d9a req-5e851772-2296-498f-ac25-8e41f0d408b6 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:39.456164 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-74b14a8e-7d85-47af-a506-9dab76da9d9a req-5e851772-2296-498f-ac25-8e41f0d408b6 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:39.471069 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-74b14a8e-7d85-47af-a506-9dab76da9d9a req-5e851772-2296-498f-ac25-8e41f0d408b6 service nova] Creating event network-vif-deleted:c738b507-0460-44ab-8aa6-5019592de190 for instance cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6 on n-h2-846463-3 Sep 23 04:39:39.477946 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-74b14a8e-7d85-47af-a506-9dab76da9d9a req-5e851772-2296-498f-ac25-8e41f0d408b6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044856 Sep 23 04:39:39.479256 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1136/2308] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:39:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:39:39.488698 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-55ed9210-d48b-4831-acbe-f0df6d8372c4 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:39.489858 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-55ed9210-d48b-4831-acbe-f0df6d8372c4 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] [instance: 7cc18563-ad1f-4050-818b-880782814c23] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:39.497706 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-55ed9210-d48b-4831-acbe-f0df6d8372c4 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:39.498246 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-55ed9210-d48b-4831-acbe-f0df6d8372c4 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:39.498689 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-55ed9210-d48b-4831-acbe-f0df6d8372c4 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:39.499419 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-55ed9210-d48b-4831-acbe-f0df6d8372c4 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:39.500198 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-55ed9210-d48b-4831-acbe-f0df6d8372c4 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:39.500628 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-55ed9210-d48b-4831-acbe-f0df6d8372c4 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:39.537944 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-55ed9210-d48b-4831-acbe-f0df6d8372c4 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:39.538478 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-55ed9210-d48b-4831-acbe-f0df6d8372c4 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:39.538928 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-55ed9210-d48b-4831-acbe-f0df6d8372c4 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:39.539389 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-55ed9210-d48b-4831-acbe-f0df6d8372c4 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lazy-loading 'fault' on Instance uuid 7cc18563-ad1f-4050-818b-880782814c23 {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:39:39.593570 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-7b51e4fd-856d-475d-bae5-b130275d3c15 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Getting quotas for project 8c54af2d42a04748b9c52c4a4846c03e. Resources: {'server_group_members'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:39:39.601506 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-7b51e4fd-856d-475d-bae5-b130275d3c15 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Getting quotas for user 21d5e06dc2ba4f779359c55804ed79a8 and project 8c54af2d42a04748b9c52c4a4846c03e. Resources: {'server_group_members'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:39:39.610763 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-55ed9210-d48b-4831-acbe-f0df6d8372c4 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6477e60b54491baff0a7dbee062ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc56537160d349aab8f5e6499ca8ab99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:39.624029 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-55ed9210-d48b-4831-acbe-f0df6d8372c4 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] 10.222.0.33 "GET /compute/v2.1/servers/7cc18563-ad1f-4050-818b-880782814c23" status: 200 len: 1307 microversion: 2.1 time: 0.140065 Sep 23 04:39:39.624621 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1137/2309] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:39 2022] GET /compute/v2.1/servers/7cc18563-ad1f-4050-818b-880782814c23 => generated 1307 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:39.740954 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-149b9650-01fc-4cd9-9cb6-b91866c64f39 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:39.741617 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-149b9650-01fc-4cd9-9cb6-b91866c64f39 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:39.750436 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-149b9650-01fc-4cd9-9cb6-b91866c64f39 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:39.751309 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-149b9650-01fc-4cd9-9cb6-b91866c64f39 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:39.752989 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-149b9650-01fc-4cd9-9cb6-b91866c64f39 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:39.756358 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-149b9650-01fc-4cd9-9cb6-b91866c64f39 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:39.756358 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-149b9650-01fc-4cd9-9cb6-b91866c64f39 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:39.756358 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-149b9650-01fc-4cd9-9cb6-b91866c64f39 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:39.759693 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-7b51e4fd-856d-475d-bae5-b130275d3c15 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Getting quotas for project 8c54af2d42a04748b9c52c4a4846c03e. Resources: {'server_group_members'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:39:39.768863 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-7b51e4fd-856d-475d-bae5-b130275d3c15 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Getting quotas for user 21d5e06dc2ba4f779359c55804ed79a8 and project 8c54af2d42a04748b9c52c4a4846c03e. Resources: {'server_group_members'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:39:39.792713 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-149b9650-01fc-4cd9-9cb6-b91866c64f39 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:39.793326 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-149b9650-01fc-4cd9-9cb6-b91866c64f39 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:39.793768 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-149b9650-01fc-4cd9-9cb6-b91866c64f39 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:39.794387 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-149b9650-01fc-4cd9-9cb6-b91866c64f39 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lazy-loading 'fault' on Instance uuid cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6 {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:39:39.797921 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-7b51e4fd-856d-475d-bae5-b130275d3c15 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.288927 Sep 23 04:39:39.800505 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1173/2310] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:39:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1291 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:39:39.813697 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7c944550-a32d-47ec-bbce-57c2b486810b tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:39.814910 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-7c944550-a32d-47ec-bbce-57c2b486810b tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] [instance: 82f0e20e-0209-42dc-bbdc-15d6c0c030d8] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:39.872168 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-149b9650-01fc-4cd9-9cb6-b91866c64f39 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:39.888966 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-149b9650-01fc-4cd9-9cb6-b91866c64f39 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6" status: 200 len: 1305 microversion: 2.1 time: 0.149822 Sep 23 04:39:39.898082 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1138/2311] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:39 2022] GET /compute/v2.1/servers/cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6 => generated 1305 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:39.919158 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-7c944550-a32d-47ec-bbce-57c2b486810b tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d5e06dc2ba4f779359c55804ed79a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c54af2d42a04748b9c52c4a4846c03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:39.923195 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b98ff132-7c77-452a-adcf-d8d0fa80bcdb tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:39.924513 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b98ff132-7c77-452a-adcf-d8d0fa80bcdb tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] [instance: 94fc4134-9b8e-4dcd-bd96-5545bfd51c97] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:39.927189 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-7c944550-a32d-47ec-bbce-57c2b486810b tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] 10.222.0.33 "GET /compute/v2.1/servers/82f0e20e-0209-42dc-bbdc-15d6c0c030d8" status: 200 len: 1213 microversion: 2.1 time: 0.119907 Sep 23 04:39:39.929138 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1174/2312] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:39 2022] GET /compute/v2.1/servers/82f0e20e-0209-42dc-bbdc-15d6c0c030d8 => generated 1213 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:39.943643 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b98ff132-7c77-452a-adcf-d8d0fa80bcdb tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:39.944380 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b98ff132-7c77-452a-adcf-d8d0fa80bcdb tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:39.945036 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b98ff132-7c77-452a-adcf-d8d0fa80bcdb tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:39.945971 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b98ff132-7c77-452a-adcf-d8d0fa80bcdb tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:39.946627 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b98ff132-7c77-452a-adcf-d8d0fa80bcdb tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:39.947672 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b98ff132-7c77-452a-adcf-d8d0fa80bcdb tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:39.993462 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b98ff132-7c77-452a-adcf-d8d0fa80bcdb tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:39.994153 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b98ff132-7c77-452a-adcf-d8d0fa80bcdb tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:39.994731 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b98ff132-7c77-452a-adcf-d8d0fa80bcdb tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:39.995306 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-b98ff132-7c77-452a-adcf-d8d0fa80bcdb tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lazy-loading 'fault' on Instance uuid 94fc4134-9b8e-4dcd-bd96-5545bfd51c97 {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:39:40.042640 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b98ff132-7c77-452a-adcf-d8d0fa80bcdb tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:40.051558 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b98ff132-7c77-452a-adcf-d8d0fa80bcdb tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:40.053386 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b98ff132-7c77-452a-adcf-d8d0fa80bcdb tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6504948146c94487a7357025b8e47860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b05671a2f19d42d49aa676680e998b33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:40.062200 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b98ff132-7c77-452a-adcf-d8d0fa80bcdb tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] 10.222.0.33 "GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97" status: 200 len: 1449 microversion: 2.75 time: 0.145362 Sep 23 04:39:40.064376 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1139/2313] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:39:39 2022] GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97 => generated 1449 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:39:40.256368 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-daf8aafb-1998-47f4-aefb-4e849ac2efba tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:40.257141 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-daf8aafb-1998-47f4-aefb-4e849ac2efba tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: aa35cea0-4f7f-4d03-9436-f15264b9f713] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:40.270966 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-daf8aafb-1998-47f4-aefb-4e849ac2efba tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:40.270966 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-daf8aafb-1998-47f4-aefb-4e849ac2efba tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:40.270966 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-daf8aafb-1998-47f4-aefb-4e849ac2efba tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:40.270966 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-daf8aafb-1998-47f4-aefb-4e849ac2efba tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:40.270966 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-daf8aafb-1998-47f4-aefb-4e849ac2efba tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:40.270966 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-daf8aafb-1998-47f4-aefb-4e849ac2efba tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:40.400056 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-cd522c60-90f8-4190-9b7a-8de2a17b2304 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:40.400914 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-cd522c60-90f8-4190-9b7a-8de2a17b2304 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:40.407699 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cd522c60-90f8-4190-9b7a-8de2a17b2304 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:40.408270 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cd522c60-90f8-4190-9b7a-8de2a17b2304 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:40.408661 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cd522c60-90f8-4190-9b7a-8de2a17b2304 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:40.409358 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cd522c60-90f8-4190-9b7a-8de2a17b2304 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:40.410029 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cd522c60-90f8-4190-9b7a-8de2a17b2304 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:40.410454 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cd522c60-90f8-4190-9b7a-8de2a17b2304 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:40.412300 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-daf8aafb-1998-47f4-aefb-4e849ac2efba tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:40.421728 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-daf8aafb-1998-47f4-aefb-4e849ac2efba tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713" status: 200 len: 1392 microversion: 2.1 time: 0.169171 Sep 23 04:39:40.422691 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1175/2314] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:40 2022] GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713 => generated 1392 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:40.485547 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-cd522c60-90f8-4190-9b7a-8de2a17b2304 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:40.494633 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-cd522c60-90f8-4190-9b7a-8de2a17b2304 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:40.496484 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-cd522c60-90f8-4190-9b7a-8de2a17b2304 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:40.503009 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-cd522c60-90f8-4190-9b7a-8de2a17b2304 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1537 microversion: 2.91 time: 0.106965 Sep 23 04:39:40.503770 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1140/2315] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:39:40 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1537 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:39:40.651078 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-bde2d42f-1ae6-4915-bf1a-0d7ff3d02e18 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:40.651929 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-bde2d42f-1ae6-4915-bf1a-0d7ff3d02e18 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] [instance: 7cc18563-ad1f-4050-818b-880782814c23] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:40.660725 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bde2d42f-1ae6-4915-bf1a-0d7ff3d02e18 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:40.662169 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bde2d42f-1ae6-4915-bf1a-0d7ff3d02e18 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:40.662722 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bde2d42f-1ae6-4915-bf1a-0d7ff3d02e18 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:40.663521 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bde2d42f-1ae6-4915-bf1a-0d7ff3d02e18 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:40.664178 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bde2d42f-1ae6-4915-bf1a-0d7ff3d02e18 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:40.664760 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bde2d42f-1ae6-4915-bf1a-0d7ff3d02e18 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:40.681302 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-bde2d42f-1ae6-4915-bf1a-0d7ff3d02e18 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] HTTP exception thrown: Instance 7cc18563-ad1f-4050-818b-880782814c23 could not be found. Sep 23 04:39:40.682915 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-bde2d42f-1ae6-4915-bf1a-0d7ff3d02e18 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Request method failure captured: Sep 23 04:39:40.682915 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/7cc18563-ad1f-4050-818b-880782814c23 HTTP/1.1 Sep 23 04:39:40.682915 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:39:40.682915 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:39:40.682915 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:39:40.682915 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:39:40.682915 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:39:40.682915 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:39:40.682915 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:39:40.682915 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:39:40.682915 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLThUG8HOQwskXefZrwmW_drWoLJPaI8O_WwFaWB2iivDn_ISOhNd_f8rahPeDc7j4hAXXXsJjlptuXYOZj6E34_ZmtFdvFrv1cXUCfeRYnC5V5di-PRHzG4dyCtKPiuqZ44tlPJujkpLqDq6dDyZaqsVMpY3zarZr91itPtEKKGwUw8 Sep 23 04:39:40.682915 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:39:40.682915 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:39:40.682915 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:39:40.682915 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:39:40.682915 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:39:40.682915 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:39:40.682915 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: fc56537160d349aab8f5e6499ca8ab99 Sep 23 04:39:40.682915 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-LiveMigrationNegativeTest-459864214 Sep 23 04:39:40.682915 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:39:40.682915 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:39:40.682915 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fc56537160d349aab8f5e6499ca8ab99", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fc56537160d349aab8f5e6499ca8ab99"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fc56537160d349aab8f5e6499ca8ab99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fc56537160d349aab8f5e6499ca8ab99"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:39:40.682915 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-LiveMigrationNegativeTest-459864214 Sep 23 04:39:40.682915 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: fc56537160d349aab8f5e6499ca8ab99 Sep 23 04:39:40.682915 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-459864214 Sep 23 04:39:40.682915 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-LiveMigrationNegativeTest-459864214-project Sep 23 04:39:40.682915 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:39:40.682915 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:39:40.682915 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: ee6477e60b54491baff0a7dbee062ed6 Sep 23 04:39:40.682915 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-LiveMigrationNegativeTest-459864214-project Sep 23 04:39:40.682915 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:39:40.682915 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 7cc18563-ad1f-4050-818b-880782814c23 could not be found. Sep 23 04:39:40.682915 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '7cc18563-ad1f-4050-818b-880782814c23'} Sep 23 04:39:40.682915 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:39:40.682915 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:39:40.682915 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:39:40.682915 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:39:40.682915 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:39:40.682915 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:39:40.682915 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:39:40.682915 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:39:40.682915 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:39:40.682915 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:39:40.682915 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7cc18563-ad1f-4050-818b-880782814c23 could not be found. Sep 23 04:39:40.682915 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:39:40.682915 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:39:40.682915 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:39:40.682915 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:39:40.682915 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:39:40.682915 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:39:40.682915 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:39:40.682915 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:39:40.682915 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:39:40.682915 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:39:40.682915 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:39:40.682915 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:39:40.682915 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:39:40.682915 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:39:40.682915 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:39:40.682915 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:39:40.682915 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7cc18563-ad1f-4050-818b-880782814c23 could not be found. Sep 23 04:39:40.682915 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:39:40.682915 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:39:40.682915 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:39:40.687715 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:39:40.687715 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:39:40.687715 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:39:40.687715 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:39:40.687715 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:39:40.687715 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7cc18563-ad1f-4050-818b-880782814c23 could not be found. Sep 23 04:39:40.687715 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:39:40.687715 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-bde2d42f-1ae6-4915-bf1a-0d7ff3d02e18 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Returning 404 to user: Instance 7cc18563-ad1f-4050-818b-880782814c23 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:39:40.687715 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-bde2d42f-1ae6-4915-bf1a-0d7ff3d02e18 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] 10.222.0.33 "GET /compute/v2.1/servers/7cc18563-ad1f-4050-818b-880782814c23" status: 404 len: 111 microversion: 2.1 time: 0.038566 Sep 23 04:39:40.687715 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1176/2316] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:40 2022] GET /compute/v2.1/servers/7cc18563-ad1f-4050-818b-880782814c23 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:39:40.693457 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c653fb1f-72c8-4106-98a6-72af94be0f82 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:40.693996 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c653fb1f-72c8-4106-98a6-72af94be0f82 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] [instance: 3871f20c-2d2b-4918-9381-73e73651a586] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:40.700415 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c653fb1f-72c8-4106-98a6-72af94be0f82 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:40.701106 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c653fb1f-72c8-4106-98a6-72af94be0f82 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:40.701352 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c653fb1f-72c8-4106-98a6-72af94be0f82 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:40.702131 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c653fb1f-72c8-4106-98a6-72af94be0f82 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:40.702600 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c653fb1f-72c8-4106-98a6-72af94be0f82 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:40.703030 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c653fb1f-72c8-4106-98a6-72af94be0f82 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:40.728291 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c653fb1f-72c8-4106-98a6-72af94be0f82 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] [instance: 3871f20c-2d2b-4918-9381-73e73651a586] Going to try to terminate instance {{(pid=122698) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:39:40.911800 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2b9005b4-506d-41f9-b301-01a07676e875 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:40.912337 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-2b9005b4-506d-41f9-b301-01a07676e875 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:40.918304 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2b9005b4-506d-41f9-b301-01a07676e875 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:40.918830 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2b9005b4-506d-41f9-b301-01a07676e875 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:40.919311 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2b9005b4-506d-41f9-b301-01a07676e875 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:40.920676 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2b9005b4-506d-41f9-b301-01a07676e875 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:40.921139 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2b9005b4-506d-41f9-b301-01a07676e875 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:40.921570 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2b9005b4-506d-41f9-b301-01a07676e875 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:40.935407 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-2b9005b4-506d-41f9-b301-01a07676e875 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] HTTP exception thrown: Instance cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6 could not be found. Sep 23 04:39:40.936986 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2b9005b4-506d-41f9-b301-01a07676e875 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Request method failure captured: Sep 23 04:39:40.936986 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6 HTTP/1.1 Sep 23 04:39:40.936986 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:39:40.936986 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:39:40.936986 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:39:40.936986 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:39:40.936986 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:39:40.936986 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:39:40.936986 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:39:40.936986 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:39:40.936986 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTgD-AJZNKtluGEJNjQKU0pcHtUCc1AZ8Ycz4MPGIeanw2_GglRmvn8LiMCEayIX86yw_RpyCC_JZrlVGSjhSgenUVZhpJ_MqN5SLmcv6Qnl3N6cXWJgtCK8N_ffRhD1dYgLIdHHgnmyTAptDZsjatOWU1ocTU40JP9XOpkK3deqL7A Sep 23 04:39:40.936986 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:39:40.936986 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:39:40.936986 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:39:40.936986 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:39:40.936986 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:39:40.936986 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:39:40.936986 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: fe698721372f40888dc2918c46e65f2f Sep 23 04:39:40.936986 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-DeleteServersTestJSON-347759205 Sep 23 04:39:40.936986 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:39:40.936986 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:39:40.936986 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fe698721372f40888dc2918c46e65f2f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe698721372f40888dc2918c46e65f2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fe698721372f40888dc2918c46e65f2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe698721372f40888dc2918c46e65f2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:39:40.936986 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-DeleteServersTestJSON-347759205 Sep 23 04:39:40.936986 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: fe698721372f40888dc2918c46e65f2f Sep 23 04:39:40.936986 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-DeleteServersTestJSON-347759205 Sep 23 04:39:40.936986 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-DeleteServersTestJSON-347759205-project Sep 23 04:39:40.936986 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:39:40.936986 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:39:40.936986 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 36526fe612c840fb907e1992d8e62538 Sep 23 04:39:40.936986 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-DeleteServersTestJSON-347759205-project Sep 23 04:39:40.936986 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:39:40.936986 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6 could not be found. Sep 23 04:39:40.936986 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': 'cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6'} Sep 23 04:39:40.936986 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:39:40.936986 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:39:40.936986 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:39:40.936986 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:39:40.936986 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:39:40.936986 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:39:40.936986 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:39:40.936986 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:39:40.936986 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:39:40.936986 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:39:40.936986 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6 could not be found. Sep 23 04:39:40.936986 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:39:40.936986 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:39:40.936986 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:39:40.936986 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:39:40.936986 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:39:40.936986 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:39:40.936986 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:39:40.936986 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:39:40.936986 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:39:40.936986 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:39:40.936986 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:39:40.936986 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:39:40.936986 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:39:40.936986 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:39:40.936986 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:39:40.936986 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:39:40.936986 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6 could not be found. Sep 23 04:39:40.936986 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:39:40.936986 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:39:40.936986 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:39:40.941273 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:39:40.941273 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:39:40.941273 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:39:40.941273 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:39:40.941273 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:39:40.941273 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6 could not be found. Sep 23 04:39:40.941273 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:39:40.941273 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2b9005b4-506d-41f9-b301-01a07676e875 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Returning 404 to user: Instance cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:39:40.941273 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2b9005b4-506d-41f9-b301-01a07676e875 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6" status: 404 len: 111 microversion: 2.1 time: 0.030830 Sep 23 04:39:40.941273 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1177/2317] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:40 2022] GET /compute/v2.1/servers/cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 04:39:40.952689 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e1b6d83a-8d60-44db-aea0-b80d5f589263 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:40.953514 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e1b6d83a-8d60-44db-aea0-b80d5f589263 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] [instance: 82f0e20e-0209-42dc-bbdc-15d6c0c030d8] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:41.012550 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e1b6d83a-8d60-44db-aea0-b80d5f589263 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d5e06dc2ba4f779359c55804ed79a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c54af2d42a04748b9c52c4a4846c03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:41.022695 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e1b6d83a-8d60-44db-aea0-b80d5f589263 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] 10.222.0.33 "GET /compute/v2.1/servers/82f0e20e-0209-42dc-bbdc-15d6c0c030d8" status: 200 len: 1213 microversion: 2.1 time: 0.073759 Sep 23 04:39:41.023988 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1178/2318] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:40 2022] GET /compute/v2.1/servers/82f0e20e-0209-42dc-bbdc-15d6c0c030d8 => generated 1213 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:39:41.081125 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3372f223-9343-4ee1-b035-ca3879fac8e2 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1773380102", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "networks": [{"uuid": "a989594a-cd71-405f-a7ac-42f529a758f7"}]}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:39:41.113999 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=2,nova_api:DELETE=6 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:39:41.143099 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.neutron [None req-3372f223-9343-4ee1-b035-ca3879fac8e2 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] validate_networks() for [('a989594a-cd71-405f-a7ac-42f529a758f7', None, None, None, None, None)] {{(pid=122699) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:39:41.274162 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c653fb1f-72c8-4106-98a6-72af94be0f82 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] 10.222.0.33 "DELETE /compute/v2.1/servers/3871f20c-2d2b-4918-9381-73e73651a586" status: 204 len: 0 microversion: 2.1 time: 0.584190 Sep 23 04:39:41.278500 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1141/2319] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:39:40 2022] DELETE /compute/v2.1/servers/3871f20c-2d2b-4918-9381-73e73651a586 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:39:41.282704 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9febe50b-7f47-4916-8290-cc00adfefa96 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:41.283773 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-9febe50b-7f47-4916-8290-cc00adfefa96 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] [instance: 94fc4134-9b8e-4dcd-bd96-5545bfd51c97] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:41.290791 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9febe50b-7f47-4916-8290-cc00adfefa96 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:41.291493 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9febe50b-7f47-4916-8290-cc00adfefa96 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:41.291938 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9febe50b-7f47-4916-8290-cc00adfefa96 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:41.292676 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9febe50b-7f47-4916-8290-cc00adfefa96 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:41.293424 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9febe50b-7f47-4916-8290-cc00adfefa96 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:41.293857 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9febe50b-7f47-4916-8290-cc00adfefa96 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:41.310167 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-9febe50b-7f47-4916-8290-cc00adfefa96 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] HTTP exception thrown: Instance 94fc4134-9b8e-4dcd-bd96-5545bfd51c97 could not be found. Sep 23 04:39:41.311847 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9febe50b-7f47-4916-8290-cc00adfefa96 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Request method failure captured: Sep 23 04:39:41.311847 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97 HTTP/1.1 Sep 23 04:39:41.311847 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:39:41.311847 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:39:41.311847 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:39:41.311847 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:39:41.311847 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:39:41.311847 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:39:41.311847 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:39:41.311847 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:39:41.311847 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTgrKdR59SzOZhTiatzPvIhAeClVwK-zjTw3V-62K7jH8uy5mHGOWcRXBSqVukup68cYbbPwrxpEnDUBYcIPqbRTi4DkiTUJ0XmdYtK5Kw8G-_whxWr_xmBdqCv0qcQHf7IDf1Kze07UmC4aDY8CHclqmM3VY4wbpYOQNKK7W33O3A0 Sep 23 04:39:41.311847 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:39:41.311847 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:39:41.311847 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:39:41.311847 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:39:41.311847 n-d-846463-3 devstack@n-api.service[122698]: X-Openstack-Nova-Api-Version: 2.75 Sep 23 04:39:41.311847 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:39:41.311847 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:39:41.311847 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: b05671a2f19d42d49aa676680e998b33 Sep 23 04:39:41.311847 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ServersAdmin275Test-1951372581 Sep 23 04:39:41.311847 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:39:41.311847 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:39:41.311847 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b05671a2f19d42d49aa676680e998b33", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b05671a2f19d42d49aa676680e998b33"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b05671a2f19d42d49aa676680e998b33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b05671a2f19d42d49aa676680e998b33"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:39:41.311847 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ServersAdmin275Test-1951372581 Sep 23 04:39:41.311847 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: b05671a2f19d42d49aa676680e998b33 Sep 23 04:39:41.311847 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ServersAdmin275Test-1951372581 Sep 23 04:39:41.311847 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ServersAdmin275Test-1951372581-project Sep 23 04:39:41.311847 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:39:41.311847 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:39:41.311847 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 6504948146c94487a7357025b8e47860 Sep 23 04:39:41.311847 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ServersAdmin275Test-1951372581-project Sep 23 04:39:41.311847 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:39:41.311847 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 94fc4134-9b8e-4dcd-bd96-5545bfd51c97 could not be found. Sep 23 04:39:41.311847 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '94fc4134-9b8e-4dcd-bd96-5545bfd51c97'} Sep 23 04:39:41.311847 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:39:41.311847 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:39:41.311847 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:39:41.311847 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:39:41.311847 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:39:41.311847 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:39:41.311847 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:39:41.311847 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:39:41.311847 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:39:41.311847 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:39:41.311847 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94fc4134-9b8e-4dcd-bd96-5545bfd51c97 could not be found. Sep 23 04:39:41.311847 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:39:41.311847 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:39:41.311847 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:39:41.311847 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:39:41.311847 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:39:41.311847 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:39:41.311847 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:39:41.311847 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:39:41.311847 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:39:41.311847 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:39:41.311847 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:39:41.311847 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:39:41.311847 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:39:41.311847 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:39:41.311847 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:39:41.311847 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:39:41.311847 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94fc4134-9b8e-4dcd-bd96-5545bfd51c97 could not be found. Sep 23 04:39:41.311847 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:39:41.311847 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:39:41.311847 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:39:41.316279 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:39:41.316279 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:39:41.316279 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:39:41.316279 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:39:41.316279 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:39:41.316279 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94fc4134-9b8e-4dcd-bd96-5545bfd51c97 could not be found. Sep 23 04:39:41.316279 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:39:41.316279 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9febe50b-7f47-4916-8290-cc00adfefa96 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] Returning 404 to user: Instance 94fc4134-9b8e-4dcd-bd96-5545bfd51c97 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:39:41.316279 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9febe50b-7f47-4916-8290-cc00adfefa96 tempest-ServersAdmin275Test-1951372581 tempest-ServersAdmin275Test-1951372581-project] 10.222.0.33 "GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97" status: 404 len: 111 microversion: 2.75 time: 0.037176 Sep 23 04:39:41.317211 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1142/2320] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:39:41 2022] GET /compute/v2.1/servers/94fc4134-9b8e-4dcd-bd96-5545bfd51c97 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 23 04:39:41.327664 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e324fd8a-955b-40c1-8c2a-4c819f1b80ce tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:41.327664 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e324fd8a-955b-40c1-8c2a-4c819f1b80ce tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] [instance: 3871f20c-2d2b-4918-9381-73e73651a586] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:41.331574 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e324fd8a-955b-40c1-8c2a-4c819f1b80ce tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:41.332069 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e324fd8a-955b-40c1-8c2a-4c819f1b80ce tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:41.332737 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e324fd8a-955b-40c1-8c2a-4c819f1b80ce tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:41.333602 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e324fd8a-955b-40c1-8c2a-4c819f1b80ce tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:41.334245 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e324fd8a-955b-40c1-8c2a-4c819f1b80ce tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:41.334830 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e324fd8a-955b-40c1-8c2a-4c819f1b80ce tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:41.566525 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e324fd8a-955b-40c1-8c2a-4c819f1b80ce tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6477e60b54491baff0a7dbee062ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc56537160d349aab8f5e6499ca8ab99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:41.574305 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e324fd8a-955b-40c1-8c2a-4c819f1b80ce tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] 10.222.0.33 "GET /compute/v2.1/servers/3871f20c-2d2b-4918-9381-73e73651a586" status: 200 len: 1474 microversion: 2.1 time: 0.256025 Sep 23 04:39:41.575069 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1143/2321] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:41 2022] GET /compute/v2.1/servers/3871f20c-2d2b-4918-9381-73e73651a586 => generated 1474 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:41.580861 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-597a0434-43f5-4b1b-b36a-795edeb15154 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:41.584330 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-597a0434-43f5-4b1b-b36a-795edeb15154 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: aa35cea0-4f7f-4d03-9436-f15264b9f713] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:41.587927 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-597a0434-43f5-4b1b-b36a-795edeb15154 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:41.588488 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-597a0434-43f5-4b1b-b36a-795edeb15154 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:41.589010 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-597a0434-43f5-4b1b-b36a-795edeb15154 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:41.589793 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-597a0434-43f5-4b1b-b36a-795edeb15154 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:41.590344 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-597a0434-43f5-4b1b-b36a-795edeb15154 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:41.590836 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-597a0434-43f5-4b1b-b36a-795edeb15154 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:41.656783 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-3372f223-9343-4ee1-b035-ca3879fac8e2 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Flavor limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:39:41.657806 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-3372f223-9343-4ee1-b035-ca3879fac8e2 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Image limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:39:41.658610 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-3372f223-9343-4ee1-b035-ca3879fac8e2 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Flavor pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:39:41.659161 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-3372f223-9343-4ee1-b035-ca3879fac8e2 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Image pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:39:41.659577 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-3372f223-9343-4ee1-b035-ca3879fac8e2 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:39:41.669212 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3372f223-9343-4ee1-b035-ca3879fac8e2 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:41.670080 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3372f223-9343-4ee1-b035-ca3879fac8e2 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:41.678943 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3372f223-9343-4ee1-b035-ca3879fac8e2 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:41.679852 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3372f223-9343-4ee1-b035-ca3879fac8e2 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:41.681323 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3372f223-9343-4ee1-b035-ca3879fac8e2 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:41.681774 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3372f223-9343-4ee1-b035-ca3879fac8e2 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:41.716951 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-3372f223-9343-4ee1-b035-ca3879fac8e2 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Getting quotas for project fe698721372f40888dc2918c46e65f2f. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:39:41.721593 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-3372f223-9343-4ee1-b035-ca3879fac8e2 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Getting quotas for user 36526fe612c840fb907e1992d8e62538 and project fe698721372f40888dc2918c46e65f2f. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:39:41.733531 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-3372f223-9343-4ee1-b035-ca3879fac8e2 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Going to run 1 instances... {{(pid=122699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:39:41.735748 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-3372f223-9343-4ee1-b035-ca3879fac8e2 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 42fe539b-6665-43fb-b7a2-bc8a6f2c65d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:39:41.751483 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-597a0434-43f5-4b1b-b36a-795edeb15154 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:41.761004 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-597a0434-43f5-4b1b-b36a-795edeb15154 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713" status: 200 len: 1392 microversion: 2.1 time: 0.184262 Sep 23 04:39:41.761577 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1144/2322] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:41 2022] GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713 => generated 1392 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:41.767246 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2ce50c24-b208-4cca-a234-86549ea4d73a tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:41.767860 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-2ce50c24-b208-4cca-a234-86549ea4d73a tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:41.773513 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2ce50c24-b208-4cca-a234-86549ea4d73a tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:41.774045 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2ce50c24-b208-4cca-a234-86549ea4d73a tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:41.774483 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2ce50c24-b208-4cca-a234-86549ea4d73a tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:41.775173 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2ce50c24-b208-4cca-a234-86549ea4d73a tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:41.775624 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2ce50c24-b208-4cca-a234-86549ea4d73a tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:41.776042 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2ce50c24-b208-4cca-a234-86549ea4d73a tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:41.843901 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-2ce50c24-b208-4cca-a234-86549ea4d73a tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:41.852248 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-2ce50c24-b208-4cca-a234-86549ea4d73a tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:41.853787 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-2ce50c24-b208-4cca-a234-86549ea4d73a tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:41.859142 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2ce50c24-b208-4cca-a234-86549ea4d73a tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1537 microversion: 2.91 time: 0.096281 Sep 23 04:39:41.859792 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1145/2323] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:39:41 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1537 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:39:41.920848 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3372f223-9343-4ee1-b035-ca3879fac8e2 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.843536 Sep 23 04:39:41.922524 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1179/2324] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:39:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 846 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 23 04:39:41.933991 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a1c28458-bd37-45d9-8a26-a9ac79e43869 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:41.935032 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a1c28458-bd37-45d9-8a26-a9ac79e43869 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 42fe539b-6665-43fb-b7a2-bc8a6f2c65d5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:41.997219 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a1c28458-bd37-45d9-8a26-a9ac79e43869 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:42.006179 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a1c28458-bd37-45d9-8a26-a9ac79e43869 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/42fe539b-6665-43fb-b7a2-bc8a6f2c65d5" status: 200 len: 1215 microversion: 2.1 time: 0.076014 Sep 23 04:39:42.006843 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1146/2325] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:41 2022] GET /compute/v2.1/servers/42fe539b-6665-43fb-b7a2-bc8a6f2c65d5 => generated 1215 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:42.053731 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6dfc3850-02c3-4445-803b-12eab51a6cda tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:42.056327 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-6dfc3850-02c3-4445-803b-12eab51a6cda tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] [instance: 82f0e20e-0209-42dc-bbdc-15d6c0c030d8] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:42.066731 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6dfc3850-02c3-4445-803b-12eab51a6cda tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:42.067740 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6dfc3850-02c3-4445-803b-12eab51a6cda tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:42.068242 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6dfc3850-02c3-4445-803b-12eab51a6cda tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:42.069150 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6dfc3850-02c3-4445-803b-12eab51a6cda tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:42.070016 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6dfc3850-02c3-4445-803b-12eab51a6cda tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:42.071041 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6dfc3850-02c3-4445-803b-12eab51a6cda tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:42.144166 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-6dfc3850-02c3-4445-803b-12eab51a6cda tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d5e06dc2ba4f779359c55804ed79a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c54af2d42a04748b9c52c4a4846c03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:42.152247 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6dfc3850-02c3-4445-803b-12eab51a6cda tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] 10.222.0.33 "GET /compute/v2.1/servers/82f0e20e-0209-42dc-bbdc-15d6c0c030d8" status: 200 len: 1217 microversion: 2.1 time: 0.103553 Sep 23 04:39:42.152839 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1180/2326] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:42 2022] GET /compute/v2.1/servers/82f0e20e-0209-42dc-bbdc-15d6c0c030d8 => generated 1217 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:42.601535 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d01f6958-b57a-4d80-a641-382e6bce1b35 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:42.602875 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d01f6958-b57a-4d80-a641-382e6bce1b35 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] [instance: 3871f20c-2d2b-4918-9381-73e73651a586] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:42.616754 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d01f6958-b57a-4d80-a641-382e6bce1b35 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:42.619065 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d01f6958-b57a-4d80-a641-382e6bce1b35 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:42.619522 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d01f6958-b57a-4d80-a641-382e6bce1b35 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:42.620844 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d01f6958-b57a-4d80-a641-382e6bce1b35 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:42.623506 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d01f6958-b57a-4d80-a641-382e6bce1b35 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:42.624160 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d01f6958-b57a-4d80-a641-382e6bce1b35 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:42.786273 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-cb7a4c2d-a707-4f1c-9f81-7fd0359886fa tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:42.786890 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-cb7a4c2d-a707-4f1c-9f81-7fd0359886fa tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: aa35cea0-4f7f-4d03-9436-f15264b9f713] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:42.793071 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d01f6958-b57a-4d80-a641-382e6bce1b35 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6477e60b54491baff0a7dbee062ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc56537160d349aab8f5e6499ca8ab99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:42.804442 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cb7a4c2d-a707-4f1c-9f81-7fd0359886fa tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:42.804915 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cb7a4c2d-a707-4f1c-9f81-7fd0359886fa tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:42.805343 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cb7a4c2d-a707-4f1c-9f81-7fd0359886fa tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:42.806687 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d01f6958-b57a-4d80-a641-382e6bce1b35 tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] 10.222.0.33 "GET /compute/v2.1/servers/3871f20c-2d2b-4918-9381-73e73651a586" status: 200 len: 1474 microversion: 2.1 time: 0.210858 Sep 23 04:39:42.807474 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1147/2327] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:42 2022] GET /compute/v2.1/servers/3871f20c-2d2b-4918-9381-73e73651a586 => generated 1474 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:39:42.807735 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cb7a4c2d-a707-4f1c-9f81-7fd0359886fa tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:42.808202 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cb7a4c2d-a707-4f1c-9f81-7fd0359886fa tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:42.808792 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cb7a4c2d-a707-4f1c-9f81-7fd0359886fa tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:42.887924 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2db4406d-2659-4f77-8e8f-4b3bb035dc04 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:42.888857 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-2db4406d-2659-4f77-8e8f-4b3bb035dc04 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:42.902735 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2db4406d-2659-4f77-8e8f-4b3bb035dc04 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:42.904083 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2db4406d-2659-4f77-8e8f-4b3bb035dc04 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:42.904529 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2db4406d-2659-4f77-8e8f-4b3bb035dc04 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:42.905515 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2db4406d-2659-4f77-8e8f-4b3bb035dc04 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:42.905736 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2db4406d-2659-4f77-8e8f-4b3bb035dc04 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:42.907341 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2db4406d-2659-4f77-8e8f-4b3bb035dc04 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:43.007911 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-2db4406d-2659-4f77-8e8f-4b3bb035dc04 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:43.020648 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-2db4406d-2659-4f77-8e8f-4b3bb035dc04 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:43.025855 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-2db4406d-2659-4f77-8e8f-4b3bb035dc04 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:43.033794 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2db4406d-2659-4f77-8e8f-4b3bb035dc04 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1537 microversion: 2.91 time: 0.149971 Sep 23 04:39:43.039429 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1148/2328] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:39:42 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1537 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:39:43.040023 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-cb7a4c2d-a707-4f1c-9f81-7fd0359886fa tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:43.052527 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-6dbf3269-99b9-465d-a7d5-b5b95d224d2c req-ad975579-4bf2-41f1-b14c-fe171c1709c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa35cea0-4f7f-4d03-9436-f15264b9f713", "name": "network-vif-unplugged", "status": "completed", "tag": "bc9fa346-7e65-43be-854e-637e4641d7f9"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:39:43.076450 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-cb7a4c2d-a707-4f1c-9f81-7fd0359886fa tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713" status: 200 len: 1392 microversion: 2.1 time: 0.293487 Sep 23 04:39:43.077085 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1181/2329] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:42 2022] GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713 => generated 1392 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:43.087216 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-6dbf3269-99b9-465d-a7d5-b5b95d224d2c req-ad975579-4bf2-41f1-b14c-fe171c1709c7 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:43.087216 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-6dbf3269-99b9-465d-a7d5-b5b95d224d2c req-ad975579-4bf2-41f1-b14c-fe171c1709c7 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:43.087216 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-6dbf3269-99b9-465d-a7d5-b5b95d224d2c req-ad975579-4bf2-41f1-b14c-fe171c1709c7 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:43.087216 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:39:43.092907 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-fab4b5b7-fcbd-4518-99f9-7762f7f970ae tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:43.093924 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-fab4b5b7-fcbd-4518-99f9-7762f7f970ae tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 42fe539b-6665-43fb-b7a2-bc8a6f2c65d5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:43.119202 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-6dbf3269-99b9-465d-a7d5-b5b95d224d2c req-ad975579-4bf2-41f1-b14c-fe171c1709c7 service nova] Creating event network-vif-unplugged:bc9fa346-7e65-43be-854e-637e4641d7f9 for instance aa35cea0-4f7f-4d03-9436-f15264b9f713 on n-h1-846463-3 Sep 23 04:39:43.129121 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-6dbf3269-99b9-465d-a7d5-b5b95d224d2c req-ad975579-4bf2-41f1-b14c-fe171c1709c7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.085792 Sep 23 04:39:43.130436 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1149/2330] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:39:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:39:43.178131 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1ab82f05-04ba-49f9-aedc-83b71b0fb7a3 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:43.179019 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-1ab82f05-04ba-49f9-aedc-83b71b0fb7a3 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] [instance: 82f0e20e-0209-42dc-bbdc-15d6c0c030d8] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:43.194515 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1ab82f05-04ba-49f9-aedc-83b71b0fb7a3 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:43.195165 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1ab82f05-04ba-49f9-aedc-83b71b0fb7a3 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:43.195615 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1ab82f05-04ba-49f9-aedc-83b71b0fb7a3 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:43.196339 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1ab82f05-04ba-49f9-aedc-83b71b0fb7a3 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:43.196803 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1ab82f05-04ba-49f9-aedc-83b71b0fb7a3 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:43.197239 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1ab82f05-04ba-49f9-aedc-83b71b0fb7a3 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:43.205832 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-fab4b5b7-fcbd-4518-99f9-7762f7f970ae tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:43.218641 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-fab4b5b7-fcbd-4518-99f9-7762f7f970ae tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/42fe539b-6665-43fb-b7a2-bc8a6f2c65d5" status: 200 len: 1215 microversion: 2.1 time: 0.140341 Sep 23 04:39:43.231775 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1182/2331] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:43 2022] GET /compute/v2.1/servers/42fe539b-6665-43fb-b7a2-bc8a6f2c65d5 => generated 1215 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:43.287451 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-1ab82f05-04ba-49f9-aedc-83b71b0fb7a3 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d5e06dc2ba4f779359c55804ed79a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c54af2d42a04748b9c52c4a4846c03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:43.296837 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-1ab82f05-04ba-49f9-aedc-83b71b0fb7a3 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] 10.222.0.33 "GET /compute/v2.1/servers/82f0e20e-0209-42dc-bbdc-15d6c0c030d8" status: 200 len: 1265 microversion: 2.1 time: 0.124665 Sep 23 04:39:43.300614 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1150/2332] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:43 2022] GET /compute/v2.1/servers/82f0e20e-0209-42dc-bbdc-15d6c0c030d8 => generated 1265 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:39:43.831965 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f73ac973-0b78-4b60-972c-619a4b96185a tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:43.833276 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f73ac973-0b78-4b60-972c-619a4b96185a tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] [instance: 3871f20c-2d2b-4918-9381-73e73651a586] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:43.841944 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f73ac973-0b78-4b60-972c-619a4b96185a tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:43.846846 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f73ac973-0b78-4b60-972c-619a4b96185a tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:43.847518 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f73ac973-0b78-4b60-972c-619a4b96185a tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:43.848276 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f73ac973-0b78-4b60-972c-619a4b96185a tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:43.848740 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f73ac973-0b78-4b60-972c-619a4b96185a tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:43.849182 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f73ac973-0b78-4b60-972c-619a4b96185a tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:43.956703 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f73ac973-0b78-4b60-972c-619a4b96185a tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6477e60b54491baff0a7dbee062ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc56537160d349aab8f5e6499ca8ab99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:43.965866 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f73ac973-0b78-4b60-972c-619a4b96185a tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] 10.222.0.33 "GET /compute/v2.1/servers/3871f20c-2d2b-4918-9381-73e73651a586" status: 200 len: 1432 microversion: 2.1 time: 0.138154 Sep 23 04:39:43.971859 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1183/2333] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:43 2022] GET /compute/v2.1/servers/3871f20c-2d2b-4918-9381-73e73651a586 => generated 1432 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:44.067778 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6fd9d1d6-43a7-4baa-bf02-704d901842dc tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:44.069146 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-6fd9d1d6-43a7-4baa-bf02-704d901842dc tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:44.088555 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6fd9d1d6-43a7-4baa-bf02-704d901842dc tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:44.090802 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6fd9d1d6-43a7-4baa-bf02-704d901842dc tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:44.094340 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6fd9d1d6-43a7-4baa-bf02-704d901842dc tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:44.095331 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6fd9d1d6-43a7-4baa-bf02-704d901842dc tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:44.102844 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-94a47928-1a6e-4bd7-abe8-f4ac159bede5 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:44.103549 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-94a47928-1a6e-4bd7-abe8-f4ac159bede5 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: aa35cea0-4f7f-4d03-9436-f15264b9f713] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:44.113358 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6fd9d1d6-43a7-4baa-bf02-704d901842dc tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:44.113551 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-94a47928-1a6e-4bd7-abe8-f4ac159bede5 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:44.113551 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-94a47928-1a6e-4bd7-abe8-f4ac159bede5 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:44.113750 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6fd9d1d6-43a7-4baa-bf02-704d901842dc tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:44.119149 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-94a47928-1a6e-4bd7-abe8-f4ac159bede5 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:44.134316 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-94a47928-1a6e-4bd7-abe8-f4ac159bede5 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:44.136930 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-94a47928-1a6e-4bd7-abe8-f4ac159bede5 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:44.137535 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-94a47928-1a6e-4bd7-abe8-f4ac159bede5 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:44.318852 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6fd9d1d6-43a7-4baa-bf02-704d901842dc tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:44.344579 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6fd9d1d6-43a7-4baa-bf02-704d901842dc tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:44.352423 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6fd9d1d6-43a7-4baa-bf02-704d901842dc tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:44.382278 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-6fd9d1d6-43a7-4baa-bf02-704d901842dc tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1537 microversion: 2.91 time: 0.320196 Sep 23 04:39:44.386002 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1151/2334] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:39:44 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1537 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:39:44.397328 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-63ab04b0-4697-45a2-8d2e-4d5af537af08 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:44.406890 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-63ab04b0-4697-45a2-8d2e-4d5af537af08 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 42fe539b-6665-43fb-b7a2-bc8a6f2c65d5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:44.421017 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-63ab04b0-4697-45a2-8d2e-4d5af537af08 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:44.433336 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-63ab04b0-4697-45a2-8d2e-4d5af537af08 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:44.435685 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-63ab04b0-4697-45a2-8d2e-4d5af537af08 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:44.440179 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-63ab04b0-4697-45a2-8d2e-4d5af537af08 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:44.440970 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-63ab04b0-4697-45a2-8d2e-4d5af537af08 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:44.441415 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-63ab04b0-4697-45a2-8d2e-4d5af537af08 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:44.594778 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-63ab04b0-4697-45a2-8d2e-4d5af537af08 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:44.604875 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-63ab04b0-4697-45a2-8d2e-4d5af537af08 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/42fe539b-6665-43fb-b7a2-bc8a6f2c65d5" status: 200 len: 1267 microversion: 2.1 time: 0.212822 Sep 23 04:39:44.610494 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1152/2335] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:44 2022] GET /compute/v2.1/servers/42fe539b-6665-43fb-b7a2-bc8a6f2c65d5 => generated 1267 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:44.616490 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-aff544a6-294c-4013-8951-845c952eed4b tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:44.619691 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-aff544a6-294c-4013-8951-845c952eed4b tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] [instance: 82f0e20e-0209-42dc-bbdc-15d6c0c030d8] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:44.628590 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-aff544a6-294c-4013-8951-845c952eed4b tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:44.629097 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-aff544a6-294c-4013-8951-845c952eed4b tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:44.629541 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-aff544a6-294c-4013-8951-845c952eed4b tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:44.635999 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-aff544a6-294c-4013-8951-845c952eed4b tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:44.638180 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-aff544a6-294c-4013-8951-845c952eed4b tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:44.639361 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-94a47928-1a6e-4bd7-abe8-f4ac159bede5 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:44.641102 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-aff544a6-294c-4013-8951-845c952eed4b tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:44.648141 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-94a47928-1a6e-4bd7-abe8-f4ac159bede5 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713" status: 200 len: 1392 microversion: 2.1 time: 0.549399 Sep 23 04:39:44.648730 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1184/2336] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:44 2022] GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713 => generated 1392 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:39:44.809355 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-aff544a6-294c-4013-8951-845c952eed4b tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d5e06dc2ba4f779359c55804ed79a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c54af2d42a04748b9c52c4a4846c03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:44.836128 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-aff544a6-294c-4013-8951-845c952eed4b tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] 10.222.0.33 "GET /compute/v2.1/servers/82f0e20e-0209-42dc-bbdc-15d6c0c030d8" status: 200 len: 1271 microversion: 2.1 time: 0.226509 Sep 23 04:39:44.840084 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1153/2337] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:44 2022] GET /compute/v2.1/servers/82f0e20e-0209-42dc-bbdc-15d6c0c030d8 => generated 1271 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:44.992317 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-74593d57-38cd-40dc-85d7-d0a800e1fd4e tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:44.992934 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-74593d57-38cd-40dc-85d7-d0a800e1fd4e tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] [instance: 3871f20c-2d2b-4918-9381-73e73651a586] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:44.999675 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-74593d57-38cd-40dc-85d7-d0a800e1fd4e tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:45.000385 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-74593d57-38cd-40dc-85d7-d0a800e1fd4e tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:45.000818 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-74593d57-38cd-40dc-85d7-d0a800e1fd4e tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:45.001699 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-74593d57-38cd-40dc-85d7-d0a800e1fd4e tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:45.002177 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-74593d57-38cd-40dc-85d7-d0a800e1fd4e tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:45.002748 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-74593d57-38cd-40dc-85d7-d0a800e1fd4e tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:45.025387 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:39:45.041715 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-74593d57-38cd-40dc-85d7-d0a800e1fd4e tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:45.042303 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-74593d57-38cd-40dc-85d7-d0a800e1fd4e tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:45.042750 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-74593d57-38cd-40dc-85d7-d0a800e1fd4e tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:45.043268 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-74593d57-38cd-40dc-85d7-d0a800e1fd4e tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lazy-loading 'fault' on Instance uuid 3871f20c-2d2b-4918-9381-73e73651a586 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:39:45.089067 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-74593d57-38cd-40dc-85d7-d0a800e1fd4e tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee6477e60b54491baff0a7dbee062ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc56537160d349aab8f5e6499ca8ab99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:45.103968 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-74593d57-38cd-40dc-85d7-d0a800e1fd4e tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] 10.222.0.33 "GET /compute/v2.1/servers/3871f20c-2d2b-4918-9381-73e73651a586" status: 200 len: 1309 microversion: 2.1 time: 0.115129 Sep 23 04:39:45.105444 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1185/2338] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:44 2022] GET /compute/v2.1/servers/3871f20c-2d2b-4918-9381-73e73651a586 => generated 1309 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:45.147243 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-237fd072-19ba-435a-af39-174586d1d904 req-49818445-c95f-4db4-a34d-16c70684d559 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa35cea0-4f7f-4d03-9436-f15264b9f713", "tag": "bc9fa346-7e65-43be-854e-637e4641d7f9"}, {"server_uuid": "3871f20c-2d2b-4918-9381-73e73651a586", "name": "network-vif-deleted", "tag": "7db4e8d1-e181-46a0-8a28-968c1fad7a75"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:39:45.160052 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-237fd072-19ba-435a-af39-174586d1d904 req-49818445-c95f-4db4-a34d-16c70684d559 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:45.160566 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-237fd072-19ba-435a-af39-174586d1d904 req-49818445-c95f-4db4-a34d-16c70684d559 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:45.160993 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-237fd072-19ba-435a-af39-174586d1d904 req-49818445-c95f-4db4-a34d-16c70684d559 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:45.174128 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-237fd072-19ba-435a-af39-174586d1d904 req-49818445-c95f-4db4-a34d-16c70684d559 service nova] Creating event network-changed:bc9fa346-7e65-43be-854e-637e4641d7f9 for instance aa35cea0-4f7f-4d03-9436-f15264b9f713 on n-h1-846463-3 Sep 23 04:39:45.180911 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-237fd072-19ba-435a-af39-174586d1d904 req-49818445-c95f-4db4-a34d-16c70684d559 service nova] Creating event network-vif-deleted:7db4e8d1-e181-46a0-8a28-968c1fad7a75 for instance 3871f20c-2d2b-4918-9381-73e73651a586 on n-h1-846463-3 Sep 23 04:39:45.181790 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-237fd072-19ba-435a-af39-174586d1d904 req-49818445-c95f-4db4-a34d-16c70684d559 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.038253 Sep 23 04:39:45.182798 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1154/2339] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:39:45 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:39:45.417469 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3daaac72-2ba0-4b47-945e-2e1a2067f198 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:45.418122 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-3daaac72-2ba0-4b47-945e-2e1a2067f198 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:45.425859 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3daaac72-2ba0-4b47-945e-2e1a2067f198 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:45.426796 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3daaac72-2ba0-4b47-945e-2e1a2067f198 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:45.427639 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3daaac72-2ba0-4b47-945e-2e1a2067f198 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:45.429149 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3daaac72-2ba0-4b47-945e-2e1a2067f198 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:45.429718 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3daaac72-2ba0-4b47-945e-2e1a2067f198 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:45.430194 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3daaac72-2ba0-4b47-945e-2e1a2067f198 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:45.521038 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-3daaac72-2ba0-4b47-945e-2e1a2067f198 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:45.534189 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-3daaac72-2ba0-4b47-945e-2e1a2067f198 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:45.535115 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-3daaac72-2ba0-4b47-945e-2e1a2067f198 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:45.541963 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3daaac72-2ba0-4b47-945e-2e1a2067f198 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1537 microversion: 2.91 time: 0.129204 Sep 23 04:39:45.542542 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1186/2340] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:39:45 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1537 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:39:45.636805 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0a1a8086-50c2-4a8a-a7a6-10d317d1ac2f tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:45.636805 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-0a1a8086-50c2-4a8a-a7a6-10d317d1ac2f tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 42fe539b-6665-43fb-b7a2-bc8a6f2c65d5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:45.643786 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0a1a8086-50c2-4a8a-a7a6-10d317d1ac2f tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:45.644407 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0a1a8086-50c2-4a8a-a7a6-10d317d1ac2f tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:45.644857 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0a1a8086-50c2-4a8a-a7a6-10d317d1ac2f tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:45.645767 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0a1a8086-50c2-4a8a-a7a6-10d317d1ac2f tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:45.646262 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0a1a8086-50c2-4a8a-a7a6-10d317d1ac2f tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:45.646693 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0a1a8086-50c2-4a8a-a7a6-10d317d1ac2f tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:45.673507 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-741da943-4254-4734-9743-1ba70380b22a tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:45.674159 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-741da943-4254-4734-9743-1ba70380b22a tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: aa35cea0-4f7f-4d03-9436-f15264b9f713] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:45.681256 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-741da943-4254-4734-9743-1ba70380b22a tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:45.682097 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-741da943-4254-4734-9743-1ba70380b22a tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:45.682896 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-741da943-4254-4734-9743-1ba70380b22a tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:45.683614 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-741da943-4254-4734-9743-1ba70380b22a tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:45.684130 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-741da943-4254-4734-9743-1ba70380b22a tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:45.684564 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-741da943-4254-4734-9743-1ba70380b22a tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:45.739649 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-0a1a8086-50c2-4a8a-a7a6-10d317d1ac2f tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:45.748839 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0a1a8086-50c2-4a8a-a7a6-10d317d1ac2f tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/42fe539b-6665-43fb-b7a2-bc8a6f2c65d5" status: 200 len: 1275 microversion: 2.1 time: 0.121453 Sep 23 04:39:45.749682 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1155/2341] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:45 2022] GET /compute/v2.1/servers/42fe539b-6665-43fb-b7a2-bc8a6f2c65d5 => generated 1275 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:45.852968 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-741da943-4254-4734-9743-1ba70380b22a tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:45.861778 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-741da943-4254-4734-9743-1ba70380b22a tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713" status: 200 len: 1392 microversion: 2.1 time: 0.193032 Sep 23 04:39:45.863043 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1187/2342] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:45 2022] GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713 => generated 1392 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:39:45.866495 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-69e4571b-f1a4-4a26-889e-d4a6f16c5081 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:45.867106 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-69e4571b-f1a4-4a26-889e-d4a6f16c5081 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] [instance: 82f0e20e-0209-42dc-bbdc-15d6c0c030d8] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:45.875388 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-69e4571b-f1a4-4a26-889e-d4a6f16c5081 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:45.877951 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-69e4571b-f1a4-4a26-889e-d4a6f16c5081 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:45.878646 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-69e4571b-f1a4-4a26-889e-d4a6f16c5081 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:45.883957 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-69e4571b-f1a4-4a26-889e-d4a6f16c5081 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:45.886474 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-69e4571b-f1a4-4a26-889e-d4a6f16c5081 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:45.887100 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-69e4571b-f1a4-4a26-889e-d4a6f16c5081 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:46.104975 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-69e4571b-f1a4-4a26-889e-d4a6f16c5081 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d5e06dc2ba4f779359c55804ed79a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c54af2d42a04748b9c52c4a4846c03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:46.115599 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-69e4571b-f1a4-4a26-889e-d4a6f16c5081 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] 10.222.0.33 "GET /compute/v2.1/servers/82f0e20e-0209-42dc-bbdc-15d6c0c030d8" status: 200 len: 1313 microversion: 2.1 time: 0.252537 Sep 23 04:39:46.116785 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1156/2343] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:45 2022] GET /compute/v2.1/servers/82f0e20e-0209-42dc-bbdc-15d6c0c030d8 => generated 1313 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:46.135210 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-749f7eaa-1ddb-4e48-a03f-e34651a6481e tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:46.136555 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-749f7eaa-1ddb-4e48-a03f-e34651a6481e tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] [instance: 3871f20c-2d2b-4918-9381-73e73651a586] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:46.163247 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-749f7eaa-1ddb-4e48-a03f-e34651a6481e tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:46.164533 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-749f7eaa-1ddb-4e48-a03f-e34651a6481e tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:46.165614 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-749f7eaa-1ddb-4e48-a03f-e34651a6481e tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:46.166661 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-749f7eaa-1ddb-4e48-a03f-e34651a6481e tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:46.167316 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-749f7eaa-1ddb-4e48-a03f-e34651a6481e tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:46.167924 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-749f7eaa-1ddb-4e48-a03f-e34651a6481e tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:46.195473 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-749f7eaa-1ddb-4e48-a03f-e34651a6481e tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] HTTP exception thrown: Instance 3871f20c-2d2b-4918-9381-73e73651a586 could not be found. Sep 23 04:39:46.197655 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-749f7eaa-1ddb-4e48-a03f-e34651a6481e tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Request method failure captured: Sep 23 04:39:46.197655 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/3871f20c-2d2b-4918-9381-73e73651a586 HTTP/1.1 Sep 23 04:39:46.197655 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:39:46.197655 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:39:46.197655 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:39:46.197655 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:39:46.197655 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:39:46.197655 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:39:46.197655 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:39:46.197655 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:39:46.197655 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLThUG8HOQwskXefZrwmW_drWoLJPaI8O_WwFaWB2iivDn_ISOhNd_f8rahPeDc7j4hAXXXsJjlptuXYOZj6E34_ZmtFdvFrv1cXUCfeRYnC5V5di-PRHzG4dyCtKPiuqZ44tlPJujkpLqDq6dDyZaqsVMpY3zarZr91itPtEKKGwUw8 Sep 23 04:39:46.197655 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:39:46.197655 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:39:46.197655 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:39:46.197655 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:39:46.197655 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:39:46.197655 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:39:46.197655 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: fc56537160d349aab8f5e6499ca8ab99 Sep 23 04:39:46.197655 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-LiveMigrationNegativeTest-459864214 Sep 23 04:39:46.197655 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:39:46.197655 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:39:46.197655 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fc56537160d349aab8f5e6499ca8ab99", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fc56537160d349aab8f5e6499ca8ab99"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fc56537160d349aab8f5e6499ca8ab99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fc56537160d349aab8f5e6499ca8ab99"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:39:46.197655 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-LiveMigrationNegativeTest-459864214 Sep 23 04:39:46.197655 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: fc56537160d349aab8f5e6499ca8ab99 Sep 23 04:39:46.197655 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-459864214 Sep 23 04:39:46.197655 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-LiveMigrationNegativeTest-459864214-project Sep 23 04:39:46.197655 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:39:46.197655 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:39:46.197655 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: ee6477e60b54491baff0a7dbee062ed6 Sep 23 04:39:46.197655 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-LiveMigrationNegativeTest-459864214-project Sep 23 04:39:46.197655 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:39:46.197655 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 3871f20c-2d2b-4918-9381-73e73651a586 could not be found. Sep 23 04:39:46.197655 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '3871f20c-2d2b-4918-9381-73e73651a586'} Sep 23 04:39:46.197655 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:39:46.197655 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:39:46.197655 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:39:46.197655 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:39:46.197655 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:39:46.197655 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:39:46.197655 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:39:46.197655 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:39:46.197655 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:39:46.197655 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:39:46.197655 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3871f20c-2d2b-4918-9381-73e73651a586 could not be found. Sep 23 04:39:46.197655 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:39:46.197655 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:39:46.197655 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:39:46.197655 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:39:46.197655 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:39:46.197655 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:39:46.197655 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:39:46.197655 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:39:46.197655 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:39:46.197655 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:39:46.197655 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:39:46.197655 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:39:46.197655 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:39:46.197655 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:39:46.197655 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:39:46.197655 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:39:46.197655 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3871f20c-2d2b-4918-9381-73e73651a586 could not be found. Sep 23 04:39:46.197655 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:39:46.197655 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:39:46.197655 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:39:46.202089 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:39:46.202089 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:39:46.202089 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:39:46.202089 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:39:46.202089 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:39:46.202089 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3871f20c-2d2b-4918-9381-73e73651a586 could not be found. Sep 23 04:39:46.202089 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:39:46.202801 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-749f7eaa-1ddb-4e48-a03f-e34651a6481e tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] Returning 404 to user: Instance 3871f20c-2d2b-4918-9381-73e73651a586 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:39:46.203878 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-749f7eaa-1ddb-4e48-a03f-e34651a6481e tempest-LiveMigrationNegativeTest-459864214 tempest-LiveMigrationNegativeTest-459864214-project] 10.222.0.33 "GET /compute/v2.1/servers/3871f20c-2d2b-4918-9381-73e73651a586" status: 404 len: 111 microversion: 2.1 time: 0.078603 Sep 23 04:39:46.204827 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1188/2344] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:46 2022] GET /compute/v2.1/servers/3871f20c-2d2b-4918-9381-73e73651a586 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:39:46.570967 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-eff6b4df-91f8-42a3-9b1b-90280fce6ddd tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:46.572237 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-eff6b4df-91f8-42a3-9b1b-90280fce6ddd tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:46.580964 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-eff6b4df-91f8-42a3-9b1b-90280fce6ddd tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:46.581466 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-eff6b4df-91f8-42a3-9b1b-90280fce6ddd tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:46.581925 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-eff6b4df-91f8-42a3-9b1b-90280fce6ddd tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:46.582728 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-eff6b4df-91f8-42a3-9b1b-90280fce6ddd tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:46.583341 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-eff6b4df-91f8-42a3-9b1b-90280fce6ddd tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:46.583773 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-eff6b4df-91f8-42a3-9b1b-90280fce6ddd tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:46.664630 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-eff6b4df-91f8-42a3-9b1b-90280fce6ddd tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:46.675394 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-eff6b4df-91f8-42a3-9b1b-90280fce6ddd tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:46.678680 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-eff6b4df-91f8-42a3-9b1b-90280fce6ddd tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:46.689010 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-eff6b4df-91f8-42a3-9b1b-90280fce6ddd tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1537 microversion: 2.91 time: 0.122412 Sep 23 04:39:46.690330 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1157/2345] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:39:46 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1537 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:39:46.778411 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3b44029f-2eea-41f0-a0b9-2f645e1d63a6 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:46.779991 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-3b44029f-2eea-41f0-a0b9-2f645e1d63a6 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 42fe539b-6665-43fb-b7a2-bc8a6f2c65d5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:46.796063 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3b44029f-2eea-41f0-a0b9-2f645e1d63a6 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:46.796794 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3b44029f-2eea-41f0-a0b9-2f645e1d63a6 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:46.798696 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3b44029f-2eea-41f0-a0b9-2f645e1d63a6 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:46.798696 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3b44029f-2eea-41f0-a0b9-2f645e1d63a6 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:46.800573 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3b44029f-2eea-41f0-a0b9-2f645e1d63a6 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:46.801619 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3b44029f-2eea-41f0-a0b9-2f645e1d63a6 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:46.892236 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-146736a3-4b81-498e-bad9-1c76c82cd317 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:46.892768 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-146736a3-4b81-498e-bad9-1c76c82cd317 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: aa35cea0-4f7f-4d03-9436-f15264b9f713] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:46.905540 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-146736a3-4b81-498e-bad9-1c76c82cd317 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:46.906342 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-146736a3-4b81-498e-bad9-1c76c82cd317 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:46.906971 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-146736a3-4b81-498e-bad9-1c76c82cd317 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:46.907847 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-146736a3-4b81-498e-bad9-1c76c82cd317 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:46.908608 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-146736a3-4b81-498e-bad9-1c76c82cd317 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:46.909200 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-146736a3-4b81-498e-bad9-1c76c82cd317 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:46.939056 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-3b44029f-2eea-41f0-a0b9-2f645e1d63a6 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:46.954255 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3b44029f-2eea-41f0-a0b9-2f645e1d63a6 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/42fe539b-6665-43fb-b7a2-bc8a6f2c65d5" status: 200 len: 1273 microversion: 2.1 time: 0.179626 Sep 23 04:39:46.955545 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1189/2346] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:46 2022] GET /compute/v2.1/servers/42fe539b-6665-43fb-b7a2-bc8a6f2c65d5 => generated 1273 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:47.148872 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ca5265ef-6f58-4095-b38d-b6205cfdec42 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:47.151549 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ca5265ef-6f58-4095-b38d-b6205cfdec42 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] [instance: 82f0e20e-0209-42dc-bbdc-15d6c0c030d8] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:47.171022 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ca5265ef-6f58-4095-b38d-b6205cfdec42 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:47.179192 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ca5265ef-6f58-4095-b38d-b6205cfdec42 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:47.180978 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ca5265ef-6f58-4095-b38d-b6205cfdec42 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:47.181658 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-146736a3-4b81-498e-bad9-1c76c82cd317 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:47.182551 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ca5265ef-6f58-4095-b38d-b6205cfdec42 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:47.183178 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ca5265ef-6f58-4095-b38d-b6205cfdec42 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:47.183959 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ca5265ef-6f58-4095-b38d-b6205cfdec42 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:47.193070 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-146736a3-4b81-498e-bad9-1c76c82cd317 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713" status: 200 len: 1392 microversion: 2.1 time: 0.311565 Sep 23 04:39:47.194226 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1158/2347] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:46 2022] GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713 => generated 1392 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:39:47.411437 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ca5265ef-6f58-4095-b38d-b6205cfdec42 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d5e06dc2ba4f779359c55804ed79a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c54af2d42a04748b9c52c4a4846c03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:47.422350 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ca5265ef-6f58-4095-b38d-b6205cfdec42 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] 10.222.0.33 "GET /compute/v2.1/servers/82f0e20e-0209-42dc-bbdc-15d6c0c030d8" status: 200 len: 1313 microversion: 2.1 time: 0.286218 Sep 23 04:39:47.423686 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1190/2348] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:47 2022] GET /compute/v2.1/servers/82f0e20e-0209-42dc-bbdc-15d6c0c030d8 => generated 1313 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:39:47.722531 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-bbb3c9ce-e8f4-4905-b498-607cd65bf558 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:47.723749 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-bbb3c9ce-e8f4-4905-b498-607cd65bf558 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:47.738787 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bbb3c9ce-e8f4-4905-b498-607cd65bf558 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:47.739305 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bbb3c9ce-e8f4-4905-b498-607cd65bf558 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:47.739758 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bbb3c9ce-e8f4-4905-b498-607cd65bf558 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:47.740491 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bbb3c9ce-e8f4-4905-b498-607cd65bf558 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:47.740951 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bbb3c9ce-e8f4-4905-b498-607cd65bf558 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:47.741691 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bbb3c9ce-e8f4-4905-b498-607cd65bf558 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:47.870392 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-bbb3c9ce-e8f4-4905-b498-607cd65bf558 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:47.883877 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-bbb3c9ce-e8f4-4905-b498-607cd65bf558 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:47.899219 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-bbb3c9ce-e8f4-4905-b498-607cd65bf558 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:47.909409 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-bbb3c9ce-e8f4-4905-b498-607cd65bf558 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1537 microversion: 2.91 time: 0.193254 Sep 23 04:39:47.911255 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1159/2349] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:39:47 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1537 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:39:47.984816 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9041a678-6dbe-42e9-8838-5d382d3d358d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:47.985723 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-9041a678-6dbe-42e9-8838-5d382d3d358d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 42fe539b-6665-43fb-b7a2-bc8a6f2c65d5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:47.994445 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9041a678-6dbe-42e9-8838-5d382d3d358d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:47.995331 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9041a678-6dbe-42e9-8838-5d382d3d358d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:47.995994 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9041a678-6dbe-42e9-8838-5d382d3d358d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:47.998132 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9041a678-6dbe-42e9-8838-5d382d3d358d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:47.998843 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9041a678-6dbe-42e9-8838-5d382d3d358d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:47.999597 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9041a678-6dbe-42e9-8838-5d382d3d358d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:48.217929 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8f8cc060-c440-4ca8-bc99-763873961164 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:48.219110 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8f8cc060-c440-4ca8-bc99-763873961164 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: aa35cea0-4f7f-4d03-9436-f15264b9f713] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:48.237876 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8f8cc060-c440-4ca8-bc99-763873961164 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:48.244078 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8f8cc060-c440-4ca8-bc99-763873961164 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:48.244078 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8f8cc060-c440-4ca8-bc99-763873961164 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:48.244078 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8f8cc060-c440-4ca8-bc99-763873961164 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:48.246597 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8f8cc060-c440-4ca8-bc99-763873961164 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:48.247229 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8f8cc060-c440-4ca8-bc99-763873961164 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:48.511435 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-9041a678-6dbe-42e9-8838-5d382d3d358d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:48.521448 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-9041a678-6dbe-42e9-8838-5d382d3d358d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/42fe539b-6665-43fb-b7a2-bc8a6f2c65d5" status: 200 len: 1315 microversion: 2.1 time: 0.544673 Sep 23 04:39:48.522578 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1191/2350] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:47 2022] GET /compute/v2.1/servers/42fe539b-6665-43fb-b7a2-bc8a6f2c65d5 => generated 1315 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:48.540640 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-93d73726-be06-4c7d-aeb4-998d38630158 req-673c2380-348c-48e4-94f2-93a782c9201e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82f0e20e-0209-42dc-bbdc-15d6c0c030d8", "tag": "e7206eea-5f84-4dea-89fc-e6e135ad9cd6"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:39:48.552044 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-93d73726-be06-4c7d-aeb4-998d38630158 req-673c2380-348c-48e4-94f2-93a782c9201e service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:48.552871 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-93d73726-be06-4c7d-aeb4-998d38630158 req-673c2380-348c-48e4-94f2-93a782c9201e service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:48.553979 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-93d73726-be06-4c7d-aeb4-998d38630158 req-673c2380-348c-48e4-94f2-93a782c9201e service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:48.568235 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8f8cc060-c440-4ca8-bc99-763873961164 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:48.570779 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-93d73726-be06-4c7d-aeb4-998d38630158 req-673c2380-348c-48e4-94f2-93a782c9201e service nova] Creating event network-changed:e7206eea-5f84-4dea-89fc-e6e135ad9cd6 for instance 82f0e20e-0209-42dc-bbdc-15d6c0c030d8 on n-h2-846463-3 Sep 23 04:39:48.576414 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-93d73726-be06-4c7d-aeb4-998d38630158 req-673c2380-348c-48e4-94f2-93a782c9201e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052433 Sep 23 04:39:48.577085 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1192/2351] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:39:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:39:48.578568 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8f8cc060-c440-4ca8-bc99-763873961164 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713" status: 200 len: 1392 microversion: 2.1 time: 0.365570 Sep 23 04:39:48.580085 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1160/2352] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:48 2022] GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713 => generated 1392 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:39:48.585940 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-43c994b4-29a8-46a7-b6ac-866f27d8c254 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:48.586947 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-43c994b4-29a8-46a7-b6ac-866f27d8c254 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] [instance: 82f0e20e-0209-42dc-bbdc-15d6c0c030d8] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:48.590749 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:39:48.595719 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-43c994b4-29a8-46a7-b6ac-866f27d8c254 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:48.596524 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-43c994b4-29a8-46a7-b6ac-866f27d8c254 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:48.598155 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-43c994b4-29a8-46a7-b6ac-866f27d8c254 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:48.598155 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-43c994b4-29a8-46a7-b6ac-866f27d8c254 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:48.598331 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-43c994b4-29a8-46a7-b6ac-866f27d8c254 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:48.598853 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-43c994b4-29a8-46a7-b6ac-866f27d8c254 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:48.944284 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-db416d49-f1c9-4a89-b601-10cab17f4f2d tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:48.945833 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-db416d49-f1c9-4a89-b601-10cab17f4f2d tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:48.956167 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-db416d49-f1c9-4a89-b601-10cab17f4f2d tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:48.958574 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-db416d49-f1c9-4a89-b601-10cab17f4f2d tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:48.959365 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-db416d49-f1c9-4a89-b601-10cab17f4f2d tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:48.960842 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-db416d49-f1c9-4a89-b601-10cab17f4f2d tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:48.961651 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-db416d49-f1c9-4a89-b601-10cab17f4f2d tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:48.962330 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-db416d49-f1c9-4a89-b601-10cab17f4f2d tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:49.207709 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-db416d49-f1c9-4a89-b601-10cab17f4f2d tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:49.229307 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-db416d49-f1c9-4a89-b601-10cab17f4f2d tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:49.231472 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-db416d49-f1c9-4a89-b601-10cab17f4f2d tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:49.243261 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-db416d49-f1c9-4a89-b601-10cab17f4f2d tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1537 microversion: 2.91 time: 0.305234 Sep 23 04:39:49.258162 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1161/2353] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:39:48 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1537 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:39:49.342291 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-43c994b4-29a8-46a7-b6ac-866f27d8c254 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d5e06dc2ba4f779359c55804ed79a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c54af2d42a04748b9c52c4a4846c03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:49.350917 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-43c994b4-29a8-46a7-b6ac-866f27d8c254 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] 10.222.0.33 "GET /compute/v2.1/servers/82f0e20e-0209-42dc-bbdc-15d6c0c030d8" status: 200 len: 1313 microversion: 2.1 time: 0.772301 Sep 23 04:39:49.355247 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1193/2354] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:48 2022] GET /compute/v2.1/servers/82f0e20e-0209-42dc-bbdc-15d6c0c030d8 => generated 1313 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:49.546041 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-00030487-b3e0-4f1f-a472-52ebe67c7589 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:49.546833 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-00030487-b3e0-4f1f-a472-52ebe67c7589 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 42fe539b-6665-43fb-b7a2-bc8a6f2c65d5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:49.553615 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-00030487-b3e0-4f1f-a472-52ebe67c7589 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:49.554442 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-00030487-b3e0-4f1f-a472-52ebe67c7589 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:49.555217 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-00030487-b3e0-4f1f-a472-52ebe67c7589 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:49.556333 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-00030487-b3e0-4f1f-a472-52ebe67c7589 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:49.557015 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-00030487-b3e0-4f1f-a472-52ebe67c7589 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:49.557773 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-00030487-b3e0-4f1f-a472-52ebe67c7589 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:49.604533 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3b6e3708-f1a9-4778-98c3-ed31a37baee9 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:49.615969 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-3b6e3708-f1a9-4778-98c3-ed31a37baee9 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: aa35cea0-4f7f-4d03-9436-f15264b9f713] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:49.640008 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3b6e3708-f1a9-4778-98c3-ed31a37baee9 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:49.640616 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3b6e3708-f1a9-4778-98c3-ed31a37baee9 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:49.641219 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3b6e3708-f1a9-4778-98c3-ed31a37baee9 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:49.642058 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3b6e3708-f1a9-4778-98c3-ed31a37baee9 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:49.642601 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3b6e3708-f1a9-4778-98c3-ed31a37baee9 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:49.643158 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3b6e3708-f1a9-4778-98c3-ed31a37baee9 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:50.051934 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-00030487-b3e0-4f1f-a472-52ebe67c7589 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:50.057919 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-3b6e3708-f1a9-4778-98c3-ed31a37baee9 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:50.066580 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-00030487-b3e0-4f1f-a472-52ebe67c7589 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/42fe539b-6665-43fb-b7a2-bc8a6f2c65d5" status: 200 len: 1315 microversion: 2.1 time: 0.522115 Sep 23 04:39:50.068864 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1162/2355] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:49 2022] GET /compute/v2.1/servers/42fe539b-6665-43fb-b7a2-bc8a6f2c65d5 => generated 1315 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:50.085051 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3b6e3708-f1a9-4778-98c3-ed31a37baee9 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713" status: 200 len: 1392 microversion: 2.1 time: 0.485544 Sep 23 04:39:50.086155 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1194/2356] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:49 2022] GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713 => generated 1392 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:50.280548 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f66c3250-c45b-4433-aa0a-04da6c36e3c0 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:50.287203 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f66c3250-c45b-4433-aa0a-04da6c36e3c0 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:50.292718 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f66c3250-c45b-4433-aa0a-04da6c36e3c0 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:50.294866 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f66c3250-c45b-4433-aa0a-04da6c36e3c0 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:50.295494 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f66c3250-c45b-4433-aa0a-04da6c36e3c0 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:50.296388 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f66c3250-c45b-4433-aa0a-04da6c36e3c0 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:50.296890 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f66c3250-c45b-4433-aa0a-04da6c36e3c0 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:50.297327 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f66c3250-c45b-4433-aa0a-04da6c36e3c0 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:50.383166 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c257a1e1-68a1-4497-b0e9-aae121e4b136 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:50.383780 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c257a1e1-68a1-4497-b0e9-aae121e4b136 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] [instance: 82f0e20e-0209-42dc-bbdc-15d6c0c030d8] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:50.396004 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c257a1e1-68a1-4497-b0e9-aae121e4b136 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:50.396791 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c257a1e1-68a1-4497-b0e9-aae121e4b136 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:50.397236 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c257a1e1-68a1-4497-b0e9-aae121e4b136 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:50.398030 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c257a1e1-68a1-4497-b0e9-aae121e4b136 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:50.398570 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c257a1e1-68a1-4497-b0e9-aae121e4b136 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:50.410492 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c257a1e1-68a1-4497-b0e9-aae121e4b136 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:50.525880 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f66c3250-c45b-4433-aa0a-04da6c36e3c0 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:50.538250 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f66c3250-c45b-4433-aa0a-04da6c36e3c0 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:50.543341 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f66c3250-c45b-4433-aa0a-04da6c36e3c0 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:50.553584 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f66c3250-c45b-4433-aa0a-04da6c36e3c0 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1537 microversion: 2.91 time: 0.281211 Sep 23 04:39:50.555127 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1163/2357] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:39:50 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1537 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:39:50.616737 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-cb3bd1c2-7422-49e7-b0a3-8bd267f0cfd9 req-514088d6-1bb1-4a03-b397-46b0a4414466 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42fe539b-6665-43fb-b7a2-bc8a6f2c65d5", "tag": "612a667a-9f5d-490a-b4df-3250d5946428"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:39:50.633523 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-cb3bd1c2-7422-49e7-b0a3-8bd267f0cfd9 req-514088d6-1bb1-4a03-b397-46b0a4414466 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:50.634912 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-cb3bd1c2-7422-49e7-b0a3-8bd267f0cfd9 req-514088d6-1bb1-4a03-b397-46b0a4414466 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:50.635672 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-cb3bd1c2-7422-49e7-b0a3-8bd267f0cfd9 req-514088d6-1bb1-4a03-b397-46b0a4414466 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:50.675450 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-cb3bd1c2-7422-49e7-b0a3-8bd267f0cfd9 req-514088d6-1bb1-4a03-b397-46b0a4414466 service nova] Creating event network-changed:612a667a-9f5d-490a-b4df-3250d5946428 for instance 42fe539b-6665-43fb-b7a2-bc8a6f2c65d5 on n-h2-846463-3 Sep 23 04:39:50.688555 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-cb3bd1c2-7422-49e7-b0a3-8bd267f0cfd9 req-514088d6-1bb1-4a03-b397-46b0a4414466 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075371 Sep 23 04:39:50.690712 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1164/2358] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:39:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:39:50.789482 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c257a1e1-68a1-4497-b0e9-aae121e4b136 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d5e06dc2ba4f779359c55804ed79a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c54af2d42a04748b9c52c4a4846c03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:50.818872 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c257a1e1-68a1-4497-b0e9-aae121e4b136 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] 10.222.0.33 "GET /compute/v2.1/servers/82f0e20e-0209-42dc-bbdc-15d6c0c030d8" status: 200 len: 1313 microversion: 2.1 time: 0.438423 Sep 23 04:39:50.821371 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1195/2359] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:50 2022] GET /compute/v2.1/servers/82f0e20e-0209-42dc-bbdc-15d6c0c030d8 => generated 1313 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:51.092835 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ebd58590-38f9-4073-8a72-48fb92d3cf7d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:51.093586 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-ebd58590-38f9-4073-8a72-48fb92d3cf7d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 42fe539b-6665-43fb-b7a2-bc8a6f2c65d5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:51.112704 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ff935c32-a405-43f9-b045-dd1e429ba732 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:51.113587 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ff935c32-a405-43f9-b045-dd1e429ba732 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: aa35cea0-4f7f-4d03-9436-f15264b9f713] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:51.136992 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ff935c32-a405-43f9-b045-dd1e429ba732 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:51.142221 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ff935c32-a405-43f9-b045-dd1e429ba732 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:51.144161 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ff935c32-a405-43f9-b045-dd1e429ba732 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:51.146456 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ff935c32-a405-43f9-b045-dd1e429ba732 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:51.149486 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ebd58590-38f9-4073-8a72-48fb92d3cf7d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:51.150230 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ff935c32-a405-43f9-b045-dd1e429ba732 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:51.151783 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ebd58590-38f9-4073-8a72-48fb92d3cf7d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:51.152401 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ff935c32-a405-43f9-b045-dd1e429ba732 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:51.154644 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ebd58590-38f9-4073-8a72-48fb92d3cf7d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:51.157594 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ebd58590-38f9-4073-8a72-48fb92d3cf7d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:51.158290 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ebd58590-38f9-4073-8a72-48fb92d3cf7d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:51.164661 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ebd58590-38f9-4073-8a72-48fb92d3cf7d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:51.699873 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=10 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:39:51.729157 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ff935c32-a405-43f9-b045-dd1e429ba732 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:51.734227 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ff935c32-a405-43f9-b045-dd1e429ba732 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713" status: 200 len: 1392 microversion: 2.1 time: 0.626937 Sep 23 04:39:51.736084 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1196/2360] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:51 2022] GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713 => generated 1392 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:51.743603 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-069a47a5-ea48-4afb-9081-8f8df1290d60 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:51.745027 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-069a47a5-ea48-4afb-9081-8f8df1290d60 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:51.755174 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ebd58590-38f9-4073-8a72-48fb92d3cf7d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:51.755683 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-069a47a5-ea48-4afb-9081-8f8df1290d60 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:51.758760 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-069a47a5-ea48-4afb-9081-8f8df1290d60 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:51.758760 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-069a47a5-ea48-4afb-9081-8f8df1290d60 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:51.760307 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-069a47a5-ea48-4afb-9081-8f8df1290d60 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:51.761185 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-069a47a5-ea48-4afb-9081-8f8df1290d60 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:51.762791 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-069a47a5-ea48-4afb-9081-8f8df1290d60 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:51.764924 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ebd58590-38f9-4073-8a72-48fb92d3cf7d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/42fe539b-6665-43fb-b7a2-bc8a6f2c65d5" status: 200 len: 1315 microversion: 2.1 time: 0.678932 Sep 23 04:39:51.768593 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1165/2361] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:51 2022] GET /compute/v2.1/servers/42fe539b-6665-43fb-b7a2-bc8a6f2c65d5 => generated 1315 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:51.848587 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d8a3b53b-b689-4dc3-935b-a2eb5438dad7 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:51.849456 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d8a3b53b-b689-4dc3-935b-a2eb5438dad7 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] [instance: 82f0e20e-0209-42dc-bbdc-15d6c0c030d8] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:51.855742 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d8a3b53b-b689-4dc3-935b-a2eb5438dad7 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:51.856449 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d8a3b53b-b689-4dc3-935b-a2eb5438dad7 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:51.857549 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d8a3b53b-b689-4dc3-935b-a2eb5438dad7 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:51.858434 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d8a3b53b-b689-4dc3-935b-a2eb5438dad7 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:51.859067 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d8a3b53b-b689-4dc3-935b-a2eb5438dad7 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:51.859951 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d8a3b53b-b689-4dc3-935b-a2eb5438dad7 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:51.936142 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-069a47a5-ea48-4afb-9081-8f8df1290d60 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:51.956500 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-069a47a5-ea48-4afb-9081-8f8df1290d60 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:51.959869 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-069a47a5-ea48-4afb-9081-8f8df1290d60 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:51.971755 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-069a47a5-ea48-4afb-9081-8f8df1290d60 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1537 microversion: 2.91 time: 0.233843 Sep 23 04:39:51.972896 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1197/2362] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:39:51 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1537 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:39:52.005823 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=10 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:39:52.225795 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d8a3b53b-b689-4dc3-935b-a2eb5438dad7 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d5e06dc2ba4f779359c55804ed79a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c54af2d42a04748b9c52c4a4846c03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:52.238622 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d8a3b53b-b689-4dc3-935b-a2eb5438dad7 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] 10.222.0.33 "GET /compute/v2.1/servers/82f0e20e-0209-42dc-bbdc-15d6c0c030d8" status: 200 len: 1313 microversion: 2.1 time: 0.393849 Sep 23 04:39:52.240697 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1166/2363] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:51 2022] GET /compute/v2.1/servers/82f0e20e-0209-42dc-bbdc-15d6c0c030d8 => generated 1313 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:52.766015 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-eaa74a7b-fa69-4f3d-9c59-f55a4971fa6e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:52.768061 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-eaa74a7b-fa69-4f3d-9c59-f55a4971fa6e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: aa35cea0-4f7f-4d03-9436-f15264b9f713] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:52.781840 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eaa74a7b-fa69-4f3d-9c59-f55a4971fa6e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:52.784107 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eaa74a7b-fa69-4f3d-9c59-f55a4971fa6e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:52.784824 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eaa74a7b-fa69-4f3d-9c59-f55a4971fa6e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:52.785860 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eaa74a7b-fa69-4f3d-9c59-f55a4971fa6e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:52.786588 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eaa74a7b-fa69-4f3d-9c59-f55a4971fa6e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:52.787443 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eaa74a7b-fa69-4f3d-9c59-f55a4971fa6e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:52.796913 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b5affb28-d42e-4eb6-9dbb-68eb3ba60003 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:52.800999 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b5affb28-d42e-4eb6-9dbb-68eb3ba60003 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 42fe539b-6665-43fb-b7a2-bc8a6f2c65d5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:52.808209 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b5affb28-d42e-4eb6-9dbb-68eb3ba60003 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:52.808740 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b5affb28-d42e-4eb6-9dbb-68eb3ba60003 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:52.810727 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b5affb28-d42e-4eb6-9dbb-68eb3ba60003 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:52.815014 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b5affb28-d42e-4eb6-9dbb-68eb3ba60003 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:52.817637 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b5affb28-d42e-4eb6-9dbb-68eb3ba60003 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:52.818404 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b5affb28-d42e-4eb6-9dbb-68eb3ba60003 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:53.178372 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b5affb28-d42e-4eb6-9dbb-68eb3ba60003 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:53.185553 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=100 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:39:53.185969 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-eaa74a7b-fa69-4f3d-9c59-f55a4971fa6e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:53.195621 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-eaa74a7b-fa69-4f3d-9c59-f55a4971fa6e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713" status: 200 len: 1392 microversion: 2.1 time: 0.440481 Sep 23 04:39:53.197276 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1198/2364] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:52 2022] GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713 => generated 1392 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:53.200073 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b5affb28-d42e-4eb6-9dbb-68eb3ba60003 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/42fe539b-6665-43fb-b7a2-bc8a6f2c65d5" status: 200 len: 1315 microversion: 2.1 time: 0.409240 Sep 23 04:39:53.203553 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1c2d1cc8-fea1-480a-9121-2c468ee4b0bc tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:53.204430 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1c2d1cc8-fea1-480a-9121-2c468ee4b0bc tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:53.214557 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=58 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:39:53.217306 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1167/2365] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:52 2022] GET /compute/v2.1/servers/42fe539b-6665-43fb-b7a2-bc8a6f2c65d5 => generated 1315 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:53.221446 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1c2d1cc8-fea1-480a-9121-2c468ee4b0bc tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:53.225792 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1c2d1cc8-fea1-480a-9121-2c468ee4b0bc tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:53.226511 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1c2d1cc8-fea1-480a-9121-2c468ee4b0bc tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:53.229337 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1c2d1cc8-fea1-480a-9121-2c468ee4b0bc tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:53.229848 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1c2d1cc8-fea1-480a-9121-2c468ee4b0bc tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:53.230320 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1c2d1cc8-fea1-480a-9121-2c468ee4b0bc tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:53.323748 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1c2d1cc8-fea1-480a-9121-2c468ee4b0bc tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:53.340771 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1c2d1cc8-fea1-480a-9121-2c468ee4b0bc tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:53.340771 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1c2d1cc8-fea1-480a-9121-2c468ee4b0bc tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:53.347599 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1c2d1cc8-fea1-480a-9121-2c468ee4b0bc tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1537 microversion: 2.91 time: 0.148630 Sep 23 04:39:53.349452 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1199/2366] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:39:53 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1537 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:39:53.355614 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8cc34923-cf9e-41b6-bc24-fa3c7d6cf1cf tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:53.356300 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-8cc34923-cf9e-41b6-bc24-fa3c7d6cf1cf tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] [instance: 82f0e20e-0209-42dc-bbdc-15d6c0c030d8] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:53.363515 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8cc34923-cf9e-41b6-bc24-fa3c7d6cf1cf tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:53.364377 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8cc34923-cf9e-41b6-bc24-fa3c7d6cf1cf tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:53.365069 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8cc34923-cf9e-41b6-bc24-fa3c7d6cf1cf tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:53.366452 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8cc34923-cf9e-41b6-bc24-fa3c7d6cf1cf tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:53.366989 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8cc34923-cf9e-41b6-bc24-fa3c7d6cf1cf tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:53.367561 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8cc34923-cf9e-41b6-bc24-fa3c7d6cf1cf tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:53.457463 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1b113693-140e-4fbb-a778-49d3ac49447d tempest-QuotaClassesAdminTestJSON-804048716 tempest-QuotaClassesAdminTestJSON-804048716-project-admin] Calling method '.version_select at 0x7ff1bb83c790>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:53.474567 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-1b113693-140e-4fbb-a778-49d3ac49447d tempest-QuotaClassesAdminTestJSON-804048716 tempest-QuotaClassesAdminTestJSON-804048716-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.254269 Sep 23 04:39:53.475489 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1168/2367] 10.222.0.33 () {58 vars in 1185 bytes} [Fri Sep 23 04:39:53 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:39:53.490487 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-13306beb-3e01-4a8c-9f38-c92986b8288e tempest-QuotaClassesAdminTestJSON-804048716 tempest-QuotaClassesAdminTestJSON-804048716-project-admin] Action: 'update', calling method: .version_select at 0x7ff1bbaa7430>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:39:53.560779 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-8cc34923-cf9e-41b6-bc24-fa3c7d6cf1cf tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d5e06dc2ba4f779359c55804ed79a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c54af2d42a04748b9c52c4a4846c03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:53.568848 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-8cc34923-cf9e-41b6-bc24-fa3c7d6cf1cf tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] 10.222.0.33 "GET /compute/v2.1/servers/82f0e20e-0209-42dc-bbdc-15d6c0c030d8" status: 200 len: 1313 microversion: 2.1 time: 0.218253 Sep 23 04:39:53.569425 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1200/2368] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:53 2022] GET /compute/v2.1/servers/82f0e20e-0209-42dc-bbdc-15d6c0c030d8 => generated 1313 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:54.055986 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=7,nova_api:INSERT=4 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:39:54.223532 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b05979d3-cdb3-4265-bd66-3678d8c26e84 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:54.224975 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b05979d3-cdb3-4265-bd66-3678d8c26e84 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: aa35cea0-4f7f-4d03-9436-f15264b9f713] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:54.233058 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b05979d3-cdb3-4265-bd66-3678d8c26e84 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:54.233558 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b05979d3-cdb3-4265-bd66-3678d8c26e84 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:54.234392 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b05979d3-cdb3-4265-bd66-3678d8c26e84 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:54.235118 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b05979d3-cdb3-4265-bd66-3678d8c26e84 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:54.235742 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b05979d3-cdb3-4265-bd66-3678d8c26e84 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:54.236174 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b05979d3-cdb3-4265-bd66-3678d8c26e84 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:54.692422 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b05979d3-cdb3-4265-bd66-3678d8c26e84 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:54.701453 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b05979d3-cdb3-4265-bd66-3678d8c26e84 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713" status: 200 len: 1392 microversion: 2.1 time: 0.481966 Sep 23 04:39:54.702165 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1201/2369] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:54 2022] GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713 => generated 1392 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:54.707421 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-569b56b8-7e5b-47c8-b800-9c8f4a8a2b4e tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:54.708300 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-569b56b8-7e5b-47c8-b800-9c8f4a8a2b4e tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 42fe539b-6665-43fb-b7a2-bc8a6f2c65d5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:54.721569 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-569b56b8-7e5b-47c8-b800-9c8f4a8a2b4e tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:54.722441 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-569b56b8-7e5b-47c8-b800-9c8f4a8a2b4e tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:54.723118 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-569b56b8-7e5b-47c8-b800-9c8f4a8a2b4e tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:54.724070 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-569b56b8-7e5b-47c8-b800-9c8f4a8a2b4e tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:54.724712 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-569b56b8-7e5b-47c8-b800-9c8f4a8a2b4e tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:54.725204 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-569b56b8-7e5b-47c8-b800-9c8f4a8a2b4e tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:54.874721 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-13306beb-3e01-4a8c-9f38-c92986b8288e tempest-QuotaClassesAdminTestJSON-804048716 tempest-QuotaClassesAdminTestJSON-804048716-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 1.390226 Sep 23 04:39:54.876532 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1169/2370] 10.222.0.33 () {60 vars in 1206 bytes} [Fri Sep 23 04:39:53 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 1392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:39:54.882969 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d3a639c6-de3f-46d0-888d-e21f7e4f699f tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:54.883637 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d3a639c6-de3f-46d0-888d-e21f7e4f699f tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:54.890473 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d3a639c6-de3f-46d0-888d-e21f7e4f699f tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:54.891173 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d3a639c6-de3f-46d0-888d-e21f7e4f699f tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:54.892085 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d3a639c6-de3f-46d0-888d-e21f7e4f699f tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:54.893006 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d3a639c6-de3f-46d0-888d-e21f7e4f699f tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:54.893629 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d3a639c6-de3f-46d0-888d-e21f7e4f699f tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:54.894241 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d3a639c6-de3f-46d0-888d-e21f7e4f699f tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:55.014197 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d3a639c6-de3f-46d0-888d-e21f7e4f699f tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:55.024185 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d3a639c6-de3f-46d0-888d-e21f7e4f699f tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:55.025689 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d3a639c6-de3f-46d0-888d-e21f7e4f699f tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:55.031000 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d3a639c6-de3f-46d0-888d-e21f7e4f699f tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1537 microversion: 2.91 time: 0.153174 Sep 23 04:39:55.046101 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1170/2371] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:39:54 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1537 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:39:55.058226 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9ea811be-34dc-4dea-a112-74f78d2b051d tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:55.058853 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-9ea811be-34dc-4dea-a112-74f78d2b051d tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] [instance: 82f0e20e-0209-42dc-bbdc-15d6c0c030d8] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:55.065635 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9ea811be-34dc-4dea-a112-74f78d2b051d tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:55.065875 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-569b56b8-7e5b-47c8-b800-9c8f4a8a2b4e tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:55.066169 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9ea811be-34dc-4dea-a112-74f78d2b051d tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:55.066667 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9ea811be-34dc-4dea-a112-74f78d2b051d tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:55.067400 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9ea811be-34dc-4dea-a112-74f78d2b051d tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:55.067868 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9ea811be-34dc-4dea-a112-74f78d2b051d tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:55.068389 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9ea811be-34dc-4dea-a112-74f78d2b051d tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:55.077406 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-569b56b8-7e5b-47c8-b800-9c8f4a8a2b4e tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/42fe539b-6665-43fb-b7a2-bc8a6f2c65d5" status: 200 len: 1315 microversion: 2.1 time: 0.373850 Sep 23 04:39:55.078683 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1202/2372] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:54 2022] GET /compute/v2.1/servers/42fe539b-6665-43fb-b7a2-bc8a6f2c65d5 => generated 1315 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:55.088079 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f8d8192c-ba62-4f17-8d2d-9f9cb7294444 tempest-QuotaClassesAdminTestJSON-804048716 tempest-QuotaClassesAdminTestJSON-804048716-project-admin] Calling method '.version_select at 0x7ff1bb824c10>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:55.102156 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f8d8192c-ba62-4f17-8d2d-9f9cb7294444 tempest-QuotaClassesAdminTestJSON-804048716 tempest-QuotaClassesAdminTestJSON-804048716-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.022023 Sep 23 04:39:55.102956 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1203/2373] 10.222.0.33 () {58 vars in 1185 bytes} [Fri Sep 23 04:39:55 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:39:55.116500 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-50a44ba3-b3d7-4840-a57a-a5bc3992e72b tempest-QuotaClassesAdminTestJSON-804048716 tempest-QuotaClassesAdminTestJSON-804048716-project-admin] Action: 'update', calling method: .version_select at 0x7ff1bafc1b80>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:39:55.385454 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-9ea811be-34dc-4dea-a112-74f78d2b051d tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d5e06dc2ba4f779359c55804ed79a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c54af2d42a04748b9c52c4a4846c03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:55.393739 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9ea811be-34dc-4dea-a112-74f78d2b051d tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] 10.222.0.33 "GET /compute/v2.1/servers/82f0e20e-0209-42dc-bbdc-15d6c0c030d8" status: 200 len: 1313 microversion: 2.1 time: 0.346439 Sep 23 04:39:55.394352 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1171/2374] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:55 2022] GET /compute/v2.1/servers/82f0e20e-0209-42dc-bbdc-15d6c0c030d8 => generated 1313 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:55.726445 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-31385e5e-6d69-4b9b-bb26-a0018a24ebf0 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:55.727504 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-31385e5e-6d69-4b9b-bb26-a0018a24ebf0 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: aa35cea0-4f7f-4d03-9436-f15264b9f713] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:55.734190 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-31385e5e-6d69-4b9b-bb26-a0018a24ebf0 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:55.734689 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-31385e5e-6d69-4b9b-bb26-a0018a24ebf0 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:55.735132 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-31385e5e-6d69-4b9b-bb26-a0018a24ebf0 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:55.735862 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-31385e5e-6d69-4b9b-bb26-a0018a24ebf0 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:55.736321 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-31385e5e-6d69-4b9b-bb26-a0018a24ebf0 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:55.736931 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-31385e5e-6d69-4b9b-bb26-a0018a24ebf0 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:55.935661 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-31385e5e-6d69-4b9b-bb26-a0018a24ebf0 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:55.944219 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-31385e5e-6d69-4b9b-bb26-a0018a24ebf0 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713" status: 200 len: 1382 microversion: 2.1 time: 0.221696 Sep 23 04:39:55.953363 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1172/2375] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:55 2022] GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713 => generated 1382 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:39:55.984371 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8fe37c9b-314f-4227-8222-0740a8927384 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Calling method '.version_select at 0x7ff1bb917c10>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:55.994017 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8fe37c9b-314f-4227-8222-0740a8927384 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:55.995864 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8fe37c9b-314f-4227-8222-0740a8927384 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:55.996845 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8fe37c9b-314f-4227-8222-0740a8927384 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:56.025288 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8fe37c9b-314f-4227-8222-0740a8927384 tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] 10.222.0.33 "GET /compute/v2.1/os-migrations" status: 200 len: 1554 microversion: 2.1 time: 0.049594 Sep 23 04:39:56.026616 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1173/2376] 10.222.0.33 () {58 vars in 1143 bytes} [Fri Sep 23 04:39:55 2022] GET /compute/v2.1/os-migrations => generated 1554 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:56.051800 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-26975bd7-3adf-49d0-8f25-d2f8966c4a4d tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:56.052356 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-26975bd7-3adf-49d0-8f25-d2f8966c4a4d tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] [instance: aa35cea0-4f7f-4d03-9436-f15264b9f713] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:56.073577 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-26975bd7-3adf-49d0-8f25-d2f8966c4a4d tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:56.074134 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-26975bd7-3adf-49d0-8f25-d2f8966c4a4d tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:56.074582 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-26975bd7-3adf-49d0-8f25-d2f8966c4a4d tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:56.075518 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-26975bd7-3adf-49d0-8f25-d2f8966c4a4d tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:56.078433 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-26975bd7-3adf-49d0-8f25-d2f8966c4a4d tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:56.079040 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-26975bd7-3adf-49d0-8f25-d2f8966c4a4d tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:56.397748 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-26975bd7-3adf-49d0-8f25-d2f8966c4a4d tempest-LiveMigrationTest-181300380 tempest-LiveMigrationTest-181300380-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713" status: 200 len: 1533 microversion: 2.1 time: 0.356695 Sep 23 04:39:56.399230 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1174/2377] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:56 2022] GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713 => generated 1533 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:56.409788 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1efcecca-8443-4818-8955-83663e732eab tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:56.411919 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-1efcecca-8443-4818-8955-83663e732eab tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:56.429329 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-50a44ba3-b3d7-4840-a57a-a5bc3992e72b tempest-QuotaClassesAdminTestJSON-804048716 tempest-QuotaClassesAdminTestJSON-804048716-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 1.317368 Sep 23 04:39:56.440288 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1204/2378] 10.222.0.33 () {60 vars in 1206 bytes} [Fri Sep 23 04:39:55 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:39:56.452815 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7813de00-ed14-45ad-ae71-c84b3aca8d4a tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:56.453784 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-7813de00-ed14-45ad-ae71-c84b3aca8d4a tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 42fe539b-6665-43fb-b7a2-bc8a6f2c65d5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:56.457719 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1efcecca-8443-4818-8955-83663e732eab tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:56.459520 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1efcecca-8443-4818-8955-83663e732eab tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:56.462794 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1efcecca-8443-4818-8955-83663e732eab tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:56.465302 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7813de00-ed14-45ad-ae71-c84b3aca8d4a tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:56.466671 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7813de00-ed14-45ad-ae71-c84b3aca8d4a tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:56.466977 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1efcecca-8443-4818-8955-83663e732eab tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:56.467636 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7813de00-ed14-45ad-ae71-c84b3aca8d4a tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:56.468448 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7813de00-ed14-45ad-ae71-c84b3aca8d4a tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:56.469026 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7813de00-ed14-45ad-ae71-c84b3aca8d4a tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:56.469558 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1efcecca-8443-4818-8955-83663e732eab tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:56.470036 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1efcecca-8443-4818-8955-83663e732eab tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:56.470645 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7813de00-ed14-45ad-ae71-c84b3aca8d4a tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:56.481340 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=100 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:39:56.638975 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-1efcecca-8443-4818-8955-83663e732eab tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:56.648791 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-1efcecca-8443-4818-8955-83663e732eab tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:56.650474 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-1efcecca-8443-4818-8955-83663e732eab tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:56.660593 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-1efcecca-8443-4818-8955-83663e732eab tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1537 microversion: 2.91 time: 0.260070 Sep 23 04:39:56.661192 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1175/2379] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:39:56 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1537 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:39:56.672979 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-6d513f62-0d1c-4f63-b4a8-5d88a5ae5b2b req-e666dbfd-a093-44b8-b0c9-4cb8afe85124 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82f0e20e-0209-42dc-bbdc-15d6c0c030d8", "name": "network-vif-plugged", "status": "completed", "tag": "e7206eea-5f84-4dea-89fc-e6e135ad9cd6"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:39:56.693954 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-6d513f62-0d1c-4f63-b4a8-5d88a5ae5b2b req-e666dbfd-a093-44b8-b0c9-4cb8afe85124 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:56.694714 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-6d513f62-0d1c-4f63-b4a8-5d88a5ae5b2b req-e666dbfd-a093-44b8-b0c9-4cb8afe85124 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:56.695319 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-6d513f62-0d1c-4f63-b4a8-5d88a5ae5b2b req-e666dbfd-a093-44b8-b0c9-4cb8afe85124 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:56.707952 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-6d513f62-0d1c-4f63-b4a8-5d88a5ae5b2b req-e666dbfd-a093-44b8-b0c9-4cb8afe85124 service nova] Creating event network-vif-plugged:e7206eea-5f84-4dea-89fc-e6e135ad9cd6 for instance 82f0e20e-0209-42dc-bbdc-15d6c0c030d8 on n-h2-846463-3 Sep 23 04:39:56.713132 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-6d513f62-0d1c-4f63-b4a8-5d88a5ae5b2b req-e666dbfd-a093-44b8-b0c9-4cb8afe85124 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050780 Sep 23 04:39:56.714194 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1176/2380] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:39:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:39:56.719777 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-15e7326f-0778-4eac-b4ef-100dbc1f6323 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:56.720586 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-15e7326f-0778-4eac-b4ef-100dbc1f6323 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] [instance: 82f0e20e-0209-42dc-bbdc-15d6c0c030d8] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:56.727705 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-15e7326f-0778-4eac-b4ef-100dbc1f6323 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:56.728210 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-15e7326f-0778-4eac-b4ef-100dbc1f6323 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:56.728657 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-15e7326f-0778-4eac-b4ef-100dbc1f6323 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:56.729379 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-15e7326f-0778-4eac-b4ef-100dbc1f6323 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:56.730107 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-15e7326f-0778-4eac-b4ef-100dbc1f6323 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:56.730377 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-15e7326f-0778-4eac-b4ef-100dbc1f6323 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:56.898411 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-7813de00-ed14-45ad-ae71-c84b3aca8d4a tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:56.910779 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-7813de00-ed14-45ad-ae71-c84b3aca8d4a tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/42fe539b-6665-43fb-b7a2-bc8a6f2c65d5" status: 200 len: 1315 microversion: 2.1 time: 0.468230 Sep 23 04:39:56.912297 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1205/2381] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:56 2022] GET /compute/v2.1/servers/42fe539b-6665-43fb-b7a2-bc8a6f2c65d5 => generated 1315 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:56.921453 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8270eae6-63e4-4f8b-8a9d-f0d7a294c016 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:56.922289 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-8270eae6-63e4-4f8b-8a9d-f0d7a294c016 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: aa35cea0-4f7f-4d03-9436-f15264b9f713] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:56.930316 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8270eae6-63e4-4f8b-8a9d-f0d7a294c016 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:56.930815 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8270eae6-63e4-4f8b-8a9d-f0d7a294c016 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:56.931256 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8270eae6-63e4-4f8b-8a9d-f0d7a294c016 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:56.932061 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8270eae6-63e4-4f8b-8a9d-f0d7a294c016 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:56.932524 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8270eae6-63e4-4f8b-8a9d-f0d7a294c016 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:56.932997 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8270eae6-63e4-4f8b-8a9d-f0d7a294c016 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:56.970530 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-8270eae6-63e4-4f8b-8a9d-f0d7a294c016 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: aa35cea0-4f7f-4d03-9436-f15264b9f713] Going to try to terminate instance {{(pid=122699) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:39:57.043537 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-15e7326f-0778-4eac-b4ef-100dbc1f6323 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d5e06dc2ba4f779359c55804ed79a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c54af2d42a04748b9c52c4a4846c03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:57.052758 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-15e7326f-0778-4eac-b4ef-100dbc1f6323 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] 10.222.0.33 "GET /compute/v2.1/servers/82f0e20e-0209-42dc-bbdc-15d6c0c030d8" status: 200 len: 1313 microversion: 2.1 time: 0.337283 Sep 23 04:39:57.053680 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1177/2382] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:56 2022] GET /compute/v2.1/servers/82f0e20e-0209-42dc-bbdc-15d6c0c030d8 => generated 1313 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:57.344742 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-8270eae6-63e4-4f8b-8a9d-f0d7a294c016 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "DELETE /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713" status: 204 len: 0 microversion: 2.1 time: 0.429274 Sep 23 04:39:57.345350 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1206/2383] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:39:56 2022] DELETE /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:39:57.354428 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1a3a6ed9-63ba-4e90-821b-20f9a4cbbe0d tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:57.355264 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-1a3a6ed9-63ba-4e90-821b-20f9a4cbbe0d tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: aa35cea0-4f7f-4d03-9436-f15264b9f713] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:57.362842 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1a3a6ed9-63ba-4e90-821b-20f9a4cbbe0d tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:57.363465 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1a3a6ed9-63ba-4e90-821b-20f9a4cbbe0d tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:57.364001 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1a3a6ed9-63ba-4e90-821b-20f9a4cbbe0d tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:57.364796 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1a3a6ed9-63ba-4e90-821b-20f9a4cbbe0d tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:57.365364 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1a3a6ed9-63ba-4e90-821b-20f9a4cbbe0d tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:57.365882 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1a3a6ed9-63ba-4e90-821b-20f9a4cbbe0d tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:57.697169 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-1a3a6ed9-63ba-4e90-821b-20f9a4cbbe0d tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:57.697379 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-26edf173-0f20-41eb-b6c7-55cd27d0d043 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:57.698129 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-26edf173-0f20-41eb-b6c7-55cd27d0d043 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:57.705947 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-26edf173-0f20-41eb-b6c7-55cd27d0d043 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:57.706585 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-26edf173-0f20-41eb-b6c7-55cd27d0d043 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:57.707044 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-1a3a6ed9-63ba-4e90-821b-20f9a4cbbe0d tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713" status: 200 len: 1388 microversion: 2.1 time: 0.356587 Sep 23 04:39:57.707497 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-26edf173-0f20-41eb-b6c7-55cd27d0d043 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:57.708015 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1178/2384] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:57 2022] GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713 => generated 1388 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:57.708641 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-26edf173-0f20-41eb-b6c7-55cd27d0d043 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:57.709243 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-26edf173-0f20-41eb-b6c7-55cd27d0d043 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:57.709806 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-26edf173-0f20-41eb-b6c7-55cd27d0d043 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:57.848714 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-26edf173-0f20-41eb-b6c7-55cd27d0d043 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:57.859383 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-26edf173-0f20-41eb-b6c7-55cd27d0d043 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:57.863961 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-26edf173-0f20-41eb-b6c7-55cd27d0d043 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:57.872757 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-26edf173-0f20-41eb-b6c7-55cd27d0d043 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1537 microversion: 2.91 time: 0.175120 Sep 23 04:39:57.873551 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1207/2385] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:39:57 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1537 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:39:57.937281 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-cdd9e2e3-df1e-4c99-b8a4-d27610906f30 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:57.937940 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-cdd9e2e3-df1e-4c99-b8a4-d27610906f30 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 42fe539b-6665-43fb-b7a2-bc8a6f2c65d5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:57.944412 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cdd9e2e3-df1e-4c99-b8a4-d27610906f30 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:57.944912 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cdd9e2e3-df1e-4c99-b8a4-d27610906f30 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:57.945358 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cdd9e2e3-df1e-4c99-b8a4-d27610906f30 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:57.946106 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cdd9e2e3-df1e-4c99-b8a4-d27610906f30 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:57.946581 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cdd9e2e3-df1e-4c99-b8a4-d27610906f30 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:57.947013 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cdd9e2e3-df1e-4c99-b8a4-d27610906f30 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:58.075922 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-dbbc1206-8499-4aab-9118-bdd784ad80f1 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:58.076549 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-dbbc1206-8499-4aab-9118-bdd784ad80f1 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] [instance: 82f0e20e-0209-42dc-bbdc-15d6c0c030d8] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:58.088120 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dbbc1206-8499-4aab-9118-bdd784ad80f1 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:58.093962 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dbbc1206-8499-4aab-9118-bdd784ad80f1 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:58.095040 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dbbc1206-8499-4aab-9118-bdd784ad80f1 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:58.095819 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dbbc1206-8499-4aab-9118-bdd784ad80f1 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:58.096326 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dbbc1206-8499-4aab-9118-bdd784ad80f1 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:58.096734 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dbbc1206-8499-4aab-9118-bdd784ad80f1 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:58.312198 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-cdd9e2e3-df1e-4c99-b8a4-d27610906f30 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:58.327844 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-cdd9e2e3-df1e-4c99-b8a4-d27610906f30 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/42fe539b-6665-43fb-b7a2-bc8a6f2c65d5" status: 200 len: 1315 microversion: 2.1 time: 0.394181 Sep 23 04:39:58.344120 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1179/2386] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:57 2022] GET /compute/v2.1/servers/42fe539b-6665-43fb-b7a2-bc8a6f2c65d5 => generated 1315 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:58.499333 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-dbbc1206-8499-4aab-9118-bdd784ad80f1 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d5e06dc2ba4f779359c55804ed79a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c54af2d42a04748b9c52c4a4846c03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:58.508544 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-dbbc1206-8499-4aab-9118-bdd784ad80f1 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] 10.222.0.33 "GET /compute/v2.1/servers/82f0e20e-0209-42dc-bbdc-15d6c0c030d8" status: 200 len: 1313 microversion: 2.1 time: 0.436830 Sep 23 04:39:58.511382 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1208/2387] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:58 2022] GET /compute/v2.1/servers/82f0e20e-0209-42dc-bbdc-15d6c0c030d8 => generated 1313 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:39:58.738781 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-e575d01e-039d-4f86-89c2-660c56192a01 req-bd189c63-ade6-4cef-b90f-93113d238ce4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42fe539b-6665-43fb-b7a2-bc8a6f2c65d5", "name": "network-vif-plugged", "status": "completed", "tag": "612a667a-9f5d-490a-b4df-3250d5946428"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:39:58.746039 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-73b205dc-2086-49b5-803b-b9d127fd9edc tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:58.749762 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-73b205dc-2086-49b5-803b-b9d127fd9edc tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: aa35cea0-4f7f-4d03-9436-f15264b9f713] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:58.756497 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-e575d01e-039d-4f86-89c2-660c56192a01 req-bd189c63-ade6-4cef-b90f-93113d238ce4 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:58.756987 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-e575d01e-039d-4f86-89c2-660c56192a01 req-bd189c63-ade6-4cef-b90f-93113d238ce4 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:58.757417 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-e575d01e-039d-4f86-89c2-660c56192a01 req-bd189c63-ade6-4cef-b90f-93113d238ce4 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:58.768457 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-73b205dc-2086-49b5-803b-b9d127fd9edc tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:58.769188 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-73b205dc-2086-49b5-803b-b9d127fd9edc tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:58.770158 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-73b205dc-2086-49b5-803b-b9d127fd9edc tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:58.771036 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-73b205dc-2086-49b5-803b-b9d127fd9edc tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:58.771676 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-73b205dc-2086-49b5-803b-b9d127fd9edc tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:58.772258 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-73b205dc-2086-49b5-803b-b9d127fd9edc tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:58.789345 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-e575d01e-039d-4f86-89c2-660c56192a01 req-bd189c63-ade6-4cef-b90f-93113d238ce4 service nova] Creating event network-vif-plugged:612a667a-9f5d-490a-b4df-3250d5946428 for instance 42fe539b-6665-43fb-b7a2-bc8a6f2c65d5 on n-h2-846463-3 Sep 23 04:39:58.799794 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-e575d01e-039d-4f86-89c2-660c56192a01 req-bd189c63-ade6-4cef-b90f-93113d238ce4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062841 Sep 23 04:39:58.802093 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1209/2388] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:39:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:39:58.903711 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e8e91612-1ffe-41c0-abbb-9447b6acfe9f tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:58.905188 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e8e91612-1ffe-41c0-abbb-9447b6acfe9f tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:58.920709 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e8e91612-1ffe-41c0-abbb-9447b6acfe9f tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:58.930222 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e8e91612-1ffe-41c0-abbb-9447b6acfe9f tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:58.930222 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e8e91612-1ffe-41c0-abbb-9447b6acfe9f tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:58.930222 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e8e91612-1ffe-41c0-abbb-9447b6acfe9f tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:58.930222 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e8e91612-1ffe-41c0-abbb-9447b6acfe9f tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:58.930222 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e8e91612-1ffe-41c0-abbb-9447b6acfe9f tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:59.033828 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e8e91612-1ffe-41c0-abbb-9447b6acfe9f tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:59.060473 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-73b205dc-2086-49b5-803b-b9d127fd9edc tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:59.065164 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e8e91612-1ffe-41c0-abbb-9447b6acfe9f tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:59.066860 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e8e91612-1ffe-41c0-abbb-9447b6acfe9f tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:59.072678 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-73b205dc-2086-49b5-803b-b9d127fd9edc tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713" status: 200 len: 1388 microversion: 2.1 time: 0.341596 Sep 23 04:39:59.073969 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1180/2389] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:58 2022] GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713 => generated 1388 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:59.083003 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e8e91612-1ffe-41c0-abbb-9447b6acfe9f tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1537 microversion: 2.91 time: 0.184780 Sep 23 04:39:59.083749 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1210/2390] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:39:58 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1537 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:39:59.351900 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3a004727-6783-456d-994d-f93195b1b1c9 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:59.352737 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3a004727-6783-456d-994d-f93195b1b1c9 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 42fe539b-6665-43fb-b7a2-bc8a6f2c65d5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:59.410742 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3a004727-6783-456d-994d-f93195b1b1c9 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:59.411844 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3a004727-6783-456d-994d-f93195b1b1c9 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:59.413048 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3a004727-6783-456d-994d-f93195b1b1c9 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:59.414331 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3a004727-6783-456d-994d-f93195b1b1c9 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:59.414993 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3a004727-6783-456d-994d-f93195b1b1c9 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:59.415712 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3a004727-6783-456d-994d-f93195b1b1c9 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:59.540849 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9fccba38-9977-45e2-a0d1-56669126f483 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:59.542770 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-9fccba38-9977-45e2-a0d1-56669126f483 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] [instance: 82f0e20e-0209-42dc-bbdc-15d6c0c030d8] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:39:59.550651 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9fccba38-9977-45e2-a0d1-56669126f483 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:59.551311 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9fccba38-9977-45e2-a0d1-56669126f483 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:59.554147 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9fccba38-9977-45e2-a0d1-56669126f483 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:59.554147 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9fccba38-9977-45e2-a0d1-56669126f483 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:59.554147 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9fccba38-9977-45e2-a0d1-56669126f483 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:59.554147 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9fccba38-9977-45e2-a0d1-56669126f483 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:59.588095 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-3a004727-6783-456d-994d-f93195b1b1c9 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:59.613815 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3a004727-6783-456d-994d-f93195b1b1c9 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/42fe539b-6665-43fb-b7a2-bc8a6f2c65d5" status: 200 len: 1315 microversion: 2.1 time: 0.250458 Sep 23 04:39:59.615119 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1181/2391] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:59 2022] GET /compute/v2.1/servers/42fe539b-6665-43fb-b7a2-bc8a6f2c65d5 => generated 1315 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:59.856470 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-ad8278ca-ec83-4708-935a-7386e3475541 req-bab4e142-982b-44a1-8478-88aeeba5e074 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa35cea0-4f7f-4d03-9436-f15264b9f713", "name": "network-vif-deleted", "tag": "bc9fa346-7e65-43be-854e-637e4641d7f9"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:39:59.883231 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-ad8278ca-ec83-4708-935a-7386e3475541 req-bab4e142-982b-44a1-8478-88aeeba5e074 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:59.884250 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-ad8278ca-ec83-4708-935a-7386e3475541 req-bab4e142-982b-44a1-8478-88aeeba5e074 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:59.885987 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-ad8278ca-ec83-4708-935a-7386e3475541 req-bab4e142-982b-44a1-8478-88aeeba5e074 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:39:59.898715 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-9fccba38-9977-45e2-a0d1-56669126f483 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d5e06dc2ba4f779359c55804ed79a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c54af2d42a04748b9c52c4a4846c03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:39:59.908956 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-ad8278ca-ec83-4708-935a-7386e3475541 req-bab4e142-982b-44a1-8478-88aeeba5e074 service nova] Creating event network-vif-deleted:bc9fa346-7e65-43be-854e-637e4641d7f9 for instance aa35cea0-4f7f-4d03-9436-f15264b9f713 on n-h2-846463-3 Sep 23 04:39:59.910751 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-9fccba38-9977-45e2-a0d1-56669126f483 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] 10.222.0.33 "GET /compute/v2.1/servers/82f0e20e-0209-42dc-bbdc-15d6c0c030d8" status: 200 len: 1498 microversion: 2.1 time: 0.376423 Sep 23 04:39:59.913864 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1211/2392] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:39:59 2022] GET /compute/v2.1/servers/82f0e20e-0209-42dc-bbdc-15d6c0c030d8 => generated 1498 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:39:59.936058 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-ad8278ca-ec83-4708-935a-7386e3475541 req-bab4e142-982b-44a1-8478-88aeeba5e074 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084814 Sep 23 04:39:59.939149 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1182/2393] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:39:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:39:59.940770 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d92d1e58-acd4-4e15-8b08-aa20e26a8788 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:39:59.970894 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.compute.server_groups [None req-d92d1e58-acd4-4e15-8b08-aa20e26a8788 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Querying cell feac528b-4983-4e61-aae7-f1973fe5bc2c(cell1) for 1 instances {{(pid=122699) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 23 04:39:59.971437 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d92d1e58-acd4-4e15-8b08-aa20e26a8788 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:39:59.971982 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d92d1e58-acd4-4e15-8b08-aa20e26a8788 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:39:59.972355 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d92d1e58-acd4-4e15-8b08-aa20e26a8788 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:00.031448 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d92d1e58-acd4-4e15-8b08-aa20e26a8788 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] 10.222.0.33 "GET /compute/v2.1/os-server-groups/9a387ef9-8706-4119-8155-93d3e8f66e16" status: 200 len: 221 microversion: 2.1 time: 0.094456 Sep 23 04:40:00.033455 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1212/2394] 10.222.0.33 () {58 vars in 1263 bytes} [Fri Sep 23 04:39:59 2022] GET /compute/v2.1/os-server-groups/9a387ef9-8706-4119-8155-93d3e8f66e16 => generated 221 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:40:00.048018 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f080e207-02a7-4117-8e78-2d7c8c0564a0 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:00.052136 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f080e207-02a7-4117-8e78-2d7c8c0564a0 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] [instance: 82f0e20e-0209-42dc-bbdc-15d6c0c030d8] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:00.082381 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f080e207-02a7-4117-8e78-2d7c8c0564a0 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:00.083344 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f080e207-02a7-4117-8e78-2d7c8c0564a0 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:00.083898 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f080e207-02a7-4117-8e78-2d7c8c0564a0 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:00.084770 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f080e207-02a7-4117-8e78-2d7c8c0564a0 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:00.085336 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f080e207-02a7-4117-8e78-2d7c8c0564a0 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:00.085910 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f080e207-02a7-4117-8e78-2d7c8c0564a0 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:00.096028 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0c0810e6-133a-48e2-9742-0066e3050554 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:00.097078 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-0c0810e6-133a-48e2-9742-0066e3050554 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: aa35cea0-4f7f-4d03-9436-f15264b9f713] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:00.105305 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0c0810e6-133a-48e2-9742-0066e3050554 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:00.113696 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0c0810e6-133a-48e2-9742-0066e3050554 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:00.114495 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0c0810e6-133a-48e2-9742-0066e3050554 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:00.115475 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0c0810e6-133a-48e2-9742-0066e3050554 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:00.116505 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0c0810e6-133a-48e2-9742-0066e3050554 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:00.117399 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0c0810e6-133a-48e2-9742-0066e3050554 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:00.139695 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f080e207-02a7-4117-8e78-2d7c8c0564a0 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] [instance: 82f0e20e-0209-42dc-bbdc-15d6c0c030d8] Going to try to terminate instance {{(pid=122698) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:40:00.236949 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-0c0810e6-133a-48e2-9742-0066e3050554 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:00.254479 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0c0810e6-133a-48e2-9742-0066e3050554 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713" status: 200 len: 1346 microversion: 2.1 time: 0.161036 Sep 23 04:40:00.254898 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1213/2395] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:40:00 2022] GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713 => generated 1346 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:40:00.266064 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b8d76147-994f-45d6-bcd5-53be4489ae1a tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:00.267427 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b8d76147-994f-45d6-bcd5-53be4489ae1a tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:00.282924 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b8d76147-994f-45d6-bcd5-53be4489ae1a tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:00.284277 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b8d76147-994f-45d6-bcd5-53be4489ae1a tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:00.289249 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b8d76147-994f-45d6-bcd5-53be4489ae1a tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:00.290752 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b8d76147-994f-45d6-bcd5-53be4489ae1a tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:00.291701 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b8d76147-994f-45d6-bcd5-53be4489ae1a tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:00.292298 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b8d76147-994f-45d6-bcd5-53be4489ae1a tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:00.443340 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b8d76147-994f-45d6-bcd5-53be4489ae1a tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:00.455521 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b8d76147-994f-45d6-bcd5-53be4489ae1a tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:00.467280 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b8d76147-994f-45d6-bcd5-53be4489ae1a tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:00.486128 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b8d76147-994f-45d6-bcd5-53be4489ae1a tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1558 microversion: 2.91 time: 0.230071 Sep 23 04:40:00.489538 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1214/2396] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:40:00 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1558 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:40:00.642810 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f080e207-02a7-4117-8e78-2d7c8c0564a0 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] 10.222.0.33 "DELETE /compute/v2.1/servers/82f0e20e-0209-42dc-bbdc-15d6c0c030d8" status: 204 len: 0 microversion: 2.1 time: 0.601948 Sep 23 04:40:00.643430 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1183/2397] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:40:00 2022] DELETE /compute/v2.1/servers/82f0e20e-0209-42dc-bbdc-15d6c0c030d8 => generated 0 bytes in 604 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:40:00.645151 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5eed65c5-5706-46ed-ae00-ee46caf2035f tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:00.654289 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-5eed65c5-5706-46ed-ae00-ee46caf2035f tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 42fe539b-6665-43fb-b7a2-bc8a6f2c65d5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:00.662127 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a45e84ff-fad4-4a7c-a4c2-727889079514 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:00.668653 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a45e84ff-fad4-4a7c-a4c2-727889079514 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] [instance: 82f0e20e-0209-42dc-bbdc-15d6c0c030d8] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:00.680850 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5eed65c5-5706-46ed-ae00-ee46caf2035f tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:00.685291 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5eed65c5-5706-46ed-ae00-ee46caf2035f tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:00.685291 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5eed65c5-5706-46ed-ae00-ee46caf2035f tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:00.685291 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5eed65c5-5706-46ed-ae00-ee46caf2035f tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:00.685291 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5eed65c5-5706-46ed-ae00-ee46caf2035f tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:00.685291 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5eed65c5-5706-46ed-ae00-ee46caf2035f tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:00.687723 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a45e84ff-fad4-4a7c-a4c2-727889079514 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:00.688232 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a45e84ff-fad4-4a7c-a4c2-727889079514 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:00.688705 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a45e84ff-fad4-4a7c-a4c2-727889079514 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:00.689379 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a45e84ff-fad4-4a7c-a4c2-727889079514 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:00.689836 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a45e84ff-fad4-4a7c-a4c2-727889079514 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:00.690296 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a45e84ff-fad4-4a7c-a4c2-727889079514 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:01.161949 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-5eed65c5-5706-46ed-ae00-ee46caf2035f tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:01.172161 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5eed65c5-5706-46ed-ae00-ee46caf2035f tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/42fe539b-6665-43fb-b7a2-bc8a6f2c65d5" status: 200 len: 1315 microversion: 2.1 time: 0.536394 Sep 23 04:40:01.175299 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1215/2398] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:40:00 2022] GET /compute/v2.1/servers/42fe539b-6665-43fb-b7a2-bc8a6f2c65d5 => generated 1315 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:40:01.203457 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a45e84ff-fad4-4a7c-a4c2-727889079514 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d5e06dc2ba4f779359c55804ed79a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c54af2d42a04748b9c52c4a4846c03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:01.211542 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a45e84ff-fad4-4a7c-a4c2-727889079514 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] 10.222.0.33 "GET /compute/v2.1/servers/82f0e20e-0209-42dc-bbdc-15d6c0c030d8" status: 200 len: 1504 microversion: 2.1 time: 0.556913 Sep 23 04:40:01.217498 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1184/2399] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:40:00 2022] GET /compute/v2.1/servers/82f0e20e-0209-42dc-bbdc-15d6c0c030d8 => generated 1504 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:40:01.285966 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6615bb46-8d49-4808-8e40-db560283d37e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:01.286978 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-6615bb46-8d49-4808-8e40-db560283d37e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: aa35cea0-4f7f-4d03-9436-f15264b9f713] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:01.307382 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6615bb46-8d49-4808-8e40-db560283d37e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:01.311895 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6615bb46-8d49-4808-8e40-db560283d37e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:01.313848 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6615bb46-8d49-4808-8e40-db560283d37e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:01.315074 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6615bb46-8d49-4808-8e40-db560283d37e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:01.316281 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6615bb46-8d49-4808-8e40-db560283d37e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:01.318451 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6615bb46-8d49-4808-8e40-db560283d37e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:01.447800 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-6615bb46-8d49-4808-8e40-db560283d37e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:01.461161 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6615bb46-8d49-4808-8e40-db560283d37e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713" status: 200 len: 1184 microversion: 2.1 time: 0.185015 Sep 23 04:40:01.467857 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1216/2400] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:40:01 2022] GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713 => generated 1184 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:40:01.528360 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-153d7085-c00b-4987-8700-2c9b3ab72427 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:01.529092 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-153d7085-c00b-4987-8700-2c9b3ab72427 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:01.549383 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-153d7085-c00b-4987-8700-2c9b3ab72427 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:01.550167 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-153d7085-c00b-4987-8700-2c9b3ab72427 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:01.550832 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-153d7085-c00b-4987-8700-2c9b3ab72427 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:01.551819 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-153d7085-c00b-4987-8700-2c9b3ab72427 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:01.555293 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-153d7085-c00b-4987-8700-2c9b3ab72427 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:01.556921 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-153d7085-c00b-4987-8700-2c9b3ab72427 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:01.664469 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-153d7085-c00b-4987-8700-2c9b3ab72427 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:01.686334 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-153d7085-c00b-4987-8700-2c9b3ab72427 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:01.702536 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-153d7085-c00b-4987-8700-2c9b3ab72427 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:01.723147 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-153d7085-c00b-4987-8700-2c9b3ab72427 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1558 microversion: 2.91 time: 0.204509 Sep 23 04:40:01.724783 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1185/2401] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:40:01 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1558 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:40:02.206662 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-98bf56c9-a438-44dc-84bd-98160f96f8d2 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:02.208269 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-98bf56c9-a438-44dc-84bd-98160f96f8d2 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 42fe539b-6665-43fb-b7a2-bc8a6f2c65d5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:02.233999 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-98bf56c9-a438-44dc-84bd-98160f96f8d2 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:02.251342 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7ac17fcb-4e11-4aac-bbeb-f67040097231 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:02.252808 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-98bf56c9-a438-44dc-84bd-98160f96f8d2 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:02.253114 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7ac17fcb-4e11-4aac-bbeb-f67040097231 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] [instance: 82f0e20e-0209-42dc-bbdc-15d6c0c030d8] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:02.256044 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-98bf56c9-a438-44dc-84bd-98160f96f8d2 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:02.260978 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-98bf56c9-a438-44dc-84bd-98160f96f8d2 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:02.264262 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-98bf56c9-a438-44dc-84bd-98160f96f8d2 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:02.265010 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-98bf56c9-a438-44dc-84bd-98160f96f8d2 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:02.268823 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7ac17fcb-4e11-4aac-bbeb-f67040097231 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:02.272175 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7ac17fcb-4e11-4aac-bbeb-f67040097231 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:02.273978 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7ac17fcb-4e11-4aac-bbeb-f67040097231 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:02.276922 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7ac17fcb-4e11-4aac-bbeb-f67040097231 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:02.278923 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7ac17fcb-4e11-4aac-bbeb-f67040097231 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:02.279755 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7ac17fcb-4e11-4aac-bbeb-f67040097231 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:02.819360 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-7ac17fcb-4e11-4aac-bbeb-f67040097231 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d5e06dc2ba4f779359c55804ed79a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c54af2d42a04748b9c52c4a4846c03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:02.822816 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:40:02.832101 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7ac17fcb-4e11-4aac-bbeb-f67040097231 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] 10.222.0.33 "GET /compute/v2.1/servers/82f0e20e-0209-42dc-bbdc-15d6c0c030d8" status: 200 len: 1504 microversion: 2.1 time: 0.599924 Sep 23 04:40:02.833418 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1186/2402] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:40:02 2022] GET /compute/v2.1/servers/82f0e20e-0209-42dc-bbdc-15d6c0c030d8 => generated 1504 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:40:02.853761 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d7a0cbe2-dcdc-443a-a218-2f692d216ff4 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:02.854449 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d7a0cbe2-dcdc-443a-a218-2f692d216ff4 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: aa35cea0-4f7f-4d03-9436-f15264b9f713] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:02.868590 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d7a0cbe2-dcdc-443a-a218-2f692d216ff4 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:02.869099 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d7a0cbe2-dcdc-443a-a218-2f692d216ff4 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:02.869539 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d7a0cbe2-dcdc-443a-a218-2f692d216ff4 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:02.875102 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d7a0cbe2-dcdc-443a-a218-2f692d216ff4 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:02.875678 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d7a0cbe2-dcdc-443a-a218-2f692d216ff4 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:02.876254 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d7a0cbe2-dcdc-443a-a218-2f692d216ff4 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:03.705196 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d7a0cbe2-dcdc-443a-a218-2f692d216ff4 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:03.717455 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-98bf56c9-a438-44dc-84bd-98160f96f8d2 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:03.722801 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d7a0cbe2-dcdc-443a-a218-2f692d216ff4 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713" status: 200 len: 1184 microversion: 2.1 time: 0.887854 Sep 23 04:40:03.723931 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1187/2403] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:40:02 2022] GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713 => generated 1184 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:40:03.738257 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-41732b3b-5a09-4566-b97f-73784fa7915d tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:03.739153 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-41732b3b-5a09-4566-b97f-73784fa7915d tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:03.750461 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-98bf56c9-a438-44dc-84bd-98160f96f8d2 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/42fe539b-6665-43fb-b7a2-bc8a6f2c65d5" status: 200 len: 1502 microversion: 2.1 time: 1.548270 Sep 23 04:40:03.751077 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1217/2404] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:40:02 2022] GET /compute/v2.1/servers/42fe539b-6665-43fb-b7a2-bc8a6f2c65d5 => generated 1502 bytes in 1552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:40:03.753453 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-41732b3b-5a09-4566-b97f-73784fa7915d tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:03.754241 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-41732b3b-5a09-4566-b97f-73784fa7915d tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:03.754959 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-41732b3b-5a09-4566-b97f-73784fa7915d tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:03.755892 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-41732b3b-5a09-4566-b97f-73784fa7915d tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:03.756541 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-41732b3b-5a09-4566-b97f-73784fa7915d tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:03.757162 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-41732b3b-5a09-4566-b97f-73784fa7915d tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:03.792873 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e9868392-7bc2-4ddb-864f-c2bc5401cf41 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:40:03.793708 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e9868392-7bc2-4ddb-864f-c2bc5401cf41 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 42fe539b-6665-43fb-b7a2-bc8a6f2c65d5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:03.807443 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e9868392-7bc2-4ddb-864f-c2bc5401cf41 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:03.808236 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e9868392-7bc2-4ddb-864f-c2bc5401cf41 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:03.811519 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e9868392-7bc2-4ddb-864f-c2bc5401cf41 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:03.812485 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e9868392-7bc2-4ddb-864f-c2bc5401cf41 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:03.813316 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e9868392-7bc2-4ddb-864f-c2bc5401cf41 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:03.815041 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e9868392-7bc2-4ddb-864f-c2bc5401cf41 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:03.847279 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-e9868392-7bc2-4ddb-864f-c2bc5401cf41 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lazy-loading 'flavor' on Instance uuid 42fe539b-6665-43fb-b7a2-bc8a6f2c65d5 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:40:03.864296 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-41732b3b-5a09-4566-b97f-73784fa7915d tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:03.876287 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-41732b3b-5a09-4566-b97f-73784fa7915d tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:03.877924 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-41732b3b-5a09-4566-b97f-73784fa7915d tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:03.884097 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-41732b3b-5a09-4566-b97f-73784fa7915d tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1553 microversion: 2.91 time: 0.159018 Sep 23 04:40:03.884872 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1188/2405] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:40:03 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1553 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:40:03.912419 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9714606c-fa24-4526-b00a-89370a43cb98 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:03.913060 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-9714606c-fa24-4526-b00a-89370a43cb98 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] [instance: 82f0e20e-0209-42dc-bbdc-15d6c0c030d8] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:03.919495 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9714606c-fa24-4526-b00a-89370a43cb98 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:03.919998 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9714606c-fa24-4526-b00a-89370a43cb98 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:03.920444 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9714606c-fa24-4526-b00a-89370a43cb98 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:03.921167 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9714606c-fa24-4526-b00a-89370a43cb98 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:03.921930 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9714606c-fa24-4526-b00a-89370a43cb98 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:03.922366 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9714606c-fa24-4526-b00a-89370a43cb98 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:04.198604 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-9714606c-fa24-4526-b00a-89370a43cb98 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d5e06dc2ba4f779359c55804ed79a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c54af2d42a04748b9c52c4a4846c03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:04.207957 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9714606c-fa24-4526-b00a-89370a43cb98 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] 10.222.0.33 "GET /compute/v2.1/servers/82f0e20e-0209-42dc-bbdc-15d6c0c030d8" status: 200 len: 1504 microversion: 2.1 time: 0.308997 Sep 23 04:40:04.209033 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1189/2406] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:40:03 2022] GET /compute/v2.1/servers/82f0e20e-0209-42dc-bbdc-15d6c0c030d8 => generated 1504 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:40:04.587385 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-3da8eea9-b9cc-4395-b6cc-049583bf0db0 req-2dcea20d-a19a-42f9-8c96-345e73327cbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82f0e20e-0209-42dc-bbdc-15d6c0c030d8", "name": "network-vif-deleted", "tag": "e7206eea-5f84-4dea-89fc-e6e135ad9cd6"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:40:04.626367 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-3da8eea9-b9cc-4395-b6cc-049583bf0db0 req-2dcea20d-a19a-42f9-8c96-345e73327cbe service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:04.626865 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-3da8eea9-b9cc-4395-b6cc-049583bf0db0 req-2dcea20d-a19a-42f9-8c96-345e73327cbe service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:04.627304 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-3da8eea9-b9cc-4395-b6cc-049583bf0db0 req-2dcea20d-a19a-42f9-8c96-345e73327cbe service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:04.661762 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-3da8eea9-b9cc-4395-b6cc-049583bf0db0 req-2dcea20d-a19a-42f9-8c96-345e73327cbe service nova] Creating event network-vif-deleted:e7206eea-5f84-4dea-89fc-e6e135ad9cd6 for instance 82f0e20e-0209-42dc-bbdc-15d6c0c030d8 on n-h2-846463-3 Sep 23 04:40:04.681376 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-3da8eea9-b9cc-4395-b6cc-049583bf0db0 req-2dcea20d-a19a-42f9-8c96-345e73327cbe service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101552 Sep 23 04:40:04.686892 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1190/2407] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:40:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:40:04.758494 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2bfac71b-d3ba-4fc8-90da-518e97db5abb tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:04.759245 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-2bfac71b-d3ba-4fc8-90da-518e97db5abb tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: aa35cea0-4f7f-4d03-9436-f15264b9f713] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:04.774286 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2bfac71b-d3ba-4fc8-90da-518e97db5abb tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:04.775519 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2bfac71b-d3ba-4fc8-90da-518e97db5abb tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:04.776325 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2bfac71b-d3ba-4fc8-90da-518e97db5abb tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:04.777403 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2bfac71b-d3ba-4fc8-90da-518e97db5abb tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:04.779379 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2bfac71b-d3ba-4fc8-90da-518e97db5abb tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:04.780517 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2bfac71b-d3ba-4fc8-90da-518e97db5abb tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:04.871664 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=25,nova_cell0:UPDATE=7 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:40:04.911365 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e9868392-7bc2-4ddb-864f-c2bc5401cf41 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "POST /compute/v2.1/servers/42fe539b-6665-43fb-b7a2-bc8a6f2c65d5/action" status: 202 len: 0 microversion: 2.1 time: 1.122798 Sep 23 04:40:04.920641 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1218/2408] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:40:03 2022] POST /compute/v2.1/servers/42fe539b-6665-43fb-b7a2-bc8a6f2c65d5/action => generated 0 bytes in 1127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 23 04:40:04.937867 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0dd06577-517d-4c61-b418-23e4ed5ca521 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:04.938631 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-0dd06577-517d-4c61-b418-23e4ed5ca521 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:04.947001 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-2bfac71b-d3ba-4fc8-90da-518e97db5abb tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:04.960893 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0dd06577-517d-4c61-b418-23e4ed5ca521 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:04.961411 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0dd06577-517d-4c61-b418-23e4ed5ca521 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:04.961928 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0dd06577-517d-4c61-b418-23e4ed5ca521 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:04.968168 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0dd06577-517d-4c61-b418-23e4ed5ca521 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:04.969042 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0dd06577-517d-4c61-b418-23e4ed5ca521 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:04.969844 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0dd06577-517d-4c61-b418-23e4ed5ca521 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:04.970329 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2bfac71b-d3ba-4fc8-90da-518e97db5abb tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713" status: 200 len: 1184 microversion: 2.1 time: 0.226952 Sep 23 04:40:04.974599 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1191/2409] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:40:04 2022] GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713 => generated 1184 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:40:04.996438 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:40:05.009037 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e053f392-4d99-4621-80ae-453985d77e0a tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:05.012054 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e053f392-4d99-4621-80ae-453985d77e0a tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 42fe539b-6665-43fb-b7a2-bc8a6f2c65d5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:05.041756 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e053f392-4d99-4621-80ae-453985d77e0a tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:05.047289 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e053f392-4d99-4621-80ae-453985d77e0a tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:05.048179 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e053f392-4d99-4621-80ae-453985d77e0a tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:05.051613 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e053f392-4d99-4621-80ae-453985d77e0a tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:05.053235 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e053f392-4d99-4621-80ae-453985d77e0a tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:05.060179 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e053f392-4d99-4621-80ae-453985d77e0a tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:05.196190 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-0dd06577-517d-4c61-b418-23e4ed5ca521 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:05.207966 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-0dd06577-517d-4c61-b418-23e4ed5ca521 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:05.209585 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-0dd06577-517d-4c61-b418-23e4ed5ca521 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:05.227724 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0dd06577-517d-4c61-b418-23e4ed5ca521 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1553 microversion: 2.91 time: 0.300677 Sep 23 04:40:05.252592 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1219/2410] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:40:04 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1553 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:40:05.269711 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-933dad9a-4f1d-4ccf-803f-9a21defe716b tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:05.271321 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-933dad9a-4f1d-4ccf-803f-9a21defe716b tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] [instance: 82f0e20e-0209-42dc-bbdc-15d6c0c030d8] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:05.280674 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-933dad9a-4f1d-4ccf-803f-9a21defe716b tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:05.281384 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-933dad9a-4f1d-4ccf-803f-9a21defe716b tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:05.284263 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-933dad9a-4f1d-4ccf-803f-9a21defe716b tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:05.285181 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-933dad9a-4f1d-4ccf-803f-9a21defe716b tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:05.285800 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-933dad9a-4f1d-4ccf-803f-9a21defe716b tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:05.286395 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-933dad9a-4f1d-4ccf-803f-9a21defe716b tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:05.331506 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=13 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:40:05.334384 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-933dad9a-4f1d-4ccf-803f-9a21defe716b tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:05.335167 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-933dad9a-4f1d-4ccf-803f-9a21defe716b tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:05.335805 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-933dad9a-4f1d-4ccf-803f-9a21defe716b tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:05.336405 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-933dad9a-4f1d-4ccf-803f-9a21defe716b tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Lazy-loading 'fault' on Instance uuid 82f0e20e-0209-42dc-bbdc-15d6c0c030d8 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:40:05.444803 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-933dad9a-4f1d-4ccf-803f-9a21defe716b tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21d5e06dc2ba4f779359c55804ed79a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c54af2d42a04748b9c52c4a4846c03e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:05.458961 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-933dad9a-4f1d-4ccf-803f-9a21defe716b tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] 10.222.0.33 "GET /compute/v2.1/servers/82f0e20e-0209-42dc-bbdc-15d6c0c030d8" status: 200 len: 1303 microversion: 2.1 time: 0.204467 Sep 23 04:40:05.477262 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1220/2411] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:40:05 2022] GET /compute/v2.1/servers/82f0e20e-0209-42dc-bbdc-15d6c0c030d8 => generated 1303 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:40:05.658343 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e053f392-4d99-4621-80ae-453985d77e0a tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:05.667401 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e053f392-4d99-4621-80ae-453985d77e0a tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/42fe539b-6665-43fb-b7a2-bc8a6f2c65d5" status: 200 len: 1508 microversion: 2.1 time: 0.691703 Sep 23 04:40:05.672059 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1192/2412] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:40:04 2022] GET /compute/v2.1/servers/42fe539b-6665-43fb-b7a2-bc8a6f2c65d5 => generated 1508 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:40:06.020134 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e9b64d50-5369-4756-aa39-eacd147b07a1 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:06.021943 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e9b64d50-5369-4756-aa39-eacd147b07a1 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: aa35cea0-4f7f-4d03-9436-f15264b9f713] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:06.035619 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e9b64d50-5369-4756-aa39-eacd147b07a1 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:06.036432 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e9b64d50-5369-4756-aa39-eacd147b07a1 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:06.037040 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e9b64d50-5369-4756-aa39-eacd147b07a1 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:06.037951 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e9b64d50-5369-4756-aa39-eacd147b07a1 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:06.042089 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e9b64d50-5369-4756-aa39-eacd147b07a1 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:06.042875 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e9b64d50-5369-4756-aa39-eacd147b07a1 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:06.251260 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e9b64d50-5369-4756-aa39-eacd147b07a1 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:06.261630 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e9b64d50-5369-4756-aa39-eacd147b07a1 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713" status: 200 len: 1184 microversion: 2.1 time: 0.245250 Sep 23 04:40:06.263334 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1221/2413] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:40:06 2022] GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713 => generated 1184 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:40:06.265387 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-80606ebb-b3f9-461f-9004-6de548eac90a tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:06.266045 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-80606ebb-b3f9-461f-9004-6de548eac90a tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:06.279264 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-80606ebb-b3f9-461f-9004-6de548eac90a tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:06.279795 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-80606ebb-b3f9-461f-9004-6de548eac90a tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:06.280239 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-80606ebb-b3f9-461f-9004-6de548eac90a tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:06.281366 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-80606ebb-b3f9-461f-9004-6de548eac90a tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:06.281830 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-80606ebb-b3f9-461f-9004-6de548eac90a tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:06.282277 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-80606ebb-b3f9-461f-9004-6de548eac90a tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:06.485269 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a59ac5f4-ad0d-4df0-add1-c40929dabe65 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:06.486182 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a59ac5f4-ad0d-4df0-add1-c40929dabe65 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] [instance: 82f0e20e-0209-42dc-bbdc-15d6c0c030d8] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:06.488270 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=4 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:40:06.501861 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a59ac5f4-ad0d-4df0-add1-c40929dabe65 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:06.503077 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a59ac5f4-ad0d-4df0-add1-c40929dabe65 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:06.503681 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a59ac5f4-ad0d-4df0-add1-c40929dabe65 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:06.505923 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a59ac5f4-ad0d-4df0-add1-c40929dabe65 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:06.506578 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a59ac5f4-ad0d-4df0-add1-c40929dabe65 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:06.509135 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a59ac5f4-ad0d-4df0-add1-c40929dabe65 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:06.519385 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-80606ebb-b3f9-461f-9004-6de548eac90a tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:06.531729 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-80606ebb-b3f9-461f-9004-6de548eac90a tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:06.533551 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-80606ebb-b3f9-461f-9004-6de548eac90a tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:06.542697 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-80606ebb-b3f9-461f-9004-6de548eac90a tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1553 microversion: 2.91 time: 0.285714 Sep 23 04:40:06.552630 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-a59ac5f4-ad0d-4df0-add1-c40929dabe65 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] HTTP exception thrown: Instance 82f0e20e-0209-42dc-bbdc-15d6c0c030d8 could not be found. Sep 23 04:40:06.552630 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a59ac5f4-ad0d-4df0-add1-c40929dabe65 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Request method failure captured: Sep 23 04:40:06.552630 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/82f0e20e-0209-42dc-bbdc-15d6c0c030d8 HTTP/1.1 Sep 23 04:40:06.552630 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:40:06.552630 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:40:06.552630 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:40:06.552630 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:40:06.552630 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:40:06.552630 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:40:06.552630 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:40:06.552630 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:40:06.552630 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTiGFE8KMCtYxUxaARaCHl3Tyx3nEzwdFh0FkvQ6g_baUv5JdWg2f6XPF2_kFhShXG6qc65flFRHg3IEaUejWn2Ryq6Ja_eXI0fAojiTgLVxNpBNYZhaHd_UPF-HvehNsLjnvXu6jApkY6jtiJi4IMKz_NCpazD-mlAH41Y0QUfE4DE Sep 23 04:40:06.552630 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:40:06.552630 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:40:06.552630 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:40:06.552630 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:40:06.552630 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:40:06.552630 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:40:06.552630 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 8c54af2d42a04748b9c52c4a4846c03e Sep 23 04:40:06.552630 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ServerGroupTestJSON-1716812918 Sep 23 04:40:06.552630 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:40:06.552630 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:40:06.552630 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8c54af2d42a04748b9c52c4a4846c03e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8c54af2d42a04748b9c52c4a4846c03e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8c54af2d42a04748b9c52c4a4846c03e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8c54af2d42a04748b9c52c4a4846c03e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:40:06.552630 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ServerGroupTestJSON-1716812918 Sep 23 04:40:06.552630 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 8c54af2d42a04748b9c52c4a4846c03e Sep 23 04:40:06.552630 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ServerGroupTestJSON-1716812918 Sep 23 04:40:06.552630 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ServerGroupTestJSON-1716812918-project Sep 23 04:40:06.552630 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:40:06.552630 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:40:06.552630 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 21d5e06dc2ba4f779359c55804ed79a8 Sep 23 04:40:06.552630 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ServerGroupTestJSON-1716812918-project Sep 23 04:40:06.552630 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:40:06.552630 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 82f0e20e-0209-42dc-bbdc-15d6c0c030d8 could not be found. Sep 23 04:40:06.552630 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '82f0e20e-0209-42dc-bbdc-15d6c0c030d8'} Sep 23 04:40:06.552630 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:40:06.552630 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:40:06.552630 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:40:06.552630 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:40:06.552630 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:40:06.552630 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:40:06.552630 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:40:06.552630 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:40:06.552630 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:40:06.552630 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:40:06.552630 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82f0e20e-0209-42dc-bbdc-15d6c0c030d8 could not be found. Sep 23 04:40:06.552630 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:40:06.552630 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:40:06.552630 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:40:06.552630 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:40:06.552630 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:40:06.552630 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:40:06.552630 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:40:06.552630 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:40:06.552630 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:40:06.552630 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:40:06.552630 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:40:06.552630 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:40:06.552630 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:40:06.552630 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:40:06.552630 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:40:06.552630 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:40:06.579654 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82f0e20e-0209-42dc-bbdc-15d6c0c030d8 could not be found. Sep 23 04:40:06.579654 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:40:06.579654 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:40:06.579654 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:40:06.579654 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:40:06.579654 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:40:06.579654 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:40:06.579654 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:40:06.579654 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:40:06.579654 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82f0e20e-0209-42dc-bbdc-15d6c0c030d8 could not be found. Sep 23 04:40:06.579654 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:40:06.579654 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a59ac5f4-ad0d-4df0-add1-c40929dabe65 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Returning 404 to user: Instance 82f0e20e-0209-42dc-bbdc-15d6c0c030d8 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:40:06.579654 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a59ac5f4-ad0d-4df0-add1-c40929dabe65 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] 10.222.0.33 "GET /compute/v2.1/servers/82f0e20e-0209-42dc-bbdc-15d6c0c030d8" status: 404 len: 111 microversion: 2.1 time: 0.064948 Sep 23 04:40:06.579654 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1222/2414] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:40:06 2022] GET /compute/v2.1/servers/82f0e20e-0209-42dc-bbdc-15d6c0c030d8 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 04:40:06.579654 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-28f35368-246a-470e-99e8-f71b953ed175 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:06.581275 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1193/2415] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:40:06 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1553 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:40:06.599099 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.compute.server_groups [None req-28f35368-246a-470e-99e8-f71b953ed175 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Querying cell feac528b-4983-4e61-aae7-f1973fe5bc2c(cell1) for 1 instances {{(pid=122699) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 23 04:40:06.600061 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-28f35368-246a-470e-99e8-f71b953ed175 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:06.600616 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-28f35368-246a-470e-99e8-f71b953ed175 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:06.601071 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-28f35368-246a-470e-99e8-f71b953ed175 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:06.614047 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-28f35368-246a-470e-99e8-f71b953ed175 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] 10.222.0.33 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.059938 Sep 23 04:40:06.622072 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1223/2416] 10.222.0.33 () {58 vars in 1152 bytes} [Fri Sep 23 04:40:06 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:40:06.639737 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0f6a53ee-d569-4c64-82d0-50c079ae1e89 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:06.676553 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.compute.server_groups [None req-0f6a53ee-d569-4c64-82d0-50c079ae1e89 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Querying cell feac528b-4983-4e61-aae7-f1973fe5bc2c(cell1) for 1 instances {{(pid=122698) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 23 04:40:06.677764 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0f6a53ee-d569-4c64-82d0-50c079ae1e89 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:06.679802 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0f6a53ee-d569-4c64-82d0-50c079ae1e89 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:06.680614 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0f6a53ee-d569-4c64-82d0-50c079ae1e89 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:06.698292 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3e962908-027e-4bf8-affc-ac9ec19ad192 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:06.698913 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-3e962908-027e-4bf8-affc-ac9ec19ad192 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 42fe539b-6665-43fb-b7a2-bc8a6f2c65d5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:06.708060 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3e962908-027e-4bf8-affc-ac9ec19ad192 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:06.711144 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0f6a53ee-d569-4c64-82d0-50c079ae1e89 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] 10.222.0.33 "GET /compute/v2.1/os-server-groups/9a387ef9-8706-4119-8155-93d3e8f66e16" status: 200 len: 183 microversion: 2.1 time: 0.083282 Sep 23 04:40:06.711144 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1194/2417] 10.222.0.33 () {58 vars in 1263 bytes} [Fri Sep 23 04:40:06 2022] GET /compute/v2.1/os-server-groups/9a387ef9-8706-4119-8155-93d3e8f66e16 => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:40:06.719895 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3e962908-027e-4bf8-affc-ac9ec19ad192 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:06.720515 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3e962908-027e-4bf8-affc-ac9ec19ad192 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:06.721290 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3e962908-027e-4bf8-affc-ac9ec19ad192 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:06.721775 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3e962908-027e-4bf8-affc-ac9ec19ad192 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:06.722257 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3e962908-027e-4bf8-affc-ac9ec19ad192 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:06.723413 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b0ac7521-e5c3-4b7f-98c2-8ef0c8ffbd09 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:06.725594 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b0ac7521-e5c3-4b7f-98c2-8ef0c8ffbd09 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] [instance: 82f0e20e-0209-42dc-bbdc-15d6c0c030d8] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:06.741562 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b0ac7521-e5c3-4b7f-98c2-8ef0c8ffbd09 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:06.744068 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b0ac7521-e5c3-4b7f-98c2-8ef0c8ffbd09 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:06.744927 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b0ac7521-e5c3-4b7f-98c2-8ef0c8ffbd09 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:06.747965 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b0ac7521-e5c3-4b7f-98c2-8ef0c8ffbd09 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:06.749144 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b0ac7521-e5c3-4b7f-98c2-8ef0c8ffbd09 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:06.752396 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b0ac7521-e5c3-4b7f-98c2-8ef0c8ffbd09 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:06.786564 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-b0ac7521-e5c3-4b7f-98c2-8ef0c8ffbd09 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] HTTP exception thrown: Instance 82f0e20e-0209-42dc-bbdc-15d6c0c030d8 could not be found. Sep 23 04:40:06.795753 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b0ac7521-e5c3-4b7f-98c2-8ef0c8ffbd09 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Request method failure captured: Sep 23 04:40:06.795753 n-d-846463-3 devstack@n-api.service[122698]: request: DELETE /compute/v2.1/servers/82f0e20e-0209-42dc-bbdc-15d6c0c030d8 HTTP/1.1 Sep 23 04:40:06.795753 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:40:06.795753 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:40:06.795753 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:40:06.795753 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:40:06.795753 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:40:06.795753 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:40:06.795753 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:40:06.795753 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:40:06.795753 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTiGFE8KMCtYxUxaARaCHl3Tyx3nEzwdFh0FkvQ6g_baUv5JdWg2f6XPF2_kFhShXG6qc65flFRHg3IEaUejWn2Ryq6Ja_eXI0fAojiTgLVxNpBNYZhaHd_UPF-HvehNsLjnvXu6jApkY6jtiJi4IMKz_NCpazD-mlAH41Y0QUfE4DE Sep 23 04:40:06.795753 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:40:06.795753 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:40:06.795753 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:40:06.795753 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:40:06.795753 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:40:06.795753 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:40:06.795753 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 8c54af2d42a04748b9c52c4a4846c03e Sep 23 04:40:06.795753 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ServerGroupTestJSON-1716812918 Sep 23 04:40:06.795753 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:40:06.795753 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:40:06.795753 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8c54af2d42a04748b9c52c4a4846c03e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8c54af2d42a04748b9c52c4a4846c03e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8c54af2d42a04748b9c52c4a4846c03e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8c54af2d42a04748b9c52c4a4846c03e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:40:06.795753 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ServerGroupTestJSON-1716812918 Sep 23 04:40:06.795753 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 8c54af2d42a04748b9c52c4a4846c03e Sep 23 04:40:06.795753 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ServerGroupTestJSON-1716812918 Sep 23 04:40:06.795753 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ServerGroupTestJSON-1716812918-project Sep 23 04:40:06.795753 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:40:06.795753 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:40:06.795753 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 21d5e06dc2ba4f779359c55804ed79a8 Sep 23 04:40:06.795753 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ServerGroupTestJSON-1716812918-project Sep 23 04:40:06.795753 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:40:06.795753 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 82f0e20e-0209-42dc-bbdc-15d6c0c030d8 could not be found. Sep 23 04:40:06.795753 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '82f0e20e-0209-42dc-bbdc-15d6c0c030d8'} Sep 23 04:40:06.795753 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:40:06.795753 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:40:06.795753 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:40:06.795753 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:40:06.795753 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:40:06.795753 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:40:06.795753 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:40:06.795753 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:40:06.795753 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:40:06.795753 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:40:06.795753 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82f0e20e-0209-42dc-bbdc-15d6c0c030d8 could not be found. Sep 23 04:40:06.795753 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:40:06.795753 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:40:06.795753 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:40:06.795753 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:40:06.795753 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:40:06.795753 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:40:06.795753 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:40:06.795753 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:40:06.795753 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:40:06.795753 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:40:06.795753 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 04:40:06.795753 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 04:40:06.795753 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 04:40:06.795753 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 04:40:06.795753 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:40:06.795753 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:40:06.795753 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:40:06.795753 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:40:06.799278 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82f0e20e-0209-42dc-bbdc-15d6c0c030d8 could not be found. Sep 23 04:40:06.799278 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:40:06.799278 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:40:06.799278 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:40:06.799278 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:40:06.799278 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:40:06.799278 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:40:06.799278 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:40:06.799278 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:40:06.799278 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82f0e20e-0209-42dc-bbdc-15d6c0c030d8 could not be found. Sep 23 04:40:06.799278 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:40:06.808549 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b0ac7521-e5c3-4b7f-98c2-8ef0c8ffbd09 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Returning 404 to user: Instance 82f0e20e-0209-42dc-bbdc-15d6c0c030d8 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:40:06.810489 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b0ac7521-e5c3-4b7f-98c2-8ef0c8ffbd09 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] 10.222.0.33 "DELETE /compute/v2.1/servers/82f0e20e-0209-42dc-bbdc-15d6c0c030d8" status: 404 len: 111 microversion: 2.1 time: 0.093352 Sep 23 04:40:06.812921 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1195/2418] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:40:06 2022] DELETE /compute/v2.1/servers/82f0e20e-0209-42dc-bbdc-15d6c0c030d8 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 04:40:06.824650 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-569fb1f9-a284-4944-80cf-d90c477215c0 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:06.826013 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-569fb1f9-a284-4944-80cf-d90c477215c0 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] [instance: 82f0e20e-0209-42dc-bbdc-15d6c0c030d8] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:06.838906 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-569fb1f9-a284-4944-80cf-d90c477215c0 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:06.841976 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-569fb1f9-a284-4944-80cf-d90c477215c0 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:06.844328 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-569fb1f9-a284-4944-80cf-d90c477215c0 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:06.845261 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-569fb1f9-a284-4944-80cf-d90c477215c0 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:06.847695 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-569fb1f9-a284-4944-80cf-d90c477215c0 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:06.857081 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-569fb1f9-a284-4944-80cf-d90c477215c0 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:06.882517 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-569fb1f9-a284-4944-80cf-d90c477215c0 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] HTTP exception thrown: Instance 82f0e20e-0209-42dc-bbdc-15d6c0c030d8 could not be found. Sep 23 04:40:06.885272 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-569fb1f9-a284-4944-80cf-d90c477215c0 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Request method failure captured: Sep 23 04:40:06.885272 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/82f0e20e-0209-42dc-bbdc-15d6c0c030d8 HTTP/1.1 Sep 23 04:40:06.885272 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:40:06.885272 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:40:06.885272 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:40:06.885272 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:40:06.885272 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:40:06.885272 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:40:06.885272 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:40:06.885272 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:40:06.885272 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTiGFE8KMCtYxUxaARaCHl3Tyx3nEzwdFh0FkvQ6g_baUv5JdWg2f6XPF2_kFhShXG6qc65flFRHg3IEaUejWn2Ryq6Ja_eXI0fAojiTgLVxNpBNYZhaHd_UPF-HvehNsLjnvXu6jApkY6jtiJi4IMKz_NCpazD-mlAH41Y0QUfE4DE Sep 23 04:40:06.885272 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:40:06.885272 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:40:06.885272 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:40:06.885272 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:40:06.885272 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:40:06.885272 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:40:06.885272 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 8c54af2d42a04748b9c52c4a4846c03e Sep 23 04:40:06.885272 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ServerGroupTestJSON-1716812918 Sep 23 04:40:06.885272 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:40:06.885272 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:40:06.885272 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8c54af2d42a04748b9c52c4a4846c03e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8c54af2d42a04748b9c52c4a4846c03e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8c54af2d42a04748b9c52c4a4846c03e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8c54af2d42a04748b9c52c4a4846c03e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:40:06.885272 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ServerGroupTestJSON-1716812918 Sep 23 04:40:06.885272 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 8c54af2d42a04748b9c52c4a4846c03e Sep 23 04:40:06.885272 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ServerGroupTestJSON-1716812918 Sep 23 04:40:06.885272 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ServerGroupTestJSON-1716812918-project Sep 23 04:40:06.885272 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:40:06.885272 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:40:06.885272 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 21d5e06dc2ba4f779359c55804ed79a8 Sep 23 04:40:06.885272 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ServerGroupTestJSON-1716812918-project Sep 23 04:40:06.885272 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:40:06.885272 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 82f0e20e-0209-42dc-bbdc-15d6c0c030d8 could not be found. Sep 23 04:40:06.885272 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '82f0e20e-0209-42dc-bbdc-15d6c0c030d8'} Sep 23 04:40:06.885272 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:40:06.885272 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:40:06.885272 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:40:06.885272 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:40:06.885272 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:40:06.885272 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:40:06.885272 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:40:06.885272 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:40:06.885272 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:40:06.885272 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:40:06.885272 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82f0e20e-0209-42dc-bbdc-15d6c0c030d8 could not be found. Sep 23 04:40:06.885272 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:40:06.885272 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:40:06.885272 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:40:06.885272 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:40:06.885272 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:40:06.885272 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:40:06.885272 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:40:06.885272 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:40:06.885272 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:40:06.885272 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:40:06.885272 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:40:06.885272 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:40:06.885272 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:40:06.885272 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:40:06.885272 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:40:06.885272 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:40:06.885272 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82f0e20e-0209-42dc-bbdc-15d6c0c030d8 could not be found. Sep 23 04:40:06.885272 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:40:06.885272 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:40:06.885272 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:40:06.890344 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:40:06.890344 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:40:06.890344 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:40:06.890344 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:40:06.890344 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:40:06.890344 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82f0e20e-0209-42dc-bbdc-15d6c0c030d8 could not be found. Sep 23 04:40:06.890344 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:40:06.892219 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-569fb1f9-a284-4944-80cf-d90c477215c0 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Returning 404 to user: Instance 82f0e20e-0209-42dc-bbdc-15d6c0c030d8 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:40:06.895766 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-569fb1f9-a284-4944-80cf-d90c477215c0 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] 10.222.0.33 "GET /compute/v2.1/servers/82f0e20e-0209-42dc-bbdc-15d6c0c030d8" status: 404 len: 111 microversion: 2.1 time: 0.078379 Sep 23 04:40:06.899834 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1196/2419] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:40:06 2022] GET /compute/v2.1/servers/82f0e20e-0209-42dc-bbdc-15d6c0c030d8 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:40:06.907233 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-096d663d-4ea9-4c8e-acab-39a5563630a5 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:06.913833 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-096d663d-4ea9-4c8e-acab-39a5563630a5 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] HTTP exception thrown: Instance group 33d68a52-0f07-4540-a8b3-bad376eb2e78 could not be found. Sep 23 04:40:06.927118 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-096d663d-4ea9-4c8e-acab-39a5563630a5 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Request method failure captured: Sep 23 04:40:06.927118 n-d-846463-3 devstack@n-api.service[122698]: request: DELETE /compute/v2.1/os-server-groups/33d68a52-0f07-4540-a8b3-bad376eb2e78 HTTP/1.1 Sep 23 04:40:06.927118 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:40:06.927118 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:40:06.927118 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:40:06.927118 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:40:06.927118 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:40:06.927118 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:40:06.927118 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:40:06.927118 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:40:06.927118 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTiGFE8KMCtYxUxaARaCHl3Tyx3nEzwdFh0FkvQ6g_baUv5JdWg2f6XPF2_kFhShXG6qc65flFRHg3IEaUejWn2Ryq6Ja_eXI0fAojiTgLVxNpBNYZhaHd_UPF-HvehNsLjnvXu6jApkY6jtiJi4IMKz_NCpazD-mlAH41Y0QUfE4DE Sep 23 04:40:06.927118 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:40:06.927118 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:40:06.927118 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:40:06.927118 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:40:06.927118 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:40:06.927118 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:40:06.927118 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 8c54af2d42a04748b9c52c4a4846c03e Sep 23 04:40:06.927118 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ServerGroupTestJSON-1716812918 Sep 23 04:40:06.927118 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:40:06.927118 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:40:06.927118 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8c54af2d42a04748b9c52c4a4846c03e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8c54af2d42a04748b9c52c4a4846c03e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8c54af2d42a04748b9c52c4a4846c03e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8c54af2d42a04748b9c52c4a4846c03e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:40:06.927118 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ServerGroupTestJSON-1716812918 Sep 23 04:40:06.927118 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 8c54af2d42a04748b9c52c4a4846c03e Sep 23 04:40:06.927118 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ServerGroupTestJSON-1716812918 Sep 23 04:40:06.927118 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ServerGroupTestJSON-1716812918-project Sep 23 04:40:06.927118 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:40:06.927118 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:40:06.927118 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 21d5e06dc2ba4f779359c55804ed79a8 Sep 23 04:40:06.927118 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ServerGroupTestJSON-1716812918-project Sep 23 04:40:06.927118 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:40:06.927118 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance group 33d68a52-0f07-4540-a8b3-bad376eb2e78 could not be found. Sep 23 04:40:06.927118 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '33d68a52-0f07-4540-a8b3-bad376eb2e78'} Sep 23 04:40:06.927118 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:40:06.927118 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:40:06.927118 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 23 04:40:06.927118 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 23 04:40:06.927118 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 04:40:06.927118 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 04:40:06.927118 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 23 04:40:06.927118 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 23 04:40:06.927118 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 23 04:40:06.927118 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 23 04:40:06.927118 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 23 04:40:06.927118 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 23 04:40:06.927118 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 33d68a52-0f07-4540-a8b3-bad376eb2e78 could not be found. Sep 23 04:40:06.927118 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:40:06.927118 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:40:06.927118 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:40:06.927118 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:40:06.927118 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:40:06.927118 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:40:06.927118 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:40:06.927118 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:40:06.927118 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:40:06.927118 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:40:06.927118 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 23 04:40:06.927118 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:40:06.927118 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 33d68a52-0f07-4540-a8b3-bad376eb2e78 could not be found. Sep 23 04:40:06.927118 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:40:06.927118 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:40:06.927118 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:40:06.927118 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:40:06.933172 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:40:06.933172 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:40:06.933172 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:40:06.933172 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:40:06.933172 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 33d68a52-0f07-4540-a8b3-bad376eb2e78 could not be found. Sep 23 04:40:06.933172 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:40:06.933172 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-096d663d-4ea9-4c8e-acab-39a5563630a5 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Returning 404 to user: Instance group 33d68a52-0f07-4540-a8b3-bad376eb2e78 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:40:06.933172 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-096d663d-4ea9-4c8e-acab-39a5563630a5 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] 10.222.0.33 "DELETE /compute/v2.1/os-server-groups/33d68a52-0f07-4540-a8b3-bad376eb2e78" status: 404 len: 117 microversion: 2.1 time: 0.027654 Sep 23 04:40:06.933172 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1197/2420] 10.222.0.33 () {58 vars in 1266 bytes} [Fri Sep 23 04:40:06 2022] DELETE /compute/v2.1/os-server-groups/33d68a52-0f07-4540-a8b3-bad376eb2e78 => generated 117 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:40:06.940705 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-73884555-9e55-4289-91c6-aa017aa09fe2 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:06.947777 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-73884555-9e55-4289-91c6-aa017aa09fe2 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] HTTP exception thrown: Instance group 0fd904e7-7ee0-46d1-a062-6ce539a9f36f could not be found. Sep 23 04:40:06.949323 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-73884555-9e55-4289-91c6-aa017aa09fe2 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Request method failure captured: Sep 23 04:40:06.949323 n-d-846463-3 devstack@n-api.service[122698]: request: DELETE /compute/v2.1/os-server-groups/0fd904e7-7ee0-46d1-a062-6ce539a9f36f HTTP/1.1 Sep 23 04:40:06.949323 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:40:06.949323 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:40:06.949323 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:40:06.949323 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:40:06.949323 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:40:06.949323 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:40:06.949323 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:40:06.949323 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:40:06.949323 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTiGFE8KMCtYxUxaARaCHl3Tyx3nEzwdFh0FkvQ6g_baUv5JdWg2f6XPF2_kFhShXG6qc65flFRHg3IEaUejWn2Ryq6Ja_eXI0fAojiTgLVxNpBNYZhaHd_UPF-HvehNsLjnvXu6jApkY6jtiJi4IMKz_NCpazD-mlAH41Y0QUfE4DE Sep 23 04:40:06.949323 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:40:06.949323 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:40:06.949323 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:40:06.949323 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:40:06.949323 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:40:06.949323 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:40:06.949323 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 8c54af2d42a04748b9c52c4a4846c03e Sep 23 04:40:06.949323 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ServerGroupTestJSON-1716812918 Sep 23 04:40:06.949323 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:40:06.949323 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:40:06.949323 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8c54af2d42a04748b9c52c4a4846c03e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8c54af2d42a04748b9c52c4a4846c03e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8c54af2d42a04748b9c52c4a4846c03e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8c54af2d42a04748b9c52c4a4846c03e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:40:06.949323 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ServerGroupTestJSON-1716812918 Sep 23 04:40:06.949323 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 8c54af2d42a04748b9c52c4a4846c03e Sep 23 04:40:06.949323 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ServerGroupTestJSON-1716812918 Sep 23 04:40:06.949323 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ServerGroupTestJSON-1716812918-project Sep 23 04:40:06.949323 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:40:06.949323 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:40:06.949323 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 21d5e06dc2ba4f779359c55804ed79a8 Sep 23 04:40:06.949323 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ServerGroupTestJSON-1716812918-project Sep 23 04:40:06.949323 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:40:06.949323 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance group 0fd904e7-7ee0-46d1-a062-6ce539a9f36f could not be found. Sep 23 04:40:06.949323 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '0fd904e7-7ee0-46d1-a062-6ce539a9f36f'} Sep 23 04:40:06.949323 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:40:06.949323 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:40:06.949323 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 23 04:40:06.949323 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 23 04:40:06.949323 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 04:40:06.949323 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 04:40:06.949323 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 23 04:40:06.949323 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 23 04:40:06.949323 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 23 04:40:06.949323 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 23 04:40:06.949323 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 23 04:40:06.949323 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 23 04:40:06.949323 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 0fd904e7-7ee0-46d1-a062-6ce539a9f36f could not be found. Sep 23 04:40:06.949323 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:40:06.949323 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:40:06.949323 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:40:06.949323 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:40:06.949323 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:40:06.949323 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:40:06.949323 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:40:06.949323 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:40:06.949323 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:40:06.949323 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:40:06.949323 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 23 04:40:06.949323 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:40:06.949323 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 0fd904e7-7ee0-46d1-a062-6ce539a9f36f could not be found. Sep 23 04:40:06.949323 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:40:06.949323 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:40:06.949323 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:40:06.949323 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:40:06.952911 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:40:06.952911 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:40:06.952911 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:40:06.952911 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:40:06.952911 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 0fd904e7-7ee0-46d1-a062-6ce539a9f36f could not be found. Sep 23 04:40:06.952911 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:40:06.952911 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-73884555-9e55-4289-91c6-aa017aa09fe2 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Returning 404 to user: Instance group 0fd904e7-7ee0-46d1-a062-6ce539a9f36f could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:40:06.952911 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-73884555-9e55-4289-91c6-aa017aa09fe2 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] 10.222.0.33 "DELETE /compute/v2.1/os-server-groups/0fd904e7-7ee0-46d1-a062-6ce539a9f36f" status: 404 len: 117 microversion: 2.1 time: 0.014373 Sep 23 04:40:06.952911 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1198/2421] 10.222.0.33 () {58 vars in 1266 bytes} [Fri Sep 23 04:40:06 2022] DELETE /compute/v2.1/os-server-groups/0fd904e7-7ee0-46d1-a062-6ce539a9f36f => generated 117 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 04:40:06.962668 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ad541551-ca13-40c3-8dd2-4871db28b8eb tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:06.970772 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-ad541551-ca13-40c3-8dd2-4871db28b8eb tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] HTTP exception thrown: Instance group 19f6eb78-f635-4ba3-a5db-96086a219717 could not be found. Sep 23 04:40:06.972911 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ad541551-ca13-40c3-8dd2-4871db28b8eb tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Request method failure captured: Sep 23 04:40:06.972911 n-d-846463-3 devstack@n-api.service[122698]: request: DELETE /compute/v2.1/os-server-groups/19f6eb78-f635-4ba3-a5db-96086a219717 HTTP/1.1 Sep 23 04:40:06.972911 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:40:06.972911 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:40:06.972911 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:40:06.972911 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:40:06.972911 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:40:06.972911 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:40:06.972911 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:40:06.972911 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:40:06.972911 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTiGFE8KMCtYxUxaARaCHl3Tyx3nEzwdFh0FkvQ6g_baUv5JdWg2f6XPF2_kFhShXG6qc65flFRHg3IEaUejWn2Ryq6Ja_eXI0fAojiTgLVxNpBNYZhaHd_UPF-HvehNsLjnvXu6jApkY6jtiJi4IMKz_NCpazD-mlAH41Y0QUfE4DE Sep 23 04:40:06.972911 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:40:06.972911 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:40:06.972911 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:40:06.972911 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:40:06.972911 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:40:06.972911 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:40:06.972911 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 8c54af2d42a04748b9c52c4a4846c03e Sep 23 04:40:06.972911 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ServerGroupTestJSON-1716812918 Sep 23 04:40:06.972911 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:40:06.972911 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:40:06.972911 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8c54af2d42a04748b9c52c4a4846c03e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8c54af2d42a04748b9c52c4a4846c03e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8c54af2d42a04748b9c52c4a4846c03e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8c54af2d42a04748b9c52c4a4846c03e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:40:06.972911 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ServerGroupTestJSON-1716812918 Sep 23 04:40:06.972911 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 8c54af2d42a04748b9c52c4a4846c03e Sep 23 04:40:06.972911 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ServerGroupTestJSON-1716812918 Sep 23 04:40:06.972911 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ServerGroupTestJSON-1716812918-project Sep 23 04:40:06.972911 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:40:06.972911 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:40:06.972911 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 21d5e06dc2ba4f779359c55804ed79a8 Sep 23 04:40:06.972911 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ServerGroupTestJSON-1716812918-project Sep 23 04:40:06.972911 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:40:06.972911 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance group 19f6eb78-f635-4ba3-a5db-96086a219717 could not be found. Sep 23 04:40:06.972911 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '19f6eb78-f635-4ba3-a5db-96086a219717'} Sep 23 04:40:06.972911 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:40:06.972911 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:40:06.972911 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 23 04:40:06.972911 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 23 04:40:06.972911 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 04:40:06.972911 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 04:40:06.972911 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 23 04:40:06.972911 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 23 04:40:06.972911 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 23 04:40:06.972911 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 23 04:40:06.972911 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 23 04:40:06.972911 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 23 04:40:06.972911 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 19f6eb78-f635-4ba3-a5db-96086a219717 could not be found. Sep 23 04:40:06.972911 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:40:06.972911 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:40:06.972911 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:40:06.972911 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:40:06.972911 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:40:06.972911 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:40:06.972911 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:40:06.972911 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:40:06.972911 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:40:06.972911 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:40:06.972911 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 23 04:40:06.972911 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:40:06.972911 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 19f6eb78-f635-4ba3-a5db-96086a219717 could not be found. Sep 23 04:40:06.972911 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:40:06.972911 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:40:06.972911 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:40:06.972911 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:40:06.980521 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:40:06.980521 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:40:06.980521 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:40:06.980521 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:40:06.980521 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 19f6eb78-f635-4ba3-a5db-96086a219717 could not be found. Sep 23 04:40:06.980521 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:40:06.980521 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ad541551-ca13-40c3-8dd2-4871db28b8eb tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Returning 404 to user: Instance group 19f6eb78-f635-4ba3-a5db-96086a219717 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:40:06.980521 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ad541551-ca13-40c3-8dd2-4871db28b8eb tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] 10.222.0.33 "DELETE /compute/v2.1/os-server-groups/19f6eb78-f635-4ba3-a5db-96086a219717" status: 404 len: 117 microversion: 2.1 time: 0.017373 Sep 23 04:40:06.980521 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1199/2422] 10.222.0.33 () {58 vars in 1266 bytes} [Fri Sep 23 04:40:06 2022] DELETE /compute/v2.1/os-server-groups/19f6eb78-f635-4ba3-a5db-96086a219717 => generated 117 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:40:06.991587 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3c6f82a0-7bc9-4f64-832d-55f1507155ab tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:07.002060 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-3c6f82a0-7bc9-4f64-832d-55f1507155ab tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] HTTP exception thrown: Instance group d0f4a685-b8d8-49ed-bc22-b018e663be81 could not be found. Sep 23 04:40:07.005014 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3c6f82a0-7bc9-4f64-832d-55f1507155ab tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Request method failure captured: Sep 23 04:40:07.005014 n-d-846463-3 devstack@n-api.service[122698]: request: DELETE /compute/v2.1/os-server-groups/d0f4a685-b8d8-49ed-bc22-b018e663be81 HTTP/1.1 Sep 23 04:40:07.005014 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:40:07.005014 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:40:07.005014 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:40:07.005014 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:40:07.005014 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:40:07.005014 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:40:07.005014 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:40:07.005014 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:40:07.005014 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTiGFE8KMCtYxUxaARaCHl3Tyx3nEzwdFh0FkvQ6g_baUv5JdWg2f6XPF2_kFhShXG6qc65flFRHg3IEaUejWn2Ryq6Ja_eXI0fAojiTgLVxNpBNYZhaHd_UPF-HvehNsLjnvXu6jApkY6jtiJi4IMKz_NCpazD-mlAH41Y0QUfE4DE Sep 23 04:40:07.005014 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:40:07.005014 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:40:07.005014 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:40:07.005014 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:40:07.005014 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:40:07.005014 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:40:07.005014 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 8c54af2d42a04748b9c52c4a4846c03e Sep 23 04:40:07.005014 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ServerGroupTestJSON-1716812918 Sep 23 04:40:07.005014 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:40:07.005014 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:40:07.005014 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8c54af2d42a04748b9c52c4a4846c03e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8c54af2d42a04748b9c52c4a4846c03e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8c54af2d42a04748b9c52c4a4846c03e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8c54af2d42a04748b9c52c4a4846c03e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:40:07.005014 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ServerGroupTestJSON-1716812918 Sep 23 04:40:07.005014 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 8c54af2d42a04748b9c52c4a4846c03e Sep 23 04:40:07.005014 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ServerGroupTestJSON-1716812918 Sep 23 04:40:07.005014 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ServerGroupTestJSON-1716812918-project Sep 23 04:40:07.005014 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:40:07.005014 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:40:07.005014 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 21d5e06dc2ba4f779359c55804ed79a8 Sep 23 04:40:07.005014 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ServerGroupTestJSON-1716812918-project Sep 23 04:40:07.005014 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:40:07.005014 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance group d0f4a685-b8d8-49ed-bc22-b018e663be81 could not be found. Sep 23 04:40:07.005014 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': 'd0f4a685-b8d8-49ed-bc22-b018e663be81'} Sep 23 04:40:07.005014 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:40:07.005014 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:40:07.005014 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 23 04:40:07.005014 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 23 04:40:07.005014 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 04:40:07.005014 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 04:40:07.005014 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 23 04:40:07.005014 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 23 04:40:07.005014 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 23 04:40:07.005014 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 23 04:40:07.005014 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 23 04:40:07.005014 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 23 04:40:07.005014 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group d0f4a685-b8d8-49ed-bc22-b018e663be81 could not be found. Sep 23 04:40:07.005014 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:40:07.005014 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:40:07.005014 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:40:07.005014 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:40:07.005014 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:40:07.005014 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:40:07.005014 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:40:07.005014 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:40:07.005014 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:40:07.005014 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:40:07.005014 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 23 04:40:07.005014 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:40:07.005014 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group d0f4a685-b8d8-49ed-bc22-b018e663be81 could not be found. Sep 23 04:40:07.005014 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:40:07.005014 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:40:07.005014 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:40:07.005014 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:40:07.008829 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:40:07.008829 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:40:07.008829 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:40:07.008829 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:40:07.008829 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group d0f4a685-b8d8-49ed-bc22-b018e663be81 could not be found. Sep 23 04:40:07.008829 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:40:07.008829 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3c6f82a0-7bc9-4f64-832d-55f1507155ab tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Returning 404 to user: Instance group d0f4a685-b8d8-49ed-bc22-b018e663be81 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:40:07.008829 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3c6f82a0-7bc9-4f64-832d-55f1507155ab tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] 10.222.0.33 "DELETE /compute/v2.1/os-server-groups/d0f4a685-b8d8-49ed-bc22-b018e663be81" status: 404 len: 117 microversion: 2.1 time: 0.024488 Sep 23 04:40:07.008829 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1200/2423] 10.222.0.33 () {58 vars in 1266 bytes} [Fri Sep 23 04:40:06 2022] DELETE /compute/v2.1/os-server-groups/d0f4a685-b8d8-49ed-bc22-b018e663be81 => generated 117 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:40:07.020612 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4fa3a968-401c-472d-a4f9-9890976d2a94 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:07.023387 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=90,nova_api:UPDATE=7 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:40:07.141500 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-3e962908-027e-4bf8-affc-ac9ec19ad192 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:07.161668 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3e962908-027e-4bf8-affc-ac9ec19ad192 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/42fe539b-6665-43fb-b7a2-bc8a6f2c65d5" status: 200 len: 1508 microversion: 2.1 time: 0.466113 Sep 23 04:40:07.162365 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4fa3a968-401c-472d-a4f9-9890976d2a94 tempest-ServerGroupTestJSON-1716812918 tempest-ServerGroupTestJSON-1716812918-project] 10.222.0.33 "DELETE /compute/v2.1/os-server-groups/9a387ef9-8706-4119-8155-93d3e8f66e16" status: 204 len: 0 microversion: 2.1 time: 0.150165 Sep 23 04:40:07.166351 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1201/2425] 10.222.0.33 () {58 vars in 1266 bytes} [Fri Sep 23 04:40:07 2022] DELETE /compute/v2.1/os-server-groups/9a387ef9-8706-4119-8155-93d3e8f66e16 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:40:07.166489 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1224/2425] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:40:06 2022] GET /compute/v2.1/servers/42fe539b-6665-43fb-b7a2-bc8a6f2c65d5 => generated 1508 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:40:07.290368 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-148fe290-3e28-4bbd-85fc-25e468536cbc tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:07.291279 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-148fe290-3e28-4bbd-85fc-25e468536cbc tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: aa35cea0-4f7f-4d03-9436-f15264b9f713] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:07.310926 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-148fe290-3e28-4bbd-85fc-25e468536cbc tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:07.311681 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-148fe290-3e28-4bbd-85fc-25e468536cbc tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:07.312324 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-148fe290-3e28-4bbd-85fc-25e468536cbc tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:07.316995 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-148fe290-3e28-4bbd-85fc-25e468536cbc tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:07.319300 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-148fe290-3e28-4bbd-85fc-25e468536cbc tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:07.319510 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-148fe290-3e28-4bbd-85fc-25e468536cbc tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:07.576657 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c66480e5-7976-4f27-8ea9-93d535573961 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:07.577490 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c66480e5-7976-4f27-8ea9-93d535573961 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:07.601402 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c66480e5-7976-4f27-8ea9-93d535573961 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:07.604775 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c66480e5-7976-4f27-8ea9-93d535573961 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:07.609590 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c66480e5-7976-4f27-8ea9-93d535573961 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:07.609590 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c66480e5-7976-4f27-8ea9-93d535573961 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:07.609590 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c66480e5-7976-4f27-8ea9-93d535573961 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:07.610104 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c66480e5-7976-4f27-8ea9-93d535573961 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:07.629321 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-148fe290-3e28-4bbd-85fc-25e468536cbc tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:07.637582 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-148fe290-3e28-4bbd-85fc-25e468536cbc tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713" status: 200 len: 1184 microversion: 2.1 time: 0.352854 Sep 23 04:40:07.646396 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1225/2426] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:40:07 2022] GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713 => generated 1184 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:40:07.851890 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c66480e5-7976-4f27-8ea9-93d535573961 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:07.872987 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c66480e5-7976-4f27-8ea9-93d535573961 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:07.875277 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c66480e5-7976-4f27-8ea9-93d535573961 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:07.889108 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c66480e5-7976-4f27-8ea9-93d535573961 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1553 microversion: 2.91 time: 0.315659 Sep 23 04:40:07.899536 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1202/2427] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:40:07 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1553 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:40:08.190093 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-cd95525a-899d-4d6d-8117-a6d41ceed314 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:08.197400 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-cd95525a-899d-4d6d-8117-a6d41ceed314 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 42fe539b-6665-43fb-b7a2-bc8a6f2c65d5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:08.202219 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cd95525a-899d-4d6d-8117-a6d41ceed314 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:08.206695 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cd95525a-899d-4d6d-8117-a6d41ceed314 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:08.208967 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cd95525a-899d-4d6d-8117-a6d41ceed314 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:08.209922 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cd95525a-899d-4d6d-8117-a6d41ceed314 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:08.213637 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cd95525a-899d-4d6d-8117-a6d41ceed314 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:08.214305 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cd95525a-899d-4d6d-8117-a6d41ceed314 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:08.670352 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0bd100cd-89b8-4903-b1da-8413841e875e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:08.671071 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-0bd100cd-89b8-4903-b1da-8413841e875e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: aa35cea0-4f7f-4d03-9436-f15264b9f713] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:08.685595 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0bd100cd-89b8-4903-b1da-8413841e875e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:08.686415 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0bd100cd-89b8-4903-b1da-8413841e875e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:08.687054 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0bd100cd-89b8-4903-b1da-8413841e875e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:08.688797 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0bd100cd-89b8-4903-b1da-8413841e875e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:08.694856 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0bd100cd-89b8-4903-b1da-8413841e875e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:08.695624 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0bd100cd-89b8-4903-b1da-8413841e875e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:08.821752 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-cd95525a-899d-4d6d-8117-a6d41ceed314 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:08.830340 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-cd95525a-899d-4d6d-8117-a6d41ceed314 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/42fe539b-6665-43fb-b7a2-bc8a6f2c65d5" status: 200 len: 1508 microversion: 2.1 time: 0.645220 Sep 23 04:40:08.845621 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1226/2428] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:40:08 2022] GET /compute/v2.1/servers/42fe539b-6665-43fb-b7a2-bc8a6f2c65d5 => generated 1508 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:40:08.859377 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-0bd100cd-89b8-4903-b1da-8413841e875e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:08.872937 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0bd100cd-89b8-4903-b1da-8413841e875e tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713" status: 200 len: 1184 microversion: 2.1 time: 0.206943 Sep 23 04:40:08.874027 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1203/2429] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:40:08 2022] GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713 => generated 1184 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:40:08.925110 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2c46e522-0222-4ff5-88c9-ff21a2e5f1da tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:08.925728 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-2c46e522-0222-4ff5-88c9-ff21a2e5f1da tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:08.934901 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2c46e522-0222-4ff5-88c9-ff21a2e5f1da tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:08.935405 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2c46e522-0222-4ff5-88c9-ff21a2e5f1da tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:08.935847 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2c46e522-0222-4ff5-88c9-ff21a2e5f1da tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:08.936562 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2c46e522-0222-4ff5-88c9-ff21a2e5f1da tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:08.937023 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2c46e522-0222-4ff5-88c9-ff21a2e5f1da tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:08.937445 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2c46e522-0222-4ff5-88c9-ff21a2e5f1da tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:09.705832 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2c46e522-0222-4ff5-88c9-ff21a2e5f1da tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:09.721026 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2c46e522-0222-4ff5-88c9-ff21a2e5f1da tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:09.722602 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2c46e522-0222-4ff5-88c9-ff21a2e5f1da tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:09.738206 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2c46e522-0222-4ff5-88c9-ff21a2e5f1da tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1553 microversion: 2.91 time: 0.816882 Sep 23 04:40:09.750873 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1227/2430] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:40:08 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1553 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:40:09.860973 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f77bdd84-14b3-42b3-a592-736b428b209a tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:09.863205 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f77bdd84-14b3-42b3-a592-736b428b209a tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 42fe539b-6665-43fb-b7a2-bc8a6f2c65d5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:09.881461 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f77bdd84-14b3-42b3-a592-736b428b209a tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:09.886944 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f77bdd84-14b3-42b3-a592-736b428b209a tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:09.890937 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f77bdd84-14b3-42b3-a592-736b428b209a tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:09.891913 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f77bdd84-14b3-42b3-a592-736b428b209a tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:09.895374 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f77bdd84-14b3-42b3-a592-736b428b209a tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:09.895374 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f77bdd84-14b3-42b3-a592-736b428b209a tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:09.901513 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a84d0a4a-e433-4087-a9f5-f3129c186100 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:09.903017 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a84d0a4a-e433-4087-a9f5-f3129c186100 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: aa35cea0-4f7f-4d03-9436-f15264b9f713] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:09.939088 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a84d0a4a-e433-4087-a9f5-f3129c186100 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:09.942229 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a84d0a4a-e433-4087-a9f5-f3129c186100 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:09.945136 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a84d0a4a-e433-4087-a9f5-f3129c186100 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:09.949195 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a84d0a4a-e433-4087-a9f5-f3129c186100 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:09.952320 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a84d0a4a-e433-4087-a9f5-f3129c186100 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:09.953436 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a84d0a4a-e433-4087-a9f5-f3129c186100 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:10.140339 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a84d0a4a-e433-4087-a9f5-f3129c186100 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:10.146804 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a84d0a4a-e433-4087-a9f5-f3129c186100 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:10.149065 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a84d0a4a-e433-4087-a9f5-f3129c186100 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:10.151740 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-a84d0a4a-e433-4087-a9f5-f3129c186100 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lazy-loading 'fault' on Instance uuid aa35cea0-4f7f-4d03-9436-f15264b9f713 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:40:10.534626 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a84d0a4a-e433-4087-a9f5-f3129c186100 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:10.546240 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a84d0a4a-e433-4087-a9f5-f3129c186100 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713" status: 200 len: 1143 microversion: 2.1 time: 0.649521 Sep 23 04:40:10.546843 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1228/2431] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:40:09 2022] GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713 => generated 1143 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:40:10.773765 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6ff0971c-a787-41bc-8b61-81c9ab98f2f7 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:10.775177 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-6ff0971c-a787-41bc-8b61-81c9ab98f2f7 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:10.797765 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6ff0971c-a787-41bc-8b61-81c9ab98f2f7 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:10.798636 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6ff0971c-a787-41bc-8b61-81c9ab98f2f7 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:10.799241 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6ff0971c-a787-41bc-8b61-81c9ab98f2f7 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:10.800117 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6ff0971c-a787-41bc-8b61-81c9ab98f2f7 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:10.800732 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6ff0971c-a787-41bc-8b61-81c9ab98f2f7 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:10.801456 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6ff0971c-a787-41bc-8b61-81c9ab98f2f7 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:11.000579 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f77bdd84-14b3-42b3-a592-736b428b209a tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:11.024330 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f77bdd84-14b3-42b3-a592-736b428b209a tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/42fe539b-6665-43fb-b7a2-bc8a6f2c65d5" status: 200 len: 1508 microversion: 2.1 time: 1.169755 Sep 23 04:40:11.029444 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1204/2432] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:40:09 2022] GET /compute/v2.1/servers/42fe539b-6665-43fb-b7a2-bc8a6f2c65d5 => generated 1508 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:40:11.031973 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-6ff0971c-a787-41bc-8b61-81c9ab98f2f7 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:11.052119 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-6ff0971c-a787-41bc-8b61-81c9ab98f2f7 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:11.054027 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-6ff0971c-a787-41bc-8b61-81c9ab98f2f7 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:11.076330 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6ff0971c-a787-41bc-8b61-81c9ab98f2f7 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1553 microversion: 2.91 time: 0.310021 Sep 23 04:40:11.078473 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1229/2433] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:40:10 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1553 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:40:11.569193 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4e3815f3-6689-4208-9c16-9a7c1beab11d tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:11.570407 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4e3815f3-6689-4208-9c16-9a7c1beab11d tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: aa35cea0-4f7f-4d03-9436-f15264b9f713] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:11.581339 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4e3815f3-6689-4208-9c16-9a7c1beab11d tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:11.582085 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4e3815f3-6689-4208-9c16-9a7c1beab11d tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:11.582712 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4e3815f3-6689-4208-9c16-9a7c1beab11d tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:11.588044 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4e3815f3-6689-4208-9c16-9a7c1beab11d tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:11.588769 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4e3815f3-6689-4208-9c16-9a7c1beab11d tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:11.589375 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4e3815f3-6689-4208-9c16-9a7c1beab11d tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:11.641496 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-4e3815f3-6689-4208-9c16-9a7c1beab11d tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] HTTP exception thrown: Instance aa35cea0-4f7f-4d03-9436-f15264b9f713 could not be found. Sep 23 04:40:11.643283 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4e3815f3-6689-4208-9c16-9a7c1beab11d tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Request method failure captured: Sep 23 04:40:11.643283 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713 HTTP/1.1 Sep 23 04:40:11.643283 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:40:11.643283 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:40:11.643283 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:40:11.643283 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:40:11.643283 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:40:11.643283 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:40:11.643283 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:40:11.643283 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:40:11.643283 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTcNAuuAvcMSzeRfNMub4GatrGaNFAdVjoyngK1TY5in1YZ6QNGRYPH5v55GVnDmBMF0sLhf8Sr5c0HFc7yDQLOpgvmmOrzz5EcjVod5YyYFmG_VsP9JTCpR9IKnz3i4uGS6U8OvbA0E0OQ4o-5_pXC0QM_YyWBYZ-V5XzE_FtxBeVo Sep 23 04:40:11.643283 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:40:11.643283 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:40:11.643283 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:40:11.643283 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:40:11.643283 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:40:11.643283 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:40:11.643283 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 004af70c9f9a43c4a7be8136268e98f9 Sep 23 04:40:11.643283 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-LiveMigrationTest-630802414 Sep 23 04:40:11.643283 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:40:11.643283 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:40:11.643283 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_004af70c9f9a43c4a7be8136268e98f9", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/004af70c9f9a43c4a7be8136268e98f9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/004af70c9f9a43c4a7be8136268e98f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "tempest-type-1451344989", "name": "tempest-service-1652784468", "endpoints": []}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/004af70c9f9a43c4a7be8136268e98f9"}]}, {"type": "tempest-type-1029636837", "name": "tempest-service-1633719024", "endpoints": [{"region": "tempest-region-1560816386", "publicURL": "https://url-1076501004.com"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:40:11.643283 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-LiveMigrationTest-630802414 Sep 23 04:40:11.643283 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 004af70c9f9a43c4a7be8136268e98f9 Sep 23 04:40:11.643283 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-LiveMigrationTest-630802414 Sep 23 04:40:11.643283 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-LiveMigrationTest-630802414-project Sep 23 04:40:11.643283 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:40:11.643283 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:40:11.643283 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 82d04a55ba72452995e3b156325e0890 Sep 23 04:40:11.643283 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-LiveMigrationTest-630802414-project Sep 23 04:40:11.643283 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:40:11.643283 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance aa35cea0-4f7f-4d03-9436-f15264b9f713 could not be found. Sep 23 04:40:11.643283 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': 'aa35cea0-4f7f-4d03-9436-f15264b9f713'} Sep 23 04:40:11.643283 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:40:11.643283 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:40:11.643283 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:40:11.643283 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:40:11.643283 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:40:11.643283 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:40:11.643283 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:40:11.643283 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:40:11.643283 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:40:11.643283 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:40:11.643283 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa35cea0-4f7f-4d03-9436-f15264b9f713 could not be found. Sep 23 04:40:11.643283 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:40:11.643283 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:40:11.643283 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:40:11.643283 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:40:11.643283 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:40:11.643283 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:40:11.643283 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:40:11.643283 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:40:11.643283 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:40:11.643283 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:40:11.643283 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:40:11.643283 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:40:11.643283 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:40:11.643283 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:40:11.643283 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:40:11.643283 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:40:11.643283 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa35cea0-4f7f-4d03-9436-f15264b9f713 could not be found. Sep 23 04:40:11.647713 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:40:11.647713 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:40:11.647713 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:40:11.647713 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:40:11.647713 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:40:11.647713 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:40:11.647713 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:40:11.647713 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:40:11.647713 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa35cea0-4f7f-4d03-9436-f15264b9f713 could not be found. Sep 23 04:40:11.647713 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:40:11.647713 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4e3815f3-6689-4208-9c16-9a7c1beab11d tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Returning 404 to user: Instance aa35cea0-4f7f-4d03-9436-f15264b9f713 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:40:11.647713 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4e3815f3-6689-4208-9c16-9a7c1beab11d tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713" status: 404 len: 111 microversion: 2.1 time: 0.080209 Sep 23 04:40:11.668961 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1205/2434] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:40:11 2022] GET /compute/v2.1/servers/aa35cea0-4f7f-4d03-9436-f15264b9f713 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:40:12.054080 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2e31d665-cdf0-4f94-8dd0-75b803909168 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:12.059751 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-2e31d665-cdf0-4f94-8dd0-75b803909168 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 42fe539b-6665-43fb-b7a2-bc8a6f2c65d5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:12.067339 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2e31d665-cdf0-4f94-8dd0-75b803909168 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:12.068140 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2e31d665-cdf0-4f94-8dd0-75b803909168 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:12.068822 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2e31d665-cdf0-4f94-8dd0-75b803909168 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:12.069754 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2e31d665-cdf0-4f94-8dd0-75b803909168 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:12.070623 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2e31d665-cdf0-4f94-8dd0-75b803909168 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:12.071290 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2e31d665-cdf0-4f94-8dd0-75b803909168 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:12.110891 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-de6afc55-7990-4e47-acf1-88fb0be40195 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:12.110891 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-de6afc55-7990-4e47-acf1-88fb0be40195 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:12.123304 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-de6afc55-7990-4e47-acf1-88fb0be40195 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:12.123967 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-de6afc55-7990-4e47-acf1-88fb0be40195 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:12.124548 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-de6afc55-7990-4e47-acf1-88fb0be40195 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:12.125379 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-de6afc55-7990-4e47-acf1-88fb0be40195 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:12.126370 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-de6afc55-7990-4e47-acf1-88fb0be40195 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:12.140289 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-de6afc55-7990-4e47-acf1-88fb0be40195 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:13.837152 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-de6afc55-7990-4e47-acf1-88fb0be40195 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:13.847338 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-de6afc55-7990-4e47-acf1-88fb0be40195 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:13.849117 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-de6afc55-7990-4e47-acf1-88fb0be40195 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:13.873180 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-de6afc55-7990-4e47-acf1-88fb0be40195 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1553 microversion: 2.91 time: 1.765599 Sep 23 04:40:13.875166 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1206/2435] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:40:12 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1553 bytes in 1771 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:40:14.103834 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2e31d665-cdf0-4f94-8dd0-75b803909168 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:14.131449 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2e31d665-cdf0-4f94-8dd0-75b803909168 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/42fe539b-6665-43fb-b7a2-bc8a6f2c65d5" status: 200 len: 1508 microversion: 2.1 time: 2.081358 Sep 23 04:40:14.132052 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1230/2436] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:40:12 2022] GET /compute/v2.1/servers/42fe539b-6665-43fb-b7a2-bc8a6f2c65d5 => generated 1508 bytes in 2083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:40:14.905386 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6e920435-dd9f-4e66-a0cf-542086034461 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:14.906770 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-6e920435-dd9f-4e66-a0cf-542086034461 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:14.918963 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6e920435-dd9f-4e66-a0cf-542086034461 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:14.920251 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6e920435-dd9f-4e66-a0cf-542086034461 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:14.920955 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6e920435-dd9f-4e66-a0cf-542086034461 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:14.921993 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6e920435-dd9f-4e66-a0cf-542086034461 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:14.922847 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6e920435-dd9f-4e66-a0cf-542086034461 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:14.923462 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6e920435-dd9f-4e66-a0cf-542086034461 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:15.096002 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6e920435-dd9f-4e66-a0cf-542086034461 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:15.110000 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6e920435-dd9f-4e66-a0cf-542086034461 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:15.114999 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6e920435-dd9f-4e66-a0cf-542086034461 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:15.135222 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-6e920435-dd9f-4e66-a0cf-542086034461 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1553 microversion: 2.91 time: 0.232694 Sep 23 04:40:15.155768 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1207/2437] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:40:14 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1553 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:40:15.193474 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0ff964b5-3aec-4d5e-9742-31c22d21e6c6 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:15.194743 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-0ff964b5-3aec-4d5e-9742-31c22d21e6c6 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 42fe539b-6665-43fb-b7a2-bc8a6f2c65d5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:15.209686 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0ff964b5-3aec-4d5e-9742-31c22d21e6c6 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:15.212054 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0ff964b5-3aec-4d5e-9742-31c22d21e6c6 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:15.213930 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0ff964b5-3aec-4d5e-9742-31c22d21e6c6 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:15.215582 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0ff964b5-3aec-4d5e-9742-31c22d21e6c6 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:15.217279 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0ff964b5-3aec-4d5e-9742-31c22d21e6c6 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:15.219285 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0ff964b5-3aec-4d5e-9742-31c22d21e6c6 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:15.907052 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-0ff964b5-3aec-4d5e-9742-31c22d21e6c6 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:15.918348 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0ff964b5-3aec-4d5e-9742-31c22d21e6c6 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/42fe539b-6665-43fb-b7a2-bc8a6f2c65d5" status: 200 len: 1508 microversion: 2.1 time: 0.728297 Sep 23 04:40:15.919879 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1231/2438] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:40:15 2022] GET /compute/v2.1/servers/42fe539b-6665-43fb-b7a2-bc8a6f2c65d5 => generated 1508 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:40:16.172238 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-32b91712-a37a-4a2e-bf85-4b6ea3fe370a tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:16.172853 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-32b91712-a37a-4a2e-bf85-4b6ea3fe370a tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:16.188878 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-32b91712-a37a-4a2e-bf85-4b6ea3fe370a tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:16.188878 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-32b91712-a37a-4a2e-bf85-4b6ea3fe370a tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:16.188878 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-32b91712-a37a-4a2e-bf85-4b6ea3fe370a tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:16.188878 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-32b91712-a37a-4a2e-bf85-4b6ea3fe370a tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:16.188878 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-32b91712-a37a-4a2e-bf85-4b6ea3fe370a tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:16.188878 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-32b91712-a37a-4a2e-bf85-4b6ea3fe370a tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:16.621714 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-32b91712-a37a-4a2e-bf85-4b6ea3fe370a tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:16.636533 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-32b91712-a37a-4a2e-bf85-4b6ea3fe370a tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:16.648236 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-32b91712-a37a-4a2e-bf85-4b6ea3fe370a tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:16.676372 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-32b91712-a37a-4a2e-bf85-4b6ea3fe370a tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1553 microversion: 2.91 time: 0.508896 Sep 23 04:40:16.676987 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1208/2439] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:40:16 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1553 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:40:16.941545 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8e0b666e-45d0-4be9-ae7f-c61dac37d0a3 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:16.950033 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-8e0b666e-45d0-4be9-ae7f-c61dac37d0a3 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 42fe539b-6665-43fb-b7a2-bc8a6f2c65d5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:16.973272 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8e0b666e-45d0-4be9-ae7f-c61dac37d0a3 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:16.975639 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8e0b666e-45d0-4be9-ae7f-c61dac37d0a3 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:16.979102 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8e0b666e-45d0-4be9-ae7f-c61dac37d0a3 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:16.982368 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8e0b666e-45d0-4be9-ae7f-c61dac37d0a3 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:16.986489 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8e0b666e-45d0-4be9-ae7f-c61dac37d0a3 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:16.991604 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8e0b666e-45d0-4be9-ae7f-c61dac37d0a3 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:17.718464 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4b96bc0f-cae7-43b0-b862-c9233ca62591 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:17.719279 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4b96bc0f-cae7-43b0-b862-c9233ca62591 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:17.741544 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4b96bc0f-cae7-43b0-b862-c9233ca62591 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:17.778374 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4b96bc0f-cae7-43b0-b862-c9233ca62591 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:17.788648 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4b96bc0f-cae7-43b0-b862-c9233ca62591 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.040s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:17.789808 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4b96bc0f-cae7-43b0-b862-c9233ca62591 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:17.798565 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-8e0b666e-45d0-4be9-ae7f-c61dac37d0a3 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:17.804354 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4b96bc0f-cae7-43b0-b862-c9233ca62591 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:17.809905 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4b96bc0f-cae7-43b0-b862-c9233ca62591 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:17.827535 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-8e0b666e-45d0-4be9-ae7f-c61dac37d0a3 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/42fe539b-6665-43fb-b7a2-bc8a6f2c65d5" status: 200 len: 1508 microversion: 2.1 time: 0.887446 Sep 23 04:40:17.832955 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1232/2440] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:40:16 2022] GET /compute/v2.1/servers/42fe539b-6665-43fb-b7a2-bc8a6f2c65d5 => generated 1508 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:40:18.020271 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4b96bc0f-cae7-43b0-b862-c9233ca62591 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:18.031992 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4b96bc0f-cae7-43b0-b862-c9233ca62591 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:18.036714 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4b96bc0f-cae7-43b0-b862-c9233ca62591 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:18.060977 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4b96bc0f-cae7-43b0-b862-c9233ca62591 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1553 microversion: 2.91 time: 0.351799 Sep 23 04:40:18.082413 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1209/2441] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:40:17 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1553 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:40:18.859332 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-85f82a68-3f68-4cd6-b6c1-1ce66acd27a1 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:18.860025 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-85f82a68-3f68-4cd6-b6c1-1ce66acd27a1 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 42fe539b-6665-43fb-b7a2-bc8a6f2c65d5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:18.893340 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-85f82a68-3f68-4cd6-b6c1-1ce66acd27a1 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:18.893926 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-85f82a68-3f68-4cd6-b6c1-1ce66acd27a1 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:18.894462 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-85f82a68-3f68-4cd6-b6c1-1ce66acd27a1 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:18.895210 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-85f82a68-3f68-4cd6-b6c1-1ce66acd27a1 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:18.895683 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-85f82a68-3f68-4cd6-b6c1-1ce66acd27a1 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:18.901072 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-85f82a68-3f68-4cd6-b6c1-1ce66acd27a1 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:19.100331 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b21d6464-0d57-4b85-bfef-b5acd2f0e6a1 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:19.101768 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b21d6464-0d57-4b85-bfef-b5acd2f0e6a1 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:19.119556 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b21d6464-0d57-4b85-bfef-b5acd2f0e6a1 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:19.120490 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b21d6464-0d57-4b85-bfef-b5acd2f0e6a1 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:19.126685 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b21d6464-0d57-4b85-bfef-b5acd2f0e6a1 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:19.130148 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b21d6464-0d57-4b85-bfef-b5acd2f0e6a1 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:19.130496 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b21d6464-0d57-4b85-bfef-b5acd2f0e6a1 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:19.131177 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b21d6464-0d57-4b85-bfef-b5acd2f0e6a1 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:19.389683 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-85f82a68-3f68-4cd6-b6c1-1ce66acd27a1 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:19.400350 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-85f82a68-3f68-4cd6-b6c1-1ce66acd27a1 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/42fe539b-6665-43fb-b7a2-bc8a6f2c65d5" status: 200 len: 1508 microversion: 2.1 time: 0.546259 Sep 23 04:40:19.409471 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1233/2442] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:40:18 2022] GET /compute/v2.1/servers/42fe539b-6665-43fb-b7a2-bc8a6f2c65d5 => generated 1508 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:40:19.425330 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b21d6464-0d57-4b85-bfef-b5acd2f0e6a1 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:19.446906 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b21d6464-0d57-4b85-bfef-b5acd2f0e6a1 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:19.454869 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b21d6464-0d57-4b85-bfef-b5acd2f0e6a1 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:19.485510 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b21d6464-0d57-4b85-bfef-b5acd2f0e6a1 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1553 microversion: 2.91 time: 0.383373 Sep 23 04:40:19.516731 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1210/2443] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:40:19 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1553 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:40:20.435145 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c75383ce-ee16-41cc-aa11-5df27cee54f3 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:20.437647 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c75383ce-ee16-41cc-aa11-5df27cee54f3 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 42fe539b-6665-43fb-b7a2-bc8a6f2c65d5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:20.454164 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c75383ce-ee16-41cc-aa11-5df27cee54f3 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:20.457095 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c75383ce-ee16-41cc-aa11-5df27cee54f3 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:20.457973 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c75383ce-ee16-41cc-aa11-5df27cee54f3 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:20.458897 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c75383ce-ee16-41cc-aa11-5df27cee54f3 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:20.459507 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c75383ce-ee16-41cc-aa11-5df27cee54f3 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:20.461974 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c75383ce-ee16-41cc-aa11-5df27cee54f3 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:20.523402 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e170abbe-80ee-416f-876b-7c7d8a9f5e06 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:20.525050 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e170abbe-80ee-416f-876b-7c7d8a9f5e06 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:20.533484 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e170abbe-80ee-416f-876b-7c7d8a9f5e06 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:20.534756 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e170abbe-80ee-416f-876b-7c7d8a9f5e06 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:20.535432 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e170abbe-80ee-416f-876b-7c7d8a9f5e06 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:20.536527 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e170abbe-80ee-416f-876b-7c7d8a9f5e06 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:20.537228 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e170abbe-80ee-416f-876b-7c7d8a9f5e06 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:20.537955 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e170abbe-80ee-416f-876b-7c7d8a9f5e06 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:20.723439 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e170abbe-80ee-416f-876b-7c7d8a9f5e06 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:20.725776 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=100 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:40:20.736087 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e170abbe-80ee-416f-876b-7c7d8a9f5e06 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:20.762236 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e170abbe-80ee-416f-876b-7c7d8a9f5e06 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:20.788361 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e170abbe-80ee-416f-876b-7c7d8a9f5e06 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1553 microversion: 2.91 time: 0.269593 Sep 23 04:40:20.805922 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1211/2444] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:40:20 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1553 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:40:21.109108 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c75383ce-ee16-41cc-aa11-5df27cee54f3 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:21.139005 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c75383ce-ee16-41cc-aa11-5df27cee54f3 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/42fe539b-6665-43fb-b7a2-bc8a6f2c65d5" status: 200 len: 1508 microversion: 2.1 time: 0.708097 Sep 23 04:40:21.171151 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1234/2445] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:40:20 2022] GET /compute/v2.1/servers/42fe539b-6665-43fb-b7a2-bc8a6f2c65d5 => generated 1508 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:40:21.247018 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a9431bde-8836-4a12-b204-59b390e84a5c tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:21.247527 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a9431bde-8836-4a12-b204-59b390e84a5c tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: 04e9b262-d9e0-434a-bcbb-a85ef9180ee9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:21.278297 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a9431bde-8836-4a12-b204-59b390e84a5c tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:21.281048 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a9431bde-8836-4a12-b204-59b390e84a5c tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:21.285337 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a9431bde-8836-4a12-b204-59b390e84a5c tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:21.294951 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a9431bde-8836-4a12-b204-59b390e84a5c tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:21.298259 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a9431bde-8836-4a12-b204-59b390e84a5c tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:21.298738 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a9431bde-8836-4a12-b204-59b390e84a5c tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:21.460377 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a9431bde-8836-4a12-b204-59b390e84a5c tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: 04e9b262-d9e0-434a-bcbb-a85ef9180ee9] Going to try to terminate instance {{(pid=122698) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:40:21.843877 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-cb116126-1ff1-445b-a7b8-bb5801a093ce tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:21.845761 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-cb116126-1ff1-445b-a7b8-bb5801a093ce tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:21.875981 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cb116126-1ff1-445b-a7b8-bb5801a093ce tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:21.881776 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cb116126-1ff1-445b-a7b8-bb5801a093ce tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:21.882383 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cb116126-1ff1-445b-a7b8-bb5801a093ce tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:21.883165 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cb116126-1ff1-445b-a7b8-bb5801a093ce tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:21.893165 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cb116126-1ff1-445b-a7b8-bb5801a093ce tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:21.893835 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cb116126-1ff1-445b-a7b8-bb5801a093ce tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:21.989285 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a9431bde-8836-4a12-b204-59b390e84a5c tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "DELETE /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9" status: 204 len: 0 microversion: 2.1 time: 0.753794 Sep 23 04:40:21.991928 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1212/2446] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:40:21 2022] DELETE /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9 => generated 0 bytes in 756 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:40:21.999642 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-179c1fec-5a06-42fe-9822-9242322feb0a tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:22.000371 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-179c1fec-5a06-42fe-9822-9242322feb0a tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: 04e9b262-d9e0-434a-bcbb-a85ef9180ee9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:22.053821 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-179c1fec-5a06-42fe-9822-9242322feb0a tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:22.053821 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-179c1fec-5a06-42fe-9822-9242322feb0a tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:22.060426 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-179c1fec-5a06-42fe-9822-9242322feb0a tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:22.063575 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-179c1fec-5a06-42fe-9822-9242322feb0a tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:22.063575 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-179c1fec-5a06-42fe-9822-9242322feb0a tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:22.063575 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-179c1fec-5a06-42fe-9822-9242322feb0a tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:22.645870 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-cb116126-1ff1-445b-a7b8-bb5801a093ce tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:22.678194 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-cb116126-1ff1-445b-a7b8-bb5801a093ce tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:22.685625 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-cb116126-1ff1-445b-a7b8-bb5801a093ce tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:22.724001 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-cb116126-1ff1-445b-a7b8-bb5801a093ce tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1553 microversion: 2.91 time: 0.887766 Sep 23 04:40:22.743444 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1235/2447] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:40:21 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1553 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:40:22.781251 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-fdb6d392-3854-4f66-bc76-d587bc5b8f7b tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:22.782067 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-fdb6d392-3854-4f66-bc76-d587bc5b8f7b tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 42fe539b-6665-43fb-b7a2-bc8a6f2c65d5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:22.828715 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fdb6d392-3854-4f66-bc76-d587bc5b8f7b tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:22.835502 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fdb6d392-3854-4f66-bc76-d587bc5b8f7b tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:22.850144 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fdb6d392-3854-4f66-bc76-d587bc5b8f7b tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:22.851010 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fdb6d392-3854-4f66-bc76-d587bc5b8f7b tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:22.857153 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fdb6d392-3854-4f66-bc76-d587bc5b8f7b tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:22.857622 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fdb6d392-3854-4f66-bc76-d587bc5b8f7b tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:22.970657 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=100 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:40:24.025076 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-179c1fec-5a06-42fe-9822-9242322feb0a tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:24.046482 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-179c1fec-5a06-42fe-9822-9242322feb0a tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9" status: 200 len: 1669 microversion: 2.1 time: 2.048753 Sep 23 04:40:24.049627 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1213/2448] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:40:21 2022] GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9 => generated 1669 bytes in 2056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:40:24.061079 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-bf02a2f1-8224-4dce-b15e-58c258a57010 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:24.062570 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-bf02a2f1-8224-4dce-b15e-58c258a57010 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:24.076637 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bf02a2f1-8224-4dce-b15e-58c258a57010 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:24.078481 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bf02a2f1-8224-4dce-b15e-58c258a57010 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:24.080748 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bf02a2f1-8224-4dce-b15e-58c258a57010 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:24.082763 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bf02a2f1-8224-4dce-b15e-58c258a57010 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:24.083537 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bf02a2f1-8224-4dce-b15e-58c258a57010 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:24.085144 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bf02a2f1-8224-4dce-b15e-58c258a57010 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:24.333533 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-bf02a2f1-8224-4dce-b15e-58c258a57010 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:24.351154 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-bf02a2f1-8224-4dce-b15e-58c258a57010 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:24.357739 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-fdb6d392-3854-4f66-bc76-d587bc5b8f7b tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:24.372154 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-bf02a2f1-8224-4dce-b15e-58c258a57010 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:24.373252 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-fdb6d392-3854-4f66-bc76-d587bc5b8f7b tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/42fe539b-6665-43fb-b7a2-bc8a6f2c65d5" status: 200 len: 1508 microversion: 2.1 time: 1.628631 Sep 23 04:40:24.379628 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1236/2449] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:40:22 2022] GET /compute/v2.1/servers/42fe539b-6665-43fb-b7a2-bc8a6f2c65d5 => generated 1508 bytes in 1638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:40:24.417175 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-bf02a2f1-8224-4dce-b15e-58c258a57010 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1553 microversion: 2.91 time: 0.347394 Sep 23 04:40:24.418022 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1214/2450] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:40:24 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1553 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:40:25.083793 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8f6c1549-a791-48a6-ac72-ba0598e29996 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:25.084860 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-8f6c1549-a791-48a6-ac72-ba0598e29996 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: 04e9b262-d9e0-434a-bcbb-a85ef9180ee9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:25.117031 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8f6c1549-a791-48a6-ac72-ba0598e29996 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:25.118192 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8f6c1549-a791-48a6-ac72-ba0598e29996 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:25.125956 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8f6c1549-a791-48a6-ac72-ba0598e29996 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:25.129944 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8f6c1549-a791-48a6-ac72-ba0598e29996 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:25.129944 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8f6c1549-a791-48a6-ac72-ba0598e29996 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:25.129944 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8f6c1549-a791-48a6-ac72-ba0598e29996 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:25.415486 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5ade5cf8-82c7-4de7-9c30-0c4aca8aa76a tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:25.416111 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5ade5cf8-82c7-4de7-9c30-0c4aca8aa76a tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 42fe539b-6665-43fb-b7a2-bc8a6f2c65d5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:25.438505 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5ade5cf8-82c7-4de7-9c30-0c4aca8aa76a tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:25.438505 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5ade5cf8-82c7-4de7-9c30-0c4aca8aa76a tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:25.438505 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5ade5cf8-82c7-4de7-9c30-0c4aca8aa76a tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:25.438505 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5ade5cf8-82c7-4de7-9c30-0c4aca8aa76a tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:25.453049 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5ade5cf8-82c7-4de7-9c30-0c4aca8aa76a tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:25.454717 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5ade5cf8-82c7-4de7-9c30-0c4aca8aa76a tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:26.849089 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-5ade5cf8-82c7-4de7-9c30-0c4aca8aa76a tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:26.874066 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5ade5cf8-82c7-4de7-9c30-0c4aca8aa76a tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/42fe539b-6665-43fb-b7a2-bc8a6f2c65d5" status: 200 len: 1508 microversion: 2.1 time: 1.452784 Sep 23 04:40:26.874066 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1215/2451] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:40:25 2022] GET /compute/v2.1/servers/42fe539b-6665-43fb-b7a2-bc8a6f2c65d5 => generated 1508 bytes in 1459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:40:26.880245 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-8f6c1549-a791-48a6-ac72-ba0598e29996 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:26.882299 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4aef05d0-b5f1-482f-8e6f-3e4e040bccef tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:26.885629 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4aef05d0-b5f1-482f-8e6f-3e4e040bccef tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:26.908780 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4aef05d0-b5f1-482f-8e6f-3e4e040bccef tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:26.908780 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4aef05d0-b5f1-482f-8e6f-3e4e040bccef tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:26.908780 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4aef05d0-b5f1-482f-8e6f-3e4e040bccef tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:26.912498 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4aef05d0-b5f1-482f-8e6f-3e4e040bccef tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:26.913770 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4aef05d0-b5f1-482f-8e6f-3e4e040bccef tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:26.914212 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-8f6c1549-a791-48a6-ac72-ba0598e29996 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9" status: 200 len: 1669 microversion: 2.1 time: 1.833702 Sep 23 04:40:26.916422 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4aef05d0-b5f1-482f-8e6f-3e4e040bccef tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:26.941793 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1237/2452] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:40:25 2022] GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9 => generated 1669 bytes in 1863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:40:27.219608 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4aef05d0-b5f1-482f-8e6f-3e4e040bccef tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:27.251759 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4aef05d0-b5f1-482f-8e6f-3e4e040bccef tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:27.280495 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4aef05d0-b5f1-482f-8e6f-3e4e040bccef tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:27.324430 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4aef05d0-b5f1-482f-8e6f-3e4e040bccef tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1553 microversion: 2.91 time: 0.441442 Sep 23 04:40:27.325357 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1216/2453] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:40:26 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1553 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:40:27.911565 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0604c4b9-ea20-4a2f-85a2-23a46f4ec91a tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:27.912259 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-0604c4b9-ea20-4a2f-85a2-23a46f4ec91a tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 42fe539b-6665-43fb-b7a2-bc8a6f2c65d5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:27.928700 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0604c4b9-ea20-4a2f-85a2-23a46f4ec91a tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:27.944651 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0604c4b9-ea20-4a2f-85a2-23a46f4ec91a tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:27.950056 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0604c4b9-ea20-4a2f-85a2-23a46f4ec91a tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:27.960479 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-6c9cc61b-f3a9-4a16-8c12-2d07a6986edb req-86b1e66c-6126-4c12-bba8-f8d66cbbf94e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04e9b262-d9e0-434a-bcbb-a85ef9180ee9", "name": "network-vif-deleted", "tag": "ef809f4d-5127-48f1-a968-99867a38928e"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:40:27.971154 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0604c4b9-ea20-4a2f-85a2-23a46f4ec91a tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:27.977157 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0604c4b9-ea20-4a2f-85a2-23a46f4ec91a tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:27.978416 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0604c4b9-ea20-4a2f-85a2-23a46f4ec91a tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:28.010813 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-6c9cc61b-f3a9-4a16-8c12-2d07a6986edb req-86b1e66c-6126-4c12-bba8-f8d66cbbf94e service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:28.026982 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-6c9cc61b-f3a9-4a16-8c12-2d07a6986edb req-86b1e66c-6126-4c12-bba8-f8d66cbbf94e service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:28.028915 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-6c9cc61b-f3a9-4a16-8c12-2d07a6986edb req-86b1e66c-6126-4c12-bba8-f8d66cbbf94e service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:28.079067 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-6c9cc61b-f3a9-4a16-8c12-2d07a6986edb req-86b1e66c-6126-4c12-bba8-f8d66cbbf94e service nova] Creating event network-vif-deleted:ef809f4d-5127-48f1-a968-99867a38928e for instance 04e9b262-d9e0-434a-bcbb-a85ef9180ee9 on n-h1-846463-3 Sep 23 04:40:28.094523 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-6c9cc61b-f3a9-4a16-8c12-2d07a6986edb req-86b1e66c-6126-4c12-bba8-f8d66cbbf94e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137653 Sep 23 04:40:28.103847 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1217/2454] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:40:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:40:28.142176 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-fee677dd-aedf-4fa4-992c-233795adb403 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:28.184588 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-fee677dd-aedf-4fa4-992c-233795adb403 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: 04e9b262-d9e0-434a-bcbb-a85ef9180ee9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:28.212189 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fee677dd-aedf-4fa4-992c-233795adb403 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:28.213410 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fee677dd-aedf-4fa4-992c-233795adb403 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:28.217503 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fee677dd-aedf-4fa4-992c-233795adb403 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:28.221590 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fee677dd-aedf-4fa4-992c-233795adb403 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:28.225363 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fee677dd-aedf-4fa4-992c-233795adb403 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:28.227101 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fee677dd-aedf-4fa4-992c-233795adb403 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:28.632317 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-fee677dd-aedf-4fa4-992c-233795adb403 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:28.651391 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-fee677dd-aedf-4fa4-992c-233795adb403 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9" status: 200 len: 1320 microversion: 2.1 time: 0.549345 Sep 23 04:40:28.663988 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1218/2455] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:40:28 2022] GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9 => generated 1320 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:40:28.971108 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-0604c4b9-ea20-4a2f-85a2-23a46f4ec91a tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:28.992446 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0604c4b9-ea20-4a2f-85a2-23a46f4ec91a tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/42fe539b-6665-43fb-b7a2-bc8a6f2c65d5" status: 200 len: 1508 microversion: 2.1 time: 1.072835 Sep 23 04:40:29.021992 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1238/2456] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:40:27 2022] GET /compute/v2.1/servers/42fe539b-6665-43fb-b7a2-bc8a6f2c65d5 => generated 1508 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:40:29.030124 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6bbaea86-2cb1-426e-8571-7b43bb6cda3d tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:29.030747 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-6bbaea86-2cb1-426e-8571-7b43bb6cda3d tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:29.072879 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-bcc7c830-eb8c-4df2-b394-1d6a4c026062 tempest-FloatingIPsTestJSON-1066831830 tempest-FloatingIPsTestJSON-1066831830-project] Action: 'create', calling method: .version_select at 0x7ff1bab34a60>, body: {"pool": null} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:40:29.096376 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6bbaea86-2cb1-426e-8571-7b43bb6cda3d tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:29.102808 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6bbaea86-2cb1-426e-8571-7b43bb6cda3d tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:29.127817 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6bbaea86-2cb1-426e-8571-7b43bb6cda3d tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:29.127817 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6bbaea86-2cb1-426e-8571-7b43bb6cda3d tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:29.132342 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6bbaea86-2cb1-426e-8571-7b43bb6cda3d tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:29.134567 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6bbaea86-2cb1-426e-8571-7b43bb6cda3d tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:29.631363 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-6bbaea86-2cb1-426e-8571-7b43bb6cda3d tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:29.649229 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-6bbaea86-2cb1-426e-8571-7b43bb6cda3d tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:29.654468 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-6bbaea86-2cb1-426e-8571-7b43bb6cda3d tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:29.675663 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6bbaea86-2cb1-426e-8571-7b43bb6cda3d tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1553 microversion: 2.91 time: 0.656159 Sep 23 04:40:29.682300 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1239/2457] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:40:29 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1553 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:40:29.702372 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-01ffc50b-19f8-4b25-a1b8-f2b06b130f2c tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:29.707165 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-01ffc50b-19f8-4b25-a1b8-f2b06b130f2c tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: 04e9b262-d9e0-434a-bcbb-a85ef9180ee9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:29.744844 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-01ffc50b-19f8-4b25-a1b8-f2b06b130f2c tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:29.749152 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-01ffc50b-19f8-4b25-a1b8-f2b06b130f2c tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:29.750681 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-01ffc50b-19f8-4b25-a1b8-f2b06b130f2c tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:29.754243 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-01ffc50b-19f8-4b25-a1b8-f2b06b130f2c tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:29.757764 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-01ffc50b-19f8-4b25-a1b8-f2b06b130f2c tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:29.761853 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-01ffc50b-19f8-4b25-a1b8-f2b06b130f2c tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:29.930677 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-01ffc50b-19f8-4b25-a1b8-f2b06b130f2c tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:29.934697 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-01ffc50b-19f8-4b25-a1b8-f2b06b130f2c tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:29.941041 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-01ffc50b-19f8-4b25-a1b8-f2b06b130f2c tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:29.944739 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-01ffc50b-19f8-4b25-a1b8-f2b06b130f2c tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lazy-loading 'fault' on Instance uuid 04e9b262-d9e0-434a-bcbb-a85ef9180ee9 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:40:30.286903 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-01ffc50b-19f8-4b25-a1b8-f2b06b130f2c tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:30.308879 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-01ffc50b-19f8-4b25-a1b8-f2b06b130f2c tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9" status: 200 len: 1325 microversion: 2.1 time: 0.611988 Sep 23 04:40:30.316538 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1240/2458] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:40:29 2022] GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9 => generated 1325 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:40:30.330642 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5bda4e3b-caaf-4069-ad8b-6fcfa5a0619d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:30.344822 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-5bda4e3b-caaf-4069-ad8b-6fcfa5a0619d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 42fe539b-6665-43fb-b7a2-bc8a6f2c65d5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:30.385116 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5bda4e3b-caaf-4069-ad8b-6fcfa5a0619d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:30.387342 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5bda4e3b-caaf-4069-ad8b-6fcfa5a0619d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:30.388045 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5bda4e3b-caaf-4069-ad8b-6fcfa5a0619d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:30.388999 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5bda4e3b-caaf-4069-ad8b-6fcfa5a0619d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:30.391089 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5bda4e3b-caaf-4069-ad8b-6fcfa5a0619d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:30.392063 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5bda4e3b-caaf-4069-ad8b-6fcfa5a0619d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:31.178195 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-5bda4e3b-caaf-4069-ad8b-6fcfa5a0619d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:31.245107 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5bda4e3b-caaf-4069-ad8b-6fcfa5a0619d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/42fe539b-6665-43fb-b7a2-bc8a6f2c65d5" status: 200 len: 1508 microversion: 2.1 time: 0.924876 Sep 23 04:40:31.260457 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1241/2459] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:40:30 2022] GET /compute/v2.1/servers/42fe539b-6665-43fb-b7a2-bc8a6f2c65d5 => generated 1508 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:40:31.277689 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c2419555-2873-46d3-b71c-780c6a02f8ff tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:31.278685 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c2419555-2873-46d3-b71c-780c6a02f8ff tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:31.287383 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c2419555-2873-46d3-b71c-780c6a02f8ff tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:31.288842 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c2419555-2873-46d3-b71c-780c6a02f8ff tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:31.289593 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c2419555-2873-46d3-b71c-780c6a02f8ff tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:31.290657 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c2419555-2873-46d3-b71c-780c6a02f8ff tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:31.291342 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c2419555-2873-46d3-b71c-780c6a02f8ff tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:31.292045 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c2419555-2873-46d3-b71c-780c6a02f8ff tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:31.566146 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c2419555-2873-46d3-b71c-780c6a02f8ff tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:31.578822 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c2419555-2873-46d3-b71c-780c6a02f8ff tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:31.588065 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c2419555-2873-46d3-b71c-780c6a02f8ff tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:31.603892 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c2419555-2873-46d3-b71c-780c6a02f8ff tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1553 microversion: 2.91 time: 0.340062 Sep 23 04:40:31.607019 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1242/2460] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:40:31 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1553 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:40:31.620527 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f40b84d8-42f0-4d8f-92df-295564676b57 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:31.621971 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f40b84d8-42f0-4d8f-92df-295564676b57 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: 04e9b262-d9e0-434a-bcbb-a85ef9180ee9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:31.641491 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f40b84d8-42f0-4d8f-92df-295564676b57 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:31.648958 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f40b84d8-42f0-4d8f-92df-295564676b57 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:31.651088 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f40b84d8-42f0-4d8f-92df-295564676b57 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:31.655813 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f40b84d8-42f0-4d8f-92df-295564676b57 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:31.657355 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f40b84d8-42f0-4d8f-92df-295564676b57 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:31.660887 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f40b84d8-42f0-4d8f-92df-295564676b57 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:31.711941 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-f40b84d8-42f0-4d8f-92df-295564676b57 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] HTTP exception thrown: Instance 04e9b262-d9e0-434a-bcbb-a85ef9180ee9 could not be found. Sep 23 04:40:31.717881 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f40b84d8-42f0-4d8f-92df-295564676b57 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Request method failure captured: Sep 23 04:40:31.717881 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9 HTTP/1.1 Sep 23 04:40:31.717881 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:40:31.717881 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:40:31.717881 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:40:31.717881 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:40:31.717881 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:40:31.717881 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:40:31.717881 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:40:31.717881 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:40:31.717881 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTcNAuuAvcMSzeRfNMub4GatrGaNFAdVjoyngK1TY5in1YZ6QNGRYPH5v55GVnDmBMF0sLhf8Sr5c0HFc7yDQLOpgvmmOrzz5EcjVod5YyYFmG_VsP9JTCpR9IKnz3i4uGS6U8OvbA0E0OQ4o-5_pXC0QM_YyWBYZ-V5XzE_FtxBeVo Sep 23 04:40:31.717881 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:40:31.717881 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:40:31.717881 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:40:31.717881 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:40:31.717881 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:40:31.717881 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:40:31.717881 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 004af70c9f9a43c4a7be8136268e98f9 Sep 23 04:40:31.717881 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-LiveMigrationTest-630802414 Sep 23 04:40:31.717881 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:40:31.717881 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:40:31.717881 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_004af70c9f9a43c4a7be8136268e98f9", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/004af70c9f9a43c4a7be8136268e98f9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/004af70c9f9a43c4a7be8136268e98f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "tempest-type-1451344989", "name": "tempest-service-1652784468", "endpoints": []}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/004af70c9f9a43c4a7be8136268e98f9"}]}, {"type": "tempest-type-1029636837", "name": "tempest-service-1633719024", "endpoints": [{"region": "tempest-region-1560816386", "publicURL": "https://url-1076501004.com"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:40:31.717881 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-LiveMigrationTest-630802414 Sep 23 04:40:31.717881 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 004af70c9f9a43c4a7be8136268e98f9 Sep 23 04:40:31.717881 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-LiveMigrationTest-630802414 Sep 23 04:40:31.717881 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-LiveMigrationTest-630802414-project Sep 23 04:40:31.717881 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:40:31.717881 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:40:31.717881 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 82d04a55ba72452995e3b156325e0890 Sep 23 04:40:31.717881 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-LiveMigrationTest-630802414-project Sep 23 04:40:31.717881 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:40:31.717881 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 04e9b262-d9e0-434a-bcbb-a85ef9180ee9 could not be found. Sep 23 04:40:31.717881 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '04e9b262-d9e0-434a-bcbb-a85ef9180ee9'} Sep 23 04:40:31.717881 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:40:31.717881 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:40:31.717881 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:40:31.717881 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:40:31.717881 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:40:31.717881 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:40:31.717881 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:40:31.717881 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:40:31.717881 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:40:31.717881 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:40:31.717881 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04e9b262-d9e0-434a-bcbb-a85ef9180ee9 could not be found. Sep 23 04:40:31.717881 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:40:31.717881 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:40:31.717881 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:40:31.717881 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:40:31.717881 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:40:31.717881 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:40:31.717881 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:40:31.717881 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:40:31.717881 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:40:31.717881 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:40:31.717881 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:40:31.717881 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:40:31.717881 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:40:31.717881 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:40:31.717881 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:40:31.717881 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:40:31.717881 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04e9b262-d9e0-434a-bcbb-a85ef9180ee9 could not be found. Sep 23 04:40:31.723819 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:40:31.723819 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:40:31.723819 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:40:31.723819 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:40:31.723819 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:40:31.723819 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:40:31.723819 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:40:31.723819 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:40:31.723819 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04e9b262-d9e0-434a-bcbb-a85ef9180ee9 could not be found. Sep 23 04:40:31.723819 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:40:31.723819 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f40b84d8-42f0-4d8f-92df-295564676b57 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Returning 404 to user: Instance 04e9b262-d9e0-434a-bcbb-a85ef9180ee9 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:40:31.724458 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f40b84d8-42f0-4d8f-92df-295564676b57 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9" status: 404 len: 111 microversion: 2.1 time: 0.108188 Sep 23 04:40:31.730579 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1243/2461] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:40:31 2022] GET /compute/v2.1/servers/04e9b262-d9e0-434a-bcbb-a85ef9180ee9 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:40:31.739275 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d6b9cf68-b5de-401c-bf3c-9051f11bcc4a tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '.version_select at 0x7ff1babf1550>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:31.882580 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d6b9cf68-b5de-401c-bf3c-9051f11bcc4a tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1997278881" status: 202 len: 0 microversion: 2.1 time: 0.150659 Sep 23 04:40:31.883185 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1244/2462] 10.222.0.33 () {58 vars in 1221 bytes} [Fri Sep 23 04:40:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1997278881 => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:40:32.280180 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2a360c42-2072-4e4d-ad60-06541e6e7def tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:32.282852 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-2a360c42-2072-4e4d-ad60-06541e6e7def tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 42fe539b-6665-43fb-b7a2-bc8a6f2c65d5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:32.304060 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2a360c42-2072-4e4d-ad60-06541e6e7def tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:32.311608 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2a360c42-2072-4e4d-ad60-06541e6e7def tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:32.311608 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2a360c42-2072-4e4d-ad60-06541e6e7def tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:32.311608 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2a360c42-2072-4e4d-ad60-06541e6e7def tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:32.311608 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2a360c42-2072-4e4d-ad60-06541e6e7def tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:32.317725 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2a360c42-2072-4e4d-ad60-06541e6e7def tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:32.714050 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2a360c42-2072-4e4d-ad60-06541e6e7def tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:32.724482 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2a360c42-2072-4e4d-ad60-06541e6e7def tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/42fe539b-6665-43fb-b7a2-bc8a6f2c65d5" status: 200 len: 1529 microversion: 2.1 time: 0.448842 Sep 23 04:40:32.725073 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1245/2463] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:40:32 2022] GET /compute/v2.1/servers/42fe539b-6665-43fb-b7a2-bc8a6f2c65d5 => generated 1529 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:40:32.742656 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d5fa8c81-9933-46e3-864f-8e850c823e7d tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:32.742656 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d5fa8c81-9933-46e3-864f-8e850c823e7d tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:32.754374 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d5fa8c81-9933-46e3-864f-8e850c823e7d tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:32.754795 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d5fa8c81-9933-46e3-864f-8e850c823e7d tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:32.758843 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d5fa8c81-9933-46e3-864f-8e850c823e7d tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:32.759892 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d5fa8c81-9933-46e3-864f-8e850c823e7d tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:32.760533 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d5fa8c81-9933-46e3-864f-8e850c823e7d tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:32.761184 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d5fa8c81-9933-46e3-864f-8e850c823e7d tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:32.939679 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d5fa8c81-9933-46e3-864f-8e850c823e7d tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:32.962818 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d5fa8c81-9933-46e3-864f-8e850c823e7d tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:32.965486 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d5fa8c81-9933-46e3-864f-8e850c823e7d tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:32.989851 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d5fa8c81-9933-46e3-864f-8e850c823e7d tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1553 microversion: 2.91 time: 0.262168 Sep 23 04:40:32.989851 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1246/2464] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:40:32 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1553 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:40:33.754441 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-eb707865-214b-447d-b043-bf651682dc3e tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:33.755768 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-eb707865-214b-447d-b043-bf651682dc3e tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 42fe539b-6665-43fb-b7a2-bc8a6f2c65d5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:33.765247 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eb707865-214b-447d-b043-bf651682dc3e tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:33.775863 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eb707865-214b-447d-b043-bf651682dc3e tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:33.778572 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eb707865-214b-447d-b043-bf651682dc3e tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:33.779617 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eb707865-214b-447d-b043-bf651682dc3e tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:33.782605 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eb707865-214b-447d-b043-bf651682dc3e tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:33.783254 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eb707865-214b-447d-b043-bf651682dc3e tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:34.134860 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-eb707865-214b-447d-b043-bf651682dc3e tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:34.153034 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-eb707865-214b-447d-b043-bf651682dc3e tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/42fe539b-6665-43fb-b7a2-bc8a6f2c65d5" status: 200 len: 1524 microversion: 2.1 time: 0.397685 Sep 23 04:40:34.153034 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1247/2465] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:40:33 2022] GET /compute/v2.1/servers/42fe539b-6665-43fb-b7a2-bc8a6f2c65d5 => generated 1524 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:40:34.162964 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-98f15f85-93e6-4824-b40a-42b25e4b3e84 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:34.167277 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-98f15f85-93e6-4824-b40a-42b25e4b3e84 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:34.180209 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-98f15f85-93e6-4824-b40a-42b25e4b3e84 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:34.184691 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-98f15f85-93e6-4824-b40a-42b25e4b3e84 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:34.185163 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-98f15f85-93e6-4824-b40a-42b25e4b3e84 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:34.185960 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-98f15f85-93e6-4824-b40a-42b25e4b3e84 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:34.193098 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-98f15f85-93e6-4824-b40a-42b25e4b3e84 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:34.193599 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-98f15f85-93e6-4824-b40a-42b25e4b3e84 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:34.552053 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-98f15f85-93e6-4824-b40a-42b25e4b3e84 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:34.570388 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-98f15f85-93e6-4824-b40a-42b25e4b3e84 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:34.575130 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-98f15f85-93e6-4824-b40a-42b25e4b3e84 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:34.592796 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-98f15f85-93e6-4824-b40a-42b25e4b3e84 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1553 microversion: 2.91 time: 0.436907 Sep 23 04:40:34.606612 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1248/2466] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:40:34 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1553 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:40:34.864377 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-bcc7c830-eb8c-4df2-b394-1d6a4c026062 tempest-FloatingIPsTestJSON-1066831830 tempest-FloatingIPsTestJSON-1066831830-project] 10.222.0.33 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 6.183768 Sep 23 04:40:34.870767 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1219/2467] 10.222.0.33 () {60 vars in 1170 bytes} [Fri Sep 23 04:40:28 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 6191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:40:34.883394 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-96aebdec-7c55-4f2f-b7b5-11cc28fefac8 tempest-FloatingIPsTestJSON-1066831830 tempest-FloatingIPsTestJSON-1066831830-project] Calling method '.version_select at 0x7ff1bb8d8b80>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:35.011544 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5abcfff2-a691-4c06-a3ca-c2a1a961d759 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:35.013317 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5abcfff2-a691-4c06-a3ca-c2a1a961d759 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: 36165f99-56fa-427b-98b4-c79d41f1fe28] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:35.024125 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5abcfff2-a691-4c06-a3ca-c2a1a961d759 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:35.027494 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5abcfff2-a691-4c06-a3ca-c2a1a961d759 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:35.028736 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5abcfff2-a691-4c06-a3ca-c2a1a961d759 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:35.029813 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5abcfff2-a691-4c06-a3ca-c2a1a961d759 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:35.032224 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5abcfff2-a691-4c06-a3ca-c2a1a961d759 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:35.033015 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5abcfff2-a691-4c06-a3ca-c2a1a961d759 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:35.107680 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5abcfff2-a691-4c06-a3ca-c2a1a961d759 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: 36165f99-56fa-427b-98b4-c79d41f1fe28] Going to try to terminate instance {{(pid=122698) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:40:35.562443 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5abcfff2-a691-4c06-a3ca-c2a1a961d759 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "DELETE /compute/v2.1/servers/36165f99-56fa-427b-98b4-c79d41f1fe28" status: 204 len: 0 microversion: 2.1 time: 0.554113 Sep 23 04:40:35.564360 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1220/2468] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:40:35 2022] DELETE /compute/v2.1/servers/36165f99-56fa-427b-98b4-c79d41f1fe28 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:40:35.573042 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-eba72b8c-cb5e-4f1e-9b70-686a38b4ae78 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:35.576443 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-eba72b8c-cb5e-4f1e-9b70-686a38b4ae78 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 42fe539b-6665-43fb-b7a2-bc8a6f2c65d5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:35.591339 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-eba72b8c-cb5e-4f1e-9b70-686a38b4ae78 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:35.593210 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-eba72b8c-cb5e-4f1e-9b70-686a38b4ae78 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:35.594286 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-eba72b8c-cb5e-4f1e-9b70-686a38b4ae78 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:35.598123 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-96aebdec-7c55-4f2f-b7b5-11cc28fefac8 tempest-FloatingIPsTestJSON-1066831830 tempest-FloatingIPsTestJSON-1066831830-project] 10.222.0.33 "GET /compute/v2.1/os-floating-ips/56c58d62-e337-4478-bf77-9502fe5dd7fb" status: 200 len: 141 microversion: 2.1 time: 0.718376 Sep 23 04:40:35.599670 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1249/2469] 10.222.0.33 () {58 vars in 1260 bytes} [Fri Sep 23 04:40:34 2022] GET /compute/v2.1/os-floating-ips/56c58d62-e337-4478-bf77-9502fe5dd7fb => generated 141 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:40:35.605573 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c4723481-4aff-41f1-88dc-834fb4fc7831 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:35.608018 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c4723481-4aff-41f1-88dc-834fb4fc7831 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: 36165f99-56fa-427b-98b4-c79d41f1fe28] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:35.610093 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-eba72b8c-cb5e-4f1e-9b70-686a38b4ae78 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:35.623944 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-eba72b8c-cb5e-4f1e-9b70-686a38b4ae78 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:35.623944 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-eba72b8c-cb5e-4f1e-9b70-686a38b4ae78 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:35.625627 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c4723481-4aff-41f1-88dc-834fb4fc7831 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:35.629280 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c4723481-4aff-41f1-88dc-834fb4fc7831 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:35.631670 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c4723481-4aff-41f1-88dc-834fb4fc7831 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:35.632605 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c4723481-4aff-41f1-88dc-834fb4fc7831 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:35.634428 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c4723481-4aff-41f1-88dc-834fb4fc7831 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:35.635054 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c4723481-4aff-41f1-88dc-834fb4fc7831 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:36.337093 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c4723481-4aff-41f1-88dc-834fb4fc7831 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:36.368533 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c4723481-4aff-41f1-88dc-834fb4fc7831 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/36165f99-56fa-427b-98b4-c79d41f1fe28" status: 200 len: 1485 microversion: 2.1 time: 0.764541 Sep 23 04:40:36.369828 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1250/2470] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:40:35 2022] GET /compute/v2.1/servers/36165f99-56fa-427b-98b4-c79d41f1fe28 => generated 1485 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:40:36.375514 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6b659f77-84e4-4ce9-a3d1-ec1c5b73d613 tempest-FloatingIPsTestJSON-1066831830 tempest-FloatingIPsTestJSON-1066831830-project] Calling method '.version_select at 0x7ff1bbfd3f70>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:36.568942 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-eba72b8c-cb5e-4f1e-9b70-686a38b4ae78 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:36.584470 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-eba72b8c-cb5e-4f1e-9b70-686a38b4ae78 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/42fe539b-6665-43fb-b7a2-bc8a6f2c65d5" status: 200 len: 1524 microversion: 2.1 time: 1.013050 Sep 23 04:40:36.585094 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1221/2471] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:40:35 2022] GET /compute/v2.1/servers/42fe539b-6665-43fb-b7a2-bc8a6f2c65d5 => generated 1524 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:40:36.625856 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-29b051bb-ebc7-47ff-87f5-781ec6a0ff5f tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:36.634912 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-29b051bb-ebc7-47ff-87f5-781ec6a0ff5f tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:36.648548 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-29b051bb-ebc7-47ff-87f5-781ec6a0ff5f tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:36.649064 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-29b051bb-ebc7-47ff-87f5-781ec6a0ff5f tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:36.649517 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-29b051bb-ebc7-47ff-87f5-781ec6a0ff5f tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:36.650277 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-29b051bb-ebc7-47ff-87f5-781ec6a0ff5f tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:36.650744 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-29b051bb-ebc7-47ff-87f5-781ec6a0ff5f tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:36.651178 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-29b051bb-ebc7-47ff-87f5-781ec6a0ff5f tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:36.828926 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-29b051bb-ebc7-47ff-87f5-781ec6a0ff5f tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:36.844481 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-29b051bb-ebc7-47ff-87f5-781ec6a0ff5f tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:36.846470 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-29b051bb-ebc7-47ff-87f5-781ec6a0ff5f tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:36.861072 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-29b051bb-ebc7-47ff-87f5-781ec6a0ff5f tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1553 microversion: 2.91 time: 0.269957 Sep 23 04:40:36.881612 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1222/2472] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:40:36 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1553 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:40:36.898150 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-17a22be9-82df-4043-b55a-fc89645cdf61 req-1a41e0d0-442c-4b40-bf17-88c7259f9c25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42fe539b-6665-43fb-b7a2-bc8a6f2c65d5", "name": "network-vif-plugged", "status": "completed", "tag": "612a667a-9f5d-490a-b4df-3250d5946428"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:40:36.926785 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-17a22be9-82df-4043-b55a-fc89645cdf61 req-1a41e0d0-442c-4b40-bf17-88c7259f9c25 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:36.927272 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-17a22be9-82df-4043-b55a-fc89645cdf61 req-1a41e0d0-442c-4b40-bf17-88c7259f9c25 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:36.927701 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-17a22be9-82df-4043-b55a-fc89645cdf61 req-1a41e0d0-442c-4b40-bf17-88c7259f9c25 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:36.977407 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-17a22be9-82df-4043-b55a-fc89645cdf61 req-1a41e0d0-442c-4b40-bf17-88c7259f9c25 service nova] Creating event network-vif-plugged:612a667a-9f5d-490a-b4df-3250d5946428 for instance 42fe539b-6665-43fb-b7a2-bc8a6f2c65d5 on n-h2-846463-3 Sep 23 04:40:36.996615 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-17a22be9-82df-4043-b55a-fc89645cdf61 req-1a41e0d0-442c-4b40-bf17-88c7259f9c25 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113347 Sep 23 04:40:36.997378 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1223/2473] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:40:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:40:37.532738 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-725339b8-795c-49ee-ad74-fb48d94654fd tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:37.532738 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-725339b8-795c-49ee-ad74-fb48d94654fd tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: 36165f99-56fa-427b-98b4-c79d41f1fe28] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:37.532738 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-725339b8-795c-49ee-ad74-fb48d94654fd tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:37.532738 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-725339b8-795c-49ee-ad74-fb48d94654fd tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:37.532738 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-725339b8-795c-49ee-ad74-fb48d94654fd tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:37.532738 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-725339b8-795c-49ee-ad74-fb48d94654fd tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:37.532738 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-725339b8-795c-49ee-ad74-fb48d94654fd tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:37.532738 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-725339b8-795c-49ee-ad74-fb48d94654fd tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:37.941113 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-725339b8-795c-49ee-ad74-fb48d94654fd tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:37.950789 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-725339b8-795c-49ee-ad74-fb48d94654fd tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/36165f99-56fa-427b-98b4-c79d41f1fe28" status: 200 len: 1485 microversion: 2.1 time: 0.555448 Sep 23 04:40:37.951376 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1224/2474] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:40:37 2022] GET /compute/v2.1/servers/36165f99-56fa-427b-98b4-c79d41f1fe28 => generated 1485 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:40:37.966046 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-53a8549a-97e2-4655-855e-66b77f80bbd4 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:37.968204 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-53a8549a-97e2-4655-855e-66b77f80bbd4 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 42fe539b-6665-43fb-b7a2-bc8a6f2c65d5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:37.981938 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-53a8549a-97e2-4655-855e-66b77f80bbd4 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:37.982441 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-53a8549a-97e2-4655-855e-66b77f80bbd4 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:37.984605 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-53a8549a-97e2-4655-855e-66b77f80bbd4 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:37.985382 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-53a8549a-97e2-4655-855e-66b77f80bbd4 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:37.985856 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-53a8549a-97e2-4655-855e-66b77f80bbd4 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:37.990728 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-53a8549a-97e2-4655-855e-66b77f80bbd4 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:38.131864 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6b659f77-84e4-4ce9-a3d1-ec1c5b73d613 tempest-FloatingIPsTestJSON-1066831830 tempest-FloatingIPsTestJSON-1066831830-project] 10.222.0.33 "GET /compute/v2.1/os-floating-ips" status: 200 len: 144 microversion: 2.1 time: 1.760100 Sep 23 04:40:38.141488 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1251/2475] 10.222.0.33 () {58 vars in 1149 bytes} [Fri Sep 23 04:40:36 2022] GET /compute/v2.1/os-floating-ips => generated 144 bytes in 1766 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:40:38.162714 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a86307f3-db07-4025-979a-f40576d1a458 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:38.162714 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a86307f3-db07-4025-979a-f40576d1a458 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:38.201084 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a86307f3-db07-4025-979a-f40576d1a458 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:38.201614 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a86307f3-db07-4025-979a-f40576d1a458 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:38.202108 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a86307f3-db07-4025-979a-f40576d1a458 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:38.202831 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a86307f3-db07-4025-979a-f40576d1a458 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:38.203393 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a86307f3-db07-4025-979a-f40576d1a458 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:38.203736 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a86307f3-db07-4025-979a-f40576d1a458 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:38.463208 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a86307f3-db07-4025-979a-f40576d1a458 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:38.476706 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a86307f3-db07-4025-979a-f40576d1a458 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:38.484591 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a86307f3-db07-4025-979a-f40576d1a458 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:38.497236 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-53a8549a-97e2-4655-855e-66b77f80bbd4 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:38.501443 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:40:38.505687 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-53a8549a-97e2-4655-855e-66b77f80bbd4 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/42fe539b-6665-43fb-b7a2-bc8a6f2c65d5" status: 200 len: 1524 microversion: 2.1 time: 0.549685 Sep 23 04:40:38.507706 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a86307f3-db07-4025-979a-f40576d1a458 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1553 microversion: 2.91 time: 0.368539 Sep 23 04:40:38.508710 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1252/2476] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:40:38 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1553 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:40:38.521602 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2112fd7b-a707-4a4f-8260-99dadaff3f41 tempest-FloatingIPsTestJSON-1066831830 tempest-FloatingIPsTestJSON-1066831830-project] Calling method '.version_select at 0x7ff1bac2e700>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:38.534890 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1225/2477] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:40:37 2022] GET /compute/v2.1/servers/42fe539b-6665-43fb-b7a2-bc8a6f2c65d5 => generated 1524 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:40:38.977376 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a2bacea4-9bae-4519-8390-95a20368c410 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:38.978258 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a2bacea4-9bae-4519-8390-95a20368c410 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: 36165f99-56fa-427b-98b4-c79d41f1fe28] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:38.986058 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a2bacea4-9bae-4519-8390-95a20368c410 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:38.986947 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a2bacea4-9bae-4519-8390-95a20368c410 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:38.987617 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a2bacea4-9bae-4519-8390-95a20368c410 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:38.988625 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a2bacea4-9bae-4519-8390-95a20368c410 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:38.989467 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a2bacea4-9bae-4519-8390-95a20368c410 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:38.990107 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a2bacea4-9bae-4519-8390-95a20368c410 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:39.582226 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a2bacea4-9bae-4519-8390-95a20368c410 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:39.594436 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a2bacea4-9bae-4519-8390-95a20368c410 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/36165f99-56fa-427b-98b4-c79d41f1fe28" status: 200 len: 1485 microversion: 2.1 time: 0.621528 Sep 23 04:40:39.595228 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1226/2478] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:40:38 2022] GET /compute/v2.1/servers/36165f99-56fa-427b-98b4-c79d41f1fe28 => generated 1485 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:40:39.609863 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-891afa9f-d1f1-4472-a26f-a69836734192 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:39.618733 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-891afa9f-d1f1-4472-a26f-a69836734192 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 42fe539b-6665-43fb-b7a2-bc8a6f2c65d5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:39.629843 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-891afa9f-d1f1-4472-a26f-a69836734192 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:39.630380 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-891afa9f-d1f1-4472-a26f-a69836734192 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:39.630825 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-891afa9f-d1f1-4472-a26f-a69836734192 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:39.631540 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-891afa9f-d1f1-4472-a26f-a69836734192 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:39.632001 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-891afa9f-d1f1-4472-a26f-a69836734192 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:39.632432 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-891afa9f-d1f1-4472-a26f-a69836734192 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:39.684837 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:40:40.165542 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-891afa9f-d1f1-4472-a26f-a69836734192 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:40.182385 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-891afa9f-d1f1-4472-a26f-a69836734192 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/42fe539b-6665-43fb-b7a2-bc8a6f2c65d5" status: 200 len: 1524 microversion: 2.1 time: 0.585921 Sep 23 04:40:40.190961 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1227/2479] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:40:39 2022] GET /compute/v2.1/servers/42fe539b-6665-43fb-b7a2-bc8a6f2c65d5 => generated 1524 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:40:40.199426 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3dbc7706-c542-4b08-acc8-9b31a7e8303f tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:40.210772 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3dbc7706-c542-4b08-acc8-9b31a7e8303f tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:40.245088 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3dbc7706-c542-4b08-acc8-9b31a7e8303f tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:40.245880 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3dbc7706-c542-4b08-acc8-9b31a7e8303f tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:40.246516 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3dbc7706-c542-4b08-acc8-9b31a7e8303f tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:40.247405 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3dbc7706-c542-4b08-acc8-9b31a7e8303f tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:40.248036 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3dbc7706-c542-4b08-acc8-9b31a7e8303f tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:40.248621 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3dbc7706-c542-4b08-acc8-9b31a7e8303f tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:40.637585 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-3dbc7706-c542-4b08-acc8-9b31a7e8303f tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:40.654753 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-3dbc7706-c542-4b08-acc8-9b31a7e8303f tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:40.661776 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-3dbc7706-c542-4b08-acc8-9b31a7e8303f tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:40.673321 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=3,nova_api:UPDATE=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:40:40.676793 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3dbc7706-c542-4b08-acc8-9b31a7e8303f tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1535 microversion: 2.91 time: 0.484652 Sep 23 04:40:40.678375 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1228/2480] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:40:40 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1535 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:40:40.688579 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-193bc62e-ceef-4464-9e86-833faf8f0cfd req-a10bd465-9318-44ba-a38e-580878f8ab02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36165f99-56fa-427b-98b4-c79d41f1fe28", "name": "network-vif-deleted", "tag": "0d971d87-a72a-48a8-adf7-e1b2b7f60e03"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:40:40.723729 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-193bc62e-ceef-4464-9e86-833faf8f0cfd req-a10bd465-9318-44ba-a38e-580878f8ab02 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:40.724477 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-193bc62e-ceef-4464-9e86-833faf8f0cfd req-a10bd465-9318-44ba-a38e-580878f8ab02 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:40.725229 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-193bc62e-ceef-4464-9e86-833faf8f0cfd req-a10bd465-9318-44ba-a38e-580878f8ab02 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:40.754936 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-193bc62e-ceef-4464-9e86-833faf8f0cfd req-a10bd465-9318-44ba-a38e-580878f8ab02 service nova] Creating event network-vif-deleted:0d971d87-a72a-48a8-adf7-e1b2b7f60e03 for instance 36165f99-56fa-427b-98b4-c79d41f1fe28 on n-h1-846463-3 Sep 23 04:40:40.762254 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-193bc62e-ceef-4464-9e86-833faf8f0cfd req-a10bd465-9318-44ba-a38e-580878f8ab02 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080374 Sep 23 04:40:40.766507 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1229/2481] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:40:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:40:40.784313 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c602faef-aada-4646-aabe-51dc44e718e6 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:40.786620 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c602faef-aada-4646-aabe-51dc44e718e6 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: 36165f99-56fa-427b-98b4-c79d41f1fe28] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:40.801785 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c602faef-aada-4646-aabe-51dc44e718e6 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:40.807987 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c602faef-aada-4646-aabe-51dc44e718e6 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:40.807987 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c602faef-aada-4646-aabe-51dc44e718e6 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:40.807987 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c602faef-aada-4646-aabe-51dc44e718e6 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:40.807987 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c602faef-aada-4646-aabe-51dc44e718e6 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:40.807987 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c602faef-aada-4646-aabe-51dc44e718e6 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:40.990869 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c602faef-aada-4646-aabe-51dc44e718e6 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:41.002910 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c602faef-aada-4646-aabe-51dc44e718e6 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/36165f99-56fa-427b-98b4-c79d41f1fe28" status: 200 len: 1443 microversion: 2.1 time: 0.234807 Sep 23 04:40:41.019021 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1230/2482] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:40:40 2022] GET /compute/v2.1/servers/36165f99-56fa-427b-98b4-c79d41f1fe28 => generated 1443 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:40:41.029691 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2112fd7b-a707-4a4f-8260-99dadaff3f41 tempest-FloatingIPsTestJSON-1066831830 tempest-FloatingIPsTestJSON-1066831830-project] 10.222.0.33 "DELETE /compute/v2.1/os-floating-ips/56c58d62-e337-4478-bf77-9502fe5dd7fb" status: 202 len: 0 microversion: 2.1 time: 2.516008 Sep 23 04:40:41.030321 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1253/2483] 10.222.0.33 () {58 vars in 1263 bytes} [Fri Sep 23 04:40:38 2022] DELETE /compute/v2.1/os-floating-ips/56c58d62-e337-4478-bf77-9502fe5dd7fb => generated 0 bytes in 2517 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:40:41.040937 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a1b702bc-dde8-4687-9946-6f20125f652b tempest-FloatingIPsTestJSON-1066831830 tempest-FloatingIPsTestJSON-1066831830-project] Action: 'create', calling method: .version_select at 0x7ff1c3d2fee0>, body: {"pool": null} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:40:41.228808 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0a86ae05-5fb0-4f97-958f-9fde9dea2d22 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:41.229980 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-0a86ae05-5fb0-4f97-958f-9fde9dea2d22 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 42fe539b-6665-43fb-b7a2-bc8a6f2c65d5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:41.248762 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0a86ae05-5fb0-4f97-958f-9fde9dea2d22 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:41.252119 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0a86ae05-5fb0-4f97-958f-9fde9dea2d22 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:41.255714 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0a86ae05-5fb0-4f97-958f-9fde9dea2d22 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:41.257638 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0a86ae05-5fb0-4f97-958f-9fde9dea2d22 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:41.261575 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0a86ae05-5fb0-4f97-958f-9fde9dea2d22 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:41.262264 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0a86ae05-5fb0-4f97-958f-9fde9dea2d22 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:41.671577 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-0a86ae05-5fb0-4f97-958f-9fde9dea2d22 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:41.687401 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0a86ae05-5fb0-4f97-958f-9fde9dea2d22 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/42fe539b-6665-43fb-b7a2-bc8a6f2c65d5" status: 200 len: 1524 microversion: 2.1 time: 0.470321 Sep 23 04:40:41.696301 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1254/2484] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:40:41 2022] GET /compute/v2.1/servers/42fe539b-6665-43fb-b7a2-bc8a6f2c65d5 => generated 1524 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:40:41.717680 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-52ccde2d-43b0-4b8f-b02e-24d6c7461a3e tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:41.720911 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-52ccde2d-43b0-4b8f-b02e-24d6c7461a3e tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:41.743333 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-52ccde2d-43b0-4b8f-b02e-24d6c7461a3e tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:41.750108 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-52ccde2d-43b0-4b8f-b02e-24d6c7461a3e tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:41.750966 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-52ccde2d-43b0-4b8f-b02e-24d6c7461a3e tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:41.753463 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-52ccde2d-43b0-4b8f-b02e-24d6c7461a3e tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:41.755649 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-52ccde2d-43b0-4b8f-b02e-24d6c7461a3e tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:41.761546 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-52ccde2d-43b0-4b8f-b02e-24d6c7461a3e tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:41.986039 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-52ccde2d-43b0-4b8f-b02e-24d6c7461a3e tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:42.003102 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-52ccde2d-43b0-4b8f-b02e-24d6c7461a3e tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:42.005325 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-52ccde2d-43b0-4b8f-b02e-24d6c7461a3e tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:42.017121 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-52ccde2d-43b0-4b8f-b02e-24d6c7461a3e tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1538 microversion: 2.91 time: 0.306602 Sep 23 04:40:42.022391 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1255/2485] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:40:41 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1538 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:40:42.037960 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-53da2619-42d0-46c1-b997-0ab5571f41fd tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:42.039282 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-53da2619-42d0-46c1-b997-0ab5571f41fd tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: 36165f99-56fa-427b-98b4-c79d41f1fe28] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:42.058414 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-53da2619-42d0-46c1-b997-0ab5571f41fd tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:42.059224 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-53da2619-42d0-46c1-b997-0ab5571f41fd tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:42.062470 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-53da2619-42d0-46c1-b997-0ab5571f41fd tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:42.063630 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-53da2619-42d0-46c1-b997-0ab5571f41fd tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:42.064332 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-53da2619-42d0-46c1-b997-0ab5571f41fd tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:42.064933 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-53da2619-42d0-46c1-b997-0ab5571f41fd tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:42.174808 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-53da2619-42d0-46c1-b997-0ab5571f41fd tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:42.176882 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-53da2619-42d0-46c1-b997-0ab5571f41fd tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:42.177575 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-53da2619-42d0-46c1-b997-0ab5571f41fd tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:42.179683 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-53da2619-42d0-46c1-b997-0ab5571f41fd tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lazy-loading 'fault' on Instance uuid 36165f99-56fa-427b-98b4-c79d41f1fe28 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:40:42.392874 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-53da2619-42d0-46c1-b997-0ab5571f41fd tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:42.407054 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-53da2619-42d0-46c1-b997-0ab5571f41fd tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/36165f99-56fa-427b-98b4-c79d41f1fe28" status: 200 len: 1301 microversion: 2.1 time: 0.383285 Sep 23 04:40:42.407656 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1256/2486] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:40:42 2022] GET /compute/v2.1/servers/36165f99-56fa-427b-98b4-c79d41f1fe28 => generated 1301 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:40:42.415919 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7a31b510-55e5-424e-9288-3b3f647c4997 tempest-UnshelveToHostMultiNodesTest-1629091521 tempest-UnshelveToHostMultiNodesTest-1629091521-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h1-846463-3"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:40:42.435559 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-7a31b510-55e5-424e-9288-3b3f647c4997 tempest-UnshelveToHostMultiNodesTest-1629091521 tempest-UnshelveToHostMultiNodesTest-1629091521-project-admin] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:42.455381 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7a31b510-55e5-424e-9288-3b3f647c4997 tempest-UnshelveToHostMultiNodesTest-1629091521 tempest-UnshelveToHostMultiNodesTest-1629091521-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:42.462723 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7a31b510-55e5-424e-9288-3b3f647c4997 tempest-UnshelveToHostMultiNodesTest-1629091521 tempest-UnshelveToHostMultiNodesTest-1629091521-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:42.471231 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7a31b510-55e5-424e-9288-3b3f647c4997 tempest-UnshelveToHostMultiNodesTest-1629091521 tempest-UnshelveToHostMultiNodesTest-1629091521-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:42.472354 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7a31b510-55e5-424e-9288-3b3f647c4997 tempest-UnshelveToHostMultiNodesTest-1629091521 tempest-UnshelveToHostMultiNodesTest-1629091521-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:42.473005 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7a31b510-55e5-424e-9288-3b3f647c4997 tempest-UnshelveToHostMultiNodesTest-1629091521 tempest-UnshelveToHostMultiNodesTest-1629091521-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:42.473861 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7a31b510-55e5-424e-9288-3b3f647c4997 tempest-UnshelveToHostMultiNodesTest-1629091521 tempest-UnshelveToHostMultiNodesTest-1629091521-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:42.478350 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=100 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:40:42.653258 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-7a31b510-55e5-424e-9288-3b3f647c4997 tempest-UnshelveToHostMultiNodesTest-1629091521 tempest-UnshelveToHostMultiNodesTest-1629091521-project-admin] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h1-846463-3". {{(pid=122699) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 23 04:40:43.084246 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-7a31b510-55e5-424e-9288-3b3f647c4997 tempest-UnshelveToHostMultiNodesTest-1629091521 tempest-UnshelveToHostMultiNodesTest-1629091521-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831/action" status: 202 len: 0 microversion: 2.91 time: 0.675492 Sep 23 04:40:43.087238 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1257/2487] 10.222.0.33 () {62 vars in 1319 bytes} [Fri Sep 23 04:40:42 2022] POST /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831/action => generated 0 bytes in 679 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:40:43.095675 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2507d5f8-c7d9-4cdb-8c24-a4ff6826f9b4 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:43.102769 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-2507d5f8-c7d9-4cdb-8c24-a4ff6826f9b4 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 42fe539b-6665-43fb-b7a2-bc8a6f2c65d5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:43.119264 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2507d5f8-c7d9-4cdb-8c24-a4ff6826f9b4 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:43.120346 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2507d5f8-c7d9-4cdb-8c24-a4ff6826f9b4 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:43.121061 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2507d5f8-c7d9-4cdb-8c24-a4ff6826f9b4 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:43.122807 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2507d5f8-c7d9-4cdb-8c24-a4ff6826f9b4 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:43.128271 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2507d5f8-c7d9-4cdb-8c24-a4ff6826f9b4 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:43.130426 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2507d5f8-c7d9-4cdb-8c24-a4ff6826f9b4 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:44.085556 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2507d5f8-c7d9-4cdb-8c24-a4ff6826f9b4 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:44.094145 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2507d5f8-c7d9-4cdb-8c24-a4ff6826f9b4 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/42fe539b-6665-43fb-b7a2-bc8a6f2c65d5" status: 200 len: 1524 microversion: 2.1 time: 1.005530 Sep 23 04:40:44.100761 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1258/2488] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:40:43 2022] GET /compute/v2.1/servers/42fe539b-6665-43fb-b7a2-bc8a6f2c65d5 => generated 1524 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:40:44.104796 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b834a7ce-2ef6-4cbd-bdcc-fb6fa91d2af8 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:44.107237 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b834a7ce-2ef6-4cbd-bdcc-fb6fa91d2af8 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:44.123691 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b834a7ce-2ef6-4cbd-bdcc-fb6fa91d2af8 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:44.124469 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b834a7ce-2ef6-4cbd-bdcc-fb6fa91d2af8 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:44.125079 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b834a7ce-2ef6-4cbd-bdcc-fb6fa91d2af8 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:44.126002 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b834a7ce-2ef6-4cbd-bdcc-fb6fa91d2af8 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:44.126620 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b834a7ce-2ef6-4cbd-bdcc-fb6fa91d2af8 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:44.128196 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b834a7ce-2ef6-4cbd-bdcc-fb6fa91d2af8 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:44.295802 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b834a7ce-2ef6-4cbd-bdcc-fb6fa91d2af8 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:44.305082 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b834a7ce-2ef6-4cbd-bdcc-fb6fa91d2af8 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:44.311232 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b834a7ce-2ef6-4cbd-bdcc-fb6fa91d2af8 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:44.318010 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b834a7ce-2ef6-4cbd-bdcc-fb6fa91d2af8 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1486 microversion: 2.91 time: 0.218991 Sep 23 04:40:44.332338 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1259/2489] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:40:44 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1486 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:40:44.350494 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f15826f7-4fb4-4c35-9b34-8c5fe1bf93a5 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:44.353072 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f15826f7-4fb4-4c35-9b34-8c5fe1bf93a5 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: 36165f99-56fa-427b-98b4-c79d41f1fe28] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:44.372068 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f15826f7-4fb4-4c35-9b34-8c5fe1bf93a5 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:44.372586 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f15826f7-4fb4-4c35-9b34-8c5fe1bf93a5 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:44.386131 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f15826f7-4fb4-4c35-9b34-8c5fe1bf93a5 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:44.387183 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f15826f7-4fb4-4c35-9b34-8c5fe1bf93a5 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:44.388171 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f15826f7-4fb4-4c35-9b34-8c5fe1bf93a5 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:44.388425 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f15826f7-4fb4-4c35-9b34-8c5fe1bf93a5 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:44.408533 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-f15826f7-4fb4-4c35-9b34-8c5fe1bf93a5 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] HTTP exception thrown: Instance 36165f99-56fa-427b-98b4-c79d41f1fe28 could not be found. Sep 23 04:40:44.410189 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f15826f7-4fb4-4c35-9b34-8c5fe1bf93a5 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Request method failure captured: Sep 23 04:40:44.410189 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/36165f99-56fa-427b-98b4-c79d41f1fe28 HTTP/1.1 Sep 23 04:40:44.410189 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:40:44.410189 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:40:44.410189 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:40:44.410189 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:40:44.410189 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:40:44.410189 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:40:44.410189 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:40:44.410189 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:40:44.410189 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTcNAuuAvcMSzeRfNMub4GatrGaNFAdVjoyngK1TY5in1YZ6QNGRYPH5v55GVnDmBMF0sLhf8Sr5c0HFc7yDQLOpgvmmOrzz5EcjVod5YyYFmG_VsP9JTCpR9IKnz3i4uGS6U8OvbA0E0OQ4o-5_pXC0QM_YyWBYZ-V5XzE_FtxBeVo Sep 23 04:40:44.410189 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:40:44.410189 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:40:44.410189 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:40:44.410189 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:40:44.410189 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:40:44.410189 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:40:44.410189 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 004af70c9f9a43c4a7be8136268e98f9 Sep 23 04:40:44.410189 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-LiveMigrationTest-630802414 Sep 23 04:40:44.410189 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:40:44.410189 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:40:44.410189 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_004af70c9f9a43c4a7be8136268e98f9", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/004af70c9f9a43c4a7be8136268e98f9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/004af70c9f9a43c4a7be8136268e98f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "tempest-type-1451344989", "name": "tempest-service-1652784468", "endpoints": []}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/004af70c9f9a43c4a7be8136268e98f9"}]}, {"type": "tempest-type-1029636837", "name": "tempest-service-1633719024", "endpoints": [{"region": "tempest-region-1560816386", "publicURL": "https://url-1076501004.com"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:40:44.410189 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-LiveMigrationTest-630802414 Sep 23 04:40:44.410189 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 004af70c9f9a43c4a7be8136268e98f9 Sep 23 04:40:44.410189 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-LiveMigrationTest-630802414 Sep 23 04:40:44.410189 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-LiveMigrationTest-630802414-project Sep 23 04:40:44.410189 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:40:44.410189 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:40:44.410189 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 82d04a55ba72452995e3b156325e0890 Sep 23 04:40:44.410189 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-LiveMigrationTest-630802414-project Sep 23 04:40:44.410189 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:40:44.410189 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 36165f99-56fa-427b-98b4-c79d41f1fe28 could not be found. Sep 23 04:40:44.410189 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '36165f99-56fa-427b-98b4-c79d41f1fe28'} Sep 23 04:40:44.410189 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:40:44.410189 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:40:44.410189 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:40:44.410189 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:40:44.410189 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:40:44.410189 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:40:44.410189 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:40:44.410189 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:40:44.410189 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:40:44.410189 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:40:44.410189 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36165f99-56fa-427b-98b4-c79d41f1fe28 could not be found. Sep 23 04:40:44.410189 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:40:44.410189 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:40:44.410189 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:40:44.410189 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:40:44.410189 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:40:44.410189 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:40:44.410189 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:40:44.410189 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:40:44.410189 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:40:44.410189 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:40:44.410189 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:40:44.410189 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:40:44.410189 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:40:44.410189 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:40:44.410189 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:40:44.410189 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:40:44.410189 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36165f99-56fa-427b-98b4-c79d41f1fe28 could not be found. Sep 23 04:40:44.414705 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:40:44.414705 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:40:44.414705 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:40:44.414705 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:40:44.414705 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:40:44.414705 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:40:44.414705 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:40:44.414705 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:40:44.414705 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36165f99-56fa-427b-98b4-c79d41f1fe28 could not be found. Sep 23 04:40:44.414705 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:40:44.414705 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f15826f7-4fb4-4c35-9b34-8c5fe1bf93a5 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Returning 404 to user: Instance 36165f99-56fa-427b-98b4-c79d41f1fe28 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:40:44.417533 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f15826f7-4fb4-4c35-9b34-8c5fe1bf93a5 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/36165f99-56fa-427b-98b4-c79d41f1fe28" status: 404 len: 111 microversion: 2.1 time: 0.083268 Sep 23 04:40:44.418736 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1260/2490] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:40:44 2022] GET /compute/v2.1/servers/36165f99-56fa-427b-98b4-c79d41f1fe28 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:40:44.431173 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7b0f7f42-25c8-4ae2-bccd-c2eb501ae1ea tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:44.431928 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-7b0f7f42-25c8-4ae2-bccd-c2eb501ae1ea tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: f77bb6f0-6ce7-40d8-9cb2-2fcb559353ac] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:44.441418 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7b0f7f42-25c8-4ae2-bccd-c2eb501ae1ea tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:44.443199 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7b0f7f42-25c8-4ae2-bccd-c2eb501ae1ea tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:44.443199 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7b0f7f42-25c8-4ae2-bccd-c2eb501ae1ea tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:44.443400 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7b0f7f42-25c8-4ae2-bccd-c2eb501ae1ea tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:44.443852 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7b0f7f42-25c8-4ae2-bccd-c2eb501ae1ea tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:44.444396 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7b0f7f42-25c8-4ae2-bccd-c2eb501ae1ea tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:44.488804 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-7b0f7f42-25c8-4ae2-bccd-c2eb501ae1ea tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: f77bb6f0-6ce7-40d8-9cb2-2fcb559353ac] Going to try to terminate instance {{(pid=122699) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:40:45.972151 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-7b0f7f42-25c8-4ae2-bccd-c2eb501ae1ea tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f77bb6f0-6ce7-40d8-9cb2-2fcb559353ac" status: 204 len: 0 microversion: 2.1 time: 1.547857 Sep 23 04:40:45.975432 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1261/2491] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:40:44 2022] DELETE /compute/v2.1/servers/f77bb6f0-6ce7-40d8-9cb2-2fcb559353ac => generated 0 bytes in 1549 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:40:45.981563 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5d70fc02-0b5f-4602-af88-db830d47f6de tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:45.985689 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-5d70fc02-0b5f-4602-af88-db830d47f6de tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 42fe539b-6665-43fb-b7a2-bc8a6f2c65d5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:46.011556 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5d70fc02-0b5f-4602-af88-db830d47f6de tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:46.012615 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5d70fc02-0b5f-4602-af88-db830d47f6de tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:46.013225 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5d70fc02-0b5f-4602-af88-db830d47f6de tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:46.014429 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5d70fc02-0b5f-4602-af88-db830d47f6de tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:46.015685 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5d70fc02-0b5f-4602-af88-db830d47f6de tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:46.016292 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5d70fc02-0b5f-4602-af88-db830d47f6de tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:46.730602 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-5d70fc02-0b5f-4602-af88-db830d47f6de tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:46.751692 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5d70fc02-0b5f-4602-af88-db830d47f6de tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/42fe539b-6665-43fb-b7a2-bc8a6f2c65d5" status: 200 len: 1524 microversion: 2.1 time: 0.765273 Sep 23 04:40:46.766996 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1262/2492] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:40:45 2022] GET /compute/v2.1/servers/42fe539b-6665-43fb-b7a2-bc8a6f2c65d5 => generated 1524 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:40:46.766996 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8f7828eb-cb61-4119-b487-b3497e0c9857 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:46.766996 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-8f7828eb-cb61-4119-b487-b3497e0c9857 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:46.792956 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8f7828eb-cb61-4119-b487-b3497e0c9857 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:46.797139 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8f7828eb-cb61-4119-b487-b3497e0c9857 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:46.798807 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8f7828eb-cb61-4119-b487-b3497e0c9857 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:46.799590 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8f7828eb-cb61-4119-b487-b3497e0c9857 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:46.800069 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8f7828eb-cb61-4119-b487-b3497e0c9857 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:46.800492 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8f7828eb-cb61-4119-b487-b3497e0c9857 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:47.023734 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-8f7828eb-cb61-4119-b487-b3497e0c9857 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:47.047595 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-8f7828eb-cb61-4119-b487-b3497e0c9857 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:47.051465 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-8f7828eb-cb61-4119-b487-b3497e0c9857 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:47.074466 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-8f7828eb-cb61-4119-b487-b3497e0c9857 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1486 microversion: 2.91 time: 0.315737 Sep 23 04:40:47.075092 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1263/2493] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:40:46 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1486 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:40:47.095297 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2d695b3f-0108-4ebb-ae5f-7bd0116819ae tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:47.095297 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-2d695b3f-0108-4ebb-ae5f-7bd0116819ae tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] [instance: 53745879-9973-4217-b1c5-b45f917db80e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:47.111970 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2d695b3f-0108-4ebb-ae5f-7bd0116819ae tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:47.116386 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2d695b3f-0108-4ebb-ae5f-7bd0116819ae tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:47.116386 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2d695b3f-0108-4ebb-ae5f-7bd0116819ae tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:47.116386 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2d695b3f-0108-4ebb-ae5f-7bd0116819ae tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:47.116386 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2d695b3f-0108-4ebb-ae5f-7bd0116819ae tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:47.117016 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2d695b3f-0108-4ebb-ae5f-7bd0116819ae tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:47.641121 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2d695b3f-0108-4ebb-ae5f-7bd0116819ae tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:47.665238 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2d695b3f-0108-4ebb-ae5f-7bd0116819ae tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:47.670257 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2d695b3f-0108-4ebb-ae5f-7bd0116819ae tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:47.686090 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2d695b3f-0108-4ebb-ae5f-7bd0116819ae tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] 10.222.0.33 "GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e" status: 200 len: 2947 microversion: 2.42 time: 0.603168 Sep 23 04:40:47.687266 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1264/2494] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:40:47 2022] GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e => generated 2947 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:40:47.703087 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-dfc432d0-1631-41b3-ba64-dff472699489 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:47.704574 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-dfc432d0-1631-41b3-ba64-dff472699489 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: f77bb6f0-6ce7-40d8-9cb2-2fcb559353ac] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:47.717353 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dfc432d0-1631-41b3-ba64-dff472699489 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:47.721245 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dfc432d0-1631-41b3-ba64-dff472699489 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:47.721864 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dfc432d0-1631-41b3-ba64-dff472699489 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:47.728514 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dfc432d0-1631-41b3-ba64-dff472699489 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:47.729452 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dfc432d0-1631-41b3-ba64-dff472699489 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:47.732720 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dfc432d0-1631-41b3-ba64-dff472699489 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:47.914291 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a1b702bc-dde8-4687-9946-6f20125f652b tempest-FloatingIPsTestJSON-1066831830 tempest-FloatingIPsTestJSON-1066831830-project] 10.222.0.33 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 6.878531 Sep 23 04:40:47.915667 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1231/2495] 10.222.0.33 () {60 vars in 1170 bytes} [Fri Sep 23 04:40:41 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 6880 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:40:47.920375 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b7bed53b-e9f7-42fa-ac4f-6eb65adecab7 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:47.920869 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b7bed53b-e9f7-42fa-ac4f-6eb65adecab7 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] [instance: 53745879-9973-4217-b1c5-b45f917db80e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:47.967969 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b7bed53b-e9f7-42fa-ac4f-6eb65adecab7 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:47.975998 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b7bed53b-e9f7-42fa-ac4f-6eb65adecab7 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:47.976343 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b7bed53b-e9f7-42fa-ac4f-6eb65adecab7 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:47.977194 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b7bed53b-e9f7-42fa-ac4f-6eb65adecab7 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:47.977687 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b7bed53b-e9f7-42fa-ac4f-6eb65adecab7 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:47.978163 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b7bed53b-e9f7-42fa-ac4f-6eb65adecab7 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:48.128696 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-dfc432d0-1631-41b3-ba64-dff472699489 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82d04a55ba72452995e3b156325e0890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004af70c9f9a43c4a7be8136268e98f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:48.146664 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-dfc432d0-1631-41b3-ba64-dff472699489 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/f77bb6f0-6ce7-40d8-9cb2-2fcb559353ac" status: 200 len: 1457 microversion: 2.1 time: 0.456051 Sep 23 04:40:48.146664 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1265/2496] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:40:47 2022] GET /compute/v2.1/servers/f77bb6f0-6ce7-40d8-9cb2-2fcb559353ac => generated 1457 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:40:48.168190 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7dd9bff2-3b12-49af-9453-6ff30997e975 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:48.175471 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-7dd9bff2-3b12-49af-9453-6ff30997e975 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 42fe539b-6665-43fb-b7a2-bc8a6f2c65d5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:48.195972 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7dd9bff2-3b12-49af-9453-6ff30997e975 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:48.198316 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7dd9bff2-3b12-49af-9453-6ff30997e975 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:48.198316 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7dd9bff2-3b12-49af-9453-6ff30997e975 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:48.198316 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7dd9bff2-3b12-49af-9453-6ff30997e975 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:48.201797 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7dd9bff2-3b12-49af-9453-6ff30997e975 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:48.202340 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7dd9bff2-3b12-49af-9453-6ff30997e975 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:48.392390 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b7bed53b-e9f7-42fa-ac4f-6eb65adecab7 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] 10.222.0.33 "GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e/os-interface" status: 200 len: 1828 microversion: 2.42 time: 0.476374 Sep 23 04:40:48.393247 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1232/2497] 10.222.0.33 () {60 vars in 1316 bytes} [Fri Sep 23 04:40:47 2022] GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e/os-interface => generated 1828 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:40:48.400400 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-2e791a0f-bd29-4e3f-856b-5a0416994c5f req-44cc9bb9-fc72-4362-bd3f-a68ec8041ad7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f77bb6f0-6ce7-40d8-9cb2-2fcb559353ac", "name": "network-vif-deleted", "tag": "f109c520-e5ff-40d8-a820-4cc8e75e5e84"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:40:48.415272 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-2e791a0f-bd29-4e3f-856b-5a0416994c5f req-44cc9bb9-fc72-4362-bd3f-a68ec8041ad7 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:48.415272 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-2e791a0f-bd29-4e3f-856b-5a0416994c5f req-44cc9bb9-fc72-4362-bd3f-a68ec8041ad7 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:48.415272 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-2e791a0f-bd29-4e3f-856b-5a0416994c5f req-44cc9bb9-fc72-4362-bd3f-a68ec8041ad7 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:48.426661 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-2e791a0f-bd29-4e3f-856b-5a0416994c5f req-44cc9bb9-fc72-4362-bd3f-a68ec8041ad7 service nova] Creating event network-vif-deleted:f109c520-e5ff-40d8-a820-4cc8e75e5e84 for instance f77bb6f0-6ce7-40d8-9cb2-2fcb559353ac on n-h1-846463-3 Sep 23 04:40:48.441176 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-2e791a0f-bd29-4e3f-856b-5a0416994c5f req-44cc9bb9-fc72-4362-bd3f-a68ec8041ad7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046437 Sep 23 04:40:48.442310 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1233/2498] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:40:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:40:48.448520 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-087a10e7-3a6c-4617-a01e-7b4f1ebdf99f tempest-FloatingIPsTestJSON-1066831830 tempest-FloatingIPsTestJSON-1066831830-project] Calling method '.version_select at 0x7ff1baadb3a0>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:50.302881 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-7dd9bff2-3b12-49af-9453-6ff30997e975 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:50.322719 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-7dd9bff2-3b12-49af-9453-6ff30997e975 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/42fe539b-6665-43fb-b7a2-bc8a6f2c65d5" status: 200 len: 1524 microversion: 2.1 time: 2.175684 Sep 23 04:40:50.326928 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1266/2499] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:40:48 2022] GET /compute/v2.1/servers/42fe539b-6665-43fb-b7a2-bc8a6f2c65d5 => generated 1524 bytes in 2180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:40:50.339644 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9e150a3f-68bf-4285-af4c-1455e3eeae2b tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:50.343865 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-9e150a3f-68bf-4285-af4c-1455e3eeae2b tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:50.364359 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9e150a3f-68bf-4285-af4c-1455e3eeae2b tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:50.366546 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9e150a3f-68bf-4285-af4c-1455e3eeae2b tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:50.367251 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9e150a3f-68bf-4285-af4c-1455e3eeae2b tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:50.376825 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9e150a3f-68bf-4285-af4c-1455e3eeae2b tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:50.377586 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9e150a3f-68bf-4285-af4c-1455e3eeae2b tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:50.385444 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9e150a3f-68bf-4285-af4c-1455e3eeae2b tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:50.532211 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-9e150a3f-68bf-4285-af4c-1455e3eeae2b tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:50.541980 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-9e150a3f-68bf-4285-af4c-1455e3eeae2b tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:50.547766 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-9e150a3f-68bf-4285-af4c-1455e3eeae2b tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:50.559411 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-9e150a3f-68bf-4285-af4c-1455e3eeae2b tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1486 microversion: 2.91 time: 0.230830 Sep 23 04:40:50.564771 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1267/2500] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:40:50 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1486 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:40:50.574029 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-31e8aec1-8f5d-4e9e-b1e6-0d513d59ba81 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:50.577576 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-31e8aec1-8f5d-4e9e-b1e6-0d513d59ba81 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] [instance: f77bb6f0-6ce7-40d8-9cb2-2fcb559353ac] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:50.586721 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-31e8aec1-8f5d-4e9e-b1e6-0d513d59ba81 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:50.590480 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-31e8aec1-8f5d-4e9e-b1e6-0d513d59ba81 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:50.594149 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-31e8aec1-8f5d-4e9e-b1e6-0d513d59ba81 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:50.597852 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-31e8aec1-8f5d-4e9e-b1e6-0d513d59ba81 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:50.598594 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-31e8aec1-8f5d-4e9e-b1e6-0d513d59ba81 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:50.604446 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-31e8aec1-8f5d-4e9e-b1e6-0d513d59ba81 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:50.633131 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-31e8aec1-8f5d-4e9e-b1e6-0d513d59ba81 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] HTTP exception thrown: Instance f77bb6f0-6ce7-40d8-9cb2-2fcb559353ac could not be found. Sep 23 04:40:50.639500 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-31e8aec1-8f5d-4e9e-b1e6-0d513d59ba81 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Request method failure captured: Sep 23 04:40:50.639500 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/f77bb6f0-6ce7-40d8-9cb2-2fcb559353ac HTTP/1.1 Sep 23 04:40:50.639500 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:40:50.639500 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:40:50.639500 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:40:50.639500 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:40:50.639500 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:40:50.639500 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:40:50.639500 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:40:50.639500 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:40:50.639500 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTcNAuuAvcMSzeRfNMub4GatrGaNFAdVjoyngK1TY5in1YZ6QNGRYPH5v55GVnDmBMF0sLhf8Sr5c0HFc7yDQLOpgvmmOrzz5EcjVod5YyYFmG_VsP9JTCpR9IKnz3i4uGS6U8OvbA0E0OQ4o-5_pXC0QM_YyWBYZ-V5XzE_FtxBeVo Sep 23 04:40:50.639500 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:40:50.639500 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:40:50.639500 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:40:50.639500 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:40:50.639500 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:40:50.639500 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:40:50.639500 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 004af70c9f9a43c4a7be8136268e98f9 Sep 23 04:40:50.639500 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-LiveMigrationTest-630802414 Sep 23 04:40:50.639500 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:40:50.639500 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:40:50.639500 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_004af70c9f9a43c4a7be8136268e98f9", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/004af70c9f9a43c4a7be8136268e98f9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/004af70c9f9a43c4a7be8136268e98f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "tempest-type-1451344989", "name": "tempest-service-1652784468", "endpoints": []}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/004af70c9f9a43c4a7be8136268e98f9"}]}, {"type": "tempest-type-1029636837", "name": "tempest-service-1633719024", "endpoints": [{"region": "tempest-region-1560816386", "publicURL": "https://url-1076501004.com"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:40:50.639500 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-LiveMigrationTest-630802414 Sep 23 04:40:50.639500 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 004af70c9f9a43c4a7be8136268e98f9 Sep 23 04:40:50.639500 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-LiveMigrationTest-630802414 Sep 23 04:40:50.639500 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-LiveMigrationTest-630802414-project Sep 23 04:40:50.639500 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:40:50.639500 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:40:50.639500 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 82d04a55ba72452995e3b156325e0890 Sep 23 04:40:50.639500 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-LiveMigrationTest-630802414-project Sep 23 04:40:50.639500 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:40:50.639500 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance f77bb6f0-6ce7-40d8-9cb2-2fcb559353ac could not be found. Sep 23 04:40:50.639500 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': 'f77bb6f0-6ce7-40d8-9cb2-2fcb559353ac'} Sep 23 04:40:50.639500 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:40:50.639500 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:40:50.639500 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:40:50.639500 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:40:50.639500 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:40:50.639500 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:40:50.639500 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:40:50.639500 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:40:50.639500 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:40:50.639500 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:40:50.639500 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f77bb6f0-6ce7-40d8-9cb2-2fcb559353ac could not be found. Sep 23 04:40:50.639500 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:40:50.639500 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:40:50.639500 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:40:50.639500 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:40:50.639500 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:40:50.639500 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:40:50.639500 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:40:50.639500 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:40:50.639500 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:40:50.639500 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:40:50.639500 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:40:50.639500 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:40:50.639500 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:40:50.639500 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:40:50.639500 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:40:50.639500 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:40:50.639500 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f77bb6f0-6ce7-40d8-9cb2-2fcb559353ac could not be found. Sep 23 04:40:50.643871 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:40:50.643871 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:40:50.643871 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:40:50.643871 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:40:50.643871 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:40:50.643871 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:40:50.643871 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:40:50.643871 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:40:50.643871 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f77bb6f0-6ce7-40d8-9cb2-2fcb559353ac could not be found. Sep 23 04:40:50.643871 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:40:50.647948 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-31e8aec1-8f5d-4e9e-b1e6-0d513d59ba81 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] Returning 404 to user: Instance f77bb6f0-6ce7-40d8-9cb2-2fcb559353ac could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:40:50.649692 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-31e8aec1-8f5d-4e9e-b1e6-0d513d59ba81 tempest-LiveMigrationTest-630802414 tempest-LiveMigrationTest-630802414-project] 10.222.0.33 "GET /compute/v2.1/servers/f77bb6f0-6ce7-40d8-9cb2-2fcb559353ac" status: 404 len: 111 microversion: 2.1 time: 0.083647 Sep 23 04:40:50.662984 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1268/2501] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:40:50 2022] GET /compute/v2.1/servers/f77bb6f0-6ce7-40d8-9cb2-2fcb559353ac => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:40:51.348956 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-06f70099-0f9a-4859-93ea-683f79576f9d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:51.349700 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-06f70099-0f9a-4859-93ea-683f79576f9d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 42fe539b-6665-43fb-b7a2-bc8a6f2c65d5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:51.364892 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-06f70099-0f9a-4859-93ea-683f79576f9d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:51.365977 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-06f70099-0f9a-4859-93ea-683f79576f9d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:51.365977 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-06f70099-0f9a-4859-93ea-683f79576f9d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:51.366617 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-06f70099-0f9a-4859-93ea-683f79576f9d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:51.367448 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-06f70099-0f9a-4859-93ea-683f79576f9d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:51.367448 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-06f70099-0f9a-4859-93ea-683f79576f9d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:52.009671 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-06f70099-0f9a-4859-93ea-683f79576f9d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:52.025090 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-06f70099-0f9a-4859-93ea-683f79576f9d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/42fe539b-6665-43fb-b7a2-bc8a6f2c65d5" status: 200 len: 1524 microversion: 2.1 time: 0.675933 Sep 23 04:40:52.025090 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1269/2502] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:40:51 2022] GET /compute/v2.1/servers/42fe539b-6665-43fb-b7a2-bc8a6f2c65d5 => generated 1524 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:40:52.060343 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-02625739-5cc6-42c3-af80-779a6bfbd42f tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:52.061045 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-02625739-5cc6-42c3-af80-779a6bfbd42f tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:52.094479 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-02625739-5cc6-42c3-af80-779a6bfbd42f tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:52.095077 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-02625739-5cc6-42c3-af80-779a6bfbd42f tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:52.104376 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-02625739-5cc6-42c3-af80-779a6bfbd42f tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:52.105311 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-02625739-5cc6-42c3-af80-779a6bfbd42f tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:52.108950 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-02625739-5cc6-42c3-af80-779a6bfbd42f tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:52.110159 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-02625739-5cc6-42c3-af80-779a6bfbd42f tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:52.548562 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-02625739-5cc6-42c3-af80-779a6bfbd42f tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:52.559155 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-02625739-5cc6-42c3-af80-779a6bfbd42f tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:52.565920 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-02625739-5cc6-42c3-af80-779a6bfbd42f tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:52.584767 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-02625739-5cc6-42c3-af80-779a6bfbd42f tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1486 microversion: 2.91 time: 0.561891 Sep 23 04:40:52.588347 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1270/2503] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:40:52 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1486 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:40:52.774079 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b522308d-8e54-413f-80b0-969bfbb3734f tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-846136178", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:40:53.665577 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-087a10e7-3a6c-4617-a01e-7b4f1ebdf99f tempest-FloatingIPsTestJSON-1066831830 tempest-FloatingIPsTestJSON-1066831830-project] 10.222.0.33 "DELETE /compute/v2.1/os-floating-ips/7f60e3e4-ee8e-4f1b-804d-eb534674c17c" status: 202 len: 0 microversion: 2.1 time: 5.221813 Sep 23 04:40:53.670814 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1234/2504] 10.222.0.33 () {58 vars in 1263 bytes} [Fri Sep 23 04:40:48 2022] DELETE /compute/v2.1/os-floating-ips/7f60e3e4-ee8e-4f1b-804d-eb534674c17c => generated 0 bytes in 5223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:40:53.675284 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a024a7e9-9579-499f-82ab-d2cdf816493f tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:53.682508 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a024a7e9-9579-499f-82ab-d2cdf816493f tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 42fe539b-6665-43fb-b7a2-bc8a6f2c65d5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:53.720327 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a024a7e9-9579-499f-82ab-d2cdf816493f tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:53.721907 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a024a7e9-9579-499f-82ab-d2cdf816493f tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:53.722708 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a024a7e9-9579-499f-82ab-d2cdf816493f tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:53.728319 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a024a7e9-9579-499f-82ab-d2cdf816493f tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:53.729590 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a024a7e9-9579-499f-82ab-d2cdf816493f tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:53.732887 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a024a7e9-9579-499f-82ab-d2cdf816493f tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:54.750089 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a024a7e9-9579-499f-82ab-d2cdf816493f tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:54.761685 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a024a7e9-9579-499f-82ab-d2cdf816493f tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/42fe539b-6665-43fb-b7a2-bc8a6f2c65d5" status: 200 len: 1524 microversion: 2.1 time: 1.093572 Sep 23 04:40:54.763875 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1235/2505] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:40:53 2022] GET /compute/v2.1/servers/42fe539b-6665-43fb-b7a2-bc8a6f2c65d5 => generated 1524 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:40:54.779942 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-31102914-471c-4275-9791-2f40dc059a1c tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:54.786652 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-31102914-471c-4275-9791-2f40dc059a1c tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:54.796906 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-31102914-471c-4275-9791-2f40dc059a1c tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:54.800491 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-31102914-471c-4275-9791-2f40dc059a1c tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:54.801034 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-31102914-471c-4275-9791-2f40dc059a1c tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:54.804133 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-31102914-471c-4275-9791-2f40dc059a1c tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:54.804710 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-31102914-471c-4275-9791-2f40dc059a1c tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:54.806702 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-31102914-471c-4275-9791-2f40dc059a1c tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:55.039907 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-31102914-471c-4275-9791-2f40dc059a1c tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:55.068496 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-31102914-471c-4275-9791-2f40dc059a1c tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:55.077801 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-31102914-471c-4275-9791-2f40dc059a1c tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:55.103092 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-31102914-471c-4275-9791-2f40dc059a1c tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1486 microversion: 2.91 time: 0.334878 Sep 23 04:40:55.108883 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1236/2506] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:40:54 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1486 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:40:55.125111 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-82248ee7-8df7-4897-9312-d52de8e145f6 tempest-FloatingIPsTestJSON-1066831830 tempest-FloatingIPsTestJSON-1066831830-project] Calling method '.version_select at 0x7ff1bab08ee0>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:55.260982 n-d-846463-3 devstack@n-api.service[122698]: DEBUG neutronclient.v2_0.client [None req-82248ee7-8df7-4897-9312-d52de8e145f6 tempest-FloatingIPsTestJSON-1066831830 tempest-FloatingIPsTestJSON-1066831830-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 7f60e3e4-ee8e-4f1b-804d-eb534674c17c could not be found", "detail": ""}} {{(pid=122698) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 23 04:40:55.260982 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-82248ee7-8df7-4897-9312-d52de8e145f6 tempest-FloatingIPsTestJSON-1066831830 tempest-FloatingIPsTestJSON-1066831830-project] HTTP exception thrown: Floating IP not found for ID 7f60e3e4-ee8e-4f1b-804d-eb534674c17c Sep 23 04:40:55.260982 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-82248ee7-8df7-4897-9312-d52de8e145f6 tempest-FloatingIPsTestJSON-1066831830 tempest-FloatingIPsTestJSON-1066831830-project] Request method failure captured: Sep 23 04:40:55.260982 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/os-floating-ips/7f60e3e4-ee8e-4f1b-804d-eb534674c17c HTTP/1.1 Sep 23 04:40:55.260982 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:40:55.260982 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:40:55.260982 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:40:55.260982 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:40:55.260982 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:40:55.260982 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:40:55.260982 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:40:55.260982 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:40:55.260982 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTi7i7yXG9yU1wCgopGtZDeCQsto4R6UseVWUvdglxMBmLBNJULBUWHqynEeIIi1dSptMATS_wkKcsR4Bi5V6F--NNvj9K91JhA3_IuHOiTN_hujeV4ogCJ4aoDO-9RA0louOfM5eHdMivO2yhThj4XNaF3ORUbQ620nfaKrKf9qSqE Sep 23 04:40:55.260982 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:40:55.260982 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:40:55.260982 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:40:55.260982 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:40:55.260982 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:40:55.260982 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:40:55.260982 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: a6a96b36f06547c18063e936d3730678 Sep 23 04:40:55.260982 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-FloatingIPsTestJSON-1066831830 Sep 23 04:40:55.260982 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:40:55.260982 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:40:55.260982 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a6a96b36f06547c18063e936d3730678", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a6a96b36f06547c18063e936d3730678"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a6a96b36f06547c18063e936d3730678"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a6a96b36f06547c18063e936d3730678"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:40:55.260982 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-FloatingIPsTestJSON-1066831830 Sep 23 04:40:55.260982 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: a6a96b36f06547c18063e936d3730678 Sep 23 04:40:55.260982 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1066831830 Sep 23 04:40:55.260982 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-FloatingIPsTestJSON-1066831830-project Sep 23 04:40:55.260982 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:40:55.260982 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:40:55.260982 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 5f737c85e8144e9dac8118165e1c5b72 Sep 23 04:40:55.260982 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-FloatingIPsTestJSON-1066831830-project Sep 23 04:40:55.260982 n-d-846463-3 devstack@n-api.service[122698]: method: Sep 23 04:40:55.260982 n-d-846463-3 devstack@n-api.service[122698]: exception: Floating IP not found for ID 7f60e3e4-ee8e-4f1b-804d-eb534674c17c Sep 23 04:40:55.260982 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '7f60e3e4-ee8e-4f1b-804d-eb534674c17c'} Sep 23 04:40:55.260982 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:40:55.260982 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:40:55.260982 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Sep 23 04:40:55.260982 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Sep 23 04:40:55.260982 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:40:55.260982 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:40:55.260982 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Sep 23 04:40:55.260982 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Sep 23 04:40:55.260982 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:40:55.260982 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:40:55.260982 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 23 04:40:55.260982 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 23 04:40:55.260982 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:40:55.260982 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:40:55.260982 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 23 04:40:55.260982 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 23 04:40:55.260982 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:40:55.260982 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:40:55.260982 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 23 04:40:55.260982 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 23 04:40:55.260982 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:40:55.260982 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:40:55.268213 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 23 04:40:55.268213 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 23 04:40:55.268213 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 23 04:40:55.268213 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 23 04:40:55.268213 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 7f60e3e4-ee8e-4f1b-804d-eb534674c17c could not be found Sep 23 04:40:55.268213 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c4783e87-86ce-43a0-892a-078d526a33e2'] Sep 23 04:40:55.268213 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:40:55.268213 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:40:55.268213 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:40:55.268213 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:40:55.268213 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Sep 23 04:40:55.268213 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Sep 23 04:40:55.268213 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Sep 23 04:40:55.268213 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Sep 23 04:40:55.268213 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 7f60e3e4-ee8e-4f1b-804d-eb534674c17c. Sep 23 04:40:55.268213 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:40:55.268213 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:40:55.268213 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:40:55.268213 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:40:55.268213 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:40:55.268213 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:40:55.268213 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:40:55.268213 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:40:55.268213 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:40:55.268213 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:40:55.268213 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:40:55.268213 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:40:55.268213 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Sep 23 04:40:55.268213 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 23 04:40:55.268213 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 7f60e3e4-ee8e-4f1b-804d-eb534674c17c Sep 23 04:40:55.268213 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:40:55.268213 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:40:55.268213 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:40:55.268213 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:40:55.268213 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:40:55.268213 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:40:55.268213 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:40:55.268213 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:40:55.268213 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 7f60e3e4-ee8e-4f1b-804d-eb534674c17c Sep 23 04:40:55.268213 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:40:55.268213 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-82248ee7-8df7-4897-9312-d52de8e145f6 tempest-FloatingIPsTestJSON-1066831830 tempest-FloatingIPsTestJSON-1066831830-project] Returning 404 to user: Floating IP not found for ID 7f60e3e4-ee8e-4f1b-804d-eb534674c17c {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:40:55.268213 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-82248ee7-8df7-4897-9312-d52de8e145f6 tempest-FloatingIPsTestJSON-1066831830 tempest-FloatingIPsTestJSON-1066831830-project] 10.222.0.33 "GET /compute/v2.1/os-floating-ips/7f60e3e4-ee8e-4f1b-804d-eb534674c17c" status: 404 len: 111 microversion: 2.1 time: 0.151822 Sep 23 04:40:55.268213 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1237/2507] 10.222.0.33 () {58 vars in 1260 bytes} [Fri Sep 23 04:40:55 2022] GET /compute/v2.1/os-floating-ips/7f60e3e4-ee8e-4f1b-804d-eb534674c17c => generated 111 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:40:55.271592 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6856ef29-ac8c-41c8-a62f-d96f5723bfdc tempest-FloatingIPsTestJSON-1066831830 tempest-FloatingIPsTestJSON-1066831830-project] Calling method '.version_select at 0x7ff1baa890d0>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:55.467930 n-d-846463-3 devstack@n-api.service[122698]: DEBUG neutronclient.v2_0.client [None req-6856ef29-ac8c-41c8-a62f-d96f5723bfdc tempest-FloatingIPsTestJSON-1066831830 tempest-FloatingIPsTestJSON-1066831830-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 7f60e3e4-ee8e-4f1b-804d-eb534674c17c could not be found", "detail": ""}} {{(pid=122698) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 23 04:40:55.468623 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-6856ef29-ac8c-41c8-a62f-d96f5723bfdc tempest-FloatingIPsTestJSON-1066831830 tempest-FloatingIPsTestJSON-1066831830-project] HTTP exception thrown: Floating IP not found for ID 7f60e3e4-ee8e-4f1b-804d-eb534674c17c Sep 23 04:40:55.470652 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6856ef29-ac8c-41c8-a62f-d96f5723bfdc tempest-FloatingIPsTestJSON-1066831830 tempest-FloatingIPsTestJSON-1066831830-project] Request method failure captured: Sep 23 04:40:55.470652 n-d-846463-3 devstack@n-api.service[122698]: request: DELETE /compute/v2.1/os-floating-ips/7f60e3e4-ee8e-4f1b-804d-eb534674c17c HTTP/1.1 Sep 23 04:40:55.470652 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:40:55.470652 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:40:55.470652 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:40:55.470652 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:40:55.470652 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:40:55.470652 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:40:55.470652 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:40:55.470652 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:40:55.470652 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTi7i7yXG9yU1wCgopGtZDeCQsto4R6UseVWUvdglxMBmLBNJULBUWHqynEeIIi1dSptMATS_wkKcsR4Bi5V6F--NNvj9K91JhA3_IuHOiTN_hujeV4ogCJ4aoDO-9RA0louOfM5eHdMivO2yhThj4XNaF3ORUbQ620nfaKrKf9qSqE Sep 23 04:40:55.470652 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:40:55.470652 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:40:55.470652 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:40:55.470652 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:40:55.470652 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:40:55.470652 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:40:55.470652 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: a6a96b36f06547c18063e936d3730678 Sep 23 04:40:55.470652 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-FloatingIPsTestJSON-1066831830 Sep 23 04:40:55.470652 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:40:55.470652 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:40:55.470652 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a6a96b36f06547c18063e936d3730678", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a6a96b36f06547c18063e936d3730678"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a6a96b36f06547c18063e936d3730678"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a6a96b36f06547c18063e936d3730678"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:40:55.470652 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-FloatingIPsTestJSON-1066831830 Sep 23 04:40:55.470652 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: a6a96b36f06547c18063e936d3730678 Sep 23 04:40:55.470652 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1066831830 Sep 23 04:40:55.470652 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-FloatingIPsTestJSON-1066831830-project Sep 23 04:40:55.470652 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:40:55.470652 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:40:55.470652 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 5f737c85e8144e9dac8118165e1c5b72 Sep 23 04:40:55.470652 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-FloatingIPsTestJSON-1066831830-project Sep 23 04:40:55.470652 n-d-846463-3 devstack@n-api.service[122698]: method: Sep 23 04:40:55.470652 n-d-846463-3 devstack@n-api.service[122698]: exception: Floating IP not found for ID 7f60e3e4-ee8e-4f1b-804d-eb534674c17c Sep 23 04:40:55.470652 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '7f60e3e4-ee8e-4f1b-804d-eb534674c17c'} Sep 23 04:40:55.470652 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:40:55.470652 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:40:55.470652 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Sep 23 04:40:55.470652 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Sep 23 04:40:55.470652 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:40:55.470652 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:40:55.470652 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Sep 23 04:40:55.470652 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Sep 23 04:40:55.470652 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:40:55.470652 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:40:55.470652 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 23 04:40:55.470652 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 23 04:40:55.470652 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:40:55.470652 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:40:55.470652 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 23 04:40:55.470652 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 23 04:40:55.470652 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:40:55.470652 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:40:55.470652 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 23 04:40:55.470652 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 23 04:40:55.470652 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:40:55.470652 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:40:55.470652 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 23 04:40:55.470652 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 23 04:40:55.470652 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 23 04:40:55.470652 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 23 04:40:55.470652 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 7f60e3e4-ee8e-4f1b-804d-eb534674c17c could not be found Sep 23 04:40:55.470652 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2cc4d4ae-6fd7-44be-8989-91997ddc7db0'] Sep 23 04:40:55.470652 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:40:55.473956 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:40:55.473956 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:40:55.473956 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:40:55.473956 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Sep 23 04:40:55.473956 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Sep 23 04:40:55.473956 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Sep 23 04:40:55.473956 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Sep 23 04:40:55.473956 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 7f60e3e4-ee8e-4f1b-804d-eb534674c17c. Sep 23 04:40:55.473956 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:40:55.473956 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:40:55.473956 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:40:55.473956 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:40:55.473956 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:40:55.473956 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:40:55.473956 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:40:55.473956 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:40:55.473956 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:40:55.473956 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:40:55.473956 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:40:55.473956 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:40:55.473956 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Sep 23 04:40:55.473956 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 23 04:40:55.473956 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 7f60e3e4-ee8e-4f1b-804d-eb534674c17c Sep 23 04:40:55.473956 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:40:55.473956 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:40:55.473956 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:40:55.473956 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:40:55.473956 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:40:55.473956 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:40:55.473956 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:40:55.473956 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:40:55.473956 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 7f60e3e4-ee8e-4f1b-804d-eb534674c17c Sep 23 04:40:55.473956 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:40:55.473956 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6856ef29-ac8c-41c8-a62f-d96f5723bfdc tempest-FloatingIPsTestJSON-1066831830 tempest-FloatingIPsTestJSON-1066831830-project] Returning 404 to user: Floating IP not found for ID 7f60e3e4-ee8e-4f1b-804d-eb534674c17c {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:40:55.473956 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-6856ef29-ac8c-41c8-a62f-d96f5723bfdc tempest-FloatingIPsTestJSON-1066831830 tempest-FloatingIPsTestJSON-1066831830-project] 10.222.0.33 "DELETE /compute/v2.1/os-floating-ips/7f60e3e4-ee8e-4f1b-804d-eb534674c17c" status: 404 len: 111 microversion: 2.1 time: 0.204318 Sep 23 04:40:55.482178 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1238/2508] 10.222.0.33 () {58 vars in 1263 bytes} [Fri Sep 23 04:40:55 2022] DELETE /compute/v2.1/os-floating-ips/7f60e3e4-ee8e-4f1b-804d-eb534674c17c => generated 111 bytes in 215 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:40:55.732174 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.neutron [None req-b522308d-8e54-413f-80b0-969bfbb3734f tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] validate_networks() for [('915287f6-aa15-4992-ac36-33c87673d394', None, None, None, None, None)] {{(pid=122699) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:40:55.874188 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-30432acd-bd67-4b97-8200-ba9d0f4b4de4 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Action: 'create', calling method: .version_select at 0x7ff1baa85dc0>, body: {"keypair": {"name": "tempest-keypair-2000032787", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPw4FraBEW4xy1uz9kgDoOuiqgqprRlLYmbchGx0hRJLFF1cDnEnolHdIktMOSMCnl+S9qaVhYFF7Z3HePJCgRESWW8qkm3HlUEcuXACWY1u9+M6PYfASUjyFME9Jomdtw=="}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:40:55.922180 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-30432acd-bd67-4b97-8200-ba9d0f4b4de4 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Getting quotas for project ddf77b55dfd8452e949229e4eb085283. Resources: {'key_pairs'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:40:55.930066 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-30432acd-bd67-4b97-8200-ba9d0f4b4de4 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Getting quotas for user 542c9592c76c4d4b9f3f16cea354398d and project ddf77b55dfd8452e949229e4eb085283. Resources: {'key_pairs'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:40:56.028863 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-30432acd-bd67-4b97-8200-ba9d0f4b4de4 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.453847 Sep 23 04:40:56.030487 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1239/2509] 10.222.0.33 () {60 vars in 1159 bytes} [Fri Sep 23 04:40:55 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:40:56.037580 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-70158707-7a25-4751-b48f-acb28a528747 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:56.038700 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-70158707-7a25-4751-b48f-acb28a528747 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 42fe539b-6665-43fb-b7a2-bc8a6f2c65d5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:56.048105 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-70158707-7a25-4751-b48f-acb28a528747 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:56.051092 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-70158707-7a25-4751-b48f-acb28a528747 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:56.051092 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-70158707-7a25-4751-b48f-acb28a528747 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:56.051092 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-70158707-7a25-4751-b48f-acb28a528747 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:56.051092 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-70158707-7a25-4751-b48f-acb28a528747 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:56.051912 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-70158707-7a25-4751-b48f-acb28a528747 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:56.589086 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-70158707-7a25-4751-b48f-acb28a528747 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:56.598242 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-70158707-7a25-4751-b48f-acb28a528747 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/42fe539b-6665-43fb-b7a2-bc8a6f2c65d5" status: 200 len: 1524 microversion: 2.1 time: 0.566333 Sep 23 04:40:56.606047 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1240/2510] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:40:56 2022] GET /compute/v2.1/servers/42fe539b-6665-43fb-b7a2-bc8a6f2c65d5 => generated 1524 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:40:56.611140 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4074939c-710d-44d3-bd55-f4d069128a36 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:56.612135 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4074939c-710d-44d3-bd55-f4d069128a36 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:56.640550 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4074939c-710d-44d3-bd55-f4d069128a36 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:56.642264 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4074939c-710d-44d3-bd55-f4d069128a36 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:56.643582 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4074939c-710d-44d3-bd55-f4d069128a36 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:56.645927 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4074939c-710d-44d3-bd55-f4d069128a36 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:56.647172 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4074939c-710d-44d3-bd55-f4d069128a36 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:56.648957 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4074939c-710d-44d3-bd55-f4d069128a36 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:56.778512 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4074939c-710d-44d3-bd55-f4d069128a36 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:56.797269 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4074939c-710d-44d3-bd55-f4d069128a36 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:56.798980 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4074939c-710d-44d3-bd55-f4d069128a36 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:56.804425 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4074939c-710d-44d3-bd55-f4d069128a36 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1486 microversion: 2.91 time: 0.197177 Sep 23 04:40:56.830894 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1241/2511] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:40:56 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1486 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:40:57.356572 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-b522308d-8e54-413f-80b0-969bfbb3734f tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Flavor limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:40:57.357644 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-b522308d-8e54-413f-80b0-969bfbb3734f tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Image limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:40:57.358153 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-b522308d-8e54-413f-80b0-969bfbb3734f tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Flavor pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:40:57.358567 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-b522308d-8e54-413f-80b0-969bfbb3734f tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Image pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:40:57.359091 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-b522308d-8e54-413f-80b0-969bfbb3734f tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:40:57.375779 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b522308d-8e54-413f-80b0-969bfbb3734f tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:57.375910 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b522308d-8e54-413f-80b0-969bfbb3734f tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:57.376295 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b522308d-8e54-413f-80b0-969bfbb3734f tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:57.377019 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b522308d-8e54-413f-80b0-969bfbb3734f tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:57.391106 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b522308d-8e54-413f-80b0-969bfbb3734f tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:57.399245 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b522308d-8e54-413f-80b0-969bfbb3734f tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:57.456085 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-b522308d-8e54-413f-80b0-969bfbb3734f tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Getting quotas for project f7a16a53325a4d61aef94281435e9726. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:40:57.482764 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-b522308d-8e54-413f-80b0-969bfbb3734f tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Getting quotas for user ace08d8e105e46e299773c5a1b96039f and project f7a16a53325a4d61aef94281435e9726. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:40:57.548612 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b522308d-8e54-413f-80b0-969bfbb3734f tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Going to run 1 instances... {{(pid=122699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:40:57.553971 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b522308d-8e54-413f-80b0-969bfbb3734f tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] [instance: 5ee8a1da-f229-4716-bc67-da23f07963bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:40:57.633070 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8da2cd60-b347-4023-823f-b9c415d1519b tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:57.633792 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8da2cd60-b347-4023-823f-b9c415d1519b tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 42fe539b-6665-43fb-b7a2-bc8a6f2c65d5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:57.657092 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8da2cd60-b347-4023-823f-b9c415d1519b tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:57.657595 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8da2cd60-b347-4023-823f-b9c415d1519b tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:57.658067 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8da2cd60-b347-4023-823f-b9c415d1519b tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:57.658779 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8da2cd60-b347-4023-823f-b9c415d1519b tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:57.659238 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8da2cd60-b347-4023-823f-b9c415d1519b tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:57.659687 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8da2cd60-b347-4023-823f-b9c415d1519b tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:57.768473 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b522308d-8e54-413f-80b0-969bfbb3734f tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.163321 Sep 23 04:40:57.772445 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1271/2512] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:40:52 2022] POST /compute/v2.1/servers => generated 383 bytes in 5168 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:40:57.792735 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-63eba19b-ce90-46fd-8657-2c2cc1ac4461 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:57.794620 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-63eba19b-ce90-46fd-8657-2c2cc1ac4461 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] [instance: 5ee8a1da-f229-4716-bc67-da23f07963bd] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:57.926459 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-63eba19b-ce90-46fd-8657-2c2cc1ac4461 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace08d8e105e46e299773c5a1b96039f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a16a53325a4d61aef94281435e9726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:57.938448 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-63eba19b-ce90-46fd-8657-2c2cc1ac4461 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] 10.222.0.33 "GET /compute/v2.1/servers/5ee8a1da-f229-4716-bc67-da23f07963bd" status: 200 len: 1222 microversion: 2.1 time: 0.159997 Sep 23 04:40:57.944384 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1272/2513] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:40:57 2022] GET /compute/v2.1/servers/5ee8a1da-f229-4716-bc67-da23f07963bd => generated 1222 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:40:57.962818 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-49f63a7f-a5b3-4cd7-b3e8-a4dcde92f1e1 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:57.968854 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-49f63a7f-a5b3-4cd7-b3e8-a4dcde92f1e1 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:57.994754 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-49f63a7f-a5b3-4cd7-b3e8-a4dcde92f1e1 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:57.995321 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-49f63a7f-a5b3-4cd7-b3e8-a4dcde92f1e1 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:57.998111 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-49f63a7f-a5b3-4cd7-b3e8-a4dcde92f1e1 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:57.999056 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-49f63a7f-a5b3-4cd7-b3e8-a4dcde92f1e1 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:58.001468 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-49f63a7f-a5b3-4cd7-b3e8-a4dcde92f1e1 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:58.005742 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-49f63a7f-a5b3-4cd7-b3e8-a4dcde92f1e1 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:58.122764 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-49f63a7f-a5b3-4cd7-b3e8-a4dcde92f1e1 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:58.126907 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:40:58.141177 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-49f63a7f-a5b3-4cd7-b3e8-a4dcde92f1e1 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:58.164145 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-49f63a7f-a5b3-4cd7-b3e8-a4dcde92f1e1 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:58.199066 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-49f63a7f-a5b3-4cd7-b3e8-a4dcde92f1e1 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1488 microversion: 2.91 time: 0.253474 Sep 23 04:40:58.199684 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1273/2514] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:40:57 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1488 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:40:58.206963 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8da2cd60-b347-4023-823f-b9c415d1519b tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:58.219385 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8da2cd60-b347-4023-823f-b9c415d1519b tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/42fe539b-6665-43fb-b7a2-bc8a6f2c65d5" status: 200 len: 1524 microversion: 2.1 time: 0.588666 Sep 23 04:40:58.236122 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1242/2515] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:40:57 2022] GET /compute/v2.1/servers/42fe539b-6665-43fb-b7a2-bc8a6f2c65d5 => generated 1524 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:40:58.964851 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-812f026c-2421-4790-bedb-51984bcc8bb5 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:58.965482 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-812f026c-2421-4790-bedb-51984bcc8bb5 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] [instance: 5ee8a1da-f229-4716-bc67-da23f07963bd] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:59.233449 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b62273f4-fdfd-460d-8962-a2151341f2b5 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:59.234082 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b62273f4-fdfd-460d-8962-a2151341f2b5 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:59.250538 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b62273f4-fdfd-460d-8962-a2151341f2b5 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:59.250755 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-812f026c-2421-4790-bedb-51984bcc8bb5 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace08d8e105e46e299773c5a1b96039f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a16a53325a4d61aef94281435e9726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:59.251091 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b62273f4-fdfd-460d-8962-a2151341f2b5 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:59.251549 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b62273f4-fdfd-460d-8962-a2151341f2b5 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:59.252299 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b62273f4-fdfd-460d-8962-a2151341f2b5 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:59.252765 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b62273f4-fdfd-460d-8962-a2151341f2b5 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:59.256179 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b62273f4-fdfd-460d-8962-a2151341f2b5 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:59.260794 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-812f026c-2421-4790-bedb-51984bcc8bb5 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] 10.222.0.33 "GET /compute/v2.1/servers/5ee8a1da-f229-4716-bc67-da23f07963bd" status: 200 len: 1222 microversion: 2.1 time: 0.299428 Sep 23 04:40:59.269777 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1274/2516] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:40:58 2022] GET /compute/v2.1/servers/5ee8a1da-f229-4716-bc67-da23f07963bd => generated 1222 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:40:59.269777 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-cee35acc-1551-4326-97d7-0cd36c08f0d3 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:40:59.269777 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-cee35acc-1551-4326-97d7-0cd36c08f0d3 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 42fe539b-6665-43fb-b7a2-bc8a6f2c65d5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:40:59.296322 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cee35acc-1551-4326-97d7-0cd36c08f0d3 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:59.296840 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cee35acc-1551-4326-97d7-0cd36c08f0d3 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:59.297505 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cee35acc-1551-4326-97d7-0cd36c08f0d3 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:59.298331 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cee35acc-1551-4326-97d7-0cd36c08f0d3 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:40:59.298843 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cee35acc-1551-4326-97d7-0cd36c08f0d3 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:40:59.299350 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cee35acc-1551-4326-97d7-0cd36c08f0d3 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:40:59.775781 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b62273f4-fdfd-460d-8962-a2151341f2b5 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:59.785767 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b62273f4-fdfd-460d-8962-a2151341f2b5 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:59.787773 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b62273f4-fdfd-460d-8962-a2151341f2b5 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:40:59.793617 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b62273f4-fdfd-460d-8962-a2151341f2b5 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1544 microversion: 2.91 time: 0.565460 Sep 23 04:40:59.794930 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1243/2517] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:40:59 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1544 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:41:00.096932 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-cee35acc-1551-4326-97d7-0cd36c08f0d3 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:00.106061 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-cee35acc-1551-4326-97d7-0cd36c08f0d3 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/42fe539b-6665-43fb-b7a2-bc8a6f2c65d5" status: 200 len: 1524 microversion: 2.1 time: 0.843001 Sep 23 04:41:00.107348 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1275/2518] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:40:59 2022] GET /compute/v2.1/servers/42fe539b-6665-43fb-b7a2-bc8a6f2c65d5 => generated 1524 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:00.287777 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-cd61ad66-ebae-499e-bc8e-fad1e02d921f tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:00.298142 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-cd61ad66-ebae-499e-bc8e-fad1e02d921f tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] [instance: 5ee8a1da-f229-4716-bc67-da23f07963bd] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:00.301142 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cd61ad66-ebae-499e-bc8e-fad1e02d921f tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:00.304417 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cd61ad66-ebae-499e-bc8e-fad1e02d921f tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:00.305453 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cd61ad66-ebae-499e-bc8e-fad1e02d921f tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:00.309209 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cd61ad66-ebae-499e-bc8e-fad1e02d921f tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:00.310077 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cd61ad66-ebae-499e-bc8e-fad1e02d921f tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:00.310736 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cd61ad66-ebae-499e-bc8e-fad1e02d921f tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:00.501202 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-cd61ad66-ebae-499e-bc8e-fad1e02d921f tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace08d8e105e46e299773c5a1b96039f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a16a53325a4d61aef94281435e9726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:00.528901 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-cd61ad66-ebae-499e-bc8e-fad1e02d921f tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] 10.222.0.33 "GET /compute/v2.1/servers/5ee8a1da-f229-4716-bc67-da23f07963bd" status: 200 len: 1226 microversion: 2.1 time: 0.234748 Sep 23 04:41:00.536997 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1244/2519] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:00 2022] GET /compute/v2.1/servers/5ee8a1da-f229-4716-bc67-da23f07963bd => generated 1226 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:00.853252 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d28d1c57-a5f2-4494-8362-1c2d7519bcaf tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:00.857448 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d28d1c57-a5f2-4494-8362-1c2d7519bcaf tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:00.878562 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d28d1c57-a5f2-4494-8362-1c2d7519bcaf tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:00.879510 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d28d1c57-a5f2-4494-8362-1c2d7519bcaf tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:00.879619 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d28d1c57-a5f2-4494-8362-1c2d7519bcaf tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:00.883559 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d28d1c57-a5f2-4494-8362-1c2d7519bcaf tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:00.884630 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d28d1c57-a5f2-4494-8362-1c2d7519bcaf tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:00.887554 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d28d1c57-a5f2-4494-8362-1c2d7519bcaf tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:01.131286 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8fb8218f-0808-4984-8cf2-3668ded7ab90 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:01.131912 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8fb8218f-0808-4984-8cf2-3668ded7ab90 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 42fe539b-6665-43fb-b7a2-bc8a6f2c65d5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:01.147281 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8fb8218f-0808-4984-8cf2-3668ded7ab90 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:01.147862 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8fb8218f-0808-4984-8cf2-3668ded7ab90 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:01.148420 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8fb8218f-0808-4984-8cf2-3668ded7ab90 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:01.149307 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8fb8218f-0808-4984-8cf2-3668ded7ab90 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:01.151057 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8fb8218f-0808-4984-8cf2-3668ded7ab90 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:01.154018 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8fb8218f-0808-4984-8cf2-3668ded7ab90 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:01.208298 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d28d1c57-a5f2-4494-8362-1c2d7519bcaf tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:01.284564 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d28d1c57-a5f2-4494-8362-1c2d7519bcaf tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:01.291233 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d28d1c57-a5f2-4494-8362-1c2d7519bcaf tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:01.310842 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d28d1c57-a5f2-4494-8362-1c2d7519bcaf tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1544 microversion: 2.91 time: 0.486797 Sep 23 04:41:01.313504 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1276/2520] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:41:00 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1544 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:41:01.560307 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-693113fe-504c-40f3-887a-bf2787047346 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:01.560975 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-693113fe-504c-40f3-887a-bf2787047346 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] [instance: 5ee8a1da-f229-4716-bc67-da23f07963bd] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:01.578644 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-693113fe-504c-40f3-887a-bf2787047346 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:01.582476 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-693113fe-504c-40f3-887a-bf2787047346 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:01.583921 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-693113fe-504c-40f3-887a-bf2787047346 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:01.591784 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-693113fe-504c-40f3-887a-bf2787047346 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:01.592700 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-693113fe-504c-40f3-887a-bf2787047346 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:01.593308 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-693113fe-504c-40f3-887a-bf2787047346 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:01.650882 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8fb8218f-0808-4984-8cf2-3668ded7ab90 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:01.680597 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8fb8218f-0808-4984-8cf2-3668ded7ab90 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/42fe539b-6665-43fb-b7a2-bc8a6f2c65d5" status: 200 len: 1506 microversion: 2.1 time: 0.551972 Sep 23 04:41:01.681594 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1245/2521] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:01 2022] GET /compute/v2.1/servers/42fe539b-6665-43fb-b7a2-bc8a6f2c65d5 => generated 1506 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:01.725655 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-693113fe-504c-40f3-887a-bf2787047346 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace08d8e105e46e299773c5a1b96039f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a16a53325a4d61aef94281435e9726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:01.740275 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-693113fe-504c-40f3-887a-bf2787047346 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] 10.222.0.33 "GET /compute/v2.1/servers/5ee8a1da-f229-4716-bc67-da23f07963bd" status: 200 len: 1274 microversion: 2.1 time: 0.184294 Sep 23 04:41:01.743414 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1277/2522] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:01 2022] GET /compute/v2.1/servers/5ee8a1da-f229-4716-bc67-da23f07963bd => generated 1274 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:41:02.343174 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-94f66de7-bcd7-4b0f-a530-497cd666018d tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:02.343801 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-94f66de7-bcd7-4b0f-a530-497cd666018d tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:02.356449 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-94f66de7-bcd7-4b0f-a530-497cd666018d tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:02.356967 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-94f66de7-bcd7-4b0f-a530-497cd666018d tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:02.357545 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-94f66de7-bcd7-4b0f-a530-497cd666018d tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:02.358471 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-94f66de7-bcd7-4b0f-a530-497cd666018d tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:02.359150 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-94f66de7-bcd7-4b0f-a530-497cd666018d tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:02.359913 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-94f66de7-bcd7-4b0f-a530-497cd666018d tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:02.625143 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-94f66de7-bcd7-4b0f-a530-497cd666018d tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:02.648317 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-94f66de7-bcd7-4b0f-a530-497cd666018d tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:02.653639 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-94f66de7-bcd7-4b0f-a530-497cd666018d tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:02.665073 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-94f66de7-bcd7-4b0f-a530-497cd666018d tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1544 microversion: 2.91 time: 0.326767 Sep 23 04:41:02.666758 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1246/2523] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:41:02 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1544 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:41:02.708463 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-bca0c019-d037-4644-bde0-76c095d9f93d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:02.709931 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-bca0c019-d037-4644-bde0-76c095d9f93d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 42fe539b-6665-43fb-b7a2-bc8a6f2c65d5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:02.724692 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bca0c019-d037-4644-bde0-76c095d9f93d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:02.725473 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bca0c019-d037-4644-bde0-76c095d9f93d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:02.726110 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bca0c019-d037-4644-bde0-76c095d9f93d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:02.731760 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bca0c019-d037-4644-bde0-76c095d9f93d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:02.732308 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bca0c019-d037-4644-bde0-76c095d9f93d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:02.733462 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bca0c019-d037-4644-bde0-76c095d9f93d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:02.747904 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-2d83ec7f-3268-4cf6-bf53-6a914168e7a6 req-d5e55417-a34d-402f-b883-b61e7389ed22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42fe539b-6665-43fb-b7a2-bc8a6f2c65d5", "name": "network-vif-unplugged", "status": "completed", "tag": "612a667a-9f5d-490a-b4df-3250d5946428"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:41:02.769020 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-2d83ec7f-3268-4cf6-bf53-6a914168e7a6 req-d5e55417-a34d-402f-b883-b61e7389ed22 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:02.769922 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-2d83ec7f-3268-4cf6-bf53-6a914168e7a6 req-d5e55417-a34d-402f-b883-b61e7389ed22 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:02.772102 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-2d83ec7f-3268-4cf6-bf53-6a914168e7a6 req-d5e55417-a34d-402f-b883-b61e7389ed22 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:02.793549 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-2d83ec7f-3268-4cf6-bf53-6a914168e7a6 req-d5e55417-a34d-402f-b883-b61e7389ed22 service nova] Creating event network-vif-unplugged:612a667a-9f5d-490a-b4df-3250d5946428 for instance 42fe539b-6665-43fb-b7a2-bc8a6f2c65d5 on n-h2-846463-3 Sep 23 04:41:02.801436 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-2d83ec7f-3268-4cf6-bf53-6a914168e7a6 req-d5e55417-a34d-402f-b883-b61e7389ed22 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.062316 Sep 23 04:41:02.806217 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1247/2524] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:41:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:41:02.842137 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8000be2a-ce85-4e0a-a72a-647e0b06ae82 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:02.842874 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8000be2a-ce85-4e0a-a72a-647e0b06ae82 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] [instance: 5ee8a1da-f229-4716-bc67-da23f07963bd] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:02.870521 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8000be2a-ce85-4e0a-a72a-647e0b06ae82 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:02.871046 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8000be2a-ce85-4e0a-a72a-647e0b06ae82 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:02.871494 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8000be2a-ce85-4e0a-a72a-647e0b06ae82 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:02.872277 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8000be2a-ce85-4e0a-a72a-647e0b06ae82 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:02.872693 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8000be2a-ce85-4e0a-a72a-647e0b06ae82 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:02.876890 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8000be2a-ce85-4e0a-a72a-647e0b06ae82 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:03.106153 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8000be2a-ce85-4e0a-a72a-647e0b06ae82 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace08d8e105e46e299773c5a1b96039f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a16a53325a4d61aef94281435e9726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:03.126445 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8000be2a-ce85-4e0a-a72a-647e0b06ae82 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] 10.222.0.33 "GET /compute/v2.1/servers/5ee8a1da-f229-4716-bc67-da23f07963bd" status: 200 len: 1292 microversion: 2.1 time: 0.320503 Sep 23 04:41:03.127693 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1248/2525] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:02 2022] GET /compute/v2.1/servers/5ee8a1da-f229-4716-bc67-da23f07963bd => generated 1292 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:03.240981 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-bca0c019-d037-4644-bde0-76c095d9f93d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:03.258116 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-bca0c019-d037-4644-bde0-76c095d9f93d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/42fe539b-6665-43fb-b7a2-bc8a6f2c65d5" status: 200 len: 1506 microversion: 2.1 time: 0.553692 Sep 23 04:41:03.258755 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1278/2526] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:02 2022] GET /compute/v2.1/servers/42fe539b-6665-43fb-b7a2-bc8a6f2c65d5 => generated 1506 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:41:03.697081 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4445b464-ba0a-4856-a89f-4fef37edfcbe tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:03.698286 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4445b464-ba0a-4856-a89f-4fef37edfcbe tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:03.705771 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4445b464-ba0a-4856-a89f-4fef37edfcbe tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:03.706301 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4445b464-ba0a-4856-a89f-4fef37edfcbe tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:03.706745 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4445b464-ba0a-4856-a89f-4fef37edfcbe tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:03.716341 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4445b464-ba0a-4856-a89f-4fef37edfcbe tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:03.717159 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4445b464-ba0a-4856-a89f-4fef37edfcbe tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:03.717804 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4445b464-ba0a-4856-a89f-4fef37edfcbe tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:04.016322 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4445b464-ba0a-4856-a89f-4fef37edfcbe tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:04.052172 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4445b464-ba0a-4856-a89f-4fef37edfcbe tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:04.055401 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4445b464-ba0a-4856-a89f-4fef37edfcbe tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:04.084088 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4445b464-ba0a-4856-a89f-4fef37edfcbe tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1544 microversion: 2.91 time: 0.388305 Sep 23 04:41:04.084889 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1249/2527] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:41:03 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1544 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:41:04.155518 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-fcf8156f-95b4-4884-9b4c-86ae314c343d tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:04.156742 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-fcf8156f-95b4-4884-9b4c-86ae314c343d tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] [instance: 5ee8a1da-f229-4716-bc67-da23f07963bd] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:04.175254 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fcf8156f-95b4-4884-9b4c-86ae314c343d tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:04.176389 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fcf8156f-95b4-4884-9b4c-86ae314c343d tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:04.176885 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fcf8156f-95b4-4884-9b4c-86ae314c343d tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:04.177880 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fcf8156f-95b4-4884-9b4c-86ae314c343d tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:04.178495 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fcf8156f-95b4-4884-9b4c-86ae314c343d tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:04.178938 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fcf8156f-95b4-4884-9b4c-86ae314c343d tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:04.291604 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8c4a8f9f-f0cc-4e04-88a7-aa0e1c697647 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:04.292994 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8c4a8f9f-f0cc-4e04-88a7-aa0e1c697647 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 42fe539b-6665-43fb-b7a2-bc8a6f2c65d5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:04.312525 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8c4a8f9f-f0cc-4e04-88a7-aa0e1c697647 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:04.313035 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8c4a8f9f-f0cc-4e04-88a7-aa0e1c697647 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:04.314639 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-fcf8156f-95b4-4884-9b4c-86ae314c343d tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace08d8e105e46e299773c5a1b96039f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a16a53325a4d61aef94281435e9726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:04.322717 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8c4a8f9f-f0cc-4e04-88a7-aa0e1c697647 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:04.325259 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8c4a8f9f-f0cc-4e04-88a7-aa0e1c697647 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:04.326394 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8c4a8f9f-f0cc-4e04-88a7-aa0e1c697647 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:04.327736 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-fcf8156f-95b4-4884-9b4c-86ae314c343d tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] 10.222.0.33 "GET /compute/v2.1/servers/5ee8a1da-f229-4716-bc67-da23f07963bd" status: 200 len: 1280 microversion: 2.1 time: 0.172263 Sep 23 04:41:04.328483 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8c4a8f9f-f0cc-4e04-88a7-aa0e1c697647 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:04.329114 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1279/2528] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:04 2022] GET /compute/v2.1/servers/5ee8a1da-f229-4716-bc67-da23f07963bd => generated 1280 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:04.673241 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8c4a8f9f-f0cc-4e04-88a7-aa0e1c697647 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:04.680727 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8c4a8f9f-f0cc-4e04-88a7-aa0e1c697647 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/42fe539b-6665-43fb-b7a2-bc8a6f2c65d5" status: 200 len: 1506 microversion: 2.1 time: 0.401792 Sep 23 04:41:04.692307 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1250/2529] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:04 2022] GET /compute/v2.1/servers/42fe539b-6665-43fb-b7a2-bc8a6f2c65d5 => generated 1506 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:41:05.117665 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f4f1990b-6da9-48e0-9b6f-9475878fd257 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:05.118421 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f4f1990b-6da9-48e0-9b6f-9475878fd257 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:05.134437 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:41:05.138911 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f4f1990b-6da9-48e0-9b6f-9475878fd257 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:05.139714 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f4f1990b-6da9-48e0-9b6f-9475878fd257 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:05.140168 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f4f1990b-6da9-48e0-9b6f-9475878fd257 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:05.141067 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f4f1990b-6da9-48e0-9b6f-9475878fd257 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:05.141578 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f4f1990b-6da9-48e0-9b6f-9475878fd257 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:05.142200 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f4f1990b-6da9-48e0-9b6f-9475878fd257 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:05.251716 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f4f1990b-6da9-48e0-9b6f-9475878fd257 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:05.266582 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f4f1990b-6da9-48e0-9b6f-9475878fd257 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:05.269078 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f4f1990b-6da9-48e0-9b6f-9475878fd257 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:05.289759 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-249b8935-25fa-4111-8526-15c484c50dde tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1445537429", "imageRef": "e16f841f-0fe9-4481-bd59-5f617cee9208", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "e836fa68-2c30-47b2-8b60-cac7bd69dfc5"}], "security_groups": [{"name": "tempest-securitygroup--827154675"}], "key_name": "tempest-keypair-2000032787", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:41:05.298278 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f4f1990b-6da9-48e0-9b6f-9475878fd257 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1544 microversion: 2.91 time: 0.183260 Sep 23 04:41:05.299089 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1280/2530] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:41:05 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1544 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:41:05.357821 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-fb06d963-fd68-4bc6-a372-9b2a85a6ff65 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:05.358941 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-fb06d963-fd68-4bc6-a372-9b2a85a6ff65 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] [instance: 5ee8a1da-f229-4716-bc67-da23f07963bd] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:05.367019 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fb06d963-fd68-4bc6-a372-9b2a85a6ff65 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:05.367960 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fb06d963-fd68-4bc6-a372-9b2a85a6ff65 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:05.368721 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fb06d963-fd68-4bc6-a372-9b2a85a6ff65 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:05.370620 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fb06d963-fd68-4bc6-a372-9b2a85a6ff65 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:05.372660 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fb06d963-fd68-4bc6-a372-9b2a85a6ff65 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:05.373583 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fb06d963-fd68-4bc6-a372-9b2a85a6ff65 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:05.511700 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-fb06d963-fd68-4bc6-a372-9b2a85a6ff65 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace08d8e105e46e299773c5a1b96039f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a16a53325a4d61aef94281435e9726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:05.523758 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-fb06d963-fd68-4bc6-a372-9b2a85a6ff65 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] 10.222.0.33 "GET /compute/v2.1/servers/5ee8a1da-f229-4716-bc67-da23f07963bd" status: 200 len: 1280 microversion: 2.1 time: 0.172064 Sep 23 04:41:05.524321 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1281/2531] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:05 2022] GET /compute/v2.1/servers/5ee8a1da-f229-4716-bc67-da23f07963bd => generated 1280 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:05.564448 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.network.neutron [None req-249b8935-25fa-4111-8526-15c484c50dde tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] validate_networks() for [('e836fa68-2c30-47b2-8b60-cac7bd69dfc5', None, None, None, None, None)] {{(pid=122698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:41:05.705152 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-739882a0-c87e-42e4-823d-6907831d9478 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:05.706045 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-739882a0-c87e-42e4-823d-6907831d9478 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 42fe539b-6665-43fb-b7a2-bc8a6f2c65d5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:05.721473 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-739882a0-c87e-42e4-823d-6907831d9478 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:05.721473 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-739882a0-c87e-42e4-823d-6907831d9478 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:05.721473 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-739882a0-c87e-42e4-823d-6907831d9478 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:05.722312 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-739882a0-c87e-42e4-823d-6907831d9478 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:05.722908 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-739882a0-c87e-42e4-823d-6907831d9478 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:05.733469 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-739882a0-c87e-42e4-823d-6907831d9478 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:05.943430 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=4 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:41:06.497264 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-739882a0-c87e-42e4-823d-6907831d9478 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:06.511454 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-739882a0-c87e-42e4-823d-6907831d9478 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/42fe539b-6665-43fb-b7a2-bc8a6f2c65d5" status: 200 len: 1509 microversion: 2.1 time: 0.810525 Sep 23 04:41:06.524697 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1282/2532] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:05 2022] GET /compute/v2.1/servers/42fe539b-6665-43fb-b7a2-bc8a6f2c65d5 => generated 1509 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:06.542429 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a1b4d9cf-b1b0-485d-b740-a758dce86294 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:06.547909 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a1b4d9cf-b1b0-485d-b740-a758dce86294 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:06.561508 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a1b4d9cf-b1b0-485d-b740-a758dce86294 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:06.562055 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a1b4d9cf-b1b0-485d-b740-a758dce86294 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:06.562562 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a1b4d9cf-b1b0-485d-b740-a758dce86294 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:06.563274 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a1b4d9cf-b1b0-485d-b740-a758dce86294 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:06.563743 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a1b4d9cf-b1b0-485d-b740-a758dce86294 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:06.564169 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a1b4d9cf-b1b0-485d-b740-a758dce86294 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:06.870961 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a1b4d9cf-b1b0-485d-b740-a758dce86294 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:06.882616 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a1b4d9cf-b1b0-485d-b740-a758dce86294 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:06.884605 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a1b4d9cf-b1b0-485d-b740-a758dce86294 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:06.907909 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a1b4d9cf-b1b0-485d-b740-a758dce86294 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1544 microversion: 2.91 time: 0.379809 Sep 23 04:41:06.925586 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1283/2533] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:41:06 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1544 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:41:06.942130 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1fc793ed-5b7c-4266-9a71-53664a818f47 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:06.942636 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1fc793ed-5b7c-4266-9a71-53664a818f47 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 42fe539b-6665-43fb-b7a2-bc8a6f2c65d5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:06.958086 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1fc793ed-5b7c-4266-9a71-53664a818f47 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:06.962658 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1fc793ed-5b7c-4266-9a71-53664a818f47 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:06.963372 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1fc793ed-5b7c-4266-9a71-53664a818f47 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:06.967406 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1fc793ed-5b7c-4266-9a71-53664a818f47 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:06.968079 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1fc793ed-5b7c-4266-9a71-53664a818f47 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:06.976710 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1fc793ed-5b7c-4266-9a71-53664a818f47 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:07.046629 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1fc793ed-5b7c-4266-9a71-53664a818f47 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 42fe539b-6665-43fb-b7a2-bc8a6f2c65d5] Going to try to terminate instance {{(pid=122699) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:41:07.066519 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.compute.api [None req-1fc793ed-5b7c-4266-9a71-53664a818f47 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 42fe539b-6665-43fb-b7a2-bc8a6f2c65d5] Working on deleting snapshot d939be86-fa8d-4777-b219-179df3d269f7 from shelved instance... Sep 23 04:41:07.426631 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:41:07.657839 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-249b8935-25fa-4111-8526-15c484c50dde tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Flavor limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:41:07.658592 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-249b8935-25fa-4111-8526-15c484c50dde tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Image limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:41:07.659741 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-249b8935-25fa-4111-8526-15c484c50dde tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Flavor pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:41:07.660747 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-249b8935-25fa-4111-8526-15c484c50dde tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Image pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:41:07.661746 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-249b8935-25fa-4111-8526-15c484c50dde tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:41:07.683209 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-249b8935-25fa-4111-8526-15c484c50dde tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:07.684192 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-249b8935-25fa-4111-8526-15c484c50dde tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:07.685841 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-249b8935-25fa-4111-8526-15c484c50dde tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:07.688008 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-249b8935-25fa-4111-8526-15c484c50dde tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:07.688976 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-249b8935-25fa-4111-8526-15c484c50dde tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:07.689582 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-249b8935-25fa-4111-8526-15c484c50dde tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:07.736199 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-249b8935-25fa-4111-8526-15c484c50dde tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Getting quotas for project ddf77b55dfd8452e949229e4eb085283. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:41:07.754463 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-249b8935-25fa-4111-8526-15c484c50dde tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Getting quotas for user 542c9592c76c4d4b9f3f16cea354398d and project ddf77b55dfd8452e949229e4eb085283. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:41:07.778956 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-249b8935-25fa-4111-8526-15c484c50dde tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Going to run 1 instances... {{(pid=122698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:41:07.788873 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-249b8935-25fa-4111-8526-15c484c50dde tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] [instance: dfb8f504-218a-471c-b7a8-70c498769f0e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e16f841f-0fe9-4481-bd59-5f617cee9208',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:41:07.997021 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-249b8935-25fa-4111-8526-15c484c50dde tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.712376 Sep 23 04:41:08.006067 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1251/2534] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:41:05 2022] POST /compute/v2.1/servers => generated 405 bytes in 2722 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 23 04:41:08.012747 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d5256a6a-1ede-4537-a098-66ae283cf2a5 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:08.013788 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d5256a6a-1ede-4537-a098-66ae283cf2a5 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] [instance: 5ee8a1da-f229-4716-bc67-da23f07963bd] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:08.024217 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d5256a6a-1ede-4537-a098-66ae283cf2a5 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:08.029551 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d5256a6a-1ede-4537-a098-66ae283cf2a5 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:08.029551 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d5256a6a-1ede-4537-a098-66ae283cf2a5 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:08.029551 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d5256a6a-1ede-4537-a098-66ae283cf2a5 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:08.029551 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d5256a6a-1ede-4537-a098-66ae283cf2a5 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:08.029551 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d5256a6a-1ede-4537-a098-66ae283cf2a5 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:08.031558 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=100 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:41:09.121883 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d5256a6a-1ede-4537-a098-66ae283cf2a5 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace08d8e105e46e299773c5a1b96039f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a16a53325a4d61aef94281435e9726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:09.129941 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d5256a6a-1ede-4537-a098-66ae283cf2a5 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] 10.222.0.33 "GET /compute/v2.1/servers/5ee8a1da-f229-4716-bc67-da23f07963bd" status: 200 len: 1322 microversion: 2.1 time: 1.122436 Sep 23 04:41:09.130525 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1252/2535] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:08 2022] GET /compute/v2.1/servers/5ee8a1da-f229-4716-bc67-da23f07963bd => generated 1322 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:09.157127 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2f1a536e-af24-44ea-aa36-90778e17aaa1 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:09.160259 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-2f1a536e-af24-44ea-aa36-90778e17aaa1 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:09.172666 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2f1a536e-af24-44ea-aa36-90778e17aaa1 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:09.175187 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2f1a536e-af24-44ea-aa36-90778e17aaa1 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:09.175873 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2f1a536e-af24-44ea-aa36-90778e17aaa1 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:09.176827 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2f1a536e-af24-44ea-aa36-90778e17aaa1 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:09.177507 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2f1a536e-af24-44ea-aa36-90778e17aaa1 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:09.178228 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2f1a536e-af24-44ea-aa36-90778e17aaa1 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:09.256575 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=10 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:41:09.413042 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-2f1a536e-af24-44ea-aa36-90778e17aaa1 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:09.426614 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-2f1a536e-af24-44ea-aa36-90778e17aaa1 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:09.428084 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-2f1a536e-af24-44ea-aa36-90778e17aaa1 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:09.442342 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2f1a536e-af24-44ea-aa36-90778e17aaa1 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1544 microversion: 2.91 time: 0.306646 Sep 23 04:41:09.443244 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1253/2536] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:41:09 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1544 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:41:09.448681 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-85d77a3c-acf5-4e33-9efe-909741b8391f tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:09.452022 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-85d77a3c-acf5-4e33-9efe-909741b8391f tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] [instance: dfb8f504-218a-471c-b7a8-70c498769f0e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:09.601925 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-85d77a3c-acf5-4e33-9efe-909741b8391f tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542c9592c76c4d4b9f3f16cea354398d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf77b55dfd8452e949229e4eb085283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:09.613695 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-85d77a3c-acf5-4e33-9efe-909741b8391f tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] 10.222.0.33 "GET /compute/v2.1/servers/dfb8f504-218a-471c-b7a8-70c498769f0e" status: 200 len: 1246 microversion: 2.1 time: 0.169145 Sep 23 04:41:09.631059 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1254/2537] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:09 2022] GET /compute/v2.1/servers/dfb8f504-218a-471c-b7a8-70c498769f0e => generated 1246 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:09.747411 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-53b8c6fc-7565-4a24-ba37-5e58866c4691 req-e2958d97-eb7a-4e8f-a6f5-09549892fd45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ee8a1da-f229-4716-bc67-da23f07963bd", "tag": "f9285902-d382-442c-88b6-fad3f3a0ebcc"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:41:09.784097 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-53b8c6fc-7565-4a24-ba37-5e58866c4691 req-e2958d97-eb7a-4e8f-a6f5-09549892fd45 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:09.785168 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-53b8c6fc-7565-4a24-ba37-5e58866c4691 req-e2958d97-eb7a-4e8f-a6f5-09549892fd45 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:09.787109 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-53b8c6fc-7565-4a24-ba37-5e58866c4691 req-e2958d97-eb7a-4e8f-a6f5-09549892fd45 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:09.818149 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-53b8c6fc-7565-4a24-ba37-5e58866c4691 req-e2958d97-eb7a-4e8f-a6f5-09549892fd45 service nova] Creating event network-changed:f9285902-d382-442c-88b6-fad3f3a0ebcc for instance 5ee8a1da-f229-4716-bc67-da23f07963bd on n-h1-846463-3 Sep 23 04:41:09.829416 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-53b8c6fc-7565-4a24-ba37-5e58866c4691 req-e2958d97-eb7a-4e8f-a6f5-09549892fd45 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090371 Sep 23 04:41:09.830958 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1255/2538] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:41:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:41:10.164398 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-402aebe9-2966-435e-8c61-f5de904085da tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:10.165126 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-402aebe9-2966-435e-8c61-f5de904085da tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] [instance: 5ee8a1da-f229-4716-bc67-da23f07963bd] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:10.190603 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-402aebe9-2966-435e-8c61-f5de904085da tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:10.192599 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-402aebe9-2966-435e-8c61-f5de904085da tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:10.193782 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-402aebe9-2966-435e-8c61-f5de904085da tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:10.200899 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-402aebe9-2966-435e-8c61-f5de904085da tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:10.201659 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-402aebe9-2966-435e-8c61-f5de904085da tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:10.216149 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-402aebe9-2966-435e-8c61-f5de904085da tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:10.472241 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1fc793ed-5b7c-4266-9a71-53664a818f47 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 42fe539b-6665-43fb-b7a2-bc8a6f2c65d5] Doing local delete in cell feac528b-4983-4e61-aae7-f1973fe5bc2c(cell1) {{(pid=122699) _delete /opt/stack/nova/nova/compute/api.py:2546}} Sep 23 04:41:10.473798 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1fc793ed-5b7c-4266-9a71-53664a818f47 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:10.474654 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1fc793ed-5b7c-4266-9a71-53664a818f47 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:10.493547 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1fc793ed-5b7c-4266-9a71-53664a818f47 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:10.494478 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.compute.api [None req-1fc793ed-5b7c-4266-9a71-53664a818f47 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 42fe539b-6665-43fb-b7a2-bc8a6f2c65d5] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Sep 23 04:41:10.501292 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.neutron [None req-1fc793ed-5b7c-4266-9a71-53664a818f47 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 42fe539b-6665-43fb-b7a2-bc8a6f2c65d5] deallocate_for_instance() {{(pid=122699) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Sep 23 04:41:10.520581 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-402aebe9-2966-435e-8c61-f5de904085da tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace08d8e105e46e299773c5a1b96039f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a16a53325a4d61aef94281435e9726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:10.540043 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-402aebe9-2966-435e-8c61-f5de904085da tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] 10.222.0.33 "GET /compute/v2.1/servers/5ee8a1da-f229-4716-bc67-da23f07963bd" status: 200 len: 1322 microversion: 2.1 time: 0.383785 Sep 23 04:41:10.545544 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1256/2539] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:10 2022] GET /compute/v2.1/servers/5ee8a1da-f229-4716-bc67-da23f07963bd => generated 1322 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:41:10.551615 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d67291a7-4275-4571-8f62-799053db50d4 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:10.555710 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d67291a7-4275-4571-8f62-799053db50d4 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:10.560289 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d67291a7-4275-4571-8f62-799053db50d4 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:10.561024 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d67291a7-4275-4571-8f62-799053db50d4 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:10.563957 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d67291a7-4275-4571-8f62-799053db50d4 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:10.565291 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d67291a7-4275-4571-8f62-799053db50d4 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:10.566175 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d67291a7-4275-4571-8f62-799053db50d4 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:10.567924 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d67291a7-4275-4571-8f62-799053db50d4 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:10.683405 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d67291a7-4275-4571-8f62-799053db50d4 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:10.694374 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d67291a7-4275-4571-8f62-799053db50d4 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:10.695956 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d67291a7-4275-4571-8f62-799053db50d4 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:10.702725 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d67291a7-4275-4571-8f62-799053db50d4 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1544 microversion: 2.91 time: 0.155063 Sep 23 04:41:10.703859 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1257/2540] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:41:10 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1544 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:41:10.709274 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-82ff4400-f15f-4445-b5e4-10b4a2e29035 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:10.709913 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-82ff4400-f15f-4445-b5e4-10b4a2e29035 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] [instance: dfb8f504-218a-471c-b7a8-70c498769f0e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:10.716520 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-82ff4400-f15f-4445-b5e4-10b4a2e29035 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:10.717209 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-82ff4400-f15f-4445-b5e4-10b4a2e29035 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:10.717674 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-82ff4400-f15f-4445-b5e4-10b4a2e29035 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:10.718689 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-82ff4400-f15f-4445-b5e4-10b4a2e29035 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:10.719292 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-82ff4400-f15f-4445-b5e4-10b4a2e29035 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:10.719893 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-82ff4400-f15f-4445-b5e4-10b4a2e29035 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:10.904925 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-82ff4400-f15f-4445-b5e4-10b4a2e29035 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542c9592c76c4d4b9f3f16cea354398d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf77b55dfd8452e949229e4eb085283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:10.918392 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-82ff4400-f15f-4445-b5e4-10b4a2e29035 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] 10.222.0.33 "GET /compute/v2.1/servers/dfb8f504-218a-471c-b7a8-70c498769f0e" status: 200 len: 1242 microversion: 2.1 time: 0.213368 Sep 23 04:41:10.919235 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1258/2541] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:10 2022] GET /compute/v2.1/servers/dfb8f504-218a-471c-b7a8-70c498769f0e => generated 1242 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:11.570572 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e7cc8874-0d5b-40c8-aa4a-cbbd12c7b090 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:11.571233 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e7cc8874-0d5b-40c8-aa4a-cbbd12c7b090 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] [instance: 5ee8a1da-f229-4716-bc67-da23f07963bd] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:11.585836 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e7cc8874-0d5b-40c8-aa4a-cbbd12c7b090 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:11.586451 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e7cc8874-0d5b-40c8-aa4a-cbbd12c7b090 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:11.586928 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e7cc8874-0d5b-40c8-aa4a-cbbd12c7b090 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:11.588330 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e7cc8874-0d5b-40c8-aa4a-cbbd12c7b090 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:11.588834 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e7cc8874-0d5b-40c8-aa4a-cbbd12c7b090 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:11.589281 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e7cc8874-0d5b-40c8-aa4a-cbbd12c7b090 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:11.915139 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e7cc8874-0d5b-40c8-aa4a-cbbd12c7b090 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace08d8e105e46e299773c5a1b96039f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a16a53325a4d61aef94281435e9726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:11.927205 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e7cc8874-0d5b-40c8-aa4a-cbbd12c7b090 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] 10.222.0.33 "GET /compute/v2.1/servers/5ee8a1da-f229-4716-bc67-da23f07963bd" status: 200 len: 1322 microversion: 2.1 time: 0.361988 Sep 23 04:41:11.944820 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1259/2542] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:11 2022] GET /compute/v2.1/servers/5ee8a1da-f229-4716-bc67-da23f07963bd => generated 1322 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:41:11.954278 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-216d0675-c3f1-49da-9d0a-41306cb29ff1 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:11.955098 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-216d0675-c3f1-49da-9d0a-41306cb29ff1 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:11.959776 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:41:11.972379 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-216d0675-c3f1-49da-9d0a-41306cb29ff1 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:11.972890 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-216d0675-c3f1-49da-9d0a-41306cb29ff1 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:11.973338 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-216d0675-c3f1-49da-9d0a-41306cb29ff1 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:11.974107 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-216d0675-c3f1-49da-9d0a-41306cb29ff1 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:11.974574 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-216d0675-c3f1-49da-9d0a-41306cb29ff1 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:11.975009 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-216d0675-c3f1-49da-9d0a-41306cb29ff1 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:12.054729 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-216d0675-c3f1-49da-9d0a-41306cb29ff1 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:12.063327 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-216d0675-c3f1-49da-9d0a-41306cb29ff1 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:12.064910 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-216d0675-c3f1-49da-9d0a-41306cb29ff1 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:12.071160 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-216d0675-c3f1-49da-9d0a-41306cb29ff1 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1544 microversion: 2.91 time: 0.126613 Sep 23 04:41:12.072256 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1260/2543] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:41:11 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1544 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:41:12.077613 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b771ccdf-f70d-4ce8-900f-44ccc0a9a8be tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:12.078468 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b771ccdf-f70d-4ce8-900f-44ccc0a9a8be tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] [instance: dfb8f504-218a-471c-b7a8-70c498769f0e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:12.084686 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b771ccdf-f70d-4ce8-900f-44ccc0a9a8be tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:12.085380 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b771ccdf-f70d-4ce8-900f-44ccc0a9a8be tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:12.086050 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b771ccdf-f70d-4ce8-900f-44ccc0a9a8be tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:12.087235 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b771ccdf-f70d-4ce8-900f-44ccc0a9a8be tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:12.088679 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b771ccdf-f70d-4ce8-900f-44ccc0a9a8be tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:12.089261 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b771ccdf-f70d-4ce8-900f-44ccc0a9a8be tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:12.160032 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b771ccdf-f70d-4ce8-900f-44ccc0a9a8be tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542c9592c76c4d4b9f3f16cea354398d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf77b55dfd8452e949229e4eb085283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:12.168118 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b771ccdf-f70d-4ce8-900f-44ccc0a9a8be tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] 10.222.0.33 "GET /compute/v2.1/servers/dfb8f504-218a-471c-b7a8-70c498769f0e" status: 200 len: 1298 microversion: 2.1 time: 0.094725 Sep 23 04:41:12.168682 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1261/2544] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:12 2022] GET /compute/v2.1/servers/dfb8f504-218a-471c-b7a8-70c498769f0e => generated 1298 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:12.553326 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.neutron [None req-1fc793ed-5b7c-4266-9a71-53664a818f47 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 42fe539b-6665-43fb-b7a2-bc8a6f2c65d5] Updating instance_info_cache with network_info: [] {{(pid=122699) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 23 04:41:12.866941 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-afa82d4c-b2e5-4cef-88ec-e92257019ca9 req-a8a96098-2250-4096-80d2-5e3085b0e7e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42fe539b-6665-43fb-b7a2-bc8a6f2c65d5", "name": "network-vif-deleted", "tag": "612a667a-9f5d-490a-b4df-3250d5946428"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:41:12.911512 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-afa82d4c-b2e5-4cef-88ec-e92257019ca9 req-a8a96098-2250-4096-80d2-5e3085b0e7e9 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:12.912006 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-afa82d4c-b2e5-4cef-88ec-e92257019ca9 req-a8a96098-2250-4096-80d2-5e3085b0e7e9 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:12.919793 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-afa82d4c-b2e5-4cef-88ec-e92257019ca9 req-a8a96098-2250-4096-80d2-5e3085b0e7e9 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:12.980231 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.compute.server_external_events [req-afa82d4c-b2e5-4cef-88ec-e92257019ca9 req-a8a96098-2250-4096-80d2-5e3085b0e7e9 service nova] Unable to find a host for instance 42fe539b-6665-43fb-b7a2-bc8a6f2c65d5. Dropping event network-vif-deleted {{(pid=122698) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 23 04:41:12.985104 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-afa82d4c-b2e5-4cef-88ec-e92257019ca9 req-a8a96098-2250-4096-80d2-5e3085b0e7e9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.501135 Sep 23 04:41:12.986023 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1262/2545] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:41:12 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 503 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Sep 23 04:41:13.114090 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-399461da-ddd3-4cd7-be99-64c050935db8 tempest-AZV2TestJSON-1952169089 tempest-AZV2TestJSON-1952169089-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:13.116540 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-399461da-ddd3-4cd7-be99-64c050935db8 tempest-AZV2TestJSON-1952169089 tempest-AZV2TestJSON-1952169089-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:13.116838 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-399461da-ddd3-4cd7-be99-64c050935db8 tempest-AZV2TestJSON-1952169089 tempest-AZV2TestJSON-1952169089-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:13.117474 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-399461da-ddd3-4cd7-be99-64c050935db8 tempest-AZV2TestJSON-1952169089 tempest-AZV2TestJSON-1952169089-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:13.118727 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-399461da-ddd3-4cd7-be99-64c050935db8 tempest-AZV2TestJSON-1952169089 tempest-AZV2TestJSON-1952169089-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:13.119502 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-399461da-ddd3-4cd7-be99-64c050935db8 tempest-AZV2TestJSON-1952169089 tempest-AZV2TestJSON-1952169089-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:13.120190 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-399461da-ddd3-4cd7-be99-64c050935db8 tempest-AZV2TestJSON-1952169089 tempest-AZV2TestJSON-1952169089-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:13.187962 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-399461da-ddd3-4cd7-be99-64c050935db8 tempest-AZV2TestJSON-1952169089 tempest-AZV2TestJSON-1952169089-project] 10.222.0.33 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.198975 Sep 23 04:41:13.194566 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1263/2546] 10.222.0.33 () {58 vars in 1164 bytes} [Fri Sep 23 04:41:12 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 04:41:13.233662 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-625fc315-c78b-4aa1-ad45-c168837525e2 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:13.234970 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-625fc315-c78b-4aa1-ad45-c168837525e2 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] [instance: 5ee8a1da-f229-4716-bc67-da23f07963bd] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:13.248100 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-625fc315-c78b-4aa1-ad45-c168837525e2 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:13.249942 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-625fc315-c78b-4aa1-ad45-c168837525e2 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:13.252203 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-625fc315-c78b-4aa1-ad45-c168837525e2 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:13.255267 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-625fc315-c78b-4aa1-ad45-c168837525e2 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:13.255960 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-625fc315-c78b-4aa1-ad45-c168837525e2 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:13.258050 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-625fc315-c78b-4aa1-ad45-c168837525e2 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:13.677483 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1fc793ed-5b7c-4266-9a71-53664a818f47 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "DELETE /compute/v2.1/servers/42fe539b-6665-43fb-b7a2-bc8a6f2c65d5" status: 204 len: 0 microversion: 2.1 time: 6.741753 Sep 23 04:41:13.679535 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1284/2547] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:41:06 2022] DELETE /compute/v2.1/servers/42fe539b-6665-43fb-b7a2-bc8a6f2c65d5 => generated 0 bytes in 6753 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:41:13.691333 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ce57687b-db1f-40b9-816d-5282c59ce791 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:13.691333 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ce57687b-db1f-40b9-816d-5282c59ce791 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:13.707449 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ce57687b-db1f-40b9-816d-5282c59ce791 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:13.708025 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ce57687b-db1f-40b9-816d-5282c59ce791 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:13.709707 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ce57687b-db1f-40b9-816d-5282c59ce791 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:13.711543 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ce57687b-db1f-40b9-816d-5282c59ce791 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:13.712530 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ce57687b-db1f-40b9-816d-5282c59ce791 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:13.714941 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ce57687b-db1f-40b9-816d-5282c59ce791 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:13.724926 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:41:13.787499 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-625fc315-c78b-4aa1-ad45-c168837525e2 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace08d8e105e46e299773c5a1b96039f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a16a53325a4d61aef94281435e9726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:13.799690 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-625fc315-c78b-4aa1-ad45-c168837525e2 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] 10.222.0.33 "GET /compute/v2.1/servers/5ee8a1da-f229-4716-bc67-da23f07963bd" status: 200 len: 1322 microversion: 2.1 time: 0.603169 Sep 23 04:41:13.804595 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1264/2548] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:13 2022] GET /compute/v2.1/servers/5ee8a1da-f229-4716-bc67-da23f07963bd => generated 1322 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:13.814001 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d503b683-4655-49f2-82fa-84a91b766b67 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:13.817592 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d503b683-4655-49f2-82fa-84a91b766b67 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] [instance: dfb8f504-218a-471c-b7a8-70c498769f0e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:13.830947 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d503b683-4655-49f2-82fa-84a91b766b67 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:13.835603 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d503b683-4655-49f2-82fa-84a91b766b67 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:13.835603 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d503b683-4655-49f2-82fa-84a91b766b67 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:13.835603 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d503b683-4655-49f2-82fa-84a91b766b67 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:13.836516 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d503b683-4655-49f2-82fa-84a91b766b67 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:13.837922 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d503b683-4655-49f2-82fa-84a91b766b67 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:14.072888 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ce57687b-db1f-40b9-816d-5282c59ce791 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:14.093984 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ce57687b-db1f-40b9-816d-5282c59ce791 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:14.096358 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ce57687b-db1f-40b9-816d-5282c59ce791 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:14.122358 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ce57687b-db1f-40b9-816d-5282c59ce791 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1544 microversion: 2.91 time: 0.441519 Sep 23 04:41:14.126199 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1285/2549] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:41:13 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1544 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:41:14.139220 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2b252f0a-f4ed-4a41-b56d-8986a0119bd7 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:14.140249 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-2b252f0a-f4ed-4a41-b56d-8986a0119bd7 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 42fe539b-6665-43fb-b7a2-bc8a6f2c65d5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:14.162211 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2b252f0a-f4ed-4a41-b56d-8986a0119bd7 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:14.163050 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2b252f0a-f4ed-4a41-b56d-8986a0119bd7 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:14.163732 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2b252f0a-f4ed-4a41-b56d-8986a0119bd7 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:14.168208 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2b252f0a-f4ed-4a41-b56d-8986a0119bd7 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:14.168208 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2b252f0a-f4ed-4a41-b56d-8986a0119bd7 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:14.168208 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2b252f0a-f4ed-4a41-b56d-8986a0119bd7 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:14.197640 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d503b683-4655-49f2-82fa-84a91b766b67 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542c9592c76c4d4b9f3f16cea354398d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf77b55dfd8452e949229e4eb085283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:14.210791 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-2b252f0a-f4ed-4a41-b56d-8986a0119bd7 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] HTTP exception thrown: Instance 42fe539b-6665-43fb-b7a2-bc8a6f2c65d5 could not be found. Sep 23 04:41:14.217199 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2b252f0a-f4ed-4a41-b56d-8986a0119bd7 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Request method failure captured: Sep 23 04:41:14.217199 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/42fe539b-6665-43fb-b7a2-bc8a6f2c65d5 HTTP/1.1 Sep 23 04:41:14.217199 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:41:14.217199 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:41:14.217199 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:41:14.217199 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:41:14.217199 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:41:14.217199 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:41:14.217199 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:41:14.217199 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:41:14.217199 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTgD-AJZNKtluGEJNjQKU0pcHtUCc1AZ8Ycz4MPGIeanw2_GglRmvn8LiMCEayIX86yw_RpyCC_JZrlVGSjhSgenUVZhpJ_MqN5SLmcv6Qnl3N6cXWJgtCK8N_ffRhD1dYgLIdHHgnmyTAptDZsjatOWU1ocTU40JP9XOpkK3deqL7A Sep 23 04:41:14.217199 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:41:14.217199 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:41:14.217199 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:41:14.217199 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:41:14.217199 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:41:14.217199 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:41:14.217199 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: fe698721372f40888dc2918c46e65f2f Sep 23 04:41:14.217199 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-DeleteServersTestJSON-347759205 Sep 23 04:41:14.217199 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:41:14.217199 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:41:14.217199 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fe698721372f40888dc2918c46e65f2f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe698721372f40888dc2918c46e65f2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fe698721372f40888dc2918c46e65f2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe698721372f40888dc2918c46e65f2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:41:14.217199 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-DeleteServersTestJSON-347759205 Sep 23 04:41:14.217199 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: fe698721372f40888dc2918c46e65f2f Sep 23 04:41:14.217199 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-DeleteServersTestJSON-347759205 Sep 23 04:41:14.217199 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-DeleteServersTestJSON-347759205-project Sep 23 04:41:14.217199 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:41:14.217199 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:41:14.217199 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 36526fe612c840fb907e1992d8e62538 Sep 23 04:41:14.217199 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-DeleteServersTestJSON-347759205-project Sep 23 04:41:14.217199 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:41:14.217199 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 42fe539b-6665-43fb-b7a2-bc8a6f2c65d5 could not be found. Sep 23 04:41:14.217199 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '42fe539b-6665-43fb-b7a2-bc8a6f2c65d5'} Sep 23 04:41:14.217199 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:41:14.217199 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:41:14.217199 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:41:14.217199 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:41:14.217199 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:41:14.217199 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:41:14.217199 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:41:14.217199 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:41:14.217199 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:41:14.217199 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:41:14.217199 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42fe539b-6665-43fb-b7a2-bc8a6f2c65d5 could not be found. Sep 23 04:41:14.217199 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:41:14.217199 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:41:14.217199 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:41:14.217199 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:41:14.217199 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:41:14.217199 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:41:14.217199 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:41:14.217199 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:41:14.217199 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:41:14.217199 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:41:14.217199 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:41:14.217199 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:41:14.217199 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:41:14.217199 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:41:14.217199 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:41:14.217199 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:41:14.217199 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42fe539b-6665-43fb-b7a2-bc8a6f2c65d5 could not be found. Sep 23 04:41:14.217199 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:41:14.217199 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:41:14.217199 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:41:14.221226 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:41:14.221226 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:41:14.221226 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:41:14.221226 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:41:14.221226 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:41:14.221226 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42fe539b-6665-43fb-b7a2-bc8a6f2c65d5 could not be found. Sep 23 04:41:14.221226 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:41:14.223459 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2b252f0a-f4ed-4a41-b56d-8986a0119bd7 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Returning 404 to user: Instance 42fe539b-6665-43fb-b7a2-bc8a6f2c65d5 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:41:14.223617 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d503b683-4655-49f2-82fa-84a91b766b67 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] 10.222.0.33 "GET /compute/v2.1/servers/dfb8f504-218a-471c-b7a8-70c498769f0e" status: 200 len: 1304 microversion: 2.1 time: 0.416344 Sep 23 04:41:14.224545 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2b252f0a-f4ed-4a41-b56d-8986a0119bd7 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/42fe539b-6665-43fb-b7a2-bc8a6f2c65d5" status: 404 len: 111 microversion: 2.1 time: 0.096709 Sep 23 04:41:14.225550 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1286/2550] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:14 2022] GET /compute/v2.1/servers/42fe539b-6665-43fb-b7a2-bc8a6f2c65d5 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:41:14.231941 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1265/2551] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:13 2022] GET /compute/v2.1/servers/dfb8f504-218a-471c-b7a8-70c498769f0e => generated 1304 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:14.783970 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e4a841bb-f7a3-4f5e-aa0c-4084b30332fa tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1817385279", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "networks": [{"uuid": "a989594a-cd71-405f-a7ac-42f529a758f7"}]}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:41:14.832069 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9fde6d77-978f-4306-80a1-ad30a20526aa tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:14.832930 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-9fde6d77-978f-4306-80a1-ad30a20526aa tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] [instance: 5ee8a1da-f229-4716-bc67-da23f07963bd] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:14.844145 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9fde6d77-978f-4306-80a1-ad30a20526aa tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:14.844651 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9fde6d77-978f-4306-80a1-ad30a20526aa tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:14.845095 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9fde6d77-978f-4306-80a1-ad30a20526aa tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:14.845812 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9fde6d77-978f-4306-80a1-ad30a20526aa tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:14.846316 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9fde6d77-978f-4306-80a1-ad30a20526aa tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:14.846743 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9fde6d77-978f-4306-80a1-ad30a20526aa tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:14.941114 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.neutron [None req-e4a841bb-f7a3-4f5e-aa0c-4084b30332fa tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] validate_networks() for [('a989594a-cd71-405f-a7ac-42f529a758f7', None, None, None, None, None)] {{(pid=122699) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:41:16.067826 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-9fde6d77-978f-4306-80a1-ad30a20526aa tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace08d8e105e46e299773c5a1b96039f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a16a53325a4d61aef94281435e9726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:16.085062 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9fde6d77-978f-4306-80a1-ad30a20526aa tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] 10.222.0.33 "GET /compute/v2.1/servers/5ee8a1da-f229-4716-bc67-da23f07963bd" status: 200 len: 1322 microversion: 2.1 time: 1.257595 Sep 23 04:41:16.086623 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1266/2552] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:14 2022] GET /compute/v2.1/servers/5ee8a1da-f229-4716-bc67-da23f07963bd => generated 1322 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:16.096030 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-066ea8fe-ec45-4e06-9bd2-bcf6a784240e tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:16.098153 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-066ea8fe-ec45-4e06-9bd2-bcf6a784240e tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:16.108444 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-066ea8fe-ec45-4e06-9bd2-bcf6a784240e tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:16.109022 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-066ea8fe-ec45-4e06-9bd2-bcf6a784240e tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:16.114132 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-066ea8fe-ec45-4e06-9bd2-bcf6a784240e tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:16.114132 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-066ea8fe-ec45-4e06-9bd2-bcf6a784240e tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:16.114132 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-066ea8fe-ec45-4e06-9bd2-bcf6a784240e tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:16.114132 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-066ea8fe-ec45-4e06-9bd2-bcf6a784240e tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:16.288594 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-066ea8fe-ec45-4e06-9bd2-bcf6a784240e tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:16.291795 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-066ea8fe-ec45-4e06-9bd2-bcf6a784240e tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:16.293405 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-066ea8fe-ec45-4e06-9bd2-bcf6a784240e tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:16.310590 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-066ea8fe-ec45-4e06-9bd2-bcf6a784240e tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1544 microversion: 2.91 time: 0.221961 Sep 23 04:41:16.344738 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1267/2553] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:41:16 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1544 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:41:16.354753 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-baf62ff2-bade-4779-916f-de0b004f3c40 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:16.356338 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-baf62ff2-bade-4779-916f-de0b004f3c40 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] [instance: dfb8f504-218a-471c-b7a8-70c498769f0e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:16.364239 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-baf62ff2-bade-4779-916f-de0b004f3c40 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:16.364732 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-baf62ff2-bade-4779-916f-de0b004f3c40 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:16.365779 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-baf62ff2-bade-4779-916f-de0b004f3c40 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:16.367077 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-baf62ff2-bade-4779-916f-de0b004f3c40 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:16.368197 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-baf62ff2-bade-4779-916f-de0b004f3c40 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:16.369019 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-baf62ff2-bade-4779-916f-de0b004f3c40 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:16.648593 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-e4a841bb-f7a3-4f5e-aa0c-4084b30332fa tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Flavor limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:41:16.649152 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-e4a841bb-f7a3-4f5e-aa0c-4084b30332fa tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Image limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:41:16.650114 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-e4a841bb-f7a3-4f5e-aa0c-4084b30332fa tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Flavor pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:41:16.650694 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-e4a841bb-f7a3-4f5e-aa0c-4084b30332fa tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Image pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:41:16.651408 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-e4a841bb-f7a3-4f5e-aa0c-4084b30332fa tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:41:16.687576 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e4a841bb-f7a3-4f5e-aa0c-4084b30332fa tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:16.690531 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e4a841bb-f7a3-4f5e-aa0c-4084b30332fa tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:16.695212 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e4a841bb-f7a3-4f5e-aa0c-4084b30332fa tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:16.702389 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e4a841bb-f7a3-4f5e-aa0c-4084b30332fa tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:16.702389 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e4a841bb-f7a3-4f5e-aa0c-4084b30332fa tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:16.702389 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e4a841bb-f7a3-4f5e-aa0c-4084b30332fa tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:16.761432 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-e4a841bb-f7a3-4f5e-aa0c-4084b30332fa tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Getting quotas for project fe698721372f40888dc2918c46e65f2f. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:41:16.775519 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-e4a841bb-f7a3-4f5e-aa0c-4084b30332fa tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Getting quotas for user 36526fe612c840fb907e1992d8e62538 and project fe698721372f40888dc2918c46e65f2f. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:41:16.797882 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e4a841bb-f7a3-4f5e-aa0c-4084b30332fa tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Going to run 1 instances... {{(pid=122699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:41:16.800670 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e4a841bb-f7a3-4f5e-aa0c-4084b30332fa tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 8a6b2904-2edd-4e9e-b6fa-1d6249721f52] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:41:16.883018 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-baf62ff2-bade-4779-916f-de0b004f3c40 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542c9592c76c4d4b9f3f16cea354398d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf77b55dfd8452e949229e4eb085283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:16.902887 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-baf62ff2-bade-4779-916f-de0b004f3c40 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] 10.222.0.33 "GET /compute/v2.1/servers/dfb8f504-218a-471c-b7a8-70c498769f0e" status: 200 len: 1371 microversion: 2.1 time: 0.555454 Sep 23 04:41:16.914937 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1268/2554] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:16 2022] GET /compute/v2.1/servers/dfb8f504-218a-471c-b7a8-70c498769f0e => generated 1371 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:16.914937 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-7584e122-06ad-4f93-8bf2-6c2d090abf6c req-e3d3fe37-767e-483c-a0a3-6c1622f13801 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfb8f504-218a-471c-b7a8-70c498769f0e", "tag": "e03d6cb1-0498-436c-ab0a-43f410f1eaf8"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:41:16.943391 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-7584e122-06ad-4f93-8bf2-6c2d090abf6c req-e3d3fe37-767e-483c-a0a3-6c1622f13801 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:16.943662 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-7584e122-06ad-4f93-8bf2-6c2d090abf6c req-e3d3fe37-767e-483c-a0a3-6c1622f13801 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:16.944117 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-7584e122-06ad-4f93-8bf2-6c2d090abf6c req-e3d3fe37-767e-483c-a0a3-6c1622f13801 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:16.961423 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-7584e122-06ad-4f93-8bf2-6c2d090abf6c req-e3d3fe37-767e-483c-a0a3-6c1622f13801 service nova] Creating event network-changed:e03d6cb1-0498-436c-ab0a-43f410f1eaf8 for instance dfb8f504-218a-471c-b7a8-70c498769f0e on n-h2-846463-3 Sep 23 04:41:16.966909 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-7584e122-06ad-4f93-8bf2-6c2d090abf6c req-e3d3fe37-767e-483c-a0a3-6c1622f13801 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061635 Sep 23 04:41:16.967862 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1269/2555] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:41:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:41:17.112771 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e4a841bb-f7a3-4f5e-aa0c-4084b30332fa tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.336142 Sep 23 04:41:17.114083 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1287/2556] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:41:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 2340 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:41:17.132648 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-85099ae3-0d67-46ed-8334-e6641724ba53 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:17.133712 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-85099ae3-0d67-46ed-8334-e6641724ba53 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 8a6b2904-2edd-4e9e-b6fa-1d6249721f52] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:17.137944 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-77011456-8bf6-4de7-b7f3-1fcf859c14d7 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:17.144873 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-77011456-8bf6-4de7-b7f3-1fcf859c14d7 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] [instance: 5ee8a1da-f229-4716-bc67-da23f07963bd] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:17.165727 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-77011456-8bf6-4de7-b7f3-1fcf859c14d7 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:17.167940 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-77011456-8bf6-4de7-b7f3-1fcf859c14d7 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:17.169764 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-77011456-8bf6-4de7-b7f3-1fcf859c14d7 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:17.173657 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-77011456-8bf6-4de7-b7f3-1fcf859c14d7 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:17.175236 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-77011456-8bf6-4de7-b7f3-1fcf859c14d7 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:17.179714 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-77011456-8bf6-4de7-b7f3-1fcf859c14d7 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:17.342601 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-85099ae3-0d67-46ed-8334-e6641724ba53 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:17.349873 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-85099ae3-0d67-46ed-8334-e6641724ba53 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/8a6b2904-2edd-4e9e-b6fa-1d6249721f52" status: 200 len: 1215 microversion: 2.1 time: 0.226930 Sep 23 04:41:17.350495 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1288/2557] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:17 2022] GET /compute/v2.1/servers/8a6b2904-2edd-4e9e-b6fa-1d6249721f52 => generated 1215 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:41:17.366587 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d3ca107e-dea2-40c6-824f-ffc418595ce9 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:17.367315 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d3ca107e-dea2-40c6-824f-ffc418595ce9 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:17.396702 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d3ca107e-dea2-40c6-824f-ffc418595ce9 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:17.397883 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d3ca107e-dea2-40c6-824f-ffc418595ce9 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:17.399941 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d3ca107e-dea2-40c6-824f-ffc418595ce9 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:17.404095 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d3ca107e-dea2-40c6-824f-ffc418595ce9 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:17.407151 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d3ca107e-dea2-40c6-824f-ffc418595ce9 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:17.409449 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d3ca107e-dea2-40c6-824f-ffc418595ce9 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:17.540472 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d3ca107e-dea2-40c6-824f-ffc418595ce9 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:17.551485 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d3ca107e-dea2-40c6-824f-ffc418595ce9 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:17.553317 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d3ca107e-dea2-40c6-824f-ffc418595ce9 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:17.560597 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d3ca107e-dea2-40c6-824f-ffc418595ce9 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1544 microversion: 2.91 time: 0.208434 Sep 23 04:41:17.562024 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1289/2558] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:41:17 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1544 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:41:17.931268 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5a3d4392-8a7e-43e1-b691-4b7e5cec1530 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:17.932006 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-5a3d4392-8a7e-43e1-b691-4b7e5cec1530 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] [instance: dfb8f504-218a-471c-b7a8-70c498769f0e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:17.949236 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5a3d4392-8a7e-43e1-b691-4b7e5cec1530 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:17.950458 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5a3d4392-8a7e-43e1-b691-4b7e5cec1530 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:17.957966 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5a3d4392-8a7e-43e1-b691-4b7e5cec1530 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:17.957966 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5a3d4392-8a7e-43e1-b691-4b7e5cec1530 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:17.957966 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5a3d4392-8a7e-43e1-b691-4b7e5cec1530 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:17.957966 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5a3d4392-8a7e-43e1-b691-4b7e5cec1530 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:17.989057 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-77011456-8bf6-4de7-b7f3-1fcf859c14d7 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace08d8e105e46e299773c5a1b96039f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a16a53325a4d61aef94281435e9726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:17.998965 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-77011456-8bf6-4de7-b7f3-1fcf859c14d7 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] 10.222.0.33 "GET /compute/v2.1/servers/5ee8a1da-f229-4716-bc67-da23f07963bd" status: 200 len: 1322 microversion: 2.1 time: 0.891843 Sep 23 04:41:18.014921 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1270/2559] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:17 2022] GET /compute/v2.1/servers/5ee8a1da-f229-4716-bc67-da23f07963bd => generated 1322 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:18.301415 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-5a3d4392-8a7e-43e1-b691-4b7e5cec1530 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542c9592c76c4d4b9f3f16cea354398d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf77b55dfd8452e949229e4eb085283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:18.312285 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5a3d4392-8a7e-43e1-b691-4b7e5cec1530 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] 10.222.0.33 "GET /compute/v2.1/servers/dfb8f504-218a-471c-b7a8-70c498769f0e" status: 200 len: 1371 microversion: 2.1 time: 0.387360 Sep 23 04:41:18.314993 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1290/2560] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:17 2022] GET /compute/v2.1/servers/dfb8f504-218a-471c-b7a8-70c498769f0e => generated 1371 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:41:18.382574 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7f1faaff-2165-4997-b765-fcda36a2ef62 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:18.383796 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7f1faaff-2165-4997-b765-fcda36a2ef62 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 8a6b2904-2edd-4e9e-b6fa-1d6249721f52] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:18.585081 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-7f1faaff-2165-4997-b765-fcda36a2ef62 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:18.591804 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-823fd8f9-4edf-4d5b-bb90-878e39656d25 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:18.592627 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-823fd8f9-4edf-4d5b-bb90-878e39656d25 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:18.603433 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7f1faaff-2165-4997-b765-fcda36a2ef62 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/8a6b2904-2edd-4e9e-b6fa-1d6249721f52" status: 200 len: 1215 microversion: 2.1 time: 0.229257 Sep 23 04:41:18.609926 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-823fd8f9-4edf-4d5b-bb90-878e39656d25 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:18.611318 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1271/2561] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:18 2022] GET /compute/v2.1/servers/8a6b2904-2edd-4e9e-b6fa-1d6249721f52 => generated 1215 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:18.611987 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-823fd8f9-4edf-4d5b-bb90-878e39656d25 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:18.612570 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-823fd8f9-4edf-4d5b-bb90-878e39656d25 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:18.613641 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-823fd8f9-4edf-4d5b-bb90-878e39656d25 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:18.614618 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-823fd8f9-4edf-4d5b-bb90-878e39656d25 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:18.615472 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-823fd8f9-4edf-4d5b-bb90-878e39656d25 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:18.803639 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-823fd8f9-4edf-4d5b-bb90-878e39656d25 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:18.813667 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-823fd8f9-4edf-4d5b-bb90-878e39656d25 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:18.815613 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-823fd8f9-4edf-4d5b-bb90-878e39656d25 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:18.821444 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-823fd8f9-4edf-4d5b-bb90-878e39656d25 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1544 microversion: 2.91 time: 0.234127 Sep 23 04:41:18.839301 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1291/2562] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:41:18 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1544 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:41:19.030805 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-35b2bd05-2a8f-4999-b984-460d0daba553 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:19.036452 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-35b2bd05-2a8f-4999-b984-460d0daba553 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] [instance: 5ee8a1da-f229-4716-bc67-da23f07963bd] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:19.062884 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-35b2bd05-2a8f-4999-b984-460d0daba553 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:19.064579 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-35b2bd05-2a8f-4999-b984-460d0daba553 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:19.065841 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-35b2bd05-2a8f-4999-b984-460d0daba553 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:19.068568 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-35b2bd05-2a8f-4999-b984-460d0daba553 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:19.069067 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-35b2bd05-2a8f-4999-b984-460d0daba553 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:19.069507 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-35b2bd05-2a8f-4999-b984-460d0daba553 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:19.340549 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9b016a4d-306f-4746-a956-f847170297df tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:19.341173 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-9b016a4d-306f-4746-a956-f847170297df tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] [instance: dfb8f504-218a-471c-b7a8-70c498769f0e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:19.357613 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9b016a4d-306f-4746-a956-f847170297df tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:19.358450 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9b016a4d-306f-4746-a956-f847170297df tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:19.362309 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9b016a4d-306f-4746-a956-f847170297df tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:19.363316 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9b016a4d-306f-4746-a956-f847170297df tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:19.364082 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9b016a4d-306f-4746-a956-f847170297df tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:19.364743 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9b016a4d-306f-4746-a956-f847170297df tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:19.480831 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-35b2bd05-2a8f-4999-b984-460d0daba553 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace08d8e105e46e299773c5a1b96039f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a16a53325a4d61aef94281435e9726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:19.491912 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-35b2bd05-2a8f-4999-b984-460d0daba553 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] 10.222.0.33 "GET /compute/v2.1/servers/5ee8a1da-f229-4716-bc67-da23f07963bd" status: 200 len: 1322 microversion: 2.1 time: 0.468210 Sep 23 04:41:19.512926 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1272/2563] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:19 2022] GET /compute/v2.1/servers/5ee8a1da-f229-4716-bc67-da23f07963bd => generated 1322 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:19.578984 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-10b618e6-a10c-4eb9-9791-d8de42c7b7df req-b78e5341-ce9c-4db3-b171-2edc969d9425 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ee8a1da-f229-4716-bc67-da23f07963bd", "name": "network-vif-plugged", "status": "completed", "tag": "f9285902-d382-442c-88b6-fad3f3a0ebcc"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:41:19.598829 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-10b618e6-a10c-4eb9-9791-d8de42c7b7df req-b78e5341-ce9c-4db3-b171-2edc969d9425 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:19.598829 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-10b618e6-a10c-4eb9-9791-d8de42c7b7df req-b78e5341-ce9c-4db3-b171-2edc969d9425 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:19.598829 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-10b618e6-a10c-4eb9-9791-d8de42c7b7df req-b78e5341-ce9c-4db3-b171-2edc969d9425 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:19.622567 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-10b618e6-a10c-4eb9-9791-d8de42c7b7df req-b78e5341-ce9c-4db3-b171-2edc969d9425 service nova] Creating event network-vif-plugged:f9285902-d382-442c-88b6-fad3f3a0ebcc for instance 5ee8a1da-f229-4716-bc67-da23f07963bd on n-h1-846463-3 Sep 23 04:41:19.632491 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-10b618e6-a10c-4eb9-9791-d8de42c7b7df req-b78e5341-ce9c-4db3-b171-2edc969d9425 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057545 Sep 23 04:41:19.633567 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1273/2564] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:41:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:41:19.652959 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d123d26d-510e-4167-92a5-5107bec404c4 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:19.654199 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d123d26d-510e-4167-92a5-5107bec404c4 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 8a6b2904-2edd-4e9e-b6fa-1d6249721f52] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:19.662805 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d123d26d-510e-4167-92a5-5107bec404c4 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:19.663576 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d123d26d-510e-4167-92a5-5107bec404c4 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:19.664170 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d123d26d-510e-4167-92a5-5107bec404c4 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:19.665040 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d123d26d-510e-4167-92a5-5107bec404c4 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:19.665642 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d123d26d-510e-4167-92a5-5107bec404c4 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:19.666250 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d123d26d-510e-4167-92a5-5107bec404c4 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:19.672349 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=100 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:41:19.852930 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d123d26d-510e-4167-92a5-5107bec404c4 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:19.863094 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d123d26d-510e-4167-92a5-5107bec404c4 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/8a6b2904-2edd-4e9e-b6fa-1d6249721f52" status: 200 len: 1219 microversion: 2.1 time: 0.228025 Sep 23 04:41:19.867558 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1274/2565] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:19 2022] GET /compute/v2.1/servers/8a6b2904-2edd-4e9e-b6fa-1d6249721f52 => generated 1219 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:19.873244 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-aeb4866a-2918-4872-86d3-43f0b1f44a6e tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:19.879835 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-aeb4866a-2918-4872-86d3-43f0b1f44a6e tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:19.887486 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-9b016a4d-306f-4746-a956-f847170297df tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542c9592c76c4d4b9f3f16cea354398d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf77b55dfd8452e949229e4eb085283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:19.906804 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-9b016a4d-306f-4746-a956-f847170297df tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] 10.222.0.33 "GET /compute/v2.1/servers/dfb8f504-218a-471c-b7a8-70c498769f0e" status: 200 len: 1371 microversion: 2.1 time: 0.566516 Sep 23 04:41:19.906804 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1292/2566] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:19 2022] GET /compute/v2.1/servers/dfb8f504-218a-471c-b7a8-70c498769f0e => generated 1371 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:41:19.907077 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-aeb4866a-2918-4872-86d3-43f0b1f44a6e tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:19.907077 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-aeb4866a-2918-4872-86d3-43f0b1f44a6e tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:19.907077 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-aeb4866a-2918-4872-86d3-43f0b1f44a6e tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:19.921509 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-aeb4866a-2918-4872-86d3-43f0b1f44a6e tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:19.922167 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-aeb4866a-2918-4872-86d3-43f0b1f44a6e tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:19.922618 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-aeb4866a-2918-4872-86d3-43f0b1f44a6e tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:20.039161 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-aeb4866a-2918-4872-86d3-43f0b1f44a6e tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:20.056488 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-aeb4866a-2918-4872-86d3-43f0b1f44a6e tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:20.059609 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-aeb4866a-2918-4872-86d3-43f0b1f44a6e tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:20.065336 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-aeb4866a-2918-4872-86d3-43f0b1f44a6e tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1531 microversion: 2.91 time: 0.196526 Sep 23 04:41:20.066426 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1275/2567] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:41:19 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1531 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:41:20.094776 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-74df523b-cc28-45f7-819e-f1cfffbe96d3 tempest-UnshelveToHostMultiNodesTest-1629091521 tempest-UnshelveToHostMultiNodesTest-1629091521-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:20.095663 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-74df523b-cc28-45f7-819e-f1cfffbe96d3 tempest-UnshelveToHostMultiNodesTest-1629091521 tempest-UnshelveToHostMultiNodesTest-1629091521-project-admin] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:20.102558 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-74df523b-cc28-45f7-819e-f1cfffbe96d3 tempest-UnshelveToHostMultiNodesTest-1629091521 tempest-UnshelveToHostMultiNodesTest-1629091521-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:20.103331 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-74df523b-cc28-45f7-819e-f1cfffbe96d3 tempest-UnshelveToHostMultiNodesTest-1629091521 tempest-UnshelveToHostMultiNodesTest-1629091521-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:20.103956 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-74df523b-cc28-45f7-819e-f1cfffbe96d3 tempest-UnshelveToHostMultiNodesTest-1629091521 tempest-UnshelveToHostMultiNodesTest-1629091521-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:20.105542 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-74df523b-cc28-45f7-819e-f1cfffbe96d3 tempest-UnshelveToHostMultiNodesTest-1629091521 tempest-UnshelveToHostMultiNodesTest-1629091521-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:20.106078 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-74df523b-cc28-45f7-819e-f1cfffbe96d3 tempest-UnshelveToHostMultiNodesTest-1629091521 tempest-UnshelveToHostMultiNodesTest-1629091521-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:20.106571 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-74df523b-cc28-45f7-819e-f1cfffbe96d3 tempest-UnshelveToHostMultiNodesTest-1629091521 tempest-UnshelveToHostMultiNodesTest-1629091521-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:20.235562 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-74df523b-cc28-45f7-819e-f1cfffbe96d3 tempest-UnshelveToHostMultiNodesTest-1629091521 tempest-UnshelveToHostMultiNodesTest-1629091521-project-admin] Lazy-loading 'services' on Instance uuid 11ba0b77-8202-461d-8fdf-16528c7fa831 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:41:20.257452 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-74df523b-cc28-45f7-819e-f1cfffbe96d3 tempest-UnshelveToHostMultiNodesTest-1629091521 tempest-UnshelveToHostMultiNodesTest-1629091521-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1936 microversion: 2.91 time: 0.166800 Sep 23 04:41:20.259032 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1293/2568] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:41:20 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1936 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:41:20.290908 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4d87bd6c-9ee3-49df-9de4-58ff3eec2b21 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:41:20.291484 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4d87bd6c-9ee3-49df-9de4-58ff3eec2b21 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:20.309630 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4d87bd6c-9ee3-49df-9de4-58ff3eec2b21 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:20.310212 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4d87bd6c-9ee3-49df-9de4-58ff3eec2b21 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:20.313916 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4d87bd6c-9ee3-49df-9de4-58ff3eec2b21 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:20.314931 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4d87bd6c-9ee3-49df-9de4-58ff3eec2b21 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:20.315751 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4d87bd6c-9ee3-49df-9de4-58ff3eec2b21 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:20.317439 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4d87bd6c-9ee3-49df-9de4-58ff3eec2b21 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:20.389912 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-4d87bd6c-9ee3-49df-9de4-58ff3eec2b21 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lazy-loading 'flavor' on Instance uuid 11ba0b77-8202-461d-8fdf-16528c7fa831 {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:41:20.519790 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-44500162-c943-487e-8f09-34739304b766 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:20.520382 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-44500162-c943-487e-8f09-34739304b766 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] [instance: 5ee8a1da-f229-4716-bc67-da23f07963bd] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:20.530294 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-44500162-c943-487e-8f09-34739304b766 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:20.530878 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-44500162-c943-487e-8f09-34739304b766 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:20.534140 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-44500162-c943-487e-8f09-34739304b766 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:20.534973 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-44500162-c943-487e-8f09-34739304b766 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:20.535472 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-44500162-c943-487e-8f09-34739304b766 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:20.535920 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-44500162-c943-487e-8f09-34739304b766 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:20.841293 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-44500162-c943-487e-8f09-34739304b766 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace08d8e105e46e299773c5a1b96039f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a16a53325a4d61aef94281435e9726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:20.862137 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-44500162-c943-487e-8f09-34739304b766 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] 10.222.0.33 "GET /compute/v2.1/servers/5ee8a1da-f229-4716-bc67-da23f07963bd" status: 200 len: 1322 microversion: 2.1 time: 0.346599 Sep 23 04:41:20.878558 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1294/2569] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:20 2022] GET /compute/v2.1/servers/5ee8a1da-f229-4716-bc67-da23f07963bd => generated 1322 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:41:20.893602 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-78b6f6b3-505e-4864-bb22-d347e7364eb7 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:20.894468 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-78b6f6b3-505e-4864-bb22-d347e7364eb7 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 8a6b2904-2edd-4e9e-b6fa-1d6249721f52] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:20.906959 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-78b6f6b3-505e-4864-bb22-d347e7364eb7 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:20.910185 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-78b6f6b3-505e-4864-bb22-d347e7364eb7 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:20.913168 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-78b6f6b3-505e-4864-bb22-d347e7364eb7 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:20.914231 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-78b6f6b3-505e-4864-bb22-d347e7364eb7 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:20.919785 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-78b6f6b3-505e-4864-bb22-d347e7364eb7 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:20.920527 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-78b6f6b3-505e-4864-bb22-d347e7364eb7 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:21.042217 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-78b6f6b3-505e-4864-bb22-d347e7364eb7 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:21.084835 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-78b6f6b3-505e-4864-bb22-d347e7364eb7 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/8a6b2904-2edd-4e9e-b6fa-1d6249721f52" status: 200 len: 1267 microversion: 2.1 time: 0.194877 Sep 23 04:41:21.085530 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1295/2570] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:20 2022] GET /compute/v2.1/servers/8a6b2904-2edd-4e9e-b6fa-1d6249721f52 => generated 1267 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:41:21.109538 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-92d450fb-d580-44c3-ada3-48a5d5e9915d tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:21.110352 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-92d450fb-d580-44c3-ada3-48a5d5e9915d tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] [instance: dfb8f504-218a-471c-b7a8-70c498769f0e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:21.131601 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-92d450fb-d580-44c3-ada3-48a5d5e9915d tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:21.134538 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-92d450fb-d580-44c3-ada3-48a5d5e9915d tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:21.138010 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-92d450fb-d580-44c3-ada3-48a5d5e9915d tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:21.139190 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-92d450fb-d580-44c3-ada3-48a5d5e9915d tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:21.140769 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-92d450fb-d580-44c3-ada3-48a5d5e9915d tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:21.145293 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-92d450fb-d580-44c3-ada3-48a5d5e9915d tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:21.182360 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4d87bd6c-9ee3-49df-9de4-58ff3eec2b21 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "POST /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831/action" status: 202 len: 0 microversion: 2.91 time: 0.894685 Sep 23 04:41:21.187917 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1276/2571] 10.222.0.33 () {62 vars in 1319 bytes} [Fri Sep 23 04:41:20 2022] POST /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831/action => generated 0 bytes in 901 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:41:21.201497 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-fc7ea74d-5ce7-4d80-9793-f12855b4e5d9 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:21.203543 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-fc7ea74d-5ce7-4d80-9793-f12855b4e5d9 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:21.227067 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fc7ea74d-5ce7-4d80-9793-f12855b4e5d9 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:21.227990 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fc7ea74d-5ce7-4d80-9793-f12855b4e5d9 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:21.228658 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fc7ea74d-5ce7-4d80-9793-f12855b4e5d9 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:21.230142 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fc7ea74d-5ce7-4d80-9793-f12855b4e5d9 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:21.230823 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fc7ea74d-5ce7-4d80-9793-f12855b4e5d9 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:21.231416 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fc7ea74d-5ce7-4d80-9793-f12855b4e5d9 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:21.388085 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-fc7ea74d-5ce7-4d80-9793-f12855b4e5d9 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:21.407833 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-fc7ea74d-5ce7-4d80-9793-f12855b4e5d9 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:21.412207 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-fc7ea74d-5ce7-4d80-9793-f12855b4e5d9 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:21.434778 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-fc7ea74d-5ce7-4d80-9793-f12855b4e5d9 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1537 microversion: 2.91 time: 0.243452 Sep 23 04:41:21.438372 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1277/2572] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:41:21 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1537 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:41:21.657136 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-92d450fb-d580-44c3-ada3-48a5d5e9915d tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542c9592c76c4d4b9f3f16cea354398d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf77b55dfd8452e949229e4eb085283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:21.666321 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-92d450fb-d580-44c3-ada3-48a5d5e9915d tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] 10.222.0.33 "GET /compute/v2.1/servers/dfb8f504-218a-471c-b7a8-70c498769f0e" status: 200 len: 1371 microversion: 2.1 time: 0.578346 Sep 23 04:41:21.690288 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1296/2573] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:21 2022] GET /compute/v2.1/servers/dfb8f504-218a-471c-b7a8-70c498769f0e => generated 1371 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:21.893023 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-59abcc36-53f1-49c2-8d46-253b62928e68 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:21.894433 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-59abcc36-53f1-49c2-8d46-253b62928e68 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] [instance: 5ee8a1da-f229-4716-bc67-da23f07963bd] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:21.903093 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-59abcc36-53f1-49c2-8d46-253b62928e68 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:21.904322 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-59abcc36-53f1-49c2-8d46-253b62928e68 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:21.905042 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-59abcc36-53f1-49c2-8d46-253b62928e68 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:21.906243 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-59abcc36-53f1-49c2-8d46-253b62928e68 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:21.907787 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-59abcc36-53f1-49c2-8d46-253b62928e68 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:21.908496 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-59abcc36-53f1-49c2-8d46-253b62928e68 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:22.113540 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a177dd65-e6f2-46ba-baf5-5da0dade2bb4 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:22.114723 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a177dd65-e6f2-46ba-baf5-5da0dade2bb4 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 8a6b2904-2edd-4e9e-b6fa-1d6249721f52] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:22.124557 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a177dd65-e6f2-46ba-baf5-5da0dade2bb4 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:22.133169 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a177dd65-e6f2-46ba-baf5-5da0dade2bb4 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:22.133169 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a177dd65-e6f2-46ba-baf5-5da0dade2bb4 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:22.133169 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a177dd65-e6f2-46ba-baf5-5da0dade2bb4 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:22.133169 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a177dd65-e6f2-46ba-baf5-5da0dade2bb4 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:22.133439 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a177dd65-e6f2-46ba-baf5-5da0dade2bb4 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:22.260641 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a177dd65-e6f2-46ba-baf5-5da0dade2bb4 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:22.272749 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a177dd65-e6f2-46ba-baf5-5da0dade2bb4 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/8a6b2904-2edd-4e9e-b6fa-1d6249721f52" status: 200 len: 1273 microversion: 2.1 time: 0.163945 Sep 23 04:41:22.280027 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1297/2574] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:22 2022] GET /compute/v2.1/servers/8a6b2904-2edd-4e9e-b6fa-1d6249721f52 => generated 1273 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:41:22.556826 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-59abcc36-53f1-49c2-8d46-253b62928e68 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace08d8e105e46e299773c5a1b96039f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a16a53325a4d61aef94281435e9726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:22.574450 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-59abcc36-53f1-49c2-8d46-253b62928e68 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] 10.222.0.33 "GET /compute/v2.1/servers/5ee8a1da-f229-4716-bc67-da23f07963bd" status: 200 len: 1516 microversion: 2.1 time: 0.684911 Sep 23 04:41:22.576440 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1278/2575] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:21 2022] GET /compute/v2.1/servers/5ee8a1da-f229-4716-bc67-da23f07963bd => generated 1516 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:22.599344 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b8535f4a-c5bb-4105-9cb7-07870b7f5144 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:22.599344 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b8535f4a-c5bb-4105-9cb7-07870b7f5144 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:22.612095 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b8535f4a-c5bb-4105-9cb7-07870b7f5144 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:22.618734 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b8535f4a-c5bb-4105-9cb7-07870b7f5144 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:22.619526 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b8535f4a-c5bb-4105-9cb7-07870b7f5144 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:22.620590 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b8535f4a-c5bb-4105-9cb7-07870b7f5144 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:22.621403 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b8535f4a-c5bb-4105-9cb7-07870b7f5144 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:22.622045 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b8535f4a-c5bb-4105-9cb7-07870b7f5144 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:22.831391 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b8535f4a-c5bb-4105-9cb7-07870b7f5144 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:22.845124 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8114ddcf-8ff8-402e-972f-2381b1af8916 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-154786954", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:41:22.848968 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b8535f4a-c5bb-4105-9cb7-07870b7f5144 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:22.850540 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b8535f4a-c5bb-4105-9cb7-07870b7f5144 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:22.869146 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b8535f4a-c5bb-4105-9cb7-07870b7f5144 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1537 microversion: 2.91 time: 0.289708 Sep 23 04:41:22.870014 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1279/2576] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:41:22 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1537 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:41:22.901479 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d15b1ece-a22f-46cb-a704-5c6bc61102d4 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:41:22.910762 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d15b1ece-a22f-46cb-a704-5c6bc61102d4 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] [instance: 5ee8a1da-f229-4716-bc67-da23f07963bd] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:22.924663 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d15b1ece-a22f-46cb-a704-5c6bc61102d4 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:22.929825 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d15b1ece-a22f-46cb-a704-5c6bc61102d4 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:22.930415 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d15b1ece-a22f-46cb-a704-5c6bc61102d4 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:22.931292 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d15b1ece-a22f-46cb-a704-5c6bc61102d4 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:22.931778 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d15b1ece-a22f-46cb-a704-5c6bc61102d4 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:22.932246 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d15b1ece-a22f-46cb-a704-5c6bc61102d4 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:22.938687 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.neutron [None req-8114ddcf-8ff8-402e-972f-2381b1af8916 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] validate_networks() for None {{(pid=122699) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:41:22.994541 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-d15b1ece-a22f-46cb-a704-5c6bc61102d4 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lazy-loading 'flavor' on Instance uuid 5ee8a1da-f229-4716-bc67-da23f07963bd {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:41:23.191907 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=4 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:41:23.349857 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d15b1ece-a22f-46cb-a704-5c6bc61102d4 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] 10.222.0.33 "POST /compute/v2.1/servers/5ee8a1da-f229-4716-bc67-da23f07963bd/action" status: 200 len: 32 microversion: 2.1 time: 0.467399 Sep 23 04:41:23.351012 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1280/2577] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:41:22 2022] POST /compute/v2.1/servers/5ee8a1da-f229-4716-bc67-da23f07963bd/action => generated 32 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 04:41:23.377130 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7146ddaf-188c-4c17-8faf-78da7e8a5476 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:23.378948 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7146ddaf-188c-4c17-8faf-78da7e8a5476 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] [instance: dfb8f504-218a-471c-b7a8-70c498769f0e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:23.397576 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7146ddaf-188c-4c17-8faf-78da7e8a5476 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:23.398402 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7146ddaf-188c-4c17-8faf-78da7e8a5476 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:23.399023 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7146ddaf-188c-4c17-8faf-78da7e8a5476 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:23.400045 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7146ddaf-188c-4c17-8faf-78da7e8a5476 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:23.400915 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7146ddaf-188c-4c17-8faf-78da7e8a5476 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:23.401691 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7146ddaf-188c-4c17-8faf-78da7e8a5476 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:23.917089 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-7146ddaf-188c-4c17-8faf-78da7e8a5476 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542c9592c76c4d4b9f3f16cea354398d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf77b55dfd8452e949229e4eb085283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:23.931016 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7146ddaf-188c-4c17-8faf-78da7e8a5476 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] 10.222.0.33 "GET /compute/v2.1/servers/dfb8f504-218a-471c-b7a8-70c498769f0e" status: 200 len: 1371 microversion: 2.1 time: 0.578423 Sep 23 04:41:23.950981 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-8114ddcf-8ff8-402e-972f-2381b1af8916 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Flavor limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:41:23.951942 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-8114ddcf-8ff8-402e-972f-2381b1af8916 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Image limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:41:23.952576 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-8114ddcf-8ff8-402e-972f-2381b1af8916 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Flavor pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:41:23.953342 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-8114ddcf-8ff8-402e-972f-2381b1af8916 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Image pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:41:23.953964 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-8114ddcf-8ff8-402e-972f-2381b1af8916 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:41:23.956629 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1281/2578] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:23 2022] GET /compute/v2.1/servers/dfb8f504-218a-471c-b7a8-70c498769f0e => generated 1371 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:23.961932 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4f9c7bb2-6a18-4422-9680-dd547e5296c9 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:23.969860 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4f9c7bb2-6a18-4422-9680-dd547e5296c9 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 8a6b2904-2edd-4e9e-b6fa-1d6249721f52] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:23.981317 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8114ddcf-8ff8-402e-972f-2381b1af8916 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:23.982282 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8114ddcf-8ff8-402e-972f-2381b1af8916 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:23.996697 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8114ddcf-8ff8-402e-972f-2381b1af8916 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:23.996697 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8114ddcf-8ff8-402e-972f-2381b1af8916 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:23.996697 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8114ddcf-8ff8-402e-972f-2381b1af8916 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:23.996697 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8114ddcf-8ff8-402e-972f-2381b1af8916 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:23.999036 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4f9c7bb2-6a18-4422-9680-dd547e5296c9 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:23.999036 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4f9c7bb2-6a18-4422-9680-dd547e5296c9 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:23.999036 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4f9c7bb2-6a18-4422-9680-dd547e5296c9 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:23.999036 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4f9c7bb2-6a18-4422-9680-dd547e5296c9 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:23.999036 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4f9c7bb2-6a18-4422-9680-dd547e5296c9 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:23.999036 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4f9c7bb2-6a18-4422-9680-dd547e5296c9 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:24.031761 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-8114ddcf-8ff8-402e-972f-2381b1af8916 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Getting quotas for project 8844923c06ca4a9e9fa774ed17c4fc25. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:41:24.041170 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-8114ddcf-8ff8-402e-972f-2381b1af8916 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Getting quotas for user f7c1c2f05c7b48cfb2cd4ecb56a2a21a and project 8844923c06ca4a9e9fa774ed17c4fc25. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:41:24.071464 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-8114ddcf-8ff8-402e-972f-2381b1af8916 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Going to run 1 instances... {{(pid=122699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:41:24.074481 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-8114ddcf-8ff8-402e-972f-2381b1af8916 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] [instance: fde8e9cc-b3de-4af8-a6e5-d5ab50af4844] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:41:24.495290 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4f9c7bb2-6a18-4422-9680-dd547e5296c9 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:24.504799 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4f9c7bb2-6a18-4422-9680-dd547e5296c9 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/8a6b2904-2edd-4e9e-b6fa-1d6249721f52" status: 200 len: 1315 microversion: 2.1 time: 0.546723 Sep 23 04:41:24.510768 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1282/2579] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:23 2022] GET /compute/v2.1/servers/8a6b2904-2edd-4e9e-b6fa-1d6249721f52 => generated 1315 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:24.519739 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c9a1c864-efee-4f6d-85b4-1ee46ab96c97 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:24.525184 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c9a1c864-efee-4f6d-85b4-1ee46ab96c97 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] [instance: 5ee8a1da-f229-4716-bc67-da23f07963bd] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:24.535966 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c9a1c864-efee-4f6d-85b4-1ee46ab96c97 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:24.536968 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c9a1c864-efee-4f6d-85b4-1ee46ab96c97 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:24.538381 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c9a1c864-efee-4f6d-85b4-1ee46ab96c97 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:24.542052 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-8114ddcf-8ff8-402e-972f-2381b1af8916 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.259722 Sep 23 04:41:24.542219 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c9a1c864-efee-4f6d-85b4-1ee46ab96c97 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:24.542708 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c9a1c864-efee-4f6d-85b4-1ee46ab96c97 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:24.543228 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c9a1c864-efee-4f6d-85b4-1ee46ab96c97 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:24.550098 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1298/2580] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:41:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 2269 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:41:24.555536 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-37a75737-a7a4-462c-b6a3-36fb93e7a3c7 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:24.556490 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-37a75737-a7a4-462c-b6a3-36fb93e7a3c7 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:24.563889 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-37a75737-a7a4-462c-b6a3-36fb93e7a3c7 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:24.564756 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-37a75737-a7a4-462c-b6a3-36fb93e7a3c7 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:24.565452 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-37a75737-a7a4-462c-b6a3-36fb93e7a3c7 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:24.566487 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-37a75737-a7a4-462c-b6a3-36fb93e7a3c7 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:24.567151 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-37a75737-a7a4-462c-b6a3-36fb93e7a3c7 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:24.567803 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-37a75737-a7a4-462c-b6a3-36fb93e7a3c7 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:25.069017 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c9a1c864-efee-4f6d-85b4-1ee46ab96c97 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace08d8e105e46e299773c5a1b96039f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a16a53325a4d61aef94281435e9726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:25.076755 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c9a1c864-efee-4f6d-85b4-1ee46ab96c97 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] 10.222.0.33 "GET /compute/v2.1/servers/5ee8a1da-f229-4716-bc67-da23f07963bd" status: 200 len: 1522 microversion: 2.1 time: 0.564421 Sep 23 04:41:25.083396 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1283/2581] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:24 2022] GET /compute/v2.1/servers/5ee8a1da-f229-4716-bc67-da23f07963bd => generated 1522 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:25.091736 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-60f79105-c137-4521-9595-42adfd81d972 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:25.096836 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-37a75737-a7a4-462c-b6a3-36fb93e7a3c7 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:25.097405 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-60f79105-c137-4521-9595-42adfd81d972 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] [instance: fde8e9cc-b3de-4af8-a6e5-d5ab50af4844] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:25.141100 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-37a75737-a7a4-462c-b6a3-36fb93e7a3c7 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:25.145859 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-37a75737-a7a4-462c-b6a3-36fb93e7a3c7 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:25.154457 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-37a75737-a7a4-462c-b6a3-36fb93e7a3c7 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1537 microversion: 2.91 time: 0.602806 Sep 23 04:41:25.175262 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1299/2582] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:41:24 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1537 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:41:25.187127 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-888900f9-96a3-4d6b-9c7f-80ced7f01440 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:25.189016 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-888900f9-96a3-4d6b-9c7f-80ced7f01440 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] [instance: dfb8f504-218a-471c-b7a8-70c498769f0e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:25.204098 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-888900f9-96a3-4d6b-9c7f-80ced7f01440 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:25.208048 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-888900f9-96a3-4d6b-9c7f-80ced7f01440 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:25.209228 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-888900f9-96a3-4d6b-9c7f-80ced7f01440 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:25.214708 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-888900f9-96a3-4d6b-9c7f-80ced7f01440 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:25.214708 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-888900f9-96a3-4d6b-9c7f-80ced7f01440 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:25.214708 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-888900f9-96a3-4d6b-9c7f-80ced7f01440 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:25.314509 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-60f79105-c137-4521-9595-42adfd81d972 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c1c2f05c7b48cfb2cd4ecb56a2a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8844923c06ca4a9e9fa774ed17c4fc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:25.328248 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-60f79105-c137-4521-9595-42adfd81d972 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] 10.222.0.33 "GET /compute/v2.1/servers/fde8e9cc-b3de-4af8-a6e5-d5ab50af4844" status: 200 len: 1213 microversion: 2.1 time: 0.243617 Sep 23 04:41:25.328925 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1284/2583] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:25 2022] GET /compute/v2.1/servers/fde8e9cc-b3de-4af8-a6e5-d5ab50af4844 => generated 1213 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:25.537932 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-bc364099-99e3-4de4-9aee-f9fbfc7b20ac tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:25.538871 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-bc364099-99e3-4de4-9aee-f9fbfc7b20ac tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 8a6b2904-2edd-4e9e-b6fa-1d6249721f52] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:25.550677 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bc364099-99e3-4de4-9aee-f9fbfc7b20ac tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:25.554473 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bc364099-99e3-4de4-9aee-f9fbfc7b20ac tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:25.555073 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bc364099-99e3-4de4-9aee-f9fbfc7b20ac tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:25.556077 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bc364099-99e3-4de4-9aee-f9fbfc7b20ac tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:25.558098 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bc364099-99e3-4de4-9aee-f9fbfc7b20ac tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:25.558713 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bc364099-99e3-4de4-9aee-f9fbfc7b20ac tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:26.387298 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-888900f9-96a3-4d6b-9c7f-80ced7f01440 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542c9592c76c4d4b9f3f16cea354398d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf77b55dfd8452e949229e4eb085283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:26.403875 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-888900f9-96a3-4d6b-9c7f-80ced7f01440 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] 10.222.0.33 "GET /compute/v2.1/servers/dfb8f504-218a-471c-b7a8-70c498769f0e" status: 200 len: 1371 microversion: 2.1 time: 1.227366 Sep 23 04:41:26.416382 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1300/2584] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:25 2022] GET /compute/v2.1/servers/dfb8f504-218a-471c-b7a8-70c498769f0e => generated 1371 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:26.446035 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-bc364099-99e3-4de4-9aee-f9fbfc7b20ac tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:26.461194 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1e641d53-5b21-4f7d-a289-77ba903c7adc tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:26.462570 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1e641d53-5b21-4f7d-a289-77ba903c7adc tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] [instance: 5ee8a1da-f229-4716-bc67-da23f07963bd] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:26.469145 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-bc364099-99e3-4de4-9aee-f9fbfc7b20ac tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/8a6b2904-2edd-4e9e-b6fa-1d6249721f52" status: 200 len: 1315 microversion: 2.1 time: 0.929025 Sep 23 04:41:26.472872 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e641d53-5b21-4f7d-a289-77ba903c7adc tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:26.473438 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e641d53-5b21-4f7d-a289-77ba903c7adc tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:26.473832 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e641d53-5b21-4f7d-a289-77ba903c7adc tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:26.476752 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1285/2585] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:25 2022] GET /compute/v2.1/servers/8a6b2904-2edd-4e9e-b6fa-1d6249721f52 => generated 1315 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:26.478088 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e641d53-5b21-4f7d-a289-77ba903c7adc tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:26.478826 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e641d53-5b21-4f7d-a289-77ba903c7adc tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:26.479650 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e641d53-5b21-4f7d-a289-77ba903c7adc tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:26.489597 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-20745500-f66f-4f90-adcb-0593c019c60b tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:26.491658 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-20745500-f66f-4f90-adcb-0593c019c60b tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:26.504284 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-20745500-f66f-4f90-adcb-0593c019c60b tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:26.504795 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-20745500-f66f-4f90-adcb-0593c019c60b tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:26.507739 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-20745500-f66f-4f90-adcb-0593c019c60b tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:26.508887 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-20745500-f66f-4f90-adcb-0593c019c60b tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:26.509679 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-20745500-f66f-4f90-adcb-0593c019c60b tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:26.511795 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-20745500-f66f-4f90-adcb-0593c019c60b tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:26.731697 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-20745500-f66f-4f90-adcb-0593c019c60b tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:26.748123 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-20745500-f66f-4f90-adcb-0593c019c60b tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:26.778538 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-20745500-f66f-4f90-adcb-0593c019c60b tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:26.778538 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-20745500-f66f-4f90-adcb-0593c019c60b tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1537 microversion: 2.91 time: 0.287895 Sep 23 04:41:26.778538 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1286/2586] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:41:26 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1537 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:41:26.778538 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0b615244-bb6b-451e-a3ca-403f9b4ebc75 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:26.778538 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-0b615244-bb6b-451e-a3ca-403f9b4ebc75 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] [instance: fde8e9cc-b3de-4af8-a6e5-d5ab50af4844] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:26.811981 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0b615244-bb6b-451e-a3ca-403f9b4ebc75 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:26.812965 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0b615244-bb6b-451e-a3ca-403f9b4ebc75 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:26.813677 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0b615244-bb6b-451e-a3ca-403f9b4ebc75 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:26.814708 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0b615244-bb6b-451e-a3ca-403f9b4ebc75 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:26.815446 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0b615244-bb6b-451e-a3ca-403f9b4ebc75 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:26.816094 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0b615244-bb6b-451e-a3ca-403f9b4ebc75 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:27.036427 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1e641d53-5b21-4f7d-a289-77ba903c7adc tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace08d8e105e46e299773c5a1b96039f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a16a53325a4d61aef94281435e9726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:27.049513 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-0b615244-bb6b-451e-a3ca-403f9b4ebc75 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c1c2f05c7b48cfb2cd4ecb56a2a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8844923c06ca4a9e9fa774ed17c4fc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:27.050144 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1e641d53-5b21-4f7d-a289-77ba903c7adc tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] 10.222.0.33 "GET /compute/v2.1/servers/5ee8a1da-f229-4716-bc67-da23f07963bd" status: 200 len: 1522 microversion: 2.1 time: 0.628843 Sep 23 04:41:27.052292 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:41:27.065960 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1301/2587] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:26 2022] GET /compute/v2.1/servers/5ee8a1da-f229-4716-bc67-da23f07963bd => generated 1522 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:27.076263 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0b615244-bb6b-451e-a3ca-403f9b4ebc75 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] 10.222.0.33 "GET /compute/v2.1/servers/fde8e9cc-b3de-4af8-a6e5-d5ab50af4844" status: 200 len: 1217 microversion: 2.1 time: 0.307954 Sep 23 04:41:27.077118 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1287/2588] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:26 2022] GET /compute/v2.1/servers/fde8e9cc-b3de-4af8-a6e5-d5ab50af4844 => generated 1217 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:27.431439 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7f913b9e-664c-45a3-93bd-506bb39c8f55 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:27.433146 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-7f913b9e-664c-45a3-93bd-506bb39c8f55 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] [instance: dfb8f504-218a-471c-b7a8-70c498769f0e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:27.442781 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7f913b9e-664c-45a3-93bd-506bb39c8f55 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:27.444962 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7f913b9e-664c-45a3-93bd-506bb39c8f55 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:27.444962 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7f913b9e-664c-45a3-93bd-506bb39c8f55 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:27.444962 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7f913b9e-664c-45a3-93bd-506bb39c8f55 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:27.445559 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7f913b9e-664c-45a3-93bd-506bb39c8f55 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:27.446031 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7f913b9e-664c-45a3-93bd-506bb39c8f55 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:27.493029 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b29090c0-c2d5-4cd1-b987-db1d029e21de tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:27.493764 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b29090c0-c2d5-4cd1-b987-db1d029e21de tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 8a6b2904-2edd-4e9e-b6fa-1d6249721f52] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:27.502051 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b29090c0-c2d5-4cd1-b987-db1d029e21de tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:27.503163 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b29090c0-c2d5-4cd1-b987-db1d029e21de tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:27.503614 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b29090c0-c2d5-4cd1-b987-db1d029e21de tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:27.504454 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b29090c0-c2d5-4cd1-b987-db1d029e21de tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:27.504873 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b29090c0-c2d5-4cd1-b987-db1d029e21de tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:27.505306 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b29090c0-c2d5-4cd1-b987-db1d029e21de tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:27.752467 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b29090c0-c2d5-4cd1-b987-db1d029e21de tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:27.762710 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-7f913b9e-664c-45a3-93bd-506bb39c8f55 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542c9592c76c4d4b9f3f16cea354398d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf77b55dfd8452e949229e4eb085283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:27.763384 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b29090c0-c2d5-4cd1-b987-db1d029e21de tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/8a6b2904-2edd-4e9e-b6fa-1d6249721f52" status: 200 len: 1315 microversion: 2.1 time: 0.274114 Sep 23 04:41:27.764706 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1288/2589] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:27 2022] GET /compute/v2.1/servers/8a6b2904-2edd-4e9e-b6fa-1d6249721f52 => generated 1315 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:41:27.774389 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-7f913b9e-664c-45a3-93bd-506bb39c8f55 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] 10.222.0.33 "GET /compute/v2.1/servers/dfb8f504-218a-471c-b7a8-70c498769f0e" status: 200 len: 1371 microversion: 2.1 time: 0.347868 Sep 23 04:41:27.776248 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1302/2590] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:27 2022] GET /compute/v2.1/servers/dfb8f504-218a-471c-b7a8-70c498769f0e => generated 1371 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:27.789752 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-3ae57cf0-ca89-404e-bb3c-e8fae7e5e447 req-f61909bf-2d3a-4cdd-a323-266e87f75778 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a6b2904-2edd-4e9e-b6fa-1d6249721f52", "tag": "391b0b37-303e-4cb7-84df-aafbc7c7b54b"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:41:27.801688 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9ed8e73b-8706-4601-8c88-fb3ee11975ee tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:27.802474 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-9ed8e73b-8706-4601-8c88-fb3ee11975ee tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:27.804656 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-3ae57cf0-ca89-404e-bb3c-e8fae7e5e447 req-f61909bf-2d3a-4cdd-a323-266e87f75778 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:27.805207 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-3ae57cf0-ca89-404e-bb3c-e8fae7e5e447 req-f61909bf-2d3a-4cdd-a323-266e87f75778 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:27.805843 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-3ae57cf0-ca89-404e-bb3c-e8fae7e5e447 req-f61909bf-2d3a-4cdd-a323-266e87f75778 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:27.814794 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9ed8e73b-8706-4601-8c88-fb3ee11975ee tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:27.815557 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9ed8e73b-8706-4601-8c88-fb3ee11975ee tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:27.816203 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9ed8e73b-8706-4601-8c88-fb3ee11975ee tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:27.817298 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9ed8e73b-8706-4601-8c88-fb3ee11975ee tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:27.817975 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9ed8e73b-8706-4601-8c88-fb3ee11975ee tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:27.818607 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9ed8e73b-8706-4601-8c88-fb3ee11975ee tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:27.827392 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-3ae57cf0-ca89-404e-bb3c-e8fae7e5e447 req-f61909bf-2d3a-4cdd-a323-266e87f75778 service nova] Creating event network-changed:391b0b37-303e-4cb7-84df-aafbc7c7b54b for instance 8a6b2904-2edd-4e9e-b6fa-1d6249721f52 on n-h1-846463-3 Sep 23 04:41:27.833369 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-3ae57cf0-ca89-404e-bb3c-e8fae7e5e447 req-f61909bf-2d3a-4cdd-a323-266e87f75778 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066797 Sep 23 04:41:27.836745 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1289/2591] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:41:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:41:27.969880 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-9ed8e73b-8706-4601-8c88-fb3ee11975ee tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:27.982231 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-9ed8e73b-8706-4601-8c88-fb3ee11975ee tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:27.984647 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-9ed8e73b-8706-4601-8c88-fb3ee11975ee tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:27.992065 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:41:27.994975 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-9ed8e73b-8706-4601-8c88-fb3ee11975ee tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1537 microversion: 2.91 time: 0.196403 Sep 23 04:41:27.995784 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1303/2592] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:41:27 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1537 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:41:28.079732 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-825636cf-013d-4a9f-9b7e-f77cba02ba09 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:28.079732 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-825636cf-013d-4a9f-9b7e-f77cba02ba09 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] [instance: 5ee8a1da-f229-4716-bc67-da23f07963bd] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:28.105353 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1a04dfeb-dc72-4e08-9279-78e977e894ea tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:28.105521 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-825636cf-013d-4a9f-9b7e-f77cba02ba09 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:28.105998 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-825636cf-013d-4a9f-9b7e-f77cba02ba09 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:28.106205 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1a04dfeb-dc72-4e08-9279-78e977e894ea tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] [instance: fde8e9cc-b3de-4af8-a6e5-d5ab50af4844] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:28.108629 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-825636cf-013d-4a9f-9b7e-f77cba02ba09 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:28.109592 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-825636cf-013d-4a9f-9b7e-f77cba02ba09 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:28.111349 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-825636cf-013d-4a9f-9b7e-f77cba02ba09 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:28.116227 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1a04dfeb-dc72-4e08-9279-78e977e894ea tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:28.116865 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1a04dfeb-dc72-4e08-9279-78e977e894ea tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:28.117306 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1a04dfeb-dc72-4e08-9279-78e977e894ea tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:28.118037 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1a04dfeb-dc72-4e08-9279-78e977e894ea tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:28.118468 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-825636cf-013d-4a9f-9b7e-f77cba02ba09 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:28.118608 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1a04dfeb-dc72-4e08-9279-78e977e894ea tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:28.118903 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1a04dfeb-dc72-4e08-9279-78e977e894ea tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:28.165357 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=100 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:41:28.285706 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1a04dfeb-dc72-4e08-9279-78e977e894ea tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c1c2f05c7b48cfb2cd4ecb56a2a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8844923c06ca4a9e9fa774ed17c4fc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:28.299194 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1a04dfeb-dc72-4e08-9279-78e977e894ea tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] 10.222.0.33 "GET /compute/v2.1/servers/fde8e9cc-b3de-4af8-a6e5-d5ab50af4844" status: 200 len: 1265 microversion: 2.1 time: 0.197945 Sep 23 04:41:28.299801 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1304/2593] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:28 2022] GET /compute/v2.1/servers/fde8e9cc-b3de-4af8-a6e5-d5ab50af4844 => generated 1265 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:41:28.568792 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-825636cf-013d-4a9f-9b7e-f77cba02ba09 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace08d8e105e46e299773c5a1b96039f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a16a53325a4d61aef94281435e9726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:28.581818 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-825636cf-013d-4a9f-9b7e-f77cba02ba09 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] 10.222.0.33 "GET /compute/v2.1/servers/5ee8a1da-f229-4716-bc67-da23f07963bd" status: 200 len: 1522 microversion: 2.1 time: 0.509327 Sep 23 04:41:28.597281 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1290/2594] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:28 2022] GET /compute/v2.1/servers/5ee8a1da-f229-4716-bc67-da23f07963bd => generated 1522 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:28.787366 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3ab3e3cd-c6cc-462d-988c-2f1392ffbf05 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:28.792515 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-3ab3e3cd-c6cc-462d-988c-2f1392ffbf05 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 8a6b2904-2edd-4e9e-b6fa-1d6249721f52] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:28.800322 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3ab3e3cd-c6cc-462d-988c-2f1392ffbf05 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:28.801039 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3ab3e3cd-c6cc-462d-988c-2f1392ffbf05 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:28.801647 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3ab3e3cd-c6cc-462d-988c-2f1392ffbf05 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:28.803319 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c08cd59c-a5d7-46a1-b18c-2720f624c92b tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:28.804309 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3ab3e3cd-c6cc-462d-988c-2f1392ffbf05 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:28.804960 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3ab3e3cd-c6cc-462d-988c-2f1392ffbf05 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:28.805446 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c08cd59c-a5d7-46a1-b18c-2720f624c92b tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] [instance: dfb8f504-218a-471c-b7a8-70c498769f0e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:28.806126 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3ab3e3cd-c6cc-462d-988c-2f1392ffbf05 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:28.814778 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c08cd59c-a5d7-46a1-b18c-2720f624c92b tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:28.816825 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c08cd59c-a5d7-46a1-b18c-2720f624c92b tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:28.817490 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c08cd59c-a5d7-46a1-b18c-2720f624c92b tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:28.818475 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c08cd59c-a5d7-46a1-b18c-2720f624c92b tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:28.819689 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c08cd59c-a5d7-46a1-b18c-2720f624c92b tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:28.820376 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c08cd59c-a5d7-46a1-b18c-2720f624c92b tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:29.228597 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-3ab3e3cd-c6cc-462d-988c-2f1392ffbf05 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:29.239268 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3ab3e3cd-c6cc-462d-988c-2f1392ffbf05 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/8a6b2904-2edd-4e9e-b6fa-1d6249721f52" status: 200 len: 1315 microversion: 2.1 time: 0.455691 Sep 23 04:41:29.254486 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1305/2595] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:28 2022] GET /compute/v2.1/servers/8a6b2904-2edd-4e9e-b6fa-1d6249721f52 => generated 1315 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:29.259108 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c08cd59c-a5d7-46a1-b18c-2720f624c92b tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542c9592c76c4d4b9f3f16cea354398d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf77b55dfd8452e949229e4eb085283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:29.261912 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-beecc466-07d3-4fe1-bc69-ddfdb3c1ceb2 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:29.261912 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-beecc466-07d3-4fe1-bc69-ddfdb3c1ceb2 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:29.271118 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c08cd59c-a5d7-46a1-b18c-2720f624c92b tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] 10.222.0.33 "GET /compute/v2.1/servers/dfb8f504-218a-471c-b7a8-70c498769f0e" status: 200 len: 1371 microversion: 2.1 time: 0.471911 Sep 23 04:41:29.274846 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1291/2596] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:28 2022] GET /compute/v2.1/servers/dfb8f504-218a-471c-b7a8-70c498769f0e => generated 1371 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:29.278739 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-beecc466-07d3-4fe1-bc69-ddfdb3c1ceb2 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:29.279255 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-beecc466-07d3-4fe1-bc69-ddfdb3c1ceb2 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:29.279708 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-beecc466-07d3-4fe1-bc69-ddfdb3c1ceb2 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:29.280437 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-beecc466-07d3-4fe1-bc69-ddfdb3c1ceb2 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:29.280905 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-beecc466-07d3-4fe1-bc69-ddfdb3c1ceb2 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:29.281334 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-beecc466-07d3-4fe1-bc69-ddfdb3c1ceb2 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:29.326351 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5fef1d66-8285-4e9a-9047-8afb74c5e67e tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:29.327236 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5fef1d66-8285-4e9a-9047-8afb74c5e67e tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] [instance: fde8e9cc-b3de-4af8-a6e5-d5ab50af4844] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:29.356409 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5fef1d66-8285-4e9a-9047-8afb74c5e67e tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:29.357137 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5fef1d66-8285-4e9a-9047-8afb74c5e67e tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:29.361332 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5fef1d66-8285-4e9a-9047-8afb74c5e67e tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:29.362323 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5fef1d66-8285-4e9a-9047-8afb74c5e67e tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:29.371149 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5fef1d66-8285-4e9a-9047-8afb74c5e67e tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:29.371149 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5fef1d66-8285-4e9a-9047-8afb74c5e67e tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:29.417545 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-beecc466-07d3-4fe1-bc69-ddfdb3c1ceb2 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:29.427778 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-beecc466-07d3-4fe1-bc69-ddfdb3c1ceb2 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:29.429237 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-beecc466-07d3-4fe1-bc69-ddfdb3c1ceb2 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:29.449246 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-beecc466-07d3-4fe1-bc69-ddfdb3c1ceb2 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1537 microversion: 2.91 time: 0.189177 Sep 23 04:41:29.449936 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1306/2597] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:41:29 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1537 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:41:29.524944 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-5fef1d66-8285-4e9a-9047-8afb74c5e67e tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c1c2f05c7b48cfb2cd4ecb56a2a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8844923c06ca4a9e9fa774ed17c4fc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:29.533609 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5fef1d66-8285-4e9a-9047-8afb74c5e67e tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] 10.222.0.33 "GET /compute/v2.1/servers/fde8e9cc-b3de-4af8-a6e5-d5ab50af4844" status: 200 len: 1273 microversion: 2.1 time: 0.211341 Sep 23 04:41:29.534229 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1292/2598] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:29 2022] GET /compute/v2.1/servers/fde8e9cc-b3de-4af8-a6e5-d5ab50af4844 => generated 1273 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:41:29.608215 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b2f64535-4874-4c98-b859-a30a3bfdf30c tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:29.609193 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b2f64535-4874-4c98-b859-a30a3bfdf30c tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] [instance: 5ee8a1da-f229-4716-bc67-da23f07963bd] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:29.616132 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b2f64535-4874-4c98-b859-a30a3bfdf30c tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:29.616892 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b2f64535-4874-4c98-b859-a30a3bfdf30c tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:29.618010 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b2f64535-4874-4c98-b859-a30a3bfdf30c tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:29.620403 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b2f64535-4874-4c98-b859-a30a3bfdf30c tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:29.621059 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b2f64535-4874-4c98-b859-a30a3bfdf30c tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:29.622610 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b2f64535-4874-4c98-b859-a30a3bfdf30c tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:29.811838 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-20f808f0-1f74-4e2c-b2a4-1e054b81f7cf tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Action: 'create', calling method: .version_select at 0x7ff1bb95c940>, body: {"keypair": {"name": "tempest-keypair-396311470", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPEx65WPt40sxgfAfJ/0UBDqX1bjTuhpJFxK94Mt4teIWuok8fJh7ZffqNzAxXeMHMmnHIu2BNmeinzT4klvYDFkeT7EHfW1kZA6uVPu0ukg2Oxl78cC0LrAzpp62dXZzQ=="}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:41:29.829615 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b2f64535-4874-4c98-b859-a30a3bfdf30c tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace08d8e105e46e299773c5a1b96039f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a16a53325a4d61aef94281435e9726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:29.830115 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-20f808f0-1f74-4e2c-b2a4-1e054b81f7cf tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Getting quotas for project d56a38177bdb4624b9abe512ae98266b. Resources: {'key_pairs'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:41:29.834924 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-20f808f0-1f74-4e2c-b2a4-1e054b81f7cf tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Getting quotas for user e6ade7cab39345e29e7ee7a977bc80f8 and project d56a38177bdb4624b9abe512ae98266b. Resources: {'key_pairs'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:41:29.838858 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b2f64535-4874-4c98-b859-a30a3bfdf30c tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] 10.222.0.33 "GET /compute/v2.1/servers/5ee8a1da-f229-4716-bc67-da23f07963bd" status: 200 len: 1522 microversion: 2.1 time: 0.234163 Sep 23 04:41:29.839622 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1307/2599] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:29 2022] GET /compute/v2.1/servers/5ee8a1da-f229-4716-bc67-da23f07963bd => generated 1522 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:29.909029 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-20f808f0-1f74-4e2c-b2a4-1e054b81f7cf tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.281325 Sep 23 04:41:29.909607 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1293/2600] 10.222.0.33 () {60 vars in 1159 bytes} [Fri Sep 23 04:41:29 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:41:30.269014 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f746d889-6675-4137-921a-35cfc15800f2 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:30.270053 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f746d889-6675-4137-921a-35cfc15800f2 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 8a6b2904-2edd-4e9e-b6fa-1d6249721f52] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:30.280895 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f746d889-6675-4137-921a-35cfc15800f2 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:30.281493 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f746d889-6675-4137-921a-35cfc15800f2 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:30.282012 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f746d889-6675-4137-921a-35cfc15800f2 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:30.282757 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f746d889-6675-4137-921a-35cfc15800f2 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:30.283229 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f746d889-6675-4137-921a-35cfc15800f2 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:30.283656 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f746d889-6675-4137-921a-35cfc15800f2 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:30.302032 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f95001e9-bd82-45c2-bd25-08f27bde49ce tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:30.302667 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f95001e9-bd82-45c2-bd25-08f27bde49ce tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] [instance: dfb8f504-218a-471c-b7a8-70c498769f0e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:30.309982 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f95001e9-bd82-45c2-bd25-08f27bde49ce tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:30.310749 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f95001e9-bd82-45c2-bd25-08f27bde49ce tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:30.311195 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f95001e9-bd82-45c2-bd25-08f27bde49ce tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:30.312075 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f95001e9-bd82-45c2-bd25-08f27bde49ce tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:30.312737 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f95001e9-bd82-45c2-bd25-08f27bde49ce tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:30.313395 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f95001e9-bd82-45c2-bd25-08f27bde49ce tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:30.560843 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f746d889-6675-4137-921a-35cfc15800f2 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:30.574079 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f746d889-6675-4137-921a-35cfc15800f2 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/8a6b2904-2edd-4e9e-b6fa-1d6249721f52" status: 200 len: 1315 microversion: 2.1 time: 0.305162 Sep 23 04:41:30.574079 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1308/2601] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:30 2022] GET /compute/v2.1/servers/8a6b2904-2edd-4e9e-b6fa-1d6249721f52 => generated 1315 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:30.575971 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2d814eb4-c853-41b0-8e62-27fd2e390e3d tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:30.576998 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-2d814eb4-c853-41b0-8e62-27fd2e390e3d tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:30.585680 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2d814eb4-c853-41b0-8e62-27fd2e390e3d tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:30.586441 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2d814eb4-c853-41b0-8e62-27fd2e390e3d tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:30.586883 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2d814eb4-c853-41b0-8e62-27fd2e390e3d tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:30.587600 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2d814eb4-c853-41b0-8e62-27fd2e390e3d tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:30.588092 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2d814eb4-c853-41b0-8e62-27fd2e390e3d tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:30.590107 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2d814eb4-c853-41b0-8e62-27fd2e390e3d tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:30.596336 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f95001e9-bd82-45c2-bd25-08f27bde49ce tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542c9592c76c4d4b9f3f16cea354398d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf77b55dfd8452e949229e4eb085283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:30.604986 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f95001e9-bd82-45c2-bd25-08f27bde49ce tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] 10.222.0.33 "GET /compute/v2.1/servers/dfb8f504-218a-471c-b7a8-70c498769f0e" status: 200 len: 1371 microversion: 2.1 time: 0.306805 Sep 23 04:41:30.617917 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1294/2602] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:30 2022] GET /compute/v2.1/servers/dfb8f504-218a-471c-b7a8-70c498769f0e => generated 1371 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:30.617917 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-17ed18c4-753c-4932-ad7c-3bd0d8cf44f1 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:30.617917 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-17ed18c4-753c-4932-ad7c-3bd0d8cf44f1 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] [instance: fde8e9cc-b3de-4af8-a6e5-d5ab50af4844] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:30.619043 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-17ed18c4-753c-4932-ad7c-3bd0d8cf44f1 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:30.620434 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-17ed18c4-753c-4932-ad7c-3bd0d8cf44f1 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:30.621115 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-17ed18c4-753c-4932-ad7c-3bd0d8cf44f1 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:30.622104 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-17ed18c4-753c-4932-ad7c-3bd0d8cf44f1 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:30.622785 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-17ed18c4-753c-4932-ad7c-3bd0d8cf44f1 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:30.623447 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-17ed18c4-753c-4932-ad7c-3bd0d8cf44f1 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:30.727236 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2d814eb4-c853-41b0-8e62-27fd2e390e3d tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:30.736872 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2d814eb4-c853-41b0-8e62-27fd2e390e3d tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:30.738606 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2d814eb4-c853-41b0-8e62-27fd2e390e3d tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:30.747813 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2d814eb4-c853-41b0-8e62-27fd2e390e3d tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1537 microversion: 2.91 time: 0.176302 Sep 23 04:41:30.748416 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1309/2603] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:41:30 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1537 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:41:30.749106 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-17ed18c4-753c-4932-ad7c-3bd0d8cf44f1 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c1c2f05c7b48cfb2cd4ecb56a2a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8844923c06ca4a9e9fa774ed17c4fc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:30.765070 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-17ed18c4-753c-4932-ad7c-3bd0d8cf44f1 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] 10.222.0.33 "GET /compute/v2.1/servers/fde8e9cc-b3de-4af8-a6e5-d5ab50af4844" status: 200 len: 1271 microversion: 2.1 time: 0.157292 Sep 23 04:41:30.774664 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1295/2604] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:30 2022] GET /compute/v2.1/servers/fde8e9cc-b3de-4af8-a6e5-d5ab50af4844 => generated 1271 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:30.864061 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0da58314-ad60-4836-9677-a699fdbc8009 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:30.865351 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-0da58314-ad60-4836-9677-a699fdbc8009 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] [instance: 5ee8a1da-f229-4716-bc67-da23f07963bd] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:30.873742 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0da58314-ad60-4836-9677-a699fdbc8009 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:30.874608 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0da58314-ad60-4836-9677-a699fdbc8009 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:30.881206 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0da58314-ad60-4836-9677-a699fdbc8009 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:30.881206 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0da58314-ad60-4836-9677-a699fdbc8009 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:30.881206 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0da58314-ad60-4836-9677-a699fdbc8009 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:30.881206 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0da58314-ad60-4836-9677-a699fdbc8009 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:31.099520 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-0da58314-ad60-4836-9677-a699fdbc8009 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace08d8e105e46e299773c5a1b96039f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a16a53325a4d61aef94281435e9726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:31.108612 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0da58314-ad60-4836-9677-a699fdbc8009 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] 10.222.0.33 "GET /compute/v2.1/servers/5ee8a1da-f229-4716-bc67-da23f07963bd" status: 200 len: 1522 microversion: 2.1 time: 0.248858 Sep 23 04:41:31.117962 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1310/2605] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:30 2022] GET /compute/v2.1/servers/5ee8a1da-f229-4716-bc67-da23f07963bd => generated 1522 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:31.595514 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c1f78ec1-f200-4bd6-973f-2d842a1b6bda tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:31.597669 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c1f78ec1-f200-4bd6-973f-2d842a1b6bda tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 8a6b2904-2edd-4e9e-b6fa-1d6249721f52] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:31.606195 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:41:31.612388 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c1f78ec1-f200-4bd6-973f-2d842a1b6bda tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:31.613616 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c1f78ec1-f200-4bd6-973f-2d842a1b6bda tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:31.614399 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c1f78ec1-f200-4bd6-973f-2d842a1b6bda tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:31.615428 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c1f78ec1-f200-4bd6-973f-2d842a1b6bda tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:31.616122 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c1f78ec1-f200-4bd6-973f-2d842a1b6bda tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:31.617019 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c1f78ec1-f200-4bd6-973f-2d842a1b6bda tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:31.633407 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-df6b3deb-e2a2-417e-a4e5-930293e464c3 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:31.634205 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-df6b3deb-e2a2-417e-a4e5-930293e464c3 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] [instance: dfb8f504-218a-471c-b7a8-70c498769f0e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:31.646154 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-df6b3deb-e2a2-417e-a4e5-930293e464c3 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:31.648538 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-df6b3deb-e2a2-417e-a4e5-930293e464c3 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:31.653233 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-df6b3deb-e2a2-417e-a4e5-930293e464c3 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:31.653233 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-df6b3deb-e2a2-417e-a4e5-930293e464c3 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:31.653233 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-df6b3deb-e2a2-417e-a4e5-930293e464c3 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:31.654081 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-df6b3deb-e2a2-417e-a4e5-930293e464c3 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:32.155101 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-df6b3deb-e2a2-417e-a4e5-930293e464c3 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542c9592c76c4d4b9f3f16cea354398d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf77b55dfd8452e949229e4eb085283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:32.157659 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c1f78ec1-f200-4bd6-973f-2d842a1b6bda tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:32.165355 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-df6b3deb-e2a2-417e-a4e5-930293e464c3 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] 10.222.0.33 "GET /compute/v2.1/servers/dfb8f504-218a-471c-b7a8-70c498769f0e" status: 200 len: 1371 microversion: 2.1 time: 0.536261 Sep 23 04:41:32.167227 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1311/2606] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:31 2022] GET /compute/v2.1/servers/dfb8f504-218a-471c-b7a8-70c498769f0e => generated 1371 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:41:32.173312 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-937d9719-9ea3-4665-942e-ea9b271c7d75 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:32.174184 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-937d9719-9ea3-4665-942e-ea9b271c7d75 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:32.179530 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c1f78ec1-f200-4bd6-973f-2d842a1b6bda tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/8a6b2904-2edd-4e9e-b6fa-1d6249721f52" status: 200 len: 1315 microversion: 2.1 time: 0.590071 Sep 23 04:41:32.185162 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-937d9719-9ea3-4665-942e-ea9b271c7d75 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:32.185671 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-937d9719-9ea3-4665-942e-ea9b271c7d75 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:32.186155 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-937d9719-9ea3-4665-942e-ea9b271c7d75 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:32.186877 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-937d9719-9ea3-4665-942e-ea9b271c7d75 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:32.187343 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-937d9719-9ea3-4665-942e-ea9b271c7d75 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:32.187774 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-937d9719-9ea3-4665-942e-ea9b271c7d75 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:32.191752 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1296/2607] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:31 2022] GET /compute/v2.1/servers/8a6b2904-2edd-4e9e-b6fa-1d6249721f52 => generated 1315 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:32.204808 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-25b88b96-326d-4084-9f17-120d46593e01 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:32.206736 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-25b88b96-326d-4084-9f17-120d46593e01 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] [instance: fde8e9cc-b3de-4af8-a6e5-d5ab50af4844] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:32.224350 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-25b88b96-326d-4084-9f17-120d46593e01 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:32.224893 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-25b88b96-326d-4084-9f17-120d46593e01 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:32.225355 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-25b88b96-326d-4084-9f17-120d46593e01 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:32.226177 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-25b88b96-326d-4084-9f17-120d46593e01 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:32.226647 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-25b88b96-326d-4084-9f17-120d46593e01 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:32.227084 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-25b88b96-326d-4084-9f17-120d46593e01 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:32.264292 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-937d9719-9ea3-4665-942e-ea9b271c7d75 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:32.273009 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-937d9719-9ea3-4665-942e-ea9b271c7d75 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:32.274876 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-937d9719-9ea3-4665-942e-ea9b271c7d75 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:32.281396 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-937d9719-9ea3-4665-942e-ea9b271c7d75 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1537 microversion: 2.91 time: 0.112836 Sep 23 04:41:32.282053 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1312/2608] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:41:32 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1537 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:41:32.286567 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d5a560e0-f8c5-4c51-9f22-acbecbe003d7 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:32.287176 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d5a560e0-f8c5-4c51-9f22-acbecbe003d7 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] [instance: 5ee8a1da-f229-4716-bc67-da23f07963bd] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:32.293765 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d5a560e0-f8c5-4c51-9f22-acbecbe003d7 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:32.294296 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d5a560e0-f8c5-4c51-9f22-acbecbe003d7 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:32.294798 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d5a560e0-f8c5-4c51-9f22-acbecbe003d7 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:32.295504 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d5a560e0-f8c5-4c51-9f22-acbecbe003d7 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:32.295972 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d5a560e0-f8c5-4c51-9f22-acbecbe003d7 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:32.296400 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d5a560e0-f8c5-4c51-9f22-acbecbe003d7 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:32.461931 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-25b88b96-326d-4084-9f17-120d46593e01 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c1c2f05c7b48cfb2cd4ecb56a2a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8844923c06ca4a9e9fa774ed17c4fc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:32.461931 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-25b88b96-326d-4084-9f17-120d46593e01 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] 10.222.0.33 "GET /compute/v2.1/servers/fde8e9cc-b3de-4af8-a6e5-d5ab50af4844" status: 200 len: 1313 microversion: 2.1 time: 0.234014 Sep 23 04:41:32.461931 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1297/2609] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:32 2022] GET /compute/v2.1/servers/fde8e9cc-b3de-4af8-a6e5-d5ab50af4844 => generated 1313 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:32.467260 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d5a560e0-f8c5-4c51-9f22-acbecbe003d7 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace08d8e105e46e299773c5a1b96039f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a16a53325a4d61aef94281435e9726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:32.476141 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d5a560e0-f8c5-4c51-9f22-acbecbe003d7 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] 10.222.0.33 "GET /compute/v2.1/servers/5ee8a1da-f229-4716-bc67-da23f07963bd" status: 200 len: 1522 microversion: 2.1 time: 0.193026 Sep 23 04:41:32.476741 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1313/2610] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:32 2022] GET /compute/v2.1/servers/5ee8a1da-f229-4716-bc67-da23f07963bd => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:33.200330 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0e8c17dd-d86e-4981-9386-abb38f8afb15 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:33.201800 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-0e8c17dd-d86e-4981-9386-abb38f8afb15 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] [instance: dfb8f504-218a-471c-b7a8-70c498769f0e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:33.212178 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0e8c17dd-d86e-4981-9386-abb38f8afb15 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:33.212981 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0e8c17dd-d86e-4981-9386-abb38f8afb15 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:33.214009 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0e8c17dd-d86e-4981-9386-abb38f8afb15 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:33.216360 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0e8c17dd-d86e-4981-9386-abb38f8afb15 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:33.217319 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0e8c17dd-d86e-4981-9386-abb38f8afb15 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:33.217996 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0e8c17dd-d86e-4981-9386-abb38f8afb15 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:33.227768 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-fed617a9-d302-4b79-b2e1-04e6bc26258c req-29a26903-298c-4b4d-8294-4323f39345a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfb8f504-218a-471c-b7a8-70c498769f0e", "name": "network-vif-plugged", "status": "completed", "tag": "e03d6cb1-0498-436c-ab0a-43f410f1eaf8"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:41:33.242216 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-fed617a9-d302-4b79-b2e1-04e6bc26258c req-29a26903-298c-4b4d-8294-4323f39345a3 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:33.242949 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-fed617a9-d302-4b79-b2e1-04e6bc26258c req-29a26903-298c-4b4d-8294-4323f39345a3 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:33.243527 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-fed617a9-d302-4b79-b2e1-04e6bc26258c req-29a26903-298c-4b4d-8294-4323f39345a3 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:33.263484 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-fed617a9-d302-4b79-b2e1-04e6bc26258c req-29a26903-298c-4b4d-8294-4323f39345a3 service nova] Creating event network-vif-plugged:e03d6cb1-0498-436c-ab0a-43f410f1eaf8 for instance dfb8f504-218a-471c-b7a8-70c498769f0e on n-h2-846463-3 Sep 23 04:41:33.270146 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-fed617a9-d302-4b79-b2e1-04e6bc26258c req-29a26903-298c-4b4d-8294-4323f39345a3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133928 Sep 23 04:41:33.271259 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1298/2611] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:41:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:41:33.277582 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ace65517-05ac-4414-93c2-0a2ec78122d3 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:33.281653 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-ace65517-05ac-4414-93c2-0a2ec78122d3 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 8a6b2904-2edd-4e9e-b6fa-1d6249721f52] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:33.287575 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ace65517-05ac-4414-93c2-0a2ec78122d3 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:33.290300 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ace65517-05ac-4414-93c2-0a2ec78122d3 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:33.291418 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ace65517-05ac-4414-93c2-0a2ec78122d3 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:33.292417 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ace65517-05ac-4414-93c2-0a2ec78122d3 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:33.293694 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ace65517-05ac-4414-93c2-0a2ec78122d3 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:33.294440 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ace65517-05ac-4414-93c2-0a2ec78122d3 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:33.528460 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-0e8c17dd-d86e-4981-9386-abb38f8afb15 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542c9592c76c4d4b9f3f16cea354398d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf77b55dfd8452e949229e4eb085283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:33.543275 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0e8c17dd-d86e-4981-9386-abb38f8afb15 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] 10.222.0.33 "GET /compute/v2.1/servers/dfb8f504-218a-471c-b7a8-70c498769f0e" status: 200 len: 1371 microversion: 2.1 time: 0.348322 Sep 23 04:41:33.545527 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1314/2612] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:33 2022] GET /compute/v2.1/servers/dfb8f504-218a-471c-b7a8-70c498769f0e => generated 1371 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:41:33.562389 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-82a1363f-288c-4959-82a2-0f754e42a580 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:33.569492 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-82a1363f-288c-4959-82a2-0f754e42a580 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:33.571302 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ace65517-05ac-4414-93c2-0a2ec78122d3 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:33.582568 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ace65517-05ac-4414-93c2-0a2ec78122d3 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/8a6b2904-2edd-4e9e-b6fa-1d6249721f52" status: 200 len: 1315 microversion: 2.1 time: 0.309195 Sep 23 04:41:33.585855 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1299/2613] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:33 2022] GET /compute/v2.1/servers/8a6b2904-2edd-4e9e-b6fa-1d6249721f52 => generated 1315 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:33.607746 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-82a1363f-288c-4959-82a2-0f754e42a580 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:33.608421 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-82a1363f-288c-4959-82a2-0f754e42a580 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:33.609134 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-82a1363f-288c-4959-82a2-0f754e42a580 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:33.611359 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-02ccf166-1cd6-4538-9e2f-87d21bd78c48 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:33.612284 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-82a1363f-288c-4959-82a2-0f754e42a580 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:33.612851 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-82a1363f-288c-4959-82a2-0f754e42a580 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:33.613382 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-82a1363f-288c-4959-82a2-0f754e42a580 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:33.614230 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-02ccf166-1cd6-4538-9e2f-87d21bd78c48 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] [instance: fde8e9cc-b3de-4af8-a6e5-d5ab50af4844] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:33.635609 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-02ccf166-1cd6-4538-9e2f-87d21bd78c48 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:33.636785 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-02ccf166-1cd6-4538-9e2f-87d21bd78c48 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:33.637427 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-02ccf166-1cd6-4538-9e2f-87d21bd78c48 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:33.638220 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-02ccf166-1cd6-4538-9e2f-87d21bd78c48 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:33.638696 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-02ccf166-1cd6-4538-9e2f-87d21bd78c48 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:33.639469 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-02ccf166-1cd6-4538-9e2f-87d21bd78c48 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:33.721629 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-82a1363f-288c-4959-82a2-0f754e42a580 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:33.732763 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-82a1363f-288c-4959-82a2-0f754e42a580 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:33.734255 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-82a1363f-288c-4959-82a2-0f754e42a580 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:33.739534 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-82a1363f-288c-4959-82a2-0f754e42a580 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1537 microversion: 2.91 time: 0.192724 Sep 23 04:41:33.753930 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1315/2614] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:41:33 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1537 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:41:33.753930 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b1675370-5e7f-4e59-8589-5bc5a734941a tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:33.753930 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b1675370-5e7f-4e59-8589-5bc5a734941a tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] [instance: 5ee8a1da-f229-4716-bc67-da23f07963bd] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:33.776930 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b1675370-5e7f-4e59-8589-5bc5a734941a tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:33.777338 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b1675370-5e7f-4e59-8589-5bc5a734941a tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:33.777807 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b1675370-5e7f-4e59-8589-5bc5a734941a tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:33.780721 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b1675370-5e7f-4e59-8589-5bc5a734941a tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:33.781412 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b1675370-5e7f-4e59-8589-5bc5a734941a tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:33.786037 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b1675370-5e7f-4e59-8589-5bc5a734941a tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:33.983960 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-02ccf166-1cd6-4538-9e2f-87d21bd78c48 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c1c2f05c7b48cfb2cd4ecb56a2a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8844923c06ca4a9e9fa774ed17c4fc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:33.992947 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-02ccf166-1cd6-4538-9e2f-87d21bd78c48 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] 10.222.0.33 "GET /compute/v2.1/servers/fde8e9cc-b3de-4af8-a6e5-d5ab50af4844" status: 200 len: 1313 microversion: 2.1 time: 0.391709 Sep 23 04:41:34.004665 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=4 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:41:34.013123 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1300/2615] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:33 2022] GET /compute/v2.1/servers/fde8e9cc-b3de-4af8-a6e5-d5ab50af4844 => generated 1313 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:34.017148 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b1675370-5e7f-4e59-8589-5bc5a734941a tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace08d8e105e46e299773c5a1b96039f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a16a53325a4d61aef94281435e9726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:34.027916 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b1675370-5e7f-4e59-8589-5bc5a734941a tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] 10.222.0.33 "GET /compute/v2.1/servers/5ee8a1da-f229-4716-bc67-da23f07963bd" status: 200 len: 1522 microversion: 2.1 time: 0.285717 Sep 23 04:41:34.029435 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1316/2616] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:33 2022] GET /compute/v2.1/servers/5ee8a1da-f229-4716-bc67-da23f07963bd => generated 1522 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:34.102872 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-fe2100cd-3fa0-4934-81ee-3165ca75f4dc req-6ccdbe0b-bd61-4de3-94ce-9583a8c50f97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fde8e9cc-b3de-4af8-a6e5-d5ab50af4844", "tag": "31c78d18-fe06-4beb-bab2-05a3371ba287"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:41:34.114889 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-fe2100cd-3fa0-4934-81ee-3165ca75f4dc req-6ccdbe0b-bd61-4de3-94ce-9583a8c50f97 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:34.116304 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-fe2100cd-3fa0-4934-81ee-3165ca75f4dc req-6ccdbe0b-bd61-4de3-94ce-9583a8c50f97 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:34.116304 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-fe2100cd-3fa0-4934-81ee-3165ca75f4dc req-6ccdbe0b-bd61-4de3-94ce-9583a8c50f97 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:34.127660 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-fe2100cd-3fa0-4934-81ee-3165ca75f4dc req-6ccdbe0b-bd61-4de3-94ce-9583a8c50f97 service nova] Creating event network-changed:31c78d18-fe06-4beb-bab2-05a3371ba287 for instance fde8e9cc-b3de-4af8-a6e5-d5ab50af4844 on n-h2-846463-3 Sep 23 04:41:34.133284 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-fe2100cd-3fa0-4934-81ee-3165ca75f4dc req-6ccdbe0b-bd61-4de3-94ce-9583a8c50f97 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117719 Sep 23 04:41:34.133284 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1301/2617] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:41:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:41:34.231825 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b7c1d308-03e7-4cc0-aed8-64f09c24bc10 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "8761f76e-e338-4652-a329-9ba94d9d9fae"}], "security_groups": [{"name": "tempest-securitygroup--868736301"}], "key_name": "tempest-keypair-396311470", "user_data": "}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:41:34.249734 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=14 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:41:34.376920 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.neutron [None req-b7c1d308-03e7-4cc0-aed8-64f09c24bc10 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] validate_networks() for [('8761f76e-e338-4652-a329-9ba94d9d9fae', None, None, None, None, None)] {{(pid=122699) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:41:34.571106 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3bb32ec6-c180-4941-bee6-c3091b3ede5b tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:34.572010 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3bb32ec6-c180-4941-bee6-c3091b3ede5b tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] [instance: dfb8f504-218a-471c-b7a8-70c498769f0e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:34.586091 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3bb32ec6-c180-4941-bee6-c3091b3ede5b tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:34.586603 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3bb32ec6-c180-4941-bee6-c3091b3ede5b tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:34.587048 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3bb32ec6-c180-4941-bee6-c3091b3ede5b tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:34.587859 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3bb32ec6-c180-4941-bee6-c3091b3ede5b tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:34.592989 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3bb32ec6-c180-4941-bee6-c3091b3ede5b tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:34.603438 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3bb32ec6-c180-4941-bee6-c3091b3ede5b tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:34.964901 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-3bb32ec6-c180-4941-bee6-c3091b3ede5b tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542c9592c76c4d4b9f3f16cea354398d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf77b55dfd8452e949229e4eb085283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:34.975400 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3bb32ec6-c180-4941-bee6-c3091b3ede5b tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] 10.222.0.33 "GET /compute/v2.1/servers/dfb8f504-218a-471c-b7a8-70c498769f0e" status: 200 len: 1371 microversion: 2.1 time: 0.408594 Sep 23 04:41:34.989754 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1302/2618] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:34 2022] GET /compute/v2.1/servers/dfb8f504-218a-471c-b7a8-70c498769f0e => generated 1371 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:34.989754 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a6abf482-d11b-46ec-9020-350184f8f252 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:34.989754 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a6abf482-d11b-46ec-9020-350184f8f252 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 8a6b2904-2edd-4e9e-b6fa-1d6249721f52] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:35.011694 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a6abf482-d11b-46ec-9020-350184f8f252 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:35.011694 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a6abf482-d11b-46ec-9020-350184f8f252 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:35.011694 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a6abf482-d11b-46ec-9020-350184f8f252 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:35.011694 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a6abf482-d11b-46ec-9020-350184f8f252 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:35.011694 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a6abf482-d11b-46ec-9020-350184f8f252 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:35.011694 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a6abf482-d11b-46ec-9020-350184f8f252 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:35.128822 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-b7c1d308-03e7-4cc0-aed8-64f09c24bc10 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Flavor limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:41:35.129245 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-b7c1d308-03e7-4cc0-aed8-64f09c24bc10 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Image limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:41:35.129714 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-b7c1d308-03e7-4cc0-aed8-64f09c24bc10 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Flavor pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:41:35.130152 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-b7c1d308-03e7-4cc0-aed8-64f09c24bc10 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Image pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:41:35.130692 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-b7c1d308-03e7-4cc0-aed8-64f09c24bc10 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:41:35.143474 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b7c1d308-03e7-4cc0-aed8-64f09c24bc10 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:35.144278 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b7c1d308-03e7-4cc0-aed8-64f09c24bc10 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:35.144912 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b7c1d308-03e7-4cc0-aed8-64f09c24bc10 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:35.145834 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b7c1d308-03e7-4cc0-aed8-64f09c24bc10 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:35.146531 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b7c1d308-03e7-4cc0-aed8-64f09c24bc10 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:35.147364 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b7c1d308-03e7-4cc0-aed8-64f09c24bc10 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:35.167713 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-b7c1d308-03e7-4cc0-aed8-64f09c24bc10 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Getting quotas for project d56a38177bdb4624b9abe512ae98266b. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:41:35.173389 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-b7c1d308-03e7-4cc0-aed8-64f09c24bc10 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Getting quotas for user e6ade7cab39345e29e7ee7a977bc80f8 and project d56a38177bdb4624b9abe512ae98266b. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:41:35.188352 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b7c1d308-03e7-4cc0-aed8-64f09c24bc10 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Going to run 1 instances... {{(pid=122699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:41:35.190995 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b7c1d308-03e7-4cc0-aed8-64f09c24bc10 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] [instance: 4fe42fc2-8cfa-4571-9282-fa4a6fcd75c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:41:35.281205 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a6abf482-d11b-46ec-9020-350184f8f252 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:35.292366 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a6abf482-d11b-46ec-9020-350184f8f252 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/8a6b2904-2edd-4e9e-b6fa-1d6249721f52" status: 200 len: 1315 microversion: 2.1 time: 0.310063 Sep 23 04:41:35.293152 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1303/2619] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:34 2022] GET /compute/v2.1/servers/8a6b2904-2edd-4e9e-b6fa-1d6249721f52 => generated 1315 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:35.297513 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-53261bb2-0c9a-4afe-9216-6cdf628aab04 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:35.298152 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-53261bb2-0c9a-4afe-9216-6cdf628aab04 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:35.308410 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b7c1d308-03e7-4cc0-aed8-64f09c24bc10 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.089819 Sep 23 04:41:35.310752 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1317/2620] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:41:34 2022] POST /compute/v2.1/servers => generated 408 bytes in 1093 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:41:35.314516 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-53261bb2-0c9a-4afe-9216-6cdf628aab04 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:35.315020 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-53261bb2-0c9a-4afe-9216-6cdf628aab04 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:35.315467 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-53261bb2-0c9a-4afe-9216-6cdf628aab04 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:35.316177 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-53261bb2-0c9a-4afe-9216-6cdf628aab04 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:35.316614 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b892c5c2-c8d5-4a5a-a3b6-f9a83202d588 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:35.316769 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-53261bb2-0c9a-4afe-9216-6cdf628aab04 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:35.317047 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-53261bb2-0c9a-4afe-9216-6cdf628aab04 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:35.317870 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b892c5c2-c8d5-4a5a-a3b6-f9a83202d588 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] [instance: fde8e9cc-b3de-4af8-a6e5-d5ab50af4844] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:35.327014 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b892c5c2-c8d5-4a5a-a3b6-f9a83202d588 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:35.329362 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b892c5c2-c8d5-4a5a-a3b6-f9a83202d588 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:35.329362 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b892c5c2-c8d5-4a5a-a3b6-f9a83202d588 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:35.329362 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b892c5c2-c8d5-4a5a-a3b6-f9a83202d588 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:35.330148 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b892c5c2-c8d5-4a5a-a3b6-f9a83202d588 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:35.330801 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b892c5c2-c8d5-4a5a-a3b6-f9a83202d588 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:35.449561 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-53261bb2-0c9a-4afe-9216-6cdf628aab04 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:35.461165 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-53261bb2-0c9a-4afe-9216-6cdf628aab04 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:35.462861 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-53261bb2-0c9a-4afe-9216-6cdf628aab04 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:35.469851 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-53261bb2-0c9a-4afe-9216-6cdf628aab04 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1537 microversion: 2.91 time: 0.175354 Sep 23 04:41:35.486557 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1304/2621] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:41:35 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1537 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:41:35.498574 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-049039d4-429d-4ff6-9408-1ace2ebf7a04 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:35.499752 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-049039d4-429d-4ff6-9408-1ace2ebf7a04 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] [instance: 5ee8a1da-f229-4716-bc67-da23f07963bd] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:35.508194 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-049039d4-429d-4ff6-9408-1ace2ebf7a04 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:35.511752 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-049039d4-429d-4ff6-9408-1ace2ebf7a04 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:35.511752 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-049039d4-429d-4ff6-9408-1ace2ebf7a04 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:35.511752 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-049039d4-429d-4ff6-9408-1ace2ebf7a04 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:35.511752 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-049039d4-429d-4ff6-9408-1ace2ebf7a04 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:35.513161 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-049039d4-429d-4ff6-9408-1ace2ebf7a04 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:35.537230 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b892c5c2-c8d5-4a5a-a3b6-f9a83202d588 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c1c2f05c7b48cfb2cd4ecb56a2a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8844923c06ca4a9e9fa774ed17c4fc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:35.550304 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b892c5c2-c8d5-4a5a-a3b6-f9a83202d588 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] 10.222.0.33 "GET /compute/v2.1/servers/fde8e9cc-b3de-4af8-a6e5-d5ab50af4844" status: 200 len: 1313 microversion: 2.1 time: 0.234847 Sep 23 04:41:35.550940 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1318/2622] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:35 2022] GET /compute/v2.1/servers/fde8e9cc-b3de-4af8-a6e5-d5ab50af4844 => generated 1313 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:35.555883 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-9299ce8c-f8c0-4037-b535-5e23a5898d43 req-9c2c9aa6-a4cc-47f8-8b68-7d79a3fceb5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a6b2904-2edd-4e9e-b6fa-1d6249721f52", "name": "network-vif-plugged", "status": "completed", "tag": "391b0b37-303e-4cb7-84df-aafbc7c7b54b"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:41:35.567779 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-9299ce8c-f8c0-4037-b535-5e23a5898d43 req-9c2c9aa6-a4cc-47f8-8b68-7d79a3fceb5f service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:35.568456 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-9299ce8c-f8c0-4037-b535-5e23a5898d43 req-9c2c9aa6-a4cc-47f8-8b68-7d79a3fceb5f service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:35.569038 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-9299ce8c-f8c0-4037-b535-5e23a5898d43 req-9c2c9aa6-a4cc-47f8-8b68-7d79a3fceb5f service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:35.585616 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-9299ce8c-f8c0-4037-b535-5e23a5898d43 req-9c2c9aa6-a4cc-47f8-8b68-7d79a3fceb5f service nova] Creating event network-vif-plugged:391b0b37-303e-4cb7-84df-aafbc7c7b54b for instance 8a6b2904-2edd-4e9e-b6fa-1d6249721f52 on n-h1-846463-3 Sep 23 04:41:35.594015 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-9299ce8c-f8c0-4037-b535-5e23a5898d43 req-9c2c9aa6-a4cc-47f8-8b68-7d79a3fceb5f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041811 Sep 23 04:41:35.595038 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1319/2623] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:41:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:41:35.618197 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6b4934ce-78b3-4960-b976-22e6880427d4 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:35.619612 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-6b4934ce-78b3-4960-b976-22e6880427d4 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] [instance: 4fe42fc2-8cfa-4571-9282-fa4a6fcd75c8] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:35.717022 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-6b4934ce-78b3-4960-b976-22e6880427d4 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6ade7cab39345e29e7ee7a977bc80f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56a38177bdb4624b9abe512ae98266b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:35.728997 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6b4934ce-78b3-4960-b976-22e6880427d4 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] 10.222.0.33 "GET /compute/v2.1/servers/4fe42fc2-8cfa-4571-9282-fa4a6fcd75c8" status: 200 len: 1225 microversion: 2.1 time: 0.126212 Sep 23 04:41:35.730190 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1320/2624] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:35 2022] GET /compute/v2.1/servers/4fe42fc2-8cfa-4571-9282-fa4a6fcd75c8 => generated 1225 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:35.748826 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-049039d4-429d-4ff6-9408-1ace2ebf7a04 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace08d8e105e46e299773c5a1b96039f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a16a53325a4d61aef94281435e9726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:35.757853 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-049039d4-429d-4ff6-9408-1ace2ebf7a04 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] 10.222.0.33 "GET /compute/v2.1/servers/5ee8a1da-f229-4716-bc67-da23f07963bd" status: 200 len: 1522 microversion: 2.1 time: 0.270105 Sep 23 04:41:35.762013 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1305/2625] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:35 2022] GET /compute/v2.1/servers/5ee8a1da-f229-4716-bc67-da23f07963bd => generated 1522 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:36.006746 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ccf63f67-26e3-4b14-a495-fcb24eb3e8cf tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:36.008156 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ccf63f67-26e3-4b14-a495-fcb24eb3e8cf tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] [instance: dfb8f504-218a-471c-b7a8-70c498769f0e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:36.021627 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ccf63f67-26e3-4b14-a495-fcb24eb3e8cf tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:36.022490 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ccf63f67-26e3-4b14-a495-fcb24eb3e8cf tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:36.023093 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ccf63f67-26e3-4b14-a495-fcb24eb3e8cf tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:36.024495 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ccf63f67-26e3-4b14-a495-fcb24eb3e8cf tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:36.025807 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ccf63f67-26e3-4b14-a495-fcb24eb3e8cf tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:36.026447 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ccf63f67-26e3-4b14-a495-fcb24eb3e8cf tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:36.175231 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ccf63f67-26e3-4b14-a495-fcb24eb3e8cf tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542c9592c76c4d4b9f3f16cea354398d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf77b55dfd8452e949229e4eb085283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:36.184669 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ccf63f67-26e3-4b14-a495-fcb24eb3e8cf tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] 10.222.0.33 "GET /compute/v2.1/servers/dfb8f504-218a-471c-b7a8-70c498769f0e" status: 200 len: 1556 microversion: 2.1 time: 0.184331 Sep 23 04:41:36.185289 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1321/2626] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:35 2022] GET /compute/v2.1/servers/dfb8f504-218a-471c-b7a8-70c498769f0e => generated 1556 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:36.207051 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3f98f079-2bec-45de-9700-36dad4952a06 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:36.207829 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3f98f079-2bec-45de-9700-36dad4952a06 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] [instance: dfb8f504-218a-471c-b7a8-70c498769f0e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:36.215018 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3f98f079-2bec-45de-9700-36dad4952a06 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:36.215522 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3f98f079-2bec-45de-9700-36dad4952a06 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:36.215967 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3f98f079-2bec-45de-9700-36dad4952a06 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:36.219339 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3f98f079-2bec-45de-9700-36dad4952a06 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:36.219831 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3f98f079-2bec-45de-9700-36dad4952a06 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:36.220281 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3f98f079-2bec-45de-9700-36dad4952a06 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:36.317945 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9fa5a9f5-6641-4a76-9e43-f669ef77f04c tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:36.318731 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-9fa5a9f5-6641-4a76-9e43-f669ef77f04c tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 8a6b2904-2edd-4e9e-b6fa-1d6249721f52] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:36.325690 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9fa5a9f5-6641-4a76-9e43-f669ef77f04c tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:36.326379 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9fa5a9f5-6641-4a76-9e43-f669ef77f04c tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:36.326893 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9fa5a9f5-6641-4a76-9e43-f669ef77f04c tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:36.327678 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9fa5a9f5-6641-4a76-9e43-f669ef77f04c tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:36.328211 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9fa5a9f5-6641-4a76-9e43-f669ef77f04c tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:36.328766 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9fa5a9f5-6641-4a76-9e43-f669ef77f04c tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:36.344981 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3f98f079-2bec-45de-9700-36dad4952a06 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] 10.222.0.33 "GET /compute/v2.1/servers/dfb8f504-218a-471c-b7a8-70c498769f0e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.141826 Sep 23 04:41:36.347443 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1306/2627] 10.222.0.33 () {58 vars in 1275 bytes} [Fri Sep 23 04:41:36 2022] GET /compute/v2.1/servers/dfb8f504-218a-471c-b7a8-70c498769f0e/os-interface => generated 284 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:41:36.515753 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0aea0b8d-94b2-4b19-85f9-467d2f419ff9 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:36.516461 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-0aea0b8d-94b2-4b19-85f9-467d2f419ff9 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:36.525154 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0aea0b8d-94b2-4b19-85f9-467d2f419ff9 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:36.526955 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0aea0b8d-94b2-4b19-85f9-467d2f419ff9 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:36.530350 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0aea0b8d-94b2-4b19-85f9-467d2f419ff9 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:36.530350 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0aea0b8d-94b2-4b19-85f9-467d2f419ff9 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:36.530350 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0aea0b8d-94b2-4b19-85f9-467d2f419ff9 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:36.530350 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0aea0b8d-94b2-4b19-85f9-467d2f419ff9 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:36.620544 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-0aea0b8d-94b2-4b19-85f9-467d2f419ff9 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:36.622897 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=100 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:41:36.629647 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-0aea0b8d-94b2-4b19-85f9-467d2f419ff9 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:36.631155 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-0aea0b8d-94b2-4b19-85f9-467d2f419ff9 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:36.636680 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0aea0b8d-94b2-4b19-85f9-467d2f419ff9 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1537 microversion: 2.91 time: 0.136872 Sep 23 04:41:36.648134 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1307/2628] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:41:36 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1537 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:41:36.648134 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c4e389bd-bf1f-49cb-b6a8-1a076dd1d4cf tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:36.648134 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c4e389bd-bf1f-49cb-b6a8-1a076dd1d4cf tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] [instance: fde8e9cc-b3de-4af8-a6e5-d5ab50af4844] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:36.649127 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c4e389bd-bf1f-49cb-b6a8-1a076dd1d4cf tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:36.649625 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c4e389bd-bf1f-49cb-b6a8-1a076dd1d4cf tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:36.650105 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c4e389bd-bf1f-49cb-b6a8-1a076dd1d4cf tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:36.651399 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c4e389bd-bf1f-49cb-b6a8-1a076dd1d4cf tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:36.651864 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c4e389bd-bf1f-49cb-b6a8-1a076dd1d4cf tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:36.652333 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c4e389bd-bf1f-49cb-b6a8-1a076dd1d4cf tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:36.687886 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-9fa5a9f5-6641-4a76-9e43-f669ef77f04c tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:36.697680 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-9fa5a9f5-6641-4a76-9e43-f669ef77f04c tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/8a6b2904-2edd-4e9e-b6fa-1d6249721f52" status: 200 len: 1315 microversion: 2.1 time: 0.382065 Sep 23 04:41:36.698538 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1322/2629] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:36 2022] GET /compute/v2.1/servers/8a6b2904-2edd-4e9e-b6fa-1d6249721f52 => generated 1315 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:41:36.753350 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-79752568-db11-4036-a6c0-9406671a13c3 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:36.754774 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-79752568-db11-4036-a6c0-9406671a13c3 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] [instance: 4fe42fc2-8cfa-4571-9282-fa4a6fcd75c8] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:36.763308 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-79752568-db11-4036-a6c0-9406671a13c3 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:36.764065 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-79752568-db11-4036-a6c0-9406671a13c3 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:36.765014 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-79752568-db11-4036-a6c0-9406671a13c3 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:36.767437 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-79752568-db11-4036-a6c0-9406671a13c3 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:36.767437 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-79752568-db11-4036-a6c0-9406671a13c3 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:36.767437 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-79752568-db11-4036-a6c0-9406671a13c3 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:36.796937 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=100 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:41:36.891613 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-79752568-db11-4036-a6c0-9406671a13c3 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6ade7cab39345e29e7ee7a977bc80f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56a38177bdb4624b9abe512ae98266b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:36.900812 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-79752568-db11-4036-a6c0-9406671a13c3 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] 10.222.0.33 "GET /compute/v2.1/servers/4fe42fc2-8cfa-4571-9282-fa4a6fcd75c8" status: 200 len: 1229 microversion: 2.1 time: 0.151793 Sep 23 04:41:36.901407 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1323/2630] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:36 2022] GET /compute/v2.1/servers/4fe42fc2-8cfa-4571-9282-fa4a6fcd75c8 => generated 1229 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:41:36.916826 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1c18a9be-d5f9-46f9-9b9e-5edad84a4a96 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:36.918657 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1c18a9be-d5f9-46f9-9b9e-5edad84a4a96 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] [instance: 5ee8a1da-f229-4716-bc67-da23f07963bd] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:36.928459 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1c18a9be-d5f9-46f9-9b9e-5edad84a4a96 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:36.929035 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1c18a9be-d5f9-46f9-9b9e-5edad84a4a96 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:36.932169 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1c18a9be-d5f9-46f9-9b9e-5edad84a4a96 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:36.934575 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1c18a9be-d5f9-46f9-9b9e-5edad84a4a96 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:36.934575 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1c18a9be-d5f9-46f9-9b9e-5edad84a4a96 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:36.934575 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1c18a9be-d5f9-46f9-9b9e-5edad84a4a96 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:37.015934 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c4e389bd-bf1f-49cb-b6a8-1a076dd1d4cf tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c1c2f05c7b48cfb2cd4ecb56a2a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8844923c06ca4a9e9fa774ed17c4fc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:37.023974 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c4e389bd-bf1f-49cb-b6a8-1a076dd1d4cf tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] 10.222.0.33 "GET /compute/v2.1/servers/fde8e9cc-b3de-4af8-a6e5-d5ab50af4844" status: 200 len: 1313 microversion: 2.1 time: 0.385708 Sep 23 04:41:37.024729 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1308/2631] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:36 2022] GET /compute/v2.1/servers/fde8e9cc-b3de-4af8-a6e5-d5ab50af4844 => generated 1313 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:37.528679 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1c18a9be-d5f9-46f9-9b9e-5edad84a4a96 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace08d8e105e46e299773c5a1b96039f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a16a53325a4d61aef94281435e9726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:37.537510 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1c18a9be-d5f9-46f9-9b9e-5edad84a4a96 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] 10.222.0.33 "GET /compute/v2.1/servers/5ee8a1da-f229-4716-bc67-da23f07963bd" status: 200 len: 1522 microversion: 2.1 time: 0.634631 Sep 23 04:41:37.538102 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1324/2632] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:36 2022] GET /compute/v2.1/servers/5ee8a1da-f229-4716-bc67-da23f07963bd => generated 1522 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:37.667408 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-15404907-7db4-4d95-9f63-fd41917bf22c tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:37.668149 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-15404907-7db4-4d95-9f63-fd41917bf22c tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:37.676840 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-15404907-7db4-4d95-9f63-fd41917bf22c tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:37.681632 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-15404907-7db4-4d95-9f63-fd41917bf22c tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:37.681632 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-15404907-7db4-4d95-9f63-fd41917bf22c tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:37.681632 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-15404907-7db4-4d95-9f63-fd41917bf22c tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:37.681632 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-15404907-7db4-4d95-9f63-fd41917bf22c tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:37.681632 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-15404907-7db4-4d95-9f63-fd41917bf22c tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:37.722455 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c906ff22-92cc-4f75-8750-55ddf418cb82 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:37.723088 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c906ff22-92cc-4f75-8750-55ddf418cb82 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 8a6b2904-2edd-4e9e-b6fa-1d6249721f52] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:37.730469 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c906ff22-92cc-4f75-8750-55ddf418cb82 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:37.730967 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c906ff22-92cc-4f75-8750-55ddf418cb82 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:37.731460 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c906ff22-92cc-4f75-8750-55ddf418cb82 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:37.732169 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c906ff22-92cc-4f75-8750-55ddf418cb82 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:37.732809 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c906ff22-92cc-4f75-8750-55ddf418cb82 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:37.733587 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c906ff22-92cc-4f75-8750-55ddf418cb82 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:37.793233 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-15404907-7db4-4d95-9f63-fd41917bf22c tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:37.805178 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-15404907-7db4-4d95-9f63-fd41917bf22c tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:37.806833 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-15404907-7db4-4d95-9f63-fd41917bf22c tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:37.812466 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-15404907-7db4-4d95-9f63-fd41917bf22c tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1537 microversion: 2.91 time: 0.150341 Sep 23 04:41:37.813762 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1309/2633] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:41:37 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1537 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:41:37.926379 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6b7d083c-5a31-4d1c-aef1-81f7a82e4ab7 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:37.927018 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-6b7d083c-5a31-4d1c-aef1-81f7a82e4ab7 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] [instance: 4fe42fc2-8cfa-4571-9282-fa4a6fcd75c8] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:37.934963 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6b7d083c-5a31-4d1c-aef1-81f7a82e4ab7 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:37.941018 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6b7d083c-5a31-4d1c-aef1-81f7a82e4ab7 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:37.941018 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6b7d083c-5a31-4d1c-aef1-81f7a82e4ab7 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:37.941018 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6b7d083c-5a31-4d1c-aef1-81f7a82e4ab7 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:37.941018 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6b7d083c-5a31-4d1c-aef1-81f7a82e4ab7 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:37.941018 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6b7d083c-5a31-4d1c-aef1-81f7a82e4ab7 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:38.005686 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c906ff22-92cc-4f75-8750-55ddf418cb82 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:38.016273 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c906ff22-92cc-4f75-8750-55ddf418cb82 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/8a6b2904-2edd-4e9e-b6fa-1d6249721f52" status: 200 len: 1502 microversion: 2.1 time: 0.299144 Sep 23 04:41:38.017624 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1325/2634] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:37 2022] GET /compute/v2.1/servers/8a6b2904-2edd-4e9e-b6fa-1d6249721f52 => generated 1502 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:38.044088 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9e0b3793-7a1a-44f0-ac10-a0d6f1a8d950 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:41:38.050933 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9e0b3793-7a1a-44f0-ac10-a0d6f1a8d950 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:38.051680 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9e0b3793-7a1a-44f0-ac10-a0d6f1a8d950 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:38.052484 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9e0b3793-7a1a-44f0-ac10-a0d6f1a8d950 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:38.065837 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6b7d083c-5a31-4d1c-aef1-81f7a82e4ab7 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6ade7cab39345e29e7ee7a977bc80f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56a38177bdb4624b9abe512ae98266b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:38.088829 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-6b7d083c-5a31-4d1c-aef1-81f7a82e4ab7 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] 10.222.0.33 "GET /compute/v2.1/servers/4fe42fc2-8cfa-4571-9282-fa4a6fcd75c8" status: 200 len: 1277 microversion: 2.1 time: 0.166842 Sep 23 04:41:38.091637 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1310/2635] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:37 2022] GET /compute/v2.1/servers/4fe42fc2-8cfa-4571-9282-fa4a6fcd75c8 => generated 1277 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:41:38.098682 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a1646bc4-7e6c-4dc4-9f2b-4eb761f4c9bf tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:38.099533 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a1646bc4-7e6c-4dc4-9f2b-4eb761f4c9bf tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] [instance: fde8e9cc-b3de-4af8-a6e5-d5ab50af4844] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:38.105443 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-9e0b3793-7a1a-44f0-ac10-a0d6f1a8d950 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 8a6b2904-2edd-4e9e-b6fa-1d6249721f52] Going to try to stop instance {{(pid=122699) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 23 04:41:38.118382 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a1646bc4-7e6c-4dc4-9f2b-4eb761f4c9bf tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:38.119937 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a1646bc4-7e6c-4dc4-9f2b-4eb761f4c9bf tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:38.120556 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a1646bc4-7e6c-4dc4-9f2b-4eb761f4c9bf tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:38.122542 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a1646bc4-7e6c-4dc4-9f2b-4eb761f4c9bf tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:38.123088 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a1646bc4-7e6c-4dc4-9f2b-4eb761f4c9bf tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:38.123629 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a1646bc4-7e6c-4dc4-9f2b-4eb761f4c9bf tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:38.334237 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-9e0b3793-7a1a-44f0-ac10-a0d6f1a8d950 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "POST /compute/v2.1/servers/8a6b2904-2edd-4e9e-b6fa-1d6249721f52/action" status: 202 len: 0 microversion: 2.1 time: 0.281765 Sep 23 04:41:38.339700 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1326/2636] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:41:38 2022] POST /compute/v2.1/servers/8a6b2904-2edd-4e9e-b6fa-1d6249721f52/action => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 23 04:41:38.354914 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-027208cb-7257-434d-b3d7-84ea189f9381 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:38.355642 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-027208cb-7257-434d-b3d7-84ea189f9381 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 8a6b2904-2edd-4e9e-b6fa-1d6249721f52] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:38.371655 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-027208cb-7257-434d-b3d7-84ea189f9381 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:38.372191 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-027208cb-7257-434d-b3d7-84ea189f9381 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:38.372628 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-027208cb-7257-434d-b3d7-84ea189f9381 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:38.373346 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-027208cb-7257-434d-b3d7-84ea189f9381 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:38.373804 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-027208cb-7257-434d-b3d7-84ea189f9381 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:38.374264 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-027208cb-7257-434d-b3d7-84ea189f9381 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:38.387834 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a1646bc4-7e6c-4dc4-9f2b-4eb761f4c9bf tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c1c2f05c7b48cfb2cd4ecb56a2a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8844923c06ca4a9e9fa774ed17c4fc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:38.400886 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a1646bc4-7e6c-4dc4-9f2b-4eb761f4c9bf tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] 10.222.0.33 "GET /compute/v2.1/servers/fde8e9cc-b3de-4af8-a6e5-d5ab50af4844" status: 200 len: 1313 microversion: 2.1 time: 0.304783 Sep 23 04:41:38.401503 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1311/2637] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:38 2022] GET /compute/v2.1/servers/fde8e9cc-b3de-4af8-a6e5-d5ab50af4844 => generated 1313 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:38.569344 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e9eb0a49-deb0-4d42-b238-78d10ec73ac4 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:38.570712 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e9eb0a49-deb0-4d42-b238-78d10ec73ac4 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] [instance: 5ee8a1da-f229-4716-bc67-da23f07963bd] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:38.581266 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e9eb0a49-deb0-4d42-b238-78d10ec73ac4 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:38.581961 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e9eb0a49-deb0-4d42-b238-78d10ec73ac4 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:38.582487 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e9eb0a49-deb0-4d42-b238-78d10ec73ac4 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:38.583343 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e9eb0a49-deb0-4d42-b238-78d10ec73ac4 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:38.583950 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e9eb0a49-deb0-4d42-b238-78d10ec73ac4 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:38.584677 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e9eb0a49-deb0-4d42-b238-78d10ec73ac4 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:38.847962 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-027208cb-7257-434d-b3d7-84ea189f9381 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:38.868341 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-027208cb-7257-434d-b3d7-84ea189f9381 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/8a6b2904-2edd-4e9e-b6fa-1d6249721f52" status: 200 len: 1512 microversion: 2.1 time: 0.516942 Sep 23 04:41:38.870566 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1327/2638] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:38 2022] GET /compute/v2.1/servers/8a6b2904-2edd-4e9e-b6fa-1d6249721f52 => generated 1512 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:38.890263 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-9e3320ea-a7d1-48b5-9bf2-4ebec778c6f3 req-899dbafe-8023-4831-8e55-3688a1f71305 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfb8f504-218a-471c-b7a8-70c498769f0e", "tag": "e03d6cb1-0498-436c-ab0a-43f410f1eaf8"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:41:38.905960 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-9e3320ea-a7d1-48b5-9bf2-4ebec778c6f3 req-899dbafe-8023-4831-8e55-3688a1f71305 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:38.905960 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-9e3320ea-a7d1-48b5-9bf2-4ebec778c6f3 req-899dbafe-8023-4831-8e55-3688a1f71305 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:38.905960 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-9e3320ea-a7d1-48b5-9bf2-4ebec778c6f3 req-899dbafe-8023-4831-8e55-3688a1f71305 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:38.922548 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-9e3320ea-a7d1-48b5-9bf2-4ebec778c6f3 req-899dbafe-8023-4831-8e55-3688a1f71305 service nova] Creating event network-changed:e03d6cb1-0498-436c-ab0a-43f410f1eaf8 for instance dfb8f504-218a-471c-b7a8-70c498769f0e on n-h2-846463-3 Sep 23 04:41:38.928147 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-9e3320ea-a7d1-48b5-9bf2-4ebec778c6f3 req-899dbafe-8023-4831-8e55-3688a1f71305 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055730 Sep 23 04:41:38.935238 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1328/2639] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:41:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:41:38.952952 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-15ff8fd8-c992-4250-9ab6-e85370122d35 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:38.953800 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-15ff8fd8-c992-4250-9ab6-e85370122d35 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:38.966055 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-15ff8fd8-c992-4250-9ab6-e85370122d35 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:38.966546 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-15ff8fd8-c992-4250-9ab6-e85370122d35 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:38.966985 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-15ff8fd8-c992-4250-9ab6-e85370122d35 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:38.967736 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-15ff8fd8-c992-4250-9ab6-e85370122d35 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:38.969574 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-15ff8fd8-c992-4250-9ab6-e85370122d35 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:38.969574 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-15ff8fd8-c992-4250-9ab6-e85370122d35 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:39.101918 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-15ff8fd8-c992-4250-9ab6-e85370122d35 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:39.115948 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-15ff8fd8-c992-4250-9ab6-e85370122d35 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:39.117400 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-15ff8fd8-c992-4250-9ab6-e85370122d35 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:39.141433 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-15ff8fd8-c992-4250-9ab6-e85370122d35 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1537 microversion: 2.91 time: 0.210822 Sep 23 04:41:39.142067 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1329/2640] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:41:38 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1537 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:41:39.173939 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6d06c5b5-922d-4b39-a0f5-cb1ad44776af tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:39.174494 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-6d06c5b5-922d-4b39-a0f5-cb1ad44776af tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] [instance: 4fe42fc2-8cfa-4571-9282-fa4a6fcd75c8] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:39.182321 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6d06c5b5-922d-4b39-a0f5-cb1ad44776af tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:39.182821 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6d06c5b5-922d-4b39-a0f5-cb1ad44776af tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:39.183797 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6d06c5b5-922d-4b39-a0f5-cb1ad44776af tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:39.184540 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6d06c5b5-922d-4b39-a0f5-cb1ad44776af tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:39.185006 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6d06c5b5-922d-4b39-a0f5-cb1ad44776af tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:39.185489 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6d06c5b5-922d-4b39-a0f5-cb1ad44776af tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:39.307503 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-6d06c5b5-922d-4b39-a0f5-cb1ad44776af tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6ade7cab39345e29e7ee7a977bc80f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56a38177bdb4624b9abe512ae98266b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:39.323334 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6d06c5b5-922d-4b39-a0f5-cb1ad44776af tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] 10.222.0.33 "GET /compute/v2.1/servers/4fe42fc2-8cfa-4571-9282-fa4a6fcd75c8" status: 200 len: 1283 microversion: 2.1 time: 0.163795 Sep 23 04:41:39.340442 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1330/2641] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:39 2022] GET /compute/v2.1/servers/4fe42fc2-8cfa-4571-9282-fa4a6fcd75c8 => generated 1283 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:39.349802 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e9eb0a49-deb0-4d42-b238-78d10ec73ac4 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace08d8e105e46e299773c5a1b96039f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a16a53325a4d61aef94281435e9726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:39.366924 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e9eb0a49-deb0-4d42-b238-78d10ec73ac4 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] 10.222.0.33 "GET /compute/v2.1/servers/5ee8a1da-f229-4716-bc67-da23f07963bd" status: 200 len: 1522 microversion: 2.1 time: 0.805507 Sep 23 04:41:39.367844 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1312/2642] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:38 2022] GET /compute/v2.1/servers/5ee8a1da-f229-4716-bc67-da23f07963bd => generated 1522 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:39.430279 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a58358a3-2210-4ec0-a6b4-2cd21999c63e tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:39.431128 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a58358a3-2210-4ec0-a6b4-2cd21999c63e tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] [instance: fde8e9cc-b3de-4af8-a6e5-d5ab50af4844] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:39.438640 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a58358a3-2210-4ec0-a6b4-2cd21999c63e tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:39.439574 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a58358a3-2210-4ec0-a6b4-2cd21999c63e tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:39.440112 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a58358a3-2210-4ec0-a6b4-2cd21999c63e tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:39.441171 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a58358a3-2210-4ec0-a6b4-2cd21999c63e tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:39.441770 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a58358a3-2210-4ec0-a6b4-2cd21999c63e tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:39.442293 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a58358a3-2210-4ec0-a6b4-2cd21999c63e tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:39.771307 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a58358a3-2210-4ec0-a6b4-2cd21999c63e tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c1c2f05c7b48cfb2cd4ecb56a2a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8844923c06ca4a9e9fa774ed17c4fc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:39.779666 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a58358a3-2210-4ec0-a6b4-2cd21999c63e tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] 10.222.0.33 "GET /compute/v2.1/servers/fde8e9cc-b3de-4af8-a6e5-d5ab50af4844" status: 200 len: 1313 microversion: 2.1 time: 0.355743 Sep 23 04:41:39.787587 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1331/2643] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:39 2022] GET /compute/v2.1/servers/fde8e9cc-b3de-4af8-a6e5-d5ab50af4844 => generated 1313 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:39.899270 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1f2bd7ba-8ee3-4b7b-92e0-e09bfb1cbe03 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:39.900384 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-1f2bd7ba-8ee3-4b7b-92e0-e09bfb1cbe03 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 8a6b2904-2edd-4e9e-b6fa-1d6249721f52] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:39.903232 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=16 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:41:39.908961 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1f2bd7ba-8ee3-4b7b-92e0-e09bfb1cbe03 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:39.909511 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1f2bd7ba-8ee3-4b7b-92e0-e09bfb1cbe03 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:39.910341 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1f2bd7ba-8ee3-4b7b-92e0-e09bfb1cbe03 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:39.911066 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1f2bd7ba-8ee3-4b7b-92e0-e09bfb1cbe03 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:39.911529 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1f2bd7ba-8ee3-4b7b-92e0-e09bfb1cbe03 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:39.911965 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1f2bd7ba-8ee3-4b7b-92e0-e09bfb1cbe03 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:40.174706 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-1f2bd7ba-8ee3-4b7b-92e0-e09bfb1cbe03 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:40.177218 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d8e9eba8-4f99-45b4-a226-220053ae751a tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:40.178525 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d8e9eba8-4f99-45b4-a226-220053ae751a tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:40.186839 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d8e9eba8-4f99-45b4-a226-220053ae751a tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:40.187494 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d8e9eba8-4f99-45b4-a226-220053ae751a tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:40.187940 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d8e9eba8-4f99-45b4-a226-220053ae751a tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:40.188746 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d8e9eba8-4f99-45b4-a226-220053ae751a tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:40.188926 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-1f2bd7ba-8ee3-4b7b-92e0-e09bfb1cbe03 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/8a6b2904-2edd-4e9e-b6fa-1d6249721f52" status: 200 len: 1512 microversion: 2.1 time: 0.293783 Sep 23 04:41:40.201915 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d8e9eba8-4f99-45b4-a226-220053ae751a tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:40.201915 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d8e9eba8-4f99-45b4-a226-220053ae751a tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:40.205048 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1313/2644] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:39 2022] GET /compute/v2.1/servers/8a6b2904-2edd-4e9e-b6fa-1d6249721f52 => generated 1512 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:40.279941 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d8e9eba8-4f99-45b4-a226-220053ae751a tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:40.287620 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d8e9eba8-4f99-45b4-a226-220053ae751a tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:40.289085 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d8e9eba8-4f99-45b4-a226-220053ae751a tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:40.295311 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d8e9eba8-4f99-45b4-a226-220053ae751a tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1537 microversion: 2.91 time: 0.123305 Sep 23 04:41:40.295888 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1332/2645] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:41:40 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1537 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:41:40.352803 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6ccedb6f-7e39-4095-8c09-4a4a6b2848e7 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:40.354209 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-6ccedb6f-7e39-4095-8c09-4a4a6b2848e7 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] [instance: 4fe42fc2-8cfa-4571-9282-fa4a6fcd75c8] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:40.360681 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6ccedb6f-7e39-4095-8c09-4a4a6b2848e7 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:40.361171 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6ccedb6f-7e39-4095-8c09-4a4a6b2848e7 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:40.361611 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6ccedb6f-7e39-4095-8c09-4a4a6b2848e7 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:40.362332 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6ccedb6f-7e39-4095-8c09-4a4a6b2848e7 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:40.362796 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6ccedb6f-7e39-4095-8c09-4a4a6b2848e7 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:40.363224 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6ccedb6f-7e39-4095-8c09-4a4a6b2848e7 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:40.392473 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-18dde0f8-17f4-4218-bc93-cc07742b91c2 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:40.393017 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-18dde0f8-17f4-4218-bc93-cc07742b91c2 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] [instance: 5ee8a1da-f229-4716-bc67-da23f07963bd] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:40.399693 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-18dde0f8-17f4-4218-bc93-cc07742b91c2 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:40.400228 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-18dde0f8-17f4-4218-bc93-cc07742b91c2 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:40.400673 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-18dde0f8-17f4-4218-bc93-cc07742b91c2 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:40.401431 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-18dde0f8-17f4-4218-bc93-cc07742b91c2 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:40.401991 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-18dde0f8-17f4-4218-bc93-cc07742b91c2 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:40.402454 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-18dde0f8-17f4-4218-bc93-cc07742b91c2 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:40.647692 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6ccedb6f-7e39-4095-8c09-4a4a6b2848e7 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6ade7cab39345e29e7ee7a977bc80f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56a38177bdb4624b9abe512ae98266b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:40.658179 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-6ccedb6f-7e39-4095-8c09-4a4a6b2848e7 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] 10.222.0.33 "GET /compute/v2.1/servers/4fe42fc2-8cfa-4571-9282-fa4a6fcd75c8" status: 200 len: 1350 microversion: 2.1 time: 0.309178 Sep 23 04:41:40.659404 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1314/2646] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:40 2022] GET /compute/v2.1/servers/4fe42fc2-8cfa-4571-9282-fa4a6fcd75c8 => generated 1350 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:40.709840 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-18dde0f8-17f4-4218-bc93-cc07742b91c2 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace08d8e105e46e299773c5a1b96039f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a16a53325a4d61aef94281435e9726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:40.720382 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-18dde0f8-17f4-4218-bc93-cc07742b91c2 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] 10.222.0.33 "GET /compute/v2.1/servers/5ee8a1da-f229-4716-bc67-da23f07963bd" status: 200 len: 1522 microversion: 2.1 time: 0.332158 Sep 23 04:41:40.734079 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1333/2647] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:40 2022] GET /compute/v2.1/servers/5ee8a1da-f229-4716-bc67-da23f07963bd => generated 1522 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:41:40.807255 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-090a2552-3cc3-4c77-b091-8fff09a56055 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:40.807881 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-090a2552-3cc3-4c77-b091-8fff09a56055 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] [instance: fde8e9cc-b3de-4af8-a6e5-d5ab50af4844] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:40.814319 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-090a2552-3cc3-4c77-b091-8fff09a56055 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:40.814835 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-090a2552-3cc3-4c77-b091-8fff09a56055 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:40.815363 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-090a2552-3cc3-4c77-b091-8fff09a56055 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:40.816277 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-090a2552-3cc3-4c77-b091-8fff09a56055 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:40.816747 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-090a2552-3cc3-4c77-b091-8fff09a56055 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:40.817175 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-090a2552-3cc3-4c77-b091-8fff09a56055 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:40.971415 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-44bfe580-af77-4cbd-936f-3829cc687741 req-7d59c37a-2093-4877-9e32-345c4ef5174c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fde8e9cc-b3de-4af8-a6e5-d5ab50af4844", "name": "network-vif-plugged", "status": "completed", "tag": "31c78d18-fe06-4beb-bab2-05a3371ba287"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:41:40.981945 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-44bfe580-af77-4cbd-936f-3829cc687741 req-7d59c37a-2093-4877-9e32-345c4ef5174c service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:40.982654 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-44bfe580-af77-4cbd-936f-3829cc687741 req-7d59c37a-2093-4877-9e32-345c4ef5174c service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:40.983245 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-44bfe580-af77-4cbd-936f-3829cc687741 req-7d59c37a-2093-4877-9e32-345c4ef5174c service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:41.008925 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-44bfe580-af77-4cbd-936f-3829cc687741 req-7d59c37a-2093-4877-9e32-345c4ef5174c service nova] Creating event network-vif-plugged:31c78d18-fe06-4beb-bab2-05a3371ba287 for instance fde8e9cc-b3de-4af8-a6e5-d5ab50af4844 on n-h2-846463-3 Sep 23 04:41:41.019275 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-44bfe580-af77-4cbd-936f-3829cc687741 req-7d59c37a-2093-4877-9e32-345c4ef5174c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050769 Sep 23 04:41:41.021549 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1334/2648] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:41:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:41:41.049685 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-090a2552-3cc3-4c77-b091-8fff09a56055 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c1c2f05c7b48cfb2cd4ecb56a2a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8844923c06ca4a9e9fa774ed17c4fc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:41.064487 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-090a2552-3cc3-4c77-b091-8fff09a56055 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] 10.222.0.33 "GET /compute/v2.1/servers/fde8e9cc-b3de-4af8-a6e5-d5ab50af4844" status: 200 len: 1313 microversion: 2.1 time: 0.261058 Sep 23 04:41:41.065203 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1315/2649] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:40 2022] GET /compute/v2.1/servers/fde8e9cc-b3de-4af8-a6e5-d5ab50af4844 => generated 1313 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:41.218939 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b66cfc5b-1004-4165-9d45-e1df5e74699e tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:41.220066 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b66cfc5b-1004-4165-9d45-e1df5e74699e tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 8a6b2904-2edd-4e9e-b6fa-1d6249721f52] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:41.225954 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b66cfc5b-1004-4165-9d45-e1df5e74699e tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:41.226546 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b66cfc5b-1004-4165-9d45-e1df5e74699e tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:41.227167 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b66cfc5b-1004-4165-9d45-e1df5e74699e tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:41.227515 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b66cfc5b-1004-4165-9d45-e1df5e74699e tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:41.228509 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b66cfc5b-1004-4165-9d45-e1df5e74699e tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:41.228509 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b66cfc5b-1004-4165-9d45-e1df5e74699e tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:41.324790 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-40e84771-4133-4ed2-bdc4-98fdf1abbdc9 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:41.325820 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-40e84771-4133-4ed2-bdc4-98fdf1abbdc9 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:41.333449 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-40e84771-4133-4ed2-bdc4-98fdf1abbdc9 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:41.336207 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-40e84771-4133-4ed2-bdc4-98fdf1abbdc9 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:41.336207 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-40e84771-4133-4ed2-bdc4-98fdf1abbdc9 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:41.337419 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-40e84771-4133-4ed2-bdc4-98fdf1abbdc9 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:41.338160 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-40e84771-4133-4ed2-bdc4-98fdf1abbdc9 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:41.338683 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-40e84771-4133-4ed2-bdc4-98fdf1abbdc9 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:41.421466 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-40e84771-4133-4ed2-bdc4-98fdf1abbdc9 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:41.434814 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-40e84771-4133-4ed2-bdc4-98fdf1abbdc9 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:41.434814 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-40e84771-4133-4ed2-bdc4-98fdf1abbdc9 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:41.437686 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-40e84771-4133-4ed2-bdc4-98fdf1abbdc9 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1537 microversion: 2.91 time: 0.117676 Sep 23 04:41:41.450376 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b66cfc5b-1004-4165-9d45-e1df5e74699e tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:41.451116 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1316/2650] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:41:41 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1537 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:41:41.455334 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b66cfc5b-1004-4165-9d45-e1df5e74699e tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/8a6b2904-2edd-4e9e-b6fa-1d6249721f52" status: 200 len: 1512 microversion: 2.1 time: 0.243038 Sep 23 04:41:41.469957 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1335/2651] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:41 2022] GET /compute/v2.1/servers/8a6b2904-2edd-4e9e-b6fa-1d6249721f52 => generated 1512 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:41.634463 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-1ed2ba83-6a68-41af-891d-3c2352655e87 req-71026f2e-699a-42f6-85d0-5b4382fb29c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fe42fc2-8cfa-4571-9282-fa4a6fcd75c8", "tag": "9beb8450-2cd0-4018-9daa-49a22c787feb"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:41:41.644895 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-1ed2ba83-6a68-41af-891d-3c2352655e87 req-71026f2e-699a-42f6-85d0-5b4382fb29c7 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:41.645388 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-1ed2ba83-6a68-41af-891d-3c2352655e87 req-71026f2e-699a-42f6-85d0-5b4382fb29c7 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:41.645821 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-1ed2ba83-6a68-41af-891d-3c2352655e87 req-71026f2e-699a-42f6-85d0-5b4382fb29c7 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:41.659256 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-1ed2ba83-6a68-41af-891d-3c2352655e87 req-71026f2e-699a-42f6-85d0-5b4382fb29c7 service nova] Creating event network-changed:9beb8450-2cd0-4018-9daa-49a22c787feb for instance 4fe42fc2-8cfa-4571-9282-fa4a6fcd75c8 on n-h1-846463-3 Sep 23 04:41:41.664205 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-1ed2ba83-6a68-41af-891d-3c2352655e87 req-71026f2e-699a-42f6-85d0-5b4382fb29c7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033524 Sep 23 04:41:41.664964 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1317/2652] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:41:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:41:41.682855 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5cb205c5-042f-4463-a4e1-93a6d72f12f3 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:41.683698 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-5cb205c5-042f-4463-a4e1-93a6d72f12f3 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] [instance: 4fe42fc2-8cfa-4571-9282-fa4a6fcd75c8] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:41.690584 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5cb205c5-042f-4463-a4e1-93a6d72f12f3 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:41.691308 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5cb205c5-042f-4463-a4e1-93a6d72f12f3 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:41.691757 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5cb205c5-042f-4463-a4e1-93a6d72f12f3 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:41.692474 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5cb205c5-042f-4463-a4e1-93a6d72f12f3 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:41.692936 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5cb205c5-042f-4463-a4e1-93a6d72f12f3 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:41.693368 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5cb205c5-042f-4463-a4e1-93a6d72f12f3 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:41.746785 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ad05454a-ad02-4fa7-b4e2-afca5f9c3a4a tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:41.747652 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-ad05454a-ad02-4fa7-b4e2-afca5f9c3a4a tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] [instance: 5ee8a1da-f229-4716-bc67-da23f07963bd] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:41.754119 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ad05454a-ad02-4fa7-b4e2-afca5f9c3a4a tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:41.754612 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ad05454a-ad02-4fa7-b4e2-afca5f9c3a4a tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:41.755049 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ad05454a-ad02-4fa7-b4e2-afca5f9c3a4a tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:41.755756 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ad05454a-ad02-4fa7-b4e2-afca5f9c3a4a tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:41.756243 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ad05454a-ad02-4fa7-b4e2-afca5f9c3a4a tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:41.756725 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ad05454a-ad02-4fa7-b4e2-afca5f9c3a4a tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:42.262836 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-5cb205c5-042f-4463-a4e1-93a6d72f12f3 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6ade7cab39345e29e7ee7a977bc80f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56a38177bdb4624b9abe512ae98266b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:42.276693 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5cb205c5-042f-4463-a4e1-93a6d72f12f3 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] 10.222.0.33 "GET /compute/v2.1/servers/4fe42fc2-8cfa-4571-9282-fa4a6fcd75c8" status: 200 len: 1350 microversion: 2.1 time: 0.598307 Sep 23 04:41:42.292580 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1336/2653] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:41 2022] GET /compute/v2.1/servers/4fe42fc2-8cfa-4571-9282-fa4a6fcd75c8 => generated 1350 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:42.293040 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ad05454a-ad02-4fa7-b4e2-afca5f9c3a4a tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace08d8e105e46e299773c5a1b96039f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a16a53325a4d61aef94281435e9726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:42.298736 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1c4a1fa6-1886-4d4e-99a4-bd3b07e66296 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:42.299721 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ad05454a-ad02-4fa7-b4e2-afca5f9c3a4a tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] 10.222.0.33 "GET /compute/v2.1/servers/5ee8a1da-f229-4716-bc67-da23f07963bd" status: 200 len: 1522 microversion: 2.1 time: 0.555443 Sep 23 04:41:42.313923 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1318/2654] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:41 2022] GET /compute/v2.1/servers/5ee8a1da-f229-4716-bc67-da23f07963bd => generated 1522 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:41:42.314132 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1c4a1fa6-1886-4d4e-99a4-bd3b07e66296 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] [instance: fde8e9cc-b3de-4af8-a6e5-d5ab50af4844] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:42.314132 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1c4a1fa6-1886-4d4e-99a4-bd3b07e66296 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:42.314132 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1c4a1fa6-1886-4d4e-99a4-bd3b07e66296 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:42.314132 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1c4a1fa6-1886-4d4e-99a4-bd3b07e66296 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:42.314132 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1c4a1fa6-1886-4d4e-99a4-bd3b07e66296 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:42.314132 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1c4a1fa6-1886-4d4e-99a4-bd3b07e66296 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:42.314132 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1c4a1fa6-1886-4d4e-99a4-bd3b07e66296 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:42.468030 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-758593f4-d0aa-46f5-b5bd-def0ee92767b tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:42.468660 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-758593f4-d0aa-46f5-b5bd-def0ee92767b tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:42.476079 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-758593f4-d0aa-46f5-b5bd-def0ee92767b tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:42.478347 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-758593f4-d0aa-46f5-b5bd-def0ee92767b tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:42.478347 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-758593f4-d0aa-46f5-b5bd-def0ee92767b tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:42.478347 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-758593f4-d0aa-46f5-b5bd-def0ee92767b tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:42.478590 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-758593f4-d0aa-46f5-b5bd-def0ee92767b tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:42.478903 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-758593f4-d0aa-46f5-b5bd-def0ee92767b tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:42.527191 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1c4a1fa6-1886-4d4e-99a4-bd3b07e66296 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c1c2f05c7b48cfb2cd4ecb56a2a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8844923c06ca4a9e9fa774ed17c4fc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:42.537258 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1c4a1fa6-1886-4d4e-99a4-bd3b07e66296 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] 10.222.0.33 "GET /compute/v2.1/servers/fde8e9cc-b3de-4af8-a6e5-d5ab50af4844" status: 200 len: 1313 microversion: 2.1 time: 0.257694 Sep 23 04:41:42.538176 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1337/2655] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:42 2022] GET /compute/v2.1/servers/fde8e9cc-b3de-4af8-a6e5-d5ab50af4844 => generated 1313 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:42.543899 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0c9f1810-1212-455a-bda0-ffd49f4e9c28 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:42.547545 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-0c9f1810-1212-455a-bda0-ffd49f4e9c28 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 8a6b2904-2edd-4e9e-b6fa-1d6249721f52] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:42.551659 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:41:42.555680 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0c9f1810-1212-455a-bda0-ffd49f4e9c28 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:42.556276 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0c9f1810-1212-455a-bda0-ffd49f4e9c28 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:42.556994 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0c9f1810-1212-455a-bda0-ffd49f4e9c28 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:42.558121 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0c9f1810-1212-455a-bda0-ffd49f4e9c28 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:42.558640 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0c9f1810-1212-455a-bda0-ffd49f4e9c28 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:42.559122 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0c9f1810-1212-455a-bda0-ffd49f4e9c28 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:42.603766 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-758593f4-d0aa-46f5-b5bd-def0ee92767b tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:42.612981 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-758593f4-d0aa-46f5-b5bd-def0ee92767b tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:42.614687 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-758593f4-d0aa-46f5-b5bd-def0ee92767b tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:42.621706 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-758593f4-d0aa-46f5-b5bd-def0ee92767b tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1537 microversion: 2.91 time: 0.158555 Sep 23 04:41:42.622566 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1319/2656] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:41:42 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1537 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:41:42.788250 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-0c9f1810-1212-455a-bda0-ffd49f4e9c28 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:42.796998 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0c9f1810-1212-455a-bda0-ffd49f4e9c28 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/8a6b2904-2edd-4e9e-b6fa-1d6249721f52" status: 200 len: 1512 microversion: 2.1 time: 0.257333 Sep 23 04:41:42.809039 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1338/2657] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:42 2022] GET /compute/v2.1/servers/8a6b2904-2edd-4e9e-b6fa-1d6249721f52 => generated 1512 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:43.300917 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-885f4af2-0e24-4d83-823b-f4ff5664486b tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:43.301462 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-885f4af2-0e24-4d83-823b-f4ff5664486b tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] [instance: 4fe42fc2-8cfa-4571-9282-fa4a6fcd75c8] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:43.308807 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-885f4af2-0e24-4d83-823b-f4ff5664486b tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:43.309303 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-885f4af2-0e24-4d83-823b-f4ff5664486b tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:43.309743 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-885f4af2-0e24-4d83-823b-f4ff5664486b tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:43.310474 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-885f4af2-0e24-4d83-823b-f4ff5664486b tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:43.310937 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-885f4af2-0e24-4d83-823b-f4ff5664486b tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:43.311370 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-885f4af2-0e24-4d83-823b-f4ff5664486b tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:43.325062 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-954279ef-307f-4e94-bf8f-8382db9160bd tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:43.325758 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-954279ef-307f-4e94-bf8f-8382db9160bd tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] [instance: 5ee8a1da-f229-4716-bc67-da23f07963bd] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:43.334631 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-954279ef-307f-4e94-bf8f-8382db9160bd tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:43.335278 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-954279ef-307f-4e94-bf8f-8382db9160bd tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:43.335875 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-954279ef-307f-4e94-bf8f-8382db9160bd tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:43.337789 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-954279ef-307f-4e94-bf8f-8382db9160bd tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:43.338563 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-954279ef-307f-4e94-bf8f-8382db9160bd tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:43.339204 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-954279ef-307f-4e94-bf8f-8382db9160bd tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:43.510898 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-885f4af2-0e24-4d83-823b-f4ff5664486b tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6ade7cab39345e29e7ee7a977bc80f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56a38177bdb4624b9abe512ae98266b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:43.520309 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-885f4af2-0e24-4d83-823b-f4ff5664486b tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] 10.222.0.33 "GET /compute/v2.1/servers/4fe42fc2-8cfa-4571-9282-fa4a6fcd75c8" status: 200 len: 1350 microversion: 2.1 time: 0.223499 Sep 23 04:41:43.523195 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1320/2658] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:43 2022] GET /compute/v2.1/servers/4fe42fc2-8cfa-4571-9282-fa4a6fcd75c8 => generated 1350 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:43.527335 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-954279ef-307f-4e94-bf8f-8382db9160bd tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace08d8e105e46e299773c5a1b96039f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a16a53325a4d61aef94281435e9726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:43.535579 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-954279ef-307f-4e94-bf8f-8382db9160bd tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] 10.222.0.33 "GET /compute/v2.1/servers/5ee8a1da-f229-4716-bc67-da23f07963bd" status: 200 len: 1522 microversion: 2.1 time: 0.215028 Sep 23 04:41:43.536376 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1339/2659] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:43 2022] GET /compute/v2.1/servers/5ee8a1da-f229-4716-bc67-da23f07963bd => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:43.560755 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6fc8b5ef-b676-4adf-8262-6cf58fa4166b tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:43.561305 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-6fc8b5ef-b676-4adf-8262-6cf58fa4166b tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] [instance: fde8e9cc-b3de-4af8-a6e5-d5ab50af4844] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:43.567428 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6fc8b5ef-b676-4adf-8262-6cf58fa4166b tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:43.567932 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6fc8b5ef-b676-4adf-8262-6cf58fa4166b tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:43.568384 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6fc8b5ef-b676-4adf-8262-6cf58fa4166b tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:43.569094 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6fc8b5ef-b676-4adf-8262-6cf58fa4166b tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:43.569563 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6fc8b5ef-b676-4adf-8262-6cf58fa4166b tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:43.570052 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6fc8b5ef-b676-4adf-8262-6cf58fa4166b tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:43.655293 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a865baed-e522-46d9-8436-46578afe59b2 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:43.655902 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a865baed-e522-46d9-8436-46578afe59b2 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:43.661919 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a865baed-e522-46d9-8436-46578afe59b2 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:43.662632 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a865baed-e522-46d9-8436-46578afe59b2 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:43.663081 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a865baed-e522-46d9-8436-46578afe59b2 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:43.663812 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a865baed-e522-46d9-8436-46578afe59b2 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:43.664266 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a865baed-e522-46d9-8436-46578afe59b2 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:43.664692 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a865baed-e522-46d9-8436-46578afe59b2 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:43.688257 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:41:43.706955 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6fc8b5ef-b676-4adf-8262-6cf58fa4166b tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c1c2f05c7b48cfb2cd4ecb56a2a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8844923c06ca4a9e9fa774ed17c4fc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:43.717050 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-6fc8b5ef-b676-4adf-8262-6cf58fa4166b tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] 10.222.0.33 "GET /compute/v2.1/servers/fde8e9cc-b3de-4af8-a6e5-d5ab50af4844" status: 200 len: 1463 microversion: 2.1 time: 0.159796 Sep 23 04:41:43.717350 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1321/2660] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:43 2022] GET /compute/v2.1/servers/fde8e9cc-b3de-4af8-a6e5-d5ab50af4844 => generated 1463 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:43.737745 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a865baed-e522-46d9-8436-46578afe59b2 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:43.747240 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a865baed-e522-46d9-8436-46578afe59b2 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:43.749070 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a865baed-e522-46d9-8436-46578afe59b2 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:43.756591 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a865baed-e522-46d9-8436-46578afe59b2 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1537 microversion: 2.91 time: 0.109602 Sep 23 04:41:43.757319 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1340/2661] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:41:43 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1537 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:41:43.820704 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-65974741-2a12-4efd-9483-01a82b781bf9 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:43.821397 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-65974741-2a12-4efd-9483-01a82b781bf9 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 8a6b2904-2edd-4e9e-b6fa-1d6249721f52] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:43.829341 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-65974741-2a12-4efd-9483-01a82b781bf9 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:43.830224 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-65974741-2a12-4efd-9483-01a82b781bf9 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:43.830800 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-65974741-2a12-4efd-9483-01a82b781bf9 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:43.832190 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-65974741-2a12-4efd-9483-01a82b781bf9 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:43.832733 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-65974741-2a12-4efd-9483-01a82b781bf9 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:43.833234 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-65974741-2a12-4efd-9483-01a82b781bf9 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:43.938535 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4fe410b9-0788-4220-a3e7-0ff24e8f9124 tempest-TenantUsagesTestJSON-533631679 tempest-TenantUsagesTestJSON-533631679-project-admin] Calling method '.version_select at 0x7ff1c3d2f8b0>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:43.950618 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4fe410b9-0788-4220-a3e7-0ff24e8f9124 tempest-TenantUsagesTestJSON-533631679 tempest-TenantUsagesTestJSON-533631679-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:43.951144 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4fe410b9-0788-4220-a3e7-0ff24e8f9124 tempest-TenantUsagesTestJSON-533631679 tempest-TenantUsagesTestJSON-533631679-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:43.951820 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4fe410b9-0788-4220-a3e7-0ff24e8f9124 tempest-TenantUsagesTestJSON-533631679 tempest-TenantUsagesTestJSON-533631679-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:43.969117 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4fe410b9-0788-4220-a3e7-0ff24e8f9124 tempest-TenantUsagesTestJSON-533631679 tempest-TenantUsagesTestJSON-533631679-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:43.969602 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4fe410b9-0788-4220-a3e7-0ff24e8f9124 tempest-TenantUsagesTestJSON-533631679 tempest-TenantUsagesTestJSON-533631679-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:43.970075 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4fe410b9-0788-4220-a3e7-0ff24e8f9124 tempest-TenantUsagesTestJSON-533631679 tempest-TenantUsagesTestJSON-533631679-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:43.978462 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-65974741-2a12-4efd-9483-01a82b781bf9 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:43.987746 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-65974741-2a12-4efd-9483-01a82b781bf9 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/8a6b2904-2edd-4e9e-b6fa-1d6249721f52" status: 200 len: 1512 microversion: 2.1 time: 0.171278 Sep 23 04:41:43.988335 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1341/2662] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:43 2022] GET /compute/v2.1/servers/8a6b2904-2edd-4e9e-b6fa-1d6249721f52 => generated 1512 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:41:43.988829 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4fe410b9-0788-4220-a3e7-0ff24e8f9124 tempest-TenantUsagesTestJSON-533631679 tempest-TenantUsagesTestJSON-533631679-project-admin] 10.222.0.33 "GET /compute/v2.1/os-simple-tenant-usage/8844923c06ca4a9e9fa774ed17c4fc25?start=2022-09-22T04%3A41%3A43.741280&end=2022-09-24T04%3A41%3A43.741280" status: 200 len: 694 microversion: 2.1 time: 0.243537 Sep 23 04:41:43.989949 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1322/2663] 10.222.0.33 () {58 vars in 1412 bytes} [Fri Sep 23 04:41:43 2022] GET /compute/v2.1/os-simple-tenant-usage/8844923c06ca4a9e9fa774ed17c4fc25?start=2022-09-22T04%3A41%3A43.741280&end=2022-09-24T04%3A41%3A43.741280 => generated 694 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:41:44.004284 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d26b60d0-a8d8-4dc4-9dff-a99542ec8047 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Calling method '.version_select at 0x7ff1babf1430>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:44.016434 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d26b60d0-a8d8-4dc4-9dff-a99542ec8047 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:44.016924 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d26b60d0-a8d8-4dc4-9dff-a99542ec8047 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:44.017370 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d26b60d0-a8d8-4dc4-9dff-a99542ec8047 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:44.033913 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d26b60d0-a8d8-4dc4-9dff-a99542ec8047 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:44.034416 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d26b60d0-a8d8-4dc4-9dff-a99542ec8047 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:44.034862 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d26b60d0-a8d8-4dc4-9dff-a99542ec8047 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:44.052214 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d26b60d0-a8d8-4dc4-9dff-a99542ec8047 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] 10.222.0.33 "GET /compute/v2.1/os-simple-tenant-usage/8844923c06ca4a9e9fa774ed17c4fc25?start=2022-09-22T04%3A41%3A43.741280&end=2022-09-24T04%3A41%3A43.741280" status: 200 len: 694 microversion: 2.1 time: 0.051633 Sep 23 04:41:44.053021 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1342/2664] 10.222.0.33 () {58 vars in 1412 bytes} [Fri Sep 23 04:41:43 2022] GET /compute/v2.1/os-simple-tenant-usage/8844923c06ca4a9e9fa774ed17c4fc25?start=2022-09-22T04%3A41%3A43.741280&end=2022-09-24T04%3A41%3A43.741280 => generated 694 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:41:44.067221 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c1ff60a7-be12-40d6-a7b9-106806f3197e tempest-TenantUsagesTestJSON-533631679 tempest-TenantUsagesTestJSON-533631679-project-admin] Calling method '.version_select at 0x7ff1bbaa70d0>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:44.076628 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c1ff60a7-be12-40d6-a7b9-106806f3197e tempest-TenantUsagesTestJSON-533631679 tempest-TenantUsagesTestJSON-533631679-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:44.077046 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c1ff60a7-be12-40d6-a7b9-106806f3197e tempest-TenantUsagesTestJSON-533631679 tempest-TenantUsagesTestJSON-533631679-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:44.077488 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c1ff60a7-be12-40d6-a7b9-106806f3197e tempest-TenantUsagesTestJSON-533631679 tempest-TenantUsagesTestJSON-533631679-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:44.093639 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c1ff60a7-be12-40d6-a7b9-106806f3197e tempest-TenantUsagesTestJSON-533631679 tempest-TenantUsagesTestJSON-533631679-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:44.094161 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c1ff60a7-be12-40d6-a7b9-106806f3197e tempest-TenantUsagesTestJSON-533631679 tempest-TenantUsagesTestJSON-533631679-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:44.094606 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c1ff60a7-be12-40d6-a7b9-106806f3197e tempest-TenantUsagesTestJSON-533631679 tempest-TenantUsagesTestJSON-533631679-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:44.202169 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c1ff60a7-be12-40d6-a7b9-106806f3197e tempest-TenantUsagesTestJSON-533631679 tempest-TenantUsagesTestJSON-533631679-project-admin] 10.222.0.33 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-22T04%3A41%3A43.741280&end=2022-09-24T04%3A41%3A43.741280&detailed=1" status: 200 len: 29153 microversion: 2.1 time: 0.138531 Sep 23 04:41:44.202801 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1323/2665] 10.222.0.33 () {58 vars in 1335 bytes} [Fri Sep 23 04:41:44 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-22T04%3A41%3A43.741280&end=2022-09-24T04%3A41%3A43.741280&detailed=1 => generated 29153 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 04:41:44.242880 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1e0e3f90-7fce-4b4d-88ec-0677a5931fd0 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:44.243376 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1e0e3f90-7fce-4b4d-88ec-0677a5931fd0 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] [instance: fde8e9cc-b3de-4af8-a6e5-d5ab50af4844] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:44.249869 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e0e3f90-7fce-4b4d-88ec-0677a5931fd0 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:44.250391 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e0e3f90-7fce-4b4d-88ec-0677a5931fd0 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:44.250834 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e0e3f90-7fce-4b4d-88ec-0677a5931fd0 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:44.251533 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e0e3f90-7fce-4b4d-88ec-0677a5931fd0 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:44.251997 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e0e3f90-7fce-4b4d-88ec-0677a5931fd0 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:44.252458 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e0e3f90-7fce-4b4d-88ec-0677a5931fd0 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:44.277771 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1e0e3f90-7fce-4b4d-88ec-0677a5931fd0 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] [instance: fde8e9cc-b3de-4af8-a6e5-d5ab50af4844] Going to try to terminate instance {{(pid=122699) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:41:44.543503 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-fbee3ef5-08f9-432b-b4c6-7058582ff663 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:44.544096 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-fbee3ef5-08f9-432b-b4c6-7058582ff663 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] [instance: 4fe42fc2-8cfa-4571-9282-fa4a6fcd75c8] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:44.551993 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fbee3ef5-08f9-432b-b4c6-7058582ff663 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:44.552489 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fbee3ef5-08f9-432b-b4c6-7058582ff663 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:44.552934 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fbee3ef5-08f9-432b-b4c6-7058582ff663 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:44.553830 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fbee3ef5-08f9-432b-b4c6-7058582ff663 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:44.554325 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fbee3ef5-08f9-432b-b4c6-7058582ff663 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:44.554908 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fbee3ef5-08f9-432b-b4c6-7058582ff663 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:44.615077 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1e0e3f90-7fce-4b4d-88ec-0677a5931fd0 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] 10.222.0.33 "DELETE /compute/v2.1/servers/fde8e9cc-b3de-4af8-a6e5-d5ab50af4844" status: 204 len: 0 microversion: 2.1 time: 0.375740 Sep 23 04:41:44.619232 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1343/2666] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:41:44 2022] DELETE /compute/v2.1/servers/fde8e9cc-b3de-4af8-a6e5-d5ab50af4844 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:41:44.621340 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2190be8f-5b76-4be3-830f-d3cbe8473f3c tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:44.622080 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-2190be8f-5b76-4be3-830f-d3cbe8473f3c tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] [instance: 5ee8a1da-f229-4716-bc67-da23f07963bd] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:44.627895 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2190be8f-5b76-4be3-830f-d3cbe8473f3c tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:44.628391 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2190be8f-5b76-4be3-830f-d3cbe8473f3c tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:44.628838 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2190be8f-5b76-4be3-830f-d3cbe8473f3c tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:44.629542 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2190be8f-5b76-4be3-830f-d3cbe8473f3c tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:44.630032 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2190be8f-5b76-4be3-830f-d3cbe8473f3c tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:44.630466 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2190be8f-5b76-4be3-830f-d3cbe8473f3c tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:44.721806 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-fbee3ef5-08f9-432b-b4c6-7058582ff663 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6ade7cab39345e29e7ee7a977bc80f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56a38177bdb4624b9abe512ae98266b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:44.731206 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-fbee3ef5-08f9-432b-b4c6-7058582ff663 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] 10.222.0.33 "GET /compute/v2.1/servers/4fe42fc2-8cfa-4571-9282-fa4a6fcd75c8" status: 200 len: 1350 microversion: 2.1 time: 0.191562 Sep 23 04:41:44.735402 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1324/2667] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:44 2022] GET /compute/v2.1/servers/4fe42fc2-8cfa-4571-9282-fa4a6fcd75c8 => generated 1350 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:44.736743 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4a4e5213-bff3-4961-a5cd-d1fd43ce9374 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:44.737390 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4a4e5213-bff3-4961-a5cd-d1fd43ce9374 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] [instance: fde8e9cc-b3de-4af8-a6e5-d5ab50af4844] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:44.753552 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4a4e5213-bff3-4961-a5cd-d1fd43ce9374 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:44.754218 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4a4e5213-bff3-4961-a5cd-d1fd43ce9374 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:44.754779 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4a4e5213-bff3-4961-a5cd-d1fd43ce9374 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:44.755745 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4a4e5213-bff3-4961-a5cd-d1fd43ce9374 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:44.756422 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4a4e5213-bff3-4961-a5cd-d1fd43ce9374 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:44.757564 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4a4e5213-bff3-4961-a5cd-d1fd43ce9374 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:44.794562 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2190be8f-5b76-4be3-830f-d3cbe8473f3c tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace08d8e105e46e299773c5a1b96039f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a16a53325a4d61aef94281435e9726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:44.802535 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2190be8f-5b76-4be3-830f-d3cbe8473f3c tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] 10.222.0.33 "GET /compute/v2.1/servers/5ee8a1da-f229-4716-bc67-da23f07963bd" status: 200 len: 1522 microversion: 2.1 time: 0.185645 Sep 23 04:41:44.803312 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1344/2668] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:44 2022] GET /compute/v2.1/servers/5ee8a1da-f229-4716-bc67-da23f07963bd => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:44.809525 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3060450b-be1e-442b-a270-fac25fedcf20 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:44.809525 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-3060450b-be1e-442b-a270-fac25fedcf20 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:44.814833 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3060450b-be1e-442b-a270-fac25fedcf20 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:44.815334 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3060450b-be1e-442b-a270-fac25fedcf20 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:44.815779 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3060450b-be1e-442b-a270-fac25fedcf20 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:44.816672 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3060450b-be1e-442b-a270-fac25fedcf20 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:44.816943 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3060450b-be1e-442b-a270-fac25fedcf20 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:44.817376 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3060450b-be1e-442b-a270-fac25fedcf20 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:44.905536 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-3060450b-be1e-442b-a270-fac25fedcf20 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:44.916734 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-3060450b-be1e-442b-a270-fac25fedcf20 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:44.918349 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-3060450b-be1e-442b-a270-fac25fedcf20 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:44.923633 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3060450b-be1e-442b-a270-fac25fedcf20 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1537 microversion: 2.91 time: 0.119510 Sep 23 04:41:44.924236 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1345/2669] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:41:44 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1537 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:41:44.928488 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4a4e5213-bff3-4961-a5cd-d1fd43ce9374 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c1c2f05c7b48cfb2cd4ecb56a2a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8844923c06ca4a9e9fa774ed17c4fc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:44.944299 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4a4e5213-bff3-4961-a5cd-d1fd43ce9374 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] 10.222.0.33 "GET /compute/v2.1/servers/fde8e9cc-b3de-4af8-a6e5-d5ab50af4844" status: 200 len: 1469 microversion: 2.1 time: 0.211490 Sep 23 04:41:44.945135 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1325/2670] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:44 2022] GET /compute/v2.1/servers/fde8e9cc-b3de-4af8-a6e5-d5ab50af4844 => generated 1469 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:45.011267 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-75331453-2a8c-409e-8954-efaff5ce4ea6 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:45.012026 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-75331453-2a8c-409e-8954-efaff5ce4ea6 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 8a6b2904-2edd-4e9e-b6fa-1d6249721f52] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:45.019147 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-75331453-2a8c-409e-8954-efaff5ce4ea6 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:45.019742 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-75331453-2a8c-409e-8954-efaff5ce4ea6 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:45.020252 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-75331453-2a8c-409e-8954-efaff5ce4ea6 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:45.021031 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-75331453-2a8c-409e-8954-efaff5ce4ea6 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:45.021680 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-75331453-2a8c-409e-8954-efaff5ce4ea6 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:45.022215 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-75331453-2a8c-409e-8954-efaff5ce4ea6 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:45.163174 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-75331453-2a8c-409e-8954-efaff5ce4ea6 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:45.175167 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-75331453-2a8c-409e-8954-efaff5ce4ea6 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/8a6b2904-2edd-4e9e-b6fa-1d6249721f52" status: 200 len: 1512 microversion: 2.1 time: 0.167986 Sep 23 04:41:45.176323 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1346/2671] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:45 2022] GET /compute/v2.1/servers/8a6b2904-2edd-4e9e-b6fa-1d6249721f52 => generated 1512 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:45.758899 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a235bcb6-3a4d-434d-9a0d-3d4c4945f268 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:45.761093 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a235bcb6-3a4d-434d-9a0d-3d4c4945f268 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] [instance: 4fe42fc2-8cfa-4571-9282-fa4a6fcd75c8] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:45.769595 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a235bcb6-3a4d-434d-9a0d-3d4c4945f268 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:45.770516 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a235bcb6-3a4d-434d-9a0d-3d4c4945f268 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:45.771048 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a235bcb6-3a4d-434d-9a0d-3d4c4945f268 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:45.771879 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a235bcb6-3a4d-434d-9a0d-3d4c4945f268 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:45.772700 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a235bcb6-3a4d-434d-9a0d-3d4c4945f268 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:45.773748 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a235bcb6-3a4d-434d-9a0d-3d4c4945f268 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:45.789572 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=100 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:41:45.827445 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a2f6e303-2549-411b-a9ff-8dba5bc4d154 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:45.828063 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a2f6e303-2549-411b-a9ff-8dba5bc4d154 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] [instance: 5ee8a1da-f229-4716-bc67-da23f07963bd] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:45.830583 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=8 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:41:45.838412 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a2f6e303-2549-411b-a9ff-8dba5bc4d154 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:45.839527 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a2f6e303-2549-411b-a9ff-8dba5bc4d154 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:45.840223 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a2f6e303-2549-411b-a9ff-8dba5bc4d154 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:45.841293 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a2f6e303-2549-411b-a9ff-8dba5bc4d154 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:45.842272 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a2f6e303-2549-411b-a9ff-8dba5bc4d154 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:45.843620 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a2f6e303-2549-411b-a9ff-8dba5bc4d154 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:45.999994 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a235bcb6-3a4d-434d-9a0d-3d4c4945f268 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6ade7cab39345e29e7ee7a977bc80f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56a38177bdb4624b9abe512ae98266b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:46.007920 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a235bcb6-3a4d-434d-9a0d-3d4c4945f268 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] 10.222.0.33 "GET /compute/v2.1/servers/4fe42fc2-8cfa-4571-9282-fa4a6fcd75c8" status: 200 len: 1350 microversion: 2.1 time: 0.253786 Sep 23 04:41:46.008498 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1326/2672] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:45 2022] GET /compute/v2.1/servers/4fe42fc2-8cfa-4571-9282-fa4a6fcd75c8 => generated 1350 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:46.014665 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-cff8fa45-fbab-46c7-ab52-bc99f355d341 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:46.015362 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-cff8fa45-fbab-46c7-ab52-bc99f355d341 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:46.021301 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cff8fa45-fbab-46c7-ab52-bc99f355d341 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:46.021804 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cff8fa45-fbab-46c7-ab52-bc99f355d341 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:46.022266 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cff8fa45-fbab-46c7-ab52-bc99f355d341 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:46.023139 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cff8fa45-fbab-46c7-ab52-bc99f355d341 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:46.023752 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cff8fa45-fbab-46c7-ab52-bc99f355d341 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:46.024502 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cff8fa45-fbab-46c7-ab52-bc99f355d341 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:46.032168 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a2f6e303-2549-411b-a9ff-8dba5bc4d154 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace08d8e105e46e299773c5a1b96039f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a16a53325a4d61aef94281435e9726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:46.040614 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a2f6e303-2549-411b-a9ff-8dba5bc4d154 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] 10.222.0.33 "GET /compute/v2.1/servers/5ee8a1da-f229-4716-bc67-da23f07963bd" status: 200 len: 1522 microversion: 2.1 time: 0.217003 Sep 23 04:41:46.049190 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1347/2673] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:45 2022] GET /compute/v2.1/servers/5ee8a1da-f229-4716-bc67-da23f07963bd => generated 1522 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:41:46.049190 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5995176c-ba38-4a69-8714-7d1344264351 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:46.049190 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-5995176c-ba38-4a69-8714-7d1344264351 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] [instance: fde8e9cc-b3de-4af8-a6e5-d5ab50af4844] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:46.052722 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5995176c-ba38-4a69-8714-7d1344264351 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:46.053466 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5995176c-ba38-4a69-8714-7d1344264351 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:46.054161 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5995176c-ba38-4a69-8714-7d1344264351 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:46.054641 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5995176c-ba38-4a69-8714-7d1344264351 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:46.055105 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5995176c-ba38-4a69-8714-7d1344264351 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:46.055554 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5995176c-ba38-4a69-8714-7d1344264351 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:46.091786 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-cff8fa45-fbab-46c7-ab52-bc99f355d341 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:46.100358 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-cff8fa45-fbab-46c7-ab52-bc99f355d341 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:46.103525 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-cff8fa45-fbab-46c7-ab52-bc99f355d341 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:46.108246 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-cff8fa45-fbab-46c7-ab52-bc99f355d341 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1537 microversion: 2.91 time: 0.097931 Sep 23 04:41:46.108827 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1327/2674] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:41:46 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1537 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:41:46.199571 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2b4788e7-baf2-49e7-b83c-2390d77b9886 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:46.200469 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-2b4788e7-baf2-49e7-b83c-2390d77b9886 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 8a6b2904-2edd-4e9e-b6fa-1d6249721f52] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:46.201144 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-5995176c-ba38-4a69-8714-7d1344264351 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c1c2f05c7b48cfb2cd4ecb56a2a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8844923c06ca4a9e9fa774ed17c4fc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:46.207263 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2b4788e7-baf2-49e7-b83c-2390d77b9886 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:46.207986 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2b4788e7-baf2-49e7-b83c-2390d77b9886 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:46.208584 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2b4788e7-baf2-49e7-b83c-2390d77b9886 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:46.209480 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2b4788e7-baf2-49e7-b83c-2390d77b9886 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:46.209607 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5995176c-ba38-4a69-8714-7d1344264351 tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] 10.222.0.33 "GET /compute/v2.1/servers/fde8e9cc-b3de-4af8-a6e5-d5ab50af4844" status: 200 len: 1469 microversion: 2.1 time: 0.166853 Sep 23 04:41:46.209972 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2b4788e7-baf2-49e7-b83c-2390d77b9886 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:46.210231 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1348/2675] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:46 2022] GET /compute/v2.1/servers/fde8e9cc-b3de-4af8-a6e5-d5ab50af4844 => generated 1469 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:46.218226 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2b4788e7-baf2-49e7-b83c-2390d77b9886 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:46.359828 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-2b4788e7-baf2-49e7-b83c-2390d77b9886 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:46.368461 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2b4788e7-baf2-49e7-b83c-2390d77b9886 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/8a6b2904-2edd-4e9e-b6fa-1d6249721f52" status: 200 len: 1512 microversion: 2.1 time: 0.173165 Sep 23 04:41:46.370121 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1328/2676] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:46 2022] GET /compute/v2.1/servers/8a6b2904-2edd-4e9e-b6fa-1d6249721f52 => generated 1512 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:46.971089 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-4590fcc5-37c5-4e2b-a74f-0e5124322463 req-4984460c-62f8-4d0a-b758-2d5feadbf241 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fde8e9cc-b3de-4af8-a6e5-d5ab50af4844", "name": "network-vif-deleted", "tag": "31c78d18-fe06-4beb-bab2-05a3371ba287"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:41:46.983859 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-4590fcc5-37c5-4e2b-a74f-0e5124322463 req-4984460c-62f8-4d0a-b758-2d5feadbf241 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:46.984650 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-4590fcc5-37c5-4e2b-a74f-0e5124322463 req-4984460c-62f8-4d0a-b758-2d5feadbf241 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:46.985082 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-4590fcc5-37c5-4e2b-a74f-0e5124322463 req-4984460c-62f8-4d0a-b758-2d5feadbf241 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:47.000753 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-4590fcc5-37c5-4e2b-a74f-0e5124322463 req-4984460c-62f8-4d0a-b758-2d5feadbf241 service nova] Creating event network-vif-deleted:31c78d18-fe06-4beb-bab2-05a3371ba287 for instance fde8e9cc-b3de-4af8-a6e5-d5ab50af4844 on n-h2-846463-3 Sep 23 04:41:47.005703 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-4590fcc5-37c5-4e2b-a74f-0e5124322463 req-4984460c-62f8-4d0a-b758-2d5feadbf241 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039582 Sep 23 04:41:47.006352 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1349/2677] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:41:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:41:47.032116 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-077b218c-b0f7-4e54-9fa0-ef911de00b1b tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:47.032750 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-077b218c-b0f7-4e54-9fa0-ef911de00b1b tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] [instance: 4fe42fc2-8cfa-4571-9282-fa4a6fcd75c8] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:47.039788 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-077b218c-b0f7-4e54-9fa0-ef911de00b1b tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:47.040325 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-077b218c-b0f7-4e54-9fa0-ef911de00b1b tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:47.040775 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-077b218c-b0f7-4e54-9fa0-ef911de00b1b tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:47.041491 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-077b218c-b0f7-4e54-9fa0-ef911de00b1b tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:47.041990 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-077b218c-b0f7-4e54-9fa0-ef911de00b1b tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:47.042432 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-077b218c-b0f7-4e54-9fa0-ef911de00b1b tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:47.064636 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5f3c0b01-b79b-45f8-ad13-b45ff29fa7d5 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:47.065532 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-5f3c0b01-b79b-45f8-ad13-b45ff29fa7d5 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] [instance: 5ee8a1da-f229-4716-bc67-da23f07963bd] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:47.072736 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5f3c0b01-b79b-45f8-ad13-b45ff29fa7d5 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:47.073434 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5f3c0b01-b79b-45f8-ad13-b45ff29fa7d5 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:47.074143 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5f3c0b01-b79b-45f8-ad13-b45ff29fa7d5 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:47.074858 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5f3c0b01-b79b-45f8-ad13-b45ff29fa7d5 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:47.075489 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5f3c0b01-b79b-45f8-ad13-b45ff29fa7d5 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:47.075920 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5f3c0b01-b79b-45f8-ad13-b45ff29fa7d5 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:47.268605 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-077b218c-b0f7-4e54-9fa0-ef911de00b1b tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6ade7cab39345e29e7ee7a977bc80f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56a38177bdb4624b9abe512ae98266b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:47.278249 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-5f3c0b01-b79b-45f8-ad13-b45ff29fa7d5 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace08d8e105e46e299773c5a1b96039f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a16a53325a4d61aef94281435e9726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:47.286686 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-077b218c-b0f7-4e54-9fa0-ef911de00b1b tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] 10.222.0.33 "GET /compute/v2.1/servers/4fe42fc2-8cfa-4571-9282-fa4a6fcd75c8" status: 200 len: 1350 microversion: 2.1 time: 0.258363 Sep 23 04:41:47.289078 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5f3c0b01-b79b-45f8-ad13-b45ff29fa7d5 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] 10.222.0.33 "GET /compute/v2.1/servers/5ee8a1da-f229-4716-bc67-da23f07963bd" status: 200 len: 1522 microversion: 2.1 time: 0.226326 Sep 23 04:41:47.290280 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1350/2678] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:47 2022] GET /compute/v2.1/servers/5ee8a1da-f229-4716-bc67-da23f07963bd => generated 1522 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:47.300127 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ef1b79d4-5db5-4fff-ab10-496c2bf43aab tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:47.300991 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ef1b79d4-5db5-4fff-ab10-496c2bf43aab tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:47.309143 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1329/2679] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:47 2022] GET /compute/v2.1/servers/4fe42fc2-8cfa-4571-9282-fa4a6fcd75c8 => generated 1350 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:47.309727 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ef1b79d4-5db5-4fff-ab10-496c2bf43aab tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:47.310431 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ef1b79d4-5db5-4fff-ab10-496c2bf43aab tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:47.311516 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ef1b79d4-5db5-4fff-ab10-496c2bf43aab tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:47.312423 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ef1b79d4-5db5-4fff-ab10-496c2bf43aab tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:47.313728 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ef1b79d4-5db5-4fff-ab10-496c2bf43aab tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:47.314197 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ef1b79d4-5db5-4fff-ab10-496c2bf43aab tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:47.316264 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4e9e9ac2-e7ea-4727-ac96-1271e2eabfcc tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:47.316878 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4e9e9ac2-e7ea-4727-ac96-1271e2eabfcc tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] [instance: fde8e9cc-b3de-4af8-a6e5-d5ab50af4844] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:47.332288 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4e9e9ac2-e7ea-4727-ac96-1271e2eabfcc tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:47.334760 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4e9e9ac2-e7ea-4727-ac96-1271e2eabfcc tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:47.335293 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4e9e9ac2-e7ea-4727-ac96-1271e2eabfcc tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:47.336208 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4e9e9ac2-e7ea-4727-ac96-1271e2eabfcc tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:47.336893 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4e9e9ac2-e7ea-4727-ac96-1271e2eabfcc tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:47.337539 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4e9e9ac2-e7ea-4727-ac96-1271e2eabfcc tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:47.371343 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4e9e9ac2-e7ea-4727-ac96-1271e2eabfcc tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:47.371977 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4e9e9ac2-e7ea-4727-ac96-1271e2eabfcc tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:47.372514 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4e9e9ac2-e7ea-4727-ac96-1271e2eabfcc tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:47.373053 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-4e9e9ac2-e7ea-4727-ac96-1271e2eabfcc tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Lazy-loading 'fault' on Instance uuid fde8e9cc-b3de-4af8-a6e5-d5ab50af4844 {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:41:47.381772 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ef1b79d4-5db5-4fff-ab10-496c2bf43aab tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:47.392940 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ef1b79d4-5db5-4fff-ab10-496c2bf43aab tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:47.394714 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ef1b79d4-5db5-4fff-ab10-496c2bf43aab tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:47.400627 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ef1b79d4-5db5-4fff-ab10-496c2bf43aab tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1558 microversion: 2.91 time: 0.108978 Sep 23 04:41:47.401592 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1351/2680] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:41:47 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1558 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:41:47.411400 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1303e232-c6ce-40a6-8e41-8aa26edccdc5 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:47.411591 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1303e232-c6ce-40a6-8e41-8aa26edccdc5 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 8a6b2904-2edd-4e9e-b6fa-1d6249721f52] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:47.421044 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1303e232-c6ce-40a6-8e41-8aa26edccdc5 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:47.421638 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1303e232-c6ce-40a6-8e41-8aa26edccdc5 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:47.422040 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1303e232-c6ce-40a6-8e41-8aa26edccdc5 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:47.422765 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1303e232-c6ce-40a6-8e41-8aa26edccdc5 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:47.423230 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1303e232-c6ce-40a6-8e41-8aa26edccdc5 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:47.423665 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1303e232-c6ce-40a6-8e41-8aa26edccdc5 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:47.424533 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4e9e9ac2-e7ea-4727-ac96-1271e2eabfcc tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c1c2f05c7b48cfb2cd4ecb56a2a21a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8844923c06ca4a9e9fa774ed17c4fc25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:47.436289 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4e9e9ac2-e7ea-4727-ac96-1271e2eabfcc tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] 10.222.0.33 "GET /compute/v2.1/servers/fde8e9cc-b3de-4af8-a6e5-d5ab50af4844" status: 200 len: 1303 microversion: 2.1 time: 0.125962 Sep 23 04:41:47.448325 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1330/2681] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:47 2022] GET /compute/v2.1/servers/fde8e9cc-b3de-4af8-a6e5-d5ab50af4844 => generated 1303 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:47.595924 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1303e232-c6ce-40a6-8e41-8aa26edccdc5 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:47.602564 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-a9d73d1b-5638-4090-8134-1678fa684e39 req-4f593774-03b1-4c18-b339-a2573a81f9ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fe42fc2-8cfa-4571-9282-fa4a6fcd75c8", "name": "network-vif-plugged", "status": "completed", "tag": "9beb8450-2cd0-4018-9daa-49a22c787feb"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:41:47.608847 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1303e232-c6ce-40a6-8e41-8aa26edccdc5 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/8a6b2904-2edd-4e9e-b6fa-1d6249721f52" status: 200 len: 1512 microversion: 2.1 time: 0.203704 Sep 23 04:41:47.609526 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1352/2682] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:47 2022] GET /compute/v2.1/servers/8a6b2904-2edd-4e9e-b6fa-1d6249721f52 => generated 1512 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:47.613623 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-a9d73d1b-5638-4090-8134-1678fa684e39 req-4f593774-03b1-4c18-b339-a2573a81f9ca service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:47.614150 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-a9d73d1b-5638-4090-8134-1678fa684e39 req-4f593774-03b1-4c18-b339-a2573a81f9ca service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:47.614590 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-a9d73d1b-5638-4090-8134-1678fa684e39 req-4f593774-03b1-4c18-b339-a2573a81f9ca service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:47.626370 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-a9d73d1b-5638-4090-8134-1678fa684e39 req-4f593774-03b1-4c18-b339-a2573a81f9ca service nova] Creating event network-vif-plugged:9beb8450-2cd0-4018-9daa-49a22c787feb for instance 4fe42fc2-8cfa-4571-9282-fa4a6fcd75c8 on n-h1-846463-3 Sep 23 04:41:47.631694 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-a9d73d1b-5638-4090-8134-1678fa684e39 req-4f593774-03b1-4c18-b339-a2573a81f9ca service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035748 Sep 23 04:41:47.632283 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1331/2683] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:41:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:41:48.315991 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a0ffd348-9799-42b3-836b-48476d4b3a66 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:48.316556 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a0ffd348-9799-42b3-836b-48476d4b3a66 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] [instance: 5ee8a1da-f229-4716-bc67-da23f07963bd] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:48.317210 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-63dd0c05-5277-45e2-a313-fba49002db30 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:48.324631 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a0ffd348-9799-42b3-836b-48476d4b3a66 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:48.324873 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-63dd0c05-5277-45e2-a313-fba49002db30 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] [instance: 4fe42fc2-8cfa-4571-9282-fa4a6fcd75c8] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:48.325513 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a0ffd348-9799-42b3-836b-48476d4b3a66 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:48.326152 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a0ffd348-9799-42b3-836b-48476d4b3a66 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:48.327034 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a0ffd348-9799-42b3-836b-48476d4b3a66 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:48.327664 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a0ffd348-9799-42b3-836b-48476d4b3a66 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:48.328430 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a0ffd348-9799-42b3-836b-48476d4b3a66 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:48.338974 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-63dd0c05-5277-45e2-a313-fba49002db30 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:48.339481 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-63dd0c05-5277-45e2-a313-fba49002db30 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:48.339909 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-63dd0c05-5277-45e2-a313-fba49002db30 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:48.340622 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-63dd0c05-5277-45e2-a313-fba49002db30 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:48.341080 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-63dd0c05-5277-45e2-a313-fba49002db30 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:48.341507 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-63dd0c05-5277-45e2-a313-fba49002db30 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:48.549878 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a0ffd348-9799-42b3-836b-48476d4b3a66 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace08d8e105e46e299773c5a1b96039f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a16a53325a4d61aef94281435e9726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:48.556337 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-63dd0c05-5277-45e2-a313-fba49002db30 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6ade7cab39345e29e7ee7a977bc80f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56a38177bdb4624b9abe512ae98266b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:48.559178 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a0ffd348-9799-42b3-836b-48476d4b3a66 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] 10.222.0.33 "GET /compute/v2.1/servers/5ee8a1da-f229-4716-bc67-da23f07963bd" status: 200 len: 1522 microversion: 2.1 time: 0.247143 Sep 23 04:41:48.560224 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1353/2684] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:48 2022] GET /compute/v2.1/servers/5ee8a1da-f229-4716-bc67-da23f07963bd => generated 1522 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:41:48.564866 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-15ed9cc5-3dec-4096-8872-6baa597eaedd tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:48.565611 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-15ed9cc5-3dec-4096-8872-6baa597eaedd tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:48.572273 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-15ed9cc5-3dec-4096-8872-6baa597eaedd tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:48.572807 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-15ed9cc5-3dec-4096-8872-6baa597eaedd tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:48.573340 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-15ed9cc5-3dec-4096-8872-6baa597eaedd tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:48.574212 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-15ed9cc5-3dec-4096-8872-6baa597eaedd tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:48.574778 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-15ed9cc5-3dec-4096-8872-6baa597eaedd tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:48.575293 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-15ed9cc5-3dec-4096-8872-6baa597eaedd tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:48.580912 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-63dd0c05-5277-45e2-a313-fba49002db30 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] 10.222.0.33 "GET /compute/v2.1/servers/4fe42fc2-8cfa-4571-9282-fa4a6fcd75c8" status: 200 len: 1350 microversion: 2.1 time: 0.268673 Sep 23 04:41:48.581703 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1332/2685] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:48 2022] GET /compute/v2.1/servers/4fe42fc2-8cfa-4571-9282-fa4a6fcd75c8 => generated 1350 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:41:48.586420 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8ee63d94-3ee9-4696-986e-4f50ae7e66ea tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:48.587237 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8ee63d94-3ee9-4696-986e-4f50ae7e66ea tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] [instance: fde8e9cc-b3de-4af8-a6e5-d5ab50af4844] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:48.594094 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8ee63d94-3ee9-4696-986e-4f50ae7e66ea tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:48.594787 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8ee63d94-3ee9-4696-986e-4f50ae7e66ea tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:48.595408 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8ee63d94-3ee9-4696-986e-4f50ae7e66ea tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:48.596276 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8ee63d94-3ee9-4696-986e-4f50ae7e66ea tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:48.596889 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8ee63d94-3ee9-4696-986e-4f50ae7e66ea tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:48.597467 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8ee63d94-3ee9-4696-986e-4f50ae7e66ea tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:48.612167 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-8ee63d94-3ee9-4696-986e-4f50ae7e66ea tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] HTTP exception thrown: Instance fde8e9cc-b3de-4af8-a6e5-d5ab50af4844 could not be found. Sep 23 04:41:48.614150 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8ee63d94-3ee9-4696-986e-4f50ae7e66ea tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Request method failure captured: Sep 23 04:41:48.614150 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/fde8e9cc-b3de-4af8-a6e5-d5ab50af4844 HTTP/1.1 Sep 23 04:41:48.614150 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:41:48.614150 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:41:48.614150 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:41:48.614150 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:41:48.614150 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:41:48.614150 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:41:48.614150 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:41:48.614150 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:41:48.614150 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTjwoPfsQQho0Dq-5fqg5OocPhZ6FpNRjKb9zO-xR145GDWnaA5i_td2D6_QeWBBgDey5r2u_QGBBDc2hxN8WLcCvpEwv-3mQJ89JT7jRVQJON0C5kkDTAV3f3sqxV1uOITH0RSv5RopCtRwdxbMpekg8MiDmqNOpgA1swJngNhvbjc Sep 23 04:41:48.614150 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:41:48.614150 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:41:48.614150 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:41:48.614150 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:41:48.614150 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:41:48.614150 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:41:48.614150 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 8844923c06ca4a9e9fa774ed17c4fc25 Sep 23 04:41:48.614150 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-TenantUsagesTestJSON-1839625464 Sep 23 04:41:48.614150 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:41:48.614150 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:41:48.614150 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8844923c06ca4a9e9fa774ed17c4fc25", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8844923c06ca4a9e9fa774ed17c4fc25"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8844923c06ca4a9e9fa774ed17c4fc25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8844923c06ca4a9e9fa774ed17c4fc25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:41:48.614150 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-TenantUsagesTestJSON-1839625464 Sep 23 04:41:48.614150 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 8844923c06ca4a9e9fa774ed17c4fc25 Sep 23 04:41:48.614150 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-TenantUsagesTestJSON-1839625464 Sep 23 04:41:48.614150 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-TenantUsagesTestJSON-1839625464-project Sep 23 04:41:48.614150 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:41:48.614150 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:41:48.614150 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: f7c1c2f05c7b48cfb2cd4ecb56a2a21a Sep 23 04:41:48.614150 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-TenantUsagesTestJSON-1839625464-project Sep 23 04:41:48.614150 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:41:48.614150 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance fde8e9cc-b3de-4af8-a6e5-d5ab50af4844 could not be found. Sep 23 04:41:48.614150 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': 'fde8e9cc-b3de-4af8-a6e5-d5ab50af4844'} Sep 23 04:41:48.614150 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:41:48.614150 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:41:48.614150 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:41:48.614150 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:41:48.614150 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:41:48.614150 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:41:48.614150 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:41:48.614150 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:41:48.614150 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:41:48.614150 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:41:48.614150 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fde8e9cc-b3de-4af8-a6e5-d5ab50af4844 could not be found. Sep 23 04:41:48.614150 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:41:48.614150 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:41:48.614150 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:41:48.614150 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:41:48.614150 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:41:48.614150 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:41:48.614150 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:41:48.614150 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:41:48.614150 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:41:48.614150 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:41:48.614150 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:41:48.614150 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:41:48.614150 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:41:48.614150 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:41:48.614150 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:41:48.614150 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:41:48.614150 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fde8e9cc-b3de-4af8-a6e5-d5ab50af4844 could not be found. Sep 23 04:41:48.614150 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:41:48.614150 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:41:48.614150 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:41:48.618680 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:41:48.618680 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:41:48.618680 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:41:48.618680 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:41:48.618680 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:41:48.618680 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fde8e9cc-b3de-4af8-a6e5-d5ab50af4844 could not be found. Sep 23 04:41:48.618680 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:41:48.619944 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8ee63d94-3ee9-4696-986e-4f50ae7e66ea tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] Returning 404 to user: Instance fde8e9cc-b3de-4af8-a6e5-d5ab50af4844 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:41:48.620816 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8ee63d94-3ee9-4696-986e-4f50ae7e66ea tempest-TenantUsagesTestJSON-1839625464 tempest-TenantUsagesTestJSON-1839625464-project] 10.222.0.33 "GET /compute/v2.1/servers/fde8e9cc-b3de-4af8-a6e5-d5ab50af4844" status: 404 len: 111 microversion: 2.1 time: 0.037938 Sep 23 04:41:48.621399 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1333/2686] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:48 2022] GET /compute/v2.1/servers/fde8e9cc-b3de-4af8-a6e5-d5ab50af4844 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:41:48.634780 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-63d7c7af-c363-407c-9cc9-fe2a3692b956 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:48.635518 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-63d7c7af-c363-407c-9cc9-fe2a3692b956 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 8a6b2904-2edd-4e9e-b6fa-1d6249721f52] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:48.642552 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-63d7c7af-c363-407c-9cc9-fe2a3692b956 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:48.643074 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-63d7c7af-c363-407c-9cc9-fe2a3692b956 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:48.643617 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-63d7c7af-c363-407c-9cc9-fe2a3692b956 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:48.644426 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-63d7c7af-c363-407c-9cc9-fe2a3692b956 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:48.644988 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-63d7c7af-c363-407c-9cc9-fe2a3692b956 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:48.645517 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-63d7c7af-c363-407c-9cc9-fe2a3692b956 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:48.653540 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-15ed9cc5-3dec-4096-8872-6baa597eaedd tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:48.662123 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-15ed9cc5-3dec-4096-8872-6baa597eaedd tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:48.663875 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-15ed9cc5-3dec-4096-8872-6baa597eaedd tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:48.669373 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-15ed9cc5-3dec-4096-8872-6baa597eaedd tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1558 microversion: 2.91 time: 0.108387 Sep 23 04:41:48.670094 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1354/2687] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:41:48 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1558 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:41:48.793216 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-63d7c7af-c363-407c-9cc9-fe2a3692b956 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:48.801061 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-63d7c7af-c363-407c-9cc9-fe2a3692b956 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/8a6b2904-2edd-4e9e-b6fa-1d6249721f52" status: 200 len: 1512 microversion: 2.1 time: 0.171665 Sep 23 04:41:48.801625 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1334/2688] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:48 2022] GET /compute/v2.1/servers/8a6b2904-2edd-4e9e-b6fa-1d6249721f52 => generated 1512 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:49.587578 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1855d7fe-b8dd-4079-bdfc-50d34313de92 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:49.588346 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1855d7fe-b8dd-4079-bdfc-50d34313de92 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] [instance: 5ee8a1da-f229-4716-bc67-da23f07963bd] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:49.595246 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1855d7fe-b8dd-4079-bdfc-50d34313de92 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:49.595864 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1855d7fe-b8dd-4079-bdfc-50d34313de92 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:49.596404 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1855d7fe-b8dd-4079-bdfc-50d34313de92 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:49.597312 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1855d7fe-b8dd-4079-bdfc-50d34313de92 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:49.597905 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1855d7fe-b8dd-4079-bdfc-50d34313de92 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:49.598435 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1855d7fe-b8dd-4079-bdfc-50d34313de92 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:49.606575 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-53a1658e-108e-4b51-ba34-8af044d994f0 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:49.607190 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-53a1658e-108e-4b51-ba34-8af044d994f0 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] [instance: 4fe42fc2-8cfa-4571-9282-fa4a6fcd75c8] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:49.614666 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-53a1658e-108e-4b51-ba34-8af044d994f0 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:49.615571 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-53a1658e-108e-4b51-ba34-8af044d994f0 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:49.616016 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-53a1658e-108e-4b51-ba34-8af044d994f0 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:49.616733 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-53a1658e-108e-4b51-ba34-8af044d994f0 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:49.617195 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-53a1658e-108e-4b51-ba34-8af044d994f0 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:49.617623 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-53a1658e-108e-4b51-ba34-8af044d994f0 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:49.823686 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1855d7fe-b8dd-4079-bdfc-50d34313de92 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace08d8e105e46e299773c5a1b96039f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a16a53325a4d61aef94281435e9726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:49.831423 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1855d7fe-b8dd-4079-bdfc-50d34313de92 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] 10.222.0.33 "GET /compute/v2.1/servers/5ee8a1da-f229-4716-bc67-da23f07963bd" status: 200 len: 1522 microversion: 2.1 time: 0.248937 Sep 23 04:41:49.832273 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1355/2689] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:49 2022] GET /compute/v2.1/servers/5ee8a1da-f229-4716-bc67-da23f07963bd => generated 1522 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:49.852298 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-47307878-1b85-49a0-ac34-88e24289c868 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:49.853806 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-47307878-1b85-49a0-ac34-88e24289c868 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:49.857571 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-53a1658e-108e-4b51-ba34-8af044d994f0 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6ade7cab39345e29e7ee7a977bc80f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56a38177bdb4624b9abe512ae98266b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:49.860626 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-47307878-1b85-49a0-ac34-88e24289c868 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:49.861376 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-47307878-1b85-49a0-ac34-88e24289c868 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:49.862117 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-47307878-1b85-49a0-ac34-88e24289c868 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:49.863053 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-47307878-1b85-49a0-ac34-88e24289c868 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:49.863753 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-47307878-1b85-49a0-ac34-88e24289c868 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:49.864366 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-47307878-1b85-49a0-ac34-88e24289c868 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:49.865471 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-53a1658e-108e-4b51-ba34-8af044d994f0 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] 10.222.0.33 "GET /compute/v2.1/servers/4fe42fc2-8cfa-4571-9282-fa4a6fcd75c8" status: 200 len: 1539 microversion: 2.1 time: 0.263300 Sep 23 04:41:49.866081 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1335/2690] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:49 2022] GET /compute/v2.1/servers/4fe42fc2-8cfa-4571-9282-fa4a6fcd75c8 => generated 1539 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:49.871721 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-57180a15-ebe1-4914-8258-c7cef98d9233 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:49.871845 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-57180a15-ebe1-4914-8258-c7cef98d9233 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 8a6b2904-2edd-4e9e-b6fa-1d6249721f52] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:49.877686 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-57180a15-ebe1-4914-8258-c7cef98d9233 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:49.878424 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-57180a15-ebe1-4914-8258-c7cef98d9233 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:49.879072 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-57180a15-ebe1-4914-8258-c7cef98d9233 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:49.879961 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-57180a15-ebe1-4914-8258-c7cef98d9233 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:49.880602 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-57180a15-ebe1-4914-8258-c7cef98d9233 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:49.881211 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-57180a15-ebe1-4914-8258-c7cef98d9233 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:49.942871 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-47307878-1b85-49a0-ac34-88e24289c868 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:49.949851 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:41:49.958299 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-47307878-1b85-49a0-ac34-88e24289c868 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:49.960542 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-47307878-1b85-49a0-ac34-88e24289c868 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:49.966454 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-47307878-1b85-49a0-ac34-88e24289c868 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1553 microversion: 2.91 time: 0.119157 Sep 23 04:41:49.967071 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1356/2691] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:41:49 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1553 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:41:49.972141 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6ae27094-cac7-42a0-9c53-5b79c5d78434 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:49.973238 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-6ae27094-cac7-42a0-9c53-5b79c5d78434 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] [instance: 4fe42fc2-8cfa-4571-9282-fa4a6fcd75c8] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:49.980037 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6ae27094-cac7-42a0-9c53-5b79c5d78434 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:49.980807 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6ae27094-cac7-42a0-9c53-5b79c5d78434 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:49.981255 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6ae27094-cac7-42a0-9c53-5b79c5d78434 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:49.984974 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6ae27094-cac7-42a0-9c53-5b79c5d78434 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:49.984974 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6ae27094-cac7-42a0-9c53-5b79c5d78434 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:49.984974 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6ae27094-cac7-42a0-9c53-5b79c5d78434 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:50.121280 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6ae27094-cac7-42a0-9c53-5b79c5d78434 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] 10.222.0.33 "GET /compute/v2.1/servers/4fe42fc2-8cfa-4571-9282-fa4a6fcd75c8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.152698 Sep 23 04:41:50.121909 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1357/2692] 10.222.0.33 () {58 vars in 1275 bytes} [Fri Sep 23 04:41:49 2022] GET /compute/v2.1/servers/4fe42fc2-8cfa-4571-9282-fa4a6fcd75c8/os-interface => generated 284 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:41:50.132049 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-57180a15-ebe1-4914-8258-c7cef98d9233 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:50.143168 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-57180a15-ebe1-4914-8258-c7cef98d9233 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/8a6b2904-2edd-4e9e-b6fa-1d6249721f52" status: 200 len: 1512 microversion: 2.1 time: 0.275995 Sep 23 04:41:50.144484 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1336/2693] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:49 2022] GET /compute/v2.1/servers/8a6b2904-2edd-4e9e-b6fa-1d6249721f52 => generated 1512 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:50.865083 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-084126af-f99e-4da2-9098-4c9544290dfa tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:50.866308 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-084126af-f99e-4da2-9098-4c9544290dfa tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] [instance: 5ee8a1da-f229-4716-bc67-da23f07963bd] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:50.875149 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-084126af-f99e-4da2-9098-4c9544290dfa tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:50.875980 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-084126af-f99e-4da2-9098-4c9544290dfa tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:50.876622 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-084126af-f99e-4da2-9098-4c9544290dfa tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:50.877504 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-084126af-f99e-4da2-9098-4c9544290dfa tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:50.878338 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-084126af-f99e-4da2-9098-4c9544290dfa tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:50.879189 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-084126af-f99e-4da2-9098-4c9544290dfa tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:51.002944 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-dc156e3c-c382-4e85-bf6d-be8deb1f9351 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:51.002944 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-dc156e3c-c382-4e85-bf6d-be8deb1f9351 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:51.012058 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dc156e3c-c382-4e85-bf6d-be8deb1f9351 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:51.013309 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dc156e3c-c382-4e85-bf6d-be8deb1f9351 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:51.017571 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dc156e3c-c382-4e85-bf6d-be8deb1f9351 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:51.017571 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dc156e3c-c382-4e85-bf6d-be8deb1f9351 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:51.017571 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dc156e3c-c382-4e85-bf6d-be8deb1f9351 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:51.017571 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dc156e3c-c382-4e85-bf6d-be8deb1f9351 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:51.178347 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-dc156e3c-c382-4e85-bf6d-be8deb1f9351 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:51.194452 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-dc156e3c-c382-4e85-bf6d-be8deb1f9351 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:51.196248 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-dc156e3c-c382-4e85-bf6d-be8deb1f9351 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:51.203043 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-dc156e3c-c382-4e85-bf6d-be8deb1f9351 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1553 microversion: 2.91 time: 0.208869 Sep 23 04:41:51.204214 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1337/2694] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:41:50 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1553 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:41:51.210276 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7c54b1e5-71a8-44e3-84d3-f97763607589 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:51.211394 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7c54b1e5-71a8-44e3-84d3-f97763607589 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 8a6b2904-2edd-4e9e-b6fa-1d6249721f52] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:51.219078 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=100 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:41:51.221229 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7c54b1e5-71a8-44e3-84d3-f97763607589 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:51.221927 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7c54b1e5-71a8-44e3-84d3-f97763607589 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:51.222619 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7c54b1e5-71a8-44e3-84d3-f97763607589 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:51.223611 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7c54b1e5-71a8-44e3-84d3-f97763607589 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:51.224556 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7c54b1e5-71a8-44e3-84d3-f97763607589 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:51.225272 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7c54b1e5-71a8-44e3-84d3-f97763607589 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:51.835610 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-084126af-f99e-4da2-9098-4c9544290dfa tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace08d8e105e46e299773c5a1b96039f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a16a53325a4d61aef94281435e9726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:51.845850 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-084126af-f99e-4da2-9098-4c9544290dfa tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] 10.222.0.33 "GET /compute/v2.1/servers/5ee8a1da-f229-4716-bc67-da23f07963bd" status: 200 len: 1522 microversion: 2.1 time: 0.988920 Sep 23 04:41:51.859254 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1358/2695] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:50 2022] GET /compute/v2.1/servers/5ee8a1da-f229-4716-bc67-da23f07963bd => generated 1522 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:52.079022 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-7c54b1e5-71a8-44e3-84d3-f97763607589 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:52.088645 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7c54b1e5-71a8-44e3-84d3-f97763607589 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/8a6b2904-2edd-4e9e-b6fa-1d6249721f52" status: 200 len: 1512 microversion: 2.1 time: 0.883084 Sep 23 04:41:52.089240 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1338/2696] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:51 2022] GET /compute/v2.1/servers/8a6b2904-2edd-4e9e-b6fa-1d6249721f52 => generated 1512 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:52.240331 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-43c1248c-e579-4d3f-a801-0341734bb969 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:52.240989 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-43c1248c-e579-4d3f-a801-0341734bb969 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:52.254412 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-43c1248c-e579-4d3f-a801-0341734bb969 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:52.255018 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-43c1248c-e579-4d3f-a801-0341734bb969 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:52.255484 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-43c1248c-e579-4d3f-a801-0341734bb969 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:52.256228 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-43c1248c-e579-4d3f-a801-0341734bb969 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:52.261454 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-43c1248c-e579-4d3f-a801-0341734bb969 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:52.261981 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-43c1248c-e579-4d3f-a801-0341734bb969 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:52.367136 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-cdebf023-81c6-4574-be5e-0314684cfc86 req-92e9756c-bc13-49a8-9010-ef62e1e64fb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fe42fc2-8cfa-4571-9282-fa4a6fcd75c8", "tag": "9beb8450-2cd0-4018-9daa-49a22c787feb"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:41:52.387973 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-cdebf023-81c6-4574-be5e-0314684cfc86 req-92e9756c-bc13-49a8-9010-ef62e1e64fb5 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:52.388477 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-cdebf023-81c6-4574-be5e-0314684cfc86 req-92e9756c-bc13-49a8-9010-ef62e1e64fb5 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:52.389226 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-cdebf023-81c6-4574-be5e-0314684cfc86 req-92e9756c-bc13-49a8-9010-ef62e1e64fb5 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:52.411402 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-cdebf023-81c6-4574-be5e-0314684cfc86 req-92e9756c-bc13-49a8-9010-ef62e1e64fb5 service nova] Creating event network-changed:9beb8450-2cd0-4018-9daa-49a22c787feb for instance 4fe42fc2-8cfa-4571-9282-fa4a6fcd75c8 on n-h1-846463-3 Sep 23 04:41:52.424197 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-cdebf023-81c6-4574-be5e-0314684cfc86 req-92e9756c-bc13-49a8-9010-ef62e1e64fb5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060971 Sep 23 04:41:52.426834 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1339/2697] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:41:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:41:52.437946 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-43c1248c-e579-4d3f-a801-0341734bb969 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:52.459904 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-43c1248c-e579-4d3f-a801-0341734bb969 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:52.469490 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-43c1248c-e579-4d3f-a801-0341734bb969 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:52.487169 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-43c1248c-e579-4d3f-a801-0341734bb969 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1553 microversion: 2.91 time: 0.254009 Sep 23 04:41:52.488740 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1359/2698] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:41:52 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1553 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:41:52.871353 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3fd083ec-2377-4a9f-9a87-26dfc44eae65 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:52.872473 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3fd083ec-2377-4a9f-9a87-26dfc44eae65 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] [instance: 5ee8a1da-f229-4716-bc67-da23f07963bd] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:52.882501 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3fd083ec-2377-4a9f-9a87-26dfc44eae65 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:52.889662 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3fd083ec-2377-4a9f-9a87-26dfc44eae65 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:52.890351 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3fd083ec-2377-4a9f-9a87-26dfc44eae65 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:52.891379 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3fd083ec-2377-4a9f-9a87-26dfc44eae65 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:52.892024 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3fd083ec-2377-4a9f-9a87-26dfc44eae65 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:52.892623 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3fd083ec-2377-4a9f-9a87-26dfc44eae65 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:53.128768 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6107bb57-7999-49d8-9dc0-dfcb762eb9a1 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:53.130075 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-6107bb57-7999-49d8-9dc0-dfcb762eb9a1 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 8a6b2904-2edd-4e9e-b6fa-1d6249721f52] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:53.143837 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6107bb57-7999-49d8-9dc0-dfcb762eb9a1 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:53.148081 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6107bb57-7999-49d8-9dc0-dfcb762eb9a1 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:53.149178 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6107bb57-7999-49d8-9dc0-dfcb762eb9a1 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:53.150760 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6107bb57-7999-49d8-9dc0-dfcb762eb9a1 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:53.153143 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6107bb57-7999-49d8-9dc0-dfcb762eb9a1 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:53.153774 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6107bb57-7999-49d8-9dc0-dfcb762eb9a1 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:53.338161 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-3fd083ec-2377-4a9f-9a87-26dfc44eae65 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace08d8e105e46e299773c5a1b96039f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a16a53325a4d61aef94281435e9726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:53.349001 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3fd083ec-2377-4a9f-9a87-26dfc44eae65 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] 10.222.0.33 "GET /compute/v2.1/servers/5ee8a1da-f229-4716-bc67-da23f07963bd" status: 200 len: 1522 microversion: 2.1 time: 0.481504 Sep 23 04:41:53.363304 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1340/2699] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:52 2022] GET /compute/v2.1/servers/5ee8a1da-f229-4716-bc67-da23f07963bd => generated 1522 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:53.423076 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-6107bb57-7999-49d8-9dc0-dfcb762eb9a1 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:53.440179 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6107bb57-7999-49d8-9dc0-dfcb762eb9a1 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/8a6b2904-2edd-4e9e-b6fa-1d6249721f52" status: 200 len: 1512 microversion: 2.1 time: 0.322007 Sep 23 04:41:53.441177 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1360/2700] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:53 2022] GET /compute/v2.1/servers/8a6b2904-2edd-4e9e-b6fa-1d6249721f52 => generated 1512 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:53.520238 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1f777208-b284-4dea-8beb-2140295e3b5e tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:53.520871 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-1f777208-b284-4dea-8beb-2140295e3b5e tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:53.537482 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1f777208-b284-4dea-8beb-2140295e3b5e tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:53.545720 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1f777208-b284-4dea-8beb-2140295e3b5e tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:53.545720 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1f777208-b284-4dea-8beb-2140295e3b5e tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:53.545720 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1f777208-b284-4dea-8beb-2140295e3b5e tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:53.545720 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1f777208-b284-4dea-8beb-2140295e3b5e tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:53.545720 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1f777208-b284-4dea-8beb-2140295e3b5e tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:53.672728 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-1f777208-b284-4dea-8beb-2140295e3b5e tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:53.689210 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-1f777208-b284-4dea-8beb-2140295e3b5e tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:53.692715 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-1f777208-b284-4dea-8beb-2140295e3b5e tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:53.701261 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-1f777208-b284-4dea-8beb-2140295e3b5e tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1553 microversion: 2.91 time: 0.185086 Sep 23 04:41:53.702232 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1341/2701] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:41:53 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1553 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:41:54.377059 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-17677c0c-efda-49dc-ae3a-38f009a33ebd tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:54.378382 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-17677c0c-efda-49dc-ae3a-38f009a33ebd tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] [instance: 5ee8a1da-f229-4716-bc67-da23f07963bd] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:54.389041 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=4 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:41:54.394977 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-17677c0c-efda-49dc-ae3a-38f009a33ebd tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:54.404527 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-17677c0c-efda-49dc-ae3a-38f009a33ebd tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:54.405295 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-17677c0c-efda-49dc-ae3a-38f009a33ebd tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:54.405961 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-17677c0c-efda-49dc-ae3a-38f009a33ebd tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:54.406442 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-17677c0c-efda-49dc-ae3a-38f009a33ebd tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:54.412468 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-17677c0c-efda-49dc-ae3a-38f009a33ebd tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:54.469347 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6978c842-4c2c-4403-b544-59f976efdf66 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:54.470452 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-6978c842-4c2c-4403-b544-59f976efdf66 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 8a6b2904-2edd-4e9e-b6fa-1d6249721f52] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:54.474865 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=4 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:41:54.487903 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6978c842-4c2c-4403-b544-59f976efdf66 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:54.489475 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6978c842-4c2c-4403-b544-59f976efdf66 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:54.490912 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6978c842-4c2c-4403-b544-59f976efdf66 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:54.491818 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6978c842-4c2c-4403-b544-59f976efdf66 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:54.495318 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6978c842-4c2c-4403-b544-59f976efdf66 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:54.496094 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6978c842-4c2c-4403-b544-59f976efdf66 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:54.721714 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-17677c0c-efda-49dc-ae3a-38f009a33ebd tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace08d8e105e46e299773c5a1b96039f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a16a53325a4d61aef94281435e9726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:54.735752 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-17677c0c-efda-49dc-ae3a-38f009a33ebd tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] 10.222.0.33 "GET /compute/v2.1/servers/5ee8a1da-f229-4716-bc67-da23f07963bd" status: 200 len: 1522 microversion: 2.1 time: 0.362533 Sep 23 04:41:54.737402 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1361/2702] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:54 2022] GET /compute/v2.1/servers/5ee8a1da-f229-4716-bc67-da23f07963bd => generated 1522 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:41:54.744287 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-305f74b1-e144-4173-b235-0712cd037617 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:54.745491 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-305f74b1-e144-4173-b235-0712cd037617 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:54.753564 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-305f74b1-e144-4173-b235-0712cd037617 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:54.756745 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-305f74b1-e144-4173-b235-0712cd037617 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:54.756745 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-305f74b1-e144-4173-b235-0712cd037617 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:54.756745 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-305f74b1-e144-4173-b235-0712cd037617 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:54.756745 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-305f74b1-e144-4173-b235-0712cd037617 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:54.757329 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-305f74b1-e144-4173-b235-0712cd037617 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:54.852297 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6978c842-4c2c-4403-b544-59f976efdf66 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:54.863673 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-6978c842-4c2c-4403-b544-59f976efdf66 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/8a6b2904-2edd-4e9e-b6fa-1d6249721f52" status: 200 len: 1512 microversion: 2.1 time: 0.396694 Sep 23 04:41:54.866489 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1342/2703] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:54 2022] GET /compute/v2.1/servers/8a6b2904-2edd-4e9e-b6fa-1d6249721f52 => generated 1512 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:41:54.870717 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-305f74b1-e144-4173-b235-0712cd037617 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:54.880275 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-305f74b1-e144-4173-b235-0712cd037617 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:54.882009 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-305f74b1-e144-4173-b235-0712cd037617 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:54.888343 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-305f74b1-e144-4173-b235-0712cd037617 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1553 microversion: 2.91 time: 0.149592 Sep 23 04:41:54.889372 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1362/2704] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:41:54 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1553 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:41:55.441087 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f2f4ccad-118f-4e03-95ff-e61c2155ea6f tempest-TenantUsagesNegativeTestJSON-2112595813 tempest-TenantUsagesNegativeTestJSON-2112595813-project-admin] 10.222.0.33 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-09-22T04%3A41%3A55.309702&end=2022-09-24T04%3A41%3A55.309702" status: 404 len: 112 microversion: - time: 0.127174 Sep 23 04:41:55.441715 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1343/2705] 10.222.0.33 () {58 vars in 1316 bytes} [Fri Sep 23 04:41:55 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-09-22T04%3A41%3A55.309702&end=2022-09-24T04%3A41%3A55.309702 => generated 112 bytes in 129 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Sep 23 04:41:55.451577 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-51fbcce3-b2ed-4f14-ac5d-6e0f9e5f907c tempest-TenantUsagesNegativeTestJSON-2112595813 tempest-TenantUsagesNegativeTestJSON-2112595813-project-admin] Calling method '.version_select at 0x7ff1baadb310>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:55.455868 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-51fbcce3-b2ed-4f14-ac5d-6e0f9e5f907c tempest-TenantUsagesNegativeTestJSON-2112595813 tempest-TenantUsagesNegativeTestJSON-2112595813-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Sep 23 04:41:55.475337 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-51fbcce3-b2ed-4f14-ac5d-6e0f9e5f907c tempest-TenantUsagesNegativeTestJSON-2112595813 tempest-TenantUsagesNegativeTestJSON-2112595813-project-admin] Request method failure captured: Sep 23 04:41:55.475337 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/os-simple-tenant-usage/be7cce1a28684252928a22237e114f98?start=2022-09-24T04%3A41%3A55.309702&end=2022-09-22T04%3A41%3A55.309702 HTTP/1.1 Sep 23 04:41:55.475337 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:41:55.475337 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:41:55.475337 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:41:55.475337 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:41:55.475337 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:41:55.475337 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:41:55.475337 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:41:55.475337 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:41:55.475337 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTkTR_cv6xNAS0YHY7VNQuZ63S5EFLH90096n2cJNCsnAFjCytX2CRtfaZluSP8CWzIFF0dK7WDVDmKwQZHgaeDj6a9uaLgsqjFXwWG8FB313_Ox50OL_R7BSXVK8i6DoV6izE2rn1E3td-TqhTNR76qffpCp8CH_0iw1_sbEUNdruw Sep 23 04:41:55.475337 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:41:55.475337 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:41:55.475337 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:41:55.475337 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:41:55.475337 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:41:55.475337 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:41:55.475337 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: bec95510152e4abfa75110897df01695 Sep 23 04:41:55.475337 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-2112595813 Sep 23 04:41:55.475337 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,admin,member Sep 23 04:41:55.475337 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,admin,member Sep 23 04:41:55.475337 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bec95510152e4abfa75110897df01695", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bec95510152e4abfa75110897df01695"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bec95510152e4abfa75110897df01695"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bec95510152e4abfa75110897df01695"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:41:55.475337 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-2112595813 Sep 23 04:41:55.475337 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: bec95510152e4abfa75110897df01695 Sep 23 04:41:55.475337 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-2112595813 Sep 23 04:41:55.475337 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-TenantUsagesNegativeTestJSON-2112595813-project-admin Sep 23 04:41:55.475337 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:41:55.475337 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:41:55.475337 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 211549944aaa4623879038702671e788 Sep 23 04:41:55.475337 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-2112595813-project-admin Sep 23 04:41:55.475337 n-d-846463-3 devstack@n-api.service[122699]: method: Sep 23 04:41:55.475337 n-d-846463-3 devstack@n-api.service[122699]: exception: Invalid start time. The start time cannot occur after the end time. Sep 23 04:41:55.475337 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': 'be7cce1a28684252928a22237e114f98'} Sep 23 04:41:55.475337 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:41:55.475337 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:41:55.475337 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:41:55.475337 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:41:55.475337 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:41:55.475337 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:41:55.475337 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:41:55.475337 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:41:55.475337 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 23 04:41:55.475337 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:41:55.475337 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:41:55.475337 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:41:55.475337 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Sep 23 04:41:55.475337 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self._show(req, id) Sep 23 04:41:55.475337 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Sep 23 04:41:55.475337 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Sep 23 04:41:55.475337 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Sep 23 04:41:55.475337 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Sep 23 04:41:55.475337 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Sep 23 04:41:55.475337 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:41:55.475337 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:41:55.475337 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:41:55.475337 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:41:55.475337 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:41:55.475337 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:41:55.475337 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:41:55.475337 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:41:55.475337 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Sep 23 04:41:55.475337 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:41:55.482786 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-51fbcce3-b2ed-4f14-ac5d-6e0f9e5f907c tempest-TenantUsagesNegativeTestJSON-2112595813 tempest-TenantUsagesNegativeTestJSON-2112595813-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:41:55.482786 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-51fbcce3-b2ed-4f14-ac5d-6e0f9e5f907c tempest-TenantUsagesNegativeTestJSON-2112595813 tempest-TenantUsagesNegativeTestJSON-2112595813-project-admin] 10.222.0.33 "GET /compute/v2.1/os-simple-tenant-usage/be7cce1a28684252928a22237e114f98?start=2022-09-24T04%3A41%3A55.309702&end=2022-09-22T04%3A41%3A55.309702" status: 400 len: 111 microversion: 2.1 time: 0.029006 Sep 23 04:41:55.482786 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1363/2706] 10.222.0.33 () {58 vars in 1412 bytes} [Fri Sep 23 04:41:55 2022] GET /compute/v2.1/os-simple-tenant-usage/be7cce1a28684252928a22237e114f98?start=2022-09-24T04%3A41%3A55.309702&end=2022-09-22T04%3A41%3A55.309702 => generated 111 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 04:41:55.612952 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-072c6b49-0c2e-4e87-abb5-580aa06c91a9 tempest-TenantUsagesNegativeTestJSON-429162741 tempest-TenantUsagesNegativeTestJSON-429162741-project] Calling method '.version_select at 0x7ff1bbbfb430>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:55.616991 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-072c6b49-0c2e-4e87-abb5-580aa06c91a9 tempest-TenantUsagesNegativeTestJSON-429162741 tempest-TenantUsagesNegativeTestJSON-429162741-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': 'b02813f7d78248dcaac93550beaae17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be7cce1a28684252928a22237e114f98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:55.619670 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-072c6b49-0c2e-4e87-abb5-580aa06c91a9 tempest-TenantUsagesNegativeTestJSON-429162741 tempest-TenantUsagesNegativeTestJSON-429162741-project] Request method failure captured: Sep 23 04:41:55.619670 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-22T04%3A41%3A55.309702&end=2022-09-24T04%3A41%3A55.309702&detailed=1 HTTP/1.1 Sep 23 04:41:55.619670 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:41:55.619670 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:41:55.619670 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:41:55.619670 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:41:55.619670 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:41:55.619670 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:41:55.619670 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:41:55.619670 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:41:55.619670 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTkSOfynDBZ-4uRuXxfjPuMmiz-hlxP_ifwLc59EzKrKPiho7ViJq_ZCWL9kuKF7HniL6yfOz-kfiAZXqZNdOqrMv5uUD8t8YAw_tgucM5YU7jX8ox7N3IBfM7UC-Hiud3k9Q0AnP6Lq1HyO6bqsiabyyLk32SbLiVOFDmbFLXagw-Y Sep 23 04:41:55.619670 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:41:55.619670 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:41:55.619670 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:41:55.619670 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:41:55.619670 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:41:55.619670 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:41:55.619670 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: be7cce1a28684252928a22237e114f98 Sep 23 04:41:55.619670 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-429162741 Sep 23 04:41:55.619670 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:41:55.619670 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:41:55.619670 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_be7cce1a28684252928a22237e114f98", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/be7cce1a28684252928a22237e114f98"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/be7cce1a28684252928a22237e114f98"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/be7cce1a28684252928a22237e114f98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:41:55.619670 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-429162741 Sep 23 04:41:55.619670 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: be7cce1a28684252928a22237e114f98 Sep 23 04:41:55.619670 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-429162741 Sep 23 04:41:55.619670 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-TenantUsagesNegativeTestJSON-429162741-project Sep 23 04:41:55.619670 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:41:55.619670 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:41:55.619670 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: b02813f7d78248dcaac93550beaae17e Sep 23 04:41:55.619670 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-429162741-project Sep 23 04:41:55.619670 n-d-846463-3 devstack@n-api.service[122698]: method: Sep 23 04:41:55.619670 n-d-846463-3 devstack@n-api.service[122698]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Sep 23 04:41:55.619670 n-d-846463-3 devstack@n-api.service[122698]: action_args: {} Sep 23 04:41:55.619670 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:41:55.619670 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:41:55.619670 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:41:55.619670 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:41:55.619670 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:41:55.619670 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:41:55.619670 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:41:55.619670 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:41:55.619670 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 23 04:41:55.619670 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:41:55.619670 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:41:55.619670 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:41:55.619670 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Sep 23 04:41:55.619670 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self._index(req) Sep 23 04:41:55.619670 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Sep 23 04:41:55.619670 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Sep 23 04:41:55.619670 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 23 04:41:55.619670 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 23 04:41:55.619670 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 23 04:41:55.619670 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 23 04:41:55.619670 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 23 04:41:55.619670 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 23 04:41:55.619670 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 23 04:41:55.619670 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise self.value Sep 23 04:41:55.619670 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 23 04:41:55.619670 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 23 04:41:55.619670 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 23 04:41:55.619670 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 23 04:41:55.619670 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 23 04:41:55.619670 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 23 04:41:55.626330 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Sep 23 04:41:55.626330 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:41:55.626330 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:41:55.626330 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:41:55.626330 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:41:55.626330 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:41:55.626330 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:41:55.626330 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 23 04:41:55.626330 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 23 04:41:55.626330 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Sep 23 04:41:55.626330 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:41:55.626330 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-072c6b49-0c2e-4e87-abb5-580aa06c91a9 tempest-TenantUsagesNegativeTestJSON-429162741 tempest-TenantUsagesNegativeTestJSON-429162741-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:41:55.626330 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-072c6b49-0c2e-4e87-abb5-580aa06c91a9 tempest-TenantUsagesNegativeTestJSON-429162741 tempest-TenantUsagesNegativeTestJSON-429162741-project] 10.222.0.33 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-22T04%3A41%3A55.309702&end=2022-09-24T04%3A41%3A55.309702&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.135953 Sep 23 04:41:55.626330 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1344/2707] 10.222.0.33 () {58 vars in 1335 bytes} [Fri Sep 23 04:41:55 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-22T04%3A41%3A55.309702&end=2022-09-24T04%3A41%3A55.309702&detailed=1 => generated 123 bytes in 138 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:41:55.765534 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-81521e16-ee6c-4624-831b-bbba8fcbfd4f tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:55.766217 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-81521e16-ee6c-4624-831b-bbba8fcbfd4f tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] [instance: 5ee8a1da-f229-4716-bc67-da23f07963bd] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:55.773653 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-81521e16-ee6c-4624-831b-bbba8fcbfd4f tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:55.785071 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-81521e16-ee6c-4624-831b-bbba8fcbfd4f tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:55.785071 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-81521e16-ee6c-4624-831b-bbba8fcbfd4f tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:55.785071 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-81521e16-ee6c-4624-831b-bbba8fcbfd4f tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:55.785071 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-81521e16-ee6c-4624-831b-bbba8fcbfd4f tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:55.785071 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-81521e16-ee6c-4624-831b-bbba8fcbfd4f tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:55.900244 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-775b9249-a19e-4524-b176-e559976ad54c tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:55.900867 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-775b9249-a19e-4524-b176-e559976ad54c tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 8a6b2904-2edd-4e9e-b6fa-1d6249721f52] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:55.913591 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-775b9249-a19e-4524-b176-e559976ad54c tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:55.914171 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-775b9249-a19e-4524-b176-e559976ad54c tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:55.914625 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-775b9249-a19e-4524-b176-e559976ad54c tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:55.920400 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-775b9249-a19e-4524-b176-e559976ad54c tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:55.922954 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-775b9249-a19e-4524-b176-e559976ad54c tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:55.924187 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-775b9249-a19e-4524-b176-e559976ad54c tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:55.952639 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-81521e16-ee6c-4624-831b-bbba8fcbfd4f tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace08d8e105e46e299773c5a1b96039f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a16a53325a4d61aef94281435e9726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:55.966533 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-81521e16-ee6c-4624-831b-bbba8fcbfd4f tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] 10.222.0.33 "GET /compute/v2.1/servers/5ee8a1da-f229-4716-bc67-da23f07963bd" status: 200 len: 1522 microversion: 2.1 time: 0.205560 Sep 23 04:41:55.967709 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1364/2708] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:55 2022] GET /compute/v2.1/servers/5ee8a1da-f229-4716-bc67-da23f07963bd => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:55.982967 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c631350a-d76f-4419-b48a-6b9e1b0849f9 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:55.984002 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c631350a-d76f-4419-b48a-6b9e1b0849f9 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:55.998162 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c631350a-d76f-4419-b48a-6b9e1b0849f9 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:55.998983 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c631350a-d76f-4419-b48a-6b9e1b0849f9 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:55.999660 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c631350a-d76f-4419-b48a-6b9e1b0849f9 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:56.000581 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c631350a-d76f-4419-b48a-6b9e1b0849f9 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:56.001223 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c631350a-d76f-4419-b48a-6b9e1b0849f9 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:56.001866 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c631350a-d76f-4419-b48a-6b9e1b0849f9 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:56.088362 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c631350a-d76f-4419-b48a-6b9e1b0849f9 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:56.105975 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c631350a-d76f-4419-b48a-6b9e1b0849f9 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:56.108338 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c631350a-d76f-4419-b48a-6b9e1b0849f9 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:56.121325 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c631350a-d76f-4419-b48a-6b9e1b0849f9 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1553 microversion: 2.91 time: 0.152308 Sep 23 04:41:56.138584 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1365/2709] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:41:55 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1553 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:41:56.157119 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-775b9249-a19e-4524-b176-e559976ad54c tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:56.168907 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-775b9249-a19e-4524-b176-e559976ad54c tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/8a6b2904-2edd-4e9e-b6fa-1d6249721f52" status: 200 len: 1512 microversion: 2.1 time: 0.275430 Sep 23 04:41:56.169150 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1345/2710] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:55 2022] GET /compute/v2.1/servers/8a6b2904-2edd-4e9e-b6fa-1d6249721f52 => generated 1512 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:56.991762 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4f2c977d-49bd-4b79-bdae-257cccc311ba tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:56.992347 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4f2c977d-49bd-4b79-bdae-257cccc311ba tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] [instance: 5ee8a1da-f229-4716-bc67-da23f07963bd] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:57.019959 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4f2c977d-49bd-4b79-bdae-257cccc311ba tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:57.020629 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4f2c977d-49bd-4b79-bdae-257cccc311ba tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:57.021073 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4f2c977d-49bd-4b79-bdae-257cccc311ba tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:57.022190 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4f2c977d-49bd-4b79-bdae-257cccc311ba tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:57.022833 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4f2c977d-49bd-4b79-bdae-257cccc311ba tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:57.023272 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4f2c977d-49bd-4b79-bdae-257cccc311ba tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:57.155165 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-96e0f2eb-0cf4-4ad8-bac3-c87cc557af2b tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:57.156456 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-96e0f2eb-0cf4-4ad8-bac3-c87cc557af2b tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:57.164648 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-96e0f2eb-0cf4-4ad8-bac3-c87cc557af2b tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:57.166480 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-96e0f2eb-0cf4-4ad8-bac3-c87cc557af2b tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:57.167447 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-96e0f2eb-0cf4-4ad8-bac3-c87cc557af2b tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:57.168361 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-96e0f2eb-0cf4-4ad8-bac3-c87cc557af2b tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:57.169034 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-96e0f2eb-0cf4-4ad8-bac3-c87cc557af2b tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:57.169685 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-96e0f2eb-0cf4-4ad8-bac3-c87cc557af2b tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:57.313660 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-96e0f2eb-0cf4-4ad8-bac3-c87cc557af2b tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:57.316032 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=100 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:41:57.327839 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-4f2c977d-49bd-4b79-bdae-257cccc311ba tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace08d8e105e46e299773c5a1b96039f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a16a53325a4d61aef94281435e9726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:57.344467 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4f2c977d-49bd-4b79-bdae-257cccc311ba tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] 10.222.0.33 "GET /compute/v2.1/servers/5ee8a1da-f229-4716-bc67-da23f07963bd" status: 200 len: 1522 microversion: 2.1 time: 0.357061 Sep 23 04:41:57.345727 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-96e0f2eb-0cf4-4ad8-bac3-c87cc557af2b tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:57.360503 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1366/2711] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:56 2022] GET /compute/v2.1/servers/5ee8a1da-f229-4716-bc67-da23f07963bd => generated 1522 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:57.374328 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-96e0f2eb-0cf4-4ad8-bac3-c87cc557af2b tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:57.386211 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-cf275e34-854a-475e-90f3-d5aefb2b5ddb tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:57.387409 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-cf275e34-854a-475e-90f3-d5aefb2b5ddb tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 8a6b2904-2edd-4e9e-b6fa-1d6249721f52] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:57.393120 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-96e0f2eb-0cf4-4ad8-bac3-c87cc557af2b tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1553 microversion: 2.91 time: 0.244803 Sep 23 04:41:57.394420 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cf275e34-854a-475e-90f3-d5aefb2b5ddb tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:57.395064 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cf275e34-854a-475e-90f3-d5aefb2b5ddb tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:57.395747 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cf275e34-854a-475e-90f3-d5aefb2b5ddb tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:57.398292 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cf275e34-854a-475e-90f3-d5aefb2b5ddb tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:57.398696 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1346/2712] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:41:57 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1553 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:41:57.399329 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cf275e34-854a-475e-90f3-d5aefb2b5ddb tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:57.399977 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cf275e34-854a-475e-90f3-d5aefb2b5ddb tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:57.658388 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-cf275e34-854a-475e-90f3-d5aefb2b5ddb tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:57.668031 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-cf275e34-854a-475e-90f3-d5aefb2b5ddb tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/8a6b2904-2edd-4e9e-b6fa-1d6249721f52" status: 200 len: 1512 microversion: 2.1 time: 0.306214 Sep 23 04:41:57.668627 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1367/2713] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:57 2022] GET /compute/v2.1/servers/8a6b2904-2edd-4e9e-b6fa-1d6249721f52 => generated 1512 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:58.377193 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-fbe39ba4-73e2-468a-936c-6460cfe69bd9 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:58.378739 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-fbe39ba4-73e2-468a-936c-6460cfe69bd9 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] [instance: 5ee8a1da-f229-4716-bc67-da23f07963bd] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:58.389389 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fbe39ba4-73e2-468a-936c-6460cfe69bd9 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:58.389931 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fbe39ba4-73e2-468a-936c-6460cfe69bd9 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:58.390437 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fbe39ba4-73e2-468a-936c-6460cfe69bd9 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:58.391387 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fbe39ba4-73e2-468a-936c-6460cfe69bd9 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:58.391988 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fbe39ba4-73e2-468a-936c-6460cfe69bd9 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:58.392485 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fbe39ba4-73e2-468a-936c-6460cfe69bd9 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:58.436097 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2c447f81-1eed-4e65-8d8b-ae429cab7f41 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:58.437242 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-2c447f81-1eed-4e65-8d8b-ae429cab7f41 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:58.452749 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2c447f81-1eed-4e65-8d8b-ae429cab7f41 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:58.458030 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2c447f81-1eed-4e65-8d8b-ae429cab7f41 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:58.460460 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2c447f81-1eed-4e65-8d8b-ae429cab7f41 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:58.464270 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2c447f81-1eed-4e65-8d8b-ae429cab7f41 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:58.465435 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2c447f81-1eed-4e65-8d8b-ae429cab7f41 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:58.468126 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2c447f81-1eed-4e65-8d8b-ae429cab7f41 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:58.576065 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2c447f81-1eed-4e65-8d8b-ae429cab7f41 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:58.587685 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2c447f81-1eed-4e65-8d8b-ae429cab7f41 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:58.593562 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2c447f81-1eed-4e65-8d8b-ae429cab7f41 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:58.604968 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2c447f81-1eed-4e65-8d8b-ae429cab7f41 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1553 microversion: 2.91 time: 0.175192 Sep 23 04:41:58.626166 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1368/2714] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:41:58 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1553 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:41:58.692734 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-232823b4-42b9-4eaa-87d0-46fd07017994 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:58.693747 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-232823b4-42b9-4eaa-87d0-46fd07017994 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 8a6b2904-2edd-4e9e-b6fa-1d6249721f52] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:58.701646 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-232823b4-42b9-4eaa-87d0-46fd07017994 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:58.702554 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-232823b4-42b9-4eaa-87d0-46fd07017994 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:58.703381 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-232823b4-42b9-4eaa-87d0-46fd07017994 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:58.704577 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-232823b4-42b9-4eaa-87d0-46fd07017994 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:58.705261 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-232823b4-42b9-4eaa-87d0-46fd07017994 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:58.706143 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-232823b4-42b9-4eaa-87d0-46fd07017994 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:58.863875 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-fbe39ba4-73e2-468a-936c-6460cfe69bd9 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace08d8e105e46e299773c5a1b96039f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a16a53325a4d61aef94281435e9726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:58.876098 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-fbe39ba4-73e2-468a-936c-6460cfe69bd9 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] 10.222.0.33 "GET /compute/v2.1/servers/5ee8a1da-f229-4716-bc67-da23f07963bd" status: 200 len: 1502 microversion: 2.1 time: 0.505922 Sep 23 04:41:58.889271 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1347/2715] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:58 2022] GET /compute/v2.1/servers/5ee8a1da-f229-4716-bc67-da23f07963bd => generated 1502 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:58.908366 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d9bb4ea4-419d-4bce-b05e-8a7dcd4640e2 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Action: 'create', calling method: .version_select at 0x7ff1bb96a940>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-287420159", "description": "tempest-description-486384067"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:41:58.928062 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-232823b4-42b9-4eaa-87d0-46fd07017994 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:58.938838 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-232823b4-42b9-4eaa-87d0-46fd07017994 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/8a6b2904-2edd-4e9e-b6fa-1d6249721f52" status: 200 len: 1512 microversion: 2.1 time: 0.249856 Sep 23 04:41:58.939735 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1369/2716] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:58 2022] GET /compute/v2.1/servers/8a6b2904-2edd-4e9e-b6fa-1d6249721f52 => generated 1512 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:41:59.637153 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6e2b2fef-735b-4c16-bfc0-8ce8f9a13339 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:59.637826 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-6e2b2fef-735b-4c16-bfc0-8ce8f9a13339 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:59.645018 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6e2b2fef-735b-4c16-bfc0-8ce8f9a13339 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:59.645455 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6e2b2fef-735b-4c16-bfc0-8ce8f9a13339 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:59.645928 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6e2b2fef-735b-4c16-bfc0-8ce8f9a13339 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:59.646628 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6e2b2fef-735b-4c16-bfc0-8ce8f9a13339 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:59.647088 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6e2b2fef-735b-4c16-bfc0-8ce8f9a13339 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:59.647570 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6e2b2fef-735b-4c16-bfc0-8ce8f9a13339 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:59.727444 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-6e2b2fef-735b-4c16-bfc0-8ce8f9a13339 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:59.735476 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-6e2b2fef-735b-4c16-bfc0-8ce8f9a13339 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:59.736925 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-6e2b2fef-735b-4c16-bfc0-8ce8f9a13339 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:41:59.741743 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6e2b2fef-735b-4c16-bfc0-8ce8f9a13339 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1553 microversion: 2.91 time: 0.109059 Sep 23 04:41:59.742362 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1370/2717] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:41:59 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1553 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:41:59.818794 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d9bb4ea4-419d-4bce-b05e-8a7dcd4640e2 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 249 microversion: 2.1 time: 0.919249 Sep 23 04:41:59.820705 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1348/2718] 10.222.0.33 () {60 vars in 1180 bytes} [Fri Sep 23 04:41:58 2022] POST /compute/v2.1/os-security-groups => generated 249 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:41:59.838106 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-18985908-0d3a-4411-9b8e-8953e673f9d9 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-287420159"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:41:59.839114 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-18985908-0d3a-4411-9b8e-8953e673f9d9 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] [instance: 5ee8a1da-f229-4716-bc67-da23f07963bd] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:59.847162 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-18985908-0d3a-4411-9b8e-8953e673f9d9 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:59.847798 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-18985908-0d3a-4411-9b8e-8953e673f9d9 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:59.850675 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-18985908-0d3a-4411-9b8e-8953e673f9d9 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:59.850675 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-18985908-0d3a-4411-9b8e-8953e673f9d9 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:59.850675 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-18985908-0d3a-4411-9b8e-8953e673f9d9 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:59.850675 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-18985908-0d3a-4411-9b8e-8953e673f9d9 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:59.963175 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-61223a9d-169e-4c7a-a5f6-5713b16176fe tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:41:59.963805 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-61223a9d-169e-4c7a-a5f6-5713b16176fe tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 8a6b2904-2edd-4e9e-b6fa-1d6249721f52] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:41:59.975176 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-61223a9d-169e-4c7a-a5f6-5713b16176fe tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:59.975901 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-61223a9d-169e-4c7a-a5f6-5713b16176fe tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:59.976867 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-61223a9d-169e-4c7a-a5f6-5713b16176fe tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:41:59.978064 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-61223a9d-169e-4c7a-a5f6-5713b16176fe tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:41:59.978705 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-61223a9d-169e-4c7a-a5f6-5713b16176fe tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:41:59.979462 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-61223a9d-169e-4c7a-a5f6-5713b16176fe tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:00.065937 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.network.security_group_api [None req-18985908-0d3a-4411-9b8e-8953e673f9d9 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Adding security group b2d449b5-0138-4cd5-8328-91fc1b80c0c5 to port f9285902-d382-442c-88b6-fad3f3a0ebcc Sep 23 04:42:00.327625 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-61223a9d-169e-4c7a-a5f6-5713b16176fe tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:00.338933 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-61223a9d-169e-4c7a-a5f6-5713b16176fe tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/8a6b2904-2edd-4e9e-b6fa-1d6249721f52" status: 200 len: 1512 microversion: 2.1 time: 0.377515 Sep 23 04:42:00.342594 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1349/2719] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:41:59 2022] GET /compute/v2.1/servers/8a6b2904-2edd-4e9e-b6fa-1d6249721f52 => generated 1512 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:42:00.771461 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7f78f783-8be2-4f1c-8673-08b16a146ef9 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:00.772463 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7f78f783-8be2-4f1c-8673-08b16a146ef9 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:00.785331 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7f78f783-8be2-4f1c-8673-08b16a146ef9 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:00.786772 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7f78f783-8be2-4f1c-8673-08b16a146ef9 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:00.787499 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7f78f783-8be2-4f1c-8673-08b16a146ef9 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:00.789456 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7f78f783-8be2-4f1c-8673-08b16a146ef9 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:00.791204 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7f78f783-8be2-4f1c-8673-08b16a146ef9 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:00.791907 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7f78f783-8be2-4f1c-8673-08b16a146ef9 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:00.891743 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-7f78f783-8be2-4f1c-8673-08b16a146ef9 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:00.917184 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-7f78f783-8be2-4f1c-8673-08b16a146ef9 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:00.921094 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-7f78f783-8be2-4f1c-8673-08b16a146ef9 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:00.936407 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7f78f783-8be2-4f1c-8673-08b16a146ef9 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1553 microversion: 2.91 time: 0.169839 Sep 23 04:42:00.937545 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1350/2720] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:42:00 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1553 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:42:01.087296 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-18985908-0d3a-4411-9b8e-8953e673f9d9 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] 10.222.0.33 "POST /compute/v2.1/servers/5ee8a1da-f229-4716-bc67-da23f07963bd/action" status: 202 len: 0 microversion: 2.1 time: 1.256328 Sep 23 04:42:01.089140 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1371/2721] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:41:59 2022] POST /compute/v2.1/servers/5ee8a1da-f229-4716-bc67-da23f07963bd/action => generated 0 bytes in 1260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 23 04:42:01.098784 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8c3f2d1e-d388-4ff5-b8a3-acd2eeafcd62 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-287420159"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:42:01.099402 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8c3f2d1e-d388-4ff5-b8a3-acd2eeafcd62 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] [instance: 5ee8a1da-f229-4716-bc67-da23f07963bd] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:01.112764 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8c3f2d1e-d388-4ff5-b8a3-acd2eeafcd62 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:01.113482 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8c3f2d1e-d388-4ff5-b8a3-acd2eeafcd62 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:01.114227 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8c3f2d1e-d388-4ff5-b8a3-acd2eeafcd62 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:01.116646 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8c3f2d1e-d388-4ff5-b8a3-acd2eeafcd62 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:01.117286 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8c3f2d1e-d388-4ff5-b8a3-acd2eeafcd62 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:01.119098 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8c3f2d1e-d388-4ff5-b8a3-acd2eeafcd62 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:01.172823 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-89bb4ab6-4918-4dc3-8fd8-3c5094cea644 req-086be70c-73f0-4983-afad-518bcf3acbd9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ee8a1da-f229-4716-bc67-da23f07963bd", "tag": "f9285902-d382-442c-88b6-fad3f3a0ebcc"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:42:01.189074 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-89bb4ab6-4918-4dc3-8fd8-3c5094cea644 req-086be70c-73f0-4983-afad-518bcf3acbd9 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:01.194172 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-89bb4ab6-4918-4dc3-8fd8-3c5094cea644 req-086be70c-73f0-4983-afad-518bcf3acbd9 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:01.198830 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-89bb4ab6-4918-4dc3-8fd8-3c5094cea644 req-086be70c-73f0-4983-afad-518bcf3acbd9 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:01.220452 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-89bb4ab6-4918-4dc3-8fd8-3c5094cea644 req-086be70c-73f0-4983-afad-518bcf3acbd9 service nova] Creating event network-changed:f9285902-d382-442c-88b6-fad3f3a0ebcc for instance 5ee8a1da-f229-4716-bc67-da23f07963bd on n-h1-846463-3 Sep 23 04:42:01.237909 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-89bb4ab6-4918-4dc3-8fd8-3c5094cea644 req-086be70c-73f0-4983-afad-518bcf3acbd9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069358 Sep 23 04:42:01.240693 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1372/2722] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:42:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:42:01.363809 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-809f931a-c608-4c46-a3ae-e9db819880ab tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:01.364902 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-809f931a-c608-4c46-a3ae-e9db819880ab tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 8a6b2904-2edd-4e9e-b6fa-1d6249721f52] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:01.380720 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-809f931a-c608-4c46-a3ae-e9db819880ab tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:01.381669 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-809f931a-c608-4c46-a3ae-e9db819880ab tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:01.382501 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-809f931a-c608-4c46-a3ae-e9db819880ab tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:01.383526 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-809f931a-c608-4c46-a3ae-e9db819880ab tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:01.384218 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-809f931a-c608-4c46-a3ae-e9db819880ab tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:01.384868 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-809f931a-c608-4c46-a3ae-e9db819880ab tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:01.766529 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.network.security_group_api [None req-8c3f2d1e-d388-4ff5-b8a3-acd2eeafcd62 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Removing security group b2d449b5-0138-4cd5-8328-91fc1b80c0c5 from port f9285902-d382-442c-88b6-fad3f3a0ebcc Sep 23 04:42:01.990764 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-809f931a-c608-4c46-a3ae-e9db819880ab tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:02.007091 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-809f931a-c608-4c46-a3ae-e9db819880ab tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/8a6b2904-2edd-4e9e-b6fa-1d6249721f52" status: 200 len: 1512 microversion: 2.1 time: 0.646222 Sep 23 04:42:02.007999 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1373/2723] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:42:01 2022] GET /compute/v2.1/servers/8a6b2904-2edd-4e9e-b6fa-1d6249721f52 => generated 1512 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:42:02.016486 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-877fe144-7e8c-473d-828b-a74da0ae30fa tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:02.025851 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-877fe144-7e8c-473d-828b-a74da0ae30fa tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:02.034748 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-877fe144-7e8c-473d-828b-a74da0ae30fa tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:02.037596 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-877fe144-7e8c-473d-828b-a74da0ae30fa tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:02.037596 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-877fe144-7e8c-473d-828b-a74da0ae30fa tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:02.037596 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-877fe144-7e8c-473d-828b-a74da0ae30fa tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:02.038843 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-877fe144-7e8c-473d-828b-a74da0ae30fa tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:02.039459 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-877fe144-7e8c-473d-828b-a74da0ae30fa tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:02.186446 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-877fe144-7e8c-473d-828b-a74da0ae30fa tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:02.198105 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-877fe144-7e8c-473d-828b-a74da0ae30fa tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:02.202010 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-877fe144-7e8c-473d-828b-a74da0ae30fa tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:02.208093 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-877fe144-7e8c-473d-828b-a74da0ae30fa tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1553 microversion: 2.91 time: 0.198370 Sep 23 04:42:02.229707 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1374/2724] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:42:02 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1553 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:42:02.625349 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8c3f2d1e-d388-4ff5-b8a3-acd2eeafcd62 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] 10.222.0.33 "POST /compute/v2.1/servers/5ee8a1da-f229-4716-bc67-da23f07963bd/action" status: 202 len: 0 microversion: 2.1 time: 1.531387 Sep 23 04:42:02.631571 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1351/2725] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:42:01 2022] POST /compute/v2.1/servers/5ee8a1da-f229-4716-bc67-da23f07963bd/action => generated 0 bytes in 1538 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:42:02.636994 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8083be3f-a274-4957-843a-51fe4190bcb6 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Action: 'create', calling method: .version_select at 0x7ff1ba9ffee0>, body: {"pool": null} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:42:03.035425 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4b65ed96-71df-4e6a-9ed4-6cfe0cb2f1fb tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:03.037357 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4b65ed96-71df-4e6a-9ed4-6cfe0cb2f1fb tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 8a6b2904-2edd-4e9e-b6fa-1d6249721f52] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:03.073239 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4b65ed96-71df-4e6a-9ed4-6cfe0cb2f1fb tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:03.074657 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4b65ed96-71df-4e6a-9ed4-6cfe0cb2f1fb tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:03.078689 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4b65ed96-71df-4e6a-9ed4-6cfe0cb2f1fb tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:03.079700 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4b65ed96-71df-4e6a-9ed4-6cfe0cb2f1fb tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:03.083558 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4b65ed96-71df-4e6a-9ed4-6cfe0cb2f1fb tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:03.084128 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4b65ed96-71df-4e6a-9ed4-6cfe0cb2f1fb tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:03.394993 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4b65ed96-71df-4e6a-9ed4-6cfe0cb2f1fb tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:03.408764 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4b65ed96-71df-4e6a-9ed4-6cfe0cb2f1fb tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/8a6b2904-2edd-4e9e-b6fa-1d6249721f52" status: 200 len: 1512 microversion: 2.1 time: 0.377020 Sep 23 04:42:03.418805 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1352/2726] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:42:03 2022] GET /compute/v2.1/servers/8a6b2904-2edd-4e9e-b6fa-1d6249721f52 => generated 1512 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:42:03.435185 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-50f0ce43-117e-4353-a041-9f6a68acb2bc tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:03.436801 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-50f0ce43-117e-4353-a041-9f6a68acb2bc tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:03.445866 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-50f0ce43-117e-4353-a041-9f6a68acb2bc tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:03.446709 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-50f0ce43-117e-4353-a041-9f6a68acb2bc tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:03.447379 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-50f0ce43-117e-4353-a041-9f6a68acb2bc tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:03.448299 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-50f0ce43-117e-4353-a041-9f6a68acb2bc tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:03.448922 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-50f0ce43-117e-4353-a041-9f6a68acb2bc tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:03.449619 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-50f0ce43-117e-4353-a041-9f6a68acb2bc tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:03.580533 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-50f0ce43-117e-4353-a041-9f6a68acb2bc tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:03.596396 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-50f0ce43-117e-4353-a041-9f6a68acb2bc tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:03.598423 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-50f0ce43-117e-4353-a041-9f6a68acb2bc tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:03.610997 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-50f0ce43-117e-4353-a041-9f6a68acb2bc tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1553 microversion: 2.91 time: 0.183747 Sep 23 04:42:03.611601 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1353/2727] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:42:03 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1553 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:42:03.622288 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-e9dfdb86-212b-40a3-ad5e-08a1bccbe852 req-ea034fb1-f821-4b55-b686-1ba4967e7887 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ee8a1da-f229-4716-bc67-da23f07963bd", "tag": "f9285902-d382-442c-88b6-fad3f3a0ebcc"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:42:03.644085 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-e9dfdb86-212b-40a3-ad5e-08a1bccbe852 req-ea034fb1-f821-4b55-b686-1ba4967e7887 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:03.651565 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-e9dfdb86-212b-40a3-ad5e-08a1bccbe852 req-ea034fb1-f821-4b55-b686-1ba4967e7887 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:03.652248 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-e9dfdb86-212b-40a3-ad5e-08a1bccbe852 req-ea034fb1-f821-4b55-b686-1ba4967e7887 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:03.674438 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-e9dfdb86-212b-40a3-ad5e-08a1bccbe852 req-ea034fb1-f821-4b55-b686-1ba4967e7887 service nova] Creating event network-changed:f9285902-d382-442c-88b6-fad3f3a0ebcc for instance 5ee8a1da-f229-4716-bc67-da23f07963bd on n-h1-846463-3 Sep 23 04:42:03.682565 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-e9dfdb86-212b-40a3-ad5e-08a1bccbe852 req-ea034fb1-f821-4b55-b686-1ba4967e7887 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064325 Sep 23 04:42:03.684247 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1354/2728] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:42:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:42:04.490417 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2629ea6a-a0c6-4be8-9843-2ae4350ac015 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:04.491416 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-2629ea6a-a0c6-4be8-9843-2ae4350ac015 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 8a6b2904-2edd-4e9e-b6fa-1d6249721f52] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:04.511147 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2629ea6a-a0c6-4be8-9843-2ae4350ac015 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:04.511928 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2629ea6a-a0c6-4be8-9843-2ae4350ac015 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:04.512574 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2629ea6a-a0c6-4be8-9843-2ae4350ac015 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:04.520159 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2629ea6a-a0c6-4be8-9843-2ae4350ac015 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:04.520673 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2629ea6a-a0c6-4be8-9843-2ae4350ac015 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:04.521732 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2629ea6a-a0c6-4be8-9843-2ae4350ac015 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:05.122932 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-2629ea6a-a0c6-4be8-9843-2ae4350ac015 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:05.146709 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2629ea6a-a0c6-4be8-9843-2ae4350ac015 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/8a6b2904-2edd-4e9e-b6fa-1d6249721f52" status: 200 len: 1512 microversion: 2.1 time: 0.667375 Sep 23 04:42:05.147332 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1355/2729] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:42:04 2022] GET /compute/v2.1/servers/8a6b2904-2edd-4e9e-b6fa-1d6249721f52 => generated 1512 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:42:05.155430 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-727b311f-25c9-42f3-8907-b11116440d42 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:05.160989 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-727b311f-25c9-42f3-8907-b11116440d42 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:05.174527 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-727b311f-25c9-42f3-8907-b11116440d42 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:05.175358 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-727b311f-25c9-42f3-8907-b11116440d42 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:05.176012 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-727b311f-25c9-42f3-8907-b11116440d42 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:05.177116 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-727b311f-25c9-42f3-8907-b11116440d42 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:05.178088 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-727b311f-25c9-42f3-8907-b11116440d42 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:05.184150 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-727b311f-25c9-42f3-8907-b11116440d42 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:05.367784 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-727b311f-25c9-42f3-8907-b11116440d42 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:05.377755 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-727b311f-25c9-42f3-8907-b11116440d42 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:05.382970 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-727b311f-25c9-42f3-8907-b11116440d42 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:05.392497 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-727b311f-25c9-42f3-8907-b11116440d42 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1553 microversion: 2.91 time: 0.243876 Sep 23 04:42:05.408773 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1356/2730] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:42:05 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1553 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:42:05.962522 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-8083be3f-a274-4957-843a-51fe4190bcb6 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] 10.222.0.33 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.327613 Sep 23 04:42:05.962522 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1375/2731] 10.222.0.33 () {60 vars in 1170 bytes} [Fri Sep 23 04:42:02 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:42:05.973819 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d3f05056-ad5f-47e3-9954-34dd9225e229 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Action: 'action', calling method: .version_select at 0x7ff1c18e1790>, body: {"addFloatingIp": {"address": "172.25.3.28"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:42:05.976356 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d3f05056-ad5f-47e3-9954-34dd9225e229 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] [instance: 5ee8a1da-f229-4716-bc67-da23f07963bd] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:05.988998 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d3f05056-ad5f-47e3-9954-34dd9225e229 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:05.990443 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d3f05056-ad5f-47e3-9954-34dd9225e229 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:05.990891 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d3f05056-ad5f-47e3-9954-34dd9225e229 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:05.991617 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d3f05056-ad5f-47e3-9954-34dd9225e229 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:06.001565 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d3f05056-ad5f-47e3-9954-34dd9225e229 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:06.007837 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d3f05056-ad5f-47e3-9954-34dd9225e229 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:06.069391 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d3f05056-ad5f-47e3-9954-34dd9225e229 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Acquiring lock "refresh_cache-5ee8a1da-f229-4716-bc67-da23f07963bd" {{(pid=122698) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 23 04:42:06.072370 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d3f05056-ad5f-47e3-9954-34dd9225e229 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Acquired lock "refresh_cache-5ee8a1da-f229-4716-bc67-da23f07963bd" {{(pid=122698) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 23 04:42:06.175353 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e290fc65-6feb-46a8-9fe6-93873f47395e tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:06.176185 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e290fc65-6feb-46a8-9fe6-93873f47395e tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 8a6b2904-2edd-4e9e-b6fa-1d6249721f52] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:06.190161 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:42:06.192825 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e290fc65-6feb-46a8-9fe6-93873f47395e tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:06.193545 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e290fc65-6feb-46a8-9fe6-93873f47395e tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:06.194271 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e290fc65-6feb-46a8-9fe6-93873f47395e tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:06.195184 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e290fc65-6feb-46a8-9fe6-93873f47395e tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:06.196445 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e290fc65-6feb-46a8-9fe6-93873f47395e tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:06.197037 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e290fc65-6feb-46a8-9fe6-93873f47395e tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:07.044055 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e290fc65-6feb-46a8-9fe6-93873f47395e tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:07.049033 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=100 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:42:07.057222 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e290fc65-6feb-46a8-9fe6-93873f47395e tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/8a6b2904-2edd-4e9e-b6fa-1d6249721f52" status: 200 len: 1512 microversion: 2.1 time: 0.886977 Sep 23 04:42:07.058608 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1376/2732] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:42:06 2022] GET /compute/v2.1/servers/8a6b2904-2edd-4e9e-b6fa-1d6249721f52 => generated 1512 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:42:07.068156 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d4b79878-374c-4f1d-98d9-096f6b847a05 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:07.070192 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d4b79878-374c-4f1d-98d9-096f6b847a05 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:07.077485 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d4b79878-374c-4f1d-98d9-096f6b847a05 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:07.078109 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d4b79878-374c-4f1d-98d9-096f6b847a05 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:07.078801 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d4b79878-374c-4f1d-98d9-096f6b847a05 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:07.079589 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d4b79878-374c-4f1d-98d9-096f6b847a05 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:07.080123 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d4b79878-374c-4f1d-98d9-096f6b847a05 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:07.080748 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d4b79878-374c-4f1d-98d9-096f6b847a05 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:07.198093 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d4b79878-374c-4f1d-98d9-096f6b847a05 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:07.212681 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d4b79878-374c-4f1d-98d9-096f6b847a05 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:07.214562 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d4b79878-374c-4f1d-98d9-096f6b847a05 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:07.227878 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d4b79878-374c-4f1d-98d9-096f6b847a05 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1553 microversion: 2.91 time: 0.165658 Sep 23 04:42:07.231001 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1377/2733] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:42:07 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1553 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:42:08.083478 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7125f0a2-d401-428a-9eb7-4e84e0572b7f tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:08.084093 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-7125f0a2-d401-428a-9eb7-4e84e0572b7f tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 8a6b2904-2edd-4e9e-b6fa-1d6249721f52] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:08.103229 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7125f0a2-d401-428a-9eb7-4e84e0572b7f tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:08.103738 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7125f0a2-d401-428a-9eb7-4e84e0572b7f tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:08.104205 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7125f0a2-d401-428a-9eb7-4e84e0572b7f tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:08.104929 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7125f0a2-d401-428a-9eb7-4e84e0572b7f tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:08.105392 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7125f0a2-d401-428a-9eb7-4e84e0572b7f tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:08.105818 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7125f0a2-d401-428a-9eb7-4e84e0572b7f tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:08.854256 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-7125f0a2-d401-428a-9eb7-4e84e0572b7f tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:08.916246 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-7125f0a2-d401-428a-9eb7-4e84e0572b7f tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/8a6b2904-2edd-4e9e-b6fa-1d6249721f52" status: 200 len: 1512 microversion: 2.1 time: 0.818706 Sep 23 04:42:08.918064 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1378/2734] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:42:08 2022] GET /compute/v2.1/servers/8a6b2904-2edd-4e9e-b6fa-1d6249721f52 => generated 1512 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:42:08.933573 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0763947c-5a21-484e-9e5f-90b0ab221758 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:08.934236 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-0763947c-5a21-484e-9e5f-90b0ab221758 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:08.948071 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0763947c-5a21-484e-9e5f-90b0ab221758 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:08.948834 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0763947c-5a21-484e-9e5f-90b0ab221758 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:08.949468 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0763947c-5a21-484e-9e5f-90b0ab221758 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:08.950396 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0763947c-5a21-484e-9e5f-90b0ab221758 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:08.951024 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0763947c-5a21-484e-9e5f-90b0ab221758 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:08.951613 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0763947c-5a21-484e-9e5f-90b0ab221758 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:09.156630 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-0763947c-5a21-484e-9e5f-90b0ab221758 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:09.165621 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-0763947c-5a21-484e-9e5f-90b0ab221758 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:09.166946 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-0763947c-5a21-484e-9e5f-90b0ab221758 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:09.178734 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0763947c-5a21-484e-9e5f-90b0ab221758 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1535 microversion: 2.91 time: 0.259452 Sep 23 04:42:09.179715 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1379/2735] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:42:08 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1535 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:42:09.549184 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.network.neutron [None req-d3f05056-ad5f-47e3-9954-34dd9225e229 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] [instance: 5ee8a1da-f229-4716-bc67-da23f07963bd] Building network info cache for instance {{(pid=122698) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 23 04:42:09.559584 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-288b77e9-68f8-444f-b608-d2c052ceb298 req-cdebc1aa-7d6d-43b8-9e52-75be5900a439 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ee8a1da-f229-4716-bc67-da23f07963bd", "tag": "f9285902-d382-442c-88b6-fad3f3a0ebcc"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:42:09.575305 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-288b77e9-68f8-444f-b608-d2c052ceb298 req-cdebc1aa-7d6d-43b8-9e52-75be5900a439 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:09.576710 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-288b77e9-68f8-444f-b608-d2c052ceb298 req-cdebc1aa-7d6d-43b8-9e52-75be5900a439 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:09.578899 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-288b77e9-68f8-444f-b608-d2c052ceb298 req-cdebc1aa-7d6d-43b8-9e52-75be5900a439 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:09.608280 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-288b77e9-68f8-444f-b608-d2c052ceb298 req-cdebc1aa-7d6d-43b8-9e52-75be5900a439 service nova] Creating event network-changed:f9285902-d382-442c-88b6-fad3f3a0ebcc for instance 5ee8a1da-f229-4716-bc67-da23f07963bd on n-h1-846463-3 Sep 23 04:42:09.616302 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-288b77e9-68f8-444f-b608-d2c052ceb298 req-cdebc1aa-7d6d-43b8-9e52-75be5900a439 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062076 Sep 23 04:42:09.619134 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1380/2736] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:42:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:42:09.940665 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-601045ca-b4d3-4915-b493-a7cfdef10df7 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:09.941568 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-601045ca-b4d3-4915-b493-a7cfdef10df7 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 8a6b2904-2edd-4e9e-b6fa-1d6249721f52] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:09.952675 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-601045ca-b4d3-4915-b493-a7cfdef10df7 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:09.953394 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-601045ca-b4d3-4915-b493-a7cfdef10df7 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:09.953972 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-601045ca-b4d3-4915-b493-a7cfdef10df7 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:09.956930 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-601045ca-b4d3-4915-b493-a7cfdef10df7 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:09.957523 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-601045ca-b4d3-4915-b493-a7cfdef10df7 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:09.958090 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-601045ca-b4d3-4915-b493-a7cfdef10df7 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:10.309188 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-601045ca-b4d3-4915-b493-a7cfdef10df7 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:10.322507 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-601045ca-b4d3-4915-b493-a7cfdef10df7 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/8a6b2904-2edd-4e9e-b6fa-1d6249721f52" status: 200 len: 1512 microversion: 2.1 time: 0.385968 Sep 23 04:42:10.338100 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1381/2737] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:42:09 2022] GET /compute/v2.1/servers/8a6b2904-2edd-4e9e-b6fa-1d6249721f52 => generated 1512 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:42:10.361090 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1903efa3-cad9-43a8-9952-b187da51617b tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:10.361779 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1903efa3-cad9-43a8-9952-b187da51617b tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:10.372958 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1903efa3-cad9-43a8-9952-b187da51617b tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:10.373473 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1903efa3-cad9-43a8-9952-b187da51617b tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:10.373958 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1903efa3-cad9-43a8-9952-b187da51617b tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:10.375110 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1903efa3-cad9-43a8-9952-b187da51617b tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:10.375589 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1903efa3-cad9-43a8-9952-b187da51617b tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:10.376028 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1903efa3-cad9-43a8-9952-b187da51617b tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:10.490628 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1903efa3-cad9-43a8-9952-b187da51617b tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:10.501139 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1903efa3-cad9-43a8-9952-b187da51617b tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:10.503648 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1903efa3-cad9-43a8-9952-b187da51617b tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:10.512049 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1903efa3-cad9-43a8-9952-b187da51617b tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1535 microversion: 2.91 time: 0.170837 Sep 23 04:42:10.512946 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1382/2738] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:42:10 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1535 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:42:10.592460 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.network.neutron [None req-d3f05056-ad5f-47e3-9954-34dd9225e229 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] [instance: 5ee8a1da-f229-4716-bc67-da23f07963bd] Updating instance_info_cache with network_info: [{"id": "f9285902-d382-442c-88b6-fad3f3a0ebcc", "address": "fa:16:3e:37:2f:84", "network": {"id": "915287f6-aa15-4992-ac36-33c87673d394", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-220138403-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.3.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "f7a16a53325a4d61aef94281435e9726", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapf9285902-d3", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122698) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 23 04:42:10.757679 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d3f05056-ad5f-47e3-9954-34dd9225e229 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Releasing lock "refresh_cache-5ee8a1da-f229-4716-bc67-da23f07963bd" {{(pid=122698) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 23 04:42:10.760205 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d3f05056-ad5f-47e3-9954-34dd9225e229 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] 10.222.0.33 "POST /compute/v2.1/servers/5ee8a1da-f229-4716-bc67-da23f07963bd/action" status: 202 len: 0 microversion: 2.1 time: 4.790368 Sep 23 04:42:10.766583 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1357/2739] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:42:05 2022] POST /compute/v2.1/servers/5ee8a1da-f229-4716-bc67-da23f07963bd/action => generated 0 bytes in 4794 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 23 04:42:10.775382 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-089d5310-2c7c-4eec-a9e9-f8fef5cd59ec tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.3.28"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:42:11.121235 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-089d5310-2c7c-4eec-a9e9-f8fef5cd59ec tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] [instance: 5ee8a1da-f229-4716-bc67-da23f07963bd] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:11.129424 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-089d5310-2c7c-4eec-a9e9-f8fef5cd59ec tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:11.130021 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-089d5310-2c7c-4eec-a9e9-f8fef5cd59ec tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:11.130482 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-089d5310-2c7c-4eec-a9e9-f8fef5cd59ec tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:11.134743 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-089d5310-2c7c-4eec-a9e9-f8fef5cd59ec tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:11.135984 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-089d5310-2c7c-4eec-a9e9-f8fef5cd59ec tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:11.136738 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-089d5310-2c7c-4eec-a9e9-f8fef5cd59ec tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:11.348366 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-827f215b-bfb6-4ca7-a438-a43589e1e360 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:11.349426 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-827f215b-bfb6-4ca7-a438-a43589e1e360 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 8a6b2904-2edd-4e9e-b6fa-1d6249721f52] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:11.362674 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-827f215b-bfb6-4ca7-a438-a43589e1e360 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:11.363881 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-827f215b-bfb6-4ca7-a438-a43589e1e360 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:11.365260 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-827f215b-bfb6-4ca7-a438-a43589e1e360 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:11.367109 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-827f215b-bfb6-4ca7-a438-a43589e1e360 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:11.370731 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-827f215b-bfb6-4ca7-a438-a43589e1e360 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:11.371425 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-827f215b-bfb6-4ca7-a438-a43589e1e360 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:11.788942 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-089d5310-2c7c-4eec-a9e9-f8fef5cd59ec tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Acquiring lock "refresh_cache-5ee8a1da-f229-4716-bc67-da23f07963bd" {{(pid=122699) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 23 04:42:11.794904 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-089d5310-2c7c-4eec-a9e9-f8fef5cd59ec tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Acquired lock "refresh_cache-5ee8a1da-f229-4716-bc67-da23f07963bd" {{(pid=122699) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 23 04:42:11.869828 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-827f215b-bfb6-4ca7-a438-a43589e1e360 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:11.880781 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-827f215b-bfb6-4ca7-a438-a43589e1e360 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/8a6b2904-2edd-4e9e-b6fa-1d6249721f52" status: 200 len: 1489 microversion: 2.1 time: 0.536606 Sep 23 04:42:11.892572 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1358/2740] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:42:11 2022] GET /compute/v2.1/servers/8a6b2904-2edd-4e9e-b6fa-1d6249721f52 => generated 1489 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:42:11.906742 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2ae65a0a-991a-4d86-913f-b459bcf61a44 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:11.907792 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-2ae65a0a-991a-4d86-913f-b459bcf61a44 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:11.917951 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2ae65a0a-991a-4d86-913f-b459bcf61a44 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:11.918700 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2ae65a0a-991a-4d86-913f-b459bcf61a44 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:11.919301 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2ae65a0a-991a-4d86-913f-b459bcf61a44 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:11.920247 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2ae65a0a-991a-4d86-913f-b459bcf61a44 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:11.921199 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2ae65a0a-991a-4d86-913f-b459bcf61a44 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:11.921879 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2ae65a0a-991a-4d86-913f-b459bcf61a44 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:12.029807 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-2ae65a0a-991a-4d86-913f-b459bcf61a44 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:12.048201 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-2ae65a0a-991a-4d86-913f-b459bcf61a44 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:12.050112 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-2ae65a0a-991a-4d86-913f-b459bcf61a44 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:12.056019 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2ae65a0a-991a-4d86-913f-b459bcf61a44 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1478 microversion: 2.91 time: 0.153021 Sep 23 04:42:12.056895 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1359/2741] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:42:11 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1478 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:42:12.061613 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-67b58cc9-0538-4e22-928e-d5b789c0c664 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:12.062228 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-67b58cc9-0538-4e22-928e-d5b789c0c664 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 8a6b2904-2edd-4e9e-b6fa-1d6249721f52] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:12.068526 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-67b58cc9-0538-4e22-928e-d5b789c0c664 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:12.069860 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-67b58cc9-0538-4e22-928e-d5b789c0c664 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:12.077657 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-67b58cc9-0538-4e22-928e-d5b789c0c664 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:12.077657 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-67b58cc9-0538-4e22-928e-d5b789c0c664 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:12.077657 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-67b58cc9-0538-4e22-928e-d5b789c0c664 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:12.077657 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-67b58cc9-0538-4e22-928e-d5b789c0c664 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:12.099331 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-67b58cc9-0538-4e22-928e-d5b789c0c664 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 8a6b2904-2edd-4e9e-b6fa-1d6249721f52] Going to try to terminate instance {{(pid=122698) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:42:12.606476 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-67b58cc9-0538-4e22-928e-d5b789c0c664 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "DELETE /compute/v2.1/servers/8a6b2904-2edd-4e9e-b6fa-1d6249721f52" status: 204 len: 0 microversion: 2.1 time: 0.547034 Sep 23 04:42:12.610595 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1360/2742] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:42:12 2022] DELETE /compute/v2.1/servers/8a6b2904-2edd-4e9e-b6fa-1d6249721f52 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:42:12.617688 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5ee738e9-f93d-4371-8d9c-780437e6ad00 tempest-UnshelveToHostMultiNodesTest-1629091521 tempest-UnshelveToHostMultiNodesTest-1629091521-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h2-846463-3"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:42:12.620770 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5ee738e9-f93d-4371-8d9c-780437e6ad00 tempest-UnshelveToHostMultiNodesTest-1629091521 tempest-UnshelveToHostMultiNodesTest-1629091521-project-admin] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:12.631048 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5ee738e9-f93d-4371-8d9c-780437e6ad00 tempest-UnshelveToHostMultiNodesTest-1629091521 tempest-UnshelveToHostMultiNodesTest-1629091521-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:12.631830 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5ee738e9-f93d-4371-8d9c-780437e6ad00 tempest-UnshelveToHostMultiNodesTest-1629091521 tempest-UnshelveToHostMultiNodesTest-1629091521-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:12.633794 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5ee738e9-f93d-4371-8d9c-780437e6ad00 tempest-UnshelveToHostMultiNodesTest-1629091521 tempest-UnshelveToHostMultiNodesTest-1629091521-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:12.637000 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5ee738e9-f93d-4371-8d9c-780437e6ad00 tempest-UnshelveToHostMultiNodesTest-1629091521 tempest-UnshelveToHostMultiNodesTest-1629091521-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:12.637000 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5ee738e9-f93d-4371-8d9c-780437e6ad00 tempest-UnshelveToHostMultiNodesTest-1629091521 tempest-UnshelveToHostMultiNodesTest-1629091521-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:12.637000 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5ee738e9-f93d-4371-8d9c-780437e6ad00 tempest-UnshelveToHostMultiNodesTest-1629091521 tempest-UnshelveToHostMultiNodesTest-1629091521-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:12.713106 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5ee738e9-f93d-4371-8d9c-780437e6ad00 tempest-UnshelveToHostMultiNodesTest-1629091521 tempest-UnshelveToHostMultiNodesTest-1629091521-project-admin] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h2-846463-3". {{(pid=122698) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 23 04:42:12.760613 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=3,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:42:13.082615 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5ee738e9-f93d-4371-8d9c-780437e6ad00 tempest-UnshelveToHostMultiNodesTest-1629091521 tempest-UnshelveToHostMultiNodesTest-1629091521-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831/action" status: 202 len: 0 microversion: 2.91 time: 0.469643 Sep 23 04:42:13.083995 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1361/2743] 10.222.0.33 () {62 vars in 1319 bytes} [Fri Sep 23 04:42:12 2022] POST /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831/action => generated 0 bytes in 472 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:42:13.096481 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-08cd26cf-8772-400b-85c2-616277a1a587 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:13.101474 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-08cd26cf-8772-400b-85c2-616277a1a587 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 8a6b2904-2edd-4e9e-b6fa-1d6249721f52] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:13.116014 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-08cd26cf-8772-400b-85c2-616277a1a587 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:13.116528 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-08cd26cf-8772-400b-85c2-616277a1a587 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:13.116971 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-08cd26cf-8772-400b-85c2-616277a1a587 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:13.120583 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-08cd26cf-8772-400b-85c2-616277a1a587 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:13.121610 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-08cd26cf-8772-400b-85c2-616277a1a587 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:13.122986 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-08cd26cf-8772-400b-85c2-616277a1a587 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:13.152834 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.neutron [None req-089d5310-2c7c-4eec-a9e9-f8fef5cd59ec tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] [instance: 5ee8a1da-f229-4716-bc67-da23f07963bd] Building network info cache for instance {{(pid=122699) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 23 04:42:13.569391 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-08cd26cf-8772-400b-85c2-616277a1a587 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:13.581582 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-08cd26cf-8772-400b-85c2-616277a1a587 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/8a6b2904-2edd-4e9e-b6fa-1d6249721f52" status: 200 len: 1495 microversion: 2.1 time: 0.495991 Sep 23 04:42:13.598075 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1362/2744] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:42:13 2022] GET /compute/v2.1/servers/8a6b2904-2edd-4e9e-b6fa-1d6249721f52 => generated 1495 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:42:13.606725 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e6d0b1e7-74a5-45af-9ece-39f8da5c97ad tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:13.607565 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e6d0b1e7-74a5-45af-9ece-39f8da5c97ad tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:13.614312 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e6d0b1e7-74a5-45af-9ece-39f8da5c97ad tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:13.615049 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e6d0b1e7-74a5-45af-9ece-39f8da5c97ad tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:13.615686 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e6d0b1e7-74a5-45af-9ece-39f8da5c97ad tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:13.629584 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e6d0b1e7-74a5-45af-9ece-39f8da5c97ad tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:13.630915 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e6d0b1e7-74a5-45af-9ece-39f8da5c97ad tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:13.632478 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e6d0b1e7-74a5-45af-9ece-39f8da5c97ad tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:14.476303 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e6d0b1e7-74a5-45af-9ece-39f8da5c97ad tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:14.491690 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e6d0b1e7-74a5-45af-9ece-39f8da5c97ad tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:14.508561 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e6d0b1e7-74a5-45af-9ece-39f8da5c97ad tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:14.510871 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e6d0b1e7-74a5-45af-9ece-39f8da5c97ad tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1486 microversion: 2.91 time: 0.910400 Sep 23 04:42:14.532119 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1363/2745] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:42:13 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1486 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:42:14.544314 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-6792a5b1-4e0d-40c2-9b4f-6e5dd09ddf36 req-18551a7b-58ba-4408-87fb-a863af30c0d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ee8a1da-f229-4716-bc67-da23f07963bd", "tag": "f9285902-d382-442c-88b6-fad3f3a0ebcc"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:42:14.565822 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-6792a5b1-4e0d-40c2-9b4f-6e5dd09ddf36 req-18551a7b-58ba-4408-87fb-a863af30c0d0 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:14.566340 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-6792a5b1-4e0d-40c2-9b4f-6e5dd09ddf36 req-18551a7b-58ba-4408-87fb-a863af30c0d0 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:14.571107 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-6792a5b1-4e0d-40c2-9b4f-6e5dd09ddf36 req-18551a7b-58ba-4408-87fb-a863af30c0d0 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:14.606465 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-6792a5b1-4e0d-40c2-9b4f-6e5dd09ddf36 req-18551a7b-58ba-4408-87fb-a863af30c0d0 service nova] Creating event network-changed:f9285902-d382-442c-88b6-fad3f3a0ebcc for instance 5ee8a1da-f229-4716-bc67-da23f07963bd on n-h1-846463-3 Sep 23 04:42:14.624137 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-6792a5b1-4e0d-40c2-9b4f-6e5dd09ddf36 req-18551a7b-58ba-4408-87fb-a863af30c0d0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090686 Sep 23 04:42:14.626447 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1364/2746] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:42:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:42:14.631380 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e4851d3e-17ff-4454-94c0-94836b064a68 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:14.636310 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e4851d3e-17ff-4454-94c0-94836b064a68 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 8a6b2904-2edd-4e9e-b6fa-1d6249721f52] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:14.650002 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e4851d3e-17ff-4454-94c0-94836b064a68 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:14.653561 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e4851d3e-17ff-4454-94c0-94836b064a68 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:14.654224 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e4851d3e-17ff-4454-94c0-94836b064a68 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:14.655126 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e4851d3e-17ff-4454-94c0-94836b064a68 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:14.657001 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e4851d3e-17ff-4454-94c0-94836b064a68 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:14.662756 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e4851d3e-17ff-4454-94c0-94836b064a68 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:15.700251 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.neutron [None req-089d5310-2c7c-4eec-a9e9-f8fef5cd59ec tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] [instance: 5ee8a1da-f229-4716-bc67-da23f07963bd] Updating instance_info_cache with network_info: [{"id": "f9285902-d382-442c-88b6-fad3f3a0ebcc", "address": "fa:16:3e:37:2f:84", "network": {"id": "915287f6-aa15-4992-ac36-33c87673d394", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-220138403-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "f7a16a53325a4d61aef94281435e9726", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapf9285902-d3", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122699) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 23 04:42:15.760361 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e4851d3e-17ff-4454-94c0-94836b064a68 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:15.772971 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e4851d3e-17ff-4454-94c0-94836b064a68 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/8a6b2904-2edd-4e9e-b6fa-1d6249721f52" status: 200 len: 1495 microversion: 2.1 time: 1.146584 Sep 23 04:42:15.773703 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1365/2747] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:42:14 2022] GET /compute/v2.1/servers/8a6b2904-2edd-4e9e-b6fa-1d6249721f52 => generated 1495 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:42:15.782407 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-da117608-4466-4995-9bda-f088375d3dd7 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:15.792075 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-da117608-4466-4995-9bda-f088375d3dd7 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:15.796571 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-da117608-4466-4995-9bda-f088375d3dd7 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:15.797199 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-da117608-4466-4995-9bda-f088375d3dd7 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:15.797775 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-da117608-4466-4995-9bda-f088375d3dd7 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:15.799128 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-da117608-4466-4995-9bda-f088375d3dd7 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:15.799678 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-da117608-4466-4995-9bda-f088375d3dd7 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:15.800323 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-da117608-4466-4995-9bda-f088375d3dd7 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:15.813615 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-089d5310-2c7c-4eec-a9e9-f8fef5cd59ec tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Releasing lock "refresh_cache-5ee8a1da-f229-4716-bc67-da23f07963bd" {{(pid=122699) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 23 04:42:15.814631 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-089d5310-2c7c-4eec-a9e9-f8fef5cd59ec tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] 10.222.0.33 "POST /compute/v2.1/servers/5ee8a1da-f229-4716-bc67-da23f07963bd/action" status: 202 len: 0 microversion: 2.1 time: 5.046545 Sep 23 04:42:15.818149 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1383/2748] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:42:10 2022] POST /compute/v2.1/servers/5ee8a1da-f229-4716-bc67-da23f07963bd/action => generated 0 bytes in 5048 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 23 04:42:15.827613 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-da65e1f0-7464-410d-ad38-cb515ef7ec8f tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Calling method '.version_select at 0x7ff1baaf2dc0>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:16.028949 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-da117608-4466-4995-9bda-f088375d3dd7 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:16.038885 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-da117608-4466-4995-9bda-f088375d3dd7 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:16.041651 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-da117608-4466-4995-9bda-f088375d3dd7 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:16.052721 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-da117608-4466-4995-9bda-f088375d3dd7 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1488 microversion: 2.91 time: 0.277832 Sep 23 04:42:16.053858 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1366/2749] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:42:15 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1488 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:42:16.551598 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-94af0ad0-eca2-48d7-8dc3-af7b8c205bfe tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8baef134-0776-432d-b1a4-21cda52b9216"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:42:16.554024 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-94af0ad0-eca2-48d7-8dc3-af7b8c205bfe tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] [instance: dfb8f504-218a-471c-b7a8-70c498769f0e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:16.574656 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-94af0ad0-eca2-48d7-8dc3-af7b8c205bfe tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:16.581792 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-94af0ad0-eca2-48d7-8dc3-af7b8c205bfe tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:16.581792 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-94af0ad0-eca2-48d7-8dc3-af7b8c205bfe tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:16.581792 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-94af0ad0-eca2-48d7-8dc3-af7b8c205bfe tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:16.581792 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-94af0ad0-eca2-48d7-8dc3-af7b8c205bfe tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:16.581792 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-94af0ad0-eca2-48d7-8dc3-af7b8c205bfe tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:17.741607 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-94af0ad0-eca2-48d7-8dc3-af7b8c205bfe tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] 10.222.0.33 "POST /compute/v2.1/servers/dfb8f504-218a-471c-b7a8-70c498769f0e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.193552 Sep 23 04:42:17.748011 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1367/2750] 10.222.0.33 () {60 vars in 1323 bytes} [Fri Sep 23 04:42:16 2022] POST /compute/v2.1/servers/dfb8f504-218a-471c-b7a8-70c498769f0e/os-volume_attachments => generated 194 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:42:17.752725 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-64d66a0f-4be8-4c31-b57e-51493e6d9a5d req-b5932623-f4e6-457c-9774-518042e8568c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a6b2904-2edd-4e9e-b6fa-1d6249721f52", "name": "network-vif-deleted", "tag": "391b0b37-303e-4cb7-84df-aafbc7c7b54b"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:42:17.778913 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-64d66a0f-4be8-4c31-b57e-51493e6d9a5d req-b5932623-f4e6-457c-9774-518042e8568c service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:17.790664 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-64d66a0f-4be8-4c31-b57e-51493e6d9a5d req-b5932623-f4e6-457c-9774-518042e8568c service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:17.791770 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-64d66a0f-4be8-4c31-b57e-51493e6d9a5d req-b5932623-f4e6-457c-9774-518042e8568c service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:17.803371 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-64d66a0f-4be8-4c31-b57e-51493e6d9a5d req-b5932623-f4e6-457c-9774-518042e8568c service nova] Creating event network-vif-deleted:391b0b37-303e-4cb7-84df-aafbc7c7b54b for instance 8a6b2904-2edd-4e9e-b6fa-1d6249721f52 on n-h1-846463-3 Sep 23 04:42:17.818345 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-64d66a0f-4be8-4c31-b57e-51493e6d9a5d req-b5932623-f4e6-457c-9774-518042e8568c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074378 Sep 23 04:42:17.819513 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1368/2751] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:42:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:42:17.836998 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f6c61515-c47c-450d-8639-7af625a4af0c tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:17.838150 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f6c61515-c47c-450d-8639-7af625a4af0c tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 8a6b2904-2edd-4e9e-b6fa-1d6249721f52] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:17.846021 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f6c61515-c47c-450d-8639-7af625a4af0c tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:17.846701 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f6c61515-c47c-450d-8639-7af625a4af0c tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:17.847347 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f6c61515-c47c-450d-8639-7af625a4af0c tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:17.848430 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f6c61515-c47c-450d-8639-7af625a4af0c tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:17.862684 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f6c61515-c47c-450d-8639-7af625a4af0c tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:17.863180 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f6c61515-c47c-450d-8639-7af625a4af0c tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:17.940354 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f6c61515-c47c-450d-8639-7af625a4af0c tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:17.942592 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f6c61515-c47c-450d-8639-7af625a4af0c tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:17.943152 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f6c61515-c47c-450d-8639-7af625a4af0c tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:17.948521 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-f6c61515-c47c-450d-8639-7af625a4af0c tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lazy-loading 'fault' on Instance uuid 8a6b2904-2edd-4e9e-b6fa-1d6249721f52 {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:42:18.087809 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f6c61515-c47c-450d-8639-7af625a4af0c tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:18.108522 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f6c61515-c47c-450d-8639-7af625a4af0c tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/8a6b2904-2edd-4e9e-b6fa-1d6249721f52" status: 200 len: 1305 microversion: 2.1 time: 0.287091 Sep 23 04:42:18.109148 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1369/2752] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:42:17 2022] GET /compute/v2.1/servers/8a6b2904-2edd-4e9e-b6fa-1d6249721f52 => generated 1305 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:42:18.113796 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-79ce7ce8-5a74-4a4f-a52c-9318d966b192 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:18.114444 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-79ce7ce8-5a74-4a4f-a52c-9318d966b192 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:18.135874 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-79ce7ce8-5a74-4a4f-a52c-9318d966b192 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:18.136684 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-79ce7ce8-5a74-4a4f-a52c-9318d966b192 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:18.137150 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-79ce7ce8-5a74-4a4f-a52c-9318d966b192 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:18.137931 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-79ce7ce8-5a74-4a4f-a52c-9318d966b192 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:18.138399 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-79ce7ce8-5a74-4a4f-a52c-9318d966b192 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:18.139141 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-79ce7ce8-5a74-4a4f-a52c-9318d966b192 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:18.385166 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-79ce7ce8-5a74-4a4f-a52c-9318d966b192 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:18.405463 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-79ce7ce8-5a74-4a4f-a52c-9318d966b192 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:18.439711 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-79ce7ce8-5a74-4a4f-a52c-9318d966b192 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:18.446105 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-79ce7ce8-5a74-4a4f-a52c-9318d966b192 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1544 microversion: 2.91 time: 0.335851 Sep 23 04:42:18.446704 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1370/2753] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:42:18 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1544 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:42:18.487528 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-da65e1f0-7464-410d-ad38-cb515ef7ec8f tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] 10.222.0.33 "DELETE /compute/v2.1/os-floating-ips/d427b09b-d9a7-483b-ba99-c73aa073306d" status: 202 len: 0 microversion: 2.1 time: 2.665778 Sep 23 04:42:18.494475 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1384/2754] 10.222.0.33 () {58 vars in 1263 bytes} [Fri Sep 23 04:42:15 2022] DELETE /compute/v2.1/os-floating-ips/d427b09b-d9a7-483b-ba99-c73aa073306d => generated 0 bytes in 2674 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 23 04:42:18.500341 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5cf7d57e-8300-4e1d-b7df-81c6c0b52e15 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Calling method '.version_select at 0x7ff1bbfedaf0>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:19.137823 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-104322aa-385d-4d89-9a4a-c51b3de58916 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:19.142072 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-104322aa-385d-4d89-9a4a-c51b3de58916 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 8a6b2904-2edd-4e9e-b6fa-1d6249721f52] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:19.153626 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-104322aa-385d-4d89-9a4a-c51b3de58916 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:19.154178 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-104322aa-385d-4d89-9a4a-c51b3de58916 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:19.154636 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-104322aa-385d-4d89-9a4a-c51b3de58916 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:19.155368 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-104322aa-385d-4d89-9a4a-c51b3de58916 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:19.159816 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-104322aa-385d-4d89-9a4a-c51b3de58916 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:19.160283 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-104322aa-385d-4d89-9a4a-c51b3de58916 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:19.187236 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-104322aa-385d-4d89-9a4a-c51b3de58916 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] HTTP exception thrown: Instance 8a6b2904-2edd-4e9e-b6fa-1d6249721f52 could not be found. Sep 23 04:42:19.189485 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-104322aa-385d-4d89-9a4a-c51b3de58916 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Request method failure captured: Sep 23 04:42:19.189485 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/8a6b2904-2edd-4e9e-b6fa-1d6249721f52 HTTP/1.1 Sep 23 04:42:19.189485 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:42:19.189485 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:42:19.189485 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:42:19.189485 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:42:19.189485 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:42:19.189485 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:42:19.189485 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:42:19.189485 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:42:19.189485 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTgD-AJZNKtluGEJNjQKU0pcHtUCc1AZ8Ycz4MPGIeanw2_GglRmvn8LiMCEayIX86yw_RpyCC_JZrlVGSjhSgenUVZhpJ_MqN5SLmcv6Qnl3N6cXWJgtCK8N_ffRhD1dYgLIdHHgnmyTAptDZsjatOWU1ocTU40JP9XOpkK3deqL7A Sep 23 04:42:19.189485 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:42:19.189485 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:42:19.189485 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:42:19.189485 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:42:19.189485 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:42:19.189485 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:42:19.189485 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: fe698721372f40888dc2918c46e65f2f Sep 23 04:42:19.189485 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-DeleteServersTestJSON-347759205 Sep 23 04:42:19.189485 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:42:19.189485 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:42:19.189485 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fe698721372f40888dc2918c46e65f2f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe698721372f40888dc2918c46e65f2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fe698721372f40888dc2918c46e65f2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe698721372f40888dc2918c46e65f2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:42:19.189485 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-DeleteServersTestJSON-347759205 Sep 23 04:42:19.189485 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: fe698721372f40888dc2918c46e65f2f Sep 23 04:42:19.189485 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-DeleteServersTestJSON-347759205 Sep 23 04:42:19.189485 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-DeleteServersTestJSON-347759205-project Sep 23 04:42:19.189485 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:42:19.189485 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:42:19.189485 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 36526fe612c840fb907e1992d8e62538 Sep 23 04:42:19.189485 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-DeleteServersTestJSON-347759205-project Sep 23 04:42:19.189485 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:42:19.189485 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 8a6b2904-2edd-4e9e-b6fa-1d6249721f52 could not be found. Sep 23 04:42:19.189485 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '8a6b2904-2edd-4e9e-b6fa-1d6249721f52'} Sep 23 04:42:19.189485 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:42:19.189485 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:42:19.189485 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:42:19.189485 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:42:19.189485 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:42:19.189485 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:42:19.189485 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:42:19.189485 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:42:19.189485 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:42:19.189485 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:42:19.189485 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a6b2904-2edd-4e9e-b6fa-1d6249721f52 could not be found. Sep 23 04:42:19.189485 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:42:19.189485 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:42:19.189485 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:42:19.189485 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:42:19.189485 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:42:19.189485 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:42:19.189485 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:42:19.189485 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:42:19.189485 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:42:19.189485 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:42:19.189485 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:42:19.189485 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:42:19.189485 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:42:19.189485 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:42:19.189485 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:42:19.189485 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:42:19.189485 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a6b2904-2edd-4e9e-b6fa-1d6249721f52 could not be found. Sep 23 04:42:19.189485 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:42:19.189485 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:42:19.189485 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:42:19.194538 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:42:19.194538 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:42:19.194538 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:42:19.194538 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:42:19.194538 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:42:19.194538 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a6b2904-2edd-4e9e-b6fa-1d6249721f52 could not be found. Sep 23 04:42:19.194538 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:42:19.194538 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-104322aa-385d-4d89-9a4a-c51b3de58916 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Returning 404 to user: Instance 8a6b2904-2edd-4e9e-b6fa-1d6249721f52 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:42:19.194538 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-104322aa-385d-4d89-9a4a-c51b3de58916 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/8a6b2904-2edd-4e9e-b6fa-1d6249721f52" status: 404 len: 111 microversion: 2.1 time: 0.059136 Sep 23 04:42:19.208988 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1385/2755] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:42:19 2022] GET /compute/v2.1/servers/8a6b2904-2edd-4e9e-b6fa-1d6249721f52 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:42:19.348651 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-aefe5732-0e9c-4de7-a624-de76d3fd8c80 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1937250626", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "networks": [{"uuid": "a989594a-cd71-405f-a7ac-42f529a758f7"}]}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:42:19.450495 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5cf7d57e-8300-4e1d-b7df-81c6c0b52e15 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/b2d449b5-0138-4cd5-8328-91fc1b80c0c5" status: 202 len: 0 microversion: 2.1 time: 0.955108 Sep 23 04:42:19.451957 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1371/2756] 10.222.0.33 () {58 vars in 1272 bytes} [Fri Sep 23 04:42:18 2022] DELETE /compute/v2.1/os-security-groups/b2d449b5-0138-4cd5-8328-91fc1b80c0c5 => generated 0 bytes in 957 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:42:19.460013 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7bb874ca-2d8e-43a1-b7bf-485d21a20574 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:19.462007 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7bb874ca-2d8e-43a1-b7bf-485d21a20574 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] [instance: 5ee8a1da-f229-4716-bc67-da23f07963bd] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:19.463273 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.neutron [None req-aefe5732-0e9c-4de7-a624-de76d3fd8c80 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] validate_networks() for [('a989594a-cd71-405f-a7ac-42f529a758f7', None, None, None, None, None)] {{(pid=122699) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:42:19.483787 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7bb874ca-2d8e-43a1-b7bf-485d21a20574 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:19.483787 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7bb874ca-2d8e-43a1-b7bf-485d21a20574 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:19.483787 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7bb874ca-2d8e-43a1-b7bf-485d21a20574 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:19.484275 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7bb874ca-2d8e-43a1-b7bf-485d21a20574 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:19.485106 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7bb874ca-2d8e-43a1-b7bf-485d21a20574 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:19.486030 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7bb874ca-2d8e-43a1-b7bf-485d21a20574 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:19.550174 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7bb874ca-2d8e-43a1-b7bf-485d21a20574 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] [instance: 5ee8a1da-f229-4716-bc67-da23f07963bd] Going to try to terminate instance {{(pid=122698) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:42:20.065690 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7bb874ca-2d8e-43a1-b7bf-485d21a20574 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] 10.222.0.33 "DELETE /compute/v2.1/servers/5ee8a1da-f229-4716-bc67-da23f07963bd" status: 204 len: 0 microversion: 2.1 time: 0.609506 Sep 23 04:42:20.067275 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1372/2757] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:42:19 2022] DELETE /compute/v2.1/servers/5ee8a1da-f229-4716-bc67-da23f07963bd => generated 0 bytes in 612 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:42:20.077127 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-dbacdefa-3934-45e3-8c0f-3f11beace89d tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:20.079032 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-dbacdefa-3934-45e3-8c0f-3f11beace89d tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:20.094899 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dbacdefa-3934-45e3-8c0f-3f11beace89d tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:20.098609 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dbacdefa-3934-45e3-8c0f-3f11beace89d tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:20.099247 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dbacdefa-3934-45e3-8c0f-3f11beace89d tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:20.100152 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dbacdefa-3934-45e3-8c0f-3f11beace89d tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:20.103357 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dbacdefa-3934-45e3-8c0f-3f11beace89d tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:20.104003 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dbacdefa-3934-45e3-8c0f-3f11beace89d tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:20.243585 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-dbacdefa-3934-45e3-8c0f-3f11beace89d tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:20.259288 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-dbacdefa-3934-45e3-8c0f-3f11beace89d tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:20.262962 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-dbacdefa-3934-45e3-8c0f-3f11beace89d tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:20.276433 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:42:20.288020 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-dbacdefa-3934-45e3-8c0f-3f11beace89d tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1544 microversion: 2.91 time: 0.210670 Sep 23 04:42:20.290423 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1373/2758] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:42:20 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1544 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:42:20.299209 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1ff7f68d-0606-4311-a095-ee7de6c0f3ce tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:20.301752 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-1ff7f68d-0606-4311-a095-ee7de6c0f3ce tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] [instance: 5ee8a1da-f229-4716-bc67-da23f07963bd] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:20.318105 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1ff7f68d-0606-4311-a095-ee7de6c0f3ce tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:20.319008 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1ff7f68d-0606-4311-a095-ee7de6c0f3ce tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:20.319692 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1ff7f68d-0606-4311-a095-ee7de6c0f3ce tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:20.320974 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1ff7f68d-0606-4311-a095-ee7de6c0f3ce tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:20.323702 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1ff7f68d-0606-4311-a095-ee7de6c0f3ce tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:20.324557 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1ff7f68d-0606-4311-a095-ee7de6c0f3ce tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:20.788121 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-1ff7f68d-0606-4311-a095-ee7de6c0f3ce tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace08d8e105e46e299773c5a1b96039f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a16a53325a4d61aef94281435e9726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:20.801426 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-1ff7f68d-0606-4311-a095-ee7de6c0f3ce tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] 10.222.0.33 "GET /compute/v2.1/servers/5ee8a1da-f229-4716-bc67-da23f07963bd" status: 200 len: 1508 microversion: 2.1 time: 0.509516 Sep 23 04:42:20.802297 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1374/2759] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:42:20 2022] GET /compute/v2.1/servers/5ee8a1da-f229-4716-bc67-da23f07963bd => generated 1508 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:42:20.884195 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-aefe5732-0e9c-4de7-a624-de76d3fd8c80 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Flavor limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:42:20.885324 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-aefe5732-0e9c-4de7-a624-de76d3fd8c80 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Image limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:42:20.886764 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-aefe5732-0e9c-4de7-a624-de76d3fd8c80 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Flavor pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:42:20.887574 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-aefe5732-0e9c-4de7-a624-de76d3fd8c80 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Image pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:42:20.895690 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-aefe5732-0e9c-4de7-a624-de76d3fd8c80 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:42:20.923684 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aefe5732-0e9c-4de7-a624-de76d3fd8c80 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:20.928414 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aefe5732-0e9c-4de7-a624-de76d3fd8c80 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:20.929824 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aefe5732-0e9c-4de7-a624-de76d3fd8c80 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:20.931200 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aefe5732-0e9c-4de7-a624-de76d3fd8c80 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:20.932127 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aefe5732-0e9c-4de7-a624-de76d3fd8c80 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:20.933041 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aefe5732-0e9c-4de7-a624-de76d3fd8c80 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:20.962195 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-aefe5732-0e9c-4de7-a624-de76d3fd8c80 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Getting quotas for project fe698721372f40888dc2918c46e65f2f. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:42:20.972713 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-aefe5732-0e9c-4de7-a624-de76d3fd8c80 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Getting quotas for user 36526fe612c840fb907e1992d8e62538 and project fe698721372f40888dc2918c46e65f2f. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:42:20.993128 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-aefe5732-0e9c-4de7-a624-de76d3fd8c80 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Going to run 1 instances... {{(pid=122699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:42:21.000157 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-aefe5732-0e9c-4de7-a624-de76d3fd8c80 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 3c54457b-bab9-4a3e-bb6f-d0723dfbebf4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:42:21.197807 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-aefe5732-0e9c-4de7-a624-de76d3fd8c80 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.854116 Sep 23 04:42:21.208582 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1386/2760] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:42:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1868 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:42:21.211999 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-582c9742-cf64-4fee-acd7-1cc010f74c8d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:21.212720 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-582c9742-cf64-4fee-acd7-1cc010f74c8d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 3c54457b-bab9-4a3e-bb6f-d0723dfbebf4] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:21.322480 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-13f6d66e-06f5-41e6-8537-56801d2e8c38 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:21.325858 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-13f6d66e-06f5-41e6-8537-56801d2e8c38 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:21.345258 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-582c9742-cf64-4fee-acd7-1cc010f74c8d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:21.369713 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-582c9742-cf64-4fee-acd7-1cc010f74c8d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/3c54457b-bab9-4a3e-bb6f-d0723dfbebf4" status: 200 len: 1215 microversion: 2.1 time: 0.162023 Sep 23 04:42:21.378646 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1375/2761] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:42:21 2022] GET /compute/v2.1/servers/3c54457b-bab9-4a3e-bb6f-d0723dfbebf4 => generated 1215 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:42:21.380299 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-13f6d66e-06f5-41e6-8537-56801d2e8c38 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:21.383610 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-13f6d66e-06f5-41e6-8537-56801d2e8c38 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:21.387125 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-13f6d66e-06f5-41e6-8537-56801d2e8c38 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:21.391693 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-13f6d66e-06f5-41e6-8537-56801d2e8c38 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:21.392189 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-13f6d66e-06f5-41e6-8537-56801d2e8c38 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:21.395202 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-13f6d66e-06f5-41e6-8537-56801d2e8c38 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:21.627891 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-13f6d66e-06f5-41e6-8537-56801d2e8c38 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:21.642682 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-13f6d66e-06f5-41e6-8537-56801d2e8c38 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:21.645236 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-13f6d66e-06f5-41e6-8537-56801d2e8c38 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:21.657537 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-13f6d66e-06f5-41e6-8537-56801d2e8c38 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1544 microversion: 2.91 time: 0.340564 Sep 23 04:42:21.660260 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1387/2762] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:42:21 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1544 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:42:21.833774 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a95c9fc8-d7e4-4f11-b090-35eed52b4664 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:21.838777 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a95c9fc8-d7e4-4f11-b090-35eed52b4664 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] [instance: 5ee8a1da-f229-4716-bc67-da23f07963bd] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:21.867009 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a95c9fc8-d7e4-4f11-b090-35eed52b4664 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:21.871344 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a95c9fc8-d7e4-4f11-b090-35eed52b4664 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:21.872095 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a95c9fc8-d7e4-4f11-b090-35eed52b4664 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:21.875509 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a95c9fc8-d7e4-4f11-b090-35eed52b4664 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:21.879644 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a95c9fc8-d7e4-4f11-b090-35eed52b4664 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:21.880350 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a95c9fc8-d7e4-4f11-b090-35eed52b4664 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:22.403858 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-bfeacc77-464b-4322-84ec-10149e4d53e2 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:22.404477 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-bfeacc77-464b-4322-84ec-10149e4d53e2 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 3c54457b-bab9-4a3e-bb6f-d0723dfbebf4] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:22.621552 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-bfeacc77-464b-4322-84ec-10149e4d53e2 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:22.647752 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-bfeacc77-464b-4322-84ec-10149e4d53e2 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/3c54457b-bab9-4a3e-bb6f-d0723dfbebf4" status: 200 len: 1215 microversion: 2.1 time: 0.229504 Sep 23 04:42:22.647752 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1388/2763] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:42:22 2022] GET /compute/v2.1/servers/3c54457b-bab9-4a3e-bb6f-d0723dfbebf4 => generated 1215 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:42:22.669571 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a95c9fc8-d7e4-4f11-b090-35eed52b4664 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace08d8e105e46e299773c5a1b96039f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a16a53325a4d61aef94281435e9726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:22.685684 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a95c9fc8-d7e4-4f11-b090-35eed52b4664 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] 10.222.0.33 "GET /compute/v2.1/servers/5ee8a1da-f229-4716-bc67-da23f07963bd" status: 200 len: 1508 microversion: 2.1 time: 0.855662 Sep 23 04:42:22.686603 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1376/2764] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:42:21 2022] GET /compute/v2.1/servers/5ee8a1da-f229-4716-bc67-da23f07963bd => generated 1508 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:42:22.703217 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-60fc6b55-dc30-4c14-ac4b-f08cb5c020d7 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:22.704059 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-60fc6b55-dc30-4c14-ac4b-f08cb5c020d7 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:22.725447 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-60fc6b55-dc30-4c14-ac4b-f08cb5c020d7 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:22.729356 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-60fc6b55-dc30-4c14-ac4b-f08cb5c020d7 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:22.731192 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-60fc6b55-dc30-4c14-ac4b-f08cb5c020d7 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:22.734582 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-60fc6b55-dc30-4c14-ac4b-f08cb5c020d7 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:22.737333 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-60fc6b55-dc30-4c14-ac4b-f08cb5c020d7 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:22.738016 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-60fc6b55-dc30-4c14-ac4b-f08cb5c020d7 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:22.967155 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-60fc6b55-dc30-4c14-ac4b-f08cb5c020d7 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:22.984744 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-60fc6b55-dc30-4c14-ac4b-f08cb5c020d7 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:22.990036 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-60fc6b55-dc30-4c14-ac4b-f08cb5c020d7 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:23.026690 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-60fc6b55-dc30-4c14-ac4b-f08cb5c020d7 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1544 microversion: 2.91 time: 0.339675 Sep 23 04:42:23.030028 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1389/2765] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:42:22 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1544 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:42:23.716017 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-50d07177-df48-4fc5-8e73-1071f888fb88 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:23.717695 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-50d07177-df48-4fc5-8e73-1071f888fb88 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] [instance: 5ee8a1da-f229-4716-bc67-da23f07963bd] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:23.762076 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-50d07177-df48-4fc5-8e73-1071f888fb88 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:23.765825 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-50d07177-df48-4fc5-8e73-1071f888fb88 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:23.766528 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-50d07177-df48-4fc5-8e73-1071f888fb88 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:23.770847 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-50d07177-df48-4fc5-8e73-1071f888fb88 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:23.774195 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-50d07177-df48-4fc5-8e73-1071f888fb88 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:23.774859 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-50d07177-df48-4fc5-8e73-1071f888fb88 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:23.863698 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1ea218d6-f1b3-4206-af3e-dfdfb8a154c4 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:23.864983 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-1ea218d6-f1b3-4206-af3e-dfdfb8a154c4 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 3c54457b-bab9-4a3e-bb6f-d0723dfbebf4] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:23.872789 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1ea218d6-f1b3-4206-af3e-dfdfb8a154c4 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:23.873662 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1ea218d6-f1b3-4206-af3e-dfdfb8a154c4 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:23.874350 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1ea218d6-f1b3-4206-af3e-dfdfb8a154c4 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:23.876567 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1ea218d6-f1b3-4206-af3e-dfdfb8a154c4 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:23.877316 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1ea218d6-f1b3-4206-af3e-dfdfb8a154c4 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:23.880044 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1ea218d6-f1b3-4206-af3e-dfdfb8a154c4 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:24.109238 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-1ea218d6-f1b3-4206-af3e-dfdfb8a154c4 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:24.109238 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-1ea218d6-f1b3-4206-af3e-dfdfb8a154c4 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/3c54457b-bab9-4a3e-bb6f-d0723dfbebf4" status: 200 len: 1267 microversion: 2.1 time: 0.430757 Sep 23 04:42:24.109238 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1377/2766] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:42:23 2022] GET /compute/v2.1/servers/3c54457b-bab9-4a3e-bb6f-d0723dfbebf4 => generated 1267 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:42:24.109238 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-99145223-0b7b-487f-b99c-3d274574b02f tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:24.109238 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-99145223-0b7b-487f-b99c-3d274574b02f tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:24.109238 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-99145223-0b7b-487f-b99c-3d274574b02f tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:24.109238 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-99145223-0b7b-487f-b99c-3d274574b02f tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:24.109238 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-99145223-0b7b-487f-b99c-3d274574b02f tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:24.109238 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-99145223-0b7b-487f-b99c-3d274574b02f tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:24.109238 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-99145223-0b7b-487f-b99c-3d274574b02f tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:24.109238 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-99145223-0b7b-487f-b99c-3d274574b02f tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:24.109238 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:42:24.271263 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-99145223-0b7b-487f-b99c-3d274574b02f tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:24.286938 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-99145223-0b7b-487f-b99c-3d274574b02f tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:24.294578 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-99145223-0b7b-487f-b99c-3d274574b02f tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:24.312978 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-99145223-0b7b-487f-b99c-3d274574b02f tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1544 microversion: 2.91 time: 0.227422 Sep 23 04:42:24.314791 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1378/2767] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:42:24 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1544 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:42:24.336437 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-50d07177-df48-4fc5-8e73-1071f888fb88 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace08d8e105e46e299773c5a1b96039f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a16a53325a4d61aef94281435e9726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:24.371276 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-50d07177-df48-4fc5-8e73-1071f888fb88 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] 10.222.0.33 "GET /compute/v2.1/servers/5ee8a1da-f229-4716-bc67-da23f07963bd" status: 200 len: 1508 microversion: 2.1 time: 0.657036 Sep 23 04:42:24.388361 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1390/2768] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:42:23 2022] GET /compute/v2.1/servers/5ee8a1da-f229-4716-bc67-da23f07963bd => generated 1508 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:42:24.743977 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-13d6ce63-7691-4e8a-a6a6-5c3cfc359a98 req-5f815b76-7297-41a9-9e85-d004dc814504 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ee8a1da-f229-4716-bc67-da23f07963bd", "name": "network-vif-deleted", "tag": "f9285902-d382-442c-88b6-fad3f3a0ebcc"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:42:24.800843 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-13d6ce63-7691-4e8a-a6a6-5c3cfc359a98 req-5f815b76-7297-41a9-9e85-d004dc814504 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:24.801337 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-13d6ce63-7691-4e8a-a6a6-5c3cfc359a98 req-5f815b76-7297-41a9-9e85-d004dc814504 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:24.801772 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-13d6ce63-7691-4e8a-a6a6-5c3cfc359a98 req-5f815b76-7297-41a9-9e85-d004dc814504 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:24.856640 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-13d6ce63-7691-4e8a-a6a6-5c3cfc359a98 req-5f815b76-7297-41a9-9e85-d004dc814504 service nova] Creating event network-vif-deleted:f9285902-d382-442c-88b6-fad3f3a0ebcc for instance 5ee8a1da-f229-4716-bc67-da23f07963bd on n-h1-846463-3 Sep 23 04:42:24.887107 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-13d6ce63-7691-4e8a-a6a6-5c3cfc359a98 req-5f815b76-7297-41a9-9e85-d004dc814504 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147023 Sep 23 04:42:24.889817 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1379/2769] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:42:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:42:25.127865 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-626efe5d-ee32-47d5-915a-2ab7d8b3990d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:25.128498 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-626efe5d-ee32-47d5-915a-2ab7d8b3990d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 3c54457b-bab9-4a3e-bb6f-d0723dfbebf4] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:25.140734 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-626efe5d-ee32-47d5-915a-2ab7d8b3990d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:25.146126 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-626efe5d-ee32-47d5-915a-2ab7d8b3990d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:25.150365 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-626efe5d-ee32-47d5-915a-2ab7d8b3990d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:25.155505 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-626efe5d-ee32-47d5-915a-2ab7d8b3990d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:25.156229 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-626efe5d-ee32-47d5-915a-2ab7d8b3990d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:25.157981 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-626efe5d-ee32-47d5-915a-2ab7d8b3990d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:25.350220 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-76ab8bbd-0e91-4928-8eaf-ad5517b71785 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:25.352171 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-76ab8bbd-0e91-4928-8eaf-ad5517b71785 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:25.365167 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-76ab8bbd-0e91-4928-8eaf-ad5517b71785 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:25.373623 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-76ab8bbd-0e91-4928-8eaf-ad5517b71785 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:25.374424 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-76ab8bbd-0e91-4928-8eaf-ad5517b71785 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:25.375429 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-76ab8bbd-0e91-4928-8eaf-ad5517b71785 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:25.377447 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-76ab8bbd-0e91-4928-8eaf-ad5517b71785 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:25.378223 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-76ab8bbd-0e91-4928-8eaf-ad5517b71785 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:25.431303 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-626efe5d-ee32-47d5-915a-2ab7d8b3990d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:25.446265 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-626efe5d-ee32-47d5-915a-2ab7d8b3990d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/3c54457b-bab9-4a3e-bb6f-d0723dfbebf4" status: 200 len: 1275 microversion: 2.1 time: 0.322343 Sep 23 04:42:25.451340 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1391/2770] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:42:25 2022] GET /compute/v2.1/servers/3c54457b-bab9-4a3e-bb6f-d0723dfbebf4 => generated 1275 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:42:25.463583 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4d2c6a76-ffac-4a80-9d80-c521d6fb4ca0 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:25.480018 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4d2c6a76-ffac-4a80-9d80-c521d6fb4ca0 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] [instance: 5ee8a1da-f229-4716-bc67-da23f07963bd] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:25.490483 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4d2c6a76-ffac-4a80-9d80-c521d6fb4ca0 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:25.491301 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4d2c6a76-ffac-4a80-9d80-c521d6fb4ca0 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:25.492119 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4d2c6a76-ffac-4a80-9d80-c521d6fb4ca0 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:25.495945 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4d2c6a76-ffac-4a80-9d80-c521d6fb4ca0 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:25.496724 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4d2c6a76-ffac-4a80-9d80-c521d6fb4ca0 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:25.497408 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4d2c6a76-ffac-4a80-9d80-c521d6fb4ca0 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:25.580327 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-76ab8bbd-0e91-4928-8eaf-ad5517b71785 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:25.617131 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-76ab8bbd-0e91-4928-8eaf-ad5517b71785 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:25.618666 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-76ab8bbd-0e91-4928-8eaf-ad5517b71785 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:25.633163 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4d2c6a76-ffac-4a80-9d80-c521d6fb4ca0 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:25.635460 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4d2c6a76-ffac-4a80-9d80-c521d6fb4ca0 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:25.637721 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4d2c6a76-ffac-4a80-9d80-c521d6fb4ca0 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:25.639620 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-4d2c6a76-ffac-4a80-9d80-c521d6fb4ca0 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lazy-loading 'fault' on Instance uuid 5ee8a1da-f229-4716-bc67-da23f07963bd {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:42:25.647074 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-76ab8bbd-0e91-4928-8eaf-ad5517b71785 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1544 microversion: 2.91 time: 0.301649 Sep 23 04:42:25.678481 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1380/2771] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:42:25 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1544 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:42:26.019757 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-4d2c6a76-ffac-4a80-9d80-c521d6fb4ca0 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ace08d8e105e46e299773c5a1b96039f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a16a53325a4d61aef94281435e9726', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:26.031773 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4d2c6a76-ffac-4a80-9d80-c521d6fb4ca0 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] 10.222.0.33 "GET /compute/v2.1/servers/5ee8a1da-f229-4716-bc67-da23f07963bd" status: 200 len: 1312 microversion: 2.1 time: 0.578999 Sep 23 04:42:26.041436 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1392/2772] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:42:25 2022] GET /compute/v2.1/servers/5ee8a1da-f229-4716-bc67-da23f07963bd => generated 1312 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:42:26.474810 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-cb0704e1-e885-4723-ad84-be8eef1564f1 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Action: 'create', calling method: .version_select at 0x7ff1bb9091f0>, body: {"keypair": {"name": "tempest-keypair-1544762167", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOjkSVWon9K2tnhAWo5ArDT6xcJb+7CdP4PyHtr0vGlSYx13Qk0bMcLJOloXMgYBWl/cXOx4xEmQdGD2db4zQtDFTo9TY/Tz6MIn8H1Z71ddNVdYDW0KPpVUkCyzdg9+Vw=="}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:42:26.478360 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f9f4e9c4-c9ab-49a6-9ffb-be364b72da51 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:26.479474 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f9f4e9c4-c9ab-49a6-9ffb-be364b72da51 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 3c54457b-bab9-4a3e-bb6f-d0723dfbebf4] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:26.502832 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f9f4e9c4-c9ab-49a6-9ffb-be364b72da51 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:26.507804 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f9f4e9c4-c9ab-49a6-9ffb-be364b72da51 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:26.508545 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f9f4e9c4-c9ab-49a6-9ffb-be364b72da51 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:26.510734 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f9f4e9c4-c9ab-49a6-9ffb-be364b72da51 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:26.512514 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f9f4e9c4-c9ab-49a6-9ffb-be364b72da51 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:26.516083 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f9f4e9c4-c9ab-49a6-9ffb-be364b72da51 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:26.530608 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-cb0704e1-e885-4723-ad84-be8eef1564f1 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Getting quotas for project 2f0b7307c30a4c118da4c501691e349f. Resources: {'key_pairs'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:42:26.558935 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-cb0704e1-e885-4723-ad84-be8eef1564f1 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Getting quotas for user 5e235519204b4efc8b6c7e2988fab9b8 and project 2f0b7307c30a4c118da4c501691e349f. Resources: {'key_pairs'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:42:26.700505 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f9f4e9c4-c9ab-49a6-9ffb-be364b72da51 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:26.720985 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f9f4e9c4-c9ab-49a6-9ffb-be364b72da51 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/3c54457b-bab9-4a3e-bb6f-d0723dfbebf4" status: 200 len: 1273 microversion: 2.1 time: 0.246930 Sep 23 04:42:26.726914 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1393/2773] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:42:26 2022] GET /compute/v2.1/servers/3c54457b-bab9-4a3e-bb6f-d0723dfbebf4 => generated 1273 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:42:26.736257 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-cb0704e1-e885-4723-ad84-be8eef1564f1 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.513823 Sep 23 04:42:26.743762 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1381/2774] 10.222.0.33 () {60 vars in 1159 bytes} [Fri Sep 23 04:42:26 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:42:26.758104 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d9b490f7-6f10-438f-be49-48ae88243cc9 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:26.758104 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d9b490f7-6f10-438f-be49-48ae88243cc9 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:26.780177 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d9b490f7-6f10-438f-be49-48ae88243cc9 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:26.784813 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d9b490f7-6f10-438f-be49-48ae88243cc9 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:26.787312 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d9b490f7-6f10-438f-be49-48ae88243cc9 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:26.791826 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d9b490f7-6f10-438f-be49-48ae88243cc9 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:26.793609 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d9b490f7-6f10-438f-be49-48ae88243cc9 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:26.794180 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d9b490f7-6f10-438f-be49-48ae88243cc9 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:26.996708 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d9b490f7-6f10-438f-be49-48ae88243cc9 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:27.009780 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d9b490f7-6f10-438f-be49-48ae88243cc9 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:27.018204 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d9b490f7-6f10-438f-be49-48ae88243cc9 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:27.038125 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d9b490f7-6f10-438f-be49-48ae88243cc9 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1544 microversion: 2.91 time: 0.308884 Sep 23 04:42:27.040886 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1394/2775] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:42:26 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1544 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:42:27.072106 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7fd9758c-4b28-4e4a-9498-72773c5f7407 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:27.072885 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7fd9758c-4b28-4e4a-9498-72773c5f7407 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] [instance: 5ee8a1da-f229-4716-bc67-da23f07963bd] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:27.087600 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7fd9758c-4b28-4e4a-9498-72773c5f7407 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:27.090402 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7fd9758c-4b28-4e4a-9498-72773c5f7407 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:27.090964 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7fd9758c-4b28-4e4a-9498-72773c5f7407 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:27.094217 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7fd9758c-4b28-4e4a-9498-72773c5f7407 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:27.096956 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7fd9758c-4b28-4e4a-9498-72773c5f7407 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:27.097472 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7fd9758c-4b28-4e4a-9498-72773c5f7407 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:27.146168 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-7fd9758c-4b28-4e4a-9498-72773c5f7407 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] HTTP exception thrown: Instance 5ee8a1da-f229-4716-bc67-da23f07963bd could not be found. Sep 23 04:42:27.149586 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7fd9758c-4b28-4e4a-9498-72773c5f7407 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Request method failure captured: Sep 23 04:42:27.149586 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/5ee8a1da-f229-4716-bc67-da23f07963bd HTTP/1.1 Sep 23 04:42:27.149586 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:42:27.149586 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:42:27.149586 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:42:27.149586 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:42:27.149586 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:42:27.149586 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:42:27.149586 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:42:27.149586 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:42:27.149586 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTjTJ8sT8iec4LLvA9KqmpPMGY_uCuyO0qo8Y-LTWYpKPiPlMFSb2NBdJiT8IW5YKB2isvNEHsqAgFcnXoGx6JKEy-LkfD8QICy3YPhSkunybf2sEoFcZUO-CihC4pDVMQTz4Ag-UJSl0jXKjHL_W4UhKd2CQb8rPTrAKEimVdG5I7Y Sep 23 04:42:27.149586 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:42:27.149586 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:42:27.149586 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:42:27.149586 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:42:27.149586 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:42:27.149586 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:42:27.149586 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: f7a16a53325a4d61aef94281435e9726 Sep 23 04:42:27.149586 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-1536340135 Sep 23 04:42:27.149586 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:42:27.149586 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:42:27.149586 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f7a16a53325a4d61aef94281435e9726", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f7a16a53325a4d61aef94281435e9726"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f7a16a53325a4d61aef94281435e9726"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f7a16a53325a4d61aef94281435e9726"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:42:27.149586 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-1536340135 Sep 23 04:42:27.149586 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: f7a16a53325a4d61aef94281435e9726 Sep 23 04:42:27.149586 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-1536340135 Sep 23 04:42:27.149586 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ServerRescueTestJSONUnderV235-1536340135-project Sep 23 04:42:27.149586 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:42:27.149586 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:42:27.149586 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: ace08d8e105e46e299773c5a1b96039f Sep 23 04:42:27.149586 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-1536340135-project Sep 23 04:42:27.149586 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:42:27.149586 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 5ee8a1da-f229-4716-bc67-da23f07963bd could not be found. Sep 23 04:42:27.149586 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '5ee8a1da-f229-4716-bc67-da23f07963bd'} Sep 23 04:42:27.149586 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:42:27.149586 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:42:27.149586 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:42:27.149586 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:42:27.149586 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:42:27.149586 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:42:27.149586 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:42:27.149586 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:42:27.149586 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:42:27.149586 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:42:27.149586 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ee8a1da-f229-4716-bc67-da23f07963bd could not be found. Sep 23 04:42:27.149586 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:42:27.149586 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:42:27.149586 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:42:27.149586 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:42:27.149586 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:42:27.149586 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:42:27.149586 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:42:27.149586 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:42:27.149586 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:42:27.149586 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:42:27.149586 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:42:27.149586 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:42:27.149586 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:42:27.149586 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:42:27.149586 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:42:27.149586 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:42:27.149586 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ee8a1da-f229-4716-bc67-da23f07963bd could not be found. Sep 23 04:42:27.149586 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:42:27.149586 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:42:27.153667 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:42:27.153667 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:42:27.153667 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:42:27.153667 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:42:27.153667 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:42:27.153667 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:42:27.153667 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ee8a1da-f229-4716-bc67-da23f07963bd could not be found. Sep 23 04:42:27.153667 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:42:27.158800 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7fd9758c-4b28-4e4a-9498-72773c5f7407 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] Returning 404 to user: Instance 5ee8a1da-f229-4716-bc67-da23f07963bd could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:42:27.160533 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7fd9758c-4b28-4e4a-9498-72773c5f7407 tempest-ServerRescueTestJSONUnderV235-1536340135 tempest-ServerRescueTestJSONUnderV235-1536340135-project] 10.222.0.33 "GET /compute/v2.1/servers/5ee8a1da-f229-4716-bc67-da23f07963bd" status: 404 len: 111 microversion: 2.1 time: 0.093473 Sep 23 04:42:27.170159 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1382/2776] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:42:27 2022] GET /compute/v2.1/servers/5ee8a1da-f229-4716-bc67-da23f07963bd => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:42:27.752761 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a6f59be7-2d99-4606-ad88-5618d4eafebe tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:27.753455 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a6f59be7-2d99-4606-ad88-5618d4eafebe tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 3c54457b-bab9-4a3e-bb6f-d0723dfbebf4] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:27.771018 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a6f59be7-2d99-4606-ad88-5618d4eafebe tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:27.772081 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a6f59be7-2d99-4606-ad88-5618d4eafebe tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:27.772706 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a6f59be7-2d99-4606-ad88-5618d4eafebe tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:27.781153 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a6f59be7-2d99-4606-ad88-5618d4eafebe tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:27.782036 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a6f59be7-2d99-4606-ad88-5618d4eafebe tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:27.783281 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a6f59be7-2d99-4606-ad88-5618d4eafebe tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:28.076007 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d53e923a-8717-45dc-8fed-763b663266a1 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:28.076007 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d53e923a-8717-45dc-8fed-763b663266a1 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:28.086885 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d53e923a-8717-45dc-8fed-763b663266a1 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:28.087789 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d53e923a-8717-45dc-8fed-763b663266a1 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:28.087956 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d53e923a-8717-45dc-8fed-763b663266a1 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:28.090402 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d53e923a-8717-45dc-8fed-763b663266a1 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:28.093981 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d53e923a-8717-45dc-8fed-763b663266a1 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:28.094936 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d53e923a-8717-45dc-8fed-763b663266a1 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:28.384637 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d53e923a-8717-45dc-8fed-763b663266a1 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:28.404405 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d53e923a-8717-45dc-8fed-763b663266a1 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:28.406802 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d53e923a-8717-45dc-8fed-763b663266a1 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:28.431679 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d53e923a-8717-45dc-8fed-763b663266a1 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1544 microversion: 2.91 time: 0.362982 Sep 23 04:42:28.434084 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1383/2777] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:42:28 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1544 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:42:28.473984 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a6f59be7-2d99-4606-ad88-5618d4eafebe tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:28.487464 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a6f59be7-2d99-4606-ad88-5618d4eafebe tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/3c54457b-bab9-4a3e-bb6f-d0723dfbebf4" status: 200 len: 1315 microversion: 2.1 time: 0.739094 Sep 23 04:42:28.502284 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1395/2778] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:42:27 2022] GET /compute/v2.1/servers/3c54457b-bab9-4a3e-bb6f-d0723dfbebf4 => generated 1315 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:42:29.262700 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-08f75f8a-0798-4eb0-93a8-11ad553aad94 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:29.263258 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-08f75f8a-0798-4eb0-93a8-11ad553aad94 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] [instance: 4fe42fc2-8cfa-4571-9282-fa4a6fcd75c8] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:29.278644 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-08f75f8a-0798-4eb0-93a8-11ad553aad94 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:29.279517 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-08f75f8a-0798-4eb0-93a8-11ad553aad94 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:29.280202 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-08f75f8a-0798-4eb0-93a8-11ad553aad94 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:29.281202 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-08f75f8a-0798-4eb0-93a8-11ad553aad94 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:29.282045 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-08f75f8a-0798-4eb0-93a8-11ad553aad94 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:29.286267 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-08f75f8a-0798-4eb0-93a8-11ad553aad94 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:29.340261 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-08f75f8a-0798-4eb0-93a8-11ad553aad94 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] [instance: 4fe42fc2-8cfa-4571-9282-fa4a6fcd75c8] Going to try to terminate instance {{(pid=122698) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:42:29.386431 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-904db7e5-82fd-4cdf-939c-32ed36336548 req-c1a90bf9-32aa-4daf-8492-d9bca92cdbfc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c54457b-bab9-4a3e-bb6f-d0723dfbebf4", "tag": "50746c1a-5edd-4880-85e5-6ef1b5511e58"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:42:29.408541 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-904db7e5-82fd-4cdf-939c-32ed36336548 req-c1a90bf9-32aa-4daf-8492-d9bca92cdbfc service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:29.411595 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-904db7e5-82fd-4cdf-939c-32ed36336548 req-c1a90bf9-32aa-4daf-8492-d9bca92cdbfc service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:29.413139 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-904db7e5-82fd-4cdf-939c-32ed36336548 req-c1a90bf9-32aa-4daf-8492-d9bca92cdbfc service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:29.438935 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-904db7e5-82fd-4cdf-939c-32ed36336548 req-c1a90bf9-32aa-4daf-8492-d9bca92cdbfc service nova] Creating event network-changed:50746c1a-5edd-4880-85e5-6ef1b5511e58 for instance 3c54457b-bab9-4a3e-bb6f-d0723dfbebf4 on n-h2-846463-3 Sep 23 04:42:29.446649 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-904db7e5-82fd-4cdf-939c-32ed36336548 req-c1a90bf9-32aa-4daf-8492-d9bca92cdbfc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063909 Sep 23 04:42:29.447957 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1396/2779] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:42:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:42:29.469052 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9b5b71f3-c042-40e6-8597-54304a76c4a3 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:29.473903 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-9b5b71f3-c042-40e6-8597-54304a76c4a3 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:29.504802 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9b5b71f3-c042-40e6-8597-54304a76c4a3 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:29.506072 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9b5b71f3-c042-40e6-8597-54304a76c4a3 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:29.507096 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9b5b71f3-c042-40e6-8597-54304a76c4a3 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:29.508399 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9b5b71f3-c042-40e6-8597-54304a76c4a3 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:29.509136 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9b5b71f3-c042-40e6-8597-54304a76c4a3 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:29.510006 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9b5b71f3-c042-40e6-8597-54304a76c4a3 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:29.541028 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:42:29.759205 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-9b5b71f3-c042-40e6-8597-54304a76c4a3 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:29.774838 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-9b5b71f3-c042-40e6-8597-54304a76c4a3 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:29.776578 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-9b5b71f3-c042-40e6-8597-54304a76c4a3 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:29.789580 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-9b5b71f3-c042-40e6-8597-54304a76c4a3 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1544 microversion: 2.91 time: 0.325191 Sep 23 04:42:29.793357 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1397/2780] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:42:29 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1544 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:42:29.800700 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-571138a4-d8fa-4698-b11f-ffe515766584 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:29.803290 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-571138a4-d8fa-4698-b11f-ffe515766584 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 3c54457b-bab9-4a3e-bb6f-d0723dfbebf4] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:29.822471 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-571138a4-d8fa-4698-b11f-ffe515766584 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:29.824215 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-571138a4-d8fa-4698-b11f-ffe515766584 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:29.825462 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-571138a4-d8fa-4698-b11f-ffe515766584 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:29.826512 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-571138a4-d8fa-4698-b11f-ffe515766584 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:29.830381 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-571138a4-d8fa-4698-b11f-ffe515766584 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:29.831062 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-571138a4-d8fa-4698-b11f-ffe515766584 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:29.850340 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-08f75f8a-0798-4eb0-93a8-11ad553aad94 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4fe42fc2-8cfa-4571-9282-fa4a6fcd75c8" status: 204 len: 0 microversion: 2.1 time: 0.592041 Sep 23 04:42:29.851925 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1384/2781] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:42:29 2022] DELETE /compute/v2.1/servers/4fe42fc2-8cfa-4571-9282-fa4a6fcd75c8 => generated 0 bytes in 596 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:42:29.861206 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-598a7446-767c-4426-8c4e-37e9f595ef8f tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:29.864399 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-598a7446-767c-4426-8c4e-37e9f595ef8f tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] [instance: 4fe42fc2-8cfa-4571-9282-fa4a6fcd75c8] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:29.901085 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-598a7446-767c-4426-8c4e-37e9f595ef8f tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:29.907991 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-598a7446-767c-4426-8c4e-37e9f595ef8f tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:29.907991 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-598a7446-767c-4426-8c4e-37e9f595ef8f tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:29.911036 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-598a7446-767c-4426-8c4e-37e9f595ef8f tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:29.914639 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-598a7446-767c-4426-8c4e-37e9f595ef8f tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:29.915354 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-598a7446-767c-4426-8c4e-37e9f595ef8f tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:30.353447 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-598a7446-767c-4426-8c4e-37e9f595ef8f tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6ade7cab39345e29e7ee7a977bc80f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56a38177bdb4624b9abe512ae98266b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:30.364114 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-598a7446-767c-4426-8c4e-37e9f595ef8f tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] 10.222.0.33 "GET /compute/v2.1/servers/4fe42fc2-8cfa-4571-9282-fa4a6fcd75c8" status: 200 len: 1663 microversion: 2.1 time: 0.507835 Sep 23 04:42:30.365584 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1385/2782] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:42:29 2022] GET /compute/v2.1/servers/4fe42fc2-8cfa-4571-9282-fa4a6fcd75c8 => generated 1663 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:42:30.432340 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-571138a4-d8fa-4698-b11f-ffe515766584 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:30.446711 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-571138a4-d8fa-4698-b11f-ffe515766584 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/3c54457b-bab9-4a3e-bb6f-d0723dfbebf4" status: 200 len: 1315 microversion: 2.1 time: 0.654731 Sep 23 04:42:30.450552 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1398/2783] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:42:29 2022] GET /compute/v2.1/servers/3c54457b-bab9-4a3e-bb6f-d0723dfbebf4 => generated 1315 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:42:30.824231 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-903f5192-673d-44f3-afbb-a998c158eee8 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:30.824958 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-903f5192-673d-44f3-afbb-a998c158eee8 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:30.861465 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-903f5192-673d-44f3-afbb-a998c158eee8 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:30.862004 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-903f5192-673d-44f3-afbb-a998c158eee8 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:30.865908 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-903f5192-673d-44f3-afbb-a998c158eee8 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:30.868764 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-903f5192-673d-44f3-afbb-a998c158eee8 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:30.869569 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-903f5192-673d-44f3-afbb-a998c158eee8 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:30.872443 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-903f5192-673d-44f3-afbb-a998c158eee8 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:31.081825 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-903f5192-673d-44f3-afbb-a998c158eee8 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:31.095315 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-903f5192-673d-44f3-afbb-a998c158eee8 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:31.099941 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-903f5192-673d-44f3-afbb-a998c158eee8 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:31.119100 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-903f5192-673d-44f3-afbb-a998c158eee8 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1544 microversion: 2.91 time: 0.301193 Sep 23 04:42:31.128872 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1386/2784] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:42:30 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1544 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:42:31.393485 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-113835ce-c672-4751-aa4f-9243f687274a tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:31.394810 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-113835ce-c672-4751-aa4f-9243f687274a tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] [instance: 4fe42fc2-8cfa-4571-9282-fa4a6fcd75c8] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:31.400787 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:42:31.418590 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-113835ce-c672-4751-aa4f-9243f687274a tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:31.418590 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-113835ce-c672-4751-aa4f-9243f687274a tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:31.418590 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-113835ce-c672-4751-aa4f-9243f687274a tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:31.422376 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-113835ce-c672-4751-aa4f-9243f687274a tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:31.426231 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-113835ce-c672-4751-aa4f-9243f687274a tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:31.426907 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-113835ce-c672-4751-aa4f-9243f687274a tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:31.475990 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f517606c-bdb8-4858-bf94-8ca48af17dca tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:31.480183 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f517606c-bdb8-4858-bf94-8ca48af17dca tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 3c54457b-bab9-4a3e-bb6f-d0723dfbebf4] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:31.504654 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f517606c-bdb8-4858-bf94-8ca48af17dca tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:31.505863 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f517606c-bdb8-4858-bf94-8ca48af17dca tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:31.506975 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f517606c-bdb8-4858-bf94-8ca48af17dca tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:31.508562 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f517606c-bdb8-4858-bf94-8ca48af17dca tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:31.509217 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f517606c-bdb8-4858-bf94-8ca48af17dca tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:31.510706 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f517606c-bdb8-4858-bf94-8ca48af17dca tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:32.261020 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-113835ce-c672-4751-aa4f-9243f687274a tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6ade7cab39345e29e7ee7a977bc80f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56a38177bdb4624b9abe512ae98266b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:32.271687 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-113835ce-c672-4751-aa4f-9243f687274a tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] 10.222.0.33 "GET /compute/v2.1/servers/4fe42fc2-8cfa-4571-9282-fa4a6fcd75c8" status: 200 len: 1663 microversion: 2.1 time: 0.882867 Sep 23 04:42:32.274810 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1399/2785] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:42:31 2022] GET /compute/v2.1/servers/4fe42fc2-8cfa-4571-9282-fa4a6fcd75c8 => generated 1663 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:42:32.307219 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-081777e8-007f-446b-ae0f-43237246ab97 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:32.308316 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-081777e8-007f-446b-ae0f-43237246ab97 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:32.336187 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-081777e8-007f-446b-ae0f-43237246ab97 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:32.336674 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-081777e8-007f-446b-ae0f-43237246ab97 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:32.337118 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-081777e8-007f-446b-ae0f-43237246ab97 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:32.352671 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-081777e8-007f-446b-ae0f-43237246ab97 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:32.353408 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-081777e8-007f-446b-ae0f-43237246ab97 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:32.360047 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-081777e8-007f-446b-ae0f-43237246ab97 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:32.543507 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f517606c-bdb8-4858-bf94-8ca48af17dca tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:32.563717 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f517606c-bdb8-4858-bf94-8ca48af17dca tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/3c54457b-bab9-4a3e-bb6f-d0723dfbebf4" status: 200 len: 1315 microversion: 2.1 time: 1.092144 Sep 23 04:42:32.564987 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1387/2786] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:42:31 2022] GET /compute/v2.1/servers/3c54457b-bab9-4a3e-bb6f-d0723dfbebf4 => generated 1315 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:42:32.569126 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-081777e8-007f-446b-ae0f-43237246ab97 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:32.578546 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-081777e8-007f-446b-ae0f-43237246ab97 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:32.582676 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-081777e8-007f-446b-ae0f-43237246ab97 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:32.591045 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-081777e8-007f-446b-ae0f-43237246ab97 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1544 microversion: 2.91 time: 0.314951 Sep 23 04:42:32.591890 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1400/2787] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:42:32 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1544 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:42:33.302958 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5405d2d6-210e-4cc7-b423-10f3eadb6043 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:33.304585 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5405d2d6-210e-4cc7-b423-10f3eadb6043 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] [instance: 4fe42fc2-8cfa-4571-9282-fa4a6fcd75c8] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:33.316489 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5405d2d6-210e-4cc7-b423-10f3eadb6043 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:33.318887 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5405d2d6-210e-4cc7-b423-10f3eadb6043 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:33.320604 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5405d2d6-210e-4cc7-b423-10f3eadb6043 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:33.322730 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5405d2d6-210e-4cc7-b423-10f3eadb6043 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:33.323423 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5405d2d6-210e-4cc7-b423-10f3eadb6043 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:33.324104 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5405d2d6-210e-4cc7-b423-10f3eadb6043 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:33.499989 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-5405d2d6-210e-4cc7-b423-10f3eadb6043 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6ade7cab39345e29e7ee7a977bc80f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56a38177bdb4624b9abe512ae98266b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:33.520226 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5405d2d6-210e-4cc7-b423-10f3eadb6043 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] 10.222.0.33 "GET /compute/v2.1/servers/4fe42fc2-8cfa-4571-9282-fa4a6fcd75c8" status: 200 len: 1596 microversion: 2.1 time: 0.221532 Sep 23 04:42:33.523962 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1388/2788] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:42:33 2022] GET /compute/v2.1/servers/4fe42fc2-8cfa-4571-9282-fa4a6fcd75c8 => generated 1596 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:42:33.586993 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-073f2679-c757-41d3-aac5-67b3c5588e1d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:33.587614 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-073f2679-c757-41d3-aac5-67b3c5588e1d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 3c54457b-bab9-4a3e-bb6f-d0723dfbebf4] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:33.590536 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=8 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:42:33.601603 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-073f2679-c757-41d3-aac5-67b3c5588e1d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:33.602159 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-073f2679-c757-41d3-aac5-67b3c5588e1d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:33.602618 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-073f2679-c757-41d3-aac5-67b3c5588e1d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:33.605190 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-073f2679-c757-41d3-aac5-67b3c5588e1d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:33.605190 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-073f2679-c757-41d3-aac5-67b3c5588e1d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:33.605190 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-073f2679-c757-41d3-aac5-67b3c5588e1d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:33.627689 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5fc77796-8f96-43e7-8a2c-da5a6a61ce98 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:33.628321 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5fc77796-8f96-43e7-8a2c-da5a6a61ce98 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:33.644469 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5fc77796-8f96-43e7-8a2c-da5a6a61ce98 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:33.644987 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5fc77796-8f96-43e7-8a2c-da5a6a61ce98 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:33.647345 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5fc77796-8f96-43e7-8a2c-da5a6a61ce98 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:33.647345 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5fc77796-8f96-43e7-8a2c-da5a6a61ce98 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:33.647345 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5fc77796-8f96-43e7-8a2c-da5a6a61ce98 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:33.647345 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5fc77796-8f96-43e7-8a2c-da5a6a61ce98 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:33.856016 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-5fc77796-8f96-43e7-8a2c-da5a6a61ce98 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:33.873371 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-5fc77796-8f96-43e7-8a2c-da5a6a61ce98 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:33.881432 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-5fc77796-8f96-43e7-8a2c-da5a6a61ce98 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:33.895514 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5fc77796-8f96-43e7-8a2c-da5a6a61ce98 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1544 microversion: 2.91 time: 0.269522 Sep 23 04:42:33.914979 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1389/2789] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:42:33 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1544 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:42:33.930874 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-b1b440c7-b8b3-4d85-a3fe-b8dd60b4d88c req-0bdc4c44-29d4-4d38-abd7-702e39cefa87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fe42fc2-8cfa-4571-9282-fa4a6fcd75c8", "name": "network-vif-deleted", "tag": "9beb8450-2cd0-4018-9daa-49a22c787feb"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:42:33.955899 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-b1b440c7-b8b3-4d85-a3fe-b8dd60b4d88c req-0bdc4c44-29d4-4d38-abd7-702e39cefa87 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:33.957509 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-b1b440c7-b8b3-4d85-a3fe-b8dd60b4d88c req-0bdc4c44-29d4-4d38-abd7-702e39cefa87 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:33.958274 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-b1b440c7-b8b3-4d85-a3fe-b8dd60b4d88c req-0bdc4c44-29d4-4d38-abd7-702e39cefa87 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:33.974813 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-b1b440c7-b8b3-4d85-a3fe-b8dd60b4d88c req-0bdc4c44-29d4-4d38-abd7-702e39cefa87 service nova] Creating event network-vif-deleted:9beb8450-2cd0-4018-9daa-49a22c787feb for instance 4fe42fc2-8cfa-4571-9282-fa4a6fcd75c8 on n-h1-846463-3 Sep 23 04:42:33.983394 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-b1b440c7-b8b3-4d85-a3fe-b8dd60b4d88c req-0bdc4c44-29d4-4d38-abd7-702e39cefa87 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056377 Sep 23 04:42:33.986225 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1390/2790] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:42:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:42:34.039618 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2735edba-b00e-4505-8f69-fff4c62ede25 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1447083857", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "networks": [{"uuid": "5179b17b-de1d-4853-b1fd-563abc0651ec"}], "security_groups": [{"name": "tempest-securitygroup--608511024"}], "key_name": "tempest-keypair-1544762167", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:42:34.241595 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-073f2679-c757-41d3-aac5-67b3c5588e1d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:34.261732 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-073f2679-c757-41d3-aac5-67b3c5588e1d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/3c54457b-bab9-4a3e-bb6f-d0723dfbebf4" status: 200 len: 1315 microversion: 2.1 time: 0.678684 Sep 23 04:42:34.262770 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1401/2791] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:42:33 2022] GET /compute/v2.1/servers/3c54457b-bab9-4a3e-bb6f-d0723dfbebf4 => generated 1315 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:42:34.342240 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.network.neutron [None req-2735edba-b00e-4505-8f69-fff4c62ede25 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] validate_networks() for [('5179b17b-de1d-4853-b1fd-563abc0651ec', None, None, None, None, None)] {{(pid=122698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:42:34.550748 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-34c044e1-d91b-4cb9-b768-b8c023e081d5 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:34.551630 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-34c044e1-d91b-4cb9-b768-b8c023e081d5 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] [instance: 4fe42fc2-8cfa-4571-9282-fa4a6fcd75c8] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:34.560197 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-34c044e1-d91b-4cb9-b768-b8c023e081d5 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:34.560806 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-34c044e1-d91b-4cb9-b768-b8c023e081d5 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:34.561613 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-34c044e1-d91b-4cb9-b768-b8c023e081d5 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:34.562450 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-34c044e1-d91b-4cb9-b768-b8c023e081d5 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:34.562989 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-34c044e1-d91b-4cb9-b768-b8c023e081d5 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:34.564678 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-34c044e1-d91b-4cb9-b768-b8c023e081d5 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:34.599171 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-34c044e1-d91b-4cb9-b768-b8c023e081d5 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:34.600421 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-34c044e1-d91b-4cb9-b768-b8c023e081d5 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:34.601110 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-34c044e1-d91b-4cb9-b768-b8c023e081d5 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:34.601772 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-34c044e1-d91b-4cb9-b768-b8c023e081d5 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Lazy-loading 'fault' on Instance uuid 4fe42fc2-8cfa-4571-9282-fa4a6fcd75c8 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:42:34.748168 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-34c044e1-d91b-4cb9-b768-b8c023e081d5 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6ade7cab39345e29e7ee7a977bc80f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd56a38177bdb4624b9abe512ae98266b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:34.762385 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-34c044e1-d91b-4cb9-b768-b8c023e081d5 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] 10.222.0.33 "GET /compute/v2.1/servers/4fe42fc2-8cfa-4571-9282-fa4a6fcd75c8" status: 200 len: 1315 microversion: 2.1 time: 0.212870 Sep 23 04:42:34.778874 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1402/2792] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:42:34 2022] GET /compute/v2.1/servers/4fe42fc2-8cfa-4571-9282-fa4a6fcd75c8 => generated 1315 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:42:34.935722 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0134cad3-22af-4c0d-a282-21f5cc107827 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:34.936958 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-0134cad3-22af-4c0d-a282-21f5cc107827 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:34.944142 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0134cad3-22af-4c0d-a282-21f5cc107827 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:34.944786 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0134cad3-22af-4c0d-a282-21f5cc107827 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:34.945400 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0134cad3-22af-4c0d-a282-21f5cc107827 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:34.946535 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0134cad3-22af-4c0d-a282-21f5cc107827 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:34.947351 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0134cad3-22af-4c0d-a282-21f5cc107827 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:34.947922 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0134cad3-22af-4c0d-a282-21f5cc107827 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:35.070524 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-0134cad3-22af-4c0d-a282-21f5cc107827 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:35.096712 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-0134cad3-22af-4c0d-a282-21f5cc107827 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:35.102359 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-0134cad3-22af-4c0d-a282-21f5cc107827 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:35.120335 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0134cad3-22af-4c0d-a282-21f5cc107827 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1544 microversion: 2.91 time: 0.191281 Sep 23 04:42:35.122457 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1403/2793] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:42:34 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1544 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:42:35.289406 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9d12db63-177f-4de9-a187-c6dd472b6f0a tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:35.290472 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-9d12db63-177f-4de9-a187-c6dd472b6f0a tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 3c54457b-bab9-4a3e-bb6f-d0723dfbebf4] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:35.334297 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9d12db63-177f-4de9-a187-c6dd472b6f0a tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:35.336310 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9d12db63-177f-4de9-a187-c6dd472b6f0a tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:35.336758 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9d12db63-177f-4de9-a187-c6dd472b6f0a tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:35.338783 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9d12db63-177f-4de9-a187-c6dd472b6f0a tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:35.347432 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9d12db63-177f-4de9-a187-c6dd472b6f0a tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:35.347432 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9d12db63-177f-4de9-a187-c6dd472b6f0a tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:36.124135 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-2735edba-b00e-4505-8f69-fff4c62ede25 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Flavor limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:42:36.124612 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-2735edba-b00e-4505-8f69-fff4c62ede25 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Image limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:42:36.125020 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-2735edba-b00e-4505-8f69-fff4c62ede25 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Flavor pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:42:36.125430 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-2735edba-b00e-4505-8f69-fff4c62ede25 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Image pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:42:36.125839 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-2735edba-b00e-4505-8f69-fff4c62ede25 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:42:36.135762 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2735edba-b00e-4505-8f69-fff4c62ede25 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:36.136172 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2735edba-b00e-4505-8f69-fff4c62ede25 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:36.136610 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2735edba-b00e-4505-8f69-fff4c62ede25 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:36.137338 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2735edba-b00e-4505-8f69-fff4c62ede25 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:36.137797 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2735edba-b00e-4505-8f69-fff4c62ede25 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:36.138275 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2735edba-b00e-4505-8f69-fff4c62ede25 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:36.146984 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-9d12db63-177f-4de9-a187-c6dd472b6f0a tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:36.155868 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-9d12db63-177f-4de9-a187-c6dd472b6f0a tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/3c54457b-bab9-4a3e-bb6f-d0723dfbebf4" status: 200 len: 1315 microversion: 2.1 time: 0.873222 Sep 23 04:42:36.159457 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-2735edba-b00e-4505-8f69-fff4c62ede25 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Getting quotas for project 2f0b7307c30a4c118da4c501691e349f. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:42:36.166021 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-2735edba-b00e-4505-8f69-fff4c62ede25 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Getting quotas for user 5e235519204b4efc8b6c7e2988fab9b8 and project 2f0b7307c30a4c118da4c501691e349f. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:42:36.170525 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1404/2794] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:42:35 2022] GET /compute/v2.1/servers/3c54457b-bab9-4a3e-bb6f-d0723dfbebf4 => generated 1315 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:42:36.176259 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4b8e6d78-38bd-4b31-a8ef-a9c6386ef070 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:36.177078 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4b8e6d78-38bd-4b31-a8ef-a9c6386ef070 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] [instance: 4fe42fc2-8cfa-4571-9282-fa4a6fcd75c8] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:36.182987 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-2735edba-b00e-4505-8f69-fff4c62ede25 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Going to run 1 instances... {{(pid=122698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:42:36.185449 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-2735edba-b00e-4505-8f69-fff4c62ede25 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] [instance: 48df7db9-a805-4c72-a1a5-29632b00248c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:42:36.189054 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4b8e6d78-38bd-4b31-a8ef-a9c6386ef070 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:36.190504 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4b8e6d78-38bd-4b31-a8ef-a9c6386ef070 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:36.191207 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4b8e6d78-38bd-4b31-a8ef-a9c6386ef070 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:36.192177 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4b8e6d78-38bd-4b31-a8ef-a9c6386ef070 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:36.193199 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4b8e6d78-38bd-4b31-a8ef-a9c6386ef070 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:36.193860 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4b8e6d78-38bd-4b31-a8ef-a9c6386ef070 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:36.216817 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-4b8e6d78-38bd-4b31-a8ef-a9c6386ef070 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] HTTP exception thrown: Instance 4fe42fc2-8cfa-4571-9282-fa4a6fcd75c8 could not be found. Sep 23 04:42:36.218557 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4b8e6d78-38bd-4b31-a8ef-a9c6386ef070 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Request method failure captured: Sep 23 04:42:36.218557 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/4fe42fc2-8cfa-4571-9282-fa4a6fcd75c8 HTTP/1.1 Sep 23 04:42:36.218557 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:42:36.218557 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:42:36.218557 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:42:36.218557 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:42:36.218557 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:42:36.218557 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:42:36.218557 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:42:36.218557 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:42:36.218557 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTj55I3EnUu3xkn8Km_tduxnT86PXqwFJq77pNjHkI_AISfuqINbqVlq0g0kt5LO5-PMPHkSx_rYuIuw8ninmkcxUVaWXaVXqOY99oTKkuAsf31TzhUlIhXVCjgidPTTQ-ta35rzBJN4gvI8mLd2JDmieyMVloXGA6zLp0iTd-dmHzg Sep 23 04:42:36.218557 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:42:36.218557 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:42:36.218557 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:42:36.218557 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:42:36.218557 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:42:36.218557 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:42:36.218557 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: d56a38177bdb4624b9abe512ae98266b Sep 23 04:42:36.218557 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ServersTestFqdnHostnames-1890911975 Sep 23 04:42:36.218557 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:42:36.218557 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:42:36.218557 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d56a38177bdb4624b9abe512ae98266b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d56a38177bdb4624b9abe512ae98266b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d56a38177bdb4624b9abe512ae98266b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d56a38177bdb4624b9abe512ae98266b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:42:36.218557 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ServersTestFqdnHostnames-1890911975 Sep 23 04:42:36.218557 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: d56a38177bdb4624b9abe512ae98266b Sep 23 04:42:36.218557 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-1890911975 Sep 23 04:42:36.218557 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ServersTestFqdnHostnames-1890911975-project Sep 23 04:42:36.218557 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:42:36.218557 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:42:36.218557 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: e6ade7cab39345e29e7ee7a977bc80f8 Sep 23 04:42:36.218557 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ServersTestFqdnHostnames-1890911975-project Sep 23 04:42:36.218557 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:42:36.218557 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 4fe42fc2-8cfa-4571-9282-fa4a6fcd75c8 could not be found. Sep 23 04:42:36.218557 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '4fe42fc2-8cfa-4571-9282-fa4a6fcd75c8'} Sep 23 04:42:36.218557 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:42:36.218557 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:42:36.218557 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:42:36.218557 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:42:36.218557 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:42:36.218557 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:42:36.218557 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:42:36.218557 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:42:36.218557 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:42:36.218557 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:42:36.218557 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fe42fc2-8cfa-4571-9282-fa4a6fcd75c8 could not be found. Sep 23 04:42:36.218557 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:42:36.218557 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:42:36.218557 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:42:36.218557 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:42:36.218557 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:42:36.218557 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:42:36.218557 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:42:36.218557 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:42:36.218557 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:42:36.218557 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:42:36.218557 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:42:36.218557 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:42:36.218557 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:42:36.218557 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:42:36.218557 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:42:36.218557 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:42:36.218557 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fe42fc2-8cfa-4571-9282-fa4a6fcd75c8 could not be found. Sep 23 04:42:36.218557 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:42:36.218557 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:42:36.218557 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:42:36.225038 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:42:36.225038 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:42:36.225038 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:42:36.225038 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:42:36.225038 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:42:36.225038 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fe42fc2-8cfa-4571-9282-fa4a6fcd75c8 could not be found. Sep 23 04:42:36.225038 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:42:36.225038 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4b8e6d78-38bd-4b31-a8ef-a9c6386ef070 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Returning 404 to user: Instance 4fe42fc2-8cfa-4571-9282-fa4a6fcd75c8 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:42:36.225038 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4b8e6d78-38bd-4b31-a8ef-a9c6386ef070 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] 10.222.0.33 "GET /compute/v2.1/servers/4fe42fc2-8cfa-4571-9282-fa4a6fcd75c8" status: 404 len: 111 microversion: 2.1 time: 0.048627 Sep 23 04:42:36.225038 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1405/2795] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:42:36 2022] GET /compute/v2.1/servers/4fe42fc2-8cfa-4571-9282-fa4a6fcd75c8 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:42:36.226312 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-eb7e0414-42e9-4951-be62-bf2c70989db5 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:36.227917 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-eb7e0414-42e9-4951-be62-bf2c70989db5 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] [instance: dfb8f504-218a-471c-b7a8-70c498769f0e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:36.234304 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eb7e0414-42e9-4951-be62-bf2c70989db5 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:36.234807 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eb7e0414-42e9-4951-be62-bf2c70989db5 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:36.235276 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eb7e0414-42e9-4951-be62-bf2c70989db5 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:36.235975 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eb7e0414-42e9-4951-be62-bf2c70989db5 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:36.236440 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eb7e0414-42e9-4951-be62-bf2c70989db5 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:36.236876 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eb7e0414-42e9-4951-be62-bf2c70989db5 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:36.273353 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-eb7e0414-42e9-4951-be62-bf2c70989db5 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] 10.222.0.33 "GET /compute/v2.1/servers/dfb8f504-218a-471c-b7a8-70c498769f0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051768 Sep 23 04:42:36.273986 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1406/2796] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Sep 23 04:42:36 2022] GET /compute/v2.1/servers/dfb8f504-218a-471c-b7a8-70c498769f0e/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:42:36.284279 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5c1467b5-bfa2-4845-8e39-a0a069afa683 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:36.284901 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-5c1467b5-bfa2-4845-8e39-a0a069afa683 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:36.291064 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5c1467b5-bfa2-4845-8e39-a0a069afa683 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:36.291566 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5c1467b5-bfa2-4845-8e39-a0a069afa683 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:36.292013 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5c1467b5-bfa2-4845-8e39-a0a069afa683 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:36.292962 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5c1467b5-bfa2-4845-8e39-a0a069afa683 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:36.293430 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5c1467b5-bfa2-4845-8e39-a0a069afa683 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:36.293863 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5c1467b5-bfa2-4845-8e39-a0a069afa683 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:36.383589 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2735edba-b00e-4505-8f69-fff4c62ede25 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.354112 Sep 23 04:42:36.390758 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-5c1467b5-bfa2-4845-8e39-a0a069afa683 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:36.390936 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1391/2797] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:42:34 2022] POST /compute/v2.1/servers => generated 405 bytes in 2356 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:42:36.390936 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f4e36f9c-7d7b-4682-acf7-5797a1ececd2 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] Calling method '.version_select at 0x7ff1bbf61700>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:36.407636 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-5c1467b5-bfa2-4845-8e39-a0a069afa683 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:36.411304 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-5c1467b5-bfa2-4845-8e39-a0a069afa683 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:36.417713 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:42:36.420259 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5c1467b5-bfa2-4845-8e39-a0a069afa683 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1544 microversion: 2.91 time: 0.139834 Sep 23 04:42:36.445945 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1407/2798] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:42:36 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1544 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:42:36.449044 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-52cbbca7-da5d-42aa-8deb-9eef5d554b42 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:36.450020 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-52cbbca7-da5d-42aa-8deb-9eef5d554b42 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] [instance: dfb8f504-218a-471c-b7a8-70c498769f0e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:36.457177 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-52cbbca7-da5d-42aa-8deb-9eef5d554b42 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:36.457767 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-52cbbca7-da5d-42aa-8deb-9eef5d554b42 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:36.458567 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-52cbbca7-da5d-42aa-8deb-9eef5d554b42 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:36.459099 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-52cbbca7-da5d-42aa-8deb-9eef5d554b42 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:36.459749 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-52cbbca7-da5d-42aa-8deb-9eef5d554b42 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:36.460644 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-52cbbca7-da5d-42aa-8deb-9eef5d554b42 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:36.489046 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f4e36f9c-7d7b-4682-acf7-5797a1ececd2 tempest-ServersTestFqdnHostnames-1890911975 tempest-ServersTestFqdnHostnames-1890911975-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-396311470" status: 202 len: 0 microversion: 2.1 time: 0.103026 Sep 23 04:42:36.494524 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1392/2799] 10.222.0.33 () {58 vars in 1218 bytes} [Fri Sep 23 04:42:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-396311470 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:42:36.500108 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6c91f416-da85-41a8-b2b6-b0424845e9b5 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:36.500730 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-6c91f416-da85-41a8-b2b6-b0424845e9b5 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] [instance: 48df7db9-a805-4c72-a1a5-29632b00248c] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:36.595053 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-52cbbca7-da5d-42aa-8deb-9eef5d554b42 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lazy-loading 'services' on Instance uuid dfb8f504-218a-471c-b7a8-70c498769f0e {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:42:36.600397 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6c91f416-da85-41a8-b2b6-b0424845e9b5 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e235519204b4efc8b6c7e2988fab9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0b7307c30a4c118da4c501691e349f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:36.613250 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-6c91f416-da85-41a8-b2b6-b0424845e9b5 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] 10.222.0.33 "GET /compute/v2.1/servers/48df7db9-a805-4c72-a1a5-29632b00248c" status: 200 len: 1242 microversion: 2.1 time: 0.117278 Sep 23 04:42:36.619472 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1393/2800] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:42:36 2022] GET /compute/v2.1/servers/48df7db9-a805-4c72-a1a5-29632b00248c => generated 1242 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:42:36.875800 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-52cbbca7-da5d-42aa-8deb-9eef5d554b42 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] 10.222.0.33 "DELETE /compute/v2.1/servers/dfb8f504-218a-471c-b7a8-70c498769f0e/os-volume_attachments/8baef134-0776-432d-b1a4-21cda52b9216" status: 202 len: 0 microversion: 2.1 time: 0.438128 Sep 23 04:42:36.876528 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1408/2801] 10.222.0.33 () {58 vars in 1416 bytes} [Fri Sep 23 04:42:36 2022] DELETE /compute/v2.1/servers/dfb8f504-218a-471c-b7a8-70c498769f0e/os-volume_attachments/8baef134-0776-432d-b1a4-21cda52b9216 => generated 0 bytes in 440 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:42:37.094587 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-edc79adc-fce4-4df3-ac78-37894318259d req-ffa0ecef-7146-4a11-83b1-3c8d43da9ace service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c54457b-bab9-4a3e-bb6f-d0723dfbebf4", "name": "network-vif-plugged", "status": "completed", "tag": "50746c1a-5edd-4880-85e5-6ef1b5511e58"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:42:37.124944 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-edc79adc-fce4-4df3-ac78-37894318259d req-ffa0ecef-7146-4a11-83b1-3c8d43da9ace service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:37.125540 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-edc79adc-fce4-4df3-ac78-37894318259d req-ffa0ecef-7146-4a11-83b1-3c8d43da9ace service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:37.125979 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-edc79adc-fce4-4df3-ac78-37894318259d req-ffa0ecef-7146-4a11-83b1-3c8d43da9ace service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:37.138042 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-edc79adc-fce4-4df3-ac78-37894318259d req-ffa0ecef-7146-4a11-83b1-3c8d43da9ace service nova] Creating event network-vif-plugged:50746c1a-5edd-4880-85e5-6ef1b5511e58 for instance 3c54457b-bab9-4a3e-bb6f-d0723dfbebf4 on n-h2-846463-3 Sep 23 04:42:37.143561 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-edc79adc-fce4-4df3-ac78-37894318259d req-ffa0ecef-7146-4a11-83b1-3c8d43da9ace service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054370 Sep 23 04:42:37.144341 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1394/2802] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:42:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:42:37.184625 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a9d508a5-8abc-4296-85ec-29c5398a885d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:37.185354 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a9d508a5-8abc-4296-85ec-29c5398a885d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 3c54457b-bab9-4a3e-bb6f-d0723dfbebf4] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:37.197764 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a9d508a5-8abc-4296-85ec-29c5398a885d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:37.209506 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a9d508a5-8abc-4296-85ec-29c5398a885d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:37.212034 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a9d508a5-8abc-4296-85ec-29c5398a885d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:37.212849 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a9d508a5-8abc-4296-85ec-29c5398a885d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:37.217877 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a9d508a5-8abc-4296-85ec-29c5398a885d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:37.218619 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a9d508a5-8abc-4296-85ec-29c5398a885d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:37.456069 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b674b340-6c28-4629-9360-050e4f5226b7 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:37.457554 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b674b340-6c28-4629-9360-050e4f5226b7 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:37.471551 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b674b340-6c28-4629-9360-050e4f5226b7 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:37.474668 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b674b340-6c28-4629-9360-050e4f5226b7 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:37.475423 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b674b340-6c28-4629-9360-050e4f5226b7 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:37.478759 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b674b340-6c28-4629-9360-050e4f5226b7 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:37.479358 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b674b340-6c28-4629-9360-050e4f5226b7 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:37.480646 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b674b340-6c28-4629-9360-050e4f5226b7 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:37.550013 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a9d508a5-8abc-4296-85ec-29c5398a885d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:37.574163 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a9d508a5-8abc-4296-85ec-29c5398a885d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/3c54457b-bab9-4a3e-bb6f-d0723dfbebf4" status: 200 len: 1315 microversion: 2.1 time: 0.395017 Sep 23 04:42:37.575367 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1409/2803] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:42:37 2022] GET /compute/v2.1/servers/3c54457b-bab9-4a3e-bb6f-d0723dfbebf4 => generated 1315 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:42:37.609625 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b674b340-6c28-4629-9360-050e4f5226b7 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:37.625557 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b674b340-6c28-4629-9360-050e4f5226b7 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:37.632913 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b674b340-6c28-4629-9360-050e4f5226b7 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:37.633838 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b674b340-6c28-4629-9360-050e4f5226b7 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1544 microversion: 2.91 time: 0.184669 Sep 23 04:42:37.634834 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1395/2804] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:42:37 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1544 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:42:37.641367 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b93f4278-c249-432e-80bc-3d13da0f11a5 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:37.642229 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b93f4278-c249-432e-80bc-3d13da0f11a5 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] [instance: 48df7db9-a805-4c72-a1a5-29632b00248c] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:37.821547 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b93f4278-c249-432e-80bc-3d13da0f11a5 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e235519204b4efc8b6c7e2988fab9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0b7307c30a4c118da4c501691e349f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:37.829928 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b93f4278-c249-432e-80bc-3d13da0f11a5 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] 10.222.0.33 "GET /compute/v2.1/servers/48df7db9-a805-4c72-a1a5-29632b00248c" status: 200 len: 1242 microversion: 2.1 time: 0.193130 Sep 23 04:42:37.831332 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1410/2805] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:42:37 2022] GET /compute/v2.1/servers/48df7db9-a805-4c72-a1a5-29632b00248c => generated 1242 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:42:38.602680 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a6821497-72ce-4bea-8964-a870c07e22dc tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:38.604037 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a6821497-72ce-4bea-8964-a870c07e22dc tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 3c54457b-bab9-4a3e-bb6f-d0723dfbebf4] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:38.622569 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a6821497-72ce-4bea-8964-a870c07e22dc tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:38.626582 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a6821497-72ce-4bea-8964-a870c07e22dc tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:38.627756 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a6821497-72ce-4bea-8964-a870c07e22dc tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:38.637314 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a6821497-72ce-4bea-8964-a870c07e22dc tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:38.640385 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a6821497-72ce-4bea-8964-a870c07e22dc tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:38.643124 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a6821497-72ce-4bea-8964-a870c07e22dc tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:38.669294 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1ee38d5d-f6cb-4c0e-a430-682c79d4823b tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:38.670054 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1ee38d5d-f6cb-4c0e-a430-682c79d4823b tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:38.685995 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1ee38d5d-f6cb-4c0e-a430-682c79d4823b tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:38.686524 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1ee38d5d-f6cb-4c0e-a430-682c79d4823b tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:38.686971 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1ee38d5d-f6cb-4c0e-a430-682c79d4823b tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:38.691029 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1ee38d5d-f6cb-4c0e-a430-682c79d4823b tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:38.692021 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1ee38d5d-f6cb-4c0e-a430-682c79d4823b tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:38.693992 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1ee38d5d-f6cb-4c0e-a430-682c79d4823b tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:38.910521 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1ee38d5d-f6cb-4c0e-a430-682c79d4823b tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:38.925564 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1ee38d5d-f6cb-4c0e-a430-682c79d4823b tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:38.927554 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1ee38d5d-f6cb-4c0e-a430-682c79d4823b tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:38.940617 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1ee38d5d-f6cb-4c0e-a430-682c79d4823b tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1531 microversion: 2.91 time: 0.277903 Sep 23 04:42:38.948358 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1411/2806] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:42:38 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1531 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:42:38.953767 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3cd89ffe-fd45-4761-aa6b-092c4512e6d4 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:38.957213 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-3cd89ffe-fd45-4761-aa6b-092c4512e6d4 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] [instance: 48df7db9-a805-4c72-a1a5-29632b00248c] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:38.977870 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3cd89ffe-fd45-4761-aa6b-092c4512e6d4 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:38.984377 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3cd89ffe-fd45-4761-aa6b-092c4512e6d4 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:38.984944 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3cd89ffe-fd45-4761-aa6b-092c4512e6d4 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:38.987957 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3cd89ffe-fd45-4761-aa6b-092c4512e6d4 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:38.990558 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3cd89ffe-fd45-4761-aa6b-092c4512e6d4 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:38.995594 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3cd89ffe-fd45-4761-aa6b-092c4512e6d4 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:39.250296 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-3cd89ffe-fd45-4761-aa6b-092c4512e6d4 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e235519204b4efc8b6c7e2988fab9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0b7307c30a4c118da4c501691e349f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:39.264117 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3cd89ffe-fd45-4761-aa6b-092c4512e6d4 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] 10.222.0.33 "GET /compute/v2.1/servers/48df7db9-a805-4c72-a1a5-29632b00248c" status: 200 len: 1294 microversion: 2.1 time: 0.314075 Sep 23 04:42:39.265131 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1412/2807] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:42:38 2022] GET /compute/v2.1/servers/48df7db9-a805-4c72-a1a5-29632b00248c => generated 1294 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:42:39.269900 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ccc672eb-1f24-46b1-8744-5f9d2e7af134 tempest-UnshelveToHostMultiNodesTest-1629091521 tempest-UnshelveToHostMultiNodesTest-1629091521-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:39.274638 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ccc672eb-1f24-46b1-8744-5f9d2e7af134 tempest-UnshelveToHostMultiNodesTest-1629091521 tempest-UnshelveToHostMultiNodesTest-1629091521-project-admin] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:39.295021 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ccc672eb-1f24-46b1-8744-5f9d2e7af134 tempest-UnshelveToHostMultiNodesTest-1629091521 tempest-UnshelveToHostMultiNodesTest-1629091521-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:39.295648 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ccc672eb-1f24-46b1-8744-5f9d2e7af134 tempest-UnshelveToHostMultiNodesTest-1629091521 tempest-UnshelveToHostMultiNodesTest-1629091521-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:39.296132 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ccc672eb-1f24-46b1-8744-5f9d2e7af134 tempest-UnshelveToHostMultiNodesTest-1629091521 tempest-UnshelveToHostMultiNodesTest-1629091521-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:39.296939 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ccc672eb-1f24-46b1-8744-5f9d2e7af134 tempest-UnshelveToHostMultiNodesTest-1629091521 tempest-UnshelveToHostMultiNodesTest-1629091521-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:39.297475 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ccc672eb-1f24-46b1-8744-5f9d2e7af134 tempest-UnshelveToHostMultiNodesTest-1629091521 tempest-UnshelveToHostMultiNodesTest-1629091521-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:39.298006 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ccc672eb-1f24-46b1-8744-5f9d2e7af134 tempest-UnshelveToHostMultiNodesTest-1629091521 tempest-UnshelveToHostMultiNodesTest-1629091521-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:39.300113 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a6821497-72ce-4bea-8964-a870c07e22dc tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:39.351529 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a6821497-72ce-4bea-8964-a870c07e22dc tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/3c54457b-bab9-4a3e-bb6f-d0723dfbebf4" status: 200 len: 1315 microversion: 2.1 time: 0.755304 Sep 23 04:42:39.352869 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1396/2808] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:42:38 2022] GET /compute/v2.1/servers/3c54457b-bab9-4a3e-bb6f-d0723dfbebf4 => generated 1315 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:42:39.448260 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-ccc672eb-1f24-46b1-8744-5f9d2e7af134 tempest-UnshelveToHostMultiNodesTest-1629091521 tempest-UnshelveToHostMultiNodesTest-1629091521-project-admin] Lazy-loading 'services' on Instance uuid 11ba0b77-8202-461d-8fdf-16528c7fa831 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:42:39.471198 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ccc672eb-1f24-46b1-8744-5f9d2e7af134 tempest-UnshelveToHostMultiNodesTest-1629091521 tempest-UnshelveToHostMultiNodesTest-1629091521-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1936 microversion: 2.91 time: 0.204914 Sep 23 04:42:39.482014 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1413/2809] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:42:39 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1936 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:42:39.533544 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5c45eb5e-5e9f-44e0-b00c-1241a9120060 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:39.534190 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5c45eb5e-5e9f-44e0-b00c-1241a9120060 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:39.546743 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5c45eb5e-5e9f-44e0-b00c-1241a9120060 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:39.551923 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5c45eb5e-5e9f-44e0-b00c-1241a9120060 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:39.552486 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5c45eb5e-5e9f-44e0-b00c-1241a9120060 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:39.553312 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5c45eb5e-5e9f-44e0-b00c-1241a9120060 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:39.554515 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5c45eb5e-5e9f-44e0-b00c-1241a9120060 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:39.555925 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5c45eb5e-5e9f-44e0-b00c-1241a9120060 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:39.587951 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5c45eb5e-5e9f-44e0-b00c-1241a9120060 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Going to try to terminate instance {{(pid=122698) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:42:39.739121 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:42:39.840077 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:42:39.952862 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5c45eb5e-5e9f-44e0-b00c-1241a9120060 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "DELETE /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 204 len: 0 microversion: 2.91 time: 0.422980 Sep 23 04:42:39.958412 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1397/2810] 10.222.0.33 () {60 vars in 1280 bytes} [Fri Sep 23 04:42:39 2022] DELETE /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 23 04:42:39.967495 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-68482ca0-8473-4c12-a6f6-8e76a1ecb465 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:39.968496 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-68482ca0-8473-4c12-a6f6-8e76a1ecb465 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:39.997209 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-68482ca0-8473-4c12-a6f6-8e76a1ecb465 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:39.998441 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-68482ca0-8473-4c12-a6f6-8e76a1ecb465 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:40.000414 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-68482ca0-8473-4c12-a6f6-8e76a1ecb465 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:40.004126 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-68482ca0-8473-4c12-a6f6-8e76a1ecb465 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:40.004623 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-68482ca0-8473-4c12-a6f6-8e76a1ecb465 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:40.005061 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-68482ca0-8473-4c12-a6f6-8e76a1ecb465 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:40.018929 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:42:40.171788 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-68482ca0-8473-4c12-a6f6-8e76a1ecb465 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:40.187497 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-68482ca0-8473-4c12-a6f6-8e76a1ecb465 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:40.189075 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-68482ca0-8473-4c12-a6f6-8e76a1ecb465 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:40.221024 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-68482ca0-8473-4c12-a6f6-8e76a1ecb465 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1537 microversion: 2.91 time: 0.262311 Sep 23 04:42:40.221977 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1414/2811] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:42:39 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1537 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:42:40.295142 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-db0c15b3-1feb-40ef-847a-0b3d2e3d9072 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:40.295987 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-db0c15b3-1feb-40ef-847a-0b3d2e3d9072 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] [instance: 48df7db9-a805-4c72-a1a5-29632b00248c] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:40.304538 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-db0c15b3-1feb-40ef-847a-0b3d2e3d9072 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:40.305118 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-db0c15b3-1feb-40ef-847a-0b3d2e3d9072 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:40.305663 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-db0c15b3-1feb-40ef-847a-0b3d2e3d9072 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:40.306563 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-db0c15b3-1feb-40ef-847a-0b3d2e3d9072 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:40.307063 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-db0c15b3-1feb-40ef-847a-0b3d2e3d9072 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:40.307588 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-db0c15b3-1feb-40ef-847a-0b3d2e3d9072 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:40.378710 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5688687a-fc28-4545-9c3e-f51383113987 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:40.379333 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-5688687a-fc28-4545-9c3e-f51383113987 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 3c54457b-bab9-4a3e-bb6f-d0723dfbebf4] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:40.398869 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5688687a-fc28-4545-9c3e-f51383113987 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:40.398869 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5688687a-fc28-4545-9c3e-f51383113987 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:40.398869 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5688687a-fc28-4545-9c3e-f51383113987 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:40.398869 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5688687a-fc28-4545-9c3e-f51383113987 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:40.398869 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5688687a-fc28-4545-9c3e-f51383113987 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:40.398869 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5688687a-fc28-4545-9c3e-f51383113987 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:40.436156 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-db0c15b3-1feb-40ef-847a-0b3d2e3d9072 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e235519204b4efc8b6c7e2988fab9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0b7307c30a4c118da4c501691e349f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:40.449159 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-db0c15b3-1feb-40ef-847a-0b3d2e3d9072 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] 10.222.0.33 "GET /compute/v2.1/servers/48df7db9-a805-4c72-a1a5-29632b00248c" status: 200 len: 1312 microversion: 2.1 time: 0.162121 Sep 23 04:42:40.461729 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1398/2812] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:42:40 2022] GET /compute/v2.1/servers/48df7db9-a805-4c72-a1a5-29632b00248c => generated 1312 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:42:40.769533 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-5688687a-fc28-4545-9c3e-f51383113987 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:40.780502 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5688687a-fc28-4545-9c3e-f51383113987 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/3c54457b-bab9-4a3e-bb6f-d0723dfbebf4" status: 200 len: 1502 microversion: 2.1 time: 0.408346 Sep 23 04:42:40.797766 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1415/2813] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:42:40 2022] GET /compute/v2.1/servers/3c54457b-bab9-4a3e-bb6f-d0723dfbebf4 => generated 1502 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:42:40.808232 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8d02e079-1f9e-4ec0-8710-074b364b1dfc tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:42:40.808965 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8d02e079-1f9e-4ec0-8710-074b364b1dfc tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 3c54457b-bab9-4a3e-bb6f-d0723dfbebf4] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:40.827588 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8d02e079-1f9e-4ec0-8710-074b364b1dfc tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:40.832660 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8d02e079-1f9e-4ec0-8710-074b364b1dfc tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:40.832660 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8d02e079-1f9e-4ec0-8710-074b364b1dfc tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:40.832660 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8d02e079-1f9e-4ec0-8710-074b364b1dfc tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:40.832660 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8d02e079-1f9e-4ec0-8710-074b364b1dfc tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:40.833078 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8d02e079-1f9e-4ec0-8710-074b364b1dfc tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:40.896808 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-8d02e079-1f9e-4ec0-8710-074b364b1dfc tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lazy-loading 'flavor' on Instance uuid 3c54457b-bab9-4a3e-bb6f-d0723dfbebf4 {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:42:41.254504 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b4ccc3c2-a804-4652-9e74-f9d184dacb83 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:41.255978 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b4ccc3c2-a804-4652-9e74-f9d184dacb83 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:41.269396 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b4ccc3c2-a804-4652-9e74-f9d184dacb83 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:41.270300 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b4ccc3c2-a804-4652-9e74-f9d184dacb83 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:41.270963 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b4ccc3c2-a804-4652-9e74-f9d184dacb83 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:41.271888 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b4ccc3c2-a804-4652-9e74-f9d184dacb83 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:41.272641 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b4ccc3c2-a804-4652-9e74-f9d184dacb83 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:41.273246 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b4ccc3c2-a804-4652-9e74-f9d184dacb83 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:41.284125 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8d02e079-1f9e-4ec0-8710-074b364b1dfc tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "POST /compute/v2.1/servers/3c54457b-bab9-4a3e-bb6f-d0723dfbebf4/action" status: 202 len: 0 microversion: 2.1 time: 0.479952 Sep 23 04:42:41.285169 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1399/2814] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:42:40 2022] POST /compute/v2.1/servers/3c54457b-bab9-4a3e-bb6f-d0723dfbebf4/action => generated 0 bytes in 482 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:42:41.295219 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b97ad2b1-50a5-409e-b9ac-dc30c68f5cda tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:41.295952 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b97ad2b1-50a5-409e-b9ac-dc30c68f5cda tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 3c54457b-bab9-4a3e-bb6f-d0723dfbebf4] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:41.323240 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b97ad2b1-50a5-409e-b9ac-dc30c68f5cda tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:41.324945 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b97ad2b1-50a5-409e-b9ac-dc30c68f5cda tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:41.327193 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b97ad2b1-50a5-409e-b9ac-dc30c68f5cda tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:41.329610 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b97ad2b1-50a5-409e-b9ac-dc30c68f5cda tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:41.333209 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b97ad2b1-50a5-409e-b9ac-dc30c68f5cda tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:41.338006 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b97ad2b1-50a5-409e-b9ac-dc30c68f5cda tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:41.423532 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b4ccc3c2-a804-4652-9e74-f9d184dacb83 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:41.437247 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b4ccc3c2-a804-4652-9e74-f9d184dacb83 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:41.453324 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b4ccc3c2-a804-4652-9e74-f9d184dacb83 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:41.471984 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b4ccc3c2-a804-4652-9e74-f9d184dacb83 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1537 microversion: 2.91 time: 0.220477 Sep 23 04:42:41.487302 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1416/2815] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:42:41 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1537 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:42:41.500009 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c346d6c1-aab9-4ef3-a77e-2f04a6ec897e tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:41.502761 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c346d6c1-aab9-4ef3-a77e-2f04a6ec897e tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] [instance: 48df7db9-a805-4c72-a1a5-29632b00248c] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:41.527585 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c346d6c1-aab9-4ef3-a77e-2f04a6ec897e tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:41.530258 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c346d6c1-aab9-4ef3-a77e-2f04a6ec897e tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:41.530891 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c346d6c1-aab9-4ef3-a77e-2f04a6ec897e tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:41.531959 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c346d6c1-aab9-4ef3-a77e-2f04a6ec897e tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:41.534483 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c346d6c1-aab9-4ef3-a77e-2f04a6ec897e tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:41.535176 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c346d6c1-aab9-4ef3-a77e-2f04a6ec897e tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:42.335643 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c346d6c1-aab9-4ef3-a77e-2f04a6ec897e tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e235519204b4efc8b6c7e2988fab9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0b7307c30a4c118da4c501691e349f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:42.350477 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c346d6c1-aab9-4ef3-a77e-2f04a6ec897e tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] 10.222.0.33 "GET /compute/v2.1/servers/48df7db9-a805-4c72-a1a5-29632b00248c" status: 200 len: 1367 microversion: 2.1 time: 0.859086 Sep 23 04:42:42.375167 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1417/2816] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:42:41 2022] GET /compute/v2.1/servers/48df7db9-a805-4c72-a1a5-29632b00248c => generated 1367 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:42:42.401150 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b97ad2b1-50a5-409e-b9ac-dc30c68f5cda tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:42.410884 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b97ad2b1-50a5-409e-b9ac-dc30c68f5cda tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/3c54457b-bab9-4a3e-bb6f-d0723dfbebf4" status: 200 len: 1510 microversion: 2.1 time: 1.121665 Sep 23 04:42:42.416432 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1400/2817] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:42:41 2022] GET /compute/v2.1/servers/3c54457b-bab9-4a3e-bb6f-d0723dfbebf4 => generated 1510 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:42:42.507612 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-411cbfe4-71f7-4a5c-be76-44c0d5757dfe tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:42.514080 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-411cbfe4-71f7-4a5c-be76-44c0d5757dfe tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:42.545749 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-411cbfe4-71f7-4a5c-be76-44c0d5757dfe tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:42.545749 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-411cbfe4-71f7-4a5c-be76-44c0d5757dfe tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:42.545749 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-411cbfe4-71f7-4a5c-be76-44c0d5757dfe tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:42.545749 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-411cbfe4-71f7-4a5c-be76-44c0d5757dfe tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:42.545749 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-411cbfe4-71f7-4a5c-be76-44c0d5757dfe tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:42.545749 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-411cbfe4-71f7-4a5c-be76-44c0d5757dfe tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:42.614826 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-411cbfe4-71f7-4a5c-be76-44c0d5757dfe tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:42.615337 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-411cbfe4-71f7-4a5c-be76-44c0d5757dfe tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:42.615875 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-411cbfe4-71f7-4a5c-be76-44c0d5757dfe tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:42.616475 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-411cbfe4-71f7-4a5c-be76-44c0d5757dfe tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lazy-loading 'fault' on Instance uuid 11ba0b77-8202-461d-8fdf-16528c7fa831 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:42:42.722756 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-411cbfe4-71f7-4a5c-be76-44c0d5757dfe tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:42.732766 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-411cbfe4-71f7-4a5c-be76-44c0d5757dfe tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:42.734899 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-411cbfe4-71f7-4a5c-be76-44c0d5757dfe tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9aaffb5b70d4890a9d41c6127affb9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccefc8bfaa7b4209b2e46503bc5f91f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:42.740785 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-411cbfe4-71f7-4a5c-be76-44c0d5757dfe tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 200 len: 1542 microversion: 2.91 time: 0.240516 Sep 23 04:42:42.742136 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1418/2818] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:42:42 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 1542 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:42:43.404383 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-714ada9d-f60d-4911-8af1-1ffe00bd831c tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:43.405849 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-714ada9d-f60d-4911-8af1-1ffe00bd831c tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] [instance: 48df7db9-a805-4c72-a1a5-29632b00248c] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:43.416765 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-714ada9d-f60d-4911-8af1-1ffe00bd831c tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:43.417930 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-714ada9d-f60d-4911-8af1-1ffe00bd831c tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:43.422422 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-714ada9d-f60d-4911-8af1-1ffe00bd831c tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:43.423223 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-714ada9d-f60d-4911-8af1-1ffe00bd831c tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:43.423708 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-714ada9d-f60d-4911-8af1-1ffe00bd831c tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:43.431336 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-714ada9d-f60d-4911-8af1-1ffe00bd831c tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:43.437087 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-245d5fcf-8d06-4c26-9b32-dc493fb8395b tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:43.437796 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-245d5fcf-8d06-4c26-9b32-dc493fb8395b tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 3c54457b-bab9-4a3e-bb6f-d0723dfbebf4] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:43.444911 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-245d5fcf-8d06-4c26-9b32-dc493fb8395b tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:43.445479 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-245d5fcf-8d06-4c26-9b32-dc493fb8395b tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:43.445950 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-245d5fcf-8d06-4c26-9b32-dc493fb8395b tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:43.446675 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-245d5fcf-8d06-4c26-9b32-dc493fb8395b tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:43.447140 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-245d5fcf-8d06-4c26-9b32-dc493fb8395b tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:43.454026 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-245d5fcf-8d06-4c26-9b32-dc493fb8395b tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:43.897943 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-245d5fcf-8d06-4c26-9b32-dc493fb8395b tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:43.911900 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-245d5fcf-8d06-4c26-9b32-dc493fb8395b tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/3c54457b-bab9-4a3e-bb6f-d0723dfbebf4" status: 200 len: 1493 microversion: 2.1 time: 0.478989 Sep 23 04:42:43.914697 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1419/2819] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:42:43 2022] GET /compute/v2.1/servers/3c54457b-bab9-4a3e-bb6f-d0723dfbebf4 => generated 1493 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:42:43.926748 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-62ffdb7a-1798-4752-a7eb-4a470f257323 req-03cd641e-aa88-4d01-8945-7da36288efdb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48df7db9-a805-4c72-a1a5-29632b00248c", "tag": "26df0c1e-53e4-4613-b218-9ca9a68bcbbc"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:42:43.956624 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-714ada9d-f60d-4911-8af1-1ffe00bd831c tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e235519204b4efc8b6c7e2988fab9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0b7307c30a4c118da4c501691e349f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:43.957731 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-62ffdb7a-1798-4752-a7eb-4a470f257323 req-03cd641e-aa88-4d01-8945-7da36288efdb service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:43.959764 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-62ffdb7a-1798-4752-a7eb-4a470f257323 req-03cd641e-aa88-4d01-8945-7da36288efdb service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:43.961643 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-62ffdb7a-1798-4752-a7eb-4a470f257323 req-03cd641e-aa88-4d01-8945-7da36288efdb service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:43.961819 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-714ada9d-f60d-4911-8af1-1ffe00bd831c tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] 10.222.0.33 "GET /compute/v2.1/servers/48df7db9-a805-4c72-a1a5-29632b00248c" status: 200 len: 1367 microversion: 2.1 time: 0.561852 Sep 23 04:42:43.964228 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1401/2820] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:42:43 2022] GET /compute/v2.1/servers/48df7db9-a805-4c72-a1a5-29632b00248c => generated 1367 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:42:43.970839 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b65e7517-df10-4fcb-a793-d478622475b1 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:43.972262 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b65e7517-df10-4fcb-a793-d478622475b1 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] [instance: 11ba0b77-8202-461d-8fdf-16528c7fa831] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:43.982017 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b65e7517-df10-4fcb-a793-d478622475b1 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:43.991622 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b65e7517-df10-4fcb-a793-d478622475b1 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:43.991622 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b65e7517-df10-4fcb-a793-d478622475b1 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:43.991622 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b65e7517-df10-4fcb-a793-d478622475b1 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:43.991622 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b65e7517-df10-4fcb-a793-d478622475b1 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:43.991622 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b65e7517-df10-4fcb-a793-d478622475b1 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:44.007972 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-62ffdb7a-1798-4752-a7eb-4a470f257323 req-03cd641e-aa88-4d01-8945-7da36288efdb service nova] Creating event network-changed:26df0c1e-53e4-4613-b218-9ca9a68bcbbc for instance 48df7db9-a805-4c72-a1a5-29632b00248c on n-h1-846463-3 Sep 23 04:42:44.010083 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-b65e7517-df10-4fcb-a793-d478622475b1 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] HTTP exception thrown: Instance 11ba0b77-8202-461d-8fdf-16528c7fa831 could not be found. Sep 23 04:42:44.013191 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b65e7517-df10-4fcb-a793-d478622475b1 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Request method failure captured: Sep 23 04:42:44.013191 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 HTTP/1.1 Sep 23 04:42:44.013191 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:42:44.013191 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:42:44.013191 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:42:44.013191 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:42:44.013191 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:42:44.013191 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:42:44.013191 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:42:44.013191 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:42:44.013191 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTh63tZ2QwUsJZSVknj47bs8bXfruJgu_QPUKE1tRuAtO3YadVRyZPhEIMoUWsZeugSUqFLmtG5XrFZT2iEfELLM5wa0IzAvCy44Y0RJ2JentApN3gbTiZ3bxgF7JT4c1Q5cjJra-WK2Zdxs6iTLWBRgB6HC844wFeDOBxtwo3v2lyc Sep 23 04:42:44.013191 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:42:44.013191 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:42:44.013191 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:42:44.013191 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:42:44.013191 n-d-846463-3 devstack@n-api.service[122698]: X-Openstack-Nova-Api-Version: 2.91 Sep 23 04:42:44.013191 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:42:44.013191 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:42:44.013191 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: ccefc8bfaa7b4209b2e46503bc5f91f7 Sep 23 04:42:44.013191 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-UnshelveToHostMultiNodesTest-2044510597 Sep 23 04:42:44.013191 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:42:44.013191 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:42:44.013191 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ccefc8bfaa7b4209b2e46503bc5f91f7", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ccefc8bfaa7b4209b2e46503bc5f91f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ccefc8bfaa7b4209b2e46503bc5f91f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ccefc8bfaa7b4209b2e46503bc5f91f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:42:44.013191 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-UnshelveToHostMultiNodesTest-2044510597 Sep 23 04:42:44.013191 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: ccefc8bfaa7b4209b2e46503bc5f91f7 Sep 23 04:42:44.013191 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-UnshelveToHostMultiNodesTest-2044510597 Sep 23 04:42:44.013191 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-UnshelveToHostMultiNodesTest-2044510597-project Sep 23 04:42:44.013191 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:42:44.013191 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:42:44.013191 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: b9aaffb5b70d4890a9d41c6127affb9d Sep 23 04:42:44.013191 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-UnshelveToHostMultiNodesTest-2044510597-project Sep 23 04:42:44.013191 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:42:44.013191 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 11ba0b77-8202-461d-8fdf-16528c7fa831 could not be found. Sep 23 04:42:44.013191 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '11ba0b77-8202-461d-8fdf-16528c7fa831'} Sep 23 04:42:44.013191 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:42:44.013191 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:42:44.013191 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:42:44.013191 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:42:44.013191 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:42:44.013191 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:42:44.013191 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:42:44.013191 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:42:44.013191 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:42:44.013191 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:42:44.013191 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11ba0b77-8202-461d-8fdf-16528c7fa831 could not be found. Sep 23 04:42:44.013191 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:42:44.013191 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:42:44.013191 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:42:44.013191 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:42:44.013191 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:42:44.013191 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:42:44.013191 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:42:44.013191 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:42:44.013191 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:42:44.013191 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:42:44.013191 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:42:44.013191 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:42:44.013191 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:42:44.013191 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:42:44.013191 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:42:44.013191 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:42:44.013191 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11ba0b77-8202-461d-8fdf-16528c7fa831 could not be found. Sep 23 04:42:44.013191 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:42:44.018395 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:42:44.018395 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:42:44.018395 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:42:44.018395 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:42:44.018395 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:42:44.018395 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:42:44.018395 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:42:44.018395 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11ba0b77-8202-461d-8fdf-16528c7fa831 could not be found. Sep 23 04:42:44.018395 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:42:44.018395 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b65e7517-df10-4fcb-a793-d478622475b1 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] Returning 404 to user: Instance 11ba0b77-8202-461d-8fdf-16528c7fa831 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:42:44.018395 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b65e7517-df10-4fcb-a793-d478622475b1 tempest-UnshelveToHostMultiNodesTest-2044510597 tempest-UnshelveToHostMultiNodesTest-2044510597-project] 10.222.0.33 "GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831" status: 404 len: 111 microversion: 2.91 time: 0.049575 Sep 23 04:42:44.019996 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1402/2821] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:42:43 2022] GET /compute/v2.1/servers/11ba0b77-8202-461d-8fdf-16528c7fa831 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 23 04:42:44.029642 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9a887bd8-63c1-4f73-8f41-11b6747a1065 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:44.029642 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-9a887bd8-63c1-4f73-8f41-11b6747a1065 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 3c54457b-bab9-4a3e-bb6f-d0723dfbebf4] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:44.029952 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-62ffdb7a-1798-4752-a7eb-4a470f257323 req-03cd641e-aa88-4d01-8945-7da36288efdb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112487 Sep 23 04:42:44.030617 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1420/2822] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:42:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:42:44.038518 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9a887bd8-63c1-4f73-8f41-11b6747a1065 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:44.039093 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9a887bd8-63c1-4f73-8f41-11b6747a1065 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:44.039547 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9a887bd8-63c1-4f73-8f41-11b6747a1065 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:44.040738 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9a887bd8-63c1-4f73-8f41-11b6747a1065 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:44.041974 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9a887bd8-63c1-4f73-8f41-11b6747a1065 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:44.042461 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9a887bd8-63c1-4f73-8f41-11b6747a1065 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:44.086052 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-9a887bd8-63c1-4f73-8f41-11b6747a1065 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 3c54457b-bab9-4a3e-bb6f-d0723dfbebf4] Going to try to terminate instance {{(pid=122698) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:42:44.572556 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9a887bd8-63c1-4f73-8f41-11b6747a1065 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "DELETE /compute/v2.1/servers/3c54457b-bab9-4a3e-bb6f-d0723dfbebf4" status: 204 len: 0 microversion: 2.1 time: 0.551304 Sep 23 04:42:44.575346 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1403/2823] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:42:44 2022] DELETE /compute/v2.1/servers/3c54457b-bab9-4a3e-bb6f-d0723dfbebf4 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:42:44.584635 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b406aa3c-9cbf-4684-9092-20c233e7d983 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:44.586631 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b406aa3c-9cbf-4684-9092-20c233e7d983 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 3c54457b-bab9-4a3e-bb6f-d0723dfbebf4] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:44.596415 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b406aa3c-9cbf-4684-9092-20c233e7d983 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:44.597705 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b406aa3c-9cbf-4684-9092-20c233e7d983 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:44.598712 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b406aa3c-9cbf-4684-9092-20c233e7d983 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:44.606346 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b406aa3c-9cbf-4684-9092-20c233e7d983 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:44.606346 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b406aa3c-9cbf-4684-9092-20c233e7d983 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:44.606346 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b406aa3c-9cbf-4684-9092-20c233e7d983 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:44.828705 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-42c7b298-ac76-498c-a90f-c21c710c9ce6 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:44.831159 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-42c7b298-ac76-498c-a90f-c21c710c9ce6 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] [instance: dfb8f504-218a-471c-b7a8-70c498769f0e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:44.840399 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-42c7b298-ac76-498c-a90f-c21c710c9ce6 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:44.840969 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-42c7b298-ac76-498c-a90f-c21c710c9ce6 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:44.841485 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-42c7b298-ac76-498c-a90f-c21c710c9ce6 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:44.842730 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-42c7b298-ac76-498c-a90f-c21c710c9ce6 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:44.843269 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-42c7b298-ac76-498c-a90f-c21c710c9ce6 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:44.843787 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-42c7b298-ac76-498c-a90f-c21c710c9ce6 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:44.883633 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-42c7b298-ac76-498c-a90f-c21c710c9ce6 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] 10.222.0.33 "GET /compute/v2.1/servers/dfb8f504-218a-471c-b7a8-70c498769f0e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058736 Sep 23 04:42:44.884920 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1404/2824] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Sep 23 04:42:44 2022] GET /compute/v2.1/servers/dfb8f504-218a-471c-b7a8-70c498769f0e/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 23 04:42:44.966541 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ec780cb7-c78e-4e35-9cc7-e221ce327356 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:44.969402 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-ec780cb7-c78e-4e35-9cc7-e221ce327356 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] [instance: dfb8f504-218a-471c-b7a8-70c498769f0e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:44.978340 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ec780cb7-c78e-4e35-9cc7-e221ce327356 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:44.979250 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ec780cb7-c78e-4e35-9cc7-e221ce327356 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:44.979943 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ec780cb7-c78e-4e35-9cc7-e221ce327356 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:44.981020 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ec780cb7-c78e-4e35-9cc7-e221ce327356 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:44.981700 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ec780cb7-c78e-4e35-9cc7-e221ce327356 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:44.983076 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ec780cb7-c78e-4e35-9cc7-e221ce327356 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:45.056691 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ec780cb7-c78e-4e35-9cc7-e221ce327356 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] 10.222.0.33 "GET /compute/v2.1/servers/dfb8f504-218a-471c-b7a8-70c498769f0e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.096832 Sep 23 04:42:45.058028 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1405/2825] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Sep 23 04:42:44 2022] GET /compute/v2.1/servers/dfb8f504-218a-471c-b7a8-70c498769f0e/os-volume_attachments => generated 25 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 04:42:45.067172 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b406aa3c-9cbf-4684-9092-20c233e7d983 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:45.074839 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-66a245e4-6e33-4b15-8567-7185664d539f tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:45.075921 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-66a245e4-6e33-4b15-8567-7185664d539f tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] [instance: 48df7db9-a805-4c72-a1a5-29632b00248c] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:45.085226 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b406aa3c-9cbf-4684-9092-20c233e7d983 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/3c54457b-bab9-4a3e-bb6f-d0723dfbebf4" status: 200 len: 1499 microversion: 2.1 time: 0.505155 Sep 23 04:42:45.086291 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1421/2826] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:42:44 2022] GET /compute/v2.1/servers/3c54457b-bab9-4a3e-bb6f-d0723dfbebf4 => generated 1499 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:42:45.091210 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-66a245e4-6e33-4b15-8567-7185664d539f tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:45.092451 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-66a245e4-6e33-4b15-8567-7185664d539f tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:45.093260 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-66a245e4-6e33-4b15-8567-7185664d539f tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:45.094224 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-66a245e4-6e33-4b15-8567-7185664d539f tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:45.094909 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-66a245e4-6e33-4b15-8567-7185664d539f tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:45.095577 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-66a245e4-6e33-4b15-8567-7185664d539f tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:45.183138 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-22e106ac-3b3c-48ce-901e-1e59fa58a391 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:45.183894 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-22e106ac-3b3c-48ce-901e-1e59fa58a391 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] [instance: dfb8f504-218a-471c-b7a8-70c498769f0e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:45.190750 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-22e106ac-3b3c-48ce-901e-1e59fa58a391 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:45.191512 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-22e106ac-3b3c-48ce-901e-1e59fa58a391 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:45.192122 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-22e106ac-3b3c-48ce-901e-1e59fa58a391 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:45.193353 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-22e106ac-3b3c-48ce-901e-1e59fa58a391 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:45.194701 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-22e106ac-3b3c-48ce-901e-1e59fa58a391 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:45.195283 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-22e106ac-3b3c-48ce-901e-1e59fa58a391 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:45.227073 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-22e106ac-3b3c-48ce-901e-1e59fa58a391 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] [instance: dfb8f504-218a-471c-b7a8-70c498769f0e] Going to try to terminate instance {{(pid=122699) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:42:45.476923 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-66a245e4-6e33-4b15-8567-7185664d539f tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e235519204b4efc8b6c7e2988fab9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0b7307c30a4c118da4c501691e349f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:45.488343 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-66a245e4-6e33-4b15-8567-7185664d539f tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] 10.222.0.33 "GET /compute/v2.1/servers/48df7db9-a805-4c72-a1a5-29632b00248c" status: 200 len: 1367 microversion: 2.1 time: 0.429028 Sep 23 04:42:45.490135 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1406/2827] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:42:45 2022] GET /compute/v2.1/servers/48df7db9-a805-4c72-a1a5-29632b00248c => generated 1367 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:42:45.672413 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-22e106ac-3b3c-48ce-901e-1e59fa58a391 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] 10.222.0.33 "DELETE /compute/v2.1/servers/dfb8f504-218a-471c-b7a8-70c498769f0e" status: 204 len: 0 microversion: 2.1 time: 0.497565 Sep 23 04:42:45.673451 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1422/2828] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:42:45 2022] DELETE /compute/v2.1/servers/dfb8f504-218a-471c-b7a8-70c498769f0e => generated 0 bytes in 500 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 23 04:42:45.696320 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-668e447b-e78e-45de-a592-f2f1e3ca2b7d tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:45.697456 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-668e447b-e78e-45de-a592-f2f1e3ca2b7d tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] [instance: dfb8f504-218a-471c-b7a8-70c498769f0e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:45.713609 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-668e447b-e78e-45de-a592-f2f1e3ca2b7d tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:45.716178 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-668e447b-e78e-45de-a592-f2f1e3ca2b7d tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:45.719225 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-668e447b-e78e-45de-a592-f2f1e3ca2b7d tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:45.720911 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-668e447b-e78e-45de-a592-f2f1e3ca2b7d tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:45.722043 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-668e447b-e78e-45de-a592-f2f1e3ca2b7d tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:45.723097 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-668e447b-e78e-45de-a592-f2f1e3ca2b7d tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:46.075886 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-668e447b-e78e-45de-a592-f2f1e3ca2b7d tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542c9592c76c4d4b9f3f16cea354398d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf77b55dfd8452e949229e4eb085283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:46.115002 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2b3b53e8-41dc-4e44-b587-2b3e7dff7043 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:46.125562 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-2b3b53e8-41dc-4e44-b587-2b3e7dff7043 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 3c54457b-bab9-4a3e-bb6f-d0723dfbebf4] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:46.168589 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-668e447b-e78e-45de-a592-f2f1e3ca2b7d tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] 10.222.0.33 "GET /compute/v2.1/servers/dfb8f504-218a-471c-b7a8-70c498769f0e" status: 200 len: 1680 microversion: 2.1 time: 0.467672 Sep 23 04:42:46.170232 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1407/2829] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:42:45 2022] GET /compute/v2.1/servers/dfb8f504-218a-471c-b7a8-70c498769f0e => generated 1680 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:42:46.173982 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2b3b53e8-41dc-4e44-b587-2b3e7dff7043 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:46.174698 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2b3b53e8-41dc-4e44-b587-2b3e7dff7043 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:46.175329 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2b3b53e8-41dc-4e44-b587-2b3e7dff7043 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:46.176228 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2b3b53e8-41dc-4e44-b587-2b3e7dff7043 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:46.176856 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2b3b53e8-41dc-4e44-b587-2b3e7dff7043 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:46.177467 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2b3b53e8-41dc-4e44-b587-2b3e7dff7043 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:46.529607 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:42:46.535261 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-984952aa-c3b0-4406-acce-4bf55de56d6c tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:46.536146 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-984952aa-c3b0-4406-acce-4bf55de56d6c tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] [instance: 48df7db9-a805-4c72-a1a5-29632b00248c] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:46.542951 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-984952aa-c3b0-4406-acce-4bf55de56d6c tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:46.543449 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-984952aa-c3b0-4406-acce-4bf55de56d6c tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:46.543884 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-984952aa-c3b0-4406-acce-4bf55de56d6c tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:46.544593 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-984952aa-c3b0-4406-acce-4bf55de56d6c tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:46.545325 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-984952aa-c3b0-4406-acce-4bf55de56d6c tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:46.566477 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-984952aa-c3b0-4406-acce-4bf55de56d6c tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:46.619790 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=14 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:42:46.973094 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2b3b53e8-41dc-4e44-b587-2b3e7dff7043 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:46.984464 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-984952aa-c3b0-4406-acce-4bf55de56d6c tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e235519204b4efc8b6c7e2988fab9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0b7307c30a4c118da4c501691e349f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:46.985010 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2b3b53e8-41dc-4e44-b587-2b3e7dff7043 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/3c54457b-bab9-4a3e-bb6f-d0723dfbebf4" status: 200 len: 1499 microversion: 2.1 time: 0.878434 Sep 23 04:42:46.985321 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1423/2830] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:42:46 2022] GET /compute/v2.1/servers/3c54457b-bab9-4a3e-bb6f-d0723dfbebf4 => generated 1499 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:42:47.009015 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-984952aa-c3b0-4406-acce-4bf55de56d6c tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] 10.222.0.33 "GET /compute/v2.1/servers/48df7db9-a805-4c72-a1a5-29632b00248c" status: 200 len: 1367 microversion: 2.1 time: 0.479792 Sep 23 04:42:47.011287 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1408/2831] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:42:46 2022] GET /compute/v2.1/servers/48df7db9-a805-4c72-a1a5-29632b00248c => generated 1367 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:42:47.192717 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-12f3e779-d0a5-47fa-beaf-d0e23aa19e67 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:47.193655 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-12f3e779-d0a5-47fa-beaf-d0e23aa19e67 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] [instance: dfb8f504-218a-471c-b7a8-70c498769f0e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:47.215185 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-12f3e779-d0a5-47fa-beaf-d0e23aa19e67 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:47.221430 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-12f3e779-d0a5-47fa-beaf-d0e23aa19e67 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:47.222242 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-12f3e779-d0a5-47fa-beaf-d0e23aa19e67 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:47.223565 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-12f3e779-d0a5-47fa-beaf-d0e23aa19e67 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:47.224590 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-12f3e779-d0a5-47fa-beaf-d0e23aa19e67 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:47.226401 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-12f3e779-d0a5-47fa-beaf-d0e23aa19e67 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:47.575168 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-12f3e779-d0a5-47fa-beaf-d0e23aa19e67 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542c9592c76c4d4b9f3f16cea354398d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf77b55dfd8452e949229e4eb085283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:47.592341 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-12f3e779-d0a5-47fa-beaf-d0e23aa19e67 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] 10.222.0.33 "GET /compute/v2.1/servers/dfb8f504-218a-471c-b7a8-70c498769f0e" status: 200 len: 1680 microversion: 2.1 time: 0.403846 Sep 23 04:42:47.593175 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1424/2832] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:42:47 2022] GET /compute/v2.1/servers/dfb8f504-218a-471c-b7a8-70c498769f0e => generated 1680 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:42:48.008377 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7755dd60-9b7d-4871-899d-a64a052db00d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:48.008999 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7755dd60-9b7d-4871-899d-a64a052db00d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 3c54457b-bab9-4a3e-bb6f-d0723dfbebf4] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:48.024383 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7755dd60-9b7d-4871-899d-a64a052db00d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:48.027994 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7755dd60-9b7d-4871-899d-a64a052db00d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:48.033785 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9084939e-c969-4282-af5f-42eee3a7dea0 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:48.035015 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-9084939e-c969-4282-af5f-42eee3a7dea0 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] [instance: 48df7db9-a805-4c72-a1a5-29632b00248c] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:48.037848 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:42:48.040767 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7755dd60-9b7d-4871-899d-a64a052db00d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:48.041644 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7755dd60-9b7d-4871-899d-a64a052db00d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:48.042166 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7755dd60-9b7d-4871-899d-a64a052db00d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:48.046571 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7755dd60-9b7d-4871-899d-a64a052db00d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:48.079016 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9084939e-c969-4282-af5f-42eee3a7dea0 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:48.079016 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9084939e-c969-4282-af5f-42eee3a7dea0 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:48.079200 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9084939e-c969-4282-af5f-42eee3a7dea0 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:48.080648 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9084939e-c969-4282-af5f-42eee3a7dea0 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:48.081179 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9084939e-c969-4282-af5f-42eee3a7dea0 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:48.081622 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9084939e-c969-4282-af5f-42eee3a7dea0 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:48.447541 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-7755dd60-9b7d-4871-899d-a64a052db00d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:48.455756 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7755dd60-9b7d-4871-899d-a64a052db00d tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/3c54457b-bab9-4a3e-bb6f-d0723dfbebf4" status: 200 len: 1499 microversion: 2.1 time: 0.451820 Sep 23 04:42:48.473364 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1409/2833] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:42:48 2022] GET /compute/v2.1/servers/3c54457b-bab9-4a3e-bb6f-d0723dfbebf4 => generated 1499 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:42:48.484540 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-8d990d36-7001-405c-af3a-c00cbc8ec210 req-c5832222-034b-48db-bd69-a7999d048890 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48df7db9-a805-4c72-a1a5-29632b00248c", "name": "network-vif-plugged", "status": "completed", "tag": "26df0c1e-53e4-4613-b218-9ca9a68bcbbc"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:42:48.499182 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-8d990d36-7001-405c-af3a-c00cbc8ec210 req-c5832222-034b-48db-bd69-a7999d048890 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:48.499387 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-9084939e-c969-4282-af5f-42eee3a7dea0 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e235519204b4efc8b6c7e2988fab9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0b7307c30a4c118da4c501691e349f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:48.500442 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-8d990d36-7001-405c-af3a-c00cbc8ec210 req-c5832222-034b-48db-bd69-a7999d048890 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:48.501181 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-8d990d36-7001-405c-af3a-c00cbc8ec210 req-c5832222-034b-48db-bd69-a7999d048890 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:48.507463 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-9084939e-c969-4282-af5f-42eee3a7dea0 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] 10.222.0.33 "GET /compute/v2.1/servers/48df7db9-a805-4c72-a1a5-29632b00248c" status: 200 len: 1367 microversion: 2.1 time: 0.477487 Sep 23 04:42:48.513114 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1425/2834] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:42:48 2022] GET /compute/v2.1/servers/48df7db9-a805-4c72-a1a5-29632b00248c => generated 1367 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:42:48.523716 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-8d990d36-7001-405c-af3a-c00cbc8ec210 req-c5832222-034b-48db-bd69-a7999d048890 service nova] Creating event network-vif-plugged:26df0c1e-53e4-4613-b218-9ca9a68bcbbc for instance 48df7db9-a805-4c72-a1a5-29632b00248c on n-h1-846463-3 Sep 23 04:42:48.529908 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-8d990d36-7001-405c-af3a-c00cbc8ec210 req-c5832222-034b-48db-bd69-a7999d048890 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050442 Sep 23 04:42:48.535337 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1410/2835] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:42:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:42:48.615291 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-bd392850-5761-4824-ac79-feef931dd110 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:48.622682 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-bd392850-5761-4824-ac79-feef931dd110 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] [instance: dfb8f504-218a-471c-b7a8-70c498769f0e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:48.623377 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bd392850-5761-4824-ac79-feef931dd110 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:48.624330 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bd392850-5761-4824-ac79-feef931dd110 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:48.624854 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bd392850-5761-4824-ac79-feef931dd110 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:48.625720 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bd392850-5761-4824-ac79-feef931dd110 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:48.626437 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bd392850-5761-4824-ac79-feef931dd110 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:48.627036 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bd392850-5761-4824-ac79-feef931dd110 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:48.907338 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-bd392850-5761-4824-ac79-feef931dd110 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542c9592c76c4d4b9f3f16cea354398d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf77b55dfd8452e949229e4eb085283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:48.919185 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-bd392850-5761-4824-ac79-feef931dd110 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] 10.222.0.33 "GET /compute/v2.1/servers/dfb8f504-218a-471c-b7a8-70c498769f0e" status: 200 len: 1680 microversion: 2.1 time: 0.307596 Sep 23 04:42:48.934898 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1426/2836] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:42:48 2022] GET /compute/v2.1/servers/dfb8f504-218a-471c-b7a8-70c498769f0e => generated 1680 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:42:49.486403 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e5b3b6b9-8e67-476b-9b11-fcebf0c57db1 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:49.487112 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e5b3b6b9-8e67-476b-9b11-fcebf0c57db1 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 3c54457b-bab9-4a3e-bb6f-d0723dfbebf4] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:49.499815 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e5b3b6b9-8e67-476b-9b11-fcebf0c57db1 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:49.499815 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e5b3b6b9-8e67-476b-9b11-fcebf0c57db1 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:49.499815 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e5b3b6b9-8e67-476b-9b11-fcebf0c57db1 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:49.499815 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e5b3b6b9-8e67-476b-9b11-fcebf0c57db1 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:49.499815 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e5b3b6b9-8e67-476b-9b11-fcebf0c57db1 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:49.499815 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e5b3b6b9-8e67-476b-9b11-fcebf0c57db1 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:49.538527 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9621417f-12b5-4994-ad33-c2b5e2454046 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:49.540123 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-9621417f-12b5-4994-ad33-c2b5e2454046 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] [instance: 48df7db9-a805-4c72-a1a5-29632b00248c] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:49.545934 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9621417f-12b5-4994-ad33-c2b5e2454046 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:49.546681 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9621417f-12b5-4994-ad33-c2b5e2454046 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:49.547285 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9621417f-12b5-4994-ad33-c2b5e2454046 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:49.551033 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9621417f-12b5-4994-ad33-c2b5e2454046 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:49.552121 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9621417f-12b5-4994-ad33-c2b5e2454046 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:49.552827 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9621417f-12b5-4994-ad33-c2b5e2454046 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:49.616210 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e5b3b6b9-8e67-476b-9b11-fcebf0c57db1 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:49.627525 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e5b3b6b9-8e67-476b-9b11-fcebf0c57db1 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/3c54457b-bab9-4a3e-bb6f-d0723dfbebf4" status: 200 len: 1457 microversion: 2.1 time: 0.146341 Sep 23 04:42:49.628124 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1411/2837] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:42:49 2022] GET /compute/v2.1/servers/3c54457b-bab9-4a3e-bb6f-d0723dfbebf4 => generated 1457 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:42:49.802873 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-9621417f-12b5-4994-ad33-c2b5e2454046 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e235519204b4efc8b6c7e2988fab9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0b7307c30a4c118da4c501691e349f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:49.804161 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c2b2a76a-a942-4066-b900-2734a3dcafe3 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-656947869", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "networks": "none"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:42:49.821999 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-9621417f-12b5-4994-ad33-c2b5e2454046 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] 10.222.0.33 "GET /compute/v2.1/servers/48df7db9-a805-4c72-a1a5-29632b00248c" status: 200 len: 1367 microversion: 2.1 time: 0.278191 Sep 23 04:42:49.821999 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1427/2838] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:42:49 2022] GET /compute/v2.1/servers/48df7db9-a805-4c72-a1a5-29632b00248c => generated 1367 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:42:49.893916 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-c092da60-1aa3-4d52-9224-ef2737767205 req-7bcfee63-9466-4e83-b7c1-cdd85325493e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c54457b-bab9-4a3e-bb6f-d0723dfbebf4", "name": "network-vif-deleted", "tag": "50746c1a-5edd-4880-85e5-6ef1b5511e58"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:42:49.913445 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-c2b2a76a-a942-4066-b900-2734a3dcafe3 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Flavor limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:42:49.914228 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-c2b2a76a-a942-4066-b900-2734a3dcafe3 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Image limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:42:49.914876 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-c2b2a76a-a942-4066-b900-2734a3dcafe3 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Flavor pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:42:49.919978 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-c092da60-1aa3-4d52-9224-ef2737767205 req-7bcfee63-9466-4e83-b7c1-cdd85325493e service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:49.919978 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-c092da60-1aa3-4d52-9224-ef2737767205 req-7bcfee63-9466-4e83-b7c1-cdd85325493e service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:49.919978 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-c092da60-1aa3-4d52-9224-ef2737767205 req-7bcfee63-9466-4e83-b7c1-cdd85325493e service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:49.920245 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-c2b2a76a-a942-4066-b900-2734a3dcafe3 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Image pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:42:49.920245 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-c2b2a76a-a942-4066-b900-2734a3dcafe3 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:42:49.936264 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-c092da60-1aa3-4d52-9224-ef2737767205 req-7bcfee63-9466-4e83-b7c1-cdd85325493e service nova] Creating event network-vif-deleted:50746c1a-5edd-4880-85e5-6ef1b5511e58 for instance 3c54457b-bab9-4a3e-bb6f-d0723dfbebf4 on n-h2-846463-3 Sep 23 04:42:49.947807 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-c092da60-1aa3-4d52-9224-ef2737767205 req-7bcfee63-9466-4e83-b7c1-cdd85325493e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058921 Sep 23 04:42:49.951881 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1428/2839] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:42:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:42:49.961607 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2e839985-ebf3-4f77-a893-bad4f8ad4d1a tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:49.962375 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-2e839985-ebf3-4f77-a893-bad4f8ad4d1a tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] [instance: dfb8f504-218a-471c-b7a8-70c498769f0e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:49.971850 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c2b2a76a-a942-4066-b900-2734a3dcafe3 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:49.973088 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c2b2a76a-a942-4066-b900-2734a3dcafe3 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:49.973550 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c2b2a76a-a942-4066-b900-2734a3dcafe3 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:49.974392 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c2b2a76a-a942-4066-b900-2734a3dcafe3 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:49.977023 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c2b2a76a-a942-4066-b900-2734a3dcafe3 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:49.977475 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c2b2a76a-a942-4066-b900-2734a3dcafe3 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:49.978681 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2e839985-ebf3-4f77-a893-bad4f8ad4d1a tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:49.982873 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2e839985-ebf3-4f77-a893-bad4f8ad4d1a tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:49.982873 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2e839985-ebf3-4f77-a893-bad4f8ad4d1a tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:49.982873 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2e839985-ebf3-4f77-a893-bad4f8ad4d1a tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:49.982873 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2e839985-ebf3-4f77-a893-bad4f8ad4d1a tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:49.983366 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2e839985-ebf3-4f77-a893-bad4f8ad4d1a tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:50.007776 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-c2b2a76a-a942-4066-b900-2734a3dcafe3 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Getting quotas for project 0f66ca22a6f24928840a07e889f2e740. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:42:50.015496 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-c2b2a76a-a942-4066-b900-2734a3dcafe3 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Getting quotas for user 6fd00d7cc82d4ec0b9b36fe2bb0be056 and project 0f66ca22a6f24928840a07e889f2e740. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:42:50.032381 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c2b2a76a-a942-4066-b900-2734a3dcafe3 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Going to run 1 instances... {{(pid=122698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:42:50.035616 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c2b2a76a-a942-4066-b900-2734a3dcafe3 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] [instance: 17bcb29e-d024-484c-ade0-793ef585ae96] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:42:50.106492 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2e839985-ebf3-4f77-a893-bad4f8ad4d1a tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542c9592c76c4d4b9f3f16cea354398d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf77b55dfd8452e949229e4eb085283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:50.115196 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2e839985-ebf3-4f77-a893-bad4f8ad4d1a tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] 10.222.0.33 "GET /compute/v2.1/servers/dfb8f504-218a-471c-b7a8-70c498769f0e" status: 200 len: 1613 microversion: 2.1 time: 0.162060 Sep 23 04:42:50.120289 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1429/2840] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:42:49 2022] GET /compute/v2.1/servers/dfb8f504-218a-471c-b7a8-70c498769f0e => generated 1613 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:42:50.182912 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c2b2a76a-a942-4066-b900-2734a3dcafe3 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.553500 Sep 23 04:42:50.197460 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-253c5a8e-bd67-4431-b05f-f41373d39c0f tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:50.198129 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-253c5a8e-bd67-4431-b05f-f41373d39c0f tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] [instance: 17bcb29e-d024-484c-ade0-793ef585ae96] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:50.202013 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1412/2841] 10.222.0.33 () {62 vars in 1188 bytes} [Fri Sep 23 04:42:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 573 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 23 04:42:50.337851 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-253c5a8e-bd67-4431-b05f-f41373d39c0f tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd00d7cc82d4ec0b9b36fe2bb0be056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f66ca22a6f24928840a07e889f2e740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:50.347464 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-253c5a8e-bd67-4431-b05f-f41373d39c0f tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6fd00d7cc82d4ec0b9b36fe2bb0be056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f66ca22a6f24928840a07e889f2e740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:50.361527 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-253c5a8e-bd67-4431-b05f-f41373d39c0f tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6fd00d7cc82d4ec0b9b36fe2bb0be056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f66ca22a6f24928840a07e889f2e740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:50.361527 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-253c5a8e-bd67-4431-b05f-f41373d39c0f tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] 10.222.0.33 "GET /compute/v2.1/servers/17bcb29e-d024-484c-ade0-793ef585ae96" status: 200 len: 1280 microversion: 2.47 time: 0.168354 Sep 23 04:42:50.362793 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1430/2842] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:42:50 2022] GET /compute/v2.1/servers/17bcb29e-d024-484c-ade0-793ef585ae96 => generated 1280 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:42:50.655549 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-809439b9-2e37-4ed5-ae2f-d9be461ac8b0 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:50.656167 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-809439b9-2e37-4ed5-ae2f-d9be461ac8b0 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 3c54457b-bab9-4a3e-bb6f-d0723dfbebf4] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:50.666375 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-809439b9-2e37-4ed5-ae2f-d9be461ac8b0 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:50.666876 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-809439b9-2e37-4ed5-ae2f-d9be461ac8b0 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:50.667326 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-809439b9-2e37-4ed5-ae2f-d9be461ac8b0 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:50.668052 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-809439b9-2e37-4ed5-ae2f-d9be461ac8b0 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:50.668590 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-809439b9-2e37-4ed5-ae2f-d9be461ac8b0 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:50.669026 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-809439b9-2e37-4ed5-ae2f-d9be461ac8b0 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:50.673391 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:42:50.720903 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-809439b9-2e37-4ed5-ae2f-d9be461ac8b0 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:50.721515 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-809439b9-2e37-4ed5-ae2f-d9be461ac8b0 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:50.722096 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-809439b9-2e37-4ed5-ae2f-d9be461ac8b0 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:50.722802 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-809439b9-2e37-4ed5-ae2f-d9be461ac8b0 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lazy-loading 'fault' on Instance uuid 3c54457b-bab9-4a3e-bb6f-d0723dfbebf4 {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:42:50.770168 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-809439b9-2e37-4ed5-ae2f-d9be461ac8b0 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36526fe612c840fb907e1992d8e62538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe698721372f40888dc2918c46e65f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:50.781110 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-809439b9-2e37-4ed5-ae2f-d9be461ac8b0 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/3c54457b-bab9-4a3e-bb6f-d0723dfbebf4" status: 200 len: 1305 microversion: 2.1 time: 0.129163 Sep 23 04:42:50.781715 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1413/2843] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:42:50 2022] GET /compute/v2.1/servers/3c54457b-bab9-4a3e-bb6f-d0723dfbebf4 => generated 1305 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:42:50.838286 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8e820e0c-e60b-4133-b86d-2a9e853803a8 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:50.841406 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-8e820e0c-e60b-4133-b86d-2a9e853803a8 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] [instance: 48df7db9-a805-4c72-a1a5-29632b00248c] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:50.868966 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8e820e0c-e60b-4133-b86d-2a9e853803a8 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:50.871642 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8e820e0c-e60b-4133-b86d-2a9e853803a8 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:50.872377 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8e820e0c-e60b-4133-b86d-2a9e853803a8 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:50.875053 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8e820e0c-e60b-4133-b86d-2a9e853803a8 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:50.875636 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8e820e0c-e60b-4133-b86d-2a9e853803a8 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:50.876515 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8e820e0c-e60b-4133-b86d-2a9e853803a8 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:50.888180 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:42:51.151708 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-59e57daa-730e-4711-8bd9-b31fae015b1e tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:51.154439 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-59e57daa-730e-4711-8bd9-b31fae015b1e tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] [instance: dfb8f504-218a-471c-b7a8-70c498769f0e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:51.162835 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-8e820e0c-e60b-4133-b86d-2a9e853803a8 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e235519204b4efc8b6c7e2988fab9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0b7307c30a4c118da4c501691e349f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:51.177808 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-8e820e0c-e60b-4133-b86d-2a9e853803a8 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] 10.222.0.33 "GET /compute/v2.1/servers/48df7db9-a805-4c72-a1a5-29632b00248c" status: 200 len: 1367 microversion: 2.1 time: 0.341817 Sep 23 04:42:51.179553 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1431/2844] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:42:50 2022] GET /compute/v2.1/servers/48df7db9-a805-4c72-a1a5-29632b00248c => generated 1367 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:42:51.182396 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-59e57daa-730e-4711-8bd9-b31fae015b1e tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:51.184686 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-59e57daa-730e-4711-8bd9-b31fae015b1e tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:51.186497 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-59e57daa-730e-4711-8bd9-b31fae015b1e tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:51.187654 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-59e57daa-730e-4711-8bd9-b31fae015b1e tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:51.190521 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-59e57daa-730e-4711-8bd9-b31fae015b1e tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:51.191735 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-59e57daa-730e-4711-8bd9-b31fae015b1e tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:51.296276 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-59e57daa-730e-4711-8bd9-b31fae015b1e tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542c9592c76c4d4b9f3f16cea354398d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf77b55dfd8452e949229e4eb085283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:51.312689 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-59e57daa-730e-4711-8bd9-b31fae015b1e tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] 10.222.0.33 "GET /compute/v2.1/servers/dfb8f504-218a-471c-b7a8-70c498769f0e" status: 200 len: 1613 microversion: 2.1 time: 0.169518 Sep 23 04:42:51.314325 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1414/2845] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:42:51 2022] GET /compute/v2.1/servers/dfb8f504-218a-471c-b7a8-70c498769f0e => generated 1613 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:42:51.396879 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-16cbcac5-5a8d-482c-9d35-c26dfe62297a tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:51.397513 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-16cbcac5-5a8d-482c-9d35-c26dfe62297a tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] [instance: 17bcb29e-d024-484c-ade0-793ef585ae96] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:51.510936 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-16cbcac5-5a8d-482c-9d35-c26dfe62297a tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd00d7cc82d4ec0b9b36fe2bb0be056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f66ca22a6f24928840a07e889f2e740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:51.519736 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-16cbcac5-5a8d-482c-9d35-c26dfe62297a tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6fd00d7cc82d4ec0b9b36fe2bb0be056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f66ca22a6f24928840a07e889f2e740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:51.521227 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-16cbcac5-5a8d-482c-9d35-c26dfe62297a tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6fd00d7cc82d4ec0b9b36fe2bb0be056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f66ca22a6f24928840a07e889f2e740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:51.522497 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-16cbcac5-5a8d-482c-9d35-c26dfe62297a tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] 10.222.0.33 "GET /compute/v2.1/servers/17bcb29e-d024-484c-ade0-793ef585ae96" status: 200 len: 1280 microversion: 2.47 time: 0.129927 Sep 23 04:42:51.523083 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1432/2846] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:42:51 2022] GET /compute/v2.1/servers/17bcb29e-d024-484c-ade0-793ef585ae96 => generated 1280 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:42:51.812825 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-18894226-651d-4817-986e-5102dd7aa04f tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:51.813372 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-18894226-651d-4817-986e-5102dd7aa04f tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 3c54457b-bab9-4a3e-bb6f-d0723dfbebf4] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:51.826249 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-18894226-651d-4817-986e-5102dd7aa04f tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:51.827424 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-18894226-651d-4817-986e-5102dd7aa04f tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:51.828151 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-18894226-651d-4817-986e-5102dd7aa04f tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:51.829444 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-18894226-651d-4817-986e-5102dd7aa04f tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:51.829976 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-18894226-651d-4817-986e-5102dd7aa04f tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:51.830513 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-18894226-651d-4817-986e-5102dd7aa04f tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:51.858300 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-18894226-651d-4817-986e-5102dd7aa04f tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] HTTP exception thrown: Instance 3c54457b-bab9-4a3e-bb6f-d0723dfbebf4 could not be found. Sep 23 04:42:51.860423 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-18894226-651d-4817-986e-5102dd7aa04f tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Request method failure captured: Sep 23 04:42:51.860423 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/3c54457b-bab9-4a3e-bb6f-d0723dfbebf4 HTTP/1.1 Sep 23 04:42:51.860423 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:42:51.860423 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:42:51.860423 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:42:51.860423 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:42:51.860423 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:42:51.860423 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:42:51.860423 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:42:51.860423 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:42:51.860423 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTgD-AJZNKtluGEJNjQKU0pcHtUCc1AZ8Ycz4MPGIeanw2_GglRmvn8LiMCEayIX86yw_RpyCC_JZrlVGSjhSgenUVZhpJ_MqN5SLmcv6Qnl3N6cXWJgtCK8N_ffRhD1dYgLIdHHgnmyTAptDZsjatOWU1ocTU40JP9XOpkK3deqL7A Sep 23 04:42:51.860423 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:42:51.860423 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:42:51.860423 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:42:51.860423 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:42:51.860423 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:42:51.860423 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:42:51.860423 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: fe698721372f40888dc2918c46e65f2f Sep 23 04:42:51.860423 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-DeleteServersTestJSON-347759205 Sep 23 04:42:51.860423 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:42:51.860423 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:42:51.860423 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fe698721372f40888dc2918c46e65f2f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe698721372f40888dc2918c46e65f2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fe698721372f40888dc2918c46e65f2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe698721372f40888dc2918c46e65f2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:42:51.860423 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-DeleteServersTestJSON-347759205 Sep 23 04:42:51.860423 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: fe698721372f40888dc2918c46e65f2f Sep 23 04:42:51.860423 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-DeleteServersTestJSON-347759205 Sep 23 04:42:51.860423 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-DeleteServersTestJSON-347759205-project Sep 23 04:42:51.860423 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:42:51.860423 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:42:51.860423 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 36526fe612c840fb907e1992d8e62538 Sep 23 04:42:51.860423 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-DeleteServersTestJSON-347759205-project Sep 23 04:42:51.860423 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:42:51.860423 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 3c54457b-bab9-4a3e-bb6f-d0723dfbebf4 could not be found. Sep 23 04:42:51.860423 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '3c54457b-bab9-4a3e-bb6f-d0723dfbebf4'} Sep 23 04:42:51.860423 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:42:51.860423 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:42:51.860423 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:42:51.860423 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:42:51.860423 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:42:51.860423 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:42:51.860423 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:42:51.860423 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:42:51.860423 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:42:51.860423 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:42:51.860423 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c54457b-bab9-4a3e-bb6f-d0723dfbebf4 could not be found. Sep 23 04:42:51.860423 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:42:51.860423 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:42:51.860423 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:42:51.860423 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:42:51.860423 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:42:51.860423 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:42:51.860423 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:42:51.860423 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:42:51.860423 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:42:51.860423 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:42:51.860423 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:42:51.860423 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:42:51.860423 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:42:51.860423 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:42:51.860423 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:42:51.860423 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:42:51.860423 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c54457b-bab9-4a3e-bb6f-d0723dfbebf4 could not be found. Sep 23 04:42:51.860423 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:42:51.860423 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:42:51.860423 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:42:51.864229 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:42:51.864229 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:42:51.864229 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:42:51.864229 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:42:51.864229 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:42:51.864229 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c54457b-bab9-4a3e-bb6f-d0723dfbebf4 could not be found. Sep 23 04:42:51.864229 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:42:51.864229 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-18894226-651d-4817-986e-5102dd7aa04f tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Returning 404 to user: Instance 3c54457b-bab9-4a3e-bb6f-d0723dfbebf4 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:42:51.864229 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-18894226-651d-4817-986e-5102dd7aa04f tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/3c54457b-bab9-4a3e-bb6f-d0723dfbebf4" status: 404 len: 111 microversion: 2.1 time: 0.053268 Sep 23 04:42:51.866924 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1415/2847] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:42:51 2022] GET /compute/v2.1/servers/3c54457b-bab9-4a3e-bb6f-d0723dfbebf4 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:42:51.881797 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d9548afb-ea29-44d3-94d0-0396c94070c0 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:51.882344 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d9548afb-ea29-44d3-94d0-0396c94070c0 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 3c54457b-bab9-4a3e-bb6f-d0723dfbebf4] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:51.893663 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d9548afb-ea29-44d3-94d0-0396c94070c0 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:51.894207 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d9548afb-ea29-44d3-94d0-0396c94070c0 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:51.894660 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d9548afb-ea29-44d3-94d0-0396c94070c0 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:51.895385 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d9548afb-ea29-44d3-94d0-0396c94070c0 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:51.895857 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d9548afb-ea29-44d3-94d0-0396c94070c0 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:51.896295 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d9548afb-ea29-44d3-94d0-0396c94070c0 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:51.938979 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-d9548afb-ea29-44d3-94d0-0396c94070c0 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] HTTP exception thrown: Instance 3c54457b-bab9-4a3e-bb6f-d0723dfbebf4 could not be found. Sep 23 04:42:51.942313 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d9548afb-ea29-44d3-94d0-0396c94070c0 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Request method failure captured: Sep 23 04:42:51.942313 n-d-846463-3 devstack@n-api.service[122699]: request: DELETE /compute/v2.1/servers/3c54457b-bab9-4a3e-bb6f-d0723dfbebf4 HTTP/1.1 Sep 23 04:42:51.942313 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:42:51.942313 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:42:51.942313 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:42:51.942313 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:42:51.942313 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:42:51.942313 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:42:51.942313 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:42:51.942313 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:42:51.942313 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTgD-AJZNKtluGEJNjQKU0pcHtUCc1AZ8Ycz4MPGIeanw2_GglRmvn8LiMCEayIX86yw_RpyCC_JZrlVGSjhSgenUVZhpJ_MqN5SLmcv6Qnl3N6cXWJgtCK8N_ffRhD1dYgLIdHHgnmyTAptDZsjatOWU1ocTU40JP9XOpkK3deqL7A Sep 23 04:42:51.942313 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:42:51.942313 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:42:51.942313 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:42:51.942313 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:42:51.942313 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:42:51.942313 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:42:51.942313 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: fe698721372f40888dc2918c46e65f2f Sep 23 04:42:51.942313 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-DeleteServersTestJSON-347759205 Sep 23 04:42:51.942313 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:42:51.942313 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:42:51.942313 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fe698721372f40888dc2918c46e65f2f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe698721372f40888dc2918c46e65f2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fe698721372f40888dc2918c46e65f2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe698721372f40888dc2918c46e65f2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:42:51.942313 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-DeleteServersTestJSON-347759205 Sep 23 04:42:51.942313 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: fe698721372f40888dc2918c46e65f2f Sep 23 04:42:51.942313 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-DeleteServersTestJSON-347759205 Sep 23 04:42:51.942313 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-DeleteServersTestJSON-347759205-project Sep 23 04:42:51.942313 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:42:51.942313 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:42:51.942313 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 36526fe612c840fb907e1992d8e62538 Sep 23 04:42:51.942313 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-DeleteServersTestJSON-347759205-project Sep 23 04:42:51.942313 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:42:51.942313 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 3c54457b-bab9-4a3e-bb6f-d0723dfbebf4 could not be found. Sep 23 04:42:51.942313 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '3c54457b-bab9-4a3e-bb6f-d0723dfbebf4'} Sep 23 04:42:51.942313 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:42:51.942313 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:42:51.942313 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:42:51.942313 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:42:51.942313 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:42:51.942313 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:42:51.942313 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:42:51.942313 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:42:51.942313 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:42:51.942313 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:42:51.942313 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c54457b-bab9-4a3e-bb6f-d0723dfbebf4 could not be found. Sep 23 04:42:51.942313 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:42:51.942313 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:42:51.942313 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:42:51.942313 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:42:51.942313 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:42:51.942313 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:42:51.942313 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:42:51.942313 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:42:51.942313 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:42:51.942313 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:42:51.942313 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 04:42:51.942313 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 04:42:51.942313 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 04:42:51.942313 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 04:42:51.942313 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:42:51.942313 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:42:51.942313 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:42:51.942313 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:42:51.946000 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c54457b-bab9-4a3e-bb6f-d0723dfbebf4 could not be found. Sep 23 04:42:51.946000 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:42:51.946000 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:42:51.946000 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:42:51.946000 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:42:51.946000 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:42:51.946000 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:42:51.946000 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:42:51.946000 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:42:51.946000 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c54457b-bab9-4a3e-bb6f-d0723dfbebf4 could not be found. Sep 23 04:42:51.946000 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:42:51.949273 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d9548afb-ea29-44d3-94d0-0396c94070c0 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Returning 404 to user: Instance 3c54457b-bab9-4a3e-bb6f-d0723dfbebf4 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:42:51.950799 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d9548afb-ea29-44d3-94d0-0396c94070c0 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "DELETE /compute/v2.1/servers/3c54457b-bab9-4a3e-bb6f-d0723dfbebf4" status: 404 len: 111 microversion: 2.1 time: 0.076824 Sep 23 04:42:51.951947 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1433/2848] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:42:51 2022] DELETE /compute/v2.1/servers/3c54457b-bab9-4a3e-bb6f-d0723dfbebf4 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:42:51.960672 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-598f0730-9564-455a-b6d9-0c79c7cf9b03 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:51.980266 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-598f0730-9564-455a-b6d9-0c79c7cf9b03 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 3c54457b-bab9-4a3e-bb6f-d0723dfbebf4] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:51.980266 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-598f0730-9564-455a-b6d9-0c79c7cf9b03 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:51.980266 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-598f0730-9564-455a-b6d9-0c79c7cf9b03 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:51.980266 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-598f0730-9564-455a-b6d9-0c79c7cf9b03 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:51.980266 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-598f0730-9564-455a-b6d9-0c79c7cf9b03 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:51.980266 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-598f0730-9564-455a-b6d9-0c79c7cf9b03 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:51.980266 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-598f0730-9564-455a-b6d9-0c79c7cf9b03 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:51.988079 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-598f0730-9564-455a-b6d9-0c79c7cf9b03 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] HTTP exception thrown: Instance 3c54457b-bab9-4a3e-bb6f-d0723dfbebf4 could not be found. Sep 23 04:42:51.989828 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-598f0730-9564-455a-b6d9-0c79c7cf9b03 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Request method failure captured: Sep 23 04:42:51.989828 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/3c54457b-bab9-4a3e-bb6f-d0723dfbebf4 HTTP/1.1 Sep 23 04:42:51.989828 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:42:51.989828 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:42:51.989828 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:42:51.989828 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:42:51.989828 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:42:51.989828 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:42:51.989828 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:42:51.989828 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:42:51.989828 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTgD-AJZNKtluGEJNjQKU0pcHtUCc1AZ8Ycz4MPGIeanw2_GglRmvn8LiMCEayIX86yw_RpyCC_JZrlVGSjhSgenUVZhpJ_MqN5SLmcv6Qnl3N6cXWJgtCK8N_ffRhD1dYgLIdHHgnmyTAptDZsjatOWU1ocTU40JP9XOpkK3deqL7A Sep 23 04:42:51.989828 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:42:51.989828 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:42:51.989828 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:42:51.989828 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:42:51.989828 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:42:51.989828 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:42:51.989828 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: fe698721372f40888dc2918c46e65f2f Sep 23 04:42:51.989828 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-DeleteServersTestJSON-347759205 Sep 23 04:42:51.989828 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:42:51.989828 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:42:51.989828 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fe698721372f40888dc2918c46e65f2f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe698721372f40888dc2918c46e65f2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fe698721372f40888dc2918c46e65f2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe698721372f40888dc2918c46e65f2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:42:51.989828 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-DeleteServersTestJSON-347759205 Sep 23 04:42:51.989828 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: fe698721372f40888dc2918c46e65f2f Sep 23 04:42:51.989828 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-DeleteServersTestJSON-347759205 Sep 23 04:42:51.989828 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-DeleteServersTestJSON-347759205-project Sep 23 04:42:51.989828 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:42:51.989828 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:42:51.989828 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 36526fe612c840fb907e1992d8e62538 Sep 23 04:42:51.989828 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-DeleteServersTestJSON-347759205-project Sep 23 04:42:51.989828 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:42:51.989828 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 3c54457b-bab9-4a3e-bb6f-d0723dfbebf4 could not be found. Sep 23 04:42:51.989828 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '3c54457b-bab9-4a3e-bb6f-d0723dfbebf4'} Sep 23 04:42:51.989828 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:42:51.989828 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:42:51.989828 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:42:51.989828 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:42:51.989828 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:42:51.989828 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:42:51.989828 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:42:51.989828 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:42:51.989828 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:42:51.989828 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:42:51.989828 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c54457b-bab9-4a3e-bb6f-d0723dfbebf4 could not be found. Sep 23 04:42:51.989828 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:42:51.989828 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:42:51.989828 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:42:51.989828 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:42:51.989828 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:42:51.989828 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:42:51.989828 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:42:51.989828 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:42:51.989828 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:42:51.989828 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:42:51.989828 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:42:51.989828 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:42:51.989828 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:42:51.989828 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:42:51.989828 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:42:51.989828 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:42:51.989828 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c54457b-bab9-4a3e-bb6f-d0723dfbebf4 could not be found. Sep 23 04:42:51.989828 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:42:51.989828 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:42:51.989828 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:42:51.994578 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:42:51.994578 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:42:51.994578 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:42:51.994578 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:42:51.994578 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:42:51.994578 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c54457b-bab9-4a3e-bb6f-d0723dfbebf4 could not be found. Sep 23 04:42:51.994578 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:42:52.026375 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-e7fad3a1-b678-4c06-86f1-3930f03fe65e req-0f47a661-3fcd-4149-ba81-979e9fde8dc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfb8f504-218a-471c-b7a8-70c498769f0e", "name": "network-vif-deleted", "tag": "e03d6cb1-0498-436c-ab0a-43f410f1eaf8"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:42:52.034682 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-598f0730-9564-455a-b6d9-0c79c7cf9b03 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Returning 404 to user: Instance 3c54457b-bab9-4a3e-bb6f-d0723dfbebf4 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:42:52.042555 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-598f0730-9564-455a-b6d9-0c79c7cf9b03 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/3c54457b-bab9-4a3e-bb6f-d0723dfbebf4" status: 404 len: 111 microversion: 2.1 time: 0.079444 Sep 23 04:42:52.043257 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1416/2849] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:42:51 2022] GET /compute/v2.1/servers/3c54457b-bab9-4a3e-bb6f-d0723dfbebf4 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:42:52.053290 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-e7fad3a1-b678-4c06-86f1-3930f03fe65e req-0f47a661-3fcd-4149-ba81-979e9fde8dc6 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:52.061293 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-e7fad3a1-b678-4c06-86f1-3930f03fe65e req-0f47a661-3fcd-4149-ba81-979e9fde8dc6 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:52.061720 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ccc02e0a-9d03-4215-92fd-178f1447f9a2 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:52.062162 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-e7fad3a1-b678-4c06-86f1-3930f03fe65e req-0f47a661-3fcd-4149-ba81-979e9fde8dc6 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:52.064901 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-ccc02e0a-9d03-4215-92fd-178f1447f9a2 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 8a6b2904-2edd-4e9e-b6fa-1d6249721f52] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:52.073211 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ccc02e0a-9d03-4215-92fd-178f1447f9a2 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:52.074152 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ccc02e0a-9d03-4215-92fd-178f1447f9a2 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:52.074884 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ccc02e0a-9d03-4215-92fd-178f1447f9a2 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:52.075979 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ccc02e0a-9d03-4215-92fd-178f1447f9a2 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:52.076682 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ccc02e0a-9d03-4215-92fd-178f1447f9a2 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:52.077334 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ccc02e0a-9d03-4215-92fd-178f1447f9a2 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:52.096615 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-ccc02e0a-9d03-4215-92fd-178f1447f9a2 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] HTTP exception thrown: Instance 8a6b2904-2edd-4e9e-b6fa-1d6249721f52 could not be found. Sep 23 04:42:52.099367 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ccc02e0a-9d03-4215-92fd-178f1447f9a2 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Request method failure captured: Sep 23 04:42:52.099367 n-d-846463-3 devstack@n-api.service[122698]: request: DELETE /compute/v2.1/servers/8a6b2904-2edd-4e9e-b6fa-1d6249721f52 HTTP/1.1 Sep 23 04:42:52.099367 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:42:52.099367 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:42:52.099367 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:42:52.099367 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:42:52.099367 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:42:52.099367 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:42:52.099367 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:42:52.099367 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:42:52.099367 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTgD-AJZNKtluGEJNjQKU0pcHtUCc1AZ8Ycz4MPGIeanw2_GglRmvn8LiMCEayIX86yw_RpyCC_JZrlVGSjhSgenUVZhpJ_MqN5SLmcv6Qnl3N6cXWJgtCK8N_ffRhD1dYgLIdHHgnmyTAptDZsjatOWU1ocTU40JP9XOpkK3deqL7A Sep 23 04:42:52.099367 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:42:52.099367 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:42:52.099367 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:42:52.099367 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:42:52.099367 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:42:52.099367 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:42:52.099367 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: fe698721372f40888dc2918c46e65f2f Sep 23 04:42:52.099367 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-DeleteServersTestJSON-347759205 Sep 23 04:42:52.099367 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:42:52.099367 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:42:52.099367 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fe698721372f40888dc2918c46e65f2f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe698721372f40888dc2918c46e65f2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fe698721372f40888dc2918c46e65f2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe698721372f40888dc2918c46e65f2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:42:52.099367 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-DeleteServersTestJSON-347759205 Sep 23 04:42:52.099367 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: fe698721372f40888dc2918c46e65f2f Sep 23 04:42:52.099367 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-DeleteServersTestJSON-347759205 Sep 23 04:42:52.099367 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-DeleteServersTestJSON-347759205-project Sep 23 04:42:52.099367 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:42:52.099367 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:42:52.099367 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 36526fe612c840fb907e1992d8e62538 Sep 23 04:42:52.099367 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-DeleteServersTestJSON-347759205-project Sep 23 04:42:52.099367 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:42:52.099367 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 8a6b2904-2edd-4e9e-b6fa-1d6249721f52 could not be found. Sep 23 04:42:52.099367 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '8a6b2904-2edd-4e9e-b6fa-1d6249721f52'} Sep 23 04:42:52.099367 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:42:52.099367 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:42:52.099367 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:42:52.099367 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:42:52.099367 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:42:52.099367 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:42:52.099367 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:42:52.099367 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:42:52.099367 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:42:52.099367 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:42:52.099367 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a6b2904-2edd-4e9e-b6fa-1d6249721f52 could not be found. Sep 23 04:42:52.099367 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:42:52.099367 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:42:52.099367 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:42:52.099367 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:42:52.099367 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:42:52.099367 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:42:52.099367 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:42:52.099367 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:42:52.099367 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:42:52.099367 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:42:52.099367 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 04:42:52.099367 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 04:42:52.099367 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 04:42:52.099367 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 04:42:52.099367 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:42:52.099367 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:42:52.099367 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:42:52.099367 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:42:52.104872 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a6b2904-2edd-4e9e-b6fa-1d6249721f52 could not be found. Sep 23 04:42:52.104872 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:42:52.104872 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:42:52.104872 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:42:52.104872 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:42:52.104872 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:42:52.104872 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:42:52.104872 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:42:52.104872 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:42:52.104872 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a6b2904-2edd-4e9e-b6fa-1d6249721f52 could not be found. Sep 23 04:42:52.104872 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:42:52.105675 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-e7fad3a1-b678-4c06-86f1-3930f03fe65e req-0f47a661-3fcd-4149-ba81-979e9fde8dc6 service nova] Creating event network-vif-deleted:e03d6cb1-0498-436c-ab0a-43f410f1eaf8 for instance dfb8f504-218a-471c-b7a8-70c498769f0e on n-h2-846463-3 Sep 23 04:42:52.106803 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ccc02e0a-9d03-4215-92fd-178f1447f9a2 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Returning 404 to user: Instance 8a6b2904-2edd-4e9e-b6fa-1d6249721f52 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:42:52.107917 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ccc02e0a-9d03-4215-92fd-178f1447f9a2 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "DELETE /compute/v2.1/servers/8a6b2904-2edd-4e9e-b6fa-1d6249721f52" status: 404 len: 111 microversion: 2.1 time: 0.058834 Sep 23 04:42:52.109072 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1417/2850] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:42:52 2022] DELETE /compute/v2.1/servers/8a6b2904-2edd-4e9e-b6fa-1d6249721f52 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:42:52.119705 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f6dc12c9-b4b4-485f-bbfe-cb6340f25c38 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:52.120710 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f6dc12c9-b4b4-485f-bbfe-cb6340f25c38 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 8a6b2904-2edd-4e9e-b6fa-1d6249721f52] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:52.122078 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-e7fad3a1-b678-4c06-86f1-3930f03fe65e req-0f47a661-3fcd-4149-ba81-979e9fde8dc6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117706 Sep 23 04:42:52.129352 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1434/2851] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:42:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:42:52.129494 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f6dc12c9-b4b4-485f-bbfe-cb6340f25c38 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:52.129494 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f6dc12c9-b4b4-485f-bbfe-cb6340f25c38 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:52.129494 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f6dc12c9-b4b4-485f-bbfe-cb6340f25c38 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:52.129494 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f6dc12c9-b4b4-485f-bbfe-cb6340f25c38 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:52.129805 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f6dc12c9-b4b4-485f-bbfe-cb6340f25c38 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:52.130720 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f6dc12c9-b4b4-485f-bbfe-cb6340f25c38 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:52.165185 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-f6dc12c9-b4b4-485f-bbfe-cb6340f25c38 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] HTTP exception thrown: Instance 8a6b2904-2edd-4e9e-b6fa-1d6249721f52 could not be found. Sep 23 04:42:52.171578 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f6dc12c9-b4b4-485f-bbfe-cb6340f25c38 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Request method failure captured: Sep 23 04:42:52.171578 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/8a6b2904-2edd-4e9e-b6fa-1d6249721f52 HTTP/1.1 Sep 23 04:42:52.171578 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:42:52.171578 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:42:52.171578 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:42:52.171578 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:42:52.171578 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:42:52.171578 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:42:52.171578 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:42:52.171578 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:42:52.171578 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTgD-AJZNKtluGEJNjQKU0pcHtUCc1AZ8Ycz4MPGIeanw2_GglRmvn8LiMCEayIX86yw_RpyCC_JZrlVGSjhSgenUVZhpJ_MqN5SLmcv6Qnl3N6cXWJgtCK8N_ffRhD1dYgLIdHHgnmyTAptDZsjatOWU1ocTU40JP9XOpkK3deqL7A Sep 23 04:42:52.171578 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:42:52.171578 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:42:52.171578 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:42:52.171578 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:42:52.171578 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:42:52.171578 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:42:52.171578 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: fe698721372f40888dc2918c46e65f2f Sep 23 04:42:52.171578 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-DeleteServersTestJSON-347759205 Sep 23 04:42:52.171578 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:42:52.171578 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:42:52.171578 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fe698721372f40888dc2918c46e65f2f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe698721372f40888dc2918c46e65f2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fe698721372f40888dc2918c46e65f2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe698721372f40888dc2918c46e65f2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:42:52.171578 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-DeleteServersTestJSON-347759205 Sep 23 04:42:52.171578 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: fe698721372f40888dc2918c46e65f2f Sep 23 04:42:52.171578 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-DeleteServersTestJSON-347759205 Sep 23 04:42:52.171578 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-DeleteServersTestJSON-347759205-project Sep 23 04:42:52.171578 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:42:52.171578 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:42:52.171578 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 36526fe612c840fb907e1992d8e62538 Sep 23 04:42:52.171578 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-DeleteServersTestJSON-347759205-project Sep 23 04:42:52.171578 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:42:52.171578 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 8a6b2904-2edd-4e9e-b6fa-1d6249721f52 could not be found. Sep 23 04:42:52.171578 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '8a6b2904-2edd-4e9e-b6fa-1d6249721f52'} Sep 23 04:42:52.171578 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:42:52.171578 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:42:52.171578 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:42:52.171578 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:42:52.171578 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:42:52.171578 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:42:52.171578 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:42:52.171578 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:42:52.171578 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:42:52.171578 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:42:52.171578 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a6b2904-2edd-4e9e-b6fa-1d6249721f52 could not be found. Sep 23 04:42:52.171578 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:42:52.171578 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:42:52.171578 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:42:52.171578 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:42:52.171578 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:42:52.171578 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:42:52.171578 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:42:52.171578 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:42:52.171578 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:42:52.171578 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:42:52.171578 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:42:52.171578 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:42:52.171578 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:42:52.171578 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:42:52.171578 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:42:52.171578 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:42:52.171578 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a6b2904-2edd-4e9e-b6fa-1d6249721f52 could not be found. Sep 23 04:42:52.171578 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:42:52.171578 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:42:52.171578 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:42:52.175398 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:42:52.175398 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:42:52.175398 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:42:52.175398 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:42:52.175398 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:42:52.175398 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a6b2904-2edd-4e9e-b6fa-1d6249721f52 could not be found. Sep 23 04:42:52.175398 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:42:52.175398 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f6dc12c9-b4b4-485f-bbfe-cb6340f25c38 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Returning 404 to user: Instance 8a6b2904-2edd-4e9e-b6fa-1d6249721f52 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:42:52.175398 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f6dc12c9-b4b4-485f-bbfe-cb6340f25c38 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/8a6b2904-2edd-4e9e-b6fa-1d6249721f52" status: 404 len: 111 microversion: 2.1 time: 0.059401 Sep 23 04:42:52.175398 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1418/2852] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:42:52 2022] GET /compute/v2.1/servers/8a6b2904-2edd-4e9e-b6fa-1d6249721f52 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 04:42:52.184956 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-30ff9ace-593b-4a22-82bb-8fe423408cb1 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:52.185571 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-30ff9ace-593b-4a22-82bb-8fe423408cb1 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 42fe539b-6665-43fb-b7a2-bc8a6f2c65d5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:52.199124 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-30ff9ace-593b-4a22-82bb-8fe423408cb1 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:52.199689 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-30ff9ace-593b-4a22-82bb-8fe423408cb1 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:52.200150 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-30ff9ace-593b-4a22-82bb-8fe423408cb1 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:52.200886 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-30ff9ace-593b-4a22-82bb-8fe423408cb1 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:52.203564 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ad57f064-5e41-43a4-be77-7d7a8cc04ec9 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:52.204097 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-30ff9ace-593b-4a22-82bb-8fe423408cb1 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:52.204275 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-ad57f064-5e41-43a4-be77-7d7a8cc04ec9 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] [instance: 48df7db9-a805-4c72-a1a5-29632b00248c] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:52.204560 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-30ff9ace-593b-4a22-82bb-8fe423408cb1 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:52.216776 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ad57f064-5e41-43a4-be77-7d7a8cc04ec9 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:52.217541 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ad57f064-5e41-43a4-be77-7d7a8cc04ec9 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:52.218456 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ad57f064-5e41-43a4-be77-7d7a8cc04ec9 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:52.219721 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ad57f064-5e41-43a4-be77-7d7a8cc04ec9 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:52.224437 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ad57f064-5e41-43a4-be77-7d7a8cc04ec9 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:52.225358 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ad57f064-5e41-43a4-be77-7d7a8cc04ec9 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:52.249257 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-30ff9ace-593b-4a22-82bb-8fe423408cb1 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] HTTP exception thrown: Instance 42fe539b-6665-43fb-b7a2-bc8a6f2c65d5 could not be found. Sep 23 04:42:52.255156 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-30ff9ace-593b-4a22-82bb-8fe423408cb1 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Request method failure captured: Sep 23 04:42:52.255156 n-d-846463-3 devstack@n-api.service[122699]: request: DELETE /compute/v2.1/servers/42fe539b-6665-43fb-b7a2-bc8a6f2c65d5 HTTP/1.1 Sep 23 04:42:52.255156 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:42:52.255156 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:42:52.255156 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:42:52.255156 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:42:52.255156 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:42:52.255156 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:42:52.255156 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:42:52.255156 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:42:52.255156 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTgD-AJZNKtluGEJNjQKU0pcHtUCc1AZ8Ycz4MPGIeanw2_GglRmvn8LiMCEayIX86yw_RpyCC_JZrlVGSjhSgenUVZhpJ_MqN5SLmcv6Qnl3N6cXWJgtCK8N_ffRhD1dYgLIdHHgnmyTAptDZsjatOWU1ocTU40JP9XOpkK3deqL7A Sep 23 04:42:52.255156 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:42:52.255156 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:42:52.255156 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:42:52.255156 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:42:52.255156 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:42:52.255156 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:42:52.255156 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: fe698721372f40888dc2918c46e65f2f Sep 23 04:42:52.255156 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-DeleteServersTestJSON-347759205 Sep 23 04:42:52.255156 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:42:52.255156 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:42:52.255156 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fe698721372f40888dc2918c46e65f2f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe698721372f40888dc2918c46e65f2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fe698721372f40888dc2918c46e65f2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe698721372f40888dc2918c46e65f2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:42:52.255156 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-DeleteServersTestJSON-347759205 Sep 23 04:42:52.255156 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: fe698721372f40888dc2918c46e65f2f Sep 23 04:42:52.255156 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-DeleteServersTestJSON-347759205 Sep 23 04:42:52.255156 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-DeleteServersTestJSON-347759205-project Sep 23 04:42:52.255156 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:42:52.255156 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:42:52.255156 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 36526fe612c840fb907e1992d8e62538 Sep 23 04:42:52.255156 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-DeleteServersTestJSON-347759205-project Sep 23 04:42:52.255156 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:42:52.255156 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 42fe539b-6665-43fb-b7a2-bc8a6f2c65d5 could not be found. Sep 23 04:42:52.255156 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '42fe539b-6665-43fb-b7a2-bc8a6f2c65d5'} Sep 23 04:42:52.255156 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:42:52.255156 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:42:52.255156 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:42:52.255156 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:42:52.255156 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:42:52.255156 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:42:52.255156 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:42:52.255156 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:42:52.255156 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:42:52.255156 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:42:52.255156 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42fe539b-6665-43fb-b7a2-bc8a6f2c65d5 could not be found. Sep 23 04:42:52.255156 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:42:52.255156 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:42:52.255156 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:42:52.255156 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:42:52.255156 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:42:52.255156 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:42:52.255156 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:42:52.255156 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:42:52.255156 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:42:52.255156 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:42:52.255156 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 04:42:52.255156 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 04:42:52.255156 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 04:42:52.255156 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 04:42:52.255156 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:42:52.255156 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:42:52.255156 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:42:52.255156 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:42:52.262213 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42fe539b-6665-43fb-b7a2-bc8a6f2c65d5 could not be found. Sep 23 04:42:52.262213 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:42:52.262213 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:42:52.262213 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:42:52.262213 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:42:52.262213 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:42:52.262213 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:42:52.262213 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:42:52.262213 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:42:52.262213 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42fe539b-6665-43fb-b7a2-bc8a6f2c65d5 could not be found. Sep 23 04:42:52.262213 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:42:52.262213 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-30ff9ace-593b-4a22-82bb-8fe423408cb1 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Returning 404 to user: Instance 42fe539b-6665-43fb-b7a2-bc8a6f2c65d5 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:42:52.262213 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-30ff9ace-593b-4a22-82bb-8fe423408cb1 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "DELETE /compute/v2.1/servers/42fe539b-6665-43fb-b7a2-bc8a6f2c65d5" status: 404 len: 111 microversion: 2.1 time: 0.081153 Sep 23 04:42:52.265134 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1435/2853] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:42:52 2022] DELETE /compute/v2.1/servers/42fe539b-6665-43fb-b7a2-bc8a6f2c65d5 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:42:52.278996 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-355f95f0-1b5d-4622-a18e-130d9af189c9 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:52.279646 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-355f95f0-1b5d-4622-a18e-130d9af189c9 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 42fe539b-6665-43fb-b7a2-bc8a6f2c65d5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:52.297099 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-355f95f0-1b5d-4622-a18e-130d9af189c9 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:52.301056 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-355f95f0-1b5d-4622-a18e-130d9af189c9 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:52.301619 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-355f95f0-1b5d-4622-a18e-130d9af189c9 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:52.302491 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-355f95f0-1b5d-4622-a18e-130d9af189c9 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:52.303393 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-355f95f0-1b5d-4622-a18e-130d9af189c9 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:52.306120 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-355f95f0-1b5d-4622-a18e-130d9af189c9 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:52.345816 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-355f95f0-1b5d-4622-a18e-130d9af189c9 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] HTTP exception thrown: Instance 42fe539b-6665-43fb-b7a2-bc8a6f2c65d5 could not be found. Sep 23 04:42:52.350692 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-355f95f0-1b5d-4622-a18e-130d9af189c9 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Request method failure captured: Sep 23 04:42:52.350692 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/42fe539b-6665-43fb-b7a2-bc8a6f2c65d5 HTTP/1.1 Sep 23 04:42:52.350692 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:42:52.350692 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:42:52.350692 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:42:52.350692 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:42:52.350692 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:42:52.350692 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:42:52.350692 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:42:52.350692 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:42:52.350692 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTgD-AJZNKtluGEJNjQKU0pcHtUCc1AZ8Ycz4MPGIeanw2_GglRmvn8LiMCEayIX86yw_RpyCC_JZrlVGSjhSgenUVZhpJ_MqN5SLmcv6Qnl3N6cXWJgtCK8N_ffRhD1dYgLIdHHgnmyTAptDZsjatOWU1ocTU40JP9XOpkK3deqL7A Sep 23 04:42:52.350692 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:42:52.350692 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:42:52.350692 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:42:52.350692 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:42:52.350692 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:42:52.350692 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:42:52.350692 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: fe698721372f40888dc2918c46e65f2f Sep 23 04:42:52.350692 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-DeleteServersTestJSON-347759205 Sep 23 04:42:52.350692 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:42:52.350692 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:42:52.350692 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fe698721372f40888dc2918c46e65f2f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe698721372f40888dc2918c46e65f2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fe698721372f40888dc2918c46e65f2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe698721372f40888dc2918c46e65f2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:42:52.350692 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-DeleteServersTestJSON-347759205 Sep 23 04:42:52.350692 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: fe698721372f40888dc2918c46e65f2f Sep 23 04:42:52.350692 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-DeleteServersTestJSON-347759205 Sep 23 04:42:52.350692 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-DeleteServersTestJSON-347759205-project Sep 23 04:42:52.350692 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:42:52.350692 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:42:52.350692 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 36526fe612c840fb907e1992d8e62538 Sep 23 04:42:52.350692 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-DeleteServersTestJSON-347759205-project Sep 23 04:42:52.350692 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:42:52.350692 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 42fe539b-6665-43fb-b7a2-bc8a6f2c65d5 could not be found. Sep 23 04:42:52.350692 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '42fe539b-6665-43fb-b7a2-bc8a6f2c65d5'} Sep 23 04:42:52.350692 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:42:52.350692 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:42:52.350692 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:42:52.350692 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:42:52.350692 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:42:52.350692 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:42:52.350692 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:42:52.350692 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:42:52.350692 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:42:52.350692 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:42:52.350692 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42fe539b-6665-43fb-b7a2-bc8a6f2c65d5 could not be found. Sep 23 04:42:52.350692 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:42:52.350692 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:42:52.350692 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:42:52.350692 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:42:52.350692 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:42:52.350692 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:42:52.350692 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:42:52.350692 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:42:52.350692 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:42:52.350692 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:42:52.350692 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:42:52.350692 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:42:52.350692 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:42:52.350692 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:42:52.350692 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:42:52.350692 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:42:52.350692 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42fe539b-6665-43fb-b7a2-bc8a6f2c65d5 could not be found. Sep 23 04:42:52.350692 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:42:52.350692 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:42:52.350692 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:42:52.360385 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:42:52.360385 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:42:52.360385 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:42:52.360385 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:42:52.360385 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:42:52.360385 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42fe539b-6665-43fb-b7a2-bc8a6f2c65d5 could not be found. Sep 23 04:42:52.360385 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:42:52.360385 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-355f95f0-1b5d-4622-a18e-130d9af189c9 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Returning 404 to user: Instance 42fe539b-6665-43fb-b7a2-bc8a6f2c65d5 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:42:52.362771 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-355f95f0-1b5d-4622-a18e-130d9af189c9 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/42fe539b-6665-43fb-b7a2-bc8a6f2c65d5" status: 404 len: 111 microversion: 2.1 time: 0.090595 Sep 23 04:42:52.366083 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1436/2854] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:42:52 2022] GET /compute/v2.1/servers/42fe539b-6665-43fb-b7a2-bc8a6f2c65d5 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:42:52.375318 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-924a5e9b-4c58-4d0e-8c4c-aa1ee141493b tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:52.378873 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-924a5e9b-4c58-4d0e-8c4c-aa1ee141493b tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] [instance: dfb8f504-218a-471c-b7a8-70c498769f0e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:52.396150 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-924a5e9b-4c58-4d0e-8c4c-aa1ee141493b tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:52.398487 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-924a5e9b-4c58-4d0e-8c4c-aa1ee141493b tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:52.399177 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-924a5e9b-4c58-4d0e-8c4c-aa1ee141493b tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:52.400136 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-924a5e9b-4c58-4d0e-8c4c-aa1ee141493b tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:52.402254 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-924a5e9b-4c58-4d0e-8c4c-aa1ee141493b tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:52.405129 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-924a5e9b-4c58-4d0e-8c4c-aa1ee141493b tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:52.471822 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-924a5e9b-4c58-4d0e-8c4c-aa1ee141493b tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:52.472340 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-924a5e9b-4c58-4d0e-8c4c-aa1ee141493b tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:52.472792 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-924a5e9b-4c58-4d0e-8c4c-aa1ee141493b tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:52.473266 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-924a5e9b-4c58-4d0e-8c4c-aa1ee141493b tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lazy-loading 'fault' on Instance uuid dfb8f504-218a-471c-b7a8-70c498769f0e {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:42:52.584652 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-924a5e9b-4c58-4d0e-8c4c-aa1ee141493b tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '542c9592c76c4d4b9f3f16cea354398d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf77b55dfd8452e949229e4eb085283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:52.602790 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-924a5e9b-4c58-4d0e-8c4c-aa1ee141493b tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] 10.222.0.33 "GET /compute/v2.1/servers/dfb8f504-218a-471c-b7a8-70c498769f0e" status: 200 len: 1332 microversion: 2.1 time: 0.235399 Sep 23 04:42:52.626812 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1437/2855] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:42:52 2022] GET /compute/v2.1/servers/dfb8f504-218a-471c-b7a8-70c498769f0e => generated 1332 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:42:52.646697 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a22addfa-fb65-4e14-a9ba-25c7de3c02c2 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:52.647562 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a22addfa-fb65-4e14-a9ba-25c7de3c02c2 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:52.655521 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a22addfa-fb65-4e14-a9ba-25c7de3c02c2 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:52.656241 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a22addfa-fb65-4e14-a9ba-25c7de3c02c2 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:52.656842 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a22addfa-fb65-4e14-a9ba-25c7de3c02c2 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:52.658333 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a22addfa-fb65-4e14-a9ba-25c7de3c02c2 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:52.659010 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a22addfa-fb65-4e14-a9ba-25c7de3c02c2 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:52.659807 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a22addfa-fb65-4e14-a9ba-25c7de3c02c2 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:52.677074 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-a22addfa-fb65-4e14-a9ba-25c7de3c02c2 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] HTTP exception thrown: Instance cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6 could not be found. Sep 23 04:42:52.679824 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a22addfa-fb65-4e14-a9ba-25c7de3c02c2 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Request method failure captured: Sep 23 04:42:52.679824 n-d-846463-3 devstack@n-api.service[122699]: request: DELETE /compute/v2.1/servers/cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6 HTTP/1.1 Sep 23 04:42:52.679824 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:42:52.679824 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:42:52.679824 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:42:52.679824 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:42:52.679824 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:42:52.679824 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:42:52.679824 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:42:52.679824 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:42:52.679824 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTgD-AJZNKtluGEJNjQKU0pcHtUCc1AZ8Ycz4MPGIeanw2_GglRmvn8LiMCEayIX86yw_RpyCC_JZrlVGSjhSgenUVZhpJ_MqN5SLmcv6Qnl3N6cXWJgtCK8N_ffRhD1dYgLIdHHgnmyTAptDZsjatOWU1ocTU40JP9XOpkK3deqL7A Sep 23 04:42:52.679824 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:42:52.679824 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:42:52.679824 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:42:52.679824 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:42:52.679824 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:42:52.679824 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:42:52.679824 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: fe698721372f40888dc2918c46e65f2f Sep 23 04:42:52.679824 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-DeleteServersTestJSON-347759205 Sep 23 04:42:52.679824 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:42:52.679824 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:42:52.679824 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fe698721372f40888dc2918c46e65f2f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe698721372f40888dc2918c46e65f2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fe698721372f40888dc2918c46e65f2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe698721372f40888dc2918c46e65f2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:42:52.679824 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-DeleteServersTestJSON-347759205 Sep 23 04:42:52.679824 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: fe698721372f40888dc2918c46e65f2f Sep 23 04:42:52.679824 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-DeleteServersTestJSON-347759205 Sep 23 04:42:52.679824 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-DeleteServersTestJSON-347759205-project Sep 23 04:42:52.679824 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:42:52.679824 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:42:52.679824 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 36526fe612c840fb907e1992d8e62538 Sep 23 04:42:52.679824 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-DeleteServersTestJSON-347759205-project Sep 23 04:42:52.679824 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:42:52.679824 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6 could not be found. Sep 23 04:42:52.679824 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': 'cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6'} Sep 23 04:42:52.679824 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:42:52.679824 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:42:52.679824 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:42:52.679824 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:42:52.679824 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:42:52.679824 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:42:52.679824 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:42:52.679824 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:42:52.679824 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:42:52.679824 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:42:52.679824 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6 could not be found. Sep 23 04:42:52.679824 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:42:52.679824 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:42:52.679824 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:42:52.679824 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:42:52.679824 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:42:52.679824 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:42:52.679824 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:42:52.679824 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:42:52.679824 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:42:52.679824 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:42:52.679824 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 04:42:52.679824 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 04:42:52.679824 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 04:42:52.679824 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 04:42:52.679824 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:42:52.679824 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:42:52.679824 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:42:52.679824 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:42:52.683583 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6 could not be found. Sep 23 04:42:52.683583 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:42:52.683583 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:42:52.683583 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:42:52.683583 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:42:52.683583 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:42:52.683583 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:42:52.683583 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:42:52.683583 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:42:52.683583 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6 could not be found. Sep 23 04:42:52.683583 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:42:52.685740 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a22addfa-fb65-4e14-a9ba-25c7de3c02c2 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Returning 404 to user: Instance cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:42:52.686968 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a22addfa-fb65-4e14-a9ba-25c7de3c02c2 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "DELETE /compute/v2.1/servers/cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6" status: 404 len: 111 microversion: 2.1 time: 0.057608 Sep 23 04:42:52.691215 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1438/2856] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:42:52 2022] DELETE /compute/v2.1/servers/cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:42:52.697874 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b35abf01-e140-4edb-8dc2-e26b4720acc2 tempest-ImagesMetadataTestJSON-1618678320 tempest-ImagesMetadataTestJSON-1618678320-project] Calling method '.version_select at 0x7ff1c0964e50>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:52.712010 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ad57f064-5e41-43a4-be77-7d7a8cc04ec9 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e235519204b4efc8b6c7e2988fab9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0b7307c30a4c118da4c501691e349f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:52.725875 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ad57f064-5e41-43a4-be77-7d7a8cc04ec9 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] 10.222.0.33 "GET /compute/v2.1/servers/48df7db9-a805-4c72-a1a5-29632b00248c" status: 200 len: 1556 microversion: 2.1 time: 0.524287 Sep 23 04:42:52.729218 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1419/2857] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:42:52 2022] GET /compute/v2.1/servers/48df7db9-a805-4c72-a1a5-29632b00248c => generated 1556 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:42:52.740317 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0eca804f-1e27-4e2c-9c93-7fa3f9301642 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:52.744064 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-0eca804f-1e27-4e2c-9c93-7fa3f9301642 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] [instance: 17bcb29e-d024-484c-ade0-793ef585ae96] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:52.761741 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0eca804f-1e27-4e2c-9c93-7fa3f9301642 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:52.766309 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0eca804f-1e27-4e2c-9c93-7fa3f9301642 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:52.767071 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0eca804f-1e27-4e2c-9c93-7fa3f9301642 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:52.767986 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0eca804f-1e27-4e2c-9c93-7fa3f9301642 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:52.771359 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0eca804f-1e27-4e2c-9c93-7fa3f9301642 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:52.772519 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0eca804f-1e27-4e2c-9c93-7fa3f9301642 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:52.781652 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b35abf01-e140-4edb-8dc2-e26b4720acc2 tempest-ImagesMetadataTestJSON-1618678320 tempest-ImagesMetadataTestJSON-1618678320-project] 10.222.0.33 "GET /compute/v2.1/images/7721111c-a389-457b-8cbf-48c14c3e1442" status: 200 len: 636 microversion: 2.1 time: 0.088995 Sep 23 04:42:52.795373 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1439/2858] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:42:52 2022] GET /compute/v2.1/images/7721111c-a389-457b-8cbf-48c14c3e1442 => generated 636 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:42:52.804467 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e3960bea-7be2-4c5a-a818-eca8a50c94ab tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:52.805476 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e3960bea-7be2-4c5a-a818-eca8a50c94ab tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:52.817322 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e3960bea-7be2-4c5a-a818-eca8a50c94ab tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:52.817845 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e3960bea-7be2-4c5a-a818-eca8a50c94ab tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:52.818477 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e3960bea-7be2-4c5a-a818-eca8a50c94ab tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:52.825754 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e3960bea-7be2-4c5a-a818-eca8a50c94ab tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:52.826341 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e3960bea-7be2-4c5a-a818-eca8a50c94ab tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:52.826794 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e3960bea-7be2-4c5a-a818-eca8a50c94ab tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:52.859225 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-e3960bea-7be2-4c5a-a818-eca8a50c94ab tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] HTTP exception thrown: Instance cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6 could not be found. Sep 23 04:42:52.860897 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e3960bea-7be2-4c5a-a818-eca8a50c94ab tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Request method failure captured: Sep 23 04:42:52.860897 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6 HTTP/1.1 Sep 23 04:42:52.860897 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:42:52.860897 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:42:52.860897 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:42:52.860897 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:42:52.860897 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:42:52.860897 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:42:52.860897 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:42:52.860897 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:42:52.860897 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTgD-AJZNKtluGEJNjQKU0pcHtUCc1AZ8Ycz4MPGIeanw2_GglRmvn8LiMCEayIX86yw_RpyCC_JZrlVGSjhSgenUVZhpJ_MqN5SLmcv6Qnl3N6cXWJgtCK8N_ffRhD1dYgLIdHHgnmyTAptDZsjatOWU1ocTU40JP9XOpkK3deqL7A Sep 23 04:42:52.860897 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:42:52.860897 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:42:52.860897 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:42:52.860897 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:42:52.860897 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:42:52.860897 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:42:52.860897 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: fe698721372f40888dc2918c46e65f2f Sep 23 04:42:52.860897 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-DeleteServersTestJSON-347759205 Sep 23 04:42:52.860897 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:42:52.860897 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:42:52.860897 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fe698721372f40888dc2918c46e65f2f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe698721372f40888dc2918c46e65f2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fe698721372f40888dc2918c46e65f2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe698721372f40888dc2918c46e65f2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:42:52.860897 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-DeleteServersTestJSON-347759205 Sep 23 04:42:52.860897 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: fe698721372f40888dc2918c46e65f2f Sep 23 04:42:52.860897 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-DeleteServersTestJSON-347759205 Sep 23 04:42:52.860897 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-DeleteServersTestJSON-347759205-project Sep 23 04:42:52.860897 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:42:52.860897 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:42:52.860897 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 36526fe612c840fb907e1992d8e62538 Sep 23 04:42:52.860897 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-DeleteServersTestJSON-347759205-project Sep 23 04:42:52.860897 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:42:52.860897 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6 could not be found. Sep 23 04:42:52.860897 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': 'cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6'} Sep 23 04:42:52.860897 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:42:52.860897 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:42:52.860897 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:42:52.860897 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:42:52.860897 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:42:52.860897 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:42:52.860897 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:42:52.860897 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:42:52.860897 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:42:52.860897 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:42:52.860897 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6 could not be found. Sep 23 04:42:52.860897 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:42:52.860897 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:42:52.860897 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:42:52.860897 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:42:52.860897 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:42:52.860897 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:42:52.860897 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:42:52.860897 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:42:52.860897 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:42:52.860897 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:42:52.860897 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:42:52.860897 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:42:52.860897 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:42:52.860897 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:42:52.860897 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:42:52.860897 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:42:52.860897 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6 could not be found. Sep 23 04:42:52.860897 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:42:52.860897 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:42:52.860897 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:42:52.864715 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:42:52.864715 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:42:52.864715 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:42:52.864715 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:42:52.864715 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:42:52.864715 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6 could not be found. Sep 23 04:42:52.864715 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:42:52.864715 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e3960bea-7be2-4c5a-a818-eca8a50c94ab tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Returning 404 to user: Instance cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:42:52.864715 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e3960bea-7be2-4c5a-a818-eca8a50c94ab tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6" status: 404 len: 111 microversion: 2.1 time: 0.076674 Sep 23 04:42:52.872769 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1440/2859] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:42:52 2022] GET /compute/v2.1/servers/cc7402f8-ed50-4737-aa9f-4c4e8f1f7ac6 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:42:52.891668 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-22c6396e-2c11-4c78-bf47-5b72579ec80c tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:52.893628 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-22c6396e-2c11-4c78-bf47-5b72579ec80c tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] [instance: 48df7db9-a805-4c72-a1a5-29632b00248c] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:52.905011 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-22c6396e-2c11-4c78-bf47-5b72579ec80c tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:52.905783 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-22c6396e-2c11-4c78-bf47-5b72579ec80c tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:52.906759 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-22c6396e-2c11-4c78-bf47-5b72579ec80c tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:52.908719 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-22c6396e-2c11-4c78-bf47-5b72579ec80c tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:52.909626 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-22c6396e-2c11-4c78-bf47-5b72579ec80c tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:52.910412 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-22c6396e-2c11-4c78-bf47-5b72579ec80c tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:52.949681 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-0eca804f-1e27-4e2c-9c93-7fa3f9301642 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd00d7cc82d4ec0b9b36fe2bb0be056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f66ca22a6f24928840a07e889f2e740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:52.962634 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-0eca804f-1e27-4e2c-9c93-7fa3f9301642 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6fd00d7cc82d4ec0b9b36fe2bb0be056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f66ca22a6f24928840a07e889f2e740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:52.971618 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-0eca804f-1e27-4e2c-9c93-7fa3f9301642 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6fd00d7cc82d4ec0b9b36fe2bb0be056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f66ca22a6f24928840a07e889f2e740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:52.973345 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0eca804f-1e27-4e2c-9c93-7fa3f9301642 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] 10.222.0.33 "GET /compute/v2.1/servers/17bcb29e-d024-484c-ade0-793ef585ae96" status: 200 len: 1276 microversion: 2.47 time: 0.239619 Sep 23 04:42:52.974198 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1420/2860] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:42:52 2022] GET /compute/v2.1/servers/17bcb29e-d024-484c-ade0-793ef585ae96 => generated 1276 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:42:52.979072 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8911bc01-3af9-49f2-9d93-69e07fc8deaa tempest-ImagesMetadataTestJSON-1618678320 tempest-ImagesMetadataTestJSON-1618678320-project] Action: 'update_all', calling method: .version_select at 0x7ff1bbd58700>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:42:53.083855 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-8911bc01-3af9-49f2-9d93-69e07fc8deaa tempest-ImagesMetadataTestJSON-1618678320 tempest-ImagesMetadataTestJSON-1618678320-project] Getting quotas for project a1e370c98adf42c0a037739a16c23174. Resources: dict_keys(['metadata_items']) {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:42:53.103729 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-8911bc01-3af9-49f2-9d93-69e07fc8deaa tempest-ImagesMetadataTestJSON-1618678320 tempest-ImagesMetadataTestJSON-1618678320-project] Getting quotas for user 89dc6f9b68894a848c129f1fb66cb5c5 and project a1e370c98adf42c0a037739a16c23174. Resources: dict_keys(['metadata_items']) {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:42:53.174104 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-22c6396e-2c11-4c78-bf47-5b72579ec80c tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] 10.222.0.33 "GET /compute/v2.1/servers/48df7db9-a805-4c72-a1a5-29632b00248c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.302224 Sep 23 04:42:53.174919 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1441/2861] 10.222.0.33 () {58 vars in 1275 bytes} [Fri Sep 23 04:42:52 2022] GET /compute/v2.1/servers/48df7db9-a805-4c72-a1a5-29632b00248c/os-interface => generated 284 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:42:53.180041 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8e7f040e-cc01-4fcd-92a1-5e634b4d7b6a tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:53.180853 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-8e7f040e-cc01-4fcd-92a1-5e634b4d7b6a tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 0add84f7-600c-46b6-a3ff-c64db803e4f8] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:53.190755 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-8e7f040e-cc01-4fcd-92a1-5e634b4d7b6a tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] HTTP exception thrown: Instance 0add84f7-600c-46b6-a3ff-c64db803e4f8 could not be found. Sep 23 04:42:53.203445 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8e7f040e-cc01-4fcd-92a1-5e634b4d7b6a tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Request method failure captured: Sep 23 04:42:53.203445 n-d-846463-3 devstack@n-api.service[122699]: request: DELETE /compute/v2.1/servers/0add84f7-600c-46b6-a3ff-c64db803e4f8 HTTP/1.1 Sep 23 04:42:53.203445 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:42:53.203445 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:42:53.203445 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:42:53.203445 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:42:53.203445 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:42:53.203445 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:42:53.203445 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:42:53.203445 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:42:53.203445 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTgD-AJZNKtluGEJNjQKU0pcHtUCc1AZ8Ycz4MPGIeanw2_GglRmvn8LiMCEayIX86yw_RpyCC_JZrlVGSjhSgenUVZhpJ_MqN5SLmcv6Qnl3N6cXWJgtCK8N_ffRhD1dYgLIdHHgnmyTAptDZsjatOWU1ocTU40JP9XOpkK3deqL7A Sep 23 04:42:53.203445 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:42:53.203445 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:42:53.203445 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:42:53.203445 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:42:53.203445 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:42:53.203445 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:42:53.203445 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: fe698721372f40888dc2918c46e65f2f Sep 23 04:42:53.203445 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-DeleteServersTestJSON-347759205 Sep 23 04:42:53.203445 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:42:53.203445 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:42:53.203445 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fe698721372f40888dc2918c46e65f2f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe698721372f40888dc2918c46e65f2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fe698721372f40888dc2918c46e65f2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe698721372f40888dc2918c46e65f2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:42:53.203445 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-DeleteServersTestJSON-347759205 Sep 23 04:42:53.203445 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: fe698721372f40888dc2918c46e65f2f Sep 23 04:42:53.203445 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-DeleteServersTestJSON-347759205 Sep 23 04:42:53.203445 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-DeleteServersTestJSON-347759205-project Sep 23 04:42:53.203445 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:42:53.203445 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:42:53.203445 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 36526fe612c840fb907e1992d8e62538 Sep 23 04:42:53.203445 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-DeleteServersTestJSON-347759205-project Sep 23 04:42:53.203445 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:42:53.203445 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 0add84f7-600c-46b6-a3ff-c64db803e4f8 could not be found. Sep 23 04:42:53.203445 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '0add84f7-600c-46b6-a3ff-c64db803e4f8'} Sep 23 04:42:53.203445 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:42:53.203445 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:42:53.203445 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:42:53.203445 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:42:53.203445 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:42:53.203445 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:42:53.203445 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 23 04:42:53.203445 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 23 04:42:53.203445 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0add84f7-600c-46b6-a3ff-c64db803e4f8 could not be found. Sep 23 04:42:53.203445 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:42:53.203445 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:42:53.203445 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:42:53.203445 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:42:53.203445 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:42:53.203445 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:42:53.203445 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:42:53.203445 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:42:53.203445 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:42:53.203445 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:42:53.203445 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 04:42:53.203445 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 04:42:53.203445 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 04:42:53.203445 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 04:42:53.203445 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:42:53.203445 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:42:53.203445 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:42:53.203445 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:42:53.203445 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0add84f7-600c-46b6-a3ff-c64db803e4f8 could not be found. Sep 23 04:42:53.203445 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:42:53.203445 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:42:53.203445 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:42:53.208034 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:42:53.208034 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:42:53.208034 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:42:53.208034 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:42:53.208034 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:42:53.208034 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0add84f7-600c-46b6-a3ff-c64db803e4f8 could not be found. Sep 23 04:42:53.208034 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:42:53.211630 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8e7f040e-cc01-4fcd-92a1-5e634b4d7b6a tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Returning 404 to user: Instance 0add84f7-600c-46b6-a3ff-c64db803e4f8 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:42:53.223051 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-8e7f040e-cc01-4fcd-92a1-5e634b4d7b6a tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "DELETE /compute/v2.1/servers/0add84f7-600c-46b6-a3ff-c64db803e4f8" status: 404 len: 111 microversion: 2.1 time: 0.036478 Sep 23 04:42:53.234672 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1442/2862] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:42:53 2022] DELETE /compute/v2.1/servers/0add84f7-600c-46b6-a3ff-c64db803e4f8 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:42:53.242729 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-fea2ea46-de40-4df6-ad4c-a644d5961cf4 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:53.243358 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-fea2ea46-de40-4df6-ad4c-a644d5961cf4 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 0add84f7-600c-46b6-a3ff-c64db803e4f8] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:53.263870 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-fea2ea46-de40-4df6-ad4c-a644d5961cf4 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] HTTP exception thrown: Instance 0add84f7-600c-46b6-a3ff-c64db803e4f8 could not be found. Sep 23 04:42:53.267605 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-fea2ea46-de40-4df6-ad4c-a644d5961cf4 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Request method failure captured: Sep 23 04:42:53.267605 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/0add84f7-600c-46b6-a3ff-c64db803e4f8 HTTP/1.1 Sep 23 04:42:53.267605 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:42:53.267605 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:42:53.267605 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:42:53.267605 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:42:53.267605 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:42:53.267605 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:42:53.267605 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:42:53.267605 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:42:53.267605 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTgD-AJZNKtluGEJNjQKU0pcHtUCc1AZ8Ycz4MPGIeanw2_GglRmvn8LiMCEayIX86yw_RpyCC_JZrlVGSjhSgenUVZhpJ_MqN5SLmcv6Qnl3N6cXWJgtCK8N_ffRhD1dYgLIdHHgnmyTAptDZsjatOWU1ocTU40JP9XOpkK3deqL7A Sep 23 04:42:53.267605 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:42:53.267605 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:42:53.267605 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:42:53.267605 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:42:53.267605 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:42:53.267605 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:42:53.267605 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: fe698721372f40888dc2918c46e65f2f Sep 23 04:42:53.267605 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-DeleteServersTestJSON-347759205 Sep 23 04:42:53.267605 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:42:53.267605 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:42:53.267605 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fe698721372f40888dc2918c46e65f2f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe698721372f40888dc2918c46e65f2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fe698721372f40888dc2918c46e65f2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe698721372f40888dc2918c46e65f2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:42:53.267605 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-DeleteServersTestJSON-347759205 Sep 23 04:42:53.267605 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: fe698721372f40888dc2918c46e65f2f Sep 23 04:42:53.267605 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-DeleteServersTestJSON-347759205 Sep 23 04:42:53.267605 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-DeleteServersTestJSON-347759205-project Sep 23 04:42:53.267605 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:42:53.267605 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:42:53.267605 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 36526fe612c840fb907e1992d8e62538 Sep 23 04:42:53.267605 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-DeleteServersTestJSON-347759205-project Sep 23 04:42:53.267605 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:42:53.267605 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 0add84f7-600c-46b6-a3ff-c64db803e4f8 could not be found. Sep 23 04:42:53.267605 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '0add84f7-600c-46b6-a3ff-c64db803e4f8'} Sep 23 04:42:53.267605 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:42:53.267605 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:42:53.267605 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:42:53.267605 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:42:53.267605 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:42:53.267605 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:42:53.267605 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 23 04:42:53.267605 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 23 04:42:53.267605 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0add84f7-600c-46b6-a3ff-c64db803e4f8 could not be found. Sep 23 04:42:53.267605 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:42:53.267605 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:42:53.267605 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:42:53.267605 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:42:53.267605 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:42:53.267605 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:42:53.267605 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:42:53.267605 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:42:53.267605 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:42:53.267605 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:42:53.267605 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:42:53.267605 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:42:53.267605 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:42:53.267605 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:42:53.267605 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:42:53.267605 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:42:53.267605 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0add84f7-600c-46b6-a3ff-c64db803e4f8 could not be found. Sep 23 04:42:53.267605 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:42:53.267605 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:42:53.267605 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:42:53.267605 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:42:53.267605 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:42:53.272397 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:42:53.272397 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:42:53.272397 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:42:53.272397 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0add84f7-600c-46b6-a3ff-c64db803e4f8 could not be found. Sep 23 04:42:53.272397 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:42:53.273701 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-fea2ea46-de40-4df6-ad4c-a644d5961cf4 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Returning 404 to user: Instance 0add84f7-600c-46b6-a3ff-c64db803e4f8 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:42:53.275033 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-fea2ea46-de40-4df6-ad4c-a644d5961cf4 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/0add84f7-600c-46b6-a3ff-c64db803e4f8" status: 404 len: 111 microversion: 2.1 time: 0.045288 Sep 23 04:42:53.279582 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1443/2863] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:42:53 2022] GET /compute/v2.1/servers/0add84f7-600c-46b6-a3ff-c64db803e4f8 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:42:53.647745 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-bf377987-b400-4f54-ab6f-ed99f47e85e0 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:53.648536 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-bf377987-b400-4f54-ab6f-ed99f47e85e0 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] [instance: dfb8f504-218a-471c-b7a8-70c498769f0e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:53.656474 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bf377987-b400-4f54-ab6f-ed99f47e85e0 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:53.656986 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bf377987-b400-4f54-ab6f-ed99f47e85e0 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:53.657433 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bf377987-b400-4f54-ab6f-ed99f47e85e0 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:53.663106 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bf377987-b400-4f54-ab6f-ed99f47e85e0 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:53.663671 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bf377987-b400-4f54-ab6f-ed99f47e85e0 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:53.664002 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bf377987-b400-4f54-ab6f-ed99f47e85e0 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:53.705807 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-bf377987-b400-4f54-ab6f-ed99f47e85e0 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] HTTP exception thrown: Instance dfb8f504-218a-471c-b7a8-70c498769f0e could not be found. Sep 23 04:42:53.708810 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-bf377987-b400-4f54-ab6f-ed99f47e85e0 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Request method failure captured: Sep 23 04:42:53.708810 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/dfb8f504-218a-471c-b7a8-70c498769f0e HTTP/1.1 Sep 23 04:42:53.708810 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:42:53.708810 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:42:53.708810 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:42:53.708810 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:42:53.708810 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:42:53.708810 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:42:53.708810 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:42:53.708810 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:42:53.708810 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTieUWxWVz7tagLf0YOUGD3zbsKFDzpc2b3aaNhcN_ZlklFdFncZs2NLllcvch0GskWqt4COl_aegLGomoq5rNwRbJ80i1JBntABqSfT0ytSHW6micesQtO-pb8oglbhIGSac7wG4OeV3zrnFAvqktOkjIG879ee6y7C1UWVcGCKfkU Sep 23 04:42:53.708810 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:42:53.708810 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:42:53.708810 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:42:53.708810 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:42:53.708810 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:42:53.708810 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:42:53.708810 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: ddf77b55dfd8452e949229e4eb085283 Sep 23 04:42:53.708810 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1278053024 Sep 23 04:42:53.708810 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:42:53.708810 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:42:53.708810 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ddf77b55dfd8452e949229e4eb085283", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ddf77b55dfd8452e949229e4eb085283"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ddf77b55dfd8452e949229e4eb085283"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ddf77b55dfd8452e949229e4eb085283"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:42:53.708810 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1278053024 Sep 23 04:42:53.708810 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: ddf77b55dfd8452e949229e4eb085283 Sep 23 04:42:53.708810 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1278053024 Sep 23 04:42:53.708810 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-AttachSCSIVolumeTestJSON-1278053024-project Sep 23 04:42:53.708810 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:42:53.708810 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:42:53.708810 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 542c9592c76c4d4b9f3f16cea354398d Sep 23 04:42:53.708810 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1278053024-project Sep 23 04:42:53.708810 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:42:53.708810 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance dfb8f504-218a-471c-b7a8-70c498769f0e could not be found. Sep 23 04:42:53.708810 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': 'dfb8f504-218a-471c-b7a8-70c498769f0e'} Sep 23 04:42:53.708810 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:42:53.708810 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:42:53.708810 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:42:53.708810 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:42:53.708810 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:42:53.708810 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:42:53.708810 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:42:53.708810 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:42:53.708810 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:42:53.708810 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:42:53.708810 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfb8f504-218a-471c-b7a8-70c498769f0e could not be found. Sep 23 04:42:53.708810 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:42:53.708810 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:42:53.708810 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:42:53.708810 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:42:53.708810 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:42:53.708810 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:42:53.708810 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:42:53.708810 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:42:53.708810 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:42:53.708810 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:42:53.708810 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:42:53.708810 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:42:53.708810 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:42:53.708810 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:42:53.708810 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:42:53.708810 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:42:53.708810 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfb8f504-218a-471c-b7a8-70c498769f0e could not be found. Sep 23 04:42:53.708810 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:42:53.708810 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:42:53.708810 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:42:53.713284 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:42:53.713284 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:42:53.713284 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:42:53.713284 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:42:53.713284 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:42:53.713284 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfb8f504-218a-471c-b7a8-70c498769f0e could not be found. Sep 23 04:42:53.713284 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:42:53.715611 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-bf377987-b400-4f54-ab6f-ed99f47e85e0 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Returning 404 to user: Instance dfb8f504-218a-471c-b7a8-70c498769f0e could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:42:53.716922 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-bf377987-b400-4f54-ab6f-ed99f47e85e0 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] 10.222.0.33 "GET /compute/v2.1/servers/dfb8f504-218a-471c-b7a8-70c498769f0e" status: 404 len: 111 microversion: 2.1 time: 0.073246 Sep 23 04:42:53.718613 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1444/2864] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:42:53 2022] GET /compute/v2.1/servers/dfb8f504-218a-471c-b7a8-70c498769f0e => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 04:42:53.728036 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-83a8598a-679c-4e9e-bc63-af565a695b6b tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Calling method '.version_select at 0x7ff1baa07940>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:53.742357 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:42:53.752300 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8911bc01-3af9-49f2-9d93-69e07fc8deaa tempest-ImagesMetadataTestJSON-1618678320 tempest-ImagesMetadataTestJSON-1618678320-project] 10.222.0.33 "PUT /compute/v2.1/images/7721111c-a389-457b-8cbf-48c14c3e1442/metadata" status: 200 len: 61 microversion: 2.1 time: 0.776724 Sep 23 04:42:53.753001 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1421/2865] 10.222.0.33 () {60 vars in 1280 bytes} [Fri Sep 23 04:42:52 2022] PUT /compute/v2.1/images/7721111c-a389-457b-8cbf-48c14c3e1442/metadata => generated 61 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 04:42:53.764223 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-553dbf2c-d9a1-4a34-bca5-6e5b21eef6be tempest-ImagesMetadataTestJSON-1618678320 tempest-ImagesMetadataTestJSON-1618678320-project] Calling method '.version_select at 0x7ff1bbd58a60>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:53.827476 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-83a8598a-679c-4e9e-bc63-af565a695b6b tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2000032787" status: 202 len: 0 microversion: 2.1 time: 0.104616 Sep 23 04:42:53.828066 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1445/2866] 10.222.0.33 () {58 vars in 1221 bytes} [Fri Sep 23 04:42:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2000032787 => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:42:54.005909 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-cb9b8894-5280-409b-9e61-a445d2141ec7 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:54.008248 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-cb9b8894-5280-409b-9e61-a445d2141ec7 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] [instance: 17bcb29e-d024-484c-ade0-793ef585ae96] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:54.019174 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cb9b8894-5280-409b-9e61-a445d2141ec7 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:54.020116 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cb9b8894-5280-409b-9e61-a445d2141ec7 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:54.020783 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cb9b8894-5280-409b-9e61-a445d2141ec7 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:54.022530 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cb9b8894-5280-409b-9e61-a445d2141ec7 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:54.023163 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cb9b8894-5280-409b-9e61-a445d2141ec7 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:54.023746 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cb9b8894-5280-409b-9e61-a445d2141ec7 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:54.158304 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-cb9b8894-5280-409b-9e61-a445d2141ec7 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd00d7cc82d4ec0b9b36fe2bb0be056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f66ca22a6f24928840a07e889f2e740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:54.172474 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-cb9b8894-5280-409b-9e61-a445d2141ec7 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6fd00d7cc82d4ec0b9b36fe2bb0be056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f66ca22a6f24928840a07e889f2e740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:54.174666 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-cb9b8894-5280-409b-9e61-a445d2141ec7 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6fd00d7cc82d4ec0b9b36fe2bb0be056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f66ca22a6f24928840a07e889f2e740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:54.176233 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-cb9b8894-5280-409b-9e61-a445d2141ec7 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] 10.222.0.33 "GET /compute/v2.1/servers/17bcb29e-d024-484c-ade0-793ef585ae96" status: 200 len: 1350 microversion: 2.47 time: 0.175318 Sep 23 04:42:54.177018 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1446/2867] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:42:53 2022] GET /compute/v2.1/servers/17bcb29e-d024-484c-ade0-793ef585ae96 => generated 1350 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:42:54.314455 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-553dbf2c-d9a1-4a34-bca5-6e5b21eef6be tempest-ImagesMetadataTestJSON-1618678320 tempest-ImagesMetadataTestJSON-1618678320-project] 10.222.0.33 "DELETE /compute/v2.1/images/7721111c-a389-457b-8cbf-48c14c3e1442/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.554640 Sep 23 04:42:54.315030 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1422/2868] 10.222.0.33 () {58 vars in 1296 bytes} [Fri Sep 23 04:42:53 2022] DELETE /compute/v2.1/images/7721111c-a389-457b-8cbf-48c14c3e1442/metadata/os_version => generated 0 bytes in 556 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 23 04:42:54.327855 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-625416de-6a38-4d4e-a7ef-ca7776b73f21 tempest-ImagesMetadataTestJSON-1618678320 tempest-ImagesMetadataTestJSON-1618678320-project] Calling method '.version_select at 0x7ff1bab69a60>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:54.391226 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-625416de-6a38-4d4e-a7ef-ca7776b73f21 tempest-ImagesMetadataTestJSON-1618678320 tempest-ImagesMetadataTestJSON-1618678320-project] 10.222.0.33 "GET /compute/v2.1/images/7721111c-a389-457b-8cbf-48c14c3e1442/metadata" status: 200 len: 37 microversion: 2.1 time: 0.070420 Sep 23 04:42:54.392979 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1447/2869] 10.222.0.33 () {58 vars in 1260 bytes} [Fri Sep 23 04:42:54 2022] GET /compute/v2.1/images/7721111c-a389-457b-8cbf-48c14c3e1442/metadata => generated 37 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 04:42:54.406048 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f9de9efa-d883-46a5-b6c5-b32115361b96 tempest-ImagesMetadataTestJSON-1618678320 tempest-ImagesMetadataTestJSON-1618678320-project] Action: 'update_all', calling method: .version_select at 0x7ff1bbe69280>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:42:54.477061 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-f9de9efa-d883-46a5-b6c5-b32115361b96 tempest-ImagesMetadataTestJSON-1618678320 tempest-ImagesMetadataTestJSON-1618678320-project] Getting quotas for project a1e370c98adf42c0a037739a16c23174. Resources: dict_keys(['metadata_items']) {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:42:54.482866 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-f9de9efa-d883-46a5-b6c5-b32115361b96 tempest-ImagesMetadataTestJSON-1618678320 tempest-ImagesMetadataTestJSON-1618678320-project] Getting quotas for user 89dc6f9b68894a848c129f1fb66cb5c5 and project a1e370c98adf42c0a037739a16c23174. Resources: dict_keys(['metadata_items']) {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:42:54.976598 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f9de9efa-d883-46a5-b6c5-b32115361b96 tempest-ImagesMetadataTestJSON-1618678320 tempest-ImagesMetadataTestJSON-1618678320-project] 10.222.0.33 "PUT /compute/v2.1/images/7721111c-a389-457b-8cbf-48c14c3e1442/metadata" status: 200 len: 61 microversion: 2.1 time: 0.574820 Sep 23 04:42:54.977242 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1423/2870] 10.222.0.33 () {60 vars in 1280 bytes} [Fri Sep 23 04:42:54 2022] PUT /compute/v2.1/images/7721111c-a389-457b-8cbf-48c14c3e1442/metadata => generated 61 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 04:42:54.987358 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a9b813c8-1ebe-4d9c-8f0b-9b7ac1cf3776 tempest-ImagesMetadataTestJSON-1618678320 tempest-ImagesMetadataTestJSON-1618678320-project] Calling method '.version_select at 0x7ff1baa92430>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:55.052689 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a9b813c8-1ebe-4d9c-8f0b-9b7ac1cf3776 tempest-ImagesMetadataTestJSON-1618678320 tempest-ImagesMetadataTestJSON-1618678320-project] 10.222.0.33 "GET /compute/v2.1/images/7721111c-a389-457b-8cbf-48c14c3e1442/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.069307 Sep 23 04:42:55.053320 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1448/2871] 10.222.0.33 () {58 vars in 1290 bytes} [Fri Sep 23 04:42:54 2022] GET /compute/v2.1/images/7721111c-a389-457b-8cbf-48c14c3e1442/metadata/os_distro => generated 33 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 23 04:42:55.068071 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-87bb3cd7-19c7-4e93-b1eb-1a93cce1feff tempest-ImagesMetadataTestJSON-1618678320 tempest-ImagesMetadataTestJSON-1618678320-project] Action: 'update_all', calling method: .version_select at 0x7ff1bbd58c10>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:42:55.152365 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-87bb3cd7-19c7-4e93-b1eb-1a93cce1feff tempest-ImagesMetadataTestJSON-1618678320 tempest-ImagesMetadataTestJSON-1618678320-project] Getting quotas for project a1e370c98adf42c0a037739a16c23174. Resources: dict_keys(['metadata_items']) {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:42:55.167161 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-87bb3cd7-19c7-4e93-b1eb-1a93cce1feff tempest-ImagesMetadataTestJSON-1618678320 tempest-ImagesMetadataTestJSON-1618678320-project] Getting quotas for user 89dc6f9b68894a848c129f1fb66cb5c5 and project a1e370c98adf42c0a037739a16c23174. Resources: dict_keys(['metadata_items']) {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:42:55.213789 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-61649902-ee89-4245-a3bd-ba9ed52a99b5 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:55.215217 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-61649902-ee89-4245-a3bd-ba9ed52a99b5 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] [instance: 17bcb29e-d024-484c-ade0-793ef585ae96] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:55.239409 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-61649902-ee89-4245-a3bd-ba9ed52a99b5 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:55.241853 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-61649902-ee89-4245-a3bd-ba9ed52a99b5 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:55.242711 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-61649902-ee89-4245-a3bd-ba9ed52a99b5 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:55.244128 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-61649902-ee89-4245-a3bd-ba9ed52a99b5 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:55.247134 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-61649902-ee89-4245-a3bd-ba9ed52a99b5 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:55.248237 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-61649902-ee89-4245-a3bd-ba9ed52a99b5 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:55.423939 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-87bb3cd7-19c7-4e93-b1eb-1a93cce1feff tempest-ImagesMetadataTestJSON-1618678320 tempest-ImagesMetadataTestJSON-1618678320-project] 10.222.0.33 "PUT /compute/v2.1/images/7721111c-a389-457b-8cbf-48c14c3e1442/metadata" status: 200 len: 61 microversion: 2.1 time: 0.360842 Sep 23 04:42:55.424828 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1424/2872] 10.222.0.33 () {60 vars in 1280 bytes} [Fri Sep 23 04:42:55 2022] PUT /compute/v2.1/images/7721111c-a389-457b-8cbf-48c14c3e1442/metadata => generated 61 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 04:42:55.455677 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-61649902-ee89-4245-a3bd-ba9ed52a99b5 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd00d7cc82d4ec0b9b36fe2bb0be056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f66ca22a6f24928840a07e889f2e740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:55.468642 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-61649902-ee89-4245-a3bd-ba9ed52a99b5 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6fd00d7cc82d4ec0b9b36fe2bb0be056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f66ca22a6f24928840a07e889f2e740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:55.473732 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-61649902-ee89-4245-a3bd-ba9ed52a99b5 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6fd00d7cc82d4ec0b9b36fe2bb0be056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f66ca22a6f24928840a07e889f2e740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:55.478724 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-61649902-ee89-4245-a3bd-ba9ed52a99b5 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] 10.222.0.33 "GET /compute/v2.1/servers/17bcb29e-d024-484c-ade0-793ef585ae96" status: 200 len: 1338 microversion: 2.47 time: 0.272845 Sep 23 04:42:55.479791 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1449/2873] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:42:55 2022] GET /compute/v2.1/servers/17bcb29e-d024-484c-ade0-793ef585ae96 => generated 1338 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:42:55.493620 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8c0d9911-569e-4cd8-ab99-b2e4522eca9e tempest-ImagesMetadataTestJSON-1618678320 tempest-ImagesMetadataTestJSON-1618678320-project] Calling method '.version_select at 0x7ff1babf1e50>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:55.567872 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-8c0d9911-569e-4cd8-ab99-b2e4522eca9e tempest-ImagesMetadataTestJSON-1618678320 tempest-ImagesMetadataTestJSON-1618678320-project] 10.222.0.33 "GET /compute/v2.1/images/7721111c-a389-457b-8cbf-48c14c3e1442/metadata" status: 200 len: 61 microversion: 2.1 time: 0.085750 Sep 23 04:42:55.572442 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1450/2874] 10.222.0.33 () {58 vars in 1260 bytes} [Fri Sep 23 04:42:55 2022] GET /compute/v2.1/images/7721111c-a389-457b-8cbf-48c14c3e1442/metadata => generated 61 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 04:42:55.587345 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-27b7358b-a877-4699-8971-7c7a4b59f2d1 tempest-ImagesMetadataTestJSON-1618678320 tempest-ImagesMetadataTestJSON-1618678320-project] Action: 'update_all', calling method: .version_select at 0x7ff1bab581f0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:42:55.673556 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-27b7358b-a877-4699-8971-7c7a4b59f2d1 tempest-ImagesMetadataTestJSON-1618678320 tempest-ImagesMetadataTestJSON-1618678320-project] Getting quotas for project a1e370c98adf42c0a037739a16c23174. Resources: dict_keys(['metadata_items']) {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:42:55.690862 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-27b7358b-a877-4699-8971-7c7a4b59f2d1 tempest-ImagesMetadataTestJSON-1618678320 tempest-ImagesMetadataTestJSON-1618678320-project] Getting quotas for user 89dc6f9b68894a848c129f1fb66cb5c5 and project a1e370c98adf42c0a037739a16c23174. Resources: dict_keys(['metadata_items']) {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:42:55.796663 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7c2c6363-b9eb-43e8-8788-0c91f6c5eaf8 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:55.801599 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7c2c6363-b9eb-43e8-8788-0c91f6c5eaf8 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] [instance: 53745879-9973-4217-b1c5-b45f917db80e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:55.828576 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7c2c6363-b9eb-43e8-8788-0c91f6c5eaf8 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:55.829209 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7c2c6363-b9eb-43e8-8788-0c91f6c5eaf8 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:55.830239 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7c2c6363-b9eb-43e8-8788-0c91f6c5eaf8 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:55.834144 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7c2c6363-b9eb-43e8-8788-0c91f6c5eaf8 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:55.836489 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7c2c6363-b9eb-43e8-8788-0c91f6c5eaf8 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:55.837169 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7c2c6363-b9eb-43e8-8788-0c91f6c5eaf8 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:55.921626 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7c2c6363-b9eb-43e8-8788-0c91f6c5eaf8 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] [instance: 53745879-9973-4217-b1c5-b45f917db80e] Going to try to terminate instance {{(pid=122698) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:42:55.954346 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-27b7358b-a877-4699-8971-7c7a4b59f2d1 tempest-ImagesMetadataTestJSON-1618678320 tempest-ImagesMetadataTestJSON-1618678320-project] 10.222.0.33 "PUT /compute/v2.1/images/7721111c-a389-457b-8cbf-48c14c3e1442/metadata" status: 200 len: 61 microversion: 2.1 time: 0.374431 Sep 23 04:42:55.955238 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1451/2875] 10.222.0.33 () {60 vars in 1280 bytes} [Fri Sep 23 04:42:55 2022] PUT /compute/v2.1/images/7721111c-a389-457b-8cbf-48c14c3e1442/metadata => generated 61 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 23 04:42:55.965568 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f7693b4d-2260-4808-be54-3cc8ef8e6eb2 tempest-ImagesMetadataTestJSON-1618678320 tempest-ImagesMetadataTestJSON-1618678320-project] Action: 'update_all', calling method: .version_select at 0x7ff1babf1dc0>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:42:56.045041 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-f7693b4d-2260-4808-be54-3cc8ef8e6eb2 tempest-ImagesMetadataTestJSON-1618678320 tempest-ImagesMetadataTestJSON-1618678320-project] Getting quotas for project a1e370c98adf42c0a037739a16c23174. Resources: dict_keys(['metadata_items']) {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:42:56.051713 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-f7693b4d-2260-4808-be54-3cc8ef8e6eb2 tempest-ImagesMetadataTestJSON-1618678320 tempest-ImagesMetadataTestJSON-1618678320-project] Getting quotas for user 89dc6f9b68894a848c129f1fb66cb5c5 and project a1e370c98adf42c0a037739a16c23174. Resources: dict_keys(['metadata_items']) {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:42:56.280021 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:42:56.403082 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7c2c6363-b9eb-43e8-8788-0c91f6c5eaf8 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] 10.222.0.33 "DELETE /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e" status: 204 len: 0 microversion: 2.42 time: 0.976981 Sep 23 04:42:56.404072 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1425/2876] 10.222.0.33 () {60 vars in 1280 bytes} [Fri Sep 23 04:42:55 2022] DELETE /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e => generated 0 bytes in 979 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 23 04:42:56.413567 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b400f44d-eade-4244-a048-e3d8a1c1b4ba tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:56.416034 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b400f44d-eade-4244-a048-e3d8a1c1b4ba tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] [instance: 53745879-9973-4217-b1c5-b45f917db80e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:56.438722 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b400f44d-eade-4244-a048-e3d8a1c1b4ba tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:56.444548 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b400f44d-eade-4244-a048-e3d8a1c1b4ba tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:56.445907 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b400f44d-eade-4244-a048-e3d8a1c1b4ba tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:56.451597 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b400f44d-eade-4244-a048-e3d8a1c1b4ba tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:56.452781 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b400f44d-eade-4244-a048-e3d8a1c1b4ba tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:56.460964 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b400f44d-eade-4244-a048-e3d8a1c1b4ba tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:56.704997 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f7693b4d-2260-4808-be54-3cc8ef8e6eb2 tempest-ImagesMetadataTestJSON-1618678320 tempest-ImagesMetadataTestJSON-1618678320-project] 10.222.0.33 "PUT /compute/v2.1/images/7721111c-a389-457b-8cbf-48c14c3e1442/metadata" status: 200 len: 64 microversion: 2.1 time: 0.743967 Sep 23 04:42:56.705614 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1452/2877] 10.222.0.33 () {60 vars in 1280 bytes} [Fri Sep 23 04:42:55 2022] PUT /compute/v2.1/images/7721111c-a389-457b-8cbf-48c14c3e1442/metadata => generated 64 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 04:42:56.710821 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-23b5a2e9-240c-4b17-a5db-53446b3a4f19 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:56.714247 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-23b5a2e9-240c-4b17-a5db-53446b3a4f19 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] [instance: 17bcb29e-d024-484c-ade0-793ef585ae96] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:56.721378 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-23b5a2e9-240c-4b17-a5db-53446b3a4f19 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:56.722071 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-23b5a2e9-240c-4b17-a5db-53446b3a4f19 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:56.726416 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-23b5a2e9-240c-4b17-a5db-53446b3a4f19 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:56.727230 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-23b5a2e9-240c-4b17-a5db-53446b3a4f19 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:56.727724 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-23b5a2e9-240c-4b17-a5db-53446b3a4f19 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:56.728167 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-23b5a2e9-240c-4b17-a5db-53446b3a4f19 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:56.852385 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-23b5a2e9-240c-4b17-a5db-53446b3a4f19 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd00d7cc82d4ec0b9b36fe2bb0be056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f66ca22a6f24928840a07e889f2e740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:56.864497 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-23b5a2e9-240c-4b17-a5db-53446b3a4f19 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6fd00d7cc82d4ec0b9b36fe2bb0be056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f66ca22a6f24928840a07e889f2e740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:56.866645 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-23b5a2e9-240c-4b17-a5db-53446b3a4f19 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6fd00d7cc82d4ec0b9b36fe2bb0be056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f66ca22a6f24928840a07e889f2e740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:56.867882 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-23b5a2e9-240c-4b17-a5db-53446b3a4f19 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] 10.222.0.33 "GET /compute/v2.1/servers/17bcb29e-d024-484c-ade0-793ef585ae96" status: 200 len: 1338 microversion: 2.47 time: 0.161233 Sep 23 04:42:56.891499 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1453/2878] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:42:56 2022] GET /compute/v2.1/servers/17bcb29e-d024-484c-ade0-793ef585ae96 => generated 1338 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:42:56.912908 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8ad08469-fc5f-4fdd-8dab-f25979ba17f5 tempest-ImagesMetadataTestJSON-1618678320 tempest-ImagesMetadataTestJSON-1618678320-project] Calling method '.version_select at 0x7ff1bab58700>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:56.923285 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b400f44d-eade-4244-a048-e3d8a1c1b4ba tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:56.937520 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b400f44d-eade-4244-a048-e3d8a1c1b4ba tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:56.947455 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b400f44d-eade-4244-a048-e3d8a1c1b4ba tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:56.949039 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b400f44d-eade-4244-a048-e3d8a1c1b4ba tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] 10.222.0.33 "GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e" status: 200 len: 2953 microversion: 2.42 time: 0.540371 Sep 23 04:42:56.949860 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1426/2879] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:42:56 2022] GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e => generated 2953 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:42:57.243743 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-8ad08469-fc5f-4fdd-8dab-f25979ba17f5 tempest-ImagesMetadataTestJSON-1618678320 tempest-ImagesMetadataTestJSON-1618678320-project] 10.222.0.33 "GET /compute/v2.1/images/7721111c-a389-457b-8cbf-48c14c3e1442/metadata" status: 200 len: 64 microversion: 2.1 time: 0.118778 Sep 23 04:42:57.243743 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1454/2880] 10.222.0.33 () {58 vars in 1260 bytes} [Fri Sep 23 04:42:56 2022] GET /compute/v2.1/images/7721111c-a389-457b-8cbf-48c14c3e1442/metadata => generated 64 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 04:42:57.245790 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-6da35be8-fb90-418f-9e65-ab0f85580770 req-79028480-a92d-4a0c-846c-b8700d4349f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48df7db9-a805-4c72-a1a5-29632b00248c", "tag": "26df0c1e-53e4-4613-b218-9ca9a68bcbbc"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:42:57.245790 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-6da35be8-fb90-418f-9e65-ab0f85580770 req-79028480-a92d-4a0c-846c-b8700d4349f8 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:57.245790 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-6da35be8-fb90-418f-9e65-ab0f85580770 req-79028480-a92d-4a0c-846c-b8700d4349f8 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:57.245790 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-6da35be8-fb90-418f-9e65-ab0f85580770 req-79028480-a92d-4a0c-846c-b8700d4349f8 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:57.245790 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-6da35be8-fb90-418f-9e65-ab0f85580770 req-79028480-a92d-4a0c-846c-b8700d4349f8 service nova] Creating event network-changed:26df0c1e-53e4-4613-b218-9ca9a68bcbbc for instance 48df7db9-a805-4c72-a1a5-29632b00248c on n-h1-846463-3 Sep 23 04:42:57.245790 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-6da35be8-fb90-418f-9e65-ab0f85580770 req-79028480-a92d-4a0c-846c-b8700d4349f8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076448 Sep 23 04:42:57.245790 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1427/2881] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:42:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:42:57.247218 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-fb4506ad-148e-4da9-a037-6b1348af8565 tempest-ImagesMetadataTestJSON-1618678320 tempest-ImagesMetadataTestJSON-1618678320-project] Action: 'update_all', calling method: .version_select at 0x7ff1bab7c430>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:42:57.311722 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-fb4506ad-148e-4da9-a037-6b1348af8565 tempest-ImagesMetadataTestJSON-1618678320 tempest-ImagesMetadataTestJSON-1618678320-project] Getting quotas for project a1e370c98adf42c0a037739a16c23174. Resources: dict_keys(['metadata_items']) {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:42:57.320351 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-fb4506ad-148e-4da9-a037-6b1348af8565 tempest-ImagesMetadataTestJSON-1618678320 tempest-ImagesMetadataTestJSON-1618678320-project] Getting quotas for user 89dc6f9b68894a848c129f1fb66cb5c5 and project a1e370c98adf42c0a037739a16c23174. Resources: dict_keys(['metadata_items']) {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:42:57.904160 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-46a02ef6-95db-4b56-a854-493c56113dff tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:57.905527 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-46a02ef6-95db-4b56-a854-493c56113dff tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] [instance: 17bcb29e-d024-484c-ade0-793ef585ae96] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:57.916903 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-46a02ef6-95db-4b56-a854-493c56113dff tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:57.917680 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-46a02ef6-95db-4b56-a854-493c56113dff tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:57.919279 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-46a02ef6-95db-4b56-a854-493c56113dff tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:57.922206 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-46a02ef6-95db-4b56-a854-493c56113dff tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:57.923191 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-46a02ef6-95db-4b56-a854-493c56113dff tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:57.924711 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-46a02ef6-95db-4b56-a854-493c56113dff tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:57.948026 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-fb4506ad-148e-4da9-a037-6b1348af8565 tempest-ImagesMetadataTestJSON-1618678320 tempest-ImagesMetadataTestJSON-1618678320-project] 10.222.0.33 "PUT /compute/v2.1/images/7721111c-a389-457b-8cbf-48c14c3e1442/metadata" status: 200 len: 61 microversion: 2.1 time: 0.720526 Sep 23 04:42:57.953203 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1455/2882] 10.222.0.33 () {60 vars in 1280 bytes} [Fri Sep 23 04:42:57 2022] PUT /compute/v2.1/images/7721111c-a389-457b-8cbf-48c14c3e1442/metadata => generated 61 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 04:42:57.971860 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-52cd9645-e93a-43ea-bc97-fb974b87c4d1 tempest-ImagesMetadataTestJSON-1618678320 tempest-ImagesMetadataTestJSON-1618678320-project] Action: 'update', calling method: .version_select at 0x7ff1bab58310>, body: {"meta": {"os_version": "alt"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:42:58.073329 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-52cd9645-e93a-43ea-bc97-fb974b87c4d1 tempest-ImagesMetadataTestJSON-1618678320 tempest-ImagesMetadataTestJSON-1618678320-project] Getting quotas for project a1e370c98adf42c0a037739a16c23174. Resources: dict_keys(['metadata_items']) {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:42:58.080926 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-52cd9645-e93a-43ea-bc97-fb974b87c4d1 tempest-ImagesMetadataTestJSON-1618678320 tempest-ImagesMetadataTestJSON-1618678320-project] Getting quotas for user 89dc6f9b68894a848c129f1fb66cb5c5 and project a1e370c98adf42c0a037739a16c23174. Resources: dict_keys(['metadata_items']) {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:42:58.118552 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-46a02ef6-95db-4b56-a854-493c56113dff tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd00d7cc82d4ec0b9b36fe2bb0be056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f66ca22a6f24928840a07e889f2e740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:58.138617 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-46a02ef6-95db-4b56-a854-493c56113dff tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6fd00d7cc82d4ec0b9b36fe2bb0be056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f66ca22a6f24928840a07e889f2e740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:58.141049 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-46a02ef6-95db-4b56-a854-493c56113dff tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6fd00d7cc82d4ec0b9b36fe2bb0be056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f66ca22a6f24928840a07e889f2e740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:58.142468 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-46a02ef6-95db-4b56-a854-493c56113dff tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] 10.222.0.33 "GET /compute/v2.1/servers/17bcb29e-d024-484c-ade0-793ef585ae96" status: 200 len: 1338 microversion: 2.47 time: 0.244423 Sep 23 04:42:58.143621 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1428/2883] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:42:57 2022] GET /compute/v2.1/servers/17bcb29e-d024-484c-ade0-793ef585ae96 => generated 1338 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:42:58.148299 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1a451262-072e-4e87-b9fc-6aed6b9cd229 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:58.153610 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-1a451262-072e-4e87-b9fc-6aed6b9cd229 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] [instance: 53745879-9973-4217-b1c5-b45f917db80e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:58.173753 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1a451262-072e-4e87-b9fc-6aed6b9cd229 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:58.174755 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1a451262-072e-4e87-b9fc-6aed6b9cd229 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:58.176621 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1a451262-072e-4e87-b9fc-6aed6b9cd229 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:58.180922 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1a451262-072e-4e87-b9fc-6aed6b9cd229 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:58.181626 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1a451262-072e-4e87-b9fc-6aed6b9cd229 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:58.182542 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1a451262-072e-4e87-b9fc-6aed6b9cd229 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:58.732827 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-1a451262-072e-4e87-b9fc-6aed6b9cd229 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:58.743225 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-1a451262-072e-4e87-b9fc-6aed6b9cd229 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:58.745152 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-1a451262-072e-4e87-b9fc-6aed6b9cd229 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:58.746494 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-1a451262-072e-4e87-b9fc-6aed6b9cd229 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] 10.222.0.33 "GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e" status: 200 len: 2953 microversion: 2.42 time: 0.601928 Sep 23 04:42:58.748954 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-52cd9645-e93a-43ea-bc97-fb974b87c4d1 tempest-ImagesMetadataTestJSON-1618678320 tempest-ImagesMetadataTestJSON-1618678320-project] 10.222.0.33 "PUT /compute/v2.1/images/7721111c-a389-457b-8cbf-48c14c3e1442/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.791071 Sep 23 04:42:58.751042 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1456/2884] 10.222.0.33 () {60 vars in 1313 bytes} [Fri Sep 23 04:42:57 2022] PUT /compute/v2.1/images/7721111c-a389-457b-8cbf-48c14c3e1442/metadata/os_version => generated 31 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 04:42:58.770345 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1429/2885] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:42:58 2022] GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e => generated 2953 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:42:58.774036 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-148d0488-1410-4c85-b781-60ee841e3e90 tempest-ImagesMetadataTestJSON-1618678320 tempest-ImagesMetadataTestJSON-1618678320-project] Calling method '.version_select at 0x7ff1babe8c10>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:58.846722 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-148d0488-1410-4c85-b781-60ee841e3e90 tempest-ImagesMetadataTestJSON-1618678320 tempest-ImagesMetadataTestJSON-1618678320-project] 10.222.0.33 "GET /compute/v2.1/images/7721111c-a389-457b-8cbf-48c14c3e1442/metadata" status: 200 len: 58 microversion: 2.1 time: 0.078970 Sep 23 04:42:58.847335 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1457/2886] 10.222.0.33 () {58 vars in 1260 bytes} [Fri Sep 23 04:42:58 2022] GET /compute/v2.1/images/7721111c-a389-457b-8cbf-48c14c3e1442/metadata => generated 58 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 23 04:42:58.860196 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-74db0b54-6755-4781-ae19-ba33dd0824f1 tempest-ImagesMetadataTestJSON-1618678320 tempest-ImagesMetadataTestJSON-1618678320-project] Action: 'update_all', calling method: .version_select at 0x7ff1bafe3dc0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:42:58.937991 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-74db0b54-6755-4781-ae19-ba33dd0824f1 tempest-ImagesMetadataTestJSON-1618678320 tempest-ImagesMetadataTestJSON-1618678320-project] Getting quotas for project a1e370c98adf42c0a037739a16c23174. Resources: dict_keys(['metadata_items']) {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:42:58.945099 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-74db0b54-6755-4781-ae19-ba33dd0824f1 tempest-ImagesMetadataTestJSON-1618678320 tempest-ImagesMetadataTestJSON-1618678320-project] Getting quotas for user 89dc6f9b68894a848c129f1fb66cb5c5 and project a1e370c98adf42c0a037739a16c23174. Resources: dict_keys(['metadata_items']) {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:42:59.174212 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5b27348f-285c-492b-b321-4429f4738cf0 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:59.175355 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-5b27348f-285c-492b-b321-4429f4738cf0 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] [instance: 17bcb29e-d024-484c-ade0-793ef585ae96] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:59.200818 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5b27348f-285c-492b-b321-4429f4738cf0 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:59.201341 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5b27348f-285c-492b-b321-4429f4738cf0 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:59.208702 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5b27348f-285c-492b-b321-4429f4738cf0 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:59.210148 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5b27348f-285c-492b-b321-4429f4738cf0 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:59.211023 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5b27348f-285c-492b-b321-4429f4738cf0 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:59.211487 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5b27348f-285c-492b-b321-4429f4738cf0 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:59.460899 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-5b27348f-285c-492b-b321-4429f4738cf0 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd00d7cc82d4ec0b9b36fe2bb0be056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f66ca22a6f24928840a07e889f2e740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:59.473084 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-5b27348f-285c-492b-b321-4429f4738cf0 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6fd00d7cc82d4ec0b9b36fe2bb0be056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f66ca22a6f24928840a07e889f2e740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:59.479976 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-5b27348f-285c-492b-b321-4429f4738cf0 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6fd00d7cc82d4ec0b9b36fe2bb0be056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f66ca22a6f24928840a07e889f2e740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:42:59.487255 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5b27348f-285c-492b-b321-4429f4738cf0 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] 10.222.0.33 "GET /compute/v2.1/servers/17bcb29e-d024-484c-ade0-793ef585ae96" status: 200 len: 1359 microversion: 2.47 time: 0.318375 Sep 23 04:42:59.492903 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1458/2887] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:42:59 2022] GET /compute/v2.1/servers/17bcb29e-d024-484c-ade0-793ef585ae96 => generated 1359 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:42:59.497984 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-674beb08-17ea-4d16-83ba-fc91201adfc4 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:42:59.506835 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-674beb08-17ea-4d16-83ba-fc91201adfc4 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 9d2757b5-8933-4d44-bfa5-cb5054cd05c6] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:59.526473 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-674beb08-17ea-4d16-83ba-fc91201adfc4 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:59.528712 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-674beb08-17ea-4d16-83ba-fc91201adfc4 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:59.530440 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-674beb08-17ea-4d16-83ba-fc91201adfc4 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:59.531381 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-674beb08-17ea-4d16-83ba-fc91201adfc4 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:59.532747 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-674beb08-17ea-4d16-83ba-fc91201adfc4 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:59.535166 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-674beb08-17ea-4d16-83ba-fc91201adfc4 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:59.562932 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-674beb08-17ea-4d16-83ba-fc91201adfc4 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] HTTP exception thrown: Instance 9d2757b5-8933-4d44-bfa5-cb5054cd05c6 could not be found. Sep 23 04:42:59.565253 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-674beb08-17ea-4d16-83ba-fc91201adfc4 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Request method failure captured: Sep 23 04:42:59.565253 n-d-846463-3 devstack@n-api.service[122699]: request: DELETE /compute/v2.1/servers/9d2757b5-8933-4d44-bfa5-cb5054cd05c6 HTTP/1.1 Sep 23 04:42:59.565253 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:42:59.565253 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:42:59.565253 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:42:59.565253 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:42:59.565253 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:42:59.565253 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:42:59.565253 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:42:59.565253 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:42:59.565253 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTgD-AJZNKtluGEJNjQKU0pcHtUCc1AZ8Ycz4MPGIeanw2_GglRmvn8LiMCEayIX86yw_RpyCC_JZrlVGSjhSgenUVZhpJ_MqN5SLmcv6Qnl3N6cXWJgtCK8N_ffRhD1dYgLIdHHgnmyTAptDZsjatOWU1ocTU40JP9XOpkK3deqL7A Sep 23 04:42:59.565253 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:42:59.565253 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:42:59.565253 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:42:59.565253 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:42:59.565253 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:42:59.565253 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:42:59.565253 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: fe698721372f40888dc2918c46e65f2f Sep 23 04:42:59.565253 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-DeleteServersTestJSON-347759205 Sep 23 04:42:59.565253 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:42:59.565253 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:42:59.565253 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fe698721372f40888dc2918c46e65f2f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe698721372f40888dc2918c46e65f2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fe698721372f40888dc2918c46e65f2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe698721372f40888dc2918c46e65f2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:42:59.565253 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-DeleteServersTestJSON-347759205 Sep 23 04:42:59.565253 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: fe698721372f40888dc2918c46e65f2f Sep 23 04:42:59.565253 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-DeleteServersTestJSON-347759205 Sep 23 04:42:59.565253 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-DeleteServersTestJSON-347759205-project Sep 23 04:42:59.565253 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:42:59.565253 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:42:59.565253 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 36526fe612c840fb907e1992d8e62538 Sep 23 04:42:59.565253 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-DeleteServersTestJSON-347759205-project Sep 23 04:42:59.565253 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:42:59.565253 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 9d2757b5-8933-4d44-bfa5-cb5054cd05c6 could not be found. Sep 23 04:42:59.565253 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '9d2757b5-8933-4d44-bfa5-cb5054cd05c6'} Sep 23 04:42:59.565253 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:42:59.565253 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:42:59.565253 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:42:59.565253 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:42:59.565253 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:42:59.565253 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:42:59.565253 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:42:59.565253 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:42:59.565253 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:42:59.565253 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:42:59.565253 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d2757b5-8933-4d44-bfa5-cb5054cd05c6 could not be found. Sep 23 04:42:59.565253 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:42:59.565253 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:42:59.565253 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:42:59.565253 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:42:59.565253 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:42:59.565253 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:42:59.565253 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:42:59.565253 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:42:59.565253 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:42:59.565253 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:42:59.565253 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 04:42:59.565253 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 04:42:59.565253 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 04:42:59.565253 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 04:42:59.565253 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:42:59.565253 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:42:59.565253 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:42:59.565253 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:42:59.571337 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d2757b5-8933-4d44-bfa5-cb5054cd05c6 could not be found. Sep 23 04:42:59.571337 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:42:59.571337 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:42:59.571337 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:42:59.571337 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:42:59.571337 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:42:59.571337 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:42:59.571337 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:42:59.571337 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:42:59.571337 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d2757b5-8933-4d44-bfa5-cb5054cd05c6 could not be found. Sep 23 04:42:59.571337 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:42:59.571337 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-674beb08-17ea-4d16-83ba-fc91201adfc4 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Returning 404 to user: Instance 9d2757b5-8933-4d44-bfa5-cb5054cd05c6 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:42:59.571337 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-674beb08-17ea-4d16-83ba-fc91201adfc4 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9d2757b5-8933-4d44-bfa5-cb5054cd05c6" status: 404 len: 111 microversion: 2.1 time: 0.072693 Sep 23 04:42:59.575649 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1459/2888] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:42:59 2022] DELETE /compute/v2.1/servers/9d2757b5-8933-4d44-bfa5-cb5054cd05c6 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:42:59.649604 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-74db0b54-6755-4781-ae19-ba33dd0824f1 tempest-ImagesMetadataTestJSON-1618678320 tempest-ImagesMetadataTestJSON-1618678320-project] 10.222.0.33 "PUT /compute/v2.1/images/7721111c-a389-457b-8cbf-48c14c3e1442/metadata" status: 200 len: 61 microversion: 2.1 time: 0.793652 Sep 23 04:42:59.650692 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1430/2889] 10.222.0.33 () {60 vars in 1280 bytes} [Fri Sep 23 04:42:58 2022] PUT /compute/v2.1/images/7721111c-a389-457b-8cbf-48c14c3e1442/metadata => generated 61 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 04:42:59.658704 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f6530527-49a6-4b98-a84c-fc364a5fdd14 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-131946359"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:42:59.661068 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f6530527-49a6-4b98-a84c-fc364a5fdd14 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] [instance: 17bcb29e-d024-484c-ade0-793ef585ae96] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:42:59.686307 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f6530527-49a6-4b98-a84c-fc364a5fdd14 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:59.700490 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f6530527-49a6-4b98-a84c-fc364a5fdd14 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:59.700948 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f6530527-49a6-4b98-a84c-fc364a5fdd14 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:59.701692 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f6530527-49a6-4b98-a84c-fc364a5fdd14 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:42:59.701814 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f4b6f222-8f73-4f4b-81c3-2c3276bda204 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-1435868468", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "networks": [{"uuid": "e70e4da0-3337-4af1-b4df-8067d676f5e8"}]}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:42:59.702191 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f6530527-49a6-4b98-a84c-fc364a5fdd14 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:42:59.702619 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f6530527-49a6-4b98-a84c-fc364a5fdd14 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:42:59.812894 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.neutron [None req-f4b6f222-8f73-4f4b-81c3-2c3276bda204 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] validate_networks() for [('e70e4da0-3337-4af1-b4df-8067d676f5e8', None, None, None, None, None)] {{(pid=122699) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:42:59.986307 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:43:00.422728 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f6530527-49a6-4b98-a84c-fc364a5fdd14 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] 10.222.0.33 "POST /compute/v2.1/servers/17bcb29e-d024-484c-ade0-793ef585ae96/action" status: 202 len: 52 microversion: 2.47 time: 0.770837 Sep 23 04:43:00.423647 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1431/2890] 10.222.0.33 () {62 vars in 1319 bytes} [Fri Sep 23 04:42:59 2022] POST /compute/v2.1/servers/17bcb29e-d024-484c-ade0-793ef585ae96/action => generated 52 bytes in 773 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Sep 23 04:43:00.430268 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c062b7a9-8893-40f0-96c3-ec8133bcc3ec tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:00.434722 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c062b7a9-8893-40f0-96c3-ec8133bcc3ec tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 9d2757b5-8933-4d44-bfa5-cb5054cd05c6] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:00.451023 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c062b7a9-8893-40f0-96c3-ec8133bcc3ec tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:00.451661 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c062b7a9-8893-40f0-96c3-ec8133bcc3ec tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:00.454431 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c062b7a9-8893-40f0-96c3-ec8133bcc3ec tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:00.455296 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c062b7a9-8893-40f0-96c3-ec8133bcc3ec tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:00.455904 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c062b7a9-8893-40f0-96c3-ec8133bcc3ec tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:00.457358 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c062b7a9-8893-40f0-96c3-ec8133bcc3ec tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:00.498473 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-c062b7a9-8893-40f0-96c3-ec8133bcc3ec tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] HTTP exception thrown: Instance 9d2757b5-8933-4d44-bfa5-cb5054cd05c6 could not be found. Sep 23 04:43:00.502815 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c062b7a9-8893-40f0-96c3-ec8133bcc3ec tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Request method failure captured: Sep 23 04:43:00.502815 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/9d2757b5-8933-4d44-bfa5-cb5054cd05c6 HTTP/1.1 Sep 23 04:43:00.502815 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:43:00.502815 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:43:00.502815 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:43:00.502815 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:43:00.502815 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:43:00.502815 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:43:00.502815 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:43:00.502815 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:43:00.502815 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTgD-AJZNKtluGEJNjQKU0pcHtUCc1AZ8Ycz4MPGIeanw2_GglRmvn8LiMCEayIX86yw_RpyCC_JZrlVGSjhSgenUVZhpJ_MqN5SLmcv6Qnl3N6cXWJgtCK8N_ffRhD1dYgLIdHHgnmyTAptDZsjatOWU1ocTU40JP9XOpkK3deqL7A Sep 23 04:43:00.502815 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:43:00.502815 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:43:00.502815 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:43:00.502815 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:43:00.502815 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:43:00.502815 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:43:00.502815 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: fe698721372f40888dc2918c46e65f2f Sep 23 04:43:00.502815 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-DeleteServersTestJSON-347759205 Sep 23 04:43:00.502815 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:43:00.502815 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:43:00.502815 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fe698721372f40888dc2918c46e65f2f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe698721372f40888dc2918c46e65f2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fe698721372f40888dc2918c46e65f2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe698721372f40888dc2918c46e65f2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:43:00.502815 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-DeleteServersTestJSON-347759205 Sep 23 04:43:00.502815 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: fe698721372f40888dc2918c46e65f2f Sep 23 04:43:00.502815 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-DeleteServersTestJSON-347759205 Sep 23 04:43:00.502815 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-DeleteServersTestJSON-347759205-project Sep 23 04:43:00.502815 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:43:00.502815 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:43:00.502815 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 36526fe612c840fb907e1992d8e62538 Sep 23 04:43:00.502815 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-DeleteServersTestJSON-347759205-project Sep 23 04:43:00.502815 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:43:00.502815 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 9d2757b5-8933-4d44-bfa5-cb5054cd05c6 could not be found. Sep 23 04:43:00.502815 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '9d2757b5-8933-4d44-bfa5-cb5054cd05c6'} Sep 23 04:43:00.502815 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:43:00.502815 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:43:00.502815 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:43:00.502815 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:43:00.502815 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:43:00.502815 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:43:00.502815 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:43:00.502815 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:43:00.502815 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:43:00.502815 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:43:00.502815 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d2757b5-8933-4d44-bfa5-cb5054cd05c6 could not be found. Sep 23 04:43:00.502815 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:43:00.502815 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:43:00.502815 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:43:00.502815 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:43:00.502815 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:43:00.502815 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:43:00.502815 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:43:00.502815 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:43:00.502815 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:43:00.502815 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:43:00.502815 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:43:00.502815 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:43:00.502815 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:43:00.502815 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:43:00.502815 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:43:00.502815 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:43:00.502815 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d2757b5-8933-4d44-bfa5-cb5054cd05c6 could not be found. Sep 23 04:43:00.502815 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:43:00.502815 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:43:00.502815 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:43:00.507159 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:43:00.507159 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:43:00.507159 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:43:00.507159 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:43:00.507159 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:43:00.507159 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d2757b5-8933-4d44-bfa5-cb5054cd05c6 could not be found. Sep 23 04:43:00.507159 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:43:00.510785 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c062b7a9-8893-40f0-96c3-ec8133bcc3ec tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Returning 404 to user: Instance 9d2757b5-8933-4d44-bfa5-cb5054cd05c6 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:43:00.513560 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c062b7a9-8893-40f0-96c3-ec8133bcc3ec tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/9d2757b5-8933-4d44-bfa5-cb5054cd05c6" status: 404 len: 111 microversion: 2.1 time: 0.088400 Sep 23 04:43:00.524286 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1432/2891] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:00 2022] GET /compute/v2.1/servers/9d2757b5-8933-4d44-bfa5-cb5054cd05c6 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:43:00.532072 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-81edf05e-9749-434f-9beb-951a00b5e28a tempest-ImagesMetadataTestJSON-1618678320 tempest-ImagesMetadataTestJSON-1618678320-project] Action: 'create', calling method: .version_select at 0x7ff1bafe3b80>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:43:00.627580 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-81edf05e-9749-434f-9beb-951a00b5e28a tempest-ImagesMetadataTestJSON-1618678320 tempest-ImagesMetadataTestJSON-1618678320-project] Getting quotas for project a1e370c98adf42c0a037739a16c23174. Resources: dict_keys(['metadata_items']) {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:43:00.654042 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-81edf05e-9749-434f-9beb-951a00b5e28a tempest-ImagesMetadataTestJSON-1618678320 tempest-ImagesMetadataTestJSON-1618678320-project] Getting quotas for user 89dc6f9b68894a848c129f1fb66cb5c5 and project a1e370c98adf42c0a037739a16c23174. Resources: dict_keys(['metadata_items']) {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:43:00.672008 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-f4b6f222-8f73-4f4b-81c3-2c3276bda204 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Flavor limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:43:00.672008 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-f4b6f222-8f73-4f4b-81c3-2c3276bda204 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Image limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:43:00.672008 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-f4b6f222-8f73-4f4b-81c3-2c3276bda204 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Flavor pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:43:00.672008 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-f4b6f222-8f73-4f4b-81c3-2c3276bda204 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Image pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:43:00.672008 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-f4b6f222-8f73-4f4b-81c3-2c3276bda204 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:43:00.690579 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f4b6f222-8f73-4f4b-81c3-2c3276bda204 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:00.691399 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f4b6f222-8f73-4f4b-81c3-2c3276bda204 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:00.698035 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f4b6f222-8f73-4f4b-81c3-2c3276bda204 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:00.699199 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f4b6f222-8f73-4f4b-81c3-2c3276bda204 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:00.703032 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f4b6f222-8f73-4f4b-81c3-2c3276bda204 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:00.703032 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f4b6f222-8f73-4f4b-81c3-2c3276bda204 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:00.744275 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-f4b6f222-8f73-4f4b-81c3-2c3276bda204 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Getting quotas for project c23bd5a8b84942898a99930b2bc0ca12. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:43:00.761996 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-f4b6f222-8f73-4f4b-81c3-2c3276bda204 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Getting quotas for user 252c87e244984f71ae0907ee769bec05 and project c23bd5a8b84942898a99930b2bc0ca12. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:43:00.822076 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f4b6f222-8f73-4f4b-81c3-2c3276bda204 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Going to run 1 instances... {{(pid=122699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:43:00.829469 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f4b6f222-8f73-4f4b-81c3-2c3276bda204 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 5051152b-180a-4ed9-85fb-074836ae447c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:43:01.061320 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f4b6f222-8f73-4f4b-81c3-2c3276bda204 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.481146 Sep 23 04:43:01.064892 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1460/2892] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:42:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1492 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:43:01.073567 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-cda54fe1-b806-4774-8c35-dda61184c29d tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:01.085169 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-cda54fe1-b806-4774-8c35-dda61184c29d tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] [instance: 53745879-9973-4217-b1c5-b45f917db80e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:01.109224 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cda54fe1-b806-4774-8c35-dda61184c29d tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:01.110045 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cda54fe1-b806-4774-8c35-dda61184c29d tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:01.114227 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cda54fe1-b806-4774-8c35-dda61184c29d tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:01.115104 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cda54fe1-b806-4774-8c35-dda61184c29d tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:01.119571 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cda54fe1-b806-4774-8c35-dda61184c29d tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:01.120401 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cda54fe1-b806-4774-8c35-dda61184c29d tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:01.340176 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-81edf05e-9749-434f-9beb-951a00b5e28a tempest-ImagesMetadataTestJSON-1618678320 tempest-ImagesMetadataTestJSON-1618678320-project] 10.222.0.33 "POST /compute/v2.1/images/7721111c-a389-457b-8cbf-48c14c3e1442/metadata" status: 200 len: 85 microversion: 2.1 time: 0.814587 Sep 23 04:43:01.340946 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1433/2893] 10.222.0.33 () {60 vars in 1281 bytes} [Fri Sep 23 04:43:00 2022] POST /compute/v2.1/images/7721111c-a389-457b-8cbf-48c14c3e1442/metadata => generated 85 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 04:43:01.351001 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6416a7dc-cb40-4fd6-b48a-043522e1307d tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:01.351709 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-6416a7dc-cb40-4fd6-b48a-043522e1307d tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] [instance: 17bcb29e-d024-484c-ade0-793ef585ae96] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:01.359274 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6416a7dc-cb40-4fd6-b48a-043522e1307d tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:01.359946 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6416a7dc-cb40-4fd6-b48a-043522e1307d tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:01.360564 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6416a7dc-cb40-4fd6-b48a-043522e1307d tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:01.362565 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6416a7dc-cb40-4fd6-b48a-043522e1307d tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:01.363199 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6416a7dc-cb40-4fd6-b48a-043522e1307d tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:01.364320 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6416a7dc-cb40-4fd6-b48a-043522e1307d tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:01.398272 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-6416a7dc-cb40-4fd6-b48a-043522e1307d tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] [instance: 17bcb29e-d024-484c-ade0-793ef585ae96] Going to try to terminate instance {{(pid=122698) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:43:01.590086 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:43:01.743070 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-cda54fe1-b806-4774-8c35-dda61184c29d tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:01.768660 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-cda54fe1-b806-4774-8c35-dda61184c29d tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:01.773170 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-cda54fe1-b806-4774-8c35-dda61184c29d tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:01.775655 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-cda54fe1-b806-4774-8c35-dda61184c29d tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] 10.222.0.33 "GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e" status: 200 len: 2953 microversion: 2.42 time: 0.709469 Sep 23 04:43:01.783217 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1461/2894] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:43:01 2022] GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e => generated 2953 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:43:01.799395 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-cbf8aed2-dc19-4003-a9d5-38fcb4979490 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:01.829208 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-cbf8aed2-dc19-4003-a9d5-38fcb4979490 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 19d7387c-9776-4e8e-801d-c959ba47af7f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:01.871067 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cbf8aed2-dc19-4003-a9d5-38fcb4979490 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:01.872042 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cbf8aed2-dc19-4003-a9d5-38fcb4979490 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:01.872933 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cbf8aed2-dc19-4003-a9d5-38fcb4979490 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:01.874009 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cbf8aed2-dc19-4003-a9d5-38fcb4979490 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:01.874772 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cbf8aed2-dc19-4003-a9d5-38fcb4979490 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:01.875505 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cbf8aed2-dc19-4003-a9d5-38fcb4979490 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:01.887100 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-6416a7dc-cb40-4fd6-b48a-043522e1307d tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] 10.222.0.33 "DELETE /compute/v2.1/servers/17bcb29e-d024-484c-ade0-793ef585ae96" status: 204 len: 0 microversion: 2.47 time: 0.542729 Sep 23 04:43:01.893258 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1434/2895] 10.222.0.33 () {60 vars in 1280 bytes} [Fri Sep 23 04:43:01 2022] DELETE /compute/v2.1/servers/17bcb29e-d024-484c-ade0-793ef585ae96 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 23 04:43:01.923272 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-cbf8aed2-dc19-4003-a9d5-38fcb4979490 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] HTTP exception thrown: Instance 19d7387c-9776-4e8e-801d-c959ba47af7f could not be found. Sep 23 04:43:01.927690 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-cbf8aed2-dc19-4003-a9d5-38fcb4979490 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Request method failure captured: Sep 23 04:43:01.927690 n-d-846463-3 devstack@n-api.service[122699]: request: DELETE /compute/v2.1/servers/19d7387c-9776-4e8e-801d-c959ba47af7f HTTP/1.1 Sep 23 04:43:01.927690 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:43:01.927690 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:43:01.927690 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:43:01.927690 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:43:01.927690 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:43:01.927690 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:43:01.927690 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:43:01.927690 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:43:01.927690 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTgD-AJZNKtluGEJNjQKU0pcHtUCc1AZ8Ycz4MPGIeanw2_GglRmvn8LiMCEayIX86yw_RpyCC_JZrlVGSjhSgenUVZhpJ_MqN5SLmcv6Qnl3N6cXWJgtCK8N_ffRhD1dYgLIdHHgnmyTAptDZsjatOWU1ocTU40JP9XOpkK3deqL7A Sep 23 04:43:01.927690 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:43:01.927690 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:43:01.927690 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:43:01.927690 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:43:01.927690 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:43:01.927690 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:43:01.927690 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: fe698721372f40888dc2918c46e65f2f Sep 23 04:43:01.927690 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-DeleteServersTestJSON-347759205 Sep 23 04:43:01.927690 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:43:01.927690 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:43:01.927690 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fe698721372f40888dc2918c46e65f2f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe698721372f40888dc2918c46e65f2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fe698721372f40888dc2918c46e65f2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe698721372f40888dc2918c46e65f2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:43:01.927690 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-DeleteServersTestJSON-347759205 Sep 23 04:43:01.927690 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: fe698721372f40888dc2918c46e65f2f Sep 23 04:43:01.927690 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-DeleteServersTestJSON-347759205 Sep 23 04:43:01.927690 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-DeleteServersTestJSON-347759205-project Sep 23 04:43:01.927690 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:43:01.927690 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:43:01.927690 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 36526fe612c840fb907e1992d8e62538 Sep 23 04:43:01.927690 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-DeleteServersTestJSON-347759205-project Sep 23 04:43:01.927690 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:43:01.927690 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 19d7387c-9776-4e8e-801d-c959ba47af7f could not be found. Sep 23 04:43:01.927690 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '19d7387c-9776-4e8e-801d-c959ba47af7f'} Sep 23 04:43:01.927690 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:43:01.927690 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:43:01.927690 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:43:01.927690 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:43:01.927690 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:43:01.927690 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:43:01.927690 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:43:01.927690 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:43:01.927690 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:43:01.927690 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:43:01.927690 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19d7387c-9776-4e8e-801d-c959ba47af7f could not be found. Sep 23 04:43:01.927690 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:43:01.927690 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:43:01.927690 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:43:01.927690 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:43:01.927690 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:43:01.927690 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:43:01.927690 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:43:01.927690 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:43:01.927690 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:43:01.927690 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:43:01.927690 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 04:43:01.927690 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 04:43:01.927690 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 04:43:01.927690 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 04:43:01.927690 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:43:01.927690 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:43:01.927690 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:43:01.927690 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:43:01.932025 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19d7387c-9776-4e8e-801d-c959ba47af7f could not be found. Sep 23 04:43:01.932025 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:43:01.932025 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:43:01.932025 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:43:01.932025 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:43:01.932025 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:43:01.932025 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:43:01.932025 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:43:01.932025 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:43:01.932025 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19d7387c-9776-4e8e-801d-c959ba47af7f could not be found. Sep 23 04:43:01.932025 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:43:01.932712 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-663083ba-ff88-46b2-b817-eb0d32b72f06 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:01.936422 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-663083ba-ff88-46b2-b817-eb0d32b72f06 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 5051152b-180a-4ed9-85fb-074836ae447c] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:01.937412 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-cbf8aed2-dc19-4003-a9d5-38fcb4979490 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Returning 404 to user: Instance 19d7387c-9776-4e8e-801d-c959ba47af7f could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:43:01.938606 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-cbf8aed2-dc19-4003-a9d5-38fcb4979490 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "DELETE /compute/v2.1/servers/19d7387c-9776-4e8e-801d-c959ba47af7f" status: 404 len: 111 microversion: 2.1 time: 0.153865 Sep 23 04:43:01.948976 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1462/2896] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:43:01 2022] DELETE /compute/v2.1/servers/19d7387c-9776-4e8e-801d-c959ba47af7f => generated 111 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:43:01.948976 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-663a662b-2337-4f59-8ec3-e2b4fdb316ce tempest-ImagesMetadataTestJSON-1618678320 tempest-ImagesMetadataTestJSON-1618678320-project] Calling method '.version_select at 0x7ff1bac379d0>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:02.065636 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-663a662b-2337-4f59-8ec3-e2b4fdb316ce tempest-ImagesMetadataTestJSON-1618678320 tempest-ImagesMetadataTestJSON-1618678320-project] 10.222.0.33 "GET /compute/v2.1/images/7721111c-a389-457b-8cbf-48c14c3e1442/metadata" status: 200 len: 85 microversion: 2.1 time: 0.124002 Sep 23 04:43:02.070154 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1463/2897] 10.222.0.33 () {58 vars in 1260 bytes} [Fri Sep 23 04:43:01 2022] GET /compute/v2.1/images/7721111c-a389-457b-8cbf-48c14c3e1442/metadata => generated 85 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 04:43:02.088688 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-dace06bd-27ca-41ea-bc2d-553ce2555fac tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:02.110944 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-dace06bd-27ca-41ea-bc2d-553ce2555fac tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] [instance: 17bcb29e-d024-484c-ade0-793ef585ae96] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:02.146926 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dace06bd-27ca-41ea-bc2d-553ce2555fac tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:02.150524 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dace06bd-27ca-41ea-bc2d-553ce2555fac tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:02.150997 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dace06bd-27ca-41ea-bc2d-553ce2555fac tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:02.151752 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dace06bd-27ca-41ea-bc2d-553ce2555fac tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:02.152233 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dace06bd-27ca-41ea-bc2d-553ce2555fac tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:02.152675 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dace06bd-27ca-41ea-bc2d-553ce2555fac tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:02.486244 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-dace06bd-27ca-41ea-bc2d-553ce2555fac tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd00d7cc82d4ec0b9b36fe2bb0be056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f66ca22a6f24928840a07e889f2e740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:02.496095 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-dace06bd-27ca-41ea-bc2d-553ce2555fac tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6fd00d7cc82d4ec0b9b36fe2bb0be056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f66ca22a6f24928840a07e889f2e740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:02.497581 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-dace06bd-27ca-41ea-bc2d-553ce2555fac tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6fd00d7cc82d4ec0b9b36fe2bb0be056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f66ca22a6f24928840a07e889f2e740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:02.504814 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-dace06bd-27ca-41ea-bc2d-553ce2555fac tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] 10.222.0.33 "GET /compute/v2.1/servers/17bcb29e-d024-484c-ade0-793ef585ae96" status: 200 len: 1365 microversion: 2.47 time: 0.437331 Sep 23 04:43:02.505678 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1464/2898] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:43:02 2022] GET /compute/v2.1/servers/17bcb29e-d024-484c-ade0-793ef585ae96 => generated 1365 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:43:02.530094 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6eb98ee5-9de4-4ff0-9132-847fc40f9c67 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:02.541871 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-6eb98ee5-9de4-4ff0-9132-847fc40f9c67 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] [instance: 19d7387c-9776-4e8e-801d-c959ba47af7f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:02.562416 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6eb98ee5-9de4-4ff0-9132-847fc40f9c67 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:02.573079 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6eb98ee5-9de4-4ff0-9132-847fc40f9c67 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:02.573079 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6eb98ee5-9de4-4ff0-9132-847fc40f9c67 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:02.578857 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6eb98ee5-9de4-4ff0-9132-847fc40f9c67 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:02.579379 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6eb98ee5-9de4-4ff0-9132-847fc40f9c67 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:02.579836 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6eb98ee5-9de4-4ff0-9132-847fc40f9c67 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:02.654534 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-6eb98ee5-9de4-4ff0-9132-847fc40f9c67 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] HTTP exception thrown: Instance 19d7387c-9776-4e8e-801d-c959ba47af7f could not be found. Sep 23 04:43:02.659705 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6eb98ee5-9de4-4ff0-9132-847fc40f9c67 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Request method failure captured: Sep 23 04:43:02.659705 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/19d7387c-9776-4e8e-801d-c959ba47af7f HTTP/1.1 Sep 23 04:43:02.659705 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:43:02.659705 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:43:02.659705 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:43:02.659705 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:43:02.659705 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:43:02.659705 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:43:02.659705 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:43:02.659705 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:43:02.659705 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTgD-AJZNKtluGEJNjQKU0pcHtUCc1AZ8Ycz4MPGIeanw2_GglRmvn8LiMCEayIX86yw_RpyCC_JZrlVGSjhSgenUVZhpJ_MqN5SLmcv6Qnl3N6cXWJgtCK8N_ffRhD1dYgLIdHHgnmyTAptDZsjatOWU1ocTU40JP9XOpkK3deqL7A Sep 23 04:43:02.659705 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:43:02.659705 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:43:02.659705 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:43:02.659705 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:43:02.659705 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:43:02.659705 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:43:02.659705 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: fe698721372f40888dc2918c46e65f2f Sep 23 04:43:02.659705 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-DeleteServersTestJSON-347759205 Sep 23 04:43:02.659705 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:43:02.659705 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:43:02.659705 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fe698721372f40888dc2918c46e65f2f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe698721372f40888dc2918c46e65f2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fe698721372f40888dc2918c46e65f2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fe698721372f40888dc2918c46e65f2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:43:02.659705 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-DeleteServersTestJSON-347759205 Sep 23 04:43:02.659705 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: fe698721372f40888dc2918c46e65f2f Sep 23 04:43:02.659705 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-DeleteServersTestJSON-347759205 Sep 23 04:43:02.659705 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-DeleteServersTestJSON-347759205-project Sep 23 04:43:02.659705 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:43:02.659705 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:43:02.659705 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 36526fe612c840fb907e1992d8e62538 Sep 23 04:43:02.659705 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-DeleteServersTestJSON-347759205-project Sep 23 04:43:02.659705 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:43:02.659705 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 19d7387c-9776-4e8e-801d-c959ba47af7f could not be found. Sep 23 04:43:02.659705 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '19d7387c-9776-4e8e-801d-c959ba47af7f'} Sep 23 04:43:02.659705 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:43:02.659705 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:43:02.659705 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:43:02.659705 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:43:02.659705 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:43:02.659705 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:43:02.659705 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:43:02.659705 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:43:02.659705 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:43:02.659705 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:43:02.659705 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19d7387c-9776-4e8e-801d-c959ba47af7f could not be found. Sep 23 04:43:02.659705 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:43:02.659705 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:43:02.659705 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:43:02.659705 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:43:02.659705 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:43:02.659705 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:43:02.659705 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:43:02.659705 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:43:02.659705 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:43:02.659705 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:43:02.659705 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:43:02.659705 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:43:02.659705 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:43:02.659705 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:43:02.659705 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:43:02.659705 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:43:02.659705 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19d7387c-9776-4e8e-801d-c959ba47af7f could not be found. Sep 23 04:43:02.659705 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:43:02.659705 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:43:02.659705 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:43:02.666280 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:43:02.666280 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:43:02.666280 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:43:02.666280 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:43:02.666280 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:43:02.666280 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19d7387c-9776-4e8e-801d-c959ba47af7f could not be found. Sep 23 04:43:02.666280 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:43:02.666280 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6eb98ee5-9de4-4ff0-9132-847fc40f9c67 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] Returning 404 to user: Instance 19d7387c-9776-4e8e-801d-c959ba47af7f could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:43:02.666280 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6eb98ee5-9de4-4ff0-9132-847fc40f9c67 tempest-DeleteServersTestJSON-347759205 tempest-DeleteServersTestJSON-347759205-project] 10.222.0.33 "GET /compute/v2.1/servers/19d7387c-9776-4e8e-801d-c959ba47af7f" status: 404 len: 111 microversion: 2.1 time: 0.154342 Sep 23 04:43:02.666280 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1465/2899] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:02 2022] GET /compute/v2.1/servers/19d7387c-9776-4e8e-801d-c959ba47af7f => generated 111 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:43:02.675976 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-663083ba-ff88-46b2-b817-eb0d32b72f06 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:02.708051 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-663083ba-ff88-46b2-b817-eb0d32b72f06 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/5051152b-180a-4ed9-85fb-074836ae447c" status: 200 len: 1193 microversion: 2.1 time: 0.788752 Sep 23 04:43:02.709926 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1435/2900] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:01 2022] GET /compute/v2.1/servers/5051152b-180a-4ed9-85fb-074836ae447c => generated 1193 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:43:02.820237 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9b490447-f69a-4085-a2ff-b754ec9d0c34 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:02.821597 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-9b490447-f69a-4085-a2ff-b754ec9d0c34 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] [instance: 53745879-9973-4217-b1c5-b45f917db80e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:02.852200 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9b490447-f69a-4085-a2ff-b754ec9d0c34 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:02.853491 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9b490447-f69a-4085-a2ff-b754ec9d0c34 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:02.856243 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9b490447-f69a-4085-a2ff-b754ec9d0c34 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:02.866668 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9b490447-f69a-4085-a2ff-b754ec9d0c34 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:02.866668 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9b490447-f69a-4085-a2ff-b754ec9d0c34 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:02.866668 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9b490447-f69a-4085-a2ff-b754ec9d0c34 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:03.125217 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-e1204d28-d4b8-4cfe-89ef-1120537deded req-bc9c1a1a-4eb5-480d-8fca-c18ebb931676 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53745879-9973-4217-b1c5-b45f917db80e", "name": "network-vif-unplugged", "status": "completed", "tag": "ee2c6848-15f1-4da5-b9cb-45460ca2720e"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:43:03.165267 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-e1204d28-d4b8-4cfe-89ef-1120537deded req-bc9c1a1a-4eb5-480d-8fca-c18ebb931676 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:03.166178 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-e1204d28-d4b8-4cfe-89ef-1120537deded req-bc9c1a1a-4eb5-480d-8fca-c18ebb931676 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:03.166771 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-e1204d28-d4b8-4cfe-89ef-1120537deded req-bc9c1a1a-4eb5-480d-8fca-c18ebb931676 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:03.182627 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-e1204d28-d4b8-4cfe-89ef-1120537deded req-bc9c1a1a-4eb5-480d-8fca-c18ebb931676 service nova] Creating event network-vif-unplugged:ee2c6848-15f1-4da5-b9cb-45460ca2720e for instance 53745879-9973-4217-b1c5-b45f917db80e on n-h2-846463-3 Sep 23 04:43:03.190887 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-e1204d28-d4b8-4cfe-89ef-1120537deded req-bc9c1a1a-4eb5-480d-8fca-c18ebb931676 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.073406 Sep 23 04:43:03.193055 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1436/2901] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:43:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:43:03.546502 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-9b490447-f69a-4085-a2ff-b754ec9d0c34 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:03.553235 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5028040a-2ab7-4c8e-b849-307bc3c62279 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:03.557473 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5028040a-2ab7-4c8e-b849-307bc3c62279 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] [instance: 17bcb29e-d024-484c-ade0-793ef585ae96] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:03.571331 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-9b490447-f69a-4085-a2ff-b754ec9d0c34 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:03.573396 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-9b490447-f69a-4085-a2ff-b754ec9d0c34 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:03.577224 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5028040a-2ab7-4c8e-b849-307bc3c62279 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:03.578413 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-9b490447-f69a-4085-a2ff-b754ec9d0c34 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] 10.222.0.33 "GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e" status: 200 len: 2911 microversion: 2.42 time: 0.767130 Sep 23 04:43:03.578641 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5028040a-2ab7-4c8e-b849-307bc3c62279 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:03.599129 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5028040a-2ab7-4c8e-b849-307bc3c62279 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:03.600275 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1466/2902] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:43:02 2022] GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e => generated 2911 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:43:03.600924 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5028040a-2ab7-4c8e-b849-307bc3c62279 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:03.601484 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5028040a-2ab7-4c8e-b849-307bc3c62279 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:03.602021 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5028040a-2ab7-4c8e-b849-307bc3c62279 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:03.733522 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7b878a0d-b1b2-4e8f-9aac-cd37db227a88 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:03.734091 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-7b878a0d-b1b2-4e8f-9aac-cd37db227a88 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 5051152b-180a-4ed9-85fb-074836ae447c] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:03.751798 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7b878a0d-b1b2-4e8f-9aac-cd37db227a88 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:03.759655 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7b878a0d-b1b2-4e8f-9aac-cd37db227a88 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:03.759655 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7b878a0d-b1b2-4e8f-9aac-cd37db227a88 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:03.759655 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7b878a0d-b1b2-4e8f-9aac-cd37db227a88 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:03.759655 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7b878a0d-b1b2-4e8f-9aac-cd37db227a88 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:03.762742 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7b878a0d-b1b2-4e8f-9aac-cd37db227a88 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:03.790870 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-5028040a-2ab7-4c8e-b849-307bc3c62279 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd00d7cc82d4ec0b9b36fe2bb0be056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f66ca22a6f24928840a07e889f2e740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:03.806044 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-5028040a-2ab7-4c8e-b849-307bc3c62279 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6fd00d7cc82d4ec0b9b36fe2bb0be056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f66ca22a6f24928840a07e889f2e740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:03.807690 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-5028040a-2ab7-4c8e-b849-307bc3c62279 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6fd00d7cc82d4ec0b9b36fe2bb0be056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f66ca22a6f24928840a07e889f2e740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:03.808895 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5028040a-2ab7-4c8e-b849-307bc3c62279 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] 10.222.0.33 "GET /compute/v2.1/servers/17bcb29e-d024-484c-ade0-793ef585ae96" status: 200 len: 1365 microversion: 2.47 time: 0.274780 Sep 23 04:43:03.814150 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1437/2903] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:43:03 2022] GET /compute/v2.1/servers/17bcb29e-d024-484c-ade0-793ef585ae96 => generated 1365 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:43:03.899540 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-7b878a0d-b1b2-4e8f-9aac-cd37db227a88 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:03.916749 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-7b878a0d-b1b2-4e8f-9aac-cd37db227a88 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/5051152b-180a-4ed9-85fb-074836ae447c" status: 200 len: 1197 microversion: 2.1 time: 0.188382 Sep 23 04:43:03.919612 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1467/2904] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:03 2022] GET /compute/v2.1/servers/5051152b-180a-4ed9-85fb-074836ae447c => generated 1197 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:43:04.620848 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-85a79b35-2f8f-4f23-bc49-09f8eaee7c18 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:04.620848 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-85a79b35-2f8f-4f23-bc49-09f8eaee7c18 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] [instance: 53745879-9973-4217-b1c5-b45f917db80e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:04.630653 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-85a79b35-2f8f-4f23-bc49-09f8eaee7c18 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:04.632032 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-85a79b35-2f8f-4f23-bc49-09f8eaee7c18 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:04.650267 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-85a79b35-2f8f-4f23-bc49-09f8eaee7c18 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:04.654779 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-85a79b35-2f8f-4f23-bc49-09f8eaee7c18 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:04.654779 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-85a79b35-2f8f-4f23-bc49-09f8eaee7c18 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:04.658286 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-85a79b35-2f8f-4f23-bc49-09f8eaee7c18 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:04.841658 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0c1f6b90-0f0e-4ad2-9014-3b77b2c5e0da tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:04.842325 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-0c1f6b90-0f0e-4ad2-9014-3b77b2c5e0da tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] [instance: 17bcb29e-d024-484c-ade0-793ef585ae96] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:04.857317 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0c1f6b90-0f0e-4ad2-9014-3b77b2c5e0da tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:04.859005 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0c1f6b90-0f0e-4ad2-9014-3b77b2c5e0da tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:04.859620 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0c1f6b90-0f0e-4ad2-9014-3b77b2c5e0da tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:04.860518 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0c1f6b90-0f0e-4ad2-9014-3b77b2c5e0da tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:04.861501 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0c1f6b90-0f0e-4ad2-9014-3b77b2c5e0da tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:04.862547 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0c1f6b90-0f0e-4ad2-9014-3b77b2c5e0da tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:05.035095 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-0c1f6b90-0f0e-4ad2-9014-3b77b2c5e0da tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd00d7cc82d4ec0b9b36fe2bb0be056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f66ca22a6f24928840a07e889f2e740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:05.052006 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-0c1f6b90-0f0e-4ad2-9014-3b77b2c5e0da tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6fd00d7cc82d4ec0b9b36fe2bb0be056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f66ca22a6f24928840a07e889f2e740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:05.060670 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-0c1f6b90-0f0e-4ad2-9014-3b77b2c5e0da tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6fd00d7cc82d4ec0b9b36fe2bb0be056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f66ca22a6f24928840a07e889f2e740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:05.068612 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0c1f6b90-0f0e-4ad2-9014-3b77b2c5e0da tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] 10.222.0.33 "GET /compute/v2.1/servers/17bcb29e-d024-484c-ade0-793ef585ae96" status: 200 len: 1365 microversion: 2.47 time: 0.225317 Sep 23 04:43:05.069534 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1468/2905] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:43:04 2022] GET /compute/v2.1/servers/17bcb29e-d024-484c-ade0-793ef585ae96 => generated 1365 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:43:05.086189 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-95dc0271-736e-460d-a6ed-52b138a3dcca tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:05.089334 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-95dc0271-736e-460d-a6ed-52b138a3dcca tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 5051152b-180a-4ed9-85fb-074836ae447c] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:05.094328 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-95dc0271-736e-460d-a6ed-52b138a3dcca tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:05.095119 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-95dc0271-736e-460d-a6ed-52b138a3dcca tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:05.095781 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-95dc0271-736e-460d-a6ed-52b138a3dcca tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:05.096787 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-95dc0271-736e-460d-a6ed-52b138a3dcca tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:05.097459 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-95dc0271-736e-460d-a6ed-52b138a3dcca tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:05.098094 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-95dc0271-736e-460d-a6ed-52b138a3dcca tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:05.150028 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-85a79b35-2f8f-4f23-bc49-09f8eaee7c18 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:05.173786 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-85a79b35-2f8f-4f23-bc49-09f8eaee7c18 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:05.180024 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-85a79b35-2f8f-4f23-bc49-09f8eaee7c18 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:05.186611 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-85a79b35-2f8f-4f23-bc49-09f8eaee7c18 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] 10.222.0.33 "GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e" status: 200 len: 2911 microversion: 2.42 time: 0.573098 Sep 23 04:43:05.188417 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1438/2906] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:43:04 2022] GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e => generated 2911 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:43:05.193566 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-95dc0271-736e-460d-a6ed-52b138a3dcca tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:05.212914 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-95dc0271-736e-460d-a6ed-52b138a3dcca tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/5051152b-180a-4ed9-85fb-074836ae447c" status: 200 len: 1245 microversion: 2.1 time: 0.142019 Sep 23 04:43:05.218646 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1469/2907] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:05 2022] GET /compute/v2.1/servers/5051152b-180a-4ed9-85fb-074836ae447c => generated 1245 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:43:05.237097 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-26fa755d-6d66-45b0-90dd-1cfe3febbe44 req-caed958b-ff33-4942-85df-309e1151ad48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53745879-9973-4217-b1c5-b45f917db80e", "name": "network-vif-unplugged", "status": "completed", "tag": "db361959-8361-465d-9cf6-0cddc23eb745"}, {"server_uuid": "53745879-9973-4217-b1c5-b45f917db80e", "name": "network-vif-unplugged", "status": "completed", "tag": "2e21d383-3d28-4e86-b810-b78bf2b6d003"}, {"server_uuid": "53745879-9973-4217-b1c5-b45f917db80e", "name": "network-vif-unplugged", "status": "completed", "tag": "04ec7c4f-3b61-4a17-a7c1-0ebd792d85ae"}, {"server_uuid": "53745879-9973-4217-b1c5-b45f917db80e", "name": "network-vif-unplugged", "status": "completed", "tag": "94e28598-1406-4598-9b02-0050f6bb7fcd"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:43:05.259227 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-26fa755d-6d66-45b0-90dd-1cfe3febbe44 req-caed958b-ff33-4942-85df-309e1151ad48 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:05.261911 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-26fa755d-6d66-45b0-90dd-1cfe3febbe44 req-caed958b-ff33-4942-85df-309e1151ad48 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:05.261911 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-26fa755d-6d66-45b0-90dd-1cfe3febbe44 req-caed958b-ff33-4942-85df-309e1151ad48 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:05.282800 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-26fa755d-6d66-45b0-90dd-1cfe3febbe44 req-caed958b-ff33-4942-85df-309e1151ad48 service nova] Creating event network-vif-unplugged:db361959-8361-465d-9cf6-0cddc23eb745 for instance 53745879-9973-4217-b1c5-b45f917db80e on n-h2-846463-3 Sep 23 04:43:05.283317 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-26fa755d-6d66-45b0-90dd-1cfe3febbe44 req-caed958b-ff33-4942-85df-309e1151ad48 service nova] Creating event network-vif-unplugged:2e21d383-3d28-4e86-b810-b78bf2b6d003 for instance 53745879-9973-4217-b1c5-b45f917db80e on n-h2-846463-3 Sep 23 04:43:05.283844 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-26fa755d-6d66-45b0-90dd-1cfe3febbe44 req-caed958b-ff33-4942-85df-309e1151ad48 service nova] Creating event network-vif-unplugged:04ec7c4f-3b61-4a17-a7c1-0ebd792d85ae for instance 53745879-9973-4217-b1c5-b45f917db80e on n-h2-846463-3 Sep 23 04:43:05.286082 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-26fa755d-6d66-45b0-90dd-1cfe3febbe44 req-caed958b-ff33-4942-85df-309e1151ad48 service nova] Creating event network-vif-unplugged:94e28598-1406-4598-9b02-0050f6bb7fcd for instance 53745879-9973-4217-b1c5-b45f917db80e on n-h2-846463-3 Sep 23 04:43:05.299402 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-26fa755d-6d66-45b0-90dd-1cfe3febbe44 req-caed958b-ff33-4942-85df-309e1151ad48 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 704 microversion: 2.1 time: 0.070991 Sep 23 04:43:05.300016 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1439/2908] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:43:05 2022] POST /compute/v2.1/os-server-external-events => generated 704 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:43:06.099500 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-98ef6c14-9672-4bf3-b442-319a962d885b tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:06.100782 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-98ef6c14-9672-4bf3-b442-319a962d885b tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] [instance: 17bcb29e-d024-484c-ade0-793ef585ae96] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:06.109801 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-98ef6c14-9672-4bf3-b442-319a962d885b tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:06.110606 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-98ef6c14-9672-4bf3-b442-319a962d885b tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:06.111393 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-98ef6c14-9672-4bf3-b442-319a962d885b tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:06.112514 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-98ef6c14-9672-4bf3-b442-319a962d885b tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:06.113201 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-98ef6c14-9672-4bf3-b442-319a962d885b tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:06.113801 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-98ef6c14-9672-4bf3-b442-319a962d885b tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:06.119455 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=100 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:43:06.170862 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-98ef6c14-9672-4bf3-b442-319a962d885b tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:06.171609 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-98ef6c14-9672-4bf3-b442-319a962d885b tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:06.172225 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-98ef6c14-9672-4bf3-b442-319a962d885b tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:06.172907 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-98ef6c14-9672-4bf3-b442-319a962d885b tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Lazy-loading 'fault' on Instance uuid 17bcb29e-d024-484c-ade0-793ef585ae96 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:43:06.211914 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-780dfaaa-c459-4659-ac5c-76d8acdf3b96 req-a0a861ec-8d6e-4491-b625-88a7cb29766c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53745879-9973-4217-b1c5-b45f917db80e", "name": "network-vif-deleted", "tag": "04ec7c4f-3b61-4a17-a7c1-0ebd792d85ae"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:43:06.231053 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-780dfaaa-c459-4659-ac5c-76d8acdf3b96 req-a0a861ec-8d6e-4491-b625-88a7cb29766c service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:06.231532 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-780dfaaa-c459-4659-ac5c-76d8acdf3b96 req-a0a861ec-8d6e-4491-b625-88a7cb29766c service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:06.231975 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-780dfaaa-c459-4659-ac5c-76d8acdf3b96 req-a0a861ec-8d6e-4491-b625-88a7cb29766c service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:06.267935 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-780dfaaa-c459-4659-ac5c-76d8acdf3b96 req-a0a861ec-8d6e-4491-b625-88a7cb29766c service nova] Creating event network-vif-deleted:04ec7c4f-3b61-4a17-a7c1-0ebd792d85ae for instance 53745879-9973-4217-b1c5-b45f917db80e on n-h2-846463-3 Sep 23 04:43:06.292527 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-780dfaaa-c459-4659-ac5c-76d8acdf3b96 req-a0a861ec-8d6e-4491-b625-88a7cb29766c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086199 Sep 23 04:43:06.293908 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1440/2909] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:43:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:43:06.299556 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-088962d4-c5c7-4a2a-b6cc-6e0c38c44183 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:06.302363 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-088962d4-c5c7-4a2a-b6cc-6e0c38c44183 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] [instance: 53745879-9973-4217-b1c5-b45f917db80e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:06.316334 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-088962d4-c5c7-4a2a-b6cc-6e0c38c44183 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:06.321231 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-088962d4-c5c7-4a2a-b6cc-6e0c38c44183 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:06.321930 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-088962d4-c5c7-4a2a-b6cc-6e0c38c44183 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:06.322868 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-088962d4-c5c7-4a2a-b6cc-6e0c38c44183 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:06.324196 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-088962d4-c5c7-4a2a-b6cc-6e0c38c44183 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:06.324897 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-088962d4-c5c7-4a2a-b6cc-6e0c38c44183 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:06.514637 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-98ef6c14-9672-4bf3-b442-319a962d885b tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd00d7cc82d4ec0b9b36fe2bb0be056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f66ca22a6f24928840a07e889f2e740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:06.523331 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-98ef6c14-9672-4bf3-b442-319a962d885b tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6fd00d7cc82d4ec0b9b36fe2bb0be056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f66ca22a6f24928840a07e889f2e740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:06.524864 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-98ef6c14-9672-4bf3-b442-319a962d885b tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6fd00d7cc82d4ec0b9b36fe2bb0be056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f66ca22a6f24928840a07e889f2e740', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:06.526295 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-98ef6c14-9672-4bf3-b442-319a962d885b tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] 10.222.0.33 "GET /compute/v2.1/servers/17bcb29e-d024-484c-ade0-793ef585ae96" status: 200 len: 1370 microversion: 2.47 time: 0.431458 Sep 23 04:43:06.537805 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1470/2910] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:43:06 2022] GET /compute/v2.1/servers/17bcb29e-d024-484c-ade0-793ef585ae96 => generated 1370 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:43:06.562655 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1789e412-aebc-4159-aafa-92f95b3123a0 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:06.563536 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1789e412-aebc-4159-aafa-92f95b3123a0 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 5051152b-180a-4ed9-85fb-074836ae447c] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:06.579479 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1789e412-aebc-4159-aafa-92f95b3123a0 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:06.581160 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1789e412-aebc-4159-aafa-92f95b3123a0 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:06.586920 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1789e412-aebc-4159-aafa-92f95b3123a0 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:06.616539 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1789e412-aebc-4159-aafa-92f95b3123a0 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:06.617059 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1789e412-aebc-4159-aafa-92f95b3123a0 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:06.617542 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1789e412-aebc-4159-aafa-92f95b3123a0 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:06.805789 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1789e412-aebc-4159-aafa-92f95b3123a0 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:06.827959 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1789e412-aebc-4159-aafa-92f95b3123a0 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/5051152b-180a-4ed9-85fb-074836ae447c" status: 200 len: 1251 microversion: 2.1 time: 0.288007 Sep 23 04:43:06.830301 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1471/2911] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:06 2022] GET /compute/v2.1/servers/5051152b-180a-4ed9-85fb-074836ae447c => generated 1251 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:43:06.838924 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c5df31a9-7861-4dc1-a3bd-fa163be7afd8 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:06.839800 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c5df31a9-7861-4dc1-a3bd-fa163be7afd8 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] [instance: dfb8f504-218a-471c-b7a8-70c498769f0e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:06.848030 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c5df31a9-7861-4dc1-a3bd-fa163be7afd8 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:06.848869 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c5df31a9-7861-4dc1-a3bd-fa163be7afd8 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:06.850199 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c5df31a9-7861-4dc1-a3bd-fa163be7afd8 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:06.851319 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c5df31a9-7861-4dc1-a3bd-fa163be7afd8 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:06.852058 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c5df31a9-7861-4dc1-a3bd-fa163be7afd8 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:06.852717 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c5df31a9-7861-4dc1-a3bd-fa163be7afd8 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:06.872471 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-088962d4-c5c7-4a2a-b6cc-6e0c38c44183 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:06.874751 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-c5df31a9-7861-4dc1-a3bd-fa163be7afd8 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] HTTP exception thrown: Instance dfb8f504-218a-471c-b7a8-70c498769f0e could not be found. Sep 23 04:43:06.876601 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c5df31a9-7861-4dc1-a3bd-fa163be7afd8 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Request method failure captured: Sep 23 04:43:06.876601 n-d-846463-3 devstack@n-api.service[122699]: request: DELETE /compute/v2.1/servers/dfb8f504-218a-471c-b7a8-70c498769f0e HTTP/1.1 Sep 23 04:43:06.876601 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:43:06.876601 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:43:06.876601 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:43:06.876601 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:43:06.876601 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:43:06.876601 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:43:06.876601 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:43:06.876601 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:43:06.876601 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTieUWxWVz7tagLf0YOUGD3zbsKFDzpc2b3aaNhcN_ZlklFdFncZs2NLllcvch0GskWqt4COl_aegLGomoq5rNwRbJ80i1JBntABqSfT0ytSHW6micesQtO-pb8oglbhIGSac7wG4OeV3zrnFAvqktOkjIG879ee6y7C1UWVcGCKfkU Sep 23 04:43:06.876601 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:43:06.876601 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:43:06.876601 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:43:06.876601 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:43:06.876601 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:43:06.876601 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:43:06.876601 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: ddf77b55dfd8452e949229e4eb085283 Sep 23 04:43:06.876601 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1278053024 Sep 23 04:43:06.876601 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:43:06.876601 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:43:06.876601 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ddf77b55dfd8452e949229e4eb085283", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ddf77b55dfd8452e949229e4eb085283"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ddf77b55dfd8452e949229e4eb085283"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ddf77b55dfd8452e949229e4eb085283"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:43:06.876601 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1278053024 Sep 23 04:43:06.876601 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: ddf77b55dfd8452e949229e4eb085283 Sep 23 04:43:06.876601 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1278053024 Sep 23 04:43:06.876601 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-AttachSCSIVolumeTestJSON-1278053024-project Sep 23 04:43:06.876601 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:43:06.876601 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:43:06.876601 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 542c9592c76c4d4b9f3f16cea354398d Sep 23 04:43:06.876601 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1278053024-project Sep 23 04:43:06.876601 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:43:06.876601 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance dfb8f504-218a-471c-b7a8-70c498769f0e could not be found. Sep 23 04:43:06.876601 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': 'dfb8f504-218a-471c-b7a8-70c498769f0e'} Sep 23 04:43:06.876601 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:43:06.876601 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:43:06.876601 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:43:06.876601 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:43:06.876601 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:43:06.876601 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:43:06.876601 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:43:06.876601 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:43:06.876601 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:43:06.876601 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:43:06.876601 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfb8f504-218a-471c-b7a8-70c498769f0e could not be found. Sep 23 04:43:06.876601 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:43:06.876601 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:43:06.876601 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:43:06.876601 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:43:06.876601 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:43:06.876601 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:43:06.876601 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:43:06.876601 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:43:06.876601 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:43:06.876601 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:43:06.876601 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 04:43:06.876601 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 04:43:06.876601 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 04:43:06.876601 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 04:43:06.876601 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:43:06.876601 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:43:06.876601 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:43:06.876601 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:43:06.903359 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfb8f504-218a-471c-b7a8-70c498769f0e could not be found. Sep 23 04:43:06.903359 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:43:06.903359 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:43:06.903359 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:43:06.903359 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:43:06.903359 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:43:06.903359 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:43:06.903359 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:43:06.903359 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:43:06.903359 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfb8f504-218a-471c-b7a8-70c498769f0e could not be found. Sep 23 04:43:06.903359 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:43:06.903359 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c5df31a9-7861-4dc1-a3bd-fa163be7afd8 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Returning 404 to user: Instance dfb8f504-218a-471c-b7a8-70c498769f0e could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:43:06.903359 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c5df31a9-7861-4dc1-a3bd-fa163be7afd8 tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] 10.222.0.33 "DELETE /compute/v2.1/servers/dfb8f504-218a-471c-b7a8-70c498769f0e" status: 404 len: 111 microversion: 2.1 time: 0.046679 Sep 23 04:43:06.903359 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1472/2912] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:43:06 2022] DELETE /compute/v2.1/servers/dfb8f504-218a-471c-b7a8-70c498769f0e => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:43:06.907519 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-088962d4-c5c7-4a2a-b6cc-6e0c38c44183 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:06.907519 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-088962d4-c5c7-4a2a-b6cc-6e0c38c44183 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:06.907519 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-088962d4-c5c7-4a2a-b6cc-6e0c38c44183 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] 10.222.0.33 "GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e" status: 200 len: 2865 microversion: 2.42 time: 0.589444 Sep 23 04:43:06.907519 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1441/2913] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:43:06 2022] GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e => generated 2865 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:43:06.925764 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-920ef9f1-4f9d-47a1-aae8-21336c23f38b tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:06.927957 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-920ef9f1-4f9d-47a1-aae8-21336c23f38b tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] [instance: dfb8f504-218a-471c-b7a8-70c498769f0e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:06.939673 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-920ef9f1-4f9d-47a1-aae8-21336c23f38b tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:06.940419 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-920ef9f1-4f9d-47a1-aae8-21336c23f38b tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:06.940995 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-920ef9f1-4f9d-47a1-aae8-21336c23f38b tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:06.941853 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-920ef9f1-4f9d-47a1-aae8-21336c23f38b tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:06.942416 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-920ef9f1-4f9d-47a1-aae8-21336c23f38b tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:06.942946 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-920ef9f1-4f9d-47a1-aae8-21336c23f38b tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:06.977322 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-920ef9f1-4f9d-47a1-aae8-21336c23f38b tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] HTTP exception thrown: Instance dfb8f504-218a-471c-b7a8-70c498769f0e could not be found. Sep 23 04:43:06.981763 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-920ef9f1-4f9d-47a1-aae8-21336c23f38b tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Request method failure captured: Sep 23 04:43:06.981763 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/dfb8f504-218a-471c-b7a8-70c498769f0e HTTP/1.1 Sep 23 04:43:06.981763 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:43:06.981763 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:43:06.981763 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:43:06.981763 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:43:06.981763 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:43:06.981763 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:43:06.981763 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:43:06.981763 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:43:06.981763 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTieUWxWVz7tagLf0YOUGD3zbsKFDzpc2b3aaNhcN_ZlklFdFncZs2NLllcvch0GskWqt4COl_aegLGomoq5rNwRbJ80i1JBntABqSfT0ytSHW6micesQtO-pb8oglbhIGSac7wG4OeV3zrnFAvqktOkjIG879ee6y7C1UWVcGCKfkU Sep 23 04:43:06.981763 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:43:06.981763 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:43:06.981763 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:43:06.981763 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:43:06.981763 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:43:06.981763 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:43:06.981763 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: ddf77b55dfd8452e949229e4eb085283 Sep 23 04:43:06.981763 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1278053024 Sep 23 04:43:06.981763 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:43:06.981763 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:43:06.981763 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ddf77b55dfd8452e949229e4eb085283", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ddf77b55dfd8452e949229e4eb085283"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ddf77b55dfd8452e949229e4eb085283"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ddf77b55dfd8452e949229e4eb085283"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:43:06.981763 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1278053024 Sep 23 04:43:06.981763 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: ddf77b55dfd8452e949229e4eb085283 Sep 23 04:43:06.981763 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1278053024 Sep 23 04:43:06.981763 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-AttachSCSIVolumeTestJSON-1278053024-project Sep 23 04:43:06.981763 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:43:06.981763 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:43:06.981763 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 542c9592c76c4d4b9f3f16cea354398d Sep 23 04:43:06.981763 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1278053024-project Sep 23 04:43:06.981763 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:43:06.981763 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance dfb8f504-218a-471c-b7a8-70c498769f0e could not be found. Sep 23 04:43:06.981763 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': 'dfb8f504-218a-471c-b7a8-70c498769f0e'} Sep 23 04:43:06.981763 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:43:06.981763 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:43:06.981763 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:43:06.981763 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:43:06.981763 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:43:06.981763 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:43:06.981763 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:43:06.981763 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:43:06.981763 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:43:06.981763 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:43:06.981763 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfb8f504-218a-471c-b7a8-70c498769f0e could not be found. Sep 23 04:43:06.981763 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:43:06.981763 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:43:06.981763 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:43:06.981763 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:43:06.981763 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:43:06.981763 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:43:06.981763 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:43:06.981763 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:43:06.981763 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:43:06.981763 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:43:06.981763 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:43:06.981763 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:43:06.981763 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:43:06.981763 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:43:06.981763 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:43:06.981763 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:43:06.981763 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfb8f504-218a-471c-b7a8-70c498769f0e could not be found. Sep 23 04:43:06.981763 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:43:06.981763 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:43:06.981763 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:43:06.985769 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:43:06.985769 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:43:06.985769 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:43:06.985769 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:43:06.985769 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:43:06.985769 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfb8f504-218a-471c-b7a8-70c498769f0e could not be found. Sep 23 04:43:06.985769 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:43:06.985769 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-920ef9f1-4f9d-47a1-aae8-21336c23f38b tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] Returning 404 to user: Instance dfb8f504-218a-471c-b7a8-70c498769f0e could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:43:06.985769 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-920ef9f1-4f9d-47a1-aae8-21336c23f38b tempest-AttachSCSIVolumeTestJSON-1278053024 tempest-AttachSCSIVolumeTestJSON-1278053024-project] 10.222.0.33 "GET /compute/v2.1/servers/dfb8f504-218a-471c-b7a8-70c498769f0e" status: 404 len: 111 microversion: 2.1 time: 0.067188 Sep 23 04:43:06.985769 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1473/2914] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:06 2022] GET /compute/v2.1/servers/dfb8f504-218a-471c-b7a8-70c498769f0e => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:43:07.557710 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4507039e-52e2-4f08-b8a2-27a05473cb38 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:07.559713 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4507039e-52e2-4f08-b8a2-27a05473cb38 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] [instance: 17bcb29e-d024-484c-ade0-793ef585ae96] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:07.580523 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4507039e-52e2-4f08-b8a2-27a05473cb38 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:07.582637 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4507039e-52e2-4f08-b8a2-27a05473cb38 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:07.584467 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4507039e-52e2-4f08-b8a2-27a05473cb38 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:07.587240 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4507039e-52e2-4f08-b8a2-27a05473cb38 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:07.592852 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4507039e-52e2-4f08-b8a2-27a05473cb38 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:07.593647 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4507039e-52e2-4f08-b8a2-27a05473cb38 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:07.628686 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-4507039e-52e2-4f08-b8a2-27a05473cb38 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] HTTP exception thrown: Instance 17bcb29e-d024-484c-ade0-793ef585ae96 could not be found. Sep 23 04:43:07.633250 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4507039e-52e2-4f08-b8a2-27a05473cb38 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Request method failure captured: Sep 23 04:43:07.633250 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/17bcb29e-d024-484c-ade0-793ef585ae96 HTTP/1.1 Sep 23 04:43:07.633250 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:43:07.633250 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:43:07.633250 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:43:07.633250 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:43:07.633250 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:43:07.633250 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:43:07.633250 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:43:07.633250 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:43:07.633250 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTlJdLqoFDh-bH10Jsp5IBJ2T-FXhEG97QuIQ2cjc8Mpc4YnJ6S9RFqCCFDpsDqfn1WSA-sOpLHoxwibxasaejtLnskmFNd0FMLy2glOitgcXqlq3z80P9auG1ZmIxV5PLrZae3hw9rEmlDFo3aIsC5L3b2LXUyVaCYMgZe7HcH1ofQ Sep 23 04:43:07.633250 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:43:07.633250 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:43:07.633250 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:43:07.633250 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:43:07.633250 n-d-846463-3 devstack@n-api.service[122698]: X-Openstack-Nova-Api-Version: 2.47 Sep 23 04:43:07.633250 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:43:07.633250 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:43:07.633250 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 0f66ca22a6f24928840a07e889f2e740 Sep 23 04:43:07.633250 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ServersAaction247Test-356062021 Sep 23 04:43:07.633250 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:43:07.633250 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:43:07.633250 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0f66ca22a6f24928840a07e889f2e740", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0f66ca22a6f24928840a07e889f2e740"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0f66ca22a6f24928840a07e889f2e740"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0f66ca22a6f24928840a07e889f2e740"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:43:07.633250 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ServersAaction247Test-356062021 Sep 23 04:43:07.633250 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 0f66ca22a6f24928840a07e889f2e740 Sep 23 04:43:07.633250 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ServersAaction247Test-356062021 Sep 23 04:43:07.633250 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ServersAaction247Test-356062021-project Sep 23 04:43:07.633250 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:43:07.633250 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:43:07.633250 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 6fd00d7cc82d4ec0b9b36fe2bb0be056 Sep 23 04:43:07.633250 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ServersAaction247Test-356062021-project Sep 23 04:43:07.633250 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:43:07.633250 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 17bcb29e-d024-484c-ade0-793ef585ae96 could not be found. Sep 23 04:43:07.633250 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '17bcb29e-d024-484c-ade0-793ef585ae96'} Sep 23 04:43:07.633250 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:43:07.633250 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:43:07.633250 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:43:07.633250 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:43:07.633250 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:43:07.633250 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:43:07.633250 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:43:07.633250 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:43:07.633250 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:43:07.633250 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:43:07.633250 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17bcb29e-d024-484c-ade0-793ef585ae96 could not be found. Sep 23 04:43:07.633250 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:43:07.633250 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:43:07.633250 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:43:07.633250 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:43:07.633250 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:43:07.633250 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:43:07.633250 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:43:07.633250 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:43:07.633250 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:43:07.633250 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:43:07.633250 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:43:07.633250 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:43:07.633250 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:43:07.633250 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:43:07.633250 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:43:07.633250 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:43:07.633250 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17bcb29e-d024-484c-ade0-793ef585ae96 could not be found. Sep 23 04:43:07.633250 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:43:07.633250 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:43:07.633250 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:43:07.637524 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:43:07.637524 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:43:07.637524 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:43:07.637524 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:43:07.637524 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:43:07.637524 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17bcb29e-d024-484c-ade0-793ef585ae96 could not be found. Sep 23 04:43:07.637524 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:43:07.642985 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4507039e-52e2-4f08-b8a2-27a05473cb38 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] Returning 404 to user: Instance 17bcb29e-d024-484c-ade0-793ef585ae96 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:43:07.646345 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4507039e-52e2-4f08-b8a2-27a05473cb38 tempest-ServersAaction247Test-356062021 tempest-ServersAaction247Test-356062021-project] 10.222.0.33 "GET /compute/v2.1/servers/17bcb29e-d024-484c-ade0-793ef585ae96" status: 404 len: 111 microversion: 2.47 time: 0.090358 Sep 23 04:43:07.646345 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1442/2915] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:43:07 2022] GET /compute/v2.1/servers/17bcb29e-d024-484c-ade0-793ef585ae96 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 23 04:43:07.855441 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d822aa2c-3053-4731-bbd4-d37ba9e0b1c4 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:07.856945 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d822aa2c-3053-4731-bbd4-d37ba9e0b1c4 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 5051152b-180a-4ed9-85fb-074836ae447c] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:07.866571 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d822aa2c-3053-4731-bbd4-d37ba9e0b1c4 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:07.870082 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d822aa2c-3053-4731-bbd4-d37ba9e0b1c4 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:07.870845 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d822aa2c-3053-4731-bbd4-d37ba9e0b1c4 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:07.873653 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d822aa2c-3053-4731-bbd4-d37ba9e0b1c4 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:07.874586 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d822aa2c-3053-4731-bbd4-d37ba9e0b1c4 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:07.878176 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d822aa2c-3053-4731-bbd4-d37ba9e0b1c4 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:07.930958 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-93d8d394-b68a-449b-a0c2-7cfc7aba40a4 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:07.932564 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-93d8d394-b68a-449b-a0c2-7cfc7aba40a4 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] [instance: 53745879-9973-4217-b1c5-b45f917db80e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:07.962220 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-93d8d394-b68a-449b-a0c2-7cfc7aba40a4 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:07.963007 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-93d8d394-b68a-449b-a0c2-7cfc7aba40a4 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:07.965868 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-93d8d394-b68a-449b-a0c2-7cfc7aba40a4 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:07.968874 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-93d8d394-b68a-449b-a0c2-7cfc7aba40a4 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:07.972503 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-93d8d394-b68a-449b-a0c2-7cfc7aba40a4 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:07.976365 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-93d8d394-b68a-449b-a0c2-7cfc7aba40a4 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:08.037531 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d822aa2c-3053-4731-bbd4-d37ba9e0b1c4 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:08.050558 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d822aa2c-3053-4731-bbd4-d37ba9e0b1c4 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/5051152b-180a-4ed9-85fb-074836ae447c" status: 200 len: 1251 microversion: 2.1 time: 0.198779 Sep 23 04:43:08.074572 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1474/2916] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:07 2022] GET /compute/v2.1/servers/5051152b-180a-4ed9-85fb-074836ae447c => generated 1251 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:43:08.401871 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-5ffd1922-a4fb-4530-9186-9fcaf9962814 req-572bd0f1-480d-4eb5-8a55-be536287c72d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53745879-9973-4217-b1c5-b45f917db80e", "name": "network-vif-deleted", "tag": "ee2c6848-15f1-4da5-b9cb-45460ca2720e"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:43:08.419933 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-5ffd1922-a4fb-4530-9186-9fcaf9962814 req-572bd0f1-480d-4eb5-8a55-be536287c72d service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:08.420842 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-5ffd1922-a4fb-4530-9186-9fcaf9962814 req-572bd0f1-480d-4eb5-8a55-be536287c72d service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:08.421293 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-5ffd1922-a4fb-4530-9186-9fcaf9962814 req-572bd0f1-480d-4eb5-8a55-be536287c72d service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:08.440548 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-5ffd1922-a4fb-4530-9186-9fcaf9962814 req-572bd0f1-480d-4eb5-8a55-be536287c72d service nova] Creating event network-vif-deleted:ee2c6848-15f1-4da5-b9cb-45460ca2720e for instance 53745879-9973-4217-b1c5-b45f917db80e on n-h2-846463-3 Sep 23 04:43:08.449540 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-5ffd1922-a4fb-4530-9186-9fcaf9962814 req-572bd0f1-480d-4eb5-8a55-be536287c72d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060459 Sep 23 04:43:08.451735 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1475/2917] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:43:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:43:08.879174 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-93d8d394-b68a-449b-a0c2-7cfc7aba40a4 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:08.899897 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-93d8d394-b68a-449b-a0c2-7cfc7aba40a4 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:08.902140 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-93d8d394-b68a-449b-a0c2-7cfc7aba40a4 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:08.904525 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-93d8d394-b68a-449b-a0c2-7cfc7aba40a4 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] 10.222.0.33 "GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e" status: 200 len: 2527 microversion: 2.42 time: 0.983817 Sep 23 04:43:08.917929 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1443/2918] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:43:07 2022] GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e => generated 2527 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:43:09.079645 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-da21f012-9e2d-4140-8d32-d4ebb8a0e0fc tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:09.080674 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-da21f012-9e2d-4140-8d32-d4ebb8a0e0fc tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 5051152b-180a-4ed9-85fb-074836ae447c] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:09.089131 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-da21f012-9e2d-4140-8d32-d4ebb8a0e0fc tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:09.089817 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-da21f012-9e2d-4140-8d32-d4ebb8a0e0fc tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:09.090434 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-da21f012-9e2d-4140-8d32-d4ebb8a0e0fc tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:09.091443 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-da21f012-9e2d-4140-8d32-d4ebb8a0e0fc tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:09.092052 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-da21f012-9e2d-4140-8d32-d4ebb8a0e0fc tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:09.092587 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-da21f012-9e2d-4140-8d32-d4ebb8a0e0fc tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:09.601221 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-da21f012-9e2d-4140-8d32-d4ebb8a0e0fc tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:09.611547 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-da21f012-9e2d-4140-8d32-d4ebb8a0e0fc tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/5051152b-180a-4ed9-85fb-074836ae447c" status: 200 len: 1293 microversion: 2.1 time: 0.536561 Sep 23 04:43:09.612141 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1476/2919] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:09 2022] GET /compute/v2.1/servers/5051152b-180a-4ed9-85fb-074836ae447c => generated 1293 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:43:09.936653 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d2128256-cafe-4b80-bcd7-8d79a7efc797 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:09.938084 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d2128256-cafe-4b80-bcd7-8d79a7efc797 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] [instance: 53745879-9973-4217-b1c5-b45f917db80e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:09.947262 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d2128256-cafe-4b80-bcd7-8d79a7efc797 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:09.948267 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d2128256-cafe-4b80-bcd7-8d79a7efc797 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:09.949074 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d2128256-cafe-4b80-bcd7-8d79a7efc797 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:09.950059 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d2128256-cafe-4b80-bcd7-8d79a7efc797 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:09.950721 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d2128256-cafe-4b80-bcd7-8d79a7efc797 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:09.951399 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d2128256-cafe-4b80-bcd7-8d79a7efc797 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:10.511182 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-5a214ed0-6a4f-4b6b-bc6a-80d88fc9912f req-38228cde-f79d-4718-bd00-e1641a56a0d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53745879-9973-4217-b1c5-b45f917db80e", "name": "network-vif-deleted", "tag": "2e21d383-3d28-4e86-b810-b78bf2b6d003"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:43:10.534906 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-5a214ed0-6a4f-4b6b-bc6a-80d88fc9912f req-38228cde-f79d-4718-bd00-e1641a56a0d3 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:10.535809 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-5a214ed0-6a4f-4b6b-bc6a-80d88fc9912f req-38228cde-f79d-4718-bd00-e1641a56a0d3 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:10.536573 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-5a214ed0-6a4f-4b6b-bc6a-80d88fc9912f req-38228cde-f79d-4718-bd00-e1641a56a0d3 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:10.564499 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-5a214ed0-6a4f-4b6b-bc6a-80d88fc9912f req-38228cde-f79d-4718-bd00-e1641a56a0d3 service nova] Creating event network-vif-deleted:2e21d383-3d28-4e86-b810-b78bf2b6d003 for instance 53745879-9973-4217-b1c5-b45f917db80e on n-h2-846463-3 Sep 23 04:43:10.575856 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-5a214ed0-6a4f-4b6b-bc6a-80d88fc9912f req-38228cde-f79d-4718-bd00-e1641a56a0d3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068833 Sep 23 04:43:10.577134 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1477/2920] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:43:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:43:10.645724 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-dade33f5-0658-4806-9a31-2330e93d41f0 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:10.648141 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-dade33f5-0658-4806-9a31-2330e93d41f0 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 5051152b-180a-4ed9-85fb-074836ae447c] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:10.665106 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dade33f5-0658-4806-9a31-2330e93d41f0 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:10.666024 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dade33f5-0658-4806-9a31-2330e93d41f0 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:10.666638 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dade33f5-0658-4806-9a31-2330e93d41f0 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:10.668546 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dade33f5-0658-4806-9a31-2330e93d41f0 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:10.669215 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dade33f5-0658-4806-9a31-2330e93d41f0 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:10.669665 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dade33f5-0658-4806-9a31-2330e93d41f0 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:10.718458 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:43:10.788485 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d2128256-cafe-4b80-bcd7-8d79a7efc797 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:10.795291 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=26 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:43:10.798776 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d2128256-cafe-4b80-bcd7-8d79a7efc797 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:10.800334 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d2128256-cafe-4b80-bcd7-8d79a7efc797 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:10.801576 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d2128256-cafe-4b80-bcd7-8d79a7efc797 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] 10.222.0.33 "GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e" status: 200 len: 2368 microversion: 2.42 time: 0.869433 Sep 23 04:43:10.802174 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1444/2921] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:43:09 2022] GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e => generated 2368 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:43:11.134457 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-dade33f5-0658-4806-9a31-2330e93d41f0 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:11.143835 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-dade33f5-0658-4806-9a31-2330e93d41f0 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/5051152b-180a-4ed9-85fb-074836ae447c" status: 200 len: 1293 microversion: 2.1 time: 0.512378 Sep 23 04:43:11.148944 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1478/2922] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:10 2022] GET /compute/v2.1/servers/5051152b-180a-4ed9-85fb-074836ae447c => generated 1293 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:43:11.829051 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-357f9355-3f53-4ee0-b065-ff23d625e92e tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:11.830281 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-357f9355-3f53-4ee0-b065-ff23d625e92e tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] [instance: 53745879-9973-4217-b1c5-b45f917db80e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:11.841463 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-357f9355-3f53-4ee0-b065-ff23d625e92e tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:11.841991 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-357f9355-3f53-4ee0-b065-ff23d625e92e tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:11.842434 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-357f9355-3f53-4ee0-b065-ff23d625e92e tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:11.843192 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-357f9355-3f53-4ee0-b065-ff23d625e92e tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:11.845603 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-357f9355-3f53-4ee0-b065-ff23d625e92e tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:11.849600 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-357f9355-3f53-4ee0-b065-ff23d625e92e tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:12.171138 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7ac85c12-c8a0-48a0-816d-81e165ba6e08 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:12.171854 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-7ac85c12-c8a0-48a0-816d-81e165ba6e08 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 5051152b-180a-4ed9-85fb-074836ae447c] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:12.190853 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7ac85c12-c8a0-48a0-816d-81e165ba6e08 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:12.192214 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7ac85c12-c8a0-48a0-816d-81e165ba6e08 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:12.193672 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7ac85c12-c8a0-48a0-816d-81e165ba6e08 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:12.194515 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7ac85c12-c8a0-48a0-816d-81e165ba6e08 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:12.195421 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7ac85c12-c8a0-48a0-816d-81e165ba6e08 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:12.195937 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7ac85c12-c8a0-48a0-816d-81e165ba6e08 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:12.580886 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-357f9355-3f53-4ee0-b065-ff23d625e92e tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:12.597536 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-357f9355-3f53-4ee0-b065-ff23d625e92e tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:12.603370 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-357f9355-3f53-4ee0-b065-ff23d625e92e tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:12.611903 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-357f9355-3f53-4ee0-b065-ff23d625e92e tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] 10.222.0.33 "GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e" status: 200 len: 2208 microversion: 2.42 time: 0.786162 Sep 23 04:43:12.614535 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1445/2923] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:43:11 2022] GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e => generated 2208 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:43:12.624042 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-9105532f-d6f3-46e7-a8dc-72aca263516b req-0b46e59e-6738-4611-8b6e-39ec22e33128 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53745879-9973-4217-b1c5-b45f917db80e", "name": "network-vif-deleted", "tag": "94e28598-1406-4598-9b02-0050f6bb7fcd"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:43:12.651693 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-9105532f-d6f3-46e7-a8dc-72aca263516b req-0b46e59e-6738-4611-8b6e-39ec22e33128 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:12.654611 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-9105532f-d6f3-46e7-a8dc-72aca263516b req-0b46e59e-6738-4611-8b6e-39ec22e33128 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:12.655261 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-9105532f-d6f3-46e7-a8dc-72aca263516b req-0b46e59e-6738-4611-8b6e-39ec22e33128 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:12.683948 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-9105532f-d6f3-46e7-a8dc-72aca263516b req-0b46e59e-6738-4611-8b6e-39ec22e33128 service nova] Creating event network-vif-deleted:94e28598-1406-4598-9b02-0050f6bb7fcd for instance 53745879-9973-4217-b1c5-b45f917db80e on n-h2-846463-3 Sep 23 04:43:12.695322 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=28 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:43:12.700149 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-9105532f-d6f3-46e7-a8dc-72aca263516b req-0b46e59e-6738-4611-8b6e-39ec22e33128 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083535 Sep 23 04:43:12.711519 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1446/2924] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:43:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:43:12.811089 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-ba0acc20-77d8-492b-a452-8f18976b6628 req-4e86d76d-01c0-4517-8974-f5ea2dfd8167 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5051152b-180a-4ed9-85fb-074836ae447c", "tag": "a5af28f5-cddc-4619-80a6-e76b666d596f"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:43:12.832835 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-ba0acc20-77d8-492b-a452-8f18976b6628 req-4e86d76d-01c0-4517-8974-f5ea2dfd8167 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:12.834261 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-ba0acc20-77d8-492b-a452-8f18976b6628 req-4e86d76d-01c0-4517-8974-f5ea2dfd8167 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:12.834587 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-ba0acc20-77d8-492b-a452-8f18976b6628 req-4e86d76d-01c0-4517-8974-f5ea2dfd8167 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:12.856302 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-ba0acc20-77d8-492b-a452-8f18976b6628 req-4e86d76d-01c0-4517-8974-f5ea2dfd8167 service nova] Creating event network-changed:a5af28f5-cddc-4619-80a6-e76b666d596f for instance 5051152b-180a-4ed9-85fb-074836ae447c on n-h2-846463-3 Sep 23 04:43:12.861120 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-ba0acc20-77d8-492b-a452-8f18976b6628 req-4e86d76d-01c0-4517-8974-f5ea2dfd8167 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054012 Sep 23 04:43:12.862374 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1447/2925] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:43:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:43:13.141416 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-7ac85c12-c8a0-48a0-816d-81e165ba6e08 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:13.152487 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-7ac85c12-c8a0-48a0-816d-81e165ba6e08 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/5051152b-180a-4ed9-85fb-074836ae447c" status: 200 len: 1293 microversion: 2.1 time: 0.985161 Sep 23 04:43:13.167519 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1479/2926] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:12 2022] GET /compute/v2.1/servers/5051152b-180a-4ed9-85fb-074836ae447c => generated 1293 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:43:13.641869 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6aa16ebb-89e7-4e5f-bd28-607a68c4f592 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:13.645530 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-6aa16ebb-89e7-4e5f-bd28-607a68c4f592 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] [instance: 53745879-9973-4217-b1c5-b45f917db80e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:13.649714 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6aa16ebb-89e7-4e5f-bd28-607a68c4f592 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:13.650304 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6aa16ebb-89e7-4e5f-bd28-607a68c4f592 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:13.650750 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6aa16ebb-89e7-4e5f-bd28-607a68c4f592 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:13.651466 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6aa16ebb-89e7-4e5f-bd28-607a68c4f592 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:13.651926 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6aa16ebb-89e7-4e5f-bd28-607a68c4f592 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:13.652356 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6aa16ebb-89e7-4e5f-bd28-607a68c4f592 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:13.906305 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6aa16ebb-89e7-4e5f-bd28-607a68c4f592 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:13.925430 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6aa16ebb-89e7-4e5f-bd28-607a68c4f592 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:13.936645 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6aa16ebb-89e7-4e5f-bd28-607a68c4f592 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:13.938288 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-6aa16ebb-89e7-4e5f-bd28-607a68c4f592 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] 10.222.0.33 "GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e" status: 200 len: 1603 microversion: 2.42 time: 0.300973 Sep 23 04:43:13.939048 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1448/2927] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:43:13 2022] GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e => generated 1603 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:43:14.183751 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8accf6bb-f6b3-4bdf-a5c1-b9bc89164fff tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:14.185759 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-8accf6bb-f6b3-4bdf-a5c1-b9bc89164fff tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 5051152b-180a-4ed9-85fb-074836ae447c] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:14.206071 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:43:14.210055 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8accf6bb-f6b3-4bdf-a5c1-b9bc89164fff tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:14.210515 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8accf6bb-f6b3-4bdf-a5c1-b9bc89164fff tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:14.211121 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8accf6bb-f6b3-4bdf-a5c1-b9bc89164fff tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:14.212233 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8accf6bb-f6b3-4bdf-a5c1-b9bc89164fff tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:14.212846 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8accf6bb-f6b3-4bdf-a5c1-b9bc89164fff tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:14.213592 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8accf6bb-f6b3-4bdf-a5c1-b9bc89164fff tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:14.736068 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-2ccd6e15-6380-4bfb-8465-b21fc00855aa req-2444c4a1-b587-4749-9eb9-e377c0c3ffe2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53745879-9973-4217-b1c5-b45f917db80e", "name": "network-vif-deleted", "tag": "db361959-8361-465d-9cf6-0cddc23eb745"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:43:14.764330 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-2ccd6e15-6380-4bfb-8465-b21fc00855aa req-2444c4a1-b587-4749-9eb9-e377c0c3ffe2 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:14.765172 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-2ccd6e15-6380-4bfb-8465-b21fc00855aa req-2444c4a1-b587-4749-9eb9-e377c0c3ffe2 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:14.765630 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-2ccd6e15-6380-4bfb-8465-b21fc00855aa req-2444c4a1-b587-4749-9eb9-e377c0c3ffe2 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:14.779387 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-2ccd6e15-6380-4bfb-8465-b21fc00855aa req-2444c4a1-b587-4749-9eb9-e377c0c3ffe2 service nova] Creating event network-vif-deleted:db361959-8361-465d-9cf6-0cddc23eb745 for instance 53745879-9973-4217-b1c5-b45f917db80e on n-h2-846463-3 Sep 23 04:43:14.784817 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-2ccd6e15-6380-4bfb-8465-b21fc00855aa req-2444c4a1-b587-4749-9eb9-e377c0c3ffe2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052503 Sep 23 04:43:14.785778 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1449/2928] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:43:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:43:14.969256 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2189e287-616e-41e3-ba58-9dcc8d92b624 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:14.970014 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-2189e287-616e-41e3-ba58-9dcc8d92b624 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] [instance: 53745879-9973-4217-b1c5-b45f917db80e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:14.981910 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2189e287-616e-41e3-ba58-9dcc8d92b624 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:14.982742 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2189e287-616e-41e3-ba58-9dcc8d92b624 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:14.983386 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2189e287-616e-41e3-ba58-9dcc8d92b624 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:14.984293 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2189e287-616e-41e3-ba58-9dcc8d92b624 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:14.984964 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2189e287-616e-41e3-ba58-9dcc8d92b624 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:14.985556 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2189e287-616e-41e3-ba58-9dcc8d92b624 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:15.221573 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-2189e287-616e-41e3-ba58-9dcc8d92b624 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:15.238005 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-2189e287-616e-41e3-ba58-9dcc8d92b624 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:15.244673 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-2189e287-616e-41e3-ba58-9dcc8d92b624 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:15.248130 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2189e287-616e-41e3-ba58-9dcc8d92b624 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] 10.222.0.33 "GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e" status: 200 len: 1603 microversion: 2.42 time: 0.284114 Sep 23 04:43:15.250233 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1450/2929] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:43:14 2022] GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e => generated 1603 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:43:15.383604 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-8accf6bb-f6b3-4bdf-a5c1-b9bc89164fff tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:15.423871 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-8accf6bb-f6b3-4bdf-a5c1-b9bc89164fff tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/5051152b-180a-4ed9-85fb-074836ae447c" status: 200 len: 1293 microversion: 2.1 time: 1.246091 Sep 23 04:43:15.428070 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1480/2930] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:14 2022] GET /compute/v2.1/servers/5051152b-180a-4ed9-85fb-074836ae447c => generated 1293 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:43:16.277698 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-45f14ad3-4344-41ad-9611-6839fba782e7 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:16.282810 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-45f14ad3-4344-41ad-9611-6839fba782e7 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] [instance: 53745879-9973-4217-b1c5-b45f917db80e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:16.292330 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-45f14ad3-4344-41ad-9611-6839fba782e7 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:16.293068 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-45f14ad3-4344-41ad-9611-6839fba782e7 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:16.293685 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-45f14ad3-4344-41ad-9611-6839fba782e7 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:16.294749 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-45f14ad3-4344-41ad-9611-6839fba782e7 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:16.295388 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-45f14ad3-4344-41ad-9611-6839fba782e7 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:16.296006 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-45f14ad3-4344-41ad-9611-6839fba782e7 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:16.454084 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-45f14ad3-4344-41ad-9611-6839fba782e7 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:16.466941 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d2e79046-5f2b-42bc-bea5-a40712aa5918 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:16.466941 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d2e79046-5f2b-42bc-bea5-a40712aa5918 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 5051152b-180a-4ed9-85fb-074836ae447c] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:16.484414 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-45f14ad3-4344-41ad-9611-6839fba782e7 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:16.485925 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d2e79046-5f2b-42bc-bea5-a40712aa5918 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:16.488161 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d2e79046-5f2b-42bc-bea5-a40712aa5918 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:16.488933 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d2e79046-5f2b-42bc-bea5-a40712aa5918 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:16.489337 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-45f14ad3-4344-41ad-9611-6839fba782e7 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:16.495248 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d2e79046-5f2b-42bc-bea5-a40712aa5918 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:16.496369 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d2e79046-5f2b-42bc-bea5-a40712aa5918 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:16.500378 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-45f14ad3-4344-41ad-9611-6839fba782e7 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] 10.222.0.33 "GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e" status: 200 len: 1603 microversion: 2.42 time: 0.218080 Sep 23 04:43:16.500378 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1451/2931] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:43:16 2022] GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e => generated 1603 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:43:16.500586 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d2e79046-5f2b-42bc-bea5-a40712aa5918 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:16.916213 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d2e79046-5f2b-42bc-bea5-a40712aa5918 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:16.930701 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d2e79046-5f2b-42bc-bea5-a40712aa5918 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/5051152b-180a-4ed9-85fb-074836ae447c" status: 200 len: 1293 microversion: 2.1 time: 0.482680 Sep 23 04:43:16.940129 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1481/2932] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:16 2022] GET /compute/v2.1/servers/5051152b-180a-4ed9-85fb-074836ae447c => generated 1293 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:43:17.535139 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9333d8af-1c7e-4aef-a855-03ec36983c5e tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:17.538479 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-9333d8af-1c7e-4aef-a855-03ec36983c5e tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] [instance: 53745879-9973-4217-b1c5-b45f917db80e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:17.566099 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9333d8af-1c7e-4aef-a855-03ec36983c5e tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:17.568677 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9333d8af-1c7e-4aef-a855-03ec36983c5e tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:17.570011 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9333d8af-1c7e-4aef-a855-03ec36983c5e tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:17.572693 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9333d8af-1c7e-4aef-a855-03ec36983c5e tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:17.574652 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9333d8af-1c7e-4aef-a855-03ec36983c5e tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:17.577623 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9333d8af-1c7e-4aef-a855-03ec36983c5e tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:17.894611 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-9333d8af-1c7e-4aef-a855-03ec36983c5e tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:17.908198 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-9333d8af-1c7e-4aef-a855-03ec36983c5e tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:17.926163 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-9333d8af-1c7e-4aef-a855-03ec36983c5e tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:17.929926 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9333d8af-1c7e-4aef-a855-03ec36983c5e tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] 10.222.0.33 "GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e" status: 200 len: 1603 microversion: 2.42 time: 0.405966 Sep 23 04:43:17.932007 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1452/2933] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:43:17 2022] GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e => generated 1603 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:43:17.956218 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2c52e5b0-1418-455e-a588-0b1f7702c545 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:17.957003 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-2c52e5b0-1418-455e-a588-0b1f7702c545 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 5051152b-180a-4ed9-85fb-074836ae447c] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:17.967027 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2c52e5b0-1418-455e-a588-0b1f7702c545 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:17.967821 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2c52e5b0-1418-455e-a588-0b1f7702c545 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:17.975546 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2c52e5b0-1418-455e-a588-0b1f7702c545 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:17.975546 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2c52e5b0-1418-455e-a588-0b1f7702c545 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:17.975546 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2c52e5b0-1418-455e-a588-0b1f7702c545 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:17.975546 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2c52e5b0-1418-455e-a588-0b1f7702c545 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:18.260566 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2c52e5b0-1418-455e-a588-0b1f7702c545 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:18.280803 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2c52e5b0-1418-455e-a588-0b1f7702c545 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/5051152b-180a-4ed9-85fb-074836ae447c" status: 200 len: 1293 microversion: 2.1 time: 0.329431 Sep 23 04:43:18.291938 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1482/2934] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:17 2022] GET /compute/v2.1/servers/5051152b-180a-4ed9-85fb-074836ae447c => generated 1293 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:43:18.956734 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5017b13c-4c13-4f76-b4d3-d06fbce6d06f tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:18.958205 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5017b13c-4c13-4f76-b4d3-d06fbce6d06f tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] [instance: 53745879-9973-4217-b1c5-b45f917db80e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:18.973409 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5017b13c-4c13-4f76-b4d3-d06fbce6d06f tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:18.975792 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5017b13c-4c13-4f76-b4d3-d06fbce6d06f tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:18.977488 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5017b13c-4c13-4f76-b4d3-d06fbce6d06f tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:18.979421 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5017b13c-4c13-4f76-b4d3-d06fbce6d06f tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:18.982380 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5017b13c-4c13-4f76-b4d3-d06fbce6d06f tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:18.983097 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5017b13c-4c13-4f76-b4d3-d06fbce6d06f tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:19.311363 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b2ef16d3-f989-4f3a-ba36-b1ca3c82dfc9 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:19.312563 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b2ef16d3-f989-4f3a-ba36-b1ca3c82dfc9 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 5051152b-180a-4ed9-85fb-074836ae447c] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:19.329495 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b2ef16d3-f989-4f3a-ba36-b1ca3c82dfc9 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:19.330280 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b2ef16d3-f989-4f3a-ba36-b1ca3c82dfc9 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:19.331370 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b2ef16d3-f989-4f3a-ba36-b1ca3c82dfc9 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:19.331597 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b2ef16d3-f989-4f3a-ba36-b1ca3c82dfc9 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:19.332066 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b2ef16d3-f989-4f3a-ba36-b1ca3c82dfc9 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:19.332507 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b2ef16d3-f989-4f3a-ba36-b1ca3c82dfc9 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:19.584860 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-5017b13c-4c13-4f76-b4d3-d06fbce6d06f tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:19.595174 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-5017b13c-4c13-4f76-b4d3-d06fbce6d06f tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:19.596935 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-5017b13c-4c13-4f76-b4d3-d06fbce6d06f tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:19.598358 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5017b13c-4c13-4f76-b4d3-d06fbce6d06f tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] 10.222.0.33 "GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e" status: 200 len: 1603 microversion: 2.42 time: 0.646488 Sep 23 04:43:19.615055 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1453/2935] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:43:18 2022] GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e => generated 1603 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:43:19.828713 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b2ef16d3-f989-4f3a-ba36-b1ca3c82dfc9 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:19.841517 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b2ef16d3-f989-4f3a-ba36-b1ca3c82dfc9 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/5051152b-180a-4ed9-85fb-074836ae447c" status: 200 len: 1293 microversion: 2.1 time: 0.533735 Sep 23 04:43:19.844144 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1483/2936] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:19 2022] GET /compute/v2.1/servers/5051152b-180a-4ed9-85fb-074836ae447c => generated 1293 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:43:20.627924 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f49f6e91-cb96-4444-9e1f-8d1131023f3a tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:20.628689 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f49f6e91-cb96-4444-9e1f-8d1131023f3a tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] [instance: 53745879-9973-4217-b1c5-b45f917db80e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:20.647375 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f49f6e91-cb96-4444-9e1f-8d1131023f3a tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:20.652234 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f49f6e91-cb96-4444-9e1f-8d1131023f3a tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:20.657984 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f49f6e91-cb96-4444-9e1f-8d1131023f3a tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:20.659582 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f49f6e91-cb96-4444-9e1f-8d1131023f3a tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:20.663577 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f49f6e91-cb96-4444-9e1f-8d1131023f3a tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:20.664375 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f49f6e91-cb96-4444-9e1f-8d1131023f3a tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:20.872535 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e2304abf-a5be-4e01-99c7-26175218c4b3 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:20.873173 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e2304abf-a5be-4e01-99c7-26175218c4b3 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 5051152b-180a-4ed9-85fb-074836ae447c] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:20.910935 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e2304abf-a5be-4e01-99c7-26175218c4b3 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:20.918381 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e2304abf-a5be-4e01-99c7-26175218c4b3 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:20.918896 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e2304abf-a5be-4e01-99c7-26175218c4b3 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:20.923224 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e2304abf-a5be-4e01-99c7-26175218c4b3 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:20.923748 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e2304abf-a5be-4e01-99c7-26175218c4b3 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:20.928470 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e2304abf-a5be-4e01-99c7-26175218c4b3 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:20.954348 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f49f6e91-cb96-4444-9e1f-8d1131023f3a tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:20.984270 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f49f6e91-cb96-4444-9e1f-8d1131023f3a tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:20.991686 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f49f6e91-cb96-4444-9e1f-8d1131023f3a tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:20.994422 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f49f6e91-cb96-4444-9e1f-8d1131023f3a tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] 10.222.0.33 "GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e" status: 200 len: 1603 microversion: 2.42 time: 0.369740 Sep 23 04:43:20.998272 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1454/2937] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:43:20 2022] GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e => generated 1603 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:43:21.532580 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e2304abf-a5be-4e01-99c7-26175218c4b3 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:21.547604 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e2304abf-a5be-4e01-99c7-26175218c4b3 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/5051152b-180a-4ed9-85fb-074836ae447c" status: 200 len: 1293 microversion: 2.1 time: 0.674430 Sep 23 04:43:21.549138 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1484/2938] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:20 2022] GET /compute/v2.1/servers/5051152b-180a-4ed9-85fb-074836ae447c => generated 1293 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:43:22.024556 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8bfd8c85-21eb-400b-b279-791e4c8896a7 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:22.025742 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8bfd8c85-21eb-400b-b279-791e4c8896a7 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] [instance: 53745879-9973-4217-b1c5-b45f917db80e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:22.046525 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8bfd8c85-21eb-400b-b279-791e4c8896a7 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:22.047361 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8bfd8c85-21eb-400b-b279-791e4c8896a7 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:22.051195 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8bfd8c85-21eb-400b-b279-791e4c8896a7 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:22.052233 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8bfd8c85-21eb-400b-b279-791e4c8896a7 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:22.052905 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8bfd8c85-21eb-400b-b279-791e4c8896a7 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:22.054012 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8bfd8c85-21eb-400b-b279-791e4c8896a7 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:22.575849 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8bfd8c85-21eb-400b-b279-791e4c8896a7 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:22.596142 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c6e17dfe-726e-46c5-a8c1-f2b1ab4e6826 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:22.600432 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c6e17dfe-726e-46c5-a8c1-f2b1ab4e6826 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 5051152b-180a-4ed9-85fb-074836ae447c] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:22.633198 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8bfd8c85-21eb-400b-b279-791e4c8896a7 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:22.637189 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c6e17dfe-726e-46c5-a8c1-f2b1ab4e6826 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:22.638838 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c6e17dfe-726e-46c5-a8c1-f2b1ab4e6826 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:22.640913 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c6e17dfe-726e-46c5-a8c1-f2b1ab4e6826 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:22.641639 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8bfd8c85-21eb-400b-b279-791e4c8896a7 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:22.642904 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c6e17dfe-726e-46c5-a8c1-f2b1ab4e6826 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:22.647438 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c6e17dfe-726e-46c5-a8c1-f2b1ab4e6826 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:22.648908 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8bfd8c85-21eb-400b-b279-791e4c8896a7 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] 10.222.0.33 "GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e" status: 200 len: 1603 microversion: 2.42 time: 0.628123 Sep 23 04:43:22.649141 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c6e17dfe-726e-46c5-a8c1-f2b1ab4e6826 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:22.664443 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1455/2939] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:43:22 2022] GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e => generated 1603 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:43:23.691473 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0d17b78e-1f3f-4769-aeb8-3ffff0609e5c tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:23.693695 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-0d17b78e-1f3f-4769-aeb8-3ffff0609e5c tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] [instance: 53745879-9973-4217-b1c5-b45f917db80e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:23.703231 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0d17b78e-1f3f-4769-aeb8-3ffff0609e5c tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:23.710644 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0d17b78e-1f3f-4769-aeb8-3ffff0609e5c tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:23.711445 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0d17b78e-1f3f-4769-aeb8-3ffff0609e5c tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:23.712388 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0d17b78e-1f3f-4769-aeb8-3ffff0609e5c tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:23.713030 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0d17b78e-1f3f-4769-aeb8-3ffff0609e5c tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:23.713641 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0d17b78e-1f3f-4769-aeb8-3ffff0609e5c tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:24.010946 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c6e17dfe-726e-46c5-a8c1-f2b1ab4e6826 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:24.024548 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c6e17dfe-726e-46c5-a8c1-f2b1ab4e6826 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/5051152b-180a-4ed9-85fb-074836ae447c" status: 200 len: 1293 microversion: 2.1 time: 1.453702 Sep 23 04:43:24.054406 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1485/2940] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:22 2022] GET /compute/v2.1/servers/5051152b-180a-4ed9-85fb-074836ae447c => generated 1293 bytes in 1487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:43:24.133786 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-0d17b78e-1f3f-4769-aeb8-3ffff0609e5c tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:24.152999 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-0d17b78e-1f3f-4769-aeb8-3ffff0609e5c tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:24.157173 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-0d17b78e-1f3f-4769-aeb8-3ffff0609e5c tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:24.164960 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0d17b78e-1f3f-4769-aeb8-3ffff0609e5c tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] 10.222.0.33 "GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e" status: 200 len: 1603 microversion: 2.42 time: 0.485303 Sep 23 04:43:24.166677 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1456/2941] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:43:23 2022] GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e => generated 1603 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:43:24.406959 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-451c140f-5510-4a4d-91f9-2d2f532028da req-b32e9873-583f-4dd8-a729-d145f2d31ab3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5051152b-180a-4ed9-85fb-074836ae447c", "name": "network-vif-plugged", "status": "completed", "tag": "a5af28f5-cddc-4619-80a6-e76b666d596f"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:43:24.430741 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-451c140f-5510-4a4d-91f9-2d2f532028da req-b32e9873-583f-4dd8-a729-d145f2d31ab3 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:24.439760 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-451c140f-5510-4a4d-91f9-2d2f532028da req-b32e9873-583f-4dd8-a729-d145f2d31ab3 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:24.439760 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-451c140f-5510-4a4d-91f9-2d2f532028da req-b32e9873-583f-4dd8-a729-d145f2d31ab3 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:24.468303 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-451c140f-5510-4a4d-91f9-2d2f532028da req-b32e9873-583f-4dd8-a729-d145f2d31ab3 service nova] Creating event network-vif-plugged:a5af28f5-cddc-4619-80a6-e76b666d596f for instance 5051152b-180a-4ed9-85fb-074836ae447c on n-h2-846463-3 Sep 23 04:43:24.479957 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-451c140f-5510-4a4d-91f9-2d2f532028da req-b32e9873-583f-4dd8-a729-d145f2d31ab3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078221 Sep 23 04:43:24.485213 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1486/2942] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:43:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:43:25.053858 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-933feaef-a422-4f88-8421-186e62deb3eb tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:25.054508 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-933feaef-a422-4f88-8421-186e62deb3eb tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 5051152b-180a-4ed9-85fb-074836ae447c] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:25.076190 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-933feaef-a422-4f88-8421-186e62deb3eb tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:25.076190 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-933feaef-a422-4f88-8421-186e62deb3eb tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:25.078672 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-933feaef-a422-4f88-8421-186e62deb3eb tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:25.081122 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-933feaef-a422-4f88-8421-186e62deb3eb tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:25.081645 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-933feaef-a422-4f88-8421-186e62deb3eb tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:25.082174 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-933feaef-a422-4f88-8421-186e62deb3eb tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:25.096817 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=100 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:43:25.197855 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-51eb534f-f4de-416d-aef1-a807b6f2b0a8 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:25.199655 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-51eb534f-f4de-416d-aef1-a807b6f2b0a8 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] [instance: 53745879-9973-4217-b1c5-b45f917db80e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:25.227117 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-51eb534f-f4de-416d-aef1-a807b6f2b0a8 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:25.233170 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-51eb534f-f4de-416d-aef1-a807b6f2b0a8 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:25.248349 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-51eb534f-f4de-416d-aef1-a807b6f2b0a8 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:25.252813 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-51eb534f-f4de-416d-aef1-a807b6f2b0a8 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:25.255486 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-51eb534f-f4de-416d-aef1-a807b6f2b0a8 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:25.260412 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-51eb534f-f4de-416d-aef1-a807b6f2b0a8 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:25.497326 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-51eb534f-f4de-416d-aef1-a807b6f2b0a8 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:25.558884 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-51eb534f-f4de-416d-aef1-a807b6f2b0a8 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:25.569235 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-51eb534f-f4de-416d-aef1-a807b6f2b0a8 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:25.570949 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-51eb534f-f4de-416d-aef1-a807b6f2b0a8 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] 10.222.0.33 "GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e" status: 200 len: 1603 microversion: 2.42 time: 0.379796 Sep 23 04:43:25.571902 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1487/2943] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:43:25 2022] GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e => generated 1603 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:43:25.772749 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-933feaef-a422-4f88-8421-186e62deb3eb tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:25.798846 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-933feaef-a422-4f88-8421-186e62deb3eb tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/5051152b-180a-4ed9-85fb-074836ae447c" status: 200 len: 1293 microversion: 2.1 time: 0.749776 Sep 23 04:43:25.821608 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1457/2944] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:25 2022] GET /compute/v2.1/servers/5051152b-180a-4ed9-85fb-074836ae447c => generated 1293 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:43:26.602352 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1e1bdb56-f1de-4128-aa51-7cecc6caffc2 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:26.604940 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1e1bdb56-f1de-4128-aa51-7cecc6caffc2 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] [instance: 53745879-9973-4217-b1c5-b45f917db80e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:26.624210 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e1bdb56-f1de-4128-aa51-7cecc6caffc2 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:26.626005 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e1bdb56-f1de-4128-aa51-7cecc6caffc2 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:26.626798 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e1bdb56-f1de-4128-aa51-7cecc6caffc2 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:26.627834 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e1bdb56-f1de-4128-aa51-7cecc6caffc2 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:26.633088 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e1bdb56-f1de-4128-aa51-7cecc6caffc2 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:26.634434 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e1bdb56-f1de-4128-aa51-7cecc6caffc2 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:26.827924 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3f719275-ea52-492d-a9ae-c49e870d788d tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:26.828557 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3f719275-ea52-492d-a9ae-c49e870d788d tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 5051152b-180a-4ed9-85fb-074836ae447c] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:26.839735 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3f719275-ea52-492d-a9ae-c49e870d788d tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:26.840324 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3f719275-ea52-492d-a9ae-c49e870d788d tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:26.840806 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3f719275-ea52-492d-a9ae-c49e870d788d tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:26.841708 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3f719275-ea52-492d-a9ae-c49e870d788d tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:26.842995 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3f719275-ea52-492d-a9ae-c49e870d788d tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:26.844754 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3f719275-ea52-492d-a9ae-c49e870d788d tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:27.237910 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1e1bdb56-f1de-4128-aa51-7cecc6caffc2 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:27.260625 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1e1bdb56-f1de-4128-aa51-7cecc6caffc2 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:27.270094 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1e1bdb56-f1de-4128-aa51-7cecc6caffc2 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:27.274485 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1e1bdb56-f1de-4128-aa51-7cecc6caffc2 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] 10.222.0.33 "GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e" status: 200 len: 1603 microversion: 2.42 time: 0.674561 Sep 23 04:43:27.278238 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1488/2945] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:43:26 2022] GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e => generated 1603 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:43:27.564893 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-3f719275-ea52-492d-a9ae-c49e870d788d tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:27.574603 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3f719275-ea52-492d-a9ae-c49e870d788d tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/5051152b-180a-4ed9-85fb-074836ae447c" status: 200 len: 1473 microversion: 2.1 time: 0.752732 Sep 23 04:43:27.594722 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1458/2946] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:26 2022] GET /compute/v2.1/servers/5051152b-180a-4ed9-85fb-074836ae447c => generated 1473 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:43:27.903041 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3c5ad70b-ad3a-48fd-a4eb-59bf6b383595 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1301311232", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:43:28.022853 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.neutron [None req-3c5ad70b-ad3a-48fd-a4eb-59bf6b383595 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] validate_networks() for [('e70e4da0-3337-4af1-b4df-8067d676f5e8', None, None, None, None, None)] {{(pid=122699) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:43:28.203148 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-cb15b318-af94-48ab-a091-7bc23be85dd1 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-141150303", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "networks": [{"uuid": "ba35f7e0-9420-45ef-a251-5988b98046ec"}]}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:43:28.253730 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:43:28.337708 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.network.neutron [None req-cb15b318-af94-48ab-a091-7bc23be85dd1 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] validate_networks() for [('ba35f7e0-9420-45ef-a251-5988b98046ec', None, None, None, None, None)] {{(pid=122698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:43:30.008549 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-3c5ad70b-ad3a-48fd-a4eb-59bf6b383595 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Flavor limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:43:30.008549 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-3c5ad70b-ad3a-48fd-a4eb-59bf6b383595 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Image limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:43:30.009150 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-3c5ad70b-ad3a-48fd-a4eb-59bf6b383595 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Flavor pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:43:30.009333 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-3c5ad70b-ad3a-48fd-a4eb-59bf6b383595 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Image pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:43:30.010926 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-3c5ad70b-ad3a-48fd-a4eb-59bf6b383595 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:43:30.042089 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3c5ad70b-ad3a-48fd-a4eb-59bf6b383595 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:30.042510 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3c5ad70b-ad3a-48fd-a4eb-59bf6b383595 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:30.042963 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3c5ad70b-ad3a-48fd-a4eb-59bf6b383595 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:30.043729 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3c5ad70b-ad3a-48fd-a4eb-59bf6b383595 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:30.045306 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3c5ad70b-ad3a-48fd-a4eb-59bf6b383595 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:30.045753 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3c5ad70b-ad3a-48fd-a4eb-59bf6b383595 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:30.090715 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-3c5ad70b-ad3a-48fd-a4eb-59bf6b383595 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Getting quotas for project c23bd5a8b84942898a99930b2bc0ca12. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:43:30.099740 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-3c5ad70b-ad3a-48fd-a4eb-59bf6b383595 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Getting quotas for user 252c87e244984f71ae0907ee769bec05 and project c23bd5a8b84942898a99930b2bc0ca12. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:43:30.120525 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-3c5ad70b-ad3a-48fd-a4eb-59bf6b383595 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Going to run 1 instances... {{(pid=122699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:43:30.124284 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-3c5ad70b-ad3a-48fd-a4eb-59bf6b383595 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 4c9542e4-b84e-4f7b-b29d-6574d486100f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:43:30.137992 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-cb15b318-af94-48ab-a091-7bc23be85dd1 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Flavor limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:43:30.139243 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-cb15b318-af94-48ab-a091-7bc23be85dd1 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Image limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:43:30.139887 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-cb15b318-af94-48ab-a091-7bc23be85dd1 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Flavor pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:43:30.140478 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-cb15b318-af94-48ab-a091-7bc23be85dd1 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Image pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:43:30.141276 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-cb15b318-af94-48ab-a091-7bc23be85dd1 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:43:30.186885 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cb15b318-af94-48ab-a091-7bc23be85dd1 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:30.189405 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cb15b318-af94-48ab-a091-7bc23be85dd1 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:30.193782 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cb15b318-af94-48ab-a091-7bc23be85dd1 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:30.197620 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cb15b318-af94-48ab-a091-7bc23be85dd1 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:30.201491 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cb15b318-af94-48ab-a091-7bc23be85dd1 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:30.202002 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cb15b318-af94-48ab-a091-7bc23be85dd1 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:30.265568 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-cb15b318-af94-48ab-a091-7bc23be85dd1 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Getting quotas for project 7c43f2b70bc74a48b62fb4115337f073. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:43:30.273335 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-cb15b318-af94-48ab-a091-7bc23be85dd1 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Getting quotas for user c11980041918484990dac709544d0b42 and project 7c43f2b70bc74a48b62fb4115337f073. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:43:30.296769 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-cb15b318-af94-48ab-a091-7bc23be85dd1 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Going to run 1 instances... {{(pid=122698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:43:30.297917 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-cb15b318-af94-48ab-a091-7bc23be85dd1 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] [instance: 2cea388e-a568-48be-9f76-b673509a7824] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:43:30.435549 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3c5ad70b-ad3a-48fd-a4eb-59bf6b383595 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.536102 Sep 23 04:43:30.447370 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1489/2947] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:43:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 2545 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:43:30.449845 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-67e123b2-7d48-4037-8a4b-da266e8dd1b8 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:30.461494 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-67e123b2-7d48-4037-8a4b-da266e8dd1b8 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] [instance: 53745879-9973-4217-b1c5-b45f917db80e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:30.486335 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-67e123b2-7d48-4037-8a4b-da266e8dd1b8 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:30.487341 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-67e123b2-7d48-4037-8a4b-da266e8dd1b8 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:30.487341 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-67e123b2-7d48-4037-8a4b-da266e8dd1b8 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:30.493439 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-67e123b2-7d48-4037-8a4b-da266e8dd1b8 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:30.493998 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-67e123b2-7d48-4037-8a4b-da266e8dd1b8 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:30.494540 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-67e123b2-7d48-4037-8a4b-da266e8dd1b8 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:30.532278 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=100 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:43:30.606350 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-cb15b318-af94-48ab-a091-7bc23be85dd1 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.670276 Sep 23 04:43:30.620672 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1459/2948] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:43:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 2686 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:43:30.656968 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-75d97704-fec4-48e7-9f1a-a28995cd6b75 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:30.656968 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-75d97704-fec4-48e7-9f1a-a28995cd6b75 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 4c9542e4-b84e-4f7b-b29d-6574d486100f] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:30.748990 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-75d97704-fec4-48e7-9f1a-a28995cd6b75 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 4c9542e4-b84e-4f7b-b29d-6574d486100f] Going to try to terminate instance {{(pid=122698) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:43:30.928243 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-67e123b2-7d48-4037-8a4b-da266e8dd1b8 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:30.955635 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-67e123b2-7d48-4037-8a4b-da266e8dd1b8 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:30.957220 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-67e123b2-7d48-4037-8a4b-da266e8dd1b8 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:30.963977 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-67e123b2-7d48-4037-8a4b-da266e8dd1b8 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] 10.222.0.33 "GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e" status: 200 len: 1603 microversion: 2.42 time: 0.517548 Sep 23 04:43:30.964587 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1490/2949] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:43:30 2022] GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e => generated 1603 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:43:30.985241 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ef6afced-35f5-4ab1-9b54-b0c29c92b8dd tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:30.985241 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ef6afced-35f5-4ab1-9b54-b0c29c92b8dd tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] [instance: 2cea388e-a568-48be-9f76-b673509a7824] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:31.154807 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-75d97704-fec4-48e7-9f1a-a28995cd6b75 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4c9542e4-b84e-4f7b-b29d-6574d486100f" status: 204 len: 0 microversion: 2.1 time: 0.530905 Sep 23 04:43:31.156048 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1460/2950] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:43:30 2022] DELETE /compute/v2.1/servers/4c9542e4-b84e-4f7b-b29d-6574d486100f => generated 0 bytes in 534 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:43:31.165158 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b70a6323-5a9e-413b-bf6d-dcfd1815eb10 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:31.166216 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b70a6323-5a9e-413b-bf6d-dcfd1815eb10 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 4c9542e4-b84e-4f7b-b29d-6574d486100f] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:31.218902 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-b70a6323-5a9e-413b-bf6d-dcfd1815eb10 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] HTTP exception thrown: Instance 4c9542e4-b84e-4f7b-b29d-6574d486100f could not be found. Sep 23 04:43:31.230068 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b70a6323-5a9e-413b-bf6d-dcfd1815eb10 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Request method failure captured: Sep 23 04:43:31.230068 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/4c9542e4-b84e-4f7b-b29d-6574d486100f HTTP/1.1 Sep 23 04:43:31.230068 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:43:31.230068 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:43:31.230068 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:43:31.230068 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:43:31.230068 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:43:31.230068 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:43:31.230068 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:43:31.230068 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:43:31.230068 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTlTlFK_k4e3BWkoqwVigfjvHO2lVSTsmHRT7EhNgH87mj-DVuWXCq-NRLrmXyv4E_e0wXdkZnDmOQ4aUkRrz7wPxuRsMdZHh23aH7xyd0PRdo29c8XIic0D4fdht4KBWWMxFeNNSWWMe-xxhvPgOUVxbcTbEXPF75Q0c4Y9h1Ew0hk Sep 23 04:43:31.230068 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:43:31.230068 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:43:31.230068 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:43:31.230068 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:43:31.230068 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:43:31.230068 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:43:31.230068 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: c23bd5a8b84942898a99930b2bc0ca12 Sep 23 04:43:31.230068 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ServersTestJSON-1923416422 Sep 23 04:43:31.230068 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:43:31.230068 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:43:31.230068 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c23bd5a8b84942898a99930b2bc0ca12", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c23bd5a8b84942898a99930b2bc0ca12"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c23bd5a8b84942898a99930b2bc0ca12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c23bd5a8b84942898a99930b2bc0ca12"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:43:31.230068 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ServersTestJSON-1923416422 Sep 23 04:43:31.230068 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: c23bd5a8b84942898a99930b2bc0ca12 Sep 23 04:43:31.230068 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ServersTestJSON-1923416422 Sep 23 04:43:31.230068 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ServersTestJSON-1923416422-project Sep 23 04:43:31.230068 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:43:31.230068 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:43:31.230068 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 252c87e244984f71ae0907ee769bec05 Sep 23 04:43:31.230068 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ServersTestJSON-1923416422-project Sep 23 04:43:31.230068 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:43:31.230068 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 4c9542e4-b84e-4f7b-b29d-6574d486100f could not be found. Sep 23 04:43:31.230068 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '4c9542e4-b84e-4f7b-b29d-6574d486100f'} Sep 23 04:43:31.230068 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:43:31.230068 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:43:31.230068 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2932, in _get_instance Sep 23 04:43:31.230068 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi build_req = objects.BuildRequest.get_by_instance_uuid( Sep 23 04:43:31.230068 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 04:43:31.230068 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 04:43:31.230068 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 177, in get_by_instance_uuid Sep 23 04:43:31.230068 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi db_req = cls._get_by_instance_uuid_from_db(context, instance_uuid) Sep 23 04:43:31.230068 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 23 04:43:31.230068 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 23 04:43:31.230068 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 172, in _get_by_instance_uuid_from_db Sep 23 04:43:31.230068 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.BuildRequestNotFound(uuid=instance_uuid) Sep 23 04:43:31.230068 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.BuildRequestNotFound: BuildRequest not found for instance 4c9542e4-b84e-4f7b-b29d-6574d486100f Sep 23 04:43:31.230068 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:43:31.230068 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:43:31.230068 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:43:31.230068 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:43:31.230068 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:43:31.230068 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:43:31.230068 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:43:31.230068 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:43:31.230068 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2944, in _get_instance Sep 23 04:43:31.230068 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 23 04:43:31.230068 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c9542e4-b84e-4f7b-b29d-6574d486100f could not be found. Sep 23 04:43:31.230068 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:43:31.230068 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:43:31.230068 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:43:31.230068 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:43:31.230068 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:43:31.230068 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:43:31.237999 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:43:31.237999 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:43:31.237999 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:43:31.237999 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:43:31.237999 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:43:31.237999 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:43:31.237999 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:43:31.237999 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:43:31.237999 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:43:31.237999 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:43:31.237999 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c9542e4-b84e-4f7b-b29d-6574d486100f could not be found. Sep 23 04:43:31.237999 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:43:31.237999 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:43:31.237999 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:43:31.237999 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:43:31.237999 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:43:31.237999 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:43:31.237999 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:43:31.237999 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:43:31.237999 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c9542e4-b84e-4f7b-b29d-6574d486100f could not be found. Sep 23 04:43:31.237999 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:43:31.237999 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b70a6323-5a9e-413b-bf6d-dcfd1815eb10 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Returning 404 to user: Instance 4c9542e4-b84e-4f7b-b29d-6574d486100f could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:43:31.237999 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b70a6323-5a9e-413b-bf6d-dcfd1815eb10 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/4c9542e4-b84e-4f7b-b29d-6574d486100f" status: 404 len: 111 microversion: 2.1 time: 0.072513 Sep 23 04:43:31.241143 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1461/2951] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:31 2022] GET /compute/v2.1/servers/4c9542e4-b84e-4f7b-b29d-6574d486100f => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 04:43:31.480949 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ef6afced-35f5-4ab1-9b54-b0c29c92b8dd tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11980041918484990dac709544d0b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c43f2b70bc74a48b62fb4115337f073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:31.489478 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ef6afced-35f5-4ab1-9b54-b0c29c92b8dd tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/servers/2cea388e-a568-48be-9f76-b673509a7824" status: 200 len: 1207 microversion: 2.1 time: 0.520514 Sep 23 04:43:31.495143 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1491/2952] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:30 2022] GET /compute/v2.1/servers/2cea388e-a568-48be-9f76-b673509a7824 => generated 1207 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:43:31.568668 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-04f66179-7f6c-41cb-b4b2-08a22d0c397e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-108141452", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "e70e4da0-3337-4af1-b4df-8067d676f5e8"}]}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:43:31.737044 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.network.neutron [None req-04f66179-7f6c-41cb-b4b2-08a22d0c397e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] validate_networks() for [('e70e4da0-3337-4af1-b4df-8067d676f5e8', None, None, None, None, None)] {{(pid=122698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:43:31.995119 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c0326a8b-e30e-42cc-9524-3a9c34eeeefe tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:31.996177 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c0326a8b-e30e-42cc-9524-3a9c34eeeefe tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] [instance: 53745879-9973-4217-b1c5-b45f917db80e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:32.009026 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c0326a8b-e30e-42cc-9524-3a9c34eeeefe tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:32.016811 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c0326a8b-e30e-42cc-9524-3a9c34eeeefe tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:32.018626 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c0326a8b-e30e-42cc-9524-3a9c34eeeefe tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:32.020132 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c0326a8b-e30e-42cc-9524-3a9c34eeeefe tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:32.020971 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c0326a8b-e30e-42cc-9524-3a9c34eeeefe tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:32.021794 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c0326a8b-e30e-42cc-9524-3a9c34eeeefe tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:32.606792 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c0326a8b-e30e-42cc-9524-3a9c34eeeefe tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:32.627881 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c0326a8b-e30e-42cc-9524-3a9c34eeeefe tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:32.630521 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c0326a8b-e30e-42cc-9524-3a9c34eeeefe tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:32.638482 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c0326a8b-e30e-42cc-9524-3a9c34eeeefe tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] 10.222.0.33 "GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e" status: 200 len: 1603 microversion: 2.42 time: 0.642563 Sep 23 04:43:32.639707 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1492/2953] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:43:31 2022] GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e => generated 1603 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:43:32.655248 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1dd886d1-eb5b-4ae6-ad10-c9d758d93ec9 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:32.656168 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1dd886d1-eb5b-4ae6-ad10-c9d758d93ec9 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] [instance: 2cea388e-a568-48be-9f76-b673509a7824] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:32.848756 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1dd886d1-eb5b-4ae6-ad10-c9d758d93ec9 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11980041918484990dac709544d0b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c43f2b70bc74a48b62fb4115337f073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:32.863471 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1dd886d1-eb5b-4ae6-ad10-c9d758d93ec9 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/servers/2cea388e-a568-48be-9f76-b673509a7824" status: 200 len: 1207 microversion: 2.1 time: 0.216944 Sep 23 04:43:32.865017 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1493/2954] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:32 2022] GET /compute/v2.1/servers/2cea388e-a568-48be-9f76-b673509a7824 => generated 1207 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:43:33.404558 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-23230941-97e7-4d9d-9016-bbe2ab8e2aec tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-1407249485", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "networks": [{"uuid": "4b3f0d49-8dcf-4f4f-ad95-d701584e651f"}]}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:43:33.568233 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.neutron [None req-23230941-97e7-4d9d-9016-bbe2ab8e2aec tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] validate_networks() for [('4b3f0d49-8dcf-4f4f-ad95-d701584e651f', None, None, None, None, None)] {{(pid=122699) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:43:33.627095 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-04f66179-7f6c-41cb-b4b2-08a22d0c397e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Flavor limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:43:33.627598 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-04f66179-7f6c-41cb-b4b2-08a22d0c397e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Image limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:43:33.628002 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-04f66179-7f6c-41cb-b4b2-08a22d0c397e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Flavor pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:43:33.628418 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-04f66179-7f6c-41cb-b4b2-08a22d0c397e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Image pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:43:33.628837 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-04f66179-7f6c-41cb-b4b2-08a22d0c397e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:43:33.650214 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-04f66179-7f6c-41cb-b4b2-08a22d0c397e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:33.651801 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-04f66179-7f6c-41cb-b4b2-08a22d0c397e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:33.651801 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-04f66179-7f6c-41cb-b4b2-08a22d0c397e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:33.652016 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-04f66179-7f6c-41cb-b4b2-08a22d0c397e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:33.652320 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-04f66179-7f6c-41cb-b4b2-08a22d0c397e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:33.652754 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-04f66179-7f6c-41cb-b4b2-08a22d0c397e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:33.730195 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-04f66179-7f6c-41cb-b4b2-08a22d0c397e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Getting quotas for project c23bd5a8b84942898a99930b2bc0ca12. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:43:33.750147 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-04f66179-7f6c-41cb-b4b2-08a22d0c397e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Getting quotas for user 252c87e244984f71ae0907ee769bec05 and project c23bd5a8b84942898a99930b2bc0ca12. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:43:33.787946 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-04f66179-7f6c-41cb-b4b2-08a22d0c397e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Going to run 1 instances... {{(pid=122698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:43:33.800612 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-04f66179-7f6c-41cb-b4b2-08a22d0c397e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 2170ccef-31bf-4166-b5cb-e07cd521e20c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:43:34.052685 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-04f66179-7f6c-41cb-b4b2-08a22d0c397e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.477257 Sep 23 04:43:34.055252 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1462/2955] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:43:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 2492 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:43:34.065198 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ba109ab7-8148-46d0-b307-a9288cf89b2f tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ef22cf0c-ed0a-42a9-bef9-3ef5ea5f1ed4"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:43:34.074376 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-ba109ab7-8148-46d0-b307-a9288cf89b2f tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] [instance: 48df7db9-a805-4c72-a1a5-29632b00248c] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:34.094984 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ba109ab7-8148-46d0-b307-a9288cf89b2f tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:34.095832 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ba109ab7-8148-46d0-b307-a9288cf89b2f tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:34.096486 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ba109ab7-8148-46d0-b307-a9288cf89b2f tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:34.097429 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ba109ab7-8148-46d0-b307-a9288cf89b2f tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:34.098156 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ba109ab7-8148-46d0-b307-a9288cf89b2f tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:34.098813 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ba109ab7-8148-46d0-b307-a9288cf89b2f tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:35.136919 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-23230941-97e7-4d9d-9016-bbe2ab8e2aec tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Flavor limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:43:35.137449 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-23230941-97e7-4d9d-9016-bbe2ab8e2aec tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Image limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:43:35.138247 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-23230941-97e7-4d9d-9016-bbe2ab8e2aec tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Flavor pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:43:35.138722 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-23230941-97e7-4d9d-9016-bbe2ab8e2aec tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Image pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:43:35.139195 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-23230941-97e7-4d9d-9016-bbe2ab8e2aec tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:43:35.166112 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-23230941-97e7-4d9d-9016-bbe2ab8e2aec tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:35.168237 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-23230941-97e7-4d9d-9016-bbe2ab8e2aec tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:35.172667 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-23230941-97e7-4d9d-9016-bbe2ab8e2aec tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:35.173347 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-23230941-97e7-4d9d-9016-bbe2ab8e2aec tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:35.178475 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-23230941-97e7-4d9d-9016-bbe2ab8e2aec tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:35.179704 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-23230941-97e7-4d9d-9016-bbe2ab8e2aec tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:35.222463 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-23230941-97e7-4d9d-9016-bbe2ab8e2aec tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Getting quotas for project f0a5691a27f143eda1faf12fbbd9696c. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:43:35.235933 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-23230941-97e7-4d9d-9016-bbe2ab8e2aec tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Getting quotas for user c18998e15712495b83c222edc234349e and project f0a5691a27f143eda1faf12fbbd9696c. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:43:35.271794 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-23230941-97e7-4d9d-9016-bbe2ab8e2aec tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Going to run 1 instances... {{(pid=122699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:43:35.280187 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-23230941-97e7-4d9d-9016-bbe2ab8e2aec tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] [instance: bcdc202d-96f2-4640-8e81-f786d5e15793] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:43:35.417367 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ba109ab7-8148-46d0-b307-a9288cf89b2f tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] 10.222.0.33 "POST /compute/v2.1/servers/48df7db9-a805-4c72-a1a5-29632b00248c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.355152 Sep 23 04:43:35.418417 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1463/2956] 10.222.0.33 () {60 vars in 1323 bytes} [Fri Sep 23 04:43:34 2022] POST /compute/v2.1/servers/48df7db9-a805-4c72-a1a5-29632b00248c/os-volume_attachments => generated 194 bytes in 1362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:43:35.474384 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c5225e72-4693-468d-b9f1-c5a9a663aec1 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:35.474384 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c5225e72-4693-468d-b9f1-c5a9a663aec1 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] [instance: 53745879-9973-4217-b1c5-b45f917db80e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:35.484692 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c5225e72-4693-468d-b9f1-c5a9a663aec1 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:35.485259 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c5225e72-4693-468d-b9f1-c5a9a663aec1 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:35.485720 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c5225e72-4693-468d-b9f1-c5a9a663aec1 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:35.486500 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c5225e72-4693-468d-b9f1-c5a9a663aec1 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:35.497547 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c5225e72-4693-468d-b9f1-c5a9a663aec1 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:35.497547 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c5225e72-4693-468d-b9f1-c5a9a663aec1 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:35.545971 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-23230941-97e7-4d9d-9016-bbe2ab8e2aec tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.402534 Sep 23 04:43:35.547622 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1494/2957] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:43:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 2405 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:43:35.563621 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-27083875-359d-40bb-8655-5c0cd4f8889c tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:35.564473 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-27083875-359d-40bb-8655-5c0cd4f8889c tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] [instance: 2cea388e-a568-48be-9f76-b673509a7824] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:35.577768 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-27083875-359d-40bb-8655-5c0cd4f8889c tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:35.584200 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-27083875-359d-40bb-8655-5c0cd4f8889c tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:35.584845 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-27083875-359d-40bb-8655-5c0cd4f8889c tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:35.589582 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-27083875-359d-40bb-8655-5c0cd4f8889c tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:35.590323 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-27083875-359d-40bb-8655-5c0cd4f8889c tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:35.603414 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-27083875-359d-40bb-8655-5c0cd4f8889c tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:35.798052 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c5225e72-4693-468d-b9f1-c5a9a663aec1 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:35.814603 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c5225e72-4693-468d-b9f1-c5a9a663aec1 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:35.824405 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c5225e72-4693-468d-b9f1-c5a9a663aec1 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:35.824405 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c5225e72-4693-468d-b9f1-c5a9a663aec1 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] 10.222.0.33 "GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e" status: 200 len: 1603 microversion: 2.42 time: 0.401716 Sep 23 04:43:35.826013 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1464/2958] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:43:35 2022] GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e => generated 1603 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:43:35.841120 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7368e9f3-6c4f-458c-937f-ce61754dc4f5 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:35.845449 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7368e9f3-6c4f-458c-937f-ce61754dc4f5 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 2170ccef-31bf-4166-b5cb-e07cd521e20c] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:35.861515 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7368e9f3-6c4f-458c-937f-ce61754dc4f5 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:35.863074 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7368e9f3-6c4f-458c-937f-ce61754dc4f5 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:35.864716 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7368e9f3-6c4f-458c-937f-ce61754dc4f5 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:35.866525 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7368e9f3-6c4f-458c-937f-ce61754dc4f5 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:35.882454 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7368e9f3-6c4f-458c-937f-ce61754dc4f5 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:35.885341 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7368e9f3-6c4f-458c-937f-ce61754dc4f5 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:35.893844 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-27083875-359d-40bb-8655-5c0cd4f8889c tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11980041918484990dac709544d0b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c43f2b70bc74a48b62fb4115337f073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:35.907190 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-27083875-359d-40bb-8655-5c0cd4f8889c tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/servers/2cea388e-a568-48be-9f76-b673509a7824" status: 200 len: 1265 microversion: 2.1 time: 0.357648 Sep 23 04:43:35.915923 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1495/2959] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:35 2022] GET /compute/v2.1/servers/2cea388e-a568-48be-9f76-b673509a7824 => generated 1265 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:43:35.924233 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c8dc341d-b659-496b-a2a8-d21c6e5e8658 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:35.925687 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c8dc341d-b659-496b-a2a8-d21c6e5e8658 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] [instance: bcdc202d-96f2-4640-8e81-f786d5e15793] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:36.098836 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c8dc341d-b659-496b-a2a8-d21c6e5e8658 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18998e15712495b83c222edc234349e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5691a27f143eda1faf12fbbd9696c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:36.111503 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c8dc341d-b659-496b-a2a8-d21c6e5e8658 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] 10.222.0.33 "GET /compute/v2.1/servers/bcdc202d-96f2-4640-8e81-f786d5e15793" status: 200 len: 1217 microversion: 2.1 time: 0.196716 Sep 23 04:43:36.113795 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1496/2960] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:35 2022] GET /compute/v2.1/servers/bcdc202d-96f2-4640-8e81-f786d5e15793 => generated 1217 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:43:36.179781 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-7368e9f3-6c4f-458c-937f-ce61754dc4f5 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:36.190101 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7368e9f3-6c4f-458c-937f-ce61754dc4f5 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/2170ccef-31bf-4166-b5cb-e07cd521e20c" status: 200 len: 1224 microversion: 2.1 time: 0.362638 Sep 23 04:43:36.195674 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1465/2961] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:35 2022] GET /compute/v2.1/servers/2170ccef-31bf-4166-b5cb-e07cd521e20c => generated 1224 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:43:36.858473 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-00c2ab82-9ff1-405d-b63a-2a04648c6c1e tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:36.859738 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-00c2ab82-9ff1-405d-b63a-2a04648c6c1e tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] [instance: 53745879-9973-4217-b1c5-b45f917db80e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:36.867268 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-00c2ab82-9ff1-405d-b63a-2a04648c6c1e tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:36.868043 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-00c2ab82-9ff1-405d-b63a-2a04648c6c1e tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:36.868656 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-00c2ab82-9ff1-405d-b63a-2a04648c6c1e tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:36.869549 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-00c2ab82-9ff1-405d-b63a-2a04648c6c1e tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:36.870225 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-00c2ab82-9ff1-405d-b63a-2a04648c6c1e tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:36.870837 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-00c2ab82-9ff1-405d-b63a-2a04648c6c1e tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:36.941666 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-31679201-0102-4673-8554-efa8543c5d7e tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:36.942781 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-31679201-0102-4673-8554-efa8543c5d7e tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] [instance: 2cea388e-a568-48be-9f76-b673509a7824] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:36.966747 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-31679201-0102-4673-8554-efa8543c5d7e tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:36.967286 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-31679201-0102-4673-8554-efa8543c5d7e tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:36.968932 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-31679201-0102-4673-8554-efa8543c5d7e tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:36.969711 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-31679201-0102-4673-8554-efa8543c5d7e tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:36.970230 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-31679201-0102-4673-8554-efa8543c5d7e tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:36.977105 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-31679201-0102-4673-8554-efa8543c5d7e tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:37.183052 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-00c2ab82-9ff1-405d-b63a-2a04648c6c1e tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:37.199721 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-00c2ab82-9ff1-405d-b63a-2a04648c6c1e tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:37.201605 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-00c2ab82-9ff1-405d-b63a-2a04648c6c1e tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:37.211046 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-00c2ab82-9ff1-405d-b63a-2a04648c6c1e tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] 10.222.0.33 "GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e" status: 200 len: 1603 microversion: 2.42 time: 0.350718 Sep 23 04:43:37.229814 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1497/2962] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:43:36 2022] GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e => generated 1603 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:43:37.234795 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-bb1743b4-d4de-43a1-b201-ff9a905b55a7 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:37.240013 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-bb1743b4-d4de-43a1-b201-ff9a905b55a7 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] [instance: bcdc202d-96f2-4640-8e81-f786d5e15793] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:37.253649 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-31679201-0102-4673-8554-efa8543c5d7e tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11980041918484990dac709544d0b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c43f2b70bc74a48b62fb4115337f073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:37.270706 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-31679201-0102-4673-8554-efa8543c5d7e tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/servers/2cea388e-a568-48be-9f76-b673509a7824" status: 200 len: 1265 microversion: 2.1 time: 0.332169 Sep 23 04:43:37.271334 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1466/2963] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:36 2022] GET /compute/v2.1/servers/2cea388e-a568-48be-9f76-b673509a7824 => generated 1265 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:43:37.290438 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-41780bd1-4e5d-4be0-b1e7-12a6ab0eba41 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:37.294872 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-41780bd1-4e5d-4be0-b1e7-12a6ab0eba41 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 2170ccef-31bf-4166-b5cb-e07cd521e20c] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:37.310869 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-41780bd1-4e5d-4be0-b1e7-12a6ab0eba41 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:37.315544 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-41780bd1-4e5d-4be0-b1e7-12a6ab0eba41 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:37.319879 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-41780bd1-4e5d-4be0-b1e7-12a6ab0eba41 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:37.319879 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-41780bd1-4e5d-4be0-b1e7-12a6ab0eba41 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:37.319879 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-41780bd1-4e5d-4be0-b1e7-12a6ab0eba41 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:37.319879 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-41780bd1-4e5d-4be0-b1e7-12a6ab0eba41 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:37.558130 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-bb1743b4-d4de-43a1-b201-ff9a905b55a7 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18998e15712495b83c222edc234349e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5691a27f143eda1faf12fbbd9696c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:37.570587 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-bb1743b4-d4de-43a1-b201-ff9a905b55a7 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] 10.222.0.33 "GET /compute/v2.1/servers/bcdc202d-96f2-4640-8e81-f786d5e15793" status: 200 len: 1217 microversion: 2.1 time: 0.339481 Sep 23 04:43:37.583317 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1498/2964] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:37 2022] GET /compute/v2.1/servers/bcdc202d-96f2-4640-8e81-f786d5e15793 => generated 1217 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:43:37.588592 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-41780bd1-4e5d-4be0-b1e7-12a6ab0eba41 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:37.597150 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-41780bd1-4e5d-4be0-b1e7-12a6ab0eba41 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/2170ccef-31bf-4166-b5cb-e07cd521e20c" status: 200 len: 1272 microversion: 2.1 time: 0.324731 Sep 23 04:43:37.602242 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1467/2965] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:37 2022] GET /compute/v2.1/servers/2170ccef-31bf-4166-b5cb-e07cd521e20c => generated 1272 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:43:38.234835 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-66e05249-9baf-401c-a690-666bff95bc08 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:38.236316 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-66e05249-9baf-401c-a690-666bff95bc08 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] [instance: 53745879-9973-4217-b1c5-b45f917db80e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:38.266545 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-66e05249-9baf-401c-a690-666bff95bc08 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:38.267079 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-66e05249-9baf-401c-a690-666bff95bc08 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:38.267533 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-66e05249-9baf-401c-a690-666bff95bc08 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:38.268279 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-66e05249-9baf-401c-a690-666bff95bc08 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:38.268750 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-66e05249-9baf-401c-a690-666bff95bc08 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:38.269187 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-66e05249-9baf-401c-a690-666bff95bc08 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:38.300619 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-eb74e2ca-6c63-406f-bf2d-ae85eeb374af tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:38.301933 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-eb74e2ca-6c63-406f-bf2d-ae85eeb374af tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] [instance: 2cea388e-a568-48be-9f76-b673509a7824] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:38.320447 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-eb74e2ca-6c63-406f-bf2d-ae85eeb374af tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:38.320970 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-eb74e2ca-6c63-406f-bf2d-ae85eeb374af tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:38.321427 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-eb74e2ca-6c63-406f-bf2d-ae85eeb374af tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:38.322248 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-eb74e2ca-6c63-406f-bf2d-ae85eeb374af tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:38.322724 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-eb74e2ca-6c63-406f-bf2d-ae85eeb374af tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:38.323165 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-eb74e2ca-6c63-406f-bf2d-ae85eeb374af tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:38.515216 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-eb74e2ca-6c63-406f-bf2d-ae85eeb374af tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11980041918484990dac709544d0b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c43f2b70bc74a48b62fb4115337f073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:38.525189 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-eb74e2ca-6c63-406f-bf2d-ae85eeb374af tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/servers/2cea388e-a568-48be-9f76-b673509a7824" status: 200 len: 1265 microversion: 2.1 time: 0.228325 Sep 23 04:43:38.527974 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1468/2966] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:38 2022] GET /compute/v2.1/servers/2cea388e-a568-48be-9f76-b673509a7824 => generated 1265 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:43:38.532607 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-66e05249-9baf-401c-a690-666bff95bc08 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:38.542083 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-66e05249-9baf-401c-a690-666bff95bc08 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:38.543589 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-66e05249-9baf-401c-a690-666bff95bc08 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:38.548748 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-66e05249-9baf-401c-a690-666bff95bc08 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] 10.222.0.33 "GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e" status: 200 len: 1603 microversion: 2.42 time: 0.314115 Sep 23 04:43:38.557185 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1499/2967] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:43:38 2022] GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e => generated 1603 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:43:38.605782 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ba88901e-56ef-4736-b813-9b53bc0ffe74 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:38.606450 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-ba88901e-56ef-4736-b813-9b53bc0ffe74 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] [instance: bcdc202d-96f2-4640-8e81-f786d5e15793] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:38.626025 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-49d05776-c182-4f93-b27a-bd827cb53bd3 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:38.626683 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-49d05776-c182-4f93-b27a-bd827cb53bd3 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 2170ccef-31bf-4166-b5cb-e07cd521e20c] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:38.630372 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ba88901e-56ef-4736-b813-9b53bc0ffe74 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:38.630888 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ba88901e-56ef-4736-b813-9b53bc0ffe74 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:38.633580 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ba88901e-56ef-4736-b813-9b53bc0ffe74 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:38.642375 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ba88901e-56ef-4736-b813-9b53bc0ffe74 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:38.643167 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ba88901e-56ef-4736-b813-9b53bc0ffe74 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:38.643285 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-49d05776-c182-4f93-b27a-bd827cb53bd3 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:38.643724 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ba88901e-56ef-4736-b813-9b53bc0ffe74 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:38.643857 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-49d05776-c182-4f93-b27a-bd827cb53bd3 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:38.644239 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-49d05776-c182-4f93-b27a-bd827cb53bd3 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:38.645014 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-49d05776-c182-4f93-b27a-bd827cb53bd3 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:38.645599 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-49d05776-c182-4f93-b27a-bd827cb53bd3 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:38.646080 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-49d05776-c182-4f93-b27a-bd827cb53bd3 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:38.786906 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-49d05776-c182-4f93-b27a-bd827cb53bd3 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:38.799943 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-49d05776-c182-4f93-b27a-bd827cb53bd3 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/2170ccef-31bf-4166-b5cb-e07cd521e20c" status: 200 len: 1278 microversion: 2.1 time: 0.179188 Sep 23 04:43:38.801653 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1500/2968] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:38 2022] GET /compute/v2.1/servers/2170ccef-31bf-4166-b5cb-e07cd521e20c => generated 1278 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:43:39.029983 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ba88901e-56ef-4736-b813-9b53bc0ffe74 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18998e15712495b83c222edc234349e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5691a27f143eda1faf12fbbd9696c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:39.046556 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ba88901e-56ef-4736-b813-9b53bc0ffe74 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] 10.222.0.33 "GET /compute/v2.1/servers/bcdc202d-96f2-4640-8e81-f786d5e15793" status: 200 len: 1269 microversion: 2.1 time: 0.444195 Sep 23 04:43:39.048972 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1469/2969] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:38 2022] GET /compute/v2.1/servers/bcdc202d-96f2-4640-8e81-f786d5e15793 => generated 1269 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:43:39.548700 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-04523d3d-83f9-475d-99f1-38428ac0a657 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:39.549322 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-04523d3d-83f9-475d-99f1-38428ac0a657 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] [instance: 2cea388e-a568-48be-9f76-b673509a7824] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:39.565554 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-04523d3d-83f9-475d-99f1-38428ac0a657 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:39.577114 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7d38c4c2-a559-4c9b-867f-790ecb3945c3 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:39.577991 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7d38c4c2-a559-4c9b-867f-790ecb3945c3 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] [instance: 53745879-9973-4217-b1c5-b45f917db80e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:39.578658 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-04523d3d-83f9-475d-99f1-38428ac0a657 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:39.579274 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-04523d3d-83f9-475d-99f1-38428ac0a657 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:39.580055 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-04523d3d-83f9-475d-99f1-38428ac0a657 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:39.584470 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-04523d3d-83f9-475d-99f1-38428ac0a657 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:39.587748 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-04523d3d-83f9-475d-99f1-38428ac0a657 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:39.604212 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7d38c4c2-a559-4c9b-867f-790ecb3945c3 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:39.605510 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7d38c4c2-a559-4c9b-867f-790ecb3945c3 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:39.606258 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7d38c4c2-a559-4c9b-867f-790ecb3945c3 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:39.607227 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7d38c4c2-a559-4c9b-867f-790ecb3945c3 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:39.608090 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7d38c4c2-a559-4c9b-867f-790ecb3945c3 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:39.608762 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7d38c4c2-a559-4c9b-867f-790ecb3945c3 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:39.661074 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7d38c4c2-a559-4c9b-867f-790ecb3945c3 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:39.662106 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7d38c4c2-a559-4c9b-867f-790ecb3945c3 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:39.662768 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7d38c4c2-a559-4c9b-867f-790ecb3945c3 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:39.663605 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-7d38c4c2-a559-4c9b-867f-790ecb3945c3 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lazy-loading 'fault' on Instance uuid 53745879-9973-4217-b1c5-b45f917db80e {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:43:40.083280 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-7d38c4c2-a559-4c9b-867f-790ecb3945c3 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:40.103298 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-7d38c4c2-a559-4c9b-867f-790ecb3945c3 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:40.110627 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-7d38c4c2-a559-4c9b-867f-790ecb3945c3 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '99d8fe44ad7c412d8629159f7529ba81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c853e6ab59d45c084f6f7349f3ef87c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:40.124196 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7d38c4c2-a559-4c9b-867f-790ecb3945c3 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] 10.222.0.33 "GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e" status: 200 len: 1608 microversion: 2.42 time: 0.548151 Sep 23 04:43:40.127898 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1470/2970] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:43:39 2022] GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e => generated 1608 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:43:40.150892 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-dfadbbfe-61b2-45fd-b1fa-924b5d226611 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:40.151973 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-dfadbbfe-61b2-45fd-b1fa-924b5d226611 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 2170ccef-31bf-4166-b5cb-e07cd521e20c] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:40.176825 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dfadbbfe-61b2-45fd-b1fa-924b5d226611 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:40.187996 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dfadbbfe-61b2-45fd-b1fa-924b5d226611 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:40.187996 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dfadbbfe-61b2-45fd-b1fa-924b5d226611 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:40.187996 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dfadbbfe-61b2-45fd-b1fa-924b5d226611 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:40.187996 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dfadbbfe-61b2-45fd-b1fa-924b5d226611 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:40.187996 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dfadbbfe-61b2-45fd-b1fa-924b5d226611 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:40.468437 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-dfadbbfe-61b2-45fd-b1fa-924b5d226611 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:40.497285 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-dfadbbfe-61b2-45fd-b1fa-924b5d226611 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/2170ccef-31bf-4166-b5cb-e07cd521e20c" status: 200 len: 1278 microversion: 2.1 time: 0.367500 Sep 23 04:43:40.505349 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1471/2971] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:40 2022] GET /compute/v2.1/servers/2170ccef-31bf-4166-b5cb-e07cd521e20c => generated 1278 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:43:40.563798 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a3b17a57-de27-40d1-b21c-2d7251681f4d tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:40.563798 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a3b17a57-de27-40d1-b21c-2d7251681f4d tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] [instance: bcdc202d-96f2-4640-8e81-f786d5e15793] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:40.574988 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a3b17a57-de27-40d1-b21c-2d7251681f4d tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:40.575785 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a3b17a57-de27-40d1-b21c-2d7251681f4d tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:40.581696 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a3b17a57-de27-40d1-b21c-2d7251681f4d tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:40.582460 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a3b17a57-de27-40d1-b21c-2d7251681f4d tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:40.584884 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a3b17a57-de27-40d1-b21c-2d7251681f4d tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:40.585553 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a3b17a57-de27-40d1-b21c-2d7251681f4d tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:40.683885 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-04523d3d-83f9-475d-99f1-38428ac0a657 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11980041918484990dac709544d0b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c43f2b70bc74a48b62fb4115337f073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:40.708424 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-04523d3d-83f9-475d-99f1-38428ac0a657 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/servers/2cea388e-a568-48be-9f76-b673509a7824" status: 200 len: 1307 microversion: 2.1 time: 1.163531 Sep 23 04:43:40.711149 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1501/2972] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:39 2022] GET /compute/v2.1/servers/2cea388e-a568-48be-9f76-b673509a7824 => generated 1307 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:43:40.780509 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a3b17a57-de27-40d1-b21c-2d7251681f4d tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18998e15712495b83c222edc234349e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5691a27f143eda1faf12fbbd9696c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:40.797211 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a3b17a57-de27-40d1-b21c-2d7251681f4d tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] 10.222.0.33 "GET /compute/v2.1/servers/bcdc202d-96f2-4640-8e81-f786d5e15793" status: 200 len: 1275 microversion: 2.1 time: 0.277975 Sep 23 04:43:40.810809 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1472/2973] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:40 2022] GET /compute/v2.1/servers/bcdc202d-96f2-4640-8e81-f786d5e15793 => generated 1275 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:43:41.159586 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-afc0d065-58df-4618-8e04-b159f92a469d tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:41.159586 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-afc0d065-58df-4618-8e04-b159f92a469d tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] [instance: 53745879-9973-4217-b1c5-b45f917db80e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:41.169475 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-afc0d065-58df-4618-8e04-b159f92a469d tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:41.175369 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-afc0d065-58df-4618-8e04-b159f92a469d tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:41.176612 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-afc0d065-58df-4618-8e04-b159f92a469d tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:41.186409 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-afc0d065-58df-4618-8e04-b159f92a469d tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:41.186929 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-afc0d065-58df-4618-8e04-b159f92a469d tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:41.191861 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-afc0d065-58df-4618-8e04-b159f92a469d tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:41.236727 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-afc0d065-58df-4618-8e04-b159f92a469d tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] HTTP exception thrown: Instance 53745879-9973-4217-b1c5-b45f917db80e could not be found. Sep 23 04:43:41.242799 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-afc0d065-58df-4618-8e04-b159f92a469d tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Request method failure captured: Sep 23 04:43:41.242799 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e HTTP/1.1 Sep 23 04:43:41.242799 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:43:41.242799 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:43:41.242799 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:43:41.242799 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:43:41.242799 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:43:41.242799 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:43:41.242799 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:43:41.242799 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:43:41.242799 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTei-zMAV2Riq9maPSimi_17Crj2SyHKz0T3x8ro5so93kwJLlDk8p9v7yY8AHCSaYZoC-i2B8W1vSjbP_YFyBQMdjHsjASEYXcFymEvoavlKmV7DaBuBwYSL_bHi8jdya2BCEmlsdJzxzRdNlLS9x2-l4-BuYCy2Vd-I79AdVtADP0 Sep 23 04:43:41.242799 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:43:41.242799 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:43:41.242799 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:43:41.242799 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:43:41.242799 n-d-846463-3 devstack@n-api.service[122699]: X-Openstack-Nova-Api-Version: 2.42 Sep 23 04:43:41.242799 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:43:41.242799 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:43:41.242799 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 9c853e6ab59d45c084f6f7349f3ef87c Sep 23 04:43:41.242799 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-2026340842 Sep 23 04:43:41.242799 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:43:41.242799 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:43:41.242799 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9c853e6ab59d45c084f6f7349f3ef87c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9c853e6ab59d45c084f6f7349f3ef87c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9c853e6ab59d45c084f6f7349f3ef87c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9c853e6ab59d45c084f6f7349f3ef87c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:43:41.242799 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-TaggedBootDevicesTest_v242-2026340842 Sep 23 04:43:41.242799 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 9c853e6ab59d45c084f6f7349f3ef87c Sep 23 04:43:41.242799 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-2026340842 Sep 23 04:43:41.242799 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-TaggedBootDevicesTest_v242-2026340842-project Sep 23 04:43:41.242799 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:43:41.242799 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:43:41.242799 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 99d8fe44ad7c412d8629159f7529ba81 Sep 23 04:43:41.242799 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-TaggedBootDevicesTest_v242-2026340842-project Sep 23 04:43:41.242799 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:43:41.242799 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 53745879-9973-4217-b1c5-b45f917db80e could not be found. Sep 23 04:43:41.242799 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '53745879-9973-4217-b1c5-b45f917db80e'} Sep 23 04:43:41.242799 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:43:41.242799 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:43:41.242799 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:43:41.242799 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:43:41.242799 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:43:41.242799 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:43:41.242799 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:43:41.242799 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:43:41.242799 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:43:41.242799 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:43:41.242799 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53745879-9973-4217-b1c5-b45f917db80e could not be found. Sep 23 04:43:41.242799 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:43:41.242799 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:43:41.242799 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:43:41.242799 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:43:41.242799 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:43:41.242799 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:43:41.242799 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:43:41.242799 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:43:41.242799 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:43:41.242799 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:43:41.242799 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:43:41.242799 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:43:41.242799 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:43:41.242799 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:43:41.242799 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:43:41.242799 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:43:41.242799 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53745879-9973-4217-b1c5-b45f917db80e could not be found. Sep 23 04:43:41.242799 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:43:41.242799 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:43:41.249426 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:43:41.249426 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:43:41.249426 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:43:41.249426 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:43:41.249426 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:43:41.249426 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:43:41.249426 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53745879-9973-4217-b1c5-b45f917db80e could not be found. Sep 23 04:43:41.249426 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:43:41.253114 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-afc0d065-58df-4618-8e04-b159f92a469d tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Returning 404 to user: Instance 53745879-9973-4217-b1c5-b45f917db80e could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:43:41.259683 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-afc0d065-58df-4618-8e04-b159f92a469d tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] 10.222.0.33 "GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e" status: 404 len: 111 microversion: 2.42 time: 0.110677 Sep 23 04:43:41.266225 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1502/2974] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:43:41 2022] GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 23 04:43:41.272489 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b90e435c-5e42-4b7f-8ef8-643edf585f02 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Calling method '.version_select at 0x7ff1bba92dc0>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:41.440736 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b90e435c-5e42-4b7f-8ef8-643edf585f02 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2111355749" status: 204 len: 0 microversion: 2.42 time: 0.173647 Sep 23 04:43:41.450990 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1473/2975] 10.222.0.33 () {60 vars in 1262 bytes} [Fri Sep 23 04:43:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2111355749 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 23 04:43:41.530760 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0882f60a-e650-4a63-b155-b491b5e83903 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:41.532069 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-0882f60a-e650-4a63-b155-b491b5e83903 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 2170ccef-31bf-4166-b5cb-e07cd521e20c] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:41.541718 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0882f60a-e650-4a63-b155-b491b5e83903 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:41.542509 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0882f60a-e650-4a63-b155-b491b5e83903 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:41.543118 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0882f60a-e650-4a63-b155-b491b5e83903 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:41.544696 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0882f60a-e650-4a63-b155-b491b5e83903 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:41.554616 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0882f60a-e650-4a63-b155-b491b5e83903 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:41.555375 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0882f60a-e650-4a63-b155-b491b5e83903 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:41.740943 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-fc1983fb-4a2b-4129-a1b7-b8eb22ba7b04 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:41.744577 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-fc1983fb-4a2b-4129-a1b7-b8eb22ba7b04 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] [instance: 2cea388e-a568-48be-9f76-b673509a7824] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:41.763178 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fc1983fb-4a2b-4129-a1b7-b8eb22ba7b04 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:41.764014 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fc1983fb-4a2b-4129-a1b7-b8eb22ba7b04 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:41.764492 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fc1983fb-4a2b-4129-a1b7-b8eb22ba7b04 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:41.765699 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fc1983fb-4a2b-4129-a1b7-b8eb22ba7b04 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:41.766202 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fc1983fb-4a2b-4129-a1b7-b8eb22ba7b04 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:41.766642 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fc1983fb-4a2b-4129-a1b7-b8eb22ba7b04 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:42.293991 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-0882f60a-e650-4a63-b155-b491b5e83903 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:42.307130 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0882f60a-e650-4a63-b155-b491b5e83903 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/2170ccef-31bf-4166-b5cb-e07cd521e20c" status: 200 len: 1320 microversion: 2.1 time: 0.777333 Sep 23 04:43:42.308388 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1503/2976] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:41 2022] GET /compute/v2.1/servers/2170ccef-31bf-4166-b5cb-e07cd521e20c => generated 1320 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:43:42.316233 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-fc108925-6213-4ae2-8f6e-62627a3c39b0 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:42.319821 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-fc108925-6213-4ae2-8f6e-62627a3c39b0 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] [instance: bcdc202d-96f2-4640-8e81-f786d5e15793] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:42.338080 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fc108925-6213-4ae2-8f6e-62627a3c39b0 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:42.338790 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fc108925-6213-4ae2-8f6e-62627a3c39b0 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:42.341964 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fc108925-6213-4ae2-8f6e-62627a3c39b0 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:42.342997 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fc108925-6213-4ae2-8f6e-62627a3c39b0 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:42.343218 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-fc1983fb-4a2b-4129-a1b7-b8eb22ba7b04 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11980041918484990dac709544d0b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c43f2b70bc74a48b62fb4115337f073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:42.343893 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fc108925-6213-4ae2-8f6e-62627a3c39b0 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:42.344818 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fc108925-6213-4ae2-8f6e-62627a3c39b0 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:42.351580 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-fc1983fb-4a2b-4129-a1b7-b8eb22ba7b04 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/servers/2cea388e-a568-48be-9f76-b673509a7824" status: 200 len: 1307 microversion: 2.1 time: 0.616261 Sep 23 04:43:42.359239 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1474/2977] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:41 2022] GET /compute/v2.1/servers/2cea388e-a568-48be-9f76-b673509a7824 => generated 1307 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:43:42.489737 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-fc108925-6213-4ae2-8f6e-62627a3c39b0 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18998e15712495b83c222edc234349e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5691a27f143eda1faf12fbbd9696c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:42.501699 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-fc108925-6213-4ae2-8f6e-62627a3c39b0 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] 10.222.0.33 "GET /compute/v2.1/servers/bcdc202d-96f2-4640-8e81-f786d5e15793" status: 200 len: 1275 microversion: 2.1 time: 0.190160 Sep 23 04:43:42.502348 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1504/2978] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:42 2022] GET /compute/v2.1/servers/bcdc202d-96f2-4640-8e81-f786d5e15793 => generated 1275 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:43:43.338554 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6f1f1406-e97b-4c5a-af8e-c9868b164b72 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:43.339180 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-6f1f1406-e97b-4c5a-af8e-c9868b164b72 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 2170ccef-31bf-4166-b5cb-e07cd521e20c] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:43.343682 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-fd2a9fc3-1627-4928-8071-aa8e8dbb7e36 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-965774800", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "networks": [{"uuid": "0ed68e85-afb0-4ed7-b6fd-f4aa74bc7d6d"}]}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:43:43.368402 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6f1f1406-e97b-4c5a-af8e-c9868b164b72 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:43.368923 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6f1f1406-e97b-4c5a-af8e-c9868b164b72 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:43.369459 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6f1f1406-e97b-4c5a-af8e-c9868b164b72 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:43.374958 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6f1f1406-e97b-4c5a-af8e-c9868b164b72 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:43.375625 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6f1f1406-e97b-4c5a-af8e-c9868b164b72 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:43.376074 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6f1f1406-e97b-4c5a-af8e-c9868b164b72 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:43.455801 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.network.neutron [None req-fd2a9fc3-1627-4928-8071-aa8e8dbb7e36 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] validate_networks() for [('0ed68e85-afb0-4ed7-b6fd-f4aa74bc7d6d', None, None, None, None, None)] {{(pid=122698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:43:43.705941 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=4 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:43:43.777440 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=14 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:43:44.424294 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-6f1f1406-e97b-4c5a-af8e-c9868b164b72 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:44.437838 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6f1f1406-e97b-4c5a-af8e-c9868b164b72 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/2170ccef-31bf-4166-b5cb-e07cd521e20c" status: 200 len: 1320 microversion: 2.1 time: 1.105860 Sep 23 04:43:44.438471 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1505/2979] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:43 2022] GET /compute/v2.1/servers/2170ccef-31bf-4166-b5cb-e07cd521e20c => generated 1320 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:43:44.457688 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-70298c9d-17dc-4647-9fa8-7002c79066ca tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:44.471678 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-70298c9d-17dc-4647-9fa8-7002c79066ca tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] [instance: 2cea388e-a568-48be-9f76-b673509a7824] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:44.477709 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-70298c9d-17dc-4647-9fa8-7002c79066ca tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:44.478684 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-70298c9d-17dc-4647-9fa8-7002c79066ca tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:44.479299 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-70298c9d-17dc-4647-9fa8-7002c79066ca tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:44.480198 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-70298c9d-17dc-4647-9fa8-7002c79066ca tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:44.480854 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-70298c9d-17dc-4647-9fa8-7002c79066ca tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:44.481502 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-70298c9d-17dc-4647-9fa8-7002c79066ca tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:45.202278 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=4 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:43:45.617135 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-70298c9d-17dc-4647-9fa8-7002c79066ca tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11980041918484990dac709544d0b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c43f2b70bc74a48b62fb4115337f073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:45.632043 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-70298c9d-17dc-4647-9fa8-7002c79066ca tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/servers/2cea388e-a568-48be-9f76-b673509a7824" status: 200 len: 1307 microversion: 2.1 time: 1.189076 Sep 23 04:43:45.633564 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1506/2980] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:44 2022] GET /compute/v2.1/servers/2cea388e-a568-48be-9f76-b673509a7824 => generated 1307 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:43:45.645783 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2a1a2882-7872-479b-a45d-3618750f04f1 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:45.648238 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-2a1a2882-7872-479b-a45d-3618750f04f1 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] [instance: bcdc202d-96f2-4640-8e81-f786d5e15793] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:45.660093 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2a1a2882-7872-479b-a45d-3618750f04f1 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:45.662810 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2a1a2882-7872-479b-a45d-3618750f04f1 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:45.663502 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2a1a2882-7872-479b-a45d-3618750f04f1 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:45.666982 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2a1a2882-7872-479b-a45d-3618750f04f1 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:45.667702 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2a1a2882-7872-479b-a45d-3618750f04f1 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:45.672433 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2a1a2882-7872-479b-a45d-3618750f04f1 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:46.201406 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-fd2a9fc3-1627-4928-8071-aa8e8dbb7e36 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Flavor limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:43:46.202578 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-fd2a9fc3-1627-4928-8071-aa8e8dbb7e36 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Image limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:43:46.203392 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-fd2a9fc3-1627-4928-8071-aa8e8dbb7e36 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Flavor pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:43:46.204245 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-fd2a9fc3-1627-4928-8071-aa8e8dbb7e36 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Image pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:43:46.205313 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-fd2a9fc3-1627-4928-8071-aa8e8dbb7e36 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:43:46.220534 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fd2a9fc3-1627-4928-8071-aa8e8dbb7e36 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:46.222416 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fd2a9fc3-1627-4928-8071-aa8e8dbb7e36 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:46.223713 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fd2a9fc3-1627-4928-8071-aa8e8dbb7e36 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:46.225366 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fd2a9fc3-1627-4928-8071-aa8e8dbb7e36 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:46.226391 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fd2a9fc3-1627-4928-8071-aa8e8dbb7e36 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:46.228165 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fd2a9fc3-1627-4928-8071-aa8e8dbb7e36 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:46.267939 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-fd2a9fc3-1627-4928-8071-aa8e8dbb7e36 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Getting quotas for project 42090b82fbf8462eb96c0e69210aa460. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:43:46.276232 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-fd2a9fc3-1627-4928-8071-aa8e8dbb7e36 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Getting quotas for user 0d2d38f8f2244a81bf0935a121f039fe and project 42090b82fbf8462eb96c0e69210aa460. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:43:46.313224 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-fd2a9fc3-1627-4928-8071-aa8e8dbb7e36 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Going to run 1 instances... {{(pid=122698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:43:46.317447 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-fd2a9fc3-1627-4928-8071-aa8e8dbb7e36 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] [instance: dc73bb47-24fc-4b26-a371-c9cb0719748b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:43:46.368528 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2a1a2882-7872-479b-a45d-3618750f04f1 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18998e15712495b83c222edc234349e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5691a27f143eda1faf12fbbd9696c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:46.379442 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2a1a2882-7872-479b-a45d-3618750f04f1 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] 10.222.0.33 "GET /compute/v2.1/servers/bcdc202d-96f2-4640-8e81-f786d5e15793" status: 200 len: 1317 microversion: 2.1 time: 0.744281 Sep 23 04:43:46.380793 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1507/2981] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:45 2022] GET /compute/v2.1/servers/bcdc202d-96f2-4640-8e81-f786d5e15793 => generated 1317 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:43:46.386894 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-9d178187-6817-426d-a1de-b1cd067cfd29 req-bd774ba4-2af2-41ed-932a-6daad89e4e26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2cea388e-a568-48be-9f76-b673509a7824", "tag": "74832ded-447e-411f-ad28-f9a01aaa0cba"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:43:46.400065 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-9d178187-6817-426d-a1de-b1cd067cfd29 req-bd774ba4-2af2-41ed-932a-6daad89e4e26 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:46.401237 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-9d178187-6817-426d-a1de-b1cd067cfd29 req-bd774ba4-2af2-41ed-932a-6daad89e4e26 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:46.402020 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-9d178187-6817-426d-a1de-b1cd067cfd29 req-bd774ba4-2af2-41ed-932a-6daad89e4e26 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:46.420021 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-9d178187-6817-426d-a1de-b1cd067cfd29 req-bd774ba4-2af2-41ed-932a-6daad89e4e26 service nova] Creating event network-changed:74832ded-447e-411f-ad28-f9a01aaa0cba for instance 2cea388e-a568-48be-9f76-b673509a7824 on n-h1-846463-3 Sep 23 04:43:46.429008 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-9d178187-6817-426d-a1de-b1cd067cfd29 req-bd774ba4-2af2-41ed-932a-6daad89e4e26 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046412 Sep 23 04:43:46.430666 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1508/2982] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:43:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:43:46.454472 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8a3cdd53-73bd-4125-9a5c-72132e2aac11 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:46.464488 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-8a3cdd53-73bd-4125-9a5c-72132e2aac11 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 2170ccef-31bf-4166-b5cb-e07cd521e20c] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:46.474886 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8a3cdd53-73bd-4125-9a5c-72132e2aac11 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:46.475760 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8a3cdd53-73bd-4125-9a5c-72132e2aac11 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:46.476474 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8a3cdd53-73bd-4125-9a5c-72132e2aac11 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:46.478456 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8a3cdd53-73bd-4125-9a5c-72132e2aac11 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:46.479412 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8a3cdd53-73bd-4125-9a5c-72132e2aac11 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:46.480084 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8a3cdd53-73bd-4125-9a5c-72132e2aac11 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:46.483191 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-fd2a9fc3-1627-4928-8071-aa8e8dbb7e36 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.355267 Sep 23 04:43:46.489346 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1475/2983] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:43:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 3359 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:43:46.510897 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-59dcb7db-c280-4e6e-9c4e-c03c353f2337 req-75a6c295-f6f8-48d7-8537-26379f45bea0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2170ccef-31bf-4166-b5cb-e07cd521e20c", "tag": "1f0381ba-d366-4464-a229-d69baa62dd73"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:43:46.552886 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-59dcb7db-c280-4e6e-9c4e-c03c353f2337 req-75a6c295-f6f8-48d7-8537-26379f45bea0 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:46.554337 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-59dcb7db-c280-4e6e-9c4e-c03c353f2337 req-75a6c295-f6f8-48d7-8537-26379f45bea0 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:46.556940 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-59dcb7db-c280-4e6e-9c4e-c03c353f2337 req-75a6c295-f6f8-48d7-8537-26379f45bea0 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:46.580856 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-59dcb7db-c280-4e6e-9c4e-c03c353f2337 req-75a6c295-f6f8-48d7-8537-26379f45bea0 service nova] Creating event network-changed:1f0381ba-d366-4464-a229-d69baa62dd73 for instance 2170ccef-31bf-4166-b5cb-e07cd521e20c on n-h2-846463-3 Sep 23 04:43:46.597285 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-59dcb7db-c280-4e6e-9c4e-c03c353f2337 req-75a6c295-f6f8-48d7-8537-26379f45bea0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103155 Sep 23 04:43:46.599255 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1476/2984] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:43:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:43:46.604633 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-282c075c-6e07-45f6-8fa2-ad8af2afab54 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:46.608911 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-282c075c-6e07-45f6-8fa2-ad8af2afab54 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] [instance: dc73bb47-24fc-4b26-a371-c9cb0719748b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:46.617931 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=9,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:43:46.788701 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-282c075c-6e07-45f6-8fa2-ad8af2afab54 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2d38f8f2244a81bf0935a121f039fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42090b82fbf8462eb96c0e69210aa460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:46.805967 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-282c075c-6e07-45f6-8fa2-ad8af2afab54 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] 10.222.0.33 "GET /compute/v2.1/servers/dc73bb47-24fc-4b26-a371-c9cb0719748b" status: 200 len: 1224 microversion: 2.1 time: 0.205173 Sep 23 04:43:46.806663 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1477/2985] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:46 2022] GET /compute/v2.1/servers/dc73bb47-24fc-4b26-a371-c9cb0719748b => generated 1224 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:43:46.811299 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-26135c83-b78b-4e48-a225-f1412fc9bb02 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:46.812103 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-26135c83-b78b-4e48-a225-f1412fc9bb02 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] [instance: 2cea388e-a568-48be-9f76-b673509a7824] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:46.828108 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-26135c83-b78b-4e48-a225-f1412fc9bb02 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:46.828792 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-26135c83-b78b-4e48-a225-f1412fc9bb02 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:46.829412 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-26135c83-b78b-4e48-a225-f1412fc9bb02 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:46.830358 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-26135c83-b78b-4e48-a225-f1412fc9bb02 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:46.830976 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-26135c83-b78b-4e48-a225-f1412fc9bb02 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:46.831564 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-26135c83-b78b-4e48-a225-f1412fc9bb02 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:46.862020 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-8a3cdd53-73bd-4125-9a5c-72132e2aac11 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:46.871884 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-8a3cdd53-73bd-4125-9a5c-72132e2aac11 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/2170ccef-31bf-4166-b5cb-e07cd521e20c" status: 200 len: 1320 microversion: 2.1 time: 0.437616 Sep 23 04:43:46.878054 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1509/2986] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:46 2022] GET /compute/v2.1/servers/2170ccef-31bf-4166-b5cb-e07cd521e20c => generated 1320 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:43:47.404131 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-fe72bb54-3f5e-4b4c-a328-813edb2f16aa tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:47.404757 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-fe72bb54-3f5e-4b4c-a328-813edb2f16aa tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] [instance: bcdc202d-96f2-4640-8e81-f786d5e15793] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:47.408305 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=6 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:43:47.418595 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fe72bb54-3f5e-4b4c-a328-813edb2f16aa tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:47.419109 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fe72bb54-3f5e-4b4c-a328-813edb2f16aa tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:47.419558 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fe72bb54-3f5e-4b4c-a328-813edb2f16aa tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:47.420291 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fe72bb54-3f5e-4b4c-a328-813edb2f16aa tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:47.420759 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fe72bb54-3f5e-4b4c-a328-813edb2f16aa tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:47.421194 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fe72bb54-3f5e-4b4c-a328-813edb2f16aa tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:47.562653 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=20 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:43:47.859369 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-26135c83-b78b-4e48-a225-f1412fc9bb02 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11980041918484990dac709544d0b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c43f2b70bc74a48b62fb4115337f073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:47.868473 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:43:47.895148 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-26135c83-b78b-4e48-a225-f1412fc9bb02 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/servers/2cea388e-a568-48be-9f76-b673509a7824" status: 200 len: 1307 microversion: 2.1 time: 1.083055 Sep 23 04:43:47.911060 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1478/2987] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:46 2022] GET /compute/v2.1/servers/2cea388e-a568-48be-9f76-b673509a7824 => generated 1307 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:43:47.911060 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-dab17584-1dfb-41c1-be1c-b727e2379869 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:47.911060 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-dab17584-1dfb-41c1-be1c-b727e2379869 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] [instance: dc73bb47-24fc-4b26-a371-c9cb0719748b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:48.062074 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-dab17584-1dfb-41c1-be1c-b727e2379869 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2d38f8f2244a81bf0935a121f039fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42090b82fbf8462eb96c0e69210aa460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:48.083243 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-dab17584-1dfb-41c1-be1c-b727e2379869 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] 10.222.0.33 "GET /compute/v2.1/servers/dc73bb47-24fc-4b26-a371-c9cb0719748b" status: 200 len: 1224 microversion: 2.1 time: 0.186076 Sep 23 04:43:48.088448 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1479/2988] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:47 2022] GET /compute/v2.1/servers/dc73bb47-24fc-4b26-a371-c9cb0719748b => generated 1224 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:43:48.110366 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0efe0c38-1def-4bf5-86ad-91c451efe9b6 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:48.111410 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-0efe0c38-1def-4bf5-86ad-91c451efe9b6 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 2170ccef-31bf-4166-b5cb-e07cd521e20c] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:48.118763 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0efe0c38-1def-4bf5-86ad-91c451efe9b6 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:48.119678 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0efe0c38-1def-4bf5-86ad-91c451efe9b6 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:48.120315 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0efe0c38-1def-4bf5-86ad-91c451efe9b6 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:48.121304 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0efe0c38-1def-4bf5-86ad-91c451efe9b6 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:48.122048 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0efe0c38-1def-4bf5-86ad-91c451efe9b6 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:48.122672 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0efe0c38-1def-4bf5-86ad-91c451efe9b6 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:48.382013 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-fe72bb54-3f5e-4b4c-a328-813edb2f16aa tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18998e15712495b83c222edc234349e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5691a27f143eda1faf12fbbd9696c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:48.392189 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-fe72bb54-3f5e-4b4c-a328-813edb2f16aa tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] 10.222.0.33 "GET /compute/v2.1/servers/bcdc202d-96f2-4640-8e81-f786d5e15793" status: 200 len: 1317 microversion: 2.1 time: 0.991771 Sep 23 04:43:48.407590 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1510/2989] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:47 2022] GET /compute/v2.1/servers/bcdc202d-96f2-4640-8e81-f786d5e15793 => generated 1317 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:43:48.484977 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-0efe0c38-1def-4bf5-86ad-91c451efe9b6 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:48.516314 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-f767ec24-ec78-41cc-9ece-0227ee6f7d4d req-b543d643-c2e9-429e-a7f8-e3ae37878019 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bcdc202d-96f2-4640-8e81-f786d5e15793", "tag": "ddea8eb8-0e1d-414f-9d9f-d8a108d70e38"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:43:48.520853 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0efe0c38-1def-4bf5-86ad-91c451efe9b6 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/2170ccef-31bf-4166-b5cb-e07cd521e20c" status: 200 len: 1320 microversion: 2.1 time: 0.416500 Sep 23 04:43:48.525360 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1480/2990] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:48 2022] GET /compute/v2.1/servers/2170ccef-31bf-4166-b5cb-e07cd521e20c => generated 1320 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:43:48.567916 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-f767ec24-ec78-41cc-9ece-0227ee6f7d4d req-b543d643-c2e9-429e-a7f8-e3ae37878019 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:48.568826 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-f767ec24-ec78-41cc-9ece-0227ee6f7d4d req-b543d643-c2e9-429e-a7f8-e3ae37878019 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:48.570077 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-f767ec24-ec78-41cc-9ece-0227ee6f7d4d req-b543d643-c2e9-429e-a7f8-e3ae37878019 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:48.589695 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-f767ec24-ec78-41cc-9ece-0227ee6f7d4d req-b543d643-c2e9-429e-a7f8-e3ae37878019 service nova] Creating event network-changed:ddea8eb8-0e1d-414f-9d9f-d8a108d70e38 for instance bcdc202d-96f2-4640-8e81-f786d5e15793 on n-h2-846463-3 Sep 23 04:43:48.599514 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-f767ec24-ec78-41cc-9ece-0227ee6f7d4d req-b543d643-c2e9-429e-a7f8-e3ae37878019 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108400 Sep 23 04:43:48.601596 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1511/2991] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:43:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:43:48.924177 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ff27d066-cf91-4af3-a356-a58496c3ee4a tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:48.924812 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-ff27d066-cf91-4af3-a356-a58496c3ee4a tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] [instance: 2cea388e-a568-48be-9f76-b673509a7824] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:48.932549 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ff27d066-cf91-4af3-a356-a58496c3ee4a tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:48.933142 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ff27d066-cf91-4af3-a356-a58496c3ee4a tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:48.933585 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ff27d066-cf91-4af3-a356-a58496c3ee4a tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:48.934388 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ff27d066-cf91-4af3-a356-a58496c3ee4a tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:48.934934 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ff27d066-cf91-4af3-a356-a58496c3ee4a tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:48.935365 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ff27d066-cf91-4af3-a356-a58496c3ee4a tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:49.117332 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d7b630b3-4df0-4c43-b97d-2d9155a4263f tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:49.118258 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d7b630b3-4df0-4c43-b97d-2d9155a4263f tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] [instance: dc73bb47-24fc-4b26-a371-c9cb0719748b] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:49.125361 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d7b630b3-4df0-4c43-b97d-2d9155a4263f tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:49.125866 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d7b630b3-4df0-4c43-b97d-2d9155a4263f tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:49.129467 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d7b630b3-4df0-4c43-b97d-2d9155a4263f tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:49.129467 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d7b630b3-4df0-4c43-b97d-2d9155a4263f tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:49.129467 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d7b630b3-4df0-4c43-b97d-2d9155a4263f tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:49.129467 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d7b630b3-4df0-4c43-b97d-2d9155a4263f tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:49.347055 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d7b630b3-4df0-4c43-b97d-2d9155a4263f tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2d38f8f2244a81bf0935a121f039fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42090b82fbf8462eb96c0e69210aa460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:49.369293 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d7b630b3-4df0-4c43-b97d-2d9155a4263f tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] 10.222.0.33 "GET /compute/v2.1/servers/dc73bb47-24fc-4b26-a371-c9cb0719748b" status: 200 len: 1276 microversion: 2.1 time: 0.255872 Sep 23 04:43:49.372554 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1512/2992] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:49 2022] GET /compute/v2.1/servers/dc73bb47-24fc-4b26-a371-c9cb0719748b => generated 1276 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:43:49.424753 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-25f7909d-6a90-493c-a7df-11f75ddcae27 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:49.427378 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-25f7909d-6a90-493c-a7df-11f75ddcae27 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] [instance: bcdc202d-96f2-4640-8e81-f786d5e15793] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:49.438855 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-25f7909d-6a90-493c-a7df-11f75ddcae27 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:49.439648 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-25f7909d-6a90-493c-a7df-11f75ddcae27 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:49.440396 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-25f7909d-6a90-493c-a7df-11f75ddcae27 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:49.441881 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-25f7909d-6a90-493c-a7df-11f75ddcae27 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:49.442661 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-25f7909d-6a90-493c-a7df-11f75ddcae27 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:49.443316 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-25f7909d-6a90-493c-a7df-11f75ddcae27 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:49.539838 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ff27d066-cf91-4af3-a356-a58496c3ee4a tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11980041918484990dac709544d0b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c43f2b70bc74a48b62fb4115337f073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:49.558653 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ff27d066-cf91-4af3-a356-a58496c3ee4a tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/servers/2cea388e-a568-48be-9f76-b673509a7824" status: 200 len: 1307 microversion: 2.1 time: 0.638539 Sep 23 04:43:49.567854 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1481/2993] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:48 2022] GET /compute/v2.1/servers/2cea388e-a568-48be-9f76-b673509a7824 => generated 1307 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:43:49.582769 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-300dccb5-ee73-49da-be6a-46745985459b tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:49.582769 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-300dccb5-ee73-49da-be6a-46745985459b tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 2170ccef-31bf-4166-b5cb-e07cd521e20c] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:49.586581 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-300dccb5-ee73-49da-be6a-46745985459b tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:49.590393 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-300dccb5-ee73-49da-be6a-46745985459b tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:49.590956 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-300dccb5-ee73-49da-be6a-46745985459b tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:49.591766 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-300dccb5-ee73-49da-be6a-46745985459b tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:49.592356 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-300dccb5-ee73-49da-be6a-46745985459b tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:49.594295 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-300dccb5-ee73-49da-be6a-46745985459b tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:50.097057 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-25f7909d-6a90-493c-a7df-11f75ddcae27 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18998e15712495b83c222edc234349e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5691a27f143eda1faf12fbbd9696c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:50.100329 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=100 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:43:50.125644 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-25f7909d-6a90-493c-a7df-11f75ddcae27 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] 10.222.0.33 "GET /compute/v2.1/servers/bcdc202d-96f2-4640-8e81-f786d5e15793" status: 200 len: 1317 microversion: 2.1 time: 0.705037 Sep 23 04:43:50.127358 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1513/2994] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:49 2022] GET /compute/v2.1/servers/bcdc202d-96f2-4640-8e81-f786d5e15793 => generated 1317 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:43:50.144251 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-300dccb5-ee73-49da-be6a-46745985459b tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:50.153705 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-300dccb5-ee73-49da-be6a-46745985459b tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/2170ccef-31bf-4166-b5cb-e07cd521e20c" status: 200 len: 1320 microversion: 2.1 time: 0.584376 Sep 23 04:43:50.154333 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1482/2995] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:49 2022] GET /compute/v2.1/servers/2170ccef-31bf-4166-b5cb-e07cd521e20c => generated 1320 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:43:50.401418 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-60d306c5-60ac-40e4-b3ee-e1436727de27 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:50.402077 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-60d306c5-60ac-40e4-b3ee-e1436727de27 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] [instance: dc73bb47-24fc-4b26-a371-c9cb0719748b] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:50.408564 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-60d306c5-60ac-40e4-b3ee-e1436727de27 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:50.409403 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-60d306c5-60ac-40e4-b3ee-e1436727de27 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:50.410703 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-60d306c5-60ac-40e4-b3ee-e1436727de27 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:50.411690 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-60d306c5-60ac-40e4-b3ee-e1436727de27 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:50.412376 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-60d306c5-60ac-40e4-b3ee-e1436727de27 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:50.423723 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-60d306c5-60ac-40e4-b3ee-e1436727de27 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:50.592675 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-dbe490bd-e9e1-4d6c-b2d3-4d1063ef246b tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:50.596640 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-dbe490bd-e9e1-4d6c-b2d3-4d1063ef246b tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] [instance: 2cea388e-a568-48be-9f76-b673509a7824] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:50.618606 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dbe490bd-e9e1-4d6c-b2d3-4d1063ef246b tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:50.619582 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dbe490bd-e9e1-4d6c-b2d3-4d1063ef246b tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:50.620346 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dbe490bd-e9e1-4d6c-b2d3-4d1063ef246b tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:50.621599 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dbe490bd-e9e1-4d6c-b2d3-4d1063ef246b tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:50.624041 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dbe490bd-e9e1-4d6c-b2d3-4d1063ef246b tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:50.625064 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dbe490bd-e9e1-4d6c-b2d3-4d1063ef246b tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:50.652275 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-60d306c5-60ac-40e4-b3ee-e1436727de27 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2d38f8f2244a81bf0935a121f039fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42090b82fbf8462eb96c0e69210aa460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:50.666264 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-60d306c5-60ac-40e4-b3ee-e1436727de27 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] 10.222.0.33 "GET /compute/v2.1/servers/dc73bb47-24fc-4b26-a371-c9cb0719748b" status: 200 len: 1294 microversion: 2.1 time: 0.268601 Sep 23 04:43:50.667570 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1514/2996] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:50 2022] GET /compute/v2.1/servers/dc73bb47-24fc-4b26-a371-c9cb0719748b => generated 1294 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:43:51.160327 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c253f1e8-400e-4997-bcc2-376c4291cef4 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:51.161336 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c253f1e8-400e-4997-bcc2-376c4291cef4 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] [instance: bcdc202d-96f2-4640-8e81-f786d5e15793] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:51.194108 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c253f1e8-400e-4997-bcc2-376c4291cef4 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:51.194807 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c253f1e8-400e-4997-bcc2-376c4291cef4 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:51.195271 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c253f1e8-400e-4997-bcc2-376c4291cef4 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:51.196057 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c253f1e8-400e-4997-bcc2-376c4291cef4 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:51.196552 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c253f1e8-400e-4997-bcc2-376c4291cef4 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:51.206131 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c253f1e8-400e-4997-bcc2-376c4291cef4 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:51.962403 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-dbe490bd-e9e1-4d6c-b2d3-4d1063ef246b tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11980041918484990dac709544d0b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c43f2b70bc74a48b62fb4115337f073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:52.021267 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-dbe490bd-e9e1-4d6c-b2d3-4d1063ef246b tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/servers/2cea388e-a568-48be-9f76-b673509a7824" status: 200 len: 1307 microversion: 2.1 time: 1.424059 Sep 23 04:43:52.026733 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1483/2997] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:50 2022] GET /compute/v2.1/servers/2cea388e-a568-48be-9f76-b673509a7824 => generated 1307 bytes in 1441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:43:52.040000 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-79bcc2b2-a4d0-49be-a900-71b69e2bcb92 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:52.051213 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-79bcc2b2-a4d0-49be-a900-71b69e2bcb92 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 2170ccef-31bf-4166-b5cb-e07cd521e20c] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:52.079084 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-79bcc2b2-a4d0-49be-a900-71b69e2bcb92 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:52.084637 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-79bcc2b2-a4d0-49be-a900-71b69e2bcb92 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:52.090742 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-79bcc2b2-a4d0-49be-a900-71b69e2bcb92 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:52.094770 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-79bcc2b2-a4d0-49be-a900-71b69e2bcb92 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:52.095947 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-79bcc2b2-a4d0-49be-a900-71b69e2bcb92 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:52.097506 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-79bcc2b2-a4d0-49be-a900-71b69e2bcb92 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:52.146895 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c253f1e8-400e-4997-bcc2-376c4291cef4 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18998e15712495b83c222edc234349e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5691a27f143eda1faf12fbbd9696c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:52.159579 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c253f1e8-400e-4997-bcc2-376c4291cef4 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] 10.222.0.33 "GET /compute/v2.1/servers/bcdc202d-96f2-4640-8e81-f786d5e15793" status: 200 len: 1317 microversion: 2.1 time: 1.014153 Sep 23 04:43:52.175361 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1515/2998] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:51 2022] GET /compute/v2.1/servers/bcdc202d-96f2-4640-8e81-f786d5e15793 => generated 1317 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:43:52.183900 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-23b299ff-1b4d-498a-b33f-bff057538029 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:52.185497 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-23b299ff-1b4d-498a-b33f-bff057538029 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] [instance: dc73bb47-24fc-4b26-a371-c9cb0719748b] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:52.192598 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-23b299ff-1b4d-498a-b33f-bff057538029 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:52.193440 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-23b299ff-1b4d-498a-b33f-bff057538029 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:52.194213 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-23b299ff-1b4d-498a-b33f-bff057538029 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:52.195562 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-23b299ff-1b4d-498a-b33f-bff057538029 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:52.196287 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-23b299ff-1b4d-498a-b33f-bff057538029 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:52.197617 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-23b299ff-1b4d-498a-b33f-bff057538029 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:52.561119 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-23b299ff-1b4d-498a-b33f-bff057538029 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2d38f8f2244a81bf0935a121f039fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42090b82fbf8462eb96c0e69210aa460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:52.573857 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-23b299ff-1b4d-498a-b33f-bff057538029 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] 10.222.0.33 "GET /compute/v2.1/servers/dc73bb47-24fc-4b26-a371-c9cb0719748b" status: 200 len: 1324 microversion: 2.1 time: 0.396985 Sep 23 04:43:52.577500 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1516/2999] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:52 2022] GET /compute/v2.1/servers/dc73bb47-24fc-4b26-a371-c9cb0719748b => generated 1324 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:43:52.646928 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-79bcc2b2-a4d0-49be-a900-71b69e2bcb92 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:52.659582 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-79bcc2b2-a4d0-49be-a900-71b69e2bcb92 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/2170ccef-31bf-4166-b5cb-e07cd521e20c" status: 200 len: 1320 microversion: 2.1 time: 0.624799 Sep 23 04:43:52.682203 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1484/3000] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:52 2022] GET /compute/v2.1/servers/2170ccef-31bf-4166-b5cb-e07cd521e20c => generated 1320 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:43:52.844805 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-990e8413-7a3e-4076-8b62-f0f0e3959a26 req-7afb4098-3356-4268-9333-8c78b2580c9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cea388e-a568-48be-9f76-b673509a7824", "name": "network-vif-plugged", "status": "completed", "tag": "74832ded-447e-411f-ad28-f9a01aaa0cba"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:43:52.856354 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-990e8413-7a3e-4076-8b62-f0f0e3959a26 req-7afb4098-3356-4268-9333-8c78b2580c9e service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:52.857309 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-990e8413-7a3e-4076-8b62-f0f0e3959a26 req-7afb4098-3356-4268-9333-8c78b2580c9e service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:52.857976 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-990e8413-7a3e-4076-8b62-f0f0e3959a26 req-7afb4098-3356-4268-9333-8c78b2580c9e service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:52.875894 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-990e8413-7a3e-4076-8b62-f0f0e3959a26 req-7afb4098-3356-4268-9333-8c78b2580c9e service nova] Creating event network-vif-plugged:74832ded-447e-411f-ad28-f9a01aaa0cba for instance 2cea388e-a568-48be-9f76-b673509a7824 on n-h1-846463-3 Sep 23 04:43:52.883182 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-990e8413-7a3e-4076-8b62-f0f0e3959a26 req-7afb4098-3356-4268-9333-8c78b2580c9e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041543 Sep 23 04:43:52.884513 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1517/3001] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:43:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:43:53.049766 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-53d29706-9fab-49d3-8f46-33851b131527 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:53.051060 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-53d29706-9fab-49d3-8f46-33851b131527 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] [instance: 2cea388e-a568-48be-9f76-b673509a7824] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:53.070679 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-53d29706-9fab-49d3-8f46-33851b131527 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:53.071042 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-53d29706-9fab-49d3-8f46-33851b131527 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:53.073244 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-53d29706-9fab-49d3-8f46-33851b131527 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:53.078293 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-53d29706-9fab-49d3-8f46-33851b131527 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:53.078897 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-53d29706-9fab-49d3-8f46-33851b131527 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:53.079570 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-53d29706-9fab-49d3-8f46-33851b131527 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:53.195375 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d85af9eb-86d0-4eaa-8f10-0346da87d75c tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:53.198355 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d85af9eb-86d0-4eaa-8f10-0346da87d75c tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] [instance: bcdc202d-96f2-4640-8e81-f786d5e15793] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:53.214148 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d85af9eb-86d0-4eaa-8f10-0346da87d75c tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:53.217739 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d85af9eb-86d0-4eaa-8f10-0346da87d75c tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:53.219647 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d85af9eb-86d0-4eaa-8f10-0346da87d75c tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:53.222025 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d85af9eb-86d0-4eaa-8f10-0346da87d75c tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:53.223223 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d85af9eb-86d0-4eaa-8f10-0346da87d75c tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:53.226528 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d85af9eb-86d0-4eaa-8f10-0346da87d75c tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:53.968193 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d85af9eb-86d0-4eaa-8f10-0346da87d75c tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18998e15712495b83c222edc234349e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5691a27f143eda1faf12fbbd9696c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:53.982997 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d85af9eb-86d0-4eaa-8f10-0346da87d75c tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] 10.222.0.33 "GET /compute/v2.1/servers/bcdc202d-96f2-4640-8e81-f786d5e15793" status: 200 len: 1317 microversion: 2.1 time: 0.798174 Sep 23 04:43:53.983636 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1518/3002] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:53 2022] GET /compute/v2.1/servers/bcdc202d-96f2-4640-8e81-f786d5e15793 => generated 1317 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:43:54.129761 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-53d29706-9fab-49d3-8f46-33851b131527 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11980041918484990dac709544d0b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c43f2b70bc74a48b62fb4115337f073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:54.144981 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-53d29706-9fab-49d3-8f46-33851b131527 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/servers/2cea388e-a568-48be-9f76-b673509a7824" status: 200 len: 1307 microversion: 2.1 time: 1.099803 Sep 23 04:43:54.146005 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1485/3003] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:53 2022] GET /compute/v2.1/servers/2cea388e-a568-48be-9f76-b673509a7824 => generated 1307 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:43:54.153295 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f153980a-08e7-449a-bed4-6d550e987a49 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:54.158407 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f153980a-08e7-449a-bed4-6d550e987a49 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] [instance: dc73bb47-24fc-4b26-a371-c9cb0719748b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:54.170944 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f153980a-08e7-449a-bed4-6d550e987a49 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:54.172813 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f153980a-08e7-449a-bed4-6d550e987a49 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:54.175964 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f153980a-08e7-449a-bed4-6d550e987a49 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:54.176830 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f153980a-08e7-449a-bed4-6d550e987a49 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:54.177590 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f153980a-08e7-449a-bed4-6d550e987a49 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:54.179341 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f153980a-08e7-449a-bed4-6d550e987a49 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:54.193440 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c84e8308-422f-4f71-b5c2-2b4871b318ef tempest-VolumesAdminNegativeTest-1909562694 tempest-VolumesAdminNegativeTest-1909562694-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "62471458-e1d1-436b-9e2f-3e1f57347f40"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:43:54.196324 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c84e8308-422f-4f71-b5c2-2b4871b318ef tempest-VolumesAdminNegativeTest-1909562694 tempest-VolumesAdminNegativeTest-1909562694-project-admin] [instance: 48df7db9-a805-4c72-a1a5-29632b00248c] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:54.212449 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c84e8308-422f-4f71-b5c2-2b4871b318ef tempest-VolumesAdminNegativeTest-1909562694 tempest-VolumesAdminNegativeTest-1909562694-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:54.213316 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c84e8308-422f-4f71-b5c2-2b4871b318ef tempest-VolumesAdminNegativeTest-1909562694 tempest-VolumesAdminNegativeTest-1909562694-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:54.213775 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c84e8308-422f-4f71-b5c2-2b4871b318ef tempest-VolumesAdminNegativeTest-1909562694 tempest-VolumesAdminNegativeTest-1909562694-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:54.214852 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c84e8308-422f-4f71-b5c2-2b4871b318ef tempest-VolumesAdminNegativeTest-1909562694 tempest-VolumesAdminNegativeTest-1909562694-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:54.221409 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c84e8308-422f-4f71-b5c2-2b4871b318ef tempest-VolumesAdminNegativeTest-1909562694 tempest-VolumesAdminNegativeTest-1909562694-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:54.221880 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c84e8308-422f-4f71-b5c2-2b4871b318ef tempest-VolumesAdminNegativeTest-1909562694 tempest-VolumesAdminNegativeTest-1909562694-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:54.413928 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-c84e8308-422f-4f71-b5c2-2b4871b318ef tempest-VolumesAdminNegativeTest-1909562694 tempest-VolumesAdminNegativeTest-1909562694-project-admin] HTTP exception thrown: Volume 62471458-e1d1-436b-9e2f-3e1f57347f40 could not be found. Sep 23 04:43:54.433656 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c84e8308-422f-4f71-b5c2-2b4871b318ef tempest-VolumesAdminNegativeTest-1909562694 tempest-VolumesAdminNegativeTest-1909562694-project-admin] Request method failure captured: Sep 23 04:43:54.433656 n-d-846463-3 devstack@n-api.service[122699]: request: PUT /compute/v2.1/servers/48df7db9-a805-4c72-a1a5-29632b00248c/os-volume_attachments/ef22cf0c-ed0a-42a9-bef9-3ef5ea5f1ed4 HTTP/1.1 Sep 23 04:43:54.433656 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:43:54.433656 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:43:54.433656 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:43:54.433656 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 74 Sep 23 04:43:54.433656 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:43:54.433656 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:43:54.433656 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:43:54.433656 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:43:54.433656 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTky9s_1bzr8a7rEDhK_USJgh1gGjmUJRRsR9md_qP-cLm-umk6Uq_mUWIXO93fDaw1bcIALvapO9il-jO4LhU1AyxPTLcWclbfG4yLmF9c3ikV1mbv3rBI05Gs8oTxdq9AWbCf_zoGpR38EPlYyx3reiMWg2FfxAfPvA_bnEc3xeCw Sep 23 04:43:54.433656 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:43:54.433656 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:43:54.433656 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:43:54.433656 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:43:54.433656 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:43:54.433656 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:43:54.433656 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 435d134b3a224a61975ced67bdf49af0 Sep 23 04:43:54.433656 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-VolumesAdminNegativeTest-1909562694 Sep 23 04:43:54.433656 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,admin,member Sep 23 04:43:54.433656 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,admin,member Sep 23 04:43:54.433656 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_435d134b3a224a61975ced67bdf49af0", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/435d134b3a224a61975ced67bdf49af0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/435d134b3a224a61975ced67bdf49af0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/435d134b3a224a61975ced67bdf49af0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:43:54.433656 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-VolumesAdminNegativeTest-1909562694 Sep 23 04:43:54.433656 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 435d134b3a224a61975ced67bdf49af0 Sep 23 04:43:54.433656 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1909562694 Sep 23 04:43:54.433656 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-VolumesAdminNegativeTest-1909562694-project-admin Sep 23 04:43:54.433656 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:43:54.433656 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:43:54.433656 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 9c924672fbad4bd4bd018e2736ba3e22 Sep 23 04:43:54.433656 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-VolumesAdminNegativeTest-1909562694-project-admin Sep 23 04:43:54.433656 n-d-846463-3 devstack@n-api.service[122699]: Sep 23 04:43:54.433656 n-d-846463-3 devstack@n-api.service[122699]: {"volumeAttachment": {"volumeId": "62471458-e1d1-436b-9e2f-3e1f57347f40"}} Sep 23 04:43:54.433656 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:43:54.433656 n-d-846463-3 devstack@n-api.service[122699]: exception: Volume 62471458-e1d1-436b-9e2f-3e1f57347f40 could not be found. Sep 23 04:43:54.433656 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'server_id': '48df7db9-a805-4c72-a1a5-29632b00248c', 'id': 'ef22cf0c-ed0a-42a9-bef9-3ef5ea5f1ed4', 'body': {'volumeAttachment': {'volumeId': '62471458-e1d1-436b-9e2f-3e1f57347f40'}}} Sep 23 04:43:54.433656 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:43:54.433656 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:43:54.433656 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 23 04:43:54.433656 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 23 04:43:54.433656 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 23 04:43:54.433656 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 23 04:43:54.433656 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 23 04:43:54.433656 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 23 04:43:54.433656 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 23 04:43:54.433656 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 23 04:43:54.433656 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 23 04:43:54.433656 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 23 04:43:54.433656 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 23 04:43:54.433656 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 23 04:43:54.433656 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 23 04:43:54.433656 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 23 04:43:54.433656 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 62471458-e1d1-436b-9e2f-3e1f57347f40 could not be found. (HTTP 404) (Request-ID: req-a13bfed0-98d1-4673-b4d3-a10b84de6acd) Sep 23 04:43:54.433656 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:43:54.433656 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:43:54.433656 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:43:54.433656 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:43:54.433656 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Sep 23 04:43:54.433656 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Sep 23 04:43:54.433656 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 23 04:43:54.433656 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 23 04:43:54.433656 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 23 04:43:54.438875 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 23 04:43:54.438875 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 23 04:43:54.438875 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 23 04:43:54.438875 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 23 04:43:54.438875 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 23 04:43:54.438875 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 23 04:43:54.438875 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 23 04:43:54.438875 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 23 04:43:54.438875 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 23 04:43:54.438875 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 23 04:43:54.438875 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 23 04:43:54.438875 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 23 04:43:54.438875 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 23 04:43:54.438875 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 23 04:43:54.438875 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 23 04:43:54.438875 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 23 04:43:54.438875 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 23 04:43:54.438875 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 62471458-e1d1-436b-9e2f-3e1f57347f40 could not be found. Sep 23 04:43:54.438875 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:43:54.438875 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:43:54.438875 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:43:54.438875 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:43:54.438875 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:43:54.438875 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:43:54.438875 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:43:54.438875 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:43:54.438875 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:43:54.438875 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:43:54.438875 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:43:54.438875 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:43:54.438875 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:43:54.438875 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:43:54.438875 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Sep 23 04:43:54.438875 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Sep 23 04:43:54.438875 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Sep 23 04:43:54.438875 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 23 04:43:54.438875 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 62471458-e1d1-436b-9e2f-3e1f57347f40 could not be found. Sep 23 04:43:54.438875 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:43:54.438875 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:43:54.438875 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:43:54.438875 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:43:54.438875 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:43:54.438875 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:43:54.438875 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:43:54.438875 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:43:54.438875 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 62471458-e1d1-436b-9e2f-3e1f57347f40 could not be found. Sep 23 04:43:54.438875 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:43:54.445240 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c84e8308-422f-4f71-b5c2-2b4871b318ef tempest-VolumesAdminNegativeTest-1909562694 tempest-VolumesAdminNegativeTest-1909562694-project-admin] Returning 400 to user: Volume 62471458-e1d1-436b-9e2f-3e1f57347f40 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:43:54.448332 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c84e8308-422f-4f71-b5c2-2b4871b318ef tempest-VolumesAdminNegativeTest-1909562694 tempest-VolumesAdminNegativeTest-1909562694-project-admin] 10.222.0.33 "PUT /compute/v2.1/servers/48df7db9-a805-4c72-a1a5-29632b00248c/os-volume_attachments/ef22cf0c-ed0a-42a9-bef9-3ef5ea5f1ed4" status: 400 len: 107 microversion: 2.1 time: 0.457956 Sep 23 04:43:54.458619 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1519/3004] 10.222.0.33 () {60 vars in 1433 bytes} [Fri Sep 23 04:43:53 2022] PUT /compute/v2.1/servers/48df7db9-a805-4c72-a1a5-29632b00248c/os-volume_attachments/ef22cf0c-ed0a-42a9-bef9-3ef5ea5f1ed4 => generated 107 bytes in 474 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 04:43:54.466819 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ca1e2b68-8f2d-48cc-9ace-04503b152abe tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:54.467766 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ca1e2b68-8f2d-48cc-9ace-04503b152abe tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 2170ccef-31bf-4166-b5cb-e07cd521e20c] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:54.489667 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ca1e2b68-8f2d-48cc-9ace-04503b152abe tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:54.490753 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ca1e2b68-8f2d-48cc-9ace-04503b152abe tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:54.492173 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ca1e2b68-8f2d-48cc-9ace-04503b152abe tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:54.493136 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ca1e2b68-8f2d-48cc-9ace-04503b152abe tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:54.493830 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ca1e2b68-8f2d-48cc-9ace-04503b152abe tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:54.494509 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ca1e2b68-8f2d-48cc-9ace-04503b152abe tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:54.914209 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f153980a-08e7-449a-bed4-6d550e987a49 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2d38f8f2244a81bf0935a121f039fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42090b82fbf8462eb96c0e69210aa460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:54.922522 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f153980a-08e7-449a-bed4-6d550e987a49 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] 10.222.0.33 "GET /compute/v2.1/servers/dc73bb47-24fc-4b26-a371-c9cb0719748b" status: 200 len: 1324 microversion: 2.1 time: 0.774589 Sep 23 04:43:54.923308 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1486/3005] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:54 2022] GET /compute/v2.1/servers/dc73bb47-24fc-4b26-a371-c9cb0719748b => generated 1324 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:43:54.937954 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e487b258-4659-4fbf-90a9-84fd5926916d tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:54.938771 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e487b258-4659-4fbf-90a9-84fd5926916d tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] [instance: 48df7db9-a805-4c72-a1a5-29632b00248c] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:54.950292 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e487b258-4659-4fbf-90a9-84fd5926916d tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:54.952674 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e487b258-4659-4fbf-90a9-84fd5926916d tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:54.953142 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e487b258-4659-4fbf-90a9-84fd5926916d tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:54.953914 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e487b258-4659-4fbf-90a9-84fd5926916d tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:54.954423 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e487b258-4659-4fbf-90a9-84fd5926916d tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:54.954862 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e487b258-4659-4fbf-90a9-84fd5926916d tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:55.100957 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-e487b258-4659-4fbf-90a9-84fd5926916d tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lazy-loading 'services' on Instance uuid 48df7db9-a805-4c72-a1a5-29632b00248c {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:43:55.336494 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e487b258-4659-4fbf-90a9-84fd5926916d tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] 10.222.0.33 "DELETE /compute/v2.1/servers/48df7db9-a805-4c72-a1a5-29632b00248c/os-volume_attachments/ef22cf0c-ed0a-42a9-bef9-3ef5ea5f1ed4" status: 202 len: 0 microversion: 2.1 time: 0.411603 Sep 23 04:43:55.337826 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1487/3006] 10.222.0.33 () {58 vars in 1416 bytes} [Fri Sep 23 04:43:54 2022] DELETE /compute/v2.1/servers/48df7db9-a805-4c72-a1a5-29632b00248c/os-volume_attachments/ef22cf0c-ed0a-42a9-bef9-3ef5ea5f1ed4 => generated 0 bytes in 414 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:43:55.352372 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-50634b44-b2b6-4502-91d0-97248f5ca58f tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:55.353649 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-50634b44-b2b6-4502-91d0-97248f5ca58f tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] [instance: bcdc202d-96f2-4640-8e81-f786d5e15793] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:55.369105 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-50634b44-b2b6-4502-91d0-97248f5ca58f tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:55.370256 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-50634b44-b2b6-4502-91d0-97248f5ca58f tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:55.370876 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-50634b44-b2b6-4502-91d0-97248f5ca58f tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:55.371798 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-50634b44-b2b6-4502-91d0-97248f5ca58f tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:55.372435 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-50634b44-b2b6-4502-91d0-97248f5ca58f tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:55.373030 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-50634b44-b2b6-4502-91d0-97248f5ca58f tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:55.836088 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ca1e2b68-8f2d-48cc-9ace-04503b152abe tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:55.870968 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ca1e2b68-8f2d-48cc-9ace-04503b152abe tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/2170ccef-31bf-4166-b5cb-e07cd521e20c" status: 200 len: 1320 microversion: 2.1 time: 1.410822 Sep 23 04:43:55.896019 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1520/3007] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:54 2022] GET /compute/v2.1/servers/2170ccef-31bf-4166-b5cb-e07cd521e20c => generated 1320 bytes in 1437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:43:55.904836 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-45217295-5523-40cc-b323-2677a56764c3 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:55.906510 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-45217295-5523-40cc-b323-2677a56764c3 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] [instance: 2cea388e-a568-48be-9f76-b673509a7824] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:55.932838 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-45217295-5523-40cc-b323-2677a56764c3 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:55.932838 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-45217295-5523-40cc-b323-2677a56764c3 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:55.932838 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-45217295-5523-40cc-b323-2677a56764c3 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:55.932838 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-45217295-5523-40cc-b323-2677a56764c3 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:55.932838 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-45217295-5523-40cc-b323-2677a56764c3 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:55.932838 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-45217295-5523-40cc-b323-2677a56764c3 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:56.249562 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:43:56.434361 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-50634b44-b2b6-4502-91d0-97248f5ca58f tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18998e15712495b83c222edc234349e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5691a27f143eda1faf12fbbd9696c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:56.444488 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-50634b44-b2b6-4502-91d0-97248f5ca58f tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] 10.222.0.33 "GET /compute/v2.1/servers/bcdc202d-96f2-4640-8e81-f786d5e15793" status: 200 len: 1317 microversion: 2.1 time: 1.105195 Sep 23 04:43:56.449348 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1488/3008] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:55 2022] GET /compute/v2.1/servers/bcdc202d-96f2-4640-8e81-f786d5e15793 => generated 1317 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:43:56.462510 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c0d41f7a-42d7-4958-8fbd-055f16b0cb6a tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:56.470470 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c0d41f7a-42d7-4958-8fbd-055f16b0cb6a tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] [instance: 48df7db9-a805-4c72-a1a5-29632b00248c] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:56.476794 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-45217295-5523-40cc-b323-2677a56764c3 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11980041918484990dac709544d0b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c43f2b70bc74a48b62fb4115337f073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:56.484805 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-45217295-5523-40cc-b323-2677a56764c3 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/servers/2cea388e-a568-48be-9f76-b673509a7824" status: 200 len: 1486 microversion: 2.1 time: 0.587307 Sep 23 04:43:56.497983 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1521/3009] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:55 2022] GET /compute/v2.1/servers/2cea388e-a568-48be-9f76-b673509a7824 => generated 1486 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:43:56.498758 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c0d41f7a-42d7-4958-8fbd-055f16b0cb6a tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:56.498758 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c0d41f7a-42d7-4958-8fbd-055f16b0cb6a tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:56.498758 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c0d41f7a-42d7-4958-8fbd-055f16b0cb6a tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:56.498758 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c0d41f7a-42d7-4958-8fbd-055f16b0cb6a tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:56.498758 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c0d41f7a-42d7-4958-8fbd-055f16b0cb6a tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:56.498758 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c0d41f7a-42d7-4958-8fbd-055f16b0cb6a tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:56.506275 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-f8b7bc35-5031-477f-96e9-81eeeb84e616 req-996129bf-3bdb-46da-a7aa-16aa224f7b2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2170ccef-31bf-4166-b5cb-e07cd521e20c", "name": "network-vif-plugged", "status": "completed", "tag": "1f0381ba-d366-4464-a229-d69baa62dd73"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:43:56.532668 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-f8b7bc35-5031-477f-96e9-81eeeb84e616 req-996129bf-3bdb-46da-a7aa-16aa224f7b2a service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:56.533030 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-f8b7bc35-5031-477f-96e9-81eeeb84e616 req-996129bf-3bdb-46da-a7aa-16aa224f7b2a service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:56.533466 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-f8b7bc35-5031-477f-96e9-81eeeb84e616 req-996129bf-3bdb-46da-a7aa-16aa224f7b2a service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:56.565237 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-f8b7bc35-5031-477f-96e9-81eeeb84e616 req-996129bf-3bdb-46da-a7aa-16aa224f7b2a service nova] Creating event network-vif-plugged:1f0381ba-d366-4464-a229-d69baa62dd73 for instance 2170ccef-31bf-4166-b5cb-e07cd521e20c on n-h2-846463-3 Sep 23 04:43:56.571751 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c0d41f7a-42d7-4958-8fbd-055f16b0cb6a tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] 10.222.0.33 "GET /compute/v2.1/servers/48df7db9-a805-4c72-a1a5-29632b00248c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.121059 Sep 23 04:43:56.575363 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1489/3010] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Sep 23 04:43:56 2022] GET /compute/v2.1/servers/48df7db9-a805-4c72-a1a5-29632b00248c/os-volume_attachments => generated 197 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:43:56.578546 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-f8b7bc35-5031-477f-96e9-81eeeb84e616 req-996129bf-3bdb-46da-a7aa-16aa224f7b2a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084815 Sep 23 04:43:56.579352 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1522/3011] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:43:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:43:56.583765 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a0799bba-7f98-4f34-ac2c-8215398731f9 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:56.588726 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-a2b25a75-b712-4415-a1c2-a8bc36e41983 req-27c14960-aa74-4a29-8d40-491485a00b60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc73bb47-24fc-4b26-a371-c9cb0719748b", "tag": "c5a36ea8-5c64-4075-b87d-53d2b92335d9"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:43:56.589752 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a0799bba-7f98-4f34-ac2c-8215398731f9 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] [instance: dc73bb47-24fc-4b26-a371-c9cb0719748b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:56.603355 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a0799bba-7f98-4f34-ac2c-8215398731f9 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:56.605791 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a0799bba-7f98-4f34-ac2c-8215398731f9 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:56.608622 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a0799bba-7f98-4f34-ac2c-8215398731f9 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:56.610627 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a0799bba-7f98-4f34-ac2c-8215398731f9 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:56.613773 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-a2b25a75-b712-4415-a1c2-a8bc36e41983 req-27c14960-aa74-4a29-8d40-491485a00b60 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:56.619385 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a0799bba-7f98-4f34-ac2c-8215398731f9 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:56.619385 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a0799bba-7f98-4f34-ac2c-8215398731f9 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:56.619592 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-a2b25a75-b712-4415-a1c2-a8bc36e41983 req-27c14960-aa74-4a29-8d40-491485a00b60 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:56.619592 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-a2b25a75-b712-4415-a1c2-a8bc36e41983 req-27c14960-aa74-4a29-8d40-491485a00b60 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:56.656000 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-a2b25a75-b712-4415-a1c2-a8bc36e41983 req-27c14960-aa74-4a29-8d40-491485a00b60 service nova] Creating event network-changed:c5a36ea8-5c64-4075-b87d-53d2b92335d9 for instance dc73bb47-24fc-4b26-a371-c9cb0719748b on n-h1-846463-3 Sep 23 04:43:56.669726 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-a2b25a75-b712-4415-a1c2-a8bc36e41983 req-27c14960-aa74-4a29-8d40-491485a00b60 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088820 Sep 23 04:43:56.672308 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1523/3012] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:43:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:43:56.680721 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0ea54076-7b93-4753-9201-c28b3dadc0d8 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:43:56.687255 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-0ea54076-7b93-4753-9201-c28b3dadc0d8 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] [instance: 2cea388e-a568-48be-9f76-b673509a7824] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:56.706960 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0ea54076-7b93-4753-9201-c28b3dadc0d8 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:56.715835 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0ea54076-7b93-4753-9201-c28b3dadc0d8 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:56.716603 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0ea54076-7b93-4753-9201-c28b3dadc0d8 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:56.719091 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0ea54076-7b93-4753-9201-c28b3dadc0d8 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:56.719815 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0ea54076-7b93-4753-9201-c28b3dadc0d8 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:56.720655 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0ea54076-7b93-4753-9201-c28b3dadc0d8 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:57.076673 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0ea54076-7b93-4753-9201-c28b3dadc0d8 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "POST /compute/v2.1/servers/2cea388e-a568-48be-9f76-b673509a7824/action" status: 202 len: 0 microversion: 2.1 time: 0.402292 Sep 23 04:43:57.081439 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1524/3013] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:43:56 2022] POST /compute/v2.1/servers/2cea388e-a568-48be-9f76-b673509a7824/action => generated 0 bytes in 405 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:43:57.084364 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ddbebe79-3918-41a7-8dfb-36a40c6417b9 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:57.085089 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ddbebe79-3918-41a7-8dfb-36a40c6417b9 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 2170ccef-31bf-4166-b5cb-e07cd521e20c] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:57.121069 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ddbebe79-3918-41a7-8dfb-36a40c6417b9 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:57.121587 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ddbebe79-3918-41a7-8dfb-36a40c6417b9 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:57.122077 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ddbebe79-3918-41a7-8dfb-36a40c6417b9 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:57.122812 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ddbebe79-3918-41a7-8dfb-36a40c6417b9 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:57.123289 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ddbebe79-3918-41a7-8dfb-36a40c6417b9 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:57.128020 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ddbebe79-3918-41a7-8dfb-36a40c6417b9 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:57.194171 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a0799bba-7f98-4f34-ac2c-8215398731f9 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2d38f8f2244a81bf0935a121f039fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42090b82fbf8462eb96c0e69210aa460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:57.210640 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a0799bba-7f98-4f34-ac2c-8215398731f9 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] 10.222.0.33 "GET /compute/v2.1/servers/dc73bb47-24fc-4b26-a371-c9cb0719748b" status: 200 len: 1324 microversion: 2.1 time: 0.633026 Sep 23 04:43:57.212863 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1490/3014] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:56 2022] GET /compute/v2.1/servers/dc73bb47-24fc-4b26-a371-c9cb0719748b => generated 1324 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:43:57.242270 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0711db97-f878-4440-b226-490b425b7437 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:57.243227 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-0711db97-f878-4440-b226-490b425b7437 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] [instance: 2cea388e-a568-48be-9f76-b673509a7824] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:57.251888 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0711db97-f878-4440-b226-490b425b7437 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:57.252730 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0711db97-f878-4440-b226-490b425b7437 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:57.254035 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0711db97-f878-4440-b226-490b425b7437 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:57.255216 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0711db97-f878-4440-b226-490b425b7437 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:57.255959 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0711db97-f878-4440-b226-490b425b7437 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:57.256649 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0711db97-f878-4440-b226-490b425b7437 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:57.668535 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-0711db97-f878-4440-b226-490b425b7437 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11980041918484990dac709544d0b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c43f2b70bc74a48b62fb4115337f073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:57.686698 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0711db97-f878-4440-b226-490b425b7437 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/servers/2cea388e-a568-48be-9f76-b673509a7824" status: 200 len: 1491 microversion: 2.1 time: 0.455197 Sep 23 04:43:57.702307 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1491/3015] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:57 2022] GET /compute/v2.1/servers/2cea388e-a568-48be-9f76-b673509a7824 => generated 1491 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:43:57.714217 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-56ad4a54-a7b7-4280-95cd-079b8b45d525 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:57.715748 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-56ad4a54-a7b7-4280-95cd-079b8b45d525 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] [instance: 53745879-9973-4217-b1c5-b45f917db80e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:57.730040 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ddbebe79-3918-41a7-8dfb-36a40c6417b9 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:57.739569 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ddbebe79-3918-41a7-8dfb-36a40c6417b9 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/2170ccef-31bf-4166-b5cb-e07cd521e20c" status: 200 len: 1320 microversion: 2.1 time: 0.659348 Sep 23 04:43:57.740171 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1525/3016] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:57 2022] GET /compute/v2.1/servers/2170ccef-31bf-4166-b5cb-e07cd521e20c => generated 1320 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:43:57.744723 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-bc84f66a-aee6-4dd6-8b65-6c8b5a18994b tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:57.745341 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-bc84f66a-aee6-4dd6-8b65-6c8b5a18994b tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] [instance: bcdc202d-96f2-4640-8e81-f786d5e15793] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:57.747686 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-56ad4a54-a7b7-4280-95cd-079b8b45d525 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:57.748420 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-56ad4a54-a7b7-4280-95cd-079b8b45d525 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:57.748871 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-56ad4a54-a7b7-4280-95cd-079b8b45d525 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:57.749594 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-56ad4a54-a7b7-4280-95cd-079b8b45d525 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:57.750084 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-56ad4a54-a7b7-4280-95cd-079b8b45d525 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:57.750523 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-56ad4a54-a7b7-4280-95cd-079b8b45d525 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:57.761686 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bc84f66a-aee6-4dd6-8b65-6c8b5a18994b tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:57.771181 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bc84f66a-aee6-4dd6-8b65-6c8b5a18994b tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:57.776588 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bc84f66a-aee6-4dd6-8b65-6c8b5a18994b tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:57.776588 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bc84f66a-aee6-4dd6-8b65-6c8b5a18994b tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:57.776588 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bc84f66a-aee6-4dd6-8b65-6c8b5a18994b tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:57.776588 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bc84f66a-aee6-4dd6-8b65-6c8b5a18994b tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:57.787779 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-56ad4a54-a7b7-4280-95cd-079b8b45d525 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] HTTP exception thrown: Instance 53745879-9973-4217-b1c5-b45f917db80e could not be found. Sep 23 04:43:57.790858 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-56ad4a54-a7b7-4280-95cd-079b8b45d525 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Request method failure captured: Sep 23 04:43:57.790858 n-d-846463-3 devstack@n-api.service[122698]: request: DELETE /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e HTTP/1.1 Sep 23 04:43:57.790858 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:43:57.790858 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:43:57.790858 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:43:57.790858 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:43:57.790858 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:43:57.790858 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:43:57.790858 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:43:57.790858 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:43:57.790858 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTei-zMAV2Riq9maPSimi_17Crj2SyHKz0T3x8ro5so93kwJLlDk8p9v7yY8AHCSaYZoC-i2B8W1vSjbP_YFyBQMdjHsjASEYXcFymEvoavlKmV7DaBuBwYSL_bHi8jdya2BCEmlsdJzxzRdNlLS9x2-l4-BuYCy2Vd-I79AdVtADP0 Sep 23 04:43:57.790858 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:43:57.790858 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:43:57.790858 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:43:57.790858 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:43:57.790858 n-d-846463-3 devstack@n-api.service[122698]: X-Openstack-Nova-Api-Version: 2.42 Sep 23 04:43:57.790858 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:43:57.790858 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:43:57.790858 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 9c853e6ab59d45c084f6f7349f3ef87c Sep 23 04:43:57.790858 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-2026340842 Sep 23 04:43:57.790858 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:43:57.790858 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:43:57.790858 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9c853e6ab59d45c084f6f7349f3ef87c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9c853e6ab59d45c084f6f7349f3ef87c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9c853e6ab59d45c084f6f7349f3ef87c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9c853e6ab59d45c084f6f7349f3ef87c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:43:57.790858 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-TaggedBootDevicesTest_v242-2026340842 Sep 23 04:43:57.790858 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 9c853e6ab59d45c084f6f7349f3ef87c Sep 23 04:43:57.790858 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-2026340842 Sep 23 04:43:57.790858 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-TaggedBootDevicesTest_v242-2026340842-project Sep 23 04:43:57.790858 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:43:57.790858 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:43:57.790858 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 99d8fe44ad7c412d8629159f7529ba81 Sep 23 04:43:57.790858 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-TaggedBootDevicesTest_v242-2026340842-project Sep 23 04:43:57.790858 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:43:57.790858 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 53745879-9973-4217-b1c5-b45f917db80e could not be found. Sep 23 04:43:57.790858 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '53745879-9973-4217-b1c5-b45f917db80e'} Sep 23 04:43:57.790858 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:43:57.790858 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:43:57.790858 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:43:57.790858 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:43:57.790858 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:43:57.790858 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:43:57.790858 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:43:57.790858 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:43:57.790858 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:43:57.790858 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:43:57.790858 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53745879-9973-4217-b1c5-b45f917db80e could not be found. Sep 23 04:43:57.790858 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:43:57.790858 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:43:57.790858 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:43:57.790858 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:43:57.790858 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:43:57.790858 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:43:57.790858 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:43:57.790858 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:43:57.790858 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:43:57.790858 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:43:57.790858 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 04:43:57.790858 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 04:43:57.790858 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 04:43:57.790858 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 04:43:57.790858 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:43:57.790858 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:43:57.790858 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:43:57.790858 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:43:57.795456 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53745879-9973-4217-b1c5-b45f917db80e could not be found. Sep 23 04:43:57.795456 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:43:57.795456 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:43:57.795456 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:43:57.795456 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:43:57.795456 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:43:57.795456 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:43:57.795456 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:43:57.795456 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:43:57.795456 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53745879-9973-4217-b1c5-b45f917db80e could not be found. Sep 23 04:43:57.795456 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:43:57.799194 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-56ad4a54-a7b7-4280-95cd-079b8b45d525 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Returning 404 to user: Instance 53745879-9973-4217-b1c5-b45f917db80e could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:43:57.801983 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-56ad4a54-a7b7-4280-95cd-079b8b45d525 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] 10.222.0.33 "DELETE /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e" status: 404 len: 111 microversion: 2.42 time: 0.098277 Sep 23 04:43:57.808840 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1492/3017] 10.222.0.33 () {60 vars in 1280 bytes} [Fri Sep 23 04:43:57 2022] DELETE /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 23 04:43:57.814351 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-01450e64-637f-4fe9-9e8d-e3966a553b8e tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:57.818661 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-01450e64-637f-4fe9-9e8d-e3966a553b8e tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] [instance: 48df7db9-a805-4c72-a1a5-29632b00248c] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:57.838545 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-01450e64-637f-4fe9-9e8d-e3966a553b8e tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:57.839233 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-01450e64-637f-4fe9-9e8d-e3966a553b8e tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:57.839838 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-01450e64-637f-4fe9-9e8d-e3966a553b8e tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:57.840915 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-01450e64-637f-4fe9-9e8d-e3966a553b8e tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:57.841544 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-01450e64-637f-4fe9-9e8d-e3966a553b8e tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:57.842255 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-01450e64-637f-4fe9-9e8d-e3966a553b8e tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:57.905668 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-01450e64-637f-4fe9-9e8d-e3966a553b8e tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] 10.222.0.33 "GET /compute/v2.1/servers/48df7db9-a805-4c72-a1a5-29632b00248c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095511 Sep 23 04:43:57.910922 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1493/3018] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Sep 23 04:43:57 2022] GET /compute/v2.1/servers/48df7db9-a805-4c72-a1a5-29632b00248c/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:43:57.927599 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7add7ee7-15c9-4433-b2f2-1a0e029739b0 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:57.931600 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7add7ee7-15c9-4433-b2f2-1a0e029739b0 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] [instance: 53745879-9973-4217-b1c5-b45f917db80e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:57.950280 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7add7ee7-15c9-4433-b2f2-1a0e029739b0 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:57.950900 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7add7ee7-15c9-4433-b2f2-1a0e029739b0 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:57.951810 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7add7ee7-15c9-4433-b2f2-1a0e029739b0 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:57.952642 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7add7ee7-15c9-4433-b2f2-1a0e029739b0 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:57.953226 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7add7ee7-15c9-4433-b2f2-1a0e029739b0 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:57.953763 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7add7ee7-15c9-4433-b2f2-1a0e029739b0 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:57.985417 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-7add7ee7-15c9-4433-b2f2-1a0e029739b0 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] HTTP exception thrown: Instance 53745879-9973-4217-b1c5-b45f917db80e could not be found. Sep 23 04:43:57.987203 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7add7ee7-15c9-4433-b2f2-1a0e029739b0 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Request method failure captured: Sep 23 04:43:57.987203 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e HTTP/1.1 Sep 23 04:43:57.987203 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:43:57.987203 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:43:57.987203 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:43:57.987203 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:43:57.987203 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:43:57.987203 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:43:57.987203 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:43:57.987203 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:43:57.987203 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTei-zMAV2Riq9maPSimi_17Crj2SyHKz0T3x8ro5so93kwJLlDk8p9v7yY8AHCSaYZoC-i2B8W1vSjbP_YFyBQMdjHsjASEYXcFymEvoavlKmV7DaBuBwYSL_bHi8jdya2BCEmlsdJzxzRdNlLS9x2-l4-BuYCy2Vd-I79AdVtADP0 Sep 23 04:43:57.987203 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:43:57.987203 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:43:57.987203 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:43:57.987203 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:43:57.987203 n-d-846463-3 devstack@n-api.service[122698]: X-Openstack-Nova-Api-Version: 2.42 Sep 23 04:43:57.987203 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:43:57.987203 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:43:57.987203 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 9c853e6ab59d45c084f6f7349f3ef87c Sep 23 04:43:57.987203 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-2026340842 Sep 23 04:43:57.987203 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:43:57.987203 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:43:57.987203 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9c853e6ab59d45c084f6f7349f3ef87c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9c853e6ab59d45c084f6f7349f3ef87c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9c853e6ab59d45c084f6f7349f3ef87c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9c853e6ab59d45c084f6f7349f3ef87c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:43:57.987203 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-TaggedBootDevicesTest_v242-2026340842 Sep 23 04:43:57.987203 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 9c853e6ab59d45c084f6f7349f3ef87c Sep 23 04:43:57.987203 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-2026340842 Sep 23 04:43:57.987203 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-TaggedBootDevicesTest_v242-2026340842-project Sep 23 04:43:57.987203 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:43:57.987203 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:43:57.987203 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 99d8fe44ad7c412d8629159f7529ba81 Sep 23 04:43:57.987203 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-TaggedBootDevicesTest_v242-2026340842-project Sep 23 04:43:57.987203 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:43:57.987203 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 53745879-9973-4217-b1c5-b45f917db80e could not be found. Sep 23 04:43:57.987203 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '53745879-9973-4217-b1c5-b45f917db80e'} Sep 23 04:43:57.987203 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:43:57.987203 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:43:57.987203 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:43:57.987203 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:43:57.987203 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:43:57.987203 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:43:57.987203 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:43:57.987203 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:43:57.987203 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:43:57.987203 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:43:57.987203 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53745879-9973-4217-b1c5-b45f917db80e could not be found. Sep 23 04:43:57.987203 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:43:57.987203 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:43:57.987203 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:43:57.987203 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:43:57.987203 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:43:57.987203 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:43:57.987203 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:43:57.987203 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:43:57.987203 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:43:57.987203 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:43:57.987203 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:43:57.987203 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:43:57.987203 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:43:57.987203 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:43:57.987203 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:43:57.987203 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:43:57.987203 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53745879-9973-4217-b1c5-b45f917db80e could not be found. Sep 23 04:43:57.987203 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:43:57.987203 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:43:57.992747 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:43:57.992747 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:43:57.992747 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:43:57.992747 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:43:57.992747 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:43:57.992747 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:43:57.992747 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53745879-9973-4217-b1c5-b45f917db80e could not be found. Sep 23 04:43:57.992747 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:43:57.992747 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7add7ee7-15c9-4433-b2f2-1a0e029739b0 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] Returning 404 to user: Instance 53745879-9973-4217-b1c5-b45f917db80e could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:43:57.994496 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7add7ee7-15c9-4433-b2f2-1a0e029739b0 tempest-TaggedBootDevicesTest_v242-2026340842 tempest-TaggedBootDevicesTest_v242-2026340842-project] 10.222.0.33 "GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e" status: 404 len: 111 microversion: 2.42 time: 0.076140 Sep 23 04:43:57.995503 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1494/3019] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:43:57 2022] GET /compute/v2.1/servers/53745879-9973-4217-b1c5-b45f917db80e => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 23 04:43:58.025851 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-bc84f66a-aee6-4dd6-8b65-6c8b5a18994b tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18998e15712495b83c222edc234349e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5691a27f143eda1faf12fbbd9696c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:58.033929 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-bc84f66a-aee6-4dd6-8b65-6c8b5a18994b tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] 10.222.0.33 "GET /compute/v2.1/servers/bcdc202d-96f2-4640-8e81-f786d5e15793" status: 200 len: 1317 microversion: 2.1 time: 0.292669 Sep 23 04:43:58.034587 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1526/3020] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:57 2022] GET /compute/v2.1/servers/bcdc202d-96f2-4640-8e81-f786d5e15793 => generated 1317 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:43:58.253032 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-da7bf102-de14-4529-8578-d35801898d9a tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:58.257409 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-da7bf102-de14-4529-8578-d35801898d9a tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] [instance: dc73bb47-24fc-4b26-a371-c9cb0719748b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:58.281474 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=10 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:43:58.285319 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-da7bf102-de14-4529-8578-d35801898d9a tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:58.286221 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-da7bf102-de14-4529-8578-d35801898d9a tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:58.287450 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-da7bf102-de14-4529-8578-d35801898d9a tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:58.288528 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-da7bf102-de14-4529-8578-d35801898d9a tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:58.289437 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-da7bf102-de14-4529-8578-d35801898d9a tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:58.290104 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-da7bf102-de14-4529-8578-d35801898d9a tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:58.489566 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-da7bf102-de14-4529-8578-d35801898d9a tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2d38f8f2244a81bf0935a121f039fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42090b82fbf8462eb96c0e69210aa460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:58.504563 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-da7bf102-de14-4529-8578-d35801898d9a tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] 10.222.0.33 "GET /compute/v2.1/servers/dc73bb47-24fc-4b26-a371-c9cb0719748b" status: 200 len: 1324 microversion: 2.1 time: 0.267561 Sep 23 04:43:58.507287 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1495/3021] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:58 2022] GET /compute/v2.1/servers/dc73bb47-24fc-4b26-a371-c9cb0719748b => generated 1324 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:43:58.641532 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-37b7194f-454a-44ba-894f-f8afa29c9b84 req-8a715a24-9417-45ff-92a2-e59268d29e3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcdc202d-96f2-4640-8e81-f786d5e15793", "name": "network-vif-plugged", "status": "completed", "tag": "ddea8eb8-0e1d-414f-9d9f-d8a108d70e38"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:43:58.660162 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-37b7194f-454a-44ba-894f-f8afa29c9b84 req-8a715a24-9417-45ff-92a2-e59268d29e3a service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:58.661209 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-37b7194f-454a-44ba-894f-f8afa29c9b84 req-8a715a24-9417-45ff-92a2-e59268d29e3a service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:58.661848 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-37b7194f-454a-44ba-894f-f8afa29c9b84 req-8a715a24-9417-45ff-92a2-e59268d29e3a service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:58.685346 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-37b7194f-454a-44ba-894f-f8afa29c9b84 req-8a715a24-9417-45ff-92a2-e59268d29e3a service nova] Creating event network-vif-plugged:ddea8eb8-0e1d-414f-9d9f-d8a108d70e38 for instance bcdc202d-96f2-4640-8e81-f786d5e15793 on n-h2-846463-3 Sep 23 04:43:58.715419 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-37b7194f-454a-44ba-894f-f8afa29c9b84 req-8a715a24-9417-45ff-92a2-e59268d29e3a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080107 Sep 23 04:43:58.717786 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1527/3022] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:43:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:43:58.726313 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9275db27-6d63-4241-987e-40ad088de620 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:58.727595 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-9275db27-6d63-4241-987e-40ad088de620 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] [instance: 2cea388e-a568-48be-9f76-b673509a7824] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:58.746131 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9275db27-6d63-4241-987e-40ad088de620 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:58.746131 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9275db27-6d63-4241-987e-40ad088de620 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:58.746131 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9275db27-6d63-4241-987e-40ad088de620 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:58.746131 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9275db27-6d63-4241-987e-40ad088de620 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:58.746776 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9275db27-6d63-4241-987e-40ad088de620 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:58.747413 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9275db27-6d63-4241-987e-40ad088de620 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:58.784720 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6b7e244b-326b-4f6e-bb28-7d4062665461 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:58.784720 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-6b7e244b-326b-4f6e-bb28-7d4062665461 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 2170ccef-31bf-4166-b5cb-e07cd521e20c] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:58.789527 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6b7e244b-326b-4f6e-bb28-7d4062665461 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:58.790151 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6b7e244b-326b-4f6e-bb28-7d4062665461 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:58.791220 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6b7e244b-326b-4f6e-bb28-7d4062665461 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:58.792139 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6b7e244b-326b-4f6e-bb28-7d4062665461 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:58.792705 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6b7e244b-326b-4f6e-bb28-7d4062665461 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:58.793412 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6b7e244b-326b-4f6e-bb28-7d4062665461 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:59.073239 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-9275db27-6d63-4241-987e-40ad088de620 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11980041918484990dac709544d0b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c43f2b70bc74a48b62fb4115337f073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:59.080037 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-6b7e244b-326b-4f6e-bb28-7d4062665461 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:59.093202 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9275db27-6d63-4241-987e-40ad088de620 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/servers/2cea388e-a568-48be-9f76-b673509a7824" status: 200 len: 1471 microversion: 2.1 time: 0.373559 Sep 23 04:43:59.093202 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1496/3023] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:58 2022] GET /compute/v2.1/servers/2cea388e-a568-48be-9f76-b673509a7824 => generated 1471 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:43:59.093412 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6b7e244b-326b-4f6e-bb28-7d4062665461 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/2170ccef-31bf-4166-b5cb-e07cd521e20c" status: 200 len: 1320 microversion: 2.1 time: 0.322244 Sep 23 04:43:59.093412 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1528/3024] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:58 2022] GET /compute/v2.1/servers/2170ccef-31bf-4166-b5cb-e07cd521e20c => generated 1320 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:43:59.096323 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4c265c8c-904c-4993-8972-6fb94bc5f2a0 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:59.097165 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4c265c8c-904c-4993-8972-6fb94bc5f2a0 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] [instance: bcdc202d-96f2-4640-8e81-f786d5e15793] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:59.099987 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-89c95cb6-ee77-4425-a7e4-ee34d3b7131b tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:59.102421 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-89c95cb6-ee77-4425-a7e4-ee34d3b7131b tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] [instance: 48df7db9-a805-4c72-a1a5-29632b00248c] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:59.104241 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4c265c8c-904c-4993-8972-6fb94bc5f2a0 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:59.104933 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4c265c8c-904c-4993-8972-6fb94bc5f2a0 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:59.105695 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4c265c8c-904c-4993-8972-6fb94bc5f2a0 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:59.106614 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4c265c8c-904c-4993-8972-6fb94bc5f2a0 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:59.107954 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4c265c8c-904c-4993-8972-6fb94bc5f2a0 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:59.108546 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4c265c8c-904c-4993-8972-6fb94bc5f2a0 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:59.118745 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-89c95cb6-ee77-4425-a7e4-ee34d3b7131b tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:59.119642 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-89c95cb6-ee77-4425-a7e4-ee34d3b7131b tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:59.123290 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-89c95cb6-ee77-4425-a7e4-ee34d3b7131b tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:59.124288 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-89c95cb6-ee77-4425-a7e4-ee34d3b7131b tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:59.125503 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-89c95cb6-ee77-4425-a7e4-ee34d3b7131b tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:59.126131 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-89c95cb6-ee77-4425-a7e4-ee34d3b7131b tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:59.133962 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:43:59.233396 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-89c95cb6-ee77-4425-a7e4-ee34d3b7131b tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] 10.222.0.33 "GET /compute/v2.1/servers/48df7db9-a805-4c72-a1a5-29632b00248c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.143357 Sep 23 04:43:59.235105 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1497/3025] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Sep 23 04:43:59 2022] GET /compute/v2.1/servers/48df7db9-a805-4c72-a1a5-29632b00248c/os-volume_attachments => generated 197 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:43:59.240650 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3c867087-7408-4acb-8cd5-c259bfbffcb0 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1981268500"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:43:59.243884 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3c867087-7408-4acb-8cd5-c259bfbffcb0 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] [instance: 2cea388e-a568-48be-9f76-b673509a7824] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:59.252144 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3c867087-7408-4acb-8cd5-c259bfbffcb0 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:59.254099 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3c867087-7408-4acb-8cd5-c259bfbffcb0 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:59.254826 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3c867087-7408-4acb-8cd5-c259bfbffcb0 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:59.256283 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3c867087-7408-4acb-8cd5-c259bfbffcb0 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:59.257075 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3c867087-7408-4acb-8cd5-c259bfbffcb0 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:59.257726 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3c867087-7408-4acb-8cd5-c259bfbffcb0 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:59.312662 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-4c265c8c-904c-4993-8972-6fb94bc5f2a0 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18998e15712495b83c222edc234349e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5691a27f143eda1faf12fbbd9696c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:43:59.340197 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4c265c8c-904c-4993-8972-6fb94bc5f2a0 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] 10.222.0.33 "GET /compute/v2.1/servers/bcdc202d-96f2-4640-8e81-f786d5e15793" status: 200 len: 1317 microversion: 2.1 time: 0.247189 Sep 23 04:43:59.350410 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1529/3026] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:59 2022] GET /compute/v2.1/servers/bcdc202d-96f2-4640-8e81-f786d5e15793 => generated 1317 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:43:59.461569 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-688605a8-da03-4fd3-a81a-6c09f47319a4 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-1498345986", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "networks": [{"uuid": "92e4cf52-3ec0-4ed2-ba7a-11c60083e3f3"}]}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:43:59.586030 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.neutron [None req-688605a8-da03-4fd3-a81a-6c09f47319a4 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] validate_networks() for [('92e4cf52-3ec0-4ed2-ba7a-11c60083e3f3', None, None, None, None, None)] {{(pid=122699) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:43:59.844976 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3c867087-7408-4acb-8cd5-c259bfbffcb0 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "POST /compute/v2.1/servers/2cea388e-a568-48be-9f76-b673509a7824/action" status: 202 len: 0 microversion: 2.1 time: 0.608354 Sep 23 04:43:59.847001 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1498/3027] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:43:59 2022] POST /compute/v2.1/servers/2cea388e-a568-48be-9f76-b673509a7824/action => generated 0 bytes in 611 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 23 04:43:59.854514 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-35acd5ae-6e3f-4f31-ae94-78b5ca1f2071 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:43:59.855726 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-35acd5ae-6e3f-4f31-ae94-78b5ca1f2071 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] [instance: dc73bb47-24fc-4b26-a371-c9cb0719748b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:43:59.868447 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-35acd5ae-6e3f-4f31-ae94-78b5ca1f2071 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:59.869240 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-35acd5ae-6e3f-4f31-ae94-78b5ca1f2071 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:59.870015 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-35acd5ae-6e3f-4f31-ae94-78b5ca1f2071 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:43:59.871269 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-35acd5ae-6e3f-4f31-ae94-78b5ca1f2071 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:43:59.871989 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-35acd5ae-6e3f-4f31-ae94-78b5ca1f2071 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:43:59.872614 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-35acd5ae-6e3f-4f31-ae94-78b5ca1f2071 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:00.272300 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-35acd5ae-6e3f-4f31-ae94-78b5ca1f2071 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2d38f8f2244a81bf0935a121f039fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42090b82fbf8462eb96c0e69210aa460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:00.286801 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-35acd5ae-6e3f-4f31-ae94-78b5ca1f2071 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] 10.222.0.33 "GET /compute/v2.1/servers/dc73bb47-24fc-4b26-a371-c9cb0719748b" status: 200 len: 1324 microversion: 2.1 time: 0.436288 Sep 23 04:44:00.288560 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1499/3028] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:43:59 2022] GET /compute/v2.1/servers/dc73bb47-24fc-4b26-a371-c9cb0719748b => generated 1324 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:00.299033 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-29de3360-72ab-46e3-b811-16042984c672 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '.version_select at 0x7ff1bab2be50>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:00.369350 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-29de3360-72ab-46e3-b811-16042984c672 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/images/e161c9e7-af1d-4409-9a40-1f3f8885ed79" status: 200 len: 1414 microversion: 2.1 time: 0.076663 Sep 23 04:44:00.377300 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1500/3029] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:44:00 2022] GET /compute/v2.1/images/e161c9e7-af1d-4409-9a40-1f3f8885ed79 => generated 1414 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:00.377300 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2e86e5a9-5da3-437c-bb2d-ab20f2d5d063 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:00.377300 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-2e86e5a9-5da3-437c-bb2d-ab20f2d5d063 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 2170ccef-31bf-4166-b5cb-e07cd521e20c] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:00.384530 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2e86e5a9-5da3-437c-bb2d-ab20f2d5d063 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:00.385201 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2e86e5a9-5da3-437c-bb2d-ab20f2d5d063 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:00.385670 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2e86e5a9-5da3-437c-bb2d-ab20f2d5d063 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:00.386398 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2e86e5a9-5da3-437c-bb2d-ab20f2d5d063 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:00.386912 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2e86e5a9-5da3-437c-bb2d-ab20f2d5d063 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:00.387341 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2e86e5a9-5da3-437c-bb2d-ab20f2d5d063 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:00.632752 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-688605a8-da03-4fd3-a81a-6c09f47319a4 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Flavor limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:44:00.633255 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-688605a8-da03-4fd3-a81a-6c09f47319a4 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Image limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:44:00.634479 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-688605a8-da03-4fd3-a81a-6c09f47319a4 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Flavor pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:44:00.635206 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-688605a8-da03-4fd3-a81a-6c09f47319a4 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Image pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:44:00.635824 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-688605a8-da03-4fd3-a81a-6c09f47319a4 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:44:00.649870 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-2e86e5a9-5da3-437c-bb2d-ab20f2d5d063 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:00.651988 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-688605a8-da03-4fd3-a81a-6c09f47319a4 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:00.658478 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2e86e5a9-5da3-437c-bb2d-ab20f2d5d063 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/2170ccef-31bf-4166-b5cb-e07cd521e20c" status: 200 len: 1500 microversion: 2.1 time: 0.286925 Sep 23 04:44:00.658803 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-688605a8-da03-4fd3-a81a-6c09f47319a4 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:00.659139 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1501/3030] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:00 2022] GET /compute/v2.1/servers/2170ccef-31bf-4166-b5cb-e07cd521e20c => generated 1500 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:00.660925 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-688605a8-da03-4fd3-a81a-6c09f47319a4 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:00.661754 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-688605a8-da03-4fd3-a81a-6c09f47319a4 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:00.662259 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-688605a8-da03-4fd3-a81a-6c09f47319a4 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:00.662693 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-688605a8-da03-4fd3-a81a-6c09f47319a4 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:00.665495 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e0009e20-24ff-4e88-b765-18e341780119 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:00.668032 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e0009e20-24ff-4e88-b765-18e341780119 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] [instance: 48df7db9-a805-4c72-a1a5-29632b00248c] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:00.674550 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e0009e20-24ff-4e88-b765-18e341780119 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:00.675873 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e0009e20-24ff-4e88-b765-18e341780119 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:00.676493 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e0009e20-24ff-4e88-b765-18e341780119 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:00.677387 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e0009e20-24ff-4e88-b765-18e341780119 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:00.678045 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e0009e20-24ff-4e88-b765-18e341780119 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:00.678484 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e0009e20-24ff-4e88-b765-18e341780119 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:00.689560 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-688605a8-da03-4fd3-a81a-6c09f47319a4 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Getting quotas for project d22fd8f3b0334cb3b1af66cf626422fe. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:44:00.696167 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-688605a8-da03-4fd3-a81a-6c09f47319a4 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Getting quotas for user d0c53d79930a4eaf9fcf7cd10707fbf3 and project d22fd8f3b0334cb3b1af66cf626422fe. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:44:00.712028 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-688605a8-da03-4fd3-a81a-6c09f47319a4 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Going to run 1 instances... {{(pid=122699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:44:00.714351 n-d-846463-3 devstack@n-api.service[122699]: WARNING nova.utils [None req-688605a8-da03-4fd3-a81a-6c09f47319a4 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-1498345986 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-149834598 Sep 23 04:44:00.715336 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-688605a8-da03-4fd3-a81a-6c09f47319a4 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] [instance: 15e9bc0f-2262-4e2c-9cac-0eca4575943c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:44:00.728072 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e0009e20-24ff-4e88-b765-18e341780119 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] 10.222.0.33 "GET /compute/v2.1/servers/48df7db9-a805-4c72-a1a5-29632b00248c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067132 Sep 23 04:44:00.730174 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1502/3031] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Sep 23 04:44:00 2022] GET /compute/v2.1/servers/48df7db9-a805-4c72-a1a5-29632b00248c/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:44:00.737919 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f5f38280-375f-4cb1-ab85-dc8fd59a2eb0 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:00.739169 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f5f38280-375f-4cb1-ab85-dc8fd59a2eb0 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] [instance: bcdc202d-96f2-4640-8e81-f786d5e15793] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:00.747155 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f5f38280-375f-4cb1-ab85-dc8fd59a2eb0 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:00.751928 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f5f38280-375f-4cb1-ab85-dc8fd59a2eb0 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:00.751928 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f5f38280-375f-4cb1-ab85-dc8fd59a2eb0 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:00.751928 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f5f38280-375f-4cb1-ab85-dc8fd59a2eb0 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:00.751928 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f5f38280-375f-4cb1-ab85-dc8fd59a2eb0 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:00.751928 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f5f38280-375f-4cb1-ab85-dc8fd59a2eb0 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:00.959515 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-688605a8-da03-4fd3-a81a-6c09f47319a4 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.602753 Sep 23 04:44:00.960574 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1530/3032] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:43:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1609 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:44:00.965468 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f5fd8279-718b-4a74-a9e0-2bc3257885e2 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:00.966119 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f5fd8279-718b-4a74-a9e0-2bc3257885e2 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 2170ccef-31bf-4166-b5cb-e07cd521e20c] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:00.983783 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f5fd8279-718b-4a74-a9e0-2bc3257885e2 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:00.993289 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f5f38280-375f-4cb1-ab85-dc8fd59a2eb0 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18998e15712495b83c222edc234349e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5691a27f143eda1faf12fbbd9696c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:00.998084 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f5fd8279-718b-4a74-a9e0-2bc3257885e2 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:01.001334 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f5fd8279-718b-4a74-a9e0-2bc3257885e2 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:01.002633 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f5fd8279-718b-4a74-a9e0-2bc3257885e2 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:01.005425 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f5f38280-375f-4cb1-ab85-dc8fd59a2eb0 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] 10.222.0.33 "GET /compute/v2.1/servers/bcdc202d-96f2-4640-8e81-f786d5e15793" status: 200 len: 1317 microversion: 2.1 time: 0.271267 Sep 23 04:44:01.006898 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f5fd8279-718b-4a74-a9e0-2bc3257885e2 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:01.007534 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f5fd8279-718b-4a74-a9e0-2bc3257885e2 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:01.007959 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1503/3033] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:00 2022] GET /compute/v2.1/servers/bcdc202d-96f2-4640-8e81-f786d5e15793 => generated 1317 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:01.021397 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9628ed7f-a64f-4d66-9ce4-769634195507 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:01.026614 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-9628ed7f-a64f-4d66-9ce4-769634195507 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] [instance: 15e9bc0f-2262-4e2c-9cac-0eca4575943c] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:01.089796 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-9628ed7f-a64f-4d66-9ce4-769634195507 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c53d79930a4eaf9fcf7cd10707fbf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22fd8f3b0334cb3b1af66cf626422fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:01.097264 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9628ed7f-a64f-4d66-9ce4-769634195507 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] 10.222.0.33 "GET /compute/v2.1/servers/15e9bc0f-2262-4e2c-9cac-0eca4575943c" status: 200 len: 1232 microversion: 2.1 time: 0.087817 Sep 23 04:44:01.106340 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1504/3034] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:01 2022] GET /compute/v2.1/servers/15e9bc0f-2262-4e2c-9cac-0eca4575943c => generated 1232 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:01.261306 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f5fd8279-718b-4a74-a9e0-2bc3257885e2 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:01.273670 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f5fd8279-718b-4a74-a9e0-2bc3257885e2 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/2170ccef-31bf-4166-b5cb-e07cd521e20c" status: 200 len: 1500 microversion: 2.1 time: 0.311914 Sep 23 04:44:01.274512 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1531/3035] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:00 2022] GET /compute/v2.1/servers/2170ccef-31bf-4166-b5cb-e07cd521e20c => generated 1500 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:01.300616 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d7f438a4-6905-4cde-bc6e-9082ac58c1bc tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:01.300616 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d7f438a4-6905-4cde-bc6e-9082ac58c1bc tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 2170ccef-31bf-4166-b5cb-e07cd521e20c] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:01.312888 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d7f438a4-6905-4cde-bc6e-9082ac58c1bc tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:01.313597 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d7f438a4-6905-4cde-bc6e-9082ac58c1bc tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:01.314666 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d7f438a4-6905-4cde-bc6e-9082ac58c1bc tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:01.316461 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d7f438a4-6905-4cde-bc6e-9082ac58c1bc tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:01.316853 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4b4e9ca7-8a7f-4c29-9ea6-f84ab2792dab tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:01.316988 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d7f438a4-6905-4cde-bc6e-9082ac58c1bc tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:01.317990 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4b4e9ca7-8a7f-4c29-9ea6-f84ab2792dab tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] [instance: dc73bb47-24fc-4b26-a371-c9cb0719748b] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:01.333026 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4b4e9ca7-8a7f-4c29-9ea6-f84ab2792dab tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:01.334589 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4b4e9ca7-8a7f-4c29-9ea6-f84ab2792dab tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:01.335064 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4b4e9ca7-8a7f-4c29-9ea6-f84ab2792dab tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:01.336805 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4b4e9ca7-8a7f-4c29-9ea6-f84ab2792dab tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:01.338529 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4b4e9ca7-8a7f-4c29-9ea6-f84ab2792dab tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:01.338970 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4b4e9ca7-8a7f-4c29-9ea6-f84ab2792dab tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:01.361786 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d7f438a4-6905-4cde-bc6e-9082ac58c1bc tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:01.440061 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d7f438a4-6905-4cde-bc6e-9082ac58c1bc tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 2170ccef-31bf-4166-b5cb-e07cd521e20c] Going to try to terminate instance {{(pid=122698) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:44:01.733273 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-4b4e9ca7-8a7f-4c29-9ea6-f84ab2792dab tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2d38f8f2244a81bf0935a121f039fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42090b82fbf8462eb96c0e69210aa460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:01.744934 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4b4e9ca7-8a7f-4c29-9ea6-f84ab2792dab tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] 10.222.0.33 "GET /compute/v2.1/servers/dc73bb47-24fc-4b26-a371-c9cb0719748b" status: 200 len: 1324 microversion: 2.1 time: 0.433965 Sep 23 04:44:01.758747 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1532/3036] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:01 2022] GET /compute/v2.1/servers/dc73bb47-24fc-4b26-a371-c9cb0719748b => generated 1324 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:01.764659 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f6751be7-c3fa-4349-bfba-4e302fc1bb23 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '.version_select at 0x7ff1bbb32e50>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:01.828057 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f6751be7-c3fa-4349-bfba-4e302fc1bb23 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/images/e161c9e7-af1d-4409-9a40-1f3f8885ed79" status: 200 len: 1414 microversion: 2.1 time: 0.065863 Sep 23 04:44:01.829136 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1533/3037] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:44:01 2022] GET /compute/v2.1/images/e161c9e7-af1d-4409-9a40-1f3f8885ed79 => generated 1414 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:01.839492 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-16ef3cb9-5277-4072-bb65-a06eedf0b61a tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:01.855635 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-16ef3cb9-5277-4072-bb65-a06eedf0b61a tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] [instance: 48df7db9-a805-4c72-a1a5-29632b00248c] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:01.873807 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-16ef3cb9-5277-4072-bb65-a06eedf0b61a tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:01.875533 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-16ef3cb9-5277-4072-bb65-a06eedf0b61a tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:01.881714 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-16ef3cb9-5277-4072-bb65-a06eedf0b61a tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:01.886528 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-16ef3cb9-5277-4072-bb65-a06eedf0b61a tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:01.886528 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-16ef3cb9-5277-4072-bb65-a06eedf0b61a tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:01.888046 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-16ef3cb9-5277-4072-bb65-a06eedf0b61a tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:01.919753 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:44:01.948176 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-16ef3cb9-5277-4072-bb65-a06eedf0b61a tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] 10.222.0.33 "GET /compute/v2.1/servers/48df7db9-a805-4c72-a1a5-29632b00248c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.117310 Sep 23 04:44:01.949533 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1534/3038] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Sep 23 04:44:01 2022] GET /compute/v2.1/servers/48df7db9-a805-4c72-a1a5-29632b00248c/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:44:01.989769 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d7f438a4-6905-4cde-bc6e-9082ac58c1bc tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "DELETE /compute/v2.1/servers/2170ccef-31bf-4166-b5cb-e07cd521e20c" status: 204 len: 0 microversion: 2.1 time: 0.696669 Sep 23 04:44:01.995932 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1505/3039] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:44:01 2022] DELETE /compute/v2.1/servers/2170ccef-31bf-4166-b5cb-e07cd521e20c => generated 0 bytes in 703 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:44:02.003166 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-aa2bfb2e-1896-4ed2-bd89-4e1b5e4c800e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:02.003796 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-aa2bfb2e-1896-4ed2-bd89-4e1b5e4c800e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 2170ccef-31bf-4166-b5cb-e07cd521e20c] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:02.015951 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aa2bfb2e-1896-4ed2-bd89-4e1b5e4c800e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:02.018347 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aa2bfb2e-1896-4ed2-bd89-4e1b5e4c800e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:02.018347 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aa2bfb2e-1896-4ed2-bd89-4e1b5e4c800e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:02.018347 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aa2bfb2e-1896-4ed2-bd89-4e1b5e4c800e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:02.018347 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aa2bfb2e-1896-4ed2-bd89-4e1b5e4c800e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:02.019050 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aa2bfb2e-1896-4ed2-bd89-4e1b5e4c800e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:02.035742 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-cef97eb4-034b-4eb3-9687-2bc5b5138a80 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:02.036646 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-cef97eb4-034b-4eb3-9687-2bc5b5138a80 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] [instance: bcdc202d-96f2-4640-8e81-f786d5e15793] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:02.055642 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cef97eb4-034b-4eb3-9687-2bc5b5138a80 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:02.058995 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cef97eb4-034b-4eb3-9687-2bc5b5138a80 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:02.064982 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cef97eb4-034b-4eb3-9687-2bc5b5138a80 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:02.064982 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cef97eb4-034b-4eb3-9687-2bc5b5138a80 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:02.067476 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cef97eb4-034b-4eb3-9687-2bc5b5138a80 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:02.068043 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cef97eb4-034b-4eb3-9687-2bc5b5138a80 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:02.463043 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-aa2bfb2e-1896-4ed2-bd89-4e1b5e4c800e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:02.485605 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-aa2bfb2e-1896-4ed2-bd89-4e1b5e4c800e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/2170ccef-31bf-4166-b5cb-e07cd521e20c" status: 200 len: 1506 microversion: 2.1 time: 0.484558 Sep 23 04:44:02.486885 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1535/3040] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:01 2022] GET /compute/v2.1/servers/2170ccef-31bf-4166-b5cb-e07cd521e20c => generated 1506 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:02.499538 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-84685bb1-7c93-4074-8a55-78eafa12edba tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:02.506838 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-84685bb1-7c93-4074-8a55-78eafa12edba tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] [instance: 15e9bc0f-2262-4e2c-9cac-0eca4575943c] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:02.674608 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-84685bb1-7c93-4074-8a55-78eafa12edba tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c53d79930a4eaf9fcf7cd10707fbf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22fd8f3b0334cb3b1af66cf626422fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:02.688881 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-84685bb1-7c93-4074-8a55-78eafa12edba tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] 10.222.0.33 "GET /compute/v2.1/servers/15e9bc0f-2262-4e2c-9cac-0eca4575943c" status: 200 len: 1232 microversion: 2.1 time: 0.200071 Sep 23 04:44:02.689674 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1536/3041] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:02 2022] GET /compute/v2.1/servers/15e9bc0f-2262-4e2c-9cac-0eca4575943c => generated 1232 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:02.769183 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-41f81072-6ac0-40d1-a05b-f77f57ad4fc4 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:02.769815 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-41f81072-6ac0-40d1-a05b-f77f57ad4fc4 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] [instance: dc73bb47-24fc-4b26-a371-c9cb0719748b] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:02.776562 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-cef97eb4-034b-4eb3-9687-2bc5b5138a80 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18998e15712495b83c222edc234349e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5691a27f143eda1faf12fbbd9696c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:02.802072 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-cef97eb4-034b-4eb3-9687-2bc5b5138a80 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] 10.222.0.33 "GET /compute/v2.1/servers/bcdc202d-96f2-4640-8e81-f786d5e15793" status: 200 len: 1506 microversion: 2.1 time: 0.757186 Sep 23 04:44:02.803311 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1506/3042] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:02 2022] GET /compute/v2.1/servers/bcdc202d-96f2-4640-8e81-f786d5e15793 => generated 1506 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:44:02.807681 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-41f81072-6ac0-40d1-a05b-f77f57ad4fc4 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:02.811721 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-41f81072-6ac0-40d1-a05b-f77f57ad4fc4 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:02.812232 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-41f81072-6ac0-40d1-a05b-f77f57ad4fc4 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:02.813004 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-41f81072-6ac0-40d1-a05b-f77f57ad4fc4 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:02.813477 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-41f81072-6ac0-40d1-a05b-f77f57ad4fc4 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:02.815046 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-41f81072-6ac0-40d1-a05b-f77f57ad4fc4 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:02.832533 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-51eaa026-27ea-4c30-a7a0-3f2890c1f90c tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:02.833050 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-51eaa026-27ea-4c30-a7a0-3f2890c1f90c tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] [instance: bcdc202d-96f2-4640-8e81-f786d5e15793] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:02.857663 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-51eaa026-27ea-4c30-a7a0-3f2890c1f90c tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:02.861645 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-51eaa026-27ea-4c30-a7a0-3f2890c1f90c tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:02.863638 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-51eaa026-27ea-4c30-a7a0-3f2890c1f90c tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:02.864414 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-51eaa026-27ea-4c30-a7a0-3f2890c1f90c tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:02.864892 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-51eaa026-27ea-4c30-a7a0-3f2890c1f90c tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:02.865382 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-51eaa026-27ea-4c30-a7a0-3f2890c1f90c tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:02.984067 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-51eaa026-27ea-4c30-a7a0-3f2890c1f90c tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] 10.222.0.33 "GET /compute/v2.1/servers/bcdc202d-96f2-4640-8e81-f786d5e15793/ips" status: 200 len: 109 microversion: 2.1 time: 0.155819 Sep 23 04:44:02.985289 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1507/3043] 10.222.0.33 () {58 vars in 1248 bytes} [Fri Sep 23 04:44:02 2022] GET /compute/v2.1/servers/bcdc202d-96f2-4640-8e81-f786d5e15793/ips => generated 109 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:44:02.992888 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1b1e1d08-51c2-45ef-9acb-3e2e644b21c6 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '.version_select at 0x7ff1baa7d700>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:03.060994 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-1b1e1d08-51c2-45ef-9acb-3e2e644b21c6 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/images/e161c9e7-af1d-4409-9a40-1f3f8885ed79" status: 200 len: 1414 microversion: 2.1 time: 0.073605 Sep 23 04:44:03.063638 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1508/3044] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:44:02 2022] GET /compute/v2.1/images/e161c9e7-af1d-4409-9a40-1f3f8885ed79 => generated 1414 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:03.069004 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-60d8d784-65db-4490-bdcb-b43baa078200 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:03.072057 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-60d8d784-65db-4490-bdcb-b43baa078200 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] [instance: 48df7db9-a805-4c72-a1a5-29632b00248c] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:03.078615 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-60d8d784-65db-4490-bdcb-b43baa078200 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:03.082586 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-60d8d784-65db-4490-bdcb-b43baa078200 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:03.083537 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-60d8d784-65db-4490-bdcb-b43baa078200 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:03.084500 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-60d8d784-65db-4490-bdcb-b43baa078200 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:03.085197 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-60d8d784-65db-4490-bdcb-b43baa078200 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:03.086632 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-60d8d784-65db-4490-bdcb-b43baa078200 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:03.163948 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-41f81072-6ac0-40d1-a05b-f77f57ad4fc4 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2d38f8f2244a81bf0935a121f039fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42090b82fbf8462eb96c0e69210aa460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:03.172029 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-41f81072-6ac0-40d1-a05b-f77f57ad4fc4 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] 10.222.0.33 "GET /compute/v2.1/servers/dc73bb47-24fc-4b26-a371-c9cb0719748b" status: 200 len: 1324 microversion: 2.1 time: 0.407008 Sep 23 04:44:03.175460 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1537/3045] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:02 2022] GET /compute/v2.1/servers/dc73bb47-24fc-4b26-a371-c9cb0719748b => generated 1324 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:44:03.182950 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-60d8d784-65db-4490-bdcb-b43baa078200 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] 10.222.0.33 "GET /compute/v2.1/servers/48df7db9-a805-4c72-a1a5-29632b00248c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.117765 Sep 23 04:44:03.189391 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1509/3046] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Sep 23 04:44:03 2022] GET /compute/v2.1/servers/48df7db9-a805-4c72-a1a5-29632b00248c/os-volume_attachments => generated 25 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 04:44:03.191384 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3ca58c9e-98b2-4401-bace-f459131aace7 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:03.191905 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-3ca58c9e-98b2-4401-bace-f459131aace7 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] [instance: bcdc202d-96f2-4640-8e81-f786d5e15793] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:03.207218 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3ca58c9e-98b2-4401-bace-f459131aace7 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:03.211258 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3ca58c9e-98b2-4401-bace-f459131aace7 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:03.216148 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3ca58c9e-98b2-4401-bace-f459131aace7 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:03.217126 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3ca58c9e-98b2-4401-bace-f459131aace7 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:03.217842 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3ca58c9e-98b2-4401-bace-f459131aace7 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:03.218549 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3ca58c9e-98b2-4401-bace-f459131aace7 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:03.270336 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3ca58c9e-98b2-4401-bace-f459131aace7 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] 10.222.0.33 "GET /compute/v2.1/servers/bcdc202d-96f2-4640-8e81-f786d5e15793/ips" status: 200 len: 109 microversion: 2.1 time: 0.093781 Sep 23 04:44:03.271131 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1538/3047] 10.222.0.33 () {58 vars in 1248 bytes} [Fri Sep 23 04:44:03 2022] GET /compute/v2.1/servers/bcdc202d-96f2-4640-8e81-f786d5e15793/ips => generated 109 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:44:03.294932 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a1947c92-18e0-43e0-8c3f-cd3c6d320396 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:03.295458 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a1947c92-18e0-43e0-8c3f-cd3c6d320396 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] [instance: bcdc202d-96f2-4640-8e81-f786d5e15793] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:03.304989 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a1947c92-18e0-43e0-8c3f-cd3c6d320396 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:03.306565 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a1947c92-18e0-43e0-8c3f-cd3c6d320396 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:03.307184 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a1947c92-18e0-43e0-8c3f-cd3c6d320396 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:03.309348 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a1947c92-18e0-43e0-8c3f-cd3c6d320396 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:03.309348 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a1947c92-18e0-43e0-8c3f-cd3c6d320396 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:03.309348 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a1947c92-18e0-43e0-8c3f-cd3c6d320396 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:03.402382 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a1947c92-18e0-43e0-8c3f-cd3c6d320396 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] 10.222.0.33 "GET /compute/v2.1/servers/bcdc202d-96f2-4640-8e81-f786d5e15793/ips/tempest-ServerAddressesTestJSON-722329400-network" status: 200 len: 94 microversion: 2.1 time: 0.122560 Sep 23 04:44:03.410318 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1510/3048] 10.222.0.33 () {58 vars in 1398 bytes} [Fri Sep 23 04:44:03 2022] GET /compute/v2.1/servers/bcdc202d-96f2-4640-8e81-f786d5e15793/ips/tempest-ServerAddressesTestJSON-722329400-network => generated 94 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 04:44:03.417298 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8af9576a-323a-44ee-bdc7-5e1479c50f78 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:03.418986 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-8af9576a-323a-44ee-bdc7-5e1479c50f78 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] [instance: bcdc202d-96f2-4640-8e81-f786d5e15793] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:03.427375 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8af9576a-323a-44ee-bdc7-5e1479c50f78 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:03.428230 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8af9576a-323a-44ee-bdc7-5e1479c50f78 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:03.428747 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8af9576a-323a-44ee-bdc7-5e1479c50f78 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:03.432423 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8af9576a-323a-44ee-bdc7-5e1479c50f78 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:03.433018 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8af9576a-323a-44ee-bdc7-5e1479c50f78 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:03.433637 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8af9576a-323a-44ee-bdc7-5e1479c50f78 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:03.455010 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-13ada74d-8526-4267-b144-47d74ceac10d tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-448009968", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "networks": [{"uuid": "5179b17b-de1d-4853-b1fd-563abc0651ec"}]}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:44:03.504641 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-8af9576a-323a-44ee-bdc7-5e1479c50f78 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] [instance: bcdc202d-96f2-4640-8e81-f786d5e15793] Going to try to terminate instance {{(pid=122699) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:44:03.566546 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.network.neutron [None req-13ada74d-8526-4267-b144-47d74ceac10d tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] validate_networks() for [('5179b17b-de1d-4853-b1fd-563abc0651ec', None, None, None, None, None)] {{(pid=122698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:44:03.960001 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-8af9576a-323a-44ee-bdc7-5e1479c50f78 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] 10.222.0.33 "DELETE /compute/v2.1/servers/bcdc202d-96f2-4640-8e81-f786d5e15793" status: 204 len: 0 microversion: 2.1 time: 0.547667 Sep 23 04:44:03.961648 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1539/3049] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:44:03 2022] DELETE /compute/v2.1/servers/bcdc202d-96f2-4640-8e81-f786d5e15793 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:44:03.973526 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-33f88f24-5622-4a04-8804-0e86d554c680 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:03.975667 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-33f88f24-5622-4a04-8804-0e86d554c680 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 2170ccef-31bf-4166-b5cb-e07cd521e20c] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:03.994292 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-33f88f24-5622-4a04-8804-0e86d554c680 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:03.995305 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-33f88f24-5622-4a04-8804-0e86d554c680 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:03.996767 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-33f88f24-5622-4a04-8804-0e86d554c680 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:03.996767 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-33f88f24-5622-4a04-8804-0e86d554c680 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:03.997530 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-33f88f24-5622-4a04-8804-0e86d554c680 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:03.998231 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-33f88f24-5622-4a04-8804-0e86d554c680 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:04.334697 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-33f88f24-5622-4a04-8804-0e86d554c680 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:04.345594 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-33f88f24-5622-4a04-8804-0e86d554c680 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/2170ccef-31bf-4166-b5cb-e07cd521e20c" status: 200 len: 1506 microversion: 2.1 time: 0.382428 Sep 23 04:44:04.347796 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1540/3050] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:03 2022] GET /compute/v2.1/servers/2170ccef-31bf-4166-b5cb-e07cd521e20c => generated 1506 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:04.370949 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ad42238e-1d69-4647-8867-1b37a4d1e05f tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:04.371493 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ad42238e-1d69-4647-8867-1b37a4d1e05f tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] [instance: 15e9bc0f-2262-4e2c-9cac-0eca4575943c] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:04.379471 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ad42238e-1d69-4647-8867-1b37a4d1e05f tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:04.379995 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ad42238e-1d69-4647-8867-1b37a4d1e05f tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:04.384546 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ad42238e-1d69-4647-8867-1b37a4d1e05f tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:04.384546 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ad42238e-1d69-4647-8867-1b37a4d1e05f tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:04.384546 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ad42238e-1d69-4647-8867-1b37a4d1e05f tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:04.384546 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ad42238e-1d69-4647-8867-1b37a4d1e05f tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:04.464003 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ad42238e-1d69-4647-8867-1b37a4d1e05f tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c53d79930a4eaf9fcf7cd10707fbf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22fd8f3b0334cb3b1af66cf626422fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:04.476268 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ad42238e-1d69-4647-8867-1b37a4d1e05f tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] 10.222.0.33 "GET /compute/v2.1/servers/15e9bc0f-2262-4e2c-9cac-0eca4575943c" status: 200 len: 1284 microversion: 2.1 time: 0.112667 Sep 23 04:44:04.477556 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1541/3051] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:04 2022] GET /compute/v2.1/servers/15e9bc0f-2262-4e2c-9cac-0eca4575943c => generated 1284 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:04.486422 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5944a5e0-59cd-4f4b-bed4-2cfb865c9a65 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:04.487051 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-5944a5e0-59cd-4f4b-bed4-2cfb865c9a65 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] [instance: bcdc202d-96f2-4640-8e81-f786d5e15793] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:04.505764 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5944a5e0-59cd-4f4b-bed4-2cfb865c9a65 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:04.506703 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5944a5e0-59cd-4f4b-bed4-2cfb865c9a65 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:04.507157 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5944a5e0-59cd-4f4b-bed4-2cfb865c9a65 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:04.514272 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5944a5e0-59cd-4f4b-bed4-2cfb865c9a65 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:04.515042 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5944a5e0-59cd-4f4b-bed4-2cfb865c9a65 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:04.515551 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-13ada74d-8526-4267-b144-47d74ceac10d tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Flavor limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:44:04.515968 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5944a5e0-59cd-4f4b-bed4-2cfb865c9a65 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:04.516069 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-13ada74d-8526-4267-b144-47d74ceac10d tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Image limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:44:04.517089 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-13ada74d-8526-4267-b144-47d74ceac10d tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Flavor pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:44:04.517520 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-13ada74d-8526-4267-b144-47d74ceac10d tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Image pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:44:04.517976 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-13ada74d-8526-4267-b144-47d74ceac10d tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:44:04.567901 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-13ada74d-8526-4267-b144-47d74ceac10d tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:04.574420 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-13ada74d-8526-4267-b144-47d74ceac10d tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:04.576888 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-13ada74d-8526-4267-b144-47d74ceac10d tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:04.580215 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-13ada74d-8526-4267-b144-47d74ceac10d tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:04.582477 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-13ada74d-8526-4267-b144-47d74ceac10d tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:04.583679 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-13ada74d-8526-4267-b144-47d74ceac10d tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:04.655234 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-13ada74d-8526-4267-b144-47d74ceac10d tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Getting quotas for project 2f0b7307c30a4c118da4c501691e349f. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:44:04.663520 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-13ada74d-8526-4267-b144-47d74ceac10d tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Getting quotas for user 5e235519204b4efc8b6c7e2988fab9b8 and project 2f0b7307c30a4c118da4c501691e349f. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:44:04.729351 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-13ada74d-8526-4267-b144-47d74ceac10d tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Going to run 1 instances... {{(pid=122698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:44:04.747569 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-13ada74d-8526-4267-b144-47d74ceac10d tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] [instance: b903ed91-8ea3-4c20-8565-b190d442e723] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:44:04.994710 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-13ada74d-8526-4267-b144-47d74ceac10d tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.545335 Sep 23 04:44:05.003923 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1511/3052] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:44:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1555 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 23 04:44:05.009157 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-bda0ee89-6906-442f-81b6-5b00f5ba6b84 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '.version_select at 0x7ff1baa5cee0>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:05.104724 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-bda0ee89-6906-442f-81b6-5b00f5ba6b84 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/images/e161c9e7-af1d-4409-9a40-1f3f8885ed79" status: 200 len: 1414 microversion: 2.1 time: 0.099263 Sep 23 04:44:05.105334 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1512/3053] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:44:05 2022] GET /compute/v2.1/images/e161c9e7-af1d-4409-9a40-1f3f8885ed79 => generated 1414 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:05.136805 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1caffadd-858a-4231-89a4-4e22d1cef1a3 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:05.138562 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-1caffadd-858a-4231-89a4-4e22d1cef1a3 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] [instance: dc73bb47-24fc-4b26-a371-c9cb0719748b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:05.169214 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1caffadd-858a-4231-89a4-4e22d1cef1a3 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:05.169727 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1caffadd-858a-4231-89a4-4e22d1cef1a3 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:05.170206 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1caffadd-858a-4231-89a4-4e22d1cef1a3 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:05.170929 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1caffadd-858a-4231-89a4-4e22d1cef1a3 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:05.171396 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1caffadd-858a-4231-89a4-4e22d1cef1a3 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:05.171834 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1caffadd-858a-4231-89a4-4e22d1cef1a3 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:05.355572 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-5944a5e0-59cd-4f4b-bed4-2cfb865c9a65 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18998e15712495b83c222edc234349e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5691a27f143eda1faf12fbbd9696c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:05.367811 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5944a5e0-59cd-4f4b-bed4-2cfb865c9a65 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] 10.222.0.33 "GET /compute/v2.1/servers/bcdc202d-96f2-4640-8e81-f786d5e15793" status: 200 len: 1512 microversion: 2.1 time: 0.889021 Sep 23 04:44:05.368664 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1542/3054] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:04 2022] GET /compute/v2.1/servers/bcdc202d-96f2-4640-8e81-f786d5e15793 => generated 1512 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:05.376488 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-85834157-f81a-4020-b1ae-77d7f6032fce req-7609e460-1710-44ee-837d-8249b41f0347 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc73bb47-24fc-4b26-a371-c9cb0719748b", "name": "network-vif-plugged", "status": "completed", "tag": "c5a36ea8-5c64-4075-b87d-53d2b92335d9"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:44:05.389879 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-85834157-f81a-4020-b1ae-77d7f6032fce req-7609e460-1710-44ee-837d-8249b41f0347 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:05.390740 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-85834157-f81a-4020-b1ae-77d7f6032fce req-7609e460-1710-44ee-837d-8249b41f0347 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:05.391489 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-85834157-f81a-4020-b1ae-77d7f6032fce req-7609e460-1710-44ee-837d-8249b41f0347 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:05.470577 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-85834157-f81a-4020-b1ae-77d7f6032fce req-7609e460-1710-44ee-837d-8249b41f0347 service nova] Creating event network-vif-plugged:c5a36ea8-5c64-4075-b87d-53d2b92335d9 for instance dc73bb47-24fc-4b26-a371-c9cb0719748b on n-h1-846463-3 Sep 23 04:44:05.500185 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-85834157-f81a-4020-b1ae-77d7f6032fce req-7609e460-1710-44ee-837d-8249b41f0347 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129609 Sep 23 04:44:05.504311 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1543/3055] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:44:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:44:05.529700 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-bca007e2-451f-414a-bc00-667e867ae585 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:05.533788 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-bca007e2-451f-414a-bc00-667e867ae585 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] [instance: b903ed91-8ea3-4c20-8565-b190d442e723] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:05.713543 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-1caffadd-858a-4231-89a4-4e22d1cef1a3 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2d38f8f2244a81bf0935a121f039fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42090b82fbf8462eb96c0e69210aa460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:05.741477 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-bca007e2-451f-414a-bc00-667e867ae585 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e235519204b4efc8b6c7e2988fab9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0b7307c30a4c118da4c501691e349f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:05.749658 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-bca007e2-451f-414a-bc00-667e867ae585 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] 10.222.0.33 "GET /compute/v2.1/servers/b903ed91-8ea3-4c20-8565-b190d442e723" status: 200 len: 1217 microversion: 2.1 time: 0.243764 Sep 23 04:44:05.757483 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-1caffadd-858a-4231-89a4-4e22d1cef1a3 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] 10.222.0.33 "GET /compute/v2.1/servers/dc73bb47-24fc-4b26-a371-c9cb0719748b" status: 200 len: 1324 microversion: 2.1 time: 0.644979 Sep 23 04:44:05.758299 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1544/3056] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:05 2022] GET /compute/v2.1/servers/b903ed91-8ea3-4c20-8565-b190d442e723 => generated 1217 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:05.759258 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1513/3057] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:05 2022] GET /compute/v2.1/servers/dc73bb47-24fc-4b26-a371-c9cb0719748b => generated 1324 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:05.769429 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-7d9fb79b-ee20-4c3a-9af8-f04c94e48da9 req-ab0e8ed9-4d3a-4717-9e55-72dc4958f911 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2170ccef-31bf-4166-b5cb-e07cd521e20c", "name": "network-vif-deleted", "tag": "1f0381ba-d366-4464-a229-d69baa62dd73"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:44:05.777694 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-14501b91-528d-44aa-85a2-3c7d268f64e9 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:05.778736 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-14501b91-528d-44aa-85a2-3c7d268f64e9 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 2170ccef-31bf-4166-b5cb-e07cd521e20c] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:05.799294 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-14501b91-528d-44aa-85a2-3c7d268f64e9 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:05.801804 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-14501b91-528d-44aa-85a2-3c7d268f64e9 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:05.805603 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-7d9fb79b-ee20-4c3a-9af8-f04c94e48da9 req-ab0e8ed9-4d3a-4717-9e55-72dc4958f911 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:05.806438 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-14501b91-528d-44aa-85a2-3c7d268f64e9 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:05.807491 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-14501b91-528d-44aa-85a2-3c7d268f64e9 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:05.808195 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-14501b91-528d-44aa-85a2-3c7d268f64e9 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:05.808807 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-14501b91-528d-44aa-85a2-3c7d268f64e9 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:05.812064 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-7d9fb79b-ee20-4c3a-9af8-f04c94e48da9 req-ab0e8ed9-4d3a-4717-9e55-72dc4958f911 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:05.812966 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-7d9fb79b-ee20-4c3a-9af8-f04c94e48da9 req-ab0e8ed9-4d3a-4717-9e55-72dc4958f911 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:05.828855 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-7d9fb79b-ee20-4c3a-9af8-f04c94e48da9 req-ab0e8ed9-4d3a-4717-9e55-72dc4958f911 service nova] Creating event network-vif-deleted:1f0381ba-d366-4464-a229-d69baa62dd73 for instance 2170ccef-31bf-4166-b5cb-e07cd521e20c on n-h2-846463-3 Sep 23 04:44:05.835185 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-7d9fb79b-ee20-4c3a-9af8-f04c94e48da9 req-ab0e8ed9-4d3a-4717-9e55-72dc4958f911 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075656 Sep 23 04:44:05.836585 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1545/3058] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:44:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:44:05.843247 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7d21f11a-4553-4454-8b0f-bad2eef4f607 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:05.846203 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-7d21f11a-4553-4454-8b0f-bad2eef4f607 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] [instance: 15e9bc0f-2262-4e2c-9cac-0eca4575943c] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:05.852129 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7d21f11a-4553-4454-8b0f-bad2eef4f607 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:05.853208 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7d21f11a-4553-4454-8b0f-bad2eef4f607 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:05.854042 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7d21f11a-4553-4454-8b0f-bad2eef4f607 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:05.854977 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7d21f11a-4553-4454-8b0f-bad2eef4f607 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:05.855788 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7d21f11a-4553-4454-8b0f-bad2eef4f607 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:05.856385 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7d21f11a-4553-4454-8b0f-bad2eef4f607 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:05.860962 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-14501b91-528d-44aa-85a2-3c7d268f64e9 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:05.862065 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-14501b91-528d-44aa-85a2-3c7d268f64e9 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:05.862720 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-14501b91-528d-44aa-85a2-3c7d268f64e9 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:05.863440 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-14501b91-528d-44aa-85a2-3c7d268f64e9 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lazy-loading 'fault' on Instance uuid 2170ccef-31bf-4166-b5cb-e07cd521e20c {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:44:05.951112 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-14501b91-528d-44aa-85a2-3c7d268f64e9 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:05.969112 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-14501b91-528d-44aa-85a2-3c7d268f64e9 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/2170ccef-31bf-4166-b5cb-e07cd521e20c" status: 200 len: 1310 microversion: 2.1 time: 0.208041 Sep 23 04:44:05.993778 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1514/3059] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:05 2022] GET /compute/v2.1/servers/2170ccef-31bf-4166-b5cb-e07cd521e20c => generated 1310 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:06.003858 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-7d21f11a-4553-4454-8b0f-bad2eef4f607 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c53d79930a4eaf9fcf7cd10707fbf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22fd8f3b0334cb3b1af66cf626422fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:06.016840 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-7d21f11a-4553-4454-8b0f-bad2eef4f607 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] 10.222.0.33 "GET /compute/v2.1/servers/15e9bc0f-2262-4e2c-9cac-0eca4575943c" status: 200 len: 1284 microversion: 2.1 time: 0.178795 Sep 23 04:44:06.017434 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1546/3060] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:05 2022] GET /compute/v2.1/servers/15e9bc0f-2262-4e2c-9cac-0eca4575943c => generated 1284 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:06.133622 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d6d54633-32dc-48d2-ac14-f9eb8efc8c28 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '.version_select at 0x7ff1baa7d5e0>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:06.257636 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d6d54633-32dc-48d2-ac14-f9eb8efc8c28 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/images/e161c9e7-af1d-4409-9a40-1f3f8885ed79" status: 200 len: 1414 microversion: 2.1 time: 0.131344 Sep 23 04:44:06.267385 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1515/3061] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:44:06 2022] GET /compute/v2.1/images/e161c9e7-af1d-4409-9a40-1f3f8885ed79 => generated 1414 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:06.399080 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f556ff43-cda1-43e9-b4ec-6e28cd003605 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:06.399831 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f556ff43-cda1-43e9-b4ec-6e28cd003605 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] [instance: bcdc202d-96f2-4640-8e81-f786d5e15793] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:06.416559 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f556ff43-cda1-43e9-b4ec-6e28cd003605 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:06.417103 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f556ff43-cda1-43e9-b4ec-6e28cd003605 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:06.423131 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f556ff43-cda1-43e9-b4ec-6e28cd003605 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:06.423131 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f556ff43-cda1-43e9-b4ec-6e28cd003605 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:06.423131 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f556ff43-cda1-43e9-b4ec-6e28cd003605 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:06.423131 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f556ff43-cda1-43e9-b4ec-6e28cd003605 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:06.787566 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f556ff43-cda1-43e9-b4ec-6e28cd003605 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18998e15712495b83c222edc234349e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5691a27f143eda1faf12fbbd9696c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:06.796981 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-691036cd-0051-4812-9398-9cd64440792a tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:06.800749 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-691036cd-0051-4812-9398-9cd64440792a tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] [instance: dc73bb47-24fc-4b26-a371-c9cb0719748b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:06.809924 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f556ff43-cda1-43e9-b4ec-6e28cd003605 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] 10.222.0.33 "GET /compute/v2.1/servers/bcdc202d-96f2-4640-8e81-f786d5e15793" status: 200 len: 1512 microversion: 2.1 time: 0.418401 Sep 23 04:44:06.810133 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-691036cd-0051-4812-9398-9cd64440792a tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:06.810633 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-691036cd-0051-4812-9398-9cd64440792a tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:06.811902 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-691036cd-0051-4812-9398-9cd64440792a tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:06.812997 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-691036cd-0051-4812-9398-9cd64440792a tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:06.814040 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-691036cd-0051-4812-9398-9cd64440792a tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:06.815090 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1547/3062] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:06 2022] GET /compute/v2.1/servers/bcdc202d-96f2-4640-8e81-f786d5e15793 => generated 1512 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:06.820560 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-691036cd-0051-4812-9398-9cd64440792a tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:06.830912 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-879a816e-d6a8-42db-9def-21d4e1f87345 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:06.832342 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-879a816e-d6a8-42db-9def-21d4e1f87345 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] [instance: b903ed91-8ea3-4c20-8565-b190d442e723] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:06.848399 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-879a816e-d6a8-42db-9def-21d4e1f87345 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:06.849619 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-879a816e-d6a8-42db-9def-21d4e1f87345 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:06.855611 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-879a816e-d6a8-42db-9def-21d4e1f87345 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:06.855611 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-879a816e-d6a8-42db-9def-21d4e1f87345 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:06.855918 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-879a816e-d6a8-42db-9def-21d4e1f87345 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:06.863092 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-879a816e-d6a8-42db-9def-21d4e1f87345 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:07.305774 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-879a816e-d6a8-42db-9def-21d4e1f87345 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e235519204b4efc8b6c7e2988fab9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0b7307c30a4c118da4c501691e349f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:07.328641 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-879a816e-d6a8-42db-9def-21d4e1f87345 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] 10.222.0.33 "GET /compute/v2.1/servers/b903ed91-8ea3-4c20-8565-b190d442e723" status: 200 len: 1221 microversion: 2.1 time: 0.511132 Sep 23 04:44:07.351212 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1548/3063] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:06 2022] GET /compute/v2.1/servers/b903ed91-8ea3-4c20-8565-b190d442e723 => generated 1221 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:07.356215 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1a1399d8-2255-40d3-94a0-b7ac3b5ad8de tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:07.356843 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1a1399d8-2255-40d3-94a0-b7ac3b5ad8de tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 2170ccef-31bf-4166-b5cb-e07cd521e20c] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:07.373605 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:44:07.377121 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1a1399d8-2255-40d3-94a0-b7ac3b5ad8de tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:07.377322 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1a1399d8-2255-40d3-94a0-b7ac3b5ad8de tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:07.377771 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1a1399d8-2255-40d3-94a0-b7ac3b5ad8de tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:07.379061 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1a1399d8-2255-40d3-94a0-b7ac3b5ad8de tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:07.379538 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1a1399d8-2255-40d3-94a0-b7ac3b5ad8de tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:07.379978 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1a1399d8-2255-40d3-94a0-b7ac3b5ad8de tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:07.478508 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-1a1399d8-2255-40d3-94a0-b7ac3b5ad8de tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] HTTP exception thrown: Instance 2170ccef-31bf-4166-b5cb-e07cd521e20c could not be found. Sep 23 04:44:07.478508 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1a1399d8-2255-40d3-94a0-b7ac3b5ad8de tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Request method failure captured: Sep 23 04:44:07.478508 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/2170ccef-31bf-4166-b5cb-e07cd521e20c HTTP/1.1 Sep 23 04:44:07.478508 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:44:07.478508 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:44:07.478508 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:44:07.478508 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:44:07.478508 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:44:07.478508 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:44:07.478508 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:44:07.478508 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:44:07.478508 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTlTlFK_k4e3BWkoqwVigfjvHO2lVSTsmHRT7EhNgH87mj-DVuWXCq-NRLrmXyv4E_e0wXdkZnDmOQ4aUkRrz7wPxuRsMdZHh23aH7xyd0PRdo29c8XIic0D4fdht4KBWWMxFeNNSWWMe-xxhvPgOUVxbcTbEXPF75Q0c4Y9h1Ew0hk Sep 23 04:44:07.478508 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:44:07.478508 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:44:07.478508 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:44:07.478508 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:44:07.478508 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:44:07.478508 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:44:07.478508 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: c23bd5a8b84942898a99930b2bc0ca12 Sep 23 04:44:07.478508 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ServersTestJSON-1923416422 Sep 23 04:44:07.478508 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:44:07.478508 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:44:07.478508 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c23bd5a8b84942898a99930b2bc0ca12", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c23bd5a8b84942898a99930b2bc0ca12"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c23bd5a8b84942898a99930b2bc0ca12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c23bd5a8b84942898a99930b2bc0ca12"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:44:07.478508 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ServersTestJSON-1923416422 Sep 23 04:44:07.478508 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: c23bd5a8b84942898a99930b2bc0ca12 Sep 23 04:44:07.478508 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ServersTestJSON-1923416422 Sep 23 04:44:07.478508 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ServersTestJSON-1923416422-project Sep 23 04:44:07.478508 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:44:07.478508 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:44:07.478508 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 252c87e244984f71ae0907ee769bec05 Sep 23 04:44:07.478508 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ServersTestJSON-1923416422-project Sep 23 04:44:07.478508 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:44:07.478508 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 2170ccef-31bf-4166-b5cb-e07cd521e20c could not be found. Sep 23 04:44:07.478508 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '2170ccef-31bf-4166-b5cb-e07cd521e20c'} Sep 23 04:44:07.478508 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:44:07.478508 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:44:07.478508 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:44:07.478508 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:44:07.478508 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:44:07.478508 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:44:07.478508 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:44:07.478508 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:44:07.478508 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:44:07.478508 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:44:07.478508 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2170ccef-31bf-4166-b5cb-e07cd521e20c could not be found. Sep 23 04:44:07.478508 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:44:07.478508 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:44:07.478508 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:44:07.478508 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:44:07.478508 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:44:07.478508 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:44:07.478508 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:44:07.478508 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:44:07.478508 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:44:07.478508 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:44:07.478508 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:44:07.478508 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:44:07.478508 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:44:07.478508 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:44:07.478508 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:44:07.478508 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:44:07.484172 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2170ccef-31bf-4166-b5cb-e07cd521e20c could not be found. Sep 23 04:44:07.484172 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:44:07.484172 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:44:07.484172 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:44:07.484172 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:44:07.484172 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:44:07.484172 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:44:07.484172 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:44:07.484172 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:44:07.484172 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2170ccef-31bf-4166-b5cb-e07cd521e20c could not be found. Sep 23 04:44:07.484172 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:44:07.484172 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1a1399d8-2255-40d3-94a0-b7ac3b5ad8de tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Returning 404 to user: Instance 2170ccef-31bf-4166-b5cb-e07cd521e20c could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:44:07.484172 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1a1399d8-2255-40d3-94a0-b7ac3b5ad8de tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/2170ccef-31bf-4166-b5cb-e07cd521e20c" status: 404 len: 111 microversion: 2.1 time: 0.128814 Sep 23 04:44:07.485007 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1549/3064] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:07 2022] GET /compute/v2.1/servers/2170ccef-31bf-4166-b5cb-e07cd521e20c => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:44:07.499298 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3b20394c-dec6-4ce4-9055-4301e76e37c1 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:07.500028 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-3b20394c-dec6-4ce4-9055-4301e76e37c1 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] [instance: 15e9bc0f-2262-4e2c-9cac-0eca4575943c] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:07.530153 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3b20394c-dec6-4ce4-9055-4301e76e37c1 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:07.531839 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3b20394c-dec6-4ce4-9055-4301e76e37c1 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:07.532302 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3b20394c-dec6-4ce4-9055-4301e76e37c1 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:07.533048 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3b20394c-dec6-4ce4-9055-4301e76e37c1 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:07.533575 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3b20394c-dec6-4ce4-9055-4301e76e37c1 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:07.536970 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3b20394c-dec6-4ce4-9055-4301e76e37c1 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:07.562728 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-691036cd-0051-4812-9398-9cd64440792a tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2d38f8f2244a81bf0935a121f039fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42090b82fbf8462eb96c0e69210aa460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:07.567339 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:44:07.576314 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-691036cd-0051-4812-9398-9cd64440792a tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] 10.222.0.33 "GET /compute/v2.1/servers/dc73bb47-24fc-4b26-a371-c9cb0719748b" status: 200 len: 1324 microversion: 2.1 time: 0.782906 Sep 23 04:44:07.592971 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1516/3065] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:06 2022] GET /compute/v2.1/servers/dc73bb47-24fc-4b26-a371-c9cb0719748b => generated 1324 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:44:07.592971 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-85d662d0-d1ab-4818-bc94-ba2671f36569 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '.version_select at 0x7ff1bb7e0dc0>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:07.706723 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-85d662d0-d1ab-4818-bc94-ba2671f36569 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/images/e161c9e7-af1d-4409-9a40-1f3f8885ed79" status: 200 len: 1414 microversion: 2.1 time: 0.126727 Sep 23 04:44:07.715350 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1517/3066] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:44:07 2022] GET /compute/v2.1/images/e161c9e7-af1d-4409-9a40-1f3f8885ed79 => generated 1414 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:07.715350 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a89d9e2b-4df8-4bcc-93f9-0a509e53be2a tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Action: 'create', calling method: .version_select at 0x7ff1baa04c10>, body: {"keypair": {"name": "tempest-key-897099014", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFWAhI7xeeT4HLILi3WdvpX+USpPo+PT5fUkFpxrOiq6MEZXlREaABu6ih9ofRFrl9/lf4BHvUQR9a9Mjxsw1G+rt1fOwYY9SwvjkOvpq4zQiAv9ORQsQxemxx0Q/sG5Gg=="}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:44:07.737869 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:44:07.764711 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-a89d9e2b-4df8-4bcc-93f9-0a509e53be2a tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Getting quotas for project c23bd5a8b84942898a99930b2bc0ca12. Resources: {'key_pairs'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:44:07.778562 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-a89d9e2b-4df8-4bcc-93f9-0a509e53be2a tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Getting quotas for user 252c87e244984f71ae0907ee769bec05 and project c23bd5a8b84942898a99930b2bc0ca12. Resources: {'key_pairs'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:44:07.832879 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-3b20394c-dec6-4ce4-9055-4301e76e37c1 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c53d79930a4eaf9fcf7cd10707fbf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22fd8f3b0334cb3b1af66cf626422fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:07.845257 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3b20394c-dec6-4ce4-9055-4301e76e37c1 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] 10.222.0.33 "GET /compute/v2.1/servers/15e9bc0f-2262-4e2c-9cac-0eca4575943c" status: 200 len: 1290 microversion: 2.1 time: 0.358619 Sep 23 04:44:07.847146 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1550/3067] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:07 2022] GET /compute/v2.1/servers/15e9bc0f-2262-4e2c-9cac-0eca4575943c => generated 1290 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:07.859676 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-c199a6f2-286f-4d4f-87ae-38029f24f510 req-a5b5a491-426c-4205-a5f4-a051d8765f36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cea388e-a568-48be-9f76-b673509a7824", "name": "network-vif-plugged", "status": "completed", "tag": "74832ded-447e-411f-ad28-f9a01aaa0cba"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:44:07.877122 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-c199a6f2-286f-4d4f-87ae-38029f24f510 req-a5b5a491-426c-4205-a5f4-a051d8765f36 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:07.878866 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-c199a6f2-286f-4d4f-87ae-38029f24f510 req-a5b5a491-426c-4205-a5f4-a051d8765f36 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:07.879549 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-c199a6f2-286f-4d4f-87ae-38029f24f510 req-a5b5a491-426c-4205-a5f4-a051d8765f36 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:07.898224 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-c199a6f2-286f-4d4f-87ae-38029f24f510 req-a5b5a491-426c-4205-a5f4-a051d8765f36 service nova] Creating event network-vif-plugged:74832ded-447e-411f-ad28-f9a01aaa0cba for instance 2cea388e-a568-48be-9f76-b673509a7824 on n-h1-846463-3 Sep 23 04:44:07.906619 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-c199a6f2-286f-4d4f-87ae-38029f24f510 req-a5b5a491-426c-4205-a5f4-a051d8765f36 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056947 Sep 23 04:44:07.908066 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1551/3068] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:44:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:44:07.915610 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-569abeeb-e589-47d7-baf3-82436607661b tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:07.922126 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-569abeeb-e589-47d7-baf3-82436607661b tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] [instance: bcdc202d-96f2-4640-8e81-f786d5e15793] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:07.932593 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-569abeeb-e589-47d7-baf3-82436607661b tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:07.933358 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-569abeeb-e589-47d7-baf3-82436607661b tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:07.935253 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-569abeeb-e589-47d7-baf3-82436607661b tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:07.936139 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-569abeeb-e589-47d7-baf3-82436607661b tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:07.936761 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-569abeeb-e589-47d7-baf3-82436607661b tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:07.937343 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-569abeeb-e589-47d7-baf3-82436607661b tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:07.950913 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a89d9e2b-4df8-4bcc-93f9-0a509e53be2a tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 381 microversion: 2.1 time: 0.242089 Sep 23 04:44:07.958259 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1518/3069] 10.222.0.33 () {60 vars in 1159 bytes} [Fri Sep 23 04:44:07 2022] POST /compute/v2.1/os-keypairs => generated 381 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:44:07.963816 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-bcbd7a0d-6cb7-432a-8382-5dcff7e46f6b tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '.version_select at 0x7ff1baa04160>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:07.974877 n-d-846463-3 devstack@n-api.service[122698]: WARNING oslo_db.sqlalchemy.utils [None req-bcbd7a0d-6cb7-432a-8382-5dcff7e46f6b tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 23 04:44:07.986161 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-bcbd7a0d-6cb7-432a-8382-5dcff7e46f6b tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/os-keypairs" status: 200 len: 350 microversion: 2.1 time: 0.026253 Sep 23 04:44:07.994916 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1519/3070] 10.222.0.33 () {58 vars in 1137 bytes} [Fri Sep 23 04:44:07 2022] GET /compute/v2.1/os-keypairs => generated 350 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:44:08.046155 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-e21fc266-8690-4e9f-a671-41ab5617ec98 req-4fbd9b5f-d58d-4898-b9a2-6f6d6c15309d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcdc202d-96f2-4640-8e81-f786d5e15793", "name": "network-vif-deleted", "tag": "ddea8eb8-0e1d-414f-9d9f-d8a108d70e38"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:44:08.118804 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-569abeeb-e589-47d7-baf3-82436607661b tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18998e15712495b83c222edc234349e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0a5691a27f143eda1faf12fbbd9696c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:08.126216 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-e21fc266-8690-4e9f-a671-41ab5617ec98 req-4fbd9b5f-d58d-4898-b9a2-6f6d6c15309d service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:08.126710 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-e21fc266-8690-4e9f-a671-41ab5617ec98 req-4fbd9b5f-d58d-4898-b9a2-6f6d6c15309d service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:08.127322 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-e21fc266-8690-4e9f-a671-41ab5617ec98 req-4fbd9b5f-d58d-4898-b9a2-6f6d6c15309d service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:08.135056 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-569abeeb-e589-47d7-baf3-82436607661b tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] 10.222.0.33 "GET /compute/v2.1/servers/bcdc202d-96f2-4640-8e81-f786d5e15793" status: 200 len: 1302 microversion: 2.1 time: 0.223641 Sep 23 04:44:08.139276 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1552/3071] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:07 2022] GET /compute/v2.1/servers/bcdc202d-96f2-4640-8e81-f786d5e15793 => generated 1302 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:08.175575 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-e21fc266-8690-4e9f-a671-41ab5617ec98 req-4fbd9b5f-d58d-4898-b9a2-6f6d6c15309d service nova] Creating event network-vif-deleted:ddea8eb8-0e1d-414f-9d9f-d8a108d70e38 for instance bcdc202d-96f2-4640-8e81-f786d5e15793 on n-h2-846463-3 Sep 23 04:44:08.190780 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-e21fc266-8690-4e9f-a671-41ab5617ec98 req-4fbd9b5f-d58d-4898-b9a2-6f6d6c15309d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.171315 Sep 23 04:44:08.193693 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1520/3072] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:44:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:44:08.283159 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-733a5ad5-787f-4c51-8433-6146759ec2f9 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-2072902680", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "key_name": "tempest-key-897099014", "networks": [{"uuid": "e70e4da0-3337-4af1-b4df-8067d676f5e8"}]}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:44:08.361019 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0da0dff6-d230-468a-bca7-c624f0ba245a tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:08.362041 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-0da0dff6-d230-468a-bca7-c624f0ba245a tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] [instance: b903ed91-8ea3-4c20-8565-b190d442e723] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:08.373195 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0da0dff6-d230-468a-bca7-c624f0ba245a tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:08.375456 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0da0dff6-d230-468a-bca7-c624f0ba245a tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:08.376448 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0da0dff6-d230-468a-bca7-c624f0ba245a tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:08.378119 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0da0dff6-d230-468a-bca7-c624f0ba245a tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:08.380772 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0da0dff6-d230-468a-bca7-c624f0ba245a tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:08.381820 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0da0dff6-d230-468a-bca7-c624f0ba245a tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:08.444447 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.neutron [None req-733a5ad5-787f-4c51-8433-6146759ec2f9 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] validate_networks() for [('e70e4da0-3337-4af1-b4df-8067d676f5e8', None, None, None, None, None)] {{(pid=122699) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:44:08.507418 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-0da0dff6-d230-468a-bca7-c624f0ba245a tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e235519204b4efc8b6c7e2988fab9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0b7307c30a4c118da4c501691e349f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:08.518336 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0da0dff6-d230-468a-bca7-c624f0ba245a tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] 10.222.0.33 "GET /compute/v2.1/servers/b903ed91-8ea3-4c20-8565-b190d442e723" status: 200 len: 1269 microversion: 2.1 time: 0.161184 Sep 23 04:44:08.519082 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1521/3073] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:08 2022] GET /compute/v2.1/servers/b903ed91-8ea3-4c20-8565-b190d442e723 => generated 1269 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:08.602464 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3180abe3-212e-4734-990a-9e83022ac571 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:08.603201 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3180abe3-212e-4734-990a-9e83022ac571 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] [instance: dc73bb47-24fc-4b26-a371-c9cb0719748b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:08.616666 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3180abe3-212e-4734-990a-9e83022ac571 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:08.621291 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3180abe3-212e-4734-990a-9e83022ac571 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:08.624203 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3180abe3-212e-4734-990a-9e83022ac571 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:08.627666 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3180abe3-212e-4734-990a-9e83022ac571 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:08.630117 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3180abe3-212e-4734-990a-9e83022ac571 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:08.630117 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3180abe3-212e-4734-990a-9e83022ac571 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:09.156758 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-3180abe3-212e-4734-990a-9e83022ac571 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2d38f8f2244a81bf0935a121f039fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42090b82fbf8462eb96c0e69210aa460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:09.166100 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3180abe3-212e-4734-990a-9e83022ac571 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] 10.222.0.33 "GET /compute/v2.1/servers/dc73bb47-24fc-4b26-a371-c9cb0719748b" status: 200 len: 1521 microversion: 2.1 time: 0.569157 Sep 23 04:44:09.172163 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1522/3074] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:08 2022] GET /compute/v2.1/servers/dc73bb47-24fc-4b26-a371-c9cb0719748b => generated 1521 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:44:09.186138 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2a8898c4-bbc6-45bb-89ca-1ee01d261672 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '.version_select at 0x7ff1bafe3d30>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:09.270553 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2a8898c4-bbc6-45bb-89ca-1ee01d261672 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/images/e161c9e7-af1d-4409-9a40-1f3f8885ed79" status: 200 len: 1414 microversion: 2.1 time: 0.096460 Sep 23 04:44:09.271244 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1523/3075] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:44:09 2022] GET /compute/v2.1/images/e161c9e7-af1d-4409-9a40-1f3f8885ed79 => generated 1414 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:09.293960 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-aeceb5a1-19ae-4c04-8915-7bd4d2067e17 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:09.295105 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-aeceb5a1-19ae-4c04-8915-7bd4d2067e17 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] [instance: 15e9bc0f-2262-4e2c-9cac-0eca4575943c] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:09.303911 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-aeceb5a1-19ae-4c04-8915-7bd4d2067e17 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:09.304781 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-aeceb5a1-19ae-4c04-8915-7bd4d2067e17 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:09.306958 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-aeceb5a1-19ae-4c04-8915-7bd4d2067e17 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:09.307907 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-aeceb5a1-19ae-4c04-8915-7bd4d2067e17 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:09.308538 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-aeceb5a1-19ae-4c04-8915-7bd4d2067e17 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:09.309167 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-aeceb5a1-19ae-4c04-8915-7bd4d2067e17 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:09.883249 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-733a5ad5-787f-4c51-8433-6146759ec2f9 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Flavor limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:44:09.883249 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-733a5ad5-787f-4c51-8433-6146759ec2f9 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Image limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:44:09.883249 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-733a5ad5-787f-4c51-8433-6146759ec2f9 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Flavor pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:44:09.883249 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-733a5ad5-787f-4c51-8433-6146759ec2f9 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Image pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:44:09.883249 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-733a5ad5-787f-4c51-8433-6146759ec2f9 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:44:09.884113 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-aeceb5a1-19ae-4c04-8915-7bd4d2067e17 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c53d79930a4eaf9fcf7cd10707fbf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22fd8f3b0334cb3b1af66cf626422fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:09.885521 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-aeceb5a1-19ae-4c04-8915-7bd4d2067e17 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] 10.222.0.33 "GET /compute/v2.1/servers/15e9bc0f-2262-4e2c-9cac-0eca4575943c" status: 200 len: 1332 microversion: 2.1 time: 0.603641 Sep 23 04:44:09.888437 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1524/3076] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:09 2022] GET /compute/v2.1/servers/15e9bc0f-2262-4e2c-9cac-0eca4575943c => generated 1332 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:09.897522 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-844970fa-c2c0-43d5-8c32-1f10ae0a2467 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:09.898543 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-844970fa-c2c0-43d5-8c32-1f10ae0a2467 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] [instance: bcdc202d-96f2-4640-8e81-f786d5e15793] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:09.915695 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-844970fa-c2c0-43d5-8c32-1f10ae0a2467 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:09.918615 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-733a5ad5-787f-4c51-8433-6146759ec2f9 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:09.919209 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-844970fa-c2c0-43d5-8c32-1f10ae0a2467 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:09.919675 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-844970fa-c2c0-43d5-8c32-1f10ae0a2467 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:09.920420 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-844970fa-c2c0-43d5-8c32-1f10ae0a2467 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:09.920890 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-844970fa-c2c0-43d5-8c32-1f10ae0a2467 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:09.921331 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-844970fa-c2c0-43d5-8c32-1f10ae0a2467 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:09.921727 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-733a5ad5-787f-4c51-8433-6146759ec2f9 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:09.922993 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-733a5ad5-787f-4c51-8433-6146759ec2f9 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:09.925476 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-733a5ad5-787f-4c51-8433-6146759ec2f9 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:09.927755 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-733a5ad5-787f-4c51-8433-6146759ec2f9 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:09.929196 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-733a5ad5-787f-4c51-8433-6146759ec2f9 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:09.955424 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-844970fa-c2c0-43d5-8c32-1f10ae0a2467 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] HTTP exception thrown: Instance bcdc202d-96f2-4640-8e81-f786d5e15793 could not be found. Sep 23 04:44:09.959086 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-844970fa-c2c0-43d5-8c32-1f10ae0a2467 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Request method failure captured: Sep 23 04:44:09.959086 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/bcdc202d-96f2-4640-8e81-f786d5e15793 HTTP/1.1 Sep 23 04:44:09.959086 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:44:09.959086 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:44:09.959086 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:44:09.959086 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:44:09.959086 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:44:09.959086 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:44:09.959086 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:44:09.959086 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:44:09.959086 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTl0yFzighKafdD9m_XqihcRNCzjZ6OBAnutxohVdHg1nsCLrbZME4qTF-7GLwiTD8FgfedDbUyOKeh9bvgr3VqoIBzpjjA6-oTYOkkTdzkCKVjcBj8UMC2Ku2ZWT3RNNe3sqPx7cFkSPs0Pv0aVmvRb2luG_DKUbYim1oob004itn4 Sep 23 04:44:09.959086 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:44:09.959086 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:44:09.959086 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:44:09.959086 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:44:09.959086 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:44:09.959086 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:44:09.959086 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: f0a5691a27f143eda1faf12fbbd9696c Sep 23 04:44:09.959086 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ServerAddressesTestJSON-1876914846 Sep 23 04:44:09.959086 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:44:09.959086 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:44:09.959086 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f0a5691a27f143eda1faf12fbbd9696c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f0a5691a27f143eda1faf12fbbd9696c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f0a5691a27f143eda1faf12fbbd9696c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f0a5691a27f143eda1faf12fbbd9696c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:44:09.959086 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ServerAddressesTestJSON-1876914846 Sep 23 04:44:09.959086 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: f0a5691a27f143eda1faf12fbbd9696c Sep 23 04:44:09.959086 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ServerAddressesTestJSON-1876914846 Sep 23 04:44:09.959086 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ServerAddressesTestJSON-1876914846-project Sep 23 04:44:09.959086 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:44:09.959086 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:44:09.959086 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: c18998e15712495b83c222edc234349e Sep 23 04:44:09.959086 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ServerAddressesTestJSON-1876914846-project Sep 23 04:44:09.959086 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:44:09.959086 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance bcdc202d-96f2-4640-8e81-f786d5e15793 could not be found. Sep 23 04:44:09.959086 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': 'bcdc202d-96f2-4640-8e81-f786d5e15793'} Sep 23 04:44:09.959086 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:44:09.959086 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:44:09.959086 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:44:09.959086 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:44:09.959086 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:44:09.959086 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:44:09.959086 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:44:09.959086 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:44:09.959086 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:44:09.959086 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:44:09.959086 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bcdc202d-96f2-4640-8e81-f786d5e15793 could not be found. Sep 23 04:44:09.959086 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:44:09.959086 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:44:09.959086 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:44:09.959086 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:44:09.959086 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:44:09.959086 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:44:09.959086 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:44:09.959086 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:44:09.959086 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:44:09.959086 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:44:09.959086 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:44:09.959086 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:44:09.959086 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:44:09.959086 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:44:09.959086 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:44:09.959086 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:44:09.959086 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bcdc202d-96f2-4640-8e81-f786d5e15793 could not be found. Sep 23 04:44:09.959086 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:44:09.959086 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:44:09.959086 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:44:09.964333 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:44:09.964333 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:44:09.964333 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:44:09.964333 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:44:09.964333 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:44:09.964333 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bcdc202d-96f2-4640-8e81-f786d5e15793 could not be found. Sep 23 04:44:09.964333 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:44:09.967618 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-844970fa-c2c0-43d5-8c32-1f10ae0a2467 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] Returning 404 to user: Instance bcdc202d-96f2-4640-8e81-f786d5e15793 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:44:09.970288 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-844970fa-c2c0-43d5-8c32-1f10ae0a2467 tempest-ServerAddressesTestJSON-1876914846 tempest-ServerAddressesTestJSON-1876914846-project] 10.222.0.33 "GET /compute/v2.1/servers/bcdc202d-96f2-4640-8e81-f786d5e15793" status: 404 len: 111 microversion: 2.1 time: 0.080656 Sep 23 04:44:09.977643 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1525/3077] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:09 2022] GET /compute/v2.1/servers/bcdc202d-96f2-4640-8e81-f786d5e15793 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:44:09.985512 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-160282a0-8e13-4754-8028-cd15df23c857 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:09.988111 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-160282a0-8e13-4754-8028-cd15df23c857 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] [instance: dc73bb47-24fc-4b26-a371-c9cb0719748b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:10.002647 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-160282a0-8e13-4754-8028-cd15df23c857 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:10.003715 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-160282a0-8e13-4754-8028-cd15df23c857 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:10.004835 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-160282a0-8e13-4754-8028-cd15df23c857 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:10.005773 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-160282a0-8e13-4754-8028-cd15df23c857 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:10.008546 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-160282a0-8e13-4754-8028-cd15df23c857 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:10.009191 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-160282a0-8e13-4754-8028-cd15df23c857 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:10.056766 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-733a5ad5-787f-4c51-8433-6146759ec2f9 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Getting quotas for project c23bd5a8b84942898a99930b2bc0ca12. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:44:10.103027 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-160282a0-8e13-4754-8028-cd15df23c857 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] HTTP exception thrown: Action 999 not found Sep 23 04:44:10.113407 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-160282a0-8e13-4754-8028-cd15df23c857 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Request method failure captured: Sep 23 04:44:10.113407 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/dc73bb47-24fc-4b26-a371-c9cb0719748b/os-instance-actions/999 HTTP/1.1 Sep 23 04:44:10.113407 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:44:10.113407 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:44:10.113407 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:44:10.113407 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:44:10.113407 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:44:10.113407 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:44:10.113407 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:44:10.113407 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:44:10.113407 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTl-7-DuuekLkM8jni6XElIut--UdDsxZQaDDrhVYNE2BIqflIl1RWa1u49UHAUDR0oh0nhqOHHecIEgUN_GZTzG7BDFsk1rcrqRgjQFgwn2c8YsUqYiQrDsIB8atnLoikOrSPeymCaV_jDdML1mYtwihcTfl4FZEZMxBtnYRx5MwXQ Sep 23 04:44:10.113407 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:44:10.113407 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:44:10.113407 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:44:10.113407 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:44:10.113407 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:44:10.113407 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:44:10.113407 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 42090b82fbf8462eb96c0e69210aa460 Sep 23 04:44:10.113407 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-550699681 Sep 23 04:44:10.113407 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:44:10.113407 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:44:10.113407 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_42090b82fbf8462eb96c0e69210aa460", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/42090b82fbf8462eb96c0e69210aa460"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/42090b82fbf8462eb96c0e69210aa460"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/42090b82fbf8462eb96c0e69210aa460"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:44:10.113407 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-550699681 Sep 23 04:44:10.113407 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 42090b82fbf8462eb96c0e69210aa460 Sep 23 04:44:10.113407 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-550699681 Sep 23 04:44:10.113407 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-InstanceActionsNegativeTestJSON-550699681-project Sep 23 04:44:10.113407 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:44:10.113407 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:44:10.113407 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 0d2d38f8f2244a81bf0935a121f039fe Sep 23 04:44:10.113407 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-550699681-project Sep 23 04:44:10.113407 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:44:10.113407 n-d-846463-3 devstack@n-api.service[122698]: exception: Action 999 not found Sep 23 04:44:10.113407 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'server_id': 'dc73bb47-24fc-4b26-a371-c9cb0719748b', 'id': '999'} Sep 23 04:44:10.113407 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:44:10.113407 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:44:10.113407 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:44:10.113407 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:44:10.113407 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:44:10.113407 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:44:10.113407 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:44:10.113407 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:44:10.113407 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Sep 23 04:44:10.113407 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 23 04:44:10.113407 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Sep 23 04:44:10.113407 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:44:10.113407 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:44:10.113407 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:44:10.113407 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:44:10.113407 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:44:10.113407 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:44:10.113407 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:44:10.113407 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:44:10.113407 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Sep 23 04:44:10.113407 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:44:10.117689 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-733a5ad5-787f-4c51-8433-6146759ec2f9 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Getting quotas for user 252c87e244984f71ae0907ee769bec05 and project c23bd5a8b84942898a99930b2bc0ca12. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:44:10.118595 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-160282a0-8e13-4754-8028-cd15df23c857 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Returning 404 to user: Action 999 not found {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:44:10.119671 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-160282a0-8e13-4754-8028-cd15df23c857 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] 10.222.0.33 "GET /compute/v2.1/servers/dc73bb47-24fc-4b26-a371-c9cb0719748b/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.140744 Sep 23 04:44:10.120951 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1526/3078] 10.222.0.33 () {58 vars in 1308 bytes} [Fri Sep 23 04:44:09 2022] GET /compute/v2.1/servers/dc73bb47-24fc-4b26-a371-c9cb0719748b/os-instance-actions/999 => generated 66 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 23 04:44:10.143569 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-286a9726-bf26-4854-a309-7a16822ea9da tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:10.149215 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-286a9726-bf26-4854-a309-7a16822ea9da tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] [instance: b903ed91-8ea3-4c20-8565-b190d442e723] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:10.165859 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-286a9726-bf26-4854-a309-7a16822ea9da tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:10.172801 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-286a9726-bf26-4854-a309-7a16822ea9da tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:10.176881 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-286a9726-bf26-4854-a309-7a16822ea9da tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:10.181253 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-286a9726-bf26-4854-a309-7a16822ea9da tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:10.183574 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-286a9726-bf26-4854-a309-7a16822ea9da tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:10.183976 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-733a5ad5-787f-4c51-8433-6146759ec2f9 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Going to run 1 instances... {{(pid=122699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:44:10.186003 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-286a9726-bf26-4854-a309-7a16822ea9da tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:10.195118 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-733a5ad5-787f-4c51-8433-6146759ec2f9 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 874db366-9e32-40a4-bddb-ec587a81b865] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:44:10.446524 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-733a5ad5-787f-4c51-8433-6146759ec2f9 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.164131 Sep 23 04:44:10.446945 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-286a9726-bf26-4854-a309-7a16822ea9da tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e235519204b4efc8b6c7e2988fab9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0b7307c30a4c118da4c501691e349f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:10.462865 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1553/3079] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:44:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 2171 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:44:10.462865 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9356a9fd-8640-401a-8231-fe5706b69e9d tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Calling method '.version_select at 0x7ff1bb712280>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:10.463775 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-286a9726-bf26-4854-a309-7a16822ea9da tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] 10.222.0.33 "GET /compute/v2.1/servers/b903ed91-8ea3-4c20-8565-b190d442e723" status: 200 len: 1275 microversion: 2.1 time: 0.336715 Sep 23 04:44:10.463775 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1527/3080] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:10 2022] GET /compute/v2.1/servers/b903ed91-8ea3-4c20-8565-b190d442e723 => generated 1275 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:10.463940 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-9356a9fd-8640-401a-8231-fe5706b69e9d tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] [instance: 435991ef-faf1-4816-978b-3afeb8ec5fbb] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:10.478779 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-224b5f2d-cf40-49bf-8c07-bbb3c9132d39 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '.version_select at 0x7ff1baa54d30>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:10.482244 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-9356a9fd-8640-401a-8231-fe5706b69e9d tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] HTTP exception thrown: Instance 435991ef-faf1-4816-978b-3afeb8ec5fbb could not be found. Sep 23 04:44:10.492122 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9356a9fd-8640-401a-8231-fe5706b69e9d tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Request method failure captured: Sep 23 04:44:10.492122 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/435991ef-faf1-4816-978b-3afeb8ec5fbb/os-instance-actions HTTP/1.1 Sep 23 04:44:10.492122 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:44:10.492122 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:44:10.492122 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:44:10.492122 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:44:10.492122 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:44:10.492122 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:44:10.492122 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:44:10.492122 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:44:10.492122 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTl-7-DuuekLkM8jni6XElIut--UdDsxZQaDDrhVYNE2BIqflIl1RWa1u49UHAUDR0oh0nhqOHHecIEgUN_GZTzG7BDFsk1rcrqRgjQFgwn2c8YsUqYiQrDsIB8atnLoikOrSPeymCaV_jDdML1mYtwihcTfl4FZEZMxBtnYRx5MwXQ Sep 23 04:44:10.492122 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:44:10.492122 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:44:10.492122 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:44:10.492122 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:44:10.492122 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:44:10.492122 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:44:10.492122 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 42090b82fbf8462eb96c0e69210aa460 Sep 23 04:44:10.492122 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-550699681 Sep 23 04:44:10.492122 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:44:10.492122 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:44:10.492122 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_42090b82fbf8462eb96c0e69210aa460", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/42090b82fbf8462eb96c0e69210aa460"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/42090b82fbf8462eb96c0e69210aa460"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/42090b82fbf8462eb96c0e69210aa460"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:44:10.492122 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-550699681 Sep 23 04:44:10.492122 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 42090b82fbf8462eb96c0e69210aa460 Sep 23 04:44:10.492122 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-550699681 Sep 23 04:44:10.492122 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-InstanceActionsNegativeTestJSON-550699681-project Sep 23 04:44:10.492122 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:44:10.492122 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:44:10.492122 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 0d2d38f8f2244a81bf0935a121f039fe Sep 23 04:44:10.492122 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-550699681-project Sep 23 04:44:10.492122 n-d-846463-3 devstack@n-api.service[122699]: method: Sep 23 04:44:10.492122 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 435991ef-faf1-4816-978b-3afeb8ec5fbb could not be found. Sep 23 04:44:10.492122 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'server_id': '435991ef-faf1-4816-978b-3afeb8ec5fbb'} Sep 23 04:44:10.492122 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:44:10.492122 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:44:10.492122 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:44:10.492122 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:44:10.492122 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:44:10.492122 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:44:10.492122 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 23 04:44:10.492122 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 23 04:44:10.492122 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 435991ef-faf1-4816-978b-3afeb8ec5fbb could not be found. Sep 23 04:44:10.492122 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:44:10.492122 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:44:10.492122 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:44:10.492122 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:44:10.492122 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:44:10.492122 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:44:10.492122 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:44:10.492122 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:44:10.492122 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:44:10.492122 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:44:10.492122 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:44:10.492122 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:44:10.492122 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Sep 23 04:44:10.492122 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Sep 23 04:44:10.492122 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:44:10.492122 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:44:10.492122 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Sep 23 04:44:10.492122 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Sep 23 04:44:10.492122 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:44:10.492122 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:44:10.496000 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 435991ef-faf1-4816-978b-3afeb8ec5fbb could not be found. Sep 23 04:44:10.496000 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:44:10.496000 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:44:10.496000 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:44:10.496000 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:44:10.496000 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:44:10.496000 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:44:10.496000 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:44:10.496000 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:44:10.496000 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 435991ef-faf1-4816-978b-3afeb8ec5fbb could not be found. Sep 23 04:44:10.496000 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:44:10.496000 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9356a9fd-8640-401a-8231-fe5706b69e9d tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Returning 404 to user: Instance 435991ef-faf1-4816-978b-3afeb8ec5fbb could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:44:10.496000 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-9356a9fd-8640-401a-8231-fe5706b69e9d tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] 10.222.0.33 "GET /compute/v2.1/servers/435991ef-faf1-4816-978b-3afeb8ec5fbb/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.038505 Sep 23 04:44:10.496000 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1554/3081] 10.222.0.33 () {58 vars in 1296 bytes} [Fri Sep 23 04:44:10 2022] GET /compute/v2.1/servers/435991ef-faf1-4816-978b-3afeb8ec5fbb/os-instance-actions => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:44:10.516804 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7dad35cd-6bff-4261-abb2-06666279930b tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:10.532147 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-7dad35cd-6bff-4261-abb2-06666279930b tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 874db366-9e32-40a4-bddb-ec587a81b865] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:10.562939 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-224b5f2d-cf40-49bf-8c07-bbb3c9132d39 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/images/e161c9e7-af1d-4409-9a40-1f3f8885ed79" status: 200 len: 1414 microversion: 2.1 time: 0.100454 Sep 23 04:44:10.563515 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1528/3082] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:44:10 2022] GET /compute/v2.1/images/e161c9e7-af1d-4409-9a40-1f3f8885ed79 => generated 1414 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:10.588159 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a12b3548-4ac7-415c-a24b-7c605d1af4a5 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:10.588883 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a12b3548-4ac7-415c-a24b-7c605d1af4a5 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] [instance: dc73bb47-24fc-4b26-a371-c9cb0719748b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:10.600999 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a12b3548-4ac7-415c-a24b-7c605d1af4a5 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:10.600999 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a12b3548-4ac7-415c-a24b-7c605d1af4a5 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:10.600999 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a12b3548-4ac7-415c-a24b-7c605d1af4a5 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:10.600999 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a12b3548-4ac7-415c-a24b-7c605d1af4a5 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:10.600999 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a12b3548-4ac7-415c-a24b-7c605d1af4a5 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:10.606066 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a12b3548-4ac7-415c-a24b-7c605d1af4a5 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:10.683550 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a12b3548-4ac7-415c-a24b-7c605d1af4a5 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] [instance: dc73bb47-24fc-4b26-a371-c9cb0719748b] Going to try to terminate instance {{(pid=122698) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:44:10.764430 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-7dad35cd-6bff-4261-abb2-06666279930b tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:10.772264 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-7dad35cd-6bff-4261-abb2-06666279930b tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/874db366-9e32-40a4-bddb-ec587a81b865" status: 200 len: 1228 microversion: 2.1 time: 0.279392 Sep 23 04:44:10.774569 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1555/3083] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:10 2022] GET /compute/v2.1/servers/874db366-9e32-40a4-bddb-ec587a81b865 => generated 1228 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:10.912350 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-cbfd9377-2545-49e4-aeb4-9c80a3a28c89 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:10.913056 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-cbfd9377-2545-49e4-aeb4-9c80a3a28c89 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] [instance: 15e9bc0f-2262-4e2c-9cac-0eca4575943c] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:10.931963 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cbfd9377-2545-49e4-aeb4-9c80a3a28c89 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:10.932816 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cbfd9377-2545-49e4-aeb4-9c80a3a28c89 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:10.933467 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cbfd9377-2545-49e4-aeb4-9c80a3a28c89 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:10.934446 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cbfd9377-2545-49e4-aeb4-9c80a3a28c89 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:10.935123 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cbfd9377-2545-49e4-aeb4-9c80a3a28c89 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:10.935743 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cbfd9377-2545-49e4-aeb4-9c80a3a28c89 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:11.197983 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a12b3548-4ac7-415c-a24b-7c605d1af4a5 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] 10.222.0.33 "DELETE /compute/v2.1/servers/dc73bb47-24fc-4b26-a371-c9cb0719748b" status: 204 len: 0 microversion: 2.1 time: 0.618303 Sep 23 04:44:11.197983 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1529/3084] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:44:10 2022] DELETE /compute/v2.1/servers/dc73bb47-24fc-4b26-a371-c9cb0719748b => generated 0 bytes in 625 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:44:11.205160 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8d7e59b2-3a98-428e-8cf3-902c9e66a1e1 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:11.220421 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8d7e59b2-3a98-428e-8cf3-902c9e66a1e1 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] [instance: dc73bb47-24fc-4b26-a371-c9cb0719748b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:11.248126 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8d7e59b2-3a98-428e-8cf3-902c9e66a1e1 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:11.256092 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8d7e59b2-3a98-428e-8cf3-902c9e66a1e1 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:11.256092 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8d7e59b2-3a98-428e-8cf3-902c9e66a1e1 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:11.256092 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8d7e59b2-3a98-428e-8cf3-902c9e66a1e1 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:11.256513 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8d7e59b2-3a98-428e-8cf3-902c9e66a1e1 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:11.258808 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8d7e59b2-3a98-428e-8cf3-902c9e66a1e1 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:11.269844 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-cbfd9377-2545-49e4-aeb4-9c80a3a28c89 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c53d79930a4eaf9fcf7cd10707fbf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22fd8f3b0334cb3b1af66cf626422fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:11.272838 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:44:11.286380 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-cbfd9377-2545-49e4-aeb4-9c80a3a28c89 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] 10.222.0.33 "GET /compute/v2.1/servers/15e9bc0f-2262-4e2c-9cac-0eca4575943c" status: 200 len: 1332 microversion: 2.1 time: 0.378148 Sep 23 04:44:11.287434 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1556/3085] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:10 2022] GET /compute/v2.1/servers/15e9bc0f-2262-4e2c-9cac-0eca4575943c => generated 1332 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:44:11.488807 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-32693e24-e8dd-4977-87c4-a49b5e510868 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:11.489436 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-32693e24-e8dd-4977-87c4-a49b5e510868 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] [instance: b903ed91-8ea3-4c20-8565-b190d442e723] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:11.508108 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-32693e24-e8dd-4977-87c4-a49b5e510868 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:11.508615 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-32693e24-e8dd-4977-87c4-a49b5e510868 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:11.509065 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-32693e24-e8dd-4977-87c4-a49b5e510868 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:11.509792 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-32693e24-e8dd-4977-87c4-a49b5e510868 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:11.519471 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-32693e24-e8dd-4977-87c4-a49b5e510868 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:11.520790 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-32693e24-e8dd-4977-87c4-a49b5e510868 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:12.244643 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-32693e24-e8dd-4977-87c4-a49b5e510868 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e235519204b4efc8b6c7e2988fab9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0b7307c30a4c118da4c501691e349f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:12.258397 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-32693e24-e8dd-4977-87c4-a49b5e510868 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] 10.222.0.33 "GET /compute/v2.1/servers/b903ed91-8ea3-4c20-8565-b190d442e723" status: 200 len: 1317 microversion: 2.1 time: 0.773466 Sep 23 04:44:12.260360 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8d7e59b2-3a98-428e-8cf3-902c9e66a1e1 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2d38f8f2244a81bf0935a121f039fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42090b82fbf8462eb96c0e69210aa460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:12.281916 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1557/3086] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:11 2022] GET /compute/v2.1/servers/b903ed91-8ea3-4c20-8565-b190d442e723 => generated 1317 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:44:12.282128 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8d7e59b2-3a98-428e-8cf3-902c9e66a1e1 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] 10.222.0.33 "GET /compute/v2.1/servers/dc73bb47-24fc-4b26-a371-c9cb0719748b" status: 200 len: 1527 microversion: 2.1 time: 1.075340 Sep 23 04:44:12.282128 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1530/3087] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:11 2022] GET /compute/v2.1/servers/dc73bb47-24fc-4b26-a371-c9cb0719748b => generated 1527 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:12.286301 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f67daaaf-b08e-46de-905b-b1f2bcf25b2d tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:12.286462 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ad7b8ff6-94d7-4199-8965-0372c8fcdea2 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '.version_select at 0x7ff1bb8d55e0>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:12.300916 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f67daaaf-b08e-46de-905b-b1f2bcf25b2d tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 874db366-9e32-40a4-bddb-ec587a81b865] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:12.340914 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f67daaaf-b08e-46de-905b-b1f2bcf25b2d tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:12.348171 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f67daaaf-b08e-46de-905b-b1f2bcf25b2d tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:12.348931 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f67daaaf-b08e-46de-905b-b1f2bcf25b2d tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:12.353189 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f67daaaf-b08e-46de-905b-b1f2bcf25b2d tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:12.364109 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f67daaaf-b08e-46de-905b-b1f2bcf25b2d tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:12.367109 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f67daaaf-b08e-46de-905b-b1f2bcf25b2d tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:12.405106 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ad7b8ff6-94d7-4199-8965-0372c8fcdea2 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/images/e161c9e7-af1d-4409-9a40-1f3f8885ed79" status: 200 len: 1414 microversion: 2.1 time: 0.135252 Sep 23 04:44:12.413774 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1558/3088] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:44:12 2022] GET /compute/v2.1/images/e161c9e7-af1d-4409-9a40-1f3f8885ed79 => generated 1414 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:12.417827 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a70e7cd2-5eec-4dcc-a55d-8e067e5c0eba tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:12.428117 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a70e7cd2-5eec-4dcc-a55d-8e067e5c0eba tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] [instance: 15e9bc0f-2262-4e2c-9cac-0eca4575943c] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:12.446568 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a70e7cd2-5eec-4dcc-a55d-8e067e5c0eba tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:12.447076 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a70e7cd2-5eec-4dcc-a55d-8e067e5c0eba tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:12.447520 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a70e7cd2-5eec-4dcc-a55d-8e067e5c0eba tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:12.448239 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a70e7cd2-5eec-4dcc-a55d-8e067e5c0eba tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:12.448697 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a70e7cd2-5eec-4dcc-a55d-8e067e5c0eba tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:12.459517 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a70e7cd2-5eec-4dcc-a55d-8e067e5c0eba tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:13.306962 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f67daaaf-b08e-46de-905b-b1f2bcf25b2d tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:13.316859 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f67daaaf-b08e-46de-905b-b1f2bcf25b2d tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/874db366-9e32-40a4-bddb-ec587a81b865" status: 200 len: 1232 microversion: 2.1 time: 1.038081 Sep 23 04:44:13.321975 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1531/3089] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:12 2022] GET /compute/v2.1/servers/874db366-9e32-40a4-bddb-ec587a81b865 => generated 1232 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:13.335087 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-f5cb950a-de09-4032-adcd-d824652a2dac req-f3c12aed-8b82-4572-9867-d954ec10f8e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15e9bc0f-2262-4e2c-9cac-0eca4575943c", "tag": "c81ebfeb-05fd-445f-bb49-70dc27b6c143"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:44:13.362485 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-f5cb950a-de09-4032-adcd-d824652a2dac req-f3c12aed-8b82-4572-9867-d954ec10f8e1 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:13.366723 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-f5cb950a-de09-4032-adcd-d824652a2dac req-f3c12aed-8b82-4572-9867-d954ec10f8e1 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:13.367688 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-f5cb950a-de09-4032-adcd-d824652a2dac req-f3c12aed-8b82-4572-9867-d954ec10f8e1 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:13.408215 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-f5cb950a-de09-4032-adcd-d824652a2dac req-f3c12aed-8b82-4572-9867-d954ec10f8e1 service nova] Creating event network-changed:c81ebfeb-05fd-445f-bb49-70dc27b6c143 for instance 15e9bc0f-2262-4e2c-9cac-0eca4575943c on n-h2-846463-3 Sep 23 04:44:13.421680 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-f5cb950a-de09-4032-adcd-d824652a2dac req-f3c12aed-8b82-4572-9867-d954ec10f8e1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097961 Sep 23 04:44:13.426746 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1532/3090] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:44:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:44:13.440729 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b9b28ddd-6cef-479d-a8d0-795aa7d029eb tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:13.441062 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b9b28ddd-6cef-479d-a8d0-795aa7d029eb tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] [instance: b903ed91-8ea3-4c20-8565-b190d442e723] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:13.460778 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b9b28ddd-6cef-479d-a8d0-795aa7d029eb tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:13.461286 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b9b28ddd-6cef-479d-a8d0-795aa7d029eb tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:13.461736 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b9b28ddd-6cef-479d-a8d0-795aa7d029eb tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:13.462506 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b9b28ddd-6cef-479d-a8d0-795aa7d029eb tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:13.470537 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b9b28ddd-6cef-479d-a8d0-795aa7d029eb tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:13.471101 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b9b28ddd-6cef-479d-a8d0-795aa7d029eb tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:14.299057 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a70e7cd2-5eec-4dcc-a55d-8e067e5c0eba tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c53d79930a4eaf9fcf7cd10707fbf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22fd8f3b0334cb3b1af66cf626422fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:14.313906 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a70e7cd2-5eec-4dcc-a55d-8e067e5c0eba tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] 10.222.0.33 "GET /compute/v2.1/servers/15e9bc0f-2262-4e2c-9cac-0eca4575943c" status: 200 len: 1332 microversion: 2.1 time: 1.905723 Sep 23 04:44:14.339294 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1559/3091] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:12 2022] GET /compute/v2.1/servers/15e9bc0f-2262-4e2c-9cac-0eca4575943c => generated 1332 bytes in 1933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:14.353667 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ed94040e-fe14-4da5-8cc8-f6d752f1e3fb tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:14.366980 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ed94040e-fe14-4da5-8cc8-f6d752f1e3fb tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] [instance: dc73bb47-24fc-4b26-a371-c9cb0719748b] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:14.379961 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ed94040e-fe14-4da5-8cc8-f6d752f1e3fb tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:14.382457 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ed94040e-fe14-4da5-8cc8-f6d752f1e3fb tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:14.383906 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ed94040e-fe14-4da5-8cc8-f6d752f1e3fb tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:14.386840 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ed94040e-fe14-4da5-8cc8-f6d752f1e3fb tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:14.387616 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ed94040e-fe14-4da5-8cc8-f6d752f1e3fb tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:14.389060 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ed94040e-fe14-4da5-8cc8-f6d752f1e3fb tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:14.617280 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:44:14.796049 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b9b28ddd-6cef-479d-a8d0-795aa7d029eb tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e235519204b4efc8b6c7e2988fab9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0b7307c30a4c118da4c501691e349f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:14.812076 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b9b28ddd-6cef-479d-a8d0-795aa7d029eb tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] 10.222.0.33 "GET /compute/v2.1/servers/b903ed91-8ea3-4c20-8565-b190d442e723" status: 200 len: 1317 microversion: 2.1 time: 1.386092 Sep 23 04:44:14.812683 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1533/3092] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:13 2022] GET /compute/v2.1/servers/b903ed91-8ea3-4c20-8565-b190d442e723 => generated 1317 bytes in 1388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:14.850717 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a8a9e013-38b0-44a0-b66d-455071a32937 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '.version_select at 0x7ff1baa6cf70>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:14.925962 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a8a9e013-38b0-44a0-b66d-455071a32937 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/images/e161c9e7-af1d-4409-9a40-1f3f8885ed79" status: 200 len: 1414 microversion: 2.1 time: 0.090785 Sep 23 04:44:14.926545 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1534/3093] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:44:14 2022] GET /compute/v2.1/images/e161c9e7-af1d-4409-9a40-1f3f8885ed79 => generated 1414 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:14.940059 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4374fedd-dbe5-430a-822b-03fef58e6f2f tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:14.943319 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4374fedd-dbe5-430a-822b-03fef58e6f2f tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 874db366-9e32-40a4-bddb-ec587a81b865] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:14.958971 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4374fedd-dbe5-430a-822b-03fef58e6f2f tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:14.963491 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4374fedd-dbe5-430a-822b-03fef58e6f2f tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:14.964134 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4374fedd-dbe5-430a-822b-03fef58e6f2f tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:14.965044 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4374fedd-dbe5-430a-822b-03fef58e6f2f tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:14.965793 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4374fedd-dbe5-430a-822b-03fef58e6f2f tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:14.966432 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4374fedd-dbe5-430a-822b-03fef58e6f2f tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:15.105439 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ed94040e-fe14-4da5-8cc8-f6d752f1e3fb tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2d38f8f2244a81bf0935a121f039fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42090b82fbf8462eb96c0e69210aa460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:15.116482 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ed94040e-fe14-4da5-8cc8-f6d752f1e3fb tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] 10.222.0.33 "GET /compute/v2.1/servers/dc73bb47-24fc-4b26-a371-c9cb0719748b" status: 200 len: 1527 microversion: 2.1 time: 0.774297 Sep 23 04:44:15.138570 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1560/3094] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:14 2022] GET /compute/v2.1/servers/dc73bb47-24fc-4b26-a371-c9cb0719748b => generated 1527 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:15.159737 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-98d629e7-4fc0-4ea1-8b60-79985dc9ef2a req-403674c4-d55a-4913-b75d-03807652598d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b903ed91-8ea3-4c20-8565-b190d442e723", "tag": "1eb2993e-ab60-4149-954a-75f33e83e3e1"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:44:15.184555 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-98d629e7-4fc0-4ea1-8b60-79985dc9ef2a req-403674c4-d55a-4913-b75d-03807652598d service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:15.188122 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-98d629e7-4fc0-4ea1-8b60-79985dc9ef2a req-403674c4-d55a-4913-b75d-03807652598d service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:15.188892 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-98d629e7-4fc0-4ea1-8b60-79985dc9ef2a req-403674c4-d55a-4913-b75d-03807652598d service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:15.215617 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-98d629e7-4fc0-4ea1-8b60-79985dc9ef2a req-403674c4-d55a-4913-b75d-03807652598d service nova] Creating event network-changed:1eb2993e-ab60-4149-954a-75f33e83e3e1 for instance b903ed91-8ea3-4c20-8565-b190d442e723 on n-h1-846463-3 Sep 23 04:44:15.230742 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-98d629e7-4fc0-4ea1-8b60-79985dc9ef2a req-403674c4-d55a-4913-b75d-03807652598d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087756 Sep 23 04:44:15.232204 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1561/3095] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:44:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:44:15.247169 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4374fedd-dbe5-430a-822b-03fef58e6f2f tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:15.259442 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4374fedd-dbe5-430a-822b-03fef58e6f2f tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/874db366-9e32-40a4-bddb-ec587a81b865" status: 200 len: 1286 microversion: 2.1 time: 0.325875 Sep 23 04:44:15.263137 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1535/3096] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:14 2022] GET /compute/v2.1/servers/874db366-9e32-40a4-bddb-ec587a81b865 => generated 1286 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:15.365600 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-54c0e535-8a6c-4da6-982f-e9d053e6d1ae tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:15.367427 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-54c0e535-8a6c-4da6-982f-e9d053e6d1ae tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] [instance: 15e9bc0f-2262-4e2c-9cac-0eca4575943c] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:15.374471 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-54c0e535-8a6c-4da6-982f-e9d053e6d1ae tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:15.375517 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-54c0e535-8a6c-4da6-982f-e9d053e6d1ae tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:15.376246 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-54c0e535-8a6c-4da6-982f-e9d053e6d1ae tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:15.377256 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-54c0e535-8a6c-4da6-982f-e9d053e6d1ae tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:15.378647 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-54c0e535-8a6c-4da6-982f-e9d053e6d1ae tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:15.379462 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-54c0e535-8a6c-4da6-982f-e9d053e6d1ae tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:15.765495 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-54c0e535-8a6c-4da6-982f-e9d053e6d1ae tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c53d79930a4eaf9fcf7cd10707fbf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22fd8f3b0334cb3b1af66cf626422fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:15.799676 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-54c0e535-8a6c-4da6-982f-e9d053e6d1ae tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] 10.222.0.33 "GET /compute/v2.1/servers/15e9bc0f-2262-4e2c-9cac-0eca4575943c" status: 200 len: 1332 microversion: 2.1 time: 0.439736 Sep 23 04:44:15.814987 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1562/3097] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:15 2022] GET /compute/v2.1/servers/15e9bc0f-2262-4e2c-9cac-0eca4575943c => generated 1332 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:15.839562 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-fedb8905-7b4d-4399-a0d4-42d916c2ff5d tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:15.842461 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-fedb8905-7b4d-4399-a0d4-42d916c2ff5d tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] [instance: b903ed91-8ea3-4c20-8565-b190d442e723] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:15.849566 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fedb8905-7b4d-4399-a0d4-42d916c2ff5d tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:15.853973 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fedb8905-7b4d-4399-a0d4-42d916c2ff5d tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:15.856768 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fedb8905-7b4d-4399-a0d4-42d916c2ff5d tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:15.857807 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fedb8905-7b4d-4399-a0d4-42d916c2ff5d tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:15.858656 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fedb8905-7b4d-4399-a0d4-42d916c2ff5d tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:15.862230 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fedb8905-7b4d-4399-a0d4-42d916c2ff5d tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:15.942531 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c3dcfba2-9b33-43b6-96b7-04362df264bd tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '.version_select at 0x7ff1c019e3a0>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:16.069409 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c3dcfba2-9b33-43b6-96b7-04362df264bd tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/images/e161c9e7-af1d-4409-9a40-1f3f8885ed79" status: 200 len: 1414 microversion: 2.1 time: 0.131071 Sep 23 04:44:16.070461 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1563/3098] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:44:15 2022] GET /compute/v2.1/images/e161c9e7-af1d-4409-9a40-1f3f8885ed79 => generated 1414 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:44:16.144455 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2d2da571-28e3-422d-8542-2064ead08338 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:16.145093 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-2d2da571-28e3-422d-8542-2064ead08338 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] [instance: dc73bb47-24fc-4b26-a371-c9cb0719748b] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:16.160976 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2d2da571-28e3-422d-8542-2064ead08338 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:16.170549 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2d2da571-28e3-422d-8542-2064ead08338 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:16.171153 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2d2da571-28e3-422d-8542-2064ead08338 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:16.171946 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2d2da571-28e3-422d-8542-2064ead08338 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:16.172440 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2d2da571-28e3-422d-8542-2064ead08338 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:16.176897 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2d2da571-28e3-422d-8542-2064ead08338 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:16.421585 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2d2da571-28e3-422d-8542-2064ead08338 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2d38f8f2244a81bf0935a121f039fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42090b82fbf8462eb96c0e69210aa460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:16.437231 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2d2da571-28e3-422d-8542-2064ead08338 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] 10.222.0.33 "GET /compute/v2.1/servers/dc73bb47-24fc-4b26-a371-c9cb0719748b" status: 200 len: 1485 microversion: 2.1 time: 0.292637 Sep 23 04:44:16.438221 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1564/3099] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:16 2022] GET /compute/v2.1/servers/dc73bb47-24fc-4b26-a371-c9cb0719748b => generated 1485 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:16.459203 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b6cb0128-e7f0-4230-9405-123d444c9316 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:16.462201 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b6cb0128-e7f0-4230-9405-123d444c9316 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 874db366-9e32-40a4-bddb-ec587a81b865] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:16.483654 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b6cb0128-e7f0-4230-9405-123d444c9316 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:16.484470 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b6cb0128-e7f0-4230-9405-123d444c9316 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:16.485562 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b6cb0128-e7f0-4230-9405-123d444c9316 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:16.486521 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b6cb0128-e7f0-4230-9405-123d444c9316 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:16.488869 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b6cb0128-e7f0-4230-9405-123d444c9316 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:16.489548 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b6cb0128-e7f0-4230-9405-123d444c9316 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:16.525562 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-fedb8905-7b4d-4399-a0d4-42d916c2ff5d tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e235519204b4efc8b6c7e2988fab9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0b7307c30a4c118da4c501691e349f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:16.538416 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-fedb8905-7b4d-4399-a0d4-42d916c2ff5d tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] 10.222.0.33 "GET /compute/v2.1/servers/b903ed91-8ea3-4c20-8565-b190d442e723" status: 200 len: 1317 microversion: 2.1 time: 0.702796 Sep 23 04:44:16.558388 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1536/3100] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:15 2022] GET /compute/v2.1/servers/b903ed91-8ea3-4c20-8565-b190d442e723 => generated 1317 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:16.706458 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-c0a43374-a384-4625-a9fe-383b27b11bb1 req-6caab2c4-1a3c-40ea-b5b0-1a5d53bbd040 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc73bb47-24fc-4b26-a371-c9cb0719748b", "name": "network-vif-deleted", "tag": "c5a36ea8-5c64-4075-b87d-53d2b92335d9"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:44:16.713981 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b6cb0128-e7f0-4230-9405-123d444c9316 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:16.735019 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b6cb0128-e7f0-4230-9405-123d444c9316 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/874db366-9e32-40a4-bddb-ec587a81b865" status: 200 len: 1286 microversion: 2.1 time: 0.282743 Sep 23 04:44:16.739504 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1565/3101] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:16 2022] GET /compute/v2.1/servers/874db366-9e32-40a4-bddb-ec587a81b865 => generated 1286 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:16.741656 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-c0a43374-a384-4625-a9fe-383b27b11bb1 req-6caab2c4-1a3c-40ea-b5b0-1a5d53bbd040 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:16.742234 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-c0a43374-a384-4625-a9fe-383b27b11bb1 req-6caab2c4-1a3c-40ea-b5b0-1a5d53bbd040 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:16.742677 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-c0a43374-a384-4625-a9fe-383b27b11bb1 req-6caab2c4-1a3c-40ea-b5b0-1a5d53bbd040 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:16.811732 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-c0a43374-a384-4625-a9fe-383b27b11bb1 req-6caab2c4-1a3c-40ea-b5b0-1a5d53bbd040 service nova] Creating event network-vif-deleted:c5a36ea8-5c64-4075-b87d-53d2b92335d9 for instance dc73bb47-24fc-4b26-a371-c9cb0719748b on n-h1-846463-3 Sep 23 04:44:16.836554 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-009642a6-2602-4c42-ad62-5e9a8602956a tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:16.837220 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-009642a6-2602-4c42-ad62-5e9a8602956a tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] [instance: 15e9bc0f-2262-4e2c-9cac-0eca4575943c] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:16.845707 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-c0a43374-a384-4625-a9fe-383b27b11bb1 req-6caab2c4-1a3c-40ea-b5b0-1a5d53bbd040 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145113 Sep 23 04:44:16.846459 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1537/3102] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:44:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:44:16.856670 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-009642a6-2602-4c42-ad62-5e9a8602956a tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:16.858164 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-009642a6-2602-4c42-ad62-5e9a8602956a tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:16.862313 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-009642a6-2602-4c42-ad62-5e9a8602956a tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:16.863669 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-009642a6-2602-4c42-ad62-5e9a8602956a tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:16.872555 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-009642a6-2602-4c42-ad62-5e9a8602956a tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:16.878577 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-009642a6-2602-4c42-ad62-5e9a8602956a tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:17.087930 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-198802ba-d40b-4808-9224-01de6a79817f tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '.version_select at 0x7ff1baa1b9d0>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:17.165932 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-198802ba-d40b-4808-9224-01de6a79817f tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/images/e161c9e7-af1d-4409-9a40-1f3f8885ed79" status: 200 len: 1414 microversion: 2.1 time: 0.083089 Sep 23 04:44:17.178791 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1538/3103] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:44:17 2022] GET /compute/v2.1/images/e161c9e7-af1d-4409-9a40-1f3f8885ed79 => generated 1414 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:44:17.471460 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2f538822-a6c1-4780-80e3-eaf82067abcf tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:17.473296 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-2f538822-a6c1-4780-80e3-eaf82067abcf tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] [instance: dc73bb47-24fc-4b26-a371-c9cb0719748b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:17.484332 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2f538822-a6c1-4780-80e3-eaf82067abcf tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:17.484880 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2f538822-a6c1-4780-80e3-eaf82067abcf tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:17.485516 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2f538822-a6c1-4780-80e3-eaf82067abcf tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:17.487323 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2f538822-a6c1-4780-80e3-eaf82067abcf tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:17.487948 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2f538822-a6c1-4780-80e3-eaf82067abcf tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:17.488541 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2f538822-a6c1-4780-80e3-eaf82067abcf tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:17.534500 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2f538822-a6c1-4780-80e3-eaf82067abcf tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:17.535106 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2f538822-a6c1-4780-80e3-eaf82067abcf tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:17.535812 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2f538822-a6c1-4780-80e3-eaf82067abcf tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:17.536496 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-2f538822-a6c1-4780-80e3-eaf82067abcf tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Lazy-loading 'fault' on Instance uuid dc73bb47-24fc-4b26-a371-c9cb0719748b {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:44:17.659543 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-009642a6-2602-4c42-ad62-5e9a8602956a tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c53d79930a4eaf9fcf7cd10707fbf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22fd8f3b0334cb3b1af66cf626422fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:17.681649 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-009642a6-2602-4c42-ad62-5e9a8602956a tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] 10.222.0.33 "GET /compute/v2.1/servers/15e9bc0f-2262-4e2c-9cac-0eca4575943c" status: 200 len: 1332 microversion: 2.1 time: 0.851481 Sep 23 04:44:17.704957 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1566/3104] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:16 2022] GET /compute/v2.1/servers/15e9bc0f-2262-4e2c-9cac-0eca4575943c => generated 1332 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:44:17.716236 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-2f538822-a6c1-4780-80e3-eaf82067abcf tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2d38f8f2244a81bf0935a121f039fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42090b82fbf8462eb96c0e69210aa460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:17.725034 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2f538822-a6c1-4780-80e3-eaf82067abcf tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] 10.222.0.33 "GET /compute/v2.1/servers/dc73bb47-24fc-4b26-a371-c9cb0719748b" status: 200 len: 1314 microversion: 2.1 time: 0.264502 Sep 23 04:44:17.727268 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5f28a6a7-002f-4d21-8242-9d8c48ed491a tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:17.727922 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-5f28a6a7-002f-4d21-8242-9d8c48ed491a tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] [instance: b903ed91-8ea3-4c20-8565-b190d442e723] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:17.738184 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1539/3105] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:17 2022] GET /compute/v2.1/servers/dc73bb47-24fc-4b26-a371-c9cb0719748b => generated 1314 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:44:17.760104 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2a991c88-ef6c-4516-b354-a0d260312e79 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:17.762493 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-2a991c88-ef6c-4516-b354-a0d260312e79 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 874db366-9e32-40a4-bddb-ec587a81b865] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:17.762964 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5f28a6a7-002f-4d21-8242-9d8c48ed491a tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:17.766399 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5f28a6a7-002f-4d21-8242-9d8c48ed491a tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:17.766873 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5f28a6a7-002f-4d21-8242-9d8c48ed491a tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:17.767641 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5f28a6a7-002f-4d21-8242-9d8c48ed491a tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:17.776890 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5f28a6a7-002f-4d21-8242-9d8c48ed491a tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:17.779103 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2a991c88-ef6c-4516-b354-a0d260312e79 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:17.779959 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2a991c88-ef6c-4516-b354-a0d260312e79 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:17.780744 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2a991c88-ef6c-4516-b354-a0d260312e79 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:17.781661 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2a991c88-ef6c-4516-b354-a0d260312e79 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:17.782405 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2a991c88-ef6c-4516-b354-a0d260312e79 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:17.785446 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5f28a6a7-002f-4d21-8242-9d8c48ed491a tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:17.786104 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2a991c88-ef6c-4516-b354-a0d260312e79 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:17.863546 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=12 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:44:18.506497 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-5f28a6a7-002f-4d21-8242-9d8c48ed491a tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e235519204b4efc8b6c7e2988fab9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0b7307c30a4c118da4c501691e349f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:18.516022 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5f28a6a7-002f-4d21-8242-9d8c48ed491a tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] 10.222.0.33 "GET /compute/v2.1/servers/b903ed91-8ea3-4c20-8565-b190d442e723" status: 200 len: 1317 microversion: 2.1 time: 0.810714 Sep 23 04:44:18.523149 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1567/3106] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:17 2022] GET /compute/v2.1/servers/b903ed91-8ea3-4c20-8565-b190d442e723 => generated 1317 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:18.530644 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-892ad235-16aa-488e-986d-0fa3e87b0340 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '.version_select at 0x7ff1c04d75e0>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:18.658435 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-892ad235-16aa-488e-986d-0fa3e87b0340 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/images/e161c9e7-af1d-4409-9a40-1f3f8885ed79" status: 200 len: 1414 microversion: 2.1 time: 0.133776 Sep 23 04:44:18.667045 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1568/3107] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:44:18 2022] GET /compute/v2.1/images/e161c9e7-af1d-4409-9a40-1f3f8885ed79 => generated 1414 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:18.712729 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e4d4f718-dc78-42bf-b05b-3e3919f103bc tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:18.715575 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e4d4f718-dc78-42bf-b05b-3e3919f103bc tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] [instance: 15e9bc0f-2262-4e2c-9cac-0eca4575943c] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:18.730367 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e4d4f718-dc78-42bf-b05b-3e3919f103bc tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:18.731202 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e4d4f718-dc78-42bf-b05b-3e3919f103bc tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:18.732532 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e4d4f718-dc78-42bf-b05b-3e3919f103bc tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:18.738978 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e4d4f718-dc78-42bf-b05b-3e3919f103bc tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:18.745175 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e4d4f718-dc78-42bf-b05b-3e3919f103bc tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:18.747189 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e4d4f718-dc78-42bf-b05b-3e3919f103bc tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:19.943538 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-2a991c88-ef6c-4516-b354-a0d260312e79 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:19.958418 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2a991c88-ef6c-4516-b354-a0d260312e79 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/874db366-9e32-40a4-bddb-ec587a81b865" status: 200 len: 1328 microversion: 2.1 time: 2.199172 Sep 23 04:44:19.959042 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1540/3108] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:17 2022] GET /compute/v2.1/servers/874db366-9e32-40a4-bddb-ec587a81b865 => generated 1328 bytes in 2203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:19.975152 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-cffbd83e-b6a6-446d-90ad-2a62c2a5c405 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:19.983212 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-cffbd83e-b6a6-446d-90ad-2a62c2a5c405 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] [instance: dc73bb47-24fc-4b26-a371-c9cb0719748b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:19.991133 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=4 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:44:19.997074 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cffbd83e-b6a6-446d-90ad-2a62c2a5c405 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:20.004254 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cffbd83e-b6a6-446d-90ad-2a62c2a5c405 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:20.005011 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cffbd83e-b6a6-446d-90ad-2a62c2a5c405 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:20.006079 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cffbd83e-b6a6-446d-90ad-2a62c2a5c405 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:20.006844 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cffbd83e-b6a6-446d-90ad-2a62c2a5c405 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:20.007443 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cffbd83e-b6a6-446d-90ad-2a62c2a5c405 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:20.018641 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:44:20.046550 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-cffbd83e-b6a6-446d-90ad-2a62c2a5c405 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] HTTP exception thrown: Instance dc73bb47-24fc-4b26-a371-c9cb0719748b could not be found. Sep 23 04:44:20.055715 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-cffbd83e-b6a6-446d-90ad-2a62c2a5c405 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Request method failure captured: Sep 23 04:44:20.055715 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/dc73bb47-24fc-4b26-a371-c9cb0719748b HTTP/1.1 Sep 23 04:44:20.055715 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:44:20.055715 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:44:20.055715 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:44:20.055715 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:44:20.055715 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:44:20.055715 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:44:20.055715 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:44:20.055715 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:44:20.055715 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTl-7-DuuekLkM8jni6XElIut--UdDsxZQaDDrhVYNE2BIqflIl1RWa1u49UHAUDR0oh0nhqOHHecIEgUN_GZTzG7BDFsk1rcrqRgjQFgwn2c8YsUqYiQrDsIB8atnLoikOrSPeymCaV_jDdML1mYtwihcTfl4FZEZMxBtnYRx5MwXQ Sep 23 04:44:20.055715 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:44:20.055715 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:44:20.055715 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:44:20.055715 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:44:20.055715 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:44:20.055715 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:44:20.055715 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 42090b82fbf8462eb96c0e69210aa460 Sep 23 04:44:20.055715 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-550699681 Sep 23 04:44:20.055715 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:44:20.055715 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:44:20.055715 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_42090b82fbf8462eb96c0e69210aa460", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/42090b82fbf8462eb96c0e69210aa460"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/42090b82fbf8462eb96c0e69210aa460"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/42090b82fbf8462eb96c0e69210aa460"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:44:20.055715 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-550699681 Sep 23 04:44:20.055715 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 42090b82fbf8462eb96c0e69210aa460 Sep 23 04:44:20.055715 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-550699681 Sep 23 04:44:20.055715 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-InstanceActionsNegativeTestJSON-550699681-project Sep 23 04:44:20.055715 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:44:20.055715 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:44:20.055715 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 0d2d38f8f2244a81bf0935a121f039fe Sep 23 04:44:20.055715 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-550699681-project Sep 23 04:44:20.055715 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:44:20.055715 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance dc73bb47-24fc-4b26-a371-c9cb0719748b could not be found. Sep 23 04:44:20.055715 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': 'dc73bb47-24fc-4b26-a371-c9cb0719748b'} Sep 23 04:44:20.055715 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:44:20.055715 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:44:20.055715 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:44:20.055715 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:44:20.055715 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:44:20.055715 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:44:20.055715 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:44:20.055715 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:44:20.055715 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:44:20.055715 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:44:20.055715 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc73bb47-24fc-4b26-a371-c9cb0719748b could not be found. Sep 23 04:44:20.055715 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:44:20.055715 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:44:20.055715 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:44:20.055715 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:44:20.055715 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:44:20.055715 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:44:20.055715 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:44:20.055715 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:44:20.055715 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:44:20.055715 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:44:20.055715 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:44:20.055715 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:44:20.055715 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:44:20.055715 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:44:20.055715 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:44:20.055715 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:44:20.055715 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc73bb47-24fc-4b26-a371-c9cb0719748b could not be found. Sep 23 04:44:20.055715 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:44:20.055715 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:44:20.060498 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:44:20.060498 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:44:20.060498 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:44:20.060498 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:44:20.060498 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:44:20.060498 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:44:20.060498 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc73bb47-24fc-4b26-a371-c9cb0719748b could not be found. Sep 23 04:44:20.060498 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:44:20.062002 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-cffbd83e-b6a6-446d-90ad-2a62c2a5c405 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] Returning 404 to user: Instance dc73bb47-24fc-4b26-a371-c9cb0719748b could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:44:20.063098 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-cffbd83e-b6a6-446d-90ad-2a62c2a5c405 tempest-InstanceActionsNegativeTestJSON-550699681 tempest-InstanceActionsNegativeTestJSON-550699681-project] 10.222.0.33 "GET /compute/v2.1/servers/dc73bb47-24fc-4b26-a371-c9cb0719748b" status: 404 len: 111 microversion: 2.1 time: 0.102284 Sep 23 04:44:20.064557 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1541/3109] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:19 2022] GET /compute/v2.1/servers/dc73bb47-24fc-4b26-a371-c9cb0719748b => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:44:20.078466 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-99f1985d-9be1-4e24-bd38-310f905dcab3 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:20.079696 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-99f1985d-9be1-4e24-bd38-310f905dcab3 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] [instance: b903ed91-8ea3-4c20-8565-b190d442e723] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:20.101530 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-99f1985d-9be1-4e24-bd38-310f905dcab3 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:20.102488 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-99f1985d-9be1-4e24-bd38-310f905dcab3 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:20.103123 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-99f1985d-9be1-4e24-bd38-310f905dcab3 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:20.104035 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-99f1985d-9be1-4e24-bd38-310f905dcab3 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:20.107819 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-99f1985d-9be1-4e24-bd38-310f905dcab3 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:20.108471 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-99f1985d-9be1-4e24-bd38-310f905dcab3 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:20.154767 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e4d4f718-dc78-42bf-b05b-3e3919f103bc tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c53d79930a4eaf9fcf7cd10707fbf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22fd8f3b0334cb3b1af66cf626422fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:20.163927 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e4d4f718-dc78-42bf-b05b-3e3919f103bc tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] 10.222.0.33 "GET /compute/v2.1/servers/15e9bc0f-2262-4e2c-9cac-0eca4575943c" status: 200 len: 1332 microversion: 2.1 time: 1.455487 Sep 23 04:44:20.169246 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1569/3110] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:18 2022] GET /compute/v2.1/servers/15e9bc0f-2262-4e2c-9cac-0eca4575943c => generated 1332 bytes in 1461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:20.174795 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0983156c-4d96-43f5-a048-8ffe3767edbc tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '.version_select at 0x7ff1c3f11160>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:20.268524 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0983156c-4d96-43f5-a048-8ffe3767edbc tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/images/e161c9e7-af1d-4409-9a40-1f3f8885ed79" status: 200 len: 1414 microversion: 2.1 time: 0.097375 Sep 23 04:44:20.269220 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1570/3111] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:44:20 2022] GET /compute/v2.1/images/e161c9e7-af1d-4409-9a40-1f3f8885ed79 => generated 1414 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:20.984755 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-16506e07-b3d0-4af6-b504-180a505fd2e6 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:20.985373 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-16506e07-b3d0-4af6-b504-180a505fd2e6 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 874db366-9e32-40a4-bddb-ec587a81b865] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:20.988388 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=18 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:44:21.004068 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-16506e07-b3d0-4af6-b504-180a505fd2e6 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:21.004667 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-16506e07-b3d0-4af6-b504-180a505fd2e6 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:21.005012 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-16506e07-b3d0-4af6-b504-180a505fd2e6 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:21.005741 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-16506e07-b3d0-4af6-b504-180a505fd2e6 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:21.006236 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-16506e07-b3d0-4af6-b504-180a505fd2e6 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:21.006667 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-16506e07-b3d0-4af6-b504-180a505fd2e6 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:21.078093 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-99f1985d-9be1-4e24-bd38-310f905dcab3 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e235519204b4efc8b6c7e2988fab9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0b7307c30a4c118da4c501691e349f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:21.087690 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-99f1985d-9be1-4e24-bd38-310f905dcab3 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] 10.222.0.33 "GET /compute/v2.1/servers/b903ed91-8ea3-4c20-8565-b190d442e723" status: 200 len: 1317 microversion: 2.1 time: 1.021753 Sep 23 04:44:21.113082 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1542/3112] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:20 2022] GET /compute/v2.1/servers/b903ed91-8ea3-4c20-8565-b190d442e723 => generated 1317 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:21.198488 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-223d2f83-288a-4030-a19d-b976f3e2ea3f tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:21.199176 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-223d2f83-288a-4030-a19d-b976f3e2ea3f tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] [instance: 15e9bc0f-2262-4e2c-9cac-0eca4575943c] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:21.212163 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-223d2f83-288a-4030-a19d-b976f3e2ea3f tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:21.213707 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-223d2f83-288a-4030-a19d-b976f3e2ea3f tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:21.214371 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-223d2f83-288a-4030-a19d-b976f3e2ea3f tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:21.217876 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-223d2f83-288a-4030-a19d-b976f3e2ea3f tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:21.223334 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-223d2f83-288a-4030-a19d-b976f3e2ea3f tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:21.223334 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-223d2f83-288a-4030-a19d-b976f3e2ea3f tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:21.616496 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-223d2f83-288a-4030-a19d-b976f3e2ea3f tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c53d79930a4eaf9fcf7cd10707fbf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22fd8f3b0334cb3b1af66cf626422fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:21.629606 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-223d2f83-288a-4030-a19d-b976f3e2ea3f tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] 10.222.0.33 "GET /compute/v2.1/servers/15e9bc0f-2262-4e2c-9cac-0eca4575943c" status: 200 len: 1332 microversion: 2.1 time: 0.436816 Sep 23 04:44:21.633980 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1543/3113] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:21 2022] GET /compute/v2.1/servers/15e9bc0f-2262-4e2c-9cac-0eca4575943c => generated 1332 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:44:21.644668 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-23722e24-6eb8-4309-b5b1-f4cec03ce5af tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '.version_select at 0x7ff1bba92d30>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:21.677934 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-16506e07-b3d0-4af6-b504-180a505fd2e6 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:21.687326 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-16506e07-b3d0-4af6-b504-180a505fd2e6 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/874db366-9e32-40a4-bddb-ec587a81b865" status: 200 len: 1328 microversion: 2.1 time: 0.706432 Sep 23 04:44:21.697809 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1571/3114] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:20 2022] GET /compute/v2.1/servers/874db366-9e32-40a4-bddb-ec587a81b865 => generated 1328 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:44:21.756386 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-23722e24-6eb8-4309-b5b1-f4cec03ce5af tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/images/e161c9e7-af1d-4409-9a40-1f3f8885ed79" status: 200 len: 1414 microversion: 2.1 time: 0.121063 Sep 23 04:44:21.771740 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1544/3115] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:44:21 2022] GET /compute/v2.1/images/e161c9e7-af1d-4409-9a40-1f3f8885ed79 => generated 1414 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:22.120576 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d37f5d0e-df15-4d10-8df5-d0eeae564350 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:22.122181 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d37f5d0e-df15-4d10-8df5-d0eeae564350 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] [instance: b903ed91-8ea3-4c20-8565-b190d442e723] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:22.130138 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d37f5d0e-df15-4d10-8df5-d0eeae564350 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:22.130851 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d37f5d0e-df15-4d10-8df5-d0eeae564350 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:22.131443 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d37f5d0e-df15-4d10-8df5-d0eeae564350 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:22.136702 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d37f5d0e-df15-4d10-8df5-d0eeae564350 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:22.137504 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d37f5d0e-df15-4d10-8df5-d0eeae564350 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:22.138393 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d37f5d0e-df15-4d10-8df5-d0eeae564350 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:22.635258 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d37f5d0e-df15-4d10-8df5-d0eeae564350 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e235519204b4efc8b6c7e2988fab9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0b7307c30a4c118da4c501691e349f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:22.656675 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6c1bf546-aea3-4f62-bca3-41769665c356 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:22.657294 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-6c1bf546-aea3-4f62-bca3-41769665c356 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] [instance: 15e9bc0f-2262-4e2c-9cac-0eca4575943c] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:22.662225 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d37f5d0e-df15-4d10-8df5-d0eeae564350 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] 10.222.0.33 "GET /compute/v2.1/servers/b903ed91-8ea3-4c20-8565-b190d442e723" status: 200 len: 1317 microversion: 2.1 time: 0.548888 Sep 23 04:44:22.667479 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1572/3116] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:22 2022] GET /compute/v2.1/servers/b903ed91-8ea3-4c20-8565-b190d442e723 => generated 1317 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:44:22.670708 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6c1bf546-aea3-4f62-bca3-41769665c356 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:22.671703 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6c1bf546-aea3-4f62-bca3-41769665c356 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:22.672288 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6c1bf546-aea3-4f62-bca3-41769665c356 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:22.674168 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6c1bf546-aea3-4f62-bca3-41769665c356 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:22.674815 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6c1bf546-aea3-4f62-bca3-41769665c356 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:22.677422 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6c1bf546-aea3-4f62-bca3-41769665c356 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:22.712454 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9260cc82-90dc-4215-96ad-db1d84a13154 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:22.713313 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-9260cc82-90dc-4215-96ad-db1d84a13154 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 874db366-9e32-40a4-bddb-ec587a81b865] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:22.720156 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9260cc82-90dc-4215-96ad-db1d84a13154 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:22.734780 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9260cc82-90dc-4215-96ad-db1d84a13154 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:22.737879 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9260cc82-90dc-4215-96ad-db1d84a13154 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:22.739255 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9260cc82-90dc-4215-96ad-db1d84a13154 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:22.742619 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9260cc82-90dc-4215-96ad-db1d84a13154 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:22.743245 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9260cc82-90dc-4215-96ad-db1d84a13154 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:23.396735 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6c1bf546-aea3-4f62-bca3-41769665c356 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c53d79930a4eaf9fcf7cd10707fbf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22fd8f3b0334cb3b1af66cf626422fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:23.431476 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-6c1bf546-aea3-4f62-bca3-41769665c356 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] 10.222.0.33 "GET /compute/v2.1/servers/15e9bc0f-2262-4e2c-9cac-0eca4575943c" status: 200 len: 1332 microversion: 2.1 time: 0.778824 Sep 23 04:44:23.434661 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1545/3117] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:22 2022] GET /compute/v2.1/servers/15e9bc0f-2262-4e2c-9cac-0eca4575943c => generated 1332 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:23.458480 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-9260cc82-90dc-4215-96ad-db1d84a13154 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:23.467035 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b4849650-3e6a-4935-9bbe-b7dacfe4e24c tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '.version_select at 0x7ff1baa6c310>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:23.471179 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-9260cc82-90dc-4215-96ad-db1d84a13154 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/874db366-9e32-40a4-bddb-ec587a81b865" status: 200 len: 1328 microversion: 2.1 time: 0.762208 Sep 23 04:44:23.472463 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1573/3118] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:22 2022] GET /compute/v2.1/servers/874db366-9e32-40a4-bddb-ec587a81b865 => generated 1328 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:44:23.478774 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-a3f755b6-9e7e-46e8-a5f2-49672e9c6061 req-aee147da-d635-46e4-bbed-aee3924d4075 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b903ed91-8ea3-4c20-8565-b190d442e723", "name": "network-vif-plugged", "status": "completed", "tag": "1eb2993e-ab60-4149-954a-75f33e83e3e1"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:44:23.500813 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-a3f755b6-9e7e-46e8-a5f2-49672e9c6061 req-aee147da-d635-46e4-bbed-aee3924d4075 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:23.505567 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-a3f755b6-9e7e-46e8-a5f2-49672e9c6061 req-aee147da-d635-46e4-bbed-aee3924d4075 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:23.507414 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-a3f755b6-9e7e-46e8-a5f2-49672e9c6061 req-aee147da-d635-46e4-bbed-aee3924d4075 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:23.548634 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-a3f755b6-9e7e-46e8-a5f2-49672e9c6061 req-aee147da-d635-46e4-bbed-aee3924d4075 service nova] Creating event network-vif-plugged:1eb2993e-ab60-4149-954a-75f33e83e3e1 for instance b903ed91-8ea3-4c20-8565-b190d442e723 on n-h1-846463-3 Sep 23 04:44:23.555031 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-a3f755b6-9e7e-46e8-a5f2-49672e9c6061 req-aee147da-d635-46e4-bbed-aee3924d4075 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080987 Sep 23 04:44:23.556217 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1574/3119] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:44:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:44:23.562425 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-62e910c3-ec80-4939-8d33-001718596353 req-a9d49978-9432-4810-85e8-2c533b190d54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "874db366-9e32-40a4-bddb-ec587a81b865", "tag": "0d222fe9-2403-4841-ad5b-64483223ce62"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:44:23.581908 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-62e910c3-ec80-4939-8d33-001718596353 req-a9d49978-9432-4810-85e8-2c533b190d54 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:23.584631 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-62e910c3-ec80-4939-8d33-001718596353 req-a9d49978-9432-4810-85e8-2c533b190d54 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:23.585254 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-62e910c3-ec80-4939-8d33-001718596353 req-a9d49978-9432-4810-85e8-2c533b190d54 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:23.615279 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-62e910c3-ec80-4939-8d33-001718596353 req-a9d49978-9432-4810-85e8-2c533b190d54 service nova] Creating event network-changed:0d222fe9-2403-4841-ad5b-64483223ce62 for instance 874db366-9e32-40a4-bddb-ec587a81b865 on n-h2-846463-3 Sep 23 04:44:23.615505 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b4849650-3e6a-4935-9bbe-b7dacfe4e24c tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/images/e161c9e7-af1d-4409-9a40-1f3f8885ed79" status: 200 len: 1414 microversion: 2.1 time: 0.177157 Sep 23 04:44:23.616423 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1546/3120] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:44:23 2022] GET /compute/v2.1/images/e161c9e7-af1d-4409-9a40-1f3f8885ed79 => generated 1414 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:23.622106 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-62e910c3-ec80-4939-8d33-001718596353 req-a9d49978-9432-4810-85e8-2c533b190d54 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064015 Sep 23 04:44:23.623335 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1575/3121] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:44:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:44:23.693548 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-844fd7da-708a-48c0-931e-e86a0b4a452b tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:23.694821 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-844fd7da-708a-48c0-931e-e86a0b4a452b tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] [instance: b903ed91-8ea3-4c20-8565-b190d442e723] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:23.701531 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-844fd7da-708a-48c0-931e-e86a0b4a452b tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:23.702417 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-844fd7da-708a-48c0-931e-e86a0b4a452b tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:23.703032 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-844fd7da-708a-48c0-931e-e86a0b4a452b tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:23.704061 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-844fd7da-708a-48c0-931e-e86a0b4a452b tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:23.704703 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-844fd7da-708a-48c0-931e-e86a0b4a452b tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:23.705444 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-844fd7da-708a-48c0-931e-e86a0b4a452b tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:23.936233 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-844fd7da-708a-48c0-931e-e86a0b4a452b tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e235519204b4efc8b6c7e2988fab9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0b7307c30a4c118da4c501691e349f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:23.947824 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-844fd7da-708a-48c0-931e-e86a0b4a452b tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] 10.222.0.33 "GET /compute/v2.1/servers/b903ed91-8ea3-4c20-8565-b190d442e723" status: 200 len: 1317 microversion: 2.1 time: 0.258907 Sep 23 04:44:23.962543 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1547/3122] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:23 2022] GET /compute/v2.1/servers/b903ed91-8ea3-4c20-8565-b190d442e723 => generated 1317 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:24.479970 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-13ce7471-d0d1-4acb-a32d-3d301ca07320 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:24.481480 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-13ce7471-d0d1-4acb-a32d-3d301ca07320 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] [instance: 15e9bc0f-2262-4e2c-9cac-0eca4575943c] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:24.499497 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7d974dc4-60eb-4380-8cf4-7f0d8cfc952a tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:24.500511 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7d974dc4-60eb-4380-8cf4-7f0d8cfc952a tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 874db366-9e32-40a4-bddb-ec587a81b865] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:24.508603 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-13ce7471-d0d1-4acb-a32d-3d301ca07320 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:24.510494 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-13ce7471-d0d1-4acb-a32d-3d301ca07320 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:24.512376 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7d974dc4-60eb-4380-8cf4-7f0d8cfc952a tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:24.513444 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-13ce7471-d0d1-4acb-a32d-3d301ca07320 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:24.519155 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-13ce7471-d0d1-4acb-a32d-3d301ca07320 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:24.520307 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7d974dc4-60eb-4380-8cf4-7f0d8cfc952a tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:24.520954 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7d974dc4-60eb-4380-8cf4-7f0d8cfc952a tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:24.522668 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-13ce7471-d0d1-4acb-a32d-3d301ca07320 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:24.526132 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7d974dc4-60eb-4380-8cf4-7f0d8cfc952a tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:24.526947 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-13ce7471-d0d1-4acb-a32d-3d301ca07320 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:24.527749 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7d974dc4-60eb-4380-8cf4-7f0d8cfc952a tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:24.530356 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7d974dc4-60eb-4380-8cf4-7f0d8cfc952a tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:25.609983 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-13ce7471-d0d1-4acb-a32d-3d301ca07320 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c53d79930a4eaf9fcf7cd10707fbf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22fd8f3b0334cb3b1af66cf626422fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:25.616869 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-7d974dc4-60eb-4380-8cf4-7f0d8cfc952a tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:25.623703 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-13ce7471-d0d1-4acb-a32d-3d301ca07320 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] 10.222.0.33 "GET /compute/v2.1/servers/15e9bc0f-2262-4e2c-9cac-0eca4575943c" status: 200 len: 1332 microversion: 2.1 time: 1.148132 Sep 23 04:44:25.624858 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7d974dc4-60eb-4380-8cf4-7f0d8cfc952a tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/874db366-9e32-40a4-bddb-ec587a81b865" status: 200 len: 1328 microversion: 2.1 time: 1.130029 Sep 23 04:44:25.626216 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1576/3123] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:24 2022] GET /compute/v2.1/servers/15e9bc0f-2262-4e2c-9cac-0eca4575943c => generated 1332 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:25.627988 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1548/3124] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:24 2022] GET /compute/v2.1/servers/874db366-9e32-40a4-bddb-ec587a81b865 => generated 1328 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:44:25.635776 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-46e55b3e-f3bb-4680-94cb-1b52ebaab639 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:25.644162 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-46e55b3e-f3bb-4680-94cb-1b52ebaab639 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] [instance: b903ed91-8ea3-4c20-8565-b190d442e723] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:25.665106 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-46e55b3e-f3bb-4680-94cb-1b52ebaab639 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:25.665791 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-46e55b3e-f3bb-4680-94cb-1b52ebaab639 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:25.666494 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-46e55b3e-f3bb-4680-94cb-1b52ebaab639 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:25.668197 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-46e55b3e-f3bb-4680-94cb-1b52ebaab639 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:25.669687 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-46e55b3e-f3bb-4680-94cb-1b52ebaab639 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:25.673202 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8927f80f-165f-4d0c-9a74-bf88c1c95b19 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '.version_select at 0x7ff1bb7c3c10>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:25.674033 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-46e55b3e-f3bb-4680-94cb-1b52ebaab639 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:25.764749 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-8927f80f-165f-4d0c-9a74-bf88c1c95b19 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/images/e161c9e7-af1d-4409-9a40-1f3f8885ed79" status: 200 len: 1414 microversion: 2.1 time: 0.126505 Sep 23 04:44:25.765283 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1577/3125] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:44:25 2022] GET /compute/v2.1/images/e161c9e7-af1d-4409-9a40-1f3f8885ed79 => generated 1414 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:25.793655 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-2e3d4f50-eec6-4c5c-92db-27f49f52cde9 req-5403b545-87df-430b-9dd5-3677d85caf95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15e9bc0f-2262-4e2c-9cac-0eca4575943c", "name": "network-vif-plugged", "status": "completed", "tag": "c81ebfeb-05fd-445f-bb49-70dc27b6c143"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:44:25.829354 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-2e3d4f50-eec6-4c5c-92db-27f49f52cde9 req-5403b545-87df-430b-9dd5-3677d85caf95 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:25.829830 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-2e3d4f50-eec6-4c5c-92db-27f49f52cde9 req-5403b545-87df-430b-9dd5-3677d85caf95 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:25.830856 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-2e3d4f50-eec6-4c5c-92db-27f49f52cde9 req-5403b545-87df-430b-9dd5-3677d85caf95 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:25.854696 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-2e3d4f50-eec6-4c5c-92db-27f49f52cde9 req-5403b545-87df-430b-9dd5-3677d85caf95 service nova] Creating event network-vif-plugged:c81ebfeb-05fd-445f-bb49-70dc27b6c143 for instance 15e9bc0f-2262-4e2c-9cac-0eca4575943c on n-h2-846463-3 Sep 23 04:44:25.887286 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-2e3d4f50-eec6-4c5c-92db-27f49f52cde9 req-5403b545-87df-430b-9dd5-3677d85caf95 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111646 Sep 23 04:44:25.891876 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1578/3126] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:44:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:44:26.651665 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d8d2a62b-afad-4944-9b75-9156567f7c94 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:26.653252 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d8d2a62b-afad-4944-9b75-9156567f7c94 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] [instance: 15e9bc0f-2262-4e2c-9cac-0eca4575943c] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:26.666337 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d8d2a62b-afad-4944-9b75-9156567f7c94 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:26.667054 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d8d2a62b-afad-4944-9b75-9156567f7c94 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:26.667588 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d8d2a62b-afad-4944-9b75-9156567f7c94 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:26.668323 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d8d2a62b-afad-4944-9b75-9156567f7c94 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:26.669024 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d8d2a62b-afad-4944-9b75-9156567f7c94 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:26.669464 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d8d2a62b-afad-4944-9b75-9156567f7c94 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:26.730301 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-46e55b3e-f3bb-4680-94cb-1b52ebaab639 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e235519204b4efc8b6c7e2988fab9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0b7307c30a4c118da4c501691e349f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:26.749240 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-46e55b3e-f3bb-4680-94cb-1b52ebaab639 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] 10.222.0.33 "GET /compute/v2.1/servers/b903ed91-8ea3-4c20-8565-b190d442e723" status: 200 len: 1317 microversion: 2.1 time: 1.114329 Sep 23 04:44:26.750234 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1549/3127] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:25 2022] GET /compute/v2.1/servers/b903ed91-8ea3-4c20-8565-b190d442e723 => generated 1317 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:26.766789 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-836d75aa-512f-4fb3-bdee-4e597cf494c3 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:26.767434 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-836d75aa-512f-4fb3-bdee-4e597cf494c3 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 874db366-9e32-40a4-bddb-ec587a81b865] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:26.780510 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-836d75aa-512f-4fb3-bdee-4e597cf494c3 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:26.781013 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-836d75aa-512f-4fb3-bdee-4e597cf494c3 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:26.781453 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-836d75aa-512f-4fb3-bdee-4e597cf494c3 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:26.782755 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-836d75aa-512f-4fb3-bdee-4e597cf494c3 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:26.783253 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-836d75aa-512f-4fb3-bdee-4e597cf494c3 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:26.783682 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-836d75aa-512f-4fb3-bdee-4e597cf494c3 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:27.159362 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d8d2a62b-afad-4944-9b75-9156567f7c94 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c53d79930a4eaf9fcf7cd10707fbf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22fd8f3b0334cb3b1af66cf626422fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:27.178798 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d8d2a62b-afad-4944-9b75-9156567f7c94 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] 10.222.0.33 "GET /compute/v2.1/servers/15e9bc0f-2262-4e2c-9cac-0eca4575943c" status: 200 len: 1332 microversion: 2.1 time: 0.533463 Sep 23 04:44:27.182203 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1579/3128] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:26 2022] GET /compute/v2.1/servers/15e9bc0f-2262-4e2c-9cac-0eca4575943c => generated 1332 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:44:27.201052 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3053950d-95be-4fc1-aede-2905133a9c69 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '.version_select at 0x7ff1bb824550>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:27.219632 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-836d75aa-512f-4fb3-bdee-4e597cf494c3 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:27.229570 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-836d75aa-512f-4fb3-bdee-4e597cf494c3 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/874db366-9e32-40a4-bddb-ec587a81b865" status: 200 len: 1328 microversion: 2.1 time: 0.477300 Sep 23 04:44:27.237564 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1550/3129] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:26 2022] GET /compute/v2.1/servers/874db366-9e32-40a4-bddb-ec587a81b865 => generated 1328 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:27.302325 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3053950d-95be-4fc1-aede-2905133a9c69 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/images/e161c9e7-af1d-4409-9a40-1f3f8885ed79" status: 200 len: 1414 microversion: 2.1 time: 0.118472 Sep 23 04:44:27.302928 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1580/3130] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:44:27 2022] GET /compute/v2.1/images/e161c9e7-af1d-4409-9a40-1f3f8885ed79 => generated 1414 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:27.775771 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c84f14ca-b6ec-4ad0-aefb-690dbf4ca9f4 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:27.776505 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c84f14ca-b6ec-4ad0-aefb-690dbf4ca9f4 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] [instance: b903ed91-8ea3-4c20-8565-b190d442e723] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:27.793607 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c84f14ca-b6ec-4ad0-aefb-690dbf4ca9f4 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:27.796316 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c84f14ca-b6ec-4ad0-aefb-690dbf4ca9f4 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:27.798060 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c84f14ca-b6ec-4ad0-aefb-690dbf4ca9f4 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:27.800610 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c84f14ca-b6ec-4ad0-aefb-690dbf4ca9f4 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:27.803635 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c84f14ca-b6ec-4ad0-aefb-690dbf4ca9f4 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:27.804678 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c84f14ca-b6ec-4ad0-aefb-690dbf4ca9f4 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:28.206522 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1d32b931-77f3-4c3f-a418-c928ce4a3b05 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:28.207158 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1d32b931-77f3-4c3f-a418-c928ce4a3b05 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] [instance: 15e9bc0f-2262-4e2c-9cac-0eca4575943c] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:28.231417 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1d32b931-77f3-4c3f-a418-c928ce4a3b05 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:28.231919 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1d32b931-77f3-4c3f-a418-c928ce4a3b05 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:28.232372 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1d32b931-77f3-4c3f-a418-c928ce4a3b05 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:28.233104 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1d32b931-77f3-4c3f-a418-c928ce4a3b05 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:28.233582 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1d32b931-77f3-4c3f-a418-c928ce4a3b05 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:28.234052 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1d32b931-77f3-4c3f-a418-c928ce4a3b05 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:28.586947 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c84f14ca-b6ec-4ad0-aefb-690dbf4ca9f4 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e235519204b4efc8b6c7e2988fab9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0b7307c30a4c118da4c501691e349f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:28.605996 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c84f14ca-b6ec-4ad0-aefb-690dbf4ca9f4 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] 10.222.0.33 "GET /compute/v2.1/servers/b903ed91-8ea3-4c20-8565-b190d442e723" status: 200 len: 1507 microversion: 2.1 time: 0.831756 Sep 23 04:44:28.610825 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1551/3131] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:27 2022] GET /compute/v2.1/servers/b903ed91-8ea3-4c20-8565-b190d442e723 => generated 1507 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:28.623788 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b3a27214-f245-4d55-a7ed-922706ca0dc0 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:28.625367 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b3a27214-f245-4d55-a7ed-922706ca0dc0 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 874db366-9e32-40a4-bddb-ec587a81b865] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:28.661656 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b3a27214-f245-4d55-a7ed-922706ca0dc0 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:28.665359 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b3a27214-f245-4d55-a7ed-922706ca0dc0 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:28.668299 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b3a27214-f245-4d55-a7ed-922706ca0dc0 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:28.675587 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b3a27214-f245-4d55-a7ed-922706ca0dc0 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:28.676143 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b3a27214-f245-4d55-a7ed-922706ca0dc0 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:28.676697 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b3a27214-f245-4d55-a7ed-922706ca0dc0 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:29.091164 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1d32b931-77f3-4c3f-a418-c928ce4a3b05 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c53d79930a4eaf9fcf7cd10707fbf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22fd8f3b0334cb3b1af66cf626422fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:29.109733 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1d32b931-77f3-4c3f-a418-c928ce4a3b05 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] 10.222.0.33 "GET /compute/v2.1/servers/15e9bc0f-2262-4e2c-9cac-0eca4575943c" status: 200 len: 1332 microversion: 2.1 time: 0.907728 Sep 23 04:44:29.114876 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1581/3132] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:28 2022] GET /compute/v2.1/servers/15e9bc0f-2262-4e2c-9cac-0eca4575943c => generated 1332 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:29.123695 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-34008bd9-f8ad-4efb-b795-3f3d50ff9a65 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '.version_select at 0x7ff1c03cc430>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:29.178924 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b3a27214-f245-4d55-a7ed-922706ca0dc0 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:29.199985 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b3a27214-f245-4d55-a7ed-922706ca0dc0 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/874db366-9e32-40a4-bddb-ec587a81b865" status: 200 len: 1328 microversion: 2.1 time: 0.587256 Sep 23 04:44:29.202230 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1552/3133] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:28 2022] GET /compute/v2.1/servers/874db366-9e32-40a4-bddb-ec587a81b865 => generated 1328 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:29.206864 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-34008bd9-f8ad-4efb-b795-3f3d50ff9a65 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/images/e161c9e7-af1d-4409-9a40-1f3f8885ed79" status: 200 len: 1414 microversion: 2.1 time: 0.090199 Sep 23 04:44:29.211141 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1582/3134] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:44:29 2022] GET /compute/v2.1/images/e161c9e7-af1d-4409-9a40-1f3f8885ed79 => generated 1414 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:30.022003 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-323a3170-21be-43bb-8d28-5debe761e516 req-184597b5-e24a-4fe5-8443-9a4ecaf3aeef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "874db366-9e32-40a4-bddb-ec587a81b865", "name": "network-vif-plugged", "status": "completed", "tag": "0d222fe9-2403-4841-ad5b-64483223ce62"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:44:30.042787 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-323a3170-21be-43bb-8d28-5debe761e516 req-184597b5-e24a-4fe5-8443-9a4ecaf3aeef service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:30.045666 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-323a3170-21be-43bb-8d28-5debe761e516 req-184597b5-e24a-4fe5-8443-9a4ecaf3aeef service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:30.046385 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-323a3170-21be-43bb-8d28-5debe761e516 req-184597b5-e24a-4fe5-8443-9a4ecaf3aeef service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:30.116756 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-323a3170-21be-43bb-8d28-5debe761e516 req-184597b5-e24a-4fe5-8443-9a4ecaf3aeef service nova] Creating event network-vif-plugged:0d222fe9-2403-4841-ad5b-64483223ce62 for instance 874db366-9e32-40a4-bddb-ec587a81b865 on n-h2-846463-3 Sep 23 04:44:30.125272 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-323a3170-21be-43bb-8d28-5debe761e516 req-184597b5-e24a-4fe5-8443-9a4ecaf3aeef service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107363 Sep 23 04:44:30.134372 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1553/3135] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:44:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:44:30.143069 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8e8bd461-41b1-4589-9279-431c3203450f tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:30.143945 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-8e8bd461-41b1-4589-9279-431c3203450f tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] [instance: 15e9bc0f-2262-4e2c-9cac-0eca4575943c] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:30.169177 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8e8bd461-41b1-4589-9279-431c3203450f tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:30.170006 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8e8bd461-41b1-4589-9279-431c3203450f tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:30.170613 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8e8bd461-41b1-4589-9279-431c3203450f tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:30.171516 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8e8bd461-41b1-4589-9279-431c3203450f tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:30.172137 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8e8bd461-41b1-4589-9279-431c3203450f tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:30.172830 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8e8bd461-41b1-4589-9279-431c3203450f tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:30.185526 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=100 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:44:30.226454 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5d3cd0cc-31ce-44d6-aef9-32072a169bcb tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:30.228114 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5d3cd0cc-31ce-44d6-aef9-32072a169bcb tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 874db366-9e32-40a4-bddb-ec587a81b865] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:30.243787 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5d3cd0cc-31ce-44d6-aef9-32072a169bcb tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:30.244770 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5d3cd0cc-31ce-44d6-aef9-32072a169bcb tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:30.245967 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5d3cd0cc-31ce-44d6-aef9-32072a169bcb tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:30.248488 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5d3cd0cc-31ce-44d6-aef9-32072a169bcb tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:30.249333 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5d3cd0cc-31ce-44d6-aef9-32072a169bcb tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:30.254232 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5d3cd0cc-31ce-44d6-aef9-32072a169bcb tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:30.992750 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-8e8bd461-41b1-4589-9279-431c3203450f tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c53d79930a4eaf9fcf7cd10707fbf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22fd8f3b0334cb3b1af66cf626422fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:31.066214 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-8e8bd461-41b1-4589-9279-431c3203450f tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] 10.222.0.33 "GET /compute/v2.1/servers/15e9bc0f-2262-4e2c-9cac-0eca4575943c" status: 200 len: 1536 microversion: 2.1 time: 0.929180 Sep 23 04:44:31.088352 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1583/3136] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:30 2022] GET /compute/v2.1/servers/15e9bc0f-2262-4e2c-9cac-0eca4575943c => generated 1536 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:31.109331 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-5d3cd0cc-31ce-44d6-aef9-32072a169bcb tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:31.121285 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-155fd145-111c-477b-b292-c3cac2e7d213 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '.version_select at 0x7ff1bb705310>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:31.134656 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5d3cd0cc-31ce-44d6-aef9-32072a169bcb tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/874db366-9e32-40a4-bddb-ec587a81b865" status: 200 len: 1328 microversion: 2.1 time: 0.914177 Sep 23 04:44:31.148296 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1554/3137] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:30 2022] GET /compute/v2.1/servers/874db366-9e32-40a4-bddb-ec587a81b865 => generated 1328 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:31.152937 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3aefff23-758c-4a9b-9fe9-0a10eac5c1bb tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Action: 'create', calling method: .version_select at 0x7ff1baa1b8b0>, body: {"pool": "343ef4fa-fca9-4453-b062-2fa3eb6972c1"} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:44:31.195188 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-155fd145-111c-477b-b292-c3cac2e7d213 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/images/e161c9e7-af1d-4409-9a40-1f3f8885ed79" status: 200 len: 1414 microversion: 2.1 time: 0.102678 Sep 23 04:44:31.196364 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1584/3138] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:44:31 2022] GET /compute/v2.1/images/e161c9e7-af1d-4409-9a40-1f3f8885ed79 => generated 1414 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:32.169389 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-85778b08-316d-4fb6-8257-b299140701aa tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:32.170050 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-85778b08-316d-4fb6-8257-b299140701aa tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 874db366-9e32-40a4-bddb-ec587a81b865] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:32.212618 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-85778b08-316d-4fb6-8257-b299140701aa tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:32.218176 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-85778b08-316d-4fb6-8257-b299140701aa tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:32.218526 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-85778b08-316d-4fb6-8257-b299140701aa tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:32.222885 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-85778b08-316d-4fb6-8257-b299140701aa tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:32.224645 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-85778b08-316d-4fb6-8257-b299140701aa tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:32.230131 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-85778b08-316d-4fb6-8257-b299140701aa tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:33.372290 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-85778b08-316d-4fb6-8257-b299140701aa tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:33.381266 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-85778b08-316d-4fb6-8257-b299140701aa tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/874db366-9e32-40a4-bddb-ec587a81b865" status: 200 len: 1508 microversion: 2.1 time: 1.218274 Sep 23 04:44:33.381948 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1585/3139] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:32 2022] GET /compute/v2.1/servers/874db366-9e32-40a4-bddb-ec587a81b865 => generated 1508 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:44:33.386678 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ba60add9-ae4c-4635-b24f-2b93efee9cee tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '.version_select at 0x7ff1bb76ed30>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:33.432202 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ba60add9-ae4c-4635-b24f-2b93efee9cee tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/images/e161c9e7-af1d-4409-9a40-1f3f8885ed79" status: 200 len: 1414 microversion: 2.1 time: 0.049037 Sep 23 04:44:33.432773 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1586/3140] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:44:33 2022] GET /compute/v2.1/images/e161c9e7-af1d-4409-9a40-1f3f8885ed79 => generated 1414 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:33.437621 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-657ea6b6-f334-41b4-9102-cb50645fd888 tempest-VolumesAdminNegativeTest-1909562694 tempest-VolumesAdminNegativeTest-1909562694-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "05a386af-e85a-4298-8bda-35e79d064206"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:44:33.440495 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-657ea6b6-f334-41b4-9102-cb50645fd888 tempest-VolumesAdminNegativeTest-1909562694 tempest-VolumesAdminNegativeTest-1909562694-project-admin] [instance: b903ed91-8ea3-4c20-8565-b190d442e723] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:33.450351 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-657ea6b6-f334-41b4-9102-cb50645fd888 tempest-VolumesAdminNegativeTest-1909562694 tempest-VolumesAdminNegativeTest-1909562694-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:33.450912 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-657ea6b6-f334-41b4-9102-cb50645fd888 tempest-VolumesAdminNegativeTest-1909562694 tempest-VolumesAdminNegativeTest-1909562694-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:33.451386 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-657ea6b6-f334-41b4-9102-cb50645fd888 tempest-VolumesAdminNegativeTest-1909562694 tempest-VolumesAdminNegativeTest-1909562694-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:33.452298 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-657ea6b6-f334-41b4-9102-cb50645fd888 tempest-VolumesAdminNegativeTest-1909562694 tempest-VolumesAdminNegativeTest-1909562694-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:33.452872 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-657ea6b6-f334-41b4-9102-cb50645fd888 tempest-VolumesAdminNegativeTest-1909562694 tempest-VolumesAdminNegativeTest-1909562694-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:33.453388 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-657ea6b6-f334-41b4-9102-cb50645fd888 tempest-VolumesAdminNegativeTest-1909562694 tempest-VolumesAdminNegativeTest-1909562694-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:33.509563 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-657ea6b6-f334-41b4-9102-cb50645fd888 tempest-VolumesAdminNegativeTest-1909562694 tempest-VolumesAdminNegativeTest-1909562694-project-admin] HTTP exception thrown: Volume b17e27fe-c5f6-46f3-87e9-de8ccc01e77e could not be found. Sep 23 04:44:33.512092 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-657ea6b6-f334-41b4-9102-cb50645fd888 tempest-VolumesAdminNegativeTest-1909562694 tempest-VolumesAdminNegativeTest-1909562694-project-admin] Request method failure captured: Sep 23 04:44:33.512092 n-d-846463-3 devstack@n-api.service[122699]: request: PUT /compute/v2.1/servers/b903ed91-8ea3-4c20-8565-b190d442e723/os-volume_attachments/b17e27fe-c5f6-46f3-87e9-de8ccc01e77e HTTP/1.1 Sep 23 04:44:33.512092 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:44:33.512092 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:44:33.512092 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:44:33.512092 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 74 Sep 23 04:44:33.512092 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:44:33.512092 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:44:33.512092 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:44:33.512092 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:44:33.512092 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTky9s_1bzr8a7rEDhK_USJgh1gGjmUJRRsR9md_qP-cLm-umk6Uq_mUWIXO93fDaw1bcIALvapO9il-jO4LhU1AyxPTLcWclbfG4yLmF9c3ikV1mbv3rBI05Gs8oTxdq9AWbCf_zoGpR38EPlYyx3reiMWg2FfxAfPvA_bnEc3xeCw Sep 23 04:44:33.512092 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:44:33.512092 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:44:33.512092 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:44:33.512092 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:44:33.512092 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:44:33.512092 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:44:33.512092 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 435d134b3a224a61975ced67bdf49af0 Sep 23 04:44:33.512092 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-VolumesAdminNegativeTest-1909562694 Sep 23 04:44:33.512092 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,admin,member Sep 23 04:44:33.512092 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,admin,member Sep 23 04:44:33.512092 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_435d134b3a224a61975ced67bdf49af0", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/435d134b3a224a61975ced67bdf49af0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/435d134b3a224a61975ced67bdf49af0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/435d134b3a224a61975ced67bdf49af0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:44:33.512092 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-VolumesAdminNegativeTest-1909562694 Sep 23 04:44:33.512092 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 435d134b3a224a61975ced67bdf49af0 Sep 23 04:44:33.512092 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1909562694 Sep 23 04:44:33.512092 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-VolumesAdminNegativeTest-1909562694-project-admin Sep 23 04:44:33.512092 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:44:33.512092 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:44:33.512092 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 9c924672fbad4bd4bd018e2736ba3e22 Sep 23 04:44:33.512092 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-VolumesAdminNegativeTest-1909562694-project-admin Sep 23 04:44:33.512092 n-d-846463-3 devstack@n-api.service[122699]: Sep 23 04:44:33.512092 n-d-846463-3 devstack@n-api.service[122699]: {"volumeAttachment": {"volumeId": "05a386af-e85a-4298-8bda-35e79d064206"}} Sep 23 04:44:33.512092 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:44:33.512092 n-d-846463-3 devstack@n-api.service[122699]: exception: Volume b17e27fe-c5f6-46f3-87e9-de8ccc01e77e could not be found. Sep 23 04:44:33.512092 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'server_id': 'b903ed91-8ea3-4c20-8565-b190d442e723', 'id': 'b17e27fe-c5f6-46f3-87e9-de8ccc01e77e', 'body': {'volumeAttachment': {'volumeId': '05a386af-e85a-4298-8bda-35e79d064206'}}} Sep 23 04:44:33.512092 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:44:33.512092 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:44:33.512092 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 23 04:44:33.512092 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 23 04:44:33.512092 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 23 04:44:33.512092 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 23 04:44:33.512092 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 23 04:44:33.512092 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 23 04:44:33.512092 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 23 04:44:33.512092 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 23 04:44:33.512092 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 23 04:44:33.512092 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 23 04:44:33.512092 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 23 04:44:33.512092 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 23 04:44:33.512092 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 23 04:44:33.512092 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 23 04:44:33.512092 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b17e27fe-c5f6-46f3-87e9-de8ccc01e77e could not be found. (HTTP 404) (Request-ID: req-b4c9fe8f-9bb6-4739-9134-d2eaabb37335) Sep 23 04:44:33.512092 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:44:33.512092 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:44:33.512092 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:44:33.512092 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:44:33.512092 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Sep 23 04:44:33.512092 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Sep 23 04:44:33.512092 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 23 04:44:33.512092 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 23 04:44:33.512092 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 23 04:44:33.516228 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 23 04:44:33.516228 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 23 04:44:33.516228 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 23 04:44:33.516228 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 23 04:44:33.516228 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 23 04:44:33.516228 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 23 04:44:33.516228 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 23 04:44:33.516228 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 23 04:44:33.516228 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 23 04:44:33.516228 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 23 04:44:33.516228 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 23 04:44:33.516228 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 23 04:44:33.516228 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 23 04:44:33.516228 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 23 04:44:33.516228 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 23 04:44:33.516228 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 23 04:44:33.516228 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 23 04:44:33.516228 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b17e27fe-c5f6-46f3-87e9-de8ccc01e77e could not be found. Sep 23 04:44:33.516228 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:44:33.516228 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:44:33.516228 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:44:33.516228 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:44:33.516228 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:44:33.516228 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:44:33.516228 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:44:33.516228 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:44:33.516228 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:44:33.516228 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:44:33.516228 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:44:33.516228 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:44:33.516228 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:44:33.516228 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:44:33.516228 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Sep 23 04:44:33.516228 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Sep 23 04:44:33.516228 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Sep 23 04:44:33.516228 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:44:33.516228 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b17e27fe-c5f6-46f3-87e9-de8ccc01e77e could not be found. Sep 23 04:44:33.516228 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:44:33.516228 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:44:33.516228 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:44:33.516228 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:44:33.516228 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:44:33.516228 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:44:33.516228 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:44:33.516228 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:44:33.516228 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b17e27fe-c5f6-46f3-87e9-de8ccc01e77e could not be found. Sep 23 04:44:33.516228 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:44:33.516228 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-657ea6b6-f334-41b4-9102-cb50645fd888 tempest-VolumesAdminNegativeTest-1909562694 tempest-VolumesAdminNegativeTest-1909562694-project-admin] Returning 404 to user: Volume b17e27fe-c5f6-46f3-87e9-de8ccc01e77e could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:44:33.516228 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-657ea6b6-f334-41b4-9102-cb50645fd888 tempest-VolumesAdminNegativeTest-1909562694 tempest-VolumesAdminNegativeTest-1909562694-project-admin] 10.222.0.33 "PUT /compute/v2.1/servers/b903ed91-8ea3-4c20-8565-b190d442e723/os-volume_attachments/b17e27fe-c5f6-46f3-87e9-de8ccc01e77e" status: 404 len: 109 microversion: 2.1 time: 0.079921 Sep 23 04:44:33.516228 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1587/3141] 10.222.0.33 () {60 vars in 1433 bytes} [Fri Sep 23 04:44:33 2022] PUT /compute/v2.1/servers/b903ed91-8ea3-4c20-8565-b190d442e723/os-volume_attachments/b17e27fe-c5f6-46f3-87e9-de8ccc01e77e => generated 109 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:44:33.525828 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1be6e570-2fd0-4141-b42f-eb040d2f9a8b tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:33.526482 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1be6e570-2fd0-4141-b42f-eb040d2f9a8b tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 874db366-9e32-40a4-bddb-ec587a81b865] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:33.534448 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1be6e570-2fd0-4141-b42f-eb040d2f9a8b tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:33.535734 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1be6e570-2fd0-4141-b42f-eb040d2f9a8b tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:33.536351 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1be6e570-2fd0-4141-b42f-eb040d2f9a8b tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:33.537918 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1be6e570-2fd0-4141-b42f-eb040d2f9a8b tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:33.538740 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1be6e570-2fd0-4141-b42f-eb040d2f9a8b tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:33.539665 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1be6e570-2fd0-4141-b42f-eb040d2f9a8b tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:34.114567 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1be6e570-2fd0-4141-b42f-eb040d2f9a8b tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:34.147379 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1be6e570-2fd0-4141-b42f-eb040d2f9a8b tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/874db366-9e32-40a4-bddb-ec587a81b865" status: 200 len: 1508 microversion: 2.1 time: 0.631323 Sep 23 04:44:34.148575 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1588/3142] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:33 2022] GET /compute/v2.1/servers/874db366-9e32-40a4-bddb-ec587a81b865 => generated 1508 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:34.176064 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4246f88d-0c92-49da-9d61-8e5bf4f0af56 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:34.176641 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4246f88d-0c92-49da-9d61-8e5bf4f0af56 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 874db366-9e32-40a4-bddb-ec587a81b865] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:34.194801 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4246f88d-0c92-49da-9d61-8e5bf4f0af56 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:34.195546 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4246f88d-0c92-49da-9d61-8e5bf4f0af56 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:34.197957 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4246f88d-0c92-49da-9d61-8e5bf4f0af56 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:34.198929 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4246f88d-0c92-49da-9d61-8e5bf4f0af56 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:34.199408 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4246f88d-0c92-49da-9d61-8e5bf4f0af56 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:34.199852 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4246f88d-0c92-49da-9d61-8e5bf4f0af56 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:34.276349 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4246f88d-0c92-49da-9d61-8e5bf4f0af56 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 874db366-9e32-40a4-bddb-ec587a81b865] Going to try to terminate instance {{(pid=122699) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:44:34.719971 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4246f88d-0c92-49da-9d61-8e5bf4f0af56 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "DELETE /compute/v2.1/servers/874db366-9e32-40a4-bddb-ec587a81b865" status: 204 len: 0 microversion: 2.1 time: 0.547691 Sep 23 04:44:34.721212 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1589/3143] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:44:34 2022] DELETE /compute/v2.1/servers/874db366-9e32-40a4-bddb-ec587a81b865 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:44:34.727286 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0db57d4a-ea8c-4e62-a712-4a887d3c2dd0 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '.version_select at 0x7ff1bb9d8e50>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:34.827836 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0db57d4a-ea8c-4e62-a712-4a887d3c2dd0 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/images/e161c9e7-af1d-4409-9a40-1f3f8885ed79" status: 200 len: 1414 microversion: 2.1 time: 0.105149 Sep 23 04:44:34.834928 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1590/3144] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:44:34 2022] GET /compute/v2.1/images/e161c9e7-af1d-4409-9a40-1f3f8885ed79 => generated 1414 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:34.852401 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9cbf6240-a276-4dfb-ba0c-4c2c7cecb1d5 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:34.853988 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-9cbf6240-a276-4dfb-ba0c-4c2c7cecb1d5 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 874db366-9e32-40a4-bddb-ec587a81b865] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:34.877075 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9cbf6240-a276-4dfb-ba0c-4c2c7cecb1d5 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:34.878078 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9cbf6240-a276-4dfb-ba0c-4c2c7cecb1d5 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:34.878539 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9cbf6240-a276-4dfb-ba0c-4c2c7cecb1d5 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:34.879260 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9cbf6240-a276-4dfb-ba0c-4c2c7cecb1d5 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:34.879720 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9cbf6240-a276-4dfb-ba0c-4c2c7cecb1d5 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:34.880159 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9cbf6240-a276-4dfb-ba0c-4c2c7cecb1d5 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:35.491449 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-9cbf6240-a276-4dfb-ba0c-4c2c7cecb1d5 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:35.502065 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-9cbf6240-a276-4dfb-ba0c-4c2c7cecb1d5 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/874db366-9e32-40a4-bddb-ec587a81b865" status: 200 len: 1514 microversion: 2.1 time: 0.665771 Sep 23 04:44:35.502874 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1591/3145] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:34 2022] GET /compute/v2.1/servers/874db366-9e32-40a4-bddb-ec587a81b865 => generated 1514 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:35.846490 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-530b1850-ca8b-4543-9458-f31d25997e14 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '.version_select at 0x7ff1c03cc310>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:35.946492 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-530b1850-ca8b-4543-9458-f31d25997e14 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/images/e161c9e7-af1d-4409-9a40-1f3f8885ed79" status: 200 len: 1423 microversion: 2.1 time: 0.103879 Sep 23 04:44:35.947717 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1592/3146] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:44:35 2022] GET /compute/v2.1/images/e161c9e7-af1d-4409-9a40-1f3f8885ed79 => generated 1423 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:35.963960 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9bd57552-ba01-4a41-985c-c46c84206570 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '.version_select at 0x7ff1bac37c10>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:36.026917 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-9bd57552-ba01-4a41-985c-c46c84206570 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/images/e161c9e7-af1d-4409-9a40-1f3f8885ed79" status: 200 len: 1423 microversion: 2.1 time: 0.062150 Sep 23 04:44:36.026917 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1593/3147] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:44:35 2022] GET /compute/v2.1/images/e161c9e7-af1d-4409-9a40-1f3f8885ed79 => generated 1423 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:44:36.038783 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-cc377bad-1c8e-4e12-a811-d4304a6bab2d tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '.version_select at 0x7ff1bb76e280>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:36.697632 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3aefff23-758c-4a9b-9fe9-0a10eac5c1bb tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] 10.222.0.33 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.553657 Sep 23 04:44:36.698320 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1555/3148] 10.222.0.33 () {60 vars in 1170 bytes} [Fri Sep 23 04:44:31 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5556 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:44:36.703187 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-273cbac0-b94f-467b-b599-60c07ef9bf2c tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:36.703888 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-273cbac0-b94f-467b-b599-60c07ef9bf2c tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 874db366-9e32-40a4-bddb-ec587a81b865] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:36.716721 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-273cbac0-b94f-467b-b599-60c07ef9bf2c tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:36.721425 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-273cbac0-b94f-467b-b599-60c07ef9bf2c tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:36.723991 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-273cbac0-b94f-467b-b599-60c07ef9bf2c tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:36.724756 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-273cbac0-b94f-467b-b599-60c07ef9bf2c tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:36.725327 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-273cbac0-b94f-467b-b599-60c07ef9bf2c tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:36.727856 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-273cbac0-b94f-467b-b599-60c07ef9bf2c tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:37.171221 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-273cbac0-b94f-467b-b599-60c07ef9bf2c tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:37.184605 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-273cbac0-b94f-467b-b599-60c07ef9bf2c tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/874db366-9e32-40a4-bddb-ec587a81b865" status: 200 len: 1514 microversion: 2.1 time: 0.483700 Sep 23 04:44:37.185415 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1556/3149] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:36 2022] GET /compute/v2.1/servers/874db366-9e32-40a4-bddb-ec587a81b865 => generated 1514 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:37.199153 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f71ff1f7-450e-419d-a6b2-22d85ae3262a tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.3.128"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:44:37.206028 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f71ff1f7-450e-419d-a6b2-22d85ae3262a tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] [instance: 15e9bc0f-2262-4e2c-9cac-0eca4575943c] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:37.213433 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f71ff1f7-450e-419d-a6b2-22d85ae3262a tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:37.215748 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f71ff1f7-450e-419d-a6b2-22d85ae3262a tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:37.216564 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f71ff1f7-450e-419d-a6b2-22d85ae3262a tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:37.217499 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f71ff1f7-450e-419d-a6b2-22d85ae3262a tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:37.218480 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f71ff1f7-450e-419d-a6b2-22d85ae3262a tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:37.219128 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f71ff1f7-450e-419d-a6b2-22d85ae3262a tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:37.275213 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f71ff1f7-450e-419d-a6b2-22d85ae3262a tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Acquiring lock "refresh_cache-15e9bc0f-2262-4e2c-9cac-0eca4575943c" {{(pid=122698) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 23 04:44:37.278391 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f71ff1f7-450e-419d-a6b2-22d85ae3262a tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Acquired lock "refresh_cache-15e9bc0f-2262-4e2c-9cac-0eca4575943c" {{(pid=122698) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 23 04:44:37.918972 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-cc377bad-1c8e-4e12-a811-d4304a6bab2d tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "DELETE /compute/v2.1/images/e161c9e7-af1d-4409-9a40-1f3f8885ed79" status: 204 len: 0 microversion: 2.1 time: 1.887302 Sep 23 04:44:37.920344 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1594/3150] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:36 2022] DELETE /compute/v2.1/images/e161c9e7-af1d-4409-9a40-1f3f8885ed79 => generated 0 bytes in 1889 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:44:37.925998 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-4c0655e2-1228-42d1-a659-87ca9420f705 req-087f154f-6753-4feb-b704-eac57e5c0f0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "874db366-9e32-40a4-bddb-ec587a81b865", "name": "network-vif-deleted", "tag": "0d222fe9-2403-4841-ad5b-64483223ce62"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:44:37.959798 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-4c0655e2-1228-42d1-a659-87ca9420f705 req-087f154f-6753-4feb-b704-eac57e5c0f0a service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:37.960604 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-4c0655e2-1228-42d1-a659-87ca9420f705 req-087f154f-6753-4feb-b704-eac57e5c0f0a service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:37.961342 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-4c0655e2-1228-42d1-a659-87ca9420f705 req-087f154f-6753-4feb-b704-eac57e5c0f0a service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:37.993147 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-4c0655e2-1228-42d1-a659-87ca9420f705 req-087f154f-6753-4feb-b704-eac57e5c0f0a service nova] Creating event network-vif-deleted:0d222fe9-2403-4841-ad5b-64483223ce62 for instance 874db366-9e32-40a4-bddb-ec587a81b865 on n-h2-846463-3 Sep 23 04:44:38.008913 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-4c0655e2-1228-42d1-a659-87ca9420f705 req-087f154f-6753-4feb-b704-eac57e5c0f0a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087053 Sep 23 04:44:38.014288 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1595/3151] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:44:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:44:38.021122 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f51b990b-d6c3-4054-8863-114c2d21074c tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:38.021973 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f51b990b-d6c3-4054-8863-114c2d21074c tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] [instance: 2cea388e-a568-48be-9f76-b673509a7824] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:38.040141 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f51b990b-d6c3-4054-8863-114c2d21074c tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:38.040141 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f51b990b-d6c3-4054-8863-114c2d21074c tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:38.040141 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f51b990b-d6c3-4054-8863-114c2d21074c tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:38.040141 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f51b990b-d6c3-4054-8863-114c2d21074c tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:38.040141 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f51b990b-d6c3-4054-8863-114c2d21074c tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:38.040723 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f51b990b-d6c3-4054-8863-114c2d21074c tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:38.114814 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f51b990b-d6c3-4054-8863-114c2d21074c tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] [instance: 2cea388e-a568-48be-9f76-b673509a7824] Going to try to terminate instance {{(pid=122699) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:44:38.565880 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f51b990b-d6c3-4054-8863-114c2d21074c tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "DELETE /compute/v2.1/servers/2cea388e-a568-48be-9f76-b673509a7824" status: 204 len: 0 microversion: 2.1 time: 0.549587 Sep 23 04:44:38.567063 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1596/3152] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:44:38 2022] DELETE /compute/v2.1/servers/2cea388e-a568-48be-9f76-b673509a7824 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:44:38.593439 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-14abe9ad-030d-4fc5-8968-c8378be97383 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:38.602952 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-14abe9ad-030d-4fc5-8968-c8378be97383 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 874db366-9e32-40a4-bddb-ec587a81b865] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:38.605011 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:44:38.618477 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-14abe9ad-030d-4fc5-8968-c8378be97383 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:38.618991 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-14abe9ad-030d-4fc5-8968-c8378be97383 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:38.619437 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-14abe9ad-030d-4fc5-8968-c8378be97383 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:38.620164 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-14abe9ad-030d-4fc5-8968-c8378be97383 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:38.620631 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-14abe9ad-030d-4fc5-8968-c8378be97383 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:38.621243 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-14abe9ad-030d-4fc5-8968-c8378be97383 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:38.717092 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-14abe9ad-030d-4fc5-8968-c8378be97383 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:38.721966 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-14abe9ad-030d-4fc5-8968-c8378be97383 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:38.722581 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-14abe9ad-030d-4fc5-8968-c8378be97383 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:38.723310 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-14abe9ad-030d-4fc5-8968-c8378be97383 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lazy-loading 'fault' on Instance uuid 874db366-9e32-40a4-bddb-ec587a81b865 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:44:38.953469 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-14abe9ad-030d-4fc5-8968-c8378be97383 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:38.968366 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-14abe9ad-030d-4fc5-8968-c8378be97383 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/874db366-9e32-40a4-bddb-ec587a81b865" status: 200 len: 1318 microversion: 2.1 time: 0.399451 Sep 23 04:44:38.985448 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1597/3153] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:38 2022] GET /compute/v2.1/servers/874db366-9e32-40a4-bddb-ec587a81b865 => generated 1318 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:38.991084 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d71e1283-8090-4c71-8fea-8c6793904054 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:38.996576 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d71e1283-8090-4c71-8fea-8c6793904054 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] [instance: b903ed91-8ea3-4c20-8565-b190d442e723] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:39.002307 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d71e1283-8090-4c71-8fea-8c6793904054 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:39.004772 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d71e1283-8090-4c71-8fea-8c6793904054 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:39.006133 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d71e1283-8090-4c71-8fea-8c6793904054 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:39.007917 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d71e1283-8090-4c71-8fea-8c6793904054 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:39.011251 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d71e1283-8090-4c71-8fea-8c6793904054 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:39.012989 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d71e1283-8090-4c71-8fea-8c6793904054 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:39.076927 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d71e1283-8090-4c71-8fea-8c6793904054 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] [instance: b903ed91-8ea3-4c20-8565-b190d442e723] Going to try to terminate instance {{(pid=122699) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:44:39.474101 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d71e1283-8090-4c71-8fea-8c6793904054 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b903ed91-8ea3-4c20-8565-b190d442e723" status: 204 len: 0 microversion: 2.1 time: 0.501905 Sep 23 04:44:39.475018 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1598/3154] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:44:38 2022] DELETE /compute/v2.1/servers/b903ed91-8ea3-4c20-8565-b190d442e723 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:44:39.480511 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3f8c933a-7e8e-4369-92f3-082be7c61265 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1528846871", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "networks": [{"uuid": "ba35f7e0-9420-45ef-a251-5988b98046ec"}]}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:44:39.583882 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.neutron [None req-3f8c933a-7e8e-4369-92f3-082be7c61265 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] validate_networks() for [('ba35f7e0-9420-45ef-a251-5988b98046ec', None, None, None, None, None)] {{(pid=122699) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:44:40.872713 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.network.neutron [None req-f71ff1f7-450e-419d-a6b2-22d85ae3262a tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] [instance: 15e9bc0f-2262-4e2c-9cac-0eca4575943c] Building network info cache for instance {{(pid=122698) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 23 04:44:40.975935 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-3f8c933a-7e8e-4369-92f3-082be7c61265 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Flavor limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:44:40.975935 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-3f8c933a-7e8e-4369-92f3-082be7c61265 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Image limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:44:40.975935 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-3f8c933a-7e8e-4369-92f3-082be7c61265 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Flavor pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:44:40.977080 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-3f8c933a-7e8e-4369-92f3-082be7c61265 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Image pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:44:40.977560 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-3f8c933a-7e8e-4369-92f3-082be7c61265 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:44:41.007452 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3f8c933a-7e8e-4369-92f3-082be7c61265 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:41.007452 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3f8c933a-7e8e-4369-92f3-082be7c61265 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:41.007452 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3f8c933a-7e8e-4369-92f3-082be7c61265 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:41.007452 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3f8c933a-7e8e-4369-92f3-082be7c61265 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:41.007452 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3f8c933a-7e8e-4369-92f3-082be7c61265 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:41.007452 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3f8c933a-7e8e-4369-92f3-082be7c61265 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:41.076949 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-3f8c933a-7e8e-4369-92f3-082be7c61265 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Getting quotas for project 7c43f2b70bc74a48b62fb4115337f073. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:44:41.084248 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-3f8c933a-7e8e-4369-92f3-082be7c61265 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Getting quotas for user c11980041918484990dac709544d0b42 and project 7c43f2b70bc74a48b62fb4115337f073. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:44:41.104037 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-3f8c933a-7e8e-4369-92f3-082be7c61265 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Going to run 1 instances... {{(pid=122699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:44:41.107076 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-3f8c933a-7e8e-4369-92f3-082be7c61265 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] [instance: 188a699b-0a1a-46b4-9a03-788af481d3ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:44:41.297163 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3f8c933a-7e8e-4369-92f3-082be7c61265 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.820798 Sep 23 04:44:41.298768 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1599/3155] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:44:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1823 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:44:41.311940 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0d40ed55-fc1c-46f4-a94f-61d613c88635 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:41.312932 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-0d40ed55-fc1c-46f4-a94f-61d613c88635 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] [instance: b903ed91-8ea3-4c20-8565-b190d442e723] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:41.324587 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0d40ed55-fc1c-46f4-a94f-61d613c88635 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:41.338342 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0d40ed55-fc1c-46f4-a94f-61d613c88635 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:41.338342 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0d40ed55-fc1c-46f4-a94f-61d613c88635 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:41.338342 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0d40ed55-fc1c-46f4-a94f-61d613c88635 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:41.338342 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0d40ed55-fc1c-46f4-a94f-61d613c88635 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:41.338342 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0d40ed55-fc1c-46f4-a94f-61d613c88635 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:41.838699 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-0d40ed55-fc1c-46f4-a94f-61d613c88635 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e235519204b4efc8b6c7e2988fab9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0b7307c30a4c118da4c501691e349f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:41.847148 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0d40ed55-fc1c-46f4-a94f-61d613c88635 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] 10.222.0.33 "GET /compute/v2.1/servers/b903ed91-8ea3-4c20-8565-b190d442e723" status: 200 len: 1513 microversion: 2.1 time: 0.539676 Sep 23 04:44:41.847752 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1600/3156] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:41 2022] GET /compute/v2.1/servers/b903ed91-8ea3-4c20-8565-b190d442e723 => generated 1513 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:41.862545 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e66aee48-f8de-48db-beff-74308aa09066 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:41.862545 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e66aee48-f8de-48db-beff-74308aa09066 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 874db366-9e32-40a4-bddb-ec587a81b865] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:41.879748 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e66aee48-f8de-48db-beff-74308aa09066 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:41.880261 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e66aee48-f8de-48db-beff-74308aa09066 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:41.880719 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e66aee48-f8de-48db-beff-74308aa09066 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:41.881426 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e66aee48-f8de-48db-beff-74308aa09066 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:41.881923 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e66aee48-f8de-48db-beff-74308aa09066 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:41.882357 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e66aee48-f8de-48db-beff-74308aa09066 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:41.897496 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-e66aee48-f8de-48db-beff-74308aa09066 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] HTTP exception thrown: Instance 874db366-9e32-40a4-bddb-ec587a81b865 could not be found. Sep 23 04:44:41.899492 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e66aee48-f8de-48db-beff-74308aa09066 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Request method failure captured: Sep 23 04:44:41.899492 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/874db366-9e32-40a4-bddb-ec587a81b865 HTTP/1.1 Sep 23 04:44:41.899492 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:44:41.899492 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:44:41.899492 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:44:41.899492 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:44:41.899492 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:44:41.899492 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:44:41.899492 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:44:41.899492 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:44:41.899492 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTlTlFK_k4e3BWkoqwVigfjvHO2lVSTsmHRT7EhNgH87mj-DVuWXCq-NRLrmXyv4E_e0wXdkZnDmOQ4aUkRrz7wPxuRsMdZHh23aH7xyd0PRdo29c8XIic0D4fdht4KBWWMxFeNNSWWMe-xxhvPgOUVxbcTbEXPF75Q0c4Y9h1Ew0hk Sep 23 04:44:41.899492 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:44:41.899492 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:44:41.899492 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:44:41.899492 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:44:41.899492 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:44:41.899492 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:44:41.899492 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: c23bd5a8b84942898a99930b2bc0ca12 Sep 23 04:44:41.899492 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ServersTestJSON-1923416422 Sep 23 04:44:41.899492 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:44:41.899492 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:44:41.899492 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c23bd5a8b84942898a99930b2bc0ca12", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c23bd5a8b84942898a99930b2bc0ca12"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c23bd5a8b84942898a99930b2bc0ca12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c23bd5a8b84942898a99930b2bc0ca12"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:44:41.899492 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ServersTestJSON-1923416422 Sep 23 04:44:41.899492 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: c23bd5a8b84942898a99930b2bc0ca12 Sep 23 04:44:41.899492 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ServersTestJSON-1923416422 Sep 23 04:44:41.899492 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ServersTestJSON-1923416422-project Sep 23 04:44:41.899492 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:44:41.899492 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:44:41.899492 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 252c87e244984f71ae0907ee769bec05 Sep 23 04:44:41.899492 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ServersTestJSON-1923416422-project Sep 23 04:44:41.899492 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:44:41.899492 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 874db366-9e32-40a4-bddb-ec587a81b865 could not be found. Sep 23 04:44:41.899492 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '874db366-9e32-40a4-bddb-ec587a81b865'} Sep 23 04:44:41.899492 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:44:41.899492 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:44:41.899492 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:44:41.899492 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:44:41.899492 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:44:41.899492 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:44:41.899492 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:44:41.899492 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:44:41.899492 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:44:41.899492 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:44:41.899492 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 874db366-9e32-40a4-bddb-ec587a81b865 could not be found. Sep 23 04:44:41.899492 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:44:41.899492 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:44:41.899492 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:44:41.899492 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:44:41.899492 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:44:41.899492 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:44:41.899492 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:44:41.899492 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:44:41.899492 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:44:41.899492 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:44:41.899492 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:44:41.899492 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:44:41.899492 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:44:41.899492 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:44:41.899492 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:44:41.899492 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:44:41.899492 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 874db366-9e32-40a4-bddb-ec587a81b865 could not be found. Sep 23 04:44:41.899492 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:44:41.899492 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:44:41.899492 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:44:41.903814 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:44:41.903814 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:44:41.903814 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:44:41.903814 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:44:41.903814 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:44:41.903814 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 874db366-9e32-40a4-bddb-ec587a81b865 could not be found. Sep 23 04:44:41.903814 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:44:41.905813 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e66aee48-f8de-48db-beff-74308aa09066 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Returning 404 to user: Instance 874db366-9e32-40a4-bddb-ec587a81b865 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:44:41.908051 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e66aee48-f8de-48db-beff-74308aa09066 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/874db366-9e32-40a4-bddb-ec587a81b865" status: 404 len: 111 microversion: 2.1 time: 0.058245 Sep 23 04:44:41.909174 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1601/3157] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:41 2022] GET /compute/v2.1/servers/874db366-9e32-40a4-bddb-ec587a81b865 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:44:41.915963 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-378f0bd8-d89f-4363-a7ec-98462175f359 req-dd0a90a6-8767-4912-ad10-f01c13d37179 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cea388e-a568-48be-9f76-b673509a7824", "name": "network-vif-unplugged", "status": "completed", "tag": "74832ded-447e-411f-ad28-f9a01aaa0cba"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:44:41.927170 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-378f0bd8-d89f-4363-a7ec-98462175f359 req-dd0a90a6-8767-4912-ad10-f01c13d37179 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:41.928611 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-378f0bd8-d89f-4363-a7ec-98462175f359 req-dd0a90a6-8767-4912-ad10-f01c13d37179 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:41.929518 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-378f0bd8-d89f-4363-a7ec-98462175f359 req-dd0a90a6-8767-4912-ad10-f01c13d37179 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:41.943120 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-378f0bd8-d89f-4363-a7ec-98462175f359 req-dd0a90a6-8767-4912-ad10-f01c13d37179 service nova] Creating event network-vif-unplugged:74832ded-447e-411f-ad28-f9a01aaa0cba for instance 2cea388e-a568-48be-9f76-b673509a7824 on n-h1-846463-3 Sep 23 04:44:41.948314 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-378f0bd8-d89f-4363-a7ec-98462175f359 req-dd0a90a6-8767-4912-ad10-f01c13d37179 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037723 Sep 23 04:44:41.949575 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1602/3158] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:44:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:44:41.962828 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-f0cab3dc-3311-4264-9caa-b2b17418bc73 req-719f15e0-466c-49a2-b835-c2bbd316e84e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15e9bc0f-2262-4e2c-9cac-0eca4575943c", "tag": "c81ebfeb-05fd-445f-bb49-70dc27b6c143"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:44:41.971666 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-f0cab3dc-3311-4264-9caa-b2b17418bc73 req-719f15e0-466c-49a2-b835-c2bbd316e84e service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:41.972162 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-f0cab3dc-3311-4264-9caa-b2b17418bc73 req-719f15e0-466c-49a2-b835-c2bbd316e84e service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:41.972634 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-f0cab3dc-3311-4264-9caa-b2b17418bc73 req-719f15e0-466c-49a2-b835-c2bbd316e84e service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:42.005130 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-f0cab3dc-3311-4264-9caa-b2b17418bc73 req-719f15e0-466c-49a2-b835-c2bbd316e84e service nova] Creating event network-changed:c81ebfeb-05fd-445f-bb49-70dc27b6c143 for instance 15e9bc0f-2262-4e2c-9cac-0eca4575943c on n-h2-846463-3 Sep 23 04:44:42.011435 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-f0cab3dc-3311-4264-9caa-b2b17418bc73 req-719f15e0-466c-49a2-b835-c2bbd316e84e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060276 Sep 23 04:44:42.023024 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1603/3159] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:44:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:44:42.028378 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1c5510e4-ebbb-4809-8f18-72fb71243682 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:42.029116 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1c5510e4-ebbb-4809-8f18-72fb71243682 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] [instance: 188a699b-0a1a-46b4-9a03-788af481d3ca] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:42.235507 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1c5510e4-ebbb-4809-8f18-72fb71243682 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11980041918484990dac709544d0b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c43f2b70bc74a48b62fb4115337f073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:42.248347 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1c5510e4-ebbb-4809-8f18-72fb71243682 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/servers/188a699b-0a1a-46b4-9a03-788af481d3ca" status: 200 len: 1208 microversion: 2.1 time: 0.223989 Sep 23 04:44:42.249488 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1604/3160] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:42 2022] GET /compute/v2.1/servers/188a699b-0a1a-46b4-9a03-788af481d3ca => generated 1208 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:42.254351 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5a174ad7-50f3-4147-abe5-e948d6c60c99 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '.version_select at 0x7ff1c03cc430>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:42.407462 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5a174ad7-50f3-4147-abe5-e948d6c60c99 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-key-897099014" status: 202 len: 0 microversion: 2.1 time: 0.156645 Sep 23 04:44:42.408409 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1605/3161] 10.222.0.33 () {58 vars in 1206 bytes} [Fri Sep 23 04:44:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-897099014 => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:44:42.619756 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-068dbef3-8c39-4187-856f-22189d512508 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-773675428", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "networks": [{"uuid": "e70e4da0-3337-4af1-b4df-8067d676f5e8"}]}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:44:42.729766 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.neutron [None req-068dbef3-8c39-4187-856f-22189d512508 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] validate_networks() for [('e70e4da0-3337-4af1-b4df-8067d676f5e8', None, None, None, None, None)] {{(pid=122699) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:44:42.874395 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.network.neutron [None req-f71ff1f7-450e-419d-a6b2-22d85ae3262a tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] [instance: 15e9bc0f-2262-4e2c-9cac-0eca4575943c] Updating instance_info_cache with network_info: [{"id": "c81ebfeb-05fd-445f-bb49-70dc27b6c143", "address": "fa:16:3e:19:06:94", "network": {"id": "92e4cf52-3ec0-4ed2-ba7a-11c60083e3f3", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1923791577-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.3.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "d22fd8f3b0334cb3b1af66cf626422fe", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapc81ebfeb-05", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122698) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 23 04:44:43.010833 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f71ff1f7-450e-419d-a6b2-22d85ae3262a tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Releasing lock "refresh_cache-15e9bc0f-2262-4e2c-9cac-0eca4575943c" {{(pid=122698) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 23 04:44:43.010833 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f71ff1f7-450e-419d-a6b2-22d85ae3262a tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] 10.222.0.33 "POST /compute/v2.1/servers/15e9bc0f-2262-4e2c-9cac-0eca4575943c/action" status: 202 len: 0 microversion: 2.1 time: 5.819002 Sep 23 04:44:43.010833 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1557/3162] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:44:37 2022] POST /compute/v2.1/servers/15e9bc0f-2262-4e2c-9cac-0eca4575943c/action => generated 0 bytes in 5822 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 23 04:44:43.016875 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ef31606d-019b-407b-90f8-d849cf9377c2 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:43.018083 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-ef31606d-019b-407b-90f8-d849cf9377c2 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] [instance: b903ed91-8ea3-4c20-8565-b190d442e723] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:43.050833 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:44:43.074674 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ef31606d-019b-407b-90f8-d849cf9377c2 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:43.075363 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ef31606d-019b-407b-90f8-d849cf9377c2 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:43.077368 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ef31606d-019b-407b-90f8-d849cf9377c2 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:43.080762 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ef31606d-019b-407b-90f8-d849cf9377c2 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:43.087243 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ef31606d-019b-407b-90f8-d849cf9377c2 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:43.093119 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ef31606d-019b-407b-90f8-d849cf9377c2 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:44.465470 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ef31606d-019b-407b-90f8-d849cf9377c2 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e235519204b4efc8b6c7e2988fab9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0b7307c30a4c118da4c501691e349f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:44.478656 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ef31606d-019b-407b-90f8-d849cf9377c2 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] 10.222.0.33 "GET /compute/v2.1/servers/b903ed91-8ea3-4c20-8565-b190d442e723" status: 200 len: 1513 microversion: 2.1 time: 1.469983 Sep 23 04:44:44.489529 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1558/3163] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:43 2022] GET /compute/v2.1/servers/b903ed91-8ea3-4c20-8565-b190d442e723 => generated 1513 bytes in 1480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:44.503322 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-da3935d1-3a99-461e-9102-0de9f7402561 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Action: 'create', calling method: .version_select at 0x7ff1baa1bca0>, body: {"pool": "343ef4fa-fca9-4453-b062-2fa3eb6972c1"} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:44:45.472799 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-068dbef3-8c39-4187-856f-22189d512508 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Flavor limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:44:45.473804 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-068dbef3-8c39-4187-856f-22189d512508 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Image limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:44:45.474804 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-068dbef3-8c39-4187-856f-22189d512508 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Flavor pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:44:45.476319 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-068dbef3-8c39-4187-856f-22189d512508 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Image pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:44:45.476997 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-068dbef3-8c39-4187-856f-22189d512508 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:44:45.500256 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-068dbef3-8c39-4187-856f-22189d512508 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:45.501057 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-068dbef3-8c39-4187-856f-22189d512508 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:45.506295 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-068dbef3-8c39-4187-856f-22189d512508 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:45.506295 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-068dbef3-8c39-4187-856f-22189d512508 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:45.506295 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-068dbef3-8c39-4187-856f-22189d512508 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:45.506295 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-068dbef3-8c39-4187-856f-22189d512508 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:45.520127 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:44:45.550063 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-068dbef3-8c39-4187-856f-22189d512508 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Getting quotas for project c23bd5a8b84942898a99930b2bc0ca12. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:44:45.572856 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-068dbef3-8c39-4187-856f-22189d512508 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Getting quotas for user 252c87e244984f71ae0907ee769bec05 and project c23bd5a8b84942898a99930b2bc0ca12. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:44:45.609340 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-068dbef3-8c39-4187-856f-22189d512508 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Going to run 1 instances... {{(pid=122699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:44:45.613378 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-068dbef3-8c39-4187-856f-22189d512508 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 2c316737-b84f-4b49-a5ab-cc0196b15760] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:44:45.868718 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-068dbef3-8c39-4187-856f-22189d512508 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.252733 Sep 23 04:44:45.871882 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1606/3164] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:44:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 3257 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 23 04:44:45.882082 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-aa0e0004-1b7b-4ad0-8abd-43fbf60c9bbd tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:45.891262 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-aa0e0004-1b7b-4ad0-8abd-43fbf60c9bbd tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] [instance: 188a699b-0a1a-46b4-9a03-788af481d3ca] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:45.924113 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aa0e0004-1b7b-4ad0-8abd-43fbf60c9bbd tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:45.934896 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aa0e0004-1b7b-4ad0-8abd-43fbf60c9bbd tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:45.936179 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aa0e0004-1b7b-4ad0-8abd-43fbf60c9bbd tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:45.937045 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aa0e0004-1b7b-4ad0-8abd-43fbf60c9bbd tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:45.939083 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aa0e0004-1b7b-4ad0-8abd-43fbf60c9bbd tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:45.940420 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aa0e0004-1b7b-4ad0-8abd-43fbf60c9bbd tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:46.477924 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-aa0e0004-1b7b-4ad0-8abd-43fbf60c9bbd tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11980041918484990dac709544d0b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c43f2b70bc74a48b62fb4115337f073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:46.488182 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-aa0e0004-1b7b-4ad0-8abd-43fbf60c9bbd tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/servers/188a699b-0a1a-46b4-9a03-788af481d3ca" status: 200 len: 1266 microversion: 2.1 time: 0.615013 Sep 23 04:44:46.488911 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1607/3165] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:45 2022] GET /compute/v2.1/servers/188a699b-0a1a-46b4-9a03-788af481d3ca => generated 1266 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:46.493673 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-16dc4f80-47b6-44d4-86f5-661ecd36f591 req-7d5c73be-a3ff-4117-b274-b03a88e2b766 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cea388e-a568-48be-9f76-b673509a7824", "name": "network-vif-deleted", "tag": "74832ded-447e-411f-ad28-f9a01aaa0cba"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:44:46.507272 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-16dc4f80-47b6-44d4-86f5-661ecd36f591 req-7d5c73be-a3ff-4117-b274-b03a88e2b766 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:46.508045 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-16dc4f80-47b6-44d4-86f5-661ecd36f591 req-7d5c73be-a3ff-4117-b274-b03a88e2b766 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:46.508654 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-16dc4f80-47b6-44d4-86f5-661ecd36f591 req-7d5c73be-a3ff-4117-b274-b03a88e2b766 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:46.540069 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-16dc4f80-47b6-44d4-86f5-661ecd36f591 req-7d5c73be-a3ff-4117-b274-b03a88e2b766 service nova] Creating event network-vif-deleted:74832ded-447e-411f-ad28-f9a01aaa0cba for instance 2cea388e-a568-48be-9f76-b673509a7824 on n-h1-846463-3 Sep 23 04:44:46.550033 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-16dc4f80-47b6-44d4-86f5-661ecd36f591 req-7d5c73be-a3ff-4117-b274-b03a88e2b766 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059633 Sep 23 04:44:46.552429 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1608/3166] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:44:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:44:46.561827 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-22bf9998-37fd-4eb9-806e-18124fdb9383 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:46.562583 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-22bf9998-37fd-4eb9-806e-18124fdb9383 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] [instance: b903ed91-8ea3-4c20-8565-b190d442e723] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:46.578005 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-22bf9998-37fd-4eb9-806e-18124fdb9383 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:46.579736 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-22bf9998-37fd-4eb9-806e-18124fdb9383 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:46.580383 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-22bf9998-37fd-4eb9-806e-18124fdb9383 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:46.582631 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-22bf9998-37fd-4eb9-806e-18124fdb9383 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:46.584989 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-22bf9998-37fd-4eb9-806e-18124fdb9383 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:46.586986 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-22bf9998-37fd-4eb9-806e-18124fdb9383 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:46.670913 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-22bf9998-37fd-4eb9-806e-18124fdb9383 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:46.671586 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-22bf9998-37fd-4eb9-806e-18124fdb9383 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:46.672209 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-22bf9998-37fd-4eb9-806e-18124fdb9383 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:46.672828 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-22bf9998-37fd-4eb9-806e-18124fdb9383 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lazy-loading 'fault' on Instance uuid b903ed91-8ea3-4c20-8565-b190d442e723 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:44:46.815726 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-22bf9998-37fd-4eb9-806e-18124fdb9383 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e235519204b4efc8b6c7e2988fab9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0b7307c30a4c118da4c501691e349f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:46.829378 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-22bf9998-37fd-4eb9-806e-18124fdb9383 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] 10.222.0.33 "GET /compute/v2.1/servers/b903ed91-8ea3-4c20-8565-b190d442e723" status: 200 len: 1307 microversion: 2.1 time: 0.272408 Sep 23 04:44:46.830277 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1609/3167] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:46 2022] GET /compute/v2.1/servers/b903ed91-8ea3-4c20-8565-b190d442e723 => generated 1307 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:46.848801 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-ae9dc6cc-8225-471b-8e6e-c338ad781082 req-631d0b40-1fd1-49ec-8ddf-c840dae29626 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b903ed91-8ea3-4c20-8565-b190d442e723", "name": "network-vif-deleted", "tag": "1eb2993e-ab60-4149-954a-75f33e83e3e1"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:44:46.868713 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-ae9dc6cc-8225-471b-8e6e-c338ad781082 req-631d0b40-1fd1-49ec-8ddf-c840dae29626 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:46.869589 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-ae9dc6cc-8225-471b-8e6e-c338ad781082 req-631d0b40-1fd1-49ec-8ddf-c840dae29626 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:46.870330 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-ae9dc6cc-8225-471b-8e6e-c338ad781082 req-631d0b40-1fd1-49ec-8ddf-c840dae29626 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:46.932090 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-ae9dc6cc-8225-471b-8e6e-c338ad781082 req-631d0b40-1fd1-49ec-8ddf-c840dae29626 service nova] Creating event network-vif-deleted:1eb2993e-ab60-4149-954a-75f33e83e3e1 for instance b903ed91-8ea3-4c20-8565-b190d442e723 on n-h1-846463-3 Sep 23 04:44:46.953609 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-ae9dc6cc-8225-471b-8e6e-c338ad781082 req-631d0b40-1fd1-49ec-8ddf-c840dae29626 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111415 Sep 23 04:44:46.954875 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1610/3168] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:44:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:44:46.988372 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1095e560-3549-40d7-8731-862d860cb358 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:46.989185 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1095e560-3549-40d7-8731-862d860cb358 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 2c316737-b84f-4b49-a5ab-cc0196b15760] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:47.111870 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1095e560-3549-40d7-8731-862d860cb358 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:47.119886 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1095e560-3549-40d7-8731-862d860cb358 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/2c316737-b84f-4b49-a5ab-cc0196b15760" status: 200 len: 1208 microversion: 2.1 time: 0.161381 Sep 23 04:44:47.120483 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1611/3169] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:46 2022] GET /compute/v2.1/servers/2c316737-b84f-4b49-a5ab-cc0196b15760 => generated 1208 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:47.467431 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a38ab3bd-aa46-4351-9430-319a12073cb1 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-633733857", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "f7c3489b-0a72-4837-812a-886bdac58946"}]}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:44:47.580920 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.neutron [None req-a38ab3bd-aa46-4351-9430-319a12073cb1 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] validate_networks() for [('f7c3489b-0a72-4837-812a-886bdac58946', None, None, None, None, None)] {{(pid=122699) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:44:49.026516 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-a38ab3bd-aa46-4351-9430-319a12073cb1 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Flavor limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:44:49.027592 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-a38ab3bd-aa46-4351-9430-319a12073cb1 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Image limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:44:49.028255 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-a38ab3bd-aa46-4351-9430-319a12073cb1 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Flavor pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:44:49.028993 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-a38ab3bd-aa46-4351-9430-319a12073cb1 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Image pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:44:49.029749 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-a38ab3bd-aa46-4351-9430-319a12073cb1 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:44:49.054869 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a38ab3bd-aa46-4351-9430-319a12073cb1 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:49.055633 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a38ab3bd-aa46-4351-9430-319a12073cb1 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:49.056271 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a38ab3bd-aa46-4351-9430-319a12073cb1 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:49.057200 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a38ab3bd-aa46-4351-9430-319a12073cb1 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:49.057830 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a38ab3bd-aa46-4351-9430-319a12073cb1 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:49.059631 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a38ab3bd-aa46-4351-9430-319a12073cb1 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:49.126609 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-a38ab3bd-aa46-4351-9430-319a12073cb1 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Getting quotas for project c9f623171eb84310b4297ad6ba269c54. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:44:49.142587 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-a38ab3bd-aa46-4351-9430-319a12073cb1 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Getting quotas for user f455e9897223404cac3033250226fbc0 and project c9f623171eb84310b4297ad6ba269c54. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:44:49.174438 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a38ab3bd-aa46-4351-9430-319a12073cb1 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Going to run 1 instances... {{(pid=122699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:44:49.177108 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a38ab3bd-aa46-4351-9430-319a12073cb1 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] [instance: 147e9a2b-507b-4ecf-ae6a-de2f30903108] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:44:49.349663 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a38ab3bd-aa46-4351-9430-319a12073cb1 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.227915 Sep 23 04:44:49.350554 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1612/3170] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:44:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 2230 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:44:49.368423 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-095772d1-7815-46c3-9ede-e584aded157c tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:49.371465 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-095772d1-7815-46c3-9ede-e584aded157c tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] [instance: 188a699b-0a1a-46b4-9a03-788af481d3ca] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:49.387290 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-095772d1-7815-46c3-9ede-e584aded157c tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:49.388060 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-095772d1-7815-46c3-9ede-e584aded157c tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:49.388512 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-095772d1-7815-46c3-9ede-e584aded157c tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:49.389228 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-095772d1-7815-46c3-9ede-e584aded157c tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:49.400856 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-095772d1-7815-46c3-9ede-e584aded157c tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:49.401331 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-095772d1-7815-46c3-9ede-e584aded157c tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:50.044559 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-095772d1-7815-46c3-9ede-e584aded157c tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11980041918484990dac709544d0b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c43f2b70bc74a48b62fb4115337f073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:50.056358 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-095772d1-7815-46c3-9ede-e584aded157c tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/servers/188a699b-0a1a-46b4-9a03-788af481d3ca" status: 200 len: 1308 microversion: 2.1 time: 0.701777 Sep 23 04:44:50.056358 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1613/3171] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:49 2022] GET /compute/v2.1/servers/188a699b-0a1a-46b4-9a03-788af481d3ca => generated 1308 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:50.073542 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-89e39a2f-2d9c-4e74-8790-388911c7e870 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:50.074472 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-89e39a2f-2d9c-4e74-8790-388911c7e870 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] [instance: b903ed91-8ea3-4c20-8565-b190d442e723] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:50.081004 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-89e39a2f-2d9c-4e74-8790-388911c7e870 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:50.083006 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-89e39a2f-2d9c-4e74-8790-388911c7e870 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:50.096933 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-89e39a2f-2d9c-4e74-8790-388911c7e870 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:50.098114 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-89e39a2f-2d9c-4e74-8790-388911c7e870 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:50.098768 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-89e39a2f-2d9c-4e74-8790-388911c7e870 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:50.099423 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-89e39a2f-2d9c-4e74-8790-388911c7e870 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:50.151215 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-89e39a2f-2d9c-4e74-8790-388911c7e870 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] HTTP exception thrown: Instance b903ed91-8ea3-4c20-8565-b190d442e723 could not be found. Sep 23 04:44:50.153180 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-89e39a2f-2d9c-4e74-8790-388911c7e870 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Request method failure captured: Sep 23 04:44:50.153180 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/b903ed91-8ea3-4c20-8565-b190d442e723 HTTP/1.1 Sep 23 04:44:50.153180 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:44:50.153180 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:44:50.153180 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:44:50.153180 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:44:50.153180 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:44:50.153180 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:44:50.153180 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:44:50.153180 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:44:50.153180 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTkhK7XbSajkVnbnDopFxjpLIBnuwakk2XlYaNVXx11wZ-7RHBdKfy_R-irPmIWx4p-TOGU0SRkH38-v_0C-71DSshVuUFFquz9Da2Nt2oKsLVzd0TKk2z6yh3BxmzNJif31ADoWsl8aT5_B-Jyj8-1sDFBTIe5f4MNqUghX_vs5Fr0 Sep 23 04:44:50.153180 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:44:50.153180 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:44:50.153180 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:44:50.153180 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:44:50.153180 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:44:50.153180 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:44:50.153180 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 2f0b7307c30a4c118da4c501691e349f Sep 23 04:44:50.153180 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-VolumesAdminNegativeTest-1731673499 Sep 23 04:44:50.153180 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:44:50.153180 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:44:50.153180 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2f0b7307c30a4c118da4c501691e349f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2f0b7307c30a4c118da4c501691e349f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2f0b7307c30a4c118da4c501691e349f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2f0b7307c30a4c118da4c501691e349f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:44:50.153180 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-VolumesAdminNegativeTest-1731673499 Sep 23 04:44:50.153180 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 2f0b7307c30a4c118da4c501691e349f Sep 23 04:44:50.153180 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1731673499 Sep 23 04:44:50.153180 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-VolumesAdminNegativeTest-1731673499-project Sep 23 04:44:50.153180 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:44:50.153180 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:44:50.153180 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 5e235519204b4efc8b6c7e2988fab9b8 Sep 23 04:44:50.153180 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-VolumesAdminNegativeTest-1731673499-project Sep 23 04:44:50.153180 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:44:50.153180 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance b903ed91-8ea3-4c20-8565-b190d442e723 could not be found. Sep 23 04:44:50.153180 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': 'b903ed91-8ea3-4c20-8565-b190d442e723'} Sep 23 04:44:50.153180 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:44:50.153180 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:44:50.153180 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:44:50.153180 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:44:50.153180 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:44:50.153180 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:44:50.153180 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:44:50.153180 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:44:50.153180 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:44:50.153180 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:44:50.153180 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b903ed91-8ea3-4c20-8565-b190d442e723 could not be found. Sep 23 04:44:50.153180 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:44:50.153180 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:44:50.153180 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:44:50.153180 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:44:50.153180 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:44:50.153180 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:44:50.153180 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:44:50.153180 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:44:50.153180 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:44:50.153180 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:44:50.153180 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:44:50.153180 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:44:50.153180 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:44:50.153180 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:44:50.153180 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:44:50.153180 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:44:50.153180 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b903ed91-8ea3-4c20-8565-b190d442e723 could not be found. Sep 23 04:44:50.153180 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:44:50.153180 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:44:50.153180 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:44:50.160492 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:44:50.160492 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:44:50.160492 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:44:50.160492 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:44:50.160492 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:44:50.160492 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b903ed91-8ea3-4c20-8565-b190d442e723 could not be found. Sep 23 04:44:50.160492 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:44:50.160492 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-89e39a2f-2d9c-4e74-8790-388911c7e870 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Returning 404 to user: Instance b903ed91-8ea3-4c20-8565-b190d442e723 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:44:50.162261 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-89e39a2f-2d9c-4e74-8790-388911c7e870 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] 10.222.0.33 "GET /compute/v2.1/servers/b903ed91-8ea3-4c20-8565-b190d442e723" status: 404 len: 111 microversion: 2.1 time: 0.096898 Sep 23 04:44:50.163357 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1614/3172] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:50 2022] GET /compute/v2.1/servers/b903ed91-8ea3-4c20-8565-b190d442e723 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:44:50.178730 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c30065b4-7ba6-4680-a860-5e05def73b51 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:50.190941 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c30065b4-7ba6-4680-a860-5e05def73b51 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 2c316737-b84f-4b49-a5ab-cc0196b15760] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:50.207513 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c30065b4-7ba6-4680-a860-5e05def73b51 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:50.208554 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c30065b4-7ba6-4680-a860-5e05def73b51 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:50.212780 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c30065b4-7ba6-4680-a860-5e05def73b51 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:50.213641 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c30065b4-7ba6-4680-a860-5e05def73b51 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:50.214441 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c30065b4-7ba6-4680-a860-5e05def73b51 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:50.216124 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c30065b4-7ba6-4680-a860-5e05def73b51 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:50.695579 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c30065b4-7ba6-4680-a860-5e05def73b51 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:50.720667 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c30065b4-7ba6-4680-a860-5e05def73b51 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/2c316737-b84f-4b49-a5ab-cc0196b15760" status: 200 len: 1266 microversion: 2.1 time: 0.546674 Sep 23 04:44:50.720667 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1615/3173] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:50 2022] GET /compute/v2.1/servers/2c316737-b84f-4b49-a5ab-cc0196b15760 => generated 1266 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:50.729588 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d54fa8d5-7329-46ef-85cf-7447032e3273 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:50.732451 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d54fa8d5-7329-46ef-85cf-7447032e3273 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] [instance: 147e9a2b-507b-4ecf-ae6a-de2f30903108] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:50.943799 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d54fa8d5-7329-46ef-85cf-7447032e3273 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f455e9897223404cac3033250226fbc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f623171eb84310b4297ad6ba269c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:50.952628 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d54fa8d5-7329-46ef-85cf-7447032e3273 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] 10.222.0.33 "GET /compute/v2.1/servers/147e9a2b-507b-4ecf-ae6a-de2f30903108" status: 200 len: 1223 microversion: 2.1 time: 0.238632 Sep 23 04:44:50.956496 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1616/3174] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:50 2022] GET /compute/v2.1/servers/147e9a2b-507b-4ecf-ae6a-de2f30903108 => generated 1223 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:51.076911 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d6b53e1f-4a60-403a-bcdf-00b2358088d5 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:51.078221 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d6b53e1f-4a60-403a-bcdf-00b2358088d5 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] [instance: 188a699b-0a1a-46b4-9a03-788af481d3ca] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:51.080932 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1,nova_api:INSERT=9,nova_api:DELETE=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:44:51.091455 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d6b53e1f-4a60-403a-bcdf-00b2358088d5 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:51.092354 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d6b53e1f-4a60-403a-bcdf-00b2358088d5 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:51.093644 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d6b53e1f-4a60-403a-bcdf-00b2358088d5 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:51.097756 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d6b53e1f-4a60-403a-bcdf-00b2358088d5 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:51.098622 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d6b53e1f-4a60-403a-bcdf-00b2358088d5 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:51.099266 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d6b53e1f-4a60-403a-bcdf-00b2358088d5 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:51.295737 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-da3935d1-3a99-461e-9102-0de9f7402561 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] 10.222.0.33 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 6.803826 Sep 23 04:44:51.297222 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1559/3175] 10.222.0.33 () {60 vars in 1170 bytes} [Fri Sep 23 04:44:44 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 6807 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:44:51.315932 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-adcd8c44-d9da-4e2e-8cc1-2f0edd587e30 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.3.65"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:44:51.338998 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-adcd8c44-d9da-4e2e-8cc1-2f0edd587e30 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] [instance: 15e9bc0f-2262-4e2c-9cac-0eca4575943c] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:51.347066 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-adcd8c44-d9da-4e2e-8cc1-2f0edd587e30 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:51.347669 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-adcd8c44-d9da-4e2e-8cc1-2f0edd587e30 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:51.348384 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-adcd8c44-d9da-4e2e-8cc1-2f0edd587e30 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:51.349342 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-adcd8c44-d9da-4e2e-8cc1-2f0edd587e30 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:51.350224 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-adcd8c44-d9da-4e2e-8cc1-2f0edd587e30 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:51.351065 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-adcd8c44-d9da-4e2e-8cc1-2f0edd587e30 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:51.357102 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=83,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:44:51.390863 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-adcd8c44-d9da-4e2e-8cc1-2f0edd587e30 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Acquiring lock "refresh_cache-15e9bc0f-2262-4e2c-9cac-0eca4575943c" {{(pid=122698) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 23 04:44:51.391878 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-adcd8c44-d9da-4e2e-8cc1-2f0edd587e30 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Acquired lock "refresh_cache-15e9bc0f-2262-4e2c-9cac-0eca4575943c" {{(pid=122698) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 23 04:44:52.235190 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d6b53e1f-4a60-403a-bcdf-00b2358088d5 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11980041918484990dac709544d0b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c43f2b70bc74a48b62fb4115337f073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:52.245027 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d6b53e1f-4a60-403a-bcdf-00b2358088d5 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/servers/188a699b-0a1a-46b4-9a03-788af481d3ca" status: 200 len: 1308 microversion: 2.1 time: 1.172050 Sep 23 04:44:52.259091 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1617/3176] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:51 2022] GET /compute/v2.1/servers/188a699b-0a1a-46b4-9a03-788af481d3ca => generated 1308 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:52.281665 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-db5357db-5153-47c5-9da3-c6edab0df762 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:52.296207 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-db5357db-5153-47c5-9da3-c6edab0df762 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 2c316737-b84f-4b49-a5ab-cc0196b15760] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:52.318072 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-db5357db-5153-47c5-9da3-c6edab0df762 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:52.318072 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-db5357db-5153-47c5-9da3-c6edab0df762 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:52.318072 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-db5357db-5153-47c5-9da3-c6edab0df762 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:52.318072 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-db5357db-5153-47c5-9da3-c6edab0df762 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:52.318072 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-db5357db-5153-47c5-9da3-c6edab0df762 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:52.318072 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-db5357db-5153-47c5-9da3-c6edab0df762 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:52.760420 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-db5357db-5153-47c5-9da3-c6edab0df762 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:52.790704 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-db5357db-5153-47c5-9da3-c6edab0df762 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/2c316737-b84f-4b49-a5ab-cc0196b15760" status: 200 len: 1266 microversion: 2.1 time: 0.502415 Sep 23 04:44:52.793742 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1618/3177] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:52 2022] GET /compute/v2.1/servers/2c316737-b84f-4b49-a5ab-cc0196b15760 => generated 1266 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:52.826392 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-288b71f5-6771-476f-801c-1c686f8a1ef9 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:52.827000 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-288b71f5-6771-476f-801c-1c686f8a1ef9 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] [instance: 147e9a2b-507b-4ecf-ae6a-de2f30903108] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:52.871511 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-288b71f5-6771-476f-801c-1c686f8a1ef9 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:52.872050 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-288b71f5-6771-476f-801c-1c686f8a1ef9 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:52.873858 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-288b71f5-6771-476f-801c-1c686f8a1ef9 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:52.876615 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-288b71f5-6771-476f-801c-1c686f8a1ef9 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:52.877103 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-288b71f5-6771-476f-801c-1c686f8a1ef9 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:52.877540 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-288b71f5-6771-476f-801c-1c686f8a1ef9 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:53.014764 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-288b71f5-6771-476f-801c-1c686f8a1ef9 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f455e9897223404cac3033250226fbc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f623171eb84310b4297ad6ba269c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:53.079401 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-288b71f5-6771-476f-801c-1c686f8a1ef9 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] 10.222.0.33 "GET /compute/v2.1/servers/147e9a2b-507b-4ecf-ae6a-de2f30903108" status: 200 len: 1275 microversion: 2.1 time: 0.267843 Sep 23 04:44:53.083946 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1619/3178] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:52 2022] GET /compute/v2.1/servers/147e9a2b-507b-4ecf-ae6a-de2f30903108 => generated 1275 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:53.217459 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-9757a2f9-8549-4e4e-a1ac-03938b698eee req-262d6718-9316-4195-af16-cbca9981db47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "188a699b-0a1a-46b4-9a03-788af481d3ca", "tag": "f0ab08a0-19b4-4e1e-b09d-bc591c3179dd"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:44:53.244454 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-9757a2f9-8549-4e4e-a1ac-03938b698eee req-262d6718-9316-4195-af16-cbca9981db47 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:53.250766 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-9757a2f9-8549-4e4e-a1ac-03938b698eee req-262d6718-9316-4195-af16-cbca9981db47 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:53.251618 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-9757a2f9-8549-4e4e-a1ac-03938b698eee req-262d6718-9316-4195-af16-cbca9981db47 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:53.281155 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-9757a2f9-8549-4e4e-a1ac-03938b698eee req-262d6718-9316-4195-af16-cbca9981db47 service nova] Creating event network-changed:f0ab08a0-19b4-4e1e-b09d-bc591c3179dd for instance 188a699b-0a1a-46b4-9a03-788af481d3ca on n-h2-846463-3 Sep 23 04:44:53.292018 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-9757a2f9-8549-4e4e-a1ac-03938b698eee req-262d6718-9316-4195-af16-cbca9981db47 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081182 Sep 23 04:44:53.293109 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1620/3179] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:44:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:44:53.303029 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-457cde91-f60e-4d46-8d64-838b4d17fd4b tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:53.304610 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-457cde91-f60e-4d46-8d64-838b4d17fd4b tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] [instance: 188a699b-0a1a-46b4-9a03-788af481d3ca] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:53.315516 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-457cde91-f60e-4d46-8d64-838b4d17fd4b tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:53.316334 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-457cde91-f60e-4d46-8d64-838b4d17fd4b tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:53.317675 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-457cde91-f60e-4d46-8d64-838b4d17fd4b tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:53.324540 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-457cde91-f60e-4d46-8d64-838b4d17fd4b tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:53.324932 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-457cde91-f60e-4d46-8d64-838b4d17fd4b tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:53.329644 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-457cde91-f60e-4d46-8d64-838b4d17fd4b tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:54.148000 n-d-846463-3 devstack@n-api.service[122698]: DEBUG neutronclient.v2_0.client [None req-adcd8c44-d9da-4e2e-8cc1-2f0edd587e30 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.3.65 (ee768c4c-24d0-4694-98ad-194e9aa46569) with port c81ebfeb-05fd-445f-bb49-70dc27b6c143 using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network 343ef4fa-fca9-4453-b062-2fa3eb6972c1.", "detail": ""}} {{(pid=122698) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 23 04:44:54.148598 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-adcd8c44-d9da-4e2e-8cc1-2f0edd587e30 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Releasing lock "refresh_cache-15e9bc0f-2262-4e2c-9cac-0eca4575943c" {{(pid=122698) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 23 04:44:54.149157 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-adcd8c44-d9da-4e2e-8cc1-2f0edd587e30 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] HTTP exception thrown: Cannot associate floating IP 172.25.3.65 (ee768c4c-24d0-4694-98ad-194e9aa46569) with port c81ebfeb-05fd-445f-bb49-70dc27b6c143 using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network 343ef4fa-fca9-4453-b062-2fa3eb6972c1. Sep 23 04:44:54.149157 n-d-846463-3 devstack@n-api.service[122698]: Neutron server returns request_ids: ['req-10c836bb-83ca-48e8-b3d0-a39a7321dda7'] Sep 23 04:44:54.153273 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-adcd8c44-d9da-4e2e-8cc1-2f0edd587e30 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Request method failure captured: Sep 23 04:44:54.153273 n-d-846463-3 devstack@n-api.service[122698]: request: POST /compute/v2.1/servers/15e9bc0f-2262-4e2c-9cac-0eca4575943c/action HTTP/1.1 Sep 23 04:44:54.153273 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:44:54.153273 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:44:54.153273 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:44:54.153273 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 45 Sep 23 04:44:54.153273 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:44:54.153273 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:44:54.153273 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:44:54.153273 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:44:54.153273 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTmPnd6xyvib_sf8QDaEntL9VdzDsB1XlvYVv_byssSC9y0FuDAryctCXBXrVZCD9PbDQ3dSKjCyQRUJ_pn0mcUTQtUcsqOBu7SzpbudMSWwG5qnWC39KpYvZ5kKS2OfyNAGthEfbeZlhBjN-4zVQm7v8iE9-1JXPDGcINofG8kf_uc Sep 23 04:44:54.153273 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:44:54.153273 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:44:54.153273 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:44:54.153273 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:44:54.153273 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:44:54.153273 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:44:54.153273 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: d22fd8f3b0334cb3b1af66cf626422fe Sep 23 04:44:54.153273 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 Sep 23 04:44:54.153273 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:44:54.153273 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:44:54.153273 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d22fd8f3b0334cb3b1af66cf626422fe", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d22fd8f3b0334cb3b1af66cf626422fe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d22fd8f3b0334cb3b1af66cf626422fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d22fd8f3b0334cb3b1af66cf626422fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:44:54.153273 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 Sep 23 04:44:54.153273 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: d22fd8f3b0334cb3b1af66cf626422fe Sep 23 04:44:54.153273 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 Sep 23 04:44:54.153273 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project Sep 23 04:44:54.153273 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:44:54.153273 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:44:54.153273 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: d0c53d79930a4eaf9fcf7cd10707fbf3 Sep 23 04:44:54.153273 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project Sep 23 04:44:54.153273 n-d-846463-3 devstack@n-api.service[122698]: Sep 23 04:44:54.153273 n-d-846463-3 devstack@n-api.service[122698]: {"addFloatingIp": {"address": "172.25.3.65"}} Sep 23 04:44:54.153273 n-d-846463-3 devstack@n-api.service[122698]: method: Sep 23 04:44:54.153273 n-d-846463-3 devstack@n-api.service[122698]: exception: Cannot associate floating IP 172.25.3.65 (ee768c4c-24d0-4694-98ad-194e9aa46569) with port c81ebfeb-05fd-445f-bb49-70dc27b6c143 using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network 343ef4fa-fca9-4453-b062-2fa3eb6972c1. Sep 23 04:44:54.153273 n-d-846463-3 devstack@n-api.service[122698]: Neutron server returns request_ids: ['req-10c836bb-83ca-48e8-b3d0-a39a7321dda7'] Sep 23 04:44:54.153273 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '15e9bc0f-2262-4e2c-9cac-0eca4575943c', 'body': {'addFloatingIp': {'address': '172.25.3.65'}}} Sep 23 04:44:54.153273 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:44:54.153273 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:44:54.153273 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2703, in associate_floating_ip Sep 23 04:44:54.153273 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Sep 23 04:44:54.153273 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:44:54.153273 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:44:54.153273 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1016, in update_floatingip Sep 23 04:44:54.153273 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Sep 23 04:44:54.153273 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:44:54.153273 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:44:54.153273 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2548, in _update_resource Sep 23 04:44:54.153273 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Sep 23 04:44:54.153273 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:44:54.153273 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:44:54.153273 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Sep 23 04:44:54.153273 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Sep 23 04:44:54.153273 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:44:54.153273 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:44:54.153273 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 23 04:44:54.153273 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 23 04:44:54.153273 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:44:54.153273 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:44:54.153273 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 23 04:44:54.153273 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 23 04:44:54.160062 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:44:54.160062 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:44:54.160062 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 23 04:44:54.160062 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 23 04:44:54.160062 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 23 04:44:54.160062 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 23 04:44:54.160062 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.3.65 (ee768c4c-24d0-4694-98ad-194e9aa46569) with port c81ebfeb-05fd-445f-bb49-70dc27b6c143 using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network 343ef4fa-fca9-4453-b062-2fa3eb6972c1. Sep 23 04:44:54.160062 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-10c836bb-83ca-48e8-b3d0-a39a7321dda7'] Sep 23 04:44:54.160062 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:44:54.160062 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:44:54.160062 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:44:54.160062 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:44:54.160062 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Sep 23 04:44:54.160062 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Sep 23 04:44:54.160062 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Sep 23 04:44:54.160062 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Sep 23 04:44:54.160062 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2705, in associate_floating_ip Sep 23 04:44:54.160062 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Sep 23 04:44:54.160062 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.3.65 (ee768c4c-24d0-4694-98ad-194e9aa46569) with port c81ebfeb-05fd-445f-bb49-70dc27b6c143 using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network 343ef4fa-fca9-4453-b062-2fa3eb6972c1. Sep 23 04:44:54.160062 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-10c836bb-83ca-48e8-b3d0-a39a7321dda7'] Sep 23 04:44:54.160062 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:44:54.160062 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:44:54.160062 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:44:54.160062 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:44:54.160062 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:44:54.160062 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:44:54.160062 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:44:54.160062 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:44:54.160062 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:44:54.160062 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:44:54.160062 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:44:54.160062 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:44:54.160062 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:44:54.160062 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:44:54.160062 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Sep 23 04:44:54.160062 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Sep 23 04:44:54.160062 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.3.65 (ee768c4c-24d0-4694-98ad-194e9aa46569) with port c81ebfeb-05fd-445f-bb49-70dc27b6c143 using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network 343ef4fa-fca9-4453-b062-2fa3eb6972c1. Sep 23 04:44:54.160062 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-10c836bb-83ca-48e8-b3d0-a39a7321dda7'] Sep 23 04:44:54.160062 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:44:54.160062 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:44:54.160062 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:44:54.160062 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:44:54.160062 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:44:54.160062 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:44:54.160062 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:44:54.160062 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:44:54.160062 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.3.65 (ee768c4c-24d0-4694-98ad-194e9aa46569) with port c81ebfeb-05fd-445f-bb49-70dc27b6c143 using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network 343ef4fa-fca9-4453-b062-2fa3eb6972c1. Sep 23 04:44:54.160062 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-10c836bb-83ca-48e8-b3d0-a39a7321dda7'] Sep 23 04:44:54.160062 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:44:54.167112 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-adcd8c44-d9da-4e2e-8cc1-2f0edd587e30 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Returning 400 to user: Cannot associate floating IP 172.25.3.65 (ee768c4c-24d0-4694-98ad-194e9aa46569) with port c81ebfeb-05fd-445f-bb49-70dc27b6c143 using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network 343ef4fa-fca9-4453-b062-2fa3eb6972c1. Sep 23 04:44:54.167112 n-d-846463-3 devstack@n-api.service[122698]: Neutron server returns request_ids: ['req-10c836bb-83ca-48e8-b3d0-a39a7321dda7'] {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:44:54.172094 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-adcd8c44-d9da-4e2e-8cc1-2f0edd587e30 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] 10.222.0.33 "POST /compute/v2.1/servers/15e9bc0f-2262-4e2c-9cac-0eca4575943c/action" status: 400 len: 380 microversion: 2.1 time: 2.860713 Sep 23 04:44:54.173054 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1560/3180] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:44:51 2022] POST /compute/v2.1/servers/15e9bc0f-2262-4e2c-9cac-0eca4575943c/action => generated 380 bytes in 2867 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 23 04:44:54.185683 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d101b88c-639d-4905-89e6-bd608d048a91 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:54.201323 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d101b88c-639d-4905-89e6-bd608d048a91 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 2c316737-b84f-4b49-a5ab-cc0196b15760] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:54.235220 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d101b88c-639d-4905-89e6-bd608d048a91 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:54.236343 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d101b88c-639d-4905-89e6-bd608d048a91 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:54.236825 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d101b88c-639d-4905-89e6-bd608d048a91 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:54.237569 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d101b88c-639d-4905-89e6-bd608d048a91 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:54.238079 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d101b88c-639d-4905-89e6-bd608d048a91 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:54.238508 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d101b88c-639d-4905-89e6-bd608d048a91 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:54.447094 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d101b88c-639d-4905-89e6-bd608d048a91 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:54.461429 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d101b88c-639d-4905-89e6-bd608d048a91 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/2c316737-b84f-4b49-a5ab-cc0196b15760" status: 200 len: 1266 microversion: 2.1 time: 0.285547 Sep 23 04:44:54.462527 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1561/3181] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:54 2022] GET /compute/v2.1/servers/2c316737-b84f-4b49-a5ab-cc0196b15760 => generated 1266 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:54.497785 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b319fa85-fb43-438a-8a63-0b95d3f98946 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:54.502203 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b319fa85-fb43-438a-8a63-0b95d3f98946 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] [instance: 147e9a2b-507b-4ecf-ae6a-de2f30903108] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:54.510118 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-457cde91-f60e-4d46-8d64-838b4d17fd4b tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11980041918484990dac709544d0b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c43f2b70bc74a48b62fb4115337f073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:54.527775 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b319fa85-fb43-438a-8a63-0b95d3f98946 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:54.528633 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b319fa85-fb43-438a-8a63-0b95d3f98946 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:54.529405 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b319fa85-fb43-438a-8a63-0b95d3f98946 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:54.531167 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b319fa85-fb43-438a-8a63-0b95d3f98946 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:54.531676 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b319fa85-fb43-438a-8a63-0b95d3f98946 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:54.532154 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b319fa85-fb43-438a-8a63-0b95d3f98946 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:54.549122 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-457cde91-f60e-4d46-8d64-838b4d17fd4b tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/servers/188a699b-0a1a-46b4-9a03-788af481d3ca" status: 200 len: 1308 microversion: 2.1 time: 1.254240 Sep 23 04:44:54.575418 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1621/3182] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:53 2022] GET /compute/v2.1/servers/188a699b-0a1a-46b4-9a03-788af481d3ca => generated 1308 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:54.604360 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-20b38851-8a0f-416b-a835-24e4608886fe tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Calling method '.version_select at 0x7ff1c3f31550>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:54.893402 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b319fa85-fb43-438a-8a63-0b95d3f98946 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f455e9897223404cac3033250226fbc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f623171eb84310b4297ad6ba269c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:54.908676 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b319fa85-fb43-438a-8a63-0b95d3f98946 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] 10.222.0.33 "GET /compute/v2.1/servers/147e9a2b-507b-4ecf-ae6a-de2f30903108" status: 200 len: 1281 microversion: 2.1 time: 0.438742 Sep 23 04:44:54.912412 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1562/3183] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:54 2022] GET /compute/v2.1/servers/147e9a2b-507b-4ecf-ae6a-de2f30903108 => generated 1281 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:55.487122 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1cdcb9be-f080-43b4-8265-475dcc221762 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:55.487780 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-1cdcb9be-f080-43b4-8265-475dcc221762 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 2c316737-b84f-4b49-a5ab-cc0196b15760] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:55.499824 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1cdcb9be-f080-43b4-8265-475dcc221762 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:55.500341 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1cdcb9be-f080-43b4-8265-475dcc221762 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:55.500836 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1cdcb9be-f080-43b4-8265-475dcc221762 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:55.501571 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1cdcb9be-f080-43b4-8265-475dcc221762 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:55.502067 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1cdcb9be-f080-43b4-8265-475dcc221762 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:55.502505 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1cdcb9be-f080-43b4-8265-475dcc221762 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:56.149784 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-1cdcb9be-f080-43b4-8265-475dcc221762 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:56.172335 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-1cdcb9be-f080-43b4-8265-475dcc221762 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/2c316737-b84f-4b49-a5ab-cc0196b15760" status: 200 len: 1308 microversion: 2.1 time: 0.690566 Sep 23 04:44:56.172983 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1563/3184] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:55 2022] GET /compute/v2.1/servers/2c316737-b84f-4b49-a5ab-cc0196b15760 => generated 1308 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:44:56.194099 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4918c078-c081-4bf7-b64c-a5e36ed76d76 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:56.194984 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4918c078-c081-4bf7-b64c-a5e36ed76d76 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] [instance: 188a699b-0a1a-46b4-9a03-788af481d3ca] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:56.206025 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4918c078-c081-4bf7-b64c-a5e36ed76d76 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:56.206727 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4918c078-c081-4bf7-b64c-a5e36ed76d76 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:56.207358 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4918c078-c081-4bf7-b64c-a5e36ed76d76 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:56.208097 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4918c078-c081-4bf7-b64c-a5e36ed76d76 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:56.208568 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4918c078-c081-4bf7-b64c-a5e36ed76d76 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:56.209001 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4918c078-c081-4bf7-b64c-a5e36ed76d76 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:56.975777 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4918c078-c081-4bf7-b64c-a5e36ed76d76 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11980041918484990dac709544d0b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c43f2b70bc74a48b62fb4115337f073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:56.995045 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4918c078-c081-4bf7-b64c-a5e36ed76d76 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/servers/188a699b-0a1a-46b4-9a03-788af481d3ca" status: 200 len: 1308 microversion: 2.1 time: 0.818671 Sep 23 04:44:56.995045 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1564/3185] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:56 2022] GET /compute/v2.1/servers/188a699b-0a1a-46b4-9a03-788af481d3ca => generated 1308 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:56.999051 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-412f5d3a-e117-42e8-8d8e-ab21486e914d tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:57.006744 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-412f5d3a-e117-42e8-8d8e-ab21486e914d tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] [instance: 147e9a2b-507b-4ecf-ae6a-de2f30903108] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:57.018834 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-412f5d3a-e117-42e8-8d8e-ab21486e914d tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:57.019757 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-412f5d3a-e117-42e8-8d8e-ab21486e914d tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:57.020396 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-412f5d3a-e117-42e8-8d8e-ab21486e914d tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:57.021329 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-412f5d3a-e117-42e8-8d8e-ab21486e914d tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:57.021799 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-412f5d3a-e117-42e8-8d8e-ab21486e914d tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:57.022289 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-412f5d3a-e117-42e8-8d8e-ab21486e914d tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:57.880606 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-412f5d3a-e117-42e8-8d8e-ab21486e914d tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f455e9897223404cac3033250226fbc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f623171eb84310b4297ad6ba269c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:57.894505 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-412f5d3a-e117-42e8-8d8e-ab21486e914d tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] 10.222.0.33 "GET /compute/v2.1/servers/147e9a2b-507b-4ecf-ae6a-de2f30903108" status: 200 len: 1323 microversion: 2.1 time: 0.899424 Sep 23 04:44:57.895106 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1565/3186] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:56 2022] GET /compute/v2.1/servers/147e9a2b-507b-4ecf-ae6a-de2f30903108 => generated 1323 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:57.904568 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2f9365fa-fc7d-42ff-a018-6be2ab64750e tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:57.905982 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-2f9365fa-fc7d-42ff-a018-6be2ab64750e tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] [instance: 48df7db9-a805-4c72-a1a5-29632b00248c] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:57.919294 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2f9365fa-fc7d-42ff-a018-6be2ab64750e tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:57.921302 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2f9365fa-fc7d-42ff-a018-6be2ab64750e tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:57.930761 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2f9365fa-fc7d-42ff-a018-6be2ab64750e tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:57.931859 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2f9365fa-fc7d-42ff-a018-6be2ab64750e tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:57.932346 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2f9365fa-fc7d-42ff-a018-6be2ab64750e tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:57.932791 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2f9365fa-fc7d-42ff-a018-6be2ab64750e tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:57.963396 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-2f9365fa-fc7d-42ff-a018-6be2ab64750e tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] [instance: 48df7db9-a805-4c72-a1a5-29632b00248c] Going to try to terminate instance {{(pid=122698) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:44:58.050532 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-20b38851-8a0f-416b-a835-24e4608886fe tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] 10.222.0.33 "DELETE /compute/v2.1/os-floating-ips/ee768c4c-24d0-4694-98ad-194e9aa46569" status: 202 len: 0 microversion: 2.1 time: 3.451355 Sep 23 04:44:58.051165 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1622/3187] 10.222.0.33 () {58 vars in 1263 bytes} [Fri Sep 23 04:44:54 2022] DELETE /compute/v2.1/os-floating-ips/ee768c4c-24d0-4694-98ad-194e9aa46569 => generated 0 bytes in 3475 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:44:58.058901 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0967ed74-12c9-4773-83cd-6efe82ee1a06 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:58.059530 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-0967ed74-12c9-4773-83cd-6efe82ee1a06 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 2c316737-b84f-4b49-a5ab-cc0196b15760] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:58.081865 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0967ed74-12c9-4773-83cd-6efe82ee1a06 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:58.082421 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0967ed74-12c9-4773-83cd-6efe82ee1a06 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:58.082910 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0967ed74-12c9-4773-83cd-6efe82ee1a06 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:58.083816 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0967ed74-12c9-4773-83cd-6efe82ee1a06 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:58.084452 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0967ed74-12c9-4773-83cd-6efe82ee1a06 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:58.085053 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0967ed74-12c9-4773-83cd-6efe82ee1a06 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:58.349314 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2f9365fa-fc7d-42ff-a018-6be2ab64750e tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] 10.222.0.33 "DELETE /compute/v2.1/servers/48df7db9-a805-4c72-a1a5-29632b00248c" status: 204 len: 0 microversion: 2.1 time: 0.451038 Sep 23 04:44:58.350955 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1566/3188] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:44:57 2022] DELETE /compute/v2.1/servers/48df7db9-a805-4c72-a1a5-29632b00248c => generated 0 bytes in 455 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:44:58.623366 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d80ff411-01f4-4246-9b15-5f6933f020ff tempest-ServerGroup264TestJSON-881668288 tempest-ServerGroup264TestJSON-881668288-project] Action: 'create', calling method: .version_select at 0x7ff1c3ef0a60>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:44:58.645793 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-d80ff411-01f4-4246-9b15-5f6933f020ff tempest-ServerGroup264TestJSON-881668288 tempest-ServerGroup264TestJSON-881668288-project] Getting quotas for project b72fa96fc6c54dc48829de7688905c2d. Resources: {'server_groups'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:44:58.652234 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-d80ff411-01f4-4246-9b15-5f6933f020ff tempest-ServerGroup264TestJSON-881668288 tempest-ServerGroup264TestJSON-881668288-project] Getting quotas for user b71671360a624cea9073afe97c747ddf and project b72fa96fc6c54dc48829de7688905c2d. Resources: {'server_groups'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:44:58.814003 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-0967ed74-12c9-4773-83cd-6efe82ee1a06 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:58.819938 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0967ed74-12c9-4773-83cd-6efe82ee1a06 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/2c316737-b84f-4b49-a5ab-cc0196b15760" status: 200 len: 1308 microversion: 2.1 time: 0.767722 Sep 23 04:44:58.823946 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1623/3189] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:58 2022] GET /compute/v2.1/servers/2c316737-b84f-4b49-a5ab-cc0196b15760 => generated 1308 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:58.833478 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ff9d00c7-ee5b-4223-b707-3c4cb234e7cb tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:58.834082 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ff9d00c7-ee5b-4223-b707-3c4cb234e7cb tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] [instance: 188a699b-0a1a-46b4-9a03-788af481d3ca] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:58.843452 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ff9d00c7-ee5b-4223-b707-3c4cb234e7cb tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:58.843952 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ff9d00c7-ee5b-4223-b707-3c4cb234e7cb tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:58.844907 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ff9d00c7-ee5b-4223-b707-3c4cb234e7cb tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:58.855288 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ff9d00c7-ee5b-4223-b707-3c4cb234e7cb tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:58.855994 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ff9d00c7-ee5b-4223-b707-3c4cb234e7cb tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:58.856584 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ff9d00c7-ee5b-4223-b707-3c4cb234e7cb tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:58.885782 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-d80ff411-01f4-4246-9b15-5f6933f020ff tempest-ServerGroup264TestJSON-881668288 tempest-ServerGroup264TestJSON-881668288-project] Getting quotas for project b72fa96fc6c54dc48829de7688905c2d. Resources: {'server_groups'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:44:58.896153 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-d80ff411-01f4-4246-9b15-5f6933f020ff tempest-ServerGroup264TestJSON-881668288 tempest-ServerGroup264TestJSON-881668288-project] Getting quotas for user b71671360a624cea9073afe97c747ddf and project b72fa96fc6c54dc48829de7688905c2d. Resources: {'server_groups'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:44:58.950235 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d80ff411-01f4-4246-9b15-5f6933f020ff tempest-ServerGroup264TestJSON-881668288 tempest-ServerGroup264TestJSON-881668288-project] 10.222.0.33 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.596611 Sep 23 04:44:58.952285 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1567/3190] 10.222.0.33 () {62 vars in 1214 bytes} [Fri Sep 23 04:44:58 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 04:44:58.958659 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-cd16ab83-3b29-4908-b2e4-eda7fe44bdea tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.3.128"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:44:59.101148 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=6 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:44:59.279488 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ff9d00c7-ee5b-4223-b707-3c4cb234e7cb tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11980041918484990dac709544d0b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c43f2b70bc74a48b62fb4115337f073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:59.291619 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ff9d00c7-ee5b-4223-b707-3c4cb234e7cb tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/servers/188a699b-0a1a-46b4-9a03-788af481d3ca" status: 200 len: 1308 microversion: 2.1 time: 0.466581 Sep 23 04:44:59.293457 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1624/3191] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:58 2022] GET /compute/v2.1/servers/188a699b-0a1a-46b4-9a03-788af481d3ca => generated 1308 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:59.301126 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-829f4d6f-9b6c-40f1-8d54-697f0436be3f req-dc671934-98b7-40b4-a0fa-ec330fa6e4d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "147e9a2b-507b-4ecf-ae6a-de2f30903108", "tag": "6dd5961e-9308-4178-8e45-0b2b5b318393"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:44:59.334363 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-829f4d6f-9b6c-40f1-8d54-697f0436be3f req-dc671934-98b7-40b4-a0fa-ec330fa6e4d7 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:59.334790 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-829f4d6f-9b6c-40f1-8d54-697f0436be3f req-dc671934-98b7-40b4-a0fa-ec330fa6e4d7 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:59.335234 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-829f4d6f-9b6c-40f1-8d54-697f0436be3f req-dc671934-98b7-40b4-a0fa-ec330fa6e4d7 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:59.336619 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-cd16ab83-3b29-4908-b2e4-eda7fe44bdea tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] [instance: 15e9bc0f-2262-4e2c-9cac-0eca4575943c] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:59.343057 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cd16ab83-3b29-4908-b2e4-eda7fe44bdea tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:59.343786 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cd16ab83-3b29-4908-b2e4-eda7fe44bdea tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:59.345007 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cd16ab83-3b29-4908-b2e4-eda7fe44bdea tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:59.346648 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cd16ab83-3b29-4908-b2e4-eda7fe44bdea tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:59.348474 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cd16ab83-3b29-4908-b2e4-eda7fe44bdea tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:59.349071 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cd16ab83-3b29-4908-b2e4-eda7fe44bdea tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:59.349337 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-829f4d6f-9b6c-40f1-8d54-697f0436be3f req-dc671934-98b7-40b4-a0fa-ec330fa6e4d7 service nova] Creating event network-changed:6dd5961e-9308-4178-8e45-0b2b5b318393 for instance 147e9a2b-507b-4ecf-ae6a-de2f30903108 on n-h1-846463-3 Sep 23 04:44:59.355594 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-829f4d6f-9b6c-40f1-8d54-697f0436be3f req-dc671934-98b7-40b4-a0fa-ec330fa6e4d7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060582 Sep 23 04:44:59.356851 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1625/3192] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:44:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:44:59.363452 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c8a80bca-124e-4b25-a642-18209d4ff102 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:59.364385 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c8a80bca-124e-4b25-a642-18209d4ff102 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] [instance: 48df7db9-a805-4c72-a1a5-29632b00248c] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:59.372508 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c8a80bca-124e-4b25-a642-18209d4ff102 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:59.373263 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c8a80bca-124e-4b25-a642-18209d4ff102 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:59.379503 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c8a80bca-124e-4b25-a642-18209d4ff102 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:59.379503 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c8a80bca-124e-4b25-a642-18209d4ff102 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:59.379503 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c8a80bca-124e-4b25-a642-18209d4ff102 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:59.379503 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c8a80bca-124e-4b25-a642-18209d4ff102 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:59.738691 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c8a80bca-124e-4b25-a642-18209d4ff102 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e235519204b4efc8b6c7e2988fab9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0b7307c30a4c118da4c501691e349f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:44:59.750897 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c8a80bca-124e-4b25-a642-18209d4ff102 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] 10.222.0.33 "GET /compute/v2.1/servers/48df7db9-a805-4c72-a1a5-29632b00248c" status: 200 len: 1681 microversion: 2.1 time: 0.392646 Sep 23 04:44:59.754769 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1626/3193] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:59 2022] GET /compute/v2.1/servers/48df7db9-a805-4c72-a1a5-29632b00248c => generated 1681 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:44:59.755167 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cd16ab83-3b29-4908-b2e4-eda7fe44bdea tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Acquiring lock "refresh_cache-15e9bc0f-2262-4e2c-9cac-0eca4575943c" {{(pid=122698) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 23 04:44:59.755675 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cd16ab83-3b29-4908-b2e4-eda7fe44bdea tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Acquired lock "refresh_cache-15e9bc0f-2262-4e2c-9cac-0eca4575943c" {{(pid=122698) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 23 04:44:59.760810 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4a5ff74f-b120-4d79-880c-3f29f7639895 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:44:59.762105 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4a5ff74f-b120-4d79-880c-3f29f7639895 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] [instance: 147e9a2b-507b-4ecf-ae6a-de2f30903108] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:44:59.773354 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4a5ff74f-b120-4d79-880c-3f29f7639895 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:59.774166 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4a5ff74f-b120-4d79-880c-3f29f7639895 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:59.774786 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4a5ff74f-b120-4d79-880c-3f29f7639895 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:44:59.775691 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4a5ff74f-b120-4d79-880c-3f29f7639895 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:44:59.776322 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4a5ff74f-b120-4d79-880c-3f29f7639895 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:44:59.777218 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4a5ff74f-b120-4d79-880c-3f29f7639895 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:00.095704 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-4a5ff74f-b120-4d79-880c-3f29f7639895 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f455e9897223404cac3033250226fbc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f623171eb84310b4297ad6ba269c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:00.105452 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4a5ff74f-b120-4d79-880c-3f29f7639895 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] 10.222.0.33 "GET /compute/v2.1/servers/147e9a2b-507b-4ecf-ae6a-de2f30903108" status: 200 len: 1323 microversion: 2.1 time: 0.348665 Sep 23 04:45:00.107235 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1627/3194] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:44:59 2022] GET /compute/v2.1/servers/147e9a2b-507b-4ecf-ae6a-de2f30903108 => generated 1323 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:45:00.112649 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7311015c-cf73-487b-a6f3-cbc6d11e4605 tempest-ServerGroup264TestJSON-881668288 tempest-ServerGroup264TestJSON-881668288-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:00.149007 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-7311015c-cf73-487b-a6f3-cbc6d11e4605 tempest-ServerGroup264TestJSON-881668288 tempest-ServerGroup264TestJSON-881668288-project] 10.222.0.33 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.039455 Sep 23 04:45:00.151028 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1628/3195] 10.222.0.33 () {60 vars in 1193 bytes} [Fri Sep 23 04:45:00 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 04:45:00.160992 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-b649e17b-2508-48a6-b771-ba85307732d8 req-b89b717f-9f91-4588-b5b1-476685c06c6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c316737-b84f-4b49-a5ab-cc0196b15760", "tag": "fc3e1dd8-4c97-4525-a268-cb6993ddf935"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:45:00.183227 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-b649e17b-2508-48a6-b771-ba85307732d8 req-b89b717f-9f91-4588-b5b1-476685c06c6b service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:00.183996 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-b649e17b-2508-48a6-b771-ba85307732d8 req-b89b717f-9f91-4588-b5b1-476685c06c6b service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:00.185079 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-b649e17b-2508-48a6-b771-ba85307732d8 req-b89b717f-9f91-4588-b5b1-476685c06c6b service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:00.201311 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-b649e17b-2508-48a6-b771-ba85307732d8 req-b89b717f-9f91-4588-b5b1-476685c06c6b service nova] Creating event network-changed:fc3e1dd8-4c97-4525-a268-cb6993ddf935 for instance 2c316737-b84f-4b49-a5ab-cc0196b15760 on n-h1-846463-3 Sep 23 04:45:00.212854 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-b649e17b-2508-48a6-b771-ba85307732d8 req-b89b717f-9f91-4588-b5b1-476685c06c6b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060234 Sep 23 04:45:00.214183 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1629/3196] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:45:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:45:00.221932 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1ef251be-3033-4920-9573-c15fe45ca3dd tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:00.223900 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1ef251be-3033-4920-9573-c15fe45ca3dd tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 2c316737-b84f-4b49-a5ab-cc0196b15760] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:00.239548 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1ef251be-3033-4920-9573-c15fe45ca3dd tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:00.241078 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1ef251be-3033-4920-9573-c15fe45ca3dd tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:00.242955 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1ef251be-3033-4920-9573-c15fe45ca3dd tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:00.244651 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1ef251be-3033-4920-9573-c15fe45ca3dd tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:00.245368 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1ef251be-3033-4920-9573-c15fe45ca3dd tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:00.246158 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1ef251be-3033-4920-9573-c15fe45ca3dd tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:00.612450 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1ef251be-3033-4920-9573-c15fe45ca3dd tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:00.633219 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1ef251be-3033-4920-9573-c15fe45ca3dd tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/2c316737-b84f-4b49-a5ab-cc0196b15760" status: 200 len: 1308 microversion: 2.1 time: 0.417242 Sep 23 04:45:00.636542 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1630/3197] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:45:00 2022] GET /compute/v2.1/servers/2c316737-b84f-4b49-a5ab-cc0196b15760 => generated 1308 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:45:00.651207 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4df638bf-a633-4710-94c7-4c1c2487eafb tempest-ServerGroup264TestJSON-881668288 tempest-ServerGroup264TestJSON-881668288-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:00.680080 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4df638bf-a633-4710-94c7-4c1c2487eafb tempest-ServerGroup264TestJSON-881668288 tempest-ServerGroup264TestJSON-881668288-project] 10.222.0.33 "GET /compute/v2.1/os-server-groups/3632698c-7ca2-490a-88af-74c03b2b87a5" status: 200 len: 235 microversion: 2.64 time: 0.042204 Sep 23 04:45:00.687235 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1631/3198] 10.222.0.33 () {60 vars in 1304 bytes} [Fri Sep 23 04:45:00 2022] GET /compute/v2.1/os-server-groups/3632698c-7ca2-490a-88af-74c03b2b87a5 => generated 235 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 04:45:00.692752 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-6c55d1a4-edbb-4290-924d-5e32ac19085d req-e5a3e3f4-d6e7-4c86-a0f9-4c02eb986a67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "188a699b-0a1a-46b4-9a03-788af481d3ca", "name": "network-vif-plugged", "status": "completed", "tag": "f0ab08a0-19b4-4e1e-b09d-bc591c3179dd"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:45:00.705042 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-6c55d1a4-edbb-4290-924d-5e32ac19085d req-e5a3e3f4-d6e7-4c86-a0f9-4c02eb986a67 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:00.705963 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-6c55d1a4-edbb-4290-924d-5e32ac19085d req-e5a3e3f4-d6e7-4c86-a0f9-4c02eb986a67 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:00.706603 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-6c55d1a4-edbb-4290-924d-5e32ac19085d req-e5a3e3f4-d6e7-4c86-a0f9-4c02eb986a67 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:00.718943 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-6c55d1a4-edbb-4290-924d-5e32ac19085d req-e5a3e3f4-d6e7-4c86-a0f9-4c02eb986a67 service nova] Creating event network-vif-plugged:f0ab08a0-19b4-4e1e-b09d-bc591c3179dd for instance 188a699b-0a1a-46b4-9a03-788af481d3ca on n-h2-846463-3 Sep 23 04:45:00.724295 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-6c55d1a4-edbb-4290-924d-5e32ac19085d req-e5a3e3f4-d6e7-4c86-a0f9-4c02eb986a67 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035086 Sep 23 04:45:00.725566 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1632/3199] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:45:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:45:00.734410 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3d9adeaf-5070-456e-a26a-641e8590e64f tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:00.735899 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-3d9adeaf-5070-456e-a26a-641e8590e64f tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] [instance: 188a699b-0a1a-46b4-9a03-788af481d3ca] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:00.743402 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3d9adeaf-5070-456e-a26a-641e8590e64f tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:00.744288 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3d9adeaf-5070-456e-a26a-641e8590e64f tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:00.745532 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3d9adeaf-5070-456e-a26a-641e8590e64f tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:00.746612 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3d9adeaf-5070-456e-a26a-641e8590e64f tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:00.747253 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3d9adeaf-5070-456e-a26a-641e8590e64f tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:00.748033 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3d9adeaf-5070-456e-a26a-641e8590e64f tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:00.771039 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=100 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:45:00.952294 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=24 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:45:01.194128 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-3d9adeaf-5070-456e-a26a-641e8590e64f tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11980041918484990dac709544d0b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c43f2b70bc74a48b62fb4115337f073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:01.236130 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3d9adeaf-5070-456e-a26a-641e8590e64f tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/servers/188a699b-0a1a-46b4-9a03-788af481d3ca" status: 200 len: 1308 microversion: 2.1 time: 0.499605 Sep 23 04:45:01.237091 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1633/3200] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:45:00 2022] GET /compute/v2.1/servers/188a699b-0a1a-46b4-9a03-788af481d3ca => generated 1308 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:45:01.264582 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-caf5f1a8-b21b-4880-b9cb-e0a37d053730 tempest-ServerGroup264TestJSON-881668288 tempest-ServerGroup264TestJSON-881668288-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:01.431942 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-caf5f1a8-b21b-4880-b9cb-e0a37d053730 tempest-ServerGroup264TestJSON-881668288 tempest-ServerGroup264TestJSON-881668288-project] 10.222.0.33 "DELETE /compute/v2.1/os-server-groups/3632698c-7ca2-490a-88af-74c03b2b87a5" status: 204 len: 0 microversion: 2.64 time: 0.176224 Sep 23 04:45:01.433791 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1634/3201] 10.222.0.33 () {60 vars in 1307 bytes} [Fri Sep 23 04:45:01 2022] DELETE /compute/v2.1/os-server-groups/3632698c-7ca2-490a-88af-74c03b2b87a5 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 23 04:45:01.440334 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c6b33022-34db-4dab-96b7-25df9afddd04 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:01.441970 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c6b33022-34db-4dab-96b7-25df9afddd04 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] [instance: 48df7db9-a805-4c72-a1a5-29632b00248c] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:01.460963 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c6b33022-34db-4dab-96b7-25df9afddd04 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:01.462208 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c6b33022-34db-4dab-96b7-25df9afddd04 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:01.462900 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c6b33022-34db-4dab-96b7-25df9afddd04 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:01.463978 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c6b33022-34db-4dab-96b7-25df9afddd04 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:01.464695 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c6b33022-34db-4dab-96b7-25df9afddd04 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:01.465809 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c6b33022-34db-4dab-96b7-25df9afddd04 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:01.500121 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.network.neutron [None req-cd16ab83-3b29-4908-b2e4-eda7fe44bdea tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] [instance: 15e9bc0f-2262-4e2c-9cac-0eca4575943c] Building network info cache for instance {{(pid=122698) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 23 04:45:01.642202 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c6b33022-34db-4dab-96b7-25df9afddd04 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e235519204b4efc8b6c7e2988fab9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0b7307c30a4c118da4c501691e349f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:01.661453 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c6b33022-34db-4dab-96b7-25df9afddd04 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] 10.222.0.33 "GET /compute/v2.1/servers/48df7db9-a805-4c72-a1a5-29632b00248c" status: 200 len: 1614 microversion: 2.1 time: 0.223759 Sep 23 04:45:01.675388 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1635/3202] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:45:01 2022] GET /compute/v2.1/servers/48df7db9-a805-4c72-a1a5-29632b00248c => generated 1614 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:45:01.699131 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-bd0b239b-a982-4d5b-9158-920c688ec2b8 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:01.704272 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-bd0b239b-a982-4d5b-9158-920c688ec2b8 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] [instance: 147e9a2b-507b-4ecf-ae6a-de2f30903108] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:01.728044 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bd0b239b-a982-4d5b-9158-920c688ec2b8 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:01.728613 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bd0b239b-a982-4d5b-9158-920c688ec2b8 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:01.729062 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bd0b239b-a982-4d5b-9158-920c688ec2b8 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:01.729778 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bd0b239b-a982-4d5b-9158-920c688ec2b8 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:01.730271 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bd0b239b-a982-4d5b-9158-920c688ec2b8 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:01.730698 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bd0b239b-a982-4d5b-9158-920c688ec2b8 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:02.018338 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-bd0b239b-a982-4d5b-9158-920c688ec2b8 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f455e9897223404cac3033250226fbc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f623171eb84310b4297ad6ba269c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:02.035614 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-bd0b239b-a982-4d5b-9158-920c688ec2b8 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] 10.222.0.33 "GET /compute/v2.1/servers/147e9a2b-507b-4ecf-ae6a-de2f30903108" status: 200 len: 1323 microversion: 2.1 time: 0.351438 Sep 23 04:45:02.037481 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1636/3203] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:45:01 2022] GET /compute/v2.1/servers/147e9a2b-507b-4ecf-ae6a-de2f30903108 => generated 1323 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:45:02.048471 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-369d409c-751d-4db9-8605-4a2f3d5220a7 tempest-ServerGroup264TestJSON-881668288 tempest-ServerGroup264TestJSON-881668288-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:02.062353 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-369d409c-751d-4db9-8605-4a2f3d5220a7 tempest-ServerGroup264TestJSON-881668288 tempest-ServerGroup264TestJSON-881668288-project] HTTP exception thrown: Instance group 3632698c-7ca2-490a-88af-74c03b2b87a5 could not be found. Sep 23 04:45:02.067433 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-369d409c-751d-4db9-8605-4a2f3d5220a7 tempest-ServerGroup264TestJSON-881668288 tempest-ServerGroup264TestJSON-881668288-project] Request method failure captured: Sep 23 04:45:02.067433 n-d-846463-3 devstack@n-api.service[122699]: request: DELETE /compute/v2.1/os-server-groups/3632698c-7ca2-490a-88af-74c03b2b87a5 HTTP/1.1 Sep 23 04:45:02.067433 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:45:02.067433 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:45:02.067433 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:45:02.067433 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:45:02.067433 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:45:02.067433 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:45:02.067433 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:45:02.067433 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:45:02.067433 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTnJo5GNzMSoqTdXa2oW9eKCzMyDtS88QVk6rsN8oSCq3ffU9lQlfIMdCH1L9GQlG--UvxQKeM5HnjUfp6hXI0H53g8oDAKgdSeHoZipCAIHgMhR3pm80j4cTRLbL52eX2njTFgbU_2d_IP6SrkErrlHdSHWcfPNvT8e7eYoW8tnDzg Sep 23 04:45:02.067433 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:45:02.067433 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:45:02.067433 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:45:02.067433 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:45:02.067433 n-d-846463-3 devstack@n-api.service[122699]: X-Openstack-Nova-Api-Version: 2.64 Sep 23 04:45:02.067433 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:45:02.067433 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:45:02.067433 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: b72fa96fc6c54dc48829de7688905c2d Sep 23 04:45:02.067433 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ServerGroup264TestJSON-881668288 Sep 23 04:45:02.067433 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:45:02.067433 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:45:02.067433 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b72fa96fc6c54dc48829de7688905c2d", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b72fa96fc6c54dc48829de7688905c2d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b72fa96fc6c54dc48829de7688905c2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b72fa96fc6c54dc48829de7688905c2d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:45:02.067433 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ServerGroup264TestJSON-881668288 Sep 23 04:45:02.067433 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: b72fa96fc6c54dc48829de7688905c2d Sep 23 04:45:02.067433 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ServerGroup264TestJSON-881668288 Sep 23 04:45:02.067433 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ServerGroup264TestJSON-881668288-project Sep 23 04:45:02.067433 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:45:02.067433 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:45:02.067433 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: b71671360a624cea9073afe97c747ddf Sep 23 04:45:02.067433 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ServerGroup264TestJSON-881668288-project Sep 23 04:45:02.067433 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:45:02.067433 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance group 3632698c-7ca2-490a-88af-74c03b2b87a5 could not be found. Sep 23 04:45:02.067433 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '3632698c-7ca2-490a-88af-74c03b2b87a5'} Sep 23 04:45:02.067433 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:45:02.067433 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:45:02.067433 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 23 04:45:02.067433 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 23 04:45:02.067433 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 04:45:02.067433 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 04:45:02.067433 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 23 04:45:02.067433 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 23 04:45:02.067433 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 23 04:45:02.067433 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 23 04:45:02.067433 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 23 04:45:02.067433 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 23 04:45:02.067433 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 3632698c-7ca2-490a-88af-74c03b2b87a5 could not be found. Sep 23 04:45:02.067433 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:45:02.067433 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:45:02.067433 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:45:02.067433 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:45:02.067433 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:45:02.067433 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:45:02.067433 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:45:02.067433 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:45:02.067433 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:45:02.067433 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:45:02.067433 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 23 04:45:02.067433 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:45:02.067433 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 3632698c-7ca2-490a-88af-74c03b2b87a5 could not be found. Sep 23 04:45:02.067433 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:45:02.067433 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:45:02.067433 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:45:02.067433 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:45:02.071420 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:45:02.071420 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:45:02.071420 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:45:02.071420 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:45:02.071420 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 3632698c-7ca2-490a-88af-74c03b2b87a5 could not be found. Sep 23 04:45:02.071420 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:45:02.071420 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-369d409c-751d-4db9-8605-4a2f3d5220a7 tempest-ServerGroup264TestJSON-881668288 tempest-ServerGroup264TestJSON-881668288-project] Returning 404 to user: Instance group 3632698c-7ca2-490a-88af-74c03b2b87a5 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:45:02.071420 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-369d409c-751d-4db9-8605-4a2f3d5220a7 tempest-ServerGroup264TestJSON-881668288 tempest-ServerGroup264TestJSON-881668288-project] 10.222.0.33 "DELETE /compute/v2.1/os-server-groups/3632698c-7ca2-490a-88af-74c03b2b87a5" status: 404 len: 117 microversion: 2.64 time: 0.030959 Sep 23 04:45:02.076097 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1637/3204] 10.222.0.33 () {60 vars in 1307 bytes} [Fri Sep 23 04:45:02 2022] DELETE /compute/v2.1/os-server-groups/3632698c-7ca2-490a-88af-74c03b2b87a5 => generated 117 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 23 04:45:02.095636 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-468a5e17-cb6c-4216-88cf-f3a6e13c71c5 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:02.097796 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-468a5e17-cb6c-4216-88cf-f3a6e13c71c5 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 2c316737-b84f-4b49-a5ab-cc0196b15760] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:02.119530 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-468a5e17-cb6c-4216-88cf-f3a6e13c71c5 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:02.122217 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-468a5e17-cb6c-4216-88cf-f3a6e13c71c5 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:02.126972 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-468a5e17-cb6c-4216-88cf-f3a6e13c71c5 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:02.129067 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-468a5e17-cb6c-4216-88cf-f3a6e13c71c5 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:02.129780 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-468a5e17-cb6c-4216-88cf-f3a6e13c71c5 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:02.133745 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-468a5e17-cb6c-4216-88cf-f3a6e13c71c5 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:02.520360 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-468a5e17-cb6c-4216-88cf-f3a6e13c71c5 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:02.532523 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-468a5e17-cb6c-4216-88cf-f3a6e13c71c5 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/2c316737-b84f-4b49-a5ab-cc0196b15760" status: 200 len: 1308 microversion: 2.1 time: 0.454338 Sep 23 04:45:02.536170 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1638/3205] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:45:02 2022] GET /compute/v2.1/servers/2c316737-b84f-4b49-a5ab-cc0196b15760 => generated 1308 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:45:02.554611 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b3fb7f99-fcc1-4975-8e32-cf95282f22f9 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:02.559695 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b3fb7f99-fcc1-4975-8e32-cf95282f22f9 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] [instance: 188a699b-0a1a-46b4-9a03-788af481d3ca] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:02.577941 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b3fb7f99-fcc1-4975-8e32-cf95282f22f9 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:02.580034 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b3fb7f99-fcc1-4975-8e32-cf95282f22f9 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:02.580782 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b3fb7f99-fcc1-4975-8e32-cf95282f22f9 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:02.582634 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b3fb7f99-fcc1-4975-8e32-cf95282f22f9 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:02.583918 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b3fb7f99-fcc1-4975-8e32-cf95282f22f9 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:02.588030 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b3fb7f99-fcc1-4975-8e32-cf95282f22f9 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:02.993458 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b3fb7f99-fcc1-4975-8e32-cf95282f22f9 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11980041918484990dac709544d0b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c43f2b70bc74a48b62fb4115337f073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:03.011595 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b3fb7f99-fcc1-4975-8e32-cf95282f22f9 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/servers/188a699b-0a1a-46b4-9a03-788af481d3ca" status: 200 len: 1488 microversion: 2.1 time: 0.471339 Sep 23 04:45:03.034254 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1639/3206] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:45:02 2022] GET /compute/v2.1/servers/188a699b-0a1a-46b4-9a03-788af481d3ca => generated 1488 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:45:03.043995 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-490a73c3-482f-47d3-bba2-e07ec09245bf req-d1213ef2-7b2e-4d64-ad6a-c69c4690002c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15e9bc0f-2262-4e2c-9cac-0eca4575943c", "tag": "c81ebfeb-05fd-445f-bb49-70dc27b6c143"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:45:03.082171 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-490a73c3-482f-47d3-bba2-e07ec09245bf req-d1213ef2-7b2e-4d64-ad6a-c69c4690002c service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:03.085951 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-490a73c3-482f-47d3-bba2-e07ec09245bf req-d1213ef2-7b2e-4d64-ad6a-c69c4690002c service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:03.086743 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-490a73c3-482f-47d3-bba2-e07ec09245bf req-d1213ef2-7b2e-4d64-ad6a-c69c4690002c service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:03.135141 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-490a73c3-482f-47d3-bba2-e07ec09245bf req-d1213ef2-7b2e-4d64-ad6a-c69c4690002c service nova] Creating event network-changed:c81ebfeb-05fd-445f-bb49-70dc27b6c143 for instance 15e9bc0f-2262-4e2c-9cac-0eca4575943c on n-h2-846463-3 Sep 23 04:45:03.149040 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-490a73c3-482f-47d3-bba2-e07ec09245bf req-d1213ef2-7b2e-4d64-ad6a-c69c4690002c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113069 Sep 23 04:45:03.149849 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1640/3207] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:45:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:45:03.167277 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-358bf850-c195-4129-9a4b-589715f72308 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:03.168824 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-358bf850-c195-4129-9a4b-589715f72308 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] [instance: 48df7db9-a805-4c72-a1a5-29632b00248c] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:03.186610 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-358bf850-c195-4129-9a4b-589715f72308 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:03.187115 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-358bf850-c195-4129-9a4b-589715f72308 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:03.187559 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-358bf850-c195-4129-9a4b-589715f72308 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:03.188901 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-358bf850-c195-4129-9a4b-589715f72308 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:03.189361 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-358bf850-c195-4129-9a4b-589715f72308 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:03.190206 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-358bf850-c195-4129-9a4b-589715f72308 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:03.507132 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-358bf850-c195-4129-9a4b-589715f72308 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e235519204b4efc8b6c7e2988fab9b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0b7307c30a4c118da4c501691e349f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:03.518775 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-358bf850-c195-4129-9a4b-589715f72308 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] 10.222.0.33 "GET /compute/v2.1/servers/48df7db9-a805-4c72-a1a5-29632b00248c" status: 200 len: 1614 microversion: 2.1 time: 0.365611 Sep 23 04:45:03.533974 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1641/3208] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:45:03 2022] GET /compute/v2.1/servers/48df7db9-a805-4c72-a1a5-29632b00248c => generated 1614 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:45:03.533974 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-07f707ce-61b7-4ce5-bb06-117296455f1c req-6acd0594-aeb9-47ab-afef-795b05551aaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48df7db9-a805-4c72-a1a5-29632b00248c", "name": "network-vif-deleted", "tag": "26df0c1e-53e4-4613-b218-9ca9a68bcbbc"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:45:03.549677 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.network.neutron [None req-cd16ab83-3b29-4908-b2e4-eda7fe44bdea tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] [instance: 15e9bc0f-2262-4e2c-9cac-0eca4575943c] Updating instance_info_cache with network_info: [{"id": "c81ebfeb-05fd-445f-bb49-70dc27b6c143", "address": "fa:16:3e:19:06:94", "network": {"id": "92e4cf52-3ec0-4ed2-ba7a-11c60083e3f3", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1923791577-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "d22fd8f3b0334cb3b1af66cf626422fe", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapc81ebfeb-05", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122698) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 23 04:45:03.555512 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-07f707ce-61b7-4ce5-bb06-117296455f1c req-6acd0594-aeb9-47ab-afef-795b05551aaa service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:03.559141 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-07f707ce-61b7-4ce5-bb06-117296455f1c req-6acd0594-aeb9-47ab-afef-795b05551aaa service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:03.560506 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-07f707ce-61b7-4ce5-bb06-117296455f1c req-6acd0594-aeb9-47ab-afef-795b05551aaa service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:03.580073 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-07f707ce-61b7-4ce5-bb06-117296455f1c req-6acd0594-aeb9-47ab-afef-795b05551aaa service nova] Creating event network-vif-deleted:26df0c1e-53e4-4613-b218-9ca9a68bcbbc for instance 48df7db9-a805-4c72-a1a5-29632b00248c on n-h1-846463-3 Sep 23 04:45:03.586982 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-07f707ce-61b7-4ce5-bb06-117296455f1c req-6acd0594-aeb9-47ab-afef-795b05551aaa service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061855 Sep 23 04:45:03.588322 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1642/3209] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:45:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:45:03.601086 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-03ea5fa4-377d-480e-a543-bcb1a5101007 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:45:03.608202 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-03ea5fa4-377d-480e-a543-bcb1a5101007 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:03.608794 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-03ea5fa4-377d-480e-a543-bcb1a5101007 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:03.609540 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-03ea5fa4-377d-480e-a543-bcb1a5101007 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:03.644288 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-03ea5fa4-377d-480e-a543-bcb1a5101007 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] [instance: 188a699b-0a1a-46b4-9a03-788af481d3ca] Going to try to stop instance {{(pid=122699) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 23 04:45:03.665961 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cd16ab83-3b29-4908-b2e4-eda7fe44bdea tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Releasing lock "refresh_cache-15e9bc0f-2262-4e2c-9cac-0eca4575943c" {{(pid=122698) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 23 04:45:03.666869 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-cd16ab83-3b29-4908-b2e4-eda7fe44bdea tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] 10.222.0.33 "POST /compute/v2.1/servers/15e9bc0f-2262-4e2c-9cac-0eca4575943c/action" status: 202 len: 0 microversion: 2.1 time: 4.713388 Sep 23 04:45:03.667493 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1568/3210] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:44:58 2022] POST /compute/v2.1/servers/15e9bc0f-2262-4e2c-9cac-0eca4575943c/action => generated 0 bytes in 4715 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 23 04:45:03.673627 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-627d5f34-8af1-41a6-9cc7-5ceaad6244f9 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:03.674281 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-627d5f34-8af1-41a6-9cc7-5ceaad6244f9 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] [instance: 147e9a2b-507b-4ecf-ae6a-de2f30903108] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:03.696225 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-627d5f34-8af1-41a6-9cc7-5ceaad6244f9 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:03.696742 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-627d5f34-8af1-41a6-9cc7-5ceaad6244f9 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:03.697190 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-627d5f34-8af1-41a6-9cc7-5ceaad6244f9 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:03.698248 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-627d5f34-8af1-41a6-9cc7-5ceaad6244f9 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:03.698892 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-627d5f34-8af1-41a6-9cc7-5ceaad6244f9 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:03.699504 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-627d5f34-8af1-41a6-9cc7-5ceaad6244f9 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:03.921659 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-03ea5fa4-377d-480e-a543-bcb1a5101007 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "POST /compute/v2.1/servers/188a699b-0a1a-46b4-9a03-788af481d3ca/action" status: 202 len: 0 microversion: 2.1 time: 0.331119 Sep 23 04:45:03.924057 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1643/3211] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:45:03 2022] POST /compute/v2.1/servers/188a699b-0a1a-46b4-9a03-788af481d3ca/action => generated 0 bytes in 335 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:45:03.942684 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-83305743-4f15-4356-a30b-7395d386b682 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:03.947598 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-83305743-4f15-4356-a30b-7395d386b682 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 2c316737-b84f-4b49-a5ab-cc0196b15760] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:03.979289 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-83305743-4f15-4356-a30b-7395d386b682 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:03.981149 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-83305743-4f15-4356-a30b-7395d386b682 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:03.981828 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-83305743-4f15-4356-a30b-7395d386b682 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:03.992600 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-83305743-4f15-4356-a30b-7395d386b682 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:03.992600 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-83305743-4f15-4356-a30b-7395d386b682 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:03.992600 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-83305743-4f15-4356-a30b-7395d386b682 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:04.752679 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-627d5f34-8af1-41a6-9cc7-5ceaad6244f9 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f455e9897223404cac3033250226fbc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f623171eb84310b4297ad6ba269c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:04.785832 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-627d5f34-8af1-41a6-9cc7-5ceaad6244f9 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] 10.222.0.33 "GET /compute/v2.1/servers/147e9a2b-507b-4ecf-ae6a-de2f30903108" status: 200 len: 1323 microversion: 2.1 time: 1.103475 Sep 23 04:45:04.785832 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1569/3212] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:45:03 2022] GET /compute/v2.1/servers/147e9a2b-507b-4ecf-ae6a-de2f30903108 => generated 1323 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:45:04.785832 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8b5dc86e-01ab-492f-b15b-847f9d3c8366 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Calling method '.version_select at 0x7ff1baab45e0>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:04.800836 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-83305743-4f15-4356-a30b-7395d386b682 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:04.815869 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-83305743-4f15-4356-a30b-7395d386b682 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/2c316737-b84f-4b49-a5ab-cc0196b15760" status: 200 len: 1308 microversion: 2.1 time: 0.887692 Sep 23 04:45:04.817345 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1644/3213] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:45:03 2022] GET /compute/v2.1/servers/2c316737-b84f-4b49-a5ab-cc0196b15760 => generated 1308 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:45:04.824689 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-fc860620-0fd2-4922-ac72-b9d47b1d6f34 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:04.825554 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-fc860620-0fd2-4922-ac72-b9d47b1d6f34 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] [instance: 188a699b-0a1a-46b4-9a03-788af481d3ca] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:04.841218 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fc860620-0fd2-4922-ac72-b9d47b1d6f34 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:04.842586 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fc860620-0fd2-4922-ac72-b9d47b1d6f34 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:04.843215 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fc860620-0fd2-4922-ac72-b9d47b1d6f34 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:04.844124 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fc860620-0fd2-4922-ac72-b9d47b1d6f34 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:04.844741 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fc860620-0fd2-4922-ac72-b9d47b1d6f34 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:04.845321 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fc860620-0fd2-4922-ac72-b9d47b1d6f34 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:05.425813 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-fc860620-0fd2-4922-ac72-b9d47b1d6f34 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11980041918484990dac709544d0b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c43f2b70bc74a48b62fb4115337f073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:05.434543 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-fc860620-0fd2-4922-ac72-b9d47b1d6f34 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/servers/188a699b-0a1a-46b4-9a03-788af481d3ca" status: 200 len: 1498 microversion: 2.1 time: 0.615821 Sep 23 04:45:05.435151 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1645/3214] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:45:04 2022] GET /compute/v2.1/servers/188a699b-0a1a-46b4-9a03-788af481d3ca => generated 1498 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:45:05.450281 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c0ec84d2-14b3-47ba-baf4-89cbe96528a6 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:05.450919 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c0ec84d2-14b3-47ba-baf4-89cbe96528a6 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] [instance: 48df7db9-a805-4c72-a1a5-29632b00248c] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:05.463637 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c0ec84d2-14b3-47ba-baf4-89cbe96528a6 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:05.464162 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c0ec84d2-14b3-47ba-baf4-89cbe96528a6 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:05.464617 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c0ec84d2-14b3-47ba-baf4-89cbe96528a6 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:05.465351 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c0ec84d2-14b3-47ba-baf4-89cbe96528a6 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:05.465819 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c0ec84d2-14b3-47ba-baf4-89cbe96528a6 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:05.474647 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c0ec84d2-14b3-47ba-baf4-89cbe96528a6 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:05.511218 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-c0ec84d2-14b3-47ba-baf4-89cbe96528a6 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] HTTP exception thrown: Instance 48df7db9-a805-4c72-a1a5-29632b00248c could not be found. Sep 23 04:45:05.511218 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c0ec84d2-14b3-47ba-baf4-89cbe96528a6 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Request method failure captured: Sep 23 04:45:05.511218 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/48df7db9-a805-4c72-a1a5-29632b00248c HTTP/1.1 Sep 23 04:45:05.511218 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:45:05.511218 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:45:05.511218 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:45:05.511218 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:45:05.511218 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:45:05.511218 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:45:05.511218 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:45:05.511218 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:45:05.511218 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTkhK7XbSajkVnbnDopFxjpLIBnuwakk2XlYaNVXx11wZ-7RHBdKfy_R-irPmIWx4p-TOGU0SRkH38-v_0C-71DSshVuUFFquz9Da2Nt2oKsLVzd0TKk2z6yh3BxmzNJif31ADoWsl8aT5_B-Jyj8-1sDFBTIe5f4MNqUghX_vs5Fr0 Sep 23 04:45:05.511218 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:45:05.511218 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:45:05.511218 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:45:05.511218 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:45:05.511218 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:45:05.511218 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:45:05.511218 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 2f0b7307c30a4c118da4c501691e349f Sep 23 04:45:05.511218 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-VolumesAdminNegativeTest-1731673499 Sep 23 04:45:05.511218 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:45:05.511218 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:45:05.511218 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2f0b7307c30a4c118da4c501691e349f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2f0b7307c30a4c118da4c501691e349f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2f0b7307c30a4c118da4c501691e349f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2f0b7307c30a4c118da4c501691e349f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:45:05.511218 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-VolumesAdminNegativeTest-1731673499 Sep 23 04:45:05.511218 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 2f0b7307c30a4c118da4c501691e349f Sep 23 04:45:05.511218 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1731673499 Sep 23 04:45:05.511218 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-VolumesAdminNegativeTest-1731673499-project Sep 23 04:45:05.511218 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:45:05.511218 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:45:05.511218 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 5e235519204b4efc8b6c7e2988fab9b8 Sep 23 04:45:05.511218 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-VolumesAdminNegativeTest-1731673499-project Sep 23 04:45:05.511218 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:45:05.511218 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 48df7db9-a805-4c72-a1a5-29632b00248c could not be found. Sep 23 04:45:05.511218 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '48df7db9-a805-4c72-a1a5-29632b00248c'} Sep 23 04:45:05.511218 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:45:05.511218 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:45:05.511218 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:45:05.511218 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:45:05.511218 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:45:05.511218 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:45:05.511218 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:45:05.511218 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:45:05.511218 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:45:05.511218 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:45:05.511218 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48df7db9-a805-4c72-a1a5-29632b00248c could not be found. Sep 23 04:45:05.511218 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:45:05.511218 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:45:05.511218 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:45:05.511218 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:45:05.511218 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:45:05.511218 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:45:05.511218 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:45:05.511218 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:45:05.511218 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:45:05.511218 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:45:05.511218 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:45:05.511218 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:45:05.511218 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:45:05.511218 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:45:05.511218 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:45:05.511218 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:45:05.516966 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48df7db9-a805-4c72-a1a5-29632b00248c could not be found. Sep 23 04:45:05.516966 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:45:05.516966 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:45:05.516966 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:45:05.516966 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:45:05.516966 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:45:05.516966 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:45:05.516966 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:45:05.516966 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:45:05.516966 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48df7db9-a805-4c72-a1a5-29632b00248c could not be found. Sep 23 04:45:05.516966 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:45:05.516966 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c0ec84d2-14b3-47ba-baf4-89cbe96528a6 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Returning 404 to user: Instance 48df7db9-a805-4c72-a1a5-29632b00248c could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:45:05.516966 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c0ec84d2-14b3-47ba-baf4-89cbe96528a6 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] 10.222.0.33 "GET /compute/v2.1/servers/48df7db9-a805-4c72-a1a5-29632b00248c" status: 404 len: 111 microversion: 2.1 time: 0.073030 Sep 23 04:45:05.516966 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1646/3215] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:45:05 2022] GET /compute/v2.1/servers/48df7db9-a805-4c72-a1a5-29632b00248c => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:45:05.521993 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a516d5bd-6afe-4a67-9662-c62452a712c4 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] Calling method '.version_select at 0x7ff1c3f31820>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:05.725472 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a516d5bd-6afe-4a67-9662-c62452a712c4 tempest-VolumesAdminNegativeTest-1731673499 tempest-VolumesAdminNegativeTest-1731673499-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1544762167" status: 202 len: 0 microversion: 2.1 time: 0.207775 Sep 23 04:45:05.726806 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1647/3216] 10.222.0.33 () {58 vars in 1221 bytes} [Fri Sep 23 04:45:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1544762167 => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:45:05.799002 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b059d646-6f03-439a-a2e8-a6ef9bc9f9e7 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:05.800848 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b059d646-6f03-439a-a2e8-a6ef9bc9f9e7 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] [instance: 147e9a2b-507b-4ecf-ae6a-de2f30903108] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:05.809077 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b059d646-6f03-439a-a2e8-a6ef9bc9f9e7 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:05.810474 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b059d646-6f03-439a-a2e8-a6ef9bc9f9e7 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:05.811167 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b059d646-6f03-439a-a2e8-a6ef9bc9f9e7 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:05.812112 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b059d646-6f03-439a-a2e8-a6ef9bc9f9e7 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:05.812740 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b059d646-6f03-439a-a2e8-a6ef9bc9f9e7 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:05.813870 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b059d646-6f03-439a-a2e8-a6ef9bc9f9e7 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:06.312247 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b059d646-6f03-439a-a2e8-a6ef9bc9f9e7 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f455e9897223404cac3033250226fbc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f623171eb84310b4297ad6ba269c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:06.326142 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b059d646-6f03-439a-a2e8-a6ef9bc9f9e7 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] 10.222.0.33 "GET /compute/v2.1/servers/147e9a2b-507b-4ecf-ae6a-de2f30903108" status: 200 len: 1323 microversion: 2.1 time: 0.531376 Sep 23 04:45:06.336467 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1648/3217] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:45:05 2022] GET /compute/v2.1/servers/147e9a2b-507b-4ecf-ae6a-de2f30903108 => generated 1323 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:45:06.349191 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1b1a047b-7159-40b6-812d-ac5b9d4a6e1b tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:06.350139 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1b1a047b-7159-40b6-812d-ac5b9d4a6e1b tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 2c316737-b84f-4b49-a5ab-cc0196b15760] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:06.363121 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1b1a047b-7159-40b6-812d-ac5b9d4a6e1b tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:06.363838 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1b1a047b-7159-40b6-812d-ac5b9d4a6e1b tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:06.364453 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1b1a047b-7159-40b6-812d-ac5b9d4a6e1b tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:06.365363 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1b1a047b-7159-40b6-812d-ac5b9d4a6e1b tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:06.366012 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1b1a047b-7159-40b6-812d-ac5b9d4a6e1b tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:06.366677 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1b1a047b-7159-40b6-812d-ac5b9d4a6e1b tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:06.816780 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1b1a047b-7159-40b6-812d-ac5b9d4a6e1b tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:06.834768 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1b1a047b-7159-40b6-812d-ac5b9d4a6e1b tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/2c316737-b84f-4b49-a5ab-cc0196b15760" status: 200 len: 1308 microversion: 2.1 time: 0.496054 Sep 23 04:45:06.835365 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1649/3218] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:45:06 2022] GET /compute/v2.1/servers/2c316737-b84f-4b49-a5ab-cc0196b15760 => generated 1308 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:45:06.855347 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6cc1c4ad-842f-40e1-80da-5de1aa66d635 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:06.855973 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-6cc1c4ad-842f-40e1-80da-5de1aa66d635 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] [instance: 188a699b-0a1a-46b4-9a03-788af481d3ca] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:06.875584 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6cc1c4ad-842f-40e1-80da-5de1aa66d635 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:06.881805 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6cc1c4ad-842f-40e1-80da-5de1aa66d635 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:06.881805 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6cc1c4ad-842f-40e1-80da-5de1aa66d635 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:06.881805 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6cc1c4ad-842f-40e1-80da-5de1aa66d635 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:06.881805 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6cc1c4ad-842f-40e1-80da-5de1aa66d635 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:06.881805 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6cc1c4ad-842f-40e1-80da-5de1aa66d635 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:07.753594 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-6cc1c4ad-842f-40e1-80da-5de1aa66d635 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11980041918484990dac709544d0b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c43f2b70bc74a48b62fb4115337f073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:07.770415 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6cc1c4ad-842f-40e1-80da-5de1aa66d635 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/servers/188a699b-0a1a-46b4-9a03-788af481d3ca" status: 200 len: 1498 microversion: 2.1 time: 0.916711 Sep 23 04:45:07.771052 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1650/3219] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:45:06 2022] GET /compute/v2.1/servers/188a699b-0a1a-46b4-9a03-788af481d3ca => generated 1498 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:45:07.780361 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d937766f-23f5-488d-b209-737f35e3a86a tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:07.780994 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d937766f-23f5-488d-b209-737f35e3a86a tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] [instance: 147e9a2b-507b-4ecf-ae6a-de2f30903108] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:07.796174 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d937766f-23f5-488d-b209-737f35e3a86a tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:07.799222 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d937766f-23f5-488d-b209-737f35e3a86a tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:07.799863 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d937766f-23f5-488d-b209-737f35e3a86a tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:07.800874 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d937766f-23f5-488d-b209-737f35e3a86a tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:07.801549 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d937766f-23f5-488d-b209-737f35e3a86a tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:07.802718 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d937766f-23f5-488d-b209-737f35e3a86a tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:08.022403 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8b5dc86e-01ab-492f-b15b-847f9d3c8366 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] 10.222.0.33 "DELETE /compute/v2.1/os-floating-ips/c82c9b28-4cb3-417b-91ab-bc859de74905" status: 202 len: 0 microversion: 2.1 time: 3.245575 Sep 23 04:45:08.024640 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1570/3220] 10.222.0.33 () {58 vars in 1263 bytes} [Fri Sep 23 04:45:04 2022] DELETE /compute/v2.1/os-floating-ips/c82c9b28-4cb3-417b-91ab-bc859de74905 => generated 0 bytes in 3249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:45:08.032580 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-2bd99728-894a-4840-80dc-054db957c141 req-f520bdda-d5b6-46d1-8e19-77b68241702d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "147e9a2b-507b-4ecf-ae6a-de2f30903108", "name": "network-vif-plugged", "status": "completed", "tag": "6dd5961e-9308-4178-8e45-0b2b5b318393"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:45:08.051508 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-2bd99728-894a-4840-80dc-054db957c141 req-f520bdda-d5b6-46d1-8e19-77b68241702d service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:08.052809 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-2bd99728-894a-4840-80dc-054db957c141 req-f520bdda-d5b6-46d1-8e19-77b68241702d service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:08.053519 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-2bd99728-894a-4840-80dc-054db957c141 req-f520bdda-d5b6-46d1-8e19-77b68241702d service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:08.075476 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-2bd99728-894a-4840-80dc-054db957c141 req-f520bdda-d5b6-46d1-8e19-77b68241702d service nova] Creating event network-vif-plugged:6dd5961e-9308-4178-8e45-0b2b5b318393 for instance 147e9a2b-507b-4ecf-ae6a-de2f30903108 on n-h1-846463-3 Sep 23 04:45:08.081184 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-2bd99728-894a-4840-80dc-054db957c141 req-f520bdda-d5b6-46d1-8e19-77b68241702d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054710 Sep 23 04:45:08.081794 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1571/3221] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:45:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:45:08.083967 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d937766f-23f5-488d-b209-737f35e3a86a tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f455e9897223404cac3033250226fbc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f623171eb84310b4297ad6ba269c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:08.091316 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9ef28be6-bef4-40e5-a2ed-91f7e2f20e85 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:08.091316 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-9ef28be6-bef4-40e5-a2ed-91f7e2f20e85 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 2c316737-b84f-4b49-a5ab-cc0196b15760] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:08.093288 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d937766f-23f5-488d-b209-737f35e3a86a tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] 10.222.0.33 "GET /compute/v2.1/servers/147e9a2b-507b-4ecf-ae6a-de2f30903108" status: 200 len: 1323 microversion: 2.1 time: 0.321012 Sep 23 04:45:08.095220 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1651/3222] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:45:07 2022] GET /compute/v2.1/servers/147e9a2b-507b-4ecf-ae6a-de2f30903108 => generated 1323 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:45:08.111414 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e3a170d4-5ec7-4cc8-a689-37a8ef0c9d76 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:45:08.119929 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e3a170d4-5ec7-4cc8-a689-37a8ef0c9d76 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Request method failure captured: Sep 23 04:45:08.119929 n-d-846463-3 devstack@n-api.service[122699]: request: POST /compute/v2.1/servers/15e9bc0f-2262-4e2c-9cac-0eca4575943c/action HTTP/1.1 Sep 23 04:45:08.119929 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:45:08.119929 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:45:08.119929 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:45:08.119929 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 34 Sep 23 04:45:08.119929 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:45:08.119929 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:45:08.119929 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:45:08.119929 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:45:08.119929 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTmPnd6xyvib_sf8QDaEntL9VdzDsB1XlvYVv_byssSC9y0FuDAryctCXBXrVZCD9PbDQ3dSKjCyQRUJ_pn0mcUTQtUcsqOBu7SzpbudMSWwG5qnWC39KpYvZ5kKS2OfyNAGthEfbeZlhBjN-4zVQm7v8iE9-1JXPDGcINofG8kf_uc Sep 23 04:45:08.119929 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:45:08.119929 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:45:08.119929 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:45:08.119929 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:45:08.119929 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:45:08.119929 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:45:08.119929 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: d22fd8f3b0334cb3b1af66cf626422fe Sep 23 04:45:08.119929 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 Sep 23 04:45:08.119929 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:45:08.119929 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:45:08.119929 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d22fd8f3b0334cb3b1af66cf626422fe", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d22fd8f3b0334cb3b1af66cf626422fe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d22fd8f3b0334cb3b1af66cf626422fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d22fd8f3b0334cb3b1af66cf626422fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:45:08.119929 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 Sep 23 04:45:08.119929 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: d22fd8f3b0334cb3b1af66cf626422fe Sep 23 04:45:08.119929 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 Sep 23 04:45:08.119929 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project Sep 23 04:45:08.119929 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:45:08.119929 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:45:08.119929 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: d0c53d79930a4eaf9fcf7cd10707fbf3 Sep 23 04:45:08.119929 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project Sep 23 04:45:08.119929 n-d-846463-3 devstack@n-api.service[122699]: Sep 23 04:45:08.119929 n-d-846463-3 devstack@n-api.service[122699]: {"addFloatingIp": {"address": ""}} Sep 23 04:45:08.119929 n-d-846463-3 devstack@n-api.service[122699]: method: Sep 23 04:45:08.119929 n-d-846463-3 devstack@n-api.service[122699]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Sep 23 04:45:08.119929 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '15e9bc0f-2262-4e2c-9cac-0eca4575943c', 'body': {'addFloatingIp': {'address': ''}}} Sep 23 04:45:08.119929 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:45:08.119929 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:45:08.119929 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 23 04:45:08.119929 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 23 04:45:08.119929 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 23 04:45:08.119929 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise error Sep 23 04:45:08.119929 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Sep 23 04:45:08.119929 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:45:08.119929 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Sep 23 04:45:08.119929 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Sep 23 04:45:08.119929 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:45:08.119929 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Sep 23 04:45:08.119929 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi '' Sep 23 04:45:08.119929 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:45:08.119929 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:45:08.119929 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:45:08.119929 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:45:08.119929 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:45:08.119929 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:45:08.119929 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:45:08.119929 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:45:08.119929 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:45:08.119929 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:45:08.119929 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:45:08.119929 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:45:08.119929 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 23 04:45:08.119929 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 23 04:45:08.119929 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 23 04:45:08.119929 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 23 04:45:08.119929 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 23 04:45:08.124866 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 23 04:45:08.124866 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Sep 23 04:45:08.124866 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:45:08.124866 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:45:08.124866 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:45:08.124866 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:45:08.124866 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:45:08.124866 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:45:08.124866 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 23 04:45:08.124866 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 23 04:45:08.124866 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Sep 23 04:45:08.124866 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:45:08.127062 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9ef28be6-bef4-40e5-a2ed-91f7e2f20e85 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:08.127201 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e3a170d4-5ec7-4cc8-a689-37a8ef0c9d76 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:45:08.127538 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9ef28be6-bef4-40e5-a2ed-91f7e2f20e85 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:08.127991 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9ef28be6-bef4-40e5-a2ed-91f7e2f20e85 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:08.128727 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9ef28be6-bef4-40e5-a2ed-91f7e2f20e85 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:08.128988 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e3a170d4-5ec7-4cc8-a689-37a8ef0c9d76 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] 10.222.0.33 "POST /compute/v2.1/servers/15e9bc0f-2262-4e2c-9cac-0eca4575943c/action" status: 400 len: 142 microversion: 2.1 time: 0.032176 Sep 23 04:45:08.129197 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9ef28be6-bef4-40e5-a2ed-91f7e2f20e85 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:08.129629 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9ef28be6-bef4-40e5-a2ed-91f7e2f20e85 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:08.136608 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1652/3223] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:45:08 2022] POST /compute/v2.1/servers/15e9bc0f-2262-4e2c-9cac-0eca4575943c/action => generated 142 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 04:45:08.196208 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d860a635-ea13-404b-94f1-590fe2e1e330 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:45:08.201558 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d860a635-ea13-404b-94f1-590fe2e1e330 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] [instance: 15e9bc0f-2262-4e2c-9cac-0eca4575943c] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:08.223820 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d860a635-ea13-404b-94f1-590fe2e1e330 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:08.224744 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d860a635-ea13-404b-94f1-590fe2e1e330 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:08.226296 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d860a635-ea13-404b-94f1-590fe2e1e330 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:08.239570 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d860a635-ea13-404b-94f1-590fe2e1e330 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:08.239570 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d860a635-ea13-404b-94f1-590fe2e1e330 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:08.239570 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d860a635-ea13-404b-94f1-590fe2e1e330 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:08.286359 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d860a635-ea13-404b-94f1-590fe2e1e330 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Acquiring lock "refresh_cache-15e9bc0f-2262-4e2c-9cac-0eca4575943c" {{(pid=122699) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 23 04:45:08.287019 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d860a635-ea13-404b-94f1-590fe2e1e330 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Acquired lock "refresh_cache-15e9bc0f-2262-4e2c-9cac-0eca4575943c" {{(pid=122699) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 23 04:45:08.558596 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d860a635-ea13-404b-94f1-590fe2e1e330 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Releasing lock "refresh_cache-15e9bc0f-2262-4e2c-9cac-0eca4575943c" {{(pid=122699) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 23 04:45:08.559029 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-d860a635-ea13-404b-94f1-590fe2e1e330 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] HTTP exception thrown: floating IP not found Sep 23 04:45:08.560649 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d860a635-ea13-404b-94f1-590fe2e1e330 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Request method failure captured: Sep 23 04:45:08.560649 n-d-846463-3 devstack@n-api.service[122699]: request: POST /compute/v2.1/servers/15e9bc0f-2262-4e2c-9cac-0eca4575943c/action HTTP/1.1 Sep 23 04:45:08.560649 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:45:08.560649 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:45:08.560649 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:45:08.560649 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 41 Sep 23 04:45:08.560649 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:45:08.560649 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:45:08.560649 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:45:08.560649 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:45:08.560649 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTmPnd6xyvib_sf8QDaEntL9VdzDsB1XlvYVv_byssSC9y0FuDAryctCXBXrVZCD9PbDQ3dSKjCyQRUJ_pn0mcUTQtUcsqOBu7SzpbudMSWwG5qnWC39KpYvZ5kKS2OfyNAGthEfbeZlhBjN-4zVQm7v8iE9-1JXPDGcINofG8kf_uc Sep 23 04:45:08.560649 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:45:08.560649 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:45:08.560649 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:45:08.560649 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:45:08.560649 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:45:08.560649 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:45:08.560649 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: d22fd8f3b0334cb3b1af66cf626422fe Sep 23 04:45:08.560649 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 Sep 23 04:45:08.560649 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:45:08.560649 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:45:08.560649 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d22fd8f3b0334cb3b1af66cf626422fe", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d22fd8f3b0334cb3b1af66cf626422fe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d22fd8f3b0334cb3b1af66cf626422fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d22fd8f3b0334cb3b1af66cf626422fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:45:08.560649 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 Sep 23 04:45:08.560649 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: d22fd8f3b0334cb3b1af66cf626422fe Sep 23 04:45:08.560649 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 Sep 23 04:45:08.560649 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project Sep 23 04:45:08.560649 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:45:08.560649 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:45:08.560649 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: d0c53d79930a4eaf9fcf7cd10707fbf3 Sep 23 04:45:08.560649 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project Sep 23 04:45:08.560649 n-d-846463-3 devstack@n-api.service[122699]: Sep 23 04:45:08.560649 n-d-846463-3 devstack@n-api.service[122699]: {"addFloatingIp": {"address": "0.0.0.0"}} Sep 23 04:45:08.560649 n-d-846463-3 devstack@n-api.service[122699]: method: Sep 23 04:45:08.560649 n-d-846463-3 devstack@n-api.service[122699]: exception: floating IP not found Sep 23 04:45:08.560649 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '15e9bc0f-2262-4e2c-9cac-0eca4575943c', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Sep 23 04:45:08.560649 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:45:08.560649 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:45:08.560649 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Sep 23 04:45:08.560649 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Sep 23 04:45:08.560649 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Sep 23 04:45:08.560649 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Sep 23 04:45:08.560649 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2699, in associate_floating_ip Sep 23 04:45:08.560649 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Sep 23 04:45:08.560649 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Sep 23 04:45:08.560649 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Sep 23 04:45:08.560649 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Sep 23 04:45:08.560649 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:45:08.560649 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:45:08.560649 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:45:08.560649 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:45:08.560649 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:45:08.560649 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:45:08.560649 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:45:08.560649 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:45:08.560649 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:45:08.560649 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:45:08.560649 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:45:08.560649 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:45:08.560649 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:45:08.560649 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:45:08.560649 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Sep 23 04:45:08.560649 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 23 04:45:08.560649 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Sep 23 04:45:08.560649 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:45:08.574061 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:45:08.574061 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:45:08.574061 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:45:08.574061 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:45:08.574061 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:45:08.574061 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:45:08.574061 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:45:08.574061 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Sep 23 04:45:08.574061 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:45:08.574061 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d860a635-ea13-404b-94f1-590fe2e1e330 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Returning 404 to user: floating IP not found {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:45:08.574061 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d860a635-ea13-404b-94f1-590fe2e1e330 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] 10.222.0.33 "POST /compute/v2.1/servers/15e9bc0f-2262-4e2c-9cac-0eca4575943c/action" status: 404 len: 67 microversion: 2.1 time: 0.394584 Sep 23 04:45:08.574061 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1653/3224] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:45:08 2022] POST /compute/v2.1/servers/15e9bc0f-2262-4e2c-9cac-0eca4575943c/action => generated 67 bytes in 404 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 23 04:45:08.576718 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-43d64cf2-3c97-4446-91ca-61ced77a60fb tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:45:08.679419 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-9ef28be6-bef4-40e5-a2ed-91f7e2f20e85 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:08.681265 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-43d64cf2-3c97-4446-91ca-61ced77a60fb tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Sep 23 04:45:08.682304 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-43d64cf2-3c97-4446-91ca-61ced77a60fb tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Request method failure captured: Sep 23 04:45:08.682304 n-d-846463-3 devstack@n-api.service[122699]: request: POST /compute/v2.1/servers/15e9bc0f-2262-4e2c-9cac-0eca4575943c/action HTTP/1.1 Sep 23 04:45:08.682304 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:45:08.682304 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:45:08.682304 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:45:08.682304 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 44 Sep 23 04:45:08.682304 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:45:08.682304 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:45:08.682304 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:45:08.682304 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:45:08.682304 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTmPnd6xyvib_sf8QDaEntL9VdzDsB1XlvYVv_byssSC9y0FuDAryctCXBXrVZCD9PbDQ3dSKjCyQRUJ_pn0mcUTQtUcsqOBu7SzpbudMSWwG5qnWC39KpYvZ5kKS2OfyNAGthEfbeZlhBjN-4zVQm7v8iE9-1JXPDGcINofG8kf_uc Sep 23 04:45:08.682304 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:45:08.682304 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:45:08.682304 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:45:08.682304 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:45:08.682304 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:45:08.682304 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:45:08.682304 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: d22fd8f3b0334cb3b1af66cf626422fe Sep 23 04:45:08.682304 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 Sep 23 04:45:08.682304 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:45:08.682304 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:45:08.682304 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d22fd8f3b0334cb3b1af66cf626422fe", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d22fd8f3b0334cb3b1af66cf626422fe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d22fd8f3b0334cb3b1af66cf626422fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d22fd8f3b0334cb3b1af66cf626422fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:45:08.682304 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 Sep 23 04:45:08.682304 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: d22fd8f3b0334cb3b1af66cf626422fe Sep 23 04:45:08.682304 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 Sep 23 04:45:08.682304 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project Sep 23 04:45:08.682304 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:45:08.682304 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:45:08.682304 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: d0c53d79930a4eaf9fcf7cd10707fbf3 Sep 23 04:45:08.682304 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project Sep 23 04:45:08.682304 n-d-846463-3 devstack@n-api.service[122699]: Sep 23 04:45:08.682304 n-d-846463-3 devstack@n-api.service[122699]: {"removeFloatingIp": {"address": "0.0.0.0"}} Sep 23 04:45:08.682304 n-d-846463-3 devstack@n-api.service[122699]: method: Sep 23 04:45:08.682304 n-d-846463-3 devstack@n-api.service[122699]: exception: Floating IP not found for address 0.0.0.0. Sep 23 04:45:08.682304 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '15e9bc0f-2262-4e2c-9cac-0eca4575943c', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Sep 23 04:45:08.682304 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:45:08.682304 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:45:08.682304 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Sep 23 04:45:08.682304 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Sep 23 04:45:08.682304 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2927, in get_instance_id_by_floating_address Sep 23 04:45:08.682304 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Sep 23 04:45:08.682304 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Sep 23 04:45:08.682304 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Sep 23 04:45:08.682304 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Sep 23 04:45:08.682304 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:45:08.682304 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:45:08.682304 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:45:08.682304 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:45:08.682304 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:45:08.682304 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:45:08.682304 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:45:08.682304 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:45:08.682304 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:45:08.682304 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:45:08.682304 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:45:08.682304 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:45:08.682304 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:45:08.682304 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:45:08.682304 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Sep 23 04:45:08.682304 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Sep 23 04:45:08.682304 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Sep 23 04:45:08.682304 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Sep 23 04:45:08.688548 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Sep 23 04:45:08.688548 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:45:08.688548 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:45:08.688548 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:45:08.688548 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:45:08.688548 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:45:08.688548 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:45:08.688548 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:45:08.688548 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:45:08.688548 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Sep 23 04:45:08.688548 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:45:08.691826 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-43d64cf2-3c97-4446-91ca-61ced77a60fb tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:45:08.693077 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-43d64cf2-3c97-4446-91ca-61ced77a60fb tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] 10.222.0.33 "POST /compute/v2.1/servers/15e9bc0f-2262-4e2c-9cac-0eca4575943c/action" status: 404 len: 88 microversion: 2.1 time: 0.120401 Sep 23 04:45:08.697881 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1654/3225] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:45:08 2022] POST /compute/v2.1/servers/15e9bc0f-2262-4e2c-9cac-0eca4575943c/action => generated 88 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 23 04:45:08.706402 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9ef28be6-bef4-40e5-a2ed-91f7e2f20e85 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/2c316737-b84f-4b49-a5ab-cc0196b15760" status: 200 len: 1308 microversion: 2.1 time: 0.619515 Sep 23 04:45:08.710157 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1572/3226] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:45:08 2022] GET /compute/v2.1/servers/2c316737-b84f-4b49-a5ab-cc0196b15760 => generated 1308 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:45:08.716180 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b1c657af-ebf2-4e0d-8c12-a09525a8929c tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:08.717448 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b1c657af-ebf2-4e0d-8c12-a09525a8929c tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] [instance: 15e9bc0f-2262-4e2c-9cac-0eca4575943c] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:08.729384 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b1c657af-ebf2-4e0d-8c12-a09525a8929c tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:08.730785 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b1c657af-ebf2-4e0d-8c12-a09525a8929c tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:08.731995 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b1c657af-ebf2-4e0d-8c12-a09525a8929c tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:08.733654 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b1c657af-ebf2-4e0d-8c12-a09525a8929c tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:08.735446 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b1c657af-ebf2-4e0d-8c12-a09525a8929c tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:08.736166 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b1c657af-ebf2-4e0d-8c12-a09525a8929c tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:08.771953 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b1c657af-ebf2-4e0d-8c12-a09525a8929c tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] [instance: 15e9bc0f-2262-4e2c-9cac-0eca4575943c] Going to try to terminate instance {{(pid=122699) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:45:08.795863 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b2806963-c4f4-46e4-9a23-2744c20caa76 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:08.796731 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b2806963-c4f4-46e4-9a23-2744c20caa76 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] [instance: 188a699b-0a1a-46b4-9a03-788af481d3ca] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:08.806981 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:45:08.807234 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b2806963-c4f4-46e4-9a23-2744c20caa76 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:08.809469 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b2806963-c4f4-46e4-9a23-2744c20caa76 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:08.809964 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b2806963-c4f4-46e4-9a23-2744c20caa76 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:08.811985 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b2806963-c4f4-46e4-9a23-2744c20caa76 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:08.813181 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b2806963-c4f4-46e4-9a23-2744c20caa76 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:08.815856 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b2806963-c4f4-46e4-9a23-2744c20caa76 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:08.934616 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=8 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:45:09.112577 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b2806963-c4f4-46e4-9a23-2744c20caa76 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11980041918484990dac709544d0b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c43f2b70bc74a48b62fb4115337f073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:09.122928 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b2806963-c4f4-46e4-9a23-2744c20caa76 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/servers/188a699b-0a1a-46b4-9a03-788af481d3ca" status: 200 len: 1498 microversion: 2.1 time: 0.330846 Sep 23 04:45:09.124073 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1573/3227] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:45:08 2022] GET /compute/v2.1/servers/188a699b-0a1a-46b4-9a03-788af481d3ca => generated 1498 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:45:09.131053 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b575a646-e2f0-4604-8cc5-49d20116ce5e tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:09.132042 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b575a646-e2f0-4604-8cc5-49d20116ce5e tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] [instance: 147e9a2b-507b-4ecf-ae6a-de2f30903108] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:09.139759 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b575a646-e2f0-4604-8cc5-49d20116ce5e tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:09.140630 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b575a646-e2f0-4604-8cc5-49d20116ce5e tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:09.141190 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b575a646-e2f0-4604-8cc5-49d20116ce5e tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:09.142187 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b575a646-e2f0-4604-8cc5-49d20116ce5e tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:09.142722 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b575a646-e2f0-4604-8cc5-49d20116ce5e tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:09.143247 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b575a646-e2f0-4604-8cc5-49d20116ce5e tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:09.176209 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b1c657af-ebf2-4e0d-8c12-a09525a8929c tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] 10.222.0.33 "DELETE /compute/v2.1/servers/15e9bc0f-2262-4e2c-9cac-0eca4575943c" status: 204 len: 0 microversion: 2.1 time: 0.472818 Sep 23 04:45:09.178511 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1655/3228] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:45:08 2022] DELETE /compute/v2.1/servers/15e9bc0f-2262-4e2c-9cac-0eca4575943c => generated 0 bytes in 480 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:45:09.187337 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-83bbfeaa-9cee-4a97-9448-877d49df534f tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:09.188501 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-83bbfeaa-9cee-4a97-9448-877d49df534f tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] [instance: 15e9bc0f-2262-4e2c-9cac-0eca4575943c] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:09.205368 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-83bbfeaa-9cee-4a97-9448-877d49df534f tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:09.209503 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-83bbfeaa-9cee-4a97-9448-877d49df534f tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:09.209503 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-83bbfeaa-9cee-4a97-9448-877d49df534f tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:09.212663 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-83bbfeaa-9cee-4a97-9448-877d49df534f tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:09.213875 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-83bbfeaa-9cee-4a97-9448-877d49df534f tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:09.214614 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-83bbfeaa-9cee-4a97-9448-877d49df534f tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:09.558891 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b575a646-e2f0-4604-8cc5-49d20116ce5e tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f455e9897223404cac3033250226fbc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f623171eb84310b4297ad6ba269c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:09.570511 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b575a646-e2f0-4604-8cc5-49d20116ce5e tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] 10.222.0.33 "GET /compute/v2.1/servers/147e9a2b-507b-4ecf-ae6a-de2f30903108" status: 200 len: 1323 microversion: 2.1 time: 0.444637 Sep 23 04:45:09.587355 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1574/3229] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:45:09 2022] GET /compute/v2.1/servers/147e9a2b-507b-4ecf-ae6a-de2f30903108 => generated 1323 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:45:09.644257 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-83bbfeaa-9cee-4a97-9448-877d49df534f tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c53d79930a4eaf9fcf7cd10707fbf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22fd8f3b0334cb3b1af66cf626422fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:09.657745 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-83bbfeaa-9cee-4a97-9448-877d49df534f tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] 10.222.0.33 "GET /compute/v2.1/servers/15e9bc0f-2262-4e2c-9cac-0eca4575943c" status: 200 len: 1542 microversion: 2.1 time: 0.473788 Sep 23 04:45:09.662783 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1656/3230] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:45:09 2022] GET /compute/v2.1/servers/15e9bc0f-2262-4e2c-9cac-0eca4575943c => generated 1542 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:45:09.735407 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7e28a1b8-9347-41c8-9927-eba58b76d3bb tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:09.736412 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7e28a1b8-9347-41c8-9927-eba58b76d3bb tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 2c316737-b84f-4b49-a5ab-cc0196b15760] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:09.743409 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7e28a1b8-9347-41c8-9927-eba58b76d3bb tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:09.745121 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7e28a1b8-9347-41c8-9927-eba58b76d3bb tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:09.745853 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7e28a1b8-9347-41c8-9927-eba58b76d3bb tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:09.747515 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7e28a1b8-9347-41c8-9927-eba58b76d3bb tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:09.748232 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7e28a1b8-9347-41c8-9927-eba58b76d3bb tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:09.749118 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7e28a1b8-9347-41c8-9927-eba58b76d3bb tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:10.037983 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-7e28a1b8-9347-41c8-9927-eba58b76d3bb tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:10.047851 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7e28a1b8-9347-41c8-9927-eba58b76d3bb tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/2c316737-b84f-4b49-a5ab-cc0196b15760" status: 200 len: 1308 microversion: 2.1 time: 0.319224 Sep 23 04:45:10.060793 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1575/3231] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:45:09 2022] GET /compute/v2.1/servers/2c316737-b84f-4b49-a5ab-cc0196b15760 => generated 1308 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:45:10.116079 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-4c0b8e13-9eb6-4c44-a481-4b038d82020c req-81db4461-3ed9-4100-b812-48b7b54aeb62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c316737-b84f-4b49-a5ab-cc0196b15760", "name": "network-vif-plugged", "status": "completed", "tag": "fc3e1dd8-4c97-4525-a268-cb6993ddf935"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:45:10.126451 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-4c0b8e13-9eb6-4c44-a481-4b038d82020c req-81db4461-3ed9-4100-b812-48b7b54aeb62 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:10.127431 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-4c0b8e13-9eb6-4c44-a481-4b038d82020c req-81db4461-3ed9-4100-b812-48b7b54aeb62 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:10.128096 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-4c0b8e13-9eb6-4c44-a481-4b038d82020c req-81db4461-3ed9-4100-b812-48b7b54aeb62 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:10.140930 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-4c0b8e13-9eb6-4c44-a481-4b038d82020c req-81db4461-3ed9-4100-b812-48b7b54aeb62 service nova] Creating event network-vif-plugged:fc3e1dd8-4c97-4525-a268-cb6993ddf935 for instance 2c316737-b84f-4b49-a5ab-cc0196b15760 on n-h1-846463-3 Sep 23 04:45:10.149094 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2eddebb0-99cb-478b-b3f9-b07bb1bd429d tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:10.150373 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-2eddebb0-99cb-478b-b3f9-b07bb1bd429d tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] [instance: 188a699b-0a1a-46b4-9a03-788af481d3ca] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:10.159736 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2eddebb0-99cb-478b-b3f9-b07bb1bd429d tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:10.160679 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2eddebb0-99cb-478b-b3f9-b07bb1bd429d tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:10.163183 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-4c0b8e13-9eb6-4c44-a481-4b038d82020c req-81db4461-3ed9-4100-b812-48b7b54aeb62 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051138 Sep 23 04:45:10.163923 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2eddebb0-99cb-478b-b3f9-b07bb1bd429d tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:10.164886 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2eddebb0-99cb-478b-b3f9-b07bb1bd429d tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:10.165579 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2eddebb0-99cb-478b-b3f9-b07bb1bd429d tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:10.167095 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2eddebb0-99cb-478b-b3f9-b07bb1bd429d tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:10.168097 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1657/3232] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:45:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:45:10.598075 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f677d3f9-4950-4347-943e-032fc5d34f33 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:10.598075 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f677d3f9-4950-4347-943e-032fc5d34f33 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] [instance: 147e9a2b-507b-4ecf-ae6a-de2f30903108] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:10.604337 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f677d3f9-4950-4347-943e-032fc5d34f33 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:10.604868 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-2eddebb0-99cb-478b-b3f9-b07bb1bd429d tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11980041918484990dac709544d0b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c43f2b70bc74a48b62fb4115337f073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:10.605478 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f677d3f9-4950-4347-943e-032fc5d34f33 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:10.606149 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f677d3f9-4950-4347-943e-032fc5d34f33 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:10.607078 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f677d3f9-4950-4347-943e-032fc5d34f33 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:10.607738 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f677d3f9-4950-4347-943e-032fc5d34f33 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:10.608574 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f677d3f9-4950-4347-943e-032fc5d34f33 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:10.624516 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2eddebb0-99cb-478b-b3f9-b07bb1bd429d tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/servers/188a699b-0a1a-46b4-9a03-788af481d3ca" status: 200 len: 1498 microversion: 2.1 time: 0.473636 Sep 23 04:45:10.624516 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1576/3233] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:45:10 2022] GET /compute/v2.1/servers/188a699b-0a1a-46b4-9a03-788af481d3ca => generated 1498 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:45:10.683966 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9bab25d5-0379-453c-992f-e77b4f1bc8c3 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:10.684830 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-9bab25d5-0379-453c-992f-e77b4f1bc8c3 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] [instance: 15e9bc0f-2262-4e2c-9cac-0eca4575943c] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:10.698819 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9bab25d5-0379-453c-992f-e77b4f1bc8c3 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:10.699836 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9bab25d5-0379-453c-992f-e77b4f1bc8c3 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:10.700518 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9bab25d5-0379-453c-992f-e77b4f1bc8c3 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:10.702251 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9bab25d5-0379-453c-992f-e77b4f1bc8c3 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:10.704273 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9bab25d5-0379-453c-992f-e77b4f1bc8c3 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:10.705330 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9bab25d5-0379-453c-992f-e77b4f1bc8c3 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:10.712486 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:45:11.333564 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f677d3f9-4950-4347-943e-032fc5d34f33 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f455e9897223404cac3033250226fbc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f623171eb84310b4297ad6ba269c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:11.345807 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f677d3f9-4950-4347-943e-032fc5d34f33 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] 10.222.0.33 "GET /compute/v2.1/servers/147e9a2b-507b-4ecf-ae6a-de2f30903108" status: 200 len: 1519 microversion: 2.1 time: 0.756198 Sep 23 04:45:11.359123 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1658/3234] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:45:10 2022] GET /compute/v2.1/servers/147e9a2b-507b-4ecf-ae6a-de2f30903108 => generated 1519 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:45:11.378092 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4b795a4e-d51c-43b1-a44e-9e27d43bb691 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:11.399526 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4b795a4e-d51c-43b1-a44e-9e27d43bb691 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 2c316737-b84f-4b49-a5ab-cc0196b15760] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:11.417269 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4b795a4e-d51c-43b1-a44e-9e27d43bb691 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:11.417687 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4b795a4e-d51c-43b1-a44e-9e27d43bb691 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:11.418222 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4b795a4e-d51c-43b1-a44e-9e27d43bb691 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:11.421943 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-9bab25d5-0379-453c-992f-e77b4f1bc8c3 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c53d79930a4eaf9fcf7cd10707fbf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22fd8f3b0334cb3b1af66cf626422fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:11.435525 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9bab25d5-0379-453c-992f-e77b4f1bc8c3 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] 10.222.0.33 "GET /compute/v2.1/servers/15e9bc0f-2262-4e2c-9cac-0eca4575943c" status: 200 len: 1542 microversion: 2.1 time: 0.756546 Sep 23 04:45:11.437315 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1577/3235] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:45:10 2022] GET /compute/v2.1/servers/15e9bc0f-2262-4e2c-9cac-0eca4575943c => generated 1542 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:45:11.450807 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4b795a4e-d51c-43b1-a44e-9e27d43bb691 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:11.450807 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4b795a4e-d51c-43b1-a44e-9e27d43bb691 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:11.450807 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4b795a4e-d51c-43b1-a44e-9e27d43bb691 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:11.617984 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-74c063e8-5249-43f6-968f-656584ba8a2c tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-795304674", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "f7c3489b-0a72-4837-812a-886bdac58946"}]}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:45:11.623226 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-74c063e8-5249-43f6-968f-656584ba8a2c tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Request method failure captured: Sep 23 04:45:11.623226 n-d-846463-3 devstack@n-api.service[122698]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 23 04:45:11.623226 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:45:11.623226 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:45:11.623226 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:45:11.623226 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 242 Sep 23 04:45:11.623226 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:45:11.623226 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:45:11.623226 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:45:11.623226 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:45:11.623226 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTm-ym8hKl35z0_or5NGLmrSKoptm5PEIY64Kx7SPYE6G_rcJvuM5uum9i42rHD7QtxuVtZN58b30AqdTJsFA0a18oafox1NI6E6ieyGQ22kp5xrc7vTDFHkvvOW2DiX87WJfKdge50Q9ZLEnROa4pijJzreryqA5jO4rEuCU-G7oBw Sep 23 04:45:11.623226 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:45:11.623226 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:45:11.623226 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:45:11.623226 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:45:11.623226 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:45:11.623226 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:45:11.623226 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: c9f623171eb84310b4297ad6ba269c54 Sep 23 04:45:11.623226 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-852991410 Sep 23 04:45:11.623226 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:45:11.623226 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:45:11.623226 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c9f623171eb84310b4297ad6ba269c54", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c9f623171eb84310b4297ad6ba269c54"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c9f623171eb84310b4297ad6ba269c54"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c9f623171eb84310b4297ad6ba269c54"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:45:11.623226 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-852991410 Sep 23 04:45:11.623226 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: c9f623171eb84310b4297ad6ba269c54 Sep 23 04:45:11.623226 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-852991410 Sep 23 04:45:11.623226 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ServerMetadataNegativeTestJSON-852991410-project Sep 23 04:45:11.623226 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:45:11.623226 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:45:11.623226 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: f455e9897223404cac3033250226fbc0 Sep 23 04:45:11.623226 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-852991410-project Sep 23 04:45:11.623226 n-d-846463-3 devstack@n-api.service[122698]: Sep 23 04:45:11.623226 n-d-846463-3 devstack@n-api.service[122698]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-795304674", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "f7c3489b-0a72-4837-812a-886bdac58946"}]}} Sep 23 04:45:11.623226 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:45:11.623226 n-d-846463-3 devstack@n-api.service[122698]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 23 04:45:11.623226 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-795304674', 'imageRef': 'b8dd79b9-f0b9-43a9-9605-17244137c0ee', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': 'f7c3489b-0a72-4837-812a-886bdac58946'}]}}} Sep 23 04:45:11.623226 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:45:11.623226 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:45:11.623226 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 23 04:45:11.623226 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 23 04:45:11.623226 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 23 04:45:11.623226 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise error Sep 23 04:45:11.623226 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 23 04:45:11.623226 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:45:11.623226 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 23 04:45:11.623226 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 23 04:45:11.623226 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 23 04:45:11.623226 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 23 04:45:11.623226 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 23 04:45:11.623226 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:45:11.623226 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 23 04:45:11.623226 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi {'': 'data1'} Sep 23 04:45:11.623226 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:45:11.623226 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:45:11.623226 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:45:11.623226 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:45:11.623226 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:45:11.623226 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:45:11.623226 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:45:11.623226 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:45:11.623226 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:45:11.623226 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:45:11.623226 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:45:11.623226 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:45:11.629755 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 23 04:45:11.629755 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 23 04:45:11.629755 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 23 04:45:11.629755 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 23 04:45:11.629755 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 23 04:45:11.629755 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 23 04:45:11.629755 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 23 04:45:11.629755 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:45:11.629755 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:45:11.629755 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:45:11.629755 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:45:11.629755 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:45:11.629755 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:45:11.629755 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 23 04:45:11.629755 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 23 04:45:11.629755 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 23 04:45:11.629755 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:45:11.629755 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-74c063e8-5249-43f6-968f-656584ba8a2c tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:45:11.629755 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-74c063e8-5249-43f6-968f-656584ba8a2c tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.011587 Sep 23 04:45:11.629755 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1578/3236] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:45:11 2022] POST /compute/v2.1/servers => generated 175 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 23 04:45:11.645878 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9fd1d089-61ea-4d05-ba74-9e0ca880da7f tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:11.650878 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-9fd1d089-61ea-4d05-ba74-9e0ca880da7f tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] [instance: 5236e43a-1393-4215-8b19-b8b3ee5670a8] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:11.678898 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-9fd1d089-61ea-4d05-ba74-9e0ca880da7f tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] HTTP exception thrown: Instance 5236e43a-1393-4215-8b19-b8b3ee5670a8 could not be found. Sep 23 04:45:11.693139 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9fd1d089-61ea-4d05-ba74-9e0ca880da7f tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Request method failure captured: Sep 23 04:45:11.693139 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/5236e43a-1393-4215-8b19-b8b3ee5670a8/metadata HTTP/1.1 Sep 23 04:45:11.693139 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:45:11.693139 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:45:11.693139 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:45:11.693139 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:45:11.693139 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:45:11.693139 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:45:11.693139 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:45:11.693139 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:45:11.693139 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTm-ym8hKl35z0_or5NGLmrSKoptm5PEIY64Kx7SPYE6G_rcJvuM5uum9i42rHD7QtxuVtZN58b30AqdTJsFA0a18oafox1NI6E6ieyGQ22kp5xrc7vTDFHkvvOW2DiX87WJfKdge50Q9ZLEnROa4pijJzreryqA5jO4rEuCU-G7oBw Sep 23 04:45:11.693139 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:45:11.693139 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:45:11.693139 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:45:11.693139 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:45:11.693139 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:45:11.693139 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:45:11.693139 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: c9f623171eb84310b4297ad6ba269c54 Sep 23 04:45:11.693139 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-852991410 Sep 23 04:45:11.693139 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:45:11.693139 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:45:11.693139 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c9f623171eb84310b4297ad6ba269c54", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c9f623171eb84310b4297ad6ba269c54"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c9f623171eb84310b4297ad6ba269c54"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c9f623171eb84310b4297ad6ba269c54"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:45:11.693139 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-852991410 Sep 23 04:45:11.693139 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: c9f623171eb84310b4297ad6ba269c54 Sep 23 04:45:11.693139 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-852991410 Sep 23 04:45:11.693139 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ServerMetadataNegativeTestJSON-852991410-project Sep 23 04:45:11.693139 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:45:11.693139 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:45:11.693139 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: f455e9897223404cac3033250226fbc0 Sep 23 04:45:11.693139 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-852991410-project Sep 23 04:45:11.693139 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:45:11.693139 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 5236e43a-1393-4215-8b19-b8b3ee5670a8 could not be found. Sep 23 04:45:11.693139 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'server_id': '5236e43a-1393-4215-8b19-b8b3ee5670a8'} Sep 23 04:45:11.693139 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:45:11.693139 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:45:11.693139 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:45:11.693139 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:45:11.693139 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:45:11.693139 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:45:11.693139 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 23 04:45:11.693139 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 23 04:45:11.693139 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5236e43a-1393-4215-8b19-b8b3ee5670a8 could not be found. Sep 23 04:45:11.693139 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:45:11.693139 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:45:11.693139 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:45:11.693139 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:45:11.693139 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:45:11.693139 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:45:11.693139 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:45:11.693139 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:45:11.693139 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:45:11.693139 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:45:11.693139 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Sep 23 04:45:11.693139 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Sep 23 04:45:11.693139 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:45:11.693139 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:45:11.693139 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5236e43a-1393-4215-8b19-b8b3ee5670a8 could not be found. Sep 23 04:45:11.693139 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:45:11.693139 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:45:11.693139 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:45:11.693139 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:45:11.693139 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:45:11.693139 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:45:11.698351 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:45:11.698351 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:45:11.698351 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5236e43a-1393-4215-8b19-b8b3ee5670a8 could not be found. Sep 23 04:45:11.698351 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:45:11.698351 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9fd1d089-61ea-4d05-ba74-9e0ca880da7f tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Returning 404 to user: Instance 5236e43a-1393-4215-8b19-b8b3ee5670a8 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:45:11.698351 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9fd1d089-61ea-4d05-ba74-9e0ca880da7f tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] 10.222.0.33 "GET /compute/v2.1/servers/5236e43a-1393-4215-8b19-b8b3ee5670a8/metadata" status: 404 len: 111 microversion: 2.1 time: 0.059611 Sep 23 04:45:11.698351 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1579/3237] 10.222.0.33 () {58 vars in 1263 bytes} [Fri Sep 23 04:45:11 2022] GET /compute/v2.1/servers/5236e43a-1393-4215-8b19-b8b3ee5670a8/metadata => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:45:11.712300 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9786f542-4a53-4e9e-ae4f-82db281d3035 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:11.712928 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-9786f542-4a53-4e9e-ae4f-82db281d3035 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] [instance: 188a699b-0a1a-46b4-9a03-788af481d3ca] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:11.733250 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9786f542-4a53-4e9e-ae4f-82db281d3035 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:11.733755 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9786f542-4a53-4e9e-ae4f-82db281d3035 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:11.736702 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9786f542-4a53-4e9e-ae4f-82db281d3035 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:11.737630 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9786f542-4a53-4e9e-ae4f-82db281d3035 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:11.742303 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9786f542-4a53-4e9e-ae4f-82db281d3035 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:11.743206 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9786f542-4a53-4e9e-ae4f-82db281d3035 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:12.361845 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-4b795a4e-d51c-43b1-a44e-9e27d43bb691 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:12.376403 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4b795a4e-d51c-43b1-a44e-9e27d43bb691 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/2c316737-b84f-4b49-a5ab-cc0196b15760" status: 200 len: 1308 microversion: 2.1 time: 1.015784 Sep 23 04:45:12.392851 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1659/3238] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:45:11 2022] GET /compute/v2.1/servers/2c316737-b84f-4b49-a5ab-cc0196b15760 => generated 1308 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:45:12.417910 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-77ec6f66-8ec3-4a7d-ab3d-388c32368bcc tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1051005749", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "f7c3489b-0a72-4837-812a-886bdac58946"}]}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:45:12.417910 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-77ec6f66-8ec3-4a7d-ab3d-388c32368bcc tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Request method failure captured: Sep 23 04:45:12.417910 n-d-846463-3 devstack@n-api.service[122699]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 23 04:45:12.417910 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:45:12.417910 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:45:12.417910 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:45:12.417910 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 499 Sep 23 04:45:12.417910 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:45:12.417910 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:45:12.417910 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:45:12.417910 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:45:12.417910 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTm-ym8hKl35z0_or5NGLmrSKoptm5PEIY64Kx7SPYE6G_rcJvuM5uum9i42rHD7QtxuVtZN58b30AqdTJsFA0a18oafox1NI6E6ieyGQ22kp5xrc7vTDFHkvvOW2DiX87WJfKdge50Q9ZLEnROa4pijJzreryqA5jO4rEuCU-G7oBw Sep 23 04:45:12.417910 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:45:12.417910 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:45:12.417910 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:45:12.417910 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:45:12.417910 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:45:12.417910 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:45:12.417910 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: c9f623171eb84310b4297ad6ba269c54 Sep 23 04:45:12.417910 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-852991410 Sep 23 04:45:12.417910 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:45:12.417910 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:45:12.417910 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c9f623171eb84310b4297ad6ba269c54", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c9f623171eb84310b4297ad6ba269c54"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c9f623171eb84310b4297ad6ba269c54"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c9f623171eb84310b4297ad6ba269c54"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:45:12.417910 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-852991410 Sep 23 04:45:12.417910 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: c9f623171eb84310b4297ad6ba269c54 Sep 23 04:45:12.417910 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-852991410 Sep 23 04:45:12.417910 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ServerMetadataNegativeTestJSON-852991410-project Sep 23 04:45:12.417910 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:45:12.417910 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:45:12.417910 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: f455e9897223404cac3033250226fbc0 Sep 23 04:45:12.417910 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-852991410-project Sep 23 04:45:12.417910 n-d-846463-3 devstack@n-api.service[122699]: Sep 23 04:45:12.417910 n-d-846463-3 devstack@n-api.service[122699]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1051005749", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "f7c3489b-0a72-4837-812a-886bdac58946"}]}} Sep 23 04:45:12.417910 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:45:12.417910 n-d-846463-3 devstack@n-api.service[122699]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 23 04:45:12.417910 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1051005749', 'imageRef': 'b8dd79b9-f0b9-43a9-9605-17244137c0ee', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'f7c3489b-0a72-4837-812a-886bdac58946'}]}}} Sep 23 04:45:12.417910 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:45:12.417910 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:45:12.417910 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 23 04:45:12.417910 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 23 04:45:12.417910 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 23 04:45:12.421355 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise error Sep 23 04:45:12.421355 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 23 04:45:12.421355 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:45:12.421355 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 23 04:45:12.421355 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 23 04:45:12.421355 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 23 04:45:12.421355 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 23 04:45:12.421355 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 23 04:45:12.421355 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:45:12.421355 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 23 04:45:12.421355 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Sep 23 04:45:12.421355 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:45:12.421355 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:45:12.421355 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:45:12.421355 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:45:12.421355 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:45:12.421355 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:45:12.421355 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:45:12.421355 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:45:12.421355 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:45:12.421355 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:45:12.421355 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:45:12.421355 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:45:12.421355 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 23 04:45:12.421355 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 23 04:45:12.421355 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 23 04:45:12.421355 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 23 04:45:12.421355 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 23 04:45:12.421355 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 23 04:45:12.421355 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 23 04:45:12.421355 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:45:12.421355 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:45:12.421355 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:45:12.421355 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:45:12.421355 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:45:12.421355 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:45:12.421355 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 23 04:45:12.421355 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 23 04:45:12.421355 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 23 04:45:12.421355 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:45:12.424693 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-77ec6f66-8ec3-4a7d-ab3d-388c32368bcc tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:45:12.424693 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-77ec6f66-8ec3-4a7d-ab3d-388c32368bcc tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.018819 Sep 23 04:45:12.429918 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1660/3239] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:45:12 2022] POST /compute/v2.1/servers => generated 687 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 04:45:12.466347 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-31be4564-8cbb-4415-9d12-b7da36037109 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:12.467248 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-31be4564-8cbb-4415-9d12-b7da36037109 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] [instance: 15e9bc0f-2262-4e2c-9cac-0eca4575943c] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:12.492708 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-31be4564-8cbb-4415-9d12-b7da36037109 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:12.492708 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-31be4564-8cbb-4415-9d12-b7da36037109 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:12.492708 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-31be4564-8cbb-4415-9d12-b7da36037109 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:12.492708 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-31be4564-8cbb-4415-9d12-b7da36037109 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:12.492708 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-31be4564-8cbb-4415-9d12-b7da36037109 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:12.492708 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-31be4564-8cbb-4415-9d12-b7da36037109 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:12.936342 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-31be4564-8cbb-4415-9d12-b7da36037109 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c53d79930a4eaf9fcf7cd10707fbf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22fd8f3b0334cb3b1af66cf626422fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:12.938401 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-9786f542-4a53-4e9e-ae4f-82db281d3035 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11980041918484990dac709544d0b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c43f2b70bc74a48b62fb4115337f073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:12.958054 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9786f542-4a53-4e9e-ae4f-82db281d3035 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/servers/188a699b-0a1a-46b4-9a03-788af481d3ca" status: 200 len: 1498 microversion: 2.1 time: 1.261155 Sep 23 04:45:12.982551 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1580/3240] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:45:11 2022] GET /compute/v2.1/servers/188a699b-0a1a-46b4-9a03-788af481d3ca => generated 1498 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:45:12.984108 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-31be4564-8cbb-4415-9d12-b7da36037109 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] 10.222.0.33 "GET /compute/v2.1/servers/15e9bc0f-2262-4e2c-9cac-0eca4575943c" status: 200 len: 1500 microversion: 2.1 time: 0.517728 Sep 23 04:45:12.986211 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1661/3241] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:45:12 2022] GET /compute/v2.1/servers/15e9bc0f-2262-4e2c-9cac-0eca4575943c => generated 1500 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:45:12.994252 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-13374525-ca17-4cf9-94d0-a330b4e5f22c tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-732987868", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "f7c3489b-0a72-4837-812a-886bdac58946"}]}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:45:12.999632 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-13374525-ca17-4cf9-94d0-a330b4e5f22c tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Request method failure captured: Sep 23 04:45:12.999632 n-d-846463-3 devstack@n-api.service[122698]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 23 04:45:12.999632 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:45:12.999632 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:45:12.999632 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:45:12.999632 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 499 Sep 23 04:45:12.999632 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:45:12.999632 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:45:12.999632 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:45:12.999632 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:45:12.999632 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTm-ym8hKl35z0_or5NGLmrSKoptm5PEIY64Kx7SPYE6G_rcJvuM5uum9i42rHD7QtxuVtZN58b30AqdTJsFA0a18oafox1NI6E6ieyGQ22kp5xrc7vTDFHkvvOW2DiX87WJfKdge50Q9ZLEnROa4pijJzreryqA5jO4rEuCU-G7oBw Sep 23 04:45:12.999632 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:45:12.999632 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:45:12.999632 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:45:12.999632 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:45:12.999632 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:45:12.999632 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:45:12.999632 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: c9f623171eb84310b4297ad6ba269c54 Sep 23 04:45:12.999632 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-852991410 Sep 23 04:45:12.999632 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:45:12.999632 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:45:12.999632 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c9f623171eb84310b4297ad6ba269c54", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c9f623171eb84310b4297ad6ba269c54"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c9f623171eb84310b4297ad6ba269c54"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c9f623171eb84310b4297ad6ba269c54"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:45:12.999632 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-852991410 Sep 23 04:45:12.999632 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: c9f623171eb84310b4297ad6ba269c54 Sep 23 04:45:12.999632 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-852991410 Sep 23 04:45:12.999632 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ServerMetadataNegativeTestJSON-852991410-project Sep 23 04:45:12.999632 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:45:12.999632 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:45:12.999632 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: f455e9897223404cac3033250226fbc0 Sep 23 04:45:12.999632 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-852991410-project Sep 23 04:45:12.999632 n-d-846463-3 devstack@n-api.service[122698]: Sep 23 04:45:12.999632 n-d-846463-3 devstack@n-api.service[122698]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-732987868", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "f7c3489b-0a72-4837-812a-886bdac58946"}]}} Sep 23 04:45:12.999632 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:45:12.999632 n-d-846463-3 devstack@n-api.service[122698]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 23 04:45:12.999632 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-732987868', 'imageRef': 'b8dd79b9-f0b9-43a9-9605-17244137c0ee', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'f7c3489b-0a72-4837-812a-886bdac58946'}]}}} Sep 23 04:45:12.999632 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:45:12.999632 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:45:12.999632 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 23 04:45:12.999632 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 23 04:45:12.999632 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 23 04:45:12.999632 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise error Sep 23 04:45:12.999632 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 23 04:45:12.999632 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:45:12.999632 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 23 04:45:12.999632 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 23 04:45:12.999632 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 23 04:45:12.999632 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 23 04:45:13.003398 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 23 04:45:13.003398 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:45:13.003398 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 23 04:45:13.003398 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Sep 23 04:45:13.003398 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:45:13.003398 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:45:13.003398 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:45:13.003398 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:45:13.003398 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:45:13.003398 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:45:13.003398 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:45:13.003398 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:45:13.003398 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:45:13.003398 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:45:13.003398 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:45:13.003398 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:45:13.003398 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 23 04:45:13.003398 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 23 04:45:13.003398 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 23 04:45:13.003398 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 23 04:45:13.003398 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 23 04:45:13.003398 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 23 04:45:13.003398 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 23 04:45:13.003398 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:45:13.003398 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:45:13.003398 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:45:13.003398 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:45:13.003398 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:45:13.003398 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:45:13.003398 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 23 04:45:13.003398 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 23 04:45:13.003398 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 23 04:45:13.003398 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:45:13.008985 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-13374525-ca17-4cf9-94d0-a330b4e5f22c tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:45:13.014239 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-13374525-ca17-4cf9-94d0-a330b4e5f22c tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.030455 Sep 23 04:45:13.017837 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1581/3242] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:45:12 2022] POST /compute/v2.1/servers => generated 689 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 04:45:13.076457 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ff7268bf-712d-4d41-9803-b6afc1de5c8f tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1911921358", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "f7c3489b-0a72-4837-812a-886bdac58946"}]}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:45:13.081871 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ff7268bf-712d-4d41-9803-b6afc1de5c8f tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Request method failure captured: Sep 23 04:45:13.081871 n-d-846463-3 devstack@n-api.service[122699]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 23 04:45:13.081871 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:45:13.081871 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:45:13.081871 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:45:13.081871 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 754 Sep 23 04:45:13.081871 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:45:13.081871 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:45:13.081871 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:45:13.081871 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:45:13.081871 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTm-ym8hKl35z0_or5NGLmrSKoptm5PEIY64Kx7SPYE6G_rcJvuM5uum9i42rHD7QtxuVtZN58b30AqdTJsFA0a18oafox1NI6E6ieyGQ22kp5xrc7vTDFHkvvOW2DiX87WJfKdge50Q9ZLEnROa4pijJzreryqA5jO4rEuCU-G7oBw Sep 23 04:45:13.081871 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:45:13.081871 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:45:13.081871 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:45:13.081871 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:45:13.081871 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:45:13.081871 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:45:13.081871 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: c9f623171eb84310b4297ad6ba269c54 Sep 23 04:45:13.081871 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-852991410 Sep 23 04:45:13.081871 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:45:13.081871 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:45:13.081871 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c9f623171eb84310b4297ad6ba269c54", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c9f623171eb84310b4297ad6ba269c54"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c9f623171eb84310b4297ad6ba269c54"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c9f623171eb84310b4297ad6ba269c54"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:45:13.081871 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-852991410 Sep 23 04:45:13.081871 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: c9f623171eb84310b4297ad6ba269c54 Sep 23 04:45:13.081871 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-852991410 Sep 23 04:45:13.081871 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ServerMetadataNegativeTestJSON-852991410-project Sep 23 04:45:13.081871 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:45:13.081871 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:45:13.081871 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: f455e9897223404cac3033250226fbc0 Sep 23 04:45:13.081871 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-852991410-project Sep 23 04:45:13.081871 n-d-846463-3 devstack@n-api.service[122699]: Sep 23 04:45:13.081871 n-d-846463-3 devstack@n-api.service[122699]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1911921358", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "f7c3489b-0a72-4837-812a-886bdac58946"}]}} Sep 23 04:45:13.081871 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:45:13.081871 n-d-846463-3 devstack@n-api.service[122699]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 23 04:45:13.081871 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1911921358', 'imageRef': 'b8dd79b9-f0b9-43a9-9605-17244137c0ee', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'f7c3489b-0a72-4837-812a-886bdac58946'}]}}} Sep 23 04:45:13.081871 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:45:13.081871 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:45:13.081871 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 23 04:45:13.081871 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 23 04:45:13.081871 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 23 04:45:13.092561 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise error Sep 23 04:45:13.092561 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 23 04:45:13.092561 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:45:13.092561 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 23 04:45:13.092561 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 23 04:45:13.092561 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 23 04:45:13.092561 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 23 04:45:13.092561 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 23 04:45:13.092561 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:45:13.092561 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 23 04:45:13.092561 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Sep 23 04:45:13.092561 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:45:13.092561 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:45:13.092561 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:45:13.092561 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:45:13.092561 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:45:13.092561 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:45:13.092561 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:45:13.092561 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:45:13.092561 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:45:13.092561 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:45:13.092561 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:45:13.092561 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:45:13.092561 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 23 04:45:13.092561 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 23 04:45:13.092561 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 23 04:45:13.092561 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 23 04:45:13.092561 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 23 04:45:13.092561 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 23 04:45:13.092561 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 23 04:45:13.092561 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:45:13.092561 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:45:13.092561 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:45:13.092561 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:45:13.092561 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:45:13.092561 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:45:13.092561 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 23 04:45:13.092561 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 23 04:45:13.095031 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 23 04:45:13.095031 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:45:13.095031 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ff7268bf-712d-4d41-9803-b6afc1de5c8f tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:45:13.095031 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ff7268bf-712d-4d41-9803-b6afc1de5c8f tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.011484 Sep 23 04:45:13.095031 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1662/3243] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:45:13 2022] POST /compute/v2.1/servers => generated 1197 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Sep 23 04:45:13.168258 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-03e686b7-6dc8-4978-b79e-7da7f4a5c69b tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-589316118", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "f7c3489b-0a72-4837-812a-886bdac58946"}]}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:45:13.168841 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-3cca5c36-2670-4d1c-b433-4980da7b92fe req-c64dde69-106b-498d-9b0f-63fdc0b0e472 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15e9bc0f-2262-4e2c-9cac-0eca4575943c", "name": "network-vif-deleted", "tag": "c81ebfeb-05fd-445f-bb49-70dc27b6c143"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:45:13.174897 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-03e686b7-6dc8-4978-b79e-7da7f4a5c69b tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Request method failure captured: Sep 23 04:45:13.174897 n-d-846463-3 devstack@n-api.service[122698]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 23 04:45:13.174897 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:45:13.174897 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:45:13.174897 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:45:13.174897 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 1265 Sep 23 04:45:13.174897 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:45:13.174897 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:45:13.174897 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:45:13.174897 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:45:13.174897 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTm-ym8hKl35z0_or5NGLmrSKoptm5PEIY64Kx7SPYE6G_rcJvuM5uum9i42rHD7QtxuVtZN58b30AqdTJsFA0a18oafox1NI6E6ieyGQ22kp5xrc7vTDFHkvvOW2DiX87WJfKdge50Q9ZLEnROa4pijJzreryqA5jO4rEuCU-G7oBw Sep 23 04:45:13.174897 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:45:13.174897 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:45:13.174897 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:45:13.174897 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:45:13.174897 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:45:13.174897 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:45:13.174897 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: c9f623171eb84310b4297ad6ba269c54 Sep 23 04:45:13.174897 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-852991410 Sep 23 04:45:13.174897 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:45:13.174897 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:45:13.174897 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c9f623171eb84310b4297ad6ba269c54", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c9f623171eb84310b4297ad6ba269c54"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c9f623171eb84310b4297ad6ba269c54"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c9f623171eb84310b4297ad6ba269c54"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:45:13.174897 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-852991410 Sep 23 04:45:13.174897 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: c9f623171eb84310b4297ad6ba269c54 Sep 23 04:45:13.174897 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-852991410 Sep 23 04:45:13.174897 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ServerMetadataNegativeTestJSON-852991410-project Sep 23 04:45:13.174897 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:45:13.174897 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:45:13.174897 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: f455e9897223404cac3033250226fbc0 Sep 23 04:45:13.174897 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-852991410-project Sep 23 04:45:13.174897 n-d-846463-3 devstack@n-api.service[122698]: Sep 23 04:45:13.174897 n-d-846463-3 devstack@n-api.service[122698]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-589316118", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "f7c3489b-0a72-4837-812a-886bdac58946"}]}} Sep 23 04:45:13.174897 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:45:13.177189 n-d-846463-3 devstack@n-api.service[122698]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 23 04:45:13.177189 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-589316118', 'imageRef': 'b8dd79b9-f0b9-43a9-9605-17244137c0ee', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'f7c3489b-0a72-4837-812a-886bdac58946'}]}}} Sep 23 04:45:13.177189 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:45:13.177189 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:45:13.177189 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 23 04:45:13.177189 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 23 04:45:13.177189 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 23 04:45:13.177189 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise error Sep 23 04:45:13.177189 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 23 04:45:13.177189 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:45:13.177189 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 23 04:45:13.177189 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 23 04:45:13.177189 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 23 04:45:13.177189 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 23 04:45:13.177189 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 23 04:45:13.177189 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:45:13.177189 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 23 04:45:13.178637 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Sep 23 04:45:13.178637 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:45:13.178637 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:45:13.178637 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:45:13.178637 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:45:13.178637 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:45:13.178637 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:45:13.178637 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:45:13.178637 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:45:13.178637 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:45:13.178637 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:45:13.178637 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:45:13.178637 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:45:13.178637 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 23 04:45:13.178637 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 23 04:45:13.178637 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 23 04:45:13.178637 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 23 04:45:13.178637 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 23 04:45:13.178637 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 23 04:45:13.178637 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 23 04:45:13.178637 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:45:13.178637 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:45:13.178637 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:45:13.178637 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:45:13.178637 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:45:13.178637 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:45:13.178637 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 23 04:45:13.178637 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 23 04:45:13.182886 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 23 04:45:13.182886 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:45:13.186710 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-03e686b7-6dc8-4978-b79e-7da7f4a5c69b tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:45:13.188673 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-03e686b7-6dc8-4978-b79e-7da7f4a5c69b tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.027314 Sep 23 04:45:13.189949 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1582/3244] 10.222.0.33 () {60 vars in 1148 bytes} [Fri Sep 23 04:45:13 2022] POST /compute/v2.1/servers => generated 2221 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Sep 23 04:45:13.192478 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-3cca5c36-2670-4d1c-b433-4980da7b92fe req-c64dde69-106b-498d-9b0f-63fdc0b0e472 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:13.192971 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-3cca5c36-2670-4d1c-b433-4980da7b92fe req-c64dde69-106b-498d-9b0f-63fdc0b0e472 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:13.193401 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-3cca5c36-2670-4d1c-b433-4980da7b92fe req-c64dde69-106b-498d-9b0f-63fdc0b0e472 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:13.209180 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2dde777b-5cbb-4814-9741-526f46635cfd tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:13.210060 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-2dde777b-5cbb-4814-9741-526f46635cfd tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] [instance: bbc7f646-c34f-4602-a62d-48f7f05102b7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:13.220994 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-3cca5c36-2670-4d1c-b433-4980da7b92fe req-c64dde69-106b-498d-9b0f-63fdc0b0e472 service nova] Creating event network-vif-deleted:c81ebfeb-05fd-445f-bb49-70dc27b6c143 for instance 15e9bc0f-2262-4e2c-9cac-0eca4575943c on n-h2-846463-3 Sep 23 04:45:13.222329 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-2dde777b-5cbb-4814-9741-526f46635cfd tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] HTTP exception thrown: Instance bbc7f646-c34f-4602-a62d-48f7f05102b7 could not be found. Sep 23 04:45:13.224505 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2dde777b-5cbb-4814-9741-526f46635cfd tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Request method failure captured: Sep 23 04:45:13.224505 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/bbc7f646-c34f-4602-a62d-48f7f05102b7/metadata/test2 HTTP/1.1 Sep 23 04:45:13.224505 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:45:13.224505 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:45:13.224505 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:45:13.224505 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:45:13.224505 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:45:13.224505 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:45:13.224505 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:45:13.224505 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:45:13.224505 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTm-ym8hKl35z0_or5NGLmrSKoptm5PEIY64Kx7SPYE6G_rcJvuM5uum9i42rHD7QtxuVtZN58b30AqdTJsFA0a18oafox1NI6E6ieyGQ22kp5xrc7vTDFHkvvOW2DiX87WJfKdge50Q9ZLEnROa4pijJzreryqA5jO4rEuCU-G7oBw Sep 23 04:45:13.224505 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:45:13.224505 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:45:13.224505 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:45:13.224505 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:45:13.224505 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:45:13.224505 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:45:13.224505 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: c9f623171eb84310b4297ad6ba269c54 Sep 23 04:45:13.224505 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-852991410 Sep 23 04:45:13.224505 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:45:13.224505 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:45:13.224505 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c9f623171eb84310b4297ad6ba269c54", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c9f623171eb84310b4297ad6ba269c54"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c9f623171eb84310b4297ad6ba269c54"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c9f623171eb84310b4297ad6ba269c54"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:45:13.224505 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-852991410 Sep 23 04:45:13.224505 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: c9f623171eb84310b4297ad6ba269c54 Sep 23 04:45:13.224505 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-852991410 Sep 23 04:45:13.224505 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ServerMetadataNegativeTestJSON-852991410-project Sep 23 04:45:13.224505 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:45:13.224505 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:45:13.224505 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: f455e9897223404cac3033250226fbc0 Sep 23 04:45:13.224505 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-852991410-project Sep 23 04:45:13.224505 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:45:13.224505 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance bbc7f646-c34f-4602-a62d-48f7f05102b7 could not be found. Sep 23 04:45:13.224505 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'server_id': 'bbc7f646-c34f-4602-a62d-48f7f05102b7', 'id': 'test2'} Sep 23 04:45:13.224505 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:45:13.224505 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:45:13.224505 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:45:13.224505 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:45:13.224505 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:45:13.224505 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:45:13.224505 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 23 04:45:13.224505 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 23 04:45:13.224505 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbc7f646-c34f-4602-a62d-48f7f05102b7 could not be found. Sep 23 04:45:13.224505 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:45:13.224505 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:45:13.224505 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:45:13.224505 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:45:13.224505 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:45:13.224505 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:45:13.224505 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:45:13.224505 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:45:13.224505 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:45:13.224505 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:45:13.224505 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Sep 23 04:45:13.224505 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Sep 23 04:45:13.224505 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:45:13.224505 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:45:13.224505 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbc7f646-c34f-4602-a62d-48f7f05102b7 could not be found. Sep 23 04:45:13.224505 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:45:13.224505 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:45:13.224505 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:45:13.224505 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:45:13.224505 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:45:13.224505 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:45:13.229941 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:45:13.229941 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:45:13.229941 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbc7f646-c34f-4602-a62d-48f7f05102b7 could not be found. Sep 23 04:45:13.229941 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:45:13.232052 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-3cca5c36-2670-4d1c-b433-4980da7b92fe req-c64dde69-106b-498d-9b0f-63fdc0b0e472 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066760 Sep 23 04:45:13.232669 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1663/3245] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:45:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:45:13.247170 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2dde777b-5cbb-4814-9741-526f46635cfd tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Returning 404 to user: Instance bbc7f646-c34f-4602-a62d-48f7f05102b7 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:45:13.252349 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2dde777b-5cbb-4814-9741-526f46635cfd tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] 10.222.0.33 "GET /compute/v2.1/servers/bbc7f646-c34f-4602-a62d-48f7f05102b7/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.044933 Sep 23 04:45:13.253953 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1583/3246] 10.222.0.33 () {58 vars in 1281 bytes} [Fri Sep 23 04:45:13 2022] GET /compute/v2.1/servers/bbc7f646-c34f-4602-a62d-48f7f05102b7/metadata/test2 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:45:13.294172 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1e749674-aa97-46d6-b3cc-1357447bbc6d tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:13.294795 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1e749674-aa97-46d6-b3cc-1357447bbc6d tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] [instance: 147e9a2b-507b-4ecf-ae6a-de2f30903108] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:13.325612 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e749674-aa97-46d6-b3cc-1357447bbc6d tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:13.327129 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e749674-aa97-46d6-b3cc-1357447bbc6d tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:13.327586 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e749674-aa97-46d6-b3cc-1357447bbc6d tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:13.329065 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e749674-aa97-46d6-b3cc-1357447bbc6d tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:13.329704 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e749674-aa97-46d6-b3cc-1357447bbc6d tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:13.330375 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e749674-aa97-46d6-b3cc-1357447bbc6d tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:13.368939 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1e749674-aa97-46d6-b3cc-1357447bbc6d tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] [instance: 147e9a2b-507b-4ecf-ae6a-de2f30903108] Going to try to terminate instance {{(pid=122699) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:45:13.407786 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ce8a8d45-5376-434c-b46f-f315a701a435 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:13.407786 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-ce8a8d45-5376-434c-b46f-f315a701a435 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 2c316737-b84f-4b49-a5ab-cc0196b15760] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:13.409004 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ce8a8d45-5376-434c-b46f-f315a701a435 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:13.409602 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ce8a8d45-5376-434c-b46f-f315a701a435 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:13.410457 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ce8a8d45-5376-434c-b46f-f315a701a435 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:13.411261 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ce8a8d45-5376-434c-b46f-f315a701a435 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:13.414505 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ce8a8d45-5376-434c-b46f-f315a701a435 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:13.415046 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ce8a8d45-5376-434c-b46f-f315a701a435 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:13.662423 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=4,nova_api:UPDATE=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:45:13.766690 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1e749674-aa97-46d6-b3cc-1357447bbc6d tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] 10.222.0.33 "DELETE /compute/v2.1/servers/147e9a2b-507b-4ecf-ae6a-de2f30903108" status: 204 len: 0 microversion: 2.1 time: 0.495975 Sep 23 04:45:13.769152 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1664/3247] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:45:13 2022] DELETE /compute/v2.1/servers/147e9a2b-507b-4ecf-ae6a-de2f30903108 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:45:13.778048 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-307588cd-f8c2-4113-8c81-3edf7758db9f tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:13.779195 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-307588cd-f8c2-4113-8c81-3edf7758db9f tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] [instance: 147e9a2b-507b-4ecf-ae6a-de2f30903108] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:13.781569 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ce8a8d45-5376-434c-b46f-f315a701a435 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:13.792334 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-307588cd-f8c2-4113-8c81-3edf7758db9f tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:13.793622 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-307588cd-f8c2-4113-8c81-3edf7758db9f tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:13.794343 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-307588cd-f8c2-4113-8c81-3edf7758db9f tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:13.795313 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-307588cd-f8c2-4113-8c81-3edf7758db9f tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:13.796712 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-307588cd-f8c2-4113-8c81-3edf7758db9f tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:13.797851 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-307588cd-f8c2-4113-8c81-3edf7758db9f tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:13.799664 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ce8a8d45-5376-434c-b46f-f315a701a435 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/2c316737-b84f-4b49-a5ab-cc0196b15760" status: 200 len: 1488 microversion: 2.1 time: 0.403059 Sep 23 04:45:13.801290 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1584/3248] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:45:13 2022] GET /compute/v2.1/servers/2c316737-b84f-4b49-a5ab-cc0196b15760 => generated 1488 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:45:13.989521 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e571378a-1820-4093-aac2-28a0248272d6 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:13.993667 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e571378a-1820-4093-aac2-28a0248272d6 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] [instance: 188a699b-0a1a-46b4-9a03-788af481d3ca] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:14.007157 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e571378a-1820-4093-aac2-28a0248272d6 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:14.008876 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e571378a-1820-4093-aac2-28a0248272d6 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:14.009343 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e571378a-1820-4093-aac2-28a0248272d6 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:14.011626 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e571378a-1820-4093-aac2-28a0248272d6 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:14.012794 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e571378a-1820-4093-aac2-28a0248272d6 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:14.013243 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e571378a-1820-4093-aac2-28a0248272d6 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:14.026387 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-307588cd-f8c2-4113-8c81-3edf7758db9f tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f455e9897223404cac3033250226fbc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f623171eb84310b4297ad6ba269c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:14.039132 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-307588cd-f8c2-4113-8c81-3edf7758db9f tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] 10.222.0.33 "GET /compute/v2.1/servers/147e9a2b-507b-4ecf-ae6a-de2f30903108" status: 200 len: 1525 microversion: 2.1 time: 0.265820 Sep 23 04:45:14.039756 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1665/3249] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:45:13 2022] GET /compute/v2.1/servers/147e9a2b-507b-4ecf-ae6a-de2f30903108 => generated 1525 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:45:14.050830 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8aa65abb-13a2-4478-8e8c-97893f87111b tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-773675428", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "networks": [{"uuid": "e70e4da0-3337-4af1-b4df-8067d676f5e8"}]}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:45:14.111958 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.neutron [None req-8aa65abb-13a2-4478-8e8c-97893f87111b tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] validate_networks() for [('e70e4da0-3337-4af1-b4df-8067d676f5e8', None, None, None, None, None)] {{(pid=122699) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:45:14.403788 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e571378a-1820-4093-aac2-28a0248272d6 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11980041918484990dac709544d0b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c43f2b70bc74a48b62fb4115337f073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:14.422846 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e571378a-1820-4093-aac2-28a0248272d6 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/servers/188a699b-0a1a-46b4-9a03-788af481d3ca" status: 200 len: 1498 microversion: 2.1 time: 0.436366 Sep 23 04:45:14.423506 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1585/3250] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:45:13 2022] GET /compute/v2.1/servers/188a699b-0a1a-46b4-9a03-788af481d3ca => generated 1498 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:45:14.443263 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8312ac90-4451-43da-af84-c9d74379ed40 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:14.444072 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8312ac90-4451-43da-af84-c9d74379ed40 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] [instance: 15e9bc0f-2262-4e2c-9cac-0eca4575943c] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:14.447633 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:45:14.456664 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8312ac90-4451-43da-af84-c9d74379ed40 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:14.458175 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8312ac90-4451-43da-af84-c9d74379ed40 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:14.458175 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8312ac90-4451-43da-af84-c9d74379ed40 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:14.458522 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8312ac90-4451-43da-af84-c9d74379ed40 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:14.458996 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8312ac90-4451-43da-af84-c9d74379ed40 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:14.459423 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8312ac90-4451-43da-af84-c9d74379ed40 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:14.514312 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8312ac90-4451-43da-af84-c9d74379ed40 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:14.514817 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8312ac90-4451-43da-af84-c9d74379ed40 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:14.515261 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8312ac90-4451-43da-af84-c9d74379ed40 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:14.516253 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-8312ac90-4451-43da-af84-c9d74379ed40 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Lazy-loading 'fault' on Instance uuid 15e9bc0f-2262-4e2c-9cac-0eca4575943c {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:45:14.620535 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8312ac90-4451-43da-af84-c9d74379ed40 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c53d79930a4eaf9fcf7cd10707fbf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22fd8f3b0334cb3b1af66cf626422fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:14.633847 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8312ac90-4451-43da-af84-c9d74379ed40 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] 10.222.0.33 "GET /compute/v2.1/servers/15e9bc0f-2262-4e2c-9cac-0eca4575943c" status: 200 len: 1322 microversion: 2.1 time: 0.208988 Sep 23 04:45:14.644305 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1586/3251] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:45:14 2022] GET /compute/v2.1/servers/15e9bc0f-2262-4e2c-9cac-0eca4575943c => generated 1322 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:45:15.006479 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-8aa65abb-13a2-4478-8e8c-97893f87111b tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Flavor limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:45:15.006965 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-8aa65abb-13a2-4478-8e8c-97893f87111b tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Image limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:45:15.007372 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-8aa65abb-13a2-4478-8e8c-97893f87111b tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Flavor pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:45:15.007784 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-8aa65abb-13a2-4478-8e8c-97893f87111b tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Image pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:45:15.008242 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-8aa65abb-13a2-4478-8e8c-97893f87111b tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:45:15.026695 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8aa65abb-13a2-4478-8e8c-97893f87111b tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:15.027345 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8aa65abb-13a2-4478-8e8c-97893f87111b tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:15.027892 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8aa65abb-13a2-4478-8e8c-97893f87111b tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:15.029072 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8aa65abb-13a2-4478-8e8c-97893f87111b tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:15.029628 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8aa65abb-13a2-4478-8e8c-97893f87111b tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:15.030755 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8aa65abb-13a2-4478-8e8c-97893f87111b tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:15.068118 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d2825d8f-776a-4adc-8e32-cef3f80cdab8 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:15.068705 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-8aa65abb-13a2-4478-8e8c-97893f87111b tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Getting quotas for project c23bd5a8b84942898a99930b2bc0ca12. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:45:15.071220 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d2825d8f-776a-4adc-8e32-cef3f80cdab8 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] [instance: 147e9a2b-507b-4ecf-ae6a-de2f30903108] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:15.079689 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-8aa65abb-13a2-4478-8e8c-97893f87111b tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Getting quotas for user 252c87e244984f71ae0907ee769bec05 and project c23bd5a8b84942898a99930b2bc0ca12. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:45:15.092469 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d2825d8f-776a-4adc-8e32-cef3f80cdab8 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:15.097429 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d2825d8f-776a-4adc-8e32-cef3f80cdab8 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:15.102155 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-8aa65abb-13a2-4478-8e8c-97893f87111b tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Going to run 1 instances... {{(pid=122699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:45:15.105822 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-8aa65abb-13a2-4478-8e8c-97893f87111b tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 27e4cd67-a4b3-440d-81dd-963f6372b385] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:45:15.106139 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d2825d8f-776a-4adc-8e32-cef3f80cdab8 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:15.108133 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d2825d8f-776a-4adc-8e32-cef3f80cdab8 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:15.113249 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d2825d8f-776a-4adc-8e32-cef3f80cdab8 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:15.113866 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d2825d8f-776a-4adc-8e32-cef3f80cdab8 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:15.398364 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-8aa65abb-13a2-4478-8e8c-97893f87111b tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.356605 Sep 23 04:45:15.399367 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1666/3252] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:45:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1359 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:45:15.410928 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-541dce66-00fc-4a1c-ac49-70f9cd4f3c79 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:15.411854 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-541dce66-00fc-4a1c-ac49-70f9cd4f3c79 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 27e4cd67-a4b3-440d-81dd-963f6372b385] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:15.680440 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-541dce66-00fc-4a1c-ac49-70f9cd4f3c79 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:15.695277 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-541dce66-00fc-4a1c-ac49-70f9cd4f3c79 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/27e4cd67-a4b3-440d-81dd-963f6372b385" status: 200 len: 1208 microversion: 2.1 time: 0.288621 Sep 23 04:45:15.702715 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1667/3253] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:45:15 2022] GET /compute/v2.1/servers/27e4cd67-a4b3-440d-81dd-963f6372b385 => generated 1208 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:45:15.709271 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0dcfec0e-c904-40cd-8824-cd9eb92189ba tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:15.710332 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-0dcfec0e-c904-40cd-8824-cd9eb92189ba tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] [instance: 188a699b-0a1a-46b4-9a03-788af481d3ca] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:15.723733 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0dcfec0e-c904-40cd-8824-cd9eb92189ba tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:15.734474 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0dcfec0e-c904-40cd-8824-cd9eb92189ba tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:15.735214 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0dcfec0e-c904-40cd-8824-cd9eb92189ba tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:15.735991 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0dcfec0e-c904-40cd-8824-cd9eb92189ba tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:15.738365 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0dcfec0e-c904-40cd-8824-cd9eb92189ba tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:15.740660 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0dcfec0e-c904-40cd-8824-cd9eb92189ba tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:15.933314 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d2825d8f-776a-4adc-8e32-cef3f80cdab8 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f455e9897223404cac3033250226fbc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f623171eb84310b4297ad6ba269c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:15.943505 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d2825d8f-776a-4adc-8e32-cef3f80cdab8 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] 10.222.0.33 "GET /compute/v2.1/servers/147e9a2b-507b-4ecf-ae6a-de2f30903108" status: 200 len: 1525 microversion: 2.1 time: 0.881200 Sep 23 04:45:15.944110 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1587/3254] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:45:15 2022] GET /compute/v2.1/servers/147e9a2b-507b-4ecf-ae6a-de2f30903108 => generated 1525 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:45:15.956934 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e8c4f931-ca64-4086-80d4-c468811d821c tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:15.957542 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e8c4f931-ca64-4086-80d4-c468811d821c tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] [instance: 15e9bc0f-2262-4e2c-9cac-0eca4575943c] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:15.968360 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e8c4f931-ca64-4086-80d4-c468811d821c tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:15.973146 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e8c4f931-ca64-4086-80d4-c468811d821c tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:15.973826 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e8c4f931-ca64-4086-80d4-c468811d821c tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:15.974756 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e8c4f931-ca64-4086-80d4-c468811d821c tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:15.975375 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e8c4f931-ca64-4086-80d4-c468811d821c tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:15.979607 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e8c4f931-ca64-4086-80d4-c468811d821c tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:15.997710 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-e8c4f931-ca64-4086-80d4-c468811d821c tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] HTTP exception thrown: Instance 15e9bc0f-2262-4e2c-9cac-0eca4575943c could not be found. Sep 23 04:45:15.998532 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e8c4f931-ca64-4086-80d4-c468811d821c tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Request method failure captured: Sep 23 04:45:15.998532 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/15e9bc0f-2262-4e2c-9cac-0eca4575943c HTTP/1.1 Sep 23 04:45:15.998532 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:45:15.998532 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:45:15.998532 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:45:15.998532 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:45:15.998532 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:45:15.998532 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:45:15.998532 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:45:15.998532 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:45:15.998532 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTmPnd6xyvib_sf8QDaEntL9VdzDsB1XlvYVv_byssSC9y0FuDAryctCXBXrVZCD9PbDQ3dSKjCyQRUJ_pn0mcUTQtUcsqOBu7SzpbudMSWwG5qnWC39KpYvZ5kKS2OfyNAGthEfbeZlhBjN-4zVQm7v8iE9-1JXPDGcINofG8kf_uc Sep 23 04:45:15.998532 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:45:15.998532 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:45:15.998532 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:45:15.998532 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:45:15.998532 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:45:15.998532 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:45:15.998532 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: d22fd8f3b0334cb3b1af66cf626422fe Sep 23 04:45:15.998532 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 Sep 23 04:45:15.998532 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:45:15.998532 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:45:15.998532 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d22fd8f3b0334cb3b1af66cf626422fe", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d22fd8f3b0334cb3b1af66cf626422fe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d22fd8f3b0334cb3b1af66cf626422fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d22fd8f3b0334cb3b1af66cf626422fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:45:15.998532 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 Sep 23 04:45:15.998532 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: d22fd8f3b0334cb3b1af66cf626422fe Sep 23 04:45:15.998532 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 Sep 23 04:45:15.998532 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project Sep 23 04:45:15.998532 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:45:15.998532 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:45:15.998532 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: d0c53d79930a4eaf9fcf7cd10707fbf3 Sep 23 04:45:15.998532 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project Sep 23 04:45:15.998532 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:45:15.998532 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 15e9bc0f-2262-4e2c-9cac-0eca4575943c could not be found. Sep 23 04:45:15.998532 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '15e9bc0f-2262-4e2c-9cac-0eca4575943c'} Sep 23 04:45:15.998532 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:45:15.998532 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:45:15.998532 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:45:15.998532 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:45:15.998532 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:45:15.998532 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:45:15.998532 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:45:15.998532 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:45:15.998532 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:45:15.998532 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:45:15.998532 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15e9bc0f-2262-4e2c-9cac-0eca4575943c could not be found. Sep 23 04:45:15.998532 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:45:15.998532 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:45:15.998532 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:45:15.998532 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:45:15.998532 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:45:15.998532 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:45:15.998532 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:45:15.998532 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:45:15.998532 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:45:15.998532 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:45:15.998532 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:45:15.998532 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:45:15.998532 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:45:15.998532 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:45:15.998532 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:45:15.998532 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:45:15.998532 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15e9bc0f-2262-4e2c-9cac-0eca4575943c could not be found. Sep 23 04:45:15.998532 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:45:16.003228 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:45:16.003228 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:45:16.003228 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:45:16.003228 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:45:16.003228 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:45:16.003228 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:45:16.003228 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:45:16.003228 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15e9bc0f-2262-4e2c-9cac-0eca4575943c could not be found. Sep 23 04:45:16.003228 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:45:16.003228 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e8c4f931-ca64-4086-80d4-c468811d821c tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] Returning 404 to user: Instance 15e9bc0f-2262-4e2c-9cac-0eca4575943c could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:45:16.003228 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e8c4f931-ca64-4086-80d4-c468811d821c tempest-FloatingIPsAssociationNegativeTestJSON-1098739593 tempest-FloatingIPsAssociationNegativeTestJSON-1098739593-project] 10.222.0.33 "GET /compute/v2.1/servers/15e9bc0f-2262-4e2c-9cac-0eca4575943c" status: 404 len: 111 microversion: 2.1 time: 0.053006 Sep 23 04:45:16.004315 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1588/3255] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:45:15 2022] GET /compute/v2.1/servers/15e9bc0f-2262-4e2c-9cac-0eca4575943c => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:45:16.309880 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-0dcfec0e-c904-40cd-8824-cd9eb92189ba tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11980041918484990dac709544d0b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c43f2b70bc74a48b62fb4115337f073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:16.322622 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0dcfec0e-c904-40cd-8824-cd9eb92189ba tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/servers/188a699b-0a1a-46b4-9a03-788af481d3ca" status: 200 len: 1498 microversion: 2.1 time: 0.624434 Sep 23 04:45:16.328905 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1668/3256] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:45:15 2022] GET /compute/v2.1/servers/188a699b-0a1a-46b4-9a03-788af481d3ca => generated 1498 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:45:16.731494 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e2b88cf6-7114-4989-8798-f25bacfb1248 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:16.732635 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e2b88cf6-7114-4989-8798-f25bacfb1248 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 27e4cd67-a4b3-440d-81dd-963f6372b385] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:16.862360 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e2b88cf6-7114-4989-8798-f25bacfb1248 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:16.875944 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e2b88cf6-7114-4989-8798-f25bacfb1248 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/27e4cd67-a4b3-440d-81dd-963f6372b385" status: 200 len: 1208 microversion: 2.1 time: 0.148876 Sep 23 04:45:16.878111 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1589/3257] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:45:16 2022] GET /compute/v2.1/servers/27e4cd67-a4b3-440d-81dd-963f6372b385 => generated 1208 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:45:16.970240 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7e38bda5-08fd-471a-81d2-1e17be4ef8f0 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:16.971095 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7e38bda5-08fd-471a-81d2-1e17be4ef8f0 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] [instance: 147e9a2b-507b-4ecf-ae6a-de2f30903108] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:16.987361 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7e38bda5-08fd-471a-81d2-1e17be4ef8f0 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:16.988167 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7e38bda5-08fd-471a-81d2-1e17be4ef8f0 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:16.990491 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7e38bda5-08fd-471a-81d2-1e17be4ef8f0 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:16.991858 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7e38bda5-08fd-471a-81d2-1e17be4ef8f0 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:16.997213 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7e38bda5-08fd-471a-81d2-1e17be4ef8f0 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:16.998090 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7e38bda5-08fd-471a-81d2-1e17be4ef8f0 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:17.030186 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-23d9c785-2bb7-4109-a476-bf5f1bb9c9d1 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-709010507", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "networks": "none"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:45:17.161288 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-23d9c785-2bb7-4109-a476-bf5f1bb9c9d1 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Flavor limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:45:17.166064 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-23d9c785-2bb7-4109-a476-bf5f1bb9c9d1 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Image limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:45:17.167372 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-23d9c785-2bb7-4109-a476-bf5f1bb9c9d1 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Flavor pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:45:17.167372 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-23d9c785-2bb7-4109-a476-bf5f1bb9c9d1 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Image pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:45:17.167563 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-23d9c785-2bb7-4109-a476-bf5f1bb9c9d1 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:45:17.194378 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-7e38bda5-08fd-471a-81d2-1e17be4ef8f0 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f455e9897223404cac3033250226fbc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f623171eb84310b4297ad6ba269c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:17.201275 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-23d9c785-2bb7-4109-a476-bf5f1bb9c9d1 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:17.202112 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-23d9c785-2bb7-4109-a476-bf5f1bb9c9d1 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:17.203755 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-23d9c785-2bb7-4109-a476-bf5f1bb9c9d1 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:17.203970 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-23d9c785-2bb7-4109-a476-bf5f1bb9c9d1 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:17.204439 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-23d9c785-2bb7-4109-a476-bf5f1bb9c9d1 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:17.204876 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-23d9c785-2bb7-4109-a476-bf5f1bb9c9d1 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:17.213661 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7e38bda5-08fd-471a-81d2-1e17be4ef8f0 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] 10.222.0.33 "GET /compute/v2.1/servers/147e9a2b-507b-4ecf-ae6a-de2f30903108" status: 200 len: 1483 microversion: 2.1 time: 0.248141 Sep 23 04:45:17.215134 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1590/3258] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:45:16 2022] GET /compute/v2.1/servers/147e9a2b-507b-4ecf-ae6a-de2f30903108 => generated 1483 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:45:17.283361 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-23d9c785-2bb7-4109-a476-bf5f1bb9c9d1 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Getting quotas for project 268508420e3c4d4cb3d60cb19488bddf. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:45:17.290943 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-23d9c785-2bb7-4109-a476-bf5f1bb9c9d1 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Getting quotas for user 90aaca3ba23b4c46bcebc4f60a7337a9 and project 268508420e3c4d4cb3d60cb19488bddf. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:45:17.308380 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-23d9c785-2bb7-4109-a476-bf5f1bb9c9d1 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Going to run 1 instances... {{(pid=122699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:45:17.312066 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-23d9c785-2bb7-4109-a476-bf5f1bb9c9d1 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] [instance: a369d441-1f65-4e05-ba68-8e606497a368] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:45:17.365460 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-459d1d56-edc4-48b2-80b6-b6101aca7271 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-720741788", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "networks": [{"uuid": "65c9d50f-294e-4acb-84d6-27b5089e84d0"}]}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:45:17.497956 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.network.neutron [None req-459d1d56-edc4-48b2-80b6-b6101aca7271 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] validate_networks() for [('65c9d50f-294e-4acb-84d6-27b5089e84d0', None, None, None, None, None)] {{(pid=122698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:45:17.542140 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-23d9c785-2bb7-4109-a476-bf5f1bb9c9d1 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.775960 Sep 23 04:45:17.543981 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1669/3259] 10.222.0.33 () {62 vars in 1188 bytes} [Fri Sep 23 04:45:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 778 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 23 04:45:17.557421 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-04bb28de-e23f-4f01-81b7-12719842dc83 req-544c55ac-1668-475b-b37a-b882a36d8a7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "147e9a2b-507b-4ecf-ae6a-de2f30903108", "name": "network-vif-deleted", "tag": "6dd5961e-9308-4178-8e45-0b2b5b318393"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:45:17.584796 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-04bb28de-e23f-4f01-81b7-12719842dc83 req-544c55ac-1668-475b-b37a-b882a36d8a7a service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:17.584796 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-04bb28de-e23f-4f01-81b7-12719842dc83 req-544c55ac-1668-475b-b37a-b882a36d8a7a service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:17.584796 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-04bb28de-e23f-4f01-81b7-12719842dc83 req-544c55ac-1668-475b-b37a-b882a36d8a7a service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:17.604106 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-04bb28de-e23f-4f01-81b7-12719842dc83 req-544c55ac-1668-475b-b37a-b882a36d8a7a service nova] Creating event network-vif-deleted:6dd5961e-9308-4178-8e45-0b2b5b318393 for instance 147e9a2b-507b-4ecf-ae6a-de2f30903108 on n-h1-846463-3 Sep 23 04:45:17.614693 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-04bb28de-e23f-4f01-81b7-12719842dc83 req-544c55ac-1668-475b-b37a-b882a36d8a7a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068806 Sep 23 04:45:17.616875 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1670/3260] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:45:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:45:17.623592 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2468ae05-4507-4192-8ad7-c0991232feed tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:17.624670 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-2468ae05-4507-4192-8ad7-c0991232feed tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] [instance: 188a699b-0a1a-46b4-9a03-788af481d3ca] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:17.650522 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2468ae05-4507-4192-8ad7-c0991232feed tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:17.652138 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2468ae05-4507-4192-8ad7-c0991232feed tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:17.655309 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2468ae05-4507-4192-8ad7-c0991232feed tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:17.657580 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2468ae05-4507-4192-8ad7-c0991232feed tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:17.658567 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2468ae05-4507-4192-8ad7-c0991232feed tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:17.659269 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2468ae05-4507-4192-8ad7-c0991232feed tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:18.050465 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2468ae05-4507-4192-8ad7-c0991232feed tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11980041918484990dac709544d0b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c43f2b70bc74a48b62fb4115337f073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:18.058314 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2468ae05-4507-4192-8ad7-c0991232feed tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/servers/188a699b-0a1a-46b4-9a03-788af481d3ca" status: 200 len: 1498 microversion: 2.1 time: 0.439889 Sep 23 04:45:18.059636 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1671/3261] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:45:17 2022] GET /compute/v2.1/servers/188a699b-0a1a-46b4-9a03-788af481d3ca => generated 1498 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:45:18.067636 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4686c97b-34c7-453c-a3c0-52e2757acbc3 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:18.068880 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4686c97b-34c7-453c-a3c0-52e2757acbc3 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] [instance: a369d441-1f65-4e05-ba68-8e606497a368] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:18.189921 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-4686c97b-34c7-453c-a3c0-52e2757acbc3 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aaca3ba23b4c46bcebc4f60a7337a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268508420e3c4d4cb3d60cb19488bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:18.201825 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-4686c97b-34c7-453c-a3c0-52e2757acbc3 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90aaca3ba23b4c46bcebc4f60a7337a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268508420e3c4d4cb3d60cb19488bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:18.204523 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-4686c97b-34c7-453c-a3c0-52e2757acbc3 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90aaca3ba23b4c46bcebc4f60a7337a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268508420e3c4d4cb3d60cb19488bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:18.206057 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4686c97b-34c7-453c-a3c0-52e2757acbc3 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] 10.222.0.33 "GET /compute/v2.1/servers/a369d441-1f65-4e05-ba68-8e606497a368" status: 200 len: 1277 microversion: 2.54 time: 0.145113 Sep 23 04:45:18.207653 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1672/3262] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:45:18 2022] GET /compute/v2.1/servers/a369d441-1f65-4e05-ba68-8e606497a368 => generated 1277 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:45:18.213326 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-163ac216-6f22-49a7-a1a1-fe946880235a tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:18.214404 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-163ac216-6f22-49a7-a1a1-fe946880235a tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 27e4cd67-a4b3-440d-81dd-963f6372b385] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:18.229947 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-163ac216-6f22-49a7-a1a1-fe946880235a tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:18.230832 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-163ac216-6f22-49a7-a1a1-fe946880235a tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:18.231669 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-163ac216-6f22-49a7-a1a1-fe946880235a tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:18.232637 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-163ac216-6f22-49a7-a1a1-fe946880235a tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:18.233611 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-163ac216-6f22-49a7-a1a1-fe946880235a tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:18.234519 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-163ac216-6f22-49a7-a1a1-fe946880235a tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:18.531429 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-163ac216-6f22-49a7-a1a1-fe946880235a tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:18.547072 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-163ac216-6f22-49a7-a1a1-fe946880235a tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/27e4cd67-a4b3-440d-81dd-963f6372b385" status: 200 len: 1260 microversion: 2.1 time: 0.337977 Sep 23 04:45:18.565946 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1673/3263] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:45:18 2022] GET /compute/v2.1/servers/27e4cd67-a4b3-440d-81dd-963f6372b385 => generated 1260 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:45:18.588765 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4c41dbd8-5464-45bd-886e-7278e1c8fc94 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:18.589446 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4c41dbd8-5464-45bd-886e-7278e1c8fc94 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] [instance: 147e9a2b-507b-4ecf-ae6a-de2f30903108] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:18.599822 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4c41dbd8-5464-45bd-886e-7278e1c8fc94 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:18.606492 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4c41dbd8-5464-45bd-886e-7278e1c8fc94 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:18.607794 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4c41dbd8-5464-45bd-886e-7278e1c8fc94 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:18.609317 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4c41dbd8-5464-45bd-886e-7278e1c8fc94 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:18.609788 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4c41dbd8-5464-45bd-886e-7278e1c8fc94 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:18.610514 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4c41dbd8-5464-45bd-886e-7278e1c8fc94 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:18.675893 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4c41dbd8-5464-45bd-886e-7278e1c8fc94 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:18.675893 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4c41dbd8-5464-45bd-886e-7278e1c8fc94 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:18.675893 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4c41dbd8-5464-45bd-886e-7278e1c8fc94 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:18.675893 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-4c41dbd8-5464-45bd-886e-7278e1c8fc94 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Lazy-loading 'fault' on Instance uuid 147e9a2b-507b-4ecf-ae6a-de2f30903108 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:45:18.970362 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-4c41dbd8-5464-45bd-886e-7278e1c8fc94 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f455e9897223404cac3033250226fbc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f623171eb84310b4297ad6ba269c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:18.979473 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4c41dbd8-5464-45bd-886e-7278e1c8fc94 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] 10.222.0.33 "GET /compute/v2.1/servers/147e9a2b-507b-4ecf-ae6a-de2f30903108" status: 200 len: 1313 microversion: 2.1 time: 0.412332 Sep 23 04:45:18.980733 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-459d1d56-edc4-48b2-80b6-b6101aca7271 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Flavor limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:45:18.981724 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-459d1d56-edc4-48b2-80b6-b6101aca7271 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Image limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:45:18.982414 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-459d1d56-edc4-48b2-80b6-b6101aca7271 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Flavor pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:45:18.991581 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-459d1d56-edc4-48b2-80b6-b6101aca7271 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Image pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:45:18.991581 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-459d1d56-edc4-48b2-80b6-b6101aca7271 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:45:18.991811 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1674/3264] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:45:18 2022] GET /compute/v2.1/servers/147e9a2b-507b-4ecf-ae6a-de2f30903108 => generated 1313 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:45:18.996473 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-459d1d56-edc4-48b2-80b6-b6101aca7271 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:18.997253 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-459d1d56-edc4-48b2-80b6-b6101aca7271 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:18.998526 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-459d1d56-edc4-48b2-80b6-b6101aca7271 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:19.001473 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-459d1d56-edc4-48b2-80b6-b6101aca7271 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:19.003084 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-459d1d56-edc4-48b2-80b6-b6101aca7271 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:19.003782 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-459d1d56-edc4-48b2-80b6-b6101aca7271 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:19.032643 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-459d1d56-edc4-48b2-80b6-b6101aca7271 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Getting quotas for project ecebd3f6411d4d9d9a85b84c77efab02. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:45:19.052004 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-459d1d56-edc4-48b2-80b6-b6101aca7271 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Getting quotas for user a450c16562c24174809ea6819a26c62e and project ecebd3f6411d4d9d9a85b84c77efab02. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:45:19.078335 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-459d1d56-edc4-48b2-80b6-b6101aca7271 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Going to run 1 instances... {{(pid=122698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:45:19.082003 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-459d1d56-edc4-48b2-80b6-b6101aca7271 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] [instance: b1eab370-87bb-4d58-bcaf-c41520e016a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:45:19.085603 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5afc9cfd-8955-46f3-aa5c-c3cf30403e5d tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:19.086260 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-5afc9cfd-8955-46f3-aa5c-c3cf30403e5d tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] [instance: 188a699b-0a1a-46b4-9a03-788af481d3ca] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:19.096744 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5afc9cfd-8955-46f3-aa5c-c3cf30403e5d tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:19.097257 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5afc9cfd-8955-46f3-aa5c-c3cf30403e5d tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:19.097691 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5afc9cfd-8955-46f3-aa5c-c3cf30403e5d tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:19.100997 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5afc9cfd-8955-46f3-aa5c-c3cf30403e5d tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:19.101859 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5afc9cfd-8955-46f3-aa5c-c3cf30403e5d tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:19.104008 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5afc9cfd-8955-46f3-aa5c-c3cf30403e5d tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:19.365203 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-459d1d56-edc4-48b2-80b6-b6101aca7271 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 2.148460 Sep 23 04:45:19.371044 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1591/3265] 10.222.0.33 () {62 vars in 1188 bytes} [Fri Sep 23 04:45:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 2155 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 23 04:45:19.390791 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e97eb60f-caf2-4bcd-8a4d-af728322f7d6 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:19.393322 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e97eb60f-caf2-4bcd-8a4d-af728322f7d6 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] [instance: a369d441-1f65-4e05-ba68-8e606497a368] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:19.406633 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e97eb60f-caf2-4bcd-8a4d-af728322f7d6 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:19.425071 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e97eb60f-caf2-4bcd-8a4d-af728322f7d6 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:19.428211 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e97eb60f-caf2-4bcd-8a4d-af728322f7d6 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:19.434821 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e97eb60f-caf2-4bcd-8a4d-af728322f7d6 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:19.435793 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e97eb60f-caf2-4bcd-8a4d-af728322f7d6 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:19.436486 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e97eb60f-caf2-4bcd-8a4d-af728322f7d6 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:19.960919 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e97eb60f-caf2-4bcd-8a4d-af728322f7d6 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aaca3ba23b4c46bcebc4f60a7337a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268508420e3c4d4cb3d60cb19488bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:19.972340 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e97eb60f-caf2-4bcd-8a4d-af728322f7d6 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90aaca3ba23b4c46bcebc4f60a7337a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268508420e3c4d4cb3d60cb19488bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:19.979690 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e97eb60f-caf2-4bcd-8a4d-af728322f7d6 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90aaca3ba23b4c46bcebc4f60a7337a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268508420e3c4d4cb3d60cb19488bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:19.981352 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e97eb60f-caf2-4bcd-8a4d-af728322f7d6 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] 10.222.0.33 "GET /compute/v2.1/servers/a369d441-1f65-4e05-ba68-8e606497a368" status: 200 len: 1281 microversion: 2.54 time: 0.608804 Sep 23 04:45:19.994740 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1592/3266] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:45:19 2022] GET /compute/v2.1/servers/a369d441-1f65-4e05-ba68-8e606497a368 => generated 1281 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:45:20.008038 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e35b6346-bf9d-4d46-a163-89298da55bd1 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:20.010782 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e35b6346-bf9d-4d46-a163-89298da55bd1 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] [instance: b1eab370-87bb-4d58-bcaf-c41520e016a0] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:20.182070 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e35b6346-bf9d-4d46-a163-89298da55bd1 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a450c16562c24174809ea6819a26c62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebd3f6411d4d9d9a85b84c77efab02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:20.192686 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e35b6346-bf9d-4d46-a163-89298da55bd1 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a450c16562c24174809ea6819a26c62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebd3f6411d4d9d9a85b84c77efab02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:20.197324 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e35b6346-bf9d-4d46-a163-89298da55bd1 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a450c16562c24174809ea6819a26c62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebd3f6411d4d9d9a85b84c77efab02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:20.205018 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e35b6346-bf9d-4d46-a163-89298da55bd1 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] 10.222.0.33 "GET /compute/v2.1/servers/b1eab370-87bb-4d58-bcaf-c41520e016a0" status: 200 len: 1258 microversion: 2.21 time: 0.208834 Sep 23 04:45:20.205621 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1593/3267] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:45:19 2022] GET /compute/v2.1/servers/b1eab370-87bb-4d58-bcaf-c41520e016a0 => generated 1258 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:45:20.210508 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-dd798d3c-f92f-42ba-969c-4cfdaff8d73e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:20.211126 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-dd798d3c-f92f-42ba-969c-4cfdaff8d73e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 27e4cd67-a4b3-440d-81dd-963f6372b385] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:20.230656 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dd798d3c-f92f-42ba-969c-4cfdaff8d73e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:20.231565 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dd798d3c-f92f-42ba-969c-4cfdaff8d73e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:20.232254 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dd798d3c-f92f-42ba-969c-4cfdaff8d73e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:20.233218 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dd798d3c-f92f-42ba-969c-4cfdaff8d73e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:20.233923 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dd798d3c-f92f-42ba-969c-4cfdaff8d73e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:20.235110 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dd798d3c-f92f-42ba-969c-4cfdaff8d73e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:20.350194 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-5afc9cfd-8955-46f3-aa5c-c3cf30403e5d tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11980041918484990dac709544d0b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c43f2b70bc74a48b62fb4115337f073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:20.355183 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-dd798d3c-f92f-42ba-969c-4cfdaff8d73e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:20.364090 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5afc9cfd-8955-46f3-aa5c-c3cf30403e5d tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/servers/188a699b-0a1a-46b4-9a03-788af481d3ca" status: 200 len: 1498 microversion: 2.1 time: 1.283488 Sep 23 04:45:20.364311 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-dd798d3c-f92f-42ba-969c-4cfdaff8d73e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/27e4cd67-a4b3-440d-81dd-963f6372b385" status: 200 len: 1266 microversion: 2.1 time: 0.157441 Sep 23 04:45:20.370638 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1594/3268] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:45:20 2022] GET /compute/v2.1/servers/27e4cd67-a4b3-440d-81dd-963f6372b385 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:45:20.380548 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1675/3269] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:45:19 2022] GET /compute/v2.1/servers/188a699b-0a1a-46b4-9a03-788af481d3ca => generated 1498 bytes in 1301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:45:20.386265 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6bb3edf4-25ec-4952-a4d6-627176372b29 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:20.389612 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-6bb3edf4-25ec-4952-a4d6-627176372b29 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] [instance: 147e9a2b-507b-4ecf-ae6a-de2f30903108] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:20.412785 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6bb3edf4-25ec-4952-a4d6-627176372b29 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:20.414212 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6bb3edf4-25ec-4952-a4d6-627176372b29 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:20.415038 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6bb3edf4-25ec-4952-a4d6-627176372b29 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:20.416070 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6bb3edf4-25ec-4952-a4d6-627176372b29 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:20.417377 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6bb3edf4-25ec-4952-a4d6-627176372b29 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:20.420339 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6bb3edf4-25ec-4952-a4d6-627176372b29 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:20.452266 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-6bb3edf4-25ec-4952-a4d6-627176372b29 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] HTTP exception thrown: Instance 147e9a2b-507b-4ecf-ae6a-de2f30903108 could not be found. Sep 23 04:45:20.467467 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6bb3edf4-25ec-4952-a4d6-627176372b29 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Request method failure captured: Sep 23 04:45:20.467467 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/147e9a2b-507b-4ecf-ae6a-de2f30903108 HTTP/1.1 Sep 23 04:45:20.467467 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:45:20.467467 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:45:20.467467 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:45:20.467467 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:45:20.467467 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:45:20.467467 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:45:20.467467 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:45:20.467467 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:45:20.467467 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTm-ym8hKl35z0_or5NGLmrSKoptm5PEIY64Kx7SPYE6G_rcJvuM5uum9i42rHD7QtxuVtZN58b30AqdTJsFA0a18oafox1NI6E6ieyGQ22kp5xrc7vTDFHkvvOW2DiX87WJfKdge50Q9ZLEnROa4pijJzreryqA5jO4rEuCU-G7oBw Sep 23 04:45:20.467467 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:45:20.467467 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:45:20.467467 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:45:20.467467 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:45:20.467467 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:45:20.467467 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:45:20.467467 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: c9f623171eb84310b4297ad6ba269c54 Sep 23 04:45:20.467467 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-852991410 Sep 23 04:45:20.467467 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:45:20.467467 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:45:20.467467 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c9f623171eb84310b4297ad6ba269c54", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c9f623171eb84310b4297ad6ba269c54"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c9f623171eb84310b4297ad6ba269c54"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c9f623171eb84310b4297ad6ba269c54"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:45:20.467467 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-852991410 Sep 23 04:45:20.467467 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: c9f623171eb84310b4297ad6ba269c54 Sep 23 04:45:20.467467 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-852991410 Sep 23 04:45:20.467467 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ServerMetadataNegativeTestJSON-852991410-project Sep 23 04:45:20.467467 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:45:20.467467 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:45:20.467467 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: f455e9897223404cac3033250226fbc0 Sep 23 04:45:20.467467 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-852991410-project Sep 23 04:45:20.467467 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:45:20.467467 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 147e9a2b-507b-4ecf-ae6a-de2f30903108 could not be found. Sep 23 04:45:20.467467 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '147e9a2b-507b-4ecf-ae6a-de2f30903108'} Sep 23 04:45:20.467467 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:45:20.467467 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:45:20.467467 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:45:20.467467 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:45:20.467467 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:45:20.467467 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:45:20.467467 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:45:20.467467 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:45:20.467467 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:45:20.467467 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:45:20.467467 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 147e9a2b-507b-4ecf-ae6a-de2f30903108 could not be found. Sep 23 04:45:20.467467 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:45:20.467467 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:45:20.467467 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:45:20.467467 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:45:20.467467 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:45:20.467467 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:45:20.467467 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:45:20.467467 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:45:20.467467 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:45:20.467467 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:45:20.467467 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:45:20.467467 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:45:20.467467 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:45:20.467467 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:45:20.467467 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:45:20.467467 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:45:20.467467 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 147e9a2b-507b-4ecf-ae6a-de2f30903108 could not be found. Sep 23 04:45:20.467467 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:45:20.467467 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:45:20.479754 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:45:20.479754 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:45:20.479754 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:45:20.479754 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:45:20.479754 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:45:20.479754 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:45:20.479754 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 147e9a2b-507b-4ecf-ae6a-de2f30903108 could not be found. Sep 23 04:45:20.479754 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:45:20.479754 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6bb3edf4-25ec-4952-a4d6-627176372b29 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] Returning 404 to user: Instance 147e9a2b-507b-4ecf-ae6a-de2f30903108 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:45:20.479754 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-6bb3edf4-25ec-4952-a4d6-627176372b29 tempest-ServerMetadataNegativeTestJSON-852991410 tempest-ServerMetadataNegativeTestJSON-852991410-project] 10.222.0.33 "GET /compute/v2.1/servers/147e9a2b-507b-4ecf-ae6a-de2f30903108" status: 404 len: 111 microversion: 2.1 time: 0.096479 Sep 23 04:45:20.479754 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1595/3270] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:45:20 2022] GET /compute/v2.1/servers/147e9a2b-507b-4ecf-ae6a-de2f30903108 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:45:21.014609 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c87f1deb-d768-4211-8a84-36621f576de0 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:21.017584 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c87f1deb-d768-4211-8a84-36621f576de0 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] [instance: a369d441-1f65-4e05-ba68-8e606497a368] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:21.038996 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c87f1deb-d768-4211-8a84-36621f576de0 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:21.041715 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c87f1deb-d768-4211-8a84-36621f576de0 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:21.043290 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c87f1deb-d768-4211-8a84-36621f576de0 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:21.047338 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c87f1deb-d768-4211-8a84-36621f576de0 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:21.049213 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c87f1deb-d768-4211-8a84-36621f576de0 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:21.050129 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c87f1deb-d768-4211-8a84-36621f576de0 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:21.232706 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9f926d8e-acdf-4516-a882-59371c488a6e tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:21.235000 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-9f926d8e-acdf-4516-a882-59371c488a6e tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] [instance: b1eab370-87bb-4d58-bcaf-c41520e016a0] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:21.248179 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c87f1deb-d768-4211-8a84-36621f576de0 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aaca3ba23b4c46bcebc4f60a7337a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268508420e3c4d4cb3d60cb19488bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:21.248640 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9f926d8e-acdf-4516-a882-59371c488a6e tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:21.249345 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9f926d8e-acdf-4516-a882-59371c488a6e tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:21.251598 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9f926d8e-acdf-4516-a882-59371c488a6e tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:21.253014 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9f926d8e-acdf-4516-a882-59371c488a6e tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:21.254794 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9f926d8e-acdf-4516-a882-59371c488a6e tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:21.255442 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9f926d8e-acdf-4516-a882-59371c488a6e tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:21.305083 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:45:21.335499 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c87f1deb-d768-4211-8a84-36621f576de0 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90aaca3ba23b4c46bcebc4f60a7337a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268508420e3c4d4cb3d60cb19488bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:21.340287 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c87f1deb-d768-4211-8a84-36621f576de0 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90aaca3ba23b4c46bcebc4f60a7337a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268508420e3c4d4cb3d60cb19488bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:21.345612 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c87f1deb-d768-4211-8a84-36621f576de0 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] 10.222.0.33 "GET /compute/v2.1/servers/a369d441-1f65-4e05-ba68-8e606497a368" status: 200 len: 1337 microversion: 2.54 time: 0.338482 Sep 23 04:45:21.346679 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1676/3271] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:45:21 2022] GET /compute/v2.1/servers/a369d441-1f65-4e05-ba68-8e606497a368 => generated 1337 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:45:21.393185 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-59840d3c-e051-41e7-bb39-14225842a240 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:21.404383 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-59840d3c-e051-41e7-bb39-14225842a240 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] [instance: 188a699b-0a1a-46b4-9a03-788af481d3ca] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:21.411786 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-59840d3c-e051-41e7-bb39-14225842a240 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:21.416918 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-59840d3c-e051-41e7-bb39-14225842a240 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:21.417870 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-59840d3c-e051-41e7-bb39-14225842a240 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:21.420079 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-59840d3c-e051-41e7-bb39-14225842a240 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:21.421578 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-59840d3c-e051-41e7-bb39-14225842a240 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:21.424401 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-59840d3c-e051-41e7-bb39-14225842a240 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:21.519321 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-9f926d8e-acdf-4516-a882-59371c488a6e tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a450c16562c24174809ea6819a26c62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebd3f6411d4d9d9a85b84c77efab02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:21.528835 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-9f926d8e-acdf-4516-a882-59371c488a6e tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a450c16562c24174809ea6819a26c62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebd3f6411d4d9d9a85b84c77efab02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:21.530291 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-9f926d8e-acdf-4516-a882-59371c488a6e tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a450c16562c24174809ea6819a26c62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebd3f6411d4d9d9a85b84c77efab02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:21.541317 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9f926d8e-acdf-4516-a882-59371c488a6e tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] 10.222.0.33 "GET /compute/v2.1/servers/b1eab370-87bb-4d58-bcaf-c41520e016a0" status: 200 len: 1262 microversion: 2.21 time: 0.313838 Sep 23 04:45:21.544424 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1596/3272] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:45:21 2022] GET /compute/v2.1/servers/b1eab370-87bb-4d58-bcaf-c41520e016a0 => generated 1262 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:45:21.555709 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-07ead9a6-a38a-427b-aaf2-ad88839ef5c5 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:21.556609 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-07ead9a6-a38a-427b-aaf2-ad88839ef5c5 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 27e4cd67-a4b3-440d-81dd-963f6372b385] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:21.572211 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-07ead9a6-a38a-427b-aaf2-ad88839ef5c5 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:21.572905 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-07ead9a6-a38a-427b-aaf2-ad88839ef5c5 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:21.573667 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-07ead9a6-a38a-427b-aaf2-ad88839ef5c5 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:21.574554 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-07ead9a6-a38a-427b-aaf2-ad88839ef5c5 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:21.575167 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-07ead9a6-a38a-427b-aaf2-ad88839ef5c5 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:21.575750 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-07ead9a6-a38a-427b-aaf2-ad88839ef5c5 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:22.123268 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-59840d3c-e051-41e7-bb39-14225842a240 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11980041918484990dac709544d0b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c43f2b70bc74a48b62fb4115337f073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:22.137128 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-59840d3c-e051-41e7-bb39-14225842a240 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/servers/188a699b-0a1a-46b4-9a03-788af481d3ca" status: 200 len: 1498 microversion: 2.1 time: 0.747669 Sep 23 04:45:22.137128 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1677/3273] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:45:21 2022] GET /compute/v2.1/servers/188a699b-0a1a-46b4-9a03-788af481d3ca => generated 1498 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:45:22.316349 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-07ead9a6-a38a-427b-aaf2-ad88839ef5c5 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:22.358019 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-07ead9a6-a38a-427b-aaf2-ad88839ef5c5 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/27e4cd67-a4b3-440d-81dd-963f6372b385" status: 200 len: 1308 microversion: 2.1 time: 0.812197 Sep 23 04:45:22.371236 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1597/3274] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:45:21 2022] GET /compute/v2.1/servers/27e4cd67-a4b3-440d-81dd-963f6372b385 => generated 1308 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:45:22.380155 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-547e81ae-5674-4915-b4ca-5a7c31c33696 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:22.380913 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-547e81ae-5674-4915-b4ca-5a7c31c33696 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] [instance: a369d441-1f65-4e05-ba68-8e606497a368] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:22.393397 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-547e81ae-5674-4915-b4ca-5a7c31c33696 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:22.394639 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-547e81ae-5674-4915-b4ca-5a7c31c33696 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:22.395621 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-547e81ae-5674-4915-b4ca-5a7c31c33696 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:22.396517 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-547e81ae-5674-4915-b4ca-5a7c31c33696 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:22.397144 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-547e81ae-5674-4915-b4ca-5a7c31c33696 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:22.397732 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-547e81ae-5674-4915-b4ca-5a7c31c33696 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:22.572037 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-578dc0f1-ec49-45fd-b919-b5688fbaef1d tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:22.573259 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-578dc0f1-ec49-45fd-b919-b5688fbaef1d tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] [instance: b1eab370-87bb-4d58-bcaf-c41520e016a0] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:22.576463 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-547e81ae-5674-4915-b4ca-5a7c31c33696 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aaca3ba23b4c46bcebc4f60a7337a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268508420e3c4d4cb3d60cb19488bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:22.580507 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-578dc0f1-ec49-45fd-b919-b5688fbaef1d tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:22.584565 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-578dc0f1-ec49-45fd-b919-b5688fbaef1d tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:22.584565 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-578dc0f1-ec49-45fd-b919-b5688fbaef1d tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:22.584565 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-578dc0f1-ec49-45fd-b919-b5688fbaef1d tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:22.584565 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-578dc0f1-ec49-45fd-b919-b5688fbaef1d tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:22.584565 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-578dc0f1-ec49-45fd-b919-b5688fbaef1d tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:22.588045 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-547e81ae-5674-4915-b4ca-5a7c31c33696 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90aaca3ba23b4c46bcebc4f60a7337a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268508420e3c4d4cb3d60cb19488bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:22.596688 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-547e81ae-5674-4915-b4ca-5a7c31c33696 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90aaca3ba23b4c46bcebc4f60a7337a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268508420e3c4d4cb3d60cb19488bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:22.598259 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-547e81ae-5674-4915-b4ca-5a7c31c33696 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] 10.222.0.33 "GET /compute/v2.1/servers/a369d441-1f65-4e05-ba68-8e606497a368" status: 200 len: 1335 microversion: 2.54 time: 0.221987 Sep 23 04:45:22.601245 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1678/3275] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:45:22 2022] GET /compute/v2.1/servers/a369d441-1f65-4e05-ba68-8e606497a368 => generated 1335 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:45:22.735428 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-578dc0f1-ec49-45fd-b919-b5688fbaef1d tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a450c16562c24174809ea6819a26c62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebd3f6411d4d9d9a85b84c77efab02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:22.754451 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-578dc0f1-ec49-45fd-b919-b5688fbaef1d tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a450c16562c24174809ea6819a26c62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebd3f6411d4d9d9a85b84c77efab02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:22.757129 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-578dc0f1-ec49-45fd-b919-b5688fbaef1d tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a450c16562c24174809ea6819a26c62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebd3f6411d4d9d9a85b84c77efab02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:22.759541 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-578dc0f1-ec49-45fd-b919-b5688fbaef1d tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] 10.222.0.33 "GET /compute/v2.1/servers/b1eab370-87bb-4d58-bcaf-c41520e016a0" status: 200 len: 1310 microversion: 2.21 time: 0.192674 Sep 23 04:45:22.771960 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1598/3276] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:45:22 2022] GET /compute/v2.1/servers/b1eab370-87bb-4d58-bcaf-c41520e016a0 => generated 1310 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:45:23.161186 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7ed6c4a5-4f94-4e71-af8a-e9b6e0376fbf tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:23.161806 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-7ed6c4a5-4f94-4e71-af8a-e9b6e0376fbf tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] [instance: 188a699b-0a1a-46b4-9a03-788af481d3ca] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:23.173867 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7ed6c4a5-4f94-4e71-af8a-e9b6e0376fbf tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:23.174356 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7ed6c4a5-4f94-4e71-af8a-e9b6e0376fbf tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:23.174795 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7ed6c4a5-4f94-4e71-af8a-e9b6e0376fbf tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:23.175501 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7ed6c4a5-4f94-4e71-af8a-e9b6e0376fbf tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:23.176057 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7ed6c4a5-4f94-4e71-af8a-e9b6e0376fbf tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:23.176460 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7ed6c4a5-4f94-4e71-af8a-e9b6e0376fbf tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:23.385782 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c76fe73f-5340-4154-b345-d8b004f63ce8 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:23.388022 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c76fe73f-5340-4154-b345-d8b004f63ce8 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 27e4cd67-a4b3-440d-81dd-963f6372b385] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:23.400649 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c76fe73f-5340-4154-b345-d8b004f63ce8 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:23.411348 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c76fe73f-5340-4154-b345-d8b004f63ce8 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:23.411348 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c76fe73f-5340-4154-b345-d8b004f63ce8 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:23.411348 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c76fe73f-5340-4154-b345-d8b004f63ce8 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:23.411348 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c76fe73f-5340-4154-b345-d8b004f63ce8 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:23.411348 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c76fe73f-5340-4154-b345-d8b004f63ce8 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:24.639942 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-7ed6c4a5-4f94-4e71-af8a-e9b6e0376fbf tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11980041918484990dac709544d0b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c43f2b70bc74a48b62fb4115337f073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:24.665770 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-7ed6c4a5-4f94-4e71-af8a-e9b6e0376fbf tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/servers/188a699b-0a1a-46b4-9a03-788af481d3ca" status: 200 len: 1498 microversion: 2.1 time: 1.506322 Sep 23 04:45:24.679926 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1679/3277] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:45:23 2022] GET /compute/v2.1/servers/188a699b-0a1a-46b4-9a03-788af481d3ca => generated 1498 bytes in 1513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:45:24.686661 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c76fe73f-5340-4154-b345-d8b004f63ce8 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:24.687374 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-64bfb8d9-2d8f-4902-b14d-7ddb89958ebe tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:24.688171 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-64bfb8d9-2d8f-4902-b14d-7ddb89958ebe tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] [instance: a369d441-1f65-4e05-ba68-8e606497a368] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:24.697990 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-64bfb8d9-2d8f-4902-b14d-7ddb89958ebe tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:24.702267 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-64bfb8d9-2d8f-4902-b14d-7ddb89958ebe tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:24.702267 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-64bfb8d9-2d8f-4902-b14d-7ddb89958ebe tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:24.702267 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-64bfb8d9-2d8f-4902-b14d-7ddb89958ebe tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:24.702267 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-64bfb8d9-2d8f-4902-b14d-7ddb89958ebe tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:24.702267 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-64bfb8d9-2d8f-4902-b14d-7ddb89958ebe tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:24.704827 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c76fe73f-5340-4154-b345-d8b004f63ce8 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/27e4cd67-a4b3-440d-81dd-963f6372b385" status: 200 len: 1308 microversion: 2.1 time: 1.323026 Sep 23 04:45:24.720506 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1599/3278] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:45:23 2022] GET /compute/v2.1/servers/27e4cd67-a4b3-440d-81dd-963f6372b385 => generated 1308 bytes in 1341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:45:24.733878 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1f7ac8c9-62a6-4b81-b159-911449ba156c tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:24.734786 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-1f7ac8c9-62a6-4b81-b159-911449ba156c tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] [instance: b1eab370-87bb-4d58-bcaf-c41520e016a0] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:24.744872 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1f7ac8c9-62a6-4b81-b159-911449ba156c tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:24.746283 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1f7ac8c9-62a6-4b81-b159-911449ba156c tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:24.746743 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1f7ac8c9-62a6-4b81-b159-911449ba156c tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:24.748079 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1f7ac8c9-62a6-4b81-b159-911449ba156c tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:24.748892 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1f7ac8c9-62a6-4b81-b159-911449ba156c tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:24.749971 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1f7ac8c9-62a6-4b81-b159-911449ba156c tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:24.999597 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-64bfb8d9-2d8f-4902-b14d-7ddb89958ebe tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aaca3ba23b4c46bcebc4f60a7337a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268508420e3c4d4cb3d60cb19488bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:25.014043 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-64bfb8d9-2d8f-4902-b14d-7ddb89958ebe tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90aaca3ba23b4c46bcebc4f60a7337a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268508420e3c4d4cb3d60cb19488bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:25.016550 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-64bfb8d9-2d8f-4902-b14d-7ddb89958ebe tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90aaca3ba23b4c46bcebc4f60a7337a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268508420e3c4d4cb3d60cb19488bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:25.018539 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-64bfb8d9-2d8f-4902-b14d-7ddb89958ebe tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] 10.222.0.33 "GET /compute/v2.1/servers/a369d441-1f65-4e05-ba68-8e606497a368" status: 200 len: 1356 microversion: 2.54 time: 0.347832 Sep 23 04:45:25.019822 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1680/3279] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:45:24 2022] GET /compute/v2.1/servers/a369d441-1f65-4e05-ba68-8e606497a368 => generated 1356 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:45:25.047851 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-1f7ac8c9-62a6-4b81-b159-911449ba156c tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a450c16562c24174809ea6819a26c62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebd3f6411d4d9d9a85b84c77efab02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:25.053391 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-233021a4-ba24-4ab0-bc93-cd926d99cf88 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Action: 'create', calling method: .version_select at 0x7ff1bb733f70>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-107314317", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE8aA4sZ7pFmL3zvpG1bU1qRQdtPhmb/9QThhzrJZKSx2UWybDWITbgxbo6VK2f9/uRU2pNgROhRtmacf1CxKgzdhRc+MYlc/0GGq0Evfu7aQTxQePXfVcyIhZ+0VM0DzA=="}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:45:25.056794 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-1f7ac8c9-62a6-4b81-b159-911449ba156c tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a450c16562c24174809ea6819a26c62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebd3f6411d4d9d9a85b84c77efab02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:25.062645 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-1f7ac8c9-62a6-4b81-b159-911449ba156c tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a450c16562c24174809ea6819a26c62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebd3f6411d4d9d9a85b84c77efab02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:25.062645 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-1f7ac8c9-62a6-4b81-b159-911449ba156c tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] 10.222.0.33 "GET /compute/v2.1/servers/b1eab370-87bb-4d58-bcaf-c41520e016a0" status: 200 len: 1316 microversion: 2.21 time: 0.338065 Sep 23 04:45:25.062645 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1600/3280] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:45:24 2022] GET /compute/v2.1/servers/b1eab370-87bb-4d58-bcaf-c41520e016a0 => generated 1316 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:45:25.077488 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-233021a4-ba24-4ab0-bc93-cd926d99cf88 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Getting quotas for project 268508420e3c4d4cb3d60cb19488bddf. Resources: {'key_pairs'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:45:25.102864 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-233021a4-ba24-4ab0-bc93-cd926d99cf88 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Getting quotas for user 90aaca3ba23b4c46bcebc4f60a7337a9 and project 268508420e3c4d4cb3d60cb19488bddf. Resources: {'key_pairs'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:45:25.212092 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-233021a4-ba24-4ab0-bc93-cd926d99cf88 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 419 microversion: 2.54 time: 0.164241 Sep 23 04:45:25.213005 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1681/3281] 10.222.0.33 () {62 vars in 1200 bytes} [Fri Sep 23 04:45:25 2022] POST /compute/v2.1/os-keypairs => generated 419 bytes in 166 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Sep 23 04:45:25.228072 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-48ab9d73-8722-4804-a624-c8688437a2a6 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-107314317", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:45:25.232421 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-48ab9d73-8722-4804-a624-c8688437a2a6 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] [instance: a369d441-1f65-4e05-ba68-8e606497a368] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:25.242503 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-48ab9d73-8722-4804-a624-c8688437a2a6 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:25.244695 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-48ab9d73-8722-4804-a624-c8688437a2a6 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:25.245406 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-48ab9d73-8722-4804-a624-c8688437a2a6 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:25.246220 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-48ab9d73-8722-4804-a624-c8688437a2a6 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:25.246684 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-48ab9d73-8722-4804-a624-c8688437a2a6 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:25.247303 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-48ab9d73-8722-4804-a624-c8688437a2a6 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:25.358883 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-48ab9d73-8722-4804-a624-c8688437a2a6 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Flavor limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:45:25.360108 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-48ab9d73-8722-4804-a624-c8688437a2a6 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Image limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:45:25.360892 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-48ab9d73-8722-4804-a624-c8688437a2a6 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Flavor pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:45:25.361481 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-48ab9d73-8722-4804-a624-c8688437a2a6 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Image pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:45:25.362109 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-48ab9d73-8722-4804-a624-c8688437a2a6 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:45:25.504789 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:45:25.694902 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-86d8533d-8619-4190-b69c-1f931842ebb3 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:25.696142 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-86d8533d-8619-4190-b69c-1f931842ebb3 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] [instance: 188a699b-0a1a-46b4-9a03-788af481d3ca] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:25.708530 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-86d8533d-8619-4190-b69c-1f931842ebb3 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:25.713510 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-86d8533d-8619-4190-b69c-1f931842ebb3 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:25.714085 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-86d8533d-8619-4190-b69c-1f931842ebb3 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:25.714860 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-86d8533d-8619-4190-b69c-1f931842ebb3 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:25.715410 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-86d8533d-8619-4190-b69c-1f931842ebb3 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:25.715852 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-86d8533d-8619-4190-b69c-1f931842ebb3 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:25.790343 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-48ab9d73-8722-4804-a624-c8688437a2a6 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] [instance: a369d441-1f65-4e05-ba68-8e606497a368] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:25.807973 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-48ab9d73-8722-4804-a624-c8688437a2a6 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:25.808485 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-48ab9d73-8722-4804-a624-c8688437a2a6 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:25.808924 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-48ab9d73-8722-4804-a624-c8688437a2a6 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:25.809644 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-48ab9d73-8722-4804-a624-c8688437a2a6 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:25.810131 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-48ab9d73-8722-4804-a624-c8688437a2a6 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:25.815057 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-48ab9d73-8722-4804-a624-c8688437a2a6 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:25.856094 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-48ab9d73-8722-4804-a624-c8688437a2a6 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] 10.222.0.33 "POST /compute/v2.1/servers/a369d441-1f65-4e05-ba68-8e606497a368/action" status: 202 len: 1138 microversion: 2.54 time: 0.634248 Sep 23 04:45:25.871069 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1601/3282] 10.222.0.33 () {62 vars in 1320 bytes} [Fri Sep 23 04:45:25 2022] POST /compute/v2.1/servers/a369d441-1f65-4e05-ba68-8e606497a368/action => generated 1138 bytes in 649 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Sep 23 04:45:25.878948 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3ecfdd4e-2733-4208-a337-49ee45b9645b tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:25.879804 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3ecfdd4e-2733-4208-a337-49ee45b9645b tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 27e4cd67-a4b3-440d-81dd-963f6372b385] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:25.889176 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3ecfdd4e-2733-4208-a337-49ee45b9645b tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:25.890719 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3ecfdd4e-2733-4208-a337-49ee45b9645b tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:25.891387 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3ecfdd4e-2733-4208-a337-49ee45b9645b tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:25.892320 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3ecfdd4e-2733-4208-a337-49ee45b9645b tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:25.893020 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3ecfdd4e-2733-4208-a337-49ee45b9645b tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:25.894055 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3ecfdd4e-2733-4208-a337-49ee45b9645b tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:26.811044 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-3ecfdd4e-2733-4208-a337-49ee45b9645b tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:26.825197 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3ecfdd4e-2733-4208-a337-49ee45b9645b tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/27e4cd67-a4b3-440d-81dd-963f6372b385" status: 200 len: 1308 microversion: 2.1 time: 0.947174 Sep 23 04:45:26.827832 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1602/3283] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:45:25 2022] GET /compute/v2.1/servers/27e4cd67-a4b3-440d-81dd-963f6372b385 => generated 1308 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:45:26.828181 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-86d8533d-8619-4190-b69c-1f931842ebb3 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11980041918484990dac709544d0b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c43f2b70bc74a48b62fb4115337f073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:26.837014 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-86d8533d-8619-4190-b69c-1f931842ebb3 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/servers/188a699b-0a1a-46b4-9a03-788af481d3ca" status: 200 len: 1498 microversion: 2.1 time: 1.146075 Sep 23 04:45:26.842058 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1682/3284] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:45:25 2022] GET /compute/v2.1/servers/188a699b-0a1a-46b4-9a03-788af481d3ca => generated 1498 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:45:26.846425 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-307a12f8-144a-48b8-93a5-9f9c82dcf5a3 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:26.847240 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-307a12f8-144a-48b8-93a5-9f9c82dcf5a3 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] [instance: a369d441-1f65-4e05-ba68-8e606497a368] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:26.849784 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8f86d89d-de01-49d9-87c1-d45355c8d819 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:26.853369 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-8f86d89d-de01-49d9-87c1-d45355c8d819 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] [instance: b1eab370-87bb-4d58-bcaf-c41520e016a0] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:26.856681 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-307a12f8-144a-48b8-93a5-9f9c82dcf5a3 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:26.858321 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-307a12f8-144a-48b8-93a5-9f9c82dcf5a3 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:26.859549 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-307a12f8-144a-48b8-93a5-9f9c82dcf5a3 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:26.861356 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-307a12f8-144a-48b8-93a5-9f9c82dcf5a3 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:26.861836 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-307a12f8-144a-48b8-93a5-9f9c82dcf5a3 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:26.865426 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-307a12f8-144a-48b8-93a5-9f9c82dcf5a3 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:26.865656 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8f86d89d-de01-49d9-87c1-d45355c8d819 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:26.866190 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8f86d89d-de01-49d9-87c1-d45355c8d819 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:26.866851 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8f86d89d-de01-49d9-87c1-d45355c8d819 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:26.867772 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8f86d89d-de01-49d9-87c1-d45355c8d819 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:26.868445 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8f86d89d-de01-49d9-87c1-d45355c8d819 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:26.868990 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8f86d89d-de01-49d9-87c1-d45355c8d819 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:27.027694 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-307a12f8-144a-48b8-93a5-9f9c82dcf5a3 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aaca3ba23b4c46bcebc4f60a7337a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268508420e3c4d4cb3d60cb19488bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:27.028140 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-8f86d89d-de01-49d9-87c1-d45355c8d819 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a450c16562c24174809ea6819a26c62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebd3f6411d4d9d9a85b84c77efab02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:27.037926 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-8f86d89d-de01-49d9-87c1-d45355c8d819 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a450c16562c24174809ea6819a26c62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebd3f6411d4d9d9a85b84c77efab02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:27.039652 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-8f86d89d-de01-49d9-87c1-d45355c8d819 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a450c16562c24174809ea6819a26c62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebd3f6411d4d9d9a85b84c77efab02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:27.042034 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-8f86d89d-de01-49d9-87c1-d45355c8d819 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] 10.222.0.33 "GET /compute/v2.1/servers/b1eab370-87bb-4d58-bcaf-c41520e016a0" status: 200 len: 1316 microversion: 2.21 time: 0.198761 Sep 23 04:45:27.042777 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1683/3285] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:45:26 2022] GET /compute/v2.1/servers/b1eab370-87bb-4d58-bcaf-c41520e016a0 => generated 1316 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:45:27.050037 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-307a12f8-144a-48b8-93a5-9f9c82dcf5a3 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90aaca3ba23b4c46bcebc4f60a7337a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268508420e3c4d4cb3d60cb19488bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:27.050037 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-307a12f8-144a-48b8-93a5-9f9c82dcf5a3 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90aaca3ba23b4c46bcebc4f60a7337a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268508420e3c4d4cb3d60cb19488bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:27.050037 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-307a12f8-144a-48b8-93a5-9f9c82dcf5a3 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] 10.222.0.33 "GET /compute/v2.1/servers/a369d441-1f65-4e05-ba68-8e606497a368" status: 200 len: 1407 microversion: 2.54 time: 0.208576 Sep 23 04:45:27.050037 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1603/3286] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:45:26 2022] GET /compute/v2.1/servers/a369d441-1f65-4e05-ba68-8e606497a368 => generated 1407 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:45:27.223814 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-a3f0030c-d69f-4fc0-868b-9a626d9f00a4 req-5b7b001e-31ca-4809-96b5-a292c2d73b6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27e4cd67-a4b3-440d-81dd-963f6372b385", "tag": "ed9f6280-d98e-41c6-bd3c-e1eafb0f3027"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:45:27.234367 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-a3f0030c-d69f-4fc0-868b-9a626d9f00a4 req-5b7b001e-31ca-4809-96b5-a292c2d73b6a service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:27.241174 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-a3f0030c-d69f-4fc0-868b-9a626d9f00a4 req-5b7b001e-31ca-4809-96b5-a292c2d73b6a service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:27.241174 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-a3f0030c-d69f-4fc0-868b-9a626d9f00a4 req-5b7b001e-31ca-4809-96b5-a292c2d73b6a service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:27.261468 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-a3f0030c-d69f-4fc0-868b-9a626d9f00a4 req-5b7b001e-31ca-4809-96b5-a292c2d73b6a service nova] Creating event network-changed:ed9f6280-d98e-41c6-bd3c-e1eafb0f3027 for instance 27e4cd67-a4b3-440d-81dd-963f6372b385 on n-h2-846463-3 Sep 23 04:45:27.271805 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-a3f0030c-d69f-4fc0-868b-9a626d9f00a4 req-5b7b001e-31ca-4809-96b5-a292c2d73b6a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051548 Sep 23 04:45:27.275874 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1604/3287] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:45:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:45:27.863291 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=4 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:45:27.865082 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-fd5aec31-2fc5-466b-9e43-e134baf3ddef tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:27.865699 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-fd5aec31-2fc5-466b-9e43-e134baf3ddef tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 27e4cd67-a4b3-440d-81dd-963f6372b385] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:27.871320 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-01b6390a-0fb6-463b-8f01-dcc90694846f tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:27.875271 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-01b6390a-0fb6-463b-8f01-dcc90694846f tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] [instance: 188a699b-0a1a-46b4-9a03-788af481d3ca] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:27.881023 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fd5aec31-2fc5-466b-9e43-e134baf3ddef tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:27.881784 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fd5aec31-2fc5-466b-9e43-e134baf3ddef tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:27.882406 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fd5aec31-2fc5-466b-9e43-e134baf3ddef tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:27.883291 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fd5aec31-2fc5-466b-9e43-e134baf3ddef tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:27.883844 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-01b6390a-0fb6-463b-8f01-dcc90694846f tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:27.884195 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fd5aec31-2fc5-466b-9e43-e134baf3ddef tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:27.884320 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-01b6390a-0fb6-463b-8f01-dcc90694846f tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:27.884770 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-01b6390a-0fb6-463b-8f01-dcc90694846f tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:27.885474 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-01b6390a-0fb6-463b-8f01-dcc90694846f tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:27.885788 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fd5aec31-2fc5-466b-9e43-e134baf3ddef tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:27.891785 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-01b6390a-0fb6-463b-8f01-dcc90694846f tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:27.893699 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-01b6390a-0fb6-463b-8f01-dcc90694846f tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:28.791680 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-fd5aec31-2fc5-466b-9e43-e134baf3ddef tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:28.805775 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-fd5aec31-2fc5-466b-9e43-e134baf3ddef tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/27e4cd67-a4b3-440d-81dd-963f6372b385" status: 200 len: 1308 microversion: 2.1 time: 0.945828 Sep 23 04:45:28.808097 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1684/3288] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:45:27 2022] GET /compute/v2.1/servers/27e4cd67-a4b3-440d-81dd-963f6372b385 => generated 1308 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:45:28.814700 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f948855e-9de3-4772-97b1-de0d88658aad tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:28.816191 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f948855e-9de3-4772-97b1-de0d88658aad tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] [instance: b1eab370-87bb-4d58-bcaf-c41520e016a0] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:28.823461 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f948855e-9de3-4772-97b1-de0d88658aad tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:28.827459 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f948855e-9de3-4772-97b1-de0d88658aad tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:28.828623 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f948855e-9de3-4772-97b1-de0d88658aad tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:28.829441 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-01b6390a-0fb6-463b-8f01-dcc90694846f tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11980041918484990dac709544d0b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c43f2b70bc74a48b62fb4115337f073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:28.829673 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f948855e-9de3-4772-97b1-de0d88658aad tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:28.830281 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f948855e-9de3-4772-97b1-de0d88658aad tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:28.836749 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f948855e-9de3-4772-97b1-de0d88658aad tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:28.846671 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-01b6390a-0fb6-463b-8f01-dcc90694846f tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/servers/188a699b-0a1a-46b4-9a03-788af481d3ca" status: 200 len: 1498 microversion: 2.1 time: 0.981168 Sep 23 04:45:28.848686 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1605/3289] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:45:27 2022] GET /compute/v2.1/servers/188a699b-0a1a-46b4-9a03-788af481d3ca => generated 1498 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:45:28.867313 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6ac331a7-b0d5-4011-a588-4f0d327fffd1 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:28.868920 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-6ac331a7-b0d5-4011-a588-4f0d327fffd1 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] [instance: a369d441-1f65-4e05-ba68-8e606497a368] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:28.885542 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6ac331a7-b0d5-4011-a588-4f0d327fffd1 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:28.886840 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6ac331a7-b0d5-4011-a588-4f0d327fffd1 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:28.887538 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6ac331a7-b0d5-4011-a588-4f0d327fffd1 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:28.888276 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6ac331a7-b0d5-4011-a588-4f0d327fffd1 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:28.888740 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6ac331a7-b0d5-4011-a588-4f0d327fffd1 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:28.889339 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6ac331a7-b0d5-4011-a588-4f0d327fffd1 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:29.021030 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:45:29.073323 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6ac331a7-b0d5-4011-a588-4f0d327fffd1 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aaca3ba23b4c46bcebc4f60a7337a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268508420e3c4d4cb3d60cb19488bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:29.124504 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6ac331a7-b0d5-4011-a588-4f0d327fffd1 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90aaca3ba23b4c46bcebc4f60a7337a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268508420e3c4d4cb3d60cb19488bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:29.133236 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6ac331a7-b0d5-4011-a588-4f0d327fffd1 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90aaca3ba23b4c46bcebc4f60a7337a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268508420e3c4d4cb3d60cb19488bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:29.136235 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-6ac331a7-b0d5-4011-a588-4f0d327fffd1 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] 10.222.0.33 "GET /compute/v2.1/servers/a369d441-1f65-4e05-ba68-8e606497a368" status: 200 len: 1407 microversion: 2.54 time: 0.286272 Sep 23 04:45:29.139866 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1606/3290] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:45:28 2022] GET /compute/v2.1/servers/a369d441-1f65-4e05-ba68-8e606497a368 => generated 1407 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:45:29.424208 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f948855e-9de3-4772-97b1-de0d88658aad tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a450c16562c24174809ea6819a26c62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebd3f6411d4d9d9a85b84c77efab02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:29.443866 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f948855e-9de3-4772-97b1-de0d88658aad tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a450c16562c24174809ea6819a26c62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebd3f6411d4d9d9a85b84c77efab02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:29.448989 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f948855e-9de3-4772-97b1-de0d88658aad tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a450c16562c24174809ea6819a26c62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebd3f6411d4d9d9a85b84c77efab02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:29.452040 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f948855e-9de3-4772-97b1-de0d88658aad tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] 10.222.0.33 "GET /compute/v2.1/servers/b1eab370-87bb-4d58-bcaf-c41520e016a0" status: 200 len: 1358 microversion: 2.21 time: 0.643089 Sep 23 04:45:29.455939 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1685/3291] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:45:28 2022] GET /compute/v2.1/servers/b1eab370-87bb-4d58-bcaf-c41520e016a0 => generated 1358 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:45:29.835216 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1669dbe0-97ec-4b8d-88f2-088d368e1347 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:29.836248 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-1669dbe0-97ec-4b8d-88f2-088d368e1347 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 27e4cd67-a4b3-440d-81dd-963f6372b385] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:29.846520 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1669dbe0-97ec-4b8d-88f2-088d368e1347 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:29.853065 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1669dbe0-97ec-4b8d-88f2-088d368e1347 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:29.853525 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1669dbe0-97ec-4b8d-88f2-088d368e1347 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:29.854388 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1669dbe0-97ec-4b8d-88f2-088d368e1347 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:29.854752 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1669dbe0-97ec-4b8d-88f2-088d368e1347 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:29.855177 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1669dbe0-97ec-4b8d-88f2-088d368e1347 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:29.884568 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2d4703ff-e536-491e-a4eb-8f8aadaf5777 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:29.888835 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-2d4703ff-e536-491e-a4eb-8f8aadaf5777 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] [instance: 188a699b-0a1a-46b4-9a03-788af481d3ca] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:29.906136 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2d4703ff-e536-491e-a4eb-8f8aadaf5777 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:29.906964 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2d4703ff-e536-491e-a4eb-8f8aadaf5777 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:29.907809 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2d4703ff-e536-491e-a4eb-8f8aadaf5777 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:29.910524 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2d4703ff-e536-491e-a4eb-8f8aadaf5777 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:29.911585 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2d4703ff-e536-491e-a4eb-8f8aadaf5777 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:29.912253 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2d4703ff-e536-491e-a4eb-8f8aadaf5777 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:30.186383 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=10 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:45:30.245114 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-1669dbe0-97ec-4b8d-88f2-088d368e1347 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:30.252399 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-1669dbe0-97ec-4b8d-88f2-088d368e1347 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/27e4cd67-a4b3-440d-81dd-963f6372b385" status: 200 len: 1308 microversion: 2.1 time: 0.421349 Sep 23 04:45:30.252977 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1607/3292] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:45:29 2022] GET /compute/v2.1/servers/27e4cd67-a4b3-440d-81dd-963f6372b385 => generated 1308 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:45:30.276021 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d9de75e3-f07d-46ac-a15a-6496003f4ac9 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:30.276468 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d9de75e3-f07d-46ac-a15a-6496003f4ac9 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] [instance: a369d441-1f65-4e05-ba68-8e606497a368] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:30.294052 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d9de75e3-f07d-46ac-a15a-6496003f4ac9 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:30.294905 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d9de75e3-f07d-46ac-a15a-6496003f4ac9 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:30.295422 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d9de75e3-f07d-46ac-a15a-6496003f4ac9 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:30.296295 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d9de75e3-f07d-46ac-a15a-6496003f4ac9 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:30.296823 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d9de75e3-f07d-46ac-a15a-6496003f4ac9 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:30.297545 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d9de75e3-f07d-46ac-a15a-6496003f4ac9 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:30.361228 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2d4703ff-e536-491e-a4eb-8f8aadaf5777 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11980041918484990dac709544d0b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c43f2b70bc74a48b62fb4115337f073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:30.387630 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2d4703ff-e536-491e-a4eb-8f8aadaf5777 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/servers/188a699b-0a1a-46b4-9a03-788af481d3ca" status: 200 len: 1475 microversion: 2.1 time: 0.515280 Sep 23 04:45:30.405383 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1686/3293] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:45:29 2022] GET /compute/v2.1/servers/188a699b-0a1a-46b4-9a03-788af481d3ca => generated 1475 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:45:30.411123 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6d2253b4-60e3-4b38-84a4-7bb94295a09a tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1862813312"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:45:30.412096 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d9de75e3-f07d-46ac-a15a-6496003f4ac9 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aaca3ba23b4c46bcebc4f60a7337a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268508420e3c4d4cb3d60cb19488bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:30.413598 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-6d2253b4-60e3-4b38-84a4-7bb94295a09a tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] [instance: 188a699b-0a1a-46b4-9a03-788af481d3ca] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:30.426741 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6d2253b4-60e3-4b38-84a4-7bb94295a09a tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:30.430573 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6d2253b4-60e3-4b38-84a4-7bb94295a09a tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:30.431156 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d9de75e3-f07d-46ac-a15a-6496003f4ac9 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90aaca3ba23b4c46bcebc4f60a7337a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268508420e3c4d4cb3d60cb19488bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:30.431280 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6d2253b4-60e3-4b38-84a4-7bb94295a09a tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:30.432090 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6d2253b4-60e3-4b38-84a4-7bb94295a09a tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:30.432634 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d9de75e3-f07d-46ac-a15a-6496003f4ac9 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90aaca3ba23b4c46bcebc4f60a7337a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268508420e3c4d4cb3d60cb19488bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:30.432780 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6d2253b4-60e3-4b38-84a4-7bb94295a09a tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:30.433269 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6d2253b4-60e3-4b38-84a4-7bb94295a09a tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:30.433907 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d9de75e3-f07d-46ac-a15a-6496003f4ac9 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] 10.222.0.33 "GET /compute/v2.1/servers/a369d441-1f65-4e05-ba68-8e606497a368" status: 200 len: 1407 microversion: 2.54 time: 0.174140 Sep 23 04:45:30.434695 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1608/3294] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:45:30 2022] GET /compute/v2.1/servers/a369d441-1f65-4e05-ba68-8e606497a368 => generated 1407 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:45:30.490639 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-fc7f9656-8e39-433a-8309-9531ea010b51 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:30.493410 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-fc7f9656-8e39-433a-8309-9531ea010b51 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] [instance: b1eab370-87bb-4d58-bcaf-c41520e016a0] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:30.504861 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fc7f9656-8e39-433a-8309-9531ea010b51 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:30.506228 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fc7f9656-8e39-433a-8309-9531ea010b51 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:30.507687 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fc7f9656-8e39-433a-8309-9531ea010b51 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:30.508522 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fc7f9656-8e39-433a-8309-9531ea010b51 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:30.510893 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fc7f9656-8e39-433a-8309-9531ea010b51 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:30.510893 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fc7f9656-8e39-433a-8309-9531ea010b51 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:30.738010 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-fc7f9656-8e39-433a-8309-9531ea010b51 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a450c16562c24174809ea6819a26c62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebd3f6411d4d9d9a85b84c77efab02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:30.746934 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-fc7f9656-8e39-433a-8309-9531ea010b51 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a450c16562c24174809ea6819a26c62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebd3f6411d4d9d9a85b84c77efab02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:30.748426 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-fc7f9656-8e39-433a-8309-9531ea010b51 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a450c16562c24174809ea6819a26c62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebd3f6411d4d9d9a85b84c77efab02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:30.750274 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-fc7f9656-8e39-433a-8309-9531ea010b51 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] 10.222.0.33 "GET /compute/v2.1/servers/b1eab370-87bb-4d58-bcaf-c41520e016a0" status: 200 len: 1358 microversion: 2.21 time: 0.266206 Sep 23 04:45:30.750855 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1609/3295] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:45:30 2022] GET /compute/v2.1/servers/b1eab370-87bb-4d58-bcaf-c41520e016a0 => generated 1358 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:45:30.864305 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-fc904ff3-ccb7-489d-9fd9-b1a268016349 req-4658f4c8-0fa5-450d-bcb5-e0eb236e3174 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1eab370-87bb-4d58-bcaf-c41520e016a0", "tag": "eae362d7-35fd-4917-9b61-a1977494380e"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:45:30.879014 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-fc904ff3-ccb7-489d-9fd9-b1a268016349 req-4658f4c8-0fa5-450d-bcb5-e0eb236e3174 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:30.879504 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-fc904ff3-ccb7-489d-9fd9-b1a268016349 req-4658f4c8-0fa5-450d-bcb5-e0eb236e3174 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:30.879941 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-fc904ff3-ccb7-489d-9fd9-b1a268016349 req-4658f4c8-0fa5-450d-bcb5-e0eb236e3174 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:30.892940 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-fc904ff3-ccb7-489d-9fd9-b1a268016349 req-4658f4c8-0fa5-450d-bcb5-e0eb236e3174 service nova] Creating event network-changed:eae362d7-35fd-4917-9b61-a1977494380e for instance b1eab370-87bb-4d58-bcaf-c41520e016a0 on n-h1-846463-3 Sep 23 04:45:30.900904 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-fc904ff3-ccb7-489d-9fd9-b1a268016349 req-4658f4c8-0fa5-450d-bcb5-e0eb236e3174 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039321 Sep 23 04:45:30.901801 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1610/3296] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:45:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:45:30.939273 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6d2253b4-60e3-4b38-84a4-7bb94295a09a tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "POST /compute/v2.1/servers/188a699b-0a1a-46b4-9a03-788af481d3ca/action" status: 202 len: 0 microversion: 2.1 time: 0.528714 Sep 23 04:45:30.940561 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1687/3297] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:45:30 2022] POST /compute/v2.1/servers/188a699b-0a1a-46b4-9a03-788af481d3ca/action => generated 0 bytes in 534 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 23 04:45:30.957275 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-47866cc0-7302-4361-a31a-bf16ed5ae482 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '.version_select at 0x7ff1baa35ca0>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:31.015068 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-47866cc0-7302-4361-a31a-bf16ed5ae482 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/images/61d751db-b940-4f89-b620-4902c2decb81" status: 200 len: 1414 microversion: 2.1 time: 0.067302 Sep 23 04:45:31.016049 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1611/3298] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:45:30 2022] GET /compute/v2.1/images/61d751db-b940-4f89-b620-4902c2decb81 => generated 1414 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:45:31.287832 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-cedf0020-d45b-457d-928d-fe08c3e02f5b tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:31.288550 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-cedf0020-d45b-457d-928d-fe08c3e02f5b tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 27e4cd67-a4b3-440d-81dd-963f6372b385] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:31.297362 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cedf0020-d45b-457d-928d-fe08c3e02f5b tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:31.302424 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cedf0020-d45b-457d-928d-fe08c3e02f5b tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:31.302890 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cedf0020-d45b-457d-928d-fe08c3e02f5b tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:31.305862 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cedf0020-d45b-457d-928d-fe08c3e02f5b tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:31.307698 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cedf0020-d45b-457d-928d-fe08c3e02f5b tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:31.308419 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cedf0020-d45b-457d-928d-fe08c3e02f5b tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:31.463245 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-78e39640-f3a1-4893-9722-7a0566c6bd52 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:31.464986 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-78e39640-f3a1-4893-9722-7a0566c6bd52 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] [instance: a369d441-1f65-4e05-ba68-8e606497a368] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:31.477459 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-78e39640-f3a1-4893-9722-7a0566c6bd52 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:31.479043 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-78e39640-f3a1-4893-9722-7a0566c6bd52 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:31.482213 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-78e39640-f3a1-4893-9722-7a0566c6bd52 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:31.482213 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-78e39640-f3a1-4893-9722-7a0566c6bd52 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:31.482213 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-78e39640-f3a1-4893-9722-7a0566c6bd52 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:31.482592 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-78e39640-f3a1-4893-9722-7a0566c6bd52 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:31.643170 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-78e39640-f3a1-4893-9722-7a0566c6bd52 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aaca3ba23b4c46bcebc4f60a7337a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268508420e3c4d4cb3d60cb19488bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:31.657117 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-78e39640-f3a1-4893-9722-7a0566c6bd52 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90aaca3ba23b4c46bcebc4f60a7337a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268508420e3c4d4cb3d60cb19488bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:31.658683 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-78e39640-f3a1-4893-9722-7a0566c6bd52 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90aaca3ba23b4c46bcebc4f60a7337a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268508420e3c4d4cb3d60cb19488bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:31.659907 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-78e39640-f3a1-4893-9722-7a0566c6bd52 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] 10.222.0.33 "GET /compute/v2.1/servers/a369d441-1f65-4e05-ba68-8e606497a368" status: 200 len: 1407 microversion: 2.54 time: 0.204094 Sep 23 04:45:31.664704 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1612/3299] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:45:31 2022] GET /compute/v2.1/servers/a369d441-1f65-4e05-ba68-8e606497a368 => generated 1407 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:45:31.775510 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-bc71a935-06a1-45c1-9b41-fc24b78f6104 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:31.776285 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-bc71a935-06a1-45c1-9b41-fc24b78f6104 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] [instance: b1eab370-87bb-4d58-bcaf-c41520e016a0] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:31.783558 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bc71a935-06a1-45c1-9b41-fc24b78f6104 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:31.784304 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bc71a935-06a1-45c1-9b41-fc24b78f6104 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:31.784766 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bc71a935-06a1-45c1-9b41-fc24b78f6104 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:31.785485 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bc71a935-06a1-45c1-9b41-fc24b78f6104 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:31.785974 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bc71a935-06a1-45c1-9b41-fc24b78f6104 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:31.786437 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bc71a935-06a1-45c1-9b41-fc24b78f6104 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:32.356840 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-cedf0020-d45b-457d-928d-fe08c3e02f5b tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:32.367896 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-cedf0020-d45b-457d-928d-fe08c3e02f5b tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/27e4cd67-a4b3-440d-81dd-963f6372b385" status: 200 len: 1308 microversion: 2.1 time: 1.083720 Sep 23 04:45:32.368915 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1688/3300] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:45:31 2022] GET /compute/v2.1/servers/27e4cd67-a4b3-440d-81dd-963f6372b385 => generated 1308 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:45:32.376151 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-042e6897-a7f7-4236-8902-39b7c0848cd9 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '.version_select at 0x7ff1c3f3a8b0>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:32.458744 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-042e6897-a7f7-4236-8902-39b7c0848cd9 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/images/61d751db-b940-4f89-b620-4902c2decb81" status: 200 len: 1414 microversion: 2.1 time: 0.088199 Sep 23 04:45:32.460641 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1689/3301] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:45:32 2022] GET /compute/v2.1/images/61d751db-b940-4f89-b620-4902c2decb81 => generated 1414 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:45:32.618619 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-bc71a935-06a1-45c1-9b41-fc24b78f6104 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a450c16562c24174809ea6819a26c62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebd3f6411d4d9d9a85b84c77efab02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:32.650348 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-bc71a935-06a1-45c1-9b41-fc24b78f6104 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a450c16562c24174809ea6819a26c62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebd3f6411d4d9d9a85b84c77efab02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:32.663831 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-bc71a935-06a1-45c1-9b41-fc24b78f6104 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a450c16562c24174809ea6819a26c62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebd3f6411d4d9d9a85b84c77efab02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:32.663831 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-bc71a935-06a1-45c1-9b41-fc24b78f6104 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] 10.222.0.33 "GET /compute/v2.1/servers/b1eab370-87bb-4d58-bcaf-c41520e016a0" status: 200 len: 1358 microversion: 2.21 time: 0.889645 Sep 23 04:45:32.680620 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1613/3302] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:45:31 2022] GET /compute/v2.1/servers/b1eab370-87bb-4d58-bcaf-c41520e016a0 => generated 1358 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:45:32.694256 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ab66bf5f-4b74-4826-b661-df8866d42e96 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:32.705811 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ab66bf5f-4b74-4826-b661-df8866d42e96 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] [instance: a369d441-1f65-4e05-ba68-8e606497a368] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:32.730657 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ab66bf5f-4b74-4826-b661-df8866d42e96 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:32.732623 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ab66bf5f-4b74-4826-b661-df8866d42e96 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:32.735420 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ab66bf5f-4b74-4826-b661-df8866d42e96 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:32.738015 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ab66bf5f-4b74-4826-b661-df8866d42e96 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:32.743079 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ab66bf5f-4b74-4826-b661-df8866d42e96 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:32.743819 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ab66bf5f-4b74-4826-b661-df8866d42e96 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:33.011059 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ab66bf5f-4b74-4826-b661-df8866d42e96 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aaca3ba23b4c46bcebc4f60a7337a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268508420e3c4d4cb3d60cb19488bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:33.022530 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ab66bf5f-4b74-4826-b661-df8866d42e96 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90aaca3ba23b4c46bcebc4f60a7337a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268508420e3c4d4cb3d60cb19488bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:33.024931 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ab66bf5f-4b74-4826-b661-df8866d42e96 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90aaca3ba23b4c46bcebc4f60a7337a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268508420e3c4d4cb3d60cb19488bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:33.027325 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ab66bf5f-4b74-4826-b661-df8866d42e96 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] 10.222.0.33 "GET /compute/v2.1/servers/a369d441-1f65-4e05-ba68-8e606497a368" status: 200 len: 1407 microversion: 2.54 time: 0.339489 Sep 23 04:45:33.034928 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1690/3303] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:45:32 2022] GET /compute/v2.1/servers/a369d441-1f65-4e05-ba68-8e606497a368 => generated 1407 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:45:33.396786 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-82033264-c07a-4a5a-8166-09a927578592 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:33.397883 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-82033264-c07a-4a5a-8166-09a927578592 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 27e4cd67-a4b3-440d-81dd-963f6372b385] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:33.410985 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-82033264-c07a-4a5a-8166-09a927578592 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:33.411826 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-82033264-c07a-4a5a-8166-09a927578592 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:33.413245 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-82033264-c07a-4a5a-8166-09a927578592 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:33.414008 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-82033264-c07a-4a5a-8166-09a927578592 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:33.415031 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-82033264-c07a-4a5a-8166-09a927578592 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:33.415633 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-82033264-c07a-4a5a-8166-09a927578592 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:33.476236 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-cc85fdbc-f083-4941-bb73-6e6b06778c74 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '.version_select at 0x7ff1bb824c10>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:33.568373 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-cc85fdbc-f083-4941-bb73-6e6b06778c74 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/images/61d751db-b940-4f89-b620-4902c2decb81" status: 200 len: 1414 microversion: 2.1 time: 0.097643 Sep 23 04:45:33.576421 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1691/3304] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:45:33 2022] GET /compute/v2.1/images/61d751db-b940-4f89-b620-4902c2decb81 => generated 1414 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:45:33.692961 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e4c5ee6f-dd7a-48c0-ae4b-cf87c8417746 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:33.693338 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e4c5ee6f-dd7a-48c0-ae4b-cf87c8417746 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] [instance: b1eab370-87bb-4d58-bcaf-c41520e016a0] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:33.695597 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=7 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:45:33.712088 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e4c5ee6f-dd7a-48c0-ae4b-cf87c8417746 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:33.716551 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e4c5ee6f-dd7a-48c0-ae4b-cf87c8417746 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:33.717324 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e4c5ee6f-dd7a-48c0-ae4b-cf87c8417746 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:33.722688 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e4c5ee6f-dd7a-48c0-ae4b-cf87c8417746 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:33.723406 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e4c5ee6f-dd7a-48c0-ae4b-cf87c8417746 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:33.726108 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e4c5ee6f-dd7a-48c0-ae4b-cf87c8417746 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:33.983185 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-82033264-c07a-4a5a-8166-09a927578592 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:33.996873 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-82033264-c07a-4a5a-8166-09a927578592 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/27e4cd67-a4b3-440d-81dd-963f6372b385" status: 200 len: 1308 microversion: 2.1 time: 0.607518 Sep 23 04:45:34.001055 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1614/3305] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:45:33 2022] GET /compute/v2.1/servers/27e4cd67-a4b3-440d-81dd-963f6372b385 => generated 1308 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:45:34.063202 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-12aa27db-6c58-4262-9f62-12f6b6e39424 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:34.063862 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-12aa27db-6c58-4262-9f62-12f6b6e39424 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] [instance: a369d441-1f65-4e05-ba68-8e606497a368] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:34.074993 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-12aa27db-6c58-4262-9f62-12f6b6e39424 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:34.080833 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-12aa27db-6c58-4262-9f62-12f6b6e39424 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:34.080833 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-12aa27db-6c58-4262-9f62-12f6b6e39424 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:34.080833 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-12aa27db-6c58-4262-9f62-12f6b6e39424 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:34.082250 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-12aa27db-6c58-4262-9f62-12f6b6e39424 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:34.083019 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-12aa27db-6c58-4262-9f62-12f6b6e39424 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:34.206563 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-12aa27db-6c58-4262-9f62-12f6b6e39424 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aaca3ba23b4c46bcebc4f60a7337a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268508420e3c4d4cb3d60cb19488bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:34.220945 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-12aa27db-6c58-4262-9f62-12f6b6e39424 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90aaca3ba23b4c46bcebc4f60a7337a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268508420e3c4d4cb3d60cb19488bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:34.222981 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-12aa27db-6c58-4262-9f62-12f6b6e39424 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90aaca3ba23b4c46bcebc4f60a7337a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268508420e3c4d4cb3d60cb19488bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:34.224339 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-12aa27db-6c58-4262-9f62-12f6b6e39424 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] 10.222.0.33 "GET /compute/v2.1/servers/a369d441-1f65-4e05-ba68-8e606497a368" status: 200 len: 1407 microversion: 2.54 time: 0.166733 Sep 23 04:45:34.229356 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1615/3306] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:45:34 2022] GET /compute/v2.1/servers/a369d441-1f65-4e05-ba68-8e606497a368 => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:45:34.267751 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e4c5ee6f-dd7a-48c0-ae4b-cf87c8417746 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a450c16562c24174809ea6819a26c62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebd3f6411d4d9d9a85b84c77efab02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:34.278099 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e4c5ee6f-dd7a-48c0-ae4b-cf87c8417746 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a450c16562c24174809ea6819a26c62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebd3f6411d4d9d9a85b84c77efab02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:34.279608 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e4c5ee6f-dd7a-48c0-ae4b-cf87c8417746 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a450c16562c24174809ea6819a26c62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebd3f6411d4d9d9a85b84c77efab02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:34.283071 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e4c5ee6f-dd7a-48c0-ae4b-cf87c8417746 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] 10.222.0.33 "GET /compute/v2.1/servers/b1eab370-87bb-4d58-bcaf-c41520e016a0" status: 200 len: 1358 microversion: 2.21 time: 0.593477 Sep 23 04:45:34.283925 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1692/3307] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:45:33 2022] GET /compute/v2.1/servers/b1eab370-87bb-4d58-bcaf-c41520e016a0 => generated 1358 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:45:34.360727 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-4361c58b-6767-43c0-9d02-917c1d3055d3 req-d2320688-fb22-4b51-930f-098effa067a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27e4cd67-a4b3-440d-81dd-963f6372b385", "name": "network-vif-plugged", "status": "completed", "tag": "ed9f6280-d98e-41c6-bd3c-e1eafb0f3027"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:45:34.384038 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-4361c58b-6767-43c0-9d02-917c1d3055d3 req-d2320688-fb22-4b51-930f-098effa067a4 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:34.385573 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-4361c58b-6767-43c0-9d02-917c1d3055d3 req-d2320688-fb22-4b51-930f-098effa067a4 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:34.390339 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-4361c58b-6767-43c0-9d02-917c1d3055d3 req-d2320688-fb22-4b51-930f-098effa067a4 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:34.423156 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-4361c58b-6767-43c0-9d02-917c1d3055d3 req-d2320688-fb22-4b51-930f-098effa067a4 service nova] Creating event network-vif-plugged:ed9f6280-d98e-41c6-bd3c-e1eafb0f3027 for instance 27e4cd67-a4b3-440d-81dd-963f6372b385 on n-h2-846463-3 Sep 23 04:45:34.435901 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-4361c58b-6767-43c0-9d02-917c1d3055d3 req-d2320688-fb22-4b51-930f-098effa067a4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078207 Sep 23 04:45:34.440366 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1616/3308] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:45:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:45:34.587602 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a880e6d6-7038-43fe-b3bc-e33be2f2229c tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '.version_select at 0x7ff1bb7334c0>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:34.673827 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a880e6d6-7038-43fe-b3bc-e33be2f2229c tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/images/61d751db-b940-4f89-b620-4902c2decb81" status: 200 len: 1414 microversion: 2.1 time: 0.090038 Sep 23 04:45:34.674826 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1693/3309] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:45:34 2022] GET /compute/v2.1/images/61d751db-b940-4f89-b620-4902c2decb81 => generated 1414 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:45:35.032165 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0fa84697-df0f-46b3-ae39-bee1070f3338 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:35.034393 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-0fa84697-df0f-46b3-ae39-bee1070f3338 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 27e4cd67-a4b3-440d-81dd-963f6372b385] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:35.048833 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0fa84697-df0f-46b3-ae39-bee1070f3338 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:35.050085 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0fa84697-df0f-46b3-ae39-bee1070f3338 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:35.052179 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0fa84697-df0f-46b3-ae39-bee1070f3338 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:35.053336 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0fa84697-df0f-46b3-ae39-bee1070f3338 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:35.054143 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0fa84697-df0f-46b3-ae39-bee1070f3338 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:35.058720 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0fa84697-df0f-46b3-ae39-bee1070f3338 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:35.259291 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9159ff9b-bf77-455a-adaa-238e3f0806e1 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:35.260150 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-9159ff9b-bf77-455a-adaa-238e3f0806e1 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] [instance: a369d441-1f65-4e05-ba68-8e606497a368] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:35.264524 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=20 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:45:35.274087 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9159ff9b-bf77-455a-adaa-238e3f0806e1 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:35.278024 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9159ff9b-bf77-455a-adaa-238e3f0806e1 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:35.278024 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9159ff9b-bf77-455a-adaa-238e3f0806e1 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:35.278024 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9159ff9b-bf77-455a-adaa-238e3f0806e1 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:35.278024 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9159ff9b-bf77-455a-adaa-238e3f0806e1 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:35.278024 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9159ff9b-bf77-455a-adaa-238e3f0806e1 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:35.404308 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-9159ff9b-bf77-455a-adaa-238e3f0806e1 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aaca3ba23b4c46bcebc4f60a7337a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268508420e3c4d4cb3d60cb19488bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:35.414339 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-9159ff9b-bf77-455a-adaa-238e3f0806e1 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90aaca3ba23b4c46bcebc4f60a7337a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268508420e3c4d4cb3d60cb19488bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:35.416138 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-9159ff9b-bf77-455a-adaa-238e3f0806e1 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90aaca3ba23b4c46bcebc4f60a7337a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268508420e3c4d4cb3d60cb19488bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:35.418114 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-9159ff9b-bf77-455a-adaa-238e3f0806e1 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] 10.222.0.33 "GET /compute/v2.1/servers/a369d441-1f65-4e05-ba68-8e606497a368" status: 200 len: 1407 microversion: 2.54 time: 0.165066 Sep 23 04:45:35.422098 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-0fa84697-df0f-46b3-ae39-bee1070f3338 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:35.430949 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1694/3310] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:45:35 2022] GET /compute/v2.1/servers/a369d441-1f65-4e05-ba68-8e606497a368 => generated 1407 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:45:35.437267 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0fa84697-df0f-46b3-ae39-bee1070f3338 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/27e4cd67-a4b3-440d-81dd-963f6372b385" status: 200 len: 1308 microversion: 2.1 time: 0.414038 Sep 23 04:45:35.438078 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1617/3311] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:45:35 2022] GET /compute/v2.1/servers/27e4cd67-a4b3-440d-81dd-963f6372b385 => generated 1308 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:45:35.443821 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4ff9109f-935d-4efe-bdea-555fdce1c9bc tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:35.444693 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4ff9109f-935d-4efe-bdea-555fdce1c9bc tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] [instance: b1eab370-87bb-4d58-bcaf-c41520e016a0] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:35.450996 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4ff9109f-935d-4efe-bdea-555fdce1c9bc tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:35.451871 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4ff9109f-935d-4efe-bdea-555fdce1c9bc tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:35.453075 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4ff9109f-935d-4efe-bdea-555fdce1c9bc tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:35.454292 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4ff9109f-935d-4efe-bdea-555fdce1c9bc tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:35.455000 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4ff9109f-935d-4efe-bdea-555fdce1c9bc tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:35.455703 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4ff9109f-935d-4efe-bdea-555fdce1c9bc tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:35.690882 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f22cc62e-f4c7-4784-9925-34557f73e215 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '.version_select at 0x7ff1ba987a60>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:35.754547 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f22cc62e-f4c7-4784-9925-34557f73e215 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/images/61d751db-b940-4f89-b620-4902c2decb81" status: 200 len: 1414 microversion: 2.1 time: 0.067965 Sep 23 04:45:35.755359 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1618/3312] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:45:35 2022] GET /compute/v2.1/images/61d751db-b940-4f89-b620-4902c2decb81 => generated 1414 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:45:35.960499 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-4ff9109f-935d-4efe-bdea-555fdce1c9bc tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a450c16562c24174809ea6819a26c62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebd3f6411d4d9d9a85b84c77efab02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:35.988471 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-4ff9109f-935d-4efe-bdea-555fdce1c9bc tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a450c16562c24174809ea6819a26c62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebd3f6411d4d9d9a85b84c77efab02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:36.008023 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-4ff9109f-935d-4efe-bdea-555fdce1c9bc tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a450c16562c24174809ea6819a26c62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebd3f6411d4d9d9a85b84c77efab02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:36.010436 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4ff9109f-935d-4efe-bdea-555fdce1c9bc tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] 10.222.0.33 "GET /compute/v2.1/servers/b1eab370-87bb-4d58-bcaf-c41520e016a0" status: 200 len: 1358 microversion: 2.21 time: 0.578196 Sep 23 04:45:36.015229 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1695/3313] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:45:35 2022] GET /compute/v2.1/servers/b1eab370-87bb-4d58-bcaf-c41520e016a0 => generated 1358 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:45:36.447713 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-932c368a-49ea-4025-9bcf-d80e2d3b587b tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:36.448876 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-932c368a-49ea-4025-9bcf-d80e2d3b587b tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] [instance: a369d441-1f65-4e05-ba68-8e606497a368] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:36.467543 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2519a712-f183-4f42-90ab-660f55fec8b3 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:36.468200 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-2519a712-f183-4f42-90ab-660f55fec8b3 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 27e4cd67-a4b3-440d-81dd-963f6372b385] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:36.470972 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-932c368a-49ea-4025-9bcf-d80e2d3b587b tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:36.476272 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-932c368a-49ea-4025-9bcf-d80e2d3b587b tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:36.476961 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-932c368a-49ea-4025-9bcf-d80e2d3b587b tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:36.477875 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-932c368a-49ea-4025-9bcf-d80e2d3b587b tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:36.478580 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-932c368a-49ea-4025-9bcf-d80e2d3b587b tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:36.479200 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2519a712-f183-4f42-90ab-660f55fec8b3 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:36.479322 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-932c368a-49ea-4025-9bcf-d80e2d3b587b tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:36.480512 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2519a712-f183-4f42-90ab-660f55fec8b3 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:36.486234 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2519a712-f183-4f42-90ab-660f55fec8b3 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:36.487095 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2519a712-f183-4f42-90ab-660f55fec8b3 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:36.487596 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2519a712-f183-4f42-90ab-660f55fec8b3 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:36.488047 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2519a712-f183-4f42-90ab-660f55fec8b3 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:36.493114 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:45:36.617101 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-932c368a-49ea-4025-9bcf-d80e2d3b587b tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aaca3ba23b4c46bcebc4f60a7337a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268508420e3c4d4cb3d60cb19488bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:36.634393 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-932c368a-49ea-4025-9bcf-d80e2d3b587b tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90aaca3ba23b4c46bcebc4f60a7337a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268508420e3c4d4cb3d60cb19488bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:36.635874 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-932c368a-49ea-4025-9bcf-d80e2d3b587b tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90aaca3ba23b4c46bcebc4f60a7337a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268508420e3c4d4cb3d60cb19488bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:36.637103 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-932c368a-49ea-4025-9bcf-d80e2d3b587b tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] 10.222.0.33 "GET /compute/v2.1/servers/a369d441-1f65-4e05-ba68-8e606497a368" status: 200 len: 1407 microversion: 2.54 time: 0.194404 Sep 23 04:45:36.653998 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1619/3314] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:45:36 2022] GET /compute/v2.1/servers/a369d441-1f65-4e05-ba68-8e606497a368 => generated 1407 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:45:36.668424 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-fa3cd1ce-825f-4414-baab-2a5182216cc3 req-e8b55f36-fb6c-4293-902f-c45c8da0ab8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "188a699b-0a1a-46b4-9a03-788af481d3ca", "name": "network-vif-plugged", "status": "completed", "tag": "f0ab08a0-19b4-4e1e-b09d-bc591c3179dd"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:45:36.690556 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-fa3cd1ce-825f-4414-baab-2a5182216cc3 req-e8b55f36-fb6c-4293-902f-c45c8da0ab8b service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:36.691358 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-fa3cd1ce-825f-4414-baab-2a5182216cc3 req-e8b55f36-fb6c-4293-902f-c45c8da0ab8b service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:36.691955 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-fa3cd1ce-825f-4414-baab-2a5182216cc3 req-e8b55f36-fb6c-4293-902f-c45c8da0ab8b service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:36.717865 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-fa3cd1ce-825f-4414-baab-2a5182216cc3 req-e8b55f36-fb6c-4293-902f-c45c8da0ab8b service nova] Creating event network-vif-plugged:f0ab08a0-19b4-4e1e-b09d-bc591c3179dd for instance 188a699b-0a1a-46b4-9a03-788af481d3ca on n-h2-846463-3 Sep 23 04:45:36.736349 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-fa3cd1ce-825f-4414-baab-2a5182216cc3 req-e8b55f36-fb6c-4293-902f-c45c8da0ab8b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080305 Sep 23 04:45:36.737562 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1620/3315] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:45:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:45:36.770669 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-039ad7b6-22b2-4a2c-ac7e-3670b33adec8 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '.version_select at 0x7ff1c3ef0a60>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:36.826836 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-039ad7b6-22b2-4a2c-ac7e-3670b33adec8 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/images/61d751db-b940-4f89-b620-4902c2decb81" status: 200 len: 1414 microversion: 2.1 time: 0.060297 Sep 23 04:45:36.828811 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1621/3316] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:45:36 2022] GET /compute/v2.1/images/61d751db-b940-4f89-b620-4902c2decb81 => generated 1414 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:45:37.040261 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8ff4bae5-7ece-4b82-89be-405e8694f5dd tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:37.041266 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8ff4bae5-7ece-4b82-89be-405e8694f5dd tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] [instance: b1eab370-87bb-4d58-bcaf-c41520e016a0] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:37.060529 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8ff4bae5-7ece-4b82-89be-405e8694f5dd tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:37.062258 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8ff4bae5-7ece-4b82-89be-405e8694f5dd tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:37.063128 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8ff4bae5-7ece-4b82-89be-405e8694f5dd tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:37.064120 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8ff4bae5-7ece-4b82-89be-405e8694f5dd tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:37.065139 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8ff4bae5-7ece-4b82-89be-405e8694f5dd tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:37.065815 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8ff4bae5-7ece-4b82-89be-405e8694f5dd tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:37.091441 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:45:37.593080 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8ff4bae5-7ece-4b82-89be-405e8694f5dd tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a450c16562c24174809ea6819a26c62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebd3f6411d4d9d9a85b84c77efab02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:37.630584 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8ff4bae5-7ece-4b82-89be-405e8694f5dd tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a450c16562c24174809ea6819a26c62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebd3f6411d4d9d9a85b84c77efab02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:37.639098 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8ff4bae5-7ece-4b82-89be-405e8694f5dd tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a450c16562c24174809ea6819a26c62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebd3f6411d4d9d9a85b84c77efab02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:37.642098 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8ff4bae5-7ece-4b82-89be-405e8694f5dd tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] 10.222.0.33 "GET /compute/v2.1/servers/b1eab370-87bb-4d58-bcaf-c41520e016a0" status: 200 len: 1358 microversion: 2.21 time: 0.605774 Sep 23 04:45:37.646286 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1622/3317] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:45:37 2022] GET /compute/v2.1/servers/b1eab370-87bb-4d58-bcaf-c41520e016a0 => generated 1358 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:45:37.673271 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-63549acb-fed9-40c2-8fd2-a464d8ea9fec tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:37.675177 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-63549acb-fed9-40c2-8fd2-a464d8ea9fec tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] [instance: a369d441-1f65-4e05-ba68-8e606497a368] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:37.693432 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-63549acb-fed9-40c2-8fd2-a464d8ea9fec tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:37.706631 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-63549acb-fed9-40c2-8fd2-a464d8ea9fec tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:37.708174 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-63549acb-fed9-40c2-8fd2-a464d8ea9fec tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:37.709236 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-63549acb-fed9-40c2-8fd2-a464d8ea9fec tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:37.712125 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-63549acb-fed9-40c2-8fd2-a464d8ea9fec tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:37.719549 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-63549acb-fed9-40c2-8fd2-a464d8ea9fec tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:37.730293 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2519a712-f183-4f42-90ab-660f55fec8b3 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:37.749625 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2519a712-f183-4f42-90ab-660f55fec8b3 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/27e4cd67-a4b3-440d-81dd-963f6372b385" status: 200 len: 1489 microversion: 2.1 time: 1.282256 Sep 23 04:45:37.753182 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1696/3318] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:45:36 2022] GET /compute/v2.1/servers/27e4cd67-a4b3-440d-81dd-963f6372b385 => generated 1489 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:45:37.784922 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6c69c522-3f43-4042-9163-1eaf8773fff1 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:37.787579 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-6c69c522-3f43-4042-9163-1eaf8773fff1 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 2c316737-b84f-4b49-a5ab-cc0196b15760] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:37.796443 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6c69c522-3f43-4042-9163-1eaf8773fff1 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:37.802207 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6c69c522-3f43-4042-9163-1eaf8773fff1 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:37.806633 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6c69c522-3f43-4042-9163-1eaf8773fff1 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:37.809568 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6c69c522-3f43-4042-9163-1eaf8773fff1 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:37.811252 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6c69c522-3f43-4042-9163-1eaf8773fff1 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:37.829584 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6c69c522-3f43-4042-9163-1eaf8773fff1 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:38.131411 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-63549acb-fed9-40c2-8fd2-a464d8ea9fec tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aaca3ba23b4c46bcebc4f60a7337a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268508420e3c4d4cb3d60cb19488bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:38.142266 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-63549acb-fed9-40c2-8fd2-a464d8ea9fec tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90aaca3ba23b4c46bcebc4f60a7337a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268508420e3c4d4cb3d60cb19488bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:38.166231 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-63549acb-fed9-40c2-8fd2-a464d8ea9fec tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90aaca3ba23b4c46bcebc4f60a7337a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268508420e3c4d4cb3d60cb19488bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:38.166231 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-63549acb-fed9-40c2-8fd2-a464d8ea9fec tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] 10.222.0.33 "GET /compute/v2.1/servers/a369d441-1f65-4e05-ba68-8e606497a368" status: 200 len: 1407 microversion: 2.54 time: 0.484613 Sep 23 04:45:38.166231 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1623/3319] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:45:37 2022] GET /compute/v2.1/servers/a369d441-1f65-4e05-ba68-8e606497a368 => generated 1407 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:45:38.175246 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ff47a885-c807-4e71-b28b-80e844b26b49 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '.version_select at 0x7ff1ba99d550>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:38.290056 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ff47a885-c807-4e71-b28b-80e844b26b49 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/images/61d751db-b940-4f89-b620-4902c2decb81" status: 200 len: 1414 microversion: 2.1 time: 0.123702 Sep 23 04:45:38.290924 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1624/3320] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:45:38 2022] GET /compute/v2.1/images/61d751db-b940-4f89-b620-4902c2decb81 => generated 1414 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:45:38.562671 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-6c69c522-3f43-4042-9163-1eaf8773fff1 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:38.579483 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6c69c522-3f43-4042-9163-1eaf8773fff1 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/2c316737-b84f-4b49-a5ab-cc0196b15760" status: 200 len: 1488 microversion: 2.1 time: 0.798088 Sep 23 04:45:38.580617 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1697/3321] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:45:37 2022] GET /compute/v2.1/servers/2c316737-b84f-4b49-a5ab-cc0196b15760 => generated 1488 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:45:38.608352 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a325e74c-2f54-4f7f-b2a7-2d806010973e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:38.608949 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a325e74c-2f54-4f7f-b2a7-2d806010973e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 27e4cd67-a4b3-440d-81dd-963f6372b385] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:38.620991 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a325e74c-2f54-4f7f-b2a7-2d806010973e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:38.621406 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a325e74c-2f54-4f7f-b2a7-2d806010973e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:38.621840 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a325e74c-2f54-4f7f-b2a7-2d806010973e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:38.622578 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a325e74c-2f54-4f7f-b2a7-2d806010973e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:38.623035 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a325e74c-2f54-4f7f-b2a7-2d806010973e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:38.623469 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a325e74c-2f54-4f7f-b2a7-2d806010973e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:38.677214 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4f1139d4-20fe-41f7-8b50-45dfe9f8a375 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:38.677854 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4f1139d4-20fe-41f7-8b50-45dfe9f8a375 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] [instance: b1eab370-87bb-4d58-bcaf-c41520e016a0] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:38.696760 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4f1139d4-20fe-41f7-8b50-45dfe9f8a375 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:38.702734 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4f1139d4-20fe-41f7-8b50-45dfe9f8a375 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:38.710135 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4f1139d4-20fe-41f7-8b50-45dfe9f8a375 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:38.711041 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4f1139d4-20fe-41f7-8b50-45dfe9f8a375 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:38.718329 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4f1139d4-20fe-41f7-8b50-45dfe9f8a375 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:38.718825 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4f1139d4-20fe-41f7-8b50-45dfe9f8a375 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:39.208610 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a325e74c-2f54-4f7f-b2a7-2d806010973e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:39.218204 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a325e74c-2f54-4f7f-b2a7-2d806010973e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/27e4cd67-a4b3-440d-81dd-963f6372b385" status: 200 len: 1489 microversion: 2.1 time: 0.614272 Sep 23 04:45:39.223085 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1625/3322] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:45:38 2022] GET /compute/v2.1/servers/27e4cd67-a4b3-440d-81dd-963f6372b385 => generated 1489 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:45:39.235673 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0dce376a-fab1-4438-bf13-089bf87ae6f0 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:39.237763 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-0dce376a-fab1-4438-bf13-089bf87ae6f0 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] [instance: a369d441-1f65-4e05-ba68-8e606497a368] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:39.252426 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0dce376a-fab1-4438-bf13-089bf87ae6f0 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:39.255077 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0dce376a-fab1-4438-bf13-089bf87ae6f0 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:39.255907 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0dce376a-fab1-4438-bf13-089bf87ae6f0 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:39.258537 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0dce376a-fab1-4438-bf13-089bf87ae6f0 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:39.259953 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0dce376a-fab1-4438-bf13-089bf87ae6f0 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:39.262603 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0dce376a-fab1-4438-bf13-089bf87ae6f0 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:39.423875 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-0dce376a-fab1-4438-bf13-089bf87ae6f0 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aaca3ba23b4c46bcebc4f60a7337a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268508420e3c4d4cb3d60cb19488bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:39.435765 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-0dce376a-fab1-4438-bf13-089bf87ae6f0 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90aaca3ba23b4c46bcebc4f60a7337a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268508420e3c4d4cb3d60cb19488bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:39.441931 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-0dce376a-fab1-4438-bf13-089bf87ae6f0 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90aaca3ba23b4c46bcebc4f60a7337a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268508420e3c4d4cb3d60cb19488bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:39.445269 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0dce376a-fab1-4438-bf13-089bf87ae6f0 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] 10.222.0.33 "GET /compute/v2.1/servers/a369d441-1f65-4e05-ba68-8e606497a368" status: 200 len: 1407 microversion: 2.54 time: 0.220346 Sep 23 04:45:39.446352 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1626/3323] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:45:39 2022] GET /compute/v2.1/servers/a369d441-1f65-4e05-ba68-8e606497a368 => generated 1407 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:45:39.455406 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5252d58f-dd2b-47bf-9679-38adaa169c99 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:39.456231 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5252d58f-dd2b-47bf-9679-38adaa169c99 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 27e4cd67-a4b3-440d-81dd-963f6372b385] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:39.460708 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:45:39.468590 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-4f1139d4-20fe-41f7-8b50-45dfe9f8a375 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a450c16562c24174809ea6819a26c62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebd3f6411d4d9d9a85b84c77efab02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:39.486952 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-4f1139d4-20fe-41f7-8b50-45dfe9f8a375 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a450c16562c24174809ea6819a26c62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebd3f6411d4d9d9a85b84c77efab02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:39.487351 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5252d58f-dd2b-47bf-9679-38adaa169c99 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:39.488165 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5252d58f-dd2b-47bf-9679-38adaa169c99 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:39.488619 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5252d58f-dd2b-47bf-9679-38adaa169c99 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:39.489416 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-4f1139d4-20fe-41f7-8b50-45dfe9f8a375 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a450c16562c24174809ea6819a26c62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebd3f6411d4d9d9a85b84c77efab02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:39.490807 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4f1139d4-20fe-41f7-8b50-45dfe9f8a375 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] 10.222.0.33 "GET /compute/v2.1/servers/b1eab370-87bb-4d58-bcaf-c41520e016a0" status: 200 len: 1358 microversion: 2.21 time: 0.818501 Sep 23 04:45:39.491499 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5252d58f-dd2b-47bf-9679-38adaa169c99 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:39.491719 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1698/3324] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:45:38 2022] GET /compute/v2.1/servers/b1eab370-87bb-4d58-bcaf-c41520e016a0 => generated 1358 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:45:39.491964 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5252d58f-dd2b-47bf-9679-38adaa169c99 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:39.492405 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5252d58f-dd2b-47bf-9679-38adaa169c99 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:39.496595 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-29d1a640-c168-4d32-bcf6-e93d40f5a21f tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '.version_select at 0x7ff1bb733f70>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:39.567820 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5252d58f-dd2b-47bf-9679-38adaa169c99 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 27e4cd67-a4b3-440d-81dd-963f6372b385] Going to try to terminate instance {{(pid=122698) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:45:39.576165 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-29d1a640-c168-4d32-bcf6-e93d40f5a21f tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/images/61d751db-b940-4f89-b620-4902c2decb81" status: 200 len: 1414 microversion: 2.1 time: 0.082918 Sep 23 04:45:39.577043 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1699/3325] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:45:39 2022] GET /compute/v2.1/images/61d751db-b940-4f89-b620-4902c2decb81 => generated 1414 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:45:40.019951 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5252d58f-dd2b-47bf-9679-38adaa169c99 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "DELETE /compute/v2.1/servers/27e4cd67-a4b3-440d-81dd-963f6372b385" status: 204 len: 0 microversion: 2.1 time: 0.569864 Sep 23 04:45:40.021579 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1627/3326] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:45:39 2022] DELETE /compute/v2.1/servers/27e4cd67-a4b3-440d-81dd-963f6372b385 => generated 0 bytes in 572 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:45:40.031940 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c84fc4a9-ceff-4dcf-87b1-056be0827d30 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:40.031940 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c84fc4a9-ceff-4dcf-87b1-056be0827d30 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 27e4cd67-a4b3-440d-81dd-963f6372b385] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:40.044726 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c84fc4a9-ceff-4dcf-87b1-056be0827d30 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:40.045248 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c84fc4a9-ceff-4dcf-87b1-056be0827d30 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:40.046461 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c84fc4a9-ceff-4dcf-87b1-056be0827d30 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:40.047214 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c84fc4a9-ceff-4dcf-87b1-056be0827d30 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:40.047884 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c84fc4a9-ceff-4dcf-87b1-056be0827d30 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:40.053745 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c84fc4a9-ceff-4dcf-87b1-056be0827d30 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:40.457911 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c84fc4a9-ceff-4dcf-87b1-056be0827d30 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:40.472999 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c84fc4a9-ceff-4dcf-87b1-056be0827d30 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/27e4cd67-a4b3-440d-81dd-963f6372b385" status: 200 len: 1495 microversion: 2.1 time: 0.446790 Sep 23 04:45:40.475118 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f3409377-1454-4032-b001-a902ae20b666 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:40.475768 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f3409377-1454-4032-b001-a902ae20b666 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] [instance: a369d441-1f65-4e05-ba68-8e606497a368] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:40.477871 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1700/3327] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:45:40 2022] GET /compute/v2.1/servers/27e4cd67-a4b3-440d-81dd-963f6372b385 => generated 1495 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:45:40.495423 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f3409377-1454-4032-b001-a902ae20b666 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:40.495423 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f3409377-1454-4032-b001-a902ae20b666 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:40.495423 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f3409377-1454-4032-b001-a902ae20b666 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:40.495423 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f3409377-1454-4032-b001-a902ae20b666 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:40.495423 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f3409377-1454-4032-b001-a902ae20b666 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:40.495423 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f3409377-1454-4032-b001-a902ae20b666 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:40.520706 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7a16963f-27e1-4dca-8804-781f0a112af7 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:40.521395 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-7a16963f-27e1-4dca-8804-781f0a112af7 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] [instance: b1eab370-87bb-4d58-bcaf-c41520e016a0] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:40.535508 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7a16963f-27e1-4dca-8804-781f0a112af7 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:40.536848 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7a16963f-27e1-4dca-8804-781f0a112af7 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:40.537721 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7a16963f-27e1-4dca-8804-781f0a112af7 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:40.542992 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7a16963f-27e1-4dca-8804-781f0a112af7 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:40.543496 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7a16963f-27e1-4dca-8804-781f0a112af7 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:40.543947 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7a16963f-27e1-4dca-8804-781f0a112af7 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:40.796645 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f3409377-1454-4032-b001-a902ae20b666 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aaca3ba23b4c46bcebc4f60a7337a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268508420e3c4d4cb3d60cb19488bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:40.813845 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f3409377-1454-4032-b001-a902ae20b666 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90aaca3ba23b4c46bcebc4f60a7337a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268508420e3c4d4cb3d60cb19488bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:40.818720 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f3409377-1454-4032-b001-a902ae20b666 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90aaca3ba23b4c46bcebc4f60a7337a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268508420e3c4d4cb3d60cb19488bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:40.824804 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f3409377-1454-4032-b001-a902ae20b666 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] 10.222.0.33 "GET /compute/v2.1/servers/a369d441-1f65-4e05-ba68-8e606497a368" status: 200 len: 1407 microversion: 2.54 time: 0.354689 Sep 23 04:45:40.832669 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1628/3328] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:45:40 2022] GET /compute/v2.1/servers/a369d441-1f65-4e05-ba68-8e606497a368 => generated 1407 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:45:40.841595 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5bc2567b-2607-417d-ad58-a252a5a977a0 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '.version_select at 0x7ff1ba9c0d30>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:40.938018 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5bc2567b-2607-417d-ad58-a252a5a977a0 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/images/61d751db-b940-4f89-b620-4902c2decb81" status: 200 len: 1414 microversion: 2.1 time: 0.109008 Sep 23 04:45:40.938920 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1629/3329] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:45:40 2022] GET /compute/v2.1/images/61d751db-b940-4f89-b620-4902c2decb81 => generated 1414 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:45:40.988794 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-7a16963f-27e1-4dca-8804-781f0a112af7 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a450c16562c24174809ea6819a26c62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebd3f6411d4d9d9a85b84c77efab02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:41.002249 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-7a16963f-27e1-4dca-8804-781f0a112af7 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a450c16562c24174809ea6819a26c62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebd3f6411d4d9d9a85b84c77efab02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:41.004258 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-7a16963f-27e1-4dca-8804-781f0a112af7 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a450c16562c24174809ea6819a26c62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebd3f6411d4d9d9a85b84c77efab02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:41.006919 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-7a16963f-27e1-4dca-8804-781f0a112af7 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] 10.222.0.33 "GET /compute/v2.1/servers/b1eab370-87bb-4d58-bcaf-c41520e016a0" status: 200 len: 1358 microversion: 2.21 time: 0.491083 Sep 23 04:45:41.031012 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1701/3330] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:45:40 2022] GET /compute/v2.1/servers/b1eab370-87bb-4d58-bcaf-c41520e016a0 => generated 1358 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:45:41.504941 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-474df3ae-92ec-4bea-be86-a69ff04f4ed4 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:41.505545 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-474df3ae-92ec-4bea-be86-a69ff04f4ed4 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 27e4cd67-a4b3-440d-81dd-963f6372b385] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:41.522160 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-474df3ae-92ec-4bea-be86-a69ff04f4ed4 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:41.522160 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-474df3ae-92ec-4bea-be86-a69ff04f4ed4 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:41.522160 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-474df3ae-92ec-4bea-be86-a69ff04f4ed4 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:41.522160 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-474df3ae-92ec-4bea-be86-a69ff04f4ed4 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:41.526339 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-474df3ae-92ec-4bea-be86-a69ff04f4ed4 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:41.526809 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-474df3ae-92ec-4bea-be86-a69ff04f4ed4 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:41.853389 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3e5a8645-8030-4975-8e6a-8b0070637d0f tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:41.865243 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-3e5a8645-8030-4975-8e6a-8b0070637d0f tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] [instance: a369d441-1f65-4e05-ba68-8e606497a368] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:41.868976 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3e5a8645-8030-4975-8e6a-8b0070637d0f tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:41.870433 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3e5a8645-8030-4975-8e6a-8b0070637d0f tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:41.871537 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3e5a8645-8030-4975-8e6a-8b0070637d0f tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:41.873546 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3e5a8645-8030-4975-8e6a-8b0070637d0f tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:41.876008 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3e5a8645-8030-4975-8e6a-8b0070637d0f tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:41.877327 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3e5a8645-8030-4975-8e6a-8b0070637d0f tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:42.218242 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-3e5a8645-8030-4975-8e6a-8b0070637d0f tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aaca3ba23b4c46bcebc4f60a7337a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268508420e3c4d4cb3d60cb19488bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:42.229496 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-3e5a8645-8030-4975-8e6a-8b0070637d0f tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90aaca3ba23b4c46bcebc4f60a7337a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268508420e3c4d4cb3d60cb19488bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:42.235487 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-3e5a8645-8030-4975-8e6a-8b0070637d0f tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90aaca3ba23b4c46bcebc4f60a7337a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268508420e3c4d4cb3d60cb19488bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:42.239182 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3e5a8645-8030-4975-8e6a-8b0070637d0f tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] 10.222.0.33 "GET /compute/v2.1/servers/a369d441-1f65-4e05-ba68-8e606497a368" status: 200 len: 1407 microversion: 2.54 time: 0.390718 Sep 23 04:45:42.242809 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1702/3331] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:45:41 2022] GET /compute/v2.1/servers/a369d441-1f65-4e05-ba68-8e606497a368 => generated 1407 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:45:42.257349 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5f2547f1-5f44-408b-a8be-418e8a724d41 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '.version_select at 0x7ff1bafc13a0>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:42.388955 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5f2547f1-5f44-408b-a8be-418e8a724d41 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/images/61d751db-b940-4f89-b620-4902c2decb81" status: 200 len: 1414 microversion: 2.1 time: 0.144640 Sep 23 04:45:42.389999 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1703/3332] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:45:42 2022] GET /compute/v2.1/images/61d751db-b940-4f89-b620-4902c2decb81 => generated 1414 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:45:42.402158 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-3fafa513-f097-489e-b765-db685edbfa20 req-23c03268-d0fe-434e-8183-4e14df386a1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1eab370-87bb-4d58-bcaf-c41520e016a0", "name": "network-vif-plugged", "status": "completed", "tag": "eae362d7-35fd-4917-9b61-a1977494380e"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:45:42.455921 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-3fafa513-f097-489e-b765-db685edbfa20 req-23c03268-d0fe-434e-8183-4e14df386a1c service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:42.456415 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-3fafa513-f097-489e-b765-db685edbfa20 req-23c03268-d0fe-434e-8183-4e14df386a1c service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:42.456857 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-3fafa513-f097-489e-b765-db685edbfa20 req-23c03268-d0fe-434e-8183-4e14df386a1c service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:42.516809 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-3fafa513-f097-489e-b765-db685edbfa20 req-23c03268-d0fe-434e-8183-4e14df386a1c service nova] Creating event network-vif-plugged:eae362d7-35fd-4917-9b61-a1977494380e for instance b1eab370-87bb-4d58-bcaf-c41520e016a0 on n-h1-846463-3 Sep 23 04:45:42.542882 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-3fafa513-f097-489e-b765-db685edbfa20 req-23c03268-d0fe-434e-8183-4e14df386a1c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145370 Sep 23 04:45:42.543395 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1704/3333] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:45:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:45:42.597610 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6e71272d-f562-4976-a607-eaed84856ea5 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:42.598565 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-6e71272d-f562-4976-a607-eaed84856ea5 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] [instance: b1eab370-87bb-4d58-bcaf-c41520e016a0] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:42.639749 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6e71272d-f562-4976-a607-eaed84856ea5 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:42.639749 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6e71272d-f562-4976-a607-eaed84856ea5 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:42.641041 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6e71272d-f562-4976-a607-eaed84856ea5 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:42.641953 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6e71272d-f562-4976-a607-eaed84856ea5 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:42.642468 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6e71272d-f562-4976-a607-eaed84856ea5 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:42.642923 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6e71272d-f562-4976-a607-eaed84856ea5 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:43.731817 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-474df3ae-92ec-4bea-be86-a69ff04f4ed4 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:43.751004 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-474df3ae-92ec-4bea-be86-a69ff04f4ed4 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/27e4cd67-a4b3-440d-81dd-963f6372b385" status: 200 len: 1495 microversion: 2.1 time: 2.242996 Sep 23 04:45:43.752387 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1630/3334] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:45:41 2022] GET /compute/v2.1/servers/27e4cd67-a4b3-440d-81dd-963f6372b385 => generated 1495 bytes in 2252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:45:43.768733 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-68191a04-bf5d-4483-ae79-94fcec9af5eb tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:43.771143 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-68191a04-bf5d-4483-ae79-94fcec9af5eb tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] [instance: a369d441-1f65-4e05-ba68-8e606497a368] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:43.797512 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-68191a04-bf5d-4483-ae79-94fcec9af5eb tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:43.802101 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-68191a04-bf5d-4483-ae79-94fcec9af5eb tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:43.802917 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-68191a04-bf5d-4483-ae79-94fcec9af5eb tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:43.816081 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-68191a04-bf5d-4483-ae79-94fcec9af5eb tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:43.816832 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-68191a04-bf5d-4483-ae79-94fcec9af5eb tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:43.818959 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-68191a04-bf5d-4483-ae79-94fcec9af5eb tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:44.243389 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-68191a04-bf5d-4483-ae79-94fcec9af5eb tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aaca3ba23b4c46bcebc4f60a7337a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268508420e3c4d4cb3d60cb19488bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:44.257459 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-68191a04-bf5d-4483-ae79-94fcec9af5eb tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90aaca3ba23b4c46bcebc4f60a7337a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268508420e3c4d4cb3d60cb19488bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:44.261282 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-68191a04-bf5d-4483-ae79-94fcec9af5eb tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90aaca3ba23b4c46bcebc4f60a7337a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268508420e3c4d4cb3d60cb19488bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:44.263922 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-68191a04-bf5d-4483-ae79-94fcec9af5eb tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] 10.222.0.33 "GET /compute/v2.1/servers/a369d441-1f65-4e05-ba68-8e606497a368" status: 200 len: 1407 microversion: 2.54 time: 0.510192 Sep 23 04:45:44.265203 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1631/3335] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:45:43 2022] GET /compute/v2.1/servers/a369d441-1f65-4e05-ba68-8e606497a368 => generated 1407 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:45:44.281247 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a25190cf-4b06-4aa7-9ccb-ab8793ed367e tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '.version_select at 0x7ff1baa7d550>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:44.388667 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a25190cf-4b06-4aa7-9ccb-ab8793ed367e tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/images/61d751db-b940-4f89-b620-4902c2decb81" status: 200 len: 1414 microversion: 2.1 time: 0.121168 Sep 23 04:45:44.391407 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1632/3336] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:45:44 2022] GET /compute/v2.1/images/61d751db-b940-4f89-b620-4902c2decb81 => generated 1414 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:45:44.780633 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f5aae64d-c766-41fe-a50c-7fc3338c8d59 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:44.782618 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f5aae64d-c766-41fe-a50c-7fc3338c8d59 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 27e4cd67-a4b3-440d-81dd-963f6372b385] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:44.802648 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f5aae64d-c766-41fe-a50c-7fc3338c8d59 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:44.806336 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f5aae64d-c766-41fe-a50c-7fc3338c8d59 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:44.807034 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f5aae64d-c766-41fe-a50c-7fc3338c8d59 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:44.808152 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f5aae64d-c766-41fe-a50c-7fc3338c8d59 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:44.810439 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f5aae64d-c766-41fe-a50c-7fc3338c8d59 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:44.812082 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f5aae64d-c766-41fe-a50c-7fc3338c8d59 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:44.896222 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-6e71272d-f562-4976-a607-eaed84856ea5 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a450c16562c24174809ea6819a26c62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebd3f6411d4d9d9a85b84c77efab02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:44.927219 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-6e71272d-f562-4976-a607-eaed84856ea5 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a450c16562c24174809ea6819a26c62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebd3f6411d4d9d9a85b84c77efab02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:44.931511 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-6e71272d-f562-4976-a607-eaed84856ea5 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a450c16562c24174809ea6819a26c62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebd3f6411d4d9d9a85b84c77efab02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:44.933143 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6e71272d-f562-4976-a607-eaed84856ea5 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] 10.222.0.33 "GET /compute/v2.1/servers/b1eab370-87bb-4d58-bcaf-c41520e016a0" status: 200 len: 1358 microversion: 2.21 time: 2.377595 Sep 23 04:45:44.940960 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1705/3337] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:45:42 2022] GET /compute/v2.1/servers/b1eab370-87bb-4d58-bcaf-c41520e016a0 => generated 1358 bytes in 2386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:45:44.968596 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-fe08da23-95a9-45d4-80ff-7aa6b1782870 req-f7664271-856a-473e-ab27-0fff561e291f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27e4cd67-a4b3-440d-81dd-963f6372b385", "name": "network-vif-deleted", "tag": "ed9f6280-d98e-41c6-bd3c-e1eafb0f3027"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:45:45.000986 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-fe08da23-95a9-45d4-80ff-7aa6b1782870 req-f7664271-856a-473e-ab27-0fff561e291f service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:45.001679 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-fe08da23-95a9-45d4-80ff-7aa6b1782870 req-f7664271-856a-473e-ab27-0fff561e291f service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:45.002187 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-fe08da23-95a9-45d4-80ff-7aa6b1782870 req-f7664271-856a-473e-ab27-0fff561e291f service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:45.063618 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-fe08da23-95a9-45d4-80ff-7aa6b1782870 req-f7664271-856a-473e-ab27-0fff561e291f service nova] Creating event network-vif-deleted:ed9f6280-d98e-41c6-bd3c-e1eafb0f3027 for instance 27e4cd67-a4b3-440d-81dd-963f6372b385 on n-h2-846463-3 Sep 23 04:45:45.088437 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-fe08da23-95a9-45d4-80ff-7aa6b1782870 req-f7664271-856a-473e-ab27-0fff561e291f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145567 Sep 23 04:45:45.094655 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1706/3338] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:45:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:45:45.150926 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f5aae64d-c766-41fe-a50c-7fc3338c8d59 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:45.160848 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f5aae64d-c766-41fe-a50c-7fc3338c8d59 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/27e4cd67-a4b3-440d-81dd-963f6372b385" status: 200 len: 1453 microversion: 2.1 time: 0.384449 Sep 23 04:45:45.163333 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1633/3339] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:45:44 2022] GET /compute/v2.1/servers/27e4cd67-a4b3-440d-81dd-963f6372b385 => generated 1453 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:45:45.297368 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-205b9dd0-4fa9-4aa7-98fc-b77aa0bf7820 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:45.298023 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-205b9dd0-4fa9-4aa7-98fc-b77aa0bf7820 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] [instance: a369d441-1f65-4e05-ba68-8e606497a368] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:45.336264 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-205b9dd0-4fa9-4aa7-98fc-b77aa0bf7820 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:45.336264 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-205b9dd0-4fa9-4aa7-98fc-b77aa0bf7820 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:45.336264 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-205b9dd0-4fa9-4aa7-98fc-b77aa0bf7820 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:45.337781 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-205b9dd0-4fa9-4aa7-98fc-b77aa0bf7820 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:45.342632 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-205b9dd0-4fa9-4aa7-98fc-b77aa0bf7820 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:45.343422 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-205b9dd0-4fa9-4aa7-98fc-b77aa0bf7820 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:45.449581 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-066bcd8f-8145-46fc-bbb3-f565089b9780 tempest-FloatingIPDetailsTestJSON-1403081710 tempest-FloatingIPDetailsTestJSON-1403081710-project] Action: 'create', calling method: .version_select at 0x7ff1bafc1820>, body: {"pool": null} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:45:45.517553 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-205b9dd0-4fa9-4aa7-98fc-b77aa0bf7820 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aaca3ba23b4c46bcebc4f60a7337a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268508420e3c4d4cb3d60cb19488bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:45.527243 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-205b9dd0-4fa9-4aa7-98fc-b77aa0bf7820 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90aaca3ba23b4c46bcebc4f60a7337a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268508420e3c4d4cb3d60cb19488bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:45.529357 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-205b9dd0-4fa9-4aa7-98fc-b77aa0bf7820 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90aaca3ba23b4c46bcebc4f60a7337a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268508420e3c4d4cb3d60cb19488bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:45.530651 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-205b9dd0-4fa9-4aa7-98fc-b77aa0bf7820 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] 10.222.0.33 "GET /compute/v2.1/servers/a369d441-1f65-4e05-ba68-8e606497a368" status: 200 len: 1407 microversion: 2.54 time: 0.239352 Sep 23 04:45:45.531548 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1634/3340] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:45:45 2022] GET /compute/v2.1/servers/a369d441-1f65-4e05-ba68-8e606497a368 => generated 1407 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:45:45.571831 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-098f7e2e-b7c0-4879-a0ae-9e6e8648cec7 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '.version_select at 0x7ff1ba9ad5e0>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:45.678810 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-098f7e2e-b7c0-4879-a0ae-9e6e8648cec7 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/images/61d751db-b940-4f89-b620-4902c2decb81" status: 200 len: 1414 microversion: 2.1 time: 0.137992 Sep 23 04:45:45.686667 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1635/3341] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:45:45 2022] GET /compute/v2.1/images/61d751db-b940-4f89-b620-4902c2decb81 => generated 1414 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:45:45.968241 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-02cbd33e-ebb9-4b30-b09a-8641e6b21879 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:45.969167 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-02cbd33e-ebb9-4b30-b09a-8641e6b21879 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] [instance: b1eab370-87bb-4d58-bcaf-c41520e016a0] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:45.991789 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-02cbd33e-ebb9-4b30-b09a-8641e6b21879 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:45.992294 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-02cbd33e-ebb9-4b30-b09a-8641e6b21879 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:45.995162 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-02cbd33e-ebb9-4b30-b09a-8641e6b21879 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:46.000160 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-02cbd33e-ebb9-4b30-b09a-8641e6b21879 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:46.000160 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-02cbd33e-ebb9-4b30-b09a-8641e6b21879 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:46.000160 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-02cbd33e-ebb9-4b30-b09a-8641e6b21879 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:46.971960 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-02cbd33e-ebb9-4b30-b09a-8641e6b21879 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a450c16562c24174809ea6819a26c62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebd3f6411d4d9d9a85b84c77efab02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:46.987491 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-02cbd33e-ebb9-4b30-b09a-8641e6b21879 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a450c16562c24174809ea6819a26c62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebd3f6411d4d9d9a85b84c77efab02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:46.989481 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-02cbd33e-ebb9-4b30-b09a-8641e6b21879 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a450c16562c24174809ea6819a26c62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebd3f6411d4d9d9a85b84c77efab02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:46.993296 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-02cbd33e-ebb9-4b30-b09a-8641e6b21879 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] 10.222.0.33 "GET /compute/v2.1/servers/b1eab370-87bb-4d58-bcaf-c41520e016a0" status: 200 len: 1358 microversion: 2.21 time: 1.028032 Sep 23 04:45:47.026029 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1636/3342] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:45:45 2022] GET /compute/v2.1/servers/b1eab370-87bb-4d58-bcaf-c41520e016a0 => generated 1358 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:45:47.038572 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8c7cd860-e615-45e4-a43a-864b10efdbf0 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:47.045293 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8c7cd860-e615-45e4-a43a-864b10efdbf0 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 27e4cd67-a4b3-440d-81dd-963f6372b385] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:47.067927 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8c7cd860-e615-45e4-a43a-864b10efdbf0 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:47.071505 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8c7cd860-e615-45e4-a43a-864b10efdbf0 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:47.072727 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8c7cd860-e615-45e4-a43a-864b10efdbf0 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:47.075972 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8c7cd860-e615-45e4-a43a-864b10efdbf0 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:47.076713 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8c7cd860-e615-45e4-a43a-864b10efdbf0 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:47.078787 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8c7cd860-e615-45e4-a43a-864b10efdbf0 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:47.132465 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-8c7cd860-e615-45e4-a43a-864b10efdbf0 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] HTTP exception thrown: Instance 27e4cd67-a4b3-440d-81dd-963f6372b385 could not be found. Sep 23 04:45:47.138365 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8c7cd860-e615-45e4-a43a-864b10efdbf0 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Request method failure captured: Sep 23 04:45:47.138365 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/27e4cd67-a4b3-440d-81dd-963f6372b385 HTTP/1.1 Sep 23 04:45:47.138365 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:45:47.138365 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:45:47.138365 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:45:47.138365 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:45:47.138365 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:45:47.138365 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:45:47.138365 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:45:47.138365 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:45:47.138365 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTlTlFK_k4e3BWkoqwVigfjvHO2lVSTsmHRT7EhNgH87mj-DVuWXCq-NRLrmXyv4E_e0wXdkZnDmOQ4aUkRrz7wPxuRsMdZHh23aH7xyd0PRdo29c8XIic0D4fdht4KBWWMxFeNNSWWMe-xxhvPgOUVxbcTbEXPF75Q0c4Y9h1Ew0hk Sep 23 04:45:47.138365 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:45:47.138365 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:45:47.138365 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:45:47.138365 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:45:47.138365 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:45:47.138365 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:45:47.138365 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: c23bd5a8b84942898a99930b2bc0ca12 Sep 23 04:45:47.138365 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ServersTestJSON-1923416422 Sep 23 04:45:47.138365 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:45:47.138365 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:45:47.138365 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c23bd5a8b84942898a99930b2bc0ca12", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c23bd5a8b84942898a99930b2bc0ca12"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c23bd5a8b84942898a99930b2bc0ca12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c23bd5a8b84942898a99930b2bc0ca12"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:45:47.138365 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ServersTestJSON-1923416422 Sep 23 04:45:47.138365 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: c23bd5a8b84942898a99930b2bc0ca12 Sep 23 04:45:47.138365 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ServersTestJSON-1923416422 Sep 23 04:45:47.138365 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ServersTestJSON-1923416422-project Sep 23 04:45:47.138365 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:45:47.138365 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:45:47.138365 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 252c87e244984f71ae0907ee769bec05 Sep 23 04:45:47.138365 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ServersTestJSON-1923416422-project Sep 23 04:45:47.138365 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:45:47.138365 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 27e4cd67-a4b3-440d-81dd-963f6372b385 could not be found. Sep 23 04:45:47.138365 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '27e4cd67-a4b3-440d-81dd-963f6372b385'} Sep 23 04:45:47.138365 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:45:47.138365 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:45:47.138365 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:45:47.138365 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:45:47.138365 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:45:47.138365 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:45:47.138365 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:45:47.138365 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:45:47.138365 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:45:47.138365 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:45:47.138365 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27e4cd67-a4b3-440d-81dd-963f6372b385 could not be found. Sep 23 04:45:47.138365 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:45:47.138365 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:45:47.138365 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:45:47.138365 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:45:47.138365 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:45:47.138365 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:45:47.138365 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:45:47.138365 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:45:47.138365 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:45:47.138365 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:45:47.138365 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:45:47.138365 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:45:47.138365 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:45:47.138365 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:45:47.138365 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:45:47.138365 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:45:47.138365 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27e4cd67-a4b3-440d-81dd-963f6372b385 could not be found. Sep 23 04:45:47.138365 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:45:47.138365 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:45:47.138365 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:45:47.142784 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:45:47.142784 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:45:47.142784 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:45:47.142784 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:45:47.142784 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:45:47.142784 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27e4cd67-a4b3-440d-81dd-963f6372b385 could not be found. Sep 23 04:45:47.142784 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:45:47.147848 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8c7cd860-e615-45e4-a43a-864b10efdbf0 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Returning 404 to user: Instance 27e4cd67-a4b3-440d-81dd-963f6372b385 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:45:47.149206 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8c7cd860-e615-45e4-a43a-864b10efdbf0 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/27e4cd67-a4b3-440d-81dd-963f6372b385" status: 404 len: 111 microversion: 2.1 time: 0.121094 Sep 23 04:45:47.166314 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1637/3343] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:45:47 2022] GET /compute/v2.1/servers/27e4cd67-a4b3-440d-81dd-963f6372b385 => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:45:47.174901 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8ceeed4f-8009-40ca-af36-50e5b9a1748f tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:47.175787 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8ceeed4f-8009-40ca-af36-50e5b9a1748f tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] [instance: a369d441-1f65-4e05-ba68-8e606497a368] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:47.183375 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8ceeed4f-8009-40ca-af36-50e5b9a1748f tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:47.190069 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8ceeed4f-8009-40ca-af36-50e5b9a1748f tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:47.190069 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8ceeed4f-8009-40ca-af36-50e5b9a1748f tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:47.190069 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8ceeed4f-8009-40ca-af36-50e5b9a1748f tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:47.190069 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8ceeed4f-8009-40ca-af36-50e5b9a1748f tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:47.190069 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8ceeed4f-8009-40ca-af36-50e5b9a1748f tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:47.311571 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8ceeed4f-8009-40ca-af36-50e5b9a1748f tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aaca3ba23b4c46bcebc4f60a7337a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268508420e3c4d4cb3d60cb19488bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:47.353304 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8ceeed4f-8009-40ca-af36-50e5b9a1748f tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90aaca3ba23b4c46bcebc4f60a7337a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268508420e3c4d4cb3d60cb19488bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:47.358602 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8ceeed4f-8009-40ca-af36-50e5b9a1748f tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90aaca3ba23b4c46bcebc4f60a7337a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268508420e3c4d4cb3d60cb19488bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:47.362741 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8ceeed4f-8009-40ca-af36-50e5b9a1748f tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] 10.222.0.33 "GET /compute/v2.1/servers/a369d441-1f65-4e05-ba68-8e606497a368" status: 200 len: 1407 microversion: 2.54 time: 0.194916 Sep 23 04:45:47.363545 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1638/3344] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:45:47 2022] GET /compute/v2.1/servers/a369d441-1f65-4e05-ba68-8e606497a368 => generated 1407 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:45:47.373835 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1dac4d52-806d-4032-b691-c669b27c70d5 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '.version_select at 0x7ff1ba9aa4c0>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:47.470931 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-1dac4d52-806d-4032-b691-c669b27c70d5 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/images/61d751db-b940-4f89-b620-4902c2decb81" status: 200 len: 1414 microversion: 2.1 time: 0.103199 Sep 23 04:45:47.472798 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1639/3345] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:45:47 2022] GET /compute/v2.1/images/61d751db-b940-4f89-b620-4902c2decb81 => generated 1414 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:45:47.483796 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-586c2029-97d7-44fd-9e07-e22245d87a17 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:47.486418 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-586c2029-97d7-44fd-9e07-e22245d87a17 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 2c316737-b84f-4b49-a5ab-cc0196b15760] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:47.507884 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-586c2029-97d7-44fd-9e07-e22245d87a17 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:47.508179 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-586c2029-97d7-44fd-9e07-e22245d87a17 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:47.511906 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-586c2029-97d7-44fd-9e07-e22245d87a17 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:47.511906 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-586c2029-97d7-44fd-9e07-e22245d87a17 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:47.511906 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-586c2029-97d7-44fd-9e07-e22245d87a17 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:47.511906 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-586c2029-97d7-44fd-9e07-e22245d87a17 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:47.575983 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-586c2029-97d7-44fd-9e07-e22245d87a17 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 2c316737-b84f-4b49-a5ab-cc0196b15760] Going to try to terminate instance {{(pid=122698) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:45:47.981432 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-586c2029-97d7-44fd-9e07-e22245d87a17 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "DELETE /compute/v2.1/servers/2c316737-b84f-4b49-a5ab-cc0196b15760" status: 204 len: 0 microversion: 2.1 time: 0.506542 Sep 23 04:45:47.983355 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1640/3346] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:45:47 2022] DELETE /compute/v2.1/servers/2c316737-b84f-4b49-a5ab-cc0196b15760 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:45:47.995315 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-468307c3-3193-4675-8970-d9cdcbc4b648 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:47.996459 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-468307c3-3193-4675-8970-d9cdcbc4b648 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 2c316737-b84f-4b49-a5ab-cc0196b15760] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:48.010260 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-468307c3-3193-4675-8970-d9cdcbc4b648 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:48.013528 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-468307c3-3193-4675-8970-d9cdcbc4b648 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:48.018026 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-468307c3-3193-4675-8970-d9cdcbc4b648 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:48.019085 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-468307c3-3193-4675-8970-d9cdcbc4b648 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:48.019835 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-468307c3-3193-4675-8970-d9cdcbc4b648 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:48.020927 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-468307c3-3193-4675-8970-d9cdcbc4b648 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:48.083251 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:45:48.585497 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-468307c3-3193-4675-8970-d9cdcbc4b648 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:48.598918 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-468307c3-3193-4675-8970-d9cdcbc4b648 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/2c316737-b84f-4b49-a5ab-cc0196b15760" status: 200 len: 1494 microversion: 2.1 time: 0.610898 Sep 23 04:45:48.599512 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1641/3347] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:45:47 2022] GET /compute/v2.1/servers/2c316737-b84f-4b49-a5ab-cc0196b15760 => generated 1494 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:45:48.617627 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-92d2389c-b121-48b6-aa52-3bd74ce0ecb3 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:48.620310 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-92d2389c-b121-48b6-aa52-3bd74ce0ecb3 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] [instance: b1eab370-87bb-4d58-bcaf-c41520e016a0] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:48.636042 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-92d2389c-b121-48b6-aa52-3bd74ce0ecb3 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:48.665776 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-92d2389c-b121-48b6-aa52-3bd74ce0ecb3 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:48.666276 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-92d2389c-b121-48b6-aa52-3bd74ce0ecb3 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:48.667045 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-92d2389c-b121-48b6-aa52-3bd74ce0ecb3 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:48.667955 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-92d2389c-b121-48b6-aa52-3bd74ce0ecb3 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:48.669062 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-92d2389c-b121-48b6-aa52-3bd74ce0ecb3 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:49.261277 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-92d2389c-b121-48b6-aa52-3bd74ce0ecb3 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a450c16562c24174809ea6819a26c62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebd3f6411d4d9d9a85b84c77efab02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:49.279978 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-92d2389c-b121-48b6-aa52-3bd74ce0ecb3 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a450c16562c24174809ea6819a26c62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebd3f6411d4d9d9a85b84c77efab02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:49.296529 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-92d2389c-b121-48b6-aa52-3bd74ce0ecb3 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a450c16562c24174809ea6819a26c62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebd3f6411d4d9d9a85b84c77efab02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:49.304187 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-92d2389c-b121-48b6-aa52-3bd74ce0ecb3 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] 10.222.0.33 "GET /compute/v2.1/servers/b1eab370-87bb-4d58-bcaf-c41520e016a0" status: 200 len: 1551 microversion: 2.21 time: 0.693644 Sep 23 04:45:49.309920 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1642/3348] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:45:48 2022] GET /compute/v2.1/servers/b1eab370-87bb-4d58-bcaf-c41520e016a0 => generated 1551 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:45:49.337913 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-84dcda5c-9744-44fd-bc41-d77f63a92330 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:49.342516 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-84dcda5c-9744-44fd-bc41-d77f63a92330 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] [instance: a369d441-1f65-4e05-ba68-8e606497a368] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:49.366097 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-84dcda5c-9744-44fd-bc41-d77f63a92330 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:49.371513 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-84dcda5c-9744-44fd-bc41-d77f63a92330 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:49.373180 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-84dcda5c-9744-44fd-bc41-d77f63a92330 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:49.375702 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-84dcda5c-9744-44fd-bc41-d77f63a92330 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:49.386594 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-84dcda5c-9744-44fd-bc41-d77f63a92330 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:49.392026 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-84dcda5c-9744-44fd-bc41-d77f63a92330 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:50.208851 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-84dcda5c-9744-44fd-bc41-d77f63a92330 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aaca3ba23b4c46bcebc4f60a7337a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268508420e3c4d4cb3d60cb19488bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:50.237076 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-84dcda5c-9744-44fd-bc41-d77f63a92330 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90aaca3ba23b4c46bcebc4f60a7337a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268508420e3c4d4cb3d60cb19488bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:50.242800 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-84dcda5c-9744-44fd-bc41-d77f63a92330 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90aaca3ba23b4c46bcebc4f60a7337a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268508420e3c4d4cb3d60cb19488bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:50.245113 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-84dcda5c-9744-44fd-bc41-d77f63a92330 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] 10.222.0.33 "GET /compute/v2.1/servers/a369d441-1f65-4e05-ba68-8e606497a368" status: 200 len: 1407 microversion: 2.54 time: 0.923810 Sep 23 04:45:50.251520 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1643/3349] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:45:49 2022] GET /compute/v2.1/servers/a369d441-1f65-4e05-ba68-8e606497a368 => generated 1407 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:45:50.268485 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f125bcc0-a8a3-485c-a6f1-e2e1684fedd9 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '.version_select at 0x7ff1c3ef00d0>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:50.386103 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f125bcc0-a8a3-485c-a6f1-e2e1684fedd9 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/images/61d751db-b940-4f89-b620-4902c2decb81" status: 200 len: 1414 microversion: 2.1 time: 0.133044 Sep 23 04:45:50.394267 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1644/3350] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:45:50 2022] GET /compute/v2.1/images/61d751db-b940-4f89-b620-4902c2decb81 => generated 1414 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:45:50.400201 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-39d62eef-0def-4dec-a216-2f8d2f0ca598 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:50.401854 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-39d62eef-0def-4dec-a216-2f8d2f0ca598 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] [instance: b1eab370-87bb-4d58-bcaf-c41520e016a0] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:50.422298 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-39d62eef-0def-4dec-a216-2f8d2f0ca598 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:50.423055 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-39d62eef-0def-4dec-a216-2f8d2f0ca598 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:50.424421 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-39d62eef-0def-4dec-a216-2f8d2f0ca598 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:50.427238 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-39d62eef-0def-4dec-a216-2f8d2f0ca598 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:50.427908 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-39d62eef-0def-4dec-a216-2f8d2f0ca598 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:50.429395 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-39d62eef-0def-4dec-a216-2f8d2f0ca598 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:50.510048 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-39d62eef-0def-4dec-a216-2f8d2f0ca598 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] [instance: b1eab370-87bb-4d58-bcaf-c41520e016a0] Going to try to terminate instance {{(pid=122698) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:45:51.037274 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-39d62eef-0def-4dec-a216-2f8d2f0ca598 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b1eab370-87bb-4d58-bcaf-c41520e016a0" status: 204 len: 0 microversion: 2.21 time: 0.647832 Sep 23 04:45:51.038307 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1645/3351] 10.222.0.33 () {60 vars in 1280 bytes} [Fri Sep 23 04:45:50 2022] DELETE /compute/v2.1/servers/b1eab370-87bb-4d58-bcaf-c41520e016a0 => generated 0 bytes in 651 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 23 04:45:51.045446 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-234cf58e-3f4b-4091-ba08-f3fc40c85924 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:51.056979 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-234cf58e-3f4b-4091-ba08-f3fc40c85924 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 2c316737-b84f-4b49-a5ab-cc0196b15760] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:51.084504 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-234cf58e-3f4b-4091-ba08-f3fc40c85924 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:51.088921 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-234cf58e-3f4b-4091-ba08-f3fc40c85924 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:51.089747 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-234cf58e-3f4b-4091-ba08-f3fc40c85924 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:51.092852 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-234cf58e-3f4b-4091-ba08-f3fc40c85924 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:51.097815 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-234cf58e-3f4b-4091-ba08-f3fc40c85924 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:51.100206 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-234cf58e-3f4b-4091-ba08-f3fc40c85924 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:52.341210 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-234cf58e-3f4b-4091-ba08-f3fc40c85924 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:52.354835 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-234cf58e-3f4b-4091-ba08-f3fc40c85924 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/2c316737-b84f-4b49-a5ab-cc0196b15760" status: 200 len: 1494 microversion: 2.1 time: 1.314916 Sep 23 04:45:52.362602 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1646/3352] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:45:51 2022] GET /compute/v2.1/servers/2c316737-b84f-4b49-a5ab-cc0196b15760 => generated 1494 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:45:52.393718 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4c631376-8403-4e36-a949-ab6f61cd85a6 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:52.394784 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4c631376-8403-4e36-a949-ab6f61cd85a6 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] [instance: b1eab370-87bb-4d58-bcaf-c41520e016a0] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:52.423389 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4c631376-8403-4e36-a949-ab6f61cd85a6 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:52.427519 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4c631376-8403-4e36-a949-ab6f61cd85a6 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:52.431257 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4c631376-8403-4e36-a949-ab6f61cd85a6 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:52.433397 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4c631376-8403-4e36-a949-ab6f61cd85a6 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:52.436449 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4c631376-8403-4e36-a949-ab6f61cd85a6 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:52.436449 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4c631376-8403-4e36-a949-ab6f61cd85a6 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:52.497512 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-066bcd8f-8145-46fc-bbb3-f565089b9780 tempest-FloatingIPDetailsTestJSON-1403081710 tempest-FloatingIPDetailsTestJSON-1403081710-project] 10.222.0.33 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 7.401392 Sep 23 04:45:52.505670 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1707/3353] 10.222.0.33 () {60 vars in 1170 bytes} [Fri Sep 23 04:45:45 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 7403 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:45:52.517799 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0467bbae-5d80-4964-a4ad-a89a2ad89ff4 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:52.520490 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-0467bbae-5d80-4964-a4ad-a89a2ad89ff4 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] [instance: a369d441-1f65-4e05-ba68-8e606497a368] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:52.535818 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0467bbae-5d80-4964-a4ad-a89a2ad89ff4 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:52.537814 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0467bbae-5d80-4964-a4ad-a89a2ad89ff4 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:52.538557 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0467bbae-5d80-4964-a4ad-a89a2ad89ff4 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:52.543659 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0467bbae-5d80-4964-a4ad-a89a2ad89ff4 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:52.544444 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0467bbae-5d80-4964-a4ad-a89a2ad89ff4 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:52.547331 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0467bbae-5d80-4964-a4ad-a89a2ad89ff4 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:53.230370 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-0467bbae-5d80-4964-a4ad-a89a2ad89ff4 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aaca3ba23b4c46bcebc4f60a7337a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268508420e3c4d4cb3d60cb19488bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:53.240583 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-0467bbae-5d80-4964-a4ad-a89a2ad89ff4 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90aaca3ba23b4c46bcebc4f60a7337a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268508420e3c4d4cb3d60cb19488bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:53.251045 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-0467bbae-5d80-4964-a4ad-a89a2ad89ff4 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90aaca3ba23b4c46bcebc4f60a7337a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268508420e3c4d4cb3d60cb19488bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:53.257147 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0467bbae-5d80-4964-a4ad-a89a2ad89ff4 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] 10.222.0.33 "GET /compute/v2.1/servers/a369d441-1f65-4e05-ba68-8e606497a368" status: 200 len: 1407 microversion: 2.54 time: 0.743882 Sep 23 04:45:53.260139 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1708/3354] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:45:52 2022] GET /compute/v2.1/servers/a369d441-1f65-4e05-ba68-8e606497a368 => generated 1407 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:45:53.272331 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ed9ff4a7-1dd4-4621-bbf4-678b48e447ff tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '.version_select at 0x7ff1baa3f430>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:53.382655 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ed9ff4a7-1dd4-4621-bbf4-678b48e447ff tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/images/61d751db-b940-4f89-b620-4902c2decb81" status: 200 len: 1414 microversion: 2.1 time: 0.121093 Sep 23 04:45:53.383357 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1709/3355] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:45:53 2022] GET /compute/v2.1/images/61d751db-b940-4f89-b620-4902c2decb81 => generated 1414 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:45:53.398665 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-facf817c-2c05-4b72-a1e5-cf9e87eb5772 tempest-FloatingIPDetailsTestJSON-1403081710 tempest-FloatingIPDetailsTestJSON-1403081710-project] Action: 'create', calling method: .version_select at 0x7ff1bb731160>, body: {"pool": null} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:45:53.758908 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4c631376-8403-4e36-a949-ab6f61cd85a6 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a450c16562c24174809ea6819a26c62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebd3f6411d4d9d9a85b84c77efab02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:53.780153 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4c631376-8403-4e36-a949-ab6f61cd85a6 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a450c16562c24174809ea6819a26c62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebd3f6411d4d9d9a85b84c77efab02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:53.791268 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4c631376-8403-4e36-a949-ab6f61cd85a6 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a450c16562c24174809ea6819a26c62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebd3f6411d4d9d9a85b84c77efab02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:53.796019 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4c631376-8403-4e36-a949-ab6f61cd85a6 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] 10.222.0.33 "GET /compute/v2.1/servers/b1eab370-87bb-4d58-bcaf-c41520e016a0" status: 200 len: 1557 microversion: 2.21 time: 1.431739 Sep 23 04:45:53.804224 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1647/3356] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:45:52 2022] GET /compute/v2.1/servers/b1eab370-87bb-4d58-bcaf-c41520e016a0 => generated 1557 bytes in 1441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:45:53.834736 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ee4f29b3-ab28-402d-b0ab-7bba15acb9c7 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:53.834736 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-ee4f29b3-ab28-402d-b0ab-7bba15acb9c7 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 2c316737-b84f-4b49-a5ab-cc0196b15760] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:53.864553 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ee4f29b3-ab28-402d-b0ab-7bba15acb9c7 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:53.864667 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ee4f29b3-ab28-402d-b0ab-7bba15acb9c7 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:53.865025 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ee4f29b3-ab28-402d-b0ab-7bba15acb9c7 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:53.865758 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ee4f29b3-ab28-402d-b0ab-7bba15acb9c7 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:53.878487 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ee4f29b3-ab28-402d-b0ab-7bba15acb9c7 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:53.879228 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ee4f29b3-ab28-402d-b0ab-7bba15acb9c7 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:54.172525 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ee4f29b3-ab28-402d-b0ab-7bba15acb9c7 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:54.181318 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ee4f29b3-ab28-402d-b0ab-7bba15acb9c7 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/2c316737-b84f-4b49-a5ab-cc0196b15760" status: 200 len: 1293 microversion: 2.1 time: 0.373197 Sep 23 04:45:54.181949 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1648/3357] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:45:53 2022] GET /compute/v2.1/servers/2c316737-b84f-4b49-a5ab-cc0196b15760 => generated 1293 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:45:54.191825 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-78444806-d951-4a19-81fe-2796812b14be req-749989a4-73c9-4277-b613-cf0039b9b424 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c316737-b84f-4b49-a5ab-cc0196b15760", "name": "network-vif-deleted", "tag": "fc3e1dd8-4c97-4525-a268-cb6993ddf935"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:45:54.222677 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-78444806-d951-4a19-81fe-2796812b14be req-749989a4-73c9-4277-b613-cf0039b9b424 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:54.226128 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-78444806-d951-4a19-81fe-2796812b14be req-749989a4-73c9-4277-b613-cf0039b9b424 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:54.226860 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-78444806-d951-4a19-81fe-2796812b14be req-749989a4-73c9-4277-b613-cf0039b9b424 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:54.255323 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-78444806-d951-4a19-81fe-2796812b14be req-749989a4-73c9-4277-b613-cf0039b9b424 service nova] Creating event network-vif-deleted:fc3e1dd8-4c97-4525-a268-cb6993ddf935 for instance 2c316737-b84f-4b49-a5ab-cc0196b15760 on n-h1-846463-3 Sep 23 04:45:54.297450 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-78444806-d951-4a19-81fe-2796812b14be req-749989a4-73c9-4277-b613-cf0039b9b424 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109073 Sep 23 04:45:54.298303 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1649/3358] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:45:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:45:54.304575 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c3ca6a78-0b9a-48b8-9e7f-ebf59f77c040 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:54.305705 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c3ca6a78-0b9a-48b8-9e7f-ebf59f77c040 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] [instance: a369d441-1f65-4e05-ba68-8e606497a368] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:54.319669 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c3ca6a78-0b9a-48b8-9e7f-ebf59f77c040 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:54.336944 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c3ca6a78-0b9a-48b8-9e7f-ebf59f77c040 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:54.338606 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c3ca6a78-0b9a-48b8-9e7f-ebf59f77c040 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:54.343596 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c3ca6a78-0b9a-48b8-9e7f-ebf59f77c040 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:54.344365 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c3ca6a78-0b9a-48b8-9e7f-ebf59f77c040 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:54.345033 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c3ca6a78-0b9a-48b8-9e7f-ebf59f77c040 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:54.678947 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c3ca6a78-0b9a-48b8-9e7f-ebf59f77c040 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aaca3ba23b4c46bcebc4f60a7337a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268508420e3c4d4cb3d60cb19488bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:54.689183 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c3ca6a78-0b9a-48b8-9e7f-ebf59f77c040 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90aaca3ba23b4c46bcebc4f60a7337a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268508420e3c4d4cb3d60cb19488bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:54.711939 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c3ca6a78-0b9a-48b8-9e7f-ebf59f77c040 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90aaca3ba23b4c46bcebc4f60a7337a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268508420e3c4d4cb3d60cb19488bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:54.713192 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c3ca6a78-0b9a-48b8-9e7f-ebf59f77c040 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] 10.222.0.33 "GET /compute/v2.1/servers/a369d441-1f65-4e05-ba68-8e606497a368" status: 200 len: 1413 microversion: 2.54 time: 0.413538 Sep 23 04:45:54.713763 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1650/3359] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:45:54 2022] GET /compute/v2.1/servers/a369d441-1f65-4e05-ba68-8e606497a368 => generated 1413 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:45:54.732555 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a9fc91fe-87c1-4e6d-8637-b5d64a97a220 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '.version_select at 0x7ff1ba948670>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:54.811286 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a9fc91fe-87c1-4e6d-8637-b5d64a97a220 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/images/61d751db-b940-4f89-b620-4902c2decb81" status: 200 len: 1414 microversion: 2.1 time: 0.094551 Sep 23 04:45:54.812776 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1651/3360] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:45:54 2022] GET /compute/v2.1/images/61d751db-b940-4f89-b620-4902c2decb81 => generated 1414 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:45:54.926099 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-fb307af6-18d1-465e-a116-aff2c4343d49 tempest-FloatingIPDetailsNegativeTestJSON-919441292 tempest-FloatingIPDetailsNegativeTestJSON-919441292-project] Calling method '.version_select at 0x7ff1ba9f0670>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:55.055911 n-d-846463-3 devstack@n-api.service[122698]: DEBUG neutronclient.v2_0.client [None req-fb307af6-18d1-465e-a116-aff2c4343d49 tempest-FloatingIPDetailsNegativeTestJSON-919441292 tempest-FloatingIPDetailsNegativeTestJSON-919441292-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 0ac82b06-88c9-4ff1-abb4-bc39448f6754 could not be found", "detail": ""}} {{(pid=122698) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 23 04:45:55.056695 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-fb307af6-18d1-465e-a116-aff2c4343d49 tempest-FloatingIPDetailsNegativeTestJSON-919441292 tempest-FloatingIPDetailsNegativeTestJSON-919441292-project] HTTP exception thrown: Floating IP not found for ID 0ac82b06-88c9-4ff1-abb4-bc39448f6754 Sep 23 04:45:55.058769 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-fb307af6-18d1-465e-a116-aff2c4343d49 tempest-FloatingIPDetailsNegativeTestJSON-919441292 tempest-FloatingIPDetailsNegativeTestJSON-919441292-project] Request method failure captured: Sep 23 04:45:55.058769 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/os-floating-ips/0ac82b06-88c9-4ff1-abb4-bc39448f6754 HTTP/1.1 Sep 23 04:45:55.058769 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:45:55.058769 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:45:55.058769 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:45:55.058769 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:45:55.058769 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:45:55.058769 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:45:55.058769 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:45:55.058769 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:45:55.058769 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLToClFZ0Pv_bkJtVtUR_o3MCBdCVUuil9t8uQIvistE2xlmu3sPMiQV7xGUAx4roZw4K92fXLGPrHOGCEO3M4ooNR6n3n5JC_8AnCRVcYitU3ckb0f1jRk_GU9SrbbPygZawCBHSmgF3Vxyax-HGOSEdypyLrZsD7TveoPP-D3BjBu0 Sep 23 04:45:55.058769 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:45:55.058769 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:45:55.058769 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:45:55.058769 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:45:55.058769 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:45:55.058769 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:45:55.058769 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: fff41c6b051a46b9b232341c67e18a50 Sep 23 04:45:55.058769 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-919441292 Sep 23 04:45:55.058769 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:45:55.058769 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:45:55.058769 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fff41c6b051a46b9b232341c67e18a50", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fff41c6b051a46b9b232341c67e18a50"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fff41c6b051a46b9b232341c67e18a50"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fff41c6b051a46b9b232341c67e18a50"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:45:55.058769 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-919441292 Sep 23 04:45:55.058769 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: fff41c6b051a46b9b232341c67e18a50 Sep 23 04:45:55.058769 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-919441292 Sep 23 04:45:55.058769 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-919441292-project Sep 23 04:45:55.058769 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:45:55.058769 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:45:55.058769 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 90dc0e0f4d2b4b6b8a5dbf8a4efb92d7 Sep 23 04:45:55.058769 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-919441292-project Sep 23 04:45:55.058769 n-d-846463-3 devstack@n-api.service[122698]: method: Sep 23 04:45:55.058769 n-d-846463-3 devstack@n-api.service[122698]: exception: Floating IP not found for ID 0ac82b06-88c9-4ff1-abb4-bc39448f6754 Sep 23 04:45:55.058769 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '0ac82b06-88c9-4ff1-abb4-bc39448f6754'} Sep 23 04:45:55.058769 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:45:55.058769 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:45:55.058769 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Sep 23 04:45:55.058769 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Sep 23 04:45:55.058769 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:45:55.058769 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:45:55.058769 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Sep 23 04:45:55.058769 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Sep 23 04:45:55.058769 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:45:55.058769 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:45:55.058769 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 23 04:45:55.058769 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 23 04:45:55.058769 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:45:55.058769 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:45:55.058769 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 23 04:45:55.058769 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 23 04:45:55.058769 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:45:55.058769 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:45:55.058769 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 23 04:45:55.058769 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 23 04:45:55.058769 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:45:55.058769 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:45:55.058769 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 23 04:45:55.058769 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 23 04:45:55.058769 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 23 04:45:55.058769 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 23 04:45:55.058769 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 0ac82b06-88c9-4ff1-abb4-bc39448f6754 could not be found Sep 23 04:45:55.058769 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7c61beb6-0ab1-403d-8054-79fb762ddc4f'] Sep 23 04:45:55.065535 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:45:55.065535 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:45:55.065535 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:45:55.065535 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:45:55.065535 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Sep 23 04:45:55.065535 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Sep 23 04:45:55.065535 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Sep 23 04:45:55.065535 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Sep 23 04:45:55.065535 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 0ac82b06-88c9-4ff1-abb4-bc39448f6754. Sep 23 04:45:55.065535 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:45:55.065535 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:45:55.065535 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:45:55.065535 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:45:55.065535 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:45:55.065535 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:45:55.065535 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:45:55.065535 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:45:55.065535 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:45:55.065535 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:45:55.065535 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:45:55.065535 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:45:55.065535 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Sep 23 04:45:55.065535 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 23 04:45:55.065535 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 0ac82b06-88c9-4ff1-abb4-bc39448f6754 Sep 23 04:45:55.065535 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:45:55.065535 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:45:55.065535 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:45:55.065535 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:45:55.065535 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:45:55.065535 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:45:55.065535 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:45:55.065535 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:45:55.065535 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 0ac82b06-88c9-4ff1-abb4-bc39448f6754 Sep 23 04:45:55.065535 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:45:55.065535 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-fb307af6-18d1-465e-a116-aff2c4343d49 tempest-FloatingIPDetailsNegativeTestJSON-919441292 tempest-FloatingIPDetailsNegativeTestJSON-919441292-project] Returning 404 to user: Floating IP not found for ID 0ac82b06-88c9-4ff1-abb4-bc39448f6754 {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:45:55.065535 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-fb307af6-18d1-465e-a116-aff2c4343d49 tempest-FloatingIPDetailsNegativeTestJSON-919441292 tempest-FloatingIPDetailsNegativeTestJSON-919441292-project] 10.222.0.33 "GET /compute/v2.1/os-floating-ips/0ac82b06-88c9-4ff1-abb4-bc39448f6754" status: 404 len: 111 microversion: 2.1 time: 0.246466 Sep 23 04:45:55.065535 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1652/3361] 10.222.0.33 () {58 vars in 1260 bytes} [Fri Sep 23 04:45:54 2022] GET /compute/v2.1/os-floating-ips/0ac82b06-88c9-4ff1-abb4-bc39448f6754 => generated 111 bytes in 248 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:45:55.078368 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-fb6aeba2-3b75-4d7d-8011-2f8f5184dcf5 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:55.084269 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-fb6aeba2-3b75-4d7d-8011-2f8f5184dcf5 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] [instance: b1eab370-87bb-4d58-bcaf-c41520e016a0] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:55.117184 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fb6aeba2-3b75-4d7d-8011-2f8f5184dcf5 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:55.118564 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fb6aeba2-3b75-4d7d-8011-2f8f5184dcf5 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:55.121488 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fb6aeba2-3b75-4d7d-8011-2f8f5184dcf5 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:55.122746 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fb6aeba2-3b75-4d7d-8011-2f8f5184dcf5 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:55.126338 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fb6aeba2-3b75-4d7d-8011-2f8f5184dcf5 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:55.126872 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fb6aeba2-3b75-4d7d-8011-2f8f5184dcf5 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:55.835474 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-fb6aeba2-3b75-4d7d-8011-2f8f5184dcf5 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a450c16562c24174809ea6819a26c62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebd3f6411d4d9d9a85b84c77efab02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:55.857000 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-fb6aeba2-3b75-4d7d-8011-2f8f5184dcf5 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a450c16562c24174809ea6819a26c62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebd3f6411d4d9d9a85b84c77efab02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:55.867427 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-fb6aeba2-3b75-4d7d-8011-2f8f5184dcf5 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a450c16562c24174809ea6819a26c62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecebd3f6411d4d9d9a85b84c77efab02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:55.869975 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-fb6aeba2-3b75-4d7d-8011-2f8f5184dcf5 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] 10.222.0.33 "GET /compute/v2.1/servers/b1eab370-87bb-4d58-bcaf-c41520e016a0" status: 200 len: 1557 microversion: 2.21 time: 0.807120 Sep 23 04:45:55.879193 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1653/3362] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:45:55 2022] GET /compute/v2.1/servers/b1eab370-87bb-4d58-bcaf-c41520e016a0 => generated 1557 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:45:55.881604 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f07d88d7-4172-48d6-8eae-cea9b883b72e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:55.882590 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f07d88d7-4172-48d6-8eae-cea9b883b72e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 2c316737-b84f-4b49-a5ab-cc0196b15760] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:55.892725 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f07d88d7-4172-48d6-8eae-cea9b883b72e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:55.893565 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f07d88d7-4172-48d6-8eae-cea9b883b72e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:55.894362 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f07d88d7-4172-48d6-8eae-cea9b883b72e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:55.895430 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f07d88d7-4172-48d6-8eae-cea9b883b72e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:55.896089 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f07d88d7-4172-48d6-8eae-cea9b883b72e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:55.896742 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f07d88d7-4172-48d6-8eae-cea9b883b72e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:55.927210 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-f07d88d7-4172-48d6-8eae-cea9b883b72e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] HTTP exception thrown: Instance 2c316737-b84f-4b49-a5ab-cc0196b15760 could not be found. Sep 23 04:45:55.938894 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f07d88d7-4172-48d6-8eae-cea9b883b72e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Request method failure captured: Sep 23 04:45:55.938894 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/2c316737-b84f-4b49-a5ab-cc0196b15760 HTTP/1.1 Sep 23 04:45:55.938894 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:45:55.938894 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:45:55.938894 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:45:55.938894 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:45:55.938894 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:45:55.938894 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:45:55.938894 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:45:55.938894 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:45:55.938894 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTlTlFK_k4e3BWkoqwVigfjvHO2lVSTsmHRT7EhNgH87mj-DVuWXCq-NRLrmXyv4E_e0wXdkZnDmOQ4aUkRrz7wPxuRsMdZHh23aH7xyd0PRdo29c8XIic0D4fdht4KBWWMxFeNNSWWMe-xxhvPgOUVxbcTbEXPF75Q0c4Y9h1Ew0hk Sep 23 04:45:55.938894 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:45:55.938894 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:45:55.938894 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:45:55.938894 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:45:55.938894 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:45:55.938894 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:45:55.938894 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: c23bd5a8b84942898a99930b2bc0ca12 Sep 23 04:45:55.938894 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ServersTestJSON-1923416422 Sep 23 04:45:55.938894 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:45:55.938894 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:45:55.938894 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c23bd5a8b84942898a99930b2bc0ca12", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c23bd5a8b84942898a99930b2bc0ca12"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c23bd5a8b84942898a99930b2bc0ca12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c23bd5a8b84942898a99930b2bc0ca12"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:45:55.938894 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ServersTestJSON-1923416422 Sep 23 04:45:55.938894 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: c23bd5a8b84942898a99930b2bc0ca12 Sep 23 04:45:55.938894 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ServersTestJSON-1923416422 Sep 23 04:45:55.938894 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ServersTestJSON-1923416422-project Sep 23 04:45:55.938894 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:45:55.938894 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:45:55.938894 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 252c87e244984f71ae0907ee769bec05 Sep 23 04:45:55.938894 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ServersTestJSON-1923416422-project Sep 23 04:45:55.938894 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:45:55.938894 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 2c316737-b84f-4b49-a5ab-cc0196b15760 could not be found. Sep 23 04:45:55.938894 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '2c316737-b84f-4b49-a5ab-cc0196b15760'} Sep 23 04:45:55.938894 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:45:55.938894 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:45:55.938894 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:45:55.938894 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:45:55.938894 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:45:55.938894 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:45:55.938894 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:45:55.938894 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:45:55.938894 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:45:55.938894 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:45:55.938894 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c316737-b84f-4b49-a5ab-cc0196b15760 could not be found. Sep 23 04:45:55.938894 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:45:55.938894 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:45:55.938894 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:45:55.938894 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:45:55.938894 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:45:55.938894 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:45:55.938894 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:45:55.938894 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:45:55.938894 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:45:55.938894 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:45:55.938894 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:45:55.938894 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:45:55.938894 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:45:55.938894 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:45:55.938894 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:45:55.938894 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:45:55.938894 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c316737-b84f-4b49-a5ab-cc0196b15760 could not be found. Sep 23 04:45:55.938894 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:45:55.938894 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:45:55.938894 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:45:55.943197 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:45:55.943197 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:45:55.943197 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:45:55.943197 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:45:55.943197 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:45:55.943197 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c316737-b84f-4b49-a5ab-cc0196b15760 could not be found. Sep 23 04:45:55.943197 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:45:55.943197 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f07d88d7-4172-48d6-8eae-cea9b883b72e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Returning 404 to user: Instance 2c316737-b84f-4b49-a5ab-cc0196b15760 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:45:55.943197 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f07d88d7-4172-48d6-8eae-cea9b883b72e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/2c316737-b84f-4b49-a5ab-cc0196b15760" status: 404 len: 111 microversion: 2.1 time: 0.065273 Sep 23 04:45:55.945939 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1654/3363] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:45:55 2022] GET /compute/v2.1/servers/2c316737-b84f-4b49-a5ab-cc0196b15760 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:45:55.960747 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-da072d26-ac29-4f44-a40d-68ec0d2b96e9 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:55.964222 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-da072d26-ac29-4f44-a40d-68ec0d2b96e9 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] [instance: a369d441-1f65-4e05-ba68-8e606497a368] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:55.978410 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-da072d26-ac29-4f44-a40d-68ec0d2b96e9 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:55.978912 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-da072d26-ac29-4f44-a40d-68ec0d2b96e9 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:55.979359 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-da072d26-ac29-4f44-a40d-68ec0d2b96e9 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:55.988635 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-da072d26-ac29-4f44-a40d-68ec0d2b96e9 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:55.991196 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-da072d26-ac29-4f44-a40d-68ec0d2b96e9 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:55.995011 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-da072d26-ac29-4f44-a40d-68ec0d2b96e9 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:56.377165 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-da072d26-ac29-4f44-a40d-68ec0d2b96e9 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aaca3ba23b4c46bcebc4f60a7337a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268508420e3c4d4cb3d60cb19488bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:56.394148 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-da072d26-ac29-4f44-a40d-68ec0d2b96e9 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90aaca3ba23b4c46bcebc4f60a7337a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268508420e3c4d4cb3d60cb19488bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:56.405923 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-da072d26-ac29-4f44-a40d-68ec0d2b96e9 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90aaca3ba23b4c46bcebc4f60a7337a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268508420e3c4d4cb3d60cb19488bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:56.407166 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-da072d26-ac29-4f44-a40d-68ec0d2b96e9 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] 10.222.0.33 "GET /compute/v2.1/servers/a369d441-1f65-4e05-ba68-8e606497a368" status: 200 len: 1413 microversion: 2.54 time: 0.460217 Sep 23 04:45:56.407723 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1655/3364] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:45:55 2022] GET /compute/v2.1/servers/a369d441-1f65-4e05-ba68-8e606497a368 => generated 1413 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:45:56.430842 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b5dc8d73-0b9e-4f76-b461-86b81016b77a tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '.version_select at 0x7ff1ba9aadc0>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:56.584505 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b5dc8d73-0b9e-4f76-b461-86b81016b77a tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/images/61d751db-b940-4f89-b620-4902c2decb81" status: 200 len: 1414 microversion: 2.1 time: 0.171983 Sep 23 04:45:56.585403 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1656/3365] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:45:56 2022] GET /compute/v2.1/images/61d751db-b940-4f89-b620-4902c2decb81 => generated 1414 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:45:56.598880 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7bdaace3-775c-4e9a-91fe-3b46d24af73b tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1075565945", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "networks": [{"uuid": "e70e4da0-3337-4af1-b4df-8067d676f5e8"}]}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:45:56.710352 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.network.neutron [None req-7bdaace3-775c-4e9a-91fe-3b46d24af73b tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] validate_networks() for [('e70e4da0-3337-4af1-b4df-8067d676f5e8', None, None, None, None, None)] {{(pid=122698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:45:58.501551 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-7bdaace3-775c-4e9a-91fe-3b46d24af73b tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Flavor limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:45:58.504459 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-7bdaace3-775c-4e9a-91fe-3b46d24af73b tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Image limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:45:58.504459 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-7bdaace3-775c-4e9a-91fe-3b46d24af73b tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Flavor pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:45:58.504459 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-7bdaace3-775c-4e9a-91fe-3b46d24af73b tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Image pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:45:58.510938 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-7bdaace3-775c-4e9a-91fe-3b46d24af73b tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:45:58.547360 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7bdaace3-775c-4e9a-91fe-3b46d24af73b tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:58.547864 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7bdaace3-775c-4e9a-91fe-3b46d24af73b tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:58.548358 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7bdaace3-775c-4e9a-91fe-3b46d24af73b tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:58.553158 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7bdaace3-775c-4e9a-91fe-3b46d24af73b tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:58.553993 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7bdaace3-775c-4e9a-91fe-3b46d24af73b tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:58.554144 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7bdaace3-775c-4e9a-91fe-3b46d24af73b tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:58.608920 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-7bdaace3-775c-4e9a-91fe-3b46d24af73b tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Getting quotas for project c23bd5a8b84942898a99930b2bc0ca12. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:45:58.615132 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-7bdaace3-775c-4e9a-91fe-3b46d24af73b tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Getting quotas for user 252c87e244984f71ae0907ee769bec05 and project c23bd5a8b84942898a99930b2bc0ca12. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:45:58.647918 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7bdaace3-775c-4e9a-91fe-3b46d24af73b tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Going to run 1 instances... {{(pid=122698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:45:58.650533 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7bdaace3-775c-4e9a-91fe-3b46d24af73b tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 5977951e-84f3-4f6b-b86f-44853cc1bc60] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:45:58.831662 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7bdaace3-775c-4e9a-91fe-3b46d24af73b tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.244636 Sep 23 04:45:58.832335 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1657/3366] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:45:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 2246 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:45:58.841867 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-facf817c-2c05-4b72-a1e5-cf9e87eb5772 tempest-FloatingIPDetailsTestJSON-1403081710 tempest-FloatingIPDetailsTestJSON-1403081710-project] 10.222.0.33 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 5.455996 Sep 23 04:45:58.845273 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-b1d9b616-62a6-49d7-a06e-2a6b71bc329c req-14d8270b-c44e-4009-b4b6-6a8c41672890 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1eab370-87bb-4d58-bcaf-c41520e016a0", "name": "network-vif-deleted", "tag": "eae362d7-35fd-4917-9b61-a1977494380e"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:45:58.851821 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1710/3367] 10.222.0.33 () {60 vars in 1170 bytes} [Fri Sep 23 04:45:53 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 5467 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:45:58.866594 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c9e3d8ee-6791-4248-be06-08ca9a7d16e8 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:58.867523 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c9e3d8ee-6791-4248-be06-08ca9a7d16e8 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] [instance: b1eab370-87bb-4d58-bcaf-c41520e016a0] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:58.870662 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-b1d9b616-62a6-49d7-a06e-2a6b71bc329c req-14d8270b-c44e-4009-b4b6-6a8c41672890 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:58.874683 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-b1d9b616-62a6-49d7-a06e-2a6b71bc329c req-14d8270b-c44e-4009-b4b6-6a8c41672890 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:58.875379 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-b1d9b616-62a6-49d7-a06e-2a6b71bc329c req-14d8270b-c44e-4009-b4b6-6a8c41672890 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:58.910991 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c9e3d8ee-6791-4248-be06-08ca9a7d16e8 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:58.913194 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c9e3d8ee-6791-4248-be06-08ca9a7d16e8 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:58.914926 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c9e3d8ee-6791-4248-be06-08ca9a7d16e8 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:58.919972 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c9e3d8ee-6791-4248-be06-08ca9a7d16e8 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:58.920354 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-b1d9b616-62a6-49d7-a06e-2a6b71bc329c req-14d8270b-c44e-4009-b4b6-6a8c41672890 service nova] Creating event network-vif-deleted:eae362d7-35fd-4917-9b61-a1977494380e for instance b1eab370-87bb-4d58-bcaf-c41520e016a0 on n-h1-846463-3 Sep 23 04:45:58.923272 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c9e3d8ee-6791-4248-be06-08ca9a7d16e8 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:58.924127 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c9e3d8ee-6791-4248-be06-08ca9a7d16e8 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:58.928988 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-b1d9b616-62a6-49d7-a06e-2a6b71bc329c req-14d8270b-c44e-4009-b4b6-6a8c41672890 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095355 Sep 23 04:45:58.929598 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1658/3368] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:45:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:45:59.009868 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-c9e3d8ee-6791-4248-be06-08ca9a7d16e8 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] HTTP exception thrown: Instance b1eab370-87bb-4d58-bcaf-c41520e016a0 could not be found. Sep 23 04:45:59.016531 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c9e3d8ee-6791-4248-be06-08ca9a7d16e8 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Request method failure captured: Sep 23 04:45:59.016531 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/b1eab370-87bb-4d58-bcaf-c41520e016a0 HTTP/1.1 Sep 23 04:45:59.016531 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:45:59.016531 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:45:59.016531 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:45:59.016531 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:45:59.016531 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:45:59.016531 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:45:59.016531 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:45:59.016531 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:45:59.016531 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTncf_4iRHzO4Tk3A89kDuh3iSPpmneEoF0njQrwaKT7c2lfueVEfoj2xQ20faOXdut26yG2Pgn37UIiY54IKCnUQRr9VtjPfcXNoDrqQITyQHgWRDBkhmn3eQSsN6s4pCLaxTrXZ_wGB8OirE5M3bBLWwDCtHrGxpV-yn6q0WDQjLY Sep 23 04:45:59.016531 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:45:59.016531 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:45:59.016531 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:45:59.016531 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:45:59.016531 n-d-846463-3 devstack@n-api.service[122699]: X-Openstack-Nova-Api-Version: 2.21 Sep 23 04:45:59.016531 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:45:59.016531 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:45:59.016531 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: ecebd3f6411d4d9d9a85b84c77efab02 Sep 23 04:45:59.016531 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-InstanceActionsV221TestJSON-850095259 Sep 23 04:45:59.016531 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:45:59.016531 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:45:59.016531 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ecebd3f6411d4d9d9a85b84c77efab02", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ecebd3f6411d4d9d9a85b84c77efab02"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ecebd3f6411d4d9d9a85b84c77efab02"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ecebd3f6411d4d9d9a85b84c77efab02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:45:59.016531 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-InstanceActionsV221TestJSON-850095259 Sep 23 04:45:59.016531 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: ecebd3f6411d4d9d9a85b84c77efab02 Sep 23 04:45:59.016531 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-850095259 Sep 23 04:45:59.016531 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-InstanceActionsV221TestJSON-850095259-project Sep 23 04:45:59.016531 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:45:59.016531 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:45:59.016531 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: a450c16562c24174809ea6819a26c62e Sep 23 04:45:59.016531 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-InstanceActionsV221TestJSON-850095259-project Sep 23 04:45:59.016531 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:45:59.016531 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance b1eab370-87bb-4d58-bcaf-c41520e016a0 could not be found. Sep 23 04:45:59.016531 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': 'b1eab370-87bb-4d58-bcaf-c41520e016a0'} Sep 23 04:45:59.016531 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:45:59.016531 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:45:59.016531 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:45:59.016531 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:45:59.016531 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:45:59.016531 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:45:59.016531 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:45:59.016531 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:45:59.016531 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:45:59.016531 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:45:59.016531 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1eab370-87bb-4d58-bcaf-c41520e016a0 could not be found. Sep 23 04:45:59.016531 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:45:59.016531 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:45:59.016531 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:45:59.016531 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:45:59.016531 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:45:59.016531 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:45:59.016531 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:45:59.016531 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:45:59.016531 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:45:59.016531 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:45:59.016531 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:45:59.016531 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:45:59.016531 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:45:59.016531 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:45:59.016531 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:45:59.016531 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:45:59.016531 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1eab370-87bb-4d58-bcaf-c41520e016a0 could not be found. Sep 23 04:45:59.016531 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:45:59.016531 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:45:59.022665 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:45:59.022665 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:45:59.022665 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:45:59.022665 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:45:59.022665 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:45:59.022665 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:45:59.022665 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1eab370-87bb-4d58-bcaf-c41520e016a0 could not be found. Sep 23 04:45:59.022665 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:45:59.031548 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c9e3d8ee-6791-4248-be06-08ca9a7d16e8 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Returning 404 to user: Instance b1eab370-87bb-4d58-bcaf-c41520e016a0 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:45:59.035557 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c9e3d8ee-6791-4248-be06-08ca9a7d16e8 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] 10.222.0.33 "GET /compute/v2.1/servers/b1eab370-87bb-4d58-bcaf-c41520e016a0" status: 404 len: 111 microversion: 2.21 time: 0.180221 Sep 23 04:45:59.039605 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1711/3369] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:45:58 2022] GET /compute/v2.1/servers/b1eab370-87bb-4d58-bcaf-c41520e016a0 => generated 111 bytes in 187 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 23 04:45:59.058122 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a8fb9150-0ec4-4c50-8843-f410ce49c2fb tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:59.059178 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a8fb9150-0ec4-4c50-8843-f410ce49c2fb tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] [instance: a369d441-1f65-4e05-ba68-8e606497a368] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:59.074008 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a8fb9150-0ec4-4c50-8843-f410ce49c2fb tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:59.079428 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a8fb9150-0ec4-4c50-8843-f410ce49c2fb tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:59.079428 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a8fb9150-0ec4-4c50-8843-f410ce49c2fb tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:59.079428 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a8fb9150-0ec4-4c50-8843-f410ce49c2fb tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:45:59.079428 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a8fb9150-0ec4-4c50-8843-f410ce49c2fb tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:45:59.079428 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a8fb9150-0ec4-4c50-8843-f410ce49c2fb tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:45:59.108710 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2981f027-0b5a-436d-abba-f78311248da9 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-909561041", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:45:59.217012 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.network.neutron [None req-2981f027-0b5a-436d-abba-f78311248da9 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] validate_networks() for [('d1eca3a2-09d8-4072-bb9b-de5d4b83a47e', None, None, None, None, None)] {{(pid=122698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:45:59.424835 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a8fb9150-0ec4-4c50-8843-f410ce49c2fb tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aaca3ba23b4c46bcebc4f60a7337a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268508420e3c4d4cb3d60cb19488bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:59.440508 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a8fb9150-0ec4-4c50-8843-f410ce49c2fb tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90aaca3ba23b4c46bcebc4f60a7337a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268508420e3c4d4cb3d60cb19488bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:59.471748 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a8fb9150-0ec4-4c50-8843-f410ce49c2fb tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90aaca3ba23b4c46bcebc4f60a7337a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268508420e3c4d4cb3d60cb19488bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:59.471748 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a8fb9150-0ec4-4c50-8843-f410ce49c2fb tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] 10.222.0.33 "GET /compute/v2.1/servers/a369d441-1f65-4e05-ba68-8e606497a368" status: 200 len: 1398 microversion: 2.54 time: 0.425441 Sep 23 04:45:59.481107 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1712/3370] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:45:59 2022] GET /compute/v2.1/servers/a369d441-1f65-4e05-ba68-8e606497a368 => generated 1398 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:45:59.486712 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c49c8cf6-2196-4649-8fdb-de96203680f2 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '.version_select at 0x7ff1bafc1b80>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:59.588912 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c49c8cf6-2196-4649-8fdb-de96203680f2 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/images/61d751db-b940-4f89-b620-4902c2decb81" status: 200 len: 1414 microversion: 2.1 time: 0.106200 Sep 23 04:45:59.593815 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1713/3371] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:45:59 2022] GET /compute/v2.1/images/61d751db-b940-4f89-b620-4902c2decb81 => generated 1414 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:45:59.602982 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-577a7660-af7c-4471-b6fc-4947c4a14be7 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:45:59.603881 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-577a7660-af7c-4471-b6fc-4947c4a14be7 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 5977951e-84f3-4f6b-b86f-44853cc1bc60] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:45:59.826866 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-577a7660-af7c-4471-b6fc-4947c4a14be7 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:45:59.840235 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-577a7660-af7c-4471-b6fc-4947c4a14be7 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/5977951e-84f3-4f6b-b86f-44853cc1bc60" status: 200 len: 1209 microversion: 2.1 time: 0.244188 Sep 23 04:45:59.845279 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1714/3372] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:45:59 2022] GET /compute/v2.1/servers/5977951e-84f3-4f6b-b86f-44853cc1bc60 => generated 1209 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:45:59.865916 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6f125177-f2bd-49b3-9999-01ea78946091 tempest-FloatingIPDetailsTestJSON-1403081710 tempest-FloatingIPDetailsTestJSON-1403081710-project] Action: 'create', calling method: .version_select at 0x7ff1bb733700>, body: {"pool": null} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:46:01.488672 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-2981f027-0b5a-436d-abba-f78311248da9 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Flavor limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:46:01.489658 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-2981f027-0b5a-436d-abba-f78311248da9 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Image limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:46:01.490352 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-2981f027-0b5a-436d-abba-f78311248da9 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Flavor pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:46:01.490957 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-2981f027-0b5a-436d-abba-f78311248da9 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Image pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:46:01.491533 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-2981f027-0b5a-436d-abba-f78311248da9 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:46:01.532477 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2981f027-0b5a-436d-abba-f78311248da9 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:01.533268 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2981f027-0b5a-436d-abba-f78311248da9 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:01.533880 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2981f027-0b5a-436d-abba-f78311248da9 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:01.537510 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2981f027-0b5a-436d-abba-f78311248da9 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:01.538247 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2981f027-0b5a-436d-abba-f78311248da9 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:01.538856 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2981f027-0b5a-436d-abba-f78311248da9 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:01.607915 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-2981f027-0b5a-436d-abba-f78311248da9 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Getting quotas for project dcafb05f6f554e278cd552023947c6ac. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:46:01.638312 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-2981f027-0b5a-436d-abba-f78311248da9 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Getting quotas for user c786bbedc21849ea92924139a44707b7 and project dcafb05f6f554e278cd552023947c6ac. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:46:01.731620 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-2981f027-0b5a-436d-abba-f78311248da9 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Going to run 1 instances... {{(pid=122698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:46:01.741220 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-2981f027-0b5a-436d-abba-f78311248da9 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: f0374fc2-3c0f-48e1-b969-2933785fd47b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:46:01.977419 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2981f027-0b5a-436d-abba-f78311248da9 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.033417 Sep 23 04:46:01.980411 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1659/3373] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:45:58 2022] POST /compute/v2.1/servers => generated 383 bytes in 3037 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:46:01.992803 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-aa8d1e1d-3157-4f1f-b480-585820836d1a tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Calling method '.version_select at 0x7ff1ba9ad310>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:01.993399 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-aa8d1e1d-3157-4f1f-b480-585820836d1a tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] [instance: b1eab370-87bb-4d58-bcaf-c41520e016a0] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:02.025054 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-aa8d1e1d-3157-4f1f-b480-585820836d1a tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:02.025054 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-aa8d1e1d-3157-4f1f-b480-585820836d1a tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:02.025629 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-aa8d1e1d-3157-4f1f-b480-585820836d1a tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:02.027007 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-aa8d1e1d-3157-4f1f-b480-585820836d1a tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:02.029961 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-aa8d1e1d-3157-4f1f-b480-585820836d1a tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:02.030620 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-aa8d1e1d-3157-4f1f-b480-585820836d1a tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:02.220649 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-aa8d1e1d-3157-4f1f-b480-585820836d1a tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] 10.222.0.33 "GET /compute/v2.1/servers/b1eab370-87bb-4d58-bcaf-c41520e016a0/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.238880 Sep 23 04:46:02.240413 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1660/3374] 10.222.0.33 () {60 vars in 1337 bytes} [Fri Sep 23 04:46:01 2022] GET /compute/v2.1/servers/b1eab370-87bb-4d58-bcaf-c41520e016a0/os-instance-actions => generated 611 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 04:46:02.255233 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d7aa80d2-eda3-4281-b532-9822612b4e56 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Calling method '.version_select at 0x7ff1ba9adf70>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:02.292947 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=3,nova_api:INSERT=6 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:46:02.364315 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d7aa80d2-eda3-4281-b532-9822612b4e56 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-107314317" status: 204 len: 0 microversion: 2.54 time: 0.129098 Sep 23 04:46:02.371234 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1661/3375] 10.222.0.33 () {60 vars in 1316 bytes} [Fri Sep 23 04:46:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-107314317 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 23 04:46:02.371635 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1f6fe2ea-465e-4539-960d-d203d05bbfca tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '.version_select at 0x7ff1ba9f0430>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:02.458960 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-1f6fe2ea-465e-4539-960d-d203d05bbfca tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/images/61d751db-b940-4f89-b620-4902c2decb81" status: 200 len: 1414 microversion: 2.1 time: 0.091526 Sep 23 04:46:02.459567 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1662/3376] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:46:02 2022] GET /compute/v2.1/images/61d751db-b940-4f89-b620-4902c2decb81 => generated 1414 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:02.487061 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f58ebfa1-9b45-4cf9-8d03-173cd77759c6 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:02.491854 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f58ebfa1-9b45-4cf9-8d03-173cd77759c6 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 5977951e-84f3-4f6b-b86f-44853cc1bc60] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:02.515191 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f58ebfa1-9b45-4cf9-8d03-173cd77759c6 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:02.515787 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f58ebfa1-9b45-4cf9-8d03-173cd77759c6 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:02.517065 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f58ebfa1-9b45-4cf9-8d03-173cd77759c6 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:02.520431 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f58ebfa1-9b45-4cf9-8d03-173cd77759c6 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:02.520945 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f58ebfa1-9b45-4cf9-8d03-173cd77759c6 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:02.523143 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f58ebfa1-9b45-4cf9-8d03-173cd77759c6 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:02.687913 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f58ebfa1-9b45-4cf9-8d03-173cd77759c6 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:02.709531 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f58ebfa1-9b45-4cf9-8d03-173cd77759c6 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/5977951e-84f3-4f6b-b86f-44853cc1bc60" status: 200 len: 1267 microversion: 2.1 time: 0.236255 Sep 23 04:46:02.715325 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1663/3377] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:02 2022] GET /compute/v2.1/servers/5977951e-84f3-4f6b-b86f-44853cc1bc60 => generated 1267 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:02.728671 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-fc3bd4a0-e684-4f95-8a9e-65bdb491a23a tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:02.731264 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-fc3bd4a0-e684-4f95-8a9e-65bdb491a23a tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: f0374fc2-3c0f-48e1-b969-2933785fd47b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:02.986428 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-fc3bd4a0-e684-4f95-8a9e-65bdb491a23a tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c786bbedc21849ea92924139a44707b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcafb05f6f554e278cd552023947c6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:03.006599 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-fc3bd4a0-e684-4f95-8a9e-65bdb491a23a tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/f0374fc2-3c0f-48e1-b969-2933785fd47b" status: 200 len: 1221 microversion: 2.1 time: 0.290061 Sep 23 04:46:03.014340 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1664/3378] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:02 2022] GET /compute/v2.1/servers/f0374fc2-3c0f-48e1-b969-2933785fd47b => generated 1221 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:03.021444 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-930979b8-69b5-42bd-b6a4-75690ebb8d12 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:03.021984 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-930979b8-69b5-42bd-b6a4-75690ebb8d12 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] [instance: b1eab370-87bb-4d58-bcaf-c41520e016a0] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:03.043372 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-930979b8-69b5-42bd-b6a4-75690ebb8d12 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:03.056627 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-930979b8-69b5-42bd-b6a4-75690ebb8d12 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:03.057356 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-930979b8-69b5-42bd-b6a4-75690ebb8d12 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:03.060537 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-930979b8-69b5-42bd-b6a4-75690ebb8d12 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:03.065324 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-930979b8-69b5-42bd-b6a4-75690ebb8d12 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:03.066504 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-930979b8-69b5-42bd-b6a4-75690ebb8d12 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:03.116912 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-930979b8-69b5-42bd-b6a4-75690ebb8d12 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] HTTP exception thrown: Instance b1eab370-87bb-4d58-bcaf-c41520e016a0 could not be found. Sep 23 04:46:03.126872 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-930979b8-69b5-42bd-b6a4-75690ebb8d12 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Request method failure captured: Sep 23 04:46:03.126872 n-d-846463-3 devstack@n-api.service[122698]: request: DELETE /compute/v2.1/servers/b1eab370-87bb-4d58-bcaf-c41520e016a0 HTTP/1.1 Sep 23 04:46:03.126872 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:46:03.126872 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:46:03.126872 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:46:03.126872 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:46:03.126872 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:46:03.126872 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:46:03.126872 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:46:03.126872 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:46:03.126872 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTncf_4iRHzO4Tk3A89kDuh3iSPpmneEoF0njQrwaKT7c2lfueVEfoj2xQ20faOXdut26yG2Pgn37UIiY54IKCnUQRr9VtjPfcXNoDrqQITyQHgWRDBkhmn3eQSsN6s4pCLaxTrXZ_wGB8OirE5M3bBLWwDCtHrGxpV-yn6q0WDQjLY Sep 23 04:46:03.126872 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:46:03.126872 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:46:03.126872 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:46:03.126872 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:46:03.126872 n-d-846463-3 devstack@n-api.service[122698]: X-Openstack-Nova-Api-Version: 2.21 Sep 23 04:46:03.126872 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:46:03.126872 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:46:03.126872 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: ecebd3f6411d4d9d9a85b84c77efab02 Sep 23 04:46:03.126872 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-InstanceActionsV221TestJSON-850095259 Sep 23 04:46:03.126872 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:46:03.126872 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:46:03.126872 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ecebd3f6411d4d9d9a85b84c77efab02", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ecebd3f6411d4d9d9a85b84c77efab02"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ecebd3f6411d4d9d9a85b84c77efab02"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ecebd3f6411d4d9d9a85b84c77efab02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:46:03.126872 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-InstanceActionsV221TestJSON-850095259 Sep 23 04:46:03.126872 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: ecebd3f6411d4d9d9a85b84c77efab02 Sep 23 04:46:03.126872 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-850095259 Sep 23 04:46:03.126872 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-InstanceActionsV221TestJSON-850095259-project Sep 23 04:46:03.126872 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:46:03.126872 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:46:03.126872 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: a450c16562c24174809ea6819a26c62e Sep 23 04:46:03.126872 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-InstanceActionsV221TestJSON-850095259-project Sep 23 04:46:03.126872 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:46:03.126872 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance b1eab370-87bb-4d58-bcaf-c41520e016a0 could not be found. Sep 23 04:46:03.126872 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': 'b1eab370-87bb-4d58-bcaf-c41520e016a0'} Sep 23 04:46:03.126872 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:46:03.126872 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:46:03.126872 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:46:03.126872 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:46:03.126872 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:46:03.126872 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:46:03.126872 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:46:03.126872 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:46:03.126872 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:46:03.126872 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:46:03.126872 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1eab370-87bb-4d58-bcaf-c41520e016a0 could not be found. Sep 23 04:46:03.126872 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:46:03.126872 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:46:03.126872 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:46:03.126872 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:46:03.126872 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:46:03.126872 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:46:03.126872 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:46:03.126872 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:46:03.126872 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:46:03.126872 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:46:03.126872 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 04:46:03.126872 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 04:46:03.126872 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 04:46:03.126872 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 04:46:03.126872 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:46:03.126872 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:46:03.126872 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:46:03.126872 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:46:03.131821 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1eab370-87bb-4d58-bcaf-c41520e016a0 could not be found. Sep 23 04:46:03.131821 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:46:03.131821 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:46:03.131821 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:46:03.131821 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:46:03.131821 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:46:03.131821 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:46:03.131821 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:46:03.131821 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:46:03.131821 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1eab370-87bb-4d58-bcaf-c41520e016a0 could not be found. Sep 23 04:46:03.131821 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:46:03.134369 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-930979b8-69b5-42bd-b6a4-75690ebb8d12 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Returning 404 to user: Instance b1eab370-87bb-4d58-bcaf-c41520e016a0 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:46:03.135431 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-930979b8-69b5-42bd-b6a4-75690ebb8d12 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b1eab370-87bb-4d58-bcaf-c41520e016a0" status: 404 len: 111 microversion: 2.21 time: 0.120055 Sep 23 04:46:03.139060 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1665/3379] 10.222.0.33 () {60 vars in 1280 bytes} [Fri Sep 23 04:46:03 2022] DELETE /compute/v2.1/servers/b1eab370-87bb-4d58-bcaf-c41520e016a0 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 23 04:46:03.146376 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-68b7f1ff-ee69-4e6c-b89e-e77c349d86ec tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:03.150769 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-68b7f1ff-ee69-4e6c-b89e-e77c349d86ec tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] [instance: a369d441-1f65-4e05-ba68-8e606497a368] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:03.165221 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-68b7f1ff-ee69-4e6c-b89e-e77c349d86ec tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:03.166468 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-68b7f1ff-ee69-4e6c-b89e-e77c349d86ec tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:03.170812 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-68b7f1ff-ee69-4e6c-b89e-e77c349d86ec tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:03.174879 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-68b7f1ff-ee69-4e6c-b89e-e77c349d86ec tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:03.176217 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-68b7f1ff-ee69-4e6c-b89e-e77c349d86ec tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:03.181107 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-68b7f1ff-ee69-4e6c-b89e-e77c349d86ec tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:03.240188 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-68b7f1ff-ee69-4e6c-b89e-e77c349d86ec tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] [instance: a369d441-1f65-4e05-ba68-8e606497a368] Going to try to terminate instance {{(pid=122698) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:46:03.316943 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:46:03.787513 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-68b7f1ff-ee69-4e6c-b89e-e77c349d86ec tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a369d441-1f65-4e05-ba68-8e606497a368" status: 204 len: 0 microversion: 2.54 time: 0.645957 Sep 23 04:46:03.788676 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1666/3380] 10.222.0.33 () {60 vars in 1280 bytes} [Fri Sep 23 04:46:03 2022] DELETE /compute/v2.1/servers/a369d441-1f65-4e05-ba68-8e606497a368 => generated 0 bytes in 649 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 23 04:46:03.828357 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8b342996-fd4e-4264-bcf2-e2e53476bb3b tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-24812617", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:46:04.021526 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.network.neutron [None req-8b342996-fd4e-4264-bcf2-e2e53476bb3b tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] validate_networks() for [('d1eca3a2-09d8-4072-bb9b-de5d4b83a47e', None, None, None, None, None)] {{(pid=122698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:46:05.845383 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-8b342996-fd4e-4264-bcf2-e2e53476bb3b tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Flavor limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:46:05.846093 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-8b342996-fd4e-4264-bcf2-e2e53476bb3b tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Image limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:46:05.846319 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-8b342996-fd4e-4264-bcf2-e2e53476bb3b tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Flavor pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:46:05.847241 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-8b342996-fd4e-4264-bcf2-e2e53476bb3b tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Image pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:46:05.847393 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-8b342996-fd4e-4264-bcf2-e2e53476bb3b tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:46:05.858765 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8b342996-fd4e-4264-bcf2-e2e53476bb3b tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:05.859255 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8b342996-fd4e-4264-bcf2-e2e53476bb3b tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:05.862655 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8b342996-fd4e-4264-bcf2-e2e53476bb3b tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:05.862655 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8b342996-fd4e-4264-bcf2-e2e53476bb3b tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:05.862655 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8b342996-fd4e-4264-bcf2-e2e53476bb3b tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:05.862655 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8b342996-fd4e-4264-bcf2-e2e53476bb3b tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:05.880875 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-8b342996-fd4e-4264-bcf2-e2e53476bb3b tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Getting quotas for project dcafb05f6f554e278cd552023947c6ac. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:46:05.889361 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-8b342996-fd4e-4264-bcf2-e2e53476bb3b tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Getting quotas for user c786bbedc21849ea92924139a44707b7 and project dcafb05f6f554e278cd552023947c6ac. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:46:05.920473 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8b342996-fd4e-4264-bcf2-e2e53476bb3b tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Going to run 1 instances... {{(pid=122698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:46:05.932580 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8b342996-fd4e-4264-bcf2-e2e53476bb3b tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: 9763a452-dc3c-436d-bee4-a3967af3bcbb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:46:06.147961 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8b342996-fd4e-4264-bcf2-e2e53476bb3b tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.358162 Sep 23 04:46:06.148994 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1667/3381] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:46:03 2022] POST /compute/v2.1/servers => generated 383 bytes in 2360 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:46:06.154124 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9ce15581-f54c-4885-9d7d-76775bf4a721 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:06.155255 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-9ce15581-f54c-4885-9d7d-76775bf4a721 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] [instance: b1eab370-87bb-4d58-bcaf-c41520e016a0] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:06.170670 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9ce15581-f54c-4885-9d7d-76775bf4a721 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:06.175494 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9ce15581-f54c-4885-9d7d-76775bf4a721 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:06.176507 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9ce15581-f54c-4885-9d7d-76775bf4a721 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:06.177461 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9ce15581-f54c-4885-9d7d-76775bf4a721 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:06.178517 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9ce15581-f54c-4885-9d7d-76775bf4a721 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:06.179625 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9ce15581-f54c-4885-9d7d-76775bf4a721 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:06.201272 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-9ce15581-f54c-4885-9d7d-76775bf4a721 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] HTTP exception thrown: Instance b1eab370-87bb-4d58-bcaf-c41520e016a0 could not be found. Sep 23 04:46:06.206783 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9ce15581-f54c-4885-9d7d-76775bf4a721 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Request method failure captured: Sep 23 04:46:06.206783 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/b1eab370-87bb-4d58-bcaf-c41520e016a0 HTTP/1.1 Sep 23 04:46:06.206783 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:46:06.206783 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:46:06.206783 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:46:06.206783 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:46:06.206783 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:46:06.206783 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:46:06.206783 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:46:06.206783 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:46:06.206783 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTncf_4iRHzO4Tk3A89kDuh3iSPpmneEoF0njQrwaKT7c2lfueVEfoj2xQ20faOXdut26yG2Pgn37UIiY54IKCnUQRr9VtjPfcXNoDrqQITyQHgWRDBkhmn3eQSsN6s4pCLaxTrXZ_wGB8OirE5M3bBLWwDCtHrGxpV-yn6q0WDQjLY Sep 23 04:46:06.206783 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:46:06.206783 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:46:06.206783 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:46:06.206783 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:46:06.206783 n-d-846463-3 devstack@n-api.service[122698]: X-Openstack-Nova-Api-Version: 2.21 Sep 23 04:46:06.206783 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:46:06.206783 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:46:06.206783 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: ecebd3f6411d4d9d9a85b84c77efab02 Sep 23 04:46:06.206783 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-InstanceActionsV221TestJSON-850095259 Sep 23 04:46:06.206783 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:46:06.206783 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:46:06.206783 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ecebd3f6411d4d9d9a85b84c77efab02", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ecebd3f6411d4d9d9a85b84c77efab02"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ecebd3f6411d4d9d9a85b84c77efab02"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ecebd3f6411d4d9d9a85b84c77efab02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:46:06.206783 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-InstanceActionsV221TestJSON-850095259 Sep 23 04:46:06.206783 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: ecebd3f6411d4d9d9a85b84c77efab02 Sep 23 04:46:06.206783 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-850095259 Sep 23 04:46:06.206783 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-InstanceActionsV221TestJSON-850095259-project Sep 23 04:46:06.206783 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:46:06.206783 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:46:06.206783 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: a450c16562c24174809ea6819a26c62e Sep 23 04:46:06.206783 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-InstanceActionsV221TestJSON-850095259-project Sep 23 04:46:06.206783 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:46:06.206783 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance b1eab370-87bb-4d58-bcaf-c41520e016a0 could not be found. Sep 23 04:46:06.206783 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': 'b1eab370-87bb-4d58-bcaf-c41520e016a0'} Sep 23 04:46:06.206783 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:46:06.206783 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:46:06.206783 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:46:06.206783 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:46:06.206783 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:46:06.206783 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:46:06.206783 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:46:06.206783 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:46:06.206783 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:46:06.206783 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:46:06.206783 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1eab370-87bb-4d58-bcaf-c41520e016a0 could not be found. Sep 23 04:46:06.206783 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:46:06.206783 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:46:06.206783 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:46:06.206783 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:46:06.206783 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:46:06.206783 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:46:06.206783 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:46:06.206783 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:46:06.206783 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:46:06.206783 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:46:06.206783 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:46:06.206783 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:46:06.206783 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:46:06.206783 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:46:06.206783 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:46:06.206783 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:46:06.206783 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1eab370-87bb-4d58-bcaf-c41520e016a0 could not be found. Sep 23 04:46:06.206783 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:46:06.206783 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:46:06.216961 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:46:06.216961 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:46:06.216961 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:46:06.216961 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:46:06.216961 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:46:06.216961 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:46:06.216961 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1eab370-87bb-4d58-bcaf-c41520e016a0 could not be found. Sep 23 04:46:06.216961 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:46:06.216961 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9ce15581-f54c-4885-9d7d-76775bf4a721 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] Returning 404 to user: Instance b1eab370-87bb-4d58-bcaf-c41520e016a0 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:46:06.216961 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9ce15581-f54c-4885-9d7d-76775bf4a721 tempest-InstanceActionsV221TestJSON-850095259 tempest-InstanceActionsV221TestJSON-850095259-project] 10.222.0.33 "GET /compute/v2.1/servers/b1eab370-87bb-4d58-bcaf-c41520e016a0" status: 404 len: 111 microversion: 2.21 time: 0.058425 Sep 23 04:46:06.216961 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1668/3382] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:46:06 2022] GET /compute/v2.1/servers/b1eab370-87bb-4d58-bcaf-c41520e016a0 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 23 04:46:06.224992 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c54c503f-9f19-497d-a664-21c448d51a47 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '.version_select at 0x7ff1ba9f0670>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:06.282877 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c54c503f-9f19-497d-a664-21c448d51a47 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/images/61d751db-b940-4f89-b620-4902c2decb81" status: 200 len: 1423 microversion: 2.1 time: 0.072719 Sep 23 04:46:06.292902 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1669/3383] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:46:06 2022] GET /compute/v2.1/images/61d751db-b940-4f89-b620-4902c2decb81 => generated 1423 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:06.297285 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ff5cb858-1239-47ae-87c7-dca6d031c987 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:06.297951 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-ff5cb858-1239-47ae-87c7-dca6d031c987 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 5977951e-84f3-4f6b-b86f-44853cc1bc60] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:06.354381 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ff5cb858-1239-47ae-87c7-dca6d031c987 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:06.354910 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ff5cb858-1239-47ae-87c7-dca6d031c987 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:06.357008 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ff5cb858-1239-47ae-87c7-dca6d031c987 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:06.365749 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ff5cb858-1239-47ae-87c7-dca6d031c987 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:06.365749 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ff5cb858-1239-47ae-87c7-dca6d031c987 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:06.365749 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ff5cb858-1239-47ae-87c7-dca6d031c987 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:07.657462 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ff5cb858-1239-47ae-87c7-dca6d031c987 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:07.686564 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ff5cb858-1239-47ae-87c7-dca6d031c987 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/5977951e-84f3-4f6b-b86f-44853cc1bc60" status: 200 len: 1309 microversion: 2.1 time: 1.400355 Sep 23 04:46:07.687913 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1670/3384] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:06 2022] GET /compute/v2.1/servers/5977951e-84f3-4f6b-b86f-44853cc1bc60 => generated 1309 bytes in 1403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:07.693861 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e10fe1a6-df4a-48ac-9495-3cd69c844e14 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:07.695660 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e10fe1a6-df4a-48ac-9495-3cd69c844e14 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] [instance: a369d441-1f65-4e05-ba68-8e606497a368] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:07.702698 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e10fe1a6-df4a-48ac-9495-3cd69c844e14 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:07.703476 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e10fe1a6-df4a-48ac-9495-3cd69c844e14 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:07.704120 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e10fe1a6-df4a-48ac-9495-3cd69c844e14 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:07.707685 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e10fe1a6-df4a-48ac-9495-3cd69c844e14 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:07.708676 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e10fe1a6-df4a-48ac-9495-3cd69c844e14 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:07.709369 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e10fe1a6-df4a-48ac-9495-3cd69c844e14 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:07.732971 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6f125177-f2bd-49b3-9999-01ea78946091 tempest-FloatingIPDetailsTestJSON-1403081710 tempest-FloatingIPDetailsTestJSON-1403081710-project] 10.222.0.33 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 7.882688 Sep 23 04:46:07.734360 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1715/3385] 10.222.0.33 () {60 vars in 1170 bytes} [Fri Sep 23 04:45:59 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 7886 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:46:07.741037 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0ee17b72-39c1-4530-b5b7-2bdb0832a4fb tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:07.754119 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-0ee17b72-39c1-4530-b5b7-2bdb0832a4fb tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: 9763a452-dc3c-436d-bee4-a3967af3bcbb] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:07.791352 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=34 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:46:07.797179 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0ee17b72-39c1-4530-b5b7-2bdb0832a4fb tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:07.802024 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0ee17b72-39c1-4530-b5b7-2bdb0832a4fb tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:07.803381 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0ee17b72-39c1-4530-b5b7-2bdb0832a4fb tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:07.813801 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0ee17b72-39c1-4530-b5b7-2bdb0832a4fb tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:07.813801 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0ee17b72-39c1-4530-b5b7-2bdb0832a4fb tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:07.813801 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0ee17b72-39c1-4530-b5b7-2bdb0832a4fb tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:07.853674 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e10fe1a6-df4a-48ac-9495-3cd69c844e14 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:07.856769 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e10fe1a6-df4a-48ac-9495-3cd69c844e14 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:07.858336 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e10fe1a6-df4a-48ac-9495-3cd69c844e14 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:07.858816 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-e10fe1a6-df4a-48ac-9495-3cd69c844e14 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lazy-loading 'fault' on Instance uuid a369d441-1f65-4e05-ba68-8e606497a368 {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:46:08.066881 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e10fe1a6-df4a-48ac-9495-3cd69c844e14 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aaca3ba23b4c46bcebc4f60a7337a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268508420e3c4d4cb3d60cb19488bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:08.069434 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-0ee17b72-39c1-4530-b5b7-2bdb0832a4fb tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c786bbedc21849ea92924139a44707b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcafb05f6f554e278cd552023947c6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:08.093641 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e10fe1a6-df4a-48ac-9495-3cd69c844e14 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90aaca3ba23b4c46bcebc4f60a7337a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268508420e3c4d4cb3d60cb19488bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:08.105119 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0ee17b72-39c1-4530-b5b7-2bdb0832a4fb tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/9763a452-dc3c-436d-bee4-a3967af3bcbb" status: 200 len: 1224 microversion: 2.1 time: 0.352318 Sep 23 04:46:08.110596 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1716/3386] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:07 2022] GET /compute/v2.1/servers/9763a452-dc3c-436d-bee4-a3967af3bcbb => generated 1224 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:08.114552 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e10fe1a6-df4a-48ac-9495-3cd69c844e14 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90aaca3ba23b4c46bcebc4f60a7337a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '268508420e3c4d4cb3d60cb19488bddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:08.115802 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e10fe1a6-df4a-48ac-9495-3cd69c844e14 tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] 10.222.0.33 "GET /compute/v2.1/servers/a369d441-1f65-4e05-ba68-8e606497a368" status: 200 len: 1409 microversion: 2.54 time: 0.426744 Sep 23 04:46:08.116373 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1671/3387] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:46:07 2022] GET /compute/v2.1/servers/a369d441-1f65-4e05-ba68-8e606497a368 => generated 1409 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:46:08.120383 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2b3c815b-bfeb-43be-b371-77fe14e44d7c tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '.version_select at 0x7ff1bb8d5430>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:08.154443 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-55b3b445-441f-4499-9b65-2698e41de4ec req-99bc1b74-5b09-4139-81aa-6f38c3945992 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5977951e-84f3-4f6b-b86f-44853cc1bc60", "tag": "17f3beaa-1f30-48da-b88d-5760b58abddc"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:46:08.184435 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-55b3b445-441f-4499-9b65-2698e41de4ec req-99bc1b74-5b09-4139-81aa-6f38c3945992 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:08.185311 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-55b3b445-441f-4499-9b65-2698e41de4ec req-99bc1b74-5b09-4139-81aa-6f38c3945992 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:08.186513 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-55b3b445-441f-4499-9b65-2698e41de4ec req-99bc1b74-5b09-4139-81aa-6f38c3945992 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:08.208106 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-55b3b445-441f-4499-9b65-2698e41de4ec req-99bc1b74-5b09-4139-81aa-6f38c3945992 service nova] Creating event network-changed:17f3beaa-1f30-48da-b88d-5760b58abddc for instance 5977951e-84f3-4f6b-b86f-44853cc1bc60 on n-h1-846463-3 Sep 23 04:46:08.215909 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-55b3b445-441f-4499-9b65-2698e41de4ec req-99bc1b74-5b09-4139-81aa-6f38c3945992 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072356 Sep 23 04:46:08.229913 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1672/3388] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:46:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:46:08.240454 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7cab635c-d35b-460d-a0b6-8ed352869159 tempest-FloatingIPDetailsTestJSON-1403081710 tempest-FloatingIPDetailsTestJSON-1403081710-project] Action: 'create', calling method: .version_select at 0x7ff1ba960700>, body: {"pool": null} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:46:08.264640 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2b3c815b-bfeb-43be-b371-77fe14e44d7c tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/images/61d751db-b940-4f89-b620-4902c2decb81" status: 200 len: 1423 microversion: 2.1 time: 0.152379 Sep 23 04:46:08.265735 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1717/3389] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:46:08 2022] GET /compute/v2.1/images/61d751db-b940-4f89-b620-4902c2decb81 => generated 1423 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:08.310426 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c7817296-2866-4e94-93f1-178ce5668df4 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '.version_select at 0x7ff1bb733670>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:09.668048 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c7817296-2866-4e94-93f1-178ce5668df4 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "DELETE /compute/v2.1/images/61d751db-b940-4f89-b620-4902c2decb81" status: 204 len: 0 microversion: 2.1 time: 1.361504 Sep 23 04:46:09.670902 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1718/3390] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:08 2022] DELETE /compute/v2.1/images/61d751db-b940-4f89-b620-4902c2decb81 => generated 0 bytes in 1365 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:46:09.682551 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c30023e0-07de-4edb-ad40-1fd16e2786d5 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:09.683848 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c30023e0-07de-4edb-ad40-1fd16e2786d5 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 5977951e-84f3-4f6b-b86f-44853cc1bc60] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:09.697546 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c30023e0-07de-4edb-ad40-1fd16e2786d5 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:09.701281 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c30023e0-07de-4edb-ad40-1fd16e2786d5 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:09.702161 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c30023e0-07de-4edb-ad40-1fd16e2786d5 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:09.702965 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c30023e0-07de-4edb-ad40-1fd16e2786d5 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:09.703441 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c30023e0-07de-4edb-ad40-1fd16e2786d5 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:09.703879 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c30023e0-07de-4edb-ad40-1fd16e2786d5 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:09.708733 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=66 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:46:09.832892 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:46:10.728234 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c30023e0-07de-4edb-ad40-1fd16e2786d5 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:10.736583 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c30023e0-07de-4edb-ad40-1fd16e2786d5 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/5977951e-84f3-4f6b-b86f-44853cc1bc60" status: 200 len: 1309 microversion: 2.1 time: 1.060883 Sep 23 04:46:10.737702 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1719/3391] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:09 2022] GET /compute/v2.1/servers/5977951e-84f3-4f6b-b86f-44853cc1bc60 => generated 1309 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:10.762214 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-bc9bd05b-7110-4d3d-b599-f628291955cb tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:10.762214 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-bc9bd05b-7110-4d3d-b599-f628291955cb tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: 9763a452-dc3c-436d-bee4-a3967af3bcbb] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:10.765637 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bc9bd05b-7110-4d3d-b599-f628291955cb tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:10.766182 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bc9bd05b-7110-4d3d-b599-f628291955cb tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:10.766697 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bc9bd05b-7110-4d3d-b599-f628291955cb tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:10.767320 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bc9bd05b-7110-4d3d-b599-f628291955cb tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:10.767776 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bc9bd05b-7110-4d3d-b599-f628291955cb tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:10.768200 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bc9bd05b-7110-4d3d-b599-f628291955cb tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:11.375921 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-bc9bd05b-7110-4d3d-b599-f628291955cb tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c786bbedc21849ea92924139a44707b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcafb05f6f554e278cd552023947c6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:11.392629 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-bc9bd05b-7110-4d3d-b599-f628291955cb tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/9763a452-dc3c-436d-bee4-a3967af3bcbb" status: 200 len: 1320 microversion: 2.1 time: 0.641241 Sep 23 04:46:11.393559 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1720/3392] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:10 2022] GET /compute/v2.1/servers/9763a452-dc3c-436d-bee4-a3967af3bcbb => generated 1320 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:11.400169 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a59489a1-b64a-4d02-8f37-7ba48ec3d42c tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:11.401655 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a59489a1-b64a-4d02-8f37-7ba48ec3d42c tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] [instance: a369d441-1f65-4e05-ba68-8e606497a368] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:11.411453 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a59489a1-b64a-4d02-8f37-7ba48ec3d42c tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:11.412806 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a59489a1-b64a-4d02-8f37-7ba48ec3d42c tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:11.413429 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a59489a1-b64a-4d02-8f37-7ba48ec3d42c tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:11.414366 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a59489a1-b64a-4d02-8f37-7ba48ec3d42c tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:11.415107 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a59489a1-b64a-4d02-8f37-7ba48ec3d42c tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:11.415693 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a59489a1-b64a-4d02-8f37-7ba48ec3d42c tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:11.461344 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-a59489a1-b64a-4d02-8f37-7ba48ec3d42c tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] HTTP exception thrown: Instance a369d441-1f65-4e05-ba68-8e606497a368 could not be found. Sep 23 04:46:11.471461 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a59489a1-b64a-4d02-8f37-7ba48ec3d42c tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Request method failure captured: Sep 23 04:46:11.471461 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/a369d441-1f65-4e05-ba68-8e606497a368 HTTP/1.1 Sep 23 04:46:11.471461 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:46:11.471461 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:46:11.471461 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:46:11.471461 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:46:11.471461 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:46:11.471461 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:46:11.471461 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:46:11.471461 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:46:11.471461 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTncfkBM9jE-8uttzJbIIfZPiucOJ05jXVvLHXbDaA7HaH54NomOimfDv1i6_jmMqXvo4ggoGfDb6HJ33huLPW_sjWQRtKxvGBBvZB0BpbBaV56AFiyKQyBluCs_VH-sNtWpfwsk_cYbtelPTenVjpISb7NxrRuqwaPy_fKqzp5rJaE Sep 23 04:46:11.471461 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:46:11.471461 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:46:11.471461 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:46:11.471461 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:46:11.471461 n-d-846463-3 devstack@n-api.service[122699]: X-Openstack-Nova-Api-Version: 2.54 Sep 23 04:46:11.471461 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:46:11.471461 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:46:11.471461 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 268508420e3c4d4cb3d60cb19488bddf Sep 23 04:46:11.471461 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ServerShowV254Test-450339387 Sep 23 04:46:11.471461 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:46:11.471461 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:46:11.471461 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_268508420e3c4d4cb3d60cb19488bddf", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/268508420e3c4d4cb3d60cb19488bddf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/268508420e3c4d4cb3d60cb19488bddf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/268508420e3c4d4cb3d60cb19488bddf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:46:11.471461 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ServerShowV254Test-450339387 Sep 23 04:46:11.471461 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 268508420e3c4d4cb3d60cb19488bddf Sep 23 04:46:11.471461 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ServerShowV254Test-450339387 Sep 23 04:46:11.471461 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ServerShowV254Test-450339387-project Sep 23 04:46:11.471461 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:46:11.471461 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:46:11.471461 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 90aaca3ba23b4c46bcebc4f60a7337a9 Sep 23 04:46:11.471461 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ServerShowV254Test-450339387-project Sep 23 04:46:11.471461 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:46:11.471461 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance a369d441-1f65-4e05-ba68-8e606497a368 could not be found. Sep 23 04:46:11.471461 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': 'a369d441-1f65-4e05-ba68-8e606497a368'} Sep 23 04:46:11.471461 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:46:11.471461 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:46:11.471461 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:46:11.471461 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:46:11.471461 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:46:11.471461 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:46:11.471461 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:46:11.471461 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:46:11.471461 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:46:11.471461 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:46:11.471461 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a369d441-1f65-4e05-ba68-8e606497a368 could not be found. Sep 23 04:46:11.471461 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:46:11.471461 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:46:11.471461 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:46:11.471461 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:46:11.471461 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:46:11.471461 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:46:11.471461 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:46:11.471461 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:46:11.471461 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:46:11.471461 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:46:11.471461 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:46:11.471461 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:46:11.471461 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:46:11.471461 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:46:11.471461 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:46:11.471461 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:46:11.471461 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a369d441-1f65-4e05-ba68-8e606497a368 could not be found. Sep 23 04:46:11.471461 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:46:11.471461 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:46:11.471461 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:46:11.476563 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:46:11.476563 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:46:11.476563 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:46:11.476563 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:46:11.476563 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:46:11.476563 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a369d441-1f65-4e05-ba68-8e606497a368 could not be found. Sep 23 04:46:11.476563 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:46:11.476563 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a59489a1-b64a-4d02-8f37-7ba48ec3d42c tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] Returning 404 to user: Instance a369d441-1f65-4e05-ba68-8e606497a368 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:46:11.476563 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a59489a1-b64a-4d02-8f37-7ba48ec3d42c tempest-ServerShowV254Test-450339387 tempest-ServerShowV254Test-450339387-project] 10.222.0.33 "GET /compute/v2.1/servers/a369d441-1f65-4e05-ba68-8e606497a368" status: 404 len: 111 microversion: 2.54 time: 0.078014 Sep 23 04:46:11.480579 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1721/3393] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:46:11 2022] GET /compute/v2.1/servers/a369d441-1f65-4e05-ba68-8e606497a368 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 23 04:46:11.492412 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-09d7fc1c-df31-4263-9636-fec06b832004 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:11.498197 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-09d7fc1c-df31-4263-9636-fec06b832004 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] [instance: 188a699b-0a1a-46b4-9a03-788af481d3ca] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:11.507747 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-09d7fc1c-df31-4263-9636-fec06b832004 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:11.508247 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-09d7fc1c-df31-4263-9636-fec06b832004 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:11.508696 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-09d7fc1c-df31-4263-9636-fec06b832004 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:11.515129 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-09d7fc1c-df31-4263-9636-fec06b832004 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:11.515850 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-09d7fc1c-df31-4263-9636-fec06b832004 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:11.516457 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-09d7fc1c-df31-4263-9636-fec06b832004 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:11.574895 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-09d7fc1c-df31-4263-9636-fec06b832004 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] [instance: 188a699b-0a1a-46b4-9a03-788af481d3ca] Going to try to terminate instance {{(pid=122699) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:46:12.004179 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-09d7fc1c-df31-4263-9636-fec06b832004 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "DELETE /compute/v2.1/servers/188a699b-0a1a-46b4-9a03-788af481d3ca" status: 204 len: 0 microversion: 2.1 time: 0.521662 Sep 23 04:46:12.010768 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1722/3394] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:46:11 2022] DELETE /compute/v2.1/servers/188a699b-0a1a-46b4-9a03-788af481d3ca => generated 0 bytes in 525 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:46:12.035555 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8e228138-bd48-4516-a12a-7f18ded74f71 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:12.045915 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-8e228138-bd48-4516-a12a-7f18ded74f71 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 5977951e-84f3-4f6b-b86f-44853cc1bc60] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:12.059917 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8e228138-bd48-4516-a12a-7f18ded74f71 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:12.065564 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8e228138-bd48-4516-a12a-7f18ded74f71 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:12.065564 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8e228138-bd48-4516-a12a-7f18ded74f71 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:12.066437 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8e228138-bd48-4516-a12a-7f18ded74f71 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:12.068164 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8e228138-bd48-4516-a12a-7f18ded74f71 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:12.068961 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8e228138-bd48-4516-a12a-7f18ded74f71 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:12.732631 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-8e228138-bd48-4516-a12a-7f18ded74f71 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:12.758174 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-8e228138-bd48-4516-a12a-7f18ded74f71 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/5977951e-84f3-4f6b-b86f-44853cc1bc60" status: 200 len: 1309 microversion: 2.1 time: 0.745279 Sep 23 04:46:12.774867 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1723/3395] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:12 2022] GET /compute/v2.1/servers/5977951e-84f3-4f6b-b86f-44853cc1bc60 => generated 1309 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:12.789134 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-3888a8fd-a7e5-4a0c-8053-3ee092e8267b req-12c91921-a6ca-40a5-9ad5-6f144a58f7e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "188a699b-0a1a-46b4-9a03-788af481d3ca", "name": "network-vif-unplugged", "status": "completed", "tag": "f0ab08a0-19b4-4e1e-b09d-bc591c3179dd"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:46:12.810654 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-3888a8fd-a7e5-4a0c-8053-3ee092e8267b req-12c91921-a6ca-40a5-9ad5-6f144a58f7e8 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:12.815423 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-3888a8fd-a7e5-4a0c-8053-3ee092e8267b req-12c91921-a6ca-40a5-9ad5-6f144a58f7e8 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:12.816016 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-3888a8fd-a7e5-4a0c-8053-3ee092e8267b req-12c91921-a6ca-40a5-9ad5-6f144a58f7e8 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:12.837213 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-3888a8fd-a7e5-4a0c-8053-3ee092e8267b req-12c91921-a6ca-40a5-9ad5-6f144a58f7e8 service nova] Creating event network-vif-unplugged:f0ab08a0-19b4-4e1e-b09d-bc591c3179dd for instance 188a699b-0a1a-46b4-9a03-788af481d3ca on n-h2-846463-3 Sep 23 04:46:12.851814 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-3888a8fd-a7e5-4a0c-8053-3ee092e8267b req-12c91921-a6ca-40a5-9ad5-6f144a58f7e8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.071322 Sep 23 04:46:12.851814 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1724/3396] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:46:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:46:12.856510 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ef36f079-7fb2-4515-8c9c-372b3746a845 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-725720682", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "networks": [{"uuid": "ba35f7e0-9420-45ef-a251-5988b98046ec"}]}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:46:12.938870 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.neutron [None req-ef36f079-7fb2-4515-8c9c-372b3746a845 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] validate_networks() for [('ba35f7e0-9420-45ef-a251-5988b98046ec', None, None, None, None, None)] {{(pid=122699) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:46:14.157642 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7cab635c-d35b-460d-a0b6-8ed352869159 tempest-FloatingIPDetailsTestJSON-1403081710 tempest-FloatingIPDetailsTestJSON-1403081710-project] 10.222.0.33 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.925823 Sep 23 04:46:14.159545 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1673/3397] 10.222.0.33 () {60 vars in 1170 bytes} [Fri Sep 23 04:46:08 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5928 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:46:14.169169 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1a6f1333-fe32-4e3f-85fa-632767dba4df tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:14.172392 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-1a6f1333-fe32-4e3f-85fa-632767dba4df tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: 9763a452-dc3c-436d-bee4-a3967af3bcbb] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:14.197746 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1a6f1333-fe32-4e3f-85fa-632767dba4df tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:14.199653 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1a6f1333-fe32-4e3f-85fa-632767dba4df tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:14.201569 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1a6f1333-fe32-4e3f-85fa-632767dba4df tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:14.204164 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1a6f1333-fe32-4e3f-85fa-632767dba4df tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:14.205436 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1a6f1333-fe32-4e3f-85fa-632767dba4df tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:14.208062 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1a6f1333-fe32-4e3f-85fa-632767dba4df tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:14.792057 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-1a6f1333-fe32-4e3f-85fa-632767dba4df tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c786bbedc21849ea92924139a44707b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcafb05f6f554e278cd552023947c6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:14.804891 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-1a6f1333-fe32-4e3f-85fa-632767dba4df tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/9763a452-dc3c-436d-bee4-a3967af3bcbb" status: 200 len: 1320 microversion: 2.1 time: 0.643807 Sep 23 04:46:14.806042 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1674/3398] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:14 2022] GET /compute/v2.1/servers/9763a452-dc3c-436d-bee4-a3967af3bcbb => generated 1320 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:14.814793 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-c47c240a-c52f-48ee-8959-1c1a0884bd53 req-7bb1fd7b-081c-483b-a357-d8acaad1cdb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9763a452-dc3c-436d-bee4-a3967af3bcbb", "tag": "4e9aa528-cb1f-4f7a-add2-edebbcce69d9"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:46:14.844174 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-c47c240a-c52f-48ee-8959-1c1a0884bd53 req-7bb1fd7b-081c-483b-a357-d8acaad1cdb7 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:14.850803 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-c47c240a-c52f-48ee-8959-1c1a0884bd53 req-7bb1fd7b-081c-483b-a357-d8acaad1cdb7 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:14.850803 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-c47c240a-c52f-48ee-8959-1c1a0884bd53 req-7bb1fd7b-081c-483b-a357-d8acaad1cdb7 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:14.875528 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-c47c240a-c52f-48ee-8959-1c1a0884bd53 req-7bb1fd7b-081c-483b-a357-d8acaad1cdb7 service nova] Creating event network-changed:4e9aa528-cb1f-4f7a-add2-edebbcce69d9 for instance 9763a452-dc3c-436d-bee4-a3967af3bcbb on n-h1-846463-3 Sep 23 04:46:14.897927 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-c47c240a-c52f-48ee-8959-1c1a0884bd53 req-7bb1fd7b-081c-483b-a357-d8acaad1cdb7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088817 Sep 23 04:46:14.900337 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1675/3399] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:46:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:46:14.918363 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c780fb2b-6310-4b2d-9c5c-7ccedebaaddb tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:14.919617 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c780fb2b-6310-4b2d-9c5c-7ccedebaaddb tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 5977951e-84f3-4f6b-b86f-44853cc1bc60] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:14.941002 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c780fb2b-6310-4b2d-9c5c-7ccedebaaddb tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:14.941606 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c780fb2b-6310-4b2d-9c5c-7ccedebaaddb tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:14.942494 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c780fb2b-6310-4b2d-9c5c-7ccedebaaddb tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:14.942840 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c780fb2b-6310-4b2d-9c5c-7ccedebaaddb tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:14.943367 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c780fb2b-6310-4b2d-9c5c-7ccedebaaddb tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:14.943793 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c780fb2b-6310-4b2d-9c5c-7ccedebaaddb tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:15.034200 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-ef36f079-7fb2-4515-8c9c-372b3746a845 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Flavor limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:46:15.034738 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-ef36f079-7fb2-4515-8c9c-372b3746a845 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Image limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:46:15.035101 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-ef36f079-7fb2-4515-8c9c-372b3746a845 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Flavor pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:46:15.036753 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-ef36f079-7fb2-4515-8c9c-372b3746a845 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Image pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:46:15.037186 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-ef36f079-7fb2-4515-8c9c-372b3746a845 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:46:15.059545 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ef36f079-7fb2-4515-8c9c-372b3746a845 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:15.060530 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ef36f079-7fb2-4515-8c9c-372b3746a845 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:15.061115 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ef36f079-7fb2-4515-8c9c-372b3746a845 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:15.061723 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ef36f079-7fb2-4515-8c9c-372b3746a845 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:15.062228 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ef36f079-7fb2-4515-8c9c-372b3746a845 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:15.062673 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ef36f079-7fb2-4515-8c9c-372b3746a845 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:15.119249 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-ef36f079-7fb2-4515-8c9c-372b3746a845 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Getting quotas for project 7c43f2b70bc74a48b62fb4115337f073. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:46:15.140963 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-ef36f079-7fb2-4515-8c9c-372b3746a845 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Getting quotas for user c11980041918484990dac709544d0b42 and project 7c43f2b70bc74a48b62fb4115337f073. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:46:15.199193 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ef36f079-7fb2-4515-8c9c-372b3746a845 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Going to run 1 instances... {{(pid=122699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:46:15.201727 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ef36f079-7fb2-4515-8c9c-372b3746a845 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] [instance: 0fff1fd4-972c-4268-89fd-92b784244edf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:46:15.437110 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c780fb2b-6310-4b2d-9c5c-7ccedebaaddb tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:15.442720 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ef36f079-7fb2-4515-8c9c-372b3746a845 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.591412 Sep 23 04:46:15.450529 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1725/3400] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:46:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 2600 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:46:15.455730 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e7374f97-78ae-41bb-9c69-a0b8fb833763 tempest-FloatingIPDetailsTestJSON-1403081710 tempest-FloatingIPDetailsTestJSON-1403081710-project] Calling method '.version_select at 0x7ff1bb712430>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:15.463956 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c780fb2b-6310-4b2d-9c5c-7ccedebaaddb tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/5977951e-84f3-4f6b-b86f-44853cc1bc60" status: 200 len: 1309 microversion: 2.1 time: 0.561578 Sep 23 04:46:15.465770 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1676/3401] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:14 2022] GET /compute/v2.1/servers/5977951e-84f3-4f6b-b86f-44853cc1bc60 => generated 1309 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:15.870716 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=6 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:46:15.900708 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=20 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:46:16.037590 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-8998376e-e5e6-4f1e-b11e-f0a6671845d6 req-8f6a2aed-f2b9-4e09-af7f-700ad2e5a67f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0374fc2-3c0f-48e1-b969-2933785fd47b", "tag": "8bb12be9-bcf5-4244-b7a1-ef10ac33bd74"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:46:16.067937 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-8998376e-e5e6-4f1e-b11e-f0a6671845d6 req-8f6a2aed-f2b9-4e09-af7f-700ad2e5a67f service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:16.069869 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-8998376e-e5e6-4f1e-b11e-f0a6671845d6 req-8f6a2aed-f2b9-4e09-af7f-700ad2e5a67f service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:16.071313 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-8998376e-e5e6-4f1e-b11e-f0a6671845d6 req-8f6a2aed-f2b9-4e09-af7f-700ad2e5a67f service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:16.103425 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e7374f97-78ae-41bb-9c69-a0b8fb833763 tempest-FloatingIPDetailsTestJSON-1403081710 tempest-FloatingIPDetailsTestJSON-1403081710-project] 10.222.0.33 "GET /compute/v2.1/os-floating-ips/08e48536-9a72-4dd8-bb45-657aaeebf34e" status: 200 len: 142 microversion: 2.1 time: 0.651642 Sep 23 04:46:16.104543 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-8998376e-e5e6-4f1e-b11e-f0a6671845d6 req-8f6a2aed-f2b9-4e09-af7f-700ad2e5a67f service nova] Creating event network-changed:8bb12be9-bcf5-4244-b7a1-ef10ac33bd74 for instance f0374fc2-3c0f-48e1-b969-2933785fd47b on n-h2-846463-3 Sep 23 04:46:16.106073 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1726/3402] 10.222.0.33 () {58 vars in 1260 bytes} [Fri Sep 23 04:46:15 2022] GET /compute/v2.1/os-floating-ips/08e48536-9a72-4dd8-bb45-657aaeebf34e => generated 142 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:46:16.112223 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-98ef502b-a90e-427d-954e-033d27bc2385 req-2a16d705-8ce1-491a-b903-6ed6938d1f11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5977951e-84f3-4f6b-b86f-44853cc1bc60", "name": "network-vif-plugged", "status": "completed", "tag": "17f3beaa-1f30-48da-b88d-5760b58abddc"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:46:16.118544 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-8998376e-e5e6-4f1e-b11e-f0a6671845d6 req-8f6a2aed-f2b9-4e09-af7f-700ad2e5a67f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.646767 Sep 23 04:46:16.118544 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1677/3403] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:46:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:46:16.129496 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-51310a8c-a740-46ba-8517-cdec69efd0da tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:16.132275 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-51310a8c-a740-46ba-8517-cdec69efd0da tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] [instance: 0fff1fd4-972c-4268-89fd-92b784244edf] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:16.146769 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-98ef502b-a90e-427d-954e-033d27bc2385 req-2a16d705-8ce1-491a-b903-6ed6938d1f11 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:16.147897 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-98ef502b-a90e-427d-954e-033d27bc2385 req-2a16d705-8ce1-491a-b903-6ed6938d1f11 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:16.148352 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-98ef502b-a90e-427d-954e-033d27bc2385 req-2a16d705-8ce1-491a-b903-6ed6938d1f11 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:16.203658 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-98ef502b-a90e-427d-954e-033d27bc2385 req-2a16d705-8ce1-491a-b903-6ed6938d1f11 service nova] Creating event network-vif-plugged:17f3beaa-1f30-48da-b88d-5760b58abddc for instance 5977951e-84f3-4f6b-b86f-44853cc1bc60 on n-h1-846463-3 Sep 23 04:46:16.205212 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-98ef502b-a90e-427d-954e-033d27bc2385 req-2a16d705-8ce1-491a-b903-6ed6938d1f11 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096414 Sep 23 04:46:16.208207 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1727/3404] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:46:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:46:16.221240 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7d06ae8a-6b8a-441f-941d-1597eeb48d32 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:16.221875 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-7d06ae8a-6b8a-441f-941d-1597eeb48d32 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: 9763a452-dc3c-436d-bee4-a3967af3bcbb] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:16.231460 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7d06ae8a-6b8a-441f-941d-1597eeb48d32 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:16.231460 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7d06ae8a-6b8a-441f-941d-1597eeb48d32 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:16.231460 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7d06ae8a-6b8a-441f-941d-1597eeb48d32 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:16.241982 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7d06ae8a-6b8a-441f-941d-1597eeb48d32 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:16.243530 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7d06ae8a-6b8a-441f-941d-1597eeb48d32 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:16.244561 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7d06ae8a-6b8a-441f-941d-1597eeb48d32 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:16.363939 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-51310a8c-a740-46ba-8517-cdec69efd0da tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11980041918484990dac709544d0b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c43f2b70bc74a48b62fb4115337f073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:16.374920 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-51310a8c-a740-46ba-8517-cdec69efd0da tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/servers/0fff1fd4-972c-4268-89fd-92b784244edf" status: 200 len: 1207 microversion: 2.1 time: 0.257062 Sep 23 04:46:16.390148 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1678/3405] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:16 2022] GET /compute/v2.1/servers/0fff1fd4-972c-4268-89fd-92b784244edf => generated 1207 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:16.390148 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d4c1d0cc-7788-4d9d-b87e-addfd0f7ab61 tempest-FloatingIPDetailsTestJSON-1403081710 tempest-FloatingIPDetailsTestJSON-1403081710-project] Calling method '.version_select at 0x7ff1ba9aa4c0>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:16.619175 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-7d06ae8a-6b8a-441f-941d-1597eeb48d32 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c786bbedc21849ea92924139a44707b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcafb05f6f554e278cd552023947c6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:16.628130 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-7d06ae8a-6b8a-441f-941d-1597eeb48d32 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/9763a452-dc3c-436d-bee4-a3967af3bcbb" status: 200 len: 1320 microversion: 2.1 time: 0.418675 Sep 23 04:46:16.629134 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1728/3406] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:16 2022] GET /compute/v2.1/servers/9763a452-dc3c-436d-bee4-a3967af3bcbb => generated 1320 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:16.638881 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5d142847-89ea-4d10-8780-b7b808910c88 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:16.639852 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-5d142847-89ea-4d10-8780-b7b808910c88 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 5977951e-84f3-4f6b-b86f-44853cc1bc60] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:16.647688 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5d142847-89ea-4d10-8780-b7b808910c88 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:16.648399 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5d142847-89ea-4d10-8780-b7b808910c88 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:16.649265 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5d142847-89ea-4d10-8780-b7b808910c88 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:16.650019 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5d142847-89ea-4d10-8780-b7b808910c88 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:16.650489 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5d142847-89ea-4d10-8780-b7b808910c88 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:16.650928 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5d142847-89ea-4d10-8780-b7b808910c88 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:16.898221 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-5d142847-89ea-4d10-8780-b7b808910c88 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:16.925619 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5d142847-89ea-4d10-8780-b7b808910c88 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/5977951e-84f3-4f6b-b86f-44853cc1bc60" status: 200 len: 1309 microversion: 2.1 time: 0.294106 Sep 23 04:46:16.928881 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1729/3407] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:16 2022] GET /compute/v2.1/servers/5977951e-84f3-4f6b-b86f-44853cc1bc60 => generated 1309 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:16.979820 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-8624f347-9a09-4f61-9576-5292d8097850 req-ca9e5669-5695-4be9-8d5f-2ce14004f811 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "188a699b-0a1a-46b4-9a03-788af481d3ca", "name": "network-vif-deleted", "tag": "f0ab08a0-19b4-4e1e-b09d-bc591c3179dd"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:46:16.991646 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-8624f347-9a09-4f61-9576-5292d8097850 req-ca9e5669-5695-4be9-8d5f-2ce14004f811 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:16.992198 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-8624f347-9a09-4f61-9576-5292d8097850 req-ca9e5669-5695-4be9-8d5f-2ce14004f811 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:16.992642 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-8624f347-9a09-4f61-9576-5292d8097850 req-ca9e5669-5695-4be9-8d5f-2ce14004f811 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:17.009923 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-8624f347-9a09-4f61-9576-5292d8097850 req-ca9e5669-5695-4be9-8d5f-2ce14004f811 service nova] Creating event network-vif-deleted:f0ab08a0-19b4-4e1e-b09d-bc591c3179dd for instance 188a699b-0a1a-46b4-9a03-788af481d3ca on n-h2-846463-3 Sep 23 04:46:17.014421 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-8624f347-9a09-4f61-9576-5292d8097850 req-ca9e5669-5695-4be9-8d5f-2ce14004f811 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041686 Sep 23 04:46:17.016276 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1730/3408] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:46:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:46:17.400819 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0f33bc37-7b4b-4444-afaa-6f72deb6de88 tempest-ExtensionsTest-971177247 tempest-ExtensionsTest-971177247-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:17.405168 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0f33bc37-7b4b-4444-afaa-6f72deb6de88 tempest-ExtensionsTest-971177247 tempest-ExtensionsTest-971177247-project] 10.222.0.33 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.229069 Sep 23 04:46:17.414068 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1731/3409] 10.222.0.33 () {58 vars in 1170 bytes} [Fri Sep 23 04:46:17 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:46:17.418928 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7e153d02-d9bd-42c4-b77b-420df23591ba tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:17.421272 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-7e153d02-d9bd-42c4-b77b-420df23591ba tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] [instance: 0fff1fd4-972c-4268-89fd-92b784244edf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:17.429158 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7e153d02-d9bd-42c4-b77b-420df23591ba tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:17.429671 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7e153d02-d9bd-42c4-b77b-420df23591ba tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:17.430233 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7e153d02-d9bd-42c4-b77b-420df23591ba tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:17.431269 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7e153d02-d9bd-42c4-b77b-420df23591ba tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:17.431736 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7e153d02-d9bd-42c4-b77b-420df23591ba tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:17.432645 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7e153d02-d9bd-42c4-b77b-420df23591ba tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:17.620995 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-7e153d02-d9bd-42c4-b77b-420df23591ba tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11980041918484990dac709544d0b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c43f2b70bc74a48b62fb4115337f073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:17.629536 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-7e153d02-d9bd-42c4-b77b-420df23591ba tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/servers/0fff1fd4-972c-4268-89fd-92b784244edf" status: 200 len: 1211 microversion: 2.1 time: 0.215923 Sep 23 04:46:17.630798 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1732/3410] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:17 2022] GET /compute/v2.1/servers/0fff1fd4-972c-4268-89fd-92b784244edf => generated 1211 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:17.636291 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b6d0387e-2b0b-44c6-83f3-e4d990f043b8 tempest-ExtensionsTest-971177247 tempest-ExtensionsTest-971177247-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:17.639061 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b6d0387e-2b0b-44c6-83f3-e4d990f043b8 tempest-ExtensionsTest-971177247 tempest-ExtensionsTest-971177247-project] 10.222.0.33 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.007098 Sep 23 04:46:17.640284 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1733/3411] 10.222.0.33 () {58 vars in 1134 bytes} [Fri Sep 23 04:46:17 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 04:46:17.665449 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0433d404-698e-4f98-8c43-14f420fbba52 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:17.665449 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-0433d404-698e-4f98-8c43-14f420fbba52 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: 9763a452-dc3c-436d-bee4-a3967af3bcbb] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:17.679981 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0433d404-698e-4f98-8c43-14f420fbba52 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:17.681662 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0433d404-698e-4f98-8c43-14f420fbba52 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:17.682416 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0433d404-698e-4f98-8c43-14f420fbba52 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:17.683366 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0433d404-698e-4f98-8c43-14f420fbba52 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:17.684101 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0433d404-698e-4f98-8c43-14f420fbba52 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:17.691792 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0433d404-698e-4f98-8c43-14f420fbba52 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:17.869407 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d4c1d0cc-7788-4d9d-b87e-addfd0f7ab61 tempest-FloatingIPDetailsTestJSON-1403081710 tempest-FloatingIPDetailsTestJSON-1403081710-project] 10.222.0.33 "DELETE /compute/v2.1/os-floating-ips/08e48536-9a72-4dd8-bb45-657aaeebf34e" status: 202 len: 0 microversion: 2.1 time: 1.492093 Sep 23 04:46:17.870079 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1679/3412] 10.222.0.33 () {58 vars in 1263 bytes} [Fri Sep 23 04:46:16 2022] DELETE /compute/v2.1/os-floating-ips/08e48536-9a72-4dd8-bb45-657aaeebf34e => generated 0 bytes in 1493 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:46:17.879360 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-66a4a2d6-fa7c-4847-a8bc-e22cdeda004f tempest-FloatingIPDetailsTestJSON-1403081710 tempest-FloatingIPDetailsTestJSON-1403081710-project] Calling method '.version_select at 0x7ff1ba92c940>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:18.527097 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-0433d404-698e-4f98-8c43-14f420fbba52 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c786bbedc21849ea92924139a44707b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcafb05f6f554e278cd552023947c6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:18.543274 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0433d404-698e-4f98-8c43-14f420fbba52 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/9763a452-dc3c-436d-bee4-a3967af3bcbb" status: 200 len: 1320 microversion: 2.1 time: 0.891651 Sep 23 04:46:18.544262 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1734/3413] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:17 2022] GET /compute/v2.1/servers/9763a452-dc3c-436d-bee4-a3967af3bcbb => generated 1320 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:18.558615 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-07018339-094e-4c38-8c83-29686a447ca2 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:18.559376 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-07018339-094e-4c38-8c83-29686a447ca2 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 5977951e-84f3-4f6b-b86f-44853cc1bc60] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:18.569224 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-07018339-094e-4c38-8c83-29686a447ca2 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:18.569739 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-07018339-094e-4c38-8c83-29686a447ca2 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:18.574191 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-07018339-094e-4c38-8c83-29686a447ca2 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:18.574191 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-07018339-094e-4c38-8c83-29686a447ca2 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:18.574191 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-07018339-094e-4c38-8c83-29686a447ca2 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:18.574191 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-07018339-094e-4c38-8c83-29686a447ca2 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:18.610585 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-66a4a2d6-fa7c-4847-a8bc-e22cdeda004f tempest-FloatingIPDetailsTestJSON-1403081710 tempest-FloatingIPDetailsTestJSON-1403081710-project] 10.222.0.33 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.731392 Sep 23 04:46:18.610585 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1680/3414] 10.222.0.33 () {58 vars in 1164 bytes} [Fri Sep 23 04:46:17 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 23 04:46:18.624958 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5da7ec8e-1c43-471e-aa54-f9e4f75fdb95 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '.version_select at 0x7ff1baa10700>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:18.715406 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5da7ec8e-1c43-471e-aa54-f9e4f75fdb95 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "GET /compute/v2.1/images/800d5d9e-8556-47d5-a80b-3500dc514f86" status: 200 len: 661 microversion: 2.1 time: 0.098018 Sep 23 04:46:18.716389 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1681/3415] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:46:18 2022] GET /compute/v2.1/images/800d5d9e-8556-47d5-a80b-3500dc514f86 => generated 661 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:46:18.721025 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5fafa5dd-ac90-40d2-9719-02b136f1f0a7 tempest-FloatingIPDetailsTestJSON-1403081710 tempest-FloatingIPDetailsTestJSON-1403081710-project] Calling method '.version_select at 0x7ff1ba93fdc0>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:19.455402 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-07018339-094e-4c38-8c83-29686a447ca2 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:19.465830 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-07018339-094e-4c38-8c83-29686a447ca2 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/5977951e-84f3-4f6b-b86f-44853cc1bc60" status: 200 len: 1490 microversion: 2.1 time: 0.919715 Sep 23 04:46:19.466962 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1735/3416] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:18 2022] GET /compute/v2.1/servers/5977951e-84f3-4f6b-b86f-44853cc1bc60 => generated 1490 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:19.471895 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5fd47ffb-cde4-4bf2-a9e0-aea4d316d302 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:19.472714 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-5fd47ffb-cde4-4bf2-a9e0-aea4d316d302 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] [instance: 0fff1fd4-972c-4268-89fd-92b784244edf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:19.479973 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5fd47ffb-cde4-4bf2-a9e0-aea4d316d302 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:19.480345 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5fd47ffb-cde4-4bf2-a9e0-aea4d316d302 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:19.481148 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5fd47ffb-cde4-4bf2-a9e0-aea4d316d302 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:19.482621 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5fd47ffb-cde4-4bf2-a9e0-aea4d316d302 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:19.483285 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5fd47ffb-cde4-4bf2-a9e0-aea4d316d302 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:19.484533 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5fd47ffb-cde4-4bf2-a9e0-aea4d316d302 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:19.534861 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5fafa5dd-ac90-40d2-9719-02b136f1f0a7 tempest-FloatingIPDetailsTestJSON-1403081710 tempest-FloatingIPDetailsTestJSON-1403081710-project] 10.222.0.33 "GET /compute/v2.1/os-floating-ips" status: 200 len: 397 microversion: 2.1 time: 0.815348 Sep 23 04:46:19.537313 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1682/3417] 10.222.0.33 () {58 vars in 1149 bytes} [Fri Sep 23 04:46:18 2022] GET /compute/v2.1/os-floating-ips => generated 397 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:46:19.554750 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0bb0c62f-2fa8-4ee8-9a98-5b268633ec8e tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '.version_select at 0x7ff1ba9ad160>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:19.610197 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-5fd47ffb-cde4-4bf2-a9e0-aea4d316d302 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11980041918484990dac709544d0b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c43f2b70bc74a48b62fb4115337f073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:19.624274 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5fd47ffb-cde4-4bf2-a9e0-aea4d316d302 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/servers/0fff1fd4-972c-4268-89fd-92b784244edf" status: 200 len: 1265 microversion: 2.1 time: 0.151988 Sep 23 04:46:19.624274 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1736/3418] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:19 2022] GET /compute/v2.1/servers/0fff1fd4-972c-4268-89fd-92b784244edf => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:19.625821 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0bb0c62f-2fa8-4ee8-9a98-5b268633ec8e tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "GET /compute/v2.1/images/800d5d9e-8556-47d5-a80b-3500dc514f86" status: 200 len: 661 microversion: 2.1 time: 0.086730 Sep 23 04:46:19.626666 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1683/3419] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:46:19 2022] GET /compute/v2.1/images/800d5d9e-8556-47d5-a80b-3500dc514f86 => generated 661 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:46:19.633272 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b2949eb5-56cc-400b-84c0-536ec1b0e270 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:46:19.636327 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b2949eb5-56cc-400b-84c0-536ec1b0e270 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 5977951e-84f3-4f6b-b86f-44853cc1bc60] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:19.645500 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a8f153c9-76c6-42f8-b1a0-fc9ca67c9e7a tempest-FloatingIPDetailsTestJSON-1403081710 tempest-FloatingIPDetailsTestJSON-1403081710-project] Calling method '.version_select at 0x7ff1ba93f9d0>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:19.655783 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b2949eb5-56cc-400b-84c0-536ec1b0e270 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:19.657272 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b2949eb5-56cc-400b-84c0-536ec1b0e270 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:19.657982 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b2949eb5-56cc-400b-84c0-536ec1b0e270 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:19.658943 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b2949eb5-56cc-400b-84c0-536ec1b0e270 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:19.659583 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b2949eb5-56cc-400b-84c0-536ec1b0e270 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:19.669821 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b2949eb5-56cc-400b-84c0-536ec1b0e270 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:19.926890 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b2949eb5-56cc-400b-84c0-536ec1b0e270 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "PUT /compute/v2.1/servers/5977951e-84f3-4f6b-b86f-44853cc1bc60" status: 200 len: 1085 microversion: 2.1 time: 0.301913 Sep 23 04:46:19.931909 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1737/3420] 10.222.0.33 () {60 vars in 1256 bytes} [Fri Sep 23 04:46:19 2022] PUT /compute/v2.1/servers/5977951e-84f3-4f6b-b86f-44853cc1bc60 => generated 1085 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:19.950912 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9aaf1e71-6287-4502-add9-853f6eb08df9 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:19.951975 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-9aaf1e71-6287-4502-add9-853f6eb08df9 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: 9763a452-dc3c-436d-bee4-a3967af3bcbb] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:19.980117 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9aaf1e71-6287-4502-add9-853f6eb08df9 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:19.983652 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9aaf1e71-6287-4502-add9-853f6eb08df9 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:19.985591 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9aaf1e71-6287-4502-add9-853f6eb08df9 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:19.991389 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9aaf1e71-6287-4502-add9-853f6eb08df9 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:19.992587 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9aaf1e71-6287-4502-add9-853f6eb08df9 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:19.994174 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9aaf1e71-6287-4502-add9-853f6eb08df9 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:20.413958 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-9aaf1e71-6287-4502-add9-853f6eb08df9 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c786bbedc21849ea92924139a44707b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcafb05f6f554e278cd552023947c6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:20.429109 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-9aaf1e71-6287-4502-add9-853f6eb08df9 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/9763a452-dc3c-436d-bee4-a3967af3bcbb" status: 200 len: 1320 microversion: 2.1 time: 0.495468 Sep 23 04:46:20.430205 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1738/3421] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:19 2022] GET /compute/v2.1/servers/9763a452-dc3c-436d-bee4-a3967af3bcbb => generated 1320 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:20.453918 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-daa01423-f96f-4e08-aa02-0ac24713dfe0 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:20.454641 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-daa01423-f96f-4e08-aa02-0ac24713dfe0 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 5977951e-84f3-4f6b-b86f-44853cc1bc60] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:20.461191 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-daa01423-f96f-4e08-aa02-0ac24713dfe0 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:20.461956 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-daa01423-f96f-4e08-aa02-0ac24713dfe0 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:20.462983 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-daa01423-f96f-4e08-aa02-0ac24713dfe0 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:20.463707 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-daa01423-f96f-4e08-aa02-0ac24713dfe0 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:20.464174 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-daa01423-f96f-4e08-aa02-0ac24713dfe0 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:20.464666 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-daa01423-f96f-4e08-aa02-0ac24713dfe0 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:20.784872 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-daa01423-f96f-4e08-aa02-0ac24713dfe0 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:20.787613 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:46:20.794337 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-daa01423-f96f-4e08-aa02-0ac24713dfe0 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/5977951e-84f3-4f6b-b86f-44853cc1bc60" status: 200 len: 1511 microversion: 2.1 time: 0.362795 Sep 23 04:46:20.795020 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1739/3422] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:20 2022] GET /compute/v2.1/servers/5977951e-84f3-4f6b-b86f-44853cc1bc60 => generated 1511 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:20.799936 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-38945e78-2816-4af3-8d83-558202d4fa10 req-31ccdaaa-005c-446b-8c1c-1cbde638da8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0374fc2-3c0f-48e1-b969-2933785fd47b", "name": "network-vif-plugged", "status": "completed", "tag": "8bb12be9-bcf5-4244-b7a1-ef10ac33bd74"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:46:20.811095 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-38945e78-2816-4af3-8d83-558202d4fa10 req-31ccdaaa-005c-446b-8c1c-1cbde638da8a service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:20.812580 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-38945e78-2816-4af3-8d83-558202d4fa10 req-31ccdaaa-005c-446b-8c1c-1cbde638da8a service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:20.812580 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-38945e78-2816-4af3-8d83-558202d4fa10 req-31ccdaaa-005c-446b-8c1c-1cbde638da8a service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:20.827365 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-38945e78-2816-4af3-8d83-558202d4fa10 req-31ccdaaa-005c-446b-8c1c-1cbde638da8a service nova] Creating event network-vif-plugged:8bb12be9-bcf5-4244-b7a1-ef10ac33bd74 for instance f0374fc2-3c0f-48e1-b969-2933785fd47b on n-h2-846463-3 Sep 23 04:46:20.832793 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-38945e78-2816-4af3-8d83-558202d4fa10 req-31ccdaaa-005c-446b-8c1c-1cbde638da8a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036466 Sep 23 04:46:20.833934 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1740/3423] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:46:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:46:20.840086 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d3364be1-1da9-4ffb-8723-eb61059e3a67 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:20.841307 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d3364be1-1da9-4ffb-8723-eb61059e3a67 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] [instance: 0fff1fd4-972c-4268-89fd-92b784244edf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:20.851748 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d3364be1-1da9-4ffb-8723-eb61059e3a67 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:20.852327 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d3364be1-1da9-4ffb-8723-eb61059e3a67 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:20.852844 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d3364be1-1da9-4ffb-8723-eb61059e3a67 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:20.854519 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d3364be1-1da9-4ffb-8723-eb61059e3a67 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:20.855062 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d3364be1-1da9-4ffb-8723-eb61059e3a67 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:20.855569 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d3364be1-1da9-4ffb-8723-eb61059e3a67 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:21.036404 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d3364be1-1da9-4ffb-8723-eb61059e3a67 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11980041918484990dac709544d0b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c43f2b70bc74a48b62fb4115337f073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:21.053191 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d3364be1-1da9-4ffb-8723-eb61059e3a67 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/servers/0fff1fd4-972c-4268-89fd-92b784244edf" status: 200 len: 1265 microversion: 2.1 time: 0.217924 Sep 23 04:46:21.055544 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1741/3424] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:20 2022] GET /compute/v2.1/servers/0fff1fd4-972c-4268-89fd-92b784244edf => generated 1265 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:21.065536 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-dc4f0810-6de9-4c84-97f3-16115998ed72 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:21.071135 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-dc4f0810-6de9-4c84-97f3-16115998ed72 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 5977951e-84f3-4f6b-b86f-44853cc1bc60] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:21.095719 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dc4f0810-6de9-4c84-97f3-16115998ed72 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:21.095719 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dc4f0810-6de9-4c84-97f3-16115998ed72 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:21.095719 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dc4f0810-6de9-4c84-97f3-16115998ed72 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:21.095719 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dc4f0810-6de9-4c84-97f3-16115998ed72 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:21.095719 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dc4f0810-6de9-4c84-97f3-16115998ed72 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:21.095719 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dc4f0810-6de9-4c84-97f3-16115998ed72 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:21.476906 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-dc4f0810-6de9-4c84-97f3-16115998ed72 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:21.495907 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-dc4f0810-6de9-4c84-97f3-16115998ed72 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/5977951e-84f3-4f6b-b86f-44853cc1bc60" status: 200 len: 1511 microversion: 2.1 time: 0.438574 Sep 23 04:46:21.496828 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1742/3425] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:21 2022] GET /compute/v2.1/servers/5977951e-84f3-4f6b-b86f-44853cc1bc60 => generated 1511 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:21.501859 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-00258f52-5370-4558-96aa-e109b73ef43d tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:21.507926 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-00258f52-5370-4558-96aa-e109b73ef43d tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: 9763a452-dc3c-436d-bee4-a3967af3bcbb] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:21.523765 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a8f153c9-76c6-42f8-b1a0-fc9ca67c9e7a tempest-FloatingIPDetailsTestJSON-1403081710 tempest-FloatingIPDetailsTestJSON-1403081710-project] 10.222.0.33 "DELETE /compute/v2.1/os-floating-ips/a8492383-6021-4822-b231-adf76d0f7596" status: 202 len: 0 microversion: 2.1 time: 1.895714 Sep 23 04:46:21.524404 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1684/3426] 10.222.0.33 () {58 vars in 1263 bytes} [Fri Sep 23 04:46:19 2022] DELETE /compute/v2.1/os-floating-ips/a8492383-6021-4822-b231-adf76d0f7596 => generated 0 bytes in 1897 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:46:21.525456 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-00258f52-5370-4558-96aa-e109b73ef43d tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:21.525998 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-00258f52-5370-4558-96aa-e109b73ef43d tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:21.530923 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-00258f52-5370-4558-96aa-e109b73ef43d tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:21.530923 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-00258f52-5370-4558-96aa-e109b73ef43d tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:21.530923 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-00258f52-5370-4558-96aa-e109b73ef43d tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:21.530923 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-00258f52-5370-4558-96aa-e109b73ef43d tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:21.535119 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6e72d2e2-4a2a-4ab8-9024-689162ec2c65 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:21.540507 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-6e72d2e2-4a2a-4ab8-9024-689162ec2c65 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 5977951e-84f3-4f6b-b86f-44853cc1bc60] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:21.548228 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6e72d2e2-4a2a-4ab8-9024-689162ec2c65 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:21.548792 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6e72d2e2-4a2a-4ab8-9024-689162ec2c65 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:21.549316 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6e72d2e2-4a2a-4ab8-9024-689162ec2c65 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:21.550131 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6e72d2e2-4a2a-4ab8-9024-689162ec2c65 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:21.550667 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6e72d2e2-4a2a-4ab8-9024-689162ec2c65 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:21.551512 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6e72d2e2-4a2a-4ab8-9024-689162ec2c65 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:21.592899 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-6e72d2e2-4a2a-4ab8-9024-689162ec2c65 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 5977951e-84f3-4f6b-b86f-44853cc1bc60] Going to try to terminate instance {{(pid=122698) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:46:21.739519 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-00258f52-5370-4558-96aa-e109b73ef43d tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c786bbedc21849ea92924139a44707b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcafb05f6f554e278cd552023947c6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:21.749769 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-00258f52-5370-4558-96aa-e109b73ef43d tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/9763a452-dc3c-436d-bee4-a3967af3bcbb" status: 200 len: 1320 microversion: 2.1 time: 0.251171 Sep 23 04:46:21.753073 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1743/3427] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:21 2022] GET /compute/v2.1/servers/9763a452-dc3c-436d-bee4-a3967af3bcbb => generated 1320 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:21.759463 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-246dc0a1-833f-4a9f-818e-a7839e6d01e3 tempest-FloatingIPDetailsTestJSON-1403081710 tempest-FloatingIPDetailsTestJSON-1403081710-project] Calling method '.version_select at 0x7ff1bb0b5a60>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:22.007509 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-6e72d2e2-4a2a-4ab8-9024-689162ec2c65 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "DELETE /compute/v2.1/servers/5977951e-84f3-4f6b-b86f-44853cc1bc60" status: 204 len: 0 microversion: 2.1 time: 0.476517 Sep 23 04:46:22.008108 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1685/3428] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:46:21 2022] DELETE /compute/v2.1/servers/5977951e-84f3-4f6b-b86f-44853cc1bc60 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:46:22.020368 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3ae12d17-b2cd-4b11-a53a-8064e31544f1 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '.version_select at 0x7ff1baa104c0>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:22.072559 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3ae12d17-b2cd-4b11-a53a-8064e31544f1 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "GET /compute/v2.1/images/330e09be-4c50-4e09-bc04-3e646285dccd" status: 200 len: 662 microversion: 2.1 time: 0.061750 Sep 23 04:46:22.073354 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1686/3429] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:46:22 2022] GET /compute/v2.1/images/330e09be-4c50-4e09-bc04-3e646285dccd => generated 662 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:46:22.089214 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5adb6052-5961-4ce6-873b-4e2abe6406b1 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:22.090170 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5adb6052-5961-4ce6-873b-4e2abe6406b1 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 5977951e-84f3-4f6b-b86f-44853cc1bc60] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:22.104872 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5adb6052-5961-4ce6-873b-4e2abe6406b1 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:22.104872 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5adb6052-5961-4ce6-873b-4e2abe6406b1 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:22.105334 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5adb6052-5961-4ce6-873b-4e2abe6406b1 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:22.106389 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5adb6052-5961-4ce6-873b-4e2abe6406b1 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:22.107195 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5adb6052-5961-4ce6-873b-4e2abe6406b1 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:22.107933 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5adb6052-5961-4ce6-873b-4e2abe6406b1 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:22.500059 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-5adb6052-5961-4ce6-873b-4e2abe6406b1 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:22.508298 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5adb6052-5961-4ce6-873b-4e2abe6406b1 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/5977951e-84f3-4f6b-b86f-44853cc1bc60" status: 200 len: 1517 microversion: 2.1 time: 0.424381 Sep 23 04:46:22.508885 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1687/3430] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:22 2022] GET /compute/v2.1/servers/5977951e-84f3-4f6b-b86f-44853cc1bc60 => generated 1517 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:22.528181 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-148b42c0-52b7-48e0-9dcb-af958a430b6a tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:22.529493 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-148b42c0-52b7-48e0-9dcb-af958a430b6a tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] [instance: 0fff1fd4-972c-4268-89fd-92b784244edf] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:22.536081 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-148b42c0-52b7-48e0-9dcb-af958a430b6a tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:22.536581 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-148b42c0-52b7-48e0-9dcb-af958a430b6a tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:22.537026 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-148b42c0-52b7-48e0-9dcb-af958a430b6a tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:22.537844 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-148b42c0-52b7-48e0-9dcb-af958a430b6a tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:22.538475 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-148b42c0-52b7-48e0-9dcb-af958a430b6a tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:22.538917 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-148b42c0-52b7-48e0-9dcb-af958a430b6a tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:22.831606 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-148b42c0-52b7-48e0-9dcb-af958a430b6a tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11980041918484990dac709544d0b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c43f2b70bc74a48b62fb4115337f073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:22.847266 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-148b42c0-52b7-48e0-9dcb-af958a430b6a tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/servers/0fff1fd4-972c-4268-89fd-92b784244edf" status: 200 len: 1307 microversion: 2.1 time: 0.337118 Sep 23 04:46:22.854886 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1688/3431] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:22 2022] GET /compute/v2.1/servers/0fff1fd4-972c-4268-89fd-92b784244edf => generated 1307 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:22.871922 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-103b637e-91e0-47ab-b0a2-dcba96ff9f61 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '.version_select at 0x7ff1ba960c10>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:22.937603 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-103b637e-91e0-47ab-b0a2-dcba96ff9f61 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "GET /compute/v2.1/images/330e09be-4c50-4e09-bc04-3e646285dccd" status: 200 len: 662 microversion: 2.1 time: 0.079131 Sep 23 04:46:22.938314 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1689/3432] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:46:22 2022] GET /compute/v2.1/images/330e09be-4c50-4e09-bc04-3e646285dccd => generated 662 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:46:23.170717 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7ee627ad-9f89-4462-9ce0-32590727b87a tempest-MultipleCreateNegativeTestJSON-1848087354 tempest-MultipleCreateNegativeTestJSON-1848087354-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-928965713", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:46:23.173860 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-7ee627ad-9f89-4462-9ce0-32590727b87a tempest-MultipleCreateNegativeTestJSON-1848087354 tempest-MultipleCreateNegativeTestJSON-1848087354-project] HTTP exception thrown: min_count must be <= max_count Sep 23 04:46:23.175382 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7ee627ad-9f89-4462-9ce0-32590727b87a tempest-MultipleCreateNegativeTestJSON-1848087354 tempest-MultipleCreateNegativeTestJSON-1848087354-project] Request method failure captured: Sep 23 04:46:23.175382 n-d-846463-3 devstack@n-api.service[122698]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 23 04:46:23.175382 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:46:23.175382 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:46:23.175382 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:46:23.175382 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 183 Sep 23 04:46:23.175382 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:46:23.175382 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:46:23.175382 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:46:23.175382 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:46:23.175382 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLToeWQH1WHv99dFp1APRhyfxHxyK57ONTf35LwQvABACRO916ARouKWojyLFY0RT-yAEJLT4j-J8BQ-WKEY1ogxf7VONB6tKqRxJeDkdd5XhYLLvVsaCbO8OjY47tMLXI0Y_vkACvjAwEvUyO34VvSUJ9TnkqCyIe_GpK-5iWSFWnuQ Sep 23 04:46:23.175382 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:46:23.175382 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:46:23.175382 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:46:23.175382 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:46:23.175382 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:46:23.175382 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:46:23.175382 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: cfd6330620f54ba9ab1a25fce3f7591b Sep 23 04:46:23.175382 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1848087354 Sep 23 04:46:23.175382 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:46:23.175382 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:46:23.175382 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cfd6330620f54ba9ab1a25fce3f7591b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cfd6330620f54ba9ab1a25fce3f7591b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cfd6330620f54ba9ab1a25fce3f7591b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cfd6330620f54ba9ab1a25fce3f7591b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:46:23.175382 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1848087354 Sep 23 04:46:23.175382 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: cfd6330620f54ba9ab1a25fce3f7591b Sep 23 04:46:23.175382 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1848087354 Sep 23 04:46:23.175382 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-MultipleCreateNegativeTestJSON-1848087354-project Sep 23 04:46:23.175382 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:46:23.175382 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:46:23.175382 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: d19b0ef3e1034a21a6b73e1ad731291f Sep 23 04:46:23.175382 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1848087354-project Sep 23 04:46:23.175382 n-d-846463-3 devstack@n-api.service[122698]: Sep 23 04:46:23.175382 n-d-846463-3 devstack@n-api.service[122698]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-928965713", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "min_count": 3, "max_count": 2}} Sep 23 04:46:23.175382 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:46:23.175382 n-d-846463-3 devstack@n-api.service[122698]: exception: min_count must be <= max_count Sep 23 04:46:23.175382 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-928965713', 'imageRef': 'b8dd79b9-f0b9-43a9-9605-17244137c0ee', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Sep 23 04:46:23.175382 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:46:23.175382 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:46:23.175382 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:46:23.175382 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:46:23.175382 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:46:23.175382 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:46:23.175382 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:46:23.175382 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:46:23.175382 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:46:23.175382 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:46:23.175382 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:46:23.175382 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:46:23.175382 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:46:23.175382 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:46:23.175382 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 23 04:46:23.175382 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Sep 23 04:46:23.175382 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Sep 23 04:46:23.175382 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Sep 23 04:46:23.175382 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:46:23.175382 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:46:23.175382 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:46:23.175382 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:46:23.175382 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:46:23.175382 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:46:23.175382 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:46:23.175382 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:46:23.175382 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Sep 23 04:46:23.175382 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:46:23.185103 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7ee627ad-9f89-4462-9ce0-32590727b87a tempest-MultipleCreateNegativeTestJSON-1848087354 tempest-MultipleCreateNegativeTestJSON-1848087354-project] Returning 400 to user: min_count must be <= max_count {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:46:23.185103 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7ee627ad-9f89-4462-9ce0-32590727b87a tempest-MultipleCreateNegativeTestJSON-1848087354 tempest-MultipleCreateNegativeTestJSON-1848087354-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.236014 Sep 23 04:46:23.185103 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1690/3433] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:46:22 2022] POST /compute/v2.1/servers => generated 74 bytes in 238 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 23 04:46:23.185103 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-549c7732-5fdd-4295-8225-d20db8ee8b6c tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:23.185103 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-549c7732-5fdd-4295-8225-d20db8ee8b6c tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: 9763a452-dc3c-436d-bee4-a3967af3bcbb] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:23.189657 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-549c7732-5fdd-4295-8225-d20db8ee8b6c tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:23.190179 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-549c7732-5fdd-4295-8225-d20db8ee8b6c tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:23.190842 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-549c7732-5fdd-4295-8225-d20db8ee8b6c tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:23.191543 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-549c7732-5fdd-4295-8225-d20db8ee8b6c tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:23.191999 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-549c7732-5fdd-4295-8225-d20db8ee8b6c tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:23.192422 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-549c7732-5fdd-4295-8225-d20db8ee8b6c tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:23.458017 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-246dc0a1-833f-4a9f-818e-a7839e6d01e3 tempest-FloatingIPDetailsTestJSON-1403081710 tempest-FloatingIPDetailsTestJSON-1403081710-project] 10.222.0.33 "DELETE /compute/v2.1/os-floating-ips/83e36e04-3bce-4ff5-ae9f-94a8bc9102af" status: 202 len: 0 microversion: 2.1 time: 1.703485 Sep 23 04:46:23.461990 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1744/3434] 10.222.0.33 () {58 vars in 1263 bytes} [Fri Sep 23 04:46:21 2022] DELETE /compute/v2.1/os-floating-ips/83e36e04-3bce-4ff5-ae9f-94a8bc9102af => generated 0 bytes in 1708 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:46:23.478394 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-791effb5-e80c-4fe0-959d-4a12f1a2c370 req-15d5d3df-0777-494b-9b75-45c491b1603d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9763a452-dc3c-436d-bee4-a3967af3bcbb", "name": "network-vif-plugged", "status": "completed", "tag": "4e9aa528-cb1f-4f7a-add2-edebbcce69d9"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:46:23.486205 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-791effb5-e80c-4fe0-959d-4a12f1a2c370 req-15d5d3df-0777-494b-9b75-45c491b1603d service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:23.486861 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-791effb5-e80c-4fe0-959d-4a12f1a2c370 req-15d5d3df-0777-494b-9b75-45c491b1603d service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:23.487439 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-791effb5-e80c-4fe0-959d-4a12f1a2c370 req-15d5d3df-0777-494b-9b75-45c491b1603d service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:23.504911 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-791effb5-e80c-4fe0-959d-4a12f1a2c370 req-15d5d3df-0777-494b-9b75-45c491b1603d service nova] Creating event network-vif-plugged:4e9aa528-cb1f-4f7a-add2-edebbcce69d9 for instance 9763a452-dc3c-436d-bee4-a3967af3bcbb on n-h1-846463-3 Sep 23 04:46:23.510706 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-791effb5-e80c-4fe0-959d-4a12f1a2c370 req-15d5d3df-0777-494b-9b75-45c491b1603d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046718 Sep 23 04:46:23.511806 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1745/3435] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:46:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:46:23.520237 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6c72a989-b3ca-4e56-97a7-660e7d959917 tempest-MultipleCreateNegativeTestJSON-1848087354 tempest-MultipleCreateNegativeTestJSON-1848087354-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1939453460", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "max_count": 0}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:46:23.536958 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6c72a989-b3ca-4e56-97a7-660e7d959917 tempest-MultipleCreateNegativeTestJSON-1848087354 tempest-MultipleCreateNegativeTestJSON-1848087354-project] Request method failure captured: Sep 23 04:46:23.536958 n-d-846463-3 devstack@n-api.service[122699]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 23 04:46:23.536958 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:46:23.536958 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:46:23.536958 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:46:23.536958 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 168 Sep 23 04:46:23.536958 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:46:23.536958 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:46:23.536958 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:46:23.536958 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:46:23.536958 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLToeWQH1WHv99dFp1APRhyfxHxyK57ONTf35LwQvABACRO916ARouKWojyLFY0RT-yAEJLT4j-J8BQ-WKEY1ogxf7VONB6tKqRxJeDkdd5XhYLLvVsaCbO8OjY47tMLXI0Y_vkACvjAwEvUyO34VvSUJ9TnkqCyIe_GpK-5iWSFWnuQ Sep 23 04:46:23.536958 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:46:23.536958 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:46:23.536958 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:46:23.536958 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:46:23.536958 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:46:23.536958 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:46:23.536958 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: cfd6330620f54ba9ab1a25fce3f7591b Sep 23 04:46:23.536958 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1848087354 Sep 23 04:46:23.536958 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:46:23.536958 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:46:23.536958 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cfd6330620f54ba9ab1a25fce3f7591b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cfd6330620f54ba9ab1a25fce3f7591b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cfd6330620f54ba9ab1a25fce3f7591b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cfd6330620f54ba9ab1a25fce3f7591b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:46:23.536958 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1848087354 Sep 23 04:46:23.536958 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: cfd6330620f54ba9ab1a25fce3f7591b Sep 23 04:46:23.536958 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1848087354 Sep 23 04:46:23.536958 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-MultipleCreateNegativeTestJSON-1848087354-project Sep 23 04:46:23.536958 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:46:23.536958 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:46:23.536958 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: d19b0ef3e1034a21a6b73e1ad731291f Sep 23 04:46:23.536958 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1848087354-project Sep 23 04:46:23.536958 n-d-846463-3 devstack@n-api.service[122699]: Sep 23 04:46:23.536958 n-d-846463-3 devstack@n-api.service[122699]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1939453460", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "max_count": 0}} Sep 23 04:46:23.536958 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:46:23.536958 n-d-846463-3 devstack@n-api.service[122699]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Sep 23 04:46:23.536958 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1939453460', 'imageRef': 'b8dd79b9-f0b9-43a9-9605-17244137c0ee', 'flavorRef': '452', 'max_count': 0}}} Sep 23 04:46:23.536958 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:46:23.536958 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:46:23.536958 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 23 04:46:23.536958 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 23 04:46:23.536958 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 23 04:46:23.536958 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise error Sep 23 04:46:23.536958 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 23 04:46:23.536958 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:46:23.536958 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Sep 23 04:46:23.536958 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 23 04:46:23.536958 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi 'minimum': 1, Sep 23 04:46:23.536958 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 23 04:46:23.536958 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 23 04:46:23.536958 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:46:23.536958 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 23 04:46:23.536958 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi 0 Sep 23 04:46:23.536958 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:46:23.536958 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:46:23.536958 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:46:23.536958 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:46:23.536958 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:46:23.536958 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:46:23.536958 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:46:23.536958 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:46:23.536958 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:46:23.536958 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:46:23.536958 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:46:23.536958 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:46:23.536958 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 23 04:46:23.536958 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 23 04:46:23.543484 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 23 04:46:23.543484 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 23 04:46:23.543484 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 23 04:46:23.543484 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 23 04:46:23.543484 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Sep 23 04:46:23.543484 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:46:23.543484 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:46:23.543484 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:46:23.543484 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:46:23.543484 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:46:23.543484 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:46:23.543484 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 23 04:46:23.543484 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 23 04:46:23.543484 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Sep 23 04:46:23.543484 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:46:23.543484 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6c72a989-b3ca-4e56-97a7-660e7d959917 tempest-MultipleCreateNegativeTestJSON-1848087354 tempest-MultipleCreateNegativeTestJSON-1848087354-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:46:23.546693 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-549c7732-5fdd-4295-8225-d20db8ee8b6c tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c786bbedc21849ea92924139a44707b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcafb05f6f554e278cd552023947c6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:23.549280 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-549c7732-5fdd-4295-8225-d20db8ee8b6c tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/9763a452-dc3c-436d-bee4-a3967af3bcbb" status: 200 len: 1320 microversion: 2.1 time: 0.370151 Sep 23 04:46:23.549832 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6c72a989-b3ca-4e56-97a7-660e7d959917 tempest-MultipleCreateNegativeTestJSON-1848087354 tempest-MultipleCreateNegativeTestJSON-1848087354-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.033452 Sep 23 04:46:23.550494 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1691/3436] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:23 2022] GET /compute/v2.1/servers/9763a452-dc3c-436d-bee4-a3967af3bcbb => generated 1320 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:23.551295 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1746/3437] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:46:23 2022] POST /compute/v2.1/servers => generated 130 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 04:46:23.560852 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-bcab214b-4be9-47d7-9871-9585e19088aa tempest-FloatingIPDetailsTestJSON-1403081710 tempest-FloatingIPDetailsTestJSON-1403081710-project] Calling method '.version_select at 0x7ff1ba9c1b80>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:23.567626 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-05ba4eb3-f521-42a8-bb06-82f830c362ec req-64c31302-c46e-4866-ae89-a0769b99a714 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fff1fd4-972c-4268-89fd-92b784244edf", "tag": "1b7def80-2c6f-4b50-8986-20b3ff92ff59"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:46:23.581273 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-05ba4eb3-f521-42a8-bb06-82f830c362ec req-64c31302-c46e-4866-ae89-a0769b99a714 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:23.582017 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-05ba4eb3-f521-42a8-bb06-82f830c362ec req-64c31302-c46e-4866-ae89-a0769b99a714 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:23.582608 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-05ba4eb3-f521-42a8-bb06-82f830c362ec req-64c31302-c46e-4866-ae89-a0769b99a714 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:23.600041 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-05ba4eb3-f521-42a8-bb06-82f830c362ec req-64c31302-c46e-4866-ae89-a0769b99a714 service nova] Creating event network-changed:1b7def80-2c6f-4b50-8986-20b3ff92ff59 for instance 0fff1fd4-972c-4268-89fd-92b784244edf on n-h2-846463-3 Sep 23 04:46:23.609259 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-05ba4eb3-f521-42a8-bb06-82f830c362ec req-64c31302-c46e-4866-ae89-a0769b99a714 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057458 Sep 23 04:46:23.610604 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1692/3438] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:46:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:46:23.621488 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f30ac81f-28fc-4e7d-bc3e-9f3e43d75580 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:23.622752 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f30ac81f-28fc-4e7d-bc3e-9f3e43d75580 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 5977951e-84f3-4f6b-b86f-44853cc1bc60] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:23.631482 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f30ac81f-28fc-4e7d-bc3e-9f3e43d75580 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:23.632209 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f30ac81f-28fc-4e7d-bc3e-9f3e43d75580 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:23.633382 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f30ac81f-28fc-4e7d-bc3e-9f3e43d75580 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:23.634443 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f30ac81f-28fc-4e7d-bc3e-9f3e43d75580 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:23.636171 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f30ac81f-28fc-4e7d-bc3e-9f3e43d75580 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:23.637139 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f30ac81f-28fc-4e7d-bc3e-9f3e43d75580 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:24.081571 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f30ac81f-28fc-4e7d-bc3e-9f3e43d75580 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:24.083513 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f30ac81f-28fc-4e7d-bc3e-9f3e43d75580 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/5977951e-84f3-4f6b-b86f-44853cc1bc60" status: 200 len: 1517 microversion: 2.1 time: 0.467046 Sep 23 04:46:24.084084 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1693/3439] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:23 2022] GET /compute/v2.1/servers/5977951e-84f3-4f6b-b86f-44853cc1bc60 => generated 1517 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:24.088764 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1c2976ff-e89a-48b6-8cb3-7cc426e36056 tempest-MultipleCreateNegativeTestJSON-1848087354 tempest-MultipleCreateNegativeTestJSON-1848087354-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-110174580", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "max_count": 2.5}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:46:24.093682 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1c2976ff-e89a-48b6-8cb3-7cc426e36056 tempest-MultipleCreateNegativeTestJSON-1848087354 tempest-MultipleCreateNegativeTestJSON-1848087354-project] Request method failure captured: Sep 23 04:46:24.093682 n-d-846463-3 devstack@n-api.service[122698]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 23 04:46:24.093682 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:46:24.093682 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:46:24.093682 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:46:24.093682 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 169 Sep 23 04:46:24.093682 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:46:24.093682 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:46:24.093682 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:46:24.093682 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:46:24.093682 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLToeWQH1WHv99dFp1APRhyfxHxyK57ONTf35LwQvABACRO916ARouKWojyLFY0RT-yAEJLT4j-J8BQ-WKEY1ogxf7VONB6tKqRxJeDkdd5XhYLLvVsaCbO8OjY47tMLXI0Y_vkACvjAwEvUyO34VvSUJ9TnkqCyIe_GpK-5iWSFWnuQ Sep 23 04:46:24.093682 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:46:24.093682 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:46:24.093682 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:46:24.093682 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:46:24.093682 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:46:24.093682 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:46:24.093682 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: cfd6330620f54ba9ab1a25fce3f7591b Sep 23 04:46:24.093682 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1848087354 Sep 23 04:46:24.093682 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:46:24.093682 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:46:24.093682 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cfd6330620f54ba9ab1a25fce3f7591b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cfd6330620f54ba9ab1a25fce3f7591b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cfd6330620f54ba9ab1a25fce3f7591b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cfd6330620f54ba9ab1a25fce3f7591b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:46:24.093682 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1848087354 Sep 23 04:46:24.093682 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: cfd6330620f54ba9ab1a25fce3f7591b Sep 23 04:46:24.093682 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1848087354 Sep 23 04:46:24.093682 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-MultipleCreateNegativeTestJSON-1848087354-project Sep 23 04:46:24.093682 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:46:24.093682 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:46:24.093682 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: d19b0ef3e1034a21a6b73e1ad731291f Sep 23 04:46:24.093682 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1848087354-project Sep 23 04:46:24.093682 n-d-846463-3 devstack@n-api.service[122698]: Sep 23 04:46:24.093682 n-d-846463-3 devstack@n-api.service[122698]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-110174580", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "max_count": 2.5}} Sep 23 04:46:24.093682 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:46:24.093682 n-d-846463-3 devstack@n-api.service[122698]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 23 04:46:24.093682 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-110174580', 'imageRef': 'b8dd79b9-f0b9-43a9-9605-17244137c0ee', 'flavorRef': '452', 'max_count': 2.5}}} Sep 23 04:46:24.093682 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:46:24.093682 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:46:24.093682 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 23 04:46:24.093682 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 23 04:46:24.093682 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 23 04:46:24.093682 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise error Sep 23 04:46:24.093682 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Sep 23 04:46:24.093682 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:46:24.093682 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Sep 23 04:46:24.093682 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 23 04:46:24.093682 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi 'minimum': 1, Sep 23 04:46:24.093682 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 23 04:46:24.093682 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 23 04:46:24.093682 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:46:24.093682 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 23 04:46:24.093682 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi 2.5 Sep 23 04:46:24.093682 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:46:24.093682 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:46:24.093682 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:46:24.093682 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:46:24.093682 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:46:24.093682 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:46:24.093682 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:46:24.093682 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:46:24.093682 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:46:24.093682 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:46:24.093682 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:46:24.093682 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:46:24.093682 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 23 04:46:24.093682 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 23 04:46:24.098529 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 23 04:46:24.098529 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 23 04:46:24.098529 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 23 04:46:24.098529 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 23 04:46:24.098529 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 23 04:46:24.098529 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:46:24.098529 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:46:24.098529 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:46:24.098529 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:46:24.098529 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:46:24.098529 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:46:24.098529 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 23 04:46:24.098529 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 23 04:46:24.098529 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 23 04:46:24.098529 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:46:24.098529 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1c2976ff-e89a-48b6-8cb3-7cc426e36056 tempest-MultipleCreateNegativeTestJSON-1848087354 tempest-MultipleCreateNegativeTestJSON-1848087354-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:46:24.098529 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-1c2976ff-e89a-48b6-8cb3-7cc426e36056 tempest-MultipleCreateNegativeTestJSON-1848087354 tempest-MultipleCreateNegativeTestJSON-1848087354-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.010008 Sep 23 04:46:24.098529 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1694/3440] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:46:24 2022] POST /compute/v2.1/servers => generated 139 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 04:46:24.102659 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-633cdc6a-4e3e-4b2e-a849-a40ff99f0fe4 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:24.103461 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-633cdc6a-4e3e-4b2e-a849-a40ff99f0fe4 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] [instance: 0fff1fd4-972c-4268-89fd-92b784244edf] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:24.110791 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-633cdc6a-4e3e-4b2e-a849-a40ff99f0fe4 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:24.111306 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-633cdc6a-4e3e-4b2e-a849-a40ff99f0fe4 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:24.111890 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-633cdc6a-4e3e-4b2e-a849-a40ff99f0fe4 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:24.112963 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-633cdc6a-4e3e-4b2e-a849-a40ff99f0fe4 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:24.113452 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-633cdc6a-4e3e-4b2e-a849-a40ff99f0fe4 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:24.113905 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-633cdc6a-4e3e-4b2e-a849-a40ff99f0fe4 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:25.002528 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-633cdc6a-4e3e-4b2e-a849-a40ff99f0fe4 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11980041918484990dac709544d0b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c43f2b70bc74a48b62fb4115337f073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:25.026472 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-633cdc6a-4e3e-4b2e-a849-a40ff99f0fe4 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/servers/0fff1fd4-972c-4268-89fd-92b784244edf" status: 200 len: 1307 microversion: 2.1 time: 0.929346 Sep 23 04:46:25.027051 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1695/3441] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:24 2022] GET /compute/v2.1/servers/0fff1fd4-972c-4268-89fd-92b784244edf => generated 1307 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:25.041148 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b36ab23b-4969-4ec1-9bcd-914972e6d7b3 tempest-MultipleCreateNegativeTestJSON-1848087354 tempest-MultipleCreateNegativeTestJSON-1848087354-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-47614886", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "min_count": 0}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:46:25.060190 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b36ab23b-4969-4ec1-9bcd-914972e6d7b3 tempest-MultipleCreateNegativeTestJSON-1848087354 tempest-MultipleCreateNegativeTestJSON-1848087354-project] Request method failure captured: Sep 23 04:46:25.060190 n-d-846463-3 devstack@n-api.service[122698]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 23 04:46:25.060190 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:46:25.060190 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:46:25.060190 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:46:25.060190 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 166 Sep 23 04:46:25.060190 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:46:25.060190 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:46:25.060190 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:46:25.060190 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:46:25.060190 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLToeWQH1WHv99dFp1APRhyfxHxyK57ONTf35LwQvABACRO916ARouKWojyLFY0RT-yAEJLT4j-J8BQ-WKEY1ogxf7VONB6tKqRxJeDkdd5XhYLLvVsaCbO8OjY47tMLXI0Y_vkACvjAwEvUyO34VvSUJ9TnkqCyIe_GpK-5iWSFWnuQ Sep 23 04:46:25.060190 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:46:25.060190 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:46:25.060190 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:46:25.060190 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:46:25.060190 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:46:25.060190 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:46:25.060190 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: cfd6330620f54ba9ab1a25fce3f7591b Sep 23 04:46:25.060190 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1848087354 Sep 23 04:46:25.060190 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:46:25.060190 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:46:25.060190 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cfd6330620f54ba9ab1a25fce3f7591b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cfd6330620f54ba9ab1a25fce3f7591b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cfd6330620f54ba9ab1a25fce3f7591b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cfd6330620f54ba9ab1a25fce3f7591b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:46:25.060190 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1848087354 Sep 23 04:46:25.060190 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: cfd6330620f54ba9ab1a25fce3f7591b Sep 23 04:46:25.060190 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1848087354 Sep 23 04:46:25.060190 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-MultipleCreateNegativeTestJSON-1848087354-project Sep 23 04:46:25.060190 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:46:25.060190 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:46:25.060190 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: d19b0ef3e1034a21a6b73e1ad731291f Sep 23 04:46:25.060190 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1848087354-project Sep 23 04:46:25.060190 n-d-846463-3 devstack@n-api.service[122698]: Sep 23 04:46:25.060190 n-d-846463-3 devstack@n-api.service[122698]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-47614886", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "min_count": 0}} Sep 23 04:46:25.060190 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:46:25.060190 n-d-846463-3 devstack@n-api.service[122698]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Sep 23 04:46:25.060190 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-47614886', 'imageRef': 'b8dd79b9-f0b9-43a9-9605-17244137c0ee', 'flavorRef': '452', 'min_count': 0}}} Sep 23 04:46:25.060190 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:46:25.060190 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:46:25.060190 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 23 04:46:25.060190 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 23 04:46:25.060190 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 23 04:46:25.060190 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise error Sep 23 04:46:25.060190 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 23 04:46:25.060190 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:46:25.060190 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Sep 23 04:46:25.060190 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 23 04:46:25.060190 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi 'minimum': 1, Sep 23 04:46:25.060190 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 23 04:46:25.060190 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 23 04:46:25.060190 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:46:25.060190 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 23 04:46:25.060190 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi 0 Sep 23 04:46:25.060190 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:46:25.060190 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:46:25.060190 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:46:25.060190 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:46:25.060190 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:46:25.060190 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:46:25.060190 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:46:25.060190 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:46:25.060190 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:46:25.060190 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:46:25.060190 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:46:25.060190 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:46:25.060190 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 23 04:46:25.060190 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 23 04:46:25.068432 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 23 04:46:25.068432 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 23 04:46:25.068432 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 23 04:46:25.068432 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 23 04:46:25.068432 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Sep 23 04:46:25.068432 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:46:25.068432 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:46:25.068432 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:46:25.068432 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:46:25.068432 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:46:25.068432 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:46:25.068432 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 23 04:46:25.068432 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 23 04:46:25.068432 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Sep 23 04:46:25.068432 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:46:25.068432 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b36ab23b-4969-4ec1-9bcd-914972e6d7b3 tempest-MultipleCreateNegativeTestJSON-1848087354 tempest-MultipleCreateNegativeTestJSON-1848087354-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:46:25.068432 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b36ab23b-4969-4ec1-9bcd-914972e6d7b3 tempest-MultipleCreateNegativeTestJSON-1848087354 tempest-MultipleCreateNegativeTestJSON-1848087354-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.031739 Sep 23 04:46:25.069998 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1696/3442] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:46:25 2022] POST /compute/v2.1/servers => generated 130 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 04:46:25.084449 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-8b611e09-1a96-4048-a0d1-7230b118b5e0 req-d1e15617-b4f8-4fad-9ffc-ac239cd22c9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5977951e-84f3-4f6b-b86f-44853cc1bc60", "name": "network-vif-deleted", "tag": "17f3beaa-1f30-48da-b88d-5760b58abddc"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:46:25.087627 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:46:25.117957 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-8b611e09-1a96-4048-a0d1-7230b118b5e0 req-d1e15617-b4f8-4fad-9ffc-ac239cd22c9b service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:25.117957 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-8b611e09-1a96-4048-a0d1-7230b118b5e0 req-d1e15617-b4f8-4fad-9ffc-ac239cd22c9b service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:25.117957 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-8b611e09-1a96-4048-a0d1-7230b118b5e0 req-d1e15617-b4f8-4fad-9ffc-ac239cd22c9b service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:25.127068 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-8b611e09-1a96-4048-a0d1-7230b118b5e0 req-d1e15617-b4f8-4fad-9ffc-ac239cd22c9b service nova] Creating event network-vif-deleted:17f3beaa-1f30-48da-b88d-5760b58abddc for instance 5977951e-84f3-4f6b-b86f-44853cc1bc60 on n-h1-846463-3 Sep 23 04:46:25.132065 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-8b611e09-1a96-4048-a0d1-7230b118b5e0 req-d1e15617-b4f8-4fad-9ffc-ac239cd22c9b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056033 Sep 23 04:46:25.132912 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1697/3443] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:46:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:46:25.139700 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-adeb745f-5634-4f60-9345-23f6bde72bcc tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:25.140602 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-adeb745f-5634-4f60-9345-23f6bde72bcc tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: 9763a452-dc3c-436d-bee4-a3967af3bcbb] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:25.147057 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-adeb745f-5634-4f60-9345-23f6bde72bcc tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:25.147793 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-adeb745f-5634-4f60-9345-23f6bde72bcc tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:25.148413 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-adeb745f-5634-4f60-9345-23f6bde72bcc tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:25.149308 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-adeb745f-5634-4f60-9345-23f6bde72bcc tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:25.149991 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-adeb745f-5634-4f60-9345-23f6bde72bcc tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:25.150431 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-adeb745f-5634-4f60-9345-23f6bde72bcc tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:25.161530 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=6 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:46:25.371593 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-adeb745f-5634-4f60-9345-23f6bde72bcc tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c786bbedc21849ea92924139a44707b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcafb05f6f554e278cd552023947c6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:25.384814 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-adeb745f-5634-4f60-9345-23f6bde72bcc tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/9763a452-dc3c-436d-bee4-a3967af3bcbb" status: 200 len: 1514 microversion: 2.1 time: 0.249800 Sep 23 04:46:25.398415 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1698/3444] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:25 2022] GET /compute/v2.1/servers/9763a452-dc3c-436d-bee4-a3967af3bcbb => generated 1514 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:25.401737 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b6203abb-4fe9-46fe-8aaa-c4f8547a19b8 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '.version_select at 0x7ff1ba92c0d0>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:25.467085 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b6203abb-4fe9-46fe-8aaa-c4f8547a19b8 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "GET /compute/v2.1/images/c4d1d314-0b71-4f7c-ab75-94739b713e7f" status: 200 len: 661 microversion: 2.1 time: 0.078755 Sep 23 04:46:25.468897 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1699/3445] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:46:25 2022] GET /compute/v2.1/images/c4d1d314-0b71-4f7c-ab75-94739b713e7f => generated 661 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:46:25.475631 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-13b912c7-3ec2-4692-9d3a-9632a9d8e52e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:25.476355 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-13b912c7-3ec2-4692-9d3a-9632a9d8e52e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 5977951e-84f3-4f6b-b86f-44853cc1bc60] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:25.483345 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-13b912c7-3ec2-4692-9d3a-9632a9d8e52e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:25.483949 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-13b912c7-3ec2-4692-9d3a-9632a9d8e52e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:25.484498 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-13b912c7-3ec2-4692-9d3a-9632a9d8e52e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:25.485388 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-13b912c7-3ec2-4692-9d3a-9632a9d8e52e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:25.486051 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-13b912c7-3ec2-4692-9d3a-9632a9d8e52e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:25.490788 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-13b912c7-3ec2-4692-9d3a-9632a9d8e52e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:25.491777 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:46:25.520243 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-13b912c7-3ec2-4692-9d3a-9632a9d8e52e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:25.520734 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-13b912c7-3ec2-4692-9d3a-9632a9d8e52e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:25.521168 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-13b912c7-3ec2-4692-9d3a-9632a9d8e52e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:25.521619 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-13b912c7-3ec2-4692-9d3a-9632a9d8e52e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lazy-loading 'fault' on Instance uuid 5977951e-84f3-4f6b-b86f-44853cc1bc60 {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:46:25.572736 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-13b912c7-3ec2-4692-9d3a-9632a9d8e52e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:25.583523 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-13b912c7-3ec2-4692-9d3a-9632a9d8e52e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/5977951e-84f3-4f6b-b86f-44853cc1bc60" status: 200 len: 1320 microversion: 2.1 time: 0.113114 Sep 23 04:46:25.584799 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1700/3446] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:25 2022] GET /compute/v2.1/servers/5977951e-84f3-4f6b-b86f-44853cc1bc60 => generated 1320 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:25.593936 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-72e167f7-f13e-4b37-b6ed-92527cc9c58c tempest-MultipleCreateNegativeTestJSON-1848087354 tempest-MultipleCreateNegativeTestJSON-1848087354-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-99263544", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "min_count": 2.5}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:46:25.617300 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-72e167f7-f13e-4b37-b6ed-92527cc9c58c tempest-MultipleCreateNegativeTestJSON-1848087354 tempest-MultipleCreateNegativeTestJSON-1848087354-project] Request method failure captured: Sep 23 04:46:25.617300 n-d-846463-3 devstack@n-api.service[122698]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 23 04:46:25.617300 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:46:25.617300 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:46:25.617300 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:46:25.617300 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 168 Sep 23 04:46:25.617300 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:46:25.617300 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:46:25.617300 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:46:25.617300 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:46:25.617300 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLToeWQH1WHv99dFp1APRhyfxHxyK57ONTf35LwQvABACRO916ARouKWojyLFY0RT-yAEJLT4j-J8BQ-WKEY1ogxf7VONB6tKqRxJeDkdd5XhYLLvVsaCbO8OjY47tMLXI0Y_vkACvjAwEvUyO34VvSUJ9TnkqCyIe_GpK-5iWSFWnuQ Sep 23 04:46:25.617300 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:46:25.617300 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:46:25.617300 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:46:25.617300 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:46:25.617300 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:46:25.617300 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:46:25.617300 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: cfd6330620f54ba9ab1a25fce3f7591b Sep 23 04:46:25.617300 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1848087354 Sep 23 04:46:25.617300 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:46:25.617300 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:46:25.617300 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cfd6330620f54ba9ab1a25fce3f7591b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cfd6330620f54ba9ab1a25fce3f7591b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cfd6330620f54ba9ab1a25fce3f7591b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cfd6330620f54ba9ab1a25fce3f7591b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:46:25.617300 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1848087354 Sep 23 04:46:25.617300 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: cfd6330620f54ba9ab1a25fce3f7591b Sep 23 04:46:25.617300 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1848087354 Sep 23 04:46:25.617300 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-MultipleCreateNegativeTestJSON-1848087354-project Sep 23 04:46:25.617300 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:46:25.617300 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:46:25.617300 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: d19b0ef3e1034a21a6b73e1ad731291f Sep 23 04:46:25.617300 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1848087354-project Sep 23 04:46:25.617300 n-d-846463-3 devstack@n-api.service[122698]: Sep 23 04:46:25.617300 n-d-846463-3 devstack@n-api.service[122698]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-99263544", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "min_count": 2.5}} Sep 23 04:46:25.617300 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:46:25.617300 n-d-846463-3 devstack@n-api.service[122698]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 23 04:46:25.617300 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-99263544', 'imageRef': 'b8dd79b9-f0b9-43a9-9605-17244137c0ee', 'flavorRef': '452', 'min_count': 2.5}}} Sep 23 04:46:25.617300 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:46:25.617300 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:46:25.617300 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 23 04:46:25.617300 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 23 04:46:25.617300 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 23 04:46:25.617300 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise error Sep 23 04:46:25.617300 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Sep 23 04:46:25.617300 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:46:25.617300 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Sep 23 04:46:25.617300 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 23 04:46:25.617300 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi 'minimum': 1, Sep 23 04:46:25.617300 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 23 04:46:25.617300 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 23 04:46:25.617300 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:46:25.617300 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 23 04:46:25.617300 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi 2.5 Sep 23 04:46:25.617300 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:46:25.617300 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:46:25.617300 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:46:25.617300 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:46:25.617300 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:46:25.617300 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:46:25.617300 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:46:25.617300 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:46:25.617300 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:46:25.617300 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:46:25.617300 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:46:25.617300 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:46:25.617300 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 23 04:46:25.617300 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 23 04:46:25.628381 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 23 04:46:25.628381 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 23 04:46:25.628381 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 23 04:46:25.628381 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 23 04:46:25.628381 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 23 04:46:25.628381 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:46:25.628381 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:46:25.628381 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:46:25.628381 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:46:25.628381 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:46:25.628381 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:46:25.628381 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 23 04:46:25.628381 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 23 04:46:25.628381 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 23 04:46:25.628381 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:46:25.628381 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-72e167f7-f13e-4b37-b6ed-92527cc9c58c tempest-MultipleCreateNegativeTestJSON-1848087354 tempest-MultipleCreateNegativeTestJSON-1848087354-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:46:25.628381 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-72e167f7-f13e-4b37-b6ed-92527cc9c58c tempest-MultipleCreateNegativeTestJSON-1848087354 tempest-MultipleCreateNegativeTestJSON-1848087354-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.033998 Sep 23 04:46:25.628381 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1701/3447] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:46:25 2022] POST /compute/v2.1/servers => generated 139 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 04:46:25.632674 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a44df950-b287-4cc4-ac49-5d2e5d61e600 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:46:25.634953 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a44df950-b287-4cc4-ac49-5d2e5d61e600 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: 9763a452-dc3c-436d-bee4-a3967af3bcbb] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:25.651033 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a44df950-b287-4cc4-ac49-5d2e5d61e600 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:25.653669 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a44df950-b287-4cc4-ac49-5d2e5d61e600 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:25.654728 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a44df950-b287-4cc4-ac49-5d2e5d61e600 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:25.656102 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a44df950-b287-4cc4-ac49-5d2e5d61e600 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:25.656787 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a44df950-b287-4cc4-ac49-5d2e5d61e600 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:25.657417 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a44df950-b287-4cc4-ac49-5d2e5d61e600 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:25.706993 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-a44df950-b287-4cc4-ac49-5d2e5d61e600 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lazy-loading 'flavor' on Instance uuid 9763a452-dc3c-436d-bee4-a3967af3bcbb {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:46:25.743403 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-bcab214b-4be9-47d7-9871-9585e19088aa tempest-FloatingIPDetailsTestJSON-1403081710 tempest-FloatingIPDetailsTestJSON-1403081710-project] 10.222.0.33 "DELETE /compute/v2.1/os-floating-ips/d46a26e1-ffcc-489a-9bdd-ac2392f50fb7" status: 202 len: 0 microversion: 2.1 time: 2.190748 Sep 23 04:46:25.748892 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1747/3448] 10.222.0.33 () {58 vars in 1263 bytes} [Fri Sep 23 04:46:23 2022] DELETE /compute/v2.1/os-floating-ips/d46a26e1-ffcc-489a-9bdd-ac2392f50fb7 => generated 0 bytes in 2197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:46:25.754450 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-28228d0f-9afc-475d-89ad-bf5d82622bee tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '.version_select at 0x7ff1bb76e0d0>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:25.816279 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-28228d0f-9afc-475d-89ad-bf5d82622bee tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "GET /compute/v2.1/images/c4d1d314-0b71-4f7c-ab75-94739b713e7f" status: 200 len: 661 microversion: 2.1 time: 0.065580 Sep 23 04:46:25.816871 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1748/3449] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:46:25 2022] GET /compute/v2.1/images/c4d1d314-0b71-4f7c-ab75-94739b713e7f => generated 661 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:46:26.050242 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a0b84ce7-3168-46b5-aaa2-0b5b2c9545db tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:26.050983 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a0b84ce7-3168-46b5-aaa2-0b5b2c9545db tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] [instance: 0fff1fd4-972c-4268-89fd-92b784244edf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:26.054787 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a44df950-b287-4cc4-ac49-5d2e5d61e600 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "POST /compute/v2.1/servers/9763a452-dc3c-436d-bee4-a3967af3bcbb/action" status: 200 len: 32 microversion: 2.1 time: 0.431165 Sep 23 04:46:26.055632 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1702/3450] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:46:25 2022] POST /compute/v2.1/servers/9763a452-dc3c-436d-bee4-a3967af3bcbb/action => generated 32 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 04:46:26.071564 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4200294b-a24e-4f63-bfca-004eb575ef86 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-764585212", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:46:26.074642 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a0b84ce7-3168-46b5-aaa2-0b5b2c9545db tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:26.078131 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a0b84ce7-3168-46b5-aaa2-0b5b2c9545db tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:26.078765 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a0b84ce7-3168-46b5-aaa2-0b5b2c9545db tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:26.080307 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a0b84ce7-3168-46b5-aaa2-0b5b2c9545db tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:26.080954 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a0b84ce7-3168-46b5-aaa2-0b5b2c9545db tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:26.091370 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a0b84ce7-3168-46b5-aaa2-0b5b2c9545db tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:26.184107 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.network.neutron [None req-4200294b-a24e-4f63-bfca-004eb575ef86 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] validate_networks() for None {{(pid=122698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:46:26.370504 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:46:26.563371 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a0b84ce7-3168-46b5-aaa2-0b5b2c9545db tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11980041918484990dac709544d0b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c43f2b70bc74a48b62fb4115337f073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:26.572109 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a0b84ce7-3168-46b5-aaa2-0b5b2c9545db tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/servers/0fff1fd4-972c-4268-89fd-92b784244edf" status: 200 len: 1307 microversion: 2.1 time: 0.525833 Sep 23 04:46:26.578076 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1749/3451] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:26 2022] GET /compute/v2.1/servers/0fff1fd4-972c-4268-89fd-92b784244edf => generated 1307 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:46:26.583594 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-96785e1a-1ec5-42d9-8a15-f81501e78758 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:26.584283 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-96785e1a-1ec5-42d9-8a15-f81501e78758 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: 9763a452-dc3c-436d-bee4-a3967af3bcbb] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:26.607946 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-96785e1a-1ec5-42d9-8a15-f81501e78758 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:26.607946 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-96785e1a-1ec5-42d9-8a15-f81501e78758 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:26.607946 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-96785e1a-1ec5-42d9-8a15-f81501e78758 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:26.615237 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-96785e1a-1ec5-42d9-8a15-f81501e78758 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:26.615858 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-96785e1a-1ec5-42d9-8a15-f81501e78758 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:26.616326 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-96785e1a-1ec5-42d9-8a15-f81501e78758 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:27.138704 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-96785e1a-1ec5-42d9-8a15-f81501e78758 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c786bbedc21849ea92924139a44707b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcafb05f6f554e278cd552023947c6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:27.146578 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-96785e1a-1ec5-42d9-8a15-f81501e78758 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/9763a452-dc3c-436d-bee4-a3967af3bcbb" status: 200 len: 1520 microversion: 2.1 time: 0.567034 Sep 23 04:46:27.147551 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1750/3452] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:26 2022] GET /compute/v2.1/servers/9763a452-dc3c-436d-bee4-a3967af3bcbb => generated 1520 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:27.152669 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f984682e-0987-42a2-a11d-5a8dc09425e0 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:27.153995 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f984682e-0987-42a2-a11d-5a8dc09425e0 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 5977951e-84f3-4f6b-b86f-44853cc1bc60] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:27.160350 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f984682e-0987-42a2-a11d-5a8dc09425e0 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:27.161437 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f984682e-0987-42a2-a11d-5a8dc09425e0 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:27.161911 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f984682e-0987-42a2-a11d-5a8dc09425e0 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:27.162658 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f984682e-0987-42a2-a11d-5a8dc09425e0 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:27.163123 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f984682e-0987-42a2-a11d-5a8dc09425e0 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:27.163547 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f984682e-0987-42a2-a11d-5a8dc09425e0 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:27.180746 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-f984682e-0987-42a2-a11d-5a8dc09425e0 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] HTTP exception thrown: Instance 5977951e-84f3-4f6b-b86f-44853cc1bc60 could not be found. Sep 23 04:46:27.182595 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f984682e-0987-42a2-a11d-5a8dc09425e0 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Request method failure captured: Sep 23 04:46:27.182595 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/5977951e-84f3-4f6b-b86f-44853cc1bc60 HTTP/1.1 Sep 23 04:46:27.182595 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:46:27.182595 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:46:27.182595 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:46:27.182595 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:46:27.182595 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:46:27.182595 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:46:27.182595 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:46:27.182595 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:46:27.182595 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTlTlFK_k4e3BWkoqwVigfjvHO2lVSTsmHRT7EhNgH87mj-DVuWXCq-NRLrmXyv4E_e0wXdkZnDmOQ4aUkRrz7wPxuRsMdZHh23aH7xyd0PRdo29c8XIic0D4fdht4KBWWMxFeNNSWWMe-xxhvPgOUVxbcTbEXPF75Q0c4Y9h1Ew0hk Sep 23 04:46:27.182595 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:46:27.182595 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:46:27.182595 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:46:27.182595 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:46:27.182595 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:46:27.182595 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:46:27.182595 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: c23bd5a8b84942898a99930b2bc0ca12 Sep 23 04:46:27.182595 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ServersTestJSON-1923416422 Sep 23 04:46:27.182595 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:46:27.182595 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:46:27.182595 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c23bd5a8b84942898a99930b2bc0ca12", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c23bd5a8b84942898a99930b2bc0ca12"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c23bd5a8b84942898a99930b2bc0ca12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c23bd5a8b84942898a99930b2bc0ca12"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:46:27.182595 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ServersTestJSON-1923416422 Sep 23 04:46:27.182595 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: c23bd5a8b84942898a99930b2bc0ca12 Sep 23 04:46:27.182595 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ServersTestJSON-1923416422 Sep 23 04:46:27.182595 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ServersTestJSON-1923416422-project Sep 23 04:46:27.182595 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:46:27.182595 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:46:27.182595 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 252c87e244984f71ae0907ee769bec05 Sep 23 04:46:27.182595 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ServersTestJSON-1923416422-project Sep 23 04:46:27.182595 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:46:27.182595 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 5977951e-84f3-4f6b-b86f-44853cc1bc60 could not be found. Sep 23 04:46:27.182595 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '5977951e-84f3-4f6b-b86f-44853cc1bc60'} Sep 23 04:46:27.182595 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:46:27.182595 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:46:27.182595 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:46:27.182595 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:46:27.182595 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:46:27.182595 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:46:27.182595 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:46:27.182595 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:46:27.182595 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:46:27.182595 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:46:27.182595 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5977951e-84f3-4f6b-b86f-44853cc1bc60 could not be found. Sep 23 04:46:27.182595 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:46:27.182595 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:46:27.182595 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:46:27.182595 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:46:27.182595 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:46:27.182595 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:46:27.182595 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:46:27.182595 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:46:27.182595 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:46:27.182595 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:46:27.182595 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:46:27.182595 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:46:27.182595 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:46:27.182595 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:46:27.182595 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:46:27.182595 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:46:27.182595 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5977951e-84f3-4f6b-b86f-44853cc1bc60 could not be found. Sep 23 04:46:27.182595 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:46:27.182595 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:46:27.182595 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:46:27.188795 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:46:27.188795 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:46:27.188795 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:46:27.188795 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:46:27.188795 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:46:27.188795 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5977951e-84f3-4f6b-b86f-44853cc1bc60 could not be found. Sep 23 04:46:27.188795 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:46:27.200446 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f984682e-0987-42a2-a11d-5a8dc09425e0 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Returning 404 to user: Instance 5977951e-84f3-4f6b-b86f-44853cc1bc60 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:46:27.201848 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f984682e-0987-42a2-a11d-5a8dc09425e0 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/5977951e-84f3-4f6b-b86f-44853cc1bc60" status: 404 len: 111 microversion: 2.1 time: 0.052976 Sep 23 04:46:27.214216 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1751/3453] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:27 2022] GET /compute/v2.1/servers/5977951e-84f3-4f6b-b86f-44853cc1bc60 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:46:27.353104 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b360f5c3-acca-4206-ac69-92d33d55564a tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-472785964", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "networks": [{"uuid": "e70e4da0-3337-4af1-b4df-8067d676f5e8"}]}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:46:27.356775 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-4200294b-a24e-4f63-bfca-004eb575ef86 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Flavor limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:46:27.357789 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-4200294b-a24e-4f63-bfca-004eb575ef86 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Image limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:46:27.358521 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-4200294b-a24e-4f63-bfca-004eb575ef86 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Flavor pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:46:27.358933 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-4200294b-a24e-4f63-bfca-004eb575ef86 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Image pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:46:27.359600 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-4200294b-a24e-4f63-bfca-004eb575ef86 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:46:27.368763 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4200294b-a24e-4f63-bfca-004eb575ef86 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:27.369537 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4200294b-a24e-4f63-bfca-004eb575ef86 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:27.370291 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4200294b-a24e-4f63-bfca-004eb575ef86 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:27.371313 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4200294b-a24e-4f63-bfca-004eb575ef86 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:27.372519 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4200294b-a24e-4f63-bfca-004eb575ef86 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:27.373347 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4200294b-a24e-4f63-bfca-004eb575ef86 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:27.397790 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-4200294b-a24e-4f63-bfca-004eb575ef86 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Getting quotas for project 1dcca3b014be4e98b7db17bb37d073a0. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:46:27.403968 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-4200294b-a24e-4f63-bfca-004eb575ef86 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Getting quotas for user ff662b5d5b9e488d906565b490c8acf6 and project 1dcca3b014be4e98b7db17bb37d073a0. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:46:27.421482 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4200294b-a24e-4f63-bfca-004eb575ef86 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Going to run 1 instances... {{(pid=122698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:46:27.423559 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.neutron [None req-b360f5c3-acca-4206-ac69-92d33d55564a tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] validate_networks() for [('e70e4da0-3337-4af1-b4df-8067d676f5e8', None, None, None, None, None)] {{(pid=122699) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:46:27.424517 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4200294b-a24e-4f63-bfca-004eb575ef86 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] [instance: 401339a4-8674-4ff9-b09e-ba748f46928d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:46:27.511100 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:DELETE=1,nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=5 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:46:27.614718 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4200294b-a24e-4f63-bfca-004eb575ef86 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.557654 Sep 23 04:46:27.617556 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1703/3454] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:46:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1560 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:46:27.634168 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9d48cc0c-becb-4346-ad26-a25f02dc0f43 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:27.634168 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-9d48cc0c-becb-4346-ad26-a25f02dc0f43 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] [instance: 0fff1fd4-972c-4268-89fd-92b784244edf] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:27.650366 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9d48cc0c-becb-4346-ad26-a25f02dc0f43 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:27.667592 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9d48cc0c-becb-4346-ad26-a25f02dc0f43 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:27.667592 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9d48cc0c-becb-4346-ad26-a25f02dc0f43 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:27.667592 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9d48cc0c-becb-4346-ad26-a25f02dc0f43 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:27.674424 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9d48cc0c-becb-4346-ad26-a25f02dc0f43 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:27.675003 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9d48cc0c-becb-4346-ad26-a25f02dc0f43 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:28.639521 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-9d48cc0c-becb-4346-ad26-a25f02dc0f43 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11980041918484990dac709544d0b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c43f2b70bc74a48b62fb4115337f073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:28.657994 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9d48cc0c-becb-4346-ad26-a25f02dc0f43 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/servers/0fff1fd4-972c-4268-89fd-92b784244edf" status: 200 len: 1307 microversion: 2.1 time: 1.035217 Sep 23 04:46:28.673105 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1704/3455] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:27 2022] GET /compute/v2.1/servers/0fff1fd4-972c-4268-89fd-92b784244edf => generated 1307 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:28.692088 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-712bee5c-75a7-4206-9598-5b40e4ef427c tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:28.693735 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-712bee5c-75a7-4206-9598-5b40e4ef427c tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: 9763a452-dc3c-436d-bee4-a3967af3bcbb] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:28.711719 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-712bee5c-75a7-4206-9598-5b40e4ef427c tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:28.712479 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-712bee5c-75a7-4206-9598-5b40e4ef427c tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:28.714696 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-712bee5c-75a7-4206-9598-5b40e4ef427c tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:28.717541 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-712bee5c-75a7-4206-9598-5b40e4ef427c tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:28.718113 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-712bee5c-75a7-4206-9598-5b40e4ef427c tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:28.718572 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-712bee5c-75a7-4206-9598-5b40e4ef427c tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:29.167398 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-712bee5c-75a7-4206-9598-5b40e4ef427c tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c786bbedc21849ea92924139a44707b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcafb05f6f554e278cd552023947c6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:29.180120 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-712bee5c-75a7-4206-9598-5b40e4ef427c tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/9763a452-dc3c-436d-bee4-a3967af3bcbb" status: 200 len: 1520 microversion: 2.1 time: 0.516498 Sep 23 04:46:29.182185 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1705/3456] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:28 2022] GET /compute/v2.1/servers/9763a452-dc3c-436d-bee4-a3967af3bcbb => generated 1520 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:29.188194 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3b67a874-77d8-4cbe-8fd6-5f2e125c774e tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1825582801", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:46:29.250253 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.network.neutron [None req-3b67a874-77d8-4cbe-8fd6-5f2e125c774e tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] validate_networks() for None {{(pid=122698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:46:29.521351 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-b360f5c3-acca-4206-ac69-92d33d55564a tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Flavor limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:46:29.521870 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-b360f5c3-acca-4206-ac69-92d33d55564a tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Image limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:46:29.523063 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-b360f5c3-acca-4206-ac69-92d33d55564a tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Flavor pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:46:29.523515 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-b360f5c3-acca-4206-ac69-92d33d55564a tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Image pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:46:29.523940 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-b360f5c3-acca-4206-ac69-92d33d55564a tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:46:29.539917 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b360f5c3-acca-4206-ac69-92d33d55564a tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:29.540424 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b360f5c3-acca-4206-ac69-92d33d55564a tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:29.541722 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b360f5c3-acca-4206-ac69-92d33d55564a tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:29.544480 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b360f5c3-acca-4206-ac69-92d33d55564a tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:29.545046 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b360f5c3-acca-4206-ac69-92d33d55564a tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:29.545779 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b360f5c3-acca-4206-ac69-92d33d55564a tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:29.576219 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-b360f5c3-acca-4206-ac69-92d33d55564a tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Getting quotas for project c23bd5a8b84942898a99930b2bc0ca12. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:46:29.583254 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-b360f5c3-acca-4206-ac69-92d33d55564a tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Getting quotas for user 252c87e244984f71ae0907ee769bec05 and project c23bd5a8b84942898a99930b2bc0ca12. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:46:29.600979 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b360f5c3-acca-4206-ac69-92d33d55564a tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Going to run 1 instances... {{(pid=122699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:46:29.603695 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b360f5c3-acca-4206-ac69-92d33d55564a tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 28be637b-c43c-4881-b2ce-efb1ec1ad812] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:46:29.825439 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b360f5c3-acca-4206-ac69-92d33d55564a tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.473994 Sep 23 04:46:29.828963 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1752/3457] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:46:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 2481 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:46:29.852375 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-087ed0b9-0a43-4590-a5e1-d6e7af2775b2 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:29.858412 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-087ed0b9-0a43-4590-a5e1-d6e7af2775b2 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] [instance: 0fff1fd4-972c-4268-89fd-92b784244edf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:29.862373 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-3b67a874-77d8-4cbe-8fd6-5f2e125c774e tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Flavor limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:46:29.862900 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-3b67a874-77d8-4cbe-8fd6-5f2e125c774e tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Image limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:46:29.863255 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-3b67a874-77d8-4cbe-8fd6-5f2e125c774e tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Flavor pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:46:29.864495 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-3b67a874-77d8-4cbe-8fd6-5f2e125c774e tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Image pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:46:29.864920 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-3b67a874-77d8-4cbe-8fd6-5f2e125c774e tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:46:29.868035 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-087ed0b9-0a43-4590-a5e1-d6e7af2775b2 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:29.868804 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-087ed0b9-0a43-4590-a5e1-d6e7af2775b2 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:29.870019 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-087ed0b9-0a43-4590-a5e1-d6e7af2775b2 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:29.870950 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-087ed0b9-0a43-4590-a5e1-d6e7af2775b2 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:29.871662 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-087ed0b9-0a43-4590-a5e1-d6e7af2775b2 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:29.872321 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-087ed0b9-0a43-4590-a5e1-d6e7af2775b2 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:29.881274 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3b67a874-77d8-4cbe-8fd6-5f2e125c774e tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:29.882070 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3b67a874-77d8-4cbe-8fd6-5f2e125c774e tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:29.887451 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3b67a874-77d8-4cbe-8fd6-5f2e125c774e tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:29.888493 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3b67a874-77d8-4cbe-8fd6-5f2e125c774e tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:29.889139 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3b67a874-77d8-4cbe-8fd6-5f2e125c774e tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:29.889752 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3b67a874-77d8-4cbe-8fd6-5f2e125c774e tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:29.943478 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-3b67a874-77d8-4cbe-8fd6-5f2e125c774e tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Getting quotas for project 1dcca3b014be4e98b7db17bb37d073a0. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:46:29.956169 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-3b67a874-77d8-4cbe-8fd6-5f2e125c774e tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Getting quotas for user ff662b5d5b9e488d906565b490c8acf6 and project 1dcca3b014be4e98b7db17bb37d073a0. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:46:29.983211 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3b67a874-77d8-4cbe-8fd6-5f2e125c774e tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Going to run 1 instances... {{(pid=122698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:46:29.985447 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3b67a874-77d8-4cbe-8fd6-5f2e125c774e tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] [instance: a0eac077-d4bd-4e4a-a04a-3f86aeeed9bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:46:30.187388 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3b67a874-77d8-4cbe-8fd6-5f2e125c774e tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.003496 Sep 23 04:46:30.193671 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1706/3458] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:46:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1005 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:46:30.206896 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9cec7036-7430-4360-920f-fd287be4d3fa tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:30.207846 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-9cec7036-7430-4360-920f-fd287be4d3fa tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 28be637b-c43c-4881-b2ce-efb1ec1ad812] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:30.287577 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-087ed0b9-0a43-4590-a5e1-d6e7af2775b2 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11980041918484990dac709544d0b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c43f2b70bc74a48b62fb4115337f073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:30.299055 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-087ed0b9-0a43-4590-a5e1-d6e7af2775b2 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/servers/0fff1fd4-972c-4268-89fd-92b784244edf" status: 200 len: 1307 microversion: 2.1 time: 0.468680 Sep 23 04:46:30.299743 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1753/3459] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:29 2022] GET /compute/v2.1/servers/0fff1fd4-972c-4268-89fd-92b784244edf => generated 1307 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:30.314548 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-97098dd1-7b12-4ac1-a473-7b0cd032d63c req-45ab5c40-6e2c-4d17-9528-4aab27c7991b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fff1fd4-972c-4268-89fd-92b784244edf", "name": "network-vif-plugged", "status": "completed", "tag": "1b7def80-2c6f-4b50-8986-20b3ff92ff59"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:46:30.336433 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-97098dd1-7b12-4ac1-a473-7b0cd032d63c req-45ab5c40-6e2c-4d17-9528-4aab27c7991b service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:30.337221 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-97098dd1-7b12-4ac1-a473-7b0cd032d63c req-45ab5c40-6e2c-4d17-9528-4aab27c7991b service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:30.337766 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-97098dd1-7b12-4ac1-a473-7b0cd032d63c req-45ab5c40-6e2c-4d17-9528-4aab27c7991b service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:30.378248 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-9cec7036-7430-4360-920f-fd287be4d3fa tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:30.381202 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-97098dd1-7b12-4ac1-a473-7b0cd032d63c req-45ab5c40-6e2c-4d17-9528-4aab27c7991b service nova] Creating event network-vif-plugged:1b7def80-2c6f-4b50-8986-20b3ff92ff59 for instance 0fff1fd4-972c-4268-89fd-92b784244edf on n-h2-846463-3 Sep 23 04:46:30.403419 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-97098dd1-7b12-4ac1-a473-7b0cd032d63c req-45ab5c40-6e2c-4d17-9528-4aab27c7991b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091296 Sep 23 04:46:30.406259 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1754/3460] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:46:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:46:30.413988 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-99d28c77-1dfe-4840-a0c7-c9d1826c72e8 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:30.414706 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-99d28c77-1dfe-4840-a0c7-c9d1826c72e8 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] [instance: a0eac077-d4bd-4e4a-a04a-3f86aeeed9bd] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:30.442846 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9cec7036-7430-4360-920f-fd287be4d3fa tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/28be637b-c43c-4881-b2ce-efb1ec1ad812" status: 200 len: 1208 microversion: 2.1 time: 0.251590 Sep 23 04:46:30.445089 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1707/3461] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:30 2022] GET /compute/v2.1/servers/28be637b-c43c-4881-b2ce-efb1ec1ad812 => generated 1208 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:30.475740 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-54b5f443-bd80-4113-84c7-d7fb871e2fda tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:30.480001 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-54b5f443-bd80-4113-84c7-d7fb871e2fda tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: 9763a452-dc3c-436d-bee4-a3967af3bcbb] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:30.517104 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-54b5f443-bd80-4113-84c7-d7fb871e2fda tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:30.520539 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-54b5f443-bd80-4113-84c7-d7fb871e2fda tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:30.524511 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-54b5f443-bd80-4113-84c7-d7fb871e2fda tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:30.529358 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-54b5f443-bd80-4113-84c7-d7fb871e2fda tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:30.531364 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-54b5f443-bd80-4113-84c7-d7fb871e2fda tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:30.532038 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-54b5f443-bd80-4113-84c7-d7fb871e2fda tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:30.601478 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-99d28c77-1dfe-4840-a0c7-c9d1826c72e8 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff662b5d5b9e488d906565b490c8acf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dcca3b014be4e98b7db17bb37d073a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:30.607890 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-99d28c77-1dfe-4840-a0c7-c9d1826c72e8 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "GET /compute/v2.1/servers/a0eac077-d4bd-4e4a-a04a-3f86aeeed9bd" status: 200 len: 1218 microversion: 2.1 time: 0.200331 Sep 23 04:46:30.608460 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1755/3462] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:30 2022] GET /compute/v2.1/servers/a0eac077-d4bd-4e4a-a04a-3f86aeeed9bd => generated 1218 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:31.105103 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-54b5f443-bd80-4113-84c7-d7fb871e2fda tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c786bbedc21849ea92924139a44707b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcafb05f6f554e278cd552023947c6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:31.122719 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-54b5f443-bd80-4113-84c7-d7fb871e2fda tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/9763a452-dc3c-436d-bee4-a3967af3bcbb" status: 200 len: 1520 microversion: 2.1 time: 0.676486 Sep 23 04:46:31.123611 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1708/3463] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:30 2022] GET /compute/v2.1/servers/9763a452-dc3c-436d-bee4-a3967af3bcbb => generated 1520 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:31.327825 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c6b232d0-d5e5-4d64-b758-b3ef67527755 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:31.328443 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c6b232d0-d5e5-4d64-b758-b3ef67527755 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] [instance: 0fff1fd4-972c-4268-89fd-92b784244edf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:31.348156 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c6b232d0-d5e5-4d64-b758-b3ef67527755 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:31.348870 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c6b232d0-d5e5-4d64-b758-b3ef67527755 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:31.349487 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c6b232d0-d5e5-4d64-b758-b3ef67527755 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:31.350418 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c6b232d0-d5e5-4d64-b758-b3ef67527755 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:31.351048 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c6b232d0-d5e5-4d64-b758-b3ef67527755 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:31.351667 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c6b232d0-d5e5-4d64-b758-b3ef67527755 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:31.473494 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-627422b0-2a91-41c8-b732-d144bea03139 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:31.474582 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-627422b0-2a91-41c8-b732-d144bea03139 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 28be637b-c43c-4881-b2ce-efb1ec1ad812] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:31.493714 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-627422b0-2a91-41c8-b732-d144bea03139 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:31.510062 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-627422b0-2a91-41c8-b732-d144bea03139 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:31.511043 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-627422b0-2a91-41c8-b732-d144bea03139 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:31.515784 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-627422b0-2a91-41c8-b732-d144bea03139 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:31.536189 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-627422b0-2a91-41c8-b732-d144bea03139 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:31.537673 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-627422b0-2a91-41c8-b732-d144bea03139 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:31.961741 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-627422b0-2a91-41c8-b732-d144bea03139 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:31.988769 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-627422b0-2a91-41c8-b732-d144bea03139 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/28be637b-c43c-4881-b2ce-efb1ec1ad812" status: 200 len: 1212 microversion: 2.1 time: 0.520145 Sep 23 04:46:31.989375 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1709/3464] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:31 2022] GET /compute/v2.1/servers/28be637b-c43c-4881-b2ce-efb1ec1ad812 => generated 1212 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:46:32.003880 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c42e816b-fd2e-4b38-9e2d-4ba45b6c24f6 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:32.006120 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c42e816b-fd2e-4b38-9e2d-4ba45b6c24f6 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] [instance: a0eac077-d4bd-4e4a-a04a-3f86aeeed9bd] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:32.025821 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c42e816b-fd2e-4b38-9e2d-4ba45b6c24f6 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:32.026464 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c42e816b-fd2e-4b38-9e2d-4ba45b6c24f6 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:32.026986 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c42e816b-fd2e-4b38-9e2d-4ba45b6c24f6 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:32.028323 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c42e816b-fd2e-4b38-9e2d-4ba45b6c24f6 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:32.030458 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c42e816b-fd2e-4b38-9e2d-4ba45b6c24f6 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:32.031078 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c42e816b-fd2e-4b38-9e2d-4ba45b6c24f6 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:32.228428 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c42e816b-fd2e-4b38-9e2d-4ba45b6c24f6 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff662b5d5b9e488d906565b490c8acf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dcca3b014be4e98b7db17bb37d073a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:32.258823 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c42e816b-fd2e-4b38-9e2d-4ba45b6c24f6 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "GET /compute/v2.1/servers/a0eac077-d4bd-4e4a-a04a-3f86aeeed9bd" status: 200 len: 1222 microversion: 2.1 time: 0.263590 Sep 23 04:46:32.259677 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1710/3465] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:31 2022] GET /compute/v2.1/servers/a0eac077-d4bd-4e4a-a04a-3f86aeeed9bd => generated 1222 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:32.275452 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3870ad9f-7f9f-4ffd-94ce-a47ed6e564ef tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:32.280033 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3870ad9f-7f9f-4ffd-94ce-a47ed6e564ef tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: 9763a452-dc3c-436d-bee4-a3967af3bcbb] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:32.294058 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3870ad9f-7f9f-4ffd-94ce-a47ed6e564ef tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:32.294879 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3870ad9f-7f9f-4ffd-94ce-a47ed6e564ef tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:32.296107 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3870ad9f-7f9f-4ffd-94ce-a47ed6e564ef tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:32.297010 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3870ad9f-7f9f-4ffd-94ce-a47ed6e564ef tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:32.297919 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3870ad9f-7f9f-4ffd-94ce-a47ed6e564ef tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:32.301365 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3870ad9f-7f9f-4ffd-94ce-a47ed6e564ef tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:32.457472 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c6b232d0-d5e5-4d64-b758-b3ef67527755 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11980041918484990dac709544d0b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c43f2b70bc74a48b62fb4115337f073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:32.473550 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c6b232d0-d5e5-4d64-b758-b3ef67527755 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/servers/0fff1fd4-972c-4268-89fd-92b784244edf" status: 200 len: 1307 microversion: 2.1 time: 1.148258 Sep 23 04:46:32.492267 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1756/3466] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:31 2022] GET /compute/v2.1/servers/0fff1fd4-972c-4268-89fd-92b784244edf => generated 1307 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:32.764095 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-3870ad9f-7f9f-4ffd-94ce-a47ed6e564ef tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c786bbedc21849ea92924139a44707b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcafb05f6f554e278cd552023947c6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:32.776362 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3870ad9f-7f9f-4ffd-94ce-a47ed6e564ef tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/9763a452-dc3c-436d-bee4-a3967af3bcbb" status: 200 len: 1520 microversion: 2.1 time: 0.515199 Sep 23 04:46:32.777934 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1711/3467] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:32 2022] GET /compute/v2.1/servers/9763a452-dc3c-436d-bee4-a3967af3bcbb => generated 1520 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:33.022282 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-fbffc2c0-2218-422d-8f75-af97b4d26698 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:33.022282 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-fbffc2c0-2218-422d-8f75-af97b4d26698 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 28be637b-c43c-4881-b2ce-efb1ec1ad812] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:33.027014 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:46:33.044210 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fbffc2c0-2218-422d-8f75-af97b4d26698 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:33.044744 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fbffc2c0-2218-422d-8f75-af97b4d26698 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:33.050238 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fbffc2c0-2218-422d-8f75-af97b4d26698 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:33.050238 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fbffc2c0-2218-422d-8f75-af97b4d26698 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:33.050238 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fbffc2c0-2218-422d-8f75-af97b4d26698 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:33.050238 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fbffc2c0-2218-422d-8f75-af97b4d26698 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:33.286760 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-bd6fcd29-1417-4317-ab9f-6422865778cc tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:33.288410 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-bd6fcd29-1417-4317-ab9f-6422865778cc tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] [instance: a0eac077-d4bd-4e4a-a04a-3f86aeeed9bd] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:33.299377 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bd6fcd29-1417-4317-ab9f-6422865778cc tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:33.310098 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bd6fcd29-1417-4317-ab9f-6422865778cc tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:33.310852 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bd6fcd29-1417-4317-ab9f-6422865778cc tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:33.311832 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bd6fcd29-1417-4317-ab9f-6422865778cc tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:33.314409 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bd6fcd29-1417-4317-ab9f-6422865778cc tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:33.314884 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bd6fcd29-1417-4317-ab9f-6422865778cc tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:33.331781 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-fbffc2c0-2218-422d-8f75-af97b4d26698 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:33.341940 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-fbffc2c0-2218-422d-8f75-af97b4d26698 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/28be637b-c43c-4881-b2ce-efb1ec1ad812" status: 200 len: 1268 microversion: 2.1 time: 0.333894 Sep 23 04:46:33.342540 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1757/3468] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:33 2022] GET /compute/v2.1/servers/28be637b-c43c-4881-b2ce-efb1ec1ad812 => generated 1268 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:33.479921 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-bd6fcd29-1417-4317-ab9f-6422865778cc tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff662b5d5b9e488d906565b490c8acf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dcca3b014be4e98b7db17bb37d073a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:33.495331 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9a3c288d-c372-4474-9116-edb3e8d62f06 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:33.496886 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-9a3c288d-c372-4474-9116-edb3e8d62f06 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] [instance: 0fff1fd4-972c-4268-89fd-92b784244edf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:33.501608 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-bd6fcd29-1417-4317-ab9f-6422865778cc tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "GET /compute/v2.1/servers/a0eac077-d4bd-4e4a-a04a-3f86aeeed9bd" status: 200 len: 1270 microversion: 2.1 time: 0.218673 Sep 23 04:46:33.504925 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1712/3469] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:33 2022] GET /compute/v2.1/servers/a0eac077-d4bd-4e4a-a04a-3f86aeeed9bd => generated 1270 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:46:33.513003 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9a3c288d-c372-4474-9116-edb3e8d62f06 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:33.514948 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9a3c288d-c372-4474-9116-edb3e8d62f06 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:33.519144 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9a3c288d-c372-4474-9116-edb3e8d62f06 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:33.520225 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9a3c288d-c372-4474-9116-edb3e8d62f06 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:33.520795 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9a3c288d-c372-4474-9116-edb3e8d62f06 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:33.523577 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9a3c288d-c372-4474-9116-edb3e8d62f06 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:33.803510 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6e2453c5-d237-44b8-81ea-f982086347e5 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:33.804133 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-6e2453c5-d237-44b8-81ea-f982086347e5 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: 9763a452-dc3c-436d-bee4-a3967af3bcbb] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:33.822487 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6e2453c5-d237-44b8-81ea-f982086347e5 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:33.828113 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6e2453c5-d237-44b8-81ea-f982086347e5 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:33.829322 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6e2453c5-d237-44b8-81ea-f982086347e5 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:33.834181 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6e2453c5-d237-44b8-81ea-f982086347e5 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:33.854371 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6e2453c5-d237-44b8-81ea-f982086347e5 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:33.858703 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6e2453c5-d237-44b8-81ea-f982086347e5 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:33.927384 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-9a3c288d-c372-4474-9116-edb3e8d62f06 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11980041918484990dac709544d0b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c43f2b70bc74a48b62fb4115337f073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:33.939623 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-9a3c288d-c372-4474-9116-edb3e8d62f06 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/servers/0fff1fd4-972c-4268-89fd-92b784244edf" status: 200 len: 1487 microversion: 2.1 time: 0.447821 Sep 23 04:46:33.942228 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1758/3470] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:33 2022] GET /compute/v2.1/servers/0fff1fd4-972c-4268-89fd-92b784244edf => generated 1487 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:33.970295 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-343879b1-ae83-40d4-b0b6-e819bebc527b tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:46:33.970295 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-343879b1-ae83-40d4-b0b6-e819bebc527b tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] [instance: 0fff1fd4-972c-4268-89fd-92b784244edf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:33.982149 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-343879b1-ae83-40d4-b0b6-e819bebc527b tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:33.982661 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-343879b1-ae83-40d4-b0b6-e819bebc527b tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:33.983437 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-343879b1-ae83-40d4-b0b6-e819bebc527b tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:33.983816 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-343879b1-ae83-40d4-b0b6-e819bebc527b tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:33.984279 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-343879b1-ae83-40d4-b0b6-e819bebc527b tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:33.985101 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-343879b1-ae83-40d4-b0b6-e819bebc527b tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:34.066704 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-343879b1-ae83-40d4-b0b6-e819bebc527b tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lazy-loading 'flavor' on Instance uuid 0fff1fd4-972c-4268-89fd-92b784244edf {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:46:34.459759 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6e2453c5-d237-44b8-81ea-f982086347e5 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c786bbedc21849ea92924139a44707b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcafb05f6f554e278cd552023947c6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:34.474467 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-6e2453c5-d237-44b8-81ea-f982086347e5 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/9763a452-dc3c-436d-bee4-a3967af3bcbb" status: 200 len: 1520 microversion: 2.1 time: 0.672593 Sep 23 04:46:34.474467 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1713/3471] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:33 2022] GET /compute/v2.1/servers/9763a452-dc3c-436d-bee4-a3967af3bcbb => generated 1520 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:34.484756 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e8769c8f-e1a5-4f7d-82d1-1f8156660a86 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:34.487955 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e8769c8f-e1a5-4f7d-82d1-1f8156660a86 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 28be637b-c43c-4881-b2ce-efb1ec1ad812] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:34.507764 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e8769c8f-e1a5-4f7d-82d1-1f8156660a86 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:34.516159 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e8769c8f-e1a5-4f7d-82d1-1f8156660a86 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:34.516308 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-343879b1-ae83-40d4-b0b6-e819bebc527b tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "POST /compute/v2.1/servers/0fff1fd4-972c-4268-89fd-92b784244edf/action" status: 202 len: 0 microversion: 2.1 time: 0.546196 Sep 23 04:46:34.516764 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e8769c8f-e1a5-4f7d-82d1-1f8156660a86 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:34.516858 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1759/3472] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:46:33 2022] POST /compute/v2.1/servers/0fff1fd4-972c-4268-89fd-92b784244edf/action => generated 0 bytes in 548 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 23 04:46:34.516956 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e8769c8f-e1a5-4f7d-82d1-1f8156660a86 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:34.516956 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e8769c8f-e1a5-4f7d-82d1-1f8156660a86 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:34.516956 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e8769c8f-e1a5-4f7d-82d1-1f8156660a86 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:34.526314 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d01e826c-f6b1-425c-8572-c0545d094421 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:34.531733 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d01e826c-f6b1-425c-8572-c0545d094421 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] [instance: 0fff1fd4-972c-4268-89fd-92b784244edf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:34.558094 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d01e826c-f6b1-425c-8572-c0545d094421 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:34.562017 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d01e826c-f6b1-425c-8572-c0545d094421 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:34.562017 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d01e826c-f6b1-425c-8572-c0545d094421 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:34.563181 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d01e826c-f6b1-425c-8572-c0545d094421 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:34.567028 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d01e826c-f6b1-425c-8572-c0545d094421 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:34.567784 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d01e826c-f6b1-425c-8572-c0545d094421 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:34.875218 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e8769c8f-e1a5-4f7d-82d1-1f8156660a86 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:34.884612 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e8769c8f-e1a5-4f7d-82d1-1f8156660a86 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/28be637b-c43c-4881-b2ce-efb1ec1ad812" status: 200 len: 1266 microversion: 2.1 time: 0.408025 Sep 23 04:46:34.898413 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1714/3473] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:34 2022] GET /compute/v2.1/servers/28be637b-c43c-4881-b2ce-efb1ec1ad812 => generated 1266 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:34.906215 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c4cb12f0-fc9b-4079-b544-d55fa69986f8 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:34.907073 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c4cb12f0-fc9b-4079-b544-d55fa69986f8 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] [instance: a0eac077-d4bd-4e4a-a04a-3f86aeeed9bd] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:34.913281 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c4cb12f0-fc9b-4079-b544-d55fa69986f8 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:34.914021 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c4cb12f0-fc9b-4079-b544-d55fa69986f8 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:34.914676 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c4cb12f0-fc9b-4079-b544-d55fa69986f8 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:34.915555 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c4cb12f0-fc9b-4079-b544-d55fa69986f8 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:34.916180 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c4cb12f0-fc9b-4079-b544-d55fa69986f8 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:34.916893 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c4cb12f0-fc9b-4079-b544-d55fa69986f8 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:35.081056 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c4cb12f0-fc9b-4079-b544-d55fa69986f8 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff662b5d5b9e488d906565b490c8acf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dcca3b014be4e98b7db17bb37d073a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:35.098613 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c4cb12f0-fc9b-4079-b544-d55fa69986f8 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "GET /compute/v2.1/servers/a0eac077-d4bd-4e4a-a04a-3f86aeeed9bd" status: 200 len: 1276 microversion: 2.1 time: 0.198935 Sep 23 04:46:35.099671 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1715/3474] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:34 2022] GET /compute/v2.1/servers/a0eac077-d4bd-4e4a-a04a-3f86aeeed9bd => generated 1276 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:35.221792 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d01e826c-f6b1-425c-8572-c0545d094421 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11980041918484990dac709544d0b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c43f2b70bc74a48b62fb4115337f073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:35.235398 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d01e826c-f6b1-425c-8572-c0545d094421 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/servers/0fff1fd4-972c-4268-89fd-92b784244edf" status: 200 len: 1495 microversion: 2.1 time: 0.715827 Sep 23 04:46:35.241123 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1760/3475] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:34 2022] GET /compute/v2.1/servers/0fff1fd4-972c-4268-89fd-92b784244edf => generated 1495 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:35.496343 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-00f748f6-b6e6-40a8-a513-331b4bd02529 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:35.497712 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-00f748f6-b6e6-40a8-a513-331b4bd02529 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: 9763a452-dc3c-436d-bee4-a3967af3bcbb] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:35.511696 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-00f748f6-b6e6-40a8-a513-331b4bd02529 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:35.517558 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-00f748f6-b6e6-40a8-a513-331b4bd02529 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:35.519233 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-00f748f6-b6e6-40a8-a513-331b4bd02529 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:35.523901 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-00f748f6-b6e6-40a8-a513-331b4bd02529 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:35.525570 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-00f748f6-b6e6-40a8-a513-331b4bd02529 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:35.526303 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-00f748f6-b6e6-40a8-a513-331b4bd02529 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:35.911966 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9dedfcb3-74cc-4a63-9006-ad9824a9debd tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:35.913333 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-9dedfcb3-74cc-4a63-9006-ad9824a9debd tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 28be637b-c43c-4881-b2ce-efb1ec1ad812] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:35.923016 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9dedfcb3-74cc-4a63-9006-ad9824a9debd tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:35.923784 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9dedfcb3-74cc-4a63-9006-ad9824a9debd tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:35.924471 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9dedfcb3-74cc-4a63-9006-ad9824a9debd tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:35.925447 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9dedfcb3-74cc-4a63-9006-ad9824a9debd tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:35.926331 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9dedfcb3-74cc-4a63-9006-ad9824a9debd tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:35.926999 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9dedfcb3-74cc-4a63-9006-ad9824a9debd tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:36.790726 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-00f748f6-b6e6-40a8-a513-331b4bd02529 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c786bbedc21849ea92924139a44707b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcafb05f6f554e278cd552023947c6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:36.804556 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-00f748f6-b6e6-40a8-a513-331b4bd02529 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/9763a452-dc3c-436d-bee4-a3967af3bcbb" status: 200 len: 1520 microversion: 2.1 time: 1.313117 Sep 23 04:46:36.820927 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1716/3476] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:35 2022] GET /compute/v2.1/servers/9763a452-dc3c-436d-bee4-a3967af3bcbb => generated 1520 bytes in 1330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:36.827240 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ccb110b9-34af-46bd-87e6-09020f1bdae5 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:36.828160 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-ccb110b9-34af-46bd-87e6-09020f1bdae5 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] [instance: a0eac077-d4bd-4e4a-a04a-3f86aeeed9bd] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:36.835314 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ccb110b9-34af-46bd-87e6-09020f1bdae5 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:36.836083 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ccb110b9-34af-46bd-87e6-09020f1bdae5 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:36.836773 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ccb110b9-34af-46bd-87e6-09020f1bdae5 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:36.838128 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ccb110b9-34af-46bd-87e6-09020f1bdae5 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:36.838828 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ccb110b9-34af-46bd-87e6-09020f1bdae5 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:36.839480 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ccb110b9-34af-46bd-87e6-09020f1bdae5 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:37.009402 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ccb110b9-34af-46bd-87e6-09020f1bdae5 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff662b5d5b9e488d906565b490c8acf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dcca3b014be4e98b7db17bb37d073a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:37.027177 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:46:37.045730 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ccb110b9-34af-46bd-87e6-09020f1bdae5 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "GET /compute/v2.1/servers/a0eac077-d4bd-4e4a-a04a-3f86aeeed9bd" status: 200 len: 1276 microversion: 2.1 time: 0.222426 Sep 23 04:46:37.046694 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1717/3477] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:36 2022] GET /compute/v2.1/servers/a0eac077-d4bd-4e4a-a04a-3f86aeeed9bd => generated 1276 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:37.086061 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-9dedfcb3-74cc-4a63-9006-ad9824a9debd tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:37.095912 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-9dedfcb3-74cc-4a63-9006-ad9824a9debd tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/28be637b-c43c-4881-b2ce-efb1ec1ad812" status: 200 len: 1308 microversion: 2.1 time: 1.187735 Sep 23 04:46:37.102769 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1761/3478] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:35 2022] GET /compute/v2.1/servers/28be637b-c43c-4881-b2ce-efb1ec1ad812 => generated 1308 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:46:37.112953 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ab509ea0-8651-4aa4-8d63-e3aebeccef8d tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:37.115702 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ab509ea0-8651-4aa4-8d63-e3aebeccef8d tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] [instance: 0fff1fd4-972c-4268-89fd-92b784244edf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:37.128739 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ab509ea0-8651-4aa4-8d63-e3aebeccef8d tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:37.129620 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ab509ea0-8651-4aa4-8d63-e3aebeccef8d tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:37.130293 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ab509ea0-8651-4aa4-8d63-e3aebeccef8d tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:37.131201 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ab509ea0-8651-4aa4-8d63-e3aebeccef8d tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:37.131926 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ab509ea0-8651-4aa4-8d63-e3aebeccef8d tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:37.139418 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ab509ea0-8651-4aa4-8d63-e3aebeccef8d tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:37.429023 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-cd4e1b95-c61a-4db4-891b-3fe729fbc26a req-b0426720-8684-417b-a9f8-feb6091dbd95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "401339a4-8674-4ff9-b09e-ba748f46928d", "tag": "ee716fd2-ccf3-4c05-b155-29bb9a5565c2"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:46:37.454881 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-cd4e1b95-c61a-4db4-891b-3fe729fbc26a req-b0426720-8684-417b-a9f8-feb6091dbd95 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:37.458785 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-cd4e1b95-c61a-4db4-891b-3fe729fbc26a req-b0426720-8684-417b-a9f8-feb6091dbd95 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:37.460842 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-cd4e1b95-c61a-4db4-891b-3fe729fbc26a req-b0426720-8684-417b-a9f8-feb6091dbd95 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:37.486272 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-cd4e1b95-c61a-4db4-891b-3fe729fbc26a req-b0426720-8684-417b-a9f8-feb6091dbd95 service nova] Creating event network-changed:ee716fd2-ccf3-4c05-b155-29bb9a5565c2 for instance 401339a4-8674-4ff9-b09e-ba748f46928d on n-h1-846463-3 Sep 23 04:46:37.494064 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-cd4e1b95-c61a-4db4-891b-3fe729fbc26a req-b0426720-8684-417b-a9f8-feb6091dbd95 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.444281 Sep 23 04:46:37.495364 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1718/3479] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:46:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:46:37.830834 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f36efa0d-1bef-4f5e-8173-b068c0ba15f1 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:37.832859 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f36efa0d-1bef-4f5e-8173-b068c0ba15f1 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: 9763a452-dc3c-436d-bee4-a3967af3bcbb] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:37.838836 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ab509ea0-8651-4aa4-8d63-e3aebeccef8d tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11980041918484990dac709544d0b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c43f2b70bc74a48b62fb4115337f073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:37.854872 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f36efa0d-1bef-4f5e-8173-b068c0ba15f1 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:37.855505 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f36efa0d-1bef-4f5e-8173-b068c0ba15f1 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:37.856179 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f36efa0d-1bef-4f5e-8173-b068c0ba15f1 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:37.857007 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f36efa0d-1bef-4f5e-8173-b068c0ba15f1 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:37.859260 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f36efa0d-1bef-4f5e-8173-b068c0ba15f1 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:37.859953 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f36efa0d-1bef-4f5e-8173-b068c0ba15f1 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:37.918608 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ab509ea0-8651-4aa4-8d63-e3aebeccef8d tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/servers/0fff1fd4-972c-4268-89fd-92b784244edf" status: 200 len: 1478 microversion: 2.1 time: 0.813110 Sep 23 04:46:37.919189 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1762/3480] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:37 2022] GET /compute/v2.1/servers/0fff1fd4-972c-4268-89fd-92b784244edf => generated 1478 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:37.946996 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-10f4ea11-9051-40ef-b95f-9220600014da tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-2075472305"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:46:37.954864 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-10f4ea11-9051-40ef-b95f-9220600014da tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] [instance: 0fff1fd4-972c-4268-89fd-92b784244edf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:37.981598 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-10f4ea11-9051-40ef-b95f-9220600014da tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:37.982251 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-10f4ea11-9051-40ef-b95f-9220600014da tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:37.983131 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-10f4ea11-9051-40ef-b95f-9220600014da tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:37.985246 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-10f4ea11-9051-40ef-b95f-9220600014da tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:37.985722 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-10f4ea11-9051-40ef-b95f-9220600014da tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:37.987505 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-10f4ea11-9051-40ef-b95f-9220600014da tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:37.995718 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:46:38.633082 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f36efa0d-1bef-4f5e-8173-b068c0ba15f1 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c786bbedc21849ea92924139a44707b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcafb05f6f554e278cd552023947c6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:38.661325 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-10f4ea11-9051-40ef-b95f-9220600014da tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "POST /compute/v2.1/servers/0fff1fd4-972c-4268-89fd-92b784244edf/action" status: 202 len: 0 microversion: 2.1 time: 0.716980 Sep 23 04:46:38.669121 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f36efa0d-1bef-4f5e-8173-b068c0ba15f1 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/9763a452-dc3c-436d-bee4-a3967af3bcbb" status: 200 len: 1520 microversion: 2.1 time: 0.836823 Sep 23 04:46:38.672699 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1763/3481] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:46:37 2022] POST /compute/v2.1/servers/0fff1fd4-972c-4268-89fd-92b784244edf/action => generated 0 bytes in 730 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 23 04:46:38.680634 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1719/3482] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:37 2022] GET /compute/v2.1/servers/9763a452-dc3c-436d-bee4-a3967af3bcbb => generated 1520 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:46:38.688972 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-972868e1-cb98-402a-a852-db77c3e7e6fa tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:38.694492 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-96977666-d594-44e8-bea9-292d8a424784 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:38.695748 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-972868e1-cb98-402a-a852-db77c3e7e6fa tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] [instance: a0eac077-d4bd-4e4a-a04a-3f86aeeed9bd] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:38.697222 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-96977666-d594-44e8-bea9-292d8a424784 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 28be637b-c43c-4881-b2ce-efb1ec1ad812] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:38.724519 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-972868e1-cb98-402a-a852-db77c3e7e6fa tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:38.725033 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-972868e1-cb98-402a-a852-db77c3e7e6fa tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:38.725477 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-972868e1-cb98-402a-a852-db77c3e7e6fa tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:38.726234 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-972868e1-cb98-402a-a852-db77c3e7e6fa tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:38.726719 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-972868e1-cb98-402a-a852-db77c3e7e6fa tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:38.727140 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-972868e1-cb98-402a-a852-db77c3e7e6fa tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:38.731931 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-96977666-d594-44e8-bea9-292d8a424784 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:38.732101 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-96977666-d594-44e8-bea9-292d8a424784 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:38.732475 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-96977666-d594-44e8-bea9-292d8a424784 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:38.733196 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-96977666-d594-44e8-bea9-292d8a424784 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:38.733644 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-96977666-d594-44e8-bea9-292d8a424784 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:38.734284 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-96977666-d594-44e8-bea9-292d8a424784 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:39.563001 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:46:39.785838 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-972868e1-cb98-402a-a852-db77c3e7e6fa tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff662b5d5b9e488d906565b490c8acf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dcca3b014be4e98b7db17bb37d073a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:39.798174 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-972868e1-cb98-402a-a852-db77c3e7e6fa tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "GET /compute/v2.1/servers/a0eac077-d4bd-4e4a-a04a-3f86aeeed9bd" status: 200 len: 1318 microversion: 2.1 time: 1.120565 Sep 23 04:46:39.798174 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1764/3483] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:38 2022] GET /compute/v2.1/servers/a0eac077-d4bd-4e4a-a04a-3f86aeeed9bd => generated 1318 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:39.821391 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ceb10608-06cf-4fb8-bbd5-1895591b61aa tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '.version_select at 0x7ff1bb9ad3a0>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:39.900902 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ceb10608-06cf-4fb8-bbd5-1895591b61aa tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/images/5ca97cbe-84e0-43f6-8385-3c16932e4f48" status: 200 len: 1440 microversion: 2.1 time: 0.083925 Sep 23 04:46:39.910269 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1765/3484] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:46:39 2022] GET /compute/v2.1/images/5ca97cbe-84e0-43f6-8385-3c16932e4f48 => generated 1440 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:39.915274 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c4aaf75f-1e80-4e3d-af8e-37e8c6f47a31 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:39.915909 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c4aaf75f-1e80-4e3d-af8e-37e8c6f47a31 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: 9763a452-dc3c-436d-bee4-a3967af3bcbb] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:39.921506 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=4 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:46:39.939895 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c4aaf75f-1e80-4e3d-af8e-37e8c6f47a31 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:39.940420 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c4aaf75f-1e80-4e3d-af8e-37e8c6f47a31 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:39.940873 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c4aaf75f-1e80-4e3d-af8e-37e8c6f47a31 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:39.941593 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c4aaf75f-1e80-4e3d-af8e-37e8c6f47a31 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:39.942091 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c4aaf75f-1e80-4e3d-af8e-37e8c6f47a31 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:39.942526 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c4aaf75f-1e80-4e3d-af8e-37e8c6f47a31 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:40.180178 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-96977666-d594-44e8-bea9-292d8a424784 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:40.189236 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-96977666-d594-44e8-bea9-292d8a424784 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/28be637b-c43c-4881-b2ce-efb1ec1ad812" status: 200 len: 1308 microversion: 2.1 time: 1.507422 Sep 23 04:46:40.211147 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1720/3485] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:38 2022] GET /compute/v2.1/servers/28be637b-c43c-4881-b2ce-efb1ec1ad812 => generated 1308 bytes in 1530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:40.216122 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-63a48f6d-857f-49ae-9e01-e47d34cb84bc req-a7278137-05b1-4620-87f6-cd6ee688491c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28be637b-c43c-4881-b2ce-efb1ec1ad812", "tag": "5ab6e461-b84c-43e0-a5e3-b990d284d4a7"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:46:40.252189 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-63a48f6d-857f-49ae-9e01-e47d34cb84bc req-a7278137-05b1-4620-87f6-cd6ee688491c service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:40.253021 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-63a48f6d-857f-49ae-9e01-e47d34cb84bc req-a7278137-05b1-4620-87f6-cd6ee688491c service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:40.253690 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-63a48f6d-857f-49ae-9e01-e47d34cb84bc req-a7278137-05b1-4620-87f6-cd6ee688491c service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:40.277877 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-63a48f6d-857f-49ae-9e01-e47d34cb84bc req-a7278137-05b1-4620-87f6-cd6ee688491c service nova] Creating event network-changed:5ab6e461-b84c-43e0-a5e3-b990d284d4a7 for instance 28be637b-c43c-4881-b2ce-efb1ec1ad812 on n-h1-846463-3 Sep 23 04:46:40.284019 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-63a48f6d-857f-49ae-9e01-e47d34cb84bc req-a7278137-05b1-4620-87f6-cd6ee688491c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071435 Sep 23 04:46:40.285387 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1721/3486] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:46:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:46:40.409670 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7a9cd670-134c-4ecf-ac48-f803beb07dd8 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Action: 'create', calling method: .version_select at 0x7ff1ba8db550>, body: {"keypair": {"name": "tempest-keypair-941368436", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAHZW8wn+t5Kf9duGU/byxFLEHOk6gR+JrT3YGLISixs+qfVqHsfL/52h/5NsuvbhFT3nfDU/vGKcl0brt7MBZCRngAm8FllMVInj8OyCdF9Q0/g2R9mGxPwoR4mXv6zmg=="}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:46:40.425772 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=14 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:46:40.465630 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-7a9cd670-134c-4ecf-ac48-f803beb07dd8 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Getting quotas for project 1cdfe96be196470889a58b56a19743a7. Resources: {'key_pairs'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:46:40.504263 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-7a9cd670-134c-4ecf-ac48-f803beb07dd8 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Getting quotas for user b87ca7119ee042c3bda1e88ff38fdb7c and project 1cdfe96be196470889a58b56a19743a7. Resources: {'key_pairs'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:46:40.607647 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=8 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:46:40.616180 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7a9cd670-134c-4ecf-ac48-f803beb07dd8 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.312607 Sep 23 04:46:40.616180 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1722/3487] 10.222.0.33 () {62 vars in 1200 bytes} [Fri Sep 23 04:46:40 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 325 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 23 04:46:40.823312 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-91acbe3a-bc5b-412e-acf7-bf6e22f5724c tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:40.824662 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-91acbe3a-bc5b-412e-acf7-bf6e22f5724c tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] [instance: a0eac077-d4bd-4e4a-a04a-3f86aeeed9bd] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:40.836776 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-91acbe3a-bc5b-412e-acf7-bf6e22f5724c tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:40.837550 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-91acbe3a-bc5b-412e-acf7-bf6e22f5724c tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:40.838216 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-91acbe3a-bc5b-412e-acf7-bf6e22f5724c tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:40.839162 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-91acbe3a-bc5b-412e-acf7-bf6e22f5724c tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:40.845416 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-91acbe3a-bc5b-412e-acf7-bf6e22f5724c tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:40.846186 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-91acbe3a-bc5b-412e-acf7-bf6e22f5724c tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:41.249878 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c4aaf75f-1e80-4e3d-af8e-37e8c6f47a31 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c786bbedc21849ea92924139a44707b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcafb05f6f554e278cd552023947c6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:41.258509 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c4aaf75f-1e80-4e3d-af8e-37e8c6f47a31 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/9763a452-dc3c-436d-bee4-a3967af3bcbb" status: 200 len: 1520 microversion: 2.1 time: 1.347035 Sep 23 04:46:41.262342 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1766/3488] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:39 2022] GET /compute/v2.1/servers/9763a452-dc3c-436d-bee4-a3967af3bcbb => generated 1520 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:41.269461 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-833c47cb-1235-4d7d-87ae-9a7a2db0a582 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '.version_select at 0x7ff1bba581f0>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:41.342315 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-833c47cb-1235-4d7d-87ae-9a7a2db0a582 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/images/5ca97cbe-84e0-43f6-8385-3c16932e4f48" status: 200 len: 1440 microversion: 2.1 time: 0.078716 Sep 23 04:46:41.342912 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1767/3489] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:46:41 2022] GET /compute/v2.1/images/5ca97cbe-84e0-43f6-8385-3c16932e4f48 => generated 1440 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:41.348577 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-aa92a924-8821-415a-9ec1-59b9ad6703e1 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:41.358877 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-aa92a924-8821-415a-9ec1-59b9ad6703e1 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 28be637b-c43c-4881-b2ce-efb1ec1ad812] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:41.374229 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aa92a924-8821-415a-9ec1-59b9ad6703e1 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:41.374734 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aa92a924-8821-415a-9ec1-59b9ad6703e1 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:41.375183 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aa92a924-8821-415a-9ec1-59b9ad6703e1 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:41.375901 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aa92a924-8821-415a-9ec1-59b9ad6703e1 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:41.376361 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aa92a924-8821-415a-9ec1-59b9ad6703e1 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:41.377007 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aa92a924-8821-415a-9ec1-59b9ad6703e1 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:41.887443 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-91acbe3a-bc5b-412e-acf7-bf6e22f5724c tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff662b5d5b9e488d906565b490c8acf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dcca3b014be4e98b7db17bb37d073a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:41.896431 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-91acbe3a-bc5b-412e-acf7-bf6e22f5724c tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "GET /compute/v2.1/servers/a0eac077-d4bd-4e4a-a04a-3f86aeeed9bd" status: 200 len: 1318 microversion: 2.1 time: 1.076901 Sep 23 04:46:41.910412 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1723/3490] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:40 2022] GET /compute/v2.1/servers/a0eac077-d4bd-4e4a-a04a-3f86aeeed9bd => generated 1318 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:46:41.982776 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-aa92a924-8821-415a-9ec1-59b9ad6703e1 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:41.990604 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-aa92a924-8821-415a-9ec1-59b9ad6703e1 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/28be637b-c43c-4881-b2ce-efb1ec1ad812" status: 200 len: 1308 microversion: 2.1 time: 0.646482 Sep 23 04:46:42.014055 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1768/3491] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:41 2022] GET /compute/v2.1/servers/28be637b-c43c-4881-b2ce-efb1ec1ad812 => generated 1308 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:42.284069 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b5ab03b3-4583-454a-a4fc-60aa23d9abfc tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:42.284765 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b5ab03b3-4583-454a-a4fc-60aa23d9abfc tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: 9763a452-dc3c-436d-bee4-a3967af3bcbb] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:42.296199 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b5ab03b3-4583-454a-a4fc-60aa23d9abfc tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:42.296701 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b5ab03b3-4583-454a-a4fc-60aa23d9abfc tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:42.297146 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b5ab03b3-4583-454a-a4fc-60aa23d9abfc tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:42.301114 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b5ab03b3-4583-454a-a4fc-60aa23d9abfc tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:42.301661 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b5ab03b3-4583-454a-a4fc-60aa23d9abfc tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:42.302131 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b5ab03b3-4583-454a-a4fc-60aa23d9abfc tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:42.358457 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f52dc1a2-bfc1-4dde-9110-f7be87472ba4 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '.version_select at 0x7ff1ba9c1940>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:42.466476 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f52dc1a2-bfc1-4dde-9110-f7be87472ba4 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/images/5ca97cbe-84e0-43f6-8385-3c16932e4f48" status: 200 len: 1440 microversion: 2.1 time: 0.112105 Sep 23 04:46:42.479679 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1769/3492] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:46:42 2022] GET /compute/v2.1/images/5ca97cbe-84e0-43f6-8385-3c16932e4f48 => generated 1440 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:42.932609 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a4166ea5-f959-4ee1-96a2-ac58765455e6 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:42.933531 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a4166ea5-f959-4ee1-96a2-ac58765455e6 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] [instance: a0eac077-d4bd-4e4a-a04a-3f86aeeed9bd] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:42.959407 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a4166ea5-f959-4ee1-96a2-ac58765455e6 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:42.959717 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a4166ea5-f959-4ee1-96a2-ac58765455e6 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:42.960588 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a4166ea5-f959-4ee1-96a2-ac58765455e6 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:42.970688 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a4166ea5-f959-4ee1-96a2-ac58765455e6 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:42.970688 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a4166ea5-f959-4ee1-96a2-ac58765455e6 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:42.970963 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a4166ea5-f959-4ee1-96a2-ac58765455e6 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:43.077702 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b5ab03b3-4583-454a-a4fc-60aa23d9abfc tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c786bbedc21849ea92924139a44707b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcafb05f6f554e278cd552023947c6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:43.089595 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b5ab03b3-4583-454a-a4fc-60aa23d9abfc tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/9763a452-dc3c-436d-bee4-a3967af3bcbb" status: 200 len: 1520 microversion: 2.1 time: 0.809176 Sep 23 04:46:43.108310 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1724/3493] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:42 2022] GET /compute/v2.1/servers/9763a452-dc3c-436d-bee4-a3967af3bcbb => generated 1520 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:43.116853 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-03c9feeb-cf2d-4d1a-bf61-dca6b07beeca tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:43.117982 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-03c9feeb-cf2d-4d1a-bf61-dca6b07beeca tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 28be637b-c43c-4881-b2ce-efb1ec1ad812] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:43.126048 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-03c9feeb-cf2d-4d1a-bf61-dca6b07beeca tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:43.126553 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-03c9feeb-cf2d-4d1a-bf61-dca6b07beeca tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:43.126991 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-03c9feeb-cf2d-4d1a-bf61-dca6b07beeca tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:43.128210 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-03c9feeb-cf2d-4d1a-bf61-dca6b07beeca tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:43.128832 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-03c9feeb-cf2d-4d1a-bf61-dca6b07beeca tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:43.129254 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-03c9feeb-cf2d-4d1a-bf61-dca6b07beeca tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:43.674868 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a4166ea5-f959-4ee1-96a2-ac58765455e6 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff662b5d5b9e488d906565b490c8acf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dcca3b014be4e98b7db17bb37d073a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:43.703835 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a4166ea5-f959-4ee1-96a2-ac58765455e6 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "GET /compute/v2.1/servers/a0eac077-d4bd-4e4a-a04a-3f86aeeed9bd" status: 200 len: 1318 microversion: 2.1 time: 0.778438 Sep 23 04:46:43.712614 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1770/3494] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:42 2022] GET /compute/v2.1/servers/a0eac077-d4bd-4e4a-a04a-3f86aeeed9bd => generated 1318 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:43.721541 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ac6620bf-5528-4115-91cd-2c1f0d449159 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '.version_select at 0x7ff1bb731e50>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:43.789964 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-03c9feeb-cf2d-4d1a-bf61-dca6b07beeca tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:43.803701 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-03c9feeb-cf2d-4d1a-bf61-dca6b07beeca tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/28be637b-c43c-4881-b2ce-efb1ec1ad812" status: 200 len: 1308 microversion: 2.1 time: 0.693993 Sep 23 04:46:43.815010 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1725/3495] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:43 2022] GET /compute/v2.1/servers/28be637b-c43c-4881-b2ce-efb1ec1ad812 => generated 1308 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:43.845109 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ac6620bf-5528-4115-91cd-2c1f0d449159 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/images/5ca97cbe-84e0-43f6-8385-3c16932e4f48" status: 200 len: 1440 microversion: 2.1 time: 0.130690 Sep 23 04:46:43.856302 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1771/3496] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:46:43 2022] GET /compute/v2.1/images/5ca97cbe-84e0-43f6-8385-3c16932e4f48 => generated 1440 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:44.131412 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a3bedd96-947a-40b6-bd13-e2b1dea4db1e tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:44.132043 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a3bedd96-947a-40b6-bd13-e2b1dea4db1e tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: 9763a452-dc3c-436d-bee4-a3967af3bcbb] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:44.155266 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a3bedd96-947a-40b6-bd13-e2b1dea4db1e tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:44.156173 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a3bedd96-947a-40b6-bd13-e2b1dea4db1e tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:44.156320 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a3bedd96-947a-40b6-bd13-e2b1dea4db1e tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:44.160875 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a3bedd96-947a-40b6-bd13-e2b1dea4db1e tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:44.160875 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a3bedd96-947a-40b6-bd13-e2b1dea4db1e tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:44.160875 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a3bedd96-947a-40b6-bd13-e2b1dea4db1e tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:44.678601 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-6830eb11-2061-4f76-920b-136858b25b88 req-fbfe0168-976d-4443-8a0a-b715fc11d24a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0eac077-d4bd-4e4a-a04a-3f86aeeed9bd", "tag": "8f6a797f-179a-458b-adf8-7a33bc4631ac"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:46:44.678601 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-6830eb11-2061-4f76-920b-136858b25b88 req-fbfe0168-976d-4443-8a0a-b715fc11d24a service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:44.678601 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-6830eb11-2061-4f76-920b-136858b25b88 req-fbfe0168-976d-4443-8a0a-b715fc11d24a service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:44.678601 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-6830eb11-2061-4f76-920b-136858b25b88 req-fbfe0168-976d-4443-8a0a-b715fc11d24a service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:44.678601 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-6830eb11-2061-4f76-920b-136858b25b88 req-fbfe0168-976d-4443-8a0a-b715fc11d24a service nova] Creating event network-changed:8f6a797f-179a-458b-adf8-7a33bc4631ac for instance a0eac077-d4bd-4e4a-a04a-3f86aeeed9bd on n-h1-846463-3 Sep 23 04:46:44.678601 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-6830eb11-2061-4f76-920b-136858b25b88 req-fbfe0168-976d-4443-8a0a-b715fc11d24a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078315 Sep 23 04:46:44.678601 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1772/3497] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:46:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:46:44.742758 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-08b1020a-e8b0-413b-9e4b-3320dc039013 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:44.751481 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-08b1020a-e8b0-413b-9e4b-3320dc039013 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] [instance: a0eac077-d4bd-4e4a-a04a-3f86aeeed9bd] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:44.787617 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-08b1020a-e8b0-413b-9e4b-3320dc039013 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:44.787617 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-08b1020a-e8b0-413b-9e4b-3320dc039013 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:44.787617 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-08b1020a-e8b0-413b-9e4b-3320dc039013 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:44.787617 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-08b1020a-e8b0-413b-9e4b-3320dc039013 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:44.790692 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-08b1020a-e8b0-413b-9e4b-3320dc039013 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:44.791587 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-08b1020a-e8b0-413b-9e4b-3320dc039013 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:45.183118 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a3bedd96-947a-40b6-bd13-e2b1dea4db1e tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c786bbedc21849ea92924139a44707b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcafb05f6f554e278cd552023947c6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:45.202979 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a3bedd96-947a-40b6-bd13-e2b1dea4db1e tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/9763a452-dc3c-436d-bee4-a3967af3bcbb" status: 200 len: 1520 microversion: 2.1 time: 1.074412 Sep 23 04:46:45.206882 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1726/3498] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:44 2022] GET /compute/v2.1/servers/9763a452-dc3c-436d-bee4-a3967af3bcbb => generated 1520 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:45.218383 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-23e73deb-a84f-4627-a0c6-9d31537f3c2f tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:45.219373 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-23e73deb-a84f-4627-a0c6-9d31537f3c2f tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 28be637b-c43c-4881-b2ce-efb1ec1ad812] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:45.248900 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-23e73deb-a84f-4627-a0c6-9d31537f3c2f tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:45.250625 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-23e73deb-a84f-4627-a0c6-9d31537f3c2f tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:45.252189 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-23e73deb-a84f-4627-a0c6-9d31537f3c2f tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:45.253433 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-23e73deb-a84f-4627-a0c6-9d31537f3c2f tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:45.264955 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-23e73deb-a84f-4627-a0c6-9d31537f3c2f tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:45.265924 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-23e73deb-a84f-4627-a0c6-9d31537f3c2f tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:45.400038 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-08b1020a-e8b0-413b-9e4b-3320dc039013 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff662b5d5b9e488d906565b490c8acf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dcca3b014be4e98b7db17bb37d073a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:45.415821 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-08b1020a-e8b0-413b-9e4b-3320dc039013 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "GET /compute/v2.1/servers/a0eac077-d4bd-4e4a-a04a-3f86aeeed9bd" status: 200 len: 1318 microversion: 2.1 time: 0.680366 Sep 23 04:46:45.418889 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1773/3499] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:44 2022] GET /compute/v2.1/servers/a0eac077-d4bd-4e4a-a04a-3f86aeeed9bd => generated 1318 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:45.429067 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8e3bd346-dbea-41db-8cff-1385b8815b41 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '.version_select at 0x7ff1bb0b5700>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:45.574023 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-8e3bd346-dbea-41db-8cff-1385b8815b41 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/images/5ca97cbe-84e0-43f6-8385-3c16932e4f48" status: 200 len: 1440 microversion: 2.1 time: 0.153747 Sep 23 04:46:45.581570 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1774/3500] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:46:45 2022] GET /compute/v2.1/images/5ca97cbe-84e0-43f6-8385-3c16932e4f48 => generated 1440 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:46.313872 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-23e73deb-a84f-4627-a0c6-9d31537f3c2f tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:46.334647 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-23e73deb-a84f-4627-a0c6-9d31537f3c2f tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/28be637b-c43c-4881-b2ce-efb1ec1ad812" status: 200 len: 1308 microversion: 2.1 time: 1.129130 Sep 23 04:46:46.336374 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1727/3501] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:45 2022] GET /compute/v2.1/servers/28be637b-c43c-4881-b2ce-efb1ec1ad812 => generated 1308 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:46.386541 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-0cc18174-2f8d-44e1-a533-a4549480b68f req-81f8326f-9ebd-483f-b7e3-876ee437ca39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fff1fd4-972c-4268-89fd-92b784244edf", "name": "network-vif-plugged", "status": "completed", "tag": "1b7def80-2c6f-4b50-8986-20b3ff92ff59"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:46:46.434017 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c71c72cd-8c6e-4dc1-8335-a400d1c30635 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:46.440448 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c71c72cd-8c6e-4dc1-8335-a400d1c30635 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: 9763a452-dc3c-436d-bee4-a3967af3bcbb] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:46.452099 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-0cc18174-2f8d-44e1-a533-a4549480b68f req-81f8326f-9ebd-483f-b7e3-876ee437ca39 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:46.461338 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-0cc18174-2f8d-44e1-a533-a4549480b68f req-81f8326f-9ebd-483f-b7e3-876ee437ca39 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:46.469350 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-0cc18174-2f8d-44e1-a533-a4549480b68f req-81f8326f-9ebd-483f-b7e3-876ee437ca39 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:46.482374 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c71c72cd-8c6e-4dc1-8335-a400d1c30635 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:46.487078 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c71c72cd-8c6e-4dc1-8335-a400d1c30635 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:46.488347 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c71c72cd-8c6e-4dc1-8335-a400d1c30635 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:46.491285 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c71c72cd-8c6e-4dc1-8335-a400d1c30635 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:46.500048 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c71c72cd-8c6e-4dc1-8335-a400d1c30635 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:46.501303 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c71c72cd-8c6e-4dc1-8335-a400d1c30635 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:46.528160 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-0cc18174-2f8d-44e1-a533-a4549480b68f req-81f8326f-9ebd-483f-b7e3-876ee437ca39 service nova] Creating event network-vif-plugged:1b7def80-2c6f-4b50-8986-20b3ff92ff59 for instance 0fff1fd4-972c-4268-89fd-92b784244edf on n-h2-846463-3 Sep 23 04:46:46.556898 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-0cc18174-2f8d-44e1-a533-a4549480b68f req-81f8326f-9ebd-483f-b7e3-876ee437ca39 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.825856 Sep 23 04:46:46.564496 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1775/3502] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:46:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:46:46.592570 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f02da422-386d-4a0c-8f31-63d680820b39 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:46.593536 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f02da422-386d-4a0c-8f31-63d680820b39 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] [instance: a0eac077-d4bd-4e4a-a04a-3f86aeeed9bd] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:46.607442 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f02da422-386d-4a0c-8f31-63d680820b39 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:46.610107 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f02da422-386d-4a0c-8f31-63d680820b39 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:46.612743 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f02da422-386d-4a0c-8f31-63d680820b39 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:46.613907 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f02da422-386d-4a0c-8f31-63d680820b39 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:46.615003 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f02da422-386d-4a0c-8f31-63d680820b39 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:46.621974 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f02da422-386d-4a0c-8f31-63d680820b39 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:47.734797 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f02da422-386d-4a0c-8f31-63d680820b39 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff662b5d5b9e488d906565b490c8acf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dcca3b014be4e98b7db17bb37d073a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:47.758136 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f02da422-386d-4a0c-8f31-63d680820b39 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "GET /compute/v2.1/servers/a0eac077-d4bd-4e4a-a04a-3f86aeeed9bd" status: 200 len: 1318 microversion: 2.1 time: 1.190550 Sep 23 04:46:47.774148 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1776/3503] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:46 2022] GET /compute/v2.1/servers/a0eac077-d4bd-4e4a-a04a-3f86aeeed9bd => generated 1318 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:47.785377 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3da1f676-9f1d-4d65-870e-49bb00339816 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '.version_select at 0x7ff1ba9e34c0>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:47.882454 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c71c72cd-8c6e-4dc1-8335-a400d1c30635 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c786bbedc21849ea92924139a44707b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcafb05f6f554e278cd552023947c6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:47.892543 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c71c72cd-8c6e-4dc1-8335-a400d1c30635 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/9763a452-dc3c-436d-bee4-a3967af3bcbb" status: 200 len: 1520 microversion: 2.1 time: 1.498884 Sep 23 04:46:47.899894 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1728/3504] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:46 2022] GET /compute/v2.1/servers/9763a452-dc3c-436d-bee4-a3967af3bcbb => generated 1520 bytes in 1562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:47.941436 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3da1f676-9f1d-4d65-870e-49bb00339816 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/images/5ca97cbe-84e0-43f6-8385-3c16932e4f48" status: 200 len: 1440 microversion: 2.1 time: 0.165853 Sep 23 04:46:47.966737 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1777/3505] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:46:47 2022] GET /compute/v2.1/images/5ca97cbe-84e0-43f6-8385-3c16932e4f48 => generated 1440 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:47.985860 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-24f9cf77-cdc9-47f6-85d3-696620ff5c50 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:47.992767 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-24f9cf77-cdc9-47f6-85d3-696620ff5c50 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 28be637b-c43c-4881-b2ce-efb1ec1ad812] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:48.005436 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-24f9cf77-cdc9-47f6-85d3-696620ff5c50 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:48.005967 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-24f9cf77-cdc9-47f6-85d3-696620ff5c50 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:48.016686 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-24f9cf77-cdc9-47f6-85d3-696620ff5c50 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:48.018362 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-24f9cf77-cdc9-47f6-85d3-696620ff5c50 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:48.020865 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-24f9cf77-cdc9-47f6-85d3-696620ff5c50 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:48.023838 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-24f9cf77-cdc9-47f6-85d3-696620ff5c50 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:48.361167 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7790ad75-c5c1-4abc-97c8-d8629c4a46b4 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Action: 'create', calling method: .version_select at 0x7ff1ba9aae50>, body: {"keypair": {"name": "tempest-keypair-394368599", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHNcnuMAgpTEoudu3pfmGvToB18ywO6GfK+a2w3CgDxT9UStwHzyq3VkZ3Hvl+Jm/8Cg519IW2vrQ7+sWDRPPQEk1iANFt5Q25AuWw5faBRfUhuJIrgzqDQV6f0sX8QQ2g=="}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:46:48.421512 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-7790ad75-c5c1-4abc-97c8-d8629c4a46b4 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Getting quotas for project 2a45d69316a648fcb9c56190aaec5376. Resources: {'key_pairs'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:46:48.437701 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-7790ad75-c5c1-4abc-97c8-d8629c4a46b4 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Getting quotas for user f5e3a6e455e8483b8ce93ad380793335 and project 2a45d69316a648fcb9c56190aaec5376. Resources: {'key_pairs'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:46:48.635070 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7790ad75-c5c1-4abc-97c8-d8629c4a46b4 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.727806 Sep 23 04:46:48.642504 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1729/3506] 10.222.0.33 () {60 vars in 1159 bytes} [Fri Sep 23 04:46:47 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:46:48.660001 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-24f9cf77-cdc9-47f6-85d3-696620ff5c50 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:48.670050 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-24f9cf77-cdc9-47f6-85d3-696620ff5c50 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/28be637b-c43c-4881-b2ce-efb1ec1ad812" status: 200 len: 1308 microversion: 2.1 time: 0.701754 Sep 23 04:46:48.673202 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1778/3507] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:47 2022] GET /compute/v2.1/servers/28be637b-c43c-4881-b2ce-efb1ec1ad812 => generated 1308 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:48.727324 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-629b2a0c-88db-4002-a95e-18e1148bfce9 req-3942fc14-6a97-4beb-b0e7-b2642b04e9d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "401339a4-8674-4ff9-b09e-ba748f46928d", "name": "network-vif-plugged", "status": "completed", "tag": "ee716fd2-ccf3-4c05-b155-29bb9a5565c2"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:46:48.742047 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-629b2a0c-88db-4002-a95e-18e1148bfce9 req-3942fc14-6a97-4beb-b0e7-b2642b04e9d3 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:48.742715 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-629b2a0c-88db-4002-a95e-18e1148bfce9 req-3942fc14-6a97-4beb-b0e7-b2642b04e9d3 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:48.745080 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-629b2a0c-88db-4002-a95e-18e1148bfce9 req-3942fc14-6a97-4beb-b0e7-b2642b04e9d3 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:48.773254 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-629b2a0c-88db-4002-a95e-18e1148bfce9 req-3942fc14-6a97-4beb-b0e7-b2642b04e9d3 service nova] Creating event network-vif-plugged:ee716fd2-ccf3-4c05-b155-29bb9a5565c2 for instance 401339a4-8674-4ff9-b09e-ba748f46928d on n-h1-846463-3 Sep 23 04:46:48.782214 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3dc9e19c-138f-4003-b03d-62b5fe5a7973 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:48.783933 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-3dc9e19c-138f-4003-b03d-62b5fe5a7973 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] [instance: a0eac077-d4bd-4e4a-a04a-3f86aeeed9bd] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:48.798004 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-629b2a0c-88db-4002-a95e-18e1148bfce9 req-3942fc14-6a97-4beb-b0e7-b2642b04e9d3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077963 Sep 23 04:46:48.803903 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3dc9e19c-138f-4003-b03d-62b5fe5a7973 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:48.803903 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3dc9e19c-138f-4003-b03d-62b5fe5a7973 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:48.804516 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1730/3508] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:46:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:46:48.804606 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3dc9e19c-138f-4003-b03d-62b5fe5a7973 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:48.804606 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3dc9e19c-138f-4003-b03d-62b5fe5a7973 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:48.804606 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3dc9e19c-138f-4003-b03d-62b5fe5a7973 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:48.804606 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3dc9e19c-138f-4003-b03d-62b5fe5a7973 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:48.939213 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-bcf95e59-08d1-404c-897d-b8e65d1417b8 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:48.941213 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-bcf95e59-08d1-404c-897d-b8e65d1417b8 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: 9763a452-dc3c-436d-bee4-a3967af3bcbb] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:48.961192 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bcf95e59-08d1-404c-897d-b8e65d1417b8 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:48.966595 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bcf95e59-08d1-404c-897d-b8e65d1417b8 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:48.970903 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bcf95e59-08d1-404c-897d-b8e65d1417b8 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:48.970903 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bcf95e59-08d1-404c-897d-b8e65d1417b8 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:48.970903 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bcf95e59-08d1-404c-897d-b8e65d1417b8 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:48.970903 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bcf95e59-08d1-404c-897d-b8e65d1417b8 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:50.079896 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-3dc9e19c-138f-4003-b03d-62b5fe5a7973 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff662b5d5b9e488d906565b490c8acf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dcca3b014be4e98b7db17bb37d073a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:50.090974 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3dc9e19c-138f-4003-b03d-62b5fe5a7973 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "GET /compute/v2.1/servers/a0eac077-d4bd-4e4a-a04a-3f86aeeed9bd" status: 200 len: 1318 microversion: 2.1 time: 1.313842 Sep 23 04:46:50.096510 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1779/3509] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:48 2022] GET /compute/v2.1/servers/a0eac077-d4bd-4e4a-a04a-3f86aeeed9bd => generated 1318 bytes in 1319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:50.111000 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-bcf95e59-08d1-404c-897d-b8e65d1417b8 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c786bbedc21849ea92924139a44707b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcafb05f6f554e278cd552023947c6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:50.112893 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e92eabaa-baa6-49ff-aab2-6fc925f09cf4 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '.version_select at 0x7ff1c0c42e50>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:50.126045 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-bcf95e59-08d1-404c-897d-b8e65d1417b8 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/9763a452-dc3c-436d-bee4-a3967af3bcbb" status: 200 len: 1520 microversion: 2.1 time: 1.202116 Sep 23 04:46:50.128863 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1731/3510] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:48 2022] GET /compute/v2.1/servers/9763a452-dc3c-436d-bee4-a3967af3bcbb => generated 1520 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:50.142480 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8c0280bd-8a80-4feb-a021-4c521a70d5c0 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-860054239", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6b012070-a2c4-48c7-9b56-4366fa30168a"}], "security_groups": [{"name": "tempest-securitygroup--1904934549"}], "key_name": "tempest-keypair-941368436", "user_data": "}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:46:50.212511 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e92eabaa-baa6-49ff-aab2-6fc925f09cf4 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/images/5ca97cbe-84e0-43f6-8385-3c16932e4f48" status: 200 len: 1440 microversion: 2.1 time: 0.114138 Sep 23 04:46:50.213370 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1780/3511] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:46:50 2022] GET /compute/v2.1/images/5ca97cbe-84e0-43f6-8385-3c16932e4f48 => generated 1440 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:50.241065 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-bcb5cdad-c53a-4736-98fe-284f6d7b0f81 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:50.241719 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-bcb5cdad-c53a-4736-98fe-284f6d7b0f81 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 28be637b-c43c-4881-b2ce-efb1ec1ad812] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:50.265918 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bcb5cdad-c53a-4736-98fe-284f6d7b0f81 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:50.266728 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bcb5cdad-c53a-4736-98fe-284f6d7b0f81 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:50.267358 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bcb5cdad-c53a-4736-98fe-284f6d7b0f81 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:50.270004 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bcb5cdad-c53a-4736-98fe-284f6d7b0f81 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:50.270004 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bcb5cdad-c53a-4736-98fe-284f6d7b0f81 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:50.270004 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bcb5cdad-c53a-4736-98fe-284f6d7b0f81 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:50.748238 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.network.neutron [None req-8c0280bd-8a80-4feb-a021-4c521a70d5c0 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] validate_networks() for [('6b012070-a2c4-48c7-9b56-4366fa30168a', None, None, None, None, None)] {{(pid=122698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:46:50.945864 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-bcb5cdad-c53a-4736-98fe-284f6d7b0f81 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:50.955435 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-bcb5cdad-c53a-4736-98fe-284f6d7b0f81 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/28be637b-c43c-4881-b2ce-efb1ec1ad812" status: 200 len: 1308 microversion: 2.1 time: 0.740788 Sep 23 04:46:50.959395 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1781/3512] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:50 2022] GET /compute/v2.1/servers/28be637b-c43c-4881-b2ce-efb1ec1ad812 => generated 1308 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:50.974429 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-b4c1e361-4943-4565-a6df-33ae87f5a4e2 req-a3622768-d3b4-4239-96a6-2f17f6daed7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28be637b-c43c-4881-b2ce-efb1ec1ad812", "name": "network-vif-plugged", "status": "completed", "tag": "5ab6e461-b84c-43e0-a5e3-b990d284d4a7"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:46:50.992687 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-b4c1e361-4943-4565-a6df-33ae87f5a4e2 req-a3622768-d3b4-4239-96a6-2f17f6daed7d service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:50.993178 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-b4c1e361-4943-4565-a6df-33ae87f5a4e2 req-a3622768-d3b4-4239-96a6-2f17f6daed7d service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:50.998929 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-b4c1e361-4943-4565-a6df-33ae87f5a4e2 req-a3622768-d3b4-4239-96a6-2f17f6daed7d service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:51.030753 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-b4c1e361-4943-4565-a6df-33ae87f5a4e2 req-a3622768-d3b4-4239-96a6-2f17f6daed7d service nova] Creating event network-vif-plugged:5ab6e461-b84c-43e0-a5e3-b990d284d4a7 for instance 28be637b-c43c-4881-b2ce-efb1ec1ad812 on n-h1-846463-3 Sep 23 04:46:51.041622 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-b4c1e361-4943-4565-a6df-33ae87f5a4e2 req-a3622768-d3b4-4239-96a6-2f17f6daed7d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080758 Sep 23 04:46:51.043358 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1782/3513] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:46:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:46:51.125667 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9631f3bf-4af2-4aa4-a786-de8324902776 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:51.130462 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-9631f3bf-4af2-4aa4-a786-de8324902776 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] [instance: a0eac077-d4bd-4e4a-a04a-3f86aeeed9bd] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:51.145806 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9631f3bf-4af2-4aa4-a786-de8324902776 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:51.146600 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9631f3bf-4af2-4aa4-a786-de8324902776 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:51.148113 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9631f3bf-4af2-4aa4-a786-de8324902776 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:51.149242 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9631f3bf-4af2-4aa4-a786-de8324902776 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:51.150038 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9631f3bf-4af2-4aa4-a786-de8324902776 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:51.151647 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9631f3bf-4af2-4aa4-a786-de8324902776 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:51.754107 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-8c0280bd-8a80-4feb-a021-4c521a70d5c0 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Flavor limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:46:51.754107 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-8c0280bd-8a80-4feb-a021-4c521a70d5c0 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Image limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:46:51.754107 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-8c0280bd-8a80-4feb-a021-4c521a70d5c0 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Flavor pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:46:51.754681 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-8c0280bd-8a80-4feb-a021-4c521a70d5c0 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Image pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:46:51.754681 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-8c0280bd-8a80-4feb-a021-4c521a70d5c0 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:46:51.771950 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8c0280bd-8a80-4feb-a021-4c521a70d5c0 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:51.774221 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8c0280bd-8a80-4feb-a021-4c521a70d5c0 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:51.774221 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8c0280bd-8a80-4feb-a021-4c521a70d5c0 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:51.774221 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8c0280bd-8a80-4feb-a021-4c521a70d5c0 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:51.774221 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8c0280bd-8a80-4feb-a021-4c521a70d5c0 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:51.774588 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8c0280bd-8a80-4feb-a021-4c521a70d5c0 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:51.802663 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=94 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:46:51.812665 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-8c0280bd-8a80-4feb-a021-4c521a70d5c0 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Getting quotas for project 1cdfe96be196470889a58b56a19743a7. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:46:51.819742 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-8c0280bd-8a80-4feb-a021-4c521a70d5c0 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Getting quotas for user b87ca7119ee042c3bda1e88ff38fdb7c and project 1cdfe96be196470889a58b56a19743a7. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:46:51.829452 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-9631f3bf-4af2-4aa4-a786-de8324902776 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff662b5d5b9e488d906565b490c8acf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dcca3b014be4e98b7db17bb37d073a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:51.838957 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-9631f3bf-4af2-4aa4-a786-de8324902776 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "GET /compute/v2.1/servers/a0eac077-d4bd-4e4a-a04a-3f86aeeed9bd" status: 200 len: 1318 microversion: 2.1 time: 0.727360 Sep 23 04:46:51.882777 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1783/3514] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:51 2022] GET /compute/v2.1/servers/a0eac077-d4bd-4e4a-a04a-3f86aeeed9bd => generated 1318 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:46:51.904453 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-fe7f83a2-ff15-4383-8cc9-6afd974794c6 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:51.910348 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8c0280bd-8a80-4feb-a021-4c521a70d5c0 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Going to run 1 instances... {{(pid=122698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:46:51.913749 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8c0280bd-8a80-4feb-a021-4c521a70d5c0 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: fe7dee09-8351-4d41-8c44-8d35a966cce9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:46:51.914807 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-fe7f83a2-ff15-4383-8cc9-6afd974794c6 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: 9763a452-dc3c-436d-bee4-a3967af3bcbb] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:51.944912 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fe7f83a2-ff15-4383-8cc9-6afd974794c6 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:51.946498 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fe7f83a2-ff15-4383-8cc9-6afd974794c6 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:51.950583 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fe7f83a2-ff15-4383-8cc9-6afd974794c6 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:51.958088 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fe7f83a2-ff15-4383-8cc9-6afd974794c6 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:51.958664 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fe7f83a2-ff15-4383-8cc9-6afd974794c6 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:51.959392 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fe7f83a2-ff15-4383-8cc9-6afd974794c6 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:52.191817 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8c0280bd-8a80-4feb-a021-4c521a70d5c0 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.058201 Sep 23 04:46:52.194192 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1732/3515] 10.222.0.33 () {62 vars in 1188 bytes} [Fri Sep 23 04:46:50 2022] POST /compute/v2.1/servers => generated 402 bytes in 2064 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 23 04:46:52.223958 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a0f5823a-7477-4087-bc34-52a36219cf03 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '.version_select at 0x7ff1ba8e7c10>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:52.366045 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-fe7f83a2-ff15-4383-8cc9-6afd974794c6 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c786bbedc21849ea92924139a44707b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcafb05f6f554e278cd552023947c6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:52.377779 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a0f5823a-7477-4087-bc34-52a36219cf03 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/images/5ca97cbe-84e0-43f6-8385-3c16932e4f48" status: 200 len: 1440 microversion: 2.1 time: 0.172671 Sep 23 04:46:52.377779 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1733/3516] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:46:52 2022] GET /compute/v2.1/images/5ca97cbe-84e0-43f6-8385-3c16932e4f48 => generated 1440 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:52.383169 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-fe7f83a2-ff15-4383-8cc9-6afd974794c6 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/9763a452-dc3c-436d-bee4-a3967af3bcbb" status: 200 len: 1520 microversion: 2.1 time: 0.498657 Sep 23 04:46:52.388877 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1784/3517] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:51 2022] GET /compute/v2.1/servers/9763a452-dc3c-436d-bee4-a3967af3bcbb => generated 1520 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:52.394593 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a80c1285-dd20-4ab1-b3ec-863ad84f8808 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:52.399077 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-11d072f4-210e-4c0c-8bfe-eb6cce7e77be tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:52.402934 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-11d072f4-210e-4c0c-8bfe-eb6cce7e77be tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 28be637b-c43c-4881-b2ce-efb1ec1ad812] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:52.415400 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a80c1285-dd20-4ab1-b3ec-863ad84f8808 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: fe7dee09-8351-4d41-8c44-8d35a966cce9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:52.439501 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-11d072f4-210e-4c0c-8bfe-eb6cce7e77be tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:52.447344 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-11d072f4-210e-4c0c-8bfe-eb6cce7e77be tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:52.448171 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-11d072f4-210e-4c0c-8bfe-eb6cce7e77be tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:52.453530 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-11d072f4-210e-4c0c-8bfe-eb6cce7e77be tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:52.461736 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-11d072f4-210e-4c0c-8bfe-eb6cce7e77be tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:52.461736 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-11d072f4-210e-4c0c-8bfe-eb6cce7e77be tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:52.663307 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a80c1285-dd20-4ab1-b3ec-863ad84f8808 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:52.713949 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a80c1285-dd20-4ab1-b3ec-863ad84f8808 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:52.751344 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a80c1285-dd20-4ab1-b3ec-863ad84f8808 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:52.752602 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a80c1285-dd20-4ab1-b3ec-863ad84f8808 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9" status: 200 len: 1280 microversion: 2.20 time: 0.361879 Sep 23 04:46:52.760781 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1785/3518] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:46:52 2022] GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9 => generated 1280 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:46:52.869139 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-19d5d302-b17d-4dc6-9106-cc45034c6cd6 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:52.870086 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-19d5d302-b17d-4dc6-9106-cc45034c6cd6 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] [instance: a0eac077-d4bd-4e4a-a04a-3f86aeeed9bd] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:52.881487 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-19d5d302-b17d-4dc6-9106-cc45034c6cd6 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:52.882056 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-19d5d302-b17d-4dc6-9106-cc45034c6cd6 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:52.882529 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-19d5d302-b17d-4dc6-9106-cc45034c6cd6 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:52.883288 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-19d5d302-b17d-4dc6-9106-cc45034c6cd6 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:52.883778 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-19d5d302-b17d-4dc6-9106-cc45034c6cd6 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:52.884292 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-19d5d302-b17d-4dc6-9106-cc45034c6cd6 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:52.909366 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-11d072f4-210e-4c0c-8bfe-eb6cce7e77be tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:52.917596 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-11d072f4-210e-4c0c-8bfe-eb6cce7e77be tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/28be637b-c43c-4881-b2ce-efb1ec1ad812" status: 200 len: 1308 microversion: 2.1 time: 0.544520 Sep 23 04:46:52.918232 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1734/3519] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:52 2022] GET /compute/v2.1/servers/28be637b-c43c-4881-b2ce-efb1ec1ad812 => generated 1308 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:53.071520 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-06e27a7d-e1dc-4716-be51-517ded292e47 req-4579e19a-d83b-4101-bb37-12d1f02f97d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0eac077-d4bd-4e4a-a04a-3f86aeeed9bd", "name": "network-vif-plugged", "status": "completed", "tag": "8f6a797f-179a-458b-adf8-7a33bc4631ac"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:46:53.080471 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-19d5d302-b17d-4dc6-9106-cc45034c6cd6 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff662b5d5b9e488d906565b490c8acf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dcca3b014be4e98b7db17bb37d073a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:53.085174 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-06e27a7d-e1dc-4716-be51-517ded292e47 req-4579e19a-d83b-4101-bb37-12d1f02f97d5 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:53.085715 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-06e27a7d-e1dc-4716-be51-517ded292e47 req-4579e19a-d83b-4101-bb37-12d1f02f97d5 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:53.091750 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-06e27a7d-e1dc-4716-be51-517ded292e47 req-4579e19a-d83b-4101-bb37-12d1f02f97d5 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:53.103322 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-06e27a7d-e1dc-4716-be51-517ded292e47 req-4579e19a-d83b-4101-bb37-12d1f02f97d5 service nova] Creating event network-vif-plugged:8f6a797f-179a-458b-adf8-7a33bc4631ac for instance a0eac077-d4bd-4e4a-a04a-3f86aeeed9bd on n-h1-846463-3 Sep 23 04:46:53.112485 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-06e27a7d-e1dc-4716-be51-517ded292e47 req-4579e19a-d83b-4101-bb37-12d1f02f97d5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044517 Sep 23 04:46:53.125021 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1735/3520] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:46:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:46:53.130182 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-19d5d302-b17d-4dc6-9106-cc45034c6cd6 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "GET /compute/v2.1/servers/a0eac077-d4bd-4e4a-a04a-3f86aeeed9bd" status: 200 len: 1318 microversion: 2.1 time: 0.264695 Sep 23 04:46:53.130799 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1786/3521] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:52 2022] GET /compute/v2.1/servers/a0eac077-d4bd-4e4a-a04a-3f86aeeed9bd => generated 1318 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:53.395278 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c1e35b8b-db82-4e76-afe8-5078079d300b tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '.version_select at 0x7ff1ba92c160>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:53.416192 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e80b6a40-43cf-468d-b0e8-6edfa598376b tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:53.417975 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e80b6a40-43cf-468d-b0e8-6edfa598376b tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: 9763a452-dc3c-436d-bee4-a3967af3bcbb] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:53.430472 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e80b6a40-43cf-468d-b0e8-6edfa598376b tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:53.431241 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e80b6a40-43cf-468d-b0e8-6edfa598376b tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:53.431948 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e80b6a40-43cf-468d-b0e8-6edfa598376b tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:53.432937 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e80b6a40-43cf-468d-b0e8-6edfa598376b tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:53.434046 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e80b6a40-43cf-468d-b0e8-6edfa598376b tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:53.434893 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e80b6a40-43cf-468d-b0e8-6edfa598376b tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:53.498965 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c1e35b8b-db82-4e76-afe8-5078079d300b tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/images/5ca97cbe-84e0-43f6-8385-3c16932e4f48" status: 200 len: 1440 microversion: 2.1 time: 0.117629 Sep 23 04:46:53.510085 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1736/3522] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:46:53 2022] GET /compute/v2.1/images/5ca97cbe-84e0-43f6-8385-3c16932e4f48 => generated 1440 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:53.792661 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f66af4eb-e5f7-43a4-ae53-de81d49935e3 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:53.793691 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f66af4eb-e5f7-43a4-ae53-de81d49935e3 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: fe7dee09-8351-4d41-8c44-8d35a966cce9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:54.170173 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f66af4eb-e5f7-43a4-ae53-de81d49935e3 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:54.184521 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f66af4eb-e5f7-43a4-ae53-de81d49935e3 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:54.190731 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f66af4eb-e5f7-43a4-ae53-de81d49935e3 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:54.195844 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f66af4eb-e5f7-43a4-ae53-de81d49935e3 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9" status: 200 len: 1280 microversion: 2.20 time: 0.411173 Sep 23 04:46:54.196773 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1737/3523] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:46:53 2022] GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9 => generated 1280 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:46:54.207423 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2ea2f807-63a5-4420-8b01-6eb3f925a38a tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:54.217188 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-2ea2f807-63a5-4420-8b01-6eb3f925a38a tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 28be637b-c43c-4881-b2ce-efb1ec1ad812] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:54.240799 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2ea2f807-63a5-4420-8b01-6eb3f925a38a tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:54.241435 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2ea2f807-63a5-4420-8b01-6eb3f925a38a tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:54.242043 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2ea2f807-63a5-4420-8b01-6eb3f925a38a tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:54.244838 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2ea2f807-63a5-4420-8b01-6eb3f925a38a tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:54.248621 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2ea2f807-63a5-4420-8b01-6eb3f925a38a tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:54.252721 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2ea2f807-63a5-4420-8b01-6eb3f925a38a tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:54.436022 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e80b6a40-43cf-468d-b0e8-6edfa598376b tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c786bbedc21849ea92924139a44707b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcafb05f6f554e278cd552023947c6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:54.449495 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e80b6a40-43cf-468d-b0e8-6edfa598376b tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/9763a452-dc3c-436d-bee4-a3967af3bcbb" status: 200 len: 1520 microversion: 2.1 time: 1.034149 Sep 23 04:46:54.450484 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1787/3524] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:53 2022] GET /compute/v2.1/servers/9763a452-dc3c-436d-bee4-a3967af3bcbb => generated 1520 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:54.463167 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-65e8e338-f209-4f95-b65a-ac52c95b2a96 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:54.465398 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-65e8e338-f209-4f95-b65a-ac52c95b2a96 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] [instance: a0eac077-d4bd-4e4a-a04a-3f86aeeed9bd] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:54.479355 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-65e8e338-f209-4f95-b65a-ac52c95b2a96 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:54.484734 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-65e8e338-f209-4f95-b65a-ac52c95b2a96 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:54.490049 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-65e8e338-f209-4f95-b65a-ac52c95b2a96 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:54.491153 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-65e8e338-f209-4f95-b65a-ac52c95b2a96 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:54.491972 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-65e8e338-f209-4f95-b65a-ac52c95b2a96 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:54.492577 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-65e8e338-f209-4f95-b65a-ac52c95b2a96 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:54.535009 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:46:54.792628 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-2ea2f807-63a5-4420-8b01-6eb3f925a38a tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:54.801104 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2ea2f807-63a5-4420-8b01-6eb3f925a38a tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/28be637b-c43c-4881-b2ce-efb1ec1ad812" status: 200 len: 1488 microversion: 2.1 time: 0.602465 Sep 23 04:46:54.806916 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1738/3525] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:54 2022] GET /compute/v2.1/servers/28be637b-c43c-4881-b2ce-efb1ec1ad812 => generated 1488 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:54.834529 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2ffc1ea9-d746-4230-b4e8-f344161bb5b6 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '.version_select at 0x7ff1ba889550>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:54.942304 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-65e8e338-f209-4f95-b65a-ac52c95b2a96 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff662b5d5b9e488d906565b490c8acf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dcca3b014be4e98b7db17bb37d073a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:54.947777 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2ffc1ea9-d746-4230-b4e8-f344161bb5b6 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/images/5ca97cbe-84e0-43f6-8385-3c16932e4f48" status: 200 len: 1440 microversion: 2.1 time: 0.136449 Sep 23 04:46:54.949355 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1739/3526] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:46:54 2022] GET /compute/v2.1/images/5ca97cbe-84e0-43f6-8385-3c16932e4f48 => generated 1440 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:54.967811 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c67ea39e-c37b-4667-9e94-83c9ffc045af tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-851706718"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:46:54.972251 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-65e8e338-f209-4f95-b65a-ac52c95b2a96 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "GET /compute/v2.1/servers/a0eac077-d4bd-4e4a-a04a-3f86aeeed9bd" status: 200 len: 1318 microversion: 2.1 time: 0.519004 Sep 23 04:46:54.986126 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1788/3527] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:54 2022] GET /compute/v2.1/servers/a0eac077-d4bd-4e4a-a04a-3f86aeeed9bd => generated 1318 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:54.986360 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c67ea39e-c37b-4667-9e94-83c9ffc045af tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 28be637b-c43c-4881-b2ce-efb1ec1ad812] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:55.003213 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c67ea39e-c37b-4667-9e94-83c9ffc045af tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:55.007937 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c67ea39e-c37b-4667-9e94-83c9ffc045af tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:55.007937 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c67ea39e-c37b-4667-9e94-83c9ffc045af tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:55.007937 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c67ea39e-c37b-4667-9e94-83c9ffc045af tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:55.008288 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c67ea39e-c37b-4667-9e94-83c9ffc045af tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:55.008988 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c67ea39e-c37b-4667-9e94-83c9ffc045af tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:55.227543 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a8b00632-3cdb-47eb-b32a-2096ce96cd46 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:55.228421 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a8b00632-3cdb-47eb-b32a-2096ce96cd46 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: fe7dee09-8351-4d41-8c44-8d35a966cce9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:55.246464 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a8b00632-3cdb-47eb-b32a-2096ce96cd46 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:55.246464 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a8b00632-3cdb-47eb-b32a-2096ce96cd46 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:55.256102 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a8b00632-3cdb-47eb-b32a-2096ce96cd46 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:55.260475 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a8b00632-3cdb-47eb-b32a-2096ce96cd46 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:55.261012 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a8b00632-3cdb-47eb-b32a-2096ce96cd46 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:55.263763 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a8b00632-3cdb-47eb-b32a-2096ce96cd46 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:55.311803 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c67ea39e-c37b-4667-9e94-83c9ffc045af tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "PUT /compute/v2.1/servers/28be637b-c43c-4881-b2ce-efb1ec1ad812" status: 200 len: 1073 microversion: 2.1 time: 0.339745 Sep 23 04:46:55.313285 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1740/3528] 10.222.0.33 () {60 vars in 1256 bytes} [Fri Sep 23 04:46:54 2022] PUT /compute/v2.1/servers/28be637b-c43c-4881-b2ce-efb1ec1ad812 => generated 1073 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:55.335121 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5e936161-b2bc-4c28-908c-d0cbf898b1c0 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:55.341941 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5e936161-b2bc-4c28-908c-d0cbf898b1c0 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 28be637b-c43c-4881-b2ce-efb1ec1ad812] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:55.357666 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5e936161-b2bc-4c28-908c-d0cbf898b1c0 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:55.366697 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5e936161-b2bc-4c28-908c-d0cbf898b1c0 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:55.367502 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5e936161-b2bc-4c28-908c-d0cbf898b1c0 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:55.368538 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5e936161-b2bc-4c28-908c-d0cbf898b1c0 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:55.369238 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5e936161-b2bc-4c28-908c-d0cbf898b1c0 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:55.369918 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5e936161-b2bc-4c28-908c-d0cbf898b1c0 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:55.468058 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a8b00632-3cdb-47eb-b32a-2096ce96cd46 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:55.494789 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a8b00632-3cdb-47eb-b32a-2096ce96cd46 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:55.501157 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a8b00632-3cdb-47eb-b32a-2096ce96cd46 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:55.513261 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a8b00632-3cdb-47eb-b32a-2096ce96cd46 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9" status: 200 len: 1276 microversion: 2.20 time: 0.288817 Sep 23 04:46:55.517215 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1789/3529] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:46:55 2022] GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9 => generated 1276 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:46:55.522635 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4f1939c5-c171-41ec-87ee-039eec964634 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:55.523482 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4f1939c5-c171-41ec-87ee-039eec964634 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: 9763a452-dc3c-436d-bee4-a3967af3bcbb] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:55.530260 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4f1939c5-c171-41ec-87ee-039eec964634 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:55.531036 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4f1939c5-c171-41ec-87ee-039eec964634 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:55.531681 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4f1939c5-c171-41ec-87ee-039eec964634 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:55.532611 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4f1939c5-c171-41ec-87ee-039eec964634 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:55.533266 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4f1939c5-c171-41ec-87ee-039eec964634 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:55.533921 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4f1939c5-c171-41ec-87ee-039eec964634 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:55.952694 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-5e936161-b2bc-4c28-908c-d0cbf898b1c0 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:55.984626 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5e936161-b2bc-4c28-908c-d0cbf898b1c0 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/28be637b-c43c-4881-b2ce-efb1ec1ad812" status: 200 len: 1499 microversion: 2.1 time: 0.653340 Sep 23 04:46:55.996423 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1741/3530] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:55 2022] GET /compute/v2.1/servers/28be637b-c43c-4881-b2ce-efb1ec1ad812 => generated 1499 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:56.026155 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f27a0a19-2255-4ecd-997c-846977143d54 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2084258702", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c808d35d-7b6c-439e-908b-4f409fd90fd4"}], "security_groups": [{"name": "tempest-securitygroup--1810750269"}], "key_name": "tempest-keypair-394368599", "user_data": "}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:46:56.085663 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-4f1939c5-c171-41ec-87ee-039eec964634 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c786bbedc21849ea92924139a44707b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcafb05f6f554e278cd552023947c6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:56.099300 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4f1939c5-c171-41ec-87ee-039eec964634 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/9763a452-dc3c-436d-bee4-a3967af3bcbb" status: 200 len: 1520 microversion: 2.1 time: 0.580411 Sep 23 04:46:56.110549 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1790/3531] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:55 2022] GET /compute/v2.1/servers/9763a452-dc3c-436d-bee4-a3967af3bcbb => generated 1520 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:56.117986 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-eca160aa-0315-4fa3-92f9-ed219db9dd4e tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '.version_select at 0x7ff1ba9dc0d0>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:56.281344 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-eca160aa-0315-4fa3-92f9-ed219db9dd4e tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/images/5ca97cbe-84e0-43f6-8385-3c16932e4f48" status: 200 len: 1440 microversion: 2.1 time: 0.168080 Sep 23 04:46:56.299123 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1791/3532] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:46:56 2022] GET /compute/v2.1/images/5ca97cbe-84e0-43f6-8385-3c16932e4f48 => generated 1440 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:56.342350 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.network.neutron [None req-f27a0a19-2255-4ecd-997c-846977143d54 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] validate_networks() for [('c808d35d-7b6c-439e-908b-4f409fd90fd4', None, None, None, None, None)] {{(pid=122698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:46:56.350087 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-16f2b387-bfb2-4b1c-b4a0-90dda4167337 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:56.352471 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-16f2b387-bfb2-4b1c-b4a0-90dda4167337 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] [instance: a0eac077-d4bd-4e4a-a04a-3f86aeeed9bd] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:56.387857 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-16f2b387-bfb2-4b1c-b4a0-90dda4167337 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:56.394528 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-16f2b387-bfb2-4b1c-b4a0-90dda4167337 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:56.395798 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-16f2b387-bfb2-4b1c-b4a0-90dda4167337 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:56.403354 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-16f2b387-bfb2-4b1c-b4a0-90dda4167337 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:56.406914 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-16f2b387-bfb2-4b1c-b4a0-90dda4167337 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:56.412189 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-16f2b387-bfb2-4b1c-b4a0-90dda4167337 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:56.906297 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-16f2b387-bfb2-4b1c-b4a0-90dda4167337 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff662b5d5b9e488d906565b490c8acf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dcca3b014be4e98b7db17bb37d073a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:56.920590 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-16f2b387-bfb2-4b1c-b4a0-90dda4167337 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "GET /compute/v2.1/servers/a0eac077-d4bd-4e4a-a04a-3f86aeeed9bd" status: 200 len: 1468 microversion: 2.1 time: 0.614461 Sep 23 04:46:56.926127 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1792/3533] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:56 2022] GET /compute/v2.1/servers/a0eac077-d4bd-4e4a-a04a-3f86aeeed9bd => generated 1468 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:56.957074 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-eb8d60f9-dba4-4924-a960-47b47b0d6408 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:56.965399 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-eb8d60f9-dba4-4924-a960-47b47b0d6408 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 28be637b-c43c-4881-b2ce-efb1ec1ad812] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:56.991000 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eb8d60f9-dba4-4924-a960-47b47b0d6408 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:56.991930 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eb8d60f9-dba4-4924-a960-47b47b0d6408 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:56.992696 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eb8d60f9-dba4-4924-a960-47b47b0d6408 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:57.023425 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eb8d60f9-dba4-4924-a960-47b47b0d6408 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:57.024119 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eb8d60f9-dba4-4924-a960-47b47b0d6408 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:57.033697 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eb8d60f9-dba4-4924-a960-47b47b0d6408 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:57.879036 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-eb8d60f9-dba4-4924-a960-47b47b0d6408 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:57.898247 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-eb8d60f9-dba4-4924-a960-47b47b0d6408 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/28be637b-c43c-4881-b2ce-efb1ec1ad812" status: 200 len: 1499 microversion: 2.1 time: 0.962568 Sep 23 04:46:57.898962 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1793/3534] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:56 2022] GET /compute/v2.1/servers/28be637b-c43c-4881-b2ce-efb1ec1ad812 => generated 1499 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:57.931193 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b61e1ae4-c6e3-480c-b31f-150a39a0f750 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:57.932569 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b61e1ae4-c6e3-480c-b31f-150a39a0f750 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: fe7dee09-8351-4d41-8c44-8d35a966cce9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:57.963224 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b61e1ae4-c6e3-480c-b31f-150a39a0f750 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:57.965555 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b61e1ae4-c6e3-480c-b31f-150a39a0f750 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:57.966239 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b61e1ae4-c6e3-480c-b31f-150a39a0f750 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:57.967195 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b61e1ae4-c6e3-480c-b31f-150a39a0f750 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:57.969211 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b61e1ae4-c6e3-480c-b31f-150a39a0f750 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:57.970494 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b61e1ae4-c6e3-480c-b31f-150a39a0f750 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:58.208354 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-f27a0a19-2255-4ecd-997c-846977143d54 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Flavor limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:46:58.208886 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-f27a0a19-2255-4ecd-997c-846977143d54 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Image limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:46:58.209543 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-f27a0a19-2255-4ecd-997c-846977143d54 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Flavor pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:46:58.210164 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-f27a0a19-2255-4ecd-997c-846977143d54 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Image pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:46:58.211645 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-f27a0a19-2255-4ecd-997c-846977143d54 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:46:58.234572 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f27a0a19-2255-4ecd-997c-846977143d54 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:58.240270 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f27a0a19-2255-4ecd-997c-846977143d54 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:58.243988 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f27a0a19-2255-4ecd-997c-846977143d54 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:58.244985 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f27a0a19-2255-4ecd-997c-846977143d54 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:58.248311 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f27a0a19-2255-4ecd-997c-846977143d54 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:58.252422 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f27a0a19-2255-4ecd-997c-846977143d54 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:58.307583 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-f27a0a19-2255-4ecd-997c-846977143d54 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Getting quotas for project 2a45d69316a648fcb9c56190aaec5376. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:46:58.320777 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-f27a0a19-2255-4ecd-997c-846977143d54 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Getting quotas for user f5e3a6e455e8483b8ce93ad380793335 and project 2a45d69316a648fcb9c56190aaec5376. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:46:58.379099 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f27a0a19-2255-4ecd-997c-846977143d54 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Going to run 1 instances... {{(pid=122698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:46:58.398690 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f27a0a19-2255-4ecd-997c-846977143d54 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:46:58.416257 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b61e1ae4-c6e3-480c-b31f-150a39a0f750 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:58.434796 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b61e1ae4-c6e3-480c-b31f-150a39a0f750 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:58.438465 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b61e1ae4-c6e3-480c-b31f-150a39a0f750 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:58.445000 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b61e1ae4-c6e3-480c-b31f-150a39a0f750 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9" status: 200 len: 1338 microversion: 2.20 time: 0.526281 Sep 23 04:46:58.451587 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1794/3535] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:46:57 2022] GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9 => generated 1338 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:46:58.471595 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4efbd043-9495-44f3-9fd2-42d8109a4ebd tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:58.476354 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4efbd043-9495-44f3-9fd2-42d8109a4ebd tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] [instance: 401339a4-8674-4ff9-b09e-ba748f46928d] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:58.493002 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4efbd043-9495-44f3-9fd2-42d8109a4ebd tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:58.498386 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4efbd043-9495-44f3-9fd2-42d8109a4ebd tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:58.501029 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4efbd043-9495-44f3-9fd2-42d8109a4ebd tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:58.501858 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4efbd043-9495-44f3-9fd2-42d8109a4ebd tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:58.502371 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4efbd043-9495-44f3-9fd2-42d8109a4ebd tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:58.504607 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4efbd043-9495-44f3-9fd2-42d8109a4ebd tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:58.666695 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f27a0a19-2255-4ecd-997c-846977143d54 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.665054 Sep 23 04:46:58.669074 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1742/3536] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:46:55 2022] POST /compute/v2.1/servers => generated 409 bytes in 2672 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:46:58.681056 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-fc7aa1af-c1a1-4d90-a6db-ae902f57c9d6 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:58.682373 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-fc7aa1af-c1a1-4d90-a6db-ae902f57c9d6 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: 9763a452-dc3c-436d-bee4-a3967af3bcbb] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:58.706096 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fc7aa1af-c1a1-4d90-a6db-ae902f57c9d6 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:58.710632 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fc7aa1af-c1a1-4d90-a6db-ae902f57c9d6 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:58.711252 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fc7aa1af-c1a1-4d90-a6db-ae902f57c9d6 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:58.713137 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fc7aa1af-c1a1-4d90-a6db-ae902f57c9d6 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:58.715987 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fc7aa1af-c1a1-4d90-a6db-ae902f57c9d6 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:58.721249 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fc7aa1af-c1a1-4d90-a6db-ae902f57c9d6 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:59.004598 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-4efbd043-9495-44f3-9fd2-42d8109a4ebd tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff662b5d5b9e488d906565b490c8acf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dcca3b014be4e98b7db17bb37d073a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:59.020546 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4efbd043-9495-44f3-9fd2-42d8109a4ebd tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "GET /compute/v2.1/servers/401339a4-8674-4ff9-b09e-ba748f46928d" status: 200 len: 1467 microversion: 2.1 time: 0.567517 Sep 23 04:46:59.021174 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1795/3537] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:58 2022] GET /compute/v2.1/servers/401339a4-8674-4ff9-b09e-ba748f46928d => generated 1467 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:59.043757 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6315f478-7f18-4355-bd24-7d8cc8b248fb tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '.version_select at 0x7ff1c0c51160>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:59.187982 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-fc7aa1af-c1a1-4d90-a6db-ae902f57c9d6 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c786bbedc21849ea92924139a44707b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcafb05f6f554e278cd552023947c6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:46:59.191915 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:46:59.205212 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-fc7aa1af-c1a1-4d90-a6db-ae902f57c9d6 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/9763a452-dc3c-436d-bee4-a3967af3bcbb" status: 200 len: 1500 microversion: 2.1 time: 0.534161 Sep 23 04:46:59.222245 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1743/3538] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:58 2022] GET /compute/v2.1/servers/9763a452-dc3c-436d-bee4-a3967af3bcbb => generated 1500 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:59.232727 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6315f478-7f18-4355-bd24-7d8cc8b248fb tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/images/5ca97cbe-84e0-43f6-8385-3c16932e4f48" status: 200 len: 1440 microversion: 2.1 time: 0.210444 Sep 23 04:46:59.239545 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-14a2e271-8f11-42ac-a5d8-65547ffc9b23 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:46:59.242267 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1796/3539] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:46:59 2022] GET /compute/v2.1/images/5ca97cbe-84e0-43f6-8385-3c16932e4f48 => generated 1440 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:46:59.249456 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5d835a71-1c76-43d5-8907-edee1482506d tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:46:59.250814 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-5d835a71-1c76-43d5-8907-edee1482506d tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:59.257324 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-14a2e271-8f11-42ac-a5d8-65547ffc9b23 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:59.265651 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-14a2e271-8f11-42ac-a5d8-65547ffc9b23 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:59.266320 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-14a2e271-8f11-42ac-a5d8-65547ffc9b23 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:59.330839 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-14a2e271-8f11-42ac-a5d8-65547ffc9b23 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 28be637b-c43c-4881-b2ce-efb1ec1ad812] Going to try to stop instance {{(pid=122698) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 23 04:46:59.747752 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-14a2e271-8f11-42ac-a5d8-65547ffc9b23 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "POST /compute/v2.1/servers/28be637b-c43c-4881-b2ce-efb1ec1ad812/action" status: 202 len: 0 microversion: 2.1 time: 0.523969 Sep 23 04:46:59.748925 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1744/3540] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:46:59 2022] POST /compute/v2.1/servers/28be637b-c43c-4881-b2ce-efb1ec1ad812/action => generated 0 bytes in 526 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:46:59.771995 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d8e70bc1-2cbc-447e-87be-07239ac41ebb tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-852131795"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:46:59.778234 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d8e70bc1-2cbc-447e-87be-07239ac41ebb tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] [instance: 401339a4-8674-4ff9-b09e-ba748f46928d] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:46:59.798050 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d8e70bc1-2cbc-447e-87be-07239ac41ebb tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:59.800038 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d8e70bc1-2cbc-447e-87be-07239ac41ebb tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:59.801101 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d8e70bc1-2cbc-447e-87be-07239ac41ebb tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:46:59.804908 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d8e70bc1-2cbc-447e-87be-07239ac41ebb tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:46:59.805428 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d8e70bc1-2cbc-447e-87be-07239ac41ebb tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:46:59.806150 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d8e70bc1-2cbc-447e-87be-07239ac41ebb tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:00.373576 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-5d835a71-1c76-43d5-8907-edee1482506d tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:00.388412 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5d835a71-1c76-43d5-8907-edee1482506d tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1238 microversion: 2.1 time: 1.142852 Sep 23 04:47:00.391660 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1797/3541] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:46:59 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1238 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:00.415742 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-00001073-66c2-4cf1-b128-1128d6fb0b62 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:00.416706 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-00001073-66c2-4cf1-b128-1128d6fb0b62 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: f0374fc2-3c0f-48e1-b969-2933785fd47b] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:00.453166 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-00001073-66c2-4cf1-b128-1128d6fb0b62 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:00.461827 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-00001073-66c2-4cf1-b128-1128d6fb0b62 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:00.462337 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-00001073-66c2-4cf1-b128-1128d6fb0b62 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:00.463106 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-00001073-66c2-4cf1-b128-1128d6fb0b62 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:00.463635 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-00001073-66c2-4cf1-b128-1128d6fb0b62 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:00.464339 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-00001073-66c2-4cf1-b128-1128d6fb0b62 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:00.686330 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-00001073-66c2-4cf1-b128-1128d6fb0b62 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c786bbedc21849ea92924139a44707b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcafb05f6f554e278cd552023947c6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:00.704465 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-00001073-66c2-4cf1-b128-1128d6fb0b62 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/f0374fc2-3c0f-48e1-b969-2933785fd47b" status: 200 len: 1515 microversion: 2.1 time: 0.301785 Sep 23 04:47:00.706505 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1798/3542] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:00 2022] GET /compute/v2.1/servers/f0374fc2-3c0f-48e1-b969-2933785fd47b => generated 1515 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:00.716979 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1e3eb096-6197-4c7d-bc3f-ed07f9fe6d5e tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:00.719633 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1e3eb096-6197-4c7d-bc3f-ed07f9fe6d5e tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: fe7dee09-8351-4d41-8c44-8d35a966cce9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:00.736929 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e3eb096-6197-4c7d-bc3f-ed07f9fe6d5e tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:00.737651 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e3eb096-6197-4c7d-bc3f-ed07f9fe6d5e tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:00.738137 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e3eb096-6197-4c7d-bc3f-ed07f9fe6d5e tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:00.746889 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e3eb096-6197-4c7d-bc3f-ed07f9fe6d5e tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:00.747725 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e3eb096-6197-4c7d-bc3f-ed07f9fe6d5e tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:00.748339 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e3eb096-6197-4c7d-bc3f-ed07f9fe6d5e tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:00.831161 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d8e70bc1-2cbc-447e-87be-07239ac41ebb tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "POST /compute/v2.1/servers/401339a4-8674-4ff9-b09e-ba748f46928d/action" status: 202 len: 0 microversion: 2.1 time: 1.078310 Sep 23 04:47:00.840492 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1745/3543] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:46:59 2022] POST /compute/v2.1/servers/401339a4-8674-4ff9-b09e-ba748f46928d/action => generated 0 bytes in 1090 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 23 04:47:00.858857 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ebc033bb-20d1-4fb3-82c7-896ff41f67c7 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:00.860754 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-ebc033bb-20d1-4fb3-82c7-896ff41f67c7 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 28be637b-c43c-4881-b2ce-efb1ec1ad812] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:00.875261 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ebc033bb-20d1-4fb3-82c7-896ff41f67c7 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:00.877426 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ebc033bb-20d1-4fb3-82c7-896ff41f67c7 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:00.877968 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ebc033bb-20d1-4fb3-82c7-896ff41f67c7 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:00.879515 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ebc033bb-20d1-4fb3-82c7-896ff41f67c7 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:00.881501 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ebc033bb-20d1-4fb3-82c7-896ff41f67c7 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:00.882202 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ebc033bb-20d1-4fb3-82c7-896ff41f67c7 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:01.426199 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1e3eb096-6197-4c7d-bc3f-ed07f9fe6d5e tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:01.426199 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1e3eb096-6197-4c7d-bc3f-ed07f9fe6d5e tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:01.426199 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1e3eb096-6197-4c7d-bc3f-ed07f9fe6d5e tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:01.426199 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1e3eb096-6197-4c7d-bc3f-ed07f9fe6d5e tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9" status: 200 len: 1406 microversion: 2.20 time: 0.606855 Sep 23 04:47:01.426199 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1799/3544] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:47:00 2022] GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9 => generated 1406 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:47:01.426199 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5ddba92b-62ae-4caf-abdb-d023075ec054 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '.version_select at 0x7ff1ba9c7550>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:01.431837 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ebc033bb-20d1-4fb3-82c7-896ff41f67c7 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:01.431837 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ebc033bb-20d1-4fb3-82c7-896ff41f67c7 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/28be637b-c43c-4881-b2ce-efb1ec1ad812" status: 200 len: 1509 microversion: 2.1 time: 0.525709 Sep 23 04:47:01.431837 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1746/3545] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:00 2022] GET /compute/v2.1/servers/28be637b-c43c-4881-b2ce-efb1ec1ad812 => generated 1509 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:01.431837 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-94dba089-f74e-48ff-9a93-c05d0c154c86 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:47:01.431837 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-94dba089-f74e-48ff-9a93-c05d0c154c86 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: 73444e2e-e14d-4f28-a519-d54eec878850] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:01.432449 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5ddba92b-62ae-4caf-abdb-d023075ec054 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/images/5ca97cbe-84e0-43f6-8385-3c16932e4f48" status: 200 len: 1440 microversion: 2.1 time: 0.085999 Sep 23 04:47:01.432449 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1800/3546] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:47:01 2022] GET /compute/v2.1/images/5ca97cbe-84e0-43f6-8385-3c16932e4f48 => generated 1440 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:01.433074 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-94dba089-f74e-48ff-9a93-c05d0c154c86 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] HTTP exception thrown: Instance 73444e2e-e14d-4f28-a519-d54eec878850 could not be found. Sep 23 04:47:01.433176 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-589be398-9318-4d74-943e-d222f94033bf tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '.version_select at 0x7ff1ba9c1f70>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:01.482516 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-589be398-9318-4d74-943e-d222f94033bf tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "GET /compute/v2.1/images/ff150c0b-96d0-4d15-b6c3-7e2dc172a34c" status: 200 len: 1454 microversion: 2.1 time: 0.075983 Sep 23 04:47:01.483206 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1801/3547] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:47:01 2022] GET /compute/v2.1/images/ff150c0b-96d0-4d15-b6c3-7e2dc172a34c => generated 1454 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:01.488295 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-068e2a24-98a0-4802-8d02-590f491934fa tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:01.488995 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-068e2a24-98a0-4802-8d02-590f491934fa tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:01.499507 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-068e2a24-98a0-4802-8d02-590f491934fa tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:01.500104 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-068e2a24-98a0-4802-8d02-590f491934fa tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:01.500633 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-068e2a24-98a0-4802-8d02-590f491934fa tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:01.501451 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-068e2a24-98a0-4802-8d02-590f491934fa tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:01.502031 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-068e2a24-98a0-4802-8d02-590f491934fa tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:01.502535 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-068e2a24-98a0-4802-8d02-590f491934fa tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:01.590664 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-068e2a24-98a0-4802-8d02-590f491934fa tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:01.601467 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-068e2a24-98a0-4802-8d02-590f491934fa tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1242 microversion: 2.1 time: 0.116834 Sep 23 04:47:01.602318 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1802/3548] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:01 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1242 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:01.617013 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-94dba089-f74e-48ff-9a93-c05d0c154c86 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Request method failure captured: Sep 23 04:47:01.617013 n-d-846463-3 devstack@n-api.service[122698]: request: POST /compute/v2.1/servers/73444e2e-e14d-4f28-a519-d54eec878850/action HTTP/1.1 Sep 23 04:47:01.617013 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:47:01.617013 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:47:01.617013 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:47:01.617013 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 14 Sep 23 04:47:01.617013 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:47:01.617013 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:47:01.617013 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:47:01.617013 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:47:01.617013 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLToEB3KmJeqpeof3qtE1_ms3jD5q4R8EB4mtf6agEJBYOf3R1k1wW8qdql02e7ra521m3dklynQTAHmyD-EBkyV9p_88fIs_nz1LT08tnPBKYcM8ytHDfif-4FU40Ttv4qlVJY_DNQ2W4b2ZBQdDVOwU9-lTsZtqbQggZ1JBKRn9aZQ Sep 23 04:47:01.617013 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:47:01.617013 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:47:01.617013 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:47:01.617013 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:47:01.617013 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:47:01.617013 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:47:01.617013 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: dcafb05f6f554e278cd552023947c6ac Sep 23 04:47:01.617013 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-196358672 Sep 23 04:47:01.617013 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:47:01.617013 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:47:01.617013 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_dcafb05f6f554e278cd552023947c6ac", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dcafb05f6f554e278cd552023947c6ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/dcafb05f6f554e278cd552023947c6ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dcafb05f6f554e278cd552023947c6ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:47:01.617013 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ServerRescueNegativeTestJSON-196358672 Sep 23 04:47:01.617013 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: dcafb05f6f554e278cd552023947c6ac Sep 23 04:47:01.617013 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-196358672 Sep 23 04:47:01.617013 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ServerRescueNegativeTestJSON-196358672-project Sep 23 04:47:01.617013 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:47:01.617013 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:47:01.617013 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: c786bbedc21849ea92924139a44707b7 Sep 23 04:47:01.617013 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ServerRescueNegativeTestJSON-196358672-project Sep 23 04:47:01.617013 n-d-846463-3 devstack@n-api.service[122698]: Sep 23 04:47:01.617013 n-d-846463-3 devstack@n-api.service[122698]: {"rescue": {}} Sep 23 04:47:01.617013 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:47:01.617013 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 73444e2e-e14d-4f28-a519-d54eec878850 could not be found. Sep 23 04:47:01.617013 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '73444e2e-e14d-4f28-a519-d54eec878850', 'body': {'rescue': {}}} Sep 23 04:47:01.617013 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:47:01.617013 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:01.617013 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:47:01.617013 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:47:01.617013 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:47:01.617013 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:47:01.617013 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 23 04:47:01.617013 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 23 04:47:01.617013 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73444e2e-e14d-4f28-a519-d54eec878850 could not be found. Sep 23 04:47:01.617013 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:47:01.617013 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:47:01.617013 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:47:01.617013 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:01.617013 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:47:01.617013 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:47:01.617013 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:47:01.617013 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:47:01.617013 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:47:01.617013 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:47:01.617013 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:47:01.617013 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:47:01.617013 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Sep 23 04:47:01.617013 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 23 04:47:01.617013 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:47:01.617013 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:47:01.617013 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73444e2e-e14d-4f28-a519-d54eec878850 could not be found. Sep 23 04:47:01.617013 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:47:01.617013 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:47:01.617013 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:47:01.617013 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:01.623380 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:47:01.623380 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:47:01.623380 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:47:01.623380 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:47:01.623380 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73444e2e-e14d-4f28-a519-d54eec878850 could not be found. Sep 23 04:47:01.623380 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:47:01.623380 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-94dba089-f74e-48ff-9a93-c05d0c154c86 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Returning 404 to user: Instance 73444e2e-e14d-4f28-a519-d54eec878850 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:47:01.623380 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-94dba089-f74e-48ff-9a93-c05d0c154c86 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "POST /compute/v2.1/servers/73444e2e-e14d-4f28-a519-d54eec878850/action" status: 404 len: 111 microversion: 2.1 time: 0.247757 Sep 23 04:47:01.623380 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1747/3549] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:47:01 2022] POST /compute/v2.1/servers/73444e2e-e14d-4f28-a519-d54eec878850/action => generated 111 bytes in 249 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:47:01.633282 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a8dd23e2-8fa7-4d8f-9dae-72fb7a9fbcc2 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:47:01.633973 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a8dd23e2-8fa7-4d8f-9dae-72fb7a9fbcc2 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: f0374fc2-3c0f-48e1-b969-2933785fd47b] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:01.641932 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a8dd23e2-8fa7-4d8f-9dae-72fb7a9fbcc2 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:01.642488 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a8dd23e2-8fa7-4d8f-9dae-72fb7a9fbcc2 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:01.643225 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a8dd23e2-8fa7-4d8f-9dae-72fb7a9fbcc2 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:01.644085 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a8dd23e2-8fa7-4d8f-9dae-72fb7a9fbcc2 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:01.644556 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a8dd23e2-8fa7-4d8f-9dae-72fb7a9fbcc2 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:01.644982 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a8dd23e2-8fa7-4d8f-9dae-72fb7a9fbcc2 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:01.981529 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a8dd23e2-8fa7-4d8f-9dae-72fb7a9fbcc2 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "POST /compute/v2.1/servers/f0374fc2-3c0f-48e1-b969-2933785fd47b/action" status: 202 len: 0 microversion: 2.1 time: 0.352814 Sep 23 04:47:01.985656 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1803/3550] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:47:01 2022] POST /compute/v2.1/servers/f0374fc2-3c0f-48e1-b969-2933785fd47b/action => generated 0 bytes in 356 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:47:01.996328 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-10182684-8974-43e0-93eb-b392374f4f41 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:02.005379 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-10182684-8974-43e0-93eb-b392374f4f41 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: f0374fc2-3c0f-48e1-b969-2933785fd47b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:02.035323 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-10182684-8974-43e0-93eb-b392374f4f41 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:02.035994 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-10182684-8974-43e0-93eb-b392374f4f41 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:02.037294 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-10182684-8974-43e0-93eb-b392374f4f41 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:02.062366 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-10182684-8974-43e0-93eb-b392374f4f41 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:02.065406 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-10182684-8974-43e0-93eb-b392374f4f41 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:02.072294 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-10182684-8974-43e0-93eb-b392374f4f41 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:02.350573 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-65ade1bb-2cda-48dd-8c2e-c5785b5a672d tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-2006367288", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "networks": [{"uuid": "7ec2c088-8cd5-47fc-aaa6-ca4765f2280b"}]}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:47:02.486586 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.neutron [None req-65ade1bb-2cda-48dd-8c2e-c5785b5a672d tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] validate_networks() for [('7ec2c088-8cd5-47fc-aaa6-ca4765f2280b', None, None, None, None, None)] {{(pid=122699) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:47:02.800546 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-10182684-8974-43e0-93eb-b392374f4f41 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c786bbedc21849ea92924139a44707b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcafb05f6f554e278cd552023947c6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:02.816123 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-10182684-8974-43e0-93eb-b392374f4f41 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/f0374fc2-3c0f-48e1-b969-2933785fd47b" status: 200 len: 1520 microversion: 2.1 time: 0.826981 Sep 23 04:47:02.816723 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1748/3551] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:01 2022] GET /compute/v2.1/servers/f0374fc2-3c0f-48e1-b969-2933785fd47b => generated 1520 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:02.828061 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-740ad69d-8b77-401f-9e31-0c57384ddad2 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '.version_select at 0x7ff1ba89bdc0>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:02.892865 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-740ad69d-8b77-401f-9e31-0c57384ddad2 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/images/5ca97cbe-84e0-43f6-8385-3c16932e4f48" status: 200 len: 1440 microversion: 2.1 time: 0.071075 Sep 23 04:47:02.894091 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1749/3552] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:47:02 2022] GET /compute/v2.1/images/5ca97cbe-84e0-43f6-8385-3c16932e4f48 => generated 1440 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:02.899806 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-756666b9-76d9-44c6-89af-a7d60c2cc7cb tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:02.900681 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-756666b9-76d9-44c6-89af-a7d60c2cc7cb tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: fe7dee09-8351-4d41-8c44-8d35a966cce9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:02.934283 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-756666b9-76d9-44c6-89af-a7d60c2cc7cb tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:02.936006 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-756666b9-76d9-44c6-89af-a7d60c2cc7cb tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:02.936820 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-756666b9-76d9-44c6-89af-a7d60c2cc7cb tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:02.938930 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-756666b9-76d9-44c6-89af-a7d60c2cc7cb tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:02.940358 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-756666b9-76d9-44c6-89af-a7d60c2cc7cb tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:02.942417 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-756666b9-76d9-44c6-89af-a7d60c2cc7cb tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:03.558436 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-756666b9-76d9-44c6-89af-a7d60c2cc7cb tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:03.575065 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-756666b9-76d9-44c6-89af-a7d60c2cc7cb tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:03.584036 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-756666b9-76d9-44c6-89af-a7d60c2cc7cb tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:03.590687 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-756666b9-76d9-44c6-89af-a7d60c2cc7cb tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9" status: 200 len: 1406 microversion: 2.20 time: 0.694869 Sep 23 04:47:03.594183 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1750/3553] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:47:02 2022] GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9 => generated 1406 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:47:03.614202 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3c4dfe67-dc40-459a-ad3d-3fd1b39d5c00 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:03.615167 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3c4dfe67-dc40-459a-ad3d-3fd1b39d5c00 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 28be637b-c43c-4881-b2ce-efb1ec1ad812] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:03.643929 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3c4dfe67-dc40-459a-ad3d-3fd1b39d5c00 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:03.647337 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3c4dfe67-dc40-459a-ad3d-3fd1b39d5c00 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:03.650703 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3c4dfe67-dc40-459a-ad3d-3fd1b39d5c00 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:03.656483 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3c4dfe67-dc40-459a-ad3d-3fd1b39d5c00 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:03.657305 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3c4dfe67-dc40-459a-ad3d-3fd1b39d5c00 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:03.664930 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3c4dfe67-dc40-459a-ad3d-3fd1b39d5c00 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:03.980679 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-65ade1bb-2cda-48dd-8c2e-c5785b5a672d tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Flavor limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:47:03.981736 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-65ade1bb-2cda-48dd-8c2e-c5785b5a672d tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Image limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:47:03.982542 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-65ade1bb-2cda-48dd-8c2e-c5785b5a672d tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Flavor pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:47:03.983118 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-65ade1bb-2cda-48dd-8c2e-c5785b5a672d tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Image pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:47:03.983863 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-65ade1bb-2cda-48dd-8c2e-c5785b5a672d tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:47:04.003145 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-65ade1bb-2cda-48dd-8c2e-c5785b5a672d tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:04.003499 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-65ade1bb-2cda-48dd-8c2e-c5785b5a672d tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:04.005868 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-65ade1bb-2cda-48dd-8c2e-c5785b5a672d tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:04.006733 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-65ade1bb-2cda-48dd-8c2e-c5785b5a672d tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:04.007158 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-65ade1bb-2cda-48dd-8c2e-c5785b5a672d tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:04.010046 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-65ade1bb-2cda-48dd-8c2e-c5785b5a672d tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:04.089751 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-65ade1bb-2cda-48dd-8c2e-c5785b5a672d tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Getting quotas for project 53d02cb07a2a404c8d89aa13a950806d. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:47:04.109596 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-65ade1bb-2cda-48dd-8c2e-c5785b5a672d tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Getting quotas for user a245dd82de1340f7a58873de1851c61c and project 53d02cb07a2a404c8d89aa13a950806d. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:47:04.137670 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-65ade1bb-2cda-48dd-8c2e-c5785b5a672d tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Going to run 1 instances... {{(pid=122699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:47:04.140544 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-65ade1bb-2cda-48dd-8c2e-c5785b5a672d tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] [instance: f6413c5e-771f-45c5-94a8-b197becc0815] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:47:04.268159 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-3c4dfe67-dc40-459a-ad3d-3fd1b39d5c00 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:04.313108 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3c4dfe67-dc40-459a-ad3d-3fd1b39d5c00 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/28be637b-c43c-4881-b2ce-efb1ec1ad812" status: 200 len: 1509 microversion: 2.1 time: 0.717498 Sep 23 04:47:04.313772 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1751/3554] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:03 2022] GET /compute/v2.1/servers/28be637b-c43c-4881-b2ce-efb1ec1ad812 => generated 1509 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:04.361361 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f5b26703-c010-4b9d-8cee-23e787e55db7 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '.version_select at 0x7ff1ba8e7940>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:04.401288 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-65ade1bb-2cda-48dd-8c2e-c5785b5a672d tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.187216 Sep 23 04:47:04.411199 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1804/3555] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:47:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 2198 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:47:04.424159 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-81cbee43-1b96-490c-a277-55af0d4feb6f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:04.427290 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-81cbee43-1b96-490c-a277-55af0d4feb6f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:04.458722 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-81cbee43-1b96-490c-a277-55af0d4feb6f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:04.469590 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-81cbee43-1b96-490c-a277-55af0d4feb6f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:04.471931 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-81cbee43-1b96-490c-a277-55af0d4feb6f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:04.471931 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-81cbee43-1b96-490c-a277-55af0d4feb6f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:04.496057 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-81cbee43-1b96-490c-a277-55af0d4feb6f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:04.509210 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-81cbee43-1b96-490c-a277-55af0d4feb6f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:04.509487 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f5b26703-c010-4b9d-8cee-23e787e55db7 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "GET /compute/v2.1/images/ff150c0b-96d0-4d15-b6c3-7e2dc172a34c" status: 200 len: 1454 microversion: 2.1 time: 0.188895 Sep 23 04:47:04.520399 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1752/3556] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:47:04 2022] GET /compute/v2.1/images/ff150c0b-96d0-4d15-b6c3-7e2dc172a34c => generated 1454 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:04.545671 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2e5775e0-59e3-4a92-a1eb-7c16e9436f24 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:04.552327 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-2e5775e0-59e3-4a92-a1eb-7c16e9436f24 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: f0374fc2-3c0f-48e1-b969-2933785fd47b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:04.583536 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2e5775e0-59e3-4a92-a1eb-7c16e9436f24 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:04.584200 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2e5775e0-59e3-4a92-a1eb-7c16e9436f24 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:04.584987 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2e5775e0-59e3-4a92-a1eb-7c16e9436f24 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:04.585268 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2e5775e0-59e3-4a92-a1eb-7c16e9436f24 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:04.585729 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2e5775e0-59e3-4a92-a1eb-7c16e9436f24 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:04.586185 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2e5775e0-59e3-4a92-a1eb-7c16e9436f24 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:04.864962 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-81cbee43-1b96-490c-a277-55af0d4feb6f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:04.879089 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-81cbee43-1b96-490c-a277-55af0d4feb6f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1296 microversion: 2.1 time: 0.466441 Sep 23 04:47:04.879980 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1805/3557] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:04 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1296 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:04.894615 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-bfe1fd14-732c-413a-824f-5af38ebe0bd3 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '.version_select at 0x7ff1c0c510d0>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:05.180308 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-bfe1fd14-732c-413a-824f-5af38ebe0bd3 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/images/5ca97cbe-84e0-43f6-8385-3c16932e4f48" status: 200 len: 1440 microversion: 2.1 time: 0.297184 Sep 23 04:47:05.183054 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1806/3558] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:47:04 2022] GET /compute/v2.1/images/5ca97cbe-84e0-43f6-8385-3c16932e4f48 => generated 1440 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:05.203907 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-6e6d33c9-f61f-474a-b795-ad45ef729050 req-ee09849b-43ce-4434-b29d-8fedaba9bcab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe7dee09-8351-4d41-8c44-8d35a966cce9", "tag": "c9b47e66-2bb6-4e68-a2b9-4fb9fec9ff30"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:47:05.236911 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-6e6d33c9-f61f-474a-b795-ad45ef729050 req-ee09849b-43ce-4434-b29d-8fedaba9bcab service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:05.238624 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-6e6d33c9-f61f-474a-b795-ad45ef729050 req-ee09849b-43ce-4434-b29d-8fedaba9bcab service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:05.239998 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-6e6d33c9-f61f-474a-b795-ad45ef729050 req-ee09849b-43ce-4434-b29d-8fedaba9bcab service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:05.272857 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-2e5775e0-59e3-4a92-a1eb-7c16e9436f24 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c786bbedc21849ea92924139a44707b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcafb05f6f554e278cd552023947c6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:05.285605 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2e5775e0-59e3-4a92-a1eb-7c16e9436f24 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/f0374fc2-3c0f-48e1-b969-2933785fd47b" status: 200 len: 1500 microversion: 2.1 time: 0.763529 Sep 23 04:47:05.288688 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1753/3559] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:04 2022] GET /compute/v2.1/servers/f0374fc2-3c0f-48e1-b969-2933785fd47b => generated 1500 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:05.296724 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-6e6d33c9-f61f-474a-b795-ad45ef729050 req-ee09849b-43ce-4434-b29d-8fedaba9bcab service nova] Creating event network-changed:c9b47e66-2bb6-4e68-a2b9-4fb9fec9ff30 for instance fe7dee09-8351-4d41-8c44-8d35a966cce9 on n-h2-846463-3 Sep 23 04:47:05.311778 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-6e6d33c9-f61f-474a-b795-ad45ef729050 req-ee09849b-43ce-4434-b29d-8fedaba9bcab service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126263 Sep 23 04:47:05.315727 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1807/3560] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:47:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:47:05.318789 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ba12f514-350c-4a4a-9f07-2c9765090fff tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:05.319468 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-ba12f514-350c-4a4a-9f07-2c9765090fff tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] [instance: f6413c5e-771f-45c5-94a8-b197becc0815] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:05.333964 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b84d6b17-e078-46fa-b264-2e6192425d23 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:05.335210 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b84d6b17-e078-46fa-b264-2e6192425d23 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: fe7dee09-8351-4d41-8c44-8d35a966cce9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:05.350511 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b84d6b17-e078-46fa-b264-2e6192425d23 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:05.353918 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b84d6b17-e078-46fa-b264-2e6192425d23 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:05.355441 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b84d6b17-e078-46fa-b264-2e6192425d23 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:05.358960 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b84d6b17-e078-46fa-b264-2e6192425d23 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:05.359830 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b84d6b17-e078-46fa-b264-2e6192425d23 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:05.360471 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b84d6b17-e078-46fa-b264-2e6192425d23 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:05.443003 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ba12f514-350c-4a4a-9f07-2c9765090fff tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a245dd82de1340f7a58873de1851c61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d02cb07a2a404c8d89aa13a950806d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:05.451504 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ba12f514-350c-4a4a-9f07-2c9765090fff tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] 10.222.0.33 "GET /compute/v2.1/servers/f6413c5e-771f-45c5-94a8-b197becc0815" status: 200 len: 1225 microversion: 2.1 time: 0.144749 Sep 23 04:47:05.462955 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1754/3561] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:05 2022] GET /compute/v2.1/servers/f6413c5e-771f-45c5-94a8-b197becc0815 => generated 1225 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:05.473698 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f7615eee-b570-4c67-8010-648e22572795 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:47:05.473698 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f7615eee-b570-4c67-8010-648e22572795 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: f0374fc2-3c0f-48e1-b969-2933785fd47b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:05.492003 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f7615eee-b570-4c67-8010-648e22572795 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:05.492736 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f7615eee-b570-4c67-8010-648e22572795 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:05.494439 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f7615eee-b570-4c67-8010-648e22572795 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:05.495912 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f7615eee-b570-4c67-8010-648e22572795 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:05.498529 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f7615eee-b570-4c67-8010-648e22572795 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:05.499176 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f7615eee-b570-4c67-8010-648e22572795 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:05.555353 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-f7615eee-b570-4c67-8010-648e22572795 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lazy-loading 'flavor' on Instance uuid f0374fc2-3c0f-48e1-b969-2933785fd47b {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:47:05.583796 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-f7615eee-b570-4c67-8010-648e22572795 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] HTTP exception thrown: Cannot 'rescue' instance f0374fc2-3c0f-48e1-b969-2933785fd47b while it is in vm_state paused Sep 23 04:47:05.585524 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f7615eee-b570-4c67-8010-648e22572795 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Request method failure captured: Sep 23 04:47:05.585524 n-d-846463-3 devstack@n-api.service[122698]: request: POST /compute/v2.1/servers/f0374fc2-3c0f-48e1-b969-2933785fd47b/action HTTP/1.1 Sep 23 04:47:05.585524 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:47:05.585524 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:47:05.585524 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:47:05.585524 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 14 Sep 23 04:47:05.585524 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:47:05.585524 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:47:05.585524 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:47:05.585524 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:47:05.585524 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLToEB3KmJeqpeof3qtE1_ms3jD5q4R8EB4mtf6agEJBYOf3R1k1wW8qdql02e7ra521m3dklynQTAHmyD-EBkyV9p_88fIs_nz1LT08tnPBKYcM8ytHDfif-4FU40Ttv4qlVJY_DNQ2W4b2ZBQdDVOwU9-lTsZtqbQggZ1JBKRn9aZQ Sep 23 04:47:05.585524 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:47:05.585524 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:47:05.585524 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:47:05.585524 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:47:05.585524 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:47:05.585524 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:47:05.585524 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: dcafb05f6f554e278cd552023947c6ac Sep 23 04:47:05.585524 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-196358672 Sep 23 04:47:05.585524 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:47:05.585524 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:47:05.585524 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_dcafb05f6f554e278cd552023947c6ac", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dcafb05f6f554e278cd552023947c6ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/dcafb05f6f554e278cd552023947c6ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dcafb05f6f554e278cd552023947c6ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:47:05.585524 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ServerRescueNegativeTestJSON-196358672 Sep 23 04:47:05.585524 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: dcafb05f6f554e278cd552023947c6ac Sep 23 04:47:05.585524 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-196358672 Sep 23 04:47:05.585524 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ServerRescueNegativeTestJSON-196358672-project Sep 23 04:47:05.585524 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:47:05.585524 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:47:05.585524 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: c786bbedc21849ea92924139a44707b7 Sep 23 04:47:05.585524 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ServerRescueNegativeTestJSON-196358672-project Sep 23 04:47:05.585524 n-d-846463-3 devstack@n-api.service[122698]: Sep 23 04:47:05.585524 n-d-846463-3 devstack@n-api.service[122698]: {"rescue": {}} Sep 23 04:47:05.585524 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:47:05.585524 n-d-846463-3 devstack@n-api.service[122698]: exception: Cannot 'rescue' instance f0374fc2-3c0f-48e1-b969-2933785fd47b while it is in vm_state paused Sep 23 04:47:05.585524 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': 'f0374fc2-3c0f-48e1-b969-2933785fd47b', 'body': {'rescue': {}}} Sep 23 04:47:05.585524 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:47:05.585524 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:05.585524 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Sep 23 04:47:05.585524 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Sep 23 04:47:05.585524 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 23 04:47:05.585524 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 23 04:47:05.585524 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 23 04:47:05.585524 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 23 04:47:05.585524 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 23 04:47:05.585524 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 23 04:47:05.585524 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f0374fc2-3c0f-48e1-b969-2933785fd47b in vm_state paused. Cannot rescue while the instance is in this state. Sep 23 04:47:05.585524 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:47:05.585524 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:47:05.585524 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:47:05.585524 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:05.585524 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:47:05.585524 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:47:05.585524 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:47:05.585524 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:47:05.585524 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:47:05.585524 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:47:05.585524 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:47:05.585524 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:47:05.585524 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Sep 23 04:47:05.585524 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Sep 23 04:47:05.585524 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 23 04:47:05.585524 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 23 04:47:05.585524 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance f0374fc2-3c0f-48e1-b969-2933785fd47b while it is in vm_state paused Sep 23 04:47:05.585524 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:47:05.591501 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:47:05.591501 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:47:05.591501 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:05.591501 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:47:05.591501 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:47:05.591501 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:47:05.591501 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:47:05.591501 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance f0374fc2-3c0f-48e1-b969-2933785fd47b while it is in vm_state paused Sep 23 04:47:05.591501 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:47:05.591501 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f7615eee-b570-4c67-8010-648e22572795 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Returning 409 to user: Cannot 'rescue' instance f0374fc2-3c0f-48e1-b969-2933785fd47b while it is in vm_state paused {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:47:05.591501 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f7615eee-b570-4c67-8010-648e22572795 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "POST /compute/v2.1/servers/f0374fc2-3c0f-48e1-b969-2933785fd47b/action" status: 409 len: 144 microversion: 2.1 time: 0.122641 Sep 23 04:47:05.598396 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1755/3562] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:47:05 2022] POST /compute/v2.1/servers/f0374fc2-3c0f-48e1-b969-2933785fd47b/action => generated 144 bytes in 132 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 23 04:47:05.603394 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6b894778-a547-4bee-bb2d-bc9d8a9d5474 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:05.608783 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-6b894778-a547-4bee-bb2d-bc9d8a9d5474 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 28be637b-c43c-4881-b2ce-efb1ec1ad812] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:05.624364 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6b894778-a547-4bee-bb2d-bc9d8a9d5474 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:05.625203 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6b894778-a547-4bee-bb2d-bc9d8a9d5474 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:05.626759 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6b894778-a547-4bee-bb2d-bc9d8a9d5474 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:05.627687 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6b894778-a547-4bee-bb2d-bc9d8a9d5474 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:05.630944 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6b894778-a547-4bee-bb2d-bc9d8a9d5474 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:05.631690 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6b894778-a547-4bee-bb2d-bc9d8a9d5474 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:05.751406 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b84d6b17-e078-46fa-b264-2e6192425d23 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:05.767543 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b84d6b17-e078-46fa-b264-2e6192425d23 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:05.771841 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b84d6b17-e078-46fa-b264-2e6192425d23 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:05.780073 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b84d6b17-e078-46fa-b264-2e6192425d23 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9" status: 200 len: 1406 microversion: 2.20 time: 0.456942 Sep 23 04:47:05.781840 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1808/3563] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:47:05 2022] GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9 => generated 1406 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:47:05.802085 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-634fb7c7-8c8c-4691-a14a-c3e3f1aa7406 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '.version_select at 0x7ff1ba9dce50>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:06.000590 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6b894778-a547-4bee-bb2d-bc9d8a9d5474 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:06.014487 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-6b894778-a547-4bee-bb2d-bc9d8a9d5474 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/28be637b-c43c-4881-b2ce-efb1ec1ad812" status: 200 len: 1509 microversion: 2.1 time: 0.411767 Sep 23 04:47:06.017111 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1756/3564] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:05 2022] GET /compute/v2.1/servers/28be637b-c43c-4881-b2ce-efb1ec1ad812 => generated 1509 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:06.031957 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c3a73f82-ccdb-45c4-b359-c4c5c40c9aef tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:47:06.033440 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c3a73f82-ccdb-45c4-b359-c4c5c40c9aef tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: f0374fc2-3c0f-48e1-b969-2933785fd47b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:06.043221 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c3a73f82-ccdb-45c4-b359-c4c5c40c9aef tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:06.043912 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c3a73f82-ccdb-45c4-b359-c4c5c40c9aef tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:06.044730 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c3a73f82-ccdb-45c4-b359-c4c5c40c9aef tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:06.045664 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c3a73f82-ccdb-45c4-b359-c4c5c40c9aef tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:06.046459 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c3a73f82-ccdb-45c4-b359-c4c5c40c9aef tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:06.047329 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c3a73f82-ccdb-45c4-b359-c4c5c40c9aef tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:06.436987 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c3a73f82-ccdb-45c4-b359-c4c5c40c9aef tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "POST /compute/v2.1/servers/f0374fc2-3c0f-48e1-b969-2933785fd47b/action" status: 202 len: 0 microversion: 2.1 time: 0.418220 Sep 23 04:47:06.442134 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1757/3565] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:47:06 2022] POST /compute/v2.1/servers/f0374fc2-3c0f-48e1-b969-2933785fd47b/action => generated 0 bytes in 424 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:47:06.477217 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-20639018-1375-4868-b294-f60f5807fb27 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:06.481664 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-20639018-1375-4868-b294-f60f5807fb27 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:06.513101 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-20639018-1375-4868-b294-f60f5807fb27 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:06.519091 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-20639018-1375-4868-b294-f60f5807fb27 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:06.519555 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-20639018-1375-4868-b294-f60f5807fb27 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:06.520311 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-20639018-1375-4868-b294-f60f5807fb27 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:06.577208 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-20639018-1375-4868-b294-f60f5807fb27 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:06.583383 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-20639018-1375-4868-b294-f60f5807fb27 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.060s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:07.206533 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-20639018-1375-4868-b294-f60f5807fb27 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:07.237212 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-20639018-1375-4868-b294-f60f5807fb27 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1364 microversion: 2.1 time: 0.790193 Sep 23 04:47:07.240153 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1758/3566] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:06 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1364 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:07.251576 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0d8b0567-34ee-4848-8932-8974eb1fb813 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '.version_select at 0x7ff1baa6c430>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:08.284548 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=4 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:47:11.730428 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0d8b0567-34ee-4848-8932-8974eb1fb813 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/images/5ca97cbe-84e0-43f6-8385-3c16932e4f48" status: 200 len: 1449 microversion: 2.1 time: 4.488813 Sep 23 04:47:11.733260 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-634fb7c7-8c8c-4691-a14a-c3e3f1aa7406 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "GET /compute/v2.1/images/ff150c0b-96d0-4d15-b6c3-7e2dc172a34c" status: 200 len: 1454 microversion: 2.1 time: 5.947828 Sep 23 04:47:11.752001 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1759/3567] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:47:07 2022] GET /compute/v2.1/images/5ca97cbe-84e0-43f6-8385-3c16932e4f48 => generated 1449 bytes in 4511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:11.753739 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1809/3568] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:47:05 2022] GET /compute/v2.1/images/ff150c0b-96d0-4d15-b6c3-7e2dc172a34c => generated 1454 bytes in 5970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:11.759005 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1e0df0b6-6516-4552-af0f-05bd7760d407 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:11.759644 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1e0df0b6-6516-4552-af0f-05bd7760d407 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] [instance: f6413c5e-771f-45c5-94a8-b197becc0815] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:11.764309 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:47:11.767716 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e0c42ef7-43e3-415a-9d86-62548da0e614 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:11.768377 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e0c42ef7-43e3-415a-9d86-62548da0e614 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: f0374fc2-3c0f-48e1-b969-2933785fd47b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:11.783243 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e0df0b6-6516-4552-af0f-05bd7760d407 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:11.783746 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e0df0b6-6516-4552-af0f-05bd7760d407 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:11.784192 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e0df0b6-6516-4552-af0f-05bd7760d407 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:11.784911 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e0df0b6-6516-4552-af0f-05bd7760d407 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:11.785428 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e0df0b6-6516-4552-af0f-05bd7760d407 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:11.785859 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e0df0b6-6516-4552-af0f-05bd7760d407 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:11.789732 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e0c42ef7-43e3-415a-9d86-62548da0e614 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:11.789997 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e0c42ef7-43e3-415a-9d86-62548da0e614 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:11.790282 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e0c42ef7-43e3-415a-9d86-62548da0e614 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:11.803428 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e0c42ef7-43e3-415a-9d86-62548da0e614 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:11.805237 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e0c42ef7-43e3-415a-9d86-62548da0e614 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:11.805969 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e0c42ef7-43e3-415a-9d86-62548da0e614 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:12.099305 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1e0df0b6-6516-4552-af0f-05bd7760d407 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a245dd82de1340f7a58873de1851c61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d02cb07a2a404c8d89aa13a950806d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:12.113088 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1e0df0b6-6516-4552-af0f-05bd7760d407 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] 10.222.0.33 "GET /compute/v2.1/servers/f6413c5e-771f-45c5-94a8-b197becc0815" status: 200 len: 1325 microversion: 2.1 time: 0.353675 Sep 23 04:47:12.113088 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1810/3569] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:11 2022] GET /compute/v2.1/servers/f6413c5e-771f-45c5-94a8-b197becc0815 => generated 1325 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:12.115171 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a0438f23-5780-4ad7-93e9-d35c37cf1604 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:12.116235 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a0438f23-5780-4ad7-93e9-d35c37cf1604 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: fe7dee09-8351-4d41-8c44-8d35a966cce9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:12.123191 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a0438f23-5780-4ad7-93e9-d35c37cf1604 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:12.124107 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a0438f23-5780-4ad7-93e9-d35c37cf1604 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:12.125395 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a0438f23-5780-4ad7-93e9-d35c37cf1604 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:12.126938 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a0438f23-5780-4ad7-93e9-d35c37cf1604 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:12.127486 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a0438f23-5780-4ad7-93e9-d35c37cf1604 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:12.128099 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a0438f23-5780-4ad7-93e9-d35c37cf1604 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:12.131934 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e0c42ef7-43e3-415a-9d86-62548da0e614 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c786bbedc21849ea92924139a44707b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcafb05f6f554e278cd552023947c6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:12.144359 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e0c42ef7-43e3-415a-9d86-62548da0e614 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/f0374fc2-3c0f-48e1-b969-2933785fd47b" status: 200 len: 1515 microversion: 2.1 time: 0.390868 Sep 23 04:47:12.161915 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1760/3570] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:11 2022] GET /compute/v2.1/servers/f0374fc2-3c0f-48e1-b969-2933785fd47b => generated 1515 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:12.187383 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-cbc2ad72-902b-4d7d-80b8-b94850a1465d tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:12.188608 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-cbc2ad72-902b-4d7d-80b8-b94850a1465d tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 28be637b-c43c-4881-b2ce-efb1ec1ad812] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:12.195576 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cbc2ad72-902b-4d7d-80b8-b94850a1465d tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:12.196355 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cbc2ad72-902b-4d7d-80b8-b94850a1465d tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:12.197004 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cbc2ad72-902b-4d7d-80b8-b94850a1465d tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:12.198758 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cbc2ad72-902b-4d7d-80b8-b94850a1465d tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:12.199661 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cbc2ad72-902b-4d7d-80b8-b94850a1465d tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:12.200532 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cbc2ad72-902b-4d7d-80b8-b94850a1465d tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:12.545792 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-cbc2ad72-902b-4d7d-80b8-b94850a1465d tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:12.559616 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-cbc2ad72-902b-4d7d-80b8-b94850a1465d tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/28be637b-c43c-4881-b2ce-efb1ec1ad812" status: 200 len: 1509 microversion: 2.1 time: 0.402719 Sep 23 04:47:12.562776 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1761/3571] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:12 2022] GET /compute/v2.1/servers/28be637b-c43c-4881-b2ce-efb1ec1ad812 => generated 1509 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:12.570542 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a0438f23-5780-4ad7-93e9-d35c37cf1604 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:12.571139 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5fb21f0d-c0b4-4f25-ae59-3c0af315f77c tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:12.571939 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5fb21f0d-c0b4-4f25-ae59-3c0af315f77c tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:12.580922 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5fb21f0d-c0b4-4f25-ae59-3c0af315f77c tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:12.581696 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5fb21f0d-c0b4-4f25-ae59-3c0af315f77c tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:12.582824 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5fb21f0d-c0b4-4f25-ae59-3c0af315f77c tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:12.590103 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5fb21f0d-c0b4-4f25-ae59-3c0af315f77c tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:12.590103 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5fb21f0d-c0b4-4f25-ae59-3c0af315f77c tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:12.590103 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5fb21f0d-c0b4-4f25-ae59-3c0af315f77c tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:12.590390 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a0438f23-5780-4ad7-93e9-d35c37cf1604 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:12.591394 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:47:12.593094 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a0438f23-5780-4ad7-93e9-d35c37cf1604 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:12.594425 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a0438f23-5780-4ad7-93e9-d35c37cf1604 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9" status: 200 len: 1406 microversion: 2.20 time: 0.484144 Sep 23 04:47:12.610326 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1811/3572] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:47:12 2022] GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9 => generated 1406 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:47:12.618705 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-56a5dda6-61f3-4149-b114-77f435222ce5 req-1c111b19-fb52-45c6-ba11-d3a9816f2cf9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fb569cf-4457-4695-ad5f-fcb78f0964c5", "tag": "8fdad197-55e1-4686-bfa9-6cfa0beb24d5"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:47:12.630429 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-56a5dda6-61f3-4149-b114-77f435222ce5 req-1c111b19-fb52-45c6-ba11-d3a9816f2cf9 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:12.631387 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-56a5dda6-61f3-4149-b114-77f435222ce5 req-1c111b19-fb52-45c6-ba11-d3a9816f2cf9 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:12.632105 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-56a5dda6-61f3-4149-b114-77f435222ce5 req-1c111b19-fb52-45c6-ba11-d3a9816f2cf9 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:12.646247 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-56a5dda6-61f3-4149-b114-77f435222ce5 req-1c111b19-fb52-45c6-ba11-d3a9816f2cf9 service nova] Creating event network-changed:8fdad197-55e1-4686-bfa9-6cfa0beb24d5 for instance 4fb569cf-4457-4695-ad5f-fcb78f0964c5 on n-h2-846463-3 Sep 23 04:47:12.651918 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-56a5dda6-61f3-4149-b114-77f435222ce5 req-1c111b19-fb52-45c6-ba11-d3a9816f2cf9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040138 Sep 23 04:47:12.652888 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1812/3573] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:47:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:47:12.659539 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-b1478a25-8a8e-4e4c-a5b4-00df0a0a034c req-8a9cc83a-478a-4663-94ee-b888a6bc12c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "401339a4-8674-4ff9-b09e-ba748f46928d", "name": "network-vif-plugged", "status": "completed", "tag": "ee716fd2-ccf3-4c05-b155-29bb9a5565c2"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:47:12.671498 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-b1478a25-8a8e-4e4c-a5b4-00df0a0a034c req-8a9cc83a-478a-4663-94ee-b888a6bc12c4 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:12.672337 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-b1478a25-8a8e-4e4c-a5b4-00df0a0a034c req-8a9cc83a-478a-4663-94ee-b888a6bc12c4 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:12.673203 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-b1478a25-8a8e-4e4c-a5b4-00df0a0a034c req-8a9cc83a-478a-4663-94ee-b888a6bc12c4 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:12.685399 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:47:12.688553 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-b1478a25-8a8e-4e4c-a5b4-00df0a0a034c req-8a9cc83a-478a-4663-94ee-b888a6bc12c4 service nova] Creating event network-vif-plugged:ee716fd2-ccf3-4c05-b155-29bb9a5565c2 for instance 401339a4-8674-4ff9-b09e-ba748f46928d on n-h1-846463-3 Sep 23 04:47:12.699338 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-b1478a25-8a8e-4e4c-a5b4-00df0a0a034c req-8a9cc83a-478a-4663-94ee-b888a6bc12c4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041455 Sep 23 04:47:12.699338 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1813/3574] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:47:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:47:12.704158 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9a6737ec-1941-4f2c-81ee-d6cf7977b822 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '.version_select at 0x7ff1c0c51160>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:12.802354 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-9a6737ec-1941-4f2c-81ee-d6cf7977b822 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/images/5ca97cbe-84e0-43f6-8385-3c16932e4f48" status: 200 len: 1449 microversion: 2.1 time: 0.103873 Sep 23 04:47:12.815483 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1814/3575] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:47:12 2022] GET /compute/v2.1/images/5ca97cbe-84e0-43f6-8385-3c16932e4f48 => generated 1449 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:12.828963 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-bc054746-a958-4b2d-a9bf-f5fe4e265d14 req-f6b8ad32-e342-4563-9d3a-125be5a2433b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6413c5e-771f-45c5-94a8-b197becc0815", "tag": "050c3a35-71cb-4639-af15-aff3db06b6cf"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:47:12.848457 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-bc054746-a958-4b2d-a9bf-f5fe4e265d14 req-f6b8ad32-e342-4563-9d3a-125be5a2433b service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:12.850579 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-bc054746-a958-4b2d-a9bf-f5fe4e265d14 req-f6b8ad32-e342-4563-9d3a-125be5a2433b service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:12.855101 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-bc054746-a958-4b2d-a9bf-f5fe4e265d14 req-f6b8ad32-e342-4563-9d3a-125be5a2433b service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:12.877066 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-bc054746-a958-4b2d-a9bf-f5fe4e265d14 req-f6b8ad32-e342-4563-9d3a-125be5a2433b service nova] Creating event network-changed:050c3a35-71cb-4639-af15-aff3db06b6cf for instance f6413c5e-771f-45c5-94a8-b197becc0815 on n-h2-846463-3 Sep 23 04:47:12.890117 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-bc054746-a958-4b2d-a9bf-f5fe4e265d14 req-f6b8ad32-e342-4563-9d3a-125be5a2433b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072914 Sep 23 04:47:12.891300 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1815/3576] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:47:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:47:12.908192 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-31fe621e-9914-4875-8a3f-51352eec23af tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '.version_select at 0x7ff1ba9c7b80>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:13.007702 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-31fe621e-9914-4875-8a3f-51352eec23af tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "GET /compute/v2.1/images/ff150c0b-96d0-4d15-b6c3-7e2dc172a34c" status: 200 len: 1454 microversion: 2.1 time: 0.114937 Sep 23 04:47:13.009797 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1816/3577] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:47:12 2022] GET /compute/v2.1/images/ff150c0b-96d0-4d15-b6c3-7e2dc172a34c => generated 1454 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:13.024474 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7f7ccb9c-d784-45cd-a87a-a70bbb5eaeaf tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '.version_select at 0x7ff1ba9de820>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:13.184811 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-5fb21f0d-c0b4-4f25-ae59-3c0af315f77c tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:13.194806 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5fb21f0d-c0b4-4f25-ae59-3c0af315f77c tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1364 microversion: 2.1 time: 0.629397 Sep 23 04:47:13.201004 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1762/3578] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:12 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1364 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:13.224815 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-67fa796a-26d1-4f45-89e0-3db802cd22f0 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:13.226216 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-67fa796a-26d1-4f45-89e0-3db802cd22f0 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] [instance: f6413c5e-771f-45c5-94a8-b197becc0815] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:13.249332 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-67fa796a-26d1-4f45-89e0-3db802cd22f0 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:13.250654 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-67fa796a-26d1-4f45-89e0-3db802cd22f0 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:13.257296 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-67fa796a-26d1-4f45-89e0-3db802cd22f0 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:13.263926 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-67fa796a-26d1-4f45-89e0-3db802cd22f0 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:13.263926 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-67fa796a-26d1-4f45-89e0-3db802cd22f0 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:13.263926 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-67fa796a-26d1-4f45-89e0-3db802cd22f0 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:13.806854 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-67fa796a-26d1-4f45-89e0-3db802cd22f0 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a245dd82de1340f7a58873de1851c61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d02cb07a2a404c8d89aa13a950806d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:13.816336 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-67fa796a-26d1-4f45-89e0-3db802cd22f0 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] 10.222.0.33 "GET /compute/v2.1/servers/f6413c5e-771f-45c5-94a8-b197becc0815" status: 200 len: 1325 microversion: 2.1 time: 0.613929 Sep 23 04:47:13.824354 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1763/3579] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:13 2022] GET /compute/v2.1/servers/f6413c5e-771f-45c5-94a8-b197becc0815 => generated 1325 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:13.833802 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a5c697e8-56a7-47eb-9f37-60b7e8e3198d tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:13.839849 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a5c697e8-56a7-47eb-9f37-60b7e8e3198d tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 28be637b-c43c-4881-b2ce-efb1ec1ad812] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:13.868949 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a5c697e8-56a7-47eb-9f37-60b7e8e3198d tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:13.872135 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a5c697e8-56a7-47eb-9f37-60b7e8e3198d tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:13.872865 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a5c697e8-56a7-47eb-9f37-60b7e8e3198d tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:13.880523 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a5c697e8-56a7-47eb-9f37-60b7e8e3198d tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:13.881277 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a5c697e8-56a7-47eb-9f37-60b7e8e3198d tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:13.883306 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a5c697e8-56a7-47eb-9f37-60b7e8e3198d tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:14.048986 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:47:14.129119 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=10 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:47:14.387099 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a5c697e8-56a7-47eb-9f37-60b7e8e3198d tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:14.399160 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a5c697e8-56a7-47eb-9f37-60b7e8e3198d tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/28be637b-c43c-4881-b2ce-efb1ec1ad812" status: 200 len: 1509 microversion: 2.1 time: 0.573496 Sep 23 04:47:14.405421 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1764/3580] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:13 2022] GET /compute/v2.1/servers/28be637b-c43c-4881-b2ce-efb1ec1ad812 => generated 1509 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:14.411160 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b8ee4250-eb47-41d7-a730-8031ff7ab5f5 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:14.411764 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b8ee4250-eb47-41d7-a730-8031ff7ab5f5 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: fe7dee09-8351-4d41-8c44-8d35a966cce9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:14.433590 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b8ee4250-eb47-41d7-a730-8031ff7ab5f5 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:14.434190 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b8ee4250-eb47-41d7-a730-8031ff7ab5f5 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:14.434632 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b8ee4250-eb47-41d7-a730-8031ff7ab5f5 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:14.435345 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b8ee4250-eb47-41d7-a730-8031ff7ab5f5 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:14.435804 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b8ee4250-eb47-41d7-a730-8031ff7ab5f5 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:14.436229 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b8ee4250-eb47-41d7-a730-8031ff7ab5f5 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:14.713386 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-7f7ccb9c-d784-45cd-a87a-a70bbb5eaeaf tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "DELETE /compute/v2.1/images/5ca97cbe-84e0-43f6-8385-3c16932e4f48" status: 204 len: 0 microversion: 2.1 time: 1.693304 Sep 23 04:47:14.717138 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1817/3581] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:13 2022] DELETE /compute/v2.1/images/5ca97cbe-84e0-43f6-8385-3c16932e4f48 => generated 0 bytes in 1695 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:47:14.721937 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6a0dea49-93bb-4e69-9b09-cc79c25824ac tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '.version_select at 0x7ff1ba9dcb80>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:14.737787 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b8ee4250-eb47-41d7-a730-8031ff7ab5f5 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:14.747217 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b8ee4250-eb47-41d7-a730-8031ff7ab5f5 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:14.748674 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b8ee4250-eb47-41d7-a730-8031ff7ab5f5 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:14.749812 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b8ee4250-eb47-41d7-a730-8031ff7ab5f5 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9" status: 200 len: 1406 microversion: 2.20 time: 0.342603 Sep 23 04:47:14.783732 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6a0dea49-93bb-4e69-9b09-cc79c25824ac tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "GET /compute/v2.1/images/ff150c0b-96d0-4d15-b6c3-7e2dc172a34c" status: 200 len: 1454 microversion: 2.1 time: 0.065503 Sep 23 04:47:14.784306 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1818/3582] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:47:14 2022] GET /compute/v2.1/images/ff150c0b-96d0-4d15-b6c3-7e2dc172a34c => generated 1454 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:14.786212 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1765/3583] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:47:14 2022] GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9 => generated 1406 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:47:14.790836 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-a31096a3-01ee-4001-9944-b29127bc52f6 req-e5574775-c533-4250-96eb-2daba615a1d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe7dee09-8351-4d41-8c44-8d35a966cce9", "name": "network-vif-plugged", "status": "completed", "tag": "c9b47e66-2bb6-4e68-a2b9-4fb9fec9ff30"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:47:14.800008 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-81cefb1f-e346-452c-921c-214027f522a5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:14.800767 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-81cefb1f-e346-452c-921c-214027f522a5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:14.808649 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-a31096a3-01ee-4001-9944-b29127bc52f6 req-e5574775-c533-4250-96eb-2daba615a1d6 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:14.809926 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-81cefb1f-e346-452c-921c-214027f522a5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:14.810681 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-81cefb1f-e346-452c-921c-214027f522a5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:14.811406 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-81cefb1f-e346-452c-921c-214027f522a5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:14.812742 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-a31096a3-01ee-4001-9944-b29127bc52f6 req-e5574775-c533-4250-96eb-2daba615a1d6 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:14.812937 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-a31096a3-01ee-4001-9944-b29127bc52f6 req-e5574775-c533-4250-96eb-2daba615a1d6 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:14.813512 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-81cefb1f-e346-452c-921c-214027f522a5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:14.814017 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-81cefb1f-e346-452c-921c-214027f522a5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:14.814460 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-81cefb1f-e346-452c-921c-214027f522a5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:14.826408 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-a31096a3-01ee-4001-9944-b29127bc52f6 req-e5574775-c533-4250-96eb-2daba615a1d6 service nova] Creating event network-vif-plugged:c9b47e66-2bb6-4e68-a2b9-4fb9fec9ff30 for instance fe7dee09-8351-4d41-8c44-8d35a966cce9 on n-h2-846463-3 Sep 23 04:47:14.831918 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-a31096a3-01ee-4001-9944-b29127bc52f6 req-e5574775-c533-4250-96eb-2daba615a1d6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044465 Sep 23 04:47:14.837923 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1766/3584] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:47:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:47:14.843620 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-02d2a356-845d-49f9-b611-948644b04f09 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:14.844910 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-02d2a356-845d-49f9-b611-948644b04f09 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] [instance: 0fff1fd4-972c-4268-89fd-92b784244edf] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:14.853157 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-02d2a356-845d-49f9-b611-948644b04f09 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:14.854022 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-02d2a356-845d-49f9-b611-948644b04f09 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:14.854715 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-02d2a356-845d-49f9-b611-948644b04f09 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:14.855661 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-02d2a356-845d-49f9-b611-948644b04f09 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:14.856484 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-02d2a356-845d-49f9-b611-948644b04f09 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:14.857146 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-02d2a356-845d-49f9-b611-948644b04f09 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:14.896214 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-02d2a356-845d-49f9-b611-948644b04f09 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] [instance: 0fff1fd4-972c-4268-89fd-92b784244edf] Going to try to terminate instance {{(pid=122698) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:47:15.032019 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-81cefb1f-e346-452c-921c-214027f522a5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:15.049721 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-81cefb1f-e346-452c-921c-214027f522a5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1364 microversion: 2.1 time: 0.264354 Sep 23 04:47:15.053355 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1819/3585] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:14 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1364 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:15.069778 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ca537c31-e185-4b2e-aa48-6a9c9be8d746 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:15.070717 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ca537c31-e185-4b2e-aa48-6a9c9be8d746 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] [instance: f6413c5e-771f-45c5-94a8-b197becc0815] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:15.080116 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ca537c31-e185-4b2e-aa48-6a9c9be8d746 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:15.080814 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ca537c31-e185-4b2e-aa48-6a9c9be8d746 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:15.081267 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ca537c31-e185-4b2e-aa48-6a9c9be8d746 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:15.082071 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ca537c31-e185-4b2e-aa48-6a9c9be8d746 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:15.082539 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ca537c31-e185-4b2e-aa48-6a9c9be8d746 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:15.082974 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ca537c31-e185-4b2e-aa48-6a9c9be8d746 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:15.366386 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-02d2a356-845d-49f9-b611-948644b04f09 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "DELETE /compute/v2.1/servers/0fff1fd4-972c-4268-89fd-92b784244edf" status: 204 len: 0 microversion: 2.1 time: 0.526634 Sep 23 04:47:15.371181 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1767/3586] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:47:14 2022] DELETE /compute/v2.1/servers/0fff1fd4-972c-4268-89fd-92b784244edf => generated 0 bytes in 529 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:47:15.431413 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c4bc57b8-f7f4-4f94-ae00-c1a2d02230fc tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:15.432167 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c4bc57b8-f7f4-4f94-ae00-c1a2d02230fc tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 28be637b-c43c-4881-b2ce-efb1ec1ad812] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:15.444406 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c4bc57b8-f7f4-4f94-ae00-c1a2d02230fc tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:15.444754 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c4bc57b8-f7f4-4f94-ae00-c1a2d02230fc tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:15.445265 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c4bc57b8-f7f4-4f94-ae00-c1a2d02230fc tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:15.447262 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c4bc57b8-f7f4-4f94-ae00-c1a2d02230fc tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:15.447979 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c4bc57b8-f7f4-4f94-ae00-c1a2d02230fc tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:15.448593 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c4bc57b8-f7f4-4f94-ae00-c1a2d02230fc tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:15.449505 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=24 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:47:15.919294 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ca537c31-e185-4b2e-aa48-6a9c9be8d746 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a245dd82de1340f7a58873de1851c61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d02cb07a2a404c8d89aa13a950806d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:15.937826 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ca537c31-e185-4b2e-aa48-6a9c9be8d746 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] 10.222.0.33 "GET /compute/v2.1/servers/f6413c5e-771f-45c5-94a8-b197becc0815" status: 200 len: 1325 microversion: 2.1 time: 0.882288 Sep 23 04:47:15.940417 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1820/3587] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:15 2022] GET /compute/v2.1/servers/f6413c5e-771f-45c5-94a8-b197becc0815 => generated 1325 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:15.952972 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4ab99928-833a-40b8-a7f8-ee590fd7974e tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-971256722", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "networks": [{"uuid": "ba35f7e0-9420-45ef-a251-5988b98046ec"}]}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:47:16.010473 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c4bc57b8-f7f4-4f94-ae00-c1a2d02230fc tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:16.029186 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c4bc57b8-f7f4-4f94-ae00-c1a2d02230fc tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/28be637b-c43c-4881-b2ce-efb1ec1ad812" status: 200 len: 1509 microversion: 2.1 time: 0.595249 Sep 23 04:47:16.036731 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1768/3588] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:15 2022] GET /compute/v2.1/servers/28be637b-c43c-4881-b2ce-efb1ec1ad812 => generated 1509 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:47:16.037403 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.neutron [None req-4ab99928-833a-40b8-a7f8-ee590fd7974e tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] validate_networks() for [('ba35f7e0-9420-45ef-a251-5988b98046ec', None, None, None, None, None)] {{(pid=122699) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:47:16.044864 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-247acdcb-f4f9-4369-9aff-8aed461f9e07 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:47:16.055801 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-247acdcb-f4f9-4369-9aff-8aed461f9e07 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: f0374fc2-3c0f-48e1-b969-2933785fd47b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:16.063365 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-247acdcb-f4f9-4369-9aff-8aed461f9e07 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:16.064186 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-247acdcb-f4f9-4369-9aff-8aed461f9e07 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:16.065120 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-247acdcb-f4f9-4369-9aff-8aed461f9e07 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:16.066806 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-247acdcb-f4f9-4369-9aff-8aed461f9e07 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:16.067958 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-247acdcb-f4f9-4369-9aff-8aed461f9e07 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:16.069766 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-247acdcb-f4f9-4369-9aff-8aed461f9e07 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:16.115682 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-247acdcb-f4f9-4369-9aff-8aed461f9e07 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lazy-loading 'flavor' on Instance uuid f0374fc2-3c0f-48e1-b969-2933785fd47b {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:47:16.555823 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-247acdcb-f4f9-4369-9aff-8aed461f9e07 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "POST /compute/v2.1/servers/f0374fc2-3c0f-48e1-b969-2933785fd47b/action" status: 200 len: 32 microversion: 2.1 time: 0.517273 Sep 23 04:47:16.557646 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-4ab99928-833a-40b8-a7f8-ee590fd7974e tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Flavor limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:47:16.558127 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-4ab99928-833a-40b8-a7f8-ee590fd7974e tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Image limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:47:16.558558 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-4ab99928-833a-40b8-a7f8-ee590fd7974e tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Flavor pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:47:16.559194 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-4ab99928-833a-40b8-a7f8-ee590fd7974e tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Image pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:47:16.559791 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-4ab99928-833a-40b8-a7f8-ee590fd7974e tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:47:16.563244 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1769/3589] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:47:16 2022] POST /compute/v2.1/servers/f0374fc2-3c0f-48e1-b969-2933785fd47b/action => generated 32 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 04:47:16.570535 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-fc7f49ea-5f9c-4eef-b287-224fb19aeb66 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:16.572146 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-fc7f49ea-5f9c-4eef-b287-224fb19aeb66 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: fe7dee09-8351-4d41-8c44-8d35a966cce9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:16.574519 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:47:16.582063 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4ab99928-833a-40b8-a7f8-ee590fd7974e tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:16.582063 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4ab99928-833a-40b8-a7f8-ee590fd7974e tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:16.582063 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4ab99928-833a-40b8-a7f8-ee590fd7974e tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:16.582417 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fc7f49ea-5f9c-4eef-b287-224fb19aeb66 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:16.582417 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fc7f49ea-5f9c-4eef-b287-224fb19aeb66 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:16.582632 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4ab99928-833a-40b8-a7f8-ee590fd7974e tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:16.582747 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fc7f49ea-5f9c-4eef-b287-224fb19aeb66 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:16.582854 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4ab99928-833a-40b8-a7f8-ee590fd7974e tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:16.582967 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fc7f49ea-5f9c-4eef-b287-224fb19aeb66 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:16.582967 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fc7f49ea-5f9c-4eef-b287-224fb19aeb66 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:16.583155 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4ab99928-833a-40b8-a7f8-ee590fd7974e tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:16.583821 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fc7f49ea-5f9c-4eef-b287-224fb19aeb66 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:16.603262 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-4ab99928-833a-40b8-a7f8-ee590fd7974e tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Getting quotas for project 7c43f2b70bc74a48b62fb4115337f073. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:47:16.610920 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-4ab99928-833a-40b8-a7f8-ee590fd7974e tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Getting quotas for user c11980041918484990dac709544d0b42 and project 7c43f2b70bc74a48b62fb4115337f073. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:47:16.626104 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4ab99928-833a-40b8-a7f8-ee590fd7974e tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Going to run 1 instances... {{(pid=122699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:47:16.629027 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4ab99928-833a-40b8-a7f8-ee590fd7974e tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] [instance: 53c2eac1-c886-45f2-8b2c-77aa98ceaab5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:47:16.728411 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-fc7f49ea-5f9c-4eef-b287-224fb19aeb66 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:16.741826 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-fc7f49ea-5f9c-4eef-b287-224fb19aeb66 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:16.745313 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-fc7f49ea-5f9c-4eef-b287-224fb19aeb66 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:16.745538 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-fc7f49ea-5f9c-4eef-b287-224fb19aeb66 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9" status: 200 len: 1406 microversion: 2.20 time: 0.179966 Sep 23 04:47:16.746293 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1770/3590] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:47:16 2022] GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9 => generated 1406 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:47:16.751086 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e29b8b01-b0ac-43f2-9894-587ceccedd8a tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '.version_select at 0x7ff1ba89b550>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:16.780191 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4ab99928-833a-40b8-a7f8-ee590fd7974e tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.837269 Sep 23 04:47:16.781207 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1821/3591] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:47:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 840 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:47:16.786715 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-23221f25-8e1f-4890-acb0-ab69868a9176 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:16.787699 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-23221f25-8e1f-4890-acb0-ab69868a9176 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:16.794769 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-23221f25-8e1f-4890-acb0-ab69868a9176 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:16.795826 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-23221f25-8e1f-4890-acb0-ab69868a9176 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:16.796457 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-23221f25-8e1f-4890-acb0-ab69868a9176 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:16.797356 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-23221f25-8e1f-4890-acb0-ab69868a9176 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:16.798124 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-23221f25-8e1f-4890-acb0-ab69868a9176 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:16.798428 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-23221f25-8e1f-4890-acb0-ab69868a9176 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:16.814990 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e29b8b01-b0ac-43f2-9894-587ceccedd8a tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "GET /compute/v2.1/images/ff150c0b-96d0-4d15-b6c3-7e2dc172a34c" status: 200 len: 1454 microversion: 2.1 time: 0.067265 Sep 23 04:47:16.825939 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1771/3592] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:47:16 2022] GET /compute/v2.1/images/ff150c0b-96d0-4d15-b6c3-7e2dc172a34c => generated 1454 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:16.833155 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-bb40aaed-02ff-479b-a090-bee9c45d8051 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:16.834063 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-bb40aaed-02ff-479b-a090-bee9c45d8051 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: f0374fc2-3c0f-48e1-b969-2933785fd47b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:16.844221 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bb40aaed-02ff-479b-a090-bee9c45d8051 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:16.845035 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bb40aaed-02ff-479b-a090-bee9c45d8051 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:16.845786 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bb40aaed-02ff-479b-a090-bee9c45d8051 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:16.846892 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bb40aaed-02ff-479b-a090-bee9c45d8051 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:16.847563 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bb40aaed-02ff-479b-a090-bee9c45d8051 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:16.848233 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bb40aaed-02ff-479b-a090-bee9c45d8051 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:17.168483 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-23221f25-8e1f-4890-acb0-ab69868a9176 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:17.178052 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-23221f25-8e1f-4890-acb0-ab69868a9176 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1364 microversion: 2.1 time: 0.395445 Sep 23 04:47:17.184655 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1822/3593] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:16 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1364 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:17.189678 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4b9b5306-9e74-4302-b056-61cd7e19f0f8 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:17.191492 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4b9b5306-9e74-4302-b056-61cd7e19f0f8 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] [instance: 53c2eac1-c886-45f2-8b2c-77aa98ceaab5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:17.234288 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-bb40aaed-02ff-479b-a090-bee9c45d8051 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c786bbedc21849ea92924139a44707b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcafb05f6f554e278cd552023947c6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:17.251520 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-bb40aaed-02ff-479b-a090-bee9c45d8051 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/f0374fc2-3c0f-48e1-b969-2933785fd47b" status: 200 len: 1521 microversion: 2.1 time: 0.415169 Sep 23 04:47:17.254449 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1772/3594] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:16 2022] GET /compute/v2.1/servers/f0374fc2-3c0f-48e1-b969-2933785fd47b => generated 1521 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:17.267583 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-c019ee9f-80e8-482b-a532-93079cba4aed req-f0a8c188-c5f3-420b-a64f-3cdd6e86dcde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fb569cf-4457-4695-ad5f-fcb78f0964c5", "name": "network-vif-plugged", "status": "completed", "tag": "8fdad197-55e1-4686-bfa9-6cfa0beb24d5"}, {"server_uuid": "0fff1fd4-972c-4268-89fd-92b784244edf", "name": "network-vif-unplugged", "status": "completed", "tag": "1b7def80-2c6f-4b50-8986-20b3ff92ff59"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:47:17.285732 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-c019ee9f-80e8-482b-a532-93079cba4aed req-f0a8c188-c5f3-420b-a64f-3cdd6e86dcde service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:17.286170 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-c019ee9f-80e8-482b-a532-93079cba4aed req-f0a8c188-c5f3-420b-a64f-3cdd6e86dcde service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:17.286665 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-c019ee9f-80e8-482b-a532-93079cba4aed req-f0a8c188-c5f3-420b-a64f-3cdd6e86dcde service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:17.305160 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-c019ee9f-80e8-482b-a532-93079cba4aed req-f0a8c188-c5f3-420b-a64f-3cdd6e86dcde service nova] Creating event network-vif-plugged:8fdad197-55e1-4686-bfa9-6cfa0beb24d5 for instance 4fb569cf-4457-4695-ad5f-fcb78f0964c5 on n-h2-846463-3 Sep 23 04:47:17.305675 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-c019ee9f-80e8-482b-a532-93079cba4aed req-f0a8c188-c5f3-420b-a64f-3cdd6e86dcde service nova] Creating event network-vif-unplugged:1b7def80-2c6f-4b50-8986-20b3ff92ff59 for instance 0fff1fd4-972c-4268-89fd-92b784244edf on n-h2-846463-3 Sep 23 04:47:17.312570 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-4b9b5306-9e74-4302-b056-61cd7e19f0f8 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11980041918484990dac709544d0b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c43f2b70bc74a48b62fb4115337f073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:17.315719 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-c019ee9f-80e8-482b-a532-93079cba4aed req-f0a8c188-c5f3-420b-a64f-3cdd6e86dcde service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.059813 Sep 23 04:47:17.317480 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1773/3595] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:47:17 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:47:17.319935 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4b9b5306-9e74-4302-b056-61cd7e19f0f8 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/servers/53c2eac1-c886-45f2-8b2c-77aa98ceaab5" status: 200 len: 1207 microversion: 2.1 time: 0.133948 Sep 23 04:47:17.334138 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-943351bf-6d7c-4acb-860f-4a5d13a82dfb tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:17.334138 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-943351bf-6d7c-4acb-860f-4a5d13a82dfb tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] [instance: f6413c5e-771f-45c5-94a8-b197becc0815] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:17.335127 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-943351bf-6d7c-4acb-860f-4a5d13a82dfb tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:17.335314 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1823/3596] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:17 2022] GET /compute/v2.1/servers/53c2eac1-c886-45f2-8b2c-77aa98ceaab5 => generated 1207 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:17.336346 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-943351bf-6d7c-4acb-860f-4a5d13a82dfb tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:17.336346 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-943351bf-6d7c-4acb-860f-4a5d13a82dfb tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:17.337285 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-943351bf-6d7c-4acb-860f-4a5d13a82dfb tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:17.337813 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-943351bf-6d7c-4acb-860f-4a5d13a82dfb tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:17.338433 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-943351bf-6d7c-4acb-860f-4a5d13a82dfb tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:17.353790 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6eac00ae-78d2-4bc8-a370-85ad52290520 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:17.355335 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-6eac00ae-78d2-4bc8-a370-85ad52290520 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 28be637b-c43c-4881-b2ce-efb1ec1ad812] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:17.367043 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6eac00ae-78d2-4bc8-a370-85ad52290520 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:17.368617 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6eac00ae-78d2-4bc8-a370-85ad52290520 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:17.368617 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6eac00ae-78d2-4bc8-a370-85ad52290520 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:17.369393 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6eac00ae-78d2-4bc8-a370-85ad52290520 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:17.370693 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6eac00ae-78d2-4bc8-a370-85ad52290520 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:17.371331 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6eac00ae-78d2-4bc8-a370-85ad52290520 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:17.656417 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-943351bf-6d7c-4acb-860f-4a5d13a82dfb tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a245dd82de1340f7a58873de1851c61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d02cb07a2a404c8d89aa13a950806d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:17.665859 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-943351bf-6d7c-4acb-860f-4a5d13a82dfb tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] 10.222.0.33 "GET /compute/v2.1/servers/f6413c5e-771f-45c5-94a8-b197becc0815" status: 200 len: 1325 microversion: 2.1 time: 0.346803 Sep 23 04:47:17.668428 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1774/3597] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:17 2022] GET /compute/v2.1/servers/f6413c5e-771f-45c5-94a8-b197becc0815 => generated 1325 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:17.776842 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8759b03a-6560-439c-95cd-e1335ee0dadb tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:17.776842 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8759b03a-6560-439c-95cd-e1335ee0dadb tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: fe7dee09-8351-4d41-8c44-8d35a966cce9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:17.805262 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8759b03a-6560-439c-95cd-e1335ee0dadb tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:17.823321 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8759b03a-6560-439c-95cd-e1335ee0dadb tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:17.823799 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8759b03a-6560-439c-95cd-e1335ee0dadb tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:17.829060 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8759b03a-6560-439c-95cd-e1335ee0dadb tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:17.829563 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8759b03a-6560-439c-95cd-e1335ee0dadb tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:17.830036 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8759b03a-6560-439c-95cd-e1335ee0dadb tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:17.858890 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-6eac00ae-78d2-4bc8-a370-85ad52290520 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:17.876470 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6eac00ae-78d2-4bc8-a370-85ad52290520 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/28be637b-c43c-4881-b2ce-efb1ec1ad812" status: 200 len: 1509 microversion: 2.1 time: 0.536712 Sep 23 04:47:17.877086 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1824/3598] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:17 2022] GET /compute/v2.1/servers/28be637b-c43c-4881-b2ce-efb1ec1ad812 => generated 1509 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:17.905520 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d4ec5c4d-d4a0-45a9-b7de-562e5e142857 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '.version_select at 0x7ff1bb733d30>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:18.019257 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d4ec5c4d-d4a0-45a9-b7de-562e5e142857 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "GET /compute/v2.1/images/ff150c0b-96d0-4d15-b6c3-7e2dc172a34c" status: 200 len: 1454 microversion: 2.1 time: 0.138998 Sep 23 04:47:18.028365 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1825/3599] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:47:17 2022] GET /compute/v2.1/images/ff150c0b-96d0-4d15-b6c3-7e2dc172a34c => generated 1454 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:18.207257 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-eca8584c-8ab6-467c-a535-7a14b8413194 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:18.207865 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-eca8584c-8ab6-467c-a535-7a14b8413194 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:18.208446 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8759b03a-6560-439c-95cd-e1335ee0dadb tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:18.223082 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eca8584c-8ab6-467c-a535-7a14b8413194 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:18.223606 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eca8584c-8ab6-467c-a535-7a14b8413194 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:18.224059 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eca8584c-8ab6-467c-a535-7a14b8413194 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:18.224768 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eca8584c-8ab6-467c-a535-7a14b8413194 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:18.225228 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eca8584c-8ab6-467c-a535-7a14b8413194 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:18.225657 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eca8584c-8ab6-467c-a535-7a14b8413194 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:18.226193 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8759b03a-6560-439c-95cd-e1335ee0dadb tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:18.228023 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8759b03a-6560-439c-95cd-e1335ee0dadb tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:18.230770 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8759b03a-6560-439c-95cd-e1335ee0dadb tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9" status: 200 len: 1406 microversion: 2.20 time: 0.463232 Sep 23 04:47:18.232304 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1775/3600] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:47:17 2022] GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9 => generated 1406 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:47:18.296635 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0580fad5-3922-4b1e-ac31-3df21d5dbde7 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:18.299191 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-0580fad5-3922-4b1e-ac31-3df21d5dbde7 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: f0374fc2-3c0f-48e1-b969-2933785fd47b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:18.311008 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0580fad5-3922-4b1e-ac31-3df21d5dbde7 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:18.312139 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0580fad5-3922-4b1e-ac31-3df21d5dbde7 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:18.312838 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0580fad5-3922-4b1e-ac31-3df21d5dbde7 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:18.313935 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0580fad5-3922-4b1e-ac31-3df21d5dbde7 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:18.314828 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0580fad5-3922-4b1e-ac31-3df21d5dbde7 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:18.316613 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0580fad5-3922-4b1e-ac31-3df21d5dbde7 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:18.548026 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-eca8584c-8ab6-467c-a535-7a14b8413194 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:18.560689 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-eca8584c-8ab6-467c-a535-7a14b8413194 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1364 microversion: 2.1 time: 0.357334 Sep 23 04:47:18.561921 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1826/3601] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:18 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1364 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:18.567703 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-979f2889-f908-4484-adcf-3810a08c5692 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:18.568791 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-979f2889-f908-4484-adcf-3810a08c5692 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] [instance: 53c2eac1-c886-45f2-8b2c-77aa98ceaab5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:18.583212 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-0580fad5-3922-4b1e-ac31-3df21d5dbde7 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c786bbedc21849ea92924139a44707b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcafb05f6f554e278cd552023947c6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:18.585119 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-979f2889-f908-4484-adcf-3810a08c5692 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:18.585653 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-979f2889-f908-4484-adcf-3810a08c5692 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:18.586151 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-979f2889-f908-4484-adcf-3810a08c5692 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:18.590123 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-979f2889-f908-4484-adcf-3810a08c5692 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:18.590123 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-979f2889-f908-4484-adcf-3810a08c5692 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:18.590123 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-979f2889-f908-4484-adcf-3810a08c5692 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:18.604150 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0580fad5-3922-4b1e-ac31-3df21d5dbde7 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/f0374fc2-3c0f-48e1-b969-2933785fd47b" status: 200 len: 1521 microversion: 2.1 time: 0.328595 Sep 23 04:47:18.605361 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1776/3602] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:18 2022] GET /compute/v2.1/servers/f0374fc2-3c0f-48e1-b969-2933785fd47b => generated 1521 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:47:18.697427 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-979f2889-f908-4484-adcf-3810a08c5692 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11980041918484990dac709544d0b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c43f2b70bc74a48b62fb4115337f073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:18.698812 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-58e9a1a7-eded-40fd-adc8-33f86a373420 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:18.699454 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-58e9a1a7-eded-40fd-adc8-33f86a373420 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] [instance: f6413c5e-771f-45c5-94a8-b197becc0815] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:18.722863 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-58e9a1a7-eded-40fd-adc8-33f86a373420 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:18.724380 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-979f2889-f908-4484-adcf-3810a08c5692 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/servers/53c2eac1-c886-45f2-8b2c-77aa98ceaab5" status: 200 len: 1211 microversion: 2.1 time: 0.160640 Sep 23 04:47:18.725310 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-58e9a1a7-eded-40fd-adc8-33f86a373420 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:18.727386 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-58e9a1a7-eded-40fd-adc8-33f86a373420 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:18.728212 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-58e9a1a7-eded-40fd-adc8-33f86a373420 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:18.731931 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-58e9a1a7-eded-40fd-adc8-33f86a373420 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:18.742857 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-58e9a1a7-eded-40fd-adc8-33f86a373420 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:18.743023 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1827/3603] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:18 2022] GET /compute/v2.1/servers/53c2eac1-c886-45f2-8b2c-77aa98ceaab5 => generated 1211 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:18.774547 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:47:18.813416 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-04bdf365-479b-4683-b9d9-50b624830e67 req-b5b3c7de-f594-4cd8-a3df-764fe83d2217 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fff1fd4-972c-4268-89fd-92b784244edf", "name": "network-vif-deleted", "tag": "1b7def80-2c6f-4b50-8986-20b3ff92ff59"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:47:18.836983 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-04bdf365-479b-4683-b9d9-50b624830e67 req-b5b3c7de-f594-4cd8-a3df-764fe83d2217 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:18.836983 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-04bdf365-479b-4683-b9d9-50b624830e67 req-b5b3c7de-f594-4cd8-a3df-764fe83d2217 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:18.837318 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-04bdf365-479b-4683-b9d9-50b624830e67 req-b5b3c7de-f594-4cd8-a3df-764fe83d2217 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:18.862506 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-04bdf365-479b-4683-b9d9-50b624830e67 req-b5b3c7de-f594-4cd8-a3df-764fe83d2217 service nova] Creating event network-vif-deleted:1b7def80-2c6f-4b50-8986-20b3ff92ff59 for instance 0fff1fd4-972c-4268-89fd-92b784244edf on n-h2-846463-3 Sep 23 04:47:18.877268 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-04bdf365-479b-4683-b9d9-50b624830e67 req-b5b3c7de-f594-4cd8-a3df-764fe83d2217 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067820 Sep 23 04:47:18.877965 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1828/3604] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:47:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:47:18.902949 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4d5fb2a7-7ac5-49ac-b785-6103faff00d8 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:18.904182 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4d5fb2a7-7ac5-49ac-b785-6103faff00d8 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 28be637b-c43c-4881-b2ce-efb1ec1ad812] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:18.918685 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4d5fb2a7-7ac5-49ac-b785-6103faff00d8 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:18.921347 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4d5fb2a7-7ac5-49ac-b785-6103faff00d8 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:18.922937 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4d5fb2a7-7ac5-49ac-b785-6103faff00d8 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:18.924582 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4d5fb2a7-7ac5-49ac-b785-6103faff00d8 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:18.926630 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4d5fb2a7-7ac5-49ac-b785-6103faff00d8 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:18.928333 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4d5fb2a7-7ac5-49ac-b785-6103faff00d8 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:19.057669 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-58e9a1a7-eded-40fd-adc8-33f86a373420 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a245dd82de1340f7a58873de1851c61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d02cb07a2a404c8d89aa13a950806d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:19.066547 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-58e9a1a7-eded-40fd-adc8-33f86a373420 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] 10.222.0.33 "GET /compute/v2.1/servers/f6413c5e-771f-45c5-94a8-b197becc0815" status: 200 len: 1325 microversion: 2.1 time: 0.374256 Sep 23 04:47:19.079216 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1777/3605] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:18 2022] GET /compute/v2.1/servers/f6413c5e-771f-45c5-94a8-b197becc0815 => generated 1325 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:47:19.090717 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c79dc484-a1e6-46c2-8c25-5fb57ef7f034 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '.version_select at 0x7ff1ba8d6550>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:19.189295 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c79dc484-a1e6-46c2-8c25-5fb57ef7f034 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "GET /compute/v2.1/images/ff150c0b-96d0-4d15-b6c3-7e2dc172a34c" status: 200 len: 1454 microversion: 2.1 time: 0.108854 Sep 23 04:47:19.207065 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1778/3606] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:47:19 2022] GET /compute/v2.1/images/ff150c0b-96d0-4d15-b6c3-7e2dc172a34c => generated 1454 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:19.271078 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-060fd6b4-cf04-4810-9b79-c0734d40bfc1 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:19.271969 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-060fd6b4-cf04-4810-9b79-c0734d40bfc1 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: fe7dee09-8351-4d41-8c44-8d35a966cce9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:19.280283 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-060fd6b4-cf04-4810-9b79-c0734d40bfc1 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:19.281139 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-060fd6b4-cf04-4810-9b79-c0734d40bfc1 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:19.281775 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-060fd6b4-cf04-4810-9b79-c0734d40bfc1 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:19.282823 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-060fd6b4-cf04-4810-9b79-c0734d40bfc1 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:19.283458 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-060fd6b4-cf04-4810-9b79-c0734d40bfc1 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:19.284060 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-060fd6b4-cf04-4810-9b79-c0734d40bfc1 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:19.541057 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-4d5fb2a7-7ac5-49ac-b785-6103faff00d8 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:19.550125 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4d5fb2a7-7ac5-49ac-b785-6103faff00d8 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/28be637b-c43c-4881-b2ce-efb1ec1ad812" status: 200 len: 1509 microversion: 2.1 time: 0.652278 Sep 23 04:47:19.566219 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1829/3607] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:18 2022] GET /compute/v2.1/servers/28be637b-c43c-4881-b2ce-efb1ec1ad812 => generated 1509 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:19.590281 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f7c70ec1-45b0-4584-9a5e-07cdbfbc7080 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:19.591288 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f7c70ec1-45b0-4584-9a5e-07cdbfbc7080 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:19.597802 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f7c70ec1-45b0-4584-9a5e-07cdbfbc7080 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:19.603867 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-060fd6b4-cf04-4810-9b79-c0734d40bfc1 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:19.612465 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f7c70ec1-45b0-4584-9a5e-07cdbfbc7080 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:19.613478 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f7c70ec1-45b0-4584-9a5e-07cdbfbc7080 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:19.613614 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-060fd6b4-cf04-4810-9b79-c0734d40bfc1 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:19.615773 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-060fd6b4-cf04-4810-9b79-c0734d40bfc1 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:19.616831 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f7c70ec1-45b0-4584-9a5e-07cdbfbc7080 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:19.617178 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-060fd6b4-cf04-4810-9b79-c0734d40bfc1 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9" status: 200 len: 1599 microversion: 2.20 time: 0.351675 Sep 23 04:47:19.617806 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f7c70ec1-45b0-4584-9a5e-07cdbfbc7080 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:19.621362 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f7c70ec1-45b0-4584-9a5e-07cdbfbc7080 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:19.627535 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1779/3608] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:47:19 2022] GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9 => generated 1599 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:47:19.650194 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-00492b02-0f02-441b-89c2-163581664c2e tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:19.651601 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-00492b02-0f02-441b-89c2-163581664c2e tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: f0374fc2-3c0f-48e1-b969-2933785fd47b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:19.661594 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-00492b02-0f02-441b-89c2-163581664c2e tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:19.672438 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-00492b02-0f02-441b-89c2-163581664c2e tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:19.673267 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-00492b02-0f02-441b-89c2-163581664c2e tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:19.674268 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-00492b02-0f02-441b-89c2-163581664c2e tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:19.674955 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-00492b02-0f02-441b-89c2-163581664c2e tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:19.675587 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-00492b02-0f02-441b-89c2-163581664c2e tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:20.093062 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-00492b02-0f02-441b-89c2-163581664c2e tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c786bbedc21849ea92924139a44707b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcafb05f6f554e278cd552023947c6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:20.102311 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-00492b02-0f02-441b-89c2-163581664c2e tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/f0374fc2-3c0f-48e1-b969-2933785fd47b" status: 200 len: 1521 microversion: 2.1 time: 0.472375 Sep 23 04:47:20.105399 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1780/3609] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:19 2022] GET /compute/v2.1/servers/f0374fc2-3c0f-48e1-b969-2933785fd47b => generated 1521 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:20.114838 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-cba82d31-a0c1-43a7-8e64-90c16b103912 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:20.115339 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-cba82d31-a0c1-43a7-8e64-90c16b103912 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: fe7dee09-8351-4d41-8c44-8d35a966cce9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:20.138642 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cba82d31-a0c1-43a7-8e64-90c16b103912 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:20.140732 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cba82d31-a0c1-43a7-8e64-90c16b103912 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:20.140732 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cba82d31-a0c1-43a7-8e64-90c16b103912 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:20.141056 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cba82d31-a0c1-43a7-8e64-90c16b103912 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:20.141484 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cba82d31-a0c1-43a7-8e64-90c16b103912 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:20.142050 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cba82d31-a0c1-43a7-8e64-90c16b103912 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:20.150121 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f7c70ec1-45b0-4584-9a5e-07cdbfbc7080 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:20.158754 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f7c70ec1-45b0-4584-9a5e-07cdbfbc7080 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1364 microversion: 2.1 time: 0.576761 Sep 23 04:47:20.162599 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1830/3610] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:19 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1364 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:20.167628 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c7af7910-3e7f-4d10-8960-102fd2c79a0c tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:20.169383 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c7af7910-3e7f-4d10-8960-102fd2c79a0c tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] [instance: 53c2eac1-c886-45f2-8b2c-77aa98ceaab5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:20.183652 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c7af7910-3e7f-4d10-8960-102fd2c79a0c tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:20.184158 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c7af7910-3e7f-4d10-8960-102fd2c79a0c tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:20.184615 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c7af7910-3e7f-4d10-8960-102fd2c79a0c tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:20.185314 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c7af7910-3e7f-4d10-8960-102fd2c79a0c tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:20.185779 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c7af7910-3e7f-4d10-8960-102fd2c79a0c tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:20.186248 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c7af7910-3e7f-4d10-8960-102fd2c79a0c tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:20.309799 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c7af7910-3e7f-4d10-8960-102fd2c79a0c tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11980041918484990dac709544d0b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c43f2b70bc74a48b62fb4115337f073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:20.329072 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c7af7910-3e7f-4d10-8960-102fd2c79a0c tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/servers/53c2eac1-c886-45f2-8b2c-77aa98ceaab5" status: 200 len: 1259 microversion: 2.1 time: 0.164985 Sep 23 04:47:20.330981 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1831/3611] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:20 2022] GET /compute/v2.1/servers/53c2eac1-c886-45f2-8b2c-77aa98ceaab5 => generated 1259 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:20.347366 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7e20549f-e044-4845-a1ae-3e414292b2f5 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:20.349375 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-cba82d31-a0c1-43a7-8e64-90c16b103912 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.242838 Sep 23 04:47:20.350201 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1781/3612] 10.222.0.33 () {60 vars in 1316 bytes} [Fri Sep 23 04:47:20 2022] GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9/os-interface => generated 285 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 04:47:20.355106 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-90d1267a-0d42-47f9-90f6-2b63c9dd4478 req-6332cb9a-f85a-4e95-b275-9ad2bab8f988 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6413c5e-771f-45c5-94a8-b197becc0815", "name": "network-vif-plugged", "status": "completed", "tag": "050c3a35-71cb-4639-af15-aff3db06b6cf"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:47:20.359056 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-7e20549f-e044-4845-a1ae-3e414292b2f5 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] [instance: f6413c5e-771f-45c5-94a8-b197becc0815] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:20.371232 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7e20549f-e044-4845-a1ae-3e414292b2f5 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:20.372012 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7e20549f-e044-4845-a1ae-3e414292b2f5 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:20.372634 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7e20549f-e044-4845-a1ae-3e414292b2f5 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:20.373748 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7e20549f-e044-4845-a1ae-3e414292b2f5 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:20.374484 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7e20549f-e044-4845-a1ae-3e414292b2f5 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:20.374954 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-90d1267a-0d42-47f9-90f6-2b63c9dd4478 req-6332cb9a-f85a-4e95-b275-9ad2bab8f988 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:20.375358 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7e20549f-e044-4845-a1ae-3e414292b2f5 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:20.375639 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-90d1267a-0d42-47f9-90f6-2b63c9dd4478 req-6332cb9a-f85a-4e95-b275-9ad2bab8f988 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:20.376287 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-90d1267a-0d42-47f9-90f6-2b63c9dd4478 req-6332cb9a-f85a-4e95-b275-9ad2bab8f988 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:20.394176 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-90d1267a-0d42-47f9-90f6-2b63c9dd4478 req-6332cb9a-f85a-4e95-b275-9ad2bab8f988 service nova] Creating event network-vif-plugged:050c3a35-71cb-4639-af15-aff3db06b6cf for instance f6413c5e-771f-45c5-94a8-b197becc0815 on n-h2-846463-3 Sep 23 04:47:20.399932 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-90d1267a-0d42-47f9-90f6-2b63c9dd4478 req-6332cb9a-f85a-4e95-b275-9ad2bab8f988 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048308 Sep 23 04:47:20.401820 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1782/3613] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:47:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:47:20.412108 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3f7a4935-3f01-4294-843e-4e0af0c817f1 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '.version_select at 0x7ff1ba9c0790>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:20.481605 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3f7a4935-3f01-4294-843e-4e0af0c817f1 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "GET /compute/v2.1/images/ff150c0b-96d0-4d15-b6c3-7e2dc172a34c" status: 200 len: 1454 microversion: 2.1 time: 0.077157 Sep 23 04:47:20.482758 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1783/3614] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:47:20 2022] GET /compute/v2.1/images/ff150c0b-96d0-4d15-b6c3-7e2dc172a34c => generated 1454 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:20.576291 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-36042588-04d9-44b3-b076-020ddfcbef89 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:20.577034 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-36042588-04d9-44b3-b076-020ddfcbef89 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 28be637b-c43c-4881-b2ce-efb1ec1ad812] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:20.594135 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-36042588-04d9-44b3-b076-020ddfcbef89 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:20.596228 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-36042588-04d9-44b3-b076-020ddfcbef89 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:20.599086 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-36042588-04d9-44b3-b076-020ddfcbef89 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:20.600130 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-36042588-04d9-44b3-b076-020ddfcbef89 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:20.602871 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-36042588-04d9-44b3-b076-020ddfcbef89 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:20.603525 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-36042588-04d9-44b3-b076-020ddfcbef89 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:20.688104 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-7e20549f-e044-4845-a1ae-3e414292b2f5 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a245dd82de1340f7a58873de1851c61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d02cb07a2a404c8d89aa13a950806d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:20.700212 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-7e20549f-e044-4845-a1ae-3e414292b2f5 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] 10.222.0.33 "GET /compute/v2.1/servers/f6413c5e-771f-45c5-94a8-b197becc0815" status: 200 len: 1325 microversion: 2.1 time: 0.365238 Sep 23 04:47:20.700212 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1832/3615] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:20 2022] GET /compute/v2.1/servers/f6413c5e-771f-45c5-94a8-b197becc0815 => generated 1325 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:20.960429 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-36042588-04d9-44b3-b076-020ddfcbef89 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:20.969029 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-36042588-04d9-44b3-b076-020ddfcbef89 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/28be637b-c43c-4881-b2ce-efb1ec1ad812" status: 200 len: 1509 microversion: 2.1 time: 0.399978 Sep 23 04:47:20.974928 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1784/3616] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:20 2022] GET /compute/v2.1/servers/28be637b-c43c-4881-b2ce-efb1ec1ad812 => generated 1509 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:47:21.140962 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f9424340-3cfe-4329-86b1-82919a446695 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:21.141609 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f9424340-3cfe-4329-86b1-82919a446695 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: f0374fc2-3c0f-48e1-b969-2933785fd47b] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:21.159386 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f9424340-3cfe-4329-86b1-82919a446695 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:21.159386 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f9424340-3cfe-4329-86b1-82919a446695 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:21.162236 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f9424340-3cfe-4329-86b1-82919a446695 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:21.163056 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f9424340-3cfe-4329-86b1-82919a446695 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:21.163549 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f9424340-3cfe-4329-86b1-82919a446695 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:21.163995 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f9424340-3cfe-4329-86b1-82919a446695 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:21.185957 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f1d78aca-8a08-4f41-a371-827cc9fb8e87 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:21.187374 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f1d78aca-8a08-4f41-a371-827cc9fb8e87 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:21.198711 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f1d78aca-8a08-4f41-a371-827cc9fb8e87 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:21.200813 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f1d78aca-8a08-4f41-a371-827cc9fb8e87 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:21.201639 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f1d78aca-8a08-4f41-a371-827cc9fb8e87 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:21.203246 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f1d78aca-8a08-4f41-a371-827cc9fb8e87 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:21.203968 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f1d78aca-8a08-4f41-a371-827cc9fb8e87 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:21.205162 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f1d78aca-8a08-4f41-a371-827cc9fb8e87 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:21.564651 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f1d78aca-8a08-4f41-a371-827cc9fb8e87 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:21.595984 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f1d78aca-8a08-4f41-a371-827cc9fb8e87 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1551 microversion: 2.1 time: 0.412894 Sep 23 04:47:21.615111 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1785/3617] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:21 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1551 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:21.629612 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f3aaae2b-fcb5-4a5a-8186-05e6f61eed76 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:21.631472 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f3aaae2b-fcb5-4a5a-8186-05e6f61eed76 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] [instance: 53c2eac1-c886-45f2-8b2c-77aa98ceaab5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:21.631622 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f9424340-3cfe-4329-86b1-82919a446695 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c786bbedc21849ea92924139a44707b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcafb05f6f554e278cd552023947c6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:21.645426 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f9424340-3cfe-4329-86b1-82919a446695 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/f0374fc2-3c0f-48e1-b969-2933785fd47b" status: 200 len: 1521 microversion: 2.1 time: 0.519060 Sep 23 04:47:21.647926 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f3aaae2b-fcb5-4a5a-8186-05e6f61eed76 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:21.650094 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1833/3618] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:21 2022] GET /compute/v2.1/servers/f0374fc2-3c0f-48e1-b969-2933785fd47b => generated 1521 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:21.653169 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f3aaae2b-fcb5-4a5a-8186-05e6f61eed76 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:21.653972 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f3aaae2b-fcb5-4a5a-8186-05e6f61eed76 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:21.656427 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f3aaae2b-fcb5-4a5a-8186-05e6f61eed76 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:21.657614 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f3aaae2b-fcb5-4a5a-8186-05e6f61eed76 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:21.659503 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f3aaae2b-fcb5-4a5a-8186-05e6f61eed76 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:21.661276 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0ff20dd3-3f27-49eb-bef1-f3e1465426a1 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '.version_select at 0x7ff1ba9e6af0>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:21.721100 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0ff20dd3-3f27-49eb-bef1-f3e1465426a1 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "GET /compute/v2.1/images/ff150c0b-96d0-4d15-b6c3-7e2dc172a34c" status: 200 len: 1454 microversion: 2.1 time: 0.068099 Sep 23 04:47:21.721684 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1834/3619] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:47:21 2022] GET /compute/v2.1/images/ff150c0b-96d0-4d15-b6c3-7e2dc172a34c => generated 1454 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:21.733702 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ed7a6a3e-c23d-47e4-b0b4-dea469e97664 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:21.734318 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ed7a6a3e-c23d-47e4-b0b4-dea469e97664 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:21.754084 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ed7a6a3e-c23d-47e4-b0b4-dea469e97664 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:21.754803 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ed7a6a3e-c23d-47e4-b0b4-dea469e97664 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:21.755729 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ed7a6a3e-c23d-47e4-b0b4-dea469e97664 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:21.758237 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ed7a6a3e-c23d-47e4-b0b4-dea469e97664 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:21.758884 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ed7a6a3e-c23d-47e4-b0b4-dea469e97664 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:21.759590 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ed7a6a3e-c23d-47e4-b0b4-dea469e97664 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:21.770002 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f3aaae2b-fcb5-4a5a-8186-05e6f61eed76 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11980041918484990dac709544d0b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c43f2b70bc74a48b62fb4115337f073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:21.783626 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f3aaae2b-fcb5-4a5a-8186-05e6f61eed76 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/servers/53c2eac1-c886-45f2-8b2c-77aa98ceaab5" status: 200 len: 1265 microversion: 2.1 time: 0.166824 Sep 23 04:47:21.784715 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1786/3620] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:21 2022] GET /compute/v2.1/servers/53c2eac1-c886-45f2-8b2c-77aa98ceaab5 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:21.793931 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d8b94b73-ce32-4ede-8461-676aa893c2ba tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:21.798307 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d8b94b73-ce32-4ede-8461-676aa893c2ba tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] [instance: f6413c5e-771f-45c5-94a8-b197becc0815] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:21.804514 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d8b94b73-ce32-4ede-8461-676aa893c2ba tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:21.805277 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d8b94b73-ce32-4ede-8461-676aa893c2ba tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:21.806027 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d8b94b73-ce32-4ede-8461-676aa893c2ba tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:21.810687 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d8b94b73-ce32-4ede-8461-676aa893c2ba tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:21.811378 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d8b94b73-ce32-4ede-8461-676aa893c2ba tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:21.812421 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d8b94b73-ce32-4ede-8461-676aa893c2ba tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:21.981258 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ed7a6a3e-c23d-47e4-b0b4-dea469e97664 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.258296 Sep 23 04:47:21.983188 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1835/3621] 10.222.0.33 () {58 vars in 1275 bytes} [Fri Sep 23 04:47:21 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5/os-interface => generated 285 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:47:22.009511 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7afca2da-e3c0-4a29-b51f-ab2744854309 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:22.010879 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-7afca2da-e3c0-4a29-b51f-ab2744854309 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 28be637b-c43c-4881-b2ce-efb1ec1ad812] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:22.019132 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7afca2da-e3c0-4a29-b51f-ab2744854309 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:22.020736 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7afca2da-e3c0-4a29-b51f-ab2744854309 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:22.021452 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7afca2da-e3c0-4a29-b51f-ab2744854309 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:22.022531 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7afca2da-e3c0-4a29-b51f-ab2744854309 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:22.023425 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7afca2da-e3c0-4a29-b51f-ab2744854309 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:22.024579 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7afca2da-e3c0-4a29-b51f-ab2744854309 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:22.458097 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-7afca2da-e3c0-4a29-b51f-ab2744854309 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:22.468351 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-7afca2da-e3c0-4a29-b51f-ab2744854309 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/28be637b-c43c-4881-b2ce-efb1ec1ad812" status: 200 len: 1509 microversion: 2.1 time: 0.470860 Sep 23 04:47:22.476265 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d8b94b73-ce32-4ede-8461-676aa893c2ba tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a245dd82de1340f7a58873de1851c61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d02cb07a2a404c8d89aa13a950806d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:22.481209 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1836/3622] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:21 2022] GET /compute/v2.1/servers/28be637b-c43c-4881-b2ce-efb1ec1ad812 => generated 1509 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:47:22.487082 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d8b94b73-ce32-4ede-8461-676aa893c2ba tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] 10.222.0.33 "GET /compute/v2.1/servers/f6413c5e-771f-45c5-94a8-b197becc0815" status: 200 len: 1325 microversion: 2.1 time: 0.701062 Sep 23 04:47:22.495148 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1787/3623] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:21 2022] GET /compute/v2.1/servers/f6413c5e-771f-45c5-94a8-b197becc0815 => generated 1325 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:22.517425 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-cca80f2c-a25d-438a-9876-6592db493f13 req-f15280b7-4bff-422a-b97e-66c93caf2cca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe7dee09-8351-4d41-8c44-8d35a966cce9", "tag": "c9b47e66-2bb6-4e68-a2b9-4fb9fec9ff30"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:47:22.529322 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-cca80f2c-a25d-438a-9876-6592db493f13 req-f15280b7-4bff-422a-b97e-66c93caf2cca service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:22.530434 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-cca80f2c-a25d-438a-9876-6592db493f13 req-f15280b7-4bff-422a-b97e-66c93caf2cca service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:22.531034 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-cca80f2c-a25d-438a-9876-6592db493f13 req-f15280b7-4bff-422a-b97e-66c93caf2cca service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:22.544784 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-cca80f2c-a25d-438a-9876-6592db493f13 req-f15280b7-4bff-422a-b97e-66c93caf2cca service nova] Creating event network-changed:c9b47e66-2bb6-4e68-a2b9-4fb9fec9ff30 for instance fe7dee09-8351-4d41-8c44-8d35a966cce9 on n-h2-846463-3 Sep 23 04:47:22.553667 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-cca80f2c-a25d-438a-9876-6592db493f13 req-f15280b7-4bff-422a-b97e-66c93caf2cca service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041644 Sep 23 04:47:22.554947 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1837/3624] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:47:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:47:22.674856 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-120af34b-b2e4-4220-84b9-0f6509537017 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:22.675952 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-120af34b-b2e4-4220-84b9-0f6509537017 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: f0374fc2-3c0f-48e1-b969-2933785fd47b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:22.684851 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-120af34b-b2e4-4220-84b9-0f6509537017 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:22.688760 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-120af34b-b2e4-4220-84b9-0f6509537017 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:22.689404 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-120af34b-b2e4-4220-84b9-0f6509537017 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:22.690880 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-120af34b-b2e4-4220-84b9-0f6509537017 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:22.693045 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-120af34b-b2e4-4220-84b9-0f6509537017 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:22.693925 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-120af34b-b2e4-4220-84b9-0f6509537017 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:22.737647 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f09c8627-0568-4a70-9276-63c9a7f965df tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '.version_select at 0x7ff1ba9e34c0>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:22.812435 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f09c8627-0568-4a70-9276-63c9a7f965df tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "GET /compute/v2.1/images/ff150c0b-96d0-4d15-b6c3-7e2dc172a34c" status: 200 len: 1454 microversion: 2.1 time: 0.079371 Sep 23 04:47:22.819391 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1838/3625] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:47:22 2022] GET /compute/v2.1/images/ff150c0b-96d0-4d15-b6c3-7e2dc172a34c => generated 1454 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:22.844300 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5f314a3c-209d-4181-80e4-fbd9e3321290 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:22.852578 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-5f314a3c-209d-4181-80e4-fbd9e3321290 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] [instance: 53c2eac1-c886-45f2-8b2c-77aa98ceaab5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:22.870696 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5f314a3c-209d-4181-80e4-fbd9e3321290 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:22.871208 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5f314a3c-209d-4181-80e4-fbd9e3321290 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:22.871639 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5f314a3c-209d-4181-80e4-fbd9e3321290 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:22.884308 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5f314a3c-209d-4181-80e4-fbd9e3321290 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:22.886297 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5f314a3c-209d-4181-80e4-fbd9e3321290 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:22.888324 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5f314a3c-209d-4181-80e4-fbd9e3321290 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:23.317027 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-120af34b-b2e4-4220-84b9-0f6509537017 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c786bbedc21849ea92924139a44707b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcafb05f6f554e278cd552023947c6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:23.374648 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-120af34b-b2e4-4220-84b9-0f6509537017 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/f0374fc2-3c0f-48e1-b969-2933785fd47b" status: 200 len: 1521 microversion: 2.1 time: 0.703740 Sep 23 04:47:23.377985 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1788/3626] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:22 2022] GET /compute/v2.1/servers/f0374fc2-3c0f-48e1-b969-2933785fd47b => generated 1521 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:23.505591 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-02804c18-381c-4acd-bbd6-eaf57bfa75c5 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:23.506303 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-02804c18-381c-4acd-bbd6-eaf57bfa75c5 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 28be637b-c43c-4881-b2ce-efb1ec1ad812] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:23.526172 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-02804c18-381c-4acd-bbd6-eaf57bfa75c5 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:23.526839 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-02804c18-381c-4acd-bbd6-eaf57bfa75c5 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:23.527296 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-02804c18-381c-4acd-bbd6-eaf57bfa75c5 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:23.528049 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-02804c18-381c-4acd-bbd6-eaf57bfa75c5 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:23.537689 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-02804c18-381c-4acd-bbd6-eaf57bfa75c5 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:23.538882 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-02804c18-381c-4acd-bbd6-eaf57bfa75c5 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:24.240803 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-5f314a3c-209d-4181-80e4-fbd9e3321290 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11980041918484990dac709544d0b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c43f2b70bc74a48b62fb4115337f073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:24.252579 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5f314a3c-209d-4181-80e4-fbd9e3321290 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/servers/53c2eac1-c886-45f2-8b2c-77aa98ceaab5" status: 200 len: 1307 microversion: 2.1 time: 1.431813 Sep 23 04:47:24.253190 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1839/3627] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:22 2022] GET /compute/v2.1/servers/53c2eac1-c886-45f2-8b2c-77aa98ceaab5 => generated 1307 bytes in 1433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:24.265487 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b59ef3e8-0229-40c1-82c0-b36db7079f33 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:24.268279 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b59ef3e8-0229-40c1-82c0-b36db7079f33 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] [instance: f6413c5e-771f-45c5-94a8-b197becc0815] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:24.283753 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b59ef3e8-0229-40c1-82c0-b36db7079f33 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:24.284519 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b59ef3e8-0229-40c1-82c0-b36db7079f33 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:24.289382 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b59ef3e8-0229-40c1-82c0-b36db7079f33 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:24.290421 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b59ef3e8-0229-40c1-82c0-b36db7079f33 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:24.291351 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b59ef3e8-0229-40c1-82c0-b36db7079f33 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:24.292176 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b59ef3e8-0229-40c1-82c0-b36db7079f33 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:24.331697 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-02804c18-381c-4acd-bbd6-eaf57bfa75c5 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:24.342450 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-02804c18-381c-4acd-bbd6-eaf57bfa75c5 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/28be637b-c43c-4881-b2ce-efb1ec1ad812" status: 200 len: 1509 microversion: 2.1 time: 0.840184 Sep 23 04:47:24.350034 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1789/3628] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:23 2022] GET /compute/v2.1/servers/28be637b-c43c-4881-b2ce-efb1ec1ad812 => generated 1509 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:47:24.354940 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ec5cb0e6-f8c6-4a64-b0df-f1f49a29940a tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '.version_select at 0x7ff1ba8583a0>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:24.425829 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ec5cb0e6-f8c6-4a64-b0df-f1f49a29940a tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "GET /compute/v2.1/images/ff150c0b-96d0-4d15-b6c3-7e2dc172a34c" status: 200 len: 1454 microversion: 2.1 time: 0.074431 Sep 23 04:47:24.435338 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1790/3629] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:47:24 2022] GET /compute/v2.1/images/ff150c0b-96d0-4d15-b6c3-7e2dc172a34c => generated 1454 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:24.435338 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a7680900-c9be-4c86-8445-f013092e12f9 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:24.435338 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a7680900-c9be-4c86-8445-f013092e12f9 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: f0374fc2-3c0f-48e1-b969-2933785fd47b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:24.446286 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a7680900-c9be-4c86-8445-f013092e12f9 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:24.446936 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a7680900-c9be-4c86-8445-f013092e12f9 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:24.447545 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a7680900-c9be-4c86-8445-f013092e12f9 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:24.448926 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a7680900-c9be-4c86-8445-f013092e12f9 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:24.449491 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a7680900-c9be-4c86-8445-f013092e12f9 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:24.450060 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a7680900-c9be-4c86-8445-f013092e12f9 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:24.786960 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b59ef3e8-0229-40c1-82c0-b36db7079f33 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a245dd82de1340f7a58873de1851c61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d02cb07a2a404c8d89aa13a950806d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:24.796365 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b59ef3e8-0229-40c1-82c0-b36db7079f33 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] 10.222.0.33 "GET /compute/v2.1/servers/f6413c5e-771f-45c5-94a8-b197becc0815" status: 200 len: 1522 microversion: 2.1 time: 0.542083 Sep 23 04:47:24.797268 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1840/3630] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:24 2022] GET /compute/v2.1/servers/f6413c5e-771f-45c5-94a8-b197becc0815 => generated 1522 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:24.822888 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-27afee99-1ea2-4982-8db9-11b3b9223499 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:24.823833 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-27afee99-1ea2-4982-8db9-11b3b9223499 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] [instance: f6413c5e-771f-45c5-94a8-b197becc0815] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:24.832744 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-27afee99-1ea2-4982-8db9-11b3b9223499 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:24.834562 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-27afee99-1ea2-4982-8db9-11b3b9223499 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:24.835215 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-27afee99-1ea2-4982-8db9-11b3b9223499 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:24.836203 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-27afee99-1ea2-4982-8db9-11b3b9223499 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:24.836869 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-27afee99-1ea2-4982-8db9-11b3b9223499 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:24.837691 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-27afee99-1ea2-4982-8db9-11b3b9223499 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:24.867959 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=100 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:47:24.949360 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a7680900-c9be-4c86-8445-f013092e12f9 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c786bbedc21849ea92924139a44707b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcafb05f6f554e278cd552023947c6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:24.959202 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a7680900-c9be-4c86-8445-f013092e12f9 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/f0374fc2-3c0f-48e1-b969-2933785fd47b" status: 200 len: 1521 microversion: 2.1 time: 0.530623 Sep 23 04:47:24.959812 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1791/3631] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:24 2022] GET /compute/v2.1/servers/f0374fc2-3c0f-48e1-b969-2933785fd47b => generated 1521 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:25.276969 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6311e335-8a0f-4a69-858a-47cda579873c tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:25.278927 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-6311e335-8a0f-4a69-858a-47cda579873c tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] [instance: 53c2eac1-c886-45f2-8b2c-77aa98ceaab5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:25.287183 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6311e335-8a0f-4a69-858a-47cda579873c tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:25.287940 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6311e335-8a0f-4a69-858a-47cda579873c tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:25.288683 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6311e335-8a0f-4a69-858a-47cda579873c tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:25.289588 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6311e335-8a0f-4a69-858a-47cda579873c tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:25.290287 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6311e335-8a0f-4a69-858a-47cda579873c tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:25.290892 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6311e335-8a0f-4a69-858a-47cda579873c tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:25.359553 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-27afee99-1ea2-4982-8db9-11b3b9223499 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a245dd82de1340f7a58873de1851c61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d02cb07a2a404c8d89aa13a950806d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:25.381730 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-27afee99-1ea2-4982-8db9-11b3b9223499 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] 10.222.0.33 "GET /compute/v2.1/servers/f6413c5e-771f-45c5-94a8-b197becc0815" status: 200 len: 1522 microversion: 2.1 time: 0.563534 Sep 23 04:47:25.382673 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1841/3632] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:24 2022] GET /compute/v2.1/servers/f6413c5e-771f-45c5-94a8-b197becc0815 => generated 1522 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:47:25.397766 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5f67c05a-72e6-4b60-b2cd-5e6e727079f4 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:25.398416 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-5f67c05a-72e6-4b60-b2cd-5e6e727079f4 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 28be637b-c43c-4881-b2ce-efb1ec1ad812] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:25.407344 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5f67c05a-72e6-4b60-b2cd-5e6e727079f4 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:25.408148 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5f67c05a-72e6-4b60-b2cd-5e6e727079f4 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:25.408596 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5f67c05a-72e6-4b60-b2cd-5e6e727079f4 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:25.409309 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5f67c05a-72e6-4b60-b2cd-5e6e727079f4 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:25.409973 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5f67c05a-72e6-4b60-b2cd-5e6e727079f4 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:25.410409 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5f67c05a-72e6-4b60-b2cd-5e6e727079f4 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:25.762014 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6311e335-8a0f-4a69-858a-47cda579873c tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11980041918484990dac709544d0b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c43f2b70bc74a48b62fb4115337f073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:25.766396 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-5f67c05a-72e6-4b60-b2cd-5e6e727079f4 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:25.773644 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-6311e335-8a0f-4a69-858a-47cda579873c tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/servers/53c2eac1-c886-45f2-8b2c-77aa98ceaab5" status: 200 len: 1307 microversion: 2.1 time: 0.500914 Sep 23 04:47:25.775787 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1792/3633] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:25 2022] GET /compute/v2.1/servers/53c2eac1-c886-45f2-8b2c-77aa98ceaab5 => generated 1307 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:25.787097 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-544723cc-cd6a-4855-b78f-5d003ec5b830 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-287624240", "metadata": {"": ""}}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:47:25.787426 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5f67c05a-72e6-4b60-b2cd-5e6e727079f4 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/28be637b-c43c-4881-b2ce-efb1ec1ad812" status: 200 len: 1509 microversion: 2.1 time: 0.403602 Sep 23 04:47:25.798735 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-544723cc-cd6a-4855-b78f-5d003ec5b830 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Request method failure captured: Sep 23 04:47:25.798735 n-d-846463-3 devstack@n-api.service[122698]: request: POST /compute/v2.1/servers/f6413c5e-771f-45c5-94a8-b197becc0815/action HTTP/1.1 Sep 23 04:47:25.798735 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:47:25.798735 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:47:25.798735 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:47:25.798735 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 106 Sep 23 04:47:25.798735 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:47:25.798735 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:47:25.798735 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:47:25.798735 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:47:25.798735 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTpFpjGPh25TzqBKyhrvLvaFWkL4faeTDdKKBYZ-4258bHvdM5kvJeJfEcGV73OAvtYNm_BDk9uKOKPqKlfTdSYy5tbnqP456--ua0TKxu-LM-map64NPTKy_GCC6WVYwCbUhwP1cF4hdC1uo-LvpY1Eaa8dgHWJxu3z0t2BBREm_ZE Sep 23 04:47:25.798735 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:47:25.798735 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:47:25.798735 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:47:25.798735 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:47:25.798735 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:47:25.798735 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:47:25.798735 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 53d02cb07a2a404c8d89aa13a950806d Sep 23 04:47:25.798735 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-728698197 Sep 23 04:47:25.798735 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:47:25.798735 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:47:25.798735 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_53d02cb07a2a404c8d89aa13a950806d", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/53d02cb07a2a404c8d89aa13a950806d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/53d02cb07a2a404c8d89aa13a950806d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/53d02cb07a2a404c8d89aa13a950806d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:47:25.798735 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-728698197 Sep 23 04:47:25.798735 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 53d02cb07a2a404c8d89aa13a950806d Sep 23 04:47:25.798735 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-728698197 Sep 23 04:47:25.798735 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ImagesOneServerNegativeTestJSON-728698197-project Sep 23 04:47:25.798735 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:47:25.798735 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:47:25.798735 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: a245dd82de1340f7a58873de1851c61c Sep 23 04:47:25.798735 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-728698197-project Sep 23 04:47:25.798735 n-d-846463-3 devstack@n-api.service[122698]: Sep 23 04:47:25.798735 n-d-846463-3 devstack@n-api.service[122698]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-287624240", "metadata": {"": ""}}} Sep 23 04:47:25.798735 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:47:25.798735 n-d-846463-3 devstack@n-api.service[122698]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 23 04:47:25.798735 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': 'f6413c5e-771f-45c5-94a8-b197becc0815', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-287624240', 'metadata': {'': ''}}}} Sep 23 04:47:25.798735 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:47:25.798735 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:25.798735 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 23 04:47:25.798735 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 23 04:47:25.798735 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 23 04:47:25.798735 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise error Sep 23 04:47:25.798735 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 23 04:47:25.798735 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:47:25.798735 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Sep 23 04:47:25.798735 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 23 04:47:25.798735 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 23 04:47:25.798735 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 23 04:47:25.798735 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 23 04:47:25.798735 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:47:25.798735 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi On instance['createImage']: Sep 23 04:47:25.798735 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi {'': ''} Sep 23 04:47:25.798735 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:47:25.798735 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:47:25.798735 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:47:25.798735 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:25.798735 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:47:25.798735 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:47:25.798735 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:47:25.798735 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:47:25.798735 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:47:25.798735 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:47:25.798735 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:47:25.798735 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:47:25.798735 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 23 04:47:25.809384 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 23 04:47:25.809384 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 23 04:47:25.809384 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 23 04:47:25.809384 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 23 04:47:25.809384 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 23 04:47:25.809384 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 23 04:47:25.809384 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:47:25.809384 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:47:25.809384 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:47:25.809384 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:25.809384 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:47:25.809384 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:47:25.809384 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 23 04:47:25.809384 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 23 04:47:25.809384 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 23 04:47:25.809384 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:47:25.809384 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-544723cc-cd6a-4855-b78f-5d003ec5b830 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:47:25.809384 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-544723cc-cd6a-4855-b78f-5d003ec5b830 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] 10.222.0.33 "POST /compute/v2.1/servers/f6413c5e-771f-45c5-94a8-b197becc0815/action" status: 400 len: 170 microversion: 2.1 time: 0.021935 Sep 23 04:47:25.809384 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1793/3634] 10.222.0.33 () {60 vars in 1279 bytes} [Fri Sep 23 04:47:25 2022] POST /compute/v2.1/servers/f6413c5e-771f-45c5-94a8-b197becc0815/action => generated 170 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 04:47:25.811817 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1842/3635] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:25 2022] GET /compute/v2.1/servers/28be637b-c43c-4881-b2ce-efb1ec1ad812 => generated 1509 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:25.815715 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0227d2f8-c763-44f5-9dff-4f0cf81d7c18 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '.version_select at 0x7ff1ba8704c0>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:25.816908 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5052b817-c6a9-408d-8bf3-f56f5d828a4b tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:25.817788 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-5052b817-c6a9-408d-8bf3-f56f5d828a4b tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] [instance: f6413c5e-771f-45c5-94a8-b197becc0815] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:25.825068 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5052b817-c6a9-408d-8bf3-f56f5d828a4b tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:25.826183 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5052b817-c6a9-408d-8bf3-f56f5d828a4b tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:25.826631 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5052b817-c6a9-408d-8bf3-f56f5d828a4b tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:25.834505 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5052b817-c6a9-408d-8bf3-f56f5d828a4b tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:25.834505 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5052b817-c6a9-408d-8bf3-f56f5d828a4b tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:25.834505 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5052b817-c6a9-408d-8bf3-f56f5d828a4b tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:25.876532 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0227d2f8-c763-44f5-9dff-4f0cf81d7c18 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "GET /compute/v2.1/images/ff150c0b-96d0-4d15-b6c3-7e2dc172a34c" status: 200 len: 1454 microversion: 2.1 time: 0.070720 Sep 23 04:47:25.877415 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1794/3636] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:47:25 2022] GET /compute/v2.1/images/ff150c0b-96d0-4d15-b6c3-7e2dc172a34c => generated 1454 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:25.984092 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7814eb4c-d38d-4fc5-9f9b-e60479a33be4 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:25.986372 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7814eb4c-d38d-4fc5-9f9b-e60479a33be4 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: f0374fc2-3c0f-48e1-b969-2933785fd47b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:25.991503 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7814eb4c-d38d-4fc5-9f9b-e60479a33be4 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:25.992311 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7814eb4c-d38d-4fc5-9f9b-e60479a33be4 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:25.992503 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7814eb4c-d38d-4fc5-9f9b-e60479a33be4 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:25.993417 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7814eb4c-d38d-4fc5-9f9b-e60479a33be4 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:25.994115 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7814eb4c-d38d-4fc5-9f9b-e60479a33be4 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:25.994727 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7814eb4c-d38d-4fc5-9f9b-e60479a33be4 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:26.247997 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-5052b817-c6a9-408d-8bf3-f56f5d828a4b tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a245dd82de1340f7a58873de1851c61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d02cb07a2a404c8d89aa13a950806d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:26.265206 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5052b817-c6a9-408d-8bf3-f56f5d828a4b tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] 10.222.0.33 "GET /compute/v2.1/servers/f6413c5e-771f-45c5-94a8-b197becc0815" status: 200 len: 1522 microversion: 2.1 time: 0.454761 Sep 23 04:47:26.268344 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1843/3637] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:25 2022] GET /compute/v2.1/servers/f6413c5e-771f-45c5-94a8-b197becc0815 => generated 1522 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:26.312394 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3ab41b88-3124-4100-a7f7-997e9b7823dc tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:26.313120 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-3ab41b88-3124-4100-a7f7-997e9b7823dc tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] [instance: f6413c5e-771f-45c5-94a8-b197becc0815] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:26.321198 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3ab41b88-3124-4100-a7f7-997e9b7823dc tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:26.322670 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3ab41b88-3124-4100-a7f7-997e9b7823dc tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:26.323420 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3ab41b88-3124-4100-a7f7-997e9b7823dc tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:26.324387 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3ab41b88-3124-4100-a7f7-997e9b7823dc tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:26.326055 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3ab41b88-3124-4100-a7f7-997e9b7823dc tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:26.326894 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3ab41b88-3124-4100-a7f7-997e9b7823dc tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:26.334820 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-7814eb4c-d38d-4fc5-9f9b-e60479a33be4 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c786bbedc21849ea92924139a44707b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcafb05f6f554e278cd552023947c6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:26.345829 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7814eb4c-d38d-4fc5-9f9b-e60479a33be4 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/f0374fc2-3c0f-48e1-b969-2933785fd47b" status: 200 len: 1521 microversion: 2.1 time: 0.365474 Sep 23 04:47:26.349050 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1795/3638] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:25 2022] GET /compute/v2.1/servers/f0374fc2-3c0f-48e1-b969-2933785fd47b => generated 1521 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:47:26.353628 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-93f7bf7c-3a20-4624-93ff-294e60972bda req-27a794c1-19c2-41c7-b22f-bde428713df5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fb569cf-4457-4695-ad5f-fcb78f0964c5", "tag": "8fdad197-55e1-4686-bfa9-6cfa0beb24d5"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:47:26.380194 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-93f7bf7c-3a20-4624-93ff-294e60972bda req-27a794c1-19c2-41c7-b22f-bde428713df5 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:26.380985 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-93f7bf7c-3a20-4624-93ff-294e60972bda req-27a794c1-19c2-41c7-b22f-bde428713df5 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:26.381426 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-93f7bf7c-3a20-4624-93ff-294e60972bda req-27a794c1-19c2-41c7-b22f-bde428713df5 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:26.394479 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-93f7bf7c-3a20-4624-93ff-294e60972bda req-27a794c1-19c2-41c7-b22f-bde428713df5 service nova] Creating event network-changed:8fdad197-55e1-4686-bfa9-6cfa0beb24d5 for instance 4fb569cf-4457-4695-ad5f-fcb78f0964c5 on n-h2-846463-3 Sep 23 04:47:26.400268 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-93f7bf7c-3a20-4624-93ff-294e60972bda req-27a794c1-19c2-41c7-b22f-bde428713df5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049987 Sep 23 04:47:26.402196 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1796/3639] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:47:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:47:26.594484 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:47:26.665710 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-3ab41b88-3124-4100-a7f7-997e9b7823dc tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a245dd82de1340f7a58873de1851c61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d02cb07a2a404c8d89aa13a950806d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:26.685260 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3ab41b88-3124-4100-a7f7-997e9b7823dc tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] 10.222.0.33 "GET /compute/v2.1/servers/f6413c5e-771f-45c5-94a8-b197becc0815" status: 200 len: 1522 microversion: 2.1 time: 0.388623 Sep 23 04:47:26.686534 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1844/3640] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:26 2022] GET /compute/v2.1/servers/f6413c5e-771f-45c5-94a8-b197becc0815 => generated 1522 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:47:26.714088 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b5c5e595-ac7b-44ab-9714-2fb3a95288eb tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-859842012", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:47:26.730157 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b5c5e595-ac7b-44ab-9714-2fb3a95288eb tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Request method failure captured: Sep 23 04:47:26.730157 n-d-846463-3 devstack@n-api.service[122698]: request: POST /compute/v2.1/servers/f6413c5e-771f-45c5-94a8-b197becc0815/action HTTP/1.1 Sep 23 04:47:26.730157 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:47:26.730157 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:47:26.730157 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:47:26.730157 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 618 Sep 23 04:47:26.730157 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:47:26.730157 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:47:26.730157 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:47:26.730157 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:47:26.730157 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTpFpjGPh25TzqBKyhrvLvaFWkL4faeTDdKKBYZ-4258bHvdM5kvJeJfEcGV73OAvtYNm_BDk9uKOKPqKlfTdSYy5tbnqP456--ua0TKxu-LM-map64NPTKy_GCC6WVYwCbUhwP1cF4hdC1uo-LvpY1Eaa8dgHWJxu3z0t2BBREm_ZE Sep 23 04:47:26.730157 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:47:26.730157 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:47:26.730157 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:47:26.730157 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:47:26.730157 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:47:26.730157 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:47:26.730157 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 53d02cb07a2a404c8d89aa13a950806d Sep 23 04:47:26.730157 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-728698197 Sep 23 04:47:26.730157 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:47:26.730157 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:47:26.730157 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_53d02cb07a2a404c8d89aa13a950806d", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/53d02cb07a2a404c8d89aa13a950806d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/53d02cb07a2a404c8d89aa13a950806d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/53d02cb07a2a404c8d89aa13a950806d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:47:26.730157 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-728698197 Sep 23 04:47:26.730157 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 53d02cb07a2a404c8d89aa13a950806d Sep 23 04:47:26.730157 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-728698197 Sep 23 04:47:26.730157 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ImagesOneServerNegativeTestJSON-728698197-project Sep 23 04:47:26.730157 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:47:26.730157 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:47:26.730157 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: a245dd82de1340f7a58873de1851c61c Sep 23 04:47:26.730157 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-728698197-project Sep 23 04:47:26.730157 n-d-846463-3 devstack@n-api.service[122698]: Sep 23 04:47:26.730157 n-d-846463-3 devstack@n-api.service[122698]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-859842012", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Sep 23 04:47:26.730157 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:47:26.730157 n-d-846463-3 devstack@n-api.service[122698]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 23 04:47:26.730157 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': 'f6413c5e-771f-45c5-94a8-b197becc0815', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-859842012', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Sep 23 04:47:26.730157 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:47:26.730157 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:26.730157 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 23 04:47:26.730157 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 23 04:47:26.730157 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 23 04:47:26.730157 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise error Sep 23 04:47:26.733716 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 23 04:47:26.733716 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:47:26.733716 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Sep 23 04:47:26.733716 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 23 04:47:26.733716 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 23 04:47:26.733716 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 23 04:47:26.733716 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 23 04:47:26.733716 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:47:26.733716 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi On instance['createImage']: Sep 23 04:47:26.733716 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Sep 23 04:47:26.733716 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:47:26.733716 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:47:26.733716 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:47:26.733716 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:26.733716 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:47:26.733716 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:47:26.733716 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:47:26.733716 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:47:26.733716 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:47:26.733716 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:47:26.733716 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:47:26.733716 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:47:26.733716 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 23 04:47:26.733716 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 23 04:47:26.733716 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 23 04:47:26.733716 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 23 04:47:26.733716 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 23 04:47:26.733716 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 23 04:47:26.733716 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 23 04:47:26.733716 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:47:26.733716 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:47:26.733716 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:47:26.733716 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:26.733716 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:47:26.733716 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:47:26.733716 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 23 04:47:26.733716 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 23 04:47:26.733716 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 23 04:47:26.733716 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:47:26.742541 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b5c5e595-ac7b-44ab-9714-2fb3a95288eb tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:47:26.744866 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b5c5e595-ac7b-44ab-9714-2fb3a95288eb tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] 10.222.0.33 "POST /compute/v2.1/servers/f6413c5e-771f-45c5-94a8-b197becc0815/action" status: 400 len: 938 microversion: 2.1 time: 0.040631 Sep 23 04:47:26.747031 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1797/3641] 10.222.0.33 () {60 vars in 1279 bytes} [Fri Sep 23 04:47:26 2022] POST /compute/v2.1/servers/f6413c5e-771f-45c5-94a8-b197becc0815/action => generated 938 bytes in 44 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 04:47:26.755865 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-848c6097-373f-4dc7-94f5-b2c06b3c910b tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:26.756541 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-848c6097-373f-4dc7-94f5-b2c06b3c910b tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] [instance: f6413c5e-771f-45c5-94a8-b197becc0815] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:26.770751 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-848c6097-373f-4dc7-94f5-b2c06b3c910b tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:26.778679 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-848c6097-373f-4dc7-94f5-b2c06b3c910b tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:26.779150 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-848c6097-373f-4dc7-94f5-b2c06b3c910b tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:26.779953 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-848c6097-373f-4dc7-94f5-b2c06b3c910b tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:26.780418 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-848c6097-373f-4dc7-94f5-b2c06b3c910b tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:26.781047 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-848c6097-373f-4dc7-94f5-b2c06b3c910b tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:26.805245 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5c2ed65b-6abc-40a0-ba36-69242bc792bc tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:26.806889 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5c2ed65b-6abc-40a0-ba36-69242bc792bc tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] [instance: 53c2eac1-c886-45f2-8b2c-77aa98ceaab5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:26.820907 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5c2ed65b-6abc-40a0-ba36-69242bc792bc tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:26.821429 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5c2ed65b-6abc-40a0-ba36-69242bc792bc tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:26.821908 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5c2ed65b-6abc-40a0-ba36-69242bc792bc tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:26.825823 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5c2ed65b-6abc-40a0-ba36-69242bc792bc tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:26.837220 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5c2ed65b-6abc-40a0-ba36-69242bc792bc tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:26.840851 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5c2ed65b-6abc-40a0-ba36-69242bc792bc tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:27.317299 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=8 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:47:27.648346 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-848c6097-373f-4dc7-94f5-b2c06b3c910b tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a245dd82de1340f7a58873de1851c61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d02cb07a2a404c8d89aa13a950806d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:27.657582 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-848c6097-373f-4dc7-94f5-b2c06b3c910b tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] 10.222.0.33 "GET /compute/v2.1/servers/f6413c5e-771f-45c5-94a8-b197becc0815" status: 200 len: 1522 microversion: 2.1 time: 0.906253 Sep 23 04:47:27.659122 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1845/3642] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:26 2022] GET /compute/v2.1/servers/f6413c5e-771f-45c5-94a8-b197becc0815 => generated 1522 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:27.669691 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e63b679e-f870-494c-bec2-9407f9857daa tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:27.670225 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-5c2ed65b-6abc-40a0-ba36-69242bc792bc tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11980041918484990dac709544d0b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c43f2b70bc74a48b62fb4115337f073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:27.671864 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e63b679e-f870-494c-bec2-9407f9857daa tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 28be637b-c43c-4881-b2ce-efb1ec1ad812] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:27.678805 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e63b679e-f870-494c-bec2-9407f9857daa tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:27.679332 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e63b679e-f870-494c-bec2-9407f9857daa tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:27.679794 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e63b679e-f870-494c-bec2-9407f9857daa tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:27.680588 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e63b679e-f870-494c-bec2-9407f9857daa tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:27.681049 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e63b679e-f870-494c-bec2-9407f9857daa tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:27.681492 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e63b679e-f870-494c-bec2-9407f9857daa tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:27.688105 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5c2ed65b-6abc-40a0-ba36-69242bc792bc tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/servers/53c2eac1-c886-45f2-8b2c-77aa98ceaab5" status: 200 len: 1307 microversion: 2.1 time: 0.888122 Sep 23 04:47:27.688700 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1798/3643] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:26 2022] GET /compute/v2.1/servers/53c2eac1-c886-45f2-8b2c-77aa98ceaab5 => generated 1307 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:27.698015 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-684674cc-1d79-4694-929d-ceeffffef757 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '.version_select at 0x7ff1ba9c0790>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:27.746914 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-684674cc-1d79-4694-929d-ceeffffef757 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "GET /compute/v2.1/images/ff150c0b-96d0-4d15-b6c3-7e2dc172a34c" status: 200 len: 1463 microversion: 2.1 time: 0.056898 Sep 23 04:47:27.747500 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1799/3644] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:47:27 2022] GET /compute/v2.1/images/ff150c0b-96d0-4d15-b6c3-7e2dc172a34c => generated 1463 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:27.753097 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1e860d48-346a-4a36-8927-07f0c282f327 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:27.753704 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-1e860d48-346a-4a36-8927-07f0c282f327 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: f0374fc2-3c0f-48e1-b969-2933785fd47b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:27.767141 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1e860d48-346a-4a36-8927-07f0c282f327 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:27.769815 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1e860d48-346a-4a36-8927-07f0c282f327 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:27.769815 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1e860d48-346a-4a36-8927-07f0c282f327 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:27.769815 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1e860d48-346a-4a36-8927-07f0c282f327 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:27.769815 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1e860d48-346a-4a36-8927-07f0c282f327 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:27.769815 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1e860d48-346a-4a36-8927-07f0c282f327 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:28.130386 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e63b679e-f870-494c-bec2-9407f9857daa tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:28.142809 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-1e860d48-346a-4a36-8927-07f0c282f327 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c786bbedc21849ea92924139a44707b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcafb05f6f554e278cd552023947c6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:28.147165 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e63b679e-f870-494c-bec2-9407f9857daa tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/28be637b-c43c-4881-b2ce-efb1ec1ad812" status: 200 len: 1509 microversion: 2.1 time: 0.486745 Sep 23 04:47:28.147776 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1846/3645] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:27 2022] GET /compute/v2.1/servers/28be637b-c43c-4881-b2ce-efb1ec1ad812 => generated 1509 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:28.169276 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-1e860d48-346a-4a36-8927-07f0c282f327 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/f0374fc2-3c0f-48e1-b969-2933785fd47b" status: 200 len: 1521 microversion: 2.1 time: 0.420218 Sep 23 04:47:28.170362 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-85cfba4c-075b-4da4-9fa8-4eb9e5cadf6a tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:28.171298 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-85cfba4c-075b-4da4-9fa8-4eb9e5cadf6a tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] [instance: f6413c5e-771f-45c5-94a8-b197becc0815] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:28.172285 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1800/3646] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:27 2022] GET /compute/v2.1/servers/f0374fc2-3c0f-48e1-b969-2933785fd47b => generated 1521 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:28.196267 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-85cfba4c-075b-4da4-9fa8-4eb9e5cadf6a tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:28.196778 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-85cfba4c-075b-4da4-9fa8-4eb9e5cadf6a tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:28.200581 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-780e485d-29ee-44fb-9e3c-26b6c0ad4f05 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '.version_select at 0x7ff1ba800040>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:28.206721 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-85cfba4c-075b-4da4-9fa8-4eb9e5cadf6a tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:28.207581 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-85cfba4c-075b-4da4-9fa8-4eb9e5cadf6a tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:28.208116 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-85cfba4c-075b-4da4-9fa8-4eb9e5cadf6a tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:28.208738 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-85cfba4c-075b-4da4-9fa8-4eb9e5cadf6a tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:28.275497 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-780e485d-29ee-44fb-9e3c-26b6c0ad4f05 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "GET /compute/v2.1/images/ff150c0b-96d0-4d15-b6c3-7e2dc172a34c" status: 200 len: 1463 microversion: 2.1 time: 0.099163 Sep 23 04:47:28.279235 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1801/3647] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:47:28 2022] GET /compute/v2.1/images/ff150c0b-96d0-4d15-b6c3-7e2dc172a34c => generated 1463 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:28.290783 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-73a80062-eb56-4d80-b4d7-59e901f9d0a7 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:28.291855 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-73a80062-eb56-4d80-b4d7-59e901f9d0a7 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] [instance: 401339a4-8674-4ff9-b09e-ba748f46928d] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:28.299489 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-73a80062-eb56-4d80-b4d7-59e901f9d0a7 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:28.303953 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-73a80062-eb56-4d80-b4d7-59e901f9d0a7 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:28.304617 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-73a80062-eb56-4d80-b4d7-59e901f9d0a7 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:28.305369 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-73a80062-eb56-4d80-b4d7-59e901f9d0a7 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:28.305821 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-73a80062-eb56-4d80-b4d7-59e901f9d0a7 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:28.306329 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-73a80062-eb56-4d80-b4d7-59e901f9d0a7 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:28.438968 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-85cfba4c-075b-4da4-9fa8-4eb9e5cadf6a tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a245dd82de1340f7a58873de1851c61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d02cb07a2a404c8d89aa13a950806d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:28.443147 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-85cfba4c-075b-4da4-9fa8-4eb9e5cadf6a tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] 10.222.0.33 "GET /compute/v2.1/servers/f6413c5e-771f-45c5-94a8-b197becc0815" status: 200 len: 1522 microversion: 2.1 time: 0.294067 Sep 23 04:47:28.443724 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1847/3648] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:28 2022] GET /compute/v2.1/servers/f6413c5e-771f-45c5-94a8-b197becc0815 => generated 1522 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:28.454113 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-070d20de-4966-415c-99f5-743d00031f11 req-4f6877cd-b091-4632-bb1d-d152cf791a99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53c2eac1-c886-45f2-8b2c-77aa98ceaab5", "tag": "87b50488-13f1-4d99-be79-5edefa1d65c9"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:47:28.462313 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-070d20de-4966-415c-99f5-743d00031f11 req-4f6877cd-b091-4632-bb1d-d152cf791a99 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:28.462873 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-070d20de-4966-415c-99f5-743d00031f11 req-4f6877cd-b091-4632-bb1d-d152cf791a99 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:28.463574 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-070d20de-4966-415c-99f5-743d00031f11 req-4f6877cd-b091-4632-bb1d-d152cf791a99 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:28.475189 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-070d20de-4966-415c-99f5-743d00031f11 req-4f6877cd-b091-4632-bb1d-d152cf791a99 service nova] Creating event network-changed:87b50488-13f1-4d99-be79-5edefa1d65c9 for instance 53c2eac1-c886-45f2-8b2c-77aa98ceaab5 on n-h1-846463-3 Sep 23 04:47:28.481212 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-070d20de-4966-415c-99f5-743d00031f11 req-4f6877cd-b091-4632-bb1d-d152cf791a99 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036309 Sep 23 04:47:28.481813 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1848/3649] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:47:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:47:28.487342 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7ad71d3d-a674-4a04-a114-be83570e21bd tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:47:28.491968 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7ad71d3d-a674-4a04-a114-be83570e21bd tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Request method failure captured: Sep 23 04:47:28.491968 n-d-846463-3 devstack@n-api.service[122699]: request: POST /compute/v2.1/servers/f6413c5e-771f-45c5-94a8-b197becc0815/action HTTP/1.1 Sep 23 04:47:28.491968 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:47:28.491968 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:47:28.491968 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:47:28.491968 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 285 Sep 23 04:47:28.491968 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:47:28.491968 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:47:28.491968 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:47:28.491968 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:47:28.491968 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTpFpjGPh25TzqBKyhrvLvaFWkL4faeTDdKKBYZ-4258bHvdM5kvJeJfEcGV73OAvtYNm_BDk9uKOKPqKlfTdSYy5tbnqP456--ua0TKxu-LM-map64NPTKy_GCC6WVYwCbUhwP1cF4hdC1uo-LvpY1Eaa8dgHWJxu3z0t2BBREm_ZE Sep 23 04:47:28.491968 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:47:28.491968 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:47:28.491968 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:47:28.491968 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:47:28.491968 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:47:28.491968 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:47:28.491968 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 53d02cb07a2a404c8d89aa13a950806d Sep 23 04:47:28.491968 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-728698197 Sep 23 04:47:28.491968 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:47:28.491968 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:47:28.491968 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_53d02cb07a2a404c8d89aa13a950806d", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/53d02cb07a2a404c8d89aa13a950806d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/53d02cb07a2a404c8d89aa13a950806d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/53d02cb07a2a404c8d89aa13a950806d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:47:28.491968 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-728698197 Sep 23 04:47:28.491968 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 53d02cb07a2a404c8d89aa13a950806d Sep 23 04:47:28.491968 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-728698197 Sep 23 04:47:28.491968 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ImagesOneServerNegativeTestJSON-728698197-project Sep 23 04:47:28.491968 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:47:28.491968 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:47:28.491968 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: a245dd82de1340f7a58873de1851c61c Sep 23 04:47:28.491968 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-728698197-project Sep 23 04:47:28.491968 n-d-846463-3 devstack@n-api.service[122699]: Sep 23 04:47:28.491968 n-d-846463-3 devstack@n-api.service[122699]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Sep 23 04:47:28.491968 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:47:28.491968 n-d-846463-3 devstack@n-api.service[122699]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 23 04:47:28.491968 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': 'f6413c5e-771f-45c5-94a8-b197becc0815', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Sep 23 04:47:28.491968 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:47:28.491968 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:28.491968 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 23 04:47:28.491968 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 23 04:47:28.491968 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 23 04:47:28.491968 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise error Sep 23 04:47:28.491968 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 23 04:47:28.491968 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:47:28.491968 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Sep 23 04:47:28.491968 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 23 04:47:28.491968 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:47:28.491968 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi On instance['createImage']: Sep 23 04:47:28.491968 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 23 04:47:28.491968 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:47:28.491968 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:47:28.491968 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:47:28.491968 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:28.500861 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:47:28.500861 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:47:28.500861 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:47:28.500861 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:47:28.500861 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:47:28.500861 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:47:28.500861 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:47:28.500861 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:47:28.500861 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 23 04:47:28.500861 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 23 04:47:28.500861 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 23 04:47:28.500861 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 23 04:47:28.500861 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 23 04:47:28.500861 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 23 04:47:28.500861 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 23 04:47:28.500861 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:47:28.500861 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:47:28.500861 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:47:28.500861 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:28.500861 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:47:28.500861 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:47:28.500861 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 23 04:47:28.500861 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 23 04:47:28.500861 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 23 04:47:28.500861 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:47:28.500861 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7ad71d3d-a674-4a04-a114-be83570e21bd tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:47:28.500861 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-7ad71d3d-a674-4a04-a114-be83570e21bd tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] 10.222.0.33 "POST /compute/v2.1/servers/f6413c5e-771f-45c5-94a8-b197becc0815/action" status: 400 len: 619 microversion: 2.1 time: 0.010246 Sep 23 04:47:28.500861 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1849/3650] 10.222.0.33 () {60 vars in 1279 bytes} [Fri Sep 23 04:47:28 2022] POST /compute/v2.1/servers/f6413c5e-771f-45c5-94a8-b197becc0815/action => generated 619 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 04:47:28.504752 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-776177ef-0b5a-4111-bbe6-0d8f419b01f3 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:28.505147 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-73a80062-eb56-4d80-b4d7-59e901f9d0a7 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff662b5d5b9e488d906565b490c8acf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dcca3b014be4e98b7db17bb37d073a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:28.505547 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-776177ef-0b5a-4111-bbe6-0d8f419b01f3 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] [instance: f6413c5e-771f-45c5-94a8-b197becc0815] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:28.513924 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-776177ef-0b5a-4111-bbe6-0d8f419b01f3 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:28.514121 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-73a80062-eb56-4d80-b4d7-59e901f9d0a7 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "GET /compute/v2.1/servers/401339a4-8674-4ff9-b09e-ba748f46928d" status: 200 len: 1467 microversion: 2.1 time: 0.227261 Sep 23 04:47:28.514442 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-776177ef-0b5a-4111-bbe6-0d8f419b01f3 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:28.514894 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-776177ef-0b5a-4111-bbe6-0d8f419b01f3 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:28.515036 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1802/3651] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:28 2022] GET /compute/v2.1/servers/401339a4-8674-4ff9-b09e-ba748f46928d => generated 1467 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:47:28.515743 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-776177ef-0b5a-4111-bbe6-0d8f419b01f3 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:28.516211 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-776177ef-0b5a-4111-bbe6-0d8f419b01f3 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:28.516675 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-776177ef-0b5a-4111-bbe6-0d8f419b01f3 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:28.537373 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3c627a2d-767c-4635-9fcc-bab35733543b tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1029706374"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:47:28.539900 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3c627a2d-767c-4635-9fcc-bab35733543b tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] [instance: a0eac077-d4bd-4e4a-a04a-3f86aeeed9bd] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:28.546263 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3c627a2d-767c-4635-9fcc-bab35733543b tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:28.546821 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3c627a2d-767c-4635-9fcc-bab35733543b tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:28.547325 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3c627a2d-767c-4635-9fcc-bab35733543b tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:28.548475 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3c627a2d-767c-4635-9fcc-bab35733543b tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:28.548592 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3c627a2d-767c-4635-9fcc-bab35733543b tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:28.548976 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3c627a2d-767c-4635-9fcc-bab35733543b tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:28.581722 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=100 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:47:28.657519 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-776177ef-0b5a-4111-bbe6-0d8f419b01f3 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a245dd82de1340f7a58873de1851c61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d02cb07a2a404c8d89aa13a950806d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:28.665352 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-776177ef-0b5a-4111-bbe6-0d8f419b01f3 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] 10.222.0.33 "GET /compute/v2.1/servers/f6413c5e-771f-45c5-94a8-b197becc0815" status: 200 len: 1522 microversion: 2.1 time: 0.164519 Sep 23 04:47:28.666526 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1850/3652] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:28 2022] GET /compute/v2.1/servers/f6413c5e-771f-45c5-94a8-b197becc0815 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:47:28.689621 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0fa21fd3-e475-4267-8057-ae28829ec35d tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:28.690327 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-0fa21fd3-e475-4267-8057-ae28829ec35d tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] [instance: f6413c5e-771f-45c5-94a8-b197becc0815] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:28.696386 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0fa21fd3-e475-4267-8057-ae28829ec35d tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:28.696815 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0fa21fd3-e475-4267-8057-ae28829ec35d tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:28.697501 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0fa21fd3-e475-4267-8057-ae28829ec35d tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:28.698237 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0fa21fd3-e475-4267-8057-ae28829ec35d tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:28.698702 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0fa21fd3-e475-4267-8057-ae28829ec35d tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:28.699136 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0fa21fd3-e475-4267-8057-ae28829ec35d tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:28.858056 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-0fa21fd3-e475-4267-8057-ae28829ec35d tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a245dd82de1340f7a58873de1851c61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d02cb07a2a404c8d89aa13a950806d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:28.866237 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0fa21fd3-e475-4267-8057-ae28829ec35d tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] 10.222.0.33 "GET /compute/v2.1/servers/f6413c5e-771f-45c5-94a8-b197becc0815" status: 200 len: 1522 microversion: 2.1 time: 0.180582 Sep 23 04:47:28.867142 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1851/3653] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:28 2022] GET /compute/v2.1/servers/f6413c5e-771f-45c5-94a8-b197becc0815 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:28.871805 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-05faac75-9d62-4692-b611-923ea76259a5 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:28.873355 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-05faac75-9d62-4692-b611-923ea76259a5 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] [instance: 53c2eac1-c886-45f2-8b2c-77aa98ceaab5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:28.878431 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-05faac75-9d62-4692-b611-923ea76259a5 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:28.878929 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-05faac75-9d62-4692-b611-923ea76259a5 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:28.879377 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-05faac75-9d62-4692-b611-923ea76259a5 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:28.880085 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-05faac75-9d62-4692-b611-923ea76259a5 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:28.880711 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-05faac75-9d62-4692-b611-923ea76259a5 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:28.881321 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-05faac75-9d62-4692-b611-923ea76259a5 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:29.001496 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3c627a2d-767c-4635-9fcc-bab35733543b tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "POST /compute/v2.1/servers/a0eac077-d4bd-4e4a-a04a-3f86aeeed9bd/action" status: 202 len: 0 microversion: 2.1 time: 0.467857 Sep 23 04:47:29.002340 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1803/3654] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:47:28 2022] POST /compute/v2.1/servers/a0eac077-d4bd-4e4a-a04a-3f86aeeed9bd/action => generated 0 bytes in 469 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Sep 23 04:47:29.008205 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-893c9494-46da-4731-9e50-b8820e4318a6 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-666040846"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:47:29.010682 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-893c9494-46da-4731-9e50-b8820e4318a6 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] [instance: f6413c5e-771f-45c5-94a8-b197becc0815] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:29.017246 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-893c9494-46da-4731-9e50-b8820e4318a6 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:29.017736 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-893c9494-46da-4731-9e50-b8820e4318a6 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:29.018240 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-893c9494-46da-4731-9e50-b8820e4318a6 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:29.019209 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-893c9494-46da-4731-9e50-b8820e4318a6 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:29.019814 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-893c9494-46da-4731-9e50-b8820e4318a6 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:29.020538 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-893c9494-46da-4731-9e50-b8820e4318a6 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:29.024981 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-05faac75-9d62-4692-b611-923ea76259a5 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11980041918484990dac709544d0b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c43f2b70bc74a48b62fb4115337f073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:29.034021 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-05faac75-9d62-4692-b611-923ea76259a5 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/servers/53c2eac1-c886-45f2-8b2c-77aa98ceaab5" status: 200 len: 1307 microversion: 2.1 time: 0.165717 Sep 23 04:47:29.046955 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1852/3655] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:28 2022] GET /compute/v2.1/servers/53c2eac1-c886-45f2-8b2c-77aa98ceaab5 => generated 1307 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:29.046955 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0f416cac-1565-4e67-9c2e-1094c0340c54 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '.version_select at 0x7ff1ba9dc8b0>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:29.085794 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0f416cac-1565-4e67-9c2e-1094c0340c54 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "GET /compute/v2.1/images/ebfd24d2-4412-4ba6-8024-99147eab6142" status: 200 len: 1455 microversion: 2.1 time: 0.050192 Sep 23 04:47:29.086570 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1853/3656] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:47:29 2022] GET /compute/v2.1/images/ebfd24d2-4412-4ba6-8024-99147eab6142 => generated 1455 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:29.172378 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-09d26f03-0656-4272-9e32-d0f4f4462ffe tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:29.172989 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-09d26f03-0656-4272-9e32-d0f4f4462ffe tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 28be637b-c43c-4881-b2ce-efb1ec1ad812] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:29.179265 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-09d26f03-0656-4272-9e32-d0f4f4462ffe tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:29.179754 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-09d26f03-0656-4272-9e32-d0f4f4462ffe tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:29.185691 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-09d26f03-0656-4272-9e32-d0f4f4462ffe tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:29.185691 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-09d26f03-0656-4272-9e32-d0f4f4462ffe tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:29.185691 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-09d26f03-0656-4272-9e32-d0f4f4462ffe tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:29.185691 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-09d26f03-0656-4272-9e32-d0f4f4462ffe tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:29.320481 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-09d26f03-0656-4272-9e32-d0f4f4462ffe tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:29.333588 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-09d26f03-0656-4272-9e32-d0f4f4462ffe tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/28be637b-c43c-4881-b2ce-efb1ec1ad812" status: 200 len: 1509 microversion: 2.1 time: 0.165132 Sep 23 04:47:29.334245 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1854/3657] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:29 2022] GET /compute/v2.1/servers/28be637b-c43c-4881-b2ce-efb1ec1ad812 => generated 1509 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:47:29.339985 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3f735a40-a21f-4b8b-a16e-c9670d6b8b24 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:29.340674 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-3f735a40-a21f-4b8b-a16e-c9670d6b8b24 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: f0374fc2-3c0f-48e1-b969-2933785fd47b] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:29.347013 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3f735a40-a21f-4b8b-a16e-c9670d6b8b24 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:29.353708 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3f735a40-a21f-4b8b-a16e-c9670d6b8b24 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:29.353708 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3f735a40-a21f-4b8b-a16e-c9670d6b8b24 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:29.353708 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3f735a40-a21f-4b8b-a16e-c9670d6b8b24 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:29.353708 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3f735a40-a21f-4b8b-a16e-c9670d6b8b24 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:29.353708 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3f735a40-a21f-4b8b-a16e-c9670d6b8b24 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:29.458418 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-893c9494-46da-4731-9e50-b8820e4318a6 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] 10.222.0.33 "POST /compute/v2.1/servers/f6413c5e-771f-45c5-94a8-b197becc0815/action" status: 202 len: 0 microversion: 2.1 time: 0.454331 Sep 23 04:47:29.459165 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1804/3658] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:47:29 2022] POST /compute/v2.1/servers/f6413c5e-771f-45c5-94a8-b197becc0815/action => generated 0 bytes in 456 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 23 04:47:29.475044 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9364fd43-37b3-41d6-94e9-a090c4a3c708 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1916791876"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:47:29.480056 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-9364fd43-37b3-41d6-94e9-a090c4a3c708 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] [instance: f6413c5e-771f-45c5-94a8-b197becc0815] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:29.488162 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9364fd43-37b3-41d6-94e9-a090c4a3c708 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:29.488772 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9364fd43-37b3-41d6-94e9-a090c4a3c708 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:29.489279 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9364fd43-37b3-41d6-94e9-a090c4a3c708 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:29.490299 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9364fd43-37b3-41d6-94e9-a090c4a3c708 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:29.490980 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9364fd43-37b3-41d6-94e9-a090c4a3c708 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:29.491415 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9364fd43-37b3-41d6-94e9-a090c4a3c708 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:29.497729 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-3f735a40-a21f-4b8b-a16e-c9670d6b8b24 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c786bbedc21849ea92924139a44707b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcafb05f6f554e278cd552023947c6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:29.502535 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3f735a40-a21f-4b8b-a16e-c9670d6b8b24 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/f0374fc2-3c0f-48e1-b969-2933785fd47b" status: 200 len: 1521 microversion: 2.1 time: 0.167129 Sep 23 04:47:29.503191 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1855/3659] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:29 2022] GET /compute/v2.1/servers/f0374fc2-3c0f-48e1-b969-2933785fd47b => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:29.527191 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-9364fd43-37b3-41d6-94e9-a090c4a3c708 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] HTTP exception thrown: Cannot 'createImage' instance f6413c5e-771f-45c5-94a8-b197becc0815 while it is in task_state image_snapshot_pending Sep 23 04:47:29.528900 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9364fd43-37b3-41d6-94e9-a090c4a3c708 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Request method failure captured: Sep 23 04:47:29.528900 n-d-846463-3 devstack@n-api.service[122698]: request: POST /compute/v2.1/servers/f6413c5e-771f-45c5-94a8-b197becc0815/action HTTP/1.1 Sep 23 04:47:29.528900 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:47:29.528900 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:47:29.528900 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:47:29.528900 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 85 Sep 23 04:47:29.528900 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:47:29.528900 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:47:29.528900 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:47:29.528900 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:47:29.528900 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTpFpjGPh25TzqBKyhrvLvaFWkL4faeTDdKKBYZ-4258bHvdM5kvJeJfEcGV73OAvtYNm_BDk9uKOKPqKlfTdSYy5tbnqP456--ua0TKxu-LM-map64NPTKy_GCC6WVYwCbUhwP1cF4hdC1uo-LvpY1Eaa8dgHWJxu3z0t2BBREm_ZE Sep 23 04:47:29.528900 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:47:29.528900 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:47:29.528900 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:47:29.528900 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:47:29.528900 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:47:29.528900 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:47:29.528900 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 53d02cb07a2a404c8d89aa13a950806d Sep 23 04:47:29.528900 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-728698197 Sep 23 04:47:29.528900 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:47:29.528900 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:47:29.528900 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_53d02cb07a2a404c8d89aa13a950806d", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/53d02cb07a2a404c8d89aa13a950806d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/53d02cb07a2a404c8d89aa13a950806d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/53d02cb07a2a404c8d89aa13a950806d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:47:29.528900 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-728698197 Sep 23 04:47:29.528900 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 53d02cb07a2a404c8d89aa13a950806d Sep 23 04:47:29.528900 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-728698197 Sep 23 04:47:29.528900 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ImagesOneServerNegativeTestJSON-728698197-project Sep 23 04:47:29.528900 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:47:29.528900 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:47:29.528900 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: a245dd82de1340f7a58873de1851c61c Sep 23 04:47:29.528900 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-728698197-project Sep 23 04:47:29.528900 n-d-846463-3 devstack@n-api.service[122698]: Sep 23 04:47:29.528900 n-d-846463-3 devstack@n-api.service[122698]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1916791876"}} Sep 23 04:47:29.528900 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:47:29.528900 n-d-846463-3 devstack@n-api.service[122698]: exception: Cannot 'createImage' instance f6413c5e-771f-45c5-94a8-b197becc0815 while it is in task_state image_snapshot_pending Sep 23 04:47:29.528900 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': 'f6413c5e-771f-45c5-94a8-b197becc0815', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1916791876'}}} Sep 23 04:47:29.528900 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:47:29.528900 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:29.528900 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1349, in _action_create_image Sep 23 04:47:29.528900 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Sep 23 04:47:29.528900 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Sep 23 04:47:29.528900 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 23 04:47:29.528900 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f6413c5e-771f-45c5-94a8-b197becc0815 in task_state image_snapshot_pending. Cannot snapshot while the instance is in this state. Sep 23 04:47:29.528900 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:47:29.528900 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:47:29.528900 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:47:29.528900 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:29.528900 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:47:29.528900 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:47:29.528900 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:47:29.528900 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:47:29.528900 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:47:29.528900 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:47:29.528900 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:47:29.528900 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:47:29.528900 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:47:29.528900 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:47:29.528900 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1354, in _action_create_image Sep 23 04:47:29.528900 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 23 04:47:29.528900 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 23 04:47:29.528900 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 23 04:47:29.534785 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance f6413c5e-771f-45c5-94a8-b197becc0815 while it is in task_state image_snapshot_pending Sep 23 04:47:29.534785 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:47:29.534785 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:47:29.534785 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:47:29.534785 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:29.534785 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:47:29.534785 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:47:29.534785 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:47:29.534785 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:47:29.534785 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance f6413c5e-771f-45c5-94a8-b197becc0815 while it is in task_state image_snapshot_pending Sep 23 04:47:29.534785 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:47:29.534785 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9364fd43-37b3-41d6-94e9-a090c4a3c708 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Returning 409 to user: Cannot 'createImage' instance f6413c5e-771f-45c5-94a8-b197becc0815 while it is in task_state image_snapshot_pending {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:47:29.534785 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9364fd43-37b3-41d6-94e9-a090c4a3c708 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] 10.222.0.33 "POST /compute/v2.1/servers/f6413c5e-771f-45c5-94a8-b197becc0815/action" status: 409 len: 167 microversion: 2.1 time: 0.062919 Sep 23 04:47:29.534785 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1805/3660] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:47:29 2022] POST /compute/v2.1/servers/f6413c5e-771f-45c5-94a8-b197becc0815/action => generated 167 bytes in 65 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 23 04:47:29.538865 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a21a36ba-9769-4bab-bb72-2b978a159f6e tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Calling method '.version_select at 0x7ff1ba9f63a0>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:29.850478 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a21a36ba-9769-4bab-bb72-2b978a159f6e tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] 10.222.0.33 "DELETE /compute/v2.1/images/43adb9d8-84c7-4a78-bda0-00371e77fa15" status: 204 len: 0 microversion: 2.1 time: 0.315119 Sep 23 04:47:29.854315 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1856/3661] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:29 2022] DELETE /compute/v2.1/images/43adb9d8-84c7-4a78-bda0-00371e77fa15 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:47:29.861163 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d7c60af9-1626-4f18-9731-2b09ab5f02d4 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:29.862067 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d7c60af9-1626-4f18-9731-2b09ab5f02d4 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] [instance: f6413c5e-771f-45c5-94a8-b197becc0815] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:29.870187 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d7c60af9-1626-4f18-9731-2b09ab5f02d4 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:29.870694 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d7c60af9-1626-4f18-9731-2b09ab5f02d4 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:29.873492 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d7c60af9-1626-4f18-9731-2b09ab5f02d4 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:29.873492 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d7c60af9-1626-4f18-9731-2b09ab5f02d4 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:29.873492 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d7c60af9-1626-4f18-9731-2b09ab5f02d4 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:29.873492 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d7c60af9-1626-4f18-9731-2b09ab5f02d4 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:30.060674 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1b5d37ae-5063-4a83-aa20-57bb52f25715 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:30.061330 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1b5d37ae-5063-4a83-aa20-57bb52f25715 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] [instance: 53c2eac1-c886-45f2-8b2c-77aa98ceaab5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:30.067726 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1b5d37ae-5063-4a83-aa20-57bb52f25715 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:30.068163 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1b5d37ae-5063-4a83-aa20-57bb52f25715 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:30.068636 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1b5d37ae-5063-4a83-aa20-57bb52f25715 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:30.069351 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1b5d37ae-5063-4a83-aa20-57bb52f25715 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:30.069815 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1b5d37ae-5063-4a83-aa20-57bb52f25715 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:30.070278 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1b5d37ae-5063-4a83-aa20-57bb52f25715 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:30.095204 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d7c60af9-1626-4f18-9731-2b09ab5f02d4 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a245dd82de1340f7a58873de1851c61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d02cb07a2a404c8d89aa13a950806d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:30.103634 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d7c60af9-1626-4f18-9731-2b09ab5f02d4 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] 10.222.0.33 "GET /compute/v2.1/servers/f6413c5e-771f-45c5-94a8-b197becc0815" status: 200 len: 1534 microversion: 2.1 time: 0.247454 Sep 23 04:47:30.104601 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1806/3662] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:29 2022] GET /compute/v2.1/servers/f6413c5e-771f-45c5-94a8-b197becc0815 => generated 1534 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:30.112838 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-689ec0ff-318a-4235-a928-e72e4fa8b84b tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '.version_select at 0x7ff1ba858c10>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:30.160507 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-689ec0ff-318a-4235-a928-e72e4fa8b84b tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "GET /compute/v2.1/images/ebfd24d2-4412-4ba6-8024-99147eab6142" status: 200 len: 1455 microversion: 2.1 time: 0.054744 Sep 23 04:47:30.161094 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1807/3663] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:47:30 2022] GET /compute/v2.1/images/ebfd24d2-4412-4ba6-8024-99147eab6142 => generated 1455 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:30.271884 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1b5d37ae-5063-4a83-aa20-57bb52f25715 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11980041918484990dac709544d0b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c43f2b70bc74a48b62fb4115337f073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:30.280228 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1b5d37ae-5063-4a83-aa20-57bb52f25715 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/servers/53c2eac1-c886-45f2-8b2c-77aa98ceaab5" status: 200 len: 1307 microversion: 2.1 time: 0.223572 Sep 23 04:47:30.280800 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1857/3664] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:30 2022] GET /compute/v2.1/servers/53c2eac1-c886-45f2-8b2c-77aa98ceaab5 => generated 1307 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:47:30.357428 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ad90a5d0-3b9a-46ed-8430-493e491d001c tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:30.358093 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-ad90a5d0-3b9a-46ed-8430-493e491d001c tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 28be637b-c43c-4881-b2ce-efb1ec1ad812] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:30.364287 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ad90a5d0-3b9a-46ed-8430-493e491d001c tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:30.364773 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ad90a5d0-3b9a-46ed-8430-493e491d001c tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:30.365217 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ad90a5d0-3b9a-46ed-8430-493e491d001c tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:30.365940 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ad90a5d0-3b9a-46ed-8430-493e491d001c tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:30.366409 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ad90a5d0-3b9a-46ed-8430-493e491d001c tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:30.366840 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ad90a5d0-3b9a-46ed-8430-493e491d001c tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:30.499103 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ad90a5d0-3b9a-46ed-8430-493e491d001c tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:30.507020 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ad90a5d0-3b9a-46ed-8430-493e491d001c tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/28be637b-c43c-4881-b2ce-efb1ec1ad812" status: 200 len: 1509 microversion: 2.1 time: 0.154311 Sep 23 04:47:30.507597 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1808/3665] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:30 2022] GET /compute/v2.1/servers/28be637b-c43c-4881-b2ce-efb1ec1ad812 => generated 1509 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:30.526142 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7b11468c-829e-45b0-b88b-e71b9ff03a15 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:30.526758 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-7b11468c-829e-45b0-b88b-e71b9ff03a15 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: f0374fc2-3c0f-48e1-b969-2933785fd47b] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:30.532974 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7b11468c-829e-45b0-b88b-e71b9ff03a15 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:30.533462 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7b11468c-829e-45b0-b88b-e71b9ff03a15 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:30.533919 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7b11468c-829e-45b0-b88b-e71b9ff03a15 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:30.534612 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7b11468c-829e-45b0-b88b-e71b9ff03a15 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:30.535265 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7b11468c-829e-45b0-b88b-e71b9ff03a15 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:30.535696 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7b11468c-829e-45b0-b88b-e71b9ff03a15 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:30.671698 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-7b11468c-829e-45b0-b88b-e71b9ff03a15 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c786bbedc21849ea92924139a44707b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcafb05f6f554e278cd552023947c6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:30.679542 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-7b11468c-829e-45b0-b88b-e71b9ff03a15 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/f0374fc2-3c0f-48e1-b969-2933785fd47b" status: 200 len: 1521 microversion: 2.1 time: 0.157350 Sep 23 04:47:30.680119 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1858/3666] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:30 2022] GET /compute/v2.1/servers/f0374fc2-3c0f-48e1-b969-2933785fd47b => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:31.127861 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f7cfd4e3-738e-43dd-a517-50e7dcf96680 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:31.129037 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f7cfd4e3-738e-43dd-a517-50e7dcf96680 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] [instance: f6413c5e-771f-45c5-94a8-b197becc0815] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:31.135327 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f7cfd4e3-738e-43dd-a517-50e7dcf96680 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:31.135847 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f7cfd4e3-738e-43dd-a517-50e7dcf96680 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:31.136298 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f7cfd4e3-738e-43dd-a517-50e7dcf96680 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:31.137241 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f7cfd4e3-738e-43dd-a517-50e7dcf96680 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:31.137972 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f7cfd4e3-738e-43dd-a517-50e7dcf96680 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:31.138577 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f7cfd4e3-738e-43dd-a517-50e7dcf96680 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:31.176474 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e02f3f12-35ef-48e5-a601-3e76f0fbaa2d tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '.version_select at 0x7ff1ba9dc940>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:31.225295 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e02f3f12-35ef-48e5-a601-3e76f0fbaa2d tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "GET /compute/v2.1/images/ebfd24d2-4412-4ba6-8024-99147eab6142" status: 200 len: 1455 microversion: 2.1 time: 0.052693 Sep 23 04:47:31.233798 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1859/3667] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:47:31 2022] GET /compute/v2.1/images/ebfd24d2-4412-4ba6-8024-99147eab6142 => generated 1455 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:47:31.282006 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f7cfd4e3-738e-43dd-a517-50e7dcf96680 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a245dd82de1340f7a58873de1851c61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d02cb07a2a404c8d89aa13a950806d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:31.289793 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f7cfd4e3-738e-43dd-a517-50e7dcf96680 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] 10.222.0.33 "GET /compute/v2.1/servers/f6413c5e-771f-45c5-94a8-b197becc0815" status: 200 len: 1534 microversion: 2.1 time: 0.166026 Sep 23 04:47:31.290400 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1809/3668] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:31 2022] GET /compute/v2.1/servers/f6413c5e-771f-45c5-94a8-b197becc0815 => generated 1534 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:31.303446 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-27c99db3-abc2-4ff7-a6e1-a05b52f9edf6 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:31.304154 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-27c99db3-abc2-4ff7-a6e1-a05b52f9edf6 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] [instance: 53c2eac1-c886-45f2-8b2c-77aa98ceaab5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:31.310499 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-27c99db3-abc2-4ff7-a6e1-a05b52f9edf6 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:31.310996 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-27c99db3-abc2-4ff7-a6e1-a05b52f9edf6 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:31.311446 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-27c99db3-abc2-4ff7-a6e1-a05b52f9edf6 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:31.312185 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-27c99db3-abc2-4ff7-a6e1-a05b52f9edf6 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:31.312649 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-27c99db3-abc2-4ff7-a6e1-a05b52f9edf6 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:31.313080 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-27c99db3-abc2-4ff7-a6e1-a05b52f9edf6 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:31.450979 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-27c99db3-abc2-4ff7-a6e1-a05b52f9edf6 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11980041918484990dac709544d0b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c43f2b70bc74a48b62fb4115337f073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:31.459113 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-27c99db3-abc2-4ff7-a6e1-a05b52f9edf6 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/servers/53c2eac1-c886-45f2-8b2c-77aa98ceaab5" status: 200 len: 1307 microversion: 2.1 time: 0.159951 Sep 23 04:47:31.460087 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1860/3669] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:31 2022] GET /compute/v2.1/servers/53c2eac1-c886-45f2-8b2c-77aa98ceaab5 => generated 1307 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:31.532200 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-c7114e97-8931-4809-b393-f8d02632b7b1 req-7f5c4332-0e4c-4193-bd7f-5b11536b3263 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "401339a4-8674-4ff9-b09e-ba748f46928d", "name": "network-vif-unplugged", "status": "completed", "tag": "ee716fd2-ccf3-4c05-b155-29bb9a5565c2"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:47:31.542872 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-739b9df9-bb10-465d-9308-8db205fdb1eb tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:31.543501 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-739b9df9-bb10-465d-9308-8db205fdb1eb tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 28be637b-c43c-4881-b2ce-efb1ec1ad812] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:31.551940 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-c7114e97-8931-4809-b393-f8d02632b7b1 req-7f5c4332-0e4c-4193-bd7f-5b11536b3263 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:31.552960 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-c7114e97-8931-4809-b393-f8d02632b7b1 req-7f5c4332-0e4c-4193-bd7f-5b11536b3263 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:31.553431 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-c7114e97-8931-4809-b393-f8d02632b7b1 req-7f5c4332-0e4c-4193-bd7f-5b11536b3263 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:31.553565 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-739b9df9-bb10-465d-9308-8db205fdb1eb tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:31.553997 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-739b9df9-bb10-465d-9308-8db205fdb1eb tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:31.554446 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-739b9df9-bb10-465d-9308-8db205fdb1eb tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:31.555160 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-739b9df9-bb10-465d-9308-8db205fdb1eb tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:31.555627 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-739b9df9-bb10-465d-9308-8db205fdb1eb tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:31.556057 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-739b9df9-bb10-465d-9308-8db205fdb1eb tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:31.568551 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-c7114e97-8931-4809-b393-f8d02632b7b1 req-7f5c4332-0e4c-4193-bd7f-5b11536b3263 service nova] Creating event network-vif-unplugged:ee716fd2-ccf3-4c05-b155-29bb9a5565c2 for instance 401339a4-8674-4ff9-b09e-ba748f46928d on n-h1-846463-3 Sep 23 04:47:31.574742 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-c7114e97-8931-4809-b393-f8d02632b7b1 req-7f5c4332-0e4c-4193-bd7f-5b11536b3263 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046764 Sep 23 04:47:31.575660 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1810/3670] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:47:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:47:31.694541 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-739b9df9-bb10-465d-9308-8db205fdb1eb tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:31.704077 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f197e1d7-7856-446d-9e6f-e06243b00ac8 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:31.704271 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-739b9df9-bb10-465d-9308-8db205fdb1eb tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/28be637b-c43c-4881-b2ce-efb1ec1ad812" status: 200 len: 1486 microversion: 2.1 time: 0.167178 Sep 23 04:47:31.704895 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1861/3671] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:31 2022] GET /compute/v2.1/servers/28be637b-c43c-4881-b2ce-efb1ec1ad812 => generated 1486 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:31.705021 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f197e1d7-7856-446d-9e6f-e06243b00ac8 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: f0374fc2-3c0f-48e1-b969-2933785fd47b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:31.711146 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f197e1d7-7856-446d-9e6f-e06243b00ac8 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:31.711885 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f197e1d7-7856-446d-9e6f-e06243b00ac8 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:31.712045 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f197e1d7-7856-446d-9e6f-e06243b00ac8 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:31.713424 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f197e1d7-7856-446d-9e6f-e06243b00ac8 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:31.713881 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f197e1d7-7856-446d-9e6f-e06243b00ac8 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:31.714566 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f197e1d7-7856-446d-9e6f-e06243b00ac8 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:31.727499 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b7024d0d-2648-405e-81c4-58082abe8966 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1751390520"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:47:31.735896 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b7024d0d-2648-405e-81c4-58082abe8966 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 28be637b-c43c-4881-b2ce-efb1ec1ad812] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:31.742099 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b7024d0d-2648-405e-81c4-58082abe8966 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:31.742595 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b7024d0d-2648-405e-81c4-58082abe8966 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:31.743031 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b7024d0d-2648-405e-81c4-58082abe8966 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:31.743731 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b7024d0d-2648-405e-81c4-58082abe8966 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:31.744257 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b7024d0d-2648-405e-81c4-58082abe8966 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:31.744653 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b7024d0d-2648-405e-81c4-58082abe8966 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:31.784704 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=100 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:47:31.854214 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f197e1d7-7856-446d-9e6f-e06243b00ac8 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c786bbedc21849ea92924139a44707b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcafb05f6f554e278cd552023947c6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:31.862791 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f197e1d7-7856-446d-9e6f-e06243b00ac8 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/f0374fc2-3c0f-48e1-b969-2933785fd47b" status: 200 len: 1521 microversion: 2.1 time: 0.162843 Sep 23 04:47:31.863444 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1811/3672] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:31 2022] GET /compute/v2.1/servers/f0374fc2-3c0f-48e1-b969-2933785fd47b => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:47:31.907060 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b7024d0d-2648-405e-81c4-58082abe8966 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "PUT /compute/v2.1/servers/28be637b-c43c-4881-b2ce-efb1ec1ad812" status: 200 len: 1060 microversion: 2.1 time: 0.183259 Sep 23 04:47:31.907714 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1862/3673] 10.222.0.33 () {60 vars in 1256 bytes} [Fri Sep 23 04:47:31 2022] PUT /compute/v2.1/servers/28be637b-c43c-4881-b2ce-efb1ec1ad812 => generated 1060 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:47:31.928090 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8ba0bd46-d9f0-442a-85fd-389908f8e734 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:31.928692 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8ba0bd46-d9f0-442a-85fd-389908f8e734 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 28be637b-c43c-4881-b2ce-efb1ec1ad812] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:31.935452 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8ba0bd46-d9f0-442a-85fd-389908f8e734 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:31.935978 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8ba0bd46-d9f0-442a-85fd-389908f8e734 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:31.936396 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8ba0bd46-d9f0-442a-85fd-389908f8e734 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:31.939330 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8ba0bd46-d9f0-442a-85fd-389908f8e734 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:31.939330 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8ba0bd46-d9f0-442a-85fd-389908f8e734 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:31.939330 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8ba0bd46-d9f0-442a-85fd-389908f8e734 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:32.082407 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8ba0bd46-d9f0-442a-85fd-389908f8e734 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:32.091112 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8ba0bd46-d9f0-442a-85fd-389908f8e734 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/28be637b-c43c-4881-b2ce-efb1ec1ad812" status: 200 len: 1487 microversion: 2.1 time: 0.166747 Sep 23 04:47:32.091906 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1812/3674] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:31 2022] GET /compute/v2.1/servers/28be637b-c43c-4881-b2ce-efb1ec1ad812 => generated 1487 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:32.116562 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-43946999-bc1a-446e-958f-e801098fad1d tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:32.117188 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-43946999-bc1a-446e-958f-e801098fad1d tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 28be637b-c43c-4881-b2ce-efb1ec1ad812] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:32.121108 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:47:32.125093 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-43946999-bc1a-446e-958f-e801098fad1d tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:32.125593 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-43946999-bc1a-446e-958f-e801098fad1d tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:32.126068 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-43946999-bc1a-446e-958f-e801098fad1d tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:32.126824 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-43946999-bc1a-446e-958f-e801098fad1d tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:32.127370 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-43946999-bc1a-446e-958f-e801098fad1d tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:32.127803 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-43946999-bc1a-446e-958f-e801098fad1d tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:32.242724 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0f1e0d5b-bd87-43ed-9d71-eafce6e2c97e tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '.version_select at 0x7ff1ba846430>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:32.290122 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0f1e0d5b-bd87-43ed-9d71-eafce6e2c97e tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "GET /compute/v2.1/images/ebfd24d2-4412-4ba6-8024-99147eab6142" status: 200 len: 1455 microversion: 2.1 time: 0.050942 Sep 23 04:47:32.291261 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1813/3675] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:47:32 2022] GET /compute/v2.1/images/ebfd24d2-4412-4ba6-8024-99147eab6142 => generated 1455 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:32.300810 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-43946999-bc1a-446e-958f-e801098fad1d tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:32.309735 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-43946999-bc1a-446e-958f-e801098fad1d tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/28be637b-c43c-4881-b2ce-efb1ec1ad812" status: 200 len: 1487 microversion: 2.1 time: 0.198427 Sep 23 04:47:32.311122 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1863/3676] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:32 2022] GET /compute/v2.1/servers/28be637b-c43c-4881-b2ce-efb1ec1ad812 => generated 1487 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:32.313345 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4daa71b4-26e8-420c-a093-72b4ca361e5b tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:32.313992 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4daa71b4-26e8-420c-a093-72b4ca361e5b tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] [instance: f6413c5e-771f-45c5-94a8-b197becc0815] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:32.322736 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4daa71b4-26e8-420c-a093-72b4ca361e5b tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:32.325047 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4daa71b4-26e8-420c-a093-72b4ca361e5b tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:32.325969 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4daa71b4-26e8-420c-a093-72b4ca361e5b tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:32.328282 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4daa71b4-26e8-420c-a093-72b4ca361e5b tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:32.328282 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4daa71b4-26e8-420c-a093-72b4ca361e5b tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:32.332843 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-add3563c-b538-4e78-bb8b-aea6b127a2b7 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:32.333374 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4daa71b4-26e8-420c-a093-72b4ca361e5b tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:32.333773 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-add3563c-b538-4e78-bb8b-aea6b127a2b7 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 28be637b-c43c-4881-b2ce-efb1ec1ad812] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:32.340988 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-add3563c-b538-4e78-bb8b-aea6b127a2b7 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:32.341491 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-add3563c-b538-4e78-bb8b-aea6b127a2b7 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:32.341992 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-add3563c-b538-4e78-bb8b-aea6b127a2b7 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:32.342705 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-add3563c-b538-4e78-bb8b-aea6b127a2b7 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:32.343171 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-add3563c-b538-4e78-bb8b-aea6b127a2b7 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:32.343601 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-add3563c-b538-4e78-bb8b-aea6b127a2b7 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:32.369850 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-add3563c-b538-4e78-bb8b-aea6b127a2b7 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 28be637b-c43c-4881-b2ce-efb1ec1ad812] Going to try to terminate instance {{(pid=122699) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:47:32.475911 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4daa71b4-26e8-420c-a093-72b4ca361e5b tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a245dd82de1340f7a58873de1851c61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d02cb07a2a404c8d89aa13a950806d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:32.484717 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4daa71b4-26e8-420c-a093-72b4ca361e5b tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] 10.222.0.33 "GET /compute/v2.1/servers/f6413c5e-771f-45c5-94a8-b197becc0815" status: 200 len: 1540 microversion: 2.1 time: 0.175349 Sep 23 04:47:32.485494 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1814/3677] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:32 2022] GET /compute/v2.1/servers/f6413c5e-771f-45c5-94a8-b197becc0815 => generated 1540 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:47:32.491336 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7db3a2fe-4219-4b72-a4cf-2d79002a4fe3 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:32.492107 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7db3a2fe-4219-4b72-a4cf-2d79002a4fe3 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] [instance: 53c2eac1-c886-45f2-8b2c-77aa98ceaab5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:32.498953 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7db3a2fe-4219-4b72-a4cf-2d79002a4fe3 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:32.499450 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7db3a2fe-4219-4b72-a4cf-2d79002a4fe3 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:32.499953 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7db3a2fe-4219-4b72-a4cf-2d79002a4fe3 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:32.500599 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7db3a2fe-4219-4b72-a4cf-2d79002a4fe3 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:32.501058 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7db3a2fe-4219-4b72-a4cf-2d79002a4fe3 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:32.501490 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7db3a2fe-4219-4b72-a4cf-2d79002a4fe3 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:32.634296 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-7db3a2fe-4219-4b72-a4cf-2d79002a4fe3 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11980041918484990dac709544d0b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c43f2b70bc74a48b62fb4115337f073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:32.642442 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7db3a2fe-4219-4b72-a4cf-2d79002a4fe3 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/servers/53c2eac1-c886-45f2-8b2c-77aa98ceaab5" status: 200 len: 1307 microversion: 2.1 time: 0.155974 Sep 23 04:47:32.643086 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1815/3678] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:32 2022] GET /compute/v2.1/servers/53c2eac1-c886-45f2-8b2c-77aa98ceaab5 => generated 1307 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:32.648919 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-add3563c-b538-4e78-bb8b-aea6b127a2b7 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "DELETE /compute/v2.1/servers/28be637b-c43c-4881-b2ce-efb1ec1ad812" status: 204 len: 0 microversion: 2.1 time: 0.319970 Sep 23 04:47:32.649690 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1864/3679] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:47:32 2022] DELETE /compute/v2.1/servers/28be637b-c43c-4881-b2ce-efb1ec1ad812 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 23 04:47:32.663272 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0ee34c49-922f-4d40-81d0-fed867adaa02 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:32.663880 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-0ee34c49-922f-4d40-81d0-fed867adaa02 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 28be637b-c43c-4881-b2ce-efb1ec1ad812] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:32.670439 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0ee34c49-922f-4d40-81d0-fed867adaa02 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:32.670922 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0ee34c49-922f-4d40-81d0-fed867adaa02 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:32.671379 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0ee34c49-922f-4d40-81d0-fed867adaa02 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:32.672061 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0ee34c49-922f-4d40-81d0-fed867adaa02 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:32.672513 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0ee34c49-922f-4d40-81d0-fed867adaa02 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:32.672934 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0ee34c49-922f-4d40-81d0-fed867adaa02 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:32.802547 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-0ee34c49-922f-4d40-81d0-fed867adaa02 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:32.810907 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0ee34c49-922f-4d40-81d0-fed867adaa02 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/28be637b-c43c-4881-b2ce-efb1ec1ad812" status: 200 len: 1493 microversion: 2.1 time: 0.151556 Sep 23 04:47:32.811480 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1816/3680] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:32 2022] GET /compute/v2.1/servers/28be637b-c43c-4881-b2ce-efb1ec1ad812 => generated 1493 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:32.891324 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-728e02a3-ffbf-4cb7-b56a-f92478c2c9da tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:32.892032 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-728e02a3-ffbf-4cb7-b56a-f92478c2c9da tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: f0374fc2-3c0f-48e1-b969-2933785fd47b] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:32.898247 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-728e02a3-ffbf-4cb7-b56a-f92478c2c9da tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:32.898740 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-728e02a3-ffbf-4cb7-b56a-f92478c2c9da tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:32.899187 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-728e02a3-ffbf-4cb7-b56a-f92478c2c9da tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:32.899884 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-728e02a3-ffbf-4cb7-b56a-f92478c2c9da tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:32.900838 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-728e02a3-ffbf-4cb7-b56a-f92478c2c9da tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:32.901268 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-728e02a3-ffbf-4cb7-b56a-f92478c2c9da tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:33.031264 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-728e02a3-ffbf-4cb7-b56a-f92478c2c9da tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c786bbedc21849ea92924139a44707b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcafb05f6f554e278cd552023947c6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:33.038938 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-728e02a3-ffbf-4cb7-b56a-f92478c2c9da tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/f0374fc2-3c0f-48e1-b969-2933785fd47b" status: 200 len: 1501 microversion: 2.1 time: 0.152321 Sep 23 04:47:33.039532 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1865/3681] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:32 2022] GET /compute/v2.1/servers/f0374fc2-3c0f-48e1-b969-2933785fd47b => generated 1501 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:33.061278 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6e34ffeb-6d2c-46dc-b7dc-2266eedcb303 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "61120784-b26d-4f52-9faa-257771b46de4"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:47:33.063798 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-6e34ffeb-6d2c-46dc-b7dc-2266eedcb303 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: f0374fc2-3c0f-48e1-b969-2933785fd47b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:33.069834 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6e34ffeb-6d2c-46dc-b7dc-2266eedcb303 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:33.070358 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6e34ffeb-6d2c-46dc-b7dc-2266eedcb303 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:33.070804 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6e34ffeb-6d2c-46dc-b7dc-2266eedcb303 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:33.072557 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6e34ffeb-6d2c-46dc-b7dc-2266eedcb303 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:33.073025 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6e34ffeb-6d2c-46dc-b7dc-2266eedcb303 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:33.073460 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6e34ffeb-6d2c-46dc-b7dc-2266eedcb303 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:33.096571 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-6e34ffeb-6d2c-46dc-b7dc-2266eedcb303 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] HTTP exception thrown: Cannot 'attach_volume' instance f0374fc2-3c0f-48e1-b969-2933785fd47b while it is in vm_state rescued Sep 23 04:47:33.098269 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6e34ffeb-6d2c-46dc-b7dc-2266eedcb303 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Request method failure captured: Sep 23 04:47:33.098269 n-d-846463-3 devstack@n-api.service[122698]: request: POST /compute/v2.1/servers/f0374fc2-3c0f-48e1-b969-2933785fd47b/os-volume_attachments HTTP/1.1 Sep 23 04:47:33.098269 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:47:33.098269 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:47:33.098269 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:47:33.098269 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 74 Sep 23 04:47:33.098269 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:47:33.098269 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:47:33.098269 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:47:33.098269 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:47:33.098269 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLToEB3KmJeqpeof3qtE1_ms3jD5q4R8EB4mtf6agEJBYOf3R1k1wW8qdql02e7ra521m3dklynQTAHmyD-EBkyV9p_88fIs_nz1LT08tnPBKYcM8ytHDfif-4FU40Ttv4qlVJY_DNQ2W4b2ZBQdDVOwU9-lTsZtqbQggZ1JBKRn9aZQ Sep 23 04:47:33.098269 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:47:33.098269 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:47:33.098269 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:47:33.098269 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:47:33.098269 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:47:33.098269 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:47:33.098269 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: dcafb05f6f554e278cd552023947c6ac Sep 23 04:47:33.098269 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-196358672 Sep 23 04:47:33.098269 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:47:33.098269 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:47:33.098269 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_dcafb05f6f554e278cd552023947c6ac", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dcafb05f6f554e278cd552023947c6ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/dcafb05f6f554e278cd552023947c6ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dcafb05f6f554e278cd552023947c6ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:47:33.098269 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ServerRescueNegativeTestJSON-196358672 Sep 23 04:47:33.098269 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: dcafb05f6f554e278cd552023947c6ac Sep 23 04:47:33.098269 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-196358672 Sep 23 04:47:33.098269 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ServerRescueNegativeTestJSON-196358672-project Sep 23 04:47:33.098269 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:47:33.098269 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:47:33.098269 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: c786bbedc21849ea92924139a44707b7 Sep 23 04:47:33.098269 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ServerRescueNegativeTestJSON-196358672-project Sep 23 04:47:33.098269 n-d-846463-3 devstack@n-api.service[122698]: Sep 23 04:47:33.098269 n-d-846463-3 devstack@n-api.service[122698]: {"volumeAttachment": {"volumeId": "61120784-b26d-4f52-9faa-257771b46de4"}} Sep 23 04:47:33.098269 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:47:33.098269 n-d-846463-3 devstack@n-api.service[122698]: exception: Cannot 'attach_volume' instance f0374fc2-3c0f-48e1-b969-2933785fd47b while it is in vm_state rescued Sep 23 04:47:33.098269 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'server_id': 'f0374fc2-3c0f-48e1-b969-2933785fd47b', 'body': {'volumeAttachment': {'volumeId': '61120784-b26d-4f52-9faa-257771b46de4'}}} Sep 23 04:47:33.098269 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:47:33.098269 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:33.098269 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 23 04:47:33.098269 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 23 04:47:33.098269 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 23 04:47:33.098269 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 23 04:47:33.098269 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 23 04:47:33.098269 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 23 04:47:33.098269 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f0374fc2-3c0f-48e1-b969-2933785fd47b in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 23 04:47:33.098269 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:47:33.098269 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:47:33.098269 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:47:33.098269 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:33.098269 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:47:33.098269 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:47:33.098269 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:47:33.098269 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:47:33.098269 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:47:33.098269 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:47:33.098269 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:47:33.098269 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:47:33.098269 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:47:33.098269 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:47:33.098269 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:47:33.098269 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:47:33.098269 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 23 04:47:33.098269 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 23 04:47:33.103339 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 23 04:47:33.103339 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 23 04:47:33.103339 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance f0374fc2-3c0f-48e1-b969-2933785fd47b while it is in vm_state rescued Sep 23 04:47:33.103339 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:47:33.103339 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:47:33.103339 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:47:33.103339 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:33.103339 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:47:33.103339 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:47:33.103339 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:47:33.103339 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:47:33.103339 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance f0374fc2-3c0f-48e1-b969-2933785fd47b while it is in vm_state rescued Sep 23 04:47:33.103339 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:47:33.103339 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6e34ffeb-6d2c-46dc-b7dc-2266eedcb303 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Returning 409 to user: Cannot 'attach_volume' instance f0374fc2-3c0f-48e1-b969-2933785fd47b while it is in vm_state rescued {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:47:33.103339 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-6e34ffeb-6d2c-46dc-b7dc-2266eedcb303 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "POST /compute/v2.1/servers/f0374fc2-3c0f-48e1-b969-2933785fd47b/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.042525 Sep 23 04:47:33.103339 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1817/3682] 10.222.0.33 () {60 vars in 1323 bytes} [Fri Sep 23 04:47:33 2022] POST /compute/v2.1/servers/f0374fc2-3c0f-48e1-b969-2933785fd47b/os-volume_attachments => generated 152 bytes in 44 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 23 04:47:33.109678 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-43e8ea84-4857-4171-9bf0-cc332d210afc tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:47:33.110241 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-43e8ea84-4857-4171-9bf0-cc332d210afc tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: f0374fc2-3c0f-48e1-b969-2933785fd47b] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:33.116136 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-43e8ea84-4857-4171-9bf0-cc332d210afc tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:33.116620 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-43e8ea84-4857-4171-9bf0-cc332d210afc tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:33.117052 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-43e8ea84-4857-4171-9bf0-cc332d210afc tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:33.117762 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-43e8ea84-4857-4171-9bf0-cc332d210afc tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:33.118243 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-43e8ea84-4857-4171-9bf0-cc332d210afc tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:33.118668 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-43e8ea84-4857-4171-9bf0-cc332d210afc tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:33.308144 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6227e849-2e7d-4501-912d-fc03c092a2d5 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '.version_select at 0x7ff1ba889b80>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:33.317865 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-43e8ea84-4857-4171-9bf0-cc332d210afc tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "POST /compute/v2.1/servers/f0374fc2-3c0f-48e1-b969-2933785fd47b/action" status: 202 len: 0 microversion: 2.1 time: 0.211558 Sep 23 04:47:33.322830 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1866/3683] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:47:33 2022] POST /compute/v2.1/servers/f0374fc2-3c0f-48e1-b969-2933785fd47b/action => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:47:33.329429 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-44cf35cf-84c1-47d2-80ab-42434b70978a tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:33.330075 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-44cf35cf-84c1-47d2-80ab-42434b70978a tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: f0374fc2-3c0f-48e1-b969-2933785fd47b] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:33.339150 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-44cf35cf-84c1-47d2-80ab-42434b70978a tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:33.339921 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-44cf35cf-84c1-47d2-80ab-42434b70978a tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:33.340451 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-44cf35cf-84c1-47d2-80ab-42434b70978a tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:33.341287 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-44cf35cf-84c1-47d2-80ab-42434b70978a tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:33.341816 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-44cf35cf-84c1-47d2-80ab-42434b70978a tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:33.342360 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-44cf35cf-84c1-47d2-80ab-42434b70978a tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:33.402892 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-6227e849-2e7d-4501-912d-fc03c092a2d5 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "GET /compute/v2.1/images/ebfd24d2-4412-4ba6-8024-99147eab6142" status: 200 len: 1455 microversion: 2.1 time: 0.099187 Sep 23 04:47:33.404126 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1818/3684] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:47:33 2022] GET /compute/v2.1/images/ebfd24d2-4412-4ba6-8024-99147eab6142 => generated 1455 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:47:33.516738 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ca02d4c0-4283-4349-8a78-cfbd982b8ba3 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:33.516738 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-ca02d4c0-4283-4349-8a78-cfbd982b8ba3 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] [instance: f6413c5e-771f-45c5-94a8-b197becc0815] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:33.520010 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ca02d4c0-4283-4349-8a78-cfbd982b8ba3 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:33.533130 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ca02d4c0-4283-4349-8a78-cfbd982b8ba3 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:33.533130 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ca02d4c0-4283-4349-8a78-cfbd982b8ba3 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:33.533130 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ca02d4c0-4283-4349-8a78-cfbd982b8ba3 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:33.533130 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ca02d4c0-4283-4349-8a78-cfbd982b8ba3 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:33.533130 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ca02d4c0-4283-4349-8a78-cfbd982b8ba3 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:33.612152 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-44cf35cf-84c1-47d2-80ab-42434b70978a tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c786bbedc21849ea92924139a44707b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcafb05f6f554e278cd552023947c6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:33.620927 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-44cf35cf-84c1-47d2-80ab-42434b70978a tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/f0374fc2-3c0f-48e1-b969-2933785fd47b" status: 200 len: 1509 microversion: 2.1 time: 0.295985 Sep 23 04:47:33.623987 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1867/3685] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:33 2022] GET /compute/v2.1/servers/f0374fc2-3c0f-48e1-b969-2933785fd47b => generated 1509 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:33.665555 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d7a41f4c-5093-4d4c-bd6a-b8898ebf0f6a tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:33.666238 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d7a41f4c-5093-4d4c-bd6a-b8898ebf0f6a tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] [instance: 53c2eac1-c886-45f2-8b2c-77aa98ceaab5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:33.675415 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d7a41f4c-5093-4d4c-bd6a-b8898ebf0f6a tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:33.678380 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d7a41f4c-5093-4d4c-bd6a-b8898ebf0f6a tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:33.678380 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d7a41f4c-5093-4d4c-bd6a-b8898ebf0f6a tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:33.680908 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d7a41f4c-5093-4d4c-bd6a-b8898ebf0f6a tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:33.683627 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d7a41f4c-5093-4d4c-bd6a-b8898ebf0f6a tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:33.684362 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d7a41f4c-5093-4d4c-bd6a-b8898ebf0f6a tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:33.761236 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ca02d4c0-4283-4349-8a78-cfbd982b8ba3 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a245dd82de1340f7a58873de1851c61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d02cb07a2a404c8d89aa13a950806d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:33.770015 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ca02d4c0-4283-4349-8a78-cfbd982b8ba3 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] 10.222.0.33 "GET /compute/v2.1/servers/f6413c5e-771f-45c5-94a8-b197becc0815" status: 200 len: 1540 microversion: 2.1 time: 0.265116 Sep 23 04:47:33.771238 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1819/3686] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:33 2022] GET /compute/v2.1/servers/f6413c5e-771f-45c5-94a8-b197becc0815 => generated 1540 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:33.776169 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-0b56c263-6a2c-453e-9fd7-f25a51d10a12 req-07c9f18a-2f20-4691-9425-5fbdaa50d3d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53c2eac1-c886-45f2-8b2c-77aa98ceaab5", "name": "network-vif-plugged", "status": "completed", "tag": "87b50488-13f1-4d99-be79-5edefa1d65c9"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:47:33.786871 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-0b56c263-6a2c-453e-9fd7-f25a51d10a12 req-07c9f18a-2f20-4691-9425-5fbdaa50d3d7 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:33.787441 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-0b56c263-6a2c-453e-9fd7-f25a51d10a12 req-07c9f18a-2f20-4691-9425-5fbdaa50d3d7 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:33.787948 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-0b56c263-6a2c-453e-9fd7-f25a51d10a12 req-07c9f18a-2f20-4691-9425-5fbdaa50d3d7 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:33.800216 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-0b56c263-6a2c-453e-9fd7-f25a51d10a12 req-07c9f18a-2f20-4691-9425-5fbdaa50d3d7 service nova] Creating event network-vif-plugged:87b50488-13f1-4d99-be79-5edefa1d65c9 for instance 53c2eac1-c886-45f2-8b2c-77aa98ceaab5 on n-h1-846463-3 Sep 23 04:47:33.805511 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-0b56c263-6a2c-453e-9fd7-f25a51d10a12 req-07c9f18a-2f20-4691-9425-5fbdaa50d3d7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032730 Sep 23 04:47:33.807030 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1820/3687] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:47:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:47:33.835603 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7f862096-9440-4d40-a499-cd9862602711 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:33.837320 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7f862096-9440-4d40-a499-cd9862602711 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 28be637b-c43c-4881-b2ce-efb1ec1ad812] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:33.844738 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7f862096-9440-4d40-a499-cd9862602711 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:33.845690 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7f862096-9440-4d40-a499-cd9862602711 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:33.846465 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7f862096-9440-4d40-a499-cd9862602711 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:33.847659 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7f862096-9440-4d40-a499-cd9862602711 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:33.848372 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7f862096-9440-4d40-a499-cd9862602711 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:33.848988 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7f862096-9440-4d40-a499-cd9862602711 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:33.966839 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d7a41f4c-5093-4d4c-bd6a-b8898ebf0f6a tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11980041918484990dac709544d0b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c43f2b70bc74a48b62fb4115337f073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:33.985823 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d7a41f4c-5093-4d4c-bd6a-b8898ebf0f6a tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/servers/53c2eac1-c886-45f2-8b2c-77aa98ceaab5" status: 200 len: 1307 microversion: 2.1 time: 0.323806 Sep 23 04:47:33.992475 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1868/3688] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:33 2022] GET /compute/v2.1/servers/53c2eac1-c886-45f2-8b2c-77aa98ceaab5 => generated 1307 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:34.093619 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-7f862096-9440-4d40-a499-cd9862602711 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:34.101906 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7f862096-9440-4d40-a499-cd9862602711 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/28be637b-c43c-4881-b2ce-efb1ec1ad812" status: 200 len: 1493 microversion: 2.1 time: 0.271309 Sep 23 04:47:34.102590 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1821/3689] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:33 2022] GET /compute/v2.1/servers/28be637b-c43c-4881-b2ce-efb1ec1ad812 => generated 1493 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:47:34.421581 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-16cc8e72-4bf5-4337-8db0-2196b29f23c0 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '.version_select at 0x7ff1c3eddc10>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:34.478268 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-16cc8e72-4bf5-4337-8db0-2196b29f23c0 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "GET /compute/v2.1/images/ebfd24d2-4412-4ba6-8024-99147eab6142" status: 200 len: 1455 microversion: 2.1 time: 0.063090 Sep 23 04:47:34.479941 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1869/3690] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:47:34 2022] GET /compute/v2.1/images/ebfd24d2-4412-4ba6-8024-99147eab6142 => generated 1455 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:34.651761 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1a75ebff-df92-4644-94f4-b204a12c06cf tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:34.652497 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-1a75ebff-df92-4644-94f4-b204a12c06cf tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: f0374fc2-3c0f-48e1-b969-2933785fd47b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:34.659892 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1a75ebff-df92-4644-94f4-b204a12c06cf tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:34.660392 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1a75ebff-df92-4644-94f4-b204a12c06cf tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:34.660828 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1a75ebff-df92-4644-94f4-b204a12c06cf tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:34.661736 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1a75ebff-df92-4644-94f4-b204a12c06cf tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:34.662392 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1a75ebff-df92-4644-94f4-b204a12c06cf tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:34.662942 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1a75ebff-df92-4644-94f4-b204a12c06cf tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:34.683498 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:47:34.784588 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-37e0f115-243c-45d4-acc6-feefa0aaf220 req-cfe0f0f7-4275-4b20-bb68-235f10b45ca6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28be637b-c43c-4881-b2ce-efb1ec1ad812", "name": "network-vif-deleted", "tag": "5ab6e461-b84c-43e0-a5e3-b990d284d4a7"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:47:34.797361 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-37e0f115-243c-45d4-acc6-feefa0aaf220 req-cfe0f0f7-4275-4b20-bb68-235f10b45ca6 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:34.798033 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-37e0f115-243c-45d4-acc6-feefa0aaf220 req-cfe0f0f7-4275-4b20-bb68-235f10b45ca6 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:34.798770 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-37e0f115-243c-45d4-acc6-feefa0aaf220 req-cfe0f0f7-4275-4b20-bb68-235f10b45ca6 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:34.815844 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-37e0f115-243c-45d4-acc6-feefa0aaf220 req-cfe0f0f7-4275-4b20-bb68-235f10b45ca6 service nova] Creating event network-vif-deleted:5ab6e461-b84c-43e0-a5e3-b990d284d4a7 for instance 28be637b-c43c-4881-b2ce-efb1ec1ad812 on n-h1-846463-3 Sep 23 04:47:34.823254 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-37e0f115-243c-45d4-acc6-feefa0aaf220 req-cfe0f0f7-4275-4b20-bb68-235f10b45ca6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040687 Sep 23 04:47:34.828182 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1870/3691] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:47:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:47:34.839140 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-12cdc95d-ae6c-4144-bff6-3bd0ddcca1e7 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:34.840829 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-12cdc95d-ae6c-4144-bff6-3bd0ddcca1e7 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] [instance: f6413c5e-771f-45c5-94a8-b197becc0815] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:34.856295 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-12cdc95d-ae6c-4144-bff6-3bd0ddcca1e7 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:34.857153 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-12cdc95d-ae6c-4144-bff6-3bd0ddcca1e7 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:34.857933 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-12cdc95d-ae6c-4144-bff6-3bd0ddcca1e7 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:34.861844 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-12cdc95d-ae6c-4144-bff6-3bd0ddcca1e7 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:34.861844 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-12cdc95d-ae6c-4144-bff6-3bd0ddcca1e7 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:34.861844 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-12cdc95d-ae6c-4144-bff6-3bd0ddcca1e7 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:34.892908 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-1a75ebff-df92-4644-94f4-b204a12c06cf tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c786bbedc21849ea92924139a44707b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcafb05f6f554e278cd552023947c6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:34.901049 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-1a75ebff-df92-4644-94f4-b204a12c06cf tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/f0374fc2-3c0f-48e1-b969-2933785fd47b" status: 200 len: 1509 microversion: 2.1 time: 0.253915 Sep 23 04:47:34.901768 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1822/3692] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:34 2022] GET /compute/v2.1/servers/f0374fc2-3c0f-48e1-b969-2933785fd47b => generated 1509 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:35.022948 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-12cdc95d-ae6c-4144-bff6-3bd0ddcca1e7 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a245dd82de1340f7a58873de1851c61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d02cb07a2a404c8d89aa13a950806d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:35.028344 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-44734491-3ebf-4780-8ecd-e26373524ac7 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:35.030139 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-44734491-3ebf-4780-8ecd-e26373524ac7 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] [instance: 53c2eac1-c886-45f2-8b2c-77aa98ceaab5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:35.040769 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-12cdc95d-ae6c-4144-bff6-3bd0ddcca1e7 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] 10.222.0.33 "GET /compute/v2.1/servers/f6413c5e-771f-45c5-94a8-b197becc0815" status: 200 len: 1522 microversion: 2.1 time: 0.211005 Sep 23 04:47:35.042490 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1871/3693] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:34 2022] GET /compute/v2.1/servers/f6413c5e-771f-45c5-94a8-b197becc0815 => generated 1522 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:35.044090 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-44734491-3ebf-4780-8ecd-e26373524ac7 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:35.044975 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-44734491-3ebf-4780-8ecd-e26373524ac7 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:35.045812 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-44734491-3ebf-4780-8ecd-e26373524ac7 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:35.047142 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-44734491-3ebf-4780-8ecd-e26373524ac7 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:35.048042 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-44734491-3ebf-4780-8ecd-e26373524ac7 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:35.048849 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-44734491-3ebf-4780-8ecd-e26373524ac7 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:35.064407 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-27c5fb23-fe44-47f7-9177-8b450965c170 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:35.065146 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-27c5fb23-fe44-47f7-9177-8b450965c170 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] [instance: f6413c5e-771f-45c5-94a8-b197becc0815] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:35.071339 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-27c5fb23-fe44-47f7-9177-8b450965c170 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:35.071891 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-27c5fb23-fe44-47f7-9177-8b450965c170 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:35.072894 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-27c5fb23-fe44-47f7-9177-8b450965c170 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:35.073594 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-27c5fb23-fe44-47f7-9177-8b450965c170 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:35.074262 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-27c5fb23-fe44-47f7-9177-8b450965c170 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:35.074688 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-27c5fb23-fe44-47f7-9177-8b450965c170 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:35.100042 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-27c5fb23-fe44-47f7-9177-8b450965c170 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] [instance: f6413c5e-771f-45c5-94a8-b197becc0815] Going to try to terminate instance {{(pid=122699) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:47:35.185860 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-44734491-3ebf-4780-8ecd-e26373524ac7 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11980041918484990dac709544d0b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c43f2b70bc74a48b62fb4115337f073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:35.194024 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-44734491-3ebf-4780-8ecd-e26373524ac7 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/servers/53c2eac1-c886-45f2-8b2c-77aa98ceaab5" status: 200 len: 1307 microversion: 2.1 time: 0.180502 Sep 23 04:47:35.194601 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1823/3694] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:35 2022] GET /compute/v2.1/servers/53c2eac1-c886-45f2-8b2c-77aa98ceaab5 => generated 1307 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:47:35.199700 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a040c35d-583b-4c9f-8021-9ee12f3ddb71 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:35.204930 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a040c35d-583b-4c9f-8021-9ee12f3ddb71 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 28be637b-c43c-4881-b2ce-efb1ec1ad812] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:35.205879 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a040c35d-583b-4c9f-8021-9ee12f3ddb71 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:35.206394 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a040c35d-583b-4c9f-8021-9ee12f3ddb71 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:35.206836 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a040c35d-583b-4c9f-8021-9ee12f3ddb71 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:35.207927 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a040c35d-583b-4c9f-8021-9ee12f3ddb71 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:35.208482 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a040c35d-583b-4c9f-8021-9ee12f3ddb71 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:35.208959 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a040c35d-583b-4c9f-8021-9ee12f3ddb71 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:35.278826 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a040c35d-583b-4c9f-8021-9ee12f3ddb71 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:35.287084 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a040c35d-583b-4c9f-8021-9ee12f3ddb71 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/28be637b-c43c-4881-b2ce-efb1ec1ad812" status: 200 len: 1451 microversion: 2.1 time: 0.091433 Sep 23 04:47:35.287674 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1824/3695] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:35 2022] GET /compute/v2.1/servers/28be637b-c43c-4881-b2ce-efb1ec1ad812 => generated 1451 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:35.416932 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-27c5fb23-fe44-47f7-9177-8b450965c170 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f6413c5e-771f-45c5-94a8-b197becc0815" status: 204 len: 0 microversion: 2.1 time: 0.355234 Sep 23 04:47:35.417940 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1872/3696] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:47:35 2022] DELETE /compute/v2.1/servers/f6413c5e-771f-45c5-94a8-b197becc0815 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 23 04:47:35.426062 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-fe24bcf3-3d60-409c-af7a-a186b9d408c7 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:35.426917 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-fe24bcf3-3d60-409c-af7a-a186b9d408c7 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] [instance: f6413c5e-771f-45c5-94a8-b197becc0815] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:35.433753 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fe24bcf3-3d60-409c-af7a-a186b9d408c7 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:35.434543 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fe24bcf3-3d60-409c-af7a-a186b9d408c7 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:35.434992 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fe24bcf3-3d60-409c-af7a-a186b9d408c7 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:35.435709 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fe24bcf3-3d60-409c-af7a-a186b9d408c7 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:35.436252 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fe24bcf3-3d60-409c-af7a-a186b9d408c7 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:35.436858 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fe24bcf3-3d60-409c-af7a-a186b9d408c7 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:35.495543 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1e7334e7-00be-44d5-a395-cc52b6c23ccf tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '.version_select at 0x7ff1c0c510d0>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:35.550842 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1e7334e7-00be-44d5-a395-cc52b6c23ccf tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "GET /compute/v2.1/images/ebfd24d2-4412-4ba6-8024-99147eab6142" status: 200 len: 1455 microversion: 2.1 time: 0.060131 Sep 23 04:47:35.553545 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1873/3697] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:47:35 2022] GET /compute/v2.1/images/ebfd24d2-4412-4ba6-8024-99147eab6142 => generated 1455 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:47:35.576520 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-fe24bcf3-3d60-409c-af7a-a186b9d408c7 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a245dd82de1340f7a58873de1851c61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d02cb07a2a404c8d89aa13a950806d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:35.584583 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-fe24bcf3-3d60-409c-af7a-a186b9d408c7 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] 10.222.0.33 "GET /compute/v2.1/servers/f6413c5e-771f-45c5-94a8-b197becc0815" status: 200 len: 1528 microversion: 2.1 time: 0.162448 Sep 23 04:47:35.585171 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1825/3698] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:35 2022] GET /compute/v2.1/servers/f6413c5e-771f-45c5-94a8-b197becc0815 => generated 1528 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:35.825156 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-a65ed40f-518a-488d-8bb7-445c9b44264a req-4bd75190-a96a-4ae8-800e-77018dffa53b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0eac077-d4bd-4e4a-a04a-3f86aeeed9bd", "name": "network-vif-plugged", "status": "completed", "tag": "8f6a797f-179a-458b-adf8-7a33bc4631ac"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:47:35.848216 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-a65ed40f-518a-488d-8bb7-445c9b44264a req-4bd75190-a96a-4ae8-800e-77018dffa53b service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:35.848737 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-a65ed40f-518a-488d-8bb7-445c9b44264a req-4bd75190-a96a-4ae8-800e-77018dffa53b service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:35.849182 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-a65ed40f-518a-488d-8bb7-445c9b44264a req-4bd75190-a96a-4ae8-800e-77018dffa53b service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:35.866079 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-a65ed40f-518a-488d-8bb7-445c9b44264a req-4bd75190-a96a-4ae8-800e-77018dffa53b service nova] Creating event network-vif-plugged:8f6a797f-179a-458b-adf8-7a33bc4631ac for instance a0eac077-d4bd-4e4a-a04a-3f86aeeed9bd on n-h1-846463-3 Sep 23 04:47:35.871706 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-a65ed40f-518a-488d-8bb7-445c9b44264a req-4bd75190-a96a-4ae8-800e-77018dffa53b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050441 Sep 23 04:47:35.874200 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1874/3699] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:47:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:47:35.924679 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-515bf349-4f4d-4ea3-9734-aaec22969e12 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:35.925956 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-515bf349-4f4d-4ea3-9734-aaec22969e12 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: f0374fc2-3c0f-48e1-b969-2933785fd47b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:35.933865 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-515bf349-4f4d-4ea3-9734-aaec22969e12 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:35.934705 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-515bf349-4f4d-4ea3-9734-aaec22969e12 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:35.935321 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-515bf349-4f4d-4ea3-9734-aaec22969e12 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:35.936214 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-515bf349-4f4d-4ea3-9734-aaec22969e12 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:35.940300 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-515bf349-4f4d-4ea3-9734-aaec22969e12 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:35.940300 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-515bf349-4f4d-4ea3-9734-aaec22969e12 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:36.108520 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-515bf349-4f4d-4ea3-9734-aaec22969e12 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c786bbedc21849ea92924139a44707b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcafb05f6f554e278cd552023947c6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:36.116585 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-515bf349-4f4d-4ea3-9734-aaec22969e12 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/f0374fc2-3c0f-48e1-b969-2933785fd47b" status: 200 len: 1509 microversion: 2.1 time: 0.195715 Sep 23 04:47:36.117254 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1826/3700] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:35 2022] GET /compute/v2.1/servers/f0374fc2-3c0f-48e1-b969-2933785fd47b => generated 1509 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:36.218326 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-931275d8-6557-407c-9bfa-ca04f2947f47 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:36.219065 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-931275d8-6557-407c-9bfa-ca04f2947f47 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] [instance: 53c2eac1-c886-45f2-8b2c-77aa98ceaab5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:36.225392 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-931275d8-6557-407c-9bfa-ca04f2947f47 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:36.226102 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-931275d8-6557-407c-9bfa-ca04f2947f47 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:36.226546 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-931275d8-6557-407c-9bfa-ca04f2947f47 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:36.227394 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-931275d8-6557-407c-9bfa-ca04f2947f47 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:36.227914 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-931275d8-6557-407c-9bfa-ca04f2947f47 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:36.228560 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-931275d8-6557-407c-9bfa-ca04f2947f47 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:36.312619 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-21e517ae-29cc-4c78-ac2f-9201de5b1621 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:36.313569 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-21e517ae-29cc-4c78-ac2f-9201de5b1621 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 28be637b-c43c-4881-b2ce-efb1ec1ad812] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:36.321348 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-21e517ae-29cc-4c78-ac2f-9201de5b1621 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:36.327908 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-21e517ae-29cc-4c78-ac2f-9201de5b1621 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:36.328685 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-21e517ae-29cc-4c78-ac2f-9201de5b1621 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:36.329645 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-21e517ae-29cc-4c78-ac2f-9201de5b1621 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:36.330347 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-21e517ae-29cc-4c78-ac2f-9201de5b1621 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:36.331011 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-21e517ae-29cc-4c78-ac2f-9201de5b1621 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:36.366652 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-21e517ae-29cc-4c78-ac2f-9201de5b1621 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:36.367469 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-21e517ae-29cc-4c78-ac2f-9201de5b1621 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:36.368116 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-21e517ae-29cc-4c78-ac2f-9201de5b1621 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:36.368821 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-21e517ae-29cc-4c78-ac2f-9201de5b1621 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lazy-loading 'fault' on Instance uuid 28be637b-c43c-4881-b2ce-efb1ec1ad812 {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:47:36.448953 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-21e517ae-29cc-4c78-ac2f-9201de5b1621 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:36.458527 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-931275d8-6557-407c-9bfa-ca04f2947f47 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11980041918484990dac709544d0b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c43f2b70bc74a48b62fb4115337f073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:36.463240 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-21e517ae-29cc-4c78-ac2f-9201de5b1621 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/28be637b-c43c-4881-b2ce-efb1ec1ad812" status: 200 len: 1310 microversion: 2.1 time: 0.154318 Sep 23 04:47:36.465164 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1827/3701] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:36 2022] GET /compute/v2.1/servers/28be637b-c43c-4881-b2ce-efb1ec1ad812 => generated 1310 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:36.481571 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-931275d8-6557-407c-9bfa-ca04f2947f47 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/servers/53c2eac1-c886-45f2-8b2c-77aa98ceaab5" status: 200 len: 1486 microversion: 2.1 time: 0.258959 Sep 23 04:47:36.481571 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1875/3702] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:36 2022] GET /compute/v2.1/servers/53c2eac1-c886-45f2-8b2c-77aa98ceaab5 => generated 1486 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:36.503913 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d1de68c7-421e-44c2-9c92-43b1ec5ce3d3 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-703253486"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:47:36.506718 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d1de68c7-421e-44c2-9c92-43b1ec5ce3d3 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] [instance: 53c2eac1-c886-45f2-8b2c-77aa98ceaab5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:36.514913 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d1de68c7-421e-44c2-9c92-43b1ec5ce3d3 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:36.515528 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d1de68c7-421e-44c2-9c92-43b1ec5ce3d3 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:36.516031 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d1de68c7-421e-44c2-9c92-43b1ec5ce3d3 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:36.516937 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d1de68c7-421e-44c2-9c92-43b1ec5ce3d3 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:36.517483 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d1de68c7-421e-44c2-9c92-43b1ec5ce3d3 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:36.518157 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d1de68c7-421e-44c2-9c92-43b1ec5ce3d3 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:36.566955 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-de259b2d-dc69-47c6-b35a-327ba8956886 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '.version_select at 0x7ff1ba816b80>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:36.786312 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-de259b2d-dc69-47c6-b35a-327ba8956886 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "GET /compute/v2.1/images/ebfd24d2-4412-4ba6-8024-99147eab6142" status: 200 len: 1455 microversion: 2.1 time: 0.223018 Sep 23 04:47:36.793478 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1828/3703] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:47:36 2022] GET /compute/v2.1/images/ebfd24d2-4412-4ba6-8024-99147eab6142 => generated 1455 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:36.806459 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b82873a9-5cfc-4f8e-94a4-b2c10c9df9f4 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:36.807948 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b82873a9-5cfc-4f8e-94a4-b2c10c9df9f4 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] [instance: f6413c5e-771f-45c5-94a8-b197becc0815] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:36.815431 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b82873a9-5cfc-4f8e-94a4-b2c10c9df9f4 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:36.816166 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b82873a9-5cfc-4f8e-94a4-b2c10c9df9f4 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:36.816849 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b82873a9-5cfc-4f8e-94a4-b2c10c9df9f4 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:36.817822 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b82873a9-5cfc-4f8e-94a4-b2c10c9df9f4 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:36.818481 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b82873a9-5cfc-4f8e-94a4-b2c10c9df9f4 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:36.819115 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b82873a9-5cfc-4f8e-94a4-b2c10c9df9f4 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:36.819990 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:47:36.984756 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b82873a9-5cfc-4f8e-94a4-b2c10c9df9f4 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a245dd82de1340f7a58873de1851c61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d02cb07a2a404c8d89aa13a950806d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:36.998179 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b82873a9-5cfc-4f8e-94a4-b2c10c9df9f4 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] 10.222.0.33 "GET /compute/v2.1/servers/f6413c5e-771f-45c5-94a8-b197becc0815" status: 200 len: 1528 microversion: 2.1 time: 0.195535 Sep 23 04:47:37.012680 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1829/3704] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:36 2022] GET /compute/v2.1/servers/f6413c5e-771f-45c5-94a8-b197becc0815 => generated 1528 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:37.042456 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d1de68c7-421e-44c2-9c92-43b1ec5ce3d3 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "POST /compute/v2.1/servers/53c2eac1-c886-45f2-8b2c-77aa98ceaab5/action" status: 202 len: 0 microversion: 2.1 time: 0.526401 Sep 23 04:47:37.047047 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1876/3705] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:47:36 2022] POST /compute/v2.1/servers/53c2eac1-c886-45f2-8b2c-77aa98ceaab5/action => generated 0 bytes in 545 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 23 04:47:37.055177 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-081cf3e7-fcc7-4a37-bdca-aa6fc933f4cb tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '.version_select at 0x7ff1ba89bf70>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:37.109344 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-081cf3e7-fcc7-4a37-bdca-aa6fc933f4cb tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/images/b764d7df-d7b0-49c6-aacd-66b1e6e81089" status: 200 len: 1413 microversion: 2.1 time: 0.059179 Sep 23 04:47:37.115259 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1830/3706] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:47:37 2022] GET /compute/v2.1/images/b764d7df-d7b0-49c6-aacd-66b1e6e81089 => generated 1413 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:37.124498 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1bb0d72e-8812-4a04-a531-f4f81334b3c0 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '.version_select at 0x7ff1ba995430>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:37.143622 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a90c2ae3-c107-4615-9ac0-2fc2dc3db004 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:37.145306 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a90c2ae3-c107-4615-9ac0-2fc2dc3db004 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: f0374fc2-3c0f-48e1-b969-2933785fd47b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:37.158886 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a90c2ae3-c107-4615-9ac0-2fc2dc3db004 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:37.162969 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a90c2ae3-c107-4615-9ac0-2fc2dc3db004 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:37.164717 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a90c2ae3-c107-4615-9ac0-2fc2dc3db004 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:37.167659 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a90c2ae3-c107-4615-9ac0-2fc2dc3db004 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:37.168388 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a90c2ae3-c107-4615-9ac0-2fc2dc3db004 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:37.170037 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a90c2ae3-c107-4615-9ac0-2fc2dc3db004 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:37.201586 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1bb0d72e-8812-4a04-a531-f4f81334b3c0 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/images/b764d7df-d7b0-49c6-aacd-66b1e6e81089" status: 200 len: 1413 microversion: 2.1 time: 0.081216 Sep 23 04:47:37.202672 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1877/3707] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:47:37 2022] GET /compute/v2.1/images/b764d7df-d7b0-49c6-aacd-66b1e6e81089 => generated 1413 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:37.222173 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b1b8c282-45dc-4c3c-9649-936f09994756 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '.version_select at 0x7ff1ba9f6af0>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:37.399730 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a90c2ae3-c107-4615-9ac0-2fc2dc3db004 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c786bbedc21849ea92924139a44707b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcafb05f6f554e278cd552023947c6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:37.412604 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a90c2ae3-c107-4615-9ac0-2fc2dc3db004 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/f0374fc2-3c0f-48e1-b969-2933785fd47b" status: 200 len: 1509 microversion: 2.1 time: 0.274828 Sep 23 04:47:37.413380 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1831/3708] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:37 2022] GET /compute/v2.1/servers/f0374fc2-3c0f-48e1-b969-2933785fd47b => generated 1509 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:37.492811 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-fcd8d46d-f170-4e32-b41f-b8c052d630a9 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:37.493972 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-fcd8d46d-f170-4e32-b41f-b8c052d630a9 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 28be637b-c43c-4881-b2ce-efb1ec1ad812] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:37.506091 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fcd8d46d-f170-4e32-b41f-b8c052d630a9 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:37.507397 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fcd8d46d-f170-4e32-b41f-b8c052d630a9 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:37.507861 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fcd8d46d-f170-4e32-b41f-b8c052d630a9 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:37.513290 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fcd8d46d-f170-4e32-b41f-b8c052d630a9 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:37.513290 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fcd8d46d-f170-4e32-b41f-b8c052d630a9 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:37.513290 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fcd8d46d-f170-4e32-b41f-b8c052d630a9 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:37.538998 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-fcd8d46d-f170-4e32-b41f-b8c052d630a9 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] HTTP exception thrown: Instance 28be637b-c43c-4881-b2ce-efb1ec1ad812 could not be found. Sep 23 04:47:37.539367 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-fcd8d46d-f170-4e32-b41f-b8c052d630a9 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Request method failure captured: Sep 23 04:47:37.539367 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/28be637b-c43c-4881-b2ce-efb1ec1ad812 HTTP/1.1 Sep 23 04:47:37.539367 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:47:37.539367 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:47:37.539367 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:47:37.539367 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:47:37.539367 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:47:37.539367 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:47:37.539367 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:47:37.539367 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:47:37.539367 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTlTlFK_k4e3BWkoqwVigfjvHO2lVSTsmHRT7EhNgH87mj-DVuWXCq-NRLrmXyv4E_e0wXdkZnDmOQ4aUkRrz7wPxuRsMdZHh23aH7xyd0PRdo29c8XIic0D4fdht4KBWWMxFeNNSWWMe-xxhvPgOUVxbcTbEXPF75Q0c4Y9h1Ew0hk Sep 23 04:47:37.539367 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:47:37.539367 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:47:37.539367 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:47:37.539367 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:47:37.539367 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:47:37.539367 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:47:37.539367 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: c23bd5a8b84942898a99930b2bc0ca12 Sep 23 04:47:37.539367 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ServersTestJSON-1923416422 Sep 23 04:47:37.539367 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:47:37.539367 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:47:37.539367 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c23bd5a8b84942898a99930b2bc0ca12", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c23bd5a8b84942898a99930b2bc0ca12"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c23bd5a8b84942898a99930b2bc0ca12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c23bd5a8b84942898a99930b2bc0ca12"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:47:37.539367 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ServersTestJSON-1923416422 Sep 23 04:47:37.539367 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: c23bd5a8b84942898a99930b2bc0ca12 Sep 23 04:47:37.539367 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ServersTestJSON-1923416422 Sep 23 04:47:37.539367 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ServersTestJSON-1923416422-project Sep 23 04:47:37.539367 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:47:37.539367 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:47:37.539367 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 252c87e244984f71ae0907ee769bec05 Sep 23 04:47:37.539367 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ServersTestJSON-1923416422-project Sep 23 04:47:37.539367 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:47:37.539367 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 28be637b-c43c-4881-b2ce-efb1ec1ad812 could not be found. Sep 23 04:47:37.539367 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '28be637b-c43c-4881-b2ce-efb1ec1ad812'} Sep 23 04:47:37.539367 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:47:37.539367 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:37.539367 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:47:37.539367 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:47:37.539367 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:47:37.539367 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:47:37.539367 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:47:37.539367 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:47:37.539367 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:47:37.539367 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:47:37.539367 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28be637b-c43c-4881-b2ce-efb1ec1ad812 could not be found. Sep 23 04:47:37.539367 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:47:37.539367 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:47:37.539367 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:47:37.539367 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:37.539367 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:47:37.539367 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:47:37.539367 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:47:37.539367 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:47:37.539367 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:47:37.539367 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:47:37.539367 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:47:37.539367 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:47:37.539367 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:47:37.539367 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:47:37.539367 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:47:37.539367 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:47:37.539367 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28be637b-c43c-4881-b2ce-efb1ec1ad812 could not be found. Sep 23 04:47:37.539367 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:47:37.539367 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:47:37.539367 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:47:37.549856 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:37.549856 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:47:37.549856 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:47:37.549856 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:47:37.549856 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:47:37.549856 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28be637b-c43c-4881-b2ce-efb1ec1ad812 could not be found. Sep 23 04:47:37.549856 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:47:37.549856 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-fcd8d46d-f170-4e32-b41f-b8c052d630a9 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Returning 404 to user: Instance 28be637b-c43c-4881-b2ce-efb1ec1ad812 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:47:37.549856 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-fcd8d46d-f170-4e32-b41f-b8c052d630a9 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/28be637b-c43c-4881-b2ce-efb1ec1ad812" status: 404 len: 111 microversion: 2.1 time: 0.054543 Sep 23 04:47:37.549856 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1832/3709] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:37 2022] GET /compute/v2.1/servers/28be637b-c43c-4881-b2ce-efb1ec1ad812 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 04:47:37.558306 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-56bbc702-ff50-41d7-8cfd-cc00911b330e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:37.558813 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-56bbc702-ff50-41d7-8cfd-cc00911b330e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 28be637b-c43c-4881-b2ce-efb1ec1ad812] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:37.560791 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=100 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:47:37.567341 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-56bbc702-ff50-41d7-8cfd-cc00911b330e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:37.567879 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-56bbc702-ff50-41d7-8cfd-cc00911b330e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:37.568312 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-56bbc702-ff50-41d7-8cfd-cc00911b330e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:37.569021 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-56bbc702-ff50-41d7-8cfd-cc00911b330e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:37.569490 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-56bbc702-ff50-41d7-8cfd-cc00911b330e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:37.570076 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-56bbc702-ff50-41d7-8cfd-cc00911b330e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:37.591722 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-56bbc702-ff50-41d7-8cfd-cc00911b330e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] HTTP exception thrown: Instance 28be637b-c43c-4881-b2ce-efb1ec1ad812 could not be found. Sep 23 04:47:37.594765 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-56bbc702-ff50-41d7-8cfd-cc00911b330e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Request method failure captured: Sep 23 04:47:37.594765 n-d-846463-3 devstack@n-api.service[122698]: request: DELETE /compute/v2.1/servers/28be637b-c43c-4881-b2ce-efb1ec1ad812 HTTP/1.1 Sep 23 04:47:37.594765 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:47:37.594765 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:47:37.594765 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:47:37.594765 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:47:37.594765 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:47:37.594765 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:47:37.594765 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:47:37.594765 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:47:37.594765 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTlTlFK_k4e3BWkoqwVigfjvHO2lVSTsmHRT7EhNgH87mj-DVuWXCq-NRLrmXyv4E_e0wXdkZnDmOQ4aUkRrz7wPxuRsMdZHh23aH7xyd0PRdo29c8XIic0D4fdht4KBWWMxFeNNSWWMe-xxhvPgOUVxbcTbEXPF75Q0c4Y9h1Ew0hk Sep 23 04:47:37.594765 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:47:37.594765 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:47:37.594765 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:47:37.594765 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:47:37.594765 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:47:37.594765 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:47:37.594765 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: c23bd5a8b84942898a99930b2bc0ca12 Sep 23 04:47:37.594765 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ServersTestJSON-1923416422 Sep 23 04:47:37.594765 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:47:37.594765 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:47:37.594765 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c23bd5a8b84942898a99930b2bc0ca12", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c23bd5a8b84942898a99930b2bc0ca12"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c23bd5a8b84942898a99930b2bc0ca12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c23bd5a8b84942898a99930b2bc0ca12"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:47:37.594765 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ServersTestJSON-1923416422 Sep 23 04:47:37.594765 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: c23bd5a8b84942898a99930b2bc0ca12 Sep 23 04:47:37.594765 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ServersTestJSON-1923416422 Sep 23 04:47:37.594765 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ServersTestJSON-1923416422-project Sep 23 04:47:37.594765 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:47:37.594765 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:47:37.594765 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 252c87e244984f71ae0907ee769bec05 Sep 23 04:47:37.594765 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ServersTestJSON-1923416422-project Sep 23 04:47:37.594765 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:47:37.594765 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 28be637b-c43c-4881-b2ce-efb1ec1ad812 could not be found. Sep 23 04:47:37.594765 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '28be637b-c43c-4881-b2ce-efb1ec1ad812'} Sep 23 04:47:37.594765 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:47:37.594765 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:37.594765 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:47:37.594765 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:47:37.594765 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:47:37.594765 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:47:37.594765 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:47:37.594765 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:47:37.594765 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:47:37.594765 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:47:37.594765 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28be637b-c43c-4881-b2ce-efb1ec1ad812 could not be found. Sep 23 04:47:37.594765 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:47:37.594765 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:47:37.594765 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:47:37.594765 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:37.594765 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:47:37.594765 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:47:37.594765 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:47:37.594765 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:47:37.594765 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:47:37.594765 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:47:37.594765 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 04:47:37.594765 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 04:47:37.594765 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 04:47:37.594765 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 04:47:37.594765 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:47:37.594765 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:47:37.594765 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:47:37.594765 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:47:37.594765 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28be637b-c43c-4881-b2ce-efb1ec1ad812 could not be found. Sep 23 04:47:37.600538 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:47:37.600538 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:47:37.600538 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:47:37.600538 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:37.600538 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:47:37.600538 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:47:37.600538 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:47:37.600538 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:47:37.600538 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28be637b-c43c-4881-b2ce-efb1ec1ad812 could not be found. Sep 23 04:47:37.600538 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:47:37.600538 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-56bbc702-ff50-41d7-8cfd-cc00911b330e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Returning 404 to user: Instance 28be637b-c43c-4881-b2ce-efb1ec1ad812 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:47:37.600538 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-56bbc702-ff50-41d7-8cfd-cc00911b330e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "DELETE /compute/v2.1/servers/28be637b-c43c-4881-b2ce-efb1ec1ad812" status: 404 len: 111 microversion: 2.1 time: 0.042085 Sep 23 04:47:37.612322 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1833/3710] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:47:37 2022] DELETE /compute/v2.1/servers/28be637b-c43c-4881-b2ce-efb1ec1ad812 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:47:37.612777 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b1b8c282-45dc-4c3c-9649-936f09994756 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "DELETE /compute/v2.1/images/b764d7df-d7b0-49c6-aacd-66b1e6e81089" status: 204 len: 0 microversion: 2.1 time: 0.396520 Sep 23 04:47:37.615830 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1878/3711] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:37 2022] DELETE /compute/v2.1/images/b764d7df-d7b0-49c6-aacd-66b1e6e81089 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:47:37.623171 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c15fb4d4-e7f9-4f3b-ae59-4505af115849 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:37.625566 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c15fb4d4-e7f9-4f3b-ae59-4505af115849 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 28be637b-c43c-4881-b2ce-efb1ec1ad812] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:37.627039 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5dcf28bd-6408-4bf7-9772-e7c031f1156f tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '.version_select at 0x7ff1ba981790>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:37.639011 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c15fb4d4-e7f9-4f3b-ae59-4505af115849 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:37.647024 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c15fb4d4-e7f9-4f3b-ae59-4505af115849 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:37.652582 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c15fb4d4-e7f9-4f3b-ae59-4505af115849 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:37.659801 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c15fb4d4-e7f9-4f3b-ae59-4505af115849 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:37.660302 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c15fb4d4-e7f9-4f3b-ae59-4505af115849 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:37.660743 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c15fb4d4-e7f9-4f3b-ae59-4505af115849 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:37.678555 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-5dcf28bd-6408-4bf7-9772-e7c031f1156f tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] HTTP exception thrown: Image not found. Sep 23 04:47:37.681063 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5dcf28bd-6408-4bf7-9772-e7c031f1156f tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Request method failure captured: Sep 23 04:47:37.681063 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/images/b764d7df-d7b0-49c6-aacd-66b1e6e81089 HTTP/1.1 Sep 23 04:47:37.681063 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:47:37.681063 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:47:37.681063 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:47:37.681063 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:47:37.681063 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:47:37.681063 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:47:37.681063 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:47:37.681063 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:47:37.681063 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTlvfdi4o0Y9mCUPokn0jIn66E_gYHfswvNUJk0oWKgUgT2bckyK_dFOK9sSyNanN_-OMIsJrgn2yiYsVsn4YI8ZjfIXbzODmcN_TY4KwEWe3dvDtDeCaJf-hXkJqT27YTJIsS4J-e2mLxKFLMD_hT3yOT9NVPofkih-81ZETnZH6pk Sep 23 04:47:37.681063 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:47:37.681063 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:47:37.681063 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:47:37.681063 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:47:37.681063 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:47:37.681063 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:47:37.681063 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 7c43f2b70bc74a48b62fb4115337f073 Sep 23 04:47:37.681063 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ImagesTestJSON-1079639924 Sep 23 04:47:37.681063 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:47:37.681063 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:47:37.681063 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7c43f2b70bc74a48b62fb4115337f073", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7c43f2b70bc74a48b62fb4115337f073"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7c43f2b70bc74a48b62fb4115337f073"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7c43f2b70bc74a48b62fb4115337f073"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:47:37.681063 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ImagesTestJSON-1079639924 Sep 23 04:47:37.681063 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 7c43f2b70bc74a48b62fb4115337f073 Sep 23 04:47:37.681063 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ImagesTestJSON-1079639924 Sep 23 04:47:37.681063 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ImagesTestJSON-1079639924-project Sep 23 04:47:37.681063 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:47:37.681063 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:47:37.681063 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: c11980041918484990dac709544d0b42 Sep 23 04:47:37.681063 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ImagesTestJSON-1079639924-project Sep 23 04:47:37.681063 n-d-846463-3 devstack@n-api.service[122699]: method: Sep 23 04:47:37.681063 n-d-846463-3 devstack@n-api.service[122699]: exception: Image not found. Sep 23 04:47:37.681063 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': 'b764d7df-d7b0-49c6-aacd-66b1e6e81089'} Sep 23 04:47:37.681063 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:47:37.681063 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:37.681063 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 23 04:47:37.681063 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 23 04:47:37.681063 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 23 04:47:37.681063 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 23 04:47:37.681063 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 23 04:47:37.681063 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 23 04:47:37.681063 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 23 04:47:37.681063 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 23 04:47:37.681063 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 23 04:47:37.681063 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 23 04:47:37.681063 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 23 04:47:37.681063 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 23 04:47:37.681063 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 23 04:47:37.681063 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 23 04:47:37.681063 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 23 04:47:37.681063 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 23 04:47:37.681063 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID b764d7df-d7b0-49c6-aacd-66b1e6e81089 Sep 23 04:47:37.681063 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:47:37.681063 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:47:37.681063 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:47:37.681063 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:37.681063 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Sep 23 04:47:37.681063 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Sep 23 04:47:37.681063 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 23 04:47:37.681063 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 23 04:47:37.681063 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 23 04:47:37.681063 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 23 04:47:37.681063 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 23 04:47:37.681063 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 23 04:47:37.690009 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 23 04:47:37.690009 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 23 04:47:37.690009 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 23 04:47:37.690009 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 23 04:47:37.690009 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 23 04:47:37.690009 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 23 04:47:37.690009 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 23 04:47:37.690009 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 23 04:47:37.690009 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 23 04:47:37.690009 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 23 04:47:37.690009 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 23 04:47:37.690009 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 23 04:47:37.690009 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 23 04:47:37.690009 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 23 04:47:37.690009 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 23 04:47:37.690009 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 23 04:47:37.690009 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b764d7df-d7b0-49c6-aacd-66b1e6e81089 could not be found. Sep 23 04:47:37.690009 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:47:37.690009 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:47:37.690009 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:47:37.690009 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:37.690009 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:47:37.690009 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:47:37.690009 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:47:37.690009 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:47:37.690009 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:47:37.690009 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:47:37.690009 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:47:37.690009 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:47:37.690009 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Sep 23 04:47:37.690009 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 23 04:47:37.690009 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 23 04:47:37.690009 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:47:37.690009 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:47:37.690009 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:47:37.690009 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:37.690009 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:47:37.690009 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:47:37.690009 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:47:37.690009 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:47:37.690009 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 23 04:47:37.690009 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:47:37.690009 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5dcf28bd-6408-4bf7-9772-e7c031f1156f tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Returning 404 to user: Image not found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:47:37.690009 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5dcf28bd-6408-4bf7-9772-e7c031f1156f tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/images/b764d7df-d7b0-49c6-aacd-66b1e6e81089" status: 404 len: 62 microversion: 2.1 time: 0.063448 Sep 23 04:47:37.690009 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1879/3712] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:47:37 2022] GET /compute/v2.1/images/b764d7df-d7b0-49c6-aacd-66b1e6e81089 => generated 62 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 23 04:47:37.702093 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-bb3a49da-6f6a-4943-a019-611907700a1a tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:37.702848 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-bb3a49da-6f6a-4943-a019-611907700a1a tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] [instance: 53c2eac1-c886-45f2-8b2c-77aa98ceaab5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:37.719097 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-c15fb4d4-e7f9-4f3b-ae59-4505af115849 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] HTTP exception thrown: Instance 28be637b-c43c-4881-b2ce-efb1ec1ad812 could not be found. Sep 23 04:47:37.721223 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bb3a49da-6f6a-4943-a019-611907700a1a tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:37.722792 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bb3a49da-6f6a-4943-a019-611907700a1a tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:37.723236 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bb3a49da-6f6a-4943-a019-611907700a1a tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:37.724756 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c15fb4d4-e7f9-4f3b-ae59-4505af115849 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Request method failure captured: Sep 23 04:47:37.724756 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/28be637b-c43c-4881-b2ce-efb1ec1ad812 HTTP/1.1 Sep 23 04:47:37.724756 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:47:37.724756 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:47:37.724756 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:47:37.724756 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:47:37.724756 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:47:37.724756 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:47:37.724756 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:47:37.724756 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:47:37.724756 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTlTlFK_k4e3BWkoqwVigfjvHO2lVSTsmHRT7EhNgH87mj-DVuWXCq-NRLrmXyv4E_e0wXdkZnDmOQ4aUkRrz7wPxuRsMdZHh23aH7xyd0PRdo29c8XIic0D4fdht4KBWWMxFeNNSWWMe-xxhvPgOUVxbcTbEXPF75Q0c4Y9h1Ew0hk Sep 23 04:47:37.724756 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:47:37.724756 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:47:37.724756 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:47:37.724756 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:47:37.724756 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:47:37.724756 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:47:37.724756 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: c23bd5a8b84942898a99930b2bc0ca12 Sep 23 04:47:37.724756 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ServersTestJSON-1923416422 Sep 23 04:47:37.724756 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:47:37.724756 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:47:37.724756 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c23bd5a8b84942898a99930b2bc0ca12", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c23bd5a8b84942898a99930b2bc0ca12"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c23bd5a8b84942898a99930b2bc0ca12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c23bd5a8b84942898a99930b2bc0ca12"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:47:37.724756 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ServersTestJSON-1923416422 Sep 23 04:47:37.724756 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: c23bd5a8b84942898a99930b2bc0ca12 Sep 23 04:47:37.724756 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ServersTestJSON-1923416422 Sep 23 04:47:37.724756 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ServersTestJSON-1923416422-project Sep 23 04:47:37.724756 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:47:37.724756 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:47:37.724756 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 252c87e244984f71ae0907ee769bec05 Sep 23 04:47:37.724756 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ServersTestJSON-1923416422-project Sep 23 04:47:37.724756 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:47:37.724756 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 28be637b-c43c-4881-b2ce-efb1ec1ad812 could not be found. Sep 23 04:47:37.724756 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '28be637b-c43c-4881-b2ce-efb1ec1ad812'} Sep 23 04:47:37.724756 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:47:37.724756 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:37.724756 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:47:37.724756 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:47:37.724756 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:47:37.724756 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:47:37.724756 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:47:37.724756 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:47:37.724756 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:47:37.724756 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:47:37.724756 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28be637b-c43c-4881-b2ce-efb1ec1ad812 could not be found. Sep 23 04:47:37.724756 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:47:37.724756 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:47:37.724756 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:47:37.724756 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:37.724756 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:47:37.724756 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:47:37.724756 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:47:37.724756 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:47:37.724756 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:47:37.724756 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:47:37.724756 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:47:37.724756 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:47:37.724756 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:47:37.724756 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:47:37.724756 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:47:37.724756 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:47:37.724756 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28be637b-c43c-4881-b2ce-efb1ec1ad812 could not be found. Sep 23 04:47:37.724756 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:47:37.724756 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:47:37.724756 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:47:37.729861 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:37.729861 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:47:37.729861 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:47:37.729861 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:47:37.729861 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:47:37.729861 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28be637b-c43c-4881-b2ce-efb1ec1ad812 could not be found. Sep 23 04:47:37.729861 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:47:37.731382 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bb3a49da-6f6a-4943-a019-611907700a1a tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:37.735047 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c15fb4d4-e7f9-4f3b-ae59-4505af115849 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Returning 404 to user: Instance 28be637b-c43c-4881-b2ce-efb1ec1ad812 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:47:37.735755 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bb3a49da-6f6a-4943-a019-611907700a1a tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:37.736791 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c15fb4d4-e7f9-4f3b-ae59-4505af115849 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/28be637b-c43c-4881-b2ce-efb1ec1ad812" status: 404 len: 111 microversion: 2.1 time: 0.123126 Sep 23 04:47:37.741704 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bb3a49da-6f6a-4943-a019-611907700a1a tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:37.751541 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1834/3713] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:37 2022] GET /compute/v2.1/servers/28be637b-c43c-4881-b2ce-efb1ec1ad812 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:47:37.763366 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c3150ae5-6aec-45dc-855e-6a0121b36368 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:37.768548 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c3150ae5-6aec-45dc-855e-6a0121b36368 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 5977951e-84f3-4f6b-b86f-44853cc1bc60] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:37.817539 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c3150ae5-6aec-45dc-855e-6a0121b36368 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:37.818949 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c3150ae5-6aec-45dc-855e-6a0121b36368 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:37.820485 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c3150ae5-6aec-45dc-855e-6a0121b36368 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:37.823749 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c3150ae5-6aec-45dc-855e-6a0121b36368 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:37.829581 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c3150ae5-6aec-45dc-855e-6a0121b36368 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:37.830844 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c3150ae5-6aec-45dc-855e-6a0121b36368 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:37.915503 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-c3150ae5-6aec-45dc-855e-6a0121b36368 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] HTTP exception thrown: Instance 5977951e-84f3-4f6b-b86f-44853cc1bc60 could not be found. Sep 23 04:47:37.922017 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c3150ae5-6aec-45dc-855e-6a0121b36368 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Request method failure captured: Sep 23 04:47:37.922017 n-d-846463-3 devstack@n-api.service[122698]: request: DELETE /compute/v2.1/servers/5977951e-84f3-4f6b-b86f-44853cc1bc60 HTTP/1.1 Sep 23 04:47:37.922017 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:47:37.922017 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:47:37.922017 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:47:37.922017 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:47:37.922017 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:47:37.922017 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:47:37.922017 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:47:37.922017 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:47:37.922017 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTlTlFK_k4e3BWkoqwVigfjvHO2lVSTsmHRT7EhNgH87mj-DVuWXCq-NRLrmXyv4E_e0wXdkZnDmOQ4aUkRrz7wPxuRsMdZHh23aH7xyd0PRdo29c8XIic0D4fdht4KBWWMxFeNNSWWMe-xxhvPgOUVxbcTbEXPF75Q0c4Y9h1Ew0hk Sep 23 04:47:37.922017 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:47:37.922017 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:47:37.922017 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:47:37.922017 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:47:37.922017 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:47:37.922017 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:47:37.922017 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: c23bd5a8b84942898a99930b2bc0ca12 Sep 23 04:47:37.922017 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ServersTestJSON-1923416422 Sep 23 04:47:37.922017 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:47:37.922017 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:47:37.922017 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c23bd5a8b84942898a99930b2bc0ca12", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c23bd5a8b84942898a99930b2bc0ca12"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c23bd5a8b84942898a99930b2bc0ca12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c23bd5a8b84942898a99930b2bc0ca12"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:47:37.922017 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ServersTestJSON-1923416422 Sep 23 04:47:37.922017 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: c23bd5a8b84942898a99930b2bc0ca12 Sep 23 04:47:37.922017 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ServersTestJSON-1923416422 Sep 23 04:47:37.922017 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ServersTestJSON-1923416422-project Sep 23 04:47:37.922017 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:47:37.922017 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:47:37.922017 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 252c87e244984f71ae0907ee769bec05 Sep 23 04:47:37.922017 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ServersTestJSON-1923416422-project Sep 23 04:47:37.922017 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:47:37.922017 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 5977951e-84f3-4f6b-b86f-44853cc1bc60 could not be found. Sep 23 04:47:37.922017 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '5977951e-84f3-4f6b-b86f-44853cc1bc60'} Sep 23 04:47:37.922017 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:47:37.922017 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:37.922017 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:47:37.922017 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:47:37.922017 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:47:37.922017 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:47:37.922017 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:47:37.922017 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:47:37.922017 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:47:37.922017 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:47:37.922017 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5977951e-84f3-4f6b-b86f-44853cc1bc60 could not be found. Sep 23 04:47:37.922017 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:47:37.922017 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:47:37.922017 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:47:37.922017 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:37.922017 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:47:37.922017 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:47:37.922017 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:47:37.922017 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:47:37.922017 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:47:37.922017 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:47:37.922017 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 04:47:37.922017 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 04:47:37.922017 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 04:47:37.922017 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 04:47:37.922017 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:47:37.922017 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:47:37.922017 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:47:37.922017 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:47:37.922017 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5977951e-84f3-4f6b-b86f-44853cc1bc60 could not be found. Sep 23 04:47:37.933303 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:47:37.933303 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:47:37.933303 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:47:37.933303 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:37.933303 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:47:37.933303 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:47:37.933303 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:47:37.933303 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:47:37.933303 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5977951e-84f3-4f6b-b86f-44853cc1bc60 could not be found. Sep 23 04:47:37.933303 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:47:37.933303 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c3150ae5-6aec-45dc-855e-6a0121b36368 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Returning 404 to user: Instance 5977951e-84f3-4f6b-b86f-44853cc1bc60 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:47:37.935729 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c3150ae5-6aec-45dc-855e-6a0121b36368 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "DELETE /compute/v2.1/servers/5977951e-84f3-4f6b-b86f-44853cc1bc60" status: 404 len: 111 microversion: 2.1 time: 0.181237 Sep 23 04:47:37.939223 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1835/3714] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:47:37 2022] DELETE /compute/v2.1/servers/5977951e-84f3-4f6b-b86f-44853cc1bc60 => generated 111 bytes in 187 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:47:37.957767 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-16bf5553-6437-4dee-accc-129363570d1d tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '.version_select at 0x7ff1ba89b040>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:38.046637 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-bb3a49da-6f6a-4943-a019-611907700a1a tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11980041918484990dac709544d0b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c43f2b70bc74a48b62fb4115337f073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:38.058698 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-bb3a49da-6f6a-4943-a019-611907700a1a tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/servers/53c2eac1-c886-45f2-8b2c-77aa98ceaab5" status: 200 len: 1498 microversion: 2.1 time: 0.370228 Sep 23 04:47:38.060217 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1880/3715] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:37 2022] GET /compute/v2.1/servers/53c2eac1-c886-45f2-8b2c-77aa98ceaab5 => generated 1498 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:47:38.065443 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-16bf5553-6437-4dee-accc-129363570d1d tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "GET /compute/v2.1/images/ebfd24d2-4412-4ba6-8024-99147eab6142" status: 200 len: 1455 microversion: 2.1 time: 0.124820 Sep 23 04:47:38.066248 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1836/3716] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:47:37 2022] GET /compute/v2.1/images/ebfd24d2-4412-4ba6-8024-99147eab6142 => generated 1455 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:38.070176 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-ec0b2b54-ef8e-4cdc-b5fa-359c14b1178f req-a1b96099-efcc-4750-85be-9fb8d126717c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6413c5e-771f-45c5-94a8-b197becc0815", "name": "network-vif-plugged", "status": "completed", "tag": "050c3a35-71cb-4639-af15-aff3db06b6cf"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:47:38.079153 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9a2c0ba1-5733-4f49-b68d-d0d3b5bcc52f tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:38.082835 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-9a2c0ba1-5733-4f49-b68d-d0d3b5bcc52f tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 5977951e-84f3-4f6b-b86f-44853cc1bc60] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:38.108151 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-ec0b2b54-ef8e-4cdc-b5fa-359c14b1178f req-a1b96099-efcc-4750-85be-9fb8d126717c service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:38.111955 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-ec0b2b54-ef8e-4cdc-b5fa-359c14b1178f req-a1b96099-efcc-4750-85be-9fb8d126717c service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:38.112484 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-ec0b2b54-ef8e-4cdc-b5fa-359c14b1178f req-a1b96099-efcc-4750-85be-9fb8d126717c service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:38.114322 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9a2c0ba1-5733-4f49-b68d-d0d3b5bcc52f tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:38.116451 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9a2c0ba1-5733-4f49-b68d-d0d3b5bcc52f tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:38.117265 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9a2c0ba1-5733-4f49-b68d-d0d3b5bcc52f tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:38.123420 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9a2c0ba1-5733-4f49-b68d-d0d3b5bcc52f tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:38.124065 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9a2c0ba1-5733-4f49-b68d-d0d3b5bcc52f tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:38.125343 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9a2c0ba1-5733-4f49-b68d-d0d3b5bcc52f tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:38.144214 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-ec0b2b54-ef8e-4cdc-b5fa-359c14b1178f req-a1b96099-efcc-4750-85be-9fb8d126717c service nova] Creating event network-vif-plugged:050c3a35-71cb-4639-af15-aff3db06b6cf for instance f6413c5e-771f-45c5-94a8-b197becc0815 on n-h2-846463-3 Sep 23 04:47:38.154776 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-ec0b2b54-ef8e-4cdc-b5fa-359c14b1178f req-a1b96099-efcc-4750-85be-9fb8d126717c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092686 Sep 23 04:47:38.160315 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-9a2c0ba1-5733-4f49-b68d-d0d3b5bcc52f tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] HTTP exception thrown: Instance 5977951e-84f3-4f6b-b86f-44853cc1bc60 could not be found. Sep 23 04:47:38.160492 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1881/3717] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:47:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:47:38.164325 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9a2c0ba1-5733-4f49-b68d-d0d3b5bcc52f tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Request method failure captured: Sep 23 04:47:38.164325 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/5977951e-84f3-4f6b-b86f-44853cc1bc60 HTTP/1.1 Sep 23 04:47:38.164325 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:47:38.164325 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:47:38.164325 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:47:38.164325 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:47:38.164325 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:47:38.164325 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:47:38.164325 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:47:38.164325 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:47:38.164325 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTlTlFK_k4e3BWkoqwVigfjvHO2lVSTsmHRT7EhNgH87mj-DVuWXCq-NRLrmXyv4E_e0wXdkZnDmOQ4aUkRrz7wPxuRsMdZHh23aH7xyd0PRdo29c8XIic0D4fdht4KBWWMxFeNNSWWMe-xxhvPgOUVxbcTbEXPF75Q0c4Y9h1Ew0hk Sep 23 04:47:38.164325 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:47:38.164325 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:47:38.164325 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:47:38.164325 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:47:38.164325 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:47:38.164325 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:47:38.164325 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: c23bd5a8b84942898a99930b2bc0ca12 Sep 23 04:47:38.164325 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ServersTestJSON-1923416422 Sep 23 04:47:38.164325 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:47:38.164325 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:47:38.164325 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c23bd5a8b84942898a99930b2bc0ca12", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c23bd5a8b84942898a99930b2bc0ca12"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c23bd5a8b84942898a99930b2bc0ca12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c23bd5a8b84942898a99930b2bc0ca12"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:47:38.164325 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ServersTestJSON-1923416422 Sep 23 04:47:38.164325 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: c23bd5a8b84942898a99930b2bc0ca12 Sep 23 04:47:38.164325 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ServersTestJSON-1923416422 Sep 23 04:47:38.164325 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ServersTestJSON-1923416422-project Sep 23 04:47:38.164325 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:47:38.164325 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:47:38.164325 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 252c87e244984f71ae0907ee769bec05 Sep 23 04:47:38.164325 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ServersTestJSON-1923416422-project Sep 23 04:47:38.164325 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:47:38.164325 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 5977951e-84f3-4f6b-b86f-44853cc1bc60 could not be found. Sep 23 04:47:38.164325 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '5977951e-84f3-4f6b-b86f-44853cc1bc60'} Sep 23 04:47:38.164325 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:47:38.164325 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:38.164325 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:47:38.164325 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:47:38.164325 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:47:38.164325 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:47:38.164325 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:47:38.164325 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:47:38.164325 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:47:38.164325 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:47:38.164325 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5977951e-84f3-4f6b-b86f-44853cc1bc60 could not be found. Sep 23 04:47:38.164325 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:47:38.164325 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:47:38.164325 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:47:38.164325 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:38.164325 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:47:38.164325 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:47:38.164325 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:47:38.164325 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:47:38.164325 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:47:38.164325 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:47:38.164325 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:47:38.164325 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:47:38.164325 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:47:38.164325 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:47:38.164325 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:47:38.164325 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:47:38.164325 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5977951e-84f3-4f6b-b86f-44853cc1bc60 could not be found. Sep 23 04:47:38.164325 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:47:38.164325 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:47:38.164325 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:47:38.175311 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:38.175311 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:47:38.175311 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:47:38.175311 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:47:38.175311 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:47:38.175311 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5977951e-84f3-4f6b-b86f-44853cc1bc60 could not be found. Sep 23 04:47:38.175311 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:47:38.180183 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8fb67802-7bb7-4a38-9543-832bd9a039be tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:38.180183 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-8fb67802-7bb7-4a38-9543-832bd9a039be tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] [instance: f6413c5e-771f-45c5-94a8-b197becc0815] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:38.185585 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9a2c0ba1-5733-4f49-b68d-d0d3b5bcc52f tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Returning 404 to user: Instance 5977951e-84f3-4f6b-b86f-44853cc1bc60 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:47:38.185585 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9a2c0ba1-5733-4f49-b68d-d0d3b5bcc52f tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/5977951e-84f3-4f6b-b86f-44853cc1bc60" status: 404 len: 111 microversion: 2.1 time: 0.111984 Sep 23 04:47:38.186270 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1837/3718] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:38 2022] GET /compute/v2.1/servers/5977951e-84f3-4f6b-b86f-44853cc1bc60 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:47:38.189307 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8fb67802-7bb7-4a38-9543-832bd9a039be tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:38.193388 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-11b3008e-04b5-40b9-b1e8-bde5f1148da3 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:38.193612 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8fb67802-7bb7-4a38-9543-832bd9a039be tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:38.194259 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8fb67802-7bb7-4a38-9543-832bd9a039be tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:38.196642 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-11b3008e-04b5-40b9-b1e8-bde5f1148da3 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 27e4cd67-a4b3-440d-81dd-963f6372b385] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:38.197506 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8fb67802-7bb7-4a38-9543-832bd9a039be tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:38.198991 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8fb67802-7bb7-4a38-9543-832bd9a039be tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:38.203090 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8fb67802-7bb7-4a38-9543-832bd9a039be tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:38.210165 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-11b3008e-04b5-40b9-b1e8-bde5f1148da3 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:38.216615 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-11b3008e-04b5-40b9-b1e8-bde5f1148da3 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:38.218558 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-11b3008e-04b5-40b9-b1e8-bde5f1148da3 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:38.220556 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-11b3008e-04b5-40b9-b1e8-bde5f1148da3 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:38.221815 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-11b3008e-04b5-40b9-b1e8-bde5f1148da3 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:38.223867 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-11b3008e-04b5-40b9-b1e8-bde5f1148da3 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:38.259282 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-11b3008e-04b5-40b9-b1e8-bde5f1148da3 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] HTTP exception thrown: Instance 27e4cd67-a4b3-440d-81dd-963f6372b385 could not be found. Sep 23 04:47:38.262389 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-11b3008e-04b5-40b9-b1e8-bde5f1148da3 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Request method failure captured: Sep 23 04:47:38.262389 n-d-846463-3 devstack@n-api.service[122698]: request: DELETE /compute/v2.1/servers/27e4cd67-a4b3-440d-81dd-963f6372b385 HTTP/1.1 Sep 23 04:47:38.262389 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:47:38.262389 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:47:38.262389 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:47:38.262389 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:47:38.262389 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:47:38.262389 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:47:38.262389 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:47:38.262389 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:47:38.262389 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTlTlFK_k4e3BWkoqwVigfjvHO2lVSTsmHRT7EhNgH87mj-DVuWXCq-NRLrmXyv4E_e0wXdkZnDmOQ4aUkRrz7wPxuRsMdZHh23aH7xyd0PRdo29c8XIic0D4fdht4KBWWMxFeNNSWWMe-xxhvPgOUVxbcTbEXPF75Q0c4Y9h1Ew0hk Sep 23 04:47:38.262389 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:47:38.262389 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:47:38.262389 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:47:38.262389 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:47:38.262389 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:47:38.262389 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:47:38.262389 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: c23bd5a8b84942898a99930b2bc0ca12 Sep 23 04:47:38.262389 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ServersTestJSON-1923416422 Sep 23 04:47:38.262389 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:47:38.262389 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:47:38.262389 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c23bd5a8b84942898a99930b2bc0ca12", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c23bd5a8b84942898a99930b2bc0ca12"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c23bd5a8b84942898a99930b2bc0ca12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c23bd5a8b84942898a99930b2bc0ca12"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:47:38.262389 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ServersTestJSON-1923416422 Sep 23 04:47:38.262389 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: c23bd5a8b84942898a99930b2bc0ca12 Sep 23 04:47:38.262389 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ServersTestJSON-1923416422 Sep 23 04:47:38.262389 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ServersTestJSON-1923416422-project Sep 23 04:47:38.262389 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:47:38.262389 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:47:38.262389 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 252c87e244984f71ae0907ee769bec05 Sep 23 04:47:38.262389 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ServersTestJSON-1923416422-project Sep 23 04:47:38.262389 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:47:38.262389 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 27e4cd67-a4b3-440d-81dd-963f6372b385 could not be found. Sep 23 04:47:38.262389 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '27e4cd67-a4b3-440d-81dd-963f6372b385'} Sep 23 04:47:38.262389 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:47:38.262389 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:38.262389 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:47:38.262389 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:47:38.262389 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:47:38.262389 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:47:38.262389 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:47:38.262389 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:47:38.262389 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:47:38.262389 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:47:38.262389 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27e4cd67-a4b3-440d-81dd-963f6372b385 could not be found. Sep 23 04:47:38.262389 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:47:38.262389 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:47:38.262389 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:47:38.262389 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:38.262389 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:47:38.262389 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:47:38.262389 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:47:38.262389 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:47:38.262389 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:47:38.262389 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:47:38.262389 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 04:47:38.262389 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 04:47:38.262389 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 04:47:38.262389 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 04:47:38.262389 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:47:38.262389 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:47:38.262389 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:47:38.262389 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:47:38.262389 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27e4cd67-a4b3-440d-81dd-963f6372b385 could not be found. Sep 23 04:47:38.267548 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:47:38.267548 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:47:38.267548 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:47:38.267548 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:38.267548 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:47:38.267548 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:47:38.267548 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:47:38.267548 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:47:38.267548 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27e4cd67-a4b3-440d-81dd-963f6372b385 could not be found. Sep 23 04:47:38.267548 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:47:38.267548 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-11b3008e-04b5-40b9-b1e8-bde5f1148da3 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Returning 404 to user: Instance 27e4cd67-a4b3-440d-81dd-963f6372b385 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:47:38.269303 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-11b3008e-04b5-40b9-b1e8-bde5f1148da3 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "DELETE /compute/v2.1/servers/27e4cd67-a4b3-440d-81dd-963f6372b385" status: 404 len: 111 microversion: 2.1 time: 0.081733 Sep 23 04:47:38.270392 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1838/3719] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:47:38 2022] DELETE /compute/v2.1/servers/27e4cd67-a4b3-440d-81dd-963f6372b385 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:47:38.284338 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-866bca5f-9bc1-4645-a6fe-fa01f9868b4e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:38.285285 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-866bca5f-9bc1-4645-a6fe-fa01f9868b4e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 27e4cd67-a4b3-440d-81dd-963f6372b385] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:38.296496 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-866bca5f-9bc1-4645-a6fe-fa01f9868b4e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:38.297374 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-866bca5f-9bc1-4645-a6fe-fa01f9868b4e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:38.298307 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-866bca5f-9bc1-4645-a6fe-fa01f9868b4e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:38.299302 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-866bca5f-9bc1-4645-a6fe-fa01f9868b4e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:38.300475 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-866bca5f-9bc1-4645-a6fe-fa01f9868b4e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:38.301545 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-866bca5f-9bc1-4645-a6fe-fa01f9868b4e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:38.322381 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-866bca5f-9bc1-4645-a6fe-fa01f9868b4e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] HTTP exception thrown: Instance 27e4cd67-a4b3-440d-81dd-963f6372b385 could not be found. Sep 23 04:47:38.324919 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-866bca5f-9bc1-4645-a6fe-fa01f9868b4e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Request method failure captured: Sep 23 04:47:38.324919 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/27e4cd67-a4b3-440d-81dd-963f6372b385 HTTP/1.1 Sep 23 04:47:38.324919 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:47:38.324919 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:47:38.324919 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:47:38.324919 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:47:38.324919 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:47:38.324919 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:47:38.324919 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:47:38.324919 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:47:38.324919 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTlTlFK_k4e3BWkoqwVigfjvHO2lVSTsmHRT7EhNgH87mj-DVuWXCq-NRLrmXyv4E_e0wXdkZnDmOQ4aUkRrz7wPxuRsMdZHh23aH7xyd0PRdo29c8XIic0D4fdht4KBWWMxFeNNSWWMe-xxhvPgOUVxbcTbEXPF75Q0c4Y9h1Ew0hk Sep 23 04:47:38.324919 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:47:38.324919 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:47:38.324919 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:47:38.324919 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:47:38.324919 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:47:38.324919 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:47:38.324919 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: c23bd5a8b84942898a99930b2bc0ca12 Sep 23 04:47:38.324919 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ServersTestJSON-1923416422 Sep 23 04:47:38.324919 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:47:38.324919 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:47:38.324919 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c23bd5a8b84942898a99930b2bc0ca12", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c23bd5a8b84942898a99930b2bc0ca12"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c23bd5a8b84942898a99930b2bc0ca12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c23bd5a8b84942898a99930b2bc0ca12"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:47:38.324919 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ServersTestJSON-1923416422 Sep 23 04:47:38.324919 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: c23bd5a8b84942898a99930b2bc0ca12 Sep 23 04:47:38.324919 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ServersTestJSON-1923416422 Sep 23 04:47:38.324919 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ServersTestJSON-1923416422-project Sep 23 04:47:38.324919 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:47:38.324919 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:47:38.324919 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 252c87e244984f71ae0907ee769bec05 Sep 23 04:47:38.324919 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ServersTestJSON-1923416422-project Sep 23 04:47:38.324919 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:47:38.324919 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 27e4cd67-a4b3-440d-81dd-963f6372b385 could not be found. Sep 23 04:47:38.324919 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '27e4cd67-a4b3-440d-81dd-963f6372b385'} Sep 23 04:47:38.324919 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:47:38.324919 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:38.324919 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:47:38.324919 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:47:38.324919 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:47:38.324919 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:47:38.324919 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:47:38.324919 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:47:38.324919 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:47:38.324919 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:47:38.324919 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27e4cd67-a4b3-440d-81dd-963f6372b385 could not be found. Sep 23 04:47:38.324919 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:47:38.324919 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:47:38.324919 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:47:38.324919 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:38.324919 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:47:38.324919 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:47:38.324919 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:47:38.324919 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:47:38.324919 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:47:38.324919 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:47:38.324919 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:47:38.324919 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:47:38.324919 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:47:38.324919 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:47:38.324919 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:47:38.324919 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:47:38.324919 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27e4cd67-a4b3-440d-81dd-963f6372b385 could not be found. Sep 23 04:47:38.324919 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:47:38.324919 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:47:38.324919 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:47:38.331520 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:38.331520 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:47:38.331520 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:47:38.331520 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:47:38.331520 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:47:38.331520 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27e4cd67-a4b3-440d-81dd-963f6372b385 could not be found. Sep 23 04:47:38.331520 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:47:38.346268 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-866bca5f-9bc1-4645-a6fe-fa01f9868b4e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Returning 404 to user: Instance 27e4cd67-a4b3-440d-81dd-963f6372b385 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:47:38.349047 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-866bca5f-9bc1-4645-a6fe-fa01f9868b4e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/27e4cd67-a4b3-440d-81dd-963f6372b385" status: 404 len: 111 microversion: 2.1 time: 0.070597 Sep 23 04:47:38.351377 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1839/3720] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:38 2022] GET /compute/v2.1/servers/27e4cd67-a4b3-440d-81dd-963f6372b385 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:47:38.362575 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9bea4def-8148-44b1-add5-ecb196a4899e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:38.363534 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-9bea4def-8148-44b1-add5-ecb196a4899e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 2c316737-b84f-4b49-a5ab-cc0196b15760] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:38.377840 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9bea4def-8148-44b1-add5-ecb196a4899e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:38.378768 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9bea4def-8148-44b1-add5-ecb196a4899e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:38.379433 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9bea4def-8148-44b1-add5-ecb196a4899e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:38.380356 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9bea4def-8148-44b1-add5-ecb196a4899e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:38.381025 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9bea4def-8148-44b1-add5-ecb196a4899e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:38.381660 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9bea4def-8148-44b1-add5-ecb196a4899e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:38.401435 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-9bea4def-8148-44b1-add5-ecb196a4899e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] HTTP exception thrown: Instance 2c316737-b84f-4b49-a5ab-cc0196b15760 could not be found. Sep 23 04:47:38.403592 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9bea4def-8148-44b1-add5-ecb196a4899e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Request method failure captured: Sep 23 04:47:38.403592 n-d-846463-3 devstack@n-api.service[122698]: request: DELETE /compute/v2.1/servers/2c316737-b84f-4b49-a5ab-cc0196b15760 HTTP/1.1 Sep 23 04:47:38.403592 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:47:38.403592 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:47:38.403592 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:47:38.403592 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:47:38.403592 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:47:38.403592 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:47:38.403592 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:47:38.403592 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:47:38.403592 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTlTlFK_k4e3BWkoqwVigfjvHO2lVSTsmHRT7EhNgH87mj-DVuWXCq-NRLrmXyv4E_e0wXdkZnDmOQ4aUkRrz7wPxuRsMdZHh23aH7xyd0PRdo29c8XIic0D4fdht4KBWWMxFeNNSWWMe-xxhvPgOUVxbcTbEXPF75Q0c4Y9h1Ew0hk Sep 23 04:47:38.403592 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:47:38.403592 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:47:38.403592 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:47:38.403592 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:47:38.403592 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:47:38.403592 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:47:38.403592 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: c23bd5a8b84942898a99930b2bc0ca12 Sep 23 04:47:38.403592 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ServersTestJSON-1923416422 Sep 23 04:47:38.403592 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:47:38.403592 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:47:38.403592 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c23bd5a8b84942898a99930b2bc0ca12", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c23bd5a8b84942898a99930b2bc0ca12"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c23bd5a8b84942898a99930b2bc0ca12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c23bd5a8b84942898a99930b2bc0ca12"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:47:38.403592 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ServersTestJSON-1923416422 Sep 23 04:47:38.403592 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: c23bd5a8b84942898a99930b2bc0ca12 Sep 23 04:47:38.403592 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ServersTestJSON-1923416422 Sep 23 04:47:38.403592 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ServersTestJSON-1923416422-project Sep 23 04:47:38.403592 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:47:38.403592 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:47:38.403592 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 252c87e244984f71ae0907ee769bec05 Sep 23 04:47:38.403592 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ServersTestJSON-1923416422-project Sep 23 04:47:38.403592 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:47:38.403592 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 2c316737-b84f-4b49-a5ab-cc0196b15760 could not be found. Sep 23 04:47:38.403592 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '2c316737-b84f-4b49-a5ab-cc0196b15760'} Sep 23 04:47:38.403592 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:47:38.403592 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:38.403592 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:47:38.403592 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:47:38.403592 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:47:38.403592 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:47:38.403592 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:47:38.403592 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:47:38.403592 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:47:38.403592 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:47:38.403592 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c316737-b84f-4b49-a5ab-cc0196b15760 could not be found. Sep 23 04:47:38.403592 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:47:38.403592 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:47:38.403592 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:47:38.403592 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:38.403592 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:47:38.403592 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:47:38.403592 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:47:38.403592 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:47:38.403592 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:47:38.403592 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:47:38.403592 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 04:47:38.403592 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 04:47:38.403592 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 04:47:38.403592 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 04:47:38.403592 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:47:38.403592 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:47:38.403592 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:47:38.403592 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:47:38.403592 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c316737-b84f-4b49-a5ab-cc0196b15760 could not be found. Sep 23 04:47:38.409558 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:47:38.409558 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:47:38.409558 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:47:38.409558 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:38.409558 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:47:38.409558 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:47:38.409558 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:47:38.409558 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:47:38.409558 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c316737-b84f-4b49-a5ab-cc0196b15760 could not be found. Sep 23 04:47:38.409558 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:47:38.413330 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9bea4def-8148-44b1-add5-ecb196a4899e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Returning 404 to user: Instance 2c316737-b84f-4b49-a5ab-cc0196b15760 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:47:38.414486 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9bea4def-8148-44b1-add5-ecb196a4899e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "DELETE /compute/v2.1/servers/2c316737-b84f-4b49-a5ab-cc0196b15760" status: 404 len: 111 microversion: 2.1 time: 0.059512 Sep 23 04:47:38.416291 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1840/3721] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:47:38 2022] DELETE /compute/v2.1/servers/2c316737-b84f-4b49-a5ab-cc0196b15760 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:47:38.437834 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-04788b0d-d362-4087-b1e2-0af814834e9a tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:38.438737 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-04788b0d-d362-4087-b1e2-0af814834e9a tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 2c316737-b84f-4b49-a5ab-cc0196b15760] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:38.453979 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-04788b0d-d362-4087-b1e2-0af814834e9a tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:38.458091 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-04788b0d-d362-4087-b1e2-0af814834e9a tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:38.458552 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-04788b0d-d362-4087-b1e2-0af814834e9a tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:38.459358 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-04788b0d-d362-4087-b1e2-0af814834e9a tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:38.459824 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-04788b0d-d362-4087-b1e2-0af814834e9a tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:38.460250 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-04788b0d-d362-4087-b1e2-0af814834e9a tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:38.489243 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-04788b0d-d362-4087-b1e2-0af814834e9a tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] HTTP exception thrown: Instance 2c316737-b84f-4b49-a5ab-cc0196b15760 could not be found. Sep 23 04:47:38.490804 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-04788b0d-d362-4087-b1e2-0af814834e9a tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Request method failure captured: Sep 23 04:47:38.490804 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/2c316737-b84f-4b49-a5ab-cc0196b15760 HTTP/1.1 Sep 23 04:47:38.490804 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:47:38.490804 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:47:38.490804 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:47:38.490804 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:47:38.490804 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:47:38.490804 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:47:38.490804 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:47:38.490804 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:47:38.490804 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTlTlFK_k4e3BWkoqwVigfjvHO2lVSTsmHRT7EhNgH87mj-DVuWXCq-NRLrmXyv4E_e0wXdkZnDmOQ4aUkRrz7wPxuRsMdZHh23aH7xyd0PRdo29c8XIic0D4fdht4KBWWMxFeNNSWWMe-xxhvPgOUVxbcTbEXPF75Q0c4Y9h1Ew0hk Sep 23 04:47:38.490804 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:47:38.490804 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:47:38.490804 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:47:38.490804 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:47:38.490804 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:47:38.490804 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:47:38.490804 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: c23bd5a8b84942898a99930b2bc0ca12 Sep 23 04:47:38.490804 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ServersTestJSON-1923416422 Sep 23 04:47:38.490804 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:47:38.490804 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:47:38.490804 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c23bd5a8b84942898a99930b2bc0ca12", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c23bd5a8b84942898a99930b2bc0ca12"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c23bd5a8b84942898a99930b2bc0ca12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c23bd5a8b84942898a99930b2bc0ca12"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:47:38.490804 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ServersTestJSON-1923416422 Sep 23 04:47:38.490804 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: c23bd5a8b84942898a99930b2bc0ca12 Sep 23 04:47:38.490804 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ServersTestJSON-1923416422 Sep 23 04:47:38.490804 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ServersTestJSON-1923416422-project Sep 23 04:47:38.490804 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:47:38.490804 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:47:38.490804 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 252c87e244984f71ae0907ee769bec05 Sep 23 04:47:38.490804 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ServersTestJSON-1923416422-project Sep 23 04:47:38.490804 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:47:38.490804 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 2c316737-b84f-4b49-a5ab-cc0196b15760 could not be found. Sep 23 04:47:38.490804 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '2c316737-b84f-4b49-a5ab-cc0196b15760'} Sep 23 04:47:38.490804 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:47:38.490804 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:38.490804 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:47:38.490804 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:47:38.490804 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:47:38.490804 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:47:38.490804 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:47:38.490804 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:47:38.490804 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:47:38.490804 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:47:38.490804 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c316737-b84f-4b49-a5ab-cc0196b15760 could not be found. Sep 23 04:47:38.490804 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:47:38.490804 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:47:38.490804 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:47:38.490804 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:38.490804 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:47:38.490804 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:47:38.490804 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:47:38.490804 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:47:38.490804 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:47:38.490804 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:47:38.490804 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:47:38.490804 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:47:38.490804 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:47:38.490804 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:47:38.490804 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:47:38.490804 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:47:38.490804 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c316737-b84f-4b49-a5ab-cc0196b15760 could not be found. Sep 23 04:47:38.490804 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:47:38.490804 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:47:38.490804 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:47:38.496948 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:38.496948 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:47:38.496948 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:47:38.496948 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:47:38.496948 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:47:38.496948 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c316737-b84f-4b49-a5ab-cc0196b15760 could not be found. Sep 23 04:47:38.496948 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:47:38.496948 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-04788b0d-d362-4087-b1e2-0af814834e9a tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Returning 404 to user: Instance 2c316737-b84f-4b49-a5ab-cc0196b15760 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:47:38.498748 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-04788b0d-d362-4087-b1e2-0af814834e9a tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/2c316737-b84f-4b49-a5ab-cc0196b15760" status: 404 len: 111 microversion: 2.1 time: 0.071087 Sep 23 04:47:38.499902 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1841/3722] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:38 2022] GET /compute/v2.1/servers/2c316737-b84f-4b49-a5ab-cc0196b15760 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:47:38.513415 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e4d43719-aa66-4dae-9a6b-63acc843f792 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:38.514429 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e4d43719-aa66-4dae-9a6b-63acc843f792 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: f0374fc2-3c0f-48e1-b969-2933785fd47b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:38.524572 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e4d43719-aa66-4dae-9a6b-63acc843f792 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:38.529253 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e4d43719-aa66-4dae-9a6b-63acc843f792 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:38.529980 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e4d43719-aa66-4dae-9a6b-63acc843f792 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:38.530914 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e4d43719-aa66-4dae-9a6b-63acc843f792 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:38.531535 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e4d43719-aa66-4dae-9a6b-63acc843f792 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:38.533169 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e4d43719-aa66-4dae-9a6b-63acc843f792 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:38.809882 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-8fb67802-7bb7-4a38-9543-832bd9a039be tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a245dd82de1340f7a58873de1851c61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d02cb07a2a404c8d89aa13a950806d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:38.821701 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-8fb67802-7bb7-4a38-9543-832bd9a039be tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] 10.222.0.33 "GET /compute/v2.1/servers/f6413c5e-771f-45c5-94a8-b197becc0815" status: 200 len: 1528 microversion: 2.1 time: 0.659665 Sep 23 04:47:38.822443 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1882/3723] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:38 2022] GET /compute/v2.1/servers/f6413c5e-771f-45c5-94a8-b197becc0815 => generated 1528 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:38.831308 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7e11fea2-fef2-432b-8b96-2c0d3dff0ca2 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:38.834795 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-7e11fea2-fef2-432b-8b96-2c0d3dff0ca2 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 874db366-9e32-40a4-bddb-ec587a81b865] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:38.847329 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7e11fea2-fef2-432b-8b96-2c0d3dff0ca2 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:38.850529 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7e11fea2-fef2-432b-8b96-2c0d3dff0ca2 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:38.851165 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7e11fea2-fef2-432b-8b96-2c0d3dff0ca2 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:38.852122 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7e11fea2-fef2-432b-8b96-2c0d3dff0ca2 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:38.855203 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7e11fea2-fef2-432b-8b96-2c0d3dff0ca2 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:38.855806 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7e11fea2-fef2-432b-8b96-2c0d3dff0ca2 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:38.870718 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-7e11fea2-fef2-432b-8b96-2c0d3dff0ca2 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] HTTP exception thrown: Instance 874db366-9e32-40a4-bddb-ec587a81b865 could not be found. Sep 23 04:47:38.872592 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7e11fea2-fef2-432b-8b96-2c0d3dff0ca2 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Request method failure captured: Sep 23 04:47:38.872592 n-d-846463-3 devstack@n-api.service[122699]: request: DELETE /compute/v2.1/servers/874db366-9e32-40a4-bddb-ec587a81b865 HTTP/1.1 Sep 23 04:47:38.872592 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:47:38.872592 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:47:38.872592 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:47:38.872592 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:47:38.872592 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:47:38.872592 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:47:38.872592 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:47:38.872592 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:47:38.872592 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTlTlFK_k4e3BWkoqwVigfjvHO2lVSTsmHRT7EhNgH87mj-DVuWXCq-NRLrmXyv4E_e0wXdkZnDmOQ4aUkRrz7wPxuRsMdZHh23aH7xyd0PRdo29c8XIic0D4fdht4KBWWMxFeNNSWWMe-xxhvPgOUVxbcTbEXPF75Q0c4Y9h1Ew0hk Sep 23 04:47:38.872592 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:47:38.872592 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:47:38.872592 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:47:38.872592 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:47:38.872592 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:47:38.872592 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:47:38.872592 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: c23bd5a8b84942898a99930b2bc0ca12 Sep 23 04:47:38.872592 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ServersTestJSON-1923416422 Sep 23 04:47:38.872592 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:47:38.872592 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:47:38.872592 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c23bd5a8b84942898a99930b2bc0ca12", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c23bd5a8b84942898a99930b2bc0ca12"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c23bd5a8b84942898a99930b2bc0ca12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c23bd5a8b84942898a99930b2bc0ca12"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:47:38.872592 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ServersTestJSON-1923416422 Sep 23 04:47:38.872592 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: c23bd5a8b84942898a99930b2bc0ca12 Sep 23 04:47:38.872592 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ServersTestJSON-1923416422 Sep 23 04:47:38.872592 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ServersTestJSON-1923416422-project Sep 23 04:47:38.872592 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:47:38.872592 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:47:38.872592 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 252c87e244984f71ae0907ee769bec05 Sep 23 04:47:38.872592 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ServersTestJSON-1923416422-project Sep 23 04:47:38.872592 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:47:38.872592 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 874db366-9e32-40a4-bddb-ec587a81b865 could not be found. Sep 23 04:47:38.872592 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '874db366-9e32-40a4-bddb-ec587a81b865'} Sep 23 04:47:38.872592 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:47:38.872592 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:38.872592 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:47:38.872592 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:47:38.872592 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:47:38.872592 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:47:38.872592 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:47:38.872592 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:47:38.872592 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:47:38.872592 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:47:38.872592 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 874db366-9e32-40a4-bddb-ec587a81b865 could not be found. Sep 23 04:47:38.872592 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:47:38.872592 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:47:38.872592 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:47:38.872592 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:38.872592 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:47:38.872592 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:47:38.872592 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:47:38.872592 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:47:38.872592 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:47:38.872592 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:47:38.872592 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 04:47:38.872592 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 04:47:38.872592 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 04:47:38.872592 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 04:47:38.872592 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:47:38.872592 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:47:38.872592 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:47:38.872592 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:47:38.872592 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 874db366-9e32-40a4-bddb-ec587a81b865 could not be found. Sep 23 04:47:38.878017 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:47:38.878017 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:47:38.878017 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:47:38.878017 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:38.878017 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:47:38.878017 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:47:38.878017 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:47:38.878017 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:47:38.878017 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 874db366-9e32-40a4-bddb-ec587a81b865 could not be found. Sep 23 04:47:38.878017 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:47:38.878017 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7e11fea2-fef2-432b-8b96-2c0d3dff0ca2 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Returning 404 to user: Instance 874db366-9e32-40a4-bddb-ec587a81b865 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:47:38.879409 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-7e11fea2-fef2-432b-8b96-2c0d3dff0ca2 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "DELETE /compute/v2.1/servers/874db366-9e32-40a4-bddb-ec587a81b865" status: 404 len: 111 microversion: 2.1 time: 0.051616 Sep 23 04:47:38.882976 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1883/3724] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:47:38 2022] DELETE /compute/v2.1/servers/874db366-9e32-40a4-bddb-ec587a81b865 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:47:38.885186 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e4d43719-aa66-4dae-9a6b-63acc843f792 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c786bbedc21849ea92924139a44707b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcafb05f6f554e278cd552023947c6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:38.893994 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e4d43719-aa66-4dae-9a6b-63acc843f792 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/f0374fc2-3c0f-48e1-b969-2933785fd47b" status: 200 len: 1515 microversion: 2.1 time: 0.392751 Sep 23 04:47:38.895414 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-397a47f2-247d-4d15-88e6-7c63acc6c751 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:38.896158 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-397a47f2-247d-4d15-88e6-7c63acc6c751 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 874db366-9e32-40a4-bddb-ec587a81b865] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:38.898296 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1842/3725] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:38 2022] GET /compute/v2.1/servers/f0374fc2-3c0f-48e1-b969-2933785fd47b => generated 1515 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:38.903188 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-397a47f2-247d-4d15-88e6-7c63acc6c751 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:38.905233 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-397a47f2-247d-4d15-88e6-7c63acc6c751 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:38.905799 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-397a47f2-247d-4d15-88e6-7c63acc6c751 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:38.907360 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-397a47f2-247d-4d15-88e6-7c63acc6c751 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:38.907949 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-397a47f2-247d-4d15-88e6-7c63acc6c751 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:38.909732 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-397a47f2-247d-4d15-88e6-7c63acc6c751 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:38.955819 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-397a47f2-247d-4d15-88e6-7c63acc6c751 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] HTTP exception thrown: Instance 874db366-9e32-40a4-bddb-ec587a81b865 could not be found. Sep 23 04:47:38.957484 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-397a47f2-247d-4d15-88e6-7c63acc6c751 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Request method failure captured: Sep 23 04:47:38.957484 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/874db366-9e32-40a4-bddb-ec587a81b865 HTTP/1.1 Sep 23 04:47:38.957484 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:47:38.957484 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:47:38.957484 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:47:38.957484 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:47:38.957484 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:47:38.957484 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:47:38.957484 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:47:38.957484 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:47:38.957484 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTlTlFK_k4e3BWkoqwVigfjvHO2lVSTsmHRT7EhNgH87mj-DVuWXCq-NRLrmXyv4E_e0wXdkZnDmOQ4aUkRrz7wPxuRsMdZHh23aH7xyd0PRdo29c8XIic0D4fdht4KBWWMxFeNNSWWMe-xxhvPgOUVxbcTbEXPF75Q0c4Y9h1Ew0hk Sep 23 04:47:38.957484 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:47:38.957484 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:47:38.957484 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:47:38.957484 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:47:38.957484 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:47:38.957484 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:47:38.957484 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: c23bd5a8b84942898a99930b2bc0ca12 Sep 23 04:47:38.957484 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ServersTestJSON-1923416422 Sep 23 04:47:38.957484 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:47:38.957484 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:47:38.957484 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c23bd5a8b84942898a99930b2bc0ca12", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c23bd5a8b84942898a99930b2bc0ca12"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c23bd5a8b84942898a99930b2bc0ca12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c23bd5a8b84942898a99930b2bc0ca12"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:47:38.957484 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ServersTestJSON-1923416422 Sep 23 04:47:38.957484 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: c23bd5a8b84942898a99930b2bc0ca12 Sep 23 04:47:38.957484 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ServersTestJSON-1923416422 Sep 23 04:47:38.957484 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ServersTestJSON-1923416422-project Sep 23 04:47:38.957484 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:47:38.957484 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:47:38.957484 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 252c87e244984f71ae0907ee769bec05 Sep 23 04:47:38.957484 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ServersTestJSON-1923416422-project Sep 23 04:47:38.957484 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:47:38.957484 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 874db366-9e32-40a4-bddb-ec587a81b865 could not be found. Sep 23 04:47:38.957484 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '874db366-9e32-40a4-bddb-ec587a81b865'} Sep 23 04:47:38.957484 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:47:38.957484 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:38.957484 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:47:38.957484 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:47:38.957484 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:47:38.957484 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:47:38.957484 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:47:38.957484 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:47:38.957484 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:47:38.957484 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:47:38.957484 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 874db366-9e32-40a4-bddb-ec587a81b865 could not be found. Sep 23 04:47:38.957484 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:47:38.957484 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:47:38.957484 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:47:38.957484 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:38.957484 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:47:38.957484 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:47:38.957484 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:47:38.957484 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:47:38.957484 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:47:38.957484 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:47:38.957484 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:47:38.957484 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:47:38.957484 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:47:38.957484 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:47:38.957484 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:47:38.957484 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:47:38.957484 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 874db366-9e32-40a4-bddb-ec587a81b865 could not be found. Sep 23 04:47:38.957484 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:47:38.957484 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:47:38.957484 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:47:38.962946 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:38.962946 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:47:38.962946 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:47:38.962946 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:47:38.962946 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:47:38.962946 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 874db366-9e32-40a4-bddb-ec587a81b865 could not be found. Sep 23 04:47:38.962946 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:47:38.962946 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-397a47f2-247d-4d15-88e6-7c63acc6c751 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Returning 404 to user: Instance 874db366-9e32-40a4-bddb-ec587a81b865 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:47:38.964732 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-397a47f2-247d-4d15-88e6-7c63acc6c751 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/874db366-9e32-40a4-bddb-ec587a81b865" status: 404 len: 111 microversion: 2.1 time: 0.080628 Sep 23 04:47:38.965577 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1884/3726] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:38 2022] GET /compute/v2.1/servers/874db366-9e32-40a4-bddb-ec587a81b865 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:47:38.976552 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1982bc52-eee8-4b52-b9b4-3b178a821f34 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:38.978727 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-1982bc52-eee8-4b52-b9b4-3b178a821f34 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 2170ccef-31bf-4166-b5cb-e07cd521e20c] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:38.991146 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1982bc52-eee8-4b52-b9b4-3b178a821f34 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:38.993393 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1982bc52-eee8-4b52-b9b4-3b178a821f34 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:38.995840 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1982bc52-eee8-4b52-b9b4-3b178a821f34 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:38.996834 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1982bc52-eee8-4b52-b9b4-3b178a821f34 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:39.006725 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1982bc52-eee8-4b52-b9b4-3b178a821f34 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:39.007739 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1982bc52-eee8-4b52-b9b4-3b178a821f34 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:39.058820 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-1982bc52-eee8-4b52-b9b4-3b178a821f34 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] HTTP exception thrown: Instance 2170ccef-31bf-4166-b5cb-e07cd521e20c could not be found. Sep 23 04:47:39.067297 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1982bc52-eee8-4b52-b9b4-3b178a821f34 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Request method failure captured: Sep 23 04:47:39.067297 n-d-846463-3 devstack@n-api.service[122698]: request: DELETE /compute/v2.1/servers/2170ccef-31bf-4166-b5cb-e07cd521e20c HTTP/1.1 Sep 23 04:47:39.067297 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:47:39.067297 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:47:39.067297 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:47:39.067297 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:47:39.067297 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:47:39.067297 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:47:39.067297 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:47:39.067297 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:47:39.067297 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTlTlFK_k4e3BWkoqwVigfjvHO2lVSTsmHRT7EhNgH87mj-DVuWXCq-NRLrmXyv4E_e0wXdkZnDmOQ4aUkRrz7wPxuRsMdZHh23aH7xyd0PRdo29c8XIic0D4fdht4KBWWMxFeNNSWWMe-xxhvPgOUVxbcTbEXPF75Q0c4Y9h1Ew0hk Sep 23 04:47:39.067297 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:47:39.067297 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:47:39.067297 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:47:39.067297 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:47:39.067297 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:47:39.067297 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:47:39.067297 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: c23bd5a8b84942898a99930b2bc0ca12 Sep 23 04:47:39.067297 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ServersTestJSON-1923416422 Sep 23 04:47:39.067297 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:47:39.067297 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:47:39.067297 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c23bd5a8b84942898a99930b2bc0ca12", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c23bd5a8b84942898a99930b2bc0ca12"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c23bd5a8b84942898a99930b2bc0ca12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c23bd5a8b84942898a99930b2bc0ca12"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:47:39.067297 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ServersTestJSON-1923416422 Sep 23 04:47:39.067297 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: c23bd5a8b84942898a99930b2bc0ca12 Sep 23 04:47:39.067297 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ServersTestJSON-1923416422 Sep 23 04:47:39.067297 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ServersTestJSON-1923416422-project Sep 23 04:47:39.067297 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:47:39.067297 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:47:39.067297 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 252c87e244984f71ae0907ee769bec05 Sep 23 04:47:39.067297 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ServersTestJSON-1923416422-project Sep 23 04:47:39.067297 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:47:39.067297 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 2170ccef-31bf-4166-b5cb-e07cd521e20c could not be found. Sep 23 04:47:39.067297 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '2170ccef-31bf-4166-b5cb-e07cd521e20c'} Sep 23 04:47:39.067297 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:47:39.067297 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:39.067297 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:47:39.067297 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:47:39.067297 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:47:39.067297 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:47:39.067297 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:47:39.067297 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:47:39.067297 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:47:39.067297 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:47:39.067297 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2170ccef-31bf-4166-b5cb-e07cd521e20c could not be found. Sep 23 04:47:39.067297 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:47:39.067297 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:47:39.067297 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:47:39.067297 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:39.067297 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:47:39.067297 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:47:39.067297 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:47:39.067297 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:47:39.067297 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:47:39.067297 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:47:39.067297 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 04:47:39.067297 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 04:47:39.067297 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 04:47:39.067297 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 04:47:39.067297 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:47:39.067297 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:47:39.067297 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:47:39.067297 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:47:39.067297 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2170ccef-31bf-4166-b5cb-e07cd521e20c could not be found. Sep 23 04:47:39.082187 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:47:39.082187 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:47:39.082187 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:47:39.082187 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:39.082187 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:47:39.082187 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:47:39.082187 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:47:39.082187 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:47:39.082187 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2170ccef-31bf-4166-b5cb-e07cd521e20c could not be found. Sep 23 04:47:39.082187 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:47:39.082187 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1982bc52-eee8-4b52-b9b4-3b178a821f34 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Returning 404 to user: Instance 2170ccef-31bf-4166-b5cb-e07cd521e20c could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:47:39.082187 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-1982bc52-eee8-4b52-b9b4-3b178a821f34 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "DELETE /compute/v2.1/servers/2170ccef-31bf-4166-b5cb-e07cd521e20c" status: 404 len: 111 microversion: 2.1 time: 0.104686 Sep 23 04:47:39.087656 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1843/3727] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:47:38 2022] DELETE /compute/v2.1/servers/2170ccef-31bf-4166-b5cb-e07cd521e20c => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:47:39.087851 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-681af1d5-a521-4223-b1f2-b13e0485d4bd tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '.version_select at 0x7ff1ba9f63a0>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:39.105617 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b153c663-1dab-4ca5-8ca3-f45fc6cfbe3b tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:39.106699 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b153c663-1dab-4ca5-8ca3-f45fc6cfbe3b tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] [instance: 53c2eac1-c886-45f2-8b2c-77aa98ceaab5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:39.117656 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b153c663-1dab-4ca5-8ca3-f45fc6cfbe3b tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:39.118211 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b153c663-1dab-4ca5-8ca3-f45fc6cfbe3b tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:39.118644 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b153c663-1dab-4ca5-8ca3-f45fc6cfbe3b tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:39.125638 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b153c663-1dab-4ca5-8ca3-f45fc6cfbe3b tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:39.128074 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b153c663-1dab-4ca5-8ca3-f45fc6cfbe3b tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:39.128532 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b153c663-1dab-4ca5-8ca3-f45fc6cfbe3b tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:39.167088 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-681af1d5-a521-4223-b1f2-b13e0485d4bd tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "GET /compute/v2.1/images/ebfd24d2-4412-4ba6-8024-99147eab6142" status: 200 len: 1455 microversion: 2.1 time: 0.083109 Sep 23 04:47:39.167680 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1885/3728] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:47:39 2022] GET /compute/v2.1/images/ebfd24d2-4412-4ba6-8024-99147eab6142 => generated 1455 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:39.191764 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-de63cbfa-f55e-4db2-9a1e-53b2a1a59e91 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:39.192776 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-de63cbfa-f55e-4db2-9a1e-53b2a1a59e91 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 2170ccef-31bf-4166-b5cb-e07cd521e20c] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:39.218654 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-de63cbfa-f55e-4db2-9a1e-53b2a1a59e91 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:39.219255 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-de63cbfa-f55e-4db2-9a1e-53b2a1a59e91 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:39.219714 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-de63cbfa-f55e-4db2-9a1e-53b2a1a59e91 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:39.220472 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-de63cbfa-f55e-4db2-9a1e-53b2a1a59e91 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:39.220937 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-de63cbfa-f55e-4db2-9a1e-53b2a1a59e91 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:39.242642 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-de63cbfa-f55e-4db2-9a1e-53b2a1a59e91 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:39.359201 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-de63cbfa-f55e-4db2-9a1e-53b2a1a59e91 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] HTTP exception thrown: Instance 2170ccef-31bf-4166-b5cb-e07cd521e20c could not be found. Sep 23 04:47:39.374679 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-de63cbfa-f55e-4db2-9a1e-53b2a1a59e91 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Request method failure captured: Sep 23 04:47:39.374679 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/2170ccef-31bf-4166-b5cb-e07cd521e20c HTTP/1.1 Sep 23 04:47:39.374679 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:47:39.374679 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:47:39.374679 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:47:39.374679 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:47:39.374679 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:47:39.374679 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:47:39.374679 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:47:39.374679 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:47:39.374679 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTlTlFK_k4e3BWkoqwVigfjvHO2lVSTsmHRT7EhNgH87mj-DVuWXCq-NRLrmXyv4E_e0wXdkZnDmOQ4aUkRrz7wPxuRsMdZHh23aH7xyd0PRdo29c8XIic0D4fdht4KBWWMxFeNNSWWMe-xxhvPgOUVxbcTbEXPF75Q0c4Y9h1Ew0hk Sep 23 04:47:39.374679 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:47:39.374679 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:47:39.374679 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:47:39.374679 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:47:39.374679 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:47:39.374679 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:47:39.374679 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: c23bd5a8b84942898a99930b2bc0ca12 Sep 23 04:47:39.374679 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ServersTestJSON-1923416422 Sep 23 04:47:39.374679 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:47:39.374679 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:47:39.374679 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c23bd5a8b84942898a99930b2bc0ca12", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c23bd5a8b84942898a99930b2bc0ca12"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c23bd5a8b84942898a99930b2bc0ca12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c23bd5a8b84942898a99930b2bc0ca12"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:47:39.374679 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ServersTestJSON-1923416422 Sep 23 04:47:39.374679 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: c23bd5a8b84942898a99930b2bc0ca12 Sep 23 04:47:39.374679 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ServersTestJSON-1923416422 Sep 23 04:47:39.374679 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ServersTestJSON-1923416422-project Sep 23 04:47:39.374679 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:47:39.374679 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:47:39.374679 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 252c87e244984f71ae0907ee769bec05 Sep 23 04:47:39.374679 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ServersTestJSON-1923416422-project Sep 23 04:47:39.374679 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:47:39.374679 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 2170ccef-31bf-4166-b5cb-e07cd521e20c could not be found. Sep 23 04:47:39.374679 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '2170ccef-31bf-4166-b5cb-e07cd521e20c'} Sep 23 04:47:39.374679 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:47:39.374679 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:39.374679 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:47:39.374679 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:47:39.374679 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:47:39.374679 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:47:39.374679 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:47:39.374679 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:47:39.374679 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:47:39.374679 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:47:39.374679 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2170ccef-31bf-4166-b5cb-e07cd521e20c could not be found. Sep 23 04:47:39.374679 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:47:39.374679 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:47:39.374679 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:47:39.374679 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:39.374679 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:47:39.374679 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:47:39.374679 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:47:39.374679 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:47:39.374679 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:47:39.374679 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:47:39.374679 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:47:39.374679 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:47:39.374679 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:47:39.374679 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:47:39.374679 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:47:39.374679 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:47:39.374679 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2170ccef-31bf-4166-b5cb-e07cd521e20c could not be found. Sep 23 04:47:39.374679 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:47:39.374679 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:47:39.374679 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:47:39.391116 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:39.391116 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:47:39.391116 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:47:39.391116 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:47:39.391116 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:47:39.391116 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2170ccef-31bf-4166-b5cb-e07cd521e20c could not be found. Sep 23 04:47:39.391116 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:47:39.391116 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-de63cbfa-f55e-4db2-9a1e-53b2a1a59e91 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Returning 404 to user: Instance 2170ccef-31bf-4166-b5cb-e07cd521e20c could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:47:39.391116 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-de63cbfa-f55e-4db2-9a1e-53b2a1a59e91 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/2170ccef-31bf-4166-b5cb-e07cd521e20c" status: 404 len: 111 microversion: 2.1 time: 0.212345 Sep 23 04:47:39.391116 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1886/3729] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:39 2022] GET /compute/v2.1/servers/2170ccef-31bf-4166-b5cb-e07cd521e20c => generated 111 bytes in 213 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:47:39.404190 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5b0908ef-d288-49a1-a760-eb081d225b85 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:39.405132 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-5b0908ef-d288-49a1-a760-eb081d225b85 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 4c9542e4-b84e-4f7b-b29d-6574d486100f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:39.411932 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-5b0908ef-d288-49a1-a760-eb081d225b85 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] HTTP exception thrown: Instance 4c9542e4-b84e-4f7b-b29d-6574d486100f could not be found. Sep 23 04:47:39.413710 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5b0908ef-d288-49a1-a760-eb081d225b85 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Request method failure captured: Sep 23 04:47:39.413710 n-d-846463-3 devstack@n-api.service[122699]: request: DELETE /compute/v2.1/servers/4c9542e4-b84e-4f7b-b29d-6574d486100f HTTP/1.1 Sep 23 04:47:39.413710 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:47:39.413710 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:47:39.413710 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:47:39.413710 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:47:39.413710 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:47:39.413710 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:47:39.413710 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:47:39.413710 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:47:39.413710 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTlTlFK_k4e3BWkoqwVigfjvHO2lVSTsmHRT7EhNgH87mj-DVuWXCq-NRLrmXyv4E_e0wXdkZnDmOQ4aUkRrz7wPxuRsMdZHh23aH7xyd0PRdo29c8XIic0D4fdht4KBWWMxFeNNSWWMe-xxhvPgOUVxbcTbEXPF75Q0c4Y9h1Ew0hk Sep 23 04:47:39.413710 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:47:39.413710 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:47:39.413710 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:47:39.413710 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:47:39.413710 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:47:39.413710 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:47:39.413710 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: c23bd5a8b84942898a99930b2bc0ca12 Sep 23 04:47:39.413710 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ServersTestJSON-1923416422 Sep 23 04:47:39.413710 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:47:39.413710 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:47:39.413710 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c23bd5a8b84942898a99930b2bc0ca12", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c23bd5a8b84942898a99930b2bc0ca12"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c23bd5a8b84942898a99930b2bc0ca12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c23bd5a8b84942898a99930b2bc0ca12"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:47:39.413710 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ServersTestJSON-1923416422 Sep 23 04:47:39.413710 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: c23bd5a8b84942898a99930b2bc0ca12 Sep 23 04:47:39.413710 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ServersTestJSON-1923416422 Sep 23 04:47:39.413710 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ServersTestJSON-1923416422-project Sep 23 04:47:39.413710 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:47:39.413710 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:47:39.413710 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 252c87e244984f71ae0907ee769bec05 Sep 23 04:47:39.413710 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ServersTestJSON-1923416422-project Sep 23 04:47:39.413710 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:47:39.413710 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 4c9542e4-b84e-4f7b-b29d-6574d486100f could not be found. Sep 23 04:47:39.413710 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '4c9542e4-b84e-4f7b-b29d-6574d486100f'} Sep 23 04:47:39.413710 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:47:39.413710 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:39.413710 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:47:39.413710 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:47:39.413710 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:47:39.413710 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:47:39.413710 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 23 04:47:39.413710 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 23 04:47:39.413710 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c9542e4-b84e-4f7b-b29d-6574d486100f could not be found. Sep 23 04:47:39.413710 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:47:39.413710 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:47:39.413710 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:47:39.413710 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:39.413710 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:47:39.413710 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:47:39.413710 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:47:39.413710 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:47:39.413710 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:47:39.413710 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:47:39.413710 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 04:47:39.413710 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 04:47:39.413710 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 04:47:39.413710 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 04:47:39.413710 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:47:39.413710 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:47:39.413710 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:47:39.413710 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:47:39.413710 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c9542e4-b84e-4f7b-b29d-6574d486100f could not be found. Sep 23 04:47:39.413710 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:47:39.413710 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:47:39.413710 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:47:39.418887 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:39.418887 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:47:39.418887 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:47:39.418887 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:47:39.418887 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:47:39.418887 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c9542e4-b84e-4f7b-b29d-6574d486100f could not be found. Sep 23 04:47:39.418887 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:47:39.423967 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5b0908ef-d288-49a1-a760-eb081d225b85 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Returning 404 to user: Instance 4c9542e4-b84e-4f7b-b29d-6574d486100f could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:47:39.425071 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5b0908ef-d288-49a1-a760-eb081d225b85 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4c9542e4-b84e-4f7b-b29d-6574d486100f" status: 404 len: 111 microversion: 2.1 time: 0.036449 Sep 23 04:47:39.425981 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1887/3730] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:47:39 2022] DELETE /compute/v2.1/servers/4c9542e4-b84e-4f7b-b29d-6574d486100f => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:47:39.435722 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-961a728b-5e59-49c0-a90f-2aeca07c330a tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:39.435722 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-961a728b-5e59-49c0-a90f-2aeca07c330a tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 4c9542e4-b84e-4f7b-b29d-6574d486100f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:39.444065 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-961a728b-5e59-49c0-a90f-2aeca07c330a tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] HTTP exception thrown: Instance 4c9542e4-b84e-4f7b-b29d-6574d486100f could not be found. Sep 23 04:47:39.446101 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-961a728b-5e59-49c0-a90f-2aeca07c330a tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Request method failure captured: Sep 23 04:47:39.446101 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/4c9542e4-b84e-4f7b-b29d-6574d486100f HTTP/1.1 Sep 23 04:47:39.446101 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:47:39.446101 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:47:39.446101 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:47:39.446101 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:47:39.446101 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:47:39.446101 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:47:39.446101 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:47:39.446101 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:47:39.446101 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTlTlFK_k4e3BWkoqwVigfjvHO2lVSTsmHRT7EhNgH87mj-DVuWXCq-NRLrmXyv4E_e0wXdkZnDmOQ4aUkRrz7wPxuRsMdZHh23aH7xyd0PRdo29c8XIic0D4fdht4KBWWMxFeNNSWWMe-xxhvPgOUVxbcTbEXPF75Q0c4Y9h1Ew0hk Sep 23 04:47:39.446101 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:47:39.446101 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:47:39.446101 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:47:39.446101 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:47:39.446101 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:47:39.446101 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:47:39.446101 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: c23bd5a8b84942898a99930b2bc0ca12 Sep 23 04:47:39.446101 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ServersTestJSON-1923416422 Sep 23 04:47:39.446101 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:47:39.446101 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:47:39.446101 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c23bd5a8b84942898a99930b2bc0ca12", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c23bd5a8b84942898a99930b2bc0ca12"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c23bd5a8b84942898a99930b2bc0ca12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c23bd5a8b84942898a99930b2bc0ca12"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:47:39.446101 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ServersTestJSON-1923416422 Sep 23 04:47:39.446101 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: c23bd5a8b84942898a99930b2bc0ca12 Sep 23 04:47:39.446101 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ServersTestJSON-1923416422 Sep 23 04:47:39.446101 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ServersTestJSON-1923416422-project Sep 23 04:47:39.446101 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:47:39.446101 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:47:39.446101 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 252c87e244984f71ae0907ee769bec05 Sep 23 04:47:39.446101 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ServersTestJSON-1923416422-project Sep 23 04:47:39.446101 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:47:39.446101 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 4c9542e4-b84e-4f7b-b29d-6574d486100f could not be found. Sep 23 04:47:39.446101 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '4c9542e4-b84e-4f7b-b29d-6574d486100f'} Sep 23 04:47:39.446101 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:47:39.446101 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:39.446101 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:47:39.446101 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:47:39.446101 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:47:39.446101 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:47:39.446101 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 23 04:47:39.446101 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 23 04:47:39.446101 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c9542e4-b84e-4f7b-b29d-6574d486100f could not be found. Sep 23 04:47:39.446101 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:47:39.446101 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:47:39.446101 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:47:39.446101 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:39.446101 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:47:39.446101 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:47:39.446101 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:47:39.446101 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:47:39.446101 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:47:39.446101 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:47:39.446101 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:47:39.446101 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:47:39.446101 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:47:39.446101 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:47:39.446101 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:47:39.446101 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:47:39.446101 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c9542e4-b84e-4f7b-b29d-6574d486100f could not be found. Sep 23 04:47:39.446101 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:47:39.446101 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:47:39.446101 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:47:39.446101 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:39.446101 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:47:39.452497 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:47:39.452497 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:47:39.452497 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:47:39.452497 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c9542e4-b84e-4f7b-b29d-6574d486100f could not be found. Sep 23 04:47:39.452497 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:47:39.459818 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-961a728b-5e59-49c0-a90f-2aeca07c330a tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Returning 404 to user: Instance 4c9542e4-b84e-4f7b-b29d-6574d486100f could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:47:39.459818 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-961a728b-5e59-49c0-a90f-2aeca07c330a tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/4c9542e4-b84e-4f7b-b29d-6574d486100f" status: 404 len: 111 microversion: 2.1 time: 0.025966 Sep 23 04:47:39.459818 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1888/3731] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:39 2022] GET /compute/v2.1/servers/4c9542e4-b84e-4f7b-b29d-6574d486100f => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:47:39.469086 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e0372a2a-590b-44a7-b164-533926e79ea6 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:39.473771 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e0372a2a-590b-44a7-b164-533926e79ea6 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 5051152b-180a-4ed9-85fb-074836ae447c] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:39.484295 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e0372a2a-590b-44a7-b164-533926e79ea6 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:39.485571 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e0372a2a-590b-44a7-b164-533926e79ea6 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:39.486414 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e0372a2a-590b-44a7-b164-533926e79ea6 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:39.487426 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e0372a2a-590b-44a7-b164-533926e79ea6 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:39.488124 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e0372a2a-590b-44a7-b164-533926e79ea6 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:39.488807 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e0372a2a-590b-44a7-b164-533926e79ea6 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:39.545992 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e0372a2a-590b-44a7-b164-533926e79ea6 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 5051152b-180a-4ed9-85fb-074836ae447c] Going to try to terminate instance {{(pid=122699) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:47:39.695137 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b153c663-1dab-4ca5-8ca3-f45fc6cfbe3b tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11980041918484990dac709544d0b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c43f2b70bc74a48b62fb4115337f073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:39.703730 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b153c663-1dab-4ca5-8ca3-f45fc6cfbe3b tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/servers/53c2eac1-c886-45f2-8b2c-77aa98ceaab5" status: 200 len: 1504 microversion: 2.1 time: 0.614036 Sep 23 04:47:39.715494 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1844/3732] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:39 2022] GET /compute/v2.1/servers/53c2eac1-c886-45f2-8b2c-77aa98ceaab5 => generated 1504 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:39.729944 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-f0ad51be-0d17-4591-a799-8c1226459117 req-ef09c497-1ca6-4738-85ba-648558dcb074 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6413c5e-771f-45c5-94a8-b197becc0815", "name": "network-vif-deleted", "tag": "050c3a35-71cb-4639-af15-aff3db06b6cf"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:47:39.742328 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-f0ad51be-0d17-4591-a799-8c1226459117 req-ef09c497-1ca6-4738-85ba-648558dcb074 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:39.743009 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-f0ad51be-0d17-4591-a799-8c1226459117 req-ef09c497-1ca6-4738-85ba-648558dcb074 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:39.744352 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-f0ad51be-0d17-4591-a799-8c1226459117 req-ef09c497-1ca6-4738-85ba-648558dcb074 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:39.775546 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-f0ad51be-0d17-4591-a799-8c1226459117 req-ef09c497-1ca6-4738-85ba-648558dcb074 service nova] Creating event network-vif-deleted:050c3a35-71cb-4639-af15-aff3db06b6cf for instance f6413c5e-771f-45c5-94a8-b197becc0815 on n-h2-846463-3 Sep 23 04:47:39.781274 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-f0ad51be-0d17-4591-a799-8c1226459117 req-ef09c497-1ca6-4738-85ba-648558dcb074 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064206 Sep 23 04:47:39.782236 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1845/3733] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:47:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:47:39.845382 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f33e3f48-ea1f-48e1-ae7e-27fe3ba23401 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:39.846045 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f33e3f48-ea1f-48e1-ae7e-27fe3ba23401 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] [instance: f6413c5e-771f-45c5-94a8-b197becc0815] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:39.853336 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f33e3f48-ea1f-48e1-ae7e-27fe3ba23401 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:39.854996 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f33e3f48-ea1f-48e1-ae7e-27fe3ba23401 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:39.855684 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f33e3f48-ea1f-48e1-ae7e-27fe3ba23401 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:39.856874 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f33e3f48-ea1f-48e1-ae7e-27fe3ba23401 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:39.857596 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f33e3f48-ea1f-48e1-ae7e-27fe3ba23401 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:39.858412 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f33e3f48-ea1f-48e1-ae7e-27fe3ba23401 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:40.014311 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e0372a2a-590b-44a7-b164-533926e79ea6 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "DELETE /compute/v2.1/servers/5051152b-180a-4ed9-85fb-074836ae447c" status: 204 len: 0 microversion: 2.1 time: 0.548550 Sep 23 04:47:40.018611 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1889/3734] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:47:39 2022] DELETE /compute/v2.1/servers/5051152b-180a-4ed9-85fb-074836ae447c => generated 0 bytes in 558 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:47:40.028488 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ca68b5b9-9766-4ffe-9ce5-0ebe2b97cb4b tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:40.029326 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ca68b5b9-9766-4ffe-9ce5-0ebe2b97cb4b tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 5051152b-180a-4ed9-85fb-074836ae447c] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:40.040319 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f33e3f48-ea1f-48e1-ae7e-27fe3ba23401 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a245dd82de1340f7a58873de1851c61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d02cb07a2a404c8d89aa13a950806d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:40.046816 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ca68b5b9-9766-4ffe-9ce5-0ebe2b97cb4b tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:40.052112 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ca68b5b9-9766-4ffe-9ce5-0ebe2b97cb4b tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:40.052401 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f33e3f48-ea1f-48e1-ae7e-27fe3ba23401 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] 10.222.0.33 "GET /compute/v2.1/servers/f6413c5e-771f-45c5-94a8-b197becc0815" status: 200 len: 1486 microversion: 2.1 time: 0.208856 Sep 23 04:47:40.052965 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ca68b5b9-9766-4ffe-9ce5-0ebe2b97cb4b tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:40.053909 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ca68b5b9-9766-4ffe-9ce5-0ebe2b97cb4b tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:40.054601 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ca68b5b9-9766-4ffe-9ce5-0ebe2b97cb4b tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:40.054763 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1846/3735] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:39 2022] GET /compute/v2.1/servers/f6413c5e-771f-45c5-94a8-b197becc0815 => generated 1486 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:47:40.055468 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ca68b5b9-9766-4ffe-9ce5-0ebe2b97cb4b tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:40.198059 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-80af0ce1-2a05-4188-9d93-f9dda0bafa6e tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '.version_select at 0x7ff1ba800160>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:40.276203 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ca68b5b9-9766-4ffe-9ce5-0ebe2b97cb4b tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:40.287107 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ca68b5b9-9766-4ffe-9ce5-0ebe2b97cb4b tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/5051152b-180a-4ed9-85fb-074836ae447c" status: 200 len: 1479 microversion: 2.1 time: 0.264096 Sep 23 04:47:40.288287 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1890/3736] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:40 2022] GET /compute/v2.1/servers/5051152b-180a-4ed9-85fb-074836ae447c => generated 1479 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:40.292969 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-2e737555-fcb0-4cdb-b6ea-f396d74aff35 req-a5766ab1-4354-47ec-b6f0-ef55d8952337 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6413c5e-771f-45c5-94a8-b197becc0815", "name": "network-vif-unplugged", "status": "completed", "tag": "050c3a35-71cb-4639-af15-aff3db06b6cf"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:47:40.305045 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-2e737555-fcb0-4cdb-b6ea-f396d74aff35 req-a5766ab1-4354-47ec-b6f0-ef55d8952337 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:40.306505 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-2e737555-fcb0-4cdb-b6ea-f396d74aff35 req-a5766ab1-4354-47ec-b6f0-ef55d8952337 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:40.308703 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-2e737555-fcb0-4cdb-b6ea-f396d74aff35 req-a5766ab1-4354-47ec-b6f0-ef55d8952337 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:40.327517 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-80af0ce1-2a05-4188-9d93-f9dda0bafa6e tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "GET /compute/v2.1/images/ebfd24d2-4412-4ba6-8024-99147eab6142" status: 200 len: 1455 microversion: 2.1 time: 0.147473 Sep 23 04:47:40.328934 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1847/3737] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:47:40 2022] GET /compute/v2.1/images/ebfd24d2-4412-4ba6-8024-99147eab6142 => generated 1455 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:47:40.331077 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-2e737555-fcb0-4cdb-b6ea-f396d74aff35 req-a5766ab1-4354-47ec-b6f0-ef55d8952337 service nova] Creating event network-vif-unplugged:050c3a35-71cb-4639-af15-aff3db06b6cf for instance f6413c5e-771f-45c5-94a8-b197becc0815 on n-h2-846463-3 Sep 23 04:47:40.339451 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-2e737555-fcb0-4cdb-b6ea-f396d74aff35 req-a5766ab1-4354-47ec-b6f0-ef55d8952337 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049747 Sep 23 04:47:40.340459 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1891/3738] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:47:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:47:40.732110 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6ffa6754-1630-4289-be2e-dbe27290b45e tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:40.732649 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-6ffa6754-1630-4289-be2e-dbe27290b45e tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] [instance: 53c2eac1-c886-45f2-8b2c-77aa98ceaab5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:40.738992 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6ffa6754-1630-4289-be2e-dbe27290b45e tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:40.739487 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6ffa6754-1630-4289-be2e-dbe27290b45e tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:40.739942 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6ffa6754-1630-4289-be2e-dbe27290b45e tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:40.740667 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6ffa6754-1630-4289-be2e-dbe27290b45e tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:40.741176 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6ffa6754-1630-4289-be2e-dbe27290b45e tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:40.741563 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6ffa6754-1630-4289-be2e-dbe27290b45e tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:41.085422 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9b29193f-ed4d-416f-8324-ca398c996582 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:41.086878 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-9b29193f-ed4d-416f-8324-ca398c996582 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] [instance: f6413c5e-771f-45c5-94a8-b197becc0815] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:41.106456 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9b29193f-ed4d-416f-8324-ca398c996582 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:41.106456 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9b29193f-ed4d-416f-8324-ca398c996582 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:41.106456 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9b29193f-ed4d-416f-8324-ca398c996582 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:41.106456 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9b29193f-ed4d-416f-8324-ca398c996582 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:41.106456 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9b29193f-ed4d-416f-8324-ca398c996582 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:41.106456 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9b29193f-ed4d-416f-8324-ca398c996582 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:41.194195 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9b29193f-ed4d-416f-8324-ca398c996582 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:41.195236 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9b29193f-ed4d-416f-8324-ca398c996582 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:41.195928 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9b29193f-ed4d-416f-8324-ca398c996582 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:41.196630 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-9b29193f-ed4d-416f-8324-ca398c996582 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lazy-loading 'fault' on Instance uuid f6413c5e-771f-45c5-94a8-b197becc0815 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:47:41.297647 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-9b29193f-ed4d-416f-8324-ca398c996582 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a245dd82de1340f7a58873de1851c61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d02cb07a2a404c8d89aa13a950806d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:41.314521 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-9b29193f-ed4d-416f-8324-ca398c996582 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] 10.222.0.33 "GET /compute/v2.1/servers/f6413c5e-771f-45c5-94a8-b197becc0815" status: 200 len: 1315 microversion: 2.1 time: 0.235632 Sep 23 04:47:41.598459 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1892/3739] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:41 2022] GET /compute/v2.1/servers/f6413c5e-771f-45c5-94a8-b197becc0815 => generated 1315 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:41.598459 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-51ac418c-7e81-478c-a892-7f16ac350d2e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:41.598459 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-51ac418c-7e81-478c-a892-7f16ac350d2e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 5051152b-180a-4ed9-85fb-074836ae447c] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:41.598459 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-51ac418c-7e81-478c-a892-7f16ac350d2e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:41.598459 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-51ac418c-7e81-478c-a892-7f16ac350d2e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:41.598459 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-51ac418c-7e81-478c-a892-7f16ac350d2e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:41.598459 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-51ac418c-7e81-478c-a892-7f16ac350d2e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:41.598459 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-51ac418c-7e81-478c-a892-7f16ac350d2e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:41.598459 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-51ac418c-7e81-478c-a892-7f16ac350d2e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:41.599861 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6ffa6754-1630-4289-be2e-dbe27290b45e tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11980041918484990dac709544d0b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c43f2b70bc74a48b62fb4115337f073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:41.599861 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-6ffa6754-1630-4289-be2e-dbe27290b45e tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/servers/53c2eac1-c886-45f2-8b2c-77aa98ceaab5" status: 200 len: 1504 microversion: 2.1 time: 0.727321 Sep 23 04:47:41.599861 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1848/3740] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:40 2022] GET /compute/v2.1/servers/53c2eac1-c886-45f2-8b2c-77aa98ceaab5 => generated 1504 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:41.599861 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c3454681-287d-4bac-b15c-1e4a1bfdcdcd tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '.version_select at 0x7ff1ba8000d0>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:41.599861 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c3454681-287d-4bac-b15c-1e4a1bfdcdcd tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "GET /compute/v2.1/images/ebfd24d2-4412-4ba6-8024-99147eab6142" status: 200 len: 1455 microversion: 2.1 time: 0.053118 Sep 23 04:47:41.599861 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1849/3741] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:47:41 2022] GET /compute/v2.1/images/ebfd24d2-4412-4ba6-8024-99147eab6142 => generated 1455 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:41.600707 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-51ac418c-7e81-478c-a892-7f16ac350d2e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:41.600707 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-51ac418c-7e81-478c-a892-7f16ac350d2e tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/5051152b-180a-4ed9-85fb-074836ae447c" status: 200 len: 1479 microversion: 2.1 time: 0.213578 Sep 23 04:47:41.600707 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1893/3742] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:41 2022] GET /compute/v2.1/servers/5051152b-180a-4ed9-85fb-074836ae447c => generated 1479 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:42.357740 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e970ee66-c691-4f40-8576-665af98793a5 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:42.358593 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e970ee66-c691-4f40-8576-665af98793a5 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] [instance: f6413c5e-771f-45c5-94a8-b197becc0815] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:42.368935 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e970ee66-c691-4f40-8576-665af98793a5 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:42.369494 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e970ee66-c691-4f40-8576-665af98793a5 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:42.369965 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e970ee66-c691-4f40-8576-665af98793a5 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:42.370686 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e970ee66-c691-4f40-8576-665af98793a5 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:42.371947 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e970ee66-c691-4f40-8576-665af98793a5 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:42.372389 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e970ee66-c691-4f40-8576-665af98793a5 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:42.389799 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-cdf25a50-b42e-4cfd-a4d2-3fef957e8faa tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Action: 'create', calling method: .version_select at 0x7ff1ba9810d0>, body: {"keypair": {"name": "tempest-keypair-1757192797", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGPRE5UjcZhzD6NfR3bYHM8lewbuDd+sXZWXc2Z1NxTYleNxsfmCimff1bmqDNiP9V2oeDMc8KnTua3dX3SxrTMbfpkJbZSp148QQ5ep2Ei8YGXtaQ83LnppCXfzwtK2+w=="}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:47:42.439248 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-cdf25a50-b42e-4cfd-a4d2-3fef957e8faa tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Getting quotas for project dcafb05f6f554e278cd552023947c6ac. Resources: {'key_pairs'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:47:42.446346 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-cdf25a50-b42e-4cfd-a4d2-3fef957e8faa tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Getting quotas for user c786bbedc21849ea92924139a44707b7 and project dcafb05f6f554e278cd552023947c6ac. Resources: {'key_pairs'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:47:42.466533 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e970ee66-c691-4f40-8576-665af98793a5 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:42.467411 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e970ee66-c691-4f40-8576-665af98793a5 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:42.468095 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e970ee66-c691-4f40-8576-665af98793a5 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:42.469000 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-e970ee66-c691-4f40-8576-665af98793a5 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lazy-loading 'fault' on Instance uuid f6413c5e-771f-45c5-94a8-b197becc0815 {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:47:42.581394 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-cdf25a50-b42e-4cfd-a4d2-3fef957e8faa tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.198979 Sep 23 04:47:42.582555 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1894/3743] 10.222.0.33 () {60 vars in 1159 bytes} [Fri Sep 23 04:47:42 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:47:42.602979 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-33a6140d-1886-45b5-b1f9-f8949b0d0dc7 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:42.604995 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-33a6140d-1886-45b5-b1f9-f8949b0d0dc7 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] [instance: 53c2eac1-c886-45f2-8b2c-77aa98ceaab5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:42.624901 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-33a6140d-1886-45b5-b1f9-f8949b0d0dc7 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:42.626575 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-33a6140d-1886-45b5-b1f9-f8949b0d0dc7 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:42.628581 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-33a6140d-1886-45b5-b1f9-f8949b0d0dc7 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:42.630646 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-33a6140d-1886-45b5-b1f9-f8949b0d0dc7 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:42.632492 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-33a6140d-1886-45b5-b1f9-f8949b0d0dc7 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:42.635277 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-33a6140d-1886-45b5-b1f9-f8949b0d0dc7 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:42.933443 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e970ee66-c691-4f40-8576-665af98793a5 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a245dd82de1340f7a58873de1851c61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d02cb07a2a404c8d89aa13a950806d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:42.941134 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=100 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:47:42.962318 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e970ee66-c691-4f40-8576-665af98793a5 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] 10.222.0.33 "GET /compute/v2.1/servers/f6413c5e-771f-45c5-94a8-b197becc0815" status: 200 len: 1315 microversion: 2.1 time: 0.595020 Sep 23 04:47:42.962318 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1850/3744] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:42 2022] GET /compute/v2.1/servers/f6413c5e-771f-45c5-94a8-b197becc0815 => generated 1315 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:42.968329 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d7e791c1-9c8e-4873-bae2-6e1a087cc4d5 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '.version_select at 0x7ff1ba8005e0>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:43.027517 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d7e791c1-9c8e-4873-bae2-6e1a087cc4d5 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "GET /compute/v2.1/images/ebfd24d2-4412-4ba6-8024-99147eab6142" status: 200 len: 1455 microversion: 2.1 time: 0.062904 Sep 23 04:47:43.033027 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1851/3745] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:47:42 2022] GET /compute/v2.1/images/ebfd24d2-4412-4ba6-8024-99147eab6142 => generated 1455 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:43.046077 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e4eb3970-9a7a-4548-98af-3fcacc17da38 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:43.046709 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e4eb3970-9a7a-4548-98af-3fcacc17da38 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 5051152b-180a-4ed9-85fb-074836ae447c] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:43.053313 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-33a6140d-1886-45b5-b1f9-f8949b0d0dc7 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11980041918484990dac709544d0b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c43f2b70bc74a48b62fb4115337f073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:43.056495 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e4eb3970-9a7a-4548-98af-3fcacc17da38 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:43.059175 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e4eb3970-9a7a-4548-98af-3fcacc17da38 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:43.059835 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e4eb3970-9a7a-4548-98af-3fcacc17da38 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:43.060763 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e4eb3970-9a7a-4548-98af-3fcacc17da38 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:43.061381 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e4eb3970-9a7a-4548-98af-3fcacc17da38 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:43.062086 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e4eb3970-9a7a-4548-98af-3fcacc17da38 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:43.072113 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-33a6140d-1886-45b5-b1f9-f8949b0d0dc7 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/servers/53c2eac1-c886-45f2-8b2c-77aa98ceaab5" status: 200 len: 1486 microversion: 2.1 time: 0.479872 Sep 23 04:47:43.073257 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1895/3746] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:42 2022] GET /compute/v2.1/servers/53c2eac1-c886-45f2-8b2c-77aa98ceaab5 => generated 1486 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:43.082453 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-6fe85097-75ad-43a8-b46d-cae86114a3f6 req-6779b06e-2fed-425f-b0bc-d2ad427e99ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5051152b-180a-4ed9-85fb-074836ae447c", "name": "network-vif-deleted", "tag": "a5af28f5-cddc-4619-80a6-e76b666d596f"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:47:43.113205 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-6fe85097-75ad-43a8-b46d-cae86114a3f6 req-6779b06e-2fed-425f-b0bc-d2ad427e99ba service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:43.114220 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-6fe85097-75ad-43a8-b46d-cae86114a3f6 req-6779b06e-2fed-425f-b0bc-d2ad427e99ba service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:43.115088 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-6fe85097-75ad-43a8-b46d-cae86114a3f6 req-6779b06e-2fed-425f-b0bc-d2ad427e99ba service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:43.130810 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-6fe85097-75ad-43a8-b46d-cae86114a3f6 req-6779b06e-2fed-425f-b0bc-d2ad427e99ba service nova] Creating event network-vif-deleted:a5af28f5-cddc-4619-80a6-e76b666d596f for instance 5051152b-180a-4ed9-85fb-074836ae447c on n-h2-846463-3 Sep 23 04:47:43.136323 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-6fe85097-75ad-43a8-b46d-cae86114a3f6 req-6779b06e-2fed-425f-b0bc-d2ad427e99ba service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061712 Sep 23 04:47:43.137478 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1896/3747] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:47:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:47:43.143947 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-dc707808-651e-4152-9cf3-b9ac37464733 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:43.144789 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-dc707808-651e-4152-9cf3-b9ac37464733 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] [instance: 53c2eac1-c886-45f2-8b2c-77aa98ceaab5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:43.153646 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dc707808-651e-4152-9cf3-b9ac37464733 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:43.157036 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dc707808-651e-4152-9cf3-b9ac37464733 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:43.157036 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dc707808-651e-4152-9cf3-b9ac37464733 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:43.157036 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dc707808-651e-4152-9cf3-b9ac37464733 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:43.157036 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dc707808-651e-4152-9cf3-b9ac37464733 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:43.157520 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dc707808-651e-4152-9cf3-b9ac37464733 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:43.162614 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e4eb3970-9a7a-4548-98af-3fcacc17da38 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:43.181415 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e4eb3970-9a7a-4548-98af-3fcacc17da38 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/5051152b-180a-4ed9-85fb-074836ae447c" status: 200 len: 1437 microversion: 2.1 time: 0.146874 Sep 23 04:47:43.192682 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1852/3748] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:43 2022] GET /compute/v2.1/servers/5051152b-180a-4ed9-85fb-074836ae447c => generated 1437 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:43.205298 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-dc707808-651e-4152-9cf3-b9ac37464733 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] [instance: 53c2eac1-c886-45f2-8b2c-77aa98ceaab5] Going to try to terminate instance {{(pid=122699) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:47:43.558325 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-721d118c-527d-41b1-9778-4c5996d276b7 req-e561b284-8eda-4811-8fcf-3114da5a1fe7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53c2eac1-c886-45f2-8b2c-77aa98ceaab5", "name": "network-vif-plugged", "status": "completed", "tag": "87b50488-13f1-4d99-be79-5edefa1d65c9"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:47:43.596108 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-721d118c-527d-41b1-9778-4c5996d276b7 req-e561b284-8eda-4811-8fcf-3114da5a1fe7 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:43.596611 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-721d118c-527d-41b1-9778-4c5996d276b7 req-e561b284-8eda-4811-8fcf-3114da5a1fe7 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:43.597408 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-721d118c-527d-41b1-9778-4c5996d276b7 req-e561b284-8eda-4811-8fcf-3114da5a1fe7 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:43.599964 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-dc707808-651e-4152-9cf3-b9ac37464733 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "DELETE /compute/v2.1/servers/53c2eac1-c886-45f2-8b2c-77aa98ceaab5" status: 204 len: 0 microversion: 2.1 time: 0.460402 Sep 23 04:47:43.600562 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1897/3749] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:47:43 2022] DELETE /compute/v2.1/servers/53c2eac1-c886-45f2-8b2c-77aa98ceaab5 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:47:43.627418 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-721d118c-527d-41b1-9778-4c5996d276b7 req-e561b284-8eda-4811-8fcf-3114da5a1fe7 service nova] Creating event network-vif-plugged:87b50488-13f1-4d99-be79-5edefa1d65c9 for instance 53c2eac1-c886-45f2-8b2c-77aa98ceaab5 on n-h1-846463-3 Sep 23 04:47:43.634308 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-721d118c-527d-41b1-9778-4c5996d276b7 req-e561b284-8eda-4811-8fcf-3114da5a1fe7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093468 Sep 23 04:47:43.640045 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1853/3750] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:47:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:47:43.642947 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-54e9d8d5-7762-4d77-977b-251617772980 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '.version_select at 0x7ff1ba995790>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:43.681207 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-54e9d8d5-7762-4d77-977b-251617772980 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] HTTP exception thrown: Image not found. Sep 23 04:47:43.683965 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-54e9d8d5-7762-4d77-977b-251617772980 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Request method failure captured: Sep 23 04:47:43.683965 n-d-846463-3 devstack@n-api.service[122699]: request: DELETE /compute/v2.1/images/b764d7df-d7b0-49c6-aacd-66b1e6e81089 HTTP/1.1 Sep 23 04:47:43.683965 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:47:43.683965 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:47:43.683965 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:47:43.683965 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:47:43.683965 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:47:43.683965 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:47:43.683965 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:47:43.683965 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:47:43.683965 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTlvfdi4o0Y9mCUPokn0jIn66E_gYHfswvNUJk0oWKgUgT2bckyK_dFOK9sSyNanN_-OMIsJrgn2yiYsVsn4YI8ZjfIXbzODmcN_TY4KwEWe3dvDtDeCaJf-hXkJqT27YTJIsS4J-e2mLxKFLMD_hT3yOT9NVPofkih-81ZETnZH6pk Sep 23 04:47:43.683965 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:47:43.683965 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:47:43.683965 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:47:43.683965 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:47:43.683965 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:47:43.683965 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:47:43.683965 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 7c43f2b70bc74a48b62fb4115337f073 Sep 23 04:47:43.683965 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ImagesTestJSON-1079639924 Sep 23 04:47:43.683965 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:47:43.683965 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:47:43.683965 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7c43f2b70bc74a48b62fb4115337f073", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7c43f2b70bc74a48b62fb4115337f073"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7c43f2b70bc74a48b62fb4115337f073"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7c43f2b70bc74a48b62fb4115337f073"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:47:43.683965 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ImagesTestJSON-1079639924 Sep 23 04:47:43.683965 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 7c43f2b70bc74a48b62fb4115337f073 Sep 23 04:47:43.683965 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ImagesTestJSON-1079639924 Sep 23 04:47:43.683965 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ImagesTestJSON-1079639924-project Sep 23 04:47:43.683965 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:47:43.683965 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:47:43.683965 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: c11980041918484990dac709544d0b42 Sep 23 04:47:43.683965 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ImagesTestJSON-1079639924-project Sep 23 04:47:43.683965 n-d-846463-3 devstack@n-api.service[122699]: method: Sep 23 04:47:43.683965 n-d-846463-3 devstack@n-api.service[122699]: exception: Image not found. Sep 23 04:47:43.683965 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': 'b764d7df-d7b0-49c6-aacd-66b1e6e81089'} Sep 23 04:47:43.683965 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:47:43.683965 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:43.683965 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 23 04:47:43.683965 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 23 04:47:43.683965 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 23 04:47:43.683965 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 23 04:47:43.683965 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 23 04:47:43.683965 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 23 04:47:43.683965 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 23 04:47:43.683965 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 23 04:47:43.683965 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 23 04:47:43.683965 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 23 04:47:43.683965 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 23 04:47:43.683965 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 23 04:47:43.683965 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 23 04:47:43.683965 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 23 04:47:43.683965 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image b764d7df-d7b0-49c6-aacd-66b1e6e81089 to delete Sep 23 04:47:43.683965 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:47:43.683965 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:47:43.683965 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:47:43.683965 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:43.683965 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 23 04:47:43.683965 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 23 04:47:43.683965 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 23 04:47:43.683965 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 23 04:47:43.683965 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 23 04:47:43.683965 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 23 04:47:43.683965 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b764d7df-d7b0-49c6-aacd-66b1e6e81089 could not be found. Sep 23 04:47:43.683965 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:47:43.683965 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:47:43.683965 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:47:43.683965 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:43.690299 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:47:43.690299 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:47:43.690299 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:47:43.690299 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:47:43.690299 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:47:43.690299 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:47:43.690299 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:47:43.690299 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:47:43.690299 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 23 04:47:43.690299 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 23 04:47:43.690299 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 23 04:47:43.690299 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:47:43.690299 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:47:43.690299 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:47:43.690299 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:43.690299 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:47:43.690299 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:47:43.690299 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:47:43.690299 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:47:43.690299 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 23 04:47:43.690299 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:47:43.690299 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-54e9d8d5-7762-4d77-977b-251617772980 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Returning 404 to user: Image not found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:47:43.690299 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-54e9d8d5-7762-4d77-977b-251617772980 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "DELETE /compute/v2.1/images/b764d7df-d7b0-49c6-aacd-66b1e6e81089" status: 404 len: 62 microversion: 2.1 time: 0.067733 Sep 23 04:47:43.701431 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1898/3751] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:43 2022] DELETE /compute/v2.1/images/b764d7df-d7b0-49c6-aacd-66b1e6e81089 => generated 62 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 23 04:47:43.711564 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b5f830ed-cd79-4e07-a413-536cc4d05544 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:43.712301 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b5f830ed-cd79-4e07-a413-536cc4d05544 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] [instance: 53c2eac1-c886-45f2-8b2c-77aa98ceaab5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:43.732270 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b5f830ed-cd79-4e07-a413-536cc4d05544 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:43.732779 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b5f830ed-cd79-4e07-a413-536cc4d05544 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:43.735824 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b5f830ed-cd79-4e07-a413-536cc4d05544 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:43.739384 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b5f830ed-cd79-4e07-a413-536cc4d05544 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:43.739983 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b5f830ed-cd79-4e07-a413-536cc4d05544 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:43.740924 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b5f830ed-cd79-4e07-a413-536cc4d05544 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:43.783461 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b5f830ed-cd79-4e07-a413-536cc4d05544 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] [instance: 53c2eac1-c886-45f2-8b2c-77aa98ceaab5] Going to try to terminate instance {{(pid=122698) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:47:43.938210 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.compute.api [None req-b5f830ed-cd79-4e07-a413-536cc4d05544 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] [instance: 53c2eac1-c886-45f2-8b2c-77aa98ceaab5] Instance is already in deleting state, ignoring this request Sep 23 04:47:43.939027 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b5f830ed-cd79-4e07-a413-536cc4d05544 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "DELETE /compute/v2.1/servers/53c2eac1-c886-45f2-8b2c-77aa98ceaab5" status: 204 len: 0 microversion: 2.1 time: 0.231707 Sep 23 04:47:43.940180 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1854/3752] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:47:43 2022] DELETE /compute/v2.1/servers/53c2eac1-c886-45f2-8b2c-77aa98ceaab5 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:47:43.953047 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b808b850-8741-4869-9400-170d1f41ca8c tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:43.953808 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b808b850-8741-4869-9400-170d1f41ca8c tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] [instance: 53c2eac1-c886-45f2-8b2c-77aa98ceaab5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:43.960418 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b808b850-8741-4869-9400-170d1f41ca8c tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:43.968112 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b808b850-8741-4869-9400-170d1f41ca8c tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:43.968112 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b808b850-8741-4869-9400-170d1f41ca8c tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:43.968112 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b808b850-8741-4869-9400-170d1f41ca8c tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:43.968112 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b808b850-8741-4869-9400-170d1f41ca8c tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:43.968112 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b808b850-8741-4869-9400-170d1f41ca8c tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:43.976642 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4cb0e7a5-42f3-48a4-bcaa-89917d3e2d31 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:43.977261 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4cb0e7a5-42f3-48a4-bcaa-89917d3e2d31 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] [instance: f6413c5e-771f-45c5-94a8-b197becc0815] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:43.984325 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4cb0e7a5-42f3-48a4-bcaa-89917d3e2d31 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:43.984828 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4cb0e7a5-42f3-48a4-bcaa-89917d3e2d31 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:43.986299 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4cb0e7a5-42f3-48a4-bcaa-89917d3e2d31 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:43.997179 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4cb0e7a5-42f3-48a4-bcaa-89917d3e2d31 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:43.997844 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4cb0e7a5-42f3-48a4-bcaa-89917d3e2d31 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:43.998397 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4cb0e7a5-42f3-48a4-bcaa-89917d3e2d31 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:44.083856 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-4cb0e7a5-42f3-48a4-bcaa-89917d3e2d31 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] HTTP exception thrown: Instance f6413c5e-771f-45c5-94a8-b197becc0815 could not be found. Sep 23 04:47:44.094864 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4cb0e7a5-42f3-48a4-bcaa-89917d3e2d31 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Request method failure captured: Sep 23 04:47:44.094864 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/f6413c5e-771f-45c5-94a8-b197becc0815 HTTP/1.1 Sep 23 04:47:44.094864 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:47:44.094864 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:47:44.094864 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:47:44.094864 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:47:44.094864 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:47:44.094864 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:47:44.094864 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:47:44.094864 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:47:44.094864 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTpFpjGPh25TzqBKyhrvLvaFWkL4faeTDdKKBYZ-4258bHvdM5kvJeJfEcGV73OAvtYNm_BDk9uKOKPqKlfTdSYy5tbnqP456--ua0TKxu-LM-map64NPTKy_GCC6WVYwCbUhwP1cF4hdC1uo-LvpY1Eaa8dgHWJxu3z0t2BBREm_ZE Sep 23 04:47:44.094864 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:47:44.094864 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:47:44.094864 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:47:44.094864 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:47:44.094864 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:47:44.094864 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:47:44.094864 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 53d02cb07a2a404c8d89aa13a950806d Sep 23 04:47:44.094864 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-728698197 Sep 23 04:47:44.094864 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:47:44.094864 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:47:44.094864 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_53d02cb07a2a404c8d89aa13a950806d", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/53d02cb07a2a404c8d89aa13a950806d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/53d02cb07a2a404c8d89aa13a950806d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/53d02cb07a2a404c8d89aa13a950806d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:47:44.094864 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-728698197 Sep 23 04:47:44.094864 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 53d02cb07a2a404c8d89aa13a950806d Sep 23 04:47:44.094864 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-728698197 Sep 23 04:47:44.094864 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ImagesOneServerNegativeTestJSON-728698197-project Sep 23 04:47:44.094864 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:47:44.094864 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:47:44.094864 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: a245dd82de1340f7a58873de1851c61c Sep 23 04:47:44.094864 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-728698197-project Sep 23 04:47:44.094864 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:47:44.094864 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance f6413c5e-771f-45c5-94a8-b197becc0815 could not be found. Sep 23 04:47:44.094864 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': 'f6413c5e-771f-45c5-94a8-b197becc0815'} Sep 23 04:47:44.094864 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:47:44.094864 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:44.094864 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:47:44.094864 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:47:44.094864 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:47:44.094864 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:47:44.094864 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:47:44.094864 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:47:44.094864 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:47:44.094864 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:47:44.094864 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6413c5e-771f-45c5-94a8-b197becc0815 could not be found. Sep 23 04:47:44.094864 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:47:44.094864 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:47:44.094864 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:47:44.094864 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:44.094864 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:47:44.094864 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:47:44.094864 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:47:44.094864 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:47:44.094864 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:47:44.094864 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:47:44.094864 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:47:44.094864 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:47:44.094864 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:47:44.094864 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:47:44.094864 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:47:44.094864 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:47:44.094864 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6413c5e-771f-45c5-94a8-b197becc0815 could not be found. Sep 23 04:47:44.094864 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:47:44.094864 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:47:44.099263 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:47:44.099263 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:44.099263 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:47:44.099263 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:47:44.099263 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:47:44.099263 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:47:44.099263 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6413c5e-771f-45c5-94a8-b197becc0815 could not be found. Sep 23 04:47:44.099263 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:47:44.101684 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4cb0e7a5-42f3-48a4-bcaa-89917d3e2d31 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Returning 404 to user: Instance f6413c5e-771f-45c5-94a8-b197becc0815 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:47:44.105834 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4cb0e7a5-42f3-48a4-bcaa-89917d3e2d31 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] 10.222.0.33 "GET /compute/v2.1/servers/f6413c5e-771f-45c5-94a8-b197becc0815" status: 404 len: 111 microversion: 2.1 time: 0.133082 Sep 23 04:47:44.114022 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1855/3753] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:43 2022] GET /compute/v2.1/servers/f6413c5e-771f-45c5-94a8-b197becc0815 => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:47:44.120673 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6eee9e22-3c77-4a0a-a87b-e489f27c3fae tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '.version_select at 0x7ff1ba8d6f70>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:44.208111 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b808b850-8741-4869-9400-170d1f41ca8c tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11980041918484990dac709544d0b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c43f2b70bc74a48b62fb4115337f073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:44.209860 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-6eee9e22-3c77-4a0a-a87b-e489f27c3fae tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "GET /compute/v2.1/images/ebfd24d2-4412-4ba6-8024-99147eab6142" status: 200 len: 1455 microversion: 2.1 time: 0.094419 Sep 23 04:47:44.212769 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1856/3754] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:47:44 2022] GET /compute/v2.1/images/ebfd24d2-4412-4ba6-8024-99147eab6142 => generated 1455 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:44.217715 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b808b850-8741-4869-9400-170d1f41ca8c tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/servers/53c2eac1-c886-45f2-8b2c-77aa98ceaab5" status: 200 len: 1492 microversion: 2.1 time: 0.272932 Sep 23 04:47:44.218335 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1899/3755] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:43 2022] GET /compute/v2.1/servers/53c2eac1-c886-45f2-8b2c-77aa98ceaab5 => generated 1492 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:47:44.231108 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3e8a15df-37cd-45fe-b5de-2bc8cd1f6523 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:44.235112 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b4432c6b-cf2a-4f81-993e-64016ee0704c tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Action: 'create', calling method: .version_select at 0x7ff1ba8e7a60>, body: {"keypair": {"name": "tempest-keypair-497783909", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFheXEgmuijKspmxXkLZVK2r4LvY5YD2ir8vwanInHTLHNGLjcW+8hOU+k9/GbdY2gVh4X3J3uaA//0H0C/gqG7vZScH70sBgUuXvwWbnL5J6IYlN/CAWexgaPM4brSqKw=="}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:47:44.235683 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-3e8a15df-37cd-45fe-b5de-2bc8cd1f6523 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 5051152b-180a-4ed9-85fb-074836ae447c] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:44.244155 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3e8a15df-37cd-45fe-b5de-2bc8cd1f6523 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:44.248454 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3e8a15df-37cd-45fe-b5de-2bc8cd1f6523 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:44.249014 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3e8a15df-37cd-45fe-b5de-2bc8cd1f6523 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:44.249879 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3e8a15df-37cd-45fe-b5de-2bc8cd1f6523 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:44.250494 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3e8a15df-37cd-45fe-b5de-2bc8cd1f6523 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:44.252511 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3e8a15df-37cd-45fe-b5de-2bc8cd1f6523 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:44.274781 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-b4432c6b-cf2a-4f81-993e-64016ee0704c tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Getting quotas for project 53d02cb07a2a404c8d89aa13a950806d. Resources: {'key_pairs'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:47:44.294891 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-b4432c6b-cf2a-4f81-993e-64016ee0704c tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Getting quotas for user a245dd82de1340f7a58873de1851c61c and project 53d02cb07a2a404c8d89aa13a950806d. Resources: {'key_pairs'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:47:44.347707 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3e8a15df-37cd-45fe-b5de-2bc8cd1f6523 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:44.349863 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3e8a15df-37cd-45fe-b5de-2bc8cd1f6523 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:44.351065 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3e8a15df-37cd-45fe-b5de-2bc8cd1f6523 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:44.355257 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-3e8a15df-37cd-45fe-b5de-2bc8cd1f6523 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lazy-loading 'fault' on Instance uuid 5051152b-180a-4ed9-85fb-074836ae447c {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:47:44.411066 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b4432c6b-cf2a-4f81-993e-64016ee0704c tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.195546 Sep 23 04:47:44.421394 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1857/3756] 10.222.0.33 () {60 vars in 1159 bytes} [Fri Sep 23 04:47:44 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:47:44.481880 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-3e8a15df-37cd-45fe-b5de-2bc8cd1f6523 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252c87e244984f71ae0907ee769bec05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c23bd5a8b84942898a99930b2bc0ca12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:44.489839 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3e8a15df-37cd-45fe-b5de-2bc8cd1f6523 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/5051152b-180a-4ed9-85fb-074836ae447c" status: 200 len: 1283 microversion: 2.1 time: 0.268207 Sep 23 04:47:44.491098 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1900/3757] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:44 2022] GET /compute/v2.1/servers/5051152b-180a-4ed9-85fb-074836ae447c => generated 1283 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:45.232432 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-fe78acce-25d2-4264-a617-ae16bcbcbece tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '.version_select at 0x7ff1c03c9280>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:45.243456 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8643ca57-a5c9-41e7-b8e7-ddf2f9d8d09d tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:45.244809 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-8643ca57-a5c9-41e7-b8e7-ddf2f9d8d09d tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] [instance: 53c2eac1-c886-45f2-8b2c-77aa98ceaab5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:45.256902 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=4,nova_api:INSERT=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:47:45.272009 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8643ca57-a5c9-41e7-b8e7-ddf2f9d8d09d tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:45.272009 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8643ca57-a5c9-41e7-b8e7-ddf2f9d8d09d tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:45.272009 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8643ca57-a5c9-41e7-b8e7-ddf2f9d8d09d tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:45.272009 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8643ca57-a5c9-41e7-b8e7-ddf2f9d8d09d tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:45.272009 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8643ca57-a5c9-41e7-b8e7-ddf2f9d8d09d tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:45.272009 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8643ca57-a5c9-41e7-b8e7-ddf2f9d8d09d tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:45.275603 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:47:45.365405 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-fe78acce-25d2-4264-a617-ae16bcbcbece tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "GET /compute/v2.1/images/ebfd24d2-4412-4ba6-8024-99147eab6142" status: 200 len: 1455 microversion: 2.1 time: 0.140807 Sep 23 04:47:45.366138 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1858/3758] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:47:45 2022] GET /compute/v2.1/images/ebfd24d2-4412-4ba6-8024-99147eab6142 => generated 1455 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:45.522362 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-686ef329-430b-4523-a2d2-4e5d1eebac28 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:45.522362 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-686ef329-430b-4523-a2d2-4e5d1eebac28 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] [instance: 5051152b-180a-4ed9-85fb-074836ae447c] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:45.526495 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-686ef329-430b-4523-a2d2-4e5d1eebac28 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:45.533539 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-686ef329-430b-4523-a2d2-4e5d1eebac28 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:45.534278 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-686ef329-430b-4523-a2d2-4e5d1eebac28 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:45.535287 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-686ef329-430b-4523-a2d2-4e5d1eebac28 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:45.535979 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-686ef329-430b-4523-a2d2-4e5d1eebac28 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:45.538036 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-686ef329-430b-4523-a2d2-4e5d1eebac28 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:45.558694 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-686ef329-430b-4523-a2d2-4e5d1eebac28 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] HTTP exception thrown: Instance 5051152b-180a-4ed9-85fb-074836ae447c could not be found. Sep 23 04:47:45.560881 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-686ef329-430b-4523-a2d2-4e5d1eebac28 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Request method failure captured: Sep 23 04:47:45.560881 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/5051152b-180a-4ed9-85fb-074836ae447c HTTP/1.1 Sep 23 04:47:45.560881 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:47:45.560881 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:47:45.560881 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:47:45.560881 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:47:45.560881 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:47:45.560881 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:47:45.560881 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:47:45.560881 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:47:45.560881 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTlTlFK_k4e3BWkoqwVigfjvHO2lVSTsmHRT7EhNgH87mj-DVuWXCq-NRLrmXyv4E_e0wXdkZnDmOQ4aUkRrz7wPxuRsMdZHh23aH7xyd0PRdo29c8XIic0D4fdht4KBWWMxFeNNSWWMe-xxhvPgOUVxbcTbEXPF75Q0c4Y9h1Ew0hk Sep 23 04:47:45.560881 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:47:45.560881 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:47:45.560881 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:47:45.560881 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:47:45.560881 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:47:45.560881 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:47:45.560881 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: c23bd5a8b84942898a99930b2bc0ca12 Sep 23 04:47:45.560881 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ServersTestJSON-1923416422 Sep 23 04:47:45.560881 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:47:45.560881 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:47:45.560881 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c23bd5a8b84942898a99930b2bc0ca12", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c23bd5a8b84942898a99930b2bc0ca12"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c23bd5a8b84942898a99930b2bc0ca12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c23bd5a8b84942898a99930b2bc0ca12"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:47:45.560881 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ServersTestJSON-1923416422 Sep 23 04:47:45.560881 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: c23bd5a8b84942898a99930b2bc0ca12 Sep 23 04:47:45.560881 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ServersTestJSON-1923416422 Sep 23 04:47:45.560881 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ServersTestJSON-1923416422-project Sep 23 04:47:45.560881 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:47:45.560881 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:47:45.560881 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 252c87e244984f71ae0907ee769bec05 Sep 23 04:47:45.560881 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ServersTestJSON-1923416422-project Sep 23 04:47:45.560881 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:47:45.560881 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 5051152b-180a-4ed9-85fb-074836ae447c could not be found. Sep 23 04:47:45.560881 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '5051152b-180a-4ed9-85fb-074836ae447c'} Sep 23 04:47:45.560881 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:47:45.560881 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:45.560881 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:47:45.560881 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:47:45.560881 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:47:45.560881 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:47:45.560881 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:47:45.560881 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:47:45.560881 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:47:45.560881 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:47:45.560881 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5051152b-180a-4ed9-85fb-074836ae447c could not be found. Sep 23 04:47:45.560881 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:47:45.560881 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:47:45.560881 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:47:45.560881 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:45.560881 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:47:45.560881 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:47:45.560881 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:47:45.560881 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:47:45.560881 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:47:45.560881 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:47:45.560881 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:47:45.560881 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:47:45.560881 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:47:45.560881 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:47:45.560881 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:47:45.560881 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:47:45.560881 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5051152b-180a-4ed9-85fb-074836ae447c could not be found. Sep 23 04:47:45.560881 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:47:45.560881 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:47:45.560881 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:47:45.566139 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:45.566139 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:47:45.566139 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:47:45.566139 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:47:45.566139 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:47:45.566139 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5051152b-180a-4ed9-85fb-074836ae447c could not be found. Sep 23 04:47:45.566139 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:47:45.566139 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-686ef329-430b-4523-a2d2-4e5d1eebac28 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] Returning 404 to user: Instance 5051152b-180a-4ed9-85fb-074836ae447c could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:47:45.566139 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-686ef329-430b-4523-a2d2-4e5d1eebac28 tempest-ServersTestJSON-1923416422 tempest-ServersTestJSON-1923416422-project] 10.222.0.33 "GET /compute/v2.1/servers/5051152b-180a-4ed9-85fb-074836ae447c" status: 404 len: 111 microversion: 2.1 time: 0.049946 Sep 23 04:47:45.567190 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1859/3759] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:45 2022] GET /compute/v2.1/servers/5051152b-180a-4ed9-85fb-074836ae447c => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:47:45.733993 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-8643ca57-a5c9-41e7-b8e7-ddf2f9d8d09d tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11980041918484990dac709544d0b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c43f2b70bc74a48b62fb4115337f073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:45.742809 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-8643ca57-a5c9-41e7-b8e7-ddf2f9d8d09d tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/servers/53c2eac1-c886-45f2-8b2c-77aa98ceaab5" status: 200 len: 1492 microversion: 2.1 time: 0.505268 Sep 23 04:47:45.743728 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1901/3760] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:45 2022] GET /compute/v2.1/servers/53c2eac1-c886-45f2-8b2c-77aa98ceaab5 => generated 1492 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:46.187409 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a8cef3b9-9005-4126-9848-c0cb2a10bfc3 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1613070457", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d1eca3a2-09d8-4072-bb9b-de5d4b83a47e"}], "security_groups": [{"name": "tempest-securitygroup--220304690"}], "key_name": "tempest-keypair-1757192797", "user_data": "}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:47:46.363574 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.network.neutron [None req-a8cef3b9-9005-4126-9848-c0cb2a10bfc3 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] validate_networks() for [('d1eca3a2-09d8-4072-bb9b-de5d4b83a47e', None, None, None, None, None)] {{(pid=122698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:47:46.381366 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-cd172e59-0b7e-49cd-a215-8d3e41bff90f tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '.version_select at 0x7ff1c3e7f700>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:46.465384 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-cd172e59-0b7e-49cd-a215-8d3e41bff90f tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "GET /compute/v2.1/images/ebfd24d2-4412-4ba6-8024-99147eab6142" status: 200 len: 1455 microversion: 2.1 time: 0.088209 Sep 23 04:47:46.476001 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1902/3761] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:47:46 2022] GET /compute/v2.1/images/ebfd24d2-4412-4ba6-8024-99147eab6142 => generated 1455 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:47:46.772695 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6433d459-c055-4e80-802d-abbb3481e4d3 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:46.773756 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-6433d459-c055-4e80-802d-abbb3481e4d3 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] [instance: 53c2eac1-c886-45f2-8b2c-77aa98ceaab5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:46.786235 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6433d459-c055-4e80-802d-abbb3481e4d3 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:46.788543 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6433d459-c055-4e80-802d-abbb3481e4d3 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:46.789309 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6433d459-c055-4e80-802d-abbb3481e4d3 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:46.790720 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6433d459-c055-4e80-802d-abbb3481e4d3 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:46.792535 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6433d459-c055-4e80-802d-abbb3481e4d3 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:46.794632 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6433d459-c055-4e80-802d-abbb3481e4d3 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:47.037200 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-6433d459-c055-4e80-802d-abbb3481e4d3 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11980041918484990dac709544d0b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c43f2b70bc74a48b62fb4115337f073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:47.048922 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6433d459-c055-4e80-802d-abbb3481e4d3 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/servers/53c2eac1-c886-45f2-8b2c-77aa98ceaab5" status: 200 len: 1450 microversion: 2.1 time: 0.277174 Sep 23 04:47:47.061739 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1903/3762] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:46 2022] GET /compute/v2.1/servers/53c2eac1-c886-45f2-8b2c-77aa98ceaab5 => generated 1450 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:47.073087 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-438d2dd2-871b-45b2-b3aa-1a5eecf1c4f1 req-b90a677e-e197-4297-88f3-d789704dbf7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53c2eac1-c886-45f2-8b2c-77aa98ceaab5", "name": "network-vif-deleted", "tag": "87b50488-13f1-4d99-be79-5edefa1d65c9"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:47:47.089123 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-438d2dd2-871b-45b2-b3aa-1a5eecf1c4f1 req-b90a677e-e197-4297-88f3-d789704dbf7c service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:47.092703 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-438d2dd2-871b-45b2-b3aa-1a5eecf1c4f1 req-b90a677e-e197-4297-88f3-d789704dbf7c service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:47.093568 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-438d2dd2-871b-45b2-b3aa-1a5eecf1c4f1 req-b90a677e-e197-4297-88f3-d789704dbf7c service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:47.147451 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-438d2dd2-871b-45b2-b3aa-1a5eecf1c4f1 req-b90a677e-e197-4297-88f3-d789704dbf7c service nova] Creating event network-vif-deleted:87b50488-13f1-4d99-be79-5edefa1d65c9 for instance 53c2eac1-c886-45f2-8b2c-77aa98ceaab5 on n-h1-846463-3 Sep 23 04:47:47.162896 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-438d2dd2-871b-45b2-b3aa-1a5eecf1c4f1 req-b90a677e-e197-4297-88f3-d789704dbf7c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093654 Sep 23 04:47:47.164250 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1904/3763] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:47:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:47:47.484584 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a5628442-05f6-4b29-ad68-d51fe3d549f2 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '.version_select at 0x7ff1c3e7f550>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:47.523510 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-a8cef3b9-9005-4126-9848-c0cb2a10bfc3 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Flavor limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:47:47.524590 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-a8cef3b9-9005-4126-9848-c0cb2a10bfc3 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Image limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:47:47.525256 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-a8cef3b9-9005-4126-9848-c0cb2a10bfc3 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Flavor pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:47:47.525977 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-a8cef3b9-9005-4126-9848-c0cb2a10bfc3 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Image pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:47:47.541868 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-a8cef3b9-9005-4126-9848-c0cb2a10bfc3 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:47:47.541868 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a8cef3b9-9005-4126-9848-c0cb2a10bfc3 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:47.541868 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a8cef3b9-9005-4126-9848-c0cb2a10bfc3 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:47.541868 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a8cef3b9-9005-4126-9848-c0cb2a10bfc3 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:47.541868 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a8cef3b9-9005-4126-9848-c0cb2a10bfc3 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:47.541868 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a8cef3b9-9005-4126-9848-c0cb2a10bfc3 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:47.543383 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a8cef3b9-9005-4126-9848-c0cb2a10bfc3 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:47.582440 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-a8cef3b9-9005-4126-9848-c0cb2a10bfc3 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Getting quotas for project dcafb05f6f554e278cd552023947c6ac. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:47:47.582440 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-a8cef3b9-9005-4126-9848-c0cb2a10bfc3 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Getting quotas for user c786bbedc21849ea92924139a44707b7 and project dcafb05f6f554e278cd552023947c6ac. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:47:47.584444 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a5628442-05f6-4b29-ad68-d51fe3d549f2 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "GET /compute/v2.1/images/ebfd24d2-4412-4ba6-8024-99147eab6142" status: 200 len: 1455 microversion: 2.1 time: 0.105478 Sep 23 04:47:47.585668 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1905/3764] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:47:47 2022] GET /compute/v2.1/images/ebfd24d2-4412-4ba6-8024-99147eab6142 => generated 1455 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:47.607487 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a8cef3b9-9005-4126-9848-c0cb2a10bfc3 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Going to run 1 instances... {{(pid=122698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:47:47.611503 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a8cef3b9-9005-4126-9848-c0cb2a10bfc3 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: c4464422-9bf1-4aaa-806c-d7063e284579] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:47:47.855127 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a8cef3b9-9005-4126-9848-c0cb2a10bfc3 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.668182 Sep 23 04:47:47.862431 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1860/3765] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:47:46 2022] POST /compute/v2.1/servers => generated 408 bytes in 1674 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:47:47.868166 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-01c67cd7-77f4-4e32-bae1-58da6098366e tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:47.869229 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-01c67cd7-77f4-4e32-bae1-58da6098366e tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: c4464422-9bf1-4aaa-806c-d7063e284579] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:48.033270 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-01c67cd7-77f4-4e32-bae1-58da6098366e tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c786bbedc21849ea92924139a44707b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcafb05f6f554e278cd552023947c6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:48.050895 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-01c67cd7-77f4-4e32-bae1-58da6098366e tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579" status: 200 len: 1246 microversion: 2.1 time: 0.187412 Sep 23 04:47:48.051553 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1906/3766] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:47 2022] GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579 => generated 1246 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:48.077575 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-568762aa-6742-4540-8163-2b23dd3ff5f0 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:48.085167 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-568762aa-6742-4540-8163-2b23dd3ff5f0 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] [instance: 53c2eac1-c886-45f2-8b2c-77aa98ceaab5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:48.128090 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-568762aa-6742-4540-8163-2b23dd3ff5f0 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:48.128639 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-568762aa-6742-4540-8163-2b23dd3ff5f0 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:48.129098 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-568762aa-6742-4540-8163-2b23dd3ff5f0 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:48.129815 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-568762aa-6742-4540-8163-2b23dd3ff5f0 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:48.134095 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-568762aa-6742-4540-8163-2b23dd3ff5f0 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:48.137986 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-568762aa-6742-4540-8163-2b23dd3ff5f0 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:48.224421 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-568762aa-6742-4540-8163-2b23dd3ff5f0 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:48.225312 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-568762aa-6742-4540-8163-2b23dd3ff5f0 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:48.226015 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-568762aa-6742-4540-8163-2b23dd3ff5f0 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:48.227257 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-568762aa-6742-4540-8163-2b23dd3ff5f0 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lazy-loading 'fault' on Instance uuid 53c2eac1-c886-45f2-8b2c-77aa98ceaab5 {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:47:48.455593 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-568762aa-6742-4540-8163-2b23dd3ff5f0 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11980041918484990dac709544d0b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c43f2b70bc74a48b62fb4115337f073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:48.468606 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-568762aa-6742-4540-8163-2b23dd3ff5f0 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/servers/53c2eac1-c886-45f2-8b2c-77aa98ceaab5" status: 200 len: 1297 microversion: 2.1 time: 0.392675 Sep 23 04:47:48.474479 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1861/3767] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:48 2022] GET /compute/v2.1/servers/53c2eac1-c886-45f2-8b2c-77aa98ceaab5 => generated 1297 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:48.601742 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b7929cdc-7724-4988-bd56-9d3a9a229425 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '.version_select at 0x7ff1ba9e6310>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:48.682646 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b7929cdc-7724-4988-bd56-9d3a9a229425 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "GET /compute/v2.1/images/ebfd24d2-4412-4ba6-8024-99147eab6142" status: 200 len: 1455 microversion: 2.1 time: 0.084099 Sep 23 04:47:48.693640 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1907/3768] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:47:48 2022] GET /compute/v2.1/images/ebfd24d2-4412-4ba6-8024-99147eab6142 => generated 1455 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:48.861380 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-85ab7ead-5c12-4a37-97b6-97720275e74e tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-92016359", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:47:48.984570 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.network.neutron [None req-85ab7ead-5c12-4a37-97b6-97720275e74e tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] validate_networks() for [('7ec2c088-8cd5-47fc-aaa6-ca4765f2280b', None, None, None, None, None)] {{(pid=122698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:47:49.075437 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4fb63ee7-b47a-4a5b-8eff-e6b88aa1bf3e tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:49.076551 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4fb63ee7-b47a-4a5b-8eff-e6b88aa1bf3e tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: c4464422-9bf1-4aaa-806c-d7063e284579] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:49.161363 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-4fb63ee7-b47a-4a5b-8eff-e6b88aa1bf3e tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c786bbedc21849ea92924139a44707b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcafb05f6f554e278cd552023947c6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:49.177252 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4fb63ee7-b47a-4a5b-8eff-e6b88aa1bf3e tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579" status: 200 len: 1246 microversion: 2.1 time: 0.107101 Sep 23 04:47:49.183791 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1908/3769] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:49 2022] GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579 => generated 1246 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:47:49.507995 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ffa45402-5830-44cf-bc2e-3878f04ca908 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:49.508926 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ffa45402-5830-44cf-bc2e-3878f04ca908 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] [instance: 53c2eac1-c886-45f2-8b2c-77aa98ceaab5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:49.519945 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ffa45402-5830-44cf-bc2e-3878f04ca908 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:49.523613 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ffa45402-5830-44cf-bc2e-3878f04ca908 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:49.525482 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ffa45402-5830-44cf-bc2e-3878f04ca908 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:49.528036 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ffa45402-5830-44cf-bc2e-3878f04ca908 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:49.528703 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ffa45402-5830-44cf-bc2e-3878f04ca908 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:49.529335 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ffa45402-5830-44cf-bc2e-3878f04ca908 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:49.574016 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-ffa45402-5830-44cf-bc2e-3878f04ca908 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] HTTP exception thrown: Instance 53c2eac1-c886-45f2-8b2c-77aa98ceaab5 could not be found. Sep 23 04:47:49.588087 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ffa45402-5830-44cf-bc2e-3878f04ca908 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Request method failure captured: Sep 23 04:47:49.588087 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/53c2eac1-c886-45f2-8b2c-77aa98ceaab5 HTTP/1.1 Sep 23 04:47:49.588087 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:47:49.588087 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:47:49.588087 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:47:49.588087 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:47:49.588087 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:47:49.588087 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:47:49.588087 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:47:49.588087 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:47:49.588087 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTlvfdi4o0Y9mCUPokn0jIn66E_gYHfswvNUJk0oWKgUgT2bckyK_dFOK9sSyNanN_-OMIsJrgn2yiYsVsn4YI8ZjfIXbzODmcN_TY4KwEWe3dvDtDeCaJf-hXkJqT27YTJIsS4J-e2mLxKFLMD_hT3yOT9NVPofkih-81ZETnZH6pk Sep 23 04:47:49.588087 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:47:49.588087 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:47:49.588087 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:47:49.588087 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:47:49.588087 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:47:49.588087 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:47:49.588087 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 7c43f2b70bc74a48b62fb4115337f073 Sep 23 04:47:49.588087 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ImagesTestJSON-1079639924 Sep 23 04:47:49.588087 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:47:49.588087 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:47:49.588087 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7c43f2b70bc74a48b62fb4115337f073", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7c43f2b70bc74a48b62fb4115337f073"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7c43f2b70bc74a48b62fb4115337f073"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7c43f2b70bc74a48b62fb4115337f073"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:47:49.588087 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ImagesTestJSON-1079639924 Sep 23 04:47:49.588087 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 7c43f2b70bc74a48b62fb4115337f073 Sep 23 04:47:49.588087 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ImagesTestJSON-1079639924 Sep 23 04:47:49.588087 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ImagesTestJSON-1079639924-project Sep 23 04:47:49.588087 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:47:49.588087 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:47:49.588087 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: c11980041918484990dac709544d0b42 Sep 23 04:47:49.588087 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ImagesTestJSON-1079639924-project Sep 23 04:47:49.588087 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:47:49.588087 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 53c2eac1-c886-45f2-8b2c-77aa98ceaab5 could not be found. Sep 23 04:47:49.588087 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '53c2eac1-c886-45f2-8b2c-77aa98ceaab5'} Sep 23 04:47:49.588087 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:47:49.588087 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:49.588087 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:47:49.588087 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:47:49.588087 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:47:49.588087 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:47:49.588087 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:47:49.588087 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:47:49.588087 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:47:49.588087 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:47:49.588087 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53c2eac1-c886-45f2-8b2c-77aa98ceaab5 could not be found. Sep 23 04:47:49.588087 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:47:49.588087 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:47:49.588087 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:47:49.588087 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:49.588087 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:47:49.588087 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:47:49.588087 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:47:49.588087 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:47:49.588087 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:47:49.588087 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:47:49.588087 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:47:49.588087 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:47:49.588087 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:47:49.588087 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:47:49.588087 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:47:49.588087 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:47:49.588087 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53c2eac1-c886-45f2-8b2c-77aa98ceaab5 could not be found. Sep 23 04:47:49.588087 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:47:49.588087 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:47:49.588087 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:47:49.588087 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:49.593633 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:47:49.593633 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:47:49.593633 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:47:49.593633 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:47:49.593633 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53c2eac1-c886-45f2-8b2c-77aa98ceaab5 could not be found. Sep 23 04:47:49.593633 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:47:49.596142 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ffa45402-5830-44cf-bc2e-3878f04ca908 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Returning 404 to user: Instance 53c2eac1-c886-45f2-8b2c-77aa98ceaab5 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:47:49.596700 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ffa45402-5830-44cf-bc2e-3878f04ca908 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/servers/53c2eac1-c886-45f2-8b2c-77aa98ceaab5" status: 404 len: 111 microversion: 2.1 time: 0.092071 Sep 23 04:47:49.600695 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1909/3770] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:49 2022] GET /compute/v2.1/servers/53c2eac1-c886-45f2-8b2c-77aa98ceaab5 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 04:47:49.606655 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-bfbb0801-5fe7-47e5-8d33-8d393e060b1e tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '.version_select at 0x7ff1ba9e6f70>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:49.658808 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-bfbb0801-5fe7-47e5-8d33-8d393e060b1e tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] HTTP exception thrown: Image not found. Sep 23 04:47:49.670488 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-bfbb0801-5fe7-47e5-8d33-8d393e060b1e tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Request method failure captured: Sep 23 04:47:49.670488 n-d-846463-3 devstack@n-api.service[122699]: request: DELETE /compute/v2.1/images/5ca97cbe-84e0-43f6-8385-3c16932e4f48 HTTP/1.1 Sep 23 04:47:49.670488 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:47:49.670488 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:47:49.670488 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:47:49.670488 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:47:49.670488 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:47:49.670488 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:47:49.670488 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:47:49.670488 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:47:49.670488 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTlvfdi4o0Y9mCUPokn0jIn66E_gYHfswvNUJk0oWKgUgT2bckyK_dFOK9sSyNanN_-OMIsJrgn2yiYsVsn4YI8ZjfIXbzODmcN_TY4KwEWe3dvDtDeCaJf-hXkJqT27YTJIsS4J-e2mLxKFLMD_hT3yOT9NVPofkih-81ZETnZH6pk Sep 23 04:47:49.670488 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:47:49.670488 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:47:49.670488 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:47:49.670488 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:47:49.670488 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:47:49.670488 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:47:49.670488 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 7c43f2b70bc74a48b62fb4115337f073 Sep 23 04:47:49.670488 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ImagesTestJSON-1079639924 Sep 23 04:47:49.670488 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:47:49.670488 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:47:49.670488 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7c43f2b70bc74a48b62fb4115337f073", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7c43f2b70bc74a48b62fb4115337f073"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7c43f2b70bc74a48b62fb4115337f073"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7c43f2b70bc74a48b62fb4115337f073"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:47:49.670488 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ImagesTestJSON-1079639924 Sep 23 04:47:49.670488 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 7c43f2b70bc74a48b62fb4115337f073 Sep 23 04:47:49.670488 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ImagesTestJSON-1079639924 Sep 23 04:47:49.670488 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ImagesTestJSON-1079639924-project Sep 23 04:47:49.670488 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:47:49.670488 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:47:49.670488 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: c11980041918484990dac709544d0b42 Sep 23 04:47:49.670488 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ImagesTestJSON-1079639924-project Sep 23 04:47:49.670488 n-d-846463-3 devstack@n-api.service[122699]: method: Sep 23 04:47:49.670488 n-d-846463-3 devstack@n-api.service[122699]: exception: Image not found. Sep 23 04:47:49.670488 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '5ca97cbe-84e0-43f6-8385-3c16932e4f48'} Sep 23 04:47:49.670488 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:47:49.670488 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:49.670488 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 23 04:47:49.670488 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 23 04:47:49.670488 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 23 04:47:49.670488 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 23 04:47:49.670488 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 23 04:47:49.670488 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 23 04:47:49.670488 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 23 04:47:49.670488 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 23 04:47:49.670488 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 23 04:47:49.670488 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 23 04:47:49.670488 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 23 04:47:49.670488 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 23 04:47:49.670488 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 23 04:47:49.670488 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 23 04:47:49.670488 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 5ca97cbe-84e0-43f6-8385-3c16932e4f48 to delete Sep 23 04:47:49.670488 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:47:49.670488 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:47:49.670488 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:47:49.670488 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:49.670488 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 23 04:47:49.670488 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 23 04:47:49.670488 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 23 04:47:49.670488 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 23 04:47:49.670488 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 23 04:47:49.670488 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 23 04:47:49.670488 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5ca97cbe-84e0-43f6-8385-3c16932e4f48 could not be found. Sep 23 04:47:49.670488 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:47:49.670488 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:47:49.670488 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:47:49.670488 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:49.676016 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:47:49.676016 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:47:49.676016 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:47:49.676016 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:47:49.676016 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:47:49.676016 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:47:49.676016 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:47:49.676016 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:47:49.676016 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 23 04:47:49.676016 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 23 04:47:49.676016 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 23 04:47:49.676016 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:47:49.676016 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:47:49.676016 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:47:49.676016 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:49.676016 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:47:49.676016 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:47:49.676016 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:47:49.676016 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:47:49.676016 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 23 04:47:49.676016 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:47:49.676016 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-bfbb0801-5fe7-47e5-8d33-8d393e060b1e tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Returning 404 to user: Image not found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:47:49.676016 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-bfbb0801-5fe7-47e5-8d33-8d393e060b1e tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "DELETE /compute/v2.1/images/5ca97cbe-84e0-43f6-8385-3c16932e4f48" status: 404 len: 62 microversion: 2.1 time: 0.066896 Sep 23 04:47:49.676016 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1910/3771] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:49 2022] DELETE /compute/v2.1/images/5ca97cbe-84e0-43f6-8385-3c16932e4f48 => generated 62 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 23 04:47:49.680887 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6a3860b3-2c6e-4c84-a926-bae0db30b819 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:49.681395 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-6a3860b3-2c6e-4c84-a926-bae0db30b819 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] [instance: 0fff1fd4-972c-4268-89fd-92b784244edf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:49.704736 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6a3860b3-2c6e-4c84-a926-bae0db30b819 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:49.705377 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6a3860b3-2c6e-4c84-a926-bae0db30b819 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:49.705826 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6a3860b3-2c6e-4c84-a926-bae0db30b819 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:49.706662 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6a3860b3-2c6e-4c84-a926-bae0db30b819 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:49.707133 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6a3860b3-2c6e-4c84-a926-bae0db30b819 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:49.707564 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6a3860b3-2c6e-4c84-a926-bae0db30b819 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:49.736305 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-6a3860b3-2c6e-4c84-a926-bae0db30b819 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] HTTP exception thrown: Instance 0fff1fd4-972c-4268-89fd-92b784244edf could not be found. Sep 23 04:47:49.740475 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6a3860b3-2c6e-4c84-a926-bae0db30b819 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Request method failure captured: Sep 23 04:47:49.740475 n-d-846463-3 devstack@n-api.service[122699]: request: DELETE /compute/v2.1/servers/0fff1fd4-972c-4268-89fd-92b784244edf HTTP/1.1 Sep 23 04:47:49.740475 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:47:49.740475 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:47:49.740475 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:47:49.740475 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:47:49.740475 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:47:49.740475 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:47:49.740475 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:47:49.740475 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:47:49.740475 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTlvfdi4o0Y9mCUPokn0jIn66E_gYHfswvNUJk0oWKgUgT2bckyK_dFOK9sSyNanN_-OMIsJrgn2yiYsVsn4YI8ZjfIXbzODmcN_TY4KwEWe3dvDtDeCaJf-hXkJqT27YTJIsS4J-e2mLxKFLMD_hT3yOT9NVPofkih-81ZETnZH6pk Sep 23 04:47:49.740475 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:47:49.740475 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:47:49.740475 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:47:49.740475 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:47:49.740475 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:47:49.740475 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:47:49.740475 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 7c43f2b70bc74a48b62fb4115337f073 Sep 23 04:47:49.740475 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ImagesTestJSON-1079639924 Sep 23 04:47:49.740475 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:47:49.740475 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:47:49.740475 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7c43f2b70bc74a48b62fb4115337f073", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7c43f2b70bc74a48b62fb4115337f073"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7c43f2b70bc74a48b62fb4115337f073"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7c43f2b70bc74a48b62fb4115337f073"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:47:49.740475 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ImagesTestJSON-1079639924 Sep 23 04:47:49.740475 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 7c43f2b70bc74a48b62fb4115337f073 Sep 23 04:47:49.740475 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ImagesTestJSON-1079639924 Sep 23 04:47:49.740475 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ImagesTestJSON-1079639924-project Sep 23 04:47:49.740475 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:47:49.740475 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:47:49.740475 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: c11980041918484990dac709544d0b42 Sep 23 04:47:49.740475 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ImagesTestJSON-1079639924-project Sep 23 04:47:49.740475 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:47:49.740475 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 0fff1fd4-972c-4268-89fd-92b784244edf could not be found. Sep 23 04:47:49.740475 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '0fff1fd4-972c-4268-89fd-92b784244edf'} Sep 23 04:47:49.740475 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:47:49.740475 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:49.740475 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:47:49.740475 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:47:49.740475 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:47:49.740475 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:47:49.740475 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:47:49.740475 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:47:49.740475 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:47:49.740475 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:47:49.740475 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fff1fd4-972c-4268-89fd-92b784244edf could not be found. Sep 23 04:47:49.740475 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:47:49.740475 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:47:49.740475 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:47:49.740475 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:49.740475 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:47:49.740475 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:47:49.740475 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:47:49.740475 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:47:49.740475 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:47:49.740475 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:47:49.740475 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 04:47:49.740475 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 04:47:49.740475 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 04:47:49.740475 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 04:47:49.740475 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:47:49.740475 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:47:49.740475 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:47:49.740475 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:47:49.740475 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fff1fd4-972c-4268-89fd-92b784244edf could not be found. Sep 23 04:47:49.752406 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:47:49.752406 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:47:49.752406 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:47:49.752406 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:49.752406 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:47:49.752406 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:47:49.752406 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:47:49.752406 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:47:49.752406 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fff1fd4-972c-4268-89fd-92b784244edf could not be found. Sep 23 04:47:49.752406 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:47:49.752406 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6a3860b3-2c6e-4c84-a926-bae0db30b819 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Returning 404 to user: Instance 0fff1fd4-972c-4268-89fd-92b784244edf could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:47:49.752406 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6a3860b3-2c6e-4c84-a926-bae0db30b819 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "DELETE /compute/v2.1/servers/0fff1fd4-972c-4268-89fd-92b784244edf" status: 404 len: 111 microversion: 2.1 time: 0.074257 Sep 23 04:47:49.752406 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1911/3772] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:47:49 2022] DELETE /compute/v2.1/servers/0fff1fd4-972c-4268-89fd-92b784244edf => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:47:49.761192 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a28322ac-dc8d-4f01-9a66-fe7271fe8671 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '.version_select at 0x7ff1bb7334c0>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:49.795422 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-85ab7ead-5c12-4a37-97b6-97720275e74e tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Flavor limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:47:49.796303 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-85ab7ead-5c12-4a37-97b6-97720275e74e tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Image limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:47:49.797140 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-85ab7ead-5c12-4a37-97b6-97720275e74e tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Flavor pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:47:49.797939 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-85ab7ead-5c12-4a37-97b6-97720275e74e tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Image pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:47:49.798618 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-85ab7ead-5c12-4a37-97b6-97720275e74e tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:47:49.831430 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a28322ac-dc8d-4f01-9a66-fe7271fe8671 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "GET /compute/v2.1/images/ebfd24d2-4412-4ba6-8024-99147eab6142" status: 200 len: 1455 microversion: 2.1 time: 0.076620 Sep 23 04:47:49.831946 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-85ab7ead-5c12-4a37-97b6-97720275e74e tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:49.832728 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-85ab7ead-5c12-4a37-97b6-97720275e74e tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:49.833265 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-85ab7ead-5c12-4a37-97b6-97720275e74e tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:49.834275 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-85ab7ead-5c12-4a37-97b6-97720275e74e tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:49.834833 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-85ab7ead-5c12-4a37-97b6-97720275e74e tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:49.835344 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-85ab7ead-5c12-4a37-97b6-97720275e74e tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:49.835989 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1912/3773] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:47:49 2022] GET /compute/v2.1/images/ebfd24d2-4412-4ba6-8024-99147eab6142 => generated 1455 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:49.841925 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-036bf2cf-ab42-4ea5-8233-1b0b103934a4 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:49.842589 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-036bf2cf-ab42-4ea5-8233-1b0b103934a4 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] [instance: 0fff1fd4-972c-4268-89fd-92b784244edf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:49.851817 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-036bf2cf-ab42-4ea5-8233-1b0b103934a4 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:49.852323 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-036bf2cf-ab42-4ea5-8233-1b0b103934a4 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:49.852765 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-036bf2cf-ab42-4ea5-8233-1b0b103934a4 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:49.854045 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-036bf2cf-ab42-4ea5-8233-1b0b103934a4 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:49.855120 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-036bf2cf-ab42-4ea5-8233-1b0b103934a4 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:49.855561 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-036bf2cf-ab42-4ea5-8233-1b0b103934a4 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:49.859055 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-85ab7ead-5c12-4a37-97b6-97720275e74e tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Getting quotas for project 53d02cb07a2a404c8d89aa13a950806d. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:47:49.865038 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-85ab7ead-5c12-4a37-97b6-97720275e74e tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Getting quotas for user a245dd82de1340f7a58873de1851c61c and project 53d02cb07a2a404c8d89aa13a950806d. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:47:49.873924 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-036bf2cf-ab42-4ea5-8233-1b0b103934a4 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] HTTP exception thrown: Instance 0fff1fd4-972c-4268-89fd-92b784244edf could not be found. Sep 23 04:47:49.876146 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-036bf2cf-ab42-4ea5-8233-1b0b103934a4 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Request method failure captured: Sep 23 04:47:49.876146 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/0fff1fd4-972c-4268-89fd-92b784244edf HTTP/1.1 Sep 23 04:47:49.876146 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:47:49.876146 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:47:49.876146 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:47:49.876146 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:47:49.876146 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:47:49.876146 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:47:49.876146 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:47:49.876146 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:47:49.876146 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTlvfdi4o0Y9mCUPokn0jIn66E_gYHfswvNUJk0oWKgUgT2bckyK_dFOK9sSyNanN_-OMIsJrgn2yiYsVsn4YI8ZjfIXbzODmcN_TY4KwEWe3dvDtDeCaJf-hXkJqT27YTJIsS4J-e2mLxKFLMD_hT3yOT9NVPofkih-81ZETnZH6pk Sep 23 04:47:49.876146 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:47:49.876146 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:47:49.876146 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:47:49.876146 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:47:49.876146 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:47:49.876146 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:47:49.876146 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 7c43f2b70bc74a48b62fb4115337f073 Sep 23 04:47:49.876146 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ImagesTestJSON-1079639924 Sep 23 04:47:49.876146 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:47:49.876146 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:47:49.876146 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7c43f2b70bc74a48b62fb4115337f073", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7c43f2b70bc74a48b62fb4115337f073"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7c43f2b70bc74a48b62fb4115337f073"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7c43f2b70bc74a48b62fb4115337f073"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:47:49.876146 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ImagesTestJSON-1079639924 Sep 23 04:47:49.876146 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 7c43f2b70bc74a48b62fb4115337f073 Sep 23 04:47:49.876146 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ImagesTestJSON-1079639924 Sep 23 04:47:49.876146 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ImagesTestJSON-1079639924-project Sep 23 04:47:49.876146 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:47:49.876146 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:47:49.876146 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: c11980041918484990dac709544d0b42 Sep 23 04:47:49.876146 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ImagesTestJSON-1079639924-project Sep 23 04:47:49.876146 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:47:49.876146 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 0fff1fd4-972c-4268-89fd-92b784244edf could not be found. Sep 23 04:47:49.876146 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '0fff1fd4-972c-4268-89fd-92b784244edf'} Sep 23 04:47:49.876146 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:47:49.876146 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:49.876146 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:47:49.876146 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:47:49.876146 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:47:49.876146 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:47:49.876146 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:47:49.876146 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:47:49.876146 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:47:49.876146 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:47:49.876146 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fff1fd4-972c-4268-89fd-92b784244edf could not be found. Sep 23 04:47:49.876146 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:47:49.876146 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:47:49.876146 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:47:49.876146 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:49.876146 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:47:49.876146 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:47:49.876146 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:47:49.876146 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:47:49.876146 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:47:49.876146 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:47:49.876146 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:47:49.876146 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:47:49.876146 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:47:49.876146 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:47:49.876146 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:47:49.876146 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:47:49.876146 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fff1fd4-972c-4268-89fd-92b784244edf could not be found. Sep 23 04:47:49.876146 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:47:49.876146 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:47:49.876146 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:47:49.876146 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:49.883535 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:47:49.883535 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:47:49.883535 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:47:49.883535 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:47:49.883535 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fff1fd4-972c-4268-89fd-92b784244edf could not be found. Sep 23 04:47:49.883535 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:47:49.883535 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-036bf2cf-ab42-4ea5-8233-1b0b103934a4 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Returning 404 to user: Instance 0fff1fd4-972c-4268-89fd-92b784244edf could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:47:49.883535 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-036bf2cf-ab42-4ea5-8233-1b0b103934a4 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/servers/0fff1fd4-972c-4268-89fd-92b784244edf" status: 404 len: 111 microversion: 2.1 time: 0.040679 Sep 23 04:47:49.883535 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1913/3774] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:49 2022] GET /compute/v2.1/servers/0fff1fd4-972c-4268-89fd-92b784244edf => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:47:49.887774 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6782ef08-f3dc-4633-b70b-3091a12cd3f5 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '.version_select at 0x7ff1bb733550>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:49.888030 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-85ab7ead-5c12-4a37-97b6-97720275e74e tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Going to run 1 instances... {{(pid=122698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:47:49.890577 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-85ab7ead-5c12-4a37-97b6-97720275e74e tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] [instance: 6b1aa3ac-6bda-48be-8814-e1a5ddd510a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:47:49.915065 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-6782ef08-f3dc-4633-b70b-3091a12cd3f5 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] HTTP exception thrown: Image not found. Sep 23 04:47:49.918179 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6782ef08-f3dc-4633-b70b-3091a12cd3f5 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Request method failure captured: Sep 23 04:47:49.918179 n-d-846463-3 devstack@n-api.service[122699]: request: DELETE /compute/v2.1/images/61d751db-b940-4f89-b620-4902c2decb81 HTTP/1.1 Sep 23 04:47:49.918179 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:47:49.918179 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:47:49.918179 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:47:49.918179 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:47:49.918179 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:47:49.918179 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:47:49.918179 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:47:49.918179 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:47:49.918179 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTlvfdi4o0Y9mCUPokn0jIn66E_gYHfswvNUJk0oWKgUgT2bckyK_dFOK9sSyNanN_-OMIsJrgn2yiYsVsn4YI8ZjfIXbzODmcN_TY4KwEWe3dvDtDeCaJf-hXkJqT27YTJIsS4J-e2mLxKFLMD_hT3yOT9NVPofkih-81ZETnZH6pk Sep 23 04:47:49.918179 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:47:49.918179 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:47:49.918179 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:47:49.918179 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:47:49.918179 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:47:49.918179 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:47:49.918179 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 7c43f2b70bc74a48b62fb4115337f073 Sep 23 04:47:49.918179 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ImagesTestJSON-1079639924 Sep 23 04:47:49.918179 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:47:49.918179 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:47:49.918179 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7c43f2b70bc74a48b62fb4115337f073", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7c43f2b70bc74a48b62fb4115337f073"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7c43f2b70bc74a48b62fb4115337f073"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7c43f2b70bc74a48b62fb4115337f073"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:47:49.918179 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ImagesTestJSON-1079639924 Sep 23 04:47:49.918179 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 7c43f2b70bc74a48b62fb4115337f073 Sep 23 04:47:49.918179 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ImagesTestJSON-1079639924 Sep 23 04:47:49.918179 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ImagesTestJSON-1079639924-project Sep 23 04:47:49.918179 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:47:49.918179 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:47:49.918179 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: c11980041918484990dac709544d0b42 Sep 23 04:47:49.918179 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ImagesTestJSON-1079639924-project Sep 23 04:47:49.918179 n-d-846463-3 devstack@n-api.service[122699]: method: Sep 23 04:47:49.918179 n-d-846463-3 devstack@n-api.service[122699]: exception: Image not found. Sep 23 04:47:49.918179 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '61d751db-b940-4f89-b620-4902c2decb81'} Sep 23 04:47:49.918179 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:47:49.918179 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:49.918179 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 23 04:47:49.918179 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 23 04:47:49.918179 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 23 04:47:49.918179 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 23 04:47:49.918179 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 23 04:47:49.918179 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 23 04:47:49.918179 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 23 04:47:49.918179 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 23 04:47:49.918179 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 23 04:47:49.918179 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 23 04:47:49.918179 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 23 04:47:49.918179 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 23 04:47:49.918179 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 23 04:47:49.918179 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 23 04:47:49.918179 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 61d751db-b940-4f89-b620-4902c2decb81 to delete Sep 23 04:47:49.918179 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:47:49.918179 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:47:49.918179 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:47:49.918179 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:49.918179 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 23 04:47:49.918179 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 23 04:47:49.918179 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 23 04:47:49.918179 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 23 04:47:49.918179 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 23 04:47:49.918179 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 23 04:47:49.918179 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 61d751db-b940-4f89-b620-4902c2decb81 could not be found. Sep 23 04:47:49.918179 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:47:49.918179 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:47:49.918179 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:47:49.918179 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:49.924251 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:47:49.924251 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:47:49.924251 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:47:49.924251 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:47:49.924251 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:47:49.924251 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:47:49.924251 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:47:49.924251 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:47:49.924251 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 23 04:47:49.924251 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 23 04:47:49.924251 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 23 04:47:49.924251 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:47:49.924251 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:47:49.924251 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:47:49.924251 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:49.924251 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:47:49.924251 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:47:49.924251 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:47:49.924251 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:47:49.924251 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 23 04:47:49.924251 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:47:49.924251 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6782ef08-f3dc-4633-b70b-3091a12cd3f5 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Returning 404 to user: Image not found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:47:49.924251 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6782ef08-f3dc-4633-b70b-3091a12cd3f5 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "DELETE /compute/v2.1/images/61d751db-b940-4f89-b620-4902c2decb81" status: 404 len: 62 microversion: 2.1 time: 0.036606 Sep 23 04:47:49.924251 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1914/3775] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:49 2022] DELETE /compute/v2.1/images/61d751db-b940-4f89-b620-4902c2decb81 => generated 62 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 23 04:47:49.933672 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4e22c8f0-2130-4f28-812c-170fb8919230 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:49.934490 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4e22c8f0-2130-4f28-812c-170fb8919230 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] [instance: 188a699b-0a1a-46b4-9a03-788af481d3ca] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:49.954818 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4e22c8f0-2130-4f28-812c-170fb8919230 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:49.955547 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4e22c8f0-2130-4f28-812c-170fb8919230 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:49.956168 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4e22c8f0-2130-4f28-812c-170fb8919230 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:49.957100 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4e22c8f0-2130-4f28-812c-170fb8919230 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:49.957746 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4e22c8f0-2130-4f28-812c-170fb8919230 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:49.958536 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4e22c8f0-2130-4f28-812c-170fb8919230 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:49.986405 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-4e22c8f0-2130-4f28-812c-170fb8919230 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] HTTP exception thrown: Instance 188a699b-0a1a-46b4-9a03-788af481d3ca could not be found. Sep 23 04:47:49.988967 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4e22c8f0-2130-4f28-812c-170fb8919230 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Request method failure captured: Sep 23 04:47:49.988967 n-d-846463-3 devstack@n-api.service[122699]: request: DELETE /compute/v2.1/servers/188a699b-0a1a-46b4-9a03-788af481d3ca HTTP/1.1 Sep 23 04:47:49.988967 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:47:49.988967 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:47:49.988967 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:47:49.988967 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:47:49.988967 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:47:49.988967 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:47:49.988967 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:47:49.988967 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:47:49.988967 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTlvfdi4o0Y9mCUPokn0jIn66E_gYHfswvNUJk0oWKgUgT2bckyK_dFOK9sSyNanN_-OMIsJrgn2yiYsVsn4YI8ZjfIXbzODmcN_TY4KwEWe3dvDtDeCaJf-hXkJqT27YTJIsS4J-e2mLxKFLMD_hT3yOT9NVPofkih-81ZETnZH6pk Sep 23 04:47:49.988967 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:47:49.988967 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:47:49.988967 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:47:49.988967 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:47:49.988967 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:47:49.988967 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:47:49.988967 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 7c43f2b70bc74a48b62fb4115337f073 Sep 23 04:47:49.988967 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ImagesTestJSON-1079639924 Sep 23 04:47:49.988967 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:47:49.988967 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:47:49.988967 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7c43f2b70bc74a48b62fb4115337f073", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7c43f2b70bc74a48b62fb4115337f073"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7c43f2b70bc74a48b62fb4115337f073"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7c43f2b70bc74a48b62fb4115337f073"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:47:49.988967 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ImagesTestJSON-1079639924 Sep 23 04:47:49.988967 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 7c43f2b70bc74a48b62fb4115337f073 Sep 23 04:47:49.988967 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ImagesTestJSON-1079639924 Sep 23 04:47:49.988967 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ImagesTestJSON-1079639924-project Sep 23 04:47:49.988967 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:47:49.988967 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:47:49.988967 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: c11980041918484990dac709544d0b42 Sep 23 04:47:49.988967 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ImagesTestJSON-1079639924-project Sep 23 04:47:49.988967 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:47:49.988967 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 188a699b-0a1a-46b4-9a03-788af481d3ca could not be found. Sep 23 04:47:49.988967 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '188a699b-0a1a-46b4-9a03-788af481d3ca'} Sep 23 04:47:49.988967 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:47:49.988967 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:49.988967 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:47:49.988967 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:47:49.988967 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:47:49.988967 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:47:49.988967 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:47:49.988967 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:47:49.988967 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:47:49.988967 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:47:49.988967 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 188a699b-0a1a-46b4-9a03-788af481d3ca could not be found. Sep 23 04:47:49.988967 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:47:49.988967 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:47:49.988967 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:47:49.988967 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:49.988967 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:47:49.988967 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:47:49.988967 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:47:49.988967 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:47:49.988967 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:47:49.988967 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:47:49.988967 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 04:47:49.988967 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 04:47:49.988967 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 04:47:49.988967 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 04:47:49.988967 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:47:49.988967 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:47:49.988967 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:47:49.988967 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:47:49.988967 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 188a699b-0a1a-46b4-9a03-788af481d3ca could not be found. Sep 23 04:47:49.996214 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:47:49.996214 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:47:49.996214 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:47:49.996214 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:49.996214 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:47:49.996214 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:47:49.996214 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:47:49.996214 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:47:49.996214 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 188a699b-0a1a-46b4-9a03-788af481d3ca could not be found. Sep 23 04:47:49.996214 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:47:49.996214 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4e22c8f0-2130-4f28-812c-170fb8919230 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Returning 404 to user: Instance 188a699b-0a1a-46b4-9a03-788af481d3ca could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:47:49.996214 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4e22c8f0-2130-4f28-812c-170fb8919230 tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "DELETE /compute/v2.1/servers/188a699b-0a1a-46b4-9a03-788af481d3ca" status: 404 len: 111 microversion: 2.1 time: 0.062711 Sep 23 04:47:49.996214 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1915/3776] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:47:49 2022] DELETE /compute/v2.1/servers/188a699b-0a1a-46b4-9a03-788af481d3ca => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:47:50.011641 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7f05dc34-c946-4bd3-b459-2fa0e660d8dc tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:50.015481 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-7f05dc34-c946-4bd3-b459-2fa0e660d8dc tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] [instance: 188a699b-0a1a-46b4-9a03-788af481d3ca] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:50.019731 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7f05dc34-c946-4bd3-b459-2fa0e660d8dc tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:50.020323 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7f05dc34-c946-4bd3-b459-2fa0e660d8dc tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:50.021546 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7f05dc34-c946-4bd3-b459-2fa0e660d8dc tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:50.023878 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7f05dc34-c946-4bd3-b459-2fa0e660d8dc tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:50.023878 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7f05dc34-c946-4bd3-b459-2fa0e660d8dc tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:50.024130 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7f05dc34-c946-4bd3-b459-2fa0e660d8dc tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:50.061295 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-7f05dc34-c946-4bd3-b459-2fa0e660d8dc tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] HTTP exception thrown: Instance 188a699b-0a1a-46b4-9a03-788af481d3ca could not be found. Sep 23 04:47:50.063079 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7f05dc34-c946-4bd3-b459-2fa0e660d8dc tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Request method failure captured: Sep 23 04:47:50.063079 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/188a699b-0a1a-46b4-9a03-788af481d3ca HTTP/1.1 Sep 23 04:47:50.063079 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:47:50.063079 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:47:50.063079 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:47:50.063079 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:47:50.063079 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:47:50.063079 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:47:50.063079 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:47:50.063079 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:47:50.063079 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTlvfdi4o0Y9mCUPokn0jIn66E_gYHfswvNUJk0oWKgUgT2bckyK_dFOK9sSyNanN_-OMIsJrgn2yiYsVsn4YI8ZjfIXbzODmcN_TY4KwEWe3dvDtDeCaJf-hXkJqT27YTJIsS4J-e2mLxKFLMD_hT3yOT9NVPofkih-81ZETnZH6pk Sep 23 04:47:50.063079 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:47:50.063079 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:47:50.063079 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:47:50.063079 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:47:50.063079 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:47:50.063079 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:47:50.063079 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 7c43f2b70bc74a48b62fb4115337f073 Sep 23 04:47:50.063079 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ImagesTestJSON-1079639924 Sep 23 04:47:50.063079 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:47:50.063079 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:47:50.063079 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7c43f2b70bc74a48b62fb4115337f073", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7c43f2b70bc74a48b62fb4115337f073"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7c43f2b70bc74a48b62fb4115337f073"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7c43f2b70bc74a48b62fb4115337f073"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:47:50.063079 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ImagesTestJSON-1079639924 Sep 23 04:47:50.063079 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 7c43f2b70bc74a48b62fb4115337f073 Sep 23 04:47:50.063079 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ImagesTestJSON-1079639924 Sep 23 04:47:50.063079 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ImagesTestJSON-1079639924-project Sep 23 04:47:50.063079 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:47:50.063079 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:47:50.063079 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: c11980041918484990dac709544d0b42 Sep 23 04:47:50.063079 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ImagesTestJSON-1079639924-project Sep 23 04:47:50.063079 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:47:50.063079 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 188a699b-0a1a-46b4-9a03-788af481d3ca could not be found. Sep 23 04:47:50.063079 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '188a699b-0a1a-46b4-9a03-788af481d3ca'} Sep 23 04:47:50.063079 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:47:50.063079 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:50.063079 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:47:50.063079 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:47:50.063079 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:47:50.063079 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:47:50.063079 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:47:50.063079 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:47:50.063079 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:47:50.063079 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:47:50.063079 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 188a699b-0a1a-46b4-9a03-788af481d3ca could not be found. Sep 23 04:47:50.063079 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:47:50.063079 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:47:50.063079 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:47:50.063079 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:50.063079 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:47:50.063079 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:47:50.063079 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:47:50.063079 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:47:50.063079 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:47:50.063079 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:47:50.063079 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:47:50.063079 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:47:50.063079 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:47:50.063079 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:47:50.063079 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:47:50.063079 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:47:50.063079 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 188a699b-0a1a-46b4-9a03-788af481d3ca could not be found. Sep 23 04:47:50.063079 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:47:50.063079 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:47:50.063079 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:47:50.063079 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:50.074857 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:47:50.074857 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:47:50.074857 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:47:50.074857 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:47:50.074857 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 188a699b-0a1a-46b4-9a03-788af481d3ca could not be found. Sep 23 04:47:50.074857 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:47:50.074857 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7f05dc34-c946-4bd3-b459-2fa0e660d8dc tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Returning 404 to user: Instance 188a699b-0a1a-46b4-9a03-788af481d3ca could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:47:50.074857 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-7f05dc34-c946-4bd3-b459-2fa0e660d8dc tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/servers/188a699b-0a1a-46b4-9a03-788af481d3ca" status: 404 len: 111 microversion: 2.1 time: 0.069512 Sep 23 04:47:50.074857 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1916/3777] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:49 2022] GET /compute/v2.1/servers/188a699b-0a1a-46b4-9a03-788af481d3ca => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:47:50.081386 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-dd5341cd-a5a3-4168-bd6d-fa86d94bd80c tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '.version_select at 0x7ff1ba9f6dc0>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:50.081658 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-85ab7ead-5c12-4a37-97b6-97720275e74e tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.226156 Sep 23 04:47:50.082498 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1862/3778] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:47:48 2022] POST /compute/v2.1/servers => generated 383 bytes in 1228 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:47:50.125020 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-62fe860d-8fe8-4018-8fc9-a53b84f04ad4 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:50.125020 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-62fe860d-8fe8-4018-8fc9-a53b84f04ad4 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] [instance: 6b1aa3ac-6bda-48be-8814-e1a5ddd510a2] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:50.126145 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-dd5341cd-a5a3-4168-bd6d-fa86d94bd80c tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] HTTP exception thrown: Image not found. Sep 23 04:47:50.128417 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-dd5341cd-a5a3-4168-bd6d-fa86d94bd80c tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Request method failure captured: Sep 23 04:47:50.128417 n-d-846463-3 devstack@n-api.service[122699]: request: DELETE /compute/v2.1/images/e161c9e7-af1d-4409-9a40-1f3f8885ed79 HTTP/1.1 Sep 23 04:47:50.128417 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:47:50.128417 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:47:50.128417 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:47:50.128417 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:47:50.128417 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:47:50.128417 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:47:50.128417 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:47:50.128417 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:47:50.128417 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTlvfdi4o0Y9mCUPokn0jIn66E_gYHfswvNUJk0oWKgUgT2bckyK_dFOK9sSyNanN_-OMIsJrgn2yiYsVsn4YI8ZjfIXbzODmcN_TY4KwEWe3dvDtDeCaJf-hXkJqT27YTJIsS4J-e2mLxKFLMD_hT3yOT9NVPofkih-81ZETnZH6pk Sep 23 04:47:50.128417 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:47:50.128417 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:47:50.128417 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:47:50.128417 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:47:50.128417 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:47:50.128417 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:47:50.128417 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 7c43f2b70bc74a48b62fb4115337f073 Sep 23 04:47:50.128417 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ImagesTestJSON-1079639924 Sep 23 04:47:50.128417 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:47:50.128417 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:47:50.128417 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7c43f2b70bc74a48b62fb4115337f073", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7c43f2b70bc74a48b62fb4115337f073"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7c43f2b70bc74a48b62fb4115337f073"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7c43f2b70bc74a48b62fb4115337f073"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:47:50.128417 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ImagesTestJSON-1079639924 Sep 23 04:47:50.128417 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 7c43f2b70bc74a48b62fb4115337f073 Sep 23 04:47:50.128417 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ImagesTestJSON-1079639924 Sep 23 04:47:50.128417 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ImagesTestJSON-1079639924-project Sep 23 04:47:50.128417 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:47:50.128417 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:47:50.128417 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: c11980041918484990dac709544d0b42 Sep 23 04:47:50.128417 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ImagesTestJSON-1079639924-project Sep 23 04:47:50.128417 n-d-846463-3 devstack@n-api.service[122699]: method: Sep 23 04:47:50.128417 n-d-846463-3 devstack@n-api.service[122699]: exception: Image not found. Sep 23 04:47:50.128417 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': 'e161c9e7-af1d-4409-9a40-1f3f8885ed79'} Sep 23 04:47:50.128417 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:47:50.128417 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:50.128417 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 23 04:47:50.128417 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 23 04:47:50.128417 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 23 04:47:50.128417 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 23 04:47:50.128417 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 23 04:47:50.128417 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 23 04:47:50.128417 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 23 04:47:50.128417 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 23 04:47:50.128417 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 23 04:47:50.128417 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 23 04:47:50.128417 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 23 04:47:50.128417 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 23 04:47:50.128417 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 23 04:47:50.128417 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 23 04:47:50.128417 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image e161c9e7-af1d-4409-9a40-1f3f8885ed79 to delete Sep 23 04:47:50.128417 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:47:50.128417 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:47:50.128417 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:47:50.128417 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:50.128417 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 23 04:47:50.128417 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 23 04:47:50.128417 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 23 04:47:50.128417 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 23 04:47:50.128417 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 23 04:47:50.128417 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 23 04:47:50.128417 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e161c9e7-af1d-4409-9a40-1f3f8885ed79 could not be found. Sep 23 04:47:50.128417 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:47:50.128417 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:47:50.128417 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:47:50.128417 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:50.134200 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:47:50.134200 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:47:50.134200 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:47:50.134200 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:47:50.134200 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:47:50.134200 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:47:50.134200 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:47:50.134200 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:47:50.134200 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 23 04:47:50.134200 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 23 04:47:50.134200 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 23 04:47:50.134200 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:47:50.134200 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:47:50.134200 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:47:50.134200 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:50.134200 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:47:50.134200 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:47:50.134200 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:47:50.134200 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:47:50.134200 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 23 04:47:50.134200 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:47:50.138140 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-dd5341cd-a5a3-4168-bd6d-fa86d94bd80c tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Returning 404 to user: Image not found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:47:50.139206 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-dd5341cd-a5a3-4168-bd6d-fa86d94bd80c tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "DELETE /compute/v2.1/images/e161c9e7-af1d-4409-9a40-1f3f8885ed79" status: 404 len: 62 microversion: 2.1 time: 0.062625 Sep 23 04:47:50.140028 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1917/3779] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:50 2022] DELETE /compute/v2.1/images/e161c9e7-af1d-4409-9a40-1f3f8885ed79 => generated 62 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 23 04:47:50.151542 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-83913c2f-0640-4d44-be27-294651cee01c tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:50.152497 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-83913c2f-0640-4d44-be27-294651cee01c tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] [instance: 2cea388e-a568-48be-9f76-b673509a7824] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:50.161566 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-83913c2f-0640-4d44-be27-294651cee01c tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:50.162435 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-83913c2f-0640-4d44-be27-294651cee01c tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:50.163207 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-83913c2f-0640-4d44-be27-294651cee01c tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:50.164353 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-83913c2f-0640-4d44-be27-294651cee01c tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:50.166560 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-83913c2f-0640-4d44-be27-294651cee01c tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:50.167275 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-83913c2f-0640-4d44-be27-294651cee01c tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:50.183549 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-83913c2f-0640-4d44-be27-294651cee01c tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] HTTP exception thrown: Instance 2cea388e-a568-48be-9f76-b673509a7824 could not be found. Sep 23 04:47:50.185615 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-83913c2f-0640-4d44-be27-294651cee01c tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Request method failure captured: Sep 23 04:47:50.185615 n-d-846463-3 devstack@n-api.service[122699]: request: DELETE /compute/v2.1/servers/2cea388e-a568-48be-9f76-b673509a7824 HTTP/1.1 Sep 23 04:47:50.185615 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:47:50.185615 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:47:50.185615 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:47:50.185615 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:47:50.185615 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:47:50.185615 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:47:50.185615 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:47:50.185615 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:47:50.185615 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTlvfdi4o0Y9mCUPokn0jIn66E_gYHfswvNUJk0oWKgUgT2bckyK_dFOK9sSyNanN_-OMIsJrgn2yiYsVsn4YI8ZjfIXbzODmcN_TY4KwEWe3dvDtDeCaJf-hXkJqT27YTJIsS4J-e2mLxKFLMD_hT3yOT9NVPofkih-81ZETnZH6pk Sep 23 04:47:50.185615 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:47:50.185615 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:47:50.185615 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:47:50.185615 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:47:50.185615 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:47:50.185615 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:47:50.185615 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 7c43f2b70bc74a48b62fb4115337f073 Sep 23 04:47:50.185615 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ImagesTestJSON-1079639924 Sep 23 04:47:50.185615 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:47:50.185615 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:47:50.185615 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7c43f2b70bc74a48b62fb4115337f073", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7c43f2b70bc74a48b62fb4115337f073"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7c43f2b70bc74a48b62fb4115337f073"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7c43f2b70bc74a48b62fb4115337f073"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:47:50.185615 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ImagesTestJSON-1079639924 Sep 23 04:47:50.185615 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 7c43f2b70bc74a48b62fb4115337f073 Sep 23 04:47:50.185615 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ImagesTestJSON-1079639924 Sep 23 04:47:50.185615 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ImagesTestJSON-1079639924-project Sep 23 04:47:50.185615 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:47:50.185615 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:47:50.185615 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: c11980041918484990dac709544d0b42 Sep 23 04:47:50.185615 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ImagesTestJSON-1079639924-project Sep 23 04:47:50.185615 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:47:50.185615 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 2cea388e-a568-48be-9f76-b673509a7824 could not be found. Sep 23 04:47:50.185615 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '2cea388e-a568-48be-9f76-b673509a7824'} Sep 23 04:47:50.185615 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:47:50.185615 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:50.185615 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:47:50.185615 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:47:50.185615 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:47:50.185615 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:47:50.185615 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:47:50.185615 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:47:50.185615 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:47:50.185615 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:47:50.185615 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2cea388e-a568-48be-9f76-b673509a7824 could not be found. Sep 23 04:47:50.185615 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:47:50.185615 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:47:50.185615 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:47:50.185615 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:50.185615 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:47:50.185615 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:47:50.185615 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:47:50.185615 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:47:50.185615 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:47:50.185615 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:47:50.185615 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 04:47:50.185615 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 04:47:50.185615 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 04:47:50.185615 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 04:47:50.185615 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:47:50.185615 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:47:50.185615 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:47:50.185615 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:47:50.185615 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2cea388e-a568-48be-9f76-b673509a7824 could not be found. Sep 23 04:47:50.191286 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:47:50.191286 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:47:50.191286 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:47:50.191286 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:50.191286 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:47:50.191286 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:47:50.191286 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:47:50.191286 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:47:50.191286 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2cea388e-a568-48be-9f76-b673509a7824 could not be found. Sep 23 04:47:50.191286 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:47:50.194126 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-83913c2f-0640-4d44-be27-294651cee01c tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Returning 404 to user: Instance 2cea388e-a568-48be-9f76-b673509a7824 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:47:50.195314 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-83913c2f-0640-4d44-be27-294651cee01c tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "DELETE /compute/v2.1/servers/2cea388e-a568-48be-9f76-b673509a7824" status: 404 len: 111 microversion: 2.1 time: 0.050204 Sep 23 04:47:50.196525 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1918/3780] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:47:50 2022] DELETE /compute/v2.1/servers/2cea388e-a568-48be-9f76-b673509a7824 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:47:50.218842 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-12e88adb-879c-4336-aee5-8e46a497021f tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:50.218842 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-12e88adb-879c-4336-aee5-8e46a497021f tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: c4464422-9bf1-4aaa-806c-d7063e284579] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:50.229385 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-12e88adb-879c-4336-aee5-8e46a497021f tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:50.230947 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-12e88adb-879c-4336-aee5-8e46a497021f tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:50.231480 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-12e88adb-879c-4336-aee5-8e46a497021f tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:50.232317 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-12e88adb-879c-4336-aee5-8e46a497021f tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:50.232866 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-12e88adb-879c-4336-aee5-8e46a497021f tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:50.233378 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-12e88adb-879c-4336-aee5-8e46a497021f tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:50.318421 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-62fe860d-8fe8-4018-8fc9-a53b84f04ad4 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a245dd82de1340f7a58873de1851c61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d02cb07a2a404c8d89aa13a950806d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:50.328456 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-62fe860d-8fe8-4018-8fc9-a53b84f04ad4 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] 10.222.0.33 "GET /compute/v2.1/servers/6b1aa3ac-6bda-48be-8814-e1a5ddd510a2" status: 200 len: 1223 microversion: 2.1 time: 0.224544 Sep 23 04:47:50.330728 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1863/3781] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:50 2022] GET /compute/v2.1/servers/6b1aa3ac-6bda-48be-8814-e1a5ddd510a2 => generated 1223 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:50.339806 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5f1c172f-457c-4926-b983-42d17efebd4f tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:50.339806 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5f1c172f-457c-4926-b983-42d17efebd4f tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] [instance: 2cea388e-a568-48be-9f76-b673509a7824] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:50.349139 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5f1c172f-457c-4926-b983-42d17efebd4f tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:50.350157 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5f1c172f-457c-4926-b983-42d17efebd4f tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:50.351109 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5f1c172f-457c-4926-b983-42d17efebd4f tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:50.352111 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5f1c172f-457c-4926-b983-42d17efebd4f tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:50.356622 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5f1c172f-457c-4926-b983-42d17efebd4f tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:50.357788 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5f1c172f-457c-4926-b983-42d17efebd4f tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:50.386660 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-5f1c172f-457c-4926-b983-42d17efebd4f tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] HTTP exception thrown: Instance 2cea388e-a568-48be-9f76-b673509a7824 could not be found. Sep 23 04:47:50.388447 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5f1c172f-457c-4926-b983-42d17efebd4f tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Request method failure captured: Sep 23 04:47:50.388447 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/2cea388e-a568-48be-9f76-b673509a7824 HTTP/1.1 Sep 23 04:47:50.388447 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:47:50.388447 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:47:50.388447 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:47:50.388447 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:47:50.388447 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:47:50.388447 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:47:50.388447 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:47:50.388447 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:47:50.388447 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTlvfdi4o0Y9mCUPokn0jIn66E_gYHfswvNUJk0oWKgUgT2bckyK_dFOK9sSyNanN_-OMIsJrgn2yiYsVsn4YI8ZjfIXbzODmcN_TY4KwEWe3dvDtDeCaJf-hXkJqT27YTJIsS4J-e2mLxKFLMD_hT3yOT9NVPofkih-81ZETnZH6pk Sep 23 04:47:50.388447 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:47:50.388447 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:47:50.388447 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:47:50.388447 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:47:50.388447 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:47:50.388447 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:47:50.388447 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 7c43f2b70bc74a48b62fb4115337f073 Sep 23 04:47:50.388447 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ImagesTestJSON-1079639924 Sep 23 04:47:50.388447 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:47:50.388447 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:47:50.388447 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7c43f2b70bc74a48b62fb4115337f073", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7c43f2b70bc74a48b62fb4115337f073"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7c43f2b70bc74a48b62fb4115337f073"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7c43f2b70bc74a48b62fb4115337f073"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:47:50.388447 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ImagesTestJSON-1079639924 Sep 23 04:47:50.388447 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 7c43f2b70bc74a48b62fb4115337f073 Sep 23 04:47:50.388447 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ImagesTestJSON-1079639924 Sep 23 04:47:50.388447 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ImagesTestJSON-1079639924-project Sep 23 04:47:50.388447 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:47:50.388447 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:47:50.388447 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: c11980041918484990dac709544d0b42 Sep 23 04:47:50.388447 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ImagesTestJSON-1079639924-project Sep 23 04:47:50.388447 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:47:50.388447 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 2cea388e-a568-48be-9f76-b673509a7824 could not be found. Sep 23 04:47:50.388447 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '2cea388e-a568-48be-9f76-b673509a7824'} Sep 23 04:47:50.388447 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:47:50.388447 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:50.388447 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:47:50.388447 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:47:50.388447 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:47:50.388447 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:47:50.388447 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:47:50.388447 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:47:50.388447 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:47:50.388447 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:47:50.388447 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2cea388e-a568-48be-9f76-b673509a7824 could not be found. Sep 23 04:47:50.388447 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:47:50.388447 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:47:50.388447 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:47:50.388447 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:50.388447 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:47:50.388447 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:47:50.388447 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:47:50.388447 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:47:50.388447 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:47:50.388447 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:47:50.388447 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:47:50.388447 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:47:50.388447 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:47:50.388447 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:47:50.388447 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:47:50.388447 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:47:50.388447 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2cea388e-a568-48be-9f76-b673509a7824 could not be found. Sep 23 04:47:50.388447 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:47:50.388447 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:47:50.388447 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:47:50.388447 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:47:50.395149 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:47:50.395149 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:47:50.395149 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:47:50.395149 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:47:50.395149 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2cea388e-a568-48be-9f76-b673509a7824 could not be found. Sep 23 04:47:50.395149 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:47:50.395149 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5f1c172f-457c-4926-b983-42d17efebd4f tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] Returning 404 to user: Instance 2cea388e-a568-48be-9f76-b673509a7824 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:47:50.399065 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5f1c172f-457c-4926-b983-42d17efebd4f tempest-ImagesTestJSON-1079639924 tempest-ImagesTestJSON-1079639924-project] 10.222.0.33 "GET /compute/v2.1/servers/2cea388e-a568-48be-9f76-b673509a7824" status: 404 len: 111 microversion: 2.1 time: 0.067040 Sep 23 04:47:50.400138 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1864/3782] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:50 2022] GET /compute/v2.1/servers/2cea388e-a568-48be-9f76-b673509a7824 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:47:50.404308 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-12e88adb-879c-4336-aee5-8e46a497021f tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c786bbedc21849ea92924139a44707b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcafb05f6f554e278cd552023947c6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:50.414334 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-12e88adb-879c-4336-aee5-8e46a497021f tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579" status: 200 len: 1298 microversion: 2.1 time: 0.211799 Sep 23 04:47:50.415690 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1919/3783] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:50 2022] GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579 => generated 1298 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:47:50.851380 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d6cb5bba-3579-4573-983d-83b3ab4e852b tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '.version_select at 0x7ff1ba9ad0d0>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:50.955238 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d6cb5bba-3579-4573-983d-83b3ab4e852b tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "GET /compute/v2.1/images/ebfd24d2-4412-4ba6-8024-99147eab6142" status: 200 len: 1455 microversion: 2.1 time: 0.107868 Sep 23 04:47:50.956700 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1865/3784] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:47:50 2022] GET /compute/v2.1/images/ebfd24d2-4412-4ba6-8024-99147eab6142 => generated 1455 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:51.360286 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e98ca1b4-67e1-466c-8628-6ad7351a118d tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:51.360731 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e98ca1b4-67e1-466c-8628-6ad7351a118d tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] [instance: 6b1aa3ac-6bda-48be-8814-e1a5ddd510a2] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:51.440874 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d2c8d6bf-1222-4df8-93ee-1d8809c13c03 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:51.441504 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d2c8d6bf-1222-4df8-93ee-1d8809c13c03 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: c4464422-9bf1-4aaa-806c-d7063e284579] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:51.472583 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d2c8d6bf-1222-4df8-93ee-1d8809c13c03 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:51.476165 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d2c8d6bf-1222-4df8-93ee-1d8809c13c03 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:51.476165 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d2c8d6bf-1222-4df8-93ee-1d8809c13c03 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:51.476768 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d2c8d6bf-1222-4df8-93ee-1d8809c13c03 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:51.479962 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d2c8d6bf-1222-4df8-93ee-1d8809c13c03 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:51.481954 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d2c8d6bf-1222-4df8-93ee-1d8809c13c03 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:51.642303 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e98ca1b4-67e1-466c-8628-6ad7351a118d tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a245dd82de1340f7a58873de1851c61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d02cb07a2a404c8d89aa13a950806d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:51.653692 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e98ca1b4-67e1-466c-8628-6ad7351a118d tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] 10.222.0.33 "GET /compute/v2.1/servers/6b1aa3ac-6bda-48be-8814-e1a5ddd510a2" status: 200 len: 1223 microversion: 2.1 time: 0.299447 Sep 23 04:47:51.653692 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1920/3785] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:51 2022] GET /compute/v2.1/servers/6b1aa3ac-6bda-48be-8814-e1a5ddd510a2 => generated 1223 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:51.702269 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d2c8d6bf-1222-4df8-93ee-1d8809c13c03 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c786bbedc21849ea92924139a44707b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcafb05f6f554e278cd552023947c6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:51.711802 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d2c8d6bf-1222-4df8-93ee-1d8809c13c03 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579" status: 200 len: 1316 microversion: 2.1 time: 0.276901 Sep 23 04:47:51.718574 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1866/3786] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:51 2022] GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579 => generated 1316 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:51.972051 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-df7ef3f3-a9a2-4423-822d-bc1cb5a985dd tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '.version_select at 0x7ff1ba9f6160>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:52.048790 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-df7ef3f3-a9a2-4423-822d-bc1cb5a985dd tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "GET /compute/v2.1/images/ebfd24d2-4412-4ba6-8024-99147eab6142" status: 200 len: 1455 microversion: 2.1 time: 0.080141 Sep 23 04:47:52.051985 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1921/3787] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:47:51 2022] GET /compute/v2.1/images/ebfd24d2-4412-4ba6-8024-99147eab6142 => generated 1455 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:52.684761 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6fdc5c92-fe01-407d-ac5c-6875347facfa tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:52.686155 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-6fdc5c92-fe01-407d-ac5c-6875347facfa tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] [instance: 6b1aa3ac-6bda-48be-8814-e1a5ddd510a2] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:52.689542 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:47:52.703327 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6fdc5c92-fe01-407d-ac5c-6875347facfa tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:52.705596 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6fdc5c92-fe01-407d-ac5c-6875347facfa tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:52.706602 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6fdc5c92-fe01-407d-ac5c-6875347facfa tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:52.708479 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6fdc5c92-fe01-407d-ac5c-6875347facfa tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:52.709479 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6fdc5c92-fe01-407d-ac5c-6875347facfa tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:52.712284 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6fdc5c92-fe01-407d-ac5c-6875347facfa tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:52.752527 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1ff077e4-cb65-44c6-8b55-3fd97c2a2ea8 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:52.752527 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1ff077e4-cb65-44c6-8b55-3fd97c2a2ea8 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: c4464422-9bf1-4aaa-806c-d7063e284579] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:52.781368 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1ff077e4-cb65-44c6-8b55-3fd97c2a2ea8 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:52.782951 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1ff077e4-cb65-44c6-8b55-3fd97c2a2ea8 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:52.792542 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1ff077e4-cb65-44c6-8b55-3fd97c2a2ea8 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:52.792542 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1ff077e4-cb65-44c6-8b55-3fd97c2a2ea8 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:52.792542 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1ff077e4-cb65-44c6-8b55-3fd97c2a2ea8 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:52.792542 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1ff077e4-cb65-44c6-8b55-3fd97c2a2ea8 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:53.076374 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1ff077e4-cb65-44c6-8b55-3fd97c2a2ea8 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c786bbedc21849ea92924139a44707b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcafb05f6f554e278cd552023947c6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:53.085465 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1ff077e4-cb65-44c6-8b55-3fd97c2a2ea8 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579" status: 200 len: 1304 microversion: 2.1 time: 0.341917 Sep 23 04:47:53.086104 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1922/3788] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:52 2022] GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579 => generated 1304 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:53.099661 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6fdc5c92-fe01-407d-ac5c-6875347facfa tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a245dd82de1340f7a58873de1851c61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d02cb07a2a404c8d89aa13a950806d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:53.115113 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6be5cfb8-cbb5-4280-9cc1-19c474e15e79 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '.version_select at 0x7ff1ba995670>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:53.117312 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-6fdc5c92-fe01-407d-ac5c-6875347facfa tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] 10.222.0.33 "GET /compute/v2.1/servers/6b1aa3ac-6bda-48be-8814-e1a5ddd510a2" status: 200 len: 1275 microversion: 2.1 time: 0.444249 Sep 23 04:47:53.122403 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1867/3789] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:52 2022] GET /compute/v2.1/servers/6b1aa3ac-6bda-48be-8814-e1a5ddd510a2 => generated 1275 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:53.175549 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6be5cfb8-cbb5-4280-9cc1-19c474e15e79 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "GET /compute/v2.1/images/ebfd24d2-4412-4ba6-8024-99147eab6142" status: 200 len: 1455 microversion: 2.1 time: 0.083761 Sep 23 04:47:53.176383 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1923/3790] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:47:53 2022] GET /compute/v2.1/images/ebfd24d2-4412-4ba6-8024-99147eab6142 => generated 1455 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:54.115606 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-42656833-91a3-4a90-a086-e2497363aa45 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:54.116804 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-42656833-91a3-4a90-a086-e2497363aa45 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: c4464422-9bf1-4aaa-806c-d7063e284579] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:54.125192 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-42656833-91a3-4a90-a086-e2497363aa45 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:54.125701 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-42656833-91a3-4a90-a086-e2497363aa45 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:54.126186 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-42656833-91a3-4a90-a086-e2497363aa45 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:54.126915 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-42656833-91a3-4a90-a086-e2497363aa45 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:54.127370 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-42656833-91a3-4a90-a086-e2497363aa45 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:54.127807 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-42656833-91a3-4a90-a086-e2497363aa45 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:54.156420 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1261810c-dc0d-4948-a133-9e34da3b93d5 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:54.158345 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1261810c-dc0d-4948-a133-9e34da3b93d5 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] [instance: 6b1aa3ac-6bda-48be-8814-e1a5ddd510a2] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:54.167645 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1261810c-dc0d-4948-a133-9e34da3b93d5 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:54.168454 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1261810c-dc0d-4948-a133-9e34da3b93d5 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:54.170179 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1261810c-dc0d-4948-a133-9e34da3b93d5 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:54.171130 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1261810c-dc0d-4948-a133-9e34da3b93d5 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:54.171806 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1261810c-dc0d-4948-a133-9e34da3b93d5 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:54.173094 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1261810c-dc0d-4948-a133-9e34da3b93d5 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:54.240150 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-42656833-91a3-4a90-a086-e2497363aa45 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c786bbedc21849ea92924139a44707b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcafb05f6f554e278cd552023947c6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:54.256537 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-42656833-91a3-4a90-a086-e2497363aa45 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579" status: 200 len: 1304 microversion: 2.1 time: 0.145782 Sep 23 04:47:54.257399 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1868/3791] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:54 2022] GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579 => generated 1304 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:54.264732 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9b5b44da-32b3-4605-a6c9-9dd0eabd5a06 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '.version_select at 0x7ff1ba9aa3a0>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:54.305100 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1261810c-dc0d-4948-a133-9e34da3b93d5 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a245dd82de1340f7a58873de1851c61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d02cb07a2a404c8d89aa13a950806d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:54.317735 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1261810c-dc0d-4948-a133-9e34da3b93d5 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] 10.222.0.33 "GET /compute/v2.1/servers/6b1aa3ac-6bda-48be-8814-e1a5ddd510a2" status: 200 len: 1283 microversion: 2.1 time: 0.172230 Sep 23 04:47:54.349674 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1924/3792] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:54 2022] GET /compute/v2.1/servers/6b1aa3ac-6bda-48be-8814-e1a5ddd510a2 => generated 1283 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:54.380018 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9b5b44da-32b3-4605-a6c9-9dd0eabd5a06 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "GET /compute/v2.1/images/ebfd24d2-4412-4ba6-8024-99147eab6142" status: 200 len: 1455 microversion: 2.1 time: 0.120079 Sep 23 04:47:54.380650 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1869/3793] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:47:54 2022] GET /compute/v2.1/images/ebfd24d2-4412-4ba6-8024-99147eab6142 => generated 1455 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:55.284412 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a7df7999-b4e1-4e9c-ac3e-94a496801dc6 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:55.285150 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a7df7999-b4e1-4e9c-ac3e-94a496801dc6 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: c4464422-9bf1-4aaa-806c-d7063e284579] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:55.299381 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a7df7999-b4e1-4e9c-ac3e-94a496801dc6 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:55.301123 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a7df7999-b4e1-4e9c-ac3e-94a496801dc6 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:55.301597 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a7df7999-b4e1-4e9c-ac3e-94a496801dc6 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:55.305300 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a7df7999-b4e1-4e9c-ac3e-94a496801dc6 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:55.309959 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a7df7999-b4e1-4e9c-ac3e-94a496801dc6 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:55.310553 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a7df7999-b4e1-4e9c-ac3e-94a496801dc6 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:55.374582 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-237ba927-2d87-4de4-a985-987c3c70dd07 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:55.379759 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-237ba927-2d87-4de4-a985-987c3c70dd07 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] [instance: 6b1aa3ac-6bda-48be-8814-e1a5ddd510a2] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:55.412875 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-237ba927-2d87-4de4-a985-987c3c70dd07 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:55.434061 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-237ba927-2d87-4de4-a985-987c3c70dd07 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:55.434817 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-237ba927-2d87-4de4-a985-987c3c70dd07 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:55.440307 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-237ba927-2d87-4de4-a985-987c3c70dd07 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:55.443194 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-237ba927-2d87-4de4-a985-987c3c70dd07 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:55.444817 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-237ba927-2d87-4de4-a985-987c3c70dd07 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:55.644657 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-237ba927-2d87-4de4-a985-987c3c70dd07 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a245dd82de1340f7a58873de1851c61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d02cb07a2a404c8d89aa13a950806d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:55.662834 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-237ba927-2d87-4de4-a985-987c3c70dd07 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] 10.222.0.33 "GET /compute/v2.1/servers/6b1aa3ac-6bda-48be-8814-e1a5ddd510a2" status: 200 len: 1281 microversion: 2.1 time: 0.294196 Sep 23 04:47:55.675617 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1870/3794] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:55 2022] GET /compute/v2.1/servers/6b1aa3ac-6bda-48be-8814-e1a5ddd510a2 => generated 1281 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:55.689846 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f604c6f5-14cb-4f8c-a19a-4f6b6c96b6f9 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '.version_select at 0x7ff1ba99df70>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:55.759202 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f604c6f5-14cb-4f8c-a19a-4f6b6c96b6f9 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "GET /compute/v2.1/images/ebfd24d2-4412-4ba6-8024-99147eab6142" status: 200 len: 1455 microversion: 2.1 time: 0.074230 Sep 23 04:47:55.762023 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1871/3795] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:47:55 2022] GET /compute/v2.1/images/ebfd24d2-4412-4ba6-8024-99147eab6142 => generated 1455 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:55.784588 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a7df7999-b4e1-4e9c-ac3e-94a496801dc6 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c786bbedc21849ea92924139a44707b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcafb05f6f554e278cd552023947c6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:55.793550 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a7df7999-b4e1-4e9c-ac3e-94a496801dc6 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579" status: 200 len: 1371 microversion: 2.1 time: 0.513309 Sep 23 04:47:55.796539 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1925/3796] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:55 2022] GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579 => generated 1371 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:56.702215 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-06eee5d9-9286-4fbd-8067-6374e6ba5c43 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:56.702909 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-06eee5d9-9286-4fbd-8067-6374e6ba5c43 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] [instance: 6b1aa3ac-6bda-48be-8814-e1a5ddd510a2] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:56.718566 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-06eee5d9-9286-4fbd-8067-6374e6ba5c43 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:56.719220 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-06eee5d9-9286-4fbd-8067-6374e6ba5c43 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:56.719525 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-06eee5d9-9286-4fbd-8067-6374e6ba5c43 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:56.720251 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-06eee5d9-9286-4fbd-8067-6374e6ba5c43 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:56.720707 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-06eee5d9-9286-4fbd-8067-6374e6ba5c43 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:56.721145 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-06eee5d9-9286-4fbd-8067-6374e6ba5c43 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:56.776140 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c920871c-f2b7-4e13-9895-297788bb2ffe tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '.version_select at 0x7ff1bb875b80>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:56.879966 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c920871c-f2b7-4e13-9895-297788bb2ffe tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "GET /compute/v2.1/images/ebfd24d2-4412-4ba6-8024-99147eab6142" status: 200 len: 1464 microversion: 2.1 time: 0.108165 Sep 23 04:47:56.880643 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1926/3797] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:47:56 2022] GET /compute/v2.1/images/ebfd24d2-4412-4ba6-8024-99147eab6142 => generated 1464 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:56.901819 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0e8a6aaa-2268-4fcd-a336-69ee0d3b571a tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:56.903568 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-0e8a6aaa-2268-4fcd-a336-69ee0d3b571a tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: c4464422-9bf1-4aaa-806c-d7063e284579] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:56.923138 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0e8a6aaa-2268-4fcd-a336-69ee0d3b571a tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:56.928515 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0e8a6aaa-2268-4fcd-a336-69ee0d3b571a tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:56.928515 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0e8a6aaa-2268-4fcd-a336-69ee0d3b571a tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:56.928515 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0e8a6aaa-2268-4fcd-a336-69ee0d3b571a tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:56.930575 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0e8a6aaa-2268-4fcd-a336-69ee0d3b571a tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:56.931171 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0e8a6aaa-2268-4fcd-a336-69ee0d3b571a tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:57.334303 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-06eee5d9-9286-4fbd-8067-6374e6ba5c43 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a245dd82de1340f7a58873de1851c61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d02cb07a2a404c8d89aa13a950806d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:57.343643 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-06eee5d9-9286-4fbd-8067-6374e6ba5c43 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] 10.222.0.33 "GET /compute/v2.1/servers/6b1aa3ac-6bda-48be-8814-e1a5ddd510a2" status: 200 len: 1323 microversion: 2.1 time: 0.652228 Sep 23 04:47:57.359171 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1872/3798] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:56 2022] GET /compute/v2.1/servers/6b1aa3ac-6bda-48be-8814-e1a5ddd510a2 => generated 1323 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:57.375519 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3f0360f9-4e5b-4af7-b044-2a7aa2c23882 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '.version_select at 0x7ff1ba89b670>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:57.478781 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3f0360f9-4e5b-4af7-b044-2a7aa2c23882 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "GET /compute/v2.1/images/ebfd24d2-4412-4ba6-8024-99147eab6142" status: 200 len: 1464 microversion: 2.1 time: 0.107867 Sep 23 04:47:57.478781 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1873/3799] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:47:57 2022] GET /compute/v2.1/images/ebfd24d2-4412-4ba6-8024-99147eab6142 => generated 1464 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:57.500742 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-0e8a6aaa-2268-4fcd-a336-69ee0d3b571a tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c786bbedc21849ea92924139a44707b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcafb05f6f554e278cd552023947c6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:57.516404 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0e8a6aaa-2268-4fcd-a336-69ee0d3b571a tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579" status: 200 len: 1371 microversion: 2.1 time: 0.630706 Sep 23 04:47:57.516968 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1927/3800] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:56 2022] GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579 => generated 1371 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:57.526014 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c7632ca0-d21a-4b50-8b0b-7fac2fc4abb5 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:57.526642 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c7632ca0-d21a-4b50-8b0b-7fac2fc4abb5 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] [instance: a0eac077-d4bd-4e4a-a04a-3f86aeeed9bd] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:57.547282 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c7632ca0-d21a-4b50-8b0b-7fac2fc4abb5 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:57.547946 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c7632ca0-d21a-4b50-8b0b-7fac2fc4abb5 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:57.548679 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c7632ca0-d21a-4b50-8b0b-7fac2fc4abb5 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:57.549649 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c7632ca0-d21a-4b50-8b0b-7fac2fc4abb5 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:57.550714 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c7632ca0-d21a-4b50-8b0b-7fac2fc4abb5 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:57.552110 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c7632ca0-d21a-4b50-8b0b-7fac2fc4abb5 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:57.742403 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-fffbddb2-382c-4d5a-b01d-6020ac180b63 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-1494727554", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "networks": "none"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:47:57.847622 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-fffbddb2-382c-4d5a-b01d-6020ac180b63 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Flavor limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:47:57.848161 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-fffbddb2-382c-4d5a-b01d-6020ac180b63 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Image limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:47:57.848930 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-fffbddb2-382c-4d5a-b01d-6020ac180b63 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Flavor pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:47:57.849454 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-fffbddb2-382c-4d5a-b01d-6020ac180b63 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Image pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:47:57.850020 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-fffbddb2-382c-4d5a-b01d-6020ac180b63 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:47:57.890543 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fffbddb2-382c-4d5a-b01d-6020ac180b63 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:57.894477 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fffbddb2-382c-4d5a-b01d-6020ac180b63 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:57.895193 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fffbddb2-382c-4d5a-b01d-6020ac180b63 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:57.897029 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fffbddb2-382c-4d5a-b01d-6020ac180b63 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:57.898960 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fffbddb2-382c-4d5a-b01d-6020ac180b63 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:57.899280 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fffbddb2-382c-4d5a-b01d-6020ac180b63 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:57.935111 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-fffbddb2-382c-4d5a-b01d-6020ac180b63 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Getting quotas for project 1e16d72d2469433ca30ba6769e3d3f25. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:47:57.942654 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-fffbddb2-382c-4d5a-b01d-6020ac180b63 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Getting quotas for user ae134fe7522941698cad3f3fa11e747a and project 1e16d72d2469433ca30ba6769e3d3f25. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:47:57.965606 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-fffbddb2-382c-4d5a-b01d-6020ac180b63 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Going to run 1 instances... {{(pid=122698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:47:57.968522 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-fffbddb2-382c-4d5a-b01d-6020ac180b63 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] [instance: 3fc8d6fc-3204-43f4-9b94-100d061769a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:47:57.981692 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c7632ca0-d21a-4b50-8b0b-7fac2fc4abb5 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff662b5d5b9e488d906565b490c8acf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dcca3b014be4e98b7db17bb37d073a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:57.999395 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c7632ca0-d21a-4b50-8b0b-7fac2fc4abb5 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "GET /compute/v2.1/servers/a0eac077-d4bd-4e4a-a04a-3f86aeeed9bd" status: 200 len: 1468 microversion: 2.1 time: 0.477255 Sep 23 04:47:58.000907 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1928/3801] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:57 2022] GET /compute/v2.1/servers/a0eac077-d4bd-4e4a-a04a-3f86aeeed9bd => generated 1468 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:58.026588 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6a2a07f1-5a3a-4aec-8c7e-0921cf212d47 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-350087699"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:47:58.029116 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-6a2a07f1-5a3a-4aec-8c7e-0921cf212d47 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] [instance: 401339a4-8674-4ff9-b09e-ba748f46928d] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:58.036144 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6a2a07f1-5a3a-4aec-8c7e-0921cf212d47 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:58.036764 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6a2a07f1-5a3a-4aec-8c7e-0921cf212d47 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:58.037283 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6a2a07f1-5a3a-4aec-8c7e-0921cf212d47 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:58.038276 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6a2a07f1-5a3a-4aec-8c7e-0921cf212d47 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:58.039040 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6a2a07f1-5a3a-4aec-8c7e-0921cf212d47 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:58.039665 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6a2a07f1-5a3a-4aec-8c7e-0921cf212d47 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:58.086438 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-fffbddb2-382c-4d5a-b01d-6020ac180b63 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.616160 Sep 23 04:47:58.087302 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1874/3802] 10.222.0.33 () {62 vars in 1188 bytes} [Fri Sep 23 04:47:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 618 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 23 04:47:58.099202 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e4f91845-1a69-4102-b98a-0532f93bc1d1 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:58.099715 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e4f91845-1a69-4102-b98a-0532f93bc1d1 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] [instance: 3fc8d6fc-3204-43f4-9b94-100d061769a5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:58.252296 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e4f91845-1a69-4102-b98a-0532f93bc1d1 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae134fe7522941698cad3f3fa11e747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16d72d2469433ca30ba6769e3d3f25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:58.266133 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e4f91845-1a69-4102-b98a-0532f93bc1d1 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae134fe7522941698cad3f3fa11e747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16d72d2469433ca30ba6769e3d3f25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:58.268578 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e4f91845-1a69-4102-b98a-0532f93bc1d1 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae134fe7522941698cad3f3fa11e747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16d72d2469433ca30ba6769e3d3f25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:58.273433 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e4f91845-1a69-4102-b98a-0532f93bc1d1 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] 10.222.0.33 "GET /compute/v2.1/servers/3fc8d6fc-3204-43f4-9b94-100d061769a5" status: 200 len: 1278 microversion: 2.57 time: 0.178535 Sep 23 04:47:58.274946 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1875/3803] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:47:58 2022] GET /compute/v2.1/servers/3fc8d6fc-3204-43f4-9b94-100d061769a5 => generated 1278 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:47:58.292371 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-c832424e-c141-46ee-ab93-349748299185 req-84579e6f-bae4-4bfa-901e-3c281f40f2ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4464422-9bf1-4aaa-806c-d7063e284579", "tag": "1996c9a9-f009-4ec9-a3d8-6f5d1f1f1a46"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:47:58.310218 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-c832424e-c141-46ee-ab93-349748299185 req-84579e6f-bae4-4bfa-901e-3c281f40f2ce service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:58.310718 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-c832424e-c141-46ee-ab93-349748299185 req-84579e6f-bae4-4bfa-901e-3c281f40f2ce service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:58.311148 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-c832424e-c141-46ee-ab93-349748299185 req-84579e6f-bae4-4bfa-901e-3c281f40f2ce service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:58.351538 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-c832424e-c141-46ee-ab93-349748299185 req-84579e6f-bae4-4bfa-901e-3c281f40f2ce service nova] Creating event network-changed:1996c9a9-f009-4ec9-a3d8-6f5d1f1f1a46 for instance c4464422-9bf1-4aaa-806c-d7063e284579 on n-h1-846463-3 Sep 23 04:47:58.363581 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-c832424e-c141-46ee-ab93-349748299185 req-84579e6f-bae4-4bfa-901e-3c281f40f2ce service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086913 Sep 23 04:47:58.364197 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1876/3804] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:47:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:47:58.373777 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-dc0fff2d-8f79-4b22-bc7e-3efc0723138a tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:58.374835 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-dc0fff2d-8f79-4b22-bc7e-3efc0723138a tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] [instance: 6b1aa3ac-6bda-48be-8814-e1a5ddd510a2] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:58.382213 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dc0fff2d-8f79-4b22-bc7e-3efc0723138a tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:58.382680 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dc0fff2d-8f79-4b22-bc7e-3efc0723138a tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:58.383515 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dc0fff2d-8f79-4b22-bc7e-3efc0723138a tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:58.385620 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dc0fff2d-8f79-4b22-bc7e-3efc0723138a tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:58.397512 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dc0fff2d-8f79-4b22-bc7e-3efc0723138a tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:58.397512 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dc0fff2d-8f79-4b22-bc7e-3efc0723138a tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:58.678363 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6a2a07f1-5a3a-4aec-8c7e-0921cf212d47 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "POST /compute/v2.1/servers/401339a4-8674-4ff9-b09e-ba748f46928d/action" status: 202 len: 0 microversion: 2.1 time: 0.657266 Sep 23 04:47:58.686127 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1929/3805] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:47:58 2022] POST /compute/v2.1/servers/401339a4-8674-4ff9-b09e-ba748f46928d/action => generated 0 bytes in 667 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 23 04:47:58.693749 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5a89670b-b26e-49f8-ba64-3fef5d5ef0d6 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:58.696069 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-5a89670b-b26e-49f8-ba64-3fef5d5ef0d6 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: c4464422-9bf1-4aaa-806c-d7063e284579] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:58.705724 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5a89670b-b26e-49f8-ba64-3fef5d5ef0d6 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:58.707113 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5a89670b-b26e-49f8-ba64-3fef5d5ef0d6 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:58.710976 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5a89670b-b26e-49f8-ba64-3fef5d5ef0d6 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:58.710976 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5a89670b-b26e-49f8-ba64-3fef5d5ef0d6 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:58.710976 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5a89670b-b26e-49f8-ba64-3fef5d5ef0d6 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:58.710976 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5a89670b-b26e-49f8-ba64-3fef5d5ef0d6 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:58.898562 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-dc0fff2d-8f79-4b22-bc7e-3efc0723138a tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a245dd82de1340f7a58873de1851c61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d02cb07a2a404c8d89aa13a950806d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:58.915500 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-dc0fff2d-8f79-4b22-bc7e-3efc0723138a tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] 10.222.0.33 "GET /compute/v2.1/servers/6b1aa3ac-6bda-48be-8814-e1a5ddd510a2" status: 200 len: 1323 microversion: 2.1 time: 0.547896 Sep 23 04:47:58.916527 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1877/3806] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:58 2022] GET /compute/v2.1/servers/6b1aa3ac-6bda-48be-8814-e1a5ddd510a2 => generated 1323 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:58.933544 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5449a464-c52b-4e04-b2ed-5e4a0981fd03 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '.version_select at 0x7ff1ba800430>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:59.076136 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5449a464-c52b-4e04-b2ed-5e4a0981fd03 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "GET /compute/v2.1/images/efc8a43b-1faf-4f3e-b1e0-5cb6ebaad7c2" status: 200 len: 1454 microversion: 2.1 time: 0.157830 Sep 23 04:47:59.078899 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1878/3807] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:47:58 2022] GET /compute/v2.1/images/efc8a43b-1faf-4f3e-b1e0-5cb6ebaad7c2 => generated 1454 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:59.139402 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-5a89670b-b26e-49f8-ba64-3fef5d5ef0d6 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c786bbedc21849ea92924139a44707b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcafb05f6f554e278cd552023947c6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:59.155276 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5a89670b-b26e-49f8-ba64-3fef5d5ef0d6 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579" status: 200 len: 1371 microversion: 2.1 time: 0.467403 Sep 23 04:47:59.156794 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1930/3808] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:58 2022] GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579 => generated 1371 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:47:59.306942 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-70c65dd1-f142-4c6e-a9bd-4964ef4ce171 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:59.306942 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-70c65dd1-f142-4c6e-a9bd-4964ef4ce171 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] [instance: 3fc8d6fc-3204-43f4-9b94-100d061769a5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:59.344186 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3480b924-dd2e-4eea-bba1-112f87a9524f tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:59.347395 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-3480b924-dd2e-4eea-bba1-112f87a9524f tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: fe7dee09-8351-4d41-8c44-8d35a966cce9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:59.359167 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3480b924-dd2e-4eea-bba1-112f87a9524f tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:59.365525 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3480b924-dd2e-4eea-bba1-112f87a9524f tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:59.369788 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3480b924-dd2e-4eea-bba1-112f87a9524f tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:59.369788 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3480b924-dd2e-4eea-bba1-112f87a9524f tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:59.369788 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3480b924-dd2e-4eea-bba1-112f87a9524f tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:59.369788 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3480b924-dd2e-4eea-bba1-112f87a9524f tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:59.370829 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-70c65dd1-f142-4c6e-a9bd-4964ef4ce171 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae134fe7522941698cad3f3fa11e747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16d72d2469433ca30ba6769e3d3f25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:59.380746 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-70c65dd1-f142-4c6e-a9bd-4964ef4ce171 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae134fe7522941698cad3f3fa11e747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16d72d2469433ca30ba6769e3d3f25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:59.382869 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-70c65dd1-f142-4c6e-a9bd-4964ef4ce171 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae134fe7522941698cad3f3fa11e747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16d72d2469433ca30ba6769e3d3f25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:47:59.385317 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-70c65dd1-f142-4c6e-a9bd-4964ef4ce171 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] 10.222.0.33 "GET /compute/v2.1/servers/3fc8d6fc-3204-43f4-9b94-100d061769a5" status: 200 len: 1278 microversion: 2.57 time: 0.083711 Sep 23 04:47:59.387369 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1879/3809] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:47:59 2022] GET /compute/v2.1/servers/3fc8d6fc-3204-43f4-9b94-100d061769a5 => generated 1278 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:47:59.446305 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3480b924-dd2e-4eea-bba1-112f87a9524f tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9/ips" status: 200 len: 153 microversion: 2.20 time: 0.092078 Sep 23 04:47:59.446305 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1931/3810] 10.222.0.33 () {60 vars in 1289 bytes} [Fri Sep 23 04:47:59 2022] GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9/ips => generated 153 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 04:47:59.941186 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b507486c-59b4-489b-80f4-9925ac4c5a40 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:47:59.942264 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b507486c-59b4-489b-80f4-9925ac4c5a40 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] [instance: 6b1aa3ac-6bda-48be-8814-e1a5ddd510a2] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:47:59.953611 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b507486c-59b4-489b-80f4-9925ac4c5a40 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:59.954600 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b507486c-59b4-489b-80f4-9925ac4c5a40 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:59.955320 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b507486c-59b4-489b-80f4-9925ac4c5a40 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:47:59.956703 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b507486c-59b4-489b-80f4-9925ac4c5a40 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:47:59.957343 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b507486c-59b4-489b-80f4-9925ac4c5a40 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:47:59.957966 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b507486c-59b4-489b-80f4-9925ac4c5a40 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:00.092785 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b8fd8f01-c21c-4554-804a-b3e904c9358a tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '.version_select at 0x7ff1c03cc430>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:00.175210 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b8fd8f01-c21c-4554-804a-b3e904c9358a tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "GET /compute/v2.1/images/efc8a43b-1faf-4f3e-b1e0-5cb6ebaad7c2" status: 200 len: 1454 microversion: 2.1 time: 0.086199 Sep 23 04:48:00.186002 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1932/3811] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:48:00 2022] GET /compute/v2.1/images/efc8a43b-1faf-4f3e-b1e0-5cb6ebaad7c2 => generated 1454 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:48:00.197213 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-fce7c18b-1327-4691-b979-5f7ce8556ab8 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:00.197213 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-fce7c18b-1327-4691-b979-5f7ce8556ab8 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: c4464422-9bf1-4aaa-806c-d7063e284579] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:00.203710 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fce7c18b-1327-4691-b979-5f7ce8556ab8 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:00.204575 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fce7c18b-1327-4691-b979-5f7ce8556ab8 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:00.205264 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fce7c18b-1327-4691-b979-5f7ce8556ab8 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:00.206325 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fce7c18b-1327-4691-b979-5f7ce8556ab8 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:00.207161 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fce7c18b-1327-4691-b979-5f7ce8556ab8 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:00.207827 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fce7c18b-1327-4691-b979-5f7ce8556ab8 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:00.357472 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b507486c-59b4-489b-80f4-9925ac4c5a40 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a245dd82de1340f7a58873de1851c61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d02cb07a2a404c8d89aa13a950806d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:00.380704 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b507486c-59b4-489b-80f4-9925ac4c5a40 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] 10.222.0.33 "GET /compute/v2.1/servers/6b1aa3ac-6bda-48be-8814-e1a5ddd510a2" status: 200 len: 1323 microversion: 2.1 time: 0.443500 Sep 23 04:48:00.382345 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1880/3812] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:47:59 2022] GET /compute/v2.1/servers/6b1aa3ac-6bda-48be-8814-e1a5ddd510a2 => generated 1323 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:48:00.412599 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-67989e86-9cd9-45e9-9a1e-9d69cbc7e377 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:00.415082 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-67989e86-9cd9-45e9-9a1e-9d69cbc7e377 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] [instance: 3fc8d6fc-3204-43f4-9b94-100d061769a5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:00.432876 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-67989e86-9cd9-45e9-9a1e-9d69cbc7e377 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:00.433666 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-67989e86-9cd9-45e9-9a1e-9d69cbc7e377 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:00.434319 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-67989e86-9cd9-45e9-9a1e-9d69cbc7e377 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:00.435813 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-67989e86-9cd9-45e9-9a1e-9d69cbc7e377 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:00.436456 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-67989e86-9cd9-45e9-9a1e-9d69cbc7e377 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:00.437110 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-67989e86-9cd9-45e9-9a1e-9d69cbc7e377 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:00.632788 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-67989e86-9cd9-45e9-9a1e-9d69cbc7e377 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae134fe7522941698cad3f3fa11e747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16d72d2469433ca30ba6769e3d3f25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:00.649791 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-67989e86-9cd9-45e9-9a1e-9d69cbc7e377 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae134fe7522941698cad3f3fa11e747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16d72d2469433ca30ba6769e3d3f25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:00.652696 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-67989e86-9cd9-45e9-9a1e-9d69cbc7e377 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae134fe7522941698cad3f3fa11e747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16d72d2469433ca30ba6769e3d3f25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:00.657205 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-67989e86-9cd9-45e9-9a1e-9d69cbc7e377 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] 10.222.0.33 "GET /compute/v2.1/servers/3fc8d6fc-3204-43f4-9b94-100d061769a5" status: 200 len: 1274 microversion: 2.57 time: 0.247523 Sep 23 04:48:00.659262 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1881/3813] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:48:00 2022] GET /compute/v2.1/servers/3fc8d6fc-3204-43f4-9b94-100d061769a5 => generated 1274 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:48:00.673536 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-4ad528d4-f4a5-40c2-b81b-e301e7dbbccf req-8cd2113b-679b-48c2-a3a0-37d5ead878de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b1aa3ac-6bda-48be-8814-e1a5ddd510a2", "tag": "99d65349-904f-4ecc-8ad9-f7df89c8a9b0"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:48:00.685039 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-4ad528d4-f4a5-40c2-b81b-e301e7dbbccf req-8cd2113b-679b-48c2-a3a0-37d5ead878de service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:00.685534 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-4ad528d4-f4a5-40c2-b81b-e301e7dbbccf req-8cd2113b-679b-48c2-a3a0-37d5ead878de service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:00.686320 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-4ad528d4-f4a5-40c2-b81b-e301e7dbbccf req-8cd2113b-679b-48c2-a3a0-37d5ead878de service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:00.700547 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-4ad528d4-f4a5-40c2-b81b-e301e7dbbccf req-8cd2113b-679b-48c2-a3a0-37d5ead878de service nova] Creating event network-changed:99d65349-904f-4ecc-8ad9-f7df89c8a9b0 for instance 6b1aa3ac-6bda-48be-8814-e1a5ddd510a2 on n-h2-846463-3 Sep 23 04:48:00.706217 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-4ad528d4-f4a5-40c2-b81b-e301e7dbbccf req-8cd2113b-679b-48c2-a3a0-37d5ead878de service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045534 Sep 23 04:48:00.707142 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1882/3814] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:48:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:48:00.712383 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-88d46a58-d3b8-4c36-a5f6-d6014ede85e9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:00.713093 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-88d46a58-d3b8-4c36-a5f6-d6014ede85e9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:00.719435 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-88d46a58-d3b8-4c36-a5f6-d6014ede85e9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:00.720952 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-88d46a58-d3b8-4c36-a5f6-d6014ede85e9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:00.720952 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-88d46a58-d3b8-4c36-a5f6-d6014ede85e9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:00.722111 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-88d46a58-d3b8-4c36-a5f6-d6014ede85e9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:00.722663 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-88d46a58-d3b8-4c36-a5f6-d6014ede85e9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:00.723129 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-88d46a58-d3b8-4c36-a5f6-d6014ede85e9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:00.758625 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-fce7c18b-1327-4691-b979-5f7ce8556ab8 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c786bbedc21849ea92924139a44707b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcafb05f6f554e278cd552023947c6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:00.782293 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-fce7c18b-1327-4691-b979-5f7ce8556ab8 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579" status: 200 len: 1371 microversion: 2.1 time: 0.597408 Sep 23 04:48:00.783211 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1933/3815] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:48:00 2022] GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579 => generated 1371 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:48:01.050582 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-88d46a58-d3b8-4c36-a5f6-d6014ede85e9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:01.058309 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:48:01.063819 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-88d46a58-d3b8-4c36-a5f6-d6014ede85e9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1670 microversion: 2.1 time: 0.355425 Sep 23 04:48:01.064840 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1883/3816] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:48:00 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1670 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:48:01.089371 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8042c1e0-a6cf-4238-90a6-169c8a579617 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:01.090257 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-8042c1e0-a6cf-4238-90a6-169c8a579617 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:01.097881 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8042c1e0-a6cf-4238-90a6-169c8a579617 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:01.098481 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8042c1e0-a6cf-4238-90a6-169c8a579617 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:01.098924 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8042c1e0-a6cf-4238-90a6-169c8a579617 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:01.099632 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8042c1e0-a6cf-4238-90a6-169c8a579617 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:01.100087 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8042c1e0-a6cf-4238-90a6-169c8a579617 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:01.100545 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8042c1e0-a6cf-4238-90a6-169c8a579617 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:01.194668 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-bc8c4442-bf05-488f-9d2e-2fee1b9dedc5 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '.version_select at 0x7ff1ba846550>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:01.268926 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-bc8c4442-bf05-488f-9d2e-2fee1b9dedc5 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "GET /compute/v2.1/images/efc8a43b-1faf-4f3e-b1e0-5cb6ebaad7c2" status: 200 len: 1454 microversion: 2.1 time: 0.080094 Sep 23 04:48:01.269730 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1884/3817] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:48:01 2022] GET /compute/v2.1/images/efc8a43b-1faf-4f3e-b1e0-5cb6ebaad7c2 => generated 1454 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:48:01.406599 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5f22f516-ebbc-4a89-a697-214f2ecd1ee6 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:01.407811 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5f22f516-ebbc-4a89-a697-214f2ecd1ee6 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] [instance: 6b1aa3ac-6bda-48be-8814-e1a5ddd510a2] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:01.424170 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5f22f516-ebbc-4a89-a697-214f2ecd1ee6 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:01.424959 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5f22f516-ebbc-4a89-a697-214f2ecd1ee6 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:01.425584 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5f22f516-ebbc-4a89-a697-214f2ecd1ee6 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:01.426504 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5f22f516-ebbc-4a89-a697-214f2ecd1ee6 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:01.426967 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5f22f516-ebbc-4a89-a697-214f2ecd1ee6 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:01.427424 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5f22f516-ebbc-4a89-a697-214f2ecd1ee6 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:01.532366 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-8042c1e0-a6cf-4238-90a6-169c8a579617 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:01.542467 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-8042c1e0-a6cf-4238-90a6-169c8a579617 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1670 microversion: 2.1 time: 0.457358 Sep 23 04:48:01.543739 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1934/3818] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:48:01 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1670 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:48:01.572782 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5df4388b-0d40-426a-9201-8a26db5ff97a tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:01.573671 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-5df4388b-0d40-426a-9201-8a26db5ff97a tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:01.643579 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5df4388b-0d40-426a-9201-8a26db5ff97a tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:01.644104 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5df4388b-0d40-426a-9201-8a26db5ff97a tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:01.646582 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5df4388b-0d40-426a-9201-8a26db5ff97a tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:01.659755 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5df4388b-0d40-426a-9201-8a26db5ff97a tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:01.659755 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5df4388b-0d40-426a-9201-8a26db5ff97a tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:01.659755 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5df4388b-0d40-426a-9201-8a26db5ff97a tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:01.659755 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=10 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:48:01.696820 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:48:01.715326 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-5f22f516-ebbc-4a89-a697-214f2ecd1ee6 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a245dd82de1340f7a58873de1851c61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d02cb07a2a404c8d89aa13a950806d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:01.739699 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5f22f516-ebbc-4a89-a697-214f2ecd1ee6 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] 10.222.0.33 "GET /compute/v2.1/servers/6b1aa3ac-6bda-48be-8814-e1a5ddd510a2" status: 200 len: 1323 microversion: 2.1 time: 0.334608 Sep 23 04:48:01.742455 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1885/3819] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:48:01 2022] GET /compute/v2.1/servers/6b1aa3ac-6bda-48be-8814-e1a5ddd510a2 => generated 1323 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:48:01.758067 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-9ca70e18-2fb2-418e-9815-9fb5aaeb6c37 req-e949f88b-abaa-4185-b461-02ea5684983c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0eac077-d4bd-4e4a-a04a-3f86aeeed9bd", "name": "network-vif-unplugged", "status": "completed", "tag": "8f6a797f-179a-458b-adf8-7a33bc4631ac"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:48:01.791467 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-9ca70e18-2fb2-418e-9815-9fb5aaeb6c37 req-e949f88b-abaa-4185-b461-02ea5684983c service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:01.795146 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-9ca70e18-2fb2-418e-9815-9fb5aaeb6c37 req-e949f88b-abaa-4185-b461-02ea5684983c service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:01.795978 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-9ca70e18-2fb2-418e-9815-9fb5aaeb6c37 req-e949f88b-abaa-4185-b461-02ea5684983c service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:01.815641 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-9ca70e18-2fb2-418e-9815-9fb5aaeb6c37 req-e949f88b-abaa-4185-b461-02ea5684983c service nova] Creating event network-vif-unplugged:8f6a797f-179a-458b-adf8-7a33bc4631ac for instance a0eac077-d4bd-4e4a-a04a-3f86aeeed9bd on n-h1-846463-3 Sep 23 04:48:01.823514 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-9ca70e18-2fb2-418e-9815-9fb5aaeb6c37 req-e949f88b-abaa-4185-b461-02ea5684983c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077498 Sep 23 04:48:01.824807 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1886/3820] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:48:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:48:01.833155 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-eeca70aa-0b5c-49cf-9737-2187253f7e4e tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:01.834329 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-eeca70aa-0b5c-49cf-9737-2187253f7e4e tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] [instance: 3fc8d6fc-3204-43f4-9b94-100d061769a5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:01.842955 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-eeca70aa-0b5c-49cf-9737-2187253f7e4e tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:01.843462 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-eeca70aa-0b5c-49cf-9737-2187253f7e4e tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:01.844030 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-eeca70aa-0b5c-49cf-9737-2187253f7e4e tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:01.844790 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-eeca70aa-0b5c-49cf-9737-2187253f7e4e tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:01.845249 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-eeca70aa-0b5c-49cf-9737-2187253f7e4e tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:01.845667 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-eeca70aa-0b5c-49cf-9737-2187253f7e4e tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:01.874611 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-5df4388b-0d40-426a-9201-8a26db5ff97a tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:01.883920 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5df4388b-0d40-426a-9201-8a26db5ff97a tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1670 microversion: 2.1 time: 0.316608 Sep 23 04:48:01.884538 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1935/3821] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:48:01 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1670 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:48:01.894884 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7f91fb62-131f-46e4-9cf9-de413dbe896d tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:01.895705 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-7f91fb62-131f-46e4-9cf9-de413dbe896d tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: c4464422-9bf1-4aaa-806c-d7063e284579] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:01.904235 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7f91fb62-131f-46e4-9cf9-de413dbe896d tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:01.904731 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7f91fb62-131f-46e4-9cf9-de413dbe896d tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:01.905351 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7f91fb62-131f-46e4-9cf9-de413dbe896d tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:01.906106 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7f91fb62-131f-46e4-9cf9-de413dbe896d tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:01.906731 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7f91fb62-131f-46e4-9cf9-de413dbe896d tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:01.907331 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7f91fb62-131f-46e4-9cf9-de413dbe896d tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:01.939150 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-eeca70aa-0b5c-49cf-9737-2187253f7e4e tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae134fe7522941698cad3f3fa11e747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16d72d2469433ca30ba6769e3d3f25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:01.947576 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-eeca70aa-0b5c-49cf-9737-2187253f7e4e tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae134fe7522941698cad3f3fa11e747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16d72d2469433ca30ba6769e3d3f25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:01.949132 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-eeca70aa-0b5c-49cf-9737-2187253f7e4e tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae134fe7522941698cad3f3fa11e747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16d72d2469433ca30ba6769e3d3f25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:01.950452 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-eeca70aa-0b5c-49cf-9737-2187253f7e4e tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] 10.222.0.33 "GET /compute/v2.1/servers/3fc8d6fc-3204-43f4-9b94-100d061769a5" status: 200 len: 1348 microversion: 2.57 time: 0.124472 Sep 23 04:48:01.951305 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1887/3822] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:48:01 2022] GET /compute/v2.1/servers/3fc8d6fc-3204-43f4-9b94-100d061769a5 => generated 1348 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:48:01.970019 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b4601f86-06f1-41c0-9753-3eca0683b5e1 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-891089034"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:48:01.973926 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b4601f86-06f1-41c0-9753-3eca0683b5e1 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:01.982163 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b4601f86-06f1-41c0-9753-3eca0683b5e1 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:01.982659 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b4601f86-06f1-41c0-9753-3eca0683b5e1 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:01.983106 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b4601f86-06f1-41c0-9753-3eca0683b5e1 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:01.984629 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b4601f86-06f1-41c0-9753-3eca0683b5e1 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:01.984629 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b4601f86-06f1-41c0-9753-3eca0683b5e1 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:01.984865 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b4601f86-06f1-41c0-9753-3eca0683b5e1 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:02.073652 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-7f91fb62-131f-46e4-9cf9-de413dbe896d tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c786bbedc21849ea92924139a44707b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcafb05f6f554e278cd552023947c6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:02.081618 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-7f91fb62-131f-46e4-9cf9-de413dbe896d tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579" status: 200 len: 1371 microversion: 2.1 time: 0.195971 Sep 23 04:48:02.082574 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1936/3823] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:48:01 2022] GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579 => generated 1371 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:48:02.284907 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3db25ad8-75fe-4210-87a6-2d0c5475a62e tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '.version_select at 0x7ff1ba9e64c0>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:02.331086 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3db25ad8-75fe-4210-87a6-2d0c5475a62e tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "GET /compute/v2.1/images/efc8a43b-1faf-4f3e-b1e0-5cb6ebaad7c2" status: 200 len: 1454 microversion: 2.1 time: 0.050337 Sep 23 04:48:02.331658 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1937/3824] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:48:02 2022] GET /compute/v2.1/images/efc8a43b-1faf-4f3e-b1e0-5cb6ebaad7c2 => generated 1454 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:48:02.431614 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b4601f86-06f1-41c0-9753-3eca0683b5e1 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "POST /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5/action" status: 202 len: 0 microversion: 2.1 time: 0.466318 Sep 23 04:48:02.433113 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1888/3825] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:48:01 2022] POST /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5/action => generated 0 bytes in 481 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Sep 23 04:48:02.770610 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-257c8dae-3fd0-472c-86d4-62fbd25ea01d tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:02.771235 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-257c8dae-3fd0-472c-86d4-62fbd25ea01d tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] [instance: 6b1aa3ac-6bda-48be-8814-e1a5ddd510a2] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:02.778293 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-257c8dae-3fd0-472c-86d4-62fbd25ea01d tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:02.778919 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-257c8dae-3fd0-472c-86d4-62fbd25ea01d tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:02.796835 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-257c8dae-3fd0-472c-86d4-62fbd25ea01d tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:02.797620 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-257c8dae-3fd0-472c-86d4-62fbd25ea01d tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:02.798165 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-257c8dae-3fd0-472c-86d4-62fbd25ea01d tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:02.798602 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-257c8dae-3fd0-472c-86d4-62fbd25ea01d tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:02.977239 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-652954fe-e474-4afa-bdf0-04e25f2650b5 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:02.978685 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-652954fe-e474-4afa-bdf0-04e25f2650b5 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] [instance: 3fc8d6fc-3204-43f4-9b94-100d061769a5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:02.991898 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-652954fe-e474-4afa-bdf0-04e25f2650b5 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:02.996430 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-257c8dae-3fd0-472c-86d4-62fbd25ea01d tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a245dd82de1340f7a58873de1851c61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d02cb07a2a404c8d89aa13a950806d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:02.996585 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-652954fe-e474-4afa-bdf0-04e25f2650b5 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:02.996585 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-652954fe-e474-4afa-bdf0-04e25f2650b5 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:02.996585 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-652954fe-e474-4afa-bdf0-04e25f2650b5 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:02.997547 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-652954fe-e474-4afa-bdf0-04e25f2650b5 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:03.001731 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-652954fe-e474-4afa-bdf0-04e25f2650b5 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:03.005055 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-257c8dae-3fd0-472c-86d4-62fbd25ea01d tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] 10.222.0.33 "GET /compute/v2.1/servers/6b1aa3ac-6bda-48be-8814-e1a5ddd510a2" status: 200 len: 1323 microversion: 2.1 time: 0.238438 Sep 23 04:48:03.009211 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1938/3826] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:48:02 2022] GET /compute/v2.1/servers/6b1aa3ac-6bda-48be-8814-e1a5ddd510a2 => generated 1323 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:48:03.109491 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d2a0ea94-b1d6-426d-b86f-a9832ad82d2c tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:03.110445 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d2a0ea94-b1d6-426d-b86f-a9832ad82d2c tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: c4464422-9bf1-4aaa-806c-d7063e284579] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:03.116789 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-652954fe-e474-4afa-bdf0-04e25f2650b5 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae134fe7522941698cad3f3fa11e747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16d72d2469433ca30ba6769e3d3f25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:03.123271 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d2a0ea94-b1d6-426d-b86f-a9832ad82d2c tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:03.125848 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d2a0ea94-b1d6-426d-b86f-a9832ad82d2c tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:03.126598 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d2a0ea94-b1d6-426d-b86f-a9832ad82d2c tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:03.130442 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d2a0ea94-b1d6-426d-b86f-a9832ad82d2c tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:03.131198 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d2a0ea94-b1d6-426d-b86f-a9832ad82d2c tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:03.132029 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d2a0ea94-b1d6-426d-b86f-a9832ad82d2c tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:03.140682 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-652954fe-e474-4afa-bdf0-04e25f2650b5 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae134fe7522941698cad3f3fa11e747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16d72d2469433ca30ba6769e3d3f25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:03.144974 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-652954fe-e474-4afa-bdf0-04e25f2650b5 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae134fe7522941698cad3f3fa11e747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16d72d2469433ca30ba6769e3d3f25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:03.147349 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-652954fe-e474-4afa-bdf0-04e25f2650b5 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] 10.222.0.33 "GET /compute/v2.1/servers/3fc8d6fc-3204-43f4-9b94-100d061769a5" status: 200 len: 1336 microversion: 2.57 time: 0.174170 Sep 23 04:48:03.148655 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1889/3827] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:48:02 2022] GET /compute/v2.1/servers/3fc8d6fc-3204-43f4-9b94-100d061769a5 => generated 1336 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:48:03.297011 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-64e9d126-f7eb-4597-8085-8404a2c29a04 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:48:03.297707 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-64e9d126-f7eb-4597-8085-8404a2c29a04 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: fe7dee09-8351-4d41-8c44-8d35a966cce9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:03.305032 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-64e9d126-f7eb-4597-8085-8404a2c29a04 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:03.307763 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-64e9d126-f7eb-4597-8085-8404a2c29a04 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:03.309300 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-64e9d126-f7eb-4597-8085-8404a2c29a04 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:03.310582 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-64e9d126-f7eb-4597-8085-8404a2c29a04 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:03.312267 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-64e9d126-f7eb-4597-8085-8404a2c29a04 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:03.312836 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-64e9d126-f7eb-4597-8085-8404a2c29a04 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:03.316989 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d2a0ea94-b1d6-426d-b86f-a9832ad82d2c tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c786bbedc21849ea92924139a44707b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcafb05f6f554e278cd552023947c6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:03.328336 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d2a0ea94-b1d6-426d-b86f-a9832ad82d2c tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579" status: 200 len: 1371 microversion: 2.1 time: 0.226739 Sep 23 04:48:03.329717 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1939/3828] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:48:03 2022] GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579 => generated 1371 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:48:03.348840 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-dded2137-5140-4338-87ff-7de34f652026 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '.version_select at 0x7ff1bb09d280>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:03.356294 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-64e9d126-f7eb-4597-8085-8404a2c29a04 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lazy-loading 'flavor' on Instance uuid fe7dee09-8351-4d41-8c44-8d35a966cce9 {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:48:03.444685 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-dded2137-5140-4338-87ff-7de34f652026 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "GET /compute/v2.1/images/efc8a43b-1faf-4f3e-b1e0-5cb6ebaad7c2" status: 200 len: 1454 microversion: 2.1 time: 0.101040 Sep 23 04:48:03.448952 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1940/3829] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:48:03 2022] GET /compute/v2.1/images/efc8a43b-1faf-4f3e-b1e0-5cb6ebaad7c2 => generated 1454 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:48:04.036556 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e17b5768-7e81-49b3-b33c-9238244326ee tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:04.037395 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e17b5768-7e81-49b3-b33c-9238244326ee tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] [instance: 6b1aa3ac-6bda-48be-8814-e1a5ddd510a2] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:04.050692 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e17b5768-7e81-49b3-b33c-9238244326ee tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:04.052673 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e17b5768-7e81-49b3-b33c-9238244326ee tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:04.061877 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e17b5768-7e81-49b3-b33c-9238244326ee tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:04.061877 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e17b5768-7e81-49b3-b33c-9238244326ee tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:04.061877 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e17b5768-7e81-49b3-b33c-9238244326ee tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:04.061877 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e17b5768-7e81-49b3-b33c-9238244326ee tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:04.066205 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-64e9d126-f7eb-4597-8085-8404a2c29a04 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "POST /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9/action" status: 202 len: 0 microversion: 2.20 time: 0.773064 Sep 23 04:48:04.067153 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1890/3830] 10.222.0.33 () {62 vars in 1319 bytes} [Fri Sep 23 04:48:03 2022] POST /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9/action => generated 0 bytes in 775 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 23 04:48:04.076497 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-41f3df1c-c2ab-4fd9-bf20-043d5db48c7c tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:04.082080 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-41f3df1c-c2ab-4fd9-bf20-043d5db48c7c tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: fe7dee09-8351-4d41-8c44-8d35a966cce9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:04.086400 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-41f3df1c-c2ab-4fd9-bf20-043d5db48c7c tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:04.086920 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-41f3df1c-c2ab-4fd9-bf20-043d5db48c7c tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:04.087419 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-41f3df1c-c2ab-4fd9-bf20-043d5db48c7c tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:04.088163 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-41f3df1c-c2ab-4fd9-bf20-043d5db48c7c tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:04.088618 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-41f3df1c-c2ab-4fd9-bf20-043d5db48c7c tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:04.089045 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-41f3df1c-c2ab-4fd9-bf20-043d5db48c7c tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:04.600822 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-41f3df1c-c2ab-4fd9-bf20-043d5db48c7c tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:04.613158 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-41f3df1c-c2ab-4fd9-bf20-043d5db48c7c tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:04.615140 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-41f3df1c-c2ab-4fd9-bf20-043d5db48c7c tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:04.616629 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-41f3df1c-c2ab-4fd9-bf20-043d5db48c7c tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9" status: 200 len: 1724 microversion: 2.20 time: 0.545410 Sep 23 04:48:04.617794 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1891/3831] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:48:04 2022] GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9 => generated 1724 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:48:04.647543 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4a690751-7b78-4000-bdac-d2ae1e5cdf10 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:04.653721 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4a690751-7b78-4000-bdac-d2ae1e5cdf10 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] [instance: 3fc8d6fc-3204-43f4-9b94-100d061769a5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:04.671126 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4a690751-7b78-4000-bdac-d2ae1e5cdf10 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:04.673797 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4a690751-7b78-4000-bdac-d2ae1e5cdf10 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:04.687903 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4a690751-7b78-4000-bdac-d2ae1e5cdf10 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:04.692175 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4a690751-7b78-4000-bdac-d2ae1e5cdf10 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:04.694027 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4a690751-7b78-4000-bdac-d2ae1e5cdf10 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:04.696393 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4a690751-7b78-4000-bdac-d2ae1e5cdf10 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:04.894559 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e17b5768-7e81-49b3-b33c-9238244326ee tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a245dd82de1340f7a58873de1851c61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d02cb07a2a404c8d89aa13a950806d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:04.917314 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e17b5768-7e81-49b3-b33c-9238244326ee tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] 10.222.0.33 "GET /compute/v2.1/servers/6b1aa3ac-6bda-48be-8814-e1a5ddd510a2" status: 200 len: 1323 microversion: 2.1 time: 0.884548 Sep 23 04:48:04.918358 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1941/3832] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:48:04 2022] GET /compute/v2.1/servers/6b1aa3ac-6bda-48be-8814-e1a5ddd510a2 => generated 1323 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:48:04.923875 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-18e384d8-7084-4cb7-9103-f71190e61e67 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:04.924811 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-18e384d8-7084-4cb7-9103-f71190e61e67 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: c4464422-9bf1-4aaa-806c-d7063e284579] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:04.934415 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-18e384d8-7084-4cb7-9103-f71190e61e67 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:04.935266 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-18e384d8-7084-4cb7-9103-f71190e61e67 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:04.935952 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-18e384d8-7084-4cb7-9103-f71190e61e67 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:04.936221 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4a690751-7b78-4000-bdac-d2ae1e5cdf10 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae134fe7522941698cad3f3fa11e747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16d72d2469433ca30ba6769e3d3f25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:04.937211 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-18e384d8-7084-4cb7-9103-f71190e61e67 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:04.938072 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-18e384d8-7084-4cb7-9103-f71190e61e67 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:04.940365 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-18e384d8-7084-4cb7-9103-f71190e61e67 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:04.948017 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4a690751-7b78-4000-bdac-d2ae1e5cdf10 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae134fe7522941698cad3f3fa11e747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16d72d2469433ca30ba6769e3d3f25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:04.952238 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4a690751-7b78-4000-bdac-d2ae1e5cdf10 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae134fe7522941698cad3f3fa11e747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16d72d2469433ca30ba6769e3d3f25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:04.954935 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4a690751-7b78-4000-bdac-d2ae1e5cdf10 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] 10.222.0.33 "GET /compute/v2.1/servers/3fc8d6fc-3204-43f4-9b94-100d061769a5" status: 200 len: 1336 microversion: 2.57 time: 0.335921 Sep 23 04:48:04.961476 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1892/3833] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:48:04 2022] GET /compute/v2.1/servers/3fc8d6fc-3204-43f4-9b94-100d061769a5 => generated 1336 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:48:04.968926 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-03b2ca84-5e32-4851-8b6d-169469a6f744 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '.version_select at 0x7ff1ba89b670>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:05.077393 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-03b2ca84-5e32-4851-8b6d-169469a6f744 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "GET /compute/v2.1/images/efc8a43b-1faf-4f3e-b1e0-5cb6ebaad7c2" status: 200 len: 1454 microversion: 2.1 time: 0.113987 Sep 23 04:48:05.078286 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1893/3834] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:48:04 2022] GET /compute/v2.1/images/efc8a43b-1faf-4f3e-b1e0-5cb6ebaad7c2 => generated 1454 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:48:05.324705 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-18e384d8-7084-4cb7-9103-f71190e61e67 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c786bbedc21849ea92924139a44707b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcafb05f6f554e278cd552023947c6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:05.347796 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-18e384d8-7084-4cb7-9103-f71190e61e67 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579" status: 200 len: 1371 microversion: 2.1 time: 0.427830 Sep 23 04:48:05.348719 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1942/3835] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:48:04 2022] GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579 => generated 1371 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:48:05.644651 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f74684fc-911a-4497-b4fc-3ceb1d2c5a64 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:05.645577 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f74684fc-911a-4497-b4fc-3ceb1d2c5a64 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: fe7dee09-8351-4d41-8c44-8d35a966cce9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:05.671593 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f74684fc-911a-4497-b4fc-3ceb1d2c5a64 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:05.672454 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f74684fc-911a-4497-b4fc-3ceb1d2c5a64 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:05.676214 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f74684fc-911a-4497-b4fc-3ceb1d2c5a64 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:05.680564 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f74684fc-911a-4497-b4fc-3ceb1d2c5a64 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:05.681873 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f74684fc-911a-4497-b4fc-3ceb1d2c5a64 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:05.683145 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f74684fc-911a-4497-b4fc-3ceb1d2c5a64 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:05.944548 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-da2d198e-4c76-4270-8d6d-b691417f9d12 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:05.947151 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-da2d198e-4c76-4270-8d6d-b691417f9d12 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] [instance: 6b1aa3ac-6bda-48be-8814-e1a5ddd510a2] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:05.964969 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-da2d198e-4c76-4270-8d6d-b691417f9d12 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:05.967086 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-da2d198e-4c76-4270-8d6d-b691417f9d12 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:05.982928 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-da2d198e-4c76-4270-8d6d-b691417f9d12 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:05.986890 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-da2d198e-4c76-4270-8d6d-b691417f9d12 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:06.005484 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-da2d198e-4c76-4270-8d6d-b691417f9d12 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:06.014638 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-da2d198e-4c76-4270-8d6d-b691417f9d12 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:06.108754 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f74684fc-911a-4497-b4fc-3ceb1d2c5a64 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:06.123950 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f74684fc-911a-4497-b4fc-3ceb1d2c5a64 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:06.127809 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f74684fc-911a-4497-b4fc-3ceb1d2c5a64 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:06.131227 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f74684fc-911a-4497-b4fc-3ceb1d2c5a64 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9" status: 200 len: 1724 microversion: 2.20 time: 0.491327 Sep 23 04:48:06.135524 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1894/3836] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:48:05 2022] GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9 => generated 1724 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:48:06.167298 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f6ce1c97-a964-4fb9-9e63-7e9d1be39791 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:06.170270 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f6ce1c97-a964-4fb9-9e63-7e9d1be39791 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] [instance: 3fc8d6fc-3204-43f4-9b94-100d061769a5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:06.184107 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f6ce1c97-a964-4fb9-9e63-7e9d1be39791 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:06.184630 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f6ce1c97-a964-4fb9-9e63-7e9d1be39791 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:06.185081 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f6ce1c97-a964-4fb9-9e63-7e9d1be39791 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:06.185806 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f6ce1c97-a964-4fb9-9e63-7e9d1be39791 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:06.186302 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f6ce1c97-a964-4fb9-9e63-7e9d1be39791 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:06.189801 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f6ce1c97-a964-4fb9-9e63-7e9d1be39791 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:06.452219 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f6ce1c97-a964-4fb9-9e63-7e9d1be39791 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae134fe7522941698cad3f3fa11e747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16d72d2469433ca30ba6769e3d3f25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:06.463636 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f6ce1c97-a964-4fb9-9e63-7e9d1be39791 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae134fe7522941698cad3f3fa11e747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16d72d2469433ca30ba6769e3d3f25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:06.465754 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f6ce1c97-a964-4fb9-9e63-7e9d1be39791 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae134fe7522941698cad3f3fa11e747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16d72d2469433ca30ba6769e3d3f25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:06.468144 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f6ce1c97-a964-4fb9-9e63-7e9d1be39791 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] 10.222.0.33 "GET /compute/v2.1/servers/3fc8d6fc-3204-43f4-9b94-100d061769a5" status: 200 len: 1357 microversion: 2.57 time: 0.324931 Sep 23 04:48:06.487169 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1895/3837] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:48:06 2022] GET /compute/v2.1/servers/3fc8d6fc-3204-43f4-9b94-100d061769a5 => generated 1357 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:48:06.495796 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-479317b9-4b97-44c5-8995-417a0eeba18e tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '.version_select at 0x7ff1ba9ade50>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:06.547648 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-da2d198e-4c76-4270-8d6d-b691417f9d12 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a245dd82de1340f7a58873de1851c61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d02cb07a2a404c8d89aa13a950806d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:06.561019 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-da2d198e-4c76-4270-8d6d-b691417f9d12 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] 10.222.0.33 "GET /compute/v2.1/servers/6b1aa3ac-6bda-48be-8814-e1a5ddd510a2" status: 200 len: 1323 microversion: 2.1 time: 0.621074 Sep 23 04:48:06.565562 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1943/3838] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:48:05 2022] GET /compute/v2.1/servers/6b1aa3ac-6bda-48be-8814-e1a5ddd510a2 => generated 1323 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:48:06.573037 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-18b849f5-72d3-42d4-9f84-108bcf0330d3 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:06.574033 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-18b849f5-72d3-42d4-9f84-108bcf0330d3 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: c4464422-9bf1-4aaa-806c-d7063e284579] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:06.582071 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-18b849f5-72d3-42d4-9f84-108bcf0330d3 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:06.586007 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-18b849f5-72d3-42d4-9f84-108bcf0330d3 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:06.586007 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-18b849f5-72d3-42d4-9f84-108bcf0330d3 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:06.586007 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-18b849f5-72d3-42d4-9f84-108bcf0330d3 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:06.587904 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-18b849f5-72d3-42d4-9f84-108bcf0330d3 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:06.589115 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-18b849f5-72d3-42d4-9f84-108bcf0330d3 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:06.595696 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-479317b9-4b97-44c5-8995-417a0eeba18e tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "GET /compute/v2.1/images/efc8a43b-1faf-4f3e-b1e0-5cb6ebaad7c2" status: 200 len: 1454 microversion: 2.1 time: 0.104942 Sep 23 04:48:06.602588 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1896/3839] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:48:06 2022] GET /compute/v2.1/images/efc8a43b-1faf-4f3e-b1e0-5cb6ebaad7c2 => generated 1454 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:48:06.621228 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-083baca1-90dc-48e5-bd44-8a1f0442b4e3 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:48:06.634845 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-083baca1-90dc-48e5-bd44-8a1f0442b4e3 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] [instance: 3fc8d6fc-3204-43f4-9b94-100d061769a5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:06.668287 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-083baca1-90dc-48e5-bd44-8a1f0442b4e3 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:06.669047 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-083baca1-90dc-48e5-bd44-8a1f0442b4e3 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:06.669773 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-083baca1-90dc-48e5-bd44-8a1f0442b4e3 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:06.670649 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-083baca1-90dc-48e5-bd44-8a1f0442b4e3 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:06.671292 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-083baca1-90dc-48e5-bd44-8a1f0442b4e3 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:06.671813 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-083baca1-90dc-48e5-bd44-8a1f0442b4e3 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:06.811245 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-083baca1-90dc-48e5-bd44-8a1f0442b4e3 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Flavor limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:48:06.812039 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-083baca1-90dc-48e5-bd44-8a1f0442b4e3 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Image limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:48:06.812750 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-083baca1-90dc-48e5-bd44-8a1f0442b4e3 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Flavor pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:48:06.813418 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-083baca1-90dc-48e5-bd44-8a1f0442b4e3 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Image pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:48:06.814312 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-083baca1-90dc-48e5-bd44-8a1f0442b4e3 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:48:07.055535 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-083baca1-90dc-48e5-bd44-8a1f0442b4e3 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] [instance: 3fc8d6fc-3204-43f4-9b94-100d061769a5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:07.074730 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-083baca1-90dc-48e5-bd44-8a1f0442b4e3 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:07.075461 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-083baca1-90dc-48e5-bd44-8a1f0442b4e3 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:07.076083 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-083baca1-90dc-48e5-bd44-8a1f0442b4e3 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:07.077177 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-083baca1-90dc-48e5-bd44-8a1f0442b4e3 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:07.087676 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-083baca1-90dc-48e5-bd44-8a1f0442b4e3 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:07.087676 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-083baca1-90dc-48e5-bd44-8a1f0442b4e3 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:07.125797 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-083baca1-90dc-48e5-bd44-8a1f0442b4e3 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] 10.222.0.33 "POST /compute/v2.1/servers/3fc8d6fc-3204-43f4-9b94-100d061769a5/action" status: 202 len: 1138 microversion: 2.57 time: 0.515480 Sep 23 04:48:07.130120 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1897/3840] 10.222.0.33 () {62 vars in 1320 bytes} [Fri Sep 23 04:48:06 2022] POST /compute/v2.1/servers/3fc8d6fc-3204-43f4-9b94-100d061769a5/action => generated 1138 bytes in 526 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Sep 23 04:48:07.138909 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-8c21916b-8303-40fe-ac8b-0264fc987e59 req-5fa6db10-c189-43b1-91b8-1558872aa848 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "401339a4-8674-4ff9-b09e-ba748f46928d", "name": "network-vif-plugged", "status": "completed", "tag": "ee716fd2-ccf3-4c05-b155-29bb9a5565c2"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:48:07.165252 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-8c21916b-8303-40fe-ac8b-0264fc987e59 req-5fa6db10-c189-43b1-91b8-1558872aa848 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:07.165746 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-8c21916b-8303-40fe-ac8b-0264fc987e59 req-5fa6db10-c189-43b1-91b8-1558872aa848 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:07.166220 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-8c21916b-8303-40fe-ac8b-0264fc987e59 req-5fa6db10-c189-43b1-91b8-1558872aa848 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:07.190977 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-8c21916b-8303-40fe-ac8b-0264fc987e59 req-5fa6db10-c189-43b1-91b8-1558872aa848 service nova] Creating event network-vif-plugged:ee716fd2-ccf3-4c05-b155-29bb9a5565c2 for instance 401339a4-8674-4ff9-b09e-ba748f46928d on n-h1-846463-3 Sep 23 04:48:07.204341 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-8c21916b-8303-40fe-ac8b-0264fc987e59 req-5fa6db10-c189-43b1-91b8-1558872aa848 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072085 Sep 23 04:48:07.205304 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1898/3841] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:48:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:48:07.210686 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8c0de155-c90a-4c25-a87a-f4be4cba8875 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:07.211386 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8c0de155-c90a-4c25-a87a-f4be4cba8875 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] [instance: 3fc8d6fc-3204-43f4-9b94-100d061769a5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:07.218375 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8c0de155-c90a-4c25-a87a-f4be4cba8875 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:07.219547 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8c0de155-c90a-4c25-a87a-f4be4cba8875 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:07.219807 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8c0de155-c90a-4c25-a87a-f4be4cba8875 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:07.222657 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8c0de155-c90a-4c25-a87a-f4be4cba8875 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:07.223361 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8c0de155-c90a-4c25-a87a-f4be4cba8875 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:07.223988 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8c0de155-c90a-4c25-a87a-f4be4cba8875 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:07.252804 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:48:07.719316 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8c0de155-c90a-4c25-a87a-f4be4cba8875 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae134fe7522941698cad3f3fa11e747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16d72d2469433ca30ba6769e3d3f25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:07.735876 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8c0de155-c90a-4c25-a87a-f4be4cba8875 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae134fe7522941698cad3f3fa11e747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16d72d2469433ca30ba6769e3d3f25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:07.742329 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8c0de155-c90a-4c25-a87a-f4be4cba8875 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae134fe7522941698cad3f3fa11e747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16d72d2469433ca30ba6769e3d3f25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:07.746466 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8c0de155-c90a-4c25-a87a-f4be4cba8875 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] 10.222.0.33 "GET /compute/v2.1/servers/3fc8d6fc-3204-43f4-9b94-100d061769a5" status: 200 len: 1366 microversion: 2.57 time: 0.539766 Sep 23 04:48:07.747653 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1899/3842] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:48:07 2022] GET /compute/v2.1/servers/3fc8d6fc-3204-43f4-9b94-100d061769a5 => generated 1366 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:48:07.762607 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-068a927b-ffc0-46ef-9c02-9a8e960f3918 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:07.764195 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-068a927b-ffc0-46ef-9c02-9a8e960f3918 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: fe7dee09-8351-4d41-8c44-8d35a966cce9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:07.802466 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-068a927b-ffc0-46ef-9c02-9a8e960f3918 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:07.805723 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-068a927b-ffc0-46ef-9c02-9a8e960f3918 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:07.808691 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-068a927b-ffc0-46ef-9c02-9a8e960f3918 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:07.812950 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-068a927b-ffc0-46ef-9c02-9a8e960f3918 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:07.815904 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-068a927b-ffc0-46ef-9c02-9a8e960f3918 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:07.820192 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-068a927b-ffc0-46ef-9c02-9a8e960f3918 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:07.921040 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=6 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:48:08.582251 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-18b849f5-72d3-42d4-9f84-108bcf0330d3 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c786bbedc21849ea92924139a44707b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcafb05f6f554e278cd552023947c6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:08.592565 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-18b849f5-72d3-42d4-9f84-108bcf0330d3 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579" status: 200 len: 1371 microversion: 2.1 time: 2.025608 Sep 23 04:48:08.612365 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1944/3843] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:48:06 2022] GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579 => generated 1371 bytes in 2042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:48:08.624613 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-80abf969-d6e6-4c4e-843c-fc30019a64b4 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:08.625576 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-80abf969-d6e6-4c4e-843c-fc30019a64b4 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] [instance: 6b1aa3ac-6bda-48be-8814-e1a5ddd510a2] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:08.632925 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-80abf969-d6e6-4c4e-843c-fc30019a64b4 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:08.634744 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-80abf969-d6e6-4c4e-843c-fc30019a64b4 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:08.641216 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-80abf969-d6e6-4c4e-843c-fc30019a64b4 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:08.642426 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-80abf969-d6e6-4c4e-843c-fc30019a64b4 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:08.643075 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-80abf969-d6e6-4c4e-843c-fc30019a64b4 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:08.643675 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-80abf969-d6e6-4c4e-843c-fc30019a64b4 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:09.019888 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-068a927b-ffc0-46ef-9c02-9a8e960f3918 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:09.035134 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-068a927b-ffc0-46ef-9c02-9a8e960f3918 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:09.036892 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-068a927b-ffc0-46ef-9c02-9a8e960f3918 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:09.038563 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-068a927b-ffc0-46ef-9c02-9a8e960f3918 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9" status: 200 len: 1724 microversion: 2.20 time: 1.288570 Sep 23 04:48:09.042781 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1900/3844] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:48:07 2022] GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9 => generated 1724 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:48:09.058805 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1cefaf32-b4f7-4646-aa0b-a29e6f51c3f1 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '.version_select at 0x7ff1ba9f33a0>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:09.096749 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-80abf969-d6e6-4c4e-843c-fc30019a64b4 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a245dd82de1340f7a58873de1851c61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d02cb07a2a404c8d89aa13a950806d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:09.106446 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-80abf969-d6e6-4c4e-843c-fc30019a64b4 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] 10.222.0.33 "GET /compute/v2.1/servers/6b1aa3ac-6bda-48be-8814-e1a5ddd510a2" status: 200 len: 1323 microversion: 2.1 time: 0.496769 Sep 23 04:48:09.111463 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1945/3845] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:48:08 2022] GET /compute/v2.1/servers/6b1aa3ac-6bda-48be-8814-e1a5ddd510a2 => generated 1323 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:48:09.116477 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-398d3ebb-b57c-433e-a8e8-32cd9e822f82 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:09.118423 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-398d3ebb-b57c-433e-a8e8-32cd9e822f82 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] [instance: 3fc8d6fc-3204-43f4-9b94-100d061769a5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:09.129654 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-398d3ebb-b57c-433e-a8e8-32cd9e822f82 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:09.130479 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-398d3ebb-b57c-433e-a8e8-32cd9e822f82 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:09.131099 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-398d3ebb-b57c-433e-a8e8-32cd9e822f82 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:09.132013 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-398d3ebb-b57c-433e-a8e8-32cd9e822f82 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:09.132651 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-398d3ebb-b57c-433e-a8e8-32cd9e822f82 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:09.133259 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-398d3ebb-b57c-433e-a8e8-32cd9e822f82 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:09.328458 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-398d3ebb-b57c-433e-a8e8-32cd9e822f82 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae134fe7522941698cad3f3fa11e747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16d72d2469433ca30ba6769e3d3f25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:09.347813 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-398d3ebb-b57c-433e-a8e8-32cd9e822f82 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae134fe7522941698cad3f3fa11e747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16d72d2469433ca30ba6769e3d3f25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:09.355831 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-398d3ebb-b57c-433e-a8e8-32cd9e822f82 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae134fe7522941698cad3f3fa11e747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16d72d2469433ca30ba6769e3d3f25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:09.357423 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-398d3ebb-b57c-433e-a8e8-32cd9e822f82 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] 10.222.0.33 "GET /compute/v2.1/servers/3fc8d6fc-3204-43f4-9b94-100d061769a5" status: 200 len: 1366 microversion: 2.57 time: 0.244822 Sep 23 04:48:09.358292 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1946/3846] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:48:09 2022] GET /compute/v2.1/servers/3fc8d6fc-3204-43f4-9b94-100d061769a5 => generated 1366 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:48:09.365032 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-68bfea28-76df-4b7a-a2f7-a510e3ebb266 req-2c38ac37-8f7e-4a1c-b260-2a6bced44f4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4464422-9bf1-4aaa-806c-d7063e284579", "name": "network-vif-plugged", "status": "completed", "tag": "1996c9a9-f009-4ec9-a3d8-6f5d1f1f1a46"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:48:09.378715 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-68bfea28-76df-4b7a-a2f7-a510e3ebb266 req-2c38ac37-8f7e-4a1c-b260-2a6bced44f4f service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:09.379669 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=28 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:48:09.380330 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-68bfea28-76df-4b7a-a2f7-a510e3ebb266 req-2c38ac37-8f7e-4a1c-b260-2a6bced44f4f service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:09.381025 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-68bfea28-76df-4b7a-a2f7-a510e3ebb266 req-2c38ac37-8f7e-4a1c-b260-2a6bced44f4f service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:09.410641 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-68bfea28-76df-4b7a-a2f7-a510e3ebb266 req-2c38ac37-8f7e-4a1c-b260-2a6bced44f4f service nova] Creating event network-vif-plugged:1996c9a9-f009-4ec9-a3d8-6f5d1f1f1a46 for instance c4464422-9bf1-4aaa-806c-d7063e284579 on n-h1-846463-3 Sep 23 04:48:09.419611 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-68bfea28-76df-4b7a-a2f7-a510e3ebb266 req-2c38ac37-8f7e-4a1c-b260-2a6bced44f4f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059875 Sep 23 04:48:09.436221 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1947/3847] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:48:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:48:09.637542 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-365d869d-6b41-4648-bfcb-7049849a83a5 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:09.639026 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-365d869d-6b41-4648-bfcb-7049849a83a5 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: c4464422-9bf1-4aaa-806c-d7063e284579] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:09.654518 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-365d869d-6b41-4648-bfcb-7049849a83a5 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:09.664445 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-365d869d-6b41-4648-bfcb-7049849a83a5 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:09.665278 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-365d869d-6b41-4648-bfcb-7049849a83a5 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:09.666256 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-365d869d-6b41-4648-bfcb-7049849a83a5 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:09.666904 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-365d869d-6b41-4648-bfcb-7049849a83a5 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:09.668032 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-365d869d-6b41-4648-bfcb-7049849a83a5 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:10.156149 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-365d869d-6b41-4648-bfcb-7049849a83a5 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c786bbedc21849ea92924139a44707b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcafb05f6f554e278cd552023947c6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:10.174655 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-365d869d-6b41-4648-bfcb-7049849a83a5 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579" status: 200 len: 1371 microversion: 2.1 time: 0.541623 Sep 23 04:48:10.177510 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1948/3848] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:48:09 2022] GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579 => generated 1371 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:48:10.183515 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-82a58cbf-6867-43ce-a34b-aeb5c67d9ec5 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:10.184390 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-82a58cbf-6867-43ce-a34b-aeb5c67d9ec5 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: fe7dee09-8351-4d41-8c44-8d35a966cce9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:10.194999 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-82a58cbf-6867-43ce-a34b-aeb5c67d9ec5 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:10.195789 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-82a58cbf-6867-43ce-a34b-aeb5c67d9ec5 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:10.196567 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-82a58cbf-6867-43ce-a34b-aeb5c67d9ec5 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:10.197476 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-82a58cbf-6867-43ce-a34b-aeb5c67d9ec5 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:10.198175 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-82a58cbf-6867-43ce-a34b-aeb5c67d9ec5 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:10.198769 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-82a58cbf-6867-43ce-a34b-aeb5c67d9ec5 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:10.489933 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-82a58cbf-6867-43ce-a34b-aeb5c67d9ec5 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:10.503936 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-82a58cbf-6867-43ce-a34b-aeb5c67d9ec5 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:10.511026 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-82a58cbf-6867-43ce-a34b-aeb5c67d9ec5 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:10.512911 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-82a58cbf-6867-43ce-a34b-aeb5c67d9ec5 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9" status: 200 len: 1724 microversion: 2.20 time: 0.334040 Sep 23 04:48:10.514666 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1949/3849] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:48:10 2022] GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9 => generated 1724 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:48:10.525957 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ab8b2680-a0cb-4a30-a4a2-0820a4475e5c tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:10.526838 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ab8b2680-a0cb-4a30-a4a2-0820a4475e5c tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] [instance: 6b1aa3ac-6bda-48be-8814-e1a5ddd510a2] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:10.533949 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ab8b2680-a0cb-4a30-a4a2-0820a4475e5c tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:10.534666 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ab8b2680-a0cb-4a30-a4a2-0820a4475e5c tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:10.535993 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ab8b2680-a0cb-4a30-a4a2-0820a4475e5c tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:10.536707 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ab8b2680-a0cb-4a30-a4a2-0820a4475e5c tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:10.537340 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ab8b2680-a0cb-4a30-a4a2-0820a4475e5c tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:10.538116 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ab8b2680-a0cb-4a30-a4a2-0820a4475e5c tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:10.823997 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ab8b2680-a0cb-4a30-a4a2-0820a4475e5c tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a245dd82de1340f7a58873de1851c61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d02cb07a2a404c8d89aa13a950806d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:10.847152 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ab8b2680-a0cb-4a30-a4a2-0820a4475e5c tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] 10.222.0.33 "GET /compute/v2.1/servers/6b1aa3ac-6bda-48be-8814-e1a5ddd510a2" status: 200 len: 1323 microversion: 2.1 time: 0.322212 Sep 23 04:48:10.848095 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1950/3850] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:48:10 2022] GET /compute/v2.1/servers/6b1aa3ac-6bda-48be-8814-e1a5ddd510a2 => generated 1323 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:48:10.866540 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e2336609-0a7e-4f8a-bdfe-12501084165d tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:10.867992 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e2336609-0a7e-4f8a-bdfe-12501084165d tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] [instance: 3fc8d6fc-3204-43f4-9b94-100d061769a5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:10.884493 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e2336609-0a7e-4f8a-bdfe-12501084165d tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:10.888177 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e2336609-0a7e-4f8a-bdfe-12501084165d tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:10.888805 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e2336609-0a7e-4f8a-bdfe-12501084165d tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:10.892370 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e2336609-0a7e-4f8a-bdfe-12501084165d tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:10.893064 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e2336609-0a7e-4f8a-bdfe-12501084165d tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:10.893666 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e2336609-0a7e-4f8a-bdfe-12501084165d tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:11.095394 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e2336609-0a7e-4f8a-bdfe-12501084165d tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae134fe7522941698cad3f3fa11e747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16d72d2469433ca30ba6769e3d3f25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:11.110905 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e2336609-0a7e-4f8a-bdfe-12501084165d tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae134fe7522941698cad3f3fa11e747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16d72d2469433ca30ba6769e3d3f25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:11.112361 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e2336609-0a7e-4f8a-bdfe-12501084165d tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae134fe7522941698cad3f3fa11e747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16d72d2469433ca30ba6769e3d3f25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:11.113567 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e2336609-0a7e-4f8a-bdfe-12501084165d tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] 10.222.0.33 "GET /compute/v2.1/servers/3fc8d6fc-3204-43f4-9b94-100d061769a5" status: 200 len: 1366 microversion: 2.57 time: 0.263754 Sep 23 04:48:11.142137 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1951/3851] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:48:10 2022] GET /compute/v2.1/servers/3fc8d6fc-3204-43f4-9b94-100d061769a5 => generated 1366 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:48:11.203603 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d5068d77-f5de-48d0-963a-70f305145f2d tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:11.204230 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d5068d77-f5de-48d0-963a-70f305145f2d tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: c4464422-9bf1-4aaa-806c-d7063e284579] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:11.220965 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d5068d77-f5de-48d0-963a-70f305145f2d tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:11.221561 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d5068d77-f5de-48d0-963a-70f305145f2d tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:11.225421 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d5068d77-f5de-48d0-963a-70f305145f2d tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:11.226279 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d5068d77-f5de-48d0-963a-70f305145f2d tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:11.226767 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d5068d77-f5de-48d0-963a-70f305145f2d tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:11.227210 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d5068d77-f5de-48d0-963a-70f305145f2d tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:11.600111 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d5068d77-f5de-48d0-963a-70f305145f2d tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c786bbedc21849ea92924139a44707b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcafb05f6f554e278cd552023947c6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:11.611554 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d5068d77-f5de-48d0-963a-70f305145f2d tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579" status: 200 len: 1565 microversion: 2.1 time: 0.415057 Sep 23 04:48:11.617706 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1952/3852] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:48:11 2022] GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579 => generated 1565 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:48:11.623636 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-9f1ad38e-53d6-4779-82e8-d1410b487db8 req-04d5a1e7-c591-4513-9f11-d872155d579c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fb569cf-4457-4695-ad5f-fcb78f0964c5", "name": "network-vif-plugged", "status": "completed", "tag": "8fdad197-55e1-4686-bfa9-6cfa0beb24d5"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:48:11.650591 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-9f1ad38e-53d6-4779-82e8-d1410b487db8 req-04d5a1e7-c591-4513-9f11-d872155d579c service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:11.651090 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-9f1ad38e-53d6-4779-82e8-d1410b487db8 req-04d5a1e7-c591-4513-9f11-d872155d579c service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:11.651525 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-9f1ad38e-53d6-4779-82e8-d1410b487db8 req-04d5a1e7-c591-4513-9f11-d872155d579c service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:11.680524 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-9f1ad38e-53d6-4779-82e8-d1410b487db8 req-04d5a1e7-c591-4513-9f11-d872155d579c service nova] Creating event network-vif-plugged:8fdad197-55e1-4686-bfa9-6cfa0beb24d5 for instance 4fb569cf-4457-4695-ad5f-fcb78f0964c5 on n-h2-846463-3 Sep 23 04:48:11.689481 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-9f1ad38e-53d6-4779-82e8-d1410b487db8 req-04d5a1e7-c591-4513-9f11-d872155d579c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069695 Sep 23 04:48:11.693305 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1953/3853] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:48:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:48:11.699471 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a9f4a834-e546-4758-aca6-69e379fd4957 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:11.700645 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a9f4a834-e546-4758-aca6-69e379fd4957 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: fe7dee09-8351-4d41-8c44-8d35a966cce9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:11.708383 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a9f4a834-e546-4758-aca6-69e379fd4957 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:11.708887 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a9f4a834-e546-4758-aca6-69e379fd4957 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:11.709340 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a9f4a834-e546-4758-aca6-69e379fd4957 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:11.710083 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a9f4a834-e546-4758-aca6-69e379fd4957 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:11.710547 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a9f4a834-e546-4758-aca6-69e379fd4957 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:11.710969 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a9f4a834-e546-4758-aca6-69e379fd4957 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:12.009325 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a9f4a834-e546-4758-aca6-69e379fd4957 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:12.042116 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a9f4a834-e546-4758-aca6-69e379fd4957 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:12.051749 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a9f4a834-e546-4758-aca6-69e379fd4957 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:12.067752 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a9f4a834-e546-4758-aca6-69e379fd4957 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9" status: 200 len: 1724 microversion: 2.20 time: 0.358522 Sep 23 04:48:12.086640 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1954/3854] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:48:11 2022] GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9 => generated 1724 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:48:12.117747 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-18a51672-cd4d-4295-83ae-518138b07712 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:12.118984 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-18a51672-cd4d-4295-83ae-518138b07712 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: c4464422-9bf1-4aaa-806c-d7063e284579] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:12.135329 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-18a51672-cd4d-4295-83ae-518138b07712 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:12.136535 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-18a51672-cd4d-4295-83ae-518138b07712 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:12.148672 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-18a51672-cd4d-4295-83ae-518138b07712 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:12.157364 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-18a51672-cd4d-4295-83ae-518138b07712 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:12.158611 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-18a51672-cd4d-4295-83ae-518138b07712 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:12.159518 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-18a51672-cd4d-4295-83ae-518138b07712 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:12.234117 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=100 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:48:12.422024 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-18a51672-cd4d-4295-83ae-518138b07712 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.334034 Sep 23 04:48:12.422752 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1955/3855] 10.222.0.33 () {58 vars in 1275 bytes} [Fri Sep 23 04:48:12 2022] GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579/os-interface => generated 284 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:48:12.428040 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d5c1d34c-86d1-47a3-a4da-9a4362480fad tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:12.429074 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d5c1d34c-86d1-47a3-a4da-9a4362480fad tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] [instance: 6b1aa3ac-6bda-48be-8814-e1a5ddd510a2] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:12.454248 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d5c1d34c-86d1-47a3-a4da-9a4362480fad tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:12.458500 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d5c1d34c-86d1-47a3-a4da-9a4362480fad tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:12.459333 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d5c1d34c-86d1-47a3-a4da-9a4362480fad tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:12.460289 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d5c1d34c-86d1-47a3-a4da-9a4362480fad tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:12.460911 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d5c1d34c-86d1-47a3-a4da-9a4362480fad tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:12.461521 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d5c1d34c-86d1-47a3-a4da-9a4362480fad tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:12.830934 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d5c1d34c-86d1-47a3-a4da-9a4362480fad tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a245dd82de1340f7a58873de1851c61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d02cb07a2a404c8d89aa13a950806d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:12.841282 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d5c1d34c-86d1-47a3-a4da-9a4362480fad tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] 10.222.0.33 "GET /compute/v2.1/servers/6b1aa3ac-6bda-48be-8814-e1a5ddd510a2" status: 200 len: 1323 microversion: 2.1 time: 0.417362 Sep 23 04:48:12.843565 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1956/3856] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:48:12 2022] GET /compute/v2.1/servers/6b1aa3ac-6bda-48be-8814-e1a5ddd510a2 => generated 1323 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:48:12.849280 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-029b5e41-fe7d-48af-ae57-2e0ac5e2f18d tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:12.850216 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-029b5e41-fe7d-48af-ae57-2e0ac5e2f18d tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] [instance: 3fc8d6fc-3204-43f4-9b94-100d061769a5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:12.858968 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-029b5e41-fe7d-48af-ae57-2e0ac5e2f18d tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:12.860116 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-029b5e41-fe7d-48af-ae57-2e0ac5e2f18d tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:12.860728 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-029b5e41-fe7d-48af-ae57-2e0ac5e2f18d tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:12.861602 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-029b5e41-fe7d-48af-ae57-2e0ac5e2f18d tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:12.862867 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-029b5e41-fe7d-48af-ae57-2e0ac5e2f18d tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:12.863762 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-029b5e41-fe7d-48af-ae57-2e0ac5e2f18d tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:13.009149 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-029b5e41-fe7d-48af-ae57-2e0ac5e2f18d tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae134fe7522941698cad3f3fa11e747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16d72d2469433ca30ba6769e3d3f25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:13.026009 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-029b5e41-fe7d-48af-ae57-2e0ac5e2f18d tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae134fe7522941698cad3f3fa11e747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16d72d2469433ca30ba6769e3d3f25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:13.028022 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-029b5e41-fe7d-48af-ae57-2e0ac5e2f18d tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae134fe7522941698cad3f3fa11e747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16d72d2469433ca30ba6769e3d3f25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:13.029686 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-029b5e41-fe7d-48af-ae57-2e0ac5e2f18d tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] 10.222.0.33 "GET /compute/v2.1/servers/3fc8d6fc-3204-43f4-9b94-100d061769a5" status: 200 len: 1366 microversion: 2.57 time: 0.184726 Sep 23 04:48:13.032749 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1957/3857] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:48:12 2022] GET /compute/v2.1/servers/3fc8d6fc-3204-43f4-9b94-100d061769a5 => generated 1366 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:48:13.094024 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-aa1caaaa-e33d-417b-a421-ecadaeb97d67 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:13.095430 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-aa1caaaa-e33d-417b-a421-ecadaeb97d67 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: fe7dee09-8351-4d41-8c44-8d35a966cce9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:13.101935 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aa1caaaa-e33d-417b-a421-ecadaeb97d67 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:13.103255 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aa1caaaa-e33d-417b-a421-ecadaeb97d67 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:13.103708 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aa1caaaa-e33d-417b-a421-ecadaeb97d67 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:13.104423 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aa1caaaa-e33d-417b-a421-ecadaeb97d67 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:13.107744 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aa1caaaa-e33d-417b-a421-ecadaeb97d67 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:13.108228 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aa1caaaa-e33d-417b-a421-ecadaeb97d67 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:13.467539 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-aa1caaaa-e33d-417b-a421-ecadaeb97d67 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:13.478275 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-aa1caaaa-e33d-417b-a421-ecadaeb97d67 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:13.480802 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-aa1caaaa-e33d-417b-a421-ecadaeb97d67 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:13.482384 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-aa1caaaa-e33d-417b-a421-ecadaeb97d67 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9" status: 200 len: 1724 microversion: 2.20 time: 0.393098 Sep 23 04:48:13.494034 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1958/3858] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:48:13 2022] GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9 => generated 1724 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:48:13.706107 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-efd1e636-7843-41a5-bdf2-b3bd8b9df83f req-4da80b3f-0b77-448c-b12e-71b36a15626f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b1aa3ac-6bda-48be-8814-e1a5ddd510a2", "name": "network-vif-plugged", "status": "completed", "tag": "99d65349-904f-4ecc-8ad9-f7df89c8a9b0"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:48:13.723927 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-efd1e636-7843-41a5-bdf2-b3bd8b9df83f req-4da80b3f-0b77-448c-b12e-71b36a15626f service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:13.726581 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-efd1e636-7843-41a5-bdf2-b3bd8b9df83f req-4da80b3f-0b77-448c-b12e-71b36a15626f service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:13.727692 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-efd1e636-7843-41a5-bdf2-b3bd8b9df83f req-4da80b3f-0b77-448c-b12e-71b36a15626f service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:13.756679 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-efd1e636-7843-41a5-bdf2-b3bd8b9df83f req-4da80b3f-0b77-448c-b12e-71b36a15626f service nova] Creating event network-vif-plugged:99d65349-904f-4ecc-8ad9-f7df89c8a9b0 for instance 6b1aa3ac-6bda-48be-8814-e1a5ddd510a2 on n-h2-846463-3 Sep 23 04:48:13.763952 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-efd1e636-7843-41a5-bdf2-b3bd8b9df83f req-4da80b3f-0b77-448c-b12e-71b36a15626f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062021 Sep 23 04:48:13.765475 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1959/3859] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:48:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:48:13.870866 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-672b41dd-9327-486d-ae0c-f228ef4b6c76 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:13.871583 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-672b41dd-9327-486d-ae0c-f228ef4b6c76 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] [instance: 6b1aa3ac-6bda-48be-8814-e1a5ddd510a2] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:13.893394 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-672b41dd-9327-486d-ae0c-f228ef4b6c76 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:13.893920 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-672b41dd-9327-486d-ae0c-f228ef4b6c76 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:13.894371 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-672b41dd-9327-486d-ae0c-f228ef4b6c76 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:13.895098 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-672b41dd-9327-486d-ae0c-f228ef4b6c76 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:13.895569 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-672b41dd-9327-486d-ae0c-f228ef4b6c76 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:13.924782 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-672b41dd-9327-486d-ae0c-f228ef4b6c76 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:14.389381 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-672b41dd-9327-486d-ae0c-f228ef4b6c76 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a245dd82de1340f7a58873de1851c61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d02cb07a2a404c8d89aa13a950806d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:14.404079 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-672b41dd-9327-486d-ae0c-f228ef4b6c76 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] 10.222.0.33 "GET /compute/v2.1/servers/6b1aa3ac-6bda-48be-8814-e1a5ddd510a2" status: 200 len: 1323 microversion: 2.1 time: 0.539081 Sep 23 04:48:14.405380 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1960/3860] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:48:13 2022] GET /compute/v2.1/servers/6b1aa3ac-6bda-48be-8814-e1a5ddd510a2 => generated 1323 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:48:14.412038 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-06a92790-a62b-4967-9f68-ae722fe1f13d tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:14.413182 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-06a92790-a62b-4967-9f68-ae722fe1f13d tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] [instance: 3fc8d6fc-3204-43f4-9b94-100d061769a5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:14.429739 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=100 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:48:14.433039 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-06a92790-a62b-4967-9f68-ae722fe1f13d tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:14.433908 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-06a92790-a62b-4967-9f68-ae722fe1f13d tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:14.434865 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-06a92790-a62b-4967-9f68-ae722fe1f13d tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:14.436241 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-06a92790-a62b-4967-9f68-ae722fe1f13d tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:14.437105 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-06a92790-a62b-4967-9f68-ae722fe1f13d tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:14.437759 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-06a92790-a62b-4967-9f68-ae722fe1f13d tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:14.587486 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-06a92790-a62b-4967-9f68-ae722fe1f13d tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae134fe7522941698cad3f3fa11e747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16d72d2469433ca30ba6769e3d3f25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:14.596964 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-06a92790-a62b-4967-9f68-ae722fe1f13d tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae134fe7522941698cad3f3fa11e747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16d72d2469433ca30ba6769e3d3f25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:14.598702 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-06a92790-a62b-4967-9f68-ae722fe1f13d tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae134fe7522941698cad3f3fa11e747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16d72d2469433ca30ba6769e3d3f25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:14.600084 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-06a92790-a62b-4967-9f68-ae722fe1f13d tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] 10.222.0.33 "GET /compute/v2.1/servers/3fc8d6fc-3204-43f4-9b94-100d061769a5" status: 200 len: 1366 microversion: 2.57 time: 0.193109 Sep 23 04:48:14.605333 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1961/3861] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:48:14 2022] GET /compute/v2.1/servers/3fc8d6fc-3204-43f4-9b94-100d061769a5 => generated 1366 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:48:14.613229 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6b38e6eb-cc14-40c7-9075-3d93ef247f38 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:14.614135 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-6b38e6eb-cc14-40c7-9075-3d93ef247f38 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: fe7dee09-8351-4d41-8c44-8d35a966cce9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:14.621126 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6b38e6eb-cc14-40c7-9075-3d93ef247f38 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:14.621842 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6b38e6eb-cc14-40c7-9075-3d93ef247f38 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:14.622521 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6b38e6eb-cc14-40c7-9075-3d93ef247f38 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:14.623401 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6b38e6eb-cc14-40c7-9075-3d93ef247f38 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:14.623871 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6b38e6eb-cc14-40c7-9075-3d93ef247f38 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:14.624300 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6b38e6eb-cc14-40c7-9075-3d93ef247f38 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:14.809302 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-6b38e6eb-cc14-40c7-9075-3d93ef247f38 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:14.818431 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-6b38e6eb-cc14-40c7-9075-3d93ef247f38 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:14.820770 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-6b38e6eb-cc14-40c7-9075-3d93ef247f38 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:14.822971 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6b38e6eb-cc14-40c7-9075-3d93ef247f38 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9" status: 200 len: 1724 microversion: 2.20 time: 0.216331 Sep 23 04:48:14.823744 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1962/3862] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:48:14 2022] GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9 => generated 1724 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:48:15.432334 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6c2e49a0-e989-4abf-9b83-200b0e53103b tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:15.433852 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-6c2e49a0-e989-4abf-9b83-200b0e53103b tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] [instance: 6b1aa3ac-6bda-48be-8814-e1a5ddd510a2] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:15.440944 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6c2e49a0-e989-4abf-9b83-200b0e53103b tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:15.442311 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6c2e49a0-e989-4abf-9b83-200b0e53103b tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:15.442964 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6c2e49a0-e989-4abf-9b83-200b0e53103b tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:15.443875 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6c2e49a0-e989-4abf-9b83-200b0e53103b tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:15.444611 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6c2e49a0-e989-4abf-9b83-200b0e53103b tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:15.445238 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6c2e49a0-e989-4abf-9b83-200b0e53103b tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:15.993806 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-6c2e49a0-e989-4abf-9b83-200b0e53103b tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a245dd82de1340f7a58873de1851c61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d02cb07a2a404c8d89aa13a950806d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:16.012200 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6c2e49a0-e989-4abf-9b83-200b0e53103b tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] 10.222.0.33 "GET /compute/v2.1/servers/6b1aa3ac-6bda-48be-8814-e1a5ddd510a2" status: 200 len: 1323 microversion: 2.1 time: 0.582314 Sep 23 04:48:16.012200 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1963/3863] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:48:15 2022] GET /compute/v2.1/servers/6b1aa3ac-6bda-48be-8814-e1a5ddd510a2 => generated 1323 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:48:16.019695 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-50363915-fbd5-446e-8534-00e7959c52fd tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:16.020318 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-50363915-fbd5-446e-8534-00e7959c52fd tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] [instance: 3fc8d6fc-3204-43f4-9b94-100d061769a5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:16.032151 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-50363915-fbd5-446e-8534-00e7959c52fd tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:16.034705 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-50363915-fbd5-446e-8534-00e7959c52fd tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:16.041815 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-50363915-fbd5-446e-8534-00e7959c52fd tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:16.045872 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-50363915-fbd5-446e-8534-00e7959c52fd tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:16.045872 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-50363915-fbd5-446e-8534-00e7959c52fd tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:16.045872 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-50363915-fbd5-446e-8534-00e7959c52fd tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:16.205209 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-50363915-fbd5-446e-8534-00e7959c52fd tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae134fe7522941698cad3f3fa11e747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16d72d2469433ca30ba6769e3d3f25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:16.216670 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-50363915-fbd5-446e-8534-00e7959c52fd tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae134fe7522941698cad3f3fa11e747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16d72d2469433ca30ba6769e3d3f25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:16.218563 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-50363915-fbd5-446e-8534-00e7959c52fd tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae134fe7522941698cad3f3fa11e747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16d72d2469433ca30ba6769e3d3f25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:16.219987 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-50363915-fbd5-446e-8534-00e7959c52fd tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] 10.222.0.33 "GET /compute/v2.1/servers/3fc8d6fc-3204-43f4-9b94-100d061769a5" status: 200 len: 1366 microversion: 2.57 time: 0.204349 Sep 23 04:48:16.220737 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1964/3864] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:48:16 2022] GET /compute/v2.1/servers/3fc8d6fc-3204-43f4-9b94-100d061769a5 => generated 1366 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:48:16.225870 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c99967ee-091d-412d-9834-bfa645949978 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:16.226742 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c99967ee-091d-412d-9834-bfa645949978 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: fe7dee09-8351-4d41-8c44-8d35a966cce9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:16.233294 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c99967ee-091d-412d-9834-bfa645949978 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:16.234037 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c99967ee-091d-412d-9834-bfa645949978 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:16.234666 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c99967ee-091d-412d-9834-bfa645949978 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:16.235609 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c99967ee-091d-412d-9834-bfa645949978 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:16.236298 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c99967ee-091d-412d-9834-bfa645949978 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:16.236910 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c99967ee-091d-412d-9834-bfa645949978 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:16.628469 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c99967ee-091d-412d-9834-bfa645949978 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:16.695481 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c99967ee-091d-412d-9834-bfa645949978 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:16.697724 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c99967ee-091d-412d-9834-bfa645949978 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:16.699379 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c99967ee-091d-412d-9834-bfa645949978 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9" status: 200 len: 1724 microversion: 2.20 time: 0.477533 Sep 23 04:48:16.705143 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1965/3865] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:48:16 2022] GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9 => generated 1724 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:48:16.874931 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-f363ba44-720e-48df-b45f-3d3bf60b0534 req-fc64a2ff-3f39-434b-b913-cff08a8432bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4464422-9bf1-4aaa-806c-d7063e284579", "tag": "1996c9a9-f009-4ec9-a3d8-6f5d1f1f1a46"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:48:16.912725 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-f363ba44-720e-48df-b45f-3d3bf60b0534 req-fc64a2ff-3f39-434b-b913-cff08a8432bc service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:16.914034 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-f363ba44-720e-48df-b45f-3d3bf60b0534 req-fc64a2ff-3f39-434b-b913-cff08a8432bc service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:16.914663 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-f363ba44-720e-48df-b45f-3d3bf60b0534 req-fc64a2ff-3f39-434b-b913-cff08a8432bc service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:16.941418 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-f363ba44-720e-48df-b45f-3d3bf60b0534 req-fc64a2ff-3f39-434b-b913-cff08a8432bc service nova] Creating event network-changed:1996c9a9-f009-4ec9-a3d8-6f5d1f1f1a46 for instance c4464422-9bf1-4aaa-806c-d7063e284579 on n-h1-846463-3 Sep 23 04:48:16.951671 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-f363ba44-720e-48df-b45f-3d3bf60b0534 req-fc64a2ff-3f39-434b-b913-cff08a8432bc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099241 Sep 23 04:48:16.958069 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1966/3866] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:48:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:48:17.041126 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-30f65c3b-1696-4b17-b7f7-c912c0776130 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:17.041853 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-30f65c3b-1696-4b17-b7f7-c912c0776130 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] [instance: 6b1aa3ac-6bda-48be-8814-e1a5ddd510a2] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:17.085743 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-30f65c3b-1696-4b17-b7f7-c912c0776130 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:17.086281 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-30f65c3b-1696-4b17-b7f7-c912c0776130 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:17.095102 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-30f65c3b-1696-4b17-b7f7-c912c0776130 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:17.100546 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-30f65c3b-1696-4b17-b7f7-c912c0776130 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:17.101052 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-30f65c3b-1696-4b17-b7f7-c912c0776130 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:17.101699 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-30f65c3b-1696-4b17-b7f7-c912c0776130 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:17.506682 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-30f65c3b-1696-4b17-b7f7-c912c0776130 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a245dd82de1340f7a58873de1851c61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d02cb07a2a404c8d89aa13a950806d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:17.520719 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-30f65c3b-1696-4b17-b7f7-c912c0776130 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] 10.222.0.33 "GET /compute/v2.1/servers/6b1aa3ac-6bda-48be-8814-e1a5ddd510a2" status: 200 len: 1520 microversion: 2.1 time: 0.483047 Sep 23 04:48:17.522774 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1967/3867] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:48:17 2022] GET /compute/v2.1/servers/6b1aa3ac-6bda-48be-8814-e1a5ddd510a2 => generated 1520 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:48:17.804163 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=3 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:48:17.939330 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5b6cff82-758b-40f3-ac18-b3d9e71121cc tempest-SecurityGroupRulesTestJSON-1847559686 tempest-SecurityGroupRulesTestJSON-1847559686-project] Action: 'create', calling method: .version_select at 0x7ff1ba9929d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-2102014014", "description": "tempest-description-734266083"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:48:18.657954 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5b6cff82-758b-40f3-ac18-b3d9e71121cc tempest-SecurityGroupRulesTestJSON-1847559686 tempest-SecurityGroupRulesTestJSON-1847559686-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.133804 Sep 23 04:48:18.667565 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1968/3868] 10.222.0.33 () {60 vars in 1180 bytes} [Fri Sep 23 04:48:17 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:48:18.667565 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-79e0a304-0317-4ec7-9fd9-9e63d9dde3ef tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:18.667565 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-79e0a304-0317-4ec7-9fd9-9e63d9dde3ef tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] [instance: 3fc8d6fc-3204-43f4-9b94-100d061769a5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:18.688978 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-79e0a304-0317-4ec7-9fd9-9e63d9dde3ef tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:18.693519 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-79e0a304-0317-4ec7-9fd9-9e63d9dde3ef tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:18.694166 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-79e0a304-0317-4ec7-9fd9-9e63d9dde3ef tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:18.699339 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-79e0a304-0317-4ec7-9fd9-9e63d9dde3ef tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:18.699985 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-79e0a304-0317-4ec7-9fd9-9e63d9dde3ef tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:18.701163 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-79e0a304-0317-4ec7-9fd9-9e63d9dde3ef tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:18.913817 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-79e0a304-0317-4ec7-9fd9-9e63d9dde3ef tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae134fe7522941698cad3f3fa11e747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16d72d2469433ca30ba6769e3d3f25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:18.922812 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-79e0a304-0317-4ec7-9fd9-9e63d9dde3ef tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae134fe7522941698cad3f3fa11e747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16d72d2469433ca30ba6769e3d3f25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:18.930109 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-79e0a304-0317-4ec7-9fd9-9e63d9dde3ef tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae134fe7522941698cad3f3fa11e747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16d72d2469433ca30ba6769e3d3f25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:18.932249 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-79e0a304-0317-4ec7-9fd9-9e63d9dde3ef tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] 10.222.0.33 "GET /compute/v2.1/servers/3fc8d6fc-3204-43f4-9b94-100d061769a5" status: 200 len: 1366 microversion: 2.57 time: 0.271852 Sep 23 04:48:18.934738 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1969/3869] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:48:18 2022] GET /compute/v2.1/servers/3fc8d6fc-3204-43f4-9b94-100d061769a5 => generated 1366 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:48:18.944048 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-18760b6d-391d-4d39-9f07-e2d3545db3b6 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:18.951426 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-18760b6d-391d-4d39-9f07-e2d3545db3b6 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] [instance: 6b1aa3ac-6bda-48be-8814-e1a5ddd510a2] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:18.967718 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-18760b6d-391d-4d39-9f07-e2d3545db3b6 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:18.968496 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-18760b6d-391d-4d39-9f07-e2d3545db3b6 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:18.969116 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-18760b6d-391d-4d39-9f07-e2d3545db3b6 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:18.970228 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-18760b6d-391d-4d39-9f07-e2d3545db3b6 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:18.974556 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-18760b6d-391d-4d39-9f07-e2d3545db3b6 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:18.977162 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-18760b6d-391d-4d39-9f07-e2d3545db3b6 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:19.025665 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=8 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:48:19.363725 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-18760b6d-391d-4d39-9f07-e2d3545db3b6 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a245dd82de1340f7a58873de1851c61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d02cb07a2a404c8d89aa13a950806d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:19.372268 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-18760b6d-391d-4d39-9f07-e2d3545db3b6 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] 10.222.0.33 "GET /compute/v2.1/servers/6b1aa3ac-6bda-48be-8814-e1a5ddd510a2" status: 200 len: 1520 microversion: 2.1 time: 0.433304 Sep 23 04:48:19.390240 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1970/3870] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:48:18 2022] GET /compute/v2.1/servers/6b1aa3ac-6bda-48be-8814-e1a5ddd510a2 => generated 1520 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:48:19.396279 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2112effe-eb57-4bb1-9537-eca508221266 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:19.397304 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-2112effe-eb57-4bb1-9537-eca508221266 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: fe7dee09-8351-4d41-8c44-8d35a966cce9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:19.419672 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2112effe-eb57-4bb1-9537-eca508221266 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:19.421128 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2112effe-eb57-4bb1-9537-eca508221266 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:19.421855 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2112effe-eb57-4bb1-9537-eca508221266 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:19.422872 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2112effe-eb57-4bb1-9537-eca508221266 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:19.423574 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2112effe-eb57-4bb1-9537-eca508221266 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:19.424241 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2112effe-eb57-4bb1-9537-eca508221266 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:19.733700 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2112effe-eb57-4bb1-9537-eca508221266 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:19.742998 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2112effe-eb57-4bb1-9537-eca508221266 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:19.746021 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2112effe-eb57-4bb1-9537-eca508221266 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:19.747565 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2112effe-eb57-4bb1-9537-eca508221266 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9" status: 200 len: 1724 microversion: 2.20 time: 0.355391 Sep 23 04:48:19.762299 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1971/3871] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:48:19 2022] GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9 => generated 1724 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:48:19.772834 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-40e1437f-c4a7-47c9-ab2e-46b2d8713c1c tempest-SecurityGroupRulesTestJSON-1847559686 tempest-SecurityGroupRulesTestJSON-1847559686-project] Action: 'create', calling method: .version_select at 0x7ff1ba992700>, body: {"security_group_rule": {"parent_group_id": "b60a50d6-280f-4e41-837d-47b577f3f95c", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:48:20.656474 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-40e1437f-c4a7-47c9-ab2e-46b2d8713c1c tempest-SecurityGroupRulesTestJSON-1847559686 tempest-SecurityGroupRulesTestJSON-1847559686-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.892503 Sep 23 04:48:20.658187 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1972/3872] 10.222.0.33 () {60 vars in 1195 bytes} [Fri Sep 23 04:48:19 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:48:20.696642 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f27bd64d-c6b8-4b2a-ba83-5cac910f8a5b tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1112432749"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:48:20.709535 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f27bd64d-c6b8-4b2a-ba83-5cac910f8a5b tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] [instance: 6b1aa3ac-6bda-48be-8814-e1a5ddd510a2] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:20.722651 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f27bd64d-c6b8-4b2a-ba83-5cac910f8a5b tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:20.723128 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f27bd64d-c6b8-4b2a-ba83-5cac910f8a5b tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:20.724215 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f27bd64d-c6b8-4b2a-ba83-5cac910f8a5b tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:20.725557 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f27bd64d-c6b8-4b2a-ba83-5cac910f8a5b tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:20.726070 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f27bd64d-c6b8-4b2a-ba83-5cac910f8a5b tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:20.727225 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f27bd64d-c6b8-4b2a-ba83-5cac910f8a5b tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:24.310889 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-1cefaf32-b4f7-4646-aa0b-a29e6f51c3f1 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "GET /compute/v2.1/images/efc8a43b-1faf-4f3e-b1e0-5cb6ebaad7c2" status: 200 len: 1463 microversion: 2.1 time: 15.266814 Sep 23 04:48:24.320745 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1901/3873] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:48:09 2022] GET /compute/v2.1/images/efc8a43b-1faf-4f3e-b1e0-5cb6ebaad7c2 => generated 1463 bytes in 15268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:48:24.320745 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8eb6af5d-bf55-4d4f-bd18-a867b1c3fe03 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:24.320745 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8eb6af5d-bf55-4d4f-bd18-a867b1c3fe03 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] [instance: 3fc8d6fc-3204-43f4-9b94-100d061769a5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:24.328441 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8eb6af5d-bf55-4d4f-bd18-a867b1c3fe03 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:24.328441 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8eb6af5d-bf55-4d4f-bd18-a867b1c3fe03 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:24.328441 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8eb6af5d-bf55-4d4f-bd18-a867b1c3fe03 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:24.328441 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8eb6af5d-bf55-4d4f-bd18-a867b1c3fe03 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:24.328441 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8eb6af5d-bf55-4d4f-bd18-a867b1c3fe03 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:24.328441 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8eb6af5d-bf55-4d4f-bd18-a867b1c3fe03 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:24.401159 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8eb6af5d-bf55-4d4f-bd18-a867b1c3fe03 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae134fe7522941698cad3f3fa11e747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16d72d2469433ca30ba6769e3d3f25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:24.410981 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8eb6af5d-bf55-4d4f-bd18-a867b1c3fe03 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae134fe7522941698cad3f3fa11e747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16d72d2469433ca30ba6769e3d3f25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:24.416870 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8eb6af5d-bf55-4d4f-bd18-a867b1c3fe03 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae134fe7522941698cad3f3fa11e747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16d72d2469433ca30ba6769e3d3f25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:24.416870 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8eb6af5d-bf55-4d4f-bd18-a867b1c3fe03 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] 10.222.0.33 "GET /compute/v2.1/servers/3fc8d6fc-3204-43f4-9b94-100d061769a5" status: 200 len: 1366 microversion: 2.57 time: 0.101305 Sep 23 04:48:24.416870 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1902/3874] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:48:24 2022] GET /compute/v2.1/servers/3fc8d6fc-3204-43f4-9b94-100d061769a5 => generated 1366 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:48:24.445933 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9bfacc98-00dd-4b4e-9e22-5c54526b17e7 tempest-SecurityGroupRulesTestJSON-1847559686 tempest-SecurityGroupRulesTestJSON-1847559686-project] Action: 'create', calling method: .version_select at 0x7ff1ba800d30>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1527749426", "description": "tempest-description-528341496"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:48:24.884224 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9bfacc98-00dd-4b4e-9e22-5c54526b17e7 tempest-SecurityGroupRulesTestJSON-1847559686 tempest-SecurityGroupRulesTestJSON-1847559686-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.453463 Sep 23 04:48:24.886004 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1903/3875] 10.222.0.33 () {60 vars in 1180 bytes} [Fri Sep 23 04:48:24 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:48:24.898171 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-67cf4824-bcfb-4098-9139-34e5f9db1aa3 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:24.899212 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-67cf4824-bcfb-4098-9139-34e5f9db1aa3 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: fe7dee09-8351-4d41-8c44-8d35a966cce9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:24.916921 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f27bd64d-c6b8-4b2a-ba83-5cac910f8a5b tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] 10.222.0.33 "POST /compute/v2.1/servers/6b1aa3ac-6bda-48be-8814-e1a5ddd510a2/action" status: 202 len: 0 microversion: 2.1 time: 4.247944 Sep 23 04:48:24.916921 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1973/3876] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:48:20 2022] POST /compute/v2.1/servers/6b1aa3ac-6bda-48be-8814-e1a5ddd510a2/action => generated 0 bytes in 4249 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 23 04:48:24.917584 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-67cf4824-bcfb-4098-9139-34e5f9db1aa3 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:24.917584 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-67cf4824-bcfb-4098-9139-34e5f9db1aa3 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:24.917807 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-67cf4824-bcfb-4098-9139-34e5f9db1aa3 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:24.923226 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-67cf4824-bcfb-4098-9139-34e5f9db1aa3 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:24.923857 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-67cf4824-bcfb-4098-9139-34e5f9db1aa3 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:24.924364 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-67cf4824-bcfb-4098-9139-34e5f9db1aa3 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:24.936478 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f6311ea6-8f78-4c03-8fa4-089367fa6063 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '.version_select at 0x7ff1ba94d700>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:25.112265 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f6311ea6-8f78-4c03-8fa4-089367fa6063 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "GET /compute/v2.1/images/efc8a43b-1faf-4f3e-b1e0-5cb6ebaad7c2" status: 200 len: 1463 microversion: 2.1 time: 0.200340 Sep 23 04:48:25.114667 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1974/3877] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:48:24 2022] GET /compute/v2.1/images/efc8a43b-1faf-4f3e-b1e0-5cb6ebaad7c2 => generated 1463 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:48:25.128749 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-a27e3f48-fe30-4fa1-815b-8c8ff1fe104e req-9e63ab82-7d24-4328-bf5c-db20bec211ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe7dee09-8351-4d41-8c44-8d35a966cce9", "name": "network-vif-plugged", "status": "completed", "tag": "c9b47e66-2bb6-4e68-a2b9-4fb9fec9ff30"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:48:25.147521 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-a27e3f48-fe30-4fa1-815b-8c8ff1fe104e req-9e63ab82-7d24-4328-bf5c-db20bec211ef service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:25.148371 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-a27e3f48-fe30-4fa1-815b-8c8ff1fe104e req-9e63ab82-7d24-4328-bf5c-db20bec211ef service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:25.149528 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-a27e3f48-fe30-4fa1-815b-8c8ff1fe104e req-9e63ab82-7d24-4328-bf5c-db20bec211ef service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:25.165096 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-a27e3f48-fe30-4fa1-815b-8c8ff1fe104e req-9e63ab82-7d24-4328-bf5c-db20bec211ef service nova] Creating event network-vif-plugged:c9b47e66-2bb6-4e68-a2b9-4fb9fec9ff30 for instance fe7dee09-8351-4d41-8c44-8d35a966cce9 on n-h2-846463-3 Sep 23 04:48:25.170902 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-a27e3f48-fe30-4fa1-815b-8c8ff1fe104e req-9e63ab82-7d24-4328-bf5c-db20bec211ef service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053584 Sep 23 04:48:25.171873 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1975/3878] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:48:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:48:25.178216 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d798cdad-446c-4c35-9198-fb6dc26f427e tempest-SecurityGroupRulesTestJSON-1847559686 tempest-SecurityGroupRulesTestJSON-1847559686-project] Action: 'create', calling method: .version_select at 0x7ff1ba9f65e0>, body: {"security_group_rule": {"parent_group_id": "28727362-a34c-41fa-a189-d88e17d2579c", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:48:25.221323 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-67cf4824-bcfb-4098-9139-34e5f9db1aa3 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:25.231309 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-67cf4824-bcfb-4098-9139-34e5f9db1aa3 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:25.232836 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-67cf4824-bcfb-4098-9139-34e5f9db1aa3 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:25.234101 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-67cf4824-bcfb-4098-9139-34e5f9db1aa3 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9" status: 200 len: 1740 microversion: 2.20 time: 0.346603 Sep 23 04:48:25.234995 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1904/3879] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:48:24 2022] GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9 => generated 1740 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:48:25.239953 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9e97eed5-c7ab-4e8b-8a4b-237ede3a3ecb tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Calling method '.version_select at 0x7ff1ba846670>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:25.844250 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d798cdad-446c-4c35-9198-fb6dc26f427e tempest-SecurityGroupRulesTestJSON-1847559686 tempest-SecurityGroupRulesTestJSON-1847559686-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.670112 Sep 23 04:48:25.853835 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1976/3880] 10.222.0.33 () {60 vars in 1195 bytes} [Fri Sep 23 04:48:25 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:48:25.859831 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f9499472-4819-4b94-80ef-78dd5f63612e tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:25.862716 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f9499472-4819-4b94-80ef-78dd5f63612e tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] [instance: 401339a4-8674-4ff9-b09e-ba748f46928d] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:25.882939 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f9499472-4819-4b94-80ef-78dd5f63612e tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:25.883830 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f9499472-4819-4b94-80ef-78dd5f63612e tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:25.884458 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f9499472-4819-4b94-80ef-78dd5f63612e tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:25.885355 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f9499472-4819-4b94-80ef-78dd5f63612e tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:25.886018 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f9499472-4819-4b94-80ef-78dd5f63612e tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:25.887014 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f9499472-4819-4b94-80ef-78dd5f63612e tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:25.898053 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:48:26.142146 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f9499472-4819-4b94-80ef-78dd5f63612e tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff662b5d5b9e488d906565b490c8acf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dcca3b014be4e98b7db17bb37d073a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:26.157207 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f9499472-4819-4b94-80ef-78dd5f63612e tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "GET /compute/v2.1/servers/401339a4-8674-4ff9-b09e-ba748f46928d" status: 200 len: 1467 microversion: 2.1 time: 0.300056 Sep 23 04:48:26.158289 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1977/3881] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:48:25 2022] GET /compute/v2.1/servers/401339a4-8674-4ff9-b09e-ba748f46928d => generated 1467 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:48:26.165355 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-56d47a27-68ab-4078-a190-d93ec3d7e435 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:26.166386 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-56d47a27-68ab-4078-a190-d93ec3d7e435 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] [instance: 3fc8d6fc-3204-43f4-9b94-100d061769a5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:26.175576 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-56d47a27-68ab-4078-a190-d93ec3d7e435 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:26.176404 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-56d47a27-68ab-4078-a190-d93ec3d7e435 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:26.179648 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-56d47a27-68ab-4078-a190-d93ec3d7e435 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:26.182792 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-56d47a27-68ab-4078-a190-d93ec3d7e435 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:26.184133 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-56d47a27-68ab-4078-a190-d93ec3d7e435 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:26.185926 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-56d47a27-68ab-4078-a190-d93ec3d7e435 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:26.363576 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-56d47a27-68ab-4078-a190-d93ec3d7e435 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae134fe7522941698cad3f3fa11e747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16d72d2469433ca30ba6769e3d3f25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:26.375266 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-56d47a27-68ab-4078-a190-d93ec3d7e435 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae134fe7522941698cad3f3fa11e747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16d72d2469433ca30ba6769e3d3f25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:26.377350 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-56d47a27-68ab-4078-a190-d93ec3d7e435 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae134fe7522941698cad3f3fa11e747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16d72d2469433ca30ba6769e3d3f25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:26.380020 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-56d47a27-68ab-4078-a190-d93ec3d7e435 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] 10.222.0.33 "GET /compute/v2.1/servers/3fc8d6fc-3204-43f4-9b94-100d061769a5" status: 200 len: 1366 microversion: 2.57 time: 0.219864 Sep 23 04:48:26.392970 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1978/3882] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:48:26 2022] GET /compute/v2.1/servers/3fc8d6fc-3204-43f4-9b94-100d061769a5 => generated 1366 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:48:26.407055 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c90a8f45-60d9-4cc0-9c63-bbd0f8106046 tempest-SecurityGroupRulesTestJSON-1847559686 tempest-SecurityGroupRulesTestJSON-1847559686-project] Action: 'create', calling method: .version_select at 0x7ff1ba943ee0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-2122785558", "description": "tempest-description-1712231621"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:48:27.122839 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c90a8f45-60d9-4cc0-9c63-bbd0f8106046 tempest-SecurityGroupRulesTestJSON-1847559686 tempest-SecurityGroupRulesTestJSON-1847559686-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.727767 Sep 23 04:48:27.123784 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1979/3883] 10.222.0.33 () {60 vars in 1180 bytes} [Fri Sep 23 04:48:26 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:48:27.128347 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-bb6f5920-1d54-402e-84d2-37fa62084775 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '.version_select at 0x7ff1ba9f65e0>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:28.862829 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9e97eed5-c7ab-4e8b-8a4b-237ede3a3ecb tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] 10.222.0.33 "DELETE /compute/v2.1/images/a26ee699-a26c-4ab4-aa2c-184c1d1065ba" status: 204 len: 0 microversion: 2.1 time: 3.626088 Sep 23 04:48:28.863695 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1905/3884] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:48:25 2022] DELETE /compute/v2.1/images/a26ee699-a26c-4ab4-aa2c-184c1d1065ba => generated 0 bytes in 3628 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:48:28.874326 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c9244ee1-1332-441a-b210-ff096fb697fe tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:28.875443 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c9244ee1-1332-441a-b210-ff096fb697fe tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: fe7dee09-8351-4d41-8c44-8d35a966cce9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:28.887256 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c9244ee1-1332-441a-b210-ff096fb697fe tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:28.888318 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c9244ee1-1332-441a-b210-ff096fb697fe tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:28.889556 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c9244ee1-1332-441a-b210-ff096fb697fe tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:28.891317 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c9244ee1-1332-441a-b210-ff096fb697fe tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:28.892394 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c9244ee1-1332-441a-b210-ff096fb697fe tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:28.893867 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c9244ee1-1332-441a-b210-ff096fb697fe tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:28.999109 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-bb6f5920-1d54-402e-84d2-37fa62084775 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "GET /compute/v2.1/images?changes-since=2022-09-23T04%3A46%3A23Z" status: 200 len: 1901 microversion: 2.1 time: 1.873249 Sep 23 04:48:29.014887 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1980/3885] 10.222.0.33 () {58 vars in 1199 bytes} [Fri Sep 23 04:48:27 2022] GET /compute/v2.1/images?changes-since=2022-09-23T04%3A46%3A23Z => generated 1901 bytes in 1890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:48:29.029397 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-aea47dda-6866-4422-8169-3b391941d9e4 tempest-SecurityGroupRulesTestJSON-1847559686 tempest-SecurityGroupRulesTestJSON-1847559686-project] Action: 'create', calling method: .version_select at 0x7ff1ba9950d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1316603548", "description": "tempest-description-1828056590"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:48:29.112295 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c9244ee1-1332-441a-b210-ff096fb697fe tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:29.124706 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c9244ee1-1332-441a-b210-ff096fb697fe tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:29.127965 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c9244ee1-1332-441a-b210-ff096fb697fe tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:29.129601 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c9244ee1-1332-441a-b210-ff096fb697fe tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9" status: 200 len: 1740 microversion: 2.20 time: 0.264138 Sep 23 04:48:29.130392 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1906/3886] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:48:28 2022] GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9 => generated 1740 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:48:29.139536 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a2d660e3-c692-4bbf-a646-47f26a965be7 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:29.140663 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a2d660e3-c692-4bbf-a646-47f26a965be7 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] [instance: 3fc8d6fc-3204-43f4-9b94-100d061769a5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:29.152344 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a2d660e3-c692-4bbf-a646-47f26a965be7 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:29.152912 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a2d660e3-c692-4bbf-a646-47f26a965be7 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:29.153409 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a2d660e3-c692-4bbf-a646-47f26a965be7 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:29.154300 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a2d660e3-c692-4bbf-a646-47f26a965be7 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:29.154928 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a2d660e3-c692-4bbf-a646-47f26a965be7 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:29.155455 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a2d660e3-c692-4bbf-a646-47f26a965be7 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:29.224537 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a2d660e3-c692-4bbf-a646-47f26a965be7 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae134fe7522941698cad3f3fa11e747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16d72d2469433ca30ba6769e3d3f25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:29.234327 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a2d660e3-c692-4bbf-a646-47f26a965be7 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae134fe7522941698cad3f3fa11e747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16d72d2469433ca30ba6769e3d3f25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:29.302098 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a2d660e3-c692-4bbf-a646-47f26a965be7 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae134fe7522941698cad3f3fa11e747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16d72d2469433ca30ba6769e3d3f25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:29.302098 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a2d660e3-c692-4bbf-a646-47f26a965be7 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] 10.222.0.33 "GET /compute/v2.1/servers/3fc8d6fc-3204-43f4-9b94-100d061769a5" status: 200 len: 1366 microversion: 2.57 time: 0.105614 Sep 23 04:48:29.302098 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1907/3887] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:48:29 2022] GET /compute/v2.1/servers/3fc8d6fc-3204-43f4-9b94-100d061769a5 => generated 1366 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:48:29.302098 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c530ee77-31c7-48e7-87e9-17576bf0798b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:29.302098 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c530ee77-31c7-48e7-87e9-17576bf0798b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:29.302098 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c530ee77-31c7-48e7-87e9-17576bf0798b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:29.302098 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c530ee77-31c7-48e7-87e9-17576bf0798b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:29.302098 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c530ee77-31c7-48e7-87e9-17576bf0798b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:29.302098 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c530ee77-31c7-48e7-87e9-17576bf0798b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:29.302098 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c530ee77-31c7-48e7-87e9-17576bf0798b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:29.302098 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c530ee77-31c7-48e7-87e9-17576bf0798b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:29.409624 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c530ee77-31c7-48e7-87e9-17576bf0798b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:29.418025 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c530ee77-31c7-48e7-87e9-17576bf0798b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1683 microversion: 2.1 time: 0.179328 Sep 23 04:48:29.418636 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1908/3888] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:48:29 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1683 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:48:29.422950 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-52a1a3b4-a4bb-4fbf-873e-9eb6f0a2b6ff tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Calling method '.version_select at 0x7ff1ba9f3820>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:29.451243 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-52a1a3b4-a4bb-4fbf-873e-9eb6f0a2b6ff tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] HTTP exception thrown: Image not found. Sep 23 04:48:29.451243 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-52a1a3b4-a4bb-4fbf-873e-9eb6f0a2b6ff tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Request method failure captured: Sep 23 04:48:29.451243 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/images/a26ee699-a26c-4ab4-aa2c-184c1d1065ba HTTP/1.1 Sep 23 04:48:29.451243 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:48:29.451243 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:48:29.451243 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:48:29.451243 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:48:29.451243 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:48:29.451243 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:48:29.451243 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:48:29.451243 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:48:29.451243 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTpFpjGPh25TzqBKyhrvLvaFWkL4faeTDdKKBYZ-4258bHvdM5kvJeJfEcGV73OAvtYNm_BDk9uKOKPqKlfTdSYy5tbnqP456--ua0TKxu-LM-map64NPTKy_GCC6WVYwCbUhwP1cF4hdC1uo-LvpY1Eaa8dgHWJxu3z0t2BBREm_ZE Sep 23 04:48:29.451243 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:48:29.451243 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:48:29.451243 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:48:29.451243 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:48:29.451243 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:48:29.451243 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:48:29.451243 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 53d02cb07a2a404c8d89aa13a950806d Sep 23 04:48:29.451243 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-728698197 Sep 23 04:48:29.451243 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:48:29.451243 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:48:29.451243 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_53d02cb07a2a404c8d89aa13a950806d", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/53d02cb07a2a404c8d89aa13a950806d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/53d02cb07a2a404c8d89aa13a950806d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/53d02cb07a2a404c8d89aa13a950806d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:48:29.451243 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-728698197 Sep 23 04:48:29.451243 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 53d02cb07a2a404c8d89aa13a950806d Sep 23 04:48:29.451243 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-728698197 Sep 23 04:48:29.451243 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ImagesOneServerNegativeTestJSON-728698197-project Sep 23 04:48:29.451243 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:48:29.451243 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:48:29.451243 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: a245dd82de1340f7a58873de1851c61c Sep 23 04:48:29.451243 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-728698197-project Sep 23 04:48:29.451243 n-d-846463-3 devstack@n-api.service[122698]: method: Sep 23 04:48:29.451243 n-d-846463-3 devstack@n-api.service[122698]: exception: Image not found. Sep 23 04:48:29.451243 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': 'a26ee699-a26c-4ab4-aa2c-184c1d1065ba'} Sep 23 04:48:29.451243 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:48:29.451243 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:48:29.451243 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 23 04:48:29.451243 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 23 04:48:29.451243 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 23 04:48:29.451243 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 23 04:48:29.451243 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 23 04:48:29.451243 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 23 04:48:29.451243 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 23 04:48:29.451243 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 23 04:48:29.451243 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 23 04:48:29.451243 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 23 04:48:29.451243 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 23 04:48:29.451243 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 23 04:48:29.451243 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 23 04:48:29.451243 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 23 04:48:29.451243 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 23 04:48:29.451243 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 23 04:48:29.451243 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID a26ee699-a26c-4ab4-aa2c-184c1d1065ba Sep 23 04:48:29.451243 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:48:29.451243 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:48:29.451243 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:48:29.451243 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:48:29.451243 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Sep 23 04:48:29.451243 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Sep 23 04:48:29.451243 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 23 04:48:29.451243 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 23 04:48:29.456467 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 23 04:48:29.456467 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 23 04:48:29.456467 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 23 04:48:29.456467 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 23 04:48:29.456467 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 23 04:48:29.456467 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 23 04:48:29.456467 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 23 04:48:29.456467 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 23 04:48:29.456467 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 23 04:48:29.456467 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 23 04:48:29.456467 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 23 04:48:29.456467 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 23 04:48:29.456467 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 23 04:48:29.456467 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 23 04:48:29.456467 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 23 04:48:29.456467 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 23 04:48:29.456467 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 23 04:48:29.456467 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 23 04:48:29.456467 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 23 04:48:29.456467 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 23 04:48:29.456467 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a26ee699-a26c-4ab4-aa2c-184c1d1065ba could not be found. Sep 23 04:48:29.456467 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:48:29.456467 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:48:29.456467 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:48:29.456467 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:48:29.456467 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:48:29.456467 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:48:29.456467 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:48:29.456467 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:48:29.456467 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:48:29.456467 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:48:29.456467 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:48:29.456467 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:48:29.456467 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Sep 23 04:48:29.456467 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 23 04:48:29.456467 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 23 04:48:29.456467 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:48:29.456467 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:48:29.456467 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:48:29.456467 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:48:29.456467 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:48:29.456467 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:48:29.456467 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:48:29.456467 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:48:29.456467 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 23 04:48:29.456467 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:48:29.456467 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-52a1a3b4-a4bb-4fbf-873e-9eb6f0a2b6ff tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Returning 404 to user: Image not found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:48:29.456467 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-52a1a3b4-a4bb-4fbf-873e-9eb6f0a2b6ff tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] 10.222.0.33 "GET /compute/v2.1/images/a26ee699-a26c-4ab4-aa2c-184c1d1065ba" status: 404 len: 62 microversion: 2.1 time: 0.026682 Sep 23 04:48:29.456467 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1909/3889] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:48:29 2022] GET /compute/v2.1/images/a26ee699-a26c-4ab4-aa2c-184c1d1065ba => generated 62 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 23 04:48:29.456467 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5b5f34cb-a354-4305-b02e-19705e6a766d tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '.version_select at 0x7ff1ba9ad0d0>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:29.531358 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5b5f34cb-a354-4305-b02e-19705e6a766d tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-420410748" status: 200 len: 484 microversion: 2.1 time: 0.083527 Sep 23 04:48:29.531974 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1910/3890] 10.222.0.33 () {58 vars in 1229 bytes} [Fri Sep 23 04:48:29 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-420410748 => generated 484 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:48:29.551159 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-07fe6f53-efb3-4424-a5e9-3e0735734aad tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:29.551894 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-07fe6f53-efb3-4424-a5e9-3e0735734aad tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] [instance: 6b1aa3ac-6bda-48be-8814-e1a5ddd510a2] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:29.562163 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-07fe6f53-efb3-4424-a5e9-3e0735734aad tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:29.562163 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-07fe6f53-efb3-4424-a5e9-3e0735734aad tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:29.562163 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-07fe6f53-efb3-4424-a5e9-3e0735734aad tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:29.562163 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-07fe6f53-efb3-4424-a5e9-3e0735734aad tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:29.562163 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-07fe6f53-efb3-4424-a5e9-3e0735734aad tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:29.562844 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-07fe6f53-efb3-4424-a5e9-3e0735734aad tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:29.760470 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-07fe6f53-efb3-4424-a5e9-3e0735734aad tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a245dd82de1340f7a58873de1851c61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d02cb07a2a404c8d89aa13a950806d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:29.771525 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-07fe6f53-efb3-4424-a5e9-3e0735734aad tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] 10.222.0.33 "GET /compute/v2.1/servers/6b1aa3ac-6bda-48be-8814-e1a5ddd510a2" status: 200 len: 1533 microversion: 2.1 time: 0.238362 Sep 23 04:48:29.772116 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1911/3891] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:48:29 2022] GET /compute/v2.1/servers/6b1aa3ac-6bda-48be-8814-e1a5ddd510a2 => generated 1533 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:48:29.786615 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a201e249-7050-4d17-865a-4afa8aac6167 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '.version_select at 0x7ff1ba8460d0>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:29.941337 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-aea47dda-6866-4422-8169-3b391941d9e4 tempest-SecurityGroupRulesTestJSON-1847559686 tempest-SecurityGroupRulesTestJSON-1847559686-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.924859 Sep 23 04:48:29.945667 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a201e249-7050-4d17-865a-4afa8aac6167 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "GET /compute/v2.1/images?server=401339a4-8674-4ff9-b09e-ba748f46928d" status: 200 len: 956 microversion: 2.1 time: 0.162975 Sep 23 04:48:29.947351 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1912/3892] 10.222.0.33 () {58 vars in 1209 bytes} [Fri Sep 23 04:48:29 2022] GET /compute/v2.1/images?server=401339a4-8674-4ff9-b09e-ba748f46928d => generated 956 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:48:29.951121 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1981/3893] 10.222.0.33 () {60 vars in 1180 bytes} [Fri Sep 23 04:48:29 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:48:29.964870 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-340aeec8-2043-41c1-95cf-9bd5ba35e6b4 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '.version_select at 0x7ff1ba9525e0>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:29.984592 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-79b134ed-1516-4766-9c9a-a91146f435f2 tempest-SecurityGroupRulesTestJSON-1847559686 tempest-SecurityGroupRulesTestJSON-1847559686-project] Action: 'create', calling method: .version_select at 0x7ff1ba8d6160>, body: {"security_group_rule": {"parent_group_id": "f552062e-fbef-4048-b33b-34792531cdc0", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "247c34db-f15d-43e2-baee-775ca713ae53"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:48:30.046414 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-340aeec8-2043-41c1-95cf-9bd5ba35e6b4 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.33%2Fcompute%2Fv2.1%2Fservers%2Fa0eac077-d4bd-4e4a-a04a-3f86aeeed9bd" status: 200 len: 485 microversion: 2.1 time: 0.087839 Sep 23 04:48:30.050696 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1982/3894] 10.222.0.33 () {58 vars in 1317 bytes} [Fri Sep 23 04:48:29 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.33%2Fcompute%2Fv2.1%2Fservers%2Fa0eac077-d4bd-4e4a-a04a-3f86aeeed9bd => generated 485 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:48:30.059164 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0f95bf2f-f9b9-462f-a885-2e1378d68006 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '.version_select at 0x7ff1ba94dc10>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:30.167085 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0f95bf2f-f9b9-462f-a885-2e1378d68006 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.33%2Fcompute%2Fservers%2Fa0eac077-d4bd-4e4a-a04a-3f86aeeed9bd" status: 200 len: 485 microversion: 2.1 time: 0.109019 Sep 23 04:48:30.170662 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1983/3895] 10.222.0.33 () {58 vars in 1303 bytes} [Fri Sep 23 04:48:30 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.33%2Fcompute%2Fservers%2Fa0eac077-d4bd-4e4a-a04a-3f86aeeed9bd => generated 485 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:48:30.196057 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8656139c-8114-43f6-a333-de8097afd2b5 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:30.196550 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-8656139c-8114-43f6-a333-de8097afd2b5 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: fe7dee09-8351-4d41-8c44-8d35a966cce9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:30.209563 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8656139c-8114-43f6-a333-de8097afd2b5 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:30.210034 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8656139c-8114-43f6-a333-de8097afd2b5 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:30.210483 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8656139c-8114-43f6-a333-de8097afd2b5 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:30.212675 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8656139c-8114-43f6-a333-de8097afd2b5 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:30.213144 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8656139c-8114-43f6-a333-de8097afd2b5 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:30.216189 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8656139c-8114-43f6-a333-de8097afd2b5 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:30.448192 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-8656139c-8114-43f6-a333-de8097afd2b5 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:30.462459 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-8656139c-8114-43f6-a333-de8097afd2b5 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:30.463933 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-8656139c-8114-43f6-a333-de8097afd2b5 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:30.465142 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-8656139c-8114-43f6-a333-de8097afd2b5 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9" status: 200 len: 1740 microversion: 2.20 time: 0.293290 Sep 23 04:48:30.473976 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1984/3896] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:48:30 2022] GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9 => generated 1740 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:48:30.481907 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5f5abd1c-9123-45f2-bd65-aa0149f973fc tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '.version_select at 0x7ff1ba952280>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:30.625115 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5f5abd1c-9123-45f2-bd65-aa0149f973fc tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3279 microversion: 2.1 time: 0.149469 Sep 23 04:48:30.625968 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1985/3897] 10.222.0.33 () {58 vars in 1149 bytes} [Fri Sep 23 04:48:30 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3279 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:48:30.656160 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-7bdd7fa8-ff5e-4bfd-a34d-79e02a800ca1 req-dcbec284-7b85-404f-a516-96571af70242 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "401339a4-8674-4ff9-b09e-ba748f46928d", "name": "network-vif-unplugged", "status": "completed", "tag": "ee716fd2-ccf3-4c05-b155-29bb9a5565c2"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:48:30.692647 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-7bdd7fa8-ff5e-4bfd-a34d-79e02a800ca1 req-dcbec284-7b85-404f-a516-96571af70242 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:30.693515 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-7bdd7fa8-ff5e-4bfd-a34d-79e02a800ca1 req-dcbec284-7b85-404f-a516-96571af70242 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:30.694805 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-7bdd7fa8-ff5e-4bfd-a34d-79e02a800ca1 req-dcbec284-7b85-404f-a516-96571af70242 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:30.708428 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-7bdd7fa8-ff5e-4bfd-a34d-79e02a800ca1 req-dcbec284-7b85-404f-a516-96571af70242 service nova] Creating event network-vif-unplugged:ee716fd2-ccf3-4c05-b155-29bb9a5565c2 for instance 401339a4-8674-4ff9-b09e-ba748f46928d on n-h1-846463-3 Sep 23 04:48:30.713817 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-7bdd7fa8-ff5e-4bfd-a34d-79e02a800ca1 req-dcbec284-7b85-404f-a516-96571af70242 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072985 Sep 23 04:48:30.718693 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1986/3898] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:48:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:48:30.724660 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-cd00005d-49dd-4aa5-98db-e85b73df2a93 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:30.725796 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-cd00005d-49dd-4aa5-98db-e85b73df2a93 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] [instance: 3fc8d6fc-3204-43f4-9b94-100d061769a5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:30.732841 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cd00005d-49dd-4aa5-98db-e85b73df2a93 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:30.733561 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cd00005d-49dd-4aa5-98db-e85b73df2a93 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:30.734234 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cd00005d-49dd-4aa5-98db-e85b73df2a93 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:30.735128 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cd00005d-49dd-4aa5-98db-e85b73df2a93 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:30.735766 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cd00005d-49dd-4aa5-98db-e85b73df2a93 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:30.736386 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cd00005d-49dd-4aa5-98db-e85b73df2a93 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:30.769850 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-79b134ed-1516-4766-9c9a-a91146f435f2 tempest-SecurityGroupRulesTestJSON-1847559686 tempest-SecurityGroupRulesTestJSON-1847559686-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.800318 Sep 23 04:48:30.778364 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1913/3899] 10.222.0.33 () {60 vars in 1195 bytes} [Fri Sep 23 04:48:29 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:48:30.783311 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-cf77456b-d970-4018-a3f1-efba42f6dddf tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:30.784177 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-cf77456b-d970-4018-a3f1-efba42f6dddf tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:30.799335 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cf77456b-d970-4018-a3f1-efba42f6dddf tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:30.800800 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cf77456b-d970-4018-a3f1-efba42f6dddf tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:30.801772 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cf77456b-d970-4018-a3f1-efba42f6dddf tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:30.803266 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cf77456b-d970-4018-a3f1-efba42f6dddf tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:30.804419 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cf77456b-d970-4018-a3f1-efba42f6dddf tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:30.805483 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cf77456b-d970-4018-a3f1-efba42f6dddf tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:30.816288 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-cd00005d-49dd-4aa5-98db-e85b73df2a93 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae134fe7522941698cad3f3fa11e747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16d72d2469433ca30ba6769e3d3f25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:30.827580 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-cd00005d-49dd-4aa5-98db-e85b73df2a93 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae134fe7522941698cad3f3fa11e747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16d72d2469433ca30ba6769e3d3f25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:30.832511 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-cd00005d-49dd-4aa5-98db-e85b73df2a93 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae134fe7522941698cad3f3fa11e747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16d72d2469433ca30ba6769e3d3f25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:30.833729 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-cd00005d-49dd-4aa5-98db-e85b73df2a93 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] 10.222.0.33 "GET /compute/v2.1/servers/3fc8d6fc-3204-43f4-9b94-100d061769a5" status: 200 len: 1366 microversion: 2.57 time: 0.113472 Sep 23 04:48:30.834332 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1987/3900] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:48:30 2022] GET /compute/v2.1/servers/3fc8d6fc-3204-43f4-9b94-100d061769a5 => generated 1366 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:48:30.857563 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-99347196-c14e-4b06-8e88-bec41520898c tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '.version_select at 0x7ff1ba9954c0>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:30.972931 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-99347196-c14e-4b06-8e88-bec41520898c tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1429 microversion: 2.1 time: 0.137341 Sep 23 04:48:30.974270 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1988/3901] 10.222.0.33 () {58 vars in 1149 bytes} [Fri Sep 23 04:48:30 2022] GET /compute/v2.1/images?type=snapshot => generated 1429 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:48:30.980092 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c1c90f96-ef57-4dd8-9fae-cc07aa9806b3 tempest-SecurityGroupRulesTestJSON-1847559686 tempest-SecurityGroupRulesTestJSON-1847559686-project] Action: 'create', calling method: .version_select at 0x7ff1ba94d5e0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1950535729", "description": "tempest-description-2136910210"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:48:30.988716 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-cf77456b-d970-4018-a3f1-efba42f6dddf tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:31.003450 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-cf77456b-d970-4018-a3f1-efba42f6dddf tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1670 microversion: 2.1 time: 0.221904 Sep 23 04:48:31.018116 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1914/3902] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:48:30 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1670 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:48:31.026503 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5bfe4e1f-cec9-4a75-9203-bc64832334b7 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:31.027606 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5bfe4e1f-cec9-4a75-9203-bc64832334b7 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] [instance: 6b1aa3ac-6bda-48be-8814-e1a5ddd510a2] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:31.037354 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5bfe4e1f-cec9-4a75-9203-bc64832334b7 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:31.038164 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5bfe4e1f-cec9-4a75-9203-bc64832334b7 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:31.038993 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5bfe4e1f-cec9-4a75-9203-bc64832334b7 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:31.040449 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5bfe4e1f-cec9-4a75-9203-bc64832334b7 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:31.041546 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5bfe4e1f-cec9-4a75-9203-bc64832334b7 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:31.042278 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5bfe4e1f-cec9-4a75-9203-bc64832334b7 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:31.298142 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-5bfe4e1f-cec9-4a75-9203-bc64832334b7 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a245dd82de1340f7a58873de1851c61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d02cb07a2a404c8d89aa13a950806d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:31.311606 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5bfe4e1f-cec9-4a75-9203-bc64832334b7 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] 10.222.0.33 "GET /compute/v2.1/servers/6b1aa3ac-6bda-48be-8814-e1a5ddd510a2" status: 200 len: 1520 microversion: 2.1 time: 0.292212 Sep 23 04:48:31.339261 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1915/3903] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:48:31 2022] GET /compute/v2.1/servers/6b1aa3ac-6bda-48be-8814-e1a5ddd510a2 => generated 1520 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:48:31.349878 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f4b38f8a-d89f-4b46-b8f6-3291057b176f tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '.version_select at 0x7ff1ba846a60>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:31.424277 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f4b38f8a-d89f-4b46-b8f6-3291057b176f tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "GET /compute/v2.1/images?limit=1" status: 200 len: 621 microversion: 2.1 time: 0.082141 Sep 23 04:48:31.425158 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1916/3904] 10.222.0.33 () {58 vars in 1137 bytes} [Fri Sep 23 04:48:31 2022] GET /compute/v2.1/images?limit=1 => generated 621 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:48:31.431181 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3791cd46-3a5a-4810-8c72-55e4e523be14 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-1412954971"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:48:31.433826 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3791cd46-3a5a-4810-8c72-55e4e523be14 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:31.443154 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3791cd46-3a5a-4810-8c72-55e4e523be14 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:31.443617 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3791cd46-3a5a-4810-8c72-55e4e523be14 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:31.444446 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3791cd46-3a5a-4810-8c72-55e4e523be14 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:31.445162 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3791cd46-3a5a-4810-8c72-55e4e523be14 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:31.445668 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3791cd46-3a5a-4810-8c72-55e4e523be14 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:31.446128 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3791cd46-3a5a-4810-8c72-55e4e523be14 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:31.550935 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c1c90f96-ef57-4dd8-9fae-cc07aa9806b3 tempest-SecurityGroupRulesTestJSON-1847559686 tempest-SecurityGroupRulesTestJSON-1847559686-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.575108 Sep 23 04:48:31.552024 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1989/3905] 10.222.0.33 () {60 vars in 1180 bytes} [Fri Sep 23 04:48:30 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:48:31.557720 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2e90173d-a5cc-4700-bff8-f8e399342d5f tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:31.558474 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-2e90173d-a5cc-4700-bff8-f8e399342d5f tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] [instance: 6b1aa3ac-6bda-48be-8814-e1a5ddd510a2] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:31.567324 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2e90173d-a5cc-4700-bff8-f8e399342d5f tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:31.567324 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2e90173d-a5cc-4700-bff8-f8e399342d5f tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:31.568067 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2e90173d-a5cc-4700-bff8-f8e399342d5f tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:31.568861 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2e90173d-a5cc-4700-bff8-f8e399342d5f tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:31.569428 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2e90173d-a5cc-4700-bff8-f8e399342d5f tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:31.570206 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2e90173d-a5cc-4700-bff8-f8e399342d5f tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:31.605738 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-2e90173d-a5cc-4700-bff8-f8e399342d5f tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] [instance: 6b1aa3ac-6bda-48be-8814-e1a5ddd510a2] Going to try to terminate instance {{(pid=122699) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:48:31.881859 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3791cd46-3a5a-4810-8c72-55e4e523be14 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "POST /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5/action" status: 202 len: 0 microversion: 2.1 time: 0.455304 Sep 23 04:48:31.882842 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1917/3906] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:48:31 2022] POST /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5/action => generated 0 bytes in 457 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Sep 23 04:48:31.895318 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2e90173d-a5cc-4700-bff8-f8e399342d5f tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6b1aa3ac-6bda-48be-8814-e1a5ddd510a2" status: 204 len: 0 microversion: 2.1 time: 0.341477 Sep 23 04:48:31.899942 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1990/3907] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:48:31 2022] DELETE /compute/v2.1/servers/6b1aa3ac-6bda-48be-8814-e1a5ddd510a2 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:48:31.905345 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e237848b-e293-4460-afc5-be4e714f087c tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '.version_select at 0x7ff1ba9c9820>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:31.927931 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-17debf5b-cb76-4186-b66f-f79ddd790388 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:31.928661 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-17debf5b-cb76-4186-b66f-f79ddd790388 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: fe7dee09-8351-4d41-8c44-8d35a966cce9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:31.946915 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-17debf5b-cb76-4186-b66f-f79ddd790388 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:31.947706 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-17debf5b-cb76-4186-b66f-f79ddd790388 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:31.948186 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-17debf5b-cb76-4186-b66f-f79ddd790388 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:31.949169 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-17debf5b-cb76-4186-b66f-f79ddd790388 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:31.950114 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-17debf5b-cb76-4186-b66f-f79ddd790388 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:31.950755 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-17debf5b-cb76-4186-b66f-f79ddd790388 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:32.085430 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e237848b-e293-4460-afc5-be4e714f087c tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "GET /compute/v2.1/images/detail?changes-since=2022-09-23T04%3A46%3A16Z" status: 200 len: 6332 microversion: 2.1 time: 0.201090 Sep 23 04:48:32.086543 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1918/3908] 10.222.0.33 () {58 vars in 1220 bytes} [Fri Sep 23 04:48:31 2022] GET /compute/v2.1/images/detail?changes-since=2022-09-23T04%3A46%3A16Z => generated 6332 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:48:32.105246 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-670dcf7c-b6aa-456d-b148-1abd021a44c4 tempest-SecurityGroupRulesTestJSON-1847559686 tempest-SecurityGroupRulesTestJSON-1847559686-project] Action: 'create', calling method: .version_select at 0x7ff1ba99dca0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1051630545", "description": "tempest-description-1893322879"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:48:32.167400 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-17debf5b-cb76-4186-b66f-f79ddd790388 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:32.176503 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-17debf5b-cb76-4186-b66f-f79ddd790388 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:32.178207 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-17debf5b-cb76-4186-b66f-f79ddd790388 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:32.179418 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-17debf5b-cb76-4186-b66f-f79ddd790388 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9" status: 200 len: 1740 microversion: 2.20 time: 0.272578 Sep 23 04:48:32.180022 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1991/3909] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:48:31 2022] GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9 => generated 1740 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:48:32.184910 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8d374bf0-fed0-4e95-ac10-ce2e649096e2 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:32.185830 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-8d374bf0-fed0-4e95-ac10-ce2e649096e2 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] [instance: 3fc8d6fc-3204-43f4-9b94-100d061769a5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:32.206747 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8d374bf0-fed0-4e95-ac10-ce2e649096e2 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:32.206747 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8d374bf0-fed0-4e95-ac10-ce2e649096e2 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:32.206747 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8d374bf0-fed0-4e95-ac10-ce2e649096e2 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:32.206747 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8d374bf0-fed0-4e95-ac10-ce2e649096e2 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:32.206747 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8d374bf0-fed0-4e95-ac10-ce2e649096e2 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:32.206747 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8d374bf0-fed0-4e95-ac10-ce2e649096e2 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:32.287692 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-8d374bf0-fed0-4e95-ac10-ce2e649096e2 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae134fe7522941698cad3f3fa11e747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16d72d2469433ca30ba6769e3d3f25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:32.300553 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-8d374bf0-fed0-4e95-ac10-ce2e649096e2 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae134fe7522941698cad3f3fa11e747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16d72d2469433ca30ba6769e3d3f25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:32.305622 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-8d374bf0-fed0-4e95-ac10-ce2e649096e2 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae134fe7522941698cad3f3fa11e747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16d72d2469433ca30ba6769e3d3f25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:32.307195 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-8d374bf0-fed0-4e95-ac10-ce2e649096e2 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] 10.222.0.33 "GET /compute/v2.1/servers/3fc8d6fc-3204-43f4-9b94-100d061769a5" status: 200 len: 1366 microversion: 2.57 time: 0.126035 Sep 23 04:48:32.310573 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1992/3910] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:48:32 2022] GET /compute/v2.1/servers/3fc8d6fc-3204-43f4-9b94-100d061769a5 => generated 1366 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:48:32.327980 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-bccd8690-f970-46e7-ad5d-d3e521049e0b tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:32.328990 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-bccd8690-f970-46e7-ad5d-d3e521049e0b tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] [instance: 6b1aa3ac-6bda-48be-8814-e1a5ddd510a2] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:32.337793 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bccd8690-f970-46e7-ad5d-d3e521049e0b tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:32.338683 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bccd8690-f970-46e7-ad5d-d3e521049e0b tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:32.339591 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bccd8690-f970-46e7-ad5d-d3e521049e0b tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:32.343558 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bccd8690-f970-46e7-ad5d-d3e521049e0b tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:32.344107 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bccd8690-f970-46e7-ad5d-d3e521049e0b tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:32.344718 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bccd8690-f970-46e7-ad5d-d3e521049e0b tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:32.583848 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-670dcf7c-b6aa-456d-b148-1abd021a44c4 tempest-SecurityGroupRulesTestJSON-1847559686 tempest-SecurityGroupRulesTestJSON-1847559686-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.495614 Sep 23 04:48:32.592983 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-bccd8690-f970-46e7-ad5d-d3e521049e0b tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a245dd82de1340f7a58873de1851c61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d02cb07a2a404c8d89aa13a950806d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:32.601821 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-bccd8690-f970-46e7-ad5d-d3e521049e0b tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] 10.222.0.33 "GET /compute/v2.1/servers/6b1aa3ac-6bda-48be-8814-e1a5ddd510a2" status: 200 len: 1526 microversion: 2.1 time: 0.289548 Sep 23 04:48:32.602607 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1993/3911] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:48:32 2022] GET /compute/v2.1/servers/6b1aa3ac-6bda-48be-8814-e1a5ddd510a2 => generated 1526 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:48:32.610667 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1919/3912] 10.222.0.33 () {60 vars in 1180 bytes} [Fri Sep 23 04:48:32 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:48:32.620357 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4f341b91-e14e-4496-8288-1cf638a84edb tempest-SecurityGroupRulesTestJSON-1847559686 tempest-SecurityGroupRulesTestJSON-1847559686-project] Action: 'create', calling method: .version_select at 0x7ff1ba8e74c0>, body: {"security_group_rule": {"parent_group_id": "a678e2dc-91f9-4fef-b8ba-a23ca4e82617", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "11b75f73-395c-4381-bf41-f7fa73b5aa6e"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:48:32.621392 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6a0f54de-aaa9-45a0-9d5a-125b42bec658 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '.version_select at 0x7ff1ba943dc0>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:32.706730 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6a0f54de-aaa9-45a0-9d5a-125b42bec658 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-420410748" status: 200 len: 664 microversion: 2.1 time: 0.102877 Sep 23 04:48:32.707557 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1994/3913] 10.222.0.33 () {58 vars in 1250 bytes} [Fri Sep 23 04:48:32 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-420410748 => generated 664 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:48:32.735142 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f9e723d0-ec8e-4fee-ad1a-bd725993f9c8 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '.version_select at 0x7ff1ba94dc10>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:32.833427 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f9e723d0-ec8e-4fee-ad1a-bd725993f9c8 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.33%2Fcompute%2Fv2.1%2Fservers%2Fa0eac077-d4bd-4e4a-a04a-3f86aeeed9bd" status: 200 len: 1467 microversion: 2.1 time: 0.102595 Sep 23 04:48:32.834075 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1995/3914] 10.222.0.33 () {58 vars in 1338 bytes} [Fri Sep 23 04:48:32 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.33%2Fcompute%2Fv2.1%2Fservers%2Fa0eac077-d4bd-4e4a-a04a-3f86aeeed9bd => generated 1467 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:48:32.839521 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-e061c656-cfe2-4894-865c-421dd8fc7d0f req-e7d3d78b-8e9f-4248-a916-0f623c7a19c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b1aa3ac-6bda-48be-8814-e1a5ddd510a2", "name": "network-vif-plugged", "status": "completed", "tag": "99d65349-904f-4ecc-8ad9-f7df89c8a9b0"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:48:32.849927 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-e061c656-cfe2-4894-865c-421dd8fc7d0f req-e7d3d78b-8e9f-4248-a916-0f623c7a19c3 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:32.850770 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-e061c656-cfe2-4894-865c-421dd8fc7d0f req-e7d3d78b-8e9f-4248-a916-0f623c7a19c3 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:32.851216 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-e061c656-cfe2-4894-865c-421dd8fc7d0f req-e7d3d78b-8e9f-4248-a916-0f623c7a19c3 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:32.863960 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-e061c656-cfe2-4894-865c-421dd8fc7d0f req-e7d3d78b-8e9f-4248-a916-0f623c7a19c3 service nova] Creating event network-vif-plugged:99d65349-904f-4ecc-8ad9-f7df89c8a9b0 for instance 6b1aa3ac-6bda-48be-8814-e1a5ddd510a2 on n-h2-846463-3 Sep 23 04:48:32.870136 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-e061c656-cfe2-4894-865c-421dd8fc7d0f req-e7d3d78b-8e9f-4248-a916-0f623c7a19c3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034115 Sep 23 04:48:32.870749 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1996/3915] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:48:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:48:32.875944 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-04cb3ba6-a4b9-4772-a285-ac64aa4b3115 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '.version_select at 0x7ff1ba943940>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:32.938874 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-04cb3ba6-a4b9-4772-a285-ac64aa4b3115 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.33%2Fcompute%2Fservers%2Fa0eac077-d4bd-4e4a-a04a-3f86aeeed9bd" status: 200 len: 1467 microversion: 2.1 time: 0.066843 Sep 23 04:48:32.939765 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1997/3916] 10.222.0.33 () {58 vars in 1324 bytes} [Fri Sep 23 04:48:32 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.33%2Fcompute%2Fservers%2Fa0eac077-d4bd-4e4a-a04a-3f86aeeed9bd => generated 1467 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:48:32.958860 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-69d38824-b486-4e21-a0e5-e8e9d5457c16 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '.version_select at 0x7ff1ba94da60>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:33.277282 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-69d38824-b486-4e21-a0e5-e8e9d5457c16 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7107 microversion: 2.1 time: 0.325248 Sep 23 04:48:33.277813 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1998/3917] 10.222.0.33 () {58 vars in 1170 bytes} [Fri Sep 23 04:48:32 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7107 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:48:33.283828 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c96776da-44e7-48ff-a6ab-37b06cf23a4a tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:33.296665 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c96776da-44e7-48ff-a6ab-37b06cf23a4a tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: fe7dee09-8351-4d41-8c44-8d35a966cce9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:33.296665 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c96776da-44e7-48ff-a6ab-37b06cf23a4a tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:33.296665 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c96776da-44e7-48ff-a6ab-37b06cf23a4a tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:33.296665 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c96776da-44e7-48ff-a6ab-37b06cf23a4a tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:33.296665 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c96776da-44e7-48ff-a6ab-37b06cf23a4a tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:33.296665 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c96776da-44e7-48ff-a6ab-37b06cf23a4a tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:33.296665 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c96776da-44e7-48ff-a6ab-37b06cf23a4a tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:33.445779 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c96776da-44e7-48ff-a6ab-37b06cf23a4a tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:33.454972 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c96776da-44e7-48ff-a6ab-37b06cf23a4a tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:33.456444 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c96776da-44e7-48ff-a6ab-37b06cf23a4a tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:33.457620 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c96776da-44e7-48ff-a6ab-37b06cf23a4a tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9" status: 200 len: 1740 microversion: 2.20 time: 0.178364 Sep 23 04:48:33.459351 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 1999/3918] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:48:33 2022] GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9 => generated 1740 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:48:33.465186 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-aa6d79e5-4186-4552-9ff7-f8e2864bbdaa tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '.version_select at 0x7ff1ba992550>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:33.535928 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-aa6d79e5-4186-4552-9ff7-f8e2864bbdaa tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4375 microversion: 2.1 time: 0.075301 Sep 23 04:48:33.536441 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2000/3919] 10.222.0.33 () {58 vars in 1170 bytes} [Fri Sep 23 04:48:33 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4375 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:48:33.541529 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b1709308-c4a2-4aeb-b699-db85e45382f3 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:33.542216 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b1709308-c4a2-4aeb-b699-db85e45382f3 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] [instance: 3fc8d6fc-3204-43f4-9b94-100d061769a5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:33.549481 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b1709308-c4a2-4aeb-b699-db85e45382f3 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:33.550014 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b1709308-c4a2-4aeb-b699-db85e45382f3 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:33.550460 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b1709308-c4a2-4aeb-b699-db85e45382f3 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:33.551193 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b1709308-c4a2-4aeb-b699-db85e45382f3 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:33.551657 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b1709308-c4a2-4aeb-b699-db85e45382f3 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:33.553005 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b1709308-c4a2-4aeb-b699-db85e45382f3 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:33.619768 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b1709308-c4a2-4aeb-b699-db85e45382f3 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae134fe7522941698cad3f3fa11e747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16d72d2469433ca30ba6769e3d3f25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:33.628165 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b1709308-c4a2-4aeb-b699-db85e45382f3 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae134fe7522941698cad3f3fa11e747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16d72d2469433ca30ba6769e3d3f25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:33.629614 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b1709308-c4a2-4aeb-b699-db85e45382f3 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae134fe7522941698cad3f3fa11e747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16d72d2469433ca30ba6769e3d3f25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:33.630803 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b1709308-c4a2-4aeb-b699-db85e45382f3 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] 10.222.0.33 "GET /compute/v2.1/servers/3fc8d6fc-3204-43f4-9b94-100d061769a5" status: 200 len: 1366 microversion: 2.57 time: 0.093456 Sep 23 04:48:33.631350 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2001/3920] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:48:33 2022] GET /compute/v2.1/servers/3fc8d6fc-3204-43f4-9b94-100d061769a5 => generated 1366 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:48:33.635835 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8fc7e351-7c3c-47e9-bc8c-c08f925df77f tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '.version_select at 0x7ff1ba9430d0>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:33.677622 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-8fc7e351-7c3c-47e9-bc8c-c08f925df77f tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "GET /compute/v2.1/images/b8dd79b9-f0b9-43a9-9605-17244137c0ee" status: 200 len: 784 microversion: 2.1 time: 0.045216 Sep 23 04:48:33.694914 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2002/3921] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 23 04:48:33 2022] GET /compute/v2.1/images/b8dd79b9-f0b9-43a9-9605-17244137c0ee => generated 784 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:48:33.694914 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-840f1eb8-61c6-4cdd-9507-c3f05e637ad5 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:33.694914 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-840f1eb8-61c6-4cdd-9507-c3f05e637ad5 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] [instance: 6b1aa3ac-6bda-48be-8814-e1a5ddd510a2] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:33.694914 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-840f1eb8-61c6-4cdd-9507-c3f05e637ad5 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:33.694914 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-840f1eb8-61c6-4cdd-9507-c3f05e637ad5 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:33.694914 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-840f1eb8-61c6-4cdd-9507-c3f05e637ad5 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:33.694914 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-840f1eb8-61c6-4cdd-9507-c3f05e637ad5 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:33.694914 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-840f1eb8-61c6-4cdd-9507-c3f05e637ad5 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:33.694914 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-840f1eb8-61c6-4cdd-9507-c3f05e637ad5 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:33.959195 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-840f1eb8-61c6-4cdd-9507-c3f05e637ad5 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a245dd82de1340f7a58873de1851c61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d02cb07a2a404c8d89aa13a950806d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:33.959934 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4f341b91-e14e-4496-8288-1cf638a84edb tempest-SecurityGroupRulesTestJSON-1847559686 tempest-SecurityGroupRulesTestJSON-1847559686-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 1.345792 Sep 23 04:48:33.961643 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1920/3922] 10.222.0.33 () {60 vars in 1195 bytes} [Fri Sep 23 04:48:32 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 1350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:48:33.973182 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e51b5835-2604-4361-9a07-685046584419 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '.version_select at 0x7ff1ba9c9820>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:33.984322 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-840f1eb8-61c6-4cdd-9507-c3f05e637ad5 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] 10.222.0.33 "GET /compute/v2.1/servers/6b1aa3ac-6bda-48be-8814-e1a5ddd510a2" status: 200 len: 1526 microversion: 2.1 time: 0.305070 Sep 23 04:48:33.988028 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2003/3923] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:48:33 2022] GET /compute/v2.1/servers/6b1aa3ac-6bda-48be-8814-e1a5ddd510a2 => generated 1526 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:48:33.994209 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-54295593-2241-4b72-80a3-4f00a58a57ee tempest-SecurityGroupRulesTestJSON-1847559686 tempest-SecurityGroupRulesTestJSON-1847559686-project] Calling method '.version_select at 0x7ff1ba9dc8b0>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:34.061106 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e51b5835-2604-4361-9a07-685046584419 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1610 microversion: 2.1 time: 0.097682 Sep 23 04:48:34.063885 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1921/3924] 10.222.0.33 () {58 vars in 1158 bytes} [Fri Sep 23 04:48:33 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1610 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:48:34.079655 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c248c0e4-c71c-4cc4-a33e-71b0e0851eaa tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '.version_select at 0x7ff1ba846b80>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:34.667393 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-54295593-2241-4b72-80a3-4f00a58a57ee tempest-SecurityGroupRulesTestJSON-1847559686 tempest-SecurityGroupRulesTestJSON-1847559686-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/11b75f73-395c-4381-bf41-f7fa73b5aa6e" status: 202 len: 0 microversion: 2.1 time: 0.678180 Sep 23 04:48:34.669008 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2004/3925] 10.222.0.33 () {58 vars in 1272 bytes} [Fri Sep 23 04:48:33 2022] DELETE /compute/v2.1/os-security-groups/11b75f73-395c-4381-bf41-f7fa73b5aa6e => generated 0 bytes in 680 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:48:34.677419 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-220f49b0-6c3f-454f-9ddc-c34462522a93 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:34.680665 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-220f49b0-6c3f-454f-9ddc-c34462522a93 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: fe7dee09-8351-4d41-8c44-8d35a966cce9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:34.689417 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-220f49b0-6c3f-454f-9ddc-c34462522a93 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:34.696420 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-220f49b0-6c3f-454f-9ddc-c34462522a93 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:34.698168 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-220f49b0-6c3f-454f-9ddc-c34462522a93 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:34.705280 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-220f49b0-6c3f-454f-9ddc-c34462522a93 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:34.710057 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-220f49b0-6c3f-454f-9ddc-c34462522a93 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:34.710057 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-220f49b0-6c3f-454f-9ddc-c34462522a93 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:35.118440 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-220f49b0-6c3f-454f-9ddc-c34462522a93 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:35.128204 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-220f49b0-6c3f-454f-9ddc-c34462522a93 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:35.130946 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-220f49b0-6c3f-454f-9ddc-c34462522a93 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:35.138430 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-220f49b0-6c3f-454f-9ddc-c34462522a93 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9" status: 200 len: 1740 microversion: 2.20 time: 0.468023 Sep 23 04:48:35.150049 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2005/3926] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:48:34 2022] GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9 => generated 1740 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:48:35.150049 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2d61222e-2523-4ad3-8d81-5d8bd34b069e tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:35.150049 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-2d61222e-2523-4ad3-8d81-5d8bd34b069e tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] [instance: 3fc8d6fc-3204-43f4-9b94-100d061769a5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:35.151321 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2d61222e-2523-4ad3-8d81-5d8bd34b069e tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:35.152033 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2d61222e-2523-4ad3-8d81-5d8bd34b069e tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:35.152733 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2d61222e-2523-4ad3-8d81-5d8bd34b069e tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:35.153637 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2d61222e-2523-4ad3-8d81-5d8bd34b069e tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:35.154370 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2d61222e-2523-4ad3-8d81-5d8bd34b069e tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:35.154975 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2d61222e-2523-4ad3-8d81-5d8bd34b069e tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:35.270905 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2d61222e-2523-4ad3-8d81-5d8bd34b069e tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae134fe7522941698cad3f3fa11e747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16d72d2469433ca30ba6769e3d3f25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:35.280854 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2d61222e-2523-4ad3-8d81-5d8bd34b069e tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae134fe7522941698cad3f3fa11e747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16d72d2469433ca30ba6769e3d3f25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:35.282425 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2d61222e-2523-4ad3-8d81-5d8bd34b069e tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae134fe7522941698cad3f3fa11e747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16d72d2469433ca30ba6769e3d3f25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:35.283959 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2d61222e-2523-4ad3-8d81-5d8bd34b069e tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] 10.222.0.33 "GET /compute/v2.1/servers/3fc8d6fc-3204-43f4-9b94-100d061769a5" status: 200 len: 1366 microversion: 2.57 time: 0.143820 Sep 23 04:48:35.284597 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2006/3927] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:48:35 2022] GET /compute/v2.1/servers/3fc8d6fc-3204-43f4-9b94-100d061769a5 => generated 1366 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:48:35.297015 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-82f1c935-61a9-4d89-bbf7-56509d242638 tempest-SecurityGroupRulesTestJSON-1847559686 tempest-SecurityGroupRulesTestJSON-1847559686-project] Calling method '.version_select at 0x7ff1ba992820>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:35.413286 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-82f1c935-61a9-4d89-bbf7-56509d242638 tempest-SecurityGroupRulesTestJSON-1847559686 tempest-SecurityGroupRulesTestJSON-1847559686-project] 10.222.0.33 "GET /compute/v2.1/os-security-groups/a678e2dc-91f9-4fef-b8ba-a23ca4e82617" status: 200 len: 248 microversion: 2.1 time: 0.127411 Sep 23 04:48:35.422841 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2007/3928] 10.222.0.33 () {58 vars in 1269 bytes} [Fri Sep 23 04:48:35 2022] GET /compute/v2.1/os-security-groups/a678e2dc-91f9-4fef-b8ba-a23ca4e82617 => generated 248 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:48:35.431229 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-85255195-e825-4591-acfb-194c227a0eb5 req-50ac3a81-271b-4488-a4c1-75f9562b9643 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fb569cf-4457-4695-ad5f-fcb78f0964c5", "name": "network-vif-unplugged", "status": "completed", "tag": "8fdad197-55e1-4686-bfa9-6cfa0beb24d5"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:48:35.449642 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-85255195-e825-4591-acfb-194c227a0eb5 req-50ac3a81-271b-4488-a4c1-75f9562b9643 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:35.450303 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-85255195-e825-4591-acfb-194c227a0eb5 req-50ac3a81-271b-4488-a4c1-75f9562b9643 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:35.451011 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-85255195-e825-4591-acfb-194c227a0eb5 req-50ac3a81-271b-4488-a4c1-75f9562b9643 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:35.479291 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-85255195-e825-4591-acfb-194c227a0eb5 req-50ac3a81-271b-4488-a4c1-75f9562b9643 service nova] Creating event network-vif-unplugged:8fdad197-55e1-4686-bfa9-6cfa0beb24d5 for instance 4fb569cf-4457-4695-ad5f-fcb78f0964c5 on n-h2-846463-3 Sep 23 04:48:35.493399 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-85255195-e825-4591-acfb-194c227a0eb5 req-50ac3a81-271b-4488-a4c1-75f9562b9643 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.068788 Sep 23 04:48:35.494217 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2008/3929] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:48:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:48:35.505412 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-600e3321-3578-4078-a0b3-8b6ae8bfeb5e req-e6c2d671-81d6-46bb-b572-40ce7e703426 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b1aa3ac-6bda-48be-8814-e1a5ddd510a2", "name": "network-vif-deleted", "tag": "99d65349-904f-4ecc-8ad9-f7df89c8a9b0"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:48:35.536645 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-600e3321-3578-4078-a0b3-8b6ae8bfeb5e req-e6c2d671-81d6-46bb-b572-40ce7e703426 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:35.538610 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-600e3321-3578-4078-a0b3-8b6ae8bfeb5e req-e6c2d671-81d6-46bb-b572-40ce7e703426 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:35.547518 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-600e3321-3578-4078-a0b3-8b6ae8bfeb5e req-e6c2d671-81d6-46bb-b572-40ce7e703426 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:35.571332 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-600e3321-3578-4078-a0b3-8b6ae8bfeb5e req-e6c2d671-81d6-46bb-b572-40ce7e703426 service nova] Creating event network-vif-deleted:99d65349-904f-4ecc-8ad9-f7df89c8a9b0 for instance 6b1aa3ac-6bda-48be-8814-e1a5ddd510a2 on n-h2-846463-3 Sep 23 04:48:35.578843 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-600e3321-3578-4078-a0b3-8b6ae8bfeb5e req-e6c2d671-81d6-46bb-b572-40ce7e703426 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082032 Sep 23 04:48:35.580425 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2009/3930] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:48:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:48:35.588575 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-58996d36-48b7-469c-b678-8ffd7ce15cdb tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:35.589269 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-58996d36-48b7-469c-b678-8ffd7ce15cdb tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] [instance: 6b1aa3ac-6bda-48be-8814-e1a5ddd510a2] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:35.599429 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-58996d36-48b7-469c-b678-8ffd7ce15cdb tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:35.599925 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-58996d36-48b7-469c-b678-8ffd7ce15cdb tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:35.600362 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-58996d36-48b7-469c-b678-8ffd7ce15cdb tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:35.601077 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-58996d36-48b7-469c-b678-8ffd7ce15cdb tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:35.601536 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-58996d36-48b7-469c-b678-8ffd7ce15cdb tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:35.601991 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-58996d36-48b7-469c-b678-8ffd7ce15cdb tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:35.645333 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-58996d36-48b7-469c-b678-8ffd7ce15cdb tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:35.646411 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-58996d36-48b7-469c-b678-8ffd7ce15cdb tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:35.647111 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-58996d36-48b7-469c-b678-8ffd7ce15cdb tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:35.650118 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-58996d36-48b7-469c-b678-8ffd7ce15cdb tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lazy-loading 'fault' on Instance uuid 6b1aa3ac-6bda-48be-8814-e1a5ddd510a2 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:48:35.654241 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:48:35.703426 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-58996d36-48b7-469c-b678-8ffd7ce15cdb tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a245dd82de1340f7a58873de1851c61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d02cb07a2a404c8d89aa13a950806d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:35.712804 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-58996d36-48b7-469c-b678-8ffd7ce15cdb tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] 10.222.0.33 "GET /compute/v2.1/servers/6b1aa3ac-6bda-48be-8814-e1a5ddd510a2" status: 200 len: 1313 microversion: 2.1 time: 0.130984 Sep 23 04:48:35.715179 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2010/3931] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:48:35 2022] GET /compute/v2.1/servers/6b1aa3ac-6bda-48be-8814-e1a5ddd510a2 => generated 1313 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:48:35.721014 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0e92e620-b11c-47c0-a3d5-8e5ae3284ab2 tempest-SecurityGroupRulesTestJSON-1847559686 tempest-SecurityGroupRulesTestJSON-1847559686-project] Action: 'create', calling method: .version_select at 0x7ff1ba992820>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-2034715046", "description": "tempest-description-1095822958"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:48:36.076598 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c248c0e4-c71c-4cc4-a33e-71b0e0851eaa tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "DELETE /compute/v2.1/images/efc8a43b-1faf-4f3e-b1e0-5cb6ebaad7c2" status: 204 len: 0 microversion: 2.1 time: 2.000704 Sep 23 04:48:36.082067 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1922/3932] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:48:34 2022] DELETE /compute/v2.1/images/efc8a43b-1faf-4f3e-b1e0-5cb6ebaad7c2 => generated 0 bytes in 2003 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 23 04:48:36.089690 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f7641408-57f7-4042-98c7-f251c54e9b86 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '.version_select at 0x7ff1baa6ce50>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:36.147404 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0e92e620-b11c-47c0-a3d5-8e5ae3284ab2 tempest-SecurityGroupRulesTestJSON-1847559686 tempest-SecurityGroupRulesTestJSON-1847559686-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.430346 Sep 23 04:48:36.148432 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2011/3933] 10.222.0.33 () {60 vars in 1180 bytes} [Fri Sep 23 04:48:35 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:48:36.165797 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-cb41bd17-3a2a-42c9-919f-941fa2a41714 tempest-SecurityGroupRulesTestJSON-1847559686 tempest-SecurityGroupRulesTestJSON-1847559686-project] Action: 'create', calling method: .version_select at 0x7ff1ba992d30>, body: {"security_group_rule": {"parent_group_id": "2b43103b-fe74-4ca9-a671-ed0c7e1d6dba", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:48:36.747081 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-cb41bd17-3a2a-42c9-919f-941fa2a41714 tempest-SecurityGroupRulesTestJSON-1847559686 tempest-SecurityGroupRulesTestJSON-1847559686-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.585469 Sep 23 04:48:36.750695 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2012/3934] 10.222.0.33 () {60 vars in 1195 bytes} [Fri Sep 23 04:48:36 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:48:36.760596 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1b6918ea-524e-4a55-bd70-8100f3c1d1d9 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:36.761455 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1b6918ea-524e-4a55-bd70-8100f3c1d1d9 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: fe7dee09-8351-4d41-8c44-8d35a966cce9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:36.768761 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1b6918ea-524e-4a55-bd70-8100f3c1d1d9 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:36.769618 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1b6918ea-524e-4a55-bd70-8100f3c1d1d9 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:36.770276 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1b6918ea-524e-4a55-bd70-8100f3c1d1d9 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:36.771228 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1b6918ea-524e-4a55-bd70-8100f3c1d1d9 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:36.771730 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1b6918ea-524e-4a55-bd70-8100f3c1d1d9 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:36.772197 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1b6918ea-524e-4a55-bd70-8100f3c1d1d9 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:37.055512 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1b6918ea-524e-4a55-bd70-8100f3c1d1d9 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:37.088825 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1b6918ea-524e-4a55-bd70-8100f3c1d1d9 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:37.090306 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1b6918ea-524e-4a55-bd70-8100f3c1d1d9 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:37.092311 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1b6918ea-524e-4a55-bd70-8100f3c1d1d9 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9" status: 200 len: 1740 microversion: 2.20 time: 0.340289 Sep 23 04:48:37.093012 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2013/3935] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:48:36 2022] GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9 => generated 1740 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:48:37.098121 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0038f376-9c1b-45eb-b390-54c0eb96aed9 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:37.118074 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-0038f376-9c1b-45eb-b390-54c0eb96aed9 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] [instance: 3fc8d6fc-3204-43f4-9b94-100d061769a5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:37.118074 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0038f376-9c1b-45eb-b390-54c0eb96aed9 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:37.118074 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0038f376-9c1b-45eb-b390-54c0eb96aed9 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:37.118074 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0038f376-9c1b-45eb-b390-54c0eb96aed9 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:37.118074 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0038f376-9c1b-45eb-b390-54c0eb96aed9 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:37.118074 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0038f376-9c1b-45eb-b390-54c0eb96aed9 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:37.118074 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0038f376-9c1b-45eb-b390-54c0eb96aed9 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:37.236792 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-0038f376-9c1b-45eb-b390-54c0eb96aed9 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae134fe7522941698cad3f3fa11e747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16d72d2469433ca30ba6769e3d3f25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:37.258318 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-0038f376-9c1b-45eb-b390-54c0eb96aed9 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae134fe7522941698cad3f3fa11e747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16d72d2469433ca30ba6769e3d3f25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:37.263058 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-0038f376-9c1b-45eb-b390-54c0eb96aed9 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae134fe7522941698cad3f3fa11e747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16d72d2469433ca30ba6769e3d3f25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:37.268884 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0038f376-9c1b-45eb-b390-54c0eb96aed9 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] 10.222.0.33 "GET /compute/v2.1/servers/3fc8d6fc-3204-43f4-9b94-100d061769a5" status: 200 len: 1366 microversion: 2.57 time: 0.174291 Sep 23 04:48:37.278089 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2014/3936] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:48:37 2022] GET /compute/v2.1/servers/3fc8d6fc-3204-43f4-9b94-100d061769a5 => generated 1366 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:48:37.284337 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9f49bcb0-33e2-4961-8077-8e4e267f6dce tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:37.285270 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-9f49bcb0-33e2-4961-8077-8e4e267f6dce tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] [instance: 6b1aa3ac-6bda-48be-8814-e1a5ddd510a2] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:37.293691 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9f49bcb0-33e2-4961-8077-8e4e267f6dce tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:37.294579 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9f49bcb0-33e2-4961-8077-8e4e267f6dce tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:37.295256 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9f49bcb0-33e2-4961-8077-8e4e267f6dce tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:37.296227 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9f49bcb0-33e2-4961-8077-8e4e267f6dce tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:37.296996 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9f49bcb0-33e2-4961-8077-8e4e267f6dce tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:37.297675 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9f49bcb0-33e2-4961-8077-8e4e267f6dce tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:37.315059 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-9f49bcb0-33e2-4961-8077-8e4e267f6dce tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] HTTP exception thrown: Instance 6b1aa3ac-6bda-48be-8814-e1a5ddd510a2 could not be found. Sep 23 04:48:37.317319 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9f49bcb0-33e2-4961-8077-8e4e267f6dce tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Request method failure captured: Sep 23 04:48:37.317319 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/6b1aa3ac-6bda-48be-8814-e1a5ddd510a2 HTTP/1.1 Sep 23 04:48:37.317319 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:48:37.317319 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:48:37.317319 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:48:37.317319 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:48:37.317319 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:48:37.317319 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:48:37.317319 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:48:37.317319 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:48:37.317319 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTpFpjGPh25TzqBKyhrvLvaFWkL4faeTDdKKBYZ-4258bHvdM5kvJeJfEcGV73OAvtYNm_BDk9uKOKPqKlfTdSYy5tbnqP456--ua0TKxu-LM-map64NPTKy_GCC6WVYwCbUhwP1cF4hdC1uo-LvpY1Eaa8dgHWJxu3z0t2BBREm_ZE Sep 23 04:48:37.317319 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:48:37.317319 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:48:37.317319 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:48:37.317319 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:48:37.317319 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:48:37.317319 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:48:37.317319 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 53d02cb07a2a404c8d89aa13a950806d Sep 23 04:48:37.317319 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-728698197 Sep 23 04:48:37.317319 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:48:37.317319 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:48:37.317319 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_53d02cb07a2a404c8d89aa13a950806d", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/53d02cb07a2a404c8d89aa13a950806d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/53d02cb07a2a404c8d89aa13a950806d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/53d02cb07a2a404c8d89aa13a950806d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:48:37.317319 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-728698197 Sep 23 04:48:37.317319 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 53d02cb07a2a404c8d89aa13a950806d Sep 23 04:48:37.317319 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-728698197 Sep 23 04:48:37.317319 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ImagesOneServerNegativeTestJSON-728698197-project Sep 23 04:48:37.317319 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:48:37.317319 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:48:37.317319 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: a245dd82de1340f7a58873de1851c61c Sep 23 04:48:37.317319 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-728698197-project Sep 23 04:48:37.317319 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:48:37.317319 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 6b1aa3ac-6bda-48be-8814-e1a5ddd510a2 could not be found. Sep 23 04:48:37.317319 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '6b1aa3ac-6bda-48be-8814-e1a5ddd510a2'} Sep 23 04:48:37.317319 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:48:37.317319 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:48:37.317319 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:48:37.317319 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:48:37.317319 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:48:37.317319 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:48:37.317319 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:48:37.317319 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:48:37.317319 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:48:37.317319 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:48:37.317319 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b1aa3ac-6bda-48be-8814-e1a5ddd510a2 could not be found. Sep 23 04:48:37.317319 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:48:37.317319 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:48:37.317319 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:48:37.317319 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:48:37.317319 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:48:37.317319 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:48:37.317319 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:48:37.317319 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:48:37.317319 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:48:37.317319 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:48:37.317319 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:48:37.317319 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:48:37.317319 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:48:37.317319 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:48:37.317319 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:48:37.317319 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:48:37.317319 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b1aa3ac-6bda-48be-8814-e1a5ddd510a2 could not be found. Sep 23 04:48:37.317319 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:48:37.317319 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:48:37.739453 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:48:37.739453 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:48:37.739453 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:48:37.739453 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:48:37.739453 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:48:37.739453 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:48:37.739453 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b1aa3ac-6bda-48be-8814-e1a5ddd510a2 could not be found. Sep 23 04:48:37.739453 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:48:37.739453 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9f49bcb0-33e2-4961-8077-8e4e267f6dce tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Returning 404 to user: Instance 6b1aa3ac-6bda-48be-8814-e1a5ddd510a2 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:48:37.739453 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-9f49bcb0-33e2-4961-8077-8e4e267f6dce tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] 10.222.0.33 "GET /compute/v2.1/servers/6b1aa3ac-6bda-48be-8814-e1a5ddd510a2" status: 404 len: 111 microversion: 2.1 time: 0.046582 Sep 23 04:48:37.739453 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2015/3937] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:48:37 2022] GET /compute/v2.1/servers/6b1aa3ac-6bda-48be-8814-e1a5ddd510a2 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:48:37.739453 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0192f7dc-1c41-41c0-808e-669a18bc6848 tempest-SecurityGroupRulesTestJSON-1847559686 tempest-SecurityGroupRulesTestJSON-1847559686-project] Action: 'create', calling method: .version_select at 0x7ff1ba9921f0>, body: {"security_group_rule": {"parent_group_id": "2b43103b-fe74-4ca9-a671-ed0c7e1d6dba", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:48:37.854213 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0192f7dc-1c41-41c0-808e-669a18bc6848 tempest-SecurityGroupRulesTestJSON-1847559686 tempest-SecurityGroupRulesTestJSON-1847559686-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.532469 Sep 23 04:48:37.865338 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2016/3938] 10.222.0.33 () {60 vars in 1195 bytes} [Fri Sep 23 04:48:37 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:48:37.867658 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ba4f2957-6bab-44bd-b4d5-f644aab11a09 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1001877705", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:48:38.235457 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f7641408-57f7-4042-98c7-f251c54e9b86 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "DELETE /compute/v2.1/images/ebfd24d2-4412-4ba6-8024-99147eab6142" status: 204 len: 0 microversion: 2.1 time: 2.151868 Sep 23 04:48:38.236085 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1923/3939] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:48:36 2022] DELETE /compute/v2.1/images/ebfd24d2-4412-4ba6-8024-99147eab6142 => generated 0 bytes in 2153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:48:38.245445 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7661757c-3f88-42f1-a8a3-85e1e1ca5bb3 tempest-SecurityGroupRulesTestJSON-1847559686 tempest-SecurityGroupRulesTestJSON-1847559686-project] Calling method '.version_select at 0x7ff1ba8d6160>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:38.340895 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.neutron [None req-ba4f2957-6bab-44bd-b4d5-f644aab11a09 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] validate_networks() for [('7ec2c088-8cd5-47fc-aaa6-ca4765f2280b', None, None, None, None, None)] {{(pid=122699) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:48:38.387098 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7661757c-3f88-42f1-a8a3-85e1e1ca5bb3 tempest-SecurityGroupRulesTestJSON-1847559686 tempest-SecurityGroupRulesTestJSON-1847559686-project] 10.222.0.33 "GET /compute/v2.1/os-security-groups/2b43103b-fe74-4ca9-a671-ed0c7e1d6dba" status: 200 len: 665 microversion: 2.1 time: 0.146065 Sep 23 04:48:38.388284 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1924/3940] 10.222.0.33 () {58 vars in 1269 bytes} [Fri Sep 23 04:48:38 2022] GET /compute/v2.1/os-security-groups/2b43103b-fe74-4ca9-a671-ed0c7e1d6dba => generated 665 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:48:38.393116 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4688b1ca-66e8-4155-b968-603a637c3bee tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:38.395384 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4688b1ca-66e8-4155-b968-603a637c3bee tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: fe7dee09-8351-4d41-8c44-8d35a966cce9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:38.416223 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4688b1ca-66e8-4155-b968-603a637c3bee tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:38.418534 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4688b1ca-66e8-4155-b968-603a637c3bee tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:38.422646 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4688b1ca-66e8-4155-b968-603a637c3bee tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:38.423636 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4688b1ca-66e8-4155-b968-603a637c3bee tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:38.424295 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4688b1ca-66e8-4155-b968-603a637c3bee tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:38.425641 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4688b1ca-66e8-4155-b968-603a637c3bee tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:38.747757 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4688b1ca-66e8-4155-b968-603a637c3bee tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:38.757386 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4688b1ca-66e8-4155-b968-603a637c3bee tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:38.759194 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4688b1ca-66e8-4155-b968-603a637c3bee tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:38.761430 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4688b1ca-66e8-4155-b968-603a637c3bee tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9" status: 200 len: 1740 microversion: 2.20 time: 0.371469 Sep 23 04:48:38.768655 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1925/3941] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:48:38 2022] GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9 => generated 1740 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:48:38.786180 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-fbca56fe-4e5d-4c2f-8456-1b43038ef59c tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '.version_select at 0x7ff1ba8e7b80>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:39.517378 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-ba4f2957-6bab-44bd-b4d5-f644aab11a09 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Flavor limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:48:39.517815 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-ba4f2957-6bab-44bd-b4d5-f644aab11a09 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Image limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:48:39.518307 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-ba4f2957-6bab-44bd-b4d5-f644aab11a09 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Flavor pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:48:39.518727 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-ba4f2957-6bab-44bd-b4d5-f644aab11a09 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Image pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:48:39.519146 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-ba4f2957-6bab-44bd-b4d5-f644aab11a09 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:48:39.539279 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ba4f2957-6bab-44bd-b4d5-f644aab11a09 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:39.539765 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ba4f2957-6bab-44bd-b4d5-f644aab11a09 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:39.540325 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ba4f2957-6bab-44bd-b4d5-f644aab11a09 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:39.541142 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ba4f2957-6bab-44bd-b4d5-f644aab11a09 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:39.541756 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ba4f2957-6bab-44bd-b4d5-f644aab11a09 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:39.542223 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ba4f2957-6bab-44bd-b4d5-f644aab11a09 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:39.560713 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-ba4f2957-6bab-44bd-b4d5-f644aab11a09 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Getting quotas for project 53d02cb07a2a404c8d89aa13a950806d. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:48:39.566072 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-ba4f2957-6bab-44bd-b4d5-f644aab11a09 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Getting quotas for user a245dd82de1340f7a58873de1851c61c and project 53d02cb07a2a404c8d89aa13a950806d. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:48:39.580334 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ba4f2957-6bab-44bd-b4d5-f644aab11a09 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Going to run 1 instances... {{(pid=122699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:48:39.582695 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ba4f2957-6bab-44bd-b4d5-f644aab11a09 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] [instance: 33690ae1-5128-4bfd-b0b1-5f1bdb916fae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:48:39.731654 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ba4f2957-6bab-44bd-b4d5-f644aab11a09 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.868180 Sep 23 04:48:39.740128 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2017/3942] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:48:37 2022] POST /compute/v2.1/servers => generated 383 bytes in 1878 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:48:39.749370 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e44e63bc-a5d8-48df-9093-ce0c21996de7 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:39.749370 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e44e63bc-a5d8-48df-9093-ce0c21996de7 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] [instance: 3fc8d6fc-3204-43f4-9b94-100d061769a5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:39.754823 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e44e63bc-a5d8-48df-9093-ce0c21996de7 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:39.755510 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e44e63bc-a5d8-48df-9093-ce0c21996de7 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:39.756409 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e44e63bc-a5d8-48df-9093-ce0c21996de7 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:39.756903 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e44e63bc-a5d8-48df-9093-ce0c21996de7 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:39.757361 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e44e63bc-a5d8-48df-9093-ce0c21996de7 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:39.758208 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e44e63bc-a5d8-48df-9093-ce0c21996de7 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:39.825171 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e44e63bc-a5d8-48df-9093-ce0c21996de7 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae134fe7522941698cad3f3fa11e747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16d72d2469433ca30ba6769e3d3f25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:39.837277 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e44e63bc-a5d8-48df-9093-ce0c21996de7 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae134fe7522941698cad3f3fa11e747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16d72d2469433ca30ba6769e3d3f25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:39.839068 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e44e63bc-a5d8-48df-9093-ce0c21996de7 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae134fe7522941698cad3f3fa11e747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16d72d2469433ca30ba6769e3d3f25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:39.840385 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e44e63bc-a5d8-48df-9093-ce0c21996de7 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] 10.222.0.33 "GET /compute/v2.1/servers/3fc8d6fc-3204-43f4-9b94-100d061769a5" status: 200 len: 1384 microversion: 2.57 time: 0.098902 Sep 23 04:48:39.841166 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2018/3943] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:48:39 2022] GET /compute/v2.1/servers/3fc8d6fc-3204-43f4-9b94-100d061769a5 => generated 1384 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:48:39.850740 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8a2bfcf6-b952-4f55-851f-d353dcbacc60 tempest-SecurityGroupRulesTestJSON-1847559686 tempest-SecurityGroupRulesTestJSON-1847559686-project] Calling method '.version_select at 0x7ff1ba9950d0>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:40.139428 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-8a2bfcf6-b952-4f55-851f-d353dcbacc60 tempest-SecurityGroupRulesTestJSON-1847559686 tempest-SecurityGroupRulesTestJSON-1847559686-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-group-rules/e5533297-2608-41b3-9d26-32843eb1e8b9" status: 202 len: 0 microversion: 2.1 time: 0.296972 Sep 23 04:48:40.139960 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2019/3944] 10.222.0.33 () {58 vars in 1287 bytes} [Fri Sep 23 04:48:39 2022] DELETE /compute/v2.1/os-security-group-rules/e5533297-2608-41b3-9d26-32843eb1e8b9 => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:48:40.149280 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-233ccd66-0c65-4451-af24-34b9bba5a10e tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:40.150612 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-233ccd66-0c65-4451-af24-34b9bba5a10e tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] [instance: 33690ae1-5128-4bfd-b0b1-5f1bdb916fae] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:40.243636 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-233ccd66-0c65-4451-af24-34b9bba5a10e tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a245dd82de1340f7a58873de1851c61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d02cb07a2a404c8d89aa13a950806d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:40.252728 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-233ccd66-0c65-4451-af24-34b9bba5a10e tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] 10.222.0.33 "GET /compute/v2.1/servers/33690ae1-5128-4bfd-b0b1-5f1bdb916fae" status: 200 len: 1225 microversion: 2.1 time: 0.111586 Sep 23 04:48:40.267538 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2020/3945] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:48:40 2022] GET /compute/v2.1/servers/33690ae1-5128-4bfd-b0b1-5f1bdb916fae => generated 1225 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:48:40.275431 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ac794a66-3165-4fba-bff3-d70e8a97aada tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:40.276042 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ac794a66-3165-4fba-bff3-d70e8a97aada tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: fe7dee09-8351-4d41-8c44-8d35a966cce9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:40.283107 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ac794a66-3165-4fba-bff3-d70e8a97aada tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:40.283611 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ac794a66-3165-4fba-bff3-d70e8a97aada tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:40.284058 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ac794a66-3165-4fba-bff3-d70e8a97aada tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:40.284763 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ac794a66-3165-4fba-bff3-d70e8a97aada tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:40.285303 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ac794a66-3165-4fba-bff3-d70e8a97aada tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:40.285720 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ac794a66-3165-4fba-bff3-d70e8a97aada tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:40.437165 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-fbca56fe-4e5d-4c2f-8456-1b43038ef59c tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "DELETE /compute/v2.1/images/ff150c0b-96d0-4d15-b6c3-7e2dc172a34c" status: 204 len: 0 microversion: 2.1 time: 1.663603 Sep 23 04:48:40.438137 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1926/3946] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:48:38 2022] DELETE /compute/v2.1/images/ff150c0b-96d0-4d15-b6c3-7e2dc172a34c => generated 0 bytes in 1668 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:48:40.443769 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-35e5c34e-69eb-4bbd-858b-6d014655b271 tempest-SecurityGroupRulesTestJSON-1847559686 tempest-SecurityGroupRulesTestJSON-1847559686-project] Calling method '.version_select at 0x7ff1ba853f70>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:40.518185 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ac794a66-3165-4fba-bff3-d70e8a97aada tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:40.529007 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ac794a66-3165-4fba-bff3-d70e8a97aada tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:40.530955 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ac794a66-3165-4fba-bff3-d70e8a97aada tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:40.532226 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ac794a66-3165-4fba-bff3-d70e8a97aada tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9" status: 200 len: 1740 microversion: 2.20 time: 0.263654 Sep 23 04:48:40.542743 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2021/3947] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:48:40 2022] GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9 => generated 1740 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:48:40.553670 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7b20e0f9-eeac-4041-8169-a0a62f44ca7a tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:40.555550 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-7b20e0f9-eeac-4041-8169-a0a62f44ca7a tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] [instance: a0eac077-d4bd-4e4a-a04a-3f86aeeed9bd] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:40.568113 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7b20e0f9-eeac-4041-8169-a0a62f44ca7a tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:40.574059 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7b20e0f9-eeac-4041-8169-a0a62f44ca7a tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:40.575470 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7b20e0f9-eeac-4041-8169-a0a62f44ca7a tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:40.576727 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7b20e0f9-eeac-4041-8169-a0a62f44ca7a tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:40.578493 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7b20e0f9-eeac-4041-8169-a0a62f44ca7a tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:40.580475 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7b20e0f9-eeac-4041-8169-a0a62f44ca7a tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:40.649817 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-7b20e0f9-eeac-4041-8169-a0a62f44ca7a tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] [instance: a0eac077-d4bd-4e4a-a04a-3f86aeeed9bd] Going to try to terminate instance {{(pid=122699) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:48:40.854581 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-35e5c34e-69eb-4bbd-858b-6d014655b271 tempest-SecurityGroupRulesTestJSON-1847559686 tempest-SecurityGroupRulesTestJSON-1847559686-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/2b43103b-fe74-4ca9-a671-ed0c7e1d6dba" status: 202 len: 0 microversion: 2.1 time: 0.414778 Sep 23 04:48:40.855722 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1927/3948] 10.222.0.33 () {58 vars in 1272 bytes} [Fri Sep 23 04:48:40 2022] DELETE /compute/v2.1/os-security-groups/2b43103b-fe74-4ca9-a671-ed0c7e1d6dba => generated 0 bytes in 417 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:48:40.857296 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:48:40.861148 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-6594a9db-d787-4355-a139-30a928d370bd req-e80faea5-d4cd-4804-ba43-74567ae46030 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fb569cf-4457-4695-ad5f-fcb78f0964c5", "name": "network-vif-plugged", "status": "completed", "tag": "8fdad197-55e1-4686-bfa9-6cfa0beb24d5"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:48:40.892397 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-6594a9db-d787-4355-a139-30a928d370bd req-e80faea5-d4cd-4804-ba43-74567ae46030 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:40.898408 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-6594a9db-d787-4355-a139-30a928d370bd req-e80faea5-d4cd-4804-ba43-74567ae46030 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:40.899213 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-6594a9db-d787-4355-a139-30a928d370bd req-e80faea5-d4cd-4804-ba43-74567ae46030 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:40.917140 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-6594a9db-d787-4355-a139-30a928d370bd req-e80faea5-d4cd-4804-ba43-74567ae46030 service nova] Creating event network-vif-plugged:8fdad197-55e1-4686-bfa9-6cfa0beb24d5 for instance 4fb569cf-4457-4695-ad5f-fcb78f0964c5 on n-h2-846463-3 Sep 23 04:48:40.923307 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-6594a9db-d787-4355-a139-30a928d370bd req-e80faea5-d4cd-4804-ba43-74567ae46030 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065912 Sep 23 04:48:40.924192 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1928/3949] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:48:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:48:40.931168 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-21eb9dde-7461-4956-a096-522bb82e6dd8 tempest-SecurityGroupRulesTestJSON-1847559686 tempest-SecurityGroupRulesTestJSON-1847559686-project] Calling method '.version_select at 0x7ff1ba9f3280>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:40.958219 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-7b20e0f9-eeac-4041-8169-a0a62f44ca7a tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a0eac077-d4bd-4e4a-a04a-3f86aeeed9bd" status: 204 len: 0 microversion: 2.1 time: 0.413882 Sep 23 04:48:40.958887 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2022/3950] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:48:40 2022] DELETE /compute/v2.1/servers/a0eac077-d4bd-4e4a-a04a-3f86aeeed9bd => generated 0 bytes in 415 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:48:40.961537 n-d-846463-3 devstack@n-api.service[122698]: DEBUG neutronclient.v2_0.client [None req-21eb9dde-7461-4956-a096-522bb82e6dd8 tempest-SecurityGroupRulesTestJSON-1847559686 tempest-SecurityGroupRulesTestJSON-1847559686-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 11b75f73-395c-4381-bf41-f7fa73b5aa6e does not exist", "detail": ""}} {{(pid=122698) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 23 04:48:40.962211 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.network.security_group_api [None req-21eb9dde-7461-4956-a096-522bb82e6dd8 tempest-SecurityGroupRulesTestJSON-1847559686 tempest-SecurityGroupRulesTestJSON-1847559686-project] Neutron security group 11b75f73-395c-4381-bf41-f7fa73b5aa6e not found {{(pid=122698) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 23 04:48:40.962750 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-21eb9dde-7461-4956-a096-522bb82e6dd8 tempest-SecurityGroupRulesTestJSON-1847559686 tempest-SecurityGroupRulesTestJSON-1847559686-project] HTTP exception thrown: Security group 11b75f73-395c-4381-bf41-f7fa73b5aa6e does not exist Sep 23 04:48:40.962750 n-d-846463-3 devstack@n-api.service[122698]: Neutron server returns request_ids: ['req-0da2589a-aadd-4719-8c99-38d5193ee683'] Sep 23 04:48:40.964902 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-21eb9dde-7461-4956-a096-522bb82e6dd8 tempest-SecurityGroupRulesTestJSON-1847559686 tempest-SecurityGroupRulesTestJSON-1847559686-project] Request method failure captured: Sep 23 04:48:40.964902 n-d-846463-3 devstack@n-api.service[122698]: request: DELETE /compute/v2.1/os-security-groups/11b75f73-395c-4381-bf41-f7fa73b5aa6e HTTP/1.1 Sep 23 04:48:40.964902 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:48:40.964902 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:48:40.964902 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:48:40.964902 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:48:40.964902 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:48:40.964902 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:48:40.964902 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:48:40.964902 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:48:40.964902 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTqQ3LmFsesmvSEn2n_e_4BLCZ3pPBpCrbkW_kIJTskZhzBxcu_az5jbBQuj0Xk8KxPjzFHyBMQsSC3j7lUQqC2EiKDC4ymvynPPFJvIpJvhaeLU1wg7fGxK35fXl_AiqyxE9sfDm8DJmpicdnxAWrOs463LKPC4IaJdlR717TtPY7E Sep 23 04:48:40.964902 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:48:40.964902 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:48:40.964902 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:48:40.964902 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:48:40.964902 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:48:40.964902 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:48:40.964902 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: c17217dad1214a3f878e806b1e64017a Sep 23 04:48:40.964902 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-1847559686 Sep 23 04:48:40.964902 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:48:40.964902 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:48:40.964902 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c17217dad1214a3f878e806b1e64017a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c17217dad1214a3f878e806b1e64017a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c17217dad1214a3f878e806b1e64017a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c17217dad1214a3f878e806b1e64017a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:48:40.964902 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-SecurityGroupRulesTestJSON-1847559686 Sep 23 04:48:40.964902 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: c17217dad1214a3f878e806b1e64017a Sep 23 04:48:40.964902 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-1847559686 Sep 23 04:48:40.964902 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-SecurityGroupRulesTestJSON-1847559686-project Sep 23 04:48:40.964902 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:48:40.964902 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:48:40.964902 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 5e8ff8a501d24ec7af088992dbfe0451 Sep 23 04:48:40.964902 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-SecurityGroupRulesTestJSON-1847559686-project Sep 23 04:48:40.964902 n-d-846463-3 devstack@n-api.service[122698]: method: Sep 23 04:48:40.964902 n-d-846463-3 devstack@n-api.service[122698]: exception: Security group 11b75f73-395c-4381-bf41-f7fa73b5aa6e does not exist Sep 23 04:48:40.964902 n-d-846463-3 devstack@n-api.service[122698]: Neutron server returns request_ids: ['req-0da2589a-aadd-4719-8c99-38d5193ee683'] Sep 23 04:48:40.964902 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '11b75f73-395c-4381-bf41-f7fa73b5aa6e'} Sep 23 04:48:40.964902 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:48:40.964902 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:48:40.964902 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 23 04:48:40.964902 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 23 04:48:40.964902 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:48:40.964902 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:48:40.964902 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 23 04:48:40.964902 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 23 04:48:40.964902 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:48:40.964902 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:48:40.964902 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 23 04:48:40.964902 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 23 04:48:40.964902 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:48:40.964902 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:48:40.964902 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 23 04:48:40.964902 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 23 04:48:40.964902 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:48:40.964902 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:48:40.964902 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 23 04:48:40.964902 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 23 04:48:40.964902 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:48:40.964902 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:48:40.964902 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 23 04:48:40.964902 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 23 04:48:40.964902 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 23 04:48:40.964902 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 23 04:48:40.964902 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 11b75f73-395c-4381-bf41-f7fa73b5aa6e does not exist Sep 23 04:48:40.967910 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0da2589a-aadd-4719-8c99-38d5193ee683'] Sep 23 04:48:40.967910 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:48:40.967910 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:48:40.967910 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:48:40.967910 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:48:40.967910 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 23 04:48:40.967910 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 23 04:48:40.967910 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 23 04:48:40.967910 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 23 04:48:40.967910 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 11b75f73-395c-4381-bf41-f7fa73b5aa6e does not exist Sep 23 04:48:40.967910 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0da2589a-aadd-4719-8c99-38d5193ee683'] Sep 23 04:48:40.967910 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:48:40.967910 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:48:40.967910 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:48:40.967910 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:48:40.967910 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:48:40.967910 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:48:40.967910 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:48:40.967910 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:48:40.967910 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:48:40.967910 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:48:40.967910 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:48:40.967910 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:48:40.967910 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 23 04:48:40.967910 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 23 04:48:40.967910 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 11b75f73-395c-4381-bf41-f7fa73b5aa6e does not exist Sep 23 04:48:40.967910 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0da2589a-aadd-4719-8c99-38d5193ee683'] Sep 23 04:48:40.967910 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:48:40.967910 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:48:40.967910 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:48:40.967910 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:48:40.967910 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:48:40.967910 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:48:40.967910 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:48:40.967910 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:48:40.967910 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 11b75f73-395c-4381-bf41-f7fa73b5aa6e does not exist Sep 23 04:48:40.967910 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0da2589a-aadd-4719-8c99-38d5193ee683'] Sep 23 04:48:40.967910 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:48:40.967910 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-21eb9dde-7461-4956-a096-522bb82e6dd8 tempest-SecurityGroupRulesTestJSON-1847559686 tempest-SecurityGroupRulesTestJSON-1847559686-project] Returning 404 to user: Security group 11b75f73-395c-4381-bf41-f7fa73b5aa6e does not exist Sep 23 04:48:40.967910 n-d-846463-3 devstack@n-api.service[122698]: Neutron server returns request_ids: ['req-0da2589a-aadd-4719-8c99-38d5193ee683'] {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:48:40.967910 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-21eb9dde-7461-4956-a096-522bb82e6dd8 tempest-SecurityGroupRulesTestJSON-1847559686 tempest-SecurityGroupRulesTestJSON-1847559686-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/11b75f73-395c-4381-bf41-f7fa73b5aa6e" status: 404 len: 194 microversion: 2.1 time: 0.040858 Sep 23 04:48:40.967910 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1929/3951] 10.222.0.33 () {58 vars in 1272 bytes} [Fri Sep 23 04:48:40 2022] DELETE /compute/v2.1/os-security-groups/11b75f73-395c-4381-bf41-f7fa73b5aa6e => generated 194 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:48:40.969872 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-976f14db-4acd-4dbe-8927-abfcfcca72f5 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:40.969872 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-976f14db-4acd-4dbe-8927-abfcfcca72f5 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] [instance: 3fc8d6fc-3204-43f4-9b94-100d061769a5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:40.972665 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d8db2495-1e85-461c-b0f4-8d04b118f6c0 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:40.990444 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-976f14db-4acd-4dbe-8927-abfcfcca72f5 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:40.990444 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-976f14db-4acd-4dbe-8927-abfcfcca72f5 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:40.990444 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-976f14db-4acd-4dbe-8927-abfcfcca72f5 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:40.990444 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-976f14db-4acd-4dbe-8927-abfcfcca72f5 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:40.990444 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-976f14db-4acd-4dbe-8927-abfcfcca72f5 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:40.990444 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-976f14db-4acd-4dbe-8927-abfcfcca72f5 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:40.990922 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d8db2495-1e85-461c-b0f4-8d04b118f6c0 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] [instance: a0eac077-d4bd-4e4a-a04a-3f86aeeed9bd] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:40.998393 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d8db2495-1e85-461c-b0f4-8d04b118f6c0 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:40.998936 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d8db2495-1e85-461c-b0f4-8d04b118f6c0 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:40.999391 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d8db2495-1e85-461c-b0f4-8d04b118f6c0 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:41.000172 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d8db2495-1e85-461c-b0f4-8d04b118f6c0 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:41.002408 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d8db2495-1e85-461c-b0f4-8d04b118f6c0 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:41.002850 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d8db2495-1e85-461c-b0f4-8d04b118f6c0 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:41.102262 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-976f14db-4acd-4dbe-8927-abfcfcca72f5 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae134fe7522941698cad3f3fa11e747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16d72d2469433ca30ba6769e3d3f25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:41.112001 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-976f14db-4acd-4dbe-8927-abfcfcca72f5 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae134fe7522941698cad3f3fa11e747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16d72d2469433ca30ba6769e3d3f25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:41.114941 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-976f14db-4acd-4dbe-8927-abfcfcca72f5 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae134fe7522941698cad3f3fa11e747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16d72d2469433ca30ba6769e3d3f25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:41.116456 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-976f14db-4acd-4dbe-8927-abfcfcca72f5 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] 10.222.0.33 "GET /compute/v2.1/servers/3fc8d6fc-3204-43f4-9b94-100d061769a5" status: 200 len: 1372 microversion: 2.57 time: 0.154102 Sep 23 04:48:41.118675 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2023/3952] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:48:40 2022] GET /compute/v2.1/servers/3fc8d6fc-3204-43f4-9b94-100d061769a5 => generated 1372 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:48:41.123628 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-06acdaa6-e543-4d15-a41b-51c9f6af02a0 tempest-SecurityGroupRulesTestJSON-1847559686 tempest-SecurityGroupRulesTestJSON-1847559686-project] Calling method '.version_select at 0x7ff1ba931430>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:41.288078 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d8db2495-1e85-461c-b0f4-8d04b118f6c0 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff662b5d5b9e488d906565b490c8acf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dcca3b014be4e98b7db17bb37d073a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:41.297262 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d8db2495-1e85-461c-b0f4-8d04b118f6c0 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "GET /compute/v2.1/servers/a0eac077-d4bd-4e4a-a04a-3f86aeeed9bd" status: 200 len: 1474 microversion: 2.1 time: 0.329000 Sep 23 04:48:41.302148 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1930/3953] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:48:40 2022] GET /compute/v2.1/servers/a0eac077-d4bd-4e4a-a04a-3f86aeeed9bd => generated 1474 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:48:41.318803 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ea188e37-8301-4468-b290-753e2d01162a tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:41.319706 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-ea188e37-8301-4468-b290-753e2d01162a tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] [instance: 33690ae1-5128-4bfd-b0b1-5f1bdb916fae] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:41.327833 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ea188e37-8301-4468-b290-753e2d01162a tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:41.332176 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ea188e37-8301-4468-b290-753e2d01162a tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:41.333230 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ea188e37-8301-4468-b290-753e2d01162a tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:41.342503 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ea188e37-8301-4468-b290-753e2d01162a tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:41.343158 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ea188e37-8301-4468-b290-753e2d01162a tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:41.343792 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ea188e37-8301-4468-b290-753e2d01162a tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:41.502430 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ea188e37-8301-4468-b290-753e2d01162a tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a245dd82de1340f7a58873de1851c61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d02cb07a2a404c8d89aa13a950806d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:41.519095 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ea188e37-8301-4468-b290-753e2d01162a tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] 10.222.0.33 "GET /compute/v2.1/servers/33690ae1-5128-4bfd-b0b1-5f1bdb916fae" status: 200 len: 1229 microversion: 2.1 time: 0.215255 Sep 23 04:48:41.520123 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1931/3954] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:48:41 2022] GET /compute/v2.1/servers/33690ae1-5128-4bfd-b0b1-5f1bdb916fae => generated 1229 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:48:41.569632 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-400648c3-2adc-4357-91d8-d92b22c5cd5c tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:41.570615 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-400648c3-2adc-4357-91d8-d92b22c5cd5c tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: fe7dee09-8351-4d41-8c44-8d35a966cce9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:41.578175 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-400648c3-2adc-4357-91d8-d92b22c5cd5c tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:41.579008 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-400648c3-2adc-4357-91d8-d92b22c5cd5c tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:41.579611 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-400648c3-2adc-4357-91d8-d92b22c5cd5c tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:41.580611 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-400648c3-2adc-4357-91d8-d92b22c5cd5c tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:41.581277 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-400648c3-2adc-4357-91d8-d92b22c5cd5c tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:41.581924 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-400648c3-2adc-4357-91d8-d92b22c5cd5c tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:41.671107 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-06acdaa6-e543-4d15-a41b-51c9f6af02a0 tempest-SecurityGroupRulesTestJSON-1847559686 tempest-SecurityGroupRulesTestJSON-1847559686-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/a678e2dc-91f9-4fef-b8ba-a23ca4e82617" status: 202 len: 0 microversion: 2.1 time: 0.551158 Sep 23 04:48:41.672509 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2024/3955] 10.222.0.33 () {58 vars in 1272 bytes} [Fri Sep 23 04:48:41 2022] DELETE /compute/v2.1/os-security-groups/a678e2dc-91f9-4fef-b8ba-a23ca4e82617 => generated 0 bytes in 553 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:48:41.702805 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-bdd65814-5d99-4622-8f10-be7cef54543f tempest-SecurityGroupRulesTestJSON-1847559686 tempest-SecurityGroupRulesTestJSON-1847559686-project] Calling method '.version_select at 0x7ff1ba9315e0>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:41.874818 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-400648c3-2adc-4357-91d8-d92b22c5cd5c tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:41.889544 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-400648c3-2adc-4357-91d8-d92b22c5cd5c tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:41.891063 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-400648c3-2adc-4357-91d8-d92b22c5cd5c tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:41.896582 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-400648c3-2adc-4357-91d8-d92b22c5cd5c tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9" status: 200 len: 1722 microversion: 2.20 time: 0.335649 Sep 23 04:48:41.896582 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1932/3956] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:48:41 2022] GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9 => generated 1722 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:48:42.140163 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-bdd65814-5d99-4622-8f10-be7cef54543f tempest-SecurityGroupRulesTestJSON-1847559686 tempest-SecurityGroupRulesTestJSON-1847559686-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/247c34db-f15d-43e2-baee-775ca713ae53" status: 202 len: 0 microversion: 2.1 time: 0.460753 Sep 23 04:48:42.140748 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2025/3957] 10.222.0.33 () {58 vars in 1272 bytes} [Fri Sep 23 04:48:41 2022] DELETE /compute/v2.1/os-security-groups/247c34db-f15d-43e2-baee-775ca713ae53 => generated 0 bytes in 465 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 23 04:48:42.144740 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-cf315da4-1c42-40e5-b519-22d1290ab8ac tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:42.145366 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-cf315da4-1c42-40e5-b519-22d1290ab8ac tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] [instance: 3fc8d6fc-3204-43f4-9b94-100d061769a5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:42.149243 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a7bde775-bfa0-4e36-baae-557e0e5275b4 tempest-SecurityGroupRulesTestJSON-1847559686 tempest-SecurityGroupRulesTestJSON-1847559686-project] Calling method '.version_select at 0x7ff1ba91fa60>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:42.153058 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cf315da4-1c42-40e5-b519-22d1290ab8ac tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:42.155920 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cf315da4-1c42-40e5-b519-22d1290ab8ac tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:42.155920 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cf315da4-1c42-40e5-b519-22d1290ab8ac tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:42.155920 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cf315da4-1c42-40e5-b519-22d1290ab8ac tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:42.155920 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cf315da4-1c42-40e5-b519-22d1290ab8ac tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:42.156592 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cf315da4-1c42-40e5-b519-22d1290ab8ac tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:42.455093 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-cf315da4-1c42-40e5-b519-22d1290ab8ac tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae134fe7522941698cad3f3fa11e747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16d72d2469433ca30ba6769e3d3f25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:42.471924 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-cf315da4-1c42-40e5-b519-22d1290ab8ac tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae134fe7522941698cad3f3fa11e747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16d72d2469433ca30ba6769e3d3f25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:42.475785 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-cf315da4-1c42-40e5-b519-22d1290ab8ac tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae134fe7522941698cad3f3fa11e747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16d72d2469433ca30ba6769e3d3f25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:42.477994 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-cf315da4-1c42-40e5-b519-22d1290ab8ac tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] 10.222.0.33 "GET /compute/v2.1/servers/3fc8d6fc-3204-43f4-9b94-100d061769a5" status: 200 len: 1372 microversion: 2.57 time: 0.337653 Sep 23 04:48:42.484198 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1933/3958] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:48:42 2022] GET /compute/v2.1/servers/3fc8d6fc-3204-43f4-9b94-100d061769a5 => generated 1372 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:48:42.496825 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-cf53ecd2-4899-4199-948a-ef286fd1edc4 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:42.497647 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-cf53ecd2-4899-4199-948a-ef286fd1edc4 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] [instance: a0eac077-d4bd-4e4a-a04a-3f86aeeed9bd] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:42.513155 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cf53ecd2-4899-4199-948a-ef286fd1edc4 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:42.513749 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cf53ecd2-4899-4199-948a-ef286fd1edc4 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:42.514135 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cf53ecd2-4899-4199-948a-ef286fd1edc4 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:42.514867 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cf53ecd2-4899-4199-948a-ef286fd1edc4 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:42.515337 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cf53ecd2-4899-4199-948a-ef286fd1edc4 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:42.518495 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cf53ecd2-4899-4199-948a-ef286fd1edc4 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:42.582935 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a7bde775-bfa0-4e36-baae-557e0e5275b4 tempest-SecurityGroupRulesTestJSON-1847559686 tempest-SecurityGroupRulesTestJSON-1847559686-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/f552062e-fbef-4048-b33b-34792531cdc0" status: 202 len: 0 microversion: 2.1 time: 0.437713 Sep 23 04:48:42.584018 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2026/3959] 10.222.0.33 () {58 vars in 1272 bytes} [Fri Sep 23 04:48:42 2022] DELETE /compute/v2.1/os-security-groups/f552062e-fbef-4048-b33b-34792531cdc0 => generated 0 bytes in 439 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 23 04:48:42.590698 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-04c907dc-8816-436b-a04d-30276ecee0e5 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:42.591510 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-04c907dc-8816-436b-a04d-30276ecee0e5 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] [instance: 33690ae1-5128-4bfd-b0b1-5f1bdb916fae] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:42.611349 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-04c907dc-8816-436b-a04d-30276ecee0e5 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:42.611859 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-04c907dc-8816-436b-a04d-30276ecee0e5 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:42.615948 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-04c907dc-8816-436b-a04d-30276ecee0e5 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:42.615948 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-04c907dc-8816-436b-a04d-30276ecee0e5 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:42.615948 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-04c907dc-8816-436b-a04d-30276ecee0e5 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:42.615948 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-04c907dc-8816-436b-a04d-30276ecee0e5 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:42.818191 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-04c907dc-8816-436b-a04d-30276ecee0e5 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a245dd82de1340f7a58873de1851c61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d02cb07a2a404c8d89aa13a950806d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:42.831691 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-04c907dc-8816-436b-a04d-30276ecee0e5 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] 10.222.0.33 "GET /compute/v2.1/servers/33690ae1-5128-4bfd-b0b1-5f1bdb916fae" status: 200 len: 1277 microversion: 2.1 time: 0.246462 Sep 23 04:48:42.832824 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2027/3960] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:48:42 2022] GET /compute/v2.1/servers/33690ae1-5128-4bfd-b0b1-5f1bdb916fae => generated 1277 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:48:42.838886 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8fc18393-c1fe-481f-b28f-864d152c0058 tempest-SecurityGroupRulesTestJSON-1847559686 tempest-SecurityGroupRulesTestJSON-1847559686-project] Calling method '.version_select at 0x7ff1ba91f310>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:43.097714 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-cf53ecd2-4899-4199-948a-ef286fd1edc4 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff662b5d5b9e488d906565b490c8acf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dcca3b014be4e98b7db17bb37d073a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:43.101586 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:48:43.106144 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-cf53ecd2-4899-4199-948a-ef286fd1edc4 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "GET /compute/v2.1/servers/a0eac077-d4bd-4e4a-a04a-3f86aeeed9bd" status: 200 len: 1474 microversion: 2.1 time: 0.620683 Sep 23 04:48:43.120921 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1934/3961] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:48:42 2022] GET /compute/v2.1/servers/a0eac077-d4bd-4e4a-a04a-3f86aeeed9bd => generated 1474 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:48:43.125697 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-03747a91-e494-4716-9086-bef73e977475 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:43.125697 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-03747a91-e494-4716-9086-bef73e977475 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: fe7dee09-8351-4d41-8c44-8d35a966cce9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:43.143546 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-03747a91-e494-4716-9086-bef73e977475 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:43.149437 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-03747a91-e494-4716-9086-bef73e977475 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:43.149437 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-03747a91-e494-4716-9086-bef73e977475 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:43.149437 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-03747a91-e494-4716-9086-bef73e977475 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:43.149437 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-03747a91-e494-4716-9086-bef73e977475 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:43.149437 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-03747a91-e494-4716-9086-bef73e977475 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:43.536424 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-03747a91-e494-4716-9086-bef73e977475 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:43.546460 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-03747a91-e494-4716-9086-bef73e977475 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:43.553627 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-03747a91-e494-4716-9086-bef73e977475 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:43.556206 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-03747a91-e494-4716-9086-bef73e977475 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9" status: 200 len: 1722 microversion: 2.20 time: 0.436795 Sep 23 04:48:43.558978 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1935/3962] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:48:43 2022] GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9 => generated 1722 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:48:43.589614 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8e4543af-7f5c-4364-87aa-19430966af8d tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:43.590594 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8e4543af-7f5c-4364-87aa-19430966af8d tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] [instance: 3fc8d6fc-3204-43f4-9b94-100d061769a5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:43.598801 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8e4543af-7f5c-4364-87aa-19430966af8d tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:43.599491 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8e4543af-7f5c-4364-87aa-19430966af8d tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:43.600083 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8e4543af-7f5c-4364-87aa-19430966af8d tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:43.603643 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8e4543af-7f5c-4364-87aa-19430966af8d tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:43.604452 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8e4543af-7f5c-4364-87aa-19430966af8d tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:43.605066 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8e4543af-7f5c-4364-87aa-19430966af8d tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:43.689157 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-8fc18393-c1fe-481f-b28f-864d152c0058 tempest-SecurityGroupRulesTestJSON-1847559686 tempest-SecurityGroupRulesTestJSON-1847559686-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/28727362-a34c-41fa-a189-d88e17d2579c" status: 202 len: 0 microversion: 2.1 time: 0.855111 Sep 23 04:48:43.694048 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2028/3963] 10.222.0.33 () {58 vars in 1272 bytes} [Fri Sep 23 04:48:42 2022] DELETE /compute/v2.1/os-security-groups/28727362-a34c-41fa-a189-d88e17d2579c => generated 0 bytes in 860 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:48:43.700454 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-530b3400-793d-4f8c-b35c-aac12fa84a01 tempest-SecurityGroupRulesTestJSON-1847559686 tempest-SecurityGroupRulesTestJSON-1847559686-project] Calling method '.version_select at 0x7ff1ba91f160>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:43.813577 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8e4543af-7f5c-4364-87aa-19430966af8d tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae134fe7522941698cad3f3fa11e747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16d72d2469433ca30ba6769e3d3f25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:43.830213 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8e4543af-7f5c-4364-87aa-19430966af8d tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae134fe7522941698cad3f3fa11e747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16d72d2469433ca30ba6769e3d3f25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:43.831923 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8e4543af-7f5c-4364-87aa-19430966af8d tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae134fe7522941698cad3f3fa11e747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16d72d2469433ca30ba6769e3d3f25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:43.833173 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8e4543af-7f5c-4364-87aa-19430966af8d tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] 10.222.0.33 "GET /compute/v2.1/servers/3fc8d6fc-3204-43f4-9b94-100d061769a5" status: 200 len: 1357 microversion: 2.57 time: 0.248871 Sep 23 04:48:43.834716 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1936/3964] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:48:43 2022] GET /compute/v2.1/servers/3fc8d6fc-3204-43f4-9b94-100d061769a5 => generated 1357 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:48:43.859649 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4ae4f1b5-e947-4210-9f7a-1de9044f839d tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:43.860271 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4ae4f1b5-e947-4210-9f7a-1de9044f839d tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] [instance: 33690ae1-5128-4bfd-b0b1-5f1bdb916fae] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:43.869288 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4ae4f1b5-e947-4210-9f7a-1de9044f839d tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:43.869839 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4ae4f1b5-e947-4210-9f7a-1de9044f839d tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:43.870273 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4ae4f1b5-e947-4210-9f7a-1de9044f839d tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:43.870992 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4ae4f1b5-e947-4210-9f7a-1de9044f839d tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:43.871450 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4ae4f1b5-e947-4210-9f7a-1de9044f839d tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:43.877273 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4ae4f1b5-e947-4210-9f7a-1de9044f839d tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:44.035722 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4ae4f1b5-e947-4210-9f7a-1de9044f839d tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a245dd82de1340f7a58873de1851c61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d02cb07a2a404c8d89aa13a950806d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:44.047484 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4ae4f1b5-e947-4210-9f7a-1de9044f839d tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] 10.222.0.33 "GET /compute/v2.1/servers/33690ae1-5128-4bfd-b0b1-5f1bdb916fae" status: 200 len: 1283 microversion: 2.1 time: 0.192552 Sep 23 04:48:44.051827 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1937/3965] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:48:43 2022] GET /compute/v2.1/servers/33690ae1-5128-4bfd-b0b1-5f1bdb916fae => generated 1283 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:48:44.067370 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-59adceb8-095f-40e7-9233-3f2b37b232bf tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:44.067889 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-59adceb8-095f-40e7-9233-3f2b37b232bf tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] [instance: 3fc8d6fc-3204-43f4-9b94-100d061769a5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:44.083681 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-59adceb8-095f-40e7-9233-3f2b37b232bf tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:44.084231 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-59adceb8-095f-40e7-9233-3f2b37b232bf tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:44.084683 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-59adceb8-095f-40e7-9233-3f2b37b232bf tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:44.085947 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-59adceb8-095f-40e7-9233-3f2b37b232bf tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:44.090725 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-59adceb8-095f-40e7-9233-3f2b37b232bf tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:44.091530 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-59adceb8-095f-40e7-9233-3f2b37b232bf tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:44.132183 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-59adceb8-095f-40e7-9233-3f2b37b232bf tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] [instance: 3fc8d6fc-3204-43f4-9b94-100d061769a5] Going to try to terminate instance {{(pid=122698) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:48:44.598703 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-59adceb8-095f-40e7-9233-3f2b37b232bf tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] 10.222.0.33 "DELETE /compute/v2.1/servers/3fc8d6fc-3204-43f4-9b94-100d061769a5" status: 204 len: 0 microversion: 2.57 time: 0.544251 Sep 23 04:48:44.599520 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1938/3966] 10.222.0.33 () {60 vars in 1280 bytes} [Fri Sep 23 04:48:44 2022] DELETE /compute/v2.1/servers/3fc8d6fc-3204-43f4-9b94-100d061769a5 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 23 04:48:44.608843 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-bd8dc380-e940-4cfd-8cfc-05263b8fc5f5 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:44.615189 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-bd8dc380-e940-4cfd-8cfc-05263b8fc5f5 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] [instance: a0eac077-d4bd-4e4a-a04a-3f86aeeed9bd] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:44.629022 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bd8dc380-e940-4cfd-8cfc-05263b8fc5f5 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:44.630249 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bd8dc380-e940-4cfd-8cfc-05263b8fc5f5 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:44.630861 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bd8dc380-e940-4cfd-8cfc-05263b8fc5f5 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:44.632105 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bd8dc380-e940-4cfd-8cfc-05263b8fc5f5 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:44.633770 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bd8dc380-e940-4cfd-8cfc-05263b8fc5f5 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:44.636797 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bd8dc380-e940-4cfd-8cfc-05263b8fc5f5 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:44.662033 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-530b3400-793d-4f8c-b35c-aac12fa84a01 tempest-SecurityGroupRulesTestJSON-1847559686 tempest-SecurityGroupRulesTestJSON-1847559686-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/b60a50d6-280f-4e41-837d-47b577f3f95c" status: 202 len: 0 microversion: 2.1 time: 0.962559 Sep 23 04:48:44.662033 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2029/3967] 10.222.0.33 () {58 vars in 1272 bytes} [Fri Sep 23 04:48:43 2022] DELETE /compute/v2.1/os-security-groups/b60a50d6-280f-4e41-837d-47b577f3f95c => generated 0 bytes in 964 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:48:44.683435 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-62b2ceb1-df8c-43e6-9c75-ac6ebc3341fe req-8dbc96f4-bd5c-43d6-b668-a909abe558ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe7dee09-8351-4d41-8c44-8d35a966cce9", "name": "network-vif-unplugged", "status": "completed", "tag": "c9b47e66-2bb6-4e68-a2b9-4fb9fec9ff30"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:48:44.705516 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-62b2ceb1-df8c-43e6-9c75-ac6ebc3341fe req-8dbc96f4-bd5c-43d6-b668-a909abe558ba service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:44.706451 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-62b2ceb1-df8c-43e6-9c75-ac6ebc3341fe req-8dbc96f4-bd5c-43d6-b668-a909abe558ba service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:44.707186 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-62b2ceb1-df8c-43e6-9c75-ac6ebc3341fe req-8dbc96f4-bd5c-43d6-b668-a909abe558ba service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:44.758784 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-62b2ceb1-df8c-43e6-9c75-ac6ebc3341fe req-8dbc96f4-bd5c-43d6-b668-a909abe558ba service nova] Creating event network-vif-unplugged:c9b47e66-2bb6-4e68-a2b9-4fb9fec9ff30 for instance fe7dee09-8351-4d41-8c44-8d35a966cce9 on n-h2-846463-3 Sep 23 04:48:44.784040 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-62b2ceb1-df8c-43e6-9c75-ac6ebc3341fe req-8dbc96f4-bd5c-43d6-b668-a909abe558ba service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.117776 Sep 23 04:48:44.799339 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2030/3968] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:48:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:48:44.833023 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-e1cf85a4-61f8-4276-a28f-15a8ddf5c90f req-448c9603-6d25-4205-9781-6204017fa44c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0eac077-d4bd-4e4a-a04a-3f86aeeed9bd", "name": "network-vif-deleted", "tag": "8f6a797f-179a-458b-adf8-7a33bc4631ac"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:48:44.892292 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-e1cf85a4-61f8-4276-a28f-15a8ddf5c90f req-448c9603-6d25-4205-9781-6204017fa44c service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:44.893000 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-e1cf85a4-61f8-4276-a28f-15a8ddf5c90f req-448c9603-6d25-4205-9781-6204017fa44c service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:44.893615 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-e1cf85a4-61f8-4276-a28f-15a8ddf5c90f req-448c9603-6d25-4205-9781-6204017fa44c service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:44.919180 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-e1cf85a4-61f8-4276-a28f-15a8ddf5c90f req-448c9603-6d25-4205-9781-6204017fa44c service nova] Creating event network-vif-deleted:8f6a797f-179a-458b-adf8-7a33bc4631ac for instance a0eac077-d4bd-4e4a-a04a-3f86aeeed9bd on n-h1-846463-3 Sep 23 04:48:44.935782 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-e1cf85a4-61f8-4276-a28f-15a8ddf5c90f req-448c9603-6d25-4205-9781-6204017fa44c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134428 Sep 23 04:48:44.936976 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2031/3969] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:48:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:48:44.942764 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6b7f4829-e13d-49a0-8c1b-59799fc3da4a tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:44.943684 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-6b7f4829-e13d-49a0-8c1b-59799fc3da4a tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: fe7dee09-8351-4d41-8c44-8d35a966cce9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:44.979389 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6b7f4829-e13d-49a0-8c1b-59799fc3da4a tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:44.980190 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6b7f4829-e13d-49a0-8c1b-59799fc3da4a tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:44.980951 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6b7f4829-e13d-49a0-8c1b-59799fc3da4a tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:44.984072 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6b7f4829-e13d-49a0-8c1b-59799fc3da4a tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:44.984759 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6b7f4829-e13d-49a0-8c1b-59799fc3da4a tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:44.985351 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6b7f4829-e13d-49a0-8c1b-59799fc3da4a tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:45.239744 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-bd8dc380-e940-4cfd-8cfc-05263b8fc5f5 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff662b5d5b9e488d906565b490c8acf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dcca3b014be4e98b7db17bb37d073a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:45.254144 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-bd8dc380-e940-4cfd-8cfc-05263b8fc5f5 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "GET /compute/v2.1/servers/a0eac077-d4bd-4e4a-a04a-3f86aeeed9bd" status: 200 len: 1432 microversion: 2.1 time: 0.653073 Sep 23 04:48:45.259269 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1939/3970] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:48:44 2022] GET /compute/v2.1/servers/a0eac077-d4bd-4e4a-a04a-3f86aeeed9bd => generated 1432 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:48:45.267163 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0818d960-d067-4b9d-984c-9c708cdf7525 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:45.271886 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-0818d960-d067-4b9d-984c-9c708cdf7525 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] [instance: 3fc8d6fc-3204-43f4-9b94-100d061769a5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:45.296494 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0818d960-d067-4b9d-984c-9c708cdf7525 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:45.296494 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0818d960-d067-4b9d-984c-9c708cdf7525 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:45.296494 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0818d960-d067-4b9d-984c-9c708cdf7525 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:45.296494 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0818d960-d067-4b9d-984c-9c708cdf7525 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:45.296494 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0818d960-d067-4b9d-984c-9c708cdf7525 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:45.296494 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0818d960-d067-4b9d-984c-9c708cdf7525 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:45.499088 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-0818d960-d067-4b9d-984c-9c708cdf7525 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae134fe7522941698cad3f3fa11e747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16d72d2469433ca30ba6769e3d3f25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:45.516802 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-0818d960-d067-4b9d-984c-9c708cdf7525 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae134fe7522941698cad3f3fa11e747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16d72d2469433ca30ba6769e3d3f25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:45.528576 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-0818d960-d067-4b9d-984c-9c708cdf7525 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae134fe7522941698cad3f3fa11e747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16d72d2469433ca30ba6769e3d3f25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:45.531914 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0818d960-d067-4b9d-984c-9c708cdf7525 tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] 10.222.0.33 "GET /compute/v2.1/servers/3fc8d6fc-3204-43f4-9b94-100d061769a5" status: 200 len: 1363 microversion: 2.57 time: 0.270826 Sep 23 04:48:45.535439 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1940/3971] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:48:45 2022] GET /compute/v2.1/servers/3fc8d6fc-3204-43f4-9b94-100d061769a5 => generated 1363 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:48:45.549287 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-56cadeb7-0e68-46e2-83d3-c5e3e136831b tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:45.555654 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-56cadeb7-0e68-46e2-83d3-c5e3e136831b tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] [instance: 33690ae1-5128-4bfd-b0b1-5f1bdb916fae] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:45.562726 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-6b7f4829-e13d-49a0-8c1b-59799fc3da4a tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:45.578284 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-56cadeb7-0e68-46e2-83d3-c5e3e136831b tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:45.578767 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-56cadeb7-0e68-46e2-83d3-c5e3e136831b tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:45.579208 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-56cadeb7-0e68-46e2-83d3-c5e3e136831b tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:45.581080 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-56cadeb7-0e68-46e2-83d3-c5e3e136831b tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:45.581727 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-56cadeb7-0e68-46e2-83d3-c5e3e136831b tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:45.582815 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-56cadeb7-0e68-46e2-83d3-c5e3e136831b tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:45.599296 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-6b7f4829-e13d-49a0-8c1b-59799fc3da4a tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:45.602625 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-6b7f4829-e13d-49a0-8c1b-59799fc3da4a tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:45.603860 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6b7f4829-e13d-49a0-8c1b-59799fc3da4a tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9" status: 200 len: 1722 microversion: 2.20 time: 0.665632 Sep 23 04:48:45.604438 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2032/3972] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:48:44 2022] GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9 => generated 1722 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:48:45.955982 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-56cadeb7-0e68-46e2-83d3-c5e3e136831b tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a245dd82de1340f7a58873de1851c61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d02cb07a2a404c8d89aa13a950806d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:45.973516 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-56cadeb7-0e68-46e2-83d3-c5e3e136831b tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] 10.222.0.33 "GET /compute/v2.1/servers/33690ae1-5128-4bfd-b0b1-5f1bdb916fae" status: 200 len: 1325 microversion: 2.1 time: 0.434005 Sep 23 04:48:45.974739 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1941/3973] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:48:45 2022] GET /compute/v2.1/servers/33690ae1-5128-4bfd-b0b1-5f1bdb916fae => generated 1325 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:48:46.283844 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6dce5d87-b7e3-431c-ad2f-68771ef922de tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:46.284921 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-6dce5d87-b7e3-431c-ad2f-68771ef922de tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] [instance: a0eac077-d4bd-4e4a-a04a-3f86aeeed9bd] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:46.295525 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6dce5d87-b7e3-431c-ad2f-68771ef922de tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:46.329191 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6dce5d87-b7e3-431c-ad2f-68771ef922de tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:46.329459 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6dce5d87-b7e3-431c-ad2f-68771ef922de tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.033s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:46.335141 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6dce5d87-b7e3-431c-ad2f-68771ef922de tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:46.338226 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6dce5d87-b7e3-431c-ad2f-68771ef922de tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:46.342888 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6dce5d87-b7e3-431c-ad2f-68771ef922de tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:46.467866 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6dce5d87-b7e3-431c-ad2f-68771ef922de tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:46.468370 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6dce5d87-b7e3-431c-ad2f-68771ef922de tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:46.468814 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6dce5d87-b7e3-431c-ad2f-68771ef922de tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:46.469278 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-6dce5d87-b7e3-431c-ad2f-68771ef922de tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lazy-loading 'fault' on Instance uuid a0eac077-d4bd-4e4a-a04a-3f86aeeed9bd {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:48:46.551892 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-6dce5d87-b7e3-431c-ad2f-68771ef922de tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff662b5d5b9e488d906565b490c8acf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dcca3b014be4e98b7db17bb37d073a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:46.563497 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e05c1b33-27e7-45a5-b3ef-0b9686b948de tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:46.564399 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e05c1b33-27e7-45a5-b3ef-0b9686b948de tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] [instance: 3fc8d6fc-3204-43f4-9b94-100d061769a5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:46.568570 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6dce5d87-b7e3-431c-ad2f-68771ef922de tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "GET /compute/v2.1/servers/a0eac077-d4bd-4e4a-a04a-3f86aeeed9bd" status: 200 len: 1308 microversion: 2.1 time: 0.288628 Sep 23 04:48:46.569377 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2033/3974] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:48:46 2022] GET /compute/v2.1/servers/a0eac077-d4bd-4e4a-a04a-3f86aeeed9bd => generated 1308 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:48:46.585853 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e05c1b33-27e7-45a5-b3ef-0b9686b948de tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:46.586609 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e05c1b33-27e7-45a5-b3ef-0b9686b948de tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:46.587091 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e05c1b33-27e7-45a5-b3ef-0b9686b948de tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:46.587840 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e05c1b33-27e7-45a5-b3ef-0b9686b948de tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:46.588311 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e05c1b33-27e7-45a5-b3ef-0b9686b948de tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:46.588747 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e05c1b33-27e7-45a5-b3ef-0b9686b948de tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:46.637906 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d7f91d18-d57d-46b9-93d7-291f81b59a0c tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:46.639118 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d7f91d18-d57d-46b9-93d7-291f81b59a0c tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: fe7dee09-8351-4d41-8c44-8d35a966cce9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:46.667246 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d7f91d18-d57d-46b9-93d7-291f81b59a0c tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:46.674924 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d7f91d18-d57d-46b9-93d7-291f81b59a0c tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:46.674924 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d7f91d18-d57d-46b9-93d7-291f81b59a0c tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:46.678594 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d7f91d18-d57d-46b9-93d7-291f81b59a0c tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:46.682350 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d7f91d18-d57d-46b9-93d7-291f81b59a0c tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:46.683771 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d7f91d18-d57d-46b9-93d7-291f81b59a0c tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:46.770322 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e05c1b33-27e7-45a5-b3ef-0b9686b948de tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae134fe7522941698cad3f3fa11e747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16d72d2469433ca30ba6769e3d3f25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:46.787542 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e05c1b33-27e7-45a5-b3ef-0b9686b948de tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae134fe7522941698cad3f3fa11e747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16d72d2469433ca30ba6769e3d3f25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:46.789478 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e05c1b33-27e7-45a5-b3ef-0b9686b948de tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae134fe7522941698cad3f3fa11e747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16d72d2469433ca30ba6769e3d3f25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:46.792256 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e05c1b33-27e7-45a5-b3ef-0b9686b948de tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] 10.222.0.33 "GET /compute/v2.1/servers/3fc8d6fc-3204-43f4-9b94-100d061769a5" status: 200 len: 1363 microversion: 2.57 time: 0.233044 Sep 23 04:48:46.793748 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1942/3975] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:48:46 2022] GET /compute/v2.1/servers/3fc8d6fc-3204-43f4-9b94-100d061769a5 => generated 1363 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:48:46.804931 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-a1ebbbfa-fce7-4dcf-a8eb-0fd1a640640e req-99fc878b-f07e-42a3-acab-baf3f95d748f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33690ae1-5128-4bfd-b0b1-5f1bdb916fae", "tag": "591e0b9b-7a3c-4d9b-ba24-6b6408f5613a"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:48:46.844384 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-a1ebbbfa-fce7-4dcf-a8eb-0fd1a640640e req-99fc878b-f07e-42a3-acab-baf3f95d748f service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:46.845019 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-a1ebbbfa-fce7-4dcf-a8eb-0fd1a640640e req-99fc878b-f07e-42a3-acab-baf3f95d748f service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:46.845565 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-a1ebbbfa-fce7-4dcf-a8eb-0fd1a640640e req-99fc878b-f07e-42a3-acab-baf3f95d748f service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:46.881363 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-a1ebbbfa-fce7-4dcf-a8eb-0fd1a640640e req-99fc878b-f07e-42a3-acab-baf3f95d748f service nova] Creating event network-changed:591e0b9b-7a3c-4d9b-ba24-6b6408f5613a for instance 33690ae1-5128-4bfd-b0b1-5f1bdb916fae on n-h2-846463-3 Sep 23 04:48:46.900993 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-a1ebbbfa-fce7-4dcf-a8eb-0fd1a640640e req-99fc878b-f07e-42a3-acab-baf3f95d748f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099672 Sep 23 04:48:46.901859 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1943/3976] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:48:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:48:47.002040 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3054f089-4ade-400b-885b-c7dc2b54c171 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:47.002880 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3054f089-4ade-400b-885b-c7dc2b54c171 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] [instance: 33690ae1-5128-4bfd-b0b1-5f1bdb916fae] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:47.020020 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3054f089-4ade-400b-885b-c7dc2b54c171 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:47.020533 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3054f089-4ade-400b-885b-c7dc2b54c171 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:47.020981 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3054f089-4ade-400b-885b-c7dc2b54c171 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:47.021701 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3054f089-4ade-400b-885b-c7dc2b54c171 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:47.022209 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3054f089-4ade-400b-885b-c7dc2b54c171 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:47.022639 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3054f089-4ade-400b-885b-c7dc2b54c171 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:47.180193 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d7f91d18-d57d-46b9-93d7-291f81b59a0c tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:47.192626 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d7f91d18-d57d-46b9-93d7-291f81b59a0c tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:47.194251 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d7f91d18-d57d-46b9-93d7-291f81b59a0c tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:47.196337 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d7f91d18-d57d-46b9-93d7-291f81b59a0c tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9" status: 200 len: 1725 microversion: 2.20 time: 0.564778 Sep 23 04:48:47.216892 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2034/3977] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:48:46 2022] GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9 => generated 1725 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:48:47.228469 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ee7f9d6d-affe-4e79-bbaf-8675887e3958 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d3597f6d-271b-4aaf-bd1b-434410669ce5"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:48:47.232841 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ee7f9d6d-affe-4e79-bbaf-8675887e3958 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: fe7dee09-8351-4d41-8c44-8d35a966cce9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:47.239193 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ee7f9d6d-affe-4e79-bbaf-8675887e3958 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:47.240002 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ee7f9d6d-affe-4e79-bbaf-8675887e3958 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:47.240465 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ee7f9d6d-affe-4e79-bbaf-8675887e3958 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:47.241462 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ee7f9d6d-affe-4e79-bbaf-8675887e3958 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:47.241737 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ee7f9d6d-affe-4e79-bbaf-8675887e3958 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:47.242208 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ee7f9d6d-affe-4e79-bbaf-8675887e3958 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:47.348893 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-3054f089-4ade-400b-885b-c7dc2b54c171 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a245dd82de1340f7a58873de1851c61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d02cb07a2a404c8d89aa13a950806d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:47.365354 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3054f089-4ade-400b-885b-c7dc2b54c171 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] 10.222.0.33 "GET /compute/v2.1/servers/33690ae1-5128-4bfd-b0b1-5f1bdb916fae" status: 200 len: 1325 microversion: 2.1 time: 0.368036 Sep 23 04:48:47.396200 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1944/3978] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:48:46 2022] GET /compute/v2.1/servers/33690ae1-5128-4bfd-b0b1-5f1bdb916fae => generated 1325 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:48:47.597671 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ffbc61ae-38f0-40b6-921a-122eb3e979a9 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:47.600315 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-ffbc61ae-38f0-40b6-921a-122eb3e979a9 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] [instance: a0eac077-d4bd-4e4a-a04a-3f86aeeed9bd] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:47.619979 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ffbc61ae-38f0-40b6-921a-122eb3e979a9 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:47.627411 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ffbc61ae-38f0-40b6-921a-122eb3e979a9 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:47.628809 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ffbc61ae-38f0-40b6-921a-122eb3e979a9 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:47.630679 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ffbc61ae-38f0-40b6-921a-122eb3e979a9 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:47.633085 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ffbc61ae-38f0-40b6-921a-122eb3e979a9 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:47.633610 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ffbc61ae-38f0-40b6-921a-122eb3e979a9 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:47.679760 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-ffbc61ae-38f0-40b6-921a-122eb3e979a9 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] HTTP exception thrown: Instance a0eac077-d4bd-4e4a-a04a-3f86aeeed9bd could not be found. Sep 23 04:48:47.692417 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ffbc61ae-38f0-40b6-921a-122eb3e979a9 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Request method failure captured: Sep 23 04:48:47.692417 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/a0eac077-d4bd-4e4a-a04a-3f86aeeed9bd HTTP/1.1 Sep 23 04:48:47.692417 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:48:47.692417 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:48:47.692417 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:48:47.692417 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:48:47.692417 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:48:47.692417 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:48:47.692417 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:48:47.692417 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:48:47.692417 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLToXyXyEWneqKj6VYzspWUSeMdBqBE7U7JNs9hFRayXJjDbqPjRZkW_A1CwKrzNJE5blGGf86tQUTHr_Kcf8neU2x3hkd3Bm8fYGDYX0hKdmBOCxiC93Y25lZgw0F3fVlaKiw7iJn47HCToAj_SlZop2r-o8P_tLrYx4irv4mtlLkjA Sep 23 04:48:47.692417 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:48:47.692417 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:48:47.692417 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:48:47.692417 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:48:47.692417 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:48:47.692417 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:48:47.692417 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 1dcca3b014be4e98b7db17bb37d073a0 Sep 23 04:48:47.692417 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ListImageFiltersTestJSON-1685085465 Sep 23 04:48:47.692417 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:48:47.692417 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:48:47.692417 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1dcca3b014be4e98b7db17bb37d073a0", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1dcca3b014be4e98b7db17bb37d073a0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1dcca3b014be4e98b7db17bb37d073a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1dcca3b014be4e98b7db17bb37d073a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:48:47.692417 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ListImageFiltersTestJSON-1685085465 Sep 23 04:48:47.692417 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 1dcca3b014be4e98b7db17bb37d073a0 Sep 23 04:48:47.692417 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1685085465 Sep 23 04:48:47.692417 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ListImageFiltersTestJSON-1685085465-project Sep 23 04:48:47.692417 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:48:47.692417 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:48:47.692417 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: ff662b5d5b9e488d906565b490c8acf6 Sep 23 04:48:47.692417 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ListImageFiltersTestJSON-1685085465-project Sep 23 04:48:47.692417 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:48:47.692417 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance a0eac077-d4bd-4e4a-a04a-3f86aeeed9bd could not be found. Sep 23 04:48:47.692417 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': 'a0eac077-d4bd-4e4a-a04a-3f86aeeed9bd'} Sep 23 04:48:47.692417 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:48:47.692417 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:48:47.692417 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:48:47.692417 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:48:47.692417 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:48:47.692417 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:48:47.692417 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:48:47.692417 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:48:47.692417 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:48:47.692417 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:48:47.692417 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0eac077-d4bd-4e4a-a04a-3f86aeeed9bd could not be found. Sep 23 04:48:47.692417 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:48:47.692417 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:48:47.692417 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:48:47.692417 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:48:47.692417 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:48:47.692417 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:48:47.692417 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:48:47.692417 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:48:47.692417 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:48:47.692417 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:48:47.692417 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:48:47.692417 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:48:47.692417 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:48:47.692417 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:48:47.692417 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:48:47.692417 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:48:47.692417 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0eac077-d4bd-4e4a-a04a-3f86aeeed9bd could not be found. Sep 23 04:48:47.692417 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:48:47.692417 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:48:47.692417 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:48:47.696281 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:48:47.696281 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:48:47.696281 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:48:47.696281 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:48:47.696281 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:48:47.696281 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0eac077-d4bd-4e4a-a04a-3f86aeeed9bd could not be found. Sep 23 04:48:47.696281 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:48:47.700376 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ffbc61ae-38f0-40b6-921a-122eb3e979a9 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Returning 404 to user: Instance a0eac077-d4bd-4e4a-a04a-3f86aeeed9bd could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:48:47.700376 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ffbc61ae-38f0-40b6-921a-122eb3e979a9 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "GET /compute/v2.1/servers/a0eac077-d4bd-4e4a-a04a-3f86aeeed9bd" status: 404 len: 111 microversion: 2.1 time: 0.109475 Sep 23 04:48:47.706084 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1945/3979] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:48:47 2022] GET /compute/v2.1/servers/a0eac077-d4bd-4e4a-a04a-3f86aeeed9bd => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 04:48:47.715843 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5a1e040c-4d5c-47a1-9009-f501c8450eb6 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:47.716435 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5a1e040c-4d5c-47a1-9009-f501c8450eb6 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] [instance: 401339a4-8674-4ff9-b09e-ba748f46928d] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:47.735961 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5a1e040c-4d5c-47a1-9009-f501c8450eb6 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:47.736469 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5a1e040c-4d5c-47a1-9009-f501c8450eb6 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:47.736923 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5a1e040c-4d5c-47a1-9009-f501c8450eb6 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:47.737647 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5a1e040c-4d5c-47a1-9009-f501c8450eb6 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:47.750349 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5a1e040c-4d5c-47a1-9009-f501c8450eb6 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:47.750932 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5a1e040c-4d5c-47a1-9009-f501c8450eb6 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:47.816324 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5a1e040c-4d5c-47a1-9009-f501c8450eb6 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] [instance: 401339a4-8674-4ff9-b09e-ba748f46928d] Going to try to terminate instance {{(pid=122698) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:48:48.153861 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=4 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:48:48.239405 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5a1e040c-4d5c-47a1-9009-f501c8450eb6 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "DELETE /compute/v2.1/servers/401339a4-8674-4ff9-b09e-ba748f46928d" status: 204 len: 0 microversion: 2.1 time: 0.527662 Sep 23 04:48:48.240018 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1946/3980] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:48:47 2022] DELETE /compute/v2.1/servers/401339a4-8674-4ff9-b09e-ba748f46928d => generated 0 bytes in 530 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:48:48.245956 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-89f35076-b3f6-4289-9cd8-a4b956f37bad tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:48.246669 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-89f35076-b3f6-4289-9cd8-a4b956f37bad tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] [instance: 3fc8d6fc-3204-43f4-9b94-100d061769a5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:48.248668 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:48:48.253767 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-89f35076-b3f6-4289-9cd8-a4b956f37bad tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:48.254323 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-89f35076-b3f6-4289-9cd8-a4b956f37bad tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:48.254768 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-89f35076-b3f6-4289-9cd8-a4b956f37bad tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:48.255478 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-89f35076-b3f6-4289-9cd8-a4b956f37bad tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:48.255940 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-89f35076-b3f6-4289-9cd8-a4b956f37bad tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:48.256372 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-89f35076-b3f6-4289-9cd8-a4b956f37bad tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:48.299954 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-89f35076-b3f6-4289-9cd8-a4b956f37bad tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:48.300420 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-89f35076-b3f6-4289-9cd8-a4b956f37bad tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:48.300884 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-89f35076-b3f6-4289-9cd8-a4b956f37bad tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:48.301338 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-89f35076-b3f6-4289-9cd8-a4b956f37bad tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lazy-loading 'fault' on Instance uuid 3fc8d6fc-3204-43f4-9b94-100d061769a5 {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:48:48.686347 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-89f35076-b3f6-4289-9cd8-a4b956f37bad tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae134fe7522941698cad3f3fa11e747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16d72d2469433ca30ba6769e3d3f25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:48.697176 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-89f35076-b3f6-4289-9cd8-a4b956f37bad tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ae134fe7522941698cad3f3fa11e747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16d72d2469433ca30ba6769e3d3f25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:48.700173 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ee7f9d6d-affe-4e79-bbaf-8675887e3958 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "POST /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.478854 Sep 23 04:48:48.701175 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2035/3981] 10.222.0.33 () {62 vars in 1364 bytes} [Fri Sep 23 04:48:47 2022] POST /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9/os-volume_attachments => generated 188 bytes in 1481 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 04:48:48.706146 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8bbbe8f4-0cc7-43fd-ac5d-67bc33a924b6 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:48.710808 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-89f35076-b3f6-4289-9cd8-a4b956f37bad tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ae134fe7522941698cad3f3fa11e747a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e16d72d2469433ca30ba6769e3d3f25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:48.712499 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-89f35076-b3f6-4289-9cd8-a4b956f37bad tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] 10.222.0.33 "GET /compute/v2.1/servers/3fc8d6fc-3204-43f4-9b94-100d061769a5" status: 200 len: 1368 microversion: 2.57 time: 0.470762 Sep 23 04:48:48.713207 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1947/3982] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:48:48 2022] GET /compute/v2.1/servers/3fc8d6fc-3204-43f4-9b94-100d061769a5 => generated 1368 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:48:48.716413 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-8bbbe8f4-0cc7-43fd-ac5d-67bc33a924b6 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] [instance: 401339a4-8674-4ff9-b09e-ba748f46928d] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:48.719458 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0ba43b71-4fab-4178-9a25-f2815e2c2593 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:48.720448 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-0ba43b71-4fab-4178-9a25-f2815e2c2593 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] [instance: 33690ae1-5128-4bfd-b0b1-5f1bdb916fae] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:48.730228 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0ba43b71-4fab-4178-9a25-f2815e2c2593 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:48.731008 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0ba43b71-4fab-4178-9a25-f2815e2c2593 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:48.731804 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0ba43b71-4fab-4178-9a25-f2815e2c2593 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:48.733409 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0ba43b71-4fab-4178-9a25-f2815e2c2593 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:48.734132 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0ba43b71-4fab-4178-9a25-f2815e2c2593 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:48.734860 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8bbbe8f4-0cc7-43fd-ac5d-67bc33a924b6 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:48.735054 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0ba43b71-4fab-4178-9a25-f2815e2c2593 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:48.743428 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8bbbe8f4-0cc7-43fd-ac5d-67bc33a924b6 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:48.743428 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8bbbe8f4-0cc7-43fd-ac5d-67bc33a924b6 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:48.743658 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8bbbe8f4-0cc7-43fd-ac5d-67bc33a924b6 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:48.744010 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8bbbe8f4-0cc7-43fd-ac5d-67bc33a924b6 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:48.744453 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8bbbe8f4-0cc7-43fd-ac5d-67bc33a924b6 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:49.074432 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-0ba43b71-4fab-4178-9a25-f2815e2c2593 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a245dd82de1340f7a58873de1851c61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d02cb07a2a404c8d89aa13a950806d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:49.096633 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0ba43b71-4fab-4178-9a25-f2815e2c2593 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] 10.222.0.33 "GET /compute/v2.1/servers/33690ae1-5128-4bfd-b0b1-5f1bdb916fae" status: 200 len: 1325 microversion: 2.1 time: 0.381711 Sep 23 04:48:49.098893 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1948/3983] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:48:48 2022] GET /compute/v2.1/servers/33690ae1-5128-4bfd-b0b1-5f1bdb916fae => generated 1325 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:48:49.109018 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-8bbbe8f4-0cc7-43fd-ac5d-67bc33a924b6 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff662b5d5b9e488d906565b490c8acf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dcca3b014be4e98b7db17bb37d073a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:49.125591 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-8bbbe8f4-0cc7-43fd-ac5d-67bc33a924b6 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "GET /compute/v2.1/servers/401339a4-8674-4ff9-b09e-ba748f46928d" status: 200 len: 1473 microversion: 2.1 time: 0.423173 Sep 23 04:48:49.137649 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-19f8dc51-3139-4d33-93d0-ee22fd54eb79 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "755739a7-3c13-4a92-a5c0-91b8d4181c66"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:48:49.138250 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2036/3984] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:48:48 2022] GET /compute/v2.1/servers/401339a4-8674-4ff9-b09e-ba748f46928d => generated 1473 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:48:49.143352 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f82b5c12-33a8-4fb4-a84f-85355466bf33 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:48:49.151389 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f82b5c12-33a8-4fb4-a84f-85355466bf33 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: fe7dee09-8351-4d41-8c44-8d35a966cce9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:49.154867 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-19f8dc51-3139-4d33-93d0-ee22fd54eb79 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: c4464422-9bf1-4aaa-806c-d7063e284579] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:49.164887 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f82b5c12-33a8-4fb4-a84f-85355466bf33 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:49.166742 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f82b5c12-33a8-4fb4-a84f-85355466bf33 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:49.167304 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f82b5c12-33a8-4fb4-a84f-85355466bf33 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:49.168634 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f82b5c12-33a8-4fb4-a84f-85355466bf33 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:49.169227 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f82b5c12-33a8-4fb4-a84f-85355466bf33 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:49.170388 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f82b5c12-33a8-4fb4-a84f-85355466bf33 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:49.171232 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-19f8dc51-3139-4d33-93d0-ee22fd54eb79 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:49.171803 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-19f8dc51-3139-4d33-93d0-ee22fd54eb79 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:49.172256 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-19f8dc51-3139-4d33-93d0-ee22fd54eb79 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:49.173115 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-19f8dc51-3139-4d33-93d0-ee22fd54eb79 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:49.173596 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-19f8dc51-3139-4d33-93d0-ee22fd54eb79 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:49.174230 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-19f8dc51-3139-4d33-93d0-ee22fd54eb79 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:49.205421 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:48:49.237856 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f82b5c12-33a8-4fb4-a84f-85355466bf33 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: fe7dee09-8351-4d41-8c44-8d35a966cce9] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122699) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 23 04:48:49.551751 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:48:49.594297 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f82b5c12-33a8-4fb4-a84f-85355466bf33 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "POST /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9/action" status: 202 len: 0 microversion: 2.20 time: 0.454415 Sep 23 04:48:49.595174 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2037/3985] 10.222.0.33 () {62 vars in 1319 bytes} [Fri Sep 23 04:48:49 2022] POST /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9/action => generated 0 bytes in 456 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:48:49.611343 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5f344a23-0280-4744-b8eb-f25f8741860b tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:49.612866 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-5f344a23-0280-4744-b8eb-f25f8741860b tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: fe7dee09-8351-4d41-8c44-8d35a966cce9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:49.621172 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5f344a23-0280-4744-b8eb-f25f8741860b tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:49.622281 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5f344a23-0280-4744-b8eb-f25f8741860b tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:49.622974 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5f344a23-0280-4744-b8eb-f25f8741860b tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:49.624168 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5f344a23-0280-4744-b8eb-f25f8741860b tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:49.625047 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5f344a23-0280-4744-b8eb-f25f8741860b tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:49.625732 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5f344a23-0280-4744-b8eb-f25f8741860b tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:49.843148 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-5f344a23-0280-4744-b8eb-f25f8741860b tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:49.857362 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-5f344a23-0280-4744-b8eb-f25f8741860b tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:49.859525 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-5f344a23-0280-4744-b8eb-f25f8741860b tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:49.860788 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5f344a23-0280-4744-b8eb-f25f8741860b tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9" status: 200 len: 1751 microversion: 2.20 time: 0.257615 Sep 23 04:48:49.864989 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2038/3986] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:48:49 2022] GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9 => generated 1751 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:48:49.875216 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-74d74dfe-9c30-4969-b77c-f26be84bc07e tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:49.875846 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-74d74dfe-9c30-4969-b77c-f26be84bc07e tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] [instance: 3fc8d6fc-3204-43f4-9b94-100d061769a5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:49.890284 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-74d74dfe-9c30-4969-b77c-f26be84bc07e tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:49.890799 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-74d74dfe-9c30-4969-b77c-f26be84bc07e tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:49.895286 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-74d74dfe-9c30-4969-b77c-f26be84bc07e tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:49.895286 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-74d74dfe-9c30-4969-b77c-f26be84bc07e tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:49.895286 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-74d74dfe-9c30-4969-b77c-f26be84bc07e tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:49.895286 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-74d74dfe-9c30-4969-b77c-f26be84bc07e tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:49.925738 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-74d74dfe-9c30-4969-b77c-f26be84bc07e tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] HTTP exception thrown: Instance 3fc8d6fc-3204-43f4-9b94-100d061769a5 could not be found. Sep 23 04:48:49.930800 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-74d74dfe-9c30-4969-b77c-f26be84bc07e tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Request method failure captured: Sep 23 04:48:49.930800 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/3fc8d6fc-3204-43f4-9b94-100d061769a5 HTTP/1.1 Sep 23 04:48:49.930800 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:48:49.930800 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:48:49.930800 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:48:49.930800 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:48:49.930800 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:48:49.930800 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:48:49.930800 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:48:49.930800 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:48:49.930800 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTp9EjkT2XmO-24xQNX_22HFMnA3tvPdPEwWRSEhxlUK8ZjCN-z9vQfk-hB0oHjO4QfQPsWW-GpoWHRbTvtbixe7q1jEEHmLtnOEuE90030NVxXxotVS-qnOI3oR1GIRlaIfk5LPLqnXpv6ocioCkZGRUVAjvWhqLLpvaFTKQOYiuyo Sep 23 04:48:49.930800 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:48:49.930800 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:48:49.930800 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:48:49.930800 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:48:49.930800 n-d-846463-3 devstack@n-api.service[122699]: X-Openstack-Nova-Api-Version: 2.57 Sep 23 04:48:49.930800 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:48:49.930800 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:48:49.930800 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 1e16d72d2469433ca30ba6769e3d3f25 Sep 23 04:48:49.930800 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ServerShowV257Test-1524921958 Sep 23 04:48:49.930800 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:48:49.930800 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:48:49.930800 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1e16d72d2469433ca30ba6769e3d3f25", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1e16d72d2469433ca30ba6769e3d3f25"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1e16d72d2469433ca30ba6769e3d3f25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1e16d72d2469433ca30ba6769e3d3f25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:48:49.930800 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ServerShowV257Test-1524921958 Sep 23 04:48:49.930800 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 1e16d72d2469433ca30ba6769e3d3f25 Sep 23 04:48:49.930800 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ServerShowV257Test-1524921958 Sep 23 04:48:49.930800 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ServerShowV257Test-1524921958-project Sep 23 04:48:49.930800 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:48:49.930800 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:48:49.930800 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: ae134fe7522941698cad3f3fa11e747a Sep 23 04:48:49.930800 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ServerShowV257Test-1524921958-project Sep 23 04:48:49.930800 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:48:49.930800 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 3fc8d6fc-3204-43f4-9b94-100d061769a5 could not be found. Sep 23 04:48:49.930800 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '3fc8d6fc-3204-43f4-9b94-100d061769a5'} Sep 23 04:48:49.930800 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:48:49.930800 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:48:49.930800 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:48:49.930800 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:48:49.930800 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:48:49.930800 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:48:49.930800 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:48:49.930800 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:48:49.930800 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:48:49.930800 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:48:49.930800 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fc8d6fc-3204-43f4-9b94-100d061769a5 could not be found. Sep 23 04:48:49.930800 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:48:49.930800 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:48:49.930800 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:48:49.930800 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:48:49.930800 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:48:49.930800 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:48:49.930800 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:48:49.930800 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:48:49.930800 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:48:49.930800 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:48:49.930800 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:48:49.930800 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:48:49.930800 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:48:49.930800 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:48:49.930800 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:48:49.930800 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:48:49.930800 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fc8d6fc-3204-43f4-9b94-100d061769a5 could not be found. Sep 23 04:48:49.930800 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:48:49.930800 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:48:49.930800 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:48:49.936023 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:48:49.936023 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:48:49.936023 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:48:49.936023 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:48:49.936023 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:48:49.936023 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fc8d6fc-3204-43f4-9b94-100d061769a5 could not be found. Sep 23 04:48:49.936023 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:48:49.936023 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-74d74dfe-9c30-4969-b77c-f26be84bc07e tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] Returning 404 to user: Instance 3fc8d6fc-3204-43f4-9b94-100d061769a5 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:48:49.936023 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-74d74dfe-9c30-4969-b77c-f26be84bc07e tempest-ServerShowV257Test-1524921958 tempest-ServerShowV257Test-1524921958-project] 10.222.0.33 "GET /compute/v2.1/servers/3fc8d6fc-3204-43f4-9b94-100d061769a5" status: 404 len: 111 microversion: 2.57 time: 0.068389 Sep 23 04:48:49.936023 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2039/3987] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:48:49 2022] GET /compute/v2.1/servers/3fc8d6fc-3204-43f4-9b94-100d061769a5 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 23 04:48:50.121300 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2db37b45-ede4-4a83-a6a4-552eb0b44f3d tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:50.121300 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-2db37b45-ede4-4a83-a6a4-552eb0b44f3d tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] [instance: 33690ae1-5128-4bfd-b0b1-5f1bdb916fae] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:50.130382 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2db37b45-ede4-4a83-a6a4-552eb0b44f3d tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:50.130899 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2db37b45-ede4-4a83-a6a4-552eb0b44f3d tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:50.134247 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2db37b45-ede4-4a83-a6a4-552eb0b44f3d tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:50.135298 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2db37b45-ede4-4a83-a6a4-552eb0b44f3d tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:50.136612 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2db37b45-ede4-4a83-a6a4-552eb0b44f3d tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:50.137073 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2db37b45-ede4-4a83-a6a4-552eb0b44f3d tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:50.252271 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=8 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:48:50.653568 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2db37b45-ede4-4a83-a6a4-552eb0b44f3d tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a245dd82de1340f7a58873de1851c61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d02cb07a2a404c8d89aa13a950806d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:50.666283 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2db37b45-ede4-4a83-a6a4-552eb0b44f3d tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] 10.222.0.33 "GET /compute/v2.1/servers/33690ae1-5128-4bfd-b0b1-5f1bdb916fae" status: 200 len: 1325 microversion: 2.1 time: 0.547133 Sep 23 04:48:50.667646 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2040/3988] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:48:50 2022] GET /compute/v2.1/servers/33690ae1-5128-4bfd-b0b1-5f1bdb916fae => generated 1325 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:48:50.677289 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-275976b5-c2c5-4afd-8503-64bdfb663db4 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:50.678440 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-275976b5-c2c5-4afd-8503-64bdfb663db4 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] [instance: 401339a4-8674-4ff9-b09e-ba748f46928d] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:50.689811 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-275976b5-c2c5-4afd-8503-64bdfb663db4 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:50.690357 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-275976b5-c2c5-4afd-8503-64bdfb663db4 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:50.690886 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-275976b5-c2c5-4afd-8503-64bdfb663db4 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:50.691535 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-275976b5-c2c5-4afd-8503-64bdfb663db4 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:50.692002 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-275976b5-c2c5-4afd-8503-64bdfb663db4 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:50.694171 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-275976b5-c2c5-4afd-8503-64bdfb663db4 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:50.956885 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-19f8dc51-3139-4d33-93d0-ee22fd54eb79 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "POST /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.857442 Sep 23 04:48:50.958612 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1949/3989] 10.222.0.33 () {60 vars in 1323 bytes} [Fri Sep 23 04:48:49 2022] POST /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579/os-volume_attachments => generated 194 bytes in 1860 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:48:50.989562 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4e130060-7805-4c76-96f6-46012f6e43d9 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:50.993829 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4e130060-7805-4c76-96f6-46012f6e43d9 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: fe7dee09-8351-4d41-8c44-8d35a966cce9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:50.996012 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-275976b5-c2c5-4afd-8503-64bdfb663db4 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff662b5d5b9e488d906565b490c8acf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dcca3b014be4e98b7db17bb37d073a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:51.010406 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4e130060-7805-4c76-96f6-46012f6e43d9 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:51.010406 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4e130060-7805-4c76-96f6-46012f6e43d9 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:51.014091 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-275976b5-c2c5-4afd-8503-64bdfb663db4 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "GET /compute/v2.1/servers/401339a4-8674-4ff9-b09e-ba748f46928d" status: 200 len: 1473 microversion: 2.1 time: 0.343812 Sep 23 04:48:51.017277 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2041/3990] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:48:50 2022] GET /compute/v2.1/servers/401339a4-8674-4ff9-b09e-ba748f46928d => generated 1473 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:48:51.042844 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4e130060-7805-4c76-96f6-46012f6e43d9 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:51.048920 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4e130060-7805-4c76-96f6-46012f6e43d9 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:51.049765 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4e130060-7805-4c76-96f6-46012f6e43d9 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:51.052348 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4e130060-7805-4c76-96f6-46012f6e43d9 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:51.689945 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-39b3f007-4011-457f-a95f-298a73668560 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:51.690632 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-39b3f007-4011-457f-a95f-298a73668560 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] [instance: 33690ae1-5128-4bfd-b0b1-5f1bdb916fae] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:51.712242 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-39b3f007-4011-457f-a95f-298a73668560 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:51.712779 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-39b3f007-4011-457f-a95f-298a73668560 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:51.713259 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-39b3f007-4011-457f-a95f-298a73668560 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:51.714019 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-39b3f007-4011-457f-a95f-298a73668560 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:51.718798 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-39b3f007-4011-457f-a95f-298a73668560 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:51.719345 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-39b3f007-4011-457f-a95f-298a73668560 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:51.945451 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4e130060-7805-4c76-96f6-46012f6e43d9 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:51.976184 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4e130060-7805-4c76-96f6-46012f6e43d9 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:51.982960 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4e130060-7805-4c76-96f6-46012f6e43d9 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:51.986979 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4e130060-7805-4c76-96f6-46012f6e43d9 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9" status: 200 len: 1751 microversion: 2.20 time: 1.027078 Sep 23 04:48:51.990236 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1950/3991] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:48:50 2022] GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9 => generated 1751 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:48:52.046013 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7b7921a8-1f3b-461d-b489-380034522860 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:52.046652 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7b7921a8-1f3b-461d-b489-380034522860 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] [instance: 401339a4-8674-4ff9-b09e-ba748f46928d] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:52.077645 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7b7921a8-1f3b-461d-b489-380034522860 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:52.085813 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7b7921a8-1f3b-461d-b489-380034522860 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:52.092366 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7b7921a8-1f3b-461d-b489-380034522860 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:52.094955 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7b7921a8-1f3b-461d-b489-380034522860 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:52.096536 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7b7921a8-1f3b-461d-b489-380034522860 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:52.102929 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7b7921a8-1f3b-461d-b489-380034522860 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:52.162290 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-39b3f007-4011-457f-a95f-298a73668560 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a245dd82de1340f7a58873de1851c61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d02cb07a2a404c8d89aa13a950806d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:52.171843 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-39b3f007-4011-457f-a95f-298a73668560 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] 10.222.0.33 "GET /compute/v2.1/servers/33690ae1-5128-4bfd-b0b1-5f1bdb916fae" status: 200 len: 1325 microversion: 2.1 time: 0.486493 Sep 23 04:48:52.176559 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2042/3992] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:48:51 2022] GET /compute/v2.1/servers/33690ae1-5128-4bfd-b0b1-5f1bdb916fae => generated 1325 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:48:52.469465 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-7b7921a8-1f3b-461d-b489-380034522860 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff662b5d5b9e488d906565b490c8acf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dcca3b014be4e98b7db17bb37d073a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:52.498443 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7b7921a8-1f3b-461d-b489-380034522860 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "GET /compute/v2.1/servers/401339a4-8674-4ff9-b09e-ba748f46928d" status: 200 len: 1431 microversion: 2.1 time: 0.458040 Sep 23 04:48:52.500323 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1951/3993] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:48:52 2022] GET /compute/v2.1/servers/401339a4-8674-4ff9-b09e-ba748f46928d => generated 1431 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:48:52.985143 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-95d8f998-16ea-45d4-9acf-e93c7b2f5fa9 req-3db927a3-f650-4c32-90d8-e637e2c290ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "401339a4-8674-4ff9-b09e-ba748f46928d", "name": "network-vif-deleted", "tag": "ee716fd2-ccf3-4c05-b155-29bb9a5565c2"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:48:53.014876 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3192805e-a20f-435d-90f2-bcb29d0a7cd4 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:53.016184 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3192805e-a20f-435d-90f2-bcb29d0a7cd4 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: fe7dee09-8351-4d41-8c44-8d35a966cce9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:53.026009 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-95d8f998-16ea-45d4-9acf-e93c7b2f5fa9 req-3db927a3-f650-4c32-90d8-e637e2c290ef service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:53.026868 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-95d8f998-16ea-45d4-9acf-e93c7b2f5fa9 req-3db927a3-f650-4c32-90d8-e637e2c290ef service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:53.027478 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-95d8f998-16ea-45d4-9acf-e93c7b2f5fa9 req-3db927a3-f650-4c32-90d8-e637e2c290ef service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:53.030560 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3192805e-a20f-435d-90f2-bcb29d0a7cd4 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:53.056273 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3192805e-a20f-435d-90f2-bcb29d0a7cd4 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:53.056273 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3192805e-a20f-435d-90f2-bcb29d0a7cd4 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:53.056273 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3192805e-a20f-435d-90f2-bcb29d0a7cd4 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:53.056273 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3192805e-a20f-435d-90f2-bcb29d0a7cd4 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:53.056273 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3192805e-a20f-435d-90f2-bcb29d0a7cd4 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:53.056991 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-95d8f998-16ea-45d4-9acf-e93c7b2f5fa9 req-3db927a3-f650-4c32-90d8-e637e2c290ef service nova] Creating event network-vif-deleted:ee716fd2-ccf3-4c05-b155-29bb9a5565c2 for instance 401339a4-8674-4ff9-b09e-ba748f46928d on n-h1-846463-3 Sep 23 04:48:53.089132 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-95d8f998-16ea-45d4-9acf-e93c7b2f5fa9 req-3db927a3-f650-4c32-90d8-e637e2c290ef service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124518 Sep 23 04:48:53.098367 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2043/3994] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:48:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:48:53.203706 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a7d74d87-cc46-4456-bda8-07ea98708cc0 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:53.205106 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a7d74d87-cc46-4456-bda8-07ea98708cc0 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] [instance: 33690ae1-5128-4bfd-b0b1-5f1bdb916fae] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:53.229847 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a7d74d87-cc46-4456-bda8-07ea98708cc0 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:53.231546 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a7d74d87-cc46-4456-bda8-07ea98708cc0 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:53.234854 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a7d74d87-cc46-4456-bda8-07ea98708cc0 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:53.237249 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a7d74d87-cc46-4456-bda8-07ea98708cc0 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:53.238821 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a7d74d87-cc46-4456-bda8-07ea98708cc0 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:53.239917 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a7d74d87-cc46-4456-bda8-07ea98708cc0 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:53.949708 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a7d74d87-cc46-4456-bda8-07ea98708cc0 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a245dd82de1340f7a58873de1851c61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d02cb07a2a404c8d89aa13a950806d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:53.975393 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a7d74d87-cc46-4456-bda8-07ea98708cc0 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] 10.222.0.33 "GET /compute/v2.1/servers/33690ae1-5128-4bfd-b0b1-5f1bdb916fae" status: 200 len: 1325 microversion: 2.1 time: 0.777982 Sep 23 04:48:53.988645 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2044/3995] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:48:53 2022] GET /compute/v2.1/servers/33690ae1-5128-4bfd-b0b1-5f1bdb916fae => generated 1325 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:48:54.009668 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a9a51a4e-262f-4d8a-92d1-47fd88700a71 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:54.018468 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-3192805e-a20f-435d-90f2-bcb29d0a7cd4 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:54.022832 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a9a51a4e-262f-4d8a-92d1-47fd88700a71 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] [instance: 401339a4-8674-4ff9-b09e-ba748f46928d] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:54.030678 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-3192805e-a20f-435d-90f2-bcb29d0a7cd4 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:54.035876 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-3192805e-a20f-435d-90f2-bcb29d0a7cd4 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:54.037969 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3192805e-a20f-435d-90f2-bcb29d0a7cd4 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9" status: 200 len: 1751 microversion: 2.20 time: 1.027719 Sep 23 04:48:54.040790 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1952/3996] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:48:53 2022] GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9 => generated 1751 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:48:54.074292 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a9a51a4e-262f-4d8a-92d1-47fd88700a71 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:54.076947 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a9a51a4e-262f-4d8a-92d1-47fd88700a71 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:54.077598 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a9a51a4e-262f-4d8a-92d1-47fd88700a71 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:54.080948 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a9a51a4e-262f-4d8a-92d1-47fd88700a71 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:54.081729 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a9a51a4e-262f-4d8a-92d1-47fd88700a71 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:54.083593 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a9a51a4e-262f-4d8a-92d1-47fd88700a71 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:54.164042 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a9a51a4e-262f-4d8a-92d1-47fd88700a71 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:54.168089 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a9a51a4e-262f-4d8a-92d1-47fd88700a71 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:54.169026 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a9a51a4e-262f-4d8a-92d1-47fd88700a71 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:54.169641 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-a9a51a4e-262f-4d8a-92d1-47fd88700a71 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lazy-loading 'fault' on Instance uuid 401339a4-8674-4ff9-b09e-ba748f46928d {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:48:54.348881 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a9a51a4e-262f-4d8a-92d1-47fd88700a71 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff662b5d5b9e488d906565b490c8acf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dcca3b014be4e98b7db17bb37d073a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:54.381718 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a9a51a4e-262f-4d8a-92d1-47fd88700a71 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "GET /compute/v2.1/servers/401339a4-8674-4ff9-b09e-ba748f46928d" status: 200 len: 1307 microversion: 2.1 time: 0.389756 Sep 23 04:48:54.383691 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2045/3997] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:48:53 2022] GET /compute/v2.1/servers/401339a4-8674-4ff9-b09e-ba748f46928d => generated 1307 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:48:55.009700 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-bf8bfba7-5f0b-4b78-9da0-fe3fc9273c2a tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:55.014766 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-bf8bfba7-5f0b-4b78-9da0-fe3fc9273c2a tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] [instance: 33690ae1-5128-4bfd-b0b1-5f1bdb916fae] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:55.033918 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bf8bfba7-5f0b-4b78-9da0-fe3fc9273c2a tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:55.034539 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bf8bfba7-5f0b-4b78-9da0-fe3fc9273c2a tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:55.034898 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bf8bfba7-5f0b-4b78-9da0-fe3fc9273c2a tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:55.035636 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bf8bfba7-5f0b-4b78-9da0-fe3fc9273c2a tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:55.036106 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bf8bfba7-5f0b-4b78-9da0-fe3fc9273c2a tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:55.036545 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bf8bfba7-5f0b-4b78-9da0-fe3fc9273c2a tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:55.069235 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-fc28cc52-ee2a-4d9e-a510-284128269a93 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:55.072641 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-fc28cc52-ee2a-4d9e-a510-284128269a93 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: fe7dee09-8351-4d41-8c44-8d35a966cce9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:55.107161 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fc28cc52-ee2a-4d9e-a510-284128269a93 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:55.107667 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fc28cc52-ee2a-4d9e-a510-284128269a93 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:55.108116 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fc28cc52-ee2a-4d9e-a510-284128269a93 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:55.108838 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fc28cc52-ee2a-4d9e-a510-284128269a93 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:55.114430 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fc28cc52-ee2a-4d9e-a510-284128269a93 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:55.114674 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fc28cc52-ee2a-4d9e-a510-284128269a93 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:55.905502 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-fc28cc52-ee2a-4d9e-a510-284128269a93 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:55.926848 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-bf8bfba7-5f0b-4b78-9da0-fe3fc9273c2a tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a245dd82de1340f7a58873de1851c61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d02cb07a2a404c8d89aa13a950806d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:55.938502 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-fc28cc52-ee2a-4d9e-a510-284128269a93 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:55.940663 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-bf8bfba7-5f0b-4b78-9da0-fe3fc9273c2a tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] 10.222.0.33 "GET /compute/v2.1/servers/33690ae1-5128-4bfd-b0b1-5f1bdb916fae" status: 200 len: 1325 microversion: 2.1 time: 0.935458 Sep 23 04:48:55.945088 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1953/3998] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:48:55 2022] GET /compute/v2.1/servers/33690ae1-5128-4bfd-b0b1-5f1bdb916fae => generated 1325 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:48:55.945765 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-fc28cc52-ee2a-4d9e-a510-284128269a93 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:55.949773 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-fc28cc52-ee2a-4d9e-a510-284128269a93 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9" status: 200 len: 1753 microversion: 2.20 time: 0.884647 Sep 23 04:48:55.954707 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2046/3999] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:48:55 2022] GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9 => generated 1753 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:48:55.956454 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b4484673-725a-4030-a2d5-8a960d4de184 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:55.977399 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b4484673-725a-4030-a2d5-8a960d4de184 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] [instance: 401339a4-8674-4ff9-b09e-ba748f46928d] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:55.990801 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b4484673-725a-4030-a2d5-8a960d4de184 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:55.991656 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b4484673-725a-4030-a2d5-8a960d4de184 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:55.992371 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b4484673-725a-4030-a2d5-8a960d4de184 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:55.993309 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b4484673-725a-4030-a2d5-8a960d4de184 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:55.994013 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b4484673-725a-4030-a2d5-8a960d4de184 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:55.994753 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b4484673-725a-4030-a2d5-8a960d4de184 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:56.011215 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-b4484673-725a-4030-a2d5-8a960d4de184 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] HTTP exception thrown: Instance 401339a4-8674-4ff9-b09e-ba748f46928d could not be found. Sep 23 04:48:56.013378 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b4484673-725a-4030-a2d5-8a960d4de184 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Request method failure captured: Sep 23 04:48:56.013378 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/401339a4-8674-4ff9-b09e-ba748f46928d HTTP/1.1 Sep 23 04:48:56.013378 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:48:56.013378 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:48:56.013378 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:48:56.013378 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:48:56.013378 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:48:56.013378 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:48:56.013378 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:48:56.013378 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:48:56.013378 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLToXyXyEWneqKj6VYzspWUSeMdBqBE7U7JNs9hFRayXJjDbqPjRZkW_A1CwKrzNJE5blGGf86tQUTHr_Kcf8neU2x3hkd3Bm8fYGDYX0hKdmBOCxiC93Y25lZgw0F3fVlaKiw7iJn47HCToAj_SlZop2r-o8P_tLrYx4irv4mtlLkjA Sep 23 04:48:56.013378 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:48:56.013378 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:48:56.013378 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:48:56.013378 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:48:56.013378 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:48:56.013378 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:48:56.013378 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 1dcca3b014be4e98b7db17bb37d073a0 Sep 23 04:48:56.013378 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ListImageFiltersTestJSON-1685085465 Sep 23 04:48:56.013378 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:48:56.013378 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:48:56.013378 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1dcca3b014be4e98b7db17bb37d073a0", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1dcca3b014be4e98b7db17bb37d073a0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1dcca3b014be4e98b7db17bb37d073a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1dcca3b014be4e98b7db17bb37d073a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:48:56.013378 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ListImageFiltersTestJSON-1685085465 Sep 23 04:48:56.013378 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 1dcca3b014be4e98b7db17bb37d073a0 Sep 23 04:48:56.013378 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1685085465 Sep 23 04:48:56.013378 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ListImageFiltersTestJSON-1685085465-project Sep 23 04:48:56.013378 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:48:56.013378 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:48:56.013378 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: ff662b5d5b9e488d906565b490c8acf6 Sep 23 04:48:56.013378 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ListImageFiltersTestJSON-1685085465-project Sep 23 04:48:56.013378 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:48:56.013378 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 401339a4-8674-4ff9-b09e-ba748f46928d could not be found. Sep 23 04:48:56.013378 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '401339a4-8674-4ff9-b09e-ba748f46928d'} Sep 23 04:48:56.013378 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:48:56.013378 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:48:56.013378 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:48:56.013378 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:48:56.013378 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:48:56.013378 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:48:56.013378 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:48:56.013378 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:48:56.013378 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:48:56.013378 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:48:56.013378 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 401339a4-8674-4ff9-b09e-ba748f46928d could not be found. Sep 23 04:48:56.013378 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:48:56.013378 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:48:56.013378 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:48:56.013378 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:48:56.013378 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:48:56.013378 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:48:56.013378 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:48:56.013378 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:48:56.013378 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:48:56.013378 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:48:56.013378 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:48:56.013378 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:48:56.013378 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:48:56.013378 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:48:56.013378 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:48:56.013378 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:48:56.013378 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 401339a4-8674-4ff9-b09e-ba748f46928d could not be found. Sep 23 04:48:56.013378 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:48:56.013378 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:48:56.013378 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:48:56.023605 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:48:56.023605 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:48:56.023605 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:48:56.023605 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:48:56.023605 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:48:56.023605 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 401339a4-8674-4ff9-b09e-ba748f46928d could not be found. Sep 23 04:48:56.023605 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:48:56.023605 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b4484673-725a-4030-a2d5-8a960d4de184 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Returning 404 to user: Instance 401339a4-8674-4ff9-b09e-ba748f46928d could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:48:56.023605 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b4484673-725a-4030-a2d5-8a960d4de184 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "GET /compute/v2.1/servers/401339a4-8674-4ff9-b09e-ba748f46928d" status: 404 len: 111 microversion: 2.1 time: 0.069248 Sep 23 04:48:56.023605 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1954/4000] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:48:55 2022] GET /compute/v2.1/servers/401339a4-8674-4ff9-b09e-ba748f46928d => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:48:56.029343 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1b1349ac-dfcf-4a4e-a8ab-9919cb65ecb5 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '.version_select at 0x7ff1ba943dc0>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:56.763743 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-ba76ecbb-bee8-4d6b-b52a-5b65fd5b9ae4 req-a43ec4ae-9d3c-456f-9b2e-1d2976dbe547 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33690ae1-5128-4bfd-b0b1-5f1bdb916fae", "name": "network-vif-plugged", "status": "completed", "tag": "591e0b9b-7a3c-4d9b-ba24-6b6408f5613a"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:48:56.797259 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-ba76ecbb-bee8-4d6b-b52a-5b65fd5b9ae4 req-a43ec4ae-9d3c-456f-9b2e-1d2976dbe547 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:56.797799 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-ba76ecbb-bee8-4d6b-b52a-5b65fd5b9ae4 req-a43ec4ae-9d3c-456f-9b2e-1d2976dbe547 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:56.798345 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-ba76ecbb-bee8-4d6b-b52a-5b65fd5b9ae4 req-a43ec4ae-9d3c-456f-9b2e-1d2976dbe547 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:56.832018 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-ba76ecbb-bee8-4d6b-b52a-5b65fd5b9ae4 req-a43ec4ae-9d3c-456f-9b2e-1d2976dbe547 service nova] Creating event network-vif-plugged:591e0b9b-7a3c-4d9b-ba24-6b6408f5613a for instance 33690ae1-5128-4bfd-b0b1-5f1bdb916fae on n-h2-846463-3 Sep 23 04:48:56.848811 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-ba76ecbb-bee8-4d6b-b52a-5b65fd5b9ae4 req-a43ec4ae-9d3c-456f-9b2e-1d2976dbe547 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089851 Sep 23 04:48:56.851926 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1955/4001] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:48:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:48:56.966436 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-bd908d95-52a4-44a8-8a35-d1c6c43df698 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:56.967242 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-bd908d95-52a4-44a8-8a35-d1c6c43df698 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] [instance: 33690ae1-5128-4bfd-b0b1-5f1bdb916fae] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:56.992890 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bd908d95-52a4-44a8-8a35-d1c6c43df698 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:56.995505 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bd908d95-52a4-44a8-8a35-d1c6c43df698 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:56.997159 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bd908d95-52a4-44a8-8a35-d1c6c43df698 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:56.999088 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bd908d95-52a4-44a8-8a35-d1c6c43df698 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:57.005159 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bd908d95-52a4-44a8-8a35-d1c6c43df698 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:57.013122 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bd908d95-52a4-44a8-8a35-d1c6c43df698 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:57.288568 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1b1349ac-dfcf-4a4e-a8ab-9919cb65ecb5 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "DELETE /compute/v2.1/images/c4d1d314-0b71-4f7c-ab75-94739b713e7f" status: 204 len: 0 microversion: 2.1 time: 1.266727 Sep 23 04:48:57.289102 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2047/4002] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:48:56 2022] DELETE /compute/v2.1/images/c4d1d314-0b71-4f7c-ab75-94739b713e7f => generated 0 bytes in 1269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:48:57.295137 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d4334fe5-f520-4d11-a734-baf8b8037bc8 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:57.295745 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d4334fe5-f520-4d11-a734-baf8b8037bc8 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: fe7dee09-8351-4d41-8c44-8d35a966cce9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:57.314495 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d4334fe5-f520-4d11-a734-baf8b8037bc8 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:57.315088 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d4334fe5-f520-4d11-a734-baf8b8037bc8 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:57.321377 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d4334fe5-f520-4d11-a734-baf8b8037bc8 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:57.323092 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d4334fe5-f520-4d11-a734-baf8b8037bc8 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:57.327434 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d4334fe5-f520-4d11-a734-baf8b8037bc8 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:57.330053 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d4334fe5-f520-4d11-a734-baf8b8037bc8 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:57.433950 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-bd908d95-52a4-44a8-8a35-d1c6c43df698 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a245dd82de1340f7a58873de1851c61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d02cb07a2a404c8d89aa13a950806d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:57.443161 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-bd908d95-52a4-44a8-8a35-d1c6c43df698 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] 10.222.0.33 "GET /compute/v2.1/servers/33690ae1-5128-4bfd-b0b1-5f1bdb916fae" status: 200 len: 1325 microversion: 2.1 time: 0.482011 Sep 23 04:48:57.472784 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1956/4003] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:48:56 2022] GET /compute/v2.1/servers/33690ae1-5128-4bfd-b0b1-5f1bdb916fae => generated 1325 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:48:57.478566 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8c4f9457-b5b4-4b98-bade-26364ab40107 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '.version_select at 0x7ff1bab2b820>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:57.700066 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d4334fe5-f520-4d11-a734-baf8b8037bc8 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:57.719207 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d4334fe5-f520-4d11-a734-baf8b8037bc8 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:57.722434 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d4334fe5-f520-4d11-a734-baf8b8037bc8 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:57.727060 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d4334fe5-f520-4d11-a734-baf8b8037bc8 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9" status: 200 len: 1753 microversion: 2.20 time: 0.435840 Sep 23 04:48:57.728894 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2048/4004] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:48:57 2022] GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9 => generated 1753 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:48:58.479922 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-454f8175-5a7a-4e41-bbae-6fc98fe79013 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:58.480605 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-454f8175-5a7a-4e41-bbae-6fc98fe79013 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] [instance: 33690ae1-5128-4bfd-b0b1-5f1bdb916fae] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:58.491157 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-454f8175-5a7a-4e41-bbae-6fc98fe79013 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:58.494364 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-454f8175-5a7a-4e41-bbae-6fc98fe79013 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:58.494998 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-454f8175-5a7a-4e41-bbae-6fc98fe79013 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:58.498565 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-454f8175-5a7a-4e41-bbae-6fc98fe79013 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:58.501085 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-454f8175-5a7a-4e41-bbae-6fc98fe79013 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:58.501726 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-454f8175-5a7a-4e41-bbae-6fc98fe79013 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:58.712339 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8c4f9457-b5b4-4b98-bade-26364ab40107 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "DELETE /compute/v2.1/images/330e09be-4c50-4e09-bc04-3e646285dccd" status: 204 len: 0 microversion: 2.1 time: 1.237977 Sep 23 04:48:58.712904 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1957/4005] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:48:57 2022] DELETE /compute/v2.1/images/330e09be-4c50-4e09-bc04-3e646285dccd => generated 0 bytes in 1239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:48:58.732727 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-efe39d91-fdc2-41b4-a932-8cdb250b2962 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] Calling method '.version_select at 0x7ff1baac3700>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:58.864997 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-454f8175-5a7a-4e41-bbae-6fc98fe79013 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a245dd82de1340f7a58873de1851c61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d02cb07a2a404c8d89aa13a950806d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:58.873868 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-454f8175-5a7a-4e41-bbae-6fc98fe79013 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] 10.222.0.33 "GET /compute/v2.1/servers/33690ae1-5128-4bfd-b0b1-5f1bdb916fae" status: 200 len: 1325 microversion: 2.1 time: 0.397957 Sep 23 04:48:58.880648 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2049/4006] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:48:58 2022] GET /compute/v2.1/servers/33690ae1-5128-4bfd-b0b1-5f1bdb916fae => generated 1325 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:48:58.884953 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-86ecae85-e49b-4e62-b26e-539828d52c02 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:58.893270 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-86ecae85-e49b-4e62-b26e-539828d52c02 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: fe7dee09-8351-4d41-8c44-8d35a966cce9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:58.904707 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-86ecae85-e49b-4e62-b26e-539828d52c02 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:58.906960 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-86ecae85-e49b-4e62-b26e-539828d52c02 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:58.907618 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-86ecae85-e49b-4e62-b26e-539828d52c02 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:58.914165 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-86ecae85-e49b-4e62-b26e-539828d52c02 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:58.914843 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-86ecae85-e49b-4e62-b26e-539828d52c02 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:58.915440 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-86ecae85-e49b-4e62-b26e-539828d52c02 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:59.342679 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-86ecae85-e49b-4e62-b26e-539828d52c02 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:59.360914 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-86ecae85-e49b-4e62-b26e-539828d52c02 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:59.364777 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-86ecae85-e49b-4e62-b26e-539828d52c02 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:48:59.369039 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-86ecae85-e49b-4e62-b26e-539828d52c02 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9" status: 200 len: 1753 microversion: 2.20 time: 0.489273 Sep 23 04:48:59.369853 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2050/4007] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:48:58 2022] GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9 => generated 1753 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:48:59.903301 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-02fd3858-e25f-4489-a155-e4f7505c70f8 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:48:59.904382 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-02fd3858-e25f-4489-a155-e4f7505c70f8 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] [instance: 33690ae1-5128-4bfd-b0b1-5f1bdb916fae] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:48:59.922274 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-02fd3858-e25f-4489-a155-e4f7505c70f8 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:59.925613 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-02fd3858-e25f-4489-a155-e4f7505c70f8 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:59.928110 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-02fd3858-e25f-4489-a155-e4f7505c70f8 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:48:59.930610 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-02fd3858-e25f-4489-a155-e4f7505c70f8 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:48:59.931445 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-02fd3858-e25f-4489-a155-e4f7505c70f8 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:48:59.931894 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-02fd3858-e25f-4489-a155-e4f7505c70f8 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:00.030375 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-efe39d91-fdc2-41b4-a932-8cdb250b2962 tempest-ListImageFiltersTestJSON-1685085465 tempest-ListImageFiltersTestJSON-1685085465-project] 10.222.0.33 "DELETE /compute/v2.1/images/800d5d9e-8556-47d5-a80b-3500dc514f86" status: 204 len: 0 microversion: 2.1 time: 1.312740 Sep 23 04:49:00.031860 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1958/4008] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:48:58 2022] DELETE /compute/v2.1/images/800d5d9e-8556-47d5-a80b-3500dc514f86 => generated 0 bytes in 1315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:49:00.155576 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-02fd3858-e25f-4489-a155-e4f7505c70f8 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a245dd82de1340f7a58873de1851c61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d02cb07a2a404c8d89aa13a950806d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:00.164912 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-02fd3858-e25f-4489-a155-e4f7505c70f8 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] 10.222.0.33 "GET /compute/v2.1/servers/33690ae1-5128-4bfd-b0b1-5f1bdb916fae" status: 200 len: 1521 microversion: 2.1 time: 0.267968 Sep 23 04:49:00.166184 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2051/4009] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:48:59 2022] GET /compute/v2.1/servers/33690ae1-5128-4bfd-b0b1-5f1bdb916fae => generated 1521 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:49:00.203088 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-95210b95-15a3-403a-9c4d-bfed0cac7fad tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:00.203679 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-95210b95-15a3-403a-9c4d-bfed0cac7fad tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] [instance: 33690ae1-5128-4bfd-b0b1-5f1bdb916fae] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:00.217672 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-95210b95-15a3-403a-9c4d-bfed0cac7fad tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:00.220426 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-95210b95-15a3-403a-9c4d-bfed0cac7fad tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:00.222246 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-95210b95-15a3-403a-9c4d-bfed0cac7fad tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:00.223354 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-95210b95-15a3-403a-9c4d-bfed0cac7fad tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:00.223844 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-95210b95-15a3-403a-9c4d-bfed0cac7fad tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:00.226428 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-95210b95-15a3-403a-9c4d-bfed0cac7fad tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:00.315846 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-95210b95-15a3-403a-9c4d-bfed0cac7fad tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] [instance: 33690ae1-5128-4bfd-b0b1-5f1bdb916fae] Going to try to terminate instance {{(pid=122698) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:49:00.400139 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2bb2dda3-3a04-4237-80d7-cc8d30c0b086 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:00.401145 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-2bb2dda3-3a04-4237-80d7-cc8d30c0b086 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: fe7dee09-8351-4d41-8c44-8d35a966cce9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:00.448234 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2bb2dda3-3a04-4237-80d7-cc8d30c0b086 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:00.449299 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2bb2dda3-3a04-4237-80d7-cc8d30c0b086 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:00.455280 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2bb2dda3-3a04-4237-80d7-cc8d30c0b086 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:00.455280 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2bb2dda3-3a04-4237-80d7-cc8d30c0b086 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:00.455280 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2bb2dda3-3a04-4237-80d7-cc8d30c0b086 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:00.455280 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2bb2dda3-3a04-4237-80d7-cc8d30c0b086 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:00.791972 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-95210b95-15a3-403a-9c4d-bfed0cac7fad tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] 10.222.0.33 "DELETE /compute/v2.1/servers/33690ae1-5128-4bfd-b0b1-5f1bdb916fae" status: 204 len: 0 microversion: 2.1 time: 0.596110 Sep 23 04:49:00.798508 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1959/4010] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:49:00 2022] DELETE /compute/v2.1/servers/33690ae1-5128-4bfd-b0b1-5f1bdb916fae => generated 0 bytes in 604 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:49:00.808541 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-557f44cd-d623-4210-9c1b-6c76974d19cb tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:00.809334 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-557f44cd-d623-4210-9c1b-6c76974d19cb tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] [instance: 33690ae1-5128-4bfd-b0b1-5f1bdb916fae] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:00.840527 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-557f44cd-d623-4210-9c1b-6c76974d19cb tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:00.844282 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-557f44cd-d623-4210-9c1b-6c76974d19cb tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:00.844967 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-557f44cd-d623-4210-9c1b-6c76974d19cb tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:00.846782 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-557f44cd-d623-4210-9c1b-6c76974d19cb tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:00.848107 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-557f44cd-d623-4210-9c1b-6c76974d19cb tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:00.849817 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-557f44cd-d623-4210-9c1b-6c76974d19cb tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:00.896773 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2bb2dda3-3a04-4237-80d7-cc8d30c0b086 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:00.900797 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:49:00.914556 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2bb2dda3-3a04-4237-80d7-cc8d30c0b086 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:00.918999 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2bb2dda3-3a04-4237-80d7-cc8d30c0b086 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:00.921776 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2bb2dda3-3a04-4237-80d7-cc8d30c0b086 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9" status: 200 len: 1753 microversion: 2.20 time: 0.527902 Sep 23 04:49:00.924065 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2052/4011] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:49:00 2022] GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9 => generated 1753 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:49:01.228446 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-557f44cd-d623-4210-9c1b-6c76974d19cb tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a245dd82de1340f7a58873de1851c61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d02cb07a2a404c8d89aa13a950806d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:01.255617 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-557f44cd-d623-4210-9c1b-6c76974d19cb tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] 10.222.0.33 "GET /compute/v2.1/servers/33690ae1-5128-4bfd-b0b1-5f1bdb916fae" status: 200 len: 1527 microversion: 2.1 time: 0.441730 Sep 23 04:49:01.255617 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1960/4012] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:49:00 2022] GET /compute/v2.1/servers/33690ae1-5128-4bfd-b0b1-5f1bdb916fae => generated 1527 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:49:01.955589 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c4970b2f-54ad-471b-9a33-3a6fae369774 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:01.956201 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c4970b2f-54ad-471b-9a33-3a6fae369774 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: fe7dee09-8351-4d41-8c44-8d35a966cce9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:01.971025 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c4970b2f-54ad-471b-9a33-3a6fae369774 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:01.971523 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c4970b2f-54ad-471b-9a33-3a6fae369774 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:01.978657 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c4970b2f-54ad-471b-9a33-3a6fae369774 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:01.980571 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c4970b2f-54ad-471b-9a33-3a6fae369774 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:01.982574 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c4970b2f-54ad-471b-9a33-3a6fae369774 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:01.984722 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c4970b2f-54ad-471b-9a33-3a6fae369774 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:02.269173 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ef46f139-9350-432b-a666-69d5bdccb865 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:02.269790 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-ef46f139-9350-432b-a666-69d5bdccb865 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] [instance: 33690ae1-5128-4bfd-b0b1-5f1bdb916fae] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:02.281262 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ef46f139-9350-432b-a666-69d5bdccb865 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:02.284278 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ef46f139-9350-432b-a666-69d5bdccb865 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:02.284902 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ef46f139-9350-432b-a666-69d5bdccb865 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:02.293171 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ef46f139-9350-432b-a666-69d5bdccb865 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:02.293171 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ef46f139-9350-432b-a666-69d5bdccb865 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:02.293171 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ef46f139-9350-432b-a666-69d5bdccb865 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:02.373333 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c4970b2f-54ad-471b-9a33-3a6fae369774 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:02.388400 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c4970b2f-54ad-471b-9a33-3a6fae369774 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:02.393002 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c4970b2f-54ad-471b-9a33-3a6fae369774 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:02.401792 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c4970b2f-54ad-471b-9a33-3a6fae369774 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9" status: 200 len: 1753 microversion: 2.20 time: 0.449984 Sep 23 04:49:02.405644 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2053/4013] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:49:01 2022] GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9 => generated 1753 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:49:03.049378 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ef46f139-9350-432b-a666-69d5bdccb865 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a245dd82de1340f7a58873de1851c61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d02cb07a2a404c8d89aa13a950806d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:03.060372 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ef46f139-9350-432b-a666-69d5bdccb865 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] 10.222.0.33 "GET /compute/v2.1/servers/33690ae1-5128-4bfd-b0b1-5f1bdb916fae" status: 200 len: 1527 microversion: 2.1 time: 0.795639 Sep 23 04:49:03.077825 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1961/4014] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:49:02 2022] GET /compute/v2.1/servers/33690ae1-5128-4bfd-b0b1-5f1bdb916fae => generated 1527 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:49:03.434683 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3e670f8a-3d20-4818-a23e-88dad7e0378e tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:03.436004 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-3e670f8a-3d20-4818-a23e-88dad7e0378e tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: fe7dee09-8351-4d41-8c44-8d35a966cce9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:03.457361 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3e670f8a-3d20-4818-a23e-88dad7e0378e tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:03.461597 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3e670f8a-3d20-4818-a23e-88dad7e0378e tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:03.462817 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3e670f8a-3d20-4818-a23e-88dad7e0378e tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:03.464026 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3e670f8a-3d20-4818-a23e-88dad7e0378e tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:03.466952 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3e670f8a-3d20-4818-a23e-88dad7e0378e tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:03.469754 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3e670f8a-3d20-4818-a23e-88dad7e0378e tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:03.956680 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-20f115ba-8da3-407d-b405-9704a3bb193f req-727d92f6-e53a-4230-856b-25d45086ed89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33690ae1-5128-4bfd-b0b1-5f1bdb916fae", "name": "network-vif-deleted", "tag": "591e0b9b-7a3c-4d9b-ba24-6b6408f5613a"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:49:03.990356 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-20f115ba-8da3-407d-b405-9704a3bb193f req-727d92f6-e53a-4230-856b-25d45086ed89 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:03.991092 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-20f115ba-8da3-407d-b405-9704a3bb193f req-727d92f6-e53a-4230-856b-25d45086ed89 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:03.991692 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-20f115ba-8da3-407d-b405-9704a3bb193f req-727d92f6-e53a-4230-856b-25d45086ed89 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:04.004645 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-20f115ba-8da3-407d-b405-9704a3bb193f req-727d92f6-e53a-4230-856b-25d45086ed89 service nova] Creating event network-vif-deleted:591e0b9b-7a3c-4d9b-ba24-6b6408f5613a for instance 33690ae1-5128-4bfd-b0b1-5f1bdb916fae on n-h2-846463-3 Sep 23 04:49:04.011177 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-20f115ba-8da3-407d-b405-9704a3bb193f req-727d92f6-e53a-4230-856b-25d45086ed89 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057817 Sep 23 04:49:04.028784 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1962/4015] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:49:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:49:04.090231 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-437c631c-fddf-406d-9aeb-931145b1cf7d tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:04.090944 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-437c631c-fddf-406d-9aeb-931145b1cf7d tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] [instance: 33690ae1-5128-4bfd-b0b1-5f1bdb916fae] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:04.116358 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-437c631c-fddf-406d-9aeb-931145b1cf7d tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:04.117167 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-437c631c-fddf-406d-9aeb-931145b1cf7d tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:04.118657 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-437c631c-fddf-406d-9aeb-931145b1cf7d tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:04.121365 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-437c631c-fddf-406d-9aeb-931145b1cf7d tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:04.122056 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-437c631c-fddf-406d-9aeb-931145b1cf7d tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:04.123448 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-437c631c-fddf-406d-9aeb-931145b1cf7d tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:04.311047 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-437c631c-fddf-406d-9aeb-931145b1cf7d tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a245dd82de1340f7a58873de1851c61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d02cb07a2a404c8d89aa13a950806d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:04.327574 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-437c631c-fddf-406d-9aeb-931145b1cf7d tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] 10.222.0.33 "GET /compute/v2.1/servers/33690ae1-5128-4bfd-b0b1-5f1bdb916fae" status: 200 len: 1310 microversion: 2.1 time: 0.241458 Sep 23 04:49:04.328173 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1963/4016] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:49:04 2022] GET /compute/v2.1/servers/33690ae1-5128-4bfd-b0b1-5f1bdb916fae => generated 1310 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:49:04.386136 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-3e670f8a-3d20-4818-a23e-88dad7e0378e tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:04.395379 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-3e670f8a-3d20-4818-a23e-88dad7e0378e tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:04.403747 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-3e670f8a-3d20-4818-a23e-88dad7e0378e tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:04.405223 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3e670f8a-3d20-4818-a23e-88dad7e0378e tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9" status: 200 len: 1753 microversion: 2.20 time: 0.978956 Sep 23 04:49:04.406014 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2054/4017] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:49:03 2022] GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9 => generated 1753 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:49:04.595351 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4ec4ccd2-f5aa-4561-9237-04f4b8fd2321 tempest-KeyPairsV22TestJSON-404199016 tempest-KeyPairsV22TestJSON-404199016-project] Action: 'create', calling method: .version_select at 0x7ff1ba8d61f0>, body: {"keypair": {"name": "tempest-keypair-268736837", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBCwnW9HTelfiG3Ayuu1D/fO3V9XIaftzU9JRB2+vY2OKmt1oqlujCKEidPOPOo1KaAIsGxoSXESMm7v3N9QYilR7wVn5flyHGl3O/4yOiJjxfz9vlb93MB3lXVj3AjE2g=="}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:49:04.626790 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-4ec4ccd2-f5aa-4561-9237-04f4b8fd2321 tempest-KeyPairsV22TestJSON-404199016 tempest-KeyPairsV22TestJSON-404199016-project] Getting quotas for project 496e3855267d4d1f8af0db3d26c6ed79. Resources: {'key_pairs'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:49:04.636599 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-4ec4ccd2-f5aa-4561-9237-04f4b8fd2321 tempest-KeyPairsV22TestJSON-404199016 tempest-KeyPairsV22TestJSON-404199016-project] Getting quotas for user d9d00166ac674d3aa4753d0886cc2484 and project 496e3855267d4d1f8af0db3d26c6ed79. Resources: {'key_pairs'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:49:04.746411 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4ec4ccd2-f5aa-4561-9237-04f4b8fd2321 tempest-KeyPairsV22TestJSON-404199016 tempest-KeyPairsV22TestJSON-404199016-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.407407 Sep 23 04:49:04.749879 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1964/4018] 10.222.0.33 () {62 vars in 1199 bytes} [Fri Sep 23 04:49:04 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 416 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 23 04:49:04.761278 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-fbbafc9f-6abc-4149-b2a1-ca1572118d7c tempest-KeyPairsV22TestJSON-404199016 tempest-KeyPairsV22TestJSON-404199016-project] Calling method '.version_select at 0x7ff1ba8ca9d0>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:04.777383 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-fbbafc9f-6abc-4149-b2a1-ca1572118d7c tempest-KeyPairsV22TestJSON-404199016 tempest-KeyPairsV22TestJSON-404199016-project] 10.222.0.33 "GET /compute/v2.1/os-keypairs/tempest-keypair-268736837" status: 200 len: 512 microversion: 2.2 time: 0.020705 Sep 23 04:49:04.779255 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2055/4019] 10.222.0.33 () {60 vars in 1255 bytes} [Fri Sep 23 04:49:04 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-268736837 => generated 512 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:49:04.791007 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-fc2dc5bf-72dd-40a9-87b7-b93ba7186002 tempest-KeyPairsV22TestJSON-404199016 tempest-KeyPairsV22TestJSON-404199016-project] Calling method '.version_select at 0x7ff1baa2d280>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:04.913252 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-fc2dc5bf-72dd-40a9-87b7-b93ba7186002 tempest-KeyPairsV22TestJSON-404199016 tempest-KeyPairsV22TestJSON-404199016-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-268736837" status: 204 len: 0 microversion: 2.2 time: 0.126158 Sep 23 04:49:04.919385 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1965/4020] 10.222.0.33 () {60 vars in 1258 bytes} [Fri Sep 23 04:49:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-268736837 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:49:04.927065 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-aef98111-d806-4c91-b068-03a9fc223ec8 tempest-KeyPairsV22TestJSON-404199016 tempest-KeyPairsV22TestJSON-404199016-project] Action: 'create', calling method: .version_select at 0x7ff1ba9491f0>, body: {"keypair": {"name": "tempest-keypair-1563195898", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ3qgKJTXNpfmNOUgsi0uBIXLvpVjxLhnb1fU+Ri7V6SYmOyKm/wG4FJA1o28HwchwcqyseNMTZ+MSm4xOpkaIfvLhiD+QeGSBfg8rOXtH2okusKYdKbSyxYq7Fju5fDpA=="}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:49:04.965779 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-aef98111-d806-4c91-b068-03a9fc223ec8 tempest-KeyPairsV22TestJSON-404199016 tempest-KeyPairsV22TestJSON-404199016-project] Getting quotas for project 496e3855267d4d1f8af0db3d26c6ed79. Resources: {'key_pairs'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:49:04.972684 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-aef98111-d806-4c91-b068-03a9fc223ec8 tempest-KeyPairsV22TestJSON-404199016 tempest-KeyPairsV22TestJSON-404199016-project] Getting quotas for user d9d00166ac674d3aa4753d0886cc2484 and project 496e3855267d4d1f8af0db3d26c6ed79. Resources: {'key_pairs'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:49:05.091116 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-aef98111-d806-4c91-b068-03a9fc223ec8 tempest-KeyPairsV22TestJSON-404199016 tempest-KeyPairsV22TestJSON-404199016-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.167899 Sep 23 04:49:05.092714 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2056/4021] 10.222.0.33 () {62 vars in 1199 bytes} [Fri Sep 23 04:49:04 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 170 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 23 04:49:05.112234 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-fd282d9b-a035-4fa6-a726-910c3b0f3c18 tempest-KeyPairsV22TestJSON-404199016 tempest-KeyPairsV22TestJSON-404199016-project] Calling method '.version_select at 0x7ff1ba8469d0>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:05.235876 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-fd282d9b-a035-4fa6-a726-910c3b0f3c18 tempest-KeyPairsV22TestJSON-404199016 tempest-KeyPairsV22TestJSON-404199016-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1563195898" status: 204 len: 0 microversion: 2.2 time: 0.135669 Sep 23 04:49:05.237795 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1966/4022] 10.222.0.33 () {60 vars in 1261 bytes} [Fri Sep 23 04:49:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1563195898 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:49:05.248036 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-cb3cd1ad-9179-49a5-8ab0-3499a3a57404 tempest-KeyPairsV22TestJSON-404199016 tempest-KeyPairsV22TestJSON-404199016-project] Action: 'create', calling method: .version_select at 0x7ff1ba9e34c0>, body: {"keypair": {"name": "tempest-keypair-243589190", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:49:05.293494 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-cb3cd1ad-9179-49a5-8ab0-3499a3a57404 tempest-KeyPairsV22TestJSON-404199016 tempest-KeyPairsV22TestJSON-404199016-project] Getting quotas for project 496e3855267d4d1f8af0db3d26c6ed79. Resources: {'key_pairs'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:49:05.311489 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-cb3cd1ad-9179-49a5-8ab0-3499a3a57404 tempest-KeyPairsV22TestJSON-404199016 tempest-KeyPairsV22TestJSON-404199016-project] Getting quotas for user d9d00166ac674d3aa4753d0886cc2484 and project 496e3855267d4d1f8af0db3d26c6ed79. Resources: {'key_pairs'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:49:05.360708 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4e556124-023c-4db4-8060-69b0ed8a24cd tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:05.361848 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4e556124-023c-4db4-8060-69b0ed8a24cd tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] [instance: 33690ae1-5128-4bfd-b0b1-5f1bdb916fae] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:05.380790 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4e556124-023c-4db4-8060-69b0ed8a24cd tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:05.381517 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4e556124-023c-4db4-8060-69b0ed8a24cd tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:05.384988 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4e556124-023c-4db4-8060-69b0ed8a24cd tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:05.394908 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4e556124-023c-4db4-8060-69b0ed8a24cd tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:05.395619 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4e556124-023c-4db4-8060-69b0ed8a24cd tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:05.397671 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4e556124-023c-4db4-8060-69b0ed8a24cd tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:05.450342 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-cb3cd1ad-9179-49a5-8ab0-3499a3a57404 tempest-KeyPairsV22TestJSON-404199016 tempest-KeyPairsV22TestJSON-404199016-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 588 microversion: 2.2 time: 0.206408 Sep 23 04:49:05.458300 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2057/4023] 10.222.0.33 () {62 vars in 1199 bytes} [Fri Sep 23 04:49:05 2022] POST /compute/v2.1/os-keypairs => generated 588 bytes in 208 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 23 04:49:05.458300 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ec311491-78a3-4d07-897e-8fef32e3fe08 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:05.458300 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ec311491-78a3-4d07-897e-8fef32e3fe08 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: fe7dee09-8351-4d41-8c44-8d35a966cce9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:05.484558 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ec311491-78a3-4d07-897e-8fef32e3fe08 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:05.485384 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ec311491-78a3-4d07-897e-8fef32e3fe08 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:05.489679 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ec311491-78a3-4d07-897e-8fef32e3fe08 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:05.490746 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ec311491-78a3-4d07-897e-8fef32e3fe08 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:05.495326 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ec311491-78a3-4d07-897e-8fef32e3fe08 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:05.496023 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ec311491-78a3-4d07-897e-8fef32e3fe08 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:05.503716 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4e556124-023c-4db4-8060-69b0ed8a24cd tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:05.503716 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4e556124-023c-4db4-8060-69b0ed8a24cd tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:05.503716 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4e556124-023c-4db4-8060-69b0ed8a24cd tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:05.503716 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-4e556124-023c-4db4-8060-69b0ed8a24cd tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lazy-loading 'fault' on Instance uuid 33690ae1-5128-4bfd-b0b1-5f1bdb916fae {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:49:05.876705 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4e556124-023c-4db4-8060-69b0ed8a24cd tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a245dd82de1340f7a58873de1851c61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d02cb07a2a404c8d89aa13a950806d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:05.890179 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4e556124-023c-4db4-8060-69b0ed8a24cd tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] 10.222.0.33 "GET /compute/v2.1/servers/33690ae1-5128-4bfd-b0b1-5f1bdb916fae" status: 200 len: 1315 microversion: 2.1 time: 0.538660 Sep 23 04:49:05.890779 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1967/4024] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:49:05 2022] GET /compute/v2.1/servers/33690ae1-5128-4bfd-b0b1-5f1bdb916fae => generated 1315 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:49:05.895558 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8a36b72d-02c3-40d9-93d0-3d2ff02e09d2 tempest-KeyPairsV22TestJSON-404199016 tempest-KeyPairsV22TestJSON-404199016-project] Calling method '.version_select at 0x7ff1c3ef00d0>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:06.002503 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ec311491-78a3-4d07-897e-8fef32e3fe08 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:06.014274 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ec311491-78a3-4d07-897e-8fef32e3fe08 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:06.018132 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ec311491-78a3-4d07-897e-8fef32e3fe08 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:06.027151 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8a36b72d-02c3-40d9-93d0-3d2ff02e09d2 tempest-KeyPairsV22TestJSON-404199016 tempest-KeyPairsV22TestJSON-404199016-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-243589190" status: 204 len: 0 microversion: 2.2 time: 0.135160 Sep 23 04:49:06.027974 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1968/4025] 10.222.0.33 () {60 vars in 1258 bytes} [Fri Sep 23 04:49:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-243589190 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:49:06.032976 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5cc99e6b-983c-4b40-b328-5fad011fe82e tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:06.033751 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5cc99e6b-983c-4b40-b328-5fad011fe82e tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:06.034504 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ec311491-78a3-4d07-897e-8fef32e3fe08 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9" status: 200 len: 1753 microversion: 2.20 time: 0.571156 Sep 23 04:49:06.038612 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2058/4026] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:49:05 2022] GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9 => generated 1753 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:49:06.046780 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3b1dab83-2287-4775-b82d-59e8bb0b192f tempest-KeyPairsV22TestJSON-404199016 tempest-KeyPairsV22TestJSON-404199016-project] Action: 'create', calling method: .version_select at 0x7ff1ba93b160>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1313813617", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKLVioMzRHTZsf38EktUMDlIl3zYDNi8EbslrKef0kydIu3dG65iTzsmqNQaFtq6k+XlalocfsNK00JNKNaeZfZ9qFaARNn83dxzKyzIDIF1CSId3odDWu9YxA2EcvVZ6Q=="}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:49:06.055673 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5cc99e6b-983c-4b40-b328-5fad011fe82e tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:06.070770 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5cc99e6b-983c-4b40-b328-5fad011fe82e tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:06.071634 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5cc99e6b-983c-4b40-b328-5fad011fe82e tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:06.072593 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5cc99e6b-983c-4b40-b328-5fad011fe82e tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:06.073060 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5cc99e6b-983c-4b40-b328-5fad011fe82e tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:06.073493 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5cc99e6b-983c-4b40-b328-5fad011fe82e tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:06.127129 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-3b1dab83-2287-4775-b82d-59e8bb0b192f tempest-KeyPairsV22TestJSON-404199016 tempest-KeyPairsV22TestJSON-404199016-project] Getting quotas for project 496e3855267d4d1f8af0db3d26c6ed79. Resources: {'key_pairs'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:49:06.160304 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:INSERT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:49:06.168397 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-3b1dab83-2287-4775-b82d-59e8bb0b192f tempest-KeyPairsV22TestJSON-404199016 tempest-KeyPairsV22TestJSON-404199016-project] Getting quotas for user d9d00166ac674d3aa4753d0886cc2484 and project 496e3855267d4d1f8af0db3d26c6ed79. Resources: {'key_pairs'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:49:06.334521 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3b1dab83-2287-4775-b82d-59e8bb0b192f tempest-KeyPairsV22TestJSON-404199016 tempest-KeyPairsV22TestJSON-404199016-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.291293 Sep 23 04:49:06.335547 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2059/4027] 10.222.0.33 () {62 vars in 1199 bytes} [Fri Sep 23 04:49:06 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 293 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 23 04:49:06.349977 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1b3601ec-4927-45fa-80fe-acbfe52cc598 tempest-KeyPairsV22TestJSON-404199016 tempest-KeyPairsV22TestJSON-404199016-project] Action: 'create', calling method: .version_select at 0x7ff1ba8d1a60>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1435483492", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHRTfyorYQ6F24v3Uc7GHVQ5dRNbg3Yq2+BSLWif5uO48LW5OmaJw6OOQB1IuiRncxYG93F/YSvrNRnNALIde6uOrjcTP3xA++J7oQjHYKDlx/U4FNMYjNSthcRR+NT8sA=="}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:49:06.380047 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-1b3601ec-4927-45fa-80fe-acbfe52cc598 tempest-KeyPairsV22TestJSON-404199016 tempest-KeyPairsV22TestJSON-404199016-project] Getting quotas for project 496e3855267d4d1f8af0db3d26c6ed79. Resources: {'key_pairs'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:49:06.389880 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-1b3601ec-4927-45fa-80fe-acbfe52cc598 tempest-KeyPairsV22TestJSON-404199016 tempest-KeyPairsV22TestJSON-404199016-project] Getting quotas for user d9d00166ac674d3aa4753d0886cc2484 and project 496e3855267d4d1f8af0db3d26c6ed79. Resources: {'key_pairs'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:49:06.468608 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-5cc99e6b-983c-4b40-b328-5fad011fe82e tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:06.478369 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5cc99e6b-983c-4b40-b328-5fad011fe82e tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1670 microversion: 2.1 time: 0.449156 Sep 23 04:49:06.479625 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1969/4028] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:49:06 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1670 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:49:06.509155 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0fe854f8-6c08-4a50-9865-728f1378eeb6 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-1274189348"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:49:06.512150 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-0fe854f8-6c08-4a50-9865-728f1378eeb6 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:06.515697 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1b3601ec-4927-45fa-80fe-acbfe52cc598 tempest-KeyPairsV22TestJSON-404199016 tempest-KeyPairsV22TestJSON-404199016-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.170325 Sep 23 04:49:06.519321 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2060/4029] 10.222.0.33 () {62 vars in 1199 bytes} [Fri Sep 23 04:49:06 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 175 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 23 04:49:06.524890 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0fe854f8-6c08-4a50-9865-728f1378eeb6 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:06.525400 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0fe854f8-6c08-4a50-9865-728f1378eeb6 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:06.525845 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0fe854f8-6c08-4a50-9865-728f1378eeb6 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:06.526597 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0fe854f8-6c08-4a50-9865-728f1378eeb6 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:06.527068 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0fe854f8-6c08-4a50-9865-728f1378eeb6 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:06.527500 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0fe854f8-6c08-4a50-9865-728f1378eeb6 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:06.536746 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9ac6d0f8-3a5e-4c27-91f9-7fd0f180a415 tempest-KeyPairsV22TestJSON-404199016 tempest-KeyPairsV22TestJSON-404199016-project] Action: 'create', calling method: .version_select at 0x7ff1ba8ca820>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-162100251", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC6tLQ5xrBidh9y+YLvu1z7cHe9xXTbGnv+FCJEfnJ/Hd+Q9naeziD/KVE7L+nJHUqbIOOzze+UlhIvrElS/gEsjW9rIHx0v12V++2g1LiGGfH4qvna/vY6zVkiwspOKvw=="}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:49:06.567212 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:49:06.591444 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-9ac6d0f8-3a5e-4c27-91f9-7fd0f180a415 tempest-KeyPairsV22TestJSON-404199016 tempest-KeyPairsV22TestJSON-404199016-project] Getting quotas for project 496e3855267d4d1f8af0db3d26c6ed79. Resources: {'key_pairs'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:49:06.609614 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-9ac6d0f8-3a5e-4c27-91f9-7fd0f180a415 tempest-KeyPairsV22TestJSON-404199016 tempest-KeyPairsV22TestJSON-404199016-project] Getting quotas for user d9d00166ac674d3aa4753d0886cc2484 and project 496e3855267d4d1f8af0db3d26c6ed79. Resources: {'key_pairs'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:49:06.767065 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-9ac6d0f8-3a5e-4c27-91f9-7fd0f180a415 tempest-KeyPairsV22TestJSON-404199016 tempest-KeyPairsV22TestJSON-404199016-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.234363 Sep 23 04:49:06.775906 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2061/4030] 10.222.0.33 () {62 vars in 1199 bytes} [Fri Sep 23 04:49:06 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 245 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 23 04:49:06.785085 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d7d20436-a9fd-4868-b79a-7ae8d2de9e79 tempest-KeyPairsV22TestJSON-404199016 tempest-KeyPairsV22TestJSON-404199016-project] Calling method '.version_select at 0x7ff1ba93b0d0>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:06.800890 n-d-846463-3 devstack@n-api.service[122699]: WARNING oslo_db.sqlalchemy.utils [None req-d7d20436-a9fd-4868-b79a-7ae8d2de9e79 tempest-KeyPairsV22TestJSON-404199016 tempest-KeyPairsV22TestJSON-404199016-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 23 04:49:06.829700 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d7d20436-a9fd-4868-b79a-7ae8d2de9e79 tempest-KeyPairsV22TestJSON-404199016 tempest-KeyPairsV22TestJSON-404199016-project] 10.222.0.33 "GET /compute/v2.1/os-keypairs" status: 200 len: 1141 microversion: 2.2 time: 0.050624 Sep 23 04:49:06.839039 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2062/4031] 10.222.0.33 () {60 vars in 1177 bytes} [Fri Sep 23 04:49:06 2022] GET /compute/v2.1/os-keypairs => generated 1141 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:49:06.844585 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-284529ff-4c2f-4cdd-a17d-bdb591aa5a94 tempest-KeyPairsV22TestJSON-404199016 tempest-KeyPairsV22TestJSON-404199016-project] Calling method '.version_select at 0x7ff1ba9310d0>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:06.919111 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-284529ff-4c2f-4cdd-a17d-bdb591aa5a94 tempest-KeyPairsV22TestJSON-404199016 tempest-KeyPairsV22TestJSON-404199016-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-162100251" status: 204 len: 0 microversion: 2.2 time: 0.078563 Sep 23 04:49:06.923150 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2063/4032] 10.222.0.33 () {60 vars in 1318 bytes} [Fri Sep 23 04:49:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-162100251 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:49:06.931610 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5e9335c7-009b-466e-82f4-3cb089a73a00 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:06.932824 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-5e9335c7-009b-466e-82f4-3cb089a73a00 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] [instance: 33690ae1-5128-4bfd-b0b1-5f1bdb916fae] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:06.945547 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5e9335c7-009b-466e-82f4-3cb089a73a00 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:06.951299 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5e9335c7-009b-466e-82f4-3cb089a73a00 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:06.952083 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5e9335c7-009b-466e-82f4-3cb089a73a00 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:06.953002 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5e9335c7-009b-466e-82f4-3cb089a73a00 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:06.953629 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5e9335c7-009b-466e-82f4-3cb089a73a00 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:06.957518 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5e9335c7-009b-466e-82f4-3cb089a73a00 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:06.991067 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-5e9335c7-009b-466e-82f4-3cb089a73a00 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] HTTP exception thrown: Instance 33690ae1-5128-4bfd-b0b1-5f1bdb916fae could not be found. Sep 23 04:49:06.993183 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5e9335c7-009b-466e-82f4-3cb089a73a00 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Request method failure captured: Sep 23 04:49:06.993183 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/33690ae1-5128-4bfd-b0b1-5f1bdb916fae HTTP/1.1 Sep 23 04:49:06.993183 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:49:06.993183 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:49:06.993183 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:49:06.993183 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:49:06.993183 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:49:06.993183 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:49:06.993183 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:49:06.993183 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:49:06.993183 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTpFpjGPh25TzqBKyhrvLvaFWkL4faeTDdKKBYZ-4258bHvdM5kvJeJfEcGV73OAvtYNm_BDk9uKOKPqKlfTdSYy5tbnqP456--ua0TKxu-LM-map64NPTKy_GCC6WVYwCbUhwP1cF4hdC1uo-LvpY1Eaa8dgHWJxu3z0t2BBREm_ZE Sep 23 04:49:06.993183 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:49:06.993183 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:49:06.993183 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:49:06.993183 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:49:06.993183 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:49:06.993183 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:49:06.993183 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 53d02cb07a2a404c8d89aa13a950806d Sep 23 04:49:06.993183 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-728698197 Sep 23 04:49:06.993183 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:49:06.993183 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:49:06.993183 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_53d02cb07a2a404c8d89aa13a950806d", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/53d02cb07a2a404c8d89aa13a950806d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/53d02cb07a2a404c8d89aa13a950806d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/53d02cb07a2a404c8d89aa13a950806d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:49:06.993183 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-728698197 Sep 23 04:49:06.993183 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 53d02cb07a2a404c8d89aa13a950806d Sep 23 04:49:06.993183 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-728698197 Sep 23 04:49:06.993183 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ImagesOneServerNegativeTestJSON-728698197-project Sep 23 04:49:06.993183 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:49:06.993183 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:49:06.993183 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: a245dd82de1340f7a58873de1851c61c Sep 23 04:49:06.993183 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-728698197-project Sep 23 04:49:06.993183 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:49:06.993183 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 33690ae1-5128-4bfd-b0b1-5f1bdb916fae could not be found. Sep 23 04:49:06.993183 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '33690ae1-5128-4bfd-b0b1-5f1bdb916fae'} Sep 23 04:49:06.993183 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:49:06.993183 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:49:06.993183 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:49:06.993183 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:49:06.993183 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:49:06.993183 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:49:06.993183 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:49:06.993183 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:49:06.993183 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:49:06.993183 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:49:06.993183 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33690ae1-5128-4bfd-b0b1-5f1bdb916fae could not be found. Sep 23 04:49:06.993183 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:49:06.993183 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:49:06.993183 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:49:06.993183 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:49:06.993183 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:49:06.993183 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:49:06.993183 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:49:06.993183 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:49:06.993183 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:49:06.993183 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:49:06.993183 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:49:06.993183 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:49:06.993183 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:49:06.993183 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:49:06.993183 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:49:06.993183 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:49:06.993183 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33690ae1-5128-4bfd-b0b1-5f1bdb916fae could not be found. Sep 23 04:49:06.993183 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:49:06.993183 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:49:06.997633 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:49:06.997633 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:49:06.997633 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:49:06.997633 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:49:06.997633 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:49:06.997633 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:49:06.997633 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33690ae1-5128-4bfd-b0b1-5f1bdb916fae could not be found. Sep 23 04:49:06.997633 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:49:06.999765 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5e9335c7-009b-466e-82f4-3cb089a73a00 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Returning 404 to user: Instance 33690ae1-5128-4bfd-b0b1-5f1bdb916fae could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:49:07.002134 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5e9335c7-009b-466e-82f4-3cb089a73a00 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] 10.222.0.33 "GET /compute/v2.1/servers/33690ae1-5128-4bfd-b0b1-5f1bdb916fae" status: 404 len: 111 microversion: 2.1 time: 0.076610 Sep 23 04:49:07.008736 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2064/4033] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:49:06 2022] GET /compute/v2.1/servers/33690ae1-5128-4bfd-b0b1-5f1bdb916fae => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:49:07.022828 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-65129198-5a9b-431c-91ff-c2b7d7827fd1 tempest-KeyPairsV22TestJSON-404199016 tempest-KeyPairsV22TestJSON-404199016-project] Calling method '.version_select at 0x7ff1ba935e50>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:07.077177 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0fe854f8-6c08-4a50-9865-728f1378eeb6 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "POST /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5/action" status: 202 len: 0 microversion: 2.1 time: 0.573139 Sep 23 04:49:07.079746 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1970/4034] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:49:06 2022] POST /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5/action => generated 0 bytes in 577 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Sep 23 04:49:07.096472 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-00b4866c-7020-4045-ab4e-b2a37e09f7d8 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Calling method '.version_select at 0x7ff1ba8469d0>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:07.164258 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-65129198-5a9b-431c-91ff-c2b7d7827fd1 tempest-KeyPairsV22TestJSON-404199016 tempest-KeyPairsV22TestJSON-404199016-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1435483492" status: 204 len: 0 microversion: 2.2 time: 0.153642 Sep 23 04:49:07.164938 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2065/4035] 10.222.0.33 () {60 vars in 1321 bytes} [Fri Sep 23 04:49:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1435483492 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:49:07.171785 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-00b4866c-7020-4045-ab4e-b2a37e09f7d8 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] HTTP exception thrown: Image not found. Sep 23 04:49:07.174518 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-00b4866c-7020-4045-ab4e-b2a37e09f7d8 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Request method failure captured: Sep 23 04:49:07.174518 n-d-846463-3 devstack@n-api.service[122698]: request: DELETE /compute/v2.1/images/a26ee699-a26c-4ab4-aa2c-184c1d1065ba HTTP/1.1 Sep 23 04:49:07.174518 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:49:07.174518 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:49:07.174518 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:49:07.174518 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:49:07.174518 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:49:07.174518 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:49:07.174518 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:49:07.174518 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:49:07.174518 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTpFpjGPh25TzqBKyhrvLvaFWkL4faeTDdKKBYZ-4258bHvdM5kvJeJfEcGV73OAvtYNm_BDk9uKOKPqKlfTdSYy5tbnqP456--ua0TKxu-LM-map64NPTKy_GCC6WVYwCbUhwP1cF4hdC1uo-LvpY1Eaa8dgHWJxu3z0t2BBREm_ZE Sep 23 04:49:07.174518 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:49:07.174518 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:49:07.174518 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:49:07.174518 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:49:07.174518 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:49:07.174518 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:49:07.174518 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 53d02cb07a2a404c8d89aa13a950806d Sep 23 04:49:07.174518 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-728698197 Sep 23 04:49:07.174518 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:49:07.174518 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:49:07.174518 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_53d02cb07a2a404c8d89aa13a950806d", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/53d02cb07a2a404c8d89aa13a950806d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/53d02cb07a2a404c8d89aa13a950806d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/53d02cb07a2a404c8d89aa13a950806d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:49:07.174518 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-728698197 Sep 23 04:49:07.174518 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 53d02cb07a2a404c8d89aa13a950806d Sep 23 04:49:07.174518 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-728698197 Sep 23 04:49:07.174518 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ImagesOneServerNegativeTestJSON-728698197-project Sep 23 04:49:07.174518 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:49:07.174518 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:49:07.174518 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: a245dd82de1340f7a58873de1851c61c Sep 23 04:49:07.174518 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-728698197-project Sep 23 04:49:07.174518 n-d-846463-3 devstack@n-api.service[122698]: method: Sep 23 04:49:07.174518 n-d-846463-3 devstack@n-api.service[122698]: exception: Image not found. Sep 23 04:49:07.174518 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': 'a26ee699-a26c-4ab4-aa2c-184c1d1065ba'} Sep 23 04:49:07.174518 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:49:07.174518 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:49:07.174518 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 23 04:49:07.174518 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 23 04:49:07.174518 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 23 04:49:07.174518 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 23 04:49:07.174518 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 23 04:49:07.174518 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 23 04:49:07.174518 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 23 04:49:07.174518 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 23 04:49:07.174518 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 23 04:49:07.174518 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 23 04:49:07.174518 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 23 04:49:07.174518 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 23 04:49:07.174518 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 23 04:49:07.174518 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 23 04:49:07.174518 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image a26ee699-a26c-4ab4-aa2c-184c1d1065ba to delete Sep 23 04:49:07.174518 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:49:07.174518 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:49:07.174518 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:49:07.174518 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:49:07.174518 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 23 04:49:07.174518 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 23 04:49:07.174518 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 23 04:49:07.174518 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 23 04:49:07.174518 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 23 04:49:07.174518 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 23 04:49:07.174518 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a26ee699-a26c-4ab4-aa2c-184c1d1065ba could not be found. Sep 23 04:49:07.174518 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:49:07.174518 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:49:07.174518 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:49:07.179413 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:49:07.179413 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:49:07.179413 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:49:07.179413 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:49:07.179413 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:49:07.179413 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:49:07.179413 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:49:07.179413 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:49:07.179413 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:49:07.179413 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 23 04:49:07.179413 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 23 04:49:07.179413 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 23 04:49:07.179413 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:49:07.179413 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:49:07.179413 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:49:07.179413 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:49:07.179413 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:49:07.179413 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:49:07.179413 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:49:07.179413 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:49:07.179413 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 23 04:49:07.179413 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:49:07.180553 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7db73a2a-a900-46d8-925b-b71be19c2485 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:07.180553 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-7db73a2a-a900-46d8-925b-b71be19c2485 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: fe7dee09-8351-4d41-8c44-8d35a966cce9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:07.183208 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-00b4866c-7020-4045-ab4e-b2a37e09f7d8 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Returning 404 to user: Image not found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:49:07.184841 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-00b4866c-7020-4045-ab4e-b2a37e09f7d8 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] 10.222.0.33 "DELETE /compute/v2.1/images/a26ee699-a26c-4ab4-aa2c-184c1d1065ba" status: 404 len: 62 microversion: 2.1 time: 0.103125 Sep 23 04:49:07.186003 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1971/4036] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:49:07 2022] DELETE /compute/v2.1/images/a26ee699-a26c-4ab4-aa2c-184c1d1065ba => generated 62 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 23 04:49:07.193501 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3e4ea7f6-5c61-44f3-83c8-edbf3c042c45 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:07.195103 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3e4ea7f6-5c61-44f3-83c8-edbf3c042c45 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:07.204538 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3e4ea7f6-5c61-44f3-83c8-edbf3c042c45 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:07.205518 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3e4ea7f6-5c61-44f3-83c8-edbf3c042c45 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:07.206184 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3e4ea7f6-5c61-44f3-83c8-edbf3c042c45 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:07.207151 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3e4ea7f6-5c61-44f3-83c8-edbf3c042c45 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:07.207833 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3e4ea7f6-5c61-44f3-83c8-edbf3c042c45 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:07.208517 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3e4ea7f6-5c61-44f3-83c8-edbf3c042c45 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:07.214990 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7db73a2a-a900-46d8-925b-b71be19c2485 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:07.215504 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7db73a2a-a900-46d8-925b-b71be19c2485 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:07.215959 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7db73a2a-a900-46d8-925b-b71be19c2485 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:07.216688 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7db73a2a-a900-46d8-925b-b71be19c2485 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:07.221920 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7db73a2a-a900-46d8-925b-b71be19c2485 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:07.222393 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7db73a2a-a900-46d8-925b-b71be19c2485 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:07.607817 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-3e4ea7f6-5c61-44f3-83c8-edbf3c042c45 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:07.631032 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3e4ea7f6-5c61-44f3-83c8-edbf3c042c45 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1680 microversion: 2.1 time: 0.443755 Sep 23 04:49:07.633470 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1972/4037] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:49:07 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1680 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:49:07.645038 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3f1b1829-cc86-483c-b225-6bdbf82d77b8 tempest-KeyPairsV22TestJSON-404199016 tempest-KeyPairsV22TestJSON-404199016-project] Calling method '.version_select at 0x7ff1bafe1310>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:07.706222 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-7db73a2a-a900-46d8-925b-b71be19c2485 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:07.721151 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-7db73a2a-a900-46d8-925b-b71be19c2485 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:07.727051 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-7db73a2a-a900-46d8-925b-b71be19c2485 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:07.729245 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-7db73a2a-a900-46d8-925b-b71be19c2485 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9" status: 200 len: 1753 microversion: 2.20 time: 0.559442 Sep 23 04:49:07.730680 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2066/4038] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:49:07 2022] GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9 => generated 1753 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:49:07.736793 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-75c16676-271e-4860-9c1c-23cfe9214ea1 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:07.737841 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-75c16676-271e-4860-9c1c-23cfe9214ea1 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] [instance: 6b1aa3ac-6bda-48be-8814-e1a5ddd510a2] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:07.755432 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-75c16676-271e-4860-9c1c-23cfe9214ea1 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:07.757398 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-75c16676-271e-4860-9c1c-23cfe9214ea1 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:07.759520 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-75c16676-271e-4860-9c1c-23cfe9214ea1 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:07.761071 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-75c16676-271e-4860-9c1c-23cfe9214ea1 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:07.763856 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-75c16676-271e-4860-9c1c-23cfe9214ea1 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:07.764329 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-75c16676-271e-4860-9c1c-23cfe9214ea1 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:07.798358 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-75c16676-271e-4860-9c1c-23cfe9214ea1 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] HTTP exception thrown: Instance 6b1aa3ac-6bda-48be-8814-e1a5ddd510a2 could not be found. Sep 23 04:49:07.802328 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-75c16676-271e-4860-9c1c-23cfe9214ea1 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Request method failure captured: Sep 23 04:49:07.802328 n-d-846463-3 devstack@n-api.service[122699]: request: DELETE /compute/v2.1/servers/6b1aa3ac-6bda-48be-8814-e1a5ddd510a2 HTTP/1.1 Sep 23 04:49:07.802328 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:49:07.802328 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:49:07.802328 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:49:07.802328 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:49:07.802328 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:49:07.802328 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:49:07.802328 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:49:07.802328 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:49:07.802328 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTpFpjGPh25TzqBKyhrvLvaFWkL4faeTDdKKBYZ-4258bHvdM5kvJeJfEcGV73OAvtYNm_BDk9uKOKPqKlfTdSYy5tbnqP456--ua0TKxu-LM-map64NPTKy_GCC6WVYwCbUhwP1cF4hdC1uo-LvpY1Eaa8dgHWJxu3z0t2BBREm_ZE Sep 23 04:49:07.802328 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:49:07.802328 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:49:07.802328 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:49:07.802328 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:49:07.802328 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:49:07.802328 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:49:07.802328 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 53d02cb07a2a404c8d89aa13a950806d Sep 23 04:49:07.802328 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-728698197 Sep 23 04:49:07.802328 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:49:07.802328 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:49:07.802328 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_53d02cb07a2a404c8d89aa13a950806d", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/53d02cb07a2a404c8d89aa13a950806d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/53d02cb07a2a404c8d89aa13a950806d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/53d02cb07a2a404c8d89aa13a950806d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:49:07.802328 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-728698197 Sep 23 04:49:07.802328 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 53d02cb07a2a404c8d89aa13a950806d Sep 23 04:49:07.802328 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-728698197 Sep 23 04:49:07.802328 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ImagesOneServerNegativeTestJSON-728698197-project Sep 23 04:49:07.802328 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:49:07.802328 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:49:07.802328 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: a245dd82de1340f7a58873de1851c61c Sep 23 04:49:07.802328 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-728698197-project Sep 23 04:49:07.802328 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:49:07.802328 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 6b1aa3ac-6bda-48be-8814-e1a5ddd510a2 could not be found. Sep 23 04:49:07.802328 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '6b1aa3ac-6bda-48be-8814-e1a5ddd510a2'} Sep 23 04:49:07.802328 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:49:07.802328 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:49:07.802328 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:49:07.802328 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:49:07.802328 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:49:07.802328 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:49:07.802328 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:49:07.802328 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:49:07.802328 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:49:07.802328 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:49:07.802328 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b1aa3ac-6bda-48be-8814-e1a5ddd510a2 could not be found. Sep 23 04:49:07.802328 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:49:07.802328 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:49:07.802328 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:49:07.802328 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:49:07.802328 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:49:07.802328 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:49:07.802328 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:49:07.802328 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:49:07.802328 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:49:07.802328 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:49:07.802328 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 04:49:07.802328 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 04:49:07.802328 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 04:49:07.802328 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 04:49:07.802328 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:49:07.802328 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:49:07.802328 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:49:07.802328 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:49:07.806110 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b1aa3ac-6bda-48be-8814-e1a5ddd510a2 could not be found. Sep 23 04:49:07.806110 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:49:07.806110 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:49:07.806110 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:49:07.806110 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:49:07.806110 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:49:07.806110 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:49:07.806110 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:49:07.806110 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:49:07.806110 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b1aa3ac-6bda-48be-8814-e1a5ddd510a2 could not be found. Sep 23 04:49:07.806110 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:49:07.806110 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-75c16676-271e-4860-9c1c-23cfe9214ea1 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Returning 404 to user: Instance 6b1aa3ac-6bda-48be-8814-e1a5ddd510a2 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:49:07.806700 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-75c16676-271e-4860-9c1c-23cfe9214ea1 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6b1aa3ac-6bda-48be-8814-e1a5ddd510a2" status: 404 len: 111 microversion: 2.1 time: 0.074583 Sep 23 04:49:07.814090 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2067/4039] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:49:07 2022] DELETE /compute/v2.1/servers/6b1aa3ac-6bda-48be-8814-e1a5ddd510a2 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:49:07.834920 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c54f72c7-41c6-4a65-b7ed-77e0821c05f9 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:07.834920 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c54f72c7-41c6-4a65-b7ed-77e0821c05f9 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] [instance: 6b1aa3ac-6bda-48be-8814-e1a5ddd510a2] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:07.835058 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3f1b1829-cc86-483c-b225-6bdbf82d77b8 tempest-KeyPairsV22TestJSON-404199016 tempest-KeyPairsV22TestJSON-404199016-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1313813617" status: 204 len: 0 microversion: 2.2 time: 0.184461 Sep 23 04:49:07.835058 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1973/4040] 10.222.0.33 () {60 vars in 1321 bytes} [Fri Sep 23 04:49:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1313813617 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:49:07.842829 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c54f72c7-41c6-4a65-b7ed-77e0821c05f9 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:07.845813 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c54f72c7-41c6-4a65-b7ed-77e0821c05f9 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:07.850826 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c54f72c7-41c6-4a65-b7ed-77e0821c05f9 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:07.851320 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a39d3b4e-ca17-43c2-9272-8f4a1884b128 tempest-KeyPairsV22TestJSON-404199016 tempest-KeyPairsV22TestJSON-404199016-project] Action: 'create', calling method: .version_select at 0x7ff1baac34c0>, body: {"keypair": {"name": "tempest-keypair-1555204350", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOXJznCsj4Y2iSiTjvMaF0M4ur66N85Veke4Bdxai2DPXtC+jT6i1FLva0WvHlzWUiRG0W+O4+gR43QQj6QcuEQ3yf8rswPQSz/7LwZ9Ir1ivSoJP0zCkzFWLsxiMXEvKg=="}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:49:07.852134 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c54f72c7-41c6-4a65-b7ed-77e0821c05f9 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:07.852811 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c54f72c7-41c6-4a65-b7ed-77e0821c05f9 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:07.853469 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c54f72c7-41c6-4a65-b7ed-77e0821c05f9 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:07.891831 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-c54f72c7-41c6-4a65-b7ed-77e0821c05f9 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] HTTP exception thrown: Instance 6b1aa3ac-6bda-48be-8814-e1a5ddd510a2 could not be found. Sep 23 04:49:07.895492 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c54f72c7-41c6-4a65-b7ed-77e0821c05f9 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Request method failure captured: Sep 23 04:49:07.895492 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/6b1aa3ac-6bda-48be-8814-e1a5ddd510a2 HTTP/1.1 Sep 23 04:49:07.895492 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:49:07.895492 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:49:07.895492 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:49:07.895492 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:49:07.895492 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:49:07.895492 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:49:07.895492 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:49:07.895492 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:49:07.895492 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTpFpjGPh25TzqBKyhrvLvaFWkL4faeTDdKKBYZ-4258bHvdM5kvJeJfEcGV73OAvtYNm_BDk9uKOKPqKlfTdSYy5tbnqP456--ua0TKxu-LM-map64NPTKy_GCC6WVYwCbUhwP1cF4hdC1uo-LvpY1Eaa8dgHWJxu3z0t2BBREm_ZE Sep 23 04:49:07.895492 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:49:07.895492 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:49:07.895492 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:49:07.895492 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:49:07.895492 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:49:07.895492 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:49:07.895492 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 53d02cb07a2a404c8d89aa13a950806d Sep 23 04:49:07.895492 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-728698197 Sep 23 04:49:07.895492 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:49:07.895492 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:49:07.895492 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_53d02cb07a2a404c8d89aa13a950806d", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/53d02cb07a2a404c8d89aa13a950806d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/53d02cb07a2a404c8d89aa13a950806d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/53d02cb07a2a404c8d89aa13a950806d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:49:07.895492 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-728698197 Sep 23 04:49:07.895492 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 53d02cb07a2a404c8d89aa13a950806d Sep 23 04:49:07.895492 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-728698197 Sep 23 04:49:07.895492 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ImagesOneServerNegativeTestJSON-728698197-project Sep 23 04:49:07.895492 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:49:07.895492 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:49:07.895492 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: a245dd82de1340f7a58873de1851c61c Sep 23 04:49:07.895492 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-728698197-project Sep 23 04:49:07.895492 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:49:07.895492 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 6b1aa3ac-6bda-48be-8814-e1a5ddd510a2 could not be found. Sep 23 04:49:07.895492 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '6b1aa3ac-6bda-48be-8814-e1a5ddd510a2'} Sep 23 04:49:07.895492 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:49:07.895492 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:49:07.895492 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:49:07.895492 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:49:07.895492 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:49:07.895492 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:49:07.895492 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:49:07.895492 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:49:07.895492 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:49:07.895492 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:49:07.895492 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b1aa3ac-6bda-48be-8814-e1a5ddd510a2 could not be found. Sep 23 04:49:07.895492 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:49:07.895492 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:49:07.895492 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:49:07.895492 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:49:07.895492 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:49:07.895492 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:49:07.895492 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:49:07.895492 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:49:07.895492 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:49:07.895492 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:49:07.895492 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:49:07.895492 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:49:07.895492 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:49:07.895492 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:49:07.895492 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:49:07.895492 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:49:07.895492 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b1aa3ac-6bda-48be-8814-e1a5ddd510a2 could not be found. Sep 23 04:49:07.895492 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:49:07.895492 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:49:07.899638 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:49:07.899638 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:49:07.899638 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:49:07.899638 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:49:07.899638 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:49:07.899638 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:49:07.899638 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b1aa3ac-6bda-48be-8814-e1a5ddd510a2 could not be found. Sep 23 04:49:07.899638 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:49:07.904123 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c54f72c7-41c6-4a65-b7ed-77e0821c05f9 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Returning 404 to user: Instance 6b1aa3ac-6bda-48be-8814-e1a5ddd510a2 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:49:07.908980 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c54f72c7-41c6-4a65-b7ed-77e0821c05f9 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] 10.222.0.33 "GET /compute/v2.1/servers/6b1aa3ac-6bda-48be-8814-e1a5ddd510a2" status: 404 len: 111 microversion: 2.1 time: 0.089531 Sep 23 04:49:07.910222 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2068/4041] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:49:07 2022] GET /compute/v2.1/servers/6b1aa3ac-6bda-48be-8814-e1a5ddd510a2 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:49:07.919507 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-a39d3b4e-ca17-43c2-9272-8f4a1884b128 tempest-KeyPairsV22TestJSON-404199016 tempest-KeyPairsV22TestJSON-404199016-project] Getting quotas for project 496e3855267d4d1f8af0db3d26c6ed79. Resources: {'key_pairs'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:49:07.929626 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-a39d3b4e-ca17-43c2-9272-8f4a1884b128 tempest-KeyPairsV22TestJSON-404199016 tempest-KeyPairsV22TestJSON-404199016-project] Getting quotas for user d9d00166ac674d3aa4753d0886cc2484 and project 496e3855267d4d1f8af0db3d26c6ed79. Resources: {'key_pairs'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:49:08.074721 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a39d3b4e-ca17-43c2-9272-8f4a1884b128 tempest-KeyPairsV22TestJSON-404199016 tempest-KeyPairsV22TestJSON-404199016-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.232614 Sep 23 04:49:08.075806 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1974/4042] 10.222.0.33 () {62 vars in 1199 bytes} [Fri Sep 23 04:49:07 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 235 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Sep 23 04:49:08.091747 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b13db047-dace-4a51-a38f-ddbd54d8cbc1 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Calling method '.version_select at 0x7ff1baa7df70>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:08.188113 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b13db047-dace-4a51-a38f-ddbd54d8cbc1 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-497783909" status: 202 len: 0 microversion: 2.1 time: 0.101793 Sep 23 04:49:08.194414 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1975/4043] 10.222.0.33 () {58 vars in 1218 bytes} [Fri Sep 23 04:49:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-497783909 => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:49:08.199317 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-131210d5-b83d-46b7-81a7-06763a042a78 tempest-KeyPairsV22TestJSON-404199016 tempest-KeyPairsV22TestJSON-404199016-project] Calling method '.version_select at 0x7ff1c3ef0b80>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:08.231996 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-131210d5-b83d-46b7-81a7-06763a042a78 tempest-KeyPairsV22TestJSON-404199016 tempest-KeyPairsV22TestJSON-404199016-project] 10.222.0.33 "GET /compute/v2.1/os-keypairs/tempest-keypair-1555204350" status: 200 len: 513 microversion: 2.2 time: 0.038343 Sep 23 04:49:08.237293 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1976/4044] 10.222.0.33 () {60 vars in 1258 bytes} [Fri Sep 23 04:49:08 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1555204350 => generated 513 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:49:08.261965 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-52145d4a-e671-4f5e-8169-ea7db689af6e tempest-KeyPairsV22TestJSON-404199016 tempest-KeyPairsV22TestJSON-404199016-project] Calling method '.version_select at 0x7ff1bafb04c0>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:08.275819 n-d-846463-3 devstack@n-api.service[122698]: WARNING oslo_db.sqlalchemy.utils [None req-52145d4a-e671-4f5e-8169-ea7db689af6e tempest-KeyPairsV22TestJSON-404199016 tempest-KeyPairsV22TestJSON-404199016-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 23 04:49:08.291577 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-52145d4a-e671-4f5e-8169-ea7db689af6e tempest-KeyPairsV22TestJSON-404199016 tempest-KeyPairsV22TestJSON-404199016-project] 10.222.0.33 "GET /compute/v2.1/os-keypairs" status: 200 len: 370 microversion: 2.2 time: 0.039964 Sep 23 04:49:08.295421 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1977/4045] 10.222.0.33 () {60 vars in 1177 bytes} [Fri Sep 23 04:49:08 2022] GET /compute/v2.1/os-keypairs => generated 370 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:49:08.309262 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b17414a3-a48e-49e7-9b4b-3f1e9713aa5b tempest-KeyPairsV22TestJSON-404199016 tempest-KeyPairsV22TestJSON-404199016-project] Calling method '.version_select at 0x7ff1bafb0af0>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:08.448044 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b17414a3-a48e-49e7-9b4b-3f1e9713aa5b tempest-KeyPairsV22TestJSON-404199016 tempest-KeyPairsV22TestJSON-404199016-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1555204350" status: 204 len: 0 microversion: 2.2 time: 0.145223 Sep 23 04:49:08.453141 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1978/4046] 10.222.0.33 () {60 vars in 1261 bytes} [Fri Sep 23 04:49:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1555204350 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:49:08.467551 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-81e3c199-975a-4502-97c9-5ab40d0397dc tempest-KeyPairsV22TestJSON-404199016 tempest-KeyPairsV22TestJSON-404199016-project] Action: 'create', calling method: .version_select at 0x7ff1bab2b3a0>, body: {"keypair": {"name": "tempest-keypair-192283141", "type": "x509"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:49:08.468369 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-08e31f31-a39f-45f3-ab11-7281f06613c8 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-30906358", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "networks": [{"uuid": "eaa0cbf4-9a92-44f9-ac8d-d8f60e6441c0"}]}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:49:08.476007 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1,nova_api:INSERT=2,nova_api:DELETE=6 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:49:08.496035 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-81e3c199-975a-4502-97c9-5ab40d0397dc tempest-KeyPairsV22TestJSON-404199016 tempest-KeyPairsV22TestJSON-404199016-project] Getting quotas for project 496e3855267d4d1f8af0db3d26c6ed79. Resources: {'key_pairs'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:49:08.503901 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-81e3c199-975a-4502-97c9-5ab40d0397dc tempest-KeyPairsV22TestJSON-404199016 tempest-KeyPairsV22TestJSON-404199016-project] Getting quotas for user d9d00166ac674d3aa4753d0886cc2484 and project 496e3855267d4d1f8af0db3d26c6ed79. Resources: {'key_pairs'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:49:08.532325 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.processutils [None req-81e3c199-975a-4502-97c9-5ab40d0397dc tempest-KeyPairsV22TestJSON-404199016 tempest-KeyPairsV22TestJSON-404199016-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpzt2iy4k_/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpzt2iy4k_/temp.key -subj /CN=d9d00166ac674d3aa4753d0886cc2484 -extensions v3_req_client {{(pid=122698) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Sep 23 04:49:08.602355 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.neutron [None req-08e31f31-a39f-45f3-ab11-7281f06613c8 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] validate_networks() for [('eaa0cbf4-9a92-44f9-ac8d-d8f60e6441c0', None, None, None, None, None)] {{(pid=122699) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:49:08.926199 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.processutils [None req-81e3c199-975a-4502-97c9-5ab40d0397dc tempest-KeyPairsV22TestJSON-404199016 tempest-KeyPairsV22TestJSON-404199016-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpzt2iy4k_/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpzt2iy4k_/temp.key -subj /CN=d9d00166ac674d3aa4753d0886cc2484 -extensions v3_req_client" returned: 0 in 0.394s {{(pid=122698) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Sep 23 04:49:08.929680 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.processutils [None req-81e3c199-975a-4502-97c9-5ab40d0397dc tempest-KeyPairsV22TestJSON-404199016 tempest-KeyPairsV22TestJSON-404199016-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpzt2iy4k_/temp.key -password pass: {{(pid=122698) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Sep 23 04:49:09.018422 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.processutils [None req-81e3c199-975a-4502-97c9-5ab40d0397dc tempest-KeyPairsV22TestJSON-404199016 tempest-KeyPairsV22TestJSON-404199016-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpzt2iy4k_/temp.key -password pass:" returned: 0 in 0.085s {{(pid=122698) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Sep 23 04:49:09.195324 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-81e3c199-975a-4502-97c9-5ab40d0397dc tempest-KeyPairsV22TestJSON-404199016 tempest-KeyPairsV22TestJSON-404199016-project] Getting quotas for project 496e3855267d4d1f8af0db3d26c6ed79. Resources: {'key_pairs'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:49:09.201966 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-81e3c199-975a-4502-97c9-5ab40d0397dc tempest-KeyPairsV22TestJSON-404199016 tempest-KeyPairsV22TestJSON-404199016-project] Getting quotas for user d9d00166ac674d3aa4753d0886cc2484 and project 496e3855267d4d1f8af0db3d26c6ed79. Resources: {'key_pairs'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:49:09.220601 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-81e3c199-975a-4502-97c9-5ab40d0397dc tempest-KeyPairsV22TestJSON-404199016 tempest-KeyPairsV22TestJSON-404199016-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 4692 microversion: 2.2 time: 0.766245 Sep 23 04:49:09.228940 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1979/4047] 10.222.0.33 () {62 vars in 1198 bytes} [Fri Sep 23 04:49:08 2022] POST /compute/v2.1/os-keypairs => generated 4692 bytes in 775 msecs (HTTP/1.1 201) 9 headers in 363 bytes (2 switches on core 0) Sep 23 04:49:09.236016 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-abc7847c-339b-4f3b-9705-26e22a6808f5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:09.236889 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-abc7847c-339b-4f3b-9705-26e22a6808f5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:09.245584 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-abc7847c-339b-4f3b-9705-26e22a6808f5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:09.246496 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-abc7847c-339b-4f3b-9705-26e22a6808f5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:09.247126 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-abc7847c-339b-4f3b-9705-26e22a6808f5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:09.248082 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-abc7847c-339b-4f3b-9705-26e22a6808f5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:09.248712 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-abc7847c-339b-4f3b-9705-26e22a6808f5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:09.249450 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-abc7847c-339b-4f3b-9705-26e22a6808f5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:09.816280 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-abc7847c-339b-4f3b-9705-26e22a6808f5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:09.825786 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-abc7847c-339b-4f3b-9705-26e22a6808f5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1688 microversion: 2.1 time: 0.595210 Sep 23 04:49:09.833868 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1980/4048] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:49:09 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1688 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:49:09.865050 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-74c93eeb-11ef-4e82-85d2-c898dedbf3d8 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:09.870979 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-74c93eeb-11ef-4e82-85d2-c898dedbf3d8 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: fe7dee09-8351-4d41-8c44-8d35a966cce9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:09.883318 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-74c93eeb-11ef-4e82-85d2-c898dedbf3d8 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:09.883950 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-74c93eeb-11ef-4e82-85d2-c898dedbf3d8 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:09.887350 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-74c93eeb-11ef-4e82-85d2-c898dedbf3d8 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:09.888254 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-74c93eeb-11ef-4e82-85d2-c898dedbf3d8 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:09.888841 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-74c93eeb-11ef-4e82-85d2-c898dedbf3d8 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:09.889473 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-74c93eeb-11ef-4e82-85d2-c898dedbf3d8 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:10.221403 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-08e31f31-a39f-45f3-ab11-7281f06613c8 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Flavor limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:49:10.222465 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-08e31f31-a39f-45f3-ab11-7281f06613c8 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Image limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:49:10.223188 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-08e31f31-a39f-45f3-ab11-7281f06613c8 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Flavor pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:49:10.223730 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-08e31f31-a39f-45f3-ab11-7281f06613c8 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Image pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:49:10.224148 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-08e31f31-a39f-45f3-ab11-7281f06613c8 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:49:10.238907 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-08e31f31-a39f-45f3-ab11-7281f06613c8 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:10.242380 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-08e31f31-a39f-45f3-ab11-7281f06613c8 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:10.242380 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-08e31f31-a39f-45f3-ab11-7281f06613c8 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:10.242585 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-08e31f31-a39f-45f3-ab11-7281f06613c8 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:10.243202 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-08e31f31-a39f-45f3-ab11-7281f06613c8 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:10.243784 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-08e31f31-a39f-45f3-ab11-7281f06613c8 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:10.275195 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-74c93eeb-11ef-4e82-85d2-c898dedbf3d8 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:10.281851 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-08e31f31-a39f-45f3-ab11-7281f06613c8 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Getting quotas for project 78dca47156ff4f19a8673b893c853978. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:49:10.288582 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-08e31f31-a39f-45f3-ab11-7281f06613c8 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Getting quotas for user c912fb9d1f5447d180a9e8568220526f and project 78dca47156ff4f19a8673b893c853978. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:49:10.301030 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-74c93eeb-11ef-4e82-85d2-c898dedbf3d8 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:10.307680 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-74c93eeb-11ef-4e82-85d2-c898dedbf3d8 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:10.322817 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-74c93eeb-11ef-4e82-85d2-c898dedbf3d8 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9" status: 200 len: 1753 microversion: 2.20 time: 0.459422 Sep 23 04:49:10.322817 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1981/4049] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:49:09 2022] GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9 => generated 1753 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:49:10.324868 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-08e31f31-a39f-45f3-ab11-7281f06613c8 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Going to run 1 instances... {{(pid=122699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:49:10.336962 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-08e31f31-a39f-45f3-ab11-7281f06613c8 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:49:10.344913 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-f69461d0-e7ba-47c3-8b90-4c749b5116c1 req-652b5a44-9be7-441c-924a-ef0feedc7bca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fb569cf-4457-4695-ad5f-fcb78f0964c5", "name": "network-vif-unplugged", "status": "completed", "tag": "8fdad197-55e1-4686-bfa9-6cfa0beb24d5"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:49:10.380226 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-f69461d0-e7ba-47c3-8b90-4c749b5116c1 req-652b5a44-9be7-441c-924a-ef0feedc7bca service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:10.380226 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-f69461d0-e7ba-47c3-8b90-4c749b5116c1 req-652b5a44-9be7-441c-924a-ef0feedc7bca service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:10.380226 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-f69461d0-e7ba-47c3-8b90-4c749b5116c1 req-652b5a44-9be7-441c-924a-ef0feedc7bca service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:10.395856 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-f69461d0-e7ba-47c3-8b90-4c749b5116c1 req-652b5a44-9be7-441c-924a-ef0feedc7bca service nova] Creating event network-vif-unplugged:8fdad197-55e1-4686-bfa9-6cfa0beb24d5 for instance 4fb569cf-4457-4695-ad5f-fcb78f0964c5 on n-h2-846463-3 Sep 23 04:49:10.409202 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-f69461d0-e7ba-47c3-8b90-4c749b5116c1 req-652b5a44-9be7-441c-924a-ef0feedc7bca service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.088600 Sep 23 04:49:10.410379 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1982/4050] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:49:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:49:10.417126 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-51854cb0-1a46-491e-af9a-e5e3b7d1ceb5 tempest-KeyPairsV22TestJSON-404199016 tempest-KeyPairsV22TestJSON-404199016-project] Calling method '.version_select at 0x7ff1bab2bf70>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:10.460275 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-51854cb0-1a46-491e-af9a-e5e3b7d1ceb5 tempest-KeyPairsV22TestJSON-404199016 tempest-KeyPairsV22TestJSON-404199016-project] 10.222.0.33 "GET /compute/v2.1/os-keypairs/tempest-keypair-192283141" status: 200 len: 1533 microversion: 2.2 time: 0.047586 Sep 23 04:49:10.460897 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1983/4051] 10.222.0.33 () {60 vars in 1255 bytes} [Fri Sep 23 04:49:10 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-192283141 => generated 1533 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:49:10.479806 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b18915d0-3a14-43d2-9f03-c838fe0383d9 tempest-KeyPairsV22TestJSON-404199016 tempest-KeyPairsV22TestJSON-404199016-project] Calling method '.version_select at 0x7ff1c00f4c10>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:10.487904 n-d-846463-3 devstack@n-api.service[122698]: WARNING oslo_db.sqlalchemy.utils [None req-b18915d0-3a14-43d2-9f03-c838fe0383d9 tempest-KeyPairsV22TestJSON-404199016 tempest-KeyPairsV22TestJSON-404199016-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 23 04:49:10.500065 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b18915d0-3a14-43d2-9f03-c838fe0383d9 tempest-KeyPairsV22TestJSON-404199016 tempest-KeyPairsV22TestJSON-404199016-project] 10.222.0.33 "GET /compute/v2.1/os-keypairs" status: 200 len: 1390 microversion: 2.2 time: 0.028382 Sep 23 04:49:10.501693 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1984/4052] 10.222.0.33 () {60 vars in 1177 bytes} [Fri Sep 23 04:49:10 2022] GET /compute/v2.1/os-keypairs => generated 1390 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:49:10.518304 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-db5a5258-4e2f-4b1c-8ae1-005b969bb05f tempest-KeyPairsV22TestJSON-404199016 tempest-KeyPairsV22TestJSON-404199016-project] Calling method '.version_select at 0x7ff1ba800d30>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:10.568064 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-08e31f31-a39f-45f3-ab11-7281f06613c8 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.656364 Sep 23 04:49:10.575490 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2069/4053] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:49:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 2658 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:49:10.580603 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-22334bcb-4deb-48e5-95be-a393bd50b084 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:10.581223 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-22334bcb-4deb-48e5-95be-a393bd50b084 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:10.616228 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-db5a5258-4e2f-4b1c-8ae1-005b969bb05f tempest-KeyPairsV22TestJSON-404199016 tempest-KeyPairsV22TestJSON-404199016-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-192283141" status: 204 len: 0 microversion: 2.2 time: 0.105050 Sep 23 04:49:10.621424 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1985/4054] 10.222.0.33 () {60 vars in 1258 bytes} [Fri Sep 23 04:49:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-192283141 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:49:10.793683 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-22334bcb-4deb-48e5-95be-a393bd50b084 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:10.822778 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-22334bcb-4deb-48e5-95be-a393bd50b084 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1215 microversion: 2.1 time: 0.245693 Sep 23 04:49:10.823714 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2070/4055] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:49:10 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1215 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:49:10.857324 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-85881c8b-7b4a-43c3-b655-83c193b03eb5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:10.858115 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-85881c8b-7b4a-43c3-b655-83c193b03eb5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:10.878217 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-85881c8b-7b4a-43c3-b655-83c193b03eb5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:10.890813 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-85881c8b-7b4a-43c3-b655-83c193b03eb5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:10.893418 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-85881c8b-7b4a-43c3-b655-83c193b03eb5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:10.894249 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-85881c8b-7b4a-43c3-b655-83c193b03eb5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:10.895004 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-85881c8b-7b4a-43c3-b655-83c193b03eb5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:10.902731 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-85881c8b-7b4a-43c3-b655-83c193b03eb5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:11.310698 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-85881c8b-7b4a-43c3-b655-83c193b03eb5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:11.329017 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-85881c8b-7b4a-43c3-b655-83c193b03eb5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1688 microversion: 2.1 time: 0.474525 Sep 23 04:49:11.342747 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1986/4056] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:49:10 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1688 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:49:11.349856 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c0b8def5-a497-431e-8683-1cad21bddc24 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:11.351475 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c0b8def5-a497-431e-8683-1cad21bddc24 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: fe7dee09-8351-4d41-8c44-8d35a966cce9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:11.366560 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c0b8def5-a497-431e-8683-1cad21bddc24 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:11.367219 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c0b8def5-a497-431e-8683-1cad21bddc24 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:11.368006 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c0b8def5-a497-431e-8683-1cad21bddc24 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:11.371338 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c0b8def5-a497-431e-8683-1cad21bddc24 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:11.372100 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c0b8def5-a497-431e-8683-1cad21bddc24 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:11.373223 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c0b8def5-a497-431e-8683-1cad21bddc24 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:11.580666 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-93cfed8b-7878-425e-96aa-b6dd9f057bdd tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Calling method '.version_select at 0x7ff1baa2df70>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:11.617756 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-93cfed8b-7878-425e-96aa-b6dd9f057bdd tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] HTTP exception thrown: Image not found. Sep 23 04:49:11.627223 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-93cfed8b-7878-425e-96aa-b6dd9f057bdd tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Request method failure captured: Sep 23 04:49:11.627223 n-d-846463-3 devstack@n-api.service[122698]: request: DELETE /compute/v2.1/images/43adb9d8-84c7-4a78-bda0-00371e77fa15 HTTP/1.1 Sep 23 04:49:11.627223 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:49:11.627223 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:49:11.627223 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:49:11.627223 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:49:11.627223 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:49:11.627223 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:49:11.627223 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:49:11.627223 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:49:11.627223 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTpFpjGPh25TzqBKyhrvLvaFWkL4faeTDdKKBYZ-4258bHvdM5kvJeJfEcGV73OAvtYNm_BDk9uKOKPqKlfTdSYy5tbnqP456--ua0TKxu-LM-map64NPTKy_GCC6WVYwCbUhwP1cF4hdC1uo-LvpY1Eaa8dgHWJxu3z0t2BBREm_ZE Sep 23 04:49:11.627223 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:49:11.627223 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:49:11.627223 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:49:11.627223 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:49:11.627223 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:49:11.627223 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:49:11.627223 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 53d02cb07a2a404c8d89aa13a950806d Sep 23 04:49:11.627223 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-728698197 Sep 23 04:49:11.627223 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:49:11.627223 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:49:11.627223 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_53d02cb07a2a404c8d89aa13a950806d", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/53d02cb07a2a404c8d89aa13a950806d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/53d02cb07a2a404c8d89aa13a950806d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/53d02cb07a2a404c8d89aa13a950806d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:49:11.627223 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-728698197 Sep 23 04:49:11.627223 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 53d02cb07a2a404c8d89aa13a950806d Sep 23 04:49:11.627223 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-728698197 Sep 23 04:49:11.627223 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ImagesOneServerNegativeTestJSON-728698197-project Sep 23 04:49:11.627223 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:49:11.627223 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:49:11.627223 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: a245dd82de1340f7a58873de1851c61c Sep 23 04:49:11.627223 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-728698197-project Sep 23 04:49:11.627223 n-d-846463-3 devstack@n-api.service[122698]: method: Sep 23 04:49:11.627223 n-d-846463-3 devstack@n-api.service[122698]: exception: Image not found. Sep 23 04:49:11.627223 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '43adb9d8-84c7-4a78-bda0-00371e77fa15'} Sep 23 04:49:11.627223 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:49:11.627223 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:49:11.627223 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 23 04:49:11.627223 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 23 04:49:11.627223 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 23 04:49:11.627223 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 23 04:49:11.627223 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 23 04:49:11.627223 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 23 04:49:11.627223 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 23 04:49:11.627223 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 23 04:49:11.627223 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 23 04:49:11.627223 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 23 04:49:11.627223 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 23 04:49:11.627223 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 23 04:49:11.627223 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 23 04:49:11.627223 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 23 04:49:11.627223 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 43adb9d8-84c7-4a78-bda0-00371e77fa15 to delete Sep 23 04:49:11.627223 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:49:11.627223 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:49:11.627223 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:49:11.627223 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:49:11.627223 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 23 04:49:11.627223 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 23 04:49:11.627223 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 23 04:49:11.627223 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 23 04:49:11.627223 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 23 04:49:11.627223 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 23 04:49:11.627223 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 43adb9d8-84c7-4a78-bda0-00371e77fa15 could not be found. Sep 23 04:49:11.627223 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:49:11.627223 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:49:11.627223 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:49:11.631970 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:49:11.631970 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:49:11.631970 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:49:11.631970 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:49:11.631970 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:49:11.631970 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:49:11.631970 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:49:11.631970 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:49:11.631970 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:49:11.631970 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 23 04:49:11.631970 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 23 04:49:11.631970 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 23 04:49:11.631970 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:49:11.631970 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:49:11.631970 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:49:11.631970 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:49:11.631970 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:49:11.631970 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:49:11.631970 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:49:11.631970 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:49:11.631970 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 23 04:49:11.631970 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:49:11.640119 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-93cfed8b-7878-425e-96aa-b6dd9f057bdd tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Returning 404 to user: Image not found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:49:11.640119 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-93cfed8b-7878-425e-96aa-b6dd9f057bdd tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] 10.222.0.33 "DELETE /compute/v2.1/images/43adb9d8-84c7-4a78-bda0-00371e77fa15" status: 404 len: 62 microversion: 2.1 time: 0.064873 Sep 23 04:49:11.643729 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1987/4057] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:49:11 2022] DELETE /compute/v2.1/images/43adb9d8-84c7-4a78-bda0-00371e77fa15 => generated 62 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 23 04:49:11.656901 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-afb6fa28-5d0a-410e-9efd-6d2e6ba16282 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:11.661033 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-afb6fa28-5d0a-410e-9efd-6d2e6ba16282 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] [instance: f6413c5e-771f-45c5-94a8-b197becc0815] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:11.686063 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-afb6fa28-5d0a-410e-9efd-6d2e6ba16282 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:11.686633 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-afb6fa28-5d0a-410e-9efd-6d2e6ba16282 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:11.687104 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-afb6fa28-5d0a-410e-9efd-6d2e6ba16282 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:11.687852 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-afb6fa28-5d0a-410e-9efd-6d2e6ba16282 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:11.690052 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-afb6fa28-5d0a-410e-9efd-6d2e6ba16282 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:11.701324 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-afb6fa28-5d0a-410e-9efd-6d2e6ba16282 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:11.780371 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-afb6fa28-5d0a-410e-9efd-6d2e6ba16282 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] HTTP exception thrown: Instance f6413c5e-771f-45c5-94a8-b197becc0815 could not be found. Sep 23 04:49:11.782502 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-afb6fa28-5d0a-410e-9efd-6d2e6ba16282 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Request method failure captured: Sep 23 04:49:11.782502 n-d-846463-3 devstack@n-api.service[122698]: request: DELETE /compute/v2.1/servers/f6413c5e-771f-45c5-94a8-b197becc0815 HTTP/1.1 Sep 23 04:49:11.782502 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:49:11.782502 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:49:11.782502 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:49:11.782502 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:49:11.782502 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:49:11.782502 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:49:11.782502 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:49:11.782502 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:49:11.782502 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTpFpjGPh25TzqBKyhrvLvaFWkL4faeTDdKKBYZ-4258bHvdM5kvJeJfEcGV73OAvtYNm_BDk9uKOKPqKlfTdSYy5tbnqP456--ua0TKxu-LM-map64NPTKy_GCC6WVYwCbUhwP1cF4hdC1uo-LvpY1Eaa8dgHWJxu3z0t2BBREm_ZE Sep 23 04:49:11.782502 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:49:11.782502 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:49:11.782502 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:49:11.782502 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:49:11.782502 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:49:11.782502 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:49:11.782502 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 53d02cb07a2a404c8d89aa13a950806d Sep 23 04:49:11.782502 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-728698197 Sep 23 04:49:11.782502 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:49:11.782502 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:49:11.782502 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_53d02cb07a2a404c8d89aa13a950806d", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/53d02cb07a2a404c8d89aa13a950806d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/53d02cb07a2a404c8d89aa13a950806d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/53d02cb07a2a404c8d89aa13a950806d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:49:11.782502 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-728698197 Sep 23 04:49:11.782502 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 53d02cb07a2a404c8d89aa13a950806d Sep 23 04:49:11.782502 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-728698197 Sep 23 04:49:11.782502 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ImagesOneServerNegativeTestJSON-728698197-project Sep 23 04:49:11.782502 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:49:11.782502 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:49:11.782502 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: a245dd82de1340f7a58873de1851c61c Sep 23 04:49:11.782502 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-728698197-project Sep 23 04:49:11.782502 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:49:11.782502 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance f6413c5e-771f-45c5-94a8-b197becc0815 could not be found. Sep 23 04:49:11.782502 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': 'f6413c5e-771f-45c5-94a8-b197becc0815'} Sep 23 04:49:11.782502 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:49:11.782502 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:49:11.782502 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:49:11.782502 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:49:11.782502 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:49:11.782502 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:49:11.782502 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:49:11.782502 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:49:11.782502 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:49:11.782502 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:49:11.782502 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6413c5e-771f-45c5-94a8-b197becc0815 could not be found. Sep 23 04:49:11.782502 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:49:11.782502 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:49:11.782502 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:49:11.782502 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:49:11.782502 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:49:11.782502 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:49:11.782502 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:49:11.782502 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:49:11.782502 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:49:11.782502 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:49:11.782502 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 04:49:11.782502 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 04:49:11.782502 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 04:49:11.782502 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 04:49:11.782502 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:49:11.782502 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:49:11.782502 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:49:11.782502 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:49:11.785691 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6413c5e-771f-45c5-94a8-b197becc0815 could not be found. Sep 23 04:49:11.785691 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:49:11.785691 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:49:11.785691 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:49:11.785691 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:49:11.785691 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:49:11.785691 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:49:11.785691 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:49:11.785691 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:49:11.785691 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6413c5e-771f-45c5-94a8-b197becc0815 could not be found. Sep 23 04:49:11.785691 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:49:11.788359 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-afb6fa28-5d0a-410e-9efd-6d2e6ba16282 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Returning 404 to user: Instance f6413c5e-771f-45c5-94a8-b197becc0815 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:49:11.794469 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-afb6fa28-5d0a-410e-9efd-6d2e6ba16282 tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f6413c5e-771f-45c5-94a8-b197becc0815" status: 404 len: 111 microversion: 2.1 time: 0.142434 Sep 23 04:49:11.796173 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1988/4058] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:49:11 2022] DELETE /compute/v2.1/servers/f6413c5e-771f-45c5-94a8-b197becc0815 => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:49:11.809714 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3497fe5f-6eb1-4658-9eef-07302f1b4f5d tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:11.810451 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3497fe5f-6eb1-4658-9eef-07302f1b4f5d tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] [instance: f6413c5e-771f-45c5-94a8-b197becc0815] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:11.829533 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3497fe5f-6eb1-4658-9eef-07302f1b4f5d tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:11.830082 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3497fe5f-6eb1-4658-9eef-07302f1b4f5d tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:11.830532 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3497fe5f-6eb1-4658-9eef-07302f1b4f5d tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:11.831259 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3497fe5f-6eb1-4658-9eef-07302f1b4f5d tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:11.831720 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3497fe5f-6eb1-4658-9eef-07302f1b4f5d tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:11.832156 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3497fe5f-6eb1-4658-9eef-07302f1b4f5d tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:11.847301 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c0b8def5-a497-431e-8683-1cad21bddc24 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:11.859093 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-3497fe5f-6eb1-4658-9eef-07302f1b4f5d tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] HTTP exception thrown: Instance f6413c5e-771f-45c5-94a8-b197becc0815 could not be found. Sep 23 04:49:11.860956 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3497fe5f-6eb1-4658-9eef-07302f1b4f5d tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Request method failure captured: Sep 23 04:49:11.860956 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/f6413c5e-771f-45c5-94a8-b197becc0815 HTTP/1.1 Sep 23 04:49:11.860956 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:49:11.860956 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:49:11.860956 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:49:11.860956 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:49:11.860956 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:49:11.860956 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:49:11.860956 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:49:11.860956 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:49:11.860956 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTpFpjGPh25TzqBKyhrvLvaFWkL4faeTDdKKBYZ-4258bHvdM5kvJeJfEcGV73OAvtYNm_BDk9uKOKPqKlfTdSYy5tbnqP456--ua0TKxu-LM-map64NPTKy_GCC6WVYwCbUhwP1cF4hdC1uo-LvpY1Eaa8dgHWJxu3z0t2BBREm_ZE Sep 23 04:49:11.860956 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:49:11.860956 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:49:11.860956 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:49:11.860956 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:49:11.860956 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:49:11.860956 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:49:11.860956 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 53d02cb07a2a404c8d89aa13a950806d Sep 23 04:49:11.860956 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-728698197 Sep 23 04:49:11.860956 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:49:11.860956 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:49:11.860956 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_53d02cb07a2a404c8d89aa13a950806d", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/53d02cb07a2a404c8d89aa13a950806d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/53d02cb07a2a404c8d89aa13a950806d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/53d02cb07a2a404c8d89aa13a950806d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:49:11.860956 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-728698197 Sep 23 04:49:11.860956 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 53d02cb07a2a404c8d89aa13a950806d Sep 23 04:49:11.860956 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-728698197 Sep 23 04:49:11.860956 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ImagesOneServerNegativeTestJSON-728698197-project Sep 23 04:49:11.860956 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:49:11.860956 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:49:11.860956 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: a245dd82de1340f7a58873de1851c61c Sep 23 04:49:11.860956 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-728698197-project Sep 23 04:49:11.860956 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:49:11.860956 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance f6413c5e-771f-45c5-94a8-b197becc0815 could not be found. Sep 23 04:49:11.860956 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': 'f6413c5e-771f-45c5-94a8-b197becc0815'} Sep 23 04:49:11.860956 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:49:11.860956 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:49:11.860956 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:49:11.860956 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:49:11.860956 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:49:11.860956 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:49:11.860956 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:49:11.860956 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:49:11.860956 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:49:11.860956 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:49:11.860956 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6413c5e-771f-45c5-94a8-b197becc0815 could not be found. Sep 23 04:49:11.860956 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:49:11.860956 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:49:11.860956 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:49:11.860956 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:49:11.860956 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:49:11.860956 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:49:11.860956 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:49:11.860956 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:49:11.860956 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:49:11.860956 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:49:11.860956 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:49:11.860956 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:49:11.860956 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:49:11.860956 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:49:11.860956 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:49:11.860956 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:49:11.860956 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6413c5e-771f-45c5-94a8-b197becc0815 could not be found. Sep 23 04:49:11.860956 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:49:11.860956 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:49:11.864164 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:49:11.864164 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:49:11.864164 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:49:11.864164 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:49:11.864164 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:49:11.864164 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:49:11.864164 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6413c5e-771f-45c5-94a8-b197becc0815 could not be found. Sep 23 04:49:11.864164 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:49:11.864749 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c0b8def5-a497-431e-8683-1cad21bddc24 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:11.864749 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c0b8def5-a497-431e-8683-1cad21bddc24 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:11.866495 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c0b8def5-a497-431e-8683-1cad21bddc24 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9" status: 200 len: 1753 microversion: 2.20 time: 0.521909 Sep 23 04:49:11.867092 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3497fe5f-6eb1-4658-9eef-07302f1b4f5d tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] Returning 404 to user: Instance f6413c5e-771f-45c5-94a8-b197becc0815 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:49:11.868170 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3497fe5f-6eb1-4658-9eef-07302f1b4f5d tempest-ImagesOneServerNegativeTestJSON-728698197 tempest-ImagesOneServerNegativeTestJSON-728698197-project] 10.222.0.33 "GET /compute/v2.1/servers/f6413c5e-771f-45c5-94a8-b197becc0815" status: 404 len: 111 microversion: 2.1 time: 0.067989 Sep 23 04:49:11.873033 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2071/4059] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:49:11 2022] GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9 => generated 1753 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:49:11.879417 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ba92bb81-659a-401e-831b-49b86820bf42 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:11.880048 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ba92bb81-659a-401e-831b-49b86820bf42 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:11.884676 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1989/4060] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:49:11 2022] GET /compute/v2.1/servers/f6413c5e-771f-45c5-94a8-b197becc0815 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:49:12.366224 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-db4b7a6f-7320-4f3a-a61f-3bc5abefd7fc tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:12.367806 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-db4b7a6f-7320-4f3a-a61f-3bc5abefd7fc tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:12.378200 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ba92bb81-659a-401e-831b-49b86820bf42 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:12.383441 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-db4b7a6f-7320-4f3a-a61f-3bc5abefd7fc tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:12.383966 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-db4b7a6f-7320-4f3a-a61f-3bc5abefd7fc tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:12.384423 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-db4b7a6f-7320-4f3a-a61f-3bc5abefd7fc tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:12.388458 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-db4b7a6f-7320-4f3a-a61f-3bc5abefd7fc tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:12.388458 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-db4b7a6f-7320-4f3a-a61f-3bc5abefd7fc tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:12.388458 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-db4b7a6f-7320-4f3a-a61f-3bc5abefd7fc tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:12.399501 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ba92bb81-659a-401e-831b-49b86820bf42 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1215 microversion: 2.1 time: 0.525035 Sep 23 04:49:12.401594 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2072/4061] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:49:11 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1215 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:49:12.905493 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f46e3133-0912-4bd9-952b-54df22ab59b3 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:12.911172 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f46e3133-0912-4bd9-952b-54df22ab59b3 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: fe7dee09-8351-4d41-8c44-8d35a966cce9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:12.918439 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f46e3133-0912-4bd9-952b-54df22ab59b3 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:12.918954 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f46e3133-0912-4bd9-952b-54df22ab59b3 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:12.919437 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f46e3133-0912-4bd9-952b-54df22ab59b3 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:12.922703 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f46e3133-0912-4bd9-952b-54df22ab59b3 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:12.923229 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f46e3133-0912-4bd9-952b-54df22ab59b3 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:12.923674 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f46e3133-0912-4bd9-952b-54df22ab59b3 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:13.051082 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-db4b7a6f-7320-4f3a-a61f-3bc5abefd7fc tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:13.090986 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-db4b7a6f-7320-4f3a-a61f-3bc5abefd7fc tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1683 microversion: 2.1 time: 0.709416 Sep 23 04:49:13.090986 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1990/4062] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:49:12 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1683 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:49:13.257089 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-757d0060-bca8-481a-b98a-fb25511ca38d tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:49:13.267084 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-757d0060-bca8-481a-b98a-fb25511ca38d tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: c4464422-9bf1-4aaa-806c-d7063e284579] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:13.290737 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-757d0060-bca8-481a-b98a-fb25511ca38d tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:13.295235 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-757d0060-bca8-481a-b98a-fb25511ca38d tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:13.300817 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-757d0060-bca8-481a-b98a-fb25511ca38d tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:13.302364 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-757d0060-bca8-481a-b98a-fb25511ca38d tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:13.302906 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-757d0060-bca8-481a-b98a-fb25511ca38d tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:13.312420 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-757d0060-bca8-481a-b98a-fb25511ca38d tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:13.415051 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-757d0060-bca8-481a-b98a-fb25511ca38d tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lazy-loading 'flavor' on Instance uuid c4464422-9bf1-4aaa-806c-d7063e284579 {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:49:13.724888 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f46e3133-0912-4bd9-952b-54df22ab59b3 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:13.737736 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f46e3133-0912-4bd9-952b-54df22ab59b3 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:13.743682 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f46e3133-0912-4bd9-952b-54df22ab59b3 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:13.755364 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f46e3133-0912-4bd9-952b-54df22ab59b3 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9" status: 200 len: 1809 microversion: 2.20 time: 0.844592 Sep 23 04:49:13.757485 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2073/4063] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:49:12 2022] GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9 => generated 1809 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:49:13.773633 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1ef341ad-bc52-4968-b4f2-d2fc48e63d5d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:13.774631 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1ef341ad-bc52-4968-b4f2-d2fc48e63d5d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:13.787504 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1ef341ad-bc52-4968-b4f2-d2fc48e63d5d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:13.788912 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1ef341ad-bc52-4968-b4f2-d2fc48e63d5d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:13.792930 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1ef341ad-bc52-4968-b4f2-d2fc48e63d5d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:13.794202 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1ef341ad-bc52-4968-b4f2-d2fc48e63d5d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:13.800056 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1ef341ad-bc52-4968-b4f2-d2fc48e63d5d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:13.800056 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1ef341ad-bc52-4968-b4f2-d2fc48e63d5d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:14.093715 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-757d0060-bca8-481a-b98a-fb25511ca38d tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "POST /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579/action" status: 200 len: 32 microversion: 2.1 time: 0.842796 Sep 23 04:49:14.095185 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1991/4064] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:49:13 2022] POST /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579/action => generated 32 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 04:49:14.207412 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1ef341ad-bc52-4968-b4f2-d2fc48e63d5d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:14.219748 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1ef341ad-bc52-4968-b4f2-d2fc48e63d5d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1267 microversion: 2.1 time: 0.459633 Sep 23 04:49:14.239932 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2074/4065] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:49:13 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1267 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:49:14.265371 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5267813d-127d-424d-bf93-8360bf666e8a tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:14.272807 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-5267813d-127d-424d-bf93-8360bf666e8a tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: c4464422-9bf1-4aaa-806c-d7063e284579] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:14.296836 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5267813d-127d-424d-bf93-8360bf666e8a tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:14.298855 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5267813d-127d-424d-bf93-8360bf666e8a tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:14.300602 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5267813d-127d-424d-bf93-8360bf666e8a tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:14.303659 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5267813d-127d-424d-bf93-8360bf666e8a tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:14.312017 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5267813d-127d-424d-bf93-8360bf666e8a tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:14.313980 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5267813d-127d-424d-bf93-8360bf666e8a tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:14.725524 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-5267813d-127d-424d-bf93-8360bf666e8a tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c786bbedc21849ea92924139a44707b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcafb05f6f554e278cd552023947c6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:14.736591 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5267813d-127d-424d-bf93-8360bf666e8a tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579" status: 200 len: 1736 microversion: 2.1 time: 0.486633 Sep 23 04:49:14.740104 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2075/4066] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:49:14 2022] GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579 => generated 1736 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:49:14.751501 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-cbfc79c8-3771-44b7-88a0-fcedd272d9dc tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:14.757951 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-cbfc79c8-3771-44b7-88a0-fcedd272d9dc tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:14.777287 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cbfc79c8-3771-44b7-88a0-fcedd272d9dc tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:14.778676 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cbfc79c8-3771-44b7-88a0-fcedd272d9dc tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:14.779321 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cbfc79c8-3771-44b7-88a0-fcedd272d9dc tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:14.781401 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cbfc79c8-3771-44b7-88a0-fcedd272d9dc tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:14.785486 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cbfc79c8-3771-44b7-88a0-fcedd272d9dc tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:14.785486 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cbfc79c8-3771-44b7-88a0-fcedd272d9dc tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:14.851774 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-82ad6430-3264-4bf8-bf8d-099d3f54c05a tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Action: 'create', calling method: .version_select at 0x7ff1ba9c94c0>, body: {"keypair": {"name": "tempest-keypair-1226867454", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGSd24hQ9xHmpm9OBTx8ewY50q+02ootjfvTamE0WGKQoelv7gwJdaQLsx4fJrmp/zfZpzHBsxElsvqIFuEFGvAkiMVoS/YOqjS/NcsoLUGVDZyaC5t0lSOUzPVWrP5DyA=="}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:49:14.907875 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-82ad6430-3264-4bf8-bf8d-099d3f54c05a tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Getting quotas for project dbaa3a17b8a24f8087a5748f83d377e7. Resources: {'key_pairs'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:49:14.952829 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-82ad6430-3264-4bf8-bf8d-099d3f54c05a tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Getting quotas for user 8d728817c4f74e579eab88b62f73d08b and project dbaa3a17b8a24f8087a5748f83d377e7. Resources: {'key_pairs'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:49:15.120143 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-82ad6430-3264-4bf8-bf8d-099d3f54c05a tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.022711 Sep 23 04:49:15.120811 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1992/4067] 10.222.0.33 () {60 vars in 1159 bytes} [Fri Sep 23 04:49:14 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:49:15.134272 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-322f6c37-39b1-4182-8096-a46bac5ef1d7 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:15.136841 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-322f6c37-39b1-4182-8096-a46bac5ef1d7 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: fe7dee09-8351-4d41-8c44-8d35a966cce9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:15.174439 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-322f6c37-39b1-4182-8096-a46bac5ef1d7 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:15.180243 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-322f6c37-39b1-4182-8096-a46bac5ef1d7 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:15.180731 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-322f6c37-39b1-4182-8096-a46bac5ef1d7 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:15.191244 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-322f6c37-39b1-4182-8096-a46bac5ef1d7 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:15.191810 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-322f6c37-39b1-4182-8096-a46bac5ef1d7 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:15.192274 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-322f6c37-39b1-4182-8096-a46bac5ef1d7 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:15.413376 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-cbfc79c8-3771-44b7-88a0-fcedd272d9dc tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:15.430814 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-cbfc79c8-3771-44b7-88a0-fcedd272d9dc tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1683 microversion: 2.1 time: 0.685780 Sep 23 04:49:15.434057 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2076/4068] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:49:14 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1683 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:49:15.459095 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-22cf3f92-08bd-466a-84f3-e03b33b1ca1e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:15.462210 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-22cf3f92-08bd-466a-84f3-e03b33b1ca1e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:15.504751 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-22cf3f92-08bd-466a-84f3-e03b33b1ca1e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:15.510221 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-22cf3f92-08bd-466a-84f3-e03b33b1ca1e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:15.511846 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-22cf3f92-08bd-466a-84f3-e03b33b1ca1e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:15.516329 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-22cf3f92-08bd-466a-84f3-e03b33b1ca1e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:15.520732 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-22cf3f92-08bd-466a-84f3-e03b33b1ca1e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:15.521526 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-22cf3f92-08bd-466a-84f3-e03b33b1ca1e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:15.887723 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-22cf3f92-08bd-466a-84f3-e03b33b1ca1e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:15.900082 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-22cf3f92-08bd-466a-84f3-e03b33b1ca1e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1273 microversion: 2.1 time: 0.464386 Sep 23 04:49:15.904525 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2077/4069] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:49:15 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1273 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:49:15.913790 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a79a441e-dfe0-456d-8c72-2519f93d37df tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:15.920296 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a79a441e-dfe0-456d-8c72-2519f93d37df tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: c4464422-9bf1-4aaa-806c-d7063e284579] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:15.959305 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a79a441e-dfe0-456d-8c72-2519f93d37df tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:15.964594 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a79a441e-dfe0-456d-8c72-2519f93d37df tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:15.968418 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a79a441e-dfe0-456d-8c72-2519f93d37df tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:15.970795 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a79a441e-dfe0-456d-8c72-2519f93d37df tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:15.971930 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a79a441e-dfe0-456d-8c72-2519f93d37df tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:15.978218 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a79a441e-dfe0-456d-8c72-2519f93d37df tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:16.000975 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-322f6c37-39b1-4182-8096-a46bac5ef1d7 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:16.032623 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-322f6c37-39b1-4182-8096-a46bac5ef1d7 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:16.039182 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-322f6c37-39b1-4182-8096-a46bac5ef1d7 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:16.047408 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-322f6c37-39b1-4182-8096-a46bac5ef1d7 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9" status: 200 len: 1809 microversion: 2.20 time: 0.925238 Sep 23 04:49:16.053778 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1993/4070] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:49:15 2022] GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9 => generated 1809 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:49:16.092947 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-10ebc829-75a1-4656-88d8-fd50708e1cfb req-77367bef-b977-4987-b28e-ac650cafc64f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fb569cf-4457-4695-ad5f-fcb78f0964c5", "name": "network-vif-plugged", "status": "completed", "tag": "8fdad197-55e1-4686-bfa9-6cfa0beb24d5"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:49:16.156342 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-10ebc829-75a1-4656-88d8-fd50708e1cfb req-77367bef-b977-4987-b28e-ac650cafc64f service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:16.171767 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-10ebc829-75a1-4656-88d8-fd50708e1cfb req-77367bef-b977-4987-b28e-ac650cafc64f service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:16.171767 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-10ebc829-75a1-4656-88d8-fd50708e1cfb req-77367bef-b977-4987-b28e-ac650cafc64f service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:16.204156 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-10ebc829-75a1-4656-88d8-fd50708e1cfb req-77367bef-b977-4987-b28e-ac650cafc64f service nova] Creating event network-vif-plugged:8fdad197-55e1-4686-bfa9-6cfa0beb24d5 for instance 4fb569cf-4457-4695-ad5f-fcb78f0964c5 on n-h2-846463-3 Sep 23 04:49:16.247737 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-10ebc829-75a1-4656-88d8-fd50708e1cfb req-77367bef-b977-4987-b28e-ac650cafc64f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.189209 Sep 23 04:49:16.297571 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1994/4071] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:49:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:49:16.467217 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e7c43bf9-1528-4269-89c6-8bf494959558 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:16.468732 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e7c43bf9-1528-4269-89c6-8bf494959558 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:16.506879 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e7c43bf9-1528-4269-89c6-8bf494959558 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:16.511262 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e7c43bf9-1528-4269-89c6-8bf494959558 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:16.511982 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e7c43bf9-1528-4269-89c6-8bf494959558 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:16.512765 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e7c43bf9-1528-4269-89c6-8bf494959558 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:16.513252 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e7c43bf9-1528-4269-89c6-8bf494959558 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:16.521063 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e7c43bf9-1528-4269-89c6-8bf494959558 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:17.708736 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a79a441e-dfe0-456d-8c72-2519f93d37df tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c786bbedc21849ea92924139a44707b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcafb05f6f554e278cd552023947c6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:17.750293 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a79a441e-dfe0-456d-8c72-2519f93d37df tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579" status: 200 len: 1736 microversion: 2.1 time: 1.843359 Sep 23 04:49:17.755929 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2078/4072] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:49:15 2022] GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579 => generated 1736 bytes in 1850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:49:17.779806 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-440b533d-9656-4180-92f1-4b10ab7b30b4 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:17.785585 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-440b533d-9656-4180-92f1-4b10ab7b30b4 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:17.808932 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-440b533d-9656-4180-92f1-4b10ab7b30b4 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:17.810700 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-440b533d-9656-4180-92f1-4b10ab7b30b4 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:17.812353 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-440b533d-9656-4180-92f1-4b10ab7b30b4 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:17.833499 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-440b533d-9656-4180-92f1-4b10ab7b30b4 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:17.836751 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-440b533d-9656-4180-92f1-4b10ab7b30b4 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:17.837396 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-440b533d-9656-4180-92f1-4b10ab7b30b4 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:18.444815 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e7c43bf9-1528-4269-89c6-8bf494959558 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:18.464484 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e7c43bf9-1528-4269-89c6-8bf494959558 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1683 microversion: 2.1 time: 2.002048 Sep 23 04:49:18.485672 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1995/4073] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:49:16 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1683 bytes in 2024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:49:18.510127 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ae3177bd-3485-4cb3-b54c-85e2f86e7f5b tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:18.512713 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-ae3177bd-3485-4cb3-b54c-85e2f86e7f5b tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: fe7dee09-8351-4d41-8c44-8d35a966cce9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:18.535574 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ae3177bd-3485-4cb3-b54c-85e2f86e7f5b tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:18.540080 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ae3177bd-3485-4cb3-b54c-85e2f86e7f5b tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:18.540848 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ae3177bd-3485-4cb3-b54c-85e2f86e7f5b tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:18.578212 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ae3177bd-3485-4cb3-b54c-85e2f86e7f5b tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:18.580645 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ae3177bd-3485-4cb3-b54c-85e2f86e7f5b tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:18.582525 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ae3177bd-3485-4cb3-b54c-85e2f86e7f5b tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:19.530474 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-440b533d-9656-4180-92f1-4b10ab7b30b4 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:19.600106 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-440b533d-9656-4180-92f1-4b10ab7b30b4 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1315 microversion: 2.1 time: 1.842204 Sep 23 04:49:19.607099 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2079/4074] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:49:17 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1315 bytes in 1850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:49:19.637138 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-01e0d1bb-fc04-4f20-a023-f296e86a4f99 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:19.643012 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-01e0d1bb-fc04-4f20-a023-f296e86a4f99 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: c4464422-9bf1-4aaa-806c-d7063e284579] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:19.651386 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-01e0d1bb-fc04-4f20-a023-f296e86a4f99 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:19.652158 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-01e0d1bb-fc04-4f20-a023-f296e86a4f99 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:19.652776 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-01e0d1bb-fc04-4f20-a023-f296e86a4f99 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:19.653656 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-01e0d1bb-fc04-4f20-a023-f296e86a4f99 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:19.654315 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-01e0d1bb-fc04-4f20-a023-f296e86a4f99 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:19.654905 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-01e0d1bb-fc04-4f20-a023-f296e86a4f99 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:20.042445 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ae3177bd-3485-4cb3-b54c-85e2f86e7f5b tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:20.062942 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ae3177bd-3485-4cb3-b54c-85e2f86e7f5b tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:20.066367 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ae3177bd-3485-4cb3-b54c-85e2f86e7f5b tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:20.079688 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ae3177bd-3485-4cb3-b54c-85e2f86e7f5b tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9" status: 200 len: 1809 microversion: 2.20 time: 1.583766 Sep 23 04:49:20.080392 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1996/4075] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:49:18 2022] GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9 => generated 1809 bytes in 1594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:49:20.106387 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-13ac3965-4474-4fe4-83be-bbaf2ecf7ef3 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:20.107372 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-13ac3965-4474-4fe4-83be-bbaf2ecf7ef3 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:20.119179 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-13ac3965-4474-4fe4-83be-bbaf2ecf7ef3 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:20.121113 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-13ac3965-4474-4fe4-83be-bbaf2ecf7ef3 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:20.122182 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-13ac3965-4474-4fe4-83be-bbaf2ecf7ef3 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:20.128832 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-13ac3965-4474-4fe4-83be-bbaf2ecf7ef3 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:20.129602 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-13ac3965-4474-4fe4-83be-bbaf2ecf7ef3 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:20.130769 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-13ac3965-4474-4fe4-83be-bbaf2ecf7ef3 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:20.254934 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:49:20.828994 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-01e0d1bb-fc04-4f20-a023-f296e86a4f99 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c786bbedc21849ea92924139a44707b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcafb05f6f554e278cd552023947c6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:20.845562 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-01e0d1bb-fc04-4f20-a023-f296e86a4f99 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579" status: 200 len: 1736 microversion: 2.1 time: 1.235272 Sep 23 04:49:20.858272 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2080/4076] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:49:19 2022] GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579 => generated 1736 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:49:20.869694 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9a4f4e40-3831-4de4-a93c-7f22837572fc tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:20.889037 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-9a4f4e40-3831-4de4-a93c-7f22837572fc tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:20.911207 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9a4f4e40-3831-4de4-a93c-7f22837572fc tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:20.918723 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9a4f4e40-3831-4de4-a93c-7f22837572fc tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:20.919367 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9a4f4e40-3831-4de4-a93c-7f22837572fc tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:20.920293 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9a4f4e40-3831-4de4-a93c-7f22837572fc tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:20.922428 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9a4f4e40-3831-4de4-a93c-7f22837572fc tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:20.925657 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9a4f4e40-3831-4de4-a93c-7f22837572fc tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:21.593814 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-13ac3965-4474-4fe4-83be-bbaf2ecf7ef3 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:21.611559 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-13ac3965-4474-4fe4-83be-bbaf2ecf7ef3 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1683 microversion: 2.1 time: 1.515497 Sep 23 04:49:21.617745 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1997/4077] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:49:20 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1683 bytes in 1531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:49:21.632072 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-67628b2f-aca6-4442-91b6-2a170b3557ca tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:21.632715 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-67628b2f-aca6-4442-91b6-2a170b3557ca tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: fe7dee09-8351-4d41-8c44-8d35a966cce9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:21.669276 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-67628b2f-aca6-4442-91b6-2a170b3557ca tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:21.669783 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-67628b2f-aca6-4442-91b6-2a170b3557ca tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:21.672831 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-67628b2f-aca6-4442-91b6-2a170b3557ca tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:21.674927 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-67628b2f-aca6-4442-91b6-2a170b3557ca tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:21.677100 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-67628b2f-aca6-4442-91b6-2a170b3557ca tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:21.678776 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-67628b2f-aca6-4442-91b6-2a170b3557ca tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:21.863182 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-9a4f4e40-3831-4de4-a93c-7f22837572fc tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:21.876905 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-9a4f4e40-3831-4de4-a93c-7f22837572fc tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1315 microversion: 2.1 time: 1.017322 Sep 23 04:49:21.898286 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2081/4078] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:49:20 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1315 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:49:21.903313 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-16927c6e-3c52-4ee8-ba8c-831591321de7 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:21.903933 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-16927c6e-3c52-4ee8-ba8c-831591321de7 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: c4464422-9bf1-4aaa-806c-d7063e284579] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:21.920350 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-16927c6e-3c52-4ee8-ba8c-831591321de7 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:21.920350 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-16927c6e-3c52-4ee8-ba8c-831591321de7 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:21.920350 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-16927c6e-3c52-4ee8-ba8c-831591321de7 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:21.920350 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-16927c6e-3c52-4ee8-ba8c-831591321de7 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:21.920350 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-16927c6e-3c52-4ee8-ba8c-831591321de7 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:21.920350 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-16927c6e-3c52-4ee8-ba8c-831591321de7 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:22.326941 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-16927c6e-3c52-4ee8-ba8c-831591321de7 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c786bbedc21849ea92924139a44707b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcafb05f6f554e278cd552023947c6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:22.349583 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-16927c6e-3c52-4ee8-ba8c-831591321de7 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579" status: 200 len: 1736 microversion: 2.1 time: 0.449959 Sep 23 04:49:22.350877 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2082/4079] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:49:21 2022] GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579 => generated 1736 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:49:22.372380 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-861f6513-00ca-4426-bbd8-374e3a89c9d7 req-e00b5719-bb17-4ac9-9750-be8025147efc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9f2ff08-c66d-4991-9bae-d523a3adb8bf", "tag": "5cac1937-93f1-4537-9d14-be0ca8715d11"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:49:22.386256 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-67628b2f-aca6-4442-91b6-2a170b3557ca tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:22.398111 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=30 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:49:22.415278 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-861f6513-00ca-4426-bbd8-374e3a89c9d7 req-e00b5719-bb17-4ac9-9750-be8025147efc service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:22.415278 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-861f6513-00ca-4426-bbd8-374e3a89c9d7 req-e00b5719-bb17-4ac9-9750-be8025147efc service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:22.415278 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-861f6513-00ca-4426-bbd8-374e3a89c9d7 req-e00b5719-bb17-4ac9-9750-be8025147efc service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:22.445724 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-67628b2f-aca6-4442-91b6-2a170b3557ca tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:22.449554 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=100 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:49:22.456739 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-67628b2f-aca6-4442-91b6-2a170b3557ca tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:22.459212 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-861f6513-00ca-4426-bbd8-374e3a89c9d7 req-e00b5719-bb17-4ac9-9750-be8025147efc service nova] Creating event network-changed:5cac1937-93f1-4537-9d14-be0ca8715d11 for instance a9f2ff08-c66d-4991-9bae-d523a3adb8bf on n-h1-846463-3 Sep 23 04:49:22.463491 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-67628b2f-aca6-4442-91b6-2a170b3557ca tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9" status: 200 len: 1809 microversion: 2.20 time: 0.847796 Sep 23 04:49:22.478731 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1998/4080] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:49:21 2022] GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9 => generated 1809 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:49:22.490601 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-861f6513-00ca-4426-bbd8-374e3a89c9d7 req-e00b5719-bb17-4ac9-9750-be8025147efc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130949 Sep 23 04:49:22.495683 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2083/4081] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:49:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:49:22.657123 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4a929974-cb5b-4f9c-8af7-37c5ee582a57 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:22.658614 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4a929974-cb5b-4f9c-8af7-37c5ee582a57 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:22.683118 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4a929974-cb5b-4f9c-8af7-37c5ee582a57 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:22.684789 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4a929974-cb5b-4f9c-8af7-37c5ee582a57 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:22.686050 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4a929974-cb5b-4f9c-8af7-37c5ee582a57 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:22.691570 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4a929974-cb5b-4f9c-8af7-37c5ee582a57 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:22.691570 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4a929974-cb5b-4f9c-8af7-37c5ee582a57 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:22.691570 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4a929974-cb5b-4f9c-8af7-37c5ee582a57 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:22.791380 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:49:22.913524 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5b816884-b2e2-4d3b-b500-2a1d4e1ab2a5 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:22.915611 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-5b816884-b2e2-4d3b-b500-2a1d4e1ab2a5 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:22.923363 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5b816884-b2e2-4d3b-b500-2a1d4e1ab2a5 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:22.924078 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5b816884-b2e2-4d3b-b500-2a1d4e1ab2a5 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:22.924860 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5b816884-b2e2-4d3b-b500-2a1d4e1ab2a5 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:22.934084 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5b816884-b2e2-4d3b-b500-2a1d4e1ab2a5 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:22.934894 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5b816884-b2e2-4d3b-b500-2a1d4e1ab2a5 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:22.935485 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5b816884-b2e2-4d3b-b500-2a1d4e1ab2a5 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:23.263557 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4a929974-cb5b-4f9c-8af7-37c5ee582a57 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:23.288758 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4a929974-cb5b-4f9c-8af7-37c5ee582a57 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1683 microversion: 2.1 time: 0.645628 Sep 23 04:49:23.307598 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 1999/4082] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:49:22 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1683 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:49:23.391042 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-84640554-0671-41b7-8c3c-5d000308828a tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:23.391042 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-84640554-0671-41b7-8c3c-5d000308828a tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: c4464422-9bf1-4aaa-806c-d7063e284579] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:23.409702 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-84640554-0671-41b7-8c3c-5d000308828a tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:23.410630 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-84640554-0671-41b7-8c3c-5d000308828a tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:23.411537 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-84640554-0671-41b7-8c3c-5d000308828a tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:23.414765 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-84640554-0671-41b7-8c3c-5d000308828a tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:23.415642 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-84640554-0671-41b7-8c3c-5d000308828a tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:23.416551 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-84640554-0671-41b7-8c3c-5d000308828a tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:23.503337 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-5b816884-b2e2-4d3b-b500-2a1d4e1ab2a5 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:23.517704 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5b816884-b2e2-4d3b-b500-2a1d4e1ab2a5 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1315 microversion: 2.1 time: 0.610383 Sep 23 04:49:23.522836 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2084/4083] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:49:22 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1315 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:49:23.543526 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8b32c297-be55-4db5-b634-fed4955a8ce9 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:23.546830 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-8b32c297-be55-4db5-b634-fed4955a8ce9 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: fe7dee09-8351-4d41-8c44-8d35a966cce9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:23.574307 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:DELETE=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:49:23.584274 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8b32c297-be55-4db5-b634-fed4955a8ce9 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:23.587783 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8b32c297-be55-4db5-b634-fed4955a8ce9 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:23.590897 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8b32c297-be55-4db5-b634-fed4955a8ce9 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:23.596145 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8b32c297-be55-4db5-b634-fed4955a8ce9 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:23.597108 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8b32c297-be55-4db5-b634-fed4955a8ce9 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:23.601612 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8b32c297-be55-4db5-b634-fed4955a8ce9 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:23.821815 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-84640554-0671-41b7-8c3c-5d000308828a tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c786bbedc21849ea92924139a44707b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcafb05f6f554e278cd552023947c6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:23.836489 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-84640554-0671-41b7-8c3c-5d000308828a tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579" status: 200 len: 1736 microversion: 2.1 time: 0.464255 Sep 23 04:49:23.852435 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2000/4084] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:49:23 2022] GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579 => generated 1736 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:49:24.066997 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-8b32c297-be55-4db5-b634-fed4955a8ce9 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:24.078015 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-8b32c297-be55-4db5-b634-fed4955a8ce9 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:24.084621 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-8b32c297-be55-4db5-b634-fed4955a8ce9 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:24.090670 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-8b32c297-be55-4db5-b634-fed4955a8ce9 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9" status: 200 len: 1809 microversion: 2.20 time: 0.566494 Sep 23 04:49:24.108761 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2085/4085] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:49:23 2022] GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9 => generated 1809 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:49:24.320878 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5546f434-aa5d-47d0-a730-8813a9948edf tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:24.321404 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5546f434-aa5d-47d0-a730-8813a9948edf tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:24.344416 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5546f434-aa5d-47d0-a730-8813a9948edf tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:24.345159 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5546f434-aa5d-47d0-a730-8813a9948edf tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:24.345758 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5546f434-aa5d-47d0-a730-8813a9948edf tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:24.347272 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5546f434-aa5d-47d0-a730-8813a9948edf tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:24.347272 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5546f434-aa5d-47d0-a730-8813a9948edf tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:24.348156 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5546f434-aa5d-47d0-a730-8813a9948edf tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:24.551565 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-cad641fe-4259-4487-bd6b-dc3b9344dd8d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:24.555908 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-cad641fe-4259-4487-bd6b-dc3b9344dd8d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:24.587373 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cad641fe-4259-4487-bd6b-dc3b9344dd8d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:24.592511 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cad641fe-4259-4487-bd6b-dc3b9344dd8d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:24.603201 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cad641fe-4259-4487-bd6b-dc3b9344dd8d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:24.603201 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cad641fe-4259-4487-bd6b-dc3b9344dd8d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:24.603201 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cad641fe-4259-4487-bd6b-dc3b9344dd8d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:24.603201 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cad641fe-4259-4487-bd6b-dc3b9344dd8d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:24.990879 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=20 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:49:25.137540 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-5546f434-aa5d-47d0-a730-8813a9948edf tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:25.165881 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5546f434-aa5d-47d0-a730-8813a9948edf tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1683 microversion: 2.1 time: 0.848572 Sep 23 04:49:25.170176 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2001/4086] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:49:24 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1683 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:49:25.201970 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-16dcbc8b-fbd9-4ebc-8497-51bb71360650 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:25.221631 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-16dcbc8b-fbd9-4ebc-8497-51bb71360650 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: c4464422-9bf1-4aaa-806c-d7063e284579] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:25.255350 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-16dcbc8b-fbd9-4ebc-8497-51bb71360650 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:25.256425 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-16dcbc8b-fbd9-4ebc-8497-51bb71360650 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:25.260683 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-16dcbc8b-fbd9-4ebc-8497-51bb71360650 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:25.266909 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-16dcbc8b-fbd9-4ebc-8497-51bb71360650 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:25.267825 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-16dcbc8b-fbd9-4ebc-8497-51bb71360650 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:25.270696 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-16dcbc8b-fbd9-4ebc-8497-51bb71360650 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:25.574427 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-cad641fe-4259-4487-bd6b-dc3b9344dd8d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:25.585445 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-cad641fe-4259-4487-bd6b-dc3b9344dd8d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1315 microversion: 2.1 time: 1.043989 Sep 23 04:49:25.594425 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2086/4087] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:49:24 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1315 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:49:25.603002 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c32ff519-fe20-4d11-b34d-06c4a4d27412 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:25.608215 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c32ff519-fe20-4d11-b34d-06c4a4d27412 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: fe7dee09-8351-4d41-8c44-8d35a966cce9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:25.624658 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c32ff519-fe20-4d11-b34d-06c4a4d27412 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:25.631464 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c32ff519-fe20-4d11-b34d-06c4a4d27412 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:25.634234 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c32ff519-fe20-4d11-b34d-06c4a4d27412 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:25.639290 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c32ff519-fe20-4d11-b34d-06c4a4d27412 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:25.643565 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c32ff519-fe20-4d11-b34d-06c4a4d27412 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:25.643565 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c32ff519-fe20-4d11-b34d-06c4a4d27412 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:26.071531 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-16dcbc8b-fbd9-4ebc-8497-51bb71360650 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c786bbedc21849ea92924139a44707b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcafb05f6f554e278cd552023947c6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:26.082516 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-16dcbc8b-fbd9-4ebc-8497-51bb71360650 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579" status: 200 len: 1736 microversion: 2.1 time: 0.911132 Sep 23 04:49:26.105371 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2002/4088] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:49:25 2022] GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579 => generated 1736 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:49:26.117499 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-bd491516-1bb6-4b53-8b95-10482fcfe435 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-710089546", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "d4354f97-7a62-481d-ac06-b2b2a50f2542"}], "security_groups": [{"name": "tempest-securitygroup--1404391953"}], "key_name": "tempest-keypair-1226867454", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:49:26.215474 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c32ff519-fe20-4d11-b34d-06c4a4d27412 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:26.233390 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c32ff519-fe20-4d11-b34d-06c4a4d27412 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:26.235590 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c32ff519-fe20-4d11-b34d-06c4a4d27412 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:26.240465 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c32ff519-fe20-4d11-b34d-06c4a4d27412 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9" status: 200 len: 1809 microversion: 2.20 time: 0.643611 Sep 23 04:49:26.256676 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2087/4089] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:49:25 2022] GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9 => generated 1809 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:49:26.281442 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-18627d69-1b06-4651-869e-f21b45faa932 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:26.291437 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-18627d69-1b06-4651-869e-f21b45faa932 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:26.298475 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-18627d69-1b06-4651-869e-f21b45faa932 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:26.300572 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-18627d69-1b06-4651-869e-f21b45faa932 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:26.301295 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-18627d69-1b06-4651-869e-f21b45faa932 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:26.302822 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-18627d69-1b06-4651-869e-f21b45faa932 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:26.304767 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-18627d69-1b06-4651-869e-f21b45faa932 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:26.305412 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-18627d69-1b06-4651-869e-f21b45faa932 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:26.767547 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-18627d69-1b06-4651-869e-f21b45faa932 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:26.798799 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-18627d69-1b06-4651-869e-f21b45faa932 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1683 microversion: 2.1 time: 0.522254 Sep 23 04:49:26.798799 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2088/4090] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:49:26 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1683 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:49:26.815231 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d7dfdb50-0e72-40e9-ac1f-40f6f5c37ced tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:26.817631 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d7dfdb50-0e72-40e9-ac1f-40f6f5c37ced tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:26.830983 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d7dfdb50-0e72-40e9-ac1f-40f6f5c37ced tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:26.835937 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d7dfdb50-0e72-40e9-ac1f-40f6f5c37ced tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:26.835937 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d7dfdb50-0e72-40e9-ac1f-40f6f5c37ced tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:26.835937 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d7dfdb50-0e72-40e9-ac1f-40f6f5c37ced tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:26.842211 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d7dfdb50-0e72-40e9-ac1f-40f6f5c37ced tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:26.843315 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d7dfdb50-0e72-40e9-ac1f-40f6f5c37ced tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:27.887068 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d7dfdb50-0e72-40e9-ac1f-40f6f5c37ced tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:27.895249 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d7dfdb50-0e72-40e9-ac1f-40f6f5c37ced tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1315 microversion: 2.1 time: 1.092830 Sep 23 04:49:27.895855 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2089/4091] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:49:26 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1315 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:49:27.926379 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-977c9868-5cb3-422e-a4b8-acfb5a29449c tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:27.934104 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-977c9868-5cb3-422e-a4b8-acfb5a29449c tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: c4464422-9bf1-4aaa-806c-d7063e284579] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:27.944688 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-977c9868-5cb3-422e-a4b8-acfb5a29449c tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:27.948305 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-977c9868-5cb3-422e-a4b8-acfb5a29449c tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:27.951972 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-977c9868-5cb3-422e-a4b8-acfb5a29449c tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:27.953123 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-977c9868-5cb3-422e-a4b8-acfb5a29449c tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:27.954587 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-977c9868-5cb3-422e-a4b8-acfb5a29449c tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:27.957770 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-977c9868-5cb3-422e-a4b8-acfb5a29449c tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:28.233039 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-977c9868-5cb3-422e-a4b8-acfb5a29449c tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c786bbedc21849ea92924139a44707b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcafb05f6f554e278cd552023947c6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:28.243412 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-977c9868-5cb3-422e-a4b8-acfb5a29449c tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579" status: 200 len: 1736 microversion: 2.1 time: 0.346467 Sep 23 04:49:28.244083 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2090/4092] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:49:27 2022] GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579 => generated 1736 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:49:28.248974 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f17a0b6b-4239-497c-a37d-e3c7983f8894 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:28.254121 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f17a0b6b-4239-497c-a37d-e3c7983f8894 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: fe7dee09-8351-4d41-8c44-8d35a966cce9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:28.261998 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f17a0b6b-4239-497c-a37d-e3c7983f8894 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:28.262811 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f17a0b6b-4239-497c-a37d-e3c7983f8894 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:28.263487 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f17a0b6b-4239-497c-a37d-e3c7983f8894 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:28.264432 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f17a0b6b-4239-497c-a37d-e3c7983f8894 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:28.265111 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f17a0b6b-4239-497c-a37d-e3c7983f8894 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:28.265754 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f17a0b6b-4239-497c-a37d-e3c7983f8894 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:28.728041 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f17a0b6b-4239-497c-a37d-e3c7983f8894 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:28.748073 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f17a0b6b-4239-497c-a37d-e3c7983f8894 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:28.753135 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f17a0b6b-4239-497c-a37d-e3c7983f8894 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:28.754976 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f17a0b6b-4239-497c-a37d-e3c7983f8894 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9" status: 200 len: 1809 microversion: 2.20 time: 0.509783 Sep 23 04:49:28.777566 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2091/4093] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:49:28 2022] GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9 => generated 1809 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:49:28.791074 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-131b6fab-76d2-4184-a22d-ba366a7c3efb tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:28.791866 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-131b6fab-76d2-4184-a22d-ba366a7c3efb tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:28.799583 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-131b6fab-76d2-4184-a22d-ba366a7c3efb tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:28.800313 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-131b6fab-76d2-4184-a22d-ba366a7c3efb tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:28.800937 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-131b6fab-76d2-4184-a22d-ba366a7c3efb tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:28.801814 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-131b6fab-76d2-4184-a22d-ba366a7c3efb tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:28.802995 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-131b6fab-76d2-4184-a22d-ba366a7c3efb tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:28.803576 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-131b6fab-76d2-4184-a22d-ba366a7c3efb tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:29.240702 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-131b6fab-76d2-4184-a22d-ba366a7c3efb tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:29.284279 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-131b6fab-76d2-4184-a22d-ba366a7c3efb tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1683 microversion: 2.1 time: 0.501963 Sep 23 04:49:29.287294 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2092/4094] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:49:28 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1683 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:49:29.330767 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d207d495-7060-41f6-9947-396d86368b0f tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:29.339697 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d207d495-7060-41f6-9947-396d86368b0f tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:29.355105 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d207d495-7060-41f6-9947-396d86368b0f tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:29.355630 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d207d495-7060-41f6-9947-396d86368b0f tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:29.358298 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d207d495-7060-41f6-9947-396d86368b0f tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:29.362515 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d207d495-7060-41f6-9947-396d86368b0f tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:29.369909 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d207d495-7060-41f6-9947-396d86368b0f tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:29.370509 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d207d495-7060-41f6-9947-396d86368b0f tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:29.774600 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d207d495-7060-41f6-9947-396d86368b0f tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:29.786375 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d207d495-7060-41f6-9947-396d86368b0f tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1315 microversion: 2.1 time: 0.482628 Sep 23 04:49:29.789744 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2093/4095] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:49:29 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1315 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:49:29.800687 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1c8eaa41-5108-4a15-a8a0-f27c5d82dddb tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:29.806140 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1c8eaa41-5108-4a15-a8a0-f27c5d82dddb tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: c4464422-9bf1-4aaa-806c-d7063e284579] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:29.821603 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1c8eaa41-5108-4a15-a8a0-f27c5d82dddb tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:29.823003 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1c8eaa41-5108-4a15-a8a0-f27c5d82dddb tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:29.823003 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1c8eaa41-5108-4a15-a8a0-f27c5d82dddb tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:29.827301 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1c8eaa41-5108-4a15-a8a0-f27c5d82dddb tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:29.828822 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1c8eaa41-5108-4a15-a8a0-f27c5d82dddb tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:29.829433 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1c8eaa41-5108-4a15-a8a0-f27c5d82dddb tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:30.174423 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1c8eaa41-5108-4a15-a8a0-f27c5d82dddb tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c786bbedc21849ea92924139a44707b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcafb05f6f554e278cd552023947c6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:30.188696 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1c8eaa41-5108-4a15-a8a0-f27c5d82dddb tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579" status: 200 len: 1736 microversion: 2.1 time: 0.397595 Sep 23 04:49:30.196419 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2094/4096] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:49:29 2022] GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579 => generated 1736 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:49:30.209587 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-11d22d9f-0fcf-4470-9cca-e9cda1d87bce tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:30.210313 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-11d22d9f-0fcf-4470-9cca-e9cda1d87bce tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: fe7dee09-8351-4d41-8c44-8d35a966cce9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:30.224961 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-11d22d9f-0fcf-4470-9cca-e9cda1d87bce tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:30.228010 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-11d22d9f-0fcf-4470-9cca-e9cda1d87bce tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:30.228666 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-11d22d9f-0fcf-4470-9cca-e9cda1d87bce tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:30.229575 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-11d22d9f-0fcf-4470-9cca-e9cda1d87bce tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:30.230973 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-11d22d9f-0fcf-4470-9cca-e9cda1d87bce tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:30.235439 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-11d22d9f-0fcf-4470-9cca-e9cda1d87bce tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:30.633572 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-11d22d9f-0fcf-4470-9cca-e9cda1d87bce tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:30.656987 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-11d22d9f-0fcf-4470-9cca-e9cda1d87bce tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:30.658747 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-11d22d9f-0fcf-4470-9cca-e9cda1d87bce tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:30.660631 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-11d22d9f-0fcf-4470-9cca-e9cda1d87bce tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9" status: 200 len: 1809 microversion: 2.20 time: 0.462343 Sep 23 04:49:30.661413 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2095/4097] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:49:30 2022] GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9 => generated 1809 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:49:30.680767 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7c23d89f-3525-49f2-be2b-1dfe969287db tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:30.681395 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-7c23d89f-3525-49f2-be2b-1dfe969287db tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:30.703106 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7c23d89f-3525-49f2-be2b-1dfe969287db tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:30.709644 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7c23d89f-3525-49f2-be2b-1dfe969287db tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:30.710699 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7c23d89f-3525-49f2-be2b-1dfe969287db tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:30.711462 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7c23d89f-3525-49f2-be2b-1dfe969287db tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:30.711950 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7c23d89f-3525-49f2-be2b-1dfe969287db tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:30.712417 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7c23d89f-3525-49f2-be2b-1dfe969287db tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:31.209366 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-7c23d89f-3525-49f2-be2b-1dfe969287db tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:31.221284 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-7c23d89f-3525-49f2-be2b-1dfe969287db tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1683 microversion: 2.1 time: 0.551804 Sep 23 04:49:31.223419 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2096/4098] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:49:30 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1683 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:49:31.256369 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-32122636-ec21-4129-9d5e-bdd4e3c0f190 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:31.257350 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-32122636-ec21-4129-9d5e-bdd4e3c0f190 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:31.270985 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-32122636-ec21-4129-9d5e-bdd4e3c0f190 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:31.271865 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-32122636-ec21-4129-9d5e-bdd4e3c0f190 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:31.276280 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-32122636-ec21-4129-9d5e-bdd4e3c0f190 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:31.277304 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-32122636-ec21-4129-9d5e-bdd4e3c0f190 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:31.278028 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-32122636-ec21-4129-9d5e-bdd4e3c0f190 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:31.278726 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-32122636-ec21-4129-9d5e-bdd4e3c0f190 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:31.546326 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-32122636-ec21-4129-9d5e-bdd4e3c0f190 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:31.561451 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-32122636-ec21-4129-9d5e-bdd4e3c0f190 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1315 microversion: 2.1 time: 0.335334 Sep 23 04:49:31.564180 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2097/4099] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:49:31 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1315 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:49:31.586705 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ba8ced47-fc12-47cd-8d72-ebd13d37ed23 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:31.587675 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ba8ced47-fc12-47cd-8d72-ebd13d37ed23 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: c4464422-9bf1-4aaa-806c-d7063e284579] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:31.596758 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ba8ced47-fc12-47cd-8d72-ebd13d37ed23 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:31.598186 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ba8ced47-fc12-47cd-8d72-ebd13d37ed23 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:31.600397 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ba8ced47-fc12-47cd-8d72-ebd13d37ed23 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:31.601356 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ba8ced47-fc12-47cd-8d72-ebd13d37ed23 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:31.602003 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ba8ced47-fc12-47cd-8d72-ebd13d37ed23 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:31.602738 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ba8ced47-fc12-47cd-8d72-ebd13d37ed23 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:31.982262 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ba8ced47-fc12-47cd-8d72-ebd13d37ed23 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c786bbedc21849ea92924139a44707b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcafb05f6f554e278cd552023947c6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:31.998037 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ba8ced47-fc12-47cd-8d72-ebd13d37ed23 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579" status: 200 len: 1736 microversion: 2.1 time: 0.413553 Sep 23 04:49:31.998037 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2098/4100] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:49:31 2022] GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579 => generated 1736 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:49:32.016015 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-99df97be-2fa6-4d7b-9990-cfdaf3e77b7f tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:32.018873 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-99df97be-2fa6-4d7b-9990-cfdaf3e77b7f tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: fe7dee09-8351-4d41-8c44-8d35a966cce9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:32.047194 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-99df97be-2fa6-4d7b-9990-cfdaf3e77b7f tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:32.049080 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-99df97be-2fa6-4d7b-9990-cfdaf3e77b7f tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:32.051447 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-99df97be-2fa6-4d7b-9990-cfdaf3e77b7f tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:32.060634 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-99df97be-2fa6-4d7b-9990-cfdaf3e77b7f tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:32.061217 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-99df97be-2fa6-4d7b-9990-cfdaf3e77b7f tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:32.061878 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-99df97be-2fa6-4d7b-9990-cfdaf3e77b7f tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:32.493964 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-99df97be-2fa6-4d7b-9990-cfdaf3e77b7f tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:32.524991 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-99df97be-2fa6-4d7b-9990-cfdaf3e77b7f tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:32.530918 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-99df97be-2fa6-4d7b-9990-cfdaf3e77b7f tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:32.533276 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-99df97be-2fa6-4d7b-9990-cfdaf3e77b7f tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9" status: 200 len: 1809 microversion: 2.20 time: 0.535934 Sep 23 04:49:32.536062 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2099/4101] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:49:31 2022] GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9 => generated 1809 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:49:32.551628 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-bb2e3199-0ccc-4fe9-b28c-56ee4ecf1b86 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:32.553758 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-bb2e3199-0ccc-4fe9-b28c-56ee4ecf1b86 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:32.577901 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bb2e3199-0ccc-4fe9-b28c-56ee4ecf1b86 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:32.580404 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bb2e3199-0ccc-4fe9-b28c-56ee4ecf1b86 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:32.581401 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bb2e3199-0ccc-4fe9-b28c-56ee4ecf1b86 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:32.585541 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bb2e3199-0ccc-4fe9-b28c-56ee4ecf1b86 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:32.587842 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bb2e3199-0ccc-4fe9-b28c-56ee4ecf1b86 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:32.588756 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bb2e3199-0ccc-4fe9-b28c-56ee4ecf1b86 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:32.627008 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=100 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:49:32.810979 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-bb2e3199-0ccc-4fe9-b28c-56ee4ecf1b86 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:32.820335 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-bb2e3199-0ccc-4fe9-b28c-56ee4ecf1b86 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1683 microversion: 2.1 time: 0.278215 Sep 23 04:49:32.824219 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2100/4102] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:49:32 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1683 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:49:32.834279 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1e95a66f-01f0-49df-ac23-65b677beaaa8 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:32.838563 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1e95a66f-01f0-49df-ac23-65b677beaaa8 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:32.850227 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e95a66f-01f0-49df-ac23-65b677beaaa8 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:32.857259 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e95a66f-01f0-49df-ac23-65b677beaaa8 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:32.857966 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e95a66f-01f0-49df-ac23-65b677beaaa8 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:32.859068 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e95a66f-01f0-49df-ac23-65b677beaaa8 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:32.864339 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e95a66f-01f0-49df-ac23-65b677beaaa8 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:32.865301 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e95a66f-01f0-49df-ac23-65b677beaaa8 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:33.226248 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1e95a66f-01f0-49df-ac23-65b677beaaa8 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:33.254675 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1e95a66f-01f0-49df-ac23-65b677beaaa8 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1315 microversion: 2.1 time: 0.428636 Sep 23 04:49:33.257638 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2101/4103] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:49:32 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1315 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:49:33.266567 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8c5e63cb-48ae-4175-9343-0c34b3352bf7 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:33.267893 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-8c5e63cb-48ae-4175-9343-0c34b3352bf7 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: c4464422-9bf1-4aaa-806c-d7063e284579] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:33.284567 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8c5e63cb-48ae-4175-9343-0c34b3352bf7 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:33.285520 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8c5e63cb-48ae-4175-9343-0c34b3352bf7 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:33.286202 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8c5e63cb-48ae-4175-9343-0c34b3352bf7 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:33.293017 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8c5e63cb-48ae-4175-9343-0c34b3352bf7 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:33.293017 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8c5e63cb-48ae-4175-9343-0c34b3352bf7 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:33.293017 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8c5e63cb-48ae-4175-9343-0c34b3352bf7 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:33.517424 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-8c5e63cb-48ae-4175-9343-0c34b3352bf7 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c786bbedc21849ea92924139a44707b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcafb05f6f554e278cd552023947c6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:33.535014 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-8c5e63cb-48ae-4175-9343-0c34b3352bf7 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579" status: 200 len: 1736 microversion: 2.1 time: 0.275379 Sep 23 04:49:33.537827 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2102/4104] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:49:33 2022] GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579 => generated 1736 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:49:33.547914 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-8780310b-d0e2-4cef-bbef-b03ddd583b2c req-0587487a-4060-4374-aa8c-e0ee472a17c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9f2ff08-c66d-4991-9bae-d523a3adb8bf", "name": "network-vif-plugged", "status": "completed", "tag": "5cac1937-93f1-4537-9d14-be0ca8715d11"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:49:33.583731 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-8780310b-d0e2-4cef-bbef-b03ddd583b2c req-0587487a-4060-4374-aa8c-e0ee472a17c9 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:33.589152 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-8780310b-d0e2-4cef-bbef-b03ddd583b2c req-0587487a-4060-4374-aa8c-e0ee472a17c9 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:33.589152 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-8780310b-d0e2-4cef-bbef-b03ddd583b2c req-0587487a-4060-4374-aa8c-e0ee472a17c9 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:33.620565 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-8780310b-d0e2-4cef-bbef-b03ddd583b2c req-0587487a-4060-4374-aa8c-e0ee472a17c9 service nova] Creating event network-vif-plugged:5cac1937-93f1-4537-9d14-be0ca8715d11 for instance a9f2ff08-c66d-4991-9bae-d523a3adb8bf on n-h1-846463-3 Sep 23 04:49:33.637747 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-8780310b-d0e2-4cef-bbef-b03ddd583b2c req-0587487a-4060-4374-aa8c-e0ee472a17c9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095842 Sep 23 04:49:33.641989 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2103/4105] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:49:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:49:33.657664 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-16d6d129-3540-4845-bf0f-1adee3c8fed9 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:33.660152 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-16d6d129-3540-4845-bf0f-1adee3c8fed9 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: fe7dee09-8351-4d41-8c44-8d35a966cce9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:33.678266 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-16d6d129-3540-4845-bf0f-1adee3c8fed9 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:33.686762 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-16d6d129-3540-4845-bf0f-1adee3c8fed9 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:33.686762 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-16d6d129-3540-4845-bf0f-1adee3c8fed9 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:33.686762 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-16d6d129-3540-4845-bf0f-1adee3c8fed9 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:33.688903 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-16d6d129-3540-4845-bf0f-1adee3c8fed9 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:33.690286 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-16d6d129-3540-4845-bf0f-1adee3c8fed9 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:34.003972 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-16d6d129-3540-4845-bf0f-1adee3c8fed9 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:34.020052 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-16d6d129-3540-4845-bf0f-1adee3c8fed9 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:34.022727 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-16d6d129-3540-4845-bf0f-1adee3c8fed9 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:34.024341 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-16d6d129-3540-4845-bf0f-1adee3c8fed9 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9" status: 200 len: 1809 microversion: 2.20 time: 0.381085 Sep 23 04:49:34.025612 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2104/4106] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:49:33 2022] GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9 => generated 1809 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:49:34.032840 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4a3ae73f-5216-41b4-ad14-222147c871da tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:34.034330 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4a3ae73f-5216-41b4-ad14-222147c871da tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:34.044237 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4a3ae73f-5216-41b4-ad14-222147c871da tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:34.045361 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4a3ae73f-5216-41b4-ad14-222147c871da tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:34.046608 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4a3ae73f-5216-41b4-ad14-222147c871da tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:34.047704 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4a3ae73f-5216-41b4-ad14-222147c871da tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:34.048373 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4a3ae73f-5216-41b4-ad14-222147c871da tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:34.049063 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4a3ae73f-5216-41b4-ad14-222147c871da tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:34.354704 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-4a3ae73f-5216-41b4-ad14-222147c871da tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:34.369492 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4a3ae73f-5216-41b4-ad14-222147c871da tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1683 microversion: 2.1 time: 0.337322 Sep 23 04:49:34.371131 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2105/4107] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:49:34 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1683 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:49:34.384989 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9884acec-fecd-49e4-a8f2-9edea9a1b3c9 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:34.390709 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-9884acec-fecd-49e4-a8f2-9edea9a1b3c9 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:34.414710 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9884acec-fecd-49e4-a8f2-9edea9a1b3c9 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:34.418956 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9884acec-fecd-49e4-a8f2-9edea9a1b3c9 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:34.420473 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9884acec-fecd-49e4-a8f2-9edea9a1b3c9 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:34.425694 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9884acec-fecd-49e4-a8f2-9edea9a1b3c9 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:34.428713 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9884acec-fecd-49e4-a8f2-9edea9a1b3c9 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:34.429514 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9884acec-fecd-49e4-a8f2-9edea9a1b3c9 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:34.739323 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-9884acec-fecd-49e4-a8f2-9edea9a1b3c9 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:34.754121 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-9884acec-fecd-49e4-a8f2-9edea9a1b3c9 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1315 microversion: 2.1 time: 0.381420 Sep 23 04:49:34.755756 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2106/4108] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:49:34 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1315 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:49:35.108817 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-783ec432-91a4-4d5d-bfb7-bbb8a1d73196 tempest-KeyPairsNegativeTestJSON-709574751 tempest-KeyPairsNegativeTestJSON-709574751-project] Action: 'create', calling method: .version_select at 0x7ff1ba8d1310>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJw5zgO0H0s4ch9cGgi6LY4yqHUWBRQrouccWjlSYi7K+3RrwqpKHqxX3NvYqtciJ/QZAaySq0TiPJ4PU6T8CbBm1rAiOIILGk3iz5DKEZnIE0OIv2KR/gxW1XEOmcYfGA=="}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:49:35.129059 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-783ec432-91a4-4d5d-bfb7-bbb8a1d73196 tempest-KeyPairsNegativeTestJSON-709574751 tempest-KeyPairsNegativeTestJSON-709574751-project] Request method failure captured: Sep 23 04:49:35.129059 n-d-846463-3 devstack@n-api.service[122699]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 23 04:49:35.129059 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:49:35.129059 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:49:35.129059 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:49:35.129059 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 257 Sep 23 04:49:35.129059 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:49:35.129059 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:49:35.129059 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:49:35.129059 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:49:35.129059 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTrea4iyE1ngG3jF2E2NT0xouaLuEYYorQR0BHfMNZLDinLK74Lu7auOjkoYH5_Dfc0ONb6uD5KbdU8jzqC-Mhw-V5p0DZ0kDJmEQhxy6CFbkuCwGwIafk_R5gTq0WngtQ1L1SKfMZWj5EMFSY11i8okhpnTRCRouiNMteFw5VDAVuQ Sep 23 04:49:35.129059 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:49:35.129059 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:49:35.129059 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:49:35.129059 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:49:35.129059 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:49:35.129059 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:49:35.129059 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: c3f30086a4c54c7b99b99f9ff2dc896c Sep 23 04:49:35.129059 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-709574751 Sep 23 04:49:35.129059 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:49:35.129059 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:49:35.129059 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c3f30086a4c54c7b99b99f9ff2dc896c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c3f30086a4c54c7b99b99f9ff2dc896c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c3f30086a4c54c7b99b99f9ff2dc896c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c3f30086a4c54c7b99b99f9ff2dc896c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:49:35.129059 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-KeyPairsNegativeTestJSON-709574751 Sep 23 04:49:35.129059 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: c3f30086a4c54c7b99b99f9ff2dc896c Sep 23 04:49:35.129059 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-709574751 Sep 23 04:49:35.129059 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-KeyPairsNegativeTestJSON-709574751-project Sep 23 04:49:35.129059 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:49:35.129059 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:49:35.129059 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 08654906b90c4b5eb9085c46f9b4eeac Sep 23 04:49:35.129059 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-KeyPairsNegativeTestJSON-709574751-project Sep 23 04:49:35.129059 n-d-846463-3 devstack@n-api.service[122699]: Sep 23 04:49:35.129059 n-d-846463-3 devstack@n-api.service[122699]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJw5zgO0H0s4ch9cGgi6LY4yqHUWBRQrouccWjlSYi7K+3RrwqpKHqxX3NvYqtciJ/QZAaySq0TiPJ4PU6T8CbBm1rAiOIILGk3iz5DKEZnIE0OIv2KR/gxW1XEOmcYfGA=="}} Sep 23 04:49:35.129059 n-d-846463-3 devstack@n-api.service[122699]: method: Sep 23 04:49:35.129059 n-d-846463-3 devstack@n-api.service[122699]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Sep 23 04:49:35.129059 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJw5zgO0H0s4ch9cGgi6LY4yqHUWBRQrouccWjlSYi7K+3RrwqpKHqxX3NvYqtciJ/QZAaySq0TiPJ4PU6T8CbBm1rAiOIILGk3iz5DKEZnIE0OIv2KR/gxW1XEOmcYfGA=='}}} Sep 23 04:49:35.129059 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:49:35.129059 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:49:35.129059 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Sep 23 04:49:35.129059 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi result = func(instance) Sep 23 04:49:35.129059 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Sep 23 04:49:35.129059 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Sep 23 04:49:35.129059 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Sep 23 04:49:35.129059 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Sep 23 04:49:35.129059 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Sep 23 04:49:35.129059 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:49:35.129059 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 23 04:49:35.129059 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:49:35.129059 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:49:35.129059 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 23 04:49:35.129059 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 23 04:49:35.129059 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 23 04:49:35.129059 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise error Sep 23 04:49:35.129059 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Sep 23 04:49:35.129059 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:49:35.129059 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Sep 23 04:49:35.129059 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Sep 23 04:49:35.129059 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Sep 23 04:49:35.129059 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi 'minLength': 1, Sep 23 04:49:35.129059 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi 'type': 'string'} Sep 23 04:49:35.129059 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:49:35.129059 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Sep 23 04:49:35.129059 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Sep 23 04:49:35.129059 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:49:35.133509 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:49:35.133509 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:49:35.133509 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:49:35.133509 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:49:35.133509 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:49:35.133509 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:49:35.133509 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:49:35.133509 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:49:35.133509 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:49:35.133509 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:49:35.133509 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:49:35.133509 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:49:35.133509 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:49:35.133509 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 23 04:49:35.133509 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 23 04:49:35.133509 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 23 04:49:35.133509 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 23 04:49:35.133509 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 23 04:49:35.133509 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 23 04:49:35.133509 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Sep 23 04:49:35.133509 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:49:35.133509 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:49:35.133509 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:49:35.133509 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:49:35.133509 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:49:35.133509 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:49:35.133509 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 23 04:49:35.133509 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 23 04:49:35.133509 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Sep 23 04:49:35.133509 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:49:35.133509 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-783ec432-91a4-4d5d-bfb7-bbb8a1d73196 tempest-KeyPairsNegativeTestJSON-709574751 tempest-KeyPairsNegativeTestJSON-709574751-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:49:35.133509 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-783ec432-91a4-4d5d-bfb7-bbb8a1d73196 tempest-KeyPairsNegativeTestJSON-709574751 tempest-KeyPairsNegativeTestJSON-709574751-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.374589 Sep 23 04:49:35.133509 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2107/4109] 10.222.0.33 () {60 vars in 1159 bytes} [Fri Sep 23 04:49:34 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 376 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 04:49:35.139170 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4473a7ce-e373-4a70-b8cb-1cf7deed7b5e tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:35.139704 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4473a7ce-e373-4a70-b8cb-1cf7deed7b5e tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: c4464422-9bf1-4aaa-806c-d7063e284579] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:35.151884 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4473a7ce-e373-4a70-b8cb-1cf7deed7b5e tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:35.153793 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4473a7ce-e373-4a70-b8cb-1cf7deed7b5e tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:35.160845 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4473a7ce-e373-4a70-b8cb-1cf7deed7b5e tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:35.160845 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4473a7ce-e373-4a70-b8cb-1cf7deed7b5e tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:35.160845 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4473a7ce-e373-4a70-b8cb-1cf7deed7b5e tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:35.160845 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4473a7ce-e373-4a70-b8cb-1cf7deed7b5e tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:35.495179 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-4473a7ce-e373-4a70-b8cb-1cf7deed7b5e tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c786bbedc21849ea92924139a44707b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcafb05f6f554e278cd552023947c6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:35.510609 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4473a7ce-e373-4a70-b8cb-1cf7deed7b5e tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579" status: 200 len: 1736 microversion: 2.1 time: 0.377056 Sep 23 04:49:35.511648 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2108/4110] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:49:35 2022] GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579 => generated 1736 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:49:35.516998 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2839c063-965a-44be-b22f-3dbb40b1ee03 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:35.517682 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-2839c063-965a-44be-b22f-3dbb40b1ee03 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: fe7dee09-8351-4d41-8c44-8d35a966cce9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:35.534974 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2839c063-965a-44be-b22f-3dbb40b1ee03 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:35.534974 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2839c063-965a-44be-b22f-3dbb40b1ee03 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:35.534974 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2839c063-965a-44be-b22f-3dbb40b1ee03 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:35.536381 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2839c063-965a-44be-b22f-3dbb40b1ee03 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:35.537039 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2839c063-965a-44be-b22f-3dbb40b1ee03 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:35.537476 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2839c063-965a-44be-b22f-3dbb40b1ee03 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:35.771537 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2839c063-965a-44be-b22f-3dbb40b1ee03 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:35.781726 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2839c063-965a-44be-b22f-3dbb40b1ee03 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:35.784458 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2839c063-965a-44be-b22f-3dbb40b1ee03 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:35.790684 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2839c063-965a-44be-b22f-3dbb40b1ee03 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9" status: 200 len: 1809 microversion: 2.20 time: 0.273306 Sep 23 04:49:35.790684 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2109/4111] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:49:35 2022] GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9 => generated 1809 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:49:35.799910 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b5a405ca-c21b-4da6-b210-3924004476d7 tempest-KeyPairsNegativeTestJSON-709574751 tempest-KeyPairsNegativeTestJSON-709574751-project] Action: 'create', calling method: .version_select at 0x7ff1ba8ca310>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1203716119", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:49:35.821591 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-b5a405ca-c21b-4da6-b210-3924004476d7 tempest-KeyPairsNegativeTestJSON-709574751 tempest-KeyPairsNegativeTestJSON-709574751-project] Getting quotas for project c3f30086a4c54c7b99b99f9ff2dc896c. Resources: {'key_pairs'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:49:35.831525 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-b5a405ca-c21b-4da6-b210-3924004476d7 tempest-KeyPairsNegativeTestJSON-709574751 tempest-KeyPairsNegativeTestJSON-709574751-project] Getting quotas for user 08654906b90c4b5eb9085c46f9b4eeac and project c3f30086a4c54c7b99b99f9ff2dc896c. Resources: {'key_pairs'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:49:35.940663 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-b5a405ca-c21b-4da6-b210-3924004476d7 tempest-KeyPairsNegativeTestJSON-709574751 tempest-KeyPairsNegativeTestJSON-709574751-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Sep 23 04:49:35.980766 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b5a405ca-c21b-4da6-b210-3924004476d7 tempest-KeyPairsNegativeTestJSON-709574751 tempest-KeyPairsNegativeTestJSON-709574751-project] Request method failure captured: Sep 23 04:49:35.980766 n-d-846463-3 devstack@n-api.service[122699]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 23 04:49:35.980766 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:49:35.980766 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:49:35.980766 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:49:35.980766 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 2167 Sep 23 04:49:35.980766 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:49:35.980766 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:49:35.980766 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:49:35.980766 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:49:35.980766 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTrea4iyE1ngG3jF2E2NT0xouaLuEYYorQR0BHfMNZLDinLK74Lu7auOjkoYH5_Dfc0ONb6uD5KbdU8jzqC-Mhw-V5p0DZ0kDJmEQhxy6CFbkuCwGwIafk_R5gTq0WngtQ1L1SKfMZWj5EMFSY11i8okhpnTRCRouiNMteFw5VDAVuQ Sep 23 04:49:35.980766 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:49:35.980766 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:49:35.980766 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:49:35.980766 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:49:35.980766 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:49:35.980766 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:49:35.980766 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: c3f30086a4c54c7b99b99f9ff2dc896c Sep 23 04:49:35.980766 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-709574751 Sep 23 04:49:35.980766 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:49:35.980766 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:49:35.980766 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c3f30086a4c54c7b99b99f9ff2dc896c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c3f30086a4c54c7b99b99f9ff2dc896c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c3f30086a4c54c7b99b99f9ff2dc896c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c3f30086a4c54c7b99b99f9ff2dc896c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:49:35.980766 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-KeyPairsNegativeTestJSON-709574751 Sep 23 04:49:35.980766 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: c3f30086a4c54c7b99b99f9ff2dc896c Sep 23 04:49:35.980766 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-709574751 Sep 23 04:49:35.980766 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-KeyPairsNegativeTestJSON-709574751-project Sep 23 04:49:35.980766 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:49:35.980766 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:49:35.980766 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 08654906b90c4b5eb9085c46f9b4eeac Sep 23 04:49:35.980766 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-KeyPairsNegativeTestJSON-709574751-project Sep 23 04:49:35.980766 n-d-846463-3 devstack@n-api.service[122699]: Sep 23 04:49:35.980766 n-d-846463-3 devstack@n-api.service[122699]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1203716119", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Sep 23 04:49:35.980766 n-d-846463-3 devstack@n-api.service[122699]: method: Sep 23 04:49:35.980766 n-d-846463-3 devstack@n-api.service[122699]: exception: Keypair data is invalid: failed to generate fingerprint Sep 23 04:49:35.984172 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1203716119', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Sep 23 04:49:35.984172 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:49:35.984172 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:49:35.984172 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Sep 23 04:49:35.984172 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Sep 23 04:49:35.984172 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Sep 23 04:49:35.984172 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Sep 23 04:49:35.984172 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Sep 23 04:49:35.984172 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:49:35.984172 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:49:35.984172 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:49:35.984172 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:49:35.984172 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Sep 23 04:49:35.984172 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Sep 23 04:49:35.984172 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 23 04:49:35.984172 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 23 04:49:35.984172 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 23 04:49:35.984172 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 23 04:49:35.984172 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 23 04:49:35.984172 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise self.value Sep 23 04:49:35.984172 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 23 04:49:35.984172 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 23 04:49:35.984172 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Sep 23 04:49:35.984172 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Sep 23 04:49:35.984172 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Sep 23 04:49:35.984172 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Sep 23 04:49:35.984172 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Sep 23 04:49:35.984172 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Sep 23 04:49:35.984172 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Sep 23 04:49:35.984172 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:49:35.984172 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:49:35.984172 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:49:35.984172 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:49:35.984172 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:49:35.984172 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:49:35.984172 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:49:35.984172 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:49:35.984172 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:49:35.984172 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:49:35.984172 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:49:35.984172 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:49:35.986389 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:49:35.986389 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:49:35.986389 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:49:35.986389 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:49:35.986389 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Sep 23 04:49:35.986389 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self._create(req, body) Sep 23 04:49:35.986389 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Sep 23 04:49:35.986389 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Sep 23 04:49:35.986389 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Sep 23 04:49:35.986389 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:49:35.986389 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:49:35.986389 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:49:35.986389 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:49:35.986389 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:49:35.986389 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:49:35.986389 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:49:35.986389 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:49:35.986389 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Sep 23 04:49:35.986389 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:49:35.986389 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b5a405ca-c21b-4da6-b210-3924004476d7 tempest-KeyPairsNegativeTestJSON-709574751 tempest-KeyPairsNegativeTestJSON-709574751-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:49:35.986389 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b5a405ca-c21b-4da6-b210-3924004476d7 tempest-KeyPairsNegativeTestJSON-709574751 tempest-KeyPairsNegativeTestJSON-709574751-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.194689 Sep 23 04:49:35.990397 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2110/4112] 10.222.0.33 () {60 vars in 1160 bytes} [Fri Sep 23 04:49:35 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 203 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 23 04:49:35.996180 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-850c5034-055e-4673-88d7-70f6606929c3 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:35.996823 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-850c5034-055e-4673-88d7-70f6606929c3 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:36.015400 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-850c5034-055e-4673-88d7-70f6606929c3 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:36.015909 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-850c5034-055e-4673-88d7-70f6606929c3 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:36.016365 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-850c5034-055e-4673-88d7-70f6606929c3 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:36.017092 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-850c5034-055e-4673-88d7-70f6606929c3 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:36.017562 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-850c5034-055e-4673-88d7-70f6606929c3 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:36.018032 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-850c5034-055e-4673-88d7-70f6606929c3 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:36.077653 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=20 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:49:36.124536 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.network.neutron [None req-bd491516-1bb6-4b53-8b95-10482fcfe435 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] validate_networks() for [('d4354f97-7a62-481d-ac06-b2b2a50f2542', None, None, None, None, None)] {{(pid=122698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:49:36.145735 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:49:36.565689 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-850c5034-055e-4673-88d7-70f6606929c3 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:36.575986 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-850c5034-055e-4673-88d7-70f6606929c3 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1683 microversion: 2.1 time: 0.584331 Sep 23 04:49:36.577284 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2111/4113] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:49:35 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1683 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:49:36.593513 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b29c075b-f3f1-4dc1-affb-c602a4f96e21 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:36.595703 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b29c075b-f3f1-4dc1-affb-c602a4f96e21 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:36.612324 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b29c075b-f3f1-4dc1-affb-c602a4f96e21 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:36.614158 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b29c075b-f3f1-4dc1-affb-c602a4f96e21 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:36.620994 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b29c075b-f3f1-4dc1-affb-c602a4f96e21 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:36.627360 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b29c075b-f3f1-4dc1-affb-c602a4f96e21 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:36.628117 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b29c075b-f3f1-4dc1-affb-c602a4f96e21 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:36.632295 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b29c075b-f3f1-4dc1-affb-c602a4f96e21 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:37.312539 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b29c075b-f3f1-4dc1-affb-c602a4f96e21 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:37.328889 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b29c075b-f3f1-4dc1-affb-c602a4f96e21 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1503 microversion: 2.1 time: 0.750155 Sep 23 04:49:37.333998 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2112/4114] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:49:36 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1503 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:49:37.364159 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b172e2d6-5bfe-46d1-a162-2bd6337a7be0 tempest-KeyPairsNegativeTestJSON-709574751 tempest-KeyPairsNegativeTestJSON-709574751-project] Action: 'create', calling method: .version_select at 0x7ff1ba9499d0>, body: {"keypair": {"name": "tempest-keypair-2052622406", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSLDnbrr6il734EaJ17YRgIzYOO9guIwsfpe3ZqDdDrEYr2Ypsze4cpHbrjKZI/3rpf+7nGxh46wSB4pLmanCSUQY2LCxFbe4+G3wBQU4DBFlkAN2+E28FLQ+lpaxeeLA=="}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:49:37.424030 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-b172e2d6-5bfe-46d1-a162-2bd6337a7be0 tempest-KeyPairsNegativeTestJSON-709574751 tempest-KeyPairsNegativeTestJSON-709574751-project] Getting quotas for project c3f30086a4c54c7b99b99f9ff2dc896c. Resources: {'key_pairs'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:49:37.440006 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-b172e2d6-5bfe-46d1-a162-2bd6337a7be0 tempest-KeyPairsNegativeTestJSON-709574751 tempest-KeyPairsNegativeTestJSON-709574751-project] Getting quotas for user 08654906b90c4b5eb9085c46f9b4eeac and project c3f30086a4c54c7b99b99f9ff2dc896c. Resources: {'key_pairs'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:49:37.530775 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b172e2d6-5bfe-46d1-a162-2bd6337a7be0 tempest-KeyPairsNegativeTestJSON-709574751 tempest-KeyPairsNegativeTestJSON-709574751-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.193494 Sep 23 04:49:37.532154 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2113/4115] 10.222.0.33 () {60 vars in 1159 bytes} [Fri Sep 23 04:49:37 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:49:37.539639 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-984b1a98-5c18-4254-ab78-a2a9a7c6e018 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:37.540509 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-984b1a98-5c18-4254-ab78-a2a9a7c6e018 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: c4464422-9bf1-4aaa-806c-d7063e284579] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:37.548050 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-984b1a98-5c18-4254-ab78-a2a9a7c6e018 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:37.548715 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-984b1a98-5c18-4254-ab78-a2a9a7c6e018 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:37.549506 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-984b1a98-5c18-4254-ab78-a2a9a7c6e018 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:37.550315 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-984b1a98-5c18-4254-ab78-a2a9a7c6e018 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:37.550870 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-984b1a98-5c18-4254-ab78-a2a9a7c6e018 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:37.551341 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-984b1a98-5c18-4254-ab78-a2a9a7c6e018 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:37.894865 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-bd491516-1bb6-4b53-8b95-10482fcfe435 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Getting quotas for project dbaa3a17b8a24f8087a5748f83d377e7. Resources: dict_keys(['metadata_items']) {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:49:37.917869 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-bd491516-1bb6-4b53-8b95-10482fcfe435 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Getting quotas for user 8d728817c4f74e579eab88b62f73d08b and project dbaa3a17b8a24f8087a5748f83d377e7. Resources: dict_keys(['metadata_items']) {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:49:37.962191 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-bd491516-1bb6-4b53-8b95-10482fcfe435 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Flavor limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:49:37.963338 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-bd491516-1bb6-4b53-8b95-10482fcfe435 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Image limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:49:37.964367 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-bd491516-1bb6-4b53-8b95-10482fcfe435 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Flavor pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:49:37.965596 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-bd491516-1bb6-4b53-8b95-10482fcfe435 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Image pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:49:37.966220 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-bd491516-1bb6-4b53-8b95-10482fcfe435 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:49:37.967071 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-984b1a98-5c18-4254-ab78-a2a9a7c6e018 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c786bbedc21849ea92924139a44707b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcafb05f6f554e278cd552023947c6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:37.981994 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bd491516-1bb6-4b53-8b95-10482fcfe435 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:37.982775 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bd491516-1bb6-4b53-8b95-10482fcfe435 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:37.983483 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-984b1a98-5c18-4254-ab78-a2a9a7c6e018 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579" status: 200 len: 1736 microversion: 2.1 time: 0.449901 Sep 23 04:49:37.984123 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bd491516-1bb6-4b53-8b95-10482fcfe435 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:37.989614 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2114/4116] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:49:37 2022] GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579 => generated 1736 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:49:37.995794 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bd491516-1bb6-4b53-8b95-10482fcfe435 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:37.996554 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bd491516-1bb6-4b53-8b95-10482fcfe435 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:37.997633 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bd491516-1bb6-4b53-8b95-10482fcfe435 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:38.018070 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9aa46b6a-0faa-4071-8a4b-3ea70a86cf50 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:38.018886 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-9aa46b6a-0faa-4071-8a4b-3ea70a86cf50 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: fe7dee09-8351-4d41-8c44-8d35a966cce9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:38.032078 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9aa46b6a-0faa-4071-8a4b-3ea70a86cf50 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:38.032776 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9aa46b6a-0faa-4071-8a4b-3ea70a86cf50 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:38.033584 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9aa46b6a-0faa-4071-8a4b-3ea70a86cf50 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:38.035189 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9aa46b6a-0faa-4071-8a4b-3ea70a86cf50 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:38.037501 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9aa46b6a-0faa-4071-8a4b-3ea70a86cf50 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:38.046080 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9aa46b6a-0faa-4071-8a4b-3ea70a86cf50 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:38.057629 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-bd491516-1bb6-4b53-8b95-10482fcfe435 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Getting quotas for project dbaa3a17b8a24f8087a5748f83d377e7. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:49:38.072229 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-bd491516-1bb6-4b53-8b95-10482fcfe435 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Getting quotas for user 8d728817c4f74e579eab88b62f73d08b and project dbaa3a17b8a24f8087a5748f83d377e7. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:49:38.109025 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-bd491516-1bb6-4b53-8b95-10482fcfe435 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Going to run 1 instances... {{(pid=122698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:49:38.116924 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-bd491516-1bb6-4b53-8b95-10482fcfe435 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] [instance: e6610a41-bbef-4646-80f3-82446c38bbf5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:49:38.288186 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-9aa46b6a-0faa-4071-8a4b-3ea70a86cf50 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:38.300579 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-bd491516-1bb6-4b53-8b95-10482fcfe435 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 12.193443 Sep 23 04:49:38.309603 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2003/4117] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:49:26 2022] POST /compute/v2.1/servers => generated 407 bytes in 12203 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:49:38.312567 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-9aa46b6a-0faa-4071-8a4b-3ea70a86cf50 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:38.314147 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-9aa46b6a-0faa-4071-8a4b-3ea70a86cf50 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:38.316460 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-9aa46b6a-0faa-4071-8a4b-3ea70a86cf50 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9" status: 200 len: 1809 microversion: 2.20 time: 0.330718 Sep 23 04:49:38.317974 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2115/4118] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:49:37 2022] GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9 => generated 1809 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:49:38.322320 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b36a50d1-eadd-4908-ba38-6f0fddcc194e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-64833143", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "networks": [{"uuid": "eaa0cbf4-9a92-44f9-ac8d-d8f60e6441c0"}]}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:49:38.323430 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a7ddf6f6-a7c3-418d-a8e4-cbccaae27c7e tempest-KeyPairsNegativeTestJSON-709574751 tempest-KeyPairsNegativeTestJSON-709574751-project] Action: 'create', calling method: .version_select at 0x7ff1ba8c6550>, body: {"keypair": {"name": "tempest-keypair-2052622406", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKYOtlNpA9jE3GR/2sgPcy1TFrXI1qqhu/+rpvaUzOFDk8arSzE0xdYj0WWcK6kguIqqpayx4SbavoDAvJ+tphjfgH+35A6+a7/Ae17hgfb3LRzFfqvwDZVzjDx9K9nIfg=="}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:49:38.384624 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-a7ddf6f6-a7c3-418d-a8e4-cbccaae27c7e tempest-KeyPairsNegativeTestJSON-709574751 tempest-KeyPairsNegativeTestJSON-709574751-project] Getting quotas for project c3f30086a4c54c7b99b99f9ff2dc896c. Resources: {'key_pairs'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:49:38.399158 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-a7ddf6f6-a7c3-418d-a8e4-cbccaae27c7e tempest-KeyPairsNegativeTestJSON-709574751 tempest-KeyPairsNegativeTestJSON-709574751-project] Getting quotas for user 08654906b90c4b5eb9085c46f9b4eeac and project c3f30086a4c54c7b99b99f9ff2dc896c. Resources: {'key_pairs'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:49:38.476921 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.network.neutron [None req-b36a50d1-eadd-4908-ba38-6f0fddcc194e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] validate_networks() for [('eaa0cbf4-9a92-44f9-ac8d-d8f60e6441c0', None, None, None, None, None)] {{(pid=122698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:49:38.504265 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-a7ddf6f6-a7c3-418d-a8e4-cbccaae27c7e tempest-KeyPairsNegativeTestJSON-709574751 tempest-KeyPairsNegativeTestJSON-709574751-project] HTTP exception thrown: Key pair 'tempest-keypair-2052622406' already exists. Sep 23 04:49:38.519249 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a7ddf6f6-a7c3-418d-a8e4-cbccaae27c7e tempest-KeyPairsNegativeTestJSON-709574751 tempest-KeyPairsNegativeTestJSON-709574751-project] Request method failure captured: Sep 23 04:49:38.519249 n-d-846463-3 devstack@n-api.service[122699]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 23 04:49:38.519249 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:49:38.519249 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:49:38.519249 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:49:38.519249 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 273 Sep 23 04:49:38.519249 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:49:38.519249 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:49:38.519249 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:49:38.519249 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:49:38.519249 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTrea4iyE1ngG3jF2E2NT0xouaLuEYYorQR0BHfMNZLDinLK74Lu7auOjkoYH5_Dfc0ONb6uD5KbdU8jzqC-Mhw-V5p0DZ0kDJmEQhxy6CFbkuCwGwIafk_R5gTq0WngtQ1L1SKfMZWj5EMFSY11i8okhpnTRCRouiNMteFw5VDAVuQ Sep 23 04:49:38.519249 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:49:38.519249 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:49:38.519249 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:49:38.519249 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:49:38.519249 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:49:38.519249 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:49:38.519249 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: c3f30086a4c54c7b99b99f9ff2dc896c Sep 23 04:49:38.519249 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-709574751 Sep 23 04:49:38.519249 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:49:38.519249 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:49:38.519249 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c3f30086a4c54c7b99b99f9ff2dc896c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c3f30086a4c54c7b99b99f9ff2dc896c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c3f30086a4c54c7b99b99f9ff2dc896c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c3f30086a4c54c7b99b99f9ff2dc896c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:49:38.519249 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-KeyPairsNegativeTestJSON-709574751 Sep 23 04:49:38.519249 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: c3f30086a4c54c7b99b99f9ff2dc896c Sep 23 04:49:38.519249 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-709574751 Sep 23 04:49:38.519249 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-KeyPairsNegativeTestJSON-709574751-project Sep 23 04:49:38.519249 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:49:38.519249 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:49:38.519249 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 08654906b90c4b5eb9085c46f9b4eeac Sep 23 04:49:38.519249 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-KeyPairsNegativeTestJSON-709574751-project Sep 23 04:49:38.519249 n-d-846463-3 devstack@n-api.service[122699]: Sep 23 04:49:38.519249 n-d-846463-3 devstack@n-api.service[122699]: {"keypair": {"name": "tempest-keypair-2052622406", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKYOtlNpA9jE3GR/2sgPcy1TFrXI1qqhu/+rpvaUzOFDk8arSzE0xdYj0WWcK6kguIqqpayx4SbavoDAvJ+tphjfgH+35A6+a7/Ae17hgfb3LRzFfqvwDZVzjDx9K9nIfg=="}} Sep 23 04:49:38.519249 n-d-846463-3 devstack@n-api.service[122699]: method: Sep 23 04:49:38.519249 n-d-846463-3 devstack@n-api.service[122699]: exception: Key pair 'tempest-keypair-2052622406' already exists. Sep 23 04:49:38.519249 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-2052622406', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKYOtlNpA9jE3GR/2sgPcy1TFrXI1qqhu/+rpvaUzOFDk8arSzE0xdYj0WWcK6kguIqqpayx4SbavoDAvJ+tphjfgH+35A6+a7/Ae17hgfb3LRzFfqvwDZVzjDx9K9nIfg=='}}} Sep 23 04:49:38.519249 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:49:38.519249 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:49:38.519249 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 23 04:49:38.519249 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 23 04:49:38.519249 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 23 04:49:38.519249 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 23 04:49:38.519249 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 23 04:49:38.519249 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 23 04:49:38.519249 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 23 04:49:38.519249 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 23 04:49:38.519249 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 23 04:49:38.519249 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 23 04:49:38.519249 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 23 04:49:38.519249 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi result.read() Sep 23 04:49:38.519249 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 23 04:49:38.519249 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 23 04:49:38.519249 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 23 04:49:38.519249 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 23 04:49:38.519249 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 23 04:49:38.519249 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 23 04:49:38.519249 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 23 04:49:38.519249 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 23 04:49:38.519249 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '08654906b90c4b5eb9085c46f9b4eeac-tempest-keypair-2052622406' for key 'key_pairs.uniq_key_pairs0user_id0name'") Sep 23 04:49:38.519249 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:49:38.528272 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 23 04:49:38.528272 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:49:38.528272 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:49:38.528272 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Sep 23 04:49:38.528272 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi kp.save(context.session) Sep 23 04:49:38.528272 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Sep 23 04:49:38.528272 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi session.flush() Sep 23 04:49:38.528272 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 23 04:49:38.528272 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self._flush(objects) Sep 23 04:49:38.528272 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 23 04:49:38.528272 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Sep 23 04:49:38.528272 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 23 04:49:38.528272 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi compat.raise_( Sep 23 04:49:38.528272 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 23 04:49:38.528272 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception Sep 23 04:49:38.528272 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 23 04:49:38.528272 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi flush_context.execute() Sep 23 04:49:38.528272 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 23 04:49:38.528272 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi rec.execute(self) Sep 23 04:49:38.528272 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 23 04:49:38.528272 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Sep 23 04:49:38.528272 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 23 04:49:38.528272 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Sep 23 04:49:38.528272 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 23 04:49:38.528272 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Sep 23 04:49:38.528272 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 23 04:49:38.528272 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Sep 23 04:49:38.528272 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 23 04:49:38.528272 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Sep 23 04:49:38.528272 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 23 04:49:38.528272 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Sep 23 04:49:38.528272 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 23 04:49:38.528272 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Sep 23 04:49:38.528272 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 23 04:49:38.528272 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 23 04:49:38.528272 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 23 04:49:38.528272 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception Sep 23 04:49:38.528272 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 23 04:49:38.528272 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 23 04:49:38.528272 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 23 04:49:38.528272 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 23 04:49:38.528272 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 23 04:49:38.528272 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 23 04:49:38.528272 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 23 04:49:38.528272 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 23 04:49:38.528272 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 23 04:49:38.528272 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 23 04:49:38.528272 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 23 04:49:38.528272 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi result.read() Sep 23 04:49:38.528272 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 23 04:49:38.528272 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 23 04:49:38.528272 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 23 04:49:38.528272 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 23 04:49:38.528272 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 23 04:49:38.528272 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 23 04:49:38.528272 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 23 04:49:38.531718 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 23 04:49:38.531718 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '08654906b90c4b5eb9085c46f9b4eeac-tempest-keypair-2052622406' for key 'key_pairs.uniq_key_pairs0user_id0name'") Sep 23 04:49:38.531718 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Sep 23 04:49:38.531718 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 9, 23, 4, 49, 38, 440040), 'updated_at': None, 'name': 'tempest-keypair-2052622406', 'user_id': '08654906b90c4b5eb9085c46f9b4eeac', 'fingerprint': 'ce:84:5c:36:85:c3:1c:37:2b:87:65:12:7e:ad:d6:14', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKYOtlNpA9jE3GR/2sgPcy1TFrXI1qqhu/+rpvaUzOFDk8arSzE0xdYj0WWcK6kguIqqpayx4SbavoDAvJ+tphjfgH+35A6+a7/Ae17hgfb3LRzFfqvwDZVzjDx9K9nIfg==', 'type': 'ssh'}] Sep 23 04:49:38.531718 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 23 04:49:38.531718 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:49:38.531718 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:49:38.531718 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:49:38.531718 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:49:38.531718 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Sep 23 04:49:38.531718 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Sep 23 04:49:38.531718 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 23 04:49:38.531718 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 23 04:49:38.531718 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 23 04:49:38.531718 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 23 04:49:38.531718 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 23 04:49:38.531718 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise self.value Sep 23 04:49:38.531718 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 23 04:49:38.531718 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 23 04:49:38.531718 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Sep 23 04:49:38.531718 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi keypair.create() Sep 23 04:49:38.531718 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 23 04:49:38.531718 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 23 04:49:38.531718 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Sep 23 04:49:38.531718 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self._create() Sep 23 04:49:38.531718 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Sep 23 04:49:38.531718 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Sep 23 04:49:38.531718 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Sep 23 04:49:38.531718 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Sep 23 04:49:38.531718 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 23 04:49:38.531718 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 23 04:49:38.531718 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Sep 23 04:49:38.531718 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Sep 23 04:49:38.531718 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-2052622406' already exists. Sep 23 04:49:38.531718 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:49:38.531718 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:49:38.531718 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:49:38.531718 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:49:38.531718 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:49:38.531718 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:49:38.531718 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:49:38.531718 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:49:38.531718 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:49:38.531718 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:49:38.531718 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:49:38.531718 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:49:38.531718 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:49:38.531718 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:49:38.531718 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:49:38.531718 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:49:38.531718 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Sep 23 04:49:38.531718 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self._create(req, body) Sep 23 04:49:38.531718 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Sep 23 04:49:38.531718 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Sep 23 04:49:38.531718 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-2052622406' already exists. Sep 23 04:49:38.535911 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:49:38.535911 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:49:38.535911 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:49:38.535911 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:49:38.535911 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:49:38.535911 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:49:38.535911 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:49:38.535911 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:49:38.535911 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-2052622406' already exists. Sep 23 04:49:38.535911 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:49:38.535911 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a7ddf6f6-a7c3-418d-a8e4-cbccaae27c7e tempest-KeyPairsNegativeTestJSON-709574751 tempest-KeyPairsNegativeTestJSON-709574751-project] Returning 409 to user: Key pair 'tempest-keypair-2052622406' already exists. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:49:38.535911 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a7ddf6f6-a7c3-418d-a8e4-cbccaae27c7e tempest-KeyPairsNegativeTestJSON-709574751 tempest-KeyPairsNegativeTestJSON-709574751-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 409 len: 105 microversion: 2.1 time: 0.205030 Sep 23 04:49:38.535911 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2116/4119] 10.222.0.33 () {60 vars in 1159 bytes} [Fri Sep 23 04:49:38 2022] POST /compute/v2.1/os-keypairs => generated 105 bytes in 207 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 23 04:49:38.539276 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b08e7ec8-2d8a-43e6-88b3-c292a37e1ba3 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:38.541139 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b08e7ec8-2d8a-43e6-88b3-c292a37e1ba3 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:38.568497 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b08e7ec8-2d8a-43e6-88b3-c292a37e1ba3 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:38.569086 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b08e7ec8-2d8a-43e6-88b3-c292a37e1ba3 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:38.576102 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b08e7ec8-2d8a-43e6-88b3-c292a37e1ba3 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:38.578152 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b08e7ec8-2d8a-43e6-88b3-c292a37e1ba3 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:38.582002 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b08e7ec8-2d8a-43e6-88b3-c292a37e1ba3 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:38.582864 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b08e7ec8-2d8a-43e6-88b3-c292a37e1ba3 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:39.081177 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b08e7ec8-2d8a-43e6-88b3-c292a37e1ba3 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:39.094176 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b08e7ec8-2d8a-43e6-88b3-c292a37e1ba3 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1670 microversion: 2.1 time: 0.565178 Sep 23 04:49:39.094959 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2117/4120] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:49:38 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1670 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:49:39.112929 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e50681a0-593a-49a2-b509-275113ed7fbc tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:39.114912 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e50681a0-593a-49a2-b509-275113ed7fbc tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] [instance: e6610a41-bbef-4646-80f3-82446c38bbf5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:39.201840 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e50681a0-593a-49a2-b509-275113ed7fbc tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d728817c4f74e579eab88b62f73d08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaa3a17b8a24f8087a5748f83d377e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:39.211349 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e50681a0-593a-49a2-b509-275113ed7fbc tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] 10.222.0.33 "GET /compute/v2.1/servers/e6610a41-bbef-4646-80f3-82446c38bbf5" status: 200 len: 1269 microversion: 2.1 time: 0.115050 Sep 23 04:49:39.216263 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2118/4121] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:49:39 2022] GET /compute/v2.1/servers/e6610a41-bbef-4646-80f3-82446c38bbf5 => generated 1269 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:49:39.226568 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b533340b-bcd8-43b6-85c5-fe12e936fce2 tempest-KeyPairsNegativeTestJSON-709574751 tempest-KeyPairsNegativeTestJSON-709574751-project] Calling method '.version_select at 0x7ff1ba94dd30>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:39.274934 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-b36a50d1-eadd-4908-ba38-6f0fddcc194e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Flavor limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:49:39.275988 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-b36a50d1-eadd-4908-ba38-6f0fddcc194e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Image limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:49:39.276895 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-b36a50d1-eadd-4908-ba38-6f0fddcc194e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Flavor pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:49:39.278730 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-b36a50d1-eadd-4908-ba38-6f0fddcc194e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Image pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:49:39.279729 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-b36a50d1-eadd-4908-ba38-6f0fddcc194e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:49:39.290428 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b36a50d1-eadd-4908-ba38-6f0fddcc194e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:39.291078 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b36a50d1-eadd-4908-ba38-6f0fddcc194e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:39.291747 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b36a50d1-eadd-4908-ba38-6f0fddcc194e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:39.292695 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b36a50d1-eadd-4908-ba38-6f0fddcc194e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:39.293464 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b36a50d1-eadd-4908-ba38-6f0fddcc194e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:39.294324 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b36a50d1-eadd-4908-ba38-6f0fddcc194e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:39.318962 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-b36a50d1-eadd-4908-ba38-6f0fddcc194e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Getting quotas for project 78dca47156ff4f19a8673b893c853978. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:49:39.324705 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-b36a50d1-eadd-4908-ba38-6f0fddcc194e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Getting quotas for user c912fb9d1f5447d180a9e8568220526f and project 78dca47156ff4f19a8673b893c853978. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:49:39.339191 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b36a50d1-eadd-4908-ba38-6f0fddcc194e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Going to run 1 instances... {{(pid=122698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:49:39.341655 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b36a50d1-eadd-4908-ba38-6f0fddcc194e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: 9d5576c0-2aa8-4ca0-aed6-22c1f0700755] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:49:39.368815 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b533340b-bcd8-43b6-85c5-fe12e936fce2 tempest-KeyPairsNegativeTestJSON-709574751 tempest-KeyPairsNegativeTestJSON-709574751-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2052622406" status: 202 len: 0 microversion: 2.1 time: 0.151030 Sep 23 04:49:39.369945 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2119/4122] 10.222.0.33 () {58 vars in 1221 bytes} [Fri Sep 23 04:49:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2052622406 => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:49:39.374988 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-33e0e99f-58da-47cd-a662-46dde5b5913f tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:39.376368 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-33e0e99f-58da-47cd-a662-46dde5b5913f tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: c4464422-9bf1-4aaa-806c-d7063e284579] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:39.389743 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:49:39.391493 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-33e0e99f-58da-47cd-a662-46dde5b5913f tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:39.393200 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-33e0e99f-58da-47cd-a662-46dde5b5913f tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:39.394844 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-33e0e99f-58da-47cd-a662-46dde5b5913f tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:39.395861 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-33e0e99f-58da-47cd-a662-46dde5b5913f tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:39.396761 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-33e0e99f-58da-47cd-a662-46dde5b5913f tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:39.397502 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-33e0e99f-58da-47cd-a662-46dde5b5913f tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:39.558360 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b36a50d1-eadd-4908-ba38-6f0fddcc194e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.247350 Sep 23 04:49:39.566610 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2004/4123] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:49:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1256 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:49:39.584695 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a185e98e-82e4-4308-9b16-81601ab1a9b2 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:39.586866 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-33e0e99f-58da-47cd-a662-46dde5b5913f tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c786bbedc21849ea92924139a44707b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcafb05f6f554e278cd552023947c6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:39.590994 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a185e98e-82e4-4308-9b16-81601ab1a9b2 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:39.606074 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a185e98e-82e4-4308-9b16-81601ab1a9b2 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:39.606186 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a185e98e-82e4-4308-9b16-81601ab1a9b2 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:39.606600 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a185e98e-82e4-4308-9b16-81601ab1a9b2 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:39.610423 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a185e98e-82e4-4308-9b16-81601ab1a9b2 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:39.611737 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a185e98e-82e4-4308-9b16-81601ab1a9b2 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:39.616107 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a185e98e-82e4-4308-9b16-81601ab1a9b2 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:39.619036 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-33e0e99f-58da-47cd-a662-46dde5b5913f tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579" status: 200 len: 1736 microversion: 2.1 time: 0.247524 Sep 23 04:49:39.620070 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2120/4124] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:49:39 2022] GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579 => generated 1736 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:49:39.625720 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-372d0c30-1053-4f72-b25c-edbf5190cb89 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:39.626518 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-372d0c30-1053-4f72-b25c-edbf5190cb89 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: fe7dee09-8351-4d41-8c44-8d35a966cce9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:39.645299 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-372d0c30-1053-4f72-b25c-edbf5190cb89 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:39.645836 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-372d0c30-1053-4f72-b25c-edbf5190cb89 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:39.646495 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-372d0c30-1053-4f72-b25c-edbf5190cb89 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:39.647212 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-372d0c30-1053-4f72-b25c-edbf5190cb89 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:39.647673 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-372d0c30-1053-4f72-b25c-edbf5190cb89 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:39.648096 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-372d0c30-1053-4f72-b25c-edbf5190cb89 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:39.895577 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a185e98e-82e4-4308-9b16-81601ab1a9b2 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:39.905446 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a185e98e-82e4-4308-9b16-81601ab1a9b2 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1670 microversion: 2.1 time: 0.336331 Sep 23 04:49:39.906312 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2005/4125] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:49:39 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1670 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:49:39.911593 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-132d45bb-ce27-4f05-9dcc-999877ede023 tempest-KeyPairsNegativeTestJSON-709574751 tempest-KeyPairsNegativeTestJSON-709574751-project] Action: 'create', calling method: .version_select at 0x7ff1c3e6f550>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPMrppqBx3wZGDjNfV8cQmPBsnAiE3G25v+liP4dH29zMovTrY6zQi1fYFEDqqvlhzPiOmOeST7bl+8GAGBztF4bWy+Ul4qpKXl0d56OTueQ3BaDfFFhI5gMX+XhuSOnpQ=="}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:49:39.916242 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-132d45bb-ce27-4f05-9dcc-999877ede023 tempest-KeyPairsNegativeTestJSON-709574751 tempest-KeyPairsNegativeTestJSON-709574751-project] Request method failure captured: Sep 23 04:49:39.916242 n-d-846463-3 devstack@n-api.service[122698]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 23 04:49:39.916242 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:49:39.916242 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:49:39.916242 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:49:39.916242 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 247 Sep 23 04:49:39.916242 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:49:39.916242 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:49:39.916242 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:49:39.916242 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:49:39.916242 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTrea4iyE1ngG3jF2E2NT0xouaLuEYYorQR0BHfMNZLDinLK74Lu7auOjkoYH5_Dfc0ONb6uD5KbdU8jzqC-Mhw-V5p0DZ0kDJmEQhxy6CFbkuCwGwIafk_R5gTq0WngtQ1L1SKfMZWj5EMFSY11i8okhpnTRCRouiNMteFw5VDAVuQ Sep 23 04:49:39.916242 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:49:39.916242 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:49:39.916242 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:49:39.916242 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:49:39.916242 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:49:39.916242 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:49:39.916242 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: c3f30086a4c54c7b99b99f9ff2dc896c Sep 23 04:49:39.916242 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-709574751 Sep 23 04:49:39.916242 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:49:39.916242 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:49:39.916242 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c3f30086a4c54c7b99b99f9ff2dc896c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c3f30086a4c54c7b99b99f9ff2dc896c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c3f30086a4c54c7b99b99f9ff2dc896c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c3f30086a4c54c7b99b99f9ff2dc896c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:49:39.916242 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-KeyPairsNegativeTestJSON-709574751 Sep 23 04:49:39.916242 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: c3f30086a4c54c7b99b99f9ff2dc896c Sep 23 04:49:39.916242 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-709574751 Sep 23 04:49:39.916242 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-KeyPairsNegativeTestJSON-709574751-project Sep 23 04:49:39.916242 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:49:39.916242 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:49:39.916242 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 08654906b90c4b5eb9085c46f9b4eeac Sep 23 04:49:39.916242 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-KeyPairsNegativeTestJSON-709574751-project Sep 23 04:49:39.916242 n-d-846463-3 devstack@n-api.service[122698]: Sep 23 04:49:39.916242 n-d-846463-3 devstack@n-api.service[122698]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPMrppqBx3wZGDjNfV8cQmPBsnAiE3G25v+liP4dH29zMovTrY6zQi1fYFEDqqvlhzPiOmOeST7bl+8GAGBztF4bWy+Ul4qpKXl0d56OTueQ3BaDfFFhI5gMX+XhuSOnpQ=="}} Sep 23 04:49:39.916242 n-d-846463-3 devstack@n-api.service[122698]: method: Sep 23 04:49:39.916242 n-d-846463-3 devstack@n-api.service[122698]: exception: Invalid input for field/attribute name. Value: . '' is too short Sep 23 04:49:39.916242 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPMrppqBx3wZGDjNfV8cQmPBsnAiE3G25v+liP4dH29zMovTrY6zQi1fYFEDqqvlhzPiOmOeST7bl+8GAGBztF4bWy+Ul4qpKXl0d56OTueQ3BaDfFFhI5gMX+XhuSOnpQ=='}}} Sep 23 04:49:39.916242 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:49:39.916242 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:49:39.916242 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 23 04:49:39.916242 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 23 04:49:39.916242 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 23 04:49:39.916242 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise error Sep 23 04:49:39.916242 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 23 04:49:39.916242 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:49:39.916242 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Sep 23 04:49:39.916242 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 23 04:49:39.916242 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:49:39.916242 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi On instance['keypair']: Sep 23 04:49:39.916242 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi '' Sep 23 04:49:39.916242 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:49:39.916242 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:49:39.916242 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:49:39.916242 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:49:39.916242 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:49:39.916242 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:49:39.916242 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:49:39.916242 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:49:39.916242 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:49:39.916242 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:49:39.916242 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:49:39.916242 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:49:39.916242 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:49:39.916242 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:49:39.916242 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 23 04:49:39.916242 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 23 04:49:39.920433 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 23 04:49:39.920433 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 23 04:49:39.920433 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 23 04:49:39.920433 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 23 04:49:39.920433 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Sep 23 04:49:39.920433 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:49:39.920433 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:49:39.920433 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:49:39.920433 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:49:39.920433 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:49:39.920433 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:49:39.920433 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 23 04:49:39.920433 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 23 04:49:39.920433 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Sep 23 04:49:39.920433 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:49:39.922355 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-132d45bb-ce27-4f05-9dcc-999877ede023 tempest-KeyPairsNegativeTestJSON-709574751 tempest-KeyPairsNegativeTestJSON-709574751-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:49:39.923344 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-132d45bb-ce27-4f05-9dcc-999877ede023 tempest-KeyPairsNegativeTestJSON-709574751 tempest-KeyPairsNegativeTestJSON-709574751-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.015975 Sep 23 04:49:39.924374 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2006/4126] 10.222.0.33 () {60 vars in 1159 bytes} [Fri Sep 23 04:49:39 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 04:49:39.929682 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c7c5d783-d9e7-44be-b7f1-6d9eb2496540 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:39.930640 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c7c5d783-d9e7-44be-b7f1-6d9eb2496540 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: 9d5576c0-2aa8-4ca0-aed6-22c1f0700755] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:39.951729 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-372d0c30-1053-4f72-b25c-edbf5190cb89 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:39.964999 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-372d0c30-1053-4f72-b25c-edbf5190cb89 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:39.966815 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-372d0c30-1053-4f72-b25c-edbf5190cb89 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:39.971311 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-372d0c30-1053-4f72-b25c-edbf5190cb89 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9" status: 200 len: 1809 microversion: 2.20 time: 0.349216 Sep 23 04:49:39.973456 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2121/4127] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:49:39 2022] GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9 => generated 1809 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:49:39.981872 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ead4e5dd-ddb5-4b90-83d8-693e28f4676e tempest-KeyPairsNegativeTestJSON-709574751 tempest-KeyPairsNegativeTestJSON-709574751-project] Action: 'create', calling method: .version_select at 0x7ff1ba93b9d0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-248400134", "public_key": " "}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:49:40.042472 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-ead4e5dd-ddb5-4b90-83d8-693e28f4676e tempest-KeyPairsNegativeTestJSON-709574751 tempest-KeyPairsNegativeTestJSON-709574751-project] Getting quotas for project c3f30086a4c54c7b99b99f9ff2dc896c. Resources: {'key_pairs'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:49:40.058209 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-ead4e5dd-ddb5-4b90-83d8-693e28f4676e tempest-KeyPairsNegativeTestJSON-709574751 tempest-KeyPairsNegativeTestJSON-709574751-project] Getting quotas for user 08654906b90c4b5eb9085c46f9b4eeac and project c3f30086a4c54c7b99b99f9ff2dc896c. Resources: {'key_pairs'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:49:40.059054 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c7c5d783-d9e7-44be-b7f1-6d9eb2496540 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:40.068815 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c7c5d783-d9e7-44be-b7f1-6d9eb2496540 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/9d5576c0-2aa8-4ca0-aed6-22c1f0700755" status: 200 len: 1215 microversion: 2.1 time: 0.140770 Sep 23 04:49:40.069993 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2007/4128] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:49:39 2022] GET /compute/v2.1/servers/9d5576c0-2aa8-4ca0-aed6-22c1f0700755 => generated 1215 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:49:40.084611 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-ead4e5dd-ddb5-4b90-83d8-693e28f4676e tempest-KeyPairsNegativeTestJSON-709574751 tempest-KeyPairsNegativeTestJSON-709574751-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Sep 23 04:49:40.086478 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ead4e5dd-ddb5-4b90-83d8-693e28f4676e tempest-KeyPairsNegativeTestJSON-709574751 tempest-KeyPairsNegativeTestJSON-709574751-project] Request method failure captured: Sep 23 04:49:40.086478 n-d-846463-3 devstack@n-api.service[122699]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 23 04:49:40.086478 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:49:40.086478 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:49:40.086478 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:49:40.086478 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 94 Sep 23 04:49:40.086478 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:49:40.086478 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:49:40.086478 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:49:40.086478 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:49:40.086478 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTrea4iyE1ngG3jF2E2NT0xouaLuEYYorQR0BHfMNZLDinLK74Lu7auOjkoYH5_Dfc0ONb6uD5KbdU8jzqC-Mhw-V5p0DZ0kDJmEQhxy6CFbkuCwGwIafk_R5gTq0WngtQ1L1SKfMZWj5EMFSY11i8okhpnTRCRouiNMteFw5VDAVuQ Sep 23 04:49:40.086478 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:49:40.086478 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:49:40.086478 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:49:40.086478 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:49:40.086478 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:49:40.086478 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:49:40.086478 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: c3f30086a4c54c7b99b99f9ff2dc896c Sep 23 04:49:40.086478 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-709574751 Sep 23 04:49:40.086478 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:49:40.086478 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:49:40.086478 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c3f30086a4c54c7b99b99f9ff2dc896c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c3f30086a4c54c7b99b99f9ff2dc896c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c3f30086a4c54c7b99b99f9ff2dc896c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c3f30086a4c54c7b99b99f9ff2dc896c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:49:40.086478 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-KeyPairsNegativeTestJSON-709574751 Sep 23 04:49:40.086478 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: c3f30086a4c54c7b99b99f9ff2dc896c Sep 23 04:49:40.086478 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-709574751 Sep 23 04:49:40.086478 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-KeyPairsNegativeTestJSON-709574751-project Sep 23 04:49:40.086478 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:49:40.086478 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:49:40.086478 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 08654906b90c4b5eb9085c46f9b4eeac Sep 23 04:49:40.086478 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-KeyPairsNegativeTestJSON-709574751-project Sep 23 04:49:40.086478 n-d-846463-3 devstack@n-api.service[122699]: Sep 23 04:49:40.086478 n-d-846463-3 devstack@n-api.service[122699]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-248400134", "public_key": " "}} Sep 23 04:49:40.086478 n-d-846463-3 devstack@n-api.service[122699]: method: Sep 23 04:49:40.086478 n-d-846463-3 devstack@n-api.service[122699]: exception: Keypair data is invalid: failed to generate fingerprint Sep 23 04:49:40.086478 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-248400134', 'public_key': ' '}}} Sep 23 04:49:40.086478 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:49:40.086478 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:49:40.086478 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Sep 23 04:49:40.086478 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Sep 23 04:49:40.086478 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Sep 23 04:49:40.086478 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Sep 23 04:49:40.086478 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Sep 23 04:49:40.086478 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:49:40.086478 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:49:40.086478 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:49:40.086478 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:49:40.086478 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Sep 23 04:49:40.086478 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Sep 23 04:49:40.086478 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 23 04:49:40.086478 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 23 04:49:40.086478 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 23 04:49:40.086478 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 23 04:49:40.086478 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 23 04:49:40.086478 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise self.value Sep 23 04:49:40.086478 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 23 04:49:40.086478 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 23 04:49:40.086478 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Sep 23 04:49:40.086478 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Sep 23 04:49:40.086478 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Sep 23 04:49:40.086478 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Sep 23 04:49:40.086478 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Sep 23 04:49:40.086478 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Sep 23 04:49:40.086478 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Sep 23 04:49:40.086478 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:49:40.086478 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:49:40.086478 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:49:40.090396 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:49:40.090396 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:49:40.090396 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:49:40.090396 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:49:40.090396 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:49:40.090396 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:49:40.090396 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:49:40.090396 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:49:40.090396 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:49:40.090396 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:49:40.090396 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:49:40.090396 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:49:40.090396 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:49:40.090396 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Sep 23 04:49:40.090396 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self._create(req, body) Sep 23 04:49:40.090396 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Sep 23 04:49:40.090396 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Sep 23 04:49:40.090396 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Sep 23 04:49:40.090396 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:49:40.090396 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:49:40.090396 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:49:40.090396 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:49:40.090396 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:49:40.090396 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:49:40.090396 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:49:40.090396 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:49:40.090396 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Sep 23 04:49:40.090396 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:49:40.093189 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ead4e5dd-ddb5-4b90-83d8-693e28f4676e tempest-KeyPairsNegativeTestJSON-709574751 tempest-KeyPairsNegativeTestJSON-709574751-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:49:40.094341 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ead4e5dd-ddb5-4b90-83d8-693e28f4676e tempest-KeyPairsNegativeTestJSON-709574751 tempest-KeyPairsNegativeTestJSON-709574751-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.119083 Sep 23 04:49:40.102469 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2122/4129] 10.222.0.33 () {60 vars in 1158 bytes} [Fri Sep 23 04:49:39 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 128 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 23 04:49:40.108752 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f97de271-c98f-41c2-b4ce-1ff449cdbc3c tempest-KeyPairsNegativeTestJSON-709574751 tempest-KeyPairsNegativeTestJSON-709574751-project] Action: 'create', calling method: .version_select at 0x7ff1bbe14550>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPEzNQd97wkToc0dzL+206dPnYt6pOhZTEzCerPreN2lvJBVLQbWglFA6BRjioXGSDwDVrQ2J+N0C0gWL4UHd6Y3RjU6ma/IL3MAfSG9bNt3S+XMxMvvB9XpANZ38rWcdg=="}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:49:40.120310 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f97de271-c98f-41c2-b4ce-1ff449cdbc3c tempest-KeyPairsNegativeTestJSON-709574751 tempest-KeyPairsNegativeTestJSON-709574751-project] Request method failure captured: Sep 23 04:49:40.120310 n-d-846463-3 devstack@n-api.service[122698]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 23 04:49:40.120310 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:49:40.120310 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:49:40.120310 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:49:40.120310 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 507 Sep 23 04:49:40.120310 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:49:40.120310 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:49:40.120310 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:49:40.120310 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:49:40.120310 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTrea4iyE1ngG3jF2E2NT0xouaLuEYYorQR0BHfMNZLDinLK74Lu7auOjkoYH5_Dfc0ONb6uD5KbdU8jzqC-Mhw-V5p0DZ0kDJmEQhxy6CFbkuCwGwIafk_R5gTq0WngtQ1L1SKfMZWj5EMFSY11i8okhpnTRCRouiNMteFw5VDAVuQ Sep 23 04:49:40.120310 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:49:40.120310 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:49:40.120310 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:49:40.120310 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:49:40.120310 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:49:40.120310 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:49:40.120310 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: c3f30086a4c54c7b99b99f9ff2dc896c Sep 23 04:49:40.120310 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-709574751 Sep 23 04:49:40.120310 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:49:40.120310 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:49:40.120310 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c3f30086a4c54c7b99b99f9ff2dc896c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c3f30086a4c54c7b99b99f9ff2dc896c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c3f30086a4c54c7b99b99f9ff2dc896c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c3f30086a4c54c7b99b99f9ff2dc896c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:49:40.120310 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-KeyPairsNegativeTestJSON-709574751 Sep 23 04:49:40.120310 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: c3f30086a4c54c7b99b99f9ff2dc896c Sep 23 04:49:40.120310 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-709574751 Sep 23 04:49:40.120310 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-KeyPairsNegativeTestJSON-709574751-project Sep 23 04:49:40.120310 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:49:40.120310 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:49:40.120310 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 08654906b90c4b5eb9085c46f9b4eeac Sep 23 04:49:40.120310 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-KeyPairsNegativeTestJSON-709574751-project Sep 23 04:49:40.120310 n-d-846463-3 devstack@n-api.service[122698]: Sep 23 04:49:40.120310 n-d-846463-3 devstack@n-api.service[122698]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPEzNQd97wkToc0dzL+206dPnYt6pOhZTEzCerPreN2lvJBVLQbWglFA6BRjioXGSDwDVrQ2J+N0C0gWL4UHd6Y3RjU6ma/IL3MAfSG9bNt3S+XMxMvvB9XpANZ38rWcdg=="}} Sep 23 04:49:40.120310 n-d-846463-3 devstack@n-api.service[122698]: method: Sep 23 04:49:40.120310 n-d-846463-3 devstack@n-api.service[122698]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Sep 23 04:49:40.120310 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPEzNQd97wkToc0dzL+206dPnYt6pOhZTEzCerPreN2lvJBVLQbWglFA6BRjioXGSDwDVrQ2J+N0C0gWL4UHd6Y3RjU6ma/IL3MAfSG9bNt3S+XMxMvvB9XpANZ38rWcdg=='}}} Sep 23 04:49:40.120310 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:49:40.120310 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:49:40.120310 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 23 04:49:40.120310 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 23 04:49:40.120310 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 23 04:49:40.120310 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise error Sep 23 04:49:40.120310 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Sep 23 04:49:40.120310 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:49:40.120310 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Sep 23 04:49:40.120310 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 23 04:49:40.120310 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:49:40.120310 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi On instance['keypair']: Sep 23 04:49:40.120310 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Sep 23 04:49:40.123680 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:49:40.123680 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:49:40.123680 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:49:40.123680 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:49:40.123680 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:49:40.123680 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:49:40.123680 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:49:40.123680 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:49:40.123680 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:49:40.123680 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:49:40.123680 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:49:40.123680 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:49:40.123680 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:49:40.123680 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:49:40.123680 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 23 04:49:40.123680 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 23 04:49:40.123680 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 23 04:49:40.123680 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 23 04:49:40.123680 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 23 04:49:40.123680 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 23 04:49:40.123680 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Sep 23 04:49:40.123680 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:49:40.123680 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:49:40.123680 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:49:40.123680 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:49:40.123680 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:49:40.123680 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:49:40.123680 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 23 04:49:40.123680 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 23 04:49:40.123680 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Sep 23 04:49:40.123680 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:49:40.123680 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f97de271-c98f-41c2-b4ce-1ff449cdbc3c tempest-KeyPairsNegativeTestJSON-709574751 tempest-KeyPairsNegativeTestJSON-709574751-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:49:40.123680 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f97de271-c98f-41c2-b4ce-1ff449cdbc3c tempest-KeyPairsNegativeTestJSON-709574751 tempest-KeyPairsNegativeTestJSON-709574751-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.010281 Sep 23 04:49:40.123680 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2008/4130] 10.222.0.33 () {60 vars in 1159 bytes} [Fri Sep 23 04:49:40 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 04:49:40.139625 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3a9d1c92-6aed-4132-8d2a-26d5ecf66fc3 tempest-KeyPairsNegativeTestJSON-709574751 tempest-KeyPairsNegativeTestJSON-709574751-project] Action: 'create', calling method: .version_select at 0x7ff1ba935d30>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1354099753", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:49:40.184041 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-3a9d1c92-6aed-4132-8d2a-26d5ecf66fc3 tempest-KeyPairsNegativeTestJSON-709574751 tempest-KeyPairsNegativeTestJSON-709574751-project] Getting quotas for project c3f30086a4c54c7b99b99f9ff2dc896c. Resources: {'key_pairs'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:49:40.192946 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-3a9d1c92-6aed-4132-8d2a-26d5ecf66fc3 tempest-KeyPairsNegativeTestJSON-709574751 tempest-KeyPairsNegativeTestJSON-709574751-project] Getting quotas for user 08654906b90c4b5eb9085c46f9b4eeac and project c3f30086a4c54c7b99b99f9ff2dc896c. Resources: {'key_pairs'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:49:40.219575 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-3a9d1c92-6aed-4132-8d2a-26d5ecf66fc3 tempest-KeyPairsNegativeTestJSON-709574751 tempest-KeyPairsNegativeTestJSON-709574751-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Sep 23 04:49:40.222747 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3a9d1c92-6aed-4132-8d2a-26d5ecf66fc3 tempest-KeyPairsNegativeTestJSON-709574751 tempest-KeyPairsNegativeTestJSON-709574751-project] Request method failure captured: Sep 23 04:49:40.222747 n-d-846463-3 devstack@n-api.service[122699]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 23 04:49:40.222747 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:49:40.222747 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:49:40.222747 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:49:40.222747 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 118 Sep 23 04:49:40.222747 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:49:40.222747 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:49:40.222747 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:49:40.222747 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:49:40.222747 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTrea4iyE1ngG3jF2E2NT0xouaLuEYYorQR0BHfMNZLDinLK74Lu7auOjkoYH5_Dfc0ONb6uD5KbdU8jzqC-Mhw-V5p0DZ0kDJmEQhxy6CFbkuCwGwIafk_R5gTq0WngtQ1L1SKfMZWj5EMFSY11i8okhpnTRCRouiNMteFw5VDAVuQ Sep 23 04:49:40.222747 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:49:40.222747 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:49:40.222747 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:49:40.222747 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:49:40.222747 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:49:40.222747 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:49:40.222747 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: c3f30086a4c54c7b99b99f9ff2dc896c Sep 23 04:49:40.222747 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-709574751 Sep 23 04:49:40.222747 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:49:40.222747 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:49:40.222747 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c3f30086a4c54c7b99b99f9ff2dc896c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c3f30086a4c54c7b99b99f9ff2dc896c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c3f30086a4c54c7b99b99f9ff2dc896c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c3f30086a4c54c7b99b99f9ff2dc896c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:49:40.222747 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-KeyPairsNegativeTestJSON-709574751 Sep 23 04:49:40.222747 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: c3f30086a4c54c7b99b99f9ff2dc896c Sep 23 04:49:40.222747 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-709574751 Sep 23 04:49:40.222747 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-KeyPairsNegativeTestJSON-709574751-project Sep 23 04:49:40.222747 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:49:40.222747 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:49:40.222747 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 08654906b90c4b5eb9085c46f9b4eeac Sep 23 04:49:40.222747 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-KeyPairsNegativeTestJSON-709574751-project Sep 23 04:49:40.222747 n-d-846463-3 devstack@n-api.service[122699]: Sep 23 04:49:40.222747 n-d-846463-3 devstack@n-api.service[122699]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1354099753", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Sep 23 04:49:40.222747 n-d-846463-3 devstack@n-api.service[122699]: method: Sep 23 04:49:40.222747 n-d-846463-3 devstack@n-api.service[122699]: exception: Keypair data is invalid: failed to generate fingerprint Sep 23 04:49:40.222747 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1354099753', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Sep 23 04:49:40.222747 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:49:40.222747 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:49:40.222747 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Sep 23 04:49:40.222747 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Sep 23 04:49:40.222747 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Sep 23 04:49:40.222747 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Sep 23 04:49:40.222747 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Sep 23 04:49:40.222747 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Sep 23 04:49:40.222747 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Sep 23 04:49:40.222747 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Sep 23 04:49:40.222747 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Sep 23 04:49:40.222747 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:49:40.222747 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:49:40.222747 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:49:40.222747 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:49:40.222747 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Sep 23 04:49:40.222747 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Sep 23 04:49:40.222747 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 23 04:49:40.222747 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 23 04:49:40.222747 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 23 04:49:40.222747 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 23 04:49:40.222747 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 23 04:49:40.222747 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise self.value Sep 23 04:49:40.222747 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 23 04:49:40.222747 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 23 04:49:40.222747 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Sep 23 04:49:40.222747 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Sep 23 04:49:40.222747 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Sep 23 04:49:40.222747 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Sep 23 04:49:40.229036 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Sep 23 04:49:40.229036 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Sep 23 04:49:40.229036 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Sep 23 04:49:40.229036 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:49:40.229036 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:49:40.229036 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:49:40.229036 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:49:40.229036 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:49:40.229036 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:49:40.229036 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:49:40.229036 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:49:40.229036 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:49:40.229036 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:49:40.229036 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:49:40.229036 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:49:40.229036 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:49:40.229036 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:49:40.229036 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:49:40.229036 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:49:40.229036 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Sep 23 04:49:40.229036 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self._create(req, body) Sep 23 04:49:40.229036 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Sep 23 04:49:40.229036 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Sep 23 04:49:40.229036 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Sep 23 04:49:40.229036 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:49:40.229036 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:49:40.229036 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:49:40.229036 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:49:40.229036 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:49:40.229036 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:49:40.229036 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:49:40.229036 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:49:40.229036 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Sep 23 04:49:40.229036 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:49:40.229036 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3a9d1c92-6aed-4132-8d2a-26d5ecf66fc3 tempest-KeyPairsNegativeTestJSON-709574751 tempest-KeyPairsNegativeTestJSON-709574751-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:49:40.229036 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3a9d1c92-6aed-4132-8d2a-26d5ecf66fc3 tempest-KeyPairsNegativeTestJSON-709574751 tempest-KeyPairsNegativeTestJSON-709574751-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.097369 Sep 23 04:49:40.233689 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2123/4131] 10.222.0.33 () {60 vars in 1159 bytes} [Fri Sep 23 04:49:40 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 104 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 23 04:49:40.243366 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-be0ac367-b3a6-4e75-8b9f-c46d521a0c56 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:40.244279 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-be0ac367-b3a6-4e75-8b9f-c46d521a0c56 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] [instance: e6610a41-bbef-4646-80f3-82446c38bbf5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:40.261305 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d2986720-3380-443a-a8cb-9d7c734a27d4 tempest-KeyPairsNegativeTestJSON-709574751 tempest-KeyPairsNegativeTestJSON-709574751-project] Calling method '.version_select at 0x7ff1ba9954c0>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:40.261753 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-be0ac367-b3a6-4e75-8b9f-c46d521a0c56 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:40.262497 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-be0ac367-b3a6-4e75-8b9f-c46d521a0c56 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:40.263594 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-be0ac367-b3a6-4e75-8b9f-c46d521a0c56 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:40.266830 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-be0ac367-b3a6-4e75-8b9f-c46d521a0c56 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:40.270147 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-be0ac367-b3a6-4e75-8b9f-c46d521a0c56 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:40.271675 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-be0ac367-b3a6-4e75-8b9f-c46d521a0c56 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:40.289146 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-d2986720-3380-443a-a8cb-9d7c734a27d4 tempest-KeyPairsNegativeTestJSON-709574751 tempest-KeyPairsNegativeTestJSON-709574751-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-1918211147 not found for user 08654906b90c4b5eb9085c46f9b4eeac Sep 23 04:49:40.291208 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d2986720-3380-443a-a8cb-9d7c734a27d4 tempest-KeyPairsNegativeTestJSON-709574751 tempest-KeyPairsNegativeTestJSON-709574751-project] Request method failure captured: Sep 23 04:49:40.291208 n-d-846463-3 devstack@n-api.service[122699]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1918211147 HTTP/1.1 Sep 23 04:49:40.291208 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:49:40.291208 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:49:40.291208 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:49:40.291208 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:49:40.291208 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:49:40.291208 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:49:40.291208 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:49:40.291208 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:49:40.291208 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTrea4iyE1ngG3jF2E2NT0xouaLuEYYorQR0BHfMNZLDinLK74Lu7auOjkoYH5_Dfc0ONb6uD5KbdU8jzqC-Mhw-V5p0DZ0kDJmEQhxy6CFbkuCwGwIafk_R5gTq0WngtQ1L1SKfMZWj5EMFSY11i8okhpnTRCRouiNMteFw5VDAVuQ Sep 23 04:49:40.291208 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:49:40.291208 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:49:40.291208 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:49:40.291208 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:49:40.291208 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:49:40.291208 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:49:40.291208 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: c3f30086a4c54c7b99b99f9ff2dc896c Sep 23 04:49:40.291208 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-709574751 Sep 23 04:49:40.291208 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:49:40.291208 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:49:40.291208 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c3f30086a4c54c7b99b99f9ff2dc896c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c3f30086a4c54c7b99b99f9ff2dc896c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c3f30086a4c54c7b99b99f9ff2dc896c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c3f30086a4c54c7b99b99f9ff2dc896c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:49:40.291208 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-KeyPairsNegativeTestJSON-709574751 Sep 23 04:49:40.291208 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: c3f30086a4c54c7b99b99f9ff2dc896c Sep 23 04:49:40.291208 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-709574751 Sep 23 04:49:40.291208 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-KeyPairsNegativeTestJSON-709574751-project Sep 23 04:49:40.291208 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:49:40.291208 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:49:40.291208 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 08654906b90c4b5eb9085c46f9b4eeac Sep 23 04:49:40.291208 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-KeyPairsNegativeTestJSON-709574751-project Sep 23 04:49:40.291208 n-d-846463-3 devstack@n-api.service[122699]: method: Sep 23 04:49:40.291208 n-d-846463-3 devstack@n-api.service[122699]: exception: Keypair tempest-keypair-non-existent-1918211147 not found for user 08654906b90c4b5eb9085c46f9b4eeac Sep 23 04:49:40.291208 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': 'tempest-keypair-non-existent-1918211147'} Sep 23 04:49:40.291208 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:49:40.291208 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:49:40.291208 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Sep 23 04:49:40.291208 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Sep 23 04:49:40.291208 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 23 04:49:40.291208 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 23 04:49:40.291208 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 23 04:49:40.291208 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 23 04:49:40.291208 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 23 04:49:40.291208 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise self.value Sep 23 04:49:40.291208 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 23 04:49:40.291208 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 23 04:49:40.291208 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6861, in delete_key_pair Sep 23 04:49:40.291208 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Sep 23 04:49:40.291208 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6882, in get_key_pair Sep 23 04:49:40.291208 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Sep 23 04:49:40.291208 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 04:49:40.291208 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 04:49:40.291208 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Sep 23 04:49:40.291208 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Sep 23 04:49:40.291208 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Sep 23 04:49:40.291208 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Sep 23 04:49:40.291208 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 23 04:49:40.291208 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 23 04:49:40.291208 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Sep 23 04:49:40.291208 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Sep 23 04:49:40.291208 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-1918211147 not found for user 08654906b90c4b5eb9085c46f9b4eeac Sep 23 04:49:40.291208 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:49:40.291208 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:49:40.295116 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:49:40.295116 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:49:40.295116 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:49:40.295116 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:49:40.295116 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:49:40.295116 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:49:40.295116 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:49:40.295116 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:49:40.295116 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 23 04:49:40.295116 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:49:40.295116 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:49:40.295116 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:49:40.295116 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Sep 23 04:49:40.295116 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self._delete(req, id) Sep 23 04:49:40.295116 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Sep 23 04:49:40.295116 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Sep 23 04:49:40.295116 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-1918211147 not found for user 08654906b90c4b5eb9085c46f9b4eeac Sep 23 04:49:40.295116 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:49:40.295116 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:49:40.295116 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:49:40.295116 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:49:40.295116 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:49:40.295116 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:49:40.295116 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:49:40.295116 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:49:40.295116 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-1918211147 not found for user 08654906b90c4b5eb9085c46f9b4eeac Sep 23 04:49:40.295116 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:49:40.299248 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d2986720-3380-443a-a8cb-9d7c734a27d4 tempest-KeyPairsNegativeTestJSON-709574751 tempest-KeyPairsNegativeTestJSON-709574751-project] Returning 404 to user: Keypair tempest-keypair-non-existent-1918211147 not found for user 08654906b90c4b5eb9085c46f9b4eeac {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:49:40.300727 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d2986720-3380-443a-a8cb-9d7c734a27d4 tempest-KeyPairsNegativeTestJSON-709574751 tempest-KeyPairsNegativeTestJSON-709574751-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1918211147" status: 404 len: 145 microversion: 2.1 time: 0.049908 Sep 23 04:49:40.302377 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2124/4132] 10.222.0.33 () {58 vars in 1260 bytes} [Fri Sep 23 04:49:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1918211147 => generated 145 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 04:49:40.433867 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-be0ac367-b3a6-4e75-8b9f-c46d521a0c56 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d728817c4f74e579eab88b62f73d08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaa3a17b8a24f8087a5748f83d377e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:40.460483 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-be0ac367-b3a6-4e75-8b9f-c46d521a0c56 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] 10.222.0.33 "GET /compute/v2.1/servers/e6610a41-bbef-4646-80f3-82446c38bbf5" status: 200 len: 1273 microversion: 2.1 time: 0.221982 Sep 23 04:49:40.461460 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2009/4133] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:49:40 2022] GET /compute/v2.1/servers/e6610a41-bbef-4646-80f3-82446c38bbf5 => generated 1273 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:49:40.652259 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c14c0ca3-73d5-47c4-8a5b-8a1d70d2eeb8 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:40.652945 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c14c0ca3-73d5-47c4-8a5b-8a1d70d2eeb8 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: c4464422-9bf1-4aaa-806c-d7063e284579] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:40.677986 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c14c0ca3-73d5-47c4-8a5b-8a1d70d2eeb8 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:40.678885 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c14c0ca3-73d5-47c4-8a5b-8a1d70d2eeb8 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:40.679571 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c14c0ca3-73d5-47c4-8a5b-8a1d70d2eeb8 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:40.681078 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c14c0ca3-73d5-47c4-8a5b-8a1d70d2eeb8 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:40.683085 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c14c0ca3-73d5-47c4-8a5b-8a1d70d2eeb8 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:40.684674 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c14c0ca3-73d5-47c4-8a5b-8a1d70d2eeb8 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:40.919754 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c14c0ca3-73d5-47c4-8a5b-8a1d70d2eeb8 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c786bbedc21849ea92924139a44707b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcafb05f6f554e278cd552023947c6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:40.939842 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c14c0ca3-73d5-47c4-8a5b-8a1d70d2eeb8 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579" status: 200 len: 1736 microversion: 2.1 time: 0.285440 Sep 23 04:49:40.943121 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2125/4134] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:49:40 2022] GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579 => generated 1736 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:49:40.983976 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-11a44d02-2fed-42fe-bfd7-c788ab7ad4fa req-5623603c-3097-4884-a3d0-b593b90d764f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fb569cf-4457-4695-ad5f-fcb78f0964c5", "name": "network-vif-unplugged", "status": "completed", "tag": "8fdad197-55e1-4686-bfa9-6cfa0beb24d5"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:49:41.004044 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b80cf842-dd2e-41c4-a520-ae19162bacad tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:41.005449 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b80cf842-dd2e-41c4-a520-ae19162bacad tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: fe7dee09-8351-4d41-8c44-8d35a966cce9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:41.012998 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-11a44d02-2fed-42fe-bfd7-c788ab7ad4fa req-5623603c-3097-4884-a3d0-b593b90d764f service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:41.013502 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-11a44d02-2fed-42fe-bfd7-c788ab7ad4fa req-5623603c-3097-4884-a3d0-b593b90d764f service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:41.013984 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-11a44d02-2fed-42fe-bfd7-c788ab7ad4fa req-5623603c-3097-4884-a3d0-b593b90d764f service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:41.028320 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b80cf842-dd2e-41c4-a520-ae19162bacad tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:41.030417 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-11a44d02-2fed-42fe-bfd7-c788ab7ad4fa req-5623603c-3097-4884-a3d0-b593b90d764f service nova] Creating event network-vif-unplugged:8fdad197-55e1-4686-bfa9-6cfa0beb24d5 for instance 4fb569cf-4457-4695-ad5f-fcb78f0964c5 on n-h2-846463-3 Sep 23 04:49:41.033652 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b80cf842-dd2e-41c4-a520-ae19162bacad tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:41.037269 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b80cf842-dd2e-41c4-a520-ae19162bacad tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:41.038552 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-11a44d02-2fed-42fe-bfd7-c788ab7ad4fa req-5623603c-3097-4884-a3d0-b593b90d764f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057829 Sep 23 04:49:41.039809 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2010/4135] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:49:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:49:41.040229 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b80cf842-dd2e-41c4-a520-ae19162bacad tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:41.044903 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b80cf842-dd2e-41c4-a520-ae19162bacad tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:41.045390 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b80cf842-dd2e-41c4-a520-ae19162bacad tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:41.099263 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-22a3e610-0eb1-4920-ae82-39813e3b0757 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:41.100330 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-22a3e610-0eb1-4920-ae82-39813e3b0757 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: 9d5576c0-2aa8-4ca0-aed6-22c1f0700755] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:41.118889 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-22a3e610-0eb1-4920-ae82-39813e3b0757 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:41.119269 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-22a3e610-0eb1-4920-ae82-39813e3b0757 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:41.119725 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-22a3e610-0eb1-4920-ae82-39813e3b0757 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:41.122249 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-22a3e610-0eb1-4920-ae82-39813e3b0757 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:41.122726 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-22a3e610-0eb1-4920-ae82-39813e3b0757 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:41.123159 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-22a3e610-0eb1-4920-ae82-39813e3b0757 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:41.385213 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-22a3e610-0eb1-4920-ae82-39813e3b0757 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:41.398642 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-22a3e610-0eb1-4920-ae82-39813e3b0757 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/9d5576c0-2aa8-4ca0-aed6-22c1f0700755" status: 200 len: 1219 microversion: 2.1 time: 0.305082 Sep 23 04:49:41.399402 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2011/4136] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:49:41 2022] GET /compute/v2.1/servers/9d5576c0-2aa8-4ca0-aed6-22c1f0700755 => generated 1219 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:49:41.444271 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b80cf842-dd2e-41c4-a520-ae19162bacad tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:41.464023 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=100 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:49:41.484578 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f30ae699-5d31-4efa-a159-29e438d98ab9 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:41.485767 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f30ae699-5d31-4efa-a159-29e438d98ab9 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] [instance: e6610a41-bbef-4646-80f3-82446c38bbf5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:41.492788 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f30ae699-5d31-4efa-a159-29e438d98ab9 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:41.493509 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f30ae699-5d31-4efa-a159-29e438d98ab9 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:41.494135 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f30ae699-5d31-4efa-a159-29e438d98ab9 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:41.495004 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f30ae699-5d31-4efa-a159-29e438d98ab9 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:41.495889 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b80cf842-dd2e-41c4-a520-ae19162bacad tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:41.496693 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f30ae699-5d31-4efa-a159-29e438d98ab9 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:41.497287 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f30ae699-5d31-4efa-a159-29e438d98ab9 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:41.505589 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b80cf842-dd2e-41c4-a520-ae19162bacad tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:41.515211 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b80cf842-dd2e-41c4-a520-ae19162bacad tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9" status: 200 len: 1809 microversion: 2.20 time: 0.520341 Sep 23 04:49:41.533458 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2126/4137] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:49:40 2022] GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9 => generated 1809 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:49:41.688292 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f30ae699-5d31-4efa-a159-29e438d98ab9 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d728817c4f74e579eab88b62f73d08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaa3a17b8a24f8087a5748f83d377e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:41.697542 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f30ae699-5d31-4efa-a159-29e438d98ab9 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] 10.222.0.33 "GET /compute/v2.1/servers/e6610a41-bbef-4646-80f3-82446c38bbf5" status: 200 len: 1321 microversion: 2.1 time: 0.217059 Sep 23 04:49:41.700202 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2012/4138] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:49:41 2022] GET /compute/v2.1/servers/e6610a41-bbef-4646-80f3-82446c38bbf5 => generated 1321 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:49:41.851468 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6e8484c6-c7fe-4536-aebb-ee5c3820121b tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-2000619437", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "networks": [{"uuid": "71485cd9-e617-4a9e-af36-25d78f996e1a"}, {"uuid": "41b4ea6d-0d8d-4b52-b6ff-99896e67d8f0"}, {"uuid": "71485cd9-e617-4a9e-af36-25d78f996e1a"}]}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:49:41.960107 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.neutron [None req-6e8484c6-c7fe-4536-aebb-ee5c3820121b tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] validate_networks() for [('71485cd9-e617-4a9e-af36-25d78f996e1a', None, None, None, None, None), ('41b4ea6d-0d8d-4b52-b6ff-99896e67d8f0', None, None, None, None, None), ('71485cd9-e617-4a9e-af36-25d78f996e1a', None, None, None, None, None)] {{(pid=122699) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:49:41.971596 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-42f1872d-ad19-4b86-abb1-b6f0a1f55e35 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:41.972371 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-42f1872d-ad19-4b86-abb1-b6f0a1f55e35 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: c4464422-9bf1-4aaa-806c-d7063e284579] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:41.988477 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-42f1872d-ad19-4b86-abb1-b6f0a1f55e35 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:41.992386 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-42f1872d-ad19-4b86-abb1-b6f0a1f55e35 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:41.994644 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-42f1872d-ad19-4b86-abb1-b6f0a1f55e35 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:41.999236 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-42f1872d-ad19-4b86-abb1-b6f0a1f55e35 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:42.001476 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-42f1872d-ad19-4b86-abb1-b6f0a1f55e35 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:42.003528 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-42f1872d-ad19-4b86-abb1-b6f0a1f55e35 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:42.421675 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-42f1872d-ad19-4b86-abb1-b6f0a1f55e35 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c786bbedc21849ea92924139a44707b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcafb05f6f554e278cd552023947c6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:42.438690 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-42f1872d-ad19-4b86-abb1-b6f0a1f55e35 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579" status: 200 len: 1736 microversion: 2.1 time: 0.469654 Sep 23 04:49:42.438690 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2013/4139] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:49:41 2022] GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579 => generated 1736 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:49:42.466570 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1c5c561e-5a31-4716-ba1b-7802a34507fb tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:42.472636 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-1c5c561e-5a31-4716-ba1b-7802a34507fb tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: 9d5576c0-2aa8-4ca0-aed6-22c1f0700755] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:42.533649 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1c5c561e-5a31-4716-ba1b-7802a34507fb tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:42.538497 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1c5c561e-5a31-4716-ba1b-7802a34507fb tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:42.544469 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1c5c561e-5a31-4716-ba1b-7802a34507fb tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:42.547048 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1c5c561e-5a31-4716-ba1b-7802a34507fb tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:42.560095 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1c5c561e-5a31-4716-ba1b-7802a34507fb tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:42.561023 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1c5c561e-5a31-4716-ba1b-7802a34507fb tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:43.011591 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-1c5c561e-5a31-4716-ba1b-7802a34507fb tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:43.025600 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-1c5c561e-5a31-4716-ba1b-7802a34507fb tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/9d5576c0-2aa8-4ca0-aed6-22c1f0700755" status: 200 len: 1267 microversion: 2.1 time: 0.588317 Sep 23 04:49:43.026887 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2014/4140] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:49:42 2022] GET /compute/v2.1/servers/9d5576c0-2aa8-4ca0-aed6-22c1f0700755 => generated 1267 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:49:43.039863 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-78bb48b6-06da-4f71-aa29-af0fc516081a tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:43.040869 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-78bb48b6-06da-4f71-aa29-af0fc516081a tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: fe7dee09-8351-4d41-8c44-8d35a966cce9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:43.059797 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-78bb48b6-06da-4f71-aa29-af0fc516081a tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:43.060612 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-78bb48b6-06da-4f71-aa29-af0fc516081a tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:43.061225 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-78bb48b6-06da-4f71-aa29-af0fc516081a tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:43.066241 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-78bb48b6-06da-4f71-aa29-af0fc516081a tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:43.066924 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-78bb48b6-06da-4f71-aa29-af0fc516081a tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:43.067881 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-78bb48b6-06da-4f71-aa29-af0fc516081a tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:43.572149 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-78bb48b6-06da-4f71-aa29-af0fc516081a tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:43.597791 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-78bb48b6-06da-4f71-aa29-af0fc516081a tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:43.601788 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-78bb48b6-06da-4f71-aa29-af0fc516081a tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:43.606469 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-78bb48b6-06da-4f71-aa29-af0fc516081a tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9" status: 200 len: 1809 microversion: 2.20 time: 0.570845 Sep 23 04:49:43.607796 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2015/4141] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:49:43 2022] GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9 => generated 1809 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:49:43.619425 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8f5c6fd3-3212-45ec-849e-1105af3c4515 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:43.621719 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8f5c6fd3-3212-45ec-849e-1105af3c4515 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] [instance: e6610a41-bbef-4646-80f3-82446c38bbf5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:43.641489 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8f5c6fd3-3212-45ec-849e-1105af3c4515 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:43.642227 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8f5c6fd3-3212-45ec-849e-1105af3c4515 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:43.644600 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8f5c6fd3-3212-45ec-849e-1105af3c4515 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:43.648031 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8f5c6fd3-3212-45ec-849e-1105af3c4515 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:43.649023 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8f5c6fd3-3212-45ec-849e-1105af3c4515 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:43.649702 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8f5c6fd3-3212-45ec-849e-1105af3c4515 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:44.206957 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8f5c6fd3-3212-45ec-849e-1105af3c4515 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d728817c4f74e579eab88b62f73d08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaa3a17b8a24f8087a5748f83d377e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:44.222396 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8f5c6fd3-3212-45ec-849e-1105af3c4515 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] 10.222.0.33 "GET /compute/v2.1/servers/e6610a41-bbef-4646-80f3-82446c38bbf5" status: 200 len: 1395 microversion: 2.1 time: 0.612485 Sep 23 04:49:44.223036 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2016/4142] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:49:43 2022] GET /compute/v2.1/servers/e6610a41-bbef-4646-80f3-82446c38bbf5 => generated 1395 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:49:44.240495 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6b6b5924-b31b-46ff-b623-02650c89605d tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:44.241161 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-6b6b5924-b31b-46ff-b623-02650c89605d tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: c4464422-9bf1-4aaa-806c-d7063e284579] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:44.263004 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6b6b5924-b31b-46ff-b623-02650c89605d tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:44.263579 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6b6b5924-b31b-46ff-b623-02650c89605d tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:44.264052 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6b6b5924-b31b-46ff-b623-02650c89605d tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:44.274235 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6b6b5924-b31b-46ff-b623-02650c89605d tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:44.274833 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6b6b5924-b31b-46ff-b623-02650c89605d tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:44.275298 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6b6b5924-b31b-46ff-b623-02650c89605d tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:45.050846 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6b6b5924-b31b-46ff-b623-02650c89605d tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c786bbedc21849ea92924139a44707b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcafb05f6f554e278cd552023947c6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:45.064105 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-6b6b5924-b31b-46ff-b623-02650c89605d tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579" status: 200 len: 1736 microversion: 2.1 time: 0.838855 Sep 23 04:49:45.071210 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2017/4143] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:49:44 2022] GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579 => generated 1736 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:49:45.087403 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-477cf0be-d537-4ac9-9fa0-4795d3d118a3 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:45.088094 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-477cf0be-d537-4ac9-9fa0-4795d3d118a3 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:45.101316 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-477cf0be-d537-4ac9-9fa0-4795d3d118a3 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:45.101968 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-477cf0be-d537-4ac9-9fa0-4795d3d118a3 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:45.102419 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-477cf0be-d537-4ac9-9fa0-4795d3d118a3 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:45.103158 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-477cf0be-d537-4ac9-9fa0-4795d3d118a3 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:45.104264 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-477cf0be-d537-4ac9-9fa0-4795d3d118a3 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:45.104710 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-477cf0be-d537-4ac9-9fa0-4795d3d118a3 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:45.250811 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-6e8484c6-c7fe-4536-aebb-ee5c3820121b tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Flavor limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:49:45.251468 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-6e8484c6-c7fe-4536-aebb-ee5c3820121b tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Image limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:49:45.252111 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-6e8484c6-c7fe-4536-aebb-ee5c3820121b tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Flavor pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:49:45.252633 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-6e8484c6-c7fe-4536-aebb-ee5c3820121b tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Image pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:49:45.253238 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-6e8484c6-c7fe-4536-aebb-ee5c3820121b tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:49:45.279951 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6e8484c6-c7fe-4536-aebb-ee5c3820121b tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:45.281761 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6e8484c6-c7fe-4536-aebb-ee5c3820121b tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:45.283985 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6e8484c6-c7fe-4536-aebb-ee5c3820121b tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:45.285208 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6e8484c6-c7fe-4536-aebb-ee5c3820121b tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:45.288908 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6e8484c6-c7fe-4536-aebb-ee5c3820121b tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:45.289657 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6e8484c6-c7fe-4536-aebb-ee5c3820121b tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:45.334970 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-6e8484c6-c7fe-4536-aebb-ee5c3820121b tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Getting quotas for project 2e32df90da6b43b7b8a562dd95e6833b. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:49:45.349349 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-6e8484c6-c7fe-4536-aebb-ee5c3820121b tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Getting quotas for user 91a52352ab894e8f88be0f9d1cef0b14 and project 2e32df90da6b43b7b8a562dd95e6833b. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:49:45.384148 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-6e8484c6-c7fe-4536-aebb-ee5c3820121b tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Going to run 1 instances... {{(pid=122699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:49:45.391117 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-6e8484c6-c7fe-4536-aebb-ee5c3820121b tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] [instance: 0ecb44a6-a97f-4177-aa9a-29a5b9b51a95] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:49:45.578936 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6e8484c6-c7fe-4536-aebb-ee5c3820121b tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.729680 Sep 23 04:49:45.581864 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2127/4144] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:49:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 3735 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:49:45.603141 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6c5df7df-97d6-4ac1-9235-e32e356a25dd tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:45.607867 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-6c5df7df-97d6-4ac1-9235-e32e356a25dd tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: 9d5576c0-2aa8-4ca0-aed6-22c1f0700755] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:45.631087 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6c5df7df-97d6-4ac1-9235-e32e356a25dd tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:45.634191 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6c5df7df-97d6-4ac1-9235-e32e356a25dd tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:45.635092 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6c5df7df-97d6-4ac1-9235-e32e356a25dd tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:45.636950 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6c5df7df-97d6-4ac1-9235-e32e356a25dd tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:45.637658 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6c5df7df-97d6-4ac1-9235-e32e356a25dd tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:45.638335 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6c5df7df-97d6-4ac1-9235-e32e356a25dd tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:46.161073 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-477cf0be-d537-4ac9-9fa0-4795d3d118a3 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:46.179781 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-477cf0be-d537-4ac9-9fa0-4795d3d118a3 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1670 microversion: 2.1 time: 1.104911 Sep 23 04:49:46.187498 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2018/4145] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:49:45 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1670 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:49:46.305588 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-6c5df7df-97d6-4ac1-9235-e32e356a25dd tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:46.316569 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6c5df7df-97d6-4ac1-9235-e32e356a25dd tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/9d5576c0-2aa8-4ca0-aed6-22c1f0700755" status: 200 len: 1315 microversion: 2.1 time: 0.730388 Sep 23 04:49:46.331886 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2128/4146] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:49:45 2022] GET /compute/v2.1/servers/9d5576c0-2aa8-4ca0-aed6-22c1f0700755 => generated 1315 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:49:46.351222 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-97a905a8-74b3-4eec-a40a-fecf3e76bd92 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:46.351848 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-97a905a8-74b3-4eec-a40a-fecf3e76bd92 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: fe7dee09-8351-4d41-8c44-8d35a966cce9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:46.365927 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-97a905a8-74b3-4eec-a40a-fecf3e76bd92 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:46.368365 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-97a905a8-74b3-4eec-a40a-fecf3e76bd92 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:46.369434 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-97a905a8-74b3-4eec-a40a-fecf3e76bd92 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:46.371943 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-97a905a8-74b3-4eec-a40a-fecf3e76bd92 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:46.372575 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-97a905a8-74b3-4eec-a40a-fecf3e76bd92 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:46.374179 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-97a905a8-74b3-4eec-a40a-fecf3e76bd92 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:46.539166 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-aeb29d0a-fd1e-4a32-adbb-c195158bf508 tempest-AbsoluteLimitsNegativeTestJSON-1024176677 tempest-AbsoluteLimitsNegativeTestJSON-1024176677-project] Calling method '.version_select at 0x7ff1c3f01430>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:46.563835 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-aeb29d0a-fd1e-4a32-adbb-c195158bf508 tempest-AbsoluteLimitsNegativeTestJSON-1024176677 tempest-AbsoluteLimitsNegativeTestJSON-1024176677-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:46.564651 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-aeb29d0a-fd1e-4a32-adbb-c195158bf508 tempest-AbsoluteLimitsNegativeTestJSON-1024176677 tempest-AbsoluteLimitsNegativeTestJSON-1024176677-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:46.565411 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-aeb29d0a-fd1e-4a32-adbb-c195158bf508 tempest-AbsoluteLimitsNegativeTestJSON-1024176677 tempest-AbsoluteLimitsNegativeTestJSON-1024176677-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:46.567168 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-aeb29d0a-fd1e-4a32-adbb-c195158bf508 tempest-AbsoluteLimitsNegativeTestJSON-1024176677 tempest-AbsoluteLimitsNegativeTestJSON-1024176677-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:46.567851 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-aeb29d0a-fd1e-4a32-adbb-c195158bf508 tempest-AbsoluteLimitsNegativeTestJSON-1024176677 tempest-AbsoluteLimitsNegativeTestJSON-1024176677-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:46.568500 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-aeb29d0a-fd1e-4a32-adbb-c195158bf508 tempest-AbsoluteLimitsNegativeTestJSON-1024176677 tempest-AbsoluteLimitsNegativeTestJSON-1024176677-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:46.626982 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-aeb29d0a-fd1e-4a32-adbb-c195158bf508 tempest-AbsoluteLimitsNegativeTestJSON-1024176677 tempest-AbsoluteLimitsNegativeTestJSON-1024176677-project] 10.222.0.33 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.438077 Sep 23 04:49:46.641711 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2019/4147] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 23 04:49:46 2022] GET /compute/v2.1/limits => generated 511 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:49:46.667087 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5e67e550-de55-4b44-8dac-ffcd7c7eeb0b tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:46.668907 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5e67e550-de55-4b44-8dac-ffcd7c7eeb0b tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] [instance: e6610a41-bbef-4646-80f3-82446c38bbf5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:46.686061 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5e67e550-de55-4b44-8dac-ffcd7c7eeb0b tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:46.686679 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5e67e550-de55-4b44-8dac-ffcd7c7eeb0b tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:46.688340 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5e67e550-de55-4b44-8dac-ffcd7c7eeb0b tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:46.689163 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5e67e550-de55-4b44-8dac-ffcd7c7eeb0b tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:46.690403 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5e67e550-de55-4b44-8dac-ffcd7c7eeb0b tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:46.693059 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5e67e550-de55-4b44-8dac-ffcd7c7eeb0b tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:46.726854 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-97a905a8-74b3-4eec-a40a-fecf3e76bd92 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:46.755984 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-97a905a8-74b3-4eec-a40a-fecf3e76bd92 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:46.768166 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-97a905a8-74b3-4eec-a40a-fecf3e76bd92 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:46.775929 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-97a905a8-74b3-4eec-a40a-fecf3e76bd92 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9" status: 200 len: 1809 microversion: 2.20 time: 0.435654 Sep 23 04:49:46.776976 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2129/4148] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:49:46 2022] GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9 => generated 1809 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:49:46.797788 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b0d252f8-6964-4bd5-89c5-5b83a84bb7b3 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:46.798699 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b0d252f8-6964-4bd5-89c5-5b83a84bb7b3 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] [instance: 0ecb44a6-a97f-4177-aa9a-29a5b9b51a95] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:46.916263 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b0d252f8-6964-4bd5-89c5-5b83a84bb7b3 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a52352ab894e8f88be0f9d1cef0b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e32df90da6b43b7b8a562dd95e6833b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:46.929070 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b0d252f8-6964-4bd5-89c5-5b83a84bb7b3 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] 10.222.0.33 "GET /compute/v2.1/servers/0ecb44a6-a97f-4177-aa9a-29a5b9b51a95" status: 200 len: 1213 microversion: 2.1 time: 0.150234 Sep 23 04:49:46.930969 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2130/4149] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:49:46 2022] GET /compute/v2.1/servers/0ecb44a6-a97f-4177-aa9a-29a5b9b51a95 => generated 1213 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:49:46.941515 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-f58e2a15-b994-47a6-8a1c-38aefc34ef87 req-1f51b202-e2e0-4c5d-8044-047e0e09d65f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6610a41-bbef-4646-80f3-82446c38bbf5", "tag": "976d0405-5d6c-4b74-9881-61506bb68a99"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:49:46.960074 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-f58e2a15-b994-47a6-8a1c-38aefc34ef87 req-1f51b202-e2e0-4c5d-8044-047e0e09d65f service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:46.960805 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-f58e2a15-b994-47a6-8a1c-38aefc34ef87 req-1f51b202-e2e0-4c5d-8044-047e0e09d65f service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:46.961391 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-f58e2a15-b994-47a6-8a1c-38aefc34ef87 req-1f51b202-e2e0-4c5d-8044-047e0e09d65f service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:46.982229 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-f58e2a15-b994-47a6-8a1c-38aefc34ef87 req-1f51b202-e2e0-4c5d-8044-047e0e09d65f service nova] Creating event network-changed:976d0405-5d6c-4b74-9881-61506bb68a99 for instance e6610a41-bbef-4646-80f3-82446c38bbf5 on n-h2-846463-3 Sep 23 04:49:46.988369 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-f58e2a15-b994-47a6-8a1c-38aefc34ef87 req-1f51b202-e2e0-4c5d-8044-047e0e09d65f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055218 Sep 23 04:49:46.992266 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2131/4150] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:49:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:49:46.998526 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5bf9511a-869c-4077-802c-0f261b79f136 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:46.999228 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-5bf9511a-869c-4077-802c-0f261b79f136 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: c4464422-9bf1-4aaa-806c-d7063e284579] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:47.007955 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5bf9511a-869c-4077-802c-0f261b79f136 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:47.008794 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5bf9511a-869c-4077-802c-0f261b79f136 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:47.009255 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5bf9511a-869c-4077-802c-0f261b79f136 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:47.021451 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5bf9511a-869c-4077-802c-0f261b79f136 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:47.022182 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5bf9511a-869c-4077-802c-0f261b79f136 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:47.022790 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5bf9511a-869c-4077-802c-0f261b79f136 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:47.092305 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-5e67e550-de55-4b44-8dac-ffcd7c7eeb0b tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d728817c4f74e579eab88b62f73d08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaa3a17b8a24f8087a5748f83d377e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:47.113393 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5e67e550-de55-4b44-8dac-ffcd7c7eeb0b tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] 10.222.0.33 "GET /compute/v2.1/servers/e6610a41-bbef-4646-80f3-82446c38bbf5" status: 200 len: 1395 microversion: 2.1 time: 0.461840 Sep 23 04:49:47.114382 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2020/4151] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:49:46 2022] GET /compute/v2.1/servers/e6610a41-bbef-4646-80f3-82446c38bbf5 => generated 1395 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:49:47.121405 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-66c5cf1b-d235-4602-b718-01c9bc22ddb4 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:47.124348 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-66c5cf1b-d235-4602-b718-01c9bc22ddb4 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:47.133236 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-66c5cf1b-d235-4602-b718-01c9bc22ddb4 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:47.138424 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-66c5cf1b-d235-4602-b718-01c9bc22ddb4 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:47.139107 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-66c5cf1b-d235-4602-b718-01c9bc22ddb4 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:47.140008 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-66c5cf1b-d235-4602-b718-01c9bc22ddb4 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:47.140361 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-66c5cf1b-d235-4602-b718-01c9bc22ddb4 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:47.141666 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-66c5cf1b-d235-4602-b718-01c9bc22ddb4 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:47.354167 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-5bf9511a-869c-4077-802c-0f261b79f136 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c786bbedc21849ea92924139a44707b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcafb05f6f554e278cd552023947c6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:47.364507 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5bf9511a-869c-4077-802c-0f261b79f136 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579" status: 200 len: 1736 microversion: 2.1 time: 0.370827 Sep 23 04:49:47.380613 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2132/4152] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:49:46 2022] GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579 => generated 1736 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:49:47.389227 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3368e500-7adb-4ae5-9c99-2d3ba2c32f90 tempest-AbsoluteLimitsNegativeTestJSON-1024176677 tempest-AbsoluteLimitsNegativeTestJSON-1024176677-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-97336422", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:49:47.459303 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-66c5cf1b-d235-4602-b718-01c9bc22ddb4 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:47.465935 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.neutron [None req-3368e500-7adb-4ae5-9c99-2d3ba2c32f90 tempest-AbsoluteLimitsNegativeTestJSON-1024176677 tempest-AbsoluteLimitsNegativeTestJSON-1024176677-project] validate_networks() for None {{(pid=122699) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:49:47.472526 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-66c5cf1b-d235-4602-b718-01c9bc22ddb4 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1670 microversion: 2.1 time: 0.356416 Sep 23 04:49:47.482235 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2021/4153] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:49:47 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1670 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:49:47.496438 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d044efaa-1d64-4f28-aa7f-0ea506bc8915 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:47.496845 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d044efaa-1d64-4f28-aa7f-0ea506bc8915 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: 9d5576c0-2aa8-4ca0-aed6-22c1f0700755] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:47.505347 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d044efaa-1d64-4f28-aa7f-0ea506bc8915 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:47.508524 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d044efaa-1d64-4f28-aa7f-0ea506bc8915 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:47.508524 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d044efaa-1d64-4f28-aa7f-0ea506bc8915 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:47.508524 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d044efaa-1d64-4f28-aa7f-0ea506bc8915 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:47.508524 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d044efaa-1d64-4f28-aa7f-0ea506bc8915 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:47.508524 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d044efaa-1d64-4f28-aa7f-0ea506bc8915 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:47.942867 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d044efaa-1d64-4f28-aa7f-0ea506bc8915 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:47.970023 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d044efaa-1d64-4f28-aa7f-0ea506bc8915 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/9d5576c0-2aa8-4ca0-aed6-22c1f0700755" status: 200 len: 1315 microversion: 2.1 time: 0.486076 Sep 23 04:49:47.971133 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2022/4154] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:49:47 2022] GET /compute/v2.1/servers/9d5576c0-2aa8-4ca0-aed6-22c1f0700755 => generated 1315 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:49:48.003070 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-38eea460-9557-487b-8b0f-d4e35bca6e18 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:48.010331 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-3368e500-7adb-4ae5-9c99-2d3ba2c32f90 tempest-AbsoluteLimitsNegativeTestJSON-1024176677 tempest-AbsoluteLimitsNegativeTestJSON-1024176677-project] Getting quotas for project 267972cc309b431f81bc7e5578293655. Resources: dict_keys(['metadata_items']) {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:49:48.013054 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-38eea460-9557-487b-8b0f-d4e35bca6e18 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:48.018637 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-3368e500-7adb-4ae5-9c99-2d3ba2c32f90 tempest-AbsoluteLimitsNegativeTestJSON-1024176677 tempest-AbsoluteLimitsNegativeTestJSON-1024176677-project] Getting quotas for user 0e66d7b1e2164c21975d7700980a5366 and project 267972cc309b431f81bc7e5578293655. Resources: dict_keys(['metadata_items']) {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:49:48.026299 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-38eea460-9557-487b-8b0f-d4e35bca6e18 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:48.027190 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-38eea460-9557-487b-8b0f-d4e35bca6e18 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:48.027876 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-38eea460-9557-487b-8b0f-d4e35bca6e18 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:48.028847 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-38eea460-9557-487b-8b0f-d4e35bca6e18 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:48.029530 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-38eea460-9557-487b-8b0f-d4e35bca6e18 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:48.033497 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-3368e500-7adb-4ae5-9c99-2d3ba2c32f90 tempest-AbsoluteLimitsNegativeTestJSON-1024176677 tempest-AbsoluteLimitsNegativeTestJSON-1024176677-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Sep 23 04:49:48.034683 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-38eea460-9557-487b-8b0f-d4e35bca6e18 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:48.036067 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3368e500-7adb-4ae5-9c99-2d3ba2c32f90 tempest-AbsoluteLimitsNegativeTestJSON-1024176677 tempest-AbsoluteLimitsNegativeTestJSON-1024176677-project] Request method failure captured: Sep 23 04:49:48.036067 n-d-846463-3 devstack@n-api.service[122699]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 23 04:49:48.036067 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:49:48.036067 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:49:48.036067 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:49:48.036067 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 1750 Sep 23 04:49:48.036067 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:49:48.036067 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:49:48.036067 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:49:48.036067 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:49:48.036067 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTrozKhHUZRHrWYckCBsb5oMELxN79nL5edNp-VHLntcv91z9hqpHrORjCQqOz7EkoLA3XkmyhUMTWnVrMZCrBdohDxbjDbq4YW9WvVYZS0Bu5lyFRP_FreeY1t-d_8aArnQ4-yyH3q9rVT7Y5LdxMajGqCRMV31JKK60CXKoqRmA4I Sep 23 04:49:48.036067 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:49:48.036067 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:49:48.036067 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:49:48.036067 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:49:48.036067 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:49:48.036067 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:49:48.036067 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 267972cc309b431f81bc7e5578293655 Sep 23 04:49:48.036067 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-1024176677 Sep 23 04:49:48.036067 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:49:48.036067 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:49:48.036067 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_267972cc309b431f81bc7e5578293655", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/267972cc309b431f81bc7e5578293655"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/267972cc309b431f81bc7e5578293655"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/267972cc309b431f81bc7e5578293655"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:49:48.036067 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-1024176677 Sep 23 04:49:48.036067 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 267972cc309b431f81bc7e5578293655 Sep 23 04:49:48.036067 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-1024176677 Sep 23 04:49:48.036067 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-1024176677-project Sep 23 04:49:48.036067 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:49:48.036067 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:49:48.036067 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 0e66d7b1e2164c21975d7700980a5366 Sep 23 04:49:48.036067 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-1024176677-project Sep 23 04:49:48.036067 n-d-846463-3 devstack@n-api.service[122699]: Sep 23 04:49:48.036067 n-d-846463-3 devstack@n-api.service[122699]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-97336422", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Sep 23 04:49:48.036067 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:49:48.036067 n-d-846463-3 devstack@n-api.service[122699]: exception: Maximum number of metadata items exceeds 128 Sep 23 04:49:48.038274 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-97336422', 'imageRef': 'b8dd79b9-f0b9-43a9-9605-17244137c0ee', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Sep 23 04:49:48.038274 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:49:48.038274 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:49:48.038274 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Sep 23 04:49:48.038274 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Sep 23 04:49:48.038274 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 04:49:48.038274 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 04:49:48.038274 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Sep 23 04:49:48.038274 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Sep 23 04:49:48.038274 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Sep 23 04:49:48.038274 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Sep 23 04:49:48.038274 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Sep 23 04:49:48.038274 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Sep 23 04:49:48.038274 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Sep 23 04:49:48.038274 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:49:48.038274 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:49:48.038274 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:49:48.038274 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:49:48.038274 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 23 04:49:48.038274 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 23 04:49:48.038274 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 23 04:49:48.038274 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 23 04:49:48.038274 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Sep 23 04:49:48.038274 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Sep 23 04:49:48.038274 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Sep 23 04:49:48.038274 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Sep 23 04:49:48.038274 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Sep 23 04:49:48.038274 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Sep 23 04:49:48.038274 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Sep 23 04:49:48.038274 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:49:48.038274 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:49:48.038274 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:49:48.038274 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:49:48.038274 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:49:48.038274 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:49:48.038274 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:49:48.038274 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:49:48.038274 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:49:48.038274 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:49:48.038274 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:49:48.038274 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:49:48.038274 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:49:48.038274 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:49:48.038274 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:49:48.040548 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:49:48.040548 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 23 04:49:48.040548 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Sep 23 04:49:48.040548 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 23 04:49:48.040548 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Sep 23 04:49:48.040548 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:49:48.040548 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:49:48.040548 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:49:48.040548 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:49:48.040548 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:49:48.040548 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:49:48.040548 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:49:48.040548 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:49:48.040548 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Sep 23 04:49:48.040548 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:49:48.042447 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3368e500-7adb-4ae5-9c99-2d3ba2c32f90 tempest-AbsoluteLimitsNegativeTestJSON-1024176677 tempest-AbsoluteLimitsNegativeTestJSON-1024176677-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:49:48.045172 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3368e500-7adb-4ae5-9c99-2d3ba2c32f90 tempest-AbsoluteLimitsNegativeTestJSON-1024176677 tempest-AbsoluteLimitsNegativeTestJSON-1024176677-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.658314 Sep 23 04:49:48.045172 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2133/4155] 10.222.0.33 () {60 vars in 1148 bytes} [Fri Sep 23 04:49:47 2022] POST /compute/v2.1/servers => generated 87 bytes in 663 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Sep 23 04:49:48.068704 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-084ea992-7384-43e6-af90-8dc655726b87 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:48.070405 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-084ea992-7384-43e6-af90-8dc655726b87 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: fe7dee09-8351-4d41-8c44-8d35a966cce9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:48.085718 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-084ea992-7384-43e6-af90-8dc655726b87 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:48.087914 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-084ea992-7384-43e6-af90-8dc655726b87 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:48.092463 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-084ea992-7384-43e6-af90-8dc655726b87 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:48.097017 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-084ea992-7384-43e6-af90-8dc655726b87 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:48.097017 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-084ea992-7384-43e6-af90-8dc655726b87 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:48.097017 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-084ea992-7384-43e6-af90-8dc655726b87 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:48.693092 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-084ea992-7384-43e6-af90-8dc655726b87 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:48.704232 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-084ea992-7384-43e6-af90-8dc655726b87 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:48.709398 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-084ea992-7384-43e6-af90-8dc655726b87 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:48.713764 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-084ea992-7384-43e6-af90-8dc655726b87 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9" status: 200 len: 1809 microversion: 2.20 time: 0.658768 Sep 23 04:49:48.714483 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2134/4156] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:49:48 2022] GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9 => generated 1809 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:49:48.721276 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-38eea460-9557-487b-8b0f-d4e35bca6e18 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:48.732486 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-38eea460-9557-487b-8b0f-d4e35bca6e18 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1670 microversion: 2.1 time: 0.759928 Sep 23 04:49:48.739754 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-eb8ddcfb-b27d-4005-920c-0f6f46a5594b tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:48.742551 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2023/4157] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:49:47 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1670 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:49:48.745601 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-eb8ddcfb-b27d-4005-920c-0f6f46a5594b tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] [instance: 0ecb44a6-a97f-4177-aa9a-29a5b9b51a95] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:48.757183 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a6194705-fed0-4173-9138-e1671ae9c20a tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:48.766826 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a6194705-fed0-4173-9138-e1671ae9c20a tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] [instance: e6610a41-bbef-4646-80f3-82446c38bbf5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:48.772348 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eb8ddcfb-b27d-4005-920c-0f6f46a5594b tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:48.772348 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eb8ddcfb-b27d-4005-920c-0f6f46a5594b tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:48.772348 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eb8ddcfb-b27d-4005-920c-0f6f46a5594b tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:48.772348 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eb8ddcfb-b27d-4005-920c-0f6f46a5594b tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:48.774048 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eb8ddcfb-b27d-4005-920c-0f6f46a5594b tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:48.774640 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eb8ddcfb-b27d-4005-920c-0f6f46a5594b tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:48.775974 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a6194705-fed0-4173-9138-e1671ae9c20a tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:48.776714 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a6194705-fed0-4173-9138-e1671ae9c20a tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:48.777677 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a6194705-fed0-4173-9138-e1671ae9c20a tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:48.778773 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a6194705-fed0-4173-9138-e1671ae9c20a tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:48.779522 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a6194705-fed0-4173-9138-e1671ae9c20a tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:48.780218 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a6194705-fed0-4173-9138-e1671ae9c20a tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:49.044147 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-eb8ddcfb-b27d-4005-920c-0f6f46a5594b tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a52352ab894e8f88be0f9d1cef0b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e32df90da6b43b7b8a562dd95e6833b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:49.059007 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-eb8ddcfb-b27d-4005-920c-0f6f46a5594b tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] 10.222.0.33 "GET /compute/v2.1/servers/0ecb44a6-a97f-4177-aa9a-29a5b9b51a95" status: 200 len: 1265 microversion: 2.1 time: 0.343345 Sep 23 04:49:49.064493 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2135/4158] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:49:48 2022] GET /compute/v2.1/servers/0ecb44a6-a97f-4177-aa9a-29a5b9b51a95 => generated 1265 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:49:49.082233 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8026566f-d3c7-4bea-8331-c35853d7ce04 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:49.086874 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-8026566f-d3c7-4bea-8331-c35853d7ce04 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: c4464422-9bf1-4aaa-806c-d7063e284579] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:49.093145 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8026566f-d3c7-4bea-8331-c35853d7ce04 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:49.094165 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8026566f-d3c7-4bea-8331-c35853d7ce04 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:49.094788 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8026566f-d3c7-4bea-8331-c35853d7ce04 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:49.095668 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8026566f-d3c7-4bea-8331-c35853d7ce04 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:49.096314 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8026566f-d3c7-4bea-8331-c35853d7ce04 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:49.096900 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8026566f-d3c7-4bea-8331-c35853d7ce04 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:49.356708 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a6194705-fed0-4173-9138-e1671ae9c20a tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d728817c4f74e579eab88b62f73d08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaa3a17b8a24f8087a5748f83d377e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:49.366920 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a6194705-fed0-4173-9138-e1671ae9c20a tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] 10.222.0.33 "GET /compute/v2.1/servers/e6610a41-bbef-4646-80f3-82446c38bbf5" status: 200 len: 1395 microversion: 2.1 time: 0.619505 Sep 23 04:49:49.368205 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2024/4159] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:49:48 2022] GET /compute/v2.1/servers/e6610a41-bbef-4646-80f3-82446c38bbf5 => generated 1395 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:49:49.380352 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a481b581-27de-4f73-b1a0-6df4f75289ff tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:49:49.387233 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a481b581-27de-4f73-b1a0-6df4f75289ff tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:49.402892 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a481b581-27de-4f73-b1a0-6df4f75289ff tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:49.403676 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a481b581-27de-4f73-b1a0-6df4f75289ff tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:49.404275 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a481b581-27de-4f73-b1a0-6df4f75289ff tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:49.405364 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a481b581-27de-4f73-b1a0-6df4f75289ff tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:49.407874 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a481b581-27de-4f73-b1a0-6df4f75289ff tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:49.408329 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a481b581-27de-4f73-b1a0-6df4f75289ff tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:49.414224 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=100 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:49:49.522157 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-8026566f-d3c7-4bea-8331-c35853d7ce04 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c786bbedc21849ea92924139a44707b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcafb05f6f554e278cd552023947c6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:49.541277 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-8026566f-d3c7-4bea-8331-c35853d7ce04 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579" status: 200 len: 1736 microversion: 2.1 time: 0.472612 Sep 23 04:49:49.544044 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2136/4160] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:49:49 2022] GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579 => generated 1736 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:49:49.551319 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-b851d00c-605f-4c0f-9249-d9c5907ff4f9 req-e4a9cddf-46cf-4cf2-a955-0ff56ec3b54d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d5576c0-2aa8-4ca0-aed6-22c1f0700755", "tag": "ff157d85-3ffd-4186-931e-da7ddbdf0398"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:49:49.568201 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-b851d00c-605f-4c0f-9249-d9c5907ff4f9 req-e4a9cddf-46cf-4cf2-a955-0ff56ec3b54d service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:49.569425 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-b851d00c-605f-4c0f-9249-d9c5907ff4f9 req-e4a9cddf-46cf-4cf2-a955-0ff56ec3b54d service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:49.570355 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-b851d00c-605f-4c0f-9249-d9c5907ff4f9 req-e4a9cddf-46cf-4cf2-a955-0ff56ec3b54d service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:49.592213 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-b851d00c-605f-4c0f-9249-d9c5907ff4f9 req-e4a9cddf-46cf-4cf2-a955-0ff56ec3b54d service nova] Creating event network-changed:ff157d85-3ffd-4186-931e-da7ddbdf0398 for instance 9d5576c0-2aa8-4ca0-aed6-22c1f0700755 on n-h2-846463-3 Sep 23 04:49:49.600891 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-b851d00c-605f-4c0f-9249-d9c5907ff4f9 req-e4a9cddf-46cf-4cf2-a955-0ff56ec3b54d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055232 Sep 23 04:49:49.602266 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2137/4161] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:49:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:49:49.608848 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-a19eb97e-9255-4490-9c8c-0a42fbecd325 req-0087aa4c-e674-4158-9da0-64c52e271d7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe7dee09-8351-4d41-8c44-8d35a966cce9", "name": "network-vif-plugged", "status": "completed", "tag": "c9b47e66-2bb6-4e68-a2b9-4fb9fec9ff30"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:49:49.621806 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-a19eb97e-9255-4490-9c8c-0a42fbecd325 req-0087aa4c-e674-4158-9da0-64c52e271d7e service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:49.622538 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-a19eb97e-9255-4490-9c8c-0a42fbecd325 req-0087aa4c-e674-4158-9da0-64c52e271d7e service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:49.623159 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-a19eb97e-9255-4490-9c8c-0a42fbecd325 req-0087aa4c-e674-4158-9da0-64c52e271d7e service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:49.638435 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-a19eb97e-9255-4490-9c8c-0a42fbecd325 req-0087aa4c-e674-4158-9da0-64c52e271d7e service nova] Creating event network-vif-plugged:c9b47e66-2bb6-4e68-a2b9-4fb9fec9ff30 for instance fe7dee09-8351-4d41-8c44-8d35a966cce9 on n-h2-846463-3 Sep 23 04:49:49.645009 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-a19eb97e-9255-4490-9c8c-0a42fbecd325 req-0087aa4c-e674-4158-9da0-64c52e271d7e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041125 Sep 23 04:49:49.645838 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2138/4162] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:49:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:49:49.666349 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5c69aaf8-79e4-4031-bb90-fec1a41568f8 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:49.667811 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-5c69aaf8-79e4-4031-bb90-fec1a41568f8 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: 9d5576c0-2aa8-4ca0-aed6-22c1f0700755] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:49.682235 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5c69aaf8-79e4-4031-bb90-fec1a41568f8 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:49.683010 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5c69aaf8-79e4-4031-bb90-fec1a41568f8 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:49.687796 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a481b581-27de-4f73-b1a0-6df4f75289ff tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "POST /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5/action" status: 202 len: 0 microversion: 2.1 time: 0.317981 Sep 23 04:49:49.688471 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2025/4163] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:49:49 2022] POST /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5/action => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:49:49.689794 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5c69aaf8-79e4-4031-bb90-fec1a41568f8 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:49.691116 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5c69aaf8-79e4-4031-bb90-fec1a41568f8 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:49.692492 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5c69aaf8-79e4-4031-bb90-fec1a41568f8 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:49.693112 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5c69aaf8-79e4-4031-bb90-fec1a41568f8 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:49.714067 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-13f97bbf-2b5e-4b96-953d-af6be594bf1c tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:49.722072 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-13f97bbf-2b5e-4b96-953d-af6be594bf1c tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:49.738612 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-13f97bbf-2b5e-4b96-953d-af6be594bf1c tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:49.742472 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-13f97bbf-2b5e-4b96-953d-af6be594bf1c tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:49.743702 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-13f97bbf-2b5e-4b96-953d-af6be594bf1c tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:49.745864 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-13f97bbf-2b5e-4b96-953d-af6be594bf1c tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:49.748439 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-13f97bbf-2b5e-4b96-953d-af6be594bf1c tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:49.749148 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-13f97bbf-2b5e-4b96-953d-af6be594bf1c tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:50.177576 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-5c69aaf8-79e4-4031-bb90-fec1a41568f8 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:50.204470 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-13f97bbf-2b5e-4b96-953d-af6be594bf1c tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:50.214721 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5c69aaf8-79e4-4031-bb90-fec1a41568f8 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/9d5576c0-2aa8-4ca0-aed6-22c1f0700755" status: 200 len: 1315 microversion: 2.1 time: 0.536639 Sep 23 04:49:50.217651 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2139/4164] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:49:49 2022] GET /compute/v2.1/servers/9d5576c0-2aa8-4ca0-aed6-22c1f0700755 => generated 1315 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:49:50.221860 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-13f97bbf-2b5e-4b96-953d-af6be594bf1c tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1672 microversion: 2.1 time: 0.526610 Sep 23 04:49:50.240061 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2026/4165] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:49:49 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1672 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:49:50.242793 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ec7de04f-75bd-4e97-99f8-1ad7f6237886 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:50.243427 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c9031f01-1af4-4f9e-9f31-ea6342798a55 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:50.244057 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c9031f01-1af4-4f9e-9f31-ea6342798a55 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: fe7dee09-8351-4d41-8c44-8d35a966cce9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:50.244178 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-ec7de04f-75bd-4e97-99f8-1ad7f6237886 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] [instance: 0ecb44a6-a97f-4177-aa9a-29a5b9b51a95] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:50.252619 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ec7de04f-75bd-4e97-99f8-1ad7f6237886 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:50.255967 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ec7de04f-75bd-4e97-99f8-1ad7f6237886 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:50.259279 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ec7de04f-75bd-4e97-99f8-1ad7f6237886 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:50.259279 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ec7de04f-75bd-4e97-99f8-1ad7f6237886 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:50.259279 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ec7de04f-75bd-4e97-99f8-1ad7f6237886 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:50.259655 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c9031f01-1af4-4f9e-9f31-ea6342798a55 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:50.259792 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ec7de04f-75bd-4e97-99f8-1ad7f6237886 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:50.259945 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c9031f01-1af4-4f9e-9f31-ea6342798a55 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:50.259945 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c9031f01-1af4-4f9e-9f31-ea6342798a55 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:50.259945 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c9031f01-1af4-4f9e-9f31-ea6342798a55 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:50.260287 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c9031f01-1af4-4f9e-9f31-ea6342798a55 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:50.260783 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c9031f01-1af4-4f9e-9f31-ea6342798a55 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:50.429546 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ec7de04f-75bd-4e97-99f8-1ad7f6237886 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a52352ab894e8f88be0f9d1cef0b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e32df90da6b43b7b8a562dd95e6833b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:50.439497 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ec7de04f-75bd-4e97-99f8-1ad7f6237886 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] 10.222.0.33 "GET /compute/v2.1/servers/0ecb44a6-a97f-4177-aa9a-29a5b9b51a95" status: 200 len: 1271 microversion: 2.1 time: 0.201312 Sep 23 04:49:50.440841 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2027/4166] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:49:50 2022] GET /compute/v2.1/servers/0ecb44a6-a97f-4177-aa9a-29a5b9b51a95 => generated 1271 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:49:50.447357 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-41061fd2-d5f2-494c-926c-3d29581fb781 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:50.448308 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-41061fd2-d5f2-494c-926c-3d29581fb781 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] [instance: e6610a41-bbef-4646-80f3-82446c38bbf5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:50.455010 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-41061fd2-d5f2-494c-926c-3d29581fb781 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:50.455861 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-41061fd2-d5f2-494c-926c-3d29581fb781 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:50.456474 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-41061fd2-d5f2-494c-926c-3d29581fb781 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:50.457334 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-41061fd2-d5f2-494c-926c-3d29581fb781 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:50.458753 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-41061fd2-d5f2-494c-926c-3d29581fb781 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:50.459358 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-41061fd2-d5f2-494c-926c-3d29581fb781 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:50.502921 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c9031f01-1af4-4f9e-9f31-ea6342798a55 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:50.518138 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c9031f01-1af4-4f9e-9f31-ea6342798a55 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:50.528827 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c9031f01-1af4-4f9e-9f31-ea6342798a55 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:50.530102 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c9031f01-1af4-4f9e-9f31-ea6342798a55 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9" status: 200 len: 1809 microversion: 2.20 time: 0.310528 Sep 23 04:49:50.541113 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2140/4167] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:49:50 2022] GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9 => generated 1809 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:49:50.570240 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-541a0767-caf8-4582-9297-5b291ff5d03b tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:50.571034 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-541a0767-caf8-4582-9297-5b291ff5d03b tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: c4464422-9bf1-4aaa-806c-d7063e284579] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:50.600620 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-541a0767-caf8-4582-9297-5b291ff5d03b tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:50.603363 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-541a0767-caf8-4582-9297-5b291ff5d03b tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:50.621325 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-541a0767-caf8-4582-9297-5b291ff5d03b tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:50.624392 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-541a0767-caf8-4582-9297-5b291ff5d03b tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:50.628065 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-541a0767-caf8-4582-9297-5b291ff5d03b tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:50.633935 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-541a0767-caf8-4582-9297-5b291ff5d03b tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:50.812880 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-41061fd2-d5f2-494c-926c-3d29581fb781 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d728817c4f74e579eab88b62f73d08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaa3a17b8a24f8087a5748f83d377e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:50.830849 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-41061fd2-d5f2-494c-926c-3d29581fb781 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] 10.222.0.33 "GET /compute/v2.1/servers/e6610a41-bbef-4646-80f3-82446c38bbf5" status: 200 len: 1395 microversion: 2.1 time: 0.388441 Sep 23 04:49:50.831681 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2028/4168] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:49:50 2022] GET /compute/v2.1/servers/e6610a41-bbef-4646-80f3-82446c38bbf5 => generated 1395 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:49:50.919824 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-541a0767-caf8-4582-9297-5b291ff5d03b tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c786bbedc21849ea92924139a44707b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcafb05f6f554e278cd552023947c6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:50.937938 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-541a0767-caf8-4582-9297-5b291ff5d03b tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579" status: 200 len: 1736 microversion: 2.1 time: 0.371424 Sep 23 04:49:50.937938 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2141/4169] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:49:50 2022] GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579 => generated 1736 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:49:51.250834 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7b05fcdc-363b-43e5-8355-e609471b2b6c tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:51.252415 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7b05fcdc-363b-43e5-8355-e609471b2b6c tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:51.254106 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-64278f5c-83cf-4efa-a5e7-3dd7c84ccc5b tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:51.255104 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-64278f5c-83cf-4efa-a5e7-3dd7c84ccc5b tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: 9d5576c0-2aa8-4ca0-aed6-22c1f0700755] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:51.263257 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7b05fcdc-363b-43e5-8355-e609471b2b6c tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:51.264490 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7b05fcdc-363b-43e5-8355-e609471b2b6c tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:51.265378 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7b05fcdc-363b-43e5-8355-e609471b2b6c tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:51.266796 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7b05fcdc-363b-43e5-8355-e609471b2b6c tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:51.268026 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7b05fcdc-363b-43e5-8355-e609471b2b6c tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:51.269147 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7b05fcdc-363b-43e5-8355-e609471b2b6c tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:51.271311 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-64278f5c-83cf-4efa-a5e7-3dd7c84ccc5b tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:51.272835 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-64278f5c-83cf-4efa-a5e7-3dd7c84ccc5b tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:51.277311 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-64278f5c-83cf-4efa-a5e7-3dd7c84ccc5b tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:51.280611 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-64278f5c-83cf-4efa-a5e7-3dd7c84ccc5b tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:51.281319 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-64278f5c-83cf-4efa-a5e7-3dd7c84ccc5b tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:51.282011 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-64278f5c-83cf-4efa-a5e7-3dd7c84ccc5b tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:51.584664 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-64278f5c-83cf-4efa-a5e7-3dd7c84ccc5b tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:51.603621 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-64278f5c-83cf-4efa-a5e7-3dd7c84ccc5b tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/9d5576c0-2aa8-4ca0-aed6-22c1f0700755" status: 200 len: 1315 microversion: 2.1 time: 0.354430 Sep 23 04:49:51.607744 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2142/4170] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:49:51 2022] GET /compute/v2.1/servers/9d5576c0-2aa8-4ca0-aed6-22c1f0700755 => generated 1315 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:49:51.617315 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-7b05fcdc-363b-43e5-8355-e609471b2b6c tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:51.619881 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-60d78702-71f6-4eb1-aebf-fb4d1a2f034f tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:51.621052 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-60d78702-71f6-4eb1-aebf-fb4d1a2f034f tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] [instance: 0ecb44a6-a97f-4177-aa9a-29a5b9b51a95] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:51.630257 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7b05fcdc-363b-43e5-8355-e609471b2b6c tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1672 microversion: 2.1 time: 0.386062 Sep 23 04:49:51.643716 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2029/4171] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:49:51 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1672 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:49:51.644773 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-60d78702-71f6-4eb1-aebf-fb4d1a2f034f tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:51.646489 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-60d78702-71f6-4eb1-aebf-fb4d1a2f034f tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:51.657502 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-60d78702-71f6-4eb1-aebf-fb4d1a2f034f tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:51.657684 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6d6b5995-bbd1-4cec-841e-c6d3426eefca tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:51.657684 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-6d6b5995-bbd1-4cec-841e-c6d3426eefca tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: fe7dee09-8351-4d41-8c44-8d35a966cce9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:51.667983 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-60d78702-71f6-4eb1-aebf-fb4d1a2f034f tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:51.667983 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-60d78702-71f6-4eb1-aebf-fb4d1a2f034f tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:51.667983 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-60d78702-71f6-4eb1-aebf-fb4d1a2f034f tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:51.674538 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6d6b5995-bbd1-4cec-841e-c6d3426eefca tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:51.678740 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6d6b5995-bbd1-4cec-841e-c6d3426eefca tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:51.682627 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6d6b5995-bbd1-4cec-841e-c6d3426eefca tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:51.683974 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6d6b5995-bbd1-4cec-841e-c6d3426eefca tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:51.687687 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6d6b5995-bbd1-4cec-841e-c6d3426eefca tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:51.688318 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6d6b5995-bbd1-4cec-841e-c6d3426eefca tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:51.954088 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-60d78702-71f6-4eb1-aebf-fb4d1a2f034f tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a52352ab894e8f88be0f9d1cef0b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e32df90da6b43b7b8a562dd95e6833b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:51.956241 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6d6b5995-bbd1-4cec-841e-c6d3426eefca tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:51.965715 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-60d78702-71f6-4eb1-aebf-fb4d1a2f034f tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] 10.222.0.33 "GET /compute/v2.1/servers/0ecb44a6-a97f-4177-aa9a-29a5b9b51a95" status: 200 len: 1313 microversion: 2.1 time: 0.356593 Sep 23 04:49:51.966510 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2143/4172] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:49:51 2022] GET /compute/v2.1/servers/0ecb44a6-a97f-4177-aa9a-29a5b9b51a95 => generated 1313 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:49:51.973471 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6d6b5995-bbd1-4cec-841e-c6d3426eefca tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:51.974985 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6d6b5995-bbd1-4cec-841e-c6d3426eefca tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:51.976249 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-6d6b5995-bbd1-4cec-841e-c6d3426eefca tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9" status: 200 len: 1809 microversion: 2.20 time: 0.335846 Sep 23 04:49:51.976814 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2030/4173] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:49:51 2022] GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9 => generated 1809 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:49:51.995316 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4b99e0d2-4fa0-4c5b-84d5-6a300d51e761 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:51.998674 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4b99e0d2-4fa0-4c5b-84d5-6a300d51e761 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: c4464422-9bf1-4aaa-806c-d7063e284579] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:52.006406 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3d5e8410-b907-41d7-9a26-8987aa55fe4d tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:52.007111 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-3d5e8410-b907-41d7-9a26-8987aa55fe4d tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] [instance: e6610a41-bbef-4646-80f3-82446c38bbf5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:52.007875 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4b99e0d2-4fa0-4c5b-84d5-6a300d51e761 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:52.016469 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4b99e0d2-4fa0-4c5b-84d5-6a300d51e761 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:52.016813 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4b99e0d2-4fa0-4c5b-84d5-6a300d51e761 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:52.017206 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3d5e8410-b907-41d7-9a26-8987aa55fe4d tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:52.017730 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3d5e8410-b907-41d7-9a26-8987aa55fe4d tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:52.018807 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4b99e0d2-4fa0-4c5b-84d5-6a300d51e761 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:52.019860 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3d5e8410-b907-41d7-9a26-8987aa55fe4d tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:52.020855 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4b99e0d2-4fa0-4c5b-84d5-6a300d51e761 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:52.021352 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4b99e0d2-4fa0-4c5b-84d5-6a300d51e761 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:52.023690 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3d5e8410-b907-41d7-9a26-8987aa55fe4d tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:52.026171 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3d5e8410-b907-41d7-9a26-8987aa55fe4d tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:52.026999 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3d5e8410-b907-41d7-9a26-8987aa55fe4d tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:52.546839 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4b99e0d2-4fa0-4c5b-84d5-6a300d51e761 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c786bbedc21849ea92924139a44707b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcafb05f6f554e278cd552023947c6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:52.568095 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4b99e0d2-4fa0-4c5b-84d5-6a300d51e761 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579" status: 200 len: 1736 microversion: 2.1 time: 0.587127 Sep 23 04:49:52.583582 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2031/4174] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:49:51 2022] GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579 => generated 1736 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:49:52.627191 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-3d5e8410-b907-41d7-9a26-8987aa55fe4d tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d728817c4f74e579eab88b62f73d08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaa3a17b8a24f8087a5748f83d377e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:52.634279 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-238f5a5f-1e94-4e40-af1d-67a78e7882da tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:52.634918 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-238f5a5f-1e94-4e40-af1d-67a78e7882da tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: 9d5576c0-2aa8-4ca0-aed6-22c1f0700755] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:52.643429 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3d5e8410-b907-41d7-9a26-8987aa55fe4d tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] 10.222.0.33 "GET /compute/v2.1/servers/e6610a41-bbef-4646-80f3-82446c38bbf5" status: 200 len: 1395 microversion: 2.1 time: 0.647631 Sep 23 04:49:52.658275 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-238f5a5f-1e94-4e40-af1d-67a78e7882da tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:52.658275 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-238f5a5f-1e94-4e40-af1d-67a78e7882da tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:52.658275 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-238f5a5f-1e94-4e40-af1d-67a78e7882da tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:52.658275 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-238f5a5f-1e94-4e40-af1d-67a78e7882da tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:52.658275 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-238f5a5f-1e94-4e40-af1d-67a78e7882da tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:52.658275 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-238f5a5f-1e94-4e40-af1d-67a78e7882da tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:52.660208 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2144/4175] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:49:51 2022] GET /compute/v2.1/servers/e6610a41-bbef-4646-80f3-82446c38bbf5 => generated 1395 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:49:52.685245 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b30bfcd5-beec-4d39-9c68-5c36eeda4e3c tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:52.686038 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b30bfcd5-beec-4d39-9c68-5c36eeda4e3c tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:52.695433 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b30bfcd5-beec-4d39-9c68-5c36eeda4e3c tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:52.696055 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b30bfcd5-beec-4d39-9c68-5c36eeda4e3c tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:52.697650 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b30bfcd5-beec-4d39-9c68-5c36eeda4e3c tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:52.698554 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b30bfcd5-beec-4d39-9c68-5c36eeda4e3c tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:52.706896 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b30bfcd5-beec-4d39-9c68-5c36eeda4e3c tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:52.708483 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b30bfcd5-beec-4d39-9c68-5c36eeda4e3c tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:53.216965 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-238f5a5f-1e94-4e40-af1d-67a78e7882da tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:53.232008 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-238f5a5f-1e94-4e40-af1d-67a78e7882da tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/9d5576c0-2aa8-4ca0-aed6-22c1f0700755" status: 200 len: 1315 microversion: 2.1 time: 0.601360 Sep 23 04:49:53.234723 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2032/4176] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:49:52 2022] GET /compute/v2.1/servers/9d5576c0-2aa8-4ca0-aed6-22c1f0700755 => generated 1315 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:49:53.256000 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-6dbd1815-f4c8-4e81-b20e-17ed499c2fda req-878cf99b-accc-4590-8d67-9852c537561d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6610a41-bbef-4646-80f3-82446c38bbf5", "name": "network-vif-plugged", "status": "completed", "tag": "976d0405-5d6c-4b74-9881-61506bb68a99"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:49:53.282935 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:49:53.289318 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-6dbd1815-f4c8-4e81-b20e-17ed499c2fda req-878cf99b-accc-4590-8d67-9852c537561d service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:53.289827 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-6dbd1815-f4c8-4e81-b20e-17ed499c2fda req-878cf99b-accc-4590-8d67-9852c537561d service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:53.290300 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-6dbd1815-f4c8-4e81-b20e-17ed499c2fda req-878cf99b-accc-4590-8d67-9852c537561d service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:53.332347 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b30bfcd5-beec-4d39-9c68-5c36eeda4e3c tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:53.335650 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-6dbd1815-f4c8-4e81-b20e-17ed499c2fda req-878cf99b-accc-4590-8d67-9852c537561d service nova] Creating event network-vif-plugged:976d0405-5d6c-4b74-9881-61506bb68a99 for instance e6610a41-bbef-4646-80f3-82446c38bbf5 on n-h2-846463-3 Sep 23 04:49:53.341155 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b30bfcd5-beec-4d39-9c68-5c36eeda4e3c tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1672 microversion: 2.1 time: 0.662017 Sep 23 04:49:53.342265 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-6dbd1815-f4c8-4e81-b20e-17ed499c2fda req-878cf99b-accc-4590-8d67-9852c537561d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105549 Sep 23 04:49:53.343040 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2033/4177] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:49:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:49:53.345227 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2145/4178] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:49:52 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1672 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:49:53.360023 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c1a0364b-5b74-4ef8-8f7f-cfea940e213c tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:53.360023 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c1a0364b-5b74-4ef8-8f7f-cfea940e213c tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: fe7dee09-8351-4d41-8c44-8d35a966cce9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:53.376664 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c1a0364b-5b74-4ef8-8f7f-cfea940e213c tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:53.377653 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c1a0364b-5b74-4ef8-8f7f-cfea940e213c tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:53.382701 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c1a0364b-5b74-4ef8-8f7f-cfea940e213c tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:53.382701 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c1a0364b-5b74-4ef8-8f7f-cfea940e213c tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:53.382701 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c1a0364b-5b74-4ef8-8f7f-cfea940e213c tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:53.382701 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c1a0364b-5b74-4ef8-8f7f-cfea940e213c tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:53.393284 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-fc3f41b5-5d13-4c52-9b3e-5b7d5bc6587c tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:53.395750 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-fc3f41b5-5d13-4c52-9b3e-5b7d5bc6587c tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] [instance: 0ecb44a6-a97f-4177-aa9a-29a5b9b51a95] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:53.413224 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fc3f41b5-5d13-4c52-9b3e-5b7d5bc6587c tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:53.413991 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fc3f41b5-5d13-4c52-9b3e-5b7d5bc6587c tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:53.415979 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fc3f41b5-5d13-4c52-9b3e-5b7d5bc6587c tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:53.418013 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fc3f41b5-5d13-4c52-9b3e-5b7d5bc6587c tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:53.418922 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fc3f41b5-5d13-4c52-9b3e-5b7d5bc6587c tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:53.420925 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fc3f41b5-5d13-4c52-9b3e-5b7d5bc6587c tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:53.993108 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-fc3f41b5-5d13-4c52-9b3e-5b7d5bc6587c tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a52352ab894e8f88be0f9d1cef0b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e32df90da6b43b7b8a562dd95e6833b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:54.000050 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c1a0364b-5b74-4ef8-8f7f-cfea940e213c tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:54.004469 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-fc3f41b5-5d13-4c52-9b3e-5b7d5bc6587c tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] 10.222.0.33 "GET /compute/v2.1/servers/0ecb44a6-a97f-4177-aa9a-29a5b9b51a95" status: 200 len: 1334 microversion: 2.1 time: 0.659482 Sep 23 04:49:54.021506 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c1a0364b-5b74-4ef8-8f7f-cfea940e213c tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:54.029399 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2034/4179] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:49:53 2022] GET /compute/v2.1/servers/0ecb44a6-a97f-4177-aa9a-29a5b9b51a95 => generated 1334 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:49:54.031474 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c1a0364b-5b74-4ef8-8f7f-cfea940e213c tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:54.033587 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c1a0364b-5b74-4ef8-8f7f-cfea940e213c tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9" status: 200 len: 1809 microversion: 2.20 time: 0.683561 Sep 23 04:49:54.033587 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2146/4180] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:49:53 2022] GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9 => generated 1809 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:49:54.039053 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c1682240-096f-441e-ac24-c0ed4b15fbd4 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:54.050810 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c1682240-096f-441e-ac24-c0ed4b15fbd4 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] [instance: e6610a41-bbef-4646-80f3-82446c38bbf5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:54.060541 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c1682240-096f-441e-ac24-c0ed4b15fbd4 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:54.061214 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c1682240-096f-441e-ac24-c0ed4b15fbd4 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:54.061871 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c1682240-096f-441e-ac24-c0ed4b15fbd4 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:54.062813 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c1682240-096f-441e-ac24-c0ed4b15fbd4 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:54.063431 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c1682240-096f-441e-ac24-c0ed4b15fbd4 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:54.064005 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-040d9a99-7344-4d01-8800-a5a94c9e2353 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:54.064153 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c1682240-096f-441e-ac24-c0ed4b15fbd4 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:54.064914 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-040d9a99-7344-4d01-8800-a5a94c9e2353 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: c4464422-9bf1-4aaa-806c-d7063e284579] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:54.073565 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-040d9a99-7344-4d01-8800-a5a94c9e2353 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:54.074357 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-040d9a99-7344-4d01-8800-a5a94c9e2353 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:54.074970 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-040d9a99-7344-4d01-8800-a5a94c9e2353 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:54.077578 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-040d9a99-7344-4d01-8800-a5a94c9e2353 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:54.078239 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-040d9a99-7344-4d01-8800-a5a94c9e2353 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:54.079498 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-040d9a99-7344-4d01-8800-a5a94c9e2353 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:54.530509 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c1682240-096f-441e-ac24-c0ed4b15fbd4 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d728817c4f74e579eab88b62f73d08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaa3a17b8a24f8087a5748f83d377e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:54.549707 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c1682240-096f-441e-ac24-c0ed4b15fbd4 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] 10.222.0.33 "GET /compute/v2.1/servers/e6610a41-bbef-4646-80f3-82446c38bbf5" status: 200 len: 1395 microversion: 2.1 time: 0.513704 Sep 23 04:49:54.565086 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2147/4181] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:49:54 2022] GET /compute/v2.1/servers/e6610a41-bbef-4646-80f3-82446c38bbf5 => generated 1395 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:49:54.565086 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5af1adc4-3657-4e9d-9e09-a9732043c211 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:54.565086 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-5af1adc4-3657-4e9d-9e09-a9732043c211 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: 9d5576c0-2aa8-4ca0-aed6-22c1f0700755] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:54.567967 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5af1adc4-3657-4e9d-9e09-a9732043c211 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:54.569100 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5af1adc4-3657-4e9d-9e09-a9732043c211 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:54.569773 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5af1adc4-3657-4e9d-9e09-a9732043c211 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:54.570919 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5af1adc4-3657-4e9d-9e09-a9732043c211 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:54.571396 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5af1adc4-3657-4e9d-9e09-a9732043c211 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:54.572012 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5af1adc4-3657-4e9d-9e09-a9732043c211 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:54.579076 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=100 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:49:54.579527 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-040d9a99-7344-4d01-8800-a5a94c9e2353 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c786bbedc21849ea92924139a44707b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcafb05f6f554e278cd552023947c6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:54.590293 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-040d9a99-7344-4d01-8800-a5a94c9e2353 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579" status: 200 len: 1736 microversion: 2.1 time: 0.559881 Sep 23 04:49:54.591387 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2035/4182] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:49:54 2022] GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579 => generated 1736 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:49:54.596194 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-cd091da9-5b01-4bd4-989c-6d032cae9808 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:54.597011 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-cd091da9-5b01-4bd4-989c-6d032cae9808 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:54.609416 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cd091da9-5b01-4bd4-989c-6d032cae9808 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:54.609944 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cd091da9-5b01-4bd4-989c-6d032cae9808 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:54.610879 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cd091da9-5b01-4bd4-989c-6d032cae9808 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:54.618606 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cd091da9-5b01-4bd4-989c-6d032cae9808 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:54.618606 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cd091da9-5b01-4bd4-989c-6d032cae9808 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:54.618606 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cd091da9-5b01-4bd4-989c-6d032cae9808 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:55.256758 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-5af1adc4-3657-4e9d-9e09-a9732043c211 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:55.268355 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5af1adc4-3657-4e9d-9e09-a9732043c211 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/9d5576c0-2aa8-4ca0-aed6-22c1f0700755" status: 200 len: 1315 microversion: 2.1 time: 0.715679 Sep 23 04:49:55.269007 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2148/4183] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:49:54 2022] GET /compute/v2.1/servers/9d5576c0-2aa8-4ca0-aed6-22c1f0700755 => generated 1315 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:49:55.285551 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-cd091da9-5b01-4bd4-989c-6d032cae9808 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:55.285838 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b44f7828-7447-44f6-921a-8a551df42c6f tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:55.285975 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b44f7828-7447-44f6-921a-8a551df42c6f tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] [instance: 0ecb44a6-a97f-4177-aa9a-29a5b9b51a95] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:55.296556 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-cd091da9-5b01-4bd4-989c-6d032cae9808 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1670 microversion: 2.1 time: 0.702775 Sep 23 04:49:55.296556 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2036/4184] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:49:54 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1670 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:49:55.306070 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-22dd3722-7baf-4e21-96b3-da85a7db4a6c tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:55.306682 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-22dd3722-7baf-4e21-96b3-da85a7db4a6c tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: fe7dee09-8351-4d41-8c44-8d35a966cce9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:55.306849 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b44f7828-7447-44f6-921a-8a551df42c6f tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:55.307483 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b44f7828-7447-44f6-921a-8a551df42c6f tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:55.308925 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b44f7828-7447-44f6-921a-8a551df42c6f tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:55.312141 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b44f7828-7447-44f6-921a-8a551df42c6f tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:55.312772 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b44f7828-7447-44f6-921a-8a551df42c6f tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:55.313379 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b44f7828-7447-44f6-921a-8a551df42c6f tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:55.314078 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:49:55.340175 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-22dd3722-7baf-4e21-96b3-da85a7db4a6c tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:55.341015 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-22dd3722-7baf-4e21-96b3-da85a7db4a6c tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:55.341637 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-22dd3722-7baf-4e21-96b3-da85a7db4a6c tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:55.342639 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-22dd3722-7baf-4e21-96b3-da85a7db4a6c tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:55.348143 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-22dd3722-7baf-4e21-96b3-da85a7db4a6c tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:55.348143 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-22dd3722-7baf-4e21-96b3-da85a7db4a6c tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:55.633481 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-22dd3722-7baf-4e21-96b3-da85a7db4a6c tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:55.643411 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-22dd3722-7baf-4e21-96b3-da85a7db4a6c tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:55.645501 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-22dd3722-7baf-4e21-96b3-da85a7db4a6c tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:55.657639 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-22dd3722-7baf-4e21-96b3-da85a7db4a6c tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9" status: 200 len: 1796 microversion: 2.20 time: 0.360496 Sep 23 04:49:55.658506 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2037/4185] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:49:55 2022] GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9 => generated 1796 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:49:55.673278 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8ab577c2-aabd-4470-927d-0e11fe71fea6 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:49:55.675808 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8ab577c2-aabd-4470-927d-0e11fe71fea6 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:55.698495 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8ab577c2-aabd-4470-927d-0e11fe71fea6 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:55.699002 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8ab577c2-aabd-4470-927d-0e11fe71fea6 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:55.699450 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8ab577c2-aabd-4470-927d-0e11fe71fea6 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:55.700190 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8ab577c2-aabd-4470-927d-0e11fe71fea6 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:55.700651 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8ab577c2-aabd-4470-927d-0e11fe71fea6 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:55.701080 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8ab577c2-aabd-4470-927d-0e11fe71fea6 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:55.792316 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8ab577c2-aabd-4470-927d-0e11fe71fea6 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "POST /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5/action" status: 200 len: 322 microversion: 2.1 time: 0.131750 Sep 23 04:49:55.792867 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2038/4186] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:49:55 2022] POST /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5/action => generated 322 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:49:55.801654 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ba87a071-2596-48c4-812c-61d22baf0e02 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:55.802991 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-ba87a071-2596-48c4-812c-61d22baf0e02 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] [instance: e6610a41-bbef-4646-80f3-82446c38bbf5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:55.818915 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ba87a071-2596-48c4-812c-61d22baf0e02 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:55.819406 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ba87a071-2596-48c4-812c-61d22baf0e02 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:55.819864 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ba87a071-2596-48c4-812c-61d22baf0e02 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:55.820688 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ba87a071-2596-48c4-812c-61d22baf0e02 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:55.821565 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ba87a071-2596-48c4-812c-61d22baf0e02 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:55.822042 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ba87a071-2596-48c4-812c-61d22baf0e02 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:55.878000 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b44f7828-7447-44f6-921a-8a551df42c6f tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a52352ab894e8f88be0f9d1cef0b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e32df90da6b43b7b8a562dd95e6833b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:55.888746 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b44f7828-7447-44f6-921a-8a551df42c6f tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] 10.222.0.33 "GET /compute/v2.1/servers/0ecb44a6-a97f-4177-aa9a-29a5b9b51a95" status: 200 len: 1355 microversion: 2.1 time: 0.618686 Sep 23 04:49:55.889599 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2149/4187] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:49:55 2022] GET /compute/v2.1/servers/0ecb44a6-a97f-4177-aa9a-29a5b9b51a95 => generated 1355 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:49:55.895898 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6779f5c3-19b5-4517-857f-c502911cd5a3 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:55.896829 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-6779f5c3-19b5-4517-857f-c502911cd5a3 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: c4464422-9bf1-4aaa-806c-d7063e284579] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:55.903872 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:49:55.906615 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6779f5c3-19b5-4517-857f-c502911cd5a3 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:55.907312 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6779f5c3-19b5-4517-857f-c502911cd5a3 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:55.908497 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6779f5c3-19b5-4517-857f-c502911cd5a3 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:55.908954 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6779f5c3-19b5-4517-857f-c502911cd5a3 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:55.912714 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6779f5c3-19b5-4517-857f-c502911cd5a3 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:55.914936 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6779f5c3-19b5-4517-857f-c502911cd5a3 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:56.147161 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ba87a071-2596-48c4-812c-61d22baf0e02 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d728817c4f74e579eab88b62f73d08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaa3a17b8a24f8087a5748f83d377e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:56.157879 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-6779f5c3-19b5-4517-857f-c502911cd5a3 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c786bbedc21849ea92924139a44707b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcafb05f6f554e278cd552023947c6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:56.158600 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ba87a071-2596-48c4-812c-61d22baf0e02 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] 10.222.0.33 "GET /compute/v2.1/servers/e6610a41-bbef-4646-80f3-82446c38bbf5" status: 200 len: 1574 microversion: 2.1 time: 0.364103 Sep 23 04:49:56.186955 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6779f5c3-19b5-4517-857f-c502911cd5a3 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579" status: 200 len: 1736 microversion: 2.1 time: 0.295843 Sep 23 04:49:56.188151 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2039/4188] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:49:55 2022] GET /compute/v2.1/servers/e6610a41-bbef-4646-80f3-82446c38bbf5 => generated 1574 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:49:56.196791 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9cd995bb-6899-4b00-a851-c3c3b0cce8c7 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:56.197625 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-9cd995bb-6899-4b00-a851-c3c3b0cce8c7 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:56.201093 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2150/4189] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:49:55 2022] GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579 => generated 1736 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:49:56.208579 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9cd995bb-6899-4b00-a851-c3c3b0cce8c7 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:56.210612 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9cd995bb-6899-4b00-a851-c3c3b0cce8c7 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:56.211170 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9cd995bb-6899-4b00-a851-c3c3b0cce8c7 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:56.211905 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9cd995bb-6899-4b00-a851-c3c3b0cce8c7 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:56.212462 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9cd995bb-6899-4b00-a851-c3c3b0cce8c7 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:56.213521 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9cd995bb-6899-4b00-a851-c3c3b0cce8c7 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:56.214691 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1f157d3b-c4df-42f7-8b98-940a855e7529 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:56.215775 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1f157d3b-c4df-42f7-8b98-940a855e7529 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] [instance: e6610a41-bbef-4646-80f3-82446c38bbf5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:56.223554 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1f157d3b-c4df-42f7-8b98-940a855e7529 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:56.224382 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1f157d3b-c4df-42f7-8b98-940a855e7529 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:56.225034 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1f157d3b-c4df-42f7-8b98-940a855e7529 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:56.226371 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1f157d3b-c4df-42f7-8b98-940a855e7529 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:56.227050 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1f157d3b-c4df-42f7-8b98-940a855e7529 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:56.227756 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1f157d3b-c4df-42f7-8b98-940a855e7529 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:56.367809 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1f157d3b-c4df-42f7-8b98-940a855e7529 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] 10.222.0.33 "GET /compute/v2.1/servers/e6610a41-bbef-4646-80f3-82446c38bbf5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.164645 Sep 23 04:49:56.368848 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2151/4190] 10.222.0.33 () {58 vars in 1275 bytes} [Fri Sep 23 04:49:56 2022] GET /compute/v2.1/servers/e6610a41-bbef-4646-80f3-82446c38bbf5/os-interface => generated 284 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:49:56.374073 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d7c0ea10-8be1-434e-916e-01550e13dd8a tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:56.374936 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d7c0ea10-8be1-434e-916e-01550e13dd8a tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: 9d5576c0-2aa8-4ca0-aed6-22c1f0700755] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:56.385239 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d7c0ea10-8be1-434e-916e-01550e13dd8a tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:56.386608 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d7c0ea10-8be1-434e-916e-01550e13dd8a tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:56.387515 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d7c0ea10-8be1-434e-916e-01550e13dd8a tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:56.395098 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d7c0ea10-8be1-434e-916e-01550e13dd8a tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:56.395098 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d7c0ea10-8be1-434e-916e-01550e13dd8a tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:56.395098 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d7c0ea10-8be1-434e-916e-01550e13dd8a tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:56.564511 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=20 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:49:56.597574 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=6 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:49:56.625879 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-9cd995bb-6899-4b00-a851-c3c3b0cce8c7 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:56.647118 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9cd995bb-6899-4b00-a851-c3c3b0cce8c7 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1670 microversion: 2.1 time: 0.457145 Sep 23 04:49:56.651113 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2040/4191] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:49:56 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1670 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:49:56.680643 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9f7b8748-dace-49e4-b10f-d9e9ba213c95 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:56.681269 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-9f7b8748-dace-49e4-b10f-d9e9ba213c95 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:56.699052 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9f7b8748-dace-49e4-b10f-d9e9ba213c95 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:56.699637 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9f7b8748-dace-49e4-b10f-d9e9ba213c95 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:56.700799 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9f7b8748-dace-49e4-b10f-d9e9ba213c95 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:56.702413 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9f7b8748-dace-49e4-b10f-d9e9ba213c95 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:56.703678 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9f7b8748-dace-49e4-b10f-d9e9ba213c95 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:56.705124 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9f7b8748-dace-49e4-b10f-d9e9ba213c95 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:56.816750 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d7c0ea10-8be1-434e-916e-01550e13dd8a tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:56.827577 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d7c0ea10-8be1-434e-916e-01550e13dd8a tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/9d5576c0-2aa8-4ca0-aed6-22c1f0700755" status: 200 len: 1315 microversion: 2.1 time: 0.457150 Sep 23 04:49:56.828392 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2152/4192] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:49:56 2022] GET /compute/v2.1/servers/9d5576c0-2aa8-4ca0-aed6-22c1f0700755 => generated 1315 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:49:56.921494 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-803cebed-4a2d-458b-b83d-85507832c60a tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:56.922565 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-803cebed-4a2d-458b-b83d-85507832c60a tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] [instance: 0ecb44a6-a97f-4177-aa9a-29a5b9b51a95] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:56.935294 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-803cebed-4a2d-458b-b83d-85507832c60a tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:56.935849 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-803cebed-4a2d-458b-b83d-85507832c60a tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:56.936300 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-803cebed-4a2d-458b-b83d-85507832c60a tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:56.950126 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-803cebed-4a2d-458b-b83d-85507832c60a tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:56.950642 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-803cebed-4a2d-458b-b83d-85507832c60a tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:56.951099 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-803cebed-4a2d-458b-b83d-85507832c60a tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:57.119023 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-9f7b8748-dace-49e4-b10f-d9e9ba213c95 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:57.122558 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:49:57.129162 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9f7b8748-dace-49e4-b10f-d9e9ba213c95 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1670 microversion: 2.1 time: 0.451972 Sep 23 04:49:57.129713 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2041/4193] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:49:56 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1670 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:49:57.147625 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-171e8756-775d-4681-8ff3-f928fdc96fac req-19fac285-0fac-43e9-8b38-d3daa617af1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d5576c0-2aa8-4ca0-aed6-22c1f0700755", "name": "network-vif-plugged", "status": "completed", "tag": "ff157d85-3ffd-4186-931e-da7ddbdf0398"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:49:57.160094 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-171e8756-775d-4681-8ff3-f928fdc96fac req-19fac285-0fac-43e9-8b38-d3daa617af1f service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:57.161560 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-171e8756-775d-4681-8ff3-f928fdc96fac req-19fac285-0fac-43e9-8b38-d3daa617af1f service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:57.163362 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-171e8756-775d-4681-8ff3-f928fdc96fac req-19fac285-0fac-43e9-8b38-d3daa617af1f service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:57.192078 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-171e8756-775d-4681-8ff3-f928fdc96fac req-19fac285-0fac-43e9-8b38-d3daa617af1f service nova] Creating event network-vif-plugged:ff157d85-3ffd-4186-931e-da7ddbdf0398 for instance 9d5576c0-2aa8-4ca0-aed6-22c1f0700755 on n-h2-846463-3 Sep 23 04:49:57.197706 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-171e8756-775d-4681-8ff3-f928fdc96fac req-19fac285-0fac-43e9-8b38-d3daa617af1f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066456 Sep 23 04:49:57.199026 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2042/4194] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:49:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:49:57.205515 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-73359db1-8305-4f0a-bbb0-eb064d031333 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:57.206428 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-73359db1-8305-4f0a-bbb0-eb064d031333 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:57.214553 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-73359db1-8305-4f0a-bbb0-eb064d031333 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:57.216002 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-73359db1-8305-4f0a-bbb0-eb064d031333 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:57.216591 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-73359db1-8305-4f0a-bbb0-eb064d031333 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:57.217601 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-73359db1-8305-4f0a-bbb0-eb064d031333 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:57.219108 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-73359db1-8305-4f0a-bbb0-eb064d031333 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:57.219830 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-73359db1-8305-4f0a-bbb0-eb064d031333 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:57.444462 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-803cebed-4a2d-458b-b83d-85507832c60a tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a52352ab894e8f88be0f9d1cef0b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e32df90da6b43b7b8a562dd95e6833b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:57.459639 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-803cebed-4a2d-458b-b83d-85507832c60a tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] 10.222.0.33 "GET /compute/v2.1/servers/0ecb44a6-a97f-4177-aa9a-29a5b9b51a95" status: 200 len: 1355 microversion: 2.1 time: 0.544785 Sep 23 04:49:57.460233 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2153/4195] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:49:56 2022] GET /compute/v2.1/servers/0ecb44a6-a97f-4177-aa9a-29a5b9b51a95 => generated 1355 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:49:57.470500 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-a9724c8e-3bf2-4238-ae03-f840da906f69 req-4ee5f97c-f1b8-4b9b-88d1-1f601491a345 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ecb44a6-a97f-4177-aa9a-29a5b9b51a95", "tag": "225bcc05-7080-4633-a3f6-391f4277e3c0"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:49:57.512107 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-a9724c8e-3bf2-4238-ae03-f840da906f69 req-4ee5f97c-f1b8-4b9b-88d1-1f601491a345 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:57.516692 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-a9724c8e-3bf2-4238-ae03-f840da906f69 req-4ee5f97c-f1b8-4b9b-88d1-1f601491a345 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:57.520383 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-a9724c8e-3bf2-4238-ae03-f840da906f69 req-4ee5f97c-f1b8-4b9b-88d1-1f601491a345 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:57.548873 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-a9724c8e-3bf2-4238-ae03-f840da906f69 req-4ee5f97c-f1b8-4b9b-88d1-1f601491a345 service nova] Creating event network-changed:225bcc05-7080-4633-a3f6-391f4277e3c0 for instance 0ecb44a6-a97f-4177-aa9a-29a5b9b51a95 on n-h1-846463-3 Sep 23 04:49:57.557855 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-a9724c8e-3bf2-4238-ae03-f840da906f69 req-4ee5f97c-f1b8-4b9b-88d1-1f601491a345 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090350 Sep 23 04:49:57.559148 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2154/4196] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:49:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:49:57.565420 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b8a7dafa-7917-4a8c-b6dd-969c43180f06 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:57.566634 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b8a7dafa-7917-4a8c-b6dd-969c43180f06 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: c4464422-9bf1-4aaa-806c-d7063e284579] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:57.577038 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b8a7dafa-7917-4a8c-b6dd-969c43180f06 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:57.577879 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b8a7dafa-7917-4a8c-b6dd-969c43180f06 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:57.578494 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b8a7dafa-7917-4a8c-b6dd-969c43180f06 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:57.579666 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b8a7dafa-7917-4a8c-b6dd-969c43180f06 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:57.580571 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b8a7dafa-7917-4a8c-b6dd-969c43180f06 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:57.581288 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b8a7dafa-7917-4a8c-b6dd-969c43180f06 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:57.717584 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-73359db1-8305-4f0a-bbb0-eb064d031333 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:57.730553 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-73359db1-8305-4f0a-bbb0-eb064d031333 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1670 microversion: 2.1 time: 0.526300 Sep 23 04:49:57.731891 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2043/4197] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:49:57 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1670 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:49:57.757581 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3d1b2360-2aab-49e7-aab2-ff79799ebc9a tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:57.758242 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3d1b2360-2aab-49e7-aab2-ff79799ebc9a tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:57.766621 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3d1b2360-2aab-49e7-aab2-ff79799ebc9a tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:57.767134 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3d1b2360-2aab-49e7-aab2-ff79799ebc9a tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:57.768225 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3d1b2360-2aab-49e7-aab2-ff79799ebc9a tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:57.769140 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3d1b2360-2aab-49e7-aab2-ff79799ebc9a tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:57.770695 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3d1b2360-2aab-49e7-aab2-ff79799ebc9a tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:57.771482 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3d1b2360-2aab-49e7-aab2-ff79799ebc9a tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:57.848933 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b8a7dafa-7917-4a8c-b6dd-969c43180f06 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c786bbedc21849ea92924139a44707b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcafb05f6f554e278cd552023947c6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:57.858347 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b8a7dafa-7917-4a8c-b6dd-969c43180f06 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579" status: 200 len: 1736 microversion: 2.1 time: 0.297158 Sep 23 04:49:57.870135 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2155/4198] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:49:57 2022] GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579 => generated 1736 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:49:57.878021 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-42c2b91b-2146-46bc-90c3-d7d009a58470 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:57.885770 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-42c2b91b-2146-46bc-90c3-d7d009a58470 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: 9d5576c0-2aa8-4ca0-aed6-22c1f0700755] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:57.899179 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-42c2b91b-2146-46bc-90c3-d7d009a58470 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:57.899975 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-42c2b91b-2146-46bc-90c3-d7d009a58470 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:57.900830 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-42c2b91b-2146-46bc-90c3-d7d009a58470 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:57.902211 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-42c2b91b-2146-46bc-90c3-d7d009a58470 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:57.902918 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-42c2b91b-2146-46bc-90c3-d7d009a58470 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:57.903556 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-42c2b91b-2146-46bc-90c3-d7d009a58470 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:58.027038 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=34 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:49:58.246620 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-3d1b2360-2aab-49e7-aab2-ff79799ebc9a tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:58.256973 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3d1b2360-2aab-49e7-aab2-ff79799ebc9a tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1670 microversion: 2.1 time: 0.506603 Sep 23 04:49:58.257583 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2044/4199] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:49:57 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1670 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:49:58.286143 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-42c2b91b-2146-46bc-90c3-d7d009a58470 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:58.296930 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-42c2b91b-2146-46bc-90c3-d7d009a58470 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/9d5576c0-2aa8-4ca0-aed6-22c1f0700755" status: 200 len: 1315 microversion: 2.1 time: 0.436561 Sep 23 04:49:58.297533 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2156/4200] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:49:57 2022] GET /compute/v2.1/servers/9d5576c0-2aa8-4ca0-aed6-22c1f0700755 => generated 1315 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:49:58.453928 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4525662b-722a-4962-a0bf-0d184b70633a tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-110746981", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "networks": [{"uuid": "c808d35d-7b6c-439e-908b-4f409fd90fd4"}]}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:49:58.487161 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d2d77cb0-068c-46cc-a035-9e3652c4383e tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:58.487744 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d2d77cb0-068c-46cc-a035-9e3652c4383e tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] [instance: 0ecb44a6-a97f-4177-aa9a-29a5b9b51a95] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:58.498908 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d2d77cb0-068c-46cc-a035-9e3652c4383e tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:58.499421 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d2d77cb0-068c-46cc-a035-9e3652c4383e tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:58.499875 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d2d77cb0-068c-46cc-a035-9e3652c4383e tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:58.508705 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d2d77cb0-068c-46cc-a035-9e3652c4383e tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:58.509215 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d2d77cb0-068c-46cc-a035-9e3652c4383e tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:58.512444 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d2d77cb0-068c-46cc-a035-9e3652c4383e tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:58.597667 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.network.neutron [None req-4525662b-722a-4962-a0bf-0d184b70633a tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] validate_networks() for [('c808d35d-7b6c-439e-908b-4f409fd90fd4', None, None, None, None, None)] {{(pid=122698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:49:59.098593 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d2d77cb0-068c-46cc-a035-9e3652c4383e tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a52352ab894e8f88be0f9d1cef0b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e32df90da6b43b7b8a562dd95e6833b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:59.111619 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d2d77cb0-068c-46cc-a035-9e3652c4383e tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] 10.222.0.33 "GET /compute/v2.1/servers/0ecb44a6-a97f-4177-aa9a-29a5b9b51a95" status: 200 len: 1355 microversion: 2.1 time: 0.626891 Sep 23 04:49:59.119434 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2157/4201] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:49:58 2022] GET /compute/v2.1/servers/0ecb44a6-a97f-4177-aa9a-29a5b9b51a95 => generated 1355 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:49:59.125138 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7b550db6-b6fe-4627-847c-128388f8f44f tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:59.126056 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-7b550db6-b6fe-4627-847c-128388f8f44f tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: c4464422-9bf1-4aaa-806c-d7063e284579] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:59.146546 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7b550db6-b6fe-4627-847c-128388f8f44f tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:59.147533 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7b550db6-b6fe-4627-847c-128388f8f44f tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:59.148168 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7b550db6-b6fe-4627-847c-128388f8f44f tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:59.149230 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7b550db6-b6fe-4627-847c-128388f8f44f tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:59.149872 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7b550db6-b6fe-4627-847c-128388f8f44f tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:59.150826 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7b550db6-b6fe-4627-847c-128388f8f44f tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:59.458988 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-7b550db6-b6fe-4627-847c-128388f8f44f tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c786bbedc21849ea92924139a44707b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcafb05f6f554e278cd552023947c6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:59.477617 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-7b550db6-b6fe-4627-847c-128388f8f44f tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579" status: 200 len: 1716 microversion: 2.1 time: 0.349927 Sep 23 04:49:59.486411 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2158/4202] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:49:59 2022] GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579 => generated 1716 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:49:59.503557 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-22f09d69-2274-4923-942e-05ecad7b77ac tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:59.505010 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-22f09d69-2274-4923-942e-05ecad7b77ac tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: 9d5576c0-2aa8-4ca0-aed6-22c1f0700755] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:59.514835 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-22f09d69-2274-4923-942e-05ecad7b77ac tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:59.515543 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-22f09d69-2274-4923-942e-05ecad7b77ac tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:59.516182 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-22f09d69-2274-4923-942e-05ecad7b77ac tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:59.517046 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-22f09d69-2274-4923-942e-05ecad7b77ac tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:59.517685 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-22f09d69-2274-4923-942e-05ecad7b77ac tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:59.518309 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-22f09d69-2274-4923-942e-05ecad7b77ac tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:59.539835 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-4525662b-722a-4962-a0bf-0d184b70633a tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Flavor limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:49:59.541162 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-4525662b-722a-4962-a0bf-0d184b70633a tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Image limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:49:59.541955 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-4525662b-722a-4962-a0bf-0d184b70633a tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Flavor pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:49:59.542525 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-4525662b-722a-4962-a0bf-0d184b70633a tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Image pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:49:59.543095 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-4525662b-722a-4962-a0bf-0d184b70633a tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:49:59.556339 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4525662b-722a-4962-a0bf-0d184b70633a tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:59.557244 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4525662b-722a-4962-a0bf-0d184b70633a tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:59.557915 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4525662b-722a-4962-a0bf-0d184b70633a tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:59.558852 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4525662b-722a-4962-a0bf-0d184b70633a tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:59.559526 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4525662b-722a-4962-a0bf-0d184b70633a tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:59.559978 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4525662b-722a-4962-a0bf-0d184b70633a tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:59.583221 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-4525662b-722a-4962-a0bf-0d184b70633a tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Getting quotas for project 2a45d69316a648fcb9c56190aaec5376. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:49:59.589169 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-4525662b-722a-4962-a0bf-0d184b70633a tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Getting quotas for user f5e3a6e455e8483b8ce93ad380793335 and project 2a45d69316a648fcb9c56190aaec5376. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:49:59.605217 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4525662b-722a-4962-a0bf-0d184b70633a tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Going to run 1 instances... {{(pid=122698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:49:59.607739 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4525662b-722a-4962-a0bf-0d184b70633a tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 30d846a2-5966-4fae-9515-9d873d882e6b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:49:59.777540 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-22f09d69-2274-4923-942e-05ecad7b77ac tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:49:59.797503 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-22f09d69-2274-4923-942e-05ecad7b77ac tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/9d5576c0-2aa8-4ca0-aed6-22c1f0700755" status: 200 len: 1315 microversion: 2.1 time: 0.309520 Sep 23 04:49:59.806849 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2159/4203] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:49:59 2022] GET /compute/v2.1/servers/9d5576c0-2aa8-4ca0-aed6-22c1f0700755 => generated 1315 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:49:59.825540 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6edae052-5c21-4b1a-8440-91b1dd0aba27 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:59.826715 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-6edae052-5c21-4b1a-8440-91b1dd0aba27 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] [instance: e6610a41-bbef-4646-80f3-82446c38bbf5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:59.830320 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4525662b-722a-4962-a0bf-0d184b70633a tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.381471 Sep 23 04:49:59.835109 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6edae052-5c21-4b1a-8440-91b1dd0aba27 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:59.835859 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6edae052-5c21-4b1a-8440-91b1dd0aba27 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:59.836683 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6edae052-5c21-4b1a-8440-91b1dd0aba27 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:59.838038 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6edae052-5c21-4b1a-8440-91b1dd0aba27 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:59.838152 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2045/4204] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:49:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1390 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:49:59.845020 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6edae052-5c21-4b1a-8440-91b1dd0aba27 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:59.845020 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6edae052-5c21-4b1a-8440-91b1dd0aba27 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:59.845224 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-9ea83c75-8ac1-4822-99c8-a7021615e6ec req-8d8cdecb-2e17-415e-bc5d-13ea3faab5c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6610a41-bbef-4646-80f3-82446c38bbf5", "tag": "976d0405-5d6c-4b74-9881-61506bb68a99"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:49:59.855401 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-9ea83c75-8ac1-4822-99c8-a7021615e6ec req-8d8cdecb-2e17-415e-bc5d-13ea3faab5c7 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:59.856259 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-9ea83c75-8ac1-4822-99c8-a7021615e6ec req-8d8cdecb-2e17-415e-bc5d-13ea3faab5c7 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:59.857076 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-9ea83c75-8ac1-4822-99c8-a7021615e6ec req-8d8cdecb-2e17-415e-bc5d-13ea3faab5c7 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:59.872176 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-9ea83c75-8ac1-4822-99c8-a7021615e6ec req-8d8cdecb-2e17-415e-bc5d-13ea3faab5c7 service nova] Creating event network-changed:976d0405-5d6c-4b74-9881-61506bb68a99 for instance e6610a41-bbef-4646-80f3-82446c38bbf5 on n-h2-846463-3 Sep 23 04:49:59.878472 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-9ea83c75-8ac1-4822-99c8-a7021615e6ec req-8d8cdecb-2e17-415e-bc5d-13ea3faab5c7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039061 Sep 23 04:49:59.880430 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2046/4205] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:49:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:49:59.901796 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d54d076c-12ae-40ca-8962-bbc3a22c36c6 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:49:59.902786 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d54d076c-12ae-40ca-8962-bbc3a22c36c6 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: c4464422-9bf1-4aaa-806c-d7063e284579] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:49:59.915098 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d54d076c-12ae-40ca-8962-bbc3a22c36c6 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:59.915882 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d54d076c-12ae-40ca-8962-bbc3a22c36c6 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:59.916555 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d54d076c-12ae-40ca-8962-bbc3a22c36c6 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:49:59.917454 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d54d076c-12ae-40ca-8962-bbc3a22c36c6 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:49:59.918592 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d54d076c-12ae-40ca-8962-bbc3a22c36c6 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:49:59.923868 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d54d076c-12ae-40ca-8962-bbc3a22c36c6 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:00.081381 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-d54d076c-12ae-40ca-8962-bbc3a22c36c6 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] HTTP exception thrown: Cannot 'detach_volume' instance c4464422-9bf1-4aaa-806c-d7063e284579 while it is in vm_state rescued Sep 23 04:50:00.085037 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d54d076c-12ae-40ca-8962-bbc3a22c36c6 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Request method failure captured: Sep 23 04:50:00.085037 n-d-846463-3 devstack@n-api.service[122698]: request: DELETE /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579/os-volume_attachments/755739a7-3c13-4a92-a5c0-91b8d4181c66 HTTP/1.1 Sep 23 04:50:00.085037 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:50:00.085037 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:50:00.085037 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:50:00.085037 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:50:00.085037 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:50:00.085037 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:50:00.085037 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:50:00.085037 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:50:00.085037 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLToEB3KmJeqpeof3qtE1_ms3jD5q4R8EB4mtf6agEJBYOf3R1k1wW8qdql02e7ra521m3dklynQTAHmyD-EBkyV9p_88fIs_nz1LT08tnPBKYcM8ytHDfif-4FU40Ttv4qlVJY_DNQ2W4b2ZBQdDVOwU9-lTsZtqbQggZ1JBKRn9aZQ Sep 23 04:50:00.085037 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:50:00.085037 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:50:00.085037 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:50:00.085037 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:50:00.085037 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:50:00.085037 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:50:00.085037 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: dcafb05f6f554e278cd552023947c6ac Sep 23 04:50:00.085037 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-196358672 Sep 23 04:50:00.085037 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:50:00.085037 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:50:00.085037 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_dcafb05f6f554e278cd552023947c6ac", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dcafb05f6f554e278cd552023947c6ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/dcafb05f6f554e278cd552023947c6ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dcafb05f6f554e278cd552023947c6ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:50:00.085037 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ServerRescueNegativeTestJSON-196358672 Sep 23 04:50:00.085037 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: dcafb05f6f554e278cd552023947c6ac Sep 23 04:50:00.085037 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-196358672 Sep 23 04:50:00.085037 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ServerRescueNegativeTestJSON-196358672-project Sep 23 04:50:00.085037 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:50:00.085037 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:50:00.085037 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: c786bbedc21849ea92924139a44707b7 Sep 23 04:50:00.085037 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ServerRescueNegativeTestJSON-196358672-project Sep 23 04:50:00.085037 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:50:00.085037 n-d-846463-3 devstack@n-api.service[122698]: exception: Cannot 'detach_volume' instance c4464422-9bf1-4aaa-806c-d7063e284579 while it is in vm_state rescued Sep 23 04:50:00.085037 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'server_id': 'c4464422-9bf1-4aaa-806c-d7063e284579', 'id': '755739a7-3c13-4a92-a5c0-91b8d4181c66'} Sep 23 04:50:00.085037 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:50:00.085037 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:00.085037 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 23 04:50:00.085037 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 23 04:50:00.085037 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 23 04:50:00.085037 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 23 04:50:00.085037 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 23 04:50:00.085037 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 23 04:50:00.085037 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c4464422-9bf1-4aaa-806c-d7063e284579 in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 23 04:50:00.085037 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:50:00.085037 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:50:00.085037 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:50:00.085037 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:00.085037 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:50:00.085037 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:50:00.085037 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:50:00.085037 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:50:00.085037 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:50:00.085037 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:50:00.085037 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 23 04:50:00.085037 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 23 04:50:00.085037 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 23 04:50:00.085037 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 23 04:50:00.085037 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance c4464422-9bf1-4aaa-806c-d7063e284579 while it is in vm_state rescued Sep 23 04:50:00.085037 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:50:00.085037 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:50:00.085037 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:50:00.085037 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:00.088481 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:50:00.088481 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:50:00.088481 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:50:00.088481 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:50:00.088481 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance c4464422-9bf1-4aaa-806c-d7063e284579 while it is in vm_state rescued Sep 23 04:50:00.088481 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:50:00.092174 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d54d076c-12ae-40ca-8962-bbc3a22c36c6 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Returning 409 to user: Cannot 'detach_volume' instance c4464422-9bf1-4aaa-806c-d7063e284579 while it is in vm_state rescued {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:50:00.093675 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d54d076c-12ae-40ca-8962-bbc3a22c36c6 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579/os-volume_attachments/755739a7-3c13-4a92-a5c0-91b8d4181c66" status: 409 len: 152 microversion: 2.1 time: 0.211794 Sep 23 04:50:00.095065 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2047/4206] 10.222.0.33 () {58 vars in 1416 bytes} [Fri Sep 23 04:49:59 2022] DELETE /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579/os-volume_attachments/755739a7-3c13-4a92-a5c0-91b8d4181c66 => generated 152 bytes in 214 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 23 04:50:00.103005 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-792b09b9-acff-40d6-aa55-5ebe754eb269 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:00.105073 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-792b09b9-acff-40d6-aa55-5ebe754eb269 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 30d846a2-5966-4fae-9515-9d873d882e6b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:00.137623 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-6edae052-5c21-4b1a-8440-91b1dd0aba27 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d728817c4f74e579eab88b62f73d08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaa3a17b8a24f8087a5748f83d377e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:00.147409 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6edae052-5c21-4b1a-8440-91b1dd0aba27 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] 10.222.0.33 "GET /compute/v2.1/servers/e6610a41-bbef-4646-80f3-82446c38bbf5" status: 200 len: 1574 microversion: 2.1 time: 0.339052 Sep 23 04:50:00.149102 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2160/4207] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:49:59 2022] GET /compute/v2.1/servers/e6610a41-bbef-4646-80f3-82446c38bbf5 => generated 1574 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:00.153914 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-486239ed-9260-45a0-9ade-16ed58c2a091 req-adb70533-a111-4c98-bc08-5adc7e4d1923 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ecb44a6-a97f-4177-aa9a-29a5b9b51a95", "tag": "5e46b412-353a-44c0-b22a-05d9da788ef3"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:50:00.167263 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-486239ed-9260-45a0-9ade-16ed58c2a091 req-adb70533-a111-4c98-bc08-5adc7e4d1923 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:00.169134 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-486239ed-9260-45a0-9ade-16ed58c2a091 req-adb70533-a111-4c98-bc08-5adc7e4d1923 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:00.169134 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-486239ed-9260-45a0-9ade-16ed58c2a091 req-adb70533-a111-4c98-bc08-5adc7e4d1923 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:00.195227 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-486239ed-9260-45a0-9ade-16ed58c2a091 req-adb70533-a111-4c98-bc08-5adc7e4d1923 service nova] Creating event network-changed:5e46b412-353a-44c0-b22a-05d9da788ef3 for instance 0ecb44a6-a97f-4177-aa9a-29a5b9b51a95 on n-h1-846463-3 Sep 23 04:50:00.206401 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-486239ed-9260-45a0-9ade-16ed58c2a091 req-adb70533-a111-4c98-bc08-5adc7e4d1923 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055849 Sep 23 04:50:00.207995 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2161/4208] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:50:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:50:00.213581 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e7165b47-dd6b-4d1d-b587-7e359f3c0e31 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:50:00.214457 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e7165b47-dd6b-4d1d-b587-7e359f3c0e31 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: c4464422-9bf1-4aaa-806c-d7063e284579] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:00.228777 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e7165b47-dd6b-4d1d-b587-7e359f3c0e31 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:00.229012 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-792b09b9-acff-40d6-aa55-5ebe754eb269 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:00.229138 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e7165b47-dd6b-4d1d-b587-7e359f3c0e31 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:00.229138 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e7165b47-dd6b-4d1d-b587-7e359f3c0e31 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:00.229138 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e7165b47-dd6b-4d1d-b587-7e359f3c0e31 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:00.229138 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e7165b47-dd6b-4d1d-b587-7e359f3c0e31 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:00.229138 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e7165b47-dd6b-4d1d-b587-7e359f3c0e31 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:00.238423 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-792b09b9-acff-40d6-aa55-5ebe754eb269 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/30d846a2-5966-4fae-9515-9d873d882e6b" status: 200 len: 1214 microversion: 2.1 time: 0.142000 Sep 23 04:50:00.239527 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2048/4209] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:00 2022] GET /compute/v2.1/servers/30d846a2-5966-4fae-9515-9d873d882e6b => generated 1214 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:00.257545 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f0348901-5814-4037-8130-25e4bc487347 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:00.260104 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f0348901-5814-4037-8130-25e4bc487347 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] [instance: 0ecb44a6-a97f-4177-aa9a-29a5b9b51a95] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:00.284548 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f0348901-5814-4037-8130-25e4bc487347 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:00.285066 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f0348901-5814-4037-8130-25e4bc487347 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:00.285563 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f0348901-5814-4037-8130-25e4bc487347 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:00.291954 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f0348901-5814-4037-8130-25e4bc487347 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:00.291954 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f0348901-5814-4037-8130-25e4bc487347 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:00.291954 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f0348901-5814-4037-8130-25e4bc487347 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:00.472969 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e7165b47-dd6b-4d1d-b587-7e359f3c0e31 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "POST /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579/action" status: 202 len: 0 microversion: 2.1 time: 0.263368 Sep 23 04:50:00.474019 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2162/4210] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:50:00 2022] POST /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579/action => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:50:00.483101 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9ffcf080-77ef-443c-8662-a2dbbc1f5b74 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:00.486206 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-9ffcf080-77ef-443c-8662-a2dbbc1f5b74 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: c4464422-9bf1-4aaa-806c-d7063e284579] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:00.498079 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9ffcf080-77ef-443c-8662-a2dbbc1f5b74 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:00.498584 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9ffcf080-77ef-443c-8662-a2dbbc1f5b74 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:00.499028 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9ffcf080-77ef-443c-8662-a2dbbc1f5b74 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:00.500018 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9ffcf080-77ef-443c-8662-a2dbbc1f5b74 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:00.503005 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9ffcf080-77ef-443c-8662-a2dbbc1f5b74 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:00.506281 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9ffcf080-77ef-443c-8662-a2dbbc1f5b74 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:00.725926 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f0348901-5814-4037-8130-25e4bc487347 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a52352ab894e8f88be0f9d1cef0b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e32df90da6b43b7b8a562dd95e6833b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:00.739543 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f0348901-5814-4037-8130-25e4bc487347 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] 10.222.0.33 "GET /compute/v2.1/servers/0ecb44a6-a97f-4177-aa9a-29a5b9b51a95" status: 200 len: 1355 microversion: 2.1 time: 0.495547 Sep 23 04:50:00.741821 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2049/4211] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:00 2022] GET /compute/v2.1/servers/0ecb44a6-a97f-4177-aa9a-29a5b9b51a95 => generated 1355 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:00.822988 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-48654350-6e3b-44aa-a354-54965fb16265 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:00.823869 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-48654350-6e3b-44aa-a354-54965fb16265 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: 9d5576c0-2aa8-4ca0-aed6-22c1f0700755] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:00.837121 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-48654350-6e3b-44aa-a354-54965fb16265 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:00.837644 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-48654350-6e3b-44aa-a354-54965fb16265 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:00.843546 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-48654350-6e3b-44aa-a354-54965fb16265 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:00.845293 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-48654350-6e3b-44aa-a354-54965fb16265 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:00.845293 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-48654350-6e3b-44aa-a354-54965fb16265 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:00.848630 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-48654350-6e3b-44aa-a354-54965fb16265 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:00.909288 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-9ffcf080-77ef-443c-8662-a2dbbc1f5b74 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c786bbedc21849ea92924139a44707b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcafb05f6f554e278cd552023947c6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:00.917945 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-9ffcf080-77ef-443c-8662-a2dbbc1f5b74 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579" status: 200 len: 1724 microversion: 2.1 time: 0.439258 Sep 23 04:50:00.918407 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2163/4212] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:00 2022] GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579 => generated 1724 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:50:01.150404 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-48654350-6e3b-44aa-a354-54965fb16265 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:01.167405 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-48654350-6e3b-44aa-a354-54965fb16265 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/9d5576c0-2aa8-4ca0-aed6-22c1f0700755" status: 200 len: 1504 microversion: 2.1 time: 0.349841 Sep 23 04:50:01.168019 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2050/4213] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:00 2022] GET /compute/v2.1/servers/9d5576c0-2aa8-4ca0-aed6-22c1f0700755 => generated 1504 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:01.200607 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9e48c0a1-50cb-43dd-b181-53d62bd14034 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:01.208784 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-9e48c0a1-50cb-43dd-b181-53d62bd14034 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: 9d5576c0-2aa8-4ca0-aed6-22c1f0700755] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:01.219448 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9e48c0a1-50cb-43dd-b181-53d62bd14034 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:01.247351 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9e48c0a1-50cb-43dd-b181-53d62bd14034 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:01.248001 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9e48c0a1-50cb-43dd-b181-53d62bd14034 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:01.249029 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9e48c0a1-50cb-43dd-b181-53d62bd14034 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:01.249658 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9e48c0a1-50cb-43dd-b181-53d62bd14034 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:01.250276 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9e48c0a1-50cb-43dd-b181-53d62bd14034 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:01.268707 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6ae782a4-911f-414c-9d91-201d99a421b0 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:01.270533 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-6ae782a4-911f-414c-9d91-201d99a421b0 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 30d846a2-5966-4fae-9515-9d873d882e6b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:01.283649 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6ae782a4-911f-414c-9d91-201d99a421b0 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:01.284577 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6ae782a4-911f-414c-9d91-201d99a421b0 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:01.288310 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6ae782a4-911f-414c-9d91-201d99a421b0 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:01.290420 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6ae782a4-911f-414c-9d91-201d99a421b0 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:01.290920 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6ae782a4-911f-414c-9d91-201d99a421b0 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:01.291373 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6ae782a4-911f-414c-9d91-201d99a421b0 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:01.300296 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-9e48c0a1-50cb-43dd-b181-53d62bd14034 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: 9d5576c0-2aa8-4ca0-aed6-22c1f0700755] Going to try to terminate instance {{(pid=122699) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:50:01.349028 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:50:01.716088 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-9e48c0a1-50cb-43dd-b181-53d62bd14034 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9d5576c0-2aa8-4ca0-aed6-22c1f0700755" status: 204 len: 0 microversion: 2.1 time: 0.519861 Sep 23 04:50:01.721084 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2164/4214] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:50:01 2022] DELETE /compute/v2.1/servers/9d5576c0-2aa8-4ca0-aed6-22c1f0700755 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:50:01.734526 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6ae782a4-911f-414c-9d91-201d99a421b0 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:01.756615 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-6ae782a4-911f-414c-9d91-201d99a421b0 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/30d846a2-5966-4fae-9515-9d873d882e6b" status: 200 len: 1218 microversion: 2.1 time: 0.494304 Sep 23 04:50:01.761324 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-17d3dd87-1b83-40e1-bf18-e550820652bc tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:01.763358 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-17d3dd87-1b83-40e1-bf18-e550820652bc tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: 9d5576c0-2aa8-4ca0-aed6-22c1f0700755] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:01.763913 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2051/4215] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:01 2022] GET /compute/v2.1/servers/30d846a2-5966-4fae-9515-9d873d882e6b => generated 1218 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:50:01.786226 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f217779a-62a2-4e25-96f6-7936257ade40 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:01.786774 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-17d3dd87-1b83-40e1-bf18-e550820652bc tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:01.787323 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f217779a-62a2-4e25-96f6-7936257ade40 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] [instance: 0ecb44a6-a97f-4177-aa9a-29a5b9b51a95] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:01.787707 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-17d3dd87-1b83-40e1-bf18-e550820652bc tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:01.788311 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-17d3dd87-1b83-40e1-bf18-e550820652bc tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:01.789196 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-17d3dd87-1b83-40e1-bf18-e550820652bc tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:01.789871 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-17d3dd87-1b83-40e1-bf18-e550820652bc tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:01.790477 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-17d3dd87-1b83-40e1-bf18-e550820652bc tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:01.794553 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f217779a-62a2-4e25-96f6-7936257ade40 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:01.795116 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f217779a-62a2-4e25-96f6-7936257ade40 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:01.795626 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f217779a-62a2-4e25-96f6-7936257ade40 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:01.796613 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f217779a-62a2-4e25-96f6-7936257ade40 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:01.797196 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f217779a-62a2-4e25-96f6-7936257ade40 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:01.797637 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f217779a-62a2-4e25-96f6-7936257ade40 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:02.108894 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-17d3dd87-1b83-40e1-bf18-e550820652bc tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:02.113312 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f217779a-62a2-4e25-96f6-7936257ade40 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a52352ab894e8f88be0f9d1cef0b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e32df90da6b43b7b8a562dd95e6833b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:02.116664 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-17d3dd87-1b83-40e1-bf18-e550820652bc tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/9d5576c0-2aa8-4ca0-aed6-22c1f0700755" status: 200 len: 1510 microversion: 2.1 time: 0.374939 Sep 23 04:50:02.117752 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2165/4216] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:01 2022] GET /compute/v2.1/servers/9d5576c0-2aa8-4ca0-aed6-22c1f0700755 => generated 1510 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:02.125708 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f217779a-62a2-4e25-96f6-7936257ade40 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] 10.222.0.33 "GET /compute/v2.1/servers/0ecb44a6-a97f-4177-aa9a-29a5b9b51a95" status: 200 len: 1355 microversion: 2.1 time: 0.360116 Sep 23 04:50:02.139462 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-37d23b5c-1ee4-41d2-86fd-31a7f8ed30a7 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:02.142638 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-37d23b5c-1ee4-41d2-86fd-31a7f8ed30a7 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: c4464422-9bf1-4aaa-806c-d7063e284579] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:02.145350 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2052/4217] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:01 2022] GET /compute/v2.1/servers/0ecb44a6-a97f-4177-aa9a-29a5b9b51a95 => generated 1355 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:02.153334 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-37d23b5c-1ee4-41d2-86fd-31a7f8ed30a7 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:02.154002 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-37d23b5c-1ee4-41d2-86fd-31a7f8ed30a7 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:02.154713 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-37d23b5c-1ee4-41d2-86fd-31a7f8ed30a7 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:02.155642 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-37d23b5c-1ee4-41d2-86fd-31a7f8ed30a7 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:02.156320 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-37d23b5c-1ee4-41d2-86fd-31a7f8ed30a7 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:02.156912 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-37d23b5c-1ee4-41d2-86fd-31a7f8ed30a7 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:02.360429 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-37d23b5c-1ee4-41d2-86fd-31a7f8ed30a7 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c786bbedc21849ea92924139a44707b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcafb05f6f554e278cd552023947c6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:02.369593 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-37d23b5c-1ee4-41d2-86fd-31a7f8ed30a7 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579" status: 200 len: 1724 microversion: 2.1 time: 0.250553 Sep 23 04:50:02.370210 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2166/4218] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:02 2022] GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579 => generated 1724 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:02.783873 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7c97e27c-c862-4213-a0e6-417395804f3b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:02.784565 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7c97e27c-c862-4213-a0e6-417395804f3b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 30d846a2-5966-4fae-9515-9d873d882e6b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:02.793135 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7c97e27c-c862-4213-a0e6-417395804f3b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:02.793675 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7c97e27c-c862-4213-a0e6-417395804f3b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:02.794161 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7c97e27c-c862-4213-a0e6-417395804f3b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:02.794900 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7c97e27c-c862-4213-a0e6-417395804f3b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:02.795556 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7c97e27c-c862-4213-a0e6-417395804f3b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:02.796450 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7c97e27c-c862-4213-a0e6-417395804f3b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:02.820523 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-35faeb64-fdab-4172-b88e-25709f1308bd req-cfd44543-6cd2-47a2-b57e-fb77fa1788ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ecb44a6-a97f-4177-aa9a-29a5b9b51a95", "tag": "9c63c256-13d3-4da8-a111-86c1b541a17b"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:50:02.832909 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-35faeb64-fdab-4172-b88e-25709f1308bd req-cfd44543-6cd2-47a2-b57e-fb77fa1788ad service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:02.860282 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-35faeb64-fdab-4172-b88e-25709f1308bd req-cfd44543-6cd2-47a2-b57e-fb77fa1788ad service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:02.864872 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-35faeb64-fdab-4172-b88e-25709f1308bd req-cfd44543-6cd2-47a2-b57e-fb77fa1788ad service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:02.893273 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-35faeb64-fdab-4172-b88e-25709f1308bd req-cfd44543-6cd2-47a2-b57e-fb77fa1788ad service nova] Creating event network-changed:9c63c256-13d3-4da8-a111-86c1b541a17b for instance 0ecb44a6-a97f-4177-aa9a-29a5b9b51a95 on n-h1-846463-3 Sep 23 04:50:02.905500 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-35faeb64-fdab-4172-b88e-25709f1308bd req-cfd44543-6cd2-47a2-b57e-fb77fa1788ad service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089640 Sep 23 04:50:02.909103 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2167/4219] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:50:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:50:02.912502 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-7c97e27c-c862-4213-a0e6-417395804f3b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:02.923652 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7c97e27c-c862-4213-a0e6-417395804f3b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/30d846a2-5966-4fae-9515-9d873d882e6b" status: 200 len: 1266 microversion: 2.1 time: 0.143910 Sep 23 04:50:02.935178 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2053/4220] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:02 2022] GET /compute/v2.1/servers/30d846a2-5966-4fae-9515-9d873d882e6b => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:03.141574 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-44f43e08-232f-46f6-b103-0efa71354f2c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:03.142320 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-44f43e08-232f-46f6-b103-0efa71354f2c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: 9d5576c0-2aa8-4ca0-aed6-22c1f0700755] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:03.156727 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9484796e-49d7-4e0e-b428-b8fcea34ed73 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:03.169632 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-9484796e-49d7-4e0e-b428-b8fcea34ed73 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] [instance: 0ecb44a6-a97f-4177-aa9a-29a5b9b51a95] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:03.191838 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-44f43e08-232f-46f6-b103-0efa71354f2c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:03.192740 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9484796e-49d7-4e0e-b428-b8fcea34ed73 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:03.194468 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-44f43e08-232f-46f6-b103-0efa71354f2c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:03.194977 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9484796e-49d7-4e0e-b428-b8fcea34ed73 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:03.196662 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9484796e-49d7-4e0e-b428-b8fcea34ed73 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:03.197290 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-44f43e08-232f-46f6-b103-0efa71354f2c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:03.198228 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9484796e-49d7-4e0e-b428-b8fcea34ed73 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:03.201040 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-44f43e08-232f-46f6-b103-0efa71354f2c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:03.201734 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9484796e-49d7-4e0e-b428-b8fcea34ed73 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:03.204588 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-44f43e08-232f-46f6-b103-0efa71354f2c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:03.204588 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-44f43e08-232f-46f6-b103-0efa71354f2c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:03.205306 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9484796e-49d7-4e0e-b428-b8fcea34ed73 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:03.615462 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-9484796e-49d7-4e0e-b428-b8fcea34ed73 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a52352ab894e8f88be0f9d1cef0b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e32df90da6b43b7b8a562dd95e6833b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:03.626377 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-44f43e08-232f-46f6-b103-0efa71354f2c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:03.631104 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9484796e-49d7-4e0e-b428-b8fcea34ed73 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] 10.222.0.33 "GET /compute/v2.1/servers/0ecb44a6-a97f-4177-aa9a-29a5b9b51a95" status: 200 len: 1355 microversion: 2.1 time: 0.480412 Sep 23 04:50:03.631993 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2054/4221] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:03 2022] GET /compute/v2.1/servers/0ecb44a6-a97f-4177-aa9a-29a5b9b51a95 => generated 1355 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:50:03.639651 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b734c7f8-2ec5-47c7-92b1-14f60d56b774 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:03.640386 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b734c7f8-2ec5-47c7-92b1-14f60d56b774 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: c4464422-9bf1-4aaa-806c-d7063e284579] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:03.647251 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b734c7f8-2ec5-47c7-92b1-14f60d56b774 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:03.647917 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b734c7f8-2ec5-47c7-92b1-14f60d56b774 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:03.648529 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b734c7f8-2ec5-47c7-92b1-14f60d56b774 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:03.649336 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b734c7f8-2ec5-47c7-92b1-14f60d56b774 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:03.650107 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b734c7f8-2ec5-47c7-92b1-14f60d56b774 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:03.650757 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b734c7f8-2ec5-47c7-92b1-14f60d56b774 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:03.661232 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-44f43e08-232f-46f6-b103-0efa71354f2c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/9d5576c0-2aa8-4ca0-aed6-22c1f0700755" status: 200 len: 1510 microversion: 2.1 time: 0.523623 Sep 23 04:50:03.662099 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2168/4222] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:03 2022] GET /compute/v2.1/servers/9d5576c0-2aa8-4ca0-aed6-22c1f0700755 => generated 1510 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:50:03.917055 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b734c7f8-2ec5-47c7-92b1-14f60d56b774 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c786bbedc21849ea92924139a44707b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcafb05f6f554e278cd552023947c6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:03.925709 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b734c7f8-2ec5-47c7-92b1-14f60d56b774 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579" status: 200 len: 1724 microversion: 2.1 time: 0.292282 Sep 23 04:50:03.942172 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2055/4223] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:03 2022] GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579 => generated 1724 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:03.952342 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9b2da72c-5742-4c36-9fa5-362a72d49c6a tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:03.952963 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-9b2da72c-5742-4c36-9fa5-362a72d49c6a tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 30d846a2-5966-4fae-9515-9d873d882e6b] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:03.964215 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9b2da72c-5742-4c36-9fa5-362a72d49c6a tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:03.965411 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9b2da72c-5742-4c36-9fa5-362a72d49c6a tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:03.966375 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9b2da72c-5742-4c36-9fa5-362a72d49c6a tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:03.968514 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9b2da72c-5742-4c36-9fa5-362a72d49c6a tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:03.969050 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9b2da72c-5742-4c36-9fa5-362a72d49c6a tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:03.969628 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9b2da72c-5742-4c36-9fa5-362a72d49c6a tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:04.097155 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-9b2da72c-5742-4c36-9fa5-362a72d49c6a tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:04.108798 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-9b2da72c-5742-4c36-9fa5-362a72d49c6a tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/30d846a2-5966-4fae-9515-9d873d882e6b" status: 200 len: 1266 microversion: 2.1 time: 0.160944 Sep 23 04:50:04.115175 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2169/4224] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:03 2022] GET /compute/v2.1/servers/30d846a2-5966-4fae-9515-9d873d882e6b => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:04.655718 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-65a99168-c55b-4a4e-8ae1-9c86f3c04ba9 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:04.656344 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-65a99168-c55b-4a4e-8ae1-9c86f3c04ba9 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] [instance: 0ecb44a6-a97f-4177-aa9a-29a5b9b51a95] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:04.670040 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-65a99168-c55b-4a4e-8ae1-9c86f3c04ba9 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:04.670549 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-65a99168-c55b-4a4e-8ae1-9c86f3c04ba9 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:04.671184 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-65a99168-c55b-4a4e-8ae1-9c86f3c04ba9 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:04.673578 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-65a99168-c55b-4a4e-8ae1-9c86f3c04ba9 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:04.674329 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-65a99168-c55b-4a4e-8ae1-9c86f3c04ba9 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:04.676128 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-65a99168-c55b-4a4e-8ae1-9c86f3c04ba9 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:04.689564 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-dd616d72-2f05-48e3-87f9-fe5f7f401cd5 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:04.689564 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-dd616d72-2f05-48e3-87f9-fe5f7f401cd5 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: 9d5576c0-2aa8-4ca0-aed6-22c1f0700755] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:04.698957 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dd616d72-2f05-48e3-87f9-fe5f7f401cd5 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:04.701261 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dd616d72-2f05-48e3-87f9-fe5f7f401cd5 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:04.701741 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dd616d72-2f05-48e3-87f9-fe5f7f401cd5 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:04.702614 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dd616d72-2f05-48e3-87f9-fe5f7f401cd5 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:04.703116 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dd616d72-2f05-48e3-87f9-fe5f7f401cd5 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:04.703544 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dd616d72-2f05-48e3-87f9-fe5f7f401cd5 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:04.973302 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-65a99168-c55b-4a4e-8ae1-9c86f3c04ba9 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a52352ab894e8f88be0f9d1cef0b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e32df90da6b43b7b8a562dd95e6833b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:04.982213 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-65a99168-c55b-4a4e-8ae1-9c86f3c04ba9 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] 10.222.0.33 "GET /compute/v2.1/servers/0ecb44a6-a97f-4177-aa9a-29a5b9b51a95" status: 200 len: 1355 microversion: 2.1 time: 0.330381 Sep 23 04:50:04.982805 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2056/4225] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:04 2022] GET /compute/v2.1/servers/0ecb44a6-a97f-4177-aa9a-29a5b9b51a95 => generated 1355 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:04.985553 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-dd616d72-2f05-48e3-87f9-fe5f7f401cd5 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:04.992699 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0d7ccb64-deff-4978-aa4d-07985b67442c tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:04.993513 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-0d7ccb64-deff-4978-aa4d-07985b67442c tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: c4464422-9bf1-4aaa-806c-d7063e284579] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:04.994475 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-dd616d72-2f05-48e3-87f9-fe5f7f401cd5 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/9d5576c0-2aa8-4ca0-aed6-22c1f0700755" status: 200 len: 1510 microversion: 2.1 time: 0.311250 Sep 23 04:50:05.006033 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2170/4226] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:04 2022] GET /compute/v2.1/servers/9d5576c0-2aa8-4ca0-aed6-22c1f0700755 => generated 1510 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:50:05.020679 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0d7ccb64-deff-4978-aa4d-07985b67442c tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:05.021593 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0d7ccb64-deff-4978-aa4d-07985b67442c tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:05.022237 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0d7ccb64-deff-4978-aa4d-07985b67442c tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:05.023684 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0d7ccb64-deff-4978-aa4d-07985b67442c tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:05.024306 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0d7ccb64-deff-4978-aa4d-07985b67442c tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:05.024891 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0d7ccb64-deff-4978-aa4d-07985b67442c tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:05.136002 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-181b32a0-b574-4fe0-a594-d32006c14e1c tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:05.137067 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-181b32a0-b574-4fe0-a594-d32006c14e1c tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 30d846a2-5966-4fae-9515-9d873d882e6b] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:05.146016 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-181b32a0-b574-4fe0-a594-d32006c14e1c tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:05.149602 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-181b32a0-b574-4fe0-a594-d32006c14e1c tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:05.149602 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-181b32a0-b574-4fe0-a594-d32006c14e1c tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:05.149602 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-181b32a0-b574-4fe0-a594-d32006c14e1c tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:05.149602 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-181b32a0-b574-4fe0-a594-d32006c14e1c tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:05.149602 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-181b32a0-b574-4fe0-a594-d32006c14e1c tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:05.268137 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-0d7ccb64-deff-4978-aa4d-07985b67442c tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c786bbedc21849ea92924139a44707b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcafb05f6f554e278cd552023947c6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:05.269229 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-181b32a0-b574-4fe0-a594-d32006c14e1c tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:05.285440 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-181b32a0-b574-4fe0-a594-d32006c14e1c tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/30d846a2-5966-4fae-9515-9d873d882e6b" status: 200 len: 1272 microversion: 2.1 time: 0.152815 Sep 23 04:50:05.288007 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2171/4227] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:05 2022] GET /compute/v2.1/servers/30d846a2-5966-4fae-9515-9d873d882e6b => generated 1272 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:50:05.290718 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0d7ccb64-deff-4978-aa4d-07985b67442c tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579" status: 200 len: 1730 microversion: 2.1 time: 0.306222 Sep 23 04:50:05.303900 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2057/4228] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:04 2022] GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579 => generated 1730 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:05.317825 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2aa2725a-6a79-41eb-826e-c776d0da9417 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:05.318619 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-2aa2725a-6a79-41eb-826e-c776d0da9417 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: c4464422-9bf1-4aaa-806c-d7063e284579] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:05.327246 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2aa2725a-6a79-41eb-826e-c776d0da9417 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:05.328007 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2aa2725a-6a79-41eb-826e-c776d0da9417 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:05.332159 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2aa2725a-6a79-41eb-826e-c776d0da9417 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:05.332159 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2aa2725a-6a79-41eb-826e-c776d0da9417 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:05.332159 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2aa2725a-6a79-41eb-826e-c776d0da9417 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:05.332159 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2aa2725a-6a79-41eb-826e-c776d0da9417 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:05.338074 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-c0f2832f-7af8-4d56-b82c-a7a1d0950365 req-90233e1f-56b4-44ca-beff-d450726f45c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d5576c0-2aa8-4ca0-aed6-22c1f0700755", "name": "network-vif-deleted", "tag": "ff157d85-3ffd-4186-931e-da7ddbdf0398"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:50:05.359119 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-c0f2832f-7af8-4d56-b82c-a7a1d0950365 req-90233e1f-56b4-44ca-beff-d450726f45c3 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:05.363821 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-c0f2832f-7af8-4d56-b82c-a7a1d0950365 req-90233e1f-56b4-44ca-beff-d450726f45c3 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:05.366240 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-c0f2832f-7af8-4d56-b82c-a7a1d0950365 req-90233e1f-56b4-44ca-beff-d450726f45c3 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:05.390346 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-c0f2832f-7af8-4d56-b82c-a7a1d0950365 req-90233e1f-56b4-44ca-beff-d450726f45c3 service nova] Creating event network-vif-deleted:ff157d85-3ffd-4186-931e-da7ddbdf0398 for instance 9d5576c0-2aa8-4ca0-aed6-22c1f0700755 on n-h2-846463-3 Sep 23 04:50:05.405709 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-c0f2832f-7af8-4d56-b82c-a7a1d0950365 req-90233e1f-56b4-44ca-beff-d450726f45c3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100700 Sep 23 04:50:05.406910 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2172/4229] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:50:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:50:05.479749 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2aa2725a-6a79-41eb-826e-c776d0da9417 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.167048 Sep 23 04:50:05.480746 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2058/4230] 10.222.0.33 () {58 vars in 1275 bytes} [Fri Sep 23 04:50:05 2022] GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579/os-interface => generated 284 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:50:06.014601 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-37186f8f-9f7c-4b6f-b51d-65dc049eed7c tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:06.015506 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-37186f8f-9f7c-4b6f-b51d-65dc049eed7c tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] [instance: 0ecb44a6-a97f-4177-aa9a-29a5b9b51a95] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:06.022164 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-191eb46b-794e-4168-a433-b364f3486314 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:06.022774 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-191eb46b-794e-4168-a433-b364f3486314 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: 9d5576c0-2aa8-4ca0-aed6-22c1f0700755] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:06.043328 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-191eb46b-794e-4168-a433-b364f3486314 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:06.043774 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-191eb46b-794e-4168-a433-b364f3486314 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:06.050312 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-37186f8f-9f7c-4b6f-b51d-65dc049eed7c tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:06.054742 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-191eb46b-794e-4168-a433-b364f3486314 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:06.057011 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-37186f8f-9f7c-4b6f-b51d-65dc049eed7c tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:06.058228 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-191eb46b-794e-4168-a433-b364f3486314 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:06.059435 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-191eb46b-794e-4168-a433-b364f3486314 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:06.059756 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-37186f8f-9f7c-4b6f-b51d-65dc049eed7c tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:06.060679 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-37186f8f-9f7c-4b6f-b51d-65dc049eed7c tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:06.061277 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-191eb46b-794e-4168-a433-b364f3486314 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:06.062340 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-37186f8f-9f7c-4b6f-b51d-65dc049eed7c tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:06.064250 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-37186f8f-9f7c-4b6f-b51d-65dc049eed7c tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:06.179634 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-191eb46b-794e-4168-a433-b364f3486314 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:06.180802 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-191eb46b-794e-4168-a433-b364f3486314 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:06.197834 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-191eb46b-794e-4168-a433-b364f3486314 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:06.197834 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-191eb46b-794e-4168-a433-b364f3486314 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lazy-loading 'fault' on Instance uuid 9d5576c0-2aa8-4ca0-aed6-22c1f0700755 {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:50:06.331139 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-191eb46b-794e-4168-a433-b364f3486314 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:06.341058 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-191eb46b-794e-4168-a433-b364f3486314 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/9d5576c0-2aa8-4ca0-aed6-22c1f0700755" status: 200 len: 1305 microversion: 2.1 time: 0.323550 Sep 23 04:50:06.341947 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2059/4231] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:06 2022] GET /compute/v2.1/servers/9d5576c0-2aa8-4ca0-aed6-22c1f0700755 => generated 1305 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:50:06.361225 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-77c38e7b-7b83-4be1-9e80-0d9e9328a09d tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:06.361918 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-77c38e7b-7b83-4be1-9e80-0d9e9328a09d tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 30d846a2-5966-4fae-9515-9d873d882e6b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:06.371683 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-77c38e7b-7b83-4be1-9e80-0d9e9328a09d tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:06.372196 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-77c38e7b-7b83-4be1-9e80-0d9e9328a09d tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:06.372691 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-77c38e7b-7b83-4be1-9e80-0d9e9328a09d tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:06.373413 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-77c38e7b-7b83-4be1-9e80-0d9e9328a09d tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:06.374538 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-77c38e7b-7b83-4be1-9e80-0d9e9328a09d tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:06.375199 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-77c38e7b-7b83-4be1-9e80-0d9e9328a09d tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:06.542887 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-77c38e7b-7b83-4be1-9e80-0d9e9328a09d tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:06.557995 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-77c38e7b-7b83-4be1-9e80-0d9e9328a09d tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/30d846a2-5966-4fae-9515-9d873d882e6b" status: 200 len: 1272 microversion: 2.1 time: 0.212890 Sep 23 04:50:06.559874 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2060/4232] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:06 2022] GET /compute/v2.1/servers/30d846a2-5966-4fae-9515-9d873d882e6b => generated 1272 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:06.685626 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-37186f8f-9f7c-4b6f-b51d-65dc049eed7c tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a52352ab894e8f88be0f9d1cef0b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e32df90da6b43b7b8a562dd95e6833b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:06.699751 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-37186f8f-9f7c-4b6f-b51d-65dc049eed7c tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] 10.222.0.33 "GET /compute/v2.1/servers/0ecb44a6-a97f-4177-aa9a-29a5b9b51a95" status: 200 len: 1355 microversion: 2.1 time: 0.690461 Sep 23 04:50:06.702282 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2173/4233] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:06 2022] GET /compute/v2.1/servers/0ecb44a6-a97f-4177-aa9a-29a5b9b51a95 => generated 1355 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:07.289060 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-733c07ed-fda5-4516-9594-46e99e7f44a6 req-278b9404-24a5-4e41-b4cc-6ace6d8fad32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4464422-9bf1-4aaa-806c-d7063e284579", "tag": "1996c9a9-f009-4ec9-a3d8-6f5d1f1f1a46"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:50:07.304217 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-733c07ed-fda5-4516-9594-46e99e7f44a6 req-278b9404-24a5-4e41-b4cc-6ace6d8fad32 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:07.304717 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-733c07ed-fda5-4516-9594-46e99e7f44a6 req-278b9404-24a5-4e41-b4cc-6ace6d8fad32 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:07.305672 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-733c07ed-fda5-4516-9594-46e99e7f44a6 req-278b9404-24a5-4e41-b4cc-6ace6d8fad32 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:07.321108 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-733c07ed-fda5-4516-9594-46e99e7f44a6 req-278b9404-24a5-4e41-b4cc-6ace6d8fad32 service nova] Creating event network-changed:1996c9a9-f009-4ec9-a3d8-6f5d1f1f1a46 for instance c4464422-9bf1-4aaa-806c-d7063e284579 on n-h1-846463-3 Sep 23 04:50:07.326649 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-733c07ed-fda5-4516-9594-46e99e7f44a6 req-278b9404-24a5-4e41-b4cc-6ace6d8fad32 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042094 Sep 23 04:50:07.328046 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2061/4234] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:50:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:50:07.366092 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a452a3b3-b3ac-4592-a70f-3ea7a8a544c3 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:07.367723 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a452a3b3-b3ac-4592-a70f-3ea7a8a544c3 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: 9d5576c0-2aa8-4ca0-aed6-22c1f0700755] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:07.382839 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a452a3b3-b3ac-4592-a70f-3ea7a8a544c3 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:07.384195 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a452a3b3-b3ac-4592-a70f-3ea7a8a544c3 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:07.387005 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a452a3b3-b3ac-4592-a70f-3ea7a8a544c3 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:07.388335 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a452a3b3-b3ac-4592-a70f-3ea7a8a544c3 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:07.389272 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a452a3b3-b3ac-4592-a70f-3ea7a8a544c3 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:07.391181 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a452a3b3-b3ac-4592-a70f-3ea7a8a544c3 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:07.436129 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-a452a3b3-b3ac-4592-a70f-3ea7a8a544c3 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] HTTP exception thrown: Instance 9d5576c0-2aa8-4ca0-aed6-22c1f0700755 could not be found. Sep 23 04:50:07.441438 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a452a3b3-b3ac-4592-a70f-3ea7a8a544c3 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Request method failure captured: Sep 23 04:50:07.441438 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/9d5576c0-2aa8-4ca0-aed6-22c1f0700755 HTTP/1.1 Sep 23 04:50:07.441438 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:50:07.441438 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:50:07.441438 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:50:07.441438 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:50:07.441438 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:50:07.441438 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:50:07.441438 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:50:07.441438 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:50:07.441438 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTrDoGx96bSja4ydTGD-VWXTOyHeLiBA9Lvr197ivKeXqtV3OksEUUEiEPXK85IMwWXM1vCTp1M9PaXnUkKbFev29d-fL5KKXR0MfyGa86SLKINg6u_gn5EQLUNZ8EVLCkU1WwJ7agpVlFY75EyJH0fBcxrNg1yvFbeC2alzdH4Tkmw Sep 23 04:50:07.441438 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:50:07.441438 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:50:07.441438 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:50:07.441438 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:50:07.441438 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:50:07.441438 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:50:07.441438 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 78dca47156ff4f19a8673b893c853978 Sep 23 04:50:07.441438 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:50:07.441438 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:50:07.441438 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:50:07.441438 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_78dca47156ff4f19a8673b893c853978", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/78dca47156ff4f19a8673b893c853978"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/78dca47156ff4f19a8673b893c853978"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/78dca47156ff4f19a8673b893c853978"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:50:07.441438 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:50:07.441438 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 78dca47156ff4f19a8673b893c853978 Sep 23 04:50:07.441438 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:50:07.441438 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ServersNegativeTestJSON-1102187211-project Sep 23 04:50:07.441438 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:50:07.441438 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:50:07.441438 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: c912fb9d1f5447d180a9e8568220526f Sep 23 04:50:07.441438 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ServersNegativeTestJSON-1102187211-project Sep 23 04:50:07.441438 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:50:07.441438 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 9d5576c0-2aa8-4ca0-aed6-22c1f0700755 could not be found. Sep 23 04:50:07.441438 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '9d5576c0-2aa8-4ca0-aed6-22c1f0700755'} Sep 23 04:50:07.441438 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:50:07.441438 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:07.441438 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:50:07.441438 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:50:07.441438 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:50:07.441438 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:50:07.441438 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:50:07.441438 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:50:07.441438 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:50:07.441438 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:50:07.441438 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d5576c0-2aa8-4ca0-aed6-22c1f0700755 could not be found. Sep 23 04:50:07.441438 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:07.441438 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:50:07.441438 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:07.441438 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:07.441438 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:50:07.441438 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:50:07.441438 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:50:07.441438 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:50:07.441438 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:50:07.441438 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:50:07.441438 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:50:07.441438 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:50:07.441438 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:50:07.441438 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:50:07.441438 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:50:07.441438 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:50:07.441438 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d5576c0-2aa8-4ca0-aed6-22c1f0700755 could not be found. Sep 23 04:50:07.441438 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:07.441438 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:50:07.441438 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:07.445191 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:07.445191 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:50:07.445191 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:50:07.445191 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:50:07.445191 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:50:07.445191 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d5576c0-2aa8-4ca0-aed6-22c1f0700755 could not be found. Sep 23 04:50:07.445191 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:07.449456 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a452a3b3-b3ac-4592-a70f-3ea7a8a544c3 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Returning 404 to user: Instance 9d5576c0-2aa8-4ca0-aed6-22c1f0700755 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:50:07.450679 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a452a3b3-b3ac-4592-a70f-3ea7a8a544c3 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/9d5576c0-2aa8-4ca0-aed6-22c1f0700755" status: 404 len: 111 microversion: 2.1 time: 0.089351 Sep 23 04:50:07.457060 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2174/4235] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:07 2022] GET /compute/v2.1/servers/9d5576c0-2aa8-4ca0-aed6-22c1f0700755 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:50:07.468972 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3cbececb-c11d-46ed-bd77-24e54053d8fe tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:07.469704 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3cbececb-c11d-46ed-bd77-24e54053d8fe tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:07.481245 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3cbececb-c11d-46ed-bd77-24e54053d8fe tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:07.483665 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3cbececb-c11d-46ed-bd77-24e54053d8fe tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:07.485121 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3cbececb-c11d-46ed-bd77-24e54053d8fe tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:07.488835 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3cbececb-c11d-46ed-bd77-24e54053d8fe tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:07.489505 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3cbececb-c11d-46ed-bd77-24e54053d8fe tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:07.490154 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3cbececb-c11d-46ed-bd77-24e54053d8fe tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:07.499913 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=100 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:50:07.581268 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c240ce05-f93e-4d56-8eb2-f83163777ad9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:07.582248 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c240ce05-f93e-4d56-8eb2-f83163777ad9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 30d846a2-5966-4fae-9515-9d873d882e6b] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:07.592867 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c240ce05-f93e-4d56-8eb2-f83163777ad9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:07.594267 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c240ce05-f93e-4d56-8eb2-f83163777ad9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:07.594910 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c240ce05-f93e-4d56-8eb2-f83163777ad9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:07.601751 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c240ce05-f93e-4d56-8eb2-f83163777ad9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:07.602836 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c240ce05-f93e-4d56-8eb2-f83163777ad9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:07.603459 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c240ce05-f93e-4d56-8eb2-f83163777ad9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:08.312082 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c240ce05-f93e-4d56-8eb2-f83163777ad9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:08.321667 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c240ce05-f93e-4d56-8eb2-f83163777ad9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/30d846a2-5966-4fae-9515-9d873d882e6b" status: 200 len: 1314 microversion: 2.1 time: 0.744668 Sep 23 04:50:08.341326 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2175/4236] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:07 2022] GET /compute/v2.1/servers/30d846a2-5966-4fae-9515-9d873d882e6b => generated 1314 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:08.347416 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3456dddb-67cb-4995-892d-dc3836ad0a82 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:08.348057 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-3456dddb-67cb-4995-892d-dc3836ad0a82 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] [instance: 0ecb44a6-a97f-4177-aa9a-29a5b9b51a95] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:08.348980 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-3cbececb-c11d-46ed-bd77-24e54053d8fe tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:08.361866 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3cbececb-c11d-46ed-bd77-24e54053d8fe tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1503 microversion: 2.1 time: 0.897601 Sep 23 04:50:08.361866 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2062/4237] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:07 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1503 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:08.371274 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3456dddb-67cb-4995-892d-dc3836ad0a82 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:08.371807 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3456dddb-67cb-4995-892d-dc3836ad0a82 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:08.372220 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3456dddb-67cb-4995-892d-dc3836ad0a82 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:08.372947 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3456dddb-67cb-4995-892d-dc3836ad0a82 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:08.380641 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3456dddb-67cb-4995-892d-dc3836ad0a82 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:08.381167 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3456dddb-67cb-4995-892d-dc3836ad0a82 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:08.656207 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c738790f-d25d-4938-a3c0-d990e2bedf3a tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "networks": [{"uuid": "eaa0cbf4-9a92-44f9-ac8d-d8f60e6441c0"}]}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:50:08.660884 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c738790f-d25d-4938-a3c0-d990e2bedf3a tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Request method failure captured: Sep 23 04:50:08.660884 n-d-846463-3 devstack@n-api.service[122698]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 23 04:50:08.660884 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:50:08.660884 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:50:08.660884 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:50:08.660884 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 163 Sep 23 04:50:08.660884 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:50:08.660884 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:50:08.660884 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:50:08.660884 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:50:08.660884 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTrDoGx96bSja4ydTGD-VWXTOyHeLiBA9Lvr197ivKeXqtV3OksEUUEiEPXK85IMwWXM1vCTp1M9PaXnUkKbFev29d-fL5KKXR0MfyGa86SLKINg6u_gn5EQLUNZ8EVLCkU1WwJ7agpVlFY75EyJH0fBcxrNg1yvFbeC2alzdH4Tkmw Sep 23 04:50:08.660884 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:50:08.660884 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:50:08.660884 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:50:08.660884 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:50:08.660884 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:50:08.660884 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:50:08.660884 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 78dca47156ff4f19a8673b893c853978 Sep 23 04:50:08.660884 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:50:08.660884 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:50:08.660884 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:50:08.660884 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_78dca47156ff4f19a8673b893c853978", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/78dca47156ff4f19a8673b893c853978"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/78dca47156ff4f19a8673b893c853978"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/78dca47156ff4f19a8673b893c853978"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:50:08.660884 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:50:08.660884 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 78dca47156ff4f19a8673b893c853978 Sep 23 04:50:08.660884 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:50:08.660884 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ServersNegativeTestJSON-1102187211-project Sep 23 04:50:08.660884 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:50:08.660884 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:50:08.660884 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: c912fb9d1f5447d180a9e8568220526f Sep 23 04:50:08.660884 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ServersNegativeTestJSON-1102187211-project Sep 23 04:50:08.660884 n-d-846463-3 devstack@n-api.service[122698]: Sep 23 04:50:08.660884 n-d-846463-3 devstack@n-api.service[122698]: {"server": {"name": 12345, "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "networks": [{"uuid": "eaa0cbf4-9a92-44f9-ac8d-d8f60e6441c0"}]}} Sep 23 04:50:08.660884 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:50:08.660884 n-d-846463-3 devstack@n-api.service[122698]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Sep 23 04:50:08.660884 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'body': {'server': {'name': 12345, 'imageRef': 'b8dd79b9-f0b9-43a9-9605-17244137c0ee', 'flavorRef': '452', 'networks': [{'uuid': 'eaa0cbf4-9a92-44f9-ac8d-d8f60e6441c0'}]}}} Sep 23 04:50:08.660884 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:50:08.660884 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:08.660884 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 23 04:50:08.660884 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 23 04:50:08.660884 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 23 04:50:08.660884 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise error Sep 23 04:50:08.660884 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Sep 23 04:50:08.660884 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:50:08.660884 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Sep 23 04:50:08.660884 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 23 04:50:08.660884 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:50:08.660884 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 23 04:50:08.660884 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi 12345 Sep 23 04:50:08.660884 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:50:08.660884 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:50:08.660884 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:50:08.660884 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:08.660884 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:50:08.660884 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:50:08.660884 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:50:08.660884 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:50:08.660884 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:50:08.660884 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:50:08.660884 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:50:08.660884 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:50:08.660884 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 23 04:50:08.660884 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 23 04:50:08.660884 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 23 04:50:08.660884 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 23 04:50:08.660884 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 23 04:50:08.665556 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 23 04:50:08.665556 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Sep 23 04:50:08.665556 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:50:08.665556 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:50:08.665556 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:50:08.665556 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:08.665556 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:50:08.665556 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:50:08.665556 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 23 04:50:08.665556 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 23 04:50:08.665556 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Sep 23 04:50:08.665556 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:50:08.670051 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-3456dddb-67cb-4995-892d-dc3836ad0a82 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a52352ab894e8f88be0f9d1cef0b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e32df90da6b43b7b8a562dd95e6833b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:08.676991 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c738790f-d25d-4938-a3c0-d990e2bedf3a tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:50:08.677980 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c738790f-d25d-4938-a3c0-d990e2bedf3a tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.026597 Sep 23 04:50:08.682038 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3456dddb-67cb-4995-892d-dc3836ad0a82 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] 10.222.0.33 "GET /compute/v2.1/servers/0ecb44a6-a97f-4177-aa9a-29a5b9b51a95" status: 200 len: 1355 microversion: 2.1 time: 0.350675 Sep 23 04:50:08.697749 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2063/4238] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:50:08 2022] POST /compute/v2.1/servers => generated 127 bytes in 47 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 04:50:08.700571 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2176/4239] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:08 2022] GET /compute/v2.1/servers/0ecb44a6-a97f-4177-aa9a-29a5b9b51a95 => generated 1355 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:08.717796 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7f92fcf8-8f63-4976-a979-e0cf55c96f0b tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:08.719147 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7f92fcf8-8f63-4976-a979-e0cf55c96f0b tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:08.726929 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7f92fcf8-8f63-4976-a979-e0cf55c96f0b tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:08.729576 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7f92fcf8-8f63-4976-a979-e0cf55c96f0b tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:08.730082 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7f92fcf8-8f63-4976-a979-e0cf55c96f0b tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:08.730866 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7f92fcf8-8f63-4976-a979-e0cf55c96f0b tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:08.731341 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7f92fcf8-8f63-4976-a979-e0cf55c96f0b tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:08.731777 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7f92fcf8-8f63-4976-a979-e0cf55c96f0b tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:08.955558 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-e0d17502-a35c-4e23-be0e-440450489ac8 req-23d205b3-0f3f-4fae-afba-32bee9574731 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30d846a2-5966-4fae-9515-9d873d882e6b", "tag": "952d94de-d39b-44e0-8288-2417a201e386"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:50:08.969331 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-7f92fcf8-8f63-4976-a979-e0cf55c96f0b tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:08.974036 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-e0d17502-a35c-4e23-be0e-440450489ac8 req-23d205b3-0f3f-4fae-afba-32bee9574731 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:08.974744 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-e0d17502-a35c-4e23-be0e-440450489ac8 req-23d205b3-0f3f-4fae-afba-32bee9574731 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:08.975666 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-e0d17502-a35c-4e23-be0e-440450489ac8 req-23d205b3-0f3f-4fae-afba-32bee9574731 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:08.982870 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7f92fcf8-8f63-4976-a979-e0cf55c96f0b tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1503 microversion: 2.1 time: 0.280432 Sep 23 04:50:08.985050 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2064/4240] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:08 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1503 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:08.992062 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-e0d17502-a35c-4e23-be0e-440450489ac8 req-23d205b3-0f3f-4fae-afba-32bee9574731 service nova] Creating event network-changed:952d94de-d39b-44e0-8288-2417a201e386 for instance 30d846a2-5966-4fae-9515-9d873d882e6b on n-h2-846463-3 Sep 23 04:50:08.997795 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-e0d17502-a35c-4e23-be0e-440450489ac8 req-23d205b3-0f3f-4fae-afba-32bee9574731 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046817 Sep 23 04:50:08.999438 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2177/4241] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:50:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:50:09.023383 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b42cb77b-b35c-43b8-972c-266df3404598 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:09.026401 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b42cb77b-b35c-43b8-972c-266df3404598 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:09.048188 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b42cb77b-b35c-43b8-972c-266df3404598 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:09.049116 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b42cb77b-b35c-43b8-972c-266df3404598 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:09.049724 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b42cb77b-b35c-43b8-972c-266df3404598 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:09.051847 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b42cb77b-b35c-43b8-972c-266df3404598 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:09.052515 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b42cb77b-b35c-43b8-972c-266df3404598 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:09.053159 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b42cb77b-b35c-43b8-972c-266df3404598 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:09.252195 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b42cb77b-b35c-43b8-972c-266df3404598 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:09.261983 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b42cb77b-b35c-43b8-972c-266df3404598 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1503 microversion: 2.1 time: 0.255705 Sep 23 04:50:09.273916 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2065/4242] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:09 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1503 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:09.357754 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7c9d59ea-4cbe-419e-990a-fbc1c4b76e03 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:09.358332 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-7c9d59ea-4cbe-419e-990a-fbc1c4b76e03 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 30d846a2-5966-4fae-9515-9d873d882e6b] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:09.365806 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7c9d59ea-4cbe-419e-990a-fbc1c4b76e03 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:09.366332 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7c9d59ea-4cbe-419e-990a-fbc1c4b76e03 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:09.366783 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7c9d59ea-4cbe-419e-990a-fbc1c4b76e03 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:09.375884 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7c9d59ea-4cbe-419e-990a-fbc1c4b76e03 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:09.376575 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7c9d59ea-4cbe-419e-990a-fbc1c4b76e03 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:09.377002 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7c9d59ea-4cbe-419e-990a-fbc1c4b76e03 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:09.464941 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-255ccfdc-3803-4dff-bdc6-10e12979aa6a req-a3cbd39b-4110-48a2-8cec-7ff249f4953a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4464422-9bf1-4aaa-806c-d7063e284579", "tag": "1996c9a9-f009-4ec9-a3d8-6f5d1f1f1a46"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:50:09.489948 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-255ccfdc-3803-4dff-bdc6-10e12979aa6a req-a3cbd39b-4110-48a2-8cec-7ff249f4953a service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:09.494921 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-255ccfdc-3803-4dff-bdc6-10e12979aa6a req-a3cbd39b-4110-48a2-8cec-7ff249f4953a service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:09.494921 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-255ccfdc-3803-4dff-bdc6-10e12979aa6a req-a3cbd39b-4110-48a2-8cec-7ff249f4953a service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:09.526013 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-255ccfdc-3803-4dff-bdc6-10e12979aa6a req-a3cbd39b-4110-48a2-8cec-7ff249f4953a service nova] Creating event network-changed:1996c9a9-f009-4ec9-a3d8-6f5d1f1f1a46 for instance c4464422-9bf1-4aaa-806c-d7063e284579 on n-h1-846463-3 Sep 23 04:50:09.537961 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-255ccfdc-3803-4dff-bdc6-10e12979aa6a req-a3cbd39b-4110-48a2-8cec-7ff249f4953a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075724 Sep 23 04:50:09.537961 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2066/4243] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:50:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:50:09.713695 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:50:09.721660 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2a029705-0817-4c82-98bd-ff9e6b623cd5 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:09.725513 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-2a029705-0817-4c82-98bd-ff9e6b623cd5 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] [instance: 0ecb44a6-a97f-4177-aa9a-29a5b9b51a95] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:09.740719 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2a029705-0817-4c82-98bd-ff9e6b623cd5 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:09.740719 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2a029705-0817-4c82-98bd-ff9e6b623cd5 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:09.740719 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2a029705-0817-4c82-98bd-ff9e6b623cd5 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:09.740719 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2a029705-0817-4c82-98bd-ff9e6b623cd5 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:09.740719 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2a029705-0817-4c82-98bd-ff9e6b623cd5 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:09.740719 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2a029705-0817-4c82-98bd-ff9e6b623cd5 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:09.857213 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-7c9d59ea-4cbe-419e-990a-fbc1c4b76e03 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:09.871463 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-7c9d59ea-4cbe-419e-990a-fbc1c4b76e03 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/30d846a2-5966-4fae-9515-9d873d882e6b" status: 200 len: 1314 microversion: 2.1 time: 0.517709 Sep 23 04:50:09.873028 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2178/4244] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:09 2022] GET /compute/v2.1/servers/30d846a2-5966-4fae-9515-9d873d882e6b => generated 1314 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:10.136786 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-2a029705-0817-4c82-98bd-ff9e6b623cd5 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a52352ab894e8f88be0f9d1cef0b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e32df90da6b43b7b8a562dd95e6833b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:10.146005 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2a029705-0817-4c82-98bd-ff9e6b623cd5 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] 10.222.0.33 "GET /compute/v2.1/servers/0ecb44a6-a97f-4177-aa9a-29a5b9b51a95" status: 200 len: 1355 microversion: 2.1 time: 0.437810 Sep 23 04:50:10.148524 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2067/4245] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:09 2022] GET /compute/v2.1/servers/0ecb44a6-a97f-4177-aa9a-29a5b9b51a95 => generated 1355 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:10.898202 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7cc9a81d-10e5-42e8-9846-d127fd3fc019 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:10.898852 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-7cc9a81d-10e5-42e8-9846-d127fd3fc019 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 30d846a2-5966-4fae-9515-9d873d882e6b] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:10.908338 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7cc9a81d-10e5-42e8-9846-d127fd3fc019 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:10.912404 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7cc9a81d-10e5-42e8-9846-d127fd3fc019 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:10.912404 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7cc9a81d-10e5-42e8-9846-d127fd3fc019 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:10.912404 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7cc9a81d-10e5-42e8-9846-d127fd3fc019 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:10.912404 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7cc9a81d-10e5-42e8-9846-d127fd3fc019 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:10.912404 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7cc9a81d-10e5-42e8-9846-d127fd3fc019 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:11.137034 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-7cc9a81d-10e5-42e8-9846-d127fd3fc019 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:11.146097 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-7cc9a81d-10e5-42e8-9846-d127fd3fc019 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/30d846a2-5966-4fae-9515-9d873d882e6b" status: 200 len: 1314 microversion: 2.1 time: 0.253415 Sep 23 04:50:11.161370 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2179/4246] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:10 2022] GET /compute/v2.1/servers/30d846a2-5966-4fae-9515-9d873d882e6b => generated 1314 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:11.171971 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-bcaa7d76-211d-452f-bb85-c752a8f3c514 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:11.172688 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-bcaa7d76-211d-452f-bb85-c752a8f3c514 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] [instance: 0ecb44a6-a97f-4177-aa9a-29a5b9b51a95] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:11.179642 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=8 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:50:11.182366 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bcaa7d76-211d-452f-bb85-c752a8f3c514 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:11.183100 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bcaa7d76-211d-452f-bb85-c752a8f3c514 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:11.183777 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bcaa7d76-211d-452f-bb85-c752a8f3c514 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:11.184877 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bcaa7d76-211d-452f-bb85-c752a8f3c514 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:11.185589 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bcaa7d76-211d-452f-bb85-c752a8f3c514 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:11.186659 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bcaa7d76-211d-452f-bb85-c752a8f3c514 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:11.435583 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-bcaa7d76-211d-452f-bb85-c752a8f3c514 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a52352ab894e8f88be0f9d1cef0b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e32df90da6b43b7b8a562dd95e6833b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:11.478356 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-bcaa7d76-211d-452f-bb85-c752a8f3c514 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] 10.222.0.33 "GET /compute/v2.1/servers/0ecb44a6-a97f-4177-aa9a-29a5b9b51a95" status: 200 len: 1355 microversion: 2.1 time: 0.310278 Sep 23 04:50:11.487886 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2068/4247] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:11 2022] GET /compute/v2.1/servers/0ecb44a6-a97f-4177-aa9a-29a5b9b51a95 => generated 1355 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:12.183212 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d491d5ed-5013-4a2b-92f6-2a0f120f47be tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:12.184158 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d491d5ed-5013-4a2b-92f6-2a0f120f47be tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 30d846a2-5966-4fae-9515-9d873d882e6b] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:12.196329 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d491d5ed-5013-4a2b-92f6-2a0f120f47be tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:12.196933 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d491d5ed-5013-4a2b-92f6-2a0f120f47be tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:12.199754 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d491d5ed-5013-4a2b-92f6-2a0f120f47be tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:12.202323 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d491d5ed-5013-4a2b-92f6-2a0f120f47be tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:12.204261 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d491d5ed-5013-4a2b-92f6-2a0f120f47be tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:12.205267 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d491d5ed-5013-4a2b-92f6-2a0f120f47be tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:12.394504 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d491d5ed-5013-4a2b-92f6-2a0f120f47be tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:12.407535 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d491d5ed-5013-4a2b-92f6-2a0f120f47be tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/30d846a2-5966-4fae-9515-9d873d882e6b" status: 200 len: 1314 microversion: 2.1 time: 0.240736 Sep 23 04:50:12.412741 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2180/4248] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:12 2022] GET /compute/v2.1/servers/30d846a2-5966-4fae-9515-9d873d882e6b => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:12.506277 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ea6d89c2-4f47-4b8b-b625-94baef90a81f tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:12.508784 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-ea6d89c2-4f47-4b8b-b625-94baef90a81f tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] [instance: 0ecb44a6-a97f-4177-aa9a-29a5b9b51a95] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:12.532146 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ea6d89c2-4f47-4b8b-b625-94baef90a81f tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:12.532671 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ea6d89c2-4f47-4b8b-b625-94baef90a81f tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:12.543664 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ea6d89c2-4f47-4b8b-b625-94baef90a81f tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:12.547923 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ea6d89c2-4f47-4b8b-b625-94baef90a81f tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:12.547923 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ea6d89c2-4f47-4b8b-b625-94baef90a81f tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:12.547923 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ea6d89c2-4f47-4b8b-b625-94baef90a81f tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:12.658551 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f361f4a1-8e42-4a47-9bfc-c8955aa8060c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-45395522", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "c9ea74a4-95a5-464a-be34-5cbb337331ee", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "eaa0cbf4-9a92-44f9-ac8d-d8f60e6441c0"}]}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:50:12.779407 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ea6d89c2-4f47-4b8b-b625-94baef90a81f tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a52352ab894e8f88be0f9d1cef0b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e32df90da6b43b7b8a562dd95e6833b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:12.788373 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-f361f4a1-8e42-4a47-9bfc-c8955aa8060c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] HTTP exception thrown: Block Device c9ea74a4-95a5-464a-be34-5cbb337331ee is not bootable. Sep 23 04:50:12.788604 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ea6d89c2-4f47-4b8b-b625-94baef90a81f tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] 10.222.0.33 "GET /compute/v2.1/servers/0ecb44a6-a97f-4177-aa9a-29a5b9b51a95" status: 200 len: 1355 microversion: 2.1 time: 0.287474 Sep 23 04:50:12.790503 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2069/4249] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:12 2022] GET /compute/v2.1/servers/0ecb44a6-a97f-4177-aa9a-29a5b9b51a95 => generated 1355 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:12.800451 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f361f4a1-8e42-4a47-9bfc-c8955aa8060c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Request method failure captured: Sep 23 04:50:12.800451 n-d-846463-3 devstack@n-api.service[122699]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 23 04:50:12.800451 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:50:12.800451 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:50:12.800451 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:50:12.800451 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 356 Sep 23 04:50:12.800451 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:50:12.800451 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:50:12.800451 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:50:12.800451 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:50:12.800451 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTrDoGx96bSja4ydTGD-VWXTOyHeLiBA9Lvr197ivKeXqtV3OksEUUEiEPXK85IMwWXM1vCTp1M9PaXnUkKbFev29d-fL5KKXR0MfyGa86SLKINg6u_gn5EQLUNZ8EVLCkU1WwJ7agpVlFY75EyJH0fBcxrNg1yvFbeC2alzdH4Tkmw Sep 23 04:50:12.800451 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:50:12.800451 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:50:12.800451 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:50:12.800451 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:50:12.800451 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:50:12.800451 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:50:12.800451 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 78dca47156ff4f19a8673b893c853978 Sep 23 04:50:12.800451 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:50:12.800451 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:50:12.800451 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:50:12.800451 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_78dca47156ff4f19a8673b893c853978", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/78dca47156ff4f19a8673b893c853978"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/78dca47156ff4f19a8673b893c853978"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/78dca47156ff4f19a8673b893c853978"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:50:12.800451 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:50:12.800451 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 78dca47156ff4f19a8673b893c853978 Sep 23 04:50:12.800451 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:50:12.800451 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ServersNegativeTestJSON-1102187211-project Sep 23 04:50:12.800451 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:50:12.800451 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:50:12.800451 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: c912fb9d1f5447d180a9e8568220526f Sep 23 04:50:12.800451 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ServersNegativeTestJSON-1102187211-project Sep 23 04:50:12.800451 n-d-846463-3 devstack@n-api.service[122699]: Sep 23 04:50:12.800451 n-d-846463-3 devstack@n-api.service[122699]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-45395522", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "c9ea74a4-95a5-464a-be34-5cbb337331ee", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "eaa0cbf4-9a92-44f9-ac8d-d8f60e6441c0"}]}} Sep 23 04:50:12.800451 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:50:12.800451 n-d-846463-3 devstack@n-api.service[122699]: exception: Block Device c9ea74a4-95a5-464a-be34-5cbb337331ee is not bootable. Sep 23 04:50:12.800451 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-45395522', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': 'c9ea74a4-95a5-464a-be34-5cbb337331ee'}], 'networks': [{'uuid': 'eaa0cbf4-9a92-44f9-ac8d-d8f60e6441c0'}]}}} Sep 23 04:50:12.800451 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:50:12.800451 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:12.800451 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 23 04:50:12.800451 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 23 04:50:12.800451 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 23 04:50:12.800451 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 23 04:50:12.800451 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Sep 23 04:50:12.800451 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Sep 23 04:50:12.800451 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Sep 23 04:50:12.800451 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Sep 23 04:50:12.800451 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device c9ea74a4-95a5-464a-be34-5cbb337331ee is not bootable. Sep 23 04:50:12.800451 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:12.800451 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:50:12.800451 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:12.800451 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:12.800451 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:50:12.800451 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:50:12.800451 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:50:12.800451 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:50:12.800451 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:50:12.800451 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:50:12.800451 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:50:12.800451 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:50:12.800451 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:50:12.804659 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:50:12.804659 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:50:12.804659 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:50:12.804659 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 23 04:50:12.804659 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Sep 23 04:50:12.804659 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 23 04:50:12.804659 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device c9ea74a4-95a5-464a-be34-5cbb337331ee is not bootable. Sep 23 04:50:12.804659 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:12.804659 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:50:12.804659 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:12.804659 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:12.804659 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:50:12.804659 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:50:12.804659 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:50:12.804659 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:50:12.804659 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device c9ea74a4-95a5-464a-be34-5cbb337331ee is not bootable. Sep 23 04:50:12.804659 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:12.804659 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f361f4a1-8e42-4a47-9bfc-c8955aa8060c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Returning 400 to user: Block Device c9ea74a4-95a5-464a-be34-5cbb337331ee is not bootable. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:50:12.804659 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f361f4a1-8e42-4a47-9bfc-c8955aa8060c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.149123 Sep 23 04:50:12.804659 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2181/4250] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:50:12 2022] POST /compute/v2.1/servers => generated 110 bytes in 150 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 23 04:50:12.817334 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6df2ff7e-75e4-4f1f-a585-3de729265200 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:12.818333 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-6df2ff7e-75e4-4f1f-a585-3de729265200 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:12.830011 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6df2ff7e-75e4-4f1f-a585-3de729265200 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:12.830682 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6df2ff7e-75e4-4f1f-a585-3de729265200 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:12.831476 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6df2ff7e-75e4-4f1f-a585-3de729265200 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:12.832991 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6df2ff7e-75e4-4f1f-a585-3de729265200 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:12.833455 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6df2ff7e-75e4-4f1f-a585-3de729265200 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:12.834257 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6df2ff7e-75e4-4f1f-a585-3de729265200 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:13.045755 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6df2ff7e-75e4-4f1f-a585-3de729265200 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:13.066885 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-6df2ff7e-75e4-4f1f-a585-3de729265200 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1503 microversion: 2.1 time: 0.251688 Sep 23 04:50:13.068302 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2070/4251] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:12 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1503 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:13.095165 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-13f083ef-c89f-43b9-80d0-4cb45deb3cb7 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:13.095671 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-13f083ef-c89f-43b9-80d0-4cb45deb3cb7 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:13.101782 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-13f083ef-c89f-43b9-80d0-4cb45deb3cb7 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:13.102513 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-13f083ef-c89f-43b9-80d0-4cb45deb3cb7 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:13.106877 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-13f083ef-c89f-43b9-80d0-4cb45deb3cb7 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:13.106877 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-13f083ef-c89f-43b9-80d0-4cb45deb3cb7 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:13.106877 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-13f083ef-c89f-43b9-80d0-4cb45deb3cb7 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:13.106877 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-13f083ef-c89f-43b9-80d0-4cb45deb3cb7 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:13.317586 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-13f083ef-c89f-43b9-80d0-4cb45deb3cb7 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:13.331279 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-13f083ef-c89f-43b9-80d0-4cb45deb3cb7 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1503 microversion: 2.1 time: 0.241571 Sep 23 04:50:13.332771 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2182/4252] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:13 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1503 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:13.433308 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-02f4520a-ecdb-49ab-8866-8d54c1eb00f5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:13.434498 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-02f4520a-ecdb-49ab-8866-8d54c1eb00f5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 30d846a2-5966-4fae-9515-9d873d882e6b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:13.442838 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-02f4520a-ecdb-49ab-8866-8d54c1eb00f5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:13.443586 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-02f4520a-ecdb-49ab-8866-8d54c1eb00f5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:13.444914 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-02f4520a-ecdb-49ab-8866-8d54c1eb00f5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:13.446318 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-02f4520a-ecdb-49ab-8866-8d54c1eb00f5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:13.446950 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-02f4520a-ecdb-49ab-8866-8d54c1eb00f5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:13.447648 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-02f4520a-ecdb-49ab-8866-8d54c1eb00f5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:13.646685 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-02f4520a-ecdb-49ab-8866-8d54c1eb00f5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:13.655507 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-02f4520a-ecdb-49ab-8866-8d54c1eb00f5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/30d846a2-5966-4fae-9515-9d873d882e6b" status: 200 len: 1314 microversion: 2.1 time: 0.227303 Sep 23 04:50:13.656047 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2071/4253] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:13 2022] GET /compute/v2.1/servers/30d846a2-5966-4fae-9515-9d873d882e6b => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:13.818808 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4dddedb2-4aa5-4cd9-8371-765bbac43ed7 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:13.823413 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4dddedb2-4aa5-4cd9-8371-765bbac43ed7 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] [instance: 0ecb44a6-a97f-4177-aa9a-29a5b9b51a95] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:13.829440 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4dddedb2-4aa5-4cd9-8371-765bbac43ed7 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:13.829965 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4dddedb2-4aa5-4cd9-8371-765bbac43ed7 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:13.830415 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4dddedb2-4aa5-4cd9-8371-765bbac43ed7 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:13.831178 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4dddedb2-4aa5-4cd9-8371-765bbac43ed7 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:13.832170 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4dddedb2-4aa5-4cd9-8371-765bbac43ed7 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:13.832612 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4dddedb2-4aa5-4cd9-8371-765bbac43ed7 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:14.049327 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-4dddedb2-4aa5-4cd9-8371-765bbac43ed7 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a52352ab894e8f88be0f9d1cef0b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e32df90da6b43b7b8a562dd95e6833b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:14.073207 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4dddedb2-4aa5-4cd9-8371-765bbac43ed7 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] 10.222.0.33 "GET /compute/v2.1/servers/0ecb44a6-a97f-4177-aa9a-29a5b9b51a95" status: 200 len: 1355 microversion: 2.1 time: 0.260100 Sep 23 04:50:14.081957 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2183/4254] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:13 2022] GET /compute/v2.1/servers/0ecb44a6-a97f-4177-aa9a-29a5b9b51a95 => generated 1355 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:14.680154 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6864aa79-c307-4358-ae25-44f2c105b753 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:14.680680 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-6864aa79-c307-4358-ae25-44f2c105b753 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 30d846a2-5966-4fae-9515-9d873d882e6b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:14.695698 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6864aa79-c307-4358-ae25-44f2c105b753 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:14.696050 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6864aa79-c307-4358-ae25-44f2c105b753 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:14.696496 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6864aa79-c307-4358-ae25-44f2c105b753 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:14.697308 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6864aa79-c307-4358-ae25-44f2c105b753 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:14.697776 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6864aa79-c307-4358-ae25-44f2c105b753 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:14.698414 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6864aa79-c307-4358-ae25-44f2c105b753 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:14.936125 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6864aa79-c307-4358-ae25-44f2c105b753 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:14.948619 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-6864aa79-c307-4358-ae25-44f2c105b753 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/30d846a2-5966-4fae-9515-9d873d882e6b" status: 200 len: 1314 microversion: 2.1 time: 0.271804 Sep 23 04:50:14.961475 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2072/4255] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:14 2022] GET /compute/v2.1/servers/30d846a2-5966-4fae-9515-9d873d882e6b => generated 1314 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:15.099973 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4c4668b3-a423-4cc8-83b9-d17ae2a990da tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:15.100664 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4c4668b3-a423-4cc8-83b9-d17ae2a990da tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] [instance: 0ecb44a6-a97f-4177-aa9a-29a5b9b51a95] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:15.116065 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4c4668b3-a423-4cc8-83b9-d17ae2a990da tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:15.116591 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4c4668b3-a423-4cc8-83b9-d17ae2a990da tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:15.121513 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4c4668b3-a423-4cc8-83b9-d17ae2a990da tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:15.122459 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4c4668b3-a423-4cc8-83b9-d17ae2a990da tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:15.123131 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4c4668b3-a423-4cc8-83b9-d17ae2a990da tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:15.123841 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4c4668b3-a423-4cc8-83b9-d17ae2a990da tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:15.158717 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:50:15.370001 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-4c4668b3-a423-4cc8-83b9-d17ae2a990da tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a52352ab894e8f88be0f9d1cef0b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e32df90da6b43b7b8a562dd95e6833b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:15.384622 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4c4668b3-a423-4cc8-83b9-d17ae2a990da tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] 10.222.0.33 "GET /compute/v2.1/servers/0ecb44a6-a97f-4177-aa9a-29a5b9b51a95" status: 200 len: 1355 microversion: 2.1 time: 0.289002 Sep 23 04:50:15.386449 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2184/4256] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:15 2022] GET /compute/v2.1/servers/0ecb44a6-a97f-4177-aa9a-29a5b9b51a95 => generated 1355 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:15.975722 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f45eecb3-a22a-4ff6-83d6-89f13817638f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:15.976355 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f45eecb3-a22a-4ff6-83d6-89f13817638f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 30d846a2-5966-4fae-9515-9d873d882e6b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:15.986565 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f45eecb3-a22a-4ff6-83d6-89f13817638f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:15.987320 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f45eecb3-a22a-4ff6-83d6-89f13817638f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:15.988220 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f45eecb3-a22a-4ff6-83d6-89f13817638f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:15.989164 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f45eecb3-a22a-4ff6-83d6-89f13817638f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:15.989819 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f45eecb3-a22a-4ff6-83d6-89f13817638f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:15.990612 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f45eecb3-a22a-4ff6-83d6-89f13817638f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:16.330590 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-bcaa9bfd-b9c9-4081-8580-44304076d677 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-630240905", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "destination_type": "local"}, {"source_type": "volume", "uuid": "ca071b8e-3ac7-4166-975e-59ae89b370c1", "destination_type": "invalid"}], "networks": [{"uuid": "eaa0cbf4-9a92-44f9-ac8d-d8f60e6441c0"}]}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:50:16.340094 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-bcaa9bfd-b9c9-4081-8580-44304076d677 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Request method failure captured: Sep 23 04:50:16.340094 n-d-846463-3 devstack@n-api.service[122699]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 23 04:50:16.340094 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:50:16.340094 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:50:16.340094 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:50:16.340094 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 494 Sep 23 04:50:16.340094 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:50:16.340094 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:50:16.340094 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:50:16.340094 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:50:16.340094 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTrDoGx96bSja4ydTGD-VWXTOyHeLiBA9Lvr197ivKeXqtV3OksEUUEiEPXK85IMwWXM1vCTp1M9PaXnUkKbFev29d-fL5KKXR0MfyGa86SLKINg6u_gn5EQLUNZ8EVLCkU1WwJ7agpVlFY75EyJH0fBcxrNg1yvFbeC2alzdH4Tkmw Sep 23 04:50:16.340094 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:50:16.340094 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:50:16.340094 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:50:16.340094 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:50:16.340094 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:50:16.340094 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:50:16.340094 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 78dca47156ff4f19a8673b893c853978 Sep 23 04:50:16.340094 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:50:16.340094 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:50:16.340094 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:50:16.340094 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_78dca47156ff4f19a8673b893c853978", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/78dca47156ff4f19a8673b893c853978"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/78dca47156ff4f19a8673b893c853978"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/78dca47156ff4f19a8673b893c853978"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:50:16.340094 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:50:16.340094 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 78dca47156ff4f19a8673b893c853978 Sep 23 04:50:16.340094 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:50:16.340094 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ServersNegativeTestJSON-1102187211-project Sep 23 04:50:16.340094 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:50:16.340094 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:50:16.340094 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: c912fb9d1f5447d180a9e8568220526f Sep 23 04:50:16.340094 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ServersNegativeTestJSON-1102187211-project Sep 23 04:50:16.340094 n-d-846463-3 devstack@n-api.service[122699]: Sep 23 04:50:16.340094 n-d-846463-3 devstack@n-api.service[122699]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-630240905", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "destination_type": "local"}, {"source_type": "volume", "uuid": "ca071b8e-3ac7-4166-975e-59ae89b370c1", "destination_type": "invalid"}], "networks": [{"uuid": "eaa0cbf4-9a92-44f9-ac8d-d8f60e6441c0"}]}} Sep 23 04:50:16.340094 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:50:16.340094 n-d-846463-3 devstack@n-api.service[122699]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Sep 23 04:50:16.340094 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-630240905', 'imageRef': 'b8dd79b9-f0b9-43a9-9605-17244137c0ee', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': 'b8dd79b9-f0b9-43a9-9605-17244137c0ee', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': 'ca071b8e-3ac7-4166-975e-59ae89b370c1', 'destination_type': 'invalid'}], 'networks': [{'uuid': 'eaa0cbf4-9a92-44f9-ac8d-d8f60e6441c0'}]}}} Sep 23 04:50:16.340094 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:50:16.340094 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:16.340094 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 23 04:50:16.340094 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 23 04:50:16.340094 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 23 04:50:16.340094 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise error Sep 23 04:50:16.340094 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Sep 23 04:50:16.340094 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:16.340094 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Sep 23 04:50:16.340094 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Sep 23 04:50:16.340094 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:16.340094 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Sep 23 04:50:16.340094 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi 'invalid' Sep 23 04:50:16.340094 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:16.340094 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:50:16.340094 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:16.340094 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:16.340094 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:50:16.340094 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:50:16.340094 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:50:16.340094 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:50:16.340094 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:50:16.343336 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:50:16.343336 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:50:16.343336 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:50:16.343336 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 23 04:50:16.343336 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 23 04:50:16.343336 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 23 04:50:16.343336 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 23 04:50:16.343336 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 23 04:50:16.343336 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 23 04:50:16.343336 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Sep 23 04:50:16.343336 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:16.343336 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:50:16.343336 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:16.343336 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:16.343336 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:50:16.343336 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:50:16.343336 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 23 04:50:16.343336 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 23 04:50:16.343336 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Sep 23 04:50:16.343336 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:16.343336 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-bcaa9bfd-b9c9-4081-8580-44304076d677 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:50:16.343336 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-bcaa9bfd-b9c9-4081-8580-44304076d677 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.023123 Sep 23 04:50:16.349294 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2185/4257] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:50:16 2022] POST /compute/v2.1/servers => generated 155 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 23 04:50:16.357813 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-33b7dace-7ab3-43da-9ff0-cad9082f7099 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:16.358699 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-33b7dace-7ab3-43da-9ff0-cad9082f7099 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:16.369694 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-33b7dace-7ab3-43da-9ff0-cad9082f7099 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:16.370508 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-33b7dace-7ab3-43da-9ff0-cad9082f7099 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:16.371255 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-33b7dace-7ab3-43da-9ff0-cad9082f7099 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:16.372186 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-33b7dace-7ab3-43da-9ff0-cad9082f7099 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:16.372864 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-33b7dace-7ab3-43da-9ff0-cad9082f7099 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:16.373489 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-33b7dace-7ab3-43da-9ff0-cad9082f7099 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:16.666465 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f45eecb3-a22a-4ff6-83d6-89f13817638f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:16.676513 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f45eecb3-a22a-4ff6-83d6-89f13817638f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/30d846a2-5966-4fae-9515-9d873d882e6b" status: 200 len: 1314 microversion: 2.1 time: 0.704900 Sep 23 04:50:16.681241 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2073/4258] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:15 2022] GET /compute/v2.1/servers/30d846a2-5966-4fae-9515-9d873d882e6b => generated 1314 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:16.698627 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-04cc78c0-c176-42be-a918-ce05cd11ea43 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:16.699528 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-04cc78c0-c176-42be-a918-ce05cd11ea43 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] [instance: 0ecb44a6-a97f-4177-aa9a-29a5b9b51a95] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:16.715543 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-04cc78c0-c176-42be-a918-ce05cd11ea43 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:16.716593 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-04cc78c0-c176-42be-a918-ce05cd11ea43 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:16.717237 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-04cc78c0-c176-42be-a918-ce05cd11ea43 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:16.723336 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-04cc78c0-c176-42be-a918-ce05cd11ea43 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:16.724818 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-04cc78c0-c176-42be-a918-ce05cd11ea43 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:16.725459 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-04cc78c0-c176-42be-a918-ce05cd11ea43 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:16.737412 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-33b7dace-7ab3-43da-9ff0-cad9082f7099 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:16.748262 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-33b7dace-7ab3-43da-9ff0-cad9082f7099 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1503 microversion: 2.1 time: 0.394387 Sep 23 04:50:16.754301 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2186/4259] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:16 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1503 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:16.786730 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f64d8a6b-1203-43f3-8528-581e9bd1cf2f tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:16.787599 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f64d8a6b-1203-43f3-8528-581e9bd1cf2f tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:16.796419 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f64d8a6b-1203-43f3-8528-581e9bd1cf2f tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:16.796931 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f64d8a6b-1203-43f3-8528-581e9bd1cf2f tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:16.797380 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f64d8a6b-1203-43f3-8528-581e9bd1cf2f tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:16.798153 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f64d8a6b-1203-43f3-8528-581e9bd1cf2f tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:16.798626 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f64d8a6b-1203-43f3-8528-581e9bd1cf2f tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:16.799050 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f64d8a6b-1203-43f3-8528-581e9bd1cf2f tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:17.104042 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-04cc78c0-c176-42be-a918-ce05cd11ea43 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a52352ab894e8f88be0f9d1cef0b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e32df90da6b43b7b8a562dd95e6833b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:17.120035 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-04cc78c0-c176-42be-a918-ce05cd11ea43 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] 10.222.0.33 "GET /compute/v2.1/servers/0ecb44a6-a97f-4177-aa9a-29a5b9b51a95" status: 200 len: 1355 microversion: 2.1 time: 0.435298 Sep 23 04:50:17.122264 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2074/4260] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:16 2022] GET /compute/v2.1/servers/0ecb44a6-a97f-4177-aa9a-29a5b9b51a95 => generated 1355 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:17.147306 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f64d8a6b-1203-43f3-8528-581e9bd1cf2f tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:17.155277 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f64d8a6b-1203-43f3-8528-581e9bd1cf2f tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1503 microversion: 2.1 time: 0.373291 Sep 23 04:50:17.155862 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2187/4261] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:16 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1503 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:50:17.224050 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b588cb73-8705-4861-89f8-27cc395a0986 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-8563226", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "eaa0cbf4-9a92-44f9-ac8d-d8f60e6441c0"}]}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:50:17.228686 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b588cb73-8705-4861-89f8-27cc395a0986 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Request method failure captured: Sep 23 04:50:17.228686 n-d-846463-3 devstack@n-api.service[122698]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 23 04:50:17.228686 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:50:17.228686 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:50:17.228686 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:50:17.228686 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 489 Sep 23 04:50:17.228686 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:50:17.228686 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:50:17.228686 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:50:17.228686 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:50:17.228686 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTrDoGx96bSja4ydTGD-VWXTOyHeLiBA9Lvr197ivKeXqtV3OksEUUEiEPXK85IMwWXM1vCTp1M9PaXnUkKbFev29d-fL5KKXR0MfyGa86SLKINg6u_gn5EQLUNZ8EVLCkU1WwJ7agpVlFY75EyJH0fBcxrNg1yvFbeC2alzdH4Tkmw Sep 23 04:50:17.228686 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:50:17.228686 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:50:17.228686 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:50:17.228686 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:50:17.228686 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:50:17.228686 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:50:17.228686 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 78dca47156ff4f19a8673b893c853978 Sep 23 04:50:17.228686 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:50:17.228686 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:50:17.228686 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:50:17.228686 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_78dca47156ff4f19a8673b893c853978", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/78dca47156ff4f19a8673b893c853978"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/78dca47156ff4f19a8673b893c853978"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/78dca47156ff4f19a8673b893c853978"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:50:17.228686 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:50:17.228686 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 78dca47156ff4f19a8673b893c853978 Sep 23 04:50:17.228686 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:50:17.228686 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ServersNegativeTestJSON-1102187211-project Sep 23 04:50:17.228686 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:50:17.228686 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:50:17.228686 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: c912fb9d1f5447d180a9e8568220526f Sep 23 04:50:17.228686 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ServersNegativeTestJSON-1102187211-project Sep 23 04:50:17.228686 n-d-846463-3 devstack@n-api.service[122698]: Sep 23 04:50:17.228686 n-d-846463-3 devstack@n-api.service[122698]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-8563226", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "eaa0cbf4-9a92-44f9-ac8d-d8f60e6441c0"}]}} Sep 23 04:50:17.228686 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:50:17.228686 n-d-846463-3 devstack@n-api.service[122698]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Sep 23 04:50:17.228686 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-8563226', 'imageRef': 'b8dd79b9-f0b9-43a9-9605-17244137c0ee', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': 'eaa0cbf4-9a92-44f9-ac8d-d8f60e6441c0'}]}}} Sep 23 04:50:17.228686 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:50:17.228686 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:17.228686 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 23 04:50:17.228686 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 23 04:50:17.228686 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 23 04:50:17.228686 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise error Sep 23 04:50:17.228686 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Sep 23 04:50:17.228686 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:50:17.228686 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Sep 23 04:50:17.228686 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Sep 23 04:50:17.228686 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:50:17.228686 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Sep 23 04:50:17.231522 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Sep 23 04:50:17.231522 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:50:17.231522 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:50:17.231522 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:50:17.231522 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:17.231522 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:50:17.231522 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:50:17.231522 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:50:17.231522 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:50:17.231522 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:50:17.231522 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:50:17.231522 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:50:17.231522 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:50:17.231522 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 23 04:50:17.231522 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 23 04:50:17.231522 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 23 04:50:17.231522 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 23 04:50:17.231522 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 23 04:50:17.231522 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 23 04:50:17.231522 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Sep 23 04:50:17.231522 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:50:17.231522 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:50:17.231522 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:50:17.231522 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:17.231522 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:50:17.231522 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:50:17.231522 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 23 04:50:17.231522 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 23 04:50:17.231522 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Sep 23 04:50:17.231522 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:50:17.231522 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b588cb73-8705-4861-89f8-27cc395a0986 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:50:17.231522 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b588cb73-8705-4861-89f8-27cc395a0986 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.010412 Sep 23 04:50:17.233296 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2075/4262] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:50:17 2022] POST /compute/v2.1/servers => generated 624 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 04:50:17.242849 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-899f9424-5638-4ea4-9df6-ec0f99109ac7 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:17.243472 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-899f9424-5638-4ea4-9df6-ec0f99109ac7 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:17.249624 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-899f9424-5638-4ea4-9df6-ec0f99109ac7 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:17.250165 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-899f9424-5638-4ea4-9df6-ec0f99109ac7 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:17.250610 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-899f9424-5638-4ea4-9df6-ec0f99109ac7 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:17.251324 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-899f9424-5638-4ea4-9df6-ec0f99109ac7 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:17.251786 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-899f9424-5638-4ea4-9df6-ec0f99109ac7 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:17.252217 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-899f9424-5638-4ea4-9df6-ec0f99109ac7 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:17.428795 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-899f9424-5638-4ea4-9df6-ec0f99109ac7 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:17.437017 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-899f9424-5638-4ea4-9df6-ec0f99109ac7 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1503 microversion: 2.1 time: 0.197946 Sep 23 04:50:17.438049 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2188/4263] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:17 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1503 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:17.461394 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-7c3316f8-f624-43b0-ae7d-3d8037515057 req-ba1f10f6-c1a1-4893-94f2-a9ee5e5abb5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ecb44a6-a97f-4177-aa9a-29a5b9b51a95", "name": "network-vif-plugged", "status": "completed", "tag": "9c63c256-13d3-4da8-a111-86c1b541a17b"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:50:17.472329 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:50:17.475129 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-7c3316f8-f624-43b0-ae7d-3d8037515057 req-ba1f10f6-c1a1-4893-94f2-a9ee5e5abb5b service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:17.490943 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-7c3316f8-f624-43b0-ae7d-3d8037515057 req-ba1f10f6-c1a1-4893-94f2-a9ee5e5abb5b service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:17.491477 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5cba9324-70ea-4e4d-9826-95421bfbe769 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:17.491567 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-7c3316f8-f624-43b0-ae7d-3d8037515057 req-ba1f10f6-c1a1-4893-94f2-a9ee5e5abb5b service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:17.491640 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-5cba9324-70ea-4e4d-9826-95421bfbe769 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:17.491640 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5cba9324-70ea-4e4d-9826-95421bfbe769 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:17.491640 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5cba9324-70ea-4e4d-9826-95421bfbe769 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:17.491640 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5cba9324-70ea-4e4d-9826-95421bfbe769 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:17.491640 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5cba9324-70ea-4e4d-9826-95421bfbe769 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:17.491640 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5cba9324-70ea-4e4d-9826-95421bfbe769 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:17.491640 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5cba9324-70ea-4e4d-9826-95421bfbe769 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:17.492058 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-7c3316f8-f624-43b0-ae7d-3d8037515057 req-ba1f10f6-c1a1-4893-94f2-a9ee5e5abb5b service nova] Creating event network-vif-plugged:9c63c256-13d3-4da8-a111-86c1b541a17b for instance 0ecb44a6-a97f-4177-aa9a-29a5b9b51a95 on n-h1-846463-3 Sep 23 04:50:17.496272 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-7c3316f8-f624-43b0-ae7d-3d8037515057 req-ba1f10f6-c1a1-4893-94f2-a9ee5e5abb5b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045624 Sep 23 04:50:17.497994 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2076/4264] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:50:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:50:17.631665 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-5cba9324-70ea-4e4d-9826-95421bfbe769 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:17.640083 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5cba9324-70ea-4e4d-9826-95421bfbe769 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1503 microversion: 2.1 time: 0.172914 Sep 23 04:50:17.640973 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2189/4265] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:17 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1503 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:17.708554 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c989b174-bcc7-4676-b5ad-4a0a38d5635e tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:17.709676 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c989b174-bcc7-4676-b5ad-4a0a38d5635e tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 30d846a2-5966-4fae-9515-9d873d882e6b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:17.718102 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c989b174-bcc7-4676-b5ad-4a0a38d5635e tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:17.718960 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c989b174-bcc7-4676-b5ad-4a0a38d5635e tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:17.719661 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c989b174-bcc7-4676-b5ad-4a0a38d5635e tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:17.721132 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c989b174-bcc7-4676-b5ad-4a0a38d5635e tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:17.721613 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c989b174-bcc7-4676-b5ad-4a0a38d5635e tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:17.722402 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c989b174-bcc7-4676-b5ad-4a0a38d5635e tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:17.733631 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1b6c1150-ca08-4cda-b3a3-ccdef586e93b tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "networks": [{"uuid": "eaa0cbf4-9a92-44f9-ac8d-d8f60e6441c0"}]}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:50:17.738354 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1b6c1150-ca08-4cda-b3a3-ccdef586e93b tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Request method failure captured: Sep 23 04:50:17.738354 n-d-846463-3 devstack@n-api.service[122699]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 23 04:50:17.738354 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:50:17.738354 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:50:17.738354 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:50:17.738354 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 416 Sep 23 04:50:17.738354 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:50:17.738354 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:50:17.738354 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:50:17.738354 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:50:17.738354 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTrDoGx96bSja4ydTGD-VWXTOyHeLiBA9Lvr197ivKeXqtV3OksEUUEiEPXK85IMwWXM1vCTp1M9PaXnUkKbFev29d-fL5KKXR0MfyGa86SLKINg6u_gn5EQLUNZ8EVLCkU1WwJ7agpVlFY75EyJH0fBcxrNg1yvFbeC2alzdH4Tkmw Sep 23 04:50:17.738354 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:50:17.738354 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:50:17.738354 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:50:17.738354 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:50:17.738354 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:50:17.738354 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:50:17.738354 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 78dca47156ff4f19a8673b893c853978 Sep 23 04:50:17.738354 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:50:17.738354 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:50:17.738354 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:50:17.738354 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_78dca47156ff4f19a8673b893c853978", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/78dca47156ff4f19a8673b893c853978"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/78dca47156ff4f19a8673b893c853978"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/78dca47156ff4f19a8673b893c853978"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:50:17.738354 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:50:17.738354 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 78dca47156ff4f19a8673b893c853978 Sep 23 04:50:17.738354 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:50:17.738354 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ServersNegativeTestJSON-1102187211-project Sep 23 04:50:17.738354 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:50:17.738354 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:50:17.738354 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: c912fb9d1f5447d180a9e8568220526f Sep 23 04:50:17.738354 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ServersNegativeTestJSON-1102187211-project Sep 23 04:50:17.738354 n-d-846463-3 devstack@n-api.service[122699]: Sep 23 04:50:17.738354 n-d-846463-3 devstack@n-api.service[122699]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "networks": [{"uuid": "eaa0cbf4-9a92-44f9-ac8d-d8f60e6441c0"}]}} Sep 23 04:50:17.738354 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:50:17.738354 n-d-846463-3 devstack@n-api.service[122699]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 23 04:50:17.738354 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': 'b8dd79b9-f0b9-43a9-9605-17244137c0ee', 'flavorRef': '452', 'networks': [{'uuid': 'eaa0cbf4-9a92-44f9-ac8d-d8f60e6441c0'}]}}} Sep 23 04:50:17.738354 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:50:17.738354 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:17.738354 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 23 04:50:17.738354 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 23 04:50:17.738354 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 23 04:50:17.738354 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise error Sep 23 04:50:17.738354 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 23 04:50:17.738354 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:17.738354 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Sep 23 04:50:17.738354 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 23 04:50:17.738354 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:17.738354 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 23 04:50:17.738354 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 23 04:50:17.738354 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:17.738354 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:50:17.741187 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:17.741187 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:17.741187 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:50:17.741187 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:50:17.741187 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:50:17.741187 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:50:17.741187 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:50:17.741187 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:50:17.741187 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:50:17.741187 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:50:17.741187 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 23 04:50:17.741187 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 23 04:50:17.741187 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 23 04:50:17.741187 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 23 04:50:17.741187 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 23 04:50:17.741187 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 23 04:50:17.741187 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 23 04:50:17.741187 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:17.741187 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:50:17.741187 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:17.741187 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:17.741187 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:50:17.741187 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:50:17.741187 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 23 04:50:17.741187 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 23 04:50:17.741187 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 23 04:50:17.741187 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:17.745741 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1b6c1150-ca08-4cda-b3a3-ccdef586e93b tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:50:17.747663 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1b6c1150-ca08-4cda-b3a3-ccdef586e93b tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.018034 Sep 23 04:50:17.749957 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2190/4266] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:50:17 2022] POST /compute/v2.1/servers => generated 619 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 04:50:17.764390 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-673b5cb6-6904-4342-aee8-27ddd727ad26 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:17.765408 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-673b5cb6-6904-4342-aee8-27ddd727ad26 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:17.774274 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-673b5cb6-6904-4342-aee8-27ddd727ad26 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:17.775602 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-673b5cb6-6904-4342-aee8-27ddd727ad26 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:17.783484 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-673b5cb6-6904-4342-aee8-27ddd727ad26 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:17.783484 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-673b5cb6-6904-4342-aee8-27ddd727ad26 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:17.783484 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-673b5cb6-6904-4342-aee8-27ddd727ad26 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:17.783484 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-673b5cb6-6904-4342-aee8-27ddd727ad26 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:18.012157 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c989b174-bcc7-4676-b5ad-4a0a38d5635e tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:18.018355 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-673b5cb6-6904-4342-aee8-27ddd727ad26 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:18.022822 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c989b174-bcc7-4676-b5ad-4a0a38d5635e tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/30d846a2-5966-4fae-9515-9d873d882e6b" status: 200 len: 1314 microversion: 2.1 time: 0.320921 Sep 23 04:50:18.024572 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2077/4267] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:17 2022] GET /compute/v2.1/servers/30d846a2-5966-4fae-9515-9d873d882e6b => generated 1314 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:18.042104 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-673b5cb6-6904-4342-aee8-27ddd727ad26 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1503 microversion: 2.1 time: 0.282350 Sep 23 04:50:18.054690 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2191/4268] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:17 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1503 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:18.067623 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ccf42174-19f5-41ab-9427-2c2949b835ac tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:18.068516 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-ccf42174-19f5-41ab-9427-2c2949b835ac tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:18.079400 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ccf42174-19f5-41ab-9427-2c2949b835ac tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:18.080237 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ccf42174-19f5-41ab-9427-2c2949b835ac tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:18.080905 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ccf42174-19f5-41ab-9427-2c2949b835ac tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:18.081752 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ccf42174-19f5-41ab-9427-2c2949b835ac tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:18.082321 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ccf42174-19f5-41ab-9427-2c2949b835ac tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:18.082828 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ccf42174-19f5-41ab-9427-2c2949b835ac tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:18.148726 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-170689ec-be98-440d-b485-808e8e9a46e8 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:18.149419 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-170689ec-be98-440d-b485-808e8e9a46e8 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] [instance: 0ecb44a6-a97f-4177-aa9a-29a5b9b51a95] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:18.156155 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-170689ec-be98-440d-b485-808e8e9a46e8 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:18.156842 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-170689ec-be98-440d-b485-808e8e9a46e8 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:18.157368 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-170689ec-be98-440d-b485-808e8e9a46e8 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:18.163396 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-170689ec-be98-440d-b485-808e8e9a46e8 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:18.164037 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-170689ec-be98-440d-b485-808e8e9a46e8 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:18.164717 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-170689ec-be98-440d-b485-808e8e9a46e8 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:18.427860 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ccf42174-19f5-41ab-9427-2c2949b835ac tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:18.440048 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ccf42174-19f5-41ab-9427-2c2949b835ac tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1503 microversion: 2.1 time: 0.376538 Sep 23 04:50:18.443930 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2078/4269] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:18 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1503 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:18.464310 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-170689ec-be98-440d-b485-808e8e9a46e8 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a52352ab894e8f88be0f9d1cef0b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e32df90da6b43b7b8a562dd95e6833b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:18.478861 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-170689ec-be98-440d-b485-808e8e9a46e8 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] 10.222.0.33 "GET /compute/v2.1/servers/0ecb44a6-a97f-4177-aa9a-29a5b9b51a95" status: 200 len: 1355 microversion: 2.1 time: 0.335606 Sep 23 04:50:18.479630 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2192/4270] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:18 2022] GET /compute/v2.1/servers/0ecb44a6-a97f-4177-aa9a-29a5b9b51a95 => generated 1355 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:50:18.566440 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3b7c32b9-cfc3-4ec6-bd57-65730296b226 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1846631490", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": -1, "networks": [{"uuid": "eaa0cbf4-9a92-44f9-ac8d-d8f60e6441c0"}]}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:50:18.581787 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-3b7c32b9-cfc3-4ec6-bd57-65730296b226 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] HTTP exception thrown: Flavor -1 could not be found. Sep 23 04:50:18.585475 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3b7c32b9-cfc3-4ec6-bd57-65730296b226 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Request method failure captured: Sep 23 04:50:18.585475 n-d-846463-3 devstack@n-api.service[122698]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 23 04:50:18.585475 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:50:18.585475 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:50:18.585475 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:50:18.585475 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 206 Sep 23 04:50:18.585475 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:50:18.585475 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:50:18.585475 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:50:18.585475 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:50:18.585475 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTrDoGx96bSja4ydTGD-VWXTOyHeLiBA9Lvr197ivKeXqtV3OksEUUEiEPXK85IMwWXM1vCTp1M9PaXnUkKbFev29d-fL5KKXR0MfyGa86SLKINg6u_gn5EQLUNZ8EVLCkU1WwJ7agpVlFY75EyJH0fBcxrNg1yvFbeC2alzdH4Tkmw Sep 23 04:50:18.585475 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:50:18.585475 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:50:18.585475 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:50:18.585475 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:50:18.585475 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:50:18.585475 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:50:18.585475 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 78dca47156ff4f19a8673b893c853978 Sep 23 04:50:18.585475 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:50:18.585475 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:50:18.585475 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:50:18.585475 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_78dca47156ff4f19a8673b893c853978", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/78dca47156ff4f19a8673b893c853978"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/78dca47156ff4f19a8673b893c853978"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/78dca47156ff4f19a8673b893c853978"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:50:18.585475 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:50:18.585475 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 78dca47156ff4f19a8673b893c853978 Sep 23 04:50:18.585475 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:50:18.585475 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ServersNegativeTestJSON-1102187211-project Sep 23 04:50:18.585475 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:50:18.585475 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:50:18.585475 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: c912fb9d1f5447d180a9e8568220526f Sep 23 04:50:18.585475 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ServersNegativeTestJSON-1102187211-project Sep 23 04:50:18.585475 n-d-846463-3 devstack@n-api.service[122698]: Sep 23 04:50:18.585475 n-d-846463-3 devstack@n-api.service[122698]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1846631490", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": -1, "networks": [{"uuid": "eaa0cbf4-9a92-44f9-ac8d-d8f60e6441c0"}]}} Sep 23 04:50:18.585475 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:50:18.585475 n-d-846463-3 devstack@n-api.service[122698]: exception: Flavor -1 could not be found. Sep 23 04:50:18.585475 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1846631490', 'imageRef': 'b8dd79b9-f0b9-43a9-9605-17244137c0ee', 'flavorRef': -1, 'networks': [{'uuid': 'eaa0cbf4-9a92-44f9-ac8d-d8f60e6441c0'}]}}} Sep 23 04:50:18.585475 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:50:18.585475 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:18.585475 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Sep 23 04:50:18.585475 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Sep 23 04:50:18.585475 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 23 04:50:18.585475 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 23 04:50:18.585475 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 04:50:18.585475 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 04:50:18.585475 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 23 04:50:18.585475 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 23 04:50:18.585475 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 23 04:50:18.585475 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:50:18.585475 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 23 04:50:18.585475 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 23 04:50:18.585475 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Sep 23 04:50:18.585475 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:50:18.585475 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:50:18.585475 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:50:18.585475 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:18.585475 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:50:18.585475 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:50:18.585475 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:50:18.585475 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:50:18.585475 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:50:18.585475 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:50:18.585475 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:50:18.585475 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:50:18.589767 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:50:18.589767 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:50:18.589767 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:50:18.589767 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:50:18.589767 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 23 04:50:18.589767 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Sep 23 04:50:18.589767 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 23 04:50:18.589767 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Sep 23 04:50:18.589767 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:50:18.589767 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:50:18.589767 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:50:18.589767 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:18.589767 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:50:18.589767 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:50:18.589767 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:50:18.589767 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:50:18.589767 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Sep 23 04:50:18.589767 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:50:18.593822 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3b7c32b9-cfc3-4ec6-bd57-65730296b226 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:50:18.595967 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3b7c32b9-cfc3-4ec6-bd57-65730296b226 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.032781 Sep 23 04:50:18.595967 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2079/4271] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:50:18 2022] POST /compute/v2.1/servers => generated 73 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 23 04:50:18.605850 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-45e98951-15c1-4480-9e06-4cae1a69607c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:18.606499 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-45e98951-15c1-4480-9e06-4cae1a69607c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:18.613632 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-45e98951-15c1-4480-9e06-4cae1a69607c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:18.614569 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-45e98951-15c1-4480-9e06-4cae1a69607c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:18.615095 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-45e98951-15c1-4480-9e06-4cae1a69607c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:18.615946 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-45e98951-15c1-4480-9e06-4cae1a69607c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:18.616420 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-45e98951-15c1-4480-9e06-4cae1a69607c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:18.616993 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-45e98951-15c1-4480-9e06-4cae1a69607c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:18.787242 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-45e98951-15c1-4480-9e06-4cae1a69607c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:18.798050 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-45e98951-15c1-4480-9e06-4cae1a69607c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1503 microversion: 2.1 time: 0.196718 Sep 23 04:50:18.798783 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2193/4272] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:18 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1503 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:50:18.824153 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b08d18e4-e01b-43fc-9e01-f95fdf8dab18 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:18.824874 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b08d18e4-e01b-43fc-9e01-f95fdf8dab18 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:18.832164 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b08d18e4-e01b-43fc-9e01-f95fdf8dab18 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:18.832957 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b08d18e4-e01b-43fc-9e01-f95fdf8dab18 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:18.833627 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b08d18e4-e01b-43fc-9e01-f95fdf8dab18 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:18.834649 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b08d18e4-e01b-43fc-9e01-f95fdf8dab18 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:18.835332 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b08d18e4-e01b-43fc-9e01-f95fdf8dab18 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:18.835996 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b08d18e4-e01b-43fc-9e01-f95fdf8dab18 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:19.051662 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-84f68665-7565-4a35-abff-64f399b5ae90 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:19.052440 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-84f68665-7565-4a35-abff-64f399b5ae90 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 30d846a2-5966-4fae-9515-9d873d882e6b] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:19.056863 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b08d18e4-e01b-43fc-9e01-f95fdf8dab18 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:19.063154 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-84f68665-7565-4a35-abff-64f399b5ae90 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:19.065001 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-84f68665-7565-4a35-abff-64f399b5ae90 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:19.067601 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-84f68665-7565-4a35-abff-64f399b5ae90 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:19.068546 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b08d18e4-e01b-43fc-9e01-f95fdf8dab18 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1503 microversion: 2.1 time: 0.249015 Sep 23 04:50:19.069653 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2080/4273] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:18 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1503 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:19.076604 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-84f68665-7565-4a35-abff-64f399b5ae90 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:19.077345 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-84f68665-7565-4a35-abff-64f399b5ae90 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:19.080685 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-84f68665-7565-4a35-abff-64f399b5ae90 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:19.162582 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d3050c04-99f8-40c5-be71-6b277102cf73 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2114647631", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "eaa0cbf4-9a92-44f9-ac8d-d8f60e6441c0"}]}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:50:19.167456 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d3050c04-99f8-40c5-be71-6b277102cf73 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Request method failure captured: Sep 23 04:50:19.167456 n-d-846463-3 devstack@n-api.service[122698]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 23 04:50:19.167456 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:50:19.167456 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:50:19.167456 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:50:19.167456 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 173 Sep 23 04:50:19.167456 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:50:19.167456 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:50:19.167456 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:50:19.167456 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:50:19.167456 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTrDoGx96bSja4ydTGD-VWXTOyHeLiBA9Lvr197ivKeXqtV3OksEUUEiEPXK85IMwWXM1vCTp1M9PaXnUkKbFev29d-fL5KKXR0MfyGa86SLKINg6u_gn5EQLUNZ8EVLCkU1WwJ7agpVlFY75EyJH0fBcxrNg1yvFbeC2alzdH4Tkmw Sep 23 04:50:19.167456 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:50:19.167456 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:50:19.167456 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:50:19.167456 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:50:19.167456 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:50:19.167456 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:50:19.167456 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 78dca47156ff4f19a8673b893c853978 Sep 23 04:50:19.167456 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:50:19.167456 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:50:19.167456 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:50:19.167456 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_78dca47156ff4f19a8673b893c853978", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/78dca47156ff4f19a8673b893c853978"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/78dca47156ff4f19a8673b893c853978"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/78dca47156ff4f19a8673b893c853978"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:50:19.167456 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:50:19.167456 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 78dca47156ff4f19a8673b893c853978 Sep 23 04:50:19.167456 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:50:19.167456 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ServersNegativeTestJSON-1102187211-project Sep 23 04:50:19.167456 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:50:19.167456 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:50:19.167456 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: c912fb9d1f5447d180a9e8568220526f Sep 23 04:50:19.167456 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ServersNegativeTestJSON-1102187211-project Sep 23 04:50:19.167456 n-d-846463-3 devstack@n-api.service[122698]: Sep 23 04:50:19.167456 n-d-846463-3 devstack@n-api.service[122698]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2114647631", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "eaa0cbf4-9a92-44f9-ac8d-d8f60e6441c0"}]}} Sep 23 04:50:19.167456 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:50:19.167456 n-d-846463-3 devstack@n-api.service[122698]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Sep 23 04:50:19.167456 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2114647631', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': 'eaa0cbf4-9a92-44f9-ac8d-d8f60e6441c0'}]}}} Sep 23 04:50:19.167456 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:50:19.167456 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:19.167456 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 23 04:50:19.167456 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 23 04:50:19.167456 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 23 04:50:19.167456 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise error Sep 23 04:50:19.167456 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Sep 23 04:50:19.167456 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:50:19.167456 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Sep 23 04:50:19.167456 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Sep 23 04:50:19.167456 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Sep 23 04:50:19.167456 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:50:19.167456 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 23 04:50:19.167456 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi -1 Sep 23 04:50:19.167456 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:50:19.167456 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:50:19.167456 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:50:19.167456 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:19.167456 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:50:19.167456 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:50:19.167456 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:50:19.167456 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:50:19.167456 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:50:19.167456 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:50:19.167456 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:50:19.167456 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:50:19.167456 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 23 04:50:19.167456 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 23 04:50:19.167456 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 23 04:50:19.173015 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 23 04:50:19.173015 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 23 04:50:19.173015 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 23 04:50:19.173015 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Sep 23 04:50:19.173015 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:50:19.173015 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:50:19.173015 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:50:19.173015 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:19.173015 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:50:19.173015 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:50:19.173015 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 23 04:50:19.173015 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 23 04:50:19.173015 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Sep 23 04:50:19.173015 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:50:19.173015 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d3050c04-99f8-40c5-be71-6b277102cf73 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:50:19.173015 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d3050c04-99f8-40c5-be71-6b277102cf73 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.010960 Sep 23 04:50:19.173015 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2081/4274] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:50:19 2022] POST /compute/v2.1/servers => generated 145 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 23 04:50:19.184036 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d4955633-9654-4a64-a1d3-82bfeed3403b tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:19.185083 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d4955633-9654-4a64-a1d3-82bfeed3403b tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:19.196777 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d4955633-9654-4a64-a1d3-82bfeed3403b tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:19.197453 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d4955633-9654-4a64-a1d3-82bfeed3403b tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:19.197931 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d4955633-9654-4a64-a1d3-82bfeed3403b tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:19.198651 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d4955633-9654-4a64-a1d3-82bfeed3403b tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:19.199426 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d4955633-9654-4a64-a1d3-82bfeed3403b tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:19.200017 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d4955633-9654-4a64-a1d3-82bfeed3403b tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:19.329103 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-84f68665-7565-4a35-abff-64f399b5ae90 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:19.338204 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-84f68665-7565-4a35-abff-64f399b5ae90 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/30d846a2-5966-4fae-9515-9d873d882e6b" status: 200 len: 1314 microversion: 2.1 time: 0.293299 Sep 23 04:50:19.339195 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2194/4275] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:19 2022] GET /compute/v2.1/servers/30d846a2-5966-4fae-9515-9d873d882e6b => generated 1314 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:50:19.441983 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d4955633-9654-4a64-a1d3-82bfeed3403b tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:19.457625 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d4955633-9654-4a64-a1d3-82bfeed3403b tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1503 microversion: 2.1 time: 0.278109 Sep 23 04:50:19.468426 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2082/4276] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:19 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1503 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:50:19.481871 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c40dc63c-6be2-4236-bd08-1b8b3ea14ac1 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:19.482526 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c40dc63c-6be2-4236-bd08-1b8b3ea14ac1 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:19.492416 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c40dc63c-6be2-4236-bd08-1b8b3ea14ac1 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:19.502372 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c40dc63c-6be2-4236-bd08-1b8b3ea14ac1 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:19.502372 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c40dc63c-6be2-4236-bd08-1b8b3ea14ac1 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:19.502372 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c40dc63c-6be2-4236-bd08-1b8b3ea14ac1 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:19.502372 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c40dc63c-6be2-4236-bd08-1b8b3ea14ac1 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:19.502372 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c40dc63c-6be2-4236-bd08-1b8b3ea14ac1 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:19.520285 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5c876dfd-ab18-4c0f-a7eb-c705792545c9 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:19.521151 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5c876dfd-ab18-4c0f-a7eb-c705792545c9 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] [instance: 0ecb44a6-a97f-4177-aa9a-29a5b9b51a95] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:19.533601 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5c876dfd-ab18-4c0f-a7eb-c705792545c9 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:19.534965 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5c876dfd-ab18-4c0f-a7eb-c705792545c9 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:19.535620 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5c876dfd-ab18-4c0f-a7eb-c705792545c9 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:19.536839 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5c876dfd-ab18-4c0f-a7eb-c705792545c9 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:19.537491 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5c876dfd-ab18-4c0f-a7eb-c705792545c9 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:19.538159 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5c876dfd-ab18-4c0f-a7eb-c705792545c9 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:19.897697 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-5c876dfd-ab18-4c0f-a7eb-c705792545c9 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a52352ab894e8f88be0f9d1cef0b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e32df90da6b43b7b8a562dd95e6833b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:19.911701 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5c876dfd-ab18-4c0f-a7eb-c705792545c9 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] 10.222.0.33 "GET /compute/v2.1/servers/0ecb44a6-a97f-4177-aa9a-29a5b9b51a95" status: 200 len: 1355 microversion: 2.1 time: 0.410895 Sep 23 04:50:19.912295 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2083/4277] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:19 2022] GET /compute/v2.1/servers/0ecb44a6-a97f-4177-aa9a-29a5b9b51a95 => generated 1355 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:19.917021 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-2c468f92-2ee9-443a-9817-678c7d54fff4 req-5022bf11-bda6-4901-bc4d-294e024122bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30d846a2-5966-4fae-9515-9d873d882e6b", "name": "network-vif-plugged", "status": "completed", "tag": "952d94de-d39b-44e0-8288-2417a201e386"}, {"server_uuid": "0ecb44a6-a97f-4177-aa9a-29a5b9b51a95", "name": "network-vif-plugged", "status": "completed", "tag": "5e46b412-353a-44c0-b22a-05d9da788ef3"}, {"server_uuid": "0ecb44a6-a97f-4177-aa9a-29a5b9b51a95", "name": "network-vif-plugged", "status": "completed", "tag": "225bcc05-7080-4633-a3f6-391f4277e3c0"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:50:19.921093 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c40dc63c-6be2-4236-bd08-1b8b3ea14ac1 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:19.929110 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-2c468f92-2ee9-443a-9817-678c7d54fff4 req-5022bf11-bda6-4901-bc4d-294e024122bb service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:19.929865 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-2c468f92-2ee9-443a-9817-678c7d54fff4 req-5022bf11-bda6-4901-bc4d-294e024122bb service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:19.930514 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-2c468f92-2ee9-443a-9817-678c7d54fff4 req-5022bf11-bda6-4901-bc4d-294e024122bb service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:19.931406 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c40dc63c-6be2-4236-bd08-1b8b3ea14ac1 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1503 microversion: 2.1 time: 0.453719 Sep 23 04:50:19.935248 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=100 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:50:19.938278 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2195/4278] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:19 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1503 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:50:19.948725 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-2c468f92-2ee9-443a-9817-678c7d54fff4 req-5022bf11-bda6-4901-bc4d-294e024122bb service nova] Creating event network-vif-plugged:952d94de-d39b-44e0-8288-2417a201e386 for instance 30d846a2-5966-4fae-9515-9d873d882e6b on n-h2-846463-3 Sep 23 04:50:19.952286 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-2c468f92-2ee9-443a-9817-678c7d54fff4 req-5022bf11-bda6-4901-bc4d-294e024122bb service nova] Creating event network-vif-plugged:5e46b412-353a-44c0-b22a-05d9da788ef3 for instance 0ecb44a6-a97f-4177-aa9a-29a5b9b51a95 on n-h1-846463-3 Sep 23 04:50:19.952286 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-2c468f92-2ee9-443a-9817-678c7d54fff4 req-5022bf11-bda6-4901-bc4d-294e024122bb service nova] Creating event network-vif-plugged:225bcc05-7080-4633-a3f6-391f4277e3c0 for instance 0ecb44a6-a97f-4177-aa9a-29a5b9b51a95 on n-h1-846463-3 Sep 23 04:50:19.960196 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-2c468f92-2ee9-443a-9817-678c7d54fff4 req-5022bf11-bda6-4901-bc4d-294e024122bb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.046527 Sep 23 04:50:19.961195 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2084/4279] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:50:19 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:50:20.028722 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-29f6f3a4-7a81-4d1a-944d-e809a48efddc tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-610530086", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:50:20.037131 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-29f6f3a4-7a81-4d1a-944d-e809a48efddc tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Sep 23 04:50:20.039173 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-29f6f3a4-7a81-4d1a-944d-e809a48efddc tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Request method failure captured: Sep 23 04:50:20.039173 n-d-846463-3 devstack@n-api.service[122699]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 23 04:50:20.039173 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:50:20.039173 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:50:20.039173 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:50:20.039173 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 215 Sep 23 04:50:20.039173 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:50:20.039173 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:50:20.039173 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:50:20.039173 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:50:20.039173 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTrDoGx96bSja4ydTGD-VWXTOyHeLiBA9Lvr197ivKeXqtV3OksEUUEiEPXK85IMwWXM1vCTp1M9PaXnUkKbFev29d-fL5KKXR0MfyGa86SLKINg6u_gn5EQLUNZ8EVLCkU1WwJ7agpVlFY75EyJH0fBcxrNg1yvFbeC2alzdH4Tkmw Sep 23 04:50:20.039173 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:50:20.039173 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:50:20.039173 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:50:20.039173 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:50:20.039173 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:50:20.039173 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:50:20.039173 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 78dca47156ff4f19a8673b893c853978 Sep 23 04:50:20.039173 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:50:20.039173 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:50:20.039173 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:50:20.039173 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_78dca47156ff4f19a8673b893c853978", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/78dca47156ff4f19a8673b893c853978"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/78dca47156ff4f19a8673b893c853978"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/78dca47156ff4f19a8673b893c853978"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:50:20.039173 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:50:20.039173 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 78dca47156ff4f19a8673b893c853978 Sep 23 04:50:20.039173 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:50:20.039173 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ServersNegativeTestJSON-1102187211-project Sep 23 04:50:20.039173 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:50:20.039173 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:50:20.039173 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: c912fb9d1f5447d180a9e8568220526f Sep 23 04:50:20.039173 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ServersNegativeTestJSON-1102187211-project Sep 23 04:50:20.039173 n-d-846463-3 devstack@n-api.service[122699]: Sep 23 04:50:20.039173 n-d-846463-3 devstack@n-api.service[122699]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-610530086", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Sep 23 04:50:20.039173 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:50:20.039173 n-d-846463-3 devstack@n-api.service[122699]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Sep 23 04:50:20.039173 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-610530086', 'imageRef': 'b8dd79b9-f0b9-43a9-9605-17244137c0ee', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Sep 23 04:50:20.039173 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:50:20.039173 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:20.039173 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:50:20.039173 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:50:20.039173 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:50:20.039173 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:50:20.039173 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:50:20.039173 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:50:20.039173 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:50:20.039173 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:50:20.039173 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:50:20.039173 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:50:20.039173 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:50:20.039173 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:50:20.039173 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 23 04:50:20.039173 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Sep 23 04:50:20.039173 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Sep 23 04:50:20.039173 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Sep 23 04:50:20.039173 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Sep 23 04:50:20.039173 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Sep 23 04:50:20.039173 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self._validate_network_id( Sep 23 04:50:20.039173 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Sep 23 04:50:20.039173 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Sep 23 04:50:20.039173 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Sep 23 04:50:20.039173 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:20.039173 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:50:20.046615 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:20.046615 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:20.046615 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:50:20.046615 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:50:20.046615 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:50:20.046615 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:50:20.046615 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Sep 23 04:50:20.046615 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:20.046615 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-29f6f3a4-7a81-4d1a-944d-e809a48efddc tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:50:20.046615 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-29f6f3a4-7a81-4d1a-944d-e809a48efddc tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.017222 Sep 23 04:50:20.046615 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2196/4280] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:50:20 2022] POST /compute/v2.1/servers => generated 123 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 04:50:20.051251 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-fc5318d5-00c1-4b23-acb4-2e31e83902b5 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:20.051977 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-fc5318d5-00c1-4b23-acb4-2e31e83902b5 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:20.059678 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fc5318d5-00c1-4b23-acb4-2e31e83902b5 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:20.060183 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fc5318d5-00c1-4b23-acb4-2e31e83902b5 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:20.060629 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fc5318d5-00c1-4b23-acb4-2e31e83902b5 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:20.061707 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fc5318d5-00c1-4b23-acb4-2e31e83902b5 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:20.062203 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fc5318d5-00c1-4b23-acb4-2e31e83902b5 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:20.062771 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fc5318d5-00c1-4b23-acb4-2e31e83902b5 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:20.272456 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-fc5318d5-00c1-4b23-acb4-2e31e83902b5 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:20.281448 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-fc5318d5-00c1-4b23-acb4-2e31e83902b5 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1503 microversion: 2.1 time: 0.235673 Sep 23 04:50:20.282411 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2085/4281] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:20 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1503 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:20.305713 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f869dd46-c379-47f7-8e9d-9c04bc405c3d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:20.307283 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f869dd46-c379-47f7-8e9d-9c04bc405c3d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:20.316137 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f869dd46-c379-47f7-8e9d-9c04bc405c3d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:20.317060 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f869dd46-c379-47f7-8e9d-9c04bc405c3d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:20.317690 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f869dd46-c379-47f7-8e9d-9c04bc405c3d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:20.330437 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f869dd46-c379-47f7-8e9d-9c04bc405c3d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:20.331098 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f869dd46-c379-47f7-8e9d-9c04bc405c3d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:20.332278 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f869dd46-c379-47f7-8e9d-9c04bc405c3d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:20.361621 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6cf07eb2-24f1-4dc4-8b86-f69586b6f18e tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:20.362497 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-6cf07eb2-24f1-4dc4-8b86-f69586b6f18e tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 30d846a2-5966-4fae-9515-9d873d882e6b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:20.374710 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6cf07eb2-24f1-4dc4-8b86-f69586b6f18e tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:20.374710 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6cf07eb2-24f1-4dc4-8b86-f69586b6f18e tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:20.374710 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6cf07eb2-24f1-4dc4-8b86-f69586b6f18e tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:20.374710 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6cf07eb2-24f1-4dc4-8b86-f69586b6f18e tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:20.374710 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6cf07eb2-24f1-4dc4-8b86-f69586b6f18e tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:20.374710 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6cf07eb2-24f1-4dc4-8b86-f69586b6f18e tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:20.671767 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6cf07eb2-24f1-4dc4-8b86-f69586b6f18e tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:20.683512 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-6cf07eb2-24f1-4dc4-8b86-f69586b6f18e tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/30d846a2-5966-4fae-9515-9d873d882e6b" status: 200 len: 1314 microversion: 2.1 time: 0.326513 Sep 23 04:50:20.685189 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2086/4282] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:20 2022] GET /compute/v2.1/servers/30d846a2-5966-4fae-9515-9d873d882e6b => generated 1314 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:50:20.716766 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f869dd46-c379-47f7-8e9d-9c04bc405c3d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:20.728047 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f869dd46-c379-47f7-8e9d-9c04bc405c3d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1503 microversion: 2.1 time: 0.426247 Sep 23 04:50:20.738923 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2197/4283] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:20 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1503 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:20.811771 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-324e3da5-8f98-42c3-8d9a-6b263f71dcef tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-450816176", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "key_name": "tempest-key-971018355", "networks": [{"uuid": "eaa0cbf4-9a92-44f9-ac8d-d8f60e6441c0"}]}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:50:20.878755 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.network.neutron [None req-324e3da5-8f98-42c3-8d9a-6b263f71dcef tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] validate_networks() for [('eaa0cbf4-9a92-44f9-ac8d-d8f60e6441c0', None, None, None, None, None)] {{(pid=122698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:50:20.938653 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-29cf0237-e256-419e-8d40-cfaf4153d00a tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:20.939802 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-29cf0237-e256-419e-8d40-cfaf4153d00a tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] [instance: 0ecb44a6-a97f-4177-aa9a-29a5b9b51a95] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:20.948365 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-29cf0237-e256-419e-8d40-cfaf4153d00a tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:20.949369 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-29cf0237-e256-419e-8d40-cfaf4153d00a tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:20.950384 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-29cf0237-e256-419e-8d40-cfaf4153d00a tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:20.951917 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-29cf0237-e256-419e-8d40-cfaf4153d00a tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:20.954095 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-29cf0237-e256-419e-8d40-cfaf4153d00a tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:20.954731 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-29cf0237-e256-419e-8d40-cfaf4153d00a tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:21.182510 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-324e3da5-8f98-42c3-8d9a-6b263f71dcef tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] HTTP exception thrown: Invalid key_name provided. Sep 23 04:50:21.184952 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-324e3da5-8f98-42c3-8d9a-6b263f71dcef tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Request method failure captured: Sep 23 04:50:21.184952 n-d-846463-3 devstack@n-api.service[122698]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 23 04:50:21.184952 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:50:21.184952 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:50:21.184952 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:50:21.184952 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 245 Sep 23 04:50:21.184952 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:50:21.184952 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:50:21.184952 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:50:21.184952 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:50:21.184952 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTrDoGx96bSja4ydTGD-VWXTOyHeLiBA9Lvr197ivKeXqtV3OksEUUEiEPXK85IMwWXM1vCTp1M9PaXnUkKbFev29d-fL5KKXR0MfyGa86SLKINg6u_gn5EQLUNZ8EVLCkU1WwJ7agpVlFY75EyJH0fBcxrNg1yvFbeC2alzdH4Tkmw Sep 23 04:50:21.184952 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:50:21.184952 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:50:21.184952 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:50:21.184952 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:50:21.184952 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:50:21.184952 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:50:21.184952 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 78dca47156ff4f19a8673b893c853978 Sep 23 04:50:21.184952 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:50:21.184952 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:50:21.184952 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:50:21.184952 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_78dca47156ff4f19a8673b893c853978", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/78dca47156ff4f19a8673b893c853978"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/78dca47156ff4f19a8673b893c853978"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/78dca47156ff4f19a8673b893c853978"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:50:21.184952 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:50:21.184952 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 78dca47156ff4f19a8673b893c853978 Sep 23 04:50:21.184952 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:50:21.184952 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ServersNegativeTestJSON-1102187211-project Sep 23 04:50:21.184952 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:50:21.184952 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:50:21.184952 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: c912fb9d1f5447d180a9e8568220526f Sep 23 04:50:21.184952 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ServersNegativeTestJSON-1102187211-project Sep 23 04:50:21.184952 n-d-846463-3 devstack@n-api.service[122698]: Sep 23 04:50:21.184952 n-d-846463-3 devstack@n-api.service[122698]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-450816176", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "key_name": "tempest-key-971018355", "networks": [{"uuid": "eaa0cbf4-9a92-44f9-ac8d-d8f60e6441c0"}]}} Sep 23 04:50:21.184952 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:50:21.184952 n-d-846463-3 devstack@n-api.service[122698]: exception: Invalid key_name provided. Sep 23 04:50:21.184952 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-450816176', 'imageRef': 'b8dd79b9-f0b9-43a9-9605-17244137c0ee', 'flavorRef': '452', 'key_name': 'tempest-key-971018355', 'networks': [{'uuid': 'eaa0cbf4-9a92-44f9-ac8d-d8f60e6441c0'}]}}} Sep 23 04:50:21.184952 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:50:21.184952 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:21.184952 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 23 04:50:21.184952 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 23 04:50:21.184952 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 23 04:50:21.184952 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 23 04:50:21.184952 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Sep 23 04:50:21.184952 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Sep 23 04:50:21.184952 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Sep 23 04:50:21.184952 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Sep 23 04:50:21.184952 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 04:50:21.184952 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 04:50:21.184952 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Sep 23 04:50:21.184952 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Sep 23 04:50:21.184952 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Sep 23 04:50:21.184952 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Sep 23 04:50:21.184952 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 23 04:50:21.184952 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 23 04:50:21.184952 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Sep 23 04:50:21.184952 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Sep 23 04:50:21.184952 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-971018355 not found for user c912fb9d1f5447d180a9e8568220526f Sep 23 04:50:21.184952 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:50:21.184952 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:50:21.184952 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:50:21.184952 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:21.184952 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:50:21.188451 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:50:21.188451 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:50:21.188451 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:50:21.188451 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:50:21.188451 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:50:21.188451 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:50:21.188451 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:50:21.188451 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:50:21.188451 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:50:21.188451 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:50:21.188451 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:50:21.188451 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 23 04:50:21.188451 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Sep 23 04:50:21.188451 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Sep 23 04:50:21.188451 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Sep 23 04:50:21.188451 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:50:21.188451 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:50:21.188451 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:50:21.188451 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:21.188451 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:50:21.188451 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:50:21.188451 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:50:21.188451 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:50:21.188451 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Sep 23 04:50:21.188451 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:50:21.188451 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-324e3da5-8f98-42c3-8d9a-6b263f71dcef tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Returning 400 to user: Invalid key_name provided. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:50:21.188451 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-324e3da5-8f98-42c3-8d9a-6b263f71dcef tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.378839 Sep 23 04:50:21.188451 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2087/4284] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:50:20 2022] POST /compute/v2.1/servers => generated 70 bytes in 380 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 23 04:50:21.190567 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-29cf0237-e256-419e-8d40-cfaf4153d00a tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a52352ab894e8f88be0f9d1cef0b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e32df90da6b43b7b8a562dd95e6833b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:21.196119 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7c62aebf-4ef8-48d3-a1df-df3f475c551e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:21.196736 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7c62aebf-4ef8-48d3-a1df-df3f475c551e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:21.197690 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-29cf0237-e256-419e-8d40-cfaf4153d00a tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] 10.222.0.33 "GET /compute/v2.1/servers/0ecb44a6-a97f-4177-aa9a-29a5b9b51a95" status: 200 len: 1355 microversion: 2.1 time: 0.266726 Sep 23 04:50:21.198836 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2198/4285] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:20 2022] GET /compute/v2.1/servers/0ecb44a6-a97f-4177-aa9a-29a5b9b51a95 => generated 1355 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:21.203051 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7c62aebf-4ef8-48d3-a1df-df3f475c551e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:21.203544 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7c62aebf-4ef8-48d3-a1df-df3f475c551e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:21.204000 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7c62aebf-4ef8-48d3-a1df-df3f475c551e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:21.204696 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7c62aebf-4ef8-48d3-a1df-df3f475c551e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:21.205153 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7c62aebf-4ef8-48d3-a1df-df3f475c551e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:21.205577 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7c62aebf-4ef8-48d3-a1df-df3f475c551e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:21.393042 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-7c62aebf-4ef8-48d3-a1df-df3f475c551e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:21.403653 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7c62aebf-4ef8-48d3-a1df-df3f475c551e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1503 microversion: 2.1 time: 0.212197 Sep 23 04:50:21.404791 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2088/4286] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:21 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1503 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:50:21.428218 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f469a6b2-f045-43ef-b57b-004eb776712d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:21.429431 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f469a6b2-f045-43ef-b57b-004eb776712d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:21.436277 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f469a6b2-f045-43ef-b57b-004eb776712d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:21.436773 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f469a6b2-f045-43ef-b57b-004eb776712d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:21.437219 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f469a6b2-f045-43ef-b57b-004eb776712d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:21.437942 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f469a6b2-f045-43ef-b57b-004eb776712d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:21.438583 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f469a6b2-f045-43ef-b57b-004eb776712d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:21.439283 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f469a6b2-f045-43ef-b57b-004eb776712d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:21.662250 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f469a6b2-f045-43ef-b57b-004eb776712d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:21.678195 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f469a6b2-f045-43ef-b57b-004eb776712d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1503 microversion: 2.1 time: 0.253645 Sep 23 04:50:21.678975 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2199/4287] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:21 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1503 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:21.721166 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a5f84ea0-6473-45cd-8e3d-910b7a0849f9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:21.723036 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a5f84ea0-6473-45cd-8e3d-910b7a0849f9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 30d846a2-5966-4fae-9515-9d873d882e6b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:21.755216 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a5f84ea0-6473-45cd-8e3d-910b7a0849f9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:21.758214 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a5f84ea0-6473-45cd-8e3d-910b7a0849f9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:21.758992 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a5f84ea0-6473-45cd-8e3d-910b7a0849f9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:21.760070 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a5f84ea0-6473-45cd-8e3d-910b7a0849f9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:21.761913 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a5f84ea0-6473-45cd-8e3d-910b7a0849f9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:21.767861 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d376d8e6-8245-410c-a172-5189b6dd13e7 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1891917910", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "eaa0cbf4-9a92-44f9-ac8d-d8f60e6441c0"}]}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:50:21.774684 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a5f84ea0-6473-45cd-8e3d-910b7a0849f9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:21.823801 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:50:21.939530 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.security_group_api [None req-d376d8e6-8245-410c-a172-5189b6dd13e7 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Neutron security group does_not_exist not found {{(pid=122699) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Sep 23 04:50:21.940323 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-d376d8e6-8245-410c-a172-5189b6dd13e7 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Sep 23 04:50:21.950926 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d376d8e6-8245-410c-a172-5189b6dd13e7 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Request method failure captured: Sep 23 04:50:21.950926 n-d-846463-3 devstack@n-api.service[122699]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 23 04:50:21.950926 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:50:21.950926 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:50:21.950926 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:50:21.950926 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 258 Sep 23 04:50:21.950926 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:50:21.950926 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:50:21.950926 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:50:21.950926 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:50:21.950926 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTrDoGx96bSja4ydTGD-VWXTOyHeLiBA9Lvr197ivKeXqtV3OksEUUEiEPXK85IMwWXM1vCTp1M9PaXnUkKbFev29d-fL5KKXR0MfyGa86SLKINg6u_gn5EQLUNZ8EVLCkU1WwJ7agpVlFY75EyJH0fBcxrNg1yvFbeC2alzdH4Tkmw Sep 23 04:50:21.950926 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:50:21.950926 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:50:21.950926 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:50:21.950926 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:50:21.950926 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:50:21.950926 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:50:21.950926 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 78dca47156ff4f19a8673b893c853978 Sep 23 04:50:21.950926 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:50:21.950926 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:50:21.950926 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:50:21.950926 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_78dca47156ff4f19a8673b893c853978", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/78dca47156ff4f19a8673b893c853978"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/78dca47156ff4f19a8673b893c853978"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/78dca47156ff4f19a8673b893c853978"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:50:21.950926 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:50:21.950926 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 78dca47156ff4f19a8673b893c853978 Sep 23 04:50:21.950926 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:50:21.950926 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ServersNegativeTestJSON-1102187211-project Sep 23 04:50:21.950926 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:50:21.950926 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:50:21.950926 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: c912fb9d1f5447d180a9e8568220526f Sep 23 04:50:21.950926 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ServersNegativeTestJSON-1102187211-project Sep 23 04:50:21.950926 n-d-846463-3 devstack@n-api.service[122699]: Sep 23 04:50:21.950926 n-d-846463-3 devstack@n-api.service[122699]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1891917910", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "eaa0cbf4-9a92-44f9-ac8d-d8f60e6441c0"}]}} Sep 23 04:50:21.950926 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:50:21.950926 n-d-846463-3 devstack@n-api.service[122699]: exception: Unable to find security_group with name or id 'does_not_exist' Sep 23 04:50:21.950926 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1891917910', 'imageRef': 'b8dd79b9-f0b9-43a9-9605-17244137c0ee', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': 'eaa0cbf4-9a92-44f9-ac8d-d8f60e6441c0'}]}}} Sep 23 04:50:21.950926 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:50:21.950926 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:21.950926 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Sep 23 04:50:21.950926 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Sep 23 04:50:21.950926 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:50:21.950926 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:50:21.950926 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Sep 23 04:50:21.950926 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Sep 23 04:50:21.950926 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Sep 23 04:50:21.950926 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:21.950926 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:50:21.950926 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:21.950926 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:21.950926 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Sep 23 04:50:21.950926 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Sep 23 04:50:21.950926 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:50:21.950926 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:50:21.950926 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Sep 23 04:50:21.950926 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Sep 23 04:50:21.950926 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Sep 23 04:50:21.950926 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:21.950926 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:50:21.950926 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:21.950926 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:21.950926 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Sep 23 04:50:21.950926 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Sep 23 04:50:21.955201 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Sep 23 04:50:21.955201 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Sep 23 04:50:21.955201 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Sep 23 04:50:21.955201 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Sep 23 04:50:21.955201 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 23 04:50:21.955201 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 23 04:50:21.955201 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Sep 23 04:50:21.955201 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Sep 23 04:50:21.955201 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Sep 23 04:50:21.955201 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:21.955201 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:50:21.955201 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:21.955201 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:21.955201 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 23 04:50:21.955201 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 23 04:50:21.955201 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 23 04:50:21.955201 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 23 04:50:21.955201 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Sep 23 04:50:21.955201 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Sep 23 04:50:21.955201 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Sep 23 04:50:21.955201 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Sep 23 04:50:21.955201 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Sep 23 04:50:21.955201 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Sep 23 04:50:21.955201 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Sep 23 04:50:21.955201 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 23 04:50:21.955201 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Sep 23 04:50:21.955201 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:21.955201 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:50:21.955201 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:21.955201 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:21.955201 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:50:21.955201 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:50:21.955201 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:50:21.955201 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:50:21.955201 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:50:21.955201 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:50:21.955201 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:50:21.955201 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:50:21.955201 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:50:21.955201 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:50:21.955201 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:50:21.955201 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:50:21.955201 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 23 04:50:21.955201 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Sep 23 04:50:21.955201 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 23 04:50:21.955201 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Sep 23 04:50:21.955201 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:21.955201 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:50:21.955201 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:21.955201 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:21.955201 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:50:21.955201 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:50:21.955201 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:50:21.955201 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:50:21.955201 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Sep 23 04:50:21.955201 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:21.969719 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d376d8e6-8245-410c-a172-5189b6dd13e7 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:50:21.969719 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d376d8e6-8245-410c-a172-5189b6dd13e7 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.205194 Sep 23 04:50:21.972563 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2200/4288] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:50:21 2022] POST /compute/v2.1/servers => generated 106 bytes in 209 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 04:50:21.980361 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-eca0d9ed-8846-40b6-920a-1fa8f4f7a3d4 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:21.986505 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-eca0d9ed-8846-40b6-920a-1fa8f4f7a3d4 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:22.007569 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eca0d9ed-8846-40b6-920a-1fa8f4f7a3d4 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:22.009441 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eca0d9ed-8846-40b6-920a-1fa8f4f7a3d4 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:22.010922 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eca0d9ed-8846-40b6-920a-1fa8f4f7a3d4 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:22.016142 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eca0d9ed-8846-40b6-920a-1fa8f4f7a3d4 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:22.016912 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eca0d9ed-8846-40b6-920a-1fa8f4f7a3d4 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:22.017572 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eca0d9ed-8846-40b6-920a-1fa8f4f7a3d4 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:22.103817 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a5f84ea0-6473-45cd-8e3d-910b7a0849f9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:22.112791 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a5f84ea0-6473-45cd-8e3d-910b7a0849f9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/30d846a2-5966-4fae-9515-9d873d882e6b" status: 200 len: 1500 microversion: 2.1 time: 0.400715 Sep 23 04:50:22.113928 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2089/4289] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:21 2022] GET /compute/v2.1/servers/30d846a2-5966-4fae-9515-9d873d882e6b => generated 1500 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:22.143271 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b3cc95c7-099c-41ad-9f81-debf1f022592 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:50:22.149877 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b3cc95c7-099c-41ad-9f81-debf1f022592 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:22.150419 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b3cc95c7-099c-41ad-9f81-debf1f022592 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:22.150867 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b3cc95c7-099c-41ad-9f81-debf1f022592 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:22.203099 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b3cc95c7-099c-41ad-9f81-debf1f022592 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 30d846a2-5966-4fae-9515-9d873d882e6b] Going to try to stop instance {{(pid=122698) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 23 04:50:22.263641 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-eca0d9ed-8846-40b6-920a-1fa8f4f7a3d4 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:22.281419 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-eca0d9ed-8846-40b6-920a-1fa8f4f7a3d4 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1503 microversion: 2.1 time: 0.305991 Sep 23 04:50:22.283787 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2201/4290] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:21 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1503 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:22.291035 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d79a1217-f5c7-40a3-bf39-65b34a2f9c48 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:22.295023 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d79a1217-f5c7-40a3-bf39-65b34a2f9c48 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] [instance: 0ecb44a6-a97f-4177-aa9a-29a5b9b51a95] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:22.301625 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d79a1217-f5c7-40a3-bf39-65b34a2f9c48 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:22.302731 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d79a1217-f5c7-40a3-bf39-65b34a2f9c48 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:22.304551 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d79a1217-f5c7-40a3-bf39-65b34a2f9c48 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:22.305735 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d79a1217-f5c7-40a3-bf39-65b34a2f9c48 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:22.307252 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d79a1217-f5c7-40a3-bf39-65b34a2f9c48 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:22.308196 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d79a1217-f5c7-40a3-bf39-65b34a2f9c48 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:22.410356 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b3cc95c7-099c-41ad-9f81-debf1f022592 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "POST /compute/v2.1/servers/30d846a2-5966-4fae-9515-9d873d882e6b/action" status: 202 len: 0 microversion: 2.1 time: 0.270633 Sep 23 04:50:22.413791 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2090/4291] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:50:22 2022] POST /compute/v2.1/servers/30d846a2-5966-4fae-9515-9d873d882e6b/action => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:50:22.423452 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d6266360-7876-4c16-b62a-1c31450f6a49 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:22.424198 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d6266360-7876-4c16-b62a-1c31450f6a49 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:22.438331 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d6266360-7876-4c16-b62a-1c31450f6a49 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:22.438770 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d6266360-7876-4c16-b62a-1c31450f6a49 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:22.439223 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d6266360-7876-4c16-b62a-1c31450f6a49 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:22.439945 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d6266360-7876-4c16-b62a-1c31450f6a49 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:22.441047 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d6266360-7876-4c16-b62a-1c31450f6a49 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:22.441501 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d6266360-7876-4c16-b62a-1c31450f6a49 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:22.887921 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d79a1217-f5c7-40a3-bf39-65b34a2f9c48 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a52352ab894e8f88be0f9d1cef0b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e32df90da6b43b7b8a562dd95e6833b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:22.903716 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d79a1217-f5c7-40a3-bf39-65b34a2f9c48 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] 10.222.0.33 "GET /compute/v2.1/servers/0ecb44a6-a97f-4177-aa9a-29a5b9b51a95" status: 200 len: 1806 microversion: 2.1 time: 0.618559 Sep 23 04:50:22.904547 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2202/4292] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:22 2022] GET /compute/v2.1/servers/0ecb44a6-a97f-4177-aa9a-29a5b9b51a95 => generated 1806 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:22.919002 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d6266360-7876-4c16-b62a-1c31450f6a49 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:22.925905 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d6266360-7876-4c16-b62a-1c31450f6a49 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1503 microversion: 2.1 time: 0.506719 Sep 23 04:50:22.925905 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2091/4293] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:22 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1503 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:22.926311 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-398817fc-1d48-446c-9e84-c98a36976946 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:22.927045 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-398817fc-1d48-446c-9e84-c98a36976946 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 30d846a2-5966-4fae-9515-9d873d882e6b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:22.938588 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-95afe598-29f8-464b-b5a3-41f882180b1e tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:22.939426 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-95afe598-29f8-464b-b5a3-41f882180b1e tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] [instance: 0ecb44a6-a97f-4177-aa9a-29a5b9b51a95] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:22.957270 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-95afe598-29f8-464b-b5a3-41f882180b1e tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:22.957270 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-95afe598-29f8-464b-b5a3-41f882180b1e tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:22.957270 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-95afe598-29f8-464b-b5a3-41f882180b1e tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:22.957270 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-95afe598-29f8-464b-b5a3-41f882180b1e tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:22.957270 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-95afe598-29f8-464b-b5a3-41f882180b1e tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:22.959612 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-398817fc-1d48-446c-9e84-c98a36976946 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:22.960160 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-398817fc-1d48-446c-9e84-c98a36976946 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:22.960755 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-398817fc-1d48-446c-9e84-c98a36976946 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:22.962540 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-95afe598-29f8-464b-b5a3-41f882180b1e tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:22.962684 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-398817fc-1d48-446c-9e84-c98a36976946 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:22.963153 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-398817fc-1d48-446c-9e84-c98a36976946 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:22.963607 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-398817fc-1d48-446c-9e84-c98a36976946 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:23.011916 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-95afe598-29f8-464b-b5a3-41f882180b1e tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] 10.222.0.33 "GET /compute/v2.1/servers/0ecb44a6-a97f-4177-aa9a-29a5b9b51a95/ips" status: 200 len: 219 microversion: 2.1 time: 0.082015 Sep 23 04:50:23.024095 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2203/4294] 10.222.0.33 () {58 vars in 1248 bytes} [Fri Sep 23 04:50:22 2022] GET /compute/v2.1/servers/0ecb44a6-a97f-4177-aa9a-29a5b9b51a95/ips => generated 219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:50:23.029647 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f588ac76-e294-439d-aa37-525fc45c5d2e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:23.030555 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f588ac76-e294-439d-aa37-525fc45c5d2e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: 2fa6ed36-f150-4664-b879-f5c094206d93] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:23.039531 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-f588ac76-e294-439d-aa37-525fc45c5d2e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] HTTP exception thrown: Instance 2fa6ed36-f150-4664-b879-f5c094206d93 could not be found. Sep 23 04:50:23.042029 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f588ac76-e294-439d-aa37-525fc45c5d2e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Request method failure captured: Sep 23 04:50:23.042029 n-d-846463-3 devstack@n-api.service[122699]: request: DELETE /compute/v2.1/servers/2fa6ed36-f150-4664-b879-f5c094206d93 HTTP/1.1 Sep 23 04:50:23.042029 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:50:23.042029 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:50:23.042029 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:50:23.042029 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:50:23.042029 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:50:23.042029 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:50:23.042029 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:50:23.042029 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:50:23.042029 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTrDoGx96bSja4ydTGD-VWXTOyHeLiBA9Lvr197ivKeXqtV3OksEUUEiEPXK85IMwWXM1vCTp1M9PaXnUkKbFev29d-fL5KKXR0MfyGa86SLKINg6u_gn5EQLUNZ8EVLCkU1WwJ7agpVlFY75EyJH0fBcxrNg1yvFbeC2alzdH4Tkmw Sep 23 04:50:23.042029 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:50:23.042029 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:50:23.042029 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:50:23.042029 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:50:23.042029 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:50:23.042029 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:50:23.042029 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 78dca47156ff4f19a8673b893c853978 Sep 23 04:50:23.042029 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:50:23.042029 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:50:23.042029 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:50:23.042029 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_78dca47156ff4f19a8673b893c853978", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/78dca47156ff4f19a8673b893c853978"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/78dca47156ff4f19a8673b893c853978"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/78dca47156ff4f19a8673b893c853978"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:50:23.042029 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:50:23.042029 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 78dca47156ff4f19a8673b893c853978 Sep 23 04:50:23.042029 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:50:23.042029 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ServersNegativeTestJSON-1102187211-project Sep 23 04:50:23.042029 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:50:23.042029 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:50:23.042029 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: c912fb9d1f5447d180a9e8568220526f Sep 23 04:50:23.042029 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ServersNegativeTestJSON-1102187211-project Sep 23 04:50:23.042029 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:50:23.042029 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 2fa6ed36-f150-4664-b879-f5c094206d93 could not be found. Sep 23 04:50:23.042029 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '2fa6ed36-f150-4664-b879-f5c094206d93'} Sep 23 04:50:23.042029 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:50:23.042029 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:23.042029 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:50:23.042029 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:50:23.042029 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:50:23.042029 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:50:23.042029 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 23 04:50:23.042029 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 23 04:50:23.042029 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2fa6ed36-f150-4664-b879-f5c094206d93 could not be found. Sep 23 04:50:23.042029 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:23.042029 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:50:23.042029 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:23.042029 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:23.042029 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:50:23.042029 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:50:23.042029 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:50:23.042029 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:50:23.042029 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:50:23.042029 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:50:23.042029 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 04:50:23.042029 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 04:50:23.042029 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 04:50:23.042029 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 04:50:23.042029 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:50:23.042029 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:50:23.042029 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:50:23.042029 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:50:23.042029 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2fa6ed36-f150-4664-b879-f5c094206d93 could not be found. Sep 23 04:50:23.042029 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:23.042029 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:50:23.047222 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:23.047222 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:23.047222 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:50:23.047222 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:50:23.047222 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:50:23.047222 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:50:23.047222 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2fa6ed36-f150-4664-b879-f5c094206d93 could not be found. Sep 23 04:50:23.047222 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:23.055573 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f588ac76-e294-439d-aa37-525fc45c5d2e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Returning 404 to user: Instance 2fa6ed36-f150-4664-b879-f5c094206d93 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:50:23.056840 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f588ac76-e294-439d-aa37-525fc45c5d2e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "DELETE /compute/v2.1/servers/2fa6ed36-f150-4664-b879-f5c094206d93" status: 404 len: 111 microversion: 2.1 time: 0.031601 Sep 23 04:50:23.057909 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2204/4295] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:50:23 2022] DELETE /compute/v2.1/servers/2fa6ed36-f150-4664-b879-f5c094206d93 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:50:23.078372 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-318eb72d-49eb-4773-a5ea-184e7b3372da tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:23.091407 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-318eb72d-49eb-4773-a5ea-184e7b3372da tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] [instance: 0ecb44a6-a97f-4177-aa9a-29a5b9b51a95] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:23.111916 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-318eb72d-49eb-4773-a5ea-184e7b3372da tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:23.111916 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-318eb72d-49eb-4773-a5ea-184e7b3372da tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:23.112190 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-318eb72d-49eb-4773-a5ea-184e7b3372da tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:23.118088 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-318eb72d-49eb-4773-a5ea-184e7b3372da tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:23.118585 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-318eb72d-49eb-4773-a5ea-184e7b3372da tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:23.119035 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-318eb72d-49eb-4773-a5ea-184e7b3372da tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:23.169278 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-318eb72d-49eb-4773-a5ea-184e7b3372da tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] [instance: 0ecb44a6-a97f-4177-aa9a-29a5b9b51a95] Going to try to terminate instance {{(pid=122699) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:50:23.189821 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=100 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:50:23.210973 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-398817fc-1d48-446c-9e84-c98a36976946 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:23.219822 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-398817fc-1d48-446c-9e84-c98a36976946 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/30d846a2-5966-4fae-9515-9d873d882e6b" status: 200 len: 1510 microversion: 2.1 time: 0.298257 Sep 23 04:50:23.220403 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2092/4296] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:22 2022] GET /compute/v2.1/servers/30d846a2-5966-4fae-9515-9d873d882e6b => generated 1510 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:23.226619 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-69fc2ffc-f7d8-48f9-a97c-98dbdc3275c9 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:23.227502 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-69fc2ffc-f7d8-48f9-a97c-98dbdc3275c9 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:23.234052 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-69fc2ffc-f7d8-48f9-a97c-98dbdc3275c9 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:23.234811 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-69fc2ffc-f7d8-48f9-a97c-98dbdc3275c9 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:23.235567 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-69fc2ffc-f7d8-48f9-a97c-98dbdc3275c9 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:23.236492 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-69fc2ffc-f7d8-48f9-a97c-98dbdc3275c9 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:23.237189 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-69fc2ffc-f7d8-48f9-a97c-98dbdc3275c9 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:23.237673 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-69fc2ffc-f7d8-48f9-a97c-98dbdc3275c9 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:23.460046 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-69fc2ffc-f7d8-48f9-a97c-98dbdc3275c9 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:23.468492 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-69fc2ffc-f7d8-48f9-a97c-98dbdc3275c9 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1503 microversion: 2.1 time: 0.246844 Sep 23 04:50:23.486739 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2093/4297] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:23 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1503 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:23.495332 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-68117712-d0fc-489f-b4ec-83e19a16e1a4 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:23.495332 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-68117712-d0fc-489f-b4ec-83e19a16e1a4 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:23.500508 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-68117712-d0fc-489f-b4ec-83e19a16e1a4 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:23.501870 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-68117712-d0fc-489f-b4ec-83e19a16e1a4 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:23.502535 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-68117712-d0fc-489f-b4ec-83e19a16e1a4 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:23.504229 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-68117712-d0fc-489f-b4ec-83e19a16e1a4 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:23.504998 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-68117712-d0fc-489f-b4ec-83e19a16e1a4 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:23.505616 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-68117712-d0fc-489f-b4ec-83e19a16e1a4 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:23.540760 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-318eb72d-49eb-4773-a5ea-184e7b3372da tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] 10.222.0.33 "DELETE /compute/v2.1/servers/0ecb44a6-a97f-4177-aa9a-29a5b9b51a95" status: 204 len: 0 microversion: 2.1 time: 0.480773 Sep 23 04:50:23.541780 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2205/4298] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:50:23 2022] DELETE /compute/v2.1/servers/0ecb44a6-a97f-4177-aa9a-29a5b9b51a95 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:50:23.550931 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-44eef169-5220-4fb4-b83f-ece239dcdf52 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:23.551950 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-44eef169-5220-4fb4-b83f-ece239dcdf52 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] [instance: 0ecb44a6-a97f-4177-aa9a-29a5b9b51a95] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:23.559451 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-44eef169-5220-4fb4-b83f-ece239dcdf52 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:23.564163 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-44eef169-5220-4fb4-b83f-ece239dcdf52 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:23.564163 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-44eef169-5220-4fb4-b83f-ece239dcdf52 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:23.564163 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-44eef169-5220-4fb4-b83f-ece239dcdf52 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:23.564163 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-44eef169-5220-4fb4-b83f-ece239dcdf52 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:23.564163 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-44eef169-5220-4fb4-b83f-ece239dcdf52 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:23.806730 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-68117712-d0fc-489f-b4ec-83e19a16e1a4 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:23.819126 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-68117712-d0fc-489f-b4ec-83e19a16e1a4 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1503 microversion: 2.1 time: 0.326111 Sep 23 04:50:23.831420 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-44eef169-5220-4fb4-b83f-ece239dcdf52 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a52352ab894e8f88be0f9d1cef0b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e32df90da6b43b7b8a562dd95e6833b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:23.836492 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2094/4299] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:23 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1503 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:23.843333 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-44eef169-5220-4fb4-b83f-ece239dcdf52 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] 10.222.0.33 "GET /compute/v2.1/servers/0ecb44a6-a97f-4177-aa9a-29a5b9b51a95" status: 200 len: 1812 microversion: 2.1 time: 0.297085 Sep 23 04:50:23.844792 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-560d4bbc-3361-407d-bdf0-e41997d5ae08 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:23.852543 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-560d4bbc-3361-407d-bdf0-e41997d5ae08 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Failed to fetch instance by id 9223372036854775808 {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 23 04:50:23.864135 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-560d4bbc-3361-407d-bdf0-e41997d5ae08 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Sep 23 04:50:23.864265 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2206/4300] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:23 2022] GET /compute/v2.1/servers/0ecb44a6-a97f-4177-aa9a-29a5b9b51a95 => generated 1812 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:23.864363 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-560d4bbc-3361-407d-bdf0-e41997d5ae08 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Request method failure captured: Sep 23 04:50:23.864363 n-d-846463-3 devstack@n-api.service[122698]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Sep 23 04:50:23.864363 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:50:23.864363 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:50:23.864363 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:50:23.864363 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:50:23.864363 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:50:23.864363 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:50:23.864363 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:50:23.864363 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:50:23.864363 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTrDoGx96bSja4ydTGD-VWXTOyHeLiBA9Lvr197ivKeXqtV3OksEUUEiEPXK85IMwWXM1vCTp1M9PaXnUkKbFev29d-fL5KKXR0MfyGa86SLKINg6u_gn5EQLUNZ8EVLCkU1WwJ7agpVlFY75EyJH0fBcxrNg1yvFbeC2alzdH4Tkmw Sep 23 04:50:23.864363 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:50:23.864363 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:50:23.864363 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:50:23.864363 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:50:23.864363 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:50:23.864363 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:50:23.864363 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 78dca47156ff4f19a8673b893c853978 Sep 23 04:50:23.864363 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:50:23.864363 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:50:23.864363 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:50:23.864363 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_78dca47156ff4f19a8673b893c853978", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/78dca47156ff4f19a8673b893c853978"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/78dca47156ff4f19a8673b893c853978"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/78dca47156ff4f19a8673b893c853978"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:50:23.864363 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:50:23.864363 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 78dca47156ff4f19a8673b893c853978 Sep 23 04:50:23.864363 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:50:23.864363 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ServersNegativeTestJSON-1102187211-project Sep 23 04:50:23.864363 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:50:23.864363 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:50:23.864363 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: c912fb9d1f5447d180a9e8568220526f Sep 23 04:50:23.864363 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ServersNegativeTestJSON-1102187211-project Sep 23 04:50:23.864363 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:50:23.864363 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 9223372036854775808 could not be found. Sep 23 04:50:23.864363 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '9223372036854775808'} Sep 23 04:50:23.864363 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:50:23.864363 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:23.864363 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:50:23.864363 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:50:23.864363 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 23 04:50:23.864363 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 23 04:50:23.864363 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Sep 23 04:50:23.864363 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:50:23.864363 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:50:23.864363 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:50:23.864363 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:23.864363 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:50:23.864363 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:50:23.864363 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:50:23.864363 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:50:23.864363 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:50:23.864363 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:50:23.864363 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 04:50:23.864363 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 04:50:23.864363 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 04:50:23.864363 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 04:50:23.864363 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:50:23.864363 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:50:23.864363 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:50:23.864363 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:50:23.864363 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Sep 23 04:50:23.864363 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:50:23.864363 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:50:23.864363 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:50:23.864363 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:23.864363 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:50:23.868589 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:50:23.868589 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:50:23.868589 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:50:23.868589 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Sep 23 04:50:23.868589 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:50:23.868589 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-560d4bbc-3361-407d-bdf0-e41997d5ae08 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:50:23.868589 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-560d4bbc-3361-407d-bdf0-e41997d5ae08 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.018818 Sep 23 04:50:23.868589 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2095/4301] 10.222.0.33 () {58 vars in 1188 bytes} [Fri Sep 23 04:50:23 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 23 04:50:23.873764 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-23adf18e-14af-4860-ab5d-c8c9341340a6 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:23.874801 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-23adf18e-14af-4860-ab5d-c8c9341340a6 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:23.883092 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-23adf18e-14af-4860-ab5d-c8c9341340a6 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:23.883728 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-23adf18e-14af-4860-ab5d-c8c9341340a6 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:23.884251 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-23adf18e-14af-4860-ab5d-c8c9341340a6 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:23.885042 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-23adf18e-14af-4860-ab5d-c8c9341340a6 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:23.885971 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-23adf18e-14af-4860-ab5d-c8c9341340a6 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:23.886408 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-23adf18e-14af-4860-ab5d-c8c9341340a6 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:24.055260 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-23adf18e-14af-4860-ab5d-c8c9341340a6 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:24.069951 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-23adf18e-14af-4860-ab5d-c8c9341340a6 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1503 microversion: 2.1 time: 0.200886 Sep 23 04:50:24.070777 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2207/4302] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:23 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1503 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:24.100205 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e16b0097-01aa-4e19-862e-3885db656132 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:24.101429 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e16b0097-01aa-4e19-862e-3885db656132 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:24.113644 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e16b0097-01aa-4e19-862e-3885db656132 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:24.114465 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e16b0097-01aa-4e19-862e-3885db656132 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:24.116188 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e16b0097-01aa-4e19-862e-3885db656132 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:24.117114 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e16b0097-01aa-4e19-862e-3885db656132 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:24.118013 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e16b0097-01aa-4e19-862e-3885db656132 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:24.118644 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e16b0097-01aa-4e19-862e-3885db656132 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:24.244915 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6abef93f-3745-4a59-a85b-530fca41c0a0 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:24.245804 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-6abef93f-3745-4a59-a85b-530fca41c0a0 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 30d846a2-5966-4fae-9515-9d873d882e6b] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:24.252682 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6abef93f-3745-4a59-a85b-530fca41c0a0 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:24.253221 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6abef93f-3745-4a59-a85b-530fca41c0a0 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:24.253938 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6abef93f-3745-4a59-a85b-530fca41c0a0 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:24.254980 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6abef93f-3745-4a59-a85b-530fca41c0a0 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:24.255597 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6abef93f-3745-4a59-a85b-530fca41c0a0 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:24.256186 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6abef93f-3745-4a59-a85b-530fca41c0a0 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:24.408898 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e16b0097-01aa-4e19-862e-3885db656132 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:24.418662 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e16b0097-01aa-4e19-862e-3885db656132 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1503 microversion: 2.1 time: 0.328705 Sep 23 04:50:24.419556 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2096/4303] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:24 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1503 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:24.449504 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f6be8c11-0d45-477b-a073-59bc817c6d36 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:24.450332 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f6be8c11-0d45-477b-a073-59bc817c6d36 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Failed to fetch instance by id -1 {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 23 04:50:24.451033 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-f6be8c11-0d45-477b-a073-59bc817c6d36 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] HTTP exception thrown: Instance -1 could not be found. Sep 23 04:50:24.452714 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f6be8c11-0d45-477b-a073-59bc817c6d36 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Request method failure captured: Sep 23 04:50:24.452714 n-d-846463-3 devstack@n-api.service[122698]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Sep 23 04:50:24.452714 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:50:24.452714 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:50:24.452714 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:50:24.452714 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:50:24.452714 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:50:24.452714 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:50:24.452714 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:50:24.452714 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:50:24.452714 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTrDoGx96bSja4ydTGD-VWXTOyHeLiBA9Lvr197ivKeXqtV3OksEUUEiEPXK85IMwWXM1vCTp1M9PaXnUkKbFev29d-fL5KKXR0MfyGa86SLKINg6u_gn5EQLUNZ8EVLCkU1WwJ7agpVlFY75EyJH0fBcxrNg1yvFbeC2alzdH4Tkmw Sep 23 04:50:24.452714 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:50:24.452714 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:50:24.452714 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:50:24.452714 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:50:24.452714 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:50:24.452714 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:50:24.452714 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 78dca47156ff4f19a8673b893c853978 Sep 23 04:50:24.452714 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:50:24.452714 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:50:24.452714 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:50:24.452714 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_78dca47156ff4f19a8673b893c853978", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/78dca47156ff4f19a8673b893c853978"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/78dca47156ff4f19a8673b893c853978"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/78dca47156ff4f19a8673b893c853978"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:50:24.452714 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:50:24.452714 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 78dca47156ff4f19a8673b893c853978 Sep 23 04:50:24.452714 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:50:24.452714 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ServersNegativeTestJSON-1102187211-project Sep 23 04:50:24.452714 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:50:24.452714 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:50:24.452714 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: c912fb9d1f5447d180a9e8568220526f Sep 23 04:50:24.452714 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ServersNegativeTestJSON-1102187211-project Sep 23 04:50:24.452714 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:50:24.452714 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance -1 could not be found. Sep 23 04:50:24.452714 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '-1'} Sep 23 04:50:24.452714 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:50:24.452714 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:24.452714 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:50:24.452714 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:50:24.452714 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 23 04:50:24.452714 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 23 04:50:24.452714 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Sep 23 04:50:24.452714 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:50:24.452714 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:50:24.452714 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:50:24.452714 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:24.452714 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:50:24.452714 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:50:24.452714 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:50:24.452714 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:50:24.452714 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:50:24.452714 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:50:24.452714 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 04:50:24.452714 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 04:50:24.452714 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 04:50:24.452714 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 04:50:24.452714 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:50:24.452714 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:50:24.452714 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:50:24.452714 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:50:24.452714 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Sep 23 04:50:24.452714 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:50:24.452714 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:50:24.452714 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:50:24.452714 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:24.452714 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:50:24.452714 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:50:24.456863 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:50:24.456863 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:50:24.456863 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Sep 23 04:50:24.456863 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:50:24.458817 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f6be8c11-0d45-477b-a073-59bc817c6d36 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Returning 404 to user: Instance -1 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:50:24.459852 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f6be8c11-0d45-477b-a073-59bc817c6d36 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.018531 Sep 23 04:50:24.464360 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2097/4304] 10.222.0.33 () {58 vars in 1137 bytes} [Fri Sep 23 04:50:24 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 23 04:50:24.481681 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d4814802-1c64-4994-9bda-d0d1517b934c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:24.482400 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d4814802-1c64-4994-9bda-d0d1517b934c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:24.490474 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d4814802-1c64-4994-9bda-d0d1517b934c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:24.494723 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d4814802-1c64-4994-9bda-d0d1517b934c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:24.495387 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d4814802-1c64-4994-9bda-d0d1517b934c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:24.496163 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d4814802-1c64-4994-9bda-d0d1517b934c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:24.496706 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d4814802-1c64-4994-9bda-d0d1517b934c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:24.499295 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d4814802-1c64-4994-9bda-d0d1517b934c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:24.533251 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-6abef93f-3745-4a59-a85b-530fca41c0a0 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:24.545619 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6abef93f-3745-4a59-a85b-530fca41c0a0 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/30d846a2-5966-4fae-9515-9d873d882e6b" status: 200 len: 1510 microversion: 2.1 time: 0.305141 Sep 23 04:50:24.546247 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2208/4305] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:24 2022] GET /compute/v2.1/servers/30d846a2-5966-4fae-9515-9d873d882e6b => generated 1510 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:24.692620 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d4814802-1c64-4994-9bda-d0d1517b934c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:24.703455 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d4814802-1c64-4994-9bda-d0d1517b934c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1503 microversion: 2.1 time: 0.227937 Sep 23 04:50:24.704340 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2098/4306] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:24 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1503 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:50:24.727716 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-dfa4f198-8e41-4001-b378-a4a66e8319e2 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:24.728411 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-dfa4f198-8e41-4001-b378-a4a66e8319e2 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:24.736683 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dfa4f198-8e41-4001-b378-a4a66e8319e2 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:24.737287 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dfa4f198-8e41-4001-b378-a4a66e8319e2 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:24.737929 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dfa4f198-8e41-4001-b378-a4a66e8319e2 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:24.740004 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dfa4f198-8e41-4001-b378-a4a66e8319e2 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:24.740471 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dfa4f198-8e41-4001-b378-a4a66e8319e2 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:24.741167 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dfa4f198-8e41-4001-b378-a4a66e8319e2 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:24.868074 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3837743f-6a76-4ebc-bb68-37e2cd0623ab tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:24.868992 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3837743f-6a76-4ebc-bb68-37e2cd0623ab tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] [instance: 0ecb44a6-a97f-4177-aa9a-29a5b9b51a95] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:24.875834 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3837743f-6a76-4ebc-bb68-37e2cd0623ab tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:24.876635 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3837743f-6a76-4ebc-bb68-37e2cd0623ab tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:24.877502 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3837743f-6a76-4ebc-bb68-37e2cd0623ab tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:24.879007 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3837743f-6a76-4ebc-bb68-37e2cd0623ab tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:24.882842 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3837743f-6a76-4ebc-bb68-37e2cd0623ab tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:24.883404 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3837743f-6a76-4ebc-bb68-37e2cd0623ab tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:24.929761 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-dfa4f198-8e41-4001-b378-a4a66e8319e2 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:24.940027 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-dfa4f198-8e41-4001-b378-a4a66e8319e2 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1503 microversion: 2.1 time: 0.215778 Sep 23 04:50:24.941180 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2209/4307] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:24 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1503 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:24.964106 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-db988eaa-cb78-46da-8c67-2a8500dfce51 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:50:24.964648 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-db988eaa-cb78-46da-8c67-2a8500dfce51 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a093a4ea-29ca-44d8-852b-2052ca5fffbb] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:24.970463 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-db988eaa-cb78-46da-8c67-2a8500dfce51 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] HTTP exception thrown: Instance a093a4ea-29ca-44d8-852b-2052ca5fffbb could not be found. Sep 23 04:50:24.985644 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-db988eaa-cb78-46da-8c67-2a8500dfce51 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Request method failure captured: Sep 23 04:50:24.985644 n-d-846463-3 devstack@n-api.service[122699]: request: POST /compute/v2.1/servers/a093a4ea-29ca-44d8-852b-2052ca5fffbb/action HTTP/1.1 Sep 23 04:50:24.985644 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:50:24.985644 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:50:24.985644 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:50:24.985644 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 19 Sep 23 04:50:24.985644 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:50:24.985644 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:50:24.985644 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:50:24.985644 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:50:24.985644 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTrDoGx96bSja4ydTGD-VWXTOyHeLiBA9Lvr197ivKeXqtV3OksEUUEiEPXK85IMwWXM1vCTp1M9PaXnUkKbFev29d-fL5KKXR0MfyGa86SLKINg6u_gn5EQLUNZ8EVLCkU1WwJ7agpVlFY75EyJH0fBcxrNg1yvFbeC2alzdH4Tkmw Sep 23 04:50:24.985644 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:50:24.985644 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:50:24.985644 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:50:24.985644 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:50:24.985644 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:50:24.985644 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:50:24.985644 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 78dca47156ff4f19a8673b893c853978 Sep 23 04:50:24.985644 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:50:24.985644 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:50:24.985644 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:50:24.985644 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_78dca47156ff4f19a8673b893c853978", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/78dca47156ff4f19a8673b893c853978"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/78dca47156ff4f19a8673b893c853978"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/78dca47156ff4f19a8673b893c853978"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:50:24.985644 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:50:24.985644 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 78dca47156ff4f19a8673b893c853978 Sep 23 04:50:24.985644 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:50:24.985644 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ServersNegativeTestJSON-1102187211-project Sep 23 04:50:24.985644 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:50:24.985644 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:50:24.985644 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: c912fb9d1f5447d180a9e8568220526f Sep 23 04:50:24.985644 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ServersNegativeTestJSON-1102187211-project Sep 23 04:50:24.985644 n-d-846463-3 devstack@n-api.service[122699]: Sep 23 04:50:24.985644 n-d-846463-3 devstack@n-api.service[122699]: {"forceDelete": {}} Sep 23 04:50:24.985644 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:50:24.985644 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance a093a4ea-29ca-44d8-852b-2052ca5fffbb could not be found. Sep 23 04:50:24.985644 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': 'a093a4ea-29ca-44d8-852b-2052ca5fffbb', 'body': {'forceDelete': {}}} Sep 23 04:50:24.985644 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:50:24.985644 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:24.985644 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:50:24.985644 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:50:24.985644 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:50:24.985644 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:50:24.985644 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 23 04:50:24.985644 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 23 04:50:24.985644 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a093a4ea-29ca-44d8-852b-2052ca5fffbb could not be found. Sep 23 04:50:24.985644 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:24.985644 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:50:24.985644 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:24.985644 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:24.985644 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:50:24.985644 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:50:24.985644 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:50:24.985644 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:50:24.985644 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:50:24.985644 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:50:24.985644 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Sep 23 04:50:24.985644 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 23 04:50:24.985644 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:50:24.985644 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:50:24.985644 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a093a4ea-29ca-44d8-852b-2052ca5fffbb could not be found. Sep 23 04:50:24.985644 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:24.985644 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:50:24.985644 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:24.985644 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:24.985644 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:50:24.985644 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:50:24.992182 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:50:24.992182 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:50:24.992182 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a093a4ea-29ca-44d8-852b-2052ca5fffbb could not be found. Sep 23 04:50:24.992182 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:24.992182 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-db988eaa-cb78-46da-8c67-2a8500dfce51 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Returning 404 to user: Instance a093a4ea-29ca-44d8-852b-2052ca5fffbb could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:50:24.992182 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-db988eaa-cb78-46da-8c67-2a8500dfce51 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "POST /compute/v2.1/servers/a093a4ea-29ca-44d8-852b-2052ca5fffbb/action" status: 404 len: 111 microversion: 2.1 time: 0.028140 Sep 23 04:50:24.992182 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2210/4308] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:50:24 2022] POST /compute/v2.1/servers/a093a4ea-29ca-44d8-852b-2052ca5fffbb/action => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:50:24.997063 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1bf1b9ef-5711-4c72-995b-bd8906d2d0a6 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:24.997796 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1bf1b9ef-5711-4c72-995b-bd8906d2d0a6 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:25.006449 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1bf1b9ef-5711-4c72-995b-bd8906d2d0a6 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:25.006940 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1bf1b9ef-5711-4c72-995b-bd8906d2d0a6 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:25.007398 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1bf1b9ef-5711-4c72-995b-bd8906d2d0a6 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:25.008113 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1bf1b9ef-5711-4c72-995b-bd8906d2d0a6 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:25.008584 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1bf1b9ef-5711-4c72-995b-bd8906d2d0a6 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:25.009017 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1bf1b9ef-5711-4c72-995b-bd8906d2d0a6 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:25.088089 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-3837743f-6a76-4ebc-bb68-37e2cd0623ab tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a52352ab894e8f88be0f9d1cef0b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e32df90da6b43b7b8a562dd95e6833b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:25.099769 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3837743f-6a76-4ebc-bb68-37e2cd0623ab tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] 10.222.0.33 "GET /compute/v2.1/servers/0ecb44a6-a97f-4177-aa9a-29a5b9b51a95" status: 200 len: 1812 microversion: 2.1 time: 0.235903 Sep 23 04:50:25.102806 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2099/4309] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:24 2022] GET /compute/v2.1/servers/0ecb44a6-a97f-4177-aa9a-29a5b9b51a95 => generated 1812 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:50:25.167915 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1bf1b9ef-5711-4c72-995b-bd8906d2d0a6 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:25.176873 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1bf1b9ef-5711-4c72-995b-bd8906d2d0a6 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1503 microversion: 2.1 time: 0.183439 Sep 23 04:50:25.178215 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2211/4310] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:24 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1503 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:25.201961 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-911df054-8598-45d7-af70-aa709cf10435 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:25.202997 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-911df054-8598-45d7-af70-aa709cf10435 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:25.210335 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-911df054-8598-45d7-af70-aa709cf10435 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:25.210924 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-911df054-8598-45d7-af70-aa709cf10435 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:25.211366 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-911df054-8598-45d7-af70-aa709cf10435 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:25.212082 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-911df054-8598-45d7-af70-aa709cf10435 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:25.212544 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-911df054-8598-45d7-af70-aa709cf10435 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:25.212975 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-911df054-8598-45d7-af70-aa709cf10435 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:25.497544 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-911df054-8598-45d7-af70-aa709cf10435 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:25.504446 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-911df054-8598-45d7-af70-aa709cf10435 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1503 microversion: 2.1 time: 0.306293 Sep 23 04:50:25.517917 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2100/4311] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:25 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1503 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:25.532331 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a998f47f-3255-41fc-a239-a2b9a74e36d0 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:50:25.538709 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a998f47f-3255-41fc-a239-a2b9a74e36d0 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: 257a6b9e-d483-4ed2-9c52-2731cec71cb2] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:25.561579 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-a998f47f-3255-41fc-a239-a2b9a74e36d0 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] HTTP exception thrown: Instance 257a6b9e-d483-4ed2-9c52-2731cec71cb2 could not be found. Sep 23 04:50:25.568425 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a998f47f-3255-41fc-a239-a2b9a74e36d0 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Request method failure captured: Sep 23 04:50:25.568425 n-d-846463-3 devstack@n-api.service[122699]: request: POST /compute/v2.1/servers/257a6b9e-d483-4ed2-9c52-2731cec71cb2/action HTTP/1.1 Sep 23 04:50:25.568425 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:50:25.568425 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:50:25.568425 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:50:25.568425 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 39 Sep 23 04:50:25.568425 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:50:25.568425 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:50:25.568425 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:50:25.568425 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:50:25.568425 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTrDoGx96bSja4ydTGD-VWXTOyHeLiBA9Lvr197ivKeXqtV3OksEUUEiEPXK85IMwWXM1vCTp1M9PaXnUkKbFev29d-fL5KKXR0MfyGa86SLKINg6u_gn5EQLUNZ8EVLCkU1WwJ7agpVlFY75EyJH0fBcxrNg1yvFbeC2alzdH4Tkmw Sep 23 04:50:25.568425 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:50:25.568425 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:50:25.568425 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:50:25.568425 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:50:25.568425 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:50:25.568425 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:50:25.568425 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 78dca47156ff4f19a8673b893c853978 Sep 23 04:50:25.568425 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:50:25.568425 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:50:25.568425 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:50:25.568425 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_78dca47156ff4f19a8673b893c853978", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/78dca47156ff4f19a8673b893c853978"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/78dca47156ff4f19a8673b893c853978"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/78dca47156ff4f19a8673b893c853978"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:50:25.568425 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:50:25.568425 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 78dca47156ff4f19a8673b893c853978 Sep 23 04:50:25.568425 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:50:25.568425 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ServersNegativeTestJSON-1102187211-project Sep 23 04:50:25.568425 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:50:25.568425 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:50:25.568425 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: c912fb9d1f5447d180a9e8568220526f Sep 23 04:50:25.568425 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ServersNegativeTestJSON-1102187211-project Sep 23 04:50:25.568425 n-d-846463-3 devstack@n-api.service[122699]: Sep 23 04:50:25.568425 n-d-846463-3 devstack@n-api.service[122699]: {"os-getConsoleOutput": {"length": 10}} Sep 23 04:50:25.568425 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:50:25.568425 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 257a6b9e-d483-4ed2-9c52-2731cec71cb2 could not be found. Sep 23 04:50:25.568425 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '257a6b9e-d483-4ed2-9c52-2731cec71cb2', 'body': {'os-getConsoleOutput': {'length': 10}}} Sep 23 04:50:25.568425 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:50:25.568425 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:25.568425 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:50:25.568425 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:50:25.568425 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:50:25.568425 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:50:25.568425 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 23 04:50:25.568425 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 23 04:50:25.568425 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 257a6b9e-d483-4ed2-9c52-2731cec71cb2 could not be found. Sep 23 04:50:25.568425 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:25.568425 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:50:25.568425 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:25.568425 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:25.568425 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:50:25.568425 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:50:25.568425 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:50:25.568425 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:50:25.568425 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:50:25.568425 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:50:25.568425 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:50:25.568425 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:50:25.568425 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Sep 23 04:50:25.568425 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 23 04:50:25.568425 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:50:25.568425 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:50:25.568425 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 257a6b9e-d483-4ed2-9c52-2731cec71cb2 could not be found. Sep 23 04:50:25.568425 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:25.568425 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:50:25.568425 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:25.568425 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:25.572901 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:50:25.572901 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:50:25.572901 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:50:25.572901 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:50:25.572901 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 257a6b9e-d483-4ed2-9c52-2731cec71cb2 could not be found. Sep 23 04:50:25.572901 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:25.574075 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0213dfaf-c66d-4ae0-af7f-9dbeb45145fc tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:25.574075 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-0213dfaf-c66d-4ae0-af7f-9dbeb45145fc tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 30d846a2-5966-4fae-9515-9d873d882e6b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:25.575083 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a998f47f-3255-41fc-a239-a2b9a74e36d0 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Returning 404 to user: Instance 257a6b9e-d483-4ed2-9c52-2731cec71cb2 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:50:25.577327 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a998f47f-3255-41fc-a239-a2b9a74e36d0 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "POST /compute/v2.1/servers/257a6b9e-d483-4ed2-9c52-2731cec71cb2/action" status: 404 len: 111 microversion: 2.1 time: 0.048413 Sep 23 04:50:25.577864 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0213dfaf-c66d-4ae0-af7f-9dbeb45145fc tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:25.578741 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2212/4312] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:50:25 2022] POST /compute/v2.1/servers/257a6b9e-d483-4ed2-9c52-2731cec71cb2/action => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:50:25.582512 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0213dfaf-c66d-4ae0-af7f-9dbeb45145fc tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:25.583153 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0213dfaf-c66d-4ae0-af7f-9dbeb45145fc tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:25.584264 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0213dfaf-c66d-4ae0-af7f-9dbeb45145fc tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:25.584834 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0213dfaf-c66d-4ae0-af7f-9dbeb45145fc tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:25.585344 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0213dfaf-c66d-4ae0-af7f-9dbeb45145fc tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:25.594443 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c6ddb5ac-7dfb-486a-bb15-b83658bf9e64 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:25.599274 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c6ddb5ac-7dfb-486a-bb15-b83658bf9e64 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:25.614878 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c6ddb5ac-7dfb-486a-bb15-b83658bf9e64 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:25.616892 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c6ddb5ac-7dfb-486a-bb15-b83658bf9e64 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:25.622407 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c6ddb5ac-7dfb-486a-bb15-b83658bf9e64 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:25.624743 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c6ddb5ac-7dfb-486a-bb15-b83658bf9e64 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:25.626562 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c6ddb5ac-7dfb-486a-bb15-b83658bf9e64 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:25.630501 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c6ddb5ac-7dfb-486a-bb15-b83658bf9e64 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:25.890808 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-0213dfaf-c66d-4ae0-af7f-9dbeb45145fc tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:25.904636 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c6ddb5ac-7dfb-486a-bb15-b83658bf9e64 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:25.913958 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c6ddb5ac-7dfb-486a-bb15-b83658bf9e64 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1503 microversion: 2.1 time: 0.329378 Sep 23 04:50:25.923867 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0213dfaf-c66d-4ae0-af7f-9dbeb45145fc tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/30d846a2-5966-4fae-9515-9d873d882e6b" status: 200 len: 1510 microversion: 2.1 time: 0.358381 Sep 23 04:50:25.925354 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2213/4313] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:25 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1503 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:25.934956 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2101/4314] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:25 2022] GET /compute/v2.1/servers/30d846a2-5966-4fae-9515-9d873d882e6b => generated 1510 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:50:25.960595 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3f6d5999-5d6f-4861-b271-3d8f01ecc4b7 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:25.961663 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3f6d5999-5d6f-4861-b271-3d8f01ecc4b7 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:25.974515 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3f6d5999-5d6f-4861-b271-3d8f01ecc4b7 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:25.975259 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3f6d5999-5d6f-4861-b271-3d8f01ecc4b7 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:25.976253 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3f6d5999-5d6f-4861-b271-3d8f01ecc4b7 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:25.978853 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3f6d5999-5d6f-4861-b271-3d8f01ecc4b7 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:25.980687 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3f6d5999-5d6f-4861-b271-3d8f01ecc4b7 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:25.985530 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3f6d5999-5d6f-4861-b271-3d8f01ecc4b7 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:26.125127 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a836971f-74ea-4a40-8588-0ba6994a6d77 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:26.125668 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a836971f-74ea-4a40-8588-0ba6994a6d77 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] [instance: 0ecb44a6-a97f-4177-aa9a-29a5b9b51a95] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:26.138925 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a836971f-74ea-4a40-8588-0ba6994a6d77 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:26.139448 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a836971f-74ea-4a40-8588-0ba6994a6d77 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:26.139899 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a836971f-74ea-4a40-8588-0ba6994a6d77 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:26.140633 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a836971f-74ea-4a40-8588-0ba6994a6d77 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:26.144090 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a836971f-74ea-4a40-8588-0ba6994a6d77 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:26.146688 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a836971f-74ea-4a40-8588-0ba6994a6d77 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:26.546717 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a836971f-74ea-4a40-8588-0ba6994a6d77 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a52352ab894e8f88be0f9d1cef0b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e32df90da6b43b7b8a562dd95e6833b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:26.561308 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a836971f-74ea-4a40-8588-0ba6994a6d77 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] 10.222.0.33 "GET /compute/v2.1/servers/0ecb44a6-a97f-4177-aa9a-29a5b9b51a95" status: 200 len: 1791 microversion: 2.1 time: 0.440781 Sep 23 04:50:26.562026 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2214/4315] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:26 2022] GET /compute/v2.1/servers/0ecb44a6-a97f-4177-aa9a-29a5b9b51a95 => generated 1791 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:50:26.567664 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-02479f05-7139-4119-af67-c2eeea4d5cc6 req-3198b66d-5e53-4bd0-964e-e7110373279b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ecb44a6-a97f-4177-aa9a-29a5b9b51a95", "name": "network-vif-deleted", "tag": "5e46b412-353a-44c0-b22a-05d9da788ef3"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:50:26.589523 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-02479f05-7139-4119-af67-c2eeea4d5cc6 req-3198b66d-5e53-4bd0-964e-e7110373279b service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:26.590563 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-02479f05-7139-4119-af67-c2eeea4d5cc6 req-3198b66d-5e53-4bd0-964e-e7110373279b service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:26.591205 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-02479f05-7139-4119-af67-c2eeea4d5cc6 req-3198b66d-5e53-4bd0-964e-e7110373279b service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:26.615343 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-02479f05-7139-4119-af67-c2eeea4d5cc6 req-3198b66d-5e53-4bd0-964e-e7110373279b service nova] Creating event network-vif-deleted:5e46b412-353a-44c0-b22a-05d9da788ef3 for instance 0ecb44a6-a97f-4177-aa9a-29a5b9b51a95 on n-h1-846463-3 Sep 23 04:50:26.621453 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-02479f05-7139-4119-af67-c2eeea4d5cc6 req-3198b66d-5e53-4bd0-964e-e7110373279b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057591 Sep 23 04:50:26.622362 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2215/4316] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:50:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:50:26.632733 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-3f6d5999-5d6f-4861-b271-3d8f01ecc4b7 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:26.649832 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3f6d5999-5d6f-4861-b271-3d8f01ecc4b7 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1503 microversion: 2.1 time: 0.693880 Sep 23 04:50:26.665644 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2102/4317] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:25 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1503 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:50:26.673538 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-67a16b86-a8a1-4a08-9b5b-9d3d3cce1e53 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:26.674277 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-67a16b86-a8a1-4a08-9b5b-9d3d3cce1e53 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: 10414b2d-cbec-4450-ac60-55c47c45ecab] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:26.680736 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-67a16b86-a8a1-4a08-9b5b-9d3d3cce1e53 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] HTTP exception thrown: Instance 10414b2d-cbec-4450-ac60-55c47c45ecab could not be found. Sep 23 04:50:26.682384 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-67a16b86-a8a1-4a08-9b5b-9d3d3cce1e53 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Request method failure captured: Sep 23 04:50:26.682384 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/10414b2d-cbec-4450-ac60-55c47c45ecab HTTP/1.1 Sep 23 04:50:26.682384 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:50:26.682384 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:50:26.682384 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:50:26.682384 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:50:26.682384 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:50:26.682384 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:50:26.682384 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:50:26.682384 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:50:26.682384 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTrDoGx96bSja4ydTGD-VWXTOyHeLiBA9Lvr197ivKeXqtV3OksEUUEiEPXK85IMwWXM1vCTp1M9PaXnUkKbFev29d-fL5KKXR0MfyGa86SLKINg6u_gn5EQLUNZ8EVLCkU1WwJ7agpVlFY75EyJH0fBcxrNg1yvFbeC2alzdH4Tkmw Sep 23 04:50:26.682384 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:50:26.682384 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:50:26.682384 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:50:26.682384 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:50:26.682384 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:50:26.682384 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:50:26.682384 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 78dca47156ff4f19a8673b893c853978 Sep 23 04:50:26.682384 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:50:26.682384 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:50:26.682384 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:50:26.682384 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_78dca47156ff4f19a8673b893c853978", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/78dca47156ff4f19a8673b893c853978"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/78dca47156ff4f19a8673b893c853978"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/78dca47156ff4f19a8673b893c853978"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:50:26.682384 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:50:26.682384 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 78dca47156ff4f19a8673b893c853978 Sep 23 04:50:26.682384 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:50:26.682384 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ServersNegativeTestJSON-1102187211-project Sep 23 04:50:26.682384 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:50:26.682384 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:50:26.682384 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: c912fb9d1f5447d180a9e8568220526f Sep 23 04:50:26.682384 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ServersNegativeTestJSON-1102187211-project Sep 23 04:50:26.682384 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:50:26.682384 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 10414b2d-cbec-4450-ac60-55c47c45ecab could not be found. Sep 23 04:50:26.682384 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '10414b2d-cbec-4450-ac60-55c47c45ecab'} Sep 23 04:50:26.682384 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:50:26.682384 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:26.682384 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:50:26.682384 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:50:26.682384 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:50:26.682384 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:50:26.682384 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 23 04:50:26.682384 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 23 04:50:26.682384 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10414b2d-cbec-4450-ac60-55c47c45ecab could not be found. Sep 23 04:50:26.682384 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:26.682384 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:50:26.682384 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:26.682384 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:26.682384 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:50:26.682384 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:50:26.682384 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:50:26.682384 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:50:26.682384 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:50:26.682384 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:50:26.682384 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:50:26.682384 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:50:26.682384 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:50:26.682384 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:50:26.682384 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:50:26.682384 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:50:26.682384 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10414b2d-cbec-4450-ac60-55c47c45ecab could not be found. Sep 23 04:50:26.682384 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:26.682384 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:50:26.682384 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:26.682384 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:26.682384 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:50:26.693621 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:50:26.693621 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:50:26.693621 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:50:26.693621 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10414b2d-cbec-4450-ac60-55c47c45ecab could not be found. Sep 23 04:50:26.693621 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:26.693621 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-67a16b86-a8a1-4a08-9b5b-9d3d3cce1e53 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Returning 404 to user: Instance 10414b2d-cbec-4450-ac60-55c47c45ecab could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:50:26.693621 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-67a16b86-a8a1-4a08-9b5b-9d3d3cce1e53 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/10414b2d-cbec-4450-ac60-55c47c45ecab" status: 404 len: 111 microversion: 2.1 time: 0.014739 Sep 23 04:50:26.693621 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2216/4318] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:26 2022] GET /compute/v2.1/servers/10414b2d-cbec-4450-ac60-55c47c45ecab => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:50:26.694109 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5285c334-820f-4ffa-8a80-a43c4b8a72a8 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:26.694109 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5285c334-820f-4ffa-8a80-a43c4b8a72a8 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:26.704952 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5285c334-820f-4ffa-8a80-a43c4b8a72a8 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:26.705792 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5285c334-820f-4ffa-8a80-a43c4b8a72a8 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:26.707322 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5285c334-820f-4ffa-8a80-a43c4b8a72a8 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:26.708444 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5285c334-820f-4ffa-8a80-a43c4b8a72a8 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:26.709361 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5285c334-820f-4ffa-8a80-a43c4b8a72a8 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:26.710057 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5285c334-820f-4ffa-8a80-a43c4b8a72a8 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:26.750326 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:50:26.970015 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a06f1e8f-2cc4-4682-a1d1-07648b9b2bce tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:26.970915 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a06f1e8f-2cc4-4682-a1d1-07648b9b2bce tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 30d846a2-5966-4fae-9515-9d873d882e6b] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:26.971158 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-5285c334-820f-4ffa-8a80-a43c4b8a72a8 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:26.979368 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a06f1e8f-2cc4-4682-a1d1-07648b9b2bce tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:26.980163 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a06f1e8f-2cc4-4682-a1d1-07648b9b2bce tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:26.980826 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a06f1e8f-2cc4-4682-a1d1-07648b9b2bce tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:26.981983 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a06f1e8f-2cc4-4682-a1d1-07648b9b2bce tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:26.982816 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a06f1e8f-2cc4-4682-a1d1-07648b9b2bce tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:26.984296 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a06f1e8f-2cc4-4682-a1d1-07648b9b2bce tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:26.988244 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5285c334-820f-4ffa-8a80-a43c4b8a72a8 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1503 microversion: 2.1 time: 0.299471 Sep 23 04:50:26.994932 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2103/4319] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:26 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1503 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:50:27.012168 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-32bc7532-4b33-441f-b41c-bd940f37182f tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:27.012784 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-32bc7532-4b33-441f-b41c-bd940f37182f tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:27.035762 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-32bc7532-4b33-441f-b41c-bd940f37182f tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:27.036269 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-32bc7532-4b33-441f-b41c-bd940f37182f tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:27.036713 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-32bc7532-4b33-441f-b41c-bd940f37182f tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:27.037452 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-32bc7532-4b33-441f-b41c-bd940f37182f tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:27.037935 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-32bc7532-4b33-441f-b41c-bd940f37182f tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:27.038362 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-32bc7532-4b33-441f-b41c-bd940f37182f tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:27.281509 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a06f1e8f-2cc4-4682-a1d1-07648b9b2bce tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:27.294616 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a06f1e8f-2cc4-4682-a1d1-07648b9b2bce tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/30d846a2-5966-4fae-9515-9d873d882e6b" status: 200 len: 1510 microversion: 2.1 time: 0.328300 Sep 23 04:50:27.311092 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2217/4320] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:26 2022] GET /compute/v2.1/servers/30d846a2-5966-4fae-9515-9d873d882e6b => generated 1510 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:50:27.354265 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-32bc7532-4b33-441f-b41c-bd940f37182f tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:27.382903 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-32bc7532-4b33-441f-b41c-bd940f37182f tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1503 microversion: 2.1 time: 0.374564 Sep 23 04:50:27.384246 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2104/4321] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:27 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1503 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:27.461663 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6b297782-7d07-433f-9d3f-de52739c0d9b tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-373753266", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "eaa0cbf4-9a92-44f9-ac8d-d8f60e6441c0"}]}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:50:27.492323 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6b297782-7d07-433f-9d3f-de52739c0d9b tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Request method failure captured: Sep 23 04:50:27.492323 n-d-846463-3 devstack@n-api.service[122699]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 23 04:50:27.492323 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:50:27.492323 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:50:27.492323 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:50:27.492323 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 237 Sep 23 04:50:27.492323 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:50:27.492323 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:50:27.492323 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:50:27.492323 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:50:27.492323 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTrDoGx96bSja4ydTGD-VWXTOyHeLiBA9Lvr197ivKeXqtV3OksEUUEiEPXK85IMwWXM1vCTp1M9PaXnUkKbFev29d-fL5KKXR0MfyGa86SLKINg6u_gn5EQLUNZ8EVLCkU1WwJ7agpVlFY75EyJH0fBcxrNg1yvFbeC2alzdH4Tkmw Sep 23 04:50:27.492323 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:50:27.492323 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:50:27.492323 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:50:27.492323 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:50:27.492323 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:50:27.492323 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:50:27.492323 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 78dca47156ff4f19a8673b893c853978 Sep 23 04:50:27.492323 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:50:27.492323 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:50:27.492323 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:50:27.492323 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_78dca47156ff4f19a8673b893c853978", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/78dca47156ff4f19a8673b893c853978"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/78dca47156ff4f19a8673b893c853978"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/78dca47156ff4f19a8673b893c853978"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:50:27.492323 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:50:27.492323 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 78dca47156ff4f19a8673b893c853978 Sep 23 04:50:27.492323 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:50:27.492323 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ServersNegativeTestJSON-1102187211-project Sep 23 04:50:27.492323 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:50:27.492323 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:50:27.492323 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: c912fb9d1f5447d180a9e8568220526f Sep 23 04:50:27.492323 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ServersNegativeTestJSON-1102187211-project Sep 23 04:50:27.492323 n-d-846463-3 devstack@n-api.service[122699]: Sep 23 04:50:27.492323 n-d-846463-3 devstack@n-api.service[122699]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-373753266", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "eaa0cbf4-9a92-44f9-ac8d-d8f60e6441c0"}]}} Sep 23 04:50:27.492323 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:50:27.492323 n-d-846463-3 devstack@n-api.service[122699]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Sep 23 04:50:27.492323 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-373753266', 'imageRef': 'b8dd79b9-f0b9-43a9-9605-17244137c0ee', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': 'eaa0cbf4-9a92-44f9-ac8d-d8f60e6441c0'}]}}} Sep 23 04:50:27.492323 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:50:27.492323 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:27.492323 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Sep 23 04:50:27.492323 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi result = func(instance) Sep 23 04:50:27.492323 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 253, in is_ipv4 Sep 23 04:50:27.492323 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Sep 23 04:50:27.492323 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Sep 23 04:50:27.492323 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Sep 23 04:50:27.492323 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Sep 23 04:50:27.492323 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Sep 23 04:50:27.492323 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Sep 23 04:50:27.492323 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:27.492323 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 23 04:50:27.492323 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:27.492323 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:27.492323 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 23 04:50:27.492323 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 23 04:50:27.492323 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 23 04:50:27.492323 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise error Sep 23 04:50:27.492323 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Sep 23 04:50:27.492323 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:27.492323 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Sep 23 04:50:27.492323 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Sep 23 04:50:27.492323 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:27.492323 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 23 04:50:27.492323 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Sep 23 04:50:27.492323 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:27.492323 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:50:27.492323 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:27.492323 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:27.496293 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:50:27.496293 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:50:27.496293 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:50:27.496293 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:50:27.496293 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:50:27.496293 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:50:27.496293 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:50:27.496293 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:50:27.496293 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 23 04:50:27.496293 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 23 04:50:27.496293 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 23 04:50:27.496293 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 23 04:50:27.496293 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 23 04:50:27.496293 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 23 04:50:27.496293 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Sep 23 04:50:27.496293 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:27.496293 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:50:27.496293 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:27.496293 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:27.496293 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:50:27.496293 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:50:27.496293 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 23 04:50:27.496293 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 23 04:50:27.496293 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Sep 23 04:50:27.496293 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:27.496293 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6b297782-7d07-433f-9d3f-de52739c0d9b tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:50:27.496293 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6b297782-7d07-433f-9d3f-de52739c0d9b tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.036546 Sep 23 04:50:27.496293 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2218/4322] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:50:27 2022] POST /compute/v2.1/servers => generated 139 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 23 04:50:27.504943 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-90eed088-1982-49a8-bef9-ffdff3fc1fa4 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:27.505569 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-90eed088-1982-49a8-bef9-ffdff3fc1fa4 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:27.514220 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-90eed088-1982-49a8-bef9-ffdff3fc1fa4 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:27.514730 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-90eed088-1982-49a8-bef9-ffdff3fc1fa4 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:27.515175 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-90eed088-1982-49a8-bef9-ffdff3fc1fa4 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:27.515906 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-90eed088-1982-49a8-bef9-ffdff3fc1fa4 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:27.516408 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-90eed088-1982-49a8-bef9-ffdff3fc1fa4 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:27.516793 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-90eed088-1982-49a8-bef9-ffdff3fc1fa4 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:27.589584 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8bdf5ff9-0415-46cc-94f4-61604e74777e tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:27.590883 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-8bdf5ff9-0415-46cc-94f4-61604e74777e tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] [instance: 0ecb44a6-a97f-4177-aa9a-29a5b9b51a95] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:27.600391 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8bdf5ff9-0415-46cc-94f4-61604e74777e tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:27.600992 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8bdf5ff9-0415-46cc-94f4-61604e74777e tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:27.601650 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8bdf5ff9-0415-46cc-94f4-61604e74777e tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:27.602887 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8bdf5ff9-0415-46cc-94f4-61604e74777e tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:27.603579 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8bdf5ff9-0415-46cc-94f4-61604e74777e tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:27.604389 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8bdf5ff9-0415-46cc-94f4-61604e74777e tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:27.836469 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-90eed088-1982-49a8-bef9-ffdff3fc1fa4 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:27.845394 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-90eed088-1982-49a8-bef9-ffdff3fc1fa4 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1503 microversion: 2.1 time: 0.345608 Sep 23 04:50:27.846308 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2105/4323] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:27 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1503 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:27.869948 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b6a2adc1-a347-4724-af52-6eb3777ac80e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:27.870814 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b6a2adc1-a347-4724-af52-6eb3777ac80e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:27.877137 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b6a2adc1-a347-4724-af52-6eb3777ac80e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:27.878478 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b6a2adc1-a347-4724-af52-6eb3777ac80e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:27.879631 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b6a2adc1-a347-4724-af52-6eb3777ac80e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:27.880574 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b6a2adc1-a347-4724-af52-6eb3777ac80e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:27.881856 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b6a2adc1-a347-4724-af52-6eb3777ac80e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:27.882328 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b6a2adc1-a347-4724-af52-6eb3777ac80e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:27.893053 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-8bdf5ff9-0415-46cc-94f4-61604e74777e tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a52352ab894e8f88be0f9d1cef0b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e32df90da6b43b7b8a562dd95e6833b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:27.906344 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-8bdf5ff9-0415-46cc-94f4-61604e74777e tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] 10.222.0.33 "GET /compute/v2.1/servers/0ecb44a6-a97f-4177-aa9a-29a5b9b51a95" status: 200 len: 1612 microversion: 2.1 time: 0.321156 Sep 23 04:50:27.906950 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2219/4324] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:27 2022] GET /compute/v2.1/servers/0ecb44a6-a97f-4177-aa9a-29a5b9b51a95 => generated 1612 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:28.079113 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b6a2adc1-a347-4724-af52-6eb3777ac80e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:28.089518 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b6a2adc1-a347-4724-af52-6eb3777ac80e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1503 microversion: 2.1 time: 0.224191 Sep 23 04:50:28.090154 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2106/4325] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:27 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1503 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:50:28.223905 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1f92538a-3792-4f85-bc9e-368ba9d4c77c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-767902134", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "eaa0cbf4-9a92-44f9-ac8d-d8f60e6441c0"}]}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:50:28.228643 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1f92538a-3792-4f85-bc9e-368ba9d4c77c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Request method failure captured: Sep 23 04:50:28.228643 n-d-846463-3 devstack@n-api.service[122699]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 23 04:50:28.228643 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:50:28.228643 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:50:28.228643 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:50:28.228643 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 234 Sep 23 04:50:28.228643 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:50:28.228643 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:50:28.228643 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:50:28.228643 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:50:28.228643 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTrDoGx96bSja4ydTGD-VWXTOyHeLiBA9Lvr197ivKeXqtV3OksEUUEiEPXK85IMwWXM1vCTp1M9PaXnUkKbFev29d-fL5KKXR0MfyGa86SLKINg6u_gn5EQLUNZ8EVLCkU1WwJ7agpVlFY75EyJH0fBcxrNg1yvFbeC2alzdH4Tkmw Sep 23 04:50:28.228643 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:50:28.228643 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:50:28.228643 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:50:28.228643 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:50:28.228643 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:50:28.228643 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:50:28.228643 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 78dca47156ff4f19a8673b893c853978 Sep 23 04:50:28.228643 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:50:28.228643 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:50:28.228643 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:50:28.228643 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_78dca47156ff4f19a8673b893c853978", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/78dca47156ff4f19a8673b893c853978"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/78dca47156ff4f19a8673b893c853978"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/78dca47156ff4f19a8673b893c853978"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:50:28.228643 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:50:28.228643 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 78dca47156ff4f19a8673b893c853978 Sep 23 04:50:28.228643 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:50:28.228643 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ServersNegativeTestJSON-1102187211-project Sep 23 04:50:28.228643 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:50:28.228643 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:50:28.228643 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: c912fb9d1f5447d180a9e8568220526f Sep 23 04:50:28.228643 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ServersNegativeTestJSON-1102187211-project Sep 23 04:50:28.228643 n-d-846463-3 devstack@n-api.service[122699]: Sep 23 04:50:28.228643 n-d-846463-3 devstack@n-api.service[122699]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-767902134", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "eaa0cbf4-9a92-44f9-ac8d-d8f60e6441c0"}]}} Sep 23 04:50:28.228643 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:50:28.228643 n-d-846463-3 devstack@n-api.service[122699]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Sep 23 04:50:28.228643 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-767902134', 'imageRef': 'b8dd79b9-f0b9-43a9-9605-17244137c0ee', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': 'eaa0cbf4-9a92-44f9-ac8d-d8f60e6441c0'}]}}} Sep 23 04:50:28.228643 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:50:28.228643 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:28.228643 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Sep 23 04:50:28.228643 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi result = func(instance) Sep 23 04:50:28.228643 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 260, in is_ipv6 Sep 23 04:50:28.228643 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Sep 23 04:50:28.228643 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Sep 23 04:50:28.228643 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Sep 23 04:50:28.228643 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Sep 23 04:50:28.228643 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Sep 23 04:50:28.228643 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Sep 23 04:50:28.228643 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:28.228643 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 23 04:50:28.228643 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:28.228643 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:28.228643 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 23 04:50:28.228643 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 23 04:50:28.228643 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 23 04:50:28.228643 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise error Sep 23 04:50:28.228643 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Sep 23 04:50:28.228643 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:28.228643 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Sep 23 04:50:28.228643 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Sep 23 04:50:28.228643 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:28.228643 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 23 04:50:28.228643 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi 'notvalid' Sep 23 04:50:28.228643 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:28.228643 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:50:28.228643 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:28.228643 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:28.233138 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:50:28.233138 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:50:28.233138 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:50:28.233138 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:50:28.233138 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:50:28.233138 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:50:28.233138 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:50:28.233138 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:50:28.233138 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 23 04:50:28.233138 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 23 04:50:28.233138 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 23 04:50:28.233138 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 23 04:50:28.233138 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 23 04:50:28.233138 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 23 04:50:28.233138 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Sep 23 04:50:28.233138 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:28.233138 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:50:28.233138 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:28.233138 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:28.233138 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:50:28.233138 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:50:28.233138 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 23 04:50:28.233138 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 23 04:50:28.233138 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Sep 23 04:50:28.233138 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:28.240691 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1f92538a-3792-4f85-bc9e-368ba9d4c77c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:50:28.241692 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1f92538a-3792-4f85-bc9e-368ba9d4c77c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.023216 Sep 23 04:50:28.244311 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2220/4326] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:50:28 2022] POST /compute/v2.1/servers => generated 133 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 04:50:28.261788 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9f9eb341-4925-4dd5-9f29-7a6b7ba8215e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:28.262470 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-9f9eb341-4925-4dd5-9f29-7a6b7ba8215e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:28.276985 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9f9eb341-4925-4dd5-9f29-7a6b7ba8215e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:28.278340 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9f9eb341-4925-4dd5-9f29-7a6b7ba8215e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:28.279691 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9f9eb341-4925-4dd5-9f29-7a6b7ba8215e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:28.281259 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9f9eb341-4925-4dd5-9f29-7a6b7ba8215e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:28.281724 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9f9eb341-4925-4dd5-9f29-7a6b7ba8215e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:28.282189 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9f9eb341-4925-4dd5-9f29-7a6b7ba8215e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:28.321335 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d2ccf106-2a77-4747-94af-895e48439954 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:28.321980 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d2ccf106-2a77-4747-94af-895e48439954 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 30d846a2-5966-4fae-9515-9d873d882e6b] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:28.338993 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d2ccf106-2a77-4747-94af-895e48439954 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:28.339725 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d2ccf106-2a77-4747-94af-895e48439954 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:28.340350 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d2ccf106-2a77-4747-94af-895e48439954 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:28.341267 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d2ccf106-2a77-4747-94af-895e48439954 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:28.341960 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d2ccf106-2a77-4747-94af-895e48439954 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:28.342547 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d2ccf106-2a77-4747-94af-895e48439954 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:28.576978 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-9f9eb341-4925-4dd5-9f29-7a6b7ba8215e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:28.586721 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9f9eb341-4925-4dd5-9f29-7a6b7ba8215e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1503 microversion: 2.1 time: 0.329558 Sep 23 04:50:28.587874 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2107/4327] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:28 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1503 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:28.606815 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d2ccf106-2a77-4747-94af-895e48439954 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:28.612799 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8272378d-fb8a-4761-a5ec-a9c673db7539 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:28.613519 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8272378d-fb8a-4761-a5ec-a9c673db7539 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:28.615660 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d2ccf106-2a77-4747-94af-895e48439954 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/30d846a2-5966-4fae-9515-9d873d882e6b" status: 200 len: 1510 microversion: 2.1 time: 0.298540 Sep 23 04:50:28.626569 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2221/4328] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:28 2022] GET /compute/v2.1/servers/30d846a2-5966-4fae-9515-9d873d882e6b => generated 1510 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:50:28.626782 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8272378d-fb8a-4761-a5ec-a9c673db7539 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:28.626782 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8272378d-fb8a-4761-a5ec-a9c673db7539 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:28.626782 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8272378d-fb8a-4761-a5ec-a9c673db7539 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:28.626782 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8272378d-fb8a-4761-a5ec-a9c673db7539 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:28.626782 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8272378d-fb8a-4761-a5ec-a9c673db7539 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:28.626782 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8272378d-fb8a-4761-a5ec-a9c673db7539 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:28.659437 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-38c1c8e0-b9a7-422e-b9df-07b0cca9488e req-41fcb5b0-199a-4f5a-821b-de6521cebfe0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ecb44a6-a97f-4177-aa9a-29a5b9b51a95", "name": "network-vif-deleted", "tag": "9c63c256-13d3-4da8-a111-86c1b541a17b"}, {"server_uuid": "0ecb44a6-a97f-4177-aa9a-29a5b9b51a95", "name": "network-vif-deleted", "tag": "225bcc05-7080-4633-a3f6-391f4277e3c0"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:50:28.671062 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-38c1c8e0-b9a7-422e-b9df-07b0cca9488e req-41fcb5b0-199a-4f5a-821b-de6521cebfe0 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:28.671680 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-38c1c8e0-b9a7-422e-b9df-07b0cca9488e req-41fcb5b0-199a-4f5a-821b-de6521cebfe0 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:28.672693 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-38c1c8e0-b9a7-422e-b9df-07b0cca9488e req-41fcb5b0-199a-4f5a-821b-de6521cebfe0 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:28.685856 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-38c1c8e0-b9a7-422e-b9df-07b0cca9488e req-41fcb5b0-199a-4f5a-821b-de6521cebfe0 service nova] Creating event network-vif-deleted:9c63c256-13d3-4da8-a111-86c1b541a17b for instance 0ecb44a6-a97f-4177-aa9a-29a5b9b51a95 on n-h1-846463-3 Sep 23 04:50:28.686670 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-38c1c8e0-b9a7-422e-b9df-07b0cca9488e req-41fcb5b0-199a-4f5a-821b-de6521cebfe0 service nova] Creating event network-vif-deleted:225bcc05-7080-4633-a3f6-391f4277e3c0 for instance 0ecb44a6-a97f-4177-aa9a-29a5b9b51a95 on n-h1-846463-3 Sep 23 04:50:28.691863 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-38c1c8e0-b9a7-422e-b9df-07b0cca9488e req-41fcb5b0-199a-4f5a-821b-de6521cebfe0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.037548 Sep 23 04:50:28.692987 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2222/4329] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:50:28 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:50:28.783186 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8272378d-fb8a-4761-a5ec-a9c673db7539 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:28.793767 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8272378d-fb8a-4761-a5ec-a9c673db7539 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1503 microversion: 2.1 time: 0.185777 Sep 23 04:50:28.794400 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2108/4330] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:28 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1503 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:28.821525 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a69bde56-d7b4-4154-8118-69afab3e5053 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:50:28.822881 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a69bde56-d7b4-4154-8118-69afab3e5053 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: eb27df59-9c95-47ad-b21d-d82e5cd7f0d6] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:28.829314 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-a69bde56-d7b4-4154-8118-69afab3e5053 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] HTTP exception thrown: Instance eb27df59-9c95-47ad-b21d-d82e5cd7f0d6 could not be found. Sep 23 04:50:28.832153 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a69bde56-d7b4-4154-8118-69afab3e5053 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Request method failure captured: Sep 23 04:50:28.832153 n-d-846463-3 devstack@n-api.service[122699]: request: POST /compute/v2.1/servers/eb27df59-9c95-47ad-b21d-d82e5cd7f0d6/action HTTP/1.1 Sep 23 04:50:28.832153 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:50:28.832153 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:50:28.832153 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:50:28.832153 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 13 Sep 23 04:50:28.832153 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:50:28.832153 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:50:28.832153 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:50:28.832153 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:50:28.832153 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTrDoGx96bSja4ydTGD-VWXTOyHeLiBA9Lvr197ivKeXqtV3OksEUUEiEPXK85IMwWXM1vCTp1M9PaXnUkKbFev29d-fL5KKXR0MfyGa86SLKINg6u_gn5EQLUNZ8EVLCkU1WwJ7agpVlFY75EyJH0fBcxrNg1yvFbeC2alzdH4Tkmw Sep 23 04:50:28.832153 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:50:28.832153 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:50:28.832153 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:50:28.832153 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:50:28.832153 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:50:28.832153 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:50:28.832153 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 78dca47156ff4f19a8673b893c853978 Sep 23 04:50:28.832153 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:50:28.832153 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:50:28.832153 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:50:28.832153 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_78dca47156ff4f19a8673b893c853978", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/78dca47156ff4f19a8673b893c853978"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/78dca47156ff4f19a8673b893c853978"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/78dca47156ff4f19a8673b893c853978"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:50:28.832153 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:50:28.832153 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 78dca47156ff4f19a8673b893c853978 Sep 23 04:50:28.832153 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:50:28.832153 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ServersNegativeTestJSON-1102187211-project Sep 23 04:50:28.832153 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:50:28.832153 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:50:28.832153 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: c912fb9d1f5447d180a9e8568220526f Sep 23 04:50:28.832153 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ServersNegativeTestJSON-1102187211-project Sep 23 04:50:28.832153 n-d-846463-3 devstack@n-api.service[122699]: Sep 23 04:50:28.832153 n-d-846463-3 devstack@n-api.service[122699]: {"pause": {}} Sep 23 04:50:28.832153 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:50:28.832153 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance eb27df59-9c95-47ad-b21d-d82e5cd7f0d6 could not be found. Sep 23 04:50:28.832153 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': 'eb27df59-9c95-47ad-b21d-d82e5cd7f0d6', 'body': {'pause': {}}} Sep 23 04:50:28.832153 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:50:28.832153 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:28.832153 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:50:28.832153 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:50:28.832153 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:50:28.832153 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:50:28.832153 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 23 04:50:28.832153 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 23 04:50:28.832153 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb27df59-9c95-47ad-b21d-d82e5cd7f0d6 could not be found. Sep 23 04:50:28.832153 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:28.832153 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:50:28.832153 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:28.832153 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:28.832153 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:50:28.832153 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:50:28.832153 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:50:28.832153 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:50:28.832153 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:50:28.832153 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:50:28.832153 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Sep 23 04:50:28.832153 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Sep 23 04:50:28.832153 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:50:28.832153 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:50:28.832153 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb27df59-9c95-47ad-b21d-d82e5cd7f0d6 could not be found. Sep 23 04:50:28.832153 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:28.832153 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:50:28.832153 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:28.832153 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:28.832153 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:50:28.832153 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:50:28.836356 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:50:28.836356 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:50:28.836356 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb27df59-9c95-47ad-b21d-d82e5cd7f0d6 could not be found. Sep 23 04:50:28.836356 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:28.836356 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a69bde56-d7b4-4154-8118-69afab3e5053 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Returning 404 to user: Instance eb27df59-9c95-47ad-b21d-d82e5cd7f0d6 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:50:28.836356 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a69bde56-d7b4-4154-8118-69afab3e5053 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "POST /compute/v2.1/servers/eb27df59-9c95-47ad-b21d-d82e5cd7f0d6/action" status: 404 len: 111 microversion: 2.1 time: 0.017597 Sep 23 04:50:28.836356 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2223/4331] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:50:28 2022] POST /compute/v2.1/servers/eb27df59-9c95-47ad-b21d-d82e5cd7f0d6/action => generated 111 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:50:28.843440 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8f53ef93-f6de-4993-b44f-1dcd1cf7d744 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:28.843440 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8f53ef93-f6de-4993-b44f-1dcd1cf7d744 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:28.852777 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8f53ef93-f6de-4993-b44f-1dcd1cf7d744 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:28.863591 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8f53ef93-f6de-4993-b44f-1dcd1cf7d744 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:28.864088 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8f53ef93-f6de-4993-b44f-1dcd1cf7d744 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:28.864859 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8f53ef93-f6de-4993-b44f-1dcd1cf7d744 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:28.865341 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8f53ef93-f6de-4993-b44f-1dcd1cf7d744 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:28.865775 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8f53ef93-f6de-4993-b44f-1dcd1cf7d744 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:28.930137 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f87d271e-f609-4026-a68c-5fe6c37174aa tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:28.931123 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f87d271e-f609-4026-a68c-5fe6c37174aa tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] [instance: 0ecb44a6-a97f-4177-aa9a-29a5b9b51a95] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:28.938047 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f87d271e-f609-4026-a68c-5fe6c37174aa tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:28.938538 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f87d271e-f609-4026-a68c-5fe6c37174aa tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:28.939177 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f87d271e-f609-4026-a68c-5fe6c37174aa tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:28.940025 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f87d271e-f609-4026-a68c-5fe6c37174aa tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:28.940682 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f87d271e-f609-4026-a68c-5fe6c37174aa tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:28.941151 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f87d271e-f609-4026-a68c-5fe6c37174aa tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:28.979013 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f87d271e-f609-4026-a68c-5fe6c37174aa tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:28.979606 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f87d271e-f609-4026-a68c-5fe6c37174aa tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:28.980231 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f87d271e-f609-4026-a68c-5fe6c37174aa tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:28.980803 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-f87d271e-f609-4026-a68c-5fe6c37174aa tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lazy-loading 'fault' on Instance uuid 0ecb44a6-a97f-4177-aa9a-29a5b9b51a95 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:50:29.040895 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f87d271e-f609-4026-a68c-5fe6c37174aa tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a52352ab894e8f88be0f9d1cef0b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e32df90da6b43b7b8a562dd95e6833b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:29.050372 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f87d271e-f609-4026-a68c-5fe6c37174aa tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] 10.222.0.33 "GET /compute/v2.1/servers/0ecb44a6-a97f-4177-aa9a-29a5b9b51a95" status: 200 len: 1303 microversion: 2.1 time: 0.124200 Sep 23 04:50:29.054701 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2224/4332] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:28 2022] GET /compute/v2.1/servers/0ecb44a6-a97f-4177-aa9a-29a5b9b51a95 => generated 1303 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:50:29.066677 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8f53ef93-f6de-4993-b44f-1dcd1cf7d744 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:29.086017 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8f53ef93-f6de-4993-b44f-1dcd1cf7d744 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1503 microversion: 2.1 time: 0.247291 Sep 23 04:50:29.089433 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2109/4333] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:28 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1503 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:29.115259 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-babf1fe9-a626-4eac-a667-ddbccf504d5a tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:29.115904 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-babf1fe9-a626-4eac-a667-ddbccf504d5a tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:29.127543 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-babf1fe9-a626-4eac-a667-ddbccf504d5a tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:29.128322 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-babf1fe9-a626-4eac-a667-ddbccf504d5a tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:29.128826 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-babf1fe9-a626-4eac-a667-ddbccf504d5a tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:29.129671 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-babf1fe9-a626-4eac-a667-ddbccf504d5a tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:29.130109 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-babf1fe9-a626-4eac-a667-ddbccf504d5a tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:29.135128 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-babf1fe9-a626-4eac-a667-ddbccf504d5a tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:29.283230 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-babf1fe9-a626-4eac-a667-ddbccf504d5a tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:29.289105 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-babf1fe9-a626-4eac-a667-ddbccf504d5a tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1503 microversion: 2.1 time: 0.180559 Sep 23 04:50:29.289691 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2225/4334] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:29 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1503 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:29.316117 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2af10f98-2e68-45b8-846e-0e185d04135d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:50:29.317008 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-2af10f98-2e68-45b8-846e-0e185d04135d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:29.324621 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2af10f98-2e68-45b8-846e-0e185d04135d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:29.325223 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2af10f98-2e68-45b8-846e-0e185d04135d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:29.325951 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2af10f98-2e68-45b8-846e-0e185d04135d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:29.327063 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2af10f98-2e68-45b8-846e-0e185d04135d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:29.327641 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2af10f98-2e68-45b8-846e-0e185d04135d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:29.328183 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2af10f98-2e68-45b8-846e-0e185d04135d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:29.530539 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2af10f98-2e68-45b8-846e-0e185d04135d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "POST /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf/action" status: 202 len: 0 microversion: 2.1 time: 0.222657 Sep 23 04:50:29.531354 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2110/4335] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:50:29 2022] POST /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf/action => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:50:29.543795 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9b9d3d23-361e-40cb-8a6f-5ad19b062a2b tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:29.548532 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-9b9d3d23-361e-40cb-8a6f-5ad19b062a2b tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:29.559848 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9b9d3d23-361e-40cb-8a6f-5ad19b062a2b tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:29.561635 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9b9d3d23-361e-40cb-8a6f-5ad19b062a2b tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:29.562570 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9b9d3d23-361e-40cb-8a6f-5ad19b062a2b tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:29.563370 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9b9d3d23-361e-40cb-8a6f-5ad19b062a2b tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:29.563907 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9b9d3d23-361e-40cb-8a6f-5ad19b062a2b tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:29.564414 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9b9d3d23-361e-40cb-8a6f-5ad19b062a2b tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:29.644523 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ce6ac127-3d12-444d-ae37-ef98b280e01d tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:29.646034 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-ce6ac127-3d12-444d-ae37-ef98b280e01d tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 30d846a2-5966-4fae-9515-9d873d882e6b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:29.654705 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ce6ac127-3d12-444d-ae37-ef98b280e01d tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:29.655100 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ce6ac127-3d12-444d-ae37-ef98b280e01d tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:29.655549 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ce6ac127-3d12-444d-ae37-ef98b280e01d tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:29.656272 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ce6ac127-3d12-444d-ae37-ef98b280e01d tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:29.656745 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ce6ac127-3d12-444d-ae37-ef98b280e01d tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:29.657178 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ce6ac127-3d12-444d-ae37-ef98b280e01d tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:29.756115 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-9b9d3d23-361e-40cb-8a6f-5ad19b062a2b tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:29.761920 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-9b9d3d23-361e-40cb-8a6f-5ad19b062a2b tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1508 microversion: 2.1 time: 0.226366 Sep 23 04:50:29.762683 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2226/4336] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:29 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1508 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:29.868060 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ce6ac127-3d12-444d-ae37-ef98b280e01d tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:29.876382 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ce6ac127-3d12-444d-ae37-ef98b280e01d tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/30d846a2-5966-4fae-9515-9d873d882e6b" status: 200 len: 1510 microversion: 2.1 time: 0.237698 Sep 23 04:50:29.877465 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2111/4337] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:29 2022] GET /compute/v2.1/servers/30d846a2-5966-4fae-9515-9d873d882e6b => generated 1510 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:50:30.077750 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e7dccb3b-a69a-4028-a801-ec63bca85f68 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:30.078144 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e7dccb3b-a69a-4028-a801-ec63bca85f68 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] [instance: 0ecb44a6-a97f-4177-aa9a-29a5b9b51a95] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:30.085274 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e7dccb3b-a69a-4028-a801-ec63bca85f68 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:30.085839 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e7dccb3b-a69a-4028-a801-ec63bca85f68 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:30.086386 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e7dccb3b-a69a-4028-a801-ec63bca85f68 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:30.087155 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e7dccb3b-a69a-4028-a801-ec63bca85f68 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:30.087698 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e7dccb3b-a69a-4028-a801-ec63bca85f68 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:30.088193 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e7dccb3b-a69a-4028-a801-ec63bca85f68 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:30.105571 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-e7dccb3b-a69a-4028-a801-ec63bca85f68 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] HTTP exception thrown: Instance 0ecb44a6-a97f-4177-aa9a-29a5b9b51a95 could not be found. Sep 23 04:50:30.107188 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e7dccb3b-a69a-4028-a801-ec63bca85f68 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Request method failure captured: Sep 23 04:50:30.107188 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/0ecb44a6-a97f-4177-aa9a-29a5b9b51a95 HTTP/1.1 Sep 23 04:50:30.107188 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:50:30.107188 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:50:30.107188 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:50:30.107188 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:50:30.107188 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:50:30.107188 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:50:30.107188 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:50:30.107188 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:50:30.107188 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTrhBVxvuFyCDQeoDVV1FpKtxqJtmotmG4T0Yln9ScS8W2uYPe6yTij0480Xjn1vSTCjEWigM4pCD4NIgLoQMZOXSdRfx-nkEFunqkwXAfzSNcWjOB2pO0PN0gQD6RxsFCb71saS9mddEq6BGw9UXsqEQ1UXDELMEZB2wY46QEp0uQE Sep 23 04:50:30.107188 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:50:30.107188 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:50:30.107188 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:50:30.107188 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:50:30.107188 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:50:30.107188 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:50:30.107188 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 2e32df90da6b43b7b8a562dd95e6833b Sep 23 04:50:30.107188 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ServersTestMultiNic-972382453 Sep 23 04:50:30.107188 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:50:30.107188 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:50:30.107188 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2e32df90da6b43b7b8a562dd95e6833b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2e32df90da6b43b7b8a562dd95e6833b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2e32df90da6b43b7b8a562dd95e6833b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2e32df90da6b43b7b8a562dd95e6833b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:50:30.107188 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ServersTestMultiNic-972382453 Sep 23 04:50:30.107188 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 2e32df90da6b43b7b8a562dd95e6833b Sep 23 04:50:30.107188 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ServersTestMultiNic-972382453 Sep 23 04:50:30.107188 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ServersTestMultiNic-972382453-project Sep 23 04:50:30.107188 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:50:30.107188 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:50:30.107188 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 91a52352ab894e8f88be0f9d1cef0b14 Sep 23 04:50:30.107188 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ServersTestMultiNic-972382453-project Sep 23 04:50:30.107188 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:50:30.107188 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 0ecb44a6-a97f-4177-aa9a-29a5b9b51a95 could not be found. Sep 23 04:50:30.107188 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '0ecb44a6-a97f-4177-aa9a-29a5b9b51a95'} Sep 23 04:50:30.107188 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:50:30.107188 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:30.107188 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:50:30.107188 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:50:30.107188 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:50:30.107188 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:50:30.107188 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:50:30.107188 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:50:30.107188 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:50:30.107188 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:50:30.107188 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ecb44a6-a97f-4177-aa9a-29a5b9b51a95 could not be found. Sep 23 04:50:30.107188 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:30.107188 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:50:30.107188 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:30.107188 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:30.107188 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:50:30.107188 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:50:30.107188 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:50:30.107188 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:50:30.107188 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:50:30.107188 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:50:30.107188 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:50:30.107188 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:50:30.107188 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:50:30.107188 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:50:30.107188 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:50:30.107188 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:50:30.107188 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ecb44a6-a97f-4177-aa9a-29a5b9b51a95 could not be found. Sep 23 04:50:30.107188 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:30.107188 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:50:30.107188 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:30.111405 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:30.111405 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:50:30.111405 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:50:30.111405 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:50:30.111405 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:50:30.111405 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ecb44a6-a97f-4177-aa9a-29a5b9b51a95 could not be found. Sep 23 04:50:30.111405 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:30.111405 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e7dccb3b-a69a-4028-a801-ec63bca85f68 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Returning 404 to user: Instance 0ecb44a6-a97f-4177-aa9a-29a5b9b51a95 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:50:30.111405 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e7dccb3b-a69a-4028-a801-ec63bca85f68 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] 10.222.0.33 "GET /compute/v2.1/servers/0ecb44a6-a97f-4177-aa9a-29a5b9b51a95" status: 404 len: 111 microversion: 2.1 time: 0.035585 Sep 23 04:50:30.111405 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2227/4338] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:30 2022] GET /compute/v2.1/servers/0ecb44a6-a97f-4177-aa9a-29a5b9b51a95 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:50:30.791165 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-63d0937b-50d3-4f17-9e4b-0ce365dec0db tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:30.791797 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-63d0937b-50d3-4f17-9e4b-0ce365dec0db tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:30.805671 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-63d0937b-50d3-4f17-9e4b-0ce365dec0db tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:30.806393 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-63d0937b-50d3-4f17-9e4b-0ce365dec0db tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:30.806913 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-63d0937b-50d3-4f17-9e4b-0ce365dec0db tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:30.808186 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-63d0937b-50d3-4f17-9e4b-0ce365dec0db tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:30.808726 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-63d0937b-50d3-4f17-9e4b-0ce365dec0db tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:30.809271 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-63d0937b-50d3-4f17-9e4b-0ce365dec0db tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:30.926901 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f8d7c7e0-bc44-4380-94e9-cd015b8036e1 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:30.926901 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f8d7c7e0-bc44-4380-94e9-cd015b8036e1 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 30d846a2-5966-4fae-9515-9d873d882e6b] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:30.926901 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f8d7c7e0-bc44-4380-94e9-cd015b8036e1 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:30.926901 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f8d7c7e0-bc44-4380-94e9-cd015b8036e1 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:30.926901 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f8d7c7e0-bc44-4380-94e9-cd015b8036e1 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:30.926901 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f8d7c7e0-bc44-4380-94e9-cd015b8036e1 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:30.926901 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f8d7c7e0-bc44-4380-94e9-cd015b8036e1 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:30.926901 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f8d7c7e0-bc44-4380-94e9-cd015b8036e1 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:31.256265 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-63d0937b-50d3-4f17-9e4b-0ce365dec0db tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:31.256265 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-63d0937b-50d3-4f17-9e4b-0ce365dec0db tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1488 microversion: 2.1 time: 0.410396 Sep 23 04:50:31.256265 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2112/4339] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:30 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1488 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:31.257084 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f8d7c7e0-bc44-4380-94e9-cd015b8036e1 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:31.257084 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:50:31.257084 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f8d7c7e0-bc44-4380-94e9-cd015b8036e1 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/30d846a2-5966-4fae-9515-9d873d882e6b" status: 200 len: 1510 microversion: 2.1 time: 0.329224 Sep 23 04:50:31.257084 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2228/4340] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:30 2022] GET /compute/v2.1/servers/30d846a2-5966-4fae-9515-9d873d882e6b => generated 1510 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:50:31.263467 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5dde5565-233d-4e10-b4b4-ac54c485e152 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:50:31.264026 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5dde5565-233d-4e10-b4b4-ac54c485e152 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:31.271079 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5dde5565-233d-4e10-b4b4-ac54c485e152 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:31.271666 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5dde5565-233d-4e10-b4b4-ac54c485e152 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:31.272181 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5dde5565-233d-4e10-b4b4-ac54c485e152 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:31.272900 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5dde5565-233d-4e10-b4b4-ac54c485e152 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:31.273537 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5dde5565-233d-4e10-b4b4-ac54c485e152 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:31.274025 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5dde5565-233d-4e10-b4b4-ac54c485e152 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:31.303382 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-5dde5565-233d-4e10-b4b4-ac54c485e152 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] HTTP exception thrown: Cannot 'pause' instance a9f2ff08-c66d-4991-9bae-d523a3adb8bf while it is in vm_state paused Sep 23 04:50:31.305652 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5dde5565-233d-4e10-b4b4-ac54c485e152 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Request method failure captured: Sep 23 04:50:31.305652 n-d-846463-3 devstack@n-api.service[122698]: request: POST /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf/action HTTP/1.1 Sep 23 04:50:31.305652 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:50:31.305652 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:50:31.305652 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:50:31.305652 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 13 Sep 23 04:50:31.305652 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:50:31.305652 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:50:31.305652 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:50:31.305652 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:50:31.305652 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTrDoGx96bSja4ydTGD-VWXTOyHeLiBA9Lvr197ivKeXqtV3OksEUUEiEPXK85IMwWXM1vCTp1M9PaXnUkKbFev29d-fL5KKXR0MfyGa86SLKINg6u_gn5EQLUNZ8EVLCkU1WwJ7agpVlFY75EyJH0fBcxrNg1yvFbeC2alzdH4Tkmw Sep 23 04:50:31.305652 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:50:31.305652 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:50:31.305652 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:50:31.305652 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:50:31.305652 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:50:31.305652 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:50:31.305652 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 78dca47156ff4f19a8673b893c853978 Sep 23 04:50:31.305652 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:50:31.305652 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:50:31.305652 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:50:31.305652 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_78dca47156ff4f19a8673b893c853978", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/78dca47156ff4f19a8673b893c853978"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/78dca47156ff4f19a8673b893c853978"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/78dca47156ff4f19a8673b893c853978"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:50:31.305652 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:50:31.305652 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 78dca47156ff4f19a8673b893c853978 Sep 23 04:50:31.305652 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:50:31.305652 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ServersNegativeTestJSON-1102187211-project Sep 23 04:50:31.305652 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:50:31.305652 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:50:31.305652 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: c912fb9d1f5447d180a9e8568220526f Sep 23 04:50:31.305652 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ServersNegativeTestJSON-1102187211-project Sep 23 04:50:31.305652 n-d-846463-3 devstack@n-api.service[122698]: Sep 23 04:50:31.305652 n-d-846463-3 devstack@n-api.service[122698]: {"pause": {}} Sep 23 04:50:31.305652 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:50:31.305652 n-d-846463-3 devstack@n-api.service[122698]: exception: Cannot 'pause' instance a9f2ff08-c66d-4991-9bae-d523a3adb8bf while it is in vm_state paused Sep 23 04:50:31.305652 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': 'a9f2ff08-c66d-4991-9bae-d523a3adb8bf', 'body': {'pause': {}}} Sep 23 04:50:31.305652 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:50:31.305652 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:31.305652 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Sep 23 04:50:31.305652 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Sep 23 04:50:31.305652 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 23 04:50:31.305652 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 23 04:50:31.305652 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 23 04:50:31.305652 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 23 04:50:31.305652 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a9f2ff08-c66d-4991-9bae-d523a3adb8bf in vm_state paused. Cannot pause while the instance is in this state. Sep 23 04:50:31.305652 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:50:31.305652 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:50:31.305652 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:50:31.305652 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:31.305652 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:50:31.305652 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:50:31.305652 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:50:31.305652 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:50:31.305652 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:50:31.305652 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:50:31.305652 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Sep 23 04:50:31.305652 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 23 04:50:31.305652 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 23 04:50:31.305652 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 23 04:50:31.305652 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance a9f2ff08-c66d-4991-9bae-d523a3adb8bf while it is in vm_state paused Sep 23 04:50:31.305652 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:50:31.305652 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:50:31.305652 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:50:31.305652 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:31.305652 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:50:31.311231 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:50:31.311231 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:50:31.311231 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:50:31.311231 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance a9f2ff08-c66d-4991-9bae-d523a3adb8bf while it is in vm_state paused Sep 23 04:50:31.311231 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:50:31.311231 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5dde5565-233d-4e10-b4b4-ac54c485e152 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Returning 409 to user: Cannot 'pause' instance a9f2ff08-c66d-4991-9bae-d523a3adb8bf while it is in vm_state paused {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:50:31.311231 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5dde5565-233d-4e10-b4b4-ac54c485e152 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "POST /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf/action" status: 409 len: 143 microversion: 2.1 time: 0.048980 Sep 23 04:50:31.311231 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2113/4341] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:50:31 2022] POST /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf/action => generated 143 bytes in 51 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 23 04:50:31.319543 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ba4fdd55-3e9e-4719-9cab-1117400f027b tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:50:31.352515 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ba4fdd55-3e9e-4719-9cab-1117400f027b tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:31.352515 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ba4fdd55-3e9e-4719-9cab-1117400f027b tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:31.352515 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ba4fdd55-3e9e-4719-9cab-1117400f027b tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:31.352515 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ba4fdd55-3e9e-4719-9cab-1117400f027b tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:31.352515 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ba4fdd55-3e9e-4719-9cab-1117400f027b tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:31.352515 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ba4fdd55-3e9e-4719-9cab-1117400f027b tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:31.352515 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ba4fdd55-3e9e-4719-9cab-1117400f027b tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:32.265960 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-35e430de-8de2-4f22-b1ec-ee1e186ab380 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:32.265960 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-35e430de-8de2-4f22-b1ec-ee1e186ab380 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 30d846a2-5966-4fae-9515-9d873d882e6b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:32.274479 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-35e430de-8de2-4f22-b1ec-ee1e186ab380 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:32.275257 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-35e430de-8de2-4f22-b1ec-ee1e186ab380 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:32.275714 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-35e430de-8de2-4f22-b1ec-ee1e186ab380 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:32.276443 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-35e430de-8de2-4f22-b1ec-ee1e186ab380 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:32.277083 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-35e430de-8de2-4f22-b1ec-ee1e186ab380 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:32.277529 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-35e430de-8de2-4f22-b1ec-ee1e186ab380 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:32.412149 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ba4fdd55-3e9e-4719-9cab-1117400f027b tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "POST /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf/action" status: 202 len: 0 microversion: 2.1 time: 1.097038 Sep 23 04:50:32.416307 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2229/4342] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:50:31 2022] POST /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf/action => generated 0 bytes in 1102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 23 04:50:32.433642 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3cc9afc4-e349-4a42-b67e-e6f7fd7afdfb tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:32.434667 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-3cc9afc4-e349-4a42-b67e-e6f7fd7afdfb tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:32.470714 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3cc9afc4-e349-4a42-b67e-e6f7fd7afdfb tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:32.475778 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3cc9afc4-e349-4a42-b67e-e6f7fd7afdfb tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:32.478930 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3cc9afc4-e349-4a42-b67e-e6f7fd7afdfb tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:32.479885 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3cc9afc4-e349-4a42-b67e-e6f7fd7afdfb tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:32.480789 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3cc9afc4-e349-4a42-b67e-e6f7fd7afdfb tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:32.481397 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3cc9afc4-e349-4a42-b67e-e6f7fd7afdfb tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:32.622661 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-35e430de-8de2-4f22-b1ec-ee1e186ab380 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:32.639614 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-35e430de-8de2-4f22-b1ec-ee1e186ab380 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/30d846a2-5966-4fae-9515-9d873d882e6b" status: 200 len: 1510 microversion: 2.1 time: 0.378574 Sep 23 04:50:32.642123 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2114/4343] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:32 2022] GET /compute/v2.1/servers/30d846a2-5966-4fae-9515-9d873d882e6b => generated 1510 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:50:32.766211 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-3cc9afc4-e349-4a42-b67e-e6f7fd7afdfb tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:32.781712 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3cc9afc4-e349-4a42-b67e-e6f7fd7afdfb tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1495 microversion: 2.1 time: 0.357775 Sep 23 04:50:32.781712 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2230/4344] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:32 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1495 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:33.666593 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5a561abf-be5e-4787-8a9d-8ed99fa3c0d9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:33.667914 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5a561abf-be5e-4787-8a9d-8ed99fa3c0d9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 30d846a2-5966-4fae-9515-9d873d882e6b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:33.676562 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5a561abf-be5e-4787-8a9d-8ed99fa3c0d9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:33.677288 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5a561abf-be5e-4787-8a9d-8ed99fa3c0d9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:33.677949 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5a561abf-be5e-4787-8a9d-8ed99fa3c0d9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:33.678876 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5a561abf-be5e-4787-8a9d-8ed99fa3c0d9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:33.679751 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5a561abf-be5e-4787-8a9d-8ed99fa3c0d9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:33.680497 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5a561abf-be5e-4787-8a9d-8ed99fa3c0d9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:33.801395 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b70d2f90-8109-4dc9-99d5-c3c5ea065c75 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:33.802036 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b70d2f90-8109-4dc9-99d5-c3c5ea065c75 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:33.811634 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b70d2f90-8109-4dc9-99d5-c3c5ea065c75 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:33.812147 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b70d2f90-8109-4dc9-99d5-c3c5ea065c75 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:33.813452 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b70d2f90-8109-4dc9-99d5-c3c5ea065c75 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:33.814223 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b70d2f90-8109-4dc9-99d5-c3c5ea065c75 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:33.814691 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b70d2f90-8109-4dc9-99d5-c3c5ea065c75 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:33.819568 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b70d2f90-8109-4dc9-99d5-c3c5ea065c75 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:34.211331 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b70d2f90-8109-4dc9-99d5-c3c5ea065c75 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:34.212981 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-5a561abf-be5e-4787-8a9d-8ed99fa3c0d9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:34.220105 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b70d2f90-8109-4dc9-99d5-c3c5ea065c75 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1503 microversion: 2.1 time: 0.422466 Sep 23 04:50:34.220622 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2231/4345] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:33 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1503 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:50:34.234160 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5a561abf-be5e-4787-8a9d-8ed99fa3c0d9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/30d846a2-5966-4fae-9515-9d873d882e6b" status: 200 len: 1510 microversion: 2.1 time: 0.559207 Sep 23 04:50:34.234160 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2115/4346] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:33 2022] GET /compute/v2.1/servers/30d846a2-5966-4fae-9515-9d873d882e6b => generated 1510 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:34.236279 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9b8295c0-2dc5-4e63-b51e-99cbc40faa9e tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:34.237561 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-9b8295c0-2dc5-4e63-b51e-99cbc40faa9e tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: fe7dee09-8351-4d41-8c44-8d35a966cce9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:34.244287 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9b8295c0-2dc5-4e63-b51e-99cbc40faa9e tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:34.244883 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9b8295c0-2dc5-4e63-b51e-99cbc40faa9e tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:34.245994 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9b8295c0-2dc5-4e63-b51e-99cbc40faa9e tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:34.246233 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9b8295c0-2dc5-4e63-b51e-99cbc40faa9e tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:34.246843 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9b8295c0-2dc5-4e63-b51e-99cbc40faa9e tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:34.249147 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9b8295c0-2dc5-4e63-b51e-99cbc40faa9e tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:34.256930 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-dd02f8f9-c24a-4ce1-952b-87f73d51b2eb tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:34.257545 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-dd02f8f9-c24a-4ce1-952b-87f73d51b2eb tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:34.265183 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dd02f8f9-c24a-4ce1-952b-87f73d51b2eb tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:34.265677 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dd02f8f9-c24a-4ce1-952b-87f73d51b2eb tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:34.266224 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dd02f8f9-c24a-4ce1-952b-87f73d51b2eb tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:34.266936 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dd02f8f9-c24a-4ce1-952b-87f73d51b2eb tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:34.267571 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dd02f8f9-c24a-4ce1-952b-87f73d51b2eb tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:34.268199 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dd02f8f9-c24a-4ce1-952b-87f73d51b2eb tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:34.330302 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9b8295c0-2dc5-4e63-b51e-99cbc40faa9e tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9/os-volume_attachments/d3597f6d-271b-4aaf-bd1b-434410669ce5" status: 200 len: 194 microversion: 2.20 time: 0.102972 Sep 23 04:50:34.341006 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2116/4347] 10.222.0.33 () {60 vars in 1454 bytes} [Fri Sep 23 04:50:34 2022] GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9/os-volume_attachments/d3597f6d-271b-4aaf-bd1b-434410669ce5 => generated 194 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 04:50:34.436304 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d80e9b62-06a2-45e0-9bb2-45ad1b689dc9 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:34.436987 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d80e9b62-06a2-45e0-9bb2-45ad1b689dc9 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: fe7dee09-8351-4d41-8c44-8d35a966cce9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:34.445334 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d80e9b62-06a2-45e0-9bb2-45ad1b689dc9 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:34.446064 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d80e9b62-06a2-45e0-9bb2-45ad1b689dc9 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:34.446672 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d80e9b62-06a2-45e0-9bb2-45ad1b689dc9 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:34.447536 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d80e9b62-06a2-45e0-9bb2-45ad1b689dc9 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:34.448894 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d80e9b62-06a2-45e0-9bb2-45ad1b689dc9 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:34.449495 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d80e9b62-06a2-45e0-9bb2-45ad1b689dc9 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:34.584091 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-dd02f8f9-c24a-4ce1-952b-87f73d51b2eb tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:34.598763 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-dd02f8f9-c24a-4ce1-952b-87f73d51b2eb tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1503 microversion: 2.1 time: 0.346071 Sep 23 04:50:34.602284 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2232/4348] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:34 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1503 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:50:34.628067 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6ffed044-c97c-46bb-b901-3743c5a38efd tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:50:34.630588 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-d80e9b62-06a2-45e0-9bb2-45ad1b689dc9 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lazy-loading 'services' on Instance uuid fe7dee09-8351-4d41-8c44-8d35a966cce9 {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:50:34.631312 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-6ffed044-c97c-46bb-b901-3743c5a38efd tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: 9d5576c0-2aa8-4ca0-aed6-22c1f0700755] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:34.640615 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6ffed044-c97c-46bb-b901-3743c5a38efd tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:34.641401 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6ffed044-c97c-46bb-b901-3743c5a38efd tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:34.642067 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6ffed044-c97c-46bb-b901-3743c5a38efd tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:34.642995 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6ffed044-c97c-46bb-b901-3743c5a38efd tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:34.644262 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6ffed044-c97c-46bb-b901-3743c5a38efd tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:34.644997 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6ffed044-c97c-46bb-b901-3743c5a38efd tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:34.663867 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-6ffed044-c97c-46bb-b901-3743c5a38efd tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] HTTP exception thrown: Instance 9d5576c0-2aa8-4ca0-aed6-22c1f0700755 could not be found. Sep 23 04:50:34.666251 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6ffed044-c97c-46bb-b901-3743c5a38efd tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Request method failure captured: Sep 23 04:50:34.666251 n-d-846463-3 devstack@n-api.service[122699]: request: POST /compute/v2.1/servers/9d5576c0-2aa8-4ca0-aed6-22c1f0700755/action HTTP/1.1 Sep 23 04:50:34.666251 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:50:34.666251 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:50:34.666251 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:50:34.666251 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 28 Sep 23 04:50:34.666251 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:50:34.666251 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:50:34.666251 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:50:34.666251 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:50:34.666251 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTrDoGx96bSja4ydTGD-VWXTOyHeLiBA9Lvr197ivKeXqtV3OksEUUEiEPXK85IMwWXM1vCTp1M9PaXnUkKbFev29d-fL5KKXR0MfyGa86SLKINg6u_gn5EQLUNZ8EVLCkU1WwJ7agpVlFY75EyJH0fBcxrNg1yvFbeC2alzdH4Tkmw Sep 23 04:50:34.666251 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:50:34.666251 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:50:34.666251 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:50:34.666251 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:50:34.666251 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:50:34.666251 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:50:34.666251 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 78dca47156ff4f19a8673b893c853978 Sep 23 04:50:34.666251 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:50:34.666251 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:50:34.666251 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:50:34.666251 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_78dca47156ff4f19a8673b893c853978", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/78dca47156ff4f19a8673b893c853978"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/78dca47156ff4f19a8673b893c853978"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/78dca47156ff4f19a8673b893c853978"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:50:34.666251 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:50:34.666251 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 78dca47156ff4f19a8673b893c853978 Sep 23 04:50:34.666251 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:50:34.666251 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ServersNegativeTestJSON-1102187211-project Sep 23 04:50:34.666251 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:50:34.666251 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:50:34.666251 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: c912fb9d1f5447d180a9e8568220526f Sep 23 04:50:34.666251 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ServersNegativeTestJSON-1102187211-project Sep 23 04:50:34.666251 n-d-846463-3 devstack@n-api.service[122699]: Sep 23 04:50:34.666251 n-d-846463-3 devstack@n-api.service[122699]: {"reboot": {"type": "SOFT"}} Sep 23 04:50:34.666251 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:50:34.666251 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 9d5576c0-2aa8-4ca0-aed6-22c1f0700755 could not be found. Sep 23 04:50:34.666251 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '9d5576c0-2aa8-4ca0-aed6-22c1f0700755', 'body': {'reboot': {'type': 'SOFT'}}} Sep 23 04:50:34.666251 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:50:34.666251 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:34.666251 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:50:34.666251 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:50:34.666251 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:50:34.666251 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:50:34.666251 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:50:34.666251 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:50:34.666251 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:50:34.666251 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:50:34.666251 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d5576c0-2aa8-4ca0-aed6-22c1f0700755 could not be found. Sep 23 04:50:34.666251 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:34.666251 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:50:34.666251 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:34.666251 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:34.666251 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:50:34.666251 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:50:34.666251 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:50:34.666251 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:50:34.666251 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:50:34.666251 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:50:34.666251 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:50:34.666251 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:50:34.666251 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Sep 23 04:50:34.666251 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 23 04:50:34.666251 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:50:34.666251 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:50:34.666251 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:50:34.666251 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:50:34.670715 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d5576c0-2aa8-4ca0-aed6-22c1f0700755 could not be found. Sep 23 04:50:34.670715 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:34.670715 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:50:34.670715 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:34.670715 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:34.670715 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:50:34.670715 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:50:34.670715 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:50:34.670715 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:50:34.670715 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d5576c0-2aa8-4ca0-aed6-22c1f0700755 could not be found. Sep 23 04:50:34.670715 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:34.672871 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6ffed044-c97c-46bb-b901-3743c5a38efd tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Returning 404 to user: Instance 9d5576c0-2aa8-4ca0-aed6-22c1f0700755 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:50:34.673985 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6ffed044-c97c-46bb-b901-3743c5a38efd tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "POST /compute/v2.1/servers/9d5576c0-2aa8-4ca0-aed6-22c1f0700755/action" status: 404 len: 111 microversion: 2.1 time: 0.052002 Sep 23 04:50:34.678407 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2233/4349] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:50:34 2022] POST /compute/v2.1/servers/9d5576c0-2aa8-4ca0-aed6-22c1f0700755/action => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 04:50:34.684395 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4fb3f84f-44c5-41d4-9d4d-893c816ca060 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:34.690690 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4fb3f84f-44c5-41d4-9d4d-893c816ca060 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:34.694205 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4fb3f84f-44c5-41d4-9d4d-893c816ca060 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:34.695043 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4fb3f84f-44c5-41d4-9d4d-893c816ca060 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:34.695700 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4fb3f84f-44c5-41d4-9d4d-893c816ca060 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:34.696630 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4fb3f84f-44c5-41d4-9d4d-893c816ca060 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:34.697241 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4fb3f84f-44c5-41d4-9d4d-893c816ca060 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:34.697823 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4fb3f84f-44c5-41d4-9d4d-893c816ca060 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:34.881340 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-4fb3f84f-44c5-41d4-9d4d-893c816ca060 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:34.891266 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4fb3f84f-44c5-41d4-9d4d-893c816ca060 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1503 microversion: 2.1 time: 0.210926 Sep 23 04:50:34.893747 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2234/4350] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:34 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1503 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:34.916666 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b58a2331-4366-4edd-9649-675a6980382c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:34.917630 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b58a2331-4366-4edd-9649-675a6980382c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:34.929395 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b58a2331-4366-4edd-9649-675a6980382c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:34.930018 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b58a2331-4366-4edd-9649-675a6980382c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:34.930531 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b58a2331-4366-4edd-9649-675a6980382c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:34.931329 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b58a2331-4366-4edd-9649-675a6980382c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:34.932320 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b58a2331-4366-4edd-9649-675a6980382c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:34.932842 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b58a2331-4366-4edd-9649-675a6980382c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:34.966994 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d80e9b62-06a2-45e0-9bb2-45ad1b689dc9 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "DELETE /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9/os-volume_attachments/d3597f6d-271b-4aaf-bd1b-434410669ce5" status: 202 len: 0 microversion: 2.20 time: 0.535117 Sep 23 04:50:34.968904 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2117/4351] 10.222.0.33 () {60 vars in 1457 bytes} [Fri Sep 23 04:50:34 2022] DELETE /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9/os-volume_attachments/d3597f6d-271b-4aaf-bd1b-434410669ce5 => generated 0 bytes in 538 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 23 04:50:34.992465 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e796b1bf-09d7-4cb2-bc1e-452c3af4bc8b tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:34.995460 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e796b1bf-09d7-4cb2-bc1e-452c3af4bc8b tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: fe7dee09-8351-4d41-8c44-8d35a966cce9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:35.003325 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e796b1bf-09d7-4cb2-bc1e-452c3af4bc8b tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:35.003910 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e796b1bf-09d7-4cb2-bc1e-452c3af4bc8b tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:35.004419 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e796b1bf-09d7-4cb2-bc1e-452c3af4bc8b tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:35.005198 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e796b1bf-09d7-4cb2-bc1e-452c3af4bc8b tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:35.005724 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e796b1bf-09d7-4cb2-bc1e-452c3af4bc8b tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:35.006261 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e796b1bf-09d7-4cb2-bc1e-452c3af4bc8b tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:35.037742 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:50:35.043850 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e796b1bf-09d7-4cb2-bc1e-452c3af4bc8b tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.062418 Sep 23 04:50:35.050600 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2118/4352] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Sep 23 04:50:34 2022] GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 04:50:35.178948 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b58a2331-4366-4edd-9649-675a6980382c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:35.187599 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b58a2331-4366-4edd-9649-675a6980382c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1503 microversion: 2.1 time: 0.276395 Sep 23 04:50:35.194115 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2235/4353] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:34 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1503 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:50:35.214446 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4ecdeaba-f0e1-4224-a727-3afe18b419cd tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:50:35.217509 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4ecdeaba-f0e1-4224-a727-3afe18b419cd tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: 9de21b48-0c56-4e1c-9a5a-07a8663ffb15] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:35.225794 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-4ecdeaba-f0e1-4224-a727-3afe18b419cd tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] HTTP exception thrown: Instance 9de21b48-0c56-4e1c-9a5a-07a8663ffb15 could not be found. Sep 23 04:50:35.227885 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4ecdeaba-f0e1-4224-a727-3afe18b419cd tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Request method failure captured: Sep 23 04:50:35.227885 n-d-846463-3 devstack@n-api.service[122698]: request: POST /compute/v2.1/servers/9de21b48-0c56-4e1c-9a5a-07a8663ffb15/action HTTP/1.1 Sep 23 04:50:35.227885 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:50:35.227885 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:50:35.227885 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:50:35.227885 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 28 Sep 23 04:50:35.227885 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:50:35.227885 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:50:35.227885 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:50:35.227885 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:50:35.227885 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTrDoGx96bSja4ydTGD-VWXTOyHeLiBA9Lvr197ivKeXqtV3OksEUUEiEPXK85IMwWXM1vCTp1M9PaXnUkKbFev29d-fL5KKXR0MfyGa86SLKINg6u_gn5EQLUNZ8EVLCkU1WwJ7agpVlFY75EyJH0fBcxrNg1yvFbeC2alzdH4Tkmw Sep 23 04:50:35.227885 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:50:35.227885 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:50:35.227885 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:50:35.227885 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:50:35.227885 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:50:35.227885 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:50:35.227885 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 78dca47156ff4f19a8673b893c853978 Sep 23 04:50:35.227885 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:50:35.227885 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:50:35.227885 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:50:35.227885 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_78dca47156ff4f19a8673b893c853978", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/78dca47156ff4f19a8673b893c853978"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/78dca47156ff4f19a8673b893c853978"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/78dca47156ff4f19a8673b893c853978"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:50:35.227885 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:50:35.227885 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 78dca47156ff4f19a8673b893c853978 Sep 23 04:50:35.227885 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:50:35.227885 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ServersNegativeTestJSON-1102187211-project Sep 23 04:50:35.227885 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:50:35.227885 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:50:35.227885 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: c912fb9d1f5447d180a9e8568220526f Sep 23 04:50:35.227885 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ServersNegativeTestJSON-1102187211-project Sep 23 04:50:35.227885 n-d-846463-3 devstack@n-api.service[122698]: Sep 23 04:50:35.227885 n-d-846463-3 devstack@n-api.service[122698]: {"reboot": {"type": "SOFT"}} Sep 23 04:50:35.227885 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:50:35.227885 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 9de21b48-0c56-4e1c-9a5a-07a8663ffb15 could not be found. Sep 23 04:50:35.227885 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '9de21b48-0c56-4e1c-9a5a-07a8663ffb15', 'body': {'reboot': {'type': 'SOFT'}}} Sep 23 04:50:35.227885 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:50:35.227885 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:35.227885 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:50:35.227885 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:50:35.227885 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:50:35.227885 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:50:35.227885 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 23 04:50:35.227885 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 23 04:50:35.227885 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9de21b48-0c56-4e1c-9a5a-07a8663ffb15 could not be found. Sep 23 04:50:35.227885 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:50:35.227885 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:50:35.227885 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:50:35.227885 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:35.227885 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:50:35.227885 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:50:35.227885 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:50:35.227885 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:50:35.227885 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:50:35.227885 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:50:35.227885 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:50:35.227885 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:50:35.227885 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Sep 23 04:50:35.227885 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 23 04:50:35.227885 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:50:35.227885 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:50:35.227885 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:50:35.227885 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:50:35.227885 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9de21b48-0c56-4e1c-9a5a-07a8663ffb15 could not be found. Sep 23 04:50:35.227885 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:50:35.231987 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:50:35.231987 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:50:35.231987 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:35.231987 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:50:35.231987 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:50:35.231987 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:50:35.231987 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:50:35.231987 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9de21b48-0c56-4e1c-9a5a-07a8663ffb15 could not be found. Sep 23 04:50:35.231987 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:50:35.231987 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4ecdeaba-f0e1-4224-a727-3afe18b419cd tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Returning 404 to user: Instance 9de21b48-0c56-4e1c-9a5a-07a8663ffb15 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:50:35.231987 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4ecdeaba-f0e1-4224-a727-3afe18b419cd tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "POST /compute/v2.1/servers/9de21b48-0c56-4e1c-9a5a-07a8663ffb15/action" status: 404 len: 111 microversion: 2.1 time: 0.018752 Sep 23 04:50:35.238588 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4869f455-90c3-4837-82f9-8b37519dc449 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:35.239399 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4869f455-90c3-4837-82f9-8b37519dc449 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:35.250286 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4869f455-90c3-4837-82f9-8b37519dc449 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:35.250475 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2119/4354] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:50:35 2022] POST /compute/v2.1/servers/9de21b48-0c56-4e1c-9a5a-07a8663ffb15/action => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:50:35.250592 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4869f455-90c3-4837-82f9-8b37519dc449 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:35.250592 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4869f455-90c3-4837-82f9-8b37519dc449 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:35.250592 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4869f455-90c3-4837-82f9-8b37519dc449 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:35.250592 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4869f455-90c3-4837-82f9-8b37519dc449 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:35.250592 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4869f455-90c3-4837-82f9-8b37519dc449 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:35.251741 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-27152bc7-9116-478c-bbf8-b97636237d7c tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:35.252300 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-27152bc7-9116-478c-bbf8-b97636237d7c tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: c4464422-9bf1-4aaa-806c-d7063e284579] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:35.263241 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-27152bc7-9116-478c-bbf8-b97636237d7c tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:35.263764 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-27152bc7-9116-478c-bbf8-b97636237d7c tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:35.264217 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-27152bc7-9116-478c-bbf8-b97636237d7c tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:35.264947 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-27152bc7-9116-478c-bbf8-b97636237d7c tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:35.265580 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-27152bc7-9116-478c-bbf8-b97636237d7c tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:35.266397 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-27152bc7-9116-478c-bbf8-b97636237d7c tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:35.367452 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-27152bc7-9116-478c-bbf8-b97636237d7c tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lazy-loading 'services' on Instance uuid c4464422-9bf1-4aaa-806c-d7063e284579 {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:50:35.452686 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-4869f455-90c3-4837-82f9-8b37519dc449 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:35.463496 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4869f455-90c3-4837-82f9-8b37519dc449 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1503 microversion: 2.1 time: 0.228766 Sep 23 04:50:35.474651 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2236/4355] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:35 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1503 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:35.488641 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6837e4d7-4db3-4959-bdd4-a79e8ad1c6ce tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:35.489498 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-6837e4d7-4db3-4959-bdd4-a79e8ad1c6ce tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 30d846a2-5966-4fae-9515-9d873d882e6b] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:35.495729 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6837e4d7-4db3-4959-bdd4-a79e8ad1c6ce tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:35.499992 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6837e4d7-4db3-4959-bdd4-a79e8ad1c6ce tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:35.500523 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6837e4d7-4db3-4959-bdd4-a79e8ad1c6ce tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:35.501218 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6837e4d7-4db3-4959-bdd4-a79e8ad1c6ce tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:35.501677 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6837e4d7-4db3-4959-bdd4-a79e8ad1c6ce tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:35.502453 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6837e4d7-4db3-4959-bdd4-a79e8ad1c6ce tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:35.685432 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-6837e4d7-4db3-4959-bdd4-a79e8ad1c6ce tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:35.686677 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-27152bc7-9116-478c-bbf8-b97636237d7c tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579/os-volume_attachments/755739a7-3c13-4a92-a5c0-91b8d4181c66" status: 202 len: 0 microversion: 2.1 time: 0.438676 Sep 23 04:50:35.687500 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2120/4356] 10.222.0.33 () {58 vars in 1416 bytes} [Fri Sep 23 04:50:35 2022] DELETE /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579/os-volume_attachments/755739a7-3c13-4a92-a5c0-91b8d4181c66 => generated 0 bytes in 441 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:50:35.699608 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6837e4d7-4db3-4959-bdd4-a79e8ad1c6ce tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/30d846a2-5966-4fae-9515-9d873d882e6b" status: 200 len: 1510 microversion: 2.1 time: 0.223697 Sep 23 04:50:35.702720 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2237/4357] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:35 2022] GET /compute/v2.1/servers/30d846a2-5966-4fae-9515-9d873d882e6b => generated 1510 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:35.709733 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4d3a9af0-fa20-4cc1-a45e-b45c20c5929d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:35.710519 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4d3a9af0-fa20-4cc1-a45e-b45c20c5929d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:35.712947 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-55295960-60f3-4689-b285-9272bde31efb tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:35.715298 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-55295960-60f3-4689-b285-9272bde31efb tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: c4464422-9bf1-4aaa-806c-d7063e284579] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:35.717822 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4d3a9af0-fa20-4cc1-a45e-b45c20c5929d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:35.718369 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4d3a9af0-fa20-4cc1-a45e-b45c20c5929d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:35.718805 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4d3a9af0-fa20-4cc1-a45e-b45c20c5929d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:35.719530 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4d3a9af0-fa20-4cc1-a45e-b45c20c5929d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:35.719998 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4d3a9af0-fa20-4cc1-a45e-b45c20c5929d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:35.720449 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4d3a9af0-fa20-4cc1-a45e-b45c20c5929d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:35.722213 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-55295960-60f3-4689-b285-9272bde31efb tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:35.722776 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-55295960-60f3-4689-b285-9272bde31efb tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:35.723216 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-55295960-60f3-4689-b285-9272bde31efb tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:35.724000 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-55295960-60f3-4689-b285-9272bde31efb tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:35.724464 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-55295960-60f3-4689-b285-9272bde31efb tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:35.724871 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-55295960-60f3-4689-b285-9272bde31efb tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:35.792022 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-55295960-60f3-4689-b285-9272bde31efb tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086700 Sep 23 04:50:35.792022 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2238/4358] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Sep 23 04:50:35 2022] GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:50:36.062924 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ae346b87-dbee-4b48-9f9a-a5e4af4bdceb tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:36.065569 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4d3a9af0-fa20-4cc1-a45e-b45c20c5929d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:36.066126 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ae346b87-dbee-4b48-9f9a-a5e4af4bdceb tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: fe7dee09-8351-4d41-8c44-8d35a966cce9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:36.076568 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ae346b87-dbee-4b48-9f9a-a5e4af4bdceb tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:36.077311 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ae346b87-dbee-4b48-9f9a-a5e4af4bdceb tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:36.081743 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ae346b87-dbee-4b48-9f9a-a5e4af4bdceb tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:36.082930 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ae346b87-dbee-4b48-9f9a-a5e4af4bdceb tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:36.083578 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ae346b87-dbee-4b48-9f9a-a5e4af4bdceb tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:36.084167 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ae346b87-dbee-4b48-9f9a-a5e4af4bdceb tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:36.101430 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4d3a9af0-fa20-4cc1-a45e-b45c20c5929d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1503 microversion: 2.1 time: 0.412407 Sep 23 04:50:36.102551 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2121/4359] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:35 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1503 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:36.126802 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ae346b87-dbee-4b48-9f9a-a5e4af4bdceb tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.071728 Sep 23 04:50:36.128231 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2239/4360] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Sep 23 04:50:36 2022] GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 04:50:36.128369 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4a363a90-636e-4f0d-99bd-8eba5ab8c06c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:50:36.131435 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4a363a90-636e-4f0d-99bd-8eba5ab8c06c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: 9d5576c0-2aa8-4ca0-aed6-22c1f0700755] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:36.138167 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4a363a90-636e-4f0d-99bd-8eba5ab8c06c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:36.138877 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4a363a90-636e-4f0d-99bd-8eba5ab8c06c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:36.139707 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4a363a90-636e-4f0d-99bd-8eba5ab8c06c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:36.140648 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4a363a90-636e-4f0d-99bd-8eba5ab8c06c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:36.141117 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4a363a90-636e-4f0d-99bd-8eba5ab8c06c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:36.141544 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4a363a90-636e-4f0d-99bd-8eba5ab8c06c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:36.157985 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-4a363a90-636e-4f0d-99bd-8eba5ab8c06c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] HTTP exception thrown: Instance 9d5576c0-2aa8-4ca0-aed6-22c1f0700755 could not be found. Sep 23 04:50:36.159996 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4a363a90-636e-4f0d-99bd-8eba5ab8c06c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Request method failure captured: Sep 23 04:50:36.159996 n-d-846463-3 devstack@n-api.service[122698]: request: POST /compute/v2.1/servers/9d5576c0-2aa8-4ca0-aed6-22c1f0700755/action HTTP/1.1 Sep 23 04:50:36.159996 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:50:36.159996 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:50:36.159996 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:50:36.159996 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 65 Sep 23 04:50:36.159996 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:50:36.159996 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:50:36.159996 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:50:36.159996 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:50:36.159996 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTrDoGx96bSja4ydTGD-VWXTOyHeLiBA9Lvr197ivKeXqtV3OksEUUEiEPXK85IMwWXM1vCTp1M9PaXnUkKbFev29d-fL5KKXR0MfyGa86SLKINg6u_gn5EQLUNZ8EVLCkU1WwJ7agpVlFY75EyJH0fBcxrNg1yvFbeC2alzdH4Tkmw Sep 23 04:50:36.159996 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:50:36.159996 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:50:36.159996 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:50:36.159996 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:50:36.159996 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:50:36.159996 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:50:36.159996 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 78dca47156ff4f19a8673b893c853978 Sep 23 04:50:36.159996 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:50:36.159996 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:50:36.159996 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:50:36.159996 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_78dca47156ff4f19a8673b893c853978", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/78dca47156ff4f19a8673b893c853978"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/78dca47156ff4f19a8673b893c853978"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/78dca47156ff4f19a8673b893c853978"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:50:36.159996 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:50:36.159996 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 78dca47156ff4f19a8673b893c853978 Sep 23 04:50:36.159996 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:50:36.159996 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ServersNegativeTestJSON-1102187211-project Sep 23 04:50:36.159996 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:50:36.159996 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:50:36.159996 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: c912fb9d1f5447d180a9e8568220526f Sep 23 04:50:36.159996 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ServersNegativeTestJSON-1102187211-project Sep 23 04:50:36.159996 n-d-846463-3 devstack@n-api.service[122698]: Sep 23 04:50:36.159996 n-d-846463-3 devstack@n-api.service[122698]: {"rebuild": {"imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee"}} Sep 23 04:50:36.159996 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:50:36.159996 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 9d5576c0-2aa8-4ca0-aed6-22c1f0700755 could not be found. Sep 23 04:50:36.159996 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '9d5576c0-2aa8-4ca0-aed6-22c1f0700755', 'body': {'rebuild': {'imageRef': 'b8dd79b9-f0b9-43a9-9605-17244137c0ee'}}} Sep 23 04:50:36.159996 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:50:36.159996 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:36.159996 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:50:36.159996 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:50:36.159996 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:50:36.159996 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:50:36.159996 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:50:36.159996 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:50:36.159996 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:50:36.159996 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:50:36.159996 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d5576c0-2aa8-4ca0-aed6-22c1f0700755 could not be found. Sep 23 04:50:36.159996 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:50:36.159996 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:50:36.159996 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:50:36.159996 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:36.159996 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:50:36.159996 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:50:36.159996 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:50:36.159996 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:50:36.159996 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:50:36.159996 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:50:36.159996 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:50:36.159996 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:50:36.159996 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:50:36.159996 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:50:36.159996 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:50:36.159996 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:50:36.159996 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Sep 23 04:50:36.159996 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Sep 23 04:50:36.166774 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 23 04:50:36.166774 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:50:36.166774 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:50:36.166774 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:50:36.166774 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:50:36.166774 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d5576c0-2aa8-4ca0-aed6-22c1f0700755 could not be found. Sep 23 04:50:36.166774 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:50:36.166774 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:50:36.166774 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:50:36.166774 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:36.166774 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:50:36.166774 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:50:36.166774 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:50:36.166774 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:50:36.166774 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d5576c0-2aa8-4ca0-aed6-22c1f0700755 could not be found. Sep 23 04:50:36.166774 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:50:36.166774 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4a363a90-636e-4f0d-99bd-8eba5ab8c06c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Returning 404 to user: Instance 9d5576c0-2aa8-4ca0-aed6-22c1f0700755 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:50:36.166774 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4a363a90-636e-4f0d-99bd-8eba5ab8c06c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "POST /compute/v2.1/servers/9d5576c0-2aa8-4ca0-aed6-22c1f0700755/action" status: 404 len: 111 microversion: 2.1 time: 0.037536 Sep 23 04:50:36.166774 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2122/4361] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:50:36 2022] POST /compute/v2.1/servers/9d5576c0-2aa8-4ca0-aed6-22c1f0700755/action => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 04:50:36.171343 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-beca5f32-3bf3-475c-92c4-300aa1ebe58c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:36.172131 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-beca5f32-3bf3-475c-92c4-300aa1ebe58c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:36.178937 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-beca5f32-3bf3-475c-92c4-300aa1ebe58c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:36.179706 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-beca5f32-3bf3-475c-92c4-300aa1ebe58c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:36.180349 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-beca5f32-3bf3-475c-92c4-300aa1ebe58c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:36.181277 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-beca5f32-3bf3-475c-92c4-300aa1ebe58c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:36.181986 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-beca5f32-3bf3-475c-92c4-300aa1ebe58c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:36.182483 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-beca5f32-3bf3-475c-92c4-300aa1ebe58c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:36.347291 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-beca5f32-3bf3-475c-92c4-300aa1ebe58c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:36.362905 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-beca5f32-3bf3-475c-92c4-300aa1ebe58c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1503 microversion: 2.1 time: 0.193952 Sep 23 04:50:36.362905 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2240/4362] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:36 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1503 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:36.387458 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3d137e45-58cd-4946-9e2b-73945fa2a292 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:36.388811 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3d137e45-58cd-4946-9e2b-73945fa2a292 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:36.395600 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3d137e45-58cd-4946-9e2b-73945fa2a292 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:36.396674 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3d137e45-58cd-4946-9e2b-73945fa2a292 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:36.397339 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3d137e45-58cd-4946-9e2b-73945fa2a292 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:36.398670 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3d137e45-58cd-4946-9e2b-73945fa2a292 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:36.399381 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3d137e45-58cd-4946-9e2b-73945fa2a292 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:36.399988 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3d137e45-58cd-4946-9e2b-73945fa2a292 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:36.697583 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-3d137e45-58cd-4946-9e2b-73945fa2a292 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:36.716597 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3d137e45-58cd-4946-9e2b-73945fa2a292 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1503 microversion: 2.1 time: 0.325660 Sep 23 04:50:36.718894 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2123/4363] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:36 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1503 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:36.741467 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e633a004-1901-4f26-bd57-0e926ca84db7 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:36.742107 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e633a004-1901-4f26-bd57-0e926ca84db7 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 30d846a2-5966-4fae-9515-9d873d882e6b] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:36.749188 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-15cedcd2-0db4-4c7d-8379-f9a8d101e601 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:50:36.763978 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e633a004-1901-4f26-bd57-0e926ca84db7 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:36.765489 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-15cedcd2-0db4-4c7d-8379-f9a8d101e601 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: 86b159ba-cd0f-4136-908d-bff5e0772902] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:36.768861 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e633a004-1901-4f26-bd57-0e926ca84db7 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:36.769376 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e633a004-1901-4f26-bd57-0e926ca84db7 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:36.770172 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e633a004-1901-4f26-bd57-0e926ca84db7 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:36.774758 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e633a004-1901-4f26-bd57-0e926ca84db7 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:36.775639 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e633a004-1901-4f26-bd57-0e926ca84db7 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:36.787558 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-15cedcd2-0db4-4c7d-8379-f9a8d101e601 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] HTTP exception thrown: Instance 86b159ba-cd0f-4136-908d-bff5e0772902 could not be found. Sep 23 04:50:36.792566 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-15cedcd2-0db4-4c7d-8379-f9a8d101e601 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Request method failure captured: Sep 23 04:50:36.792566 n-d-846463-3 devstack@n-api.service[122698]: request: POST /compute/v2.1/servers/86b159ba-cd0f-4136-908d-bff5e0772902/action HTTP/1.1 Sep 23 04:50:36.792566 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:50:36.792566 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:50:36.792566 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:50:36.792566 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 65 Sep 23 04:50:36.792566 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:50:36.792566 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:50:36.792566 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:50:36.792566 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:50:36.792566 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTrDoGx96bSja4ydTGD-VWXTOyHeLiBA9Lvr197ivKeXqtV3OksEUUEiEPXK85IMwWXM1vCTp1M9PaXnUkKbFev29d-fL5KKXR0MfyGa86SLKINg6u_gn5EQLUNZ8EVLCkU1WwJ7agpVlFY75EyJH0fBcxrNg1yvFbeC2alzdH4Tkmw Sep 23 04:50:36.792566 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:50:36.792566 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:50:36.792566 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:50:36.792566 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:50:36.792566 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:50:36.792566 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:50:36.792566 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 78dca47156ff4f19a8673b893c853978 Sep 23 04:50:36.792566 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:50:36.792566 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:50:36.792566 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:50:36.792566 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_78dca47156ff4f19a8673b893c853978", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/78dca47156ff4f19a8673b893c853978"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/78dca47156ff4f19a8673b893c853978"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/78dca47156ff4f19a8673b893c853978"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:50:36.792566 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:50:36.792566 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 78dca47156ff4f19a8673b893c853978 Sep 23 04:50:36.792566 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:50:36.792566 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ServersNegativeTestJSON-1102187211-project Sep 23 04:50:36.792566 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:50:36.792566 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:50:36.792566 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: c912fb9d1f5447d180a9e8568220526f Sep 23 04:50:36.792566 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ServersNegativeTestJSON-1102187211-project Sep 23 04:50:36.792566 n-d-846463-3 devstack@n-api.service[122698]: Sep 23 04:50:36.792566 n-d-846463-3 devstack@n-api.service[122698]: {"rebuild": {"imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee"}} Sep 23 04:50:36.792566 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:50:36.792566 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 86b159ba-cd0f-4136-908d-bff5e0772902 could not be found. Sep 23 04:50:36.792566 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '86b159ba-cd0f-4136-908d-bff5e0772902', 'body': {'rebuild': {'imageRef': 'b8dd79b9-f0b9-43a9-9605-17244137c0ee'}}} Sep 23 04:50:36.792566 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:50:36.792566 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:36.792566 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:50:36.792566 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:50:36.792566 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:50:36.792566 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:50:36.792566 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 23 04:50:36.792566 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 23 04:50:36.792566 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86b159ba-cd0f-4136-908d-bff5e0772902 could not be found. Sep 23 04:50:36.792566 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:50:36.792566 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:50:36.792566 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:50:36.792566 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:36.792566 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:50:36.792566 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:50:36.792566 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:50:36.792566 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:50:36.792566 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:50:36.792566 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:50:36.792566 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:50:36.792566 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:50:36.792566 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:50:36.792566 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:50:36.792566 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:50:36.792566 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:50:36.792566 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Sep 23 04:50:36.792566 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Sep 23 04:50:36.792566 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 23 04:50:36.792566 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:50:36.796716 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:50:36.796716 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:50:36.796716 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:50:36.796716 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86b159ba-cd0f-4136-908d-bff5e0772902 could not be found. Sep 23 04:50:36.796716 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:50:36.796716 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:50:36.796716 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:50:36.796716 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:36.796716 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:50:36.796716 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:50:36.796716 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:50:36.796716 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:50:36.796716 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86b159ba-cd0f-4136-908d-bff5e0772902 could not be found. Sep 23 04:50:36.796716 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:50:36.796716 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-15cedcd2-0db4-4c7d-8379-f9a8d101e601 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Returning 404 to user: Instance 86b159ba-cd0f-4136-908d-bff5e0772902 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:50:36.801880 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-15cedcd2-0db4-4c7d-8379-f9a8d101e601 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "POST /compute/v2.1/servers/86b159ba-cd0f-4136-908d-bff5e0772902/action" status: 404 len: 111 microversion: 2.1 time: 0.051042 Sep 23 04:50:36.802776 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2124/4364] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:50:36 2022] POST /compute/v2.1/servers/86b159ba-cd0f-4136-908d-bff5e0772902/action => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:50:36.825292 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9b458ac4-f94c-47c0-8f3c-bf54cdd703af tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:36.832771 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-9b458ac4-f94c-47c0-8f3c-bf54cdd703af tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: c4464422-9bf1-4aaa-806c-d7063e284579] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:36.853635 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9b458ac4-f94c-47c0-8f3c-bf54cdd703af tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:36.854185 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9b458ac4-f94c-47c0-8f3c-bf54cdd703af tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:36.854637 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9b458ac4-f94c-47c0-8f3c-bf54cdd703af tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:36.855361 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9b458ac4-f94c-47c0-8f3c-bf54cdd703af tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:36.855832 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9b458ac4-f94c-47c0-8f3c-bf54cdd703af tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:36.856273 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9b458ac4-f94c-47c0-8f3c-bf54cdd703af tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:36.926816 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9b458ac4-f94c-47c0-8f3c-bf54cdd703af tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.116151 Sep 23 04:50:36.927915 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2125/4365] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Sep 23 04:50:36 2022] GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579/os-volume_attachments => generated 197 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:50:36.934736 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-dd3267f5-f7ce-4d66-8298-1ff2544caa18 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:36.936089 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-dd3267f5-f7ce-4d66-8298-1ff2544caa18 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:36.943475 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dd3267f5-f7ce-4d66-8298-1ff2544caa18 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:36.944292 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dd3267f5-f7ce-4d66-8298-1ff2544caa18 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:36.944966 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dd3267f5-f7ce-4d66-8298-1ff2544caa18 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:36.946279 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dd3267f5-f7ce-4d66-8298-1ff2544caa18 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:36.947247 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dd3267f5-f7ce-4d66-8298-1ff2544caa18 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:36.948168 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dd3267f5-f7ce-4d66-8298-1ff2544caa18 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:37.154367 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e633a004-1901-4f26-bd57-0e926ca84db7 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:37.169067 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e633a004-1901-4f26-bd57-0e926ca84db7 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/30d846a2-5966-4fae-9515-9d873d882e6b" status: 200 len: 1510 microversion: 2.1 time: 0.432228 Sep 23 04:50:37.172639 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2241/4366] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:36 2022] GET /compute/v2.1/servers/30d846a2-5966-4fae-9515-9d873d882e6b => generated 1510 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:37.184655 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-24e83099-1a7e-4038-a87e-31f9d37b5d13 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:37.196257 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-24e83099-1a7e-4038-a87e-31f9d37b5d13 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8d728817c4f74e579eab88b62f73d08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaa3a17b8a24f8087a5748f83d377e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:37.198468 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-24e83099-1a7e-4038-a87e-31f9d37b5d13 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Searching by: {'deleted': False, 'project_id': 'dbaa3a17b8a24f8087a5748f83d377e7'} {{(pid=122699) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 04:50:37.210416 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-24e83099-1a7e-4038-a87e-31f9d37b5d13 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:37.215104 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-24e83099-1a7e-4038-a87e-31f9d37b5d13 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:37.215832 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-24e83099-1a7e-4038-a87e-31f9d37b5d13 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:37.216916 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-24e83099-1a7e-4038-a87e-31f9d37b5d13 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:37.222087 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-24e83099-1a7e-4038-a87e-31f9d37b5d13 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:37.223520 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-24e83099-1a7e-4038-a87e-31f9d37b5d13 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:37.235034 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-dd3267f5-f7ce-4d66-8298-1ff2544caa18 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:37.253361 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-dd3267f5-f7ce-4d66-8298-1ff2544caa18 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1503 microversion: 2.1 time: 0.323609 Sep 23 04:50:37.254519 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2126/4367] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:36 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1503 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:37.266417 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0e100688-f94d-41eb-949b-080a4b6ff61a tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:37.273231 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-0e100688-f94d-41eb-949b-080a4b6ff61a tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: fe7dee09-8351-4d41-8c44-8d35a966cce9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:37.286569 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0e100688-f94d-41eb-949b-080a4b6ff61a tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:37.288304 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0e100688-f94d-41eb-949b-080a4b6ff61a tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:37.290312 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0e100688-f94d-41eb-949b-080a4b6ff61a tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:37.293076 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0e100688-f94d-41eb-949b-080a4b6ff61a tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:37.293796 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0e100688-f94d-41eb-949b-080a4b6ff61a tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:37.296314 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0e100688-f94d-41eb-949b-080a4b6ff61a tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:37.298543 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.multi_cell_list [None req-24e83099-1a7e-4038-a87e-31f9d37b5d13 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122699) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 23 04:50:37.386597 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-24e83099-1a7e-4038-a87e-31f9d37b5d13 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 333 microversion: 2.1 time: 0.212131 Sep 23 04:50:37.460330 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2242/4368] 10.222.0.33 () {58 vars in 1125 bytes} [Fri Sep 23 04:50:37 2022] GET /compute/v2.1/servers => generated 333 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:50:37.460330 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3f021bc6-12ab-4af6-894b-b7cf5777b0b9 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:37.460330 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-3f021bc6-12ab-4af6-894b-b7cf5777b0b9 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:37.462298 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0e100688-f94d-41eb-949b-080a4b6ff61a tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.160679 Sep 23 04:50:37.462298 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2127/4369] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Sep 23 04:50:37 2022] GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9/os-volume_attachments => generated 197 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 04:50:37.462902 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3f021bc6-12ab-4af6-894b-b7cf5777b0b9 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:37.462902 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3f021bc6-12ab-4af6-894b-b7cf5777b0b9 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:37.462902 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3f021bc6-12ab-4af6-894b-b7cf5777b0b9 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:37.462902 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3f021bc6-12ab-4af6-894b-b7cf5777b0b9 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:37.462902 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3f021bc6-12ab-4af6-894b-b7cf5777b0b9 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:37.462902 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3f021bc6-12ab-4af6-894b-b7cf5777b0b9 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:37.463391 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-96bcdc9f-1b10-4e21-86c9-34aee62a1811 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:37.463391 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-96bcdc9f-1b10-4e21-86c9-34aee62a1811 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8d728817c4f74e579eab88b62f73d08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaa3a17b8a24f8087a5748f83d377e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:37.463391 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-96bcdc9f-1b10-4e21-86c9-34aee62a1811 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Searching by: {'deleted': False, 'project_id': 'dbaa3a17b8a24f8087a5748f83d377e7'} {{(pid=122698) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 04:50:37.463391 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=100 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:50:37.463391 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-96bcdc9f-1b10-4e21-86c9-34aee62a1811 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:37.463391 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-96bcdc9f-1b10-4e21-86c9-34aee62a1811 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:37.463391 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-96bcdc9f-1b10-4e21-86c9-34aee62a1811 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:37.466542 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-96bcdc9f-1b10-4e21-86c9-34aee62a1811 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:37.467365 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-96bcdc9f-1b10-4e21-86c9-34aee62a1811 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:37.468042 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-96bcdc9f-1b10-4e21-86c9-34aee62a1811 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:37.534805 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.multi_cell_list [None req-96bcdc9f-1b10-4e21-86c9-34aee62a1811 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122698) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 23 04:50:37.629468 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-96bcdc9f-1b10-4e21-86c9-34aee62a1811 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d728817c4f74e579eab88b62f73d08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaa3a17b8a24f8087a5748f83d377e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:37.652321 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-96bcdc9f-1b10-4e21-86c9-34aee62a1811 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:37.653412 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-96bcdc9f-1b10-4e21-86c9-34aee62a1811 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:37.657599 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-96bcdc9f-1b10-4e21-86c9-34aee62a1811 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:38.184316 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-96bcdc9f-1b10-4e21-86c9-34aee62a1811 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] 10.222.0.33 "GET /compute/v2.1/servers/detail" status: 200 len: 1696 microversion: 2.1 time: 0.765769 Sep 23 04:50:38.187597 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2128/4370] 10.222.0.33 () {58 vars in 1146 bytes} [Fri Sep 23 04:50:37 2022] GET /compute/v2.1/servers/detail => generated 1696 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:38.208422 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3c6fa62c-9baf-442e-a860-dfbeacb0d188 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:38.212453 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3c6fa62c-9baf-442e-a860-dfbeacb0d188 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: c4464422-9bf1-4aaa-806c-d7063e284579] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:38.224784 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-3f021bc6-12ab-4af6-894b-b7cf5777b0b9 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:38.238177 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3f021bc6-12ab-4af6-894b-b7cf5777b0b9 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1503 microversion: 2.1 time: 0.836569 Sep 23 04:50:38.243914 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3c6fa62c-9baf-442e-a860-dfbeacb0d188 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:38.245140 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3c6fa62c-9baf-442e-a860-dfbeacb0d188 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:38.246026 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3c6fa62c-9baf-442e-a860-dfbeacb0d188 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:38.246999 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3c6fa62c-9baf-442e-a860-dfbeacb0d188 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:38.247970 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3c6fa62c-9baf-442e-a860-dfbeacb0d188 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:38.249614 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3c6fa62c-9baf-442e-a860-dfbeacb0d188 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:38.267896 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2243/4371] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:37 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1503 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:38.285165 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b1731cfd-626f-4529-9baa-454296e2f801 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:38.308780 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b1731cfd-626f-4529-9baa-454296e2f801 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 30d846a2-5966-4fae-9515-9d873d882e6b] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:38.312219 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3c6fa62c-9baf-442e-a860-dfbeacb0d188 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.122967 Sep 23 04:50:38.313363 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2129/4372] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Sep 23 04:50:38 2022] GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579/os-volume_attachments => generated 197 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:50:38.319493 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e49ad4e6-0df7-48db-82d2-9cfd171acbae tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:38.335459 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e49ad4e6-0df7-48db-82d2-9cfd171acbae tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.018054 Sep 23 04:50:38.336668 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2130/4373] 10.222.0.33 () {58 vars in 1137 bytes} [Fri Sep 23 04:50:38 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:50:38.344617 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b1731cfd-626f-4529-9baa-454296e2f801 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:38.347260 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b1731cfd-626f-4529-9baa-454296e2f801 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:38.348099 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b1731cfd-626f-4529-9baa-454296e2f801 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:38.348442 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b1731cfd-626f-4529-9baa-454296e2f801 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:38.348906 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b1731cfd-626f-4529-9baa-454296e2f801 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:38.349321 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b1731cfd-626f-4529-9baa-454296e2f801 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:38.367858 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-09a1d2ba-b4e5-48d0-885d-9374fd5065cf tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:50:38.368505 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-09a1d2ba-b4e5-48d0-885d-9374fd5065cf tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: 824fd758-2658-4929-9988-5366b4fb9f02] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:38.374537 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-09a1d2ba-b4e5-48d0-885d-9374fd5065cf tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] HTTP exception thrown: Instance 824fd758-2658-4929-9988-5366b4fb9f02 could not be found. Sep 23 04:50:38.377358 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-09a1d2ba-b4e5-48d0-885d-9374fd5065cf tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Request method failure captured: Sep 23 04:50:38.377358 n-d-846463-3 devstack@n-api.service[122698]: request: POST /compute/v2.1/servers/824fd758-2658-4929-9988-5366b4fb9f02/action HTTP/1.1 Sep 23 04:50:38.377358 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:50:38.377358 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:50:38.377358 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:50:38.377358 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 15 Sep 23 04:50:38.377358 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:50:38.377358 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:50:38.377358 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:50:38.377358 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:50:38.377358 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTrDoGx96bSja4ydTGD-VWXTOyHeLiBA9Lvr197ivKeXqtV3OksEUUEiEPXK85IMwWXM1vCTp1M9PaXnUkKbFev29d-fL5KKXR0MfyGa86SLKINg6u_gn5EQLUNZ8EVLCkU1WwJ7agpVlFY75EyJH0fBcxrNg1yvFbeC2alzdH4Tkmw Sep 23 04:50:38.377358 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:50:38.377358 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:50:38.377358 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:50:38.377358 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:50:38.377358 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:50:38.377358 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:50:38.377358 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 78dca47156ff4f19a8673b893c853978 Sep 23 04:50:38.377358 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:50:38.377358 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:50:38.377358 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:50:38.377358 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_78dca47156ff4f19a8673b893c853978", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/78dca47156ff4f19a8673b893c853978"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/78dca47156ff4f19a8673b893c853978"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/78dca47156ff4f19a8673b893c853978"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:50:38.377358 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:50:38.377358 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 78dca47156ff4f19a8673b893c853978 Sep 23 04:50:38.377358 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:50:38.377358 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ServersNegativeTestJSON-1102187211-project Sep 23 04:50:38.377358 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:50:38.377358 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:50:38.377358 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: c912fb9d1f5447d180a9e8568220526f Sep 23 04:50:38.377358 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ServersNegativeTestJSON-1102187211-project Sep 23 04:50:38.377358 n-d-846463-3 devstack@n-api.service[122698]: Sep 23 04:50:38.377358 n-d-846463-3 devstack@n-api.service[122698]: {"restore": {}} Sep 23 04:50:38.377358 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:50:38.377358 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 824fd758-2658-4929-9988-5366b4fb9f02 could not be found. Sep 23 04:50:38.377358 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '824fd758-2658-4929-9988-5366b4fb9f02', 'body': {'restore': {}}} Sep 23 04:50:38.377358 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:50:38.377358 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:38.377358 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:50:38.377358 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:50:38.377358 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:50:38.377358 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:50:38.377358 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 23 04:50:38.377358 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 23 04:50:38.377358 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 824fd758-2658-4929-9988-5366b4fb9f02 could not be found. Sep 23 04:50:38.377358 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:50:38.377358 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:50:38.377358 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:50:38.377358 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:38.377358 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:50:38.377358 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:50:38.377358 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:50:38.377358 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:50:38.377358 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:50:38.377358 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:50:38.377358 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Sep 23 04:50:38.377358 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 23 04:50:38.377358 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:50:38.377358 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:50:38.377358 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 824fd758-2658-4929-9988-5366b4fb9f02 could not be found. Sep 23 04:50:38.377358 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:50:38.377358 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:50:38.377358 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:50:38.377358 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:38.377358 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:50:38.377358 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:50:38.381271 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:50:38.381271 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:50:38.381271 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 824fd758-2658-4929-9988-5366b4fb9f02 could not be found. Sep 23 04:50:38.381271 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:50:38.381271 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-09a1d2ba-b4e5-48d0-885d-9374fd5065cf tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Returning 404 to user: Instance 824fd758-2658-4929-9988-5366b4fb9f02 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:50:38.381271 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-09a1d2ba-b4e5-48d0-885d-9374fd5065cf tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "POST /compute/v2.1/servers/824fd758-2658-4929-9988-5366b4fb9f02/action" status: 404 len: 111 microversion: 2.1 time: 0.030463 Sep 23 04:50:38.385641 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2131/4374] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:50:38 2022] POST /compute/v2.1/servers/824fd758-2658-4929-9988-5366b4fb9f02/action => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:50:38.390395 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2409f8c9-f916-4df2-8660-82886e17ce25 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:38.393045 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-2409f8c9-f916-4df2-8660-82886e17ce25 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:38.415563 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2409f8c9-f916-4df2-8660-82886e17ce25 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:38.416103 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2409f8c9-f916-4df2-8660-82886e17ce25 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:38.419782 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2409f8c9-f916-4df2-8660-82886e17ce25 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:38.420555 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2409f8c9-f916-4df2-8660-82886e17ce25 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:38.421028 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2409f8c9-f916-4df2-8660-82886e17ce25 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:38.421460 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2409f8c9-f916-4df2-8660-82886e17ce25 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:38.798499 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b1731cfd-626f-4529-9baa-454296e2f801 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:38.801607 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:50:38.812602 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b1731cfd-626f-4529-9baa-454296e2f801 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/30d846a2-5966-4fae-9515-9d873d882e6b" status: 200 len: 1510 microversion: 2.1 time: 0.542008 Sep 23 04:50:38.816696 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2244/4375] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:38 2022] GET /compute/v2.1/servers/30d846a2-5966-4fae-9515-9d873d882e6b => generated 1510 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:38.858452 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-2409f8c9-f916-4df2-8660-82886e17ce25 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:38.860837 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-27e8d968-706f-41ab-a56b-18e42ff21080 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:38.860837 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-27e8d968-706f-41ab-a56b-18e42ff21080 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: fe7dee09-8351-4d41-8c44-8d35a966cce9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:38.861351 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2409f8c9-f916-4df2-8660-82886e17ce25 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1503 microversion: 2.1 time: 0.449747 Sep 23 04:50:38.861351 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2132/4376] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:38 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1503 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:38.861351 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-55ebb39b-bb3b-44e0-a65c-8bd74b1940aa tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:38.861351 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-55ebb39b-bb3b-44e0-a65c-8bd74b1940aa tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] [instance: e6610a41-bbef-4646-80f3-82446c38bbf5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:38.863995 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-27e8d968-706f-41ab-a56b-18e42ff21080 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:38.863995 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-27e8d968-706f-41ab-a56b-18e42ff21080 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:38.863995 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-27e8d968-706f-41ab-a56b-18e42ff21080 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:38.863995 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-27e8d968-706f-41ab-a56b-18e42ff21080 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:38.863995 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-27e8d968-706f-41ab-a56b-18e42ff21080 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:38.863995 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-27e8d968-706f-41ab-a56b-18e42ff21080 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:38.869137 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-55ebb39b-bb3b-44e0-a65c-8bd74b1940aa tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:38.869971 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-55ebb39b-bb3b-44e0-a65c-8bd74b1940aa tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:38.870663 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-55ebb39b-bb3b-44e0-a65c-8bd74b1940aa tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:38.871598 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-55ebb39b-bb3b-44e0-a65c-8bd74b1940aa tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:38.874090 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-55ebb39b-bb3b-44e0-a65c-8bd74b1940aa tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:38.874888 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-55ebb39b-bb3b-44e0-a65c-8bd74b1940aa tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:38.938836 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-55ebb39b-bb3b-44e0-a65c-8bd74b1940aa tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] [instance: e6610a41-bbef-4646-80f3-82446c38bbf5] Going to try to terminate instance {{(pid=122698) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:50:38.941028 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-27e8d968-706f-41ab-a56b-18e42ff21080 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.123030 Sep 23 04:50:38.947558 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2245/4377] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Sep 23 04:50:38 2022] GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9/os-volume_attachments => generated 197 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 04:50:38.952542 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-94e7daa7-8894-4a9f-99a5-939b6f672358 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:38.962525 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-94e7daa7-8894-4a9f-99a5-939b6f672358 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:38.977714 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-94e7daa7-8894-4a9f-99a5-939b6f672358 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:38.978479 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-94e7daa7-8894-4a9f-99a5-939b6f672358 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:38.979220 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-94e7daa7-8894-4a9f-99a5-939b6f672358 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:38.979956 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-94e7daa7-8894-4a9f-99a5-939b6f672358 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:38.980248 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-94e7daa7-8894-4a9f-99a5-939b6f672358 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:38.982250 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-94e7daa7-8894-4a9f-99a5-939b6f672358 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:39.318979 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-94e7daa7-8894-4a9f-99a5-939b6f672358 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:39.327721 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-94e7daa7-8894-4a9f-99a5-939b6f672358 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1503 microversion: 2.1 time: 0.378753 Sep 23 04:50:39.331534 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2246/4378] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:38 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1503 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:39.340058 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-16723539-8bae-4a2c-9b4b-d10db98fe6ec tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:39.348344 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-16723539-8bae-4a2c-9b4b-d10db98fe6ec tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: c4464422-9bf1-4aaa-806c-d7063e284579] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:39.382132 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-16723539-8bae-4a2c-9b4b-d10db98fe6ec tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:39.384873 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-16723539-8bae-4a2c-9b4b-d10db98fe6ec tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:39.386342 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-16723539-8bae-4a2c-9b4b-d10db98fe6ec tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:39.388584 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-16723539-8bae-4a2c-9b4b-d10db98fe6ec tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:39.389061 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-16723539-8bae-4a2c-9b4b-d10db98fe6ec tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:39.389521 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-16723539-8bae-4a2c-9b4b-d10db98fe6ec tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:39.486288 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-55ebb39b-bb3b-44e0-a65c-8bd74b1940aa tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e6610a41-bbef-4646-80f3-82446c38bbf5" status: 204 len: 0 microversion: 2.1 time: 0.647771 Sep 23 04:50:39.486840 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2133/4379] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:50:38 2022] DELETE /compute/v2.1/servers/e6610a41-bbef-4646-80f3-82446c38bbf5 => generated 0 bytes in 649 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:50:39.492470 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f9421e84-483a-454a-9526-d9953ecbd0ff tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:50:39.493113 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f9421e84-483a-454a-9526-d9953ecbd0ff tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:39.500075 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-16723539-8bae-4a2c-9b4b-d10db98fe6ec tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.166501 Sep 23 04:50:39.512889 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f9421e84-483a-454a-9526-d9953ecbd0ff tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:39.513378 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f9421e84-483a-454a-9526-d9953ecbd0ff tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:39.513834 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f9421e84-483a-454a-9526-d9953ecbd0ff tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:39.514592 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f9421e84-483a-454a-9526-d9953ecbd0ff tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:39.515062 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f9421e84-483a-454a-9526-d9953ecbd0ff tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:39.515498 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f9421e84-483a-454a-9526-d9953ecbd0ff tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:39.522122 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2247/4380] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Sep 23 04:50:39 2022] GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579/os-volume_attachments => generated 197 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:50:39.532660 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c9edb992-d752-4b1f-a92d-1b1e6644896c tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:39.541460 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c9edb992-d752-4b1f-a92d-1b1e6644896c tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] [instance: e6610a41-bbef-4646-80f3-82446c38bbf5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:39.557307 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:50:39.559809 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c9edb992-d752-4b1f-a92d-1b1e6644896c tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:39.560687 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c9edb992-d752-4b1f-a92d-1b1e6644896c tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:39.562113 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c9edb992-d752-4b1f-a92d-1b1e6644896c tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:39.566902 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c9edb992-d752-4b1f-a92d-1b1e6644896c tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:39.567682 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c9edb992-d752-4b1f-a92d-1b1e6644896c tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:39.568346 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c9edb992-d752-4b1f-a92d-1b1e6644896c tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:39.609129 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-f9421e84-483a-454a-9526-d9953ecbd0ff tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] HTTP exception thrown: Cannot 'restore' instance a9f2ff08-c66d-4991-9bae-d523a3adb8bf while it is in vm_state active Sep 23 04:50:39.619088 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f9421e84-483a-454a-9526-d9953ecbd0ff tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Request method failure captured: Sep 23 04:50:39.619088 n-d-846463-3 devstack@n-api.service[122698]: request: POST /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf/action HTTP/1.1 Sep 23 04:50:39.619088 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:50:39.619088 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:50:39.619088 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:50:39.619088 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 15 Sep 23 04:50:39.619088 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:50:39.619088 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:50:39.619088 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:50:39.619088 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:50:39.619088 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTrDoGx96bSja4ydTGD-VWXTOyHeLiBA9Lvr197ivKeXqtV3OksEUUEiEPXK85IMwWXM1vCTp1M9PaXnUkKbFev29d-fL5KKXR0MfyGa86SLKINg6u_gn5EQLUNZ8EVLCkU1WwJ7agpVlFY75EyJH0fBcxrNg1yvFbeC2alzdH4Tkmw Sep 23 04:50:39.619088 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:50:39.619088 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:50:39.619088 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:50:39.619088 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:50:39.619088 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:50:39.619088 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:50:39.619088 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 78dca47156ff4f19a8673b893c853978 Sep 23 04:50:39.619088 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:50:39.619088 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:50:39.619088 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:50:39.619088 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_78dca47156ff4f19a8673b893c853978", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/78dca47156ff4f19a8673b893c853978"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/78dca47156ff4f19a8673b893c853978"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/78dca47156ff4f19a8673b893c853978"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:50:39.619088 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:50:39.619088 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 78dca47156ff4f19a8673b893c853978 Sep 23 04:50:39.619088 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:50:39.619088 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ServersNegativeTestJSON-1102187211-project Sep 23 04:50:39.619088 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:50:39.619088 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:50:39.619088 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: c912fb9d1f5447d180a9e8568220526f Sep 23 04:50:39.619088 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ServersNegativeTestJSON-1102187211-project Sep 23 04:50:39.619088 n-d-846463-3 devstack@n-api.service[122698]: Sep 23 04:50:39.619088 n-d-846463-3 devstack@n-api.service[122698]: {"restore": {}} Sep 23 04:50:39.619088 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:50:39.619088 n-d-846463-3 devstack@n-api.service[122698]: exception: Cannot 'restore' instance a9f2ff08-c66d-4991-9bae-d523a3adb8bf while it is in vm_state active Sep 23 04:50:39.619088 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': 'a9f2ff08-c66d-4991-9bae-d523a3adb8bf', 'body': {'restore': {}}} Sep 23 04:50:39.619088 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:50:39.619088 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:39.619088 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Sep 23 04:50:39.619088 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Sep 23 04:50:39.619088 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 23 04:50:39.619088 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 23 04:50:39.619088 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 23 04:50:39.619088 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 23 04:50:39.619088 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a9f2ff08-c66d-4991-9bae-d523a3adb8bf in vm_state active. Cannot restore while the instance is in this state. Sep 23 04:50:39.619088 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:50:39.619088 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:50:39.619088 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:50:39.619088 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:39.619088 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:50:39.619088 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:50:39.619088 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:50:39.619088 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:50:39.619088 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:50:39.619088 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:50:39.619088 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Sep 23 04:50:39.619088 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 23 04:50:39.619088 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 23 04:50:39.619088 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 23 04:50:39.619088 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance a9f2ff08-c66d-4991-9bae-d523a3adb8bf while it is in vm_state active Sep 23 04:50:39.619088 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:50:39.619088 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:50:39.619088 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:50:39.619088 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:39.619088 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:50:39.627469 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:50:39.627469 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:50:39.627469 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:50:39.627469 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance a9f2ff08-c66d-4991-9bae-d523a3adb8bf while it is in vm_state active Sep 23 04:50:39.627469 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:50:39.627469 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f9421e84-483a-454a-9526-d9953ecbd0ff tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Returning 409 to user: Cannot 'restore' instance a9f2ff08-c66d-4991-9bae-d523a3adb8bf while it is in vm_state active {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:50:39.627469 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f9421e84-483a-454a-9526-d9953ecbd0ff tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "POST /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf/action" status: 409 len: 145 microversion: 2.1 time: 0.132830 Sep 23 04:50:39.627469 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2134/4381] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:50:39 2022] POST /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf/action => generated 145 bytes in 138 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 23 04:50:39.638723 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a17669bd-70c6-4aa3-9238-298c198ee73c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:39.639358 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a17669bd-70c6-4aa3-9238-298c198ee73c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:39.664158 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a17669bd-70c6-4aa3-9238-298c198ee73c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:39.664721 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a17669bd-70c6-4aa3-9238-298c198ee73c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:39.673977 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a17669bd-70c6-4aa3-9238-298c198ee73c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:39.674887 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a17669bd-70c6-4aa3-9238-298c198ee73c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:39.675488 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a17669bd-70c6-4aa3-9238-298c198ee73c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:39.675947 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a17669bd-70c6-4aa3-9238-298c198ee73c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:39.942724 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a17669bd-70c6-4aa3-9238-298c198ee73c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:39.954455 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a17669bd-70c6-4aa3-9238-298c198ee73c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1503 microversion: 2.1 time: 0.322764 Sep 23 04:50:39.958798 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2135/4382] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:39 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1503 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:39.963796 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f2b0e7fb-ee8b-43e0-87e3-f5403d6bc143 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-2105191291", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "networks": [{"uuid": "ebf8de99-2086-4354-be0c-8000a4d041c5"}, {"uuid": "dcec5b95-71a2-4288-9344-4bec2db5c1c1"}]}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:50:39.971041 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c9edb992-d752-4b1f-a92d-1b1e6644896c tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d728817c4f74e579eab88b62f73d08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaa3a17b8a24f8087a5748f83d377e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:39.980392 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c9edb992-d752-4b1f-a92d-1b1e6644896c tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] 10.222.0.33 "GET /compute/v2.1/servers/e6610a41-bbef-4646-80f3-82446c38bbf5" status: 200 len: 1699 microversion: 2.1 time: 0.456803 Sep 23 04:50:39.980986 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2248/4383] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:39 2022] GET /compute/v2.1/servers/e6610a41-bbef-4646-80f3-82446c38bbf5 => generated 1699 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:40.005608 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5e7a91df-e334-465c-8d13-0d556397295e tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:40.006197 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-5e7a91df-e334-465c-8d13-0d556397295e tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 30d846a2-5966-4fae-9515-9d873d882e6b] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:40.030869 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5e7a91df-e334-465c-8d13-0d556397295e tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:40.034933 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5e7a91df-e334-465c-8d13-0d556397295e tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:40.035713 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5e7a91df-e334-465c-8d13-0d556397295e tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:40.036536 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5e7a91df-e334-465c-8d13-0d556397295e tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:40.038324 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5e7a91df-e334-465c-8d13-0d556397295e tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:40.038855 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5e7a91df-e334-465c-8d13-0d556397295e tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:40.083396 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.network.neutron [None req-f2b0e7fb-ee8b-43e0-87e3-f5403d6bc143 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] validate_networks() for [('ebf8de99-2086-4354-be0c-8000a4d041c5', None, None, None, None, None), ('dcec5b95-71a2-4288-9344-4bec2db5c1c1', None, None, None, None, None)] {{(pid=122698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:50:40.640443 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-5e7a91df-e334-465c-8d13-0d556397295e tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:40.649565 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5e7a91df-e334-465c-8d13-0d556397295e tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/30d846a2-5966-4fae-9515-9d873d882e6b" status: 200 len: 1510 microversion: 2.1 time: 0.667557 Sep 23 04:50:40.650194 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2249/4384] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:39 2022] GET /compute/v2.1/servers/30d846a2-5966-4fae-9515-9d873d882e6b => generated 1510 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:40.664051 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-94592da7-3c64-4e7f-a5bc-08918466ab27 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:40.668423 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-94592da7-3c64-4e7f-a5bc-08918466ab27 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: fe7dee09-8351-4d41-8c44-8d35a966cce9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:40.680407 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-94592da7-3c64-4e7f-a5bc-08918466ab27 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:40.680953 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-94592da7-3c64-4e7f-a5bc-08918466ab27 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:40.684780 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-94592da7-3c64-4e7f-a5bc-08918466ab27 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:40.685572 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-94592da7-3c64-4e7f-a5bc-08918466ab27 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:40.686095 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-94592da7-3c64-4e7f-a5bc-08918466ab27 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:40.689311 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-94592da7-3c64-4e7f-a5bc-08918466ab27 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:40.778417 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-94592da7-3c64-4e7f-a5bc-08918466ab27 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.123129 Sep 23 04:50:40.782541 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2250/4385] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Sep 23 04:50:40 2022] GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9/os-volume_attachments => generated 197 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 04:50:40.792164 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e834814b-9c02-401f-a0f2-860a4be3cbc3 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:40.794856 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e834814b-9c02-401f-a0f2-860a4be3cbc3 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:40.816611 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e834814b-9c02-401f-a0f2-860a4be3cbc3 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:40.820176 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e834814b-9c02-401f-a0f2-860a4be3cbc3 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:40.820176 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e834814b-9c02-401f-a0f2-860a4be3cbc3 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:40.820176 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e834814b-9c02-401f-a0f2-860a4be3cbc3 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:40.820176 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e834814b-9c02-401f-a0f2-860a4be3cbc3 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:40.820176 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e834814b-9c02-401f-a0f2-860a4be3cbc3 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:41.275056 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e834814b-9c02-401f-a0f2-860a4be3cbc3 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:41.288573 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e834814b-9c02-401f-a0f2-860a4be3cbc3 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1503 microversion: 2.1 time: 0.504648 Sep 23 04:50:41.291132 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2251/4386] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:40 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1503 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:41.298920 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-fe13eb45-2a83-4a55-9c9e-885545cfcf8f tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:41.304508 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-fe13eb45-2a83-4a55-9c9e-885545cfcf8f tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: c4464422-9bf1-4aaa-806c-d7063e284579] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:41.320791 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fe13eb45-2a83-4a55-9c9e-885545cfcf8f tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:41.323923 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fe13eb45-2a83-4a55-9c9e-885545cfcf8f tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:41.323923 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fe13eb45-2a83-4a55-9c9e-885545cfcf8f tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:41.323923 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fe13eb45-2a83-4a55-9c9e-885545cfcf8f tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:41.323923 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fe13eb45-2a83-4a55-9c9e-885545cfcf8f tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:41.323923 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fe13eb45-2a83-4a55-9c9e-885545cfcf8f tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:41.399049 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-fe13eb45-2a83-4a55-9c9e-885545cfcf8f tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103890 Sep 23 04:50:41.399926 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2252/4387] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Sep 23 04:50:41 2022] GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:50:41.404748 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7c6d45e2-1d08-42ef-a3fe-ffd441204f61 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:41.405596 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-7c6d45e2-1d08-42ef-a3fe-ffd441204f61 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] [instance: e6610a41-bbef-4646-80f3-82446c38bbf5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:41.419888 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7c6d45e2-1d08-42ef-a3fe-ffd441204f61 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:41.420667 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7c6d45e2-1d08-42ef-a3fe-ffd441204f61 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:41.421315 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7c6d45e2-1d08-42ef-a3fe-ffd441204f61 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:41.422233 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7c6d45e2-1d08-42ef-a3fe-ffd441204f61 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:41.422853 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7c6d45e2-1d08-42ef-a3fe-ffd441204f61 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:41.423441 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7c6d45e2-1d08-42ef-a3fe-ffd441204f61 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:41.448163 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-f2b0e7fb-ee8b-43e0-87e3-f5403d6bc143 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Flavor limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:50:41.448755 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-f2b0e7fb-ee8b-43e0-87e3-f5403d6bc143 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Image limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:50:41.449061 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-f2b0e7fb-ee8b-43e0-87e3-f5403d6bc143 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Flavor pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:50:41.453360 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-f2b0e7fb-ee8b-43e0-87e3-f5403d6bc143 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Image pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:50:41.453807 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-f2b0e7fb-ee8b-43e0-87e3-f5403d6bc143 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:50:41.486056 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f2b0e7fb-ee8b-43e0-87e3-f5403d6bc143 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:41.498514 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f2b0e7fb-ee8b-43e0-87e3-f5403d6bc143 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:41.515476 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f2b0e7fb-ee8b-43e0-87e3-f5403d6bc143 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:41.519111 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f2b0e7fb-ee8b-43e0-87e3-f5403d6bc143 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:41.519111 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f2b0e7fb-ee8b-43e0-87e3-f5403d6bc143 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:41.519111 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f2b0e7fb-ee8b-43e0-87e3-f5403d6bc143 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:41.645425 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-f2b0e7fb-ee8b-43e0-87e3-f5403d6bc143 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Getting quotas for project 2e32df90da6b43b7b8a562dd95e6833b. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:50:41.665823 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-f2b0e7fb-ee8b-43e0-87e3-f5403d6bc143 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Getting quotas for user 91a52352ab894e8f88be0f9d1cef0b14 and project 2e32df90da6b43b7b8a562dd95e6833b. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:50:41.695524 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-7c6d45e2-1d08-42ef-a3fe-ffd441204f61 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d728817c4f74e579eab88b62f73d08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaa3a17b8a24f8087a5748f83d377e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:41.704143 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-7c6d45e2-1d08-42ef-a3fe-ffd441204f61 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] 10.222.0.33 "GET /compute/v2.1/servers/e6610a41-bbef-4646-80f3-82446c38bbf5" status: 200 len: 1699 microversion: 2.1 time: 0.302965 Sep 23 04:50:41.713875 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2253/4388] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:41 2022] GET /compute/v2.1/servers/e6610a41-bbef-4646-80f3-82446c38bbf5 => generated 1699 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:41.725827 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-12ae8818-3471-4240-a043-efda1309d66b tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:50:41.735545 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-12ae8818-3471-4240-a043-efda1309d66b tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: 6dbcbf3c-5453-4e00-84ab-b5232656365a] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:41.751693 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f2b0e7fb-ee8b-43e0-87e3-f5403d6bc143 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Going to run 1 instances... {{(pid=122698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:50:41.755553 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-12ae8818-3471-4240-a043-efda1309d66b tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] HTTP exception thrown: Instance 6dbcbf3c-5453-4e00-84ab-b5232656365a could not be found. Sep 23 04:50:41.763375 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f2b0e7fb-ee8b-43e0-87e3-f5403d6bc143 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] [instance: 1d9dafd4-e427-4349-a142-2c3ed281b2b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:50:41.764262 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-12ae8818-3471-4240-a043-efda1309d66b tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Request method failure captured: Sep 23 04:50:41.764262 n-d-846463-3 devstack@n-api.service[122699]: request: POST /compute/v2.1/servers/6dbcbf3c-5453-4e00-84ab-b5232656365a/action HTTP/1.1 Sep 23 04:50:41.764262 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:50:41.764262 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:50:41.764262 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:50:41.764262 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 14 Sep 23 04:50:41.764262 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:50:41.764262 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:50:41.764262 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:50:41.764262 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:50:41.764262 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTrDoGx96bSja4ydTGD-VWXTOyHeLiBA9Lvr197ivKeXqtV3OksEUUEiEPXK85IMwWXM1vCTp1M9PaXnUkKbFev29d-fL5KKXR0MfyGa86SLKINg6u_gn5EQLUNZ8EVLCkU1WwJ7agpVlFY75EyJH0fBcxrNg1yvFbeC2alzdH4Tkmw Sep 23 04:50:41.764262 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:50:41.764262 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:50:41.764262 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:50:41.764262 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:50:41.764262 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:50:41.764262 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:50:41.764262 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 78dca47156ff4f19a8673b893c853978 Sep 23 04:50:41.764262 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:50:41.764262 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:50:41.764262 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:50:41.764262 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_78dca47156ff4f19a8673b893c853978", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/78dca47156ff4f19a8673b893c853978"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/78dca47156ff4f19a8673b893c853978"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/78dca47156ff4f19a8673b893c853978"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:50:41.764262 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:50:41.764262 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 78dca47156ff4f19a8673b893c853978 Sep 23 04:50:41.764262 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:50:41.764262 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ServersNegativeTestJSON-1102187211-project Sep 23 04:50:41.764262 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:50:41.764262 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:50:41.764262 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: c912fb9d1f5447d180a9e8568220526f Sep 23 04:50:41.764262 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ServersNegativeTestJSON-1102187211-project Sep 23 04:50:41.764262 n-d-846463-3 devstack@n-api.service[122699]: Sep 23 04:50:41.764262 n-d-846463-3 devstack@n-api.service[122699]: {"resume": {}} Sep 23 04:50:41.764262 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:50:41.764262 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 6dbcbf3c-5453-4e00-84ab-b5232656365a could not be found. Sep 23 04:50:41.764262 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '6dbcbf3c-5453-4e00-84ab-b5232656365a', 'body': {'resume': {}}} Sep 23 04:50:41.764262 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:50:41.764262 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:41.764262 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:50:41.764262 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:50:41.764262 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:50:41.764262 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:50:41.764262 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 23 04:50:41.764262 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 23 04:50:41.764262 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6dbcbf3c-5453-4e00-84ab-b5232656365a could not be found. Sep 23 04:50:41.764262 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:41.764262 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:50:41.764262 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:41.764262 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:41.764262 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:50:41.764262 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:50:41.764262 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:50:41.764262 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:50:41.764262 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:50:41.764262 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:50:41.764262 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Sep 23 04:50:41.764262 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Sep 23 04:50:41.764262 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:50:41.764262 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:50:41.764262 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6dbcbf3c-5453-4e00-84ab-b5232656365a could not be found. Sep 23 04:50:41.764262 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:41.764262 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:50:41.764262 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:41.764262 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:41.764262 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:50:41.764262 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:50:41.768554 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:50:41.768554 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:50:41.768554 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6dbcbf3c-5453-4e00-84ab-b5232656365a could not be found. Sep 23 04:50:41.768554 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:41.768554 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-12ae8818-3471-4240-a043-efda1309d66b tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Returning 404 to user: Instance 6dbcbf3c-5453-4e00-84ab-b5232656365a could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:50:41.768554 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-12ae8818-3471-4240-a043-efda1309d66b tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "POST /compute/v2.1/servers/6dbcbf3c-5453-4e00-84ab-b5232656365a/action" status: 404 len: 111 microversion: 2.1 time: 0.052821 Sep 23 04:50:41.770530 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2254/4389] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:50:41 2022] POST /compute/v2.1/servers/6dbcbf3c-5453-4e00-84ab-b5232656365a/action => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:50:41.792887 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-cdb036e9-0abb-49df-bdd4-0d777c17f77a tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:41.793516 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-cdb036e9-0abb-49df-bdd4-0d777c17f77a tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 30d846a2-5966-4fae-9515-9d873d882e6b] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:41.813723 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cdb036e9-0abb-49df-bdd4-0d777c17f77a tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:41.818149 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cdb036e9-0abb-49df-bdd4-0d777c17f77a tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:41.822418 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cdb036e9-0abb-49df-bdd4-0d777c17f77a tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:41.827033 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cdb036e9-0abb-49df-bdd4-0d777c17f77a tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:41.833097 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cdb036e9-0abb-49df-bdd4-0d777c17f77a tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:41.840008 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cdb036e9-0abb-49df-bdd4-0d777c17f77a tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:42.016770 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f2b0e7fb-ee8b-43e0-87e3-f5403d6bc143 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.056594 Sep 23 04:50:42.028978 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2136/4390] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:50:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 2069 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:50:42.042789 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c4505b75-3815-4181-995b-f449ea8445b7 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:42.043713 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c4505b75-3815-4181-995b-f449ea8445b7 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:42.052936 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c4505b75-3815-4181-995b-f449ea8445b7 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:42.053686 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c4505b75-3815-4181-995b-f449ea8445b7 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:42.054338 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c4505b75-3815-4181-995b-f449ea8445b7 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:42.055305 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c4505b75-3815-4181-995b-f449ea8445b7 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:42.055994 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c4505b75-3815-4181-995b-f449ea8445b7 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:42.057636 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c4505b75-3815-4181-995b-f449ea8445b7 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:42.311622 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-cdb036e9-0abb-49df-bdd4-0d777c17f77a tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:42.342303 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-cdb036e9-0abb-49df-bdd4-0d777c17f77a tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/30d846a2-5966-4fae-9515-9d873d882e6b" status: 200 len: 1510 microversion: 2.1 time: 0.564257 Sep 23 04:50:42.343492 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2255/4391] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:41 2022] GET /compute/v2.1/servers/30d846a2-5966-4fae-9515-9d873d882e6b => generated 1510 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:42.361572 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c5025818-0ebb-46c3-9b49-c7e28dfac022 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:42.368936 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c5025818-0ebb-46c3-9b49-c7e28dfac022 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: fe7dee09-8351-4d41-8c44-8d35a966cce9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:42.399039 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c5025818-0ebb-46c3-9b49-c7e28dfac022 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:42.399811 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c5025818-0ebb-46c3-9b49-c7e28dfac022 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:42.400427 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c5025818-0ebb-46c3-9b49-c7e28dfac022 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:42.401313 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c5025818-0ebb-46c3-9b49-c7e28dfac022 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:42.405338 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c5025818-0ebb-46c3-9b49-c7e28dfac022 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:42.406359 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c5025818-0ebb-46c3-9b49-c7e28dfac022 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:42.452343 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c4505b75-3815-4181-995b-f449ea8445b7 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:42.464405 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c4505b75-3815-4181-995b-f449ea8445b7 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1503 microversion: 2.1 time: 0.431064 Sep 23 04:50:42.464546 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c5025818-0ebb-46c3-9b49-c7e28dfac022 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.117139 Sep 23 04:50:42.464949 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2137/4392] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:42 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1503 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:42.465077 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2256/4393] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Sep 23 04:50:42 2022] GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 04:50:42.483378 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1a574081-7a85-465e-9ee4-b9a9da31ae41 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:42.483378 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-1a574081-7a85-465e-9ee4-b9a9da31ae41 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] [instance: 1d9dafd4-e427-4349-a142-2c3ed281b2b2] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:42.483820 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e4751585-897a-48d7-b170-789d8448e594 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:42.484547 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e4751585-897a-48d7-b170-789d8448e594 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: c4464422-9bf1-4aaa-806c-d7063e284579] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:42.500610 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e4751585-897a-48d7-b170-789d8448e594 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:42.506443 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e4751585-897a-48d7-b170-789d8448e594 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:42.506926 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e4751585-897a-48d7-b170-789d8448e594 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:42.507773 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e4751585-897a-48d7-b170-789d8448e594 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:42.508443 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e4751585-897a-48d7-b170-789d8448e594 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:42.508894 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e4751585-897a-48d7-b170-789d8448e594 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:42.570029 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-1a574081-7a85-465e-9ee4-b9a9da31ae41 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a52352ab894e8f88be0f9d1cef0b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e32df90da6b43b7b8a562dd95e6833b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:42.576805 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e4751585-897a-48d7-b170-789d8448e594 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.104766 Sep 23 04:50:42.577816 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2257/4394] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Sep 23 04:50:42 2022] GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:50:42.582435 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-1a574081-7a85-465e-9ee4-b9a9da31ae41 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] 10.222.0.33 "GET /compute/v2.1/servers/1d9dafd4-e427-4349-a142-2c3ed281b2b2" status: 200 len: 1213 microversion: 2.1 time: 0.112069 Sep 23 04:50:42.583449 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2138/4395] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:42 2022] GET /compute/v2.1/servers/1d9dafd4-e427-4349-a142-2c3ed281b2b2 => generated 1213 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:42.585819 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c8223458-19b1-44de-a8ad-d8b833dcf085 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:42.586669 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c8223458-19b1-44de-a8ad-d8b833dcf085 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:42.594717 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c8223458-19b1-44de-a8ad-d8b833dcf085 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:42.595403 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c8223458-19b1-44de-a8ad-d8b833dcf085 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:42.596721 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c8223458-19b1-44de-a8ad-d8b833dcf085 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:42.597594 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c8223458-19b1-44de-a8ad-d8b833dcf085 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:42.598356 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c8223458-19b1-44de-a8ad-d8b833dcf085 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:42.598994 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c8223458-19b1-44de-a8ad-d8b833dcf085 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:42.743832 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-da02831c-f988-4b56-a163-45085c681a2c tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:42.744931 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-da02831c-f988-4b56-a163-45085c681a2c tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] [instance: e6610a41-bbef-4646-80f3-82446c38bbf5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:42.756748 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-da02831c-f988-4b56-a163-45085c681a2c tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:42.757372 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-da02831c-f988-4b56-a163-45085c681a2c tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:42.760638 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-da02831c-f988-4b56-a163-45085c681a2c tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:42.761502 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-da02831c-f988-4b56-a163-45085c681a2c tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:42.762221 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-da02831c-f988-4b56-a163-45085c681a2c tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:42.770546 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-da02831c-f988-4b56-a163-45085c681a2c tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:42.778719 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:50:42.886309 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c8223458-19b1-44de-a8ad-d8b833dcf085 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:42.910137 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c8223458-19b1-44de-a8ad-d8b833dcf085 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1503 microversion: 2.1 time: 0.330385 Sep 23 04:50:42.913699 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2258/4396] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:42 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1503 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:42.936849 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9cc00c42-2199-4539-9794-5490f2cc2903 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:50:42.937450 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-9cc00c42-2199-4539-9794-5490f2cc2903 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:42.950571 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9cc00c42-2199-4539-9794-5490f2cc2903 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:42.951081 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9cc00c42-2199-4539-9794-5490f2cc2903 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:42.953074 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9cc00c42-2199-4539-9794-5490f2cc2903 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:42.956217 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9cc00c42-2199-4539-9794-5490f2cc2903 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:42.956909 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9cc00c42-2199-4539-9794-5490f2cc2903 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:42.958251 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9cc00c42-2199-4539-9794-5490f2cc2903 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:43.027788 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-9cc00c42-2199-4539-9794-5490f2cc2903 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] HTTP exception thrown: Cannot 'resume' instance a9f2ff08-c66d-4991-9bae-d523a3adb8bf while it is in vm_state active Sep 23 04:50:43.031068 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9cc00c42-2199-4539-9794-5490f2cc2903 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Request method failure captured: Sep 23 04:50:43.031068 n-d-846463-3 devstack@n-api.service[122699]: request: POST /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf/action HTTP/1.1 Sep 23 04:50:43.031068 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:50:43.031068 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:50:43.031068 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:50:43.031068 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 14 Sep 23 04:50:43.031068 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:50:43.031068 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:50:43.031068 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:50:43.031068 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:50:43.031068 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTrDoGx96bSja4ydTGD-VWXTOyHeLiBA9Lvr197ivKeXqtV3OksEUUEiEPXK85IMwWXM1vCTp1M9PaXnUkKbFev29d-fL5KKXR0MfyGa86SLKINg6u_gn5EQLUNZ8EVLCkU1WwJ7agpVlFY75EyJH0fBcxrNg1yvFbeC2alzdH4Tkmw Sep 23 04:50:43.031068 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:50:43.031068 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:50:43.031068 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:50:43.031068 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:50:43.031068 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:50:43.031068 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:50:43.031068 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 78dca47156ff4f19a8673b893c853978 Sep 23 04:50:43.031068 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:50:43.031068 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:50:43.031068 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:50:43.031068 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_78dca47156ff4f19a8673b893c853978", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/78dca47156ff4f19a8673b893c853978"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/78dca47156ff4f19a8673b893c853978"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/78dca47156ff4f19a8673b893c853978"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:50:43.031068 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:50:43.031068 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 78dca47156ff4f19a8673b893c853978 Sep 23 04:50:43.031068 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:50:43.031068 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ServersNegativeTestJSON-1102187211-project Sep 23 04:50:43.031068 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:50:43.031068 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:50:43.031068 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: c912fb9d1f5447d180a9e8568220526f Sep 23 04:50:43.031068 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ServersNegativeTestJSON-1102187211-project Sep 23 04:50:43.031068 n-d-846463-3 devstack@n-api.service[122699]: Sep 23 04:50:43.031068 n-d-846463-3 devstack@n-api.service[122699]: {"resume": {}} Sep 23 04:50:43.031068 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:50:43.031068 n-d-846463-3 devstack@n-api.service[122699]: exception: Cannot 'resume' instance a9f2ff08-c66d-4991-9bae-d523a3adb8bf while it is in vm_state active Sep 23 04:50:43.031068 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': 'a9f2ff08-c66d-4991-9bae-d523a3adb8bf', 'body': {'resume': {}}} Sep 23 04:50:43.031068 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:50:43.031068 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:43.031068 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Sep 23 04:50:43.031068 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Sep 23 04:50:43.031068 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 23 04:50:43.031068 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 23 04:50:43.031068 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Sep 23 04:50:43.031068 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 23 04:50:43.031068 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 23 04:50:43.031068 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 23 04:50:43.031068 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a9f2ff08-c66d-4991-9bae-d523a3adb8bf in vm_state active. Cannot resume while the instance is in this state. Sep 23 04:50:43.031068 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:43.031068 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:50:43.031068 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:43.031068 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:43.031068 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:50:43.031068 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:50:43.031068 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:50:43.031068 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:50:43.031068 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:50:43.031068 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:50:43.031068 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Sep 23 04:50:43.031068 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 23 04:50:43.031068 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 23 04:50:43.031068 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 23 04:50:43.031068 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance a9f2ff08-c66d-4991-9bae-d523a3adb8bf while it is in vm_state active Sep 23 04:50:43.031068 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:43.031068 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:50:43.031068 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:43.035276 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:43.035276 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:50:43.035276 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:50:43.035276 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:50:43.035276 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:50:43.035276 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance a9f2ff08-c66d-4991-9bae-d523a3adb8bf while it is in vm_state active Sep 23 04:50:43.035276 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:43.035276 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9cc00c42-2199-4539-9794-5490f2cc2903 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Returning 409 to user: Cannot 'resume' instance a9f2ff08-c66d-4991-9bae-d523a3adb8bf while it is in vm_state active {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:50:43.035276 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-9cc00c42-2199-4539-9794-5490f2cc2903 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "POST /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf/action" status: 409 len: 144 microversion: 2.1 time: 0.102601 Sep 23 04:50:43.036823 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2259/4397] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:50:42 2022] POST /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf/action => generated 144 bytes in 105 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 23 04:50:43.055869 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-20258c85-5dcf-4fcc-b4a3-aa9650ceb433 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:43.062540 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-20258c85-5dcf-4fcc-b4a3-aa9650ceb433 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:43.078212 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-20258c85-5dcf-4fcc-b4a3-aa9650ceb433 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:43.083449 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-20258c85-5dcf-4fcc-b4a3-aa9650ceb433 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:43.083999 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-20258c85-5dcf-4fcc-b4a3-aa9650ceb433 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:43.084842 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-20258c85-5dcf-4fcc-b4a3-aa9650ceb433 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:43.085337 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-20258c85-5dcf-4fcc-b4a3-aa9650ceb433 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:43.085776 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-20258c85-5dcf-4fcc-b4a3-aa9650ceb433 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:43.136673 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-da02831c-f988-4b56-a163-45085c681a2c tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d728817c4f74e579eab88b62f73d08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaa3a17b8a24f8087a5748f83d377e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:43.188508 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-da02831c-f988-4b56-a163-45085c681a2c tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] 10.222.0.33 "GET /compute/v2.1/servers/e6610a41-bbef-4646-80f3-82446c38bbf5" status: 200 len: 1699 microversion: 2.1 time: 0.439817 Sep 23 04:50:43.201508 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2139/4398] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:42 2022] GET /compute/v2.1/servers/e6610a41-bbef-4646-80f3-82446c38bbf5 => generated 1699 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:50:43.395221 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-94a3522f-5c65-4413-bbd2-548cc613f7ac tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:43.397768 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-94a3522f-5c65-4413-bbd2-548cc613f7ac tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 30d846a2-5966-4fae-9515-9d873d882e6b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:43.422481 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-94a3522f-5c65-4413-bbd2-548cc613f7ac tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:43.423056 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-94a3522f-5c65-4413-bbd2-548cc613f7ac tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:43.423515 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-94a3522f-5c65-4413-bbd2-548cc613f7ac tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:43.434966 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-94a3522f-5c65-4413-bbd2-548cc613f7ac tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:43.435489 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-94a3522f-5c65-4413-bbd2-548cc613f7ac tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:43.435935 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-94a3522f-5c65-4413-bbd2-548cc613f7ac tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:43.485378 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-20258c85-5dcf-4fcc-b4a3-aa9650ceb433 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:43.497856 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-20258c85-5dcf-4fcc-b4a3-aa9650ceb433 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1503 microversion: 2.1 time: 0.457644 Sep 23 04:50:43.499175 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2260/4399] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:43 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1503 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:43.505271 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ca560baf-ef2b-4760-863d-ea4095378a1b tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:43.510016 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ca560baf-ef2b-4760-863d-ea4095378a1b tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: fe7dee09-8351-4d41-8c44-8d35a966cce9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:43.519353 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ca560baf-ef2b-4760-863d-ea4095378a1b tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:43.520080 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ca560baf-ef2b-4760-863d-ea4095378a1b tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:43.520697 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ca560baf-ef2b-4760-863d-ea4095378a1b tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:43.521565 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ca560baf-ef2b-4760-863d-ea4095378a1b tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:43.522678 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ca560baf-ef2b-4760-863d-ea4095378a1b tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:43.523631 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ca560baf-ef2b-4760-863d-ea4095378a1b tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:43.636063 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ca560baf-ef2b-4760-863d-ea4095378a1b tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.135452 Sep 23 04:50:43.651940 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2261/4400] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Sep 23 04:50:43 2022] GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9/os-volume_attachments => generated 197 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 04:50:43.660366 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3cfd84f5-fe04-4b2d-9dde-4d61032ae52e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:43.664882 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-3cfd84f5-fe04-4b2d-9dde-4d61032ae52e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:43.695100 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3cfd84f5-fe04-4b2d-9dde-4d61032ae52e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:43.695650 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3cfd84f5-fe04-4b2d-9dde-4d61032ae52e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:43.696166 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3cfd84f5-fe04-4b2d-9dde-4d61032ae52e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:43.703102 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3cfd84f5-fe04-4b2d-9dde-4d61032ae52e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:43.705805 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3cfd84f5-fe04-4b2d-9dde-4d61032ae52e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:43.706298 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3cfd84f5-fe04-4b2d-9dde-4d61032ae52e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:43.951575 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-94a3522f-5c65-4413-bbd2-548cc613f7ac tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:43.965497 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-94a3522f-5c65-4413-bbd2-548cc613f7ac tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/30d846a2-5966-4fae-9515-9d873d882e6b" status: 200 len: 1510 microversion: 2.1 time: 0.584660 Sep 23 04:50:43.966272 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2140/4401] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:43 2022] GET /compute/v2.1/servers/30d846a2-5966-4fae-9515-9d873d882e6b => generated 1510 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:43.972616 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e09763c3-ea93-436e-98f4-1e4b39d45ef2 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:43.982494 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e09763c3-ea93-436e-98f4-1e4b39d45ef2 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: c4464422-9bf1-4aaa-806c-d7063e284579] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:43.996252 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e09763c3-ea93-436e-98f4-1e4b39d45ef2 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:44.006677 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e09763c3-ea93-436e-98f4-1e4b39d45ef2 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:44.007407 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e09763c3-ea93-436e-98f4-1e4b39d45ef2 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:44.008345 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e09763c3-ea93-436e-98f4-1e4b39d45ef2 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:44.008968 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e09763c3-ea93-436e-98f4-1e4b39d45ef2 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:44.009561 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e09763c3-ea93-436e-98f4-1e4b39d45ef2 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:44.014601 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-3cfd84f5-fe04-4b2d-9dde-4d61032ae52e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:44.017165 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=100 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:50:44.028343 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3cfd84f5-fe04-4b2d-9dde-4d61032ae52e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1503 microversion: 2.1 time: 0.371537 Sep 23 04:50:44.038733 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2262/4402] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:43 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1503 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:44.055346 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-69514421-6961-4289-bf1e-310e9bab2a72 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:44.056408 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-69514421-6961-4289-bf1e-310e9bab2a72 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] [instance: 1d9dafd4-e427-4349-a142-2c3ed281b2b2] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:44.068158 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-69514421-6961-4289-bf1e-310e9bab2a72 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:44.068158 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-69514421-6961-4289-bf1e-310e9bab2a72 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:44.068158 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-69514421-6961-4289-bf1e-310e9bab2a72 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:44.068158 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-69514421-6961-4289-bf1e-310e9bab2a72 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:44.068158 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-69514421-6961-4289-bf1e-310e9bab2a72 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:44.068158 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-69514421-6961-4289-bf1e-310e9bab2a72 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:44.073106 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e09763c3-ea93-436e-98f4-1e4b39d45ef2 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.105680 Sep 23 04:50:44.073707 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2141/4403] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Sep 23 04:50:43 2022] GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:50:44.139711 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4b277b77-76f6-4a27-b085-626ab7a06c3c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "networks": [{"uuid": "eaa0cbf4-9a92-44f9-ac8d-d8f60e6441c0"}]}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:50:44.144091 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4b277b77-76f6-4a27-b085-626ab7a06c3c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Request method failure captured: Sep 23 04:50:44.144091 n-d-846463-3 devstack@n-api.service[122698]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 23 04:50:44.144091 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:50:44.144091 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:50:44.144091 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:50:44.144091 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 160 Sep 23 04:50:44.144091 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:50:44.144091 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:50:44.144091 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:50:44.144091 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:50:44.144091 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTrDoGx96bSja4ydTGD-VWXTOyHeLiBA9Lvr197ivKeXqtV3OksEUUEiEPXK85IMwWXM1vCTp1M9PaXnUkKbFev29d-fL5KKXR0MfyGa86SLKINg6u_gn5EQLUNZ8EVLCkU1WwJ7agpVlFY75EyJH0fBcxrNg1yvFbeC2alzdH4Tkmw Sep 23 04:50:44.144091 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:50:44.144091 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:50:44.144091 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:50:44.144091 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:50:44.144091 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:50:44.144091 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:50:44.144091 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 78dca47156ff4f19a8673b893c853978 Sep 23 04:50:44.144091 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:50:44.144091 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:50:44.144091 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:50:44.144091 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_78dca47156ff4f19a8673b893c853978", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/78dca47156ff4f19a8673b893c853978"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/78dca47156ff4f19a8673b893c853978"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/78dca47156ff4f19a8673b893c853978"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:50:44.144091 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:50:44.144091 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 78dca47156ff4f19a8673b893c853978 Sep 23 04:50:44.144091 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:50:44.144091 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ServersNegativeTestJSON-1102187211-project Sep 23 04:50:44.144091 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:50:44.144091 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:50:44.144091 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: c912fb9d1f5447d180a9e8568220526f Sep 23 04:50:44.144091 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ServersNegativeTestJSON-1102187211-project Sep 23 04:50:44.144091 n-d-846463-3 devstack@n-api.service[122698]: Sep 23 04:50:44.144091 n-d-846463-3 devstack@n-api.service[122698]: {"server": {"name": "", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "networks": [{"uuid": "eaa0cbf4-9a92-44f9-ac8d-d8f60e6441c0"}]}} Sep 23 04:50:44.144091 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:50:44.144091 n-d-846463-3 devstack@n-api.service[122698]: exception: Invalid input for field/attribute name. Value: . '' is too short Sep 23 04:50:44.144091 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'body': {'server': {'name': '', 'imageRef': 'b8dd79b9-f0b9-43a9-9605-17244137c0ee', 'flavorRef': '452', 'networks': [{'uuid': 'eaa0cbf4-9a92-44f9-ac8d-d8f60e6441c0'}]}}} Sep 23 04:50:44.144091 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:50:44.144091 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:44.144091 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 23 04:50:44.144091 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 23 04:50:44.144091 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 23 04:50:44.144091 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise error Sep 23 04:50:44.144091 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 23 04:50:44.144091 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:50:44.144091 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Sep 23 04:50:44.144091 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 23 04:50:44.144091 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:50:44.144091 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 23 04:50:44.144091 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi '' Sep 23 04:50:44.144091 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:50:44.144091 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:50:44.144091 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:50:44.144091 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:44.144091 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:50:44.144091 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:50:44.144091 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:50:44.144091 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:50:44.144091 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:50:44.144091 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:50:44.144091 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:50:44.144091 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:50:44.144091 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 23 04:50:44.144091 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 23 04:50:44.144091 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 23 04:50:44.144091 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 23 04:50:44.144091 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 23 04:50:44.153602 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 23 04:50:44.153602 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Sep 23 04:50:44.153602 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:50:44.153602 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:50:44.153602 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:50:44.153602 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:44.153602 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:50:44.153602 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:50:44.153602 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 23 04:50:44.153602 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 23 04:50:44.153602 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Sep 23 04:50:44.153602 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:50:44.155251 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-69514421-6961-4289-bf1e-310e9bab2a72 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a52352ab894e8f88be0f9d1cef0b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e32df90da6b43b7b8a562dd95e6833b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:44.155376 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4b277b77-76f6-4a27-b085-626ab7a06c3c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:50:44.155666 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4b277b77-76f6-4a27-b085-626ab7a06c3c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.020161 Sep 23 04:50:44.161906 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2142/4404] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:50:44 2022] POST /compute/v2.1/servers => generated 108 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 04:50:44.166944 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8741197b-c18c-4e5c-bcda-4481dd05774f tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:44.175970 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8741197b-c18c-4e5c-bcda-4481dd05774f tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:44.181372 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-69514421-6961-4289-bf1e-310e9bab2a72 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] 10.222.0.33 "GET /compute/v2.1/servers/1d9dafd4-e427-4349-a142-2c3ed281b2b2" status: 200 len: 1217 microversion: 2.1 time: 0.141247 Sep 23 04:50:44.195275 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2263/4405] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:44 2022] GET /compute/v2.1/servers/1d9dafd4-e427-4349-a142-2c3ed281b2b2 => generated 1217 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:44.196563 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8741197b-c18c-4e5c-bcda-4481dd05774f tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:44.197228 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8741197b-c18c-4e5c-bcda-4481dd05774f tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:44.197977 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8741197b-c18c-4e5c-bcda-4481dd05774f tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:44.198855 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8741197b-c18c-4e5c-bcda-4481dd05774f tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:44.206446 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8741197b-c18c-4e5c-bcda-4481dd05774f tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:44.206941 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8741197b-c18c-4e5c-bcda-4481dd05774f tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:44.226220 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1c29ed01-fd4c-49f2-82db-88d18e3bc5ad tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:44.231011 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1c29ed01-fd4c-49f2-82db-88d18e3bc5ad tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] [instance: e6610a41-bbef-4646-80f3-82446c38bbf5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:44.243854 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1c29ed01-fd4c-49f2-82db-88d18e3bc5ad tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:44.246895 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1c29ed01-fd4c-49f2-82db-88d18e3bc5ad tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:44.247367 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1c29ed01-fd4c-49f2-82db-88d18e3bc5ad tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:44.250555 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1c29ed01-fd4c-49f2-82db-88d18e3bc5ad tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:44.251164 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1c29ed01-fd4c-49f2-82db-88d18e3bc5ad tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:44.251627 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1c29ed01-fd4c-49f2-82db-88d18e3bc5ad tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:44.498495 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1c29ed01-fd4c-49f2-82db-88d18e3bc5ad tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d728817c4f74e579eab88b62f73d08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaa3a17b8a24f8087a5748f83d377e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:44.524019 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1c29ed01-fd4c-49f2-82db-88d18e3bc5ad tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] 10.222.0.33 "GET /compute/v2.1/servers/e6610a41-bbef-4646-80f3-82446c38bbf5" status: 200 len: 1631 microversion: 2.1 time: 0.302099 Sep 23 04:50:44.538006 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2264/4406] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:44 2022] GET /compute/v2.1/servers/e6610a41-bbef-4646-80f3-82446c38bbf5 => generated 1631 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:44.545623 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-92b0a750-c84e-4103-b999-71826692ff80 req-865beb5c-b978-4309-a8e7-72ac7835d79b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6610a41-bbef-4646-80f3-82446c38bbf5", "name": "network-vif-deleted", "tag": "976d0405-5d6c-4b74-9881-61506bb68a99"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:50:44.569949 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-92b0a750-c84e-4103-b999-71826692ff80 req-865beb5c-b978-4309-a8e7-72ac7835d79b service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:44.570442 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-92b0a750-c84e-4103-b999-71826692ff80 req-865beb5c-b978-4309-a8e7-72ac7835d79b service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:44.570869 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-92b0a750-c84e-4103-b999-71826692ff80 req-865beb5c-b978-4309-a8e7-72ac7835d79b service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:44.594449 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8741197b-c18c-4e5c-bcda-4481dd05774f tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:44.600130 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-92b0a750-c84e-4103-b999-71826692ff80 req-865beb5c-b978-4309-a8e7-72ac7835d79b service nova] Creating event network-vif-deleted:976d0405-5d6c-4b74-9881-61506bb68a99 for instance e6610a41-bbef-4646-80f3-82446c38bbf5 on n-h2-846463-3 Sep 23 04:50:44.615416 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8741197b-c18c-4e5c-bcda-4481dd05774f tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1503 microversion: 2.1 time: 0.450935 Sep 23 04:50:44.615709 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-92b0a750-c84e-4103-b999-71826692ff80 req-865beb5c-b978-4309-a8e7-72ac7835d79b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085818 Sep 23 04:50:44.617664 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2143/4407] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:44 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1503 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:44.619885 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2265/4408] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:50:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:50:44.648085 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-22cce68e-edd9-4e67-a56a-56730d8d8708 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:44.649066 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-22cce68e-edd9-4e67-a56a-56730d8d8708 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:44.651740 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c63c6f01-c7e6-4ad2-ab65-ff3509efb4da tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:44.654115 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c63c6f01-c7e6-4ad2-ab65-ff3509efb4da tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: fe7dee09-8351-4d41-8c44-8d35a966cce9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:44.657097 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-22cce68e-edd9-4e67-a56a-56730d8d8708 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:44.658891 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-22cce68e-edd9-4e67-a56a-56730d8d8708 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:44.664737 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-22cce68e-edd9-4e67-a56a-56730d8d8708 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:44.665861 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-22cce68e-edd9-4e67-a56a-56730d8d8708 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:44.666568 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-22cce68e-edd9-4e67-a56a-56730d8d8708 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:44.670738 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-22cce68e-edd9-4e67-a56a-56730d8d8708 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:44.673857 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c63c6f01-c7e6-4ad2-ab65-ff3509efb4da tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:44.674401 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c63c6f01-c7e6-4ad2-ab65-ff3509efb4da tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:44.674854 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c63c6f01-c7e6-4ad2-ab65-ff3509efb4da tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:44.675575 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c63c6f01-c7e6-4ad2-ab65-ff3509efb4da tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:44.676040 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c63c6f01-c7e6-4ad2-ab65-ff3509efb4da tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:44.676476 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c63c6f01-c7e6-4ad2-ab65-ff3509efb4da tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:44.792603 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c63c6f01-c7e6-4ad2-ab65-ff3509efb4da tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.145190 Sep 23 04:50:44.801149 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2266/4409] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Sep 23 04:50:44 2022] GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9/os-volume_attachments => generated 25 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:50:44.898056 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-22cce68e-edd9-4e67-a56a-56730d8d8708 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:44.910348 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-22cce68e-edd9-4e67-a56a-56730d8d8708 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1503 microversion: 2.1 time: 0.268567 Sep 23 04:50:44.910957 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2144/4410] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:44 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1503 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:44.938815 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-35ea0126-3860-4678-8c48-0440a2d57663 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:50:44.940089 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-35ea0126-3860-4678-8c48-0440a2d57663 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: c6508903-f40a-4597-928e-d7743f98fb6a] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:44.948925 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-35ea0126-3860-4678-8c48-0440a2d57663 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] HTTP exception thrown: Instance c6508903-f40a-4597-928e-d7743f98fb6a could not be found. Sep 23 04:50:44.958342 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-35ea0126-3860-4678-8c48-0440a2d57663 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Request method failure captured: Sep 23 04:50:44.958342 n-d-846463-3 devstack@n-api.service[122699]: request: POST /compute/v2.1/servers/c6508903-f40a-4597-928e-d7743f98fb6a/action HTTP/1.1 Sep 23 04:50:44.958342 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:50:44.958342 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:50:44.958342 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:50:44.958342 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 14 Sep 23 04:50:44.958342 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:50:44.958342 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:50:44.958342 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:50:44.958342 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:50:44.958342 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTrDoGx96bSja4ydTGD-VWXTOyHeLiBA9Lvr197ivKeXqtV3OksEUUEiEPXK85IMwWXM1vCTp1M9PaXnUkKbFev29d-fL5KKXR0MfyGa86SLKINg6u_gn5EQLUNZ8EVLCkU1WwJ7agpVlFY75EyJH0fBcxrNg1yvFbeC2alzdH4Tkmw Sep 23 04:50:44.958342 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:50:44.958342 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:50:44.958342 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:50:44.958342 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:50:44.958342 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:50:44.958342 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:50:44.958342 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 78dca47156ff4f19a8673b893c853978 Sep 23 04:50:44.958342 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:50:44.958342 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:50:44.958342 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:50:44.958342 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_78dca47156ff4f19a8673b893c853978", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/78dca47156ff4f19a8673b893c853978"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/78dca47156ff4f19a8673b893c853978"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/78dca47156ff4f19a8673b893c853978"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:50:44.958342 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:50:44.958342 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 78dca47156ff4f19a8673b893c853978 Sep 23 04:50:44.958342 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:50:44.958342 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ServersNegativeTestJSON-1102187211-project Sep 23 04:50:44.958342 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:50:44.958342 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:50:44.958342 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: c912fb9d1f5447d180a9e8568220526f Sep 23 04:50:44.958342 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ServersNegativeTestJSON-1102187211-project Sep 23 04:50:44.958342 n-d-846463-3 devstack@n-api.service[122699]: Sep 23 04:50:44.958342 n-d-846463-3 devstack@n-api.service[122699]: {"shelve": {}} Sep 23 04:50:44.958342 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:50:44.958342 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance c6508903-f40a-4597-928e-d7743f98fb6a could not be found. Sep 23 04:50:44.958342 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': 'c6508903-f40a-4597-928e-d7743f98fb6a', 'body': {'shelve': {}}} Sep 23 04:50:44.958342 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:50:44.958342 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:44.958342 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:50:44.958342 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:50:44.958342 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:50:44.958342 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:50:44.958342 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 23 04:50:44.958342 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 23 04:50:44.958342 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6508903-f40a-4597-928e-d7743f98fb6a could not be found. Sep 23 04:50:44.958342 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:44.958342 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:50:44.958342 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:44.958342 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:44.958342 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:50:44.958342 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:50:44.958342 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:50:44.958342 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:50:44.958342 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:50:44.958342 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:50:44.958342 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Sep 23 04:50:44.958342 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 23 04:50:44.958342 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:50:44.958342 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:50:44.958342 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6508903-f40a-4597-928e-d7743f98fb6a could not be found. Sep 23 04:50:44.958342 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:44.958342 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:50:44.958342 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:44.958342 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:44.958342 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:50:44.958342 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:50:44.966324 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:50:44.966324 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:50:44.966324 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6508903-f40a-4597-928e-d7743f98fb6a could not be found. Sep 23 04:50:44.966324 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:44.966324 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-35ea0126-3860-4678-8c48-0440a2d57663 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Returning 404 to user: Instance c6508903-f40a-4597-928e-d7743f98fb6a could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:50:44.966324 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-35ea0126-3860-4678-8c48-0440a2d57663 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "POST /compute/v2.1/servers/c6508903-f40a-4597-928e-d7743f98fb6a/action" status: 404 len: 111 microversion: 2.1 time: 0.025081 Sep 23 04:50:44.966324 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2267/4411] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:50:44 2022] POST /compute/v2.1/servers/c6508903-f40a-4597-928e-d7743f98fb6a/action => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 04:50:44.970781 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f5bcbe75-5524-4b4d-880c-dbb92a7ab1f8 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:44.971417 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f5bcbe75-5524-4b4d-880c-dbb92a7ab1f8 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:44.980153 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f5bcbe75-5524-4b4d-880c-dbb92a7ab1f8 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:44.983461 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f5bcbe75-5524-4b4d-880c-dbb92a7ab1f8 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:44.983461 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f5bcbe75-5524-4b4d-880c-dbb92a7ab1f8 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:44.983632 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f5bcbe75-5524-4b4d-880c-dbb92a7ab1f8 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:44.984033 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f5bcbe75-5524-4b4d-880c-dbb92a7ab1f8 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:44.984490 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f5bcbe75-5524-4b4d-880c-dbb92a7ab1f8 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:44.987173 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-05b322b8-7793-46b8-bc84-c7b159aae6d3 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:44.987702 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-05b322b8-7793-46b8-bc84-c7b159aae6d3 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: fe7dee09-8351-4d41-8c44-8d35a966cce9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:44.999796 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-05b322b8-7793-46b8-bc84-c7b159aae6d3 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:45.000310 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-05b322b8-7793-46b8-bc84-c7b159aae6d3 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:45.000767 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-05b322b8-7793-46b8-bc84-c7b159aae6d3 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:45.001496 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-05b322b8-7793-46b8-bc84-c7b159aae6d3 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:45.002518 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-05b322b8-7793-46b8-bc84-c7b159aae6d3 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:45.002962 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-05b322b8-7793-46b8-bc84-c7b159aae6d3 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:45.075843 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-05b322b8-7793-46b8-bc84-c7b159aae6d3 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: fe7dee09-8351-4d41-8c44-8d35a966cce9] Going to try to terminate instance {{(pid=122699) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:50:45.213343 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f5bcbe75-5524-4b4d-880c-dbb92a7ab1f8 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:45.237400 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f5bcbe75-5524-4b4d-880c-dbb92a7ab1f8 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1503 microversion: 2.1 time: 0.272193 Sep 23 04:50:45.239147 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2145/4412] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:44 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1503 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:45.253236 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5b20dbd7-1d53-446b-9bfc-3e9d7affd858 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:45.255476 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5b20dbd7-1d53-446b-9bfc-3e9d7affd858 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 30d846a2-5966-4fae-9515-9d873d882e6b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:45.281944 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5b20dbd7-1d53-446b-9bfc-3e9d7affd858 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:45.282933 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5b20dbd7-1d53-446b-9bfc-3e9d7affd858 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:45.283785 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5b20dbd7-1d53-446b-9bfc-3e9d7affd858 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:45.288480 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5b20dbd7-1d53-446b-9bfc-3e9d7affd858 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:45.289721 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5b20dbd7-1d53-446b-9bfc-3e9d7affd858 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:45.291830 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5b20dbd7-1d53-446b-9bfc-3e9d7affd858 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:45.474272 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-05b322b8-7793-46b8-bc84-c7b159aae6d3 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "DELETE /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9" status: 204 len: 0 microversion: 2.20 time: 0.498904 Sep 23 04:50:45.474867 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2268/4413] 10.222.0.33 () {60 vars in 1280 bytes} [Fri Sep 23 04:50:44 2022] DELETE /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 23 04:50:45.483877 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-18f34a5c-709f-4756-9cd9-3719bc4a455d tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:45.499230 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-18f34a5c-709f-4756-9cd9-3719bc4a455d tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: c4464422-9bf1-4aaa-806c-d7063e284579] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:45.507771 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-18f34a5c-709f-4756-9cd9-3719bc4a455d tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:45.508280 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-18f34a5c-709f-4756-9cd9-3719bc4a455d tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:45.511933 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-18f34a5c-709f-4756-9cd9-3719bc4a455d tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:45.518542 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-18f34a5c-709f-4756-9cd9-3719bc4a455d tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:45.519267 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-18f34a5c-709f-4756-9cd9-3719bc4a455d tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:45.519721 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-18f34a5c-709f-4756-9cd9-3719bc4a455d tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:45.590197 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-18f34a5c-709f-4756-9cd9-3719bc4a455d tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.113872 Sep 23 04:50:45.594958 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2269/4414] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Sep 23 04:50:45 2022] GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:50:45.611879 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5423fb8c-ed6e-4721-a382-afbc9550f0ca tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:45.612928 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-5423fb8c-ed6e-4721-a382-afbc9550f0ca tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] [instance: 1d9dafd4-e427-4349-a142-2c3ed281b2b2] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:45.622910 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5423fb8c-ed6e-4721-a382-afbc9550f0ca tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:45.623664 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5423fb8c-ed6e-4721-a382-afbc9550f0ca tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:45.640040 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5423fb8c-ed6e-4721-a382-afbc9550f0ca tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:45.640040 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5423fb8c-ed6e-4721-a382-afbc9550f0ca tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:45.640040 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5423fb8c-ed6e-4721-a382-afbc9550f0ca tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:45.640040 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5423fb8c-ed6e-4721-a382-afbc9550f0ca tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:45.754215 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-5423fb8c-ed6e-4721-a382-afbc9550f0ca tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a52352ab894e8f88be0f9d1cef0b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e32df90da6b43b7b8a562dd95e6833b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:45.772516 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-5b20dbd7-1d53-446b-9bfc-3e9d7affd858 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:45.781245 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5b20dbd7-1d53-446b-9bfc-3e9d7affd858 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/30d846a2-5966-4fae-9515-9d873d882e6b" status: 200 len: 1510 microversion: 2.1 time: 0.540798 Sep 23 04:50:45.783893 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5423fb8c-ed6e-4721-a382-afbc9550f0ca tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] 10.222.0.33 "GET /compute/v2.1/servers/1d9dafd4-e427-4349-a142-2c3ed281b2b2" status: 200 len: 1273 microversion: 2.1 time: 0.186639 Sep 23 04:50:45.784652 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2270/4415] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:45 2022] GET /compute/v2.1/servers/1d9dafd4-e427-4349-a142-2c3ed281b2b2 => generated 1273 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:45.787011 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2146/4416] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:45 2022] GET /compute/v2.1/servers/30d846a2-5966-4fae-9515-9d873d882e6b => generated 1510 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:45.800284 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3a160c71-711b-4217-95c3-295df7d35168 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:45.800938 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-3a160c71-711b-4217-95c3-295df7d35168 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:45.805379 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8ce51931-fa9f-446e-8a0f-014c2fcf38c9 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:45.806053 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8ce51931-fa9f-446e-8a0f-014c2fcf38c9 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: fe7dee09-8351-4d41-8c44-8d35a966cce9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:45.817444 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3a160c71-711b-4217-95c3-295df7d35168 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:45.822439 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8ce51931-fa9f-446e-8a0f-014c2fcf38c9 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:45.823156 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8ce51931-fa9f-446e-8a0f-014c2fcf38c9 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:45.824242 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8ce51931-fa9f-446e-8a0f-014c2fcf38c9 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:45.825032 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3a160c71-711b-4217-95c3-295df7d35168 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:45.825480 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3a160c71-711b-4217-95c3-295df7d35168 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:45.826347 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3a160c71-711b-4217-95c3-295df7d35168 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:45.826807 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3a160c71-711b-4217-95c3-295df7d35168 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:45.827234 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3a160c71-711b-4217-95c3-295df7d35168 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:45.830334 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8ce51931-fa9f-446e-8a0f-014c2fcf38c9 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:45.830805 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8ce51931-fa9f-446e-8a0f-014c2fcf38c9 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:45.831246 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8ce51931-fa9f-446e-8a0f-014c2fcf38c9 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:46.297574 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-3a160c71-711b-4217-95c3-295df7d35168 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:46.318921 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3a160c71-711b-4217-95c3-295df7d35168 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1503 microversion: 2.1 time: 0.532221 Sep 23 04:50:46.339575 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2271/4417] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:45 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1503 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:46.351778 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8ce51931-fa9f-446e-8a0f-014c2fcf38c9 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:46.354869 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-fb89fa7f-febb-4465-9847-53b07cf2c13d tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:46.360465 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-fb89fa7f-febb-4465-9847-53b07cf2c13d tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] [instance: e6610a41-bbef-4646-80f3-82446c38bbf5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:46.381150 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fb89fa7f-febb-4465-9847-53b07cf2c13d tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:46.381722 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fb89fa7f-febb-4465-9847-53b07cf2c13d tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:46.383633 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fb89fa7f-febb-4465-9847-53b07cf2c13d tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:46.384421 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fb89fa7f-febb-4465-9847-53b07cf2c13d tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:46.387098 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8ce51931-fa9f-446e-8a0f-014c2fcf38c9 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:46.387878 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fb89fa7f-febb-4465-9847-53b07cf2c13d tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:46.388578 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fb89fa7f-febb-4465-9847-53b07cf2c13d tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:46.392136 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8ce51931-fa9f-446e-8a0f-014c2fcf38c9 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:46.396266 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8ce51931-fa9f-446e-8a0f-014c2fcf38c9 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9" status: 200 len: 1724 microversion: 2.20 time: 0.606907 Sep 23 04:50:46.398890 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2147/4418] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:50:45 2022] GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9 => generated 1724 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:50:46.414157 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1c89e0ae-9f30-44b9-86dd-b4b221b47f09 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:50:46.414996 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-1c89e0ae-9f30-44b9-86dd-b4b221b47f09 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:46.434195 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1c89e0ae-9f30-44b9-86dd-b4b221b47f09 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:46.436138 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1c89e0ae-9f30-44b9-86dd-b4b221b47f09 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:46.437158 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1c89e0ae-9f30-44b9-86dd-b4b221b47f09 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:46.438422 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1c89e0ae-9f30-44b9-86dd-b4b221b47f09 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:46.439297 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1c89e0ae-9f30-44b9-86dd-b4b221b47f09 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:46.439987 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1c89e0ae-9f30-44b9-86dd-b4b221b47f09 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:46.468885 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fb89fa7f-febb-4465-9847-53b07cf2c13d tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:46.469703 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fb89fa7f-febb-4465-9847-53b07cf2c13d tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:46.470290 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-1c89e0ae-9f30-44b9-86dd-b4b221b47f09 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lazy-loading 'flavor' on Instance uuid a9f2ff08-c66d-4991-9bae-d523a3adb8bf {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:50:46.470524 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fb89fa7f-febb-4465-9847-53b07cf2c13d tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:46.472129 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-fb89fa7f-febb-4465-9847-53b07cf2c13d tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Lazy-loading 'fault' on Instance uuid e6610a41-bbef-4646-80f3-82446c38bbf5 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:50:46.551182 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-fb89fa7f-febb-4465-9847-53b07cf2c13d tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d728817c4f74e579eab88b62f73d08b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaa3a17b8a24f8087a5748f83d377e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:46.560420 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-fb89fa7f-febb-4465-9847-53b07cf2c13d tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] 10.222.0.33 "GET /compute/v2.1/servers/e6610a41-bbef-4646-80f3-82446c38bbf5" status: 200 len: 1359 microversion: 2.1 time: 0.217040 Sep 23 04:50:46.566500 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2272/4419] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:46 2022] GET /compute/v2.1/servers/e6610a41-bbef-4646-80f3-82446c38bbf5 => generated 1359 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:46.607016 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e4429cc1-d1ab-45ea-bb51-a7dfd823688f tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:46.609637 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e4429cc1-d1ab-45ea-bb51-a7dfd823688f tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: c4464422-9bf1-4aaa-806c-d7063e284579] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:46.625733 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e4429cc1-d1ab-45ea-bb51-a7dfd823688f tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:46.627640 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e4429cc1-d1ab-45ea-bb51-a7dfd823688f tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:46.627640 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e4429cc1-d1ab-45ea-bb51-a7dfd823688f tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:46.638419 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e4429cc1-d1ab-45ea-bb51-a7dfd823688f tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:46.638934 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e4429cc1-d1ab-45ea-bb51-a7dfd823688f tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:46.639391 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e4429cc1-d1ab-45ea-bb51-a7dfd823688f tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:46.698274 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e4429cc1-d1ab-45ea-bb51-a7dfd823688f tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094975 Sep 23 04:50:46.700373 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2273/4420] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Sep 23 04:50:46 2022] GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:50:46.823090 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1cc6bb63-b527-4f64-8fee-e601556337a9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:46.823737 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1cc6bb63-b527-4f64-8fee-e601556337a9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 30d846a2-5966-4fae-9515-9d873d882e6b] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:46.845999 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1cc6bb63-b527-4f64-8fee-e601556337a9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:46.846564 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1cc6bb63-b527-4f64-8fee-e601556337a9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:46.847030 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1cc6bb63-b527-4f64-8fee-e601556337a9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:46.851141 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1cc6bb63-b527-4f64-8fee-e601556337a9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:46.851731 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1cc6bb63-b527-4f64-8fee-e601556337a9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:46.852194 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1cc6bb63-b527-4f64-8fee-e601556337a9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:47.256642 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-1c89e0ae-9f30-44b9-86dd-b4b221b47f09 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "POST /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf/action" status: 202 len: 0 microversion: 2.1 time: 0.856142 Sep 23 04:50:47.257262 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2148/4421] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:50:46 2022] POST /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf/action => generated 0 bytes in 858 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:50:47.262088 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:50:47.267020 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5ae4d92e-293a-4cf6-bb23-7b817b025885 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:47.267765 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5ae4d92e-293a-4cf6-bb23-7b817b025885 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] [instance: 1d9dafd4-e427-4349-a142-2c3ed281b2b2] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:47.281773 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5ae4d92e-293a-4cf6-bb23-7b817b025885 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:47.282315 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5ae4d92e-293a-4cf6-bb23-7b817b025885 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:47.282782 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5ae4d92e-293a-4cf6-bb23-7b817b025885 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:47.284066 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5ae4d92e-293a-4cf6-bb23-7b817b025885 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:47.284522 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5ae4d92e-293a-4cf6-bb23-7b817b025885 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:47.284950 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5ae4d92e-293a-4cf6-bb23-7b817b025885 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:47.571583 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1cc6bb63-b527-4f64-8fee-e601556337a9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:47.584010 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1cc6bb63-b527-4f64-8fee-e601556337a9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/30d846a2-5966-4fae-9515-9d873d882e6b" status: 200 len: 1510 microversion: 2.1 time: 0.767219 Sep 23 04:50:47.585063 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2274/4422] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:46 2022] GET /compute/v2.1/servers/30d846a2-5966-4fae-9515-9d873d882e6b => generated 1510 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:50:47.593080 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8efba334-794f-4f05-b0d9-395a32f8f8fc tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:47.596173 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-8efba334-794f-4f05-b0d9-395a32f8f8fc tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:47.612435 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8efba334-794f-4f05-b0d9-395a32f8f8fc tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:47.613059 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8efba334-794f-4f05-b0d9-395a32f8f8fc tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:47.613600 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8efba334-794f-4f05-b0d9-395a32f8f8fc tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:47.614480 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8efba334-794f-4f05-b0d9-395a32f8f8fc tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:47.616146 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8efba334-794f-4f05-b0d9-395a32f8f8fc tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:47.619102 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8efba334-794f-4f05-b0d9-395a32f8f8fc tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:47.879955 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-5ae4d92e-293a-4cf6-bb23-7b817b025885 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a52352ab894e8f88be0f9d1cef0b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e32df90da6b43b7b8a562dd95e6833b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:47.892241 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5ae4d92e-293a-4cf6-bb23-7b817b025885 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] 10.222.0.33 "GET /compute/v2.1/servers/1d9dafd4-e427-4349-a142-2c3ed281b2b2" status: 200 len: 1313 microversion: 2.1 time: 0.633503 Sep 23 04:50:47.893438 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2149/4423] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:47 2022] GET /compute/v2.1/servers/1d9dafd4-e427-4349-a142-2c3ed281b2b2 => generated 1313 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:47.900817 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a490523b-c76e-4ea0-aa6c-2e3daf9e143a tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:47.901633 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a490523b-c76e-4ea0-aa6c-2e3daf9e143a tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: fe7dee09-8351-4d41-8c44-8d35a966cce9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:47.919602 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a490523b-c76e-4ea0-aa6c-2e3daf9e143a tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:47.920283 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a490523b-c76e-4ea0-aa6c-2e3daf9e143a tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:47.920757 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a490523b-c76e-4ea0-aa6c-2e3daf9e143a tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:47.921801 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a490523b-c76e-4ea0-aa6c-2e3daf9e143a tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:47.922605 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a490523b-c76e-4ea0-aa6c-2e3daf9e143a tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:47.924677 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a490523b-c76e-4ea0-aa6c-2e3daf9e143a tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:48.208619 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-8efba334-794f-4f05-b0d9-395a32f8f8fc tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:48.217652 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-8efba334-794f-4f05-b0d9-395a32f8f8fc tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1509 microversion: 2.1 time: 0.631432 Sep 23 04:50:48.225144 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2275/4424] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:47 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1509 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:48.242969 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b8d373ac-4367-48de-9ccd-079026195918 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:48.243836 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b8d373ac-4367-48de-9ccd-079026195918 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] [instance: e6610a41-bbef-4646-80f3-82446c38bbf5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:48.257480 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b8d373ac-4367-48de-9ccd-079026195918 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:48.258973 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b8d373ac-4367-48de-9ccd-079026195918 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:48.259666 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b8d373ac-4367-48de-9ccd-079026195918 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:48.261451 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b8d373ac-4367-48de-9ccd-079026195918 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:48.262145 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b8d373ac-4367-48de-9ccd-079026195918 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:48.262725 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b8d373ac-4367-48de-9ccd-079026195918 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:48.287249 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-b8d373ac-4367-48de-9ccd-079026195918 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] HTTP exception thrown: Instance e6610a41-bbef-4646-80f3-82446c38bbf5 could not be found. Sep 23 04:50:48.303188 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b8d373ac-4367-48de-9ccd-079026195918 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Request method failure captured: Sep 23 04:50:48.303188 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/e6610a41-bbef-4646-80f3-82446c38bbf5 HTTP/1.1 Sep 23 04:50:48.303188 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:50:48.303188 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:50:48.303188 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:50:48.303188 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:50:48.303188 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:50:48.303188 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:50:48.303188 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:50:48.303188 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:50:48.303188 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTrJ7gIQdigyZ6RB-ImuQ83fP6jOMVj8lfVLwdU5dyEuLcSATw-fEcWRtw_vzDh1j06K5wUQoJYDozO0ofrHTMF-P-J6BXCG8qwnawbSNeSyY8mSyedb-6-GzAa8NE7OF4EIlOmZmdDFpTrJp2KnKR7BZga0gQyRKYht9H9Ndvm9l38 Sep 23 04:50:48.303188 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:50:48.303188 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:50:48.303188 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:50:48.303188 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:50:48.303188 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:50:48.303188 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:50:48.303188 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: dbaa3a17b8a24f8087a5748f83d377e7 Sep 23 04:50:48.303188 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ServersTestJSON-1273896309 Sep 23 04:50:48.303188 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:50:48.303188 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:50:48.303188 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_dbaa3a17b8a24f8087a5748f83d377e7", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dbaa3a17b8a24f8087a5748f83d377e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/dbaa3a17b8a24f8087a5748f83d377e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dbaa3a17b8a24f8087a5748f83d377e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:50:48.303188 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ServersTestJSON-1273896309 Sep 23 04:50:48.303188 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: dbaa3a17b8a24f8087a5748f83d377e7 Sep 23 04:50:48.303188 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ServersTestJSON-1273896309 Sep 23 04:50:48.303188 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ServersTestJSON-1273896309-project Sep 23 04:50:48.303188 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:50:48.303188 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:50:48.303188 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 8d728817c4f74e579eab88b62f73d08b Sep 23 04:50:48.303188 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ServersTestJSON-1273896309-project Sep 23 04:50:48.303188 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:50:48.303188 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance e6610a41-bbef-4646-80f3-82446c38bbf5 could not be found. Sep 23 04:50:48.303188 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': 'e6610a41-bbef-4646-80f3-82446c38bbf5'} Sep 23 04:50:48.303188 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:50:48.303188 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:48.303188 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:50:48.303188 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:50:48.303188 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:50:48.303188 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:50:48.303188 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:50:48.303188 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:50:48.303188 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:50:48.303188 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:50:48.303188 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6610a41-bbef-4646-80f3-82446c38bbf5 could not be found. Sep 23 04:50:48.303188 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:48.303188 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:50:48.303188 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:48.303188 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:48.303188 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:50:48.303188 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:50:48.303188 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:50:48.303188 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:50:48.303188 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:50:48.303188 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:50:48.303188 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:50:48.303188 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:50:48.303188 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:50:48.303188 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:50:48.303188 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:50:48.303188 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:50:48.303188 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6610a41-bbef-4646-80f3-82446c38bbf5 could not be found. Sep 23 04:50:48.303188 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:48.303188 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:50:48.303188 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:48.307801 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:48.307801 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:50:48.307801 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:50:48.307801 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:50:48.307801 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:50:48.307801 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6610a41-bbef-4646-80f3-82446c38bbf5 could not be found. Sep 23 04:50:48.307801 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:48.309532 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b8d373ac-4367-48de-9ccd-079026195918 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Returning 404 to user: Instance e6610a41-bbef-4646-80f3-82446c38bbf5 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:50:48.311754 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b8d373ac-4367-48de-9ccd-079026195918 tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] 10.222.0.33 "GET /compute/v2.1/servers/e6610a41-bbef-4646-80f3-82446c38bbf5" status: 404 len: 111 microversion: 2.1 time: 0.084108 Sep 23 04:50:48.313191 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2276/4425] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:48 2022] GET /compute/v2.1/servers/e6610a41-bbef-4646-80f3-82446c38bbf5 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:50:48.344539 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-50c622ca-4384-4910-a85d-9b0eb2777edd tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:48.350294 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-50c622ca-4384-4910-a85d-9b0eb2777edd tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: c4464422-9bf1-4aaa-806c-d7063e284579] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:48.362351 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-50c622ca-4384-4910-a85d-9b0eb2777edd tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:48.362922 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-50c622ca-4384-4910-a85d-9b0eb2777edd tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:48.363371 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-50c622ca-4384-4910-a85d-9b0eb2777edd tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:48.381843 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-50c622ca-4384-4910-a85d-9b0eb2777edd tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:48.381843 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-50c622ca-4384-4910-a85d-9b0eb2777edd tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:48.381843 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-50c622ca-4384-4910-a85d-9b0eb2777edd tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:48.400741 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-50c622ca-4384-4910-a85d-9b0eb2777edd tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084141 Sep 23 04:50:48.402290 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2277/4426] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Sep 23 04:50:48 2022] GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:50:48.425134 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0173dd40-4582-49e3-8f60-0c2277f813be tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] Calling method '.version_select at 0x7ff1bb733040>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:48.471350 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a490523b-c76e-4ea0-aa6c-2e3daf9e143a tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:48.515474 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0173dd40-4582-49e3-8f60-0c2277f813be tempest-ServersTestJSON-1273896309 tempest-ServersTestJSON-1273896309-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1226867454" status: 202 len: 0 microversion: 2.1 time: 0.112051 Sep 23 04:50:48.516254 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2278/4427] 10.222.0.33 () {58 vars in 1221 bytes} [Fri Sep 23 04:50:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1226867454 => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:50:48.524530 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a490523b-c76e-4ea0-aa6c-2e3daf9e143a tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:48.531560 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a490523b-c76e-4ea0-aa6c-2e3daf9e143a tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:48.536971 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a490523b-c76e-4ea0-aa6c-2e3daf9e143a tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9" status: 200 len: 1724 microversion: 2.20 time: 0.638051 Sep 23 04:50:48.539896 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2150/4428] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:50:47 2022] GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9 => generated 1724 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:50:48.611369 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-337076e5-569e-4bee-ab31-2c9edd2e6db5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:48.612985 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-337076e5-569e-4bee-ab31-2c9edd2e6db5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 30d846a2-5966-4fae-9515-9d873d882e6b] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:48.657403 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-337076e5-569e-4bee-ab31-2c9edd2e6db5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:48.661555 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-337076e5-569e-4bee-ab31-2c9edd2e6db5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:48.662223 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-337076e5-569e-4bee-ab31-2c9edd2e6db5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:48.663162 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-337076e5-569e-4bee-ab31-2c9edd2e6db5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:48.663841 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-337076e5-569e-4bee-ab31-2c9edd2e6db5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:48.664941 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-337076e5-569e-4bee-ab31-2c9edd2e6db5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:48.919597 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-78019ba3-6607-4d05-b11f-13cdf6c3c29c tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:48.920128 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-78019ba3-6607-4d05-b11f-13cdf6c3c29c tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] [instance: 1d9dafd4-e427-4349-a142-2c3ed281b2b2] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:48.934843 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-78019ba3-6607-4d05-b11f-13cdf6c3c29c tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:48.935423 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-78019ba3-6607-4d05-b11f-13cdf6c3c29c tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:48.935912 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-78019ba3-6607-4d05-b11f-13cdf6c3c29c tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:48.936745 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-78019ba3-6607-4d05-b11f-13cdf6c3c29c tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:48.937559 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-78019ba3-6607-4d05-b11f-13cdf6c3c29c tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:48.938017 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-78019ba3-6607-4d05-b11f-13cdf6c3c29c tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:49.150630 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-337076e5-569e-4bee-ab31-2c9edd2e6db5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:49.174412 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-337076e5-569e-4bee-ab31-2c9edd2e6db5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/30d846a2-5966-4fae-9515-9d873d882e6b" status: 200 len: 1510 microversion: 2.1 time: 0.555333 Sep 23 04:50:49.174412 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2279/4429] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:48 2022] GET /compute/v2.1/servers/30d846a2-5966-4fae-9515-9d873d882e6b => generated 1510 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:49.175035 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-138b50d9-c948-46f1-a8e1-46debe472891 req-1a2b5f02-4338-428f-af79-aa59c36f014c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe7dee09-8351-4d41-8c44-8d35a966cce9", "name": "network-vif-deleted", "tag": "c9b47e66-2bb6-4e68-a2b9-4fb9fec9ff30"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:50:49.204939 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-138b50d9-c948-46f1-a8e1-46debe472891 req-1a2b5f02-4338-428f-af79-aa59c36f014c service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:49.206205 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-138b50d9-c948-46f1-a8e1-46debe472891 req-1a2b5f02-4338-428f-af79-aa59c36f014c service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:49.206819 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-138b50d9-c948-46f1-a8e1-46debe472891 req-1a2b5f02-4338-428f-af79-aa59c36f014c service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:49.222400 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-138b50d9-c948-46f1-a8e1-46debe472891 req-1a2b5f02-4338-428f-af79-aa59c36f014c service nova] Creating event network-vif-deleted:c9b47e66-2bb6-4e68-a2b9-4fb9fec9ff30 for instance fe7dee09-8351-4d41-8c44-8d35a966cce9 on n-h2-846463-3 Sep 23 04:50:49.229835 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-138b50d9-c948-46f1-a8e1-46debe472891 req-1a2b5f02-4338-428f-af79-aa59c36f014c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063905 Sep 23 04:50:49.231074 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2280/4430] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:50:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:50:49.254206 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a8cf01ad-c23b-453f-8ee1-22ca788dd11f tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:49.255182 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a8cf01ad-c23b-453f-8ee1-22ca788dd11f tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:49.264388 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a8cf01ad-c23b-453f-8ee1-22ca788dd11f tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:49.265077 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a8cf01ad-c23b-453f-8ee1-22ca788dd11f tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:49.265684 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a8cf01ad-c23b-453f-8ee1-22ca788dd11f tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:49.267806 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a8cf01ad-c23b-453f-8ee1-22ca788dd11f tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:49.268478 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a8cf01ad-c23b-453f-8ee1-22ca788dd11f tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:49.269100 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a8cf01ad-c23b-453f-8ee1-22ca788dd11f tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:49.290025 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:50:49.569958 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-78019ba3-6607-4d05-b11f-13cdf6c3c29c tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a52352ab894e8f88be0f9d1cef0b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e32df90da6b43b7b8a562dd95e6833b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:49.587769 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-78019ba3-6607-4d05-b11f-13cdf6c3c29c tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] 10.222.0.33 "GET /compute/v2.1/servers/1d9dafd4-e427-4349-a142-2c3ed281b2b2" status: 200 len: 1313 microversion: 2.1 time: 0.672388 Sep 23 04:50:49.589995 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2151/4431] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:48 2022] GET /compute/v2.1/servers/1d9dafd4-e427-4349-a142-2c3ed281b2b2 => generated 1313 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:50:49.597574 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-99130b35-2d3f-4992-8299-c302d6aa03f6 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:49.601587 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-99130b35-2d3f-4992-8299-c302d6aa03f6 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: c4464422-9bf1-4aaa-806c-d7063e284579] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:49.610395 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-99130b35-2d3f-4992-8299-c302d6aa03f6 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:49.611519 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-99130b35-2d3f-4992-8299-c302d6aa03f6 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:49.612131 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-99130b35-2d3f-4992-8299-c302d6aa03f6 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:49.626088 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-99130b35-2d3f-4992-8299-c302d6aa03f6 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:49.626088 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-99130b35-2d3f-4992-8299-c302d6aa03f6 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:49.626088 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-99130b35-2d3f-4992-8299-c302d6aa03f6 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:49.724681 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-99130b35-2d3f-4992-8299-c302d6aa03f6 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.133073 Sep 23 04:50:49.725284 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2152/4432] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Sep 23 04:50:49 2022] GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579/os-volume_attachments => generated 197 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:50:49.744664 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-12cfb619-879f-4b7f-9103-e6622b52ba4b tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:49.753668 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-12cfb619-879f-4b7f-9103-e6622b52ba4b tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: fe7dee09-8351-4d41-8c44-8d35a966cce9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:49.768794 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-12cfb619-879f-4b7f-9103-e6622b52ba4b tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:49.772256 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-12cfb619-879f-4b7f-9103-e6622b52ba4b tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:49.773270 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-12cfb619-879f-4b7f-9103-e6622b52ba4b tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:49.774509 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-12cfb619-879f-4b7f-9103-e6622b52ba4b tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:49.777971 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-12cfb619-879f-4b7f-9103-e6622b52ba4b tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:49.778655 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-12cfb619-879f-4b7f-9103-e6622b52ba4b tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:49.848177 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a8cf01ad-c23b-453f-8ee1-22ca788dd11f tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:49.859877 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-12cfb619-879f-4b7f-9103-e6622b52ba4b tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:49.860507 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a8cf01ad-c23b-453f-8ee1-22ca788dd11f tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1509 microversion: 2.1 time: 0.609606 Sep 23 04:50:49.860655 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-12cfb619-879f-4b7f-9103-e6622b52ba4b tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:49.861015 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-12cfb619-879f-4b7f-9103-e6622b52ba4b tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:49.862818 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2281/4433] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:49 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1509 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:49.871363 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-12cfb619-879f-4b7f-9103-e6622b52ba4b tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lazy-loading 'fault' on Instance uuid fe7dee09-8351-4d41-8c44-8d35a966cce9 {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:50:49.943429 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-12cfb619-879f-4b7f-9103-e6622b52ba4b tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:49.955286 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-12cfb619-879f-4b7f-9103-e6622b52ba4b tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:49.959371 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-12cfb619-879f-4b7f-9103-e6622b52ba4b tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:49.963836 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-12cfb619-879f-4b7f-9103-e6622b52ba4b tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9" status: 200 len: 1370 microversion: 2.20 time: 0.229643 Sep 23 04:50:49.994918 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2153/4434] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:50:49 2022] GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9 => generated 1370 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:50:50.189767 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c1fa8dcb-c365-4d62-a371-7607438e2152 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:50.190591 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c1fa8dcb-c365-4d62-a371-7607438e2152 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 30d846a2-5966-4fae-9515-9d873d882e6b] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:50.200588 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c1fa8dcb-c365-4d62-a371-7607438e2152 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:50.201016 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c1fa8dcb-c365-4d62-a371-7607438e2152 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:50.201491 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c1fa8dcb-c365-4d62-a371-7607438e2152 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:50.202257 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c1fa8dcb-c365-4d62-a371-7607438e2152 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:50.202884 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c1fa8dcb-c365-4d62-a371-7607438e2152 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:50.203328 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c1fa8dcb-c365-4d62-a371-7607438e2152 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:50.617589 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5c4304fe-5d8b-4c08-a333-45b4d9bc866c tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:50.620385 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5c4304fe-5d8b-4c08-a333-45b4d9bc866c tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] [instance: 1d9dafd4-e427-4349-a142-2c3ed281b2b2] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:50.628418 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5c4304fe-5d8b-4c08-a333-45b4d9bc866c tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:50.628934 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5c4304fe-5d8b-4c08-a333-45b4d9bc866c tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:50.629532 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5c4304fe-5d8b-4c08-a333-45b4d9bc866c tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:50.630338 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5c4304fe-5d8b-4c08-a333-45b4d9bc866c tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:50.631185 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5c4304fe-5d8b-4c08-a333-45b4d9bc866c tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:50.636625 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5c4304fe-5d8b-4c08-a333-45b4d9bc866c tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:50.641731 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c1fa8dcb-c365-4d62-a371-7607438e2152 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:50.654953 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c1fa8dcb-c365-4d62-a371-7607438e2152 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/30d846a2-5966-4fae-9515-9d873d882e6b" status: 200 len: 1510 microversion: 2.1 time: 0.469933 Sep 23 04:50:50.671346 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2282/4435] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:50 2022] GET /compute/v2.1/servers/30d846a2-5966-4fae-9515-9d873d882e6b => generated 1510 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:50.701914 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:50:50.738443 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6cacc2f7-f555-4475-aa1a-d53fccf62117 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:50.744230 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-6cacc2f7-f555-4475-aa1a-d53fccf62117 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: c4464422-9bf1-4aaa-806c-d7063e284579] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:50.753122 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6cacc2f7-f555-4475-aa1a-d53fccf62117 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:50.753859 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6cacc2f7-f555-4475-aa1a-d53fccf62117 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:50.755241 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6cacc2f7-f555-4475-aa1a-d53fccf62117 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:50.755613 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6cacc2f7-f555-4475-aa1a-d53fccf62117 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:50.756259 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6cacc2f7-f555-4475-aa1a-d53fccf62117 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:50.757292 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6cacc2f7-f555-4475-aa1a-d53fccf62117 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:50.805104 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6cacc2f7-f555-4475-aa1a-d53fccf62117 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072381 Sep 23 04:50:50.806299 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2283/4436] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Sep 23 04:50:50 2022] GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:50:50.895688 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a7c65f1f-6401-4652-b62c-d8487acbf41c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:50.896327 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a7c65f1f-6401-4652-b62c-d8487acbf41c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:50.903940 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a7c65f1f-6401-4652-b62c-d8487acbf41c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:50.904451 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a7c65f1f-6401-4652-b62c-d8487acbf41c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:50.904897 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a7c65f1f-6401-4652-b62c-d8487acbf41c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:50.905931 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a7c65f1f-6401-4652-b62c-d8487acbf41c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:50.906582 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a7c65f1f-6401-4652-b62c-d8487acbf41c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:50.907177 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a7c65f1f-6401-4652-b62c-d8487acbf41c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:51.420989 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-5c4304fe-5d8b-4c08-a333-45b4d9bc866c tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a52352ab894e8f88be0f9d1cef0b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e32df90da6b43b7b8a562dd95e6833b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:51.430991 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5c4304fe-5d8b-4c08-a333-45b4d9bc866c tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] 10.222.0.33 "GET /compute/v2.1/servers/1d9dafd4-e427-4349-a142-2c3ed281b2b2" status: 200 len: 1334 microversion: 2.1 time: 0.817971 Sep 23 04:50:51.431640 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2154/4437] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:50 2022] GET /compute/v2.1/servers/1d9dafd4-e427-4349-a142-2c3ed281b2b2 => generated 1334 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:51.438244 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-562b856d-883d-4dac-835d-88d36b8f4e56 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:51.439817 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-562b856d-883d-4dac-835d-88d36b8f4e56 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: fe7dee09-8351-4d41-8c44-8d35a966cce9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:51.447847 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-562b856d-883d-4dac-835d-88d36b8f4e56 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:51.448677 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-562b856d-883d-4dac-835d-88d36b8f4e56 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:51.449813 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-562b856d-883d-4dac-835d-88d36b8f4e56 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:51.450396 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-562b856d-883d-4dac-835d-88d36b8f4e56 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:51.450937 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-562b856d-883d-4dac-835d-88d36b8f4e56 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:51.451441 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-562b856d-883d-4dac-835d-88d36b8f4e56 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:51.469345 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-562b856d-883d-4dac-835d-88d36b8f4e56 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] HTTP exception thrown: Instance fe7dee09-8351-4d41-8c44-8d35a966cce9 could not be found. Sep 23 04:50:51.471766 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-562b856d-883d-4dac-835d-88d36b8f4e56 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Request method failure captured: Sep 23 04:50:51.471766 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9 HTTP/1.1 Sep 23 04:50:51.471766 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:50:51.471766 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:50:51.471766 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:50:51.471766 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:50:51.471766 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:50:51.471766 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:50:51.471766 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:50:51.471766 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:50:51.471766 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLToveGoAQMGKa2MEoOD7pi4eoXebwWpQGYBxpi4v5d_5sCE8-ReUtgLxNqqDa5ZRa4NgKNhAN91c4cAyfH085Z25DFo9sDI3xEr7wMBgdXQQsjQLe9mvRYlGmbhD7LMsA85fhQUj8nzFBJzYkoK4oOVlzuKdqXhdKMrRGAYR1C8bRv8 Sep 23 04:50:51.471766 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:50:51.471766 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:50:51.471766 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:50:51.471766 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:50:51.471766 n-d-846463-3 devstack@n-api.service[122698]: X-Openstack-Nova-Api-Version: 2.20 Sep 23 04:50:51.471766 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:50:51.471766 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:50:51.471766 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 1cdfe96be196470889a58b56a19743a7 Sep 23 04:50:51.471766 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-480238040 Sep 23 04:50:51.471766 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:50:51.471766 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:50:51.471766 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1cdfe96be196470889a58b56a19743a7", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1cdfe96be196470889a58b56a19743a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1cdfe96be196470889a58b56a19743a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1cdfe96be196470889a58b56a19743a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:50:51.471766 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-AttachVolumeShelveTestJSON-480238040 Sep 23 04:50:51.471766 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 1cdfe96be196470889a58b56a19743a7 Sep 23 04:50:51.471766 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-480238040 Sep 23 04:50:51.471766 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-AttachVolumeShelveTestJSON-480238040-project Sep 23 04:50:51.471766 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:50:51.471766 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:50:51.471766 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: b87ca7119ee042c3bda1e88ff38fdb7c Sep 23 04:50:51.471766 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-AttachVolumeShelveTestJSON-480238040-project Sep 23 04:50:51.471766 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:50:51.471766 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance fe7dee09-8351-4d41-8c44-8d35a966cce9 could not be found. Sep 23 04:50:51.471766 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': 'fe7dee09-8351-4d41-8c44-8d35a966cce9'} Sep 23 04:50:51.471766 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:50:51.471766 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:51.471766 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:50:51.471766 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:50:51.471766 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:50:51.471766 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:50:51.471766 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:50:51.471766 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:50:51.471766 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:50:51.471766 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:50:51.471766 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe7dee09-8351-4d41-8c44-8d35a966cce9 could not be found. Sep 23 04:50:51.471766 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:50:51.471766 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:50:51.471766 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:50:51.471766 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:51.471766 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:50:51.471766 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:50:51.471766 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:50:51.471766 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:50:51.471766 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:50:51.471766 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:50:51.471766 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:50:51.471766 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:50:51.471766 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:50:51.471766 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:50:51.471766 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:50:51.471766 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:50:51.471766 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe7dee09-8351-4d41-8c44-8d35a966cce9 could not be found. Sep 23 04:50:51.471766 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:50:51.471766 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:50:51.487920 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:50:51.487920 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:51.487920 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:50:51.487920 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:50:51.487920 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:50:51.487920 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:50:51.487920 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe7dee09-8351-4d41-8c44-8d35a966cce9 could not be found. Sep 23 04:50:51.487920 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:50:51.487920 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-562b856d-883d-4dac-835d-88d36b8f4e56 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Returning 404 to user: Instance fe7dee09-8351-4d41-8c44-8d35a966cce9 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:50:51.487920 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-562b856d-883d-4dac-835d-88d36b8f4e56 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9" status: 404 len: 111 microversion: 2.20 time: 0.042536 Sep 23 04:50:51.487920 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2155/4438] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:50:51 2022] GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 23 04:50:51.490480 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-134b56f6-87d3-48ee-88b1-5ddada26ee0b tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '.version_select at 0x7ff1c3d2f9d0>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:51.595055 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=4 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:50:51.675385 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-134b56f6-87d3-48ee-88b1-5ddada26ee0b tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-941368436" status: 204 len: 0 microversion: 2.20 time: 0.193557 Sep 23 04:50:51.676231 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2156/4439] 10.222.0.33 () {60 vars in 1259 bytes} [Fri Sep 23 04:50:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-941368436 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 23 04:50:51.693454 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-79ad870f-308b-49e7-96a1-17fc49ab73bf tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:51.694554 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-79ad870f-308b-49e7-96a1-17fc49ab73bf tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 30d846a2-5966-4fae-9515-9d873d882e6b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:51.716470 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-79ad870f-308b-49e7-96a1-17fc49ab73bf tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:51.718910 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-79ad870f-308b-49e7-96a1-17fc49ab73bf tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:51.719452 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-79ad870f-308b-49e7-96a1-17fc49ab73bf tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:51.720885 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-79ad870f-308b-49e7-96a1-17fc49ab73bf tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:51.724461 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-79ad870f-308b-49e7-96a1-17fc49ab73bf tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:51.725088 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-79ad870f-308b-49e7-96a1-17fc49ab73bf tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:51.952300 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a7c65f1f-6401-4652-b62c-d8487acbf41c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:51.970702 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a7c65f1f-6401-4652-b62c-d8487acbf41c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1509 microversion: 2.1 time: 1.086074 Sep 23 04:50:51.971868 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2284/4440] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:50 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1509 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:50:51.994900 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a70cce13-9fc0-4a39-a668-57a590894182 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:51.997700 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a70cce13-9fc0-4a39-a668-57a590894182 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: c4464422-9bf1-4aaa-806c-d7063e284579] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:52.033040 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a70cce13-9fc0-4a39-a668-57a590894182 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:52.036075 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a70cce13-9fc0-4a39-a668-57a590894182 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:52.036569 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a70cce13-9fc0-4a39-a668-57a590894182 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:52.037484 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a70cce13-9fc0-4a39-a668-57a590894182 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:52.042158 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a70cce13-9fc0-4a39-a668-57a590894182 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:52.042745 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a70cce13-9fc0-4a39-a668-57a590894182 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:52.092989 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-79ad870f-308b-49e7-96a1-17fc49ab73bf tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:52.125592 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-79ad870f-308b-49e7-96a1-17fc49ab73bf tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/30d846a2-5966-4fae-9515-9d873d882e6b" status: 200 len: 1510 microversion: 2.1 time: 0.432847 Sep 23 04:50:52.127817 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2157/4441] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:51 2022] GET /compute/v2.1/servers/30d846a2-5966-4fae-9515-9d873d882e6b => generated 1510 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:50:52.181441 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a70cce13-9fc0-4a39-a668-57a590894182 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.207772 Sep 23 04:50:52.182103 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2285/4442] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Sep 23 04:50:51 2022] GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579/os-volume_attachments => generated 25 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 04:50:52.280527 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2b3a8a26-8a17-465e-a16b-b527db724129 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:50:52.290533 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-2b3a8a26-8a17-465e-a16b-b527db724129 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: 9763a452-dc3c-436d-bee4-a3967af3bcbb] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:52.291055 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2b3a8a26-8a17-465e-a16b-b527db724129 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:52.291566 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2b3a8a26-8a17-465e-a16b-b527db724129 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:52.292492 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2b3a8a26-8a17-465e-a16b-b527db724129 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:52.293850 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2b3a8a26-8a17-465e-a16b-b527db724129 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:52.294347 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2b3a8a26-8a17-465e-a16b-b527db724129 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:52.294835 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2b3a8a26-8a17-465e-a16b-b527db724129 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:52.330945 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-2b3a8a26-8a17-465e-a16b-b527db724129 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] HTTP exception thrown: Cannot 'reboot' instance 9763a452-dc3c-436d-bee4-a3967af3bcbb while it is in vm_state rescued Sep 23 04:50:52.333252 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2b3a8a26-8a17-465e-a16b-b527db724129 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Request method failure captured: Sep 23 04:50:52.333252 n-d-846463-3 devstack@n-api.service[122698]: request: POST /compute/v2.1/servers/9763a452-dc3c-436d-bee4-a3967af3bcbb/action HTTP/1.1 Sep 23 04:50:52.333252 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:50:52.333252 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:50:52.333252 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:50:52.333252 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 28 Sep 23 04:50:52.333252 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:50:52.333252 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:50:52.333252 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:50:52.333252 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:50:52.333252 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLToEB3KmJeqpeof3qtE1_ms3jD5q4R8EB4mtf6agEJBYOf3R1k1wW8qdql02e7ra521m3dklynQTAHmyD-EBkyV9p_88fIs_nz1LT08tnPBKYcM8ytHDfif-4FU40Ttv4qlVJY_DNQ2W4b2ZBQdDVOwU9-lTsZtqbQggZ1JBKRn9aZQ Sep 23 04:50:52.333252 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:50:52.333252 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:50:52.333252 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:50:52.333252 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:50:52.333252 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:50:52.333252 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:50:52.333252 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: dcafb05f6f554e278cd552023947c6ac Sep 23 04:50:52.333252 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-196358672 Sep 23 04:50:52.333252 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:50:52.333252 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:50:52.333252 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_dcafb05f6f554e278cd552023947c6ac", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dcafb05f6f554e278cd552023947c6ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/dcafb05f6f554e278cd552023947c6ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dcafb05f6f554e278cd552023947c6ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:50:52.333252 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ServerRescueNegativeTestJSON-196358672 Sep 23 04:50:52.333252 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: dcafb05f6f554e278cd552023947c6ac Sep 23 04:50:52.333252 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-196358672 Sep 23 04:50:52.333252 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ServerRescueNegativeTestJSON-196358672-project Sep 23 04:50:52.333252 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:50:52.333252 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:50:52.333252 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: c786bbedc21849ea92924139a44707b7 Sep 23 04:50:52.333252 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ServerRescueNegativeTestJSON-196358672-project Sep 23 04:50:52.333252 n-d-846463-3 devstack@n-api.service[122698]: Sep 23 04:50:52.333252 n-d-846463-3 devstack@n-api.service[122698]: {"reboot": {"type": "HARD"}} Sep 23 04:50:52.333252 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:50:52.333252 n-d-846463-3 devstack@n-api.service[122698]: exception: Cannot 'reboot' instance 9763a452-dc3c-436d-bee4-a3967af3bcbb while it is in vm_state rescued Sep 23 04:50:52.333252 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '9763a452-dc3c-436d-bee4-a3967af3bcbb', 'body': {'reboot': {'type': 'HARD'}}} Sep 23 04:50:52.333252 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:50:52.333252 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:52.333252 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Sep 23 04:50:52.333252 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Sep 23 04:50:52.333252 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 23 04:50:52.333252 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 23 04:50:52.333252 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Sep 23 04:50:52.333252 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Sep 23 04:50:52.333252 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 23 04:50:52.333252 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 23 04:50:52.333252 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9763a452-dc3c-436d-bee4-a3967af3bcbb in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Sep 23 04:50:52.333252 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:50:52.333252 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:50:52.333252 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:50:52.333252 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:52.333252 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:50:52.333252 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:50:52.333252 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:50:52.333252 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:50:52.333252 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:50:52.333252 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:50:52.333252 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:50:52.333252 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:50:52.333252 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Sep 23 04:50:52.333252 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 23 04:50:52.333252 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 23 04:50:52.333252 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 23 04:50:52.337769 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance 9763a452-dc3c-436d-bee4-a3967af3bcbb while it is in vm_state rescued Sep 23 04:50:52.337769 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:50:52.337769 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:50:52.337769 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:50:52.337769 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:52.337769 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:50:52.337769 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:50:52.337769 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:50:52.337769 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:50:52.337769 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance 9763a452-dc3c-436d-bee4-a3967af3bcbb while it is in vm_state rescued Sep 23 04:50:52.337769 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:50:52.339956 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2b3a8a26-8a17-465e-a16b-b527db724129 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Returning 409 to user: Cannot 'reboot' instance 9763a452-dc3c-436d-bee4-a3967af3bcbb while it is in vm_state rescued {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:50:52.341004 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2b3a8a26-8a17-465e-a16b-b527db724129 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "POST /compute/v2.1/servers/9763a452-dc3c-436d-bee4-a3967af3bcbb/action" status: 409 len: 145 microversion: 2.1 time: 0.064661 Sep 23 04:50:52.342607 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2158/4443] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:50:52 2022] POST /compute/v2.1/servers/9763a452-dc3c-436d-bee4-a3967af3bcbb/action => generated 145 bytes in 67 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 23 04:50:52.356201 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6502c27a-60de-47a9-88ff-e9feb83fbd28 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:50:52.361592 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-6502c27a-60de-47a9-88ff-e9feb83fbd28 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: 9763a452-dc3c-436d-bee4-a3967af3bcbb] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:52.368343 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6502c27a-60de-47a9-88ff-e9feb83fbd28 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:52.369056 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6502c27a-60de-47a9-88ff-e9feb83fbd28 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:52.369814 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6502c27a-60de-47a9-88ff-e9feb83fbd28 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:52.370732 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6502c27a-60de-47a9-88ff-e9feb83fbd28 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:52.371360 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6502c27a-60de-47a9-88ff-e9feb83fbd28 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:52.371957 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6502c27a-60de-47a9-88ff-e9feb83fbd28 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:52.404584 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-6502c27a-60de-47a9-88ff-e9feb83fbd28 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] HTTP exception thrown: Cannot 'rebuild' instance 9763a452-dc3c-436d-bee4-a3967af3bcbb while it is in vm_state rescued Sep 23 04:50:52.406827 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6502c27a-60de-47a9-88ff-e9feb83fbd28 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Request method failure captured: Sep 23 04:50:52.406827 n-d-846463-3 devstack@n-api.service[122699]: request: POST /compute/v2.1/servers/9763a452-dc3c-436d-bee4-a3967af3bcbb/action HTTP/1.1 Sep 23 04:50:52.406827 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:50:52.406827 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:50:52.406827 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:50:52.406827 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 65 Sep 23 04:50:52.406827 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:50:52.406827 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:50:52.406827 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:50:52.406827 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:50:52.406827 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLToEB3KmJeqpeof3qtE1_ms3jD5q4R8EB4mtf6agEJBYOf3R1k1wW8qdql02e7ra521m3dklynQTAHmyD-EBkyV9p_88fIs_nz1LT08tnPBKYcM8ytHDfif-4FU40Ttv4qlVJY_DNQ2W4b2ZBQdDVOwU9-lTsZtqbQggZ1JBKRn9aZQ Sep 23 04:50:52.406827 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:50:52.406827 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:50:52.406827 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:50:52.406827 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:50:52.406827 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:50:52.406827 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:50:52.406827 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: dcafb05f6f554e278cd552023947c6ac Sep 23 04:50:52.406827 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-196358672 Sep 23 04:50:52.406827 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:50:52.406827 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:50:52.406827 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_dcafb05f6f554e278cd552023947c6ac", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dcafb05f6f554e278cd552023947c6ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/dcafb05f6f554e278cd552023947c6ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dcafb05f6f554e278cd552023947c6ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:50:52.406827 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ServerRescueNegativeTestJSON-196358672 Sep 23 04:50:52.406827 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: dcafb05f6f554e278cd552023947c6ac Sep 23 04:50:52.406827 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-196358672 Sep 23 04:50:52.406827 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ServerRescueNegativeTestJSON-196358672-project Sep 23 04:50:52.406827 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:50:52.406827 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:50:52.406827 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: c786bbedc21849ea92924139a44707b7 Sep 23 04:50:52.406827 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ServerRescueNegativeTestJSON-196358672-project Sep 23 04:50:52.406827 n-d-846463-3 devstack@n-api.service[122699]: Sep 23 04:50:52.406827 n-d-846463-3 devstack@n-api.service[122699]: {"rebuild": {"imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee"}} Sep 23 04:50:52.406827 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:50:52.406827 n-d-846463-3 devstack@n-api.service[122699]: exception: Cannot 'rebuild' instance 9763a452-dc3c-436d-bee4-a3967af3bcbb while it is in vm_state rescued Sep 23 04:50:52.406827 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '9763a452-dc3c-436d-bee4-a3967af3bcbb', 'body': {'rebuild': {'imageRef': 'b8dd79b9-f0b9-43a9-9605-17244137c0ee'}}} Sep 23 04:50:52.406827 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:50:52.406827 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:52.406827 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1223, in _action_rebuild Sep 23 04:50:52.406827 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Sep 23 04:50:52.406827 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 23 04:50:52.406827 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 23 04:50:52.406827 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 23 04:50:52.406827 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 23 04:50:52.406827 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 23 04:50:52.406827 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 23 04:50:52.406827 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 23 04:50:52.406827 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 23 04:50:52.406827 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9763a452-dc3c-436d-bee4-a3967af3bcbb in vm_state rescued. Cannot rebuild while the instance is in this state. Sep 23 04:50:52.406827 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:52.406827 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:50:52.406827 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:52.406827 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:52.406827 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:50:52.406827 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:50:52.406827 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:50:52.406827 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:50:52.406827 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:50:52.406827 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:50:52.406827 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:50:52.406827 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:50:52.406827 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:50:52.406827 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:50:52.406827 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:50:52.413964 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:50:52.413964 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Sep 23 04:50:52.413964 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1231, in _action_rebuild Sep 23 04:50:52.413964 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 23 04:50:52.413964 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 23 04:50:52.413964 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 23 04:50:52.413964 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance 9763a452-dc3c-436d-bee4-a3967af3bcbb while it is in vm_state rescued Sep 23 04:50:52.413964 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:52.413964 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:50:52.413964 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:52.413964 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:50:52.413964 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:50:52.413964 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:50:52.413964 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:50:52.413964 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:50:52.413964 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance 9763a452-dc3c-436d-bee4-a3967af3bcbb while it is in vm_state rescued Sep 23 04:50:52.413964 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:50:52.413964 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6502c27a-60de-47a9-88ff-e9feb83fbd28 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Returning 409 to user: Cannot 'rebuild' instance 9763a452-dc3c-436d-bee4-a3967af3bcbb while it is in vm_state rescued {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:50:52.413964 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6502c27a-60de-47a9-88ff-e9feb83fbd28 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "POST /compute/v2.1/servers/9763a452-dc3c-436d-bee4-a3967af3bcbb/action" status: 409 len: 146 microversion: 2.1 time: 0.057234 Sep 23 04:50:52.413964 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2286/4444] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:50:52 2022] POST /compute/v2.1/servers/9763a452-dc3c-436d-bee4-a3967af3bcbb/action => generated 146 bytes in 59 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 23 04:50:52.425776 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a26abd4d-9748-4f3a-b4cf-020ea6959a14 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:52.426995 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a26abd4d-9748-4f3a-b4cf-020ea6959a14 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: c4464422-9bf1-4aaa-806c-d7063e284579] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:52.436053 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a26abd4d-9748-4f3a-b4cf-020ea6959a14 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:52.436852 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a26abd4d-9748-4f3a-b4cf-020ea6959a14 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:52.437577 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a26abd4d-9748-4f3a-b4cf-020ea6959a14 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:52.440195 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a26abd4d-9748-4f3a-b4cf-020ea6959a14 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:52.440996 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a26abd4d-9748-4f3a-b4cf-020ea6959a14 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:52.441605 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a26abd4d-9748-4f3a-b4cf-020ea6959a14 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:52.458907 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2a3c2a1b-e1fc-41db-ba96-eb316a8acb68 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:52.460831 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-2a3c2a1b-e1fc-41db-ba96-eb316a8acb68 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] [instance: 1d9dafd4-e427-4349-a142-2c3ed281b2b2] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:52.479452 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2a3c2a1b-e1fc-41db-ba96-eb316a8acb68 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:52.480935 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2a3c2a1b-e1fc-41db-ba96-eb316a8acb68 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:52.481593 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2a3c2a1b-e1fc-41db-ba96-eb316a8acb68 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:52.484505 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2a3c2a1b-e1fc-41db-ba96-eb316a8acb68 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:52.485220 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2a3c2a1b-e1fc-41db-ba96-eb316a8acb68 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:52.485810 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2a3c2a1b-e1fc-41db-ba96-eb316a8acb68 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:52.534027 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a26abd4d-9748-4f3a-b4cf-020ea6959a14 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: c4464422-9bf1-4aaa-806c-d7063e284579] Going to try to terminate instance {{(pid=122698) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:50:52.583326 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=10 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:50:52.904022 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a26abd4d-9748-4f3a-b4cf-020ea6959a14 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579" status: 204 len: 0 microversion: 2.1 time: 0.486793 Sep 23 04:50:52.905135 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2159/4445] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:50:52 2022] DELETE /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:50:52.919404 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1a3c1a71-0e07-4c79-9d5f-fab5e15cf482 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:52.920420 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-1a3c1a71-0e07-4c79-9d5f-fab5e15cf482 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: c4464422-9bf1-4aaa-806c-d7063e284579] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:52.938341 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1a3c1a71-0e07-4c79-9d5f-fab5e15cf482 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:52.939720 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1a3c1a71-0e07-4c79-9d5f-fab5e15cf482 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:52.942570 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1a3c1a71-0e07-4c79-9d5f-fab5e15cf482 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:52.944906 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1a3c1a71-0e07-4c79-9d5f-fab5e15cf482 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:52.949500 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1a3c1a71-0e07-4c79-9d5f-fab5e15cf482 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:52.950096 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1a3c1a71-0e07-4c79-9d5f-fab5e15cf482 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:53.169222 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2a3c2a1b-e1fc-41db-ba96-eb316a8acb68 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a52352ab894e8f88be0f9d1cef0b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e32df90da6b43b7b8a562dd95e6833b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:53.189388 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2a3c2a1b-e1fc-41db-ba96-eb316a8acb68 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] 10.222.0.33 "GET /compute/v2.1/servers/1d9dafd4-e427-4349-a142-2c3ed281b2b2" status: 200 len: 1334 microversion: 2.1 time: 0.735969 Sep 23 04:50:53.205929 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2287/4446] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:52 2022] GET /compute/v2.1/servers/1d9dafd4-e427-4349-a142-2c3ed281b2b2 => generated 1334 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:50:53.211247 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-40609e59-dfc1-42d1-b1a4-c3c03320f24e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:53.211247 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-40609e59-dfc1-42d1-b1a4-c3c03320f24e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:53.231505 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-40609e59-dfc1-42d1-b1a4-c3c03320f24e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:53.232175 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-40609e59-dfc1-42d1-b1a4-c3c03320f24e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:53.233008 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-40609e59-dfc1-42d1-b1a4-c3c03320f24e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:53.234322 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-40609e59-dfc1-42d1-b1a4-c3c03320f24e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:53.234409 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-40609e59-dfc1-42d1-b1a4-c3c03320f24e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:53.234960 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-40609e59-dfc1-42d1-b1a4-c3c03320f24e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:53.411445 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-1a3c1a71-0e07-4c79-9d5f-fab5e15cf482 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c786bbedc21849ea92924139a44707b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcafb05f6f554e278cd552023947c6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:53.420029 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-1a3c1a71-0e07-4c79-9d5f-fab5e15cf482 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579" status: 200 len: 1690 microversion: 2.1 time: 0.505866 Sep 23 04:50:53.421172 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2160/4447] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:52 2022] GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579 => generated 1690 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:50:53.427622 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-af8712d5-1928-4a4f-9ad8-3c78f62298d8 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:53.428877 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-af8712d5-1928-4a4f-9ad8-3c78f62298d8 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 30d846a2-5966-4fae-9515-9d873d882e6b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:53.435466 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-af8712d5-1928-4a4f-9ad8-3c78f62298d8 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:53.436394 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-af8712d5-1928-4a4f-9ad8-3c78f62298d8 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:53.437566 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-af8712d5-1928-4a4f-9ad8-3c78f62298d8 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:53.438501 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-af8712d5-1928-4a4f-9ad8-3c78f62298d8 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:53.439201 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-af8712d5-1928-4a4f-9ad8-3c78f62298d8 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:53.439811 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-af8712d5-1928-4a4f-9ad8-3c78f62298d8 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:53.671035 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-40609e59-dfc1-42d1-b1a4-c3c03320f24e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:53.684300 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-40609e59-dfc1-42d1-b1a4-c3c03320f24e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1509 microversion: 2.1 time: 0.483926 Sep 23 04:50:53.685752 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2288/4448] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:53 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1509 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:53.691638 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-cc8521ec-5c73-4992-b2da-dbb72bdb85ac req-ad883f60-73cf-4e23-b2da-9ce76aa91284 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d9dafd4-e427-4349-a142-2c3ed281b2b2", "tag": "5887a553-3d1e-43b2-914f-03b362eb8353"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:50:53.703202 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-af8712d5-1928-4a4f-9ad8-3c78f62298d8 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:53.704172 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-cc8521ec-5c73-4992-b2da-dbb72bdb85ac req-ad883f60-73cf-4e23-b2da-9ce76aa91284 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:53.712192 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-cc8521ec-5c73-4992-b2da-dbb72bdb85ac req-ad883f60-73cf-4e23-b2da-9ce76aa91284 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:53.712192 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-cc8521ec-5c73-4992-b2da-dbb72bdb85ac req-ad883f60-73cf-4e23-b2da-9ce76aa91284 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:53.715155 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-af8712d5-1928-4a4f-9ad8-3c78f62298d8 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/30d846a2-5966-4fae-9515-9d873d882e6b" status: 200 len: 1487 microversion: 2.1 time: 0.292728 Sep 23 04:50:53.728086 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-cc8521ec-5c73-4992-b2da-dbb72bdb85ac req-ad883f60-73cf-4e23-b2da-9ce76aa91284 service nova] Creating event network-changed:5887a553-3d1e-43b2-914f-03b362eb8353 for instance 1d9dafd4-e427-4349-a142-2c3ed281b2b2 on n-h1-846463-3 Sep 23 04:50:53.730360 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-cc8521ec-5c73-4992-b2da-dbb72bdb85ac req-ad883f60-73cf-4e23-b2da-9ce76aa91284 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042643 Sep 23 04:50:53.731334 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2289/4449] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:50:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:50:53.732513 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2161/4450] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:53 2022] GET /compute/v2.1/servers/30d846a2-5966-4fae-9515-9d873d882e6b => generated 1487 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:53.749018 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9cef6345-3f85-4062-9efc-0e60ef786b17 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:50:53.752649 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-9cef6345-3f85-4062-9efc-0e60ef786b17 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:53.763823 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9cef6345-3f85-4062-9efc-0e60ef786b17 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:53.763823 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9cef6345-3f85-4062-9efc-0e60ef786b17 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:53.763823 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9cef6345-3f85-4062-9efc-0e60ef786b17 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:53.763823 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9cef6345-3f85-4062-9efc-0e60ef786b17 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:53.763823 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9cef6345-3f85-4062-9efc-0e60ef786b17 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:53.764331 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9cef6345-3f85-4062-9efc-0e60ef786b17 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:53.867479 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-9cef6345-3f85-4062-9efc-0e60ef786b17 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "POST /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5/action" status: 200 len: 169 microversion: 2.1 time: 0.115516 Sep 23 04:50:53.867479 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2290/4451] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:50:53 2022] POST /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5/action => generated 169 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:50:53.876461 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e645046a-c58d-42af-972e-29da58c92e22 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:53.877394 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e645046a-c58d-42af-972e-29da58c92e22 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:53.882540 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:50:53.891684 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a05a3f72-c816-4a50-94ee-7ad4d6b37fef tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Action: 'create', calling method: .version_select at 0x7ff1ba9de940>, body: {"keypair": {"name": "tempest-keypair-109559585", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHNM2JD7DBA2I+ZtXbxoAZ6jowGE+YppeUNrNg2inR4dKfXbAtNlNzzN5rtYEtgZzEk6lDJ4iTU5LL3i3qbLZNKFx4Nr05ytQ5o/W3Aji4HVlafydsjaEzstiw5dstipXA=="}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:50:53.891847 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e645046a-c58d-42af-972e-29da58c92e22 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:53.891847 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e645046a-c58d-42af-972e-29da58c92e22 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:53.891847 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e645046a-c58d-42af-972e-29da58c92e22 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:53.891847 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e645046a-c58d-42af-972e-29da58c92e22 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:53.891847 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e645046a-c58d-42af-972e-29da58c92e22 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:53.891847 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e645046a-c58d-42af-972e-29da58c92e22 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:53.946436 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-a05a3f72-c816-4a50-94ee-7ad4d6b37fef tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Getting quotas for project 1cdfe96be196470889a58b56a19743a7. Resources: {'key_pairs'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:50:53.961187 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:50:53.964987 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-a05a3f72-c816-4a50-94ee-7ad4d6b37fef tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Getting quotas for user b87ca7119ee042c3bda1e88ff38fdb7c and project 1cdfe96be196470889a58b56a19743a7. Resources: {'key_pairs'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:50:54.075913 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a05a3f72-c816-4a50-94ee-7ad4d6b37fef tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.193051 Sep 23 04:50:54.076536 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2291/4452] 10.222.0.33 () {62 vars in 1200 bytes} [Fri Sep 23 04:50:53 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 195 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 23 04:50:54.080729 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e645046a-c58d-42af-972e-29da58c92e22 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:54.089482 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e645046a-c58d-42af-972e-29da58c92e22 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1670 microversion: 2.1 time: 0.219322 Sep 23 04:50:54.095046 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2162/4453] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:53 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1670 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:54.124760 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f84b1f8e-23ff-46ed-9e6e-08a0fc321079 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:54.125699 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f84b1f8e-23ff-46ed-9e6e-08a0fc321079 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:54.132877 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f84b1f8e-23ff-46ed-9e6e-08a0fc321079 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:54.133441 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f84b1f8e-23ff-46ed-9e6e-08a0fc321079 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:54.133986 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f84b1f8e-23ff-46ed-9e6e-08a0fc321079 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:54.135061 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f84b1f8e-23ff-46ed-9e6e-08a0fc321079 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:54.136000 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f84b1f8e-23ff-46ed-9e6e-08a0fc321079 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:54.136514 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f84b1f8e-23ff-46ed-9e6e-08a0fc321079 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:54.219803 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8fc7b80c-949c-480e-9f71-2196c52f4876 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:54.220474 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8fc7b80c-949c-480e-9f71-2196c52f4876 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] [instance: 1d9dafd4-e427-4349-a142-2c3ed281b2b2] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:54.228555 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8fc7b80c-949c-480e-9f71-2196c52f4876 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:54.239338 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8fc7b80c-949c-480e-9f71-2196c52f4876 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:54.239338 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8fc7b80c-949c-480e-9f71-2196c52f4876 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:54.239338 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8fc7b80c-949c-480e-9f71-2196c52f4876 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:54.239338 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8fc7b80c-949c-480e-9f71-2196c52f4876 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:54.239338 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8fc7b80c-949c-480e-9f71-2196c52f4876 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:54.307526 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f84b1f8e-23ff-46ed-9e6e-08a0fc321079 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:54.329665 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f84b1f8e-23ff-46ed-9e6e-08a0fc321079 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1670 microversion: 2.1 time: 0.205328 Sep 23 04:50:54.333521 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2292/4454] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:54 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1670 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:54.358555 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-883cde51-8f72-422d-889d-dffaff107be8 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:54.359247 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-883cde51-8f72-422d-889d-dffaff107be8 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:54.371132 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-883cde51-8f72-422d-889d-dffaff107be8 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:54.371661 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-883cde51-8f72-422d-889d-dffaff107be8 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:54.373285 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-883cde51-8f72-422d-889d-dffaff107be8 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:54.377476 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-883cde51-8f72-422d-889d-dffaff107be8 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:54.378791 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-883cde51-8f72-422d-889d-dffaff107be8 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:54.378791 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-883cde51-8f72-422d-889d-dffaff107be8 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:54.490537 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8fc7b80c-949c-480e-9f71-2196c52f4876 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a52352ab894e8f88be0f9d1cef0b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e32df90da6b43b7b8a562dd95e6833b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:54.499987 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8fc7b80c-949c-480e-9f71-2196c52f4876 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] 10.222.0.33 "GET /compute/v2.1/servers/1d9dafd4-e427-4349-a142-2c3ed281b2b2" status: 200 len: 1334 microversion: 2.1 time: 0.284705 Sep 23 04:50:54.521000 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2163/4455] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:54 2022] GET /compute/v2.1/servers/1d9dafd4-e427-4349-a142-2c3ed281b2b2 => generated 1334 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:54.523393 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-bb93b93c-beb8-4ec3-bf05-bbd6a3ff0046 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:54.524262 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-bb93b93c-beb8-4ec3-bf05-bbd6a3ff0046 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: c4464422-9bf1-4aaa-806c-d7063e284579] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:54.531010 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bb93b93c-beb8-4ec3-bf05-bbd6a3ff0046 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:54.531694 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bb93b93c-beb8-4ec3-bf05-bbd6a3ff0046 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:54.532315 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bb93b93c-beb8-4ec3-bf05-bbd6a3ff0046 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:54.533362 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bb93b93c-beb8-4ec3-bf05-bbd6a3ff0046 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:54.534021 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bb93b93c-beb8-4ec3-bf05-bbd6a3ff0046 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:54.534977 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bb93b93c-beb8-4ec3-bf05-bbd6a3ff0046 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:54.639169 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-883cde51-8f72-422d-889d-dffaff107be8 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:54.685265 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-883cde51-8f72-422d-889d-dffaff107be8 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1670 microversion: 2.1 time: 0.331025 Sep 23 04:50:54.689935 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2293/4456] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:54 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1670 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:50:54.713077 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-751d6460-6158-4d81-b52e-fb266e2a1bb5 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:54.713979 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-751d6460-6158-4d81-b52e-fb266e2a1bb5 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:54.719949 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-751d6460-6158-4d81-b52e-fb266e2a1bb5 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:54.722397 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-751d6460-6158-4d81-b52e-fb266e2a1bb5 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:54.722397 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-751d6460-6158-4d81-b52e-fb266e2a1bb5 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:54.722397 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-751d6460-6158-4d81-b52e-fb266e2a1bb5 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:54.722804 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-751d6460-6158-4d81-b52e-fb266e2a1bb5 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:54.723701 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-751d6460-6158-4d81-b52e-fb266e2a1bb5 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:54.865582 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-bb93b93c-beb8-4ec3-bf05-bbd6a3ff0046 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c786bbedc21849ea92924139a44707b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcafb05f6f554e278cd552023947c6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:54.874449 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-bb93b93c-beb8-4ec3-bf05-bbd6a3ff0046 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579" status: 200 len: 1690 microversion: 2.1 time: 0.355238 Sep 23 04:50:54.875141 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2164/4457] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:54 2022] GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579 => generated 1690 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:54.880077 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-94881f86-9d1a-4230-a564-c3ba8c190101 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:54.880921 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-94881f86-9d1a-4230-a564-c3ba8c190101 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:54.887703 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-94881f86-9d1a-4230-a564-c3ba8c190101 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:54.888589 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-94881f86-9d1a-4230-a564-c3ba8c190101 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:54.889118 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-94881f86-9d1a-4230-a564-c3ba8c190101 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:54.889929 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-94881f86-9d1a-4230-a564-c3ba8c190101 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:54.890486 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-94881f86-9d1a-4230-a564-c3ba8c190101 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:54.890990 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-94881f86-9d1a-4230-a564-c3ba8c190101 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:54.915452 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-751d6460-6158-4d81-b52e-fb266e2a1bb5 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:54.926422 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-751d6460-6158-4d81-b52e-fb266e2a1bb5 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1509 microversion: 2.1 time: 0.218656 Sep 23 04:50:54.944632 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2294/4458] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:54 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1509 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:55.101725 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-94881f86-9d1a-4230-a564-c3ba8c190101 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:55.111955 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-94881f86-9d1a-4230-a564-c3ba8c190101 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1670 microversion: 2.1 time: 0.235510 Sep 23 04:50:55.112927 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2165/4459] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:54 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1670 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:55.353753 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ee6a1ec6-7251-4bb1-a3f3-9a062cb96abd tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-246058951", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "networks": [{"uuid": "c808d35d-7b6c-439e-908b-4f409fd90fd4"}]}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:50:55.452763 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.neutron [None req-ee6a1ec6-7251-4bb1-a3f3-9a062cb96abd tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] validate_networks() for [('c808d35d-7b6c-439e-908b-4f409fd90fd4', None, None, None, None, None)] {{(pid=122699) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:50:55.527547 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7c8ccf64-9dca-4741-9a24-f72800c92691 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:55.529053 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7c8ccf64-9dca-4741-9a24-f72800c92691 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] [instance: 1d9dafd4-e427-4349-a142-2c3ed281b2b2] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:55.558677 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7c8ccf64-9dca-4741-9a24-f72800c92691 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:55.559765 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7c8ccf64-9dca-4741-9a24-f72800c92691 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:55.560614 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7c8ccf64-9dca-4741-9a24-f72800c92691 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:55.561556 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7c8ccf64-9dca-4741-9a24-f72800c92691 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:55.562415 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7c8ccf64-9dca-4741-9a24-f72800c92691 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:55.563227 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7c8ccf64-9dca-4741-9a24-f72800c92691 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:56.196449 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-7c8ccf64-9dca-4741-9a24-f72800c92691 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a52352ab894e8f88be0f9d1cef0b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e32df90da6b43b7b8a562dd95e6833b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:56.210633 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7c8ccf64-9dca-4741-9a24-f72800c92691 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] 10.222.0.33 "GET /compute/v2.1/servers/1d9dafd4-e427-4349-a142-2c3ed281b2b2" status: 200 len: 1334 microversion: 2.1 time: 0.687213 Sep 23 04:50:56.214354 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2166/4460] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:55 2022] GET /compute/v2.1/servers/1d9dafd4-e427-4349-a142-2c3ed281b2b2 => generated 1334 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:50:56.226494 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-818b47fa-224d-4378-9135-df414c653dca tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:56.227606 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-818b47fa-224d-4378-9135-df414c653dca tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: c4464422-9bf1-4aaa-806c-d7063e284579] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:56.248896 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-818b47fa-224d-4378-9135-df414c653dca tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:56.249424 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-818b47fa-224d-4378-9135-df414c653dca tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:56.249968 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-818b47fa-224d-4378-9135-df414c653dca tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:56.258741 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-818b47fa-224d-4378-9135-df414c653dca tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:56.258741 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-818b47fa-224d-4378-9135-df414c653dca tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:56.258741 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-818b47fa-224d-4378-9135-df414c653dca tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:56.675667 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-ee6a1ec6-7251-4bb1-a3f3-9a062cb96abd tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Flavor limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:50:56.676826 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-ee6a1ec6-7251-4bb1-a3f3-9a062cb96abd tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Image limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:50:56.677342 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-ee6a1ec6-7251-4bb1-a3f3-9a062cb96abd tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Flavor pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:50:56.678204 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-ee6a1ec6-7251-4bb1-a3f3-9a062cb96abd tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Image pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:50:56.678626 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-ee6a1ec6-7251-4bb1-a3f3-9a062cb96abd tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:50:56.699481 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ee6a1ec6-7251-4bb1-a3f3-9a062cb96abd tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:56.699983 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ee6a1ec6-7251-4bb1-a3f3-9a062cb96abd tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:56.700650 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ee6a1ec6-7251-4bb1-a3f3-9a062cb96abd tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:56.701705 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ee6a1ec6-7251-4bb1-a3f3-9a062cb96abd tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:56.702471 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ee6a1ec6-7251-4bb1-a3f3-9a062cb96abd tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:56.703101 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ee6a1ec6-7251-4bb1-a3f3-9a062cb96abd tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:56.750302 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-ee6a1ec6-7251-4bb1-a3f3-9a062cb96abd tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Getting quotas for project 2a45d69316a648fcb9c56190aaec5376. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:50:56.776204 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-ee6a1ec6-7251-4bb1-a3f3-9a062cb96abd tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Getting quotas for user f5e3a6e455e8483b8ce93ad380793335 and project 2a45d69316a648fcb9c56190aaec5376. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:50:56.784944 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ee6a1ec6-7251-4bb1-a3f3-9a062cb96abd tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Going to run 1 instances... {{(pid=122699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:50:56.787765 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ee6a1ec6-7251-4bb1-a3f3-9a062cb96abd tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 1aaa2f54-26e8-4141-aa20-276704f85832] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:50:56.797554 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-818b47fa-224d-4378-9135-df414c653dca tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c786bbedc21849ea92924139a44707b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcafb05f6f554e278cd552023947c6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:56.808675 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-818b47fa-224d-4378-9135-df414c653dca tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579" status: 200 len: 1690 microversion: 2.1 time: 0.592720 Sep 23 04:50:56.809696 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2167/4461] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:56 2022] GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579 => generated 1690 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:56.818452 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-de3032c8-8533-46eb-b7ca-0224045d32a4 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:56.822058 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-de3032c8-8533-46eb-b7ca-0224045d32a4 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:56.827836 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-de3032c8-8533-46eb-b7ca-0224045d32a4 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:56.828422 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-de3032c8-8533-46eb-b7ca-0224045d32a4 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:56.828878 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-de3032c8-8533-46eb-b7ca-0224045d32a4 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:56.830214 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-de3032c8-8533-46eb-b7ca-0224045d32a4 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:56.830917 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-de3032c8-8533-46eb-b7ca-0224045d32a4 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:56.831522 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-de3032c8-8533-46eb-b7ca-0224045d32a4 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:56.955134 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ee6a1ec6-7251-4bb1-a3f3-9a062cb96abd tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.603583 Sep 23 04:50:56.962175 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2295/4462] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:50:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1609 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:50:56.967315 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-df1ba498-9300-4fc8-b610-0e8281e1c6b6 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:56.973009 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-df1ba498-9300-4fc8-b610-0e8281e1c6b6 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 1aaa2f54-26e8-4141-aa20-276704f85832] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:57.091729 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-df1ba498-9300-4fc8-b610-0e8281e1c6b6 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:57.104518 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-de3032c8-8533-46eb-b7ca-0224045d32a4 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:57.128400 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-de3032c8-8533-46eb-b7ca-0224045d32a4 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1509 microversion: 2.1 time: 0.317483 Sep 23 04:50:57.129016 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2168/4463] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:56 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1509 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:57.130052 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-df1ba498-9300-4fc8-b610-0e8281e1c6b6 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/1aaa2f54-26e8-4141-aa20-276704f85832" status: 200 len: 1214 microversion: 2.1 time: 0.166553 Sep 23 04:50:57.132372 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2296/4464] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:56 2022] GET /compute/v2.1/servers/1aaa2f54-26e8-4141-aa20-276704f85832 => generated 1214 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:50:57.241130 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-fca5962b-491c-40c3-8300-99388ba27cb7 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:57.241754 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-fca5962b-491c-40c3-8300-99388ba27cb7 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] [instance: 1d9dafd4-e427-4349-a142-2c3ed281b2b2] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:57.251112 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fca5962b-491c-40c3-8300-99388ba27cb7 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:57.253381 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fca5962b-491c-40c3-8300-99388ba27cb7 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:57.253881 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fca5962b-491c-40c3-8300-99388ba27cb7 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:57.259084 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fca5962b-491c-40c3-8300-99388ba27cb7 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:57.259084 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fca5962b-491c-40c3-8300-99388ba27cb7 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:57.259084 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fca5962b-491c-40c3-8300-99388ba27cb7 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:57.837341 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-61cc23e1-1d53-41c1-8cd3-f99196f719fd tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:57.837341 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-61cc23e1-1d53-41c1-8cd3-f99196f719fd tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: c4464422-9bf1-4aaa-806c-d7063e284579] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:57.846146 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-61cc23e1-1d53-41c1-8cd3-f99196f719fd tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:57.847135 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-61cc23e1-1d53-41c1-8cd3-f99196f719fd tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:57.848062 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-61cc23e1-1d53-41c1-8cd3-f99196f719fd tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:57.849308 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-61cc23e1-1d53-41c1-8cd3-f99196f719fd tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:57.853839 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-61cc23e1-1d53-41c1-8cd3-f99196f719fd tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:57.855287 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-61cc23e1-1d53-41c1-8cd3-f99196f719fd tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:58.043752 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-61cc23e1-1d53-41c1-8cd3-f99196f719fd tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c786bbedc21849ea92924139a44707b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcafb05f6f554e278cd552023947c6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:58.054844 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-61cc23e1-1d53-41c1-8cd3-f99196f719fd tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579" status: 200 len: 1623 microversion: 2.1 time: 0.224274 Sep 23 04:50:58.055435 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2297/4465] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:57 2022] GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579 => generated 1623 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:58.159407 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d79492aa-a982-4d48-859d-fd776c997396 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:58.160102 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d79492aa-a982-4d48-859d-fd776c997396 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:58.175949 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d79492aa-a982-4d48-859d-fd776c997396 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:58.176429 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d79492aa-a982-4d48-859d-fd776c997396 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:58.183025 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d79492aa-a982-4d48-859d-fd776c997396 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:58.183933 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d79492aa-a982-4d48-859d-fd776c997396 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:58.184443 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d79492aa-a982-4d48-859d-fd776c997396 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:58.184897 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d79492aa-a982-4d48-859d-fd776c997396 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:58.379618 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-fca5962b-491c-40c3-8300-99388ba27cb7 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a52352ab894e8f88be0f9d1cef0b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e32df90da6b43b7b8a562dd95e6833b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:58.397873 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-fca5962b-491c-40c3-8300-99388ba27cb7 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] 10.222.0.33 "GET /compute/v2.1/servers/1d9dafd4-e427-4349-a142-2c3ed281b2b2" status: 200 len: 1334 microversion: 2.1 time: 1.160751 Sep 23 04:50:58.399505 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2169/4466] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:57 2022] GET /compute/v2.1/servers/1d9dafd4-e427-4349-a142-2c3ed281b2b2 => generated 1334 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:58.447674 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-30d3bf06-09f5-48ca-9282-ee19a63ad269 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:58.449977 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-30d3bf06-09f5-48ca-9282-ee19a63ad269 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 1aaa2f54-26e8-4141-aa20-276704f85832] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:58.559178 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-30d3bf06-09f5-48ca-9282-ee19a63ad269 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:58.577881 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-30d3bf06-09f5-48ca-9282-ee19a63ad269 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/1aaa2f54-26e8-4141-aa20-276704f85832" status: 200 len: 1214 microversion: 2.1 time: 0.172643 Sep 23 04:50:58.578602 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2170/4467] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:58 2022] GET /compute/v2.1/servers/1aaa2f54-26e8-4141-aa20-276704f85832 => generated 1214 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:58.689118 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-44fe35fa-a59a-464a-8e3f-1a0d44b253d7 req-8c23d124-db1d-4ea3-841c-d40d10b7f123 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d9dafd4-e427-4349-a142-2c3ed281b2b2", "tag": "a16e86e5-bb3a-4b84-bab2-3392aac0f422"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:50:58.702996 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-44fe35fa-a59a-464a-8e3f-1a0d44b253d7 req-8c23d124-db1d-4ea3-841c-d40d10b7f123 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:58.704706 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-44fe35fa-a59a-464a-8e3f-1a0d44b253d7 req-8c23d124-db1d-4ea3-841c-d40d10b7f123 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:58.708047 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-44fe35fa-a59a-464a-8e3f-1a0d44b253d7 req-8c23d124-db1d-4ea3-841c-d40d10b7f123 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:58.723795 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d79492aa-a982-4d48-859d-fd776c997396 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:58.730899 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-44fe35fa-a59a-464a-8e3f-1a0d44b253d7 req-8c23d124-db1d-4ea3-841c-d40d10b7f123 service nova] Creating event network-changed:a16e86e5-bb3a-4b84-bab2-3392aac0f422 for instance 1d9dafd4-e427-4349-a142-2c3ed281b2b2 on n-h1-846463-3 Sep 23 04:50:58.735331 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d79492aa-a982-4d48-859d-fd776c997396 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1509 microversion: 2.1 time: 0.582032 Sep 23 04:50:58.748874 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-44fe35fa-a59a-464a-8e3f-1a0d44b253d7 req-8c23d124-db1d-4ea3-841c-d40d10b7f123 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063592 Sep 23 04:50:58.749979 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2171/4468] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:50:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:50:58.752636 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2298/4469] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:58 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1509 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:59.428472 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-59f902fe-6c61-4345-87fd-296b96819eb1 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:59.429103 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-59f902fe-6c61-4345-87fd-296b96819eb1 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] [instance: 1d9dafd4-e427-4349-a142-2c3ed281b2b2] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:59.457645 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8ddd118b-e827-40ba-9526-04d1ac933e3c tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:59.458559 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8ddd118b-e827-40ba-9526-04d1ac933e3c tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: c4464422-9bf1-4aaa-806c-d7063e284579] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:59.461385 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-59f902fe-6c61-4345-87fd-296b96819eb1 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:59.461986 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-59f902fe-6c61-4345-87fd-296b96819eb1 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:59.462506 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-59f902fe-6c61-4345-87fd-296b96819eb1 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:59.463217 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-59f902fe-6c61-4345-87fd-296b96819eb1 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:59.463683 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-59f902fe-6c61-4345-87fd-296b96819eb1 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:59.464124 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-59f902fe-6c61-4345-87fd-296b96819eb1 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:59.466571 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8ddd118b-e827-40ba-9526-04d1ac933e3c tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:59.467161 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8ddd118b-e827-40ba-9526-04d1ac933e3c tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:59.467829 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8ddd118b-e827-40ba-9526-04d1ac933e3c tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:59.468878 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8ddd118b-e827-40ba-9526-04d1ac933e3c tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:59.469566 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8ddd118b-e827-40ba-9526-04d1ac933e3c tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:59.470036 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8ddd118b-e827-40ba-9526-04d1ac933e3c tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:59.649538 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8ddd118b-e827-40ba-9526-04d1ac933e3c tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c786bbedc21849ea92924139a44707b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcafb05f6f554e278cd552023947c6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:59.666201 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8ddd118b-e827-40ba-9526-04d1ac933e3c tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579" status: 200 len: 1331 microversion: 2.1 time: 0.586871 Sep 23 04:50:59.667061 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2172/4470] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:59 2022] GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579 => generated 1331 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:59.675177 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-57cc7b16-a62f-42c4-8671-6c649951338c tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:59.675798 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-57cc7b16-a62f-42c4-8671-6c649951338c tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 1aaa2f54-26e8-4141-aa20-276704f85832] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:59.692446 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-57cc7b16-a62f-42c4-8671-6c649951338c tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:59.697434 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-57cc7b16-a62f-42c4-8671-6c649951338c tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:59.698366 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-57cc7b16-a62f-42c4-8671-6c649951338c tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:59.699271 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-57cc7b16-a62f-42c4-8671-6c649951338c tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:59.699899 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-57cc7b16-a62f-42c4-8671-6c649951338c tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:59.700868 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-57cc7b16-a62f-42c4-8671-6c649951338c tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:59.707369 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:50:59.803745 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-59f902fe-6c61-4345-87fd-296b96819eb1 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a52352ab894e8f88be0f9d1cef0b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e32df90da6b43b7b8a562dd95e6833b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:59.812016 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-59f902fe-6c61-4345-87fd-296b96819eb1 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] 10.222.0.33 "GET /compute/v2.1/servers/1d9dafd4-e427-4349-a142-2c3ed281b2b2" status: 200 len: 1334 microversion: 2.1 time: 0.390147 Sep 23 04:50:59.814869 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2299/4471] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:59 2022] GET /compute/v2.1/servers/1d9dafd4-e427-4349-a142-2c3ed281b2b2 => generated 1334 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:59.832292 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b543d25d-e65f-4c4f-b382-fbdc47930fa0 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1008301794", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6b012070-a2c4-48c7-9b56-4366fa30168a"}], "security_groups": [{"name": "tempest-securitygroup--1462745099"}], "key_name": "tempest-keypair-109559585", "user_data": "}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:50:59.839960 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-57cc7b16-a62f-42c4-8671-6c649951338c tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:50:59.853124 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-57cc7b16-a62f-42c4-8671-6c649951338c tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/1aaa2f54-26e8-4141-aa20-276704f85832" status: 200 len: 1266 microversion: 2.1 time: 0.184621 Sep 23 04:50:59.853729 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2173/4472] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:59 2022] GET /compute/v2.1/servers/1aaa2f54-26e8-4141-aa20-276704f85832 => generated 1266 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:50:59.873044 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-152d907c-6631-4662-bf2f-2460eab413f2 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:50:59.876275 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-152d907c-6631-4662-bf2f-2460eab413f2 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:50:59.893398 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-152d907c-6631-4662-bf2f-2460eab413f2 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:59.901494 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-152d907c-6631-4662-bf2f-2460eab413f2 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:59.902109 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-152d907c-6631-4662-bf2f-2460eab413f2 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:50:59.903047 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-152d907c-6631-4662-bf2f-2460eab413f2 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:50:59.903629 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-152d907c-6631-4662-bf2f-2460eab413f2 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:50:59.904252 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-152d907c-6631-4662-bf2f-2460eab413f2 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:00.031989 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.neutron [None req-b543d25d-e65f-4c4f-b382-fbdc47930fa0 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] validate_networks() for [('6b012070-a2c4-48c7-9b56-4366fa30168a', None, None, None, None, None)] {{(pid=122699) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:51:00.163987 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-152d907c-6631-4662-bf2f-2460eab413f2 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:00.173023 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-152d907c-6631-4662-bf2f-2460eab413f2 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1509 microversion: 2.1 time: 0.313218 Sep 23 04:51:00.173720 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2174/4473] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:50:59 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1509 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:51:00.693827 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c865fc64-e028-40d0-8a1b-a8082062d265 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:00.694692 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c865fc64-e028-40d0-8a1b-a8082062d265 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: c4464422-9bf1-4aaa-806c-d7063e284579] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:00.712774 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c865fc64-e028-40d0-8a1b-a8082062d265 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:00.723223 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c865fc64-e028-40d0-8a1b-a8082062d265 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:00.728443 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c865fc64-e028-40d0-8a1b-a8082062d265 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:00.732336 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c865fc64-e028-40d0-8a1b-a8082062d265 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:00.734597 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c865fc64-e028-40d0-8a1b-a8082062d265 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:00.737114 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c865fc64-e028-40d0-8a1b-a8082062d265 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:00.779989 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-c865fc64-e028-40d0-8a1b-a8082062d265 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] HTTP exception thrown: Instance c4464422-9bf1-4aaa-806c-d7063e284579 could not be found. Sep 23 04:51:00.783365 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c865fc64-e028-40d0-8a1b-a8082062d265 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Request method failure captured: Sep 23 04:51:00.783365 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579 HTTP/1.1 Sep 23 04:51:00.783365 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:51:00.783365 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:51:00.783365 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:51:00.783365 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:51:00.783365 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:51:00.783365 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:51:00.783365 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:51:00.783365 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:51:00.783365 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLToEB3KmJeqpeof3qtE1_ms3jD5q4R8EB4mtf6agEJBYOf3R1k1wW8qdql02e7ra521m3dklynQTAHmyD-EBkyV9p_88fIs_nz1LT08tnPBKYcM8ytHDfif-4FU40Ttv4qlVJY_DNQ2W4b2ZBQdDVOwU9-lTsZtqbQggZ1JBKRn9aZQ Sep 23 04:51:00.783365 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:51:00.783365 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:51:00.783365 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:51:00.783365 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:51:00.783365 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:51:00.783365 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:51:00.783365 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: dcafb05f6f554e278cd552023947c6ac Sep 23 04:51:00.783365 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-196358672 Sep 23 04:51:00.783365 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:51:00.783365 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:51:00.783365 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_dcafb05f6f554e278cd552023947c6ac", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dcafb05f6f554e278cd552023947c6ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/dcafb05f6f554e278cd552023947c6ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dcafb05f6f554e278cd552023947c6ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:51:00.783365 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ServerRescueNegativeTestJSON-196358672 Sep 23 04:51:00.783365 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: dcafb05f6f554e278cd552023947c6ac Sep 23 04:51:00.783365 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-196358672 Sep 23 04:51:00.783365 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ServerRescueNegativeTestJSON-196358672-project Sep 23 04:51:00.783365 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:51:00.783365 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:51:00.783365 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: c786bbedc21849ea92924139a44707b7 Sep 23 04:51:00.783365 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ServerRescueNegativeTestJSON-196358672-project Sep 23 04:51:00.783365 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:51:00.783365 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance c4464422-9bf1-4aaa-806c-d7063e284579 could not be found. Sep 23 04:51:00.783365 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': 'c4464422-9bf1-4aaa-806c-d7063e284579'} Sep 23 04:51:00.783365 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:51:00.783365 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:51:00.783365 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:51:00.783365 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:51:00.783365 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:51:00.783365 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:51:00.783365 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:51:00.783365 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:51:00.783365 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:51:00.783365 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:51:00.783365 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4464422-9bf1-4aaa-806c-d7063e284579 could not be found. Sep 23 04:51:00.783365 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:51:00.783365 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:51:00.783365 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:51:00.783365 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:51:00.783365 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:51:00.783365 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:51:00.783365 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:51:00.783365 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:51:00.783365 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:51:00.783365 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:51:00.783365 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:51:00.783365 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:51:00.783365 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:51:00.783365 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:51:00.783365 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:51:00.783365 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:51:00.783365 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4464422-9bf1-4aaa-806c-d7063e284579 could not be found. Sep 23 04:51:00.783365 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:51:00.783365 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:51:00.793129 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:51:00.793129 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:51:00.793129 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:51:00.793129 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:51:00.793129 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:51:00.793129 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:51:00.793129 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4464422-9bf1-4aaa-806c-d7063e284579 could not be found. Sep 23 04:51:00.793129 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:51:00.793129 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c865fc64-e028-40d0-8a1b-a8082062d265 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Returning 404 to user: Instance c4464422-9bf1-4aaa-806c-d7063e284579 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:51:00.793129 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c865fc64-e028-40d0-8a1b-a8082062d265 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579" status: 404 len: 111 microversion: 2.1 time: 0.095618 Sep 23 04:51:00.794812 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2175/4474] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:00 2022] GET /compute/v2.1/servers/c4464422-9bf1-4aaa-806c-d7063e284579 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 04:51:00.803003 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-2f442dd6-55ea-4146-95e2-a2ba45700d6a req-2fa87e9e-823e-4e0f-9a77-7dda5f91f780 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4464422-9bf1-4aaa-806c-d7063e284579", "name": "network-vif-deleted", "tag": "1996c9a9-f009-4ec9-a3d8-6f5d1f1f1a46"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:51:00.829646 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-2f442dd6-55ea-4146-95e2-a2ba45700d6a req-2fa87e9e-823e-4e0f-9a77-7dda5f91f780 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:00.831414 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-2f442dd6-55ea-4146-95e2-a2ba45700d6a req-2fa87e9e-823e-4e0f-9a77-7dda5f91f780 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:00.832149 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-2f442dd6-55ea-4146-95e2-a2ba45700d6a req-2fa87e9e-823e-4e0f-9a77-7dda5f91f780 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:00.860380 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-b543d25d-e65f-4c4f-b382-fbdc47930fa0 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Flavor limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:51:00.863845 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-b543d25d-e65f-4c4f-b382-fbdc47930fa0 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Image limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:51:00.864585 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-b543d25d-e65f-4c4f-b382-fbdc47930fa0 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Flavor pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:51:00.867591 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-b543d25d-e65f-4c4f-b382-fbdc47930fa0 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Image pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:51:00.867591 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-b543d25d-e65f-4c4f-b382-fbdc47930fa0 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:51:00.898224 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-2f442dd6-55ea-4146-95e2-a2ba45700d6a req-2fa87e9e-823e-4e0f-9a77-7dda5f91f780 service nova] Creating event network-vif-deleted:1996c9a9-f009-4ec9-a3d8-6f5d1f1f1a46 for instance c4464422-9bf1-4aaa-806c-d7063e284579 on n-h1-846463-3 Sep 23 04:51:00.900165 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b543d25d-e65f-4c4f-b382-fbdc47930fa0 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:00.904877 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b543d25d-e65f-4c4f-b382-fbdc47930fa0 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:00.904877 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b543d25d-e65f-4c4f-b382-fbdc47930fa0 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:00.904877 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b543d25d-e65f-4c4f-b382-fbdc47930fa0 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:00.904877 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b543d25d-e65f-4c4f-b382-fbdc47930fa0 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:00.904877 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b543d25d-e65f-4c4f-b382-fbdc47930fa0 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:00.914857 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-2f442dd6-55ea-4146-95e2-a2ba45700d6a req-2fa87e9e-823e-4e0f-9a77-7dda5f91f780 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116183 Sep 23 04:51:00.917867 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2176/4475] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:51:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:51:00.933672 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0d1db5f4-33f5-454d-b8b5-f2c8dfae32ee tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '.version_select at 0x7ff1bb83cee0>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:00.976093 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-b543d25d-e65f-4c4f-b382-fbdc47930fa0 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Getting quotas for project 1cdfe96be196470889a58b56a19743a7. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:51:00.992684 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-b543d25d-e65f-4c4f-b382-fbdc47930fa0 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Getting quotas for user b87ca7119ee042c3bda1e88ff38fdb7c and project 1cdfe96be196470889a58b56a19743a7. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:51:01.011751 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b543d25d-e65f-4c4f-b382-fbdc47930fa0 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Going to run 1 instances... {{(pid=122699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:51:01.014413 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b543d25d-e65f-4c4f-b382-fbdc47930fa0 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: f285e256-0a0e-4126-8adf-643bd59ca141] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:51:01.099240 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0d1db5f4-33f5-454d-b8b5-f2c8dfae32ee tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1757192797" status: 202 len: 0 microversion: 2.1 time: 0.176003 Sep 23 04:51:01.105184 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2177/4476] 10.222.0.33 () {58 vars in 1221 bytes} [Fri Sep 23 04:51:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1757192797 => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:51:01.112463 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-737cbf2b-ea7d-4930-b003-4980355055a2 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:01.116958 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-737cbf2b-ea7d-4930-b003-4980355055a2 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] [instance: 1d9dafd4-e427-4349-a142-2c3ed281b2b2] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:01.133754 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-737cbf2b-ea7d-4930-b003-4980355055a2 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:01.138838 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-737cbf2b-ea7d-4930-b003-4980355055a2 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:01.138838 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-737cbf2b-ea7d-4930-b003-4980355055a2 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:01.143059 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-737cbf2b-ea7d-4930-b003-4980355055a2 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:01.144894 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-737cbf2b-ea7d-4930-b003-4980355055a2 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:01.146317 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-737cbf2b-ea7d-4930-b003-4980355055a2 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:01.298140 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b543d25d-e65f-4c4f-b382-fbdc47930fa0 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.480695 Sep 23 04:51:01.307563 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2300/4477] 10.222.0.33 () {62 vars in 1188 bytes} [Fri Sep 23 04:50:59 2022] POST /compute/v2.1/servers => generated 402 bytes in 1486 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 23 04:51:01.353497 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ad2fbb60-2b6c-42b7-84c5-07e554ce5662 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:01.354474 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ad2fbb60-2b6c-42b7-84c5-07e554ce5662 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 1aaa2f54-26e8-4141-aa20-276704f85832] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:01.367696 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ad2fbb60-2b6c-42b7-84c5-07e554ce5662 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:01.368494 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ad2fbb60-2b6c-42b7-84c5-07e554ce5662 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:01.370225 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ad2fbb60-2b6c-42b7-84c5-07e554ce5662 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:01.371347 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ad2fbb60-2b6c-42b7-84c5-07e554ce5662 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:01.373016 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ad2fbb60-2b6c-42b7-84c5-07e554ce5662 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:01.375335 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ad2fbb60-2b6c-42b7-84c5-07e554ce5662 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:01.526523 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-737cbf2b-ea7d-4930-b003-4980355055a2 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a52352ab894e8f88be0f9d1cef0b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e32df90da6b43b7b8a562dd95e6833b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:01.539934 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-737cbf2b-ea7d-4930-b003-4980355055a2 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] 10.222.0.33 "GET /compute/v2.1/servers/1d9dafd4-e427-4349-a142-2c3ed281b2b2" status: 200 len: 1334 microversion: 2.1 time: 0.431563 Sep 23 04:51:01.540599 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2178/4478] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:01 2022] GET /compute/v2.1/servers/1d9dafd4-e427-4349-a142-2c3ed281b2b2 => generated 1334 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:51:01.561192 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-704ce88d-41f0-4caf-bb05-fe944dc4c9c3 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:01.561956 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-704ce88d-41f0-4caf-bb05-fe944dc4c9c3 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:01.584935 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-704ce88d-41f0-4caf-bb05-fe944dc4c9c3 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:01.588344 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-704ce88d-41f0-4caf-bb05-fe944dc4c9c3 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:01.589949 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-704ce88d-41f0-4caf-bb05-fe944dc4c9c3 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:01.607644 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-704ce88d-41f0-4caf-bb05-fe944dc4c9c3 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:01.607644 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-704ce88d-41f0-4caf-bb05-fe944dc4c9c3 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:01.607644 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-704ce88d-41f0-4caf-bb05-fe944dc4c9c3 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:01.628867 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ad2fbb60-2b6c-42b7-84c5-07e554ce5662 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:01.648354 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ad2fbb60-2b6c-42b7-84c5-07e554ce5662 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/1aaa2f54-26e8-4141-aa20-276704f85832" status: 200 len: 1284 microversion: 2.1 time: 0.343247 Sep 23 04:51:01.648950 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2301/4479] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:01 2022] GET /compute/v2.1/servers/1aaa2f54-26e8-4141-aa20-276704f85832 => generated 1284 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:51:01.661548 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8fa00f4c-e96a-4451-8dad-561dbda22d04 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:01.662187 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-8fa00f4c-e96a-4451-8dad-561dbda22d04 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: f285e256-0a0e-4126-8adf-643bd59ca141] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:01.775286 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-8fa00f4c-e96a-4451-8dad-561dbda22d04 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:01.787204 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-8fa00f4c-e96a-4451-8dad-561dbda22d04 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:01.789925 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-8fa00f4c-e96a-4451-8dad-561dbda22d04 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:01.794678 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-8fa00f4c-e96a-4451-8dad-561dbda22d04 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141" status: 200 len: 1281 microversion: 2.20 time: 0.141876 Sep 23 04:51:01.805932 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2302/4480] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:51:01 2022] GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141 => generated 1281 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:51:01.871880 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-704ce88d-41f0-4caf-bb05-fe944dc4c9c3 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:01.882913 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-704ce88d-41f0-4caf-bb05-fe944dc4c9c3 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1509 microversion: 2.1 time: 0.340404 Sep 23 04:51:01.884136 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2179/4481] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:01 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1509 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:51:02.567628 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-29b933fd-98e3-469b-89e4-85478ee619ba tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:02.568867 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-29b933fd-98e3-469b-89e4-85478ee619ba tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] [instance: 1d9dafd4-e427-4349-a142-2c3ed281b2b2] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:02.580653 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-29b933fd-98e3-469b-89e4-85478ee619ba tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:02.583396 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-29b933fd-98e3-469b-89e4-85478ee619ba tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:02.583734 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-29b933fd-98e3-469b-89e4-85478ee619ba tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:02.584502 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-29b933fd-98e3-469b-89e4-85478ee619ba tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:02.585944 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-29b933fd-98e3-469b-89e4-85478ee619ba tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:02.586404 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-29b933fd-98e3-469b-89e4-85478ee619ba tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:02.689269 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e111db2a-9a04-4ae1-9a98-6bed8b346b8b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:02.690349 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e111db2a-9a04-4ae1-9a98-6bed8b346b8b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 1aaa2f54-26e8-4141-aa20-276704f85832] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:02.697518 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e111db2a-9a04-4ae1-9a98-6bed8b346b8b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:02.699984 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e111db2a-9a04-4ae1-9a98-6bed8b346b8b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:02.700667 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e111db2a-9a04-4ae1-9a98-6bed8b346b8b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:02.701607 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e111db2a-9a04-4ae1-9a98-6bed8b346b8b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:02.702819 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e111db2a-9a04-4ae1-9a98-6bed8b346b8b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:02.703447 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e111db2a-9a04-4ae1-9a98-6bed8b346b8b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:03.358520 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-29b933fd-98e3-469b-89e4-85478ee619ba tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a52352ab894e8f88be0f9d1cef0b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e32df90da6b43b7b8a562dd95e6833b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:03.358520 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=100 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:51:03.358520 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-29b933fd-98e3-469b-89e4-85478ee619ba tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] 10.222.0.33 "GET /compute/v2.1/servers/1d9dafd4-e427-4349-a142-2c3ed281b2b2" status: 200 len: 1334 microversion: 2.1 time: 0.576237 Sep 23 04:51:03.358520 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2303/4482] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:02 2022] GET /compute/v2.1/servers/1d9dafd4-e427-4349-a142-2c3ed281b2b2 => generated 1334 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:51:03.358520 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f0a81673-a545-41d8-90d0-7f415b5882ec tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:03.358520 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f0a81673-a545-41d8-90d0-7f415b5882ec tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: f285e256-0a0e-4126-8adf-643bd59ca141] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:03.358520 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f0a81673-a545-41d8-90d0-7f415b5882ec tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:03.358520 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f0a81673-a545-41d8-90d0-7f415b5882ec tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:03.358520 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f0a81673-a545-41d8-90d0-7f415b5882ec tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:03.358520 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f0a81673-a545-41d8-90d0-7f415b5882ec tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:03.358520 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f0a81673-a545-41d8-90d0-7f415b5882ec tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:03.358520 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f0a81673-a545-41d8-90d0-7f415b5882ec tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:03.360944 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e111db2a-9a04-4ae1-9a98-6bed8b346b8b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:03.360944 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e111db2a-9a04-4ae1-9a98-6bed8b346b8b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/1aaa2f54-26e8-4141-aa20-276704f85832" status: 200 len: 1314 microversion: 2.1 time: 0.569957 Sep 23 04:51:03.360944 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2180/4483] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:02 2022] GET /compute/v2.1/servers/1aaa2f54-26e8-4141-aa20-276704f85832 => generated 1314 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:51:03.360944 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1237fb25-d40c-4d23-bcb2-6e7a9d86daa1 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:03.360944 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-1237fb25-d40c-4d23-bcb2-6e7a9d86daa1 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:03.360944 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1237fb25-d40c-4d23-bcb2-6e7a9d86daa1 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:03.360944 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1237fb25-d40c-4d23-bcb2-6e7a9d86daa1 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:03.361824 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f0a81673-a545-41d8-90d0-7f415b5882ec tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:03.362467 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1237fb25-d40c-4d23-bcb2-6e7a9d86daa1 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:03.362467 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1237fb25-d40c-4d23-bcb2-6e7a9d86daa1 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:03.362467 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1237fb25-d40c-4d23-bcb2-6e7a9d86daa1 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:03.362467 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1237fb25-d40c-4d23-bcb2-6e7a9d86daa1 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:03.362723 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f0a81673-a545-41d8-90d0-7f415b5882ec tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:03.362723 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f0a81673-a545-41d8-90d0-7f415b5882ec tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:03.362723 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f0a81673-a545-41d8-90d0-7f415b5882ec tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141" status: 200 len: 1285 microversion: 2.20 time: 0.122206 Sep 23 04:51:03.362723 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2304/4484] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:51:03 2022] GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141 => generated 1285 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:51:03.434643 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-1237fb25-d40c-4d23-bcb2-6e7a9d86daa1 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:03.442955 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-1237fb25-d40c-4d23-bcb2-6e7a9d86daa1 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1509 microversion: 2.1 time: 0.200208 Sep 23 04:51:03.443534 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2181/4485] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:03 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1509 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:51:04.189594 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-58ca561d-631a-445b-973b-aa0ef97a7ce1 req-c05d8bbb-c967-4481-9f0f-734a7e723025 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1aaa2f54-26e8-4141-aa20-276704f85832", "tag": "11292752-bbaf-4bd3-857a-dc22e908e857"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:51:04.203279 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-58ca561d-631a-445b-973b-aa0ef97a7ce1 req-c05d8bbb-c967-4481-9f0f-734a7e723025 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:04.204002 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-58ca561d-631a-445b-973b-aa0ef97a7ce1 req-c05d8bbb-c967-4481-9f0f-734a7e723025 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:04.205201 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-58ca561d-631a-445b-973b-aa0ef97a7ce1 req-c05d8bbb-c967-4481-9f0f-734a7e723025 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:04.249138 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-58ca561d-631a-445b-973b-aa0ef97a7ce1 req-c05d8bbb-c967-4481-9f0f-734a7e723025 service nova] Creating event network-changed:11292752-bbaf-4bd3-857a-dc22e908e857 for instance 1aaa2f54-26e8-4141-aa20-276704f85832 on n-h2-846463-3 Sep 23 04:51:04.279242 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-58ca561d-631a-445b-973b-aa0ef97a7ce1 req-c05d8bbb-c967-4481-9f0f-734a7e723025 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099462 Sep 23 04:51:04.284039 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2305/4486] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:51:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:51:04.375102 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e4ce5288-aa58-41e6-b2c1-914f7f552021 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:04.377030 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0959776c-4b81-4b9a-ae49-0a4e89cca65b tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:04.380282 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e4ce5288-aa58-41e6-b2c1-914f7f552021 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 1aaa2f54-26e8-4141-aa20-276704f85832] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:04.382477 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-0959776c-4b81-4b9a-ae49-0a4e89cca65b tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] [instance: 1d9dafd4-e427-4349-a142-2c3ed281b2b2] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:04.397449 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0959776c-4b81-4b9a-ae49-0a4e89cca65b tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:04.398007 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0959776c-4b81-4b9a-ae49-0a4e89cca65b tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:04.411996 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e4ce5288-aa58-41e6-b2c1-914f7f552021 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:04.412762 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e4ce5288-aa58-41e6-b2c1-914f7f552021 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:04.412971 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0959776c-4b81-4b9a-ae49-0a4e89cca65b tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:04.425323 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e4ce5288-aa58-41e6-b2c1-914f7f552021 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:04.426252 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e4ce5288-aa58-41e6-b2c1-914f7f552021 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:04.426881 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e4ce5288-aa58-41e6-b2c1-914f7f552021 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:04.427178 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e4ce5288-aa58-41e6-b2c1-914f7f552021 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:04.429335 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0959776c-4b81-4b9a-ae49-0a4e89cca65b tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:04.429981 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0959776c-4b81-4b9a-ae49-0a4e89cca65b tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:04.430433 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0959776c-4b81-4b9a-ae49-0a4e89cca65b tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:04.786711 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-0959776c-4b81-4b9a-ae49-0a4e89cca65b tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a52352ab894e8f88be0f9d1cef0b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e32df90da6b43b7b8a562dd95e6833b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:04.795876 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0959776c-4b81-4b9a-ae49-0a4e89cca65b tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] 10.222.0.33 "GET /compute/v2.1/servers/1d9dafd4-e427-4349-a142-2c3ed281b2b2" status: 200 len: 1334 microversion: 2.1 time: 0.426072 Sep 23 04:51:04.799218 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2306/4487] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:04 2022] GET /compute/v2.1/servers/1d9dafd4-e427-4349-a142-2c3ed281b2b2 => generated 1334 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:51:04.828643 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-be53d618-cafa-4dbc-9e5a-480410b89b80 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:04.832657 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-be53d618-cafa-4dbc-9e5a-480410b89b80 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: f285e256-0a0e-4126-8adf-643bd59ca141] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:04.854022 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-be53d618-cafa-4dbc-9e5a-480410b89b80 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:04.859001 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-be53d618-cafa-4dbc-9e5a-480410b89b80 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:04.859001 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-be53d618-cafa-4dbc-9e5a-480410b89b80 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:04.861297 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-be53d618-cafa-4dbc-9e5a-480410b89b80 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:04.862080 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-be53d618-cafa-4dbc-9e5a-480410b89b80 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:04.863999 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-be53d618-cafa-4dbc-9e5a-480410b89b80 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:04.947373 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e4ce5288-aa58-41e6-b2c1-914f7f552021 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:04.960377 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e4ce5288-aa58-41e6-b2c1-914f7f552021 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/1aaa2f54-26e8-4141-aa20-276704f85832" status: 200 len: 1314 microversion: 2.1 time: 0.597466 Sep 23 04:51:04.962716 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2182/4488] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:04 2022] GET /compute/v2.1/servers/1aaa2f54-26e8-4141-aa20-276704f85832 => generated 1314 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:51:04.968378 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-39b027cf-2188-4a15-9ed8-4bcdb0de13a9 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:04.972863 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-39b027cf-2188-4a15-9ed8-4bcdb0de13a9 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:04.991004 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-39b027cf-2188-4a15-9ed8-4bcdb0de13a9 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:04.992449 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-39b027cf-2188-4a15-9ed8-4bcdb0de13a9 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:04.993769 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-39b027cf-2188-4a15-9ed8-4bcdb0de13a9 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:04.995313 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-39b027cf-2188-4a15-9ed8-4bcdb0de13a9 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:04.997338 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-39b027cf-2188-4a15-9ed8-4bcdb0de13a9 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:04.998696 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-39b027cf-2188-4a15-9ed8-4bcdb0de13a9 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:05.075455 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-be53d618-cafa-4dbc-9e5a-480410b89b80 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:05.100226 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-be53d618-cafa-4dbc-9e5a-480410b89b80 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:05.113731 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-be53d618-cafa-4dbc-9e5a-480410b89b80 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:05.114989 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-be53d618-cafa-4dbc-9e5a-480410b89b80 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141" status: 200 len: 1341 microversion: 2.20 time: 0.301810 Sep 23 04:51:05.122495 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2307/4489] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:51:04 2022] GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141 => generated 1341 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:51:05.413034 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-39b027cf-2188-4a15-9ed8-4bcdb0de13a9 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:05.421580 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-39b027cf-2188-4a15-9ed8-4bcdb0de13a9 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1530 microversion: 2.1 time: 0.456929 Sep 23 04:51:05.422205 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2183/4490] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:04 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1530 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:51:05.826476 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4711d85f-8e12-470e-a1a9-d5101b3ff4ab tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:05.827567 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4711d85f-8e12-470e-a1a9-d5101b3ff4ab tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] [instance: 1d9dafd4-e427-4349-a142-2c3ed281b2b2] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:05.843416 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4711d85f-8e12-470e-a1a9-d5101b3ff4ab tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:05.844466 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4711d85f-8e12-470e-a1a9-d5101b3ff4ab tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:05.846285 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4711d85f-8e12-470e-a1a9-d5101b3ff4ab tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:05.852974 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4711d85f-8e12-470e-a1a9-d5101b3ff4ab tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:05.870664 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4711d85f-8e12-470e-a1a9-d5101b3ff4ab tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:05.875422 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4711d85f-8e12-470e-a1a9-d5101b3ff4ab tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:05.993750 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-cb5310ee-114b-43cc-a142-a98fd088be33 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:05.994660 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-cb5310ee-114b-43cc-a142-a98fd088be33 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 1aaa2f54-26e8-4141-aa20-276704f85832] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:06.011961 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cb5310ee-114b-43cc-a142-a98fd088be33 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:06.014984 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cb5310ee-114b-43cc-a142-a98fd088be33 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:06.015699 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cb5310ee-114b-43cc-a142-a98fd088be33 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:06.016675 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cb5310ee-114b-43cc-a142-a98fd088be33 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:06.018452 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cb5310ee-114b-43cc-a142-a98fd088be33 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:06.019311 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cb5310ee-114b-43cc-a142-a98fd088be33 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:07.246618 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-cb5310ee-114b-43cc-a142-a98fd088be33 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:07.274687 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-cb5310ee-114b-43cc-a142-a98fd088be33 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/1aaa2f54-26e8-4141-aa20-276704f85832" status: 200 len: 1314 microversion: 2.1 time: 1.287093 Sep 23 04:51:07.278046 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2184/4491] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:05 2022] GET /compute/v2.1/servers/1aaa2f54-26e8-4141-aa20-276704f85832 => generated 1314 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:51:07.299474 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-58d3d98e-b741-4a36-b95d-38f5f6308492 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:07.316540 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-58d3d98e-b741-4a36-b95d-38f5f6308492 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: f285e256-0a0e-4126-8adf-643bd59ca141] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:07.354236 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-58d3d98e-b741-4a36-b95d-38f5f6308492 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:07.363022 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-58d3d98e-b741-4a36-b95d-38f5f6308492 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:07.363591 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-58d3d98e-b741-4a36-b95d-38f5f6308492 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:07.364380 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-58d3d98e-b741-4a36-b95d-38f5f6308492 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:07.366205 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-58d3d98e-b741-4a36-b95d-38f5f6308492 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:07.366897 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-58d3d98e-b741-4a36-b95d-38f5f6308492 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:07.999427 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-4711d85f-8e12-470e-a1a9-d5101b3ff4ab tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a52352ab894e8f88be0f9d1cef0b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e32df90da6b43b7b8a562dd95e6833b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:08.011722 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4711d85f-8e12-470e-a1a9-d5101b3ff4ab tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] 10.222.0.33 "GET /compute/v2.1/servers/1d9dafd4-e427-4349-a142-2c3ed281b2b2" status: 200 len: 1334 microversion: 2.1 time: 2.193584 Sep 23 04:51:08.013533 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2308/4492] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:05 2022] GET /compute/v2.1/servers/1d9dafd4-e427-4349-a142-2c3ed281b2b2 => generated 1334 bytes in 2196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:51:08.034747 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-07d06c33-cd57-4f9d-9fdc-adf6af4f9ad0 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:08.035408 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-07d06c33-cd57-4f9d-9fdc-adf6af4f9ad0 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:08.055159 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-07d06c33-cd57-4f9d-9fdc-adf6af4f9ad0 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:08.055677 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-07d06c33-cd57-4f9d-9fdc-adf6af4f9ad0 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:08.056128 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-07d06c33-cd57-4f9d-9fdc-adf6af4f9ad0 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:08.066784 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-07d06c33-cd57-4f9d-9fdc-adf6af4f9ad0 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:08.068481 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-07d06c33-cd57-4f9d-9fdc-adf6af4f9ad0 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:08.073286 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-07d06c33-cd57-4f9d-9fdc-adf6af4f9ad0 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:08.574981 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:51:08.936443 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-58d3d98e-b741-4a36-b95d-38f5f6308492 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:08.958061 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-58d3d98e-b741-4a36-b95d-38f5f6308492 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:08.961055 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-58d3d98e-b741-4a36-b95d-38f5f6308492 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:08.965747 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-58d3d98e-b741-4a36-b95d-38f5f6308492 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141" status: 200 len: 1407 microversion: 2.20 time: 1.681665 Sep 23 04:51:08.970096 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2185/4493] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:51:07 2022] GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141 => generated 1407 bytes in 1686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:51:08.987113 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7d66f950-f75e-476a-85bc-ea55576b8c0f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:08.988131 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7d66f950-f75e-476a-85bc-ea55576b8c0f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 1aaa2f54-26e8-4141-aa20-276704f85832] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:08.997012 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7d66f950-f75e-476a-85bc-ea55576b8c0f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:08.999858 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7d66f950-f75e-476a-85bc-ea55576b8c0f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:09.002469 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7d66f950-f75e-476a-85bc-ea55576b8c0f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:09.004472 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7d66f950-f75e-476a-85bc-ea55576b8c0f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:09.009233 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7d66f950-f75e-476a-85bc-ea55576b8c0f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:09.016801 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7d66f950-f75e-476a-85bc-ea55576b8c0f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:09.433261 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-07d06c33-cd57-4f9d-9fdc-adf6af4f9ad0 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:09.453327 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-07d06c33-cd57-4f9d-9fdc-adf6af4f9ad0 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1525 microversion: 2.1 time: 1.438751 Sep 23 04:51:09.470839 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2309/4494] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:08 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1525 bytes in 1452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:51:09.493919 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e7d9b5be-b188-44ec-8ec5-43b548987550 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:09.494671 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e7d9b5be-b188-44ec-8ec5-43b548987550 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] [instance: 1d9dafd4-e427-4349-a142-2c3ed281b2b2] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:09.525341 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e7d9b5be-b188-44ec-8ec5-43b548987550 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:09.527859 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e7d9b5be-b188-44ec-8ec5-43b548987550 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:09.529873 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e7d9b5be-b188-44ec-8ec5-43b548987550 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:09.530718 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e7d9b5be-b188-44ec-8ec5-43b548987550 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:09.535391 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e7d9b5be-b188-44ec-8ec5-43b548987550 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:09.537632 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e7d9b5be-b188-44ec-8ec5-43b548987550 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:09.721338 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-7d66f950-f75e-476a-85bc-ea55576b8c0f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:09.734552 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7d66f950-f75e-476a-85bc-ea55576b8c0f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/1aaa2f54-26e8-4141-aa20-276704f85832" status: 200 len: 1314 microversion: 2.1 time: 0.762182 Sep 23 04:51:09.740280 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2186/4495] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:08 2022] GET /compute/v2.1/servers/1aaa2f54-26e8-4141-aa20-276704f85832 => generated 1314 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:51:09.785359 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-34dabce5-04ba-4b96-adf1-717936362ffb req-bc19e7e2-22d4-40ec-a688-a07b5941b6bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f285e256-0a0e-4126-8adf-643bd59ca141", "tag": "e29f5caa-b337-40d1-9780-77215617f3ce"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:51:09.798331 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-34dabce5-04ba-4b96-adf1-717936362ffb req-bc19e7e2-22d4-40ec-a688-a07b5941b6bf service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:09.800123 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-34dabce5-04ba-4b96-adf1-717936362ffb req-bc19e7e2-22d4-40ec-a688-a07b5941b6bf service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:09.805996 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-34dabce5-04ba-4b96-adf1-717936362ffb req-bc19e7e2-22d4-40ec-a688-a07b5941b6bf service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:09.845311 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-34dabce5-04ba-4b96-adf1-717936362ffb req-bc19e7e2-22d4-40ec-a688-a07b5941b6bf service nova] Creating event network-changed:e29f5caa-b337-40d1-9780-77215617f3ce for instance f285e256-0a0e-4126-8adf-643bd59ca141 on n-h1-846463-3 Sep 23 04:51:09.863963 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-34dabce5-04ba-4b96-adf1-717936362ffb req-bc19e7e2-22d4-40ec-a688-a07b5941b6bf service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089805 Sep 23 04:51:09.866726 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2187/4496] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:51:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:51:10.020649 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6a1055d4-a33c-4864-a88f-4a88a5f8dc3e tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:10.021875 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-6a1055d4-a33c-4864-a88f-4a88a5f8dc3e tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: f285e256-0a0e-4126-8adf-643bd59ca141] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:10.039095 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6a1055d4-a33c-4864-a88f-4a88a5f8dc3e tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:10.042024 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6a1055d4-a33c-4864-a88f-4a88a5f8dc3e tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:10.043035 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6a1055d4-a33c-4864-a88f-4a88a5f8dc3e tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:10.044558 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6a1055d4-a33c-4864-a88f-4a88a5f8dc3e tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:10.045449 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6a1055d4-a33c-4864-a88f-4a88a5f8dc3e tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:10.046269 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6a1055d4-a33c-4864-a88f-4a88a5f8dc3e tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:10.228337 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e7d9b5be-b188-44ec-8ec5-43b548987550 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a52352ab894e8f88be0f9d1cef0b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e32df90da6b43b7b8a562dd95e6833b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:10.239737 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e7d9b5be-b188-44ec-8ec5-43b548987550 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] 10.222.0.33 "GET /compute/v2.1/servers/1d9dafd4-e427-4349-a142-2c3ed281b2b2" status: 200 len: 1334 microversion: 2.1 time: 0.767600 Sep 23 04:51:10.250140 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2310/4497] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:09 2022] GET /compute/v2.1/servers/1d9dafd4-e427-4349-a142-2c3ed281b2b2 => generated 1334 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:51:10.492581 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-08713fd8-6815-43b4-87e1-09d9fb34327b tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:10.493347 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-08713fd8-6815-43b4-87e1-09d9fb34327b tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:10.504625 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-08713fd8-6815-43b4-87e1-09d9fb34327b tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:10.505176 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-08713fd8-6815-43b4-87e1-09d9fb34327b tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:10.519133 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-08713fd8-6815-43b4-87e1-09d9fb34327b tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:10.524623 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-08713fd8-6815-43b4-87e1-09d9fb34327b tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:10.525580 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-08713fd8-6815-43b4-87e1-09d9fb34327b tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:10.526244 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-08713fd8-6815-43b4-87e1-09d9fb34327b tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:10.941377 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=4 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:51:10.941985 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6a1055d4-a33c-4864-a88f-4a88a5f8dc3e tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:10.975664 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6a1055d4-a33c-4864-a88f-4a88a5f8dc3e tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:10.978523 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6a1055d4-a33c-4864-a88f-4a88a5f8dc3e tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:10.982452 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-6a1055d4-a33c-4864-a88f-4a88a5f8dc3e tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141" status: 200 len: 1407 microversion: 2.20 time: 0.972949 Sep 23 04:51:10.984994 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2188/4498] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:51:10 2022] GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141 => generated 1407 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:51:10.997685 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-08713fd8-6815-43b4-87e1-09d9fb34327b tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:10.999493 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4bcdf727-1991-40e2-99af-aacebb881d51 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:11.008554 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4bcdf727-1991-40e2-99af-aacebb881d51 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 1aaa2f54-26e8-4141-aa20-276704f85832] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:11.027967 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-08713fd8-6815-43b4-87e1-09d9fb34327b tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1525 microversion: 2.1 time: 0.538367 Sep 23 04:51:11.028523 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2311/4499] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:10 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1525 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:51:11.050734 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4bcdf727-1991-40e2-99af-aacebb881d51 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:11.053826 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4bcdf727-1991-40e2-99af-aacebb881d51 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:11.053826 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4bcdf727-1991-40e2-99af-aacebb881d51 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:11.053826 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4bcdf727-1991-40e2-99af-aacebb881d51 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:11.053826 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4bcdf727-1991-40e2-99af-aacebb881d51 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:11.066168 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4bcdf727-1991-40e2-99af-aacebb881d51 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:11.274657 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ed8ec8a6-e84e-4110-8730-f4e2e08d1c34 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:11.275575 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ed8ec8a6-e84e-4110-8730-f4e2e08d1c34 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] [instance: 1d9dafd4-e427-4349-a142-2c3ed281b2b2] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:11.314115 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ed8ec8a6-e84e-4110-8730-f4e2e08d1c34 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:11.314871 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ed8ec8a6-e84e-4110-8730-f4e2e08d1c34 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:11.315342 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ed8ec8a6-e84e-4110-8730-f4e2e08d1c34 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:11.316117 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ed8ec8a6-e84e-4110-8730-f4e2e08d1c34 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:11.316585 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ed8ec8a6-e84e-4110-8730-f4e2e08d1c34 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:11.317022 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ed8ec8a6-e84e-4110-8730-f4e2e08d1c34 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:11.785022 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=20 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:51:11.911607 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4bcdf727-1991-40e2-99af-aacebb881d51 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:11.927273 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4bcdf727-1991-40e2-99af-aacebb881d51 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/1aaa2f54-26e8-4141-aa20-276704f85832" status: 200 len: 1314 microversion: 2.1 time: 0.940384 Sep 23 04:51:11.940679 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2189/4500] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:10 2022] GET /compute/v2.1/servers/1aaa2f54-26e8-4141-aa20-276704f85832 => generated 1314 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:51:12.014326 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d82eda55-c1f1-443e-90b7-2687d4aef9df tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:12.015132 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d82eda55-c1f1-443e-90b7-2687d4aef9df tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: f285e256-0a0e-4126-8adf-643bd59ca141] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:12.031727 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d82eda55-c1f1-443e-90b7-2687d4aef9df tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:12.038762 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d82eda55-c1f1-443e-90b7-2687d4aef9df tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:12.042922 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d82eda55-c1f1-443e-90b7-2687d4aef9df tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:12.048609 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d82eda55-c1f1-443e-90b7-2687d4aef9df tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:12.052489 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d82eda55-c1f1-443e-90b7-2687d4aef9df tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:12.056135 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d82eda55-c1f1-443e-90b7-2687d4aef9df tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:12.128772 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ed8ec8a6-e84e-4110-8730-f4e2e08d1c34 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a52352ab894e8f88be0f9d1cef0b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e32df90da6b43b7b8a562dd95e6833b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:12.139193 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ed8ec8a6-e84e-4110-8730-f4e2e08d1c34 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] 10.222.0.33 "GET /compute/v2.1/servers/1d9dafd4-e427-4349-a142-2c3ed281b2b2" status: 200 len: 1334 microversion: 2.1 time: 0.870192 Sep 23 04:51:12.141233 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2312/4501] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:11 2022] GET /compute/v2.1/servers/1d9dafd4-e427-4349-a142-2c3ed281b2b2 => generated 1334 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:51:12.152823 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c562b8f2-9a4b-49a2-8730-34ece57ee495 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:12.158906 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c562b8f2-9a4b-49a2-8730-34ece57ee495 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:12.171246 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c562b8f2-9a4b-49a2-8730-34ece57ee495 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:12.175098 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c562b8f2-9a4b-49a2-8730-34ece57ee495 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:12.175675 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c562b8f2-9a4b-49a2-8730-34ece57ee495 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:12.176509 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c562b8f2-9a4b-49a2-8730-34ece57ee495 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:12.179460 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c562b8f2-9a4b-49a2-8730-34ece57ee495 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:12.179952 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c562b8f2-9a4b-49a2-8730-34ece57ee495 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:13.227371 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d82eda55-c1f1-443e-90b7-2687d4aef9df tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:13.236478 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d82eda55-c1f1-443e-90b7-2687d4aef9df tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:13.237992 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d82eda55-c1f1-443e-90b7-2687d4aef9df tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:13.239138 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d82eda55-c1f1-443e-90b7-2687d4aef9df tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141" status: 200 len: 1407 microversion: 2.20 time: 1.230259 Sep 23 04:51:13.249785 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2190/4502] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:51:12 2022] GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141 => generated 1407 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:51:13.254887 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3da388f7-a87f-4d17-b204-7f4f35a28e0b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:13.278746 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3da388f7-a87f-4d17-b204-7f4f35a28e0b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 1aaa2f54-26e8-4141-aa20-276704f85832] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:13.317077 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3da388f7-a87f-4d17-b204-7f4f35a28e0b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:13.322637 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3da388f7-a87f-4d17-b204-7f4f35a28e0b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:13.323296 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3da388f7-a87f-4d17-b204-7f4f35a28e0b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:13.324223 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3da388f7-a87f-4d17-b204-7f4f35a28e0b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:13.342030 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3da388f7-a87f-4d17-b204-7f4f35a28e0b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:13.342030 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3da388f7-a87f-4d17-b204-7f4f35a28e0b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:13.342477 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c562b8f2-9a4b-49a2-8730-34ece57ee495 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:13.359466 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c562b8f2-9a4b-49a2-8730-34ece57ee495 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1525 microversion: 2.1 time: 1.216899 Sep 23 04:51:13.360098 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2313/4503] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:12 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1525 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:51:13.398787 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-58d70a1f-9214-48eb-8aef-13b83f2d37f2 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:13.399789 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-58d70a1f-9214-48eb-8aef-13b83f2d37f2 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] [instance: 1d9dafd4-e427-4349-a142-2c3ed281b2b2] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:13.442009 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-58d70a1f-9214-48eb-8aef-13b83f2d37f2 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:13.451507 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-58d70a1f-9214-48eb-8aef-13b83f2d37f2 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:13.454763 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-58d70a1f-9214-48eb-8aef-13b83f2d37f2 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:13.458305 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-58d70a1f-9214-48eb-8aef-13b83f2d37f2 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:13.462792 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-58d70a1f-9214-48eb-8aef-13b83f2d37f2 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:13.464870 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-58d70a1f-9214-48eb-8aef-13b83f2d37f2 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:14.230809 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-58d70a1f-9214-48eb-8aef-13b83f2d37f2 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a52352ab894e8f88be0f9d1cef0b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e32df90da6b43b7b8a562dd95e6833b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:14.232538 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-3da388f7-a87f-4d17-b204-7f4f35a28e0b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:14.232538 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3da388f7-a87f-4d17-b204-7f4f35a28e0b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/1aaa2f54-26e8-4141-aa20-276704f85832" status: 200 len: 1314 microversion: 2.1 time: 0.853482 Sep 23 04:51:14.233146 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-58d70a1f-9214-48eb-8aef-13b83f2d37f2 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] 10.222.0.33 "GET /compute/v2.1/servers/1d9dafd4-e427-4349-a142-2c3ed281b2b2" status: 200 len: 1334 microversion: 2.1 time: 0.731412 Sep 23 04:51:14.233146 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2314/4504] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:13 2022] GET /compute/v2.1/servers/1d9dafd4-e427-4349-a142-2c3ed281b2b2 => generated 1334 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:51:14.233458 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2191/4505] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:13 2022] GET /compute/v2.1/servers/1aaa2f54-26e8-4141-aa20-276704f85832 => generated 1314 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:51:14.233618 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-ec12e52c-aaf1-4782-b422-99b166deb1f3 req-e865182e-3774-437d-9f9f-8ac149d4169a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9f2ff08-c66d-4991-9bae-d523a3adb8bf", "name": "network-vif-plugged", "status": "completed", "tag": "5cac1937-93f1-4537-9d14-be0ca8715d11"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:51:14.233618 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-ec12e52c-aaf1-4782-b422-99b166deb1f3 req-e865182e-3774-437d-9f9f-8ac149d4169a service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:14.233618 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-ec12e52c-aaf1-4782-b422-99b166deb1f3 req-e865182e-3774-437d-9f9f-8ac149d4169a service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:14.233618 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-ec12e52c-aaf1-4782-b422-99b166deb1f3 req-e865182e-3774-437d-9f9f-8ac149d4169a service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:14.233618 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-ec12e52c-aaf1-4782-b422-99b166deb1f3 req-e865182e-3774-437d-9f9f-8ac149d4169a service nova] Creating event network-vif-plugged:5cac1937-93f1-4537-9d14-be0ca8715d11 for instance a9f2ff08-c66d-4991-9bae-d523a3adb8bf on n-h1-846463-3 Sep 23 04:51:14.233618 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-ec12e52c-aaf1-4782-b422-99b166deb1f3 req-e865182e-3774-437d-9f9f-8ac149d4169a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083725 Sep 23 04:51:14.233618 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2315/4506] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:51:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:51:14.277407 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c31862b6-ce67-4644-998b-ce9c975e7709 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:14.278079 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c31862b6-ce67-4644-998b-ce9c975e7709 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: f285e256-0a0e-4126-8adf-643bd59ca141] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:14.291433 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c31862b6-ce67-4644-998b-ce9c975e7709 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:14.291942 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c31862b6-ce67-4644-998b-ce9c975e7709 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:14.292784 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c31862b6-ce67-4644-998b-ce9c975e7709 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:14.293110 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c31862b6-ce67-4644-998b-ce9c975e7709 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:14.293580 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c31862b6-ce67-4644-998b-ce9c975e7709 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:14.294046 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c31862b6-ce67-4644-998b-ce9c975e7709 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:14.383848 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2fa8273e-4a5c-4361-93dd-81fcc0ac6734 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:14.384708 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-2fa8273e-4a5c-4361-93dd-81fcc0ac6734 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:14.412929 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2fa8273e-4a5c-4361-93dd-81fcc0ac6734 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:14.414493 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2fa8273e-4a5c-4361-93dd-81fcc0ac6734 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:14.416373 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2fa8273e-4a5c-4361-93dd-81fcc0ac6734 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:14.424631 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2fa8273e-4a5c-4361-93dd-81fcc0ac6734 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:14.424631 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2fa8273e-4a5c-4361-93dd-81fcc0ac6734 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:14.426876 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2fa8273e-4a5c-4361-93dd-81fcc0ac6734 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:15.901344 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c31862b6-ce67-4644-998b-ce9c975e7709 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:15.906482 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=100 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:51:15.923820 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c31862b6-ce67-4644-998b-ce9c975e7709 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:15.925309 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c31862b6-ce67-4644-998b-ce9c975e7709 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:15.926531 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c31862b6-ce67-4644-998b-ce9c975e7709 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141" status: 200 len: 1407 microversion: 2.20 time: 1.654107 Sep 23 04:51:15.943361 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2192/4507] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:51:14 2022] GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141 => generated 1407 bytes in 1671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:51:15.974342 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f4f55451-d7cf-447e-bc6c-48c3c839e7ee tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:15.977060 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f4f55451-d7cf-447e-bc6c-48c3c839e7ee tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] [instance: 1d9dafd4-e427-4349-a142-2c3ed281b2b2] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:16.007499 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f4f55451-d7cf-447e-bc6c-48c3c839e7ee tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:16.008016 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f4f55451-d7cf-447e-bc6c-48c3c839e7ee tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:16.008582 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f4f55451-d7cf-447e-bc6c-48c3c839e7ee tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:16.009418 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f4f55451-d7cf-447e-bc6c-48c3c839e7ee tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:16.015919 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f4f55451-d7cf-447e-bc6c-48c3c839e7ee tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:16.017011 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f4f55451-d7cf-447e-bc6c-48c3c839e7ee tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:16.021978 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2fa8273e-4a5c-4361-93dd-81fcc0ac6734 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:16.034084 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2fa8273e-4a5c-4361-93dd-81fcc0ac6734 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1525 microversion: 2.1 time: 1.653849 Sep 23 04:51:16.046085 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2316/4508] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:14 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1525 bytes in 1657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:51:16.046085 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c5e534c7-94a6-40f1-95bd-d6af83e330cf tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:16.046085 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c5e534c7-94a6-40f1-95bd-d6af83e330cf tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 1aaa2f54-26e8-4141-aa20-276704f85832] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:16.059717 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c5e534c7-94a6-40f1-95bd-d6af83e330cf tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:16.062346 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c5e534c7-94a6-40f1-95bd-d6af83e330cf tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:16.062881 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c5e534c7-94a6-40f1-95bd-d6af83e330cf tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:16.072000 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c5e534c7-94a6-40f1-95bd-d6af83e330cf tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:16.072597 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c5e534c7-94a6-40f1-95bd-d6af83e330cf tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:16.073335 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c5e534c7-94a6-40f1-95bd-d6af83e330cf tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:16.581680 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c5e534c7-94a6-40f1-95bd-d6af83e330cf tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:16.592514 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f4f55451-d7cf-447e-bc6c-48c3c839e7ee tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a52352ab894e8f88be0f9d1cef0b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e32df90da6b43b7b8a562dd95e6833b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:16.598870 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c5e534c7-94a6-40f1-95bd-d6af83e330cf tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/1aaa2f54-26e8-4141-aa20-276704f85832" status: 200 len: 1314 microversion: 2.1 time: 0.562843 Sep 23 04:51:16.600063 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2317/4509] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:16 2022] GET /compute/v2.1/servers/1aaa2f54-26e8-4141-aa20-276704f85832 => generated 1314 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:51:16.602820 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f4f55451-d7cf-447e-bc6c-48c3c839e7ee tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] 10.222.0.33 "GET /compute/v2.1/servers/1d9dafd4-e427-4349-a142-2c3ed281b2b2" status: 200 len: 1334 microversion: 2.1 time: 0.658067 Sep 23 04:51:16.610728 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2193/4510] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:15 2022] GET /compute/v2.1/servers/1d9dafd4-e427-4349-a142-2c3ed281b2b2 => generated 1334 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:51:16.626315 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-c3fc12e2-e0f4-4dcb-833f-4e83f74d42f1 req-6883b807-f529-4bd4-8eb6-63609da3c821 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1aaa2f54-26e8-4141-aa20-276704f85832", "name": "network-vif-plugged", "status": "completed", "tag": "11292752-bbaf-4bd3-857a-dc22e908e857"}, {"server_uuid": "1d9dafd4-e427-4349-a142-2c3ed281b2b2", "name": "network-vif-plugged", "status": "completed", "tag": "5887a553-3d1e-43b2-914f-03b362eb8353"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:51:16.650700 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0612fdcd-a529-4eb6-8361-9d207c33b89b tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:16.651347 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-0612fdcd-a529-4eb6-8361-9d207c33b89b tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: 9763a452-dc3c-436d-bee4-a3967af3bcbb] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:16.659784 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0612fdcd-a529-4eb6-8361-9d207c33b89b tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:16.667685 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-c3fc12e2-e0f4-4dcb-833f-4e83f74d42f1 req-6883b807-f529-4bd4-8eb6-63609da3c821 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:16.668202 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-c3fc12e2-e0f4-4dcb-833f-4e83f74d42f1 req-6883b807-f529-4bd4-8eb6-63609da3c821 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:16.668653 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-c3fc12e2-e0f4-4dcb-833f-4e83f74d42f1 req-6883b807-f529-4bd4-8eb6-63609da3c821 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:16.668793 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0612fdcd-a529-4eb6-8361-9d207c33b89b tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:16.671001 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0612fdcd-a529-4eb6-8361-9d207c33b89b tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:16.677604 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0612fdcd-a529-4eb6-8361-9d207c33b89b tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:16.679929 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0612fdcd-a529-4eb6-8361-9d207c33b89b tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:16.684086 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0612fdcd-a529-4eb6-8361-9d207c33b89b tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:16.707138 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-c3fc12e2-e0f4-4dcb-833f-4e83f74d42f1 req-6883b807-f529-4bd4-8eb6-63609da3c821 service nova] Creating event network-vif-plugged:11292752-bbaf-4bd3-857a-dc22e908e857 for instance 1aaa2f54-26e8-4141-aa20-276704f85832 on n-h2-846463-3 Sep 23 04:51:16.707138 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-c3fc12e2-e0f4-4dcb-833f-4e83f74d42f1 req-6883b807-f529-4bd4-8eb6-63609da3c821 service nova] Creating event network-vif-plugged:5887a553-3d1e-43b2-914f-03b362eb8353 for instance 1d9dafd4-e427-4349-a142-2c3ed281b2b2 on n-h1-846463-3 Sep 23 04:51:16.727351 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-c3fc12e2-e0f4-4dcb-833f-4e83f74d42f1 req-6883b807-f529-4bd4-8eb6-63609da3c821 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.125806 Sep 23 04:51:16.732108 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2318/4511] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:51:16 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:51:16.751773 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-0612fdcd-a529-4eb6-8361-9d207c33b89b tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: 9763a452-dc3c-436d-bee4-a3967af3bcbb] Going to try to terminate instance {{(pid=122698) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:51:16.961465 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-de69f0ce-deab-436f-8576-ac8108af20ca tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:16.962494 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-de69f0ce-deab-436f-8576-ac8108af20ca tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: f285e256-0a0e-4126-8adf-643bd59ca141] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:16.975824 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-de69f0ce-deab-436f-8576-ac8108af20ca tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:16.978555 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-de69f0ce-deab-436f-8576-ac8108af20ca tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:16.979650 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-de69f0ce-deab-436f-8576-ac8108af20ca tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:16.982474 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-de69f0ce-deab-436f-8576-ac8108af20ca tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:16.985735 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-de69f0ce-deab-436f-8576-ac8108af20ca tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:16.986422 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-de69f0ce-deab-436f-8576-ac8108af20ca tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:17.364002 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0612fdcd-a529-4eb6-8361-9d207c33b89b tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9763a452-dc3c-436d-bee4-a3967af3bcbb" status: 204 len: 0 microversion: 2.1 time: 0.716628 Sep 23 04:51:17.366265 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2194/4512] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:51:16 2022] DELETE /compute/v2.1/servers/9763a452-dc3c-436d-bee4-a3967af3bcbb => generated 0 bytes in 720 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:51:17.387560 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c04c2cf7-78ae-41a9-b20d-4505adfc057d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:17.389841 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c04c2cf7-78ae-41a9-b20d-4505adfc057d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:17.425389 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c04c2cf7-78ae-41a9-b20d-4505adfc057d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:17.426091 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c04c2cf7-78ae-41a9-b20d-4505adfc057d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:17.426556 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c04c2cf7-78ae-41a9-b20d-4505adfc057d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:17.429252 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c04c2cf7-78ae-41a9-b20d-4505adfc057d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:17.436723 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c04c2cf7-78ae-41a9-b20d-4505adfc057d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:17.437338 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c04c2cf7-78ae-41a9-b20d-4505adfc057d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:17.924116 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-de69f0ce-deab-436f-8576-ac8108af20ca tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:17.950908 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-de69f0ce-deab-436f-8576-ac8108af20ca tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:17.952809 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-de69f0ce-deab-436f-8576-ac8108af20ca tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:17.963945 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-de69f0ce-deab-436f-8576-ac8108af20ca tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141" status: 200 len: 1407 microversion: 2.20 time: 1.008743 Sep 23 04:51:17.966418 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2319/4513] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:51:16 2022] GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141 => generated 1407 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:51:17.974301 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e6b4eebd-66f1-43f6-a912-5e9ac2ce16f5 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:17.997371 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e6b4eebd-66f1-43f6-a912-5e9ac2ce16f5 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: 9763a452-dc3c-436d-bee4-a3967af3bcbb] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:18.027818 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e6b4eebd-66f1-43f6-a912-5e9ac2ce16f5 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:18.035574 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e6b4eebd-66f1-43f6-a912-5e9ac2ce16f5 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:18.036309 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e6b4eebd-66f1-43f6-a912-5e9ac2ce16f5 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:18.038228 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e6b4eebd-66f1-43f6-a912-5e9ac2ce16f5 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:18.042774 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e6b4eebd-66f1-43f6-a912-5e9ac2ce16f5 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:18.050825 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e6b4eebd-66f1-43f6-a912-5e9ac2ce16f5 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:18.130396 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c04c2cf7-78ae-41a9-b20d-4505adfc057d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:18.148319 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c04c2cf7-78ae-41a9-b20d-4505adfc057d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1525 microversion: 2.1 time: 0.767281 Sep 23 04:51:18.149149 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2195/4514] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:17 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1525 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:51:18.164257 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6dee4f2a-7d20-442a-8965-a5a5c72acdbe tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:18.164257 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-6dee4f2a-7d20-442a-8965-a5a5c72acdbe tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 1aaa2f54-26e8-4141-aa20-276704f85832] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:18.167970 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6dee4f2a-7d20-442a-8965-a5a5c72acdbe tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:18.178254 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6dee4f2a-7d20-442a-8965-a5a5c72acdbe tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:18.179033 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6dee4f2a-7d20-442a-8965-a5a5c72acdbe tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:18.180047 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6dee4f2a-7d20-442a-8965-a5a5c72acdbe tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:18.180747 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6dee4f2a-7d20-442a-8965-a5a5c72acdbe tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:18.181408 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6dee4f2a-7d20-442a-8965-a5a5c72acdbe tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:18.596806 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e6b4eebd-66f1-43f6-a912-5e9ac2ce16f5 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c786bbedc21849ea92924139a44707b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcafb05f6f554e278cd552023947c6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:18.608649 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e6b4eebd-66f1-43f6-a912-5e9ac2ce16f5 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/9763a452-dc3c-436d-bee4-a3967af3bcbb" status: 200 len: 1506 microversion: 2.1 time: 0.637829 Sep 23 04:51:18.618733 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2320/4515] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:17 2022] GET /compute/v2.1/servers/9763a452-dc3c-436d-bee4-a3967af3bcbb => generated 1506 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:51:18.628643 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-01cc82c0-1251-4ee5-8355-3d2ecd1f6f12 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:18.629637 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-01cc82c0-1251-4ee5-8355-3d2ecd1f6f12 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] [instance: 1d9dafd4-e427-4349-a142-2c3ed281b2b2] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:18.652826 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:51:18.661458 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-01cc82c0-1251-4ee5-8355-3d2ecd1f6f12 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:18.662787 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-01cc82c0-1251-4ee5-8355-3d2ecd1f6f12 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:18.664072 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-01cc82c0-1251-4ee5-8355-3d2ecd1f6f12 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:18.665680 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-01cc82c0-1251-4ee5-8355-3d2ecd1f6f12 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:18.666521 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-01cc82c0-1251-4ee5-8355-3d2ecd1f6f12 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:18.673652 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-01cc82c0-1251-4ee5-8355-3d2ecd1f6f12 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:18.927951 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6dee4f2a-7d20-442a-8965-a5a5c72acdbe tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:18.936057 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-6dee4f2a-7d20-442a-8965-a5a5c72acdbe tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/1aaa2f54-26e8-4141-aa20-276704f85832" status: 200 len: 1314 microversion: 2.1 time: 0.784827 Sep 23 04:51:18.954520 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2196/4516] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:18 2022] GET /compute/v2.1/servers/1aaa2f54-26e8-4141-aa20-276704f85832 => generated 1314 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:51:18.963635 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-096704a6-3609-4a95-a253-7177e33adc69 req-bd071be8-379f-4d59-a6e6-37a439a550f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d9dafd4-e427-4349-a142-2c3ed281b2b2", "name": "network-vif-plugged", "status": "completed", "tag": "a16e86e5-bb3a-4b84-bab2-3392aac0f422"}, {"server_uuid": "f285e256-0a0e-4126-8adf-643bd59ca141", "name": "network-vif-plugged", "status": "completed", "tag": "e29f5caa-b337-40d1-9780-77215617f3ce"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:51:18.998645 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-096704a6-3609-4a95-a253-7177e33adc69 req-bd071be8-379f-4d59-a6e6-37a439a550f7 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:18.999151 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-096704a6-3609-4a95-a253-7177e33adc69 req-bd071be8-379f-4d59-a6e6-37a439a550f7 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:19.008131 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-096704a6-3609-4a95-a253-7177e33adc69 req-bd071be8-379f-4d59-a6e6-37a439a550f7 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:19.045684 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-096704a6-3609-4a95-a253-7177e33adc69 req-bd071be8-379f-4d59-a6e6-37a439a550f7 service nova] Creating event network-vif-plugged:a16e86e5-bb3a-4b84-bab2-3392aac0f422 for instance 1d9dafd4-e427-4349-a142-2c3ed281b2b2 on n-h1-846463-3 Sep 23 04:51:19.046244 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-096704a6-3609-4a95-a253-7177e33adc69 req-bd071be8-379f-4d59-a6e6-37a439a550f7 service nova] Creating event network-vif-plugged:e29f5caa-b337-40d1-9780-77215617f3ce for instance f285e256-0a0e-4126-8adf-643bd59ca141 on n-h1-846463-3 Sep 23 04:51:19.077463 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-096704a6-3609-4a95-a253-7177e33adc69 req-bd071be8-379f-4d59-a6e6-37a439a550f7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.121523 Sep 23 04:51:19.078550 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2197/4517] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:51:18 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:51:19.090562 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ff0729de-15e9-4d4b-8f0c-ddfbc2884761 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:19.091583 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-ff0729de-15e9-4d4b-8f0c-ddfbc2884761 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: f285e256-0a0e-4126-8adf-643bd59ca141] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:19.112010 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ff0729de-15e9-4d4b-8f0c-ddfbc2884761 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:19.112795 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ff0729de-15e9-4d4b-8f0c-ddfbc2884761 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:19.128893 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ff0729de-15e9-4d4b-8f0c-ddfbc2884761 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:19.141138 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ff0729de-15e9-4d4b-8f0c-ddfbc2884761 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:19.141138 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ff0729de-15e9-4d4b-8f0c-ddfbc2884761 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:19.141138 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ff0729de-15e9-4d4b-8f0c-ddfbc2884761 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:19.667338 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-01cc82c0-1251-4ee5-8355-3d2ecd1f6f12 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a52352ab894e8f88be0f9d1cef0b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e32df90da6b43b7b8a562dd95e6833b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:19.710583 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-01cc82c0-1251-4ee5-8355-3d2ecd1f6f12 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] 10.222.0.33 "GET /compute/v2.1/servers/1d9dafd4-e427-4349-a142-2c3ed281b2b2" status: 200 len: 1334 microversion: 2.1 time: 1.064347 Sep 23 04:51:19.710583 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2321/4518] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:18 2022] GET /compute/v2.1/servers/1d9dafd4-e427-4349-a142-2c3ed281b2b2 => generated 1334 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:51:19.710583 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-95d5abbd-8d44-48a5-aa63-6575aeaa2adc tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:19.710583 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-95d5abbd-8d44-48a5-aa63-6575aeaa2adc tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:19.721772 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-95d5abbd-8d44-48a5-aa63-6575aeaa2adc tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:19.722695 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-95d5abbd-8d44-48a5-aa63-6575aeaa2adc tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:19.723500 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-95d5abbd-8d44-48a5-aa63-6575aeaa2adc tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:19.724509 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-95d5abbd-8d44-48a5-aa63-6575aeaa2adc tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:19.725151 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-95d5abbd-8d44-48a5-aa63-6575aeaa2adc tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:19.725754 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-95d5abbd-8d44-48a5-aa63-6575aeaa2adc tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:19.767352 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=100 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:51:19.807187 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ff0729de-15e9-4d4b-8f0c-ddfbc2884761 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:19.823205 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ff0729de-15e9-4d4b-8f0c-ddfbc2884761 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:19.829038 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ff0729de-15e9-4d4b-8f0c-ddfbc2884761 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:19.830581 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ff0729de-15e9-4d4b-8f0c-ddfbc2884761 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141" status: 200 len: 1407 microversion: 2.20 time: 0.750992 Sep 23 04:51:19.846212 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2198/4519] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:51:19 2022] GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141 => generated 1407 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:51:19.866396 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-317eb753-02f0-4b6d-ae67-ce6f81577a28 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:19.868045 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-317eb753-02f0-4b6d-ae67-ce6f81577a28 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: 9763a452-dc3c-436d-bee4-a3967af3bcbb] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:19.881467 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-317eb753-02f0-4b6d-ae67-ce6f81577a28 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:19.885504 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-317eb753-02f0-4b6d-ae67-ce6f81577a28 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:19.887147 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-317eb753-02f0-4b6d-ae67-ce6f81577a28 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:19.888820 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-317eb753-02f0-4b6d-ae67-ce6f81577a28 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:19.890138 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-317eb753-02f0-4b6d-ae67-ce6f81577a28 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:19.896325 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-317eb753-02f0-4b6d-ae67-ce6f81577a28 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:20.314906 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-317eb753-02f0-4b6d-ae67-ce6f81577a28 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c786bbedc21849ea92924139a44707b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcafb05f6f554e278cd552023947c6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:20.337188 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-317eb753-02f0-4b6d-ae67-ce6f81577a28 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/9763a452-dc3c-436d-bee4-a3967af3bcbb" status: 200 len: 1506 microversion: 2.1 time: 0.493604 Sep 23 04:51:20.339515 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2199/4520] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:19 2022] GET /compute/v2.1/servers/9763a452-dc3c-436d-bee4-a3967af3bcbb => generated 1506 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:51:20.354399 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3cb8e755-1cf5-4668-a645-db88d61ace05 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:20.364633 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3cb8e755-1cf5-4668-a645-db88d61ace05 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 1aaa2f54-26e8-4141-aa20-276704f85832] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:20.386064 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3cb8e755-1cf5-4668-a645-db88d61ace05 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:20.386316 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3cb8e755-1cf5-4668-a645-db88d61ace05 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:20.386756 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3cb8e755-1cf5-4668-a645-db88d61ace05 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:20.387520 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3cb8e755-1cf5-4668-a645-db88d61ace05 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:20.387990 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3cb8e755-1cf5-4668-a645-db88d61ace05 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:20.388424 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3cb8e755-1cf5-4668-a645-db88d61ace05 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:20.706149 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-95d5abbd-8d44-48a5-aa63-6575aeaa2adc tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:20.723388 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-95d5abbd-8d44-48a5-aa63-6575aeaa2adc tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1525 microversion: 2.1 time: 1.044887 Sep 23 04:51:20.724187 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2322/4521] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:19 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1525 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:51:20.745177 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a0e5bf95-ed55-4046-afff-70d1091554d4 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:20.757877 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a0e5bf95-ed55-4046-afff-70d1091554d4 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] [instance: 1d9dafd4-e427-4349-a142-2c3ed281b2b2] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:20.766859 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a0e5bf95-ed55-4046-afff-70d1091554d4 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:20.779654 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a0e5bf95-ed55-4046-afff-70d1091554d4 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:20.785001 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a0e5bf95-ed55-4046-afff-70d1091554d4 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:20.792780 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a0e5bf95-ed55-4046-afff-70d1091554d4 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:20.796051 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a0e5bf95-ed55-4046-afff-70d1091554d4 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:20.796685 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a0e5bf95-ed55-4046-afff-70d1091554d4 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:21.068330 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a0e5bf95-ed55-4046-afff-70d1091554d4 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a52352ab894e8f88be0f9d1cef0b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e32df90da6b43b7b8a562dd95e6833b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:21.082328 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a0e5bf95-ed55-4046-afff-70d1091554d4 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] 10.222.0.33 "GET /compute/v2.1/servers/1d9dafd4-e427-4349-a142-2c3ed281b2b2" status: 200 len: 1334 microversion: 2.1 time: 0.344119 Sep 23 04:51:21.104753 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2323/4522] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:20 2022] GET /compute/v2.1/servers/1d9dafd4-e427-4349-a142-2c3ed281b2b2 => generated 1334 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:51:21.118606 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-fbea1276-2384-405c-bcbb-126afd592e42 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:21.121208 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-fbea1276-2384-405c-bcbb-126afd592e42 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: f285e256-0a0e-4126-8adf-643bd59ca141] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:21.139862 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fbea1276-2384-405c-bcbb-126afd592e42 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:21.142124 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fbea1276-2384-405c-bcbb-126afd592e42 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:21.142756 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fbea1276-2384-405c-bcbb-126afd592e42 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:21.145001 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fbea1276-2384-405c-bcbb-126afd592e42 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:21.147437 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fbea1276-2384-405c-bcbb-126afd592e42 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:21.149738 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fbea1276-2384-405c-bcbb-126afd592e42 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:21.162800 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-3cb8e755-1cf5-4668-a645-db88d61ace05 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:21.182706 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3cb8e755-1cf5-4668-a645-db88d61ace05 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/1aaa2f54-26e8-4141-aa20-276704f85832" status: 200 len: 1500 microversion: 2.1 time: 0.839774 Sep 23 04:51:21.186126 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2200/4523] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:20 2022] GET /compute/v2.1/servers/1aaa2f54-26e8-4141-aa20-276704f85832 => generated 1500 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:51:21.213401 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6d171e80-1446-47e0-b24a-fa9accb5839f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:51:21.216456 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-6d171e80-1446-47e0-b24a-fa9accb5839f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 1aaa2f54-26e8-4141-aa20-276704f85832] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:21.239115 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6d171e80-1446-47e0-b24a-fa9accb5839f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:21.239853 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6d171e80-1446-47e0-b24a-fa9accb5839f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:21.243429 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6d171e80-1446-47e0-b24a-fa9accb5839f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:21.249535 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6d171e80-1446-47e0-b24a-fa9accb5839f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:21.252968 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6d171e80-1446-47e0-b24a-fa9accb5839f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:21.254170 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6d171e80-1446-47e0-b24a-fa9accb5839f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:21.396657 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-6d171e80-1446-47e0-b24a-fa9accb5839f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "POST /compute/v2.1/servers/1aaa2f54-26e8-4141-aa20-276704f85832/action" status: 200 len: 14 microversion: 2.1 time: 0.189293 Sep 23 04:51:21.407365 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2201/4524] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:51:21 2022] POST /compute/v2.1/servers/1aaa2f54-26e8-4141-aa20-276704f85832/action => generated 14 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 04:51:21.422992 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-274e2126-878e-4590-8acf-f8e9ab685b1b tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:21.422992 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-274e2126-878e-4590-8acf-f8e9ab685b1b tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: 9763a452-dc3c-436d-bee4-a3967af3bcbb] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:21.457756 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-274e2126-878e-4590-8acf-f8e9ab685b1b tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:21.461345 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-274e2126-878e-4590-8acf-f8e9ab685b1b tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:21.463246 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-274e2126-878e-4590-8acf-f8e9ab685b1b tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:21.465726 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-274e2126-878e-4590-8acf-f8e9ab685b1b tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:21.467402 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-274e2126-878e-4590-8acf-f8e9ab685b1b tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:21.468603 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-274e2126-878e-4590-8acf-f8e9ab685b1b tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:21.790796 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-274e2126-878e-4590-8acf-f8e9ab685b1b tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c786bbedc21849ea92924139a44707b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcafb05f6f554e278cd552023947c6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:21.822813 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-274e2126-878e-4590-8acf-f8e9ab685b1b tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/9763a452-dc3c-436d-bee4-a3967af3bcbb" status: 200 len: 1464 microversion: 2.1 time: 0.414009 Sep 23 04:51:21.825151 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2202/4525] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:21 2022] GET /compute/v2.1/servers/9763a452-dc3c-436d-bee4-a3967af3bcbb => generated 1464 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:51:21.905006 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-9e8a0ee5-994f-4caf-b797-7da0dbc193d8 req-9ac94884-5fdd-4049-bd97-961a47adba3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9763a452-dc3c-436d-bee4-a3967af3bcbb", "name": "network-vif-deleted", "tag": "4e9aa528-cb1f-4f7a-add2-edebbcce69d9"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:51:21.913347 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-fbea1276-2384-405c-bcbb-126afd592e42 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:21.927792 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-fbea1276-2384-405c-bcbb-126afd592e42 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:21.936571 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-fbea1276-2384-405c-bcbb-126afd592e42 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:21.936742 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-9e8a0ee5-994f-4caf-b797-7da0dbc193d8 req-9ac94884-5fdd-4049-bd97-961a47adba3a service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:21.937166 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-9e8a0ee5-994f-4caf-b797-7da0dbc193d8 req-9ac94884-5fdd-4049-bd97-961a47adba3a service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:21.937618 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-9e8a0ee5-994f-4caf-b797-7da0dbc193d8 req-9ac94884-5fdd-4049-bd97-961a47adba3a service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:21.946537 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-fbea1276-2384-405c-bcbb-126afd592e42 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141" status: 200 len: 1407 microversion: 2.20 time: 0.836512 Sep 23 04:51:21.948086 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2324/4526] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:51:21 2022] GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141 => generated 1407 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:51:21.970770 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8fb8d919-5842-496b-8a15-58e91abf326c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:21.970770 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-8fb8d919-5842-496b-8a15-58e91abf326c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:21.995309 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8fb8d919-5842-496b-8a15-58e91abf326c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:21.996121 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-9e8a0ee5-994f-4caf-b797-7da0dbc193d8 req-9ac94884-5fdd-4049-bd97-961a47adba3a service nova] Creating event network-vif-deleted:4e9aa528-cb1f-4f7a-add2-edebbcce69d9 for instance 9763a452-dc3c-436d-bee4-a3967af3bcbb on n-h1-846463-3 Sep 23 04:51:21.997470 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8fb8d919-5842-496b-8a15-58e91abf326c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:22.004802 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8fb8d919-5842-496b-8a15-58e91abf326c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:22.006619 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8fb8d919-5842-496b-8a15-58e91abf326c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:22.011516 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8fb8d919-5842-496b-8a15-58e91abf326c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:22.020279 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-9e8a0ee5-994f-4caf-b797-7da0dbc193d8 req-9ac94884-5fdd-4049-bd97-961a47adba3a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.173444 Sep 23 04:51:22.020718 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8fb8d919-5842-496b-8a15-58e91abf326c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:22.024900 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2203/4527] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:51:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:51:22.115051 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b079f5e6-17ac-4577-97d2-ff9436348746 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:22.115051 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b079f5e6-17ac-4577-97d2-ff9436348746 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] [instance: 1d9dafd4-e427-4349-a142-2c3ed281b2b2] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:22.140775 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b079f5e6-17ac-4577-97d2-ff9436348746 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:22.142305 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b079f5e6-17ac-4577-97d2-ff9436348746 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:22.148750 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b079f5e6-17ac-4577-97d2-ff9436348746 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:22.148750 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b079f5e6-17ac-4577-97d2-ff9436348746 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:22.148750 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b079f5e6-17ac-4577-97d2-ff9436348746 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:22.148750 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b079f5e6-17ac-4577-97d2-ff9436348746 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:22.553582 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b079f5e6-17ac-4577-97d2-ff9436348746 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a52352ab894e8f88be0f9d1cef0b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e32df90da6b43b7b8a562dd95e6833b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:22.564879 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b079f5e6-17ac-4577-97d2-ff9436348746 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] 10.222.0.33 "GET /compute/v2.1/servers/1d9dafd4-e427-4349-a142-2c3ed281b2b2" status: 200 len: 1669 microversion: 2.1 time: 0.461800 Sep 23 04:51:22.579276 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2204/4528] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:22 2022] GET /compute/v2.1/servers/1d9dafd4-e427-4349-a142-2c3ed281b2b2 => generated 1669 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:51:22.636368 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-8fb8d919-5842-496b-8a15-58e91abf326c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:22.652197 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-8fb8d919-5842-496b-8a15-58e91abf326c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1525 microversion: 2.1 time: 0.694646 Sep 23 04:51:22.657351 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2325/4529] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:21 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1525 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:51:22.666900 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0e48599f-6d03-48dc-9374-c75709c3db5f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:51:22.672262 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-0e48599f-6d03-48dc-9374-c75709c3db5f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 1aaa2f54-26e8-4141-aa20-276704f85832] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:22.686362 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0e48599f-6d03-48dc-9374-c75709c3db5f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:22.690736 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0e48599f-6d03-48dc-9374-c75709c3db5f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:22.700216 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0e48599f-6d03-48dc-9374-c75709c3db5f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:22.700216 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0e48599f-6d03-48dc-9374-c75709c3db5f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:22.700216 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0e48599f-6d03-48dc-9374-c75709c3db5f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:22.707876 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0e48599f-6d03-48dc-9374-c75709c3db5f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:22.818267 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0e48599f-6d03-48dc-9374-c75709c3db5f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "POST /compute/v2.1/servers/1aaa2f54-26e8-4141-aa20-276704f85832/action" status: 200 len: 14 microversion: 2.1 time: 0.161838 Sep 23 04:51:22.823433 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2326/4530] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:51:22 2022] POST /compute/v2.1/servers/1aaa2f54-26e8-4141-aa20-276704f85832/action => generated 14 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 04:51:22.833115 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-03500acf-d6b6-4f8e-a43c-ca814884e086 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:22.834062 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-03500acf-d6b6-4f8e-a43c-ca814884e086 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] [instance: 1d9dafd4-e427-4349-a142-2c3ed281b2b2] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:22.843503 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-03500acf-d6b6-4f8e-a43c-ca814884e086 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:22.844263 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-03500acf-d6b6-4f8e-a43c-ca814884e086 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:22.848165 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-03500acf-d6b6-4f8e-a43c-ca814884e086 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:22.849722 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-03500acf-d6b6-4f8e-a43c-ca814884e086 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:22.850445 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-03500acf-d6b6-4f8e-a43c-ca814884e086 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:22.851117 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-03500acf-d6b6-4f8e-a43c-ca814884e086 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:22.911573 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-03500acf-d6b6-4f8e-a43c-ca814884e086 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] 10.222.0.33 "GET /compute/v2.1/servers/1d9dafd4-e427-4349-a142-2c3ed281b2b2/ips" status: 200 len: 179 microversion: 2.1 time: 0.086516 Sep 23 04:51:22.915122 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2327/4531] 10.222.0.33 () {58 vars in 1248 bytes} [Fri Sep 23 04:51:22 2022] GET /compute/v2.1/servers/1d9dafd4-e427-4349-a142-2c3ed281b2b2/ips => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:51:22.933499 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8c4ec0cf-6b13-4478-9013-81c20b38ff98 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:22.936483 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-8c4ec0cf-6b13-4478-9013-81c20b38ff98 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: 9763a452-dc3c-436d-bee4-a3967af3bcbb] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:22.946298 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8c4ec0cf-6b13-4478-9013-81c20b38ff98 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:22.946642 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8c4ec0cf-6b13-4478-9013-81c20b38ff98 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:22.947096 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8c4ec0cf-6b13-4478-9013-81c20b38ff98 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:22.947827 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8c4ec0cf-6b13-4478-9013-81c20b38ff98 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:22.948290 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8c4ec0cf-6b13-4478-9013-81c20b38ff98 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:22.948734 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8c4ec0cf-6b13-4478-9013-81c20b38ff98 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:22.961537 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4ba36bae-b41f-48f1-880a-3317d44b50d0 tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Action: 'create', calling method: .version_select at 0x7ff1bbaa7d30>, body: {"keypair": {"name": "tempest-keypair-1120844680", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI7u8s+EPlZrnQwTzEpa9v+0g2VpdgXN0lggrC4zhCCxt89NNGXFpZnYpIKfQ1gB8atDEKpJ/2OJAWi6tQsKmi5tAGfhFOEL2HH6w6Xlq0OkI8ZqFhnQg9iFse6D2AY3Pg=="}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:51:23.001105 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-4ba36bae-b41f-48f1-880a-3317d44b50d0 tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Getting quotas for project 598e5e00bee244ee973df9124e15068b. Resources: {'key_pairs'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:51:23.019812 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:51:23.024699 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-4ba36bae-b41f-48f1-880a-3317d44b50d0 tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Getting quotas for user 923fa0e0e08047a484ff0e129afaf09a and project 598e5e00bee244ee973df9124e15068b. Resources: {'key_pairs'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:51:23.055254 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8c4ec0cf-6b13-4478-9013-81c20b38ff98 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:23.058149 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8c4ec0cf-6b13-4478-9013-81c20b38ff98 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:23.058675 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8c4ec0cf-6b13-4478-9013-81c20b38ff98 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:23.060634 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-8c4ec0cf-6b13-4478-9013-81c20b38ff98 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lazy-loading 'fault' on Instance uuid 9763a452-dc3c-436d-bee4-a3967af3bcbb {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:51:23.173501 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4ba36bae-b41f-48f1-880a-3317d44b50d0 tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.600940 Sep 23 04:51:23.180989 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2205/4532] 10.222.0.33 () {60 vars in 1159 bytes} [Fri Sep 23 04:51:22 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:51:23.187064 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-52350f7a-8193-4267-b4dd-820f922ff25d tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:23.193718 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-52350f7a-8193-4267-b4dd-820f922ff25d tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] [instance: 1d9dafd4-e427-4349-a142-2c3ed281b2b2] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:23.229642 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-52350f7a-8193-4267-b4dd-820f922ff25d tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:23.229642 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-52350f7a-8193-4267-b4dd-820f922ff25d tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:23.229809 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-52350f7a-8193-4267-b4dd-820f922ff25d tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:23.230671 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-52350f7a-8193-4267-b4dd-820f922ff25d tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:23.231226 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-52350f7a-8193-4267-b4dd-820f922ff25d tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:23.240098 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-52350f7a-8193-4267-b4dd-820f922ff25d tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:23.283434 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-8c4ec0cf-6b13-4478-9013-81c20b38ff98 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c786bbedc21849ea92924139a44707b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcafb05f6f554e278cd552023947c6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:23.292706 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-8c4ec0cf-6b13-4478-9013-81c20b38ff98 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/9763a452-dc3c-436d-bee4-a3967af3bcbb" status: 200 len: 1310 microversion: 2.1 time: 0.371463 Sep 23 04:51:23.310240 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2328/4533] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:22 2022] GET /compute/v2.1/servers/9763a452-dc3c-436d-bee4-a3967af3bcbb => generated 1310 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:51:23.343784 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-56609b55-2589-4509-99b4-4afe833466fc tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:23.344960 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-56609b55-2589-4509-99b4-4afe833466fc tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: f285e256-0a0e-4126-8adf-643bd59ca141] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:23.386446 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-56609b55-2589-4509-99b4-4afe833466fc tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:23.391904 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-56609b55-2589-4509-99b4-4afe833466fc tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:23.392446 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-56609b55-2589-4509-99b4-4afe833466fc tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:23.393356 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-56609b55-2589-4509-99b4-4afe833466fc tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:23.403884 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-56609b55-2589-4509-99b4-4afe833466fc tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:23.403884 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-56609b55-2589-4509-99b4-4afe833466fc tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:23.432330 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-52350f7a-8193-4267-b4dd-820f922ff25d tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] [instance: 1d9dafd4-e427-4349-a142-2c3ed281b2b2] Going to try to terminate instance {{(pid=122698) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:51:23.799945 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-52350f7a-8193-4267-b4dd-820f922ff25d tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] 10.222.0.33 "DELETE /compute/v2.1/servers/1d9dafd4-e427-4349-a142-2c3ed281b2b2" status: 204 len: 0 microversion: 2.1 time: 0.617412 Sep 23 04:51:23.804187 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2206/4534] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:51:23 2022] DELETE /compute/v2.1/servers/1d9dafd4-e427-4349-a142-2c3ed281b2b2 => generated 0 bytes in 619 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:51:23.809497 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-be848e96-c33b-4b30-b201-341f73f04b96 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Action: 'create', calling method: .version_select at 0x7ff1c3d2f160>, body: {"keypair": {"name": "tempest-keypair-881461369", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEqtrceXP7TsuP2w7jgLcKxvUxBf7tpPjRupihIPnE7sO4AL3+8lj/w2wSSCwqVi8ilG2aROGWhM4upeUpix+cuUj297tMD8OmTyMOpwqpm5SjHDKqM2GFXWqspYVV1BVw=="}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:51:23.824761 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-56609b55-2589-4509-99b4-4afe833466fc tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:23.834259 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-56609b55-2589-4509-99b4-4afe833466fc tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:23.835723 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-56609b55-2589-4509-99b4-4afe833466fc tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:23.836937 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-56609b55-2589-4509-99b4-4afe833466fc tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141" status: 200 len: 1599 microversion: 2.20 time: 0.525671 Sep 23 04:51:23.837511 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2329/4535] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:51:23 2022] GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141 => generated 1599 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:51:23.852883 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-be848e96-c33b-4b30-b201-341f73f04b96 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Getting quotas for project df5513e89bb94c22854ef923561ef0ef. Resources: {'key_pairs'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:51:23.856505 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-be848e96-c33b-4b30-b201-341f73f04b96 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Getting quotas for user f58f4b86f06947268442533ec19ef25d and project df5513e89bb94c22854ef923561ef0ef. Resources: {'key_pairs'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:51:23.858653 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-71b6b6f0-bfca-4f4f-8ed8-0515da73e943 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:23.859284 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-71b6b6f0-bfca-4f4f-8ed8-0515da73e943 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:23.899878 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-71b6b6f0-bfca-4f4f-8ed8-0515da73e943 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:23.899878 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-71b6b6f0-bfca-4f4f-8ed8-0515da73e943 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:23.907208 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-71b6b6f0-bfca-4f4f-8ed8-0515da73e943 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:23.910872 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-71b6b6f0-bfca-4f4f-8ed8-0515da73e943 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:23.911808 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-71b6b6f0-bfca-4f4f-8ed8-0515da73e943 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:23.912325 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-71b6b6f0-bfca-4f4f-8ed8-0515da73e943 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:24.006177 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-be848e96-c33b-4b30-b201-341f73f04b96 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.32 time: 0.203333 Sep 23 04:51:24.013817 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2207/4536] 10.222.0.33 () {62 vars in 1200 bytes} [Fri Sep 23 04:51:23 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 205 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 23 04:51:24.019042 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6554bab7-0048-4cbe-bab4-47dd8cc96b6b tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:24.019801 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-6554bab7-0048-4cbe-bab4-47dd8cc96b6b tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] [instance: 1d9dafd4-e427-4349-a142-2c3ed281b2b2] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:24.046758 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6554bab7-0048-4cbe-bab4-47dd8cc96b6b tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:24.050342 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6554bab7-0048-4cbe-bab4-47dd8cc96b6b tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:24.057475 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6554bab7-0048-4cbe-bab4-47dd8cc96b6b tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:24.058387 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6554bab7-0048-4cbe-bab4-47dd8cc96b6b tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:24.059699 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6554bab7-0048-4cbe-bab4-47dd8cc96b6b tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:24.060163 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6554bab7-0048-4cbe-bab4-47dd8cc96b6b tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:24.486365 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-71b6b6f0-bfca-4f4f-8ed8-0515da73e943 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:24.497351 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-71b6b6f0-bfca-4f4f-8ed8-0515da73e943 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1525 microversion: 2.1 time: 0.642557 Sep 23 04:51:24.507814 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2330/4537] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:23 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1525 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:51:24.516291 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-dc064efa-c630-485c-9562-1b4b52b7d85f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:51:24.533264 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-dc064efa-c630-485c-9562-1b4b52b7d85f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 1aaa2f54-26e8-4141-aa20-276704f85832] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:24.549450 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dc064efa-c630-485c-9562-1b4b52b7d85f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:24.554885 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6554bab7-0048-4cbe-bab4-47dd8cc96b6b tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a52352ab894e8f88be0f9d1cef0b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e32df90da6b43b7b8a562dd95e6833b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:24.559905 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dc064efa-c630-485c-9562-1b4b52b7d85f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:24.571651 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dc064efa-c630-485c-9562-1b4b52b7d85f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:24.572884 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dc064efa-c630-485c-9562-1b4b52b7d85f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:24.574054 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-6554bab7-0048-4cbe-bab4-47dd8cc96b6b tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] 10.222.0.33 "GET /compute/v2.1/servers/1d9dafd4-e427-4349-a142-2c3ed281b2b2" status: 200 len: 1675 microversion: 2.1 time: 0.565619 Sep 23 04:51:24.574778 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dc064efa-c630-485c-9562-1b4b52b7d85f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:24.575428 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dc064efa-c630-485c-9562-1b4b52b7d85f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:24.579335 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2208/4538] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:24 2022] GET /compute/v2.1/servers/1d9dafd4-e427-4349-a142-2c3ed281b2b2 => generated 1675 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:51:24.586202 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e750464f-fc5c-4141-9325-d8d68fa5df9a tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:24.610803 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e750464f-fc5c-4141-9325-d8d68fa5df9a tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: f285e256-0a0e-4126-8adf-643bd59ca141] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:24.627029 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e750464f-fc5c-4141-9325-d8d68fa5df9a tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:24.639396 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e750464f-fc5c-4141-9325-d8d68fa5df9a tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:24.639862 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e750464f-fc5c-4141-9325-d8d68fa5df9a tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:24.644837 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e750464f-fc5c-4141-9325-d8d68fa5df9a tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:24.645572 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e750464f-fc5c-4141-9325-d8d68fa5df9a tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:24.650642 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e750464f-fc5c-4141-9325-d8d68fa5df9a tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:24.721457 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-dc064efa-c630-485c-9562-1b4b52b7d85f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "POST /compute/v2.1/servers/1aaa2f54-26e8-4141-aa20-276704f85832/action" status: 200 len: 14 microversion: 2.1 time: 0.206187 Sep 23 04:51:24.725106 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2331/4539] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:51:24 2022] POST /compute/v2.1/servers/1aaa2f54-26e8-4141-aa20-276704f85832/action => generated 14 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 04:51:24.733960 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b0311687-c199-492c-873a-331677d58d9d tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:24.735499 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b0311687-c199-492c-873a-331677d58d9d tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: 9763a452-dc3c-436d-bee4-a3967af3bcbb] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:24.761686 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b0311687-c199-492c-873a-331677d58d9d tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:24.766622 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b0311687-c199-492c-873a-331677d58d9d tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:24.767430 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b0311687-c199-492c-873a-331677d58d9d tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:24.768465 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b0311687-c199-492c-873a-331677d58d9d tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:24.769768 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b0311687-c199-492c-873a-331677d58d9d tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:24.770615 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b0311687-c199-492c-873a-331677d58d9d tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:24.811077 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-b0311687-c199-492c-873a-331677d58d9d tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] HTTP exception thrown: Instance 9763a452-dc3c-436d-bee4-a3967af3bcbb could not be found. Sep 23 04:51:24.819992 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b0311687-c199-492c-873a-331677d58d9d tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Request method failure captured: Sep 23 04:51:24.819992 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/9763a452-dc3c-436d-bee4-a3967af3bcbb HTTP/1.1 Sep 23 04:51:24.819992 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:51:24.819992 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:51:24.819992 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:51:24.819992 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:51:24.819992 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:51:24.819992 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:51:24.819992 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:51:24.819992 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:51:24.819992 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLToEB3KmJeqpeof3qtE1_ms3jD5q4R8EB4mtf6agEJBYOf3R1k1wW8qdql02e7ra521m3dklynQTAHmyD-EBkyV9p_88fIs_nz1LT08tnPBKYcM8ytHDfif-4FU40Ttv4qlVJY_DNQ2W4b2ZBQdDVOwU9-lTsZtqbQggZ1JBKRn9aZQ Sep 23 04:51:24.819992 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:51:24.819992 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:51:24.819992 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:51:24.819992 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:51:24.819992 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:51:24.819992 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:51:24.819992 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: dcafb05f6f554e278cd552023947c6ac Sep 23 04:51:24.819992 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-196358672 Sep 23 04:51:24.819992 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:51:24.819992 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:51:24.819992 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_dcafb05f6f554e278cd552023947c6ac", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dcafb05f6f554e278cd552023947c6ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/dcafb05f6f554e278cd552023947c6ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dcafb05f6f554e278cd552023947c6ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:51:24.819992 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ServerRescueNegativeTestJSON-196358672 Sep 23 04:51:24.819992 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: dcafb05f6f554e278cd552023947c6ac Sep 23 04:51:24.819992 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-196358672 Sep 23 04:51:24.819992 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ServerRescueNegativeTestJSON-196358672-project Sep 23 04:51:24.819992 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:51:24.819992 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:51:24.819992 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: c786bbedc21849ea92924139a44707b7 Sep 23 04:51:24.819992 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ServerRescueNegativeTestJSON-196358672-project Sep 23 04:51:24.819992 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:51:24.819992 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 9763a452-dc3c-436d-bee4-a3967af3bcbb could not be found. Sep 23 04:51:24.819992 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '9763a452-dc3c-436d-bee4-a3967af3bcbb'} Sep 23 04:51:24.819992 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:51:24.819992 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:51:24.819992 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:51:24.819992 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:51:24.819992 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:51:24.819992 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:51:24.819992 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:51:24.819992 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:51:24.819992 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:51:24.819992 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:51:24.819992 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9763a452-dc3c-436d-bee4-a3967af3bcbb could not be found. Sep 23 04:51:24.819992 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:51:24.819992 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:51:24.819992 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:51:24.819992 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:51:24.819992 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:51:24.819992 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:51:24.819992 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:51:24.819992 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:51:24.819992 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:51:24.819992 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:51:24.819992 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:51:24.819992 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:51:24.819992 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:51:24.819992 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:51:24.819992 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:51:24.819992 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:51:24.819992 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9763a452-dc3c-436d-bee4-a3967af3bcbb could not be found. Sep 23 04:51:24.819992 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:51:24.819992 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:51:24.824433 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:51:24.824433 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:51:24.824433 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:51:24.824433 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:51:24.824433 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:51:24.824433 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:51:24.824433 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9763a452-dc3c-436d-bee4-a3967af3bcbb could not be found. Sep 23 04:51:24.824433 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:51:24.828759 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b0311687-c199-492c-873a-331677d58d9d tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Returning 404 to user: Instance 9763a452-dc3c-436d-bee4-a3967af3bcbb could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:51:24.832612 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b0311687-c199-492c-873a-331677d58d9d tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/9763a452-dc3c-436d-bee4-a3967af3bcbb" status: 404 len: 111 microversion: 2.1 time: 0.104567 Sep 23 04:51:24.837392 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2332/4540] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:24 2022] GET /compute/v2.1/servers/9763a452-dc3c-436d-bee4-a3967af3bcbb => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:51:24.843604 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7afd4e4c-0fb4-497e-9a7a-9536d0acd5ec tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:24.845394 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-7afd4e4c-0fb4-497e-9a7a-9536d0acd5ec tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: f0374fc2-3c0f-48e1-b969-2933785fd47b] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:24.854479 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7afd4e4c-0fb4-497e-9a7a-9536d0acd5ec tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:24.855493 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7afd4e4c-0fb4-497e-9a7a-9536d0acd5ec tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:24.856196 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7afd4e4c-0fb4-497e-9a7a-9536d0acd5ec tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:24.861768 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7afd4e4c-0fb4-497e-9a7a-9536d0acd5ec tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:24.862915 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7afd4e4c-0fb4-497e-9a7a-9536d0acd5ec tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:24.863693 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7afd4e4c-0fb4-497e-9a7a-9536d0acd5ec tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:24.910717 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-7afd4e4c-0fb4-497e-9a7a-9536d0acd5ec tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: f0374fc2-3c0f-48e1-b969-2933785fd47b] Going to try to terminate instance {{(pid=122699) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:51:25.001671 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e750464f-fc5c-4141-9325-d8d68fa5df9a tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.420532 Sep 23 04:51:25.003250 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2209/4541] 10.222.0.33 () {60 vars in 1316 bytes} [Fri Sep 23 04:51:24 2022] GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141/os-interface => generated 284 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 04:51:25.264181 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-7afd4e4c-0fb4-497e-9a7a-9536d0acd5ec tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f0374fc2-3c0f-48e1-b969-2933785fd47b" status: 204 len: 0 microversion: 2.1 time: 0.425108 Sep 23 04:51:25.264776 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2333/4542] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:51:24 2022] DELETE /compute/v2.1/servers/f0374fc2-3c0f-48e1-b969-2933785fd47b => generated 0 bytes in 427 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:51:25.278541 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d1b327c6-0273-4bd5-9030-cb243e9dfe4e tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:25.279391 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d1b327c6-0273-4bd5-9030-cb243e9dfe4e tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: f0374fc2-3c0f-48e1-b969-2933785fd47b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:25.300218 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d1b327c6-0273-4bd5-9030-cb243e9dfe4e tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:25.300979 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d1b327c6-0273-4bd5-9030-cb243e9dfe4e tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:25.301611 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d1b327c6-0273-4bd5-9030-cb243e9dfe4e tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:25.306159 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d1b327c6-0273-4bd5-9030-cb243e9dfe4e tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:25.306931 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d1b327c6-0273-4bd5-9030-cb243e9dfe4e tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:25.307626 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d1b327c6-0273-4bd5-9030-cb243e9dfe4e tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:25.371755 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:51:25.534225 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ba51e6e9-bdb2-47f6-a70d-66d8a29a44b4 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:25.535659 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ba51e6e9-bdb2-47f6-a70d-66d8a29a44b4 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:25.555876 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ba51e6e9-bdb2-47f6-a70d-66d8a29a44b4 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:25.559997 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ba51e6e9-bdb2-47f6-a70d-66d8a29a44b4 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:25.560643 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ba51e6e9-bdb2-47f6-a70d-66d8a29a44b4 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:25.564677 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ba51e6e9-bdb2-47f6-a70d-66d8a29a44b4 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:25.565620 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ba51e6e9-bdb2-47f6-a70d-66d8a29a44b4 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:25.566286 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ba51e6e9-bdb2-47f6-a70d-66d8a29a44b4 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:25.981702 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d1b327c6-0273-4bd5-9030-cb243e9dfe4e tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c786bbedc21849ea92924139a44707b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcafb05f6f554e278cd552023947c6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:25.998189 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d1b327c6-0273-4bd5-9030-cb243e9dfe4e tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/f0374fc2-3c0f-48e1-b969-2933785fd47b" status: 200 len: 1521 microversion: 2.1 time: 0.727381 Sep 23 04:51:26.023747 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2210/4543] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:25 2022] GET /compute/v2.1/servers/f0374fc2-3c0f-48e1-b969-2933785fd47b => generated 1521 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:51:26.037536 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d8884385-22b1-44df-b851-afc96a4e3a06 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:26.038598 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d8884385-22b1-44df-b851-afc96a4e3a06 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] [instance: 1d9dafd4-e427-4349-a142-2c3ed281b2b2] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:26.045414 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d8884385-22b1-44df-b851-afc96a4e3a06 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:26.046306 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d8884385-22b1-44df-b851-afc96a4e3a06 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:26.047614 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d8884385-22b1-44df-b851-afc96a4e3a06 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:26.048731 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d8884385-22b1-44df-b851-afc96a4e3a06 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:26.049632 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d8884385-22b1-44df-b851-afc96a4e3a06 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:26.050517 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d8884385-22b1-44df-b851-afc96a4e3a06 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:26.158964 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ba51e6e9-bdb2-47f6-a70d-66d8a29a44b4 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:26.172073 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ba51e6e9-bdb2-47f6-a70d-66d8a29a44b4 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1525 microversion: 2.1 time: 0.642379 Sep 23 04:51:26.174606 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2334/4544] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:25 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1525 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:51:26.186563 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-40d41fe2-51cc-4e77-9d03-65f88ff9b883 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:51:26.192131 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-40d41fe2-51cc-4e77-9d03-65f88ff9b883 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 1aaa2f54-26e8-4141-aa20-276704f85832] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:26.212972 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-40d41fe2-51cc-4e77-9d03-65f88ff9b883 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:26.214132 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-40d41fe2-51cc-4e77-9d03-65f88ff9b883 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:26.214852 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-40d41fe2-51cc-4e77-9d03-65f88ff9b883 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:26.216355 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-40d41fe2-51cc-4e77-9d03-65f88ff9b883 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:26.217604 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-40d41fe2-51cc-4e77-9d03-65f88ff9b883 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:26.220707 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-40d41fe2-51cc-4e77-9d03-65f88ff9b883 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:26.569762 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d8884385-22b1-44df-b851-afc96a4e3a06 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a52352ab894e8f88be0f9d1cef0b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e32df90da6b43b7b8a562dd95e6833b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:26.582710 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d8884385-22b1-44df-b851-afc96a4e3a06 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] 10.222.0.33 "GET /compute/v2.1/servers/1d9dafd4-e427-4349-a142-2c3ed281b2b2" status: 200 len: 1675 microversion: 2.1 time: 0.546558 Sep 23 04:51:26.584420 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2211/4545] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:26 2022] GET /compute/v2.1/servers/1d9dafd4-e427-4349-a142-2c3ed281b2b2 => generated 1675 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:51:26.896020 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-5f8a7a6b-c5cc-4bef-8cc7-73c966fbbb07 req-3722a8a0-05f8-465d-9871-cf2579b46cdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d9dafd4-e427-4349-a142-2c3ed281b2b2", "name": "network-vif-deleted", "tag": "5887a553-3d1e-43b2-914f-03b362eb8353"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:51:26.919325 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-5f8a7a6b-c5cc-4bef-8cc7-73c966fbbb07 req-3722a8a0-05f8-465d-9871-cf2579b46cdf service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:26.923120 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-5f8a7a6b-c5cc-4bef-8cc7-73c966fbbb07 req-3722a8a0-05f8-465d-9871-cf2579b46cdf service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:26.924020 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-5f8a7a6b-c5cc-4bef-8cc7-73c966fbbb07 req-3722a8a0-05f8-465d-9871-cf2579b46cdf service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:26.973623 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-5f8a7a6b-c5cc-4bef-8cc7-73c966fbbb07 req-3722a8a0-05f8-465d-9871-cf2579b46cdf service nova] Creating event network-vif-deleted:5887a553-3d1e-43b2-914f-03b362eb8353 for instance 1d9dafd4-e427-4349-a142-2c3ed281b2b2 on n-h1-846463-3 Sep 23 04:51:26.982390 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-5f8a7a6b-c5cc-4bef-8cc7-73c966fbbb07 req-3722a8a0-05f8-465d-9871-cf2579b46cdf service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088557 Sep 23 04:51:26.986750 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2212/4546] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:51:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:51:27.030934 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-cf2e9b9c-77bb-4bb7-a907-8858ee7721e3 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:27.031710 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-cf2e9b9c-77bb-4bb7-a907-8858ee7721e3 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: f0374fc2-3c0f-48e1-b969-2933785fd47b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:27.045176 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cf2e9b9c-77bb-4bb7-a907-8858ee7721e3 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:27.045967 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cf2e9b9c-77bb-4bb7-a907-8858ee7721e3 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:27.046582 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cf2e9b9c-77bb-4bb7-a907-8858ee7721e3 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:27.047509 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cf2e9b9c-77bb-4bb7-a907-8858ee7721e3 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:27.055114 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cf2e9b9c-77bb-4bb7-a907-8858ee7721e3 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:27.055868 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cf2e9b9c-77bb-4bb7-a907-8858ee7721e3 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:27.220474 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-40d41fe2-51cc-4e77-9d03-65f88ff9b883 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "POST /compute/v2.1/servers/1aaa2f54-26e8-4141-aa20-276704f85832/action" status: 200 len: 14 microversion: 2.1 time: 1.043261 Sep 23 04:51:27.222073 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2335/4547] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:51:26 2022] POST /compute/v2.1/servers/1aaa2f54-26e8-4141-aa20-276704f85832/action => generated 14 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 04:51:27.232704 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d57e8530-11d3-4632-bdfd-020cd1a740ef tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:27.235919 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d57e8530-11d3-4632-bdfd-020cd1a740ef tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:27.251828 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d57e8530-11d3-4632-bdfd-020cd1a740ef tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:27.253741 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d57e8530-11d3-4632-bdfd-020cd1a740ef tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:27.254483 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d57e8530-11d3-4632-bdfd-020cd1a740ef tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:27.255900 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d57e8530-11d3-4632-bdfd-020cd1a740ef tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:27.258956 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d57e8530-11d3-4632-bdfd-020cd1a740ef tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:27.259650 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d57e8530-11d3-4632-bdfd-020cd1a740ef tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:28.263639 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-cf2e9b9c-77bb-4bb7-a907-8858ee7721e3 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c786bbedc21849ea92924139a44707b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcafb05f6f554e278cd552023947c6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:28.268040 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d57e8530-11d3-4632-bdfd-020cd1a740ef tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:28.284798 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d57e8530-11d3-4632-bdfd-020cd1a740ef tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1525 microversion: 2.1 time: 1.061080 Sep 23 04:51:28.301532 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2336/4548] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:27 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1525 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:51:28.304907 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-cf2e9b9c-77bb-4bb7-a907-8858ee7721e3 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/f0374fc2-3c0f-48e1-b969-2933785fd47b" status: 200 len: 1521 microversion: 2.1 time: 1.274812 Sep 23 04:51:28.306967 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2213/4549] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:27 2022] GET /compute/v2.1/servers/f0374fc2-3c0f-48e1-b969-2933785fd47b => generated 1521 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:51:28.324820 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-cd519075-70b9-4a23-be72-6e9eebdf5907 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:51:28.324820 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-cd519075-70b9-4a23-be72-6e9eebdf5907 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 1aaa2f54-26e8-4141-aa20-276704f85832] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:28.325439 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-74e87f23-ea1f-49fe-bfb1-692cc3531aa9 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:28.325439 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-74e87f23-ea1f-49fe-bfb1-692cc3531aa9 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] [instance: 1d9dafd4-e427-4349-a142-2c3ed281b2b2] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:28.328365 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-74e87f23-ea1f-49fe-bfb1-692cc3531aa9 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:28.330471 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-74e87f23-ea1f-49fe-bfb1-692cc3531aa9 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:28.330931 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-74e87f23-ea1f-49fe-bfb1-692cc3531aa9 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:28.331666 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-74e87f23-ea1f-49fe-bfb1-692cc3531aa9 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:28.332142 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-74e87f23-ea1f-49fe-bfb1-692cc3531aa9 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:28.332582 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-74e87f23-ea1f-49fe-bfb1-692cc3531aa9 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:28.340373 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cd519075-70b9-4a23-be72-6e9eebdf5907 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:28.341223 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cd519075-70b9-4a23-be72-6e9eebdf5907 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:28.341681 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cd519075-70b9-4a23-be72-6e9eebdf5907 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:28.342445 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cd519075-70b9-4a23-be72-6e9eebdf5907 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:28.343110 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cd519075-70b9-4a23-be72-6e9eebdf5907 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:28.343740 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cd519075-70b9-4a23-be72-6e9eebdf5907 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:28.424711 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-cd519075-70b9-4a23-be72-6e9eebdf5907 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "POST /compute/v2.1/servers/1aaa2f54-26e8-4141-aa20-276704f85832/action" status: 200 len: 14 microversion: 2.1 time: 0.115527 Sep 23 04:51:28.432017 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2214/4550] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:51:28 2022] POST /compute/v2.1/servers/1aaa2f54-26e8-4141-aa20-276704f85832/action => generated 14 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 04:51:28.506164 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-74e87f23-ea1f-49fe-bfb1-692cc3531aa9 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a52352ab894e8f88be0f9d1cef0b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e32df90da6b43b7b8a562dd95e6833b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:28.515498 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-74e87f23-ea1f-49fe-bfb1-692cc3531aa9 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] 10.222.0.33 "GET /compute/v2.1/servers/1d9dafd4-e427-4349-a142-2c3ed281b2b2" status: 200 len: 1497 microversion: 2.1 time: 0.210897 Sep 23 04:51:28.516921 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2337/4551] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:28 2022] GET /compute/v2.1/servers/1d9dafd4-e427-4349-a142-2c3ed281b2b2 => generated 1497 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:51:29.319205 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5ebb0d30-43c6-482c-a6ad-931f45b8c470 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:29.319205 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5ebb0d30-43c6-482c-a6ad-931f45b8c470 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:29.331423 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5ebb0d30-43c6-482c-a6ad-931f45b8c470 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:29.334708 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5ebb0d30-43c6-482c-a6ad-931f45b8c470 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:29.335492 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5ebb0d30-43c6-482c-a6ad-931f45b8c470 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:29.338323 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5ebb0d30-43c6-482c-a6ad-931f45b8c470 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:29.339030 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5ebb0d30-43c6-482c-a6ad-931f45b8c470 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:29.339663 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5ebb0d30-43c6-482c-a6ad-931f45b8c470 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:29.347269 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-95fd78b7-61c0-412a-b256-2be9ba11e3c6 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:29.348229 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-95fd78b7-61c0-412a-b256-2be9ba11e3c6 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: f0374fc2-3c0f-48e1-b969-2933785fd47b] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:29.359160 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-95fd78b7-61c0-412a-b256-2be9ba11e3c6 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:29.374443 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-95fd78b7-61c0-412a-b256-2be9ba11e3c6 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:29.376002 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-95fd78b7-61c0-412a-b256-2be9ba11e3c6 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:29.379034 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-95fd78b7-61c0-412a-b256-2be9ba11e3c6 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:29.381529 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-95fd78b7-61c0-412a-b256-2be9ba11e3c6 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:29.382748 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-95fd78b7-61c0-412a-b256-2be9ba11e3c6 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:29.666968 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-95fd78b7-61c0-412a-b256-2be9ba11e3c6 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c786bbedc21849ea92924139a44707b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcafb05f6f554e278cd552023947c6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:29.679966 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-95fd78b7-61c0-412a-b256-2be9ba11e3c6 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/f0374fc2-3c0f-48e1-b969-2933785fd47b" status: 200 len: 1479 microversion: 2.1 time: 0.336778 Sep 23 04:51:29.683127 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2338/4552] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:29 2022] GET /compute/v2.1/servers/f0374fc2-3c0f-48e1-b969-2933785fd47b => generated 1479 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:51:29.704066 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b19bfd5a-ec0e-408d-b778-0d711318bf6d tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:51:29.712430 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b19bfd5a-ec0e-408d-b778-0d711318bf6d tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 1aaa2f54-26e8-4141-aa20-276704f85832] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:29.741970 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b19bfd5a-ec0e-408d-b778-0d711318bf6d tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:29.749301 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b19bfd5a-ec0e-408d-b778-0d711318bf6d tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:29.749785 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b19bfd5a-ec0e-408d-b778-0d711318bf6d tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:29.751213 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b19bfd5a-ec0e-408d-b778-0d711318bf6d tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:29.751693 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b19bfd5a-ec0e-408d-b778-0d711318bf6d tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:29.752131 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b19bfd5a-ec0e-408d-b778-0d711318bf6d tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:29.770948 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:51:29.802006 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-5ebb0d30-43c6-482c-a6ad-931f45b8c470 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:29.817919 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5ebb0d30-43c6-482c-a6ad-931f45b8c470 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1525 microversion: 2.1 time: 0.509899 Sep 23 04:51:29.818977 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2215/4553] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:29 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1525 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:51:29.824006 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b06110f5-3886-41d1-9180-b21b117462c6 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:29.826611 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b06110f5-3886-41d1-9180-b21b117462c6 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] [instance: 1d9dafd4-e427-4349-a142-2c3ed281b2b2] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:29.840887 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b06110f5-3886-41d1-9180-b21b117462c6 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:29.840887 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b06110f5-3886-41d1-9180-b21b117462c6 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:29.840887 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b06110f5-3886-41d1-9180-b21b117462c6 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:29.840887 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b06110f5-3886-41d1-9180-b21b117462c6 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:29.847092 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b06110f5-3886-41d1-9180-b21b117462c6 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:29.848315 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b06110f5-3886-41d1-9180-b21b117462c6 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:29.861530 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b19bfd5a-ec0e-408d-b778-0d711318bf6d tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "POST /compute/v2.1/servers/1aaa2f54-26e8-4141-aa20-276704f85832/action" status: 200 len: 14 microversion: 2.1 time: 0.176058 Sep 23 04:51:29.867049 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2339/4554] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:51:29 2022] POST /compute/v2.1/servers/1aaa2f54-26e8-4141-aa20-276704f85832/action => generated 14 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 04:51:29.872907 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-6bac296e-2b18-476a-8cb8-fe524fb94a18 req-8ee99862-4b3a-4ff1-af30-3abfa5789691 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d9dafd4-e427-4349-a142-2c3ed281b2b2", "name": "network-vif-deleted", "tag": "a16e86e5-bb3a-4b84-bab2-3392aac0f422"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:51:29.886215 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-6bac296e-2b18-476a-8cb8-fe524fb94a18 req-8ee99862-4b3a-4ff1-af30-3abfa5789691 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:29.887038 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-6bac296e-2b18-476a-8cb8-fe524fb94a18 req-8ee99862-4b3a-4ff1-af30-3abfa5789691 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:29.887742 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-6bac296e-2b18-476a-8cb8-fe524fb94a18 req-8ee99862-4b3a-4ff1-af30-3abfa5789691 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:29.903688 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-6bac296e-2b18-476a-8cb8-fe524fb94a18 req-8ee99862-4b3a-4ff1-af30-3abfa5789691 service nova] Creating event network-vif-deleted:a16e86e5-bb3a-4b84-bab2-3392aac0f422 for instance 1d9dafd4-e427-4349-a142-2c3ed281b2b2 on n-h1-846463-3 Sep 23 04:51:29.920982 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-6bac296e-2b18-476a-8cb8-fe524fb94a18 req-8ee99862-4b3a-4ff1-af30-3abfa5789691 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051655 Sep 23 04:51:29.938513 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2340/4555] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:51:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:51:30.118616 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b06110f5-3886-41d1-9180-b21b117462c6 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91a52352ab894e8f88be0f9d1cef0b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e32df90da6b43b7b8a562dd95e6833b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:30.129848 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b06110f5-3886-41d1-9180-b21b117462c6 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] 10.222.0.33 "GET /compute/v2.1/servers/1d9dafd4-e427-4349-a142-2c3ed281b2b2" status: 200 len: 1455 microversion: 2.1 time: 0.309709 Sep 23 04:51:30.130732 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2216/4556] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:29 2022] GET /compute/v2.1/servers/1d9dafd4-e427-4349-a142-2c3ed281b2b2 => generated 1455 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:51:30.710355 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9e89bd1e-c255-4239-818e-7b5650510b44 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:30.711168 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-9e89bd1e-c255-4239-818e-7b5650510b44 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: f0374fc2-3c0f-48e1-b969-2933785fd47b] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:30.764502 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9e89bd1e-c255-4239-818e-7b5650510b44 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:30.769047 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9e89bd1e-c255-4239-818e-7b5650510b44 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:30.770261 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9e89bd1e-c255-4239-818e-7b5650510b44 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:30.771793 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9e89bd1e-c255-4239-818e-7b5650510b44 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:30.776934 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9e89bd1e-c255-4239-818e-7b5650510b44 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:30.781784 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9e89bd1e-c255-4239-818e-7b5650510b44 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:30.897019 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9e89bd1e-c255-4239-818e-7b5650510b44 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:30.898611 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9e89bd1e-c255-4239-818e-7b5650510b44 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:30.899082 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9e89bd1e-c255-4239-818e-7b5650510b44 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:30.899597 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-9e89bd1e-c255-4239-818e-7b5650510b44 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lazy-loading 'fault' on Instance uuid f0374fc2-3c0f-48e1-b969-2933785fd47b {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:51:30.931068 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-1d8845cc-80ca-46a5-a123-be8c46f892d7 req-403cf86d-c741-4278-8b1f-1c2162511522 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f285e256-0a0e-4126-8adf-643bd59ca141", "tag": "e29f5caa-b337-40d1-9780-77215617f3ce"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:51:30.963961 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-1d8845cc-80ca-46a5-a123-be8c46f892d7 req-403cf86d-c741-4278-8b1f-1c2162511522 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:30.964483 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-1d8845cc-80ca-46a5-a123-be8c46f892d7 req-403cf86d-c741-4278-8b1f-1c2162511522 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:30.964933 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-1d8845cc-80ca-46a5-a123-be8c46f892d7 req-403cf86d-c741-4278-8b1f-1c2162511522 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:31.016843 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-1d8845cc-80ca-46a5-a123-be8c46f892d7 req-403cf86d-c741-4278-8b1f-1c2162511522 service nova] Creating event network-changed:e29f5caa-b337-40d1-9780-77215617f3ce for instance f285e256-0a0e-4126-8adf-643bd59ca141 on n-h1-846463-3 Sep 23 04:51:31.051276 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-9e89bd1e-c255-4239-818e-7b5650510b44 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c786bbedc21849ea92924139a44707b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcafb05f6f554e278cd552023947c6ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:31.052407 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-1d8845cc-80ca-46a5-a123-be8c46f892d7 req-403cf86d-c741-4278-8b1f-1c2162511522 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.237371 Sep 23 04:51:31.056711 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2217/4557] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:51:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:51:31.060263 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-9e89bd1e-c255-4239-818e-7b5650510b44 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/f0374fc2-3c0f-48e1-b969-2933785fd47b" status: 200 len: 1311 microversion: 2.1 time: 0.354722 Sep 23 04:51:31.073976 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2341/4558] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:30 2022] GET /compute/v2.1/servers/f0374fc2-3c0f-48e1-b969-2933785fd47b => generated 1311 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:51:31.092937 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3f6b19e6-8323-4157-847a-a998f2f7081f tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:31.094275 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3f6b19e6-8323-4157-847a-a998f2f7081f tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:31.100648 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b5259cdb-dd0a-431c-a21a-e748fd36ce3d tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:51:31.102970 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b5259cdb-dd0a-431c-a21a-e748fd36ce3d tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 1aaa2f54-26e8-4141-aa20-276704f85832] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:31.137739 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3f6b19e6-8323-4157-847a-a998f2f7081f tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:31.144766 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3f6b19e6-8323-4157-847a-a998f2f7081f tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:31.145970 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3f6b19e6-8323-4157-847a-a998f2f7081f tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:31.146977 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b5259cdb-dd0a-431c-a21a-e748fd36ce3d tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:31.147823 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3f6b19e6-8323-4157-847a-a998f2f7081f tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:31.150809 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3f6b19e6-8323-4157-847a-a998f2f7081f tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:31.151647 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3f6b19e6-8323-4157-847a-a998f2f7081f tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:31.152071 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b5259cdb-dd0a-431c-a21a-e748fd36ce3d tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:31.152538 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b5259cdb-dd0a-431c-a21a-e748fd36ce3d tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:31.153466 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b5259cdb-dd0a-431c-a21a-e748fd36ce3d tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:31.158085 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b5259cdb-dd0a-431c-a21a-e748fd36ce3d tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:31.158783 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b5259cdb-dd0a-431c-a21a-e748fd36ce3d tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:31.247022 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b5259cdb-dd0a-431c-a21a-e748fd36ce3d tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "POST /compute/v2.1/servers/1aaa2f54-26e8-4141-aa20-276704f85832/action" status: 200 len: 8206 microversion: 2.1 time: 0.171472 Sep 23 04:51:31.248891 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2342/4559] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:51:31 2022] POST /compute/v2.1/servers/1aaa2f54-26e8-4141-aa20-276704f85832/action => generated 8206 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:51:31.259797 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-457550c6-0d1f-4ad5-a308-6b7cc7e1ca1a tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-277041502", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "25181a8c-87bb-4920-81c6-fce7d938f634"}], "security_groups": [{"name": "tempest-securitygroup--1535069034"}], "key_name": "tempest-keypair-1120844680", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:51:31.608187 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.neutron [None req-457550c6-0d1f-4ad5-a308-6b7cc7e1ca1a tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] validate_networks() for [('25181a8c-87bb-4920-81c6-fce7d938f634', None, None, None, None, None)] {{(pid=122699) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:51:31.675346 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-3f6b19e6-8323-4157-847a-a998f2f7081f tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:31.686496 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3f6b19e6-8323-4157-847a-a998f2f7081f tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1525 microversion: 2.1 time: 0.628264 Sep 23 04:51:31.688759 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2218/4560] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:31 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1525 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:51:31.693757 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7a91f2fd-a743-4c76-afa9-50d1f287a5ae tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:31.694899 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7a91f2fd-a743-4c76-afa9-50d1f287a5ae tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] [instance: 1d9dafd4-e427-4349-a142-2c3ed281b2b2] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:31.719971 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7a91f2fd-a743-4c76-afa9-50d1f287a5ae tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:31.730699 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7a91f2fd-a743-4c76-afa9-50d1f287a5ae tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:31.732420 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7a91f2fd-a743-4c76-afa9-50d1f287a5ae tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:31.733644 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7a91f2fd-a743-4c76-afa9-50d1f287a5ae tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:31.736669 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7a91f2fd-a743-4c76-afa9-50d1f287a5ae tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:31.739886 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7a91f2fd-a743-4c76-afa9-50d1f287a5ae tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:31.774385 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-7a91f2fd-a743-4c76-afa9-50d1f287a5ae tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] HTTP exception thrown: Instance 1d9dafd4-e427-4349-a142-2c3ed281b2b2 could not be found. Sep 23 04:51:31.777843 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7a91f2fd-a743-4c76-afa9-50d1f287a5ae tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Request method failure captured: Sep 23 04:51:31.777843 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/1d9dafd4-e427-4349-a142-2c3ed281b2b2 HTTP/1.1 Sep 23 04:51:31.777843 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:51:31.777843 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:51:31.777843 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:51:31.777843 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:51:31.777843 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:51:31.777843 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:51:31.777843 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:51:31.777843 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:51:31.777843 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTrhBVxvuFyCDQeoDVV1FpKtxqJtmotmG4T0Yln9ScS8W2uYPe6yTij0480Xjn1vSTCjEWigM4pCD4NIgLoQMZOXSdRfx-nkEFunqkwXAfzSNcWjOB2pO0PN0gQD6RxsFCb71saS9mddEq6BGw9UXsqEQ1UXDELMEZB2wY46QEp0uQE Sep 23 04:51:31.777843 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:51:31.777843 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:51:31.777843 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:51:31.777843 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:51:31.777843 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:51:31.777843 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:51:31.777843 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 2e32df90da6b43b7b8a562dd95e6833b Sep 23 04:51:31.777843 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ServersTestMultiNic-972382453 Sep 23 04:51:31.777843 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:51:31.777843 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:51:31.777843 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2e32df90da6b43b7b8a562dd95e6833b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2e32df90da6b43b7b8a562dd95e6833b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2e32df90da6b43b7b8a562dd95e6833b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2e32df90da6b43b7b8a562dd95e6833b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:51:31.777843 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ServersTestMultiNic-972382453 Sep 23 04:51:31.777843 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 2e32df90da6b43b7b8a562dd95e6833b Sep 23 04:51:31.777843 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ServersTestMultiNic-972382453 Sep 23 04:51:31.777843 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ServersTestMultiNic-972382453-project Sep 23 04:51:31.777843 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:51:31.777843 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:51:31.777843 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 91a52352ab894e8f88be0f9d1cef0b14 Sep 23 04:51:31.777843 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ServersTestMultiNic-972382453-project Sep 23 04:51:31.777843 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:51:31.777843 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 1d9dafd4-e427-4349-a142-2c3ed281b2b2 could not be found. Sep 23 04:51:31.777843 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '1d9dafd4-e427-4349-a142-2c3ed281b2b2'} Sep 23 04:51:31.777843 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:51:31.777843 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:51:31.777843 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:51:31.777843 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:51:31.777843 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:51:31.777843 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:51:31.777843 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:51:31.777843 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:51:31.777843 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:51:31.777843 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:51:31.777843 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d9dafd4-e427-4349-a142-2c3ed281b2b2 could not be found. Sep 23 04:51:31.777843 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:51:31.777843 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:51:31.777843 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:51:31.777843 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:51:31.777843 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:51:31.777843 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:51:31.777843 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:51:31.777843 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:51:31.777843 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:51:31.777843 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:51:31.777843 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:51:31.777843 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:51:31.777843 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:51:31.777843 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:51:31.777843 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:51:31.777843 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:51:31.777843 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d9dafd4-e427-4349-a142-2c3ed281b2b2 could not be found. Sep 23 04:51:31.777843 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:51:31.777843 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:51:31.777843 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:51:31.782787 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:51:31.782787 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:51:31.782787 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:51:31.782787 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:51:31.782787 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:51:31.782787 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d9dafd4-e427-4349-a142-2c3ed281b2b2 could not be found. Sep 23 04:51:31.782787 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:51:31.787531 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7a91f2fd-a743-4c76-afa9-50d1f287a5ae tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Returning 404 to user: Instance 1d9dafd4-e427-4349-a142-2c3ed281b2b2 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:51:31.788592 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7a91f2fd-a743-4c76-afa9-50d1f287a5ae tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] 10.222.0.33 "GET /compute/v2.1/servers/1d9dafd4-e427-4349-a142-2c3ed281b2b2" status: 404 len: 111 microversion: 2.1 time: 0.098640 Sep 23 04:51:31.792524 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2219/4561] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:31 2022] GET /compute/v2.1/servers/1d9dafd4-e427-4349-a142-2c3ed281b2b2 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:51:31.805230 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0dcfb5fe-6937-458b-ba26-97e3866a6cdf tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:31.807833 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-0dcfb5fe-6937-458b-ba26-97e3866a6cdf tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:31.825787 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0dcfb5fe-6937-458b-ba26-97e3866a6cdf tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:31.830673 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0dcfb5fe-6937-458b-ba26-97e3866a6cdf tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:31.831292 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0dcfb5fe-6937-458b-ba26-97e3866a6cdf tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:31.834501 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0dcfb5fe-6937-458b-ba26-97e3866a6cdf tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:31.835108 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0dcfb5fe-6937-458b-ba26-97e3866a6cdf tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:31.839831 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0dcfb5fe-6937-458b-ba26-97e3866a6cdf tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:32.435664 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-0dcfb5fe-6937-458b-ba26-97e3866a6cdf tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:32.449131 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-457550c6-0d1f-4ad5-a308-6b7cc7e1ca1a tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Getting quotas for project 598e5e00bee244ee973df9124e15068b. Resources: dict_keys(['metadata_items']) {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:51:32.464861 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0dcfb5fe-6937-458b-ba26-97e3866a6cdf tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1670 microversion: 2.1 time: 0.669410 Sep 23 04:51:32.465948 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-457550c6-0d1f-4ad5-a308-6b7cc7e1ca1a tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Getting quotas for user 923fa0e0e08047a484ff0e129afaf09a and project 598e5e00bee244ee973df9124e15068b. Resources: dict_keys(['metadata_items']) {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:51:32.481545 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2220/4562] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:31 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1670 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:51:32.483633 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-298b4399-4f38-414d-b185-8d6a911a0066 req-10f559fd-3f09-4d59-988b-42ba39ccf1df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0374fc2-3c0f-48e1-b969-2933785fd47b", "name": "network-vif-deleted", "tag": "8bb12be9-bcf5-4244-b7a1-ef10ac33bd74"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:51:32.501663 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-298b4399-4f38-414d-b185-8d6a911a0066 req-10f559fd-3f09-4d59-988b-42ba39ccf1df service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:32.502499 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-298b4399-4f38-414d-b185-8d6a911a0066 req-10f559fd-3f09-4d59-988b-42ba39ccf1df service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:32.503364 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-298b4399-4f38-414d-b185-8d6a911a0066 req-10f559fd-3f09-4d59-988b-42ba39ccf1df service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:32.523110 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-298b4399-4f38-414d-b185-8d6a911a0066 req-10f559fd-3f09-4d59-988b-42ba39ccf1df service nova] Creating event network-vif-deleted:8bb12be9-bcf5-4244-b7a1-ef10ac33bd74 for instance f0374fc2-3c0f-48e1-b969-2933785fd47b on n-h2-846463-3 Sep 23 04:51:32.529725 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-457550c6-0d1f-4ad5-a308-6b7cc7e1ca1a tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Flavor limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:51:32.530211 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-457550c6-0d1f-4ad5-a308-6b7cc7e1ca1a tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Image limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:51:32.530695 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-457550c6-0d1f-4ad5-a308-6b7cc7e1ca1a tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Flavor pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:51:32.532664 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-298b4399-4f38-414d-b185-8d6a911a0066 req-10f559fd-3f09-4d59-988b-42ba39ccf1df service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057798 Sep 23 04:51:32.533906 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2221/4563] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:51:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:51:32.538886 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-457550c6-0d1f-4ad5-a308-6b7cc7e1ca1a tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Image pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:51:32.539428 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-457550c6-0d1f-4ad5-a308-6b7cc7e1ca1a tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:51:32.540032 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-07050747-6dea-4725-89aa-431243d1fe40 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:32.540991 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-07050747-6dea-4725-89aa-431243d1fe40 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] [instance: f0374fc2-3c0f-48e1-b969-2933785fd47b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:32.548684 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-07050747-6dea-4725-89aa-431243d1fe40 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:32.549581 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-07050747-6dea-4725-89aa-431243d1fe40 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:32.550271 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-07050747-6dea-4725-89aa-431243d1fe40 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:32.551351 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-07050747-6dea-4725-89aa-431243d1fe40 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:32.552187 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-07050747-6dea-4725-89aa-431243d1fe40 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:32.552949 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-07050747-6dea-4725-89aa-431243d1fe40 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:32.561580 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-457550c6-0d1f-4ad5-a308-6b7cc7e1ca1a tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:32.562131 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-457550c6-0d1f-4ad5-a308-6b7cc7e1ca1a tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:32.562623 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-457550c6-0d1f-4ad5-a308-6b7cc7e1ca1a tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:32.567820 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-457550c6-0d1f-4ad5-a308-6b7cc7e1ca1a tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:32.568331 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-457550c6-0d1f-4ad5-a308-6b7cc7e1ca1a tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:32.568785 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-457550c6-0d1f-4ad5-a308-6b7cc7e1ca1a tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:32.575243 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-07050747-6dea-4725-89aa-431243d1fe40 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] HTTP exception thrown: Instance f0374fc2-3c0f-48e1-b969-2933785fd47b could not be found. Sep 23 04:51:32.581302 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-07050747-6dea-4725-89aa-431243d1fe40 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Request method failure captured: Sep 23 04:51:32.581302 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/f0374fc2-3c0f-48e1-b969-2933785fd47b HTTP/1.1 Sep 23 04:51:32.581302 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:51:32.581302 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:51:32.581302 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:51:32.581302 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:51:32.581302 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:51:32.581302 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:51:32.581302 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:51:32.581302 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:51:32.581302 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLToEB3KmJeqpeof3qtE1_ms3jD5q4R8EB4mtf6agEJBYOf3R1k1wW8qdql02e7ra521m3dklynQTAHmyD-EBkyV9p_88fIs_nz1LT08tnPBKYcM8ytHDfif-4FU40Ttv4qlVJY_DNQ2W4b2ZBQdDVOwU9-lTsZtqbQggZ1JBKRn9aZQ Sep 23 04:51:32.581302 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:51:32.581302 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:51:32.581302 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:51:32.581302 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:51:32.581302 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:51:32.581302 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:51:32.581302 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: dcafb05f6f554e278cd552023947c6ac Sep 23 04:51:32.581302 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-196358672 Sep 23 04:51:32.581302 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:51:32.581302 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:51:32.581302 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_dcafb05f6f554e278cd552023947c6ac", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dcafb05f6f554e278cd552023947c6ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/dcafb05f6f554e278cd552023947c6ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dcafb05f6f554e278cd552023947c6ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:51:32.581302 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ServerRescueNegativeTestJSON-196358672 Sep 23 04:51:32.581302 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: dcafb05f6f554e278cd552023947c6ac Sep 23 04:51:32.581302 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-196358672 Sep 23 04:51:32.581302 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ServerRescueNegativeTestJSON-196358672-project Sep 23 04:51:32.581302 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:51:32.581302 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:51:32.581302 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: c786bbedc21849ea92924139a44707b7 Sep 23 04:51:32.581302 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ServerRescueNegativeTestJSON-196358672-project Sep 23 04:51:32.581302 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:51:32.581302 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance f0374fc2-3c0f-48e1-b969-2933785fd47b could not be found. Sep 23 04:51:32.581302 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': 'f0374fc2-3c0f-48e1-b969-2933785fd47b'} Sep 23 04:51:32.581302 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:51:32.581302 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:51:32.581302 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:51:32.581302 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:51:32.581302 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:51:32.581302 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:51:32.581302 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:51:32.581302 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:51:32.581302 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:51:32.581302 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:51:32.581302 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0374fc2-3c0f-48e1-b969-2933785fd47b could not be found. Sep 23 04:51:32.581302 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:51:32.581302 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:51:32.581302 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:51:32.581302 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:51:32.581302 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:51:32.581302 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:51:32.581302 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:51:32.581302 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:51:32.581302 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:51:32.581302 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:51:32.581302 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:51:32.581302 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:51:32.581302 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:51:32.581302 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:51:32.581302 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:51:32.581302 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:51:32.581302 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0374fc2-3c0f-48e1-b969-2933785fd47b could not be found. Sep 23 04:51:32.581302 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:51:32.581302 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:51:32.586659 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:51:32.586659 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:51:32.586659 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:51:32.586659 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:51:32.586659 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:51:32.586659 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:51:32.586659 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0374fc2-3c0f-48e1-b969-2933785fd47b could not be found. Sep 23 04:51:32.586659 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:51:32.586659 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-07050747-6dea-4725-89aa-431243d1fe40 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] Returning 404 to user: Instance f0374fc2-3c0f-48e1-b969-2933785fd47b could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:51:32.586659 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-07050747-6dea-4725-89aa-431243d1fe40 tempest-ServerRescueNegativeTestJSON-196358672 tempest-ServerRescueNegativeTestJSON-196358672-project] 10.222.0.33 "GET /compute/v2.1/servers/f0374fc2-3c0f-48e1-b969-2933785fd47b" status: 404 len: 111 microversion: 2.1 time: 0.043992 Sep 23 04:51:32.586659 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2222/4564] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:32 2022] GET /compute/v2.1/servers/f0374fc2-3c0f-48e1-b969-2933785fd47b => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:51:32.598915 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4efe897f-810c-4249-8ede-3ae659af7ded tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-655172891", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "b7e8b115-8e12-465e-92a9-2017f928523b"}, {"port": "6d6aeefc-17b8-455d-8d06-9189331b6022", "tag": "port-1"}, {"port": "18162764-2c41-4a27-9757-c9988b7e7d84", "tag": "port-2"}, {"uuid": "83b0dd5e-26ca-4721-9297-33ae3f212491", "tag": "net-1"}, {"uuid": "83b0dd5e-26ca-4721-9297-33ae3f212491"}, {"uuid": "77ba2f2b-323d-4b2c-afd8-cf6eab7a87cd", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "77ba2f2b-323d-4b2c-afd8-cf6eab7a87cd", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "b94f7ca6-ea76-4d37-836f-4b767966d7a2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "c81cf631-ecaa-48e0-afd7-ec7cf5ff78d9", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "2a54144f-ca65-430c-81ee-b2a1b78bd7d4", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1527824984"}], "key_name": "tempest-keypair-881461369", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:51:32.618800 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-457550c6-0d1f-4ad5-a308-6b7cc7e1ca1a tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Getting quotas for project 598e5e00bee244ee973df9124e15068b. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:51:32.633068 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-457550c6-0d1f-4ad5-a308-6b7cc7e1ca1a tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Getting quotas for user 923fa0e0e08047a484ff0e129afaf09a and project 598e5e00bee244ee973df9124e15068b. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:51:32.671989 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-457550c6-0d1f-4ad5-a308-6b7cc7e1ca1a tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Going to run 1 instances... {{(pid=122699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:51:32.678559 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-457550c6-0d1f-4ad5-a308-6b7cc7e1ca1a tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] [instance: 60bc9648-12d2-4db3-baf8-634b739c15f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:51:32.810563 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.network.neutron [None req-4efe897f-810c-4249-8ede-3ae659af7ded tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] validate_networks() for [('b7e8b115-8e12-465e-92a9-2017f928523b', None, None, None, None, None), (None, None, '6d6aeefc-17b8-455d-8d06-9189331b6022', None, None, None), (None, None, '18162764-2c41-4a27-9757-c9988b7e7d84', None, None, None), ('83b0dd5e-26ca-4721-9297-33ae3f212491', None, None, None, None, None), ('83b0dd5e-26ca-4721-9297-33ae3f212491', None, None, None, None, None), ('77ba2f2b-323d-4b2c-afd8-cf6eab7a87cd', '10.2.2.100', None, None, None, None), ('77ba2f2b-323d-4b2c-afd8-cf6eab7a87cd', '10.2.2.200', None, None, None, None)] {{(pid=122698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:51:32.907535 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-457550c6-0d1f-4ad5-a308-6b7cc7e1ca1a tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.654745 Sep 23 04:51:32.915404 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2343/4565] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:51:31 2022] POST /compute/v2.1/servers => generated 409 bytes in 1666 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:51:32.922977 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c0e073be-8695-4e0c-9f81-f562643620d5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:32.924222 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c0e073be-8695-4e0c-9f81-f562643620d5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:32.933137 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c0e073be-8695-4e0c-9f81-f562643620d5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:32.933939 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c0e073be-8695-4e0c-9f81-f562643620d5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:32.934812 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c0e073be-8695-4e0c-9f81-f562643620d5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:32.938618 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c0e073be-8695-4e0c-9f81-f562643620d5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:32.939616 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c0e073be-8695-4e0c-9f81-f562643620d5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:32.940255 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c0e073be-8695-4e0c-9f81-f562643620d5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:33.880844 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=8 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:51:33.992812 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c0e073be-8695-4e0c-9f81-f562643620d5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:34.003513 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c0e073be-8695-4e0c-9f81-f562643620d5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1670 microversion: 2.1 time: 1.086443 Sep 23 04:51:34.004553 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2344/4566] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:32 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1670 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:51:34.035116 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-bb1a6fb1-ff0c-42f6-9f9f-0c1f60e15385 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:34.036102 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-bb1a6fb1-ff0c-42f6-9f9f-0c1f60e15385 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:34.043944 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bb1a6fb1-ff0c-42f6-9f9f-0c1f60e15385 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:34.044717 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bb1a6fb1-ff0c-42f6-9f9f-0c1f60e15385 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:34.045432 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bb1a6fb1-ff0c-42f6-9f9f-0c1f60e15385 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:34.046349 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bb1a6fb1-ff0c-42f6-9f9f-0c1f60e15385 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:34.049173 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bb1a6fb1-ff0c-42f6-9f9f-0c1f60e15385 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:34.049794 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bb1a6fb1-ff0c-42f6-9f9f-0c1f60e15385 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:34.707232 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-bb1a6fb1-ff0c-42f6-9f9f-0c1f60e15385 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:34.720612 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-bb1a6fb1-ff0c-42f6-9f9f-0c1f60e15385 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1525 microversion: 2.1 time: 0.714911 Sep 23 04:51:34.721202 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2345/4567] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:34 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1525 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:51:34.731933 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e0ec6c2d-87f2-4736-8d39-020df3e49bb5 tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:34.732883 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e0ec6c2d-87f2-4736-8d39-020df3e49bb5 tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] [instance: 60bc9648-12d2-4db3-baf8-634b739c15f5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:35.627980 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e0ec6c2d-87f2-4736-8d39-020df3e49bb5 tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923fa0e0e08047a484ff0e129afaf09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e5e00bee244ee973df9124e15068b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:35.654096 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e0ec6c2d-87f2-4736-8d39-020df3e49bb5 tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] 10.222.0.33 "GET /compute/v2.1/servers/60bc9648-12d2-4db3-baf8-634b739c15f5" status: 200 len: 1277 microversion: 2.1 time: 0.926158 Sep 23 04:51:35.657369 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2346/4568] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:34 2022] GET /compute/v2.1/servers/60bc9648-12d2-4db3-baf8-634b739c15f5 => generated 1277 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:51:35.693949 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f6116a89-ef45-457b-8cde-4652e54155bf tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:35.694584 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f6116a89-ef45-457b-8cde-4652e54155bf tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:35.711237 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f6116a89-ef45-457b-8cde-4652e54155bf tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:35.715688 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f6116a89-ef45-457b-8cde-4652e54155bf tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:35.715688 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f6116a89-ef45-457b-8cde-4652e54155bf tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:35.715688 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f6116a89-ef45-457b-8cde-4652e54155bf tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:35.716467 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f6116a89-ef45-457b-8cde-4652e54155bf tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:35.717069 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f6116a89-ef45-457b-8cde-4652e54155bf tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:36.502566 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f6116a89-ef45-457b-8cde-4652e54155bf tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:36.530035 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f6116a89-ef45-457b-8cde-4652e54155bf tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1670 microversion: 2.1 time: 0.844388 Sep 23 04:51:36.530795 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2347/4569] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:35 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1670 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:51:36.566385 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f0aea016-4c3f-4db2-a8f6-8a310668a27f tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:36.567027 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f0aea016-4c3f-4db2-a8f6-8a310668a27f tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:36.574655 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f0aea016-4c3f-4db2-a8f6-8a310668a27f tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:36.575407 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f0aea016-4c3f-4db2-a8f6-8a310668a27f tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:36.575932 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f0aea016-4c3f-4db2-a8f6-8a310668a27f tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:36.576688 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f0aea016-4c3f-4db2-a8f6-8a310668a27f tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:36.577209 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f0aea016-4c3f-4db2-a8f6-8a310668a27f tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:36.578399 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f0aea016-4c3f-4db2-a8f6-8a310668a27f tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:36.806486 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f0aea016-4c3f-4db2-a8f6-8a310668a27f tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:36.826330 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f0aea016-4c3f-4db2-a8f6-8a310668a27f tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1525 microversion: 2.1 time: 0.266473 Sep 23 04:51:36.826889 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2348/4570] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:36 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1525 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:51:36.838722 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-49d3294f-3ea8-4419-bcd5-ec1a521f0c69 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:36.842432 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-49d3294f-3ea8-4419-bcd5-ec1a521f0c69 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] [instance: 1d9dafd4-e427-4349-a142-2c3ed281b2b2] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:36.850035 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-49d3294f-3ea8-4419-bcd5-ec1a521f0c69 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:36.850035 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-49d3294f-3ea8-4419-bcd5-ec1a521f0c69 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:36.850400 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-49d3294f-3ea8-4419-bcd5-ec1a521f0c69 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:36.850944 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-49d3294f-3ea8-4419-bcd5-ec1a521f0c69 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:36.851589 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-49d3294f-3ea8-4419-bcd5-ec1a521f0c69 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:36.852179 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-49d3294f-3ea8-4419-bcd5-ec1a521f0c69 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:36.871008 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-49d3294f-3ea8-4419-bcd5-ec1a521f0c69 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] HTTP exception thrown: Instance 1d9dafd4-e427-4349-a142-2c3ed281b2b2 could not be found. Sep 23 04:51:36.873348 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-49d3294f-3ea8-4419-bcd5-ec1a521f0c69 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Request method failure captured: Sep 23 04:51:36.873348 n-d-846463-3 devstack@n-api.service[122699]: request: DELETE /compute/v2.1/servers/1d9dafd4-e427-4349-a142-2c3ed281b2b2 HTTP/1.1 Sep 23 04:51:36.873348 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:51:36.873348 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:51:36.873348 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:51:36.873348 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:51:36.873348 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:51:36.873348 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:51:36.873348 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:51:36.873348 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:51:36.873348 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTrhBVxvuFyCDQeoDVV1FpKtxqJtmotmG4T0Yln9ScS8W2uYPe6yTij0480Xjn1vSTCjEWigM4pCD4NIgLoQMZOXSdRfx-nkEFunqkwXAfzSNcWjOB2pO0PN0gQD6RxsFCb71saS9mddEq6BGw9UXsqEQ1UXDELMEZB2wY46QEp0uQE Sep 23 04:51:36.873348 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:51:36.873348 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:51:36.873348 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:51:36.873348 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:51:36.873348 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:51:36.873348 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:51:36.873348 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 2e32df90da6b43b7b8a562dd95e6833b Sep 23 04:51:36.873348 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ServersTestMultiNic-972382453 Sep 23 04:51:36.873348 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:51:36.873348 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:51:36.873348 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2e32df90da6b43b7b8a562dd95e6833b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2e32df90da6b43b7b8a562dd95e6833b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2e32df90da6b43b7b8a562dd95e6833b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2e32df90da6b43b7b8a562dd95e6833b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:51:36.873348 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ServersTestMultiNic-972382453 Sep 23 04:51:36.873348 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 2e32df90da6b43b7b8a562dd95e6833b Sep 23 04:51:36.873348 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ServersTestMultiNic-972382453 Sep 23 04:51:36.873348 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ServersTestMultiNic-972382453-project Sep 23 04:51:36.873348 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:51:36.873348 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:51:36.873348 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 91a52352ab894e8f88be0f9d1cef0b14 Sep 23 04:51:36.873348 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ServersTestMultiNic-972382453-project Sep 23 04:51:36.873348 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:51:36.873348 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 1d9dafd4-e427-4349-a142-2c3ed281b2b2 could not be found. Sep 23 04:51:36.873348 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '1d9dafd4-e427-4349-a142-2c3ed281b2b2'} Sep 23 04:51:36.873348 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:51:36.873348 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:51:36.873348 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:51:36.873348 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:51:36.873348 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:51:36.873348 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:51:36.873348 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:51:36.873348 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:51:36.873348 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:51:36.873348 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:51:36.873348 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d9dafd4-e427-4349-a142-2c3ed281b2b2 could not be found. Sep 23 04:51:36.873348 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:51:36.873348 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:51:36.873348 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:51:36.873348 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:51:36.873348 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:51:36.873348 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:51:36.873348 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:51:36.873348 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:51:36.873348 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:51:36.873348 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:51:36.873348 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 04:51:36.873348 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 04:51:36.873348 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 04:51:36.873348 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 04:51:36.873348 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:51:36.873348 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:51:36.873348 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:51:36.873348 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:51:36.878714 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d9dafd4-e427-4349-a142-2c3ed281b2b2 could not be found. Sep 23 04:51:36.878714 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:51:36.878714 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:51:36.878714 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:51:36.878714 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:51:36.878714 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:51:36.878714 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:51:36.878714 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:51:36.878714 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:51:36.878714 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d9dafd4-e427-4349-a142-2c3ed281b2b2 could not be found. Sep 23 04:51:36.878714 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:51:36.880467 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-49d3294f-3ea8-4419-bcd5-ec1a521f0c69 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Returning 404 to user: Instance 1d9dafd4-e427-4349-a142-2c3ed281b2b2 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:51:36.882195 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-49d3294f-3ea8-4419-bcd5-ec1a521f0c69 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] 10.222.0.33 "DELETE /compute/v2.1/servers/1d9dafd4-e427-4349-a142-2c3ed281b2b2" status: 404 len: 111 microversion: 2.1 time: 0.047260 Sep 23 04:51:36.883154 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2349/4571] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:51:36 2022] DELETE /compute/v2.1/servers/1d9dafd4-e427-4349-a142-2c3ed281b2b2 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:51:36.888107 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-740769cb-f7b6-41c7-8c84-c3bb89120fc0 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:36.893718 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-740769cb-f7b6-41c7-8c84-c3bb89120fc0 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:36.897241 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-740769cb-f7b6-41c7-8c84-c3bb89120fc0 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:36.898915 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-740769cb-f7b6-41c7-8c84-c3bb89120fc0 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:36.899368 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-740769cb-f7b6-41c7-8c84-c3bb89120fc0 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:36.900336 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-740769cb-f7b6-41c7-8c84-c3bb89120fc0 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:36.900805 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-740769cb-f7b6-41c7-8c84-c3bb89120fc0 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:36.901241 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-740769cb-f7b6-41c7-8c84-c3bb89120fc0 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:37.252544 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-740769cb-f7b6-41c7-8c84-c3bb89120fc0 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:37.266432 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-740769cb-f7b6-41c7-8c84-c3bb89120fc0 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1670 microversion: 2.1 time: 0.382123 Sep 23 04:51:37.267149 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2350/4572] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:36 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1670 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:51:37.277183 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ab6bc652-27ce-4a98-97f3-09d81029db59 tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:37.279797 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ab6bc652-27ce-4a98-97f3-09d81029db59 tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] [instance: 60bc9648-12d2-4db3-baf8-634b739c15f5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:37.295548 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ab6bc652-27ce-4a98-97f3-09d81029db59 tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:37.296403 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ab6bc652-27ce-4a98-97f3-09d81029db59 tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:37.297684 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ab6bc652-27ce-4a98-97f3-09d81029db59 tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:37.298699 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ab6bc652-27ce-4a98-97f3-09d81029db59 tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:37.299337 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ab6bc652-27ce-4a98-97f3-09d81029db59 tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:37.299930 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ab6bc652-27ce-4a98-97f3-09d81029db59 tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:37.436106 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ab6bc652-27ce-4a98-97f3-09d81029db59 tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923fa0e0e08047a484ff0e129afaf09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e5e00bee244ee973df9124e15068b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:37.452018 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ab6bc652-27ce-4a98-97f3-09d81029db59 tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] 10.222.0.33 "GET /compute/v2.1/servers/60bc9648-12d2-4db3-baf8-634b739c15f5" status: 200 len: 1337 microversion: 2.1 time: 0.183529 Sep 23 04:51:37.453917 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2351/4573] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:37 2022] GET /compute/v2.1/servers/60bc9648-12d2-4db3-baf8-634b739c15f5 => generated 1337 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:51:37.460934 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-444341de-e969-411b-ae09-e26ff82fbdd7 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:37.461766 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-444341de-e969-411b-ae09-e26ff82fbdd7 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] [instance: 1d9dafd4-e427-4349-a142-2c3ed281b2b2] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:37.474653 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-444341de-e969-411b-ae09-e26ff82fbdd7 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:37.475581 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-444341de-e969-411b-ae09-e26ff82fbdd7 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:37.476196 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-444341de-e969-411b-ae09-e26ff82fbdd7 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:37.477156 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-444341de-e969-411b-ae09-e26ff82fbdd7 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:37.478144 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-444341de-e969-411b-ae09-e26ff82fbdd7 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:37.479197 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-444341de-e969-411b-ae09-e26ff82fbdd7 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:37.520780 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-444341de-e969-411b-ae09-e26ff82fbdd7 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] HTTP exception thrown: Instance 1d9dafd4-e427-4349-a142-2c3ed281b2b2 could not be found. Sep 23 04:51:37.525106 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-444341de-e969-411b-ae09-e26ff82fbdd7 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Request method failure captured: Sep 23 04:51:37.525106 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/1d9dafd4-e427-4349-a142-2c3ed281b2b2 HTTP/1.1 Sep 23 04:51:37.525106 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:51:37.525106 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:51:37.525106 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:51:37.525106 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:51:37.525106 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:51:37.525106 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:51:37.525106 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:51:37.525106 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:51:37.525106 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTrhBVxvuFyCDQeoDVV1FpKtxqJtmotmG4T0Yln9ScS8W2uYPe6yTij0480Xjn1vSTCjEWigM4pCD4NIgLoQMZOXSdRfx-nkEFunqkwXAfzSNcWjOB2pO0PN0gQD6RxsFCb71saS9mddEq6BGw9UXsqEQ1UXDELMEZB2wY46QEp0uQE Sep 23 04:51:37.525106 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:51:37.525106 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:51:37.525106 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:51:37.525106 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:51:37.525106 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:51:37.525106 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:51:37.525106 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 2e32df90da6b43b7b8a562dd95e6833b Sep 23 04:51:37.525106 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ServersTestMultiNic-972382453 Sep 23 04:51:37.525106 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:51:37.525106 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:51:37.525106 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2e32df90da6b43b7b8a562dd95e6833b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2e32df90da6b43b7b8a562dd95e6833b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2e32df90da6b43b7b8a562dd95e6833b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2e32df90da6b43b7b8a562dd95e6833b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:51:37.525106 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ServersTestMultiNic-972382453 Sep 23 04:51:37.525106 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 2e32df90da6b43b7b8a562dd95e6833b Sep 23 04:51:37.525106 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ServersTestMultiNic-972382453 Sep 23 04:51:37.525106 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ServersTestMultiNic-972382453-project Sep 23 04:51:37.525106 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:51:37.525106 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:51:37.525106 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 91a52352ab894e8f88be0f9d1cef0b14 Sep 23 04:51:37.525106 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ServersTestMultiNic-972382453-project Sep 23 04:51:37.525106 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:51:37.525106 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 1d9dafd4-e427-4349-a142-2c3ed281b2b2 could not be found. Sep 23 04:51:37.525106 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '1d9dafd4-e427-4349-a142-2c3ed281b2b2'} Sep 23 04:51:37.525106 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:51:37.525106 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:51:37.525106 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:51:37.525106 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:51:37.525106 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:51:37.525106 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:51:37.525106 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:51:37.525106 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:51:37.525106 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:51:37.525106 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:51:37.525106 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d9dafd4-e427-4349-a142-2c3ed281b2b2 could not be found. Sep 23 04:51:37.525106 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:51:37.525106 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:51:37.525106 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:51:37.525106 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:51:37.525106 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:51:37.525106 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:51:37.525106 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:51:37.525106 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:51:37.525106 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:51:37.525106 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:51:37.525106 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:51:37.525106 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:51:37.525106 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:51:37.525106 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:51:37.525106 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:51:37.525106 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:51:37.525106 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d9dafd4-e427-4349-a142-2c3ed281b2b2 could not be found. Sep 23 04:51:37.525106 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:51:37.525106 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:51:37.525106 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:51:37.530419 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:51:37.530419 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:51:37.530419 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:51:37.530419 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:51:37.530419 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:51:37.530419 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d9dafd4-e427-4349-a142-2c3ed281b2b2 could not be found. Sep 23 04:51:37.530419 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:51:37.542189 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-444341de-e969-411b-ae09-e26ff82fbdd7 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Returning 404 to user: Instance 1d9dafd4-e427-4349-a142-2c3ed281b2b2 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:51:37.542189 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-444341de-e969-411b-ae09-e26ff82fbdd7 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] 10.222.0.33 "GET /compute/v2.1/servers/1d9dafd4-e427-4349-a142-2c3ed281b2b2" status: 404 len: 111 microversion: 2.1 time: 0.077260 Sep 23 04:51:37.542189 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2352/4574] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:37 2022] GET /compute/v2.1/servers/1d9dafd4-e427-4349-a142-2c3ed281b2b2 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:51:37.547784 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-77338b95-f3c0-4ad1-b5f1-7a9b84e20704 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:51:37.548636 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-77338b95-f3c0-4ad1-b5f1-7a9b84e20704 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:37.557729 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:51:37.559876 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-77338b95-f3c0-4ad1-b5f1-7a9b84e20704 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:37.560577 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-77338b95-f3c0-4ad1-b5f1-7a9b84e20704 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:37.561280 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-77338b95-f3c0-4ad1-b5f1-7a9b84e20704 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:37.564319 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-77338b95-f3c0-4ad1-b5f1-7a9b84e20704 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:37.565067 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-77338b95-f3c0-4ad1-b5f1-7a9b84e20704 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:37.565994 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-77338b95-f3c0-4ad1-b5f1-7a9b84e20704 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:37.940675 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-77338b95-f3c0-4ad1-b5f1-7a9b84e20704 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Locking {{(pid=122699) lock /opt/stack/nova/nova/compute/api.py:4845}} Sep 23 04:51:38.301805 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-77338b95-f3c0-4ad1-b5f1-7a9b84e20704 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "POST /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5/action" status: 202 len: 0 microversion: 2.1 time: 0.766777 Sep 23 04:51:38.307688 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2353/4575] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:51:37 2022] POST /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5/action => generated 0 bytes in 773 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:51:38.313463 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-310fcae3-d3da-4382-9c86-2d9150baad73 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:38.326803 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-310fcae3-d3da-4382-9c86-2d9150baad73 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] [instance: 0ecb44a6-a97f-4177-aa9a-29a5b9b51a95] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:38.326803 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-310fcae3-d3da-4382-9c86-2d9150baad73 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:38.326803 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-310fcae3-d3da-4382-9c86-2d9150baad73 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:38.326803 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-310fcae3-d3da-4382-9c86-2d9150baad73 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:38.326803 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-310fcae3-d3da-4382-9c86-2d9150baad73 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:38.326803 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-310fcae3-d3da-4382-9c86-2d9150baad73 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:38.326803 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-310fcae3-d3da-4382-9c86-2d9150baad73 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:38.354894 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-310fcae3-d3da-4382-9c86-2d9150baad73 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] HTTP exception thrown: Instance 0ecb44a6-a97f-4177-aa9a-29a5b9b51a95 could not be found. Sep 23 04:51:38.360248 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-310fcae3-d3da-4382-9c86-2d9150baad73 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Request method failure captured: Sep 23 04:51:38.360248 n-d-846463-3 devstack@n-api.service[122699]: request: DELETE /compute/v2.1/servers/0ecb44a6-a97f-4177-aa9a-29a5b9b51a95 HTTP/1.1 Sep 23 04:51:38.360248 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:51:38.360248 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:51:38.360248 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:51:38.360248 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:51:38.360248 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:51:38.360248 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:51:38.360248 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:51:38.360248 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:51:38.360248 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTrhBVxvuFyCDQeoDVV1FpKtxqJtmotmG4T0Yln9ScS8W2uYPe6yTij0480Xjn1vSTCjEWigM4pCD4NIgLoQMZOXSdRfx-nkEFunqkwXAfzSNcWjOB2pO0PN0gQD6RxsFCb71saS9mddEq6BGw9UXsqEQ1UXDELMEZB2wY46QEp0uQE Sep 23 04:51:38.360248 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:51:38.360248 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:51:38.360248 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:51:38.360248 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:51:38.360248 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:51:38.360248 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:51:38.360248 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 2e32df90da6b43b7b8a562dd95e6833b Sep 23 04:51:38.360248 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ServersTestMultiNic-972382453 Sep 23 04:51:38.360248 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:51:38.360248 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:51:38.360248 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2e32df90da6b43b7b8a562dd95e6833b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2e32df90da6b43b7b8a562dd95e6833b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2e32df90da6b43b7b8a562dd95e6833b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2e32df90da6b43b7b8a562dd95e6833b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:51:38.360248 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ServersTestMultiNic-972382453 Sep 23 04:51:38.360248 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 2e32df90da6b43b7b8a562dd95e6833b Sep 23 04:51:38.360248 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ServersTestMultiNic-972382453 Sep 23 04:51:38.360248 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ServersTestMultiNic-972382453-project Sep 23 04:51:38.360248 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:51:38.360248 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:51:38.360248 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 91a52352ab894e8f88be0f9d1cef0b14 Sep 23 04:51:38.360248 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ServersTestMultiNic-972382453-project Sep 23 04:51:38.360248 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:51:38.360248 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 0ecb44a6-a97f-4177-aa9a-29a5b9b51a95 could not be found. Sep 23 04:51:38.360248 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '0ecb44a6-a97f-4177-aa9a-29a5b9b51a95'} Sep 23 04:51:38.360248 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:51:38.360248 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:51:38.360248 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:51:38.360248 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:51:38.360248 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:51:38.360248 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:51:38.360248 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:51:38.360248 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:51:38.360248 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:51:38.360248 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:51:38.360248 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ecb44a6-a97f-4177-aa9a-29a5b9b51a95 could not be found. Sep 23 04:51:38.360248 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:51:38.360248 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:51:38.360248 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:51:38.360248 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:51:38.360248 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:51:38.360248 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:51:38.360248 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:51:38.360248 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:51:38.360248 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:51:38.360248 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:51:38.360248 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 04:51:38.360248 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 04:51:38.360248 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 04:51:38.360248 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 04:51:38.360248 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:51:38.360248 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:51:38.360248 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:51:38.360248 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:51:38.371651 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ecb44a6-a97f-4177-aa9a-29a5b9b51a95 could not be found. Sep 23 04:51:38.371651 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:51:38.371651 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:51:38.371651 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:51:38.371651 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:51:38.371651 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:51:38.371651 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:51:38.371651 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:51:38.371651 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:51:38.371651 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ecb44a6-a97f-4177-aa9a-29a5b9b51a95 could not be found. Sep 23 04:51:38.371651 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:51:38.371651 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-310fcae3-d3da-4382-9c86-2d9150baad73 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Returning 404 to user: Instance 0ecb44a6-a97f-4177-aa9a-29a5b9b51a95 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:51:38.371651 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-310fcae3-d3da-4382-9c86-2d9150baad73 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] 10.222.0.33 "DELETE /compute/v2.1/servers/0ecb44a6-a97f-4177-aa9a-29a5b9b51a95" status: 404 len: 111 microversion: 2.1 time: 0.055791 Sep 23 04:51:38.374880 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2354/4576] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:51:38 2022] DELETE /compute/v2.1/servers/0ecb44a6-a97f-4177-aa9a-29a5b9b51a95 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:51:38.387728 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ef9c742f-1ecc-4903-b93f-82f65f8e69cb tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:38.388791 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ef9c742f-1ecc-4903-b93f-82f65f8e69cb tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:38.404239 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ef9c742f-1ecc-4903-b93f-82f65f8e69cb tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:38.405070 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ef9c742f-1ecc-4903-b93f-82f65f8e69cb tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:38.405715 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ef9c742f-1ecc-4903-b93f-82f65f8e69cb tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:38.408523 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ef9c742f-1ecc-4903-b93f-82f65f8e69cb tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:38.412033 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ef9c742f-1ecc-4903-b93f-82f65f8e69cb tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:38.412761 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ef9c742f-1ecc-4903-b93f-82f65f8e69cb tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:38.852148 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ef9c742f-1ecc-4903-b93f-82f65f8e69cb tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:38.863127 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ef9c742f-1ecc-4903-b93f-82f65f8e69cb tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1525 microversion: 2.1 time: 0.486877 Sep 23 04:51:38.864333 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2355/4577] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:38 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1525 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:51:38.869216 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7948a8cc-34ed-4f9b-9e83-bd32d6c4df0a tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:38.869933 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-7948a8cc-34ed-4f9b-9e83-bd32d6c4df0a tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:38.882331 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7948a8cc-34ed-4f9b-9e83-bd32d6c4df0a tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:38.882331 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7948a8cc-34ed-4f9b-9e83-bd32d6c4df0a tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:38.882331 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7948a8cc-34ed-4f9b-9e83-bd32d6c4df0a tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:38.882331 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7948a8cc-34ed-4f9b-9e83-bd32d6c4df0a tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:38.882331 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7948a8cc-34ed-4f9b-9e83-bd32d6c4df0a tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:38.882331 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7948a8cc-34ed-4f9b-9e83-bd32d6c4df0a tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:39.314362 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-7948a8cc-34ed-4f9b-9e83-bd32d6c4df0a tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:39.328587 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-7948a8cc-34ed-4f9b-9e83-bd32d6c4df0a tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1670 microversion: 2.1 time: 0.462925 Sep 23 04:51:39.338040 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2356/4578] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:38 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1670 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:51:39.343155 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d3eac9c9-1794-4bc2-b0aa-3524ba815b93 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:39.343822 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d3eac9c9-1794-4bc2-b0aa-3524ba815b93 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] [instance: 0ecb44a6-a97f-4177-aa9a-29a5b9b51a95] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:39.363680 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d3eac9c9-1794-4bc2-b0aa-3524ba815b93 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:39.364204 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d3eac9c9-1794-4bc2-b0aa-3524ba815b93 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:39.369021 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d3eac9c9-1794-4bc2-b0aa-3524ba815b93 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:39.374150 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d3eac9c9-1794-4bc2-b0aa-3524ba815b93 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:39.374150 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d3eac9c9-1794-4bc2-b0aa-3524ba815b93 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:39.374150 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d3eac9c9-1794-4bc2-b0aa-3524ba815b93 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:39.409735 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-d3eac9c9-1794-4bc2-b0aa-3524ba815b93 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] HTTP exception thrown: Instance 0ecb44a6-a97f-4177-aa9a-29a5b9b51a95 could not be found. Sep 23 04:51:39.411553 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d3eac9c9-1794-4bc2-b0aa-3524ba815b93 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Request method failure captured: Sep 23 04:51:39.411553 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/0ecb44a6-a97f-4177-aa9a-29a5b9b51a95 HTTP/1.1 Sep 23 04:51:39.411553 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:51:39.411553 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:51:39.411553 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:51:39.411553 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:51:39.411553 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:51:39.411553 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:51:39.411553 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:51:39.411553 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:51:39.411553 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTrhBVxvuFyCDQeoDVV1FpKtxqJtmotmG4T0Yln9ScS8W2uYPe6yTij0480Xjn1vSTCjEWigM4pCD4NIgLoQMZOXSdRfx-nkEFunqkwXAfzSNcWjOB2pO0PN0gQD6RxsFCb71saS9mddEq6BGw9UXsqEQ1UXDELMEZB2wY46QEp0uQE Sep 23 04:51:39.411553 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:51:39.411553 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:51:39.411553 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:51:39.411553 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:51:39.411553 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:51:39.411553 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:51:39.411553 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 2e32df90da6b43b7b8a562dd95e6833b Sep 23 04:51:39.411553 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ServersTestMultiNic-972382453 Sep 23 04:51:39.411553 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:51:39.411553 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:51:39.411553 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2e32df90da6b43b7b8a562dd95e6833b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2e32df90da6b43b7b8a562dd95e6833b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2e32df90da6b43b7b8a562dd95e6833b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2e32df90da6b43b7b8a562dd95e6833b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:51:39.411553 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ServersTestMultiNic-972382453 Sep 23 04:51:39.411553 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 2e32df90da6b43b7b8a562dd95e6833b Sep 23 04:51:39.411553 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ServersTestMultiNic-972382453 Sep 23 04:51:39.411553 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ServersTestMultiNic-972382453-project Sep 23 04:51:39.411553 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:51:39.411553 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:51:39.411553 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 91a52352ab894e8f88be0f9d1cef0b14 Sep 23 04:51:39.411553 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ServersTestMultiNic-972382453-project Sep 23 04:51:39.411553 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:51:39.411553 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 0ecb44a6-a97f-4177-aa9a-29a5b9b51a95 could not be found. Sep 23 04:51:39.411553 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '0ecb44a6-a97f-4177-aa9a-29a5b9b51a95'} Sep 23 04:51:39.411553 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:51:39.411553 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:51:39.411553 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:51:39.411553 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:51:39.411553 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:51:39.411553 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:51:39.411553 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:51:39.411553 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:51:39.411553 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:51:39.411553 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:51:39.411553 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ecb44a6-a97f-4177-aa9a-29a5b9b51a95 could not be found. Sep 23 04:51:39.411553 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:51:39.411553 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:51:39.411553 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:51:39.411553 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:51:39.411553 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:51:39.411553 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:51:39.411553 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:51:39.411553 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:51:39.411553 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:51:39.411553 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:51:39.411553 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:51:39.411553 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:51:39.411553 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:51:39.411553 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:51:39.411553 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:51:39.411553 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:51:39.411553 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ecb44a6-a97f-4177-aa9a-29a5b9b51a95 could not be found. Sep 23 04:51:39.411553 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:51:39.411553 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:51:39.411553 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:51:39.415287 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:51:39.415287 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:51:39.415287 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:51:39.415287 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:51:39.415287 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:51:39.415287 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ecb44a6-a97f-4177-aa9a-29a5b9b51a95 could not be found. Sep 23 04:51:39.415287 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:51:39.415287 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d3eac9c9-1794-4bc2-b0aa-3524ba815b93 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] Returning 404 to user: Instance 0ecb44a6-a97f-4177-aa9a-29a5b9b51a95 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:51:39.415287 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d3eac9c9-1794-4bc2-b0aa-3524ba815b93 tempest-ServersTestMultiNic-972382453 tempest-ServersTestMultiNic-972382453-project] 10.222.0.33 "GET /compute/v2.1/servers/0ecb44a6-a97f-4177-aa9a-29a5b9b51a95" status: 404 len: 111 microversion: 2.1 time: 0.084008 Sep 23 04:51:39.418003 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2357/4579] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:39 2022] GET /compute/v2.1/servers/0ecb44a6-a97f-4177-aa9a-29a5b9b51a95 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:51:39.426827 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-35bc6466-8802-47d1-8abc-ba50f2d5f482 tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:39.433343 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-35bc6466-8802-47d1-8abc-ba50f2d5f482 tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] [instance: 60bc9648-12d2-4db3-baf8-634b739c15f5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:39.446794 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-35bc6466-8802-47d1-8abc-ba50f2d5f482 tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:39.452039 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-35bc6466-8802-47d1-8abc-ba50f2d5f482 tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:39.452834 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-35bc6466-8802-47d1-8abc-ba50f2d5f482 tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:39.453747 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-35bc6466-8802-47d1-8abc-ba50f2d5f482 tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:39.457234 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-35bc6466-8802-47d1-8abc-ba50f2d5f482 tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:39.459713 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-35bc6466-8802-47d1-8abc-ba50f2d5f482 tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:39.514376 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:51:40.403793 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-35bc6466-8802-47d1-8abc-ba50f2d5f482 tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923fa0e0e08047a484ff0e129afaf09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e5e00bee244ee973df9124e15068b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:40.421568 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-35bc6466-8802-47d1-8abc-ba50f2d5f482 tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] 10.222.0.33 "GET /compute/v2.1/servers/60bc9648-12d2-4db3-baf8-634b739c15f5" status: 200 len: 1403 microversion: 2.1 time: 0.995805 Sep 23 04:51:40.421568 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2358/4580] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:39 2022] GET /compute/v2.1/servers/60bc9648-12d2-4db3-baf8-634b739c15f5 => generated 1403 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:51:40.423327 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-734cd744-9578-4b31-9c18-1705bf8a607a tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:51:40.435030 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-734cd744-9578-4b31-9c18-1705bf8a607a tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:40.435655 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-734cd744-9578-4b31-9c18-1705bf8a607a tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:40.436440 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-734cd744-9578-4b31-9c18-1705bf8a607a tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:40.465045 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-734cd744-9578-4b31-9c18-1705bf8a607a tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] HTTP exception thrown: Instance 4fb569cf-4457-4695-ad5f-fcb78f0964c5 is locked Sep 23 04:51:40.468678 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-734cd744-9578-4b31-9c18-1705bf8a607a tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Request method failure captured: Sep 23 04:51:40.468678 n-d-846463-3 devstack@n-api.service[122699]: request: POST /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5/action HTTP/1.1 Sep 23 04:51:40.468678 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:51:40.468678 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:51:40.468678 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:51:40.468678 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 15 Sep 23 04:51:40.468678 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:51:40.468678 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:51:40.468678 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:51:40.468678 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:51:40.468678 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTo3L7rPLSTfUV5pEDb1r3o2InNz2xVZb49WfY5_7ohSycSRkpblNb-lg3W6XL2Ai8OaA9THkgwtcWGmxSj0UZ4x-A-nrlghfegV0nGu08AcEc2fcMb2XMVF2A7TFyZB5NC63XPko5HHmiQcxjEHCZqFI55a6beSN65iF07uDP5zXrg Sep 23 04:51:40.468678 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:51:40.468678 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:51:40.468678 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:51:40.468678 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:51:40.468678 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:51:40.468678 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:51:40.468678 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 2a45d69316a648fcb9c56190aaec5376 Sep 23 04:51:40.468678 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ServerActionsTestJSON-1180260513 Sep 23 04:51:40.468678 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:51:40.468678 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:51:40.468678 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2a45d69316a648fcb9c56190aaec5376", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2a45d69316a648fcb9c56190aaec5376"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2a45d69316a648fcb9c56190aaec5376"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2a45d69316a648fcb9c56190aaec5376"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:51:40.468678 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ServerActionsTestJSON-1180260513 Sep 23 04:51:40.468678 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 2a45d69316a648fcb9c56190aaec5376 Sep 23 04:51:40.468678 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ServerActionsTestJSON-1180260513 Sep 23 04:51:40.468678 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ServerActionsTestJSON-1180260513-project Sep 23 04:51:40.468678 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:51:40.468678 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:51:40.468678 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: f5e3a6e455e8483b8ce93ad380793335 Sep 23 04:51:40.468678 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ServerActionsTestJSON-1180260513-project Sep 23 04:51:40.468678 n-d-846463-3 devstack@n-api.service[122699]: Sep 23 04:51:40.468678 n-d-846463-3 devstack@n-api.service[122699]: {"os-stop": {}} Sep 23 04:51:40.468678 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:51:40.468678 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 4fb569cf-4457-4695-ad5f-fcb78f0964c5 is locked Sep 23 04:51:40.468678 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '4fb569cf-4457-4695-ad5f-fcb78f0964c5', 'body': {'os-stop': {}}} Sep 23 04:51:40.468678 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:51:40.468678 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:51:40.468678 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1449, in _stop_server Sep 23 04:51:40.468678 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Sep 23 04:51:40.468678 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Sep 23 04:51:40.468678 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Sep 23 04:51:40.468678 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 4fb569cf-4457-4695-ad5f-fcb78f0964c5 is locked Sep 23 04:51:40.468678 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:51:40.468678 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:51:40.468678 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:51:40.468678 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:51:40.468678 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:51:40.468678 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:51:40.468678 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:51:40.468678 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:51:40.468678 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:51:40.468678 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:51:40.468678 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1451, in _stop_server Sep 23 04:51:40.468678 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Sep 23 04:51:40.468678 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 4fb569cf-4457-4695-ad5f-fcb78f0964c5 is locked Sep 23 04:51:40.468678 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:51:40.468678 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:51:40.468678 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:51:40.468678 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:51:40.468678 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:51:40.468678 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:51:40.468678 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:51:40.468678 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:51:40.468678 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fb569cf-4457-4695-ad5f-fcb78f0964c5 is locked Sep 23 04:51:40.468678 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:51:40.474057 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-734cd744-9578-4b31-9c18-1705bf8a607a tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Returning 409 to user: Instance 4fb569cf-4457-4695-ad5f-fcb78f0964c5 is locked {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:51:40.474057 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-734cd744-9578-4b31-9c18-1705bf8a607a tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "POST /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5/action" status: 409 len: 107 microversion: 2.1 time: 0.051410 Sep 23 04:51:40.474057 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2359/4581] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:51:40 2022] POST /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5/action => generated 107 bytes in 57 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 23 04:51:40.479663 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-368b9cbe-d862-43d6-8e2f-af2cf7b7dcd6 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:40.480347 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-368b9cbe-d862-43d6-8e2f-af2cf7b7dcd6 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:40.488579 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-368b9cbe-d862-43d6-8e2f-af2cf7b7dcd6 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:40.489360 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-368b9cbe-d862-43d6-8e2f-af2cf7b7dcd6 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:40.489942 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-368b9cbe-d862-43d6-8e2f-af2cf7b7dcd6 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:40.490855 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-368b9cbe-d862-43d6-8e2f-af2cf7b7dcd6 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:40.491503 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-368b9cbe-d862-43d6-8e2f-af2cf7b7dcd6 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:40.492059 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-368b9cbe-d862-43d6-8e2f-af2cf7b7dcd6 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:40.958416 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-4efe897f-810c-4249-8ede-3ae659af7ded tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Flavor limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:51:40.958999 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-4efe897f-810c-4249-8ede-3ae659af7ded tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Image limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:51:40.959502 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-4efe897f-810c-4249-8ede-3ae659af7ded tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Flavor pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:51:40.959919 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-4efe897f-810c-4249-8ede-3ae659af7ded tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Image pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:51:40.960336 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-4efe897f-810c-4249-8ede-3ae659af7ded tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:51:40.971108 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4efe897f-810c-4249-8ede-3ae659af7ded tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:40.971755 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4efe897f-810c-4249-8ede-3ae659af7ded tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:40.972207 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4efe897f-810c-4249-8ede-3ae659af7ded tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:40.973157 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4efe897f-810c-4249-8ede-3ae659af7ded tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:40.973452 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4efe897f-810c-4249-8ede-3ae659af7ded tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:40.973930 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4efe897f-810c-4249-8ede-3ae659af7ded tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:40.993436 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-4efe897f-810c-4249-8ede-3ae659af7ded tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Getting quotas for project df5513e89bb94c22854ef923561ef0ef. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:51:40.999050 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-4efe897f-810c-4249-8ede-3ae659af7ded tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Getting quotas for user f58f4b86f06947268442533ec19ef25d and project df5513e89bb94c22854ef923561ef0ef. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:51:41.041365 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-368b9cbe-d862-43d6-8e2f-af2cf7b7dcd6 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:41.051235 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-368b9cbe-d862-43d6-8e2f-af2cf7b7dcd6 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1507 microversion: 2.1 time: 0.575839 Sep 23 04:51:41.068270 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2360/4582] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:40 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1507 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:51:41.152300 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-3f6cf872-ec83-48b9-a320-04b146b9006a req-fe7aa7a1-deb9-4528-8794-b42079e4f2b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60bc9648-12d2-4db3-baf8-634b739c15f5", "tag": "40dc54c9-f14b-4e0e-8645-da8d221c6247"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:51:41.164893 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-3f6cf872-ec83-48b9-a320-04b146b9006a req-fe7aa7a1-deb9-4528-8794-b42079e4f2b2 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:41.165391 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-3f6cf872-ec83-48b9-a320-04b146b9006a req-fe7aa7a1-deb9-4528-8794-b42079e4f2b2 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:41.166397 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-3f6cf872-ec83-48b9-a320-04b146b9006a req-fe7aa7a1-deb9-4528-8794-b42079e4f2b2 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:41.179986 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-3f6cf872-ec83-48b9-a320-04b146b9006a req-fe7aa7a1-deb9-4528-8794-b42079e4f2b2 service nova] Creating event network-changed:40dc54c9-f14b-4e0e-8645-da8d221c6247 for instance 60bc9648-12d2-4db3-baf8-634b739c15f5 on n-h1-846463-3 Sep 23 04:51:41.183766 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4efe897f-810c-4249-8ede-3ae659af7ded tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Going to run 1 instances... {{(pid=122698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:51:41.186822 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4efe897f-810c-4249-8ede-3ae659af7ded tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] [instance: 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='b94f7ca6-ea76-4d37-836f-4b767966d7a2',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='c81cf631-ecaa-48e0-afd7-ec7cf5ff78d9',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2a54144f-ca65-430c-81ee-b2a1b78bd7d4',volume_size=None,volume_type=None)] {{(pid=122698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:51:41.195508 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-3f6cf872-ec83-48b9-a320-04b146b9006a req-fe7aa7a1-deb9-4528-8794-b42079e4f2b2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125824 Sep 23 04:51:41.196797 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2361/4583] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:51:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:51:41.203125 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6f160493-eec7-450b-bc44-7cea55fb2aa1 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:51:41.203754 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-6f160493-eec7-450b-bc44-7cea55fb2aa1 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:41.212023 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6f160493-eec7-450b-bc44-7cea55fb2aa1 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:41.212725 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6f160493-eec7-450b-bc44-7cea55fb2aa1 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:41.213243 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6f160493-eec7-450b-bc44-7cea55fb2aa1 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:41.214474 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6f160493-eec7-450b-bc44-7cea55fb2aa1 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:41.215159 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6f160493-eec7-450b-bc44-7cea55fb2aa1 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:41.215903 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6f160493-eec7-450b-bc44-7cea55fb2aa1 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:41.374381 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-6f160493-eec7-450b-bc44-7cea55fb2aa1 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Unlocking {{(pid=122699) unlock /opt/stack/nova/nova/compute/api.py:4874}} Sep 23 04:51:41.720087 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6f160493-eec7-450b-bc44-7cea55fb2aa1 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "POST /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5/action" status: 202 len: 0 microversion: 2.1 time: 0.519929 Sep 23 04:51:41.720087 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2362/4584] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:51:41 2022] POST /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5/action => generated 0 bytes in 522 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:51:41.724616 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-56392fb9-fabe-489c-9cd4-665b6f851a6a tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:41.725306 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-56392fb9-fabe-489c-9cd4-665b6f851a6a tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] [instance: 60bc9648-12d2-4db3-baf8-634b739c15f5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:41.731544 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-56392fb9-fabe-489c-9cd4-665b6f851a6a tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:41.732103 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-56392fb9-fabe-489c-9cd4-665b6f851a6a tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:41.732636 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-56392fb9-fabe-489c-9cd4-665b6f851a6a tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:41.733402 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-56392fb9-fabe-489c-9cd4-665b6f851a6a tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:41.733963 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-56392fb9-fabe-489c-9cd4-665b6f851a6a tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:41.734462 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-56392fb9-fabe-489c-9cd4-665b6f851a6a tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:42.143666 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-56392fb9-fabe-489c-9cd4-665b6f851a6a tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923fa0e0e08047a484ff0e129afaf09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e5e00bee244ee973df9124e15068b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:42.155959 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-56392fb9-fabe-489c-9cd4-665b6f851a6a tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] 10.222.0.33 "GET /compute/v2.1/servers/60bc9648-12d2-4db3-baf8-634b739c15f5" status: 200 len: 1403 microversion: 2.1 time: 0.435054 Sep 23 04:51:42.156629 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2363/4585] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:41 2022] GET /compute/v2.1/servers/60bc9648-12d2-4db3-baf8-634b739c15f5 => generated 1403 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:51:42.162033 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b4dcdbcb-ff2f-494c-a1d6-ec64f7ef59e5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:51:42.168729 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b4dcdbcb-ff2f-494c-a1d6-ec64f7ef59e5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:42.169227 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b4dcdbcb-ff2f-494c-a1d6-ec64f7ef59e5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:42.169751 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b4dcdbcb-ff2f-494c-a1d6-ec64f7ef59e5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:42.202219 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b4dcdbcb-ff2f-494c-a1d6-ec64f7ef59e5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Going to try to stop instance {{(pid=122699) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 23 04:51:42.498694 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b4dcdbcb-ff2f-494c-a1d6-ec64f7ef59e5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "POST /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5/action" status: 202 len: 0 microversion: 2.1 time: 0.340310 Sep 23 04:51:42.499240 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2364/4586] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:51:42 2022] POST /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5/action => generated 0 bytes in 342 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:51:42.506521 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-019db8a4-d47f-47f1-a872-4c8f7cc0f0ce tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:42.516551 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-019db8a4-d47f-47f1-a872-4c8f7cc0f0ce tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:42.525773 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-019db8a4-d47f-47f1-a872-4c8f7cc0f0ce tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:42.526397 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-019db8a4-d47f-47f1-a872-4c8f7cc0f0ce tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:42.526951 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-019db8a4-d47f-47f1-a872-4c8f7cc0f0ce tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:42.528132 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-019db8a4-d47f-47f1-a872-4c8f7cc0f0ce tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:42.529093 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-019db8a4-d47f-47f1-a872-4c8f7cc0f0ce tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:42.529799 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-019db8a4-d47f-47f1-a872-4c8f7cc0f0ce tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:42.594157 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:51:42.635660 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4efe897f-810c-4249-8ede-3ae659af7ded tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 10.052956 Sep 23 04:51:42.637542 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2223/4587] 10.222.0.33 () {62 vars in 1189 bytes} [Fri Sep 23 04:51:32 2022] POST /compute/v2.1/servers => generated 406 bytes in 10057 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 23 04:51:42.644596 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-d4959c54-5d46-42fb-b895-450ca697b58d req-91c6597e-b956-413a-be3d-cd2dedd1f2a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9f2ff08-c66d-4991-9bae-d523a3adb8bf", "name": "network-vif-unplugged", "status": "completed", "tag": "5cac1937-93f1-4537-9d14-be0ca8715d11"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:51:42.658552 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-d4959c54-5d46-42fb-b895-450ca697b58d req-91c6597e-b956-413a-be3d-cd2dedd1f2a7 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:42.659384 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-d4959c54-5d46-42fb-b895-450ca697b58d req-91c6597e-b956-413a-be3d-cd2dedd1f2a7 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:42.660071 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-d4959c54-5d46-42fb-b895-450ca697b58d req-91c6597e-b956-413a-be3d-cd2dedd1f2a7 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:42.697439 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-d4959c54-5d46-42fb-b895-450ca697b58d req-91c6597e-b956-413a-be3d-cd2dedd1f2a7 service nova] Creating event network-vif-unplugged:5cac1937-93f1-4537-9d14-be0ca8715d11 for instance a9f2ff08-c66d-4991-9bae-d523a3adb8bf on n-h1-846463-3 Sep 23 04:51:42.704140 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-d4959c54-5d46-42fb-b895-450ca697b58d req-91c6597e-b956-413a-be3d-cd2dedd1f2a7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065027 Sep 23 04:51:42.705244 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2224/4588] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:51:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:51:42.713525 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-cb473d89-39dc-4c8e-b9cf-9a41b266feb2 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:42.715171 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-cb473d89-39dc-4c8e-b9cf-9a41b266feb2 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:42.722922 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cb473d89-39dc-4c8e-b9cf-9a41b266feb2 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:42.723561 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cb473d89-39dc-4c8e-b9cf-9a41b266feb2 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:42.724085 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cb473d89-39dc-4c8e-b9cf-9a41b266feb2 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:42.724881 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cb473d89-39dc-4c8e-b9cf-9a41b266feb2 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:42.725417 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cb473d89-39dc-4c8e-b9cf-9a41b266feb2 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:42.726106 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cb473d89-39dc-4c8e-b9cf-9a41b266feb2 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:43.161451 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-019db8a4-d47f-47f1-a872-4c8f7cc0f0ce tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:43.173413 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-019db8a4-d47f-47f1-a872-4c8f7cc0f0ce tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1507 microversion: 2.1 time: 0.671966 Sep 23 04:51:43.174343 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2365/4589] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:42 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1507 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:51:43.179753 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5cd4c4ce-7c6a-4acd-a37f-0552e77f9aad tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:43.180748 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-5cd4c4ce-7c6a-4acd-a37f-0552e77f9aad tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] [instance: 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:43.271184 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-cb473d89-39dc-4c8e-b9cf-9a41b266feb2 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:43.279669 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-cb473d89-39dc-4c8e-b9cf-9a41b266feb2 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1680 microversion: 2.1 time: 0.572936 Sep 23 04:51:43.287462 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2225/4590] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:42 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1680 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:51:43.287462 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c710fd05-7268-4117-8bf8-5e41562b21ba tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:43.287462 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c710fd05-7268-4117-8bf8-5e41562b21ba tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] [instance: 60bc9648-12d2-4db3-baf8-634b739c15f5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:43.293143 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c710fd05-7268-4117-8bf8-5e41562b21ba tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:43.293845 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c710fd05-7268-4117-8bf8-5e41562b21ba tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:43.294519 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c710fd05-7268-4117-8bf8-5e41562b21ba tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:43.295269 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c710fd05-7268-4117-8bf8-5e41562b21ba tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:43.295743 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c710fd05-7268-4117-8bf8-5e41562b21ba tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:43.296684 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c710fd05-7268-4117-8bf8-5e41562b21ba tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:43.346784 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-5cd4c4ce-7c6a-4acd-a37f-0552e77f9aad tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:43.363078 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-5cd4c4ce-7c6a-4acd-a37f-0552e77f9aad tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:43.365916 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-5cd4c4ce-7c6a-4acd-a37f-0552e77f9aad tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:43.371827 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5cd4c4ce-7c6a-4acd-a37f-0552e77f9aad tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] 10.222.0.33 "GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7" status: 200 len: 1284 microversion: 2.32 time: 0.196118 Sep 23 04:51:43.380607 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2366/4591] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:51:43 2022] GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 => generated 1284 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:51:43.655457 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c710fd05-7268-4117-8bf8-5e41562b21ba tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923fa0e0e08047a484ff0e129afaf09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e5e00bee244ee973df9124e15068b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:43.672799 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c710fd05-7268-4117-8bf8-5e41562b21ba tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] 10.222.0.33 "GET /compute/v2.1/servers/60bc9648-12d2-4db3-baf8-634b739c15f5" status: 200 len: 1403 microversion: 2.1 time: 0.390266 Sep 23 04:51:43.674109 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2226/4592] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:43 2022] GET /compute/v2.1/servers/60bc9648-12d2-4db3-baf8-634b739c15f5 => generated 1403 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:51:44.197833 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4480e7bb-2ec5-400f-b704-016794f8c73e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:44.198561 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4480e7bb-2ec5-400f-b704-016794f8c73e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:44.212252 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4480e7bb-2ec5-400f-b704-016794f8c73e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:44.212857 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4480e7bb-2ec5-400f-b704-016794f8c73e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:44.213601 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4480e7bb-2ec5-400f-b704-016794f8c73e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:44.216232 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4480e7bb-2ec5-400f-b704-016794f8c73e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:44.223230 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4480e7bb-2ec5-400f-b704-016794f8c73e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:44.223936 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4480e7bb-2ec5-400f-b704-016794f8c73e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:44.308036 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-52cf0728-e5f5-41f5-98e4-0545379f4f7f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:44.309067 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-52cf0728-e5f5-41f5-98e4-0545379f4f7f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:44.352713 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-52cf0728-e5f5-41f5-98e4-0545379f4f7f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:44.353203 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-52cf0728-e5f5-41f5-98e4-0545379f4f7f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:44.359342 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-52cf0728-e5f5-41f5-98e4-0545379f4f7f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:44.359342 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-52cf0728-e5f5-41f5-98e4-0545379f4f7f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:44.359342 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-52cf0728-e5f5-41f5-98e4-0545379f4f7f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:44.359342 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-52cf0728-e5f5-41f5-98e4-0545379f4f7f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:44.509601 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-4480e7bb-2ec5-400f-b704-016794f8c73e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:44.529540 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4480e7bb-2ec5-400f-b704-016794f8c73e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1507 microversion: 2.1 time: 0.332611 Sep 23 04:51:44.544782 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2367/4593] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:44 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1507 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:51:44.552580 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9e62fa71-e06e-43d8-adff-8aae3b28107f tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:44.553342 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-9e62fa71-e06e-43d8-adff-8aae3b28107f tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] [instance: 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:44.561259 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9e62fa71-e06e-43d8-adff-8aae3b28107f tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:44.562727 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9e62fa71-e06e-43d8-adff-8aae3b28107f tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:44.563695 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9e62fa71-e06e-43d8-adff-8aae3b28107f tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:44.564839 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9e62fa71-e06e-43d8-adff-8aae3b28107f tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:44.565654 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9e62fa71-e06e-43d8-adff-8aae3b28107f tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:44.566547 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9e62fa71-e06e-43d8-adff-8aae3b28107f tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:44.748407 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-9e62fa71-e06e-43d8-adff-8aae3b28107f tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:44.761272 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-9e62fa71-e06e-43d8-adff-8aae3b28107f tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:44.763598 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-9e62fa71-e06e-43d8-adff-8aae3b28107f tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:44.765666 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-9e62fa71-e06e-43d8-adff-8aae3b28107f tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] 10.222.0.33 "GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7" status: 200 len: 1526 microversion: 2.32 time: 0.216571 Sep 23 04:51:44.768972 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2368/4594] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:51:44 2022] GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 => generated 1526 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:51:44.773073 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3091d720-243e-48e7-aaec-2a9f3c2f07a3 tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:44.773850 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-3091d720-243e-48e7-aaec-2a9f3c2f07a3 tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] [instance: 60bc9648-12d2-4db3-baf8-634b739c15f5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:44.787535 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-52cf0728-e5f5-41f5-98e4-0545379f4f7f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:44.788358 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3091d720-243e-48e7-aaec-2a9f3c2f07a3 tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:44.789666 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3091d720-243e-48e7-aaec-2a9f3c2f07a3 tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:44.791442 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3091d720-243e-48e7-aaec-2a9f3c2f07a3 tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:44.792448 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3091d720-243e-48e7-aaec-2a9f3c2f07a3 tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:44.792866 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3091d720-243e-48e7-aaec-2a9f3c2f07a3 tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:44.793468 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3091d720-243e-48e7-aaec-2a9f3c2f07a3 tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:44.813930 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-52cf0728-e5f5-41f5-98e4-0545379f4f7f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1680 microversion: 2.1 time: 0.497443 Sep 23 04:51:44.813930 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2227/4595] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:44 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1680 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:51:44.981103 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-3091d720-243e-48e7-aaec-2a9f3c2f07a3 tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923fa0e0e08047a484ff0e129afaf09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e5e00bee244ee973df9124e15068b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:44.990568 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3091d720-243e-48e7-aaec-2a9f3c2f07a3 tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] 10.222.0.33 "GET /compute/v2.1/servers/60bc9648-12d2-4db3-baf8-634b739c15f5" status: 200 len: 1403 microversion: 2.1 time: 0.222975 Sep 23 04:51:44.991216 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2369/4596] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:44 2022] GET /compute/v2.1/servers/60bc9648-12d2-4db3-baf8-634b739c15f5 => generated 1403 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:51:45.556171 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a5f8b0bb-46d1-4398-b46b-e7932656bfe0 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:45.557065 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a5f8b0bb-46d1-4398-b46b-e7932656bfe0 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:45.574648 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a5f8b0bb-46d1-4398-b46b-e7932656bfe0 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:45.575200 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a5f8b0bb-46d1-4398-b46b-e7932656bfe0 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:45.578442 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a5f8b0bb-46d1-4398-b46b-e7932656bfe0 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:45.579332 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a5f8b0bb-46d1-4398-b46b-e7932656bfe0 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:45.580393 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a5f8b0bb-46d1-4398-b46b-e7932656bfe0 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:45.580945 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a5f8b0bb-46d1-4398-b46b-e7932656bfe0 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:45.797273 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-68ea3504-a765-4628-b1a5-9636dd2de01a tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:45.802652 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-68ea3504-a765-4628-b1a5-9636dd2de01a tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] [instance: 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:45.802902 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a5f8b0bb-46d1-4398-b46b-e7932656bfe0 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:45.812356 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a5f8b0bb-46d1-4398-b46b-e7932656bfe0 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1510 microversion: 2.1 time: 0.260556 Sep 23 04:51:45.813498 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2228/4597] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:45 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1510 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:51:45.818212 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-68ea3504-a765-4628-b1a5-9636dd2de01a tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:45.818971 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-68ea3504-a765-4628-b1a5-9636dd2de01a tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:45.820137 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-68ea3504-a765-4628-b1a5-9636dd2de01a tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:45.821017 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-68ea3504-a765-4628-b1a5-9636dd2de01a tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:45.822155 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-68ea3504-a765-4628-b1a5-9636dd2de01a tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:45.822743 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-68ea3504-a765-4628-b1a5-9636dd2de01a tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:45.825592 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-14201587-53a6-4a22-a342-0ec4e2dfa525 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:45.826362 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-14201587-53a6-4a22-a342-0ec4e2dfa525 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:45.834205 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-14201587-53a6-4a22-a342-0ec4e2dfa525 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:45.835255 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-14201587-53a6-4a22-a342-0ec4e2dfa525 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:45.835808 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-14201587-53a6-4a22-a342-0ec4e2dfa525 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:45.836811 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-14201587-53a6-4a22-a342-0ec4e2dfa525 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:45.837424 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-14201587-53a6-4a22-a342-0ec4e2dfa525 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:45.837852 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-14201587-53a6-4a22-a342-0ec4e2dfa525 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:45.949340 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-68ea3504-a765-4628-b1a5-9636dd2de01a tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:45.961301 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-68ea3504-a765-4628-b1a5-9636dd2de01a tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:45.964156 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-68ea3504-a765-4628-b1a5-9636dd2de01a tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:45.965831 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-68ea3504-a765-4628-b1a5-9636dd2de01a tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] 10.222.0.33 "GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7" status: 200 len: 1574 microversion: 2.32 time: 0.174470 Sep 23 04:51:45.967317 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2370/4598] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:51:45 2022] GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 => generated 1574 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:51:45.992081 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d5bfd47f-185d-45c1-a97e-3470c1cd9cee tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:45.994760 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d5bfd47f-185d-45c1-a97e-3470c1cd9cee tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:46.013945 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d5bfd47f-185d-45c1-a97e-3470c1cd9cee tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:46.017424 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d5bfd47f-185d-45c1-a97e-3470c1cd9cee tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:46.019822 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d5bfd47f-185d-45c1-a97e-3470c1cd9cee tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:46.023663 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d5bfd47f-185d-45c1-a97e-3470c1cd9cee tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:46.024987 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d5bfd47f-185d-45c1-a97e-3470c1cd9cee tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:46.025667 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d5bfd47f-185d-45c1-a97e-3470c1cd9cee tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:46.105038 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-14201587-53a6-4a22-a342-0ec4e2dfa525 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:46.117933 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-14201587-53a6-4a22-a342-0ec4e2dfa525 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1680 microversion: 2.1 time: 0.298053 Sep 23 04:51:46.120229 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2229/4599] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:45 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1680 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:51:46.151519 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b66f661c-ba1e-4731-a44c-e721b51713c6 tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:46.152387 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b66f661c-ba1e-4731-a44c-e721b51713c6 tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] [instance: 60bc9648-12d2-4db3-baf8-634b739c15f5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:46.163366 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b66f661c-ba1e-4731-a44c-e721b51713c6 tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:46.169217 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b66f661c-ba1e-4731-a44c-e721b51713c6 tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:46.170547 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b66f661c-ba1e-4731-a44c-e721b51713c6 tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:46.172129 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b66f661c-ba1e-4731-a44c-e721b51713c6 tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:46.174212 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b66f661c-ba1e-4731-a44c-e721b51713c6 tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:46.174683 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b66f661c-ba1e-4731-a44c-e721b51713c6 tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:46.454305 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d5bfd47f-185d-45c1-a97e-3470c1cd9cee tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:46.467056 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d5bfd47f-185d-45c1-a97e-3470c1cd9cee tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1450 microversion: 2.1 time: 0.498180 Sep 23 04:51:46.491176 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2371/4600] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:45 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1450 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:51:46.550434 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3d1e832c-2f95-4c5e-a786-2acaab22e56a tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:51:46.551129 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-3d1e832c-2f95-4c5e-a786-2acaab22e56a tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:46.562067 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3d1e832c-2f95-4c5e-a786-2acaab22e56a tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:46.564877 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3d1e832c-2f95-4c5e-a786-2acaab22e56a tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:46.565594 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3d1e832c-2f95-4c5e-a786-2acaab22e56a tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:46.567274 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3d1e832c-2f95-4c5e-a786-2acaab22e56a tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:46.570710 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3d1e832c-2f95-4c5e-a786-2acaab22e56a tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:46.571456 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3d1e832c-2f95-4c5e-a786-2acaab22e56a tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:46.572534 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b66f661c-ba1e-4731-a44c-e721b51713c6 tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923fa0e0e08047a484ff0e129afaf09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e5e00bee244ee973df9124e15068b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:46.584219 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b66f661c-ba1e-4731-a44c-e721b51713c6 tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] 10.222.0.33 "GET /compute/v2.1/servers/60bc9648-12d2-4db3-baf8-634b739c15f5" status: 200 len: 1403 microversion: 2.1 time: 0.448205 Sep 23 04:51:46.608249 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2230/4601] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:46 2022] GET /compute/v2.1/servers/60bc9648-12d2-4db3-baf8-634b739c15f5 => generated 1403 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:51:46.639887 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-3d1e832c-2f95-4c5e-a786-2acaab22e56a tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lazy-loading 'flavor' on Instance uuid a9f2ff08-c66d-4991-9bae-d523a3adb8bf {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:51:46.677124 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-3d1e832c-2f95-4c5e-a786-2acaab22e56a tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] HTTP exception thrown: Cannot 'shelve' instance a9f2ff08-c66d-4991-9bae-d523a3adb8bf while it is in vm_state shelved_offloaded Sep 23 04:51:46.684474 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3d1e832c-2f95-4c5e-a786-2acaab22e56a tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Request method failure captured: Sep 23 04:51:46.684474 n-d-846463-3 devstack@n-api.service[122699]: request: POST /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf/action HTTP/1.1 Sep 23 04:51:46.684474 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:51:46.684474 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:51:46.684474 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:51:46.684474 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 14 Sep 23 04:51:46.684474 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:51:46.684474 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:51:46.684474 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:51:46.684474 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:51:46.684474 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTrDoGx96bSja4ydTGD-VWXTOyHeLiBA9Lvr197ivKeXqtV3OksEUUEiEPXK85IMwWXM1vCTp1M9PaXnUkKbFev29d-fL5KKXR0MfyGa86SLKINg6u_gn5EQLUNZ8EVLCkU1WwJ7agpVlFY75EyJH0fBcxrNg1yvFbeC2alzdH4Tkmw Sep 23 04:51:46.684474 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:51:46.684474 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:51:46.684474 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:51:46.684474 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:51:46.684474 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:51:46.684474 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:51:46.684474 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 78dca47156ff4f19a8673b893c853978 Sep 23 04:51:46.684474 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:51:46.684474 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:51:46.684474 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:51:46.684474 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_78dca47156ff4f19a8673b893c853978", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/78dca47156ff4f19a8673b893c853978"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/78dca47156ff4f19a8673b893c853978"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/78dca47156ff4f19a8673b893c853978"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:51:46.684474 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:51:46.684474 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 78dca47156ff4f19a8673b893c853978 Sep 23 04:51:46.684474 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:51:46.684474 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ServersNegativeTestJSON-1102187211-project Sep 23 04:51:46.684474 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:51:46.684474 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:51:46.684474 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: c912fb9d1f5447d180a9e8568220526f Sep 23 04:51:46.684474 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ServersNegativeTestJSON-1102187211-project Sep 23 04:51:46.684474 n-d-846463-3 devstack@n-api.service[122699]: Sep 23 04:51:46.684474 n-d-846463-3 devstack@n-api.service[122699]: {"shelve": {}} Sep 23 04:51:46.684474 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:51:46.684474 n-d-846463-3 devstack@n-api.service[122699]: exception: Cannot 'shelve' instance a9f2ff08-c66d-4991-9bae-d523a3adb8bf while it is in vm_state shelved_offloaded Sep 23 04:51:46.684474 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': 'a9f2ff08-c66d-4991-9bae-d523a3adb8bf', 'body': {'shelve': {}}} Sep 23 04:51:46.684474 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:51:46.684474 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:51:46.684474 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Sep 23 04:51:46.684474 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Sep 23 04:51:46.684474 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 23 04:51:46.684474 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 23 04:51:46.684474 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 23 04:51:46.684474 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 23 04:51:46.684474 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 23 04:51:46.684474 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 23 04:51:46.684474 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 23 04:51:46.684474 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 23 04:51:46.684474 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 23 04:51:46.684474 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 23 04:51:46.684474 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a9f2ff08-c66d-4991-9bae-d523a3adb8bf in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Sep 23 04:51:46.684474 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:51:46.684474 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:51:46.684474 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:51:46.684474 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:51:46.684474 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:51:46.684474 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:51:46.684474 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:51:46.684474 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:51:46.684474 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:51:46.684474 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:51:46.684474 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Sep 23 04:51:46.684474 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 23 04:51:46.684474 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 23 04:51:46.688566 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 23 04:51:46.688566 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance a9f2ff08-c66d-4991-9bae-d523a3adb8bf while it is in vm_state shelved_offloaded Sep 23 04:51:46.688566 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:51:46.688566 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:51:46.688566 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:51:46.688566 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:51:46.688566 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:51:46.688566 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:51:46.688566 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:51:46.688566 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:51:46.688566 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance a9f2ff08-c66d-4991-9bae-d523a3adb8bf while it is in vm_state shelved_offloaded Sep 23 04:51:46.688566 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:51:46.688566 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3d1e832c-2f95-4c5e-a786-2acaab22e56a tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Returning 409 to user: Cannot 'shelve' instance a9f2ff08-c66d-4991-9bae-d523a3adb8bf while it is in vm_state shelved_offloaded {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:51:46.688566 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3d1e832c-2f95-4c5e-a786-2acaab22e56a tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "POST /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf/action" status: 409 len: 155 microversion: 2.1 time: 0.147115 Sep 23 04:51:46.693446 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2372/4602] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:51:46 2022] POST /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf/action => generated 155 bytes in 153 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 23 04:51:46.700777 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4badde3d-b208-4d71-8a4e-c6152eb2cd28 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:51:46.701578 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4badde3d-b208-4d71-8a4e-c6152eb2cd28 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:46.721705 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4badde3d-b208-4d71-8a4e-c6152eb2cd28 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:46.722250 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4badde3d-b208-4d71-8a4e-c6152eb2cd28 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:46.722694 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4badde3d-b208-4d71-8a4e-c6152eb2cd28 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:46.723414 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4badde3d-b208-4d71-8a4e-c6152eb2cd28 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:46.729272 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4badde3d-b208-4d71-8a4e-c6152eb2cd28 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:46.731850 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4badde3d-b208-4d71-8a4e-c6152eb2cd28 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:46.816228 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4badde3d-b208-4d71-8a4e-c6152eb2cd28 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122698) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 23 04:51:46.994753 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=100 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:51:47.181958 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-d350b505-02b1-4738-be71-c4bb7d92a29c req-a7f40b23-d02e-4165-8341-454714a09afd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60bc9648-12d2-4db3-baf8-634b739c15f5", "name": "network-vif-plugged", "status": "completed", "tag": "40dc54c9-f14b-4e0e-8645-da8d221c6247"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:51:47.214050 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-d350b505-02b1-4738-be71-c4bb7d92a29c req-a7f40b23-d02e-4165-8341-454714a09afd service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:47.216023 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-d350b505-02b1-4738-be71-c4bb7d92a29c req-a7f40b23-d02e-4165-8341-454714a09afd service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:47.217404 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-d350b505-02b1-4738-be71-c4bb7d92a29c req-a7f40b23-d02e-4165-8341-454714a09afd service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:47.232653 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4badde3d-b208-4d71-8a4e-c6152eb2cd28 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "POST /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf/action" status: 202 len: 0 microversion: 2.1 time: 0.537486 Sep 23 04:51:47.240202 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2231/4603] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:51:46 2022] POST /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf/action => generated 0 bytes in 546 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 23 04:51:47.267367 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-109ff5a3-52db-4f0c-ac1d-034cdff72226 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:47.273867 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-109ff5a3-52db-4f0c-ac1d-034cdff72226 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] [instance: 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:47.288945 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-d350b505-02b1-4738-be71-c4bb7d92a29c req-a7f40b23-d02e-4165-8341-454714a09afd service nova] Creating event network-vif-plugged:40dc54c9-f14b-4e0e-8645-da8d221c6247 for instance 60bc9648-12d2-4db3-baf8-634b739c15f5 on n-h1-846463-3 Sep 23 04:51:47.290680 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-109ff5a3-52db-4f0c-ac1d-034cdff72226 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:47.298334 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-109ff5a3-52db-4f0c-ac1d-034cdff72226 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:47.298334 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-109ff5a3-52db-4f0c-ac1d-034cdff72226 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:47.298334 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-109ff5a3-52db-4f0c-ac1d-034cdff72226 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:47.298334 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-109ff5a3-52db-4f0c-ac1d-034cdff72226 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:47.298334 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-109ff5a3-52db-4f0c-ac1d-034cdff72226 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:47.299474 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-d350b505-02b1-4738-be71-c4bb7d92a29c req-a7f40b23-d02e-4165-8341-454714a09afd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.491978 Sep 23 04:51:47.299474 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2373/4604] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:51:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:51:47.639698 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f1944b6b-eaee-4f24-8a04-9454a47cd218 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:47.641032 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f1944b6b-eaee-4f24-8a04-9454a47cd218 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:47.655078 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f1944b6b-eaee-4f24-8a04-9454a47cd218 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:47.655078 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f1944b6b-eaee-4f24-8a04-9454a47cd218 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:47.658488 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f1944b6b-eaee-4f24-8a04-9454a47cd218 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:47.659481 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f1944b6b-eaee-4f24-8a04-9454a47cd218 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:47.660444 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f1944b6b-eaee-4f24-8a04-9454a47cd218 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:47.665627 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f1944b6b-eaee-4f24-8a04-9454a47cd218 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:47.730139 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:51:47.750282 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-109ff5a3-52db-4f0c-ac1d-034cdff72226 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:47.761576 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-109ff5a3-52db-4f0c-ac1d-034cdff72226 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:47.763083 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-109ff5a3-52db-4f0c-ac1d-034cdff72226 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:47.774618 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-109ff5a3-52db-4f0c-ac1d-034cdff72226 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] 10.222.0.33 "GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7" status: 200 len: 1592 microversion: 2.32 time: 0.533005 Sep 23 04:51:47.790503 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2232/4605] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:51:47 2022] GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 => generated 1592 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:51:47.805084 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-087b4803-c9bd-416f-85e1-144e6a3ec41e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:47.805938 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-087b4803-c9bd-416f-85e1-144e6a3ec41e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:47.833875 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-087b4803-c9bd-416f-85e1-144e6a3ec41e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:47.836682 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-087b4803-c9bd-416f-85e1-144e6a3ec41e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:47.842637 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-087b4803-c9bd-416f-85e1-144e6a3ec41e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:47.844227 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-087b4803-c9bd-416f-85e1-144e6a3ec41e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:47.846918 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-087b4803-c9bd-416f-85e1-144e6a3ec41e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:47.847536 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-087b4803-c9bd-416f-85e1-144e6a3ec41e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:48.128279 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f1944b6b-eaee-4f24-8a04-9454a47cd218 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:48.136033 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f1944b6b-eaee-4f24-8a04-9454a47cd218 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1680 microversion: 2.1 time: 0.838216 Sep 23 04:51:48.136984 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2374/4606] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:47 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1680 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:51:48.142951 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-78dbda06-8753-4106-92e0-e4aa2dd8831f tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:48.143729 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-78dbda06-8753-4106-92e0-e4aa2dd8831f tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] [instance: 60bc9648-12d2-4db3-baf8-634b739c15f5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:48.150239 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-78dbda06-8753-4106-92e0-e4aa2dd8831f tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:48.152846 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-78dbda06-8753-4106-92e0-e4aa2dd8831f tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:48.152846 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-78dbda06-8753-4106-92e0-e4aa2dd8831f tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:48.152846 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-78dbda06-8753-4106-92e0-e4aa2dd8831f tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:48.152846 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-78dbda06-8753-4106-92e0-e4aa2dd8831f tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:48.153450 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-78dbda06-8753-4106-92e0-e4aa2dd8831f tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:48.212754 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-087b4803-c9bd-416f-85e1-144e6a3ec41e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:48.224512 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-087b4803-c9bd-416f-85e1-144e6a3ec41e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1458 microversion: 2.1 time: 0.432774 Sep 23 04:51:48.226041 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2233/4607] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:47 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1458 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:51:48.348409 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-78dbda06-8753-4106-92e0-e4aa2dd8831f tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923fa0e0e08047a484ff0e129afaf09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e5e00bee244ee973df9124e15068b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:48.359152 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-78dbda06-8753-4106-92e0-e4aa2dd8831f tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] 10.222.0.33 "GET /compute/v2.1/servers/60bc9648-12d2-4db3-baf8-634b739c15f5" status: 200 len: 1403 microversion: 2.1 time: 0.219605 Sep 23 04:51:48.359942 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2375/4608] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:48 2022] GET /compute/v2.1/servers/60bc9648-12d2-4db3-baf8-634b739c15f5 => generated 1403 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:51:48.807738 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8a0d71c2-5d4d-4f62-b3e1-13d69219f567 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:48.808696 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8a0d71c2-5d4d-4f62-b3e1-13d69219f567 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] [instance: 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:48.814048 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:UPDATE=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:51:48.825804 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8a0d71c2-5d4d-4f62-b3e1-13d69219f567 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:48.828734 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8a0d71c2-5d4d-4f62-b3e1-13d69219f567 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:48.830180 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8a0d71c2-5d4d-4f62-b3e1-13d69219f567 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:48.831096 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8a0d71c2-5d4d-4f62-b3e1-13d69219f567 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:48.835882 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8a0d71c2-5d4d-4f62-b3e1-13d69219f567 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:48.835882 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8a0d71c2-5d4d-4f62-b3e1-13d69219f567 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:49.176990 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4b79414b-46d9-4d9a-81be-91fcaec3aecb tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:49.176990 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4b79414b-46d9-4d9a-81be-91fcaec3aecb tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:49.188413 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4b79414b-46d9-4d9a-81be-91fcaec3aecb tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:49.190223 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4b79414b-46d9-4d9a-81be-91fcaec3aecb tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:49.191749 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4b79414b-46d9-4d9a-81be-91fcaec3aecb tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:49.194186 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4b79414b-46d9-4d9a-81be-91fcaec3aecb tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:49.208274 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4b79414b-46d9-4d9a-81be-91fcaec3aecb tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:49.208643 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8a0d71c2-5d4d-4f62-b3e1-13d69219f567 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:49.211734 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4b79414b-46d9-4d9a-81be-91fcaec3aecb tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:49.223147 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8a0d71c2-5d4d-4f62-b3e1-13d69219f567 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:49.226101 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8a0d71c2-5d4d-4f62-b3e1-13d69219f567 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:49.228502 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8a0d71c2-5d4d-4f62-b3e1-13d69219f567 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] 10.222.0.33 "GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7" status: 200 len: 1660 microversion: 2.32 time: 0.427384 Sep 23 04:51:49.242658 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2234/4609] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:51:48 2022] GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 => generated 1660 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:51:49.257352 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6c567fef-983a-42b1-8b9b-f1c3e78b3dd9 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:49.258001 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-6c567fef-983a-42b1-8b9b-f1c3e78b3dd9 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:49.283370 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6c567fef-983a-42b1-8b9b-f1c3e78b3dd9 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:49.284525 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6c567fef-983a-42b1-8b9b-f1c3e78b3dd9 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:49.284984 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6c567fef-983a-42b1-8b9b-f1c3e78b3dd9 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:49.285711 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6c567fef-983a-42b1-8b9b-f1c3e78b3dd9 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:49.286204 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6c567fef-983a-42b1-8b9b-f1c3e78b3dd9 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:49.289594 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6c567fef-983a-42b1-8b9b-f1c3e78b3dd9 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:49.900983 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-4b79414b-46d9-4d9a-81be-91fcaec3aecb tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:49.908320 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6c567fef-983a-42b1-8b9b-f1c3e78b3dd9 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:49.930582 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4b79414b-46d9-4d9a-81be-91fcaec3aecb tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1680 microversion: 2.1 time: 0.769505 Sep 23 04:51:49.935105 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-6c567fef-983a-42b1-8b9b-f1c3e78b3dd9 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1458 microversion: 2.1 time: 0.689647 Sep 23 04:51:49.935925 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2376/4610] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:49 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1680 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:51:49.941012 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2235/4611] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:49 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1458 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:51:49.955022 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ad7a7d65-e1ac-404a-a97b-5fa60ac216bc tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:49.962818 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ad7a7d65-e1ac-404a-a97b-5fa60ac216bc tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] [instance: 60bc9648-12d2-4db3-baf8-634b739c15f5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:49.980290 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ad7a7d65-e1ac-404a-a97b-5fa60ac216bc tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:49.980854 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ad7a7d65-e1ac-404a-a97b-5fa60ac216bc tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:49.981305 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ad7a7d65-e1ac-404a-a97b-5fa60ac216bc tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:49.982675 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ad7a7d65-e1ac-404a-a97b-5fa60ac216bc tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:49.983156 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ad7a7d65-e1ac-404a-a97b-5fa60ac216bc tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:49.986868 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ad7a7d65-e1ac-404a-a97b-5fa60ac216bc tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:50.254685 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-332eb4e0-0e65-49fe-b543-c8020192798c tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:50.255127 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-332eb4e0-0e65-49fe-b543-c8020192798c tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] [instance: 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:50.268028 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-332eb4e0-0e65-49fe-b543-c8020192798c tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:50.270482 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-332eb4e0-0e65-49fe-b543-c8020192798c tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:50.271802 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-332eb4e0-0e65-49fe-b543-c8020192798c tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:50.273448 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-332eb4e0-0e65-49fe-b543-c8020192798c tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:50.275386 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-332eb4e0-0e65-49fe-b543-c8020192798c tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:50.276010 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-332eb4e0-0e65-49fe-b543-c8020192798c tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:50.293017 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ad7a7d65-e1ac-404a-a97b-5fa60ac216bc tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923fa0e0e08047a484ff0e129afaf09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e5e00bee244ee973df9124e15068b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:50.308843 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ad7a7d65-e1ac-404a-a97b-5fa60ac216bc tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] 10.222.0.33 "GET /compute/v2.1/servers/60bc9648-12d2-4db3-baf8-634b739c15f5" status: 200 len: 1589 microversion: 2.1 time: 0.368925 Sep 23 04:51:50.309440 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2377/4612] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:49 2022] GET /compute/v2.1/servers/60bc9648-12d2-4db3-baf8-634b739c15f5 => generated 1589 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:51:50.337168 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-cdc04fc9-98bc-4fe1-a348-75b3f084f1ac tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:50.339252 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-cdc04fc9-98bc-4fe1-a348-75b3f084f1ac tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] [instance: 60bc9648-12d2-4db3-baf8-634b739c15f5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:50.358103 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cdc04fc9-98bc-4fe1-a348-75b3f084f1ac tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:50.365834 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cdc04fc9-98bc-4fe1-a348-75b3f084f1ac tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:50.366619 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cdc04fc9-98bc-4fe1-a348-75b3f084f1ac tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:50.371506 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cdc04fc9-98bc-4fe1-a348-75b3f084f1ac tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:50.372022 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cdc04fc9-98bc-4fe1-a348-75b3f084f1ac tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:50.378398 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cdc04fc9-98bc-4fe1-a348-75b3f084f1ac tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:50.629296 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-332eb4e0-0e65-49fe-b543-c8020192798c tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:50.677830 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-332eb4e0-0e65-49fe-b543-c8020192798c tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:50.679339 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-332eb4e0-0e65-49fe-b543-c8020192798c tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:50.685066 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-332eb4e0-0e65-49fe-b543-c8020192798c tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] 10.222.0.33 "GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7" status: 200 len: 1707 microversion: 2.32 time: 0.435242 Sep 23 04:51:50.685662 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2236/4613] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:51:50 2022] GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 => generated 1707 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:51:50.708876 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-cdc04fc9-98bc-4fe1-a348-75b3f084f1ac tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] 10.222.0.33 "GET /compute/v2.1/servers/60bc9648-12d2-4db3-baf8-634b739c15f5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.366952 Sep 23 04:51:50.708876 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2378/4614] 10.222.0.33 () {58 vars in 1275 bytes} [Fri Sep 23 04:51:50 2022] GET /compute/v2.1/servers/60bc9648-12d2-4db3-baf8-634b739c15f5/os-interface => generated 284 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:51:50.996395 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-962c36dc-deea-42d1-b4f5-b769d620d8d9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:50.997123 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-11adeb0d-dd6e-4fd2-8178-ee09bb98c9df tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:51.000389 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-962c36dc-deea-42d1-b4f5-b769d620d8d9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:51.002583 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-11adeb0d-dd6e-4fd2-8178-ee09bb98c9df tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:51.023999 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-11adeb0d-dd6e-4fd2-8178-ee09bb98c9df tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:51.024661 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:51:51.026650 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-11adeb0d-dd6e-4fd2-8178-ee09bb98c9df tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:51.027270 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-11adeb0d-dd6e-4fd2-8178-ee09bb98c9df tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:51.027831 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=6 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:51:51.030025 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-11adeb0d-dd6e-4fd2-8178-ee09bb98c9df tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:51.032909 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-11adeb0d-dd6e-4fd2-8178-ee09bb98c9df tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:51.033708 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-11adeb0d-dd6e-4fd2-8178-ee09bb98c9df tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:51.034057 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-962c36dc-deea-42d1-b4f5-b769d620d8d9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:51.035968 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-962c36dc-deea-42d1-b4f5-b769d620d8d9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:51.036575 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-962c36dc-deea-42d1-b4f5-b769d620d8d9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:51.038954 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-962c36dc-deea-42d1-b4f5-b769d620d8d9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:51.042462 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-962c36dc-deea-42d1-b4f5-b769d620d8d9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:51.043421 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-962c36dc-deea-42d1-b4f5-b769d620d8d9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:51.749443 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-962c36dc-deea-42d1-b4f5-b769d620d8d9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:51.763517 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-962c36dc-deea-42d1-b4f5-b769d620d8d9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1680 microversion: 2.1 time: 0.783559 Sep 23 04:51:51.778112 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2237/4615] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:50 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1680 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:51:51.785118 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-20092005-fb8c-4527-a910-725ae46ee309 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:51.785785 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-20092005-fb8c-4527-a910-725ae46ee309 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] [instance: 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:51.810730 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-20092005-fb8c-4527-a910-725ae46ee309 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:51.811258 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-20092005-fb8c-4527-a910-725ae46ee309 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:51.820021 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-20092005-fb8c-4527-a910-725ae46ee309 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:51.820021 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-20092005-fb8c-4527-a910-725ae46ee309 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:51.820021 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-20092005-fb8c-4527-a910-725ae46ee309 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:51.821473 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-20092005-fb8c-4527-a910-725ae46ee309 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:52.048093 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-11adeb0d-dd6e-4fd2-8178-ee09bb98c9df tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:52.062536 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-11adeb0d-dd6e-4fd2-8178-ee09bb98c9df tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1516 microversion: 2.1 time: 1.080343 Sep 23 04:51:52.098461 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2379/4616] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:50 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1516 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:51:52.171331 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-20092005-fb8c-4527-a910-725ae46ee309 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:52.190023 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-20092005-fb8c-4527-a910-725ae46ee309 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:52.192590 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-20092005-fb8c-4527-a910-725ae46ee309 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:52.201116 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-20092005-fb8c-4527-a910-725ae46ee309 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] 10.222.0.33 "GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7" status: 200 len: 1754 microversion: 2.32 time: 0.419529 Sep 23 04:51:52.201116 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2238/4617] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:51:51 2022] GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 => generated 1754 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:51:52.801450 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d06300be-1900-4de6-997a-9c753254563e tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:52.802129 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d06300be-1900-4de6-997a-9c753254563e tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:52.818274 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d06300be-1900-4de6-997a-9c753254563e tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:52.819681 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d06300be-1900-4de6-997a-9c753254563e tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:52.820853 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d06300be-1900-4de6-997a-9c753254563e tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:52.822733 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d06300be-1900-4de6-997a-9c753254563e tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:52.823259 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d06300be-1900-4de6-997a-9c753254563e tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:52.824876 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d06300be-1900-4de6-997a-9c753254563e tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:53.093573 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-16e343e7-6b43-4e76-9048-225b2b00f2bb tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:53.094454 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-16e343e7-6b43-4e76-9048-225b2b00f2bb tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:53.116143 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-16e343e7-6b43-4e76-9048-225b2b00f2bb tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:53.120206 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-16e343e7-6b43-4e76-9048-225b2b00f2bb tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:53.121212 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-16e343e7-6b43-4e76-9048-225b2b00f2bb tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:53.123114 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-16e343e7-6b43-4e76-9048-225b2b00f2bb tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:53.125059 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-16e343e7-6b43-4e76-9048-225b2b00f2bb tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:53.141428 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-16e343e7-6b43-4e76-9048-225b2b00f2bb tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:53.255536 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d06300be-1900-4de6-997a-9c753254563e tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:53.277264 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d06300be-1900-4de6-997a-9c753254563e tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1680 microversion: 2.1 time: 0.481336 Sep 23 04:51:53.279080 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2380/4618] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:52 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1680 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:51:53.300838 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e1cc8c33-63ad-49d1-8d7e-37de0e3b3ca9 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:53.308264 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e1cc8c33-63ad-49d1-8d7e-37de0e3b3ca9 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] [instance: 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:53.335740 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e1cc8c33-63ad-49d1-8d7e-37de0e3b3ca9 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:53.336498 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e1cc8c33-63ad-49d1-8d7e-37de0e3b3ca9 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:53.336734 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e1cc8c33-63ad-49d1-8d7e-37de0e3b3ca9 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:53.340553 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e1cc8c33-63ad-49d1-8d7e-37de0e3b3ca9 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:53.341256 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e1cc8c33-63ad-49d1-8d7e-37de0e3b3ca9 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:53.347780 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e1cc8c33-63ad-49d1-8d7e-37de0e3b3ca9 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:53.441879 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=14 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:51:53.797022 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-16e343e7-6b43-4e76-9048-225b2b00f2bb tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:53.808812 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-16e343e7-6b43-4e76-9048-225b2b00f2bb tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1516 microversion: 2.1 time: 0.718873 Sep 23 04:51:53.811580 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2239/4619] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:53 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1516 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:51:54.108472 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e1cc8c33-63ad-49d1-8d7e-37de0e3b3ca9 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:54.124648 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e1cc8c33-63ad-49d1-8d7e-37de0e3b3ca9 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:54.126354 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e1cc8c33-63ad-49d1-8d7e-37de0e3b3ca9 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:54.132006 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e1cc8c33-63ad-49d1-8d7e-37de0e3b3ca9 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] 10.222.0.33 "GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7" status: 200 len: 1754 microversion: 2.32 time: 0.849566 Sep 23 04:51:54.135327 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2381/4620] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:51:53 2022] GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 => generated 1754 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:51:54.305825 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-deccc1a1-cb62-4ee6-b737-0bfbfa539ca7 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:54.307036 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-deccc1a1-cb62-4ee6-b737-0bfbfa539ca7 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:54.317092 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-deccc1a1-cb62-4ee6-b737-0bfbfa539ca7 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:54.317844 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-deccc1a1-cb62-4ee6-b737-0bfbfa539ca7 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:54.318557 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-deccc1a1-cb62-4ee6-b737-0bfbfa539ca7 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:54.319655 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-deccc1a1-cb62-4ee6-b737-0bfbfa539ca7 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:54.320382 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-deccc1a1-cb62-4ee6-b737-0bfbfa539ca7 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:54.321314 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-deccc1a1-cb62-4ee6-b737-0bfbfa539ca7 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:54.413579 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-fad36ad1-bccf-4864-a8ac-bd5c9080cb79 tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:54.414278 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-fad36ad1-bccf-4864-a8ac-bd5c9080cb79 tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] [instance: 60bc9648-12d2-4db3-baf8-634b739c15f5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:54.427978 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fad36ad1-bccf-4864-a8ac-bd5c9080cb79 tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:54.428496 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fad36ad1-bccf-4864-a8ac-bd5c9080cb79 tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:54.428939 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fad36ad1-bccf-4864-a8ac-bd5c9080cb79 tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:54.429722 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fad36ad1-bccf-4864-a8ac-bd5c9080cb79 tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:54.430152 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fad36ad1-bccf-4864-a8ac-bd5c9080cb79 tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:54.430588 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fad36ad1-bccf-4864-a8ac-bd5c9080cb79 tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:54.947186 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-fad36ad1-bccf-4864-a8ac-bd5c9080cb79 tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923fa0e0e08047a484ff0e129afaf09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e5e00bee244ee973df9124e15068b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:54.956662 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-fad36ad1-bccf-4864-a8ac-bd5c9080cb79 tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] 10.222.0.33 "GET /compute/v2.1/servers/60bc9648-12d2-4db3-baf8-634b739c15f5" status: 200 len: 1589 microversion: 2.1 time: 0.546965 Sep 23 04:51:54.960939 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2382/4621] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:54 2022] GET /compute/v2.1/servers/60bc9648-12d2-4db3-baf8-634b739c15f5 => generated 1589 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:51:54.968648 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-12b7178f-1006-4da7-923b-7713e90935d6 req-226dd9ab-5a55-4331-b758-da45a9822728 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60bc9648-12d2-4db3-baf8-634b739c15f5", "tag": "40dc54c9-f14b-4e0e-8645-da8d221c6247"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:51:54.996691 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-12b7178f-1006-4da7-923b-7713e90935d6 req-226dd9ab-5a55-4331-b758-da45a9822728 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:54.997322 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-12b7178f-1006-4da7-923b-7713e90935d6 req-226dd9ab-5a55-4331-b758-da45a9822728 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:54.997870 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-12b7178f-1006-4da7-923b-7713e90935d6 req-226dd9ab-5a55-4331-b758-da45a9822728 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:55.031727 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-12b7178f-1006-4da7-923b-7713e90935d6 req-226dd9ab-5a55-4331-b758-da45a9822728 service nova] Creating event network-changed:40dc54c9-f14b-4e0e-8645-da8d221c6247 for instance 60bc9648-12d2-4db3-baf8-634b739c15f5 on n-h1-846463-3 Sep 23 04:51:55.041496 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-12b7178f-1006-4da7-923b-7713e90935d6 req-226dd9ab-5a55-4331-b758-da45a9822728 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079029 Sep 23 04:51:55.046348 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2383/4622] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:51:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:51:55.059787 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-06e35a1b-4a62-4d8f-bc07-769956dae5da tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:55.063642 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-06e35a1b-4a62-4d8f-bc07-769956dae5da tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:55.074778 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-06e35a1b-4a62-4d8f-bc07-769956dae5da tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:55.076101 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-06e35a1b-4a62-4d8f-bc07-769956dae5da tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:55.076722 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-06e35a1b-4a62-4d8f-bc07-769956dae5da tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:55.078523 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-06e35a1b-4a62-4d8f-bc07-769956dae5da tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:55.079282 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-06e35a1b-4a62-4d8f-bc07-769956dae5da tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:55.079880 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-06e35a1b-4a62-4d8f-bc07-769956dae5da tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:55.114464 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-deccc1a1-cb62-4ee6-b737-0bfbfa539ca7 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:55.128349 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-deccc1a1-cb62-4ee6-b737-0bfbfa539ca7 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1657 microversion: 2.1 time: 0.825432 Sep 23 04:51:55.129108 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2240/4623] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:54 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1657 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:51:55.155105 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1575d7cb-249b-4eb6-9bd2-892d293c1fbd tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:51:55.167186 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1575d7cb-249b-4eb6-9bd2-892d293c1fbd tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:55.169017 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1575d7cb-249b-4eb6-9bd2-892d293c1fbd tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:55.169503 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1575d7cb-249b-4eb6-9bd2-892d293c1fbd tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:55.228824 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-1575d7cb-249b-4eb6-9bd2-892d293c1fbd tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Going to try to start instance {{(pid=122698) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 23 04:51:55.475994 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-1575d7cb-249b-4eb6-9bd2-892d293c1fbd tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "POST /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5/action" status: 202 len: 0 microversion: 2.1 time: 0.326784 Sep 23 04:51:55.477271 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2241/4624] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:51:55 2022] POST /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5/action => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:51:55.487105 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1712d5a4-1872-4c3f-baea-5ec02144292a tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:55.489726 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-1712d5a4-1872-4c3f-baea-5ec02144292a tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] [instance: 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:55.503690 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1712d5a4-1872-4c3f-baea-5ec02144292a tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:55.506655 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1712d5a4-1872-4c3f-baea-5ec02144292a tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:55.507360 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1712d5a4-1872-4c3f-baea-5ec02144292a tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:55.509151 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1712d5a4-1872-4c3f-baea-5ec02144292a tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:55.510623 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1712d5a4-1872-4c3f-baea-5ec02144292a tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:55.516225 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1712d5a4-1872-4c3f-baea-5ec02144292a tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:55.988827 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-06e35a1b-4a62-4d8f-bc07-769956dae5da tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:56.003970 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-06e35a1b-4a62-4d8f-bc07-769956dae5da tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1516 microversion: 2.1 time: 0.954654 Sep 23 04:51:56.004576 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2384/4625] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:55 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1516 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:51:56.015916 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d160522c-5409-458e-ba83-54e33f5934b9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:56.016604 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d160522c-5409-458e-ba83-54e33f5934b9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:56.035900 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d160522c-5409-458e-ba83-54e33f5934b9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:56.036416 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d160522c-5409-458e-ba83-54e33f5934b9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:56.041419 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d160522c-5409-458e-ba83-54e33f5934b9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:56.042541 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d160522c-5409-458e-ba83-54e33f5934b9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:56.043185 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d160522c-5409-458e-ba83-54e33f5934b9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:56.043898 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d160522c-5409-458e-ba83-54e33f5934b9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:56.165814 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-1712d5a4-1872-4c3f-baea-5ec02144292a tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:56.182319 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-1712d5a4-1872-4c3f-baea-5ec02144292a tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:56.183864 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-1712d5a4-1872-4c3f-baea-5ec02144292a tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:56.185231 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-1712d5a4-1872-4c3f-baea-5ec02144292a tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] 10.222.0.33 "GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7" status: 200 len: 1754 microversion: 2.32 time: 0.706377 Sep 23 04:51:56.186324 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2242/4626] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:51:55 2022] GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 => generated 1754 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:51:56.526102 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d160522c-5409-458e-ba83-54e33f5934b9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:56.644037 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d160522c-5409-458e-ba83-54e33f5934b9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1666 microversion: 2.1 time: 0.624970 Sep 23 04:51:56.648764 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2385/4627] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:56 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1666 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:51:56.760181 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0d1722be-43c8-415e-9e41-9a5663732492 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:56.760907 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-0d1722be-43c8-415e-9e41-9a5663732492 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: f285e256-0a0e-4126-8adf-643bd59ca141] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:56.770884 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0d1722be-43c8-415e-9e41-9a5663732492 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:56.772366 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0d1722be-43c8-415e-9e41-9a5663732492 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:56.773043 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0d1722be-43c8-415e-9e41-9a5663732492 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:56.774023 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0d1722be-43c8-415e-9e41-9a5663732492 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:56.774719 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0d1722be-43c8-415e-9e41-9a5663732492 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:56.775462 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0d1722be-43c8-415e-9e41-9a5663732492 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:56.854744 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0d1722be-43c8-415e-9e41-9a5663732492 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141/ips" status: 200 len: 152 microversion: 2.20 time: 0.501420 Sep 23 04:51:56.855333 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2243/4628] 10.222.0.33 () {60 vars in 1289 bytes} [Fri Sep 23 04:51:56 2022] GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141/ips => generated 152 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 04:51:57.034150 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8b17ec32-15e3-406d-86a4-ccb8d3d6b062 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:57.035390 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-8b17ec32-15e3-406d-86a4-ccb8d3d6b062 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:57.053698 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8b17ec32-15e3-406d-86a4-ccb8d3d6b062 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:57.073087 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8b17ec32-15e3-406d-86a4-ccb8d3d6b062 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:57.074825 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8b17ec32-15e3-406d-86a4-ccb8d3d6b062 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:57.081330 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8b17ec32-15e3-406d-86a4-ccb8d3d6b062 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:57.083604 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8b17ec32-15e3-406d-86a4-ccb8d3d6b062 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:57.085505 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8b17ec32-15e3-406d-86a4-ccb8d3d6b062 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:57.221653 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7daf09f8-f0e6-41f0-ba30-4d57fe01ce5d tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:57.223707 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7daf09f8-f0e6-41f0-ba30-4d57fe01ce5d tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] [instance: 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:57.243797 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7daf09f8-f0e6-41f0-ba30-4d57fe01ce5d tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:57.245779 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7daf09f8-f0e6-41f0-ba30-4d57fe01ce5d tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:57.248608 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7daf09f8-f0e6-41f0-ba30-4d57fe01ce5d tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:57.249765 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7daf09f8-f0e6-41f0-ba30-4d57fe01ce5d tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:57.253018 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7daf09f8-f0e6-41f0-ba30-4d57fe01ce5d tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:57.255216 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7daf09f8-f0e6-41f0-ba30-4d57fe01ce5d tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:57.373479 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-8b17ec32-15e3-406d-86a4-ccb8d3d6b062 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:57.388097 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-8b17ec32-15e3-406d-86a4-ccb8d3d6b062 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1516 microversion: 2.1 time: 0.358383 Sep 23 04:51:57.389284 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2386/4629] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:57 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1516 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:51:57.676256 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e6899b7d-ea2b-415e-8e3a-d3becfa5d0d7 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:57.677232 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e6899b7d-ea2b-415e-8e3a-d3becfa5d0d7 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:57.696614 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e6899b7d-ea2b-415e-8e3a-d3becfa5d0d7 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:57.725175 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e6899b7d-ea2b-415e-8e3a-d3becfa5d0d7 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:57.727695 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e6899b7d-ea2b-415e-8e3a-d3becfa5d0d7 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:57.732624 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e6899b7d-ea2b-415e-8e3a-d3becfa5d0d7 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:57.737481 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e6899b7d-ea2b-415e-8e3a-d3becfa5d0d7 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:57.740452 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e6899b7d-ea2b-415e-8e3a-d3becfa5d0d7 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:57.758389 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-7daf09f8-f0e6-41f0-ba30-4d57fe01ce5d tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:57.779795 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-7daf09f8-f0e6-41f0-ba30-4d57fe01ce5d tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:57.781280 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-7daf09f8-f0e6-41f0-ba30-4d57fe01ce5d tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:57.793546 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7daf09f8-f0e6-41f0-ba30-4d57fe01ce5d tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] 10.222.0.33 "GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7" status: 200 len: 1801 microversion: 2.32 time: 0.581398 Sep 23 04:51:57.797964 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2244/4630] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:51:57 2022] GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 => generated 1801 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:51:58.269588 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e6899b7d-ea2b-415e-8e3a-d3becfa5d0d7 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:58.278932 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e6899b7d-ea2b-415e-8e3a-d3becfa5d0d7 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1666 microversion: 2.1 time: 0.610111 Sep 23 04:51:58.284960 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2387/4631] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:57 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1666 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:51:58.417750 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f913467f-0518-40cf-a8b9-b64c2d837e20 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:58.418509 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f913467f-0518-40cf-a8b9-b64c2d837e20 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:58.432259 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f913467f-0518-40cf-a8b9-b64c2d837e20 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:58.432762 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f913467f-0518-40cf-a8b9-b64c2d837e20 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:58.433220 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f913467f-0518-40cf-a8b9-b64c2d837e20 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:58.433974 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f913467f-0518-40cf-a8b9-b64c2d837e20 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:58.450559 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f913467f-0518-40cf-a8b9-b64c2d837e20 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:58.451073 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f913467f-0518-40cf-a8b9-b64c2d837e20 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:58.828047 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-79f1091c-1a5f-4e93-9554-13d28119dbf1 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:58.830514 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-79f1091c-1a5f-4e93-9554-13d28119dbf1 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] [instance: 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:58.878504 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-79f1091c-1a5f-4e93-9554-13d28119dbf1 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:58.878504 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-79f1091c-1a5f-4e93-9554-13d28119dbf1 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:58.878504 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-79f1091c-1a5f-4e93-9554-13d28119dbf1 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:58.878504 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-79f1091c-1a5f-4e93-9554-13d28119dbf1 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:58.878504 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-79f1091c-1a5f-4e93-9554-13d28119dbf1 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:58.878504 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-79f1091c-1a5f-4e93-9554-13d28119dbf1 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:59.153208 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f913467f-0518-40cf-a8b9-b64c2d837e20 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:59.177178 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f913467f-0518-40cf-a8b9-b64c2d837e20 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1516 microversion: 2.1 time: 0.765000 Sep 23 04:51:59.177787 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2245/4632] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:58 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1516 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:51:59.305673 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8380497b-646d-4f08-bd81-eb7364bde964 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:51:59.306462 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8380497b-646d-4f08-bd81-eb7364bde964 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:51:59.331120 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8380497b-646d-4f08-bd81-eb7364bde964 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:59.342736 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8380497b-646d-4f08-bd81-eb7364bde964 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:59.356187 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8380497b-646d-4f08-bd81-eb7364bde964 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:59.367432 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8380497b-646d-4f08-bd81-eb7364bde964 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:51:59.368276 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8380497b-646d-4f08-bd81-eb7364bde964 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:51:59.370682 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8380497b-646d-4f08-bd81-eb7364bde964 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:51:59.734236 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-79f1091c-1a5f-4e93-9554-13d28119dbf1 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:59.745829 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-79f1091c-1a5f-4e93-9554-13d28119dbf1 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:59.778100 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-79f1091c-1a5f-4e93-9554-13d28119dbf1 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:59.782387 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-79f1091c-1a5f-4e93-9554-13d28119dbf1 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] 10.222.0.33 "GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7" status: 200 len: 1801 microversion: 2.32 time: 0.960663 Sep 23 04:51:59.790783 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2388/4633] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:51:58 2022] GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 => generated 1801 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:51:59.987226 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8380497b-646d-4f08-bd81-eb7364bde964 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:51:59.992776 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:52:00.022090 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8380497b-646d-4f08-bd81-eb7364bde964 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1666 microversion: 2.1 time: 0.720352 Sep 23 04:52:00.034282 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2246/4634] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:51:59 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1666 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:52:00.211967 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b70f3b2d-ccb2-4773-a199-374d02bc76ce tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:00.211967 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b70f3b2d-ccb2-4773-a199-374d02bc76ce tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:00.216737 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b70f3b2d-ccb2-4773-a199-374d02bc76ce tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:00.222463 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b70f3b2d-ccb2-4773-a199-374d02bc76ce tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:00.227071 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b70f3b2d-ccb2-4773-a199-374d02bc76ce tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:00.228173 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b70f3b2d-ccb2-4773-a199-374d02bc76ce tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:00.234397 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b70f3b2d-ccb2-4773-a199-374d02bc76ce tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:00.241153 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b70f3b2d-ccb2-4773-a199-374d02bc76ce tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:00.699656 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b70f3b2d-ccb2-4773-a199-374d02bc76ce tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:00.708407 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b70f3b2d-ccb2-4773-a199-374d02bc76ce tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1516 microversion: 2.1 time: 0.510491 Sep 23 04:52:00.720796 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2389/4635] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:00 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1516 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:52:00.817408 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4ff490f2-d764-46bc-aeda-31c49595f7dd tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:00.818465 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4ff490f2-d764-46bc-aeda-31c49595f7dd tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] [instance: 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:00.836801 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4ff490f2-d764-46bc-aeda-31c49595f7dd tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:00.837309 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4ff490f2-d764-46bc-aeda-31c49595f7dd tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:00.837756 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4ff490f2-d764-46bc-aeda-31c49595f7dd tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:00.843837 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4ff490f2-d764-46bc-aeda-31c49595f7dd tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:00.844344 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4ff490f2-d764-46bc-aeda-31c49595f7dd tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:00.844791 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4ff490f2-d764-46bc-aeda-31c49595f7dd tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:01.051211 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-35c76416-328b-431c-bc5c-013c7f434a42 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:01.052303 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-35c76416-328b-431c-bc5c-013c7f434a42 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:01.073018 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-35c76416-328b-431c-bc5c-013c7f434a42 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:01.073542 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-35c76416-328b-431c-bc5c-013c7f434a42 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:01.077337 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-35c76416-328b-431c-bc5c-013c7f434a42 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:01.077963 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-35c76416-328b-431c-bc5c-013c7f434a42 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:01.078697 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-35c76416-328b-431c-bc5c-013c7f434a42 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:01.079948 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-35c76416-328b-431c-bc5c-013c7f434a42 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:01.604773 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4ff490f2-d764-46bc-aeda-31c49595f7dd tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:01.638014 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4ff490f2-d764-46bc-aeda-31c49595f7dd tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:01.640299 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4ff490f2-d764-46bc-aeda-31c49595f7dd tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:01.643939 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4ff490f2-d764-46bc-aeda-31c49595f7dd tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] 10.222.0.33 "GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7" status: 200 len: 1801 microversion: 2.32 time: 0.830370 Sep 23 04:52:01.645029 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2247/4636] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:52:00 2022] GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 => generated 1801 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:52:01.672901 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-35c76416-328b-431c-bc5c-013c7f434a42 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:01.686991 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-35c76416-328b-431c-bc5c-013c7f434a42 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1666 microversion: 2.1 time: 0.639472 Sep 23 04:52:01.688358 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2390/4637] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:01 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1666 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:52:01.746267 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b80bb5fc-53bb-4256-ae07-7e01a61ebaac tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:01.746918 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b80bb5fc-53bb-4256-ae07-7e01a61ebaac tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:01.765059 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b80bb5fc-53bb-4256-ae07-7e01a61ebaac tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:01.765568 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b80bb5fc-53bb-4256-ae07-7e01a61ebaac tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:01.766091 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b80bb5fc-53bb-4256-ae07-7e01a61ebaac tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:01.766899 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b80bb5fc-53bb-4256-ae07-7e01a61ebaac tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:01.767426 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b80bb5fc-53bb-4256-ae07-7e01a61ebaac tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:01.767857 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b80bb5fc-53bb-4256-ae07-7e01a61ebaac tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:02.219214 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b80bb5fc-53bb-4256-ae07-7e01a61ebaac tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:02.232542 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b80bb5fc-53bb-4256-ae07-7e01a61ebaac tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1516 microversion: 2.1 time: 0.490322 Sep 23 04:52:02.234288 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2248/4638] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:01 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1516 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:52:02.677226 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-99b0e30a-7865-4d1b-b02a-ffcae7023bde tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:02.678647 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-99b0e30a-7865-4d1b-b02a-ffcae7023bde tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] [instance: 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:02.704293 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-99b0e30a-7865-4d1b-b02a-ffcae7023bde tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:02.704933 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-99b0e30a-7865-4d1b-b02a-ffcae7023bde tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:02.710848 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-99b0e30a-7865-4d1b-b02a-ffcae7023bde tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:02.711463 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b91d86b7-bb54-4dc1-81e3-3585a3c22b43 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:02.712325 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-99b0e30a-7865-4d1b-b02a-ffcae7023bde tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:02.712748 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b91d86b7-bb54-4dc1-81e3-3585a3c22b43 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:02.715709 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-99b0e30a-7865-4d1b-b02a-ffcae7023bde tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:02.718840 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-99b0e30a-7865-4d1b-b02a-ffcae7023bde tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:02.736033 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b91d86b7-bb54-4dc1-81e3-3585a3c22b43 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:02.736568 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b91d86b7-bb54-4dc1-81e3-3585a3c22b43 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:02.736997 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b91d86b7-bb54-4dc1-81e3-3585a3c22b43 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:02.740308 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b91d86b7-bb54-4dc1-81e3-3585a3c22b43 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:02.745218 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b91d86b7-bb54-4dc1-81e3-3585a3c22b43 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:02.750741 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b91d86b7-bb54-4dc1-81e3-3585a3c22b43 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:03.207663 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-99b0e30a-7865-4d1b-b02a-ffcae7023bde tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:03.229705 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-99b0e30a-7865-4d1b-b02a-ffcae7023bde tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:03.229705 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-99b0e30a-7865-4d1b-b02a-ffcae7023bde tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:03.229991 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-99b0e30a-7865-4d1b-b02a-ffcae7023bde tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] 10.222.0.33 "GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7" status: 200 len: 1848 microversion: 2.32 time: 0.557862 Sep 23 04:52:03.230716 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2391/4639] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:52:02 2022] GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 => generated 1848 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:52:03.244489 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b0ffb86b-d91a-4679-aab0-0eb711187db2 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:52:03.245463 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b0ffb86b-d91a-4679-aab0-0eb711187db2 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: f285e256-0a0e-4126-8adf-643bd59ca141] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:03.270023 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b0ffb86b-d91a-4679-aab0-0eb711187db2 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:03.270576 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b0ffb86b-d91a-4679-aab0-0eb711187db2 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:03.272276 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b0ffb86b-d91a-4679-aab0-0eb711187db2 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:03.273671 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b0ffb86b-d91a-4679-aab0-0eb711187db2 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:03.274274 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b0ffb86b-d91a-4679-aab0-0eb711187db2 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:03.274833 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b0ffb86b-d91a-4679-aab0-0eb711187db2 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:03.339504 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b91d86b7-bb54-4dc1-81e3-3585a3c22b43 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:03.357605 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b91d86b7-bb54-4dc1-81e3-3585a3c22b43 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1666 microversion: 2.1 time: 0.650051 Sep 23 04:52:03.372619 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=100 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:52:03.374593 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2249/4640] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:02 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1666 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:52:03.402463 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-b0ffb86b-d91a-4679-aab0-0eb711187db2 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lazy-loading 'flavor' on Instance uuid f285e256-0a0e-4126-8adf-643bd59ca141 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:52:03.412554 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8c1e850a-b66e-46c2-9f9e-27a335cfb6b4 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:03.417665 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8c1e850a-b66e-46c2-9f9e-27a335cfb6b4 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:03.443280 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8c1e850a-b66e-46c2-9f9e-27a335cfb6b4 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:03.447144 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8c1e850a-b66e-46c2-9f9e-27a335cfb6b4 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:03.449625 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8c1e850a-b66e-46c2-9f9e-27a335cfb6b4 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:03.451512 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8c1e850a-b66e-46c2-9f9e-27a335cfb6b4 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:03.457322 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8c1e850a-b66e-46c2-9f9e-27a335cfb6b4 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:03.459830 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8c1e850a-b66e-46c2-9f9e-27a335cfb6b4 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:03.924053 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8c1e850a-b66e-46c2-9f9e-27a335cfb6b4 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:03.942821 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8c1e850a-b66e-46c2-9f9e-27a335cfb6b4 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1516 microversion: 2.1 time: 0.566974 Sep 23 04:52:03.944967 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2250/4641] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:03 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1516 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:52:04.252732 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b0ffb86b-d91a-4679-aab0-0eb711187db2 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "POST /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141/action" status: 202 len: 0 microversion: 2.20 time: 1.020312 Sep 23 04:52:04.256129 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2392/4642] 10.222.0.33 () {62 vars in 1319 bytes} [Fri Sep 23 04:52:03 2022] POST /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141/action => generated 0 bytes in 1025 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:52:04.270703 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c05df3f0-e43d-40c0-8b43-c4d04d482133 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:04.272098 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c05df3f0-e43d-40c0-8b43-c4d04d482133 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] [instance: 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:04.274132 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-cb6ae814-65d7-4661-b865-1819aae847e8 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:04.275542 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-cb6ae814-65d7-4661-b865-1819aae847e8 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: f285e256-0a0e-4126-8adf-643bd59ca141] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:04.285912 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c05df3f0-e43d-40c0-8b43-c4d04d482133 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:04.290446 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c05df3f0-e43d-40c0-8b43-c4d04d482133 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:04.291958 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c05df3f0-e43d-40c0-8b43-c4d04d482133 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:04.292952 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c05df3f0-e43d-40c0-8b43-c4d04d482133 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:04.297195 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c05df3f0-e43d-40c0-8b43-c4d04d482133 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:04.300210 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c05df3f0-e43d-40c0-8b43-c4d04d482133 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:04.301998 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cb6ae814-65d7-4661-b865-1819aae847e8 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:04.305647 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cb6ae814-65d7-4661-b865-1819aae847e8 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:04.306265 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cb6ae814-65d7-4661-b865-1819aae847e8 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:04.316641 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cb6ae814-65d7-4661-b865-1819aae847e8 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:04.316641 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cb6ae814-65d7-4661-b865-1819aae847e8 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:04.316641 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cb6ae814-65d7-4661-b865-1819aae847e8 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:04.771908 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c05df3f0-e43d-40c0-8b43-c4d04d482133 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:04.791365 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c05df3f0-e43d-40c0-8b43-c4d04d482133 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:04.800593 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c05df3f0-e43d-40c0-8b43-c4d04d482133 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:04.806047 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c05df3f0-e43d-40c0-8b43-c4d04d482133 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] 10.222.0.33 "GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7" status: 200 len: 1848 microversion: 2.32 time: 0.541978 Sep 23 04:52:04.809623 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2251/4643] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:52:04 2022] GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 => generated 1848 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:52:04.847582 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-737c6869-20be-473a-b323-795171365dcb tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:04.848552 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-737c6869-20be-473a-b323-795171365dcb tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:04.869007 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-737c6869-20be-473a-b323-795171365dcb tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:04.871789 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-737c6869-20be-473a-b323-795171365dcb tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:04.872533 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-737c6869-20be-473a-b323-795171365dcb tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:04.874540 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-737c6869-20be-473a-b323-795171365dcb tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:04.879961 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-737c6869-20be-473a-b323-795171365dcb tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:04.880703 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-737c6869-20be-473a-b323-795171365dcb tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:04.926958 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-cb6ae814-65d7-4661-b865-1819aae847e8 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:04.940306 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-cb6ae814-65d7-4661-b865-1819aae847e8 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:04.943675 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-cb6ae814-65d7-4661-b865-1819aae847e8 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:04.950311 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-cb6ae814-65d7-4661-b865-1819aae847e8 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141" status: 200 len: 1724 microversion: 2.20 time: 0.685380 Sep 23 04:52:04.952865 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2393/4644] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:52:04 2022] GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141 => generated 1724 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:52:04.974342 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5814b658-db0d-484f-9e99-47c2de2fec68 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:04.975156 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-5814b658-db0d-484f-9e99-47c2de2fec68 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:04.986097 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5814b658-db0d-484f-9e99-47c2de2fec68 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:04.994240 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5814b658-db0d-484f-9e99-47c2de2fec68 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:04.994975 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5814b658-db0d-484f-9e99-47c2de2fec68 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:04.996776 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5814b658-db0d-484f-9e99-47c2de2fec68 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:04.996776 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5814b658-db0d-484f-9e99-47c2de2fec68 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:04.999114 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5814b658-db0d-484f-9e99-47c2de2fec68 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:05.213391 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-737c6869-20be-473a-b323-795171365dcb tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:05.227625 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-737c6869-20be-473a-b323-795171365dcb tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1666 microversion: 2.1 time: 0.412465 Sep 23 04:52:05.228769 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2252/4645] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:04 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1666 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:52:05.461453 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-5814b658-db0d-484f-9e99-47c2de2fec68 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:05.473399 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5814b658-db0d-484f-9e99-47c2de2fec68 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1516 microversion: 2.1 time: 0.503799 Sep 23 04:52:05.482389 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2394/4646] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:04 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1516 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:52:05.850860 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-107b4592-5694-419a-8024-f1a5b7c30b65 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:05.873576 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-107b4592-5694-419a-8024-f1a5b7c30b65 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] [instance: 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:05.905865 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-107b4592-5694-419a-8024-f1a5b7c30b65 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:05.909503 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-107b4592-5694-419a-8024-f1a5b7c30b65 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:05.910870 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-107b4592-5694-419a-8024-f1a5b7c30b65 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:05.914315 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-107b4592-5694-419a-8024-f1a5b7c30b65 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:05.918038 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-107b4592-5694-419a-8024-f1a5b7c30b65 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:05.920727 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-107b4592-5694-419a-8024-f1a5b7c30b65 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:05.987719 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7c0e4595-4c40-4f18-8024-7c742dd15c29 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:05.988365 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-7c0e4595-4c40-4f18-8024-7c742dd15c29 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: f285e256-0a0e-4126-8adf-643bd59ca141] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:06.013293 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7c0e4595-4c40-4f18-8024-7c742dd15c29 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:06.020523 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7c0e4595-4c40-4f18-8024-7c742dd15c29 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:06.021215 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7c0e4595-4c40-4f18-8024-7c742dd15c29 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:06.023643 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7c0e4595-4c40-4f18-8024-7c742dd15c29 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:06.026632 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7c0e4595-4c40-4f18-8024-7c742dd15c29 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:06.027273 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7c0e4595-4c40-4f18-8024-7c742dd15c29 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:06.495308 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-107b4592-5694-419a-8024-f1a5b7c30b65 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:06.520281 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-107b4592-5694-419a-8024-f1a5b7c30b65 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:06.521824 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-107b4592-5694-419a-8024-f1a5b7c30b65 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:06.523094 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-107b4592-5694-419a-8024-f1a5b7c30b65 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] 10.222.0.33 "GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7" status: 200 len: 1848 microversion: 2.32 time: 0.687322 Sep 23 04:52:06.545998 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2253/4647] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:52:05 2022] GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 => generated 1848 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:52:06.556733 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a9e38c9b-859d-4bf6-96f2-115256994547 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:06.557370 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a9e38c9b-859d-4bf6-96f2-115256994547 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:06.577877 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a9e38c9b-859d-4bf6-96f2-115256994547 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:06.578429 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a9e38c9b-859d-4bf6-96f2-115256994547 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:06.578892 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a9e38c9b-859d-4bf6-96f2-115256994547 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:06.580832 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a9e38c9b-859d-4bf6-96f2-115256994547 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:06.581307 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a9e38c9b-859d-4bf6-96f2-115256994547 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:06.581751 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a9e38c9b-859d-4bf6-96f2-115256994547 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:06.649596 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-7c0e4595-4c40-4f18-8024-7c742dd15c29 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:06.659816 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-7c0e4595-4c40-4f18-8024-7c742dd15c29 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:06.661240 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-7c0e4595-4c40-4f18-8024-7c742dd15c29 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:06.664329 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-7c0e4595-4c40-4f18-8024-7c742dd15c29 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141" status: 200 len: 1724 microversion: 2.20 time: 0.680521 Sep 23 04:52:06.665462 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2395/4648] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:52:05 2022] GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141 => generated 1724 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:52:06.670450 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1d1ab653-3f8b-4a76-8783-757f2e04a106 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:06.671306 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1d1ab653-3f8b-4a76-8783-757f2e04a106 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:06.691796 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1d1ab653-3f8b-4a76-8783-757f2e04a106 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:06.692584 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1d1ab653-3f8b-4a76-8783-757f2e04a106 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:06.693094 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1d1ab653-3f8b-4a76-8783-757f2e04a106 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:06.693866 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1d1ab653-3f8b-4a76-8783-757f2e04a106 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:06.694614 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1d1ab653-3f8b-4a76-8783-757f2e04a106 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:06.695052 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1d1ab653-3f8b-4a76-8783-757f2e04a106 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:07.037602 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a9e38c9b-859d-4bf6-96f2-115256994547 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:07.057988 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a9e38c9b-859d-4bf6-96f2-115256994547 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1670 microversion: 2.1 time: 0.508345 Sep 23 04:52:07.058717 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2254/4649] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:06 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1670 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:52:07.071912 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-fd40d1ca-c3bd-490a-b1bd-62b1039d9a0d req-06de914e-c5ec-49ed-82fb-14f8174f2992 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49112e3f-73fc-4ee9-b48e-bcda5b7dcda7", "tag": "7526a24d-5fba-4653-bde4-13d72cf5232a"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:52:07.098348 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-fd40d1ca-c3bd-490a-b1bd-62b1039d9a0d req-06de914e-c5ec-49ed-82fb-14f8174f2992 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:07.099635 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-fd40d1ca-c3bd-490a-b1bd-62b1039d9a0d req-06de914e-c5ec-49ed-82fb-14f8174f2992 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:07.100813 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-fd40d1ca-c3bd-490a-b1bd-62b1039d9a0d req-06de914e-c5ec-49ed-82fb-14f8174f2992 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:07.121656 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-fd40d1ca-c3bd-490a-b1bd-62b1039d9a0d req-06de914e-c5ec-49ed-82fb-14f8174f2992 service nova] Creating event network-changed:7526a24d-5fba-4653-bde4-13d72cf5232a for instance 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 on n-h2-846463-3 Sep 23 04:52:07.136027 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-fd40d1ca-c3bd-490a-b1bd-62b1039d9a0d req-06de914e-c5ec-49ed-82fb-14f8174f2992 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075986 Sep 23 04:52:07.136655 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2255/4650] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:52:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:52:07.160185 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-743f17c6-1fae-4ad7-abec-c7bf7d44d569 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:07.160844 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-743f17c6-1fae-4ad7-abec-c7bf7d44d569 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:07.177703 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-743f17c6-1fae-4ad7-abec-c7bf7d44d569 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:07.179339 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-743f17c6-1fae-4ad7-abec-c7bf7d44d569 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:07.180875 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-743f17c6-1fae-4ad7-abec-c7bf7d44d569 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:07.186239 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-743f17c6-1fae-4ad7-abec-c7bf7d44d569 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:07.189766 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-743f17c6-1fae-4ad7-abec-c7bf7d44d569 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:07.190535 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-743f17c6-1fae-4ad7-abec-c7bf7d44d569 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:07.200699 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1d1ab653-3f8b-4a76-8783-757f2e04a106 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:07.215057 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1d1ab653-3f8b-4a76-8783-757f2e04a106 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1516 microversion: 2.1 time: 0.544813 Sep 23 04:52:07.220590 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2396/4651] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:06 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1516 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:52:07.553264 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d5b4b3f3-2afe-4d1a-949f-096f37f41ec9 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:07.553906 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d5b4b3f3-2afe-4d1a-949f-096f37f41ec9 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] [instance: 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:07.565289 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d5b4b3f3-2afe-4d1a-949f-096f37f41ec9 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:07.601797 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d5b4b3f3-2afe-4d1a-949f-096f37f41ec9 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:07.601797 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d5b4b3f3-2afe-4d1a-949f-096f37f41ec9 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:07.601797 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d5b4b3f3-2afe-4d1a-949f-096f37f41ec9 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:07.601797 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d5b4b3f3-2afe-4d1a-949f-096f37f41ec9 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:07.601797 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d5b4b3f3-2afe-4d1a-949f-096f37f41ec9 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:07.642142 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-743f17c6-1fae-4ad7-abec-c7bf7d44d569 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:07.656591 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-743f17c6-1fae-4ad7-abec-c7bf7d44d569 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1670 microversion: 2.1 time: 0.515986 Sep 23 04:52:07.670043 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2256/4652] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:07 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1670 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:52:07.682226 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ab9476dc-0677-4dc2-bdde-13baef9f8c24 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:52:07.682226 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-ab9476dc-0677-4dc2-bdde-13baef9f8c24 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:07.711955 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ab9476dc-0677-4dc2-bdde-13baef9f8c24 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:07.712467 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ab9476dc-0677-4dc2-bdde-13baef9f8c24 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:07.712917 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ab9476dc-0677-4dc2-bdde-13baef9f8c24 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:07.713671 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ab9476dc-0677-4dc2-bdde-13baef9f8c24 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:07.714248 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ab9476dc-0677-4dc2-bdde-13baef9f8c24 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:07.714729 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ab9476dc-0677-4dc2-bdde-13baef9f8c24 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:07.985043 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-ab9476dc-0677-4dc2-bdde-13baef9f8c24 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Unlocking {{(pid=122698) unlock /opt/stack/nova/nova/compute/api.py:4874}} Sep 23 04:52:08.163112 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d5b4b3f3-2afe-4d1a-949f-096f37f41ec9 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:08.183655 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d5b4b3f3-2afe-4d1a-949f-096f37f41ec9 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:08.196789 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d5b4b3f3-2afe-4d1a-949f-096f37f41ec9 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:08.209544 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d5b4b3f3-2afe-4d1a-949f-096f37f41ec9 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] 10.222.0.33 "GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7" status: 200 len: 1848 microversion: 2.32 time: 0.660694 Sep 23 04:52:08.226289 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2397/4653] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:52:07 2022] GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 => generated 1848 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:52:08.235978 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8a914d8c-3794-40da-903a-190f2617075e tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:08.237146 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-8a914d8c-3794-40da-903a-190f2617075e tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: f285e256-0a0e-4126-8adf-643bd59ca141] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:08.244359 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=91 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:52:08.247129 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8a914d8c-3794-40da-903a-190f2617075e tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:08.247864 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8a914d8c-3794-40da-903a-190f2617075e tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:08.249081 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8a914d8c-3794-40da-903a-190f2617075e tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:08.250064 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8a914d8c-3794-40da-903a-190f2617075e tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:08.250804 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8a914d8c-3794-40da-903a-190f2617075e tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:08.251396 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8a914d8c-3794-40da-903a-190f2617075e tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:08.330374 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ab9476dc-0677-4dc2-bdde-13baef9f8c24 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "POST /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5/action" status: 202 len: 0 microversion: 2.1 time: 0.653236 Sep 23 04:52:08.333493 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2257/4654] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:52:07 2022] POST /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5/action => generated 0 bytes in 655 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:52:08.342797 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-86ebffb4-8f75-458f-a176-7de768fbe7fe tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:08.347286 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-86ebffb4-8f75-458f-a176-7de768fbe7fe tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:08.361875 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-86ebffb4-8f75-458f-a176-7de768fbe7fe tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:08.373038 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-86ebffb4-8f75-458f-a176-7de768fbe7fe tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:08.374248 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-86ebffb4-8f75-458f-a176-7de768fbe7fe tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:08.375045 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-86ebffb4-8f75-458f-a176-7de768fbe7fe tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:08.375520 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-86ebffb4-8f75-458f-a176-7de768fbe7fe tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:08.376152 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-86ebffb4-8f75-458f-a176-7de768fbe7fe tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:10.034422 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-86ebffb4-8f75-458f-a176-7de768fbe7fe tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:10.048145 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-86ebffb4-8f75-458f-a176-7de768fbe7fe tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1516 microversion: 2.1 time: 1.712843 Sep 23 04:52:10.050872 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2258/4655] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:08 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1516 bytes in 1717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:52:10.070027 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2985e248-ad35-440d-a628-4245f6d77da9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:10.071137 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-2985e248-ad35-440d-a628-4245f6d77da9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:10.090653 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2985e248-ad35-440d-a628-4245f6d77da9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:10.091657 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2985e248-ad35-440d-a628-4245f6d77da9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:10.093636 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2985e248-ad35-440d-a628-4245f6d77da9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:10.094663 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2985e248-ad35-440d-a628-4245f6d77da9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:10.095456 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2985e248-ad35-440d-a628-4245f6d77da9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:10.100584 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2985e248-ad35-440d-a628-4245f6d77da9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:10.159597 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-8a914d8c-3794-40da-903a-190f2617075e tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:10.169075 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-8a914d8c-3794-40da-903a-190f2617075e tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:10.170627 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-8a914d8c-3794-40da-903a-190f2617075e tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:10.171904 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-8a914d8c-3794-40da-903a-190f2617075e tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141" status: 200 len: 1724 microversion: 2.20 time: 1.944253 Sep 23 04:52:10.172487 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2398/4656] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:52:08 2022] GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141 => generated 1724 bytes in 1945 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:52:10.199845 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a07bba21-208c-413f-99b1-de890f4e179b tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:10.200529 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a07bba21-208c-413f-99b1-de890f4e179b tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] [instance: 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:10.214622 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a07bba21-208c-413f-99b1-de890f4e179b tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:10.217094 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a07bba21-208c-413f-99b1-de890f4e179b tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:10.217094 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a07bba21-208c-413f-99b1-de890f4e179b tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:10.217094 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a07bba21-208c-413f-99b1-de890f4e179b tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:10.217094 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a07bba21-208c-413f-99b1-de890f4e179b tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:10.222985 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a07bba21-208c-413f-99b1-de890f4e179b tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:10.659668 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-2985e248-ad35-440d-a628-4245f6d77da9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:10.677123 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2985e248-ad35-440d-a628-4245f6d77da9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1670 microversion: 2.1 time: 0.624709 Sep 23 04:52:10.677947 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2259/4657] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:10 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1670 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:52:10.699507 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-e54ab432-4c0c-40b8-9ccd-f8c9d9e46572 req-f6a46104-6bd7-4517-9fb4-633c2a1b36ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49112e3f-73fc-4ee9-b48e-bcda5b7dcda7", "tag": "6d6aeefc-17b8-455d-8d06-9189331b6022"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:52:10.731885 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-e54ab432-4c0c-40b8-9ccd-f8c9d9e46572 req-f6a46104-6bd7-4517-9fb4-633c2a1b36ff service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:10.731885 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-e54ab432-4c0c-40b8-9ccd-f8c9d9e46572 req-f6a46104-6bd7-4517-9fb4-633c2a1b36ff service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:10.731885 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-e54ab432-4c0c-40b8-9ccd-f8c9d9e46572 req-f6a46104-6bd7-4517-9fb4-633c2a1b36ff service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:10.765412 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-e54ab432-4c0c-40b8-9ccd-f8c9d9e46572 req-f6a46104-6bd7-4517-9fb4-633c2a1b36ff service nova] Creating event network-changed:6d6aeefc-17b8-455d-8d06-9189331b6022 for instance 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 on n-h2-846463-3 Sep 23 04:52:10.778014 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-e54ab432-4c0c-40b8-9ccd-f8c9d9e46572 req-f6a46104-6bd7-4517-9fb4-633c2a1b36ff service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095776 Sep 23 04:52:10.782723 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2260/4658] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:52:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:52:10.792043 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-fa0c3a12-7124-4212-9124-a13c16520f58 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:10.798415 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-fa0c3a12-7124-4212-9124-a13c16520f58 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:10.811684 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fa0c3a12-7124-4212-9124-a13c16520f58 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:10.814522 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fa0c3a12-7124-4212-9124-a13c16520f58 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:10.815259 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fa0c3a12-7124-4212-9124-a13c16520f58 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:10.816232 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fa0c3a12-7124-4212-9124-a13c16520f58 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:10.816986 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fa0c3a12-7124-4212-9124-a13c16520f58 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:10.818758 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fa0c3a12-7124-4212-9124-a13c16520f58 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:10.947905 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a07bba21-208c-413f-99b1-de890f4e179b tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:10.968479 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a07bba21-208c-413f-99b1-de890f4e179b tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:10.970292 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a07bba21-208c-413f-99b1-de890f4e179b tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:10.971687 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a07bba21-208c-413f-99b1-de890f4e179b tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] 10.222.0.33 "GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7" status: 200 len: 1869 microversion: 2.32 time: 0.798265 Sep 23 04:52:10.975480 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2399/4659] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:52:10 2022] GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 => generated 1869 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:52:11.075118 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c5bca599-5e0d-4ec2-b72f-bc920bd5dcee tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:11.080657 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c5bca599-5e0d-4ec2-b72f-bc920bd5dcee tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:11.105762 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c5bca599-5e0d-4ec2-b72f-bc920bd5dcee tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:11.105762 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c5bca599-5e0d-4ec2-b72f-bc920bd5dcee tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:11.105762 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c5bca599-5e0d-4ec2-b72f-bc920bd5dcee tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:11.105762 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c5bca599-5e0d-4ec2-b72f-bc920bd5dcee tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:11.105762 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c5bca599-5e0d-4ec2-b72f-bc920bd5dcee tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:11.110121 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c5bca599-5e0d-4ec2-b72f-bc920bd5dcee tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:11.344999 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-fa0c3a12-7124-4212-9124-a13c16520f58 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:11.359255 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-fa0c3a12-7124-4212-9124-a13c16520f58 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1670 microversion: 2.1 time: 0.571151 Sep 23 04:52:11.366625 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2261/4660] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:10 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1670 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:52:11.386924 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b3a2289a-cfb2-4a82-8b4f-9b2ad49614a4 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:11.386924 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b3a2289a-cfb2-4a82-8b4f-9b2ad49614a4 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: f285e256-0a0e-4126-8adf-643bd59ca141] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:11.428721 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b3a2289a-cfb2-4a82-8b4f-9b2ad49614a4 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:11.432103 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b3a2289a-cfb2-4a82-8b4f-9b2ad49614a4 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:11.436864 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b3a2289a-cfb2-4a82-8b4f-9b2ad49614a4 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:11.440893 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b3a2289a-cfb2-4a82-8b4f-9b2ad49614a4 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:11.442258 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b3a2289a-cfb2-4a82-8b4f-9b2ad49614a4 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:11.444698 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b3a2289a-cfb2-4a82-8b4f-9b2ad49614a4 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:11.516908 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:52:11.994336 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c5bca599-5e0d-4ec2-b72f-bc920bd5dcee tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:12.024822 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c5bca599-5e0d-4ec2-b72f-bc920bd5dcee tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1516 microversion: 2.1 time: 0.954980 Sep 23 04:52:12.028178 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2400/4661] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:11 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1516 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:52:12.049980 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9f25c321-cb81-440d-9d81-b67a0c7e15b8 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:12.054420 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-9f25c321-cb81-440d-9d81-b67a0c7e15b8 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:12.075764 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9f25c321-cb81-440d-9d81-b67a0c7e15b8 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:12.078251 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9f25c321-cb81-440d-9d81-b67a0c7e15b8 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:12.078684 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9f25c321-cb81-440d-9d81-b67a0c7e15b8 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:12.080383 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9f25c321-cb81-440d-9d81-b67a0c7e15b8 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:12.080872 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9f25c321-cb81-440d-9d81-b67a0c7e15b8 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:12.082483 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9f25c321-cb81-440d-9d81-b67a0c7e15b8 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:12.310784 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b3a2289a-cfb2-4a82-8b4f-9b2ad49614a4 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:12.347905 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b3a2289a-cfb2-4a82-8b4f-9b2ad49614a4 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:12.350554 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b3a2289a-cfb2-4a82-8b4f-9b2ad49614a4 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:12.353239 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b3a2289a-cfb2-4a82-8b4f-9b2ad49614a4 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141" status: 200 len: 1724 microversion: 2.20 time: 0.985266 Sep 23 04:52:12.356894 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2262/4662] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:52:11 2022] GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141 => generated 1724 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:52:12.364683 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6beb8c44-9768-4964-b488-fdea513e8cd4 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:12.371143 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-6beb8c44-9768-4964-b488-fdea513e8cd4 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] [instance: 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:12.388456 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6beb8c44-9768-4964-b488-fdea513e8cd4 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:12.389578 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6beb8c44-9768-4964-b488-fdea513e8cd4 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:12.390249 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6beb8c44-9768-4964-b488-fdea513e8cd4 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:12.400881 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6beb8c44-9768-4964-b488-fdea513e8cd4 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:12.400881 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6beb8c44-9768-4964-b488-fdea513e8cd4 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:12.400881 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6beb8c44-9768-4964-b488-fdea513e8cd4 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:13.007715 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-9f25c321-cb81-440d-9d81-b67a0c7e15b8 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:13.032558 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-9f25c321-cb81-440d-9d81-b67a0c7e15b8 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1670 microversion: 2.1 time: 1.003395 Sep 23 04:52:13.033162 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2401/4663] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:12 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1670 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:52:13.059527 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d099040d-4f18-4a1b-b84a-38db011ee0cb tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:13.064286 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d099040d-4f18-4a1b-b84a-38db011ee0cb tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:13.088827 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d099040d-4f18-4a1b-b84a-38db011ee0cb tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:13.089376 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d099040d-4f18-4a1b-b84a-38db011ee0cb tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:13.106320 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d099040d-4f18-4a1b-b84a-38db011ee0cb tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:13.107231 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d099040d-4f18-4a1b-b84a-38db011ee0cb tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:13.111227 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d099040d-4f18-4a1b-b84a-38db011ee0cb tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:13.111745 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d099040d-4f18-4a1b-b84a-38db011ee0cb tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:13.520073 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6beb8c44-9768-4964-b488-fdea513e8cd4 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:13.535978 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6beb8c44-9768-4964-b488-fdea513e8cd4 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:13.541046 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6beb8c44-9768-4964-b488-fdea513e8cd4 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:13.545265 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-6beb8c44-9768-4964-b488-fdea513e8cd4 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] 10.222.0.33 "GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7" status: 200 len: 1890 microversion: 2.32 time: 1.181798 Sep 23 04:52:13.549297 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2263/4664] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:52:12 2022] GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 => generated 1890 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:52:13.586928 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-58d58433-2027-43fc-b2e8-c005f76f0084 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:52:13.589081 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-58d58433-2027-43fc-b2e8-c005f76f0084 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:13.601578 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-58d58433-2027-43fc-b2e8-c005f76f0084 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:13.604544 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-58d58433-2027-43fc-b2e8-c005f76f0084 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:13.605764 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-58d58433-2027-43fc-b2e8-c005f76f0084 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:13.608356 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-58d58433-2027-43fc-b2e8-c005f76f0084 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:13.609044 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-58d58433-2027-43fc-b2e8-c005f76f0084 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:13.619880 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-58d58433-2027-43fc-b2e8-c005f76f0084 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:13.740802 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d099040d-4f18-4a1b-b84a-38db011ee0cb tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:13.762719 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d099040d-4f18-4a1b-b84a-38db011ee0cb tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1516 microversion: 2.1 time: 0.710093 Sep 23 04:52:13.767707 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2402/4665] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:13 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1516 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:52:13.773927 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d17310ae-b7a3-40e8-b449-1359275cc2e8 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:13.774638 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d17310ae-b7a3-40e8-b449-1359275cc2e8 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: f285e256-0a0e-4126-8adf-643bd59ca141] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:13.803125 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d17310ae-b7a3-40e8-b449-1359275cc2e8 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:13.803125 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d17310ae-b7a3-40e8-b449-1359275cc2e8 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:13.803125 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d17310ae-b7a3-40e8-b449-1359275cc2e8 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:13.803125 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d17310ae-b7a3-40e8-b449-1359275cc2e8 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:13.803125 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d17310ae-b7a3-40e8-b449-1359275cc2e8 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:13.803125 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d17310ae-b7a3-40e8-b449-1359275cc2e8 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:13.978749 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-58d58433-2027-43fc-b2e8-c005f76f0084 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "POST /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5/action" status: 202 len: 0 microversion: 2.1 time: 0.406872 Sep 23 04:52:13.979948 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2264/4666] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:52:13 2022] POST /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5/action => generated 0 bytes in 430 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:52:13.999685 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-b569b8e9-bccf-41b0-aa44-19cb0f741e80 req-c2f41c1f-ae92-49f5-9d24-7a7e29467a62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49112e3f-73fc-4ee9-b48e-bcda5b7dcda7", "tag": "18162764-2c41-4a27-9757-c9988b7e7d84"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:52:14.038863 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-b569b8e9-bccf-41b0-aa44-19cb0f741e80 req-c2f41c1f-ae92-49f5-9d24-7a7e29467a62 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:14.039645 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-b569b8e9-bccf-41b0-aa44-19cb0f741e80 req-c2f41c1f-ae92-49f5-9d24-7a7e29467a62 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:14.041925 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-b569b8e9-bccf-41b0-aa44-19cb0f741e80 req-c2f41c1f-ae92-49f5-9d24-7a7e29467a62 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:14.072606 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-b569b8e9-bccf-41b0-aa44-19cb0f741e80 req-c2f41c1f-ae92-49f5-9d24-7a7e29467a62 service nova] Creating event network-changed:18162764-2c41-4a27-9757-c9988b7e7d84 for instance 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 on n-h2-846463-3 Sep 23 04:52:14.080199 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-b569b8e9-bccf-41b0-aa44-19cb0f741e80 req-c2f41c1f-ae92-49f5-9d24-7a7e29467a62 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098405 Sep 23 04:52:14.166216 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2265/4667] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:52:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:52:14.166216 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-179bbf67-871a-4a23-b123-3ed29074ba14 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:14.166216 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-179bbf67-871a-4a23-b123-3ed29074ba14 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:14.166216 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-179bbf67-871a-4a23-b123-3ed29074ba14 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:14.166216 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-179bbf67-871a-4a23-b123-3ed29074ba14 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:14.166216 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-179bbf67-871a-4a23-b123-3ed29074ba14 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:14.166216 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-179bbf67-871a-4a23-b123-3ed29074ba14 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:14.166216 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-179bbf67-871a-4a23-b123-3ed29074ba14 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:14.166216 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-179bbf67-871a-4a23-b123-3ed29074ba14 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:14.167209 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d17310ae-b7a3-40e8-b449-1359275cc2e8 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:14.181440 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d17310ae-b7a3-40e8-b449-1359275cc2e8 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:14.190996 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d17310ae-b7a3-40e8-b449-1359275cc2e8 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:14.196406 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d17310ae-b7a3-40e8-b449-1359275cc2e8 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141" status: 200 len: 1724 microversion: 2.20 time: 0.424326 Sep 23 04:52:14.198534 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2403/4668] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:52:13 2022] GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141 => generated 1724 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:52:14.525004 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-179bbf67-871a-4a23-b123-3ed29074ba14 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:14.535310 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-179bbf67-871a-4a23-b123-3ed29074ba14 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1675 microversion: 2.1 time: 0.452802 Sep 23 04:52:14.536250 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2266/4669] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:14 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1675 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:52:14.580337 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0b4c53fe-b383-40d3-893d-7157ab4b5ffe tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:14.581090 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-0b4c53fe-b383-40d3-893d-7157ab4b5ffe tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] [instance: 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:14.587752 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0b4c53fe-b383-40d3-893d-7157ab4b5ffe tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:14.588250 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0b4c53fe-b383-40d3-893d-7157ab4b5ffe tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:14.588745 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0b4c53fe-b383-40d3-893d-7157ab4b5ffe tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:14.589396 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0b4c53fe-b383-40d3-893d-7157ab4b5ffe tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:14.589856 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0b4c53fe-b383-40d3-893d-7157ab4b5ffe tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:14.590337 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0b4c53fe-b383-40d3-893d-7157ab4b5ffe tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:14.787845 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-cac86c15-ba9c-413a-aeff-73e8e21758a1 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:14.788772 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-cac86c15-ba9c-413a-aeff-73e8e21758a1 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:14.795102 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cac86c15-ba9c-413a-aeff-73e8e21758a1 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:14.795849 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cac86c15-ba9c-413a-aeff-73e8e21758a1 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:14.796474 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cac86c15-ba9c-413a-aeff-73e8e21758a1 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:14.797377 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cac86c15-ba9c-413a-aeff-73e8e21758a1 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:14.797838 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cac86c15-ba9c-413a-aeff-73e8e21758a1 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:14.799398 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cac86c15-ba9c-413a-aeff-73e8e21758a1 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:14.806014 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-0b4c53fe-b383-40d3-893d-7157ab4b5ffe tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:14.829977 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-0b4c53fe-b383-40d3-893d-7157ab4b5ffe tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:14.831782 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-0b4c53fe-b383-40d3-893d-7157ab4b5ffe tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:14.834578 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0b4c53fe-b383-40d3-893d-7157ab4b5ffe tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] 10.222.0.33 "GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7" status: 200 len: 1890 microversion: 2.32 time: 0.258226 Sep 23 04:52:14.844609 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2404/4670] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:52:14 2022] GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 => generated 1890 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:52:14.999332 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-cac86c15-ba9c-413a-aeff-73e8e21758a1 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:15.007472 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-cac86c15-ba9c-413a-aeff-73e8e21758a1 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1516 microversion: 2.1 time: 0.224002 Sep 23 04:52:15.008255 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2267/4671] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:14 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1516 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:52:15.226931 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-04a076fe-5b1f-497a-b58a-d1a3c3f50c80 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:15.228079 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-04a076fe-5b1f-497a-b58a-d1a3c3f50c80 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: f285e256-0a0e-4126-8adf-643bd59ca141] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:15.240907 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-04a076fe-5b1f-497a-b58a-d1a3c3f50c80 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:15.241784 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-04a076fe-5b1f-497a-b58a-d1a3c3f50c80 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:15.242640 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-04a076fe-5b1f-497a-b58a-d1a3c3f50c80 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:15.245677 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-04a076fe-5b1f-497a-b58a-d1a3c3f50c80 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:15.247523 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-04a076fe-5b1f-497a-b58a-d1a3c3f50c80 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:15.249662 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-04a076fe-5b1f-497a-b58a-d1a3c3f50c80 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:15.561680 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b6eedf1f-a838-412f-8c55-2c84daf4101b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:15.562538 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b6eedf1f-a838-412f-8c55-2c84daf4101b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:15.574667 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b6eedf1f-a838-412f-8c55-2c84daf4101b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:15.576051 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b6eedf1f-a838-412f-8c55-2c84daf4101b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:15.578131 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b6eedf1f-a838-412f-8c55-2c84daf4101b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:15.583626 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b6eedf1f-a838-412f-8c55-2c84daf4101b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:15.583626 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b6eedf1f-a838-412f-8c55-2c84daf4101b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:15.583626 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b6eedf1f-a838-412f-8c55-2c84daf4101b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:15.621672 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-04a076fe-5b1f-497a-b58a-d1a3c3f50c80 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:15.636598 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-04a076fe-5b1f-497a-b58a-d1a3c3f50c80 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:15.641552 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-04a076fe-5b1f-497a-b58a-d1a3c3f50c80 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:15.645421 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-04a076fe-5b1f-497a-b58a-d1a3c3f50c80 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141" status: 200 len: 1724 microversion: 2.20 time: 0.422774 Sep 23 04:52:15.648407 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2405/4672] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:52:15 2022] GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141 => generated 1724 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:52:15.863155 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-240db3d5-1a02-4e6a-b2f1-97322fbe4b06 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:15.864053 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-240db3d5-1a02-4e6a-b2f1-97322fbe4b06 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] [instance: 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:15.874486 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-240db3d5-1a02-4e6a-b2f1-97322fbe4b06 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:15.875062 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-240db3d5-1a02-4e6a-b2f1-97322fbe4b06 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:15.875427 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-240db3d5-1a02-4e6a-b2f1-97322fbe4b06 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:15.878671 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-240db3d5-1a02-4e6a-b2f1-97322fbe4b06 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:15.879188 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-240db3d5-1a02-4e6a-b2f1-97322fbe4b06 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:15.879677 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-240db3d5-1a02-4e6a-b2f1-97322fbe4b06 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:16.255648 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b6eedf1f-a838-412f-8c55-2c84daf4101b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:16.267182 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b6eedf1f-a838-412f-8c55-2c84daf4101b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1655 microversion: 2.1 time: 0.710263 Sep 23 04:52:16.267780 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2268/4673] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:15 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1655 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:52:16.314345 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-68fdb38e-05b1-4d6b-95d8-e0aa83f50bb5 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:16.316332 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-68fdb38e-05b1-4d6b-95d8-e0aa83f50bb5 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:16.337918 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-68fdb38e-05b1-4d6b-95d8-e0aa83f50bb5 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:16.338456 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-68fdb38e-05b1-4d6b-95d8-e0aa83f50bb5 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:16.343145 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-68fdb38e-05b1-4d6b-95d8-e0aa83f50bb5 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:16.343145 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-68fdb38e-05b1-4d6b-95d8-e0aa83f50bb5 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:16.343145 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-68fdb38e-05b1-4d6b-95d8-e0aa83f50bb5 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:16.343145 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-68fdb38e-05b1-4d6b-95d8-e0aa83f50bb5 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:16.461386 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-240db3d5-1a02-4e6a-b2f1-97322fbe4b06 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:16.468040 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:52:16.510808 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-240db3d5-1a02-4e6a-b2f1-97322fbe4b06 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:16.512339 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-240db3d5-1a02-4e6a-b2f1-97322fbe4b06 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:16.549753 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-240db3d5-1a02-4e6a-b2f1-97322fbe4b06 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] 10.222.0.33 "GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7" status: 200 len: 1890 microversion: 2.32 time: 0.656000 Sep 23 04:52:16.549753 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2406/4674] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:52:15 2022] GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 => generated 1890 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:52:16.557926 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-351eb4ef-d392-4784-940c-2898fe77c2f3 req-c4e01510-3692-44b5-b6f3-17333f2106f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49112e3f-73fc-4ee9-b48e-bcda5b7dcda7", "tag": "8231c7d3-a7f9-4daf-87f5-be07473f366a"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:52:16.583581 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-68fdb38e-05b1-4d6b-95d8-e0aa83f50bb5 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:16.595855 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-68fdb38e-05b1-4d6b-95d8-e0aa83f50bb5 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1516 microversion: 2.1 time: 0.295928 Sep 23 04:52:16.613969 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2269/4675] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:16 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1516 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:52:16.614210 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-351eb4ef-d392-4784-940c-2898fe77c2f3 req-c4e01510-3692-44b5-b6f3-17333f2106f3 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:16.614210 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-351eb4ef-d392-4784-940c-2898fe77c2f3 req-c4e01510-3692-44b5-b6f3-17333f2106f3 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:16.623537 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-351eb4ef-d392-4784-940c-2898fe77c2f3 req-c4e01510-3692-44b5-b6f3-17333f2106f3 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:16.623915 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4fd131a4-3d1a-425b-bb03-8d71e28d5de8 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:52:16.623915 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4fd131a4-3d1a-425b-bb03-8d71e28d5de8 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:16.645722 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4fd131a4-3d1a-425b-bb03-8d71e28d5de8 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:16.646243 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4fd131a4-3d1a-425b-bb03-8d71e28d5de8 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:16.653668 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4fd131a4-3d1a-425b-bb03-8d71e28d5de8 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:16.653668 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4fd131a4-3d1a-425b-bb03-8d71e28d5de8 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:16.653668 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4fd131a4-3d1a-425b-bb03-8d71e28d5de8 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:16.653668 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4fd131a4-3d1a-425b-bb03-8d71e28d5de8 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:16.656024 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-351eb4ef-d392-4784-940c-2898fe77c2f3 req-c4e01510-3692-44b5-b6f3-17333f2106f3 service nova] Creating event network-changed:8231c7d3-a7f9-4daf-87f5-be07473f366a for instance 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 on n-h2-846463-3 Sep 23 04:52:16.676176 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-351eb4ef-d392-4784-940c-2898fe77c2f3 req-c4e01510-3692-44b5-b6f3-17333f2106f3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125448 Sep 23 04:52:16.678566 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2407/4676] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:52:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:52:16.985476 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4fd131a4-3d1a-425b-bb03-8d71e28d5de8 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "POST /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5/action" status: 202 len: 0 microversion: 2.1 time: 0.379658 Sep 23 04:52:16.987348 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2270/4677] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:52:16 2022] POST /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5/action => generated 0 bytes in 383 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:52:17.012876 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3bbc6a0a-c350-48dc-9683-d9d3acae0a35 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:17.015918 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3bbc6a0a-c350-48dc-9683-d9d3acae0a35 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: f285e256-0a0e-4126-8adf-643bd59ca141] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:17.030501 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3bbc6a0a-c350-48dc-9683-d9d3acae0a35 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:17.033228 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3bbc6a0a-c350-48dc-9683-d9d3acae0a35 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:17.033999 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3bbc6a0a-c350-48dc-9683-d9d3acae0a35 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:17.038271 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3bbc6a0a-c350-48dc-9683-d9d3acae0a35 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:17.039049 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3bbc6a0a-c350-48dc-9683-d9d3acae0a35 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:17.045535 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3bbc6a0a-c350-48dc-9683-d9d3acae0a35 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:17.242768 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-22f1fa2f-08a6-48c5-8e08-8674f30b3dce tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-480812141", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "networks": [{"uuid": "d9cbccd5-35fe-4c2e-aa6e-6e99efe2ad76"}]}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:52:17.335850 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-3bbc6a0a-c350-48dc-9683-d9d3acae0a35 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:17.355387 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-3bbc6a0a-c350-48dc-9683-d9d3acae0a35 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:17.358947 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-3bbc6a0a-c350-48dc-9683-d9d3acae0a35 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:17.360701 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3bbc6a0a-c350-48dc-9683-d9d3acae0a35 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141" status: 200 len: 1724 microversion: 2.20 time: 0.371103 Sep 23 04:52:17.387529 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2271/4678] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:52:16 2022] GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141 => generated 1724 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:52:17.397824 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.neutron [None req-22f1fa2f-08a6-48c5-8e08-8674f30b3dce tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] validate_networks() for [('d9cbccd5-35fe-4c2e-aa6e-6e99efe2ad76', None, None, None, None, None)] {{(pid=122699) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:52:17.420294 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-af662be9-5306-4927-84ea-2caad12d8735 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:17.422479 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-af662be9-5306-4927-84ea-2caad12d8735 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:17.438463 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-af662be9-5306-4927-84ea-2caad12d8735 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:17.442073 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-af662be9-5306-4927-84ea-2caad12d8735 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:17.442545 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-af662be9-5306-4927-84ea-2caad12d8735 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:17.443443 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-af662be9-5306-4927-84ea-2caad12d8735 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:17.446289 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-af662be9-5306-4927-84ea-2caad12d8735 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:17.446912 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-af662be9-5306-4927-84ea-2caad12d8735 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:17.825071 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-af662be9-5306-4927-84ea-2caad12d8735 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:17.834202 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-af662be9-5306-4927-84ea-2caad12d8735 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1662 microversion: 2.1 time: 0.445411 Sep 23 04:52:17.837034 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2272/4679] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:17 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1662 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:52:17.860542 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d4df9050-1d97-4c02-bf21-6e7695d947a5 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:17.863143 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d4df9050-1d97-4c02-bf21-6e7695d947a5 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] [instance: 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:17.869444 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d4df9050-1d97-4c02-bf21-6e7695d947a5 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:17.870221 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d4df9050-1d97-4c02-bf21-6e7695d947a5 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:17.870847 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d4df9050-1d97-4c02-bf21-6e7695d947a5 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:17.871741 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d4df9050-1d97-4c02-bf21-6e7695d947a5 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:17.872386 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d4df9050-1d97-4c02-bf21-6e7695d947a5 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:17.873489 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d4df9050-1d97-4c02-bf21-6e7695d947a5 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:18.258277 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-22f1fa2f-08a6-48c5-8e08-8674f30b3dce tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Flavor limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:52:18.258766 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-22f1fa2f-08a6-48c5-8e08-8674f30b3dce tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Image limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:52:18.259164 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-22f1fa2f-08a6-48c5-8e08-8674f30b3dce tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Flavor pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:52:18.259819 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-22f1fa2f-08a6-48c5-8e08-8674f30b3dce tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Image pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:52:18.260239 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-22f1fa2f-08a6-48c5-8e08-8674f30b3dce tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:52:18.287954 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-22f1fa2f-08a6-48c5-8e08-8674f30b3dce tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:18.294533 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-22f1fa2f-08a6-48c5-8e08-8674f30b3dce tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:18.295711 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-22f1fa2f-08a6-48c5-8e08-8674f30b3dce tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:18.301991 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-22f1fa2f-08a6-48c5-8e08-8674f30b3dce tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:18.301991 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-22f1fa2f-08a6-48c5-8e08-8674f30b3dce tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:18.301991 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-22f1fa2f-08a6-48c5-8e08-8674f30b3dce tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:18.344794 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-22f1fa2f-08a6-48c5-8e08-8674f30b3dce tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Getting quotas for project a94d0c555b3b4c79b1176db993b58607. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:52:18.354378 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-22f1fa2f-08a6-48c5-8e08-8674f30b3dce tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Getting quotas for user c3397cb6388640e3af28e06f80019363 and project a94d0c555b3b4c79b1176db993b58607. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:52:18.374860 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-22f1fa2f-08a6-48c5-8e08-8674f30b3dce tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Going to run 1 instances... {{(pid=122699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:52:18.378212 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-22f1fa2f-08a6-48c5-8e08-8674f30b3dce tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:52:18.498566 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d4df9050-1d97-4c02-bf21-6e7695d947a5 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:18.516232 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d4df9050-1d97-4c02-bf21-6e7695d947a5 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:18.534387 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-22f1fa2f-08a6-48c5-8e08-8674f30b3dce tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.854459 Sep 23 04:52:18.534932 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d4df9050-1d97-4c02-bf21-6e7695d947a5 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:18.542396 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2408/4680] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:52:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1863 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:52:18.543356 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d4df9050-1d97-4c02-bf21-6e7695d947a5 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] 10.222.0.33 "GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7" status: 200 len: 1890 microversion: 2.32 time: 0.705161 Sep 23 04:52:18.546367 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2273/4681] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:52:17 2022] GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 => generated 1890 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:52:18.551331 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ed0d37f8-e42a-4d35-a995-975f5c7a3465 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:18.577090 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8ebbca97-4cbd-4354-94b7-2bf45336cf1b tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:18.578273 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ed0d37f8-e42a-4d35-a995-975f5c7a3465 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:18.582055 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8ebbca97-4cbd-4354-94b7-2bf45336cf1b tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: f285e256-0a0e-4126-8adf-643bd59ca141] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:18.592409 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ed0d37f8-e42a-4d35-a995-975f5c7a3465 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:18.596384 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ed0d37f8-e42a-4d35-a995-975f5c7a3465 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:18.597765 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ed0d37f8-e42a-4d35-a995-975f5c7a3465 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:18.598856 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ed0d37f8-e42a-4d35-a995-975f5c7a3465 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:18.599542 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8ebbca97-4cbd-4354-94b7-2bf45336cf1b tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:18.600660 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8ebbca97-4cbd-4354-94b7-2bf45336cf1b tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:18.601182 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ed0d37f8-e42a-4d35-a995-975f5c7a3465 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:18.601802 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ed0d37f8-e42a-4d35-a995-975f5c7a3465 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:18.607705 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8ebbca97-4cbd-4354-94b7-2bf45336cf1b tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:18.607705 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8ebbca97-4cbd-4354-94b7-2bf45336cf1b tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:18.607705 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8ebbca97-4cbd-4354-94b7-2bf45336cf1b tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:18.607995 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8ebbca97-4cbd-4354-94b7-2bf45336cf1b tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:18.892658 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8ebbca97-4cbd-4354-94b7-2bf45336cf1b tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:18.906400 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8ebbca97-4cbd-4354-94b7-2bf45336cf1b tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:18.910480 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8ebbca97-4cbd-4354-94b7-2bf45336cf1b tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:18.916298 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8ebbca97-4cbd-4354-94b7-2bf45336cf1b tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141" status: 200 len: 1724 microversion: 2.20 time: 0.362332 Sep 23 04:52:18.917505 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2274/4682] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:52:18 2022] GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141 => generated 1724 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:52:18.932604 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7950ceb2-28cc-45ef-af30-da29f9e5d5f1 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:18.934291 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7950ceb2-28cc-45ef-af30-da29f9e5d5f1 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:18.940756 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ed0d37f8-e42a-4d35-a995-975f5c7a3465 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:18.960151 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ed0d37f8-e42a-4d35-a995-975f5c7a3465 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1516 microversion: 2.1 time: 0.407903 Sep 23 04:52:18.961323 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2409/4683] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:18 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1516 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:52:18.967317 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-6c44913b-63ae-414d-9617-39bd452f77cd req-e058f4d4-ba23-4317-940d-e59d7a36b387 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49112e3f-73fc-4ee9-b48e-bcda5b7dcda7", "tag": "16397cd8-7ed4-4825-8440-b6d39557eb3f"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:52:18.978669 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-6c44913b-63ae-414d-9617-39bd452f77cd req-e058f4d4-ba23-4317-940d-e59d7a36b387 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:18.979434 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-6c44913b-63ae-414d-9617-39bd452f77cd req-e058f4d4-ba23-4317-940d-e59d7a36b387 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:18.980004 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-6c44913b-63ae-414d-9617-39bd452f77cd req-e058f4d4-ba23-4317-940d-e59d7a36b387 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:18.992492 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-6c44913b-63ae-414d-9617-39bd452f77cd req-e058f4d4-ba23-4317-940d-e59d7a36b387 service nova] Creating event network-changed:16397cd8-7ed4-4825-8440-b6d39557eb3f for instance 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 on n-h2-846463-3 Sep 23 04:52:18.998383 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-6c44913b-63ae-414d-9617-39bd452f77cd req-e058f4d4-ba23-4317-940d-e59d7a36b387 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034918 Sep 23 04:52:18.998993 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2410/4684] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:52:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:52:19.024133 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-7950ceb2-28cc-45ef-af30-da29f9e5d5f1 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:19.033070 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7950ceb2-28cc-45ef-af30-da29f9e5d5f1 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b" status: 200 len: 1217 microversion: 2.1 time: 0.112664 Sep 23 04:52:19.034810 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-eef49e3e-0450-47df-bcd3-873f091798e2 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:19.035950 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2275/4685] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:18 2022] GET /compute/v2.1/servers/c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b => generated 1217 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:52:19.038614 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-eef49e3e-0450-47df-bcd3-873f091798e2 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:19.048145 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eef49e3e-0450-47df-bcd3-873f091798e2 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:19.048988 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eef49e3e-0450-47df-bcd3-873f091798e2 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:19.049582 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eef49e3e-0450-47df-bcd3-873f091798e2 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:19.050474 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eef49e3e-0450-47df-bcd3-873f091798e2 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:19.051107 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eef49e3e-0450-47df-bcd3-873f091798e2 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:19.052589 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eef49e3e-0450-47df-bcd3-873f091798e2 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:19.284561 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-eef49e3e-0450-47df-bcd3-873f091798e2 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:19.294342 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-eef49e3e-0450-47df-bcd3-873f091798e2 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1670 microversion: 2.1 time: 0.293553 Sep 23 04:52:19.309176 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2411/4686] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:18 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1670 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:52:19.329381 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f97d0aaf-2421-470d-b58d-4e2b21eaeee5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:19.330456 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f97d0aaf-2421-470d-b58d-4e2b21eaeee5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:19.356287 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f97d0aaf-2421-470d-b58d-4e2b21eaeee5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:19.357634 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f97d0aaf-2421-470d-b58d-4e2b21eaeee5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:19.358381 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f97d0aaf-2421-470d-b58d-4e2b21eaeee5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:19.359367 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f97d0aaf-2421-470d-b58d-4e2b21eaeee5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:19.360065 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f97d0aaf-2421-470d-b58d-4e2b21eaeee5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:19.360720 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f97d0aaf-2421-470d-b58d-4e2b21eaeee5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:19.585991 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-11e9b854-f9d6-48ec-9fef-791529d0ae5c tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:19.586922 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-11e9b854-f9d6-48ec-9fef-791529d0ae5c tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] [instance: 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:19.594487 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f97d0aaf-2421-470d-b58d-4e2b21eaeee5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:19.607757 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-11e9b854-f9d6-48ec-9fef-791529d0ae5c tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:19.610697 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-11e9b854-f9d6-48ec-9fef-791529d0ae5c tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:19.611969 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-11e9b854-f9d6-48ec-9fef-791529d0ae5c tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:19.613431 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-11e9b854-f9d6-48ec-9fef-791529d0ae5c tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:19.617419 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-11e9b854-f9d6-48ec-9fef-791529d0ae5c tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:19.619104 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-11e9b854-f9d6-48ec-9fef-791529d0ae5c tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:19.628652 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f97d0aaf-2421-470d-b58d-4e2b21eaeee5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1670 microversion: 2.1 time: 0.303335 Sep 23 04:52:19.654752 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2276/4687] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:19 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1670 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:52:19.666286 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-24a97b71-26de-404f-b8b9-35d9ced9c088 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:19.667575 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-24a97b71-26de-404f-b8b9-35d9ced9c088 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:19.677766 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-24a97b71-26de-404f-b8b9-35d9ced9c088 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:19.679576 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-24a97b71-26de-404f-b8b9-35d9ced9c088 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:19.681044 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-24a97b71-26de-404f-b8b9-35d9ced9c088 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:19.681997 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-24a97b71-26de-404f-b8b9-35d9ced9c088 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:19.683866 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-24a97b71-26de-404f-b8b9-35d9ced9c088 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:19.684216 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-24a97b71-26de-404f-b8b9-35d9ced9c088 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:20.274440 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-24a97b71-26de-404f-b8b9-35d9ced9c088 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:20.287836 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-24a97b71-26de-404f-b8b9-35d9ced9c088 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1670 microversion: 2.1 time: 0.627294 Sep 23 04:52:20.287836 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2277/4688] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:19 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1670 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:52:20.289261 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-bb37d5c8-4d9b-489f-9c42-a2ce5a562d2f tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:20.289876 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-bb37d5c8-4d9b-489f-9c42-a2ce5a562d2f tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: f285e256-0a0e-4126-8adf-643bd59ca141] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:20.326978 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bb37d5c8-4d9b-489f-9c42-a2ce5a562d2f tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:20.327491 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bb37d5c8-4d9b-489f-9c42-a2ce5a562d2f tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:20.327936 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bb37d5c8-4d9b-489f-9c42-a2ce5a562d2f tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:20.328661 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bb37d5c8-4d9b-489f-9c42-a2ce5a562d2f tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:20.353360 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bb37d5c8-4d9b-489f-9c42-a2ce5a562d2f tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:20.357310 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bb37d5c8-4d9b-489f-9c42-a2ce5a562d2f tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:20.393421 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-11e9b854-f9d6-48ec-9fef-791529d0ae5c tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:20.412384 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-11e9b854-f9d6-48ec-9fef-791529d0ae5c tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:20.414706 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-11e9b854-f9d6-48ec-9fef-791529d0ae5c tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:20.418742 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-11e9b854-f9d6-48ec-9fef-791529d0ae5c tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] 10.222.0.33 "GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7" status: 200 len: 1890 microversion: 2.32 time: 0.839035 Sep 23 04:52:20.422818 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2412/4689] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:52:19 2022] GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 => generated 1890 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:52:20.439003 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d7baf375-44bf-4265-a62d-0ab7623f77e1 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:20.443481 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d7baf375-44bf-4265-a62d-0ab7623f77e1 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:20.465819 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d7baf375-44bf-4265-a62d-0ab7623f77e1 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:20.468358 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d7baf375-44bf-4265-a62d-0ab7623f77e1 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:20.480492 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d7baf375-44bf-4265-a62d-0ab7623f77e1 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:20.482458 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d7baf375-44bf-4265-a62d-0ab7623f77e1 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:20.488539 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d7baf375-44bf-4265-a62d-0ab7623f77e1 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:20.489165 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d7baf375-44bf-4265-a62d-0ab7623f77e1 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:20.706596 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-bb37d5c8-4d9b-489f-9c42-a2ce5a562d2f tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:20.738929 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:52:20.747606 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-bb37d5c8-4d9b-489f-9c42-a2ce5a562d2f tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:20.752113 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-bb37d5c8-4d9b-489f-9c42-a2ce5a562d2f tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:20.757780 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d7baf375-44bf-4265-a62d-0ab7623f77e1 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:20.766489 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-bb37d5c8-4d9b-489f-9c42-a2ce5a562d2f tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141" status: 200 len: 1745 microversion: 2.20 time: 0.469177 Sep 23 04:52:20.767161 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2278/4690] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:52:20 2022] GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141 => generated 1745 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:52:20.775786 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d7baf375-44bf-4265-a62d-0ab7623f77e1 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1516 microversion: 2.1 time: 0.350556 Sep 23 04:52:20.778073 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2413/4691] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:20 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1516 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:52:20.786628 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c0648c96-7714-4b46-a459-65ee37af6d60 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:20.787285 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c0648c96-7714-4b46-a459-65ee37af6d60 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:20.794133 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-83c04b7f-a757-40c9-86cb-02e89dafcaa2 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:20.797053 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-83c04b7f-a757-40c9-86cb-02e89dafcaa2 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:20.808257 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=92 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:52:20.813339 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c0648c96-7714-4b46-a459-65ee37af6d60 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:20.813860 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c0648c96-7714-4b46-a459-65ee37af6d60 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:20.814503 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-83c04b7f-a757-40c9-86cb-02e89dafcaa2 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:20.815470 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c0648c96-7714-4b46-a459-65ee37af6d60 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:20.815600 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-83c04b7f-a757-40c9-86cb-02e89dafcaa2 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:20.816013 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-83c04b7f-a757-40c9-86cb-02e89dafcaa2 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:20.816930 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-83c04b7f-a757-40c9-86cb-02e89dafcaa2 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:20.817422 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c0648c96-7714-4b46-a459-65ee37af6d60 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:20.817763 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-83c04b7f-a757-40c9-86cb-02e89dafcaa2 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:20.817910 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c0648c96-7714-4b46-a459-65ee37af6d60 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:20.818504 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-83c04b7f-a757-40c9-86cb-02e89dafcaa2 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:20.820084 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c0648c96-7714-4b46-a459-65ee37af6d60 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:20.980931 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c0648c96-7714-4b46-a459-65ee37af6d60 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:20.995886 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c0648c96-7714-4b46-a459-65ee37af6d60 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b" status: 200 len: 1213 microversion: 2.1 time: 0.218415 Sep 23 04:52:20.996564 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2279/4692] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:20 2022] GET /compute/v2.1/servers/c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b => generated 1213 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:52:21.028163 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-f7f97ca6-9856-41ae-8b59-0b02f947d197 req-3f5540a5-ce56-49b8-9b3e-a4e2b0fcba9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49112e3f-73fc-4ee9-b48e-bcda5b7dcda7", "tag": "462c3500-e3b1-4869-99f4-aeaa9293fea3"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:52:21.046942 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-f7f97ca6-9856-41ae-8b59-0b02f947d197 req-3f5540a5-ce56-49b8-9b3e-a4e2b0fcba9e service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:21.047445 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-f7f97ca6-9856-41ae-8b59-0b02f947d197 req-3f5540a5-ce56-49b8-9b3e-a4e2b0fcba9e service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:21.047891 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-f7f97ca6-9856-41ae-8b59-0b02f947d197 req-3f5540a5-ce56-49b8-9b3e-a4e2b0fcba9e service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:21.084887 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-f7f97ca6-9856-41ae-8b59-0b02f947d197 req-3f5540a5-ce56-49b8-9b3e-a4e2b0fcba9e service nova] Creating event network-changed:462c3500-e3b1-4869-99f4-aeaa9293fea3 for instance 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 on n-h2-846463-3 Sep 23 04:52:21.114420 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-f7f97ca6-9856-41ae-8b59-0b02f947d197 req-3f5540a5-ce56-49b8-9b3e-a4e2b0fcba9e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075300 Sep 23 04:52:21.118711 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2280/4693] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:52:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:52:21.147201 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-83c04b7f-a757-40c9-86cb-02e89dafcaa2 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:21.157452 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-83c04b7f-a757-40c9-86cb-02e89dafcaa2 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1670 microversion: 2.1 time: 0.376437 Sep 23 04:52:21.158582 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2414/4694] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:20 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1670 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:52:21.184686 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-988cc315-c5dc-44a4-949c-f155d695abf5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:21.185956 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-988cc315-c5dc-44a4-949c-f155d695abf5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:21.208712 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-988cc315-c5dc-44a4-949c-f155d695abf5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:21.209242 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-988cc315-c5dc-44a4-949c-f155d695abf5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:21.209927 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-988cc315-c5dc-44a4-949c-f155d695abf5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:21.213057 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-988cc315-c5dc-44a4-949c-f155d695abf5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:21.213722 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-988cc315-c5dc-44a4-949c-f155d695abf5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:21.214550 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-988cc315-c5dc-44a4-949c-f155d695abf5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:21.452055 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-27f5f413-2738-4b0d-b1e1-3a2517764d6f tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:21.455273 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-27f5f413-2738-4b0d-b1e1-3a2517764d6f tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] [instance: 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:21.463292 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-27f5f413-2738-4b0d-b1e1-3a2517764d6f tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:21.464582 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-27f5f413-2738-4b0d-b1e1-3a2517764d6f tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:21.465370 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-27f5f413-2738-4b0d-b1e1-3a2517764d6f tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:21.467405 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-27f5f413-2738-4b0d-b1e1-3a2517764d6f tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:21.468237 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-27f5f413-2738-4b0d-b1e1-3a2517764d6f tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:21.470067 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-27f5f413-2738-4b0d-b1e1-3a2517764d6f tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:21.744561 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-988cc315-c5dc-44a4-949c-f155d695abf5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:21.756128 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-988cc315-c5dc-44a4-949c-f155d695abf5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1670 microversion: 2.1 time: 0.579511 Sep 23 04:52:21.776415 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2281/4695] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:21 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1670 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:52:21.802898 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-09a3c0b3-df30-479c-b775-1134d8b991a0 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:21.803915 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-09a3c0b3-df30-479c-b775-1134d8b991a0 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:21.812338 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-09a3c0b3-df30-479c-b775-1134d8b991a0 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:21.814320 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-09a3c0b3-df30-479c-b775-1134d8b991a0 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:21.818093 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-09a3c0b3-df30-479c-b775-1134d8b991a0 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:21.819946 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-09a3c0b3-df30-479c-b775-1134d8b991a0 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:21.821471 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-09a3c0b3-df30-479c-b775-1134d8b991a0 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:21.826965 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-27f5f413-2738-4b0d-b1e1-3a2517764d6f tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:21.828546 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-09a3c0b3-df30-479c-b775-1134d8b991a0 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:21.844663 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-27f5f413-2738-4b0d-b1e1-3a2517764d6f tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:21.846458 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-27f5f413-2738-4b0d-b1e1-3a2517764d6f tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:21.848253 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-27f5f413-2738-4b0d-b1e1-3a2517764d6f tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] 10.222.0.33 "GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7" status: 200 len: 1890 microversion: 2.32 time: 0.401766 Sep 23 04:52:21.851319 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2415/4696] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:52:21 2022] GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 => generated 1890 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:52:21.863659 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d6fa21a3-d2e9-4e0d-aa59-335ac3dc69df tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:21.865279 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d6fa21a3-d2e9-4e0d-aa59-335ac3dc69df tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: f285e256-0a0e-4126-8adf-643bd59ca141] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:21.873213 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d6fa21a3-d2e9-4e0d-aa59-335ac3dc69df tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:21.874347 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d6fa21a3-d2e9-4e0d-aa59-335ac3dc69df tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:21.875138 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d6fa21a3-d2e9-4e0d-aa59-335ac3dc69df tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:21.876163 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d6fa21a3-d2e9-4e0d-aa59-335ac3dc69df tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:21.876699 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d6fa21a3-d2e9-4e0d-aa59-335ac3dc69df tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:21.877223 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d6fa21a3-d2e9-4e0d-aa59-335ac3dc69df tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:22.149181 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-09a3c0b3-df30-479c-b775-1134d8b991a0 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:22.181386 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-09a3c0b3-df30-479c-b775-1134d8b991a0 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1670 microversion: 2.1 time: 0.404453 Sep 23 04:52:22.188634 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2282/4697] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:21 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1670 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:52:22.205431 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e1d2e4ac-f22c-4434-8683-ae705c02a0e8 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:22.211081 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e1d2e4ac-f22c-4434-8683-ae705c02a0e8 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:22.236322 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e1d2e4ac-f22c-4434-8683-ae705c02a0e8 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:22.239595 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e1d2e4ac-f22c-4434-8683-ae705c02a0e8 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:22.239595 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e1d2e4ac-f22c-4434-8683-ae705c02a0e8 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:22.239595 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e1d2e4ac-f22c-4434-8683-ae705c02a0e8 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:22.239595 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e1d2e4ac-f22c-4434-8683-ae705c02a0e8 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:22.245169 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e1d2e4ac-f22c-4434-8683-ae705c02a0e8 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:22.509076 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d6fa21a3-d2e9-4e0d-aa59-335ac3dc69df tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:22.532646 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d6fa21a3-d2e9-4e0d-aa59-335ac3dc69df tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:22.536888 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d6fa21a3-d2e9-4e0d-aa59-335ac3dc69df tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:22.538378 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d6fa21a3-d2e9-4e0d-aa59-335ac3dc69df tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141" status: 200 len: 1745 microversion: 2.20 time: 0.685343 Sep 23 04:52:22.541155 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2416/4698] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:52:21 2022] GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141 => generated 1745 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:52:22.550716 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ae5522ec-5548-46d1-8945-37df411f6ea9 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:22.551421 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ae5522ec-5548-46d1-8945-37df411f6ea9 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:22.573590 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ae5522ec-5548-46d1-8945-37df411f6ea9 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:22.574278 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ae5522ec-5548-46d1-8945-37df411f6ea9 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:22.574831 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ae5522ec-5548-46d1-8945-37df411f6ea9 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:22.575708 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ae5522ec-5548-46d1-8945-37df411f6ea9 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:22.576275 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ae5522ec-5548-46d1-8945-37df411f6ea9 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:22.576963 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ae5522ec-5548-46d1-8945-37df411f6ea9 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:22.652502 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e1d2e4ac-f22c-4434-8683-ae705c02a0e8 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:22.661474 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e1d2e4ac-f22c-4434-8683-ae705c02a0e8 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1516 microversion: 2.1 time: 0.471690 Sep 23 04:52:22.662082 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2283/4699] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:22 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1516 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:52:22.683117 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-65c29092-25aa-46ed-9646-7a6eb850be29 req-1ddce26e-fb0b-46b6-b414-3d490256643b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9f2ff08-c66d-4991-9bae-d523a3adb8bf", "name": "network-vif-plugged", "status": "completed", "tag": "5cac1937-93f1-4537-9d14-be0ca8715d11"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:52:22.703977 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-65c29092-25aa-46ed-9646-7a6eb850be29 req-1ddce26e-fb0b-46b6-b414-3d490256643b service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:22.704705 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-65c29092-25aa-46ed-9646-7a6eb850be29 req-1ddce26e-fb0b-46b6-b414-3d490256643b service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:22.705064 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-65c29092-25aa-46ed-9646-7a6eb850be29 req-1ddce26e-fb0b-46b6-b414-3d490256643b service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:22.731333 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-65c29092-25aa-46ed-9646-7a6eb850be29 req-1ddce26e-fb0b-46b6-b414-3d490256643b service nova] Creating event network-vif-plugged:5cac1937-93f1-4537-9d14-be0ca8715d11 for instance a9f2ff08-c66d-4991-9bae-d523a3adb8bf on n-h1-846463-3 Sep 23 04:52:22.759348 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-65c29092-25aa-46ed-9646-7a6eb850be29 req-1ddce26e-fb0b-46b6-b414-3d490256643b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096030 Sep 23 04:52:22.763815 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2284/4700] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:52:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:52:22.863161 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ae5522ec-5548-46d1-8945-37df411f6ea9 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:22.877429 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8ca2674b-73e9-4fdb-b5ed-a19cea5eb4f5 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:22.878195 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8ca2674b-73e9-4fdb-b5ed-a19cea5eb4f5 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] [instance: 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:22.902279 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ae5522ec-5548-46d1-8945-37df411f6ea9 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b" status: 200 len: 1287 microversion: 2.1 time: 0.349863 Sep 23 04:52:22.902279 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2417/4701] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:22 2022] GET /compute/v2.1/servers/c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b => generated 1287 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:52:22.902551 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8ca2674b-73e9-4fdb-b5ed-a19cea5eb4f5 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:22.903060 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8ca2674b-73e9-4fdb-b5ed-a19cea5eb4f5 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:22.905494 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8ca2674b-73e9-4fdb-b5ed-a19cea5eb4f5 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:22.908916 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8ca2674b-73e9-4fdb-b5ed-a19cea5eb4f5 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:22.909583 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8ca2674b-73e9-4fdb-b5ed-a19cea5eb4f5 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:22.910536 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8ca2674b-73e9-4fdb-b5ed-a19cea5eb4f5 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:23.243238 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-ed561409-5543-473d-a595-fa074206fd37 req-832238ac-aea3-4b58-9884-4107930081ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49112e3f-73fc-4ee9-b48e-bcda5b7dcda7", "tag": "faa157e1-e76c-4be9-8480-61d19f273bad"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:52:23.290560 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-ed561409-5543-473d-a595-fa074206fd37 req-832238ac-aea3-4b58-9884-4107930081ff service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:23.291077 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-ed561409-5543-473d-a595-fa074206fd37 req-832238ac-aea3-4b58-9884-4107930081ff service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:23.293153 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-ed561409-5543-473d-a595-fa074206fd37 req-832238ac-aea3-4b58-9884-4107930081ff service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:23.317804 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-ed561409-5543-473d-a595-fa074206fd37 req-832238ac-aea3-4b58-9884-4107930081ff service nova] Creating event network-changed:faa157e1-e76c-4be9-8480-61d19f273bad for instance 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 on n-h2-846463-3 Sep 23 04:52:23.336197 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-ed561409-5543-473d-a595-fa074206fd37 req-832238ac-aea3-4b58-9884-4107930081ff service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108452 Sep 23 04:52:23.340458 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2418/4702] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:52:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:52:23.511743 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8ca2674b-73e9-4fdb-b5ed-a19cea5eb4f5 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:23.524803 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8ca2674b-73e9-4fdb-b5ed-a19cea5eb4f5 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:23.526388 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8ca2674b-73e9-4fdb-b5ed-a19cea5eb4f5 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:23.528006 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8ca2674b-73e9-4fdb-b5ed-a19cea5eb4f5 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] 10.222.0.33 "GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7" status: 200 len: 1878 microversion: 2.32 time: 0.655962 Sep 23 04:52:23.529502 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2285/4703] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:52:22 2022] GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 => generated 1878 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:52:23.566569 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-79ea8c5c-dc6b-45e2-ba8d-73fabb908db8 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:23.567270 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-79ea8c5c-dc6b-45e2-ba8d-73fabb908db8 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: f285e256-0a0e-4126-8adf-643bd59ca141] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:23.573546 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-79ea8c5c-dc6b-45e2-ba8d-73fabb908db8 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:23.574110 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-79ea8c5c-dc6b-45e2-ba8d-73fabb908db8 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:23.574551 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-79ea8c5c-dc6b-45e2-ba8d-73fabb908db8 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:23.575249 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-79ea8c5c-dc6b-45e2-ba8d-73fabb908db8 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:23.576219 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-79ea8c5c-dc6b-45e2-ba8d-73fabb908db8 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:23.578947 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-79ea8c5c-dc6b-45e2-ba8d-73fabb908db8 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:23.686756 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d9613858-9773-4d5f-81fd-52f7158dca49 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:23.687389 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d9613858-9773-4d5f-81fd-52f7158dca49 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:23.695468 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d9613858-9773-4d5f-81fd-52f7158dca49 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:23.695968 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d9613858-9773-4d5f-81fd-52f7158dca49 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:23.696408 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d9613858-9773-4d5f-81fd-52f7158dca49 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:23.700002 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d9613858-9773-4d5f-81fd-52f7158dca49 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:23.700002 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d9613858-9773-4d5f-81fd-52f7158dca49 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:23.710090 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d9613858-9773-4d5f-81fd-52f7158dca49 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:24.012729 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-79ea8c5c-dc6b-45e2-ba8d-73fabb908db8 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:24.027271 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-79ea8c5c-dc6b-45e2-ba8d-73fabb908db8 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:24.029574 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-79ea8c5c-dc6b-45e2-ba8d-73fabb908db8 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:24.031070 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-79ea8c5c-dc6b-45e2-ba8d-73fabb908db8 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141" status: 200 len: 1740 microversion: 2.20 time: 0.468867 Sep 23 04:52:24.034952 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2419/4704] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:52:23 2022] GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141 => generated 1740 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:52:24.040075 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5277dcd8-1357-4361-8bae-4a206e26173d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:24.043048 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-5277dcd8-1357-4361-8bae-4a206e26173d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:24.053594 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5277dcd8-1357-4361-8bae-4a206e26173d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:24.054941 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5277dcd8-1357-4361-8bae-4a206e26173d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:24.055562 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5277dcd8-1357-4361-8bae-4a206e26173d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:24.056457 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5277dcd8-1357-4361-8bae-4a206e26173d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:24.057093 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5277dcd8-1357-4361-8bae-4a206e26173d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:24.057691 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5277dcd8-1357-4361-8bae-4a206e26173d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:24.568721 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-5277dcd8-1357-4361-8bae-4a206e26173d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:24.579840 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5277dcd8-1357-4361-8bae-4a206e26173d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b" status: 200 len: 1275 microversion: 2.1 time: 0.543507 Sep 23 04:52:24.585705 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2420/4705] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:24 2022] GET /compute/v2.1/servers/c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b => generated 1275 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:52:24.589547 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4ac4c2b3-c14a-4c5b-a813-a87c22b98b3a tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:24.590454 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4ac4c2b3-c14a-4c5b-a813-a87c22b98b3a tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] [instance: 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:24.604928 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4ac4c2b3-c14a-4c5b-a813-a87c22b98b3a tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:24.609305 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4ac4c2b3-c14a-4c5b-a813-a87c22b98b3a tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:24.610586 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4ac4c2b3-c14a-4c5b-a813-a87c22b98b3a tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:24.615289 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4ac4c2b3-c14a-4c5b-a813-a87c22b98b3a tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:24.616024 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4ac4c2b3-c14a-4c5b-a813-a87c22b98b3a tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:24.616666 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4ac4c2b3-c14a-4c5b-a813-a87c22b98b3a tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:24.798377 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d9613858-9773-4d5f-81fd-52f7158dca49 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:24.813063 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d9613858-9773-4d5f-81fd-52f7158dca49 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1516 microversion: 2.1 time: 1.129991 Sep 23 04:52:24.816289 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2286/4706] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:23 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1516 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:52:24.828049 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-1edfb560-15c7-4574-9669-d1509087fc1d req-43a385a0-6078-40bf-ab57-fa5736578ea5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f285e256-0a0e-4126-8adf-643bd59ca141", "name": "network-vif-plugged", "status": "completed", "tag": "e29f5caa-b337-40d1-9780-77215617f3ce"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:52:24.879565 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-1edfb560-15c7-4574-9669-d1509087fc1d req-43a385a0-6078-40bf-ab57-fa5736578ea5 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:24.881498 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-1edfb560-15c7-4574-9669-d1509087fc1d req-43a385a0-6078-40bf-ab57-fa5736578ea5 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:24.883466 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-1edfb560-15c7-4574-9669-d1509087fc1d req-43a385a0-6078-40bf-ab57-fa5736578ea5 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:24.933825 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-1edfb560-15c7-4574-9669-d1509087fc1d req-43a385a0-6078-40bf-ab57-fa5736578ea5 service nova] Creating event network-vif-plugged:e29f5caa-b337-40d1-9780-77215617f3ce for instance f285e256-0a0e-4126-8adf-643bd59ca141 on n-h1-846463-3 Sep 23 04:52:24.946902 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-1edfb560-15c7-4574-9669-d1509087fc1d req-43a385a0-6078-40bf-ab57-fa5736578ea5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127408 Sep 23 04:52:24.954868 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2287/4707] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:52:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:52:25.069790 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-38c52a75-183d-4c4a-a7f9-ee9954f4a08e tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:25.070859 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-38c52a75-183d-4c4a-a7f9-ee9954f4a08e tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: f285e256-0a0e-4126-8adf-643bd59ca141] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:25.101211 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-38c52a75-183d-4c4a-a7f9-ee9954f4a08e tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:25.104057 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-38c52a75-183d-4c4a-a7f9-ee9954f4a08e tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:25.105429 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-38c52a75-183d-4c4a-a7f9-ee9954f4a08e tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:25.107763 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-38c52a75-183d-4c4a-a7f9-ee9954f4a08e tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:25.107763 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-38c52a75-183d-4c4a-a7f9-ee9954f4a08e tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:25.108166 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-38c52a75-183d-4c4a-a7f9-ee9954f4a08e tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:25.151286 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-4ac4c2b3-c14a-4c5b-a813-a87c22b98b3a tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:25.168626 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-4ac4c2b3-c14a-4c5b-a813-a87c22b98b3a tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:25.182742 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-4ac4c2b3-c14a-4c5b-a813-a87c22b98b3a tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:25.193266 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4ac4c2b3-c14a-4c5b-a813-a87c22b98b3a tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] 10.222.0.33 "GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7" status: 200 len: 1878 microversion: 2.32 time: 0.607891 Sep 23 04:52:25.225490 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2421/4708] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:52:24 2022] GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 => generated 1878 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:52:25.548708 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-38c52a75-183d-4c4a-a7f9-ee9954f4a08e tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:25.548708 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-38c52a75-183d-4c4a-a7f9-ee9954f4a08e tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:25.548708 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-38c52a75-183d-4c4a-a7f9-ee9954f4a08e tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:25.548708 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-38c52a75-183d-4c4a-a7f9-ee9954f4a08e tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141" status: 200 len: 1740 microversion: 2.20 time: 0.447218 Sep 23 04:52:25.548708 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2288/4709] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:52:25 2022] GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141 => generated 1740 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:52:25.607755 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2a8af6e2-a2a4-4040-b847-da214b9fb1fc tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:25.609979 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-2a8af6e2-a2a4-4040-b847-da214b9fb1fc tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:25.628169 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2a8af6e2-a2a4-4040-b847-da214b9fb1fc tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:25.629356 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2a8af6e2-a2a4-4040-b847-da214b9fb1fc tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:25.634260 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2a8af6e2-a2a4-4040-b847-da214b9fb1fc tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:25.636313 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2a8af6e2-a2a4-4040-b847-da214b9fb1fc tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:25.637035 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2a8af6e2-a2a4-4040-b847-da214b9fb1fc tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:25.637717 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2a8af6e2-a2a4-4040-b847-da214b9fb1fc tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:25.842005 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ee5ddc2f-d059-4f05-a4ab-fb9ce118436d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:25.844669 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-ee5ddc2f-d059-4f05-a4ab-fb9ce118436d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:25.865386 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ee5ddc2f-d059-4f05-a4ab-fb9ce118436d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:25.865927 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ee5ddc2f-d059-4f05-a4ab-fb9ce118436d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:25.866377 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ee5ddc2f-d059-4f05-a4ab-fb9ce118436d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:25.867113 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ee5ddc2f-d059-4f05-a4ab-fb9ce118436d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:25.867583 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ee5ddc2f-d059-4f05-a4ab-fb9ce118436d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:25.868020 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ee5ddc2f-d059-4f05-a4ab-fb9ce118436d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:26.271923 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2a8af6e2-a2a4-4040-b847-da214b9fb1fc tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:26.300376 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2a8af6e2-a2a4-4040-b847-da214b9fb1fc tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b" status: 200 len: 1317 microversion: 2.1 time: 0.697261 Sep 23 04:52:26.307056 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2422/4710] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:25 2022] GET /compute/v2.1/servers/c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b => generated 1317 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:52:26.332402 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f57e3fff-998e-4d45-ae43-8870b017d635 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:26.338855 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f57e3fff-998e-4d45-ae43-8870b017d635 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] [instance: 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:26.364535 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f57e3fff-998e-4d45-ae43-8870b017d635 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:26.365130 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f57e3fff-998e-4d45-ae43-8870b017d635 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:26.365776 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f57e3fff-998e-4d45-ae43-8870b017d635 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:26.366732 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f57e3fff-998e-4d45-ae43-8870b017d635 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:26.367198 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f57e3fff-998e-4d45-ae43-8870b017d635 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:26.368819 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f57e3fff-998e-4d45-ae43-8870b017d635 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:26.654168 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ee5ddc2f-d059-4f05-a4ab-fb9ce118436d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:26.671742 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ee5ddc2f-d059-4f05-a4ab-fb9ce118436d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1516 microversion: 2.1 time: 0.834872 Sep 23 04:52:26.682657 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2289/4711] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:25 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1516 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:52:26.703382 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f57e3fff-998e-4d45-ae43-8870b017d635 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:26.730694 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3d9d97b0-0725-4a2d-b826-de04a36be939 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:26.740950 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3d9d97b0-0725-4a2d-b826-de04a36be939 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: f285e256-0a0e-4126-8adf-643bd59ca141] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:26.748639 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f57e3fff-998e-4d45-ae43-8870b017d635 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:26.753864 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f57e3fff-998e-4d45-ae43-8870b017d635 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:26.763930 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f57e3fff-998e-4d45-ae43-8870b017d635 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] 10.222.0.33 "GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7" status: 200 len: 1878 microversion: 2.32 time: 0.448767 Sep 23 04:52:26.767546 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2423/4712] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:52:26 2022] GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 => generated 1878 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:52:26.769138 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3d9d97b0-0725-4a2d-b826-de04a36be939 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:26.774570 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3d9d97b0-0725-4a2d-b826-de04a36be939 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:26.775288 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3d9d97b0-0725-4a2d-b826-de04a36be939 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:26.776938 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3d9d97b0-0725-4a2d-b826-de04a36be939 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:26.779487 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3d9d97b0-0725-4a2d-b826-de04a36be939 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:26.781509 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3d9d97b0-0725-4a2d-b826-de04a36be939 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:27.158738 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-3d9d97b0-0725-4a2d-b826-de04a36be939 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:27.178429 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-3d9d97b0-0725-4a2d-b826-de04a36be939 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:27.183823 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-3d9d97b0-0725-4a2d-b826-de04a36be939 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:27.187749 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3d9d97b0-0725-4a2d-b826-de04a36be939 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141" status: 200 len: 1740 microversion: 2.20 time: 0.503248 Sep 23 04:52:27.190064 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2290/4713] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:52:26 2022] GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141 => generated 1740 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:52:27.331303 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-619f99ac-0c74-4241-895e-a19f46f8ce9b tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:27.332249 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-619f99ac-0c74-4241-895e-a19f46f8ce9b tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:27.353284 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-619f99ac-0c74-4241-895e-a19f46f8ce9b tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:27.353801 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-619f99ac-0c74-4241-895e-a19f46f8ce9b tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:27.354277 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-619f99ac-0c74-4241-895e-a19f46f8ce9b tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:27.355016 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-619f99ac-0c74-4241-895e-a19f46f8ce9b tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:27.369612 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-619f99ac-0c74-4241-895e-a19f46f8ce9b tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:27.369612 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-619f99ac-0c74-4241-895e-a19f46f8ce9b tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:27.676729 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-619f99ac-0c74-4241-895e-a19f46f8ce9b tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:27.686678 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-619f99ac-0c74-4241-895e-a19f46f8ce9b tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b" status: 200 len: 1317 microversion: 2.1 time: 0.360577 Sep 23 04:52:27.702619 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2424/4714] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:27 2022] GET /compute/v2.1/servers/c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b => generated 1317 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:52:27.710299 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9269af3a-b8c7-454a-8505-4cb26c2b3d3c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:27.711153 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-9269af3a-b8c7-454a-8505-4cb26c2b3d3c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:27.726874 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9269af3a-b8c7-454a-8505-4cb26c2b3d3c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:27.727397 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9269af3a-b8c7-454a-8505-4cb26c2b3d3c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:27.727833 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9269af3a-b8c7-454a-8505-4cb26c2b3d3c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:27.728605 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9269af3a-b8c7-454a-8505-4cb26c2b3d3c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:27.729101 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9269af3a-b8c7-454a-8505-4cb26c2b3d3c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:27.729530 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9269af3a-b8c7-454a-8505-4cb26c2b3d3c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:27.794403 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-75748cea-057a-4fb2-8d87-8cd59087e397 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:27.795020 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-75748cea-057a-4fb2-8d87-8cd59087e397 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] [instance: 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:27.805083 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-75748cea-057a-4fb2-8d87-8cd59087e397 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:27.815398 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-75748cea-057a-4fb2-8d87-8cd59087e397 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:27.817604 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-75748cea-057a-4fb2-8d87-8cd59087e397 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:27.817604 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-75748cea-057a-4fb2-8d87-8cd59087e397 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:27.817604 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-75748cea-057a-4fb2-8d87-8cd59087e397 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:27.817604 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-75748cea-057a-4fb2-8d87-8cd59087e397 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:28.326757 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:52:28.364960 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=6 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:52:28.434463 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-75748cea-057a-4fb2-8d87-8cd59087e397 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:28.456326 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-75748cea-057a-4fb2-8d87-8cd59087e397 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:28.459162 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-75748cea-057a-4fb2-8d87-8cd59087e397 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:28.460600 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-75748cea-057a-4fb2-8d87-8cd59087e397 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] 10.222.0.33 "GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7" status: 200 len: 1878 microversion: 2.32 time: 0.670174 Sep 23 04:52:28.461441 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2425/4715] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:52:27 2022] GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 => generated 1878 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:52:28.468402 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-84c28d61-bccd-4c10-ade0-75f5c6160fc1 req-619d6999-e8df-41fb-b13e-83dd03002e2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b", "tag": "2d1ed940-5eb5-4eff-9020-37f2f21a3613"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:52:28.486853 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-84c28d61-bccd-4c10-ade0-75f5c6160fc1 req-619d6999-e8df-41fb-b13e-83dd03002e2e service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:28.492314 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-84c28d61-bccd-4c10-ade0-75f5c6160fc1 req-619d6999-e8df-41fb-b13e-83dd03002e2e service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:28.492314 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-84c28d61-bccd-4c10-ade0-75f5c6160fc1 req-619d6999-e8df-41fb-b13e-83dd03002e2e service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:28.520225 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=100 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:52:28.527505 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-84c28d61-bccd-4c10-ade0-75f5c6160fc1 req-619d6999-e8df-41fb-b13e-83dd03002e2e service nova] Creating event network-changed:2d1ed940-5eb5-4eff-9020-37f2f21a3613 for instance c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b on n-h1-846463-3 Sep 23 04:52:28.538142 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-84c28d61-bccd-4c10-ade0-75f5c6160fc1 req-619d6999-e8df-41fb-b13e-83dd03002e2e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075095 Sep 23 04:52:28.544798 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2426/4716] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:52:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:52:28.545029 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-9269af3a-b8c7-454a-8505-4cb26c2b3d3c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:28.554236 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f85a1651-3268-461b-967a-fe64d0099300 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:28.556546 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9269af3a-b8c7-454a-8505-4cb26c2b3d3c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1503 microversion: 2.1 time: 0.849992 Sep 23 04:52:28.557046 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f85a1651-3268-461b-967a-fe64d0099300 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: f285e256-0a0e-4126-8adf-643bd59ca141] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:28.571593 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f85a1651-3268-461b-967a-fe64d0099300 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:28.572119 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f85a1651-3268-461b-967a-fe64d0099300 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:28.572656 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f85a1651-3268-461b-967a-fe64d0099300 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:28.573284 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f85a1651-3268-461b-967a-fe64d0099300 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:28.573752 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f85a1651-3268-461b-967a-fe64d0099300 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:28.578774 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f85a1651-3268-461b-967a-fe64d0099300 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:28.578887 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2291/4717] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:27 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1503 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:52:28.587836 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ae1c1439-bec5-4593-8735-204bdc0d4818 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:28.588495 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-ae1c1439-bec5-4593-8735-204bdc0d4818 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:28.597242 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ae1c1439-bec5-4593-8735-204bdc0d4818 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:28.598087 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ae1c1439-bec5-4593-8735-204bdc0d4818 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:28.598686 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ae1c1439-bec5-4593-8735-204bdc0d4818 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:28.600474 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ae1c1439-bec5-4593-8735-204bdc0d4818 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:28.605129 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ae1c1439-bec5-4593-8735-204bdc0d4818 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:28.607556 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ae1c1439-bec5-4593-8735-204bdc0d4818 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:28.975513 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f85a1651-3268-461b-967a-fe64d0099300 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:28.990412 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f85a1651-3268-461b-967a-fe64d0099300 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:28.996216 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f85a1651-3268-461b-967a-fe64d0099300 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:29.007526 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f85a1651-3268-461b-967a-fe64d0099300 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141" status: 200 len: 1740 microversion: 2.20 time: 0.462060 Sep 23 04:52:29.008487 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2427/4718] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:52:28 2022] GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141 => generated 1740 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:52:29.029092 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:52:29.029650 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7801f0bf-deb6-4ce5-823c-6eee7b450f75 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:29.030545 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-7801f0bf-deb6-4ce5-823c-6eee7b450f75 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:29.041981 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7801f0bf-deb6-4ce5-823c-6eee7b450f75 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:29.043000 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7801f0bf-deb6-4ce5-823c-6eee7b450f75 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:29.043846 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7801f0bf-deb6-4ce5-823c-6eee7b450f75 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:29.051095 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7801f0bf-deb6-4ce5-823c-6eee7b450f75 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:29.052057 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7801f0bf-deb6-4ce5-823c-6eee7b450f75 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:29.056509 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7801f0bf-deb6-4ce5-823c-6eee7b450f75 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:29.069216 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ae1c1439-bec5-4593-8735-204bdc0d4818 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:29.077179 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ae1c1439-bec5-4593-8735-204bdc0d4818 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1503 microversion: 2.1 time: 0.497283 Sep 23 04:52:29.080972 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2292/4719] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:28 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1503 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:52:29.109558 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e05f7105-a664-44ce-97b8-379a23390da4 tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:29.123593 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e05f7105-a664-44ce-97b8-379a23390da4 tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '923fa0e0e08047a484ff0e129afaf09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e5e00bee244ee973df9124e15068b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:29.124394 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e05f7105-a664-44ce-97b8-379a23390da4 tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Searching by: {'deleted': False, 'project_id': '598e5e00bee244ee973df9124e15068b'} {{(pid=122698) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 04:52:29.135822 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e05f7105-a664-44ce-97b8-379a23390da4 tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:29.142797 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e05f7105-a664-44ce-97b8-379a23390da4 tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:29.143799 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e05f7105-a664-44ce-97b8-379a23390da4 tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:29.144953 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e05f7105-a664-44ce-97b8-379a23390da4 tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:29.145443 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e05f7105-a664-44ce-97b8-379a23390da4 tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:29.145877 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e05f7105-a664-44ce-97b8-379a23390da4 tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:29.185842 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.multi_cell_list [None req-e05f7105-a664-44ce-97b8-379a23390da4 tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122698) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 23 04:52:29.222905 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e05f7105-a664-44ce-97b8-379a23390da4 tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 339 microversion: 2.1 time: 0.140640 Sep 23 04:52:29.225204 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2293/4720] 10.222.0.33 () {58 vars in 1125 bytes} [Fri Sep 23 04:52:29 2022] GET /compute/v2.1/servers => generated 339 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:52:29.230819 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-fff9bdfb-81ff-4f3d-8728-632aed02f587 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:29.231679 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-fff9bdfb-81ff-4f3d-8728-632aed02f587 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:29.242921 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fff9bdfb-81ff-4f3d-8728-632aed02f587 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:29.243946 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fff9bdfb-81ff-4f3d-8728-632aed02f587 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:29.244683 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fff9bdfb-81ff-4f3d-8728-632aed02f587 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:29.245642 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fff9bdfb-81ff-4f3d-8728-632aed02f587 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:29.246306 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fff9bdfb-81ff-4f3d-8728-632aed02f587 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:29.246895 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fff9bdfb-81ff-4f3d-8728-632aed02f587 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:29.413856 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-7801f0bf-deb6-4ce5-823c-6eee7b450f75 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:29.423108 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-7801f0bf-deb6-4ce5-823c-6eee7b450f75 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b" status: 200 len: 1317 microversion: 2.1 time: 0.412096 Sep 23 04:52:29.438058 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2428/4721] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:29 2022] GET /compute/v2.1/servers/c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b => generated 1317 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:52:29.444213 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3c13aa4f-f9b3-4b87-9d2e-9147c5ba9a53 tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:29.450268 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-3c13aa4f-f9b3-4b87-9d2e-9147c5ba9a53 tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '923fa0e0e08047a484ff0e129afaf09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e5e00bee244ee973df9124e15068b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:29.451719 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-3c13aa4f-f9b3-4b87-9d2e-9147c5ba9a53 tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Searching by: {'deleted': False, 'project_id': '598e5e00bee244ee973df9124e15068b'} {{(pid=122699) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 04:52:29.457630 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3c13aa4f-f9b3-4b87-9d2e-9147c5ba9a53 tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:29.458392 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3c13aa4f-f9b3-4b87-9d2e-9147c5ba9a53 tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:29.459153 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3c13aa4f-f9b3-4b87-9d2e-9147c5ba9a53 tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:29.460051 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3c13aa4f-f9b3-4b87-9d2e-9147c5ba9a53 tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:29.460690 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3c13aa4f-f9b3-4b87-9d2e-9147c5ba9a53 tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:29.461131 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3c13aa4f-f9b3-4b87-9d2e-9147c5ba9a53 tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:29.492335 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-fff9bdfb-81ff-4f3d-8728-632aed02f587 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:29.495859 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.multi_cell_list [None req-3c13aa4f-f9b3-4b87-9d2e-9147c5ba9a53 tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122699) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 23 04:52:29.504234 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-fff9bdfb-81ff-4f3d-8728-632aed02f587 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1503 microversion: 2.1 time: 0.277356 Sep 23 04:52:29.515722 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2294/4722] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:29 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1503 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:52:29.520183 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f9c70903-d358-4a58-85b8-ce9e31a26699 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:29.520805 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f9c70903-d358-4a58-85b8-ce9e31a26699 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] [instance: 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:29.539738 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f9c70903-d358-4a58-85b8-ce9e31a26699 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:29.539738 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f9c70903-d358-4a58-85b8-ce9e31a26699 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:29.539738 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f9c70903-d358-4a58-85b8-ce9e31a26699 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:29.539738 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f9c70903-d358-4a58-85b8-ce9e31a26699 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:29.539738 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f9c70903-d358-4a58-85b8-ce9e31a26699 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:29.539738 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f9c70903-d358-4a58-85b8-ce9e31a26699 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:29.584895 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-3c13aa4f-f9b3-4b87-9d2e-9147c5ba9a53 tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923fa0e0e08047a484ff0e129afaf09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e5e00bee244ee973df9124e15068b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:29.616067 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3c13aa4f-f9b3-4b87-9d2e-9147c5ba9a53 tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:29.626204 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3c13aa4f-f9b3-4b87-9d2e-9147c5ba9a53 tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:29.626789 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3c13aa4f-f9b3-4b87-9d2e-9147c5ba9a53 tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:29.886013 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3c13aa4f-f9b3-4b87-9d2e-9147c5ba9a53 tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] 10.222.0.33 "GET /compute/v2.1/servers/detail" status: 200 len: 1710 microversion: 2.1 time: 0.446122 Sep 23 04:52:29.886778 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2429/4723] 10.222.0.33 () {58 vars in 1146 bytes} [Fri Sep 23 04:52:29 2022] GET /compute/v2.1/servers/detail => generated 1710 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:52:29.892720 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f9c70903-d358-4a58-85b8-ce9e31a26699 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:29.906678 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f9c70903-d358-4a58-85b8-ce9e31a26699 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:29.907956 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-383d05bc-5672-4e4e-bdd8-14c1e3507f3e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:52:29.909151 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f9c70903-d358-4a58-85b8-ce9e31a26699 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:29.910399 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f9c70903-d358-4a58-85b8-ce9e31a26699 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] 10.222.0.33 "GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7" status: 200 len: 1878 microversion: 2.32 time: 0.401613 Sep 23 04:52:29.911159 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2295/4724] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:52:29 2022] GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 => generated 1878 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:52:29.915532 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-383d05bc-5672-4e4e-bdd8-14c1e3507f3e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] HTTP exception thrown: Instance 42774af5-b441-4dbf-b4a3-b34f2825e566 has no mapping to a cell. Sep 23 04:52:29.919321 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6ed82831-cb43-4e1b-b3be-d6ef56e25159 tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:29.927351 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-6ed82831-cb43-4e1b-b3be-d6ef56e25159 tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.011778 Sep 23 04:52:29.928227 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2296/4725] 10.222.0.33 () {58 vars in 1137 bytes} [Fri Sep 23 04:52:29 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:52:29.945398 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-383d05bc-5672-4e4e-bdd8-14c1e3507f3e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Request method failure captured: Sep 23 04:52:29.945398 n-d-846463-3 devstack@n-api.service[122699]: request: POST /compute/v2.1/servers/42774af5-b441-4dbf-b4a3-b34f2825e566/action HTTP/1.1 Sep 23 04:52:29.945398 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:52:29.945398 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:52:29.945398 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:52:29.945398 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 15 Sep 23 04:52:29.945398 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:52:29.945398 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:52:29.945398 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:52:29.945398 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:52:29.945398 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTrDoGx96bSja4ydTGD-VWXTOyHeLiBA9Lvr197ivKeXqtV3OksEUUEiEPXK85IMwWXM1vCTp1M9PaXnUkKbFev29d-fL5KKXR0MfyGa86SLKINg6u_gn5EQLUNZ8EVLCkU1WwJ7agpVlFY75EyJH0fBcxrNg1yvFbeC2alzdH4Tkmw Sep 23 04:52:29.945398 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:52:29.945398 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:52:29.945398 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:52:29.945398 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:52:29.945398 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:52:29.945398 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:52:29.945398 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 78dca47156ff4f19a8673b893c853978 Sep 23 04:52:29.945398 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:52:29.945398 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:52:29.945398 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:52:29.945398 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_78dca47156ff4f19a8673b893c853978", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/78dca47156ff4f19a8673b893c853978"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/78dca47156ff4f19a8673b893c853978"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/78dca47156ff4f19a8673b893c853978"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:52:29.945398 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:52:29.945398 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 78dca47156ff4f19a8673b893c853978 Sep 23 04:52:29.945398 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:52:29.945398 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ServersNegativeTestJSON-1102187211-project Sep 23 04:52:29.945398 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:52:29.945398 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:52:29.945398 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: c912fb9d1f5447d180a9e8568220526f Sep 23 04:52:29.945398 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ServersNegativeTestJSON-1102187211-project Sep 23 04:52:29.945398 n-d-846463-3 devstack@n-api.service[122699]: Sep 23 04:52:29.945398 n-d-846463-3 devstack@n-api.service[122699]: {"os-stop": {}} Sep 23 04:52:29.945398 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:52:29.945398 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 42774af5-b441-4dbf-b4a3-b34f2825e566 has no mapping to a cell. Sep 23 04:52:29.945398 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '42774af5-b441-4dbf-b4a3-b34f2825e566', 'body': {'os-stop': {}}} Sep 23 04:52:29.945398 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:52:29.945398 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:52:29.945398 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1411, in _get_instance Sep 23 04:52:29.945398 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Sep 23 04:52:29.945398 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 04:52:29.945398 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 04:52:29.945398 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Sep 23 04:52:29.945398 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Sep 23 04:52:29.945398 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 23 04:52:29.945398 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 23 04:52:29.945398 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Sep 23 04:52:29.945398 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Sep 23 04:52:29.945398 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 42774af5-b441-4dbf-b4a3-b34f2825e566 has no mapping to a cell. Sep 23 04:52:29.945398 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:52:29.945398 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:52:29.945398 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:52:29.945398 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:52:29.945398 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:52:29.945398 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:52:29.945398 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:52:29.945398 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:52:29.945398 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:52:29.945398 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:52:29.945398 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1444, in _stop_server Sep 23 04:52:29.945398 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Sep 23 04:52:29.945398 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1418, in _get_instance Sep 23 04:52:29.945398 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:52:29.945398 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42774af5-b441-4dbf-b4a3-b34f2825e566 has no mapping to a cell. Sep 23 04:52:29.951411 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:52:29.951411 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:52:29.951411 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:52:29.951411 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:52:29.951411 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:52:29.951411 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:52:29.951411 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:52:29.951411 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:52:29.951411 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42774af5-b441-4dbf-b4a3-b34f2825e566 has no mapping to a cell. Sep 23 04:52:29.951411 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:52:29.951411 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-383d05bc-5672-4e4e-bdd8-14c1e3507f3e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Returning 404 to user: Instance 42774af5-b441-4dbf-b4a3-b34f2825e566 has no mapping to a cell. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:52:29.951411 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-383d05bc-5672-4e4e-bdd8-14c1e3507f3e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "POST /compute/v2.1/servers/42774af5-b441-4dbf-b4a3-b34f2825e566/action" status: 404 len: 117 microversion: 2.1 time: 0.059129 Sep 23 04:52:29.951411 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2430/4726] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:52:29 2022] POST /compute/v2.1/servers/42774af5-b441-4dbf-b4a3-b34f2825e566/action => generated 117 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:52:29.956977 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-db55b1bd-fe6c-43bb-826a-45209aa10e9e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:29.957632 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-db55b1bd-fe6c-43bb-826a-45209aa10e9e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:29.965023 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-db55b1bd-fe6c-43bb-826a-45209aa10e9e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:29.965555 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-db55b1bd-fe6c-43bb-826a-45209aa10e9e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:29.966097 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-db55b1bd-fe6c-43bb-826a-45209aa10e9e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:29.966817 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-db55b1bd-fe6c-43bb-826a-45209aa10e9e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:29.967321 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-db55b1bd-fe6c-43bb-826a-45209aa10e9e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:29.967815 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-db55b1bd-fe6c-43bb-826a-45209aa10e9e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:30.038723 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e6b2a544-49b7-4a58-b611-5f0ec24b7cad tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:30.039346 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e6b2a544-49b7-4a58-b611-5f0ec24b7cad tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: f285e256-0a0e-4126-8adf-643bd59ca141] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:30.047149 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e6b2a544-49b7-4a58-b611-5f0ec24b7cad tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:30.047899 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e6b2a544-49b7-4a58-b611-5f0ec24b7cad tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:30.048562 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e6b2a544-49b7-4a58-b611-5f0ec24b7cad tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:30.050565 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e6b2a544-49b7-4a58-b611-5f0ec24b7cad tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:30.051058 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e6b2a544-49b7-4a58-b611-5f0ec24b7cad tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:30.052062 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e6b2a544-49b7-4a58-b611-5f0ec24b7cad tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:30.153741 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-db55b1bd-fe6c-43bb-826a-45209aa10e9e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:30.165366 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-db55b1bd-fe6c-43bb-826a-45209aa10e9e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1503 microversion: 2.1 time: 0.212346 Sep 23 04:52:30.177588 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2297/4727] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:29 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1503 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:52:30.203416 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8ee5994b-788c-4266-b4c1-12834c204bdc tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:30.204079 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8ee5994b-788c-4266-b4c1-12834c204bdc tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:30.227762 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8ee5994b-788c-4266-b4c1-12834c204bdc tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:30.228724 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8ee5994b-788c-4266-b4c1-12834c204bdc tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:30.229355 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8ee5994b-788c-4266-b4c1-12834c204bdc tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:30.230266 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8ee5994b-788c-4266-b4c1-12834c204bdc tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:30.230894 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8ee5994b-788c-4266-b4c1-12834c204bdc tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:30.231679 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8ee5994b-788c-4266-b4c1-12834c204bdc tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:30.236321 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=100 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:52:30.445343 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8ee5994b-788c-4266-b4c1-12834c204bdc tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:30.454132 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8ee5994b-788c-4266-b4c1-12834c204bdc tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1503 microversion: 2.1 time: 0.255086 Sep 23 04:52:30.454716 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2298/4728] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:30 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1503 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:52:30.461682 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e6b2a544-49b7-4a58-b611-5f0ec24b7cad tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:30.470330 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e6b2a544-49b7-4a58-b611-5f0ec24b7cad tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:30.476991 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6647dd4c-7423-45a8-82f3-b4c55f23638c tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:30.477931 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e6b2a544-49b7-4a58-b611-5f0ec24b7cad tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:30.479147 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e6b2a544-49b7-4a58-b611-5f0ec24b7cad tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141" status: 200 len: 1740 microversion: 2.20 time: 0.445935 Sep 23 04:52:30.479708 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2431/4729] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:52:30 2022] GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141 => generated 1740 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:52:30.480379 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-6647dd4c-7423-45a8-82f3-b4c55f23638c tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] [instance: 60bc9648-12d2-4db3-baf8-634b739c15f5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:30.489276 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a5be64f4-d2fa-4802-8d06-d445ab130998 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:30.489902 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a5be64f4-d2fa-4802-8d06-d445ab130998 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:30.498478 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6647dd4c-7423-45a8-82f3-b4c55f23638c tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:30.499229 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6647dd4c-7423-45a8-82f3-b4c55f23638c tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:30.499406 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6647dd4c-7423-45a8-82f3-b4c55f23638c tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:30.502233 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6647dd4c-7423-45a8-82f3-b4c55f23638c tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:30.503032 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6647dd4c-7423-45a8-82f3-b4c55f23638c tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:30.504475 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6647dd4c-7423-45a8-82f3-b4c55f23638c tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:30.508838 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a5be64f4-d2fa-4802-8d06-d445ab130998 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:30.509329 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a5be64f4-d2fa-4802-8d06-d445ab130998 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:30.510053 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a5be64f4-d2fa-4802-8d06-d445ab130998 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:30.510753 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a5be64f4-d2fa-4802-8d06-d445ab130998 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:30.511207 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a5be64f4-d2fa-4802-8d06-d445ab130998 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:30.515643 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a5be64f4-d2fa-4802-8d06-d445ab130998 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:30.573319 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-6647dd4c-7423-45a8-82f3-b4c55f23638c tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] [instance: 60bc9648-12d2-4db3-baf8-634b739c15f5] Going to try to terminate instance {{(pid=122698) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:52:30.871044 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a5be64f4-d2fa-4802-8d06-d445ab130998 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:30.883105 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a5be64f4-d2fa-4802-8d06-d445ab130998 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b" status: 200 len: 1317 microversion: 2.1 time: 0.397158 Sep 23 04:52:30.884224 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2432/4730] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:30 2022] GET /compute/v2.1/servers/c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b => generated 1317 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:52:30.892549 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3477d874-9925-4603-a51f-3535c1b29fdd tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:52:30.899462 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-3477d874-9925-4603-a51f-3535c1b29fdd tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: 90709a36-9a7c-45c5-a498-6266c4b48df8] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:30.912076 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-3477d874-9925-4603-a51f-3535c1b29fdd tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] HTTP exception thrown: Instance 90709a36-9a7c-45c5-a498-6266c4b48df8 could not be found. Sep 23 04:52:30.914082 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3477d874-9925-4603-a51f-3535c1b29fdd tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Request method failure captured: Sep 23 04:52:30.914082 n-d-846463-3 devstack@n-api.service[122699]: request: POST /compute/v2.1/servers/90709a36-9a7c-45c5-a498-6266c4b48df8/action HTTP/1.1 Sep 23 04:52:30.914082 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:52:30.914082 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:52:30.914082 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:52:30.914082 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 15 Sep 23 04:52:30.914082 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:52:30.914082 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:52:30.914082 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:52:30.914082 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:52:30.914082 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTrDoGx96bSja4ydTGD-VWXTOyHeLiBA9Lvr197ivKeXqtV3OksEUUEiEPXK85IMwWXM1vCTp1M9PaXnUkKbFev29d-fL5KKXR0MfyGa86SLKINg6u_gn5EQLUNZ8EVLCkU1WwJ7agpVlFY75EyJH0fBcxrNg1yvFbeC2alzdH4Tkmw Sep 23 04:52:30.914082 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:52:30.914082 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:52:30.914082 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:52:30.914082 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:52:30.914082 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:52:30.914082 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:52:30.914082 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 78dca47156ff4f19a8673b893c853978 Sep 23 04:52:30.914082 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:52:30.914082 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:52:30.914082 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:52:30.914082 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_78dca47156ff4f19a8673b893c853978", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/78dca47156ff4f19a8673b893c853978"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/78dca47156ff4f19a8673b893c853978"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/78dca47156ff4f19a8673b893c853978"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:52:30.914082 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:52:30.914082 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 78dca47156ff4f19a8673b893c853978 Sep 23 04:52:30.914082 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:52:30.914082 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ServersNegativeTestJSON-1102187211-project Sep 23 04:52:30.914082 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:52:30.914082 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:52:30.914082 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: c912fb9d1f5447d180a9e8568220526f Sep 23 04:52:30.914082 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ServersNegativeTestJSON-1102187211-project Sep 23 04:52:30.914082 n-d-846463-3 devstack@n-api.service[122699]: Sep 23 04:52:30.914082 n-d-846463-3 devstack@n-api.service[122699]: {"suspend": {}} Sep 23 04:52:30.914082 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:52:30.914082 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 90709a36-9a7c-45c5-a498-6266c4b48df8 could not be found. Sep 23 04:52:30.914082 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '90709a36-9a7c-45c5-a498-6266c4b48df8', 'body': {'suspend': {}}} Sep 23 04:52:30.914082 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:52:30.914082 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:52:30.914082 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:52:30.914082 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:52:30.914082 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:52:30.914082 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:52:30.914082 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 23 04:52:30.914082 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 23 04:52:30.914082 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90709a36-9a7c-45c5-a498-6266c4b48df8 could not be found. Sep 23 04:52:30.914082 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:52:30.914082 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:52:30.914082 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:52:30.914082 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:52:30.914082 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:52:30.914082 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:52:30.914082 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:52:30.914082 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:52:30.914082 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:52:30.914082 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:52:30.914082 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Sep 23 04:52:30.914082 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Sep 23 04:52:30.914082 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:52:30.914082 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:52:30.914082 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90709a36-9a7c-45c5-a498-6266c4b48df8 could not be found. Sep 23 04:52:30.914082 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:52:30.914082 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:52:30.914082 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:52:30.914082 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:52:30.914082 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:52:30.914082 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:52:30.918199 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:52:30.918199 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:52:30.918199 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90709a36-9a7c-45c5-a498-6266c4b48df8 could not be found. Sep 23 04:52:30.918199 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:52:30.925512 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3477d874-9925-4603-a51f-3535c1b29fdd tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Returning 404 to user: Instance 90709a36-9a7c-45c5-a498-6266c4b48df8 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:52:30.926723 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3477d874-9925-4603-a51f-3535c1b29fdd tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "POST /compute/v2.1/servers/90709a36-9a7c-45c5-a498-6266c4b48df8/action" status: 404 len: 111 microversion: 2.1 time: 0.040982 Sep 23 04:52:30.927473 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2433/4731] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:52:30 2022] POST /compute/v2.1/servers/90709a36-9a7c-45c5-a498-6266c4b48df8/action => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:52:30.935846 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c1845185-db7a-4cdb-8860-23cc9ae46585 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:30.937546 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c1845185-db7a-4cdb-8860-23cc9ae46585 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:30.950261 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c1845185-db7a-4cdb-8860-23cc9ae46585 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:30.955630 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c1845185-db7a-4cdb-8860-23cc9ae46585 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:30.960256 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c1845185-db7a-4cdb-8860-23cc9ae46585 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:30.960256 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c1845185-db7a-4cdb-8860-23cc9ae46585 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:30.961000 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c1845185-db7a-4cdb-8860-23cc9ae46585 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:30.961670 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c1845185-db7a-4cdb-8860-23cc9ae46585 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:31.014170 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-6647dd4c-7423-45a8-82f3-b4c55f23638c tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] 10.222.0.33 "DELETE /compute/v2.1/servers/60bc9648-12d2-4db3-baf8-634b739c15f5" status: 204 len: 0 microversion: 2.1 time: 0.541932 Sep 23 04:52:31.015981 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2299/4732] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:52:30 2022] DELETE /compute/v2.1/servers/60bc9648-12d2-4db3-baf8-634b739c15f5 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:52:31.023152 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-cc4f43bd-80af-4a75-b50d-797104025414 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:31.026620 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-cc4f43bd-80af-4a75-b50d-797104025414 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] [instance: 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:31.041487 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cc4f43bd-80af-4a75-b50d-797104025414 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:31.042293 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cc4f43bd-80af-4a75-b50d-797104025414 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:31.042984 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cc4f43bd-80af-4a75-b50d-797104025414 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:31.043948 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cc4f43bd-80af-4a75-b50d-797104025414 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:31.045121 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cc4f43bd-80af-4a75-b50d-797104025414 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:31.046561 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cc4f43bd-80af-4a75-b50d-797104025414 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:31.426678 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c1845185-db7a-4cdb-8860-23cc9ae46585 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:31.436262 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c1845185-db7a-4cdb-8860-23cc9ae46585 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1503 microversion: 2.1 time: 0.504118 Sep 23 04:52:31.437075 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2434/4733] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:30 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1503 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:52:31.441574 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9d7656d5-707a-4184-b818-33e2f1191b59 tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:31.444416 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-9d7656d5-707a-4184-b818-33e2f1191b59 tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] [instance: 60bc9648-12d2-4db3-baf8-634b739c15f5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:31.454202 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-cc4f43bd-80af-4a75-b50d-797104025414 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:31.459688 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9d7656d5-707a-4184-b818-33e2f1191b59 tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:31.460507 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9d7656d5-707a-4184-b818-33e2f1191b59 tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:31.461157 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9d7656d5-707a-4184-b818-33e2f1191b59 tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:31.462418 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9d7656d5-707a-4184-b818-33e2f1191b59 tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:31.463079 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9d7656d5-707a-4184-b818-33e2f1191b59 tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:31.463681 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9d7656d5-707a-4184-b818-33e2f1191b59 tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:31.465694 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-cc4f43bd-80af-4a75-b50d-797104025414 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:31.476249 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-cc4f43bd-80af-4a75-b50d-797104025414 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:31.477543 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-cc4f43bd-80af-4a75-b50d-797104025414 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] 10.222.0.33 "GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7" status: 200 len: 1878 microversion: 2.32 time: 0.459823 Sep 23 04:52:31.501580 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2300/4734] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:52:31 2022] GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 => generated 1878 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:52:31.501580 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0eb15f91-25e2-4030-afd0-fce69a49c018 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:31.501580 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-0eb15f91-25e2-4030-afd0-fce69a49c018 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:31.501580 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0eb15f91-25e2-4030-afd0-fce69a49c018 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:31.501580 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0eb15f91-25e2-4030-afd0-fce69a49c018 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:31.501580 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0eb15f91-25e2-4030-afd0-fce69a49c018 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:31.501580 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0eb15f91-25e2-4030-afd0-fce69a49c018 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:31.501580 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0eb15f91-25e2-4030-afd0-fce69a49c018 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:31.501580 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0eb15f91-25e2-4030-afd0-fce69a49c018 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:31.683464 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-0eb15f91-25e2-4030-afd0-fce69a49c018 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:31.696214 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0eb15f91-25e2-4030-afd0-fce69a49c018 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1503 microversion: 2.1 time: 0.216505 Sep 23 04:52:31.713935 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2301/4735] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:31 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1503 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:52:31.713935 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2737865d-4b57-41a8-9335-d6988c0ff61d tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:31.713935 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-2737865d-4b57-41a8-9335-d6988c0ff61d tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: f285e256-0a0e-4126-8adf-643bd59ca141] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:31.715817 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2737865d-4b57-41a8-9335-d6988c0ff61d tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:31.716866 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2737865d-4b57-41a8-9335-d6988c0ff61d tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:31.717377 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2737865d-4b57-41a8-9335-d6988c0ff61d tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:31.718512 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2737865d-4b57-41a8-9335-d6988c0ff61d tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:31.719230 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2737865d-4b57-41a8-9335-d6988c0ff61d tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:31.719760 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2737865d-4b57-41a8-9335-d6988c0ff61d tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:31.753902 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-9d7656d5-707a-4184-b818-33e2f1191b59 tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923fa0e0e08047a484ff0e129afaf09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e5e00bee244ee973df9124e15068b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:31.766546 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-9d7656d5-707a-4184-b818-33e2f1191b59 tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] 10.222.0.33 "GET /compute/v2.1/servers/60bc9648-12d2-4db3-baf8-634b739c15f5" status: 200 len: 1713 microversion: 2.1 time: 0.324485 Sep 23 04:52:31.766546 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2435/4736] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:31 2022] GET /compute/v2.1/servers/60bc9648-12d2-4db3-baf8-634b739c15f5 => generated 1713 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:52:31.769268 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3f3edd24-3723-4542-a9fc-c144370302ff tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:52:31.770902 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-3f3edd24-3723-4542-a9fc-c144370302ff tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:31.777637 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3f3edd24-3723-4542-a9fc-c144370302ff tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:31.778151 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3f3edd24-3723-4542-a9fc-c144370302ff tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:31.778632 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3f3edd24-3723-4542-a9fc-c144370302ff tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:31.779351 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3f3edd24-3723-4542-a9fc-c144370302ff tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:31.779815 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3f3edd24-3723-4542-a9fc-c144370302ff tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:31.780588 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3f3edd24-3723-4542-a9fc-c144370302ff tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:31.829783 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-3f3edd24-3723-4542-a9fc-c144370302ff tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lazy-loading 'flavor' on Instance uuid a9f2ff08-c66d-4991-9bae-d523a3adb8bf {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:52:32.000349 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-2737865d-4b57-41a8-9335-d6988c0ff61d tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:32.009753 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-2737865d-4b57-41a8-9335-d6988c0ff61d tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:32.011557 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-2737865d-4b57-41a8-9335-d6988c0ff61d tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:32.013547 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2737865d-4b57-41a8-9335-d6988c0ff61d tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141" status: 200 len: 1740 microversion: 2.20 time: 0.313739 Sep 23 04:52:32.014339 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2302/4737] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:52:31 2022] GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141 => generated 1740 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:52:32.031417 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e559028b-37fd-4367-b097-53f97d348b83 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:32.032363 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e559028b-37fd-4367-b097-53f97d348b83 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:32.046155 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e559028b-37fd-4367-b097-53f97d348b83 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:32.047718 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e559028b-37fd-4367-b097-53f97d348b83 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:32.049140 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e559028b-37fd-4367-b097-53f97d348b83 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:32.050058 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e559028b-37fd-4367-b097-53f97d348b83 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:32.050709 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e559028b-37fd-4367-b097-53f97d348b83 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:32.051902 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e559028b-37fd-4367-b097-53f97d348b83 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:32.182708 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3f3edd24-3723-4542-a9fc-c144370302ff tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "POST /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf/action" status: 202 len: 0 microversion: 2.1 time: 0.417110 Sep 23 04:52:32.187268 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2436/4738] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:52:31 2022] POST /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf/action => generated 0 bytes in 422 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:52:32.208166 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d40f4ab8-a296-4783-8dc2-98541355933a tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:32.208551 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d40f4ab8-a296-4783-8dc2-98541355933a tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:32.224403 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d40f4ab8-a296-4783-8dc2-98541355933a tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:32.224793 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d40f4ab8-a296-4783-8dc2-98541355933a tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:32.225246 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d40f4ab8-a296-4783-8dc2-98541355933a tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:32.226003 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d40f4ab8-a296-4783-8dc2-98541355933a tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:32.226472 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d40f4ab8-a296-4783-8dc2-98541355933a tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:32.226908 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d40f4ab8-a296-4783-8dc2-98541355933a tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:32.499326 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e559028b-37fd-4367-b097-53f97d348b83 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:32.511315 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e559028b-37fd-4367-b097-53f97d348b83 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b" status: 200 len: 1317 microversion: 2.1 time: 0.494345 Sep 23 04:52:32.518745 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2303/4739] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:32 2022] GET /compute/v2.1/servers/c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b => generated 1317 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:52:32.533955 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3faa0a88-83c3-4253-8a3f-ddcde2148dd9 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:32.534601 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3faa0a88-83c3-4253-8a3f-ddcde2148dd9 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] [instance: 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:32.557804 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3faa0a88-83c3-4253-8a3f-ddcde2148dd9 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:32.557804 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3faa0a88-83c3-4253-8a3f-ddcde2148dd9 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:32.567536 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3faa0a88-83c3-4253-8a3f-ddcde2148dd9 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:32.568477 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3faa0a88-83c3-4253-8a3f-ddcde2148dd9 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:32.569743 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3faa0a88-83c3-4253-8a3f-ddcde2148dd9 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:32.570233 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3faa0a88-83c3-4253-8a3f-ddcde2148dd9 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:32.974579 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d40f4ab8-a296-4783-8dc2-98541355933a tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:32.987043 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d40f4ab8-a296-4783-8dc2-98541355933a tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1511 microversion: 2.1 time: 0.798257 Sep 23 04:52:33.002821 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2437/4740] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:32 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1511 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:52:33.018802 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b3686443-4377-4869-a4a4-c83f37708d51 tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:33.021369 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b3686443-4377-4869-a4a4-c83f37708d51 tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] [instance: 60bc9648-12d2-4db3-baf8-634b739c15f5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:33.039380 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b3686443-4377-4869-a4a4-c83f37708d51 tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:33.040186 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b3686443-4377-4869-a4a4-c83f37708d51 tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:33.040874 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b3686443-4377-4869-a4a4-c83f37708d51 tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:33.042226 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b3686443-4377-4869-a4a4-c83f37708d51 tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:33.050711 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b3686443-4377-4869-a4a4-c83f37708d51 tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:33.052228 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b3686443-4377-4869-a4a4-c83f37708d51 tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:33.092685 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-3faa0a88-83c3-4253-8a3f-ddcde2148dd9 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:33.110137 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-3faa0a88-83c3-4253-8a3f-ddcde2148dd9 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:33.111714 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-3faa0a88-83c3-4253-8a3f-ddcde2148dd9 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:33.113151 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3faa0a88-83c3-4253-8a3f-ddcde2148dd9 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] 10.222.0.33 "GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7" status: 200 len: 1878 microversion: 2.32 time: 0.593439 Sep 23 04:52:33.114376 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2304/4741] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:52:32 2022] GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 => generated 1878 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:52:33.119364 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c404c9f3-eb41-43ae-8249-a1d2d3de5f73 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:33.122733 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c404c9f3-eb41-43ae-8249-a1d2d3de5f73 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: f285e256-0a0e-4126-8adf-643bd59ca141] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:33.126915 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c404c9f3-eb41-43ae-8249-a1d2d3de5f73 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:33.127661 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c404c9f3-eb41-43ae-8249-a1d2d3de5f73 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:33.128320 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c404c9f3-eb41-43ae-8249-a1d2d3de5f73 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:33.131583 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c404c9f3-eb41-43ae-8249-a1d2d3de5f73 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:33.133585 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c404c9f3-eb41-43ae-8249-a1d2d3de5f73 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:33.135150 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c404c9f3-eb41-43ae-8249-a1d2d3de5f73 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:33.515399 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c404c9f3-eb41-43ae-8249-a1d2d3de5f73 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:33.525479 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c404c9f3-eb41-43ae-8249-a1d2d3de5f73 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:33.527059 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c404c9f3-eb41-43ae-8249-a1d2d3de5f73 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:33.528407 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c404c9f3-eb41-43ae-8249-a1d2d3de5f73 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141" status: 200 len: 1740 microversion: 2.20 time: 0.412710 Sep 23 04:52:33.529490 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2305/4742] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:52:33 2022] GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141 => generated 1740 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:52:33.545189 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3ce9ca44-755a-42e1-a32a-76a07d02cd27 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:33.553561 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3ce9ca44-755a-42e1-a32a-76a07d02cd27 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:33.553561 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3ce9ca44-755a-42e1-a32a-76a07d02cd27 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:33.554310 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3ce9ca44-755a-42e1-a32a-76a07d02cd27 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:33.555286 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3ce9ca44-755a-42e1-a32a-76a07d02cd27 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:33.556025 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3ce9ca44-755a-42e1-a32a-76a07d02cd27 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:33.557535 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3ce9ca44-755a-42e1-a32a-76a07d02cd27 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:33.558012 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3ce9ca44-755a-42e1-a32a-76a07d02cd27 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:33.579112 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b3686443-4377-4869-a4a4-c83f37708d51 tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923fa0e0e08047a484ff0e129afaf09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e5e00bee244ee973df9124e15068b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:33.592066 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b3686443-4377-4869-a4a4-c83f37708d51 tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] 10.222.0.33 "GET /compute/v2.1/servers/60bc9648-12d2-4db3-baf8-634b739c15f5" status: 200 len: 1713 microversion: 2.1 time: 0.585038 Sep 23 04:52:33.593059 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2438/4743] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:33 2022] GET /compute/v2.1/servers/60bc9648-12d2-4db3-baf8-634b739c15f5 => generated 1713 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:52:33.774932 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-3ce9ca44-755a-42e1-a32a-76a07d02cd27 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:33.783644 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3ce9ca44-755a-42e1-a32a-76a07d02cd27 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b" status: 200 len: 1317 microversion: 2.1 time: 0.243618 Sep 23 04:52:33.794379 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2306/4744] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:33 2022] GET /compute/v2.1/servers/c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b => generated 1317 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:52:34.017060 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2c3304d2-ffdb-47d2-8cbc-950e82bb3e1d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:34.018174 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-2c3304d2-ffdb-47d2-8cbc-950e82bb3e1d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:34.025246 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2c3304d2-ffdb-47d2-8cbc-950e82bb3e1d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:34.029366 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2c3304d2-ffdb-47d2-8cbc-950e82bb3e1d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:34.034453 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2c3304d2-ffdb-47d2-8cbc-950e82bb3e1d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:34.035962 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2c3304d2-ffdb-47d2-8cbc-950e82bb3e1d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:34.036474 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2c3304d2-ffdb-47d2-8cbc-950e82bb3e1d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:34.036926 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2c3304d2-ffdb-47d2-8cbc-950e82bb3e1d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:34.153187 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-42109271-bfe8-43ae-bca8-bf116e37fa33 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:34.155348 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-42109271-bfe8-43ae-bca8-bf116e37fa33 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] [instance: 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:34.168372 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-42109271-bfe8-43ae-bca8-bf116e37fa33 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:34.171243 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-42109271-bfe8-43ae-bca8-bf116e37fa33 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:34.171971 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-42109271-bfe8-43ae-bca8-bf116e37fa33 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:34.172964 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-42109271-bfe8-43ae-bca8-bf116e37fa33 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:34.175209 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-42109271-bfe8-43ae-bca8-bf116e37fa33 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:34.175838 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-42109271-bfe8-43ae-bca8-bf116e37fa33 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:34.579335 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2c3304d2-ffdb-47d2-8cbc-950e82bb3e1d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:34.587782 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2c3304d2-ffdb-47d2-8cbc-950e82bb3e1d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1494 microversion: 2.1 time: 0.575050 Sep 23 04:52:34.610673 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2439/4745] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:34 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1494 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:52:34.610962 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-5d4ab030-4059-4b06-8c27-89bfec392a34 req-39c54f41-b7e9-4449-9b31-ef3a217b3797 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60bc9648-12d2-4db3-baf8-634b739c15f5", "name": "network-vif-deleted", "tag": "40dc54c9-f14b-4e0e-8645-da8d221c6247"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:52:34.636981 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-42109271-bfe8-43ae-bca8-bf116e37fa33 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:34.648323 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-42109271-bfe8-43ae-bca8-bf116e37fa33 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:34.649813 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-42109271-bfe8-43ae-bca8-bf116e37fa33 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:34.651042 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-42109271-bfe8-43ae-bca8-bf116e37fa33 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] 10.222.0.33 "GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7" status: 200 len: 1878 microversion: 2.32 time: 0.504256 Sep 23 04:52:34.651686 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2307/4746] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:52:34 2022] GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 => generated 1878 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:52:34.664498 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:52:34.669678 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2bccdce2-dc24-4a66-9c70-3ecdeed22aab tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:34.670372 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-2bccdce2-dc24-4a66-9c70-3ecdeed22aab tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: f285e256-0a0e-4126-8adf-643bd59ca141] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:34.670690 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-5d4ab030-4059-4b06-8c27-89bfec392a34 req-39c54f41-b7e9-4449-9b31-ef3a217b3797 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:34.671212 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-5d4ab030-4059-4b06-8c27-89bfec392a34 req-39c54f41-b7e9-4449-9b31-ef3a217b3797 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:34.675786 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-5d4ab030-4059-4b06-8c27-89bfec392a34 req-39c54f41-b7e9-4449-9b31-ef3a217b3797 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:34.683674 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2bccdce2-dc24-4a66-9c70-3ecdeed22aab tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:34.684473 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2bccdce2-dc24-4a66-9c70-3ecdeed22aab tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:34.686089 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2bccdce2-dc24-4a66-9c70-3ecdeed22aab tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:34.691904 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2bccdce2-dc24-4a66-9c70-3ecdeed22aab tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:34.691904 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2bccdce2-dc24-4a66-9c70-3ecdeed22aab tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:34.691904 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2bccdce2-dc24-4a66-9c70-3ecdeed22aab tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:34.736520 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-5d4ab030-4059-4b06-8c27-89bfec392a34 req-39c54f41-b7e9-4449-9b31-ef3a217b3797 service nova] Creating event network-vif-deleted:40dc54c9-f14b-4e0e-8645-da8d221c6247 for instance 60bc9648-12d2-4db3-baf8-634b739c15f5 on n-h1-846463-3 Sep 23 04:52:34.765718 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-5d4ab030-4059-4b06-8c27-89bfec392a34 req-39c54f41-b7e9-4449-9b31-ef3a217b3797 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.162800 Sep 23 04:52:34.768170 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2440/4747] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:52:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:52:34.777043 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-413fa935-f8e4-4179-a656-dbaed19b59cd tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:34.786956 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-413fa935-f8e4-4179-a656-dbaed19b59cd tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] [instance: 60bc9648-12d2-4db3-baf8-634b739c15f5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:34.799908 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-413fa935-f8e4-4179-a656-dbaed19b59cd tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:34.801054 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-413fa935-f8e4-4179-a656-dbaed19b59cd tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:34.804771 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-413fa935-f8e4-4179-a656-dbaed19b59cd tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:34.805756 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-413fa935-f8e4-4179-a656-dbaed19b59cd tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:34.807850 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-413fa935-f8e4-4179-a656-dbaed19b59cd tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:34.810613 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-413fa935-f8e4-4179-a656-dbaed19b59cd tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:34.889439 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-413fa935-f8e4-4179-a656-dbaed19b59cd tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:34.890708 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-413fa935-f8e4-4179-a656-dbaed19b59cd tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:34.891323 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-413fa935-f8e4-4179-a656-dbaed19b59cd tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:34.892140 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-413fa935-f8e4-4179-a656-dbaed19b59cd tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Lazy-loading 'fault' on Instance uuid 60bc9648-12d2-4db3-baf8-634b739c15f5 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:52:34.958225 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-413fa935-f8e4-4179-a656-dbaed19b59cd tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '923fa0e0e08047a484ff0e129afaf09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598e5e00bee244ee973df9124e15068b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:34.971673 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-413fa935-f8e4-4179-a656-dbaed19b59cd tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] 10.222.0.33 "GET /compute/v2.1/servers/60bc9648-12d2-4db3-baf8-634b739c15f5" status: 200 len: 1367 microversion: 2.1 time: 0.198379 Sep 23 04:52:34.972653 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2441/4748] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:34 2022] GET /compute/v2.1/servers/60bc9648-12d2-4db3-baf8-634b739c15f5 => generated 1367 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:52:34.990063 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-444e8057-d514-4e54-8363-13de7bfcaf4e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:52:34.991004 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-444e8057-d514-4e54-8363-13de7bfcaf4e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:35.000761 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-444e8057-d514-4e54-8363-13de7bfcaf4e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:35.004273 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-444e8057-d514-4e54-8363-13de7bfcaf4e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:35.004987 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-444e8057-d514-4e54-8363-13de7bfcaf4e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:35.007862 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-444e8057-d514-4e54-8363-13de7bfcaf4e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:35.008548 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-444e8057-d514-4e54-8363-13de7bfcaf4e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:35.010083 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-444e8057-d514-4e54-8363-13de7bfcaf4e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:35.025552 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-2bccdce2-dc24-4a66-9c70-3ecdeed22aab tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:35.042456 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-2bccdce2-dc24-4a66-9c70-3ecdeed22aab tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:35.049558 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-2bccdce2-dc24-4a66-9c70-3ecdeed22aab tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:35.056284 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2bccdce2-dc24-4a66-9c70-3ecdeed22aab tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141" status: 200 len: 1740 microversion: 2.20 time: 0.398251 Sep 23 04:52:35.058912 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2308/4749] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:52:34 2022] GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141 => generated 1740 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:52:35.085524 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0dfb7980-3623-44a8-9c58-a2605f402b69 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:35.097571 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-0dfb7980-3623-44a8-9c58-a2605f402b69 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:35.122354 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-444e8057-d514-4e54-8363-13de7bfcaf4e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lazy-loading 'flavor' on Instance uuid a9f2ff08-c66d-4991-9bae-d523a3adb8bf {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:52:35.127353 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0dfb7980-3623-44a8-9c58-a2605f402b69 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:35.128108 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0dfb7980-3623-44a8-9c58-a2605f402b69 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:35.136857 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0dfb7980-3623-44a8-9c58-a2605f402b69 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:35.136857 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0dfb7980-3623-44a8-9c58-a2605f402b69 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:35.136857 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0dfb7980-3623-44a8-9c58-a2605f402b69 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:35.136857 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0dfb7980-3623-44a8-9c58-a2605f402b69 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:35.163560 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-444e8057-d514-4e54-8363-13de7bfcaf4e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] HTTP exception thrown: Cannot 'suspend' instance a9f2ff08-c66d-4991-9bae-d523a3adb8bf while it is in vm_state suspended Sep 23 04:52:35.166222 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-444e8057-d514-4e54-8363-13de7bfcaf4e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Request method failure captured: Sep 23 04:52:35.166222 n-d-846463-3 devstack@n-api.service[122699]: request: POST /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf/action HTTP/1.1 Sep 23 04:52:35.166222 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:52:35.166222 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:52:35.166222 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:52:35.166222 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 15 Sep 23 04:52:35.166222 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:52:35.166222 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:52:35.166222 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:52:35.166222 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:52:35.166222 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTrDoGx96bSja4ydTGD-VWXTOyHeLiBA9Lvr197ivKeXqtV3OksEUUEiEPXK85IMwWXM1vCTp1M9PaXnUkKbFev29d-fL5KKXR0MfyGa86SLKINg6u_gn5EQLUNZ8EVLCkU1WwJ7agpVlFY75EyJH0fBcxrNg1yvFbeC2alzdH4Tkmw Sep 23 04:52:35.166222 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:52:35.166222 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:52:35.166222 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:52:35.166222 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:52:35.166222 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:52:35.166222 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:52:35.166222 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 78dca47156ff4f19a8673b893c853978 Sep 23 04:52:35.166222 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:52:35.166222 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:52:35.166222 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:52:35.166222 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_78dca47156ff4f19a8673b893c853978", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/78dca47156ff4f19a8673b893c853978"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/78dca47156ff4f19a8673b893c853978"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/78dca47156ff4f19a8673b893c853978"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:52:35.166222 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:52:35.166222 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 78dca47156ff4f19a8673b893c853978 Sep 23 04:52:35.166222 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:52:35.166222 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ServersNegativeTestJSON-1102187211-project Sep 23 04:52:35.166222 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:52:35.166222 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:52:35.166222 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: c912fb9d1f5447d180a9e8568220526f Sep 23 04:52:35.166222 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ServersNegativeTestJSON-1102187211-project Sep 23 04:52:35.166222 n-d-846463-3 devstack@n-api.service[122699]: Sep 23 04:52:35.166222 n-d-846463-3 devstack@n-api.service[122699]: {"suspend": {}} Sep 23 04:52:35.166222 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:52:35.166222 n-d-846463-3 devstack@n-api.service[122699]: exception: Cannot 'suspend' instance a9f2ff08-c66d-4991-9bae-d523a3adb8bf while it is in vm_state suspended Sep 23 04:52:35.166222 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': 'a9f2ff08-c66d-4991-9bae-d523a3adb8bf', 'body': {'suspend': {}}} Sep 23 04:52:35.166222 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:52:35.166222 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:52:35.166222 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Sep 23 04:52:35.166222 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Sep 23 04:52:35.166222 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 23 04:52:35.166222 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 23 04:52:35.166222 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Sep 23 04:52:35.166222 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 23 04:52:35.166222 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 23 04:52:35.166222 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 23 04:52:35.166222 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Sep 23 04:52:35.166222 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 23 04:52:35.166222 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 23 04:52:35.166222 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 23 04:52:35.166222 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 23 04:52:35.166222 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 23 04:52:35.166222 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a9f2ff08-c66d-4991-9bae-d523a3adb8bf in vm_state suspended. Cannot suspend while the instance is in this state. Sep 23 04:52:35.166222 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:52:35.166222 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:52:35.166222 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:52:35.166222 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:52:35.166222 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:52:35.166222 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:52:35.166222 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:52:35.166222 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:52:35.166222 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:52:35.166222 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:52:35.166222 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Sep 23 04:52:35.166222 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 23 04:52:35.171164 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 23 04:52:35.171164 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 23 04:52:35.171164 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance a9f2ff08-c66d-4991-9bae-d523a3adb8bf while it is in vm_state suspended Sep 23 04:52:35.171164 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:52:35.171164 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:52:35.171164 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:52:35.171164 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:52:35.171164 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:52:35.171164 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:52:35.171164 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:52:35.171164 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:52:35.171164 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance a9f2ff08-c66d-4991-9bae-d523a3adb8bf while it is in vm_state suspended Sep 23 04:52:35.171164 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:52:35.171164 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-444e8057-d514-4e54-8363-13de7bfcaf4e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Returning 409 to user: Cannot 'suspend' instance a9f2ff08-c66d-4991-9bae-d523a3adb8bf while it is in vm_state suspended {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:52:35.173338 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-444e8057-d514-4e54-8363-13de7bfcaf4e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "POST /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf/action" status: 409 len: 148 microversion: 2.1 time: 0.197521 Sep 23 04:52:35.173498 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2442/4750] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:52:34 2022] POST /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf/action => generated 148 bytes in 200 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 23 04:52:35.179560 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-9df4a17a-75bc-4e36-8bc0-2f668c0dcef3 req-60dcaa0e-3c39-48d6-9132-0f22a4e1a0b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b", "name": "network-vif-plugged", "status": "completed", "tag": "2d1ed940-5eb5-4eff-9020-37f2f21a3613"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:52:35.192178 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-9df4a17a-75bc-4e36-8bc0-2f668c0dcef3 req-60dcaa0e-3c39-48d6-9132-0f22a4e1a0b2 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:35.194282 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-9df4a17a-75bc-4e36-8bc0-2f668c0dcef3 req-60dcaa0e-3c39-48d6-9132-0f22a4e1a0b2 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:35.194282 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-9df4a17a-75bc-4e36-8bc0-2f668c0dcef3 req-60dcaa0e-3c39-48d6-9132-0f22a4e1a0b2 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:35.210913 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-9df4a17a-75bc-4e36-8bc0-2f668c0dcef3 req-60dcaa0e-3c39-48d6-9132-0f22a4e1a0b2 service nova] Creating event network-vif-plugged:2d1ed940-5eb5-4eff-9020-37f2f21a3613 for instance c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b on n-h1-846463-3 Sep 23 04:52:35.222630 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-9df4a17a-75bc-4e36-8bc0-2f668c0dcef3 req-60dcaa0e-3c39-48d6-9132-0f22a4e1a0b2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046858 Sep 23 04:52:35.224436 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2443/4751] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:52:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:52:35.233574 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a3c3cd46-ba9f-46e3-8fbc-df256fb5b325 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:52:35.235182 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a3c3cd46-ba9f-46e3-8fbc-df256fb5b325 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:35.245429 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a3c3cd46-ba9f-46e3-8fbc-df256fb5b325 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:35.246695 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a3c3cd46-ba9f-46e3-8fbc-df256fb5b325 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:35.249467 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a3c3cd46-ba9f-46e3-8fbc-df256fb5b325 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:35.250896 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a3c3cd46-ba9f-46e3-8fbc-df256fb5b325 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:35.251631 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a3c3cd46-ba9f-46e3-8fbc-df256fb5b325 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:35.252289 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a3c3cd46-ba9f-46e3-8fbc-df256fb5b325 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:35.257319 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:52:35.402277 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-0dfb7980-3623-44a8-9c58-a2605f402b69 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:35.417208 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0dfb7980-3623-44a8-9c58-a2605f402b69 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b" status: 200 len: 1317 microversion: 2.1 time: 0.353719 Sep 23 04:52:35.433424 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2309/4752] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:35 2022] GET /compute/v2.1/servers/c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b => generated 1317 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:52:35.521745 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a3c3cd46-ba9f-46e3-8fbc-df256fb5b325 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "POST /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf/action" status: 202 len: 0 microversion: 2.1 time: 0.295210 Sep 23 04:52:35.527559 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2444/4753] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:52:35 2022] POST /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf/action => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:52:35.532776 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-46c24aff-957a-46f3-98b5-78a57c649192 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:35.533862 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-46c24aff-957a-46f3-98b5-78a57c649192 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:35.540879 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-46c24aff-957a-46f3-98b5-78a57c649192 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:35.541375 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-46c24aff-957a-46f3-98b5-78a57c649192 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:35.542013 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-46c24aff-957a-46f3-98b5-78a57c649192 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:35.547001 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-46c24aff-957a-46f3-98b5-78a57c649192 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:35.568142 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-46c24aff-957a-46f3-98b5-78a57c649192 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:35.568142 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-46c24aff-957a-46f3-98b5-78a57c649192 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:35.678460 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-496ce392-8e1a-45d9-911a-72f6718290ae tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:35.683472 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-496ce392-8e1a-45d9-911a-72f6718290ae tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] [instance: 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:35.710843 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-496ce392-8e1a-45d9-911a-72f6718290ae tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:35.712455 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-496ce392-8e1a-45d9-911a-72f6718290ae tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:35.713096 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-496ce392-8e1a-45d9-911a-72f6718290ae tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:35.717304 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-496ce392-8e1a-45d9-911a-72f6718290ae tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:35.719852 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-496ce392-8e1a-45d9-911a-72f6718290ae tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:35.720156 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-496ce392-8e1a-45d9-911a-72f6718290ae tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:36.100524 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-46c24aff-957a-46f3-98b5-78a57c649192 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:36.113237 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-46c24aff-957a-46f3-98b5-78a57c649192 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1500 microversion: 2.1 time: 0.586142 Sep 23 04:52:36.120228 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2310/4754] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:35 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1500 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:52:36.125713 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c59a301b-39f6-4b2c-becf-4f83e03dc6cf tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:36.127748 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c59a301b-39f6-4b2c-becf-4f83e03dc6cf tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] [instance: 60bc9648-12d2-4db3-baf8-634b739c15f5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:36.146999 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c59a301b-39f6-4b2c-becf-4f83e03dc6cf tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:36.151429 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c59a301b-39f6-4b2c-becf-4f83e03dc6cf tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:36.438475 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c59a301b-39f6-4b2c-becf-4f83e03dc6cf tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:36.438475 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c59a301b-39f6-4b2c-becf-4f83e03dc6cf tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:36.438475 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c59a301b-39f6-4b2c-becf-4f83e03dc6cf tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:36.438475 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c59a301b-39f6-4b2c-becf-4f83e03dc6cf tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:36.438475 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-c59a301b-39f6-4b2c-becf-4f83e03dc6cf tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] HTTP exception thrown: Instance 60bc9648-12d2-4db3-baf8-634b739c15f5 could not be found. Sep 23 04:52:36.438475 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c59a301b-39f6-4b2c-becf-4f83e03dc6cf tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Request method failure captured: Sep 23 04:52:36.438475 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/60bc9648-12d2-4db3-baf8-634b739c15f5 HTTP/1.1 Sep 23 04:52:36.438475 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:52:36.438475 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:52:36.438475 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:52:36.438475 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:52:36.438475 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:52:36.438475 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:52:36.438475 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:52:36.438475 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:52:36.438475 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTtJjBm2ViDFrm0FNl8OuhKPGtB00yv9VPJcpTftk1ZNvvFf9K2eBgyCFIDrJNUdmlKVlOOma8WRM6KbPY48jH8NbDCYIqUZwue2EBfllB6QY75sCsIQKEPKVAMcguvsUO4iznFtjAyxQgFzlc_rKvedJNf_FUI99xsJ4Qx8huEocXo Sep 23 04:52:36.438475 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:52:36.438475 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:52:36.438475 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:52:36.438475 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:52:36.438475 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:52:36.438475 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:52:36.438475 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 598e5e00bee244ee973df9124e15068b Sep 23 04:52:36.438475 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ServersTestManualDisk-1864857248 Sep 23 04:52:36.438475 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:52:36.438475 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:52:36.438475 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_598e5e00bee244ee973df9124e15068b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/598e5e00bee244ee973df9124e15068b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/598e5e00bee244ee973df9124e15068b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/598e5e00bee244ee973df9124e15068b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:52:36.438475 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ServersTestManualDisk-1864857248 Sep 23 04:52:36.438475 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 598e5e00bee244ee973df9124e15068b Sep 23 04:52:36.438475 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ServersTestManualDisk-1864857248 Sep 23 04:52:36.438475 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ServersTestManualDisk-1864857248-project Sep 23 04:52:36.438475 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:52:36.438475 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:52:36.438475 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 923fa0e0e08047a484ff0e129afaf09a Sep 23 04:52:36.438475 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ServersTestManualDisk-1864857248-project Sep 23 04:52:36.438475 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:52:36.438475 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 60bc9648-12d2-4db3-baf8-634b739c15f5 could not be found. Sep 23 04:52:36.438475 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '60bc9648-12d2-4db3-baf8-634b739c15f5'} Sep 23 04:52:36.438475 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:52:36.438475 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:52:36.438475 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:52:36.438475 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:52:36.438475 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:52:36.438475 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:52:36.438475 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:52:36.438475 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:52:36.441851 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:52:36.441851 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:52:36.441851 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60bc9648-12d2-4db3-baf8-634b739c15f5 could not be found. Sep 23 04:52:36.441851 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:52:36.441851 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:52:36.441851 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:52:36.441851 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:52:36.441851 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:52:36.441851 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:52:36.441851 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:52:36.441851 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:52:36.441851 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:52:36.441851 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:52:36.441851 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:52:36.441851 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:52:36.441851 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:52:36.441851 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:52:36.441851 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:52:36.441851 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:52:36.441851 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60bc9648-12d2-4db3-baf8-634b739c15f5 could not be found. Sep 23 04:52:36.441851 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:52:36.441851 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:52:36.441851 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:52:36.441851 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:52:36.441851 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:52:36.441851 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:52:36.441851 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:52:36.441851 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:52:36.441851 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60bc9648-12d2-4db3-baf8-634b739c15f5 could not be found. Sep 23 04:52:36.441851 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:52:36.441851 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c59a301b-39f6-4b2c-becf-4f83e03dc6cf tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Returning 404 to user: Instance 60bc9648-12d2-4db3-baf8-634b739c15f5 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:52:36.441851 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c59a301b-39f6-4b2c-becf-4f83e03dc6cf tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] 10.222.0.33 "GET /compute/v2.1/servers/60bc9648-12d2-4db3-baf8-634b739c15f5" status: 404 len: 111 microversion: 2.1 time: 0.051663 Sep 23 04:52:36.441851 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2311/4755] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:36 2022] GET /compute/v2.1/servers/60bc9648-12d2-4db3-baf8-634b739c15f5 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:52:36.441851 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f5c99f14-0403-49b8-8253-4d23cd7309bb tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:36.441851 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f5c99f14-0403-49b8-8253-4d23cd7309bb tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: f285e256-0a0e-4126-8adf-643bd59ca141] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:36.441851 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f5c99f14-0403-49b8-8253-4d23cd7309bb tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:36.441851 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f5c99f14-0403-49b8-8253-4d23cd7309bb tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:36.444417 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f5c99f14-0403-49b8-8253-4d23cd7309bb tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:36.444417 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f5c99f14-0403-49b8-8253-4d23cd7309bb tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:36.444417 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f5c99f14-0403-49b8-8253-4d23cd7309bb tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:36.444417 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f5c99f14-0403-49b8-8253-4d23cd7309bb tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:36.444935 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-496ce392-8e1a-45d9-911a-72f6718290ae tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:36.444935 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-496ce392-8e1a-45d9-911a-72f6718290ae tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:36.444935 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-496ce392-8e1a-45d9-911a-72f6718290ae tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:36.444935 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-496ce392-8e1a-45d9-911a-72f6718290ae tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] 10.222.0.33 "GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7" status: 200 len: 1878 microversion: 2.32 time: 0.554416 Sep 23 04:52:36.444935 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2445/4756] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:52:35 2022] GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 => generated 1878 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:52:36.446064 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f5c99f14-0403-49b8-8253-4d23cd7309bb tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:36.446064 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f5c99f14-0403-49b8-8253-4d23cd7309bb tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:36.446064 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f5c99f14-0403-49b8-8253-4d23cd7309bb tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:36.446064 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f5c99f14-0403-49b8-8253-4d23cd7309bb tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141" status: 200 len: 1740 microversion: 2.20 time: 0.189380 Sep 23 04:52:36.446064 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2312/4757] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:52:36 2022] GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141 => generated 1740 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:52:36.454136 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ccd99c31-d084-4ae5-96f0-7d8db0bf80af tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] Calling method '.version_select at 0x7ff1baba59d0>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:36.454503 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6c27799c-c205-48cb-93a0-39692c775c07 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:36.455979 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-6c27799c-c205-48cb-93a0-39692c775c07 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:36.465613 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6c27799c-c205-48cb-93a0-39692c775c07 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:36.466430 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6c27799c-c205-48cb-93a0-39692c775c07 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:36.466952 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6c27799c-c205-48cb-93a0-39692c775c07 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:36.467775 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6c27799c-c205-48cb-93a0-39692c775c07 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:36.468446 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6c27799c-c205-48cb-93a0-39692c775c07 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:36.469032 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6c27799c-c205-48cb-93a0-39692c775c07 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:36.600810 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ccd99c31-d084-4ae5-96f0-7d8db0bf80af tempest-ServersTestManualDisk-1864857248 tempest-ServersTestManualDisk-1864857248-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1120844680" status: 202 len: 0 microversion: 2.1 time: 0.156551 Sep 23 04:52:36.609280 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2446/4758] 10.222.0.33 () {58 vars in 1221 bytes} [Fri Sep 23 04:52:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1120844680 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:52:36.801719 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6c27799c-c205-48cb-93a0-39692c775c07 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:36.809364 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:52:36.812990 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-6c27799c-c205-48cb-93a0-39692c775c07 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b" status: 200 len: 1317 microversion: 2.1 time: 0.366867 Sep 23 04:52:36.834416 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2313/4759] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:36 2022] GET /compute/v2.1/servers/c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b => generated 1317 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:52:37.170369 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-fda39363-d623-49a9-8b24-35eca6f28de7 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:37.172207 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-fda39363-d623-49a9-8b24-35eca6f28de7 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:37.192036 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fda39363-d623-49a9-8b24-35eca6f28de7 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:37.194529 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fda39363-d623-49a9-8b24-35eca6f28de7 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:37.195415 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fda39363-d623-49a9-8b24-35eca6f28de7 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:37.196308 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fda39363-d623-49a9-8b24-35eca6f28de7 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:37.197551 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fda39363-d623-49a9-8b24-35eca6f28de7 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:37.198126 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fda39363-d623-49a9-8b24-35eca6f28de7 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:37.460958 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ed4a5b0a-dafb-415e-a7ca-d6263649bc5a tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:37.461941 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-ed4a5b0a-dafb-415e-a7ca-d6263649bc5a tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] [instance: 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:37.476921 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ed4a5b0a-dafb-415e-a7ca-d6263649bc5a tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:37.477456 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ed4a5b0a-dafb-415e-a7ca-d6263649bc5a tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:37.482170 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ed4a5b0a-dafb-415e-a7ca-d6263649bc5a tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:37.482170 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ed4a5b0a-dafb-415e-a7ca-d6263649bc5a tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:37.482450 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-fda39363-d623-49a9-8b24-35eca6f28de7 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:37.482900 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ed4a5b0a-dafb-415e-a7ca-d6263649bc5a tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:37.482900 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ed4a5b0a-dafb-415e-a7ca-d6263649bc5a tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:37.491192 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-fda39363-d623-49a9-8b24-35eca6f28de7 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1500 microversion: 2.1 time: 0.334911 Sep 23 04:52:37.493244 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2447/4760] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:37 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1500 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:52:37.517674 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0b1cb595-58e4-4ac3-bbfe-be53071066b7 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:37.518763 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-0b1cb595-58e4-4ac3-bbfe-be53071066b7 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: f285e256-0a0e-4126-8adf-643bd59ca141] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:37.529353 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0b1cb595-58e4-4ac3-bbfe-be53071066b7 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:37.530247 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0b1cb595-58e4-4ac3-bbfe-be53071066b7 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:37.532219 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0b1cb595-58e4-4ac3-bbfe-be53071066b7 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:37.533713 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0b1cb595-58e4-4ac3-bbfe-be53071066b7 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:37.534576 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0b1cb595-58e4-4ac3-bbfe-be53071066b7 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:37.535232 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0b1cb595-58e4-4ac3-bbfe-be53071066b7 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:38.501734 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ed4a5b0a-dafb-415e-a7ca-d6263649bc5a tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:38.517350 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ed4a5b0a-dafb-415e-a7ca-d6263649bc5a tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:38.517350 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ed4a5b0a-dafb-415e-a7ca-d6263649bc5a tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:38.517872 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ed4a5b0a-dafb-415e-a7ca-d6263649bc5a tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] 10.222.0.33 "GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7" status: 200 len: 1878 microversion: 2.32 time: 1.060790 Sep 23 04:52:38.518414 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2314/4761] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:52:37 2022] GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 => generated 1878 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:52:38.535084 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a139b1a0-d59d-4f63-991d-d35e3f9f1389 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:38.535725 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a139b1a0-d59d-4f63-991d-d35e3f9f1389 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:38.547573 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a139b1a0-d59d-4f63-991d-d35e3f9f1389 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:38.548093 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a139b1a0-d59d-4f63-991d-d35e3f9f1389 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:38.548543 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a139b1a0-d59d-4f63-991d-d35e3f9f1389 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:38.549264 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a139b1a0-d59d-4f63-991d-d35e3f9f1389 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:38.549733 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a139b1a0-d59d-4f63-991d-d35e3f9f1389 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:38.552417 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a139b1a0-d59d-4f63-991d-d35e3f9f1389 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:38.561729 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-0b1cb595-58e4-4ac3-bbfe-be53071066b7 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:38.574280 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-0b1cb595-58e4-4ac3-bbfe-be53071066b7 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:38.580826 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-0b1cb595-58e4-4ac3-bbfe-be53071066b7 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:38.582121 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0b1cb595-58e4-4ac3-bbfe-be53071066b7 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141" status: 200 len: 1740 microversion: 2.20 time: 1.075538 Sep 23 04:52:38.588599 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2448/4762] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:52:37 2022] GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141 => generated 1740 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:52:38.593971 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-32362808-225d-4d85-aeef-53925b662eeb tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:38.611929 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-32362808-225d-4d85-aeef-53925b662eeb tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:38.622945 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-32362808-225d-4d85-aeef-53925b662eeb tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:38.629883 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-32362808-225d-4d85-aeef-53925b662eeb tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:38.630575 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-32362808-225d-4d85-aeef-53925b662eeb tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:38.631493 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-32362808-225d-4d85-aeef-53925b662eeb tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:38.631970 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-32362808-225d-4d85-aeef-53925b662eeb tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:38.632406 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-32362808-225d-4d85-aeef-53925b662eeb tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:38.969247 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a139b1a0-d59d-4f63-991d-d35e3f9f1389 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:38.977258 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a139b1a0-d59d-4f63-991d-d35e3f9f1389 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b" status: 200 len: 1506 microversion: 2.1 time: 0.457831 Sep 23 04:52:38.977840 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2315/4763] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:38 2022] GET /compute/v2.1/servers/c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b => generated 1506 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:52:39.003453 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-585af28c-62ab-425f-89e6-bd6c33d853e1 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:39.004334 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-585af28c-62ab-425f-89e6-bd6c33d853e1 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:39.018711 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-585af28c-62ab-425f-89e6-bd6c33d853e1 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:39.024625 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-585af28c-62ab-425f-89e6-bd6c33d853e1 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:39.025237 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-585af28c-62ab-425f-89e6-bd6c33d853e1 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:39.027917 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-585af28c-62ab-425f-89e6-bd6c33d853e1 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:39.028631 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-585af28c-62ab-425f-89e6-bd6c33d853e1 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:39.029234 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-585af28c-62ab-425f-89e6-bd6c33d853e1 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:39.112279 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-32362808-225d-4d85-aeef-53925b662eeb tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:39.121035 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-32362808-225d-4d85-aeef-53925b662eeb tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1503 microversion: 2.1 time: 0.531332 Sep 23 04:52:39.121634 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2449/4764] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:38 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1503 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:52:39.151945 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6e736cf3-a09c-41ac-ab00-ad51dab219c3 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:39.152583 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-6e736cf3-a09c-41ac-ab00-ad51dab219c3 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:39.156946 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:52:39.161669 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6e736cf3-a09c-41ac-ab00-ad51dab219c3 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:39.170460 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6e736cf3-a09c-41ac-ab00-ad51dab219c3 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:39.171195 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6e736cf3-a09c-41ac-ab00-ad51dab219c3 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:39.172119 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6e736cf3-a09c-41ac-ab00-ad51dab219c3 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:39.173326 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6e736cf3-a09c-41ac-ab00-ad51dab219c3 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:39.173966 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6e736cf3-a09c-41ac-ab00-ad51dab219c3 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:39.465536 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-585af28c-62ab-425f-89e6-bd6c33d853e1 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:39.482618 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:52:39.489568 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-585af28c-62ab-425f-89e6-bd6c33d853e1 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b" status: 200 len: 1506 microversion: 2.1 time: 0.487507 Sep 23 04:52:39.492556 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2316/4765] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:38 2022] GET /compute/v2.1/servers/c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b => generated 1506 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:52:39.520825 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5c268ba5-6a9d-453d-a143-dad7a4a2cfea tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "OS-DCF:diskConfig": "AUTO"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:52:39.526654 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5c268ba5-6a9d-453d-a143-dad7a4a2cfea tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:39.547680 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5c268ba5-6a9d-453d-a143-dad7a4a2cfea tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:39.549846 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5c268ba5-6a9d-453d-a143-dad7a4a2cfea tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:39.550415 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5c268ba5-6a9d-453d-a143-dad7a4a2cfea tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:39.552473 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5c268ba5-6a9d-453d-a143-dad7a4a2cfea tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:39.553033 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5c268ba5-6a9d-453d-a143-dad7a4a2cfea tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:39.554563 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5c268ba5-6a9d-453d-a143-dad7a4a2cfea tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:39.582417 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-6e736cf3-a09c-41ac-ab00-ad51dab219c3 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:39.587832 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:52:39.600115 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6e736cf3-a09c-41ac-ab00-ad51dab219c3 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1503 microversion: 2.1 time: 0.453393 Sep 23 04:52:39.601580 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2450/4766] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:39 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1503 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:52:39.608153 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c22aaf35-b946-43b5-8fa5-77d074d38c2d tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:39.612552 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c22aaf35-b946-43b5-8fa5-77d074d38c2d tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] [instance: 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:39.625806 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c22aaf35-b946-43b5-8fa5-77d074d38c2d tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:39.630255 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c22aaf35-b946-43b5-8fa5-77d074d38c2d tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:39.630882 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c22aaf35-b946-43b5-8fa5-77d074d38c2d tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:39.631836 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c22aaf35-b946-43b5-8fa5-77d074d38c2d tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:39.632461 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c22aaf35-b946-43b5-8fa5-77d074d38c2d tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:39.633061 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c22aaf35-b946-43b5-8fa5-77d074d38c2d tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:39.700988 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-5c268ba5-6a9d-453d-a143-dad7a4a2cfea tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Flavor limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:52:39.701724 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-5c268ba5-6a9d-453d-a143-dad7a4a2cfea tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Image limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:52:39.702598 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-5c268ba5-6a9d-453d-a143-dad7a4a2cfea tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Flavor pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:52:39.703337 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-5c268ba5-6a9d-453d-a143-dad7a4a2cfea tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Image pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:52:39.704093 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-5c268ba5-6a9d-453d-a143-dad7a4a2cfea tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:52:40.012526 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5c268ba5-6a9d-453d-a143-dad7a4a2cfea tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:40.015456 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c22aaf35-b946-43b5-8fa5-77d074d38c2d tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:40.032904 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c22aaf35-b946-43b5-8fa5-77d074d38c2d tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:40.034406 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c22aaf35-b946-43b5-8fa5-77d074d38c2d tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:40.035612 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c22aaf35-b946-43b5-8fa5-77d074d38c2d tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] 10.222.0.33 "GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7" status: 200 len: 1878 microversion: 2.32 time: 0.431729 Sep 23 04:52:40.041855 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5c268ba5-6a9d-453d-a143-dad7a4a2cfea tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:40.042388 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5c268ba5-6a9d-453d-a143-dad7a4a2cfea tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:40.045325 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2451/4767] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:52:39 2022] GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 => generated 1878 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:52:40.048995 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5c268ba5-6a9d-453d-a143-dad7a4a2cfea tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:40.049826 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5c268ba5-6a9d-453d-a143-dad7a4a2cfea tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:40.050356 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5c268ba5-6a9d-453d-a143-dad7a4a2cfea tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:40.050804 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5c268ba5-6a9d-453d-a143-dad7a4a2cfea tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:40.056953 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e1675152-e9e6-494d-a9d9-7bc98d083af0 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:52:40.059379 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e1675152-e9e6-494d-a9d9-7bc98d083af0 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:40.079962 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e1675152-e9e6-494d-a9d9-7bc98d083af0 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:40.080475 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e1675152-e9e6-494d-a9d9-7bc98d083af0 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:40.080921 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e1675152-e9e6-494d-a9d9-7bc98d083af0 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:40.083852 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e1675152-e9e6-494d-a9d9-7bc98d083af0 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:40.084496 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e1675152-e9e6-494d-a9d9-7bc98d083af0 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:40.085130 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e1675152-e9e6-494d-a9d9-7bc98d083af0 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:40.112794 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5c268ba5-6a9d-453d-a143-dad7a4a2cfea tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "POST /compute/v2.1/servers/c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b/action" status: 202 len: 1108 microversion: 2.1 time: 0.600948 Sep 23 04:52:40.114744 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2317/4768] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:52:39 2022] POST /compute/v2.1/servers/c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b/action => generated 1108 bytes in 604 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 23 04:52:40.126313 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d6c0cc0e-abd7-44e0-aee6-235d3706d3a0 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:40.128353 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d6c0cc0e-abd7-44e0-aee6-235d3706d3a0 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: f285e256-0a0e-4126-8adf-643bd59ca141] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:40.143119 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d6c0cc0e-abd7-44e0-aee6-235d3706d3a0 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:40.143955 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d6c0cc0e-abd7-44e0-aee6-235d3706d3a0 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:40.144594 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d6c0cc0e-abd7-44e0-aee6-235d3706d3a0 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:40.147444 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d6c0cc0e-abd7-44e0-aee6-235d3706d3a0 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:40.148118 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d6c0cc0e-abd7-44e0-aee6-235d3706d3a0 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:40.148730 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d6c0cc0e-abd7-44e0-aee6-235d3706d3a0 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:40.415555 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e1675152-e9e6-494d-a9d9-7bc98d083af0 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "POST /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5/action" status: 202 len: 0 microversion: 2.1 time: 0.368812 Sep 23 04:52:40.416461 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2452/4769] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:52:40 2022] POST /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5/action => generated 0 bytes in 371 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:52:40.432500 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ab85cf3e-32a1-4936-b4ed-1d23e728417e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:52:40.433147 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ab85cf3e-32a1-4936-b4ed-1d23e728417e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a54cc9ce-072d-4d9d-88b8-2a558b2c1132] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:40.458915 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-ab85cf3e-32a1-4936-b4ed-1d23e728417e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] HTTP exception thrown: Instance a54cc9ce-072d-4d9d-88b8-2a558b2c1132 could not be found. Sep 23 04:52:40.460587 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ab85cf3e-32a1-4936-b4ed-1d23e728417e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Request method failure captured: Sep 23 04:52:40.460587 n-d-846463-3 devstack@n-api.service[122699]: request: POST /compute/v2.1/servers/a54cc9ce-072d-4d9d-88b8-2a558b2c1132/action HTTP/1.1 Sep 23 04:52:40.460587 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:52:40.460587 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:52:40.460587 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:52:40.460587 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 15 Sep 23 04:52:40.460587 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:52:40.460587 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:52:40.460587 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:52:40.460587 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:52:40.460587 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTrDoGx96bSja4ydTGD-VWXTOyHeLiBA9Lvr197ivKeXqtV3OksEUUEiEPXK85IMwWXM1vCTp1M9PaXnUkKbFev29d-fL5KKXR0MfyGa86SLKINg6u_gn5EQLUNZ8EVLCkU1WwJ7agpVlFY75EyJH0fBcxrNg1yvFbeC2alzdH4Tkmw Sep 23 04:52:40.460587 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:52:40.460587 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:52:40.460587 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:52:40.460587 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:52:40.460587 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:52:40.460587 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:52:40.460587 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 78dca47156ff4f19a8673b893c853978 Sep 23 04:52:40.460587 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:52:40.460587 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:52:40.460587 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:52:40.460587 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_78dca47156ff4f19a8673b893c853978", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/78dca47156ff4f19a8673b893c853978"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/78dca47156ff4f19a8673b893c853978"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/78dca47156ff4f19a8673b893c853978"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:52:40.460587 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:52:40.460587 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 78dca47156ff4f19a8673b893c853978 Sep 23 04:52:40.460587 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:52:40.460587 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ServersNegativeTestJSON-1102187211-project Sep 23 04:52:40.460587 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:52:40.460587 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:52:40.460587 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: c912fb9d1f5447d180a9e8568220526f Sep 23 04:52:40.460587 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ServersNegativeTestJSON-1102187211-project Sep 23 04:52:40.460587 n-d-846463-3 devstack@n-api.service[122699]: Sep 23 04:52:40.460587 n-d-846463-3 devstack@n-api.service[122699]: {"unpause": {}} Sep 23 04:52:40.460587 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:52:40.460587 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance a54cc9ce-072d-4d9d-88b8-2a558b2c1132 could not be found. Sep 23 04:52:40.460587 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': 'a54cc9ce-072d-4d9d-88b8-2a558b2c1132', 'body': {'unpause': {}}} Sep 23 04:52:40.460587 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:52:40.460587 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:52:40.460587 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:52:40.460587 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:52:40.460587 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:52:40.460587 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:52:40.460587 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 23 04:52:40.460587 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 23 04:52:40.460587 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a54cc9ce-072d-4d9d-88b8-2a558b2c1132 could not be found. Sep 23 04:52:40.460587 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:52:40.460587 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:52:40.460587 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:52:40.460587 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:52:40.460587 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:52:40.460587 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:52:40.460587 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:52:40.460587 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:52:40.460587 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:52:40.460587 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:52:40.460587 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Sep 23 04:52:40.460587 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Sep 23 04:52:40.460587 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:52:40.460587 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:52:40.460587 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a54cc9ce-072d-4d9d-88b8-2a558b2c1132 could not be found. Sep 23 04:52:40.460587 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:52:40.460587 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:52:40.460587 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:52:40.460587 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:52:40.460587 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:52:40.460587 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:52:40.465417 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:52:40.465417 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:52:40.465417 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a54cc9ce-072d-4d9d-88b8-2a558b2c1132 could not be found. Sep 23 04:52:40.465417 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:52:40.481808 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ab85cf3e-32a1-4936-b4ed-1d23e728417e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Returning 404 to user: Instance a54cc9ce-072d-4d9d-88b8-2a558b2c1132 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:52:40.484985 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ab85cf3e-32a1-4936-b4ed-1d23e728417e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "POST /compute/v2.1/servers/a54cc9ce-072d-4d9d-88b8-2a558b2c1132/action" status: 404 len: 111 microversion: 2.1 time: 0.067235 Sep 23 04:52:40.485124 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d6c0cc0e-abd7-44e0-aee6-235d3706d3a0 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:40.488343 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2453/4770] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:52:40 2022] POST /compute/v2.1/servers/a54cc9ce-072d-4d9d-88b8-2a558b2c1132/action => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:52:40.494947 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d6c0cc0e-abd7-44e0-aee6-235d3706d3a0 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:40.501209 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d6c0cc0e-abd7-44e0-aee6-235d3706d3a0 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:40.503673 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d6c0cc0e-abd7-44e0-aee6-235d3706d3a0 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141" status: 200 len: 1740 microversion: 2.20 time: 0.386661 Sep 23 04:52:40.504795 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-54c6c7d6-338e-4239-8dd1-38f467611471 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:40.513579 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-54c6c7d6-338e-4239-8dd1-38f467611471 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:40.526214 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-54c6c7d6-338e-4239-8dd1-38f467611471 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:40.527798 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-54c6c7d6-338e-4239-8dd1-38f467611471 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:40.527798 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-54c6c7d6-338e-4239-8dd1-38f467611471 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:40.527990 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-54c6c7d6-338e-4239-8dd1-38f467611471 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:40.531632 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2318/4771] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:52:40 2022] GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141 => generated 1740 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:52:40.534934 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-54c6c7d6-338e-4239-8dd1-38f467611471 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:40.535512 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-54c6c7d6-338e-4239-8dd1-38f467611471 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:40.536534 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2d036f4d-802f-40af-bfd6-b09468874df0 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:40.537161 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-2d036f4d-802f-40af-bfd6-b09468874df0 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:40.569669 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2d036f4d-802f-40af-bfd6-b09468874df0 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:40.570129 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2d036f4d-802f-40af-bfd6-b09468874df0 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:40.570574 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2d036f4d-802f-40af-bfd6-b09468874df0 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:40.571479 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2d036f4d-802f-40af-bfd6-b09468874df0 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:40.572102 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2d036f4d-802f-40af-bfd6-b09468874df0 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:40.572712 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2d036f4d-802f-40af-bfd6-b09468874df0 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:41.001349 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-54c6c7d6-338e-4239-8dd1-38f467611471 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:41.017373 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-54c6c7d6-338e-4239-8dd1-38f467611471 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b" status: 200 len: 1513 microversion: 2.1 time: 0.524986 Sep 23 04:52:41.018984 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2454/4772] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:40 2022] GET /compute/v2.1/servers/c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b => generated 1513 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:52:41.024936 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-99060bf2-9ef4-436a-a031-723b1aab6d15 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:41.025919 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-99060bf2-9ef4-436a-a031-723b1aab6d15 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:41.026904 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-2d036f4d-802f-40af-bfd6-b09468874df0 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:41.045601 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2d036f4d-802f-40af-bfd6-b09468874df0 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1672 microversion: 2.1 time: 0.512783 Sep 23 04:52:41.047620 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2319/4773] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:40 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1672 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:52:41.077379 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-99060bf2-9ef4-436a-a031-723b1aab6d15 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:41.077379 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-99060bf2-9ef4-436a-a031-723b1aab6d15 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:41.077379 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-99060bf2-9ef4-436a-a031-723b1aab6d15 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:41.077379 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-99060bf2-9ef4-436a-a031-723b1aab6d15 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:41.077379 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-99060bf2-9ef4-436a-a031-723b1aab6d15 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:41.077379 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-99060bf2-9ef4-436a-a031-723b1aab6d15 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:41.082338 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-abe4fadd-0cc9-49ea-8ae9-01d7e5b5574e tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:41.082969 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-abe4fadd-0cc9-49ea-8ae9-01d7e5b5574e tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] [instance: 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:41.096828 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-abe4fadd-0cc9-49ea-8ae9-01d7e5b5574e tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:41.097336 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-abe4fadd-0cc9-49ea-8ae9-01d7e5b5574e tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:41.097837 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-abe4fadd-0cc9-49ea-8ae9-01d7e5b5574e tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:41.098546 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-abe4fadd-0cc9-49ea-8ae9-01d7e5b5574e tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:41.103364 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-abe4fadd-0cc9-49ea-8ae9-01d7e5b5574e tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:41.106753 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-abe4fadd-0cc9-49ea-8ae9-01d7e5b5574e tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:41.461139 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-99060bf2-9ef4-436a-a031-723b1aab6d15 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:41.473142 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-99060bf2-9ef4-436a-a031-723b1aab6d15 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1503 microversion: 2.1 time: 0.452612 Sep 23 04:52:41.475351 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2455/4774] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:41 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1503 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:52:41.505740 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2692b43c-e7a3-4e06-858c-0e14813c16ba tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:41.511988 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-2692b43c-e7a3-4e06-858c-0e14813c16ba tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:41.516921 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2692b43c-e7a3-4e06-858c-0e14813c16ba tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:41.517427 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2692b43c-e7a3-4e06-858c-0e14813c16ba tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:41.520728 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2692b43c-e7a3-4e06-858c-0e14813c16ba tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:41.521488 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2692b43c-e7a3-4e06-858c-0e14813c16ba tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:41.524534 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2692b43c-e7a3-4e06-858c-0e14813c16ba tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:41.525312 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2692b43c-e7a3-4e06-858c-0e14813c16ba tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:41.577671 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-abe4fadd-0cc9-49ea-8ae9-01d7e5b5574e tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:41.594621 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-abe4fadd-0cc9-49ea-8ae9-01d7e5b5574e tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:41.596518 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-abe4fadd-0cc9-49ea-8ae9-01d7e5b5574e tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:41.603716 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-abe4fadd-0cc9-49ea-8ae9-01d7e5b5574e tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] 10.222.0.33 "GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7" status: 200 len: 1878 microversion: 2.32 time: 0.534493 Sep 23 04:52:41.604432 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2320/4775] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:52:41 2022] GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 => generated 1878 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:52:41.622039 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a24a440f-9bb3-4107-abba-05e6bccf1210 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:41.625433 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a24a440f-9bb3-4107-abba-05e6bccf1210 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: f285e256-0a0e-4126-8adf-643bd59ca141] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:41.642785 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a24a440f-9bb3-4107-abba-05e6bccf1210 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:41.643669 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a24a440f-9bb3-4107-abba-05e6bccf1210 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:41.644438 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a24a440f-9bb3-4107-abba-05e6bccf1210 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:41.645394 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a24a440f-9bb3-4107-abba-05e6bccf1210 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:41.646126 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a24a440f-9bb3-4107-abba-05e6bccf1210 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:41.646788 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a24a440f-9bb3-4107-abba-05e6bccf1210 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:41.870752 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2692b43c-e7a3-4e06-858c-0e14813c16ba tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:41.879835 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2692b43c-e7a3-4e06-858c-0e14813c16ba tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1503 microversion: 2.1 time: 0.379368 Sep 23 04:52:41.887007 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2456/4776] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:41 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1503 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:52:41.917155 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-363ae6bd-6295-481c-a486-8c78e65da562 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:52:41.918103 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-363ae6bd-6295-481c-a486-8c78e65da562 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:41.927703 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-363ae6bd-6295-481c-a486-8c78e65da562 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:41.928652 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-363ae6bd-6295-481c-a486-8c78e65da562 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:41.931881 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-363ae6bd-6295-481c-a486-8c78e65da562 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:41.932944 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-363ae6bd-6295-481c-a486-8c78e65da562 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:41.933651 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-363ae6bd-6295-481c-a486-8c78e65da562 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:41.936973 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-363ae6bd-6295-481c-a486-8c78e65da562 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:41.991379 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-363ae6bd-6295-481c-a486-8c78e65da562 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] HTTP exception thrown: Cannot 'unpause' instance a9f2ff08-c66d-4991-9bae-d523a3adb8bf while it is in vm_state active Sep 23 04:52:41.997779 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a24a440f-9bb3-4107-abba-05e6bccf1210 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:42.015166 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-363ae6bd-6295-481c-a486-8c78e65da562 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Request method failure captured: Sep 23 04:52:42.015166 n-d-846463-3 devstack@n-api.service[122699]: request: POST /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf/action HTTP/1.1 Sep 23 04:52:42.015166 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:52:42.015166 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:52:42.015166 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:52:42.015166 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 15 Sep 23 04:52:42.015166 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:52:42.015166 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:52:42.015166 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:52:42.015166 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:52:42.015166 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTrDoGx96bSja4ydTGD-VWXTOyHeLiBA9Lvr197ivKeXqtV3OksEUUEiEPXK85IMwWXM1vCTp1M9PaXnUkKbFev29d-fL5KKXR0MfyGa86SLKINg6u_gn5EQLUNZ8EVLCkU1WwJ7agpVlFY75EyJH0fBcxrNg1yvFbeC2alzdH4Tkmw Sep 23 04:52:42.015166 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:52:42.015166 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:52:42.015166 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:52:42.015166 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:52:42.015166 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:52:42.015166 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:52:42.015166 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 78dca47156ff4f19a8673b893c853978 Sep 23 04:52:42.015166 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:52:42.015166 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:52:42.015166 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:52:42.015166 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_78dca47156ff4f19a8673b893c853978", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/78dca47156ff4f19a8673b893c853978"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/78dca47156ff4f19a8673b893c853978"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/78dca47156ff4f19a8673b893c853978"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:52:42.015166 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:52:42.015166 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 78dca47156ff4f19a8673b893c853978 Sep 23 04:52:42.015166 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:52:42.015166 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ServersNegativeTestJSON-1102187211-project Sep 23 04:52:42.015166 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:52:42.015166 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:52:42.015166 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: c912fb9d1f5447d180a9e8568220526f Sep 23 04:52:42.015166 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ServersNegativeTestJSON-1102187211-project Sep 23 04:52:42.015166 n-d-846463-3 devstack@n-api.service[122699]: Sep 23 04:52:42.015166 n-d-846463-3 devstack@n-api.service[122699]: {"unpause": {}} Sep 23 04:52:42.015166 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:52:42.015166 n-d-846463-3 devstack@n-api.service[122699]: exception: Cannot 'unpause' instance a9f2ff08-c66d-4991-9bae-d523a3adb8bf while it is in vm_state active Sep 23 04:52:42.015166 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': 'a9f2ff08-c66d-4991-9bae-d523a3adb8bf', 'body': {'unpause': {}}} Sep 23 04:52:42.015166 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:52:42.015166 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:52:42.015166 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Sep 23 04:52:42.015166 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Sep 23 04:52:42.015166 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 23 04:52:42.015166 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 23 04:52:42.015166 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 23 04:52:42.015166 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 23 04:52:42.015166 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a9f2ff08-c66d-4991-9bae-d523a3adb8bf in vm_state active. Cannot unpause while the instance is in this state. Sep 23 04:52:42.015166 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:52:42.015166 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:52:42.015166 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:52:42.015166 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:52:42.015166 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:52:42.015166 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:52:42.015166 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:52:42.015166 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:52:42.015166 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:52:42.015166 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:52:42.015166 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Sep 23 04:52:42.015166 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 23 04:52:42.015166 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 23 04:52:42.015166 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 23 04:52:42.015166 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance a9f2ff08-c66d-4991-9bae-d523a3adb8bf while it is in vm_state active Sep 23 04:52:42.015166 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:52:42.015166 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:52:42.015166 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:52:42.015166 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:52:42.015166 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:52:42.019581 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:52:42.019581 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:52:42.019581 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:52:42.019581 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance a9f2ff08-c66d-4991-9bae-d523a3adb8bf while it is in vm_state active Sep 23 04:52:42.019581 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:52:42.022235 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a24a440f-9bb3-4107-abba-05e6bccf1210 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:42.024215 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a24a440f-9bb3-4107-abba-05e6bccf1210 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:42.025257 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-363ae6bd-6295-481c-a486-8c78e65da562 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Returning 409 to user: Cannot 'unpause' instance a9f2ff08-c66d-4991-9bae-d523a3adb8bf while it is in vm_state active {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:52:42.027246 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a24a440f-9bb3-4107-abba-05e6bccf1210 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141" status: 200 len: 1740 microversion: 2.20 time: 0.421749 Sep 23 04:52:42.028038 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-363ae6bd-6295-481c-a486-8c78e65da562 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "POST /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf/action" status: 409 len: 145 microversion: 2.1 time: 0.116129 Sep 23 04:52:42.029536 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2321/4777] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:52:41 2022] GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141 => generated 1740 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:52:42.030101 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2457/4778] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:52:41 2022] POST /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf/action => generated 145 bytes in 119 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 23 04:52:42.045860 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-264f4c28-ee6e-4bc4-aa98-96c2b6cd59cf tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:42.046898 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-264f4c28-ee6e-4bc4-aa98-96c2b6cd59cf tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:42.050967 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a77ce4c7-1c1c-4087-846c-a396c341c20d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:42.051605 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a77ce4c7-1c1c-4087-846c-a396c341c20d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:42.054900 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-264f4c28-ee6e-4bc4-aa98-96c2b6cd59cf tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:42.057316 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-264f4c28-ee6e-4bc4-aa98-96c2b6cd59cf tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:42.058081 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-264f4c28-ee6e-4bc4-aa98-96c2b6cd59cf tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:42.059062 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-264f4c28-ee6e-4bc4-aa98-96c2b6cd59cf tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:42.060920 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-264f4c28-ee6e-4bc4-aa98-96c2b6cd59cf tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:42.061343 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a77ce4c7-1c1c-4087-846c-a396c341c20d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:42.063782 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-264f4c28-ee6e-4bc4-aa98-96c2b6cd59cf tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:42.065920 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a77ce4c7-1c1c-4087-846c-a396c341c20d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:42.071763 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a77ce4c7-1c1c-4087-846c-a396c341c20d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:42.071763 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a77ce4c7-1c1c-4087-846c-a396c341c20d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:42.071763 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a77ce4c7-1c1c-4087-846c-a396c341c20d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:42.071763 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a77ce4c7-1c1c-4087-846c-a396c341c20d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:42.404803 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a77ce4c7-1c1c-4087-846c-a396c341c20d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:42.411987 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-264f4c28-ee6e-4bc4-aa98-96c2b6cd59cf tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:42.419162 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a77ce4c7-1c1c-4087-846c-a396c341c20d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b" status: 200 len: 1513 microversion: 2.1 time: 0.377519 Sep 23 04:52:42.420365 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2322/4779] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:42 2022] GET /compute/v2.1/servers/c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b => generated 1513 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:52:42.441032 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-264f4c28-ee6e-4bc4-aa98-96c2b6cd59cf tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1503 microversion: 2.1 time: 0.406244 Sep 23 04:52:42.442336 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2458/4780] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:42 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1503 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:52:42.446862 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-926525de-717e-447f-bda1-4d923d1092aa tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:42.465860 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-926525de-717e-447f-bda1-4d923d1092aa tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:42.478114 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c56d367f-ee44-4af1-97f0-7aa5e0b21929 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:42.479321 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c56d367f-ee44-4af1-97f0-7aa5e0b21929 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:42.484024 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-926525de-717e-447f-bda1-4d923d1092aa tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:42.486444 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-926525de-717e-447f-bda1-4d923d1092aa tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:42.491492 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-926525de-717e-447f-bda1-4d923d1092aa tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:42.492255 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c56d367f-ee44-4af1-97f0-7aa5e0b21929 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:42.493092 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c56d367f-ee44-4af1-97f0-7aa5e0b21929 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:42.493787 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c56d367f-ee44-4af1-97f0-7aa5e0b21929 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:42.498866 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-926525de-717e-447f-bda1-4d923d1092aa tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:42.498866 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-926525de-717e-447f-bda1-4d923d1092aa tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:42.499127 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c56d367f-ee44-4af1-97f0-7aa5e0b21929 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:42.499226 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-926525de-717e-447f-bda1-4d923d1092aa tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:42.499317 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c56d367f-ee44-4af1-97f0-7aa5e0b21929 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:42.499317 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c56d367f-ee44-4af1-97f0-7aa5e0b21929 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:42.900833 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c56d367f-ee44-4af1-97f0-7aa5e0b21929 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:42.927106 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c56d367f-ee44-4af1-97f0-7aa5e0b21929 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1503 microversion: 2.1 time: 0.445945 Sep 23 04:52:42.929409 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2459/4781] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:42 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1503 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:52:42.967106 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2df6310e-aee6-4657-8e47-7f3be133334e tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:42.970939 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-2df6310e-aee6-4657-8e47-7f3be133334e tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] [instance: 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:42.989930 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2df6310e-aee6-4657-8e47-7f3be133334e tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:42.993342 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2df6310e-aee6-4657-8e47-7f3be133334e tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:42.994172 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2df6310e-aee6-4657-8e47-7f3be133334e tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:42.996418 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2df6310e-aee6-4657-8e47-7f3be133334e tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:42.997203 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2df6310e-aee6-4657-8e47-7f3be133334e tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:43.000023 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2df6310e-aee6-4657-8e47-7f3be133334e tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:43.033577 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-926525de-717e-447f-bda1-4d923d1092aa tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:43.051762 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-926525de-717e-447f-bda1-4d923d1092aa tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1677 microversion: 2.1 time: 0.627023 Sep 23 04:52:43.074078 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2323/4782] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:42 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1677 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:52:43.087915 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d22179bb-fcbb-4bbf-a4d7-066f97cba8d7 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:52:43.101921 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d22179bb-fcbb-4bbf-a4d7-066f97cba8d7 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: 0cb2ea0a-b7de-4e50-82fe-bf49c061b200] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:43.115923 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:52:43.130755 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-d22179bb-fcbb-4bbf-a4d7-066f97cba8d7 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] HTTP exception thrown: Instance 0cb2ea0a-b7de-4e50-82fe-bf49c061b200 could not be found. Sep 23 04:52:43.130755 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d22179bb-fcbb-4bbf-a4d7-066f97cba8d7 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Request method failure captured: Sep 23 04:52:43.130755 n-d-846463-3 devstack@n-api.service[122698]: request: POST /compute/v2.1/servers/0cb2ea0a-b7de-4e50-82fe-bf49c061b200/action HTTP/1.1 Sep 23 04:52:43.130755 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:52:43.130755 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:52:43.130755 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:52:43.130755 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 18 Sep 23 04:52:43.130755 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:52:43.130755 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:52:43.130755 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:52:43.130755 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:52:43.130755 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTrDoGx96bSja4ydTGD-VWXTOyHeLiBA9Lvr197ivKeXqtV3OksEUUEiEPXK85IMwWXM1vCTp1M9PaXnUkKbFev29d-fL5KKXR0MfyGa86SLKINg6u_gn5EQLUNZ8EVLCkU1WwJ7agpVlFY75EyJH0fBcxrNg1yvFbeC2alzdH4Tkmw Sep 23 04:52:43.130755 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:52:43.130755 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:52:43.130755 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:52:43.130755 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:52:43.130755 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:52:43.130755 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:52:43.130755 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 78dca47156ff4f19a8673b893c853978 Sep 23 04:52:43.130755 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:52:43.130755 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:52:43.130755 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:52:43.130755 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_78dca47156ff4f19a8673b893c853978", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/78dca47156ff4f19a8673b893c853978"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/78dca47156ff4f19a8673b893c853978"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/78dca47156ff4f19a8673b893c853978"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:52:43.130755 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:52:43.130755 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 78dca47156ff4f19a8673b893c853978 Sep 23 04:52:43.130755 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:52:43.130755 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ServersNegativeTestJSON-1102187211-project Sep 23 04:52:43.130755 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:52:43.130755 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:52:43.130755 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: c912fb9d1f5447d180a9e8568220526f Sep 23 04:52:43.130755 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ServersNegativeTestJSON-1102187211-project Sep 23 04:52:43.130755 n-d-846463-3 devstack@n-api.service[122698]: Sep 23 04:52:43.130755 n-d-846463-3 devstack@n-api.service[122698]: {"unshelve": null} Sep 23 04:52:43.130755 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:52:43.130755 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 0cb2ea0a-b7de-4e50-82fe-bf49c061b200 could not be found. Sep 23 04:52:43.130755 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '0cb2ea0a-b7de-4e50-82fe-bf49c061b200', 'body': {'unshelve': None}} Sep 23 04:52:43.130755 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:52:43.130755 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:52:43.130755 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:52:43.130755 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:52:43.130755 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:52:43.130755 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:52:43.130755 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 23 04:52:43.130755 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 23 04:52:43.130755 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cb2ea0a-b7de-4e50-82fe-bf49c061b200 could not be found. Sep 23 04:52:43.130755 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:52:43.130755 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:52:43.130755 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:52:43.130755 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:52:43.130755 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:52:43.130755 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:52:43.130755 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:52:43.130755 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:52:43.130755 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:52:43.130755 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:52:43.130755 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:52:43.130755 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:52:43.130755 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:52:43.130755 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:52:43.130755 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Sep 23 04:52:43.130755 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 23 04:52:43.130755 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:52:43.130755 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:52:43.135553 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cb2ea0a-b7de-4e50-82fe-bf49c061b200 could not be found. Sep 23 04:52:43.135553 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:52:43.135553 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:52:43.135553 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:52:43.135553 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:52:43.135553 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:52:43.135553 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:52:43.135553 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:52:43.135553 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:52:43.135553 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cb2ea0a-b7de-4e50-82fe-bf49c061b200 could not be found. Sep 23 04:52:43.135553 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:52:43.135553 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d22179bb-fcbb-4bbf-a4d7-066f97cba8d7 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Returning 404 to user: Instance 0cb2ea0a-b7de-4e50-82fe-bf49c061b200 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:52:43.135553 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d22179bb-fcbb-4bbf-a4d7-066f97cba8d7 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "POST /compute/v2.1/servers/0cb2ea0a-b7de-4e50-82fe-bf49c061b200/action" status: 404 len: 111 microversion: 2.1 time: 0.052751 Sep 23 04:52:43.135553 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2324/4783] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:52:43 2022] POST /compute/v2.1/servers/0cb2ea0a-b7de-4e50-82fe-bf49c061b200/action => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:52:43.148779 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8c824d39-cd4e-4317-943f-0941864bebfb tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:43.149412 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8c824d39-cd4e-4317-943f-0941864bebfb tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: f285e256-0a0e-4126-8adf-643bd59ca141] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:43.161596 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8c824d39-cd4e-4317-943f-0941864bebfb tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:43.166482 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8c824d39-cd4e-4317-943f-0941864bebfb tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:43.167972 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8c824d39-cd4e-4317-943f-0941864bebfb tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:43.168922 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8c824d39-cd4e-4317-943f-0941864bebfb tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:43.171704 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8c824d39-cd4e-4317-943f-0941864bebfb tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:43.172315 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8c824d39-cd4e-4317-943f-0941864bebfb tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:43.601640 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2df6310e-aee6-4657-8e47-7f3be133334e tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:43.601640 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2df6310e-aee6-4657-8e47-7f3be133334e tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:43.601640 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2df6310e-aee6-4657-8e47-7f3be133334e tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:43.601640 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2df6310e-aee6-4657-8e47-7f3be133334e tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] 10.222.0.33 "GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7" status: 200 len: 1878 microversion: 2.32 time: 0.568948 Sep 23 04:52:43.601640 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2460/4784] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:52:42 2022] GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 => generated 1878 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:52:43.601640 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-875d6497-cd2a-42c0-8c96-74930f77ec87 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:43.601640 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-875d6497-cd2a-42c0-8c96-74930f77ec87 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:43.601640 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-875d6497-cd2a-42c0-8c96-74930f77ec87 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:43.601640 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-875d6497-cd2a-42c0-8c96-74930f77ec87 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:43.601640 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-875d6497-cd2a-42c0-8c96-74930f77ec87 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:43.601640 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-875d6497-cd2a-42c0-8c96-74930f77ec87 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:43.603161 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-875d6497-cd2a-42c0-8c96-74930f77ec87 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:43.603161 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-875d6497-cd2a-42c0-8c96-74930f77ec87 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:43.603161 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:52:43.603511 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8c824d39-cd4e-4317-943f-0941864bebfb tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:43.603511 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8c824d39-cd4e-4317-943f-0941864bebfb tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:43.603511 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8c824d39-cd4e-4317-943f-0941864bebfb tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:43.603511 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8c824d39-cd4e-4317-943f-0941864bebfb tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141" status: 200 len: 1740 microversion: 2.20 time: 0.450763 Sep 23 04:52:43.603511 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2325/4785] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:52:43 2022] GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141 => generated 1740 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:52:43.603511 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c76f6cc7-65c7-4af5-8a2f-2eba8d7f9009 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:43.603511 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c76f6cc7-65c7-4af5-8a2f-2eba8d7f9009 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:43.603511 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c76f6cc7-65c7-4af5-8a2f-2eba8d7f9009 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:43.603511 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c76f6cc7-65c7-4af5-8a2f-2eba8d7f9009 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:43.603511 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c76f6cc7-65c7-4af5-8a2f-2eba8d7f9009 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:43.603511 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c76f6cc7-65c7-4af5-8a2f-2eba8d7f9009 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:43.604540 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c76f6cc7-65c7-4af5-8a2f-2eba8d7f9009 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:43.604540 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c76f6cc7-65c7-4af5-8a2f-2eba8d7f9009 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:43.872305 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c76f6cc7-65c7-4af5-8a2f-2eba8d7f9009 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:43.886900 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c76f6cc7-65c7-4af5-8a2f-2eba8d7f9009 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b" status: 200 len: 1513 microversion: 2.1 time: 0.300419 Sep 23 04:52:43.888476 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2326/4786] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:43 2022] GET /compute/v2.1/servers/c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b => generated 1513 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:52:43.894012 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-875d6497-cd2a-42c0-8c96-74930f77ec87 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:43.903456 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-875d6497-cd2a-42c0-8c96-74930f77ec87 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1503 microversion: 2.1 time: 0.375357 Sep 23 04:52:43.919256 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2461/4787] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:43 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1503 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:52:43.931364 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-47001ac7-7ebe-421f-a803-f0edc9744877 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:43.932325 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-47001ac7-7ebe-421f-a803-f0edc9744877 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:43.942909 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-47001ac7-7ebe-421f-a803-f0edc9744877 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:43.943771 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-47001ac7-7ebe-421f-a803-f0edc9744877 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:43.944437 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-47001ac7-7ebe-421f-a803-f0edc9744877 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:43.945407 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-47001ac7-7ebe-421f-a803-f0edc9744877 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:43.946333 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-47001ac7-7ebe-421f-a803-f0edc9744877 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:43.946990 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-47001ac7-7ebe-421f-a803-f0edc9744877 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:44.086308 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-08acad66-770d-482f-88e0-584e76c77064 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:44.087823 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-08acad66-770d-482f-88e0-584e76c77064 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:44.096689 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-08acad66-770d-482f-88e0-584e76c77064 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:44.098459 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-08acad66-770d-482f-88e0-584e76c77064 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:44.100288 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-08acad66-770d-482f-88e0-584e76c77064 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:44.102190 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-08acad66-770d-482f-88e0-584e76c77064 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:44.105247 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-08acad66-770d-482f-88e0-584e76c77064 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:44.106532 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-08acad66-770d-482f-88e0-584e76c77064 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:44.192484 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-47001ac7-7ebe-421f-a803-f0edc9744877 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:44.204878 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-47001ac7-7ebe-421f-a803-f0edc9744877 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1503 microversion: 2.1 time: 0.277054 Sep 23 04:52:44.224053 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2327/4788] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:43 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1503 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:52:44.233524 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-59562bcf-5c75-4c76-9e80-9da68cfa877d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:52:44.235252 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-59562bcf-5c75-4c76-9e80-9da68cfa877d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:44.252388 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-59562bcf-5c75-4c76-9e80-9da68cfa877d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:44.256213 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-59562bcf-5c75-4c76-9e80-9da68cfa877d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:44.256920 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-59562bcf-5c75-4c76-9e80-9da68cfa877d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:44.257695 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-59562bcf-5c75-4c76-9e80-9da68cfa877d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:44.258190 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-59562bcf-5c75-4c76-9e80-9da68cfa877d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:44.258630 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-59562bcf-5c75-4c76-9e80-9da68cfa877d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:44.330459 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-59562bcf-5c75-4c76-9e80-9da68cfa877d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] HTTP exception thrown: Cannot 'unshelve' instance a9f2ff08-c66d-4991-9bae-d523a3adb8bf while it is in vm_state active Sep 23 04:52:44.332062 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-59562bcf-5c75-4c76-9e80-9da68cfa877d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Request method failure captured: Sep 23 04:52:44.332062 n-d-846463-3 devstack@n-api.service[122698]: request: POST /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf/action HTTP/1.1 Sep 23 04:52:44.332062 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:52:44.332062 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:52:44.332062 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:52:44.332062 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 18 Sep 23 04:52:44.332062 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:52:44.332062 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:52:44.332062 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:52:44.332062 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:52:44.332062 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTrDoGx96bSja4ydTGD-VWXTOyHeLiBA9Lvr197ivKeXqtV3OksEUUEiEPXK85IMwWXM1vCTp1M9PaXnUkKbFev29d-fL5KKXR0MfyGa86SLKINg6u_gn5EQLUNZ8EVLCkU1WwJ7agpVlFY75EyJH0fBcxrNg1yvFbeC2alzdH4Tkmw Sep 23 04:52:44.332062 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:52:44.332062 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:52:44.332062 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:52:44.332062 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:52:44.332062 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:52:44.332062 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:52:44.332062 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 78dca47156ff4f19a8673b893c853978 Sep 23 04:52:44.332062 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:52:44.332062 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:52:44.332062 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:52:44.332062 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_78dca47156ff4f19a8673b893c853978", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/78dca47156ff4f19a8673b893c853978"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/78dca47156ff4f19a8673b893c853978"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/78dca47156ff4f19a8673b893c853978"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:52:44.332062 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:52:44.332062 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 78dca47156ff4f19a8673b893c853978 Sep 23 04:52:44.332062 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:52:44.332062 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ServersNegativeTestJSON-1102187211-project Sep 23 04:52:44.332062 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:52:44.332062 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:52:44.332062 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: c912fb9d1f5447d180a9e8568220526f Sep 23 04:52:44.332062 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ServersNegativeTestJSON-1102187211-project Sep 23 04:52:44.332062 n-d-846463-3 devstack@n-api.service[122698]: Sep 23 04:52:44.332062 n-d-846463-3 devstack@n-api.service[122698]: {"unshelve": null} Sep 23 04:52:44.332062 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:52:44.332062 n-d-846463-3 devstack@n-api.service[122698]: exception: Cannot 'unshelve' instance a9f2ff08-c66d-4991-9bae-d523a3adb8bf while it is in vm_state active Sep 23 04:52:44.332062 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': 'a9f2ff08-c66d-4991-9bae-d523a3adb8bf', 'body': {'unshelve': None}} Sep 23 04:52:44.332062 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:52:44.332062 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:52:44.332062 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Sep 23 04:52:44.332062 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Sep 23 04:52:44.332062 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 23 04:52:44.332062 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 23 04:52:44.332062 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 23 04:52:44.332062 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 23 04:52:44.332062 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 23 04:52:44.332062 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 23 04:52:44.332062 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a9f2ff08-c66d-4991-9bae-d523a3adb8bf in vm_state active. Cannot unshelve while the instance is in this state. Sep 23 04:52:44.332062 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:52:44.332062 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:52:44.332062 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:52:44.332062 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:52:44.332062 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:52:44.332062 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:52:44.332062 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:52:44.332062 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:52:44.332062 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:52:44.332062 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:52:44.332062 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:52:44.332062 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:52:44.332062 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:52:44.332062 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:52:44.332062 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Sep 23 04:52:44.332062 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Sep 23 04:52:44.332062 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 23 04:52:44.332062 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 23 04:52:44.335979 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance a9f2ff08-c66d-4991-9bae-d523a3adb8bf while it is in vm_state active Sep 23 04:52:44.335979 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:52:44.335979 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:52:44.335979 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:52:44.335979 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:52:44.335979 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:52:44.335979 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:52:44.335979 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:52:44.335979 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:52:44.335979 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance a9f2ff08-c66d-4991-9bae-d523a3adb8bf while it is in vm_state active Sep 23 04:52:44.335979 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:52:44.335979 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-59562bcf-5c75-4c76-9e80-9da68cfa877d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Returning 409 to user: Cannot 'unshelve' instance a9f2ff08-c66d-4991-9bae-d523a3adb8bf while it is in vm_state active {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:52:44.335979 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-59562bcf-5c75-4c76-9e80-9da68cfa877d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "POST /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf/action" status: 409 len: 146 microversion: 2.1 time: 0.105439 Sep 23 04:52:44.337559 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2328/4789] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:52:44 2022] POST /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf/action => generated 146 bytes in 110 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 23 04:52:44.345319 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-63d4fb26-74cd-4ed3-9fae-9b58f06b8c7c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:44.345982 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-63d4fb26-74cd-4ed3-9fae-9b58f06b8c7c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:44.352771 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-63d4fb26-74cd-4ed3-9fae-9b58f06b8c7c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:44.353269 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-63d4fb26-74cd-4ed3-9fae-9b58f06b8c7c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:44.353982 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-63d4fb26-74cd-4ed3-9fae-9b58f06b8c7c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:44.354925 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-63d4fb26-74cd-4ed3-9fae-9b58f06b8c7c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:44.355588 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-63d4fb26-74cd-4ed3-9fae-9b58f06b8c7c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:44.356790 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-63d4fb26-74cd-4ed3-9fae-9b58f06b8c7c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:44.366502 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-08acad66-770d-482f-88e0-584e76c77064 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:44.376572 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-08acad66-770d-482f-88e0-584e76c77064 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1670 microversion: 2.1 time: 0.294119 Sep 23 04:52:44.377460 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2462/4790] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:44 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1670 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:52:44.559643 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-63d4fb26-74cd-4ed3-9fae-9b58f06b8c7c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:44.562204 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:52:44.572614 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-63d4fb26-74cd-4ed3-9fae-9b58f06b8c7c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1503 microversion: 2.1 time: 0.233835 Sep 23 04:52:44.573391 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2329/4791] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:44 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1503 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:52:44.600523 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0ab11f25-317e-4d16-986d-ff884938b16b tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:44.601469 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-0ab11f25-317e-4d16-986d-ff884938b16b tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:44.609223 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0ab11f25-317e-4d16-986d-ff884938b16b tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:44.609827 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0ab11f25-317e-4d16-986d-ff884938b16b tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:44.610547 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0ab11f25-317e-4d16-986d-ff884938b16b tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:44.632721 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a9cfee4a-f06b-4542-9963-0b7f1599f054 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:44.632920 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0ab11f25-317e-4d16-986d-ff884938b16b tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:44.633028 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a9cfee4a-f06b-4542-9963-0b7f1599f054 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] [instance: 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:44.633125 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0ab11f25-317e-4d16-986d-ff884938b16b tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:44.633240 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0ab11f25-317e-4d16-986d-ff884938b16b tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:44.642970 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a9cfee4a-f06b-4542-9963-0b7f1599f054 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:44.643782 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a9cfee4a-f06b-4542-9963-0b7f1599f054 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:44.644386 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a9cfee4a-f06b-4542-9963-0b7f1599f054 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:44.645302 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a9cfee4a-f06b-4542-9963-0b7f1599f054 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:44.645953 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a9cfee4a-f06b-4542-9963-0b7f1599f054 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:44.646541 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a9cfee4a-f06b-4542-9963-0b7f1599f054 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:45.201607 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-0ab11f25-317e-4d16-986d-ff884938b16b tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:45.216227 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0ab11f25-317e-4d16-986d-ff884938b16b tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1503 microversion: 2.1 time: 0.619021 Sep 23 04:52:45.217535 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a9cfee4a-f06b-4542-9963-0b7f1599f054 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:45.230596 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2463/4792] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:44 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1503 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:52:45.239306 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-dee9abe1-2e61-401a-bb1f-5d3c0f36d0fd tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:45.240073 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-dee9abe1-2e61-401a-bb1f-5d3c0f36d0fd tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: f285e256-0a0e-4126-8adf-643bd59ca141] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:45.242488 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a9cfee4a-f06b-4542-9963-0b7f1599f054 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:45.243558 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a9cfee4a-f06b-4542-9963-0b7f1599f054 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:45.245199 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a9cfee4a-f06b-4542-9963-0b7f1599f054 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] 10.222.0.33 "GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7" status: 200 len: 1878 microversion: 2.32 time: 0.617747 Sep 23 04:52:45.247491 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2330/4793] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:52:44 2022] GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 => generated 1878 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:52:45.247647 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dee9abe1-2e61-401a-bb1f-5d3c0f36d0fd tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:45.247647 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dee9abe1-2e61-401a-bb1f-5d3c0f36d0fd tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:45.247818 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dee9abe1-2e61-401a-bb1f-5d3c0f36d0fd tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:45.248580 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dee9abe1-2e61-401a-bb1f-5d3c0f36d0fd tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:45.249464 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dee9abe1-2e61-401a-bb1f-5d3c0f36d0fd tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:45.250084 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dee9abe1-2e61-401a-bb1f-5d3c0f36d0fd tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:45.262241 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ce771964-ba41-48b9-aea2-5f2e46401537 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:45.268258 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-ce771964-ba41-48b9-aea2-5f2e46401537 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:45.279528 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ce771964-ba41-48b9-aea2-5f2e46401537 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:45.280038 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ce771964-ba41-48b9-aea2-5f2e46401537 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:45.280658 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ce771964-ba41-48b9-aea2-5f2e46401537 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:45.281576 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ce771964-ba41-48b9-aea2-5f2e46401537 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:45.282321 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ce771964-ba41-48b9-aea2-5f2e46401537 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:45.282972 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ce771964-ba41-48b9-aea2-5f2e46401537 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:45.567435 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-dee9abe1-2e61-401a-bb1f-5d3c0f36d0fd tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:45.579036 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-dee9abe1-2e61-401a-bb1f-5d3c0f36d0fd tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:45.581015 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-dee9abe1-2e61-401a-bb1f-5d3c0f36d0fd tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:45.585431 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-dee9abe1-2e61-401a-bb1f-5d3c0f36d0fd tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141" status: 200 len: 1740 microversion: 2.20 time: 0.350018 Sep 23 04:52:45.586711 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2464/4794] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:52:45 2022] GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141 => generated 1740 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:52:45.597237 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7d4b5c8d-1d7a-4126-aa4b-12b35de42e0d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1176519699_updated"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:52:45.624113 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ce771964-ba41-48b9-aea2-5f2e46401537 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:45.633837 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ce771964-ba41-48b9-aea2-5f2e46401537 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b" status: 200 len: 1513 microversion: 2.1 time: 0.386669 Sep 23 04:52:45.635099 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-7d4b5c8d-1d7a-4126-aa4b-12b35de42e0d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: 4289ec4d-9a17-4898-b383-dea19facf6f0] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:45.642098 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2331/4795] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:45 2022] GET /compute/v2.1/servers/c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b => generated 1513 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:52:45.655251 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-7d4b5c8d-1d7a-4126-aa4b-12b35de42e0d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] HTTP exception thrown: Instance 4289ec4d-9a17-4898-b383-dea19facf6f0 could not be found. Sep 23 04:52:45.663888 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7d4b5c8d-1d7a-4126-aa4b-12b35de42e0d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Request method failure captured: Sep 23 04:52:45.663888 n-d-846463-3 devstack@n-api.service[122699]: request: PUT /compute/v2.1/servers/4289ec4d-9a17-4898-b383-dea19facf6f0 HTTP/1.1 Sep 23 04:52:45.663888 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:52:45.663888 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:52:45.663888 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:52:45.663888 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 81 Sep 23 04:52:45.663888 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:52:45.663888 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:52:45.663888 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:52:45.663888 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:52:45.663888 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTrDoGx96bSja4ydTGD-VWXTOyHeLiBA9Lvr197ivKeXqtV3OksEUUEiEPXK85IMwWXM1vCTp1M9PaXnUkKbFev29d-fL5KKXR0MfyGa86SLKINg6u_gn5EQLUNZ8EVLCkU1WwJ7agpVlFY75EyJH0fBcxrNg1yvFbeC2alzdH4Tkmw Sep 23 04:52:45.663888 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:52:45.663888 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:52:45.663888 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:52:45.663888 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:52:45.663888 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:52:45.663888 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:52:45.663888 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 78dca47156ff4f19a8673b893c853978 Sep 23 04:52:45.663888 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:52:45.663888 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:52:45.663888 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:52:45.663888 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_78dca47156ff4f19a8673b893c853978", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/78dca47156ff4f19a8673b893c853978"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/78dca47156ff4f19a8673b893c853978"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/78dca47156ff4f19a8673b893c853978"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:52:45.663888 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:52:45.663888 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 78dca47156ff4f19a8673b893c853978 Sep 23 04:52:45.663888 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:52:45.663888 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ServersNegativeTestJSON-1102187211-project Sep 23 04:52:45.663888 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:52:45.663888 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:52:45.663888 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: c912fb9d1f5447d180a9e8568220526f Sep 23 04:52:45.663888 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ServersNegativeTestJSON-1102187211-project Sep 23 04:52:45.663888 n-d-846463-3 devstack@n-api.service[122699]: Sep 23 04:52:45.663888 n-d-846463-3 devstack@n-api.service[122699]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1176519699_updated"}} Sep 23 04:52:45.663888 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:52:45.663888 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 4289ec4d-9a17-4898-b383-dea19facf6f0 could not be found. Sep 23 04:52:45.663888 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '4289ec4d-9a17-4898-b383-dea19facf6f0', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1176519699_updated'}}} Sep 23 04:52:45.663888 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:52:45.663888 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:52:45.663888 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:52:45.663888 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:52:45.663888 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:52:45.663888 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:52:45.663888 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 23 04:52:45.663888 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 23 04:52:45.663888 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4289ec4d-9a17-4898-b383-dea19facf6f0 could not be found. Sep 23 04:52:45.663888 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:52:45.663888 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:52:45.663888 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:52:45.663888 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:52:45.663888 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:52:45.663888 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:52:45.663888 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:52:45.663888 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:52:45.663888 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:52:45.663888 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:52:45.663888 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:52:45.663888 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:52:45.663888 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:52:45.663888 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:52:45.663888 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:52:45.663888 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:52:45.663888 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 23 04:52:45.663888 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Sep 23 04:52:45.663888 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Sep 23 04:52:45.663888 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:52:45.670131 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:52:45.670131 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:52:45.670131 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:52:45.670131 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4289ec4d-9a17-4898-b383-dea19facf6f0 could not be found. Sep 23 04:52:45.670131 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:52:45.670131 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:52:45.670131 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:52:45.670131 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:52:45.670131 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:52:45.670131 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:52:45.670131 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:52:45.670131 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:52:45.670131 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4289ec4d-9a17-4898-b383-dea19facf6f0 could not be found. Sep 23 04:52:45.670131 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:52:45.670131 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7d4b5c8d-1d7a-4126-aa4b-12b35de42e0d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Returning 404 to user: Instance 4289ec4d-9a17-4898-b383-dea19facf6f0 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:52:45.670131 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-7d4b5c8d-1d7a-4126-aa4b-12b35de42e0d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "PUT /compute/v2.1/servers/4289ec4d-9a17-4898-b383-dea19facf6f0" status: 404 len: 111 microversion: 2.1 time: 0.078688 Sep 23 04:52:45.670131 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2465/4796] 10.222.0.33 () {60 vars in 1256 bytes} [Fri Sep 23 04:52:45 2022] PUT /compute/v2.1/servers/4289ec4d-9a17-4898-b383-dea19facf6f0 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:52:45.678627 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8d6ec33b-998d-4754-936d-2754c5aababe tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:45.679243 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8d6ec33b-998d-4754-936d-2754c5aababe tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:45.691923 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8d6ec33b-998d-4754-936d-2754c5aababe tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:45.692418 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8d6ec33b-998d-4754-936d-2754c5aababe tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:45.692885 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8d6ec33b-998d-4754-936d-2754c5aababe tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:45.693580 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8d6ec33b-998d-4754-936d-2754c5aababe tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:45.694098 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8d6ec33b-998d-4754-936d-2754c5aababe tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:45.694522 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8d6ec33b-998d-4754-936d-2754c5aababe tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:45.928682 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8d6ec33b-998d-4754-936d-2754c5aababe tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:45.953425 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8d6ec33b-998d-4754-936d-2754c5aababe tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1503 microversion: 2.1 time: 0.278704 Sep 23 04:52:45.954341 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2332/4797] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:45 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1503 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:52:45.985302 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-931468c5-aa07-466c-8eef-8021efdaaf24 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:45.986730 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-931468c5-aa07-466c-8eef-8021efdaaf24 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:46.006574 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-931468c5-aa07-466c-8eef-8021efdaaf24 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:46.006574 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-931468c5-aa07-466c-8eef-8021efdaaf24 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:46.006982 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-931468c5-aa07-466c-8eef-8021efdaaf24 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:46.007679 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-931468c5-aa07-466c-8eef-8021efdaaf24 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:46.016207 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-931468c5-aa07-466c-8eef-8021efdaaf24 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:46.020822 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-931468c5-aa07-466c-8eef-8021efdaaf24 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:46.208862 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-931468c5-aa07-466c-8eef-8021efdaaf24 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:46.218904 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-931468c5-aa07-466c-8eef-8021efdaaf24 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1503 microversion: 2.1 time: 0.239414 Sep 23 04:52:46.220072 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2466/4798] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:45 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1503 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:52:46.247382 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c8278772-4000-4764-a54e-fa6d188036f5 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:52:46.272257 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c8278772-4000-4764-a54e-fa6d188036f5 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Request method failure captured: Sep 23 04:52:46.272257 n-d-846463-3 devstack@n-api.service[122698]: request: PUT /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf HTTP/1.1 Sep 23 04:52:46.272257 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:52:46.272257 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:52:46.272257 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:52:46.272257 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 280 Sep 23 04:52:46.272257 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:52:46.272257 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:52:46.272257 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:52:46.272257 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:52:46.272257 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTrDoGx96bSja4ydTGD-VWXTOyHeLiBA9Lvr197ivKeXqtV3OksEUUEiEPXK85IMwWXM1vCTp1M9PaXnUkKbFev29d-fL5KKXR0MfyGa86SLKINg6u_gn5EQLUNZ8EVLCkU1WwJ7agpVlFY75EyJH0fBcxrNg1yvFbeC2alzdH4Tkmw Sep 23 04:52:46.272257 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:52:46.272257 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:52:46.272257 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:52:46.272257 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:52:46.272257 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:52:46.272257 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:52:46.272257 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 78dca47156ff4f19a8673b893c853978 Sep 23 04:52:46.272257 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:52:46.272257 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:52:46.272257 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:52:46.272257 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_78dca47156ff4f19a8673b893c853978", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/78dca47156ff4f19a8673b893c853978"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/78dca47156ff4f19a8673b893c853978"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/78dca47156ff4f19a8673b893c853978"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:52:46.272257 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:52:46.272257 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 78dca47156ff4f19a8673b893c853978 Sep 23 04:52:46.272257 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:52:46.272257 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ServersNegativeTestJSON-1102187211-project Sep 23 04:52:46.272257 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:52:46.272257 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:52:46.272257 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: c912fb9d1f5447d180a9e8568220526f Sep 23 04:52:46.272257 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ServersNegativeTestJSON-1102187211-project Sep 23 04:52:46.272257 n-d-846463-3 devstack@n-api.service[122698]: Sep 23 04:52:46.272257 n-d-846463-3 devstack@n-api.service[122698]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Sep 23 04:52:46.272257 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:52:46.272257 n-d-846463-3 devstack@n-api.service[122698]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 23 04:52:46.272257 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': 'a9f2ff08-c66d-4991-9bae-d523a3adb8bf', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Sep 23 04:52:46.272257 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:52:46.272257 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:52:46.272257 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 23 04:52:46.272257 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 23 04:52:46.272257 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 23 04:52:46.272257 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise error Sep 23 04:52:46.272257 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 23 04:52:46.272257 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:52:46.272257 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Sep 23 04:52:46.272257 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 23 04:52:46.272257 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:52:46.272257 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 23 04:52:46.272257 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 23 04:52:46.272257 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:52:46.272257 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:52:46.272257 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:52:46.272257 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:52:46.282216 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:52:46.282216 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:52:46.282216 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:52:46.282216 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:52:46.282216 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:52:46.282216 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:52:46.282216 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:52:46.282216 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:52:46.282216 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 23 04:52:46.282216 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 23 04:52:46.282216 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 23 04:52:46.282216 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 23 04:52:46.282216 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 23 04:52:46.282216 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 23 04:52:46.282216 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 23 04:52:46.282216 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:52:46.282216 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:52:46.282216 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:52:46.282216 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:52:46.282216 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:52:46.282216 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:52:46.282216 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 23 04:52:46.282216 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 23 04:52:46.282216 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 23 04:52:46.282216 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:52:46.282216 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c8278772-4000-4764-a54e-fa6d188036f5 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:52:46.282216 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c8278772-4000-4764-a54e-fa6d188036f5 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "PUT /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 400 len: 619 microversion: 2.1 time: 0.034558 Sep 23 04:52:46.286890 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7861572e-59aa-479e-bfda-1e14a4c2e0fa tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:46.286890 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-7861572e-59aa-479e-bfda-1e14a4c2e0fa tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] [instance: 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:46.287207 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2333/4799] 10.222.0.33 () {60 vars in 1257 bytes} [Fri Sep 23 04:52:46 2022] PUT /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 619 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 04:52:46.287360 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7861572e-59aa-479e-bfda-1e14a4c2e0fa tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:46.287360 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7861572e-59aa-479e-bfda-1e14a4c2e0fa tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:46.287360 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7861572e-59aa-479e-bfda-1e14a4c2e0fa tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:46.287896 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7861572e-59aa-479e-bfda-1e14a4c2e0fa tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:46.288050 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7861572e-59aa-479e-bfda-1e14a4c2e0fa tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:46.288578 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7861572e-59aa-479e-bfda-1e14a4c2e0fa tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:46.304315 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d885b57d-17aa-4c71-a8e7-c65856a3c583 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:46.306177 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d885b57d-17aa-4c71-a8e7-c65856a3c583 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:46.317810 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d885b57d-17aa-4c71-a8e7-c65856a3c583 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:46.318780 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d885b57d-17aa-4c71-a8e7-c65856a3c583 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:46.319634 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d885b57d-17aa-4c71-a8e7-c65856a3c583 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:46.320969 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d885b57d-17aa-4c71-a8e7-c65856a3c583 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:46.321710 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d885b57d-17aa-4c71-a8e7-c65856a3c583 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:46.322538 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d885b57d-17aa-4c71-a8e7-c65856a3c583 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:46.730141 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-7861572e-59aa-479e-bfda-1e14a4c2e0fa tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:46.751029 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-7861572e-59aa-479e-bfda-1e14a4c2e0fa tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:46.754875 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d885b57d-17aa-4c71-a8e7-c65856a3c583 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:46.755045 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-7861572e-59aa-479e-bfda-1e14a4c2e0fa tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:46.758809 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-7861572e-59aa-479e-bfda-1e14a4c2e0fa tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] 10.222.0.33 "GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7" status: 200 len: 1878 microversion: 2.32 time: 0.488158 Sep 23 04:52:46.760141 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2467/4800] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:52:46 2022] GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 => generated 1878 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:52:46.776524 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d885b57d-17aa-4c71-a8e7-c65856a3c583 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1503 microversion: 2.1 time: 0.486769 Sep 23 04:52:46.777452 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2334/4801] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:46 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1503 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:52:46.786493 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-926e6649-10cc-4c8b-b4a9-45ab86024861 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:46.787147 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-926e6649-10cc-4c8b-b4a9-45ab86024861 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: f285e256-0a0e-4126-8adf-643bd59ca141] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:46.805364 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7f609144-d6e7-4d4f-bdaf-f4996a759c80 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:46.806383 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7f609144-d6e7-4d4f-bdaf-f4996a759c80 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:46.807904 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-926e6649-10cc-4c8b-b4a9-45ab86024861 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:46.808851 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-926e6649-10cc-4c8b-b4a9-45ab86024861 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:46.810671 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-926e6649-10cc-4c8b-b4a9-45ab86024861 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:46.813874 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-926e6649-10cc-4c8b-b4a9-45ab86024861 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:46.814657 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-926e6649-10cc-4c8b-b4a9-45ab86024861 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:46.816146 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-926e6649-10cc-4c8b-b4a9-45ab86024861 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:46.822123 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7f609144-d6e7-4d4f-bdaf-f4996a759c80 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:46.823199 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7f609144-d6e7-4d4f-bdaf-f4996a759c80 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:46.824031 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7f609144-d6e7-4d4f-bdaf-f4996a759c80 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:46.827063 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7f609144-d6e7-4d4f-bdaf-f4996a759c80 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:46.827585 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7f609144-d6e7-4d4f-bdaf-f4996a759c80 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:46.829257 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7f609144-d6e7-4d4f-bdaf-f4996a759c80 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:47.218506 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-926e6649-10cc-4c8b-b4a9-45ab86024861 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:47.227032 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-926e6649-10cc-4c8b-b4a9-45ab86024861 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:47.234078 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-926e6649-10cc-4c8b-b4a9-45ab86024861 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:47.234078 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-926e6649-10cc-4c8b-b4a9-45ab86024861 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141" status: 200 len: 1722 microversion: 2.20 time: 0.468057 Sep 23 04:52:47.234078 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2468/4802] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:52:46 2022] GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141 => generated 1722 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:52:47.236040 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0248e203-b19d-4354-b85c-987dc5726ab1 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:47.236842 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-0248e203-b19d-4354-b85c-987dc5726ab1 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:47.243121 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0248e203-b19d-4354-b85c-987dc5726ab1 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:47.243618 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0248e203-b19d-4354-b85c-987dc5726ab1 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:47.244235 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0248e203-b19d-4354-b85c-987dc5726ab1 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:47.245325 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0248e203-b19d-4354-b85c-987dc5726ab1 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:47.245776 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0248e203-b19d-4354-b85c-987dc5726ab1 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:47.246532 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0248e203-b19d-4354-b85c-987dc5726ab1 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:47.274819 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-7f609144-d6e7-4d4f-bdaf-f4996a759c80 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:47.287123 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7f609144-d6e7-4d4f-bdaf-f4996a759c80 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b" status: 200 len: 1513 microversion: 2.1 time: 0.504262 Sep 23 04:52:47.287943 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2335/4803] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:46 2022] GET /compute/v2.1/servers/c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b => generated 1513 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:52:47.492858 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-0248e203-b19d-4354-b85c-987dc5726ab1 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:47.502380 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0248e203-b19d-4354-b85c-987dc5726ab1 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1503 microversion: 2.1 time: 0.269735 Sep 23 04:52:47.503196 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2469/4804] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:47 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1503 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:52:47.525089 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-aa29ba47-2875-4922-b560-d6c3e652fb7d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:52:47.529288 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-aa29ba47-2875-4922-b560-d6c3e652fb7d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Request method failure captured: Sep 23 04:52:47.529288 n-d-846463-3 devstack@n-api.service[122698]: request: PUT /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf HTTP/1.1 Sep 23 04:52:47.529288 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:52:47.529288 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:52:47.529288 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:52:47.529288 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 24 Sep 23 04:52:47.529288 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:52:47.529288 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:52:47.529288 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:52:47.529288 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:52:47.529288 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTrDoGx96bSja4ydTGD-VWXTOyHeLiBA9Lvr197ivKeXqtV3OksEUUEiEPXK85IMwWXM1vCTp1M9PaXnUkKbFev29d-fL5KKXR0MfyGa86SLKINg6u_gn5EQLUNZ8EVLCkU1WwJ7agpVlFY75EyJH0fBcxrNg1yvFbeC2alzdH4Tkmw Sep 23 04:52:47.529288 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:52:47.529288 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:52:47.529288 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:52:47.529288 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:52:47.529288 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:52:47.529288 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:52:47.529288 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 78dca47156ff4f19a8673b893c853978 Sep 23 04:52:47.529288 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:52:47.529288 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:52:47.529288 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:52:47.529288 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_78dca47156ff4f19a8673b893c853978", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/78dca47156ff4f19a8673b893c853978"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/78dca47156ff4f19a8673b893c853978"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/78dca47156ff4f19a8673b893c853978"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:52:47.529288 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:52:47.529288 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 78dca47156ff4f19a8673b893c853978 Sep 23 04:52:47.529288 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:52:47.529288 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ServersNegativeTestJSON-1102187211-project Sep 23 04:52:47.529288 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:52:47.529288 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:52:47.529288 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: c912fb9d1f5447d180a9e8568220526f Sep 23 04:52:47.529288 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ServersNegativeTestJSON-1102187211-project Sep 23 04:52:47.529288 n-d-846463-3 devstack@n-api.service[122698]: Sep 23 04:52:47.529288 n-d-846463-3 devstack@n-api.service[122698]: {"server": {"name": ""}} Sep 23 04:52:47.529288 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:52:47.529288 n-d-846463-3 devstack@n-api.service[122698]: exception: Invalid input for field/attribute name. Value: . '' is too short Sep 23 04:52:47.529288 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': 'a9f2ff08-c66d-4991-9bae-d523a3adb8bf', 'body': {'server': {'name': ''}}} Sep 23 04:52:47.529288 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:52:47.529288 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:52:47.529288 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 23 04:52:47.529288 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 23 04:52:47.529288 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 23 04:52:47.529288 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise error Sep 23 04:52:47.529288 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 23 04:52:47.529288 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:52:47.529288 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Sep 23 04:52:47.529288 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 23 04:52:47.529288 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:52:47.529288 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 23 04:52:47.529288 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi '' Sep 23 04:52:47.529288 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:52:47.529288 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:52:47.529288 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:52:47.529288 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:52:47.529288 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:52:47.529288 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:52:47.529288 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:52:47.529288 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:52:47.529288 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:52:47.529288 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:52:47.529288 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:52:47.529288 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:52:47.529288 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 23 04:52:47.529288 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 23 04:52:47.529288 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 23 04:52:47.529288 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 23 04:52:47.529288 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 23 04:52:47.529288 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 23 04:52:47.534099 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Sep 23 04:52:47.534099 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:52:47.534099 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:52:47.534099 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:52:47.534099 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:52:47.534099 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:52:47.534099 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:52:47.534099 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 23 04:52:47.534099 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 23 04:52:47.534099 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Sep 23 04:52:47.534099 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:52:47.534099 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-aa29ba47-2875-4922-b560-d6c3e652fb7d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:52:47.534099 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-aa29ba47-2875-4922-b560-d6c3e652fb7d tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "PUT /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 400 len: 108 microversion: 2.1 time: 0.009512 Sep 23 04:52:47.535026 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2336/4805] 10.222.0.33 () {60 vars in 1256 bytes} [Fri Sep 23 04:52:47 2022] PUT /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 108 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 04:52:47.540005 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-28b8300a-0b89-49d1-89c9-14aa40c24e55 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:47.540705 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-28b8300a-0b89-49d1-89c9-14aa40c24e55 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:47.548438 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-28b8300a-0b89-49d1-89c9-14aa40c24e55 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:47.553600 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-28b8300a-0b89-49d1-89c9-14aa40c24e55 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:47.553600 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-28b8300a-0b89-49d1-89c9-14aa40c24e55 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:47.553600 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-28b8300a-0b89-49d1-89c9-14aa40c24e55 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:47.553600 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-28b8300a-0b89-49d1-89c9-14aa40c24e55 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:47.553600 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-28b8300a-0b89-49d1-89c9-14aa40c24e55 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:47.745850 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-28b8300a-0b89-49d1-89c9-14aa40c24e55 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:47.763807 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-28b8300a-0b89-49d1-89c9-14aa40c24e55 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1503 microversion: 2.1 time: 0.227698 Sep 23 04:52:47.767866 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2470/4806] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:47 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1503 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:52:47.787509 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3e22e8b8-5dfa-4bf4-8056-2b89071656b8 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:47.788134 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3e22e8b8-5dfa-4bf4-8056-2b89071656b8 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] [instance: 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:47.798273 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3e22e8b8-5dfa-4bf4-8056-2b89071656b8 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:47.798771 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3e22e8b8-5dfa-4bf4-8056-2b89071656b8 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:47.799371 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3e22e8b8-5dfa-4bf4-8056-2b89071656b8 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:47.800130 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3e22e8b8-5dfa-4bf4-8056-2b89071656b8 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:47.800597 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3e22e8b8-5dfa-4bf4-8056-2b89071656b8 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:47.801202 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3e22e8b8-5dfa-4bf4-8056-2b89071656b8 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:48.017418 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-3e22e8b8-5dfa-4bf4-8056-2b89071656b8 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:48.030269 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-3e22e8b8-5dfa-4bf4-8056-2b89071656b8 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:48.031953 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-3e22e8b8-5dfa-4bf4-8056-2b89071656b8 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:48.033641 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3e22e8b8-5dfa-4bf4-8056-2b89071656b8 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] 10.222.0.33 "GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7" status: 200 len: 1878 microversion: 2.32 time: 0.251808 Sep 23 04:52:48.035824 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2337/4807] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:52:47 2022] GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 => generated 1878 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:52:48.264464 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e59cf34f-b3d7-4946-ab68-1688628c0650 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:48.265478 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e59cf34f-b3d7-4946-ab68-1688628c0650 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: f285e256-0a0e-4126-8adf-643bd59ca141] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:48.272967 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e59cf34f-b3d7-4946-ab68-1688628c0650 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:48.273542 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e59cf34f-b3d7-4946-ab68-1688628c0650 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:48.274341 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e59cf34f-b3d7-4946-ab68-1688628c0650 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:48.274805 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e59cf34f-b3d7-4946-ab68-1688628c0650 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:48.275277 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e59cf34f-b3d7-4946-ab68-1688628c0650 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:48.275847 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e59cf34f-b3d7-4946-ab68-1688628c0650 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:48.311539 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-cc1328a2-c583-459d-b72d-380183bfe9a3 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:48.312171 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-cc1328a2-c583-459d-b72d-380183bfe9a3 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:48.340969 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cc1328a2-c583-459d-b72d-380183bfe9a3 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:48.341621 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cc1328a2-c583-459d-b72d-380183bfe9a3 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:48.342118 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cc1328a2-c583-459d-b72d-380183bfe9a3 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:48.342862 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cc1328a2-c583-459d-b72d-380183bfe9a3 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:48.343332 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cc1328a2-c583-459d-b72d-380183bfe9a3 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:48.345216 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cc1328a2-c583-459d-b72d-380183bfe9a3 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:48.459992 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e59cf34f-b3d7-4946-ab68-1688628c0650 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:48.475387 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e59cf34f-b3d7-4946-ab68-1688628c0650 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:48.478913 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e59cf34f-b3d7-4946-ab68-1688628c0650 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:48.480156 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e59cf34f-b3d7-4946-ab68-1688628c0650 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141" status: 200 len: 1722 microversion: 2.20 time: 0.222955 Sep 23 04:52:48.483492 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2471/4808] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:52:48 2022] GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141 => generated 1722 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:52:48.595808 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-cc1328a2-c583-459d-b72d-380183bfe9a3 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:48.604914 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-cc1328a2-c583-459d-b72d-380183bfe9a3 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b" status: 200 len: 1513 microversion: 2.1 time: 0.297777 Sep 23 04:52:48.605662 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2338/4809] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:48 2022] GET /compute/v2.1/servers/c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b => generated 1513 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:52:48.620697 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-c7a53640-f943-4f14-b282-675c5c022c18 req-82dacbb6-7314-4f4e-9ce9-bafa5cd1fd91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f285e256-0a0e-4126-8adf-643bd59ca141", "name": "network-vif-unplugged", "status": "completed", "tag": "e29f5caa-b337-40d1-9780-77215617f3ce"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:52:48.630757 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-c7a53640-f943-4f14-b282-675c5c022c18 req-82dacbb6-7314-4f4e-9ce9-bafa5cd1fd91 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:48.631428 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-c7a53640-f943-4f14-b282-675c5c022c18 req-82dacbb6-7314-4f4e-9ce9-bafa5cd1fd91 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:48.631677 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-c7a53640-f943-4f14-b282-675c5c022c18 req-82dacbb6-7314-4f4e-9ce9-bafa5cd1fd91 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:48.644590 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-c7a53640-f943-4f14-b282-675c5c022c18 req-82dacbb6-7314-4f4e-9ce9-bafa5cd1fd91 service nova] Creating event network-vif-unplugged:e29f5caa-b337-40d1-9780-77215617f3ce for instance f285e256-0a0e-4126-8adf-643bd59ca141 on n-h1-846463-3 Sep 23 04:52:48.649861 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-c7a53640-f943-4f14-b282-675c5c022c18 req-82dacbb6-7314-4f4e-9ce9-bafa5cd1fd91 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033465 Sep 23 04:52:48.650661 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2472/4810] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:52:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:52:49.071017 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-19816e89-de21-4e3d-b0e7-a71995419c6e tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:49.072023 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-19816e89-de21-4e3d-b0e7-a71995419c6e tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] [instance: 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:49.086387 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-19816e89-de21-4e3d-b0e7-a71995419c6e tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:49.087264 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-19816e89-de21-4e3d-b0e7-a71995419c6e tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:49.091215 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-19816e89-de21-4e3d-b0e7-a71995419c6e tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:49.095005 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-19816e89-de21-4e3d-b0e7-a71995419c6e tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:49.100245 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-19816e89-de21-4e3d-b0e7-a71995419c6e tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:49.100245 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-19816e89-de21-4e3d-b0e7-a71995419c6e tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:49.369513 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-19816e89-de21-4e3d-b0e7-a71995419c6e tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:49.381270 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-19816e89-de21-4e3d-b0e7-a71995419c6e tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:49.383166 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-19816e89-de21-4e3d-b0e7-a71995419c6e tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:49.385077 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-19816e89-de21-4e3d-b0e7-a71995419c6e tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] 10.222.0.33 "GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7" status: 200 len: 1878 microversion: 2.32 time: 0.321597 Sep 23 04:52:49.386133 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2339/4811] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:52:49 2022] GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 => generated 1878 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:52:49.526216 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-fca30066-5dcd-4765-bc76-f4e9798d88b3 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:49.526216 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-fca30066-5dcd-4765-bc76-f4e9798d88b3 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: f285e256-0a0e-4126-8adf-643bd59ca141] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:49.544994 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fca30066-5dcd-4765-bc76-f4e9798d88b3 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:49.545509 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fca30066-5dcd-4765-bc76-f4e9798d88b3 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:49.545979 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fca30066-5dcd-4765-bc76-f4e9798d88b3 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:49.546878 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fca30066-5dcd-4765-bc76-f4e9798d88b3 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:49.547648 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fca30066-5dcd-4765-bc76-f4e9798d88b3 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:49.548447 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fca30066-5dcd-4765-bc76-f4e9798d88b3 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:49.630269 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-aa02672d-61ae-4622-81ee-a530607fb460 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:49.631329 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-aa02672d-61ae-4622-81ee-a530607fb460 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:49.644547 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-aa02672d-61ae-4622-81ee-a530607fb460 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:49.645386 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-aa02672d-61ae-4622-81ee-a530607fb460 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:49.646270 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-aa02672d-61ae-4622-81ee-a530607fb460 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:49.647771 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-aa02672d-61ae-4622-81ee-a530607fb460 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:49.648445 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-aa02672d-61ae-4622-81ee-a530607fb460 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:49.650504 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-aa02672d-61ae-4622-81ee-a530607fb460 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:49.790719 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-fca30066-5dcd-4765-bc76-f4e9798d88b3 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:49.805015 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-fca30066-5dcd-4765-bc76-f4e9798d88b3 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:49.811510 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-fca30066-5dcd-4765-bc76-f4e9798d88b3 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:49.813934 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-fca30066-5dcd-4765-bc76-f4e9798d88b3 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141" status: 200 len: 1725 microversion: 2.20 time: 0.306410 Sep 23 04:52:49.814538 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2473/4812] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:52:49 2022] GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141 => generated 1725 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:52:49.845726 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-152bbf65-4771-4b8f-82f0-5dccb9a423fd tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "35d39968-8fe3-44b3-99cd-13628fe95273"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:52:49.848759 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-152bbf65-4771-4b8f-82f0-5dccb9a423fd tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: f285e256-0a0e-4126-8adf-643bd59ca141] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:49.861782 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-152bbf65-4771-4b8f-82f0-5dccb9a423fd tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:49.862600 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-152bbf65-4771-4b8f-82f0-5dccb9a423fd tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:49.864918 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-152bbf65-4771-4b8f-82f0-5dccb9a423fd tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:49.866555 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-152bbf65-4771-4b8f-82f0-5dccb9a423fd tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:49.870397 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-152bbf65-4771-4b8f-82f0-5dccb9a423fd tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:49.871080 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-152bbf65-4771-4b8f-82f0-5dccb9a423fd tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:49.885145 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-aa02672d-61ae-4622-81ee-a530607fb460 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:49.894775 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-aa02672d-61ae-4622-81ee-a530607fb460 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b" status: 200 len: 1513 microversion: 2.1 time: 0.269785 Sep 23 04:52:49.895563 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2340/4813] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:49 2022] GET /compute/v2.1/servers/c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b => generated 1513 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:52:50.421633 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ae92cc8f-c76e-45ae-83f7-2a7c60588031 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:50.423335 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-ae92cc8f-c76e-45ae-83f7-2a7c60588031 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] [instance: 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:50.435205 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ae92cc8f-c76e-45ae-83f7-2a7c60588031 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:50.436191 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ae92cc8f-c76e-45ae-83f7-2a7c60588031 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:50.436854 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ae92cc8f-c76e-45ae-83f7-2a7c60588031 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:50.437741 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ae92cc8f-c76e-45ae-83f7-2a7c60588031 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:50.438393 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ae92cc8f-c76e-45ae-83f7-2a7c60588031 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:50.439008 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ae92cc8f-c76e-45ae-83f7-2a7c60588031 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:50.694866 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ae92cc8f-c76e-45ae-83f7-2a7c60588031 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:50.706880 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ae92cc8f-c76e-45ae-83f7-2a7c60588031 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:50.708614 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ae92cc8f-c76e-45ae-83f7-2a7c60588031 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:50.709780 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ae92cc8f-c76e-45ae-83f7-2a7c60588031 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] 10.222.0.33 "GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7" status: 200 len: 1878 microversion: 2.32 time: 0.299903 Sep 23 04:52:50.710405 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2341/4814] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:52:50 2022] GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 => generated 1878 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:52:50.904936 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b8afd994-f70a-419a-867f-6078937a3d29 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Action: 'create', calling method: .version_select at 0x7ff1ba8209d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1044440630", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA4oAHaoB+mHVe3SlylegWc3t7KvFo654O4CTh632ZlJ42ZbRycju6S5k+vW3AQFY+KIcF/0mrW5/IIa1wZ9NqKgfEWUyUQyYFQrsNXrbDWKFugEcqzfKcpXBdPn5/VR5A=="}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:52:50.922075 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-b8afd994-f70a-419a-867f-6078937a3d29 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Getting quotas for project 0edd6bd5b418494fbcb05c743967d36a. Resources: {'key_pairs'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:52:50.927978 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-b8afd994-f70a-419a-867f-6078937a3d29 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Getting quotas for user 8d3d0a162e7e4beb81a54120cab246ff and project 0edd6bd5b418494fbcb05c743967d36a. Resources: {'key_pairs'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:52:50.957001 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-152bbf65-4771-4b8f-82f0-5dccb9a423fd tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "POST /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.115492 Sep 23 04:52:50.957633 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2474/4815] 10.222.0.33 () {62 vars in 1364 bytes} [Fri Sep 23 04:52:49 2022] POST /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141/os-volume_attachments => generated 188 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 04:52:50.962740 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6d9d432e-6b1d-4e76-a395-291d38adaf11 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:50.963575 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-6d9d432e-6b1d-4e76-a395-291d38adaf11 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:50.970247 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6d9d432e-6b1d-4e76-a395-291d38adaf11 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:50.970745 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6d9d432e-6b1d-4e76-a395-291d38adaf11 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:50.971332 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6d9d432e-6b1d-4e76-a395-291d38adaf11 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:50.972039 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6d9d432e-6b1d-4e76-a395-291d38adaf11 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:50.972559 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6d9d432e-6b1d-4e76-a395-291d38adaf11 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:50.972979 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6d9d432e-6b1d-4e76-a395-291d38adaf11 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:51.044243 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b8afd994-f70a-419a-867f-6078937a3d29 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.332306 Sep 23 04:52:51.044926 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2342/4816] 10.222.0.33 () {60 vars in 1159 bytes} [Fri Sep 23 04:52:50 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:52:51.101408 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6dd2564c-2ee3-4fb3-9ec4-f81b9ab2da63 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:51.102635 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-6dd2564c-2ee3-4fb3-9ec4-f81b9ab2da63 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: f285e256-0a0e-4126-8adf-643bd59ca141] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:51.109604 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6dd2564c-2ee3-4fb3-9ec4-f81b9ab2da63 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:51.110459 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6dd2564c-2ee3-4fb3-9ec4-f81b9ab2da63 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:51.111065 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6dd2564c-2ee3-4fb3-9ec4-f81b9ab2da63 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:51.111985 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6dd2564c-2ee3-4fb3-9ec4-f81b9ab2da63 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:51.112608 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6dd2564c-2ee3-4fb3-9ec4-f81b9ab2da63 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:51.113198 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6dd2564c-2ee3-4fb3-9ec4-f81b9ab2da63 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:51.139618 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-6d9d432e-6b1d-4e76-a395-291d38adaf11 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:51.149227 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6d9d432e-6b1d-4e76-a395-291d38adaf11 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b" status: 200 len: 1513 microversion: 2.1 time: 0.190247 Sep 23 04:52:51.150033 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2475/4817] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:50 2022] GET /compute/v2.1/servers/c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b => generated 1513 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:52:51.738023 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9c327b0f-8c92-4c61-837f-a781cfe93bb1 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:51.738822 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-9c327b0f-8c92-4c61-837f-a781cfe93bb1 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] [instance: 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:51.749916 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9c327b0f-8c92-4c61-837f-a781cfe93bb1 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:51.750460 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9c327b0f-8c92-4c61-837f-a781cfe93bb1 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:51.750904 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9c327b0f-8c92-4c61-837f-a781cfe93bb1 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:51.754247 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9c327b0f-8c92-4c61-837f-a781cfe93bb1 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:51.754514 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9c327b0f-8c92-4c61-837f-a781cfe93bb1 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:51.754979 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9c327b0f-8c92-4c61-837f-a781cfe93bb1 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:51.969555 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-6dd2564c-2ee3-4fb3-9ec4-f81b9ab2da63 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141/os-volume_attachments/35d39968-8fe3-44b3-99cd-13628fe95273" status: 202 len: 0 microversion: 2.20 time: 0.872292 Sep 23 04:52:51.970269 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2343/4818] 10.222.0.33 () {60 vars in 1457 bytes} [Fri Sep 23 04:52:51 2022] DELETE /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141/os-volume_attachments/35d39968-8fe3-44b3-99cd-13628fe95273 => generated 0 bytes in 874 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:52:52.119050 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-24e074aa-8773-4ccf-a4ae-94d46f20b1cc tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:52:52.120082 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-24e074aa-8773-4ccf-a4ae-94d46f20b1cc tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: f285e256-0a0e-4126-8adf-643bd59ca141] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:52.138799 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-24e074aa-8773-4ccf-a4ae-94d46f20b1cc tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:52.141371 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-24e074aa-8773-4ccf-a4ae-94d46f20b1cc tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:52.143073 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-24e074aa-8773-4ccf-a4ae-94d46f20b1cc tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:52.149400 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-24e074aa-8773-4ccf-a4ae-94d46f20b1cc tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:52.150746 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-24e074aa-8773-4ccf-a4ae-94d46f20b1cc tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:52.153442 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-24e074aa-8773-4ccf-a4ae-94d46f20b1cc tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:52.299731 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-24e074aa-8773-4ccf-a4ae-94d46f20b1cc tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: f285e256-0a0e-4126-8adf-643bd59ca141] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122698) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 23 04:52:52.486983 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-9c327b0f-8c92-4c61-837f-a781cfe93bb1 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:52.491328 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:52:52.509972 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-9c327b0f-8c92-4c61-837f-a781cfe93bb1 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:52.514113 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-9c327b0f-8c92-4c61-837f-a781cfe93bb1 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:52.515623 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-9c327b0f-8c92-4c61-837f-a781cfe93bb1 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] 10.222.0.33 "GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7" status: 200 len: 1878 microversion: 2.32 time: 0.781560 Sep 23 04:52:52.530341 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2476/4819] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:52:51 2022] GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 => generated 1878 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:52:52.547521 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-831c6fcd-5c19-4aa8-bef5-259509aa6994 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:52.547521 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-831c6fcd-5c19-4aa8-bef5-259509aa6994 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:52.552410 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-831c6fcd-5c19-4aa8-bef5-259509aa6994 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:52.553113 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-831c6fcd-5c19-4aa8-bef5-259509aa6994 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:52.553813 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-831c6fcd-5c19-4aa8-bef5-259509aa6994 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:52.554723 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-831c6fcd-5c19-4aa8-bef5-259509aa6994 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:52.555375 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-831c6fcd-5c19-4aa8-bef5-259509aa6994 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:52.556075 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-831c6fcd-5c19-4aa8-bef5-259509aa6994 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:52.688864 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-24e074aa-8773-4ccf-a4ae-94d46f20b1cc tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "POST /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141/action" status: 202 len: 0 microversion: 2.20 time: 0.575332 Sep 23 04:52:52.693650 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2344/4820] 10.222.0.33 () {62 vars in 1319 bytes} [Fri Sep 23 04:52:52 2022] POST /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141/action => generated 0 bytes in 581 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 23 04:52:52.710638 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f2ba5709-a38c-4e48-a401-f19d3b3e2641 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:52.711563 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f2ba5709-a38c-4e48-a401-f19d3b3e2641 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: f285e256-0a0e-4126-8adf-643bd59ca141] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:52.724546 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f2ba5709-a38c-4e48-a401-f19d3b3e2641 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:52.725368 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f2ba5709-a38c-4e48-a401-f19d3b3e2641 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:52.725816 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f2ba5709-a38c-4e48-a401-f19d3b3e2641 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:52.726787 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f2ba5709-a38c-4e48-a401-f19d3b3e2641 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:52.727436 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f2ba5709-a38c-4e48-a401-f19d3b3e2641 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:52.727878 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f2ba5709-a38c-4e48-a401-f19d3b3e2641 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:52.926868 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-831c6fcd-5c19-4aa8-bef5-259509aa6994 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:52.940416 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-831c6fcd-5c19-4aa8-bef5-259509aa6994 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b" status: 200 len: 1513 microversion: 2.1 time: 0.399939 Sep 23 04:52:52.941040 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2477/4821] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:52 2022] GET /compute/v2.1/servers/c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b => generated 1513 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:52:53.016872 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f2ba5709-a38c-4e48-a401-f19d3b3e2641 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:53.020306 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:52:53.025767 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f2ba5709-a38c-4e48-a401-f19d3b3e2641 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:53.039691 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f2ba5709-a38c-4e48-a401-f19d3b3e2641 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:53.040952 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f2ba5709-a38c-4e48-a401-f19d3b3e2641 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141" status: 200 len: 1673 microversion: 2.20 time: 0.346059 Sep 23 04:52:53.041532 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2345/4822] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:52:52 2022] GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141 => generated 1673 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:52:53.434273 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-b6849b7c-5bb1-4a5b-8b5e-cc9fdfb80858 req-5640a48d-fc1e-40c2-929b-bcadd9ec34c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49112e3f-73fc-4ee9-b48e-bcda5b7dcda7", "name": "network-vif-plugged", "status": "completed", "tag": "6d6aeefc-17b8-455d-8d06-9189331b6022"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:52:53.456685 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-b6849b7c-5bb1-4a5b-8b5e-cc9fdfb80858 req-5640a48d-fc1e-40c2-929b-bcadd9ec34c0 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:53.457333 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-b6849b7c-5bb1-4a5b-8b5e-cc9fdfb80858 req-5640a48d-fc1e-40c2-929b-bcadd9ec34c0 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:53.457594 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-b6849b7c-5bb1-4a5b-8b5e-cc9fdfb80858 req-5640a48d-fc1e-40c2-929b-bcadd9ec34c0 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:53.479524 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-b6849b7c-5bb1-4a5b-8b5e-cc9fdfb80858 req-5640a48d-fc1e-40c2-929b-bcadd9ec34c0 service nova] Creating event network-vif-plugged:6d6aeefc-17b8-455d-8d06-9189331b6022 for instance 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 on n-h2-846463-3 Sep 23 04:52:53.493185 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-b6849b7c-5bb1-4a5b-8b5e-cc9fdfb80858 req-5640a48d-fc1e-40c2-929b-bcadd9ec34c0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061343 Sep 23 04:52:53.494183 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2478/4823] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:52:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:52:53.547846 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8f24ce99-3537-456a-964a-16a20e71655e tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:53.548707 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8f24ce99-3537-456a-964a-16a20e71655e tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] [instance: 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:53.557354 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8f24ce99-3537-456a-964a-16a20e71655e tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:53.558236 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8f24ce99-3537-456a-964a-16a20e71655e tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:53.558943 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8f24ce99-3537-456a-964a-16a20e71655e tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:53.560113 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8f24ce99-3537-456a-964a-16a20e71655e tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:53.560620 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8f24ce99-3537-456a-964a-16a20e71655e tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:53.561161 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8f24ce99-3537-456a-964a-16a20e71655e tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:53.891167 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8f24ce99-3537-456a-964a-16a20e71655e tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:53.903264 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8f24ce99-3537-456a-964a-16a20e71655e tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:53.904848 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8f24ce99-3537-456a-964a-16a20e71655e tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:53.906559 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8f24ce99-3537-456a-964a-16a20e71655e tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] 10.222.0.33 "GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7" status: 200 len: 1878 microversion: 2.32 time: 0.363344 Sep 23 04:52:53.907682 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2346/4824] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:52:53 2022] GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 => generated 1878 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:52:53.964735 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5deb0ebb-3bed-4b90-baf0-32d63ca4c290 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:53.965412 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-5deb0ebb-3bed-4b90-baf0-32d63ca4c290 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:53.973627 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5deb0ebb-3bed-4b90-baf0-32d63ca4c290 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:53.974425 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5deb0ebb-3bed-4b90-baf0-32d63ca4c290 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:53.975035 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5deb0ebb-3bed-4b90-baf0-32d63ca4c290 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:53.975947 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5deb0ebb-3bed-4b90-baf0-32d63ca4c290 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:53.976739 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5deb0ebb-3bed-4b90-baf0-32d63ca4c290 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:53.977340 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5deb0ebb-3bed-4b90-baf0-32d63ca4c290 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:54.068951 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e55fa365-007a-4fc3-acbf-f21716c9d245 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:54.070546 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e55fa365-007a-4fc3-acbf-f21716c9d245 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: f285e256-0a0e-4126-8adf-643bd59ca141] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:54.077747 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e55fa365-007a-4fc3-acbf-f21716c9d245 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:54.081116 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e55fa365-007a-4fc3-acbf-f21716c9d245 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:54.081803 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e55fa365-007a-4fc3-acbf-f21716c9d245 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:54.082608 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e55fa365-007a-4fc3-acbf-f21716c9d245 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:54.083088 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e55fa365-007a-4fc3-acbf-f21716c9d245 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:54.083522 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e55fa365-007a-4fc3-acbf-f21716c9d245 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:54.299615 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-5deb0ebb-3bed-4b90-baf0-32d63ca4c290 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:54.307498 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e55fa365-007a-4fc3-acbf-f21716c9d245 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:54.313048 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5deb0ebb-3bed-4b90-baf0-32d63ca4c290 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b" status: 200 len: 1513 microversion: 2.1 time: 0.351792 Sep 23 04:52:54.316318 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2479/4825] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:53 2022] GET /compute/v2.1/servers/c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b => generated 1513 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:52:54.325007 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e55fa365-007a-4fc3-acbf-f21716c9d245 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:54.326850 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e55fa365-007a-4fc3-acbf-f21716c9d245 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:54.328232 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e55fa365-007a-4fc3-acbf-f21716c9d245 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141" status: 200 len: 1673 microversion: 2.20 time: 0.264094 Sep 23 04:52:54.332084 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2347/4826] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:52:54 2022] GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141 => generated 1673 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:52:54.935400 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8cf568dd-96a0-4a64-9516-8e743899b264 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:54.936615 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-8cf568dd-96a0-4a64-9516-8e743899b264 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] [instance: 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:54.943423 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8cf568dd-96a0-4a64-9516-8e743899b264 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:54.944092 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8cf568dd-96a0-4a64-9516-8e743899b264 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:54.944690 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8cf568dd-96a0-4a64-9516-8e743899b264 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:54.945770 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8cf568dd-96a0-4a64-9516-8e743899b264 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:54.946428 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8cf568dd-96a0-4a64-9516-8e743899b264 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:54.947037 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8cf568dd-96a0-4a64-9516-8e743899b264 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:55.242100 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-8cf568dd-96a0-4a64-9516-8e743899b264 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:55.255402 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-8cf568dd-96a0-4a64-9516-8e743899b264 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:55.264448 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-8cf568dd-96a0-4a64-9516-8e743899b264 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:55.268272 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-8cf568dd-96a0-4a64-9516-8e743899b264 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] 10.222.0.33 "GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7" status: 200 len: 1878 microversion: 2.32 time: 0.335650 Sep 23 04:52:55.272344 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2480/4827] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:52:54 2022] GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 => generated 1878 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:52:55.341560 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e2b5905b-dde6-401b-9b47-28d256b2ff25 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:55.342524 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e2b5905b-dde6-401b-9b47-28d256b2ff25 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:55.352978 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e2b5905b-dde6-401b-9b47-28d256b2ff25 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:55.359893 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7549745a-27fc-4f21-bb5d-d4b0805d3888 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:55.360498 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-7549745a-27fc-4f21-bb5d-d4b0805d3888 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: f285e256-0a0e-4126-8adf-643bd59ca141] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:55.368081 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7549745a-27fc-4f21-bb5d-d4b0805d3888 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:55.368785 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7549745a-27fc-4f21-bb5d-d4b0805d3888 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:55.369248 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7549745a-27fc-4f21-bb5d-d4b0805d3888 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:55.370011 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7549745a-27fc-4f21-bb5d-d4b0805d3888 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:55.370490 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7549745a-27fc-4f21-bb5d-d4b0805d3888 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:55.371035 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7549745a-27fc-4f21-bb5d-d4b0805d3888 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:55.374743 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e2b5905b-dde6-401b-9b47-28d256b2ff25 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:55.375205 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e2b5905b-dde6-401b-9b47-28d256b2ff25 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:55.375956 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e2b5905b-dde6-401b-9b47-28d256b2ff25 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:55.376504 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e2b5905b-dde6-401b-9b47-28d256b2ff25 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:55.377144 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e2b5905b-dde6-401b-9b47-28d256b2ff25 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:55.662184 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-7549745a-27fc-4f21-bb5d-d4b0805d3888 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:55.678362 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-7549745a-27fc-4f21-bb5d-d4b0805d3888 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:55.684155 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-7549745a-27fc-4f21-bb5d-d4b0805d3888 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:55.685713 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-7549745a-27fc-4f21-bb5d-d4b0805d3888 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141" status: 200 len: 1731 microversion: 2.20 time: 0.331319 Sep 23 04:52:55.686945 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2481/4828] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:52:55 2022] GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141 => generated 1731 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:52:55.763567 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e2b5905b-dde6-401b-9b47-28d256b2ff25 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:55.788677 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e2b5905b-dde6-401b-9b47-28d256b2ff25 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b" status: 200 len: 1513 microversion: 2.1 time: 0.453701 Sep 23 04:52:55.789189 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2348/4829] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:55 2022] GET /compute/v2.1/servers/c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b => generated 1513 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:52:55.990060 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b7310256-a704-41e0-a173-9ebe123bba75 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:55.992311 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b7310256-a704-41e0-a173-9ebe123bba75 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: 9d5576c0-2aa8-4ca0-aed6-22c1f0700755] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:56.008281 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b7310256-a704-41e0-a173-9ebe123bba75 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:56.010563 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b7310256-a704-41e0-a173-9ebe123bba75 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:56.015217 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b7310256-a704-41e0-a173-9ebe123bba75 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:56.017804 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b7310256-a704-41e0-a173-9ebe123bba75 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:56.018483 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b7310256-a704-41e0-a173-9ebe123bba75 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:56.019075 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b7310256-a704-41e0-a173-9ebe123bba75 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:56.060703 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-b7310256-a704-41e0-a173-9ebe123bba75 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] HTTP exception thrown: Instance 9d5576c0-2aa8-4ca0-aed6-22c1f0700755 could not be found. Sep 23 04:52:56.063321 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b7310256-a704-41e0-a173-9ebe123bba75 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Request method failure captured: Sep 23 04:52:56.063321 n-d-846463-3 devstack@n-api.service[122699]: request: DELETE /compute/v2.1/servers/9d5576c0-2aa8-4ca0-aed6-22c1f0700755 HTTP/1.1 Sep 23 04:52:56.063321 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:52:56.063321 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:52:56.063321 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:52:56.063321 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:52:56.063321 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:52:56.063321 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:52:56.063321 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:52:56.063321 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:52:56.063321 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTrDoGx96bSja4ydTGD-VWXTOyHeLiBA9Lvr197ivKeXqtV3OksEUUEiEPXK85IMwWXM1vCTp1M9PaXnUkKbFev29d-fL5KKXR0MfyGa86SLKINg6u_gn5EQLUNZ8EVLCkU1WwJ7agpVlFY75EyJH0fBcxrNg1yvFbeC2alzdH4Tkmw Sep 23 04:52:56.063321 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:52:56.063321 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:52:56.063321 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:52:56.063321 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:52:56.063321 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:52:56.063321 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:52:56.063321 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 78dca47156ff4f19a8673b893c853978 Sep 23 04:52:56.063321 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:52:56.063321 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:52:56.063321 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:52:56.063321 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_78dca47156ff4f19a8673b893c853978", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/78dca47156ff4f19a8673b893c853978"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/78dca47156ff4f19a8673b893c853978"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/78dca47156ff4f19a8673b893c853978"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:52:56.063321 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:52:56.063321 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 78dca47156ff4f19a8673b893c853978 Sep 23 04:52:56.063321 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:52:56.063321 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ServersNegativeTestJSON-1102187211-project Sep 23 04:52:56.063321 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:52:56.063321 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:52:56.063321 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: c912fb9d1f5447d180a9e8568220526f Sep 23 04:52:56.063321 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ServersNegativeTestJSON-1102187211-project Sep 23 04:52:56.063321 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:52:56.063321 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 9d5576c0-2aa8-4ca0-aed6-22c1f0700755 could not be found. Sep 23 04:52:56.063321 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '9d5576c0-2aa8-4ca0-aed6-22c1f0700755'} Sep 23 04:52:56.063321 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:52:56.063321 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:52:56.063321 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:52:56.063321 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:52:56.063321 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:52:56.063321 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:52:56.063321 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:52:56.063321 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:52:56.063321 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:52:56.063321 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:52:56.063321 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d5576c0-2aa8-4ca0-aed6-22c1f0700755 could not be found. Sep 23 04:52:56.063321 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:52:56.063321 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:52:56.063321 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:52:56.063321 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:52:56.063321 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:52:56.063321 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:52:56.063321 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:52:56.063321 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:52:56.063321 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:52:56.063321 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:52:56.063321 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 04:52:56.063321 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 04:52:56.063321 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 04:52:56.063321 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 04:52:56.063321 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:52:56.063321 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:52:56.063321 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:52:56.063321 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:52:56.073602 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d5576c0-2aa8-4ca0-aed6-22c1f0700755 could not be found. Sep 23 04:52:56.073602 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:52:56.073602 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:52:56.073602 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:52:56.073602 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:52:56.073602 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:52:56.073602 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:52:56.073602 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:52:56.073602 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:52:56.073602 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d5576c0-2aa8-4ca0-aed6-22c1f0700755 could not be found. Sep 23 04:52:56.073602 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:52:56.073602 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b7310256-a704-41e0-a173-9ebe123bba75 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Returning 404 to user: Instance 9d5576c0-2aa8-4ca0-aed6-22c1f0700755 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:52:56.073602 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b7310256-a704-41e0-a173-9ebe123bba75 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9d5576c0-2aa8-4ca0-aed6-22c1f0700755" status: 404 len: 111 microversion: 2.1 time: 0.079047 Sep 23 04:52:56.073602 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2482/4830] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:52:55 2022] DELETE /compute/v2.1/servers/9d5576c0-2aa8-4ca0-aed6-22c1f0700755 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:52:56.080941 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2c6f673f-ede9-4a3b-9438-67bf427dc89c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:56.082436 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-2c6f673f-ede9-4a3b-9438-67bf427dc89c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: 9d5576c0-2aa8-4ca0-aed6-22c1f0700755] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:56.094491 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2c6f673f-ede9-4a3b-9438-67bf427dc89c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:56.096649 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2c6f673f-ede9-4a3b-9438-67bf427dc89c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:56.097280 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2c6f673f-ede9-4a3b-9438-67bf427dc89c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:56.107243 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2c6f673f-ede9-4a3b-9438-67bf427dc89c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:56.109927 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2c6f673f-ede9-4a3b-9438-67bf427dc89c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:56.110384 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2c6f673f-ede9-4a3b-9438-67bf427dc89c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:56.130352 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-2c6f673f-ede9-4a3b-9438-67bf427dc89c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] HTTP exception thrown: Instance 9d5576c0-2aa8-4ca0-aed6-22c1f0700755 could not be found. Sep 23 04:52:56.132298 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2c6f673f-ede9-4a3b-9438-67bf427dc89c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Request method failure captured: Sep 23 04:52:56.132298 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/9d5576c0-2aa8-4ca0-aed6-22c1f0700755 HTTP/1.1 Sep 23 04:52:56.132298 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:52:56.132298 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:52:56.132298 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:52:56.132298 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:52:56.132298 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:52:56.132298 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:52:56.132298 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:52:56.132298 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:52:56.132298 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTrDoGx96bSja4ydTGD-VWXTOyHeLiBA9Lvr197ivKeXqtV3OksEUUEiEPXK85IMwWXM1vCTp1M9PaXnUkKbFev29d-fL5KKXR0MfyGa86SLKINg6u_gn5EQLUNZ8EVLCkU1WwJ7agpVlFY75EyJH0fBcxrNg1yvFbeC2alzdH4Tkmw Sep 23 04:52:56.132298 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:52:56.132298 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:52:56.132298 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:52:56.132298 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:52:56.132298 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:52:56.132298 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:52:56.132298 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 78dca47156ff4f19a8673b893c853978 Sep 23 04:52:56.132298 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:52:56.132298 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:52:56.132298 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:52:56.132298 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_78dca47156ff4f19a8673b893c853978", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/78dca47156ff4f19a8673b893c853978"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/78dca47156ff4f19a8673b893c853978"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/78dca47156ff4f19a8673b893c853978"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:52:56.132298 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:52:56.132298 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 78dca47156ff4f19a8673b893c853978 Sep 23 04:52:56.132298 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:52:56.132298 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ServersNegativeTestJSON-1102187211-project Sep 23 04:52:56.132298 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:52:56.132298 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:52:56.132298 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: c912fb9d1f5447d180a9e8568220526f Sep 23 04:52:56.132298 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ServersNegativeTestJSON-1102187211-project Sep 23 04:52:56.132298 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:52:56.132298 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 9d5576c0-2aa8-4ca0-aed6-22c1f0700755 could not be found. Sep 23 04:52:56.132298 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '9d5576c0-2aa8-4ca0-aed6-22c1f0700755'} Sep 23 04:52:56.132298 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:52:56.132298 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:52:56.132298 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:52:56.132298 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:52:56.132298 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:52:56.132298 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:52:56.132298 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:52:56.132298 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:52:56.132298 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:52:56.132298 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:52:56.132298 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d5576c0-2aa8-4ca0-aed6-22c1f0700755 could not be found. Sep 23 04:52:56.132298 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:52:56.132298 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:52:56.132298 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:52:56.132298 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:52:56.132298 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:52:56.132298 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:52:56.132298 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:52:56.132298 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:52:56.132298 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:52:56.132298 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:52:56.132298 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:52:56.132298 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:52:56.132298 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:52:56.132298 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:52:56.132298 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:52:56.132298 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:52:56.132298 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d5576c0-2aa8-4ca0-aed6-22c1f0700755 could not be found. Sep 23 04:52:56.132298 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:52:56.132298 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:52:56.132298 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:52:56.137716 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:52:56.137716 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:52:56.137716 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:52:56.137716 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:52:56.137716 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:52:56.137716 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d5576c0-2aa8-4ca0-aed6-22c1f0700755 could not be found. Sep 23 04:52:56.137716 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:52:56.139191 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2c6f673f-ede9-4a3b-9438-67bf427dc89c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Returning 404 to user: Instance 9d5576c0-2aa8-4ca0-aed6-22c1f0700755 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:52:56.140207 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2c6f673f-ede9-4a3b-9438-67bf427dc89c tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/9d5576c0-2aa8-4ca0-aed6-22c1f0700755" status: 404 len: 111 microversion: 2.1 time: 0.063996 Sep 23 04:52:56.141255 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2349/4831] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:56 2022] GET /compute/v2.1/servers/9d5576c0-2aa8-4ca0-aed6-22c1f0700755 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:52:56.149402 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2516cd2f-0ff7-4629-82a7-59242a8204f0 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:56.150208 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-2516cd2f-0ff7-4629-82a7-59242a8204f0 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:56.160767 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2516cd2f-0ff7-4629-82a7-59242a8204f0 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:56.162568 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2516cd2f-0ff7-4629-82a7-59242a8204f0 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:56.163721 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2516cd2f-0ff7-4629-82a7-59242a8204f0 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:56.164642 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2516cd2f-0ff7-4629-82a7-59242a8204f0 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:56.166373 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2516cd2f-0ff7-4629-82a7-59242a8204f0 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:56.167885 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2516cd2f-0ff7-4629-82a7-59242a8204f0 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:56.224784 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-2516cd2f-0ff7-4629-82a7-59242a8204f0 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Going to try to terminate instance {{(pid=122699) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:52:56.308276 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-66881552-f891-4d4a-ba6f-567a5783a63a tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:56.310467 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-66881552-f891-4d4a-ba6f-567a5783a63a tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] [instance: 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:56.326603 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-66881552-f891-4d4a-ba6f-567a5783a63a tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:56.332206 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-66881552-f891-4d4a-ba6f-567a5783a63a tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:56.332935 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-66881552-f891-4d4a-ba6f-567a5783a63a tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:56.333965 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-66881552-f891-4d4a-ba6f-567a5783a63a tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:56.334675 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-66881552-f891-4d4a-ba6f-567a5783a63a tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:56.335405 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-66881552-f891-4d4a-ba6f-567a5783a63a tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:56.767578 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2516cd2f-0ff7-4629-82a7-59242a8204f0 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 204 len: 0 microversion: 2.1 time: 0.619978 Sep 23 04:52:56.769802 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2483/4832] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:52:56 2022] DELETE /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 0 bytes in 625 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:52:56.791732 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-cd4ef730-958d-430c-9a91-42379849284d tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:56.792494 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-cd4ef730-958d-430c-9a91-42379849284d tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: f285e256-0a0e-4126-8adf-643bd59ca141] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:56.802031 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cd4ef730-958d-430c-9a91-42379849284d tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:56.802815 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cd4ef730-958d-430c-9a91-42379849284d tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:56.803716 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cd4ef730-958d-430c-9a91-42379849284d tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:56.804687 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cd4ef730-958d-430c-9a91-42379849284d tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:56.805381 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cd4ef730-958d-430c-9a91-42379849284d tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:56.806375 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cd4ef730-958d-430c-9a91-42379849284d tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:57.042044 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-66881552-f891-4d4a-ba6f-567a5783a63a tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:57.056072 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-66881552-f891-4d4a-ba6f-567a5783a63a tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:57.057848 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-66881552-f891-4d4a-ba6f-567a5783a63a tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:57.060464 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-66881552-f891-4d4a-ba6f-567a5783a63a tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] 10.222.0.33 "GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7" status: 200 len: 1878 microversion: 2.32 time: 0.764282 Sep 23 04:52:57.062707 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2350/4833] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:52:56 2022] GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 => generated 1878 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:52:57.088502 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d04ec26a-6fde-4dad-8f2c-210ec394743e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:57.090688 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d04ec26a-6fde-4dad-8f2c-210ec394743e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:57.100391 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d04ec26a-6fde-4dad-8f2c-210ec394743e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:57.103454 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d04ec26a-6fde-4dad-8f2c-210ec394743e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:57.104294 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d04ec26a-6fde-4dad-8f2c-210ec394743e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:57.107081 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d04ec26a-6fde-4dad-8f2c-210ec394743e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:57.107841 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d04ec26a-6fde-4dad-8f2c-210ec394743e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:57.108649 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d04ec26a-6fde-4dad-8f2c-210ec394743e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:57.158198 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-cd4ef730-958d-430c-9a91-42379849284d tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:57.177525 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-cd4ef730-958d-430c-9a91-42379849284d tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:57.181041 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-cd4ef730-958d-430c-9a91-42379849284d tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:57.181671 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-cd4ef730-958d-430c-9a91-42379849284d tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141" status: 200 len: 1731 microversion: 2.20 time: 0.406528 Sep 23 04:52:57.197815 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2484/4834] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:52:56 2022] GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141 => generated 1731 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:52:57.197815 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-aa3e196e-467e-443d-9d4e-db739eb1e736 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:57.197815 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-aa3e196e-467e-443d-9d4e-db739eb1e736 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:57.212341 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:52:57.212341 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aa3e196e-467e-443d-9d4e-db739eb1e736 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:57.212341 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aa3e196e-467e-443d-9d4e-db739eb1e736 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:57.212341 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aa3e196e-467e-443d-9d4e-db739eb1e736 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:57.212341 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aa3e196e-467e-443d-9d4e-db739eb1e736 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:57.213425 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aa3e196e-467e-443d-9d4e-db739eb1e736 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:57.214044 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aa3e196e-467e-443d-9d4e-db739eb1e736 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:57.845316 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d04ec26a-6fde-4dad-8f2c-210ec394743e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:57.856955 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d04ec26a-6fde-4dad-8f2c-210ec394743e tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1509 microversion: 2.1 time: 0.792938 Sep 23 04:52:57.857796 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2351/4835] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:57 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1509 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:52:57.867019 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-4895945b-3904-4473-98b1-8f90d6fe5f2e req-c3f208e9-ccfa-4a5f-b514-68b80f7d6619 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49112e3f-73fc-4ee9-b48e-bcda5b7dcda7", "name": "network-vif-plugged", "status": "completed", "tag": "faa157e1-e76c-4be9-8480-61d19f273bad"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:52:57.894993 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-4895945b-3904-4473-98b1-8f90d6fe5f2e req-c3f208e9-ccfa-4a5f-b514-68b80f7d6619 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:57.897460 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-4895945b-3904-4473-98b1-8f90d6fe5f2e req-c3f208e9-ccfa-4a5f-b514-68b80f7d6619 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:57.897989 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-4895945b-3904-4473-98b1-8f90d6fe5f2e req-c3f208e9-ccfa-4a5f-b514-68b80f7d6619 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:57.912608 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-4895945b-3904-4473-98b1-8f90d6fe5f2e req-c3f208e9-ccfa-4a5f-b514-68b80f7d6619 service nova] Creating event network-vif-plugged:faa157e1-e76c-4be9-8480-61d19f273bad for instance 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 on n-h2-846463-3 Sep 23 04:52:57.919063 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-4895945b-3904-4473-98b1-8f90d6fe5f2e req-c3f208e9-ccfa-4a5f-b514-68b80f7d6619 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055544 Sep 23 04:52:57.919815 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2352/4836] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:52:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:52:57.976140 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-aa3e196e-467e-443d-9d4e-db739eb1e736 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:57.985208 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-aa3e196e-467e-443d-9d4e-db739eb1e736 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b" status: 200 len: 1513 microversion: 2.1 time: 0.796775 Sep 23 04:52:58.004277 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2485/4837] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:57 2022] GET /compute/v2.1/servers/c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b => generated 1513 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:52:58.092424 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-bfa07745-2aaf-4dd6-9d47-958116d893f8 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:58.093820 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-bfa07745-2aaf-4dd6-9d47-958116d893f8 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] [instance: 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:58.100551 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bfa07745-2aaf-4dd6-9d47-958116d893f8 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:58.101343 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bfa07745-2aaf-4dd6-9d47-958116d893f8 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:58.101858 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bfa07745-2aaf-4dd6-9d47-958116d893f8 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:58.102810 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bfa07745-2aaf-4dd6-9d47-958116d893f8 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:58.103577 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bfa07745-2aaf-4dd6-9d47-958116d893f8 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:58.104203 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bfa07745-2aaf-4dd6-9d47-958116d893f8 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:58.208364 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e9d3515f-c178-4b5b-a7a0-c9d3249b170f tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:58.208984 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e9d3515f-c178-4b5b-a7a0-c9d3249b170f tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: f285e256-0a0e-4126-8adf-643bd59ca141] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:58.220249 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e9d3515f-c178-4b5b-a7a0-c9d3249b170f tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:58.220803 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e9d3515f-c178-4b5b-a7a0-c9d3249b170f tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:58.221334 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e9d3515f-c178-4b5b-a7a0-c9d3249b170f tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:58.222141 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e9d3515f-c178-4b5b-a7a0-c9d3249b170f tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:58.222806 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e9d3515f-c178-4b5b-a7a0-c9d3249b170f tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:58.223641 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e9d3515f-c178-4b5b-a7a0-c9d3249b170f tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:58.518009 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-bfa07745-2aaf-4dd6-9d47-958116d893f8 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:58.536622 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-bfa07745-2aaf-4dd6-9d47-958116d893f8 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:58.540884 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-bfa07745-2aaf-4dd6-9d47-958116d893f8 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:58.553721 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-bfa07745-2aaf-4dd6-9d47-958116d893f8 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] 10.222.0.33 "GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7" status: 200 len: 1878 microversion: 2.32 time: 0.457808 Sep 23 04:52:58.553721 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2353/4838] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:52:58 2022] GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 => generated 1878 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:52:58.595565 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e9d3515f-c178-4b5b-a7a0-c9d3249b170f tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:58.610183 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e9d3515f-c178-4b5b-a7a0-c9d3249b170f tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:58.613717 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e9d3515f-c178-4b5b-a7a0-c9d3249b170f tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:58.617705 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e9d3515f-c178-4b5b-a7a0-c9d3249b170f tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141" status: 200 len: 1731 microversion: 2.20 time: 0.410922 Sep 23 04:52:58.636960 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2486/4839] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:52:58 2022] GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141 => generated 1731 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:52:58.882409 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-16bae1a6-aba2-4f5e-8b8a-58ba2314056a tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:58.883235 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-16bae1a6-aba2-4f5e-8b8a-58ba2314056a tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:58.890443 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-16bae1a6-aba2-4f5e-8b8a-58ba2314056a tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:58.891550 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-16bae1a6-aba2-4f5e-8b8a-58ba2314056a tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:58.892539 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-16bae1a6-aba2-4f5e-8b8a-58ba2314056a tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:58.893610 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-16bae1a6-aba2-4f5e-8b8a-58ba2314056a tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:58.894269 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-16bae1a6-aba2-4f5e-8b8a-58ba2314056a tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:58.894867 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-16bae1a6-aba2-4f5e-8b8a-58ba2314056a tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:59.014606 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c40b8b55-ce23-4a19-98a2-90da15d868a0 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:59.015667 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c40b8b55-ce23-4a19-98a2-90da15d868a0 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:59.031072 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c40b8b55-ce23-4a19-98a2-90da15d868a0 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:59.031833 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c40b8b55-ce23-4a19-98a2-90da15d868a0 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:59.032890 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c40b8b55-ce23-4a19-98a2-90da15d868a0 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:59.034790 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c40b8b55-ce23-4a19-98a2-90da15d868a0 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:59.035496 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c40b8b55-ce23-4a19-98a2-90da15d868a0 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:59.036209 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c40b8b55-ce23-4a19-98a2-90da15d868a0 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:59.494339 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c40b8b55-ce23-4a19-98a2-90da15d868a0 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:59.511445 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c40b8b55-ce23-4a19-98a2-90da15d868a0 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b" status: 200 len: 1513 microversion: 2.1 time: 0.504183 Sep 23 04:52:59.522369 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2487/4840] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:59 2022] GET /compute/v2.1/servers/c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b => generated 1513 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:52:59.566442 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-16bae1a6-aba2-4f5e-8b8a-58ba2314056a tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:52:59.591781 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7a9774f5-c1bb-46df-aea4-1eb19d6c3bb8 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:59.592517 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-7a9774f5-c1bb-46df-aea4-1eb19d6c3bb8 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] [instance: 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:59.599838 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-16bae1a6-aba2-4f5e-8b8a-58ba2314056a tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1509 microversion: 2.1 time: 0.721683 Sep 23 04:52:59.600378 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7a9774f5-c1bb-46df-aea4-1eb19d6c3bb8 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:59.601381 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7a9774f5-c1bb-46df-aea4-1eb19d6c3bb8 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:59.602463 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7a9774f5-c1bb-46df-aea4-1eb19d6c3bb8 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:59.603432 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7a9774f5-c1bb-46df-aea4-1eb19d6c3bb8 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:59.604089 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7a9774f5-c1bb-46df-aea4-1eb19d6c3bb8 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:59.604731 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7a9774f5-c1bb-46df-aea4-1eb19d6c3bb8 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:59.611776 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2354/4841] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:52:58 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1509 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:52:59.648522 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5882cde4-ba14-4357-9c21-e99c5368b2f3 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:52:59.649447 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5882cde4-ba14-4357-9c21-e99c5368b2f3 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: f285e256-0a0e-4126-8adf-643bd59ca141] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:52:59.659750 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5882cde4-ba14-4357-9c21-e99c5368b2f3 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:59.660274 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5882cde4-ba14-4357-9c21-e99c5368b2f3 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:59.660737 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5882cde4-ba14-4357-9c21-e99c5368b2f3 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:52:59.661457 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5882cde4-ba14-4357-9c21-e99c5368b2f3 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:52:59.669490 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5882cde4-ba14-4357-9c21-e99c5368b2f3 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:52:59.672259 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5882cde4-ba14-4357-9c21-e99c5368b2f3 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:00.327986 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-5882cde4-ba14-4357-9c21-e99c5368b2f3 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:00.342998 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-5882cde4-ba14-4357-9c21-e99c5368b2f3 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:00.345506 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-5882cde4-ba14-4357-9c21-e99c5368b2f3 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:00.347207 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5882cde4-ba14-4357-9c21-e99c5368b2f3 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141" status: 200 len: 1731 microversion: 2.20 time: 0.705510 Sep 23 04:53:00.368829 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2355/4842] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:52:59 2022] GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141 => generated 1731 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:53:00.380098 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-4af33d58-2254-4fe0-8c35-0d08a5038a75 req-6cded9a3-97c8-4c76-87ea-298af31ff407 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49112e3f-73fc-4ee9-b48e-bcda5b7dcda7", "name": "network-vif-plugged", "status": "completed", "tag": "16397cd8-7ed4-4825-8440-b6d39557eb3f"}, {"server_uuid": "49112e3f-73fc-4ee9-b48e-bcda5b7dcda7", "name": "network-vif-plugged", "status": "completed", "tag": "7526a24d-5fba-4653-bde4-13d72cf5232a"}, {"server_uuid": "49112e3f-73fc-4ee9-b48e-bcda5b7dcda7", "name": "network-vif-plugged", "status": "completed", "tag": "8231c7d3-a7f9-4daf-87f5-be07473f366a"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:53:00.409100 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-4af33d58-2254-4fe0-8c35-0d08a5038a75 req-6cded9a3-97c8-4c76-87ea-298af31ff407 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:00.410404 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-4af33d58-2254-4fe0-8c35-0d08a5038a75 req-6cded9a3-97c8-4c76-87ea-298af31ff407 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:00.411189 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-4af33d58-2254-4fe0-8c35-0d08a5038a75 req-6cded9a3-97c8-4c76-87ea-298af31ff407 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:00.453372 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-4af33d58-2254-4fe0-8c35-0d08a5038a75 req-6cded9a3-97c8-4c76-87ea-298af31ff407 service nova] Creating event network-vif-plugged:16397cd8-7ed4-4825-8440-b6d39557eb3f for instance 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 on n-h2-846463-3 Sep 23 04:53:00.455613 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-4af33d58-2254-4fe0-8c35-0d08a5038a75 req-6cded9a3-97c8-4c76-87ea-298af31ff407 service nova] Creating event network-vif-plugged:7526a24d-5fba-4653-bde4-13d72cf5232a for instance 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 on n-h2-846463-3 Sep 23 04:53:00.456945 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-4af33d58-2254-4fe0-8c35-0d08a5038a75 req-6cded9a3-97c8-4c76-87ea-298af31ff407 service nova] Creating event network-vif-plugged:8231c7d3-a7f9-4daf-87f5-be07473f366a for instance 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 on n-h2-846463-3 Sep 23 04:53:00.469462 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-4af33d58-2254-4fe0-8c35-0d08a5038a75 req-6cded9a3-97c8-4c76-87ea-298af31ff407 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.098860 Sep 23 04:53:00.475570 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2356/4843] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:53:00 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:53:00.491856 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-7a9774f5-c1bb-46df-aea4-1eb19d6c3bb8 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:00.522520 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-7a9774f5-c1bb-46df-aea4-1eb19d6c3bb8 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:00.524380 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-7a9774f5-c1bb-46df-aea4-1eb19d6c3bb8 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:00.528296 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-7a9774f5-c1bb-46df-aea4-1eb19d6c3bb8 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] 10.222.0.33 "GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7" status: 200 len: 1878 microversion: 2.32 time: 0.945589 Sep 23 04:53:00.541752 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2488/4844] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:52:59 2022] GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 => generated 1878 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:53:00.563297 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a3e6ea18-d858-4314-b2d6-16b485115170 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:00.564408 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a3e6ea18-d858-4314-b2d6-16b485115170 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:00.574359 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a3e6ea18-d858-4314-b2d6-16b485115170 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:00.575800 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a3e6ea18-d858-4314-b2d6-16b485115170 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:00.577555 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a3e6ea18-d858-4314-b2d6-16b485115170 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:00.580514 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a3e6ea18-d858-4314-b2d6-16b485115170 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:00.581014 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a3e6ea18-d858-4314-b2d6-16b485115170 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:00.590462 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a3e6ea18-d858-4314-b2d6-16b485115170 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:00.635748 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-84dcda4d-d194-4451-ba64-42bb86c5c891 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:00.636678 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-84dcda4d-d194-4451-ba64-42bb86c5c891 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:00.660390 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-84dcda4d-d194-4451-ba64-42bb86c5c891 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:00.660390 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-84dcda4d-d194-4451-ba64-42bb86c5c891 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:00.660390 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-84dcda4d-d194-4451-ba64-42bb86c5c891 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:00.663893 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-84dcda4d-d194-4451-ba64-42bb86c5c891 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:00.663893 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-84dcda4d-d194-4451-ba64-42bb86c5c891 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:00.664258 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-84dcda4d-d194-4451-ba64-42bb86c5c891 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:00.911587 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-84dcda4d-d194-4451-ba64-42bb86c5c891 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:00.936032 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-84dcda4d-d194-4451-ba64-42bb86c5c891 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1467 microversion: 2.1 time: 0.304885 Sep 23 04:53:00.937045 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2489/4845] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:00 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1467 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:00.938885 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=4 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:53:00.942819 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-83a21950-7601-4d9b-bd89-72d3f8320adf req-894188d7-7cbd-4e38-a8af-30dd54fb4385 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9f2ff08-c66d-4991-9bae-d523a3adb8bf", "name": "network-vif-deleted", "tag": "5cac1937-93f1-4537-9d14-be0ca8715d11"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:53:00.957617 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-83a21950-7601-4d9b-bd89-72d3f8320adf req-894188d7-7cbd-4e38-a8af-30dd54fb4385 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:00.968600 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-83a21950-7601-4d9b-bd89-72d3f8320adf req-894188d7-7cbd-4e38-a8af-30dd54fb4385 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:00.971148 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-83a21950-7601-4d9b-bd89-72d3f8320adf req-894188d7-7cbd-4e38-a8af-30dd54fb4385 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:01.002380 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-83a21950-7601-4d9b-bd89-72d3f8320adf req-894188d7-7cbd-4e38-a8af-30dd54fb4385 service nova] Creating event network-vif-deleted:5cac1937-93f1-4537-9d14-be0ca8715d11 for instance a9f2ff08-c66d-4991-9bae-d523a3adb8bf on n-h1-846463-3 Sep 23 04:53:01.015261 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-83a21950-7601-4d9b-bd89-72d3f8320adf req-894188d7-7cbd-4e38-a8af-30dd54fb4385 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076325 Sep 23 04:53:01.015764 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2490/4846] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:53:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:53:01.077551 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a3e6ea18-d858-4314-b2d6-16b485115170 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:01.094454 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a3e6ea18-d858-4314-b2d6-16b485115170 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b" status: 200 len: 1513 microversion: 2.1 time: 0.532569 Sep 23 04:53:01.095119 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2357/4847] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:00 2022] GET /compute/v2.1/servers/c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b => generated 1513 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:01.383677 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1594da82-0501-46b8-8c96-0c40ead911df tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:01.384943 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1594da82-0501-46b8-8c96-0c40ead911df tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: f285e256-0a0e-4126-8adf-643bd59ca141] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:01.412545 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1594da82-0501-46b8-8c96-0c40ead911df tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:01.416954 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1594da82-0501-46b8-8c96-0c40ead911df tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:01.421333 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1594da82-0501-46b8-8c96-0c40ead911df tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:01.426848 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1594da82-0501-46b8-8c96-0c40ead911df tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:01.432703 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1594da82-0501-46b8-8c96-0c40ead911df tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:01.433178 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1594da82-0501-46b8-8c96-0c40ead911df tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:01.561642 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4089bdeb-adf5-4c7b-9ed1-cbaaec9682dd tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:01.562260 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4089bdeb-adf5-4c7b-9ed1-cbaaec9682dd tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] [instance: 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:01.596519 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4089bdeb-adf5-4c7b-9ed1-cbaaec9682dd tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:01.597227 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4089bdeb-adf5-4c7b-9ed1-cbaaec9682dd tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:01.597692 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4089bdeb-adf5-4c7b-9ed1-cbaaec9682dd tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:01.598486 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4089bdeb-adf5-4c7b-9ed1-cbaaec9682dd tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:01.598962 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4089bdeb-adf5-4c7b-9ed1-cbaaec9682dd tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:01.599401 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4089bdeb-adf5-4c7b-9ed1-cbaaec9682dd tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:02.188386 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4089bdeb-adf5-4c7b-9ed1-cbaaec9682dd tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:02.201770 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4089bdeb-adf5-4c7b-9ed1-cbaaec9682dd tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:02.212236 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1594da82-0501-46b8-8c96-0c40ead911df tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:02.223814 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4089bdeb-adf5-4c7b-9ed1-cbaaec9682dd tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:02.228956 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4089bdeb-adf5-4c7b-9ed1-cbaaec9682dd tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] 10.222.0.33 "GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7" status: 200 len: 1878 microversion: 2.32 time: 0.672052 Sep 23 04:53:02.241923 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1594da82-0501-46b8-8c96-0c40ead911df tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:02.241923 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1594da82-0501-46b8-8c96-0c40ead911df tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:02.241923 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1594da82-0501-46b8-8c96-0c40ead911df tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141" status: 200 len: 1731 microversion: 2.20 time: 0.862619 Sep 23 04:53:02.241923 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2491/4848] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:53:01 2022] GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141 => generated 1731 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:53:02.251475 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2358/4849] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:53:01 2022] GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 => generated 1878 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:53:02.258981 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3cdf0e34-4c10-4d89-b03d-a98b7841a635 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:02.262378 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3cdf0e34-4c10-4d89-b03d-a98b7841a635 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:02.269431 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3cdf0e34-4c10-4d89-b03d-a98b7841a635 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:02.270414 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3cdf0e34-4c10-4d89-b03d-a98b7841a635 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:02.271094 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3cdf0e34-4c10-4d89-b03d-a98b7841a635 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:02.272049 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3cdf0e34-4c10-4d89-b03d-a98b7841a635 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:02.273023 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c5315e4d-f816-45d3-a810-93845f709bec tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:02.273397 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3cdf0e34-4c10-4d89-b03d-a98b7841a635 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:02.274155 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3cdf0e34-4c10-4d89-b03d-a98b7841a635 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:02.279343 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c5315e4d-f816-45d3-a810-93845f709bec tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:02.309212 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c5315e4d-f816-45d3-a810-93845f709bec tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:02.312270 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c5315e4d-f816-45d3-a810-93845f709bec tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:02.312996 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c5315e4d-f816-45d3-a810-93845f709bec tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:02.316391 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c5315e4d-f816-45d3-a810-93845f709bec tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:02.320460 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c5315e4d-f816-45d3-a810-93845f709bec tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:02.321069 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c5315e4d-f816-45d3-a810-93845f709bec tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:02.415450 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c5315e4d-f816-45d3-a810-93845f709bec tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:02.416303 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c5315e4d-f816-45d3-a810-93845f709bec tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:02.417021 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c5315e4d-f816-45d3-a810-93845f709bec tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:02.418522 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-c5315e4d-f816-45d3-a810-93845f709bec tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lazy-loading 'fault' on Instance uuid a9f2ff08-c66d-4991-9bae-d523a3adb8bf {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:53:02.494529 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c5315e4d-f816-45d3-a810-93845f709bec tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c912fb9d1f5447d180a9e8568220526f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78dca47156ff4f19a8673b893c853978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:02.508155 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c5315e4d-f816-45d3-a810-93845f709bec tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 200 len: 1305 microversion: 2.1 time: 0.262499 Sep 23 04:53:02.511009 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2492/4850] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:02 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 1305 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:02.624915 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-3cdf0e34-4c10-4d89-b03d-a98b7841a635 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:02.652831 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3cdf0e34-4c10-4d89-b03d-a98b7841a635 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b" status: 200 len: 1513 microversion: 2.1 time: 0.394314 Sep 23 04:53:02.652831 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2359/4851] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:02 2022] GET /compute/v2.1/servers/c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b => generated 1513 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:02.667902 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3e7aa96e-3a39-48e2-ad3b-0276cc113180 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-700381343", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "e3a115a5-ad80-4cd0-8aec-efdb4c3b4758"}]}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:53:02.696116 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-0d85cfe2-5a67-4f5d-b73d-8eb15764057a req-57d3c3c1-b0a6-489e-9739-2d83d28c9ba9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49112e3f-73fc-4ee9-b48e-bcda5b7dcda7", "name": "network-vif-plugged", "status": "completed", "tag": "18162764-2c41-4a27-9757-c9988b7e7d84"}, {"server_uuid": "49112e3f-73fc-4ee9-b48e-bcda5b7dcda7", "name": "network-vif-plugged", "status": "completed", "tag": "462c3500-e3b1-4869-99f4-aeaa9293fea3"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:53:02.715512 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-0d85cfe2-5a67-4f5d-b73d-8eb15764057a req-57d3c3c1-b0a6-489e-9739-2d83d28c9ba9 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:02.716620 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-0d85cfe2-5a67-4f5d-b73d-8eb15764057a req-57d3c3c1-b0a6-489e-9739-2d83d28c9ba9 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:02.717620 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-0d85cfe2-5a67-4f5d-b73d-8eb15764057a req-57d3c3c1-b0a6-489e-9739-2d83d28c9ba9 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:02.734118 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-0d85cfe2-5a67-4f5d-b73d-8eb15764057a req-57d3c3c1-b0a6-489e-9739-2d83d28c9ba9 service nova] Creating event network-vif-plugged:18162764-2c41-4a27-9757-c9988b7e7d84 for instance 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 on n-h2-846463-3 Sep 23 04:53:02.734633 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-0d85cfe2-5a67-4f5d-b73d-8eb15764057a req-57d3c3c1-b0a6-489e-9739-2d83d28c9ba9 service nova] Creating event network-vif-plugged:462c3500-e3b1-4869-99f4-aeaa9293fea3 for instance 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 on n-h2-846463-3 Sep 23 04:53:02.740619 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-0d85cfe2-5a67-4f5d-b73d-8eb15764057a req-57d3c3c1-b0a6-489e-9739-2d83d28c9ba9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.051662 Sep 23 04:53:02.741380 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2360/4852] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:53:02 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:53:02.759984 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.neutron [None req-3e7aa96e-3a39-48e2-ad3b-0276cc113180 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] validate_networks() for [('e3a115a5-ad80-4cd0-8aec-efdb4c3b4758', None, None, None, None, None)] {{(pid=122699) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:53:03.266704 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c2fa2db2-368a-4b8c-b014-b84cfcd4a77b tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:03.268586 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c2fa2db2-368a-4b8c-b014-b84cfcd4a77b tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] [instance: 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:03.286229 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c2fa2db2-368a-4b8c-b014-b84cfcd4a77b tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:03.290483 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c2fa2db2-368a-4b8c-b014-b84cfcd4a77b tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:03.290483 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c2fa2db2-368a-4b8c-b014-b84cfcd4a77b tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:03.290483 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c2fa2db2-368a-4b8c-b014-b84cfcd4a77b tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:03.296981 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c2fa2db2-368a-4b8c-b014-b84cfcd4a77b tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:03.298095 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c2fa2db2-368a-4b8c-b014-b84cfcd4a77b tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:03.650808 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-3e7aa96e-3a39-48e2-ad3b-0276cc113180 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Flavor limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:53:03.651409 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-3e7aa96e-3a39-48e2-ad3b-0276cc113180 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Image limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:53:03.651760 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-3e7aa96e-3a39-48e2-ad3b-0276cc113180 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Flavor pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:53:03.653506 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-3e7aa96e-3a39-48e2-ad3b-0276cc113180 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Image pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:53:03.654167 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-3e7aa96e-3a39-48e2-ad3b-0276cc113180 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:53:03.672721 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3e7aa96e-3a39-48e2-ad3b-0276cc113180 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:03.679950 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3e7aa96e-3a39-48e2-ad3b-0276cc113180 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:03.680570 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3e7aa96e-3a39-48e2-ad3b-0276cc113180 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:03.681632 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3e7aa96e-3a39-48e2-ad3b-0276cc113180 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:03.682076 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3e7aa96e-3a39-48e2-ad3b-0276cc113180 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:03.682531 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3e7aa96e-3a39-48e2-ad3b-0276cc113180 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:03.731559 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-3e7aa96e-3a39-48e2-ad3b-0276cc113180 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Getting quotas for project 2af9b29a1d1f488faf6e4dfd19055728. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:53:03.741042 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-3e7aa96e-3a39-48e2-ad3b-0276cc113180 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Getting quotas for user 46eb7f913d7e49f58af088102c5a06a7 and project 2af9b29a1d1f488faf6e4dfd19055728. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:53:03.755886 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c2fa2db2-368a-4b8c-b014-b84cfcd4a77b tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:03.784771 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-3e7aa96e-3a39-48e2-ad3b-0276cc113180 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Going to run 2 instances... {{(pid=122699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:53:03.789587 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-3e7aa96e-3a39-48e2-ad3b-0276cc113180 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] [instance: 8243026d-51c6-4be3-b91b-4487474eb19a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:53:03.797370 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c2fa2db2-368a-4b8c-b014-b84cfcd4a77b tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:03.799045 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c2fa2db2-368a-4b8c-b014-b84cfcd4a77b tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:03.800321 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c2fa2db2-368a-4b8c-b014-b84cfcd4a77b tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] 10.222.0.33 "GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7" status: 200 len: 1878 microversion: 2.32 time: 0.541400 Sep 23 04:53:03.810250 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2361/4853] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:53:03 2022] GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 => generated 1878 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:53:03.816181 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-04891b90-027b-4239-b5a6-d30d2ad40744 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:03.816805 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-04891b90-027b-4239-b5a6-d30d2ad40744 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: f285e256-0a0e-4126-8adf-643bd59ca141] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:03.841250 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-04891b90-027b-4239-b5a6-d30d2ad40744 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:03.843157 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-04891b90-027b-4239-b5a6-d30d2ad40744 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:03.843944 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-04891b90-027b-4239-b5a6-d30d2ad40744 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:03.845501 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-04891b90-027b-4239-b5a6-d30d2ad40744 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:03.846767 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-04891b90-027b-4239-b5a6-d30d2ad40744 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:03.847722 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-04891b90-027b-4239-b5a6-d30d2ad40744 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:03.910180 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-3e7aa96e-3a39-48e2-ad3b-0276cc113180 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] [instance: 79de76d4-8a77-45a2-b29f-da2d04bc206a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=8243026d-51c6-4be3-b91b-4487474eb19a,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:53:04.124167 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-04891b90-027b-4239-b5a6-d30d2ad40744 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:04.138581 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-04891b90-027b-4239-b5a6-d30d2ad40744 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:04.141185 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-04891b90-027b-4239-b5a6-d30d2ad40744 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:04.145479 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-04891b90-027b-4239-b5a6-d30d2ad40744 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141" status: 200 len: 1731 microversion: 2.20 time: 0.334053 Sep 23 04:53:04.158278 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2362/4854] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:53:03 2022] GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141 => generated 1731 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:53:04.168243 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3e7aa96e-3a39-48e2-ad3b-0276cc113180 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.635565 Sep 23 04:53:04.168243 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2493/4855] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:53:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1637 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:53:04.168628 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-736e11eb-2ac7-4f04-89e1-35fac07830e3 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:04.168960 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-736e11eb-2ac7-4f04-89e1-35fac07830e3 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] [instance: a9f2ff08-c66d-4991-9bae-d523a3adb8bf] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:04.171466 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7cb223b5-7de9-48cd-b100-9c86ae9001af tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:04.172136 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-7cb223b5-7de9-48cd-b100-9c86ae9001af tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:04.183685 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-736e11eb-2ac7-4f04-89e1-35fac07830e3 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:04.187814 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-736e11eb-2ac7-4f04-89e1-35fac07830e3 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:04.187814 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-736e11eb-2ac7-4f04-89e1-35fac07830e3 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:04.187814 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-736e11eb-2ac7-4f04-89e1-35fac07830e3 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:04.187814 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-736e11eb-2ac7-4f04-89e1-35fac07830e3 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:04.187814 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-736e11eb-2ac7-4f04-89e1-35fac07830e3 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:04.193042 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7cb223b5-7de9-48cd-b100-9c86ae9001af tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:04.194321 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7cb223b5-7de9-48cd-b100-9c86ae9001af tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:04.194957 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7cb223b5-7de9-48cd-b100-9c86ae9001af tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:04.195893 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7cb223b5-7de9-48cd-b100-9c86ae9001af tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:04.196541 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7cb223b5-7de9-48cd-b100-9c86ae9001af tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:04.196980 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7cb223b5-7de9-48cd-b100-9c86ae9001af tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:04.203284 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:53:04.229020 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-736e11eb-2ac7-4f04-89e1-35fac07830e3 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] HTTP exception thrown: Instance a9f2ff08-c66d-4991-9bae-d523a3adb8bf could not be found. Sep 23 04:53:04.230948 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-736e11eb-2ac7-4f04-89e1-35fac07830e3 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Request method failure captured: Sep 23 04:53:04.230948 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf HTTP/1.1 Sep 23 04:53:04.230948 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:53:04.230948 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:53:04.230948 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:53:04.230948 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:53:04.230948 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:53:04.230948 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:53:04.230948 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:53:04.230948 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:53:04.230948 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTrDoGx96bSja4ydTGD-VWXTOyHeLiBA9Lvr197ivKeXqtV3OksEUUEiEPXK85IMwWXM1vCTp1M9PaXnUkKbFev29d-fL5KKXR0MfyGa86SLKINg6u_gn5EQLUNZ8EVLCkU1WwJ7agpVlFY75EyJH0fBcxrNg1yvFbeC2alzdH4Tkmw Sep 23 04:53:04.230948 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:53:04.230948 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:53:04.230948 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:53:04.230948 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:53:04.230948 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:53:04.230948 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:53:04.230948 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 78dca47156ff4f19a8673b893c853978 Sep 23 04:53:04.230948 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:53:04.230948 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:53:04.230948 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:53:04.230948 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_78dca47156ff4f19a8673b893c853978", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/78dca47156ff4f19a8673b893c853978"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/78dca47156ff4f19a8673b893c853978"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/78dca47156ff4f19a8673b893c853978"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:53:04.230948 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:53:04.230948 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 78dca47156ff4f19a8673b893c853978 Sep 23 04:53:04.230948 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1102187211 Sep 23 04:53:04.230948 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ServersNegativeTestJSON-1102187211-project Sep 23 04:53:04.230948 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:53:04.230948 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:53:04.230948 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: c912fb9d1f5447d180a9e8568220526f Sep 23 04:53:04.230948 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ServersNegativeTestJSON-1102187211-project Sep 23 04:53:04.230948 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:53:04.230948 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance a9f2ff08-c66d-4991-9bae-d523a3adb8bf could not be found. Sep 23 04:53:04.230948 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': 'a9f2ff08-c66d-4991-9bae-d523a3adb8bf'} Sep 23 04:53:04.230948 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:53:04.230948 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:53:04.230948 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:53:04.230948 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:53:04.230948 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:53:04.230948 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:53:04.230948 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:53:04.230948 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:53:04.230948 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:53:04.230948 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:53:04.230948 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9f2ff08-c66d-4991-9bae-d523a3adb8bf could not be found. Sep 23 04:53:04.230948 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:53:04.230948 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:53:04.230948 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:53:04.230948 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:53:04.230948 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:53:04.230948 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:53:04.230948 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:53:04.230948 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:53:04.230948 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:53:04.230948 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:53:04.230948 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:53:04.230948 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:53:04.230948 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:53:04.230948 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:53:04.230948 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:53:04.230948 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:53:04.230948 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9f2ff08-c66d-4991-9bae-d523a3adb8bf could not be found. Sep 23 04:53:04.230948 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:53:04.230948 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:53:04.230948 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:53:04.236224 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:53:04.236224 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:53:04.236224 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:53:04.236224 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:53:04.236224 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:53:04.236224 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9f2ff08-c66d-4991-9bae-d523a3adb8bf could not be found. Sep 23 04:53:04.236224 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:53:04.236224 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-736e11eb-2ac7-4f04-89e1-35fac07830e3 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] Returning 404 to user: Instance a9f2ff08-c66d-4991-9bae-d523a3adb8bf could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:53:04.236224 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-736e11eb-2ac7-4f04-89e1-35fac07830e3 tempest-ServersNegativeTestJSON-1102187211 tempest-ServersNegativeTestJSON-1102187211-project] 10.222.0.33 "GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf" status: 404 len: 111 microversion: 2.1 time: 0.083606 Sep 23 04:53:04.236224 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2363/4856] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:04 2022] GET /compute/v2.1/servers/a9f2ff08-c66d-4991-9bae-d523a3adb8bf => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:53:04.238875 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-08c3b855-fdf7-4faa-a2a0-022c5be00349 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:04.247421 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-08c3b855-fdf7-4faa-a2a0-022c5be00349 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '46eb7f913d7e49f58af088102c5a06a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af9b29a1d1f488faf6e4dfd19055728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:04.247421 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-08c3b855-fdf7-4faa-a2a0-022c5be00349 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Searching by: {'deleted': False, 'project_id': '2af9b29a1d1f488faf6e4dfd19055728'} {{(pid=122698) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 04:53:04.285635 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-08c3b855-fdf7-4faa-a2a0-022c5be00349 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:04.287062 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-08c3b855-fdf7-4faa-a2a0-022c5be00349 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:04.287663 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-08c3b855-fdf7-4faa-a2a0-022c5be00349 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:04.289596 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-08c3b855-fdf7-4faa-a2a0-022c5be00349 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:04.290309 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-08c3b855-fdf7-4faa-a2a0-022c5be00349 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:04.291249 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-08c3b855-fdf7-4faa-a2a0-022c5be00349 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:04.344324 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-08c3b855-fdf7-4faa-a2a0-022c5be00349 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 675 microversion: 2.1 time: 0.100666 Sep 23 04:53:04.352911 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2364/4857] 10.222.0.33 () {58 vars in 1125 bytes} [Fri Sep 23 04:53:04 2022] GET /compute/v2.1/servers => generated 675 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:53:04.366949 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a13a2dd1-f8e9-43aa-8bec-2b3deccf5a7a tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:04.368928 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a13a2dd1-f8e9-43aa-8bec-2b3deccf5a7a tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] [instance: 79de76d4-8a77-45a2-b29f-da2d04bc206a] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:04.638704 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a13a2dd1-f8e9-43aa-8bec-2b3deccf5a7a tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46eb7f913d7e49f58af088102c5a06a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af9b29a1d1f488faf6e4dfd19055728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:04.658722 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a13a2dd1-f8e9-43aa-8bec-2b3deccf5a7a tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] 10.222.0.33 "GET /compute/v2.1/servers/79de76d4-8a77-45a2-b29f-da2d04bc206a" status: 200 len: 1219 microversion: 2.1 time: 0.304310 Sep 23 04:53:04.675050 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2365/4858] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:04 2022] GET /compute/v2.1/servers/79de76d4-8a77-45a2-b29f-da2d04bc206a => generated 1219 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:04.832583 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-fbbeafd4-1a7c-460f-a114-a261d026e16f tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:04.833322 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-fbbeafd4-1a7c-460f-a114-a261d026e16f tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] [instance: 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:04.845409 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fbbeafd4-1a7c-460f-a114-a261d026e16f tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:04.847563 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fbbeafd4-1a7c-460f-a114-a261d026e16f tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:04.850112 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fbbeafd4-1a7c-460f-a114-a261d026e16f tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:04.851118 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fbbeafd4-1a7c-460f-a114-a261d026e16f tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:04.851604 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fbbeafd4-1a7c-460f-a114-a261d026e16f tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:04.853827 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fbbeafd4-1a7c-460f-a114-a261d026e16f tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:05.159869 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-7cb223b5-7de9-48cd-b100-9c86ae9001af tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:05.178356 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-7cb223b5-7de9-48cd-b100-9c86ae9001af tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b" status: 200 len: 1513 microversion: 2.1 time: 1.010750 Sep 23 04:53:05.182118 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2494/4859] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:04 2022] GET /compute/v2.1/servers/c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b => generated 1513 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:05.193198 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ddab6518-4d56-42fa-83bc-6a6a35af8e6d tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:05.204168 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ddab6518-4d56-42fa-83bc-6a6a35af8e6d tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: f285e256-0a0e-4126-8adf-643bd59ca141] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:05.238348 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ddab6518-4d56-42fa-83bc-6a6a35af8e6d tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:05.241257 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ddab6518-4d56-42fa-83bc-6a6a35af8e6d tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:05.242912 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ddab6518-4d56-42fa-83bc-6a6a35af8e6d tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:05.245262 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ddab6518-4d56-42fa-83bc-6a6a35af8e6d tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:05.246729 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ddab6518-4d56-42fa-83bc-6a6a35af8e6d tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:05.248297 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ddab6518-4d56-42fa-83bc-6a6a35af8e6d tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:05.716894 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-fbbeafd4-1a7c-460f-a114-a261d026e16f tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:05.739263 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-fbbeafd4-1a7c-460f-a114-a261d026e16f tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:05.741401 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-fbbeafd4-1a7c-460f-a114-a261d026e16f tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:05.743820 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-fbbeafd4-1a7c-460f-a114-a261d026e16f tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] 10.222.0.33 "GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7" status: 200 len: 1878 microversion: 2.32 time: 0.916869 Sep 23 04:53:05.745026 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2366/4860] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:53:04 2022] GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 => generated 1878 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:53:05.756089 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-cf8360d9-cbf7-4791-85a4-deeae73819a2 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:05.757797 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-cf8360d9-cbf7-4791-85a4-deeae73819a2 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] [instance: 79de76d4-8a77-45a2-b29f-da2d04bc206a] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:05.787089 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:53:05.839037 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ddab6518-4d56-42fa-83bc-6a6a35af8e6d tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:05.847287 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ddab6518-4d56-42fa-83bc-6a6a35af8e6d tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:05.848970 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ddab6518-4d56-42fa-83bc-6a6a35af8e6d tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:05.850482 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ddab6518-4d56-42fa-83bc-6a6a35af8e6d tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141" status: 200 len: 1731 microversion: 2.20 time: 0.666059 Sep 23 04:53:05.851578 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2495/4861] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:53:05 2022] GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141 => generated 1731 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:53:06.040912 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-cf8360d9-cbf7-4791-85a4-deeae73819a2 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46eb7f913d7e49f58af088102c5a06a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af9b29a1d1f488faf6e4dfd19055728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:06.054447 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-cf8360d9-cbf7-4791-85a4-deeae73819a2 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] 10.222.0.33 "GET /compute/v2.1/servers/79de76d4-8a77-45a2-b29f-da2d04bc206a" status: 200 len: 1219 microversion: 2.1 time: 0.308006 Sep 23 04:53:06.055048 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2367/4862] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:05 2022] GET /compute/v2.1/servers/79de76d4-8a77-45a2-b29f-da2d04bc206a => generated 1219 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:06.214855 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-15194de3-1b62-4be5-b3dd-afc5dbaab2ee tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:06.214855 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-15194de3-1b62-4be5-b3dd-afc5dbaab2ee tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:06.221096 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-15194de3-1b62-4be5-b3dd-afc5dbaab2ee tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:06.221613 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-15194de3-1b62-4be5-b3dd-afc5dbaab2ee tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:06.222089 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-15194de3-1b62-4be5-b3dd-afc5dbaab2ee tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:06.228127 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-15194de3-1b62-4be5-b3dd-afc5dbaab2ee tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:06.228935 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-15194de3-1b62-4be5-b3dd-afc5dbaab2ee tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:06.229599 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-15194de3-1b62-4be5-b3dd-afc5dbaab2ee tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:06.585171 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-15194de3-1b62-4be5-b3dd-afc5dbaab2ee tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:06.595602 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-15194de3-1b62-4be5-b3dd-afc5dbaab2ee tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b" status: 200 len: 1513 microversion: 2.1 time: 0.389230 Sep 23 04:53:06.596320 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2496/4863] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:06 2022] GET /compute/v2.1/servers/c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b => generated 1513 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:06.779432 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-aa44003e-4650-45b5-bbab-793837385af6 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:06.781401 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-aa44003e-4650-45b5-bbab-793837385af6 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] [instance: 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:06.790999 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-aa44003e-4650-45b5-bbab-793837385af6 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:06.791908 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-aa44003e-4650-45b5-bbab-793837385af6 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:06.793421 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-aa44003e-4650-45b5-bbab-793837385af6 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:06.795357 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-aa44003e-4650-45b5-bbab-793837385af6 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:06.796850 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-aa44003e-4650-45b5-bbab-793837385af6 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:06.798054 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-aa44003e-4650-45b5-bbab-793837385af6 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:06.829950 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=100 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:53:06.879534 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a42aa4a2-bf8a-49c7-a9fe-691546ea2ee9 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:06.881126 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a42aa4a2-bf8a-49c7-a9fe-691546ea2ee9 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: f285e256-0a0e-4126-8adf-643bd59ca141] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:06.891189 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a42aa4a2-bf8a-49c7-a9fe-691546ea2ee9 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:06.893577 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a42aa4a2-bf8a-49c7-a9fe-691546ea2ee9 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:06.894991 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a42aa4a2-bf8a-49c7-a9fe-691546ea2ee9 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:06.896586 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a42aa4a2-bf8a-49c7-a9fe-691546ea2ee9 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:06.897296 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a42aa4a2-bf8a-49c7-a9fe-691546ea2ee9 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:06.897991 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a42aa4a2-bf8a-49c7-a9fe-691546ea2ee9 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:07.174945 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-aa44003e-4650-45b5-bbab-793837385af6 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:07.190912 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-aa44003e-4650-45b5-bbab-793837385af6 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:07.195911 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-aa44003e-4650-45b5-bbab-793837385af6 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:07.197704 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-aa44003e-4650-45b5-bbab-793837385af6 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] 10.222.0.33 "GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7" status: 200 len: 2827 microversion: 2.32 time: 0.427160 Sep 23 04:53:07.219401 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2368/4864] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:53:06 2022] GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 => generated 2827 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:53:07.234332 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b512967a-1ca3-450f-ae57-0ceed3a24953 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:07.235469 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b512967a-1ca3-450f-ae57-0ceed3a24953 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] [instance: 79de76d4-8a77-45a2-b29f-da2d04bc206a] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:07.242634 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b512967a-1ca3-450f-ae57-0ceed3a24953 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:07.243496 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b512967a-1ca3-450f-ae57-0ceed3a24953 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:07.244157 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b512967a-1ca3-450f-ae57-0ceed3a24953 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:07.245228 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b512967a-1ca3-450f-ae57-0ceed3a24953 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:07.246537 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b512967a-1ca3-450f-ae57-0ceed3a24953 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:07.247197 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b512967a-1ca3-450f-ae57-0ceed3a24953 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:07.302425 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a42aa4a2-bf8a-49c7-a9fe-691546ea2ee9 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:07.315912 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a42aa4a2-bf8a-49c7-a9fe-691546ea2ee9 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:07.319293 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a42aa4a2-bf8a-49c7-a9fe-691546ea2ee9 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:07.321043 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a42aa4a2-bf8a-49c7-a9fe-691546ea2ee9 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141" status: 200 len: 1731 microversion: 2.20 time: 0.446302 Sep 23 04:53:07.322203 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2497/4865] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:53:06 2022] GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141 => generated 1731 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:53:07.330241 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ee0ca713-223a-4841-af97-be09d64dbb51 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:07.331269 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ee0ca713-223a-4841-af97-be09d64dbb51 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] [instance: 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:07.354647 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ee0ca713-223a-4841-af97-be09d64dbb51 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:07.361368 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ee0ca713-223a-4841-af97-be09d64dbb51 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:07.361972 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ee0ca713-223a-4841-af97-be09d64dbb51 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:07.365561 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ee0ca713-223a-4841-af97-be09d64dbb51 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:07.371231 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ee0ca713-223a-4841-af97-be09d64dbb51 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:07.375285 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ee0ca713-223a-4841-af97-be09d64dbb51 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:07.618887 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b512967a-1ca3-450f-ae57-0ceed3a24953 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46eb7f913d7e49f58af088102c5a06a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af9b29a1d1f488faf6e4dfd19055728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:07.647821 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b512967a-1ca3-450f-ae57-0ceed3a24953 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] 10.222.0.33 "GET /compute/v2.1/servers/79de76d4-8a77-45a2-b29f-da2d04bc206a" status: 200 len: 1215 microversion: 2.1 time: 0.426609 Sep 23 04:53:07.648437 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2369/4866] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:07 2022] GET /compute/v2.1/servers/79de76d4-8a77-45a2-b29f-da2d04bc206a => generated 1215 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:07.720327 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-95ce185f-2b32-49a0-a92c-dc643b424bc9 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:07.724481 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-95ce185f-2b32-49a0-a92c-dc643b424bc9 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:07.745511 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-95ce185f-2b32-49a0-a92c-dc643b424bc9 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:07.750561 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-95ce185f-2b32-49a0-a92c-dc643b424bc9 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:07.752511 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-95ce185f-2b32-49a0-a92c-dc643b424bc9 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:07.754736 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-95ce185f-2b32-49a0-a92c-dc643b424bc9 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:07.758908 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-95ce185f-2b32-49a0-a92c-dc643b424bc9 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:07.761232 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-95ce185f-2b32-49a0-a92c-dc643b424bc9 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:08.091236 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ee0ca713-223a-4841-af97-be09d64dbb51 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] 10.222.0.33 "GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7/os-interface" status: 200 len: 1828 microversion: 2.32 time: 0.767671 Sep 23 04:53:08.091848 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2498/4867] 10.222.0.33 () {60 vars in 1316 bytes} [Fri Sep 23 04:53:07 2022] GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7/os-interface => generated 1828 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:53:08.350703 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c5be4851-23c4-4241-954f-fbd927d5f7a2 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:08.352357 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c5be4851-23c4-4241-954f-fbd927d5f7a2 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: f285e256-0a0e-4126-8adf-643bd59ca141] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:08.363262 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c5be4851-23c4-4241-954f-fbd927d5f7a2 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:08.364126 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c5be4851-23c4-4241-954f-fbd927d5f7a2 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:08.365598 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c5be4851-23c4-4241-954f-fbd927d5f7a2 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:08.379233 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c5be4851-23c4-4241-954f-fbd927d5f7a2 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:08.383430 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c5be4851-23c4-4241-954f-fbd927d5f7a2 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:08.387072 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c5be4851-23c4-4241-954f-fbd927d5f7a2 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:09.751044 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c5be4851-23c4-4241-954f-fbd927d5f7a2 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:09.772728 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c5be4851-23c4-4241-954f-fbd927d5f7a2 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:09.774220 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c5be4851-23c4-4241-954f-fbd927d5f7a2 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:09.775417 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c5be4851-23c4-4241-954f-fbd927d5f7a2 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141" status: 200 len: 1731 microversion: 2.20 time: 1.429453 Sep 23 04:53:09.776080 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2499/4868] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:53:08 2022] GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141 => generated 1731 bytes in 1431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:53:09.797820 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-57468576-82ce-4f2d-b62d-6add97a8819e tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:09.812066 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-57468576-82ce-4f2d-b62d-6add97a8819e tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] [instance: 79de76d4-8a77-45a2-b29f-da2d04bc206a] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:09.829973 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-57468576-82ce-4f2d-b62d-6add97a8819e tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:09.830729 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-57468576-82ce-4f2d-b62d-6add97a8819e tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:09.831254 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-57468576-82ce-4f2d-b62d-6add97a8819e tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:09.835261 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-57468576-82ce-4f2d-b62d-6add97a8819e tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:09.835757 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-57468576-82ce-4f2d-b62d-6add97a8819e tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:09.836208 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-57468576-82ce-4f2d-b62d-6add97a8819e tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:09.987103 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-95ce185f-2b32-49a0-a92c-dc643b424bc9 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:10.005265 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-95ce185f-2b32-49a0-a92c-dc643b424bc9 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b" status: 200 len: 1513 microversion: 2.1 time: 2.310042 Sep 23 04:53:10.006109 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2370/4869] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:07 2022] GET /compute/v2.1/servers/c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b => generated 1513 bytes in 2320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:10.025718 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2ae691e3-1527-4732-9244-1e82a72d6e06 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1649765856", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "networks": [{"uuid": "c3448973-36c3-457c-82cc-b37080e31343"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1044440630", "security_groups": [{"name": "tempest-secgroup-smoke-556436824"}]}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:53:10.143213 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-57468576-82ce-4f2d-b62d-6add97a8819e tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46eb7f913d7e49f58af088102c5a06a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af9b29a1d1f488faf6e4dfd19055728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:10.154786 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-57468576-82ce-4f2d-b62d-6add97a8819e tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] 10.222.0.33 "GET /compute/v2.1/servers/79de76d4-8a77-45a2-b29f-da2d04bc206a" status: 200 len: 1277 microversion: 2.1 time: 0.376570 Sep 23 04:53:10.156093 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2500/4870] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:09 2022] GET /compute/v2.1/servers/79de76d4-8a77-45a2-b29f-da2d04bc206a => generated 1277 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:10.390560 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.network.neutron [None req-2ae691e3-1527-4732-9244-1e82a72d6e06 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] validate_networks() for [('c3448973-36c3-457c-82cc-b37080e31343', None, None, None, None, None)] {{(pid=122698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:53:10.803149 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-54577d4e-e58b-4c3a-8480-d330ef65612f tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:10.803863 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-54577d4e-e58b-4c3a-8480-d330ef65612f tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: f285e256-0a0e-4126-8adf-643bd59ca141] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:10.817002 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-54577d4e-e58b-4c3a-8480-d330ef65612f tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:10.836906 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-54577d4e-e58b-4c3a-8480-d330ef65612f tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:10.836906 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-54577d4e-e58b-4c3a-8480-d330ef65612f tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:10.836906 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-54577d4e-e58b-4c3a-8480-d330ef65612f tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:10.836906 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-54577d4e-e58b-4c3a-8480-d330ef65612f tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:10.836906 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-54577d4e-e58b-4c3a-8480-d330ef65612f tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:11.578406 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-54577d4e-e58b-4c3a-8480-d330ef65612f tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:11.612095 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-54577d4e-e58b-4c3a-8480-d330ef65612f tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:11.613825 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-54577d4e-e58b-4c3a-8480-d330ef65612f tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:11.621626 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-54577d4e-e58b-4c3a-8480-d330ef65612f tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141" status: 200 len: 1731 microversion: 2.20 time: 0.822443 Sep 23 04:53:11.625625 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2501/4871] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:53:10 2022] GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141 => generated 1731 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:53:11.657284 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f865dfd5-1264-4cd0-968e-abdfc0a580cc tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:11.660531 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f865dfd5-1264-4cd0-968e-abdfc0a580cc tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:11.681000 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f865dfd5-1264-4cd0-968e-abdfc0a580cc tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:11.682646 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f865dfd5-1264-4cd0-968e-abdfc0a580cc tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:11.684130 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f865dfd5-1264-4cd0-968e-abdfc0a580cc tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:11.686027 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f865dfd5-1264-4cd0-968e-abdfc0a580cc tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:11.688346 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f865dfd5-1264-4cd0-968e-abdfc0a580cc tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:11.691624 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f865dfd5-1264-4cd0-968e-abdfc0a580cc tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:11.844559 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-2ae691e3-1527-4732-9244-1e82a72d6e06 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Flavor limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:53:11.845589 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-2ae691e3-1527-4732-9244-1e82a72d6e06 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Image limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:53:11.846303 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-2ae691e3-1527-4732-9244-1e82a72d6e06 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Flavor pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:53:11.846892 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-2ae691e3-1527-4732-9244-1e82a72d6e06 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Image pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:53:11.847491 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-2ae691e3-1527-4732-9244-1e82a72d6e06 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:53:11.876484 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2ae691e3-1527-4732-9244-1e82a72d6e06 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:11.884681 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2ae691e3-1527-4732-9244-1e82a72d6e06 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:11.885401 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2ae691e3-1527-4732-9244-1e82a72d6e06 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:11.887923 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2ae691e3-1527-4732-9244-1e82a72d6e06 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:11.887923 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2ae691e3-1527-4732-9244-1e82a72d6e06 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:11.887923 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2ae691e3-1527-4732-9244-1e82a72d6e06 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:11.961944 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-2ae691e3-1527-4732-9244-1e82a72d6e06 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Getting quotas for project 0edd6bd5b418494fbcb05c743967d36a. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:53:11.980074 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-2ae691e3-1527-4732-9244-1e82a72d6e06 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Getting quotas for user 8d3d0a162e7e4beb81a54120cab246ff and project 0edd6bd5b418494fbcb05c743967d36a. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:53:12.040172 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-2ae691e3-1527-4732-9244-1e82a72d6e06 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Going to run 1 instances... {{(pid=122698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:53:12.051527 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-2ae691e3-1527-4732-9244-1e82a72d6e06 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 4381aca2-ea30-4473-9cd3-18c9b64f1937] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:53:12.056712 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f865dfd5-1264-4cd0-968e-abdfc0a580cc tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:12.065229 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f865dfd5-1264-4cd0-968e-abdfc0a580cc tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b" status: 200 len: 1519 microversion: 2.1 time: 0.438484 Sep 23 04:53:12.072023 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2502/4872] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:11 2022] GET /compute/v2.1/servers/c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b => generated 1519 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:12.077714 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0851d36a-ee5a-4e37-b2bc-8272f7fb893a tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:12.094863 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-0851d36a-ee5a-4e37-b2bc-8272f7fb893a tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] [instance: 79de76d4-8a77-45a2-b29f-da2d04bc206a] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:12.101467 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0851d36a-ee5a-4e37-b2bc-8272f7fb893a tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:12.102245 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0851d36a-ee5a-4e37-b2bc-8272f7fb893a tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:12.102872 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0851d36a-ee5a-4e37-b2bc-8272f7fb893a tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:12.103779 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0851d36a-ee5a-4e37-b2bc-8272f7fb893a tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:12.104696 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0851d36a-ee5a-4e37-b2bc-8272f7fb893a tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:12.105926 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0851d36a-ee5a-4e37-b2bc-8272f7fb893a tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:12.246336 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-0851d36a-ee5a-4e37-b2bc-8272f7fb893a tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46eb7f913d7e49f58af088102c5a06a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af9b29a1d1f488faf6e4dfd19055728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:12.283849 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0851d36a-ee5a-4e37-b2bc-8272f7fb893a tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] 10.222.0.33 "GET /compute/v2.1/servers/79de76d4-8a77-45a2-b29f-da2d04bc206a" status: 200 len: 1277 microversion: 2.1 time: 0.197243 Sep 23 04:53:12.283849 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2503/4873] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:12 2022] GET /compute/v2.1/servers/79de76d4-8a77-45a2-b29f-da2d04bc206a => generated 1277 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:12.299142 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-939b2a0a-56da-4e29-8e26-569e0ab47e0e req-f9388b02-f92e-445c-a016-5b22e4db1fa5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b", "name": "network-vif-unplugged", "status": "completed", "tag": "2d1ed940-5eb5-4eff-9020-37f2f21a3613"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:53:12.391843 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-939b2a0a-56da-4e29-8e26-569e0ab47e0e req-f9388b02-f92e-445c-a016-5b22e4db1fa5 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:12.392364 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-939b2a0a-56da-4e29-8e26-569e0ab47e0e req-f9388b02-f92e-445c-a016-5b22e4db1fa5 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:12.392812 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-939b2a0a-56da-4e29-8e26-569e0ab47e0e req-f9388b02-f92e-445c-a016-5b22e4db1fa5 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:12.394754 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2ae691e3-1527-4732-9244-1e82a72d6e06 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.387396 Sep 23 04:53:12.398401 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2371/4874] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:53:10 2022] POST /compute/v2.1/servers => generated 405 bytes in 2389 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:53:12.439635 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a50a5f83-b71a-4e49-9a3b-300fd53a26f7 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:12.440279 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a50a5f83-b71a-4e49-9a3b-300fd53a26f7 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 4381aca2-ea30-4473-9cd3-18c9b64f1937] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:12.478516 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-939b2a0a-56da-4e29-8e26-569e0ab47e0e req-f9388b02-f92e-445c-a016-5b22e4db1fa5 service nova] Creating event network-vif-unplugged:2d1ed940-5eb5-4eff-9020-37f2f21a3613 for instance c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b on n-h1-846463-3 Sep 23 04:53:12.494109 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-939b2a0a-56da-4e29-8e26-569e0ab47e0e req-f9388b02-f92e-445c-a016-5b22e4db1fa5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.207572 Sep 23 04:53:12.502782 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2504/4875] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:53:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:53:12.655499 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-67ddaf0e-a7bb-4739-a58d-a8722b289f53 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:12.656488 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-67ddaf0e-a7bb-4739-a58d-a8722b289f53 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: f285e256-0a0e-4126-8adf-643bd59ca141] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:12.671112 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-67ddaf0e-a7bb-4739-a58d-a8722b289f53 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:12.675397 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a50a5f83-b71a-4e49-9a3b-300fd53a26f7 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:12.675576 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-67ddaf0e-a7bb-4739-a58d-a8722b289f53 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:12.675576 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-67ddaf0e-a7bb-4739-a58d-a8722b289f53 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:12.690963 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-67ddaf0e-a7bb-4739-a58d-a8722b289f53 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:12.693475 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a50a5f83-b71a-4e49-9a3b-300fd53a26f7 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937" status: 200 len: 1267 microversion: 2.1 time: 0.275210 Sep 23 04:53:12.699454 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-67ddaf0e-a7bb-4739-a58d-a8722b289f53 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:12.700800 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-67ddaf0e-a7bb-4739-a58d-a8722b289f53 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:12.726294 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2372/4876] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:12 2022] GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937 => generated 1267 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:13.093726 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0579a554-cece-4005-85c8-80362e341413 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:13.095038 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-0579a554-cece-4005-85c8-80362e341413 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:13.110821 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0579a554-cece-4005-85c8-80362e341413 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:13.116088 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0579a554-cece-4005-85c8-80362e341413 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:13.116633 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0579a554-cece-4005-85c8-80362e341413 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:13.119485 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0579a554-cece-4005-85c8-80362e341413 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:13.120002 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0579a554-cece-4005-85c8-80362e341413 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:13.120538 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0579a554-cece-4005-85c8-80362e341413 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:13.132341 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-67ddaf0e-a7bb-4739-a58d-a8722b289f53 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:13.149809 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-67ddaf0e-a7bb-4739-a58d-a8722b289f53 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:13.160029 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-67ddaf0e-a7bb-4739-a58d-a8722b289f53 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:13.162749 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-67ddaf0e-a7bb-4739-a58d-a8722b289f53 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141" status: 200 len: 1731 microversion: 2.20 time: 0.514342 Sep 23 04:53:13.168256 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2505/4877] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:53:12 2022] GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141 => generated 1731 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:53:13.320323 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8d6fa2cc-9064-4b3c-8109-899c6acb0166 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:13.324360 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-8d6fa2cc-9064-4b3c-8109-899c6acb0166 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] [instance: 79de76d4-8a77-45a2-b29f-da2d04bc206a] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:13.335912 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8d6fa2cc-9064-4b3c-8109-899c6acb0166 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:13.338034 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8d6fa2cc-9064-4b3c-8109-899c6acb0166 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:13.338731 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8d6fa2cc-9064-4b3c-8109-899c6acb0166 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:13.339895 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8d6fa2cc-9064-4b3c-8109-899c6acb0166 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:13.340545 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8d6fa2cc-9064-4b3c-8109-899c6acb0166 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:13.341257 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8d6fa2cc-9064-4b3c-8109-899c6acb0166 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:13.519462 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-0579a554-cece-4005-85c8-80362e341413 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:13.529082 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0579a554-cece-4005-85c8-80362e341413 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b" status: 200 len: 1519 microversion: 2.1 time: 0.440205 Sep 23 04:53:13.538628 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2373/4878] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:13 2022] GET /compute/v2.1/servers/c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b => generated 1519 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:13.558873 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-8d6fa2cc-9064-4b3c-8109-899c6acb0166 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46eb7f913d7e49f58af088102c5a06a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af9b29a1d1f488faf6e4dfd19055728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:13.603766 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-8d6fa2cc-9064-4b3c-8109-899c6acb0166 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] 10.222.0.33 "GET /compute/v2.1/servers/79de76d4-8a77-45a2-b29f-da2d04bc206a" status: 200 len: 1277 microversion: 2.1 time: 0.297599 Sep 23 04:53:13.605933 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2506/4879] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:13 2022] GET /compute/v2.1/servers/79de76d4-8a77-45a2-b29f-da2d04bc206a => generated 1277 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:13.732594 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e9ecea41-972a-411e-a828-753e0b4c7166 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:13.733598 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e9ecea41-972a-411e-a828-753e0b4c7166 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 4381aca2-ea30-4473-9cd3-18c9b64f1937] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:13.862570 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e9ecea41-972a-411e-a828-753e0b4c7166 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:13.871404 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e9ecea41-972a-411e-a828-753e0b4c7166 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937" status: 200 len: 1267 microversion: 2.1 time: 0.143752 Sep 23 04:53:13.886631 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2374/4880] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:13 2022] GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937 => generated 1267 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:14.198510 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-09596b68-94d7-484c-8328-943944ab99e3 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:14.200756 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-09596b68-94d7-484c-8328-943944ab99e3 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: f285e256-0a0e-4126-8adf-643bd59ca141] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:14.218016 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:53:14.219420 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=6 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:53:14.222421 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-09596b68-94d7-484c-8328-943944ab99e3 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:14.223216 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-09596b68-94d7-484c-8328-943944ab99e3 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:14.223837 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-09596b68-94d7-484c-8328-943944ab99e3 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:14.225268 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-09596b68-94d7-484c-8328-943944ab99e3 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:14.226975 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-09596b68-94d7-484c-8328-943944ab99e3 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:14.238254 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-09596b68-94d7-484c-8328-943944ab99e3 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:14.562756 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-17372bd1-b69f-408c-a40a-15fe7875c71a tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:14.564037 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-17372bd1-b69f-408c-a40a-15fe7875c71a tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:14.576313 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-17372bd1-b69f-408c-a40a-15fe7875c71a tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:14.578608 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-17372bd1-b69f-408c-a40a-15fe7875c71a tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:14.579273 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-17372bd1-b69f-408c-a40a-15fe7875c71a tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:14.582305 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-17372bd1-b69f-408c-a40a-15fe7875c71a tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:14.583134 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-17372bd1-b69f-408c-a40a-15fe7875c71a tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:14.583951 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-17372bd1-b69f-408c-a40a-15fe7875c71a tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:14.599676 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-09596b68-94d7-484c-8328-943944ab99e3 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:14.619422 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-09596b68-94d7-484c-8328-943944ab99e3 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:14.623970 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-09596b68-94d7-484c-8328-943944ab99e3 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:14.629010 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-09596b68-94d7-484c-8328-943944ab99e3 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141" status: 200 len: 1731 microversion: 2.20 time: 0.435747 Sep 23 04:53:14.636592 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2507/4881] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:53:14 2022] GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141 => generated 1731 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:53:14.644829 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f63deec2-f01a-4191-bc91-f5f7481debed tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:14.645798 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f63deec2-f01a-4191-bc91-f5f7481debed tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] [instance: 79de76d4-8a77-45a2-b29f-da2d04bc206a] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:14.679026 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f63deec2-f01a-4191-bc91-f5f7481debed tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:14.682237 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f63deec2-f01a-4191-bc91-f5f7481debed tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:14.683000 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f63deec2-f01a-4191-bc91-f5f7481debed tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:14.685524 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f63deec2-f01a-4191-bc91-f5f7481debed tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:14.688061 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f63deec2-f01a-4191-bc91-f5f7481debed tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:14.690914 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f63deec2-f01a-4191-bc91-f5f7481debed tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:14.971181 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-17372bd1-b69f-408c-a40a-15fe7875c71a tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:14.985417 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-17372bd1-b69f-408c-a40a-15fe7875c71a tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b" status: 200 len: 1519 microversion: 2.1 time: 0.422693 Sep 23 04:53:14.988247 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2375/4882] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:14 2022] GET /compute/v2.1/servers/c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b => generated 1519 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:14.997380 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-fa4f4d19-ebc4-4bd2-b98f-7d4ea32895c9 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:14.999487 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-fa4f4d19-ebc4-4bd2-b98f-7d4ea32895c9 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 4381aca2-ea30-4473-9cd3-18c9b64f1937] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:15.019275 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fa4f4d19-ebc4-4bd2-b98f-7d4ea32895c9 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:15.020349 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fa4f4d19-ebc4-4bd2-b98f-7d4ea32895c9 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:15.021853 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fa4f4d19-ebc4-4bd2-b98f-7d4ea32895c9 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:15.022898 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fa4f4d19-ebc4-4bd2-b98f-7d4ea32895c9 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:15.024313 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fa4f4d19-ebc4-4bd2-b98f-7d4ea32895c9 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:15.024963 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fa4f4d19-ebc4-4bd2-b98f-7d4ea32895c9 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:15.186701 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-fa4f4d19-ebc4-4bd2-b98f-7d4ea32895c9 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:15.201016 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-fa4f4d19-ebc4-4bd2-b98f-7d4ea32895c9 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937" status: 200 len: 1263 microversion: 2.1 time: 0.211445 Sep 23 04:53:15.205703 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2376/4883] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:14 2022] GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937 => generated 1263 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:15.233383 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-0ed6b61e-41ab-4617-88dc-2e84a9833389 req-5beda9a3-820a-4f7e-b3a2-083ba0fd5beb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49112e3f-73fc-4ee9-b48e-bcda5b7dcda7", "tag": "7526a24d-5fba-4653-bde4-13d72cf5232a"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:53:15.275805 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f63deec2-f01a-4191-bc91-f5f7481debed tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46eb7f913d7e49f58af088102c5a06a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af9b29a1d1f488faf6e4dfd19055728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:15.282743 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-0ed6b61e-41ab-4617-88dc-2e84a9833389 req-5beda9a3-820a-4f7e-b3a2-083ba0fd5beb service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:15.283442 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-0ed6b61e-41ab-4617-88dc-2e84a9833389 req-5beda9a3-820a-4f7e-b3a2-083ba0fd5beb service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:15.284441 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-0ed6b61e-41ab-4617-88dc-2e84a9833389 req-5beda9a3-820a-4f7e-b3a2-083ba0fd5beb service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:15.299947 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f63deec2-f01a-4191-bc91-f5f7481debed tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] 10.222.0.33 "GET /compute/v2.1/servers/79de76d4-8a77-45a2-b29f-da2d04bc206a" status: 200 len: 1319 microversion: 2.1 time: 0.661898 Sep 23 04:53:15.302910 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2508/4884] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:14 2022] GET /compute/v2.1/servers/79de76d4-8a77-45a2-b29f-da2d04bc206a => generated 1319 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:15.307514 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-0ed6b61e-41ab-4617-88dc-2e84a9833389 req-5beda9a3-820a-4f7e-b3a2-083ba0fd5beb service nova] Creating event network-changed:7526a24d-5fba-4653-bde4-13d72cf5232a for instance 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 on n-h2-846463-3 Sep 23 04:53:15.330799 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-0ed6b61e-41ab-4617-88dc-2e84a9833389 req-5beda9a3-820a-4f7e-b3a2-083ba0fd5beb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103543 Sep 23 04:53:15.331747 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2377/4885] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:53:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:53:15.661189 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8ee36c76-9455-4e75-bffc-24490b84fc6f tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:15.662151 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-8ee36c76-9455-4e75-bffc-24490b84fc6f tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: f285e256-0a0e-4126-8adf-643bd59ca141] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:15.676784 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8ee36c76-9455-4e75-bffc-24490b84fc6f tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:15.682263 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8ee36c76-9455-4e75-bffc-24490b84fc6f tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:15.689045 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8ee36c76-9455-4e75-bffc-24490b84fc6f tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:15.689951 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8ee36c76-9455-4e75-bffc-24490b84fc6f tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:15.695778 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8ee36c76-9455-4e75-bffc-24490b84fc6f tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:15.696530 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8ee36c76-9455-4e75-bffc-24490b84fc6f tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:16.021078 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e2924779-6401-4b28-ad3d-2d1be0f6d204 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:16.022662 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e2924779-6401-4b28-ad3d-2d1be0f6d204 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:16.049954 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-8ee36c76-9455-4e75-bffc-24490b84fc6f tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:16.050418 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e2924779-6401-4b28-ad3d-2d1be0f6d204 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:16.051721 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e2924779-6401-4b28-ad3d-2d1be0f6d204 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:16.052929 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e2924779-6401-4b28-ad3d-2d1be0f6d204 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:16.053995 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e2924779-6401-4b28-ad3d-2d1be0f6d204 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:16.055618 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e2924779-6401-4b28-ad3d-2d1be0f6d204 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:16.056309 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e2924779-6401-4b28-ad3d-2d1be0f6d204 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:16.070920 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-8ee36c76-9455-4e75-bffc-24490b84fc6f tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:16.085946 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-8ee36c76-9455-4e75-bffc-24490b84fc6f tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:16.118770 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-8ee36c76-9455-4e75-bffc-24490b84fc6f tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141" status: 200 len: 1731 microversion: 2.20 time: 0.454381 Sep 23 04:53:16.147331 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2509/4886] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:53:15 2022] GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141 => generated 1731 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:53:16.233532 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4bc3c33f-e44e-4d58-9c09-9a2d1379f559 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:16.234300 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4bc3c33f-e44e-4d58-9c09-9a2d1379f559 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 4381aca2-ea30-4473-9cd3-18c9b64f1937] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:16.257038 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4bc3c33f-e44e-4d58-9c09-9a2d1379f559 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:16.257664 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4bc3c33f-e44e-4d58-9c09-9a2d1379f559 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:16.258410 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4bc3c33f-e44e-4d58-9c09-9a2d1379f559 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:16.259568 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4bc3c33f-e44e-4d58-9c09-9a2d1379f559 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:16.260134 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4bc3c33f-e44e-4d58-9c09-9a2d1379f559 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:16.260733 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4bc3c33f-e44e-4d58-9c09-9a2d1379f559 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:16.372787 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e2924779-6401-4b28-ad3d-2d1be0f6d204 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:16.384978 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e2924779-6401-4b28-ad3d-2d1be0f6d204 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b" status: 200 len: 1519 microversion: 2.1 time: 0.372183 Sep 23 04:53:16.396341 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2378/4887] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:16 2022] GET /compute/v2.1/servers/c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b => generated 1519 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:16.409636 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0e7179f7-1ccc-4422-a54f-1a4645200a48 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:16.414053 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-0e7179f7-1ccc-4422-a54f-1a4645200a48 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] [instance: 79de76d4-8a77-45a2-b29f-da2d04bc206a] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:16.434718 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0e7179f7-1ccc-4422-a54f-1a4645200a48 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:16.435650 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0e7179f7-1ccc-4422-a54f-1a4645200a48 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:16.438141 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0e7179f7-1ccc-4422-a54f-1a4645200a48 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:16.439249 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0e7179f7-1ccc-4422-a54f-1a4645200a48 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:16.441093 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0e7179f7-1ccc-4422-a54f-1a4645200a48 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:16.444030 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-4bc3c33f-e44e-4d58-9c09-9a2d1379f559 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:16.445182 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0e7179f7-1ccc-4422-a54f-1a4645200a48 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:16.459942 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4bc3c33f-e44e-4d58-9c09-9a2d1379f559 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937" status: 200 len: 1319 microversion: 2.1 time: 0.233305 Sep 23 04:53:16.460556 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2510/4888] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:16 2022] GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937 => generated 1319 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:16.466274 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-b31ba0ad-0375-4301-abe1-0601d86bafce req-d67c205d-4a5d-43e9-b07e-e50068fff80c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b", "name": "network-vif-plugged", "status": "completed", "tag": "2d1ed940-5eb5-4eff-9020-37f2f21a3613"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:53:16.489913 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-b31ba0ad-0375-4301-abe1-0601d86bafce req-d67c205d-4a5d-43e9-b07e-e50068fff80c service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:16.498058 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-b31ba0ad-0375-4301-abe1-0601d86bafce req-d67c205d-4a5d-43e9-b07e-e50068fff80c service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:16.498058 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-b31ba0ad-0375-4301-abe1-0601d86bafce req-d67c205d-4a5d-43e9-b07e-e50068fff80c service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:16.508134 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-b31ba0ad-0375-4301-abe1-0601d86bafce req-d67c205d-4a5d-43e9-b07e-e50068fff80c service nova] Creating event network-vif-plugged:2d1ed940-5eb5-4eff-9020-37f2f21a3613 for instance c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b on n-h1-846463-3 Sep 23 04:53:16.518336 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-b31ba0ad-0375-4301-abe1-0601d86bafce req-d67c205d-4a5d-43e9-b07e-e50068fff80c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056206 Sep 23 04:53:16.525822 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2511/4889] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:53:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:53:16.534731 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-91f77893-93b9-4c21-9a16-7289c1acff21 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:16.535454 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-91f77893-93b9-4c21-9a16-7289c1acff21 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:16.581716 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-91f77893-93b9-4c21-9a16-7289c1acff21 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:16.581716 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-91f77893-93b9-4c21-9a16-7289c1acff21 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:16.581716 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-91f77893-93b9-4c21-9a16-7289c1acff21 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:16.581716 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-91f77893-93b9-4c21-9a16-7289c1acff21 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:16.581716 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-91f77893-93b9-4c21-9a16-7289c1acff21 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:16.581716 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-91f77893-93b9-4c21-9a16-7289c1acff21 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:16.617569 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=100 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:53:16.648728 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-0e7179f7-1ccc-4422-a54f-1a4645200a48 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46eb7f913d7e49f58af088102c5a06a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af9b29a1d1f488faf6e4dfd19055728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:16.658365 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0e7179f7-1ccc-4422-a54f-1a4645200a48 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] 10.222.0.33 "GET /compute/v2.1/servers/79de76d4-8a77-45a2-b29f-da2d04bc206a" status: 200 len: 1319 microversion: 2.1 time: 0.259923 Sep 23 04:53:16.660737 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2379/4890] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:16 2022] GET /compute/v2.1/servers/79de76d4-8a77-45a2-b29f-da2d04bc206a => generated 1319 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:16.931257 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-91f77893-93b9-4c21-9a16-7289c1acff21 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:16.946991 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-91f77893-93b9-4c21-9a16-7289c1acff21 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1670 microversion: 2.1 time: 0.419443 Sep 23 04:53:16.947893 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2512/4891] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:16 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1670 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:16.980381 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-bf1ab226-b1c0-4b87-ab38-d1db57a61ad6 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:16.981111 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-bf1ab226-b1c0-4b87-ab38-d1db57a61ad6 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:16.998894 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bf1ab226-b1c0-4b87-ab38-d1db57a61ad6 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:17.001723 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bf1ab226-b1c0-4b87-ab38-d1db57a61ad6 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:17.002454 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bf1ab226-b1c0-4b87-ab38-d1db57a61ad6 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:17.003198 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bf1ab226-b1c0-4b87-ab38-d1db57a61ad6 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:17.003668 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bf1ab226-b1c0-4b87-ab38-d1db57a61ad6 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:17.004101 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bf1ab226-b1c0-4b87-ab38-d1db57a61ad6 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:17.152639 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d1493c53-1912-4ec4-a922-04bdf5f16759 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:17.153263 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d1493c53-1912-4ec4-a922-04bdf5f16759 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: f285e256-0a0e-4126-8adf-643bd59ca141] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:17.159868 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d1493c53-1912-4ec4-a922-04bdf5f16759 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:17.161596 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d1493c53-1912-4ec4-a922-04bdf5f16759 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:17.162027 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d1493c53-1912-4ec4-a922-04bdf5f16759 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:17.162758 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d1493c53-1912-4ec4-a922-04bdf5f16759 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:17.163662 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d1493c53-1912-4ec4-a922-04bdf5f16759 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:17.163662 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d1493c53-1912-4ec4-a922-04bdf5f16759 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:17.255113 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-bf1ab226-b1c0-4b87-ab38-d1db57a61ad6 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:17.268058 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-bf1ab226-b1c0-4b87-ab38-d1db57a61ad6 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1670 microversion: 2.1 time: 0.295160 Sep 23 04:53:17.268058 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2380/4892] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:16 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1670 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:17.289323 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-77371f2f-2a31-4c70-91b0-259688d76033 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:17.289979 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-77371f2f-2a31-4c70-91b0-259688d76033 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:17.296857 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-77371f2f-2a31-4c70-91b0-259688d76033 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:17.297608 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-77371f2f-2a31-4c70-91b0-259688d76033 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:17.298318 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-77371f2f-2a31-4c70-91b0-259688d76033 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:17.299205 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-77371f2f-2a31-4c70-91b0-259688d76033 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:17.299834 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-77371f2f-2a31-4c70-91b0-259688d76033 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:17.300515 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-77371f2f-2a31-4c70-91b0-259688d76033 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:17.548203 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d1493c53-1912-4ec4-a922-04bdf5f16759 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:17.554607 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d1493c53-1912-4ec4-a922-04bdf5f16759 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:17.557542 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d1493c53-1912-4ec4-a922-04bdf5f16759 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:17.559111 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d1493c53-1912-4ec4-a922-04bdf5f16759 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141" status: 200 len: 1731 microversion: 2.20 time: 0.411099 Sep 23 04:53:17.560239 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2513/4893] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:53:17 2022] GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141 => generated 1731 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:53:17.566038 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-94d1a6d5-462d-459a-911f-1ae2a70f32f1 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:17.570382 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-94d1a6d5-462d-459a-911f-1ae2a70f32f1 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:17.574269 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-94d1a6d5-462d-459a-911f-1ae2a70f32f1 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:17.575002 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-94d1a6d5-462d-459a-911f-1ae2a70f32f1 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:17.575671 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-94d1a6d5-462d-459a-911f-1ae2a70f32f1 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:17.576763 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-94d1a6d5-462d-459a-911f-1ae2a70f32f1 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:17.577437 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-94d1a6d5-462d-459a-911f-1ae2a70f32f1 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:17.578179 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-94d1a6d5-462d-459a-911f-1ae2a70f32f1 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:17.583973 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-77371f2f-2a31-4c70-91b0-259688d76033 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:17.599354 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-77371f2f-2a31-4c70-91b0-259688d76033 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1670 microversion: 2.1 time: 0.313918 Sep 23 04:53:17.624236 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2381/4894] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:17 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1670 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:53:17.632812 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-dc2b3261-ff90-4e2a-adab-8128199edaea tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:17.633841 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-dc2b3261-ff90-4e2a-adab-8128199edaea tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 4381aca2-ea30-4473-9cd3-18c9b64f1937] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:17.643889 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dc2b3261-ff90-4e2a-adab-8128199edaea tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:17.645114 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dc2b3261-ff90-4e2a-adab-8128199edaea tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:17.645798 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dc2b3261-ff90-4e2a-adab-8128199edaea tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:17.646862 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dc2b3261-ff90-4e2a-adab-8128199edaea tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:17.647489 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dc2b3261-ff90-4e2a-adab-8128199edaea tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:17.653193 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dc2b3261-ff90-4e2a-adab-8128199edaea tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:17.831574 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-dc2b3261-ff90-4e2a-adab-8128199edaea tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:17.844740 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-dc2b3261-ff90-4e2a-adab-8128199edaea tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937" status: 200 len: 1327 microversion: 2.1 time: 0.218948 Sep 23 04:53:17.846069 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2382/4895] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:17 2022] GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937 => generated 1327 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:17.862191 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f3fb28a5-797a-4ead-a7e0-d4825dfd59cf tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:17.863595 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f3fb28a5-797a-4ead-a7e0-d4825dfd59cf tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:17.877213 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f3fb28a5-797a-4ead-a7e0-d4825dfd59cf tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:17.878754 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f3fb28a5-797a-4ead-a7e0-d4825dfd59cf tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:17.879755 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f3fb28a5-797a-4ead-a7e0-d4825dfd59cf tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:17.881613 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f3fb28a5-797a-4ead-a7e0-d4825dfd59cf tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:17.882545 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f3fb28a5-797a-4ead-a7e0-d4825dfd59cf tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:17.883384 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f3fb28a5-797a-4ead-a7e0-d4825dfd59cf tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:17.985206 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-94d1a6d5-462d-459a-911f-1ae2a70f32f1 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:17.994966 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-94d1a6d5-462d-459a-911f-1ae2a70f32f1 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b" status: 200 len: 1519 microversion: 2.1 time: 0.433355 Sep 23 04:53:18.008013 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2514/4896] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:17 2022] GET /compute/v2.1/servers/c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b => generated 1519 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:18.016085 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-40bc8200-b1b6-4446-bb72-a07b275efdb4 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:18.016712 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-40bc8200-b1b6-4446-bb72-a07b275efdb4 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] [instance: 79de76d4-8a77-45a2-b29f-da2d04bc206a] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:18.031658 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-40bc8200-b1b6-4446-bb72-a07b275efdb4 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:18.032556 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-40bc8200-b1b6-4446-bb72-a07b275efdb4 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:18.034209 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-40bc8200-b1b6-4446-bb72-a07b275efdb4 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:18.034209 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-40bc8200-b1b6-4446-bb72-a07b275efdb4 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:18.034514 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-40bc8200-b1b6-4446-bb72-a07b275efdb4 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:18.034946 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-40bc8200-b1b6-4446-bb72-a07b275efdb4 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:18.226433 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f3fb28a5-797a-4ead-a7e0-d4825dfd59cf tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:18.237239 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f3fb28a5-797a-4ead-a7e0-d4825dfd59cf tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1670 microversion: 2.1 time: 0.389713 Sep 23 04:53:18.238662 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2383/4897] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:17 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1670 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:18.262852 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-40bc8200-b1b6-4446-bb72-a07b275efdb4 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46eb7f913d7e49f58af088102c5a06a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af9b29a1d1f488faf6e4dfd19055728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:18.279211 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-40bc8200-b1b6-4446-bb72-a07b275efdb4 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] 10.222.0.33 "GET /compute/v2.1/servers/79de76d4-8a77-45a2-b29f-da2d04bc206a" status: 200 len: 1319 microversion: 2.1 time: 0.266959 Sep 23 04:53:18.279918 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2515/4898] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:18 2022] GET /compute/v2.1/servers/79de76d4-8a77-45a2-b29f-da2d04bc206a => generated 1319 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:18.447862 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f37705e6-387b-4c58-b583-e12a8d3aadf7 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1895859823", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "networks": [{"uuid": "c808d35d-7b6c-439e-908b-4f409fd90fd4"}]}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:53:18.508440 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.network.neutron [None req-f37705e6-387b-4c58-b583-e12a8d3aadf7 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] validate_networks() for [('c808d35d-7b6c-439e-908b-4f409fd90fd4', None, None, None, None, None)] {{(pid=122698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:53:18.592318 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b41a957d-207c-4706-b766-bcb1e8a57d80 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:18.593758 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b41a957d-207c-4706-b766-bcb1e8a57d80 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: f285e256-0a0e-4126-8adf-643bd59ca141] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:18.601707 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b41a957d-207c-4706-b766-bcb1e8a57d80 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:18.602365 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b41a957d-207c-4706-b766-bcb1e8a57d80 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:18.603759 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b41a957d-207c-4706-b766-bcb1e8a57d80 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:18.605432 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b41a957d-207c-4706-b766-bcb1e8a57d80 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:18.615228 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b41a957d-207c-4706-b766-bcb1e8a57d80 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:18.616148 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b41a957d-207c-4706-b766-bcb1e8a57d80 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:19.038293 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b41a957d-207c-4706-b766-bcb1e8a57d80 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:19.049817 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b41a957d-207c-4706-b766-bcb1e8a57d80 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:19.051985 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b41a957d-207c-4706-b766-bcb1e8a57d80 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:19.053501 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b41a957d-207c-4706-b766-bcb1e8a57d80 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141" status: 200 len: 1731 microversion: 2.20 time: 0.468222 Sep 23 04:53:19.056539 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2516/4899] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:53:18 2022] GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141 => generated 1731 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:53:19.063856 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-524be609-f4df-4388-b3e2-aa0e4002d66b req-2e79bbe3-e888-4238-9f70-0e558f00e0a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79de76d4-8a77-45a2-b29f-da2d04bc206a", "tag": "6f074d0d-63d3-4a67-a5b5-418ee53e6c1d"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:53:19.079244 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-524be609-f4df-4388-b3e2-aa0e4002d66b req-2e79bbe3-e888-4238-9f70-0e558f00e0a5 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:19.080274 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-524be609-f4df-4388-b3e2-aa0e4002d66b req-2e79bbe3-e888-4238-9f70-0e558f00e0a5 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:19.080944 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-524be609-f4df-4388-b3e2-aa0e4002d66b req-2e79bbe3-e888-4238-9f70-0e558f00e0a5 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:19.097538 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-524be609-f4df-4388-b3e2-aa0e4002d66b req-2e79bbe3-e888-4238-9f70-0e558f00e0a5 service nova] Creating event network-changed:6f074d0d-63d3-4a67-a5b5-418ee53e6c1d for instance 79de76d4-8a77-45a2-b29f-da2d04bc206a on n-h2-846463-3 Sep 23 04:53:19.106126 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-524be609-f4df-4388-b3e2-aa0e4002d66b req-2e79bbe3-e888-4238-9f70-0e558f00e0a5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047431 Sep 23 04:53:19.107250 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2517/4900] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:53:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:53:19.117211 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f8dbf593-562f-402b-8c53-d901c72de0f7 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:19.118545 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f8dbf593-562f-402b-8c53-d901c72de0f7 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 4381aca2-ea30-4473-9cd3-18c9b64f1937] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:19.129413 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f8dbf593-562f-402b-8c53-d901c72de0f7 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:19.130213 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f8dbf593-562f-402b-8c53-d901c72de0f7 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:19.142070 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f8dbf593-562f-402b-8c53-d901c72de0f7 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:19.142070 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f8dbf593-562f-402b-8c53-d901c72de0f7 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:19.142070 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f8dbf593-562f-402b-8c53-d901c72de0f7 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:19.142070 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f8dbf593-562f-402b-8c53-d901c72de0f7 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:19.333163 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f8dbf593-562f-402b-8c53-d901c72de0f7 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:19.344664 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f8dbf593-562f-402b-8c53-d901c72de0f7 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937" status: 200 len: 1325 microversion: 2.1 time: 0.235814 Sep 23 04:53:19.346265 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2518/4901] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:19 2022] GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937 => generated 1325 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:19.352093 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-337aa398-60ee-4311-94aa-870aab5b9758 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:19.361463 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-337aa398-60ee-4311-94aa-870aab5b9758 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:19.364588 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-337aa398-60ee-4311-94aa-870aab5b9758 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:19.365158 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-337aa398-60ee-4311-94aa-870aab5b9758 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:19.365788 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-337aa398-60ee-4311-94aa-870aab5b9758 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:19.366731 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-337aa398-60ee-4311-94aa-870aab5b9758 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:19.367346 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-337aa398-60ee-4311-94aa-870aab5b9758 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:19.367786 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-337aa398-60ee-4311-94aa-870aab5b9758 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:19.416327 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-f37705e6-387b-4c58-b583-e12a8d3aadf7 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Flavor limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:53:19.417123 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-f37705e6-387b-4c58-b583-e12a8d3aadf7 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Image limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:53:19.417779 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-f37705e6-387b-4c58-b583-e12a8d3aadf7 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Flavor pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:53:19.418621 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-f37705e6-387b-4c58-b583-e12a8d3aadf7 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Image pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:53:19.419123 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-f37705e6-387b-4c58-b583-e12a8d3aadf7 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:53:19.434262 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f37705e6-387b-4c58-b583-e12a8d3aadf7 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:19.434918 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f37705e6-387b-4c58-b583-e12a8d3aadf7 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:19.436708 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f37705e6-387b-4c58-b583-e12a8d3aadf7 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:19.437814 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f37705e6-387b-4c58-b583-e12a8d3aadf7 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:19.438909 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f37705e6-387b-4c58-b583-e12a8d3aadf7 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:19.439817 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f37705e6-387b-4c58-b583-e12a8d3aadf7 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:19.473530 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-f37705e6-387b-4c58-b583-e12a8d3aadf7 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Getting quotas for project 2a45d69316a648fcb9c56190aaec5376. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:53:19.484169 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-f37705e6-387b-4c58-b583-e12a8d3aadf7 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Getting quotas for user f5e3a6e455e8483b8ce93ad380793335 and project 2a45d69316a648fcb9c56190aaec5376. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:53:19.500109 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f37705e6-387b-4c58-b583-e12a8d3aadf7 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Going to run 1 instances... {{(pid=122698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:53:19.502951 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f37705e6-387b-4c58-b583-e12a8d3aadf7 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 9dc683ca-0f6d-42d9-bf36-5bb1a5cc3286] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:53:19.582374 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-337aa398-60ee-4311-94aa-870aab5b9758 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:19.591248 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-337aa398-60ee-4311-94aa-870aab5b9758 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b" status: 200 len: 1504 microversion: 2.1 time: 0.242744 Sep 23 04:53:19.591927 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2519/4902] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:19 2022] GET /compute/v2.1/servers/c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b => generated 1504 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:19.596623 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2c0872c9-4a04-4b2a-bec6-f58bd15ea854 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:19.597965 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-2c0872c9-4a04-4b2a-bec6-f58bd15ea854 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] [instance: 79de76d4-8a77-45a2-b29f-da2d04bc206a] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:19.608644 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2c0872c9-4a04-4b2a-bec6-f58bd15ea854 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:19.608644 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2c0872c9-4a04-4b2a-bec6-f58bd15ea854 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:19.608644 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2c0872c9-4a04-4b2a-bec6-f58bd15ea854 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:19.608644 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2c0872c9-4a04-4b2a-bec6-f58bd15ea854 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:19.608644 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2c0872c9-4a04-4b2a-bec6-f58bd15ea854 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:19.608644 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2c0872c9-4a04-4b2a-bec6-f58bd15ea854 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:19.679257 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f37705e6-387b-4c58-b583-e12a8d3aadf7 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.235878 Sep 23 04:53:19.687480 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2384/4903] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:53:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1245 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:53:19.693602 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a0628a81-e655-4d89-908c-141cac4908c0 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:19.694480 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a0628a81-e655-4d89-908c-141cac4908c0 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:19.703721 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a0628a81-e655-4d89-908c-141cac4908c0 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:19.706180 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a0628a81-e655-4d89-908c-141cac4908c0 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:19.706880 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a0628a81-e655-4d89-908c-141cac4908c0 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:19.707863 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a0628a81-e655-4d89-908c-141cac4908c0 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:19.708524 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a0628a81-e655-4d89-908c-141cac4908c0 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:19.709559 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a0628a81-e655-4d89-908c-141cac4908c0 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:20.030242 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a0628a81-e655-4d89-908c-141cac4908c0 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:20.034440 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2c0872c9-4a04-4b2a-bec6-f58bd15ea854 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46eb7f913d7e49f58af088102c5a06a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af9b29a1d1f488faf6e4dfd19055728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:20.044341 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2c0872c9-4a04-4b2a-bec6-f58bd15ea854 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] 10.222.0.33 "GET /compute/v2.1/servers/79de76d4-8a77-45a2-b29f-da2d04bc206a" status: 200 len: 1319 microversion: 2.1 time: 0.451124 Sep 23 04:53:20.050323 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2520/4904] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:19 2022] GET /compute/v2.1/servers/79de76d4-8a77-45a2-b29f-da2d04bc206a => generated 1319 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:20.051002 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a0628a81-e655-4d89-908c-141cac4908c0 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b" status: 200 len: 1504 microversion: 2.1 time: 0.357748 Sep 23 04:53:20.069929 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a9b10003-5093-4c3f-9948-4cfcc9a3e02c tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:20.070372 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2385/4905] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:19 2022] GET /compute/v2.1/servers/c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b => generated 1504 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:20.070492 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a9b10003-5093-4c3f-9948-4cfcc9a3e02c tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 9dc683ca-0f6d-42d9-bf36-5bb1a5cc3286] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:20.079432 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3ae7cd7a-03c5-456e-b932-10f9e03b588b tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:20.080615 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3ae7cd7a-03c5-456e-b932-10f9e03b588b tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:20.087223 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3ae7cd7a-03c5-456e-b932-10f9e03b588b tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:20.087785 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3ae7cd7a-03c5-456e-b932-10f9e03b588b tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:20.088240 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3ae7cd7a-03c5-456e-b932-10f9e03b588b tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:20.089021 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3ae7cd7a-03c5-456e-b932-10f9e03b588b tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:20.089493 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3ae7cd7a-03c5-456e-b932-10f9e03b588b tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:20.090468 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3ae7cd7a-03c5-456e-b932-10f9e03b588b tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:20.128072 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3ae7cd7a-03c5-456e-b932-10f9e03b588b tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b] Going to try to terminate instance {{(pid=122698) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:53:20.173460 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a9b10003-5093-4c3f-9948-4cfcc9a3e02c tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:20.191066 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a9b10003-5093-4c3f-9948-4cfcc9a3e02c tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/9dc683ca-0f6d-42d9-bf36-5bb1a5cc3286" status: 200 len: 1215 microversion: 2.1 time: 0.138311 Sep 23 04:53:20.191662 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2521/4906] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:20 2022] GET /compute/v2.1/servers/9dc683ca-0f6d-42d9-bf36-5bb1a5cc3286 => generated 1215 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:20.203835 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0167ef57-6cf5-4f35-86b5-af0e8e08df5e tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:20.204647 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-0167ef57-6cf5-4f35-86b5-af0e8e08df5e tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: f285e256-0a0e-4126-8adf-643bd59ca141] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:20.212303 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0167ef57-6cf5-4f35-86b5-af0e8e08df5e tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:20.213395 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0167ef57-6cf5-4f35-86b5-af0e8e08df5e tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:20.214822 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0167ef57-6cf5-4f35-86b5-af0e8e08df5e tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:20.216640 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0167ef57-6cf5-4f35-86b5-af0e8e08df5e tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:20.217546 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0167ef57-6cf5-4f35-86b5-af0e8e08df5e tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:20.218461 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0167ef57-6cf5-4f35-86b5-af0e8e08df5e tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:20.455976 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-0167ef57-6cf5-4f35-86b5-af0e8e08df5e tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:20.455976 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-0167ef57-6cf5-4f35-86b5-af0e8e08df5e tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:20.455976 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-0167ef57-6cf5-4f35-86b5-af0e8e08df5e tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:20.455976 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0167ef57-6cf5-4f35-86b5-af0e8e08df5e tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141" status: 200 len: 1731 microversion: 2.20 time: 0.246852 Sep 23 04:53:20.458345 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2522/4907] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:53:20 2022] GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141 => generated 1731 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:53:20.467789 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ee86119b-0b23-4226-882d-c1fa2fac3bd8 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:20.468337 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ee86119b-0b23-4226-882d-c1fa2fac3bd8 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 4381aca2-ea30-4473-9cd3-18c9b64f1937] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:20.474813 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ee86119b-0b23-4226-882d-c1fa2fac3bd8 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:20.475541 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ee86119b-0b23-4226-882d-c1fa2fac3bd8 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:20.476153 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ee86119b-0b23-4226-882d-c1fa2fac3bd8 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:20.477124 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ee86119b-0b23-4226-882d-c1fa2fac3bd8 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:20.477806 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ee86119b-0b23-4226-882d-c1fa2fac3bd8 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:20.478510 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ee86119b-0b23-4226-882d-c1fa2fac3bd8 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:20.555256 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ee86119b-0b23-4226-882d-c1fa2fac3bd8 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:20.565094 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ee86119b-0b23-4226-882d-c1fa2fac3bd8 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937" status: 200 len: 1325 microversion: 2.1 time: 0.105591 Sep 23 04:53:20.565684 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2523/4908] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:20 2022] GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937 => generated 1325 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:20.625577 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3ae7cd7a-03c5-456e-b932-10f9e03b588b tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b" status: 204 len: 0 microversion: 2.1 time: 0.549859 Sep 23 04:53:20.627043 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2386/4909] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:53:20 2022] DELETE /compute/v2.1/servers/c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b => generated 0 bytes in 552 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:53:20.802331 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0f6e2e1a-d06b-4ab9-8fbe-b1a03fa7909d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1677028770", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "networks": [{"uuid": "d9cbccd5-35fe-4c2e-aa6e-6e99efe2ad76"}]}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:53:20.822439 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:53:20.874459 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.neutron [None req-0f6e2e1a-d06b-4ab9-8fbe-b1a03fa7909d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] validate_networks() for [('d9cbccd5-35fe-4c2e-aa6e-6e99efe2ad76', None, None, None, None, None)] {{(pid=122699) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:53:21.079551 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6c26d0bd-0b08-4f9c-a1a4-935dda99d200 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:21.080840 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-6c26d0bd-0b08-4f9c-a1a4-935dda99d200 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] [instance: 79de76d4-8a77-45a2-b29f-da2d04bc206a] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:21.095024 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6c26d0bd-0b08-4f9c-a1a4-935dda99d200 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:21.095989 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6c26d0bd-0b08-4f9c-a1a4-935dda99d200 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:21.103854 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6c26d0bd-0b08-4f9c-a1a4-935dda99d200 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:21.103854 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6c26d0bd-0b08-4f9c-a1a4-935dda99d200 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:21.103854 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6c26d0bd-0b08-4f9c-a1a4-935dda99d200 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:21.103854 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6c26d0bd-0b08-4f9c-a1a4-935dda99d200 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:21.129051 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:53:21.333261 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6c26d0bd-0b08-4f9c-a1a4-935dda99d200 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46eb7f913d7e49f58af088102c5a06a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af9b29a1d1f488faf6e4dfd19055728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:21.341735 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-6c26d0bd-0b08-4f9c-a1a4-935dda99d200 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] 10.222.0.33 "GET /compute/v2.1/servers/79de76d4-8a77-45a2-b29f-da2d04bc206a" status: 200 len: 1319 microversion: 2.1 time: 0.269393 Sep 23 04:53:21.342492 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2387/4910] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:21 2022] GET /compute/v2.1/servers/79de76d4-8a77-45a2-b29f-da2d04bc206a => generated 1319 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:53:21.347284 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-efad8b63-1669-4c45-887e-1ebc137eb881 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:21.347966 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-efad8b63-1669-4c45-887e-1ebc137eb881 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 9dc683ca-0f6d-42d9-bf36-5bb1a5cc3286] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:21.354053 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-efad8b63-1669-4c45-887e-1ebc137eb881 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:21.359272 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-efad8b63-1669-4c45-887e-1ebc137eb881 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:21.359272 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-efad8b63-1669-4c45-887e-1ebc137eb881 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:21.359272 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-efad8b63-1669-4c45-887e-1ebc137eb881 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:21.359272 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-efad8b63-1669-4c45-887e-1ebc137eb881 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:21.359272 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-efad8b63-1669-4c45-887e-1ebc137eb881 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:21.383139 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-0f6e2e1a-d06b-4ab9-8fbe-b1a03fa7909d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Flavor limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:53:21.388012 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-0f6e2e1a-d06b-4ab9-8fbe-b1a03fa7909d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Image limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:53:21.388012 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-0f6e2e1a-d06b-4ab9-8fbe-b1a03fa7909d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Flavor pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:53:21.388012 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-0f6e2e1a-d06b-4ab9-8fbe-b1a03fa7909d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Image pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:53:21.388012 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-0f6e2e1a-d06b-4ab9-8fbe-b1a03fa7909d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:53:21.404638 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0f6e2e1a-d06b-4ab9-8fbe-b1a03fa7909d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:21.404985 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0f6e2e1a-d06b-4ab9-8fbe-b1a03fa7909d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:21.405430 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0f6e2e1a-d06b-4ab9-8fbe-b1a03fa7909d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:21.406200 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0f6e2e1a-d06b-4ab9-8fbe-b1a03fa7909d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:21.407271 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0f6e2e1a-d06b-4ab9-8fbe-b1a03fa7909d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:21.407271 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0f6e2e1a-d06b-4ab9-8fbe-b1a03fa7909d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:21.436609 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-0f6e2e1a-d06b-4ab9-8fbe-b1a03fa7909d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Getting quotas for project a94d0c555b3b4c79b1176db993b58607. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:53:21.452305 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-efad8b63-1669-4c45-887e-1ebc137eb881 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:21.457870 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-0f6e2e1a-d06b-4ab9-8fbe-b1a03fa7909d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Getting quotas for user c3397cb6388640e3af28e06f80019363 and project a94d0c555b3b4c79b1176db993b58607. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:53:21.462931 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-efad8b63-1669-4c45-887e-1ebc137eb881 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/9dc683ca-0f6d-42d9-bf36-5bb1a5cc3286" status: 200 len: 1219 microversion: 2.1 time: 0.119308 Sep 23 04:53:21.475069 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-0f6e2e1a-d06b-4ab9-8fbe-b1a03fa7909d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Going to run 1 instances... {{(pid=122699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:53:21.477728 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-0f6e2e1a-d06b-4ab9-8fbe-b1a03fa7909d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: 6174fd18-3f10-4034-85ee-32b05fde010f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:53:21.482615 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2388/4911] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:21 2022] GET /compute/v2.1/servers/9dc683ca-0f6d-42d9-bf36-5bb1a5cc3286 => generated 1219 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:21.490077 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-a84d0ad9-82ea-4d21-ab4d-3b83b7eae779 req-c06740e6-f37b-4117-9961-1caf4950f935 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8243026d-51c6-4be3-b91b-4487474eb19a", "tag": "6b424dce-3332-4dca-a4a4-4441e71f6301"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:53:21.501154 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-a84d0ad9-82ea-4d21-ab4d-3b83b7eae779 req-c06740e6-f37b-4117-9961-1caf4950f935 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:21.501828 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-a84d0ad9-82ea-4d21-ab4d-3b83b7eae779 req-c06740e6-f37b-4117-9961-1caf4950f935 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:21.502378 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-a84d0ad9-82ea-4d21-ab4d-3b83b7eae779 req-c06740e6-f37b-4117-9961-1caf4950f935 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:21.518433 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-a84d0ad9-82ea-4d21-ab4d-3b83b7eae779 req-c06740e6-f37b-4117-9961-1caf4950f935 service nova] Creating event network-changed:6b424dce-3332-4dca-a4a4-4441e71f6301 for instance 8243026d-51c6-4be3-b91b-4487474eb19a on n-h1-846463-3 Sep 23 04:53:21.524197 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-a84d0ad9-82ea-4d21-ab4d-3b83b7eae779 req-c06740e6-f37b-4117-9961-1caf4950f935 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039711 Sep 23 04:53:21.524805 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2389/4912] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:53:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:53:21.533343 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8c94bf83-4841-4316-8b13-dfa5f774ac8c tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:21.534519 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8c94bf83-4841-4316-8b13-dfa5f774ac8c tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: f285e256-0a0e-4126-8adf-643bd59ca141] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:21.546248 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8c94bf83-4841-4316-8b13-dfa5f774ac8c tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:21.547071 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8c94bf83-4841-4316-8b13-dfa5f774ac8c tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:21.547828 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8c94bf83-4841-4316-8b13-dfa5f774ac8c tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:21.548776 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8c94bf83-4841-4316-8b13-dfa5f774ac8c tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:21.549491 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8c94bf83-4841-4316-8b13-dfa5f774ac8c tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:21.550697 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8c94bf83-4841-4316-8b13-dfa5f774ac8c tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:21.658600 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0f6e2e1a-d06b-4ab9-8fbe-b1a03fa7909d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.855780 Sep 23 04:53:21.665391 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2524/4913] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:53:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 866 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:53:21.685118 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7ee20826-1fd0-451d-977e-6c4c7cda7e5b tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:21.687850 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-7ee20826-1fd0-451d-977e-6c4c7cda7e5b tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 4381aca2-ea30-4473-9cd3-18c9b64f1937] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:21.710205 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7ee20826-1fd0-451d-977e-6c4c7cda7e5b tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:21.712743 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7ee20826-1fd0-451d-977e-6c4c7cda7e5b tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:21.714283 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7ee20826-1fd0-451d-977e-6c4c7cda7e5b tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:21.717024 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7ee20826-1fd0-451d-977e-6c4c7cda7e5b tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:21.717810 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7ee20826-1fd0-451d-977e-6c4c7cda7e5b tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:21.718510 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7ee20826-1fd0-451d-977e-6c4c7cda7e5b tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:22.005752 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8c94bf83-4841-4316-8b13-dfa5f774ac8c tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:22.018915 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8c94bf83-4841-4316-8b13-dfa5f774ac8c tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:22.020454 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8c94bf83-4841-4316-8b13-dfa5f774ac8c tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:22.021672 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8c94bf83-4841-4316-8b13-dfa5f774ac8c tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141" status: 200 len: 1731 microversion: 2.20 time: 0.493968 Sep 23 04:53:22.026838 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2390/4914] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:53:21 2022] GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141 => generated 1731 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:53:22.046896 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-bc2f1d8c-ef57-4fb9-91de-5cd8911181df tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:22.047533 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-bc2f1d8c-ef57-4fb9-91de-5cd8911181df tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: 6174fd18-3f10-4034-85ee-32b05fde010f] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:22.239154 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-bc2f1d8c-ef57-4fb9-91de-5cd8911181df tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:22.249381 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-bc2f1d8c-ef57-4fb9-91de-5cd8911181df tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f" status: 200 len: 1218 microversion: 2.1 time: 0.212595 Sep 23 04:53:22.250333 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2391/4915] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:22 2022] GET /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f => generated 1218 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:22.301982 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-7ee20826-1fd0-451d-977e-6c4c7cda7e5b tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:22.307338 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-7ee20826-1fd0-451d-977e-6c4c7cda7e5b tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937" status: 200 len: 1392 microversion: 2.1 time: 0.640696 Sep 23 04:53:22.310374 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2525/4916] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:21 2022] GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937 => generated 1392 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:22.369402 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-142e178b-11bc-496f-85a8-e30612e63eba tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:22.370483 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-142e178b-11bc-496f-85a8-e30612e63eba tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] [instance: 79de76d4-8a77-45a2-b29f-da2d04bc206a] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:22.380978 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-142e178b-11bc-496f-85a8-e30612e63eba tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:22.386426 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-142e178b-11bc-496f-85a8-e30612e63eba tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:22.386426 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-142e178b-11bc-496f-85a8-e30612e63eba tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:22.386426 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-142e178b-11bc-496f-85a8-e30612e63eba tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:22.386426 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-142e178b-11bc-496f-85a8-e30612e63eba tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:22.390367 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-142e178b-11bc-496f-85a8-e30612e63eba tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:22.493173 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5dfb44c0-b984-4c2b-ac0d-30593321b6de tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:22.494412 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-5dfb44c0-b984-4c2b-ac0d-30593321b6de tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 9dc683ca-0f6d-42d9-bf36-5bb1a5cc3286] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:22.507778 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5dfb44c0-b984-4c2b-ac0d-30593321b6de tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:22.508704 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5dfb44c0-b984-4c2b-ac0d-30593321b6de tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:22.509405 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5dfb44c0-b984-4c2b-ac0d-30593321b6de tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:22.510176 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5dfb44c0-b984-4c2b-ac0d-30593321b6de tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:22.511187 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5dfb44c0-b984-4c2b-ac0d-30593321b6de tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:22.511632 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5dfb44c0-b984-4c2b-ac0d-30593321b6de tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:22.659669 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-5dfb44c0-b984-4c2b-ac0d-30593321b6de tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:22.675244 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5dfb44c0-b984-4c2b-ac0d-30593321b6de tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/9dc683ca-0f6d-42d9-bf36-5bb1a5cc3286" status: 200 len: 1267 microversion: 2.1 time: 0.188041 Sep 23 04:53:22.675244 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2526/4917] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:22 2022] GET /compute/v2.1/servers/9dc683ca-0f6d-42d9-bf36-5bb1a5cc3286 => generated 1267 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:22.699633 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-142e178b-11bc-496f-85a8-e30612e63eba tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46eb7f913d7e49f58af088102c5a06a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af9b29a1d1f488faf6e4dfd19055728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:22.710622 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-142e178b-11bc-496f-85a8-e30612e63eba tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] 10.222.0.33 "GET /compute/v2.1/servers/79de76d4-8a77-45a2-b29f-da2d04bc206a" status: 200 len: 1319 microversion: 2.1 time: 0.348051 Sep 23 04:53:22.713229 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2392/4918] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:22 2022] GET /compute/v2.1/servers/79de76d4-8a77-45a2-b29f-da2d04bc206a => generated 1319 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:23.024904 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-fa197ea0-3217-4ca9-8b64-031f9d9c9d12 tempest-VolumesGetTestJSON-132623442 tempest-VolumesGetTestJSON-132623442-project] Action: 'create', calling method: .version_select at 0x7ff1bab273a0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-74658571", "metadata": {"Type": "work"}}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:53:23.048715 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f3eed7a0-46b0-4f8d-8ec5-77f681de6be8 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:23.049336 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f3eed7a0-46b0-4f8d-8ec5-77f681de6be8 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: f285e256-0a0e-4126-8adf-643bd59ca141] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:23.059672 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f3eed7a0-46b0-4f8d-8ec5-77f681de6be8 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:23.063955 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f3eed7a0-46b0-4f8d-8ec5-77f681de6be8 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:23.064635 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f3eed7a0-46b0-4f8d-8ec5-77f681de6be8 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:23.065704 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f3eed7a0-46b0-4f8d-8ec5-77f681de6be8 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:23.065922 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f3eed7a0-46b0-4f8d-8ec5-77f681de6be8 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:23.066561 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f3eed7a0-46b0-4f8d-8ec5-77f681de6be8 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:23.475474 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f3eed7a0-46b0-4f8d-8ec5-77f681de6be8 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:23.495903 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f3eed7a0-46b0-4f8d-8ec5-77f681de6be8 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:23.500286 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f3eed7a0-46b0-4f8d-8ec5-77f681de6be8 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:23.502673 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f3eed7a0-46b0-4f8d-8ec5-77f681de6be8 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141" status: 200 len: 1731 microversion: 2.20 time: 0.457816 Sep 23 04:53:23.505412 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2393/4919] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:53:23 2022] GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141 => generated 1731 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:53:23.517066 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-93368626-8bfc-449c-b4be-7df0b4265a5d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:23.517699 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-93368626-8bfc-449c-b4be-7df0b4265a5d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: 6174fd18-3f10-4034-85ee-32b05fde010f] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:23.539831 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-93368626-8bfc-449c-b4be-7df0b4265a5d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:23.540339 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-93368626-8bfc-449c-b4be-7df0b4265a5d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:23.543535 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-93368626-8bfc-449c-b4be-7df0b4265a5d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:23.544335 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-93368626-8bfc-449c-b4be-7df0b4265a5d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:23.546331 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-93368626-8bfc-449c-b4be-7df0b4265a5d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:23.546831 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-93368626-8bfc-449c-b4be-7df0b4265a5d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:23.663864 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-93368626-8bfc-449c-b4be-7df0b4265a5d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:23.673645 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-93368626-8bfc-449c-b4be-7df0b4265a5d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f" status: 200 len: 1222 microversion: 2.1 time: 0.165823 Sep 23 04:53:23.679229 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2394/4920] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:23 2022] GET /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f => generated 1222 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:23.681364 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4f9b5b9f-4687-4013-a7b3-ecd79781bcfa tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:23.682082 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4f9b5b9f-4687-4013-a7b3-ecd79781bcfa tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 4381aca2-ea30-4473-9cd3-18c9b64f1937] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:23.687219 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:53:23.692125 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4f9b5b9f-4687-4013-a7b3-ecd79781bcfa tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:23.692990 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4f9b5b9f-4687-4013-a7b3-ecd79781bcfa tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:23.694419 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4f9b5b9f-4687-4013-a7b3-ecd79781bcfa tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:23.695439 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4f9b5b9f-4687-4013-a7b3-ecd79781bcfa tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:23.697140 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4f9b5b9f-4687-4013-a7b3-ecd79781bcfa tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:23.702049 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4f9b5b9f-4687-4013-a7b3-ecd79781bcfa tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:23.988542 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-fa197ea0-3217-4ca9-8b64-031f9d9c9d12 tempest-VolumesGetTestJSON-132623442 tempest-VolumesGetTestJSON-132623442-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 200 len: 351 microversion: 2.1 time: 1.144553 Sep 23 04:53:23.989537 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2527/4921] 10.222.0.33 () {60 vars in 1156 bytes} [Fri Sep 23 04:53:22 2022] POST /compute/v2.1/os-volumes => generated 351 bytes in 1146 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 23 04:53:23.994766 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-8e998879-5276-42c1-87f1-890dfa8763dc req-cba53e8d-3a1b-4c96-be58-9eddfb50adf7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4381aca2-ea30-4473-9cd3-18c9b64f1937", "tag": "bc06dfe2-49c9-4f61-b1e4-e3d76533aa0c"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:53:24.027462 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-8e998879-5276-42c1-87f1-890dfa8763dc req-cba53e8d-3a1b-4c96-be58-9eddfb50adf7 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:24.028210 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-8e998879-5276-42c1-87f1-890dfa8763dc req-cba53e8d-3a1b-4c96-be58-9eddfb50adf7 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:24.028811 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-8e998879-5276-42c1-87f1-890dfa8763dc req-cba53e8d-3a1b-4c96-be58-9eddfb50adf7 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:24.047618 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-8e998879-5276-42c1-87f1-890dfa8763dc req-cba53e8d-3a1b-4c96-be58-9eddfb50adf7 service nova] Creating event network-changed:bc06dfe2-49c9-4f61-b1e4-e3d76533aa0c for instance 4381aca2-ea30-4473-9cd3-18c9b64f1937 on n-h1-846463-3 Sep 23 04:53:24.055434 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-8e998879-5276-42c1-87f1-890dfa8763dc req-cba53e8d-3a1b-4c96-be58-9eddfb50adf7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063420 Sep 23 04:53:24.059351 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2528/4922] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:53:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:53:24.073753 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-edfe1835-cbdd-4c73-9c1e-c1fd0954ef17 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:24.077084 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-edfe1835-cbdd-4c73-9c1e-c1fd0954ef17 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 9dc683ca-0f6d-42d9-bf36-5bb1a5cc3286] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:24.090760 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-edfe1835-cbdd-4c73-9c1e-c1fd0954ef17 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:24.091063 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-edfe1835-cbdd-4c73-9c1e-c1fd0954ef17 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:24.091695 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-edfe1835-cbdd-4c73-9c1e-c1fd0954ef17 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:24.092582 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-edfe1835-cbdd-4c73-9c1e-c1fd0954ef17 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:24.093208 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-edfe1835-cbdd-4c73-9c1e-c1fd0954ef17 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:24.095186 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-edfe1835-cbdd-4c73-9c1e-c1fd0954ef17 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:24.162026 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4f9b5b9f-4687-4013-a7b3-ecd79781bcfa tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:24.170648 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4f9b5b9f-4687-4013-a7b3-ecd79781bcfa tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937" status: 200 len: 1392 microversion: 2.1 time: 0.494399 Sep 23 04:53:24.171358 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2395/4923] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:23 2022] GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937 => generated 1392 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:24.193638 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e3ec08e1-8a49-4bbc-98cd-a247f1765c2e tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:24.194370 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e3ec08e1-8a49-4bbc-98cd-a247f1765c2e tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] [instance: 79de76d4-8a77-45a2-b29f-da2d04bc206a] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:24.219690 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e3ec08e1-8a49-4bbc-98cd-a247f1765c2e tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:24.222195 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e3ec08e1-8a49-4bbc-98cd-a247f1765c2e tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:24.229182 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e3ec08e1-8a49-4bbc-98cd-a247f1765c2e tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:24.229182 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e3ec08e1-8a49-4bbc-98cd-a247f1765c2e tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:24.229182 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e3ec08e1-8a49-4bbc-98cd-a247f1765c2e tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:24.229182 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e3ec08e1-8a49-4bbc-98cd-a247f1765c2e tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:24.372453 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-edfe1835-cbdd-4c73-9c1e-c1fd0954ef17 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:24.383149 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-edfe1835-cbdd-4c73-9c1e-c1fd0954ef17 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/9dc683ca-0f6d-42d9-bf36-5bb1a5cc3286" status: 200 len: 1273 microversion: 2.1 time: 0.321848 Sep 23 04:53:24.383750 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2529/4924] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:24 2022] GET /compute/v2.1/servers/9dc683ca-0f6d-42d9-bf36-5bb1a5cc3286 => generated 1273 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:24.410024 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-e172953f-6b0e-46d8-bf71-9606acd60723 req-968ccd3d-fcd5-452f-a526-bf4515cad08c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f285e256-0a0e-4126-8adf-643bd59ca141", "name": "network-vif-plugged", "status": "completed", "tag": "e29f5caa-b337-40d1-9780-77215617f3ce"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:53:24.420609 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-e172953f-6b0e-46d8-bf71-9606acd60723 req-968ccd3d-fcd5-452f-a526-bf4515cad08c service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:24.421228 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-e172953f-6b0e-46d8-bf71-9606acd60723 req-968ccd3d-fcd5-452f-a526-bf4515cad08c service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:24.421790 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-e172953f-6b0e-46d8-bf71-9606acd60723 req-968ccd3d-fcd5-452f-a526-bf4515cad08c service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:24.444729 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-e172953f-6b0e-46d8-bf71-9606acd60723 req-968ccd3d-fcd5-452f-a526-bf4515cad08c service nova] Creating event network-vif-plugged:e29f5caa-b337-40d1-9780-77215617f3ce for instance f285e256-0a0e-4126-8adf-643bd59ca141 on n-h1-846463-3 Sep 23 04:53:24.455963 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-e172953f-6b0e-46d8-bf71-9606acd60723 req-968ccd3d-fcd5-452f-a526-bf4515cad08c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054093 Sep 23 04:53:24.461561 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2530/4925] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:53:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:53:24.494388 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-18873211-1fd3-4566-a82c-b963353cd5e0 tempest-VolumesGetTestJSON-132623442 tempest-VolumesGetTestJSON-132623442-project] Calling method '.version_select at 0x7ff1bab82a60>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:24.611751 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-18873211-1fd3-4566-a82c-b963353cd5e0 tempest-VolumesGetTestJSON-132623442 tempest-VolumesGetTestJSON-132623442-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/27de227f-0448-4096-bf80-18339a0c4ec2" status: 200 len: 351 microversion: 2.1 time: 0.136128 Sep 23 04:53:24.612743 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2531/4926] 10.222.0.33 () {58 vars in 1245 bytes} [Fri Sep 23 04:53:24 2022] GET /compute/v2.1/os-volumes/27de227f-0448-4096-bf80-18339a0c4ec2 => generated 351 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:53:24.642395 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-4e53565f-dc2a-4fbb-a110-e1666d142511 req-90144cfe-a803-460e-92fd-088ef9a67d1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b", "name": "network-vif-deleted", "tag": "2d1ed940-5eb5-4eff-9020-37f2f21a3613"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:53:24.651956 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-4e53565f-dc2a-4fbb-a110-e1666d142511 req-90144cfe-a803-460e-92fd-088ef9a67d1c service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:24.654284 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-4e53565f-dc2a-4fbb-a110-e1666d142511 req-90144cfe-a803-460e-92fd-088ef9a67d1c service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:24.654899 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-4e53565f-dc2a-4fbb-a110-e1666d142511 req-90144cfe-a803-460e-92fd-088ef9a67d1c service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:24.672393 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-4e53565f-dc2a-4fbb-a110-e1666d142511 req-90144cfe-a803-460e-92fd-088ef9a67d1c service nova] Creating event network-vif-deleted:2d1ed940-5eb5-4eff-9020-37f2f21a3613 for instance c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b on n-h1-846463-3 Sep 23 04:53:24.679788 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-4e53565f-dc2a-4fbb-a110-e1666d142511 req-90144cfe-a803-460e-92fd-088ef9a67d1c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060976 Sep 23 04:53:24.681191 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2532/4927] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:53:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:53:24.699692 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d2bbce05-0650-4fa8-9b2d-1b4f6cd12db6 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:24.700637 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d2bbce05-0650-4fa8-9b2d-1b4f6cd12db6 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: f285e256-0a0e-4126-8adf-643bd59ca141] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:24.708480 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d2bbce05-0650-4fa8-9b2d-1b4f6cd12db6 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:24.708964 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d2bbce05-0650-4fa8-9b2d-1b4f6cd12db6 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:24.709631 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d2bbce05-0650-4fa8-9b2d-1b4f6cd12db6 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:24.710397 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d2bbce05-0650-4fa8-9b2d-1b4f6cd12db6 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:24.710859 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d2bbce05-0650-4fa8-9b2d-1b4f6cd12db6 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:24.711287 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d2bbce05-0650-4fa8-9b2d-1b4f6cd12db6 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:25.301259 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e3ec08e1-8a49-4bbc-98cd-a247f1765c2e tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46eb7f913d7e49f58af088102c5a06a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af9b29a1d1f488faf6e4dfd19055728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:25.312694 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e3ec08e1-8a49-4bbc-98cd-a247f1765c2e tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] 10.222.0.33 "GET /compute/v2.1/servers/79de76d4-8a77-45a2-b29f-da2d04bc206a" status: 200 len: 1319 microversion: 2.1 time: 1.140383 Sep 23 04:53:25.327218 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2396/4928] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:24 2022] GET /compute/v2.1/servers/79de76d4-8a77-45a2-b29f-da2d04bc206a => generated 1319 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:25.346593 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7f100b1f-6ca3-4705-afde-a3823edb1f83 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:25.347329 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7f100b1f-6ca3-4705-afde-a3823edb1f83 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: 6174fd18-3f10-4034-85ee-32b05fde010f] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:25.350632 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d2bbce05-0650-4fa8-9b2d-1b4f6cd12db6 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:25.354806 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7f100b1f-6ca3-4705-afde-a3823edb1f83 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:25.356132 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7f100b1f-6ca3-4705-afde-a3823edb1f83 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:25.356837 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7f100b1f-6ca3-4705-afde-a3823edb1f83 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:25.357731 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7f100b1f-6ca3-4705-afde-a3823edb1f83 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:25.358500 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7f100b1f-6ca3-4705-afde-a3823edb1f83 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:25.359629 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7f100b1f-6ca3-4705-afde-a3823edb1f83 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:25.366909 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d2bbce05-0650-4fa8-9b2d-1b4f6cd12db6 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:25.371456 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d2bbce05-0650-4fa8-9b2d-1b4f6cd12db6 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:25.372862 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d2bbce05-0650-4fa8-9b2d-1b4f6cd12db6 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141" status: 200 len: 1731 microversion: 2.20 time: 0.690348 Sep 23 04:53:25.374995 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2533/4929] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:53:24 2022] GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141 => generated 1731 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:53:25.409274 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-aadcd4d4-71e0-4b95-8a01-4626dcb5d418 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:25.410538 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-aadcd4d4-71e0-4b95-8a01-4626dcb5d418 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 4381aca2-ea30-4473-9cd3-18c9b64f1937] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:25.430442 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aadcd4d4-71e0-4b95-8a01-4626dcb5d418 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:25.436490 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aadcd4d4-71e0-4b95-8a01-4626dcb5d418 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:25.437273 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aadcd4d4-71e0-4b95-8a01-4626dcb5d418 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:25.447672 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aadcd4d4-71e0-4b95-8a01-4626dcb5d418 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:25.449064 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aadcd4d4-71e0-4b95-8a01-4626dcb5d418 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:25.449845 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aadcd4d4-71e0-4b95-8a01-4626dcb5d418 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:25.525728 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-7f100b1f-6ca3-4705-afde-a3823edb1f83 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:25.545434 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7f100b1f-6ca3-4705-afde-a3823edb1f83 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f" status: 200 len: 1288 microversion: 2.1 time: 0.210285 Sep 23 04:53:25.568292 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2397/4930] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:25 2022] GET /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f => generated 1288 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:25.581448 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-76b97959-24c9-4ff5-84d1-c3d2404692c9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:25.584988 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-76b97959-24c9-4ff5-84d1-c3d2404692c9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 9dc683ca-0f6d-42d9-bf36-5bb1a5cc3286] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:25.601603 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-76b97959-24c9-4ff5-84d1-c3d2404692c9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:25.607366 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-76b97959-24c9-4ff5-84d1-c3d2404692c9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:25.609685 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-76b97959-24c9-4ff5-84d1-c3d2404692c9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:25.612182 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-76b97959-24c9-4ff5-84d1-c3d2404692c9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:25.612989 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-76b97959-24c9-4ff5-84d1-c3d2404692c9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:25.616134 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-76b97959-24c9-4ff5-84d1-c3d2404692c9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:25.849510 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-aadcd4d4-71e0-4b95-8a01-4626dcb5d418 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:25.860369 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-aadcd4d4-71e0-4b95-8a01-4626dcb5d418 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937" status: 200 len: 1392 microversion: 2.1 time: 0.481153 Sep 23 04:53:25.878318 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2534/4931] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:25 2022] GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937 => generated 1392 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:25.888920 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7da0bf57-a24a-47bd-a674-427e7d5ac453 tempest-VolumesGetTestJSON-132623442 tempest-VolumesGetTestJSON-132623442-project] Calling method '.version_select at 0x7ff1ba8fd430>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:25.946062 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-76b97959-24c9-4ff5-84d1-c3d2404692c9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:25.957270 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-76b97959-24c9-4ff5-84d1-c3d2404692c9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/9dc683ca-0f6d-42d9-bf36-5bb1a5cc3286" status: 200 len: 1315 microversion: 2.1 time: 0.387457 Sep 23 04:53:25.958445 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2398/4932] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:25 2022] GET /compute/v2.1/servers/9dc683ca-0f6d-42d9-bf36-5bb1a5cc3286 => generated 1315 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:25.971512 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-7da0bf57-a24a-47bd-a674-427e7d5ac453 tempest-VolumesGetTestJSON-132623442 tempest-VolumesGetTestJSON-132623442-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/27de227f-0448-4096-bf80-18339a0c4ec2" status: 200 len: 352 microversion: 2.1 time: 0.091826 Sep 23 04:53:25.974055 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2535/4933] 10.222.0.33 () {58 vars in 1245 bytes} [Fri Sep 23 04:53:25 2022] GET /compute/v2.1/os-volumes/27de227f-0448-4096-bf80-18339a0c4ec2 => generated 352 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:53:25.990592 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-924482db-59bb-4ae5-8b72-7a8055ceb8e6 tempest-VolumesGetTestJSON-132623442 tempest-VolumesGetTestJSON-132623442-project] Calling method '.version_select at 0x7ff1ba820b80>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:26.068103 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-924482db-59bb-4ae5-8b72-7a8055ceb8e6 tempest-VolumesGetTestJSON-132623442 tempest-VolumesGetTestJSON-132623442-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/27de227f-0448-4096-bf80-18339a0c4ec2" status: 200 len: 352 microversion: 2.1 time: 0.081669 Sep 23 04:53:26.069046 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2399/4934] 10.222.0.33 () {58 vars in 1245 bytes} [Fri Sep 23 04:53:25 2022] GET /compute/v2.1/os-volumes/27de227f-0448-4096-bf80-18339a0c4ec2 => generated 352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:53:26.087870 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-550107a4-2470-43ac-b317-81de6b4db596 tempest-VolumesGetTestJSON-132623442 tempest-VolumesGetTestJSON-132623442-project] Calling method '.version_select at 0x7ff1baaf28b0>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:26.343980 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2ffbe0a0-88f6-45a7-91e5-9d842c613035 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:26.345233 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-2ffbe0a0-88f6-45a7-91e5-9d842c613035 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] [instance: 79de76d4-8a77-45a2-b29f-da2d04bc206a] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:26.362648 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-550107a4-2470-43ac-b317-81de6b4db596 tempest-VolumesGetTestJSON-132623442 tempest-VolumesGetTestJSON-132623442-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/27de227f-0448-4096-bf80-18339a0c4ec2" status: 202 len: 0 microversion: 2.1 time: 0.279296 Sep 23 04:53:26.368482 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2536/4935] 10.222.0.33 () {58 vars in 1248 bytes} [Fri Sep 23 04:53:26 2022] DELETE /compute/v2.1/os-volumes/27de227f-0448-4096-bf80-18339a0c4ec2 => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:53:26.381316 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-dc68200a-b5c5-4918-afc2-438edf79be98 tempest-VolumesGetTestJSON-132623442 tempest-VolumesGetTestJSON-132623442-project] Calling method '.version_select at 0x7ff1ba974a60>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:26.422042 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2ffbe0a0-88f6-45a7-91e5-9d842c613035 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:26.422453 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2ffbe0a0-88f6-45a7-91e5-9d842c613035 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:26.422904 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2ffbe0a0-88f6-45a7-91e5-9d842c613035 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:26.423629 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2ffbe0a0-88f6-45a7-91e5-9d842c613035 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:26.424103 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2ffbe0a0-88f6-45a7-91e5-9d842c613035 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:26.438701 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2ffbe0a0-88f6-45a7-91e5-9d842c613035 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:26.521624 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-dc68200a-b5c5-4918-afc2-438edf79be98 tempest-VolumesGetTestJSON-132623442 tempest-VolumesGetTestJSON-132623442-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/27de227f-0448-4096-bf80-18339a0c4ec2" status: 200 len: 351 microversion: 2.1 time: 0.150093 Sep 23 04:53:26.522379 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2537/4936] 10.222.0.33 () {58 vars in 1245 bytes} [Fri Sep 23 04:53:26 2022] GET /compute/v2.1/os-volumes/27de227f-0448-4096-bf80-18339a0c4ec2 => generated 351 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:53:26.531688 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f06d79d4-5e17-4644-9433-f6cbd4c83518 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:26.532672 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f06d79d4-5e17-4644-9433-f6cbd4c83518 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: f285e256-0a0e-4126-8adf-643bd59ca141] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:26.543461 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f06d79d4-5e17-4644-9433-f6cbd4c83518 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:26.544485 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f06d79d4-5e17-4644-9433-f6cbd4c83518 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:26.545277 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f06d79d4-5e17-4644-9433-f6cbd4c83518 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:26.546408 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f06d79d4-5e17-4644-9433-f6cbd4c83518 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:26.547272 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f06d79d4-5e17-4644-9433-f6cbd4c83518 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:26.548412 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f06d79d4-5e17-4644-9433-f6cbd4c83518 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:26.575467 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=100 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:53:26.819753 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-2ffbe0a0-88f6-45a7-91e5-9d842c613035 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46eb7f913d7e49f58af088102c5a06a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af9b29a1d1f488faf6e4dfd19055728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:26.836288 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2ffbe0a0-88f6-45a7-91e5-9d842c613035 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] 10.222.0.33 "GET /compute/v2.1/servers/79de76d4-8a77-45a2-b29f-da2d04bc206a" status: 200 len: 1319 microversion: 2.1 time: 0.498870 Sep 23 04:53:26.848287 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2400/4937] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:26 2022] GET /compute/v2.1/servers/79de76d4-8a77-45a2-b29f-da2d04bc206a => generated 1319 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:53:26.857500 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f06d79d4-5e17-4644-9433-f6cbd4c83518 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:26.858449 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-9ba74cb6-b5bd-4a33-ab24-4d7519da7923 req-758403f2-57ea-4a13-9ed4-dd994018d84c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79de76d4-8a77-45a2-b29f-da2d04bc206a", "name": "network-vif-plugged", "status": "completed", "tag": "6f074d0d-63d3-4a67-a5b5-418ee53e6c1d"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:53:26.866253 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f06d79d4-5e17-4644-9433-f6cbd4c83518 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:26.879122 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f06d79d4-5e17-4644-9433-f6cbd4c83518 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:26.881253 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f06d79d4-5e17-4644-9433-f6cbd4c83518 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141" status: 200 len: 1731 microversion: 2.20 time: 0.356745 Sep 23 04:53:26.894178 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-9ba74cb6-b5bd-4a33-ab24-4d7519da7923 req-758403f2-57ea-4a13-9ed4-dd994018d84c service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:26.894178 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-9ba74cb6-b5bd-4a33-ab24-4d7519da7923 req-758403f2-57ea-4a13-9ed4-dd994018d84c service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:26.894178 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-9ba74cb6-b5bd-4a33-ab24-4d7519da7923 req-758403f2-57ea-4a13-9ed4-dd994018d84c service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:26.908924 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2538/4938] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:53:26 2022] GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141 => generated 1731 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:53:26.918283 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1cb27153-c231-463b-b467-55355d074588 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:26.920617 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1cb27153-c231-463b-b467-55355d074588 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: 6174fd18-3f10-4034-85ee-32b05fde010f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:26.934749 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1cb27153-c231-463b-b467-55355d074588 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:26.935256 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1cb27153-c231-463b-b467-55355d074588 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:26.936106 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1cb27153-c231-463b-b467-55355d074588 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:26.936896 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1cb27153-c231-463b-b467-55355d074588 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:26.937417 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1cb27153-c231-463b-b467-55355d074588 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:26.938647 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1cb27153-c231-463b-b467-55355d074588 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:26.943797 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-9ba74cb6-b5bd-4a33-ab24-4d7519da7923 req-758403f2-57ea-4a13-9ed4-dd994018d84c service nova] Creating event network-vif-plugged:6f074d0d-63d3-4a67-a5b5-418ee53e6c1d for instance 79de76d4-8a77-45a2-b29f-da2d04bc206a on n-h2-846463-3 Sep 23 04:53:26.959225 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-9ba74cb6-b5bd-4a33-ab24-4d7519da7923 req-758403f2-57ea-4a13-9ed4-dd994018d84c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108068 Sep 23 04:53:26.960213 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2401/4939] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:53:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:53:26.968413 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-aeb65763-a609-4dfb-9157-9d1ffef6e790 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:26.971167 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-aeb65763-a609-4dfb-9157-9d1ffef6e790 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 4381aca2-ea30-4473-9cd3-18c9b64f1937] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:26.978825 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-aeb65763-a609-4dfb-9157-9d1ffef6e790 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:26.981242 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-aeb65763-a609-4dfb-9157-9d1ffef6e790 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:26.982459 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-aeb65763-a609-4dfb-9157-9d1ffef6e790 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:26.983439 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-aeb65763-a609-4dfb-9157-9d1ffef6e790 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:26.989770 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-aeb65763-a609-4dfb-9157-9d1ffef6e790 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:26.990576 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-aeb65763-a609-4dfb-9157-9d1ffef6e790 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:27.369330 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1cb27153-c231-463b-b467-55355d074588 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:27.378481 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1cb27153-c231-463b-b467-55355d074588 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f" status: 200 len: 1318 microversion: 2.1 time: 0.471063 Sep 23 04:53:27.388443 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2539/4940] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:26 2022] GET /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f => generated 1318 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:27.390734 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7a92495a-031c-47b4-b8a5-ce9185ab9801 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:27.398520 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-7a92495a-031c-47b4-b8a5-ce9185ab9801 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 9dc683ca-0f6d-42d9-bf36-5bb1a5cc3286] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:27.405007 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7a92495a-031c-47b4-b8a5-ce9185ab9801 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:27.408336 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7a92495a-031c-47b4-b8a5-ce9185ab9801 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:27.410489 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7a92495a-031c-47b4-b8a5-ce9185ab9801 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:27.411324 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7a92495a-031c-47b4-b8a5-ce9185ab9801 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:27.414772 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7a92495a-031c-47b4-b8a5-ce9185ab9801 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:27.415313 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7a92495a-031c-47b4-b8a5-ce9185ab9801 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:27.632975 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-aeb65763-a609-4dfb-9157-9d1ffef6e790 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:27.646319 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-aeb65763-a609-4dfb-9157-9d1ffef6e790 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937" status: 200 len: 1392 microversion: 2.1 time: 0.684122 Sep 23 04:53:27.647235 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2402/4941] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:26 2022] GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937 => generated 1392 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:27.659666 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ad04ae75-8ac1-46f2-b5ad-a1df4a8d0529 tempest-VolumesGetTestJSON-132623442 tempest-VolumesGetTestJSON-132623442-project] Calling method '.version_select at 0x7ff1ba7e3040>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:27.785029 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ad04ae75-8ac1-46f2-b5ad-a1df4a8d0529 tempest-VolumesGetTestJSON-132623442 tempest-VolumesGetTestJSON-132623442-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/27de227f-0448-4096-bf80-18339a0c4ec2" status: 200 len: 351 microversion: 2.1 time: 0.132421 Sep 23 04:53:27.786643 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2403/4942] 10.222.0.33 () {58 vars in 1245 bytes} [Fri Sep 23 04:53:27 2022] GET /compute/v2.1/os-volumes/27de227f-0448-4096-bf80-18339a0c4ec2 => generated 351 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:53:27.804242 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-7a92495a-031c-47b4-b8a5-ce9185ab9801 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:27.815915 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-7a92495a-031c-47b4-b8a5-ce9185ab9801 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/9dc683ca-0f6d-42d9-bf36-5bb1a5cc3286" status: 200 len: 1315 microversion: 2.1 time: 0.430218 Sep 23 04:53:27.817180 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2540/4943] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:27 2022] GET /compute/v2.1/servers/9dc683ca-0f6d-42d9-bf36-5bb1a5cc3286 => generated 1315 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:27.861503 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-bb2e3844-d433-4eaf-8fc9-d254cdaa50d8 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:27.862484 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-bb2e3844-d433-4eaf-8fc9-d254cdaa50d8 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] [instance: 79de76d4-8a77-45a2-b29f-da2d04bc206a] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:27.874643 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bb2e3844-d433-4eaf-8fc9-d254cdaa50d8 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:27.875506 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bb2e3844-d433-4eaf-8fc9-d254cdaa50d8 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:27.876272 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bb2e3844-d433-4eaf-8fc9-d254cdaa50d8 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:27.878141 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bb2e3844-d433-4eaf-8fc9-d254cdaa50d8 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:27.879086 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bb2e3844-d433-4eaf-8fc9-d254cdaa50d8 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:27.880117 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bb2e3844-d433-4eaf-8fc9-d254cdaa50d8 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:27.899235 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-edf9f217-2c1d-438f-91ea-b340bbd67909 req-295184b0-e86d-499c-89d4-7fe90a1a8211 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9dc683ca-0f6d-42d9-bf36-5bb1a5cc3286", "tag": "115752c0-7113-4f89-9e3a-ff7748947567"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:53:27.932778 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-edf9f217-2c1d-438f-91ea-b340bbd67909 req-295184b0-e86d-499c-89d4-7fe90a1a8211 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:27.934298 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-edf9f217-2c1d-438f-91ea-b340bbd67909 req-295184b0-e86d-499c-89d4-7fe90a1a8211 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:27.936726 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-edf9f217-2c1d-438f-91ea-b340bbd67909 req-295184b0-e86d-499c-89d4-7fe90a1a8211 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:27.968403 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-edf9f217-2c1d-438f-91ea-b340bbd67909 req-295184b0-e86d-499c-89d4-7fe90a1a8211 service nova] Creating event network-changed:115752c0-7113-4f89-9e3a-ff7748947567 for instance 9dc683ca-0f6d-42d9-bf36-5bb1a5cc3286 on n-h2-846463-3 Sep 23 04:53:27.995295 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-edf9f217-2c1d-438f-91ea-b340bbd67909 req-295184b0-e86d-499c-89d4-7fe90a1a8211 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097021 Sep 23 04:53:27.996355 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2541/4944] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:53:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:53:28.012526 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-04d7b056-f249-427f-b5fc-42aaf6ac7b3c tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:28.013390 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-04d7b056-f249-427f-b5fc-42aaf6ac7b3c tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: f285e256-0a0e-4126-8adf-643bd59ca141] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:28.020959 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-04d7b056-f249-427f-b5fc-42aaf6ac7b3c tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:28.022072 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-04d7b056-f249-427f-b5fc-42aaf6ac7b3c tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:28.025319 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-04d7b056-f249-427f-b5fc-42aaf6ac7b3c tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:28.026429 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-04d7b056-f249-427f-b5fc-42aaf6ac7b3c tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:28.027442 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-04d7b056-f249-427f-b5fc-42aaf6ac7b3c tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:28.028680 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-04d7b056-f249-427f-b5fc-42aaf6ac7b3c tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:28.445875 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-bb2e3844-d433-4eaf-8fc9-d254cdaa50d8 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46eb7f913d7e49f58af088102c5a06a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af9b29a1d1f488faf6e4dfd19055728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:28.462464 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-bb2e3844-d433-4eaf-8fc9-d254cdaa50d8 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] 10.222.0.33 "GET /compute/v2.1/servers/79de76d4-8a77-45a2-b29f-da2d04bc206a" status: 200 len: 1319 microversion: 2.1 time: 0.605187 Sep 23 04:53:28.464558 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2404/4945] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:27 2022] GET /compute/v2.1/servers/79de76d4-8a77-45a2-b29f-da2d04bc206a => generated 1319 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:28.485335 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d77b45d6-6331-41cd-afe2-5f7ffcdca215 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:28.493494 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d77b45d6-6331-41cd-afe2-5f7ffcdca215 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: 6174fd18-3f10-4034-85ee-32b05fde010f] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:28.502912 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d77b45d6-6331-41cd-afe2-5f7ffcdca215 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:28.503781 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d77b45d6-6331-41cd-afe2-5f7ffcdca215 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:28.505053 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d77b45d6-6331-41cd-afe2-5f7ffcdca215 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:28.506658 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d77b45d6-6331-41cd-afe2-5f7ffcdca215 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:28.510489 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d77b45d6-6331-41cd-afe2-5f7ffcdca215 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:28.513868 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d77b45d6-6331-41cd-afe2-5f7ffcdca215 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:28.522959 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-04d7b056-f249-427f-b5fc-42aaf6ac7b3c tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:28.535577 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-04d7b056-f249-427f-b5fc-42aaf6ac7b3c tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:28.537969 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-04d7b056-f249-427f-b5fc-42aaf6ac7b3c tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:28.539530 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-04d7b056-f249-427f-b5fc-42aaf6ac7b3c tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141" status: 200 len: 1731 microversion: 2.20 time: 0.539729 Sep 23 04:53:28.540387 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2542/4946] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:53:27 2022] GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141 => generated 1731 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:53:28.671982 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9454d1ca-35bb-446c-a0e2-7136e3b141d1 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:28.672520 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-9454d1ca-35bb-446c-a0e2-7136e3b141d1 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 4381aca2-ea30-4473-9cd3-18c9b64f1937] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:28.682477 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9454d1ca-35bb-446c-a0e2-7136e3b141d1 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:28.682837 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9454d1ca-35bb-446c-a0e2-7136e3b141d1 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:28.690978 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9454d1ca-35bb-446c-a0e2-7136e3b141d1 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:28.692671 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9454d1ca-35bb-446c-a0e2-7136e3b141d1 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:28.693368 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9454d1ca-35bb-446c-a0e2-7136e3b141d1 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:28.694112 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9454d1ca-35bb-446c-a0e2-7136e3b141d1 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:28.882718 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d77b45d6-6331-41cd-afe2-5f7ffcdca215 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:28.903332 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d77b45d6-6331-41cd-afe2-5f7ffcdca215 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f" status: 200 len: 1318 microversion: 2.1 time: 0.435533 Sep 23 04:53:28.903925 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2405/4947] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:28 2022] GET /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f => generated 1318 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:28.908722 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8d3fa1e5-278d-4b13-82ec-8b376929101c tempest-VolumesGetTestJSON-132623442 tempest-VolumesGetTestJSON-132623442-project] Calling method '.version_select at 0x7ff1bb948670>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:28.995859 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8d3fa1e5-278d-4b13-82ec-8b376929101c tempest-VolumesGetTestJSON-132623442 tempest-VolumesGetTestJSON-132623442-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/27de227f-0448-4096-bf80-18339a0c4ec2" status: 200 len: 351 microversion: 2.1 time: 0.090658 Sep 23 04:53:28.996958 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2406/4948] 10.222.0.33 () {58 vars in 1245 bytes} [Fri Sep 23 04:53:28 2022] GET /compute/v2.1/os-volumes/27de227f-0448-4096-bf80-18339a0c4ec2 => generated 351 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:53:29.001698 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d3887d1c-5ec1-4e43-b253-62075bf74695 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:29.002608 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d3887d1c-5ec1-4e43-b253-62075bf74695 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 9dc683ca-0f6d-42d9-bf36-5bb1a5cc3286] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:29.009309 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d3887d1c-5ec1-4e43-b253-62075bf74695 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:29.010176 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d3887d1c-5ec1-4e43-b253-62075bf74695 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:29.011465 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d3887d1c-5ec1-4e43-b253-62075bf74695 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:29.012430 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d3887d1c-5ec1-4e43-b253-62075bf74695 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:29.013122 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d3887d1c-5ec1-4e43-b253-62075bf74695 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:29.013777 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d3887d1c-5ec1-4e43-b253-62075bf74695 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:29.058193 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-9454d1ca-35bb-446c-a0e2-7136e3b141d1 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:29.067591 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-9454d1ca-35bb-446c-a0e2-7136e3b141d1 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937" status: 200 len: 1392 microversion: 2.1 time: 0.399398 Sep 23 04:53:29.082773 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2543/4949] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:28 2022] GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937 => generated 1392 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:53:29.094737 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-31192c3e-461a-4845-a672-c8229580248f req-dfe57482-62b7-4d46-b30a-851d80f6aa6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8243026d-51c6-4be3-b91b-4487474eb19a", "name": "network-vif-plugged", "status": "completed", "tag": "6b424dce-3332-4dca-a4a4-4441e71f6301"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:53:29.111527 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-31192c3e-461a-4845-a672-c8229580248f req-dfe57482-62b7-4d46-b30a-851d80f6aa6d service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:29.111527 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-31192c3e-461a-4845-a672-c8229580248f req-dfe57482-62b7-4d46-b30a-851d80f6aa6d service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:29.111527 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-31192c3e-461a-4845-a672-c8229580248f req-dfe57482-62b7-4d46-b30a-851d80f6aa6d service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:29.131631 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-31192c3e-461a-4845-a672-c8229580248f req-dfe57482-62b7-4d46-b30a-851d80f6aa6d service nova] Creating event network-vif-plugged:6b424dce-3332-4dca-a4a4-4441e71f6301 for instance 8243026d-51c6-4be3-b91b-4487474eb19a on n-h1-846463-3 Sep 23 04:53:29.144678 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-31192c3e-461a-4845-a672-c8229580248f req-dfe57482-62b7-4d46-b30a-851d80f6aa6d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054299 Sep 23 04:53:29.151689 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2544/4950] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:53:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:53:29.322414 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d3887d1c-5ec1-4e43-b253-62075bf74695 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:29.329845 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d3887d1c-5ec1-4e43-b253-62075bf74695 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/9dc683ca-0f6d-42d9-bf36-5bb1a5cc3286" status: 200 len: 1315 microversion: 2.1 time: 0.331557 Sep 23 04:53:29.339920 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2407/4951] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:28 2022] GET /compute/v2.1/servers/9dc683ca-0f6d-42d9-bf36-5bb1a5cc3286 => generated 1315 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:29.495094 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-90ac5096-e23c-46f8-bf6e-2819c4c28a7a tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:29.497779 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-90ac5096-e23c-46f8-bf6e-2819c4c28a7a tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] [instance: 79de76d4-8a77-45a2-b29f-da2d04bc206a] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:29.515986 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-90ac5096-e23c-46f8-bf6e-2819c4c28a7a tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:29.516494 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-90ac5096-e23c-46f8-bf6e-2819c4c28a7a tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:29.516936 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-90ac5096-e23c-46f8-bf6e-2819c4c28a7a tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:29.517641 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-90ac5096-e23c-46f8-bf6e-2819c4c28a7a tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:29.518123 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-90ac5096-e23c-46f8-bf6e-2819c4c28a7a tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:29.518599 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-90ac5096-e23c-46f8-bf6e-2819c4c28a7a tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:29.575078 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4c92a467-192e-4f2b-88ac-a2b70e1d39df tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:29.576127 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4c92a467-192e-4f2b-88ac-a2b70e1d39df tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: f285e256-0a0e-4126-8adf-643bd59ca141] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:29.583405 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=6 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:53:29.585594 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4c92a467-192e-4f2b-88ac-a2b70e1d39df tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:29.586372 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4c92a467-192e-4f2b-88ac-a2b70e1d39df tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:29.587088 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4c92a467-192e-4f2b-88ac-a2b70e1d39df tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:29.588375 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4c92a467-192e-4f2b-88ac-a2b70e1d39df tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:29.589505 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4c92a467-192e-4f2b-88ac-a2b70e1d39df tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:29.590176 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4c92a467-192e-4f2b-88ac-a2b70e1d39df tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:29.788431 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-90ac5096-e23c-46f8-bf6e-2819c4c28a7a tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46eb7f913d7e49f58af088102c5a06a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af9b29a1d1f488faf6e4dfd19055728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:29.797036 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-90ac5096-e23c-46f8-bf6e-2819c4c28a7a tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] 10.222.0.33 "GET /compute/v2.1/servers/79de76d4-8a77-45a2-b29f-da2d04bc206a" status: 200 len: 1506 microversion: 2.1 time: 0.307631 Sep 23 04:53:29.802250 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2545/4952] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:29 2022] GET /compute/v2.1/servers/79de76d4-8a77-45a2-b29f-da2d04bc206a => generated 1506 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:29.814274 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4c92a467-192e-4f2b-88ac-a2b70e1d39df tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:29.823802 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4c92a467-192e-4f2b-88ac-a2b70e1d39df tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:29.825617 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4c92a467-192e-4f2b-88ac-a2b70e1d39df tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:29.825765 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-45d0cd89-c27f-43f5-ac6c-60931804aeac tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:29.826417 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-45d0cd89-c27f-43f5-ac6c-60931804aeac tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] [instance: 8243026d-51c6-4be3-b91b-4487474eb19a] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:29.826846 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4c92a467-192e-4f2b-88ac-a2b70e1d39df tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141" status: 200 len: 1718 microversion: 2.20 time: 0.256770 Sep 23 04:53:29.827648 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2408/4953] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:53:29 2022] GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141 => generated 1718 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:53:29.832742 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-45d0cd89-c27f-43f5-ac6c-60931804aeac tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:29.833240 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-45d0cd89-c27f-43f5-ac6c-60931804aeac tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:29.833687 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-45d0cd89-c27f-43f5-ac6c-60931804aeac tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:29.834429 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-45d0cd89-c27f-43f5-ac6c-60931804aeac tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:29.834892 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-45d0cd89-c27f-43f5-ac6c-60931804aeac tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:29.835324 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-45d0cd89-c27f-43f5-ac6c-60931804aeac tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:29.940255 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c254b3fa-69a2-4d20-8a6b-c38abc115b1d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:29.940255 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c254b3fa-69a2-4d20-8a6b-c38abc115b1d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: 6174fd18-3f10-4034-85ee-32b05fde010f] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:29.954195 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c254b3fa-69a2-4d20-8a6b-c38abc115b1d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:29.954899 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c254b3fa-69a2-4d20-8a6b-c38abc115b1d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:29.955789 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c254b3fa-69a2-4d20-8a6b-c38abc115b1d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:29.957987 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c254b3fa-69a2-4d20-8a6b-c38abc115b1d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:29.959546 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c254b3fa-69a2-4d20-8a6b-c38abc115b1d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:29.961406 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c254b3fa-69a2-4d20-8a6b-c38abc115b1d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:29.999743 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=100 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:53:30.051471 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-45d0cd89-c27f-43f5-ac6c-60931804aeac tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46eb7f913d7e49f58af088102c5a06a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af9b29a1d1f488faf6e4dfd19055728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:30.060801 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-45d0cd89-c27f-43f5-ac6c-60931804aeac tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] 10.222.0.33 "GET /compute/v2.1/servers/8243026d-51c6-4be3-b91b-4487474eb19a" status: 200 len: 1319 microversion: 2.1 time: 0.242756 Sep 23 04:53:30.075092 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2546/4954] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:29 2022] GET /compute/v2.1/servers/8243026d-51c6-4be3-b91b-4487474eb19a => generated 1319 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:30.086432 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-06bc3f40-244a-404c-ac54-3b5addc14516 tempest-VolumesGetTestJSON-132623442 tempest-VolumesGetTestJSON-132623442-project] Calling method '.version_select at 0x7ff1ba8a2b80>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:30.130771 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-06bc3f40-244a-404c-ac54-3b5addc14516 tempest-VolumesGetTestJSON-132623442 tempest-VolumesGetTestJSON-132623442-project] HTTP exception thrown: Volume 27de227f-0448-4096-bf80-18339a0c4ec2 could not be found. Sep 23 04:53:30.133220 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-06bc3f40-244a-404c-ac54-3b5addc14516 tempest-VolumesGetTestJSON-132623442 tempest-VolumesGetTestJSON-132623442-project] Request method failure captured: Sep 23 04:53:30.133220 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/os-volumes/27de227f-0448-4096-bf80-18339a0c4ec2 HTTP/1.1 Sep 23 04:53:30.133220 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:53:30.133220 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:53:30.133220 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:53:30.133220 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:53:30.133220 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:53:30.133220 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:53:30.133220 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:53:30.133220 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:53:30.133220 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTvC7j6Eg8lGx1tVWe3ZC4V_7OEF5bUHclb3fveydzXMqsrAFg0RbI0n8lwpIabuVSQfIhqIFdteL4WV0rEXr8aVYgEXK6mS9dKzM4zCucxqo_R5GyWrGiuxC7uvLTi_aRXRblLdPygyqGgEQAOQIkVbK8ysd128VxidXkzPbo3PCTQ Sep 23 04:53:30.133220 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:53:30.133220 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:53:30.133220 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:53:30.133220 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:53:30.133220 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:53:30.133220 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:53:30.133220 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 7a32518e3ae94db7879b379bb291c294 Sep 23 04:53:30.133220 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-VolumesGetTestJSON-132623442 Sep 23 04:53:30.133220 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:53:30.133220 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:53:30.133220 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7a32518e3ae94db7879b379bb291c294", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7a32518e3ae94db7879b379bb291c294"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7a32518e3ae94db7879b379bb291c294"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7a32518e3ae94db7879b379bb291c294"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:53:30.133220 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-VolumesGetTestJSON-132623442 Sep 23 04:53:30.133220 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 7a32518e3ae94db7879b379bb291c294 Sep 23 04:53:30.133220 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-VolumesGetTestJSON-132623442 Sep 23 04:53:30.133220 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-VolumesGetTestJSON-132623442-project Sep 23 04:53:30.133220 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:53:30.133220 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:53:30.133220 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: ba46472e716b402d9fb959f6ccc3080f Sep 23 04:53:30.133220 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-VolumesGetTestJSON-132623442-project Sep 23 04:53:30.133220 n-d-846463-3 devstack@n-api.service[122699]: method: Sep 23 04:53:30.133220 n-d-846463-3 devstack@n-api.service[122699]: exception: Volume 27de227f-0448-4096-bf80-18339a0c4ec2 could not be found. Sep 23 04:53:30.133220 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '27de227f-0448-4096-bf80-18339a0c4ec2'} Sep 23 04:53:30.133220 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:53:30.133220 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:53:30.133220 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 23 04:53:30.133220 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 23 04:53:30.133220 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 23 04:53:30.133220 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 23 04:53:30.133220 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 23 04:53:30.133220 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 23 04:53:30.133220 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 23 04:53:30.133220 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 23 04:53:30.133220 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 23 04:53:30.133220 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 23 04:53:30.133220 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 23 04:53:30.133220 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 23 04:53:30.133220 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 23 04:53:30.133220 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 23 04:53:30.133220 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 27de227f-0448-4096-bf80-18339a0c4ec2 could not be found. (HTTP 404) (Request-ID: req-76d64709-d486-490c-93bd-cd1c0d842319) Sep 23 04:53:30.133220 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:53:30.133220 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:53:30.133220 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:53:30.133220 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:53:30.133220 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 23 04:53:30.133220 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 23 04:53:30.133220 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 23 04:53:30.133220 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 23 04:53:30.133220 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 23 04:53:30.133220 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 23 04:53:30.133220 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 23 04:53:30.133220 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 23 04:53:30.133220 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 23 04:53:30.138486 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 23 04:53:30.138486 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 23 04:53:30.138486 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 23 04:53:30.138486 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 23 04:53:30.138486 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 23 04:53:30.138486 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 23 04:53:30.138486 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 23 04:53:30.138486 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 23 04:53:30.138486 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 23 04:53:30.138486 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 23 04:53:30.138486 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 23 04:53:30.138486 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 23 04:53:30.138486 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 23 04:53:30.138486 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 27de227f-0448-4096-bf80-18339a0c4ec2 could not be found. Sep 23 04:53:30.138486 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:53:30.138486 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:53:30.138486 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:53:30.138486 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:53:30.138486 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:53:30.138486 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:53:30.138486 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:53:30.138486 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:53:30.138486 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 04:53:30.138486 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 04:53:30.138486 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:53:30.138486 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:53:30.138486 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 23 04:53:30.138486 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:53:30.138486 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 27de227f-0448-4096-bf80-18339a0c4ec2 could not be found. Sep 23 04:53:30.138486 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:53:30.138486 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:53:30.138486 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:53:30.138486 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:53:30.138486 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:53:30.138486 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:53:30.138486 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:53:30.138486 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:53:30.138486 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 27de227f-0448-4096-bf80-18339a0c4ec2 could not be found. Sep 23 04:53:30.138486 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:53:30.138486 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-06bc3f40-244a-404c-ac54-3b5addc14516 tempest-VolumesGetTestJSON-132623442 tempest-VolumesGetTestJSON-132623442-project] Returning 404 to user: Volume 27de227f-0448-4096-bf80-18339a0c4ec2 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:53:30.138486 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-06bc3f40-244a-404c-ac54-3b5addc14516 tempest-VolumesGetTestJSON-132623442 tempest-VolumesGetTestJSON-132623442-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/27de227f-0448-4096-bf80-18339a0c4ec2" status: 404 len: 109 microversion: 2.1 time: 0.058567 Sep 23 04:53:30.138486 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2547/4955] 10.222.0.33 () {58 vars in 1245 bytes} [Fri Sep 23 04:53:30 2022] GET /compute/v2.1/os-volumes/27de227f-0448-4096-bf80-18339a0c4ec2 => generated 109 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:53:30.146589 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-b55b5e5d-4502-4030-ad37-3dd9b58fe94a req-773038b1-81f8-48cf-bf80-a74b291c48bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6174fd18-3f10-4034-85ee-32b05fde010f", "tag": "d59a64b4-b8c2-44d3-90e0-14542ae01845"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:53:30.170063 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-b55b5e5d-4502-4030-ad37-3dd9b58fe94a req-773038b1-81f8-48cf-bf80-a74b291c48bb service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:30.174992 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-b55b5e5d-4502-4030-ad37-3dd9b58fe94a req-773038b1-81f8-48cf-bf80-a74b291c48bb service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:30.174992 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-b55b5e5d-4502-4030-ad37-3dd9b58fe94a req-773038b1-81f8-48cf-bf80-a74b291c48bb service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:30.197228 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-b55b5e5d-4502-4030-ad37-3dd9b58fe94a req-773038b1-81f8-48cf-bf80-a74b291c48bb service nova] Creating event network-changed:d59a64b4-b8c2-44d3-90e0-14542ae01845 for instance 6174fd18-3f10-4034-85ee-32b05fde010f on n-h2-846463-3 Sep 23 04:53:30.218188 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-b55b5e5d-4502-4030-ad37-3dd9b58fe94a req-773038b1-81f8-48cf-bf80-a74b291c48bb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081202 Sep 23 04:53:30.219012 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2548/4956] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:53:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:53:30.224123 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e13afd0d-2b17-4003-87f2-842f7ef0592e tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:30.225226 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e13afd0d-2b17-4003-87f2-842f7ef0592e tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 4381aca2-ea30-4473-9cd3-18c9b64f1937] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:30.232373 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c254b3fa-69a2-4d20-8a6b-c38abc115b1d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:30.241969 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c254b3fa-69a2-4d20-8a6b-c38abc115b1d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f" status: 200 len: 1318 microversion: 2.1 time: 0.311196 Sep 23 04:53:30.243213 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e13afd0d-2b17-4003-87f2-842f7ef0592e tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:30.243442 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2409/4957] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:29 2022] GET /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f => generated 1318 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:53:30.243641 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e13afd0d-2b17-4003-87f2-842f7ef0592e tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:30.244075 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e13afd0d-2b17-4003-87f2-842f7ef0592e tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:30.246338 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e13afd0d-2b17-4003-87f2-842f7ef0592e tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:30.248797 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e13afd0d-2b17-4003-87f2-842f7ef0592e tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:30.248797 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e13afd0d-2b17-4003-87f2-842f7ef0592e tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:30.365670 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d164cbcd-8514-44d4-a9f6-7a47b511471b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:30.366880 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d164cbcd-8514-44d4-a9f6-7a47b511471b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 9dc683ca-0f6d-42d9-bf36-5bb1a5cc3286] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:30.376776 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d164cbcd-8514-44d4-a9f6-7a47b511471b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:30.377505 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d164cbcd-8514-44d4-a9f6-7a47b511471b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:30.378172 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d164cbcd-8514-44d4-a9f6-7a47b511471b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:30.379007 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d164cbcd-8514-44d4-a9f6-7a47b511471b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:30.379476 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d164cbcd-8514-44d4-a9f6-7a47b511471b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:30.389880 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d164cbcd-8514-44d4-a9f6-7a47b511471b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:30.468822 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e13afd0d-2b17-4003-87f2-842f7ef0592e tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:30.476695 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e13afd0d-2b17-4003-87f2-842f7ef0592e tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937" status: 200 len: 1392 microversion: 2.1 time: 0.256470 Sep 23 04:53:30.494194 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2549/4958] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:30 2022] GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937 => generated 1392 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:30.609405 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d164cbcd-8514-44d4-a9f6-7a47b511471b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:30.618301 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d164cbcd-8514-44d4-a9f6-7a47b511471b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/9dc683ca-0f6d-42d9-bf36-5bb1a5cc3286" status: 200 len: 1315 microversion: 2.1 time: 0.258584 Sep 23 04:53:30.648687 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2410/4959] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:30 2022] GET /compute/v2.1/servers/9dc683ca-0f6d-42d9-bf36-5bb1a5cc3286 => generated 1315 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:53:31.091826 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d0b0922f-48ba-45f7-9c39-2400a9c54889 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:31.092448 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d0b0922f-48ba-45f7-9c39-2400a9c54889 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] [instance: 8243026d-51c6-4be3-b91b-4487474eb19a] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:31.102599 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d0b0922f-48ba-45f7-9c39-2400a9c54889 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:31.102996 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d0b0922f-48ba-45f7-9c39-2400a9c54889 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:31.103524 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d0b0922f-48ba-45f7-9c39-2400a9c54889 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:31.107299 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d0b0922f-48ba-45f7-9c39-2400a9c54889 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:31.108090 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d0b0922f-48ba-45f7-9c39-2400a9c54889 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:31.109395 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d0b0922f-48ba-45f7-9c39-2400a9c54889 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:31.274630 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f3e05be1-a004-4600-9fcf-a9bfc3537d34 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:31.281691 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f3e05be1-a004-4600-9fcf-a9bfc3537d34 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: 6174fd18-3f10-4034-85ee-32b05fde010f] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:31.288832 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f3e05be1-a004-4600-9fcf-a9bfc3537d34 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:31.289660 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f3e05be1-a004-4600-9fcf-a9bfc3537d34 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:31.290339 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f3e05be1-a004-4600-9fcf-a9bfc3537d34 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:31.291319 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f3e05be1-a004-4600-9fcf-a9bfc3537d34 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:31.292543 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f3e05be1-a004-4600-9fcf-a9bfc3537d34 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:31.293210 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f3e05be1-a004-4600-9fcf-a9bfc3537d34 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:31.340735 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d0b0922f-48ba-45f7-9c39-2400a9c54889 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46eb7f913d7e49f58af088102c5a06a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af9b29a1d1f488faf6e4dfd19055728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:31.353444 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d0b0922f-48ba-45f7-9c39-2400a9c54889 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] 10.222.0.33 "GET /compute/v2.1/servers/8243026d-51c6-4be3-b91b-4487474eb19a" status: 200 len: 1507 microversion: 2.1 time: 0.266609 Sep 23 04:53:31.356823 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2550/4960] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:31 2022] GET /compute/v2.1/servers/8243026d-51c6-4be3-b91b-4487474eb19a => generated 1507 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:31.379156 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2eafa500-f046-476f-89f8-cd96b1284f05 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:31.379654 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-2eafa500-f046-476f-89f8-cd96b1284f05 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] [instance: 8243026d-51c6-4be3-b91b-4487474eb19a] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:31.394568 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2eafa500-f046-476f-89f8-cd96b1284f05 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:31.395089 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2eafa500-f046-476f-89f8-cd96b1284f05 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:31.395537 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2eafa500-f046-476f-89f8-cd96b1284f05 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:31.396276 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2eafa500-f046-476f-89f8-cd96b1284f05 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:31.396724 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2eafa500-f046-476f-89f8-cd96b1284f05 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:31.403164 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2eafa500-f046-476f-89f8-cd96b1284f05 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:31.427686 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:53:31.460819 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-2eafa500-f046-476f-89f8-cd96b1284f05 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] [instance: 8243026d-51c6-4be3-b91b-4487474eb19a] Going to try to terminate instance {{(pid=122699) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:53:31.472869 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=8 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:53:31.549999 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f3e05be1-a004-4600-9fcf-a9bfc3537d34 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:31.559548 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f3e05be1-a004-4600-9fcf-a9bfc3537d34 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f" status: 200 len: 1318 microversion: 2.1 time: 0.289016 Sep 23 04:53:31.560385 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2411/4961] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:31 2022] GET /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f => generated 1318 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:53:31.564957 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f981ffc5-2cac-4e61-869c-7b3220651c83 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:31.565575 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f981ffc5-2cac-4e61-869c-7b3220651c83 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 4381aca2-ea30-4473-9cd3-18c9b64f1937] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:31.572004 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f981ffc5-2cac-4e61-869c-7b3220651c83 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:31.572507 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f981ffc5-2cac-4e61-869c-7b3220651c83 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:31.572989 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f981ffc5-2cac-4e61-869c-7b3220651c83 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:31.573695 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f981ffc5-2cac-4e61-869c-7b3220651c83 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:31.574555 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f981ffc5-2cac-4e61-869c-7b3220651c83 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:31.574971 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f981ffc5-2cac-4e61-869c-7b3220651c83 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:31.725029 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f981ffc5-2cac-4e61-869c-7b3220651c83 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:31.738915 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f981ffc5-2cac-4e61-869c-7b3220651c83 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937" status: 200 len: 1392 microversion: 2.1 time: 0.177428 Sep 23 04:53:31.739524 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2412/4962] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:31 2022] GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937 => generated 1392 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:31.754080 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4a1ac62d-e3b2-49a3-b45c-ecb2eddc20a8 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:31.754080 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4a1ac62d-e3b2-49a3-b45c-ecb2eddc20a8 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 9dc683ca-0f6d-42d9-bf36-5bb1a5cc3286] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:31.754080 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4a1ac62d-e3b2-49a3-b45c-ecb2eddc20a8 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:31.754080 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4a1ac62d-e3b2-49a3-b45c-ecb2eddc20a8 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:31.754080 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4a1ac62d-e3b2-49a3-b45c-ecb2eddc20a8 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:31.754080 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4a1ac62d-e3b2-49a3-b45c-ecb2eddc20a8 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:31.755089 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4a1ac62d-e3b2-49a3-b45c-ecb2eddc20a8 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:31.755089 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4a1ac62d-e3b2-49a3-b45c-ecb2eddc20a8 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:31.902498 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4a1ac62d-e3b2-49a3-b45c-ecb2eddc20a8 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:31.911523 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4a1ac62d-e3b2-49a3-b45c-ecb2eddc20a8 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/9dc683ca-0f6d-42d9-bf36-5bb1a5cc3286" status: 200 len: 1315 microversion: 2.1 time: 0.170927 Sep 23 04:53:31.919906 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2413/4963] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:31 2022] GET /compute/v2.1/servers/9dc683ca-0f6d-42d9-bf36-5bb1a5cc3286 => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:31.922033 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2eafa500-f046-476f-89f8-cd96b1284f05 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] 10.222.0.33 "DELETE /compute/v2.1/servers/8243026d-51c6-4be3-b91b-4487474eb19a" status: 204 len: 0 microversion: 2.1 time: 0.546383 Sep 23 04:53:31.922920 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2551/4964] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:53:31 2022] DELETE /compute/v2.1/servers/8243026d-51c6-4be3-b91b-4487474eb19a => generated 0 bytes in 548 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:53:31.934423 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-6cfaabde-a3ff-4b5a-8b01-1bc7630d2626 req-a6e5d845-2950-4767-9536-b53637e93340 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4381aca2-ea30-4473-9cd3-18c9b64f1937", "name": "network-vif-plugged", "status": "completed", "tag": "bc06dfe2-49c9-4f61-b1e4-e3d76533aa0c"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:53:31.936801 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b1d5d528-9f27-4654-a03b-ec0f6cc5cdf7 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:31.937389 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b1d5d528-9f27-4654-a03b-ec0f6cc5cdf7 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] [instance: 79de76d4-8a77-45a2-b29f-da2d04bc206a] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:31.944290 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-6cfaabde-a3ff-4b5a-8b01-1bc7630d2626 req-a6e5d845-2950-4767-9536-b53637e93340 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:31.944790 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-6cfaabde-a3ff-4b5a-8b01-1bc7630d2626 req-a6e5d845-2950-4767-9536-b53637e93340 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:31.945221 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-6cfaabde-a3ff-4b5a-8b01-1bc7630d2626 req-a6e5d845-2950-4767-9536-b53637e93340 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:31.948600 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b1d5d528-9f27-4654-a03b-ec0f6cc5cdf7 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:31.949131 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b1d5d528-9f27-4654-a03b-ec0f6cc5cdf7 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:31.949580 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b1d5d528-9f27-4654-a03b-ec0f6cc5cdf7 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:31.950333 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b1d5d528-9f27-4654-a03b-ec0f6cc5cdf7 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:31.951581 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b1d5d528-9f27-4654-a03b-ec0f6cc5cdf7 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:31.951581 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b1d5d528-9f27-4654-a03b-ec0f6cc5cdf7 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:31.959277 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-6cfaabde-a3ff-4b5a-8b01-1bc7630d2626 req-a6e5d845-2950-4767-9536-b53637e93340 service nova] Creating event network-vif-plugged:bc06dfe2-49c9-4f61-b1e4-e3d76533aa0c for instance 4381aca2-ea30-4473-9cd3-18c9b64f1937 on n-h1-846463-3 Sep 23 04:53:31.964668 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-6cfaabde-a3ff-4b5a-8b01-1bc7630d2626 req-a6e5d845-2950-4767-9536-b53637e93340 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043278 Sep 23 04:53:31.965941 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2414/4965] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:53:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:53:31.978022 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b1d5d528-9f27-4654-a03b-ec0f6cc5cdf7 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] [instance: 79de76d4-8a77-45a2-b29f-da2d04bc206a] Going to try to terminate instance {{(pid=122699) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:53:32.327411 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b1d5d528-9f27-4654-a03b-ec0f6cc5cdf7 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] 10.222.0.33 "DELETE /compute/v2.1/servers/79de76d4-8a77-45a2-b29f-da2d04bc206a" status: 204 len: 0 microversion: 2.1 time: 0.395170 Sep 23 04:53:32.328304 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2552/4966] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:53:31 2022] DELETE /compute/v2.1/servers/79de76d4-8a77-45a2-b29f-da2d04bc206a => generated 0 bytes in 397 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 23 04:53:32.445040 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=22 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:53:32.449539 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7a214cb0-93d5-42cf-89b4-69902b61abac tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-288035315", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "e3a115a5-ad80-4cd0-8aec-efdb4c3b4758"}]}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:53:32.507660 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.network.neutron [None req-7a214cb0-93d5-42cf-89b4-69902b61abac tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] validate_networks() for [('e3a115a5-ad80-4cd0-8aec-efdb4c3b4758', None, None, None, None, None)] {{(pid=122698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:53:32.585931 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a9a44736-7b72-425f-af71-1fd490d46f01 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:32.586601 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a9a44736-7b72-425f-af71-1fd490d46f01 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: 6174fd18-3f10-4034-85ee-32b05fde010f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:32.596199 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a9a44736-7b72-425f-af71-1fd490d46f01 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:32.596975 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a9a44736-7b72-425f-af71-1fd490d46f01 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:32.597620 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a9a44736-7b72-425f-af71-1fd490d46f01 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:32.598548 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a9a44736-7b72-425f-af71-1fd490d46f01 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:32.599181 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a9a44736-7b72-425f-af71-1fd490d46f01 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:32.599782 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a9a44736-7b72-425f-af71-1fd490d46f01 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:32.874889 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a9a44736-7b72-425f-af71-1fd490d46f01 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:32.885764 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a9a44736-7b72-425f-af71-1fd490d46f01 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f" status: 200 len: 1318 microversion: 2.1 time: 0.302813 Sep 23 04:53:32.886405 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2553/4967] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:32 2022] GET /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f => generated 1318 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:32.891349 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a60ed154-7de6-4d93-bc92-77438115b0e4 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:32.892205 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a60ed154-7de6-4d93-bc92-77438115b0e4 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 4381aca2-ea30-4473-9cd3-18c9b64f1937] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:32.898375 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a60ed154-7de6-4d93-bc92-77438115b0e4 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:32.899074 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a60ed154-7de6-4d93-bc92-77438115b0e4 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:32.899594 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a60ed154-7de6-4d93-bc92-77438115b0e4 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:32.900368 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a60ed154-7de6-4d93-bc92-77438115b0e4 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:32.901529 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a60ed154-7de6-4d93-bc92-77438115b0e4 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:32.909273 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a60ed154-7de6-4d93-bc92-77438115b0e4 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:33.093536 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-7a214cb0-93d5-42cf-89b4-69902b61abac tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Flavor limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:53:33.094148 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-7a214cb0-93d5-42cf-89b4-69902b61abac tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Image limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:53:33.095375 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-7a214cb0-93d5-42cf-89b4-69902b61abac tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Flavor pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:53:33.095859 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-7a214cb0-93d5-42cf-89b4-69902b61abac tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Image pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:53:33.096318 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-7a214cb0-93d5-42cf-89b4-69902b61abac tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:53:33.107120 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7a214cb0-93d5-42cf-89b4-69902b61abac tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:33.107810 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7a214cb0-93d5-42cf-89b4-69902b61abac tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:33.108252 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7a214cb0-93d5-42cf-89b4-69902b61abac tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:33.115765 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7a214cb0-93d5-42cf-89b4-69902b61abac tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:33.115765 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7a214cb0-93d5-42cf-89b4-69902b61abac tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:33.115765 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7a214cb0-93d5-42cf-89b4-69902b61abac tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:33.130425 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-7a214cb0-93d5-42cf-89b4-69902b61abac tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Getting quotas for project 2af9b29a1d1f488faf6e4dfd19055728. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:53:33.136265 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-7a214cb0-93d5-42cf-89b4-69902b61abac tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Getting quotas for user 46eb7f913d7e49f58af088102c5a06a7 and project 2af9b29a1d1f488faf6e4dfd19055728. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:53:33.140253 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a60ed154-7de6-4d93-bc92-77438115b0e4 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:33.150046 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7a214cb0-93d5-42cf-89b4-69902b61abac tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Going to run 2 instances... {{(pid=122698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:53:33.153323 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7a214cb0-93d5-42cf-89b4-69902b61abac tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] [instance: 3ee5730a-e4f9-4dea-89ce-dafaef4989bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:53:33.156426 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:53:33.159258 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a60ed154-7de6-4d93-bc92-77438115b0e4 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937" status: 200 len: 1392 microversion: 2.1 time: 0.271599 Sep 23 04:53:33.160138 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2554/4968] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:32 2022] GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937 => generated 1392 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:33.166238 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-eb92e51b-37cb-493f-aa92-e66a9284c28f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:33.166965 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-eb92e51b-37cb-493f-aa92-e66a9284c28f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 9dc683ca-0f6d-42d9-bf36-5bb1a5cc3286] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:33.173536 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eb92e51b-37cb-493f-aa92-e66a9284c28f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:33.174084 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eb92e51b-37cb-493f-aa92-e66a9284c28f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:33.174522 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eb92e51b-37cb-493f-aa92-e66a9284c28f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:33.175409 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eb92e51b-37cb-493f-aa92-e66a9284c28f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:33.175864 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eb92e51b-37cb-493f-aa92-e66a9284c28f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:33.176296 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eb92e51b-37cb-493f-aa92-e66a9284c28f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:33.313554 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-eb92e51b-37cb-493f-aa92-e66a9284c28f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:33.321478 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-eb92e51b-37cb-493f-aa92-e66a9284c28f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/9dc683ca-0f6d-42d9-bf36-5bb1a5cc3286" status: 200 len: 1315 microversion: 2.1 time: 0.160184 Sep 23 04:53:33.336500 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2555/4969] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:33 2022] GET /compute/v2.1/servers/9dc683ca-0f6d-42d9-bf36-5bb1a5cc3286 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:33.390095 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7a214cb0-93d5-42cf-89b4-69902b61abac tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] [instance: 8ee6c95b-4f74-4f70-a118-83886aebde43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=3ee5730a-e4f9-4dea-89ce-dafaef4989bf,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:53:33.582475 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7a214cb0-93d5-42cf-89b4-69902b61abac tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.138239 Sep 23 04:53:33.583166 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2415/4970] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:53:32 2022] POST /compute/v2.1/servers => generated 32 bytes in 1140 msecs (HTTP/1.1 202) 9 headers in 362 bytes (2 switches on core 0) Sep 23 04:53:33.591282 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c9cad28d-a944-4102-8a77-4eac826f3b11 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:33.597615 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c9cad28d-a944-4102-8a77-4eac826f3b11 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '46eb7f913d7e49f58af088102c5a06a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af9b29a1d1f488faf6e4dfd19055728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:33.598642 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c9cad28d-a944-4102-8a77-4eac826f3b11 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Searching by: {'deleted': False, 'project_id': '2af9b29a1d1f488faf6e4dfd19055728'} {{(pid=122699) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 04:53:33.617118 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c9cad28d-a944-4102-8a77-4eac826f3b11 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:33.617430 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c9cad28d-a944-4102-8a77-4eac826f3b11 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:33.617848 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c9cad28d-a944-4102-8a77-4eac826f3b11 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:33.618896 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c9cad28d-a944-4102-8a77-4eac826f3b11 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:33.619358 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c9cad28d-a944-4102-8a77-4eac826f3b11 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:33.620575 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c9cad28d-a944-4102-8a77-4eac826f3b11 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:33.656017 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.multi_cell_list [None req-c9cad28d-a944-4102-8a77-4eac826f3b11 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=122699) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 23 04:53:33.691611 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c9cad28d-a944-4102-8a77-4eac826f3b11 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 1333 microversion: 2.1 time: 0.103975 Sep 23 04:53:33.694027 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2556/4971] 10.222.0.33 () {58 vars in 1125 bytes} [Fri Sep 23 04:53:33 2022] GET /compute/v2.1/servers => generated 1333 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:33.706179 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5544f45b-b3a6-42b5-a87b-8ade79893d67 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:33.707134 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5544f45b-b3a6-42b5-a87b-8ade79893d67 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] [instance: 8ee6c95b-4f74-4f70-a118-83886aebde43] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:33.841760 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-5544f45b-b3a6-42b5-a87b-8ade79893d67 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46eb7f913d7e49f58af088102c5a06a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af9b29a1d1f488faf6e4dfd19055728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:33.854931 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5544f45b-b3a6-42b5-a87b-8ade79893d67 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] 10.222.0.33 "GET /compute/v2.1/servers/8ee6c95b-4f74-4f70-a118-83886aebde43" status: 200 len: 1217 microversion: 2.1 time: 0.150436 Sep 23 04:53:33.869745 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2416/4972] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:33 2022] GET /compute/v2.1/servers/8ee6c95b-4f74-4f70-a118-83886aebde43 => generated 1217 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:33.913660 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c8db0012-ed2d-49d4-b27d-0b859763312d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:33.913660 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c8db0012-ed2d-49d4-b27d-0b859763312d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: 6174fd18-3f10-4034-85ee-32b05fde010f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:33.919834 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c8db0012-ed2d-49d4-b27d-0b859763312d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:33.920346 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c8db0012-ed2d-49d4-b27d-0b859763312d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:33.920796 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c8db0012-ed2d-49d4-b27d-0b859763312d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:33.921515 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c8db0012-ed2d-49d4-b27d-0b859763312d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:33.922026 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c8db0012-ed2d-49d4-b27d-0b859763312d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:33.922461 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c8db0012-ed2d-49d4-b27d-0b859763312d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:34.183718 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8dc4a915-7a59-474b-9f73-8c3fa6eb956f tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:34.184493 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8dc4a915-7a59-474b-9f73-8c3fa6eb956f tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 4381aca2-ea30-4473-9cd3-18c9b64f1937] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:34.186675 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c8db0012-ed2d-49d4-b27d-0b859763312d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:34.195700 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c8db0012-ed2d-49d4-b27d-0b859763312d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f" status: 200 len: 1318 microversion: 2.1 time: 0.290102 Sep 23 04:53:34.196314 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2557/4973] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:33 2022] GET /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f => generated 1318 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:34.200761 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8dc4a915-7a59-474b-9f73-8c3fa6eb956f tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:34.201298 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8dc4a915-7a59-474b-9f73-8c3fa6eb956f tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:34.204428 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8dc4a915-7a59-474b-9f73-8c3fa6eb956f tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:34.206315 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8dc4a915-7a59-474b-9f73-8c3fa6eb956f tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:34.206804 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8dc4a915-7a59-474b-9f73-8c3fa6eb956f tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:34.207414 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8dc4a915-7a59-474b-9f73-8c3fa6eb956f tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:34.345215 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f511eca8-e313-40fc-96a3-89e25abd9fb5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:34.346751 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f511eca8-e313-40fc-96a3-89e25abd9fb5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 9dc683ca-0f6d-42d9-bf36-5bb1a5cc3286] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:34.358049 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f511eca8-e313-40fc-96a3-89e25abd9fb5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:34.361652 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f511eca8-e313-40fc-96a3-89e25abd9fb5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:34.363297 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f511eca8-e313-40fc-96a3-89e25abd9fb5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:34.364306 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f511eca8-e313-40fc-96a3-89e25abd9fb5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:34.367400 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f511eca8-e313-40fc-96a3-89e25abd9fb5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:34.368088 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f511eca8-e313-40fc-96a3-89e25abd9fb5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:34.743867 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8dc4a915-7a59-474b-9f73-8c3fa6eb956f tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:34.755788 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8dc4a915-7a59-474b-9f73-8c3fa6eb956f tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937" status: 200 len: 1392 microversion: 2.1 time: 0.576924 Sep 23 04:53:34.758942 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2417/4974] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:34 2022] GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937 => generated 1392 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:53:34.779384 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-bd851f26-ea43-4316-bb88-5c1ae092fda8 req-88adbf2e-e146-4e64-8e99-2dbe87eef1f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8243026d-51c6-4be3-b91b-4487474eb19a", "name": "network-vif-deleted", "tag": "6b424dce-3332-4dca-a4a4-4441e71f6301"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:53:34.807298 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-bd851f26-ea43-4316-bb88-5c1ae092fda8 req-88adbf2e-e146-4e64-8e99-2dbe87eef1f2 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:34.807778 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-bd851f26-ea43-4316-bb88-5c1ae092fda8 req-88adbf2e-e146-4e64-8e99-2dbe87eef1f2 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:34.816533 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-bd851f26-ea43-4316-bb88-5c1ae092fda8 req-88adbf2e-e146-4e64-8e99-2dbe87eef1f2 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:34.840727 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f511eca8-e313-40fc-96a3-89e25abd9fb5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:34.851174 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-bd851f26-ea43-4316-bb88-5c1ae092fda8 req-88adbf2e-e146-4e64-8e99-2dbe87eef1f2 service nova] Creating event network-vif-deleted:6b424dce-3332-4dca-a4a4-4441e71f6301 for instance 8243026d-51c6-4be3-b91b-4487474eb19a on n-h1-846463-3 Sep 23 04:53:34.861294 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f511eca8-e313-40fc-96a3-89e25abd9fb5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/9dc683ca-0f6d-42d9-bf36-5bb1a5cc3286" status: 200 len: 1315 microversion: 2.1 time: 0.520818 Sep 23 04:53:34.863138 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2558/4975] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:34 2022] GET /compute/v2.1/servers/9dc683ca-0f6d-42d9-bf36-5bb1a5cc3286 => generated 1315 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:34.882854 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-bd851f26-ea43-4316-bb88-5c1ae092fda8 req-88adbf2e-e146-4e64-8e99-2dbe87eef1f2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118484 Sep 23 04:53:34.883952 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2418/4976] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:53:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:53:34.893407 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-08814a5c-75f2-4a08-8a36-43352a771d6d tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:34.894188 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-08814a5c-75f2-4a08-8a36-43352a771d6d tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] [instance: 8ee6c95b-4f74-4f70-a118-83886aebde43] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:34.983193 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-08814a5c-75f2-4a08-8a36-43352a771d6d tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46eb7f913d7e49f58af088102c5a06a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af9b29a1d1f488faf6e4dfd19055728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:34.990832 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-08814a5c-75f2-4a08-8a36-43352a771d6d tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] 10.222.0.33 "GET /compute/v2.1/servers/8ee6c95b-4f74-4f70-a118-83886aebde43" status: 200 len: 1217 microversion: 2.1 time: 0.102397 Sep 23 04:53:34.991425 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2559/4977] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:34 2022] GET /compute/v2.1/servers/8ee6c95b-4f74-4f70-a118-83886aebde43 => generated 1217 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:53:35.237309 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-07b7f6b7-03b4-4539-aa1b-33b47238c404 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:35.241051 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-07b7f6b7-03b4-4539-aa1b-33b47238c404 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: 6174fd18-3f10-4034-85ee-32b05fde010f] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:35.250323 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-e4eb40ee-b998-436f-8644-86b4a27bef5d req-b8137445-a215-4cea-a6d0-5f0c26e3ff13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79de76d4-8a77-45a2-b29f-da2d04bc206a", "name": "network-vif-deleted", "tag": "6f074d0d-63d3-4a67-a5b5-418ee53e6c1d"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:53:35.264292 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-e4eb40ee-b998-436f-8644-86b4a27bef5d req-b8137445-a215-4cea-a6d0-5f0c26e3ff13 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:35.265144 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-e4eb40ee-b998-436f-8644-86b4a27bef5d req-b8137445-a215-4cea-a6d0-5f0c26e3ff13 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:35.266063 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-e4eb40ee-b998-436f-8644-86b4a27bef5d req-b8137445-a215-4cea-a6d0-5f0c26e3ff13 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:35.270454 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-07b7f6b7-03b4-4539-aa1b-33b47238c404 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:35.271061 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-07b7f6b7-03b4-4539-aa1b-33b47238c404 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:35.271483 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-07b7f6b7-03b4-4539-aa1b-33b47238c404 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:35.279984 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-07b7f6b7-03b4-4539-aa1b-33b47238c404 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:35.280671 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-07b7f6b7-03b4-4539-aa1b-33b47238c404 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:35.282978 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-e4eb40ee-b998-436f-8644-86b4a27bef5d req-b8137445-a215-4cea-a6d0-5f0c26e3ff13 service nova] Creating event network-vif-deleted:6f074d0d-63d3-4a67-a5b5-418ee53e6c1d for instance 79de76d4-8a77-45a2-b29f-da2d04bc206a on n-h2-846463-3 Sep 23 04:53:35.286402 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-07b7f6b7-03b4-4539-aa1b-33b47238c404 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:35.291942 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-e4eb40ee-b998-436f-8644-86b4a27bef5d req-b8137445-a215-4cea-a6d0-5f0c26e3ff13 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045422 Sep 23 04:53:35.298618 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2560/4978] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:53:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:53:35.567687 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-07b7f6b7-03b4-4539-aa1b-33b47238c404 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:35.575654 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-07b7f6b7-03b4-4539-aa1b-33b47238c404 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f" status: 200 len: 1318 microversion: 2.1 time: 0.359405 Sep 23 04:53:35.576847 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2419/4979] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:35 2022] GET /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f => generated 1318 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:35.784846 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e2c09b44-7d5d-4737-be19-6cd7999f78c9 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:35.786306 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e2c09b44-7d5d-4737-be19-6cd7999f78c9 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 4381aca2-ea30-4473-9cd3-18c9b64f1937] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:35.798102 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e2c09b44-7d5d-4737-be19-6cd7999f78c9 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:35.799001 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e2c09b44-7d5d-4737-be19-6cd7999f78c9 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:35.800389 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e2c09b44-7d5d-4737-be19-6cd7999f78c9 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:35.801347 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e2c09b44-7d5d-4737-be19-6cd7999f78c9 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:35.802075 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e2c09b44-7d5d-4737-be19-6cd7999f78c9 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:35.802756 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e2c09b44-7d5d-4737-be19-6cd7999f78c9 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:35.886290 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a70d7407-d3f0-4bb7-884a-7a70b26ce28f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:35.887793 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a70d7407-d3f0-4bb7-884a-7a70b26ce28f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 9dc683ca-0f6d-42d9-bf36-5bb1a5cc3286] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:35.902198 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a70d7407-d3f0-4bb7-884a-7a70b26ce28f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:35.904874 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a70d7407-d3f0-4bb7-884a-7a70b26ce28f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:35.905621 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a70d7407-d3f0-4bb7-884a-7a70b26ce28f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:35.907028 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a70d7407-d3f0-4bb7-884a-7a70b26ce28f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:35.909821 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a70d7407-d3f0-4bb7-884a-7a70b26ce28f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:35.913799 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a70d7407-d3f0-4bb7-884a-7a70b26ce28f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:36.115914 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e2c09b44-7d5d-4737-be19-6cd7999f78c9 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:36.128401 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e2c09b44-7d5d-4737-be19-6cd7999f78c9 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937" status: 200 len: 1564 microversion: 2.1 time: 0.347467 Sep 23 04:53:36.130349 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2561/4980] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:35 2022] GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937 => generated 1564 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:36.142178 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-da8c9b73-ecce-46de-8e83-d37148293a7e tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:36.147613 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-da8c9b73-ecce-46de-8e83-d37148293a7e tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] [instance: 8ee6c95b-4f74-4f70-a118-83886aebde43] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:36.161280 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-da8c9b73-ecce-46de-8e83-d37148293a7e tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:36.162209 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-da8c9b73-ecce-46de-8e83-d37148293a7e tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:36.163606 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-da8c9b73-ecce-46de-8e83-d37148293a7e tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:36.164676 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-da8c9b73-ecce-46de-8e83-d37148293a7e tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:36.166887 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-da8c9b73-ecce-46de-8e83-d37148293a7e tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:36.170100 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-da8c9b73-ecce-46de-8e83-d37148293a7e tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:36.244915 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a70d7407-d3f0-4bb7-884a-7a70b26ce28f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:36.256337 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a70d7407-d3f0-4bb7-884a-7a70b26ce28f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/9dc683ca-0f6d-42d9-bf36-5bb1a5cc3286" status: 200 len: 1315 microversion: 2.1 time: 0.375485 Sep 23 04:53:36.257051 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2420/4981] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:35 2022] GET /compute/v2.1/servers/9dc683ca-0f6d-42d9-bf36-5bb1a5cc3286 => generated 1315 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:36.266170 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7e27c429-a7ec-4aad-8ad8-bfe80414d888 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:36.273288 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7e27c429-a7ec-4aad-8ad8-bfe80414d888 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 4381aca2-ea30-4473-9cd3-18c9b64f1937] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:36.282609 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7e27c429-a7ec-4aad-8ad8-bfe80414d888 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:36.283303 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7e27c429-a7ec-4aad-8ad8-bfe80414d888 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:36.283925 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7e27c429-a7ec-4aad-8ad8-bfe80414d888 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:36.284823 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7e27c429-a7ec-4aad-8ad8-bfe80414d888 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:36.285435 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7e27c429-a7ec-4aad-8ad8-bfe80414d888 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:36.286106 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7e27c429-a7ec-4aad-8ad8-bfe80414d888 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:36.303511 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-da8c9b73-ecce-46de-8e83-d37148293a7e tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46eb7f913d7e49f58af088102c5a06a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af9b29a1d1f488faf6e4dfd19055728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:36.314217 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-da8c9b73-ecce-46de-8e83-d37148293a7e tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] 10.222.0.33 "GET /compute/v2.1/servers/8ee6c95b-4f74-4f70-a118-83886aebde43" status: 200 len: 1221 microversion: 2.1 time: 0.180752 Sep 23 04:53:36.316359 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2562/4982] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:36 2022] GET /compute/v2.1/servers/8ee6c95b-4f74-4f70-a118-83886aebde43 => generated 1221 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:36.459255 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-7e27c429-a7ec-4aad-8ad8-bfe80414d888 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:36.467812 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7e27c429-a7ec-4aad-8ad8-bfe80414d888 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937" status: 200 len: 1564 microversion: 2.1 time: 0.209862 Sep 23 04:53:36.468431 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2421/4983] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:36 2022] GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937 => generated 1564 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:36.599454 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b5bdc18b-af34-44bd-9cc6-400adf4530e9 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:36.600173 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b5bdc18b-af34-44bd-9cc6-400adf4530e9 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: 6174fd18-3f10-4034-85ee-32b05fde010f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:36.606984 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b5bdc18b-af34-44bd-9cc6-400adf4530e9 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:36.607472 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b5bdc18b-af34-44bd-9cc6-400adf4530e9 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:36.607908 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b5bdc18b-af34-44bd-9cc6-400adf4530e9 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:36.608600 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b5bdc18b-af34-44bd-9cc6-400adf4530e9 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:36.609163 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b5bdc18b-af34-44bd-9cc6-400adf4530e9 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:36.609706 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b5bdc18b-af34-44bd-9cc6-400adf4530e9 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:36.774523 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b5bdc18b-af34-44bd-9cc6-400adf4530e9 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:36.784224 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b5bdc18b-af34-44bd-9cc6-400adf4530e9 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f" status: 200 len: 1318 microversion: 2.1 time: 0.188591 Sep 23 04:53:36.784801 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2563/4984] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:36 2022] GET /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f => generated 1318 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:37.280444 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9c0e5c9e-92cd-4e09-a065-df7bc3eef5a8 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:37.281286 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-9c0e5c9e-92cd-4e09-a065-df7bc3eef5a8 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 9dc683ca-0f6d-42d9-bf36-5bb1a5cc3286] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:37.288496 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9c0e5c9e-92cd-4e09-a065-df7bc3eef5a8 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:37.289926 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9c0e5c9e-92cd-4e09-a065-df7bc3eef5a8 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:37.290639 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9c0e5c9e-92cd-4e09-a065-df7bc3eef5a8 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:37.291554 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9c0e5c9e-92cd-4e09-a065-df7bc3eef5a8 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:37.292121 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9c0e5c9e-92cd-4e09-a065-df7bc3eef5a8 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:37.292707 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9c0e5c9e-92cd-4e09-a065-df7bc3eef5a8 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:37.341329 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-fe2fc8ad-5c15-4a1a-b428-7408ad7c02a7 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:37.342233 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-fe2fc8ad-5c15-4a1a-b428-7408ad7c02a7 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] [instance: 8ee6c95b-4f74-4f70-a118-83886aebde43] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:37.349159 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fe2fc8ad-5c15-4a1a-b428-7408ad7c02a7 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:37.349671 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fe2fc8ad-5c15-4a1a-b428-7408ad7c02a7 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:37.350159 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fe2fc8ad-5c15-4a1a-b428-7408ad7c02a7 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:37.350880 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fe2fc8ad-5c15-4a1a-b428-7408ad7c02a7 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:37.351342 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fe2fc8ad-5c15-4a1a-b428-7408ad7c02a7 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:37.352024 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fe2fc8ad-5c15-4a1a-b428-7408ad7c02a7 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:37.431483 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-fe2fc8ad-5c15-4a1a-b428-7408ad7c02a7 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46eb7f913d7e49f58af088102c5a06a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af9b29a1d1f488faf6e4dfd19055728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:37.456339 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-fe2fc8ad-5c15-4a1a-b428-7408ad7c02a7 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] 10.222.0.33 "GET /compute/v2.1/servers/8ee6c95b-4f74-4f70-a118-83886aebde43" status: 200 len: 1213 microversion: 2.1 time: 0.119340 Sep 23 04:53:37.457615 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2564/4985] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:37 2022] GET /compute/v2.1/servers/8ee6c95b-4f74-4f70-a118-83886aebde43 => generated 1213 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:37.584544 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-9c0e5c9e-92cd-4e09-a065-df7bc3eef5a8 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:37.594954 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9c0e5c9e-92cd-4e09-a065-df7bc3eef5a8 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/9dc683ca-0f6d-42d9-bf36-5bb1a5cc3286" status: 200 len: 1315 microversion: 2.1 time: 0.319237 Sep 23 04:53:37.595484 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2422/4986] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:37 2022] GET /compute/v2.1/servers/9dc683ca-0f6d-42d9-bf36-5bb1a5cc3286 => generated 1315 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:37.817360 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c04fb489-0536-4e4f-aa03-9e14d741f57a tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:37.820677 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c04fb489-0536-4e4f-aa03-9e14d741f57a tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: 6174fd18-3f10-4034-85ee-32b05fde010f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:37.889752 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c04fb489-0536-4e4f-aa03-9e14d741f57a tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:37.890279 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c04fb489-0536-4e4f-aa03-9e14d741f57a tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:37.890742 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c04fb489-0536-4e4f-aa03-9e14d741f57a tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:37.897199 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c04fb489-0536-4e4f-aa03-9e14d741f57a tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:37.899850 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c04fb489-0536-4e4f-aa03-9e14d741f57a tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:37.900313 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c04fb489-0536-4e4f-aa03-9e14d741f57a tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:38.388335 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c04fb489-0536-4e4f-aa03-9e14d741f57a tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:38.403875 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c04fb489-0536-4e4f-aa03-9e14d741f57a tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f" status: 200 len: 1318 microversion: 2.1 time: 0.597847 Sep 23 04:53:38.414850 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2565/4987] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:37 2022] GET /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f => generated 1318 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:38.463464 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-b1fa4e71-198b-4ab7-ad77-1f7738c1bcd4 req-3d370027-03f0-4f93-a4e6-8d0b8ab91b5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6174fd18-3f10-4034-85ee-32b05fde010f", "name": "network-vif-plugged", "status": "completed", "tag": "d59a64b4-b8c2-44d3-90e0-14542ae01845"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:53:38.480263 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ac9f4317-f252-4e89-8a3a-d27811e192f7 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:38.481051 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ac9f4317-f252-4e89-8a3a-d27811e192f7 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] [instance: 8ee6c95b-4f74-4f70-a118-83886aebde43] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:38.483282 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:53:38.498242 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-b1fa4e71-198b-4ab7-ad77-1f7738c1bcd4 req-3d370027-03f0-4f93-a4e6-8d0b8ab91b5e service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:38.498881 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-b1fa4e71-198b-4ab7-ad77-1f7738c1bcd4 req-3d370027-03f0-4f93-a4e6-8d0b8ab91b5e service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:38.499387 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-b1fa4e71-198b-4ab7-ad77-1f7738c1bcd4 req-3d370027-03f0-4f93-a4e6-8d0b8ab91b5e service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:38.500095 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ac9f4317-f252-4e89-8a3a-d27811e192f7 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:38.500720 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ac9f4317-f252-4e89-8a3a-d27811e192f7 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:38.501285 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ac9f4317-f252-4e89-8a3a-d27811e192f7 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:38.502174 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ac9f4317-f252-4e89-8a3a-d27811e192f7 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:38.502713 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ac9f4317-f252-4e89-8a3a-d27811e192f7 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:38.503154 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ac9f4317-f252-4e89-8a3a-d27811e192f7 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:38.520138 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-b1fa4e71-198b-4ab7-ad77-1f7738c1bcd4 req-3d370027-03f0-4f93-a4e6-8d0b8ab91b5e service nova] Creating event network-vif-plugged:d59a64b4-b8c2-44d3-90e0-14542ae01845 for instance 6174fd18-3f10-4034-85ee-32b05fde010f on n-h2-846463-3 Sep 23 04:53:38.529486 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-b1fa4e71-198b-4ab7-ad77-1f7738c1bcd4 req-3d370027-03f0-4f93-a4e6-8d0b8ab91b5e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068644 Sep 23 04:53:38.533298 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2423/4988] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:53:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:53:38.618635 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f8710a2c-b32b-47b9-9aea-31699d7b8d89 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:38.620387 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f8710a2c-b32b-47b9-9aea-31699d7b8d89 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 9dc683ca-0f6d-42d9-bf36-5bb1a5cc3286] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:38.640985 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f8710a2c-b32b-47b9-9aea-31699d7b8d89 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:38.647509 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f8710a2c-b32b-47b9-9aea-31699d7b8d89 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:38.650367 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f8710a2c-b32b-47b9-9aea-31699d7b8d89 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:38.651258 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f8710a2c-b32b-47b9-9aea-31699d7b8d89 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:38.651803 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f8710a2c-b32b-47b9-9aea-31699d7b8d89 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:38.652519 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f8710a2c-b32b-47b9-9aea-31699d7b8d89 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:38.717195 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ac9f4317-f252-4e89-8a3a-d27811e192f7 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46eb7f913d7e49f58af088102c5a06a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af9b29a1d1f488faf6e4dfd19055728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:38.725943 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ac9f4317-f252-4e89-8a3a-d27811e192f7 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] 10.222.0.33 "GET /compute/v2.1/servers/8ee6c95b-4f74-4f70-a118-83886aebde43" status: 200 len: 1277 microversion: 2.1 time: 0.249773 Sep 23 04:53:38.729174 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2566/4989] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:38 2022] GET /compute/v2.1/servers/8ee6c95b-4f74-4f70-a118-83886aebde43 => generated 1277 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:53:39.417900 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f8710a2c-b32b-47b9-9aea-31699d7b8d89 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:39.430251 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f8710a2c-b32b-47b9-9aea-31699d7b8d89 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/9dc683ca-0f6d-42d9-bf36-5bb1a5cc3286" status: 200 len: 1315 microversion: 2.1 time: 0.815928 Sep 23 04:53:39.431084 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2424/4990] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:38 2022] GET /compute/v2.1/servers/9dc683ca-0f6d-42d9-bf36-5bb1a5cc3286 => generated 1315 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:53:39.445413 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-63c3b0f7-d316-4bdb-96ce-c7247f2d4fe4 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:39.445413 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-63c3b0f7-d316-4bdb-96ce-c7247f2d4fe4 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: 6174fd18-3f10-4034-85ee-32b05fde010f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:39.445413 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-63c3b0f7-d316-4bdb-96ce-c7247f2d4fe4 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:39.445413 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-63c3b0f7-d316-4bdb-96ce-c7247f2d4fe4 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:39.446186 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-63c3b0f7-d316-4bdb-96ce-c7247f2d4fe4 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:39.446828 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-63c3b0f7-d316-4bdb-96ce-c7247f2d4fe4 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:39.447891 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-63c3b0f7-d316-4bdb-96ce-c7247f2d4fe4 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:39.448391 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-63c3b0f7-d316-4bdb-96ce-c7247f2d4fe4 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:39.729490 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-63c3b0f7-d316-4bdb-96ce-c7247f2d4fe4 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:39.744033 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-63c3b0f7-d316-4bdb-96ce-c7247f2d4fe4 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f" status: 200 len: 1318 microversion: 2.1 time: 0.313254 Sep 23 04:53:39.753241 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7565b1b2-d54f-482f-8491-6fd2458fed22 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:39.754700 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7565b1b2-d54f-482f-8491-6fd2458fed22 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] [instance: 8ee6c95b-4f74-4f70-a118-83886aebde43] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:39.771002 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2567/4991] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:39 2022] GET /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f => generated 1318 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:53:39.771840 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7565b1b2-d54f-482f-8491-6fd2458fed22 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:39.773513 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7565b1b2-d54f-482f-8491-6fd2458fed22 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:39.774006 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7565b1b2-d54f-482f-8491-6fd2458fed22 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:39.777244 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7565b1b2-d54f-482f-8491-6fd2458fed22 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:39.777747 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7565b1b2-d54f-482f-8491-6fd2458fed22 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:39.778230 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7565b1b2-d54f-482f-8491-6fd2458fed22 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:39.882240 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-7565b1b2-d54f-482f-8491-6fd2458fed22 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46eb7f913d7e49f58af088102c5a06a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af9b29a1d1f488faf6e4dfd19055728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:39.892504 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7565b1b2-d54f-482f-8491-6fd2458fed22 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] 10.222.0.33 "GET /compute/v2.1/servers/8ee6c95b-4f74-4f70-a118-83886aebde43" status: 200 len: 1275 microversion: 2.1 time: 0.143688 Sep 23 04:53:39.893028 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2425/4992] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:39 2022] GET /compute/v2.1/servers/8ee6c95b-4f74-4f70-a118-83886aebde43 => generated 1275 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:53:39.988902 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-19ed8dc3-6ffa-495a-b65c-7aa47f5bc358 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:39.989525 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-19ed8dc3-6ffa-495a-b65c-7aa47f5bc358 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 4381aca2-ea30-4473-9cd3-18c9b64f1937] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:40.003807 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-2457afb1-e183-4302-99a6-15ceff865a4d req-4b099680-07c0-47b6-84f5-a37a95d4285a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4381aca2-ea30-4473-9cd3-18c9b64f1937", "tag": "bc06dfe2-49c9-4f61-b1e4-e3d76533aa0c"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:53:40.009448 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-19ed8dc3-6ffa-495a-b65c-7aa47f5bc358 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:40.009606 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-19ed8dc3-6ffa-495a-b65c-7aa47f5bc358 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:40.012823 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-19ed8dc3-6ffa-495a-b65c-7aa47f5bc358 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:40.013633 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-19ed8dc3-6ffa-495a-b65c-7aa47f5bc358 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:40.019666 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-19ed8dc3-6ffa-495a-b65c-7aa47f5bc358 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:40.020218 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-19ed8dc3-6ffa-495a-b65c-7aa47f5bc358 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:40.022756 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-2457afb1-e183-4302-99a6-15ceff865a4d req-4b099680-07c0-47b6-84f5-a37a95d4285a service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:40.024786 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-2457afb1-e183-4302-99a6-15ceff865a4d req-4b099680-07c0-47b6-84f5-a37a95d4285a service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:40.025257 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-2457afb1-e183-4302-99a6-15ceff865a4d req-4b099680-07c0-47b6-84f5-a37a95d4285a service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:40.055038 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-2457afb1-e183-4302-99a6-15ceff865a4d req-4b099680-07c0-47b6-84f5-a37a95d4285a service nova] Creating event network-changed:bc06dfe2-49c9-4f61-b1e4-e3d76533aa0c for instance 4381aca2-ea30-4473-9cd3-18c9b64f1937 on n-h1-846463-3 Sep 23 04:53:40.067850 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-2457afb1-e183-4302-99a6-15ceff865a4d req-4b099680-07c0-47b6-84f5-a37a95d4285a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069383 Sep 23 04:53:40.073158 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2426/4993] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:53:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:53:40.364093 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-19ed8dc3-6ffa-495a-b65c-7aa47f5bc358 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:40.383587 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-19ed8dc3-6ffa-495a-b65c-7aa47f5bc358 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937" status: 200 len: 1564 microversion: 2.1 time: 0.398631 Sep 23 04:53:40.415104 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2568/4994] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:39 2022] GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937 => generated 1564 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:40.455966 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9d732dc0-b6b4-443a-acb8-0ac74895a625 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:40.457146 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-9d732dc0-b6b4-443a-acb8-0ac74895a625 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 9dc683ca-0f6d-42d9-bf36-5bb1a5cc3286] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:40.466925 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9d732dc0-b6b4-443a-acb8-0ac74895a625 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:40.467882 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9d732dc0-b6b4-443a-acb8-0ac74895a625 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:40.468572 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9d732dc0-b6b4-443a-acb8-0ac74895a625 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:40.469536 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9d732dc0-b6b4-443a-acb8-0ac74895a625 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:40.470441 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9d732dc0-b6b4-443a-acb8-0ac74895a625 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:40.471106 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9d732dc0-b6b4-443a-acb8-0ac74895a625 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:40.553502 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-51307483-1f17-4d51-9059-955e5e28e5dd req-548e268d-12a8-44dd-b251-a8b9bb6e6ec7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dc683ca-0f6d-42d9-bf36-5bb1a5cc3286", "name": "network-vif-plugged", "status": "completed", "tag": "115752c0-7113-4f89-9e3a-ff7748947567"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:53:40.576433 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-51307483-1f17-4d51-9059-955e5e28e5dd req-548e268d-12a8-44dd-b251-a8b9bb6e6ec7 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:40.577849 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-51307483-1f17-4d51-9059-955e5e28e5dd req-548e268d-12a8-44dd-b251-a8b9bb6e6ec7 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:40.579950 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-51307483-1f17-4d51-9059-955e5e28e5dd req-548e268d-12a8-44dd-b251-a8b9bb6e6ec7 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:40.611713 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-51307483-1f17-4d51-9059-955e5e28e5dd req-548e268d-12a8-44dd-b251-a8b9bb6e6ec7 service nova] Creating event network-vif-plugged:115752c0-7113-4f89-9e3a-ff7748947567 for instance 9dc683ca-0f6d-42d9-bf36-5bb1a5cc3286 on n-h2-846463-3 Sep 23 04:53:40.621153 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-51307483-1f17-4d51-9059-955e5e28e5dd req-548e268d-12a8-44dd-b251-a8b9bb6e6ec7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071823 Sep 23 04:53:40.629490 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2569/4995] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:53:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:53:40.782802 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f1ad02b3-b3cb-424e-bb6c-e8a5c189ab63 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:40.792664 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f1ad02b3-b3cb-424e-bb6c-e8a5c189ab63 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: 6174fd18-3f10-4034-85ee-32b05fde010f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:40.797439 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f1ad02b3-b3cb-424e-bb6c-e8a5c189ab63 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:40.802452 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f1ad02b3-b3cb-424e-bb6c-e8a5c189ab63 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:40.802926 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f1ad02b3-b3cb-424e-bb6c-e8a5c189ab63 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:40.803701 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f1ad02b3-b3cb-424e-bb6c-e8a5c189ab63 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:40.814636 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f1ad02b3-b3cb-424e-bb6c-e8a5c189ab63 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:40.815104 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f1ad02b3-b3cb-424e-bb6c-e8a5c189ab63 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:40.829750 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-9d732dc0-b6b4-443a-acb8-0ac74895a625 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:40.847970 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9d732dc0-b6b4-443a-acb8-0ac74895a625 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/9dc683ca-0f6d-42d9-bf36-5bb1a5cc3286" status: 200 len: 1315 microversion: 2.1 time: 0.398518 Sep 23 04:53:40.866074 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2427/4996] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:40 2022] GET /compute/v2.1/servers/9dc683ca-0f6d-42d9-bf36-5bb1a5cc3286 => generated 1315 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:40.933083 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1014926c-b299-4070-9e70-c37c81516010 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:40.934229 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-1014926c-b299-4070-9e70-c37c81516010 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] [instance: 8ee6c95b-4f74-4f70-a118-83886aebde43] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:40.947033 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1014926c-b299-4070-9e70-c37c81516010 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:40.948746 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1014926c-b299-4070-9e70-c37c81516010 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:40.949506 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1014926c-b299-4070-9e70-c37c81516010 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:40.954035 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1014926c-b299-4070-9e70-c37c81516010 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:40.961242 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1014926c-b299-4070-9e70-c37c81516010 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:40.962738 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1014926c-b299-4070-9e70-c37c81516010 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:41.454279 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f1ad02b3-b3cb-424e-bb6c-e8a5c189ab63 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:41.470352 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f1ad02b3-b3cb-424e-bb6c-e8a5c189ab63 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f" status: 200 len: 1508 microversion: 2.1 time: 0.697345 Sep 23 04:53:41.471066 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2570/4997] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:40 2022] GET /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f => generated 1508 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:53:41.501410 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3f8dfbe6-7b9a-4f9c-b2b7-fc6d522ae818 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:41.502293 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-3f8dfbe6-7b9a-4f9c-b2b7-fc6d522ae818 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: 6174fd18-3f10-4034-85ee-32b05fde010f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:41.513380 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3f8dfbe6-7b9a-4f9c-b2b7-fc6d522ae818 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:41.516292 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3f8dfbe6-7b9a-4f9c-b2b7-fc6d522ae818 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:41.518639 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3f8dfbe6-7b9a-4f9c-b2b7-fc6d522ae818 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:41.520146 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3f8dfbe6-7b9a-4f9c-b2b7-fc6d522ae818 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:41.521270 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3f8dfbe6-7b9a-4f9c-b2b7-fc6d522ae818 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:41.522394 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3f8dfbe6-7b9a-4f9c-b2b7-fc6d522ae818 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:41.704817 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-1014926c-b299-4070-9e70-c37c81516010 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46eb7f913d7e49f58af088102c5a06a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af9b29a1d1f488faf6e4dfd19055728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:41.713314 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-1014926c-b299-4070-9e70-c37c81516010 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] 10.222.0.33 "GET /compute/v2.1/servers/8ee6c95b-4f74-4f70-a118-83886aebde43" status: 200 len: 1317 microversion: 2.1 time: 0.794007 Sep 23 04:53:41.717285 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2428/4998] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:40 2022] GET /compute/v2.1/servers/8ee6c95b-4f74-4f70-a118-83886aebde43 => generated 1317 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:53:41.873090 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-3f8dfbe6-7b9a-4f9c-b2b7-fc6d522ae818 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:41.882229 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e28267df-e040-4faf-ae0e-1907bc2a6934 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:41.883486 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e28267df-e040-4faf-ae0e-1907bc2a6934 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 9dc683ca-0f6d-42d9-bf36-5bb1a5cc3286] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:41.902420 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3f8dfbe6-7b9a-4f9c-b2b7-fc6d522ae818 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f" status: 200 len: 1508 microversion: 2.1 time: 0.404729 Sep 23 04:53:41.904912 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2571/4999] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:41 2022] GET /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f => generated 1508 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:41.905651 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e28267df-e040-4faf-ae0e-1907bc2a6934 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:41.907121 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e28267df-e040-4faf-ae0e-1907bc2a6934 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:41.908631 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e28267df-e040-4faf-ae0e-1907bc2a6934 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:41.909702 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e28267df-e040-4faf-ae0e-1907bc2a6934 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:41.910226 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e28267df-e040-4faf-ae0e-1907bc2a6934 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:41.910669 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e28267df-e040-4faf-ae0e-1907bc2a6934 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:41.932025 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8ae88a05-a0a9-4569-bce3-89d74eafdf16 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:53:41.934617 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-8ae88a05-a0a9-4569-bce3-89d74eafdf16 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: 6174fd18-3f10-4034-85ee-32b05fde010f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:41.951192 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8ae88a05-a0a9-4569-bce3-89d74eafdf16 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:41.951704 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8ae88a05-a0a9-4569-bce3-89d74eafdf16 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:41.952152 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8ae88a05-a0a9-4569-bce3-89d74eafdf16 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:41.952960 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8ae88a05-a0a9-4569-bce3-89d74eafdf16 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:41.953338 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8ae88a05-a0a9-4569-bce3-89d74eafdf16 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:41.953759 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8ae88a05-a0a9-4569-bce3-89d74eafdf16 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:42.056913 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:53:42.199048 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e28267df-e040-4faf-ae0e-1907bc2a6934 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:42.207020 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e28267df-e040-4faf-ae0e-1907bc2a6934 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/9dc683ca-0f6d-42d9-bf36-5bb1a5cc3286" status: 200 len: 1315 microversion: 2.1 time: 0.338954 Sep 23 04:53:42.208877 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2429/5000] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:41 2022] GET /compute/v2.1/servers/9dc683ca-0f6d-42d9-bf36-5bb1a5cc3286 => generated 1315 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:42.214090 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-02544da6-c9c9-46cf-8b96-88e8e484f568 req-c30ab997-38d6-4538-bc12-28c48f02744a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ee5730a-e4f9-4dea-89ce-dafaef4989bf", "tag": "e8137c91-e05a-4bae-bd3c-9d8e75f6fd55"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:53:42.225420 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-02544da6-c9c9-46cf-8b96-88e8e484f568 req-c30ab997-38d6-4538-bc12-28c48f02744a service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:42.226246 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-02544da6-c9c9-46cf-8b96-88e8e484f568 req-c30ab997-38d6-4538-bc12-28c48f02744a service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:42.227702 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-02544da6-c9c9-46cf-8b96-88e8e484f568 req-c30ab997-38d6-4538-bc12-28c48f02744a service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:42.232175 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-8ae88a05-a0a9-4569-bce3-89d74eafdf16 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "PUT /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f" status: 200 len: 1080 microversion: 2.1 time: 0.308153 Sep 23 04:53:42.232996 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2572/5001] 10.222.0.33 () {60 vars in 1256 bytes} [Fri Sep 23 04:53:41 2022] PUT /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f => generated 1080 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:53:42.252398 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-106fadad-6415-46b6-98a0-131133b57685 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:42.253368 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-106fadad-6415-46b6-98a0-131133b57685 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: 6174fd18-3f10-4034-85ee-32b05fde010f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:42.254967 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-02544da6-c9c9-46cf-8b96-88e8e484f568 req-c30ab997-38d6-4538-bc12-28c48f02744a service nova] Creating event network-changed:e8137c91-e05a-4bae-bd3c-9d8e75f6fd55 for instance 3ee5730a-e4f9-4dea-89ce-dafaef4989bf on n-h1-846463-3 Sep 23 04:53:42.261583 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-106fadad-6415-46b6-98a0-131133b57685 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:42.262168 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-02544da6-c9c9-46cf-8b96-88e8e484f568 req-c30ab997-38d6-4538-bc12-28c48f02744a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051433 Sep 23 04:53:42.262611 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-106fadad-6415-46b6-98a0-131133b57685 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:42.263254 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2430/5002] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:53:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:53:42.263676 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-106fadad-6415-46b6-98a0-131133b57685 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:42.264411 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-106fadad-6415-46b6-98a0-131133b57685 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:42.264883 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-106fadad-6415-46b6-98a0-131133b57685 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:42.266526 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-106fadad-6415-46b6-98a0-131133b57685 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:42.511422 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-a0748160-a64b-4351-9909-b815b9ece270 req-d23c585f-c40d-465e-bbed-733446d0ca9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ee6c95b-4f74-4f70-a118-83886aebde43", "tag": "297fd5f7-23f6-499f-bf6e-a456cee539ad"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:53:42.525134 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-a0748160-a64b-4351-9909-b815b9ece270 req-d23c585f-c40d-465e-bbed-733446d0ca9c service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:42.526298 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-a0748160-a64b-4351-9909-b815b9ece270 req-d23c585f-c40d-465e-bbed-733446d0ca9c service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:42.526924 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-a0748160-a64b-4351-9909-b815b9ece270 req-d23c585f-c40d-465e-bbed-733446d0ca9c service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:42.532849 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=100 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:53:42.541508 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-a0748160-a64b-4351-9909-b815b9ece270 req-d23c585f-c40d-465e-bbed-733446d0ca9c service nova] Creating event network-changed:297fd5f7-23f6-499f-bf6e-a456cee539ad for instance 8ee6c95b-4f74-4f70-a118-83886aebde43 on n-h1-846463-3 Sep 23 04:53:42.548964 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-a0748160-a64b-4351-9909-b815b9ece270 req-d23c585f-c40d-465e-bbed-733446d0ca9c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044946 Sep 23 04:53:42.549584 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2431/5003] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:53:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:53:42.559057 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-106fadad-6415-46b6-98a0-131133b57685 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:42.568306 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-106fadad-6415-46b6-98a0-131133b57685 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f" status: 200 len: 1506 microversion: 2.1 time: 0.320135 Sep 23 04:53:42.568952 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2573/5004] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:42 2022] GET /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f => generated 1506 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:53:42.621832 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c069f0fe-be75-4c83-82bb-a633f9b6b507 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:42.622831 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c069f0fe-be75-4c83-82bb-a633f9b6b507 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: 6174fd18-3f10-4034-85ee-32b05fde010f] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:42.632161 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c069f0fe-be75-4c83-82bb-a633f9b6b507 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:42.633480 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c069f0fe-be75-4c83-82bb-a633f9b6b507 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:42.636587 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c069f0fe-be75-4c83-82bb-a633f9b6b507 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:42.637632 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c069f0fe-be75-4c83-82bb-a633f9b6b507 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:42.638231 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c069f0fe-be75-4c83-82bb-a633f9b6b507 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:42.639025 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c069f0fe-be75-4c83-82bb-a633f9b6b507 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:42.747750 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f5a15387-5cfd-4cb2-a376-e559d30b42d1 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:42.747750 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f5a15387-5cfd-4cb2-a376-e559d30b42d1 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] [instance: 8ee6c95b-4f74-4f70-a118-83886aebde43] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:42.753631 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f5a15387-5cfd-4cb2-a376-e559d30b42d1 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:42.754482 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f5a15387-5cfd-4cb2-a376-e559d30b42d1 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:42.755153 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f5a15387-5cfd-4cb2-a376-e559d30b42d1 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:42.756083 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f5a15387-5cfd-4cb2-a376-e559d30b42d1 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:42.756733 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f5a15387-5cfd-4cb2-a376-e559d30b42d1 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:42.757586 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f5a15387-5cfd-4cb2-a376-e559d30b42d1 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:43.038284 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c069f0fe-be75-4c83-82bb-a633f9b6b507 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:43.047422 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c069f0fe-be75-4c83-82bb-a633f9b6b507 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f" status: 200 len: 1506 microversion: 2.1 time: 0.431387 Sep 23 04:53:43.048600 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2432/5005] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:42 2022] GET /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f => generated 1506 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:43.071186 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8984c42d-e3dd-471c-83e4-2744115458ff tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:53:43.075223 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8984c42d-e3dd-471c-83e4-2744115458ff tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: 6174fd18-3f10-4034-85ee-32b05fde010f] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:43.082117 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8984c42d-e3dd-471c-83e4-2744115458ff tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:43.082998 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8984c42d-e3dd-471c-83e4-2744115458ff tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:43.083622 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8984c42d-e3dd-471c-83e4-2744115458ff tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:43.084573 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8984c42d-e3dd-471c-83e4-2744115458ff tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:43.085396 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8984c42d-e3dd-471c-83e4-2744115458ff tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:43.086167 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8984c42d-e3dd-471c-83e4-2744115458ff tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:43.122493 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f5a15387-5cfd-4cb2-a376-e559d30b42d1 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46eb7f913d7e49f58af088102c5a06a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af9b29a1d1f488faf6e4dfd19055728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:43.123661 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:53:43.134441 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f5a15387-5cfd-4cb2-a376-e559d30b42d1 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] 10.222.0.33 "GET /compute/v2.1/servers/8ee6c95b-4f74-4f70-a118-83886aebde43" status: 200 len: 1317 microversion: 2.1 time: 0.396115 Sep 23 04:53:43.135605 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2574/5006] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:42 2022] GET /compute/v2.1/servers/8ee6c95b-4f74-4f70-a118-83886aebde43 => generated 1317 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:43.227201 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-8984c42d-e3dd-471c-83e4-2744115458ff tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Flavor limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:53:43.227636 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-8984c42d-e3dd-471c-83e4-2744115458ff tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Image limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:53:43.228138 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-8984c42d-e3dd-471c-83e4-2744115458ff tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Flavor pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:53:43.229359 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-8984c42d-e3dd-471c-83e4-2744115458ff tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Image pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:53:43.229733 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-8984c42d-e3dd-471c-83e4-2744115458ff tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:53:43.233726 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1a97c84d-91fd-4d8a-9b6e-8cfa2d0e5ea2 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:43.235203 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1a97c84d-91fd-4d8a-9b6e-8cfa2d0e5ea2 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 9dc683ca-0f6d-42d9-bf36-5bb1a5cc3286] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:43.244069 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1a97c84d-91fd-4d8a-9b6e-8cfa2d0e5ea2 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:43.245141 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1a97c84d-91fd-4d8a-9b6e-8cfa2d0e5ea2 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:43.245903 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1a97c84d-91fd-4d8a-9b6e-8cfa2d0e5ea2 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:43.246823 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1a97c84d-91fd-4d8a-9b6e-8cfa2d0e5ea2 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:43.247476 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1a97c84d-91fd-4d8a-9b6e-8cfa2d0e5ea2 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:43.248123 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1a97c84d-91fd-4d8a-9b6e-8cfa2d0e5ea2 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:43.453864 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1a97c84d-91fd-4d8a-9b6e-8cfa2d0e5ea2 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:43.460656 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1a97c84d-91fd-4d8a-9b6e-8cfa2d0e5ea2 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/9dc683ca-0f6d-42d9-bf36-5bb1a5cc3286" status: 200 len: 1502 microversion: 2.1 time: 0.233150 Sep 23 04:53:43.461401 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2575/5007] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:43 2022] GET /compute/v2.1/servers/9dc683ca-0f6d-42d9-bf36-5bb1a5cc3286 => generated 1502 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:53:43.484523 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8278d77f-71cb-47f5-9b65-17be2d954089 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:53:43.485063 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-8278d77f-71cb-47f5-9b65-17be2d954089 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 9dc683ca-0f6d-42d9-bf36-5bb1a5cc3286] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:43.491355 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8278d77f-71cb-47f5-9b65-17be2d954089 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:43.491974 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8278d77f-71cb-47f5-9b65-17be2d954089 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:43.492553 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8278d77f-71cb-47f5-9b65-17be2d954089 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:43.493260 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8278d77f-71cb-47f5-9b65-17be2d954089 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:43.493740 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8278d77f-71cb-47f5-9b65-17be2d954089 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:43.494279 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8278d77f-71cb-47f5-9b65-17be2d954089 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:43.507769 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8984c42d-e3dd-471c-83e4-2744115458ff tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: 6174fd18-3f10-4034-85ee-32b05fde010f] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:43.516595 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8984c42d-e3dd-471c-83e4-2744115458ff tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:43.517986 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8984c42d-e3dd-471c-83e4-2744115458ff tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:43.518847 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8984c42d-e3dd-471c-83e4-2744115458ff tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:43.519844 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8984c42d-e3dd-471c-83e4-2744115458ff tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:43.520491 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8984c42d-e3dd-471c-83e4-2744115458ff tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:43.521119 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8984c42d-e3dd-471c-83e4-2744115458ff tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:43.561136 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8984c42d-e3dd-471c-83e4-2744115458ff tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "POST /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f/action" status: 202 len: 1112 microversion: 2.1 time: 0.494057 Sep 23 04:53:43.562153 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2433/5008] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:53:43 2022] POST /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f/action => generated 1112 bytes in 496 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Sep 23 04:53:43.583129 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-be0b97aa-7598-4fd7-b5d9-8a16bcf834a6 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:43.584051 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-be0b97aa-7598-4fd7-b5d9-8a16bcf834a6 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: 6174fd18-3f10-4034-85ee-32b05fde010f] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:43.594119 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-be0b97aa-7598-4fd7-b5d9-8a16bcf834a6 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:43.597510 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-be0b97aa-7598-4fd7-b5d9-8a16bcf834a6 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:43.597510 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-be0b97aa-7598-4fd7-b5d9-8a16bcf834a6 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:43.597510 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-be0b97aa-7598-4fd7-b5d9-8a16bcf834a6 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:43.597510 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-be0b97aa-7598-4fd7-b5d9-8a16bcf834a6 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:43.597510 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-be0b97aa-7598-4fd7-b5d9-8a16bcf834a6 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:43.628321 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:53:43.690334 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.network.security_group_api [None req-8278d77f-71cb-47f5-9b65-17be2d954089 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Removing security group 84e695d6-d5a1-4f1c-985c-c28b82667d36 from port 115752c0-7113-4f89-9e3a-ff7748947567 Sep 23 04:53:43.895165 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=8 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:53:44.096951 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-be0b97aa-7598-4fd7-b5d9-8a16bcf834a6 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:44.107095 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-be0b97aa-7598-4fd7-b5d9-8a16bcf834a6 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f" status: 200 len: 1517 microversion: 2.1 time: 0.529388 Sep 23 04:53:44.111371 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2434/5009] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:43 2022] GET /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f => generated 1517 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:53:44.161878 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-37e5b299-de1f-4542-b884-0aaa8585c974 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:44.163315 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-37e5b299-de1f-4542-b884-0aaa8585c974 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] [instance: 8ee6c95b-4f74-4f70-a118-83886aebde43] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:44.171420 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-37e5b299-de1f-4542-b884-0aaa8585c974 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:44.172202 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-37e5b299-de1f-4542-b884-0aaa8585c974 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:44.173124 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-37e5b299-de1f-4542-b884-0aaa8585c974 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:44.174463 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-37e5b299-de1f-4542-b884-0aaa8585c974 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:44.176324 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-37e5b299-de1f-4542-b884-0aaa8585c974 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:44.177137 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-37e5b299-de1f-4542-b884-0aaa8585c974 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:44.239433 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-8278d77f-71cb-47f5-9b65-17be2d954089 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "POST /compute/v2.1/servers/9dc683ca-0f6d-42d9-bf36-5bb1a5cc3286/action" status: 202 len: 0 microversion: 2.1 time: 0.758927 Sep 23 04:53:44.242616 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2576/5010] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:53:43 2022] POST /compute/v2.1/servers/9dc683ca-0f6d-42d9-bf36-5bb1a5cc3286/action => generated 0 bytes in 763 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 23 04:53:44.258404 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-62468e8d-6eb3-432f-bd62-bd505201d23b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:44.265738 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-62468e8d-6eb3-432f-bd62-bd505201d23b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 9dc683ca-0f6d-42d9-bf36-5bb1a5cc3286] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:44.275900 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-62468e8d-6eb3-432f-bd62-bd505201d23b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:44.277674 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-62468e8d-6eb3-432f-bd62-bd505201d23b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:44.277674 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-62468e8d-6eb3-432f-bd62-bd505201d23b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:44.278492 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-62468e8d-6eb3-432f-bd62-bd505201d23b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:44.279685 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-62468e8d-6eb3-432f-bd62-bd505201d23b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:44.280228 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-62468e8d-6eb3-432f-bd62-bd505201d23b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:44.448939 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-62468e8d-6eb3-432f-bd62-bd505201d23b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:44.462347 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-62468e8d-6eb3-432f-bd62-bd505201d23b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/9dc683ca-0f6d-42d9-bf36-5bb1a5cc3286" status: 200 len: 1460 microversion: 2.1 time: 0.207422 Sep 23 04:53:44.477950 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2577/5011] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:44 2022] GET /compute/v2.1/servers/9dc683ca-0f6d-42d9-bf36-5bb1a5cc3286 => generated 1460 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:44.479643 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-fa3bf290-5582-461f-921a-ba67d6d78ad3 req-76aea92f-d4d5-4f97-b959-adba069cf1fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9dc683ca-0f6d-42d9-bf36-5bb1a5cc3286", "tag": "115752c0-7113-4f89-9e3a-ff7748947567"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:53:44.481389 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-37e5b299-de1f-4542-b884-0aaa8585c974 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46eb7f913d7e49f58af088102c5a06a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af9b29a1d1f488faf6e4dfd19055728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:44.489710 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-37e5b299-de1f-4542-b884-0aaa8585c974 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] 10.222.0.33 "GET /compute/v2.1/servers/8ee6c95b-4f74-4f70-a118-83886aebde43" status: 200 len: 1317 microversion: 2.1 time: 0.334662 Sep 23 04:53:44.490484 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2435/5012] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:44 2022] GET /compute/v2.1/servers/8ee6c95b-4f74-4f70-a118-83886aebde43 => generated 1317 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:44.496293 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0824e518-56fb-4a06-8dad-a989259b4ff5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:44.497119 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-0824e518-56fb-4a06-8dad-a989259b4ff5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:44.502994 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:53:44.504899 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0824e518-56fb-4a06-8dad-a989259b4ff5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:44.505716 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0824e518-56fb-4a06-8dad-a989259b4ff5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:44.506384 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0824e518-56fb-4a06-8dad-a989259b4ff5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:44.507296 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0824e518-56fb-4a06-8dad-a989259b4ff5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:44.507932 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0824e518-56fb-4a06-8dad-a989259b4ff5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:44.508385 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0824e518-56fb-4a06-8dad-a989259b4ff5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:44.508576 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-fa3bf290-5582-461f-921a-ba67d6d78ad3 req-76aea92f-d4d5-4f97-b959-adba069cf1fe service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:44.509336 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-fa3bf290-5582-461f-921a-ba67d6d78ad3 req-76aea92f-d4d5-4f97-b959-adba069cf1fe service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:44.510379 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-fa3bf290-5582-461f-921a-ba67d6d78ad3 req-76aea92f-d4d5-4f97-b959-adba069cf1fe service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:44.528766 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-fa3bf290-5582-461f-921a-ba67d6d78ad3 req-76aea92f-d4d5-4f97-b959-adba069cf1fe service nova] Creating event network-changed:115752c0-7113-4f89-9e3a-ff7748947567 for instance 9dc683ca-0f6d-42d9-bf36-5bb1a5cc3286 on n-h2-846463-3 Sep 23 04:53:44.537026 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-fa3bf290-5582-461f-921a-ba67d6d78ad3 req-76aea92f-d4d5-4f97-b959-adba069cf1fe service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062783 Sep 23 04:53:44.539177 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2578/5013] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:53:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:53:44.700855 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-0824e518-56fb-4a06-8dad-a989259b4ff5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:44.710648 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0824e518-56fb-4a06-8dad-a989259b4ff5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1670 microversion: 2.1 time: 0.219135 Sep 23 04:53:44.711241 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2436/5014] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:44 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1670 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:44.738566 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0b29f093-e17d-45d7-9f09-28c67f563cea tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:44.739264 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-0b29f093-e17d-45d7-9f09-28c67f563cea tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:44.747391 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0b29f093-e17d-45d7-9f09-28c67f563cea tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:44.747884 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0b29f093-e17d-45d7-9f09-28c67f563cea tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:44.748322 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0b29f093-e17d-45d7-9f09-28c67f563cea tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:44.749050 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0b29f093-e17d-45d7-9f09-28c67f563cea tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:44.749506 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0b29f093-e17d-45d7-9f09-28c67f563cea tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:44.749959 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0b29f093-e17d-45d7-9f09-28c67f563cea tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:44.893230 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-0b29f093-e17d-45d7-9f09-28c67f563cea tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:44.901794 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0b29f093-e17d-45d7-9f09-28c67f563cea tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1670 microversion: 2.1 time: 0.167957 Sep 23 04:53:44.902425 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2579/5015] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:44 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1670 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:44.927529 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ce7e7345-78fe-4ada-bce9-d9a8a237afd4 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:44.928464 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-ce7e7345-78fe-4ada-bce9-d9a8a237afd4 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:44.936405 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ce7e7345-78fe-4ada-bce9-d9a8a237afd4 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:44.936986 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ce7e7345-78fe-4ada-bce9-d9a8a237afd4 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:44.937511 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ce7e7345-78fe-4ada-bce9-d9a8a237afd4 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:44.938476 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ce7e7345-78fe-4ada-bce9-d9a8a237afd4 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:44.939035 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ce7e7345-78fe-4ada-bce9-d9a8a237afd4 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:44.939539 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ce7e7345-78fe-4ada-bce9-d9a8a237afd4 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:45.105492 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ce7e7345-78fe-4ada-bce9-d9a8a237afd4 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:45.119752 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ce7e7345-78fe-4ada-bce9-d9a8a237afd4 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1670 microversion: 2.1 time: 0.191243 Sep 23 04:53:45.119752 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2437/5016] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:44 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1670 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:53:45.132862 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ada1e441-635b-4eb2-8936-91365b775f4f tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:45.133698 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ada1e441-635b-4eb2-8936-91365b775f4f tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: 6174fd18-3f10-4034-85ee-32b05fde010f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:45.140553 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:53:45.140798 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-55486419-b29f-4662-8bd2-e0a4ee23eeb4 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:45.141523 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-55486419-b29f-4662-8bd2-e0a4ee23eeb4 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:45.142874 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ada1e441-635b-4eb2-8936-91365b775f4f tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:45.143626 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ada1e441-635b-4eb2-8936-91365b775f4f tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:45.149082 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ada1e441-635b-4eb2-8936-91365b775f4f tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:45.149082 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ada1e441-635b-4eb2-8936-91365b775f4f tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:45.149082 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ada1e441-635b-4eb2-8936-91365b775f4f tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:45.149082 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ada1e441-635b-4eb2-8936-91365b775f4f tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:45.149539 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-55486419-b29f-4662-8bd2-e0a4ee23eeb4 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:45.149539 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-55486419-b29f-4662-8bd2-e0a4ee23eeb4 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:45.149539 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-55486419-b29f-4662-8bd2-e0a4ee23eeb4 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:45.150698 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-55486419-b29f-4662-8bd2-e0a4ee23eeb4 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:45.151248 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-55486419-b29f-4662-8bd2-e0a4ee23eeb4 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:45.151903 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-55486419-b29f-4662-8bd2-e0a4ee23eeb4 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:45.612156 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-55486419-b29f-4662-8bd2-e0a4ee23eeb4 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:45.615772 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ada1e441-635b-4eb2-8936-91365b775f4f tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:45.623234 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-55486419-b29f-4662-8bd2-e0a4ee23eeb4 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1670 microversion: 2.1 time: 0.486899 Sep 23 04:53:45.624145 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2438/5017] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:45 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1670 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:45.629350 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-87d3e23f-653e-48df-a9a1-7642220280b7 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:45.638882 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-87d3e23f-653e-48df-a9a1-7642220280b7 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] [instance: 8ee6c95b-4f74-4f70-a118-83886aebde43] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:45.639041 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ada1e441-635b-4eb2-8936-91365b775f4f tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f" status: 200 len: 1517 microversion: 2.1 time: 0.503862 Sep 23 04:53:45.639041 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2580/5018] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:45 2022] GET /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f => generated 1517 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:45.639218 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-87d3e23f-653e-48df-a9a1-7642220280b7 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:45.639218 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-87d3e23f-653e-48df-a9a1-7642220280b7 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:45.639218 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-87d3e23f-653e-48df-a9a1-7642220280b7 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:45.639664 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-87d3e23f-653e-48df-a9a1-7642220280b7 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:45.640304 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-87d3e23f-653e-48df-a9a1-7642220280b7 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:45.640886 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-87d3e23f-653e-48df-a9a1-7642220280b7 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:45.750597 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-81b81b24-8bb4-4d4e-8842-d7162c3e23a9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-457732010", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "networks": [{"uuid": "c808d35d-7b6c-439e-908b-4f409fd90fd4"}]}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:53:45.824300 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.neutron [None req-81b81b24-8bb4-4d4e-8842-d7162c3e23a9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] validate_networks() for [('c808d35d-7b6c-439e-908b-4f409fd90fd4', None, None, None, None, None)] {{(pid=122699) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:53:46.138010 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-87d3e23f-653e-48df-a9a1-7642220280b7 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46eb7f913d7e49f58af088102c5a06a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af9b29a1d1f488faf6e4dfd19055728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:46.164633 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-87d3e23f-653e-48df-a9a1-7642220280b7 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] 10.222.0.33 "GET /compute/v2.1/servers/8ee6c95b-4f74-4f70-a118-83886aebde43" status: 200 len: 1317 microversion: 2.1 time: 0.539409 Sep 23 04:53:46.165649 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2439/5019] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:45 2022] GET /compute/v2.1/servers/8ee6c95b-4f74-4f70-a118-83886aebde43 => generated 1317 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:46.664936 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-effad58b-4676-4bf1-9102-a7b0a68e736c tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:46.665916 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-effad58b-4676-4bf1-9102-a7b0a68e736c tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: 6174fd18-3f10-4034-85ee-32b05fde010f] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:46.685618 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-effad58b-4676-4bf1-9102-a7b0a68e736c tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:46.686569 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-effad58b-4676-4bf1-9102-a7b0a68e736c tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:46.691136 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-effad58b-4676-4bf1-9102-a7b0a68e736c tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:46.692951 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-effad58b-4676-4bf1-9102-a7b0a68e736c tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:46.692951 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-effad58b-4676-4bf1-9102-a7b0a68e736c tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:46.693686 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-effad58b-4676-4bf1-9102-a7b0a68e736c tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:46.995728 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-effad58b-4676-4bf1-9102-a7b0a68e736c tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:47.004307 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-effad58b-4676-4bf1-9102-a7b0a68e736c tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f" status: 200 len: 1517 microversion: 2.1 time: 0.344144 Sep 23 04:53:47.005242 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2440/5020] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:46 2022] GET /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f => generated 1517 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:53:47.082817 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-81b81b24-8bb4-4d4e-8842-d7162c3e23a9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Flavor limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:53:47.083438 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-81b81b24-8bb4-4d4e-8842-d7162c3e23a9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Image limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:53:47.084083 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-81b81b24-8bb4-4d4e-8842-d7162c3e23a9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Flavor pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:53:47.084591 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-81b81b24-8bb4-4d4e-8842-d7162c3e23a9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Image pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:53:47.086076 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-81b81b24-8bb4-4d4e-8842-d7162c3e23a9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:53:47.096737 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-81b81b24-8bb4-4d4e-8842-d7162c3e23a9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:47.097437 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-81b81b24-8bb4-4d4e-8842-d7162c3e23a9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:47.098371 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-81b81b24-8bb4-4d4e-8842-d7162c3e23a9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:47.101152 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-81b81b24-8bb4-4d4e-8842-d7162c3e23a9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:47.101152 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-81b81b24-8bb4-4d4e-8842-d7162c3e23a9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:47.101152 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-81b81b24-8bb4-4d4e-8842-d7162c3e23a9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:47.120985 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-81b81b24-8bb4-4d4e-8842-d7162c3e23a9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Getting quotas for project 2a45d69316a648fcb9c56190aaec5376. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:53:47.127729 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-81b81b24-8bb4-4d4e-8842-d7162c3e23a9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Getting quotas for user f5e3a6e455e8483b8ce93ad380793335 and project 2a45d69316a648fcb9c56190aaec5376. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:53:47.142559 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-81b81b24-8bb4-4d4e-8842-d7162c3e23a9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Going to run 1 instances... {{(pid=122699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:53:47.144907 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-81b81b24-8bb4-4d4e-8842-d7162c3e23a9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 3354b397-f391-47f2-8ded-f9227bfecb6f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:53:47.188888 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d40c37a8-f190-423a-a0da-5ef2369a5af5 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:47.190562 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d40c37a8-f190-423a-a0da-5ef2369a5af5 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] [instance: 8ee6c95b-4f74-4f70-a118-83886aebde43] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:47.196592 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d40c37a8-f190-423a-a0da-5ef2369a5af5 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:47.197130 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d40c37a8-f190-423a-a0da-5ef2369a5af5 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:47.197578 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d40c37a8-f190-423a-a0da-5ef2369a5af5 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:47.198408 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d40c37a8-f190-423a-a0da-5ef2369a5af5 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:47.199197 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d40c37a8-f190-423a-a0da-5ef2369a5af5 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:47.199627 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d40c37a8-f190-423a-a0da-5ef2369a5af5 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:47.241481 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-81b81b24-8bb4-4d4e-8842-d7162c3e23a9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.496357 Sep 23 04:53:47.248250 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2581/5021] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:53:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1504 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 23 04:53:47.260270 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2f6c4a50-7275-4782-a8cf-0e61c8d5d836 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:47.261286 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-2f6c4a50-7275-4782-a8cf-0e61c8d5d836 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 3354b397-f391-47f2-8ded-f9227bfecb6f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:47.379616 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2f6c4a50-7275-4782-a8cf-0e61c8d5d836 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:47.390246 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2f6c4a50-7275-4782-a8cf-0e61c8d5d836 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/3354b397-f391-47f2-8ded-f9227bfecb6f" status: 200 len: 1214 microversion: 2.1 time: 0.135677 Sep 23 04:53:47.390973 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2582/5022] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:47 2022] GET /compute/v2.1/servers/3354b397-f391-47f2-8ded-f9227bfecb6f => generated 1214 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:47.437425 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d40c37a8-f190-423a-a0da-5ef2369a5af5 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46eb7f913d7e49f58af088102c5a06a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af9b29a1d1f488faf6e4dfd19055728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:47.454301 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d40c37a8-f190-423a-a0da-5ef2369a5af5 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] 10.222.0.33 "GET /compute/v2.1/servers/8ee6c95b-4f74-4f70-a118-83886aebde43" status: 200 len: 1317 microversion: 2.1 time: 0.268800 Sep 23 04:53:47.454789 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2441/5023] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:47 2022] GET /compute/v2.1/servers/8ee6c95b-4f74-4f70-a118-83886aebde43 => generated 1317 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:53:47.900045 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-32d4c0ec-7c70-4d62-825b-c918774da1c5 req-b07d206b-0939-4bb8-8b41-8bf45d685aaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ee5730a-e4f9-4dea-89ce-dafaef4989bf", "name": "network-vif-plugged", "status": "completed", "tag": "e8137c91-e05a-4bae-bd3c-9d8e75f6fd55"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:53:47.910945 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-32d4c0ec-7c70-4d62-825b-c918774da1c5 req-b07d206b-0939-4bb8-8b41-8bf45d685aaf service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:47.911693 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-32d4c0ec-7c70-4d62-825b-c918774da1c5 req-b07d206b-0939-4bb8-8b41-8bf45d685aaf service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:47.912576 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-32d4c0ec-7c70-4d62-825b-c918774da1c5 req-b07d206b-0939-4bb8-8b41-8bf45d685aaf service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:47.926351 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-32d4c0ec-7c70-4d62-825b-c918774da1c5 req-b07d206b-0939-4bb8-8b41-8bf45d685aaf service nova] Creating event network-vif-plugged:e8137c91-e05a-4bae-bd3c-9d8e75f6fd55 for instance 3ee5730a-e4f9-4dea-89ce-dafaef4989bf on n-h1-846463-3 Sep 23 04:53:47.932128 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-32d4c0ec-7c70-4d62-825b-c918774da1c5 req-b07d206b-0939-4bb8-8b41-8bf45d685aaf service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035626 Sep 23 04:53:47.932794 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2583/5024] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:53:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:53:48.032413 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-014b3de3-dca1-4b26-b31b-55f4b65ba5d0 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:48.033392 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-014b3de3-dca1-4b26-b31b-55f4b65ba5d0 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: 6174fd18-3f10-4034-85ee-32b05fde010f] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:48.047513 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-014b3de3-dca1-4b26-b31b-55f4b65ba5d0 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:48.048228 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-014b3de3-dca1-4b26-b31b-55f4b65ba5d0 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:48.049777 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-014b3de3-dca1-4b26-b31b-55f4b65ba5d0 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:48.050645 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-014b3de3-dca1-4b26-b31b-55f4b65ba5d0 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:48.054041 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-014b3de3-dca1-4b26-b31b-55f4b65ba5d0 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:48.054574 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-014b3de3-dca1-4b26-b31b-55f4b65ba5d0 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:48.255287 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-014b3de3-dca1-4b26-b31b-55f4b65ba5d0 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:48.264378 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-014b3de3-dca1-4b26-b31b-55f4b65ba5d0 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f" status: 200 len: 1517 microversion: 2.1 time: 0.236539 Sep 23 04:53:48.264906 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2442/5025] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:48 2022] GET /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f => generated 1517 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:48.418178 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e8f34cc3-03f4-4a13-a2f2-532b2a704412 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:48.419010 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e8f34cc3-03f4-4a13-a2f2-532b2a704412 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 3354b397-f391-47f2-8ded-f9227bfecb6f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:48.476601 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-fa2d0675-ad9e-4dc9-8f0a-bdc3cb374edd tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:48.477159 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e8f34cc3-03f4-4a13-a2f2-532b2a704412 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:48.477314 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-fa2d0675-ad9e-4dc9-8f0a-bdc3cb374edd tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] [instance: 8ee6c95b-4f74-4f70-a118-83886aebde43] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:48.483830 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fa2d0675-ad9e-4dc9-8f0a-bdc3cb374edd tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:48.484314 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fa2d0675-ad9e-4dc9-8f0a-bdc3cb374edd tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:48.484760 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fa2d0675-ad9e-4dc9-8f0a-bdc3cb374edd tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:48.485258 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e8f34cc3-03f4-4a13-a2f2-532b2a704412 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/3354b397-f391-47f2-8ded-f9227bfecb6f" status: 200 len: 1214 microversion: 2.1 time: 0.072128 Sep 23 04:53:48.485457 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fa2d0675-ad9e-4dc9-8f0a-bdc3cb374edd tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:48.485834 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2584/5026] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:48 2022] GET /compute/v2.1/servers/3354b397-f391-47f2-8ded-f9227bfecb6f => generated 1214 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:48.494629 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fa2d0675-ad9e-4dc9-8f0a-bdc3cb374edd tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:48.494629 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fa2d0675-ad9e-4dc9-8f0a-bdc3cb374edd tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:48.615321 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-fa2d0675-ad9e-4dc9-8f0a-bdc3cb374edd tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46eb7f913d7e49f58af088102c5a06a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af9b29a1d1f488faf6e4dfd19055728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:48.624491 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-fa2d0675-ad9e-4dc9-8f0a-bdc3cb374edd tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] 10.222.0.33 "GET /compute/v2.1/servers/8ee6c95b-4f74-4f70-a118-83886aebde43" status: 200 len: 1317 microversion: 2.1 time: 0.151779 Sep 23 04:53:48.625060 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2443/5027] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:48 2022] GET /compute/v2.1/servers/8ee6c95b-4f74-4f70-a118-83886aebde43 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:53:49.286995 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-744c000b-fb8e-45d6-a91e-f4e7158a7317 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:49.288036 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-744c000b-fb8e-45d6-a91e-f4e7158a7317 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: 6174fd18-3f10-4034-85ee-32b05fde010f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:49.295885 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-744c000b-fb8e-45d6-a91e-f4e7158a7317 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:49.296387 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-744c000b-fb8e-45d6-a91e-f4e7158a7317 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:49.296859 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-744c000b-fb8e-45d6-a91e-f4e7158a7317 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:49.297575 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-744c000b-fb8e-45d6-a91e-f4e7158a7317 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:49.298071 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-744c000b-fb8e-45d6-a91e-f4e7158a7317 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:49.298506 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-744c000b-fb8e-45d6-a91e-f4e7158a7317 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:49.454939 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-744c000b-fb8e-45d6-a91e-f4e7158a7317 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:49.463170 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-744c000b-fb8e-45d6-a91e-f4e7158a7317 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f" status: 200 len: 1517 microversion: 2.1 time: 0.180054 Sep 23 04:53:49.466199 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2585/5028] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:49 2022] GET /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f => generated 1517 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:49.513997 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-91b2c5a9-ebe0-4397-b289-a69dc3f3d6fd tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:49.514951 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-91b2c5a9-ebe0-4397-b289-a69dc3f3d6fd tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 3354b397-f391-47f2-8ded-f9227bfecb6f] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:49.523333 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-91b2c5a9-ebe0-4397-b289-a69dc3f3d6fd tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:49.523842 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-91b2c5a9-ebe0-4397-b289-a69dc3f3d6fd tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:49.524295 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-91b2c5a9-ebe0-4397-b289-a69dc3f3d6fd tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:49.525054 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-91b2c5a9-ebe0-4397-b289-a69dc3f3d6fd tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:49.525527 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-91b2c5a9-ebe0-4397-b289-a69dc3f3d6fd tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:49.526031 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-91b2c5a9-ebe0-4397-b289-a69dc3f3d6fd tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:49.615017 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-91b2c5a9-ebe0-4397-b289-a69dc3f3d6fd tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:49.624843 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-91b2c5a9-ebe0-4397-b289-a69dc3f3d6fd tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/3354b397-f391-47f2-8ded-f9227bfecb6f" status: 200 len: 1210 microversion: 2.1 time: 0.120154 Sep 23 04:53:49.628938 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2444/5029] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:49 2022] GET /compute/v2.1/servers/3354b397-f391-47f2-8ded-f9227bfecb6f => generated 1210 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:49.648215 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b7e7e9e2-9f5b-41e3-930a-718a72e7c8d5 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:49.658163 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b7e7e9e2-9f5b-41e3-930a-718a72e7c8d5 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] [instance: 8ee6c95b-4f74-4f70-a118-83886aebde43] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:49.658163 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b7e7e9e2-9f5b-41e3-930a-718a72e7c8d5 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:49.658163 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b7e7e9e2-9f5b-41e3-930a-718a72e7c8d5 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:49.658163 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b7e7e9e2-9f5b-41e3-930a-718a72e7c8d5 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:49.658163 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b7e7e9e2-9f5b-41e3-930a-718a72e7c8d5 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:49.658163 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b7e7e9e2-9f5b-41e3-930a-718a72e7c8d5 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:49.658163 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b7e7e9e2-9f5b-41e3-930a-718a72e7c8d5 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:49.971924 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-9294a9ca-6ee4-4d2f-94ef-8c8d9d087b8f req-19e3122c-e034-443e-85f3-66ff6cb170da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ee6c95b-4f74-4f70-a118-83886aebde43", "name": "network-vif-plugged", "status": "completed", "tag": "297fd5f7-23f6-499f-bf6e-a456cee539ad"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:53:49.989303 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-9294a9ca-6ee4-4d2f-94ef-8c8d9d087b8f req-19e3122c-e034-443e-85f3-66ff6cb170da service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:49.990078 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-9294a9ca-6ee4-4d2f-94ef-8c8d9d087b8f req-19e3122c-e034-443e-85f3-66ff6cb170da service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:49.991178 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-9294a9ca-6ee4-4d2f-94ef-8c8d9d087b8f req-19e3122c-e034-443e-85f3-66ff6cb170da service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:50.007994 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-9294a9ca-6ee4-4d2f-94ef-8c8d9d087b8f req-19e3122c-e034-443e-85f3-66ff6cb170da service nova] Creating event network-vif-plugged:297fd5f7-23f6-499f-bf6e-a456cee539ad for instance 8ee6c95b-4f74-4f70-a118-83886aebde43 on n-h1-846463-3 Sep 23 04:53:50.016911 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-9294a9ca-6ee4-4d2f-94ef-8c8d9d087b8f req-19e3122c-e034-443e-85f3-66ff6cb170da service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054899 Sep 23 04:53:50.019283 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2445/5030] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:53:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:53:50.269256 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b7e7e9e2-9f5b-41e3-930a-718a72e7c8d5 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46eb7f913d7e49f58af088102c5a06a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af9b29a1d1f488faf6e4dfd19055728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:50.277707 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b7e7e9e2-9f5b-41e3-930a-718a72e7c8d5 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] 10.222.0.33 "GET /compute/v2.1/servers/8ee6c95b-4f74-4f70-a118-83886aebde43" status: 200 len: 1317 microversion: 2.1 time: 0.633265 Sep 23 04:53:50.278375 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2586/5031] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:49 2022] GET /compute/v2.1/servers/8ee6c95b-4f74-4f70-a118-83886aebde43 => generated 1317 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:50.486279 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1dae572f-9919-4a57-99b3-2cbcad9e2128 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:50.486989 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-1dae572f-9919-4a57-99b3-2cbcad9e2128 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: 6174fd18-3f10-4034-85ee-32b05fde010f] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:50.493021 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1dae572f-9919-4a57-99b3-2cbcad9e2128 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:50.493513 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1dae572f-9919-4a57-99b3-2cbcad9e2128 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:50.494019 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1dae572f-9919-4a57-99b3-2cbcad9e2128 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:50.494755 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1dae572f-9919-4a57-99b3-2cbcad9e2128 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:50.495213 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1dae572f-9919-4a57-99b3-2cbcad9e2128 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:50.495649 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1dae572f-9919-4a57-99b3-2cbcad9e2128 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:50.632587 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-1dae572f-9919-4a57-99b3-2cbcad9e2128 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:50.641997 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-1dae572f-9919-4a57-99b3-2cbcad9e2128 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f" status: 200 len: 1517 microversion: 2.1 time: 0.159951 Sep 23 04:53:50.642886 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2446/5032] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:50 2022] GET /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f => generated 1517 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:50.651100 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d43c075f-619f-4fe4-b03e-03217fefca9b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:50.651831 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d43c075f-619f-4fe4-b03e-03217fefca9b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 3354b397-f391-47f2-8ded-f9227bfecb6f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:50.670328 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d43c075f-619f-4fe4-b03e-03217fefca9b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:50.671090 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d43c075f-619f-4fe4-b03e-03217fefca9b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:50.671561 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d43c075f-619f-4fe4-b03e-03217fefca9b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:50.672323 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d43c075f-619f-4fe4-b03e-03217fefca9b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:50.672794 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d43c075f-619f-4fe4-b03e-03217fefca9b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:50.673226 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d43c075f-619f-4fe4-b03e-03217fefca9b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:50.807221 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d43c075f-619f-4fe4-b03e-03217fefca9b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:50.815212 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d43c075f-619f-4fe4-b03e-03217fefca9b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/3354b397-f391-47f2-8ded-f9227bfecb6f" status: 200 len: 1274 microversion: 2.1 time: 0.169048 Sep 23 04:53:50.819914 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2587/5033] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:50 2022] GET /compute/v2.1/servers/3354b397-f391-47f2-8ded-f9227bfecb6f => generated 1274 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:51.301333 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-facc2e57-03d9-4376-8f01-933860ab6c09 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:51.302097 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-facc2e57-03d9-4376-8f01-933860ab6c09 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] [instance: 8ee6c95b-4f74-4f70-a118-83886aebde43] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:51.308691 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-facc2e57-03d9-4376-8f01-933860ab6c09 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:51.312905 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-facc2e57-03d9-4376-8f01-933860ab6c09 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:51.312905 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-facc2e57-03d9-4376-8f01-933860ab6c09 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:51.312905 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-facc2e57-03d9-4376-8f01-933860ab6c09 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:51.312905 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-facc2e57-03d9-4376-8f01-933860ab6c09 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:51.312905 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-facc2e57-03d9-4376-8f01-933860ab6c09 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:51.326813 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:53:51.504401 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-facc2e57-03d9-4376-8f01-933860ab6c09 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46eb7f913d7e49f58af088102c5a06a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af9b29a1d1f488faf6e4dfd19055728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:51.512745 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-facc2e57-03d9-4376-8f01-933860ab6c09 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] 10.222.0.33 "GET /compute/v2.1/servers/8ee6c95b-4f74-4f70-a118-83886aebde43" status: 200 len: 1317 microversion: 2.1 time: 0.215419 Sep 23 04:53:51.513347 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2447/5034] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:51 2022] GET /compute/v2.1/servers/8ee6c95b-4f74-4f70-a118-83886aebde43 => generated 1317 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:51.676360 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-63af313e-b2bf-443b-be4b-4db770db59a9 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:51.679355 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-63af313e-b2bf-443b-be4b-4db770db59a9 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: 6174fd18-3f10-4034-85ee-32b05fde010f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:51.692398 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-63af313e-b2bf-443b-be4b-4db770db59a9 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:51.694153 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-63af313e-b2bf-443b-be4b-4db770db59a9 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:51.694998 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-63af313e-b2bf-443b-be4b-4db770db59a9 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:51.698416 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-63af313e-b2bf-443b-be4b-4db770db59a9 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:51.700910 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-63af313e-b2bf-443b-be4b-4db770db59a9 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:51.702738 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-63af313e-b2bf-443b-be4b-4db770db59a9 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:51.846564 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-40b18b4f-5171-4e49-bfb4-5b6613e9f57b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:51.847178 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-40b18b4f-5171-4e49-bfb4-5b6613e9f57b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 3354b397-f391-47f2-8ded-f9227bfecb6f] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:51.854263 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-40b18b4f-5171-4e49-bfb4-5b6613e9f57b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:51.855545 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-40b18b4f-5171-4e49-bfb4-5b6613e9f57b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:51.855997 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-40b18b4f-5171-4e49-bfb4-5b6613e9f57b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:51.856924 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-40b18b4f-5171-4e49-bfb4-5b6613e9f57b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:51.857369 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-40b18b4f-5171-4e49-bfb4-5b6613e9f57b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:51.857996 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-40b18b4f-5171-4e49-bfb4-5b6613e9f57b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:51.971074 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-40b18b4f-5171-4e49-bfb4-5b6613e9f57b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:51.979077 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-63af313e-b2bf-443b-be4b-4db770db59a9 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:51.986588 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-40b18b4f-5171-4e49-bfb4-5b6613e9f57b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/3354b397-f391-47f2-8ded-f9227bfecb6f" status: 200 len: 1272 microversion: 2.1 time: 0.144095 Sep 23 04:53:51.989539 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2448/5035] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:51 2022] GET /compute/v2.1/servers/3354b397-f391-47f2-8ded-f9227bfecb6f => generated 1272 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:52.008588 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-63af313e-b2bf-443b-be4b-4db770db59a9 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f" status: 200 len: 1517 microversion: 2.1 time: 0.336583 Sep 23 04:53:52.013365 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2588/5036] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:51 2022] GET /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f => generated 1517 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:52.538707 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8f091f6c-bedd-474e-b03a-da3a4cd754f7 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:52.539417 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8f091f6c-bedd-474e-b03a-da3a4cd754f7 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] [instance: 8ee6c95b-4f74-4f70-a118-83886aebde43] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:52.546561 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8f091f6c-bedd-474e-b03a-da3a4cd754f7 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:52.547509 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8f091f6c-bedd-474e-b03a-da3a4cd754f7 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:52.548129 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8f091f6c-bedd-474e-b03a-da3a4cd754f7 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:52.549737 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8f091f6c-bedd-474e-b03a-da3a4cd754f7 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:52.550383 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8f091f6c-bedd-474e-b03a-da3a4cd754f7 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:52.550971 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8f091f6c-bedd-474e-b03a-da3a4cd754f7 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:52.824239 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8f091f6c-bedd-474e-b03a-da3a4cd754f7 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46eb7f913d7e49f58af088102c5a06a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af9b29a1d1f488faf6e4dfd19055728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:52.838216 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8f091f6c-bedd-474e-b03a-da3a4cd754f7 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] 10.222.0.33 "GET /compute/v2.1/servers/8ee6c95b-4f74-4f70-a118-83886aebde43" status: 200 len: 1505 microversion: 2.1 time: 0.304701 Sep 23 04:53:52.841492 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2449/5037] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:52 2022] GET /compute/v2.1/servers/8ee6c95b-4f74-4f70-a118-83886aebde43 => generated 1505 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:52.878292 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6ae4d6cb-bb11-45b1-a954-d3bd09e48f59 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:52.880101 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-6ae4d6cb-bb11-45b1-a954-d3bd09e48f59 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] [instance: 3ee5730a-e4f9-4dea-89ce-dafaef4989bf] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:52.889259 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6ae4d6cb-bb11-45b1-a954-d3bd09e48f59 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:52.890097 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6ae4d6cb-bb11-45b1-a954-d3bd09e48f59 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:52.894356 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6ae4d6cb-bb11-45b1-a954-d3bd09e48f59 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:52.894356 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6ae4d6cb-bb11-45b1-a954-d3bd09e48f59 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:52.894356 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6ae4d6cb-bb11-45b1-a954-d3bd09e48f59 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:52.894356 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6ae4d6cb-bb11-45b1-a954-d3bd09e48f59 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:53.076776 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6ae4d6cb-bb11-45b1-a954-d3bd09e48f59 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46eb7f913d7e49f58af088102c5a06a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af9b29a1d1f488faf6e4dfd19055728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:53.084686 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-6ae4d6cb-bb11-45b1-a954-d3bd09e48f59 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] 10.222.0.33 "GET /compute/v2.1/servers/3ee5730a-e4f9-4dea-89ce-dafaef4989bf" status: 200 len: 1504 microversion: 2.1 time: 0.210673 Sep 23 04:53:53.088995 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2450/5038] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:52 2022] GET /compute/v2.1/servers/3ee5730a-e4f9-4dea-89ce-dafaef4989bf => generated 1504 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:53.091803 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-06bbf41c-9bdd-466f-99e4-018eff021f68 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:53.094077 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-06bbf41c-9bdd-466f-99e4-018eff021f68 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 3354b397-f391-47f2-8ded-f9227bfecb6f] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:53.100240 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-06bbf41c-9bdd-466f-99e4-018eff021f68 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:53.100997 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-06bbf41c-9bdd-466f-99e4-018eff021f68 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:53.101764 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-06bbf41c-9bdd-466f-99e4-018eff021f68 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:53.102720 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-06bbf41c-9bdd-466f-99e4-018eff021f68 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:53.103913 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-06bbf41c-9bdd-466f-99e4-018eff021f68 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:53.104582 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-06bbf41c-9bdd-466f-99e4-018eff021f68 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:53.133685 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a033626e-c6e1-4b3d-981b-46809cb1c7b1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-47887660 tempest-PortsAdminExtendedAttrsIpV6TestJSON-47887660-project-admin] Calling method '.version_select at 0x7ff1bb8d8b80>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:53.135865 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a033626e-c6e1-4b3d-981b-46809cb1c7b1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-47887660 tempest-PortsAdminExtendedAttrsIpV6TestJSON-47887660-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:53.136562 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a033626e-c6e1-4b3d-981b-46809cb1c7b1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-47887660 tempest-PortsAdminExtendedAttrsIpV6TestJSON-47887660-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:53.137005 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a033626e-c6e1-4b3d-981b-46809cb1c7b1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-47887660 tempest-PortsAdminExtendedAttrsIpV6TestJSON-47887660-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:53.156028 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a033626e-c6e1-4b3d-981b-46809cb1c7b1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-47887660 tempest-PortsAdminExtendedAttrsIpV6TestJSON-47887660-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:53.156863 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a033626e-c6e1-4b3d-981b-46809cb1c7b1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-47887660 tempest-PortsAdminExtendedAttrsIpV6TestJSON-47887660-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:53.157492 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a033626e-c6e1-4b3d-981b-46809cb1c7b1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-47887660 tempest-PortsAdminExtendedAttrsIpV6TestJSON-47887660-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:53.170233 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a033626e-c6e1-4b3d-981b-46809cb1c7b1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-47887660 tempest-PortsAdminExtendedAttrsIpV6TestJSON-47887660-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:53.170726 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a033626e-c6e1-4b3d-981b-46809cb1c7b1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-47887660 tempest-PortsAdminExtendedAttrsIpV6TestJSON-47887660-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:53.171161 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a033626e-c6e1-4b3d-981b-46809cb1c7b1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-47887660 tempest-PortsAdminExtendedAttrsIpV6TestJSON-47887660-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:53.177311 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a033626e-c6e1-4b3d-981b-46809cb1c7b1 tempest-PortsAdminExtendedAttrsIpV6TestJSON-47887660 tempest-PortsAdminExtendedAttrsIpV6TestJSON-47887660-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.347374 Sep 23 04:53:53.177952 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2589/5039] 10.222.0.33 () {58 vars in 1146 bytes} [Fri Sep 23 04:53:52 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:53:53.183271 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8d88c67b-c248-4594-b196-aeb4666bbaeb tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:53.184135 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-8d88c67b-c248-4594-b196-aeb4666bbaeb tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: 6174fd18-3f10-4034-85ee-32b05fde010f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:53.190921 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8d88c67b-c248-4594-b196-aeb4666bbaeb tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:53.191405 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8d88c67b-c248-4594-b196-aeb4666bbaeb tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:53.191987 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8d88c67b-c248-4594-b196-aeb4666bbaeb tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:53.193126 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8d88c67b-c248-4594-b196-aeb4666bbaeb tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:53.193325 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8d88c67b-c248-4594-b196-aeb4666bbaeb tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:53.193947 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8d88c67b-c248-4594-b196-aeb4666bbaeb tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:53.428715 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-06bbf41c-9bdd-466f-99e4-018eff021f68 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:53.437592 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-06bbf41c-9bdd-466f-99e4-018eff021f68 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/3354b397-f391-47f2-8ded-f9227bfecb6f" status: 200 len: 1314 microversion: 2.1 time: 0.351006 Sep 23 04:53:53.438533 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2451/5040] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:53 2022] GET /compute/v2.1/servers/3354b397-f391-47f2-8ded-f9227bfecb6f => generated 1314 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:53.459177 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1b749886-e081-4783-a65b-3633f09befd6 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:53.462209 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-1b749886-e081-4783-a65b-3633f09befd6 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] [instance: 3ee5730a-e4f9-4dea-89ce-dafaef4989bf] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:53.467142 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1b749886-e081-4783-a65b-3633f09befd6 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:53.467651 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1b749886-e081-4783-a65b-3633f09befd6 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:53.468104 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1b749886-e081-4783-a65b-3633f09befd6 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:53.469011 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1b749886-e081-4783-a65b-3633f09befd6 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:53.469544 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1b749886-e081-4783-a65b-3633f09befd6 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:53.470198 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1b749886-e081-4783-a65b-3633f09befd6 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:53.477899 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-8d88c67b-c248-4594-b196-aeb4666bbaeb tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:53.488528 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-8d88c67b-c248-4594-b196-aeb4666bbaeb tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f" status: 200 len: 1517 microversion: 2.1 time: 0.309290 Sep 23 04:53:53.489117 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2590/5041] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:53 2022] GET /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f => generated 1517 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:53.511205 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-1b749886-e081-4783-a65b-3633f09befd6 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] [instance: 3ee5730a-e4f9-4dea-89ce-dafaef4989bf] Going to try to terminate instance {{(pid=122698) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:53:53.766643 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-daeae38a-14f5-4548-8024-cb590eb462ab req-6a03e711-afe4-4d6e-bbac-efa572e0bc8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3354b397-f391-47f2-8ded-f9227bfecb6f", "tag": "2e084b59-e468-45fb-8081-c4bafdb31c08"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:53:53.792331 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-daeae38a-14f5-4548-8024-cb590eb462ab req-6a03e711-afe4-4d6e-bbac-efa572e0bc8c service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:53.793152 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-daeae38a-14f5-4548-8024-cb590eb462ab req-6a03e711-afe4-4d6e-bbac-efa572e0bc8c service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:53.793686 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-daeae38a-14f5-4548-8024-cb590eb462ab req-6a03e711-afe4-4d6e-bbac-efa572e0bc8c service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:53.806407 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-daeae38a-14f5-4548-8024-cb590eb462ab req-6a03e711-afe4-4d6e-bbac-efa572e0bc8c service nova] Creating event network-changed:2e084b59-e468-45fb-8081-c4bafdb31c08 for instance 3354b397-f391-47f2-8ded-f9227bfecb6f on n-h1-846463-3 Sep 23 04:53:53.812227 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-daeae38a-14f5-4548-8024-cb590eb462ab req-6a03e711-afe4-4d6e-bbac-efa572e0bc8c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050004 Sep 23 04:53:53.813528 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2591/5042] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:53:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:53:53.851828 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-1b749886-e081-4783-a65b-3633f09befd6 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] 10.222.0.33 "DELETE /compute/v2.1/servers/3ee5730a-e4f9-4dea-89ce-dafaef4989bf" status: 204 len: 0 microversion: 2.1 time: 0.396735 Sep 23 04:53:53.855631 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2452/5043] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:53:53 2022] DELETE /compute/v2.1/servers/3ee5730a-e4f9-4dea-89ce-dafaef4989bf => generated 0 bytes in 399 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:53:53.862688 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-401e1cc1-382d-4258-b018-cb8146935111 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:53.863527 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-401e1cc1-382d-4258-b018-cb8146935111 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] [instance: 8ee6c95b-4f74-4f70-a118-83886aebde43] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:53.876683 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-401e1cc1-382d-4258-b018-cb8146935111 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:53.876683 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-401e1cc1-382d-4258-b018-cb8146935111 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:53.876683 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-401e1cc1-382d-4258-b018-cb8146935111 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:53.878277 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-401e1cc1-382d-4258-b018-cb8146935111 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:53.878901 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-401e1cc1-382d-4258-b018-cb8146935111 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:53.879518 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-401e1cc1-382d-4258-b018-cb8146935111 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:53.912087 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-401e1cc1-382d-4258-b018-cb8146935111 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] [instance: 8ee6c95b-4f74-4f70-a118-83886aebde43] Going to try to terminate instance {{(pid=122699) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:53:54.159769 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:53:54.304084 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-401e1cc1-382d-4258-b018-cb8146935111 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] 10.222.0.33 "DELETE /compute/v2.1/servers/8ee6c95b-4f74-4f70-a118-83886aebde43" status: 204 len: 0 microversion: 2.1 time: 0.445910 Sep 23 04:53:54.307951 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2592/5044] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:53:53 2022] DELETE /compute/v2.1/servers/8ee6c95b-4f74-4f70-a118-83886aebde43 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 23 04:53:54.315217 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-600a98ac-8ef9-439c-8f97-c2d17700ffdd tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:54.316054 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-600a98ac-8ef9-439c-8f97-c2d17700ffdd tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] [instance: 3ee5730a-e4f9-4dea-89ce-dafaef4989bf] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:54.331719 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-600a98ac-8ef9-439c-8f97-c2d17700ffdd tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:54.332599 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-600a98ac-8ef9-439c-8f97-c2d17700ffdd tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:54.333380 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-600a98ac-8ef9-439c-8f97-c2d17700ffdd tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:54.334326 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-600a98ac-8ef9-439c-8f97-c2d17700ffdd tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:54.335762 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-600a98ac-8ef9-439c-8f97-c2d17700ffdd tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:54.336396 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-600a98ac-8ef9-439c-8f97-c2d17700ffdd tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:54.464120 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6561c3ea-3fc1-4cad-98bc-61a44b62fbfe tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:54.465144 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-6561c3ea-3fc1-4cad-98bc-61a44b62fbfe tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 3354b397-f391-47f2-8ded-f9227bfecb6f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:54.471539 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6561c3ea-3fc1-4cad-98bc-61a44b62fbfe tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:54.472559 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6561c3ea-3fc1-4cad-98bc-61a44b62fbfe tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:54.473080 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6561c3ea-3fc1-4cad-98bc-61a44b62fbfe tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:54.473867 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6561c3ea-3fc1-4cad-98bc-61a44b62fbfe tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:54.474433 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6561c3ea-3fc1-4cad-98bc-61a44b62fbfe tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:54.474938 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6561c3ea-3fc1-4cad-98bc-61a44b62fbfe tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:54.559597 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-600a98ac-8ef9-439c-8f97-c2d17700ffdd tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46eb7f913d7e49f58af088102c5a06a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af9b29a1d1f488faf6e4dfd19055728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:54.567607 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-600a98ac-8ef9-439c-8f97-c2d17700ffdd tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] 10.222.0.33 "GET /compute/v2.1/servers/3ee5730a-e4f9-4dea-89ce-dafaef4989bf" status: 200 len: 1510 microversion: 2.1 time: 0.257062 Sep 23 04:53:54.568284 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2453/5045] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:54 2022] GET /compute/v2.1/servers/3ee5730a-e4f9-4dea-89ce-dafaef4989bf => generated 1510 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:54.573377 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c8e4efee-0603-4eaa-b86f-55561a35ec27 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:54.574025 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c8e4efee-0603-4eaa-b86f-55561a35ec27 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: 6174fd18-3f10-4034-85ee-32b05fde010f] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:54.579964 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c8e4efee-0603-4eaa-b86f-55561a35ec27 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:54.580513 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c8e4efee-0603-4eaa-b86f-55561a35ec27 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:54.580983 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c8e4efee-0603-4eaa-b86f-55561a35ec27 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:54.581901 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c8e4efee-0603-4eaa-b86f-55561a35ec27 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:54.582478 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c8e4efee-0603-4eaa-b86f-55561a35ec27 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:54.582918 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c8e4efee-0603-4eaa-b86f-55561a35ec27 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:54.674657 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-6561c3ea-3fc1-4cad-98bc-61a44b62fbfe tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:54.684072 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6561c3ea-3fc1-4cad-98bc-61a44b62fbfe tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/3354b397-f391-47f2-8ded-f9227bfecb6f" status: 200 len: 1314 microversion: 2.1 time: 0.226703 Sep 23 04:53:54.686616 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2593/5046] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:54 2022] GET /compute/v2.1/servers/3354b397-f391-47f2-8ded-f9227bfecb6f => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:53:54.795207 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c8e4efee-0603-4eaa-b86f-55561a35ec27 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:54.803513 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c8e4efee-0603-4eaa-b86f-55561a35ec27 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f" status: 200 len: 1517 microversion: 2.1 time: 0.234149 Sep 23 04:53:54.804392 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2454/5047] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:54 2022] GET /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f => generated 1517 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:55.598145 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-bac90c51-3295-44b1-a076-7a0c4bfd02fd tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:55.598638 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-bac90c51-3295-44b1-a076-7a0c4bfd02fd tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] [instance: 3ee5730a-e4f9-4dea-89ce-dafaef4989bf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:55.606122 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bac90c51-3295-44b1-a076-7a0c4bfd02fd tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:55.606626 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bac90c51-3295-44b1-a076-7a0c4bfd02fd tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:55.607068 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bac90c51-3295-44b1-a076-7a0c4bfd02fd tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:55.607780 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bac90c51-3295-44b1-a076-7a0c4bfd02fd tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:55.608246 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bac90c51-3295-44b1-a076-7a0c4bfd02fd tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:55.608676 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bac90c51-3295-44b1-a076-7a0c4bfd02fd tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:55.711428 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9d994aba-3d9e-40c2-8a77-fe1299415455 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:55.712583 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-9d994aba-3d9e-40c2-8a77-fe1299415455 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 3354b397-f391-47f2-8ded-f9227bfecb6f] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:55.721881 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9d994aba-3d9e-40c2-8a77-fe1299415455 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:55.722672 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9d994aba-3d9e-40c2-8a77-fe1299415455 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:55.723332 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9d994aba-3d9e-40c2-8a77-fe1299415455 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:55.724615 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9d994aba-3d9e-40c2-8a77-fe1299415455 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:55.725285 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9d994aba-3d9e-40c2-8a77-fe1299415455 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:55.727355 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9d994aba-3d9e-40c2-8a77-fe1299415455 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:55.768551 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-bac90c51-3295-44b1-a076-7a0c4bfd02fd tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46eb7f913d7e49f58af088102c5a06a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af9b29a1d1f488faf6e4dfd19055728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:55.776431 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-bac90c51-3295-44b1-a076-7a0c4bfd02fd tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] 10.222.0.33 "GET /compute/v2.1/servers/3ee5730a-e4f9-4dea-89ce-dafaef4989bf" status: 200 len: 1510 microversion: 2.1 time: 0.187855 Sep 23 04:53:55.777216 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2594/5048] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:55 2022] GET /compute/v2.1/servers/3ee5730a-e4f9-4dea-89ce-dafaef4989bf => generated 1510 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:55.828476 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a4459b8e-8ac8-4131-be3c-3530af17952d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:55.829300 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a4459b8e-8ac8-4131-be3c-3530af17952d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: 6174fd18-3f10-4034-85ee-32b05fde010f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:55.836640 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a4459b8e-8ac8-4131-be3c-3530af17952d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:55.837412 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a4459b8e-8ac8-4131-be3c-3530af17952d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:55.839614 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a4459b8e-8ac8-4131-be3c-3530af17952d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:55.840864 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a4459b8e-8ac8-4131-be3c-3530af17952d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:55.841545 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a4459b8e-8ac8-4131-be3c-3530af17952d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:55.842162 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a4459b8e-8ac8-4131-be3c-3530af17952d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:55.880644 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-9d994aba-3d9e-40c2-8a77-fe1299415455 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:55.888762 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9d994aba-3d9e-40c2-8a77-fe1299415455 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/3354b397-f391-47f2-8ded-f9227bfecb6f" status: 200 len: 1314 microversion: 2.1 time: 0.181553 Sep 23 04:53:55.889354 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2455/5049] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:55 2022] GET /compute/v2.1/servers/3354b397-f391-47f2-8ded-f9227bfecb6f => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:53:56.014201 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a4459b8e-8ac8-4131-be3c-3530af17952d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:56.022176 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a4459b8e-8ac8-4131-be3c-3530af17952d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f" status: 200 len: 1517 microversion: 2.1 time: 0.197904 Sep 23 04:53:56.022773 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2595/5050] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:55 2022] GET /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f => generated 1517 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:56.801105 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e3c72a30-a670-49ab-9235-eb50dea98a58 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:56.801731 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e3c72a30-a670-49ab-9235-eb50dea98a58 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] [instance: 3ee5730a-e4f9-4dea-89ce-dafaef4989bf] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:56.810500 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e3c72a30-a670-49ab-9235-eb50dea98a58 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:56.819454 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e3c72a30-a670-49ab-9235-eb50dea98a58 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:56.819454 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e3c72a30-a670-49ab-9235-eb50dea98a58 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:56.819454 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e3c72a30-a670-49ab-9235-eb50dea98a58 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:56.819454 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e3c72a30-a670-49ab-9235-eb50dea98a58 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:56.819454 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e3c72a30-a670-49ab-9235-eb50dea98a58 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:56.914053 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2ed2f234-4b37-4b8d-8c7c-a9d7664710a3 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:56.914603 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-2ed2f234-4b37-4b8d-8c7c-a9d7664710a3 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 3354b397-f391-47f2-8ded-f9227bfecb6f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:56.922638 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2ed2f234-4b37-4b8d-8c7c-a9d7664710a3 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:56.923146 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2ed2f234-4b37-4b8d-8c7c-a9d7664710a3 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:56.923599 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2ed2f234-4b37-4b8d-8c7c-a9d7664710a3 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:56.924321 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2ed2f234-4b37-4b8d-8c7c-a9d7664710a3 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:56.924788 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2ed2f234-4b37-4b8d-8c7c-a9d7664710a3 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:56.925639 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2ed2f234-4b37-4b8d-8c7c-a9d7664710a3 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:57.111966 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:53:57.195139 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e3c72a30-a670-49ab-9235-eb50dea98a58 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46eb7f913d7e49f58af088102c5a06a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af9b29a1d1f488faf6e4dfd19055728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:57.209294 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e3c72a30-a670-49ab-9235-eb50dea98a58 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] 10.222.0.33 "GET /compute/v2.1/servers/3ee5730a-e4f9-4dea-89ce-dafaef4989bf" status: 200 len: 1510 microversion: 2.1 time: 0.412542 Sep 23 04:53:57.210791 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2456/5051] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:56 2022] GET /compute/v2.1/servers/3ee5730a-e4f9-4dea-89ce-dafaef4989bf => generated 1510 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:57.218153 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a34ccd6e-991c-4d45-942b-b026682913a8 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:57.219026 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a34ccd6e-991c-4d45-942b-b026682913a8 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: 6174fd18-3f10-4034-85ee-32b05fde010f] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:57.231530 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2ed2f234-4b37-4b8d-8c7c-a9d7664710a3 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:57.238935 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2ed2f234-4b37-4b8d-8c7c-a9d7664710a3 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/3354b397-f391-47f2-8ded-f9227bfecb6f" status: 200 len: 1314 microversion: 2.1 time: 0.329338 Sep 23 04:53:57.241208 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2596/5052] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:56 2022] GET /compute/v2.1/servers/3354b397-f391-47f2-8ded-f9227bfecb6f => generated 1314 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:57.244519 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a34ccd6e-991c-4d45-942b-b026682913a8 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:57.245037 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a34ccd6e-991c-4d45-942b-b026682913a8 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:57.245484 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a34ccd6e-991c-4d45-942b-b026682913a8 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:57.246242 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a34ccd6e-991c-4d45-942b-b026682913a8 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:57.246711 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a34ccd6e-991c-4d45-942b-b026682913a8 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:57.247146 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a34ccd6e-991c-4d45-942b-b026682913a8 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:57.428457 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a34ccd6e-991c-4d45-942b-b026682913a8 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:57.437560 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a34ccd6e-991c-4d45-942b-b026682913a8 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f" status: 200 len: 1517 microversion: 2.1 time: 0.225495 Sep 23 04:53:57.438195 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2457/5053] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:57 2022] GET /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f => generated 1517 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:57.635432 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-4d156fe8-dce9-49f0-b848-f3a0d1b80767 req-2aa9ae07-b3b8-459d-9f09-fadb5ccd1594 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ee5730a-e4f9-4dea-89ce-dafaef4989bf", "name": "network-vif-deleted", "tag": "e8137c91-e05a-4bae-bd3c-9d8e75f6fd55"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:53:57.659660 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-4d156fe8-dce9-49f0-b848-f3a0d1b80767 req-2aa9ae07-b3b8-459d-9f09-fadb5ccd1594 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:57.662624 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-4d156fe8-dce9-49f0-b848-f3a0d1b80767 req-2aa9ae07-b3b8-459d-9f09-fadb5ccd1594 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:57.664847 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-4d156fe8-dce9-49f0-b848-f3a0d1b80767 req-2aa9ae07-b3b8-459d-9f09-fadb5ccd1594 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:57.690863 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-4d156fe8-dce9-49f0-b848-f3a0d1b80767 req-2aa9ae07-b3b8-459d-9f09-fadb5ccd1594 service nova] Creating event network-vif-deleted:e8137c91-e05a-4bae-bd3c-9d8e75f6fd55 for instance 3ee5730a-e4f9-4dea-89ce-dafaef4989bf on n-h1-846463-3 Sep 23 04:53:57.696794 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-4d156fe8-dce9-49f0-b848-f3a0d1b80767 req-2aa9ae07-b3b8-459d-9f09-fadb5ccd1594 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067351 Sep 23 04:53:57.698015 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2597/5054] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:53:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:53:58.238588 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b9a3201e-09da-49b9-8be4-db3f1cc90717 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:58.239524 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b9a3201e-09da-49b9-8be4-db3f1cc90717 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] [instance: 3ee5730a-e4f9-4dea-89ce-dafaef4989bf] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:58.247326 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b9a3201e-09da-49b9-8be4-db3f1cc90717 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:58.247837 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b9a3201e-09da-49b9-8be4-db3f1cc90717 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:58.248290 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b9a3201e-09da-49b9-8be4-db3f1cc90717 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:58.249015 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b9a3201e-09da-49b9-8be4-db3f1cc90717 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:58.256998 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b9a3201e-09da-49b9-8be4-db3f1cc90717 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:58.256998 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b9a3201e-09da-49b9-8be4-db3f1cc90717 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:58.277138 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ba7773b1-b82a-4aef-89cf-aeff9f490a43 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:58.280192 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ba7773b1-b82a-4aef-89cf-aeff9f490a43 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 3354b397-f391-47f2-8ded-f9227bfecb6f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:58.297729 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ba7773b1-b82a-4aef-89cf-aeff9f490a43 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:58.298541 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ba7773b1-b82a-4aef-89cf-aeff9f490a43 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:58.299616 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ba7773b1-b82a-4aef-89cf-aeff9f490a43 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:58.300792 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ba7773b1-b82a-4aef-89cf-aeff9f490a43 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:58.301460 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ba7773b1-b82a-4aef-89cf-aeff9f490a43 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:58.302115 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ba7773b1-b82a-4aef-89cf-aeff9f490a43 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:58.348500 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b9a3201e-09da-49b9-8be4-db3f1cc90717 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46eb7f913d7e49f58af088102c5a06a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af9b29a1d1f488faf6e4dfd19055728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:58.358428 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b9a3201e-09da-49b9-8be4-db3f1cc90717 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] 10.222.0.33 "GET /compute/v2.1/servers/3ee5730a-e4f9-4dea-89ce-dafaef4989bf" status: 200 len: 1468 microversion: 2.1 time: 0.123682 Sep 23 04:53:58.359326 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2458/5055] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:58 2022] GET /compute/v2.1/servers/3ee5730a-e4f9-4dea-89ce-dafaef4989bf => generated 1468 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:58.460794 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2382fe83-603e-4f87-9b4b-3bbc7fb2e131 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:58.461415 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-2382fe83-603e-4f87-9b4b-3bbc7fb2e131 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: 6174fd18-3f10-4034-85ee-32b05fde010f] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:58.468277 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2382fe83-603e-4f87-9b4b-3bbc7fb2e131 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:58.469149 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2382fe83-603e-4f87-9b4b-3bbc7fb2e131 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:58.469750 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2382fe83-603e-4f87-9b4b-3bbc7fb2e131 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:58.470646 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2382fe83-603e-4f87-9b4b-3bbc7fb2e131 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:58.471265 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2382fe83-603e-4f87-9b4b-3bbc7fb2e131 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:58.471984 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2382fe83-603e-4f87-9b4b-3bbc7fb2e131 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:58.479284 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ba7773b1-b82a-4aef-89cf-aeff9f490a43 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:58.485924 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=10 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:53:58.488334 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ba7773b1-b82a-4aef-89cf-aeff9f490a43 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/3354b397-f391-47f2-8ded-f9227bfecb6f" status: 200 len: 1314 microversion: 2.1 time: 0.221379 Sep 23 04:53:58.489660 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2598/5056] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:58 2022] GET /compute/v2.1/servers/3354b397-f391-47f2-8ded-f9227bfecb6f => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:53:58.755745 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-2382fe83-603e-4f87-9b4b-3bbc7fb2e131 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:58.772631 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2382fe83-603e-4f87-9b4b-3bbc7fb2e131 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f" status: 200 len: 1517 microversion: 2.1 time: 0.315715 Sep 23 04:53:58.773232 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2459/5057] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:58 2022] GET /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f => generated 1517 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:53:59.383121 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-bbdea7af-a986-4d35-9cb1-8fc4655f93af tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:59.384641 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-bbdea7af-a986-4d35-9cb1-8fc4655f93af tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] [instance: 3ee5730a-e4f9-4dea-89ce-dafaef4989bf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:59.392031 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bbdea7af-a986-4d35-9cb1-8fc4655f93af tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:59.392754 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bbdea7af-a986-4d35-9cb1-8fc4655f93af tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:59.393196 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bbdea7af-a986-4d35-9cb1-8fc4655f93af tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:59.393919 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bbdea7af-a986-4d35-9cb1-8fc4655f93af tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:59.394384 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bbdea7af-a986-4d35-9cb1-8fc4655f93af tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:59.394814 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bbdea7af-a986-4d35-9cb1-8fc4655f93af tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:59.445602 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bbdea7af-a986-4d35-9cb1-8fc4655f93af tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:59.446139 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bbdea7af-a986-4d35-9cb1-8fc4655f93af tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:59.446700 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bbdea7af-a986-4d35-9cb1-8fc4655f93af tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:59.451388 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-bbdea7af-a986-4d35-9cb1-8fc4655f93af tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lazy-loading 'fault' on Instance uuid 3ee5730a-e4f9-4dea-89ce-dafaef4989bf {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:53:59.518093 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-bbdea7af-a986-4d35-9cb1-8fc4655f93af tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46eb7f913d7e49f58af088102c5a06a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af9b29a1d1f488faf6e4dfd19055728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:59.518298 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a2fb4179-d772-4f29-a72b-5c31215a61e4 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:59.518972 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a2fb4179-d772-4f29-a72b-5c31215a61e4 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 3354b397-f391-47f2-8ded-f9227bfecb6f] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:59.535520 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a2fb4179-d772-4f29-a72b-5c31215a61e4 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:59.539250 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a2fb4179-d772-4f29-a72b-5c31215a61e4 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:59.539250 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a2fb4179-d772-4f29-a72b-5c31215a61e4 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:59.539250 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a2fb4179-d772-4f29-a72b-5c31215a61e4 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:59.539250 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a2fb4179-d772-4f29-a72b-5c31215a61e4 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:59.539250 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a2fb4179-d772-4f29-a72b-5c31215a61e4 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:59.542361 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-bbdea7af-a986-4d35-9cb1-8fc4655f93af tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] 10.222.0.33 "GET /compute/v2.1/servers/3ee5730a-e4f9-4dea-89ce-dafaef4989bf" status: 200 len: 1307 microversion: 2.1 time: 0.163346 Sep 23 04:53:59.543178 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2599/5058] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:59 2022] GET /compute/v2.1/servers/3ee5730a-e4f9-4dea-89ce-dafaef4989bf => generated 1307 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:53:59.717645 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a2fb4179-d772-4f29-a72b-5c31215a61e4 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:53:59.729377 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a2fb4179-d772-4f29-a72b-5c31215a61e4 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/3354b397-f391-47f2-8ded-f9227bfecb6f" status: 200 len: 1314 microversion: 2.1 time: 0.215407 Sep 23 04:53:59.730485 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2460/5059] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:59 2022] GET /compute/v2.1/servers/3354b397-f391-47f2-8ded-f9227bfecb6f => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:53:59.751839 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-705fddf9-cc8b-440d-b019-943285567747 req-4a349fb7-b23d-40df-809a-e9e76de7ec50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ee6c95b-4f74-4f70-a118-83886aebde43", "name": "network-vif-deleted", "tag": "297fd5f7-23f6-499f-bf6e-a456cee539ad"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:53:59.762771 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-705fddf9-cc8b-440d-b019-943285567747 req-4a349fb7-b23d-40df-809a-e9e76de7ec50 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:59.763153 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-705fddf9-cc8b-440d-b019-943285567747 req-4a349fb7-b23d-40df-809a-e9e76de7ec50 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:59.763859 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-705fddf9-cc8b-440d-b019-943285567747 req-4a349fb7-b23d-40df-809a-e9e76de7ec50 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:59.777358 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-705fddf9-cc8b-440d-b019-943285567747 req-4a349fb7-b23d-40df-809a-e9e76de7ec50 service nova] Creating event network-vif-deleted:297fd5f7-23f6-499f-bf6e-a456cee539ad for instance 8ee6c95b-4f74-4f70-a118-83886aebde43 on n-h1-846463-3 Sep 23 04:53:59.783444 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-705fddf9-cc8b-440d-b019-943285567747 req-4a349fb7-b23d-40df-809a-e9e76de7ec50 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035269 Sep 23 04:53:59.784339 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2600/5060] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:53:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:53:59.797404 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d293acf5-1c40-4b45-91ec-f4bd26439da4 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:53:59.798243 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d293acf5-1c40-4b45-91ec-f4bd26439da4 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: 6174fd18-3f10-4034-85ee-32b05fde010f] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:53:59.823872 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d293acf5-1c40-4b45-91ec-f4bd26439da4 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:59.831964 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d293acf5-1c40-4b45-91ec-f4bd26439da4 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:59.831964 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d293acf5-1c40-4b45-91ec-f4bd26439da4 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:53:59.831964 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d293acf5-1c40-4b45-91ec-f4bd26439da4 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:53:59.831964 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d293acf5-1c40-4b45-91ec-f4bd26439da4 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:53:59.831964 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d293acf5-1c40-4b45-91ec-f4bd26439da4 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:00.009954 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d293acf5-1c40-4b45-91ec-f4bd26439da4 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:00.017255 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d293acf5-1c40-4b45-91ec-f4bd26439da4 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f" status: 200 len: 1517 microversion: 2.1 time: 0.224471 Sep 23 04:54:00.017849 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2461/5061] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:53:59 2022] GET /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f => generated 1517 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:54:00.572055 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f589eac8-bff2-462f-8311-96c90f96a3d5 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:00.573516 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f589eac8-bff2-462f-8311-96c90f96a3d5 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] [instance: 3ee5730a-e4f9-4dea-89ce-dafaef4989bf] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:00.594765 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f589eac8-bff2-462f-8311-96c90f96a3d5 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:00.596291 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f589eac8-bff2-462f-8311-96c90f96a3d5 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:00.596974 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f589eac8-bff2-462f-8311-96c90f96a3d5 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:00.598029 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f589eac8-bff2-462f-8311-96c90f96a3d5 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:00.598738 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f589eac8-bff2-462f-8311-96c90f96a3d5 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:00.599993 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f589eac8-bff2-462f-8311-96c90f96a3d5 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:00.642612 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:54:00.646377 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f589eac8-bff2-462f-8311-96c90f96a3d5 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:00.646844 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f589eac8-bff2-462f-8311-96c90f96a3d5 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:00.647294 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f589eac8-bff2-462f-8311-96c90f96a3d5 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:00.647851 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-f589eac8-bff2-462f-8311-96c90f96a3d5 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lazy-loading 'fault' on Instance uuid 3ee5730a-e4f9-4dea-89ce-dafaef4989bf {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:54:00.701860 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f589eac8-bff2-462f-8311-96c90f96a3d5 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46eb7f913d7e49f58af088102c5a06a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af9b29a1d1f488faf6e4dfd19055728', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:00.709392 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f589eac8-bff2-462f-8311-96c90f96a3d5 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] 10.222.0.33 "GET /compute/v2.1/servers/3ee5730a-e4f9-4dea-89ce-dafaef4989bf" status: 200 len: 1307 microversion: 2.1 time: 0.143591 Sep 23 04:54:00.710001 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2601/5062] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:00 2022] GET /compute/v2.1/servers/3ee5730a-e4f9-4dea-89ce-dafaef4989bf => generated 1307 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:54:00.756612 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7a259b72-514f-4d7a-9aac-2c5e22e81423 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:00.759567 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7a259b72-514f-4d7a-9aac-2c5e22e81423 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 3354b397-f391-47f2-8ded-f9227bfecb6f] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:00.767030 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7a259b72-514f-4d7a-9aac-2c5e22e81423 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:00.767536 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7a259b72-514f-4d7a-9aac-2c5e22e81423 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:00.767986 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7a259b72-514f-4d7a-9aac-2c5e22e81423 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:00.768724 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7a259b72-514f-4d7a-9aac-2c5e22e81423 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:00.769366 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7a259b72-514f-4d7a-9aac-2c5e22e81423 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:00.771258 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7a259b72-514f-4d7a-9aac-2c5e22e81423 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:00.791947 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:54:00.920579 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-7a259b72-514f-4d7a-9aac-2c5e22e81423 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:00.929015 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7a259b72-514f-4d7a-9aac-2c5e22e81423 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/3354b397-f391-47f2-8ded-f9227bfecb6f" status: 200 len: 1314 microversion: 2.1 time: 0.178078 Sep 23 04:54:00.929592 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2462/5063] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:00 2022] GET /compute/v2.1/servers/3354b397-f391-47f2-8ded-f9227bfecb6f => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:54:01.042054 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3de1e8a3-0c3d-4689-9743-dc6f1acb9d05 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:01.042893 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-3de1e8a3-0c3d-4689-9743-dc6f1acb9d05 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: 6174fd18-3f10-4034-85ee-32b05fde010f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:01.050624 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3de1e8a3-0c3d-4689-9743-dc6f1acb9d05 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:01.051129 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3de1e8a3-0c3d-4689-9743-dc6f1acb9d05 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:01.051569 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3de1e8a3-0c3d-4689-9743-dc6f1acb9d05 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:01.052942 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3de1e8a3-0c3d-4689-9743-dc6f1acb9d05 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:01.053416 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3de1e8a3-0c3d-4689-9743-dc6f1acb9d05 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:01.053843 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3de1e8a3-0c3d-4689-9743-dc6f1acb9d05 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:01.281996 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-3de1e8a3-0c3d-4689-9743-dc6f1acb9d05 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:01.293681 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3de1e8a3-0c3d-4689-9743-dc6f1acb9d05 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f" status: 200 len: 1517 microversion: 2.1 time: 0.256932 Sep 23 04:54:01.294389 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2602/5064] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:01 2022] GET /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f => generated 1517 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:54:01.733084 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-079e325d-d7b0-4ae2-b9d7-c3d7c40b39e3 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:01.734059 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-079e325d-d7b0-4ae2-b9d7-c3d7c40b39e3 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] [instance: 3ee5730a-e4f9-4dea-89ce-dafaef4989bf] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:01.742949 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-079e325d-d7b0-4ae2-b9d7-c3d7c40b39e3 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:01.744437 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-079e325d-d7b0-4ae2-b9d7-c3d7c40b39e3 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:01.745063 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-079e325d-d7b0-4ae2-b9d7-c3d7c40b39e3 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:01.745820 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-079e325d-d7b0-4ae2-b9d7-c3d7c40b39e3 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:01.746445 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-079e325d-d7b0-4ae2-b9d7-c3d7c40b39e3 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:01.746873 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-079e325d-d7b0-4ae2-b9d7-c3d7c40b39e3 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:01.764598 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-079e325d-d7b0-4ae2-b9d7-c3d7c40b39e3 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] HTTP exception thrown: Instance 3ee5730a-e4f9-4dea-89ce-dafaef4989bf could not be found. Sep 23 04:54:01.766356 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-079e325d-d7b0-4ae2-b9d7-c3d7c40b39e3 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Request method failure captured: Sep 23 04:54:01.766356 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/3ee5730a-e4f9-4dea-89ce-dafaef4989bf HTTP/1.1 Sep 23 04:54:01.766356 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:54:01.766356 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:54:01.766356 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:54:01.766356 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:54:01.766356 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:54:01.766356 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:54:01.766356 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:54:01.766356 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:54:01.766356 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTuuct-5d1QoUvNPEjCVLAB-N5YN6xgu49nNVf7WCvYwmmMK4jylJF_g-m6ExDv6diAgLIn3QngWeO_g2EEFIA41I7bRRzv2RVxIDXnAYJcsT8YBonJjSZuF5fF6ANbujrYHF4NiBhXqH6fZLUVVteTl2_VY05Vext09jyx1hD4QX04 Sep 23 04:54:01.766356 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:54:01.766356 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:54:01.766356 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:54:01.766356 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:54:01.766356 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:54:01.766356 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:54:01.766356 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 2af9b29a1d1f488faf6e4dfd19055728 Sep 23 04:54:01.766356 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-MultipleCreateTestJSON-1889442196 Sep 23 04:54:01.766356 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:54:01.766356 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:54:01.766356 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2af9b29a1d1f488faf6e4dfd19055728", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2af9b29a1d1f488faf6e4dfd19055728"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2af9b29a1d1f488faf6e4dfd19055728"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2af9b29a1d1f488faf6e4dfd19055728"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:54:01.766356 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-MultipleCreateTestJSON-1889442196 Sep 23 04:54:01.766356 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 2af9b29a1d1f488faf6e4dfd19055728 Sep 23 04:54:01.766356 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1889442196 Sep 23 04:54:01.766356 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-MultipleCreateTestJSON-1889442196-project Sep 23 04:54:01.766356 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:54:01.766356 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:54:01.766356 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 46eb7f913d7e49f58af088102c5a06a7 Sep 23 04:54:01.766356 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-MultipleCreateTestJSON-1889442196-project Sep 23 04:54:01.766356 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:54:01.766356 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 3ee5730a-e4f9-4dea-89ce-dafaef4989bf could not be found. Sep 23 04:54:01.766356 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '3ee5730a-e4f9-4dea-89ce-dafaef4989bf'} Sep 23 04:54:01.766356 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:54:01.766356 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:54:01.766356 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:54:01.766356 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:54:01.766356 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:54:01.766356 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:54:01.766356 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:54:01.766356 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:54:01.766356 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:54:01.766356 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:54:01.766356 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ee5730a-e4f9-4dea-89ce-dafaef4989bf could not be found. Sep 23 04:54:01.766356 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:54:01.766356 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:54:01.766356 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:54:01.766356 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:54:01.766356 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:54:01.766356 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:54:01.766356 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:54:01.766356 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:54:01.766356 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:54:01.766356 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:54:01.766356 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:54:01.766356 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:54:01.766356 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:54:01.766356 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:54:01.766356 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:54:01.766356 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:54:01.766356 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ee5730a-e4f9-4dea-89ce-dafaef4989bf could not be found. Sep 23 04:54:01.766356 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:54:01.766356 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:54:01.766356 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:54:01.773116 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:54:01.773116 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:54:01.773116 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:54:01.773116 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:54:01.773116 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:54:01.773116 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ee5730a-e4f9-4dea-89ce-dafaef4989bf could not be found. Sep 23 04:54:01.773116 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:54:01.773116 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-079e325d-d7b0-4ae2-b9d7-c3d7c40b39e3 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Returning 404 to user: Instance 3ee5730a-e4f9-4dea-89ce-dafaef4989bf could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:54:01.773116 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-079e325d-d7b0-4ae2-b9d7-c3d7c40b39e3 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] 10.222.0.33 "GET /compute/v2.1/servers/3ee5730a-e4f9-4dea-89ce-dafaef4989bf" status: 404 len: 111 microversion: 2.1 time: 0.039133 Sep 23 04:54:01.777414 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f6052151-bf7d-4d5c-8b1d-f914200f6fe7 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:01.778071 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f6052151-bf7d-4d5c-8b1d-f914200f6fe7 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] [instance: 8ee6c95b-4f74-4f70-a118-83886aebde43] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:01.785553 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f6052151-bf7d-4d5c-8b1d-f914200f6fe7 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:01.785957 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2463/5065] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:01 2022] GET /compute/v2.1/servers/3ee5730a-e4f9-4dea-89ce-dafaef4989bf => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:54:01.786635 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f6052151-bf7d-4d5c-8b1d-f914200f6fe7 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:01.787262 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f6052151-bf7d-4d5c-8b1d-f914200f6fe7 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:01.788145 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f6052151-bf7d-4d5c-8b1d-f914200f6fe7 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:01.788609 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f6052151-bf7d-4d5c-8b1d-f914200f6fe7 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:01.789358 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f6052151-bf7d-4d5c-8b1d-f914200f6fe7 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:01.818836 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-f6052151-bf7d-4d5c-8b1d-f914200f6fe7 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] HTTP exception thrown: Instance 8ee6c95b-4f74-4f70-a118-83886aebde43 could not be found. Sep 23 04:54:01.820567 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f6052151-bf7d-4d5c-8b1d-f914200f6fe7 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Request method failure captured: Sep 23 04:54:01.820567 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/8ee6c95b-4f74-4f70-a118-83886aebde43 HTTP/1.1 Sep 23 04:54:01.820567 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:54:01.820567 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:54:01.820567 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:54:01.820567 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:54:01.820567 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:54:01.820567 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:54:01.820567 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:54:01.820567 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:54:01.820567 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTuuct-5d1QoUvNPEjCVLAB-N5YN6xgu49nNVf7WCvYwmmMK4jylJF_g-m6ExDv6diAgLIn3QngWeO_g2EEFIA41I7bRRzv2RVxIDXnAYJcsT8YBonJjSZuF5fF6ANbujrYHF4NiBhXqH6fZLUVVteTl2_VY05Vext09jyx1hD4QX04 Sep 23 04:54:01.820567 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:54:01.820567 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:54:01.820567 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:54:01.820567 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:54:01.820567 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:54:01.820567 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:54:01.820567 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 2af9b29a1d1f488faf6e4dfd19055728 Sep 23 04:54:01.820567 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-MultipleCreateTestJSON-1889442196 Sep 23 04:54:01.820567 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:54:01.820567 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:54:01.820567 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2af9b29a1d1f488faf6e4dfd19055728", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2af9b29a1d1f488faf6e4dfd19055728"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2af9b29a1d1f488faf6e4dfd19055728"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2af9b29a1d1f488faf6e4dfd19055728"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:54:01.820567 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-MultipleCreateTestJSON-1889442196 Sep 23 04:54:01.820567 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 2af9b29a1d1f488faf6e4dfd19055728 Sep 23 04:54:01.820567 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1889442196 Sep 23 04:54:01.820567 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-MultipleCreateTestJSON-1889442196-project Sep 23 04:54:01.820567 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:54:01.820567 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:54:01.820567 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 46eb7f913d7e49f58af088102c5a06a7 Sep 23 04:54:01.820567 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-MultipleCreateTestJSON-1889442196-project Sep 23 04:54:01.820567 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:54:01.820567 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 8ee6c95b-4f74-4f70-a118-83886aebde43 could not be found. Sep 23 04:54:01.820567 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '8ee6c95b-4f74-4f70-a118-83886aebde43'} Sep 23 04:54:01.820567 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:54:01.820567 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:54:01.820567 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:54:01.820567 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:54:01.820567 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:54:01.820567 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:54:01.820567 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:54:01.820567 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:54:01.820567 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:54:01.820567 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:54:01.820567 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ee6c95b-4f74-4f70-a118-83886aebde43 could not be found. Sep 23 04:54:01.820567 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:54:01.820567 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:54:01.820567 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:54:01.820567 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:54:01.820567 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:54:01.820567 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:54:01.820567 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:54:01.820567 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:54:01.820567 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:54:01.820567 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:54:01.820567 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:54:01.820567 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:54:01.820567 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:54:01.820567 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:54:01.820567 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:54:01.820567 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:54:01.820567 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ee6c95b-4f74-4f70-a118-83886aebde43 could not be found. Sep 23 04:54:01.820567 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:54:01.820567 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:54:01.820567 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:54:01.825224 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:54:01.825224 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:54:01.825224 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:54:01.825224 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:54:01.825224 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:54:01.825224 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ee6c95b-4f74-4f70-a118-83886aebde43 could not be found. Sep 23 04:54:01.825224 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:54:01.825224 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f6052151-bf7d-4d5c-8b1d-f914200f6fe7 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] Returning 404 to user: Instance 8ee6c95b-4f74-4f70-a118-83886aebde43 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:54:01.825224 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f6052151-bf7d-4d5c-8b1d-f914200f6fe7 tempest-MultipleCreateTestJSON-1889442196 tempest-MultipleCreateTestJSON-1889442196-project] 10.222.0.33 "GET /compute/v2.1/servers/8ee6c95b-4f74-4f70-a118-83886aebde43" status: 404 len: 111 microversion: 2.1 time: 0.048975 Sep 23 04:54:01.825224 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2603/5066] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:01 2022] GET /compute/v2.1/servers/8ee6c95b-4f74-4f70-a118-83886aebde43 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:54:01.953404 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d49cd158-f647-451c-9d5e-4072de436c55 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:01.954073 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d49cd158-f647-451c-9d5e-4072de436c55 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 3354b397-f391-47f2-8ded-f9227bfecb6f] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:01.964700 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d49cd158-f647-451c-9d5e-4072de436c55 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:01.968855 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d49cd158-f647-451c-9d5e-4072de436c55 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:01.968855 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d49cd158-f647-451c-9d5e-4072de436c55 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:01.968855 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d49cd158-f647-451c-9d5e-4072de436c55 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:01.968855 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d49cd158-f647-451c-9d5e-4072de436c55 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:01.968855 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d49cd158-f647-451c-9d5e-4072de436c55 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:02.146164 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d49cd158-f647-451c-9d5e-4072de436c55 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:02.157221 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d49cd158-f647-451c-9d5e-4072de436c55 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/3354b397-f391-47f2-8ded-f9227bfecb6f" status: 200 len: 1314 microversion: 2.1 time: 0.208610 Sep 23 04:54:02.158472 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2464/5067] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:01 2022] GET /compute/v2.1/servers/3354b397-f391-47f2-8ded-f9227bfecb6f => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:54:02.316697 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5341bf80-7654-4dea-aed7-5aaff2316629 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:02.317468 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-5341bf80-7654-4dea-aed7-5aaff2316629 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: 6174fd18-3f10-4034-85ee-32b05fde010f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:02.327625 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5341bf80-7654-4dea-aed7-5aaff2316629 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:02.328419 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5341bf80-7654-4dea-aed7-5aaff2316629 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:02.329048 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5341bf80-7654-4dea-aed7-5aaff2316629 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:02.330358 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5341bf80-7654-4dea-aed7-5aaff2316629 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:02.331484 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5341bf80-7654-4dea-aed7-5aaff2316629 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:02.332110 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5341bf80-7654-4dea-aed7-5aaff2316629 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:02.488424 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-5341bf80-7654-4dea-aed7-5aaff2316629 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:02.498999 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5341bf80-7654-4dea-aed7-5aaff2316629 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f" status: 200 len: 1517 microversion: 2.1 time: 0.186175 Sep 23 04:54:02.499505 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2604/5068] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:02 2022] GET /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f => generated 1517 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:54:03.020580 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-128faf79-f811-4159-a046-da108dd844df tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:54:03.025270 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-128faf79-f811-4159-a046-da108dd844df tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 4381aca2-ea30-4473-9cd3-18c9b64f1937] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:03.039287 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-128faf79-f811-4159-a046-da108dd844df tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:03.039801 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-128faf79-f811-4159-a046-da108dd844df tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:03.040366 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-128faf79-f811-4159-a046-da108dd844df tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:03.041096 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-128faf79-f811-4159-a046-da108dd844df tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:03.041566 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-128faf79-f811-4159-a046-da108dd844df tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:03.042033 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-128faf79-f811-4159-a046-da108dd844df tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:03.050164 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-59801cef-898a-4195-83d8-4897e8c522f5 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:03.052479 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-59801cef-898a-4195-83d8-4897e8c522f5 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: f285e256-0a0e-4126-8adf-643bd59ca141] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:03.063251 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-59801cef-898a-4195-83d8-4897e8c522f5 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:03.064009 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-59801cef-898a-4195-83d8-4897e8c522f5 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:03.064454 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-59801cef-898a-4195-83d8-4897e8c522f5 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:03.065352 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-59801cef-898a-4195-83d8-4897e8c522f5 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:03.066030 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-59801cef-898a-4195-83d8-4897e8c522f5 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:03.066624 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-59801cef-898a-4195-83d8-4897e8c522f5 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:03.101311 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-128faf79-f811-4159-a046-da108dd844df tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "POST /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937/action" status: 200 len: 24565 microversion: 2.1 time: 0.084403 Sep 23 04:54:03.102018 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2465/5069] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:54:03 2022] POST /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937/action => generated 24565 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 04:54:03.110308 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-59801cef-898a-4195-83d8-4897e8c522f5 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.064088 Sep 23 04:54:03.112401 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2605/5070] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Sep 23 04:54:03 2022] GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141/os-volume_attachments => generated 25 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:54:03.186797 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-09690442-c2e2-4db0-80e2-b10b6d3250e7 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:03.189255 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-09690442-c2e2-4db0-80e2-b10b6d3250e7 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 3354b397-f391-47f2-8ded-f9227bfecb6f] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:03.203464 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-09690442-c2e2-4db0-80e2-b10b6d3250e7 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:03.211620 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-09690442-c2e2-4db0-80e2-b10b6d3250e7 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:03.213236 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-09690442-c2e2-4db0-80e2-b10b6d3250e7 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:03.217198 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-09690442-c2e2-4db0-80e2-b10b6d3250e7 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:03.217817 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-09690442-c2e2-4db0-80e2-b10b6d3250e7 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:03.218810 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-09690442-c2e2-4db0-80e2-b10b6d3250e7 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:03.266607 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-bb09da52-4f9b-4b30-b04f-84f3b7a87ac5 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:03.267120 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-bb09da52-4f9b-4b30-b04f-84f3b7a87ac5 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: f285e256-0a0e-4126-8adf-643bd59ca141] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:03.280803 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bb09da52-4f9b-4b30-b04f-84f3b7a87ac5 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:03.281878 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bb09da52-4f9b-4b30-b04f-84f3b7a87ac5 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:03.282413 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bb09da52-4f9b-4b30-b04f-84f3b7a87ac5 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:03.283307 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bb09da52-4f9b-4b30-b04f-84f3b7a87ac5 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:03.283800 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bb09da52-4f9b-4b30-b04f-84f3b7a87ac5 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:03.284229 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bb09da52-4f9b-4b30-b04f-84f3b7a87ac5 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:03.341452 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-bb09da52-4f9b-4b30-b04f-84f3b7a87ac5 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: f285e256-0a0e-4126-8adf-643bd59ca141] Going to try to terminate instance {{(pid=122699) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:54:03.470320 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-09690442-c2e2-4db0-80e2-b10b6d3250e7 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:03.482064 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-09690442-c2e2-4db0-80e2-b10b6d3250e7 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/3354b397-f391-47f2-8ded-f9227bfecb6f" status: 200 len: 1314 microversion: 2.1 time: 0.301450 Sep 23 04:54:03.484066 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2466/5071] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:03 2022] GET /compute/v2.1/servers/3354b397-f391-47f2-8ded-f9227bfecb6f => generated 1314 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:54:03.522636 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-fe989f7e-288c-4d5e-8434-a942fd7c0687 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:03.524223 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-fe989f7e-288c-4d5e-8434-a942fd7c0687 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: 6174fd18-3f10-4034-85ee-32b05fde010f] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:03.531736 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fe989f7e-288c-4d5e-8434-a942fd7c0687 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:03.532375 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fe989f7e-288c-4d5e-8434-a942fd7c0687 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:03.533022 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fe989f7e-288c-4d5e-8434-a942fd7c0687 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:03.533815 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fe989f7e-288c-4d5e-8434-a942fd7c0687 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:03.534240 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fe989f7e-288c-4d5e-8434-a942fd7c0687 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:03.534735 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fe989f7e-288c-4d5e-8434-a942fd7c0687 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:03.706088 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-bb09da52-4f9b-4b30-b04f-84f3b7a87ac5 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141" status: 204 len: 0 microversion: 2.20 time: 0.443026 Sep 23 04:54:03.711063 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2606/5072] 10.222.0.33 () {60 vars in 1280 bytes} [Fri Sep 23 04:54:03 2022] DELETE /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 23 04:54:03.718436 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-68e40f68-9760-4e86-ba1d-9a17a9c9886a tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:03.719447 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-68e40f68-9760-4e86-ba1d-9a17a9c9886a tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: f285e256-0a0e-4126-8adf-643bd59ca141] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:03.728896 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-68e40f68-9760-4e86-ba1d-9a17a9c9886a tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:03.729743 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-68e40f68-9760-4e86-ba1d-9a17a9c9886a tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:03.730377 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-68e40f68-9760-4e86-ba1d-9a17a9c9886a tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:03.732342 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-68e40f68-9760-4e86-ba1d-9a17a9c9886a tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:03.733051 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-68e40f68-9760-4e86-ba1d-9a17a9c9886a tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:03.733653 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-68e40f68-9760-4e86-ba1d-9a17a9c9886a tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:04.342652 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-fe989f7e-288c-4d5e-8434-a942fd7c0687 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:04.358844 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-fe989f7e-288c-4d5e-8434-a942fd7c0687 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f" status: 200 len: 1517 microversion: 2.1 time: 0.840142 Sep 23 04:54:04.364838 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2467/5073] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:03 2022] GET /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f => generated 1517 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:54:04.364838 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-2f8e234e-f3a5-4561-bffe-f772d0364019 req-14d75c56-b431-4775-8f41-a9623a37a336 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3354b397-f391-47f2-8ded-f9227bfecb6f", "name": "network-vif-plugged", "status": "completed", "tag": "2e084b59-e468-45fb-8081-c4bafdb31c08"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:54:04.381691 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-2f8e234e-f3a5-4561-bffe-f772d0364019 req-14d75c56-b431-4775-8f41-a9623a37a336 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:04.382373 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-2f8e234e-f3a5-4561-bffe-f772d0364019 req-14d75c56-b431-4775-8f41-a9623a37a336 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:04.382917 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-2f8e234e-f3a5-4561-bffe-f772d0364019 req-14d75c56-b431-4775-8f41-a9623a37a336 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:04.400551 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-2f8e234e-f3a5-4561-bffe-f772d0364019 req-14d75c56-b431-4775-8f41-a9623a37a336 service nova] Creating event network-vif-plugged:2e084b59-e468-45fb-8081-c4bafdb31c08 for instance 3354b397-f391-47f2-8ded-f9227bfecb6f on n-h1-846463-3 Sep 23 04:54:04.405788 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-2f8e234e-f3a5-4561-bffe-f772d0364019 req-14d75c56-b431-4775-8f41-a9623a37a336 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045147 Sep 23 04:54:04.406528 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2468/5074] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:54:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:54:04.411124 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-68e40f68-9760-4e86-ba1d-9a17a9c9886a tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:04.423595 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-68e40f68-9760-4e86-ba1d-9a17a9c9886a tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:04.425172 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-68e40f68-9760-4e86-ba1d-9a17a9c9886a tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:04.426542 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-68e40f68-9760-4e86-ba1d-9a17a9c9886a tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141" status: 200 len: 1724 microversion: 2.20 time: 0.713279 Sep 23 04:54:04.427435 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2607/5075] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:54:03 2022] GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141 => generated 1724 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:54:04.505983 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-fd44f0bb-c534-43b0-8a5c-3646c09ed1bb tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:04.506717 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-fd44f0bb-c534-43b0-8a5c-3646c09ed1bb tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 3354b397-f391-47f2-8ded-f9227bfecb6f] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:04.513864 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fd44f0bb-c534-43b0-8a5c-3646c09ed1bb tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:04.514396 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fd44f0bb-c534-43b0-8a5c-3646c09ed1bb tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:04.514851 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fd44f0bb-c534-43b0-8a5c-3646c09ed1bb tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:04.515559 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fd44f0bb-c534-43b0-8a5c-3646c09ed1bb tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:04.516030 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fd44f0bb-c534-43b0-8a5c-3646c09ed1bb tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:04.516465 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fd44f0bb-c534-43b0-8a5c-3646c09ed1bb tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:04.791828 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-fd44f0bb-c534-43b0-8a5c-3646c09ed1bb tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:04.792961 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-fd44f0bb-c534-43b0-8a5c-3646c09ed1bb tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/3354b397-f391-47f2-8ded-f9227bfecb6f" status: 200 len: 1314 microversion: 2.1 time: 0.291306 Sep 23 04:54:04.794097 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2469/5076] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:04 2022] GET /compute/v2.1/servers/3354b397-f391-47f2-8ded-f9227bfecb6f => generated 1314 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:54:05.384725 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-86a96b07-048d-4f9e-ab8a-661888af5268 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:05.386771 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-86a96b07-048d-4f9e-ab8a-661888af5268 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: 6174fd18-3f10-4034-85ee-32b05fde010f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:05.393642 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-86a96b07-048d-4f9e-ab8a-661888af5268 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:05.394396 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-86a96b07-048d-4f9e-ab8a-661888af5268 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:05.394917 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-86a96b07-048d-4f9e-ab8a-661888af5268 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:05.395791 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-86a96b07-048d-4f9e-ab8a-661888af5268 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:05.396263 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-86a96b07-048d-4f9e-ab8a-661888af5268 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:05.396697 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-86a96b07-048d-4f9e-ab8a-661888af5268 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:05.454211 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-60646a2f-b3f2-4cb8-b0a5-e6d67e227407 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:05.454968 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-60646a2f-b3f2-4cb8-b0a5-e6d67e227407 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: f285e256-0a0e-4126-8adf-643bd59ca141] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:05.462285 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-60646a2f-b3f2-4cb8-b0a5-e6d67e227407 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:05.463206 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-60646a2f-b3f2-4cb8-b0a5-e6d67e227407 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:05.464048 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-60646a2f-b3f2-4cb8-b0a5-e6d67e227407 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:05.464991 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-60646a2f-b3f2-4cb8-b0a5-e6d67e227407 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:05.465460 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-60646a2f-b3f2-4cb8-b0a5-e6d67e227407 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:05.465933 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-60646a2f-b3f2-4cb8-b0a5-e6d67e227407 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:05.660306 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-86a96b07-048d-4f9e-ab8a-661888af5268 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:05.676554 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-86a96b07-048d-4f9e-ab8a-661888af5268 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f" status: 200 len: 1517 microversion: 2.1 time: 0.296874 Sep 23 04:54:05.677465 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2608/5077] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:05 2022] GET /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f => generated 1517 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:54:05.779599 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-60646a2f-b3f2-4cb8-b0a5-e6d67e227407 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:05.792572 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-60646a2f-b3f2-4cb8-b0a5-e6d67e227407 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:05.795468 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-60646a2f-b3f2-4cb8-b0a5-e6d67e227407 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:05.797486 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-60646a2f-b3f2-4cb8-b0a5-e6d67e227407 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141" status: 200 len: 1724 microversion: 2.20 time: 0.347577 Sep 23 04:54:05.798733 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2470/5078] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:54:05 2022] GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141 => generated 1724 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:54:05.825836 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-bf62f08c-ec04-4fad-8074-f8ea875e3f36 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:05.826706 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-bf62f08c-ec04-4fad-8074-f8ea875e3f36 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 3354b397-f391-47f2-8ded-f9227bfecb6f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:05.833409 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bf62f08c-ec04-4fad-8074-f8ea875e3f36 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:05.835356 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bf62f08c-ec04-4fad-8074-f8ea875e3f36 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:05.835356 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bf62f08c-ec04-4fad-8074-f8ea875e3f36 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:05.835356 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bf62f08c-ec04-4fad-8074-f8ea875e3f36 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:05.835758 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bf62f08c-ec04-4fad-8074-f8ea875e3f36 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:05.836431 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bf62f08c-ec04-4fad-8074-f8ea875e3f36 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:05.841614 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:54:06.029091 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-bf62f08c-ec04-4fad-8074-f8ea875e3f36 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:06.040931 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-bf62f08c-ec04-4fad-8074-f8ea875e3f36 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/3354b397-f391-47f2-8ded-f9227bfecb6f" status: 200 len: 1314 microversion: 2.1 time: 0.227402 Sep 23 04:54:06.041556 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2609/5079] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:05 2022] GET /compute/v2.1/servers/3354b397-f391-47f2-8ded-f9227bfecb6f => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:54:06.705291 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-da9128ae-1751-4d16-aa85-07cba04e5804 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:06.705952 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-da9128ae-1751-4d16-aa85-07cba04e5804 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: 6174fd18-3f10-4034-85ee-32b05fde010f] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:06.718732 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-da9128ae-1751-4d16-aa85-07cba04e5804 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:06.724917 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-08976faf-3be1-4329-ac32-70748c03333a req-74ac09d3-9408-4532-be0b-cc0820162063 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f285e256-0a0e-4126-8adf-643bd59ca141", "name": "network-vif-deleted", "tag": "e29f5caa-b337-40d1-9780-77215617f3ce"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:54:06.732463 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-da9128ae-1751-4d16-aa85-07cba04e5804 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:06.733045 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-da9128ae-1751-4d16-aa85-07cba04e5804 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:06.733836 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-da9128ae-1751-4d16-aa85-07cba04e5804 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:06.734528 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-da9128ae-1751-4d16-aa85-07cba04e5804 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:06.734987 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-da9128ae-1751-4d16-aa85-07cba04e5804 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:06.758089 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-08976faf-3be1-4329-ac32-70748c03333a req-74ac09d3-9408-4532-be0b-cc0820162063 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:06.761584 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-08976faf-3be1-4329-ac32-70748c03333a req-74ac09d3-9408-4532-be0b-cc0820162063 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:06.762094 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-08976faf-3be1-4329-ac32-70748c03333a req-74ac09d3-9408-4532-be0b-cc0820162063 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:06.796345 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-08976faf-3be1-4329-ac32-70748c03333a req-74ac09d3-9408-4532-be0b-cc0820162063 service nova] Creating event network-vif-deleted:e29f5caa-b337-40d1-9780-77215617f3ce for instance f285e256-0a0e-4126-8adf-643bd59ca141 on n-h1-846463-3 Sep 23 04:54:06.806360 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-08976faf-3be1-4329-ac32-70748c03333a req-74ac09d3-9408-4532-be0b-cc0820162063 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083383 Sep 23 04:54:06.814386 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2610/5080] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:54:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:54:06.839672 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d99683f7-aa5e-42ee-83a0-921c5fc5a389 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:06.840314 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d99683f7-aa5e-42ee-83a0-921c5fc5a389 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: f285e256-0a0e-4126-8adf-643bd59ca141] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:06.848045 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d99683f7-aa5e-42ee-83a0-921c5fc5a389 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:06.848351 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d99683f7-aa5e-42ee-83a0-921c5fc5a389 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:06.848796 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d99683f7-aa5e-42ee-83a0-921c5fc5a389 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:06.849929 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d99683f7-aa5e-42ee-83a0-921c5fc5a389 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:06.850560 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d99683f7-aa5e-42ee-83a0-921c5fc5a389 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:06.851160 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d99683f7-aa5e-42ee-83a0-921c5fc5a389 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:06.960470 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d99683f7-aa5e-42ee-83a0-921c5fc5a389 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:06.972827 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d99683f7-aa5e-42ee-83a0-921c5fc5a389 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:06.977197 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d99683f7-aa5e-42ee-83a0-921c5fc5a389 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:06.982893 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d99683f7-aa5e-42ee-83a0-921c5fc5a389 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141" status: 200 len: 1656 microversion: 2.20 time: 0.155008 Sep 23 04:54:06.983547 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2611/5081] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:54:06 2022] GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141 => generated 1656 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:54:07.073417 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4ecb4b8b-b694-4965-9a27-b6c64b5b3e4b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:07.074067 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4ecb4b8b-b694-4965-9a27-b6c64b5b3e4b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 3354b397-f391-47f2-8ded-f9227bfecb6f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:07.085268 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4ecb4b8b-b694-4965-9a27-b6c64b5b3e4b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:07.093753 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4ecb4b8b-b694-4965-9a27-b6c64b5b3e4b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:07.093753 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4ecb4b8b-b694-4965-9a27-b6c64b5b3e4b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:07.093753 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4ecb4b8b-b694-4965-9a27-b6c64b5b3e4b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:07.093753 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4ecb4b8b-b694-4965-9a27-b6c64b5b3e4b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:07.093753 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4ecb4b8b-b694-4965-9a27-b6c64b5b3e4b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:07.182831 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-da9128ae-1751-4d16-aa85-07cba04e5804 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:07.194725 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-da9128ae-1751-4d16-aa85-07cba04e5804 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f" status: 200 len: 1517 microversion: 2.1 time: 0.494259 Sep 23 04:54:07.195513 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2471/5082] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:06 2022] GET /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f => generated 1517 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:54:07.397555 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-4ecb4b8b-b694-4965-9a27-b6c64b5b3e4b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:07.412746 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4ecb4b8b-b694-4965-9a27-b6c64b5b3e4b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/3354b397-f391-47f2-8ded-f9227bfecb6f" status: 200 len: 1500 microversion: 2.1 time: 0.341326 Sep 23 04:54:07.414027 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2612/5083] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:07 2022] GET /compute/v2.1/servers/3354b397-f391-47f2-8ded-f9227bfecb6f => generated 1500 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:54:07.448950 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-68a977e0-804d-4cfb-84bc-beefe71dffbd tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:54:07.449605 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-68a977e0-804d-4cfb-84bc-beefe71dffbd tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 3354b397-f391-47f2-8ded-f9227bfecb6f] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:07.458543 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-68a977e0-804d-4cfb-84bc-beefe71dffbd tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:07.460959 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-68a977e0-804d-4cfb-84bc-beefe71dffbd tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:07.461427 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-68a977e0-804d-4cfb-84bc-beefe71dffbd tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:07.466275 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-68a977e0-804d-4cfb-84bc-beefe71dffbd tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:07.467003 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-68a977e0-804d-4cfb-84bc-beefe71dffbd tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:07.467455 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-68a977e0-804d-4cfb-84bc-beefe71dffbd tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:07.789540 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-68a977e0-804d-4cfb-84bc-beefe71dffbd tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "POST /compute/v2.1/servers/3354b397-f391-47f2-8ded-f9227bfecb6f/action" status: 202 len: 0 microversion: 2.1 time: 0.344162 Sep 23 04:54:07.790980 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2472/5084] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:54:07 2022] POST /compute/v2.1/servers/3354b397-f391-47f2-8ded-f9227bfecb6f/action => generated 0 bytes in 347 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:54:07.805379 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8872be5f-78d1-42ab-bebe-6572ba008587 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:07.809414 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-8872be5f-78d1-42ab-bebe-6572ba008587 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 3354b397-f391-47f2-8ded-f9227bfecb6f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:07.820282 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8872be5f-78d1-42ab-bebe-6572ba008587 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:07.821420 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8872be5f-78d1-42ab-bebe-6572ba008587 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:07.821950 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8872be5f-78d1-42ab-bebe-6572ba008587 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:07.822960 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8872be5f-78d1-42ab-bebe-6572ba008587 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:07.823479 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8872be5f-78d1-42ab-bebe-6572ba008587 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:07.823895 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8872be5f-78d1-42ab-bebe-6572ba008587 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:08.015188 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-8872be5f-78d1-42ab-bebe-6572ba008587 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:08.017220 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b4e323b4-4622-4f73-b3db-31bc88797304 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:08.018577 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b4e323b4-4622-4f73-b3db-31bc88797304 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: f285e256-0a0e-4126-8adf-643bd59ca141] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:08.027281 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b4e323b4-4622-4f73-b3db-31bc88797304 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:08.028342 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b4e323b4-4622-4f73-b3db-31bc88797304 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:08.028960 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b4e323b4-4622-4f73-b3db-31bc88797304 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:08.030485 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b4e323b4-4622-4f73-b3db-31bc88797304 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:08.032163 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b4e323b4-4622-4f73-b3db-31bc88797304 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:08.032881 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b4e323b4-4622-4f73-b3db-31bc88797304 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:08.037400 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-8872be5f-78d1-42ab-bebe-6572ba008587 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/3354b397-f391-47f2-8ded-f9227bfecb6f" status: 200 len: 1505 microversion: 2.1 time: 0.241524 Sep 23 04:54:08.042762 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2613/5085] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:07 2022] GET /compute/v2.1/servers/3354b397-f391-47f2-8ded-f9227bfecb6f => generated 1505 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:54:08.142908 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b4e323b4-4622-4f73-b3db-31bc88797304 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:08.144950 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b4e323b4-4622-4f73-b3db-31bc88797304 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:08.145946 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b4e323b4-4622-4f73-b3db-31bc88797304 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:08.152632 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-b4e323b4-4622-4f73-b3db-31bc88797304 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lazy-loading 'fault' on Instance uuid f285e256-0a0e-4126-8adf-643bd59ca141 {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:54:08.220461 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8183ea69-1abd-4540-b87a-d9e59a42eccd tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:08.222335 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-8183ea69-1abd-4540-b87a-d9e59a42eccd tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: 6174fd18-3f10-4034-85ee-32b05fde010f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:08.231063 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8183ea69-1abd-4540-b87a-d9e59a42eccd tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:08.233552 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8183ea69-1abd-4540-b87a-d9e59a42eccd tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:08.234040 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8183ea69-1abd-4540-b87a-d9e59a42eccd tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:08.234769 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8183ea69-1abd-4540-b87a-d9e59a42eccd tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:08.235229 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8183ea69-1abd-4540-b87a-d9e59a42eccd tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:08.235662 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8183ea69-1abd-4540-b87a-d9e59a42eccd tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:08.254330 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b4e323b4-4622-4f73-b3db-31bc88797304 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:08.265728 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b4e323b4-4622-4f73-b3db-31bc88797304 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:08.271099 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b4e323b4-4622-4f73-b3db-31bc88797304 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b87ca7119ee042c3bda1e88ff38fdb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdfe96be196470889a58b56a19743a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:08.274862 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b4e323b4-4622-4f73-b3db-31bc88797304 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141" status: 200 len: 1371 microversion: 2.20 time: 0.266589 Sep 23 04:54:08.291808 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2473/5086] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:54:08 2022] GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141 => generated 1371 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:54:08.518957 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-8183ea69-1abd-4540-b87a-d9e59a42eccd tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:08.530880 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-8183ea69-1abd-4540-b87a-d9e59a42eccd tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f" status: 200 len: 1517 microversion: 2.1 time: 0.312729 Sep 23 04:54:08.530880 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2614/5087] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:08 2022] GET /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f => generated 1517 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:54:09.064470 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b857f4eb-e6e9-40fd-aff9-86f55eb368dc tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:09.065107 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b857f4eb-e6e9-40fd-aff9-86f55eb368dc tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 3354b397-f391-47f2-8ded-f9227bfecb6f] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:09.072095 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b857f4eb-e6e9-40fd-aff9-86f55eb368dc tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:09.074034 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b857f4eb-e6e9-40fd-aff9-86f55eb368dc tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:09.074034 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b857f4eb-e6e9-40fd-aff9-86f55eb368dc tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:09.074034 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b857f4eb-e6e9-40fd-aff9-86f55eb368dc tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:09.078418 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b857f4eb-e6e9-40fd-aff9-86f55eb368dc tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:09.078907 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b857f4eb-e6e9-40fd-aff9-86f55eb368dc tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:09.225119 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b857f4eb-e6e9-40fd-aff9-86f55eb368dc tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:09.234540 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b857f4eb-e6e9-40fd-aff9-86f55eb368dc tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/3354b397-f391-47f2-8ded-f9227bfecb6f" status: 200 len: 1485 microversion: 2.1 time: 0.173903 Sep 23 04:54:09.250334 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2474/5088] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:09 2022] GET /compute/v2.1/servers/3354b397-f391-47f2-8ded-f9227bfecb6f => generated 1485 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:54:09.258158 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-09442234-5a37-4ac8-af21-e467f36481ff tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:54:09.259187 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-09442234-5a37-4ac8-af21-e467f36481ff tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 3354b397-f391-47f2-8ded-f9227bfecb6f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:09.266875 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-09442234-5a37-4ac8-af21-e467f36481ff tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:09.267370 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-09442234-5a37-4ac8-af21-e467f36481ff tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:09.267808 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-09442234-5a37-4ac8-af21-e467f36481ff tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:09.270941 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-09442234-5a37-4ac8-af21-e467f36481ff tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:09.270941 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-09442234-5a37-4ac8-af21-e467f36481ff tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:09.270941 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-09442234-5a37-4ac8-af21-e467f36481ff tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:09.293945 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-09442234-5a37-4ac8-af21-e467f36481ff tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lazy-loading 'flavor' on Instance uuid 3354b397-f391-47f2-8ded-f9227bfecb6f {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:54:09.303498 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9896c96c-0441-4132-83e5-5c0e64526694 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:09.304110 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-9896c96c-0441-4132-83e5-5c0e64526694 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: f285e256-0a0e-4126-8adf-643bd59ca141] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:09.310248 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9896c96c-0441-4132-83e5-5c0e64526694 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:09.310777 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9896c96c-0441-4132-83e5-5c0e64526694 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:09.311224 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9896c96c-0441-4132-83e5-5c0e64526694 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:09.312067 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9896c96c-0441-4132-83e5-5c0e64526694 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:09.312757 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9896c96c-0441-4132-83e5-5c0e64526694 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:09.313195 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9896c96c-0441-4132-83e5-5c0e64526694 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:09.328875 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-9896c96c-0441-4132-83e5-5c0e64526694 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] HTTP exception thrown: Instance f285e256-0a0e-4126-8adf-643bd59ca141 could not be found. Sep 23 04:54:09.330802 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9896c96c-0441-4132-83e5-5c0e64526694 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Request method failure captured: Sep 23 04:54:09.330802 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141 HTTP/1.1 Sep 23 04:54:09.330802 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:54:09.330802 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:54:09.330802 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:54:09.330802 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:54:09.330802 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:54:09.330802 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:54:09.330802 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:54:09.330802 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:54:09.330802 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLToveGoAQMGKa2MEoOD7pi4eoXebwWpQGYBxpi4v5d_5sCE8-ReUtgLxNqqDa5ZRa4NgKNhAN91c4cAyfH085Z25DFo9sDI3xEr7wMBgdXQQsjQLe9mvRYlGmbhD7LMsA85fhQUj8nzFBJzYkoK4oOVlzuKdqXhdKMrRGAYR1C8bRv8 Sep 23 04:54:09.330802 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:54:09.330802 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:54:09.330802 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:54:09.330802 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:54:09.330802 n-d-846463-3 devstack@n-api.service[122698]: X-Openstack-Nova-Api-Version: 2.20 Sep 23 04:54:09.330802 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:54:09.330802 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:54:09.330802 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 1cdfe96be196470889a58b56a19743a7 Sep 23 04:54:09.330802 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-480238040 Sep 23 04:54:09.330802 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:54:09.330802 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:54:09.330802 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1cdfe96be196470889a58b56a19743a7", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1cdfe96be196470889a58b56a19743a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1cdfe96be196470889a58b56a19743a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1cdfe96be196470889a58b56a19743a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:54:09.330802 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-AttachVolumeShelveTestJSON-480238040 Sep 23 04:54:09.330802 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 1cdfe96be196470889a58b56a19743a7 Sep 23 04:54:09.330802 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-480238040 Sep 23 04:54:09.330802 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-AttachVolumeShelveTestJSON-480238040-project Sep 23 04:54:09.330802 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:54:09.330802 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:54:09.330802 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: b87ca7119ee042c3bda1e88ff38fdb7c Sep 23 04:54:09.330802 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-AttachVolumeShelveTestJSON-480238040-project Sep 23 04:54:09.330802 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:54:09.330802 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance f285e256-0a0e-4126-8adf-643bd59ca141 could not be found. Sep 23 04:54:09.330802 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': 'f285e256-0a0e-4126-8adf-643bd59ca141'} Sep 23 04:54:09.330802 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:54:09.330802 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:54:09.330802 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:54:09.330802 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:54:09.330802 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:54:09.330802 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:54:09.330802 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:54:09.330802 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:54:09.330802 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:54:09.330802 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:54:09.330802 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f285e256-0a0e-4126-8adf-643bd59ca141 could not be found. Sep 23 04:54:09.330802 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:54:09.330802 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:54:09.330802 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:54:09.330802 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:54:09.330802 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:54:09.330802 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:54:09.330802 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:54:09.330802 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:54:09.330802 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:54:09.330802 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:54:09.330802 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:54:09.330802 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:54:09.330802 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:54:09.330802 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:54:09.330802 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:54:09.330802 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:54:09.330802 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f285e256-0a0e-4126-8adf-643bd59ca141 could not be found. Sep 23 04:54:09.330802 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:54:09.330802 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:54:09.335250 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:54:09.335250 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:54:09.335250 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:54:09.335250 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:54:09.335250 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:54:09.335250 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:54:09.335250 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f285e256-0a0e-4126-8adf-643bd59ca141 could not be found. Sep 23 04:54:09.335250 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:54:09.335250 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9896c96c-0441-4132-83e5-5c0e64526694 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Returning 404 to user: Instance f285e256-0a0e-4126-8adf-643bd59ca141 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:54:09.335250 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9896c96c-0441-4132-83e5-5c0e64526694 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141" status: 404 len: 111 microversion: 2.20 time: 0.032874 Sep 23 04:54:09.335250 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2475/5089] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:54:09 2022] GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 23 04:54:09.347455 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8bc07e3e-e8ab-49e8-9e6c-30e3d2131e2e tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '.version_select at 0x7ff1bbaa7700>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:09.441226 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8bc07e3e-e8ab-49e8-9e6c-30e3d2131e2e tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-109559585" status: 204 len: 0 microversion: 2.20 time: 0.097490 Sep 23 04:54:09.441812 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2476/5090] 10.222.0.33 () {60 vars in 1259 bytes} [Fri Sep 23 04:54:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-109559585 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 23 04:54:09.556885 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2e8cbc5e-f545-4a47-bc8f-d31c23127add tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:09.557558 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-2e8cbc5e-f545-4a47-bc8f-d31c23127add tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: 6174fd18-3f10-4034-85ee-32b05fde010f] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:09.572167 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2e8cbc5e-f545-4a47-bc8f-d31c23127add tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:09.572167 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2e8cbc5e-f545-4a47-bc8f-d31c23127add tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:09.572167 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2e8cbc5e-f545-4a47-bc8f-d31c23127add tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:09.572167 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2e8cbc5e-f545-4a47-bc8f-d31c23127add tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:09.572167 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2e8cbc5e-f545-4a47-bc8f-d31c23127add tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:09.572167 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2e8cbc5e-f545-4a47-bc8f-d31c23127add tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:09.727741 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-2e8cbc5e-f545-4a47-bc8f-d31c23127add tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:09.735931 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2e8cbc5e-f545-4a47-bc8f-d31c23127add tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f" status: 200 len: 1517 microversion: 2.1 time: 0.186224 Sep 23 04:54:09.736501 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2477/5091] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:09 2022] GET /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f => generated 1517 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:54:09.906316 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-09442234-5a37-4ac8-af21-e467f36481ff tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "POST /compute/v2.1/servers/3354b397-f391-47f2-8ded-f9227bfecb6f/action" status: 202 len: 0 microversion: 2.1 time: 0.651822 Sep 23 04:54:09.907380 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2615/5092] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:54:09 2022] POST /compute/v2.1/servers/3354b397-f391-47f2-8ded-f9227bfecb6f/action => generated 0 bytes in 654 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:54:09.921931 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6eacc06e-bded-47c5-9532-8908895fc422 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:09.927054 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-6eacc06e-bded-47c5-9532-8908895fc422 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 3354b397-f391-47f2-8ded-f9227bfecb6f] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:09.937778 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6eacc06e-bded-47c5-9532-8908895fc422 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:09.938897 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6eacc06e-bded-47c5-9532-8908895fc422 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:09.939425 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6eacc06e-bded-47c5-9532-8908895fc422 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:09.940256 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6eacc06e-bded-47c5-9532-8908895fc422 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:09.940794 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6eacc06e-bded-47c5-9532-8908895fc422 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:09.941306 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6eacc06e-bded-47c5-9532-8908895fc422 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:10.084792 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6eacc06e-bded-47c5-9532-8908895fc422 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:10.093542 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-6eacc06e-bded-47c5-9532-8908895fc422 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/3354b397-f391-47f2-8ded-f9227bfecb6f" status: 200 len: 1491 microversion: 2.1 time: 0.179321 Sep 23 04:54:10.094941 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2478/5093] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:09 2022] GET /compute/v2.1/servers/3354b397-f391-47f2-8ded-f9227bfecb6f => generated 1491 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:54:10.766417 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c68e0de2-6481-4db6-8ed0-2bd86192c252 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:10.767137 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c68e0de2-6481-4db6-8ed0-2bd86192c252 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: 6174fd18-3f10-4034-85ee-32b05fde010f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:10.774767 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c68e0de2-6481-4db6-8ed0-2bd86192c252 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:10.774767 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c68e0de2-6481-4db6-8ed0-2bd86192c252 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:10.775316 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c68e0de2-6481-4db6-8ed0-2bd86192c252 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:10.776637 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c68e0de2-6481-4db6-8ed0-2bd86192c252 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:10.777281 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c68e0de2-6481-4db6-8ed0-2bd86192c252 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:10.777917 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c68e0de2-6481-4db6-8ed0-2bd86192c252 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:10.974508 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c68e0de2-6481-4db6-8ed0-2bd86192c252 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:10.982772 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c68e0de2-6481-4db6-8ed0-2bd86192c252 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f" status: 200 len: 1517 microversion: 2.1 time: 0.221160 Sep 23 04:54:10.983801 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2616/5094] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:10 2022] GET /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f => generated 1517 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:54:11.117034 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b47dd9b5-2105-4d0f-8497-fde544e02309 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:11.117711 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b47dd9b5-2105-4d0f-8497-fde544e02309 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 3354b397-f391-47f2-8ded-f9227bfecb6f] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:11.125201 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b47dd9b5-2105-4d0f-8497-fde544e02309 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:11.126008 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b47dd9b5-2105-4d0f-8497-fde544e02309 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:11.127493 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b47dd9b5-2105-4d0f-8497-fde544e02309 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:11.127493 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b47dd9b5-2105-4d0f-8497-fde544e02309 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:11.128151 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b47dd9b5-2105-4d0f-8497-fde544e02309 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:11.128664 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b47dd9b5-2105-4d0f-8497-fde544e02309 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:11.391700 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b47dd9b5-2105-4d0f-8497-fde544e02309 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:11.405960 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b47dd9b5-2105-4d0f-8497-fde544e02309 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/3354b397-f391-47f2-8ded-f9227bfecb6f" status: 200 len: 1512 microversion: 2.1 time: 0.292999 Sep 23 04:54:11.409628 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2479/5095] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:11 2022] GET /compute/v2.1/servers/3354b397-f391-47f2-8ded-f9227bfecb6f => generated 1512 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:54:12.007125 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-bfd535f1-c979-41c4-b363-2a777853c0c3 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:12.007900 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-bfd535f1-c979-41c4-b363-2a777853c0c3 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: 6174fd18-3f10-4034-85ee-32b05fde010f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:12.027564 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bfd535f1-c979-41c4-b363-2a777853c0c3 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:12.028208 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bfd535f1-c979-41c4-b363-2a777853c0c3 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:12.028731 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bfd535f1-c979-41c4-b363-2a777853c0c3 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:12.029524 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bfd535f1-c979-41c4-b363-2a777853c0c3 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:12.030015 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bfd535f1-c979-41c4-b363-2a777853c0c3 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:12.030472 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bfd535f1-c979-41c4-b363-2a777853c0c3 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:12.216102 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-bfd535f1-c979-41c4-b363-2a777853c0c3 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:12.234074 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-bfd535f1-c979-41c4-b363-2a777853c0c3 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f" status: 200 len: 1535 microversion: 2.1 time: 0.230507 Sep 23 04:54:12.235864 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2617/5096] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:12 2022] GET /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f => generated 1535 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:54:12.435458 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ce7a74cc-9662-47b9-8c6a-195840a77714 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:12.436721 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-ce7a74cc-9662-47b9-8c6a-195840a77714 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 3354b397-f391-47f2-8ded-f9227bfecb6f] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:12.443924 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ce7a74cc-9662-47b9-8c6a-195840a77714 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:12.444627 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ce7a74cc-9662-47b9-8c6a-195840a77714 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:12.445077 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ce7a74cc-9662-47b9-8c6a-195840a77714 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:12.446486 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ce7a74cc-9662-47b9-8c6a-195840a77714 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:12.447118 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ce7a74cc-9662-47b9-8c6a-195840a77714 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:12.447727 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ce7a74cc-9662-47b9-8c6a-195840a77714 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:12.730116 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ce7a74cc-9662-47b9-8c6a-195840a77714 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:12.741713 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:54:12.754017 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ce7a74cc-9662-47b9-8c6a-195840a77714 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/3354b397-f391-47f2-8ded-f9227bfecb6f" status: 200 len: 1512 microversion: 2.1 time: 0.323175 Sep 23 04:54:12.775144 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2480/5097] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:12 2022] GET /compute/v2.1/servers/3354b397-f391-47f2-8ded-f9227bfecb6f => generated 1512 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:54:13.262746 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-063d4b43-afe1-49ab-a806-22c4d4f28d66 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:13.263369 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-063d4b43-afe1-49ab-a806-22c4d4f28d66 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: 6174fd18-3f10-4034-85ee-32b05fde010f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:13.270581 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-063d4b43-afe1-49ab-a806-22c4d4f28d66 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:13.271570 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-063d4b43-afe1-49ab-a806-22c4d4f28d66 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:13.272068 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-063d4b43-afe1-49ab-a806-22c4d4f28d66 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:13.272988 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-063d4b43-afe1-49ab-a806-22c4d4f28d66 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:13.273646 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-063d4b43-afe1-49ab-a806-22c4d4f28d66 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:13.274129 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-063d4b43-afe1-49ab-a806-22c4d4f28d66 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:13.729939 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-063d4b43-afe1-49ab-a806-22c4d4f28d66 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:13.730521 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-063d4b43-afe1-49ab-a806-22c4d4f28d66 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f" status: 200 len: 1523 microversion: 2.1 time: 0.472301 Sep 23 04:54:13.733065 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2618/5098] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:13 2022] GET /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f => generated 1523 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:54:13.784601 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-92a879f8-3cd0-423d-a122-ce122531a2eb tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:13.785236 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-92a879f8-3cd0-423d-a122-ce122531a2eb tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 3354b397-f391-47f2-8ded-f9227bfecb6f] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:13.794276 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:54:13.813958 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-92a879f8-3cd0-423d-a122-ce122531a2eb tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:13.814351 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-92a879f8-3cd0-423d-a122-ce122531a2eb tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:13.814798 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-92a879f8-3cd0-423d-a122-ce122531a2eb tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:13.815417 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-92a879f8-3cd0-423d-a122-ce122531a2eb tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:13.816348 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-92a879f8-3cd0-423d-a122-ce122531a2eb tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:13.816696 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-92a879f8-3cd0-423d-a122-ce122531a2eb tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:13.825247 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-fa06da28-3d16-48ba-a669-ad9925561c29 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:13.825787 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-fa06da28-3d16-48ba-a669-ad9925561c29 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: f285e256-0a0e-4126-8adf-643bd59ca141] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:13.841725 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fa06da28-3d16-48ba-a669-ad9925561c29 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:13.844214 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fa06da28-3d16-48ba-a669-ad9925561c29 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:13.844682 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fa06da28-3d16-48ba-a669-ad9925561c29 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:13.845445 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fa06da28-3d16-48ba-a669-ad9925561c29 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:13.856269 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fa06da28-3d16-48ba-a669-ad9925561c29 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:13.856775 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fa06da28-3d16-48ba-a669-ad9925561c29 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:13.898832 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-fa06da28-3d16-48ba-a669-ad9925561c29 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] HTTP exception thrown: Instance f285e256-0a0e-4126-8adf-643bd59ca141 could not be found. Sep 23 04:54:13.900611 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-fa06da28-3d16-48ba-a669-ad9925561c29 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Request method failure captured: Sep 23 04:54:13.900611 n-d-846463-3 devstack@n-api.service[122699]: request: DELETE /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141 HTTP/1.1 Sep 23 04:54:13.900611 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:54:13.900611 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:54:13.900611 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:54:13.900611 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:54:13.900611 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:54:13.900611 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:54:13.900611 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:54:13.900611 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:54:13.900611 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLToveGoAQMGKa2MEoOD7pi4eoXebwWpQGYBxpi4v5d_5sCE8-ReUtgLxNqqDa5ZRa4NgKNhAN91c4cAyfH085Z25DFo9sDI3xEr7wMBgdXQQsjQLe9mvRYlGmbhD7LMsA85fhQUj8nzFBJzYkoK4oOVlzuKdqXhdKMrRGAYR1C8bRv8 Sep 23 04:54:13.900611 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:54:13.900611 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:54:13.900611 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:54:13.900611 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:54:13.900611 n-d-846463-3 devstack@n-api.service[122699]: X-Openstack-Nova-Api-Version: 2.20 Sep 23 04:54:13.900611 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:54:13.900611 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:54:13.900611 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 1cdfe96be196470889a58b56a19743a7 Sep 23 04:54:13.900611 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-480238040 Sep 23 04:54:13.900611 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:54:13.900611 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:54:13.900611 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1cdfe96be196470889a58b56a19743a7", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1cdfe96be196470889a58b56a19743a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1cdfe96be196470889a58b56a19743a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1cdfe96be196470889a58b56a19743a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:54:13.900611 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-AttachVolumeShelveTestJSON-480238040 Sep 23 04:54:13.900611 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 1cdfe96be196470889a58b56a19743a7 Sep 23 04:54:13.900611 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-480238040 Sep 23 04:54:13.900611 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-AttachVolumeShelveTestJSON-480238040-project Sep 23 04:54:13.900611 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:54:13.900611 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:54:13.900611 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: b87ca7119ee042c3bda1e88ff38fdb7c Sep 23 04:54:13.900611 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-AttachVolumeShelveTestJSON-480238040-project Sep 23 04:54:13.900611 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:54:13.900611 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance f285e256-0a0e-4126-8adf-643bd59ca141 could not be found. Sep 23 04:54:13.900611 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': 'f285e256-0a0e-4126-8adf-643bd59ca141'} Sep 23 04:54:13.900611 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:54:13.900611 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:54:13.900611 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:54:13.900611 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:54:13.900611 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:54:13.900611 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:54:13.900611 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:54:13.900611 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:54:13.900611 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:54:13.900611 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:54:13.900611 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f285e256-0a0e-4126-8adf-643bd59ca141 could not be found. Sep 23 04:54:13.900611 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:54:13.900611 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:54:13.900611 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:54:13.900611 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:54:13.900611 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:54:13.900611 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:54:13.900611 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:54:13.900611 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:54:13.900611 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:54:13.900611 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:54:13.900611 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 04:54:13.900611 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 04:54:13.900611 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 04:54:13.900611 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 04:54:13.900611 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:54:13.900611 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:54:13.900611 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:54:13.900611 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:54:13.905170 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f285e256-0a0e-4126-8adf-643bd59ca141 could not be found. Sep 23 04:54:13.905170 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:54:13.905170 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:54:13.905170 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:54:13.905170 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:54:13.905170 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:54:13.905170 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:54:13.905170 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:54:13.905170 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:54:13.905170 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f285e256-0a0e-4126-8adf-643bd59ca141 could not be found. Sep 23 04:54:13.905170 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:54:13.905170 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-fa06da28-3d16-48ba-a669-ad9925561c29 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Returning 404 to user: Instance f285e256-0a0e-4126-8adf-643bd59ca141 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:54:13.905170 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-fa06da28-3d16-48ba-a669-ad9925561c29 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141" status: 404 len: 111 microversion: 2.20 time: 0.081853 Sep 23 04:54:13.905170 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2619/5099] 10.222.0.33 () {60 vars in 1280 bytes} [Fri Sep 23 04:54:13 2022] DELETE /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 23 04:54:13.913333 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a86f8d2d-2a61-4175-b7fc-5f517b03a4fe tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:13.916163 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a86f8d2d-2a61-4175-b7fc-5f517b03a4fe tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: f285e256-0a0e-4126-8adf-643bd59ca141] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:13.925741 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a86f8d2d-2a61-4175-b7fc-5f517b03a4fe tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:13.929679 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a86f8d2d-2a61-4175-b7fc-5f517b03a4fe tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:13.931764 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a86f8d2d-2a61-4175-b7fc-5f517b03a4fe tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:13.932705 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a86f8d2d-2a61-4175-b7fc-5f517b03a4fe tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:13.934702 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a86f8d2d-2a61-4175-b7fc-5f517b03a4fe tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:13.935324 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a86f8d2d-2a61-4175-b7fc-5f517b03a4fe tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:13.967434 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-a86f8d2d-2a61-4175-b7fc-5f517b03a4fe tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] HTTP exception thrown: Instance f285e256-0a0e-4126-8adf-643bd59ca141 could not be found. Sep 23 04:54:13.969214 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a86f8d2d-2a61-4175-b7fc-5f517b03a4fe tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Request method failure captured: Sep 23 04:54:13.969214 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141 HTTP/1.1 Sep 23 04:54:13.969214 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:54:13.969214 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:54:13.969214 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:54:13.969214 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:54:13.969214 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:54:13.969214 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:54:13.969214 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:54:13.969214 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:54:13.969214 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLToveGoAQMGKa2MEoOD7pi4eoXebwWpQGYBxpi4v5d_5sCE8-ReUtgLxNqqDa5ZRa4NgKNhAN91c4cAyfH085Z25DFo9sDI3xEr7wMBgdXQQsjQLe9mvRYlGmbhD7LMsA85fhQUj8nzFBJzYkoK4oOVlzuKdqXhdKMrRGAYR1C8bRv8 Sep 23 04:54:13.969214 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:54:13.969214 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:54:13.969214 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:54:13.969214 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:54:13.969214 n-d-846463-3 devstack@n-api.service[122699]: X-Openstack-Nova-Api-Version: 2.20 Sep 23 04:54:13.969214 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:54:13.969214 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:54:13.969214 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 1cdfe96be196470889a58b56a19743a7 Sep 23 04:54:13.969214 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-480238040 Sep 23 04:54:13.969214 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:54:13.969214 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:54:13.969214 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1cdfe96be196470889a58b56a19743a7", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1cdfe96be196470889a58b56a19743a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1cdfe96be196470889a58b56a19743a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1cdfe96be196470889a58b56a19743a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:54:13.969214 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-AttachVolumeShelveTestJSON-480238040 Sep 23 04:54:13.969214 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 1cdfe96be196470889a58b56a19743a7 Sep 23 04:54:13.969214 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-480238040 Sep 23 04:54:13.969214 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-AttachVolumeShelveTestJSON-480238040-project Sep 23 04:54:13.969214 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:54:13.969214 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:54:13.969214 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: b87ca7119ee042c3bda1e88ff38fdb7c Sep 23 04:54:13.969214 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-AttachVolumeShelveTestJSON-480238040-project Sep 23 04:54:13.969214 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:54:13.969214 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance f285e256-0a0e-4126-8adf-643bd59ca141 could not be found. Sep 23 04:54:13.969214 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': 'f285e256-0a0e-4126-8adf-643bd59ca141'} Sep 23 04:54:13.969214 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:54:13.969214 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:54:13.969214 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:54:13.969214 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:54:13.969214 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:54:13.969214 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:54:13.969214 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:54:13.969214 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:54:13.969214 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:54:13.969214 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:54:13.969214 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f285e256-0a0e-4126-8adf-643bd59ca141 could not be found. Sep 23 04:54:13.969214 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:54:13.969214 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:54:13.969214 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:54:13.969214 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:54:13.969214 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:54:13.969214 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:54:13.969214 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:54:13.969214 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:54:13.969214 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:54:13.969214 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:54:13.969214 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:54:13.969214 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:54:13.969214 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:54:13.969214 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:54:13.969214 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:54:13.969214 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:54:13.969214 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f285e256-0a0e-4126-8adf-643bd59ca141 could not be found. Sep 23 04:54:13.969214 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:54:13.969214 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:54:13.973693 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:54:13.973693 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:54:13.973693 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:54:13.973693 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:54:13.973693 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:54:13.973693 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:54:13.973693 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f285e256-0a0e-4126-8adf-643bd59ca141 could not be found. Sep 23 04:54:13.973693 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:54:13.979997 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a86f8d2d-2a61-4175-b7fc-5f517b03a4fe tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Returning 404 to user: Instance f285e256-0a0e-4126-8adf-643bd59ca141 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:54:13.981125 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a86f8d2d-2a61-4175-b7fc-5f517b03a4fe tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141" status: 404 len: 111 microversion: 2.20 time: 0.073778 Sep 23 04:54:13.982824 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2620/5100] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:54:13 2022] GET /compute/v2.1/servers/f285e256-0a0e-4126-8adf-643bd59ca141 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 23 04:54:14.104652 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-308c16be-2cbd-4f4c-b6d7-0aaadd8d2098 tempest-TestNetworkAdvancedServerOps-1586243358 tempest-TestNetworkAdvancedServerOps-1586243358-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:14.104652 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-308c16be-2cbd-4f4c-b6d7-0aaadd8d2098 tempest-TestNetworkAdvancedServerOps-1586243358 tempest-TestNetworkAdvancedServerOps-1586243358-project-admin] [instance: 4381aca2-ea30-4473-9cd3-18c9b64f1937] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:14.115747 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-308c16be-2cbd-4f4c-b6d7-0aaadd8d2098 tempest-TestNetworkAdvancedServerOps-1586243358 tempest-TestNetworkAdvancedServerOps-1586243358-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:14.116262 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-308c16be-2cbd-4f4c-b6d7-0aaadd8d2098 tempest-TestNetworkAdvancedServerOps-1586243358 tempest-TestNetworkAdvancedServerOps-1586243358-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:14.116714 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-308c16be-2cbd-4f4c-b6d7-0aaadd8d2098 tempest-TestNetworkAdvancedServerOps-1586243358 tempest-TestNetworkAdvancedServerOps-1586243358-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:14.117440 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-308c16be-2cbd-4f4c-b6d7-0aaadd8d2098 tempest-TestNetworkAdvancedServerOps-1586243358 tempest-TestNetworkAdvancedServerOps-1586243358-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:14.118571 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-308c16be-2cbd-4f4c-b6d7-0aaadd8d2098 tempest-TestNetworkAdvancedServerOps-1586243358 tempest-TestNetworkAdvancedServerOps-1586243358-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:14.125595 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-308c16be-2cbd-4f4c-b6d7-0aaadd8d2098 tempest-TestNetworkAdvancedServerOps-1586243358 tempest-TestNetworkAdvancedServerOps-1586243358-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:14.290972 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-92a879f8-3cd0-423d-a122-ce122531a2eb tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:14.292406 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-92a879f8-3cd0-423d-a122-ce122531a2eb tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/3354b397-f391-47f2-8ded-f9227bfecb6f" status: 200 len: 1507 microversion: 2.1 time: 0.511635 Sep 23 04:54:14.299614 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2481/5101] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:13 2022] GET /compute/v2.1/servers/3354b397-f391-47f2-8ded-f9227bfecb6f => generated 1507 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:54:14.765830 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-51d3ffd1-a66e-459f-9bfd-edd585753362 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:14.766516 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-51d3ffd1-a66e-459f-9bfd-edd585753362 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: 6174fd18-3f10-4034-85ee-32b05fde010f] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:14.778424 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-51d3ffd1-a66e-459f-9bfd-edd585753362 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:14.783693 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-51d3ffd1-a66e-459f-9bfd-edd585753362 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:14.786290 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-51d3ffd1-a66e-459f-9bfd-edd585753362 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:14.790690 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-51d3ffd1-a66e-459f-9bfd-edd585753362 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:14.793510 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-51d3ffd1-a66e-459f-9bfd-edd585753362 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:14.794559 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-51d3ffd1-a66e-459f-9bfd-edd585753362 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:15.720035 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-308c16be-2cbd-4f4c-b6d7-0aaadd8d2098 tempest-TestNetworkAdvancedServerOps-1586243358 tempest-TestNetworkAdvancedServerOps-1586243358-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937" status: 200 len: 1834 microversion: 2.1 time: 1.625422 Sep 23 04:54:15.739351 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2621/5102] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:14 2022] GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937 => generated 1834 bytes in 1645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:54:15.761952 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-56a8501d-6a17-41b7-9137-3526b28a1a69 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:15.768135 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-56a8501d-6a17-41b7-9137-3526b28a1a69 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 3354b397-f391-47f2-8ded-f9227bfecb6f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:15.784340 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-56a8501d-6a17-41b7-9137-3526b28a1a69 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:15.785128 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-56a8501d-6a17-41b7-9137-3526b28a1a69 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:15.786577 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-56a8501d-6a17-41b7-9137-3526b28a1a69 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:15.792033 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-56a8501d-6a17-41b7-9137-3526b28a1a69 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:15.792767 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-56a8501d-6a17-41b7-9137-3526b28a1a69 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:15.796114 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-56a8501d-6a17-41b7-9137-3526b28a1a69 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:15.812271 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-51d3ffd1-a66e-459f-9bfd-edd585753362 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:15.823952 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-51d3ffd1-a66e-459f-9bfd-edd585753362 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f" status: 200 len: 1523 microversion: 2.1 time: 1.062080 Sep 23 04:54:15.827418 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2482/5103] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:14 2022] GET /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f => generated 1523 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:54:15.847549 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-20c8ea47-ca5b-4e6a-8bdc-c1bc95c70d9c tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:15.849442 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-20c8ea47-ca5b-4e6a-8bdc-c1bc95c70d9c tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 4381aca2-ea30-4473-9cd3-18c9b64f1937] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:15.875582 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-20c8ea47-ca5b-4e6a-8bdc-c1bc95c70d9c tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:15.876098 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-20c8ea47-ca5b-4e6a-8bdc-c1bc95c70d9c tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:15.876549 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-20c8ea47-ca5b-4e6a-8bdc-c1bc95c70d9c tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:15.880747 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-20c8ea47-ca5b-4e6a-8bdc-c1bc95c70d9c tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:15.884120 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-20c8ea47-ca5b-4e6a-8bdc-c1bc95c70d9c tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:15.887485 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-20c8ea47-ca5b-4e6a-8bdc-c1bc95c70d9c tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:16.728737 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-20c8ea47-ca5b-4e6a-8bdc-c1bc95c70d9c tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:16.740161 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-20c8ea47-ca5b-4e6a-8bdc-c1bc95c70d9c tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937" status: 200 len: 1683 microversion: 2.1 time: 0.909083 Sep 23 04:54:16.740161 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2483/5104] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:15 2022] GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937 => generated 1683 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:54:16.855716 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-87a30958-93db-493e-ba3e-44c1fe81404d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:16.857172 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-87a30958-93db-493e-ba3e-44c1fe81404d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: 6174fd18-3f10-4034-85ee-32b05fde010f] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:16.870699 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-87a30958-93db-493e-ba3e-44c1fe81404d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:16.876138 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-87a30958-93db-493e-ba3e-44c1fe81404d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:16.886710 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-87a30958-93db-493e-ba3e-44c1fe81404d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:16.888363 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-87a30958-93db-493e-ba3e-44c1fe81404d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:16.891587 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-87a30958-93db-493e-ba3e-44c1fe81404d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:16.895022 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-87a30958-93db-493e-ba3e-44c1fe81404d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:17.517658 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-56a8501d-6a17-41b7-9137-3526b28a1a69 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:17.528952 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-56a8501d-6a17-41b7-9137-3526b28a1a69 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/3354b397-f391-47f2-8ded-f9227bfecb6f" status: 200 len: 1507 microversion: 2.1 time: 1.786087 Sep 23 04:54:17.530724 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2622/5105] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:15 2022] GET /compute/v2.1/servers/3354b397-f391-47f2-8ded-f9227bfecb6f => generated 1507 bytes in 1791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:54:17.544889 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2890929e-0124-4ae8-9355-984244f9ef85 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:54:17.550402 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-2890929e-0124-4ae8-9355-984244f9ef85 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 4381aca2-ea30-4473-9cd3-18c9b64f1937] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:17.564812 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2890929e-0124-4ae8-9355-984244f9ef85 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:17.569197 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2890929e-0124-4ae8-9355-984244f9ef85 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:17.569869 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2890929e-0124-4ae8-9355-984244f9ef85 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:17.570876 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2890929e-0124-4ae8-9355-984244f9ef85 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:17.571513 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2890929e-0124-4ae8-9355-984244f9ef85 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:17.572132 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2890929e-0124-4ae8-9355-984244f9ef85 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:17.655406 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2890929e-0124-4ae8-9355-984244f9ef85 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "POST /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937/action" status: 200 len: 32631 microversion: 2.1 time: 0.123130 Sep 23 04:54:17.662827 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2623/5106] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:54:17 2022] POST /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937/action => generated 32631 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 04:54:17.672224 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-6be2c252-112c-41de-bf8a-2cfd38a08c76 req-199c241b-52f5-4001-aac4-6e3bb3adeb63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3354b397-f391-47f2-8ded-f9227bfecb6f", "name": "network-vif-plugged", "status": "completed", "tag": "2e084b59-e468-45fb-8081-c4bafdb31c08"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:54:17.705476 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-6be2c252-112c-41de-bf8a-2cfd38a08c76 req-199c241b-52f5-4001-aac4-6e3bb3adeb63 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:17.706208 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-6be2c252-112c-41de-bf8a-2cfd38a08c76 req-199c241b-52f5-4001-aac4-6e3bb3adeb63 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:17.706874 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-6be2c252-112c-41de-bf8a-2cfd38a08c76 req-199c241b-52f5-4001-aac4-6e3bb3adeb63 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:17.751477 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-6be2c252-112c-41de-bf8a-2cfd38a08c76 req-199c241b-52f5-4001-aac4-6e3bb3adeb63 service nova] Creating event network-vif-plugged:2e084b59-e468-45fb-8081-c4bafdb31c08 for instance 3354b397-f391-47f2-8ded-f9227bfecb6f on n-h1-846463-3 Sep 23 04:54:17.765236 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-6be2c252-112c-41de-bf8a-2cfd38a08c76 req-199c241b-52f5-4001-aac4-6e3bb3adeb63 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097188 Sep 23 04:54:17.766223 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2624/5107] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:54:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:54:17.806243 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-87a30958-93db-493e-ba3e-44c1fe81404d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:17.821272 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a0dca919-c803-4837-95d9-6a100b483a9d tempest-TestNetworkAdvancedServerOps-1586243358 tempest-TestNetworkAdvancedServerOps-1586243358-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:54:17.823120 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-87a30958-93db-493e-ba3e-44c1fe81404d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f" status: 200 len: 1523 microversion: 2.1 time: 0.970174 Sep 23 04:54:17.823572 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a0dca919-c803-4837-95d9-6a100b483a9d tempest-TestNetworkAdvancedServerOps-1586243358 tempest-TestNetworkAdvancedServerOps-1586243358-project-admin] [instance: 4381aca2-ea30-4473-9cd3-18c9b64f1937] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:17.824638 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2484/5108] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:16 2022] GET /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f => generated 1523 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:54:17.841033 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a0dca919-c803-4837-95d9-6a100b483a9d tempest-TestNetworkAdvancedServerOps-1586243358 tempest-TestNetworkAdvancedServerOps-1586243358-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:17.841842 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a0dca919-c803-4837-95d9-6a100b483a9d tempest-TestNetworkAdvancedServerOps-1586243358 tempest-TestNetworkAdvancedServerOps-1586243358-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:17.842487 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a0dca919-c803-4837-95d9-6a100b483a9d tempest-TestNetworkAdvancedServerOps-1586243358 tempest-TestNetworkAdvancedServerOps-1586243358-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:17.852528 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a0dca919-c803-4837-95d9-6a100b483a9d tempest-TestNetworkAdvancedServerOps-1586243358 tempest-TestNetworkAdvancedServerOps-1586243358-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:17.853529 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a0dca919-c803-4837-95d9-6a100b483a9d tempest-TestNetworkAdvancedServerOps-1586243358 tempest-TestNetworkAdvancedServerOps-1586243358-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:17.857562 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a0dca919-c803-4837-95d9-6a100b483a9d tempest-TestNetworkAdvancedServerOps-1586243358 tempest-TestNetworkAdvancedServerOps-1586243358-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:17.992110 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a0dca919-c803-4837-95d9-6a100b483a9d tempest-TestNetworkAdvancedServerOps-1586243358 tempest-TestNetworkAdvancedServerOps-1586243358-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '8d8531be725e4b06abd7f3763eb1f4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e64a2c6291604a0b842352a8ecfe35c3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:17.993831 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a0dca919-c803-4837-95d9-6a100b483a9d tempest-TestNetworkAdvancedServerOps-1586243358 tempest-TestNetworkAdvancedServerOps-1586243358-project-admin] [instance: 4381aca2-ea30-4473-9cd3-18c9b64f1937] flavor_id is None. Assuming migration. {{(pid=122699) resize /opt/stack/nova/nova/compute/api.py:4196}} Sep 23 04:54:17.994347 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a0dca919-c803-4837-95d9-6a100b483a9d tempest-TestNetworkAdvancedServerOps-1586243358 tempest-TestNetworkAdvancedServerOps-1586243358-project-admin] [instance: 4381aca2-ea30-4473-9cd3-18c9b64f1937] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122699) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 23 04:54:18.472753 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:54:18.558650 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5fc02a8a-5db0-407d-8810-9afcd9af17d6 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:18.559725 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5fc02a8a-5db0-407d-8810-9afcd9af17d6 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 3354b397-f391-47f2-8ded-f9227bfecb6f] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:18.578926 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5fc02a8a-5db0-407d-8810-9afcd9af17d6 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:18.582038 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5fc02a8a-5db0-407d-8810-9afcd9af17d6 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:18.591784 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5fc02a8a-5db0-407d-8810-9afcd9af17d6 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:18.591784 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5fc02a8a-5db0-407d-8810-9afcd9af17d6 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:18.591784 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5fc02a8a-5db0-407d-8810-9afcd9af17d6 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:18.591784 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5fc02a8a-5db0-407d-8810-9afcd9af17d6 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:18.829845 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a0dca919-c803-4837-95d9-6a100b483a9d tempest-TestNetworkAdvancedServerOps-1586243358 tempest-TestNetworkAdvancedServerOps-1586243358-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937/action" status: 202 len: 0 microversion: 2.1 time: 1.019663 Sep 23 04:54:18.838804 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2625/5109] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:54:17 2022] POST /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937/action => generated 0 bytes in 1030 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:54:18.855630 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c373c88c-ae13-4124-84bf-bd7d11d692c6 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:18.857288 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c373c88c-ae13-4124-84bf-bd7d11d692c6 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 4381aca2-ea30-4473-9cd3-18c9b64f1937] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:18.876993 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c373c88c-ae13-4124-84bf-bd7d11d692c6 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:18.882807 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c373c88c-ae13-4124-84bf-bd7d11d692c6 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:18.882807 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c373c88c-ae13-4124-84bf-bd7d11d692c6 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:18.882807 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c373c88c-ae13-4124-84bf-bd7d11d692c6 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:18.884023 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c373c88c-ae13-4124-84bf-bd7d11d692c6 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:18.885850 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c373c88c-ae13-4124-84bf-bd7d11d692c6 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:19.124646 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-5fc02a8a-5db0-407d-8810-9afcd9af17d6 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:19.176782 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5fc02a8a-5db0-407d-8810-9afcd9af17d6 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/3354b397-f391-47f2-8ded-f9227bfecb6f" status: 200 len: 1507 microversion: 2.1 time: 0.623401 Sep 23 04:54:19.180725 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2485/5110] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:18 2022] GET /compute/v2.1/servers/3354b397-f391-47f2-8ded-f9227bfecb6f => generated 1507 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:54:19.204461 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-466db56b-2b97-47f7-a88a-8b54d1adceb3 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:19.206737 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-466db56b-2b97-47f7-a88a-8b54d1adceb3 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: 6174fd18-3f10-4034-85ee-32b05fde010f] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:19.244324 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-466db56b-2b97-47f7-a88a-8b54d1adceb3 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:19.248112 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c373c88c-ae13-4124-84bf-bd7d11d692c6 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:19.251833 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-466db56b-2b97-47f7-a88a-8b54d1adceb3 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.032s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:19.252547 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-466db56b-2b97-47f7-a88a-8b54d1adceb3 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:19.253473 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-466db56b-2b97-47f7-a88a-8b54d1adceb3 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:19.254245 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-466db56b-2b97-47f7-a88a-8b54d1adceb3 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:19.255586 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-466db56b-2b97-47f7-a88a-8b54d1adceb3 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:19.256711 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c373c88c-ae13-4124-84bf-bd7d11d692c6 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937" status: 200 len: 1692 microversion: 2.1 time: 0.414824 Sep 23 04:54:19.257316 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2626/5111] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:18 2022] GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937 => generated 1692 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:54:19.848071 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-9d438bed-1568-4c62-bbd9-71c94585df0d req-034229af-979a-4aab-91cb-c649c0a3ae5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6174fd18-3f10-4034-85ee-32b05fde010f", "name": "network-vif-unplugged", "status": "completed", "tag": "d59a64b4-b8c2-44d3-90e0-14542ae01845"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:54:19.850805 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-466db56b-2b97-47f7-a88a-8b54d1adceb3 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:19.865122 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-466db56b-2b97-47f7-a88a-8b54d1adceb3 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f" status: 200 len: 1523 microversion: 2.1 time: 0.679734 Sep 23 04:54:19.865739 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2486/5112] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:19 2022] GET /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f => generated 1523 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:54:19.880137 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-9d438bed-1568-4c62-bbd9-71c94585df0d req-034229af-979a-4aab-91cb-c649c0a3ae5a service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:19.880137 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-9d438bed-1568-4c62-bbd9-71c94585df0d req-034229af-979a-4aab-91cb-c649c0a3ae5a service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:19.880137 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-9d438bed-1568-4c62-bbd9-71c94585df0d req-034229af-979a-4aab-91cb-c649c0a3ae5a service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:19.892723 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-9d438bed-1568-4c62-bbd9-71c94585df0d req-034229af-979a-4aab-91cb-c649c0a3ae5a service nova] Creating event network-vif-unplugged:d59a64b4-b8c2-44d3-90e0-14542ae01845 for instance 6174fd18-3f10-4034-85ee-32b05fde010f on n-h2-846463-3 Sep 23 04:54:19.905803 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-9d438bed-1568-4c62-bbd9-71c94585df0d req-034229af-979a-4aab-91cb-c649c0a3ae5a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.067955 Sep 23 04:54:19.908670 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2627/5113] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:54:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:54:20.207728 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6c974c68-8fd1-43f1-bf2b-c562d5290e15 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:20.208355 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-6c974c68-8fd1-43f1-bf2b-c562d5290e15 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 3354b397-f391-47f2-8ded-f9227bfecb6f] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:20.215125 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6c974c68-8fd1-43f1-bf2b-c562d5290e15 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:20.215999 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6c974c68-8fd1-43f1-bf2b-c562d5290e15 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:20.216666 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6c974c68-8fd1-43f1-bf2b-c562d5290e15 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:20.218193 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6c974c68-8fd1-43f1-bf2b-c562d5290e15 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:20.219019 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6c974c68-8fd1-43f1-bf2b-c562d5290e15 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:20.220458 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6c974c68-8fd1-43f1-bf2b-c562d5290e15 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:20.288823 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3e11d2fb-1436-4b0e-a0c3-b5de72fea891 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:20.290249 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-3e11d2fb-1436-4b0e-a0c3-b5de72fea891 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 4381aca2-ea30-4473-9cd3-18c9b64f1937] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:20.308678 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3e11d2fb-1436-4b0e-a0c3-b5de72fea891 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:20.312037 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3e11d2fb-1436-4b0e-a0c3-b5de72fea891 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:20.314240 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3e11d2fb-1436-4b0e-a0c3-b5de72fea891 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:20.318595 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3e11d2fb-1436-4b0e-a0c3-b5de72fea891 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:20.319649 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3e11d2fb-1436-4b0e-a0c3-b5de72fea891 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:20.321840 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3e11d2fb-1436-4b0e-a0c3-b5de72fea891 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:21.007872 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6c974c68-8fd1-43f1-bf2b-c562d5290e15 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:21.026282 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-6c974c68-8fd1-43f1-bf2b-c562d5290e15 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/3354b397-f391-47f2-8ded-f9227bfecb6f" status: 200 len: 1507 microversion: 2.1 time: 0.814451 Sep 23 04:54:21.027438 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2487/5114] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:20 2022] GET /compute/v2.1/servers/3354b397-f391-47f2-8ded-f9227bfecb6f => generated 1507 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:54:21.042577 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-70f291e1-cbf9-4049-9cf6-bf75394e9434 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:21.043415 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-70f291e1-cbf9-4049-9cf6-bf75394e9434 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: 6174fd18-3f10-4034-85ee-32b05fde010f] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:21.049704 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-70f291e1-cbf9-4049-9cf6-bf75394e9434 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:21.070059 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-70f291e1-cbf9-4049-9cf6-bf75394e9434 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:21.071544 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-70f291e1-cbf9-4049-9cf6-bf75394e9434 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:21.073386 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-70f291e1-cbf9-4049-9cf6-bf75394e9434 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:21.082175 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-70f291e1-cbf9-4049-9cf6-bf75394e9434 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:21.082755 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-70f291e1-cbf9-4049-9cf6-bf75394e9434 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:21.273228 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-3e11d2fb-1436-4b0e-a0c3-b5de72fea891 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:21.286068 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3e11d2fb-1436-4b0e-a0c3-b5de72fea891 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937" status: 200 len: 1692 microversion: 2.1 time: 1.002708 Sep 23 04:54:21.288899 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2628/5115] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:20 2022] GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937 => generated 1692 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:54:21.304004 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-bfcac806-bcaa-47cd-9642-0defc8d5eab4 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:21.321198 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-bfcac806-bcaa-47cd-9642-0defc8d5eab4 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: fe7dee09-8351-4d41-8c44-8d35a966cce9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:21.355693 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bfcac806-bcaa-47cd-9642-0defc8d5eab4 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:21.356289 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bfcac806-bcaa-47cd-9642-0defc8d5eab4 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:21.356747 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bfcac806-bcaa-47cd-9642-0defc8d5eab4 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:21.366645 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bfcac806-bcaa-47cd-9642-0defc8d5eab4 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:21.367253 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bfcac806-bcaa-47cd-9642-0defc8d5eab4 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:21.368171 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bfcac806-bcaa-47cd-9642-0defc8d5eab4 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:21.411522 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-bfcac806-bcaa-47cd-9642-0defc8d5eab4 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] HTTP exception thrown: Instance fe7dee09-8351-4d41-8c44-8d35a966cce9 could not be found. Sep 23 04:54:21.413240 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-bfcac806-bcaa-47cd-9642-0defc8d5eab4 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Request method failure captured: Sep 23 04:54:21.413240 n-d-846463-3 devstack@n-api.service[122699]: request: DELETE /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9 HTTP/1.1 Sep 23 04:54:21.413240 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:54:21.413240 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:54:21.413240 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:54:21.413240 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:54:21.413240 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:54:21.413240 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:54:21.413240 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:54:21.413240 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:54:21.413240 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLToveGoAQMGKa2MEoOD7pi4eoXebwWpQGYBxpi4v5d_5sCE8-ReUtgLxNqqDa5ZRa4NgKNhAN91c4cAyfH085Z25DFo9sDI3xEr7wMBgdXQQsjQLe9mvRYlGmbhD7LMsA85fhQUj8nzFBJzYkoK4oOVlzuKdqXhdKMrRGAYR1C8bRv8 Sep 23 04:54:21.413240 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:54:21.413240 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:54:21.413240 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:54:21.413240 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:54:21.413240 n-d-846463-3 devstack@n-api.service[122699]: X-Openstack-Nova-Api-Version: 2.20 Sep 23 04:54:21.413240 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:54:21.413240 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:54:21.413240 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 1cdfe96be196470889a58b56a19743a7 Sep 23 04:54:21.413240 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-480238040 Sep 23 04:54:21.413240 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:54:21.413240 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:54:21.413240 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1cdfe96be196470889a58b56a19743a7", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1cdfe96be196470889a58b56a19743a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1cdfe96be196470889a58b56a19743a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1cdfe96be196470889a58b56a19743a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:54:21.413240 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-AttachVolumeShelveTestJSON-480238040 Sep 23 04:54:21.413240 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 1cdfe96be196470889a58b56a19743a7 Sep 23 04:54:21.413240 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-480238040 Sep 23 04:54:21.413240 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-AttachVolumeShelveTestJSON-480238040-project Sep 23 04:54:21.413240 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:54:21.413240 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:54:21.413240 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: b87ca7119ee042c3bda1e88ff38fdb7c Sep 23 04:54:21.413240 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-AttachVolumeShelveTestJSON-480238040-project Sep 23 04:54:21.413240 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:54:21.413240 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance fe7dee09-8351-4d41-8c44-8d35a966cce9 could not be found. Sep 23 04:54:21.413240 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': 'fe7dee09-8351-4d41-8c44-8d35a966cce9'} Sep 23 04:54:21.413240 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:54:21.413240 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:54:21.413240 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:54:21.413240 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:54:21.413240 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:54:21.413240 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:54:21.413240 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:54:21.413240 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:54:21.413240 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:54:21.413240 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:54:21.413240 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe7dee09-8351-4d41-8c44-8d35a966cce9 could not be found. Sep 23 04:54:21.413240 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:54:21.413240 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:54:21.413240 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:54:21.413240 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:54:21.413240 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:54:21.413240 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:54:21.413240 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:54:21.413240 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:54:21.413240 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:54:21.413240 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:54:21.413240 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 04:54:21.413240 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 04:54:21.413240 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 04:54:21.413240 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 04:54:21.413240 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:54:21.413240 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:54:21.413240 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:54:21.413240 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:54:21.418482 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe7dee09-8351-4d41-8c44-8d35a966cce9 could not be found. Sep 23 04:54:21.418482 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:54:21.418482 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:54:21.418482 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:54:21.418482 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:54:21.418482 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:54:21.418482 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:54:21.418482 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:54:21.418482 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:54:21.418482 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe7dee09-8351-4d41-8c44-8d35a966cce9 could not be found. Sep 23 04:54:21.418482 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:54:21.418482 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-bfcac806-bcaa-47cd-9642-0defc8d5eab4 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Returning 404 to user: Instance fe7dee09-8351-4d41-8c44-8d35a966cce9 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:54:21.430839 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-bfcac806-bcaa-47cd-9642-0defc8d5eab4 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "DELETE /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9" status: 404 len: 111 microversion: 2.20 time: 0.131583 Sep 23 04:54:21.431963 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2629/5116] 10.222.0.33 () {60 vars in 1280 bytes} [Fri Sep 23 04:54:21 2022] DELETE /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9 => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 23 04:54:21.441244 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-fbf0a153-0e73-4512-b80c-e8fad215d210 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:21.458897 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-fbf0a153-0e73-4512-b80c-e8fad215d210 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] [instance: fe7dee09-8351-4d41-8c44-8d35a966cce9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:21.466121 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fbf0a153-0e73-4512-b80c-e8fad215d210 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:21.466862 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fbf0a153-0e73-4512-b80c-e8fad215d210 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:21.467475 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fbf0a153-0e73-4512-b80c-e8fad215d210 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:21.484202 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fbf0a153-0e73-4512-b80c-e8fad215d210 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:21.484202 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fbf0a153-0e73-4512-b80c-e8fad215d210 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:21.484202 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fbf0a153-0e73-4512-b80c-e8fad215d210 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:21.523272 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-fbf0a153-0e73-4512-b80c-e8fad215d210 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] HTTP exception thrown: Instance fe7dee09-8351-4d41-8c44-8d35a966cce9 could not be found. Sep 23 04:54:21.525148 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-fbf0a153-0e73-4512-b80c-e8fad215d210 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Request method failure captured: Sep 23 04:54:21.525148 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9 HTTP/1.1 Sep 23 04:54:21.525148 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:54:21.525148 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:54:21.525148 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:54:21.525148 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:54:21.525148 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:54:21.525148 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:54:21.525148 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:54:21.525148 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:54:21.525148 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLToveGoAQMGKa2MEoOD7pi4eoXebwWpQGYBxpi4v5d_5sCE8-ReUtgLxNqqDa5ZRa4NgKNhAN91c4cAyfH085Z25DFo9sDI3xEr7wMBgdXQQsjQLe9mvRYlGmbhD7LMsA85fhQUj8nzFBJzYkoK4oOVlzuKdqXhdKMrRGAYR1C8bRv8 Sep 23 04:54:21.525148 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:54:21.525148 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:54:21.525148 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:54:21.525148 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:54:21.525148 n-d-846463-3 devstack@n-api.service[122699]: X-Openstack-Nova-Api-Version: 2.20 Sep 23 04:54:21.525148 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:54:21.525148 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:54:21.525148 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 1cdfe96be196470889a58b56a19743a7 Sep 23 04:54:21.525148 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-480238040 Sep 23 04:54:21.525148 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:54:21.525148 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:54:21.525148 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1cdfe96be196470889a58b56a19743a7", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1cdfe96be196470889a58b56a19743a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1cdfe96be196470889a58b56a19743a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1cdfe96be196470889a58b56a19743a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:54:21.525148 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-AttachVolumeShelveTestJSON-480238040 Sep 23 04:54:21.525148 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 1cdfe96be196470889a58b56a19743a7 Sep 23 04:54:21.525148 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-480238040 Sep 23 04:54:21.525148 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-AttachVolumeShelveTestJSON-480238040-project Sep 23 04:54:21.525148 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:54:21.525148 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:54:21.525148 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: b87ca7119ee042c3bda1e88ff38fdb7c Sep 23 04:54:21.525148 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-AttachVolumeShelveTestJSON-480238040-project Sep 23 04:54:21.525148 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:54:21.525148 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance fe7dee09-8351-4d41-8c44-8d35a966cce9 could not be found. Sep 23 04:54:21.525148 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': 'fe7dee09-8351-4d41-8c44-8d35a966cce9'} Sep 23 04:54:21.525148 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:54:21.525148 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:54:21.525148 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:54:21.525148 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:54:21.525148 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:54:21.525148 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:54:21.525148 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:54:21.525148 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:54:21.525148 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:54:21.525148 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:54:21.525148 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe7dee09-8351-4d41-8c44-8d35a966cce9 could not be found. Sep 23 04:54:21.525148 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:54:21.525148 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:54:21.525148 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:54:21.525148 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:54:21.525148 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:54:21.525148 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:54:21.525148 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:54:21.525148 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:54:21.525148 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:54:21.525148 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:54:21.525148 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:54:21.525148 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:54:21.525148 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:54:21.525148 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:54:21.525148 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:54:21.525148 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:54:21.525148 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe7dee09-8351-4d41-8c44-8d35a966cce9 could not be found. Sep 23 04:54:21.525148 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:54:21.525148 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:54:21.529945 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:54:21.529945 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:54:21.529945 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:54:21.529945 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:54:21.529945 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:54:21.529945 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:54:21.529945 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe7dee09-8351-4d41-8c44-8d35a966cce9 could not be found. Sep 23 04:54:21.529945 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:54:21.531237 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-fbf0a153-0e73-4512-b80c-e8fad215d210 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] Returning 404 to user: Instance fe7dee09-8351-4d41-8c44-8d35a966cce9 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:54:21.532326 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-fbf0a153-0e73-4512-b80c-e8fad215d210 tempest-AttachVolumeShelveTestJSON-480238040 tempest-AttachVolumeShelveTestJSON-480238040-project] 10.222.0.33 "GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9" status: 404 len: 111 microversion: 2.20 time: 0.096073 Sep 23 04:54:21.533372 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2630/5117] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:54:21 2022] GET /compute/v2.1/servers/fe7dee09-8351-4d41-8c44-8d35a966cce9 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 23 04:54:21.628022 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-70f291e1-cbf9-4049-9cf6-bf75394e9434 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:21.637422 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-70f291e1-cbf9-4049-9cf6-bf75394e9434 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f" status: 200 len: 1523 microversion: 2.1 time: 0.607882 Sep 23 04:54:21.649152 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2488/5118] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:21 2022] GET /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f => generated 1523 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:54:22.052999 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-938f0f58-7595-4940-a3cc-39bafc38378a tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:22.054662 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-938f0f58-7595-4940-a3cc-39bafc38378a tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 3354b397-f391-47f2-8ded-f9227bfecb6f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:22.067830 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-938f0f58-7595-4940-a3cc-39bafc38378a tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:22.074914 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-938f0f58-7595-4940-a3cc-39bafc38378a tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:22.080370 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-938f0f58-7595-4940-a3cc-39bafc38378a tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:22.080370 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-938f0f58-7595-4940-a3cc-39bafc38378a tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:22.080370 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-938f0f58-7595-4940-a3cc-39bafc38378a tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:22.080370 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-938f0f58-7595-4940-a3cc-39bafc38378a tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:22.316330 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-13a4bbef-a517-4912-9520-bb993987bc11 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:22.317599 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-13a4bbef-a517-4912-9520-bb993987bc11 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 4381aca2-ea30-4473-9cd3-18c9b64f1937] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:22.377966 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-13a4bbef-a517-4912-9520-bb993987bc11 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:22.378639 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-13a4bbef-a517-4912-9520-bb993987bc11 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:22.379940 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-13a4bbef-a517-4912-9520-bb993987bc11 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:22.412297 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-13a4bbef-a517-4912-9520-bb993987bc11 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:22.416668 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-13a4bbef-a517-4912-9520-bb993987bc11 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:22.418198 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-13a4bbef-a517-4912-9520-bb993987bc11 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:23.794451 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-938f0f58-7595-4940-a3cc-39bafc38378a tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:23.809254 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-938f0f58-7595-4940-a3cc-39bafc38378a tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/3354b397-f391-47f2-8ded-f9227bfecb6f" status: 200 len: 1507 microversion: 2.1 time: 1.759605 Sep 23 04:54:23.810024 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2631/5119] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:22 2022] GET /compute/v2.1/servers/3354b397-f391-47f2-8ded-f9227bfecb6f => generated 1507 bytes in 1762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:54:23.841179 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-87b0f0ba-d05c-4860-8fe9-265cb52ed8a1 req-7d673bad-1bb4-49f3-a1bc-22cbbb811092 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6174fd18-3f10-4034-85ee-32b05fde010f", "name": "network-vif-plugged", "status": "completed", "tag": "d59a64b4-b8c2-44d3-90e0-14542ae01845"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:54:23.891188 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-87b0f0ba-d05c-4860-8fe9-265cb52ed8a1 req-7d673bad-1bb4-49f3-a1bc-22cbbb811092 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:23.895183 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-87b0f0ba-d05c-4860-8fe9-265cb52ed8a1 req-7d673bad-1bb4-49f3-a1bc-22cbbb811092 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:23.895619 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-87b0f0ba-d05c-4860-8fe9-265cb52ed8a1 req-7d673bad-1bb4-49f3-a1bc-22cbbb811092 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:23.936057 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-13a4bbef-a517-4912-9520-bb993987bc11 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:23.944570 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-87b0f0ba-d05c-4860-8fe9-265cb52ed8a1 req-7d673bad-1bb4-49f3-a1bc-22cbbb811092 service nova] Creating event network-vif-plugged:d59a64b4-b8c2-44d3-90e0-14542ae01845 for instance 6174fd18-3f10-4034-85ee-32b05fde010f on n-h2-846463-3 Sep 23 04:54:23.954510 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-13a4bbef-a517-4912-9520-bb993987bc11 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937" status: 200 len: 1692 microversion: 2.1 time: 1.637006 Sep 23 04:54:23.954510 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2489/5120] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:22 2022] GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937 => generated 1692 bytes in 1639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:54:23.964617 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8dbfa4b5-5ade-43e4-8d74-6f4956d09a4f tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:23.966243 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8dbfa4b5-5ade-43e4-8d74-6f4956d09a4f tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: 6174fd18-3f10-4034-85ee-32b05fde010f] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:23.972555 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-87b0f0ba-d05c-4860-8fe9-265cb52ed8a1 req-7d673bad-1bb4-49f3-a1bc-22cbbb811092 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138145 Sep 23 04:54:23.973353 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2632/5121] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:54:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:54:23.976556 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8dbfa4b5-5ade-43e4-8d74-6f4956d09a4f tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:23.977286 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8dbfa4b5-5ade-43e4-8d74-6f4956d09a4f tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:23.978146 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8dbfa4b5-5ade-43e4-8d74-6f4956d09a4f tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:23.996185 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8dbfa4b5-5ade-43e4-8d74-6f4956d09a4f tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:23.997477 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8dbfa4b5-5ade-43e4-8d74-6f4956d09a4f tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:23.997978 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8dbfa4b5-5ade-43e4-8d74-6f4956d09a4f tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:24.617992 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8dbfa4b5-5ade-43e4-8d74-6f4956d09a4f tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:24.644261 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8dbfa4b5-5ade-43e4-8d74-6f4956d09a4f tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f" status: 200 len: 1523 microversion: 2.1 time: 0.692243 Sep 23 04:54:24.645119 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2490/5122] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:23 2022] GET /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f => generated 1523 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:54:24.844904 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-88333a21-0d83-418a-a8a8-d6ac3867ae0c tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:24.846457 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-88333a21-0d83-418a-a8a8-d6ac3867ae0c tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 3354b397-f391-47f2-8ded-f9227bfecb6f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:24.866930 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-88333a21-0d83-418a-a8a8-d6ac3867ae0c tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:24.872244 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-88333a21-0d83-418a-a8a8-d6ac3867ae0c tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:24.872979 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-88333a21-0d83-418a-a8a8-d6ac3867ae0c tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:24.877064 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-88333a21-0d83-418a-a8a8-d6ac3867ae0c tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:24.879906 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-88333a21-0d83-418a-a8a8-d6ac3867ae0c tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:24.882710 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-88333a21-0d83-418a-a8a8-d6ac3867ae0c tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:24.981221 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-66ce951d-f0fb-4515-a8d7-1772989b2a66 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:24.983563 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-66ce951d-f0fb-4515-a8d7-1772989b2a66 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 4381aca2-ea30-4473-9cd3-18c9b64f1937] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:25.002782 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-66ce951d-f0fb-4515-a8d7-1772989b2a66 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:25.009879 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-66ce951d-f0fb-4515-a8d7-1772989b2a66 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:25.011596 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-66ce951d-f0fb-4515-a8d7-1772989b2a66 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:25.012751 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-66ce951d-f0fb-4515-a8d7-1772989b2a66 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:25.013719 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-66ce951d-f0fb-4515-a8d7-1772989b2a66 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:25.014358 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-66ce951d-f0fb-4515-a8d7-1772989b2a66 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:25.940003 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-88333a21-0d83-418a-a8a8-d6ac3867ae0c tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:25.955907 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-66ce951d-f0fb-4515-a8d7-1772989b2a66 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:25.957744 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-88333a21-0d83-418a-a8a8-d6ac3867ae0c tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/3354b397-f391-47f2-8ded-f9227bfecb6f" status: 200 len: 1507 microversion: 2.1 time: 1.123085 Sep 23 04:54:25.969439 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-66ce951d-f0fb-4515-a8d7-1772989b2a66 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937" status: 200 len: 1692 microversion: 2.1 time: 0.992990 Sep 23 04:54:25.982080 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2633/5123] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:24 2022] GET /compute/v2.1/servers/3354b397-f391-47f2-8ded-f9227bfecb6f => generated 1507 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:54:25.989019 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2491/5124] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:24 2022] GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937 => generated 1692 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:54:25.994802 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5f076a8a-6085-41f4-a545-b8f5f2730020 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:26.002508 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-5f076a8a-6085-41f4-a545-b8f5f2730020 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: 6174fd18-3f10-4034-85ee-32b05fde010f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:26.019597 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5f076a8a-6085-41f4-a545-b8f5f2730020 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:26.031835 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5f076a8a-6085-41f4-a545-b8f5f2730020 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:26.031835 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5f076a8a-6085-41f4-a545-b8f5f2730020 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:26.031835 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5f076a8a-6085-41f4-a545-b8f5f2730020 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:26.031835 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5f076a8a-6085-41f4-a545-b8f5f2730020 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:26.032986 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5f076a8a-6085-41f4-a545-b8f5f2730020 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:26.767752 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-5f076a8a-6085-41f4-a545-b8f5f2730020 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:26.780965 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5f076a8a-6085-41f4-a545-b8f5f2730020 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f" status: 200 len: 1523 microversion: 2.1 time: 0.797353 Sep 23 04:54:26.783920 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2634/5125] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:25 2022] GET /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f => generated 1523 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:54:26.985106 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5fab8dd5-561d-4456-bd5f-53d952ff5723 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:26.985626 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5fab8dd5-561d-4456-bd5f-53d952ff5723 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 3354b397-f391-47f2-8ded-f9227bfecb6f] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:26.994274 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-95b237b1-865b-4c14-bd94-981f47b56531 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:26.995057 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-95b237b1-865b-4c14-bd94-981f47b56531 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 4381aca2-ea30-4473-9cd3-18c9b64f1937] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:27.003143 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-95b237b1-865b-4c14-bd94-981f47b56531 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:27.011930 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5fab8dd5-561d-4456-bd5f-53d952ff5723 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:27.012460 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5fab8dd5-561d-4456-bd5f-53d952ff5723 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:27.012886 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5fab8dd5-561d-4456-bd5f-53d952ff5723 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:27.013747 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5fab8dd5-561d-4456-bd5f-53d952ff5723 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:27.014427 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5fab8dd5-561d-4456-bd5f-53d952ff5723 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:27.015026 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5fab8dd5-561d-4456-bd5f-53d952ff5723 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:27.016397 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-95b237b1-865b-4c14-bd94-981f47b56531 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:27.018346 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-95b237b1-865b-4c14-bd94-981f47b56531 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:27.019610 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-95b237b1-865b-4c14-bd94-981f47b56531 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:27.026949 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-95b237b1-865b-4c14-bd94-981f47b56531 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:27.031558 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-95b237b1-865b-4c14-bd94-981f47b56531 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:27.698169 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-5fab8dd5-561d-4456-bd5f-53d952ff5723 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:27.713299 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5fab8dd5-561d-4456-bd5f-53d952ff5723 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/3354b397-f391-47f2-8ded-f9227bfecb6f" status: 200 len: 1507 microversion: 2.1 time: 0.732641 Sep 23 04:54:27.731440 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2492/5126] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:26 2022] GET /compute/v2.1/servers/3354b397-f391-47f2-8ded-f9227bfecb6f => generated 1507 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:54:27.813670 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-cfeb453f-4d89-4695-ba82-18e3e0f93ea7 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:27.814461 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-cfeb453f-4d89-4695-ba82-18e3e0f93ea7 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: 6174fd18-3f10-4034-85ee-32b05fde010f] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:27.831739 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cfeb453f-4d89-4695-ba82-18e3e0f93ea7 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:27.832717 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cfeb453f-4d89-4695-ba82-18e3e0f93ea7 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:27.833339 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cfeb453f-4d89-4695-ba82-18e3e0f93ea7 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:27.836449 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cfeb453f-4d89-4695-ba82-18e3e0f93ea7 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:27.836773 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-95b237b1-865b-4c14-bd94-981f47b56531 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:27.837574 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cfeb453f-4d89-4695-ba82-18e3e0f93ea7 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:27.838069 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cfeb453f-4d89-4695-ba82-18e3e0f93ea7 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:27.856711 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-95b237b1-865b-4c14-bd94-981f47b56531 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937" status: 200 len: 1697 microversion: 2.1 time: 0.866417 Sep 23 04:54:27.857543 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2635/5127] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:26 2022] GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937 => generated 1697 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:54:28.218076 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-cfeb453f-4d89-4695-ba82-18e3e0f93ea7 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:28.230173 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-cfeb453f-4d89-4695-ba82-18e3e0f93ea7 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f" status: 200 len: 1508 microversion: 2.1 time: 0.423243 Sep 23 04:54:28.231100 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2493/5128] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:27 2022] GET /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f => generated 1508 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:54:28.262263 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1e98a7a7-206f-4239-a404-d3d63548746c tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:28.262878 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1e98a7a7-206f-4239-a404-d3d63548746c tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: 6174fd18-3f10-4034-85ee-32b05fde010f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:28.281166 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e98a7a7-206f-4239-a404-d3d63548746c tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:28.281744 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e98a7a7-206f-4239-a404-d3d63548746c tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:28.290568 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e98a7a7-206f-4239-a404-d3d63548746c tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:28.291387 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e98a7a7-206f-4239-a404-d3d63548746c tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:28.291884 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e98a7a7-206f-4239-a404-d3d63548746c tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:28.292329 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e98a7a7-206f-4239-a404-d3d63548746c tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:28.457961 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8248ae78-fe85-48f6-86c5-b42c7c38b8a5 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-600506240", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "networks": [{"uuid": "b1dbca18-b576-4edc-ab3e-d520f3b38bf1"}]}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:54:28.542054 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.network.neutron [None req-8248ae78-fe85-48f6-86c5-b42c7c38b8a5 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] validate_networks() for [('b1dbca18-b576-4edc-ab3e-d520f3b38bf1', None, None, None, None, None)] {{(pid=122698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:54:28.852651 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1e98a7a7-206f-4239-a404-d3d63548746c tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:28.866365 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1e98a7a7-206f-4239-a404-d3d63548746c tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f" status: 200 len: 1508 microversion: 2.1 time: 0.608343 Sep 23 04:54:28.866967 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2636/5129] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:28 2022] GET /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f => generated 1508 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:54:28.892561 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1b556ecb-d792-495d-ab29-8d1177fec032 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:28.893512 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1b556ecb-d792-495d-ab29-8d1177fec032 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 3354b397-f391-47f2-8ded-f9227bfecb6f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:28.909427 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1b556ecb-d792-495d-ab29-8d1177fec032 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:28.910456 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1b556ecb-d792-495d-ab29-8d1177fec032 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:28.911678 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1b556ecb-d792-495d-ab29-8d1177fec032 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:28.914477 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1b556ecb-d792-495d-ab29-8d1177fec032 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:28.915105 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1b556ecb-d792-495d-ab29-8d1177fec032 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:28.916373 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1b556ecb-d792-495d-ab29-8d1177fec032 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:29.909335 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1b556ecb-d792-495d-ab29-8d1177fec032 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:29.926005 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1b556ecb-d792-495d-ab29-8d1177fec032 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/3354b397-f391-47f2-8ded-f9227bfecb6f" status: 200 len: 1507 microversion: 2.1 time: 1.045908 Sep 23 04:54:29.932402 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-8248ae78-fe85-48f6-86c5-b42c7c38b8a5 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Flavor limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:54:29.935121 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-8248ae78-fe85-48f6-86c5-b42c7c38b8a5 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Image limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:54:29.935121 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-8248ae78-fe85-48f6-86c5-b42c7c38b8a5 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Flavor pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:54:29.935121 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-8248ae78-fe85-48f6-86c5-b42c7c38b8a5 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Image pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:54:29.936065 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-8248ae78-fe85-48f6-86c5-b42c7c38b8a5 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:54:29.944459 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2637/5130] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:28 2022] GET /compute/v2.1/servers/3354b397-f391-47f2-8ded-f9227bfecb6f => generated 1507 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:54:29.949815 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0a9e01b7-87c8-455d-9cc0-ff24c71e69f7 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:29.956547 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-0a9e01b7-87c8-455d-9cc0-ff24c71e69f7 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 4381aca2-ea30-4473-9cd3-18c9b64f1937] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:29.963574 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8248ae78-fe85-48f6-86c5-b42c7c38b8a5 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:29.964950 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0a9e01b7-87c8-455d-9cc0-ff24c71e69f7 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:29.965801 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8248ae78-fe85-48f6-86c5-b42c7c38b8a5 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:29.965950 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0a9e01b7-87c8-455d-9cc0-ff24c71e69f7 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:29.966643 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0a9e01b7-87c8-455d-9cc0-ff24c71e69f7 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:29.967539 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0a9e01b7-87c8-455d-9cc0-ff24c71e69f7 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:29.967768 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8248ae78-fe85-48f6-86c5-b42c7c38b8a5 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:29.968433 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0a9e01b7-87c8-455d-9cc0-ff24c71e69f7 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:29.969043 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0a9e01b7-87c8-455d-9cc0-ff24c71e69f7 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:29.973983 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8248ae78-fe85-48f6-86c5-b42c7c38b8a5 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:29.974628 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8248ae78-fe85-48f6-86c5-b42c7c38b8a5 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:29.975186 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8248ae78-fe85-48f6-86c5-b42c7c38b8a5 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:30.019517 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-8248ae78-fe85-48f6-86c5-b42c7c38b8a5 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Getting quotas for project cbbeff54a4514dacae8b9f0eb517d2ef. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:54:30.026631 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-8248ae78-fe85-48f6-86c5-b42c7c38b8a5 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Getting quotas for user e06a78b01bd24d6f9c25dc56c6573ab6 and project cbbeff54a4514dacae8b9f0eb517d2ef. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:54:30.042474 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8248ae78-fe85-48f6-86c5-b42c7c38b8a5 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Going to run 1 instances... {{(pid=122698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:54:30.045319 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8248ae78-fe85-48f6-86c5-b42c7c38b8a5 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] [instance: f92b0d2f-5a4d-4c52-9b91-4195c9e78b41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:54:30.246930 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-0a9e01b7-87c8-455d-9cc0-ff24c71e69f7 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:30.255361 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0a9e01b7-87c8-455d-9cc0-ff24c71e69f7 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937" status: 200 len: 1697 microversion: 2.1 time: 0.309494 Sep 23 04:54:30.255939 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2638/5131] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:29 2022] GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937 => generated 1697 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:54:30.267069 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8a6a5e4b-16c2-4d1c-aa8d-f43e91e534ad tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:30.271983 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-8a6a5e4b-16c2-4d1c-aa8d-f43e91e534ad tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: 6174fd18-3f10-4034-85ee-32b05fde010f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:30.302922 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8a6a5e4b-16c2-4d1c-aa8d-f43e91e534ad tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:30.303581 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8a6a5e4b-16c2-4d1c-aa8d-f43e91e534ad tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:30.304047 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8a6a5e4b-16c2-4d1c-aa8d-f43e91e534ad tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:30.304819 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8a6a5e4b-16c2-4d1c-aa8d-f43e91e534ad tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:30.305287 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8a6a5e4b-16c2-4d1c-aa8d-f43e91e534ad tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:30.305722 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8a6a5e4b-16c2-4d1c-aa8d-f43e91e534ad tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:30.331365 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8248ae78-fe85-48f6-86c5-b42c7c38b8a5 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 1.994220 Sep 23 04:54:30.337748 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2494/5132] 10.222.0.33 () {62 vars in 1188 bytes} [Fri Sep 23 04:54:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 2002 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 23 04:54:30.356756 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-68b7db3c-0189-49a4-b5ec-bf5596aef094 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:30.372213 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-68b7db3c-0189-49a4-b5ec-bf5596aef094 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] [instance: f92b0d2f-5a4d-4c52-9b91-4195c9e78b41] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:30.389555 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-8a6a5e4b-16c2-4d1c-aa8d-f43e91e534ad tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: 6174fd18-3f10-4034-85ee-32b05fde010f] Going to try to terminate instance {{(pid=122699) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:54:30.801565 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-68b7db3c-0189-49a4-b5ec-bf5596aef094 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06a78b01bd24d6f9c25dc56c6573ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbeff54a4514dacae8b9f0eb517d2ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:30.841226 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-68b7db3c-0189-49a4-b5ec-bf5596aef094 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06a78b01bd24d6f9c25dc56c6573ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbeff54a4514dacae8b9f0eb517d2ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:30.842996 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-68b7db3c-0189-49a4-b5ec-bf5596aef094 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06a78b01bd24d6f9c25dc56c6573ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbeff54a4514dacae8b9f0eb517d2ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:30.844215 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-68b7db3c-0189-49a4-b5ec-bf5596aef094 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] 10.222.0.33 "GET /compute/v2.1/servers/f92b0d2f-5a4d-4c52-9b91-4195c9e78b41" status: 200 len: 1261 microversion: 2.26 time: 0.496392 Sep 23 04:54:30.844803 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2495/5133] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:54:30 2022] GET /compute/v2.1/servers/f92b0d2f-5a4d-4c52-9b91-4195c9e78b41 => generated 1261 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:54:30.973060 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f8a4fe16-1b31-4e00-b38c-e55416435a8a tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:30.974614 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f8a4fe16-1b31-4e00-b38c-e55416435a8a tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 3354b397-f391-47f2-8ded-f9227bfecb6f] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:30.987820 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f8a4fe16-1b31-4e00-b38c-e55416435a8a tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:30.989223 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f8a4fe16-1b31-4e00-b38c-e55416435a8a tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:30.989856 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f8a4fe16-1b31-4e00-b38c-e55416435a8a tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:30.991315 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f8a4fe16-1b31-4e00-b38c-e55416435a8a tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:30.992544 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f8a4fe16-1b31-4e00-b38c-e55416435a8a tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:30.993175 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f8a4fe16-1b31-4e00-b38c-e55416435a8a tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:31.004522 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-8a6a5e4b-16c2-4d1c-aa8d-f43e91e534ad tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f" status: 204 len: 0 microversion: 2.1 time: 0.743912 Sep 23 04:54:31.009145 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2639/5134] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:54:30 2022] DELETE /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f => generated 0 bytes in 748 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:54:31.211493 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7b03b10b-008e-40f9-b51a-00ef78e339ba tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-141965040", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "networks": [{"uuid": "d9cbccd5-35fe-4c2e-aa6e-6e99efe2ad76"}]}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:54:31.367933 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.neutron [None req-7b03b10b-008e-40f9-b51a-00ef78e339ba tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] validate_networks() for [('d9cbccd5-35fe-4c2e-aa6e-6e99efe2ad76', None, None, None, None, None)] {{(pid=122699) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:54:31.638963 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f8a4fe16-1b31-4e00-b38c-e55416435a8a tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:31.652895 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f8a4fe16-1b31-4e00-b38c-e55416435a8a tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/3354b397-f391-47f2-8ded-f9227bfecb6f" status: 200 len: 1507 microversion: 2.1 time: 0.687209 Sep 23 04:54:31.685644 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2496/5135] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:30 2022] GET /compute/v2.1/servers/3354b397-f391-47f2-8ded-f9227bfecb6f => generated 1507 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:54:31.743018 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-bcb8d306-94f5-4630-91c6-8ae4cdc2bf41 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:31.743908 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-bcb8d306-94f5-4630-91c6-8ae4cdc2bf41 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 4381aca2-ea30-4473-9cd3-18c9b64f1937] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:31.754018 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bcb8d306-94f5-4630-91c6-8ae4cdc2bf41 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:31.758435 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bcb8d306-94f5-4630-91c6-8ae4cdc2bf41 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:31.758435 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bcb8d306-94f5-4630-91c6-8ae4cdc2bf41 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:31.758435 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bcb8d306-94f5-4630-91c6-8ae4cdc2bf41 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:31.758435 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bcb8d306-94f5-4630-91c6-8ae4cdc2bf41 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:31.758435 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bcb8d306-94f5-4630-91c6-8ae4cdc2bf41 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:32.466105 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-bcb8d306-94f5-4630-91c6-8ae4cdc2bf41 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:32.484941 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-bcb8d306-94f5-4630-91c6-8ae4cdc2bf41 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937" status: 200 len: 1697 microversion: 2.1 time: 0.797553 Sep 23 04:54:32.501872 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2497/5136] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:31 2022] GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937 => generated 1697 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:54:32.507151 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8f78d903-958c-40ea-b4f3-07cd3541b0e6 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:32.512554 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8f78d903-958c-40ea-b4f3-07cd3541b0e6 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] [instance: f92b0d2f-5a4d-4c52-9b91-4195c9e78b41] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:32.681455 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8f78d903-958c-40ea-b4f3-07cd3541b0e6 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06a78b01bd24d6f9c25dc56c6573ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbeff54a4514dacae8b9f0eb517d2ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:32.705124 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8f78d903-958c-40ea-b4f3-07cd3541b0e6 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06a78b01bd24d6f9c25dc56c6573ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbeff54a4514dacae8b9f0eb517d2ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:32.707432 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8f78d903-958c-40ea-b4f3-07cd3541b0e6 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06a78b01bd24d6f9c25dc56c6573ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbeff54a4514dacae8b9f0eb517d2ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:32.709027 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8f78d903-958c-40ea-b4f3-07cd3541b0e6 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] 10.222.0.33 "GET /compute/v2.1/servers/f92b0d2f-5a4d-4c52-9b91-4195c9e78b41" status: 200 len: 1261 microversion: 2.26 time: 0.205694 Sep 23 04:54:32.709847 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2498/5137] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:54:32 2022] GET /compute/v2.1/servers/f92b0d2f-5a4d-4c52-9b91-4195c9e78b41 => generated 1261 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:54:32.721052 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-234cdc64-874b-4a7c-8a4c-ce5b58653cd1 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:32.722441 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-234cdc64-874b-4a7c-8a4c-ce5b58653cd1 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 3354b397-f391-47f2-8ded-f9227bfecb6f] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:32.731693 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-234cdc64-874b-4a7c-8a4c-ce5b58653cd1 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:32.735349 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-234cdc64-874b-4a7c-8a4c-ce5b58653cd1 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:32.735995 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-234cdc64-874b-4a7c-8a4c-ce5b58653cd1 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:32.736931 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-234cdc64-874b-4a7c-8a4c-ce5b58653cd1 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:32.737663 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-234cdc64-874b-4a7c-8a4c-ce5b58653cd1 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:32.738319 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-234cdc64-874b-4a7c-8a4c-ce5b58653cd1 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:33.049735 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-7b03b10b-008e-40f9-b51a-00ef78e339ba tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Flavor limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:54:33.054509 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-7b03b10b-008e-40f9-b51a-00ef78e339ba tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Image limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:54:33.054509 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-7b03b10b-008e-40f9-b51a-00ef78e339ba tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Flavor pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:54:33.054509 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-7b03b10b-008e-40f9-b51a-00ef78e339ba tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Image pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:54:33.054509 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-7b03b10b-008e-40f9-b51a-00ef78e339ba tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:54:33.057411 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:54:33.072416 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7b03b10b-008e-40f9-b51a-00ef78e339ba tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:33.072938 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7b03b10b-008e-40f9-b51a-00ef78e339ba tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:33.073389 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7b03b10b-008e-40f9-b51a-00ef78e339ba tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:33.074171 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7b03b10b-008e-40f9-b51a-00ef78e339ba tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:33.074645 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7b03b10b-008e-40f9-b51a-00ef78e339ba tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:33.075111 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7b03b10b-008e-40f9-b51a-00ef78e339ba tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:33.145809 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-7b03b10b-008e-40f9-b51a-00ef78e339ba tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Getting quotas for project a94d0c555b3b4c79b1176db993b58607. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:54:33.152851 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-7b03b10b-008e-40f9-b51a-00ef78e339ba tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Getting quotas for user c3397cb6388640e3af28e06f80019363 and project a94d0c555b3b4c79b1176db993b58607. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:54:33.167848 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-7b03b10b-008e-40f9-b51a-00ef78e339ba tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Going to run 1 instances... {{(pid=122699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:54:33.172880 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-7b03b10b-008e-40f9-b51a-00ef78e339ba tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: 10546b59-4576-4dd2-a915-53e194075a26] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:54:33.230721 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-234cdc64-874b-4a7c-8a4c-ce5b58653cd1 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:33.246307 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-234cdc64-874b-4a7c-8a4c-ce5b58653cd1 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/3354b397-f391-47f2-8ded-f9227bfecb6f" status: 200 len: 1507 microversion: 2.1 time: 0.534140 Sep 23 04:54:33.249433 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2499/5138] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:32 2022] GET /compute/v2.1/servers/3354b397-f391-47f2-8ded-f9227bfecb6f => generated 1507 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:54:33.474829 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-7b03b10b-008e-40f9-b51a-00ef78e339ba tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.269763 Sep 23 04:54:33.476097 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2640/5139] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:54:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 2272 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:54:33.488474 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9c6de3a7-9a9e-48bc-ae33-35d539378331 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:33.489726 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-9c6de3a7-9a9e-48bc-ae33-35d539378331 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: 10546b59-4576-4dd2-a915-53e194075a26] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:33.513710 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-af4097b2-b101-4245-90c4-01c9af632373 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:33.514637 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-af4097b2-b101-4245-90c4-01c9af632373 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 4381aca2-ea30-4473-9cd3-18c9b64f1937] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:33.551839 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-af4097b2-b101-4245-90c4-01c9af632373 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:33.551839 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-af4097b2-b101-4245-90c4-01c9af632373 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:33.551839 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-af4097b2-b101-4245-90c4-01c9af632373 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:33.555901 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-af4097b2-b101-4245-90c4-01c9af632373 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:33.556415 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-af4097b2-b101-4245-90c4-01c9af632373 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:33.556917 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-af4097b2-b101-4245-90c4-01c9af632373 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:33.815285 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-9c6de3a7-9a9e-48bc-ae33-35d539378331 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:33.824195 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9c6de3a7-9a9e-48bc-ae33-35d539378331 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/10546b59-4576-4dd2-a915-53e194075a26" status: 200 len: 1217 microversion: 2.1 time: 0.340511 Sep 23 04:54:33.826438 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2500/5140] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:33 2022] GET /compute/v2.1/servers/10546b59-4576-4dd2-a915-53e194075a26 => generated 1217 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:54:33.841494 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b7dfe6c1-09d0-4a4b-a2a5-1225da02dbee tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:33.842540 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b7dfe6c1-09d0-4a4b-a2a5-1225da02dbee tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] [instance: f92b0d2f-5a4d-4c52-9b91-4195c9e78b41] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:33.864354 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b7dfe6c1-09d0-4a4b-a2a5-1225da02dbee tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:33.866650 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b7dfe6c1-09d0-4a4b-a2a5-1225da02dbee tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:33.869322 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b7dfe6c1-09d0-4a4b-a2a5-1225da02dbee tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:33.872031 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b7dfe6c1-09d0-4a4b-a2a5-1225da02dbee tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:33.873380 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b7dfe6c1-09d0-4a4b-a2a5-1225da02dbee tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:33.875805 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b7dfe6c1-09d0-4a4b-a2a5-1225da02dbee tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:33.893755 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=100 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:54:34.097653 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-af4097b2-b101-4245-90c4-01c9af632373 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:34.110976 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-af4097b2-b101-4245-90c4-01c9af632373 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937" status: 200 len: 1697 microversion: 2.1 time: 0.603848 Sep 23 04:54:34.113953 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2641/5141] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:33 2022] GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937 => generated 1697 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:54:34.119894 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b7dfe6c1-09d0-4a4b-a2a5-1225da02dbee tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06a78b01bd24d6f9c25dc56c6573ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbeff54a4514dacae8b9f0eb517d2ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:34.135552 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b7dfe6c1-09d0-4a4b-a2a5-1225da02dbee tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06a78b01bd24d6f9c25dc56c6573ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbeff54a4514dacae8b9f0eb517d2ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:34.144053 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b7dfe6c1-09d0-4a4b-a2a5-1225da02dbee tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06a78b01bd24d6f9c25dc56c6573ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbeff54a4514dacae8b9f0eb517d2ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:34.146995 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b7dfe6c1-09d0-4a4b-a2a5-1225da02dbee tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] 10.222.0.33 "GET /compute/v2.1/servers/f92b0d2f-5a4d-4c52-9b91-4195c9e78b41" status: 200 len: 1313 microversion: 2.26 time: 0.317459 Sep 23 04:54:34.153495 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2501/5142] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:54:33 2022] GET /compute/v2.1/servers/f92b0d2f-5a4d-4c52-9b91-4195c9e78b41 => generated 1313 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:54:34.166306 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-f25e8552-d1ef-4789-9cc5-5f3c97165323 req-0d7deb4f-45b8-48ec-875a-06d9dcb56912 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6174fd18-3f10-4034-85ee-32b05fde010f", "name": "network-vif-deleted", "tag": "d59a64b4-b8c2-44d3-90e0-14542ae01845"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:54:34.217930 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-f25e8552-d1ef-4789-9cc5-5f3c97165323 req-0d7deb4f-45b8-48ec-875a-06d9dcb56912 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:34.217930 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-f25e8552-d1ef-4789-9cc5-5f3c97165323 req-0d7deb4f-45b8-48ec-875a-06d9dcb56912 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:34.217930 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-f25e8552-d1ef-4789-9cc5-5f3c97165323 req-0d7deb4f-45b8-48ec-875a-06d9dcb56912 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:34.275043 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c957f876-51f0-436b-967c-46ac12721c54 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:34.275678 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c957f876-51f0-436b-967c-46ac12721c54 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 3354b397-f391-47f2-8ded-f9227bfecb6f] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:34.292228 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c957f876-51f0-436b-967c-46ac12721c54 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:34.292757 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c957f876-51f0-436b-967c-46ac12721c54 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:34.293213 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c957f876-51f0-436b-967c-46ac12721c54 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:34.293974 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c957f876-51f0-436b-967c-46ac12721c54 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:34.294445 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c957f876-51f0-436b-967c-46ac12721c54 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:34.313974 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-f25e8552-d1ef-4789-9cc5-5f3c97165323 req-0d7deb4f-45b8-48ec-875a-06d9dcb56912 service nova] Creating event network-vif-deleted:d59a64b4-b8c2-44d3-90e0-14542ae01845 for instance 6174fd18-3f10-4034-85ee-32b05fde010f on n-h2-846463-3 Sep 23 04:54:34.314178 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c957f876-51f0-436b-967c-46ac12721c54 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:34.348038 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-f25e8552-d1ef-4789-9cc5-5f3c97165323 req-0d7deb4f-45b8-48ec-875a-06d9dcb56912 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.230703 Sep 23 04:54:34.348672 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2642/5143] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:54:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:54:34.796237 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c957f876-51f0-436b-967c-46ac12721c54 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:34.811558 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c957f876-51f0-436b-967c-46ac12721c54 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/3354b397-f391-47f2-8ded-f9227bfecb6f" status: 200 len: 1507 microversion: 2.1 time: 0.539975 Sep 23 04:54:34.813163 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2502/5144] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:34 2022] GET /compute/v2.1/servers/3354b397-f391-47f2-8ded-f9227bfecb6f => generated 1507 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:54:34.849945 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1fb2df6e-a3cb-429a-972d-19644fb44111 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:34.854739 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1fb2df6e-a3cb-429a-972d-19644fb44111 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: 10546b59-4576-4dd2-a915-53e194075a26] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:35.136388 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-35d8b0ef-73d0-42d3-af68-d8db3461b91e tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:35.137303 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-35d8b0ef-73d0-42d3-af68-d8db3461b91e tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 4381aca2-ea30-4473-9cd3-18c9b64f1937] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:35.144262 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1fb2df6e-a3cb-429a-972d-19644fb44111 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:35.159491 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-35d8b0ef-73d0-42d3-af68-d8db3461b91e tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:35.160008 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-35d8b0ef-73d0-42d3-af68-d8db3461b91e tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:35.160461 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-35d8b0ef-73d0-42d3-af68-d8db3461b91e tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:35.166150 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1fb2df6e-a3cb-429a-972d-19644fb44111 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/10546b59-4576-4dd2-a915-53e194075a26" status: 200 len: 1217 microversion: 2.1 time: 0.312974 Sep 23 04:54:35.166314 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-35d8b0ef-73d0-42d3-af68-d8db3461b91e tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:35.166314 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-35d8b0ef-73d0-42d3-af68-d8db3461b91e tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:35.166314 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-35d8b0ef-73d0-42d3-af68-d8db3461b91e tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:35.166550 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2643/5145] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:34 2022] GET /compute/v2.1/servers/10546b59-4576-4dd2-a915-53e194075a26 => generated 1217 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:54:35.183834 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c71662e9-43bf-4910-adf3-781c4b1258b6 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:35.184457 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c71662e9-43bf-4910-adf3-781c4b1258b6 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] [instance: f92b0d2f-5a4d-4c52-9b91-4195c9e78b41] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:35.212828 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c71662e9-43bf-4910-adf3-781c4b1258b6 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:35.215005 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c71662e9-43bf-4910-adf3-781c4b1258b6 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:35.218086 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c71662e9-43bf-4910-adf3-781c4b1258b6 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:35.223971 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c71662e9-43bf-4910-adf3-781c4b1258b6 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:35.227100 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c71662e9-43bf-4910-adf3-781c4b1258b6 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:35.234112 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c71662e9-43bf-4910-adf3-781c4b1258b6 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:35.855870 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c71662e9-43bf-4910-adf3-781c4b1258b6 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06a78b01bd24d6f9c25dc56c6573ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbeff54a4514dacae8b9f0eb517d2ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:35.871064 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c71662e9-43bf-4910-adf3-781c4b1258b6 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06a78b01bd24d6f9c25dc56c6573ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbeff54a4514dacae8b9f0eb517d2ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:35.873047 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c71662e9-43bf-4910-adf3-781c4b1258b6 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06a78b01bd24d6f9c25dc56c6573ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbeff54a4514dacae8b9f0eb517d2ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:35.874275 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c71662e9-43bf-4910-adf3-781c4b1258b6 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] 10.222.0.33 "GET /compute/v2.1/servers/f92b0d2f-5a4d-4c52-9b91-4195c9e78b41" status: 200 len: 1319 microversion: 2.26 time: 0.695696 Sep 23 04:54:35.880998 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2644/5146] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:54:35 2022] GET /compute/v2.1/servers/f92b0d2f-5a4d-4c52-9b91-4195c9e78b41 => generated 1319 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:54:35.916906 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2e89064d-e66c-4b3d-94c6-0fb8d522672f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:35.917636 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-2e89064d-e66c-4b3d-94c6-0fb8d522672f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 3354b397-f391-47f2-8ded-f9227bfecb6f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:35.931191 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2e89064d-e66c-4b3d-94c6-0fb8d522672f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:35.935436 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2e89064d-e66c-4b3d-94c6-0fb8d522672f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:35.936214 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2e89064d-e66c-4b3d-94c6-0fb8d522672f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:35.937128 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2e89064d-e66c-4b3d-94c6-0fb8d522672f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:35.939822 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2e89064d-e66c-4b3d-94c6-0fb8d522672f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:35.940436 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2e89064d-e66c-4b3d-94c6-0fb8d522672f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:35.955008 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:54:36.264274 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-35d8b0ef-73d0-42d3-af68-d8db3461b91e tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:36.286312 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-35d8b0ef-73d0-42d3-af68-d8db3461b91e tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937" status: 200 len: 1697 microversion: 2.1 time: 1.149494 Sep 23 04:54:36.290183 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2503/5147] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:35 2022] GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937 => generated 1697 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:54:36.316153 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2db3b17d-df03-4afd-ba64-167b0afb274f tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:36.319913 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-2db3b17d-df03-4afd-ba64-167b0afb274f tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: 10546b59-4576-4dd2-a915-53e194075a26] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:36.344665 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2db3b17d-df03-4afd-ba64-167b0afb274f tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:36.346382 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2db3b17d-df03-4afd-ba64-167b0afb274f tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:36.348556 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2db3b17d-df03-4afd-ba64-167b0afb274f tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:36.369647 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2db3b17d-df03-4afd-ba64-167b0afb274f tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:36.386965 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2db3b17d-df03-4afd-ba64-167b0afb274f tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:36.393943 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2db3b17d-df03-4afd-ba64-167b0afb274f tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:36.435582 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2e89064d-e66c-4b3d-94c6-0fb8d522672f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:36.446014 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2e89064d-e66c-4b3d-94c6-0fb8d522672f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/3354b397-f391-47f2-8ded-f9227bfecb6f" status: 200 len: 1507 microversion: 2.1 time: 0.544541 Sep 23 04:54:36.446654 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2645/5148] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:35 2022] GET /compute/v2.1/servers/3354b397-f391-47f2-8ded-f9227bfecb6f => generated 1507 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:54:36.914358 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-cefa2266-5c48-4b42-a46e-661a4ca08546 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:36.915001 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-cefa2266-5c48-4b42-a46e-661a4ca08546 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] [instance: f92b0d2f-5a4d-4c52-9b91-4195c9e78b41] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:36.927006 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cefa2266-5c48-4b42-a46e-661a4ca08546 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:36.928161 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cefa2266-5c48-4b42-a46e-661a4ca08546 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:36.928993 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cefa2266-5c48-4b42-a46e-661a4ca08546 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:36.930918 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cefa2266-5c48-4b42-a46e-661a4ca08546 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:36.931357 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cefa2266-5c48-4b42-a46e-661a4ca08546 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:36.931784 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cefa2266-5c48-4b42-a46e-661a4ca08546 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:36.935420 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-2db3b17d-df03-4afd-ba64-167b0afb274f tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:36.949499 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2db3b17d-df03-4afd-ba64-167b0afb274f tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/10546b59-4576-4dd2-a915-53e194075a26" status: 200 len: 1269 microversion: 2.1 time: 0.657867 Sep 23 04:54:36.954639 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2504/5149] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:36 2022] GET /compute/v2.1/servers/10546b59-4576-4dd2-a915-53e194075a26 => generated 1269 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:54:37.223314 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-cefa2266-5c48-4b42-a46e-661a4ca08546 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06a78b01bd24d6f9c25dc56c6573ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbeff54a4514dacae8b9f0eb517d2ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:37.247494 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-cefa2266-5c48-4b42-a46e-661a4ca08546 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06a78b01bd24d6f9c25dc56c6573ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbeff54a4514dacae8b9f0eb517d2ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:37.248978 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-cefa2266-5c48-4b42-a46e-661a4ca08546 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06a78b01bd24d6f9c25dc56c6573ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbeff54a4514dacae8b9f0eb517d2ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:37.250195 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-cefa2266-5c48-4b42-a46e-661a4ca08546 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] 10.222.0.33 "GET /compute/v2.1/servers/f92b0d2f-5a4d-4c52-9b91-4195c9e78b41" status: 200 len: 1361 microversion: 2.26 time: 0.340176 Sep 23 04:54:37.265074 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2646/5150] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:54:36 2022] GET /compute/v2.1/servers/f92b0d2f-5a4d-4c52-9b91-4195c9e78b41 => generated 1361 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:54:37.326669 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8391a98a-b943-46fd-a94b-2a89582f37b6 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:37.330115 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8391a98a-b943-46fd-a94b-2a89582f37b6 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 4381aca2-ea30-4473-9cd3-18c9b64f1937] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:37.341826 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8391a98a-b943-46fd-a94b-2a89582f37b6 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:37.342750 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8391a98a-b943-46fd-a94b-2a89582f37b6 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:37.343442 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8391a98a-b943-46fd-a94b-2a89582f37b6 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:37.344652 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8391a98a-b943-46fd-a94b-2a89582f37b6 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:37.345402 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8391a98a-b943-46fd-a94b-2a89582f37b6 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:37.346402 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8391a98a-b943-46fd-a94b-2a89582f37b6 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:37.474583 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1d48e1b5-d508-4741-a785-7372f9fe9cd9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:37.475111 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1d48e1b5-d508-4741-a785-7372f9fe9cd9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 3354b397-f391-47f2-8ded-f9227bfecb6f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:37.487666 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1d48e1b5-d508-4741-a785-7372f9fe9cd9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:37.488192 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1d48e1b5-d508-4741-a785-7372f9fe9cd9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:37.490262 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1d48e1b5-d508-4741-a785-7372f9fe9cd9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:37.490262 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1d48e1b5-d508-4741-a785-7372f9fe9cd9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:37.490262 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1d48e1b5-d508-4741-a785-7372f9fe9cd9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:37.494776 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1d48e1b5-d508-4741-a785-7372f9fe9cd9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:38.264515 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1d48e1b5-d508-4741-a785-7372f9fe9cd9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:38.283473 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1d48e1b5-d508-4741-a785-7372f9fe9cd9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/3354b397-f391-47f2-8ded-f9227bfecb6f" status: 200 len: 1507 microversion: 2.1 time: 0.813919 Sep 23 04:54:38.288673 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8391a98a-b943-46fd-a94b-2a89582f37b6 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:38.289983 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2647/5151] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:37 2022] GET /compute/v2.1/servers/3354b397-f391-47f2-8ded-f9227bfecb6f => generated 1507 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:54:38.297770 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0fe24d08-ecc6-4292-b139-e5db2cecb407 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:38.299615 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-0fe24d08-ecc6-4292-b139-e5db2cecb407 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: 10546b59-4576-4dd2-a915-53e194075a26] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:38.301117 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8391a98a-b943-46fd-a94b-2a89582f37b6 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937" status: 200 len: 1697 microversion: 2.1 time: 0.979833 Sep 23 04:54:38.315098 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2505/5152] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:37 2022] GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937 => generated 1697 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:54:38.318157 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0fe24d08-ecc6-4292-b139-e5db2cecb407 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:38.320641 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0fe24d08-ecc6-4292-b139-e5db2cecb407 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:38.322989 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0fe24d08-ecc6-4292-b139-e5db2cecb407 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:38.324605 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0fe24d08-ecc6-4292-b139-e5db2cecb407 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:38.326764 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0fe24d08-ecc6-4292-b139-e5db2cecb407 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:38.327529 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0fe24d08-ecc6-4292-b139-e5db2cecb407 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:38.332653 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-45f221d5-9b9d-475f-8972-e81dc9ea652d tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:38.333951 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-45f221d5-9b9d-475f-8972-e81dc9ea652d tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] [instance: f92b0d2f-5a4d-4c52-9b91-4195c9e78b41] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:38.347269 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-45f221d5-9b9d-475f-8972-e81dc9ea652d tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:38.348152 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-45f221d5-9b9d-475f-8972-e81dc9ea652d tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:38.348827 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-45f221d5-9b9d-475f-8972-e81dc9ea652d tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:38.349879 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-45f221d5-9b9d-475f-8972-e81dc9ea652d tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:38.350604 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-45f221d5-9b9d-475f-8972-e81dc9ea652d tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:38.351394 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-45f221d5-9b9d-475f-8972-e81dc9ea652d tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:38.588458 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-0fe24d08-ecc6-4292-b139-e5db2cecb407 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:38.630876 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0fe24d08-ecc6-4292-b139-e5db2cecb407 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/10546b59-4576-4dd2-a915-53e194075a26" status: 200 len: 1275 microversion: 2.1 time: 0.339323 Sep 23 04:54:38.636356 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2648/5153] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:38 2022] GET /compute/v2.1/servers/10546b59-4576-4dd2-a915-53e194075a26 => generated 1275 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:54:38.724155 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-45f221d5-9b9d-475f-8972-e81dc9ea652d tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06a78b01bd24d6f9c25dc56c6573ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbeff54a4514dacae8b9f0eb517d2ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:38.759151 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-45f221d5-9b9d-475f-8972-e81dc9ea652d tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06a78b01bd24d6f9c25dc56c6573ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbeff54a4514dacae8b9f0eb517d2ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:38.769264 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-45f221d5-9b9d-475f-8972-e81dc9ea652d tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06a78b01bd24d6f9c25dc56c6573ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbeff54a4514dacae8b9f0eb517d2ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:38.778116 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-45f221d5-9b9d-475f-8972-e81dc9ea652d tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] 10.222.0.33 "GET /compute/v2.1/servers/f92b0d2f-5a4d-4c52-9b91-4195c9e78b41" status: 200 len: 1361 microversion: 2.26 time: 0.459381 Sep 23 04:54:38.779324 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2506/5154] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:54:38 2022] GET /compute/v2.1/servers/f92b0d2f-5a4d-4c52-9b91-4195c9e78b41 => generated 1361 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:54:39.318354 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1b5bac95-9400-48bc-90f5-528a11fc5741 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:39.320316 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1b5bac95-9400-48bc-90f5-528a11fc5741 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 3354b397-f391-47f2-8ded-f9227bfecb6f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:39.330298 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f92ecd95-20f6-49b9-aa4c-3f06853f5a03 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:39.330912 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f92ecd95-20f6-49b9-aa4c-3f06853f5a03 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 4381aca2-ea30-4473-9cd3-18c9b64f1937] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:39.339273 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f92ecd95-20f6-49b9-aa4c-3f06853f5a03 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:39.340381 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f92ecd95-20f6-49b9-aa4c-3f06853f5a03 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:39.341018 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f92ecd95-20f6-49b9-aa4c-3f06853f5a03 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:39.341951 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f92ecd95-20f6-49b9-aa4c-3f06853f5a03 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:39.342863 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f92ecd95-20f6-49b9-aa4c-3f06853f5a03 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:39.343250 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1b5bac95-9400-48bc-90f5-528a11fc5741 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:39.343497 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f92ecd95-20f6-49b9-aa4c-3f06853f5a03 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:39.352751 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1b5bac95-9400-48bc-90f5-528a11fc5741 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:39.355669 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1b5bac95-9400-48bc-90f5-528a11fc5741 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:39.362680 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1b5bac95-9400-48bc-90f5-528a11fc5741 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:39.368426 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1b5bac95-9400-48bc-90f5-528a11fc5741 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:39.382099 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1b5bac95-9400-48bc-90f5-528a11fc5741 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:39.864140 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1b5bac95-9400-48bc-90f5-528a11fc5741 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:39.874036 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1b5bac95-9400-48bc-90f5-528a11fc5741 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/3354b397-f391-47f2-8ded-f9227bfecb6f" status: 200 len: 1507 microversion: 2.1 time: 0.561498 Sep 23 04:54:39.874788 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2649/5155] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:39 2022] GET /compute/v2.1/servers/3354b397-f391-47f2-8ded-f9227bfecb6f => generated 1507 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:54:39.880853 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4ae212fd-9f89-43ff-93be-e227a52659b2 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:39.881771 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4ae212fd-9f89-43ff-93be-e227a52659b2 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: 10546b59-4576-4dd2-a915-53e194075a26] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:39.891192 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4ae212fd-9f89-43ff-93be-e227a52659b2 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:39.891779 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4ae212fd-9f89-43ff-93be-e227a52659b2 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:39.892246 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4ae212fd-9f89-43ff-93be-e227a52659b2 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:39.893092 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4ae212fd-9f89-43ff-93be-e227a52659b2 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:39.893654 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4ae212fd-9f89-43ff-93be-e227a52659b2 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:39.894215 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4ae212fd-9f89-43ff-93be-e227a52659b2 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:39.909917 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f92ecd95-20f6-49b9-aa4c-3f06853f5a03 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:39.919554 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f92ecd95-20f6-49b9-aa4c-3f06853f5a03 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937" status: 200 len: 1697 microversion: 2.1 time: 0.592961 Sep 23 04:54:39.920227 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2507/5156] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:39 2022] GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937 => generated 1697 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:54:39.925879 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8ea875c1-9f2d-4571-b8f9-5449aaabb245 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:39.926510 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8ea875c1-9f2d-4571-b8f9-5449aaabb245 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] [instance: f92b0d2f-5a4d-4c52-9b91-4195c9e78b41] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:39.933256 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8ea875c1-9f2d-4571-b8f9-5449aaabb245 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:39.933763 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8ea875c1-9f2d-4571-b8f9-5449aaabb245 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:39.934260 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8ea875c1-9f2d-4571-b8f9-5449aaabb245 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:39.944135 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8ea875c1-9f2d-4571-b8f9-5449aaabb245 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:39.944135 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8ea875c1-9f2d-4571-b8f9-5449aaabb245 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:39.944135 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8ea875c1-9f2d-4571-b8f9-5449aaabb245 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:39.994323 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:54:40.034076 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-4ae212fd-9f89-43ff-93be-e227a52659b2 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:40.050437 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4ae212fd-9f89-43ff-93be-e227a52659b2 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/10546b59-4576-4dd2-a915-53e194075a26" status: 200 len: 1275 microversion: 2.1 time: 0.174220 Sep 23 04:54:40.051388 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2650/5157] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:39 2022] GET /compute/v2.1/servers/10546b59-4576-4dd2-a915-53e194075a26 => generated 1275 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:54:40.154163 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-cf74c579-7757-4700-871e-7ebf8d5224ea req-930eb258-8702-405b-b8d0-5e44a3571bf8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f92b0d2f-5a4d-4c52-9b91-4195c9e78b41", "tag": "549e0e14-c594-43e2-a408-b72248a33d12"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:54:40.184339 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-cf74c579-7757-4700-871e-7ebf8d5224ea req-930eb258-8702-405b-b8d0-5e44a3571bf8 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:40.184897 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-cf74c579-7757-4700-871e-7ebf8d5224ea req-930eb258-8702-405b-b8d0-5e44a3571bf8 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:40.185339 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-cf74c579-7757-4700-871e-7ebf8d5224ea req-930eb258-8702-405b-b8d0-5e44a3571bf8 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:40.202484 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-cf74c579-7757-4700-871e-7ebf8d5224ea req-930eb258-8702-405b-b8d0-5e44a3571bf8 service nova] Creating event network-changed:549e0e14-c594-43e2-a408-b72248a33d12 for instance f92b0d2f-5a4d-4c52-9b91-4195c9e78b41 on n-h1-846463-3 Sep 23 04:54:40.207468 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-cf74c579-7757-4700-871e-7ebf8d5224ea req-930eb258-8702-405b-b8d0-5e44a3571bf8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056982 Sep 23 04:54:40.212728 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2651/5158] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:54:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:54:40.307237 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8ea875c1-9f2d-4571-b8f9-5449aaabb245 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06a78b01bd24d6f9c25dc56c6573ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbeff54a4514dacae8b9f0eb517d2ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:40.324627 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8ea875c1-9f2d-4571-b8f9-5449aaabb245 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06a78b01bd24d6f9c25dc56c6573ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbeff54a4514dacae8b9f0eb517d2ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:40.324627 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8ea875c1-9f2d-4571-b8f9-5449aaabb245 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06a78b01bd24d6f9c25dc56c6573ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbeff54a4514dacae8b9f0eb517d2ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:40.324627 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8ea875c1-9f2d-4571-b8f9-5449aaabb245 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] 10.222.0.33 "GET /compute/v2.1/servers/f92b0d2f-5a4d-4c52-9b91-4195c9e78b41" status: 200 len: 1361 microversion: 2.26 time: 0.402691 Sep 23 04:54:40.325238 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2508/5159] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:54:39 2022] GET /compute/v2.1/servers/f92b0d2f-5a4d-4c52-9b91-4195c9e78b41 => generated 1361 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:54:40.899479 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-16f6e3ae-a393-4e2a-9f5c-01682b5eedc0 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:40.901194 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-16f6e3ae-a393-4e2a-9f5c-01682b5eedc0 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 3354b397-f391-47f2-8ded-f9227bfecb6f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:40.918161 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-16f6e3ae-a393-4e2a-9f5c-01682b5eedc0 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:40.925245 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-16f6e3ae-a393-4e2a-9f5c-01682b5eedc0 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:40.925915 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-16f6e3ae-a393-4e2a-9f5c-01682b5eedc0 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:40.927028 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-16f6e3ae-a393-4e2a-9f5c-01682b5eedc0 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:40.927602 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-16f6e3ae-a393-4e2a-9f5c-01682b5eedc0 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:40.933161 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-16f6e3ae-a393-4e2a-9f5c-01682b5eedc0 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:40.949019 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3e3ffa7a-33db-4037-88c9-664f778851fa tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:40.950334 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3e3ffa7a-33db-4037-88c9-664f778851fa tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 4381aca2-ea30-4473-9cd3-18c9b64f1937] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:40.964235 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3e3ffa7a-33db-4037-88c9-664f778851fa tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:40.967605 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3e3ffa7a-33db-4037-88c9-664f778851fa tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:40.968384 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3e3ffa7a-33db-4037-88c9-664f778851fa tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:40.969349 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3e3ffa7a-33db-4037-88c9-664f778851fa tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:40.970046 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3e3ffa7a-33db-4037-88c9-664f778851fa tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:40.971615 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3e3ffa7a-33db-4037-88c9-664f778851fa tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:41.354526 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-16f6e3ae-a393-4e2a-9f5c-01682b5eedc0 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:41.368390 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-16f6e3ae-a393-4e2a-9f5c-01682b5eedc0 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/3354b397-f391-47f2-8ded-f9227bfecb6f" status: 200 len: 1507 microversion: 2.1 time: 0.474085 Sep 23 04:54:41.369529 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2652/5160] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:40 2022] GET /compute/v2.1/servers/3354b397-f391-47f2-8ded-f9227bfecb6f => generated 1507 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:54:41.375812 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5602db5d-488f-4749-a010-4d84ef5ad24b tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:41.376720 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-5602db5d-488f-4749-a010-4d84ef5ad24b tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: 10546b59-4576-4dd2-a915-53e194075a26] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:41.385033 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5602db5d-488f-4749-a010-4d84ef5ad24b tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:41.385782 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5602db5d-488f-4749-a010-4d84ef5ad24b tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:41.386359 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5602db5d-488f-4749-a010-4d84ef5ad24b tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:41.387210 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5602db5d-488f-4749-a010-4d84ef5ad24b tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:41.387825 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5602db5d-488f-4749-a010-4d84ef5ad24b tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:41.388530 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5602db5d-488f-4749-a010-4d84ef5ad24b tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:41.391233 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-3e3ffa7a-33db-4037-88c9-664f778851fa tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:41.405527 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3e3ffa7a-33db-4037-88c9-664f778851fa tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937" status: 200 len: 1697 microversion: 2.1 time: 0.460253 Sep 23 04:54:41.408538 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2509/5161] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:40 2022] GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937 => generated 1697 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:54:41.445375 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3cbd15d1-df5c-4a3d-9f04-94a19871da53 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:41.446022 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3cbd15d1-df5c-4a3d-9f04-94a19871da53 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] [instance: f92b0d2f-5a4d-4c52-9b91-4195c9e78b41] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:41.452992 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3cbd15d1-df5c-4a3d-9f04-94a19871da53 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:41.453727 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3cbd15d1-df5c-4a3d-9f04-94a19871da53 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:41.454205 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3cbd15d1-df5c-4a3d-9f04-94a19871da53 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:41.455044 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3cbd15d1-df5c-4a3d-9f04-94a19871da53 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:41.455688 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3cbd15d1-df5c-4a3d-9f04-94a19871da53 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:41.456447 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3cbd15d1-df5c-4a3d-9f04-94a19871da53 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:41.623418 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-5602db5d-488f-4749-a010-4d84ef5ad24b tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:41.638652 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5602db5d-488f-4749-a010-4d84ef5ad24b tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/10546b59-4576-4dd2-a915-53e194075a26" status: 200 len: 1317 microversion: 2.1 time: 0.265161 Sep 23 04:54:41.638652 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2653/5162] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:41 2022] GET /compute/v2.1/servers/10546b59-4576-4dd2-a915-53e194075a26 => generated 1317 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:54:41.674610 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-3cbd15d1-df5c-4a3d-9f04-94a19871da53 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06a78b01bd24d6f9c25dc56c6573ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbeff54a4514dacae8b9f0eb517d2ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:41.684738 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-3cbd15d1-df5c-4a3d-9f04-94a19871da53 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06a78b01bd24d6f9c25dc56c6573ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbeff54a4514dacae8b9f0eb517d2ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:41.686344 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-3cbd15d1-df5c-4a3d-9f04-94a19871da53 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06a78b01bd24d6f9c25dc56c6573ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbeff54a4514dacae8b9f0eb517d2ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:41.688283 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3cbd15d1-df5c-4a3d-9f04-94a19871da53 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] 10.222.0.33 "GET /compute/v2.1/servers/f92b0d2f-5a4d-4c52-9b91-4195c9e78b41" status: 200 len: 1361 microversion: 2.26 time: 0.269251 Sep 23 04:54:41.689323 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2510/5163] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:54:41 2022] GET /compute/v2.1/servers/f92b0d2f-5a4d-4c52-9b91-4195c9e78b41 => generated 1361 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:54:41.862295 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c9203fc3-1c0c-472d-853b-d7ff9fb8f3ab tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:41.862915 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c9203fc3-1c0c-472d-853b-d7ff9fb8f3ab tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] [instance: 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:41.869701 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c9203fc3-1c0c-472d-853b-d7ff9fb8f3ab tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:41.870231 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c9203fc3-1c0c-472d-853b-d7ff9fb8f3ab tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:41.870686 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c9203fc3-1c0c-472d-853b-d7ff9fb8f3ab tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:41.871478 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c9203fc3-1c0c-472d-853b-d7ff9fb8f3ab tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:41.871949 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c9203fc3-1c0c-472d-853b-d7ff9fb8f3ab tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:41.872383 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c9203fc3-1c0c-472d-853b-d7ff9fb8f3ab tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:42.140632 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c9203fc3-1c0c-472d-853b-d7ff9fb8f3ab tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:42.157875 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c9203fc3-1c0c-472d-853b-d7ff9fb8f3ab tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:42.157875 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c9203fc3-1c0c-472d-853b-d7ff9fb8f3ab tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:42.158693 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c9203fc3-1c0c-472d-853b-d7ff9fb8f3ab tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] 10.222.0.33 "GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7" status: 200 len: 2946 microversion: 2.32 time: 0.300315 Sep 23 04:54:42.159183 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2654/5164] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:54:41 2022] GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 => generated 2946 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:54:42.188464 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-574c8950-6195-4c23-ba26-69f54f8931ab tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:42.188977 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-574c8950-6195-4c23-ba26-69f54f8931ab tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] [instance: 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:42.198207 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-574c8950-6195-4c23-ba26-69f54f8931ab tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:42.199007 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-574c8950-6195-4c23-ba26-69f54f8931ab tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:42.199999 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-574c8950-6195-4c23-ba26-69f54f8931ab tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:42.201085 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-574c8950-6195-4c23-ba26-69f54f8931ab tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:42.201977 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-574c8950-6195-4c23-ba26-69f54f8931ab tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:42.202815 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-574c8950-6195-4c23-ba26-69f54f8931ab tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:42.403888 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-574c8950-6195-4c23-ba26-69f54f8931ab tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] 10.222.0.33 "GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7/os-interface" status: 200 len: 1828 microversion: 2.32 time: 0.214963 Sep 23 04:54:42.417527 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2511/5165] 10.222.0.33 () {60 vars in 1316 bytes} [Fri Sep 23 04:54:42 2022] GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7/os-interface => generated 1828 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:54:42.421881 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-283c7e66-8437-40fa-9aed-1cde46763d45 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:42.422898 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-283c7e66-8437-40fa-9aed-1cde46763d45 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 3354b397-f391-47f2-8ded-f9227bfecb6f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:42.444451 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-283c7e66-8437-40fa-9aed-1cde46763d45 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:42.444995 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-283c7e66-8437-40fa-9aed-1cde46763d45 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:42.445444 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-283c7e66-8437-40fa-9aed-1cde46763d45 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:42.445851 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-64f5f789-84a3-4453-8368-028e5bd64dec tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:42.446183 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-283c7e66-8437-40fa-9aed-1cde46763d45 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:42.447159 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-64f5f789-84a3-4453-8368-028e5bd64dec tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 4381aca2-ea30-4473-9cd3-18c9b64f1937] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:42.454200 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-283c7e66-8437-40fa-9aed-1cde46763d45 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:42.455207 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-64f5f789-84a3-4453-8368-028e5bd64dec tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:42.455727 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-283c7e66-8437-40fa-9aed-1cde46763d45 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:42.456785 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-64f5f789-84a3-4453-8368-028e5bd64dec tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:42.458081 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-64f5f789-84a3-4453-8368-028e5bd64dec tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:42.459214 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-64f5f789-84a3-4453-8368-028e5bd64dec tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:42.460027 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-64f5f789-84a3-4453-8368-028e5bd64dec tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:42.460766 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-64f5f789-84a3-4453-8368-028e5bd64dec tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:43.120544 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:54:43.129994 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-64f5f789-84a3-4453-8368-028e5bd64dec tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:43.139049 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-283c7e66-8437-40fa-9aed-1cde46763d45 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:43.144931 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-64f5f789-84a3-4453-8368-028e5bd64dec tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937" status: 200 len: 1697 microversion: 2.1 time: 0.705710 Sep 23 04:54:43.161072 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2512/5166] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:42 2022] GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937 => generated 1697 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:54:43.161072 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-02f95443-6ab5-49ad-b316-8186c3a37bd5 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:43.162408 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-02f95443-6ab5-49ad-b316-8186c3a37bd5 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: 10546b59-4576-4dd2-a915-53e194075a26] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:43.181105 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-283c7e66-8437-40fa-9aed-1cde46763d45 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/3354b397-f391-47f2-8ded-f9227bfecb6f" status: 200 len: 1504 microversion: 2.1 time: 0.786170 Sep 23 04:54:43.181964 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2655/5167] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:42 2022] GET /compute/v2.1/servers/3354b397-f391-47f2-8ded-f9227bfecb6f => generated 1504 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:54:43.184414 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-02f95443-6ab5-49ad-b316-8186c3a37bd5 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:43.185069 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-02f95443-6ab5-49ad-b316-8186c3a37bd5 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:43.190130 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-02f95443-6ab5-49ad-b316-8186c3a37bd5 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:43.191033 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-02f95443-6ab5-49ad-b316-8186c3a37bd5 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:43.191770 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-02f95443-6ab5-49ad-b316-8186c3a37bd5 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:43.192750 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-02f95443-6ab5-49ad-b316-8186c3a37bd5 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:43.197338 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3f7921bf-bdf5-4d9f-b70b-30d623cafb17 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:43.198690 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-3f7921bf-bdf5-4d9f-b70b-30d623cafb17 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] [instance: f92b0d2f-5a4d-4c52-9b91-4195c9e78b41] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:43.211233 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3f7921bf-bdf5-4d9f-b70b-30d623cafb17 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:43.212013 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3f7921bf-bdf5-4d9f-b70b-30d623cafb17 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:43.212890 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3f7921bf-bdf5-4d9f-b70b-30d623cafb17 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:43.213805 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3f7921bf-bdf5-4d9f-b70b-30d623cafb17 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:43.219485 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3f7921bf-bdf5-4d9f-b70b-30d623cafb17 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:43.219485 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3f7921bf-bdf5-4d9f-b70b-30d623cafb17 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:43.675416 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-3f7921bf-bdf5-4d9f-b70b-30d623cafb17 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06a78b01bd24d6f9c25dc56c6573ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbeff54a4514dacae8b9f0eb517d2ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:43.684683 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-3f7921bf-bdf5-4d9f-b70b-30d623cafb17 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06a78b01bd24d6f9c25dc56c6573ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbeff54a4514dacae8b9f0eb517d2ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:43.686765 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-3f7921bf-bdf5-4d9f-b70b-30d623cafb17 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06a78b01bd24d6f9c25dc56c6573ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbeff54a4514dacae8b9f0eb517d2ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:43.688182 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3f7921bf-bdf5-4d9f-b70b-30d623cafb17 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] 10.222.0.33 "GET /compute/v2.1/servers/f92b0d2f-5a4d-4c52-9b91-4195c9e78b41" status: 200 len: 1361 microversion: 2.26 time: 0.504479 Sep 23 04:54:43.689319 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2656/5168] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:54:43 2022] GET /compute/v2.1/servers/f92b0d2f-5a4d-4c52-9b91-4195c9e78b41 => generated 1361 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:54:43.695661 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-75e2971b-445c-42ca-a640-db549587380a req-dfea4d68-b85c-4e70-bfaf-febd409d356a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10546b59-4576-4dd2-a915-53e194075a26", "tag": "1c318b20-3c2f-4db9-b120-05eb91bef00c"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:54:43.700378 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-02f95443-6ab5-49ad-b316-8186c3a37bd5 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:43.713736 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-02f95443-6ab5-49ad-b316-8186c3a37bd5 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/10546b59-4576-4dd2-a915-53e194075a26" status: 200 len: 1317 microversion: 2.1 time: 0.564809 Sep 23 04:54:43.728067 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2513/5169] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:43 2022] GET /compute/v2.1/servers/10546b59-4576-4dd2-a915-53e194075a26 => generated 1317 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:54:43.728276 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-75e2971b-445c-42ca-a640-db549587380a req-dfea4d68-b85c-4e70-bfaf-febd409d356a service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:43.728276 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-75e2971b-445c-42ca-a640-db549587380a req-dfea4d68-b85c-4e70-bfaf-febd409d356a service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:43.728276 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-75e2971b-445c-42ca-a640-db549587380a req-dfea4d68-b85c-4e70-bfaf-febd409d356a service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:43.744009 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-75e2971b-445c-42ca-a640-db549587380a req-dfea4d68-b85c-4e70-bfaf-febd409d356a service nova] Creating event network-changed:1c318b20-3c2f-4db9-b120-05eb91bef00c for instance 10546b59-4576-4dd2-a915-53e194075a26 on n-h2-846463-3 Sep 23 04:54:43.746031 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-75e2971b-445c-42ca-a640-db549587380a req-dfea4d68-b85c-4e70-bfaf-febd409d356a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055198 Sep 23 04:54:43.747310 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2657/5170] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:54:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:54:44.176047 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1fcf650f-cb7c-43b0-a290-c97c1ba8a946 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:44.176676 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-1fcf650f-cb7c-43b0-a290-c97c1ba8a946 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 4381aca2-ea30-4473-9cd3-18c9b64f1937] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:44.178643 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=12 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:54:44.191519 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1fcf650f-cb7c-43b0-a290-c97c1ba8a946 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:44.192926 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1fcf650f-cb7c-43b0-a290-c97c1ba8a946 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:44.193444 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1fcf650f-cb7c-43b0-a290-c97c1ba8a946 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:44.194360 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1fcf650f-cb7c-43b0-a290-c97c1ba8a946 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:44.195625 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1fcf650f-cb7c-43b0-a290-c97c1ba8a946 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:44.196464 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1fcf650f-cb7c-43b0-a290-c97c1ba8a946 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:44.212880 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5d6d3c26-5af9-4d65-b646-bc8ae5afd1df tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:44.214437 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-5d6d3c26-5af9-4d65-b646-bc8ae5afd1df tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 3354b397-f391-47f2-8ded-f9227bfecb6f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:44.224562 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5d6d3c26-5af9-4d65-b646-bc8ae5afd1df tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:44.225243 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5d6d3c26-5af9-4d65-b646-bc8ae5afd1df tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:44.225815 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5d6d3c26-5af9-4d65-b646-bc8ae5afd1df tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:44.226764 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5d6d3c26-5af9-4d65-b646-bc8ae5afd1df tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:44.227360 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5d6d3c26-5af9-4d65-b646-bc8ae5afd1df tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:44.227855 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5d6d3c26-5af9-4d65-b646-bc8ae5afd1df tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:44.540902 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-1fcf650f-cb7c-43b0-a290-c97c1ba8a946 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:44.552673 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-5d6d3c26-5af9-4d65-b646-bc8ae5afd1df tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:44.566962 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-1fcf650f-cb7c-43b0-a290-c97c1ba8a946 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937" status: 200 len: 1697 microversion: 2.1 time: 0.393507 Sep 23 04:54:44.567712 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2514/5171] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:44 2022] GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937 => generated 1697 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:54:44.578981 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5d6d3c26-5af9-4d65-b646-bc8ae5afd1df tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/3354b397-f391-47f2-8ded-f9227bfecb6f" status: 200 len: 1504 microversion: 2.1 time: 0.367275 Sep 23 04:54:44.578981 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2658/5172] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:44 2022] GET /compute/v2.1/servers/3354b397-f391-47f2-8ded-f9227bfecb6f => generated 1504 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:54:44.721306 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a198b56d-8d00-4d49-9232-8b9e61d6fc89 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:44.722287 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a198b56d-8d00-4d49-9232-8b9e61d6fc89 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] [instance: f92b0d2f-5a4d-4c52-9b91-4195c9e78b41] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:44.729221 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a198b56d-8d00-4d49-9232-8b9e61d6fc89 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:44.729957 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a198b56d-8d00-4d49-9232-8b9e61d6fc89 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:44.730450 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a198b56d-8d00-4d49-9232-8b9e61d6fc89 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:44.731172 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a198b56d-8d00-4d49-9232-8b9e61d6fc89 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:44.731832 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a198b56d-8d00-4d49-9232-8b9e61d6fc89 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:44.732443 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a198b56d-8d00-4d49-9232-8b9e61d6fc89 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:44.740071 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b9925a59-ca9e-4510-b66e-ad2177b4eeff tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:44.740938 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b9925a59-ca9e-4510-b66e-ad2177b4eeff tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: 10546b59-4576-4dd2-a915-53e194075a26] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:44.747442 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b9925a59-ca9e-4510-b66e-ad2177b4eeff tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:44.748238 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b9925a59-ca9e-4510-b66e-ad2177b4eeff tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:44.748921 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b9925a59-ca9e-4510-b66e-ad2177b4eeff tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:44.750181 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b9925a59-ca9e-4510-b66e-ad2177b4eeff tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:44.751140 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b9925a59-ca9e-4510-b66e-ad2177b4eeff tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:44.751845 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b9925a59-ca9e-4510-b66e-ad2177b4eeff tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:45.020630 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a198b56d-8d00-4d49-9232-8b9e61d6fc89 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06a78b01bd24d6f9c25dc56c6573ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbeff54a4514dacae8b9f0eb517d2ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:45.032949 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a198b56d-8d00-4d49-9232-8b9e61d6fc89 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06a78b01bd24d6f9c25dc56c6573ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbeff54a4514dacae8b9f0eb517d2ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:45.034015 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a198b56d-8d00-4d49-9232-8b9e61d6fc89 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06a78b01bd24d6f9c25dc56c6573ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbeff54a4514dacae8b9f0eb517d2ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:45.034451 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b9925a59-ca9e-4510-b66e-ad2177b4eeff tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:45.035799 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a198b56d-8d00-4d49-9232-8b9e61d6fc89 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] 10.222.0.33 "GET /compute/v2.1/servers/f92b0d2f-5a4d-4c52-9b91-4195c9e78b41" status: 200 len: 1361 microversion: 2.26 time: 0.320407 Sep 23 04:54:45.036923 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2515/5173] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:54:44 2022] GET /compute/v2.1/servers/f92b0d2f-5a4d-4c52-9b91-4195c9e78b41 => generated 1361 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:54:45.059184 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b9925a59-ca9e-4510-b66e-ad2177b4eeff tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/10546b59-4576-4dd2-a915-53e194075a26" status: 200 len: 1317 microversion: 2.1 time: 0.322773 Sep 23 04:54:45.063492 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2659/5174] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:44 2022] GET /compute/v2.1/servers/10546b59-4576-4dd2-a915-53e194075a26 => generated 1317 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:54:45.597622 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-fb3005c1-e3a1-4284-be14-5cef741a8916 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:45.598190 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a919eaa8-9469-461f-9762-5a62d8acbcbf tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:45.598574 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-fb3005c1-e3a1-4284-be14-5cef741a8916 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 4381aca2-ea30-4473-9cd3-18c9b64f1937] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:45.598673 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a919eaa8-9469-461f-9762-5a62d8acbcbf tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 3354b397-f391-47f2-8ded-f9227bfecb6f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:45.601117 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=8 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:54:45.607078 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a919eaa8-9469-461f-9762-5a62d8acbcbf tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:45.607270 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fb3005c1-e3a1-4284-be14-5cef741a8916 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:45.607621 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a919eaa8-9469-461f-9762-5a62d8acbcbf tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:45.607954 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fb3005c1-e3a1-4284-be14-5cef741a8916 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:45.608095 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a919eaa8-9469-461f-9762-5a62d8acbcbf tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:45.608502 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fb3005c1-e3a1-4284-be14-5cef741a8916 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:45.609049 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a919eaa8-9469-461f-9762-5a62d8acbcbf tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:45.609420 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fb3005c1-e3a1-4284-be14-5cef741a8916 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:45.609553 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a919eaa8-9469-461f-9762-5a62d8acbcbf tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:45.609969 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a919eaa8-9469-461f-9762-5a62d8acbcbf tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:45.610166 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fb3005c1-e3a1-4284-be14-5cef741a8916 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:45.610674 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fb3005c1-e3a1-4284-be14-5cef741a8916 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:45.923943 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a919eaa8-9469-461f-9762-5a62d8acbcbf tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:45.936051 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a919eaa8-9469-461f-9762-5a62d8acbcbf tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/3354b397-f391-47f2-8ded-f9227bfecb6f" status: 200 len: 1504 microversion: 2.1 time: 0.341903 Sep 23 04:54:45.951447 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-fb3005c1-e3a1-4284-be14-5cef741a8916 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:45.962236 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2660/5175] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:45 2022] GET /compute/v2.1/servers/3354b397-f391-47f2-8ded-f9227bfecb6f => generated 1504 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:54:45.964585 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-fb3005c1-e3a1-4284-be14-5cef741a8916 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937" status: 200 len: 1697 microversion: 2.1 time: 0.368470 Sep 23 04:54:45.967096 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2516/5176] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:45 2022] GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937 => generated 1697 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:54:46.072979 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f373bf92-7801-45eb-9ee1-271b1aa0bae9 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:46.075980 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f373bf92-7801-45eb-9ee1-271b1aa0bae9 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] [instance: f92b0d2f-5a4d-4c52-9b91-4195c9e78b41] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:46.090270 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-dc912f80-600e-4a3c-baf3-4ae39b1d848c tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:46.091198 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-dc912f80-600e-4a3c-baf3-4ae39b1d848c tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: 10546b59-4576-4dd2-a915-53e194075a26] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:46.123928 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f373bf92-7801-45eb-9ee1-271b1aa0bae9 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:46.126774 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dc912f80-600e-4a3c-baf3-4ae39b1d848c tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:46.130813 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dc912f80-600e-4a3c-baf3-4ae39b1d848c tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:46.130813 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dc912f80-600e-4a3c-baf3-4ae39b1d848c tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:46.130813 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dc912f80-600e-4a3c-baf3-4ae39b1d848c tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:46.131155 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f373bf92-7801-45eb-9ee1-271b1aa0bae9 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:46.131155 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f373bf92-7801-45eb-9ee1-271b1aa0bae9 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:46.131956 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f373bf92-7801-45eb-9ee1-271b1aa0bae9 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:46.132594 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f373bf92-7801-45eb-9ee1-271b1aa0bae9 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:46.134955 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dc912f80-600e-4a3c-baf3-4ae39b1d848c tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:46.135885 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dc912f80-600e-4a3c-baf3-4ae39b1d848c tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:46.136275 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f373bf92-7801-45eb-9ee1-271b1aa0bae9 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:46.823350 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-dc912f80-600e-4a3c-baf3-4ae39b1d848c tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:46.827900 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f373bf92-7801-45eb-9ee1-271b1aa0bae9 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06a78b01bd24d6f9c25dc56c6573ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbeff54a4514dacae8b9f0eb517d2ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:46.832304 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-dc912f80-600e-4a3c-baf3-4ae39b1d848c tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/10546b59-4576-4dd2-a915-53e194075a26" status: 200 len: 1317 microversion: 2.1 time: 0.750889 Sep 23 04:54:46.835771 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2517/5177] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:46 2022] GET /compute/v2.1/servers/10546b59-4576-4dd2-a915-53e194075a26 => generated 1317 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:54:46.844549 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f373bf92-7801-45eb-9ee1-271b1aa0bae9 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06a78b01bd24d6f9c25dc56c6573ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbeff54a4514dacae8b9f0eb517d2ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:46.846153 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f373bf92-7801-45eb-9ee1-271b1aa0bae9 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06a78b01bd24d6f9c25dc56c6573ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbeff54a4514dacae8b9f0eb517d2ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:46.847346 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f373bf92-7801-45eb-9ee1-271b1aa0bae9 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] 10.222.0.33 "GET /compute/v2.1/servers/f92b0d2f-5a4d-4c52-9b91-4195c9e78b41" status: 200 len: 1361 microversion: 2.26 time: 0.782786 Sep 23 04:54:46.850231 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2661/5178] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:54:46 2022] GET /compute/v2.1/servers/f92b0d2f-5a4d-4c52-9b91-4195c9e78b41 => generated 1361 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:54:46.859795 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-c8d3c48c-b770-4881-87b3-19c834cec51f req-0c446f67-61f0-46dd-837a-3e939a6aea10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3354b397-f391-47f2-8ded-f9227bfecb6f", "name": "network-vif-unplugged", "status": "completed", "tag": "2e084b59-e468-45fb-8081-c4bafdb31c08"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:54:46.868305 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=3 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:54:46.894717 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-c8d3c48c-b770-4881-87b3-19c834cec51f req-0c446f67-61f0-46dd-837a-3e939a6aea10 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:46.895232 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-c8d3c48c-b770-4881-87b3-19c834cec51f req-0c446f67-61f0-46dd-837a-3e939a6aea10 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:46.895683 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-c8d3c48c-b770-4881-87b3-19c834cec51f req-0c446f67-61f0-46dd-837a-3e939a6aea10 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:46.935443 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=100 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:54:46.947974 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-c8d3c48c-b770-4881-87b3-19c834cec51f req-0c446f67-61f0-46dd-837a-3e939a6aea10 service nova] Creating event network-vif-unplugged:2e084b59-e468-45fb-8081-c4bafdb31c08 for instance 3354b397-f391-47f2-8ded-f9227bfecb6f on n-h1-846463-3 Sep 23 04:54:46.958827 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-c8d3c48c-b770-4881-87b3-19c834cec51f req-0c446f67-61f0-46dd-837a-3e939a6aea10 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.121758 Sep 23 04:54:46.961497 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2518/5179] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:54:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:54:46.967748 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-18c6428d-162f-4ea7-8f3b-a16cfcbef398 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:46.968446 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-18c6428d-162f-4ea7-8f3b-a16cfcbef398 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 3354b397-f391-47f2-8ded-f9227bfecb6f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:46.979773 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-18c6428d-162f-4ea7-8f3b-a16cfcbef398 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:46.980463 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-18c6428d-162f-4ea7-8f3b-a16cfcbef398 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:46.981444 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-18c6428d-162f-4ea7-8f3b-a16cfcbef398 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:46.986769 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-18c6428d-162f-4ea7-8f3b-a16cfcbef398 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:46.987555 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-18c6428d-162f-4ea7-8f3b-a16cfcbef398 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:46.989041 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-18c6428d-162f-4ea7-8f3b-a16cfcbef398 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:46.991110 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3a4f1825-c8c1-4cce-a3c7-a59c9023583b tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:46.991859 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3a4f1825-c8c1-4cce-a3c7-a59c9023583b tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 4381aca2-ea30-4473-9cd3-18c9b64f1937] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:47.000633 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3a4f1825-c8c1-4cce-a3c7-a59c9023583b tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:47.001142 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3a4f1825-c8c1-4cce-a3c7-a59c9023583b tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:47.001578 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3a4f1825-c8c1-4cce-a3c7-a59c9023583b tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:47.006709 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3a4f1825-c8c1-4cce-a3c7-a59c9023583b tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:47.007879 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3a4f1825-c8c1-4cce-a3c7-a59c9023583b tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:47.011852 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3a4f1825-c8c1-4cce-a3c7-a59c9023583b tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:47.417221 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-3a4f1825-c8c1-4cce-a3c7-a59c9023583b tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:47.452309 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3a4f1825-c8c1-4cce-a3c7-a59c9023583b tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937" status: 200 len: 1697 microversion: 2.1 time: 0.465559 Sep 23 04:54:47.453660 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2519/5180] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:46 2022] GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937 => generated 1697 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:54:47.495587 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-18c6428d-162f-4ea7-8f3b-a16cfcbef398 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:47.507789 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-18c6428d-162f-4ea7-8f3b-a16cfcbef398 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/3354b397-f391-47f2-8ded-f9227bfecb6f" status: 200 len: 1504 microversion: 2.1 time: 0.541708 Sep 23 04:54:47.509689 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2662/5181] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:46 2022] GET /compute/v2.1/servers/3354b397-f391-47f2-8ded-f9227bfecb6f => generated 1504 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:54:47.860544 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3107dce2-c986-4b7c-9f9f-0d45dd18f017 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:47.863159 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3107dce2-c986-4b7c-9f9f-0d45dd18f017 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: 10546b59-4576-4dd2-a915-53e194075a26] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:47.880281 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b5fed339-812d-4fae-bc88-168e75987b9b tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:47.880920 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b5fed339-812d-4fae-bc88-168e75987b9b tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] [instance: f92b0d2f-5a4d-4c52-9b91-4195c9e78b41] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:47.886449 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3107dce2-c986-4b7c-9f9f-0d45dd18f017 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:47.890280 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3107dce2-c986-4b7c-9f9f-0d45dd18f017 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:47.890963 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3107dce2-c986-4b7c-9f9f-0d45dd18f017 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:47.891892 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3107dce2-c986-4b7c-9f9f-0d45dd18f017 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:47.892525 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3107dce2-c986-4b7c-9f9f-0d45dd18f017 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:47.892828 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b5fed339-812d-4fae-bc88-168e75987b9b tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:47.894377 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b5fed339-812d-4fae-bc88-168e75987b9b tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:47.894855 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b5fed339-812d-4fae-bc88-168e75987b9b tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:47.896879 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b5fed339-812d-4fae-bc88-168e75987b9b tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:47.898571 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b5fed339-812d-4fae-bc88-168e75987b9b tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:47.899413 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b5fed339-812d-4fae-bc88-168e75987b9b tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:47.902600 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3107dce2-c986-4b7c-9f9f-0d45dd18f017 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:47.923048 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=100 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:54:48.265835 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-3107dce2-c986-4b7c-9f9f-0d45dd18f017 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:48.266005 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b5fed339-812d-4fae-bc88-168e75987b9b tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06a78b01bd24d6f9c25dc56c6573ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbeff54a4514dacae8b9f0eb517d2ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:48.266118 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3107dce2-c986-4b7c-9f9f-0d45dd18f017 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/10546b59-4576-4dd2-a915-53e194075a26" status: 200 len: 1317 microversion: 2.1 time: 0.407509 Sep 23 04:54:48.266118 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2520/5182] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:47 2022] GET /compute/v2.1/servers/10546b59-4576-4dd2-a915-53e194075a26 => generated 1317 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:54:48.272874 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b5fed339-812d-4fae-bc88-168e75987b9b tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06a78b01bd24d6f9c25dc56c6573ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbeff54a4514dacae8b9f0eb517d2ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:48.274667 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b5fed339-812d-4fae-bc88-168e75987b9b tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06a78b01bd24d6f9c25dc56c6573ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbeff54a4514dacae8b9f0eb517d2ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:48.276048 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b5fed339-812d-4fae-bc88-168e75987b9b tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] 10.222.0.33 "GET /compute/v2.1/servers/f92b0d2f-5a4d-4c52-9b91-4195c9e78b41" status: 200 len: 1361 microversion: 2.26 time: 0.399856 Sep 23 04:54:48.277200 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2663/5183] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:54:47 2022] GET /compute/v2.1/servers/f92b0d2f-5a4d-4c52-9b91-4195c9e78b41 => generated 1361 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:54:48.477436 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d96f201f-ff14-4572-84c8-bc60ac1baaeb tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:48.478231 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d96f201f-ff14-4572-84c8-bc60ac1baaeb tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 4381aca2-ea30-4473-9cd3-18c9b64f1937] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:48.486652 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d96f201f-ff14-4572-84c8-bc60ac1baaeb tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:48.487269 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d96f201f-ff14-4572-84c8-bc60ac1baaeb tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:48.487988 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d96f201f-ff14-4572-84c8-bc60ac1baaeb tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:48.488935 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d96f201f-ff14-4572-84c8-bc60ac1baaeb tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:48.489622 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d96f201f-ff14-4572-84c8-bc60ac1baaeb tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:48.490349 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d96f201f-ff14-4572-84c8-bc60ac1baaeb tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:48.546044 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-68a89a4e-65c2-453a-b096-579cee46ed88 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:48.547084 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-68a89a4e-65c2-453a-b096-579cee46ed88 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 3354b397-f391-47f2-8ded-f9227bfecb6f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:48.561156 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-68a89a4e-65c2-453a-b096-579cee46ed88 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:48.562931 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-68a89a4e-65c2-453a-b096-579cee46ed88 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:48.563582 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-68a89a4e-65c2-453a-b096-579cee46ed88 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:48.564507 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-68a89a4e-65c2-453a-b096-579cee46ed88 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:48.565327 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-68a89a4e-65c2-453a-b096-579cee46ed88 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:48.566033 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-68a89a4e-65c2-453a-b096-579cee46ed88 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:48.809586 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d96f201f-ff14-4572-84c8-bc60ac1baaeb tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:48.818069 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d96f201f-ff14-4572-84c8-bc60ac1baaeb tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937" status: 200 len: 1697 microversion: 2.1 time: 0.345415 Sep 23 04:54:48.827179 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2521/5184] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:48 2022] GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937 => generated 1697 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:54:48.951207 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-68a89a4e-65c2-453a-b096-579cee46ed88 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:48.963876 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-68a89a4e-65c2-453a-b096-579cee46ed88 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/3354b397-f391-47f2-8ded-f9227bfecb6f" status: 200 len: 1507 microversion: 2.1 time: 0.425970 Sep 23 04:54:48.964497 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2664/5185] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:48 2022] GET /compute/v2.1/servers/3354b397-f391-47f2-8ded-f9227bfecb6f => generated 1507 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:54:48.989259 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-27dd25b8-22c6-4a55-a4ad-3100b0425b3f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:48.990649 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-27dd25b8-22c6-4a55-a4ad-3100b0425b3f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:48.998194 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-27dd25b8-22c6-4a55-a4ad-3100b0425b3f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:49.004344 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-27dd25b8-22c6-4a55-a4ad-3100b0425b3f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:49.004344 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-27dd25b8-22c6-4a55-a4ad-3100b0425b3f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:49.004344 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-27dd25b8-22c6-4a55-a4ad-3100b0425b3f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:49.004344 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-27dd25b8-22c6-4a55-a4ad-3100b0425b3f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:49.004344 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-27dd25b8-22c6-4a55-a4ad-3100b0425b3f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:49.291104 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4611fd41-7330-4325-adec-e2fa23ec1053 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:49.291881 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4611fd41-7330-4325-adec-e2fa23ec1053 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: 10546b59-4576-4dd2-a915-53e194075a26] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:49.302086 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4611fd41-7330-4325-adec-e2fa23ec1053 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:49.305385 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4611fd41-7330-4325-adec-e2fa23ec1053 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:49.307571 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4611fd41-7330-4325-adec-e2fa23ec1053 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:49.310025 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4611fd41-7330-4325-adec-e2fa23ec1053 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:49.312029 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4611fd41-7330-4325-adec-e2fa23ec1053 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:49.314172 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4611fd41-7330-4325-adec-e2fa23ec1053 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:49.375769 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-27dd25b8-22c6-4a55-a4ad-3100b0425b3f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:49.390336 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-27dd25b8-22c6-4a55-a4ad-3100b0425b3f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1670 microversion: 2.1 time: 0.404904 Sep 23 04:54:49.390935 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2522/5186] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:48 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1670 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:54:49.400400 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2f7743d5-ee98-40c4-b8bb-5b52cb9f93b1 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:49.412500 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-2f7743d5-ee98-40c4-b8bb-5b52cb9f93b1 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] [instance: f92b0d2f-5a4d-4c52-9b91-4195c9e78b41] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:49.418098 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2f7743d5-ee98-40c4-b8bb-5b52cb9f93b1 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:49.421084 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2f7743d5-ee98-40c4-b8bb-5b52cb9f93b1 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:49.421725 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2f7743d5-ee98-40c4-b8bb-5b52cb9f93b1 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:49.433153 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2f7743d5-ee98-40c4-b8bb-5b52cb9f93b1 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:49.435637 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2f7743d5-ee98-40c4-b8bb-5b52cb9f93b1 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:49.436525 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2f7743d5-ee98-40c4-b8bb-5b52cb9f93b1 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:49.707618 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-4611fd41-7330-4325-adec-e2fa23ec1053 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:49.719513 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4611fd41-7330-4325-adec-e2fa23ec1053 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/10546b59-4576-4dd2-a915-53e194075a26" status: 200 len: 1317 microversion: 2.1 time: 0.432909 Sep 23 04:54:49.722299 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2665/5187] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:49 2022] GET /compute/v2.1/servers/10546b59-4576-4dd2-a915-53e194075a26 => generated 1317 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:54:49.728254 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-bfc71623-c330-45bb-a58e-c3369dae19e0 req-2eabbd92-f116-423f-97c7-5bc448c02d1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f92b0d2f-5a4d-4c52-9b91-4195c9e78b41", "name": "network-vif-plugged", "status": "completed", "tag": "549e0e14-c594-43e2-a408-b72248a33d12"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:54:49.744060 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-bfc71623-c330-45bb-a58e-c3369dae19e0 req-2eabbd92-f116-423f-97c7-5bc448c02d1b service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:49.744904 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-bfc71623-c330-45bb-a58e-c3369dae19e0 req-2eabbd92-f116-423f-97c7-5bc448c02d1b service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:49.745589 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-bfc71623-c330-45bb-a58e-c3369dae19e0 req-2eabbd92-f116-423f-97c7-5bc448c02d1b service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:49.774603 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-bfc71623-c330-45bb-a58e-c3369dae19e0 req-2eabbd92-f116-423f-97c7-5bc448c02d1b service nova] Creating event network-vif-plugged:549e0e14-c594-43e2-a408-b72248a33d12 for instance f92b0d2f-5a4d-4c52-9b91-4195c9e78b41 on n-h1-846463-3 Sep 23 04:54:49.780617 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-bfc71623-c330-45bb-a58e-c3369dae19e0 req-2eabbd92-f116-423f-97c7-5bc448c02d1b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056559 Sep 23 04:54:49.781447 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2666/5188] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:54:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:54:49.791494 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-09b220d6-6999-406f-8e97-d690a7432a98 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:49.792588 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-09b220d6-6999-406f-8e97-d690a7432a98 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:49.803369 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-09b220d6-6999-406f-8e97-d690a7432a98 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:49.827679 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-09b220d6-6999-406f-8e97-d690a7432a98 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:49.828254 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-09b220d6-6999-406f-8e97-d690a7432a98 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:49.831482 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-09b220d6-6999-406f-8e97-d690a7432a98 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:49.832772 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-09b220d6-6999-406f-8e97-d690a7432a98 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:49.834122 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-09b220d6-6999-406f-8e97-d690a7432a98 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:49.877327 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-2f7743d5-ee98-40c4-b8bb-5b52cb9f93b1 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06a78b01bd24d6f9c25dc56c6573ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbeff54a4514dacae8b9f0eb517d2ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:49.904657 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-2f7743d5-ee98-40c4-b8bb-5b52cb9f93b1 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06a78b01bd24d6f9c25dc56c6573ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbeff54a4514dacae8b9f0eb517d2ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:49.904883 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-2f7743d5-ee98-40c4-b8bb-5b52cb9f93b1 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06a78b01bd24d6f9c25dc56c6573ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbeff54a4514dacae8b9f0eb517d2ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:49.908939 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2f7743d5-ee98-40c4-b8bb-5b52cb9f93b1 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] 10.222.0.33 "GET /compute/v2.1/servers/f92b0d2f-5a4d-4c52-9b91-4195c9e78b41" status: 200 len: 1361 microversion: 2.26 time: 0.514471 Sep 23 04:54:49.909928 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2523/5189] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:54:49 2022] GET /compute/v2.1/servers/f92b0d2f-5a4d-4c52-9b91-4195c9e78b41 => generated 1361 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:54:49.924442 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-652811a1-63c8-4d1d-9d9f-01d5e88fb4ee tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:49.925433 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-652811a1-63c8-4d1d-9d9f-01d5e88fb4ee tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 4381aca2-ea30-4473-9cd3-18c9b64f1937] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:49.942863 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-652811a1-63c8-4d1d-9d9f-01d5e88fb4ee tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:49.948668 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-652811a1-63c8-4d1d-9d9f-01d5e88fb4ee tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:49.948668 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-652811a1-63c8-4d1d-9d9f-01d5e88fb4ee tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:49.948668 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-652811a1-63c8-4d1d-9d9f-01d5e88fb4ee tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:49.948668 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-652811a1-63c8-4d1d-9d9f-01d5e88fb4ee tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:49.948668 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-652811a1-63c8-4d1d-9d9f-01d5e88fb4ee tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:50.037284 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-09b220d6-6999-406f-8e97-d690a7432a98 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:50.057469 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-09b220d6-6999-406f-8e97-d690a7432a98 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1670 microversion: 2.1 time: 0.268925 Sep 23 04:54:50.058179 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2667/5190] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:49 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1670 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:54:50.222963 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-652811a1-63c8-4d1d-9d9f-01d5e88fb4ee tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:50.236344 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-652811a1-63c8-4d1d-9d9f-01d5e88fb4ee tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937" status: 200 len: 1696 microversion: 2.1 time: 0.320980 Sep 23 04:54:50.236465 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2524/5191] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:49 2022] GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937 => generated 1696 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:54:50.246955 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7e8e0cac-fb76-40fe-ad9f-34af25df49dd tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:50.251647 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7e8e0cac-fb76-40fe-ad9f-34af25df49dd tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:50.264758 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7e8e0cac-fb76-40fe-ad9f-34af25df49dd tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:50.267635 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7e8e0cac-fb76-40fe-ad9f-34af25df49dd tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:50.268106 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7e8e0cac-fb76-40fe-ad9f-34af25df49dd tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:50.270702 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7e8e0cac-fb76-40fe-ad9f-34af25df49dd tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:50.273529 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7e8e0cac-fb76-40fe-ad9f-34af25df49dd tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:50.281742 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7e8e0cac-fb76-40fe-ad9f-34af25df49dd tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:50.305626 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a8df162b-f801-45f7-b49d-6f88abf4bbdb tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Action: 'create', calling method: .version_select at 0x7ff1ba863b80>, body: {"keypair": {"name": "tempest-keypair-2084242172", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIA7ejbFYAc9CfaZ8A/LF1uQ1ewPV2mTwKwt8wr1vHpfLAXBeInL9Hj5vGMF2nWby+2S5b8QXSDUppzk9qVunv8RDBL5Equ0bAsngLKfU/+Ugg6INiDyJB8I1b9JzEobuA=="}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:54:50.355215 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-a8df162b-f801-45f7-b49d-6f88abf4bbdb tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Getting quotas for project 71874a329e54494bb1b84f31c3826205. Resources: {'key_pairs'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:54:50.364828 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-a8df162b-f801-45f7-b49d-6f88abf4bbdb tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Getting quotas for user d1bde73a530f4666aebdd5f7d9fa1046 and project 71874a329e54494bb1b84f31c3826205. Resources: {'key_pairs'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:54:50.455782 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a8df162b-f801-45f7-b49d-6f88abf4bbdb tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.396241 Sep 23 04:54:50.467938 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2668/5192] 10.222.0.33 () {60 vars in 1159 bytes} [Fri Sep 23 04:54:50 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:54:50.524404 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-7e8e0cac-fb76-40fe-ad9f-34af25df49dd tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:50.537019 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7e8e0cac-fb76-40fe-ad9f-34af25df49dd tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1670 microversion: 2.1 time: 0.299458 Sep 23 04:54:50.538091 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2525/5193] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:50 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1670 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:54:50.562372 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2d54b39e-1817-41ff-9a0c-ab43a286f026 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:50.563003 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-2d54b39e-1817-41ff-9a0c-ab43a286f026 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:50.569876 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2d54b39e-1817-41ff-9a0c-ab43a286f026 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:50.570403 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2d54b39e-1817-41ff-9a0c-ab43a286f026 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:50.571037 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2d54b39e-1817-41ff-9a0c-ab43a286f026 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:50.572133 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2d54b39e-1817-41ff-9a0c-ab43a286f026 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:50.572790 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2d54b39e-1817-41ff-9a0c-ab43a286f026 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:50.573653 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2d54b39e-1817-41ff-9a0c-ab43a286f026 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:50.772525 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-524943b3-769c-433b-b548-62dbdc87638f tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:50.774733 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-524943b3-769c-433b-b548-62dbdc87638f tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: 10546b59-4576-4dd2-a915-53e194075a26] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:50.798291 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-524943b3-769c-433b-b548-62dbdc87638f tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:50.800330 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-524943b3-769c-433b-b548-62dbdc87638f tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:50.801479 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-524943b3-769c-433b-b548-62dbdc87638f tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:50.802654 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-524943b3-769c-433b-b548-62dbdc87638f tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:50.804418 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-524943b3-769c-433b-b548-62dbdc87638f tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:50.805049 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-524943b3-769c-433b-b548-62dbdc87638f tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:50.810497 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2d54b39e-1817-41ff-9a0c-ab43a286f026 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:50.820435 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2d54b39e-1817-41ff-9a0c-ab43a286f026 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1670 microversion: 2.1 time: 0.261459 Sep 23 04:54:50.841583 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2669/5194] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:50 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1670 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:54:50.848714 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-06254e21-6b2b-4a2a-b07c-096e903e5f38 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:54:50.859067 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-06254e21-6b2b-4a2a-b07c-096e903e5f38 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:50.859825 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-06254e21-6b2b-4a2a-b07c-096e903e5f38 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:50.864775 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-06254e21-6b2b-4a2a-b07c-096e903e5f38 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:50.892649 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-06254e21-6b2b-4a2a-b07c-096e903e5f38 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Going to try to stop instance {{(pid=122699) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 23 04:54:51.023360 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-524943b3-769c-433b-b548-62dbdc87638f tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:51.041384 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-524943b3-769c-433b-b548-62dbdc87638f tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/10546b59-4576-4dd2-a915-53e194075a26" status: 200 len: 1317 microversion: 2.1 time: 0.299914 Sep 23 04:54:51.041648 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2526/5195] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:50 2022] GET /compute/v2.1/servers/10546b59-4576-4dd2-a915-53e194075a26 => generated 1317 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:54:51.056861 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-8e41fdaf-f887-418f-962d-2d09a7a6c4dd req-ae7d309c-36bb-45c1-a5d8-c0d194484b2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4381aca2-ea30-4473-9cd3-18c9b64f1937", "name": "network-vif-unplugged", "status": "completed", "tag": "bc06dfe2-49c9-4f61-b1e4-e3d76533aa0c"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:54:51.058638 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-8e41fdaf-f887-418f-962d-2d09a7a6c4dd req-ae7d309c-36bb-45c1-a5d8-c0d194484b2b service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:51.059400 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-8e41fdaf-f887-418f-962d-2d09a7a6c4dd req-ae7d309c-36bb-45c1-a5d8-c0d194484b2b service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:51.060063 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-8e41fdaf-f887-418f-962d-2d09a7a6c4dd req-ae7d309c-36bb-45c1-a5d8-c0d194484b2b service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:51.076504 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-8e41fdaf-f887-418f-962d-2d09a7a6c4dd req-ae7d309c-36bb-45c1-a5d8-c0d194484b2b service nova] Creating event network-vif-unplugged:bc06dfe2-49c9-4f61-b1e4-e3d76533aa0c for instance 4381aca2-ea30-4473-9cd3-18c9b64f1937 on n-h2-846463-3 Sep 23 04:54:51.082680 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [req-8e41fdaf-f887-418f-962d-2d09a7a6c4dd req-ae7d309c-36bb-45c1-a5d8-c0d194484b2b service nova] Instance 4381aca2-ea30-4473-9cd3-18c9b64f1937 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846463-3', 'n-h2-846463-3'} {{(pid=122698) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 23 04:54:51.094355 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-8e41fdaf-f887-418f-962d-2d09a7a6c4dd req-ae7d309c-36bb-45c1-a5d8-c0d194484b2b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051351 Sep 23 04:54:51.095390 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2527/5196] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:54:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:54:51.100753 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9cf4b6ad-8d70-40e2-b5a4-073f65b80fdd tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:51.101396 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-9cf4b6ad-8d70-40e2-b5a4-073f65b80fdd tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] [instance: f92b0d2f-5a4d-4c52-9b91-4195c9e78b41] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:51.107547 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9cf4b6ad-8d70-40e2-b5a4-073f65b80fdd tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:51.108060 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9cf4b6ad-8d70-40e2-b5a4-073f65b80fdd tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:51.108499 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9cf4b6ad-8d70-40e2-b5a4-073f65b80fdd tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:51.109209 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9cf4b6ad-8d70-40e2-b5a4-073f65b80fdd tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:51.109671 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9cf4b6ad-8d70-40e2-b5a4-073f65b80fdd tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:51.110130 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9cf4b6ad-8d70-40e2-b5a4-073f65b80fdd tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:51.219069 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-06254e21-6b2b-4a2a-b07c-096e903e5f38 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "POST /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5/action" status: 202 len: 0 microversion: 2.1 time: 0.368168 Sep 23 04:54:51.238761 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2670/5197] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:54:50 2022] POST /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5/action => generated 0 bytes in 395 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 23 04:54:51.263991 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-827b6bd8-1457-4724-8922-6838fe21d23f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:51.266090 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-827b6bd8-1457-4724-8922-6838fe21d23f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:51.291471 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-9cf4b6ad-8d70-40e2-b5a4-073f65b80fdd tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06a78b01bd24d6f9c25dc56c6573ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbeff54a4514dacae8b9f0eb517d2ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:51.292887 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-827b6bd8-1457-4724-8922-6838fe21d23f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:51.300224 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-827b6bd8-1457-4724-8922-6838fe21d23f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:51.301099 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-827b6bd8-1457-4724-8922-6838fe21d23f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:51.302307 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-827b6bd8-1457-4724-8922-6838fe21d23f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:51.303072 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-827b6bd8-1457-4724-8922-6838fe21d23f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:51.304687 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-827b6bd8-1457-4724-8922-6838fe21d23f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:51.315708 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-9cf4b6ad-8d70-40e2-b5a4-073f65b80fdd tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06a78b01bd24d6f9c25dc56c6573ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbeff54a4514dacae8b9f0eb517d2ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:51.319539 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-9cf4b6ad-8d70-40e2-b5a4-073f65b80fdd tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06a78b01bd24d6f9c25dc56c6573ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbeff54a4514dacae8b9f0eb517d2ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:51.321096 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9cf4b6ad-8d70-40e2-b5a4-073f65b80fdd tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] 10.222.0.33 "GET /compute/v2.1/servers/f92b0d2f-5a4d-4c52-9b91-4195c9e78b41" status: 200 len: 1361 microversion: 2.26 time: 0.224381 Sep 23 04:54:51.322221 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2528/5198] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:54:51 2022] GET /compute/v2.1/servers/f92b0d2f-5a4d-4c52-9b91-4195c9e78b41 => generated 1361 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:54:51.327234 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-dc4296f3-cfa7-47e2-a025-8221b79b75ed tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:51.328200 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-dc4296f3-cfa7-47e2-a025-8221b79b75ed tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 4381aca2-ea30-4473-9cd3-18c9b64f1937] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:51.335119 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dc4296f3-cfa7-47e2-a025-8221b79b75ed tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:51.335953 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dc4296f3-cfa7-47e2-a025-8221b79b75ed tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:51.336600 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dc4296f3-cfa7-47e2-a025-8221b79b75ed tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:51.337677 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dc4296f3-cfa7-47e2-a025-8221b79b75ed tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:51.338442 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dc4296f3-cfa7-47e2-a025-8221b79b75ed tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:51.339135 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dc4296f3-cfa7-47e2-a025-8221b79b75ed tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:51.635667 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-827b6bd8-1457-4724-8922-6838fe21d23f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:51.641846 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-827b6bd8-1457-4724-8922-6838fe21d23f tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1680 microversion: 2.1 time: 0.399191 Sep 23 04:54:51.642636 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2671/5199] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:51 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1680 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:54:51.689029 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-dc4296f3-cfa7-47e2-a025-8221b79b75ed tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:51.697704 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-dc4296f3-cfa7-47e2-a025-8221b79b75ed tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937" status: 200 len: 1696 microversion: 2.1 time: 0.374172 Sep 23 04:54:51.698629 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2529/5200] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:51 2022] GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937 => generated 1696 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:54:52.073132 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-16797f71-1b45-4f5c-b9fa-15b55b0dc964 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:52.076614 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-16797f71-1b45-4f5c-b9fa-15b55b0dc964 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: 10546b59-4576-4dd2-a915-53e194075a26] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:52.100990 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-16797f71-1b45-4f5c-b9fa-15b55b0dc964 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:52.103466 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-16797f71-1b45-4f5c-b9fa-15b55b0dc964 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:52.106452 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-16797f71-1b45-4f5c-b9fa-15b55b0dc964 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:52.107601 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-16797f71-1b45-4f5c-b9fa-15b55b0dc964 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:52.108769 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-16797f71-1b45-4f5c-b9fa-15b55b0dc964 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:52.109814 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-16797f71-1b45-4f5c-b9fa-15b55b0dc964 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:52.355462 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e9b4fd7b-18d9-4a1d-8a21-de66dc2225f9 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:52.357788 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e9b4fd7b-18d9-4a1d-8a21-de66dc2225f9 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] [instance: f92b0d2f-5a4d-4c52-9b91-4195c9e78b41] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:52.373881 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e9b4fd7b-18d9-4a1d-8a21-de66dc2225f9 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:52.374742 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e9b4fd7b-18d9-4a1d-8a21-de66dc2225f9 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:52.375440 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e9b4fd7b-18d9-4a1d-8a21-de66dc2225f9 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:52.377294 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e9b4fd7b-18d9-4a1d-8a21-de66dc2225f9 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:52.379676 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e9b4fd7b-18d9-4a1d-8a21-de66dc2225f9 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:52.387159 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e9b4fd7b-18d9-4a1d-8a21-de66dc2225f9 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:52.541768 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-16797f71-1b45-4f5c-b9fa-15b55b0dc964 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:52.553797 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-16797f71-1b45-4f5c-b9fa-15b55b0dc964 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/10546b59-4576-4dd2-a915-53e194075a26" status: 200 len: 1317 microversion: 2.1 time: 0.487354 Sep 23 04:54:52.555529 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2672/5201] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:52 2022] GET /compute/v2.1/servers/10546b59-4576-4dd2-a915-53e194075a26 => generated 1317 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:54:52.562003 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-f86ed99e-be5d-4763-a3a6-cb8113d2fce8 req-65ee3514-366c-4c7a-8342-5878d3ffbe5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10546b59-4576-4dd2-a915-53e194075a26", "name": "network-vif-plugged", "status": "completed", "tag": "1c318b20-3c2f-4db9-b120-05eb91bef00c"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:54:52.575962 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-f86ed99e-be5d-4763-a3a6-cb8113d2fce8 req-65ee3514-366c-4c7a-8342-5878d3ffbe5b service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:52.576444 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-f86ed99e-be5d-4763-a3a6-cb8113d2fce8 req-65ee3514-366c-4c7a-8342-5878d3ffbe5b service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:52.581766 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-f86ed99e-be5d-4763-a3a6-cb8113d2fce8 req-65ee3514-366c-4c7a-8342-5878d3ffbe5b service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:52.590924 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-f86ed99e-be5d-4763-a3a6-cb8113d2fce8 req-65ee3514-366c-4c7a-8342-5878d3ffbe5b service nova] Creating event network-vif-plugged:1c318b20-3c2f-4db9-b120-05eb91bef00c for instance 10546b59-4576-4dd2-a915-53e194075a26 on n-h2-846463-3 Sep 23 04:54:52.596124 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-f86ed99e-be5d-4763-a3a6-cb8113d2fce8 req-65ee3514-366c-4c7a-8342-5878d3ffbe5b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038614 Sep 23 04:54:52.596901 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2673/5202] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:54:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:54:52.674611 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b538bd76-f401-45a3-aa10-fe045beb41b4 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:52.677005 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b538bd76-f401-45a3-aa10-fe045beb41b4 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:52.699728 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b538bd76-f401-45a3-aa10-fe045beb41b4 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:52.702618 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b538bd76-f401-45a3-aa10-fe045beb41b4 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:52.702618 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b538bd76-f401-45a3-aa10-fe045beb41b4 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:52.702618 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b538bd76-f401-45a3-aa10-fe045beb41b4 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:52.703429 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b538bd76-f401-45a3-aa10-fe045beb41b4 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:52.703965 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b538bd76-f401-45a3-aa10-fe045beb41b4 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:53.190802 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e9b4fd7b-18d9-4a1d-8a21-de66dc2225f9 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06a78b01bd24d6f9c25dc56c6573ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbeff54a4514dacae8b9f0eb517d2ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:53.201726 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e9b4fd7b-18d9-4a1d-8a21-de66dc2225f9 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06a78b01bd24d6f9c25dc56c6573ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbeff54a4514dacae8b9f0eb517d2ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:53.209976 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e9b4fd7b-18d9-4a1d-8a21-de66dc2225f9 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06a78b01bd24d6f9c25dc56c6573ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbeff54a4514dacae8b9f0eb517d2ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:53.211461 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e9b4fd7b-18d9-4a1d-8a21-de66dc2225f9 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] 10.222.0.33 "GET /compute/v2.1/servers/f92b0d2f-5a4d-4c52-9b91-4195c9e78b41" status: 200 len: 1546 microversion: 2.26 time: 0.863549 Sep 23 04:54:53.218850 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2530/5203] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:54:52 2022] GET /compute/v2.1/servers/f92b0d2f-5a4d-4c52-9b91-4195c9e78b41 => generated 1546 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:54:53.237048 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4f7d3b5b-cef5-4b7a-b1b6-ab8787585843 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:53.238034 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4f7d3b5b-cef5-4b7a-b1b6-ab8787585843 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 4381aca2-ea30-4473-9cd3-18c9b64f1937] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:53.248390 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4f7d3b5b-cef5-4b7a-b1b6-ab8787585843 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:53.249159 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4f7d3b5b-cef5-4b7a-b1b6-ab8787585843 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:53.253296 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4f7d3b5b-cef5-4b7a-b1b6-ab8787585843 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:53.254369 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4f7d3b5b-cef5-4b7a-b1b6-ab8787585843 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:53.255110 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4f7d3b5b-cef5-4b7a-b1b6-ab8787585843 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:53.255773 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4f7d3b5b-cef5-4b7a-b1b6-ab8787585843 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:53.454213 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b538bd76-f401-45a3-aa10-fe045beb41b4 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:53.466632 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b538bd76-f401-45a3-aa10-fe045beb41b4 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1680 microversion: 2.1 time: 0.801387 Sep 23 04:54:53.471138 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2674/5204] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:52 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1680 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:54:53.473859 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-72a86023-fcb3-4bf0-a166-3bffe5ab5535 req-1df450c3-fe2b-42dc-a479-cf47a51a8515 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4381aca2-ea30-4473-9cd3-18c9b64f1937", "tag": "bc06dfe2-49c9-4f61-b1e4-e3d76533aa0c"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:54:53.488161 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-72a86023-fcb3-4bf0-a166-3bffe5ab5535 req-1df450c3-fe2b-42dc-a479-cf47a51a8515 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:53.489035 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-72a86023-fcb3-4bf0-a166-3bffe5ab5535 req-1df450c3-fe2b-42dc-a479-cf47a51a8515 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:53.489710 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-72a86023-fcb3-4bf0-a166-3bffe5ab5535 req-1df450c3-fe2b-42dc-a479-cf47a51a8515 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:53.506680 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-72a86023-fcb3-4bf0-a166-3bffe5ab5535 req-1df450c3-fe2b-42dc-a479-cf47a51a8515 service nova] Creating event network-changed:bc06dfe2-49c9-4f61-b1e4-e3d76533aa0c for instance 4381aca2-ea30-4473-9cd3-18c9b64f1937 on n-h2-846463-3 Sep 23 04:54:53.514324 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [req-72a86023-fcb3-4bf0-a166-3bffe5ab5535 req-1df450c3-fe2b-42dc-a479-cf47a51a8515 service nova] Instance 4381aca2-ea30-4473-9cd3-18c9b64f1937 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846463-3', 'n-h2-846463-3'} {{(pid=122699) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 23 04:54:53.534463 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-72a86023-fcb3-4bf0-a166-3bffe5ab5535 req-1df450c3-fe2b-42dc-a479-cf47a51a8515 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064598 Sep 23 04:54:53.539467 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2675/5205] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:54:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:54:53.544134 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9ffa4e6f-274c-445a-847c-8c78348ed6b9 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Calling method '.version_select at 0x7ff1ba807670>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:53.558089 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9ffa4e6f-274c-445a-847c-8c78348ed6b9 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:53.558936 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9ffa4e6f-274c-445a-847c-8c78348ed6b9 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:53.559662 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9ffa4e6f-274c-445a-847c-8c78348ed6b9 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:53.560664 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-9ffa4e6f-274c-445a-847c-8c78348ed6b9 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] [instance: f92b0d2f-5a4d-4c52-9b91-4195c9e78b41] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:53.571151 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9ffa4e6f-274c-445a-847c-8c78348ed6b9 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:53.571686 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9ffa4e6f-274c-445a-847c-8c78348ed6b9 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:53.572136 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9ffa4e6f-274c-445a-847c-8c78348ed6b9 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:53.572876 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9ffa4e6f-274c-445a-847c-8c78348ed6b9 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:53.573344 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9ffa4e6f-274c-445a-847c-8c78348ed6b9 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:53.577172 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9ffa4e6f-274c-445a-847c-8c78348ed6b9 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:53.589319 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4f7d3b5b-cef5-4b7a-b1b6-ab8787585843 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:53.611139 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4f7d3b5b-cef5-4b7a-b1b6-ab8787585843 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937" status: 200 len: 1696 microversion: 2.1 time: 0.381906 Sep 23 04:54:53.612367 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2531/5206] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:53 2022] GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937 => generated 1696 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:54:53.617470 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-eaea4e38-2bc3-4728-bbef-3fd64c9547ee tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:53.618427 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-eaea4e38-2bc3-4728-bbef-3fd64c9547ee tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: 10546b59-4576-4dd2-a915-53e194075a26] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:53.635763 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-eaea4e38-2bc3-4728-bbef-3fd64c9547ee tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:53.638967 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-eaea4e38-2bc3-4728-bbef-3fd64c9547ee tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:53.643084 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-eaea4e38-2bc3-4728-bbef-3fd64c9547ee tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:53.644673 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-eaea4e38-2bc3-4728-bbef-3fd64c9547ee tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:53.655631 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9ffa4e6f-274c-445a-847c-8c78348ed6b9 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:53.655631 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9ffa4e6f-274c-445a-847c-8c78348ed6b9 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:53.655849 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9ffa4e6f-274c-445a-847c-8c78348ed6b9 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:53.656731 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-eaea4e38-2bc3-4728-bbef-3fd64c9547ee tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:53.657422 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-eaea4e38-2bc3-4728-bbef-3fd64c9547ee tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:53.701684 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9ffa4e6f-274c-445a-847c-8c78348ed6b9 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:53.701684 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9ffa4e6f-274c-445a-847c-8c78348ed6b9 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:53.701684 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9ffa4e6f-274c-445a-847c-8c78348ed6b9 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:53.838889 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-9ffa4e6f-274c-445a-847c-8c78348ed6b9 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lazy-loading 'flavor' on Instance uuid f92b0d2f-5a4d-4c52-9b91-4195c9e78b41 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:54:53.858487 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-9ffa4e6f-274c-445a-847c-8c78348ed6b9 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] 10.222.0.33 "PUT /compute/v2.1/servers/f92b0d2f-5a4d-4c52-9b91-4195c9e78b41/tags/tempest-tag-1971816868" status: 201 len: 0 microversion: 2.26 time: 0.321444 Sep 23 04:54:53.860223 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2676/5207] 10.222.0.33 () {62 vars in 1380 bytes} [Fri Sep 23 04:54:53 2022] PUT /compute/v2.1/servers/f92b0d2f-5a4d-4c52-9b91-4195c9e78b41/tags/tempest-tag-1971816868 => generated 0 bytes in 324 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Sep 23 04:54:53.871971 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-adf6b108-8fd2-46e1-be36-1c9690413c5e tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Calling method '.version_select at 0x7ff1ba870a60>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:53.880997 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:54:53.888839 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-adf6b108-8fd2-46e1-be36-1c9690413c5e tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:53.889865 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-adf6b108-8fd2-46e1-be36-1c9690413c5e tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:53.890747 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-adf6b108-8fd2-46e1-be36-1c9690413c5e tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:53.910725 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-adf6b108-8fd2-46e1-be36-1c9690413c5e tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] 10.222.0.33 "GET /compute/v2.1/servers/f92b0d2f-5a4d-4c52-9b91-4195c9e78b41/tags/tempest-tag-1971816868" status: 204 len: 0 microversion: 2.26 time: 0.044723 Sep 23 04:54:53.912366 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2677/5208] 10.222.0.33 () {60 vars in 1361 bytes} [Fri Sep 23 04:54:53 2022] GET /compute/v2.1/servers/f92b0d2f-5a4d-4c52-9b91-4195c9e78b41/tags/tempest-tag-1971816868 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 23 04:54:53.943181 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c1d39825-c911-4347-a557-f0ed07107823 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Calling method '.version_select at 0x7ff1ba8280d0>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:53.974166 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c1d39825-c911-4347-a557-f0ed07107823 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:53.975021 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c1d39825-c911-4347-a557-f0ed07107823 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:53.975686 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c1d39825-c911-4347-a557-f0ed07107823 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:53.976268 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c1d39825-c911-4347-a557-f0ed07107823 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] [instance: f92b0d2f-5a4d-4c52-9b91-4195c9e78b41] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:53.986306 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-eaea4e38-2bc3-4728-bbef-3fd64c9547ee tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:53.996976 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c1d39825-c911-4347-a557-f0ed07107823 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:53.997926 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c1d39825-c911-4347-a557-f0ed07107823 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:53.998733 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c1d39825-c911-4347-a557-f0ed07107823 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:54.000065 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-eaea4e38-2bc3-4728-bbef-3fd64c9547ee tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/10546b59-4576-4dd2-a915-53e194075a26" status: 200 len: 1317 microversion: 2.1 time: 0.386401 Sep 23 04:54:54.001053 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c1d39825-c911-4347-a557-f0ed07107823 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:54.001729 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c1d39825-c911-4347-a557-f0ed07107823 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:54.003588 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2532/5209] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:53 2022] GET /compute/v2.1/servers/10546b59-4576-4dd2-a915-53e194075a26 => generated 1317 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:54:54.019072 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c1d39825-c911-4347-a557-f0ed07107823 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:54.050016 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c1d39825-c911-4347-a557-f0ed07107823 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:54.050687 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c1d39825-c911-4347-a557-f0ed07107823 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:54.051317 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c1d39825-c911-4347-a557-f0ed07107823 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:54.180217 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-c1d39825-c911-4347-a557-f0ed07107823 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lazy-loading 'flavor' on Instance uuid f92b0d2f-5a4d-4c52-9b91-4195c9e78b41 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:54:54.233827 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c1d39825-c911-4347-a557-f0ed07107823 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f92b0d2f-5a4d-4c52-9b91-4195c9e78b41/tags" status: 204 len: 0 microversion: 2.26 time: 0.314669 Sep 23 04:54:54.235220 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2678/5210] 10.222.0.33 () {60 vars in 1295 bytes} [Fri Sep 23 04:54:53 2022] DELETE /compute/v2.1/servers/f92b0d2f-5a4d-4c52-9b91-4195c9e78b41/tags => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 23 04:54:54.245745 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d5961cd3-3fa4-40c6-b183-c9aeae5bea7e tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Calling method '.version_select at 0x7ff1baaf5820>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:54.263888 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d5961cd3-3fa4-40c6-b183-c9aeae5bea7e tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:54.264461 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d5961cd3-3fa4-40c6-b183-c9aeae5bea7e tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:54.264917 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d5961cd3-3fa4-40c6-b183-c9aeae5bea7e tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:54.283822 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d5961cd3-3fa4-40c6-b183-c9aeae5bea7e tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] 10.222.0.33 "GET /compute/v2.1/servers/f92b0d2f-5a4d-4c52-9b91-4195c9e78b41/tags" status: 200 len: 12 microversion: 2.26 time: 0.042795 Sep 23 04:54:54.285060 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2533/5211] 10.222.0.33 () {60 vars in 1292 bytes} [Fri Sep 23 04:54:54 2022] GET /compute/v2.1/servers/f92b0d2f-5a4d-4c52-9b91-4195c9e78b41/tags => generated 12 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:54:54.296263 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d31c1a09-01b4-49df-b8aa-33b18312f509 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Calling method '.version_select at 0x7ff1ba870b80>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:54.312089 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d31c1a09-01b4-49df-b8aa-33b18312f509 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:54.312790 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d31c1a09-01b4-49df-b8aa-33b18312f509 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:54.313368 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d31c1a09-01b4-49df-b8aa-33b18312f509 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:54.314281 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d31c1a09-01b4-49df-b8aa-33b18312f509 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] [instance: f92b0d2f-5a4d-4c52-9b91-4195c9e78b41] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:54.321909 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d31c1a09-01b4-49df-b8aa-33b18312f509 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:54.322459 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d31c1a09-01b4-49df-b8aa-33b18312f509 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:54.323030 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d31c1a09-01b4-49df-b8aa-33b18312f509 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:54.323882 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d31c1a09-01b4-49df-b8aa-33b18312f509 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:54.324642 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d31c1a09-01b4-49df-b8aa-33b18312f509 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:54.325359 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d31c1a09-01b4-49df-b8aa-33b18312f509 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:54.349031 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:54:54.361202 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d31c1a09-01b4-49df-b8aa-33b18312f509 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:54.361931 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d31c1a09-01b4-49df-b8aa-33b18312f509 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:54.362394 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d31c1a09-01b4-49df-b8aa-33b18312f509 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:54.375349 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d31c1a09-01b4-49df-b8aa-33b18312f509 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:54.376079 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d31c1a09-01b4-49df-b8aa-33b18312f509 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:54.376536 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d31c1a09-01b4-49df-b8aa-33b18312f509 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:54.495337 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-916d5004-6a4f-4792-8020-0fbf41aaf2fe tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:54.496273 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-916d5004-6a4f-4792-8020-0fbf41aaf2fe tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:54.511994 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-d31c1a09-01b4-49df-b8aa-33b18312f509 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lazy-loading 'flavor' on Instance uuid f92b0d2f-5a4d-4c52-9b91-4195c9e78b41 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:54:54.514365 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-916d5004-6a4f-4792-8020-0fbf41aaf2fe tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:54.515101 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-916d5004-6a4f-4792-8020-0fbf41aaf2fe tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:54.515765 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-916d5004-6a4f-4792-8020-0fbf41aaf2fe tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:54.516676 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-916d5004-6a4f-4792-8020-0fbf41aaf2fe tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:54.517329 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-916d5004-6a4f-4792-8020-0fbf41aaf2fe tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:54.517972 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-916d5004-6a4f-4792-8020-0fbf41aaf2fe tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:54.539525 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d31c1a09-01b4-49df-b8aa-33b18312f509 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] 10.222.0.33 "PUT /compute/v2.1/servers/f92b0d2f-5a4d-4c52-9b91-4195c9e78b41/tags/tempest-tag-534004741" status: 201 len: 0 microversion: 2.26 time: 0.247765 Sep 23 04:54:54.542081 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2679/5212] 10.222.0.33 () {62 vars in 1377 bytes} [Fri Sep 23 04:54:54 2022] PUT /compute/v2.1/servers/f92b0d2f-5a4d-4c52-9b91-4195c9e78b41/tags/tempest-tag-534004741 => generated 0 bytes in 251 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Sep 23 04:54:54.558213 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3c21129d-911b-4db3-8c7d-92eb9854a98f tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Calling method '.version_select at 0x7ff1ba80d790>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:54.568853 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3c21129d-911b-4db3-8c7d-92eb9854a98f tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:54.576362 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3c21129d-911b-4db3-8c7d-92eb9854a98f tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:54.576362 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3c21129d-911b-4db3-8c7d-92eb9854a98f tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:54.582009 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3c21129d-911b-4db3-8c7d-92eb9854a98f tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] 10.222.0.33 "GET /compute/v2.1/servers/f92b0d2f-5a4d-4c52-9b91-4195c9e78b41/tags" status: 200 len: 35 microversion: 2.26 time: 0.036015 Sep 23 04:54:54.583538 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2680/5213] 10.222.0.33 () {60 vars in 1292 bytes} [Fri Sep 23 04:54:54 2022] GET /compute/v2.1/servers/f92b0d2f-5a4d-4c52-9b91-4195c9e78b41/tags => generated 35 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:54:54.598743 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7e3be053-0a3b-4544-b738-17cd6c524af1 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Calling method '.version_select at 0x7ff1ba7ed310>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:54.608243 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7e3be053-0a3b-4544-b738-17cd6c524af1 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:54.609091 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7e3be053-0a3b-4544-b738-17cd6c524af1 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:54.609724 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7e3be053-0a3b-4544-b738-17cd6c524af1 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:54.610408 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-7e3be053-0a3b-4544-b738-17cd6c524af1 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] [instance: f92b0d2f-5a4d-4c52-9b91-4195c9e78b41] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:54.618131 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7e3be053-0a3b-4544-b738-17cd6c524af1 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:54.618857 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7e3be053-0a3b-4544-b738-17cd6c524af1 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:54.619611 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7e3be053-0a3b-4544-b738-17cd6c524af1 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:54.620528 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7e3be053-0a3b-4544-b738-17cd6c524af1 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:54.621153 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7e3be053-0a3b-4544-b738-17cd6c524af1 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:54.621783 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7e3be053-0a3b-4544-b738-17cd6c524af1 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:54.659882 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7e3be053-0a3b-4544-b738-17cd6c524af1 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:54.660643 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7e3be053-0a3b-4544-b738-17cd6c524af1 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:54.661250 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7e3be053-0a3b-4544-b738-17cd6c524af1 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:54.743094 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-7e3be053-0a3b-4544-b738-17cd6c524af1 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lazy-loading 'flavor' on Instance uuid f92b0d2f-5a4d-4c52-9b91-4195c9e78b41 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:54:54.773703 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-7e3be053-0a3b-4544-b738-17cd6c524af1 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f92b0d2f-5a4d-4c52-9b91-4195c9e78b41/tags/tempest-tag-534004741" status: 204 len: 0 microversion: 2.26 time: 0.182444 Sep 23 04:54:54.778122 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2681/5214] 10.222.0.33 () {60 vars in 1361 bytes} [Fri Sep 23 04:54:54 2022] DELETE /compute/v2.1/servers/f92b0d2f-5a4d-4c52-9b91-4195c9e78b41/tags/tempest-tag-534004741 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 23 04:54:54.783374 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a8d4ab7f-c6da-4878-afe1-a9fa1b8d1150 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:54.784944 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a8d4ab7f-c6da-4878-afe1-a9fa1b8d1150 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 4381aca2-ea30-4473-9cd3-18c9b64f1937] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:54.795008 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a8d4ab7f-c6da-4878-afe1-a9fa1b8d1150 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:54.796099 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a8d4ab7f-c6da-4878-afe1-a9fa1b8d1150 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:54.797540 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a8d4ab7f-c6da-4878-afe1-a9fa1b8d1150 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:54.799260 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a8d4ab7f-c6da-4878-afe1-a9fa1b8d1150 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:54.800127 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a8d4ab7f-c6da-4878-afe1-a9fa1b8d1150 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:54.801175 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a8d4ab7f-c6da-4878-afe1-a9fa1b8d1150 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:54.978658 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-916d5004-6a4f-4792-8020-0fbf41aaf2fe tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:54.988378 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-916d5004-6a4f-4792-8020-0fbf41aaf2fe tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1680 microversion: 2.1 time: 0.497691 Sep 23 04:54:54.988967 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2534/5215] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:54 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1680 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:54:55.017976 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d830de66-57cc-4058-b899-26d9a7e605fa tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Calling method '.version_select at 0x7ff1baa020d0>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:55.067255 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d830de66-57cc-4058-b899-26d9a7e605fa tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:55.068027 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d830de66-57cc-4058-b899-26d9a7e605fa tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:55.068636 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d830de66-57cc-4058-b899-26d9a7e605fa tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:55.083889 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d830de66-57cc-4058-b899-26d9a7e605fa tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] 10.222.0.33 "GET /compute/v2.1/servers/f92b0d2f-5a4d-4c52-9b91-4195c9e78b41/tags" status: 200 len: 12 microversion: 2.26 time: 0.088500 Sep 23 04:54:55.084533 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2535/5216] 10.222.0.33 () {60 vars in 1292 bytes} [Fri Sep 23 04:54:54 2022] GET /compute/v2.1/servers/f92b0d2f-5a4d-4c52-9b91-4195c9e78b41/tags => generated 12 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:54:55.089825 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-09a2b018-e8a3-4f93-bfb4-ad87b8bcd3ba tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:55.091034 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-09a2b018-e8a3-4f93-bfb4-ad87b8bcd3ba tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: 10546b59-4576-4dd2-a915-53e194075a26] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:55.107585 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-09a2b018-e8a3-4f93-bfb4-ad87b8bcd3ba tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:55.108106 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-09a2b018-e8a3-4f93-bfb4-ad87b8bcd3ba tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:55.108558 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-09a2b018-e8a3-4f93-bfb4-ad87b8bcd3ba tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:55.111805 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-09a2b018-e8a3-4f93-bfb4-ad87b8bcd3ba tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:55.111805 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-09a2b018-e8a3-4f93-bfb4-ad87b8bcd3ba tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:55.111805 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-09a2b018-e8a3-4f93-bfb4-ad87b8bcd3ba tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:55.339377 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a8d4ab7f-c6da-4878-afe1-a9fa1b8d1150 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:55.351570 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a8d4ab7f-c6da-4878-afe1-a9fa1b8d1150 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937" status: 200 len: 1696 microversion: 2.1 time: 0.572923 Sep 23 04:54:55.367647 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2682/5217] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:54 2022] GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937 => generated 1696 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:54:55.375294 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e363afb2-26a1-4f92-9921-a057fdda687f tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Calling method '.version_select at 0x7ff1ba8fda60>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:55.385463 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e363afb2-26a1-4f92-9921-a057fdda687f tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:55.386215 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e363afb2-26a1-4f92-9921-a057fdda687f tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:55.386825 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e363afb2-26a1-4f92-9921-a057fdda687f tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:55.387561 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e363afb2-26a1-4f92-9921-a057fdda687f tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] [instance: f92b0d2f-5a4d-4c52-9b91-4195c9e78b41] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:55.397136 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e363afb2-26a1-4f92-9921-a057fdda687f tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:55.397136 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e363afb2-26a1-4f92-9921-a057fdda687f tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:55.397136 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e363afb2-26a1-4f92-9921-a057fdda687f tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:55.398386 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e363afb2-26a1-4f92-9921-a057fdda687f tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:55.399115 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e363afb2-26a1-4f92-9921-a057fdda687f tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:55.399674 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e363afb2-26a1-4f92-9921-a057fdda687f tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:55.449926 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e363afb2-26a1-4f92-9921-a057fdda687f tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:55.450507 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e363afb2-26a1-4f92-9921-a057fdda687f tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:55.451613 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e363afb2-26a1-4f92-9921-a057fdda687f tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:55.476007 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-e363afb2-26a1-4f92-9921-a057fdda687f tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lazy-loading 'flavor' on Instance uuid f92b0d2f-5a4d-4c52-9b91-4195c9e78b41 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:54:55.480345 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-09a2b018-e8a3-4f93-bfb4-ad87b8bcd3ba tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:55.483919 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=100 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:54:55.500010 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-09a2b018-e8a3-4f93-bfb4-ad87b8bcd3ba tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/10546b59-4576-4dd2-a915-53e194075a26" status: 200 len: 1506 microversion: 2.1 time: 0.413738 Sep 23 04:54:55.501134 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2536/5218] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:55 2022] GET /compute/v2.1/servers/10546b59-4576-4dd2-a915-53e194075a26 => generated 1506 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:54:55.535217 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f38ea392-72c0-492c-9179-be1b9299bc68 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:55.538937 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f38ea392-72c0-492c-9179-be1b9299bc68 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: 10546b59-4576-4dd2-a915-53e194075a26] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:55.547451 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e363afb2-26a1-4f92-9921-a057fdda687f tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f92b0d2f-5a4d-4c52-9b91-4195c9e78b41/tags" status: 204 len: 0 microversion: 2.26 time: 0.178304 Sep 23 04:54:55.548326 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2683/5219] 10.222.0.33 () {60 vars in 1295 bytes} [Fri Sep 23 04:54:55 2022] DELETE /compute/v2.1/servers/f92b0d2f-5a4d-4c52-9b91-4195c9e78b41/tags => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 23 04:54:55.558250 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0568c245-f8ab-4aa7-911b-b266a28f19e4 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Calling method '.version_select at 0x7ff1ba828670>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:55.568543 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f38ea392-72c0-492c-9179-be1b9299bc68 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:55.569098 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f38ea392-72c0-492c-9179-be1b9299bc68 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:55.569556 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f38ea392-72c0-492c-9179-be1b9299bc68 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:55.570327 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f38ea392-72c0-492c-9179-be1b9299bc68 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:55.571014 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f38ea392-72c0-492c-9179-be1b9299bc68 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:55.571684 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f38ea392-72c0-492c-9179-be1b9299bc68 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:55.584318 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0568c245-f8ab-4aa7-911b-b266a28f19e4 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:55.585523 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0568c245-f8ab-4aa7-911b-b266a28f19e4 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:55.588011 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0568c245-f8ab-4aa7-911b-b266a28f19e4 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:55.588998 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-0568c245-f8ab-4aa7-911b-b266a28f19e4 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] [instance: f92b0d2f-5a4d-4c52-9b91-4195c9e78b41] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:55.607601 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0568c245-f8ab-4aa7-911b-b266a28f19e4 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:55.608518 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0568c245-f8ab-4aa7-911b-b266a28f19e4 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:55.609226 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0568c245-f8ab-4aa7-911b-b266a28f19e4 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:55.610231 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0568c245-f8ab-4aa7-911b-b266a28f19e4 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:55.611007 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0568c245-f8ab-4aa7-911b-b266a28f19e4 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:55.611671 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0568c245-f8ab-4aa7-911b-b266a28f19e4 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:55.670154 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0568c245-f8ab-4aa7-911b-b266a28f19e4 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:55.673633 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0568c245-f8ab-4aa7-911b-b266a28f19e4 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:55.674429 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0568c245-f8ab-4aa7-911b-b266a28f19e4 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:55.694347 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0568c245-f8ab-4aa7-911b-b266a28f19e4 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:55.694853 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0568c245-f8ab-4aa7-911b-b266a28f19e4 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:55.695327 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0568c245-f8ab-4aa7-911b-b266a28f19e4 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:55.824209 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-0568c245-f8ab-4aa7-911b-b266a28f19e4 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lazy-loading 'flavor' on Instance uuid f92b0d2f-5a4d-4c52-9b91-4195c9e78b41 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:54:55.825676 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f38ea392-72c0-492c-9179-be1b9299bc68 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:55.834050 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f38ea392-72c0-492c-9179-be1b9299bc68 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/10546b59-4576-4dd2-a915-53e194075a26" status: 200 len: 1506 microversion: 2.1 time: 0.302838 Sep 23 04:54:55.845478 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2537/5220] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:55 2022] GET /compute/v2.1/servers/10546b59-4576-4dd2-a915-53e194075a26 => generated 1506 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:54:55.857204 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0568c245-f8ab-4aa7-911b-b266a28f19e4 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] 10.222.0.33 "PUT /compute/v2.1/servers/f92b0d2f-5a4d-4c52-9b91-4195c9e78b41/tags/tempest-tag-2009952277" status: 201 len: 0 microversion: 2.26 time: 0.303436 Sep 23 04:54:55.867741 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3d7a9653-24c4-4447-8f3d-389401978542 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:54:55.867923 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2684/5221] 10.222.0.33 () {62 vars in 1380 bytes} [Fri Sep 23 04:54:55 2022] PUT /compute/v2.1/servers/f92b0d2f-5a4d-4c52-9b91-4195c9e78b41/tags/tempest-tag-2009952277 => generated 0 bytes in 306 msecs (HTTP/1.1 201) 10 headers in 486 bytes (2 switches on core 0) Sep 23 04:54:55.868038 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3d7a9653-24c4-4447-8f3d-389401978542 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: 10546b59-4576-4dd2-a915-53e194075a26] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:55.870420 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3d7a9653-24c4-4447-8f3d-389401978542 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:55.871531 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3d7a9653-24c4-4447-8f3d-389401978542 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:55.872180 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3d7a9653-24c4-4447-8f3d-389401978542 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:55.873269 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3d7a9653-24c4-4447-8f3d-389401978542 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:55.873926 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3d7a9653-24c4-4447-8f3d-389401978542 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:55.874541 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3d7a9653-24c4-4447-8f3d-389401978542 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:55.883002 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5edaba33-06ff-46d4-a205-fce4b715484e tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Calling method '.version_select at 0x7ff1ba8070d0>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:55.910400 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5edaba33-06ff-46d4-a205-fce4b715484e tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:55.911226 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5edaba33-06ff-46d4-a205-fce4b715484e tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:55.911679 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5edaba33-06ff-46d4-a205-fce4b715484e tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:55.912170 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-5edaba33-06ff-46d4-a205-fce4b715484e tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] [instance: f92b0d2f-5a4d-4c52-9b91-4195c9e78b41] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:55.930142 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5edaba33-06ff-46d4-a205-fce4b715484e tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:55.930624 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5edaba33-06ff-46d4-a205-fce4b715484e tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:55.931074 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5edaba33-06ff-46d4-a205-fce4b715484e tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:55.931805 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5edaba33-06ff-46d4-a205-fce4b715484e tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:55.932273 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5edaba33-06ff-46d4-a205-fce4b715484e tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:55.932696 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5edaba33-06ff-46d4-a205-fce4b715484e tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:55.979970 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5edaba33-06ff-46d4-a205-fce4b715484e tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:55.980580 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5edaba33-06ff-46d4-a205-fce4b715484e tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:55.980917 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5edaba33-06ff-46d4-a205-fce4b715484e tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:56.004473 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5edaba33-06ff-46d4-a205-fce4b715484e tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:56.007392 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5edaba33-06ff-46d4-a205-fce4b715484e tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:56.008910 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5edaba33-06ff-46d4-a205-fce4b715484e tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:56.136326 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3d7a9653-24c4-4447-8f3d-389401978542 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "PUT /compute/v2.1/servers/10546b59-4576-4dd2-a915-53e194075a26" status: 200 len: 1078 microversion: 2.1 time: 0.281584 Sep 23 04:54:56.138270 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2538/5222] 10.222.0.33 () {60 vars in 1256 bytes} [Fri Sep 23 04:54:55 2022] PUT /compute/v2.1/servers/10546b59-4576-4dd2-a915-53e194075a26 => generated 1078 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:54:56.145741 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-12e75fd0-d896-4e1a-bffb-827edc3e8913 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:56.146800 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-12e75fd0-d896-4e1a-bffb-827edc3e8913 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:56.158534 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-12e75fd0-d896-4e1a-bffb-827edc3e8913 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:56.160373 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-12e75fd0-d896-4e1a-bffb-827edc3e8913 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:56.161620 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-12e75fd0-d896-4e1a-bffb-827edc3e8913 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:56.163090 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-12e75fd0-d896-4e1a-bffb-827edc3e8913 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:56.163816 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-12e75fd0-d896-4e1a-bffb-827edc3e8913 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:56.164586 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-12e75fd0-d896-4e1a-bffb-827edc3e8913 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:56.166406 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-5edaba33-06ff-46d4-a205-fce4b715484e tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lazy-loading 'flavor' on Instance uuid f92b0d2f-5a4d-4c52-9b91-4195c9e78b41 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:54:56.211970 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5edaba33-06ff-46d4-a205-fce4b715484e tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] 10.222.0.33 "PUT /compute/v2.1/servers/f92b0d2f-5a4d-4c52-9b91-4195c9e78b41/tags/tempest-tag-336835071" status: 201 len: 0 microversion: 2.26 time: 0.333505 Sep 23 04:54:56.214504 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2685/5223] 10.222.0.33 () {62 vars in 1377 bytes} [Fri Sep 23 04:54:55 2022] PUT /compute/v2.1/servers/f92b0d2f-5a4d-4c52-9b91-4195c9e78b41/tags/tempest-tag-336835071 => generated 0 bytes in 341 msecs (HTTP/1.1 201) 10 headers in 485 bytes (2 switches on core 0) Sep 23 04:54:56.229623 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5c17e7c2-5316-4029-bafc-1c45c26e514b tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:56.249529 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-5c17e7c2-5316-4029-bafc-1c45c26e514b tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: 10546b59-4576-4dd2-a915-53e194075a26] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:56.278265 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5c17e7c2-5316-4029-bafc-1c45c26e514b tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:56.278892 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5c17e7c2-5316-4029-bafc-1c45c26e514b tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:56.281781 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5c17e7c2-5316-4029-bafc-1c45c26e514b tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:56.282733 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5c17e7c2-5316-4029-bafc-1c45c26e514b tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:56.287456 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5c17e7c2-5316-4029-bafc-1c45c26e514b tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:56.291298 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5c17e7c2-5316-4029-bafc-1c45c26e514b tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:56.546420 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-12e75fd0-d896-4e1a-bffb-827edc3e8913 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:56.576440 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-12e75fd0-d896-4e1a-bffb-827edc3e8913 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1680 microversion: 2.1 time: 0.432015 Sep 23 04:54:56.587827 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2539/5224] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:56 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1680 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:54:56.596994 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b2b26eb1-c451-4824-8cfa-63139657d835 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Calling method '.version_select at 0x7ff1baaf5670>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:56.605478 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b2b26eb1-c451-4824-8cfa-63139657d835 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:56.606014 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b2b26eb1-c451-4824-8cfa-63139657d835 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:56.606834 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b2b26eb1-c451-4824-8cfa-63139657d835 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:56.607502 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b2b26eb1-c451-4824-8cfa-63139657d835 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] [instance: f92b0d2f-5a4d-4c52-9b91-4195c9e78b41] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:56.610391 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-5c17e7c2-5316-4029-bafc-1c45c26e514b tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:56.614701 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b2b26eb1-c451-4824-8cfa-63139657d835 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:56.615365 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b2b26eb1-c451-4824-8cfa-63139657d835 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:56.616032 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b2b26eb1-c451-4824-8cfa-63139657d835 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:56.616906 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b2b26eb1-c451-4824-8cfa-63139657d835 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:56.617525 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b2b26eb1-c451-4824-8cfa-63139657d835 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:56.618154 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b2b26eb1-c451-4824-8cfa-63139657d835 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:56.618650 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5c17e7c2-5316-4029-bafc-1c45c26e514b tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/10546b59-4576-4dd2-a915-53e194075a26" status: 200 len: 1504 microversion: 2.1 time: 0.404624 Sep 23 04:54:56.621932 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2686/5225] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:56 2022] GET /compute/v2.1/servers/10546b59-4576-4dd2-a915-53e194075a26 => generated 1504 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:54:56.627755 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f40eb367-3ee6-418d-9372-7b9d0d650541 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1693826805", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b3d6df46-361b-46bb-b716-e96a928809dc"}], "security_groups": [{"name": "tempest-securitygroup--890644421"}], "key_name": "tempest-keypair-2084242172", "user_data": "}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:54:56.695994 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b2b26eb1-c451-4824-8cfa-63139657d835 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:56.697347 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b2b26eb1-c451-4824-8cfa-63139657d835 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:56.698163 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b2b26eb1-c451-4824-8cfa-63139657d835 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:56.791879 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.neutron [None req-f40eb367-3ee6-418d-9372-7b9d0d650541 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] validate_networks() for [('b3d6df46-361b-46bb-b716-e96a928809dc', None, None, None, None, None)] {{(pid=122699) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:54:56.808504 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-b2b26eb1-c451-4824-8cfa-63139657d835 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lazy-loading 'flavor' on Instance uuid f92b0d2f-5a4d-4c52-9b91-4195c9e78b41 {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:54:56.836902 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b2b26eb1-c451-4824-8cfa-63139657d835 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f92b0d2f-5a4d-4c52-9b91-4195c9e78b41/tags" status: 204 len: 0 microversion: 2.26 time: 0.241656 Sep 23 04:54:56.842678 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2540/5226] 10.222.0.33 () {60 vars in 1295 bytes} [Fri Sep 23 04:54:56 2022] DELETE /compute/v2.1/servers/f92b0d2f-5a4d-4c52-9b91-4195c9e78b41/tags => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 23 04:54:56.853364 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ff83b845-03ef-4bc8-9f9a-816d035a672e tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:56.855941 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-ff83b845-03ef-4bc8-9f9a-816d035a672e tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 4381aca2-ea30-4473-9cd3-18c9b64f1937] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:56.872821 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ff83b845-03ef-4bc8-9f9a-816d035a672e tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:56.876443 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ff83b845-03ef-4bc8-9f9a-816d035a672e tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:56.877093 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ff83b845-03ef-4bc8-9f9a-816d035a672e tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:56.877858 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ff83b845-03ef-4bc8-9f9a-816d035a672e tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:56.878361 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ff83b845-03ef-4bc8-9f9a-816d035a672e tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:56.878800 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ff83b845-03ef-4bc8-9f9a-816d035a672e tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:57.659940 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ff83b845-03ef-4bc8-9f9a-816d035a672e tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:57.671182 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ff83b845-03ef-4bc8-9f9a-816d035a672e tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937" status: 200 len: 1694 microversion: 2.1 time: 0.825088 Sep 23 04:54:57.671776 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2541/5227] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:56 2022] GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937 => generated 1694 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:54:57.684194 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-906616eb-acdf-42cb-bc18-a2fdf67ad3f3 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:57.686760 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-906616eb-acdf-42cb-bc18-a2fdf67ad3f3 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: 10546b59-4576-4dd2-a915-53e194075a26] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:57.703619 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-906616eb-acdf-42cb-bc18-a2fdf67ad3f3 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:57.704365 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-906616eb-acdf-42cb-bc18-a2fdf67ad3f3 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:57.705007 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-906616eb-acdf-42cb-bc18-a2fdf67ad3f3 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:57.707227 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-906616eb-acdf-42cb-bc18-a2fdf67ad3f3 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:57.715561 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-906616eb-acdf-42cb-bc18-a2fdf67ad3f3 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:57.716271 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-906616eb-acdf-42cb-bc18-a2fdf67ad3f3 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:58.119939 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-f40eb367-3ee6-418d-9372-7b9d0d650541 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Flavor limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:54:58.121737 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-f40eb367-3ee6-418d-9372-7b9d0d650541 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Image limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:54:58.122531 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-f40eb367-3ee6-418d-9372-7b9d0d650541 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Flavor pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:54:58.123213 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-f40eb367-3ee6-418d-9372-7b9d0d650541 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Image pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:54:58.123832 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-f40eb367-3ee6-418d-9372-7b9d0d650541 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:54:58.150342 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f40eb367-3ee6-418d-9372-7b9d0d650541 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:58.151276 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f40eb367-3ee6-418d-9372-7b9d0d650541 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:58.152944 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f40eb367-3ee6-418d-9372-7b9d0d650541 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:58.155153 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-906616eb-acdf-42cb-bc18-a2fdf67ad3f3 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:58.155613 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f40eb367-3ee6-418d-9372-7b9d0d650541 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:58.156413 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f40eb367-3ee6-418d-9372-7b9d0d650541 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:58.157017 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f40eb367-3ee6-418d-9372-7b9d0d650541 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:58.167541 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-906616eb-acdf-42cb-bc18-a2fdf67ad3f3 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/10546b59-4576-4dd2-a915-53e194075a26" status: 200 len: 1504 microversion: 2.1 time: 0.487150 Sep 23 04:54:58.168146 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2542/5228] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:57 2022] GET /compute/v2.1/servers/10546b59-4576-4dd2-a915-53e194075a26 => generated 1504 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:54:58.176999 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-91707250-31dd-4199-b442-70a07a222f73 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Calling method '.version_select at 0x7ff1ba8c8280>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:58.189613 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-f40eb367-3ee6-418d-9372-7b9d0d650541 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Getting quotas for project 71874a329e54494bb1b84f31c3826205. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:54:58.195673 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-91707250-31dd-4199-b442-70a07a222f73 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:58.196177 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-91707250-31dd-4199-b442-70a07a222f73 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:58.196631 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-91707250-31dd-4199-b442-70a07a222f73 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:58.197293 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-f40eb367-3ee6-418d-9372-7b9d0d650541 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Getting quotas for user d1bde73a530f4666aebdd5f7d9fa1046 and project 71874a329e54494bb1b84f31c3826205. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:54:58.216971 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f40eb367-3ee6-418d-9372-7b9d0d650541 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Going to run 1 instances... {{(pid=122699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:54:58.223747 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-91707250-31dd-4199-b442-70a07a222f73 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] 10.222.0.33 "GET /compute/v2.1/servers/f92b0d2f-5a4d-4c52-9b91-4195c9e78b41/tags" status: 200 len: 12 microversion: 2.26 time: 0.052629 Sep 23 04:54:58.223747 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2543/5229] 10.222.0.33 () {60 vars in 1292 bytes} [Fri Sep 23 04:54:58 2022] GET /compute/v2.1/servers/f92b0d2f-5a4d-4c52-9b91-4195c9e78b41/tags => generated 12 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:54:58.224306 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f40eb367-3ee6-418d-9372-7b9d0d650541 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] [instance: 6dfb2418-b235-4d35-b109-4bed20d1b96e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:54:58.238851 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-14f3fd47-d5f2-4792-90f6-ac171f62268b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:58.240619 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-14f3fd47-d5f2-4792-90f6-ac171f62268b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:58.258114 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-14f3fd47-d5f2-4792-90f6-ac171f62268b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:58.260159 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-14f3fd47-d5f2-4792-90f6-ac171f62268b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:58.261590 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-14f3fd47-d5f2-4792-90f6-ac171f62268b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:58.265895 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-14f3fd47-d5f2-4792-90f6-ac171f62268b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:58.266757 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-14f3fd47-d5f2-4792-90f6-ac171f62268b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:58.270051 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-14f3fd47-d5f2-4792-90f6-ac171f62268b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:58.400914 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f40eb367-3ee6-418d-9372-7b9d0d650541 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.777596 Sep 23 04:54:58.404135 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2687/5230] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:54:56 2022] POST /compute/v2.1/servers => generated 401 bytes in 1781 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:54:58.420615 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0ed432f8-80db-42ea-83d0-dd5b0c213578 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:54:58.423532 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-0ed432f8-80db-42ea-83d0-dd5b0c213578 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: 10546b59-4576-4dd2-a915-53e194075a26] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:58.438452 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0ed432f8-80db-42ea-83d0-dd5b0c213578 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:58.440073 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0ed432f8-80db-42ea-83d0-dd5b0c213578 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:58.440848 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0ed432f8-80db-42ea-83d0-dd5b0c213578 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:58.442210 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0ed432f8-80db-42ea-83d0-dd5b0c213578 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:58.442860 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0ed432f8-80db-42ea-83d0-dd5b0c213578 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:58.443860 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0ed432f8-80db-42ea-83d0-dd5b0c213578 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:58.599604 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0ed432f8-80db-42ea-83d0-dd5b0c213578 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "PUT /compute/v2.1/servers/10546b59-4576-4dd2-a915-53e194075a26" status: 200 len: 1080 microversion: 2.1 time: 0.192121 Sep 23 04:54:58.613979 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2688/5231] 10.222.0.33 () {60 vars in 1256 bytes} [Fri Sep 23 04:54:58 2022] PUT /compute/v2.1/servers/10546b59-4576-4dd2-a915-53e194075a26 => generated 1080 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:54:58.618897 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-17b225d0-03c7-4f8d-9851-8acbb0541671 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Calling method '.version_select at 0x7ff1ba7d5af0>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:58.640281 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-17b225d0-03c7-4f8d-9851-8acbb0541671 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:58.643035 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-17b225d0-03c7-4f8d-9851-8acbb0541671 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:58.644679 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-17b225d0-03c7-4f8d-9851-8acbb0541671 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:58.645241 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-17b225d0-03c7-4f8d-9851-8acbb0541671 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] [instance: f92b0d2f-5a4d-4c52-9b91-4195c9e78b41] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:58.661788 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-17b225d0-03c7-4f8d-9851-8acbb0541671 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:58.663587 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-17b225d0-03c7-4f8d-9851-8acbb0541671 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:58.664058 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-17b225d0-03c7-4f8d-9851-8acbb0541671 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:58.669331 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-17b225d0-03c7-4f8d-9851-8acbb0541671 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:58.669881 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-17b225d0-03c7-4f8d-9851-8acbb0541671 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:58.670369 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-17b225d0-03c7-4f8d-9851-8acbb0541671 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:58.720216 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-17b225d0-03c7-4f8d-9851-8acbb0541671 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:58.720726 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-17b225d0-03c7-4f8d-9851-8acbb0541671 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:58.721823 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-17b225d0-03c7-4f8d-9851-8acbb0541671 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:58.727973 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=88,nova_cell1:SAVEPOINT=3,nova_cell1:INSERT=3,nova_cell1:RELEASE=3,nova_cell1:DELETE=2,nova_cell1:UPDATE=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:54:58.739797 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-17b225d0-03c7-4f8d-9851-8acbb0541671 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lazy-loading 'flavor' on Instance uuid f92b0d2f-5a4d-4c52-9b91-4195c9e78b41 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:54:58.773317 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-17b225d0-03c7-4f8d-9851-8acbb0541671 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f92b0d2f-5a4d-4c52-9b91-4195c9e78b41/tags" status: 204 len: 0 microversion: 2.26 time: 0.168919 Sep 23 04:54:58.791749 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2689/5232] 10.222.0.33 () {60 vars in 1295 bytes} [Fri Sep 23 04:54:58 2022] DELETE /compute/v2.1/servers/f92b0d2f-5a4d-4c52-9b91-4195c9e78b41/tags => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 23 04:54:58.803904 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8ddaa699-4736-4a21-8aa5-620d2c8637d1 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:58.806265 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-8ddaa699-4736-4a21-8aa5-620d2c8637d1 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] [instance: 6dfb2418-b235-4d35-b109-4bed20d1b96e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:58.909031 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-8ddaa699-4736-4a21-8aa5-620d2c8637d1 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bde73a530f4666aebdd5f7d9fa1046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71874a329e54494bb1b84f31c3826205', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:58.920962 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-8ddaa699-4736-4a21-8aa5-620d2c8637d1 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] 10.222.0.33 "GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e" status: 200 len: 1238 microversion: 2.1 time: 0.127991 Sep 23 04:54:58.931137 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2690/5233] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:58 2022] GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e => generated 1238 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:54:58.937097 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0469ac8a-f625-4d83-b79b-309649a10a3a tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:58.937097 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-0469ac8a-f625-4d83-b79b-309649a10a3a tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: 10546b59-4576-4dd2-a915-53e194075a26] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:58.942943 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0469ac8a-f625-4d83-b79b-309649a10a3a tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:58.943710 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0469ac8a-f625-4d83-b79b-309649a10a3a tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:58.944367 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0469ac8a-f625-4d83-b79b-309649a10a3a tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:58.945267 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0469ac8a-f625-4d83-b79b-309649a10a3a tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:58.945948 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0469ac8a-f625-4d83-b79b-309649a10a3a tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:58.946366 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0469ac8a-f625-4d83-b79b-309649a10a3a tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:58.995892 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-14f3fd47-d5f2-4792-90f6-ac171f62268b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:59.005821 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-14f3fd47-d5f2-4792-90f6-ac171f62268b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1680 microversion: 2.1 time: 0.777143 Sep 23 04:54:59.006494 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2544/5234] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:58 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1680 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:54:59.011531 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d1273ac9-9090-4635-a37e-e385c661c331 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:59.016046 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d1273ac9-9090-4635-a37e-e385c661c331 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 4381aca2-ea30-4473-9cd3-18c9b64f1937] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:59.024840 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d1273ac9-9090-4635-a37e-e385c661c331 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:59.026729 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d1273ac9-9090-4635-a37e-e385c661c331 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:59.027379 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d1273ac9-9090-4635-a37e-e385c661c331 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:59.028300 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d1273ac9-9090-4635-a37e-e385c661c331 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:59.028929 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d1273ac9-9090-4635-a37e-e385c661c331 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:59.032592 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d1273ac9-9090-4635-a37e-e385c661c331 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:59.346365 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-0469ac8a-f625-4d83-b79b-309649a10a3a tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:59.367731 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0469ac8a-f625-4d83-b79b-309649a10a3a tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/10546b59-4576-4dd2-a915-53e194075a26" status: 200 len: 1506 microversion: 2.1 time: 0.435301 Sep 23 04:54:59.378108 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2691/5235] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:58 2022] GET /compute/v2.1/servers/10546b59-4576-4dd2-a915-53e194075a26 => generated 1506 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:54:59.378108 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-37c1c08c-1034-423d-8ef9-6f31324878da tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Calling method '.version_select at 0x7ff1ba7f7dc0>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:59.415416 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-37c1c08c-1034-423d-8ef9-6f31324878da tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:59.429076 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-37c1c08c-1034-423d-8ef9-6f31324878da tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:59.429688 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-37c1c08c-1034-423d-8ef9-6f31324878da tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:59.430221 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-37c1c08c-1034-423d-8ef9-6f31324878da tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] [instance: f92b0d2f-5a4d-4c52-9b91-4195c9e78b41] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:59.450478 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-37c1c08c-1034-423d-8ef9-6f31324878da tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:59.450983 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-37c1c08c-1034-423d-8ef9-6f31324878da tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:59.451430 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-37c1c08c-1034-423d-8ef9-6f31324878da tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:59.452185 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-37c1c08c-1034-423d-8ef9-6f31324878da tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:59.452649 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-37c1c08c-1034-423d-8ef9-6f31324878da tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:59.467036 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-37c1c08c-1034-423d-8ef9-6f31324878da tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:59.472565 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d1273ac9-9090-4635-a37e-e385c661c331 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:59.487113 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d1273ac9-9090-4635-a37e-e385c661c331 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937" status: 200 len: 1691 microversion: 2.1 time: 0.479365 Sep 23 04:54:59.487975 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2545/5236] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:59 2022] GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937 => generated 1691 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:54:59.500337 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5f9e1032-51d2-4f76-a9b0-6e286a0028e3 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:59.502597 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5f9e1032-51d2-4f76-a9b0-6e286a0028e3 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: 10546b59-4576-4dd2-a915-53e194075a26] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:59.516399 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5f9e1032-51d2-4f76-a9b0-6e286a0028e3 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:59.516916 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5f9e1032-51d2-4f76-a9b0-6e286a0028e3 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:59.517632 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5f9e1032-51d2-4f76-a9b0-6e286a0028e3 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:59.519264 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5f9e1032-51d2-4f76-a9b0-6e286a0028e3 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:59.522624 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5f9e1032-51d2-4f76-a9b0-6e286a0028e3 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:59.522624 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5f9e1032-51d2-4f76-a9b0-6e286a0028e3 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:59.540918 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-37c1c08c-1034-423d-8ef9-6f31324878da tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:59.541490 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-37c1c08c-1034-423d-8ef9-6f31324878da tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:59.541964 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-37c1c08c-1034-423d-8ef9-6f31324878da tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:59.559461 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-37c1c08c-1034-423d-8ef9-6f31324878da tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:59.559991 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-37c1c08c-1034-423d-8ef9-6f31324878da tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:59.560438 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-37c1c08c-1034-423d-8ef9-6f31324878da tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:59.667581 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-37c1c08c-1034-423d-8ef9-6f31324878da tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lazy-loading 'flavor' on Instance uuid f92b0d2f-5a4d-4c52-9b91-4195c9e78b41 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:54:59.691969 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-37c1c08c-1034-423d-8ef9-6f31324878da tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] 10.222.0.33 "PUT /compute/v2.1/servers/f92b0d2f-5a4d-4c52-9b91-4195c9e78b41/tags/tempest-tag-71342866" status: 201 len: 0 microversion: 2.26 time: 0.321362 Sep 23 04:54:59.692823 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2692/5237] 10.222.0.33 () {62 vars in 1374 bytes} [Fri Sep 23 04:54:59 2022] PUT /compute/v2.1/servers/f92b0d2f-5a4d-4c52-9b91-4195c9e78b41/tags/tempest-tag-71342866 => generated 0 bytes in 323 msecs (HTTP/1.1 201) 10 headers in 484 bytes (1 switches on core 0) Sep 23 04:54:59.698362 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-77e691b5-3770-443e-8d7f-76ec64350c4c tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:54:59.699466 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-77e691b5-3770-443e-8d7f-76ec64350c4c tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 4381aca2-ea30-4473-9cd3-18c9b64f1937] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:59.706606 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-77e691b5-3770-443e-8d7f-76ec64350c4c tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:59.707557 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-77e691b5-3770-443e-8d7f-76ec64350c4c tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:59.708017 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-77e691b5-3770-443e-8d7f-76ec64350c4c tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:59.708836 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-77e691b5-3770-443e-8d7f-76ec64350c4c tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:59.710205 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-77e691b5-3770-443e-8d7f-76ec64350c4c tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:59.710430 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-77e691b5-3770-443e-8d7f-76ec64350c4c tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:59.870545 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-5f9e1032-51d2-4f76-a9b0-6e286a0028e3 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:54:59.880480 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5f9e1032-51d2-4f76-a9b0-6e286a0028e3 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/10546b59-4576-4dd2-a915-53e194075a26" status: 200 len: 1506 microversion: 2.1 time: 0.384868 Sep 23 04:54:59.882562 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2546/5238] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:54:59 2022] GET /compute/v2.1/servers/10546b59-4576-4dd2-a915-53e194075a26 => generated 1506 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:54:59.889313 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e97c01c7-e6b0-4c37-9be0-d3a6d1c0b626 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Calling method '.version_select at 0x7ff1baa02a60>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:59.900795 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e97c01c7-e6b0-4c37-9be0-d3a6d1c0b626 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:59.901810 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e97c01c7-e6b0-4c37-9be0-d3a6d1c0b626 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:59.905688 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e97c01c7-e6b0-4c37-9be0-d3a6d1c0b626 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:59.905688 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e97c01c7-e6b0-4c37-9be0-d3a6d1c0b626 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] [instance: f92b0d2f-5a4d-4c52-9b91-4195c9e78b41] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:59.911760 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e97c01c7-e6b0-4c37-9be0-d3a6d1c0b626 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:59.912603 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e97c01c7-e6b0-4c37-9be0-d3a6d1c0b626 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:59.913550 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e97c01c7-e6b0-4c37-9be0-d3a6d1c0b626 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:59.914996 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e97c01c7-e6b0-4c37-9be0-d3a6d1c0b626 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:59.915680 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e97c01c7-e6b0-4c37-9be0-d3a6d1c0b626 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:59.916511 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e97c01c7-e6b0-4c37-9be0-d3a6d1c0b626 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:59.932872 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-77e691b5-3770-443e-8d7f-76ec64350c4c tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "POST /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937/action" status: 204 len: 0 microversion: 2.1 time: 0.238990 Sep 23 04:54:59.936122 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2693/5239] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:54:59 2022] POST /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937/action => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:54:59.960074 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4d3a7e1d-bf76-4281-9092-d20cf56e83f5 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:54:59.962170 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4d3a7e1d-bf76-4281-9092-d20cf56e83f5 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: 10546b59-4576-4dd2-a915-53e194075a26] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:54:59.975524 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4d3a7e1d-bf76-4281-9092-d20cf56e83f5 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:59.976291 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4d3a7e1d-bf76-4281-9092-d20cf56e83f5 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:59.981023 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4d3a7e1d-bf76-4281-9092-d20cf56e83f5 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:59.981023 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4d3a7e1d-bf76-4281-9092-d20cf56e83f5 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:59.981023 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4d3a7e1d-bf76-4281-9092-d20cf56e83f5 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:59.981023 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4d3a7e1d-bf76-4281-9092-d20cf56e83f5 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:54:59.991696 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e97c01c7-e6b0-4c37-9be0-d3a6d1c0b626 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:54:59.995722 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e97c01c7-e6b0-4c37-9be0-d3a6d1c0b626 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:54:59.996786 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e97c01c7-e6b0-4c37-9be0-d3a6d1c0b626 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:00.023496 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4d3a7e1d-bf76-4281-9092-d20cf56e83f5 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: 10546b59-4576-4dd2-a915-53e194075a26] Going to try to terminate instance {{(pid=122699) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:55:00.027033 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e97c01c7-e6b0-4c37-9be0-d3a6d1c0b626 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:00.027033 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e97c01c7-e6b0-4c37-9be0-d3a6d1c0b626 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:00.027544 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e97c01c7-e6b0-4c37-9be0-d3a6d1c0b626 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:00.109878 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-e97c01c7-e6b0-4c37-9be0-d3a6d1c0b626 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lazy-loading 'flavor' on Instance uuid f92b0d2f-5a4d-4c52-9b91-4195c9e78b41 {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:55:00.129195 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e97c01c7-e6b0-4c37-9be0-d3a6d1c0b626 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] 10.222.0.33 "PUT /compute/v2.1/servers/f92b0d2f-5a4d-4c52-9b91-4195c9e78b41/tags/tempest-tag-1369219788" status: 201 len: 0 microversion: 2.26 time: 0.244614 Sep 23 04:55:00.130516 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2547/5240] 10.222.0.33 () {62 vars in 1380 bytes} [Fri Sep 23 04:54:59 2022] PUT /compute/v2.1/servers/f92b0d2f-5a4d-4c52-9b91-4195c9e78b41/tags/tempest-tag-1369219788 => generated 0 bytes in 247 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Sep 23 04:55:00.136515 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5530e6f5-e2e7-428b-bbe9-ed2f8d6ea3e9 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:00.137562 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5530e6f5-e2e7-428b-bbe9-ed2f8d6ea3e9 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 4381aca2-ea30-4473-9cd3-18c9b64f1937] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:00.144400 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5530e6f5-e2e7-428b-bbe9-ed2f8d6ea3e9 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:00.145157 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5530e6f5-e2e7-428b-bbe9-ed2f8d6ea3e9 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:00.145791 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5530e6f5-e2e7-428b-bbe9-ed2f8d6ea3e9 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:00.146776 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5530e6f5-e2e7-428b-bbe9-ed2f8d6ea3e9 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:00.147808 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5530e6f5-e2e7-428b-bbe9-ed2f8d6ea3e9 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:00.148539 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5530e6f5-e2e7-428b-bbe9-ed2f8d6ea3e9 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:00.370954 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4d3a7e1d-bf76-4281-9092-d20cf56e83f5 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "DELETE /compute/v2.1/servers/10546b59-4576-4dd2-a915-53e194075a26" status: 204 len: 0 microversion: 2.1 time: 0.429950 Sep 23 04:55:00.371449 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2694/5241] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:54:59 2022] DELETE /compute/v2.1/servers/10546b59-4576-4dd2-a915-53e194075a26 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:55:00.381817 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ccd0d44a-432d-42da-bc1f-08af7d349d65 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:00.382538 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ccd0d44a-432d-42da-bc1f-08af7d349d65 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] [instance: 6dfb2418-b235-4d35-b109-4bed20d1b96e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:00.399760 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ccd0d44a-432d-42da-bc1f-08af7d349d65 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:00.401481 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ccd0d44a-432d-42da-bc1f-08af7d349d65 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:00.402369 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ccd0d44a-432d-42da-bc1f-08af7d349d65 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:00.405909 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ccd0d44a-432d-42da-bc1f-08af7d349d65 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:00.407094 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ccd0d44a-432d-42da-bc1f-08af7d349d65 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:00.407814 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ccd0d44a-432d-42da-bc1f-08af7d349d65 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:00.495299 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-5530e6f5-e2e7-428b-bbe9-ed2f8d6ea3e9 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:00.520488 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5530e6f5-e2e7-428b-bbe9-ed2f8d6ea3e9 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937" status: 200 len: 1691 microversion: 2.1 time: 0.385454 Sep 23 04:55:00.522871 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2548/5242] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:00 2022] GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937 => generated 1691 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:55:00.543726 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4246b2be-06c1-4bfa-b141-936e229cf63b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:00.546236 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4246b2be-06c1-4bfa-b141-936e229cf63b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:00.562739 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4246b2be-06c1-4bfa-b141-936e229cf63b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:00.563663 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4246b2be-06c1-4bfa-b141-936e229cf63b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:00.564717 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4246b2be-06c1-4bfa-b141-936e229cf63b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:00.565785 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4246b2be-06c1-4bfa-b141-936e229cf63b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:00.566680 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4246b2be-06c1-4bfa-b141-936e229cf63b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:00.568259 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4246b2be-06c1-4bfa-b141-936e229cf63b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:00.592291 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ccd0d44a-432d-42da-bc1f-08af7d349d65 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bde73a530f4666aebdd5f7d9fa1046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71874a329e54494bb1b84f31c3826205', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:00.605063 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ccd0d44a-432d-42da-bc1f-08af7d349d65 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] 10.222.0.33 "GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e" status: 200 len: 1242 microversion: 2.1 time: 0.225723 Sep 23 04:55:00.608976 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2695/5243] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:00 2022] GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e => generated 1242 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:55:00.629840 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-195bc4cb-67c9-4067-b978-3caa9497e4e5 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Action: 'update_all', calling method: .version_select at 0x7ff1ba870820>, body: {"tags": ["tempest-tag-1790863768", "tempest-tag-21119784"]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:55:00.649403 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-195bc4cb-67c9-4067-b978-3caa9497e4e5 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:00.650440 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-195bc4cb-67c9-4067-b978-3caa9497e4e5 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:00.651107 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-195bc4cb-67c9-4067-b978-3caa9497e4e5 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:00.651858 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-195bc4cb-67c9-4067-b978-3caa9497e4e5 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] [instance: f92b0d2f-5a4d-4c52-9b91-4195c9e78b41] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:00.659592 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-195bc4cb-67c9-4067-b978-3caa9497e4e5 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:00.660271 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-195bc4cb-67c9-4067-b978-3caa9497e4e5 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:00.660933 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-195bc4cb-67c9-4067-b978-3caa9497e4e5 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:00.661748 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-195bc4cb-67c9-4067-b978-3caa9497e4e5 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:00.662337 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-195bc4cb-67c9-4067-b978-3caa9497e4e5 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:00.662904 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-195bc4cb-67c9-4067-b978-3caa9497e4e5 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:00.699455 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-195bc4cb-67c9-4067-b978-3caa9497e4e5 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:00.700746 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-195bc4cb-67c9-4067-b978-3caa9497e4e5 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:00.701530 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-195bc4cb-67c9-4067-b978-3caa9497e4e5 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:00.814471 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-195bc4cb-67c9-4067-b978-3caa9497e4e5 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lazy-loading 'flavor' on Instance uuid f92b0d2f-5a4d-4c52-9b91-4195c9e78b41 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:55:00.820512 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4246b2be-06c1-4bfa-b141-936e229cf63b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:00.840028 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4246b2be-06c1-4bfa-b141-936e229cf63b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1680 microversion: 2.1 time: 0.315347 Sep 23 04:55:00.855276 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-195bc4cb-67c9-4067-b978-3caa9497e4e5 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] 10.222.0.33 "PUT /compute/v2.1/servers/f92b0d2f-5a4d-4c52-9b91-4195c9e78b41/tags" status: 200 len: 60 microversion: 2.26 time: 0.244717 Sep 23 04:55:00.856270 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2696/5244] 10.222.0.33 () {62 vars in 1312 bytes} [Fri Sep 23 04:55:00 2022] PUT /compute/v2.1/servers/f92b0d2f-5a4d-4c52-9b91-4195c9e78b41/tags => generated 60 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:55:00.859543 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2549/5245] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:00 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1680 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:55:00.862818 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-bce349bb-c53a-4731-92dc-6f09064de70c req-474b83f6-dfeb-4f0c-b3a8-e27c64709174 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4381aca2-ea30-4473-9cd3-18c9b64f1937", "name": "network-vif-plugged", "status": "completed", "tag": "bc06dfe2-49c9-4f61-b1e4-e3d76533aa0c"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:55:00.871273 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e0e6e288-91e7-4455-a672-ed6e31159893 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:00.873509 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e0e6e288-91e7-4455-a672-ed6e31159893 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: 10546b59-4576-4dd2-a915-53e194075a26] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:00.882243 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e0e6e288-91e7-4455-a672-ed6e31159893 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:00.882873 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e0e6e288-91e7-4455-a672-ed6e31159893 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:00.883419 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e0e6e288-91e7-4455-a672-ed6e31159893 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:00.885269 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e0e6e288-91e7-4455-a672-ed6e31159893 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:00.885850 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e0e6e288-91e7-4455-a672-ed6e31159893 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:00.886424 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e0e6e288-91e7-4455-a672-ed6e31159893 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:00.892999 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-bce349bb-c53a-4731-92dc-6f09064de70c req-474b83f6-dfeb-4f0c-b3a8-e27c64709174 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:00.894161 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-bce349bb-c53a-4731-92dc-6f09064de70c req-474b83f6-dfeb-4f0c-b3a8-e27c64709174 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:00.894295 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-bce349bb-c53a-4731-92dc-6f09064de70c req-474b83f6-dfeb-4f0c-b3a8-e27c64709174 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:00.912381 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-bce349bb-c53a-4731-92dc-6f09064de70c req-474b83f6-dfeb-4f0c-b3a8-e27c64709174 service nova] Creating event network-vif-plugged:bc06dfe2-49c9-4f61-b1e4-e3d76533aa0c for instance 4381aca2-ea30-4473-9cd3-18c9b64f1937 on n-h2-846463-3 Sep 23 04:55:00.921473 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [req-bce349bb-c53a-4731-92dc-6f09064de70c req-474b83f6-dfeb-4f0c-b3a8-e27c64709174 service nova] Instance 4381aca2-ea30-4473-9cd3-18c9b64f1937 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846463-3', 'n-h2-846463-3'} {{(pid=122699) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 23 04:55:00.939327 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-bce349bb-c53a-4731-92dc-6f09064de70c req-474b83f6-dfeb-4f0c-b3a8-e27c64709174 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080191 Sep 23 04:55:00.940176 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2697/5246] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:55:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:55:00.949917 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e0e6e288-91e7-4455-a672-ed6e31159893 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: 10546b59-4576-4dd2-a915-53e194075a26] Going to try to terminate instance {{(pid=122698) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:55:00.950378 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7a89639c-cf3d-412e-beba-eb2ba099ac17 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Calling method '.version_select at 0x7ff1ba80d5e0>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:00.961331 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7a89639c-cf3d-412e-beba-eb2ba099ac17 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:00.962121 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7a89639c-cf3d-412e-beba-eb2ba099ac17 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:00.962728 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7a89639c-cf3d-412e-beba-eb2ba099ac17 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:00.970985 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:DELETE=1,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=1,nova_cell1:RELEASE=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:55:01.002182 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-7a89639c-cf3d-412e-beba-eb2ba099ac17 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] 10.222.0.33 "GET /compute/v2.1/servers/f92b0d2f-5a4d-4c52-9b91-4195c9e78b41/tags" status: 200 len: 60 microversion: 2.26 time: 0.059882 Sep 23 04:55:01.003195 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2698/5247] 10.222.0.33 () {60 vars in 1292 bytes} [Fri Sep 23 04:55:00 2022] GET /compute/v2.1/servers/f92b0d2f-5a4d-4c52-9b91-4195c9e78b41/tags => generated 60 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:55:01.015360 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-051b51c5-3ca6-4726-a3b8-1416ae82413b tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Calling method '.version_select at 0x7ff1ba807700>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:01.036577 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-051b51c5-3ca6-4726-a3b8-1416ae82413b tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:01.040340 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-051b51c5-3ca6-4726-a3b8-1416ae82413b tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:01.041082 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-051b51c5-3ca6-4726-a3b8-1416ae82413b tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:01.041921 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-051b51c5-3ca6-4726-a3b8-1416ae82413b tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] [instance: f92b0d2f-5a4d-4c52-9b91-4195c9e78b41] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:01.058637 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-051b51c5-3ca6-4726-a3b8-1416ae82413b tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:01.059298 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-051b51c5-3ca6-4726-a3b8-1416ae82413b tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:01.063068 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-051b51c5-3ca6-4726-a3b8-1416ae82413b tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:01.063068 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-051b51c5-3ca6-4726-a3b8-1416ae82413b tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:01.063068 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-051b51c5-3ca6-4726-a3b8-1416ae82413b tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:01.066315 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-051b51c5-3ca6-4726-a3b8-1416ae82413b tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:01.101857 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.compute.api [None req-e0e6e288-91e7-4455-a672-ed6e31159893 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: 10546b59-4576-4dd2-a915-53e194075a26] Instance is already in deleting state, ignoring this request Sep 23 04:55:01.106486 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e0e6e288-91e7-4455-a672-ed6e31159893 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "DELETE /compute/v2.1/servers/10546b59-4576-4dd2-a915-53e194075a26" status: 204 len: 0 microversion: 2.1 time: 0.241785 Sep 23 04:55:01.110428 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2550/5248] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:55:00 2022] DELETE /compute/v2.1/servers/10546b59-4576-4dd2-a915-53e194075a26 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:55:01.111840 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-051b51c5-3ca6-4726-a3b8-1416ae82413b tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:01.113961 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-051b51c5-3ca6-4726-a3b8-1416ae82413b tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:01.114522 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-051b51c5-3ca6-4726-a3b8-1416ae82413b tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:01.120691 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0455b478-4d90-4fd3-ac38-b30bf1fd5761 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:01.120691 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-0455b478-4d90-4fd3-ac38-b30bf1fd5761 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: 10546b59-4576-4dd2-a915-53e194075a26] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:01.127858 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0455b478-4d90-4fd3-ac38-b30bf1fd5761 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:01.129230 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0455b478-4d90-4fd3-ac38-b30bf1fd5761 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:01.129855 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0455b478-4d90-4fd3-ac38-b30bf1fd5761 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:01.130815 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0455b478-4d90-4fd3-ac38-b30bf1fd5761 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:01.131532 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0455b478-4d90-4fd3-ac38-b30bf1fd5761 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:01.132545 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0455b478-4d90-4fd3-ac38-b30bf1fd5761 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:01.208565 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-051b51c5-3ca6-4726-a3b8-1416ae82413b tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lazy-loading 'flavor' on Instance uuid f92b0d2f-5a4d-4c52-9b91-4195c9e78b41 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:55:01.232676 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-051b51c5-3ca6-4726-a3b8-1416ae82413b tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f92b0d2f-5a4d-4c52-9b91-4195c9e78b41/tags" status: 204 len: 0 microversion: 2.26 time: 0.221777 Sep 23 04:55:01.234078 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2699/5249] 10.222.0.33 () {60 vars in 1295 bytes} [Fri Sep 23 04:55:01 2022] DELETE /compute/v2.1/servers/f92b0d2f-5a4d-4c52-9b91-4195c9e78b41/tags => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 23 04:55:01.246095 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6b07ec1d-7de5-47b9-9c60-79fcd72e1272 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:01.247011 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-6b07ec1d-7de5-47b9-9c60-79fcd72e1272 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] [instance: f92b0d2f-5a4d-4c52-9b91-4195c9e78b41] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:01.277398 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6b07ec1d-7de5-47b9-9c60-79fcd72e1272 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:01.278260 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6b07ec1d-7de5-47b9-9c60-79fcd72e1272 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:01.278660 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6b07ec1d-7de5-47b9-9c60-79fcd72e1272 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:01.280090 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6b07ec1d-7de5-47b9-9c60-79fcd72e1272 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:01.280651 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6b07ec1d-7de5-47b9-9c60-79fcd72e1272 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:01.281096 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6b07ec1d-7de5-47b9-9c60-79fcd72e1272 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:01.350532 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-6b07ec1d-7de5-47b9-9c60-79fcd72e1272 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] [instance: f92b0d2f-5a4d-4c52-9b91-4195c9e78b41] Going to try to terminate instance {{(pid=122699) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:55:01.417546 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=89,nova_cell1:DELETE=3,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=4,nova_cell1:RELEASE=1,nova_cell1:UPDATE=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:55:01.567411 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-0455b478-4d90-4fd3-ac38-b30bf1fd5761 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:01.578443 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0455b478-4d90-4fd3-ac38-b30bf1fd5761 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/10546b59-4576-4dd2-a915-53e194075a26" status: 200 len: 1512 microversion: 2.1 time: 0.466463 Sep 23 04:55:01.579044 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2551/5250] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:01 2022] GET /compute/v2.1/servers/10546b59-4576-4dd2-a915-53e194075a26 => generated 1512 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:55:01.584619 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-eaa7be94-bb19-4d74-8c9c-1803938cd6ab tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:01.584619 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-eaa7be94-bb19-4d74-8c9c-1803938cd6ab tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 4381aca2-ea30-4473-9cd3-18c9b64f1937] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:01.590797 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-eaa7be94-bb19-4d74-8c9c-1803938cd6ab tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:01.591285 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-eaa7be94-bb19-4d74-8c9c-1803938cd6ab tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:01.591729 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-eaa7be94-bb19-4d74-8c9c-1803938cd6ab tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:01.592438 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-eaa7be94-bb19-4d74-8c9c-1803938cd6ab tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:01.592902 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-eaa7be94-bb19-4d74-8c9c-1803938cd6ab tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:01.593329 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-eaa7be94-bb19-4d74-8c9c-1803938cd6ab tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:01.744101 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6b07ec1d-7de5-47b9-9c60-79fcd72e1272 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f92b0d2f-5a4d-4c52-9b91-4195c9e78b41" status: 204 len: 0 microversion: 2.26 time: 0.503513 Sep 23 04:55:01.745879 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2700/5251] 10.222.0.33 () {60 vars in 1280 bytes} [Fri Sep 23 04:55:01 2022] DELETE /compute/v2.1/servers/f92b0d2f-5a4d-4c52-9b91-4195c9e78b41 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 23 04:55:01.756941 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-936df9ed-5777-470e-b31f-6dd8ee86474e tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:01.759908 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-936df9ed-5777-470e-b31f-6dd8ee86474e tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] [instance: 6dfb2418-b235-4d35-b109-4bed20d1b96e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:01.770020 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-936df9ed-5777-470e-b31f-6dd8ee86474e tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:01.773480 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-936df9ed-5777-470e-b31f-6dd8ee86474e tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:01.773480 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-936df9ed-5777-470e-b31f-6dd8ee86474e tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:01.773480 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-936df9ed-5777-470e-b31f-6dd8ee86474e tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:01.773480 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-936df9ed-5777-470e-b31f-6dd8ee86474e tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:01.773480 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-936df9ed-5777-470e-b31f-6dd8ee86474e tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:02.238932 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-936df9ed-5777-470e-b31f-6dd8ee86474e tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bde73a530f4666aebdd5f7d9fa1046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71874a329e54494bb1b84f31c3826205', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:02.248795 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-936df9ed-5777-470e-b31f-6dd8ee86474e tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] 10.222.0.33 "GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e" status: 200 len: 1290 microversion: 2.1 time: 0.500273 Sep 23 04:55:02.265138 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2701/5252] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:01 2022] GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e => generated 1290 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:55:02.278625 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-461a5684-55f9-47ae-ba78-acfca69832ef tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:02.279729 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-461a5684-55f9-47ae-ba78-acfca69832ef tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] [instance: f92b0d2f-5a4d-4c52-9b91-4195c9e78b41] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:02.280140 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-eaa7be94-bb19-4d74-8c9c-1803938cd6ab tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:02.290087 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-eaa7be94-bb19-4d74-8c9c-1803938cd6ab tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937" status: 200 len: 1691 microversion: 2.1 time: 0.709968 Sep 23 04:55:02.298766 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2552/5253] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:01 2022] GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937 => generated 1691 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:55:02.304358 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7a2a76ed-dc44-46f6-83dd-33f56bf9a603 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:02.310728 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:55:02.311189 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7a2a76ed-dc44-46f6-83dd-33f56bf9a603 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:02.317987 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7a2a76ed-dc44-46f6-83dd-33f56bf9a603 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:02.321298 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7a2a76ed-dc44-46f6-83dd-33f56bf9a603 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:02.324144 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7a2a76ed-dc44-46f6-83dd-33f56bf9a603 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:02.325146 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7a2a76ed-dc44-46f6-83dd-33f56bf9a603 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:02.325804 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7a2a76ed-dc44-46f6-83dd-33f56bf9a603 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:02.326484 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7a2a76ed-dc44-46f6-83dd-33f56bf9a603 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:02.337510 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-461a5684-55f9-47ae-ba78-acfca69832ef tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:02.338318 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-461a5684-55f9-47ae-ba78-acfca69832ef tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:02.341998 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-461a5684-55f9-47ae-ba78-acfca69832ef tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:02.342785 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-461a5684-55f9-47ae-ba78-acfca69832ef tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:02.343264 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-461a5684-55f9-47ae-ba78-acfca69832ef tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:02.343730 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-461a5684-55f9-47ae-ba78-acfca69832ef tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:02.854525 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-7a2a76ed-dc44-46f6-83dd-33f56bf9a603 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:02.868545 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7a2a76ed-dc44-46f6-83dd-33f56bf9a603 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1657 microversion: 2.1 time: 0.568472 Sep 23 04:55:02.869096 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2553/5254] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:02 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1657 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:55:02.874131 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d4f6f626-e989-41f1-9c66-e616db598463 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:02.874933 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d4f6f626-e989-41f1-9c66-e616db598463 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: 10546b59-4576-4dd2-a915-53e194075a26] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:02.879454 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-461a5684-55f9-47ae-ba78-acfca69832ef tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06a78b01bd24d6f9c25dc56c6573ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbeff54a4514dacae8b9f0eb517d2ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:02.887953 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d4f6f626-e989-41f1-9c66-e616db598463 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:02.890641 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-461a5684-55f9-47ae-ba78-acfca69832ef tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06a78b01bd24d6f9c25dc56c6573ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbeff54a4514dacae8b9f0eb517d2ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:02.890641 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-461a5684-55f9-47ae-ba78-acfca69832ef tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06a78b01bd24d6f9c25dc56c6573ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbeff54a4514dacae8b9f0eb517d2ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:02.892787 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d4f6f626-e989-41f1-9c66-e616db598463 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:02.894039 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d4f6f626-e989-41f1-9c66-e616db598463 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:02.895137 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d4f6f626-e989-41f1-9c66-e616db598463 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:02.898091 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d4f6f626-e989-41f1-9c66-e616db598463 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:02.899219 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d4f6f626-e989-41f1-9c66-e616db598463 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:02.899346 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-461a5684-55f9-47ae-ba78-acfca69832ef tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] 10.222.0.33 "GET /compute/v2.1/servers/f92b0d2f-5a4d-4c52-9b91-4195c9e78b41" status: 200 len: 1552 microversion: 2.26 time: 0.628700 Sep 23 04:55:02.899936 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2702/5255] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:55:02 2022] GET /compute/v2.1/servers/f92b0d2f-5a4d-4c52-9b91-4195c9e78b41 => generated 1552 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:55:02.918069 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-95df905b-e2b7-4ac9-89b7-6d840bbea032 req-264b14b4-8532-4ad3-8970-09b8bfa23f56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10546b59-4576-4dd2-a915-53e194075a26", "name": "network-vif-deleted", "tag": "1c318b20-3c2f-4db9-b120-05eb91bef00c"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:55:02.934192 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-95df905b-e2b7-4ac9-89b7-6d840bbea032 req-264b14b4-8532-4ad3-8970-09b8bfa23f56 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:02.935516 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-95df905b-e2b7-4ac9-89b7-6d840bbea032 req-264b14b4-8532-4ad3-8970-09b8bfa23f56 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:02.935962 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-95df905b-e2b7-4ac9-89b7-6d840bbea032 req-264b14b4-8532-4ad3-8970-09b8bfa23f56 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:02.952613 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-95df905b-e2b7-4ac9-89b7-6d840bbea032 req-264b14b4-8532-4ad3-8970-09b8bfa23f56 service nova] Creating event network-vif-deleted:1c318b20-3c2f-4db9-b120-05eb91bef00c for instance 10546b59-4576-4dd2-a915-53e194075a26 on n-h2-846463-3 Sep 23 04:55:02.959938 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-95df905b-e2b7-4ac9-89b7-6d840bbea032 req-264b14b4-8532-4ad3-8970-09b8bfa23f56 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057039 Sep 23 04:55:02.966728 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2703/5256] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:55:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:55:02.978300 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6de1ba24-3394-4450-94ea-d47c24a52fe7 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:55:02.985063 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6de1ba24-3394-4450-94ea-d47c24a52fe7 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:02.985864 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6de1ba24-3394-4450-94ea-d47c24a52fe7 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:02.986571 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6de1ba24-3394-4450-94ea-d47c24a52fe7 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:03.005316 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d4f6f626-e989-41f1-9c66-e616db598463 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:03.027250 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d4f6f626-e989-41f1-9c66-e616db598463 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/10546b59-4576-4dd2-a915-53e194075a26" status: 200 len: 1302 microversion: 2.1 time: 0.156599 Sep 23 04:55:03.027851 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2554/5257] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:02 2022] GET /compute/v2.1/servers/10546b59-4576-4dd2-a915-53e194075a26 => generated 1302 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:55:03.028474 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-6de1ba24-3394-4450-94ea-d47c24a52fe7 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Going to try to start instance {{(pid=122699) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 23 04:55:03.287973 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5e01a8bb-8cdc-4b6d-977f-9933f7ce92b2 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:03.288895 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5e01a8bb-8cdc-4b6d-977f-9933f7ce92b2 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] [instance: 6dfb2418-b235-4d35-b109-4bed20d1b96e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:03.299027 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5e01a8bb-8cdc-4b6d-977f-9933f7ce92b2 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:03.299694 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5e01a8bb-8cdc-4b6d-977f-9933f7ce92b2 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:03.300134 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5e01a8bb-8cdc-4b6d-977f-9933f7ce92b2 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:03.301133 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5e01a8bb-8cdc-4b6d-977f-9933f7ce92b2 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:03.301747 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5e01a8bb-8cdc-4b6d-977f-9933f7ce92b2 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:03.302406 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5e01a8bb-8cdc-4b6d-977f-9933f7ce92b2 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:03.343198 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6de1ba24-3394-4450-94ea-d47c24a52fe7 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "POST /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5/action" status: 202 len: 0 microversion: 2.1 time: 0.372612 Sep 23 04:55:03.348184 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2704/5258] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:55:02 2022] POST /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5/action => generated 0 bytes in 376 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:55:03.353274 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-530ac2c6-257c-49c3-acf4-c1397f1198f7 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:03.354382 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-530ac2c6-257c-49c3-acf4-c1397f1198f7 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 4381aca2-ea30-4473-9cd3-18c9b64f1937] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:03.391059 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-530ac2c6-257c-49c3-acf4-c1397f1198f7 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:03.391579 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-530ac2c6-257c-49c3-acf4-c1397f1198f7 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:03.392028 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-530ac2c6-257c-49c3-acf4-c1397f1198f7 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:03.393534 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-530ac2c6-257c-49c3-acf4-c1397f1198f7 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:03.394353 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-530ac2c6-257c-49c3-acf4-c1397f1198f7 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:03.394938 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-530ac2c6-257c-49c3-acf4-c1397f1198f7 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:03.598269 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-5e01a8bb-8cdc-4b6d-977f-9933f7ce92b2 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bde73a530f4666aebdd5f7d9fa1046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71874a329e54494bb1b84f31c3826205', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:03.614001 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5e01a8bb-8cdc-4b6d-977f-9933f7ce92b2 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] 10.222.0.33 "GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e" status: 200 len: 1298 microversion: 2.1 time: 0.333526 Sep 23 04:55:03.629693 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2555/5259] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:03 2022] GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e => generated 1298 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:55:03.651494 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-90b23dc7-20d8-4d2a-a821-127da41f9798 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:03.652512 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-90b23dc7-20d8-4d2a-a821-127da41f9798 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:03.660417 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-90b23dc7-20d8-4d2a-a821-127da41f9798 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:03.661446 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-90b23dc7-20d8-4d2a-a821-127da41f9798 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:03.662140 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-90b23dc7-20d8-4d2a-a821-127da41f9798 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:03.663658 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-90b23dc7-20d8-4d2a-a821-127da41f9798 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:03.664328 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-90b23dc7-20d8-4d2a-a821-127da41f9798 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:03.665035 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-90b23dc7-20d8-4d2a-a821-127da41f9798 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:03.974255 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-530ac2c6-257c-49c3-acf4-c1397f1198f7 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:03.989025 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-530ac2c6-257c-49c3-acf4-c1397f1198f7 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937" status: 200 len: 1691 microversion: 2.1 time: 0.643578 Sep 23 04:55:03.993143 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2705/5260] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:03 2022] GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937 => generated 1691 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:55:04.014695 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-163cedfb-6c11-4d05-a83c-4aa6206ebd38 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:04.015322 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-163cedfb-6c11-4d05-a83c-4aa6206ebd38 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] [instance: f92b0d2f-5a4d-4c52-9b91-4195c9e78b41] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:04.026227 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-163cedfb-6c11-4d05-a83c-4aa6206ebd38 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:04.026227 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-163cedfb-6c11-4d05-a83c-4aa6206ebd38 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:04.027393 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-163cedfb-6c11-4d05-a83c-4aa6206ebd38 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:04.028405 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-163cedfb-6c11-4d05-a83c-4aa6206ebd38 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:04.028991 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-163cedfb-6c11-4d05-a83c-4aa6206ebd38 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:04.030794 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-163cedfb-6c11-4d05-a83c-4aa6206ebd38 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:04.113784 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-90b23dc7-20d8-4d2a-a821-127da41f9798 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:04.124173 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-90b23dc7-20d8-4d2a-a821-127da41f9798 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1666 microversion: 2.1 time: 0.489134 Sep 23 04:55:04.125414 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2556/5261] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:03 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1666 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:55:04.137090 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a4b0c9bc-cd91-4492-96d9-72f12e81842f tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:04.146646 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a4b0c9bc-cd91-4492-96d9-72f12e81842f tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: 10546b59-4576-4dd2-a915-53e194075a26] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:04.154049 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a4b0c9bc-cd91-4492-96d9-72f12e81842f tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:04.155478 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a4b0c9bc-cd91-4492-96d9-72f12e81842f tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:04.156151 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a4b0c9bc-cd91-4492-96d9-72f12e81842f tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:04.157086 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a4b0c9bc-cd91-4492-96d9-72f12e81842f tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:04.174699 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a4b0c9bc-cd91-4492-96d9-72f12e81842f tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:04.175613 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a4b0c9bc-cd91-4492-96d9-72f12e81842f tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:04.255732 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a4b0c9bc-cd91-4492-96d9-72f12e81842f tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:04.255732 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a4b0c9bc-cd91-4492-96d9-72f12e81842f tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:04.255732 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a4b0c9bc-cd91-4492-96d9-72f12e81842f tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:04.256375 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-a4b0c9bc-cd91-4492-96d9-72f12e81842f tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lazy-loading 'fault' on Instance uuid 10546b59-4576-4dd2-a915-53e194075a26 {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:55:04.326438 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a4b0c9bc-cd91-4492-96d9-72f12e81842f tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3397cb6388640e3af28e06f80019363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94d0c555b3b4c79b1176db993b58607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:04.355445 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a4b0c9bc-cd91-4492-96d9-72f12e81842f tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/10546b59-4576-4dd2-a915-53e194075a26" status: 200 len: 1307 microversion: 2.1 time: 0.228767 Sep 23 04:55:04.364099 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2557/5262] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:04 2022] GET /compute/v2.1/servers/10546b59-4576-4dd2-a915-53e194075a26 => generated 1307 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:55:04.372701 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-163cedfb-6c11-4d05-a83c-4aa6206ebd38 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06a78b01bd24d6f9c25dc56c6573ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbeff54a4514dacae8b9f0eb517d2ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:04.383231 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-163cedfb-6c11-4d05-a83c-4aa6206ebd38 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06a78b01bd24d6f9c25dc56c6573ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbeff54a4514dacae8b9f0eb517d2ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:04.385114 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-163cedfb-6c11-4d05-a83c-4aa6206ebd38 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06a78b01bd24d6f9c25dc56c6573ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbeff54a4514dacae8b9f0eb517d2ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:04.386391 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-163cedfb-6c11-4d05-a83c-4aa6206ebd38 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] 10.222.0.33 "GET /compute/v2.1/servers/f92b0d2f-5a4d-4c52-9b91-4195c9e78b41" status: 200 len: 1552 microversion: 2.26 time: 0.392237 Sep 23 04:55:04.387505 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2706/5263] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:55:03 2022] GET /compute/v2.1/servers/f92b0d2f-5a4d-4c52-9b91-4195c9e78b41 => generated 1552 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:55:04.640185 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7795633d-9dee-42f2-9f8f-bfbe75b3f6a2 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:04.641277 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7795633d-9dee-42f2-9f8f-bfbe75b3f6a2 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] [instance: 6dfb2418-b235-4d35-b109-4bed20d1b96e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:04.650260 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7795633d-9dee-42f2-9f8f-bfbe75b3f6a2 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:04.651140 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7795633d-9dee-42f2-9f8f-bfbe75b3f6a2 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:04.652742 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7795633d-9dee-42f2-9f8f-bfbe75b3f6a2 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:04.654222 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7795633d-9dee-42f2-9f8f-bfbe75b3f6a2 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:04.655155 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7795633d-9dee-42f2-9f8f-bfbe75b3f6a2 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:04.655990 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7795633d-9dee-42f2-9f8f-bfbe75b3f6a2 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:04.734138 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-7795633d-9dee-42f2-9f8f-bfbe75b3f6a2 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bde73a530f4666aebdd5f7d9fa1046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71874a329e54494bb1b84f31c3826205', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:04.745273 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7795633d-9dee-42f2-9f8f-bfbe75b3f6a2 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] 10.222.0.33 "GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e" status: 200 len: 1296 microversion: 2.1 time: 0.110515 Sep 23 04:55:04.750097 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2558/5264] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:04 2022] GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e => generated 1296 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:55:05.017521 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-00e9fd3f-1a4d-4f6d-86b8-6b0351cb79dd tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:05.018176 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-00e9fd3f-1a4d-4f6d-86b8-6b0351cb79dd tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 4381aca2-ea30-4473-9cd3-18c9b64f1937] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:05.025831 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-00e9fd3f-1a4d-4f6d-86b8-6b0351cb79dd tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:05.026368 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-00e9fd3f-1a4d-4f6d-86b8-6b0351cb79dd tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:05.026818 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-00e9fd3f-1a4d-4f6d-86b8-6b0351cb79dd tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:05.027546 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-00e9fd3f-1a4d-4f6d-86b8-6b0351cb79dd tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:05.028012 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-00e9fd3f-1a4d-4f6d-86b8-6b0351cb79dd tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:05.028445 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-00e9fd3f-1a4d-4f6d-86b8-6b0351cb79dd tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:05.151424 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-34fd7558-5cba-4304-add6-e0c2e4cc96ed tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:05.152397 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-34fd7558-5cba-4304-add6-e0c2e4cc96ed tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:05.158637 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-34fd7558-5cba-4304-add6-e0c2e4cc96ed tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:05.159145 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-34fd7558-5cba-4304-add6-e0c2e4cc96ed tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:05.159593 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-34fd7558-5cba-4304-add6-e0c2e4cc96ed tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:05.160337 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-34fd7558-5cba-4304-add6-e0c2e4cc96ed tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:05.160801 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-34fd7558-5cba-4304-add6-e0c2e4cc96ed tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:05.161229 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-34fd7558-5cba-4304-add6-e0c2e4cc96ed tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:05.170970 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-00e9fd3f-1a4d-4f6d-86b8-6b0351cb79dd tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:05.179895 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-00e9fd3f-1a4d-4f6d-86b8-6b0351cb79dd tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937" status: 200 len: 1683 microversion: 2.1 time: 0.166896 Sep 23 04:55:05.180913 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2707/5265] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:05 2022] GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937 => generated 1683 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:55:05.371590 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-34fd7558-5cba-4304-add6-e0c2e4cc96ed tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:05.380082 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-34fd7558-5cba-4304-add6-e0c2e4cc96ed tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1666 microversion: 2.1 time: 0.233222 Sep 23 04:55:05.380674 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2559/5266] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:05 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1666 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:55:05.381976 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-37034f66-4b9a-4795-8aaa-d2a85a31c35d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:05.385009 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-37034f66-4b9a-4795-8aaa-d2a85a31c35d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: 10546b59-4576-4dd2-a915-53e194075a26] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:05.390522 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-37034f66-4b9a-4795-8aaa-d2a85a31c35d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:05.391756 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-37034f66-4b9a-4795-8aaa-d2a85a31c35d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:05.392294 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-37034f66-4b9a-4795-8aaa-d2a85a31c35d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:05.393078 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-37034f66-4b9a-4795-8aaa-d2a85a31c35d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:05.393613 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-37034f66-4b9a-4795-8aaa-d2a85a31c35d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:05.394208 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-37034f66-4b9a-4795-8aaa-d2a85a31c35d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:05.408847 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-37034f66-4b9a-4795-8aaa-d2a85a31c35d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] HTTP exception thrown: Instance 10546b59-4576-4dd2-a915-53e194075a26 could not be found. Sep 23 04:55:05.410798 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-37034f66-4b9a-4795-8aaa-d2a85a31c35d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Request method failure captured: Sep 23 04:55:05.410798 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/10546b59-4576-4dd2-a915-53e194075a26 HTTP/1.1 Sep 23 04:55:05.410798 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:55:05.410798 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:55:05.410798 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:55:05.410798 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:55:05.410798 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:55:05.410798 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:55:05.410798 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:55:05.410798 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:55:05.410798 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTuAfGOmhvB_ArWk44zoIW896dMcTTn7_rVhGbRWBp99MTykXbm774Ya_IMwK_RA0C1fGFkZCjQajKsymUXgflAAZ0PV7Eh-ODSy6VAbOiYAmzqjrcnwIndk6_EgvuZCkFFIB6i1JwmOdcmAK91S5EF9Ysn-UQTcBg7uJtAxTe0Z1wM Sep 23 04:55:05.410798 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:55:05.410798 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:55:05.410798 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:55:05.410798 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:55:05.410798 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:55:05.410798 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:55:05.410798 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: a94d0c555b3b4c79b1176db993b58607 Sep 23 04:55:05.410798 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ServerDiskConfigTestJSON-23347216 Sep 23 04:55:05.410798 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:55:05.410798 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:55:05.410798 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a94d0c555b3b4c79b1176db993b58607", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a94d0c555b3b4c79b1176db993b58607"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a94d0c555b3b4c79b1176db993b58607"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a94d0c555b3b4c79b1176db993b58607"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:55:05.410798 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ServerDiskConfigTestJSON-23347216 Sep 23 04:55:05.410798 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: a94d0c555b3b4c79b1176db993b58607 Sep 23 04:55:05.410798 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-23347216 Sep 23 04:55:05.410798 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ServerDiskConfigTestJSON-23347216-project Sep 23 04:55:05.410798 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:55:05.410798 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:55:05.410798 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: c3397cb6388640e3af28e06f80019363 Sep 23 04:55:05.410798 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ServerDiskConfigTestJSON-23347216-project Sep 23 04:55:05.410798 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:55:05.410798 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 10546b59-4576-4dd2-a915-53e194075a26 could not be found. Sep 23 04:55:05.410798 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '10546b59-4576-4dd2-a915-53e194075a26'} Sep 23 04:55:05.410798 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:55:05.410798 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:55:05.410798 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:55:05.410798 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:55:05.410798 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:55:05.410798 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:55:05.410798 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:55:05.410798 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:55:05.410798 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:55:05.410798 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:55:05.410798 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10546b59-4576-4dd2-a915-53e194075a26 could not be found. Sep 23 04:55:05.410798 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:55:05.410798 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:55:05.410798 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:55:05.410798 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:55:05.410798 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:55:05.410798 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:55:05.410798 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:55:05.410798 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:55:05.410798 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:55:05.410798 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:55:05.410798 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:55:05.410798 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:55:05.410798 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:55:05.410798 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:55:05.410798 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:55:05.410798 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:55:05.410798 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10546b59-4576-4dd2-a915-53e194075a26 could not be found. Sep 23 04:55:05.410798 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:55:05.410798 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:55:05.410798 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:55:05.417181 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:55:05.417181 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:55:05.417181 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:55:05.417181 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:55:05.417181 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:55:05.417181 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10546b59-4576-4dd2-a915-53e194075a26 could not be found. Sep 23 04:55:05.417181 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:55:05.417181 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-37034f66-4b9a-4795-8aaa-d2a85a31c35d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Returning 404 to user: Instance 10546b59-4576-4dd2-a915-53e194075a26 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:55:05.417181 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-37034f66-4b9a-4795-8aaa-d2a85a31c35d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/10546b59-4576-4dd2-a915-53e194075a26" status: 404 len: 111 microversion: 2.1 time: 0.035574 Sep 23 04:55:05.419890 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f8af6fd9-fafd-483c-b6b2-525e61c0697d tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:05.420072 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2708/5267] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:05 2022] GET /compute/v2.1/servers/10546b59-4576-4dd2-a915-53e194075a26 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:55:05.420238 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f8af6fd9-fafd-483c-b6b2-525e61c0697d tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] [instance: f92b0d2f-5a4d-4c52-9b91-4195c9e78b41] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:05.420388 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f1bfe76a-5cb4-4288-a64c-7a328e2f3ce6 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:05.420913 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f1bfe76a-5cb4-4288-a64c-7a328e2f3ce6 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: 6174fd18-3f10-4034-85ee-32b05fde010f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:05.424364 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f8af6fd9-fafd-483c-b6b2-525e61c0697d tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:05.425112 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f8af6fd9-fafd-483c-b6b2-525e61c0697d tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:05.425657 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f8af6fd9-fafd-483c-b6b2-525e61c0697d tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:05.426533 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f8af6fd9-fafd-483c-b6b2-525e61c0697d tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:05.427081 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f8af6fd9-fafd-483c-b6b2-525e61c0697d tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:05.427593 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f8af6fd9-fafd-483c-b6b2-525e61c0697d tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:05.427771 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f1bfe76a-5cb4-4288-a64c-7a328e2f3ce6 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:05.428687 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f1bfe76a-5cb4-4288-a64c-7a328e2f3ce6 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:05.429146 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f1bfe76a-5cb4-4288-a64c-7a328e2f3ce6 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:05.429852 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f1bfe76a-5cb4-4288-a64c-7a328e2f3ce6 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:05.430427 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f1bfe76a-5cb4-4288-a64c-7a328e2f3ce6 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:05.430877 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f1bfe76a-5cb4-4288-a64c-7a328e2f3ce6 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:05.446917 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-f1bfe76a-5cb4-4288-a64c-7a328e2f3ce6 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] HTTP exception thrown: Instance 6174fd18-3f10-4034-85ee-32b05fde010f could not be found. Sep 23 04:55:05.448470 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f1bfe76a-5cb4-4288-a64c-7a328e2f3ce6 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Request method failure captured: Sep 23 04:55:05.448470 n-d-846463-3 devstack@n-api.service[122699]: request: DELETE /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f HTTP/1.1 Sep 23 04:55:05.448470 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:55:05.448470 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:55:05.448470 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:55:05.448470 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:55:05.448470 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:55:05.448470 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:55:05.448470 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:55:05.448470 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:55:05.448470 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTuAfGOmhvB_ArWk44zoIW896dMcTTn7_rVhGbRWBp99MTykXbm774Ya_IMwK_RA0C1fGFkZCjQajKsymUXgflAAZ0PV7Eh-ODSy6VAbOiYAmzqjrcnwIndk6_EgvuZCkFFIB6i1JwmOdcmAK91S5EF9Ysn-UQTcBg7uJtAxTe0Z1wM Sep 23 04:55:05.448470 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:55:05.448470 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:55:05.448470 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:55:05.448470 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:55:05.448470 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:55:05.448470 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:55:05.448470 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: a94d0c555b3b4c79b1176db993b58607 Sep 23 04:55:05.448470 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ServerDiskConfigTestJSON-23347216 Sep 23 04:55:05.448470 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:55:05.448470 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:55:05.448470 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a94d0c555b3b4c79b1176db993b58607", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a94d0c555b3b4c79b1176db993b58607"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a94d0c555b3b4c79b1176db993b58607"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a94d0c555b3b4c79b1176db993b58607"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:55:05.448470 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ServerDiskConfigTestJSON-23347216 Sep 23 04:55:05.448470 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: a94d0c555b3b4c79b1176db993b58607 Sep 23 04:55:05.448470 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-23347216 Sep 23 04:55:05.448470 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ServerDiskConfigTestJSON-23347216-project Sep 23 04:55:05.448470 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:55:05.448470 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:55:05.448470 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: c3397cb6388640e3af28e06f80019363 Sep 23 04:55:05.448470 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ServerDiskConfigTestJSON-23347216-project Sep 23 04:55:05.448470 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:55:05.448470 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 6174fd18-3f10-4034-85ee-32b05fde010f could not be found. Sep 23 04:55:05.448470 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '6174fd18-3f10-4034-85ee-32b05fde010f'} Sep 23 04:55:05.448470 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:55:05.448470 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:55:05.448470 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:55:05.448470 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:55:05.448470 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:55:05.448470 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:55:05.448470 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:55:05.448470 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:55:05.448470 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:55:05.448470 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:55:05.448470 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6174fd18-3f10-4034-85ee-32b05fde010f could not be found. Sep 23 04:55:05.448470 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:55:05.448470 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:55:05.448470 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:55:05.448470 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:55:05.448470 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:55:05.448470 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:55:05.448470 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:55:05.448470 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:55:05.448470 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:55:05.448470 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:55:05.448470 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 04:55:05.448470 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 04:55:05.448470 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 04:55:05.448470 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 04:55:05.448470 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:55:05.448470 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:55:05.448470 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:55:05.448470 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:55:05.454462 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6174fd18-3f10-4034-85ee-32b05fde010f could not be found. Sep 23 04:55:05.454462 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:55:05.454462 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:55:05.454462 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:55:05.454462 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:55:05.454462 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:55:05.454462 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:55:05.454462 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:55:05.454462 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:55:05.454462 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6174fd18-3f10-4034-85ee-32b05fde010f could not be found. Sep 23 04:55:05.454462 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:55:05.454462 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f1bfe76a-5cb4-4288-a64c-7a328e2f3ce6 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Returning 404 to user: Instance 6174fd18-3f10-4034-85ee-32b05fde010f could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:55:05.454462 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f1bfe76a-5cb4-4288-a64c-7a328e2f3ce6 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f" status: 404 len: 111 microversion: 2.1 time: 0.033169 Sep 23 04:55:05.454462 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2709/5268] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:55:05 2022] DELETE /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:55:05.459501 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-51cbf87d-2849-41ee-86e3-ccd7a057f0a4 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:05.460052 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-51cbf87d-2849-41ee-86e3-ccd7a057f0a4 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: 6174fd18-3f10-4034-85ee-32b05fde010f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:05.467403 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-51cbf87d-2849-41ee-86e3-ccd7a057f0a4 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:05.467903 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-51cbf87d-2849-41ee-86e3-ccd7a057f0a4 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:05.470100 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-51cbf87d-2849-41ee-86e3-ccd7a057f0a4 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:05.471950 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-51cbf87d-2849-41ee-86e3-ccd7a057f0a4 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:05.471950 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-51cbf87d-2849-41ee-86e3-ccd7a057f0a4 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:05.471950 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-51cbf87d-2849-41ee-86e3-ccd7a057f0a4 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:05.492092 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-51cbf87d-2849-41ee-86e3-ccd7a057f0a4 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] HTTP exception thrown: Instance 6174fd18-3f10-4034-85ee-32b05fde010f could not be found. Sep 23 04:55:05.494375 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-51cbf87d-2849-41ee-86e3-ccd7a057f0a4 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Request method failure captured: Sep 23 04:55:05.494375 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f HTTP/1.1 Sep 23 04:55:05.494375 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:55:05.494375 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:55:05.494375 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:55:05.494375 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:55:05.494375 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:55:05.494375 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:55:05.494375 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:55:05.494375 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:55:05.494375 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTuAfGOmhvB_ArWk44zoIW896dMcTTn7_rVhGbRWBp99MTykXbm774Ya_IMwK_RA0C1fGFkZCjQajKsymUXgflAAZ0PV7Eh-ODSy6VAbOiYAmzqjrcnwIndk6_EgvuZCkFFIB6i1JwmOdcmAK91S5EF9Ysn-UQTcBg7uJtAxTe0Z1wM Sep 23 04:55:05.494375 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:55:05.494375 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:55:05.494375 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:55:05.494375 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:55:05.494375 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:55:05.494375 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:55:05.494375 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: a94d0c555b3b4c79b1176db993b58607 Sep 23 04:55:05.494375 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ServerDiskConfigTestJSON-23347216 Sep 23 04:55:05.494375 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:55:05.494375 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:55:05.494375 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a94d0c555b3b4c79b1176db993b58607", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a94d0c555b3b4c79b1176db993b58607"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a94d0c555b3b4c79b1176db993b58607"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a94d0c555b3b4c79b1176db993b58607"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:55:05.494375 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ServerDiskConfigTestJSON-23347216 Sep 23 04:55:05.494375 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: a94d0c555b3b4c79b1176db993b58607 Sep 23 04:55:05.494375 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-23347216 Sep 23 04:55:05.494375 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ServerDiskConfigTestJSON-23347216-project Sep 23 04:55:05.494375 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:55:05.494375 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:55:05.494375 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: c3397cb6388640e3af28e06f80019363 Sep 23 04:55:05.494375 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ServerDiskConfigTestJSON-23347216-project Sep 23 04:55:05.494375 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:55:05.494375 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 6174fd18-3f10-4034-85ee-32b05fde010f could not be found. Sep 23 04:55:05.494375 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '6174fd18-3f10-4034-85ee-32b05fde010f'} Sep 23 04:55:05.494375 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:55:05.494375 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:55:05.494375 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:55:05.494375 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:55:05.494375 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:55:05.494375 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:55:05.494375 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:55:05.494375 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:55:05.494375 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:55:05.494375 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:55:05.494375 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6174fd18-3f10-4034-85ee-32b05fde010f could not be found. Sep 23 04:55:05.494375 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:55:05.494375 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:55:05.494375 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:55:05.494375 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:55:05.494375 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:55:05.494375 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:55:05.494375 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:55:05.494375 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:55:05.494375 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:55:05.494375 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:55:05.494375 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:55:05.494375 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:55:05.494375 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:55:05.494375 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:55:05.494375 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:55:05.494375 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:55:05.494375 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6174fd18-3f10-4034-85ee-32b05fde010f could not be found. Sep 23 04:55:05.494375 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:55:05.494375 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:55:05.494375 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:55:05.500814 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:55:05.500814 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:55:05.500814 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:55:05.500814 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:55:05.500814 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:55:05.500814 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6174fd18-3f10-4034-85ee-32b05fde010f could not be found. Sep 23 04:55:05.500814 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:55:05.502734 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-51cbf87d-2849-41ee-86e3-ccd7a057f0a4 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Returning 404 to user: Instance 6174fd18-3f10-4034-85ee-32b05fde010f could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:55:05.503817 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-51cbf87d-2849-41ee-86e3-ccd7a057f0a4 tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f" status: 404 len: 111 microversion: 2.1 time: 0.048661 Sep 23 04:55:05.504402 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2710/5269] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:05 2022] GET /compute/v2.1/servers/6174fd18-3f10-4034-85ee-32b05fde010f => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 04:55:05.504523 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f8af6fd9-fafd-483c-b6b2-525e61c0697d tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06a78b01bd24d6f9c25dc56c6573ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbeff54a4514dacae8b9f0eb517d2ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:05.512951 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-af78f058-b7c8-4f2f-8c8b-79eb0f2aae7a tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:05.513455 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-af78f058-b7c8-4f2f-8c8b-79eb0f2aae7a tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:05.517780 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f8af6fd9-fafd-483c-b6b2-525e61c0697d tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06a78b01bd24d6f9c25dc56c6573ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbeff54a4514dacae8b9f0eb517d2ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:05.519380 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f8af6fd9-fafd-483c-b6b2-525e61c0697d tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06a78b01bd24d6f9c25dc56c6573ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbeff54a4514dacae8b9f0eb517d2ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:05.519518 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-af78f058-b7c8-4f2f-8c8b-79eb0f2aae7a tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:05.519938 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-af78f058-b7c8-4f2f-8c8b-79eb0f2aae7a tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:05.520382 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-af78f058-b7c8-4f2f-8c8b-79eb0f2aae7a tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:05.521084 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-af78f058-b7c8-4f2f-8c8b-79eb0f2aae7a tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:05.521546 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-af78f058-b7c8-4f2f-8c8b-79eb0f2aae7a tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:05.522285 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-af78f058-b7c8-4f2f-8c8b-79eb0f2aae7a tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:05.523007 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f8af6fd9-fafd-483c-b6b2-525e61c0697d tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] 10.222.0.33 "GET /compute/v2.1/servers/f92b0d2f-5a4d-4c52-9b91-4195c9e78b41" status: 200 len: 1510 microversion: 2.26 time: 0.113977 Sep 23 04:55:05.524945 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2560/5270] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:55:05 2022] GET /compute/v2.1/servers/f92b0d2f-5a4d-4c52-9b91-4195c9e78b41 => generated 1510 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:55:05.539763 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-af78f058-b7c8-4f2f-8c8b-79eb0f2aae7a tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] HTTP exception thrown: Instance c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b could not be found. Sep 23 04:55:05.541415 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-af78f058-b7c8-4f2f-8c8b-79eb0f2aae7a tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Request method failure captured: Sep 23 04:55:05.541415 n-d-846463-3 devstack@n-api.service[122699]: request: DELETE /compute/v2.1/servers/c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b HTTP/1.1 Sep 23 04:55:05.541415 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:55:05.541415 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:55:05.541415 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:55:05.541415 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:55:05.541415 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:55:05.541415 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:55:05.541415 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:55:05.541415 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:55:05.541415 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTuAfGOmhvB_ArWk44zoIW896dMcTTn7_rVhGbRWBp99MTykXbm774Ya_IMwK_RA0C1fGFkZCjQajKsymUXgflAAZ0PV7Eh-ODSy6VAbOiYAmzqjrcnwIndk6_EgvuZCkFFIB6i1JwmOdcmAK91S5EF9Ysn-UQTcBg7uJtAxTe0Z1wM Sep 23 04:55:05.541415 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:55:05.541415 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:55:05.541415 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:55:05.541415 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:55:05.541415 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:55:05.541415 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:55:05.541415 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: a94d0c555b3b4c79b1176db993b58607 Sep 23 04:55:05.541415 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ServerDiskConfigTestJSON-23347216 Sep 23 04:55:05.541415 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:55:05.541415 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:55:05.541415 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a94d0c555b3b4c79b1176db993b58607", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a94d0c555b3b4c79b1176db993b58607"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a94d0c555b3b4c79b1176db993b58607"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a94d0c555b3b4c79b1176db993b58607"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:55:05.541415 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ServerDiskConfigTestJSON-23347216 Sep 23 04:55:05.541415 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: a94d0c555b3b4c79b1176db993b58607 Sep 23 04:55:05.541415 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-23347216 Sep 23 04:55:05.541415 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ServerDiskConfigTestJSON-23347216-project Sep 23 04:55:05.541415 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:55:05.541415 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:55:05.541415 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: c3397cb6388640e3af28e06f80019363 Sep 23 04:55:05.541415 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ServerDiskConfigTestJSON-23347216-project Sep 23 04:55:05.541415 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:55:05.541415 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b could not be found. Sep 23 04:55:05.541415 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': 'c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b'} Sep 23 04:55:05.541415 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:55:05.541415 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:55:05.541415 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:55:05.541415 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:55:05.541415 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:55:05.541415 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:55:05.541415 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:55:05.541415 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:55:05.541415 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:55:05.541415 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:55:05.541415 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b could not be found. Sep 23 04:55:05.541415 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:55:05.541415 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:55:05.541415 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:55:05.541415 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:55:05.541415 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:55:05.541415 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:55:05.541415 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:55:05.541415 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:55:05.541415 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:55:05.541415 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:55:05.541415 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 04:55:05.541415 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 04:55:05.541415 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 04:55:05.541415 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 04:55:05.541415 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:55:05.541415 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:55:05.541415 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:55:05.541415 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:55:05.547566 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b could not be found. Sep 23 04:55:05.547566 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:55:05.547566 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:55:05.547566 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:55:05.547566 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:55:05.547566 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:55:05.547566 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:55:05.547566 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:55:05.547566 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:55:05.547566 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b could not be found. Sep 23 04:55:05.547566 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:55:05.547566 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-af78f058-b7c8-4f2f-8c8b-79eb0f2aae7a tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Returning 404 to user: Instance c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:55:05.547566 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-af78f058-b7c8-4f2f-8c8b-79eb0f2aae7a tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b" status: 404 len: 111 microversion: 2.1 time: 0.035134 Sep 23 04:55:05.547566 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2711/5271] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:55:05 2022] DELETE /compute/v2.1/servers/c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 04:55:05.555111 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-703693c7-e132-482a-9377-e615adc95d9d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:05.555879 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-703693c7-e132-482a-9377-e615adc95d9d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] [instance: c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:05.562577 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-703693c7-e132-482a-9377-e615adc95d9d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:05.563159 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-703693c7-e132-482a-9377-e615adc95d9d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:05.563680 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-703693c7-e132-482a-9377-e615adc95d9d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:05.564487 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-703693c7-e132-482a-9377-e615adc95d9d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:05.565147 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-703693c7-e132-482a-9377-e615adc95d9d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:05.567774 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-703693c7-e132-482a-9377-e615adc95d9d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:05.584973 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-703693c7-e132-482a-9377-e615adc95d9d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] HTTP exception thrown: Instance c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b could not be found. Sep 23 04:55:05.586754 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-703693c7-e132-482a-9377-e615adc95d9d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Request method failure captured: Sep 23 04:55:05.586754 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b HTTP/1.1 Sep 23 04:55:05.586754 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:55:05.586754 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:55:05.586754 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:55:05.586754 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:55:05.586754 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:55:05.586754 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:55:05.586754 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:55:05.586754 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:55:05.586754 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTuAfGOmhvB_ArWk44zoIW896dMcTTn7_rVhGbRWBp99MTykXbm774Ya_IMwK_RA0C1fGFkZCjQajKsymUXgflAAZ0PV7Eh-ODSy6VAbOiYAmzqjrcnwIndk6_EgvuZCkFFIB6i1JwmOdcmAK91S5EF9Ysn-UQTcBg7uJtAxTe0Z1wM Sep 23 04:55:05.586754 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:55:05.586754 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:55:05.586754 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:55:05.586754 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:55:05.586754 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:55:05.586754 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:55:05.586754 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: a94d0c555b3b4c79b1176db993b58607 Sep 23 04:55:05.586754 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ServerDiskConfigTestJSON-23347216 Sep 23 04:55:05.586754 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:55:05.586754 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:55:05.586754 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a94d0c555b3b4c79b1176db993b58607", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a94d0c555b3b4c79b1176db993b58607"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a94d0c555b3b4c79b1176db993b58607"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a94d0c555b3b4c79b1176db993b58607"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:55:05.586754 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ServerDiskConfigTestJSON-23347216 Sep 23 04:55:05.586754 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: a94d0c555b3b4c79b1176db993b58607 Sep 23 04:55:05.586754 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-23347216 Sep 23 04:55:05.586754 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ServerDiskConfigTestJSON-23347216-project Sep 23 04:55:05.586754 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:55:05.586754 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:55:05.586754 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: c3397cb6388640e3af28e06f80019363 Sep 23 04:55:05.586754 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ServerDiskConfigTestJSON-23347216-project Sep 23 04:55:05.586754 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:55:05.586754 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b could not be found. Sep 23 04:55:05.586754 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': 'c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b'} Sep 23 04:55:05.586754 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:55:05.586754 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:55:05.586754 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:55:05.586754 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:55:05.586754 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:55:05.586754 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:55:05.586754 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:55:05.586754 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:55:05.586754 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:55:05.586754 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:55:05.586754 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b could not be found. Sep 23 04:55:05.586754 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:55:05.586754 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:55:05.586754 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:55:05.586754 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:55:05.586754 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:55:05.586754 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:55:05.586754 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:55:05.586754 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:55:05.586754 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:55:05.586754 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:55:05.586754 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:55:05.586754 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:55:05.586754 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:55:05.586754 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:55:05.586754 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:55:05.586754 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:55:05.586754 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b could not be found. Sep 23 04:55:05.586754 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:55:05.586754 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:55:05.586754 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:55:05.591714 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:55:05.591714 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:55:05.591714 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:55:05.591714 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:55:05.591714 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:55:05.591714 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b could not be found. Sep 23 04:55:05.591714 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:55:05.591714 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-703693c7-e132-482a-9377-e615adc95d9d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] Returning 404 to user: Instance c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:55:05.591714 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-703693c7-e132-482a-9377-e615adc95d9d tempest-ServerDiskConfigTestJSON-23347216 tempest-ServerDiskConfigTestJSON-23347216-project] 10.222.0.33 "GET /compute/v2.1/servers/c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b" status: 404 len: 111 microversion: 2.1 time: 0.037595 Sep 23 04:55:05.593922 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2561/5272] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:05 2022] GET /compute/v2.1/servers/c99401bf-d88e-4d4b-bfe9-f9a9dfe96e6b => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:55:05.769086 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-aa232d62-0ced-4f79-aa96-1ea78339702f tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:05.782647 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-aa232d62-0ced-4f79-aa96-1ea78339702f tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] [instance: 6dfb2418-b235-4d35-b109-4bed20d1b96e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:05.793397 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-202268e6-3800-43dc-810f-31fb97c75f25 req-16099ec0-7947-4ebe-bc79-101bc6760865 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f92b0d2f-5a4d-4c52-9b91-4195c9e78b41", "name": "network-vif-deleted", "tag": "549e0e14-c594-43e2-a408-b72248a33d12"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:55:05.803876 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aa232d62-0ced-4f79-aa96-1ea78339702f tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:05.804961 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-202268e6-3800-43dc-810f-31fb97c75f25 req-16099ec0-7947-4ebe-bc79-101bc6760865 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:05.805728 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-202268e6-3800-43dc-810f-31fb97c75f25 req-16099ec0-7947-4ebe-bc79-101bc6760865 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:05.806219 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aa232d62-0ced-4f79-aa96-1ea78339702f tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:05.806626 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-202268e6-3800-43dc-810f-31fb97c75f25 req-16099ec0-7947-4ebe-bc79-101bc6760865 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:05.806774 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aa232d62-0ced-4f79-aa96-1ea78339702f tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:05.807373 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aa232d62-0ced-4f79-aa96-1ea78339702f tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:05.807835 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aa232d62-0ced-4f79-aa96-1ea78339702f tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:05.812626 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aa232d62-0ced-4f79-aa96-1ea78339702f tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:05.822494 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-202268e6-3800-43dc-810f-31fb97c75f25 req-16099ec0-7947-4ebe-bc79-101bc6760865 service nova] Creating event network-vif-deleted:549e0e14-c594-43e2-a408-b72248a33d12 for instance f92b0d2f-5a4d-4c52-9b91-4195c9e78b41 on n-h1-846463-3 Sep 23 04:55:05.828638 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-202268e6-3800-43dc-810f-31fb97c75f25 req-16099ec0-7947-4ebe-bc79-101bc6760865 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040321 Sep 23 04:55:05.830171 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2562/5273] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:55:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:55:05.945423 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-aa232d62-0ced-4f79-aa96-1ea78339702f tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bde73a530f4666aebdd5f7d9fa1046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71874a329e54494bb1b84f31c3826205', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:05.954165 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-aa232d62-0ced-4f79-aa96-1ea78339702f tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] 10.222.0.33 "GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e" status: 200 len: 1296 microversion: 2.1 time: 0.189148 Sep 23 04:55:05.955516 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2712/5274] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:05 2022] GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e => generated 1296 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:55:06.409508 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1c4faa63-0d20-4785-a5c4-a9a23854b75d tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:06.412153 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-1c4faa63-0d20-4785-a5c4-a9a23854b75d tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:06.431018 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1c4faa63-0d20-4785-a5c4-a9a23854b75d tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:06.431950 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1c4faa63-0d20-4785-a5c4-a9a23854b75d tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:06.432627 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1c4faa63-0d20-4785-a5c4-a9a23854b75d tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:06.433581 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1c4faa63-0d20-4785-a5c4-a9a23854b75d tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:06.434541 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1c4faa63-0d20-4785-a5c4-a9a23854b75d tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:06.435343 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1c4faa63-0d20-4785-a5c4-a9a23854b75d tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:06.565399 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f5495535-014f-4086-9a2f-6522c3b47209 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:06.566957 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f5495535-014f-4086-9a2f-6522c3b47209 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] [instance: f92b0d2f-5a4d-4c52-9b91-4195c9e78b41] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:06.583164 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f5495535-014f-4086-9a2f-6522c3b47209 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:06.592868 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f5495535-014f-4086-9a2f-6522c3b47209 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:06.594611 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f5495535-014f-4086-9a2f-6522c3b47209 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:06.599228 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f5495535-014f-4086-9a2f-6522c3b47209 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:06.599917 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f5495535-014f-4086-9a2f-6522c3b47209 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:06.601061 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f5495535-014f-4086-9a2f-6522c3b47209 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:06.654557 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f5495535-014f-4086-9a2f-6522c3b47209 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:06.655444 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f5495535-014f-4086-9a2f-6522c3b47209 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:06.656147 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f5495535-014f-4086-9a2f-6522c3b47209 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:06.656993 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-f5495535-014f-4086-9a2f-6522c3b47209 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lazy-loading 'fault' on Instance uuid f92b0d2f-5a4d-4c52-9b91-4195c9e78b41 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:55:06.777555 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f5495535-014f-4086-9a2f-6522c3b47209 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06a78b01bd24d6f9c25dc56c6573ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbeff54a4514dacae8b9f0eb517d2ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:06.791186 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f5495535-014f-4086-9a2f-6522c3b47209 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e06a78b01bd24d6f9c25dc56c6573ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbeff54a4514dacae8b9f0eb517d2ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:06.792733 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f5495535-014f-4086-9a2f-6522c3b47209 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e06a78b01bd24d6f9c25dc56c6573ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbbeff54a4514dacae8b9f0eb517d2ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:06.794194 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f5495535-014f-4086-9a2f-6522c3b47209 tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] 10.222.0.33 "GET /compute/v2.1/servers/f92b0d2f-5a4d-4c52-9b91-4195c9e78b41" status: 200 len: 1351 microversion: 2.26 time: 0.234065 Sep 23 04:55:06.795263 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2713/5275] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:55:06 2022] GET /compute/v2.1/servers/f92b0d2f-5a4d-4c52-9b91-4195c9e78b41 => generated 1351 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:55:06.890280 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-1c4faa63-0d20-4785-a5c4-a9a23854b75d tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:06.899607 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-1c4faa63-0d20-4785-a5c4-a9a23854b75d tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1666 microversion: 2.1 time: 0.498445 Sep 23 04:55:06.904631 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2563/5276] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:06 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1666 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:55:06.981795 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f2107656-43f5-438f-a092-2c90f327d183 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:06.982601 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f2107656-43f5-438f-a092-2c90f327d183 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] [instance: 6dfb2418-b235-4d35-b109-4bed20d1b96e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:06.988794 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f2107656-43f5-438f-a092-2c90f327d183 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:06.989290 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f2107656-43f5-438f-a092-2c90f327d183 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:06.989943 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f2107656-43f5-438f-a092-2c90f327d183 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:06.990902 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f2107656-43f5-438f-a092-2c90f327d183 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:06.991530 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f2107656-43f5-438f-a092-2c90f327d183 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:06.992124 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f2107656-43f5-438f-a092-2c90f327d183 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:07.742555 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f2107656-43f5-438f-a092-2c90f327d183 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bde73a530f4666aebdd5f7d9fa1046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71874a329e54494bb1b84f31c3826205', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:07.751591 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f2107656-43f5-438f-a092-2c90f327d183 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] 10.222.0.33 "GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e" status: 200 len: 1363 microversion: 2.1 time: 0.777400 Sep 23 04:55:07.752464 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2714/5277] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:06 2022] GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e => generated 1363 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:55:07.821963 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-52bcc797-298a-4b1a-82a3-3beb0d8d5caa tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:07.823185 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-52bcc797-298a-4b1a-82a3-3beb0d8d5caa tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] [instance: f92b0d2f-5a4d-4c52-9b91-4195c9e78b41] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:07.830641 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-52bcc797-298a-4b1a-82a3-3beb0d8d5caa tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:07.831526 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-52bcc797-298a-4b1a-82a3-3beb0d8d5caa tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:07.832191 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-52bcc797-298a-4b1a-82a3-3beb0d8d5caa tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:07.832911 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-52bcc797-298a-4b1a-82a3-3beb0d8d5caa tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:07.833380 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-52bcc797-298a-4b1a-82a3-3beb0d8d5caa tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:07.833841 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-52bcc797-298a-4b1a-82a3-3beb0d8d5caa tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:07.850230 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-52bcc797-298a-4b1a-82a3-3beb0d8d5caa tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] HTTP exception thrown: Instance f92b0d2f-5a4d-4c52-9b91-4195c9e78b41 could not be found. Sep 23 04:55:07.852035 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-52bcc797-298a-4b1a-82a3-3beb0d8d5caa tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Request method failure captured: Sep 23 04:55:07.852035 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/f92b0d2f-5a4d-4c52-9b91-4195c9e78b41 HTTP/1.1 Sep 23 04:55:07.852035 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:55:07.852035 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:55:07.852035 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:55:07.852035 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:55:07.852035 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:55:07.852035 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:55:07.852035 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:55:07.852035 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:55:07.852035 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTwEbfzf4fkBNgsEbBR5nzTW8_0HLWTG7MsbB7i4rwWMnl_JyIZShBU6WfYRJzRrBjSZfJyEh28W4OryWvrlBOvbLBh61PytVXo__UKoh9iJ6YRsq7n1RxSbh8tT12diAH-QYAy_4WIf_EAKnNYZ5rGT_ZBvUT0S_4SpwM_Sld4sIK8 Sep 23 04:55:07.852035 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:55:07.852035 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:55:07.852035 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:55:07.852035 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:55:07.852035 n-d-846463-3 devstack@n-api.service[122698]: X-Openstack-Nova-Api-Version: 2.26 Sep 23 04:55:07.852035 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:55:07.852035 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:55:07.852035 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: cbbeff54a4514dacae8b9f0eb517d2ef Sep 23 04:55:07.852035 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ServerTagsTestJSON-347263874 Sep 23 04:55:07.852035 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:55:07.852035 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:55:07.852035 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cbbeff54a4514dacae8b9f0eb517d2ef", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cbbeff54a4514dacae8b9f0eb517d2ef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cbbeff54a4514dacae8b9f0eb517d2ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cbbeff54a4514dacae8b9f0eb517d2ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:55:07.852035 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ServerTagsTestJSON-347263874 Sep 23 04:55:07.852035 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: cbbeff54a4514dacae8b9f0eb517d2ef Sep 23 04:55:07.852035 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ServerTagsTestJSON-347263874 Sep 23 04:55:07.852035 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ServerTagsTestJSON-347263874-project Sep 23 04:55:07.852035 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:55:07.852035 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:55:07.852035 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: e06a78b01bd24d6f9c25dc56c6573ab6 Sep 23 04:55:07.852035 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ServerTagsTestJSON-347263874-project Sep 23 04:55:07.852035 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:55:07.852035 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance f92b0d2f-5a4d-4c52-9b91-4195c9e78b41 could not be found. Sep 23 04:55:07.852035 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': 'f92b0d2f-5a4d-4c52-9b91-4195c9e78b41'} Sep 23 04:55:07.852035 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:55:07.852035 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:55:07.852035 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:55:07.852035 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:55:07.852035 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:55:07.852035 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:55:07.852035 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:55:07.852035 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:55:07.852035 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:55:07.852035 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:55:07.852035 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f92b0d2f-5a4d-4c52-9b91-4195c9e78b41 could not be found. Sep 23 04:55:07.852035 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:55:07.852035 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:55:07.852035 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:55:07.852035 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:55:07.852035 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:55:07.852035 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:55:07.852035 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:55:07.852035 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:55:07.852035 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:55:07.852035 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:55:07.852035 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:55:07.852035 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:55:07.852035 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:55:07.852035 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:55:07.852035 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:55:07.852035 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:55:07.852035 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f92b0d2f-5a4d-4c52-9b91-4195c9e78b41 could not be found. Sep 23 04:55:07.852035 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:55:07.852035 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:55:07.852035 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:55:07.856374 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:55:07.856374 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:55:07.856374 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:55:07.856374 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:55:07.856374 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:55:07.856374 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f92b0d2f-5a4d-4c52-9b91-4195c9e78b41 could not be found. Sep 23 04:55:07.856374 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:55:07.856374 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-52bcc797-298a-4b1a-82a3-3beb0d8d5caa tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] Returning 404 to user: Instance f92b0d2f-5a4d-4c52-9b91-4195c9e78b41 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:55:07.856374 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-52bcc797-298a-4b1a-82a3-3beb0d8d5caa tempest-ServerTagsTestJSON-347263874 tempest-ServerTagsTestJSON-347263874-project] 10.222.0.33 "GET /compute/v2.1/servers/f92b0d2f-5a4d-4c52-9b91-4195c9e78b41" status: 404 len: 111 microversion: 2.26 time: 0.036568 Sep 23 04:55:07.858825 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2564/5278] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:55:07 2022] GET /compute/v2.1/servers/f92b0d2f-5a4d-4c52-9b91-4195c9e78b41 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 23 04:55:07.915963 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-8b363fdf-f483-4b01-8819-69255d332f1b req-7ed92a0b-6679-4e79-885a-6ab268d43080 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6dfb2418-b235-4d35-b109-4bed20d1b96e", "tag": "369581a4-2ccc-4f7e-ab3f-eaed6fc5cde6"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:55:07.931564 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-deed8cee-6c78-473b-afc2-1dfa91c93257 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:07.932188 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-deed8cee-6c78-473b-afc2-1dfa91c93257 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:07.935430 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-8b363fdf-f483-4b01-8819-69255d332f1b req-7ed92a0b-6679-4e79-885a-6ab268d43080 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:07.936195 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-8b363fdf-f483-4b01-8819-69255d332f1b req-7ed92a0b-6679-4e79-885a-6ab268d43080 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:07.939709 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-8b363fdf-f483-4b01-8819-69255d332f1b req-7ed92a0b-6679-4e79-885a-6ab268d43080 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:07.940616 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=100 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:55:07.946530 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-deed8cee-6c78-473b-afc2-1dfa91c93257 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:07.948782 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-deed8cee-6c78-473b-afc2-1dfa91c93257 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:07.949509 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-deed8cee-6c78-473b-afc2-1dfa91c93257 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:07.954444 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-deed8cee-6c78-473b-afc2-1dfa91c93257 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:07.954925 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-deed8cee-6c78-473b-afc2-1dfa91c93257 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:07.960021 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-deed8cee-6c78-473b-afc2-1dfa91c93257 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:07.965004 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-8b363fdf-f483-4b01-8819-69255d332f1b req-7ed92a0b-6679-4e79-885a-6ab268d43080 service nova] Creating event network-changed:369581a4-2ccc-4f7e-ab3f-eaed6fc5cde6 for instance 6dfb2418-b235-4d35-b109-4bed20d1b96e on n-h1-846463-3 Sep 23 04:55:07.974207 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-8b363fdf-f483-4b01-8819-69255d332f1b req-7ed92a0b-6679-4e79-885a-6ab268d43080 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060281 Sep 23 04:55:07.978214 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2715/5279] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:55:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:55:08.378228 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-deed8cee-6c78-473b-afc2-1dfa91c93257 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:08.387335 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-deed8cee-6c78-473b-afc2-1dfa91c93257 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1670 microversion: 2.1 time: 0.464764 Sep 23 04:55:08.391357 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2565/5280] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:07 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1670 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:55:08.417948 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9ae5718f-4c55-4bea-b82a-148c0e4f021c tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:08.419715 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-9ae5718f-4c55-4bea-b82a-148c0e4f021c tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:08.426527 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:55:08.429904 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9ae5718f-4c55-4bea-b82a-148c0e4f021c tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:08.430837 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9ae5718f-4c55-4bea-b82a-148c0e4f021c tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:08.431285 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9ae5718f-4c55-4bea-b82a-148c0e4f021c tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:08.431986 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9ae5718f-4c55-4bea-b82a-148c0e4f021c tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:08.432628 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9ae5718f-4c55-4bea-b82a-148c0e4f021c tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:08.433062 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9ae5718f-4c55-4bea-b82a-148c0e4f021c tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:08.789029 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-30befb74-f530-4053-b201-2d2b6c96ac89 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:08.795367 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-30befb74-f530-4053-b201-2d2b6c96ac89 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] [instance: 6dfb2418-b235-4d35-b109-4bed20d1b96e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:08.809255 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-30befb74-f530-4053-b201-2d2b6c96ac89 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:08.810257 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-30befb74-f530-4053-b201-2d2b6c96ac89 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:08.811387 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-30befb74-f530-4053-b201-2d2b6c96ac89 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:08.814655 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-30befb74-f530-4053-b201-2d2b6c96ac89 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:08.816037 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-30befb74-f530-4053-b201-2d2b6c96ac89 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:08.819680 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-30befb74-f530-4053-b201-2d2b6c96ac89 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:08.838458 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-9ae5718f-4c55-4bea-b82a-148c0e4f021c tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:08.849864 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-9ae5718f-4c55-4bea-b82a-148c0e4f021c tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1670 microversion: 2.1 time: 0.436322 Sep 23 04:55:08.850996 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2716/5281] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:08 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1670 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:55:08.883962 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-59da7939-193f-42bb-ba4e-20fb6b7464bb tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:08.884659 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-59da7939-193f-42bb-ba4e-20fb6b7464bb tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:08.891940 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-59da7939-193f-42bb-ba4e-20fb6b7464bb tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:08.892434 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-59da7939-193f-42bb-ba4e-20fb6b7464bb tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:08.893450 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-59da7939-193f-42bb-ba4e-20fb6b7464bb tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:08.900084 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-59da7939-193f-42bb-ba4e-20fb6b7464bb tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:08.900084 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-59da7939-193f-42bb-ba4e-20fb6b7464bb tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:08.900084 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-59da7939-193f-42bb-ba4e-20fb6b7464bb tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:09.291206 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=12 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:55:09.579467 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-30befb74-f530-4053-b201-2d2b6c96ac89 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bde73a530f4666aebdd5f7d9fa1046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71874a329e54494bb1b84f31c3826205', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:09.599199 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-30befb74-f530-4053-b201-2d2b6c96ac89 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] 10.222.0.33 "GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e" status: 200 len: 1363 microversion: 2.1 time: 0.816362 Sep 23 04:55:09.627507 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2566/5282] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:08 2022] GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e => generated 1363 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:55:09.780986 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-59da7939-193f-42bb-ba4e-20fb6b7464bb tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:09.800577 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-59da7939-193f-42bb-ba4e-20fb6b7464bb tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1670 microversion: 2.1 time: 0.924517 Sep 23 04:55:09.818098 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2717/5283] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:08 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1670 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:55:09.830441 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5ef05ed6-8e3d-48ab-b4b2-719280bf5cc4 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:09.832479 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5ef05ed6-8e3d-48ab-b4b2-719280bf5cc4 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:09.840184 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5ef05ed6-8e3d-48ab-b4b2-719280bf5cc4 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:09.840684 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5ef05ed6-8e3d-48ab-b4b2-719280bf5cc4 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:09.844757 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5ef05ed6-8e3d-48ab-b4b2-719280bf5cc4 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:09.844757 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5ef05ed6-8e3d-48ab-b4b2-719280bf5cc4 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:09.844757 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5ef05ed6-8e3d-48ab-b4b2-719280bf5cc4 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:09.844757 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5ef05ed6-8e3d-48ab-b4b2-719280bf5cc4 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:10.287691 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-5ef05ed6-8e3d-48ab-b4b2-719280bf5cc4 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:10.302666 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5ef05ed6-8e3d-48ab-b4b2-719280bf5cc4 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1670 microversion: 2.1 time: 0.476720 Sep 23 04:55:10.304630 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2567/5284] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:09 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1670 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:55:10.334084 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9a5df699-273e-48c3-90d5-d7fb2a3b6b74 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:10.338000 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-9a5df699-273e-48c3-90d5-d7fb2a3b6b74 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:10.352950 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9a5df699-273e-48c3-90d5-d7fb2a3b6b74 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:10.354673 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9a5df699-273e-48c3-90d5-d7fb2a3b6b74 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:10.355364 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9a5df699-273e-48c3-90d5-d7fb2a3b6b74 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:10.356882 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9a5df699-273e-48c3-90d5-d7fb2a3b6b74 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:10.357608 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9a5df699-273e-48c3-90d5-d7fb2a3b6b74 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:10.358291 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9a5df699-273e-48c3-90d5-d7fb2a3b6b74 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:10.632259 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6ac2334b-a994-4252-9249-fed80a283a5d tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:10.632881 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-6ac2334b-a994-4252-9249-fed80a283a5d tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] [instance: 6dfb2418-b235-4d35-b109-4bed20d1b96e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:10.639763 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6ac2334b-a994-4252-9249-fed80a283a5d tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:10.640330 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6ac2334b-a994-4252-9249-fed80a283a5d tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:10.641671 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6ac2334b-a994-4252-9249-fed80a283a5d tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:10.643706 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6ac2334b-a994-4252-9249-fed80a283a5d tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:10.644921 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6ac2334b-a994-4252-9249-fed80a283a5d tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:10.645583 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6ac2334b-a994-4252-9249-fed80a283a5d tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:10.650633 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:55:10.795197 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-9a5df699-273e-48c3-90d5-d7fb2a3b6b74 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:10.807266 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-9a5df699-273e-48c3-90d5-d7fb2a3b6b74 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1670 microversion: 2.1 time: 0.482301 Sep 23 04:55:10.822242 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2718/5285] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:10 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1670 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:55:10.829339 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6a272a4f-201d-4c7d-9135-9e74653f0ce0 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:55:10.829878 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-6a272a4f-201d-4c7d-9135-9e74653f0ce0 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:10.835948 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6a272a4f-201d-4c7d-9135-9e74653f0ce0 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:10.836448 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6a272a4f-201d-4c7d-9135-9e74653f0ce0 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:10.836892 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6a272a4f-201d-4c7d-9135-9e74653f0ce0 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:10.837604 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6a272a4f-201d-4c7d-9135-9e74653f0ce0 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:10.838099 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6a272a4f-201d-4c7d-9135-9e74653f0ce0 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:10.839015 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6a272a4f-201d-4c7d-9135-9e74653f0ce0 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:10.842407 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:55:10.864383 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-6a272a4f-201d-4c7d-9135-9e74653f0ce0 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lazy-loading 'flavor' on Instance uuid 4fb569cf-4457-4695-ad5f-fcb78f0964c5 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:55:10.990868 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6ac2334b-a994-4252-9249-fed80a283a5d tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bde73a530f4666aebdd5f7d9fa1046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71874a329e54494bb1b84f31c3826205', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:11.003508 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-6ac2334b-a994-4252-9249-fed80a283a5d tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] 10.222.0.33 "GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e" status: 200 len: 1363 microversion: 2.1 time: 0.375712 Sep 23 04:55:11.004178 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2568/5286] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:10 2022] GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e => generated 1363 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:55:11.231698 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6a272a4f-201d-4c7d-9135-9e74653f0ce0 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "POST /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5/action" status: 202 len: 0 microversion: 2.1 time: 0.405998 Sep 23 04:55:11.232356 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2719/5287] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:55:10 2022] POST /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5/action => generated 0 bytes in 408 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 23 04:55:11.241275 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a9368e21-8f05-4dbb-8340-15967fb375c3 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:11.241922 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a9368e21-8f05-4dbb-8340-15967fb375c3 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:11.261569 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a9368e21-8f05-4dbb-8340-15967fb375c3 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:11.262169 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a9368e21-8f05-4dbb-8340-15967fb375c3 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:11.263551 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a9368e21-8f05-4dbb-8340-15967fb375c3 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:11.264508 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a9368e21-8f05-4dbb-8340-15967fb375c3 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:11.266353 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a9368e21-8f05-4dbb-8340-15967fb375c3 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:11.267021 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a9368e21-8f05-4dbb-8340-15967fb375c3 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:11.991846 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a9368e21-8f05-4dbb-8340-15967fb375c3 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:12.019517 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a9368e21-8f05-4dbb-8340-15967fb375c3 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1678 microversion: 2.1 time: 0.782546 Sep 23 04:55:12.023395 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2569/5288] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:11 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1678 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:55:12.050124 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-bd336b25-b0ad-4fb3-814e-306bb0201244 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:12.052601 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-bd336b25-b0ad-4fb3-814e-306bb0201244 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] [instance: 6dfb2418-b235-4d35-b109-4bed20d1b96e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:12.063731 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bd336b25-b0ad-4fb3-814e-306bb0201244 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:12.064529 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bd336b25-b0ad-4fb3-814e-306bb0201244 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:12.065370 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bd336b25-b0ad-4fb3-814e-306bb0201244 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:12.066430 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bd336b25-b0ad-4fb3-814e-306bb0201244 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:12.067295 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bd336b25-b0ad-4fb3-814e-306bb0201244 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:12.068051 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bd336b25-b0ad-4fb3-814e-306bb0201244 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:12.495121 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-bd336b25-b0ad-4fb3-814e-306bb0201244 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bde73a530f4666aebdd5f7d9fa1046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71874a329e54494bb1b84f31c3826205', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:12.502906 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-bd336b25-b0ad-4fb3-814e-306bb0201244 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] 10.222.0.33 "GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e" status: 200 len: 1363 microversion: 2.1 time: 0.464725 Sep 23 04:55:12.503487 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2720/5289] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:12 2022] GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e => generated 1363 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:55:13.048875 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e1b0924a-f35f-4b46-8a41-b18e8a8a72e1 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:13.049648 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e1b0924a-f35f-4b46-8a41-b18e8a8a72e1 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:13.058196 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e1b0924a-f35f-4b46-8a41-b18e8a8a72e1 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:13.062254 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e1b0924a-f35f-4b46-8a41-b18e8a8a72e1 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:13.062254 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e1b0924a-f35f-4b46-8a41-b18e8a8a72e1 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:13.062254 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e1b0924a-f35f-4b46-8a41-b18e8a8a72e1 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:13.062254 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e1b0924a-f35f-4b46-8a41-b18e8a8a72e1 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:13.062254 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e1b0924a-f35f-4b46-8a41-b18e8a8a72e1 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:13.526956 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-88cf0e70-75fe-42ae-be7a-ebd1eb7e8d60 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:13.530259 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-88cf0e70-75fe-42ae-be7a-ebd1eb7e8d60 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] [instance: 6dfb2418-b235-4d35-b109-4bed20d1b96e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:13.530392 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e1b0924a-f35f-4b46-8a41-b18e8a8a72e1 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:13.539204 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-88cf0e70-75fe-42ae-be7a-ebd1eb7e8d60 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:13.539711 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-88cf0e70-75fe-42ae-be7a-ebd1eb7e8d60 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:13.543729 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e1b0924a-f35f-4b46-8a41-b18e8a8a72e1 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1661 microversion: 2.1 time: 0.498712 Sep 23 04:55:13.545518 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2570/5290] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:13 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1661 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:55:13.557017 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-88cf0e70-75fe-42ae-be7a-ebd1eb7e8d60 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:13.559218 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-88cf0e70-75fe-42ae-be7a-ebd1eb7e8d60 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:13.561752 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-88cf0e70-75fe-42ae-be7a-ebd1eb7e8d60 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:13.562758 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-88cf0e70-75fe-42ae-be7a-ebd1eb7e8d60 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:13.571376 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-96d5b580-76da-49aa-944a-6587a9ccec28 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:55:13.572188 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-96d5b580-76da-49aa-944a-6587a9ccec28 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:13.586965 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-96d5b580-76da-49aa-944a-6587a9ccec28 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:13.590523 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-96d5b580-76da-49aa-944a-6587a9ccec28 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:13.591164 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-96d5b580-76da-49aa-944a-6587a9ccec28 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:13.593496 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-96d5b580-76da-49aa-944a-6587a9ccec28 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:13.594181 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-96d5b580-76da-49aa-944a-6587a9ccec28 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:13.594840 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-96d5b580-76da-49aa-944a-6587a9ccec28 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:13.897786 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-96d5b580-76da-49aa-944a-6587a9ccec28 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "POST /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5/action" status: 202 len: 0 microversion: 2.1 time: 0.330750 Sep 23 04:55:13.916437 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2571/5291] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:55:13 2022] POST /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5/action => generated 0 bytes in 352 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:55:13.938298 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ea2dd258-904a-4488-b02b-3eb92777ce65 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:13.940730 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-ea2dd258-904a-4488-b02b-3eb92777ce65 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:13.962058 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ea2dd258-904a-4488-b02b-3eb92777ce65 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:13.962671 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ea2dd258-904a-4488-b02b-3eb92777ce65 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:13.964361 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ea2dd258-904a-4488-b02b-3eb92777ce65 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:13.966020 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ea2dd258-904a-4488-b02b-3eb92777ce65 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:13.966752 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ea2dd258-904a-4488-b02b-3eb92777ce65 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:13.967437 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ea2dd258-904a-4488-b02b-3eb92777ce65 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:13.967749 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-88cf0e70-75fe-42ae-be7a-ebd1eb7e8d60 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bde73a530f4666aebdd5f7d9fa1046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71874a329e54494bb1b84f31c3826205', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:13.991361 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-88cf0e70-75fe-42ae-be7a-ebd1eb7e8d60 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] 10.222.0.33 "GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e" status: 200 len: 1363 microversion: 2.1 time: 0.467872 Sep 23 04:55:13.994067 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2721/5292] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:13 2022] GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e => generated 1363 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:55:14.278052 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-a79c477f-e398-4bbc-ad97-910f9fcd6e99 req-e7aa197c-77a5-4e3b-ae5a-ea26d2177120 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dfb2418-b235-4d35-b109-4bed20d1b96e", "name": "network-vif-plugged", "status": "completed", "tag": "369581a4-2ccc-4f7e-ab3f-eaed6fc5cde6"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:55:14.289528 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-a79c477f-e398-4bbc-ad97-910f9fcd6e99 req-e7aa197c-77a5-4e3b-ae5a-ea26d2177120 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:14.290047 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-a79c477f-e398-4bbc-ad97-910f9fcd6e99 req-e7aa197c-77a5-4e3b-ae5a-ea26d2177120 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:14.290541 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-a79c477f-e398-4bbc-ad97-910f9fcd6e99 req-e7aa197c-77a5-4e3b-ae5a-ea26d2177120 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:14.304588 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-a79c477f-e398-4bbc-ad97-910f9fcd6e99 req-e7aa197c-77a5-4e3b-ae5a-ea26d2177120 service nova] Creating event network-vif-plugged:369581a4-2ccc-4f7e-ab3f-eaed6fc5cde6 for instance 6dfb2418-b235-4d35-b109-4bed20d1b96e on n-h1-846463-3 Sep 23 04:55:14.310959 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-a79c477f-e398-4bbc-ad97-910f9fcd6e99 req-e7aa197c-77a5-4e3b-ae5a-ea26d2177120 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036627 Sep 23 04:55:14.311954 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2722/5293] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:55:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:55:14.813727 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ea2dd258-904a-4488-b02b-3eb92777ce65 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:14.823239 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ea2dd258-904a-4488-b02b-3eb92777ce65 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1667 microversion: 2.1 time: 0.901662 Sep 23 04:55:14.825106 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2572/5294] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:13 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1667 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:55:15.017550 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-16e0fa0b-7b7c-48bd-9403-fdda6c00caf6 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:15.018407 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-16e0fa0b-7b7c-48bd-9403-fdda6c00caf6 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] [instance: 6dfb2418-b235-4d35-b109-4bed20d1b96e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:15.025288 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-16e0fa0b-7b7c-48bd-9403-fdda6c00caf6 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:15.025782 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-16e0fa0b-7b7c-48bd-9403-fdda6c00caf6 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:15.026261 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-16e0fa0b-7b7c-48bd-9403-fdda6c00caf6 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:15.027164 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-16e0fa0b-7b7c-48bd-9403-fdda6c00caf6 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:15.027637 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-16e0fa0b-7b7c-48bd-9403-fdda6c00caf6 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:15.028074 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-16e0fa0b-7b7c-48bd-9403-fdda6c00caf6 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:15.364069 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-16e0fa0b-7b7c-48bd-9403-fdda6c00caf6 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bde73a530f4666aebdd5f7d9fa1046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71874a329e54494bb1b84f31c3826205', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:15.372526 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-16e0fa0b-7b7c-48bd-9403-fdda6c00caf6 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] 10.222.0.33 "GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e" status: 200 len: 1363 microversion: 2.1 time: 0.359505 Sep 23 04:55:15.373793 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2723/5295] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:15 2022] GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e => generated 1363 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:55:15.848270 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-22c266db-47b6-40f9-94c3-771ba9edd330 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:15.848972 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-22c266db-47b6-40f9-94c3-771ba9edd330 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:15.868229 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-22c266db-47b6-40f9-94c3-771ba9edd330 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:15.871045 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-22c266db-47b6-40f9-94c3-771ba9edd330 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:15.873717 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-22c266db-47b6-40f9-94c3-771ba9edd330 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:15.873717 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-22c266db-47b6-40f9-94c3-771ba9edd330 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:15.873717 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-22c266db-47b6-40f9-94c3-771ba9edd330 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:15.873717 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-22c266db-47b6-40f9-94c3-771ba9edd330 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:16.275187 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-22c266db-47b6-40f9-94c3-771ba9edd330 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:16.286499 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-22c266db-47b6-40f9-94c3-771ba9edd330 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1670 microversion: 2.1 time: 0.442775 Sep 23 04:55:16.287601 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2573/5296] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:15 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1670 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:55:16.310335 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-44163cf0-8aa9-442e-9a0f-9be890120fba tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:16.312004 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-44163cf0-8aa9-442e-9a0f-9be890120fba tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:16.322044 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-44163cf0-8aa9-442e-9a0f-9be890120fba tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:16.322970 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-44163cf0-8aa9-442e-9a0f-9be890120fba tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:16.323666 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-44163cf0-8aa9-442e-9a0f-9be890120fba tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:16.325037 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-44163cf0-8aa9-442e-9a0f-9be890120fba tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:16.325738 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-44163cf0-8aa9-442e-9a0f-9be890120fba tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:16.326351 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-44163cf0-8aa9-442e-9a0f-9be890120fba tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:16.397011 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a79eeeee-3ec0-4902-8e40-399813c6fee0 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:16.397860 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a79eeeee-3ec0-4902-8e40-399813c6fee0 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] [instance: 6dfb2418-b235-4d35-b109-4bed20d1b96e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:16.405521 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a79eeeee-3ec0-4902-8e40-399813c6fee0 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:16.406326 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a79eeeee-3ec0-4902-8e40-399813c6fee0 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:16.406951 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a79eeeee-3ec0-4902-8e40-399813c6fee0 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:16.407903 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a79eeeee-3ec0-4902-8e40-399813c6fee0 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:16.408560 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a79eeeee-3ec0-4902-8e40-399813c6fee0 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:16.408983 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a79eeeee-3ec0-4902-8e40-399813c6fee0 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:16.754149 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-44163cf0-8aa9-442e-9a0f-9be890120fba tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:16.782807 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-44163cf0-8aa9-442e-9a0f-9be890120fba tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1670 microversion: 2.1 time: 0.474949 Sep 23 04:55:16.795179 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2724/5297] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:16 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1670 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:55:16.801226 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a79eeeee-3ec0-4902-8e40-399813c6fee0 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bde73a530f4666aebdd5f7d9fa1046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71874a329e54494bb1b84f31c3826205', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:16.812927 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a79eeeee-3ec0-4902-8e40-399813c6fee0 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] 10.222.0.33 "GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e" status: 200 len: 1548 microversion: 2.1 time: 0.420277 Sep 23 04:55:16.814010 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2574/5298] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:16 2022] GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e => generated 1548 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:55:16.838430 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-27d35e46-5092-4e13-8ac5-e86815efadf2 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:16.839304 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-27d35e46-5092-4e13-8ac5-e86815efadf2 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 3354b397-f391-47f2-8ded-f9227bfecb6f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:16.842526 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8c7411d9-defa-49db-9596-63d6fb4b2a29 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:16.846627 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8c7411d9-defa-49db-9596-63d6fb4b2a29 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] [instance: 6dfb2418-b235-4d35-b109-4bed20d1b96e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:16.847231 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-27d35e46-5092-4e13-8ac5-e86815efadf2 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:16.847751 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-27d35e46-5092-4e13-8ac5-e86815efadf2 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:16.848203 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-27d35e46-5092-4e13-8ac5-e86815efadf2 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:16.848950 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-27d35e46-5092-4e13-8ac5-e86815efadf2 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:16.850220 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-27d35e46-5092-4e13-8ac5-e86815efadf2 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:16.850671 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-27d35e46-5092-4e13-8ac5-e86815efadf2 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:16.857337 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8c7411d9-defa-49db-9596-63d6fb4b2a29 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:16.858655 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8c7411d9-defa-49db-9596-63d6fb4b2a29 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:16.859389 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8c7411d9-defa-49db-9596-63d6fb4b2a29 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:16.860378 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8c7411d9-defa-49db-9596-63d6fb4b2a29 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:16.861079 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8c7411d9-defa-49db-9596-63d6fb4b2a29 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:16.861742 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8c7411d9-defa-49db-9596-63d6fb4b2a29 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:16.883677 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-27d35e46-5092-4e13-8ac5-e86815efadf2 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 3354b397-f391-47f2-8ded-f9227bfecb6f] Going to try to terminate instance {{(pid=122699) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:55:16.891242 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.compute.api [None req-27d35e46-5092-4e13-8ac5-e86815efadf2 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 3354b397-f391-47f2-8ded-f9227bfecb6f] Working on deleting snapshot dfc776cf-b2be-4b4b-a92b-374a6d2df903 from shelved instance... Sep 23 04:55:17.208891 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8c7411d9-defa-49db-9596-63d6fb4b2a29 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] 10.222.0.33 "GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.373874 Sep 23 04:55:17.209493 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2575/5299] 10.222.0.33 () {58 vars in 1275 bytes} [Fri Sep 23 04:55:16 2022] GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e/os-interface => generated 284 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:55:18.510656 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-27d35e46-5092-4e13-8ac5-e86815efadf2 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 3354b397-f391-47f2-8ded-f9227bfecb6f] Doing local delete in cell feac528b-4983-4e61-aae7-f1973fe5bc2c(cell1) {{(pid=122699) _delete /opt/stack/nova/nova/compute/api.py:2546}} Sep 23 04:55:18.511434 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-27d35e46-5092-4e13-8ac5-e86815efadf2 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:18.511875 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-27d35e46-5092-4e13-8ac5-e86815efadf2 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:18.512335 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-27d35e46-5092-4e13-8ac5-e86815efadf2 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:18.512746 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.compute.api [None req-27d35e46-5092-4e13-8ac5-e86815efadf2 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 3354b397-f391-47f2-8ded-f9227bfecb6f] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Sep 23 04:55:18.521093 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.neutron [None req-27d35e46-5092-4e13-8ac5-e86815efadf2 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 3354b397-f391-47f2-8ded-f9227bfecb6f] deallocate_for_instance() {{(pid=122699) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Sep 23 04:55:20.112331 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-836205f2-e7c4-4361-b424-9552b98e880a req-f9acb826-c356-4808-acd8-68a2bc7848a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6dfb2418-b235-4d35-b109-4bed20d1b96e", "tag": "369581a4-2ccc-4f7e-ab3f-eaed6fc5cde6"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:55:20.132540 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-836205f2-e7c4-4361-b424-9552b98e880a req-f9acb826-c356-4808-acd8-68a2bc7848a7 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:20.133036 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-836205f2-e7c4-4361-b424-9552b98e880a req-f9acb826-c356-4808-acd8-68a2bc7848a7 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:20.135933 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-836205f2-e7c4-4361-b424-9552b98e880a req-f9acb826-c356-4808-acd8-68a2bc7848a7 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:20.154899 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-836205f2-e7c4-4361-b424-9552b98e880a req-f9acb826-c356-4808-acd8-68a2bc7848a7 service nova] Creating event network-changed:369581a4-2ccc-4f7e-ab3f-eaed6fc5cde6 for instance 6dfb2418-b235-4d35-b109-4bed20d1b96e on n-h1-846463-3 Sep 23 04:55:20.161223 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-836205f2-e7c4-4361-b424-9552b98e880a req-f9acb826-c356-4808-acd8-68a2bc7848a7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057766 Sep 23 04:55:20.162845 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2576/5300] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:55:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:55:20.357621 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.neutron [None req-27d35e46-5092-4e13-8ac5-e86815efadf2 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 3354b397-f391-47f2-8ded-f9227bfecb6f] Updating instance_info_cache with network_info: [] {{(pid=122699) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 23 04:55:21.036894 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-27d35e46-5092-4e13-8ac5-e86815efadf2 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "DELETE /compute/v2.1/servers/3354b397-f391-47f2-8ded-f9227bfecb6f" status: 204 len: 0 microversion: 2.1 time: 4.212248 Sep 23 04:55:21.038084 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2725/5301] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:55:16 2022] DELETE /compute/v2.1/servers/3354b397-f391-47f2-8ded-f9227bfecb6f => generated 0 bytes in 4224 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:55:21.046713 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e057e8b5-cf4a-4b0f-a76e-e24d17ac43e5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:21.048338 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e057e8b5-cf4a-4b0f-a76e-e24d17ac43e5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 3354b397-f391-47f2-8ded-f9227bfecb6f] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:21.066829 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e057e8b5-cf4a-4b0f-a76e-e24d17ac43e5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:21.067363 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e057e8b5-cf4a-4b0f-a76e-e24d17ac43e5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:21.067712 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e057e8b5-cf4a-4b0f-a76e-e24d17ac43e5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:21.071932 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e057e8b5-cf4a-4b0f-a76e-e24d17ac43e5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:21.072432 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e057e8b5-cf4a-4b0f-a76e-e24d17ac43e5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:21.074951 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e057e8b5-cf4a-4b0f-a76e-e24d17ac43e5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:21.121047 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-e057e8b5-cf4a-4b0f-a76e-e24d17ac43e5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] HTTP exception thrown: Instance 3354b397-f391-47f2-8ded-f9227bfecb6f could not be found. Sep 23 04:55:21.123864 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e057e8b5-cf4a-4b0f-a76e-e24d17ac43e5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Request method failure captured: Sep 23 04:55:21.123864 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/3354b397-f391-47f2-8ded-f9227bfecb6f HTTP/1.1 Sep 23 04:55:21.123864 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:55:21.123864 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:55:21.123864 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:55:21.123864 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:55:21.123864 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:55:21.123864 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:55:21.123864 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:55:21.123864 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:55:21.123864 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTo3L7rPLSTfUV5pEDb1r3o2InNz2xVZb49WfY5_7ohSycSRkpblNb-lg3W6XL2Ai8OaA9THkgwtcWGmxSj0UZ4x-A-nrlghfegV0nGu08AcEc2fcMb2XMVF2A7TFyZB5NC63XPko5HHmiQcxjEHCZqFI55a6beSN65iF07uDP5zXrg Sep 23 04:55:21.123864 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:55:21.123864 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:55:21.123864 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:55:21.123864 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:55:21.123864 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:55:21.123864 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:55:21.123864 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 2a45d69316a648fcb9c56190aaec5376 Sep 23 04:55:21.123864 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ServerActionsTestJSON-1180260513 Sep 23 04:55:21.123864 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:55:21.123864 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:55:21.123864 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2a45d69316a648fcb9c56190aaec5376", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2a45d69316a648fcb9c56190aaec5376"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2a45d69316a648fcb9c56190aaec5376"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2a45d69316a648fcb9c56190aaec5376"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:55:21.123864 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ServerActionsTestJSON-1180260513 Sep 23 04:55:21.123864 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 2a45d69316a648fcb9c56190aaec5376 Sep 23 04:55:21.123864 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ServerActionsTestJSON-1180260513 Sep 23 04:55:21.123864 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ServerActionsTestJSON-1180260513-project Sep 23 04:55:21.123864 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:55:21.123864 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:55:21.123864 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: f5e3a6e455e8483b8ce93ad380793335 Sep 23 04:55:21.123864 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ServerActionsTestJSON-1180260513-project Sep 23 04:55:21.123864 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:55:21.123864 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 3354b397-f391-47f2-8ded-f9227bfecb6f could not be found. Sep 23 04:55:21.123864 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '3354b397-f391-47f2-8ded-f9227bfecb6f'} Sep 23 04:55:21.123864 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:55:21.123864 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:55:21.123864 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:55:21.123864 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:55:21.123864 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:55:21.123864 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:55:21.123864 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:55:21.123864 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:55:21.123864 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:55:21.123864 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:55:21.123864 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3354b397-f391-47f2-8ded-f9227bfecb6f could not be found. Sep 23 04:55:21.123864 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:55:21.123864 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:55:21.123864 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:55:21.123864 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:55:21.123864 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:55:21.123864 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:55:21.123864 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:55:21.123864 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:55:21.123864 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:55:21.123864 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:55:21.123864 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:55:21.123864 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:55:21.123864 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:55:21.123864 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:55:21.123864 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:55:21.123864 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:55:21.123864 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3354b397-f391-47f2-8ded-f9227bfecb6f could not be found. Sep 23 04:55:21.123864 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:55:21.123864 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:55:21.123864 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:55:21.129119 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:55:21.129119 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:55:21.129119 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:55:21.129119 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:55:21.129119 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:55:21.129119 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3354b397-f391-47f2-8ded-f9227bfecb6f could not be found. Sep 23 04:55:21.129119 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:55:21.131275 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e057e8b5-cf4a-4b0f-a76e-e24d17ac43e5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Returning 404 to user: Instance 3354b397-f391-47f2-8ded-f9227bfecb6f could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:55:21.132319 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e057e8b5-cf4a-4b0f-a76e-e24d17ac43e5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/3354b397-f391-47f2-8ded-f9227bfecb6f" status: 404 len: 111 microversion: 2.1 time: 0.090511 Sep 23 04:55:21.137062 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2577/5302] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:21 2022] GET /compute/v2.1/servers/3354b397-f391-47f2-8ded-f9227bfecb6f => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:55:21.143048 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-edf60c2f-e08c-4153-a897-9bde61e81da3 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:21.143562 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-edf60c2f-e08c-4153-a897-9bde61e81da3 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 9dc683ca-0f6d-42d9-bf36-5bb1a5cc3286] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:21.153629 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-edf60c2f-e08c-4153-a897-9bde61e81da3 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:21.155026 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-edf60c2f-e08c-4153-a897-9bde61e81da3 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:21.155026 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-edf60c2f-e08c-4153-a897-9bde61e81da3 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:21.159664 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-edf60c2f-e08c-4153-a897-9bde61e81da3 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:21.160177 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-edf60c2f-e08c-4153-a897-9bde61e81da3 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:21.175314 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-edf60c2f-e08c-4153-a897-9bde61e81da3 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:21.240789 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-edf60c2f-e08c-4153-a897-9bde61e81da3 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 9dc683ca-0f6d-42d9-bf36-5bb1a5cc3286] Going to try to terminate instance {{(pid=122699) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:55:21.502581 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=19,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:55:21.759561 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-edf60c2f-e08c-4153-a897-9bde61e81da3 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9dc683ca-0f6d-42d9-bf36-5bb1a5cc3286" status: 204 len: 0 microversion: 2.1 time: 0.621612 Sep 23 04:55:21.760487 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2726/5303] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:55:21 2022] DELETE /compute/v2.1/servers/9dc683ca-0f6d-42d9-bf36-5bb1a5cc3286 => generated 0 bytes in 623 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:55:21.773314 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c65881c3-df46-4981-9e49-b6bd0dbd6b24 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:21.774315 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c65881c3-df46-4981-9e49-b6bd0dbd6b24 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 9dc683ca-0f6d-42d9-bf36-5bb1a5cc3286] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:21.782484 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c65881c3-df46-4981-9e49-b6bd0dbd6b24 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:21.783827 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c65881c3-df46-4981-9e49-b6bd0dbd6b24 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:21.784513 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c65881c3-df46-4981-9e49-b6bd0dbd6b24 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:21.789056 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c65881c3-df46-4981-9e49-b6bd0dbd6b24 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:21.798637 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c65881c3-df46-4981-9e49-b6bd0dbd6b24 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:21.799276 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c65881c3-df46-4981-9e49-b6bd0dbd6b24 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:22.057198 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c65881c3-df46-4981-9e49-b6bd0dbd6b24 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:22.080093 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c65881c3-df46-4981-9e49-b6bd0dbd6b24 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/9dc683ca-0f6d-42d9-bf36-5bb1a5cc3286" status: 200 len: 1466 microversion: 2.1 time: 0.313804 Sep 23 04:55:22.091533 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2578/5304] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:21 2022] GET /compute/v2.1/servers/9dc683ca-0f6d-42d9-bf36-5bb1a5cc3286 => generated 1466 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:55:22.241928 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-58e8c93f-c5f6-4ad5-be7f-5809b8e8fd2b req-6e044cf3-40cd-41be-a8ce-d095143d1b28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3354b397-f391-47f2-8ded-f9227bfecb6f", "name": "network-vif-deleted", "tag": "2e084b59-e468-45fb-8081-c4bafdb31c08"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:55:22.259878 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-58e8c93f-c5f6-4ad5-be7f-5809b8e8fd2b req-6e044cf3-40cd-41be-a8ce-d095143d1b28 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:22.260384 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-58e8c93f-c5f6-4ad5-be7f-5809b8e8fd2b req-6e044cf3-40cd-41be-a8ce-d095143d1b28 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:22.260829 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-58e8c93f-c5f6-4ad5-be7f-5809b8e8fd2b req-6e044cf3-40cd-41be-a8ce-d095143d1b28 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:22.287710 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.compute.server_external_events [req-58e8c93f-c5f6-4ad5-be7f-5809b8e8fd2b req-6e044cf3-40cd-41be-a8ce-d095143d1b28 service nova] Unable to find a host for instance 3354b397-f391-47f2-8ded-f9227bfecb6f. Dropping event network-vif-deleted {{(pid=122699) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 23 04:55:22.289582 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-58e8c93f-c5f6-4ad5-be7f-5809b8e8fd2b req-6e044cf3-40cd-41be-a8ce-d095143d1b28 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.052690 Sep 23 04:55:22.290863 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2727/5305] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:55:22 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 55 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 23 04:55:23.110416 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-fd852222-9d74-4f3f-8eb5-fb75a3a42a5d tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:23.111337 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-fd852222-9d74-4f3f-8eb5-fb75a3a42a5d tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 9dc683ca-0f6d-42d9-bf36-5bb1a5cc3286] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:23.124976 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fd852222-9d74-4f3f-8eb5-fb75a3a42a5d tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:23.125747 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fd852222-9d74-4f3f-8eb5-fb75a3a42a5d tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:23.126595 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fd852222-9d74-4f3f-8eb5-fb75a3a42a5d tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:23.127544 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fd852222-9d74-4f3f-8eb5-fb75a3a42a5d tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:23.128202 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fd852222-9d74-4f3f-8eb5-fb75a3a42a5d tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:23.128826 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fd852222-9d74-4f3f-8eb5-fb75a3a42a5d tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:23.268137 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-fd852222-9d74-4f3f-8eb5-fb75a3a42a5d tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:23.280527 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-fd852222-9d74-4f3f-8eb5-fb75a3a42a5d tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/9dc683ca-0f6d-42d9-bf36-5bb1a5cc3286" status: 200 len: 1466 microversion: 2.1 time: 0.175171 Sep 23 04:55:23.281452 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2579/5306] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:23 2022] GET /compute/v2.1/servers/9dc683ca-0f6d-42d9-bf36-5bb1a5cc3286 => generated 1466 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:55:23.410336 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d6d102ab-84ea-4641-9a33-7767c0d96d62 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:55:23.419589 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d6d102ab-84ea-4641-9a33-7767c0d96d62 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 4381aca2-ea30-4473-9cd3-18c9b64f1937] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:23.443742 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d6d102ab-84ea-4641-9a33-7767c0d96d62 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:23.443742 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d6d102ab-84ea-4641-9a33-7767c0d96d62 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:23.443742 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d6d102ab-84ea-4641-9a33-7767c0d96d62 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:23.443742 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d6d102ab-84ea-4641-9a33-7767c0d96d62 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:23.444191 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d6d102ab-84ea-4641-9a33-7767c0d96d62 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:23.444334 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d6d102ab-84ea-4641-9a33-7767c0d96d62 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:23.524235 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d6d102ab-84ea-4641-9a33-7767c0d96d62 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "POST /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937/action" status: 200 len: 24575 microversion: 2.1 time: 0.120150 Sep 23 04:55:23.535380 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2728/5307] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:55:23 2022] POST /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937/action => generated 24575 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 04:55:24.305103 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-124b97a6-6e7b-44be-8a49-23ff98aea229 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:24.306639 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-124b97a6-6e7b-44be-8a49-23ff98aea229 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 9dc683ca-0f6d-42d9-bf36-5bb1a5cc3286] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:24.329138 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-124b97a6-6e7b-44be-8a49-23ff98aea229 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:24.329975 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-124b97a6-6e7b-44be-8a49-23ff98aea229 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:24.333988 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-124b97a6-6e7b-44be-8a49-23ff98aea229 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:24.334953 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-124b97a6-6e7b-44be-8a49-23ff98aea229 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:24.337536 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-124b97a6-6e7b-44be-8a49-23ff98aea229 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:24.343341 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-124b97a6-6e7b-44be-8a49-23ff98aea229 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:24.541018 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-124b97a6-6e7b-44be-8a49-23ff98aea229 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:24.551618 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-124b97a6-6e7b-44be-8a49-23ff98aea229 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/9dc683ca-0f6d-42d9-bf36-5bb1a5cc3286" status: 200 len: 1466 microversion: 2.1 time: 0.250622 Sep 23 04:55:24.553771 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2580/5308] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:24 2022] GET /compute/v2.1/servers/9dc683ca-0f6d-42d9-bf36-5bb1a5cc3286 => generated 1466 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:55:24.686913 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-2cfa4237-805a-47a8-abf1-f92501166634 req-2e4e39e3-733a-4d1c-9038-f74c3f80f934 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dc683ca-0f6d-42d9-bf36-5bb1a5cc3286", "name": "network-vif-deleted", "tag": "115752c0-7113-4f89-9e3a-ff7748947567"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:55:24.722308 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-2cfa4237-805a-47a8-abf1-f92501166634 req-2e4e39e3-733a-4d1c-9038-f74c3f80f934 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:24.726702 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-2cfa4237-805a-47a8-abf1-f92501166634 req-2e4e39e3-733a-4d1c-9038-f74c3f80f934 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:24.727906 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-2cfa4237-805a-47a8-abf1-f92501166634 req-2e4e39e3-733a-4d1c-9038-f74c3f80f934 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:24.753353 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-2cfa4237-805a-47a8-abf1-f92501166634 req-2e4e39e3-733a-4d1c-9038-f74c3f80f934 service nova] Creating event network-vif-deleted:115752c0-7113-4f89-9e3a-ff7748947567 for instance 9dc683ca-0f6d-42d9-bf36-5bb1a5cc3286 on n-h2-846463-3 Sep 23 04:55:24.777655 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-2cfa4237-805a-47a8-abf1-f92501166634 req-2e4e39e3-733a-4d1c-9038-f74c3f80f934 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109300 Sep 23 04:55:24.778760 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2729/5309] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:55:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:55:25.586369 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5db9b9e9-9bb7-4dd9-952b-857cf8682f79 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:25.587962 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5db9b9e9-9bb7-4dd9-952b-857cf8682f79 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 9dc683ca-0f6d-42d9-bf36-5bb1a5cc3286] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:25.598194 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5db9b9e9-9bb7-4dd9-952b-857cf8682f79 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:25.599020 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5db9b9e9-9bb7-4dd9-952b-857cf8682f79 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:25.599690 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5db9b9e9-9bb7-4dd9-952b-857cf8682f79 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:25.600893 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5db9b9e9-9bb7-4dd9-952b-857cf8682f79 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:25.601822 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5db9b9e9-9bb7-4dd9-952b-857cf8682f79 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:25.603892 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5db9b9e9-9bb7-4dd9-952b-857cf8682f79 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:25.667268 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5db9b9e9-9bb7-4dd9-952b-857cf8682f79 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:25.668239 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5db9b9e9-9bb7-4dd9-952b-857cf8682f79 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:25.668879 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5db9b9e9-9bb7-4dd9-952b-857cf8682f79 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:25.669519 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-5db9b9e9-9bb7-4dd9-952b-857cf8682f79 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lazy-loading 'fault' on Instance uuid 9dc683ca-0f6d-42d9-bf36-5bb1a5cc3286 {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:55:25.810811 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-5db9b9e9-9bb7-4dd9-952b-857cf8682f79 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:25.824973 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5db9b9e9-9bb7-4dd9-952b-857cf8682f79 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/9dc683ca-0f6d-42d9-bf36-5bb1a5cc3286" status: 200 len: 1305 microversion: 2.1 time: 0.250382 Sep 23 04:55:25.826138 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2581/5310] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:25 2022] GET /compute/v2.1/servers/9dc683ca-0f6d-42d9-bf36-5bb1a5cc3286 => generated 1305 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:55:26.852219 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a2403ffd-3d06-47d2-90cb-9a49869ddbd7 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:26.852878 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a2403ffd-3d06-47d2-90cb-9a49869ddbd7 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 9dc683ca-0f6d-42d9-bf36-5bb1a5cc3286] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:26.873292 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a2403ffd-3d06-47d2-90cb-9a49869ddbd7 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:26.875074 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a2403ffd-3d06-47d2-90cb-9a49869ddbd7 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:26.875074 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a2403ffd-3d06-47d2-90cb-9a49869ddbd7 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:26.875074 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a2403ffd-3d06-47d2-90cb-9a49869ddbd7 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:26.875452 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a2403ffd-3d06-47d2-90cb-9a49869ddbd7 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:26.882131 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a2403ffd-3d06-47d2-90cb-9a49869ddbd7 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:26.911600 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-a2403ffd-3d06-47d2-90cb-9a49869ddbd7 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] HTTP exception thrown: Instance 9dc683ca-0f6d-42d9-bf36-5bb1a5cc3286 could not be found. Sep 23 04:55:26.913586 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a2403ffd-3d06-47d2-90cb-9a49869ddbd7 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Request method failure captured: Sep 23 04:55:26.913586 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/9dc683ca-0f6d-42d9-bf36-5bb1a5cc3286 HTTP/1.1 Sep 23 04:55:26.913586 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:55:26.913586 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:55:26.913586 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:55:26.913586 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:55:26.913586 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:55:26.913586 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:55:26.913586 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:55:26.913586 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:55:26.913586 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTo3L7rPLSTfUV5pEDb1r3o2InNz2xVZb49WfY5_7ohSycSRkpblNb-lg3W6XL2Ai8OaA9THkgwtcWGmxSj0UZ4x-A-nrlghfegV0nGu08AcEc2fcMb2XMVF2A7TFyZB5NC63XPko5HHmiQcxjEHCZqFI55a6beSN65iF07uDP5zXrg Sep 23 04:55:26.913586 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:55:26.913586 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:55:26.913586 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:55:26.913586 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:55:26.913586 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:55:26.913586 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:55:26.913586 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 2a45d69316a648fcb9c56190aaec5376 Sep 23 04:55:26.913586 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ServerActionsTestJSON-1180260513 Sep 23 04:55:26.913586 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:55:26.913586 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:55:26.913586 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2a45d69316a648fcb9c56190aaec5376", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2a45d69316a648fcb9c56190aaec5376"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2a45d69316a648fcb9c56190aaec5376"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2a45d69316a648fcb9c56190aaec5376"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:55:26.913586 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ServerActionsTestJSON-1180260513 Sep 23 04:55:26.913586 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 2a45d69316a648fcb9c56190aaec5376 Sep 23 04:55:26.913586 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ServerActionsTestJSON-1180260513 Sep 23 04:55:26.913586 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ServerActionsTestJSON-1180260513-project Sep 23 04:55:26.913586 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:55:26.913586 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:55:26.913586 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: f5e3a6e455e8483b8ce93ad380793335 Sep 23 04:55:26.913586 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ServerActionsTestJSON-1180260513-project Sep 23 04:55:26.913586 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:55:26.913586 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 9dc683ca-0f6d-42d9-bf36-5bb1a5cc3286 could not be found. Sep 23 04:55:26.913586 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '9dc683ca-0f6d-42d9-bf36-5bb1a5cc3286'} Sep 23 04:55:26.913586 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:55:26.913586 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:55:26.913586 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:55:26.913586 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:55:26.913586 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:55:26.913586 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:55:26.913586 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:55:26.913586 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:55:26.913586 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:55:26.913586 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:55:26.913586 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9dc683ca-0f6d-42d9-bf36-5bb1a5cc3286 could not be found. Sep 23 04:55:26.913586 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:55:26.913586 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:55:26.913586 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:55:26.913586 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:55:26.913586 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:55:26.913586 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:55:26.913586 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:55:26.913586 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:55:26.913586 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:55:26.913586 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:55:26.913586 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:55:26.913586 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:55:26.913586 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:55:26.913586 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:55:26.913586 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:55:26.913586 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:55:26.913586 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9dc683ca-0f6d-42d9-bf36-5bb1a5cc3286 could not be found. Sep 23 04:55:26.913586 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:55:26.913586 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:55:26.913586 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:55:26.918208 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:55:26.918208 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:55:26.918208 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:55:26.918208 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:55:26.918208 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:55:26.918208 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9dc683ca-0f6d-42d9-bf36-5bb1a5cc3286 could not be found. Sep 23 04:55:26.918208 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:55:26.919927 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a2403ffd-3d06-47d2-90cb-9a49869ddbd7 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Returning 404 to user: Instance 9dc683ca-0f6d-42d9-bf36-5bb1a5cc3286 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:55:26.921047 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a2403ffd-3d06-47d2-90cb-9a49869ddbd7 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/9dc683ca-0f6d-42d9-bf36-5bb1a5cc3286" status: 404 len: 111 microversion: 2.1 time: 0.073735 Sep 23 04:55:26.930765 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2730/5311] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:26 2022] GET /compute/v2.1/servers/9dc683ca-0f6d-42d9-bf36-5bb1a5cc3286 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:55:26.944514 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e2b8b80c-505f-4c7b-a616-476c0fe9680c tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:26.944514 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e2b8b80c-505f-4c7b-a616-476c0fe9680c tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 1aaa2f54-26e8-4141-aa20-276704f85832] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:26.951510 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e2b8b80c-505f-4c7b-a616-476c0fe9680c tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:26.952006 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e2b8b80c-505f-4c7b-a616-476c0fe9680c tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:26.952450 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e2b8b80c-505f-4c7b-a616-476c0fe9680c tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:26.953176 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e2b8b80c-505f-4c7b-a616-476c0fe9680c tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:26.953637 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e2b8b80c-505f-4c7b-a616-476c0fe9680c tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:26.954109 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e2b8b80c-505f-4c7b-a616-476c0fe9680c tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:27.025860 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e2b8b80c-505f-4c7b-a616-476c0fe9680c tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 1aaa2f54-26e8-4141-aa20-276704f85832] Going to try to terminate instance {{(pid=122698) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:55:27.467827 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e2b8b80c-505f-4c7b-a616-476c0fe9680c tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "DELETE /compute/v2.1/servers/1aaa2f54-26e8-4141-aa20-276704f85832" status: 204 len: 0 microversion: 2.1 time: 0.531316 Sep 23 04:55:27.468786 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2582/5312] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:55:26 2022] DELETE /compute/v2.1/servers/1aaa2f54-26e8-4141-aa20-276704f85832 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:55:27.477805 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-cd93df1e-e1ef-4a6c-8e7b-89b11921d38b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:27.479064 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-cd93df1e-e1ef-4a6c-8e7b-89b11921d38b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 1aaa2f54-26e8-4141-aa20-276704f85832] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:27.495565 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cd93df1e-e1ef-4a6c-8e7b-89b11921d38b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:27.496471 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cd93df1e-e1ef-4a6c-8e7b-89b11921d38b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:27.498589 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cd93df1e-e1ef-4a6c-8e7b-89b11921d38b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:27.503638 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cd93df1e-e1ef-4a6c-8e7b-89b11921d38b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:27.503638 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cd93df1e-e1ef-4a6c-8e7b-89b11921d38b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:27.503638 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cd93df1e-e1ef-4a6c-8e7b-89b11921d38b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:27.702166 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-cd93df1e-e1ef-4a6c-8e7b-89b11921d38b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:27.711812 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-cd93df1e-e1ef-4a6c-8e7b-89b11921d38b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/1aaa2f54-26e8-4141-aa20-276704f85832" status: 200 len: 1506 microversion: 2.1 time: 0.238615 Sep 23 04:55:27.713694 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2731/5313] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:27 2022] GET /compute/v2.1/servers/1aaa2f54-26e8-4141-aa20-276704f85832 => generated 1506 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:55:28.752044 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8e797186-50d1-49a5-9431-4430a99a6ef9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:28.752787 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8e797186-50d1-49a5-9431-4430a99a6ef9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 1aaa2f54-26e8-4141-aa20-276704f85832] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:28.786931 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8e797186-50d1-49a5-9431-4430a99a6ef9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:28.787459 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8e797186-50d1-49a5-9431-4430a99a6ef9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:28.787911 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8e797186-50d1-49a5-9431-4430a99a6ef9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:28.795070 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8e797186-50d1-49a5-9431-4430a99a6ef9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:28.798241 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8e797186-50d1-49a5-9431-4430a99a6ef9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:28.798751 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8e797186-50d1-49a5-9431-4430a99a6ef9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:28.852238 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:55:29.432015 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8e797186-50d1-49a5-9431-4430a99a6ef9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:29.450616 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8e797186-50d1-49a5-9431-4430a99a6ef9 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/1aaa2f54-26e8-4141-aa20-276704f85832" status: 200 len: 1506 microversion: 2.1 time: 0.716139 Sep 23 04:55:29.457714 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2583/5314] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:28 2022] GET /compute/v2.1/servers/1aaa2f54-26e8-4141-aa20-276704f85832 => generated 1506 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:55:29.813062 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b592df7c-24d9-4f9d-a67b-5734221bfb0b tempest-TestNetworkAdvancedServerOps-1586243358 tempest-TestNetworkAdvancedServerOps-1586243358-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:29.813062 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b592df7c-24d9-4f9d-a67b-5734221bfb0b tempest-TestNetworkAdvancedServerOps-1586243358 tempest-TestNetworkAdvancedServerOps-1586243358-project-admin] [instance: 4381aca2-ea30-4473-9cd3-18c9b64f1937] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:29.816947 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b592df7c-24d9-4f9d-a67b-5734221bfb0b tempest-TestNetworkAdvancedServerOps-1586243358 tempest-TestNetworkAdvancedServerOps-1586243358-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:29.818005 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b592df7c-24d9-4f9d-a67b-5734221bfb0b tempest-TestNetworkAdvancedServerOps-1586243358 tempest-TestNetworkAdvancedServerOps-1586243358-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:29.818612 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b592df7c-24d9-4f9d-a67b-5734221bfb0b tempest-TestNetworkAdvancedServerOps-1586243358 tempest-TestNetworkAdvancedServerOps-1586243358-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:29.819353 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b592df7c-24d9-4f9d-a67b-5734221bfb0b tempest-TestNetworkAdvancedServerOps-1586243358 tempest-TestNetworkAdvancedServerOps-1586243358-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:29.819827 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b592df7c-24d9-4f9d-a67b-5734221bfb0b tempest-TestNetworkAdvancedServerOps-1586243358 tempest-TestNetworkAdvancedServerOps-1586243358-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:29.820265 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b592df7c-24d9-4f9d-a67b-5734221bfb0b tempest-TestNetworkAdvancedServerOps-1586243358 tempest-TestNetworkAdvancedServerOps-1586243358-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:30.123513 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-cf261b4b-d6c4-4633-9e25-280aa6907472 req-2d6daee3-e7d8-4e2f-b497-60911f622fb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1aaa2f54-26e8-4141-aa20-276704f85832", "name": "network-vif-deleted", "tag": "11292752-bbaf-4bd3-857a-dc22e908e857"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:55:30.141667 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-cf261b4b-d6c4-4633-9e25-280aa6907472 req-2d6daee3-e7d8-4e2f-b497-60911f622fb1 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:30.142683 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-cf261b4b-d6c4-4633-9e25-280aa6907472 req-2d6daee3-e7d8-4e2f-b497-60911f622fb1 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:30.143527 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-cf261b4b-d6c4-4633-9e25-280aa6907472 req-2d6daee3-e7d8-4e2f-b497-60911f622fb1 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:30.158517 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-cf261b4b-d6c4-4633-9e25-280aa6907472 req-2d6daee3-e7d8-4e2f-b497-60911f622fb1 service nova] Creating event network-vif-deleted:11292752-bbaf-4bd3-857a-dc22e908e857 for instance 1aaa2f54-26e8-4141-aa20-276704f85832 on n-h2-846463-3 Sep 23 04:55:30.165971 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-cf261b4b-d6c4-4633-9e25-280aa6907472 req-2d6daee3-e7d8-4e2f-b497-60911f622fb1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053153 Sep 23 04:55:30.167339 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2584/5315] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:55:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:55:30.483586 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c0176158-f8c9-4431-b250-a986c9554e89 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:30.484660 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c0176158-f8c9-4431-b250-a986c9554e89 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 1aaa2f54-26e8-4141-aa20-276704f85832] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:30.512055 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c0176158-f8c9-4431-b250-a986c9554e89 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:30.540873 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c0176158-f8c9-4431-b250-a986c9554e89 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:30.549880 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c0176158-f8c9-4431-b250-a986c9554e89 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:30.550805 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c0176158-f8c9-4431-b250-a986c9554e89 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:30.551597 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c0176158-f8c9-4431-b250-a986c9554e89 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:30.553228 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c0176158-f8c9-4431-b250-a986c9554e89 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:30.633182 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b592df7c-24d9-4f9d-a67b-5734221bfb0b tempest-TestNetworkAdvancedServerOps-1586243358 tempest-TestNetworkAdvancedServerOps-1586243358-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937" status: 200 len: 1834 microversion: 2.1 time: 0.832906 Sep 23 04:55:30.638253 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2732/5316] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:29 2022] GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937 => generated 1834 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:55:30.672436 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c0176158-f8c9-4431-b250-a986c9554e89 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:30.675018 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c0176158-f8c9-4431-b250-a986c9554e89 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:30.675970 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c0176158-f8c9-4431-b250-a986c9554e89 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:30.678069 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-c0176158-f8c9-4431-b250-a986c9554e89 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lazy-loading 'fault' on Instance uuid 1aaa2f54-26e8-4141-aa20-276704f85832 {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:55:30.917142 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c0176158-f8c9-4431-b250-a986c9554e89 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:30.948061 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c0176158-f8c9-4431-b250-a986c9554e89 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/1aaa2f54-26e8-4141-aa20-276704f85832" status: 200 len: 1304 microversion: 2.1 time: 0.475260 Sep 23 04:55:30.952339 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2585/5317] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:30 2022] GET /compute/v2.1/servers/1aaa2f54-26e8-4141-aa20-276704f85832 => generated 1304 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:55:31.978491 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8149348b-c29a-4e7f-ade2-fa6dc470eb7b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:31.979865 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8149348b-c29a-4e7f-ade2-fa6dc470eb7b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 1aaa2f54-26e8-4141-aa20-276704f85832] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:31.996121 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8149348b-c29a-4e7f-ade2-fa6dc470eb7b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:31.999639 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8149348b-c29a-4e7f-ade2-fa6dc470eb7b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:32.000369 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8149348b-c29a-4e7f-ade2-fa6dc470eb7b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:32.002167 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8149348b-c29a-4e7f-ade2-fa6dc470eb7b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:32.004046 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8149348b-c29a-4e7f-ade2-fa6dc470eb7b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:32.006461 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8149348b-c29a-4e7f-ade2-fa6dc470eb7b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:32.048143 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-8149348b-c29a-4e7f-ade2-fa6dc470eb7b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] HTTP exception thrown: Instance 1aaa2f54-26e8-4141-aa20-276704f85832 could not be found. Sep 23 04:55:32.054556 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8149348b-c29a-4e7f-ade2-fa6dc470eb7b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Request method failure captured: Sep 23 04:55:32.054556 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/1aaa2f54-26e8-4141-aa20-276704f85832 HTTP/1.1 Sep 23 04:55:32.054556 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:55:32.054556 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:55:32.054556 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:55:32.054556 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:55:32.054556 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:55:32.054556 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:55:32.054556 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:55:32.054556 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:55:32.054556 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTo3L7rPLSTfUV5pEDb1r3o2InNz2xVZb49WfY5_7ohSycSRkpblNb-lg3W6XL2Ai8OaA9THkgwtcWGmxSj0UZ4x-A-nrlghfegV0nGu08AcEc2fcMb2XMVF2A7TFyZB5NC63XPko5HHmiQcxjEHCZqFI55a6beSN65iF07uDP5zXrg Sep 23 04:55:32.054556 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:55:32.054556 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:55:32.054556 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:55:32.054556 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:55:32.054556 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:55:32.054556 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:55:32.054556 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 2a45d69316a648fcb9c56190aaec5376 Sep 23 04:55:32.054556 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ServerActionsTestJSON-1180260513 Sep 23 04:55:32.054556 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:55:32.054556 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:55:32.054556 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2a45d69316a648fcb9c56190aaec5376", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2a45d69316a648fcb9c56190aaec5376"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2a45d69316a648fcb9c56190aaec5376"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2a45d69316a648fcb9c56190aaec5376"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:55:32.054556 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ServerActionsTestJSON-1180260513 Sep 23 04:55:32.054556 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 2a45d69316a648fcb9c56190aaec5376 Sep 23 04:55:32.054556 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ServerActionsTestJSON-1180260513 Sep 23 04:55:32.054556 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ServerActionsTestJSON-1180260513-project Sep 23 04:55:32.054556 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:55:32.054556 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:55:32.054556 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: f5e3a6e455e8483b8ce93ad380793335 Sep 23 04:55:32.054556 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ServerActionsTestJSON-1180260513-project Sep 23 04:55:32.054556 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:55:32.054556 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 1aaa2f54-26e8-4141-aa20-276704f85832 could not be found. Sep 23 04:55:32.054556 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '1aaa2f54-26e8-4141-aa20-276704f85832'} Sep 23 04:55:32.054556 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:55:32.054556 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:55:32.054556 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:55:32.054556 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:55:32.054556 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:55:32.054556 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:55:32.054556 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:55:32.054556 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:55:32.054556 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:55:32.054556 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:55:32.054556 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1aaa2f54-26e8-4141-aa20-276704f85832 could not be found. Sep 23 04:55:32.054556 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:55:32.054556 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:55:32.054556 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:55:32.054556 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:55:32.054556 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:55:32.054556 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:55:32.054556 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:55:32.054556 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:55:32.054556 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:55:32.054556 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:55:32.054556 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:55:32.054556 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:55:32.054556 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:55:32.054556 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:55:32.054556 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:55:32.054556 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:55:32.054556 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1aaa2f54-26e8-4141-aa20-276704f85832 could not be found. Sep 23 04:55:32.054556 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:55:32.054556 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:55:32.054556 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:55:32.059087 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:55:32.059087 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:55:32.059087 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:55:32.059087 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:55:32.059087 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:55:32.059087 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1aaa2f54-26e8-4141-aa20-276704f85832 could not be found. Sep 23 04:55:32.059087 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:55:32.059087 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8149348b-c29a-4e7f-ade2-fa6dc470eb7b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Returning 404 to user: Instance 1aaa2f54-26e8-4141-aa20-276704f85832 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:55:32.059087 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8149348b-c29a-4e7f-ade2-fa6dc470eb7b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/1aaa2f54-26e8-4141-aa20-276704f85832" status: 404 len: 111 microversion: 2.1 time: 0.086994 Sep 23 04:55:32.068533 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2586/5318] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:31 2022] GET /compute/v2.1/servers/1aaa2f54-26e8-4141-aa20-276704f85832 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 04:55:32.080810 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4a77da59-1cae-4adf-8fb1-fb061fc0313c tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:32.083896 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4a77da59-1cae-4adf-8fb1-fb061fc0313c tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 30d846a2-5966-4fae-9515-9d873d882e6b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:32.104713 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4a77da59-1cae-4adf-8fb1-fb061fc0313c tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:32.108180 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4a77da59-1cae-4adf-8fb1-fb061fc0313c tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:32.108180 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4a77da59-1cae-4adf-8fb1-fb061fc0313c tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:32.108180 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4a77da59-1cae-4adf-8fb1-fb061fc0313c tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:32.108180 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4a77da59-1cae-4adf-8fb1-fb061fc0313c tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:32.109470 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4a77da59-1cae-4adf-8fb1-fb061fc0313c tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:32.131977 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1e82e4d4-7e66-4075-8ce6-509b227b94fb tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-234401835", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "networks": [{"uuid": "04d88779-7844-4574-9787-43829ed0b011"}]}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:55:32.185947 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4a77da59-1cae-4adf-8fb1-fb061fc0313c tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 30d846a2-5966-4fae-9515-9d873d882e6b] Going to try to terminate instance {{(pid=122698) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:55:32.222487 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.neutron [None req-1e82e4d4-7e66-4075-8ce6-509b227b94fb tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] validate_networks() for [('04d88779-7844-4574-9787-43829ed0b011', None, None, None, None, None)] {{(pid=122699) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:55:32.696413 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4a77da59-1cae-4adf-8fb1-fb061fc0313c tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "DELETE /compute/v2.1/servers/30d846a2-5966-4fae-9515-9d873d882e6b" status: 204 len: 0 microversion: 2.1 time: 0.623356 Sep 23 04:55:32.697401 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2587/5319] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:55:32 2022] DELETE /compute/v2.1/servers/30d846a2-5966-4fae-9515-9d873d882e6b => generated 0 bytes in 625 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:55:32.706213 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-095ac341-c525-4fd4-824f-41e717008abb tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:32.707152 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-095ac341-c525-4fd4-824f-41e717008abb tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 30d846a2-5966-4fae-9515-9d873d882e6b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:32.722855 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-095ac341-c525-4fd4-824f-41e717008abb tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:32.726256 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-095ac341-c525-4fd4-824f-41e717008abb tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:32.735080 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-095ac341-c525-4fd4-824f-41e717008abb tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:32.735869 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-095ac341-c525-4fd4-824f-41e717008abb tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:32.736361 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-095ac341-c525-4fd4-824f-41e717008abb tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:32.736796 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-095ac341-c525-4fd4-824f-41e717008abb tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:33.162072 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-095ac341-c525-4fd4-824f-41e717008abb tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:33.184073 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-095ac341-c525-4fd4-824f-41e717008abb tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/30d846a2-5966-4fae-9515-9d873d882e6b" status: 200 len: 1493 microversion: 2.1 time: 0.482264 Sep 23 04:55:33.185338 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2588/5320] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:32 2022] GET /compute/v2.1/servers/30d846a2-5966-4fae-9515-9d873d882e6b => generated 1493 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:55:33.300850 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1b399a9f-0dbb-4bdd-8543-31369e8cef4e tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:33.301377 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-1b399a9f-0dbb-4bdd-8543-31369e8cef4e tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 4381aca2-ea30-4473-9cd3-18c9b64f1937] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:33.314764 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1b399a9f-0dbb-4bdd-8543-31369e8cef4e tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:33.322385 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1b399a9f-0dbb-4bdd-8543-31369e8cef4e tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:33.322385 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1b399a9f-0dbb-4bdd-8543-31369e8cef4e tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:33.322385 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1b399a9f-0dbb-4bdd-8543-31369e8cef4e tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:33.348395 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1b399a9f-0dbb-4bdd-8543-31369e8cef4e tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:33.348914 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1b399a9f-0dbb-4bdd-8543-31369e8cef4e tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:33.408634 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-1b399a9f-0dbb-4bdd-8543-31369e8cef4e tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 4381aca2-ea30-4473-9cd3-18c9b64f1937] Going to try to terminate instance {{(pid=122698) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:55:33.827716 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-1b399a9f-0dbb-4bdd-8543-31369e8cef4e tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937" status: 204 len: 0 microversion: 2.1 time: 0.530287 Sep 23 04:55:33.829968 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2589/5321] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:55:33 2022] DELETE /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 23 04:55:33.836623 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-33325d32-5a88-4278-b5df-80f071ab7715 req-7e6716d8-a74c-4505-8f4d-909bfb1132af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4381aca2-ea30-4473-9cd3-18c9b64f1937", "tag": "bc06dfe2-49c9-4f61-b1e4-e3d76533aa0c"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:55:33.858089 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-33325d32-5a88-4278-b5df-80f071ab7715 req-7e6716d8-a74c-4505-8f4d-909bfb1132af service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:33.860629 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-33325d32-5a88-4278-b5df-80f071ab7715 req-7e6716d8-a74c-4505-8f4d-909bfb1132af service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:33.861101 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-33325d32-5a88-4278-b5df-80f071ab7715 req-7e6716d8-a74c-4505-8f4d-909bfb1132af service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:33.893331 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-33325d32-5a88-4278-b5df-80f071ab7715 req-7e6716d8-a74c-4505-8f4d-909bfb1132af service nova] Creating event network-changed:bc06dfe2-49c9-4f61-b1e4-e3d76533aa0c for instance 4381aca2-ea30-4473-9cd3-18c9b64f1937 on n-h2-846463-3 Sep 23 04:55:33.907733 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-33325d32-5a88-4278-b5df-80f071ab7715 req-7e6716d8-a74c-4505-8f4d-909bfb1132af service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075514 Sep 23 04:55:33.910958 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2590/5322] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:55:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:55:33.926277 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-58936722-cdef-47e6-a5fd-61d855976a11 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:33.926436 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-58936722-cdef-47e6-a5fd-61d855976a11 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 4381aca2-ea30-4473-9cd3-18c9b64f1937] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:33.943031 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-58936722-cdef-47e6-a5fd-61d855976a11 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:33.946784 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-58936722-cdef-47e6-a5fd-61d855976a11 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:33.951394 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-58936722-cdef-47e6-a5fd-61d855976a11 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:33.954706 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-58936722-cdef-47e6-a5fd-61d855976a11 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:33.954706 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-58936722-cdef-47e6-a5fd-61d855976a11 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:33.954706 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-58936722-cdef-47e6-a5fd-61d855976a11 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:34.894609 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-58936722-cdef-47e6-a5fd-61d855976a11 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:34.905045 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-58936722-cdef-47e6-a5fd-61d855976a11 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937" status: 200 len: 1689 microversion: 2.1 time: 0.992684 Sep 23 04:55:34.905657 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2591/5323] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:33 2022] GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937 => generated 1689 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:55:34.920104 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-66fd84db-1ffb-40e3-b25c-0494568b2e1b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:34.922888 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-66fd84db-1ffb-40e3-b25c-0494568b2e1b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 30d846a2-5966-4fae-9515-9d873d882e6b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:34.945206 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-66fd84db-1ffb-40e3-b25c-0494568b2e1b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:34.945915 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-66fd84db-1ffb-40e3-b25c-0494568b2e1b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:34.947732 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-66fd84db-1ffb-40e3-b25c-0494568b2e1b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:34.948511 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-66fd84db-1ffb-40e3-b25c-0494568b2e1b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:34.948994 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-66fd84db-1ffb-40e3-b25c-0494568b2e1b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:34.952739 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-66fd84db-1ffb-40e3-b25c-0494568b2e1b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:34.992542 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-1e82e4d4-7e66-4075-8ce6-509b227b94fb tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Flavor limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:55:34.993069 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-1e82e4d4-7e66-4075-8ce6-509b227b94fb tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Image limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:55:34.993506 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-1e82e4d4-7e66-4075-8ce6-509b227b94fb tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Flavor pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:55:34.994269 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-1e82e4d4-7e66-4075-8ce6-509b227b94fb tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Image pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:55:34.995248 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-1e82e4d4-7e66-4075-8ce6-509b227b94fb tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:55:35.000665 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:55:35.012480 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e82e4d4-7e66-4075-8ce6-509b227b94fb tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:35.015220 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e82e4d4-7e66-4075-8ce6-509b227b94fb tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:35.016374 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e82e4d4-7e66-4075-8ce6-509b227b94fb tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:35.018208 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e82e4d4-7e66-4075-8ce6-509b227b94fb tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:35.019817 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e82e4d4-7e66-4075-8ce6-509b227b94fb tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:35.023237 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e82e4d4-7e66-4075-8ce6-509b227b94fb tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:35.087048 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-1e82e4d4-7e66-4075-8ce6-509b227b94fb tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Getting quotas for project 7e8a9e2478fc4368aad631cf00a5ab8e. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:55:35.096731 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-1e82e4d4-7e66-4075-8ce6-509b227b94fb tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Getting quotas for user 386aba60a6434dab992d14237471ad4d and project 7e8a9e2478fc4368aad631cf00a5ab8e. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:55:35.112625 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1e82e4d4-7e66-4075-8ce6-509b227b94fb tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Going to run 1 instances... {{(pid=122699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:55:35.116609 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1e82e4d4-7e66-4075-8ce6-509b227b94fb tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] [instance: 6e95e785-114e-4ffb-88fa-14d783662f85] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:55:35.133770 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-66fd84db-1ffb-40e3-b25c-0494568b2e1b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:35.142699 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-66fd84db-1ffb-40e3-b25c-0494568b2e1b tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/30d846a2-5966-4fae-9515-9d873d882e6b" status: 200 len: 1451 microversion: 2.1 time: 0.228867 Sep 23 04:55:35.147484 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2592/5324] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:34 2022] GET /compute/v2.1/servers/30d846a2-5966-4fae-9515-9d873d882e6b => generated 1451 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:55:35.300360 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1e82e4d4-7e66-4075-8ce6-509b227b94fb tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.428034 Sep 23 04:55:35.310280 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2733/5325] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:55:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 3439 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:55:35.315314 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-904d62ab-65a8-428d-8335-4195ef3b80fb tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:35.316199 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-904d62ab-65a8-428d-8335-4195ef3b80fb tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] [instance: 6e95e785-114e-4ffb-88fa-14d783662f85] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:35.713714 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-904d62ab-65a8-428d-8335-4195ef3b80fb tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386aba60a6434dab992d14237471ad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8a9e2478fc4368aad631cf00a5ab8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:35.724102 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-904d62ab-65a8-428d-8335-4195ef3b80fb tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] 10.222.0.33 "GET /compute/v2.1/servers/6e95e785-114e-4ffb-88fa-14d783662f85" status: 200 len: 1216 microversion: 2.1 time: 0.414411 Sep 23 04:55:35.742000 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2593/5326] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:35 2022] GET /compute/v2.1/servers/6e95e785-114e-4ffb-88fa-14d783662f85 => generated 1216 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:55:35.938428 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1d351974-3a7b-4de1-9ce7-4b13cc26ad41 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:35.940681 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1d351974-3a7b-4de1-9ce7-4b13cc26ad41 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 4381aca2-ea30-4473-9cd3-18c9b64f1937] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:35.963479 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1d351974-3a7b-4de1-9ce7-4b13cc26ad41 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:35.963996 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1d351974-3a7b-4de1-9ce7-4b13cc26ad41 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:35.969881 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1d351974-3a7b-4de1-9ce7-4b13cc26ad41 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:35.970869 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1d351974-3a7b-4de1-9ce7-4b13cc26ad41 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:35.971480 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1d351974-3a7b-4de1-9ce7-4b13cc26ad41 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:35.972011 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1d351974-3a7b-4de1-9ce7-4b13cc26ad41 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:36.013400 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-a07838fc-1e17-4142-96fe-ae25279e8077 req-034a0eba-9923-480f-bc43-fe25d741785b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30d846a2-5966-4fae-9515-9d873d882e6b", "name": "network-vif-deleted", "tag": "952d94de-d39b-44e0-8288-2417a201e386"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:55:36.040973 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-a07838fc-1e17-4142-96fe-ae25279e8077 req-034a0eba-9923-480f-bc43-fe25d741785b service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:36.046033 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-a07838fc-1e17-4142-96fe-ae25279e8077 req-034a0eba-9923-480f-bc43-fe25d741785b service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:36.046849 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-a07838fc-1e17-4142-96fe-ae25279e8077 req-034a0eba-9923-480f-bc43-fe25d741785b service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:36.080024 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-a07838fc-1e17-4142-96fe-ae25279e8077 req-034a0eba-9923-480f-bc43-fe25d741785b service nova] Creating event network-vif-deleted:952d94de-d39b-44e0-8288-2417a201e386 for instance 30d846a2-5966-4fae-9515-9d873d882e6b on n-h2-846463-3 Sep 23 04:55:36.094579 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-a07838fc-1e17-4142-96fe-ae25279e8077 req-034a0eba-9923-480f-bc43-fe25d741785b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081286 Sep 23 04:55:36.097386 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2594/5327] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:55:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:55:36.174135 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-86f79ac3-5ce4-4215-90d9-d6d7afab48eb tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:36.175403 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-86f79ac3-5ce4-4215-90d9-d6d7afab48eb tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 30d846a2-5966-4fae-9515-9d873d882e6b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:36.191997 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-86f79ac3-5ce4-4215-90d9-d6d7afab48eb tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:36.195705 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-86f79ac3-5ce4-4215-90d9-d6d7afab48eb tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:36.196688 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-86f79ac3-5ce4-4215-90d9-d6d7afab48eb tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:36.201749 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-86f79ac3-5ce4-4215-90d9-d6d7afab48eb tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:36.202728 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-86f79ac3-5ce4-4215-90d9-d6d7afab48eb tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:36.203615 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-86f79ac3-5ce4-4215-90d9-d6d7afab48eb tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:36.324473 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-86f79ac3-5ce4-4215-90d9-d6d7afab48eb tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:36.325433 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-86f79ac3-5ce4-4215-90d9-d6d7afab48eb tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:36.328149 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-86f79ac3-5ce4-4215-90d9-d6d7afab48eb tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:36.328917 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-86f79ac3-5ce4-4215-90d9-d6d7afab48eb tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lazy-loading 'fault' on Instance uuid 30d846a2-5966-4fae-9515-9d873d882e6b {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:55:36.547871 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1d351974-3a7b-4de1-9ce7-4b13cc26ad41 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:36.552911 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1d351974-3a7b-4de1-9ce7-4b13cc26ad41 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937" status: 200 len: 1689 microversion: 2.1 time: 0.620510 Sep 23 04:55:36.565951 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2734/5328] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:35 2022] GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937 => generated 1689 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:55:36.566389 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-86f79ac3-5ce4-4215-90d9-d6d7afab48eb tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:36.577402 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-86f79ac3-5ce4-4215-90d9-d6d7afab48eb tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/30d846a2-5966-4fae-9515-9d873d882e6b" status: 200 len: 1304 microversion: 2.1 time: 0.408255 Sep 23 04:55:36.582614 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2595/5329] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:36 2022] GET /compute/v2.1/servers/30d846a2-5966-4fae-9515-9d873d882e6b => generated 1304 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:55:36.769727 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a1038019-8258-4702-a249-9fe5a9536a36 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:36.770505 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a1038019-8258-4702-a249-9fe5a9536a36 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] [instance: 6e95e785-114e-4ffb-88fa-14d783662f85] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:36.933612 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a1038019-8258-4702-a249-9fe5a9536a36 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386aba60a6434dab992d14237471ad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8a9e2478fc4368aad631cf00a5ab8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:36.951050 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a1038019-8258-4702-a249-9fe5a9536a36 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] 10.222.0.33 "GET /compute/v2.1/servers/6e95e785-114e-4ffb-88fa-14d783662f85" status: 200 len: 1216 microversion: 2.1 time: 0.187286 Sep 23 04:55:36.951050 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2735/5330] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:36 2022] GET /compute/v2.1/servers/6e95e785-114e-4ffb-88fa-14d783662f85 => generated 1216 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:55:37.599396 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8e7a8024-3e2f-4932-b7bf-652e8da3ae32 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:37.599396 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8e7a8024-3e2f-4932-b7bf-652e8da3ae32 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 4381aca2-ea30-4473-9cd3-18c9b64f1937] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:37.599396 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8e7a8024-3e2f-4932-b7bf-652e8da3ae32 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:37.599396 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8e7a8024-3e2f-4932-b7bf-652e8da3ae32 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:37.599396 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8e7a8024-3e2f-4932-b7bf-652e8da3ae32 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:37.599396 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8e7a8024-3e2f-4932-b7bf-652e8da3ae32 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:37.599396 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8e7a8024-3e2f-4932-b7bf-652e8da3ae32 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:37.599396 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8e7a8024-3e2f-4932-b7bf-652e8da3ae32 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:37.607761 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9daf52c6-f057-4a87-a06e-241c5dab0243 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:37.608954 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-9daf52c6-f057-4a87-a06e-241c5dab0243 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 30d846a2-5966-4fae-9515-9d873d882e6b] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:37.623722 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9daf52c6-f057-4a87-a06e-241c5dab0243 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:37.624512 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9daf52c6-f057-4a87-a06e-241c5dab0243 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:37.625142 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9daf52c6-f057-4a87-a06e-241c5dab0243 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:37.631382 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9daf52c6-f057-4a87-a06e-241c5dab0243 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:37.632068 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9daf52c6-f057-4a87-a06e-241c5dab0243 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:37.632685 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9daf52c6-f057-4a87-a06e-241c5dab0243 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:37.687752 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-9daf52c6-f057-4a87-a06e-241c5dab0243 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] HTTP exception thrown: Instance 30d846a2-5966-4fae-9515-9d873d882e6b could not be found. Sep 23 04:55:37.687752 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9daf52c6-f057-4a87-a06e-241c5dab0243 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Request method failure captured: Sep 23 04:55:37.687752 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/30d846a2-5966-4fae-9515-9d873d882e6b HTTP/1.1 Sep 23 04:55:37.687752 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:55:37.687752 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:55:37.687752 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:55:37.687752 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:55:37.687752 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:55:37.687752 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:55:37.687752 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:55:37.687752 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:55:37.687752 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTo3L7rPLSTfUV5pEDb1r3o2InNz2xVZb49WfY5_7ohSycSRkpblNb-lg3W6XL2Ai8OaA9THkgwtcWGmxSj0UZ4x-A-nrlghfegV0nGu08AcEc2fcMb2XMVF2A7TFyZB5NC63XPko5HHmiQcxjEHCZqFI55a6beSN65iF07uDP5zXrg Sep 23 04:55:37.687752 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:55:37.687752 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:55:37.687752 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:55:37.687752 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:55:37.687752 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:55:37.687752 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:55:37.687752 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 2a45d69316a648fcb9c56190aaec5376 Sep 23 04:55:37.687752 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ServerActionsTestJSON-1180260513 Sep 23 04:55:37.687752 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:55:37.687752 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:55:37.687752 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2a45d69316a648fcb9c56190aaec5376", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2a45d69316a648fcb9c56190aaec5376"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2a45d69316a648fcb9c56190aaec5376"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2a45d69316a648fcb9c56190aaec5376"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:55:37.687752 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ServerActionsTestJSON-1180260513 Sep 23 04:55:37.687752 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 2a45d69316a648fcb9c56190aaec5376 Sep 23 04:55:37.687752 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ServerActionsTestJSON-1180260513 Sep 23 04:55:37.687752 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ServerActionsTestJSON-1180260513-project Sep 23 04:55:37.687752 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:55:37.687752 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:55:37.687752 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: f5e3a6e455e8483b8ce93ad380793335 Sep 23 04:55:37.687752 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ServerActionsTestJSON-1180260513-project Sep 23 04:55:37.687752 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:55:37.687752 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 30d846a2-5966-4fae-9515-9d873d882e6b could not be found. Sep 23 04:55:37.687752 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '30d846a2-5966-4fae-9515-9d873d882e6b'} Sep 23 04:55:37.687752 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:55:37.687752 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:55:37.687752 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:55:37.687752 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:55:37.687752 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:55:37.687752 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:55:37.687752 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:55:37.687752 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:55:37.687752 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:55:37.687752 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:55:37.687752 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30d846a2-5966-4fae-9515-9d873d882e6b could not be found. Sep 23 04:55:37.687752 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:55:37.687752 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:55:37.687752 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:55:37.687752 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:55:37.687752 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:55:37.687752 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:55:37.687752 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:55:37.687752 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:55:37.687752 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:55:37.687752 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:55:37.687752 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:55:37.687752 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:55:37.687752 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:55:37.687752 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:55:37.687752 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:55:37.687752 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:55:37.693432 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30d846a2-5966-4fae-9515-9d873d882e6b could not be found. Sep 23 04:55:37.693432 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:55:37.693432 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:55:37.693432 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:55:37.693432 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:55:37.693432 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:55:37.693432 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:55:37.693432 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:55:37.693432 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:55:37.693432 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30d846a2-5966-4fae-9515-9d873d882e6b could not be found. Sep 23 04:55:37.693432 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:55:37.693432 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9daf52c6-f057-4a87-a06e-241c5dab0243 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Returning 404 to user: Instance 30d846a2-5966-4fae-9515-9d873d882e6b could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:55:37.693432 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-9daf52c6-f057-4a87-a06e-241c5dab0243 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/30d846a2-5966-4fae-9515-9d873d882e6b" status: 404 len: 111 microversion: 2.1 time: 0.070746 Sep 23 04:55:37.693432 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2736/5331] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:37 2022] GET /compute/v2.1/servers/30d846a2-5966-4fae-9515-9d873d882e6b => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:55:37.693432 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ba28c963-31ad-4248-980f-1a65fef73841 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:37.693432 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ba28c963-31ad-4248-980f-1a65fef73841 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:37.702120 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ba28c963-31ad-4248-980f-1a65fef73841 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:37.702744 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ba28c963-31ad-4248-980f-1a65fef73841 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:37.703218 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ba28c963-31ad-4248-980f-1a65fef73841 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:37.704042 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ba28c963-31ad-4248-980f-1a65fef73841 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:37.704523 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ba28c963-31ad-4248-980f-1a65fef73841 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:37.704967 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ba28c963-31ad-4248-980f-1a65fef73841 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:37.765530 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ba28c963-31ad-4248-980f-1a65fef73841 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Going to try to terminate instance {{(pid=122699) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:55:38.101060 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8e7a8024-3e2f-4932-b7bf-652e8da3ae32 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:38.128519 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8e7a8024-3e2f-4932-b7bf-652e8da3ae32 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937" status: 200 len: 1689 microversion: 2.1 time: 0.531676 Sep 23 04:55:38.128519 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2596/5332] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:37 2022] GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937 => generated 1689 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:55:38.128519 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3652e297-2d8e-4253-abdf-05b75afcbc0a tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:38.128519 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3652e297-2d8e-4253-abdf-05b75afcbc0a tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] [instance: 6e95e785-114e-4ffb-88fa-14d783662f85] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:38.142367 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=3 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:55:38.144840 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3652e297-2d8e-4253-abdf-05b75afcbc0a tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:38.156326 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3652e297-2d8e-4253-abdf-05b75afcbc0a tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:38.156962 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3652e297-2d8e-4253-abdf-05b75afcbc0a tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:38.158913 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3652e297-2d8e-4253-abdf-05b75afcbc0a tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:38.160339 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3652e297-2d8e-4253-abdf-05b75afcbc0a tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:38.162492 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3652e297-2d8e-4253-abdf-05b75afcbc0a tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:38.220780 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ba28c963-31ad-4248-980f-1a65fef73841 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 204 len: 0 microversion: 2.1 time: 0.543833 Sep 23 04:55:38.222295 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2737/5333] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:55:37 2022] DELETE /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:55:38.233465 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-98d599d3-40b6-4a1d-8116-cdf322f0d937 req-2bca963c-8299-46b3-8f2b-a2f88802a262 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4381aca2-ea30-4473-9cd3-18c9b64f1937", "name": "network-vif-deleted", "tag": "bc06dfe2-49c9-4f61-b1e4-e3d76533aa0c"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:55:38.265406 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-98d599d3-40b6-4a1d-8116-cdf322f0d937 req-2bca963c-8299-46b3-8f2b-a2f88802a262 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:38.268852 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-98d599d3-40b6-4a1d-8116-cdf322f0d937 req-2bca963c-8299-46b3-8f2b-a2f88802a262 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:38.269545 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-98d599d3-40b6-4a1d-8116-cdf322f0d937 req-2bca963c-8299-46b3-8f2b-a2f88802a262 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:38.286655 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-98d599d3-40b6-4a1d-8116-cdf322f0d937 req-2bca963c-8299-46b3-8f2b-a2f88802a262 service nova] Creating event network-vif-deleted:bc06dfe2-49c9-4f61-b1e4-e3d76533aa0c for instance 4381aca2-ea30-4473-9cd3-18c9b64f1937 on n-h2-846463-3 Sep 23 04:55:38.296958 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-98d599d3-40b6-4a1d-8116-cdf322f0d937 req-2bca963c-8299-46b3-8f2b-a2f88802a262 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072918 Sep 23 04:55:38.301917 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2738/5334] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:55:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:55:38.311326 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-697db24a-0909-4eca-a232-dc8cc005981a tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:38.315016 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-697db24a-0909-4eca-a232-dc8cc005981a tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:38.329635 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-697db24a-0909-4eca-a232-dc8cc005981a tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:38.334638 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-697db24a-0909-4eca-a232-dc8cc005981a tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:38.334638 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-697db24a-0909-4eca-a232-dc8cc005981a tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:38.334638 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-697db24a-0909-4eca-a232-dc8cc005981a tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:38.334638 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-697db24a-0909-4eca-a232-dc8cc005981a tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:38.334638 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-697db24a-0909-4eca-a232-dc8cc005981a tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:38.632029 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-3652e297-2d8e-4253-abdf-05b75afcbc0a tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386aba60a6434dab992d14237471ad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8a9e2478fc4368aad631cf00a5ab8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:38.638749 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-697db24a-0909-4eca-a232-dc8cc005981a tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:38.647278 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3652e297-2d8e-4253-abdf-05b75afcbc0a tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] 10.222.0.33 "GET /compute/v2.1/servers/6e95e785-114e-4ffb-88fa-14d783662f85" status: 200 len: 1212 microversion: 2.1 time: 0.528424 Sep 23 04:55:38.648518 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2597/5335] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:38 2022] GET /compute/v2.1/servers/6e95e785-114e-4ffb-88fa-14d783662f85 => generated 1212 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:55:38.665197 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-697db24a-0909-4eca-a232-dc8cc005981a tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1676 microversion: 2.1 time: 0.345259 Sep 23 04:55:38.666235 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2739/5336] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:38 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1676 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:55:39.144200 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ba0ebb66-2b8b-4db4-8032-991df34f9845 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:39.145153 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-ba0ebb66-2b8b-4db4-8032-991df34f9845 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 4381aca2-ea30-4473-9cd3-18c9b64f1937] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:39.159973 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ba0ebb66-2b8b-4db4-8032-991df34f9845 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:39.160813 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ba0ebb66-2b8b-4db4-8032-991df34f9845 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:39.162575 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ba0ebb66-2b8b-4db4-8032-991df34f9845 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:39.164483 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ba0ebb66-2b8b-4db4-8032-991df34f9845 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:39.166685 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ba0ebb66-2b8b-4db4-8032-991df34f9845 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:39.167574 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ba0ebb66-2b8b-4db4-8032-991df34f9845 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:39.413579 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ba0ebb66-2b8b-4db4-8032-991df34f9845 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:39.429440 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ba0ebb66-2b8b-4db4-8032-991df34f9845 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937" status: 200 len: 1503 microversion: 2.1 time: 0.289416 Sep 23 04:55:39.448882 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2598/5337] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:39 2022] GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937 => generated 1503 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:55:39.671115 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0a8512e1-4c48-47eb-a468-f53a77052832 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:39.679082 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-0a8512e1-4c48-47eb-a468-f53a77052832 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] [instance: 6e95e785-114e-4ffb-88fa-14d783662f85] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:39.684210 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0a8512e1-4c48-47eb-a468-f53a77052832 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:39.684725 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0a8512e1-4c48-47eb-a468-f53a77052832 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:39.685182 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0a8512e1-4c48-47eb-a468-f53a77052832 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:39.686432 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0a8512e1-4c48-47eb-a468-f53a77052832 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:39.687249 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0a8512e1-4c48-47eb-a468-f53a77052832 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:39.687687 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0a8512e1-4c48-47eb-a468-f53a77052832 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:39.697909 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7a8c45fd-0338-4ea2-bb7f-8b3e11d7e17e tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:39.701837 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7a8c45fd-0338-4ea2-bb7f-8b3e11d7e17e tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:39.705991 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7a8c45fd-0338-4ea2-bb7f-8b3e11d7e17e tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:39.706560 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7a8c45fd-0338-4ea2-bb7f-8b3e11d7e17e tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:39.707270 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7a8c45fd-0338-4ea2-bb7f-8b3e11d7e17e tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:39.708098 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7a8c45fd-0338-4ea2-bb7f-8b3e11d7e17e tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:39.708751 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7a8c45fd-0338-4ea2-bb7f-8b3e11d7e17e tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:39.709259 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7a8c45fd-0338-4ea2-bb7f-8b3e11d7e17e tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:39.828187 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-0a8512e1-4c48-47eb-a468-f53a77052832 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386aba60a6434dab992d14237471ad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8a9e2478fc4368aad631cf00a5ab8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:39.843508 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0a8512e1-4c48-47eb-a468-f53a77052832 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] 10.222.0.33 "GET /compute/v2.1/servers/6e95e785-114e-4ffb-88fa-14d783662f85" status: 200 len: 1268 microversion: 2.1 time: 0.173202 Sep 23 04:55:39.846224 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2740/5338] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:39 2022] GET /compute/v2.1/servers/6e95e785-114e-4ffb-88fa-14d783662f85 => generated 1268 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:55:40.030264 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-7a8c45fd-0338-4ea2-bb7f-8b3e11d7e17e tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:40.038072 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:55:40.046777 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7a8c45fd-0338-4ea2-bb7f-8b3e11d7e17e tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1676 microversion: 2.1 time: 0.358472 Sep 23 04:55:40.048250 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2599/5339] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:39 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1676 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:55:40.463179 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a08ca4f2-85a8-49c3-876b-28de688ea2e9 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:40.463899 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a08ca4f2-85a8-49c3-876b-28de688ea2e9 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 4381aca2-ea30-4473-9cd3-18c9b64f1937] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:40.476256 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a08ca4f2-85a8-49c3-876b-28de688ea2e9 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:40.476777 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a08ca4f2-85a8-49c3-876b-28de688ea2e9 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:40.477233 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a08ca4f2-85a8-49c3-876b-28de688ea2e9 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:40.478023 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a08ca4f2-85a8-49c3-876b-28de688ea2e9 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:40.478509 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a08ca4f2-85a8-49c3-876b-28de688ea2e9 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:40.478929 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a08ca4f2-85a8-49c3-876b-28de688ea2e9 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:40.549269 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a08ca4f2-85a8-49c3-876b-28de688ea2e9 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:40.549451 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a08ca4f2-85a8-49c3-876b-28de688ea2e9 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:40.549828 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a08ca4f2-85a8-49c3-876b-28de688ea2e9 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:40.550302 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-a08ca4f2-85a8-49c3-876b-28de688ea2e9 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lazy-loading 'fault' on Instance uuid 4381aca2-ea30-4473-9cd3-18c9b64f1937 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:55:40.625482 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a08ca4f2-85a8-49c3-876b-28de688ea2e9 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:40.640315 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a08ca4f2-85a8-49c3-876b-28de688ea2e9 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937" status: 200 len: 1357 microversion: 2.1 time: 0.180001 Sep 23 04:55:40.659343 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2741/5340] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:40 2022] GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937 => generated 1357 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:55:40.868526 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5b0f0efd-4d9b-4eb2-943d-3a34fbe58f08 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:40.869940 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5b0f0efd-4d9b-4eb2-943d-3a34fbe58f08 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] [instance: 6e95e785-114e-4ffb-88fa-14d783662f85] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:40.881188 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5b0f0efd-4d9b-4eb2-943d-3a34fbe58f08 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:40.881955 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5b0f0efd-4d9b-4eb2-943d-3a34fbe58f08 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:40.882409 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5b0f0efd-4d9b-4eb2-943d-3a34fbe58f08 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:40.884487 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5b0f0efd-4d9b-4eb2-943d-3a34fbe58f08 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:40.885132 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5b0f0efd-4d9b-4eb2-943d-3a34fbe58f08 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:40.885739 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5b0f0efd-4d9b-4eb2-943d-3a34fbe58f08 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:41.072804 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-cfc87430-3ba3-4698-b36a-d0f5912e466e tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:41.074119 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-cfc87430-3ba3-4698-b36a-d0f5912e466e tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:41.089817 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cfc87430-3ba3-4698-b36a-d0f5912e466e tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:41.101359 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cfc87430-3ba3-4698-b36a-d0f5912e466e tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:41.102176 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cfc87430-3ba3-4698-b36a-d0f5912e466e tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:41.105115 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cfc87430-3ba3-4698-b36a-d0f5912e466e tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:41.108709 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cfc87430-3ba3-4698-b36a-d0f5912e466e tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:41.109487 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cfc87430-3ba3-4698-b36a-d0f5912e466e tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:41.251533 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-5b0f0efd-4d9b-4eb2-943d-3a34fbe58f08 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386aba60a6434dab992d14237471ad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8a9e2478fc4368aad631cf00a5ab8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:41.262748 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5b0f0efd-4d9b-4eb2-943d-3a34fbe58f08 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] 10.222.0.33 "GET /compute/v2.1/servers/6e95e785-114e-4ffb-88fa-14d783662f85" status: 200 len: 1276 microversion: 2.1 time: 0.398028 Sep 23 04:55:41.263354 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2600/5341] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:40 2022] GET /compute/v2.1/servers/6e95e785-114e-4ffb-88fa-14d783662f85 => generated 1276 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:55:41.444873 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-cfc87430-3ba3-4698-b36a-d0f5912e466e tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:41.453737 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-cfc87430-3ba3-4698-b36a-d0f5912e466e tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1676 microversion: 2.1 time: 0.384688 Sep 23 04:55:41.466818 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2742/5342] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:41 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1676 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:55:41.668556 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-431393f0-32c5-4fa5-ab9a-5ca2ba4f1fd4 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:41.669365 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-431393f0-32c5-4fa5-ab9a-5ca2ba4f1fd4 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 4381aca2-ea30-4473-9cd3-18c9b64f1937] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:41.688534 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-431393f0-32c5-4fa5-ab9a-5ca2ba4f1fd4 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:41.689621 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-431393f0-32c5-4fa5-ab9a-5ca2ba4f1fd4 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:41.690513 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-431393f0-32c5-4fa5-ab9a-5ca2ba4f1fd4 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:41.691450 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-431393f0-32c5-4fa5-ab9a-5ca2ba4f1fd4 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:41.692778 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-431393f0-32c5-4fa5-ab9a-5ca2ba4f1fd4 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:41.693610 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-431393f0-32c5-4fa5-ab9a-5ca2ba4f1fd4 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:41.716022 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-431393f0-32c5-4fa5-ab9a-5ca2ba4f1fd4 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] HTTP exception thrown: Instance 4381aca2-ea30-4473-9cd3-18c9b64f1937 could not be found. Sep 23 04:55:41.719082 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-431393f0-32c5-4fa5-ab9a-5ca2ba4f1fd4 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Request method failure captured: Sep 23 04:55:41.719082 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937 HTTP/1.1 Sep 23 04:55:41.719082 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:55:41.719082 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:55:41.719082 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:55:41.719082 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:55:41.719082 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:55:41.719082 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:55:41.719082 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:55:41.719082 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:55:41.719082 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTuh1c3OgRIe1BU7UL8-kD14hlRXf5-nFbACK4mxuSKPbpHtZ3lNSkhpLmoZL6fwvp0Ltsnj8vHhgRu38aM6jYq6FwsdCqK2OWFRVgv0DQ0vVXkecsl4CFvJWRuidyNHB1AUlKQZ5jbBIxVU9phuyFgTgBHHGat4T2qduHdIYS940-A Sep 23 04:55:41.719082 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:55:41.719082 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:55:41.719082 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:55:41.719082 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:55:41.719082 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:55:41.719082 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:55:41.719082 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 0edd6bd5b418494fbcb05c743967d36a Sep 23 04:55:41.719082 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-326863130 Sep 23 04:55:41.719082 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:55:41.719082 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:55:41.719082 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0edd6bd5b418494fbcb05c743967d36a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0edd6bd5b418494fbcb05c743967d36a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0edd6bd5b418494fbcb05c743967d36a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0edd6bd5b418494fbcb05c743967d36a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:55:41.719082 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-TestNetworkAdvancedServerOps-326863130 Sep 23 04:55:41.719082 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 0edd6bd5b418494fbcb05c743967d36a Sep 23 04:55:41.719082 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-326863130 Sep 23 04:55:41.719082 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-TestNetworkAdvancedServerOps-326863130-project Sep 23 04:55:41.719082 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:55:41.719082 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:55:41.719082 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 8d3d0a162e7e4beb81a54120cab246ff Sep 23 04:55:41.719082 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-TestNetworkAdvancedServerOps-326863130-project Sep 23 04:55:41.719082 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:55:41.719082 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 4381aca2-ea30-4473-9cd3-18c9b64f1937 could not be found. Sep 23 04:55:41.719082 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '4381aca2-ea30-4473-9cd3-18c9b64f1937'} Sep 23 04:55:41.719082 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:55:41.719082 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:55:41.719082 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:55:41.719082 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:55:41.719082 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:55:41.719082 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:55:41.719082 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:55:41.719082 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:55:41.719082 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:55:41.719082 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:55:41.719082 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4381aca2-ea30-4473-9cd3-18c9b64f1937 could not be found. Sep 23 04:55:41.719082 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:55:41.719082 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:55:41.719082 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:55:41.719082 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:55:41.719082 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:55:41.719082 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:55:41.719082 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:55:41.719082 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:55:41.719082 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:55:41.719082 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:55:41.719082 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:55:41.719082 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:55:41.719082 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:55:41.719082 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:55:41.719082 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:55:41.719082 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:55:41.719082 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4381aca2-ea30-4473-9cd3-18c9b64f1937 could not be found. Sep 23 04:55:41.719082 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:55:41.719082 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:55:41.724586 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:55:41.724586 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:55:41.724586 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:55:41.724586 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:55:41.724586 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:55:41.724586 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:55:41.724586 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4381aca2-ea30-4473-9cd3-18c9b64f1937 could not be found. Sep 23 04:55:41.724586 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:55:41.726619 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-431393f0-32c5-4fa5-ab9a-5ca2ba4f1fd4 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Returning 404 to user: Instance 4381aca2-ea30-4473-9cd3-18c9b64f1937 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:55:41.735165 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-431393f0-32c5-4fa5-ab9a-5ca2ba4f1fd4 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937" status: 404 len: 111 microversion: 2.1 time: 0.064684 Sep 23 04:55:41.735165 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2601/5343] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:41 2022] GET /compute/v2.1/servers/4381aca2-ea30-4473-9cd3-18c9b64f1937 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:55:42.287258 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-88be3cd0-1ea6-4d3c-8de9-67ff14329f9c tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:42.288583 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-88be3cd0-1ea6-4d3c-8de9-67ff14329f9c tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] [instance: 6e95e785-114e-4ffb-88fa-14d783662f85] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:42.310912 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-88be3cd0-1ea6-4d3c-8de9-67ff14329f9c tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:42.310912 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-88be3cd0-1ea6-4d3c-8de9-67ff14329f9c tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:42.310912 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-88be3cd0-1ea6-4d3c-8de9-67ff14329f9c tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:42.310912 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-88be3cd0-1ea6-4d3c-8de9-67ff14329f9c tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:42.310912 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-88be3cd0-1ea6-4d3c-8de9-67ff14329f9c tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:42.310912 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-88be3cd0-1ea6-4d3c-8de9-67ff14329f9c tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:42.451511 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-88be3cd0-1ea6-4d3c-8de9-67ff14329f9c tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386aba60a6434dab992d14237471ad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8a9e2478fc4368aad631cf00a5ab8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:42.467542 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-88be3cd0-1ea6-4d3c-8de9-67ff14329f9c tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] 10.222.0.33 "GET /compute/v2.1/servers/6e95e785-114e-4ffb-88fa-14d783662f85" status: 200 len: 1274 microversion: 2.1 time: 0.185256 Sep 23 04:55:42.479236 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2743/5344] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:42 2022] GET /compute/v2.1/servers/6e95e785-114e-4ffb-88fa-14d783662f85 => generated 1274 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:55:42.490523 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-cbc8f7d8-9c26-4ed6-a2e1-36b139f15bc1 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:42.491831 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-cbc8f7d8-9c26-4ed6-a2e1-36b139f15bc1 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:42.522634 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cbc8f7d8-9c26-4ed6-a2e1-36b139f15bc1 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:42.523528 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cbc8f7d8-9c26-4ed6-a2e1-36b139f15bc1 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:42.533298 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cbc8f7d8-9c26-4ed6-a2e1-36b139f15bc1 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:42.533298 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cbc8f7d8-9c26-4ed6-a2e1-36b139f15bc1 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:42.533298 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cbc8f7d8-9c26-4ed6-a2e1-36b139f15bc1 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:42.533298 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cbc8f7d8-9c26-4ed6-a2e1-36b139f15bc1 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:42.690208 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-cbc8f7d8-9c26-4ed6-a2e1-36b139f15bc1 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:42.701051 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-cbc8f7d8-9c26-4ed6-a2e1-36b139f15bc1 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1608 microversion: 2.1 time: 0.216298 Sep 23 04:55:42.701651 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2602/5345] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:42 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1608 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:55:43.030277 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-37c5356e-4faa-468e-b22e-28c64776b200 req-66dd0f09-a5c1-4bb3-a389-f561e09c04f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fb569cf-4457-4695-ad5f-fcb78f0964c5", "name": "network-vif-deleted", "tag": "8fdad197-55e1-4686-bfa9-6cfa0beb24d5"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:55:43.108306 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-37c5356e-4faa-468e-b22e-28c64776b200 req-66dd0f09-a5c1-4bb3-a389-f561e09c04f2 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:43.110280 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-37c5356e-4faa-468e-b22e-28c64776b200 req-66dd0f09-a5c1-4bb3-a389-f561e09c04f2 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:43.112412 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-37c5356e-4faa-468e-b22e-28c64776b200 req-66dd0f09-a5c1-4bb3-a389-f561e09c04f2 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:43.163934 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-37c5356e-4faa-468e-b22e-28c64776b200 req-66dd0f09-a5c1-4bb3-a389-f561e09c04f2 service nova] Creating event network-vif-deleted:8fdad197-55e1-4686-bfa9-6cfa0beb24d5 for instance 4fb569cf-4457-4695-ad5f-fcb78f0964c5 on n-h2-846463-3 Sep 23 04:55:43.211840 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-37c5356e-4faa-468e-b22e-28c64776b200 req-66dd0f09-a5c1-4bb3-a389-f561e09c04f2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.186287 Sep 23 04:55:43.215471 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2744/5346] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:55:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:55:43.500281 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-43344cb0-1c74-4999-948b-2c99ccec533e tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:43.501092 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-43344cb0-1c74-4999-948b-2c99ccec533e tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] [instance: 6e95e785-114e-4ffb-88fa-14d783662f85] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:43.512446 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-43344cb0-1c74-4999-948b-2c99ccec533e tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:43.516342 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-43344cb0-1c74-4999-948b-2c99ccec533e tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:43.516964 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-43344cb0-1c74-4999-948b-2c99ccec533e tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:43.517830 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-43344cb0-1c74-4999-948b-2c99ccec533e tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:43.518431 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-43344cb0-1c74-4999-948b-2c99ccec533e tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:43.518965 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-43344cb0-1c74-4999-948b-2c99ccec533e tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:43.707617 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-43344cb0-1c74-4999-948b-2c99ccec533e tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386aba60a6434dab992d14237471ad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8a9e2478fc4368aad631cf00a5ab8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:43.718626 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-43344cb0-1c74-4999-948b-2c99ccec533e tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] 10.222.0.33 "GET /compute/v2.1/servers/6e95e785-114e-4ffb-88fa-14d783662f85" status: 200 len: 1274 microversion: 2.1 time: 0.222601 Sep 23 04:55:43.719896 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2603/5347] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:43 2022] GET /compute/v2.1/servers/6e95e785-114e-4ffb-88fa-14d783662f85 => generated 1274 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:55:43.727333 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-24d90d1c-43a0-4bd8-8ef0-db901c2d58ad tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:43.728138 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-24d90d1c-43a0-4bd8-8ef0-db901c2d58ad tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:43.745675 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-24d90d1c-43a0-4bd8-8ef0-db901c2d58ad tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:43.746208 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-24d90d1c-43a0-4bd8-8ef0-db901c2d58ad tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:43.750494 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-24d90d1c-43a0-4bd8-8ef0-db901c2d58ad tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:43.750494 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-24d90d1c-43a0-4bd8-8ef0-db901c2d58ad tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:43.750494 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-24d90d1c-43a0-4bd8-8ef0-db901c2d58ad tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:43.750494 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-24d90d1c-43a0-4bd8-8ef0-db901c2d58ad tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:43.818216 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-24d90d1c-43a0-4bd8-8ef0-db901c2d58ad tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:43.818724 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-24d90d1c-43a0-4bd8-8ef0-db901c2d58ad tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:43.819170 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-24d90d1c-43a0-4bd8-8ef0-db901c2d58ad tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:43.819627 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-24d90d1c-43a0-4bd8-8ef0-db901c2d58ad tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lazy-loading 'fault' on Instance uuid 4fb569cf-4457-4695-ad5f-fcb78f0964c5 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:55:44.091850 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-24d90d1c-43a0-4bd8-8ef0-db901c2d58ad tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5e3a6e455e8483b8ce93ad380793335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a45d69316a648fcb9c56190aaec5376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:44.104238 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-24d90d1c-43a0-4bd8-8ef0-db901c2d58ad tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 200 len: 1328 microversion: 2.1 time: 0.382915 Sep 23 04:55:44.105547 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2745/5348] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:43 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 1328 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:55:44.745516 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-46b86cb9-6280-4174-9b0c-fb257e95a608 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:44.746170 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-46b86cb9-6280-4174-9b0c-fb257e95a608 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] [instance: 6e95e785-114e-4ffb-88fa-14d783662f85] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:44.764792 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-46b86cb9-6280-4174-9b0c-fb257e95a608 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:44.765607 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-46b86cb9-6280-4174-9b0c-fb257e95a608 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:44.766287 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-46b86cb9-6280-4174-9b0c-fb257e95a608 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:44.767033 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-46b86cb9-6280-4174-9b0c-fb257e95a608 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:44.767504 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-46b86cb9-6280-4174-9b0c-fb257e95a608 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:44.767935 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-46b86cb9-6280-4174-9b0c-fb257e95a608 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:45.128766 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6df4c309-1654-4791-8d56-103cc0819fd5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:45.129415 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-6df4c309-1654-4791-8d56-103cc0819fd5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] [instance: 4fb569cf-4457-4695-ad5f-fcb78f0964c5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:45.131939 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:55:45.144358 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6df4c309-1654-4791-8d56-103cc0819fd5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:45.145367 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6df4c309-1654-4791-8d56-103cc0819fd5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:45.145819 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6df4c309-1654-4791-8d56-103cc0819fd5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:45.149956 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6df4c309-1654-4791-8d56-103cc0819fd5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:45.150448 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6df4c309-1654-4791-8d56-103cc0819fd5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:45.155777 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6df4c309-1654-4791-8d56-103cc0819fd5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:45.190863 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-6df4c309-1654-4791-8d56-103cc0819fd5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] HTTP exception thrown: Instance 4fb569cf-4457-4695-ad5f-fcb78f0964c5 could not be found. Sep 23 04:55:45.192601 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6df4c309-1654-4791-8d56-103cc0819fd5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Request method failure captured: Sep 23 04:55:45.192601 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 HTTP/1.1 Sep 23 04:55:45.192601 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:55:45.192601 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:55:45.192601 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:55:45.192601 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:55:45.192601 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:55:45.192601 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:55:45.192601 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:55:45.192601 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:55:45.192601 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTo3L7rPLSTfUV5pEDb1r3o2InNz2xVZb49WfY5_7ohSycSRkpblNb-lg3W6XL2Ai8OaA9THkgwtcWGmxSj0UZ4x-A-nrlghfegV0nGu08AcEc2fcMb2XMVF2A7TFyZB5NC63XPko5HHmiQcxjEHCZqFI55a6beSN65iF07uDP5zXrg Sep 23 04:55:45.192601 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:55:45.192601 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:55:45.192601 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:55:45.192601 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:55:45.192601 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:55:45.192601 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:55:45.192601 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 2a45d69316a648fcb9c56190aaec5376 Sep 23 04:55:45.192601 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ServerActionsTestJSON-1180260513 Sep 23 04:55:45.192601 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:55:45.192601 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:55:45.192601 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2a45d69316a648fcb9c56190aaec5376", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2a45d69316a648fcb9c56190aaec5376"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2a45d69316a648fcb9c56190aaec5376"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2a45d69316a648fcb9c56190aaec5376"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:55:45.192601 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ServerActionsTestJSON-1180260513 Sep 23 04:55:45.192601 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 2a45d69316a648fcb9c56190aaec5376 Sep 23 04:55:45.192601 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ServerActionsTestJSON-1180260513 Sep 23 04:55:45.192601 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ServerActionsTestJSON-1180260513-project Sep 23 04:55:45.192601 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:55:45.192601 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:55:45.192601 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: f5e3a6e455e8483b8ce93ad380793335 Sep 23 04:55:45.192601 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ServerActionsTestJSON-1180260513-project Sep 23 04:55:45.192601 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:55:45.192601 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 4fb569cf-4457-4695-ad5f-fcb78f0964c5 could not be found. Sep 23 04:55:45.192601 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '4fb569cf-4457-4695-ad5f-fcb78f0964c5'} Sep 23 04:55:45.192601 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:55:45.192601 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:55:45.192601 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:55:45.192601 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:55:45.192601 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:55:45.192601 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:55:45.192601 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:55:45.192601 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:55:45.192601 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:55:45.192601 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:55:45.192601 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fb569cf-4457-4695-ad5f-fcb78f0964c5 could not be found. Sep 23 04:55:45.192601 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:55:45.192601 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:55:45.192601 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:55:45.192601 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:55:45.192601 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:55:45.192601 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:55:45.192601 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:55:45.192601 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:55:45.192601 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:55:45.192601 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:55:45.192601 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:55:45.192601 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:55:45.192601 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:55:45.192601 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:55:45.192601 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:55:45.192601 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:55:45.192601 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fb569cf-4457-4695-ad5f-fcb78f0964c5 could not be found. Sep 23 04:55:45.192601 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:55:45.192601 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:55:45.192601 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:55:45.197023 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:55:45.197023 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:55:45.197023 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:55:45.197023 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:55:45.197023 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:55:45.197023 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fb569cf-4457-4695-ad5f-fcb78f0964c5 could not be found. Sep 23 04:55:45.197023 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:55:45.197023 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6df4c309-1654-4791-8d56-103cc0819fd5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Returning 404 to user: Instance 4fb569cf-4457-4695-ad5f-fcb78f0964c5 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:55:45.197023 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6df4c309-1654-4791-8d56-103cc0819fd5 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5" status: 404 len: 111 microversion: 2.1 time: 0.069328 Sep 23 04:55:45.197023 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2746/5349] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:45 2022] GET /compute/v2.1/servers/4fb569cf-4457-4695-ad5f-fcb78f0964c5 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:55:45.202790 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-de0ccf1a-1d9c-4185-b503-8676f4964d56 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] Calling method '.version_select at 0x7ff1ba81eca0>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:45.249721 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-46b86cb9-6280-4174-9b0c-fb257e95a608 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386aba60a6434dab992d14237471ad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8a9e2478fc4368aad631cf00a5ab8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:45.261184 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-46b86cb9-6280-4174-9b0c-fb257e95a608 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] 10.222.0.33 "GET /compute/v2.1/servers/6e95e785-114e-4ffb-88fa-14d783662f85" status: 200 len: 1316 microversion: 2.1 time: 0.519473 Sep 23 04:55:45.279300 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2604/5350] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:44 2022] GET /compute/v2.1/servers/6e95e785-114e-4ffb-88fa-14d783662f85 => generated 1316 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:55:45.370488 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-de0ccf1a-1d9c-4185-b503-8676f4964d56 tempest-ServerActionsTestJSON-1180260513 tempest-ServerActionsTestJSON-1180260513-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-394368599" status: 202 len: 0 microversion: 2.1 time: 0.171437 Sep 23 04:55:45.371663 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2747/5351] 10.222.0.33 () {58 vars in 1218 bytes} [Fri Sep 23 04:55:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-394368599 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:55:45.398711 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-26dfc4f0-ce74-4688-84a0-dfed8d2238b9 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-733254510", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "networks": [{"uuid": "ca05156e-a3ef-4bbf-be86-b31ff51bbdf9"}]}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:55:45.482798 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.network.neutron [None req-26dfc4f0-ce74-4688-84a0-dfed8d2238b9 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] validate_networks() for [('ca05156e-a3ef-4bbf-be86-b31ff51bbdf9', None, None, None, None, None)] {{(pid=122698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:55:45.718406 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:55:46.300388 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4dee6d29-139f-4307-9146-63f1679d8bba tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:46.306050 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4dee6d29-139f-4307-9146-63f1679d8bba tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] [instance: 6e95e785-114e-4ffb-88fa-14d783662f85] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:46.328342 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4dee6d29-139f-4307-9146-63f1679d8bba tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:46.328342 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4dee6d29-139f-4307-9146-63f1679d8bba tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:46.328342 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4dee6d29-139f-4307-9146-63f1679d8bba tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:46.328342 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4dee6d29-139f-4307-9146-63f1679d8bba tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:46.328342 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4dee6d29-139f-4307-9146-63f1679d8bba tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:46.328342 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4dee6d29-139f-4307-9146-63f1679d8bba tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:46.939043 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=8 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:55:47.447414 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-4dee6d29-139f-4307-9146-63f1679d8bba tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386aba60a6434dab992d14237471ad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8a9e2478fc4368aad631cf00a5ab8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:47.453308 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:55:47.465772 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4dee6d29-139f-4307-9146-63f1679d8bba tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] 10.222.0.33 "GET /compute/v2.1/servers/6e95e785-114e-4ffb-88fa-14d783662f85" status: 200 len: 1316 microversion: 2.1 time: 1.175291 Sep 23 04:55:47.468436 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2748/5352] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:46 2022] GET /compute/v2.1/servers/6e95e785-114e-4ffb-88fa-14d783662f85 => generated 1316 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:55:47.485285 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-e7a0ac6a-5906-4276-b876-64f254e80e08 req-e47b2f85-06a5-45ab-9895-875b27090dee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e95e785-114e-4ffb-88fa-14d783662f85", "tag": "08ff13d1-5e6d-4b51-ac6b-3f0a4b5f620e"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:55:47.500061 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-e7a0ac6a-5906-4276-b876-64f254e80e08 req-e47b2f85-06a5-45ab-9895-875b27090dee service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:47.501508 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-e7a0ac6a-5906-4276-b876-64f254e80e08 req-e47b2f85-06a5-45ab-9895-875b27090dee service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:47.501983 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-e7a0ac6a-5906-4276-b876-64f254e80e08 req-e47b2f85-06a5-45ab-9895-875b27090dee service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:47.561393 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-e7a0ac6a-5906-4276-b876-64f254e80e08 req-e47b2f85-06a5-45ab-9895-875b27090dee service nova] Creating event network-changed:08ff13d1-5e6d-4b51-ac6b-3f0a4b5f620e for instance 6e95e785-114e-4ffb-88fa-14d783662f85 on n-h2-846463-3 Sep 23 04:55:47.573331 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-e7a0ac6a-5906-4276-b876-64f254e80e08 req-e47b2f85-06a5-45ab-9895-875b27090dee service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102738 Sep 23 04:55:47.574318 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2749/5353] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:55:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:55:47.797514 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-26dfc4f0-ce74-4688-84a0-dfed8d2238b9 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Flavor limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:55:47.797514 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-26dfc4f0-ce74-4688-84a0-dfed8d2238b9 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Image limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:55:47.797514 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-26dfc4f0-ce74-4688-84a0-dfed8d2238b9 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Flavor pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:55:47.797514 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-26dfc4f0-ce74-4688-84a0-dfed8d2238b9 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Image pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:55:47.798779 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-26dfc4f0-ce74-4688-84a0-dfed8d2238b9 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:55:47.822861 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-26dfc4f0-ce74-4688-84a0-dfed8d2238b9 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:47.824269 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-26dfc4f0-ce74-4688-84a0-dfed8d2238b9 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:47.824989 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-26dfc4f0-ce74-4688-84a0-dfed8d2238b9 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:47.825955 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-26dfc4f0-ce74-4688-84a0-dfed8d2238b9 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:47.826625 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-26dfc4f0-ce74-4688-84a0-dfed8d2238b9 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:47.827335 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-26dfc4f0-ce74-4688-84a0-dfed8d2238b9 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:47.855632 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-26dfc4f0-ce74-4688-84a0-dfed8d2238b9 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Getting quotas for project f3232207c310427eae4287ffb6ef6bd2. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:55:47.876885 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-26dfc4f0-ce74-4688-84a0-dfed8d2238b9 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Getting quotas for user dafb546d73a14667be9780a820432bf7 and project f3232207c310427eae4287ffb6ef6bd2. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:55:47.906080 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-26dfc4f0-ce74-4688-84a0-dfed8d2238b9 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Going to run 1 instances... {{(pid=122698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:55:47.913106 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-26dfc4f0-ce74-4688-84a0-dfed8d2238b9 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] [instance: 4ee1b613-5643-49e1-9d9c-ea100c5c55ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:55:48.124637 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-26dfc4f0-ce74-4688-84a0-dfed8d2238b9 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.844029 Sep 23 04:55:48.132665 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2605/5354] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:55:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 2851 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:55:48.139268 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-29a1fc9f-674f-4291-a381-6677024a2883 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:48.143128 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-29a1fc9f-674f-4291-a381-6677024a2883 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] [instance: 4ee1b613-5643-49e1-9d9c-ea100c5c55ff] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:48.455379 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-29a1fc9f-674f-4291-a381-6677024a2883 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafb546d73a14667be9780a820432bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3232207c310427eae4287ffb6ef6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:48.465373 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-29a1fc9f-674f-4291-a381-6677024a2883 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] 10.222.0.33 "GET /compute/v2.1/servers/4ee1b613-5643-49e1-9d9c-ea100c5c55ff" status: 200 len: 1227 microversion: 2.1 time: 0.330212 Sep 23 04:55:48.484790 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2750/5355] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:48 2022] GET /compute/v2.1/servers/4ee1b613-5643-49e1-9d9c-ea100c5c55ff => generated 1227 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:55:48.496157 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b0d55e56-d611-4e10-99ac-939cd18505b0 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:48.496157 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b0d55e56-d611-4e10-99ac-939cd18505b0 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] [instance: 6e95e785-114e-4ffb-88fa-14d783662f85] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:48.500013 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b0d55e56-d611-4e10-99ac-939cd18505b0 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:48.500506 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b0d55e56-d611-4e10-99ac-939cd18505b0 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:48.504842 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b0d55e56-d611-4e10-99ac-939cd18505b0 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:48.505599 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b0d55e56-d611-4e10-99ac-939cd18505b0 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:48.506104 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b0d55e56-d611-4e10-99ac-939cd18505b0 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:48.506542 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b0d55e56-d611-4e10-99ac-939cd18505b0 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:48.939588 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b0d55e56-d611-4e10-99ac-939cd18505b0 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386aba60a6434dab992d14237471ad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8a9e2478fc4368aad631cf00a5ab8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:48.956520 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b0d55e56-d611-4e10-99ac-939cd18505b0 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] 10.222.0.33 "GET /compute/v2.1/servers/6e95e785-114e-4ffb-88fa-14d783662f85" status: 200 len: 1316 microversion: 2.1 time: 0.464161 Sep 23 04:55:48.958533 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2606/5356] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:48 2022] GET /compute/v2.1/servers/6e95e785-114e-4ffb-88fa-14d783662f85 => generated 1316 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:55:49.495351 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e1cb244a-9bcf-42ac-8abb-341f9f93b5de tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:49.496573 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e1cb244a-9bcf-42ac-8abb-341f9f93b5de tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] [instance: 4ee1b613-5643-49e1-9d9c-ea100c5c55ff] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:49.752192 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e1cb244a-9bcf-42ac-8abb-341f9f93b5de tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafb546d73a14667be9780a820432bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3232207c310427eae4287ffb6ef6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:49.762764 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e1cb244a-9bcf-42ac-8abb-341f9f93b5de tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] 10.222.0.33 "GET /compute/v2.1/servers/4ee1b613-5643-49e1-9d9c-ea100c5c55ff" status: 200 len: 1227 microversion: 2.1 time: 0.271674 Sep 23 04:55:49.770570 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2751/5357] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:49 2022] GET /compute/v2.1/servers/4ee1b613-5643-49e1-9d9c-ea100c5c55ff => generated 1227 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:55:49.980268 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ba680ce7-5c5f-449f-a8b6-66d3773ed93e tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:49.981717 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-ba680ce7-5c5f-449f-a8b6-66d3773ed93e tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] [instance: 6e95e785-114e-4ffb-88fa-14d783662f85] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:49.992073 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ba680ce7-5c5f-449f-a8b6-66d3773ed93e tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:49.993080 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ba680ce7-5c5f-449f-a8b6-66d3773ed93e tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:49.994085 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ba680ce7-5c5f-449f-a8b6-66d3773ed93e tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:50.001764 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ba680ce7-5c5f-449f-a8b6-66d3773ed93e tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:50.002558 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ba680ce7-5c5f-449f-a8b6-66d3773ed93e tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:50.003017 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ba680ce7-5c5f-449f-a8b6-66d3773ed93e tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:50.230382 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ba680ce7-5c5f-449f-a8b6-66d3773ed93e tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386aba60a6434dab992d14237471ad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8a9e2478fc4368aad631cf00a5ab8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:50.242174 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ba680ce7-5c5f-449f-a8b6-66d3773ed93e tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] 10.222.0.33 "GET /compute/v2.1/servers/6e95e785-114e-4ffb-88fa-14d783662f85" status: 200 len: 1316 microversion: 2.1 time: 0.262854 Sep 23 04:55:50.242174 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2607/5358] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:49 2022] GET /compute/v2.1/servers/6e95e785-114e-4ffb-88fa-14d783662f85 => generated 1316 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:55:50.790799 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1d221e95-3cd2-45e4-bbea-cd50b451470b tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:50.791570 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1d221e95-3cd2-45e4-bbea-cd50b451470b tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] [instance: 4ee1b613-5643-49e1-9d9c-ea100c5c55ff] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:50.805356 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1d221e95-3cd2-45e4-bbea-cd50b451470b tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:50.806006 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1d221e95-3cd2-45e4-bbea-cd50b451470b tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:50.810596 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1d221e95-3cd2-45e4-bbea-cd50b451470b tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:50.811359 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1d221e95-3cd2-45e4-bbea-cd50b451470b tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:50.812189 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1d221e95-3cd2-45e4-bbea-cd50b451470b tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:50.812624 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1d221e95-3cd2-45e4-bbea-cd50b451470b tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:51.023101 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1d221e95-3cd2-45e4-bbea-cd50b451470b tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafb546d73a14667be9780a820432bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3232207c310427eae4287ffb6ef6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:51.033450 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1d221e95-3cd2-45e4-bbea-cd50b451470b tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] 10.222.0.33 "GET /compute/v2.1/servers/4ee1b613-5643-49e1-9d9c-ea100c5c55ff" status: 200 len: 1279 microversion: 2.1 time: 0.247097 Sep 23 04:55:51.037053 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2752/5359] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:50 2022] GET /compute/v2.1/servers/4ee1b613-5643-49e1-9d9c-ea100c5c55ff => generated 1279 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:55:51.266305 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e7fe0611-627c-4e39-a784-4ddff9b25fd1 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:51.268414 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e7fe0611-627c-4e39-a784-4ddff9b25fd1 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] [instance: 6e95e785-114e-4ffb-88fa-14d783662f85] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:51.287696 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e7fe0611-627c-4e39-a784-4ddff9b25fd1 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:51.288278 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e7fe0611-627c-4e39-a784-4ddff9b25fd1 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:51.288737 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e7fe0611-627c-4e39-a784-4ddff9b25fd1 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:51.289465 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e7fe0611-627c-4e39-a784-4ddff9b25fd1 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:51.290165 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e7fe0611-627c-4e39-a784-4ddff9b25fd1 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:51.290606 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e7fe0611-627c-4e39-a784-4ddff9b25fd1 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:51.623017 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e7fe0611-627c-4e39-a784-4ddff9b25fd1 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386aba60a6434dab992d14237471ad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8a9e2478fc4368aad631cf00a5ab8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:51.644281 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e7fe0611-627c-4e39-a784-4ddff9b25fd1 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] 10.222.0.33 "GET /compute/v2.1/servers/6e95e785-114e-4ffb-88fa-14d783662f85" status: 200 len: 1316 microversion: 2.1 time: 0.383976 Sep 23 04:55:51.645331 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2608/5360] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:51 2022] GET /compute/v2.1/servers/6e95e785-114e-4ffb-88fa-14d783662f85 => generated 1316 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:55:52.057979 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9e707768-ae25-4e20-8543-4ff06e865254 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:52.058610 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-9e707768-ae25-4e20-8543-4ff06e865254 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] [instance: 4ee1b613-5643-49e1-9d9c-ea100c5c55ff] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:52.071386 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9e707768-ae25-4e20-8543-4ff06e865254 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:52.071892 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9e707768-ae25-4e20-8543-4ff06e865254 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:52.072859 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9e707768-ae25-4e20-8543-4ff06e865254 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:52.073243 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9e707768-ae25-4e20-8543-4ff06e865254 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:52.077934 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9e707768-ae25-4e20-8543-4ff06e865254 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:52.078650 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9e707768-ae25-4e20-8543-4ff06e865254 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:52.199099 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-9e707768-ae25-4e20-8543-4ff06e865254 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafb546d73a14667be9780a820432bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3232207c310427eae4287ffb6ef6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:52.209796 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-9e707768-ae25-4e20-8543-4ff06e865254 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] 10.222.0.33 "GET /compute/v2.1/servers/4ee1b613-5643-49e1-9d9c-ea100c5c55ff" status: 200 len: 1285 microversion: 2.1 time: 0.156412 Sep 23 04:55:52.210436 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2753/5361] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:52 2022] GET /compute/v2.1/servers/4ee1b613-5643-49e1-9d9c-ea100c5c55ff => generated 1285 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:55:52.406575 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-5f14fa9b-7b09-4d20-93c0-471972b5d915 req-19064c1a-6462-4b8c-8bf6-9540c478fcdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e95e785-114e-4ffb-88fa-14d783662f85", "name": "network-vif-plugged", "status": "completed", "tag": "08ff13d1-5e6d-4b51-ac6b-3f0a4b5f620e"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:55:52.428694 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-5f14fa9b-7b09-4d20-93c0-471972b5d915 req-19064c1a-6462-4b8c-8bf6-9540c478fcdd service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:52.430388 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-5f14fa9b-7b09-4d20-93c0-471972b5d915 req-19064c1a-6462-4b8c-8bf6-9540c478fcdd service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:52.430840 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-5f14fa9b-7b09-4d20-93c0-471972b5d915 req-19064c1a-6462-4b8c-8bf6-9540c478fcdd service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:52.444866 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-5f14fa9b-7b09-4d20-93c0-471972b5d915 req-19064c1a-6462-4b8c-8bf6-9540c478fcdd service nova] Creating event network-vif-plugged:08ff13d1-5e6d-4b51-ac6b-3f0a4b5f620e for instance 6e95e785-114e-4ffb-88fa-14d783662f85 on n-h2-846463-3 Sep 23 04:55:52.450230 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-5f14fa9b-7b09-4d20-93c0-471972b5d915 req-19064c1a-6462-4b8c-8bf6-9540c478fcdd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047367 Sep 23 04:55:52.451853 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2609/5362] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:55:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:55:52.669264 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3b44df8f-f3a2-4d51-854a-66e2bdc9cc83 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:52.670092 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-3b44df8f-f3a2-4d51-854a-66e2bdc9cc83 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] [instance: 6e95e785-114e-4ffb-88fa-14d783662f85] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:52.678175 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3b44df8f-f3a2-4d51-854a-66e2bdc9cc83 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:52.682262 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3b44df8f-f3a2-4d51-854a-66e2bdc9cc83 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:52.683003 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3b44df8f-f3a2-4d51-854a-66e2bdc9cc83 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:52.684569 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3b44df8f-f3a2-4d51-854a-66e2bdc9cc83 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:52.685296 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3b44df8f-f3a2-4d51-854a-66e2bdc9cc83 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:52.685984 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3b44df8f-f3a2-4d51-854a-66e2bdc9cc83 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:52.890147 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-20f02b94-630b-40f0-91e6-3e193f3b06e7 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:52.890750 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-20f02b94-630b-40f0-91e6-3e193f3b06e7 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] [instance: 6dfb2418-b235-4d35-b109-4bed20d1b96e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:52.901654 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-20f02b94-630b-40f0-91e6-3e193f3b06e7 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:52.902557 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-20f02b94-630b-40f0-91e6-3e193f3b06e7 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:52.903248 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-20f02b94-630b-40f0-91e6-3e193f3b06e7 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:52.903928 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-20f02b94-630b-40f0-91e6-3e193f3b06e7 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:52.905086 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-20f02b94-630b-40f0-91e6-3e193f3b06e7 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:52.905529 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-20f02b94-630b-40f0-91e6-3e193f3b06e7 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:52.934147 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-20f02b94-630b-40f0-91e6-3e193f3b06e7 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] 10.222.0.33 "GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e/ips" status: 200 len: 145 microversion: 2.1 time: 0.049981 Sep 23 04:55:52.934847 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2610/5363] 10.222.0.33 () {58 vars in 1248 bytes} [Fri Sep 23 04:55:52 2022] GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e/ips => generated 145 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:55:53.018774 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-3b44df8f-f3a2-4d51-854a-66e2bdc9cc83 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386aba60a6434dab992d14237471ad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8a9e2478fc4368aad631cf00a5ab8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:53.026938 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3b44df8f-f3a2-4d51-854a-66e2bdc9cc83 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] 10.222.0.33 "GET /compute/v2.1/servers/6e95e785-114e-4ffb-88fa-14d783662f85" status: 200 len: 1316 microversion: 2.1 time: 0.362372 Sep 23 04:55:53.041782 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2754/5364] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:52 2022] GET /compute/v2.1/servers/6e95e785-114e-4ffb-88fa-14d783662f85 => generated 1316 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:55:53.167040 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d61d6585-2daf-4756-b8d7-12f8c204afc7 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '.version_select at 0x7ff1bbae8820>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:53.233012 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-19e56c3a-1661-47a7-a772-92abc63cb2a0 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:53.234307 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-19e56c3a-1661-47a7-a772-92abc63cb2a0 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] [instance: 4ee1b613-5643-49e1-9d9c-ea100c5c55ff] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:53.248669 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d61d6585-2daf-4756-b8d7-12f8c204afc7 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1044440630" status: 202 len: 0 microversion: 2.1 time: 0.085458 Sep 23 04:55:53.250064 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2611/5365] 10.222.0.33 () {58 vars in 1284 bytes} [Fri Sep 23 04:55:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1044440630 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:55:53.255364 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-19e56c3a-1661-47a7-a772-92abc63cb2a0 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:53.266695 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-19e56c3a-1661-47a7-a772-92abc63cb2a0 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:53.266695 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-19e56c3a-1661-47a7-a772-92abc63cb2a0 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:53.266695 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-19e56c3a-1661-47a7-a772-92abc63cb2a0 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:53.266695 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-19e56c3a-1661-47a7-a772-92abc63cb2a0 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:53.266695 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-19e56c3a-1661-47a7-a772-92abc63cb2a0 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:53.291594 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6a97c7dd-72f7-4ce6-8a17-705e59447037 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Action: 'create', calling method: .version_select at 0x7ff1c0138310>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-152890243", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGBuACuzN9+HByNbgEJoxCQuAdgVp3YSISciL6SIDkSpadBVu28pRJnxyeHlGp7y/x8I4cx3hkwWmH/9NygqkRGee6XX9z2CKBdx4keM9xrXroXZ4QW6S7ECwg/45faeLQ=="}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:55:53.327428 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-6a97c7dd-72f7-4ce6-8a17-705e59447037 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Getting quotas for project 0edd6bd5b418494fbcb05c743967d36a. Resources: {'key_pairs'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:55:53.336007 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-6a97c7dd-72f7-4ce6-8a17-705e59447037 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Getting quotas for user 8d3d0a162e7e4beb81a54120cab246ff and project 0edd6bd5b418494fbcb05c743967d36a. Resources: {'key_pairs'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:55:53.380047 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-19e56c3a-1661-47a7-a772-92abc63cb2a0 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafb546d73a14667be9780a820432bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3232207c310427eae4287ffb6ef6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:53.393460 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-19e56c3a-1661-47a7-a772-92abc63cb2a0 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] 10.222.0.33 "GET /compute/v2.1/servers/4ee1b613-5643-49e1-9d9c-ea100c5c55ff" status: 200 len: 1285 microversion: 2.1 time: 0.163629 Sep 23 04:55:53.394378 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2755/5366] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:53 2022] GET /compute/v2.1/servers/4ee1b613-5643-49e1-9d9c-ea100c5c55ff => generated 1285 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:55:53.436728 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-6a97c7dd-72f7-4ce6-8a17-705e59447037 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.150206 Sep 23 04:55:53.437787 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2612/5367] 10.222.0.33 () {60 vars in 1159 bytes} [Fri Sep 23 04:55:53 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:55:54.055657 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-345d602e-623e-4871-8694-cdcadc7152fc tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:54.056420 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-345d602e-623e-4871-8694-cdcadc7152fc tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] [instance: 6e95e785-114e-4ffb-88fa-14d783662f85] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:54.063181 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-345d602e-623e-4871-8694-cdcadc7152fc tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:54.067614 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-345d602e-623e-4871-8694-cdcadc7152fc tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:54.069189 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-345d602e-623e-4871-8694-cdcadc7152fc tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:54.070530 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-345d602e-623e-4871-8694-cdcadc7152fc tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:54.071243 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-345d602e-623e-4871-8694-cdcadc7152fc tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:54.073461 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-345d602e-623e-4871-8694-cdcadc7152fc tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:54.295705 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-345d602e-623e-4871-8694-cdcadc7152fc tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386aba60a6434dab992d14237471ad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8a9e2478fc4368aad631cf00a5ab8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:54.315207 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-345d602e-623e-4871-8694-cdcadc7152fc tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] 10.222.0.33 "GET /compute/v2.1/servers/6e95e785-114e-4ffb-88fa-14d783662f85" status: 200 len: 1316 microversion: 2.1 time: 0.264176 Sep 23 04:55:54.317452 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2756/5368] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:54 2022] GET /compute/v2.1/servers/6e95e785-114e-4ffb-88fa-14d783662f85 => generated 1316 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:55:54.419769 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-179989d0-4bd3-4adf-91a8-59696897e782 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:54.420708 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-179989d0-4bd3-4adf-91a8-59696897e782 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] [instance: 4ee1b613-5643-49e1-9d9c-ea100c5c55ff] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:54.432915 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-179989d0-4bd3-4adf-91a8-59696897e782 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:54.433430 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-179989d0-4bd3-4adf-91a8-59696897e782 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:54.433916 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-179989d0-4bd3-4adf-91a8-59696897e782 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:54.444302 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-179989d0-4bd3-4adf-91a8-59696897e782 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:54.444302 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-179989d0-4bd3-4adf-91a8-59696897e782 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:54.444302 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-179989d0-4bd3-4adf-91a8-59696897e782 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:54.985037 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-179989d0-4bd3-4adf-91a8-59696897e782 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafb546d73a14667be9780a820432bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3232207c310427eae4287ffb6ef6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:54.993625 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-179989d0-4bd3-4adf-91a8-59696897e782 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] 10.222.0.33 "GET /compute/v2.1/servers/4ee1b613-5643-49e1-9d9c-ea100c5c55ff" status: 200 len: 1327 microversion: 2.1 time: 0.578333 Sep 23 04:55:55.000746 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2613/5369] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:54 2022] GET /compute/v2.1/servers/4ee1b613-5643-49e1-9d9c-ea100c5c55ff => generated 1327 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:55:55.342989 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d0e51ac0-6c23-48ed-beae-8fcd080d3fb7 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:55.343620 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d0e51ac0-6c23-48ed-beae-8fcd080d3fb7 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] [instance: 6e95e785-114e-4ffb-88fa-14d783662f85] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:55.352092 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d0e51ac0-6c23-48ed-beae-8fcd080d3fb7 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:55.352848 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d0e51ac0-6c23-48ed-beae-8fcd080d3fb7 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:55.353473 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d0e51ac0-6c23-48ed-beae-8fcd080d3fb7 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:55.354423 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d0e51ac0-6c23-48ed-beae-8fcd080d3fb7 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:55.355127 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d0e51ac0-6c23-48ed-beae-8fcd080d3fb7 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:55.355733 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d0e51ac0-6c23-48ed-beae-8fcd080d3fb7 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:55.635075 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d0e51ac0-6c23-48ed-beae-8fcd080d3fb7 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386aba60a6434dab992d14237471ad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8a9e2478fc4368aad631cf00a5ab8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:55.650950 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d0e51ac0-6c23-48ed-beae-8fcd080d3fb7 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] 10.222.0.33 "GET /compute/v2.1/servers/6e95e785-114e-4ffb-88fa-14d783662f85" status: 200 len: 1505 microversion: 2.1 time: 0.311897 Sep 23 04:55:55.653449 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2757/5370] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:55 2022] GET /compute/v2.1/servers/6e95e785-114e-4ffb-88fa-14d783662f85 => generated 1505 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:55:55.679796 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ec619455-b778-43e4-a3dc-d053862ec38e tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:55.682123 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-ec619455-b778-43e4-a3dc-d053862ec38e tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] [instance: 6e95e785-114e-4ffb-88fa-14d783662f85] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:55.691490 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ec619455-b778-43e4-a3dc-d053862ec38e tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:55.691915 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ec619455-b778-43e4-a3dc-d053862ec38e tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:55.692383 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ec619455-b778-43e4-a3dc-d053862ec38e tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:55.693108 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ec619455-b778-43e4-a3dc-d053862ec38e tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:55.693614 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ec619455-b778-43e4-a3dc-d053862ec38e tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:55.694054 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ec619455-b778-43e4-a3dc-d053862ec38e tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:55.726324 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ec619455-b778-43e4-a3dc-d053862ec38e tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '386aba60a6434dab992d14237471ad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8a9e2478fc4368aad631cf00a5ab8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:55.727654 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ec619455-b778-43e4-a3dc-d053862ec38e tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] 10.222.0.33 "GET /compute/v2.1/servers/6e95e785-114e-4ffb-88fa-14d783662f85/os-instance-actions/req-1e82e4d4-7e66-4075-8ce6-509b227b94fb" status: 200 len: 313 microversion: 2.1 time: 0.052460 Sep 23 04:55:55.728257 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2614/5371] 10.222.0.33 () {58 vars in 1419 bytes} [Fri Sep 23 04:55:55 2022] GET /compute/v2.1/servers/6e95e785-114e-4ffb-88fa-14d783662f85/os-instance-actions/req-1e82e4d4-7e66-4075-8ce6-509b227b94fb => generated 313 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:55:55.742850 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-31f49502-cb53-449d-8647-f2d8f49ed12a tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:55:55.745435 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-31f49502-cb53-449d-8647-f2d8f49ed12a tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] [instance: 6e95e785-114e-4ffb-88fa-14d783662f85] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:55.753293 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-31f49502-cb53-449d-8647-f2d8f49ed12a tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:55.753995 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-31f49502-cb53-449d-8647-f2d8f49ed12a tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:55.754666 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-31f49502-cb53-449d-8647-f2d8f49ed12a tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:55.755671 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-31f49502-cb53-449d-8647-f2d8f49ed12a tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:55.757057 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-31f49502-cb53-449d-8647-f2d8f49ed12a tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:55.757506 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-31f49502-cb53-449d-8647-f2d8f49ed12a tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:55.998547 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-31f49502-cb53-449d-8647-f2d8f49ed12a tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] 10.222.0.33 "POST /compute/v2.1/servers/6e95e785-114e-4ffb-88fa-14d783662f85/action" status: 202 len: 0 microversion: 2.1 time: 0.259402 Sep 23 04:55:55.999719 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2758/5372] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:55:55 2022] POST /compute/v2.1/servers/6e95e785-114e-4ffb-88fa-14d783662f85/action => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:55:56.012558 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-dbdeada4-5623-4691-acb7-0b5d8636b8a2 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:56.015079 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-dbdeada4-5623-4691-acb7-0b5d8636b8a2 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] [instance: 6e95e785-114e-4ffb-88fa-14d783662f85] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:56.029655 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7cfe61f0-820d-4ab3-ba05-9e3bbe0b9fd5 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:56.031898 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dbdeada4-5623-4691-acb7-0b5d8636b8a2 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:56.034596 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dbdeada4-5623-4691-acb7-0b5d8636b8a2 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:56.036383 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dbdeada4-5623-4691-acb7-0b5d8636b8a2 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:56.037918 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-7cfe61f0-820d-4ab3-ba05-9e3bbe0b9fd5 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] [instance: 4ee1b613-5643-49e1-9d9c-ea100c5c55ff] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:56.039177 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dbdeada4-5623-4691-acb7-0b5d8636b8a2 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:56.039862 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dbdeada4-5623-4691-acb7-0b5d8636b8a2 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:56.040348 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dbdeada4-5623-4691-acb7-0b5d8636b8a2 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:56.069602 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7cfe61f0-820d-4ab3-ba05-9e3bbe0b9fd5 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:56.070103 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7cfe61f0-820d-4ab3-ba05-9e3bbe0b9fd5 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:56.072669 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7cfe61f0-820d-4ab3-ba05-9e3bbe0b9fd5 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:56.077272 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7cfe61f0-820d-4ab3-ba05-9e3bbe0b9fd5 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:56.077272 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7cfe61f0-820d-4ab3-ba05-9e3bbe0b9fd5 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:56.077272 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7cfe61f0-820d-4ab3-ba05-9e3bbe0b9fd5 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:56.486349 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-dbdeada4-5623-4691-acb7-0b5d8636b8a2 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386aba60a6434dab992d14237471ad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8a9e2478fc4368aad631cf00a5ab8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:56.495303 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-dbdeada4-5623-4691-acb7-0b5d8636b8a2 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] 10.222.0.33 "GET /compute/v2.1/servers/6e95e785-114e-4ffb-88fa-14d783662f85" status: 200 len: 1507 microversion: 2.1 time: 0.489849 Sep 23 04:55:56.496794 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2615/5373] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:56 2022] GET /compute/v2.1/servers/6e95e785-114e-4ffb-88fa-14d783662f85 => generated 1507 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:55:56.540129 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-7cfe61f0-820d-4ab3-ba05-9e3bbe0b9fd5 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafb546d73a14667be9780a820432bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3232207c310427eae4287ffb6ef6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:56.556456 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-7cfe61f0-820d-4ab3-ba05-9e3bbe0b9fd5 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] 10.222.0.33 "GET /compute/v2.1/servers/4ee1b613-5643-49e1-9d9c-ea100c5c55ff" status: 200 len: 1327 microversion: 2.1 time: 0.532849 Sep 23 04:55:56.560222 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2759/5374] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:56 2022] GET /compute/v2.1/servers/4ee1b613-5643-49e1-9d9c-ea100c5c55ff => generated 1327 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:55:57.020313 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-863365f2-601f-4204-84aa-a1fd0f5d69d6 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8665a9e7-15e3-4f9e-9ef4-40fbaf947667"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:55:57.022749 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-863365f2-601f-4204-84aa-a1fd0f5d69d6 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] [instance: 6dfb2418-b235-4d35-b109-4bed20d1b96e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:57.029633 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-863365f2-601f-4204-84aa-a1fd0f5d69d6 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:57.035573 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-863365f2-601f-4204-84aa-a1fd0f5d69d6 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:57.035573 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-863365f2-601f-4204-84aa-a1fd0f5d69d6 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:57.035573 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-863365f2-601f-4204-84aa-a1fd0f5d69d6 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:57.035573 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-863365f2-601f-4204-84aa-a1fd0f5d69d6 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:57.035573 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-863365f2-601f-4204-84aa-a1fd0f5d69d6 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:57.522971 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1446377f-8823-4a47-bf1c-89a02a26c7a0 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:57.523610 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1446377f-8823-4a47-bf1c-89a02a26c7a0 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] [instance: 6e95e785-114e-4ffb-88fa-14d783662f85] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:57.543037 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1446377f-8823-4a47-bf1c-89a02a26c7a0 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:57.543642 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1446377f-8823-4a47-bf1c-89a02a26c7a0 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:57.543991 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1446377f-8823-4a47-bf1c-89a02a26c7a0 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:57.544717 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1446377f-8823-4a47-bf1c-89a02a26c7a0 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:57.545182 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1446377f-8823-4a47-bf1c-89a02a26c7a0 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:57.545613 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1446377f-8823-4a47-bf1c-89a02a26c7a0 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:57.844407 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:55:57.855679 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1446377f-8823-4a47-bf1c-89a02a26c7a0 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386aba60a6434dab992d14237471ad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8a9e2478fc4368aad631cf00a5ab8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:57.863887 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1446377f-8823-4a47-bf1c-89a02a26c7a0 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] 10.222.0.33 "GET /compute/v2.1/servers/6e95e785-114e-4ffb-88fa-14d783662f85" status: 200 len: 1507 microversion: 2.1 time: 0.348557 Sep 23 04:55:57.868732 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2760/5375] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:57 2022] GET /compute/v2.1/servers/6e95e785-114e-4ffb-88fa-14d783662f85 => generated 1507 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:55:57.869157 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-38f6d328-d85e-4c03-bd86-4e6c969c8417 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:57.870283 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-38f6d328-d85e-4c03-bd86-4e6c969c8417 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] [instance: 4ee1b613-5643-49e1-9d9c-ea100c5c55ff] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:57.876155 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-38f6d328-d85e-4c03-bd86-4e6c969c8417 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:57.876872 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-38f6d328-d85e-4c03-bd86-4e6c969c8417 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:57.877491 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-38f6d328-d85e-4c03-bd86-4e6c969c8417 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:57.878420 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-38f6d328-d85e-4c03-bd86-4e6c969c8417 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:57.879089 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-38f6d328-d85e-4c03-bd86-4e6c969c8417 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:57.879933 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-38f6d328-d85e-4c03-bd86-4e6c969c8417 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:58.059997 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-38f6d328-d85e-4c03-bd86-4e6c969c8417 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafb546d73a14667be9780a820432bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3232207c310427eae4287ffb6ef6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:58.104959 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-38f6d328-d85e-4c03-bd86-4e6c969c8417 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] 10.222.0.33 "GET /compute/v2.1/servers/4ee1b613-5643-49e1-9d9c-ea100c5c55ff" status: 200 len: 1327 microversion: 2.1 time: 0.231162 Sep 23 04:55:58.105564 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2761/5376] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:57 2022] GET /compute/v2.1/servers/4ee1b613-5643-49e1-9d9c-ea100c5c55ff => generated 1327 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:55:58.146060 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-863365f2-601f-4204-84aa-a1fd0f5d69d6 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] 10.222.0.33 "POST /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.129751 Sep 23 04:55:58.147043 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2616/5377] 10.222.0.33 () {60 vars in 1323 bytes} [Fri Sep 23 04:55:57 2022] POST /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e/os-volume_attachments => generated 194 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:55:58.385156 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-24a29dde-9a6e-4478-83df-124b896b88e7 req-008f27c3-00b3-4eea-ae37-c758d9d89bb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ee1b613-5643-49e1-9d9c-ea100c5c55ff", "tag": "d5dae26e-b35e-4d28-9c57-40a5253ec981"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:55:58.401769 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-24a29dde-9a6e-4478-83df-124b896b88e7 req-008f27c3-00b3-4eea-ae37-c758d9d89bb0 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:58.403426 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-24a29dde-9a6e-4478-83df-124b896b88e7 req-008f27c3-00b3-4eea-ae37-c758d9d89bb0 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:58.404126 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-24a29dde-9a6e-4478-83df-124b896b88e7 req-008f27c3-00b3-4eea-ae37-c758d9d89bb0 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:58.451124 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-24a29dde-9a6e-4478-83df-124b896b88e7 req-008f27c3-00b3-4eea-ae37-c758d9d89bb0 service nova] Creating event network-changed:d5dae26e-b35e-4d28-9c57-40a5253ec981 for instance 4ee1b613-5643-49e1-9d9c-ea100c5c55ff on n-h1-846463-3 Sep 23 04:55:58.461292 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-24a29dde-9a6e-4478-83df-124b896b88e7 req-008f27c3-00b3-4eea-ae37-c758d9d89bb0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083315 Sep 23 04:55:58.464165 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2762/5378] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:55:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:55:58.889584 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6b20c385-71b8-472c-a1a6-c9b37d4db25e tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:58.890666 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-6b20c385-71b8-472c-a1a6-c9b37d4db25e tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] [instance: 6e95e785-114e-4ffb-88fa-14d783662f85] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:58.910507 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6b20c385-71b8-472c-a1a6-c9b37d4db25e tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:58.911472 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6b20c385-71b8-472c-a1a6-c9b37d4db25e tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:58.912201 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6b20c385-71b8-472c-a1a6-c9b37d4db25e tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:58.913292 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6b20c385-71b8-472c-a1a6-c9b37d4db25e tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:58.913985 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6b20c385-71b8-472c-a1a6-c9b37d4db25e tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:58.914614 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6b20c385-71b8-472c-a1a6-c9b37d4db25e tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:59.129692 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-126bc1f0-aacd-408a-b1d5-f58d2867cb2e tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:55:59.134433 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-126bc1f0-aacd-408a-b1d5-f58d2867cb2e tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] [instance: 4ee1b613-5643-49e1-9d9c-ea100c5c55ff] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:55:59.178579 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-126bc1f0-aacd-408a-b1d5-f58d2867cb2e tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:59.184399 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-126bc1f0-aacd-408a-b1d5-f58d2867cb2e tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:59.185214 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-126bc1f0-aacd-408a-b1d5-f58d2867cb2e tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:59.186468 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-126bc1f0-aacd-408a-b1d5-f58d2867cb2e tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:55:59.191050 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-126bc1f0-aacd-408a-b1d5-f58d2867cb2e tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:55:59.192492 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-126bc1f0-aacd-408a-b1d5-f58d2867cb2e tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:55:59.642247 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6b20c385-71b8-472c-a1a6-c9b37d4db25e tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386aba60a6434dab992d14237471ad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8a9e2478fc4368aad631cf00a5ab8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:59.661165 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-6b20c385-71b8-472c-a1a6-c9b37d4db25e tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] 10.222.0.33 "GET /compute/v2.1/servers/6e95e785-114e-4ffb-88fa-14d783662f85" status: 200 len: 1507 microversion: 2.1 time: 0.777051 Sep 23 04:55:59.662185 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2617/5379] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:58 2022] GET /compute/v2.1/servers/6e95e785-114e-4ffb-88fa-14d783662f85 => generated 1507 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:55:59.761163 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=4 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:55:59.967109 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-126bc1f0-aacd-408a-b1d5-f58d2867cb2e tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafb546d73a14667be9780a820432bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3232207c310427eae4287ffb6ef6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:55:59.980880 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-126bc1f0-aacd-408a-b1d5-f58d2867cb2e tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] 10.222.0.33 "GET /compute/v2.1/servers/4ee1b613-5643-49e1-9d9c-ea100c5c55ff" status: 200 len: 1327 microversion: 2.1 time: 0.856318 Sep 23 04:55:59.982513 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2763/5380] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:55:59 2022] GET /compute/v2.1/servers/4ee1b613-5643-49e1-9d9c-ea100c5c55ff => generated 1327 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:56:00.690486 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-46bb0c0d-f9a6-4dc5-a1af-999a68dc2a39 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:00.692432 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-46bb0c0d-f9a6-4dc5-a1af-999a68dc2a39 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] [instance: 6e95e785-114e-4ffb-88fa-14d783662f85] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:00.709950 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-46bb0c0d-f9a6-4dc5-a1af-999a68dc2a39 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:00.711731 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-46bb0c0d-f9a6-4dc5-a1af-999a68dc2a39 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:00.712436 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-46bb0c0d-f9a6-4dc5-a1af-999a68dc2a39 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:00.714153 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-46bb0c0d-f9a6-4dc5-a1af-999a68dc2a39 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:00.714846 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-46bb0c0d-f9a6-4dc5-a1af-999a68dc2a39 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:00.715522 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-46bb0c0d-f9a6-4dc5-a1af-999a68dc2a39 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:01.005150 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3b09984c-c05c-489b-91b7-cd70dfa0495b tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:01.005879 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-3b09984c-c05c-489b-91b7-cd70dfa0495b tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] [instance: 4ee1b613-5643-49e1-9d9c-ea100c5c55ff] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:01.020727 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3b09984c-c05c-489b-91b7-cd70dfa0495b tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:01.022659 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3b09984c-c05c-489b-91b7-cd70dfa0495b tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:01.023459 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3b09984c-c05c-489b-91b7-cd70dfa0495b tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:01.027638 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3b09984c-c05c-489b-91b7-cd70dfa0495b tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:01.030226 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3b09984c-c05c-489b-91b7-cd70dfa0495b tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:01.031935 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3b09984c-c05c-489b-91b7-cd70dfa0495b tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:01.033071 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-46bb0c0d-f9a6-4dc5-a1af-999a68dc2a39 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386aba60a6434dab992d14237471ad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8a9e2478fc4368aad631cf00a5ab8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:56:01.068524 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-46bb0c0d-f9a6-4dc5-a1af-999a68dc2a39 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] 10.222.0.33 "GET /compute/v2.1/servers/6e95e785-114e-4ffb-88fa-14d783662f85" status: 200 len: 1505 microversion: 2.1 time: 0.385355 Sep 23 04:56:01.088972 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2618/5381] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:56:00 2022] GET /compute/v2.1/servers/6e95e785-114e-4ffb-88fa-14d783662f85 => generated 1505 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:56:01.119964 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a1230d62-d8e0-435b-b1f1-6c9d6ecf8a1d tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Calling method '.version_select at 0x7ff1c3e6f160>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:01.120555 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a1230d62-d8e0-435b-b1f1-6c9d6ecf8a1d tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] [instance: 6e95e785-114e-4ffb-88fa-14d783662f85] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:01.134031 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a1230d62-d8e0-435b-b1f1-6c9d6ecf8a1d tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:01.134535 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a1230d62-d8e0-435b-b1f1-6c9d6ecf8a1d tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:01.140017 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a1230d62-d8e0-435b-b1f1-6c9d6ecf8a1d tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:01.140875 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a1230d62-d8e0-435b-b1f1-6c9d6ecf8a1d tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:01.143188 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a1230d62-d8e0-435b-b1f1-6c9d6ecf8a1d tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:01.145874 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a1230d62-d8e0-435b-b1f1-6c9d6ecf8a1d tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:01.177301 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:56:01.204250 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a1230d62-d8e0-435b-b1f1-6c9d6ecf8a1d tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] 10.222.0.33 "GET /compute/v2.1/servers/6e95e785-114e-4ffb-88fa-14d783662f85/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.096388 Sep 23 04:56:01.204851 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2619/5382] 10.222.0.33 () {58 vars in 1296 bytes} [Fri Sep 23 04:56:01 2022] GET /compute/v2.1/servers/6e95e785-114e-4ffb-88fa-14d783662f85/os-instance-actions => generated 611 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:56:01.228402 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6f64b6b0-c45e-42e1-a701-86d956c2a82f tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:01.235157 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-6f64b6b0-c45e-42e1-a701-86d956c2a82f tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] [instance: 6e95e785-114e-4ffb-88fa-14d783662f85] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:01.243710 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6f64b6b0-c45e-42e1-a701-86d956c2a82f tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:01.244224 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6f64b6b0-c45e-42e1-a701-86d956c2a82f tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:01.244823 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6f64b6b0-c45e-42e1-a701-86d956c2a82f tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:01.245558 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6f64b6b0-c45e-42e1-a701-86d956c2a82f tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:01.246061 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6f64b6b0-c45e-42e1-a701-86d956c2a82f tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:01.248085 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6f64b6b0-c45e-42e1-a701-86d956c2a82f tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:01.314478 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-6f64b6b0-c45e-42e1-a701-86d956c2a82f tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] [instance: 6e95e785-114e-4ffb-88fa-14d783662f85] Going to try to terminate instance {{(pid=122698) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:56:01.405023 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-3b09984c-c05c-489b-91b7-cd70dfa0495b tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafb546d73a14667be9780a820432bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3232207c310427eae4287ffb6ef6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:56:01.415458 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3b09984c-c05c-489b-91b7-cd70dfa0495b tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] 10.222.0.33 "GET /compute/v2.1/servers/4ee1b613-5643-49e1-9d9c-ea100c5c55ff" status: 200 len: 1327 microversion: 2.1 time: 0.414789 Sep 23 04:56:01.416851 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2764/5383] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:56:00 2022] GET /compute/v2.1/servers/4ee1b613-5643-49e1-9d9c-ea100c5c55ff => generated 1327 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:56:01.831385 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-6f64b6b0-c45e-42e1-a701-86d956c2a82f tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6e95e785-114e-4ffb-88fa-14d783662f85" status: 204 len: 0 microversion: 2.1 time: 0.613265 Sep 23 04:56:01.840840 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2620/5384] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:56:01 2022] DELETE /compute/v2.1/servers/6e95e785-114e-4ffb-88fa-14d783662f85 => generated 0 bytes in 616 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:56:01.851617 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c431e588-02a6-4a45-96de-4faa8d3263d1 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:01.852238 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c431e588-02a6-4a45-96de-4faa8d3263d1 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] [instance: 6e95e785-114e-4ffb-88fa-14d783662f85] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:01.864093 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c431e588-02a6-4a45-96de-4faa8d3263d1 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:01.864597 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c431e588-02a6-4a45-96de-4faa8d3263d1 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:01.865097 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c431e588-02a6-4a45-96de-4faa8d3263d1 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:01.865826 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c431e588-02a6-4a45-96de-4faa8d3263d1 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:01.866317 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c431e588-02a6-4a45-96de-4faa8d3263d1 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:01.866749 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c431e588-02a6-4a45-96de-4faa8d3263d1 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:02.442498 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c431e588-02a6-4a45-96de-4faa8d3263d1 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386aba60a6434dab992d14237471ad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8a9e2478fc4368aad631cf00a5ab8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:56:02.452130 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d02c03da-de3b-4260-934d-6ff4575482ad tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:02.453824 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d02c03da-de3b-4260-934d-6ff4575482ad tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] [instance: 4ee1b613-5643-49e1-9d9c-ea100c5c55ff] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:02.469780 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c431e588-02a6-4a45-96de-4faa8d3263d1 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] 10.222.0.33 "GET /compute/v2.1/servers/6e95e785-114e-4ffb-88fa-14d783662f85" status: 200 len: 1511 microversion: 2.1 time: 0.623800 Sep 23 04:56:02.471059 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2765/5385] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:56:01 2022] GET /compute/v2.1/servers/6e95e785-114e-4ffb-88fa-14d783662f85 => generated 1511 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:56:02.471480 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d02c03da-de3b-4260-934d-6ff4575482ad tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:02.472162 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d02c03da-de3b-4260-934d-6ff4575482ad tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:02.477099 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d02c03da-de3b-4260-934d-6ff4575482ad tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:02.477099 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d02c03da-de3b-4260-934d-6ff4575482ad tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:02.477099 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d02c03da-de3b-4260-934d-6ff4575482ad tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:02.477099 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d02c03da-de3b-4260-934d-6ff4575482ad tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:02.730882 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d02c03da-de3b-4260-934d-6ff4575482ad tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafb546d73a14667be9780a820432bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3232207c310427eae4287ffb6ef6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:56:02.741918 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d02c03da-de3b-4260-934d-6ff4575482ad tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] 10.222.0.33 "GET /compute/v2.1/servers/4ee1b613-5643-49e1-9d9c-ea100c5c55ff" status: 200 len: 1327 microversion: 2.1 time: 0.304127 Sep 23 04:56:02.744957 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2621/5386] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:56:02 2022] GET /compute/v2.1/servers/4ee1b613-5643-49e1-9d9c-ea100c5c55ff => generated 1327 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:56:03.500734 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ce94eaba-5f83-473d-942d-9ac9bf8e6236 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:03.504339 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ce94eaba-5f83-473d-942d-9ac9bf8e6236 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] [instance: 6e95e785-114e-4ffb-88fa-14d783662f85] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:03.518051 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ce94eaba-5f83-473d-942d-9ac9bf8e6236 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:03.520295 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ce94eaba-5f83-473d-942d-9ac9bf8e6236 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:03.520295 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ce94eaba-5f83-473d-942d-9ac9bf8e6236 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:03.521574 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ce94eaba-5f83-473d-942d-9ac9bf8e6236 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:03.524964 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ce94eaba-5f83-473d-942d-9ac9bf8e6236 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:03.525766 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ce94eaba-5f83-473d-942d-9ac9bf8e6236 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:03.774656 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ce94eaba-5f83-473d-942d-9ac9bf8e6236 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386aba60a6434dab992d14237471ad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8a9e2478fc4368aad631cf00a5ab8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:56:03.774809 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-00f46e6c-3caa-4945-b07c-0f45d29300f1 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:03.775401 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-00f46e6c-3caa-4945-b07c-0f45d29300f1 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] [instance: 4ee1b613-5643-49e1-9d9c-ea100c5c55ff] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:03.779015 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=10 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:56:03.788644 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ce94eaba-5f83-473d-942d-9ac9bf8e6236 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] 10.222.0.33 "GET /compute/v2.1/servers/6e95e785-114e-4ffb-88fa-14d783662f85" status: 200 len: 1511 microversion: 2.1 time: 0.292265 Sep 23 04:56:03.789791 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2766/5387] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:56:03 2022] GET /compute/v2.1/servers/6e95e785-114e-4ffb-88fa-14d783662f85 => generated 1511 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:56:03.801184 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-00f46e6c-3caa-4945-b07c-0f45d29300f1 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:03.810177 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-00f46e6c-3caa-4945-b07c-0f45d29300f1 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:03.812253 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-00f46e6c-3caa-4945-b07c-0f45d29300f1 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:03.812253 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-00f46e6c-3caa-4945-b07c-0f45d29300f1 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:03.812253 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-00f46e6c-3caa-4945-b07c-0f45d29300f1 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:03.812632 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-00f46e6c-3caa-4945-b07c-0f45d29300f1 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:04.095456 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ce94eaba-5f83-473d-942d-9ac9bf8e6236 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:04.096410 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ce94eaba-5f83-473d-942d-9ac9bf8e6236 tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] 10.222.0.33 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001315 Sep 23 04:56:04.097933 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2767/5388] 10.222.0.33 () {56 vars in 886 bytes} [Fri Sep 23 04:56:04 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Sep 23 04:56:04.193750 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-00f46e6c-3caa-4945-b07c-0f45d29300f1 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafb546d73a14667be9780a820432bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3232207c310427eae4287ffb6ef6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:56:04.212454 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-00f46e6c-3caa-4945-b07c-0f45d29300f1 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] 10.222.0.33 "GET /compute/v2.1/servers/4ee1b613-5643-49e1-9d9c-ea100c5c55ff" status: 200 len: 1327 microversion: 2.1 time: 0.441749 Sep 23 04:56:04.221429 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2622/5389] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:56:03 2022] GET /compute/v2.1/servers/4ee1b613-5643-49e1-9d9c-ea100c5c55ff => generated 1327 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:56:04.821502 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-760c6dc0-06c9-4b6f-b2ff-ed650b10680e tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:04.821502 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-760c6dc0-06c9-4b6f-b2ff-ed650b10680e tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] [instance: 6e95e785-114e-4ffb-88fa-14d783662f85] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:04.829839 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-760c6dc0-06c9-4b6f-b2ff-ed650b10680e tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:04.831040 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-760c6dc0-06c9-4b6f-b2ff-ed650b10680e tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:04.832111 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-760c6dc0-06c9-4b6f-b2ff-ed650b10680e tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:04.833007 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-760c6dc0-06c9-4b6f-b2ff-ed650b10680e tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:04.833987 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-760c6dc0-06c9-4b6f-b2ff-ed650b10680e tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:04.834623 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-760c6dc0-06c9-4b6f-b2ff-ed650b10680e tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:04.981582 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-760c6dc0-06c9-4b6f-b2ff-ed650b10680e tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386aba60a6434dab992d14237471ad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8a9e2478fc4368aad631cf00a5ab8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:56:04.985930 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:56:04.993759 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-760c6dc0-06c9-4b6f-b2ff-ed650b10680e tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] 10.222.0.33 "GET /compute/v2.1/servers/6e95e785-114e-4ffb-88fa-14d783662f85" status: 200 len: 1469 microversion: 2.1 time: 0.180961 Sep 23 04:56:04.994608 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2768/5390] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:56:04 2022] GET /compute/v2.1/servers/6e95e785-114e-4ffb-88fa-14d783662f85 => generated 1469 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:56:05.250598 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-542e265f-890c-44ac-a01f-4f682d2187ed tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:05.252171 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-542e265f-890c-44ac-a01f-4f682d2187ed tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] [instance: 4ee1b613-5643-49e1-9d9c-ea100c5c55ff] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:05.272019 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-542e265f-890c-44ac-a01f-4f682d2187ed tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:05.274587 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-542e265f-890c-44ac-a01f-4f682d2187ed tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:05.275123 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-542e265f-890c-44ac-a01f-4f682d2187ed tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:05.278004 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-542e265f-890c-44ac-a01f-4f682d2187ed tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:05.279528 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-542e265f-890c-44ac-a01f-4f682d2187ed tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:05.280437 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-542e265f-890c-44ac-a01f-4f682d2187ed tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:05.490686 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-e6fa32e7-5194-49cc-af41-c2b248f425ad req-07586c56-39c9-4d1e-b966-6c226a6b2b15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e95e785-114e-4ffb-88fa-14d783662f85", "name": "network-vif-deleted", "tag": "08ff13d1-5e6d-4b51-ac6b-3f0a4b5f620e"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:56:05.505489 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:56:05.509057 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-e6fa32e7-5194-49cc-af41-c2b248f425ad req-07586c56-39c9-4d1e-b966-6c226a6b2b15 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:05.509987 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-e6fa32e7-5194-49cc-af41-c2b248f425ad req-07586c56-39c9-4d1e-b966-6c226a6b2b15 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:05.511185 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-e6fa32e7-5194-49cc-af41-c2b248f425ad req-07586c56-39c9-4d1e-b966-6c226a6b2b15 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:05.537740 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-e6fa32e7-5194-49cc-af41-c2b248f425ad req-07586c56-39c9-4d1e-b966-6c226a6b2b15 service nova] Creating event network-vif-deleted:08ff13d1-5e6d-4b51-ac6b-3f0a4b5f620e for instance 6e95e785-114e-4ffb-88fa-14d783662f85 on n-h2-846463-3 Sep 23 04:56:05.546900 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-e6fa32e7-5194-49cc-af41-c2b248f425ad req-07586c56-39c9-4d1e-b966-6c226a6b2b15 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063371 Sep 23 04:56:05.548649 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2769/5391] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:56:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:56:05.587401 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-542e265f-890c-44ac-a01f-4f682d2187ed tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafb546d73a14667be9780a820432bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3232207c310427eae4287ffb6ef6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:56:05.596220 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-542e265f-890c-44ac-a01f-4f682d2187ed tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] 10.222.0.33 "GET /compute/v2.1/servers/4ee1b613-5643-49e1-9d9c-ea100c5c55ff" status: 200 len: 1327 microversion: 2.1 time: 0.350002 Sep 23 04:56:05.598653 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2623/5392] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:56:05 2022] GET /compute/v2.1/servers/4ee1b613-5643-49e1-9d9c-ea100c5c55ff => generated 1327 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:56:06.023322 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a935c3ed-4bcc-4086-a275-27b0a6e6835c tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:06.024653 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a935c3ed-4bcc-4086-a275-27b0a6e6835c tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] [instance: 6e95e785-114e-4ffb-88fa-14d783662f85] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:06.038065 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a935c3ed-4bcc-4086-a275-27b0a6e6835c tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:06.043305 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a935c3ed-4bcc-4086-a275-27b0a6e6835c tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:06.043770 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a935c3ed-4bcc-4086-a275-27b0a6e6835c tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:06.044559 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a935c3ed-4bcc-4086-a275-27b0a6e6835c tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:06.045091 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a935c3ed-4bcc-4086-a275-27b0a6e6835c tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:06.046436 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a935c3ed-4bcc-4086-a275-27b0a6e6835c tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:06.108324 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a935c3ed-4bcc-4086-a275-27b0a6e6835c tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:06.109180 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a935c3ed-4bcc-4086-a275-27b0a6e6835c tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:06.109466 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a935c3ed-4bcc-4086-a275-27b0a6e6835c tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:06.109991 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-a935c3ed-4bcc-4086-a275-27b0a6e6835c tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lazy-loading 'fault' on Instance uuid 6e95e785-114e-4ffb-88fa-14d783662f85 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:56:06.190289 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a935c3ed-4bcc-4086-a275-27b0a6e6835c tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '386aba60a6434dab992d14237471ad4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8a9e2478fc4368aad631cf00a5ab8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:56:06.210880 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a935c3ed-4bcc-4086-a275-27b0a6e6835c tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] 10.222.0.33 "GET /compute/v2.1/servers/6e95e785-114e-4ffb-88fa-14d783662f85" status: 200 len: 1306 microversion: 2.1 time: 0.194861 Sep 23 04:56:06.221932 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2770/5393] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:56:06 2022] GET /compute/v2.1/servers/6e95e785-114e-4ffb-88fa-14d783662f85 => generated 1306 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:56:06.623925 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5dce997a-034c-472c-a05d-412f89599cc5 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:06.624668 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5dce997a-034c-472c-a05d-412f89599cc5 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] [instance: 4ee1b613-5643-49e1-9d9c-ea100c5c55ff] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:06.642151 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5dce997a-034c-472c-a05d-412f89599cc5 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:06.643720 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5dce997a-034c-472c-a05d-412f89599cc5 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:06.645345 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5dce997a-034c-472c-a05d-412f89599cc5 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:06.646142 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5dce997a-034c-472c-a05d-412f89599cc5 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:06.648730 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5dce997a-034c-472c-a05d-412f89599cc5 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:06.653244 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5dce997a-034c-472c-a05d-412f89599cc5 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:07.236488 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-eca9a325-edb0-464c-a032-ba8e5f3bd71a tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:07.237114 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-eca9a325-edb0-464c-a032-ba8e5f3bd71a tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] [instance: 6e95e785-114e-4ffb-88fa-14d783662f85] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:07.245175 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eca9a325-edb0-464c-a032-ba8e5f3bd71a tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:07.245930 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eca9a325-edb0-464c-a032-ba8e5f3bd71a tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:07.246544 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eca9a325-edb0-464c-a032-ba8e5f3bd71a tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:07.247431 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eca9a325-edb0-464c-a032-ba8e5f3bd71a tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:07.248121 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eca9a325-edb0-464c-a032-ba8e5f3bd71a tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:07.248747 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eca9a325-edb0-464c-a032-ba8e5f3bd71a tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:07.268936 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-eca9a325-edb0-464c-a032-ba8e5f3bd71a tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] HTTP exception thrown: Instance 6e95e785-114e-4ffb-88fa-14d783662f85 could not be found. Sep 23 04:56:07.270860 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-eca9a325-edb0-464c-a032-ba8e5f3bd71a tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Request method failure captured: Sep 23 04:56:07.270860 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/6e95e785-114e-4ffb-88fa-14d783662f85 HTTP/1.1 Sep 23 04:56:07.270860 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:56:07.270860 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:56:07.270860 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:56:07.270860 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:56:07.270860 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:56:07.270860 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:56:07.270860 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:56:07.270860 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:56:07.270860 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTxDweW8sVOfM1diRLXTJfl7QbcEsLPLsnNhbIAh8xnjmj1jOw_OZbtg_FAUegrALOy1YAwnvYCOjtHmA8fSEP8BeMuo0wwS45PXPdPzgVcBOwaO-ttyc3bXJfN_inIdehnNgevgDHjpsZe2GiOgr3wsB0rmbdzAVjR-bBEirSiBYrM Sep 23 04:56:07.270860 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:56:07.270860 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:56:07.270860 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:56:07.270860 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:56:07.270860 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:56:07.270860 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:56:07.270860 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 7e8a9e2478fc4368aad631cf00a5ab8e Sep 23 04:56:07.270860 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-InstanceActionsTestJSON-1832045791 Sep 23 04:56:07.270860 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:56:07.270860 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:56:07.270860 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7e8a9e2478fc4368aad631cf00a5ab8e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7e8a9e2478fc4368aad631cf00a5ab8e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7e8a9e2478fc4368aad631cf00a5ab8e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7e8a9e2478fc4368aad631cf00a5ab8e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:56:07.270860 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-InstanceActionsTestJSON-1832045791 Sep 23 04:56:07.270860 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 7e8a9e2478fc4368aad631cf00a5ab8e Sep 23 04:56:07.270860 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-InstanceActionsTestJSON-1832045791 Sep 23 04:56:07.270860 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-InstanceActionsTestJSON-1832045791-project Sep 23 04:56:07.270860 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:56:07.270860 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:56:07.270860 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 386aba60a6434dab992d14237471ad4d Sep 23 04:56:07.270860 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-InstanceActionsTestJSON-1832045791-project Sep 23 04:56:07.270860 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:56:07.270860 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 6e95e785-114e-4ffb-88fa-14d783662f85 could not be found. Sep 23 04:56:07.270860 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '6e95e785-114e-4ffb-88fa-14d783662f85'} Sep 23 04:56:07.270860 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:56:07.270860 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:56:07.270860 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:56:07.270860 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:56:07.270860 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:56:07.270860 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:56:07.270860 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:56:07.270860 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:56:07.270860 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:56:07.270860 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:56:07.270860 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e95e785-114e-4ffb-88fa-14d783662f85 could not be found. Sep 23 04:56:07.270860 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:56:07.270860 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:56:07.270860 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:56:07.270860 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:56:07.270860 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:56:07.270860 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:56:07.270860 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:56:07.270860 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:56:07.270860 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:56:07.270860 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:56:07.270860 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:56:07.270860 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:56:07.270860 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:56:07.270860 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:56:07.270860 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:56:07.270860 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:56:07.270860 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e95e785-114e-4ffb-88fa-14d783662f85 could not be found. Sep 23 04:56:07.270860 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:56:07.270860 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:56:07.270860 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:56:07.276199 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:56:07.276199 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:56:07.276199 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:56:07.276199 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:56:07.276199 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:56:07.276199 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e95e785-114e-4ffb-88fa-14d783662f85 could not be found. Sep 23 04:56:07.276199 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:56:07.278584 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-eca9a325-edb0-464c-a032-ba8e5f3bd71a tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] Returning 404 to user: Instance 6e95e785-114e-4ffb-88fa-14d783662f85 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:56:07.279642 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-eca9a325-edb0-464c-a032-ba8e5f3bd71a tempest-InstanceActionsTestJSON-1832045791 tempest-InstanceActionsTestJSON-1832045791-project] 10.222.0.33 "GET /compute/v2.1/servers/6e95e785-114e-4ffb-88fa-14d783662f85" status: 404 len: 111 microversion: 2.1 time: 0.047718 Sep 23 04:56:07.280633 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2771/5394] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:56:07 2022] GET /compute/v2.1/servers/6e95e785-114e-4ffb-88fa-14d783662f85 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 04:56:07.368502 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-5dce997a-034c-472c-a05d-412f89599cc5 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafb546d73a14667be9780a820432bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3232207c310427eae4287ffb6ef6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:56:07.392568 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5dce997a-034c-472c-a05d-412f89599cc5 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] 10.222.0.33 "GET /compute/v2.1/servers/4ee1b613-5643-49e1-9d9c-ea100c5c55ff" status: 200 len: 1327 microversion: 2.1 time: 0.773344 Sep 23 04:56:07.419031 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2624/5395] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:56:06 2022] GET /compute/v2.1/servers/4ee1b613-5643-49e1-9d9c-ea100c5c55ff => generated 1327 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:56:07.467124 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-78dde369-ec53-4798-82c7-058abdeeab94 req-c54c6926-e196-4477-ad6a-55db45b88c94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ee1b613-5643-49e1-9d9c-ea100c5c55ff", "name": "network-vif-plugged", "status": "completed", "tag": "d5dae26e-b35e-4d28-9c57-40a5253ec981"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:56:07.513388 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-78dde369-ec53-4798-82c7-058abdeeab94 req-c54c6926-e196-4477-ad6a-55db45b88c94 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:07.515885 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-78dde369-ec53-4798-82c7-058abdeeab94 req-c54c6926-e196-4477-ad6a-55db45b88c94 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:07.515885 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-78dde369-ec53-4798-82c7-058abdeeab94 req-c54c6926-e196-4477-ad6a-55db45b88c94 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:07.560114 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-78dde369-ec53-4798-82c7-058abdeeab94 req-c54c6926-e196-4477-ad6a-55db45b88c94 service nova] Creating event network-vif-plugged:d5dae26e-b35e-4d28-9c57-40a5253ec981 for instance 4ee1b613-5643-49e1-9d9c-ea100c5c55ff on n-h1-846463-3 Sep 23 04:56:07.590015 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-78dde369-ec53-4798-82c7-058abdeeab94 req-c54c6926-e196-4477-ad6a-55db45b88c94 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138405 Sep 23 04:56:07.591530 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2772/5396] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:56:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:56:08.187171 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-cbc677fb-79f1-4f6f-a87a-9c845f92d91b tempest-QuotasTestJSON-359830717 tempest-QuotasTestJSON-359830717-project] Calling method '.version_select at 0x7ff1bbf145e0>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:08.282970 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-cbc677fb-79f1-4f6f-a87a-9c845f92d91b tempest-QuotasTestJSON-359830717 tempest-QuotasTestJSON-359830717-project] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/2bde08a5c6524eb5994a709ee8900e22/defaults" status: 200 len: 371 microversion: 2.1 time: 0.370895 Sep 23 04:56:08.283866 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2625/5397] 10.222.0.33 () {58 vars in 1269 bytes} [Fri Sep 23 04:56:07 2022] GET /compute/v2.1/os-quota-sets/2bde08a5c6524eb5994a709ee8900e22/defaults => generated 371 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:56:08.298026 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8bedde48-7368-4c8a-9878-3f2d11f2eb0e tempest-QuotasTestJSON-359830717 tempest-QuotasTestJSON-359830717-project] Calling method '.version_select at 0x7ff1ba863700>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:08.428113 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-8bedde48-7368-4c8a-9878-3f2d11f2eb0e tempest-QuotasTestJSON-359830717 tempest-QuotasTestJSON-359830717-project] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/2bde08a5c6524eb5994a709ee8900e22" status: 200 len: 371 microversion: 2.1 time: 0.134869 Sep 23 04:56:08.438425 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2773/5398] 10.222.0.33 () {58 vars in 1242 bytes} [Fri Sep 23 04:56:08 2022] GET /compute/v2.1/os-quota-sets/2bde08a5c6524eb5994a709ee8900e22 => generated 371 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:56:08.444293 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1ffdc493-82dc-4c46-b589-1e6100f1d791 tempest-QuotasTestJSON-359830717 tempest-QuotasTestJSON-359830717-project] Calling method '.version_select at 0x7ff1bbad9820>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:08.445939 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-fe8b7268-d95c-4a64-8357-4d3c961bcf4e tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:08.446926 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-fe8b7268-d95c-4a64-8357-4d3c961bcf4e tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] [instance: 4ee1b613-5643-49e1-9d9c-ea100c5c55ff] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:08.455911 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fe8b7268-d95c-4a64-8357-4d3c961bcf4e tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:08.456658 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fe8b7268-d95c-4a64-8357-4d3c961bcf4e tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:08.457570 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fe8b7268-d95c-4a64-8357-4d3c961bcf4e tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:08.459467 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fe8b7268-d95c-4a64-8357-4d3c961bcf4e tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:08.464287 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fe8b7268-d95c-4a64-8357-4d3c961bcf4e tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:08.464287 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fe8b7268-d95c-4a64-8357-4d3c961bcf4e tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:08.547103 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-1ffdc493-82dc-4c46-b589-1e6100f1d791 tempest-QuotasTestJSON-359830717 tempest-QuotasTestJSON-359830717-project] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/2bde08a5c6524eb5994a709ee8900e22/defaults" status: 200 len: 371 microversion: 2.1 time: 0.108002 Sep 23 04:56:08.549258 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2626/5399] 10.222.0.33 () {58 vars in 1269 bytes} [Fri Sep 23 04:56:08 2022] GET /compute/v2.1/os-quota-sets/2bde08a5c6524eb5994a709ee8900e22/defaults => generated 371 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:56:08.562783 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0086770e-538b-49f1-9b09-ef11ed6baadd tempest-QuotasTestJSON-359830717 tempest-QuotasTestJSON-359830717-project] Calling method '.version_select at 0x7ff1bbad9700>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:08.668709 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0086770e-538b-49f1-9b09-ef11ed6baadd tempest-QuotasTestJSON-359830717 tempest-QuotasTestJSON-359830717-project] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/2bde08a5c6524eb5994a709ee8900e22" status: 200 len: 371 microversion: 2.1 time: 0.109866 Sep 23 04:56:08.676718 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2627/5400] 10.222.0.33 () {58 vars in 1242 bytes} [Fri Sep 23 04:56:08 2022] GET /compute/v2.1/os-quota-sets/2bde08a5c6524eb5994a709ee8900e22 => generated 371 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:56:08.684619 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-bad92972-fb3c-4ff3-809f-e373468b8f48 tempest-QuotasTestJSON-359830717 tempest-QuotasTestJSON-359830717-project] Calling method '.version_select at 0x7ff1c3dc8d30>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:08.800301 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:56:08.801953 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-bad92972-fb3c-4ff3-809f-e373468b8f48 tempest-QuotasTestJSON-359830717 tempest-QuotasTestJSON-359830717-project] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/2bde08a5c6524eb5994a709ee8900e22?user_id=2855bd76fd614795b7a41808db74cc88" status: 200 len: 371 microversion: 2.1 time: 0.123292 Sep 23 04:56:08.810001 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2628/5401] 10.222.0.33 () {58 vars in 1323 bytes} [Fri Sep 23 04:56:08 2022] GET /compute/v2.1/os-quota-sets/2bde08a5c6524eb5994a709ee8900e22?user_id=2855bd76fd614795b7a41808db74cc88 => generated 371 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:56:08.900752 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-fe8b7268-d95c-4a64-8357-4d3c961bcf4e tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafb546d73a14667be9780a820432bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3232207c310427eae4287ffb6ef6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:56:08.929711 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-fe8b7268-d95c-4a64-8357-4d3c961bcf4e tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] 10.222.0.33 "GET /compute/v2.1/servers/4ee1b613-5643-49e1-9d9c-ea100c5c55ff" status: 200 len: 1327 microversion: 2.1 time: 0.489485 Sep 23 04:56:08.932762 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2774/5402] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:56:08 2022] GET /compute/v2.1/servers/4ee1b613-5643-49e1-9d9c-ea100c5c55ff => generated 1327 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:56:09.954037 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2f10d7d3-37af-4368-bc84-5af459d9bfff tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:09.955294 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-2f10d7d3-37af-4368-bc84-5af459d9bfff tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] [instance: 4ee1b613-5643-49e1-9d9c-ea100c5c55ff] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:09.967403 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2f10d7d3-37af-4368-bc84-5af459d9bfff tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:09.968340 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2f10d7d3-37af-4368-bc84-5af459d9bfff tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:09.969084 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2f10d7d3-37af-4368-bc84-5af459d9bfff tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:09.970655 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2f10d7d3-37af-4368-bc84-5af459d9bfff tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:09.971334 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2f10d7d3-37af-4368-bc84-5af459d9bfff tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:09.972487 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2f10d7d3-37af-4368-bc84-5af459d9bfff tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:10.417957 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-2f10d7d3-37af-4368-bc84-5af459d9bfff tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafb546d73a14667be9780a820432bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3232207c310427eae4287ffb6ef6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:56:10.435775 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2f10d7d3-37af-4368-bc84-5af459d9bfff tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] 10.222.0.33 "GET /compute/v2.1/servers/4ee1b613-5643-49e1-9d9c-ea100c5c55ff" status: 200 len: 1528 microversion: 2.1 time: 0.485562 Sep 23 04:56:10.437273 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2629/5403] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:56:09 2022] GET /compute/v2.1/servers/4ee1b613-5643-49e1-9d9c-ea100c5c55ff => generated 1528 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:56:10.465160 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ac64f1e0-38ea-4c9d-9ca2-aa95adae7d52 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:10.466443 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ac64f1e0-38ea-4c9d-9ca2-aa95adae7d52 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] [instance: 4ee1b613-5643-49e1-9d9c-ea100c5c55ff] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:10.477093 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ac64f1e0-38ea-4c9d-9ca2-aa95adae7d52 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:10.480515 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ac64f1e0-38ea-4c9d-9ca2-aa95adae7d52 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:10.481830 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ac64f1e0-38ea-4c9d-9ca2-aa95adae7d52 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:10.484204 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ac64f1e0-38ea-4c9d-9ca2-aa95adae7d52 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:10.484851 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ac64f1e0-38ea-4c9d-9ca2-aa95adae7d52 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:10.486410 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ac64f1e0-38ea-4c9d-9ca2-aa95adae7d52 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:10.871507 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ac64f1e0-38ea-4c9d-9ca2-aa95adae7d52 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafb546d73a14667be9780a820432bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3232207c310427eae4287ffb6ef6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:56:10.888534 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ac64f1e0-38ea-4c9d-9ca2-aa95adae7d52 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] 10.222.0.33 "GET /compute/v2.1/servers/4ee1b613-5643-49e1-9d9c-ea100c5c55ff" status: 200 len: 1528 microversion: 2.1 time: 0.427550 Sep 23 04:56:10.889994 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2775/5404] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:56:10 2022] GET /compute/v2.1/servers/4ee1b613-5643-49e1-9d9c-ea100c5c55ff => generated 1528 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:56:11.183186 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ab7d6a47-d023-457f-8709-4a1fbf3e35ff tempest-ServersNegativeTestMultiTenantJSON-1529263515 tempest-ServersNegativeTestMultiTenantJSON-1529263515-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:11.184615 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-ab7d6a47-d023-457f-8709-4a1fbf3e35ff tempest-ServersNegativeTestMultiTenantJSON-1529263515 tempest-ServersNegativeTestMultiTenantJSON-1529263515-project] [instance: 4ee1b613-5643-49e1-9d9c-ea100c5c55ff] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:11.205093 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ab7d6a47-d023-457f-8709-4a1fbf3e35ff tempest-ServersNegativeTestMultiTenantJSON-1529263515 tempest-ServersNegativeTestMultiTenantJSON-1529263515-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:11.207784 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ab7d6a47-d023-457f-8709-4a1fbf3e35ff tempest-ServersNegativeTestMultiTenantJSON-1529263515 tempest-ServersNegativeTestMultiTenantJSON-1529263515-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:11.209798 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ab7d6a47-d023-457f-8709-4a1fbf3e35ff tempest-ServersNegativeTestMultiTenantJSON-1529263515 tempest-ServersNegativeTestMultiTenantJSON-1529263515-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:11.210772 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ab7d6a47-d023-457f-8709-4a1fbf3e35ff tempest-ServersNegativeTestMultiTenantJSON-1529263515 tempest-ServersNegativeTestMultiTenantJSON-1529263515-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:11.211814 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ab7d6a47-d023-457f-8709-4a1fbf3e35ff tempest-ServersNegativeTestMultiTenantJSON-1529263515 tempest-ServersNegativeTestMultiTenantJSON-1529263515-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:11.212881 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ab7d6a47-d023-457f-8709-4a1fbf3e35ff tempest-ServersNegativeTestMultiTenantJSON-1529263515 tempest-ServersNegativeTestMultiTenantJSON-1529263515-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:11.238172 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-ab7d6a47-d023-457f-8709-4a1fbf3e35ff tempest-ServersNegativeTestMultiTenantJSON-1529263515 tempest-ServersNegativeTestMultiTenantJSON-1529263515-project] HTTP exception thrown: Instance 4ee1b613-5643-49e1-9d9c-ea100c5c55ff could not be found. Sep 23 04:56:11.240114 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ab7d6a47-d023-457f-8709-4a1fbf3e35ff tempest-ServersNegativeTestMultiTenantJSON-1529263515 tempest-ServersNegativeTestMultiTenantJSON-1529263515-project] Request method failure captured: Sep 23 04:56:11.240114 n-d-846463-3 devstack@n-api.service[122698]: request: DELETE /compute/v2.1/servers/4ee1b613-5643-49e1-9d9c-ea100c5c55ff HTTP/1.1 Sep 23 04:56:11.240114 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:56:11.240114 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:56:11.240114 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:56:11.240114 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:56:11.240114 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:56:11.240114 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:56:11.240114 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:56:11.240114 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:56:11.240114 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTxQyEQ77-IMm6Pe1dfMdCF7hF0aeVzbiPWosGagSLKahgpEWchb-6oVOrgrTbiF6HF7Zolqh9GIJ8_3kLh5e7nI1YmAh8esTo71vqLceNURzcclBR1jNAuJjnelaYmmoK2C046odAncmrmfajj9AHbIHq2h0BRD8QLCv6NyvMSE_3s Sep 23 04:56:11.240114 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:56:11.240114 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:56:11.240114 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:56:11.240114 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:56:11.240114 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:56:11.240114 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:56:11.240114 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: b5c835817bd24c58b74d8fd56bfaf6b3 Sep 23 04:56:11.240114 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1529263515 Sep 23 04:56:11.240114 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:56:11.240114 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:56:11.240114 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b5c835817bd24c58b74d8fd56bfaf6b3", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b5c835817bd24c58b74d8fd56bfaf6b3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b5c835817bd24c58b74d8fd56bfaf6b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b5c835817bd24c58b74d8fd56bfaf6b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:56:11.240114 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1529263515 Sep 23 04:56:11.240114 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: b5c835817bd24c58b74d8fd56bfaf6b3 Sep 23 04:56:11.240114 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1529263515 Sep 23 04:56:11.240114 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1529263515-project Sep 23 04:56:11.240114 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:56:11.240114 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:56:11.240114 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 82f153b8b7a14512904535dc6a7dd217 Sep 23 04:56:11.240114 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1529263515-project Sep 23 04:56:11.240114 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:56:11.240114 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 4ee1b613-5643-49e1-9d9c-ea100c5c55ff could not be found. Sep 23 04:56:11.240114 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '4ee1b613-5643-49e1-9d9c-ea100c5c55ff'} Sep 23 04:56:11.240114 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:56:11.240114 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:56:11.240114 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:56:11.240114 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:56:11.240114 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:56:11.240114 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:56:11.240114 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:56:11.240114 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:56:11.240114 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:56:11.240114 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:56:11.240114 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ee1b613-5643-49e1-9d9c-ea100c5c55ff could not be found. Sep 23 04:56:11.240114 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:56:11.240114 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:56:11.240114 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:56:11.240114 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:56:11.240114 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:56:11.240114 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:56:11.240114 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:56:11.240114 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:56:11.240114 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:56:11.240114 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:56:11.240114 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 04:56:11.240114 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 04:56:11.240114 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 04:56:11.240114 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 04:56:11.240114 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:56:11.240114 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:56:11.240114 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:56:11.240114 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:56:11.244593 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ee1b613-5643-49e1-9d9c-ea100c5c55ff could not be found. Sep 23 04:56:11.244593 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:56:11.244593 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:56:11.244593 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:56:11.244593 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:56:11.244593 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:56:11.244593 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:56:11.244593 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:56:11.244593 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:56:11.244593 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ee1b613-5643-49e1-9d9c-ea100c5c55ff could not be found. Sep 23 04:56:11.244593 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:56:11.244593 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ab7d6a47-d023-457f-8709-4a1fbf3e35ff tempest-ServersNegativeTestMultiTenantJSON-1529263515 tempest-ServersNegativeTestMultiTenantJSON-1529263515-project] Returning 404 to user: Instance 4ee1b613-5643-49e1-9d9c-ea100c5c55ff could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:56:11.244593 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ab7d6a47-d023-457f-8709-4a1fbf3e35ff tempest-ServersNegativeTestMultiTenantJSON-1529263515 tempest-ServersNegativeTestMultiTenantJSON-1529263515-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4ee1b613-5643-49e1-9d9c-ea100c5c55ff" status: 404 len: 111 microversion: 2.1 time: 0.335920 Sep 23 04:56:11.250456 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2630/5405] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:56:10 2022] DELETE /compute/v2.1/servers/4ee1b613-5643-49e1-9d9c-ea100c5c55ff => generated 111 bytes in 343 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:56:11.261550 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-02914231-f895-474b-8eab-106e70875e73 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:11.263428 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-02914231-f895-474b-8eab-106e70875e73 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] [instance: 4ee1b613-5643-49e1-9d9c-ea100c5c55ff] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:11.269196 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-02914231-f895-474b-8eab-106e70875e73 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:11.269964 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-02914231-f895-474b-8eab-106e70875e73 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:11.270423 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-02914231-f895-474b-8eab-106e70875e73 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:11.271140 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-02914231-f895-474b-8eab-106e70875e73 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:11.271597 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-02914231-f895-474b-8eab-106e70875e73 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:11.272025 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-02914231-f895-474b-8eab-106e70875e73 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:11.761838 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-fd07c287-1f79-4a8d-ab7f-601ec1332188 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:56:11.771981 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fd07c287-1f79-4a8d-ab7f-601ec1332188 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:11.773143 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fd07c287-1f79-4a8d-ab7f-601ec1332188 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:11.774319 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fd07c287-1f79-4a8d-ab7f-601ec1332188 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:11.848373 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-fd07c287-1f79-4a8d-ab7f-601ec1332188 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] [instance: 6dfb2418-b235-4d35-b109-4bed20d1b96e] Going to try to stop instance {{(pid=122698) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 23 04:56:12.150112 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-fd07c287-1f79-4a8d-ab7f-601ec1332188 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] 10.222.0.33 "POST /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e/action" status: 202 len: 0 microversion: 2.1 time: 0.393443 Sep 23 04:56:12.151361 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2631/5406] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:56:11 2022] POST /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e/action => generated 0 bytes in 396 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:56:12.166712 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9ac63a7d-0dc7-46f7-bc1f-8907c1208a0d tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:12.173323 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-9ac63a7d-0dc7-46f7-bc1f-8907c1208a0d tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] [instance: 6dfb2418-b235-4d35-b109-4bed20d1b96e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:12.190830 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9ac63a7d-0dc7-46f7-bc1f-8907c1208a0d tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:12.192352 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9ac63a7d-0dc7-46f7-bc1f-8907c1208a0d tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:12.192883 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9ac63a7d-0dc7-46f7-bc1f-8907c1208a0d tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:12.193791 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9ac63a7d-0dc7-46f7-bc1f-8907c1208a0d tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:12.194294 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9ac63a7d-0dc7-46f7-bc1f-8907c1208a0d tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:12.196949 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9ac63a7d-0dc7-46f7-bc1f-8907c1208a0d tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:12.316334 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-02914231-f895-474b-8eab-106e70875e73 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafb546d73a14667be9780a820432bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3232207c310427eae4287ffb6ef6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:56:12.331803 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-02914231-f895-474b-8eab-106e70875e73 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] 10.222.0.33 "GET /compute/v2.1/servers/4ee1b613-5643-49e1-9d9c-ea100c5c55ff" status: 200 len: 1528 microversion: 2.1 time: 1.073682 Sep 23 04:56:12.356736 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2776/5407] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:56:11 2022] GET /compute/v2.1/servers/4ee1b613-5643-49e1-9d9c-ea100c5c55ff => generated 1528 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:56:12.363274 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-cdf6527a-a1e5-4390-99c6-db34eeae6314 tempest-ServersNegativeTestMultiTenantJSON-1529263515 tempest-ServersNegativeTestMultiTenantJSON-1529263515-project] Action: 'update', calling method: >, body: {"server": {"name": "4ee1b613-5643-49e1-9d9c-ea100c5c55ff_new"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:56:12.366187 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-cdf6527a-a1e5-4390-99c6-db34eeae6314 tempest-ServersNegativeTestMultiTenantJSON-1529263515 tempest-ServersNegativeTestMultiTenantJSON-1529263515-project] [instance: 4ee1b613-5643-49e1-9d9c-ea100c5c55ff] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:12.372867 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cdf6527a-a1e5-4390-99c6-db34eeae6314 tempest-ServersNegativeTestMultiTenantJSON-1529263515 tempest-ServersNegativeTestMultiTenantJSON-1529263515-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:12.373600 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cdf6527a-a1e5-4390-99c6-db34eeae6314 tempest-ServersNegativeTestMultiTenantJSON-1529263515 tempest-ServersNegativeTestMultiTenantJSON-1529263515-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:12.374368 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cdf6527a-a1e5-4390-99c6-db34eeae6314 tempest-ServersNegativeTestMultiTenantJSON-1529263515 tempest-ServersNegativeTestMultiTenantJSON-1529263515-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:12.375324 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cdf6527a-a1e5-4390-99c6-db34eeae6314 tempest-ServersNegativeTestMultiTenantJSON-1529263515 tempest-ServersNegativeTestMultiTenantJSON-1529263515-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:12.376062 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cdf6527a-a1e5-4390-99c6-db34eeae6314 tempest-ServersNegativeTestMultiTenantJSON-1529263515 tempest-ServersNegativeTestMultiTenantJSON-1529263515-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:12.376716 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cdf6527a-a1e5-4390-99c6-db34eeae6314 tempest-ServersNegativeTestMultiTenantJSON-1529263515 tempest-ServersNegativeTestMultiTenantJSON-1529263515-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:12.396505 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-cdf6527a-a1e5-4390-99c6-db34eeae6314 tempest-ServersNegativeTestMultiTenantJSON-1529263515 tempest-ServersNegativeTestMultiTenantJSON-1529263515-project] HTTP exception thrown: Instance 4ee1b613-5643-49e1-9d9c-ea100c5c55ff could not be found. Sep 23 04:56:12.398652 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-cdf6527a-a1e5-4390-99c6-db34eeae6314 tempest-ServersNegativeTestMultiTenantJSON-1529263515 tempest-ServersNegativeTestMultiTenantJSON-1529263515-project] Request method failure captured: Sep 23 04:56:12.398652 n-d-846463-3 devstack@n-api.service[122699]: request: PUT /compute/v2.1/servers/4ee1b613-5643-49e1-9d9c-ea100c5c55ff HTTP/1.1 Sep 23 04:56:12.398652 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:56:12.398652 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:56:12.398652 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:56:12.398652 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 64 Sep 23 04:56:12.398652 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:56:12.398652 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:56:12.398652 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:56:12.398652 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:56:12.398652 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTxQyEQ77-IMm6Pe1dfMdCF7hF0aeVzbiPWosGagSLKahgpEWchb-6oVOrgrTbiF6HF7Zolqh9GIJ8_3kLh5e7nI1YmAh8esTo71vqLceNURzcclBR1jNAuJjnelaYmmoK2C046odAncmrmfajj9AHbIHq2h0BRD8QLCv6NyvMSE_3s Sep 23 04:56:12.398652 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:56:12.398652 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:56:12.398652 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:56:12.398652 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:56:12.398652 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:56:12.398652 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:56:12.398652 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: b5c835817bd24c58b74d8fd56bfaf6b3 Sep 23 04:56:12.398652 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1529263515 Sep 23 04:56:12.398652 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:56:12.398652 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:56:12.398652 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b5c835817bd24c58b74d8fd56bfaf6b3", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b5c835817bd24c58b74d8fd56bfaf6b3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b5c835817bd24c58b74d8fd56bfaf6b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b5c835817bd24c58b74d8fd56bfaf6b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:56:12.398652 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1529263515 Sep 23 04:56:12.398652 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: b5c835817bd24c58b74d8fd56bfaf6b3 Sep 23 04:56:12.398652 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1529263515 Sep 23 04:56:12.398652 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1529263515-project Sep 23 04:56:12.398652 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:56:12.398652 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:56:12.398652 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 82f153b8b7a14512904535dc6a7dd217 Sep 23 04:56:12.398652 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1529263515-project Sep 23 04:56:12.398652 n-d-846463-3 devstack@n-api.service[122699]: Sep 23 04:56:12.398652 n-d-846463-3 devstack@n-api.service[122699]: {"server": {"name": "4ee1b613-5643-49e1-9d9c-ea100c5c55ff_new"}} Sep 23 04:56:12.398652 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:56:12.398652 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 4ee1b613-5643-49e1-9d9c-ea100c5c55ff could not be found. Sep 23 04:56:12.398652 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '4ee1b613-5643-49e1-9d9c-ea100c5c55ff', 'body': {'server': {'name': '4ee1b613-5643-49e1-9d9c-ea100c5c55ff_new'}}} Sep 23 04:56:12.398652 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:56:12.398652 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:56:12.398652 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:56:12.398652 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:56:12.398652 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:56:12.398652 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:56:12.398652 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:56:12.398652 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:56:12.398652 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:56:12.398652 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:56:12.398652 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ee1b613-5643-49e1-9d9c-ea100c5c55ff could not be found. Sep 23 04:56:12.398652 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:56:12.398652 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:56:12.398652 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:56:12.398652 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:56:12.398652 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:56:12.398652 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:56:12.398652 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:56:12.398652 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:56:12.398652 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:56:12.398652 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:56:12.398652 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:56:12.398652 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:56:12.398652 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:56:12.398652 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:56:12.398652 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 04:56:12.398652 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:56:12.398652 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 23 04:56:12.403151 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Sep 23 04:56:12.403151 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Sep 23 04:56:12.403151 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:56:12.403151 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:56:12.403151 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:56:12.403151 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:56:12.403151 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ee1b613-5643-49e1-9d9c-ea100c5c55ff could not be found. Sep 23 04:56:12.403151 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:56:12.403151 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:56:12.403151 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:56:12.403151 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:56:12.403151 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:56:12.403151 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:56:12.403151 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:56:12.403151 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:56:12.403151 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ee1b613-5643-49e1-9d9c-ea100c5c55ff could not be found. Sep 23 04:56:12.403151 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:56:12.407075 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-cdf6527a-a1e5-4390-99c6-db34eeae6314 tempest-ServersNegativeTestMultiTenantJSON-1529263515 tempest-ServersNegativeTestMultiTenantJSON-1529263515-project] Returning 404 to user: Instance 4ee1b613-5643-49e1-9d9c-ea100c5c55ff could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:56:12.408252 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-cdf6527a-a1e5-4390-99c6-db34eeae6314 tempest-ServersNegativeTestMultiTenantJSON-1529263515 tempest-ServersNegativeTestMultiTenantJSON-1529263515-project] 10.222.0.33 "PUT /compute/v2.1/servers/4ee1b613-5643-49e1-9d9c-ea100c5c55ff" status: 404 len: 111 microversion: 2.1 time: 0.048983 Sep 23 04:56:12.417607 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2777/5408] 10.222.0.33 () {60 vars in 1256 bytes} [Fri Sep 23 04:56:12 2022] PUT /compute/v2.1/servers/4ee1b613-5643-49e1-9d9c-ea100c5c55ff => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 04:56:12.420229 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-babe4e01-bc0d-40b9-9e16-ea3f121d6944 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:12.420963 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-babe4e01-bc0d-40b9-9e16-ea3f121d6944 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] [instance: 4ee1b613-5643-49e1-9d9c-ea100c5c55ff] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:12.428042 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-babe4e01-bc0d-40b9-9e16-ea3f121d6944 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:12.428776 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-babe4e01-bc0d-40b9-9e16-ea3f121d6944 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:12.429388 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-babe4e01-bc0d-40b9-9e16-ea3f121d6944 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:12.430335 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-babe4e01-bc0d-40b9-9e16-ea3f121d6944 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:12.430957 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-babe4e01-bc0d-40b9-9e16-ea3f121d6944 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:12.431742 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-babe4e01-bc0d-40b9-9e16-ea3f121d6944 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:12.473837 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-babe4e01-bc0d-40b9-9e16-ea3f121d6944 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] [instance: 4ee1b613-5643-49e1-9d9c-ea100c5c55ff] Going to try to terminate instance {{(pid=122699) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:56:12.747265 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-9ac63a7d-0dc7-46f7-bc1f-8907c1208a0d tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bde73a530f4666aebdd5f7d9fa1046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71874a329e54494bb1b84f31c3826205', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:56:12.756315 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9ac63a7d-0dc7-46f7-bc1f-8907c1208a0d tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] 10.222.0.33 "GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e" status: 200 len: 1723 microversion: 2.1 time: 0.600152 Sep 23 04:56:12.756906 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2632/5409] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:56:12 2022] GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e => generated 1723 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:56:12.993242 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-babe4e01-bc0d-40b9-9e16-ea3f121d6944 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4ee1b613-5643-49e1-9d9c-ea100c5c55ff" status: 204 len: 0 microversion: 2.1 time: 0.577491 Sep 23 04:56:12.996393 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2778/5410] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:56:12 2022] DELETE /compute/v2.1/servers/4ee1b613-5643-49e1-9d9c-ea100c5c55ff => generated 0 bytes in 580 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:56:13.004329 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2e108693-4529-4dae-8b62-e1cbc7dc86b7 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:13.005088 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-2e108693-4529-4dae-8b62-e1cbc7dc86b7 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] [instance: 4ee1b613-5643-49e1-9d9c-ea100c5c55ff] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:13.012732 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2e108693-4529-4dae-8b62-e1cbc7dc86b7 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:13.014075 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2e108693-4529-4dae-8b62-e1cbc7dc86b7 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:13.014075 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2e108693-4529-4dae-8b62-e1cbc7dc86b7 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:13.014732 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2e108693-4529-4dae-8b62-e1cbc7dc86b7 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:13.015190 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2e108693-4529-4dae-8b62-e1cbc7dc86b7 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:13.015618 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2e108693-4529-4dae-8b62-e1cbc7dc86b7 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:13.202778 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-93508d93-627c-4ce7-a85c-c88b786a60b0 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-603817479", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "networks": [{"uuid": "548b0788-6e90-4d7a-aa5e-8abe2db40115"}], "key_name": "tempest-TestNetworkAdvancedServerOps-152890243", "security_groups": [{"name": "tempest-secgroup-smoke-2040545618"}]}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:56:13.472510 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-2e108693-4529-4dae-8b62-e1cbc7dc86b7 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafb546d73a14667be9780a820432bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3232207c310427eae4287ffb6ef6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:56:13.494375 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2e108693-4529-4dae-8b62-e1cbc7dc86b7 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] 10.222.0.33 "GET /compute/v2.1/servers/4ee1b613-5643-49e1-9d9c-ea100c5c55ff" status: 200 len: 1534 microversion: 2.1 time: 0.495051 Sep 23 04:56:13.508788 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2633/5411] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:56:12 2022] GET /compute/v2.1/servers/4ee1b613-5643-49e1-9d9c-ea100c5c55ff => generated 1534 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:56:13.590921 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.neutron [None req-93508d93-627c-4ce7-a85c-c88b786a60b0 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] validate_networks() for [('548b0788-6e90-4d7a-aa5e-8abe2db40115', None, None, None, None, None)] {{(pid=122699) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:56:13.781676 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-097c3776-b847-44cf-9648-68691ed4244e tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:13.782456 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-097c3776-b847-44cf-9648-68691ed4244e tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] [instance: 6dfb2418-b235-4d35-b109-4bed20d1b96e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:13.792889 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-097c3776-b847-44cf-9648-68691ed4244e tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:13.796520 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-097c3776-b847-44cf-9648-68691ed4244e tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:13.803196 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-097c3776-b847-44cf-9648-68691ed4244e tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:13.803196 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-097c3776-b847-44cf-9648-68691ed4244e tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:13.803196 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-097c3776-b847-44cf-9648-68691ed4244e tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:13.803196 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-097c3776-b847-44cf-9648-68691ed4244e tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:14.166391 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-097c3776-b847-44cf-9648-68691ed4244e tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bde73a530f4666aebdd5f7d9fa1046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71874a329e54494bb1b84f31c3826205', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:56:14.191626 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-097c3776-b847-44cf-9648-68691ed4244e tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] 10.222.0.33 "GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e" status: 200 len: 1723 microversion: 2.1 time: 0.412117 Sep 23 04:56:14.193032 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2634/5412] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:56:13 2022] GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e => generated 1723 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:56:14.409123 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-93508d93-627c-4ce7-a85c-c88b786a60b0 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Flavor limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:56:14.409123 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-93508d93-627c-4ce7-a85c-c88b786a60b0 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Image limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:56:14.409123 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-93508d93-627c-4ce7-a85c-c88b786a60b0 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Flavor pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:56:14.409123 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-93508d93-627c-4ce7-a85c-c88b786a60b0 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Image pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:56:14.411429 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-93508d93-627c-4ce7-a85c-c88b786a60b0 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:56:14.420893 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-93508d93-627c-4ce7-a85c-c88b786a60b0 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:14.421392 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-93508d93-627c-4ce7-a85c-c88b786a60b0 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:14.421837 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-93508d93-627c-4ce7-a85c-c88b786a60b0 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:14.422630 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-93508d93-627c-4ce7-a85c-c88b786a60b0 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:14.423098 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-93508d93-627c-4ce7-a85c-c88b786a60b0 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:14.423531 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-93508d93-627c-4ce7-a85c-c88b786a60b0 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:14.447489 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-93508d93-627c-4ce7-a85c-c88b786a60b0 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Getting quotas for project 0edd6bd5b418494fbcb05c743967d36a. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:56:14.453760 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-93508d93-627c-4ce7-a85c-c88b786a60b0 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Getting quotas for user 8d3d0a162e7e4beb81a54120cab246ff and project 0edd6bd5b418494fbcb05c743967d36a. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:56:14.468606 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-93508d93-627c-4ce7-a85c-c88b786a60b0 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Going to run 1 instances... {{(pid=122699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:56:14.471638 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-93508d93-627c-4ce7-a85c-c88b786a60b0 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 9bd2c0e2-8256-484a-bbd5-f21743724671] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:56:14.523576 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-76c2e6f0-eafe-4b8b-907b-ac479f0b967c tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:14.525695 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-76c2e6f0-eafe-4b8b-907b-ac479f0b967c tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] [instance: 4ee1b613-5643-49e1-9d9c-ea100c5c55ff] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:14.536299 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-76c2e6f0-eafe-4b8b-907b-ac479f0b967c tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:14.537095 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-76c2e6f0-eafe-4b8b-907b-ac479f0b967c tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:14.537739 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-76c2e6f0-eafe-4b8b-907b-ac479f0b967c tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:14.538669 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-76c2e6f0-eafe-4b8b-907b-ac479f0b967c tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:14.539332 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-76c2e6f0-eafe-4b8b-907b-ac479f0b967c tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:14.539943 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-76c2e6f0-eafe-4b8b-907b-ac479f0b967c tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:14.645144 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-93508d93-627c-4ce7-a85c-c88b786a60b0 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.449984 Sep 23 04:56:14.646515 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2779/5413] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:56:13 2022] POST /compute/v2.1/servers => generated 406 bytes in 1452 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 23 04:56:14.667788 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-42f28918-2c73-4cae-9380-9009bc2fbbb7 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:14.668526 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-42f28918-2c73-4cae-9380-9009bc2fbbb7 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 9bd2c0e2-8256-484a-bbd5-f21743724671] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:14.814273 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-42f28918-2c73-4cae-9380-9009bc2fbbb7 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:56:14.818855 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-42f28918-2c73-4cae-9380-9009bc2fbbb7 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671" status: 200 len: 1265 microversion: 2.1 time: 0.160909 Sep 23 04:56:14.825552 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2780/5414] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:56:14 2022] GET /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:56:15.184158 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-76c2e6f0-eafe-4b8b-907b-ac479f0b967c tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafb546d73a14667be9780a820432bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3232207c310427eae4287ffb6ef6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:56:15.204077 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-76c2e6f0-eafe-4b8b-907b-ac479f0b967c tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] 10.222.0.33 "GET /compute/v2.1/servers/4ee1b613-5643-49e1-9d9c-ea100c5c55ff" status: 200 len: 1534 microversion: 2.1 time: 0.684616 Sep 23 04:56:15.208506 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2635/5415] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:56:14 2022] GET /compute/v2.1/servers/4ee1b613-5643-49e1-9d9c-ea100c5c55ff => generated 1534 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:56:15.216663 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-834a652e-718a-4d62-a7f2-130152e7a05c tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:15.217712 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-834a652e-718a-4d62-a7f2-130152e7a05c tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] [instance: 6dfb2418-b235-4d35-b109-4bed20d1b96e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:15.230560 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-834a652e-718a-4d62-a7f2-130152e7a05c tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:15.231131 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-834a652e-718a-4d62-a7f2-130152e7a05c tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:15.231622 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-834a652e-718a-4d62-a7f2-130152e7a05c tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:15.232385 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-834a652e-718a-4d62-a7f2-130152e7a05c tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:15.232857 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-834a652e-718a-4d62-a7f2-130152e7a05c tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:15.233293 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-834a652e-718a-4d62-a7f2-130152e7a05c tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:15.665003 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-834a652e-718a-4d62-a7f2-130152e7a05c tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bde73a530f4666aebdd5f7d9fa1046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71874a329e54494bb1b84f31c3826205', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:56:15.686207 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-834a652e-718a-4d62-a7f2-130152e7a05c tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] 10.222.0.33 "GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e" status: 200 len: 1723 microversion: 2.1 time: 0.468212 Sep 23 04:56:15.688743 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2781/5416] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:56:15 2022] GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e => generated 1723 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:56:15.856129 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d80b1906-b383-49b9-9a8c-07cfb4524681 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:15.856129 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d80b1906-b383-49b9-9a8c-07cfb4524681 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 9bd2c0e2-8256-484a-bbd5-f21743724671] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:15.871279 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-2c28abc3-4487-457f-abe4-c25647feba94 req-69662b47-f152-4091-b826-b2aa31cb52a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ee1b613-5643-49e1-9d9c-ea100c5c55ff", "name": "network-vif-deleted", "tag": "d5dae26e-b35e-4d28-9c57-40a5253ec981"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:56:15.896191 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-2c28abc3-4487-457f-abe4-c25647feba94 req-69662b47-f152-4091-b826-b2aa31cb52a4 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:15.906461 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-2c28abc3-4487-457f-abe4-c25647feba94 req-69662b47-f152-4091-b826-b2aa31cb52a4 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:15.907027 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-2c28abc3-4487-457f-abe4-c25647feba94 req-69662b47-f152-4091-b826-b2aa31cb52a4 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:15.931441 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-2c28abc3-4487-457f-abe4-c25647feba94 req-69662b47-f152-4091-b826-b2aa31cb52a4 service nova] Creating event network-vif-deleted:d5dae26e-b35e-4d28-9c57-40a5253ec981 for instance 4ee1b613-5643-49e1-9d9c-ea100c5c55ff on n-h1-846463-3 Sep 23 04:56:15.949261 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-2c28abc3-4487-457f-abe4-c25647feba94 req-69662b47-f152-4091-b826-b2aa31cb52a4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082032 Sep 23 04:56:15.953818 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2782/5417] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:56:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:56:16.088229 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d80b1906-b383-49b9-9a8c-07cfb4524681 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:56:16.102117 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d80b1906-b383-49b9-9a8c-07cfb4524681 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671" status: 200 len: 1265 microversion: 2.1 time: 0.252368 Sep 23 04:56:16.119986 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2636/5418] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:56:15 2022] GET /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671 => generated 1265 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:56:16.232753 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-486072c7-2aea-4b50-baac-5080427bbd04 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:16.233523 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-486072c7-2aea-4b50-baac-5080427bbd04 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] [instance: 4ee1b613-5643-49e1-9d9c-ea100c5c55ff] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:16.250211 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-486072c7-2aea-4b50-baac-5080427bbd04 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:16.250856 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-486072c7-2aea-4b50-baac-5080427bbd04 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:16.251760 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-486072c7-2aea-4b50-baac-5080427bbd04 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:16.253347 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-486072c7-2aea-4b50-baac-5080427bbd04 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:16.254194 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-486072c7-2aea-4b50-baac-5080427bbd04 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:16.254787 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-486072c7-2aea-4b50-baac-5080427bbd04 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:16.334595 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-486072c7-2aea-4b50-baac-5080427bbd04 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:16.339155 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-486072c7-2aea-4b50-baac-5080427bbd04 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:16.340831 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-486072c7-2aea-4b50-baac-5080427bbd04 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:16.341728 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-486072c7-2aea-4b50-baac-5080427bbd04 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Lazy-loading 'fault' on Instance uuid 4ee1b613-5643-49e1-9d9c-ea100c5c55ff {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:56:16.387140 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5f0813c5-76c4-472d-9507-df1d94be286e tempest-ComputeTenantNetworksTest-125882874 tempest-ComputeTenantNetworksTest-125882874-project] Calling method '.version_select at 0x7ff1ba7d5d30>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:16.555064 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-486072c7-2aea-4b50-baac-5080427bbd04 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafb546d73a14667be9780a820432bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3232207c310427eae4287ffb6ef6bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:56:16.567683 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-486072c7-2aea-4b50-baac-5080427bbd04 tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] 10.222.0.33 "GET /compute/v2.1/servers/4ee1b613-5643-49e1-9d9c-ea100c5c55ff" status: 200 len: 1317 microversion: 2.1 time: 0.339751 Sep 23 04:56:16.586757 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2637/5419] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:56:16 2022] GET /compute/v2.1/servers/4ee1b613-5643-49e1-9d9c-ea100c5c55ff => generated 1317 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:56:16.713478 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6a735851-27ea-465d-8f79-009d521504dd tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:16.714208 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-6a735851-27ea-465d-8f79-009d521504dd tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] [instance: 6dfb2418-b235-4d35-b109-4bed20d1b96e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:16.727298 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6a735851-27ea-465d-8f79-009d521504dd tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:16.728121 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6a735851-27ea-465d-8f79-009d521504dd tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:16.728741 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6a735851-27ea-465d-8f79-009d521504dd tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:16.729848 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6a735851-27ea-465d-8f79-009d521504dd tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:16.730688 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6a735851-27ea-465d-8f79-009d521504dd tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:16.732831 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6a735851-27ea-465d-8f79-009d521504dd tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:16.862055 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5f0813c5-76c4-472d-9507-df1d94be286e tempest-ComputeTenantNetworksTest-125882874 tempest-ComputeTenantNetworksTest-125882874-project] 10.222.0.33 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 307 microversion: 2.1 time: 0.832850 Sep 23 04:56:16.863486 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2783/5420] 10.222.0.33 () {58 vars in 1158 bytes} [Fri Sep 23 04:56:16 2022] GET /compute/v2.1/os-tenant-networks => generated 307 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:56:16.870861 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-30be6af7-457b-40ca-9d01-c76d1c41424d tempest-ComputeTenantNetworksTest-125882874 tempest-ComputeTenantNetworksTest-125882874-project] Calling method '.version_select at 0x7ff1ba80dee0>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:17.056033 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-30be6af7-457b-40ca-9d01-c76d1c41424d tempest-ComputeTenantNetworksTest-125882874 tempest-ComputeTenantNetworksTest-125882874-project] 10.222.0.33 "GET /compute/v2.1/os-tenant-networks/93f5f257-af6c-4af7-bf92-9754a037b0c1" status: 200 len: 138 microversion: 2.1 time: 0.191129 Sep 23 04:56:17.056839 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2784/5421] 10.222.0.33 () {58 vars in 1269 bytes} [Fri Sep 23 04:56:16 2022] GET /compute/v2.1/os-tenant-networks/93f5f257-af6c-4af7-bf92-9754a037b0c1 => generated 138 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:56:17.064136 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6a735851-27ea-465d-8f79-009d521504dd tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bde73a530f4666aebdd5f7d9fa1046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71874a329e54494bb1b84f31c3826205', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:56:17.068992 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:56:17.090560 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-6a735851-27ea-465d-8f79-009d521504dd tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] 10.222.0.33 "GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e" status: 200 len: 1723 microversion: 2.1 time: 0.371116 Sep 23 04:56:17.091267 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2638/5422] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:56:16 2022] GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e => generated 1723 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:56:17.134953 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a31814b9-4122-478b-aa28-81511d99d092 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:17.134953 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a31814b9-4122-478b-aa28-81511d99d092 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 9bd2c0e2-8256-484a-bbd5-f21743724671] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:17.153776 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a31814b9-4122-478b-aa28-81511d99d092 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:17.156054 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a31814b9-4122-478b-aa28-81511d99d092 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:17.156920 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a31814b9-4122-478b-aa28-81511d99d092 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:17.158886 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a31814b9-4122-478b-aa28-81511d99d092 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:17.162033 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a31814b9-4122-478b-aa28-81511d99d092 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:17.162750 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a31814b9-4122-478b-aa28-81511d99d092 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:17.359222 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a31814b9-4122-478b-aa28-81511d99d092 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:56:17.370093 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a31814b9-4122-478b-aa28-81511d99d092 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671" status: 200 len: 1317 microversion: 2.1 time: 0.242734 Sep 23 04:56:17.396113 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2785/5423] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:56:17 2022] GET /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671 => generated 1317 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:56:17.594234 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f2d3003c-cf61-42bf-915b-450cbb3148eb tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:17.595184 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f2d3003c-cf61-42bf-915b-450cbb3148eb tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] [instance: 4ee1b613-5643-49e1-9d9c-ea100c5c55ff] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:17.604213 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f2d3003c-cf61-42bf-915b-450cbb3148eb tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:17.607530 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f2d3003c-cf61-42bf-915b-450cbb3148eb tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:17.608181 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f2d3003c-cf61-42bf-915b-450cbb3148eb tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:17.610079 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f2d3003c-cf61-42bf-915b-450cbb3148eb tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:17.610897 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f2d3003c-cf61-42bf-915b-450cbb3148eb tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:17.612426 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f2d3003c-cf61-42bf-915b-450cbb3148eb tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:17.645210 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-f2d3003c-cf61-42bf-915b-450cbb3148eb tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] HTTP exception thrown: Instance 4ee1b613-5643-49e1-9d9c-ea100c5c55ff could not be found. Sep 23 04:56:17.647688 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f2d3003c-cf61-42bf-915b-450cbb3148eb tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Request method failure captured: Sep 23 04:56:17.647688 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/4ee1b613-5643-49e1-9d9c-ea100c5c55ff HTTP/1.1 Sep 23 04:56:17.647688 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:56:17.647688 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:56:17.647688 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:56:17.647688 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:56:17.647688 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:56:17.647688 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:56:17.647688 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:56:17.647688 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:56:17.647688 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTw_cPMU-x7qUsx5TjnDsBo6p3paHJ3xZ9i9Clmlx5wNSLkVb_04oB8ZI-VSKE2_2Ly3_wOfWMVjTyXXSMyv5b3gkKje5gGvTPyCRsxSQf43LaXOwkO4xobNyGINTvxzv1_pKaD8gfLQYGH8nYTdYzpNt6d9h_ShgrQhLe-2jnxEq-o Sep 23 04:56:17.647688 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:56:17.647688 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:56:17.647688 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:56:17.647688 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:56:17.647688 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:56:17.647688 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:56:17.647688 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: f3232207c310427eae4287ffb6ef6bd2 Sep 23 04:56:17.647688 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1746401774 Sep 23 04:56:17.647688 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:56:17.647688 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:56:17.647688 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f3232207c310427eae4287ffb6ef6bd2", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f3232207c310427eae4287ffb6ef6bd2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f3232207c310427eae4287ffb6ef6bd2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f3232207c310427eae4287ffb6ef6bd2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:56:17.647688 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1746401774 Sep 23 04:56:17.647688 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: f3232207c310427eae4287ffb6ef6bd2 Sep 23 04:56:17.647688 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1746401774 Sep 23 04:56:17.647688 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1746401774-project Sep 23 04:56:17.647688 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:56:17.647688 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:56:17.647688 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: dafb546d73a14667be9780a820432bf7 Sep 23 04:56:17.647688 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1746401774-project Sep 23 04:56:17.647688 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:56:17.647688 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 4ee1b613-5643-49e1-9d9c-ea100c5c55ff could not be found. Sep 23 04:56:17.647688 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '4ee1b613-5643-49e1-9d9c-ea100c5c55ff'} Sep 23 04:56:17.647688 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:56:17.647688 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:56:17.647688 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:56:17.647688 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:56:17.647688 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:56:17.647688 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:56:17.647688 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:56:17.647688 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:56:17.647688 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:56:17.647688 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:56:17.647688 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ee1b613-5643-49e1-9d9c-ea100c5c55ff could not be found. Sep 23 04:56:17.647688 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:56:17.647688 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:56:17.647688 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:56:17.647688 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:56:17.647688 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:56:17.647688 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:56:17.647688 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:56:17.647688 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:56:17.647688 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:56:17.647688 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:56:17.647688 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:56:17.647688 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:56:17.647688 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:56:17.647688 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:56:17.647688 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:56:17.647688 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:56:17.647688 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ee1b613-5643-49e1-9d9c-ea100c5c55ff could not be found. Sep 23 04:56:17.647688 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:56:17.652537 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:56:17.652537 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:56:17.652537 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:56:17.652537 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:56:17.652537 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:56:17.652537 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:56:17.652537 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:56:17.652537 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ee1b613-5643-49e1-9d9c-ea100c5c55ff could not be found. Sep 23 04:56:17.652537 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:56:17.657755 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f2d3003c-cf61-42bf-915b-450cbb3148eb tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] Returning 404 to user: Instance 4ee1b613-5643-49e1-9d9c-ea100c5c55ff could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:56:17.658669 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f2d3003c-cf61-42bf-915b-450cbb3148eb tempest-ServersNegativeTestMultiTenantJSON-1746401774 tempest-ServersNegativeTestMultiTenantJSON-1746401774-project] 10.222.0.33 "GET /compute/v2.1/servers/4ee1b613-5643-49e1-9d9c-ea100c5c55ff" status: 404 len: 111 microversion: 2.1 time: 0.069127 Sep 23 04:56:17.659307 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2639/5424] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:56:17 2022] GET /compute/v2.1/servers/4ee1b613-5643-49e1-9d9c-ea100c5c55ff => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:56:18.117933 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-eb4547bb-a92e-4ffb-b870-1d1b2b60c464 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:18.119315 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-eb4547bb-a92e-4ffb-b870-1d1b2b60c464 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] [instance: 6dfb2418-b235-4d35-b109-4bed20d1b96e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:18.127704 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eb4547bb-a92e-4ffb-b870-1d1b2b60c464 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:18.129112 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eb4547bb-a92e-4ffb-b870-1d1b2b60c464 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:18.130159 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eb4547bb-a92e-4ffb-b870-1d1b2b60c464 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:18.131146 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eb4547bb-a92e-4ffb-b870-1d1b2b60c464 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:18.132393 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eb4547bb-a92e-4ffb-b870-1d1b2b60c464 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:18.133359 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eb4547bb-a92e-4ffb-b870-1d1b2b60c464 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:18.406925 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2d9d9bc6-bfb0-47e0-98c8-aebe884fe057 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:18.407546 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-2d9d9bc6-bfb0-47e0-98c8-aebe884fe057 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 9bd2c0e2-8256-484a-bbd5-f21743724671] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:18.424398 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2d9d9bc6-bfb0-47e0-98c8-aebe884fe057 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:18.424995 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2d9d9bc6-bfb0-47e0-98c8-aebe884fe057 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:18.425418 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2d9d9bc6-bfb0-47e0-98c8-aebe884fe057 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:18.433759 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2d9d9bc6-bfb0-47e0-98c8-aebe884fe057 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:18.433759 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2d9d9bc6-bfb0-47e0-98c8-aebe884fe057 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:18.433759 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2d9d9bc6-bfb0-47e0-98c8-aebe884fe057 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:18.437229 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-eb4547bb-a92e-4ffb-b870-1d1b2b60c464 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bde73a530f4666aebdd5f7d9fa1046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71874a329e54494bb1b84f31c3826205', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:56:18.448907 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-eb4547bb-a92e-4ffb-b870-1d1b2b60c464 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] 10.222.0.33 "GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e" status: 200 len: 1723 microversion: 2.1 time: 0.335532 Sep 23 04:56:18.452010 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2786/5425] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:56:18 2022] GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e => generated 1723 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:56:18.635647 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-2d9d9bc6-bfb0-47e0-98c8-aebe884fe057 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:56:18.648926 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2d9d9bc6-bfb0-47e0-98c8-aebe884fe057 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671" status: 200 len: 1323 microversion: 2.1 time: 0.248232 Sep 23 04:56:18.671029 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2640/5426] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:56:18 2022] GET /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671 => generated 1323 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:56:19.474971 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-32d349c6-4d25-4458-8eca-728cc384fe69 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:19.475611 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-32d349c6-4d25-4458-8eca-728cc384fe69 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] [instance: 6dfb2418-b235-4d35-b109-4bed20d1b96e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:19.499546 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-32d349c6-4d25-4458-8eca-728cc384fe69 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:19.500313 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-32d349c6-4d25-4458-8eca-728cc384fe69 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:19.511012 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-32d349c6-4d25-4458-8eca-728cc384fe69 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:19.513113 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-32d349c6-4d25-4458-8eca-728cc384fe69 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:19.514883 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-32d349c6-4d25-4458-8eca-728cc384fe69 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:19.521677 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-32d349c6-4d25-4458-8eca-728cc384fe69 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:19.682963 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a4a58e66-900d-42f0-bb93-30cdb7880fad tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:19.685205 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a4a58e66-900d-42f0-bb93-30cdb7880fad tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 9bd2c0e2-8256-484a-bbd5-f21743724671] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:19.704693 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a4a58e66-900d-42f0-bb93-30cdb7880fad tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:19.705555 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a4a58e66-900d-42f0-bb93-30cdb7880fad tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:19.706440 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a4a58e66-900d-42f0-bb93-30cdb7880fad tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:19.708241 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a4a58e66-900d-42f0-bb93-30cdb7880fad tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:19.708241 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a4a58e66-900d-42f0-bb93-30cdb7880fad tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:19.709677 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a4a58e66-900d-42f0-bb93-30cdb7880fad tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:20.228182 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-32d349c6-4d25-4458-8eca-728cc384fe69 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bde73a530f4666aebdd5f7d9fa1046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71874a329e54494bb1b84f31c3826205', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:56:20.232647 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a4a58e66-900d-42f0-bb93-30cdb7880fad tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:56:20.239060 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-32d349c6-4d25-4458-8eca-728cc384fe69 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] 10.222.0.33 "GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e" status: 200 len: 1723 microversion: 2.1 time: 0.768794 Sep 23 04:56:20.241599 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a4a58e66-900d-42f0-bb93-30cdb7880fad tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671" status: 200 len: 1391 microversion: 2.1 time: 0.564545 Sep 23 04:56:20.242850 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2787/5427] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:56:19 2022] GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e => generated 1723 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:56:20.243877 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2641/5428] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:56:19 2022] GET /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671 => generated 1391 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:56:21.265734 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-58dbb941-54e5-4fdc-8f04-ecbba301b28e tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:21.267112 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-58dbb941-54e5-4fdc-8f04-ecbba301b28e tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 9bd2c0e2-8256-484a-bbd5-f21743724671] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:21.267332 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8605ff23-2148-4ac9-ac80-1670ae15725c tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:21.269756 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8605ff23-2148-4ac9-ac80-1670ae15725c tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] [instance: 6dfb2418-b235-4d35-b109-4bed20d1b96e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:21.275919 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-58dbb941-54e5-4fdc-8f04-ecbba301b28e tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:21.283103 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8605ff23-2148-4ac9-ac80-1670ae15725c tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:21.288690 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8605ff23-2148-4ac9-ac80-1670ae15725c tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:21.293002 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8605ff23-2148-4ac9-ac80-1670ae15725c tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:21.293002 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8605ff23-2148-4ac9-ac80-1670ae15725c tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:21.293549 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-58dbb941-54e5-4fdc-8f04-ecbba301b28e tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:21.293549 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-58dbb941-54e5-4fdc-8f04-ecbba301b28e tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:21.293774 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-58dbb941-54e5-4fdc-8f04-ecbba301b28e tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:21.293959 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8605ff23-2148-4ac9-ac80-1670ae15725c tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:21.294097 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-58dbb941-54e5-4fdc-8f04-ecbba301b28e tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:21.294504 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-58dbb941-54e5-4fdc-8f04-ecbba301b28e tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:21.295177 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8605ff23-2148-4ac9-ac80-1670ae15725c tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:21.963501 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-58dbb941-54e5-4fdc-8f04-ecbba301b28e tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:56:21.971906 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-58dbb941-54e5-4fdc-8f04-ecbba301b28e tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671" status: 200 len: 1391 microversion: 2.1 time: 0.709856 Sep 23 04:56:21.972835 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2788/5429] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:56:21 2022] GET /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671 => generated 1391 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:56:22.049159 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-05b58db8-0f39-4786-8f9f-2dd4c80337a2 req-4f5714ba-64aa-49e4-a62b-6d85c14e382d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bd2c0e2-8256-484a-bbd5-f21743724671", "tag": "909994da-1d1c-4fc5-955f-cc0ae5196ea8"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:56:22.067671 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-05b58db8-0f39-4786-8f9f-2dd4c80337a2 req-4f5714ba-64aa-49e4-a62b-6d85c14e382d service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:22.070717 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-05b58db8-0f39-4786-8f9f-2dd4c80337a2 req-4f5714ba-64aa-49e4-a62b-6d85c14e382d service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:22.071460 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-05b58db8-0f39-4786-8f9f-2dd4c80337a2 req-4f5714ba-64aa-49e4-a62b-6d85c14e382d service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:22.124756 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8605ff23-2148-4ac9-ac80-1670ae15725c tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bde73a530f4666aebdd5f7d9fa1046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71874a329e54494bb1b84f31c3826205', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:56:22.125276 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-05b58db8-0f39-4786-8f9f-2dd4c80337a2 req-4f5714ba-64aa-49e4-a62b-6d85c14e382d service nova] Creating event network-changed:909994da-1d1c-4fc5-955f-cc0ae5196ea8 for instance 9bd2c0e2-8256-484a-bbd5-f21743724671 on n-h2-846463-3 Sep 23 04:56:22.125276 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-05b58db8-0f39-4786-8f9f-2dd4c80337a2 req-4f5714ba-64aa-49e4-a62b-6d85c14e382d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065599 Sep 23 04:56:22.125276 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2789/5430] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:56:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Sep 23 04:56:22.125577 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8605ff23-2148-4ac9-ac80-1670ae15725c tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] 10.222.0.33 "GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e" status: 200 len: 1723 microversion: 2.1 time: 0.854856 Sep 23 04:56:22.125577 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2642/5431] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:56:21 2022] GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e => generated 1723 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:56:22.999267 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-89737096-a418-4a1c-be9e-43505b3a50de tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:22.999980 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-89737096-a418-4a1c-be9e-43505b3a50de tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 9bd2c0e2-8256-484a-bbd5-f21743724671] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:23.017730 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-89737096-a418-4a1c-be9e-43505b3a50de tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:23.019126 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-89737096-a418-4a1c-be9e-43505b3a50de tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:23.019766 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-89737096-a418-4a1c-be9e-43505b3a50de tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:23.021109 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-89737096-a418-4a1c-be9e-43505b3a50de tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:23.021759 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-89737096-a418-4a1c-be9e-43505b3a50de tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:23.022408 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-89737096-a418-4a1c-be9e-43505b3a50de tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:23.144686 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0987019f-10f4-4eb7-a7ad-a86670e20eee tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:23.146029 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-0987019f-10f4-4eb7-a7ad-a86670e20eee tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] [instance: 6dfb2418-b235-4d35-b109-4bed20d1b96e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:23.161465 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0987019f-10f4-4eb7-a7ad-a86670e20eee tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:23.169607 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0987019f-10f4-4eb7-a7ad-a86670e20eee tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:23.176246 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0987019f-10f4-4eb7-a7ad-a86670e20eee tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:23.176546 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0987019f-10f4-4eb7-a7ad-a86670e20eee tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:23.179201 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0987019f-10f4-4eb7-a7ad-a86670e20eee tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:23.179834 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0987019f-10f4-4eb7-a7ad-a86670e20eee tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:23.332202 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-89737096-a418-4a1c-be9e-43505b3a50de tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:56:23.348909 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-89737096-a418-4a1c-be9e-43505b3a50de tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671" status: 200 len: 1391 microversion: 2.1 time: 0.353585 Sep 23 04:56:23.356977 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2790/5432] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:56:22 2022] GET /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671 => generated 1391 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:56:24.121774 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-0987019f-10f4-4eb7-a7ad-a86670e20eee tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bde73a530f4666aebdd5f7d9fa1046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71874a329e54494bb1b84f31c3826205', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:56:24.144828 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0987019f-10f4-4eb7-a7ad-a86670e20eee tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] 10.222.0.33 "GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e" status: 200 len: 1723 microversion: 2.1 time: 1.004400 Sep 23 04:56:24.147596 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2643/5433] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:56:23 2022] GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e => generated 1723 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:56:24.384277 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ed1d0826-5292-4d8f-b48c-a297c45dd177 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:24.385975 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ed1d0826-5292-4d8f-b48c-a297c45dd177 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 9bd2c0e2-8256-484a-bbd5-f21743724671] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:24.399350 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ed1d0826-5292-4d8f-b48c-a297c45dd177 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:24.400074 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ed1d0826-5292-4d8f-b48c-a297c45dd177 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:24.401230 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ed1d0826-5292-4d8f-b48c-a297c45dd177 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:24.402723 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ed1d0826-5292-4d8f-b48c-a297c45dd177 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:24.403398 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ed1d0826-5292-4d8f-b48c-a297c45dd177 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:24.404122 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ed1d0826-5292-4d8f-b48c-a297c45dd177 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:24.437826 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:56:24.812820 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ed1d0826-5292-4d8f-b48c-a297c45dd177 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:56:24.823794 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=10 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:56:24.847404 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ed1d0826-5292-4d8f-b48c-a297c45dd177 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671" status: 200 len: 1391 microversion: 2.1 time: 0.468706 Sep 23 04:56:24.847404 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2791/5434] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:56:24 2022] GET /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671 => generated 1391 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:56:25.172873 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a5282864-7efa-4b68-9fcc-05ce1659db5a tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:25.174995 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a5282864-7efa-4b68-9fcc-05ce1659db5a tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] [instance: 6dfb2418-b235-4d35-b109-4bed20d1b96e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:25.211268 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a5282864-7efa-4b68-9fcc-05ce1659db5a tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:25.212486 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a5282864-7efa-4b68-9fcc-05ce1659db5a tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:25.213288 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a5282864-7efa-4b68-9fcc-05ce1659db5a tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:25.215157 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a5282864-7efa-4b68-9fcc-05ce1659db5a tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:25.216227 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a5282864-7efa-4b68-9fcc-05ce1659db5a tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:25.217421 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a5282864-7efa-4b68-9fcc-05ce1659db5a tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:25.544484 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a5282864-7efa-4b68-9fcc-05ce1659db5a tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bde73a530f4666aebdd5f7d9fa1046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71874a329e54494bb1b84f31c3826205', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:56:25.557400 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a5282864-7efa-4b68-9fcc-05ce1659db5a tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] 10.222.0.33 "GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e" status: 200 len: 1723 microversion: 2.1 time: 0.389605 Sep 23 04:56:25.567499 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2644/5435] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:56:25 2022] GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e => generated 1723 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:56:25.878380 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-16b36a9b-a469-4f38-bc02-22104d06332e tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:25.878857 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-16b36a9b-a469-4f38-bc02-22104d06332e tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 9bd2c0e2-8256-484a-bbd5-f21743724671] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:25.890390 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-16b36a9b-a469-4f38-bc02-22104d06332e tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:25.890919 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-16b36a9b-a469-4f38-bc02-22104d06332e tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:25.895643 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-16b36a9b-a469-4f38-bc02-22104d06332e tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:25.896450 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-16b36a9b-a469-4f38-bc02-22104d06332e tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:25.897337 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-16b36a9b-a469-4f38-bc02-22104d06332e tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:25.897981 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-16b36a9b-a469-4f38-bc02-22104d06332e tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:25.906293 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:56:26.206101 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-16b36a9b-a469-4f38-bc02-22104d06332e tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:56:26.214162 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-16b36a9b-a469-4f38-bc02-22104d06332e tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671" status: 200 len: 1391 microversion: 2.1 time: 0.342520 Sep 23 04:56:26.214772 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2792/5436] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:56:25 2022] GET /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671 => generated 1391 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:56:26.584953 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5f7a9031-149b-4ef0-960a-0cda21a378e6 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:26.586204 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5f7a9031-149b-4ef0-960a-0cda21a378e6 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] [instance: 6dfb2418-b235-4d35-b109-4bed20d1b96e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:26.593059 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=8 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:56:26.602049 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5f7a9031-149b-4ef0-960a-0cda21a378e6 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:26.603238 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5f7a9031-149b-4ef0-960a-0cda21a378e6 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:26.603849 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5f7a9031-149b-4ef0-960a-0cda21a378e6 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:26.604744 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5f7a9031-149b-4ef0-960a-0cda21a378e6 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:26.605594 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5f7a9031-149b-4ef0-960a-0cda21a378e6 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:26.605940 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5f7a9031-149b-4ef0-960a-0cda21a378e6 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:27.009401 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-5f7a9031-149b-4ef0-960a-0cda21a378e6 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bde73a530f4666aebdd5f7d9fa1046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71874a329e54494bb1b84f31c3826205', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:56:27.022726 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5f7a9031-149b-4ef0-960a-0cda21a378e6 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] 10.222.0.33 "GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e" status: 200 len: 1723 microversion: 2.1 time: 0.441866 Sep 23 04:56:27.025802 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2645/5437] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:56:26 2022] GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e => generated 1723 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:56:27.245119 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-33d15698-19c6-4e53-b7ba-bcea8d0524ef tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:27.245119 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-33d15698-19c6-4e53-b7ba-bcea8d0524ef tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 9bd2c0e2-8256-484a-bbd5-f21743724671] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:27.252747 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-33d15698-19c6-4e53-b7ba-bcea8d0524ef tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:27.266201 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-33d15698-19c6-4e53-b7ba-bcea8d0524ef tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:27.266820 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-33d15698-19c6-4e53-b7ba-bcea8d0524ef tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:27.267598 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-33d15698-19c6-4e53-b7ba-bcea8d0524ef tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:27.268764 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-33d15698-19c6-4e53-b7ba-bcea8d0524ef tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:27.269145 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-33d15698-19c6-4e53-b7ba-bcea8d0524ef tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:27.779554 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-33d15698-19c6-4e53-b7ba-bcea8d0524ef tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:56:27.787591 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-33d15698-19c6-4e53-b7ba-bcea8d0524ef tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671" status: 200 len: 1391 microversion: 2.1 time: 0.549633 Sep 23 04:56:27.788508 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2793/5438] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:56:27 2022] GET /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671 => generated 1391 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:56:28.053878 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-bfacaa32-59ea-47e4-919e-4a0b4ce7ef4b tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:28.057525 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-bfacaa32-59ea-47e4-919e-4a0b4ce7ef4b tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] [instance: 6dfb2418-b235-4d35-b109-4bed20d1b96e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:28.062584 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bfacaa32-59ea-47e4-919e-4a0b4ce7ef4b tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:28.063824 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bfacaa32-59ea-47e4-919e-4a0b4ce7ef4b tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:28.064729 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bfacaa32-59ea-47e4-919e-4a0b4ce7ef4b tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:28.066267 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bfacaa32-59ea-47e4-919e-4a0b4ce7ef4b tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:28.066947 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bfacaa32-59ea-47e4-919e-4a0b4ce7ef4b tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:28.067603 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bfacaa32-59ea-47e4-919e-4a0b4ce7ef4b tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:28.649491 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-bfacaa32-59ea-47e4-919e-4a0b4ce7ef4b tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bde73a530f4666aebdd5f7d9fa1046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71874a329e54494bb1b84f31c3826205', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:56:28.675250 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-bfacaa32-59ea-47e4-919e-4a0b4ce7ef4b tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] 10.222.0.33 "GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e" status: 200 len: 1723 microversion: 2.1 time: 0.626271 Sep 23 04:56:28.683826 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2646/5439] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:56:28 2022] GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e => generated 1723 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:56:28.815798 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-15f17d67-b569-46cf-af75-47ba7df068d0 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:28.817159 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-15f17d67-b569-46cf-af75-47ba7df068d0 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 9bd2c0e2-8256-484a-bbd5-f21743724671] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:28.835812 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-15f17d67-b569-46cf-af75-47ba7df068d0 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:28.836580 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-15f17d67-b569-46cf-af75-47ba7df068d0 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:28.837196 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-15f17d67-b569-46cf-af75-47ba7df068d0 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:28.840152 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-15f17d67-b569-46cf-af75-47ba7df068d0 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:28.840152 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-15f17d67-b569-46cf-af75-47ba7df068d0 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:28.840152 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-15f17d67-b569-46cf-af75-47ba7df068d0 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:29.414918 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-8feca272-77f0-4c72-9f49-e0fe0c832dab req-bdefd61f-7b3d-4993-a6c5-7255ae872ac0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bd2c0e2-8256-484a-bbd5-f21743724671", "name": "network-vif-plugged", "status": "completed", "tag": "909994da-1d1c-4fc5-955f-cc0ae5196ea8"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:56:29.452163 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-8feca272-77f0-4c72-9f49-e0fe0c832dab req-bdefd61f-7b3d-4993-a6c5-7255ae872ac0 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:29.452845 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-8feca272-77f0-4c72-9f49-e0fe0c832dab req-bdefd61f-7b3d-4993-a6c5-7255ae872ac0 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:29.453292 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-8feca272-77f0-4c72-9f49-e0fe0c832dab req-bdefd61f-7b3d-4993-a6c5-7255ae872ac0 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:29.467967 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-8feca272-77f0-4c72-9f49-e0fe0c832dab req-bdefd61f-7b3d-4993-a6c5-7255ae872ac0 service nova] Creating event network-vif-plugged:909994da-1d1c-4fc5-955f-cc0ae5196ea8 for instance 9bd2c0e2-8256-484a-bbd5-f21743724671 on n-h2-846463-3 Sep 23 04:56:29.476481 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-8feca272-77f0-4c72-9f49-e0fe0c832dab req-bdefd61f-7b3d-4993-a6c5-7255ae872ac0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066603 Sep 23 04:56:29.503627 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2647/5440] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:56:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:56:29.602296 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-15f17d67-b569-46cf-af75-47ba7df068d0 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:56:29.611489 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-15f17d67-b569-46cf-af75-47ba7df068d0 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671" status: 200 len: 1391 microversion: 2.1 time: 0.801506 Sep 23 04:56:29.615207 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2794/5441] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:56:28 2022] GET /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671 => generated 1391 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:56:29.721642 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-65ed6083-90ad-4911-bcf4-027ddeba12ae tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:29.722644 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-65ed6083-90ad-4911-bcf4-027ddeba12ae tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] [instance: 6dfb2418-b235-4d35-b109-4bed20d1b96e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:29.742606 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-65ed6083-90ad-4911-bcf4-027ddeba12ae tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:29.743270 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-65ed6083-90ad-4911-bcf4-027ddeba12ae tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:29.751091 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-65ed6083-90ad-4911-bcf4-027ddeba12ae tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:29.751091 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-65ed6083-90ad-4911-bcf4-027ddeba12ae tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:29.751091 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-65ed6083-90ad-4911-bcf4-027ddeba12ae tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:29.751091 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-65ed6083-90ad-4911-bcf4-027ddeba12ae tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:30.289719 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-65ed6083-90ad-4911-bcf4-027ddeba12ae tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bde73a530f4666aebdd5f7d9fa1046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71874a329e54494bb1b84f31c3826205', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:56:30.305872 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-65ed6083-90ad-4911-bcf4-027ddeba12ae tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] 10.222.0.33 "GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e" status: 200 len: 1723 microversion: 2.1 time: 0.602180 Sep 23 04:56:30.309963 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2648/5442] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:56:29 2022] GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e => generated 1723 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:56:30.646825 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0840f228-83f3-4ad9-80b2-385472fa1b19 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:30.650832 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-0840f228-83f3-4ad9-80b2-385472fa1b19 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 9bd2c0e2-8256-484a-bbd5-f21743724671] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:30.664815 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0840f228-83f3-4ad9-80b2-385472fa1b19 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:30.666304 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0840f228-83f3-4ad9-80b2-385472fa1b19 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:30.667460 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0840f228-83f3-4ad9-80b2-385472fa1b19 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:30.669025 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0840f228-83f3-4ad9-80b2-385472fa1b19 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:30.669693 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0840f228-83f3-4ad9-80b2-385472fa1b19 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:30.670721 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0840f228-83f3-4ad9-80b2-385472fa1b19 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:31.022031 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-0840f228-83f3-4ad9-80b2-385472fa1b19 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:56:31.033335 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0840f228-83f3-4ad9-80b2-385472fa1b19 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671" status: 200 len: 1391 microversion: 2.1 time: 0.396285 Sep 23 04:56:31.039168 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2795/5443] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:56:30 2022] GET /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671 => generated 1391 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:56:31.338661 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f68c0dc9-5a2d-41d7-877a-b5389644cc6d tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:31.340116 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f68c0dc9-5a2d-41d7-877a-b5389644cc6d tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] [instance: 6dfb2418-b235-4d35-b109-4bed20d1b96e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:31.354727 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f68c0dc9-5a2d-41d7-877a-b5389644cc6d tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:31.359488 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f68c0dc9-5a2d-41d7-877a-b5389644cc6d tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:31.360378 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f68c0dc9-5a2d-41d7-877a-b5389644cc6d tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:31.361337 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f68c0dc9-5a2d-41d7-877a-b5389644cc6d tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:31.366015 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f68c0dc9-5a2d-41d7-877a-b5389644cc6d tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:31.366687 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f68c0dc9-5a2d-41d7-877a-b5389644cc6d tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:32.078140 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b130277e-ae7d-4d30-a6fd-313bcfb5d22b tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:32.080168 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b130277e-ae7d-4d30-a6fd-313bcfb5d22b tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 9bd2c0e2-8256-484a-bbd5-f21743724671] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:32.089596 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b130277e-ae7d-4d30-a6fd-313bcfb5d22b tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:32.090415 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b130277e-ae7d-4d30-a6fd-313bcfb5d22b tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:32.091200 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b130277e-ae7d-4d30-a6fd-313bcfb5d22b tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:32.092324 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b130277e-ae7d-4d30-a6fd-313bcfb5d22b tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:32.093026 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b130277e-ae7d-4d30-a6fd-313bcfb5d22b tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:32.093766 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b130277e-ae7d-4d30-a6fd-313bcfb5d22b tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:32.377917 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f68c0dc9-5a2d-41d7-877a-b5389644cc6d tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bde73a530f4666aebdd5f7d9fa1046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71874a329e54494bb1b84f31c3826205', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:56:32.391232 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f68c0dc9-5a2d-41d7-877a-b5389644cc6d tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] 10.222.0.33 "GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e" status: 200 len: 1723 microversion: 2.1 time: 1.058237 Sep 23 04:56:32.402306 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2649/5444] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:56:31 2022] GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e => generated 1723 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:56:32.589687 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b130277e-ae7d-4d30-a6fd-313bcfb5d22b tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:56:32.606492 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b130277e-ae7d-4d30-a6fd-313bcfb5d22b tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671" status: 200 len: 1562 microversion: 2.1 time: 0.542481 Sep 23 04:56:32.610710 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2796/5445] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:56:32 2022] GET /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671 => generated 1562 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:56:32.641557 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-aeff98c3-c43b-450a-8c4c-701a23e0994a tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:32.646699 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-aeff98c3-c43b-450a-8c4c-701a23e0994a tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 9bd2c0e2-8256-484a-bbd5-f21743724671] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:32.665107 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-aeff98c3-c43b-450a-8c4c-701a23e0994a tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:32.665831 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-aeff98c3-c43b-450a-8c4c-701a23e0994a tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:32.666511 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-aeff98c3-c43b-450a-8c4c-701a23e0994a tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:32.668892 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-aeff98c3-c43b-450a-8c4c-701a23e0994a tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:32.669598 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-aeff98c3-c43b-450a-8c4c-701a23e0994a tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:32.670282 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-aeff98c3-c43b-450a-8c4c-701a23e0994a tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:32.964765 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-aeff98c3-c43b-450a-8c4c-701a23e0994a tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:56:32.981097 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-aeff98c3-c43b-450a-8c4c-701a23e0994a tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671" status: 200 len: 1562 microversion: 2.1 time: 0.343344 Sep 23 04:56:33.005682 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2650/5446] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:56:32 2022] GET /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671 => generated 1562 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:56:33.418466 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1d5fbb67-1bab-487f-87c5-1bd8df17a745 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:33.419419 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-1d5fbb67-1bab-487f-87c5-1bd8df17a745 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] [instance: 6dfb2418-b235-4d35-b109-4bed20d1b96e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:33.434123 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1d5fbb67-1bab-487f-87c5-1bd8df17a745 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:33.440053 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1d5fbb67-1bab-487f-87c5-1bd8df17a745 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:33.440053 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1d5fbb67-1bab-487f-87c5-1bd8df17a745 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:33.440053 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1d5fbb67-1bab-487f-87c5-1bd8df17a745 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:33.440053 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1d5fbb67-1bab-487f-87c5-1bd8df17a745 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:33.440053 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1d5fbb67-1bab-487f-87c5-1bd8df17a745 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:33.480605 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a508091d-af1b-41bb-8ae6-1a2dcf268001 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-1646168547", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "networks": [{"uuid": "ba30dc39-aa25-4bbc-a85f-c1f9f0e17715"}]}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:56:33.581815 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.neutron [None req-a508091d-af1b-41bb-8ae6-1a2dcf268001 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] validate_networks() for [('ba30dc39-aa25-4bbc-a85f-c1f9f0e17715', None, None, None, None, None)] {{(pid=122699) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:56:33.989816 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-1d5fbb67-1bab-487f-87c5-1bd8df17a745 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bde73a530f4666aebdd5f7d9fa1046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71874a329e54494bb1b84f31c3826205', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:56:34.006733 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-1d5fbb67-1bab-487f-87c5-1bd8df17a745 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] 10.222.0.33 "GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e" status: 200 len: 1723 microversion: 2.1 time: 0.592124 Sep 23 04:56:34.025923 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2651/5447] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:56:33 2022] GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e => generated 1723 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:56:35.040742 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5627c8f6-b8b4-4d84-b5ef-22cd32aef507 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:35.041365 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5627c8f6-b8b4-4d84-b5ef-22cd32aef507 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] [instance: 6dfb2418-b235-4d35-b109-4bed20d1b96e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:35.055052 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5627c8f6-b8b4-4d84-b5ef-22cd32aef507 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:35.055571 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5627c8f6-b8b4-4d84-b5ef-22cd32aef507 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:35.056025 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5627c8f6-b8b4-4d84-b5ef-22cd32aef507 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:35.056789 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5627c8f6-b8b4-4d84-b5ef-22cd32aef507 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:35.057251 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5627c8f6-b8b4-4d84-b5ef-22cd32aef507 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:35.067342 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5627c8f6-b8b4-4d84-b5ef-22cd32aef507 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:35.430599 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-a508091d-af1b-41bb-8ae6-1a2dcf268001 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Flavor limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:56:35.431294 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-a508091d-af1b-41bb-8ae6-1a2dcf268001 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Image limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:56:35.431898 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-a508091d-af1b-41bb-8ae6-1a2dcf268001 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Flavor pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:56:35.432427 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-a508091d-af1b-41bb-8ae6-1a2dcf268001 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Image pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:56:35.433279 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-a508091d-af1b-41bb-8ae6-1a2dcf268001 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:56:35.466383 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a508091d-af1b-41bb-8ae6-1a2dcf268001 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:35.466383 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a508091d-af1b-41bb-8ae6-1a2dcf268001 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:35.466965 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a508091d-af1b-41bb-8ae6-1a2dcf268001 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:35.469257 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a508091d-af1b-41bb-8ae6-1a2dcf268001 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:35.471371 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a508091d-af1b-41bb-8ae6-1a2dcf268001 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:35.472241 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a508091d-af1b-41bb-8ae6-1a2dcf268001 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:35.514751 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-a508091d-af1b-41bb-8ae6-1a2dcf268001 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Getting quotas for project 3f1e75cfbb9e4ca79c46921d444ca761. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:56:35.522458 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-a508091d-af1b-41bb-8ae6-1a2dcf268001 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Getting quotas for user c0609d0a0d9243a2b205bf03b9baf254 and project 3f1e75cfbb9e4ca79c46921d444ca761. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:56:35.548586 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a508091d-af1b-41bb-8ae6-1a2dcf268001 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Going to run 1 instances... {{(pid=122699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:56:35.555423 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a508091d-af1b-41bb-8ae6-1a2dcf268001 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] [instance: 9a23c683-ac2a-4bd1-98c4-7675499569bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:56:35.690323 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-5627c8f6-b8b4-4d84-b5ef-22cd32aef507 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bde73a530f4666aebdd5f7d9fa1046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71874a329e54494bb1b84f31c3826205', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:56:35.699236 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5627c8f6-b8b4-4d84-b5ef-22cd32aef507 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] 10.222.0.33 "GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e" status: 200 len: 1723 microversion: 2.1 time: 0.663130 Sep 23 04:56:35.699820 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2652/5448] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:56:35 2022] GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e => generated 1723 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:56:35.833797 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a508091d-af1b-41bb-8ae6-1a2dcf268001 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.857504 Sep 23 04:56:35.875883 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2797/5449] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:56:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 2890 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:56:35.879925 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e8660ca3-4736-423c-a856-dbb9dd21e5cf tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:35.880120 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e8660ca3-4736-423c-a856-dbb9dd21e5cf tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] [instance: 9a23c683-ac2a-4bd1-98c4-7675499569bc] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:36.077936 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e8660ca3-4736-423c-a856-dbb9dd21e5cf tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0609d0a0d9243a2b205bf03b9baf254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1e75cfbb9e4ca79c46921d444ca761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:56:36.092950 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e8660ca3-4736-423c-a856-dbb9dd21e5cf tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] 10.222.0.33 "GET /compute/v2.1/servers/9a23c683-ac2a-4bd1-98c4-7675499569bc" status: 200 len: 1225 microversion: 2.1 time: 0.212493 Sep 23 04:56:36.098451 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2653/5450] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:56:35 2022] GET /compute/v2.1/servers/9a23c683-ac2a-4bd1-98c4-7675499569bc => generated 1225 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:56:36.724058 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4e3a7a48-841f-4e28-b17c-f6b5337e24e1 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:36.724691 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4e3a7a48-841f-4e28-b17c-f6b5337e24e1 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] [instance: 6dfb2418-b235-4d35-b109-4bed20d1b96e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:36.731457 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4e3a7a48-841f-4e28-b17c-f6b5337e24e1 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:36.732369 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4e3a7a48-841f-4e28-b17c-f6b5337e24e1 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:36.732842 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4e3a7a48-841f-4e28-b17c-f6b5337e24e1 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:36.733748 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4e3a7a48-841f-4e28-b17c-f6b5337e24e1 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:36.735318 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4e3a7a48-841f-4e28-b17c-f6b5337e24e1 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:36.735936 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4e3a7a48-841f-4e28-b17c-f6b5337e24e1 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:37.059571 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-4e3a7a48-841f-4e28-b17c-f6b5337e24e1 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bde73a530f4666aebdd5f7d9fa1046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71874a329e54494bb1b84f31c3826205', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:56:37.073238 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4e3a7a48-841f-4e28-b17c-f6b5337e24e1 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] 10.222.0.33 "GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e" status: 200 len: 1723 microversion: 2.1 time: 0.353383 Sep 23 04:56:37.074831 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2798/5451] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:56:36 2022] GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e => generated 1723 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:56:37.138797 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ef1726a9-6256-4007-8e02-8e3854a2657e tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:37.143512 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-ef1726a9-6256-4007-8e02-8e3854a2657e tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] [instance: 9a23c683-ac2a-4bd1-98c4-7675499569bc] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:37.268245 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ef1726a9-6256-4007-8e02-8e3854a2657e tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0609d0a0d9243a2b205bf03b9baf254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1e75cfbb9e4ca79c46921d444ca761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:56:37.284153 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ef1726a9-6256-4007-8e02-8e3854a2657e tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] 10.222.0.33 "GET /compute/v2.1/servers/9a23c683-ac2a-4bd1-98c4-7675499569bc" status: 200 len: 1225 microversion: 2.1 time: 0.146414 Sep 23 04:56:37.285477 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2654/5452] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:56:37 2022] GET /compute/v2.1/servers/9a23c683-ac2a-4bd1-98c4-7675499569bc => generated 1225 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:56:38.098805 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-50cd3870-2562-448d-883e-30b12fde6a55 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:38.099592 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-50cd3870-2562-448d-883e-30b12fde6a55 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] [instance: 6dfb2418-b235-4d35-b109-4bed20d1b96e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:38.119988 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-50cd3870-2562-448d-883e-30b12fde6a55 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:38.122441 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-50cd3870-2562-448d-883e-30b12fde6a55 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:38.123494 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-50cd3870-2562-448d-883e-30b12fde6a55 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:38.130345 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-50cd3870-2562-448d-883e-30b12fde6a55 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:38.131172 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-50cd3870-2562-448d-883e-30b12fde6a55 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:38.133796 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-50cd3870-2562-448d-883e-30b12fde6a55 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:38.316465 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e4304777-eb98-48ef-bab5-17d61519a641 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:38.320981 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e4304777-eb98-48ef-bab5-17d61519a641 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] [instance: 9a23c683-ac2a-4bd1-98c4-7675499569bc] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:38.340667 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e4304777-eb98-48ef-bab5-17d61519a641 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:38.341463 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e4304777-eb98-48ef-bab5-17d61519a641 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:38.342155 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e4304777-eb98-48ef-bab5-17d61519a641 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:38.343057 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e4304777-eb98-48ef-bab5-17d61519a641 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:38.343691 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e4304777-eb98-48ef-bab5-17d61519a641 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:38.344499 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e4304777-eb98-48ef-bab5-17d61519a641 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:38.525555 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e4304777-eb98-48ef-bab5-17d61519a641 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0609d0a0d9243a2b205bf03b9baf254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1e75cfbb9e4ca79c46921d444ca761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:56:38.583171 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-50cd3870-2562-448d-883e-30b12fde6a55 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bde73a530f4666aebdd5f7d9fa1046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71874a329e54494bb1b84f31c3826205', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:56:38.584222 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e4304777-eb98-48ef-bab5-17d61519a641 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] 10.222.0.33 "GET /compute/v2.1/servers/9a23c683-ac2a-4bd1-98c4-7675499569bc" status: 200 len: 1229 microversion: 2.1 time: 0.272194 Sep 23 04:56:38.588271 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2655/5453] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:56:38 2022] GET /compute/v2.1/servers/9a23c683-ac2a-4bd1-98c4-7675499569bc => generated 1229 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:56:38.593769 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-50cd3870-2562-448d-883e-30b12fde6a55 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] 10.222.0.33 "GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e" status: 200 len: 1700 microversion: 2.1 time: 0.500617 Sep 23 04:56:38.603174 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2799/5454] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:56:38 2022] GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e => generated 1700 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:56:38.635224 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d9aef474-db13-4824-bcc4-0555ce1a1829 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:56:38.652691 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f43ef5a4-b914-4089-aa73-13da41a7fddc tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:38.653309 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f43ef5a4-b914-4089-aa73-13da41a7fddc tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 9bd2c0e2-8256-484a-bbd5-f21743724671] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:38.655218 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d9aef474-db13-4824-bcc4-0555ce1a1829 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:38.662156 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:56:38.662303 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d9aef474-db13-4824-bcc4-0555ce1a1829 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:38.662303 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d9aef474-db13-4824-bcc4-0555ce1a1829 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:38.671765 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f43ef5a4-b914-4089-aa73-13da41a7fddc tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:38.672294 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f43ef5a4-b914-4089-aa73-13da41a7fddc tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:38.673544 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f43ef5a4-b914-4089-aa73-13da41a7fddc tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:38.680546 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f43ef5a4-b914-4089-aa73-13da41a7fddc tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:38.681329 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f43ef5a4-b914-4089-aa73-13da41a7fddc tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:38.681793 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f43ef5a4-b914-4089-aa73-13da41a7fddc tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:38.735214 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d9aef474-db13-4824-bcc4-0555ce1a1829 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] [instance: 6dfb2418-b235-4d35-b109-4bed20d1b96e] Going to try to start instance {{(pid=122698) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 23 04:56:39.012163 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d9aef474-db13-4824-bcc4-0555ce1a1829 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] 10.222.0.33 "POST /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e/action" status: 202 len: 0 microversion: 2.1 time: 0.381370 Sep 23 04:56:39.013495 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2656/5455] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:56:38 2022] POST /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e/action => generated 0 bytes in 384 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:56:39.214637 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f43ef5a4-b914-4089-aa73-13da41a7fddc tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:56:39.225454 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f43ef5a4-b914-4089-aa73-13da41a7fddc tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671" status: 200 len: 1562 microversion: 2.1 time: 0.576518 Sep 23 04:56:39.226114 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2800/5456] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:56:38 2022] GET /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671 => generated 1562 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:56:39.241817 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9629ac25-c141-4e58-bb98-e7190532a03e tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:39.242790 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-9629ac25-c141-4e58-bb98-e7190532a03e tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] [instance: 6dfb2418-b235-4d35-b109-4bed20d1b96e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:39.262168 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9629ac25-c141-4e58-bb98-e7190532a03e tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:39.262867 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9629ac25-c141-4e58-bb98-e7190532a03e tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:39.263488 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9629ac25-c141-4e58-bb98-e7190532a03e tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:39.264424 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9629ac25-c141-4e58-bb98-e7190532a03e tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:39.265063 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9629ac25-c141-4e58-bb98-e7190532a03e tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:39.265669 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9629ac25-c141-4e58-bb98-e7190532a03e tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:39.647402 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-9629ac25-c141-4e58-bb98-e7190532a03e tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bde73a530f4666aebdd5f7d9fa1046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71874a329e54494bb1b84f31c3826205', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:56:39.665450 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-9629ac25-c141-4e58-bb98-e7190532a03e tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] 10.222.0.33 "GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e" status: 200 len: 1709 microversion: 2.1 time: 0.426865 Sep 23 04:56:39.667948 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2801/5457] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:56:39 2022] GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e => generated 1709 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:56:39.690419 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-16c85e60-8e49-47d3-9a04-5fe83607ebf5 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:39.691328 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-16c85e60-8e49-47d3-9a04-5fe83607ebf5 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] [instance: 9a23c683-ac2a-4bd1-98c4-7675499569bc] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:39.698215 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-16c85e60-8e49-47d3-9a04-5fe83607ebf5 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:39.699093 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-16c85e60-8e49-47d3-9a04-5fe83607ebf5 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:39.699754 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-16c85e60-8e49-47d3-9a04-5fe83607ebf5 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:39.700666 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-16c85e60-8e49-47d3-9a04-5fe83607ebf5 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:39.702240 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-16c85e60-8e49-47d3-9a04-5fe83607ebf5 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:39.702886 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-16c85e60-8e49-47d3-9a04-5fe83607ebf5 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:39.779562 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-d3dd2d5b-60ff-46c8-a64f-78e5c9740800 req-339e7286-66f7-49ea-9f5a-8af37735f8af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bd2c0e2-8256-484a-bbd5-f21743724671", "tag": "909994da-1d1c-4fc5-955f-cc0ae5196ea8"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:56:39.802674 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-d3dd2d5b-60ff-46c8-a64f-78e5c9740800 req-339e7286-66f7-49ea-9f5a-8af37735f8af service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:39.803173 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-d3dd2d5b-60ff-46c8-a64f-78e5c9740800 req-339e7286-66f7-49ea-9f5a-8af37735f8af service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:39.803610 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-d3dd2d5b-60ff-46c8-a64f-78e5c9740800 req-339e7286-66f7-49ea-9f5a-8af37735f8af service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:39.823745 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-d3dd2d5b-60ff-46c8-a64f-78e5c9740800 req-339e7286-66f7-49ea-9f5a-8af37735f8af service nova] Creating event network-changed:909994da-1d1c-4fc5-955f-cc0ae5196ea8 for instance 9bd2c0e2-8256-484a-bbd5-f21743724671 on n-h2-846463-3 Sep 23 04:56:39.834583 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-d3dd2d5b-60ff-46c8-a64f-78e5c9740800 req-339e7286-66f7-49ea-9f5a-8af37735f8af service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.809654 Sep 23 04:56:39.835488 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2657/5458] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:56:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:56:39.905428 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-16c85e60-8e49-47d3-9a04-5fe83607ebf5 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0609d0a0d9243a2b205bf03b9baf254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1e75cfbb9e4ca79c46921d444ca761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:56:39.915416 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-16c85e60-8e49-47d3-9a04-5fe83607ebf5 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] 10.222.0.33 "GET /compute/v2.1/servers/9a23c683-ac2a-4bd1-98c4-7675499569bc" status: 200 len: 1285 microversion: 2.1 time: 0.229655 Sep 23 04:56:39.916225 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2802/5459] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:56:39 2022] GET /compute/v2.1/servers/9a23c683-ac2a-4bd1-98c4-7675499569bc => generated 1285 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:56:40.693243 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-df46a790-66c5-4764-99b1-fecebdde812d tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:40.694022 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-df46a790-66c5-4764-99b1-fecebdde812d tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] [instance: 6dfb2418-b235-4d35-b109-4bed20d1b96e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:40.706211 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-df46a790-66c5-4764-99b1-fecebdde812d tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:40.706724 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-df46a790-66c5-4764-99b1-fecebdde812d tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:40.707170 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-df46a790-66c5-4764-99b1-fecebdde812d tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:40.711061 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-df46a790-66c5-4764-99b1-fecebdde812d tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:40.711061 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-df46a790-66c5-4764-99b1-fecebdde812d tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:40.711061 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-df46a790-66c5-4764-99b1-fecebdde812d tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:40.748520 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:56:40.953687 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-efa00a1f-863b-4689-bc2b-33ea83d5a5a4 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:40.955097 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-efa00a1f-863b-4689-bc2b-33ea83d5a5a4 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] [instance: 9a23c683-ac2a-4bd1-98c4-7675499569bc] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:40.964129 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-efa00a1f-863b-4689-bc2b-33ea83d5a5a4 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:40.969574 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-efa00a1f-863b-4689-bc2b-33ea83d5a5a4 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:40.970283 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-efa00a1f-863b-4689-bc2b-33ea83d5a5a4 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:40.971769 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-efa00a1f-863b-4689-bc2b-33ea83d5a5a4 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:40.978010 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-efa00a1f-863b-4689-bc2b-33ea83d5a5a4 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:40.978660 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-efa00a1f-863b-4689-bc2b-33ea83d5a5a4 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:41.028818 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-df46a790-66c5-4764-99b1-fecebdde812d tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bde73a530f4666aebdd5f7d9fa1046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71874a329e54494bb1b84f31c3826205', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:56:41.037935 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-df46a790-66c5-4764-99b1-fecebdde812d tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] 10.222.0.33 "GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e" status: 200 len: 1709 microversion: 2.1 time: 0.349846 Sep 23 04:56:41.038536 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2658/5460] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:56:40 2022] GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e => generated 1709 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:56:41.094141 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-efa00a1f-863b-4689-bc2b-33ea83d5a5a4 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0609d0a0d9243a2b205bf03b9baf254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1e75cfbb9e4ca79c46921d444ca761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:56:41.112566 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-efa00a1f-863b-4689-bc2b-33ea83d5a5a4 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] 10.222.0.33 "GET /compute/v2.1/servers/9a23c683-ac2a-4bd1-98c4-7675499569bc" status: 200 len: 1283 microversion: 2.1 time: 0.165412 Sep 23 04:56:41.113984 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2803/5461] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:56:40 2022] GET /compute/v2.1/servers/9a23c683-ac2a-4bd1-98c4-7675499569bc => generated 1283 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:56:42.069729 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-91c51804-c193-47b2-959c-d7308bb1e99b tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:42.070536 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-91c51804-c193-47b2-959c-d7308bb1e99b tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] [instance: 6dfb2418-b235-4d35-b109-4bed20d1b96e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:42.102888 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-91c51804-c193-47b2-959c-d7308bb1e99b tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:42.109986 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-91c51804-c193-47b2-959c-d7308bb1e99b tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:42.113171 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-91c51804-c193-47b2-959c-d7308bb1e99b tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:42.119178 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-91c51804-c193-47b2-959c-d7308bb1e99b tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:42.122885 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-91c51804-c193-47b2-959c-d7308bb1e99b tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:42.124177 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-91c51804-c193-47b2-959c-d7308bb1e99b tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:42.147439 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-fdfe2595-5768-4a61-b974-6ebb2ccd7a81 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:42.148073 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-fdfe2595-5768-4a61-b974-6ebb2ccd7a81 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] [instance: 9a23c683-ac2a-4bd1-98c4-7675499569bc] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:42.155701 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fdfe2595-5768-4a61-b974-6ebb2ccd7a81 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:42.156207 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fdfe2595-5768-4a61-b974-6ebb2ccd7a81 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:42.156661 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fdfe2595-5768-4a61-b974-6ebb2ccd7a81 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:42.157383 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fdfe2595-5768-4a61-b974-6ebb2ccd7a81 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:42.157848 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fdfe2595-5768-4a61-b974-6ebb2ccd7a81 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:42.179464 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fdfe2595-5768-4a61-b974-6ebb2ccd7a81 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:42.563563 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-fdfe2595-5768-4a61-b974-6ebb2ccd7a81 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0609d0a0d9243a2b205bf03b9baf254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1e75cfbb9e4ca79c46921d444ca761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:56:42.578872 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-fdfe2595-5768-4a61-b974-6ebb2ccd7a81 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] 10.222.0.33 "GET /compute/v2.1/servers/9a23c683-ac2a-4bd1-98c4-7675499569bc" status: 200 len: 1283 microversion: 2.1 time: 0.438082 Sep 23 04:56:42.581016 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2804/5462] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:56:42 2022] GET /compute/v2.1/servers/9a23c683-ac2a-4bd1-98c4-7675499569bc => generated 1283 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:56:42.649788 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-91c51804-c193-47b2-959c-d7308bb1e99b tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bde73a530f4666aebdd5f7d9fa1046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71874a329e54494bb1b84f31c3826205', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:56:42.658275 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-91c51804-c193-47b2-959c-d7308bb1e99b tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] 10.222.0.33 "GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e" status: 200 len: 1709 microversion: 2.1 time: 0.595917 Sep 23 04:56:42.658903 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2659/5463] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:56:42 2022] GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e => generated 1709 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:56:43.607210 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8132597c-4eee-456e-ba91-f48f3ab8a716 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:43.609881 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-8132597c-4eee-456e-ba91-f48f3ab8a716 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] [instance: 9a23c683-ac2a-4bd1-98c4-7675499569bc] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:43.624444 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8132597c-4eee-456e-ba91-f48f3ab8a716 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:43.624963 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8132597c-4eee-456e-ba91-f48f3ab8a716 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:43.625987 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8132597c-4eee-456e-ba91-f48f3ab8a716 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:43.629154 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8132597c-4eee-456e-ba91-f48f3ab8a716 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:43.629644 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8132597c-4eee-456e-ba91-f48f3ab8a716 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:43.630133 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8132597c-4eee-456e-ba91-f48f3ab8a716 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:43.684266 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-045ea852-7d34-4fde-84b3-5f5729b4c52b tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:43.685229 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-045ea852-7d34-4fde-84b3-5f5729b4c52b tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] [instance: 6dfb2418-b235-4d35-b109-4bed20d1b96e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:43.690193 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=72 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:56:43.694807 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-045ea852-7d34-4fde-84b3-5f5729b4c52b tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:43.694941 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-045ea852-7d34-4fde-84b3-5f5729b4c52b tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:43.695446 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-045ea852-7d34-4fde-84b3-5f5729b4c52b tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:43.696182 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-045ea852-7d34-4fde-84b3-5f5729b4c52b tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:43.696658 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-045ea852-7d34-4fde-84b3-5f5729b4c52b tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:43.697103 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-045ea852-7d34-4fde-84b3-5f5729b4c52b tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:43.988815 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-8132597c-4eee-456e-ba91-f48f3ab8a716 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0609d0a0d9243a2b205bf03b9baf254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1e75cfbb9e4ca79c46921d444ca761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:56:44.000052 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-8132597c-4eee-456e-ba91-f48f3ab8a716 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] 10.222.0.33 "GET /compute/v2.1/servers/9a23c683-ac2a-4bd1-98c4-7675499569bc" status: 200 len: 1325 microversion: 2.1 time: 0.397226 Sep 23 04:56:44.004692 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2805/5464] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:56:43 2022] GET /compute/v2.1/servers/9a23c683-ac2a-4bd1-98c4-7675499569bc => generated 1325 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:56:44.292262 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-045ea852-7d34-4fde-84b3-5f5729b4c52b tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bde73a530f4666aebdd5f7d9fa1046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71874a329e54494bb1b84f31c3826205', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:56:44.302143 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-045ea852-7d34-4fde-84b3-5f5729b4c52b tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] 10.222.0.33 "GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e" status: 200 len: 1713 microversion: 2.1 time: 0.622291 Sep 23 04:56:44.302812 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2660/5465] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:56:43 2022] GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e => generated 1713 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:56:45.031248 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ff324390-827b-41d9-90f2-11cb5d419eda tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:45.034197 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ff324390-827b-41d9-90f2-11cb5d419eda tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] [instance: 9a23c683-ac2a-4bd1-98c4-7675499569bc] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:45.052371 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ff324390-827b-41d9-90f2-11cb5d419eda tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:45.053092 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ff324390-827b-41d9-90f2-11cb5d419eda tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:45.053763 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ff324390-827b-41d9-90f2-11cb5d419eda tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:45.055700 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ff324390-827b-41d9-90f2-11cb5d419eda tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:45.057555 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ff324390-827b-41d9-90f2-11cb5d419eda tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:45.058269 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ff324390-827b-41d9-90f2-11cb5d419eda tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:45.504412 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:56:45.520593 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-5da4b9d7-47c3-4fa1-84d6-e9ede00ca48c req-f7d9457e-73fc-426b-ac2b-c82e2f7a0326 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a23c683-ac2a-4bd1-98c4-7675499569bc", "tag": "0cadc710-c30f-4cb6-b62b-b24eb7fa52be"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:56:45.541099 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=6 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:56:45.542355 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-5da4b9d7-47c3-4fa1-84d6-e9ede00ca48c req-f7d9457e-73fc-426b-ac2b-c82e2f7a0326 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:45.548649 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-5da4b9d7-47c3-4fa1-84d6-e9ede00ca48c req-f7d9457e-73fc-426b-ac2b-c82e2f7a0326 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:45.548649 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-5da4b9d7-47c3-4fa1-84d6-e9ede00ca48c req-f7d9457e-73fc-426b-ac2b-c82e2f7a0326 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:45.572952 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ff324390-827b-41d9-90f2-11cb5d419eda tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0609d0a0d9243a2b205bf03b9baf254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1e75cfbb9e4ca79c46921d444ca761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:56:45.577073 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-5da4b9d7-47c3-4fa1-84d6-e9ede00ca48c req-f7d9457e-73fc-426b-ac2b-c82e2f7a0326 service nova] Creating event network-changed:0cadc710-c30f-4cb6-b62b-b24eb7fa52be for instance 9a23c683-ac2a-4bd1-98c4-7675499569bc on n-h1-846463-3 Sep 23 04:56:45.586933 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ff324390-827b-41d9-90f2-11cb5d419eda tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] 10.222.0.33 "GET /compute/v2.1/servers/9a23c683-ac2a-4bd1-98c4-7675499569bc" status: 200 len: 1325 microversion: 2.1 time: 0.562029 Sep 23 04:56:45.588155 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-5da4b9d7-47c3-4fa1-84d6-e9ede00ca48c req-f7d9457e-73fc-426b-ac2b-c82e2f7a0326 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.461118 Sep 23 04:56:45.589146 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2661/5466] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:56:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:56:45.592871 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2806/5467] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:56:45 2022] GET /compute/v2.1/servers/9a23c683-ac2a-4bd1-98c4-7675499569bc => generated 1325 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:56:46.614428 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c23e2e0f-a9ff-422f-a6f4-15d147b82efb tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:46.615711 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c23e2e0f-a9ff-422f-a6f4-15d147b82efb tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] [instance: 9a23c683-ac2a-4bd1-98c4-7675499569bc] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:46.622744 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c23e2e0f-a9ff-422f-a6f4-15d147b82efb tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:46.623504 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c23e2e0f-a9ff-422f-a6f4-15d147b82efb tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:46.624427 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c23e2e0f-a9ff-422f-a6f4-15d147b82efb tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:46.625164 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c23e2e0f-a9ff-422f-a6f4-15d147b82efb tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:46.626131 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c23e2e0f-a9ff-422f-a6f4-15d147b82efb tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:46.626131 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c23e2e0f-a9ff-422f-a6f4-15d147b82efb tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:46.786562 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c23e2e0f-a9ff-422f-a6f4-15d147b82efb tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0609d0a0d9243a2b205bf03b9baf254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1e75cfbb9e4ca79c46921d444ca761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:56:46.797988 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c23e2e0f-a9ff-422f-a6f4-15d147b82efb tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] 10.222.0.33 "GET /compute/v2.1/servers/9a23c683-ac2a-4bd1-98c4-7675499569bc" status: 200 len: 1325 microversion: 2.1 time: 0.188279 Sep 23 04:56:46.800025 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2662/5468] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:56:46 2022] GET /compute/v2.1/servers/9a23c683-ac2a-4bd1-98c4-7675499569bc => generated 1325 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:56:47.827118 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b31abe84-4b8c-4ae8-b282-301128e743a1 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:47.828420 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b31abe84-4b8c-4ae8-b282-301128e743a1 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] [instance: 9a23c683-ac2a-4bd1-98c4-7675499569bc] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:47.838839 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b31abe84-4b8c-4ae8-b282-301128e743a1 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:47.839358 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b31abe84-4b8c-4ae8-b282-301128e743a1 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:47.842316 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b31abe84-4b8c-4ae8-b282-301128e743a1 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:47.845276 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b31abe84-4b8c-4ae8-b282-301128e743a1 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:47.849248 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b31abe84-4b8c-4ae8-b282-301128e743a1 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:47.850000 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b31abe84-4b8c-4ae8-b282-301128e743a1 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:48.136438 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b31abe84-4b8c-4ae8-b282-301128e743a1 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0609d0a0d9243a2b205bf03b9baf254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1e75cfbb9e4ca79c46921d444ca761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:56:48.153832 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b31abe84-4b8c-4ae8-b282-301128e743a1 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] 10.222.0.33 "GET /compute/v2.1/servers/9a23c683-ac2a-4bd1-98c4-7675499569bc" status: 200 len: 1325 microversion: 2.1 time: 0.332074 Sep 23 04:56:48.159900 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2807/5469] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:56:47 2022] GET /compute/v2.1/servers/9a23c683-ac2a-4bd1-98c4-7675499569bc => generated 1325 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:56:49.187092 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2f7f03e4-db98-4a83-9fee-12b3be9efeec tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:49.187650 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-2f7f03e4-db98-4a83-9fee-12b3be9efeec tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] [instance: 9a23c683-ac2a-4bd1-98c4-7675499569bc] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:49.195938 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=4 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:56:49.200775 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2f7f03e4-db98-4a83-9fee-12b3be9efeec tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:49.203906 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2f7f03e4-db98-4a83-9fee-12b3be9efeec tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:49.204837 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2f7f03e4-db98-4a83-9fee-12b3be9efeec tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:49.218236 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2f7f03e4-db98-4a83-9fee-12b3be9efeec tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:49.225120 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2f7f03e4-db98-4a83-9fee-12b3be9efeec tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:49.226735 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2f7f03e4-db98-4a83-9fee-12b3be9efeec tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:49.679383 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-2f7f03e4-db98-4a83-9fee-12b3be9efeec tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0609d0a0d9243a2b205bf03b9baf254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1e75cfbb9e4ca79c46921d444ca761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:56:49.689558 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2f7f03e4-db98-4a83-9fee-12b3be9efeec tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] 10.222.0.33 "GET /compute/v2.1/servers/9a23c683-ac2a-4bd1-98c4-7675499569bc" status: 200 len: 1325 microversion: 2.1 time: 0.509462 Sep 23 04:56:49.698701 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2663/5470] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:56:49 2022] GET /compute/v2.1/servers/9a23c683-ac2a-4bd1-98c4-7675499569bc => generated 1325 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:56:49.871467 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-785515e1-66f3-4894-a7a1-4bba8ba07d36 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:49.872127 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-785515e1-66f3-4894-a7a1-4bba8ba07d36 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] [instance: 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:49.886981 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-785515e1-66f3-4894-a7a1-4bba8ba07d36 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:49.887517 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-785515e1-66f3-4894-a7a1-4bba8ba07d36 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:49.887971 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-785515e1-66f3-4894-a7a1-4bba8ba07d36 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:49.888896 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-785515e1-66f3-4894-a7a1-4bba8ba07d36 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:49.889669 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-785515e1-66f3-4894-a7a1-4bba8ba07d36 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:49.890727 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-785515e1-66f3-4894-a7a1-4bba8ba07d36 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:49.936676 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-785515e1-66f3-4894-a7a1-4bba8ba07d36 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] [instance: 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7] Going to try to terminate instance {{(pid=122699) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:56:49.987256 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=100 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:56:50.356555 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-785515e1-66f3-4894-a7a1-4bba8ba07d36 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] 10.222.0.33 "DELETE /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7" status: 204 len: 0 microversion: 2.32 time: 0.746138 Sep 23 04:56:50.358241 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2808/5471] 10.222.0.33 () {60 vars in 1280 bytes} [Fri Sep 23 04:56:49 2022] DELETE /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 => generated 0 bytes in 748 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 23 04:56:50.367243 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ff207108-6f5a-434a-aa2f-ed025a190f00 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:50.369011 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-ff207108-6f5a-434a-aa2f-ed025a190f00 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] [instance: 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:50.381843 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ff207108-6f5a-434a-aa2f-ed025a190f00 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:50.383153 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ff207108-6f5a-434a-aa2f-ed025a190f00 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:50.386454 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ff207108-6f5a-434a-aa2f-ed025a190f00 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:50.391323 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ff207108-6f5a-434a-aa2f-ed025a190f00 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:50.391323 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ff207108-6f5a-434a-aa2f-ed025a190f00 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:50.391323 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ff207108-6f5a-434a-aa2f-ed025a190f00 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:50.713289 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8e1a12df-6d0e-43ed-8dc1-ddbcefa94ad6 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:50.714085 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-8e1a12df-6d0e-43ed-8dc1-ddbcefa94ad6 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] [instance: 9a23c683-ac2a-4bd1-98c4-7675499569bc] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:50.727254 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8e1a12df-6d0e-43ed-8dc1-ddbcefa94ad6 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:50.727254 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8e1a12df-6d0e-43ed-8dc1-ddbcefa94ad6 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:50.727254 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8e1a12df-6d0e-43ed-8dc1-ddbcefa94ad6 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:50.727254 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8e1a12df-6d0e-43ed-8dc1-ddbcefa94ad6 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:50.727254 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8e1a12df-6d0e-43ed-8dc1-ddbcefa94ad6 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:50.727774 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8e1a12df-6d0e-43ed-8dc1-ddbcefa94ad6 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:50.773772 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ff207108-6f5a-434a-aa2f-ed025a190f00 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:56:50.784416 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ff207108-6f5a-434a-aa2f-ed025a190f00 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:56:50.785967 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ff207108-6f5a-434a-aa2f-ed025a190f00 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:56:50.787243 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ff207108-6f5a-434a-aa2f-ed025a190f00 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] 10.222.0.33 "GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7" status: 200 len: 2952 microversion: 2.32 time: 0.424424 Sep 23 04:56:50.802930 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2664/5472] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:56:50 2022] GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 => generated 2952 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:56:51.066486 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-8e1a12df-6d0e-43ed-8dc1-ddbcefa94ad6 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0609d0a0d9243a2b205bf03b9baf254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1e75cfbb9e4ca79c46921d444ca761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:56:51.078924 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-8e1a12df-6d0e-43ed-8dc1-ddbcefa94ad6 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] 10.222.0.33 "GET /compute/v2.1/servers/9a23c683-ac2a-4bd1-98c4-7675499569bc" status: 200 len: 1325 microversion: 2.1 time: 0.365589 Sep 23 04:56:51.079907 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2809/5473] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:56:50 2022] GET /compute/v2.1/servers/9a23c683-ac2a-4bd1-98c4-7675499569bc => generated 1325 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:56:51.658910 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-f5222e3a-a9ee-422d-9bce-b3a3341a8dec req-61e93236-f281-4ff0-a85b-7a287d375723 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a23c683-ac2a-4bd1-98c4-7675499569bc", "name": "network-vif-plugged", "status": "completed", "tag": "0cadc710-c30f-4cb6-b62b-b24eb7fa52be"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:56:51.679045 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-f5222e3a-a9ee-422d-9bce-b3a3341a8dec req-61e93236-f281-4ff0-a85b-7a287d375723 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:51.679845 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-f5222e3a-a9ee-422d-9bce-b3a3341a8dec req-61e93236-f281-4ff0-a85b-7a287d375723 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:51.680781 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-f5222e3a-a9ee-422d-9bce-b3a3341a8dec req-61e93236-f281-4ff0-a85b-7a287d375723 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:51.694127 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-f5222e3a-a9ee-422d-9bce-b3a3341a8dec req-61e93236-f281-4ff0-a85b-7a287d375723 service nova] Creating event network-vif-plugged:0cadc710-c30f-4cb6-b62b-b24eb7fa52be for instance 9a23c683-ac2a-4bd1-98c4-7675499569bc on n-h1-846463-3 Sep 23 04:56:51.701679 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-f5222e3a-a9ee-422d-9bce-b3a3341a8dec req-61e93236-f281-4ff0-a85b-7a287d375723 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.304035 Sep 23 04:56:51.702724 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2665/5474] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:56:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:56:51.816512 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-20fe81b1-cf55-45db-868a-87ef8a11a715 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:51.818064 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-20fe81b1-cf55-45db-868a-87ef8a11a715 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] [instance: 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:51.826607 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-20fe81b1-cf55-45db-868a-87ef8a11a715 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:51.827439 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-20fe81b1-cf55-45db-868a-87ef8a11a715 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:51.828116 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-20fe81b1-cf55-45db-868a-87ef8a11a715 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:51.829046 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-20fe81b1-cf55-45db-868a-87ef8a11a715 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:51.830260 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-20fe81b1-cf55-45db-868a-87ef8a11a715 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:51.831107 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-20fe81b1-cf55-45db-868a-87ef8a11a715 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:52.103565 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-20fe81b1-cf55-45db-868a-87ef8a11a715 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:56:52.104230 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-27eaf6a6-afc6-477c-a065-5937a198c431 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:52.105124 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-27eaf6a6-afc6-477c-a065-5937a198c431 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] [instance: 9a23c683-ac2a-4bd1-98c4-7675499569bc] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:52.120218 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-20fe81b1-cf55-45db-868a-87ef8a11a715 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:56:52.129297 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-20fe81b1-cf55-45db-868a-87ef8a11a715 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:56:52.129470 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-27eaf6a6-afc6-477c-a065-5937a198c431 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:52.129470 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-27eaf6a6-afc6-477c-a065-5937a198c431 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:52.129470 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-27eaf6a6-afc6-477c-a065-5937a198c431 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:52.129797 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-20fe81b1-cf55-45db-868a-87ef8a11a715 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] 10.222.0.33 "GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7" status: 200 len: 2952 microversion: 2.32 time: 0.315116 Sep 23 04:56:52.129925 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-27eaf6a6-afc6-477c-a065-5937a198c431 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:52.129925 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-27eaf6a6-afc6-477c-a065-5937a198c431 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:52.129925 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-27eaf6a6-afc6-477c-a065-5937a198c431 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:52.131098 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2810/5475] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:56:51 2022] GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 => generated 2952 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:56:52.421983 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-27eaf6a6-afc6-477c-a065-5937a198c431 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0609d0a0d9243a2b205bf03b9baf254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1e75cfbb9e4ca79c46921d444ca761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:56:52.430848 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-27eaf6a6-afc6-477c-a065-5937a198c431 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] 10.222.0.33 "GET /compute/v2.1/servers/9a23c683-ac2a-4bd1-98c4-7675499569bc" status: 200 len: 1325 microversion: 2.1 time: 0.332101 Sep 23 04:56:52.431998 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2666/5476] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:56:52 2022] GET /compute/v2.1/servers/9a23c683-ac2a-4bd1-98c4-7675499569bc => generated 1325 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:56:53.161459 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d5e9ad2f-3385-4fe0-82ff-438de3a12dbc tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:53.162933 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d5e9ad2f-3385-4fe0-82ff-438de3a12dbc tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] [instance: 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:53.174981 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d5e9ad2f-3385-4fe0-82ff-438de3a12dbc tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:53.175823 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d5e9ad2f-3385-4fe0-82ff-438de3a12dbc tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:53.176286 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d5e9ad2f-3385-4fe0-82ff-438de3a12dbc tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:53.177595 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d5e9ad2f-3385-4fe0-82ff-438de3a12dbc tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:53.178651 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d5e9ad2f-3385-4fe0-82ff-438de3a12dbc tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:53.179178 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d5e9ad2f-3385-4fe0-82ff-438de3a12dbc tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:53.459297 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-50a08573-08b3-41e7-97db-f01d2f072d03 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:53.463657 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-50a08573-08b3-41e7-97db-f01d2f072d03 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] [instance: 9a23c683-ac2a-4bd1-98c4-7675499569bc] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:53.488765 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-50a08573-08b3-41e7-97db-f01d2f072d03 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:53.491106 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-50a08573-08b3-41e7-97db-f01d2f072d03 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:53.495263 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-50a08573-08b3-41e7-97db-f01d2f072d03 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:53.496824 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-50a08573-08b3-41e7-97db-f01d2f072d03 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:53.497407 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-50a08573-08b3-41e7-97db-f01d2f072d03 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:53.500400 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-50a08573-08b3-41e7-97db-f01d2f072d03 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:53.950233 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d5e9ad2f-3385-4fe0-82ff-438de3a12dbc tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:56:53.962863 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d5e9ad2f-3385-4fe0-82ff-438de3a12dbc tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:56:53.965252 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d5e9ad2f-3385-4fe0-82ff-438de3a12dbc tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:56:53.967257 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d5e9ad2f-3385-4fe0-82ff-438de3a12dbc tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] 10.222.0.33 "GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7" status: 200 len: 2952 microversion: 2.32 time: 0.810411 Sep 23 04:56:53.994832 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2811/5477] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:56:53 2022] GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 => generated 2952 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:56:54.096010 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-50a08573-08b3-41e7-97db-f01d2f072d03 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0609d0a0d9243a2b205bf03b9baf254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1e75cfbb9e4ca79c46921d444ca761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:56:54.130221 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-50a08573-08b3-41e7-97db-f01d2f072d03 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] 10.222.0.33 "GET /compute/v2.1/servers/9a23c683-ac2a-4bd1-98c4-7675499569bc" status: 200 len: 1521 microversion: 2.1 time: 0.660865 Sep 23 04:56:54.134723 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2667/5478] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:56:53 2022] GET /compute/v2.1/servers/9a23c683-ac2a-4bd1-98c4-7675499569bc => generated 1521 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:56:54.165618 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-bc2e396f-e703-43f0-b687-84eaee060fa1 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:54.166379 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-bc2e396f-e703-43f0-b687-84eaee060fa1 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] [instance: 9a23c683-ac2a-4bd1-98c4-7675499569bc] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:54.181039 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bc2e396f-e703-43f0-b687-84eaee060fa1 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:54.183836 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bc2e396f-e703-43f0-b687-84eaee060fa1 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:54.193065 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bc2e396f-e703-43f0-b687-84eaee060fa1 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:54.193065 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bc2e396f-e703-43f0-b687-84eaee060fa1 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:54.193065 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bc2e396f-e703-43f0-b687-84eaee060fa1 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:54.195825 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bc2e396f-e703-43f0-b687-84eaee060fa1 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:54.260061 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-bc2e396f-e703-43f0-b687-84eaee060fa1 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] HTTP exception thrown: Instance is not a member of specified network Sep 23 04:56:54.267480 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-bc2e396f-e703-43f0-b687-84eaee060fa1 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Request method failure captured: Sep 23 04:56:54.267480 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/9a23c683-ac2a-4bd1-98c4-7675499569bc/ips/invalid HTTP/1.1 Sep 23 04:56:54.267480 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:56:54.267480 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:56:54.267480 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:56:54.267480 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:56:54.267480 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:56:54.267480 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:56:54.267480 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:56:54.267480 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:56:54.267480 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTyAzo61sMNBDaUb7o4CbY0pTGFLcOmRfkE94WKI_-h0EsGPxbvgjm-VoTQu32vV42Bd37rJDpf_mAdQ8nwEN6J1xRGEWnWu3OAjHePgmaddFl6kaSWYAruAdwXXfKziod2H5nsX-8-nl2cD7iaN8PlKK2z2_TVvPOmVU6tkr3a-W9Q Sep 23 04:56:54.267480 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:56:54.267480 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:56:54.267480 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:56:54.267480 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:56:54.267480 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:56:54.267480 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:56:54.267480 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 3f1e75cfbb9e4ca79c46921d444ca761 Sep 23 04:56:54.267480 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-253815714 Sep 23 04:56:54.267480 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:56:54.267480 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:56:54.267480 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3f1e75cfbb9e4ca79c46921d444ca761", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3f1e75cfbb9e4ca79c46921d444ca761"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3f1e75cfbb9e4ca79c46921d444ca761"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3f1e75cfbb9e4ca79c46921d444ca761"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:56:54.267480 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-253815714 Sep 23 04:56:54.267480 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 3f1e75cfbb9e4ca79c46921d444ca761 Sep 23 04:56:54.267480 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-253815714 Sep 23 04:56:54.267480 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ServerAddressesNegativeTestJSON-253815714-project Sep 23 04:56:54.267480 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:56:54.267480 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:56:54.267480 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: c0609d0a0d9243a2b205bf03b9baf254 Sep 23 04:56:54.267480 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-253815714-project Sep 23 04:56:54.267480 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:56:54.267480 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance is not a member of specified network Sep 23 04:56:54.267480 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'server_id': '9a23c683-ac2a-4bd1-98c4-7675499569bc', 'id': 'invalid'} Sep 23 04:56:54.267480 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:56:54.267480 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:56:54.267480 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:56:54.267480 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:56:54.267480 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:56:54.267480 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:56:54.267480 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:56:54.267480 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:56:54.267480 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Sep 23 04:56:54.267480 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 23 04:56:54.267480 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Sep 23 04:56:54.267480 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:56:54.267480 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:56:54.267480 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:56:54.267480 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:56:54.267480 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:56:54.267480 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:56:54.267480 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:56:54.267480 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:56:54.267480 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Sep 23 04:56:54.267480 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:56:54.274372 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-bc2e396f-e703-43f0-b687-84eaee060fa1 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Returning 404 to user: Instance is not a member of specified network {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:56:54.275498 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-bc2e396f-e703-43f0-b687-84eaee060fa1 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] 10.222.0.33 "GET /compute/v2.1/servers/9a23c683-ac2a-4bd1-98c4-7675499569bc/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.113991 Sep 23 04:56:54.276275 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2812/5479] 10.222.0.33 () {58 vars in 1272 bytes} [Fri Sep 23 04:56:54 2022] GET /compute/v2.1/servers/9a23c683-ac2a-4bd1-98c4-7675499569bc/ips/invalid => generated 91 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 23 04:56:54.292654 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-24bf6e4e-1146-45e7-9b7f-7131b9d95ed4 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:54.293158 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-24bf6e4e-1146-45e7-9b7f-7131b9d95ed4 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Failed to fetch instance by id 999 {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 23 04:56:54.293996 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-24bf6e4e-1146-45e7-9b7f-7131b9d95ed4 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] HTTP exception thrown: Instance 999 could not be found. Sep 23 04:56:54.295931 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-24bf6e4e-1146-45e7-9b7f-7131b9d95ed4 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Request method failure captured: Sep 23 04:56:54.295931 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Sep 23 04:56:54.295931 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:56:54.295931 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:56:54.295931 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:56:54.295931 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:56:54.295931 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:56:54.295931 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:56:54.295931 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:56:54.295931 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:56:54.295931 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTyAzo61sMNBDaUb7o4CbY0pTGFLcOmRfkE94WKI_-h0EsGPxbvgjm-VoTQu32vV42Bd37rJDpf_mAdQ8nwEN6J1xRGEWnWu3OAjHePgmaddFl6kaSWYAruAdwXXfKziod2H5nsX-8-nl2cD7iaN8PlKK2z2_TVvPOmVU6tkr3a-W9Q Sep 23 04:56:54.295931 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:56:54.295931 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:56:54.295931 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:56:54.295931 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:56:54.295931 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:56:54.295931 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:56:54.295931 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 3f1e75cfbb9e4ca79c46921d444ca761 Sep 23 04:56:54.295931 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-253815714 Sep 23 04:56:54.295931 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:56:54.295931 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:56:54.295931 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3f1e75cfbb9e4ca79c46921d444ca761", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3f1e75cfbb9e4ca79c46921d444ca761"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3f1e75cfbb9e4ca79c46921d444ca761"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3f1e75cfbb9e4ca79c46921d444ca761"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:56:54.295931 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-253815714 Sep 23 04:56:54.295931 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 3f1e75cfbb9e4ca79c46921d444ca761 Sep 23 04:56:54.295931 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-253815714 Sep 23 04:56:54.295931 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ServerAddressesNegativeTestJSON-253815714-project Sep 23 04:56:54.295931 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:56:54.295931 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:56:54.295931 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: c0609d0a0d9243a2b205bf03b9baf254 Sep 23 04:56:54.295931 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-253815714-project Sep 23 04:56:54.295931 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:56:54.295931 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 999 could not be found. Sep 23 04:56:54.295931 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'server_id': '999'} Sep 23 04:56:54.295931 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:56:54.295931 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:56:54.295931 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:56:54.295931 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:56:54.295931 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 23 04:56:54.295931 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 23 04:56:54.295931 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Sep 23 04:56:54.295931 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:56:54.295931 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:56:54.295931 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:56:54.295931 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:56:54.295931 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:56:54.295931 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:56:54.295931 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:56:54.295931 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:56:54.295931 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:56:54.295931 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:56:54.295931 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Sep 23 04:56:54.295931 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Sep 23 04:56:54.295931 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:56:54.295931 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:56:54.295931 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Sep 23 04:56:54.295931 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:56:54.295931 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:56:54.295931 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:56:54.295931 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:56:54.295931 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:56:54.295931 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:56:54.295931 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:56:54.295931 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:56:54.295931 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Sep 23 04:56:54.295931 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:56:54.303165 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-24bf6e4e-1146-45e7-9b7f-7131b9d95ed4 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Returning 404 to user: Instance 999 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:56:54.303165 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-24bf6e4e-1146-45e7-9b7f-7131b9d95ed4 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] 10.222.0.33 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.009361 Sep 23 04:56:54.303165 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2668/5480] 10.222.0.33 () {58 vars in 1149 bytes} [Fri Sep 23 04:56:54 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 23 04:56:54.311961 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5ed3fd36-a240-4dd9-9741-6dc16a29f863 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:54.312535 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-5ed3fd36-a240-4dd9-9741-6dc16a29f863 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] [instance: 9a23c683-ac2a-4bd1-98c4-7675499569bc] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:54.345282 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5ed3fd36-a240-4dd9-9741-6dc16a29f863 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:54.347305 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5ed3fd36-a240-4dd9-9741-6dc16a29f863 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:54.347305 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5ed3fd36-a240-4dd9-9741-6dc16a29f863 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:54.347305 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5ed3fd36-a240-4dd9-9741-6dc16a29f863 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:54.347831 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5ed3fd36-a240-4dd9-9741-6dc16a29f863 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:54.347943 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5ed3fd36-a240-4dd9-9741-6dc16a29f863 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:54.410251 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-5ed3fd36-a240-4dd9-9741-6dc16a29f863 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] [instance: 9a23c683-ac2a-4bd1-98c4-7675499569bc] Going to try to terminate instance {{(pid=122699) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:56:54.847673 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5ed3fd36-a240-4dd9-9741-6dc16a29f863 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9a23c683-ac2a-4bd1-98c4-7675499569bc" status: 204 len: 0 microversion: 2.1 time: 0.543828 Sep 23 04:56:54.851613 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2813/5481] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:56:54 2022] DELETE /compute/v2.1/servers/9a23c683-ac2a-4bd1-98c4-7675499569bc => generated 0 bytes in 546 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:56:54.867927 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-974c13d8-4747-4ea4-9eda-67a4fe986335 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:54.867927 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-974c13d8-4747-4ea4-9eda-67a4fe986335 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] [instance: 9a23c683-ac2a-4bd1-98c4-7675499569bc] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:54.870175 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-974c13d8-4747-4ea4-9eda-67a4fe986335 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:54.874400 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-974c13d8-4747-4ea4-9eda-67a4fe986335 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:54.874885 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-974c13d8-4747-4ea4-9eda-67a4fe986335 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:54.875653 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-974c13d8-4747-4ea4-9eda-67a4fe986335 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:54.877562 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-974c13d8-4747-4ea4-9eda-67a4fe986335 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:54.878250 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-974c13d8-4747-4ea4-9eda-67a4fe986335 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:55.001782 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-cbd7ebdd-de7a-49bf-890a-275f9e8df9cd tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:55.002970 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-cbd7ebdd-de7a-49bf-890a-275f9e8df9cd tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] [instance: 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:55.015451 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cbd7ebdd-de7a-49bf-890a-275f9e8df9cd tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:55.016351 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cbd7ebdd-de7a-49bf-890a-275f9e8df9cd tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:55.017087 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cbd7ebdd-de7a-49bf-890a-275f9e8df9cd tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:55.018055 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cbd7ebdd-de7a-49bf-890a-275f9e8df9cd tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:55.018725 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cbd7ebdd-de7a-49bf-890a-275f9e8df9cd tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:55.019352 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cbd7ebdd-de7a-49bf-890a-275f9e8df9cd tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:55.310816 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-cbd7ebdd-de7a-49bf-890a-275f9e8df9cd tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:56:55.344363 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-cbd7ebdd-de7a-49bf-890a-275f9e8df9cd tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:56:55.347345 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-cbd7ebdd-de7a-49bf-890a-275f9e8df9cd tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:56:55.348980 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-cbd7ebdd-de7a-49bf-890a-275f9e8df9cd tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] 10.222.0.33 "GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7" status: 200 len: 2931 microversion: 2.32 time: 0.353224 Sep 23 04:56:55.350172 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2814/5482] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:56:54 2022] GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 => generated 2931 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:56:55.386075 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-974c13d8-4747-4ea4-9eda-67a4fe986335 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0609d0a0d9243a2b205bf03b9baf254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1e75cfbb9e4ca79c46921d444ca761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:56:55.402968 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-974c13d8-4747-4ea4-9eda-67a4fe986335 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] 10.222.0.33 "GET /compute/v2.1/servers/9a23c683-ac2a-4bd1-98c4-7675499569bc" status: 200 len: 1527 microversion: 2.1 time: 0.550225 Sep 23 04:56:55.429254 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2669/5483] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:56:54 2022] GET /compute/v2.1/servers/9a23c683-ac2a-4bd1-98c4-7675499569bc => generated 1527 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:56:55.722233 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6e71381d-a637-4fb9-8537-4a4c54ad8956 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:56:55.728111 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-6e71381d-a637-4fb9-8537-4a4c54ad8956 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 9bd2c0e2-8256-484a-bbd5-f21743724671] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:55.745041 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6e71381d-a637-4fb9-8537-4a4c54ad8956 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:55.745560 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6e71381d-a637-4fb9-8537-4a4c54ad8956 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:55.746051 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6e71381d-a637-4fb9-8537-4a4c54ad8956 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:55.746788 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6e71381d-a637-4fb9-8537-4a4c54ad8956 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:55.747261 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6e71381d-a637-4fb9-8537-4a4c54ad8956 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:55.747705 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6e71381d-a637-4fb9-8537-4a4c54ad8956 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:55.832321 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6e71381d-a637-4fb9-8537-4a4c54ad8956 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "POST /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671/action" status: 200 len: 24569 microversion: 2.1 time: 0.111969 Sep 23 04:56:55.841154 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2815/5484] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:56:55 2022] POST /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671/action => generated 24569 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 04:56:56.382234 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-777d5512-6bfe-42b3-9543-ad689bca9380 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:56.383765 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-777d5512-6bfe-42b3-9543-ad689bca9380 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] [instance: 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:56.394803 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-777d5512-6bfe-42b3-9543-ad689bca9380 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:56.396576 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-777d5512-6bfe-42b3-9543-ad689bca9380 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:56.400070 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-777d5512-6bfe-42b3-9543-ad689bca9380 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:56.401078 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-777d5512-6bfe-42b3-9543-ad689bca9380 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:56.402509 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-777d5512-6bfe-42b3-9543-ad689bca9380 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:56.405068 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-777d5512-6bfe-42b3-9543-ad689bca9380 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:56.458322 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e39e6da4-f16a-4215-9bff-3d69f38c125d tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:56.460915 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e39e6da4-f16a-4215-9bff-3d69f38c125d tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] [instance: 9a23c683-ac2a-4bd1-98c4-7675499569bc] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:56.502185 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e39e6da4-f16a-4215-9bff-3d69f38c125d tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:56.510416 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e39e6da4-f16a-4215-9bff-3d69f38c125d tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:56.510416 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e39e6da4-f16a-4215-9bff-3d69f38c125d tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:56.510416 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e39e6da4-f16a-4215-9bff-3d69f38c125d tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:56.510416 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e39e6da4-f16a-4215-9bff-3d69f38c125d tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:56.511444 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e39e6da4-f16a-4215-9bff-3d69f38c125d tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:56.885367 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e39e6da4-f16a-4215-9bff-3d69f38c125d tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0609d0a0d9243a2b205bf03b9baf254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1e75cfbb9e4ca79c46921d444ca761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:56:56.899242 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e39e6da4-f16a-4215-9bff-3d69f38c125d tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] 10.222.0.33 "GET /compute/v2.1/servers/9a23c683-ac2a-4bd1-98c4-7675499569bc" status: 200 len: 1527 microversion: 2.1 time: 0.467494 Sep 23 04:56:56.901956 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-777d5512-6bfe-42b3-9543-ad689bca9380 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:56:56.911871 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-777d5512-6bfe-42b3-9543-ad689bca9380 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:56:56.916193 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2816/5485] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:56:56 2022] GET /compute/v2.1/servers/9a23c683-ac2a-4bd1-98c4-7675499569bc => generated 1527 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:56:56.927886 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-5a827b28-ba4a-4481-ac2e-51d2df282fca req-a83cda2f-11d6-4893-b1dc-d6cfc9ce57be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49112e3f-73fc-4ee9-b48e-bcda5b7dcda7", "name": "network-vif-unplugged", "status": "completed", "tag": "faa157e1-e76c-4be9-8480-61d19f273bad"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:56:56.929601 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-777d5512-6bfe-42b3-9543-ad689bca9380 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:56:56.939928 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-777d5512-6bfe-42b3-9543-ad689bca9380 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] 10.222.0.33 "GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7" status: 200 len: 2910 microversion: 2.32 time: 0.558904 Sep 23 04:56:56.941080 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2670/5486] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:56:56 2022] GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 => generated 2910 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:56:56.973201 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-5a827b28-ba4a-4481-ac2e-51d2df282fca req-a83cda2f-11d6-4893-b1dc-d6cfc9ce57be service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:56.975163 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-5a827b28-ba4a-4481-ac2e-51d2df282fca req-a83cda2f-11d6-4893-b1dc-d6cfc9ce57be service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:56.976972 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-5a827b28-ba4a-4481-ac2e-51d2df282fca req-a83cda2f-11d6-4893-b1dc-d6cfc9ce57be service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:57.003939 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-5a827b28-ba4a-4481-ac2e-51d2df282fca req-a83cda2f-11d6-4893-b1dc-d6cfc9ce57be service nova] Creating event network-vif-unplugged:faa157e1-e76c-4be9-8480-61d19f273bad for instance 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 on n-h2-846463-3 Sep 23 04:56:57.015427 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-5a827b28-ba4a-4481-ac2e-51d2df282fca req-a83cda2f-11d6-4893-b1dc-d6cfc9ce57be service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.098332 Sep 23 04:56:57.017877 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2817/5487] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:56:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:56:57.928668 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d6b297f4-2de5-4914-b408-0687136fb558 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:57.931911 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d6b297f4-2de5-4914-b408-0687136fb558 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] [instance: 9a23c683-ac2a-4bd1-98c4-7675499569bc] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:57.960980 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d6b297f4-2de5-4914-b408-0687136fb558 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:57.961818 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d6b297f4-2de5-4914-b408-0687136fb558 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:57.962548 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d6b297f4-2de5-4914-b408-0687136fb558 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:57.963918 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d6b297f4-2de5-4914-b408-0687136fb558 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:57.965012 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d6b297f4-2de5-4914-b408-0687136fb558 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:57.966117 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d6b297f4-2de5-4914-b408-0687136fb558 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:57.971194 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-593465ce-5f0d-4fbf-ac17-472fbdc0542c tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:57.971903 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-593465ce-5f0d-4fbf-ac17-472fbdc0542c tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] [instance: 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:57.984989 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-593465ce-5f0d-4fbf-ac17-472fbdc0542c tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:57.987908 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-593465ce-5f0d-4fbf-ac17-472fbdc0542c tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:57.988609 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-593465ce-5f0d-4fbf-ac17-472fbdc0542c tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:57.993639 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-593465ce-5f0d-4fbf-ac17-472fbdc0542c tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:57.994416 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-593465ce-5f0d-4fbf-ac17-472fbdc0542c tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:57.995069 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-593465ce-5f0d-4fbf-ac17-472fbdc0542c tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:58.770075 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-593465ce-5f0d-4fbf-ac17-472fbdc0542c tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:56:58.785319 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-593465ce-5f0d-4fbf-ac17-472fbdc0542c tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:56:58.787575 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-593465ce-5f0d-4fbf-ac17-472fbdc0542c tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:56:58.793078 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-593465ce-5f0d-4fbf-ac17-472fbdc0542c tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] 10.222.0.33 "GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7" status: 200 len: 2863 microversion: 2.32 time: 0.823057 Sep 23 04:56:58.793078 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2818/5488] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:56:57 2022] GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 => generated 2863 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:56:58.796071 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-d62a2c93-f268-41d4-bc92-5707a53bd7fe req-8f6af941-354e-4282-95f8-a4b9cf06b40e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49112e3f-73fc-4ee9-b48e-bcda5b7dcda7", "name": "network-vif-deleted", "tag": "faa157e1-e76c-4be9-8480-61d19f273bad"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:56:58.807434 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-d62a2c93-f268-41d4-bc92-5707a53bd7fe req-8f6af941-354e-4282-95f8-a4b9cf06b40e service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:58.808040 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-d62a2c93-f268-41d4-bc92-5707a53bd7fe req-8f6af941-354e-4282-95f8-a4b9cf06b40e service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:58.808608 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-d62a2c93-f268-41d4-bc92-5707a53bd7fe req-8f6af941-354e-4282-95f8-a4b9cf06b40e service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:58.822433 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-d62a2c93-f268-41d4-bc92-5707a53bd7fe req-8f6af941-354e-4282-95f8-a4b9cf06b40e service nova] Creating event network-vif-deleted:faa157e1-e76c-4be9-8480-61d19f273bad for instance 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 on n-h2-846463-3 Sep 23 04:56:58.831522 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d6b297f4-2de5-4914-b408-0687136fb558 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0609d0a0d9243a2b205bf03b9baf254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1e75cfbb9e4ca79c46921d444ca761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:56:58.838524 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-d62a2c93-f268-41d4-bc92-5707a53bd7fe req-8f6af941-354e-4282-95f8-a4b9cf06b40e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046790 Sep 23 04:56:58.845068 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2819/5489] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:56:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:56:58.845385 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d6b297f4-2de5-4914-b408-0687136fb558 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] 10.222.0.33 "GET /compute/v2.1/servers/9a23c683-ac2a-4bd1-98c4-7675499569bc" status: 200 len: 1527 microversion: 2.1 time: 0.918961 Sep 23 04:56:58.859801 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2671/5490] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:56:57 2022] GET /compute/v2.1/servers/9a23c683-ac2a-4bd1-98c4-7675499569bc => generated 1527 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:56:59.080856 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-a3d27759-7be9-4112-83be-0176b96a1fa8 req-869e60c7-5efe-4773-af8c-857d2cc383ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49112e3f-73fc-4ee9-b48e-bcda5b7dcda7", "name": "network-vif-unplugged", "status": "completed", "tag": "16397cd8-7ed4-4825-8440-b6d39557eb3f"}, {"server_uuid": "49112e3f-73fc-4ee9-b48e-bcda5b7dcda7", "name": "network-vif-unplugged", "status": "completed", "tag": "7526a24d-5fba-4653-bde4-13d72cf5232a"}, {"server_uuid": "49112e3f-73fc-4ee9-b48e-bcda5b7dcda7", "name": "network-vif-unplugged", "status": "completed", "tag": "8231c7d3-a7f9-4daf-87f5-be07473f366a"}, {"server_uuid": "49112e3f-73fc-4ee9-b48e-bcda5b7dcda7", "name": "network-vif-unplugged", "status": "completed", "tag": "462c3500-e3b1-4869-99f4-aeaa9293fea3"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:56:59.109021 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-a3d27759-7be9-4112-83be-0176b96a1fa8 req-869e60c7-5efe-4773-af8c-857d2cc383ad service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:59.109691 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-a3d27759-7be9-4112-83be-0176b96a1fa8 req-869e60c7-5efe-4773-af8c-857d2cc383ad service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:59.110822 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-a3d27759-7be9-4112-83be-0176b96a1fa8 req-869e60c7-5efe-4773-af8c-857d2cc383ad service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:59.127175 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-a3d27759-7be9-4112-83be-0176b96a1fa8 req-869e60c7-5efe-4773-af8c-857d2cc383ad service nova] Creating event network-vif-unplugged:16397cd8-7ed4-4825-8440-b6d39557eb3f for instance 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 on n-h2-846463-3 Sep 23 04:56:59.128044 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-a3d27759-7be9-4112-83be-0176b96a1fa8 req-869e60c7-5efe-4773-af8c-857d2cc383ad service nova] Creating event network-vif-unplugged:7526a24d-5fba-4653-bde4-13d72cf5232a for instance 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 on n-h2-846463-3 Sep 23 04:56:59.130434 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-a3d27759-7be9-4112-83be-0176b96a1fa8 req-869e60c7-5efe-4773-af8c-857d2cc383ad service nova] Creating event network-vif-unplugged:8231c7d3-a7f9-4daf-87f5-be07473f366a for instance 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 on n-h2-846463-3 Sep 23 04:56:59.132034 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-a3d27759-7be9-4112-83be-0176b96a1fa8 req-869e60c7-5efe-4773-af8c-857d2cc383ad service nova] Creating event network-vif-unplugged:462c3500-e3b1-4869-99f4-aeaa9293fea3 for instance 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 on n-h2-846463-3 Sep 23 04:56:59.141297 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-a3d27759-7be9-4112-83be-0176b96a1fa8 req-869e60c7-5efe-4773-af8c-857d2cc383ad service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 704 microversion: 2.1 time: 0.066375 Sep 23 04:56:59.143656 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2820/5491] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:56:59 2022] POST /compute/v2.1/os-server-external-events => generated 704 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:56:59.818103 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4be194a0-cde0-48c4-91f9-4cada79477b9 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:59.819022 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4be194a0-cde0-48c4-91f9-4cada79477b9 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] [instance: 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:59.836298 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4be194a0-cde0-48c4-91f9-4cada79477b9 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:59.837039 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4be194a0-cde0-48c4-91f9-4cada79477b9 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:59.837671 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4be194a0-cde0-48c4-91f9-4cada79477b9 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:59.840232 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4be194a0-cde0-48c4-91f9-4cada79477b9 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:59.840911 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4be194a0-cde0-48c4-91f9-4cada79477b9 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:59.841427 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4be194a0-cde0-48c4-91f9-4cada79477b9 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:59.872995 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f5cc8e36-e1f1-4749-9920-650233197293 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:56:59.873881 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f5cc8e36-e1f1-4749-9920-650233197293 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] [instance: 9a23c683-ac2a-4bd1-98c4-7675499569bc] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:56:59.889389 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f5cc8e36-e1f1-4749-9920-650233197293 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:59.891053 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f5cc8e36-e1f1-4749-9920-650233197293 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:59.892581 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f5cc8e36-e1f1-4749-9920-650233197293 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:59.896349 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f5cc8e36-e1f1-4749-9920-650233197293 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:59.896349 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f5cc8e36-e1f1-4749-9920-650233197293 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:59.896349 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f5cc8e36-e1f1-4749-9920-650233197293 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:59.934649 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f5cc8e36-e1f1-4749-9920-650233197293 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:56:59.938052 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f5cc8e36-e1f1-4749-9920-650233197293 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:56:59.939391 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f5cc8e36-e1f1-4749-9920-650233197293 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:56:59.940056 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-f5cc8e36-e1f1-4749-9920-650233197293 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Lazy-loading 'fault' on Instance uuid 9a23c683-ac2a-4bd1-98c4-7675499569bc {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:57:00.059172 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f5cc8e36-e1f1-4749-9920-650233197293 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0609d0a0d9243a2b205bf03b9baf254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1e75cfbb9e4ca79c46921d444ca761', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:00.068666 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f5cc8e36-e1f1-4749-9920-650233197293 tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] 10.222.0.33 "GET /compute/v2.1/servers/9a23c683-ac2a-4bd1-98c4-7675499569bc" status: 200 len: 1315 microversion: 2.1 time: 0.200838 Sep 23 04:57:00.069655 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2821/5492] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:56:59 2022] GET /compute/v2.1/servers/9a23c683-ac2a-4bd1-98c4-7675499569bc => generated 1315 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:57:00.248381 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4be194a0-cde0-48c4-91f9-4cada79477b9 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:00.271012 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4be194a0-cde0-48c4-91f9-4cada79477b9 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:00.303941 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4be194a0-cde0-48c4-91f9-4cada79477b9 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:00.310287 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4be194a0-cde0-48c4-91f9-4cada79477b9 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] 10.222.0.33 "GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7" status: 200 len: 2702 microversion: 2.32 time: 0.497222 Sep 23 04:57:00.311463 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2672/5493] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:56:59 2022] GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 => generated 2702 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:57:00.927085 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-a15ea72b-5b17-42f2-8961-e53030c93d68 req-072a1601-8a59-4b0a-9117-de063de9240a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a23c683-ac2a-4bd1-98c4-7675499569bc", "name": "network-vif-deleted", "tag": "0cadc710-c30f-4cb6-b62b-b24eb7fa52be"}, {"server_uuid": "49112e3f-73fc-4ee9-b48e-bcda5b7dcda7", "name": "network-vif-deleted", "tag": "462c3500-e3b1-4869-99f4-aeaa9293fea3"}, {"server_uuid": "49112e3f-73fc-4ee9-b48e-bcda5b7dcda7", "name": "network-vif-deleted", "tag": "16397cd8-7ed4-4825-8440-b6d39557eb3f"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:57:00.939629 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-a15ea72b-5b17-42f2-8961-e53030c93d68 req-072a1601-8a59-4b0a-9117-de063de9240a service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:00.940185 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-a15ea72b-5b17-42f2-8961-e53030c93d68 req-072a1601-8a59-4b0a-9117-de063de9240a service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:00.941573 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-a15ea72b-5b17-42f2-8961-e53030c93d68 req-072a1601-8a59-4b0a-9117-de063de9240a service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:00.958428 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-a15ea72b-5b17-42f2-8961-e53030c93d68 req-072a1601-8a59-4b0a-9117-de063de9240a service nova] Creating event network-vif-deleted:0cadc710-c30f-4cb6-b62b-b24eb7fa52be for instance 9a23c683-ac2a-4bd1-98c4-7675499569bc on n-h1-846463-3 Sep 23 04:57:00.958976 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-a15ea72b-5b17-42f2-8961-e53030c93d68 req-072a1601-8a59-4b0a-9117-de063de9240a service nova] Creating event network-vif-deleted:462c3500-e3b1-4869-99f4-aeaa9293fea3 for instance 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 on n-h2-846463-3 Sep 23 04:57:00.959479 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-a15ea72b-5b17-42f2-8961-e53030c93d68 req-072a1601-8a59-4b0a-9117-de063de9240a service nova] Creating event network-vif-deleted:16397cd8-7ed4-4825-8440-b6d39557eb3f for instance 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 on n-h2-846463-3 Sep 23 04:57:00.968924 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-a15ea72b-5b17-42f2-8961-e53030c93d68 req-072a1601-8a59-4b0a-9117-de063de9240a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.045342 Sep 23 04:57:00.970255 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2822/5494] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:57:00 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:57:01.092801 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b28e3aed-b249-412a-9115-6e7f55080ffa tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:01.093416 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b28e3aed-b249-412a-9115-6e7f55080ffa tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] [instance: 9a23c683-ac2a-4bd1-98c4-7675499569bc] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:01.101452 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b28e3aed-b249-412a-9115-6e7f55080ffa tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:01.101972 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b28e3aed-b249-412a-9115-6e7f55080ffa tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:01.102500 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b28e3aed-b249-412a-9115-6e7f55080ffa tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:01.103417 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b28e3aed-b249-412a-9115-6e7f55080ffa tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:01.103891 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b28e3aed-b249-412a-9115-6e7f55080ffa tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:01.104320 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b28e3aed-b249-412a-9115-6e7f55080ffa tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:01.123157 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-b28e3aed-b249-412a-9115-6e7f55080ffa tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] HTTP exception thrown: Instance 9a23c683-ac2a-4bd1-98c4-7675499569bc could not be found. Sep 23 04:57:01.125200 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b28e3aed-b249-412a-9115-6e7f55080ffa tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Request method failure captured: Sep 23 04:57:01.125200 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/9a23c683-ac2a-4bd1-98c4-7675499569bc HTTP/1.1 Sep 23 04:57:01.125200 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:57:01.125200 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:57:01.125200 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:57:01.125200 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:57:01.125200 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:57:01.125200 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:57:01.125200 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:57:01.125200 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:57:01.125200 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTyAzo61sMNBDaUb7o4CbY0pTGFLcOmRfkE94WKI_-h0EsGPxbvgjm-VoTQu32vV42Bd37rJDpf_mAdQ8nwEN6J1xRGEWnWu3OAjHePgmaddFl6kaSWYAruAdwXXfKziod2H5nsX-8-nl2cD7iaN8PlKK2z2_TVvPOmVU6tkr3a-W9Q Sep 23 04:57:01.125200 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:57:01.125200 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:57:01.125200 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:57:01.125200 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:57:01.125200 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:57:01.125200 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:57:01.125200 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 3f1e75cfbb9e4ca79c46921d444ca761 Sep 23 04:57:01.125200 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-253815714 Sep 23 04:57:01.125200 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:57:01.125200 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:57:01.125200 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3f1e75cfbb9e4ca79c46921d444ca761", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3f1e75cfbb9e4ca79c46921d444ca761"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3f1e75cfbb9e4ca79c46921d444ca761"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3f1e75cfbb9e4ca79c46921d444ca761"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:57:01.125200 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-253815714 Sep 23 04:57:01.125200 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 3f1e75cfbb9e4ca79c46921d444ca761 Sep 23 04:57:01.125200 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-253815714 Sep 23 04:57:01.125200 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ServerAddressesNegativeTestJSON-253815714-project Sep 23 04:57:01.125200 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:57:01.125200 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:57:01.125200 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: c0609d0a0d9243a2b205bf03b9baf254 Sep 23 04:57:01.125200 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-253815714-project Sep 23 04:57:01.125200 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:57:01.125200 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 9a23c683-ac2a-4bd1-98c4-7675499569bc could not be found. Sep 23 04:57:01.125200 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '9a23c683-ac2a-4bd1-98c4-7675499569bc'} Sep 23 04:57:01.125200 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:57:01.125200 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:57:01.125200 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:57:01.125200 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:57:01.125200 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:57:01.125200 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:57:01.125200 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:57:01.125200 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:57:01.125200 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:57:01.125200 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:57:01.125200 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a23c683-ac2a-4bd1-98c4-7675499569bc could not be found. Sep 23 04:57:01.125200 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:57:01.125200 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:57:01.125200 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:57:01.125200 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:57:01.125200 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:57:01.125200 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:57:01.125200 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:57:01.125200 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:57:01.125200 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:57:01.125200 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:57:01.125200 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:57:01.125200 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:57:01.125200 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:57:01.125200 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:57:01.125200 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:57:01.125200 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:57:01.125200 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a23c683-ac2a-4bd1-98c4-7675499569bc could not be found. Sep 23 04:57:01.125200 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:57:01.125200 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:57:01.130502 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:57:01.130502 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:57:01.130502 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:57:01.130502 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:57:01.130502 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:57:01.130502 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:57:01.130502 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a23c683-ac2a-4bd1-98c4-7675499569bc could not be found. Sep 23 04:57:01.130502 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:57:01.132584 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b28e3aed-b249-412a-9115-6e7f55080ffa tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] Returning 404 to user: Instance 9a23c683-ac2a-4bd1-98c4-7675499569bc could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:57:01.133917 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b28e3aed-b249-412a-9115-6e7f55080ffa tempest-ServerAddressesNegativeTestJSON-253815714 tempest-ServerAddressesNegativeTestJSON-253815714-project] 10.222.0.33 "GET /compute/v2.1/servers/9a23c683-ac2a-4bd1-98c4-7675499569bc" status: 404 len: 111 microversion: 2.1 time: 0.045103 Sep 23 04:57:01.139284 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2673/5495] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:57:01 2022] GET /compute/v2.1/servers/9a23c683-ac2a-4bd1-98c4-7675499569bc => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:57:01.344074 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-82506b24-ada2-45a7-a27c-dd6a2760a554 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:01.345004 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-82506b24-ada2-45a7-a27c-dd6a2760a554 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] [instance: 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:01.356819 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-82506b24-ada2-45a7-a27c-dd6a2760a554 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:01.357731 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-82506b24-ada2-45a7-a27c-dd6a2760a554 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:01.358572 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-82506b24-ada2-45a7-a27c-dd6a2760a554 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:01.359552 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-82506b24-ada2-45a7-a27c-dd6a2760a554 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:01.360239 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-82506b24-ada2-45a7-a27c-dd6a2760a554 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:01.360858 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-82506b24-ada2-45a7-a27c-dd6a2760a554 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:01.894647 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-82506b24-ada2-45a7-a27c-dd6a2760a554 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:01.908770 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-82506b24-ada2-45a7-a27c-dd6a2760a554 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:01.911192 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-82506b24-ada2-45a7-a27c-dd6a2760a554 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:01.912793 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-82506b24-ada2-45a7-a27c-dd6a2760a554 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] 10.222.0.33 "GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7" status: 200 len: 2385 microversion: 2.32 time: 0.573321 Sep 23 04:57:01.918490 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2823/5496] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:57:01 2022] GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 => generated 2385 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:57:02.943868 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e9659293-bafd-42c2-aeb9-d4aa970db4fb tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:02.945154 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e9659293-bafd-42c2-aeb9-d4aa970db4fb tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] [instance: 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:02.961024 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e9659293-bafd-42c2-aeb9-d4aa970db4fb tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:02.961238 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e9659293-bafd-42c2-aeb9-d4aa970db4fb tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:02.961692 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e9659293-bafd-42c2-aeb9-d4aa970db4fb tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:02.965090 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e9659293-bafd-42c2-aeb9-d4aa970db4fb tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:02.965790 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e9659293-bafd-42c2-aeb9-d4aa970db4fb tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:02.967531 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e9659293-bafd-42c2-aeb9-d4aa970db4fb tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:03.033169 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-e65f936c-029b-4335-87f3-eac0cc3b7acf req-5d8e07a6-bf43-4715-a817-5f975b51576e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49112e3f-73fc-4ee9-b48e-bcda5b7dcda7", "name": "network-vif-deleted", "tag": "8231c7d3-a7f9-4daf-87f5-be07473f366a"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:57:03.050011 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-e65f936c-029b-4335-87f3-eac0cc3b7acf req-5d8e07a6-bf43-4715-a817-5f975b51576e service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:03.050514 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-e65f936c-029b-4335-87f3-eac0cc3b7acf req-5d8e07a6-bf43-4715-a817-5f975b51576e service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:03.050956 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-e65f936c-029b-4335-87f3-eac0cc3b7acf req-5d8e07a6-bf43-4715-a817-5f975b51576e service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:03.071307 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-e65f936c-029b-4335-87f3-eac0cc3b7acf req-5d8e07a6-bf43-4715-a817-5f975b51576e service nova] Creating event network-vif-deleted:8231c7d3-a7f9-4daf-87f5-be07473f366a for instance 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 on n-h2-846463-3 Sep 23 04:57:03.094657 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-e65f936c-029b-4335-87f3-eac0cc3b7acf req-5d8e07a6-bf43-4715-a817-5f975b51576e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060492 Sep 23 04:57:03.095697 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2824/5497] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:57:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:57:03.590786 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e9659293-bafd-42c2-aeb9-d4aa970db4fb tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:03.601347 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e9659293-bafd-42c2-aeb9-d4aa970db4fb tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:03.608914 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e9659293-bafd-42c2-aeb9-d4aa970db4fb tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:03.611843 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e9659293-bafd-42c2-aeb9-d4aa970db4fb tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] 10.222.0.33 "GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7" status: 200 len: 2338 microversion: 2.32 time: 0.673505 Sep 23 04:57:03.626664 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2674/5498] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:57:02 2022] GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 => generated 2338 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:57:04.647749 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4b8eb0eb-3922-461e-990d-8ba57384dbc9 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:04.650393 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4b8eb0eb-3922-461e-990d-8ba57384dbc9 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] [instance: 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:04.689839 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4b8eb0eb-3922-461e-990d-8ba57384dbc9 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:04.690799 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4b8eb0eb-3922-461e-990d-8ba57384dbc9 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:04.692995 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4b8eb0eb-3922-461e-990d-8ba57384dbc9 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:04.697709 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4b8eb0eb-3922-461e-990d-8ba57384dbc9 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:04.700841 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4b8eb0eb-3922-461e-990d-8ba57384dbc9 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:04.702354 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4b8eb0eb-3922-461e-990d-8ba57384dbc9 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:05.206602 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-e7fc12c8-03da-46c5-a317-523b3ad50370 req-f4965483-9546-4def-87ce-dd1ddd236650 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49112e3f-73fc-4ee9-b48e-bcda5b7dcda7", "name": "network-vif-deleted", "tag": "7526a24d-5fba-4653-bde4-13d72cf5232a"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:57:05.220827 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-e7fc12c8-03da-46c5-a317-523b3ad50370 req-f4965483-9546-4def-87ce-dd1ddd236650 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:05.229023 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-e7fc12c8-03da-46c5-a317-523b3ad50370 req-f4965483-9546-4def-87ce-dd1ddd236650 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:05.230681 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-e7fc12c8-03da-46c5-a317-523b3ad50370 req-f4965483-9546-4def-87ce-dd1ddd236650 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:05.272275 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-e7fc12c8-03da-46c5-a317-523b3ad50370 req-f4965483-9546-4def-87ce-dd1ddd236650 service nova] Creating event network-vif-deleted:7526a24d-5fba-4653-bde4-13d72cf5232a for instance 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 on n-h2-846463-3 Sep 23 04:57:05.288938 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-e7fc12c8-03da-46c5-a317-523b3ad50370 req-f4965483-9546-4def-87ce-dd1ddd236650 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089813 Sep 23 04:57:05.296928 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2675/5499] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:57:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:57:05.851794 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-4b8eb0eb-3922-461e-990d-8ba57384dbc9 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:05.867942 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-4b8eb0eb-3922-461e-990d-8ba57384dbc9 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:05.873317 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-4b8eb0eb-3922-461e-990d-8ba57384dbc9 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:05.878903 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4b8eb0eb-3922-461e-990d-8ba57384dbc9 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] 10.222.0.33 "GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7" status: 200 len: 1603 microversion: 2.32 time: 1.235529 Sep 23 04:57:05.894649 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2825/5500] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:57:04 2022] GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 => generated 1603 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:57:06.911076 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5559100a-5905-4566-ab4e-20cfca486271 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:06.911783 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5559100a-5905-4566-ab4e-20cfca486271 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] [instance: 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:06.941941 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5559100a-5905-4566-ab4e-20cfca486271 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:06.944269 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5559100a-5905-4566-ab4e-20cfca486271 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:06.946443 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5559100a-5905-4566-ab4e-20cfca486271 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:06.947459 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5559100a-5905-4566-ab4e-20cfca486271 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:06.960969 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-65119f0d-4635-43ee-b304-1f5b60869854 tempest-TestNetworkAdvancedServerOps-1586243358 tempest-TestNetworkAdvancedServerOps-1586243358-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:06.962285 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-65119f0d-4635-43ee-b304-1f5b60869854 tempest-TestNetworkAdvancedServerOps-1586243358 tempest-TestNetworkAdvancedServerOps-1586243358-project-admin] [instance: 9bd2c0e2-8256-484a-bbd5-f21743724671] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:06.966729 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5559100a-5905-4566-ab4e-20cfca486271 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:06.968378 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5559100a-5905-4566-ab4e-20cfca486271 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:06.975906 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-65119f0d-4635-43ee-b304-1f5b60869854 tempest-TestNetworkAdvancedServerOps-1586243358 tempest-TestNetworkAdvancedServerOps-1586243358-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:06.981270 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-65119f0d-4635-43ee-b304-1f5b60869854 tempest-TestNetworkAdvancedServerOps-1586243358 tempest-TestNetworkAdvancedServerOps-1586243358-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:06.983064 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-65119f0d-4635-43ee-b304-1f5b60869854 tempest-TestNetworkAdvancedServerOps-1586243358 tempest-TestNetworkAdvancedServerOps-1586243358-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:06.987329 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-65119f0d-4635-43ee-b304-1f5b60869854 tempest-TestNetworkAdvancedServerOps-1586243358 tempest-TestNetworkAdvancedServerOps-1586243358-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:06.990168 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-65119f0d-4635-43ee-b304-1f5b60869854 tempest-TestNetworkAdvancedServerOps-1586243358 tempest-TestNetworkAdvancedServerOps-1586243358-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:06.993487 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-65119f0d-4635-43ee-b304-1f5b60869854 tempest-TestNetworkAdvancedServerOps-1586243358 tempest-TestNetworkAdvancedServerOps-1586243358-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:07.060511 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:57:07.225423 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-5559100a-5905-4566-ab4e-20cfca486271 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:07.255571 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-5559100a-5905-4566-ab4e-20cfca486271 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:07.257349 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-5559100a-5905-4566-ab4e-20cfca486271 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:07.264715 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5559100a-5905-4566-ab4e-20cfca486271 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] 10.222.0.33 "GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7" status: 200 len: 1603 microversion: 2.32 time: 0.355760 Sep 23 04:57:07.265346 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2676/5501] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:57:06 2022] GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 => generated 1603 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:57:07.465748 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-65119f0d-4635-43ee-b304-1f5b60869854 tempest-TestNetworkAdvancedServerOps-1586243358 tempest-TestNetworkAdvancedServerOps-1586243358-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671" status: 200 len: 1831 microversion: 2.1 time: 0.504734 Sep 23 04:57:07.483382 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2826/5502] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:57:06 2022] GET /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671 => generated 1831 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:57:07.490432 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-544b1c08-b4c9-4821-bc46-b39fd2d39762 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:07.491344 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-544b1c08-b4c9-4821-bc46-b39fd2d39762 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 9bd2c0e2-8256-484a-bbd5-f21743724671] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:07.501295 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-544b1c08-b4c9-4821-bc46-b39fd2d39762 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:07.501295 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-544b1c08-b4c9-4821-bc46-b39fd2d39762 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:07.501295 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-544b1c08-b4c9-4821-bc46-b39fd2d39762 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:07.501295 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-544b1c08-b4c9-4821-bc46-b39fd2d39762 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:07.501295 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-544b1c08-b4c9-4821-bc46-b39fd2d39762 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:07.501295 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-544b1c08-b4c9-4821-bc46-b39fd2d39762 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:07.780231 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-544b1c08-b4c9-4821-bc46-b39fd2d39762 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:07.794340 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-544b1c08-b4c9-4821-bc46-b39fd2d39762 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671" status: 200 len: 1680 microversion: 2.1 time: 0.307125 Sep 23 04:57:07.799714 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2677/5503] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:57:07 2022] GET /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671 => generated 1680 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:57:08.064870 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f651ee4d-b7c7-4136-86b4-535fefc2eb34 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:57:08.067274 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f651ee4d-b7c7-4136-86b4-535fefc2eb34 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 9bd2c0e2-8256-484a-bbd5-f21743724671] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:08.076917 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f651ee4d-b7c7-4136-86b4-535fefc2eb34 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:08.082412 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f651ee4d-b7c7-4136-86b4-535fefc2eb34 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:08.083130 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f651ee4d-b7c7-4136-86b4-535fefc2eb34 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:08.085374 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f651ee4d-b7c7-4136-86b4-535fefc2eb34 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:08.087670 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f651ee4d-b7c7-4136-86b4-535fefc2eb34 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:08.088805 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f651ee4d-b7c7-4136-86b4-535fefc2eb34 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:08.180682 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f651ee4d-b7c7-4136-86b4-535fefc2eb34 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "POST /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671/action" status: 200 len: 32638 microversion: 2.1 time: 0.120155 Sep 23 04:57:08.184631 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2827/5504] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:57:08 2022] POST /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671/action => generated 32638 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 04:57:08.302956 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0c386ce7-d69f-4073-9ca4-7132bfbdc94a tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:08.308120 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-0c386ce7-d69f-4073-9ca4-7132bfbdc94a tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] [instance: 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:08.316708 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0c386ce7-d69f-4073-9ca4-7132bfbdc94a tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:08.317631 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0c386ce7-d69f-4073-9ca4-7132bfbdc94a tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:08.318962 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0c386ce7-d69f-4073-9ca4-7132bfbdc94a tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:08.319953 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0c386ce7-d69f-4073-9ca4-7132bfbdc94a tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:08.320661 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0c386ce7-d69f-4073-9ca4-7132bfbdc94a tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:08.321334 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0c386ce7-d69f-4073-9ca4-7132bfbdc94a tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:08.338959 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-52834214-7d0b-475c-bf60-ea3be7c7dd73 tempest-TestNetworkAdvancedServerOps-1586243358 tempest-TestNetworkAdvancedServerOps-1586243358-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:57:08.341104 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-52834214-7d0b-475c-bf60-ea3be7c7dd73 tempest-TestNetworkAdvancedServerOps-1586243358 tempest-TestNetworkAdvancedServerOps-1586243358-project-admin] [instance: 9bd2c0e2-8256-484a-bbd5-f21743724671] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:08.363689 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-52834214-7d0b-475c-bf60-ea3be7c7dd73 tempest-TestNetworkAdvancedServerOps-1586243358 tempest-TestNetworkAdvancedServerOps-1586243358-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:08.364215 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-52834214-7d0b-475c-bf60-ea3be7c7dd73 tempest-TestNetworkAdvancedServerOps-1586243358 tempest-TestNetworkAdvancedServerOps-1586243358-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:08.367495 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-52834214-7d0b-475c-bf60-ea3be7c7dd73 tempest-TestNetworkAdvancedServerOps-1586243358 tempest-TestNetworkAdvancedServerOps-1586243358-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:08.368319 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-52834214-7d0b-475c-bf60-ea3be7c7dd73 tempest-TestNetworkAdvancedServerOps-1586243358 tempest-TestNetworkAdvancedServerOps-1586243358-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:08.371764 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-52834214-7d0b-475c-bf60-ea3be7c7dd73 tempest-TestNetworkAdvancedServerOps-1586243358 tempest-TestNetworkAdvancedServerOps-1586243358-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:08.372543 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-52834214-7d0b-475c-bf60-ea3be7c7dd73 tempest-TestNetworkAdvancedServerOps-1586243358 tempest-TestNetworkAdvancedServerOps-1586243358-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:08.492773 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-52834214-7d0b-475c-bf60-ea3be7c7dd73 tempest-TestNetworkAdvancedServerOps-1586243358 tempest-TestNetworkAdvancedServerOps-1586243358-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '8d8531be725e4b06abd7f3763eb1f4c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e64a2c6291604a0b842352a8ecfe35c3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:08.493356 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-52834214-7d0b-475c-bf60-ea3be7c7dd73 tempest-TestNetworkAdvancedServerOps-1586243358 tempest-TestNetworkAdvancedServerOps-1586243358-project-admin] [instance: 9bd2c0e2-8256-484a-bbd5-f21743724671] flavor_id is None. Assuming migration. {{(pid=122699) resize /opt/stack/nova/nova/compute/api.py:4196}} Sep 23 04:57:08.499150 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-52834214-7d0b-475c-bf60-ea3be7c7dd73 tempest-TestNetworkAdvancedServerOps-1586243358 tempest-TestNetworkAdvancedServerOps-1586243358-project-admin] [instance: 9bd2c0e2-8256-484a-bbd5-f21743724671] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122699) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 23 04:57:08.664405 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-0c386ce7-d69f-4073-9ca4-7132bfbdc94a tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:08.673279 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=100 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:57:08.689712 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-0c386ce7-d69f-4073-9ca4-7132bfbdc94a tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:08.698188 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-0c386ce7-d69f-4073-9ca4-7132bfbdc94a tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:08.706460 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0c386ce7-d69f-4073-9ca4-7132bfbdc94a tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] 10.222.0.33 "GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7" status: 200 len: 1603 microversion: 2.32 time: 0.415805 Sep 23 04:57:08.707058 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2678/5505] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:57:08 2022] GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 => generated 1603 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:57:08.940220 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-52834214-7d0b-475c-bf60-ea3be7c7dd73 tempest-TestNetworkAdvancedServerOps-1586243358 tempest-TestNetworkAdvancedServerOps-1586243358-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671/action" status: 202 len: 0 microversion: 2.1 time: 0.607485 Sep 23 04:57:08.950256 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2828/5506] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:57:08 2022] POST /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671/action => generated 0 bytes in 624 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 23 04:57:08.960012 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f2243730-172a-4684-9867-5f89b0a76d86 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:08.960981 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f2243730-172a-4684-9867-5f89b0a76d86 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 9bd2c0e2-8256-484a-bbd5-f21743724671] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:08.972174 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f2243730-172a-4684-9867-5f89b0a76d86 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:08.984004 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f2243730-172a-4684-9867-5f89b0a76d86 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:08.984698 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f2243730-172a-4684-9867-5f89b0a76d86 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:08.986535 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f2243730-172a-4684-9867-5f89b0a76d86 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:08.987906 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f2243730-172a-4684-9867-5f89b0a76d86 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:08.990122 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f2243730-172a-4684-9867-5f89b0a76d86 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:09.676642 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f2243730-172a-4684-9867-5f89b0a76d86 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:09.710626 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f2243730-172a-4684-9867-5f89b0a76d86 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671" status: 200 len: 1689 microversion: 2.1 time: 0.754877 Sep 23 04:57:09.713434 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2679/5507] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:57:08 2022] GET /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671 => generated 1689 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:57:09.733192 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d7200640-2c5d-4f2b-88df-c309311aa5e4 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:09.734634 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d7200640-2c5d-4f2b-88df-c309311aa5e4 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] [instance: 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:09.747176 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d7200640-2c5d-4f2b-88df-c309311aa5e4 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:09.758194 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d7200640-2c5d-4f2b-88df-c309311aa5e4 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:09.763201 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d7200640-2c5d-4f2b-88df-c309311aa5e4 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:09.767778 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d7200640-2c5d-4f2b-88df-c309311aa5e4 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:09.771563 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d7200640-2c5d-4f2b-88df-c309311aa5e4 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:09.774362 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d7200640-2c5d-4f2b-88df-c309311aa5e4 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:10.195265 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d7200640-2c5d-4f2b-88df-c309311aa5e4 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:10.212209 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d7200640-2c5d-4f2b-88df-c309311aa5e4 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:10.212209 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d7200640-2c5d-4f2b-88df-c309311aa5e4 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:10.213803 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d7200640-2c5d-4f2b-88df-c309311aa5e4 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] 10.222.0.33 "GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7" status: 200 len: 1603 microversion: 2.32 time: 0.485554 Sep 23 04:57:10.224202 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2829/5508] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:57:09 2022] GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 => generated 1603 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:57:10.737076 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c73484e2-5f13-4fd0-ba59-c8ec53bb4282 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:10.738596 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c73484e2-5f13-4fd0-ba59-c8ec53bb4282 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 9bd2c0e2-8256-484a-bbd5-f21743724671] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:10.753085 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c73484e2-5f13-4fd0-ba59-c8ec53bb4282 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:10.753878 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c73484e2-5f13-4fd0-ba59-c8ec53bb4282 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:10.755674 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c73484e2-5f13-4fd0-ba59-c8ec53bb4282 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:10.756821 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c73484e2-5f13-4fd0-ba59-c8ec53bb4282 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:10.760871 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c73484e2-5f13-4fd0-ba59-c8ec53bb4282 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:10.761816 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c73484e2-5f13-4fd0-ba59-c8ec53bb4282 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:11.284148 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-aff36f08-caee-4711-a68d-c5068e67981a tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:11.288503 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-aff36f08-caee-4711-a68d-c5068e67981a tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] [instance: 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:11.321375 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:57:11.329467 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aff36f08-caee-4711-a68d-c5068e67981a tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:11.330250 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aff36f08-caee-4711-a68d-c5068e67981a tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:11.332904 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aff36f08-caee-4711-a68d-c5068e67981a tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:11.335982 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aff36f08-caee-4711-a68d-c5068e67981a tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:11.336793 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aff36f08-caee-4711-a68d-c5068e67981a tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:11.337451 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aff36f08-caee-4711-a68d-c5068e67981a tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:11.556908 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c73484e2-5f13-4fd0-ba59-c8ec53bb4282 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:11.562721 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c73484e2-5f13-4fd0-ba59-c8ec53bb4282 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671" status: 200 len: 1689 microversion: 2.1 time: 0.830473 Sep 23 04:57:11.564106 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2680/5509] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:57:10 2022] GET /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671 => generated 1689 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:57:11.587972 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-aff36f08-caee-4711-a68d-c5068e67981a tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:11.619564 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-aff36f08-caee-4711-a68d-c5068e67981a tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:11.626350 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-aff36f08-caee-4711-a68d-c5068e67981a tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:11.644593 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-aff36f08-caee-4711-a68d-c5068e67981a tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] 10.222.0.33 "GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7" status: 200 len: 1603 microversion: 2.32 time: 0.382599 Sep 23 04:57:11.648286 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2830/5510] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:57:11 2022] GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 => generated 1603 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:57:12.592717 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c38ce5c2-dbaf-49bd-bb96-32c6ced0ba92 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:12.593338 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c38ce5c2-dbaf-49bd-bb96-32c6ced0ba92 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 9bd2c0e2-8256-484a-bbd5-f21743724671] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:12.601061 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c38ce5c2-dbaf-49bd-bb96-32c6ced0ba92 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:12.606981 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c38ce5c2-dbaf-49bd-bb96-32c6ced0ba92 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:12.608529 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c38ce5c2-dbaf-49bd-bb96-32c6ced0ba92 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:12.611276 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c38ce5c2-dbaf-49bd-bb96-32c6ced0ba92 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:12.611914 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c38ce5c2-dbaf-49bd-bb96-32c6ced0ba92 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:12.629736 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c38ce5c2-dbaf-49bd-bb96-32c6ced0ba92 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:12.680943 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-34911164-fef7-4870-aef7-1a22f0094476 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:12.681670 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-34911164-fef7-4870-aef7-1a22f0094476 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] [instance: 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:12.704229 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-34911164-fef7-4870-aef7-1a22f0094476 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:12.704864 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-34911164-fef7-4870-aef7-1a22f0094476 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:12.708072 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-34911164-fef7-4870-aef7-1a22f0094476 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:12.708964 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-34911164-fef7-4870-aef7-1a22f0094476 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:12.709560 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-34911164-fef7-4870-aef7-1a22f0094476 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:12.710139 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-34911164-fef7-4870-aef7-1a22f0094476 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:12.860431 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-34911164-fef7-4870-aef7-1a22f0094476 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:12.870503 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-34911164-fef7-4870-aef7-1a22f0094476 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:12.871980 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-34911164-fef7-4870-aef7-1a22f0094476 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:12.873192 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-34911164-fef7-4870-aef7-1a22f0094476 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] 10.222.0.33 "GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7" status: 200 len: 1603 microversion: 2.32 time: 0.204715 Sep 23 04:57:12.913490 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2831/5511] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:57:12 2022] GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 => generated 1603 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:57:13.072351 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c38ce5c2-dbaf-49bd-bb96-32c6ced0ba92 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:13.091667 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c38ce5c2-dbaf-49bd-bb96-32c6ced0ba92 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671" status: 200 len: 1689 microversion: 2.1 time: 0.502648 Sep 23 04:57:13.092912 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2681/5512] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:57:12 2022] GET /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671 => generated 1689 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:57:13.906926 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-822103c9-cc1e-43be-a4cf-9a05c79df2d3 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:13.911754 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-822103c9-cc1e-43be-a4cf-9a05c79df2d3 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] [instance: 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:13.930141 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-822103c9-cc1e-43be-a4cf-9a05c79df2d3 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:13.930650 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-822103c9-cc1e-43be-a4cf-9a05c79df2d3 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:13.931096 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-822103c9-cc1e-43be-a4cf-9a05c79df2d3 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:13.931817 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-822103c9-cc1e-43be-a4cf-9a05c79df2d3 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:13.932279 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-822103c9-cc1e-43be-a4cf-9a05c79df2d3 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:13.932700 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-822103c9-cc1e-43be-a4cf-9a05c79df2d3 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:14.077284 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-822103c9-cc1e-43be-a4cf-9a05c79df2d3 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:14.093520 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-822103c9-cc1e-43be-a4cf-9a05c79df2d3 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:14.095823 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-822103c9-cc1e-43be-a4cf-9a05c79df2d3 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:14.097531 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-822103c9-cc1e-43be-a4cf-9a05c79df2d3 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] 10.222.0.33 "GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7" status: 200 len: 1603 microversion: 2.32 time: 0.194741 Sep 23 04:57:14.098549 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2832/5513] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:57:13 2022] GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 => generated 1603 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:57:14.124654 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-fb922ac8-90ad-4dd9-bcb8-9bc8035552f3 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:14.125320 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-fb922ac8-90ad-4dd9-bcb8-9bc8035552f3 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 9bd2c0e2-8256-484a-bbd5-f21743724671] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:14.146213 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fb922ac8-90ad-4dd9-bcb8-9bc8035552f3 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:14.150787 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fb922ac8-90ad-4dd9-bcb8-9bc8035552f3 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:14.150787 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fb922ac8-90ad-4dd9-bcb8-9bc8035552f3 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:14.150787 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fb922ac8-90ad-4dd9-bcb8-9bc8035552f3 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:14.150787 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fb922ac8-90ad-4dd9-bcb8-9bc8035552f3 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:14.150787 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fb922ac8-90ad-4dd9-bcb8-9bc8035552f3 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:14.536918 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-fb922ac8-90ad-4dd9-bcb8-9bc8035552f3 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:14.547039 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-fb922ac8-90ad-4dd9-bcb8-9bc8035552f3 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671" status: 200 len: 1689 microversion: 2.1 time: 0.430417 Sep 23 04:57:14.548292 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2682/5514] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:57:14 2022] GET /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671 => generated 1689 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:57:15.132103 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-bd6cbac3-f912-42ed-9222-c3f58b5ff7b6 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:15.132889 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-bd6cbac3-f912-42ed-9222-c3f58b5ff7b6 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] [instance: 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:15.145196 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bd6cbac3-f912-42ed-9222-c3f58b5ff7b6 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:15.147588 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bd6cbac3-f912-42ed-9222-c3f58b5ff7b6 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:15.148043 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bd6cbac3-f912-42ed-9222-c3f58b5ff7b6 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:15.150143 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bd6cbac3-f912-42ed-9222-c3f58b5ff7b6 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:15.150914 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bd6cbac3-f912-42ed-9222-c3f58b5ff7b6 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:15.151389 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bd6cbac3-f912-42ed-9222-c3f58b5ff7b6 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:15.347559 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-bd6cbac3-f912-42ed-9222-c3f58b5ff7b6 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:15.381049 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-bd6cbac3-f912-42ed-9222-c3f58b5ff7b6 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:15.388888 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-bd6cbac3-f912-42ed-9222-c3f58b5ff7b6 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:15.390951 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-bd6cbac3-f912-42ed-9222-c3f58b5ff7b6 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] 10.222.0.33 "GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7" status: 200 len: 1603 microversion: 2.32 time: 0.263071 Sep 23 04:57:15.399095 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2833/5515] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:57:15 2022] GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 => generated 1603 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:57:15.571953 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-86c0f4f7-be3a-4f4e-85f3-df5a3ac8a9a0 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:15.572579 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-86c0f4f7-be3a-4f4e-85f3-df5a3ac8a9a0 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 9bd2c0e2-8256-484a-bbd5-f21743724671] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:15.576276 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=44 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:57:15.588123 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-86c0f4f7-be3a-4f4e-85f3-df5a3ac8a9a0 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:15.592211 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-86c0f4f7-be3a-4f4e-85f3-df5a3ac8a9a0 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:15.592211 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-86c0f4f7-be3a-4f4e-85f3-df5a3ac8a9a0 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:15.592211 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-86c0f4f7-be3a-4f4e-85f3-df5a3ac8a9a0 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:15.592211 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-86c0f4f7-be3a-4f4e-85f3-df5a3ac8a9a0 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:15.592211 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-86c0f4f7-be3a-4f4e-85f3-df5a3ac8a9a0 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:15.850666 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-86c0f4f7-be3a-4f4e-85f3-df5a3ac8a9a0 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:15.860224 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-86c0f4f7-be3a-4f4e-85f3-df5a3ac8a9a0 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671" status: 200 len: 1694 microversion: 2.1 time: 0.291422 Sep 23 04:57:15.863081 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2683/5516] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:57:15 2022] GET /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671 => generated 1694 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:57:16.431453 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3197df29-0cee-4e00-b6fa-8e5f30cdfb80 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:16.432009 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-3197df29-0cee-4e00-b6fa-8e5f30cdfb80 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] [instance: 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:16.442086 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3197df29-0cee-4e00-b6fa-8e5f30cdfb80 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:16.443141 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3197df29-0cee-4e00-b6fa-8e5f30cdfb80 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:16.443818 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3197df29-0cee-4e00-b6fa-8e5f30cdfb80 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:16.444785 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3197df29-0cee-4e00-b6fa-8e5f30cdfb80 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:16.445471 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3197df29-0cee-4e00-b6fa-8e5f30cdfb80 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:16.446168 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3197df29-0cee-4e00-b6fa-8e5f30cdfb80 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:16.531191 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-3197df29-0cee-4e00-b6fa-8e5f30cdfb80 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:16.543928 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-3197df29-0cee-4e00-b6fa-8e5f30cdfb80 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:16.546150 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-3197df29-0cee-4e00-b6fa-8e5f30cdfb80 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:16.566122 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3197df29-0cee-4e00-b6fa-8e5f30cdfb80 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] 10.222.0.33 "GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7" status: 200 len: 1603 microversion: 2.32 time: 0.122665 Sep 23 04:57:16.566122 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2834/5517] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:57:16 2022] GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 => generated 1603 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:57:16.889839 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-37d45d90-e3db-4867-9925-12e2cecc9e1b tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:16.891768 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-37d45d90-e3db-4867-9925-12e2cecc9e1b tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 9bd2c0e2-8256-484a-bbd5-f21743724671] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:16.907170 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-37d45d90-e3db-4867-9925-12e2cecc9e1b tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:16.907170 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-37d45d90-e3db-4867-9925-12e2cecc9e1b tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:16.907170 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-37d45d90-e3db-4867-9925-12e2cecc9e1b tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:16.907170 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-37d45d90-e3db-4867-9925-12e2cecc9e1b tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:16.907170 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-37d45d90-e3db-4867-9925-12e2cecc9e1b tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:16.909175 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-37d45d90-e3db-4867-9925-12e2cecc9e1b tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:17.068291 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8e4a24cb-8c7e-458c-907a-3b6991d9d2ae tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:17.070077 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-8e4a24cb-8c7e-458c-907a-3b6991d9d2ae tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] [instance: 6dfb2418-b235-4d35-b109-4bed20d1b96e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:17.082676 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8e4a24cb-8c7e-458c-907a-3b6991d9d2ae tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:17.084022 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8e4a24cb-8c7e-458c-907a-3b6991d9d2ae tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:17.084864 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8e4a24cb-8c7e-458c-907a-3b6991d9d2ae tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:17.086692 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8e4a24cb-8c7e-458c-907a-3b6991d9d2ae tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:17.087388 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8e4a24cb-8c7e-458c-907a-3b6991d9d2ae tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:17.088036 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8e4a24cb-8c7e-458c-907a-3b6991d9d2ae tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:17.232132 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-8e4a24cb-8c7e-458c-907a-3b6991d9d2ae tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lazy-loading 'services' on Instance uuid 6dfb2418-b235-4d35-b109-4bed20d1b96e {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:57:17.507523 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-8e4a24cb-8c7e-458c-907a-3b6991d9d2ae tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e/os-volume_attachments/8665a9e7-15e3-4f9e-9ef4-40fbaf947667" status: 202 len: 0 microversion: 2.1 time: 0.446084 Sep 23 04:57:17.527618 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2835/5518] 10.222.0.33 () {58 vars in 1416 bytes} [Fri Sep 23 04:57:17 2022] DELETE /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e/os-volume_attachments/8665a9e7-15e3-4f9e-9ef4-40fbaf947667 => generated 0 bytes in 467 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:57:17.583801 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-83fe13b8-fb0b-4c4d-99ed-0a28bfd64096 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:17.584470 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-83fe13b8-fb0b-4c4d-99ed-0a28bfd64096 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] [instance: 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:17.622353 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-83fe13b8-fb0b-4c4d-99ed-0a28bfd64096 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:17.626824 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-83fe13b8-fb0b-4c4d-99ed-0a28bfd64096 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:17.626824 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-83fe13b8-fb0b-4c4d-99ed-0a28bfd64096 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:17.627108 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-83fe13b8-fb0b-4c4d-99ed-0a28bfd64096 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:17.627699 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-83fe13b8-fb0b-4c4d-99ed-0a28bfd64096 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:17.628146 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-83fe13b8-fb0b-4c4d-99ed-0a28bfd64096 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:17.961781 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-83fe13b8-fb0b-4c4d-99ed-0a28bfd64096 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:17.988104 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-83fe13b8-fb0b-4c4d-99ed-0a28bfd64096 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:17.994082 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-37d45d90-e3db-4867-9925-12e2cecc9e1b tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:17.999615 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-83fe13b8-fb0b-4c4d-99ed-0a28bfd64096 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:18.004346 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-83fe13b8-fb0b-4c4d-99ed-0a28bfd64096 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] 10.222.0.33 "GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7" status: 200 len: 1603 microversion: 2.32 time: 0.428702 Sep 23 04:57:18.005494 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-37d45d90-e3db-4867-9925-12e2cecc9e1b tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671" status: 200 len: 1694 microversion: 2.1 time: 1.123145 Sep 23 04:57:18.008226 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2836/5519] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:57:17 2022] GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 => generated 1603 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:57:18.010536 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2684/5520] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:57:16 2022] GET /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671 => generated 1694 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:57:19.034028 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7c4226cc-f2e1-4e0e-80ff-9f086f78dd7d tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:19.035209 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-7c4226cc-f2e1-4e0e-80ff-9f086f78dd7d tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 9bd2c0e2-8256-484a-bbd5-f21743724671] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:19.036448 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-dbb2cf93-a667-4477-9233-1acb4d44ac03 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:19.037076 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-dbb2cf93-a667-4477-9233-1acb4d44ac03 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] [instance: 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:19.052278 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7c4226cc-f2e1-4e0e-80ff-9f086f78dd7d tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:19.054831 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7c4226cc-f2e1-4e0e-80ff-9f086f78dd7d tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:19.055301 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7c4226cc-f2e1-4e0e-80ff-9f086f78dd7d tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:19.058386 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7c4226cc-f2e1-4e0e-80ff-9f086f78dd7d tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:19.058890 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7c4226cc-f2e1-4e0e-80ff-9f086f78dd7d tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:19.065177 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7c4226cc-f2e1-4e0e-80ff-9f086f78dd7d tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:19.066052 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dbb2cf93-a667-4477-9233-1acb4d44ac03 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:19.066052 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dbb2cf93-a667-4477-9233-1acb4d44ac03 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:19.066052 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dbb2cf93-a667-4477-9233-1acb4d44ac03 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:19.066052 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dbb2cf93-a667-4477-9233-1acb4d44ac03 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:19.066052 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dbb2cf93-a667-4477-9233-1acb4d44ac03 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:19.066052 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dbb2cf93-a667-4477-9233-1acb4d44ac03 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:19.274651 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-dbb2cf93-a667-4477-9233-1acb4d44ac03 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:19.291081 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-dbb2cf93-a667-4477-9233-1acb4d44ac03 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:19.292664 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-dbb2cf93-a667-4477-9233-1acb4d44ac03 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:19.296213 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-dbb2cf93-a667-4477-9233-1acb4d44ac03 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] 10.222.0.33 "GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7" status: 200 len: 1603 microversion: 2.32 time: 0.263750 Sep 23 04:57:19.308062 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2685/5521] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:57:19 2022] GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 => generated 1603 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:57:19.482758 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-7c4226cc-f2e1-4e0e-80ff-9f086f78dd7d tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:19.492029 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-7c4226cc-f2e1-4e0e-80ff-9f086f78dd7d tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671" status: 200 len: 1694 microversion: 2.1 time: 0.463170 Sep 23 04:57:19.506729 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2837/5522] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:57:19 2022] GET /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671 => generated 1694 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:57:20.329399 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-66a60056-474a-48f5-a6ef-05684647c06c tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:20.333002 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-66a60056-474a-48f5-a6ef-05684647c06c tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] [instance: 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:20.349638 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-66a60056-474a-48f5-a6ef-05684647c06c tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:20.351504 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-66a60056-474a-48f5-a6ef-05684647c06c tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:20.352551 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-66a60056-474a-48f5-a6ef-05684647c06c tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:20.354089 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-66a60056-474a-48f5-a6ef-05684647c06c tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:20.355301 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-66a60056-474a-48f5-a6ef-05684647c06c tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:20.357120 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-66a60056-474a-48f5-a6ef-05684647c06c tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:20.517950 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3624fcaf-95ab-40b7-98e5-6ff2be920eb0 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:20.518676 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-3624fcaf-95ab-40b7-98e5-6ff2be920eb0 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 9bd2c0e2-8256-484a-bbd5-f21743724671] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:20.522687 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-66a60056-474a-48f5-a6ef-05684647c06c tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:20.528837 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3624fcaf-95ab-40b7-98e5-6ff2be920eb0 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:20.529643 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3624fcaf-95ab-40b7-98e5-6ff2be920eb0 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:20.530848 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3624fcaf-95ab-40b7-98e5-6ff2be920eb0 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:20.534610 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3624fcaf-95ab-40b7-98e5-6ff2be920eb0 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:20.535408 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3624fcaf-95ab-40b7-98e5-6ff2be920eb0 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:20.542606 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3624fcaf-95ab-40b7-98e5-6ff2be920eb0 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:20.547815 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-66a60056-474a-48f5-a6ef-05684647c06c tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:20.551174 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-66a60056-474a-48f5-a6ef-05684647c06c tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:20.555366 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-66a60056-474a-48f5-a6ef-05684647c06c tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] 10.222.0.33 "GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7" status: 200 len: 1603 microversion: 2.32 time: 0.230425 Sep 23 04:57:20.556008 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2686/5523] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:57:20 2022] GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 => generated 1603 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:57:20.805147 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-3624fcaf-95ab-40b7-98e5-6ff2be920eb0 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:20.813945 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3624fcaf-95ab-40b7-98e5-6ff2be920eb0 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671" status: 200 len: 1694 microversion: 2.1 time: 0.300328 Sep 23 04:57:20.815729 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2838/5524] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:57:20 2022] GET /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671 => generated 1694 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:57:21.582348 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-937e4416-3b32-4e76-846b-6e0db28357fb tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:21.583032 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-937e4416-3b32-4e76-846b-6e0db28357fb tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] [instance: 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:21.614331 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-937e4416-3b32-4e76-846b-6e0db28357fb tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:21.617285 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-937e4416-3b32-4e76-846b-6e0db28357fb tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:21.619728 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-937e4416-3b32-4e76-846b-6e0db28357fb tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:21.621598 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-937e4416-3b32-4e76-846b-6e0db28357fb tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:21.622167 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-937e4416-3b32-4e76-846b-6e0db28357fb tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:21.627590 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-937e4416-3b32-4e76-846b-6e0db28357fb tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:21.799606 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-937e4416-3b32-4e76-846b-6e0db28357fb tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:21.834591 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-937e4416-3b32-4e76-846b-6e0db28357fb tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:21.837344 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-937e4416-3b32-4e76-846b-6e0db28357fb tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:21.845940 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-937e4416-3b32-4e76-846b-6e0db28357fb tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] 10.222.0.33 "GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7" status: 200 len: 1603 microversion: 2.32 time: 0.269022 Sep 23 04:57:21.851344 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5ef32ab3-5009-4ce9-9930-7c790d8e032b tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:21.851344 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-5ef32ab3-5009-4ce9-9930-7c790d8e032b tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 9bd2c0e2-8256-484a-bbd5-f21743724671] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:21.852762 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2687/5525] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:57:21 2022] GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 => generated 1603 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:57:21.858883 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5ef32ab3-5009-4ce9-9930-7c790d8e032b tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:21.862412 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5ef32ab3-5009-4ce9-9930-7c790d8e032b tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:21.863129 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5ef32ab3-5009-4ce9-9930-7c790d8e032b tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:21.864786 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5ef32ab3-5009-4ce9-9930-7c790d8e032b tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:21.868477 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5ef32ab3-5009-4ce9-9930-7c790d8e032b tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:21.870302 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5ef32ab3-5009-4ce9-9930-7c790d8e032b tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:22.442535 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-5ef32ab3-5009-4ce9-9930-7c790d8e032b tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:22.454461 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5ef32ab3-5009-4ce9-9930-7c790d8e032b tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671" status: 200 len: 1694 microversion: 2.1 time: 0.610965 Sep 23 04:57:22.456416 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2839/5526] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:57:21 2022] GET /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671 => generated 1694 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:57:22.878777 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4524ca3f-85b7-4291-853f-20fc5861662c tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:22.879392 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4524ca3f-85b7-4291-853f-20fc5861662c tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] [instance: 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:22.890200 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4524ca3f-85b7-4291-853f-20fc5861662c tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:22.895097 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4524ca3f-85b7-4291-853f-20fc5861662c tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:22.896806 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4524ca3f-85b7-4291-853f-20fc5861662c tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:22.897764 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4524ca3f-85b7-4291-853f-20fc5861662c tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:22.898422 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4524ca3f-85b7-4291-853f-20fc5861662c tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:22.900916 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4524ca3f-85b7-4291-853f-20fc5861662c tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:23.095604 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4524ca3f-85b7-4291-853f-20fc5861662c tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:23.117581 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4524ca3f-85b7-4291-853f-20fc5861662c tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:23.121364 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4524ca3f-85b7-4291-853f-20fc5861662c tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:23.127464 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4524ca3f-85b7-4291-853f-20fc5861662c tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] 10.222.0.33 "GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7" status: 200 len: 1603 microversion: 2.32 time: 0.252815 Sep 23 04:57:23.129433 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2688/5527] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:57:22 2022] GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 => generated 1603 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:57:23.493720 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-63a888bc-aafa-4137-87a8-31aec4230851 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:23.494224 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-63a888bc-aafa-4137-87a8-31aec4230851 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 9bd2c0e2-8256-484a-bbd5-f21743724671] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:23.500596 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-63a888bc-aafa-4137-87a8-31aec4230851 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:23.505665 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-63a888bc-aafa-4137-87a8-31aec4230851 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:23.507447 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-63a888bc-aafa-4137-87a8-31aec4230851 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:23.508683 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-63a888bc-aafa-4137-87a8-31aec4230851 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:23.511545 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-63a888bc-aafa-4137-87a8-31aec4230851 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:23.512198 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-63a888bc-aafa-4137-87a8-31aec4230851 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:24.001292 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-63a888bc-aafa-4137-87a8-31aec4230851 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:24.013353 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-63a888bc-aafa-4137-87a8-31aec4230851 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671" status: 200 len: 1694 microversion: 2.1 time: 0.524295 Sep 23 04:57:24.019590 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2840/5528] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:57:23 2022] GET /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671 => generated 1694 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:57:24.158716 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5f95e8ca-6bb5-47b6-9afb-5fd83176dc14 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:24.163820 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5f95e8ca-6bb5-47b6-9afb-5fd83176dc14 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] [instance: 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:24.180849 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5f95e8ca-6bb5-47b6-9afb-5fd83176dc14 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:24.184659 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5f95e8ca-6bb5-47b6-9afb-5fd83176dc14 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:24.194696 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5f95e8ca-6bb5-47b6-9afb-5fd83176dc14 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:24.196331 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5f95e8ca-6bb5-47b6-9afb-5fd83176dc14 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:24.198509 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5f95e8ca-6bb5-47b6-9afb-5fd83176dc14 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:24.199935 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5f95e8ca-6bb5-47b6-9afb-5fd83176dc14 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:24.352491 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-5f95e8ca-6bb5-47b6-9afb-5fd83176dc14 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:24.377783 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-5f95e8ca-6bb5-47b6-9afb-5fd83176dc14 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:24.379362 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-5f95e8ca-6bb5-47b6-9afb-5fd83176dc14 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:24.380655 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5f95e8ca-6bb5-47b6-9afb-5fd83176dc14 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] 10.222.0.33 "GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7" status: 200 len: 1603 microversion: 2.32 time: 0.227579 Sep 23 04:57:24.390465 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2689/5529] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:57:24 2022] GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 => generated 1603 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:57:25.048057 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-da36a8c1-e364-4561-8e6c-02c2d963ff9c tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:25.049346 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-da36a8c1-e364-4561-8e6c-02c2d963ff9c tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 9bd2c0e2-8256-484a-bbd5-f21743724671] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:25.067562 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-da36a8c1-e364-4561-8e6c-02c2d963ff9c tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:25.071267 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-da36a8c1-e364-4561-8e6c-02c2d963ff9c tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:25.071960 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-da36a8c1-e364-4561-8e6c-02c2d963ff9c tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:25.077564 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-da36a8c1-e364-4561-8e6c-02c2d963ff9c tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:25.078977 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-da36a8c1-e364-4561-8e6c-02c2d963ff9c tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:25.080697 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-da36a8c1-e364-4561-8e6c-02c2d963ff9c tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:25.092607 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:57:25.408585 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d7de9b02-ffa0-459d-b26a-4582b95f4a3f tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:25.409600 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d7de9b02-ffa0-459d-b26a-4582b95f4a3f tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] [instance: 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:25.427922 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d7de9b02-ffa0-459d-b26a-4582b95f4a3f tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:25.429393 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d7de9b02-ffa0-459d-b26a-4582b95f4a3f tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:25.431149 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d7de9b02-ffa0-459d-b26a-4582b95f4a3f tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:25.438223 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d7de9b02-ffa0-459d-b26a-4582b95f4a3f tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:25.439340 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d7de9b02-ffa0-459d-b26a-4582b95f4a3f tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:25.440371 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d7de9b02-ffa0-459d-b26a-4582b95f4a3f tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:25.652590 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d7de9b02-ffa0-459d-b26a-4582b95f4a3f tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:25.664086 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d7de9b02-ffa0-459d-b26a-4582b95f4a3f tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:25.666086 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d7de9b02-ffa0-459d-b26a-4582b95f4a3f tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:25.667876 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d7de9b02-ffa0-459d-b26a-4582b95f4a3f tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] 10.222.0.33 "GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7" status: 200 len: 1603 microversion: 2.32 time: 0.263926 Sep 23 04:57:25.668999 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2690/5530] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:57:25 2022] GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 => generated 1603 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:57:25.840709 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-da36a8c1-e364-4561-8e6c-02c2d963ff9c tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:25.855075 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-da36a8c1-e364-4561-8e6c-02c2d963ff9c tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671" status: 200 len: 1694 microversion: 2.1 time: 0.812650 Sep 23 04:57:25.855772 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2841/5531] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:57:25 2022] GET /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671 => generated 1694 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:57:26.695981 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0de9d2bb-4352-4e22-bc59-ca7644cf8a88 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:26.695981 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-0de9d2bb-4352-4e22-bc59-ca7644cf8a88 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] [instance: 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:26.706780 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0de9d2bb-4352-4e22-bc59-ca7644cf8a88 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:26.709046 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0de9d2bb-4352-4e22-bc59-ca7644cf8a88 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:26.712958 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0de9d2bb-4352-4e22-bc59-ca7644cf8a88 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:26.718918 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0de9d2bb-4352-4e22-bc59-ca7644cf8a88 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:26.718918 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0de9d2bb-4352-4e22-bc59-ca7644cf8a88 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:26.718918 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0de9d2bb-4352-4e22-bc59-ca7644cf8a88 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:26.882404 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ba9b8924-2e19-4492-b9b4-97c6dc734562 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:26.883069 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ba9b8924-2e19-4492-b9b4-97c6dc734562 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 9bd2c0e2-8256-484a-bbd5-f21743724671] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:26.904016 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ba9b8924-2e19-4492-b9b4-97c6dc734562 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:26.904527 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ba9b8924-2e19-4492-b9b4-97c6dc734562 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:26.907787 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ba9b8924-2e19-4492-b9b4-97c6dc734562 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:26.910175 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ba9b8924-2e19-4492-b9b4-97c6dc734562 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:26.910175 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ba9b8924-2e19-4492-b9b4-97c6dc734562 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:26.913826 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ba9b8924-2e19-4492-b9b4-97c6dc734562 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:27.427557 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-0de9d2bb-4352-4e22-bc59-ca7644cf8a88 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:27.454901 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-0de9d2bb-4352-4e22-bc59-ca7644cf8a88 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:27.456894 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-0de9d2bb-4352-4e22-bc59-ca7644cf8a88 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:27.461303 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0de9d2bb-4352-4e22-bc59-ca7644cf8a88 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] 10.222.0.33 "GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7" status: 200 len: 1603 microversion: 2.32 time: 0.769755 Sep 23 04:57:27.473980 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2691/5532] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:57:26 2022] GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 => generated 1603 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:57:27.930868 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ba9b8924-2e19-4492-b9b4-97c6dc734562 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:27.962195 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ba9b8924-2e19-4492-b9b4-97c6dc734562 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671" status: 200 len: 1694 microversion: 2.1 time: 1.080333 Sep 23 04:57:27.965142 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2842/5533] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:57:26 2022] GET /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671 => generated 1694 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:57:28.523112 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ddc6f0e8-4dd4-4494-9a84-c0dcef3c9fc0 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:28.523701 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-ddc6f0e8-4dd4-4494-9a84-c0dcef3c9fc0 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] [instance: 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:28.561537 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ddc6f0e8-4dd4-4494-9a84-c0dcef3c9fc0 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:28.562921 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ddc6f0e8-4dd4-4494-9a84-c0dcef3c9fc0 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:28.563582 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ddc6f0e8-4dd4-4494-9a84-c0dcef3c9fc0 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:28.564610 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ddc6f0e8-4dd4-4494-9a84-c0dcef3c9fc0 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:28.571603 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ddc6f0e8-4dd4-4494-9a84-c0dcef3c9fc0 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:28.572264 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ddc6f0e8-4dd4-4494-9a84-c0dcef3c9fc0 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:28.708803 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-487a065e-8d8f-41a2-859b-c0951c5675d9 req-7c934915-b696-41c2-99dc-cd80688be127 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bd2c0e2-8256-484a-bbd5-f21743724671", "name": "network-vif-unplugged", "status": "completed", "tag": "909994da-1d1c-4fc5-955f-cc0ae5196ea8"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:57:28.773443 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-487a065e-8d8f-41a2-859b-c0951c5675d9 req-7c934915-b696-41c2-99dc-cd80688be127 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:28.775772 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-487a065e-8d8f-41a2-859b-c0951c5675d9 req-7c934915-b696-41c2-99dc-cd80688be127 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:28.776524 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-487a065e-8d8f-41a2-859b-c0951c5675d9 req-7c934915-b696-41c2-99dc-cd80688be127 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:28.830166 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ddc6f0e8-4dd4-4494-9a84-c0dcef3c9fc0 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:28.851523 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-487a065e-8d8f-41a2-859b-c0951c5675d9 req-7c934915-b696-41c2-99dc-cd80688be127 service nova] Creating event network-vif-unplugged:909994da-1d1c-4fc5-955f-cc0ae5196ea8 for instance 9bd2c0e2-8256-484a-bbd5-f21743724671 on n-h1-846463-3 Sep 23 04:57:28.855588 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ddc6f0e8-4dd4-4494-9a84-c0dcef3c9fc0 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:28.862547 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ddc6f0e8-4dd4-4494-9a84-c0dcef3c9fc0 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:28.862547 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ddc6f0e8-4dd4-4494-9a84-c0dcef3c9fc0 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] 10.222.0.33 "GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7" status: 200 len: 1603 microversion: 2.32 time: 0.369006 Sep 23 04:57:28.873870 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [req-487a065e-8d8f-41a2-859b-c0951c5675d9 req-7c934915-b696-41c2-99dc-cd80688be127 service nova] Instance 9bd2c0e2-8256-484a-bbd5-f21743724671 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846463-3', 'n-h2-846463-3'} {{(pid=122699) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 23 04:57:28.890200 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2692/5534] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:57:28 2022] GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 => generated 1603 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:57:28.905787 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-487a065e-8d8f-41a2-859b-c0951c5675d9 req-7c934915-b696-41c2-99dc-cd80688be127 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.204724 Sep 23 04:57:28.922891 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2843/5535] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:57:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:57:28.932421 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4b65fc18-21ab-49fb-8f06-93169396648f tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:57:28.941282 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4b65fc18-21ab-49fb-8f06-93169396648f tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:28.942008 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4b65fc18-21ab-49fb-8f06-93169396648f tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:28.942616 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4b65fc18-21ab-49fb-8f06-93169396648f tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:28.967495 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4b65fc18-21ab-49fb-8f06-93169396648f tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] [instance: 6dfb2418-b235-4d35-b109-4bed20d1b96e] Going to try to stop instance {{(pid=122698) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 23 04:57:28.991294 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8d5aaecc-06f6-4b23-a0f4-cdc182138a4b tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:28.993260 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-8d5aaecc-06f6-4b23-a0f4-cdc182138a4b tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 9bd2c0e2-8256-484a-bbd5-f21743724671] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:29.014081 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8d5aaecc-06f6-4b23-a0f4-cdc182138a4b tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:29.015406 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8d5aaecc-06f6-4b23-a0f4-cdc182138a4b tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:29.016464 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8d5aaecc-06f6-4b23-a0f4-cdc182138a4b tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:29.019612 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8d5aaecc-06f6-4b23-a0f4-cdc182138a4b tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:29.022984 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8d5aaecc-06f6-4b23-a0f4-cdc182138a4b tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:29.025954 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8d5aaecc-06f6-4b23-a0f4-cdc182138a4b tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:29.228925 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4b65fc18-21ab-49fb-8f06-93169396648f tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] 10.222.0.33 "POST /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e/action" status: 202 len: 0 microversion: 2.1 time: 0.300579 Sep 23 04:57:29.229760 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2693/5536] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:57:28 2022] POST /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e/action => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:57:29.244528 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-42286077-172e-4285-90ec-936b1305f699 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:29.245424 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-42286077-172e-4285-90ec-936b1305f699 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] [instance: 6dfb2418-b235-4d35-b109-4bed20d1b96e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:29.267262 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-42286077-172e-4285-90ec-936b1305f699 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:29.267774 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-42286077-172e-4285-90ec-936b1305f699 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:29.268220 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-42286077-172e-4285-90ec-936b1305f699 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:29.268946 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-42286077-172e-4285-90ec-936b1305f699 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:29.269424 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-42286077-172e-4285-90ec-936b1305f699 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:29.269848 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-42286077-172e-4285-90ec-936b1305f699 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:29.323629 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:57:29.894856 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-8d5aaecc-06f6-4b23-a0f4-cdc182138a4b tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:29.903438 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-8d5aaecc-06f6-4b23-a0f4-cdc182138a4b tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671" status: 200 len: 1693 microversion: 2.1 time: 0.916658 Sep 23 04:57:29.904028 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2844/5537] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:57:28 2022] GET /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671 => generated 1693 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:57:29.913063 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-59b1e285-560a-4ab5-9429-884700ee507c tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:29.924642 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-59b1e285-560a-4ab5-9429-884700ee507c tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] [instance: 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:29.962215 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-59b1e285-560a-4ab5-9429-884700ee507c tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:29.963369 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-59b1e285-560a-4ab5-9429-884700ee507c tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:29.964049 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-59b1e285-560a-4ab5-9429-884700ee507c tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:29.964998 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-59b1e285-560a-4ab5-9429-884700ee507c tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:29.968045 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-59b1e285-560a-4ab5-9429-884700ee507c tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:29.969989 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-59b1e285-560a-4ab5-9429-884700ee507c tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:30.232867 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-59b1e285-560a-4ab5-9429-884700ee507c tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:30.239359 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-59b1e285-560a-4ab5-9429-884700ee507c tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:30.247222 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-59b1e285-560a-4ab5-9429-884700ee507c tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:30.248493 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-59b1e285-560a-4ab5-9429-884700ee507c tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] 10.222.0.33 "GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7" status: 200 len: 1603 microversion: 2.32 time: 0.339298 Sep 23 04:57:30.249069 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2845/5538] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:57:29 2022] GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 => generated 1603 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:57:30.253913 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-42286077-172e-4285-90ec-936b1305f699 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bde73a530f4666aebdd5f7d9fa1046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71874a329e54494bb1b84f31c3826205', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:30.269613 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-42286077-172e-4285-90ec-936b1305f699 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] 10.222.0.33 "GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e" status: 200 len: 1677 microversion: 2.1 time: 1.034857 Sep 23 04:57:30.273222 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2694/5539] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:57:29 2022] GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e => generated 1677 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:57:30.937666 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d136ca6a-65f8-4b6e-992d-e709fd97279a tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:30.938490 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d136ca6a-65f8-4b6e-992d-e709fd97279a tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 9bd2c0e2-8256-484a-bbd5-f21743724671] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:30.963528 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d136ca6a-65f8-4b6e-992d-e709fd97279a tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:30.963528 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d136ca6a-65f8-4b6e-992d-e709fd97279a tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:30.963528 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d136ca6a-65f8-4b6e-992d-e709fd97279a tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:30.963528 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d136ca6a-65f8-4b6e-992d-e709fd97279a tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:30.988332 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d136ca6a-65f8-4b6e-992d-e709fd97279a tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:30.989129 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d136ca6a-65f8-4b6e-992d-e709fd97279a tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:31.055093 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-fa05c82f-31d6-44c5-a938-3573abea02b7 req-ddbc1789-858e-4335-b842-d0a55cead09e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bd2c0e2-8256-484a-bbd5-f21743724671", "tag": "909994da-1d1c-4fc5-955f-cc0ae5196ea8"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:57:31.085630 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-fa05c82f-31d6-44c5-a938-3573abea02b7 req-ddbc1789-858e-4335-b842-d0a55cead09e service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:31.090484 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-fa05c82f-31d6-44c5-a938-3573abea02b7 req-ddbc1789-858e-4335-b842-d0a55cead09e service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:31.091006 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-fa05c82f-31d6-44c5-a938-3573abea02b7 req-ddbc1789-858e-4335-b842-d0a55cead09e service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:31.127260 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-fa05c82f-31d6-44c5-a938-3573abea02b7 req-ddbc1789-858e-4335-b842-d0a55cead09e service nova] Creating event network-changed:909994da-1d1c-4fc5-955f-cc0ae5196ea8 for instance 9bd2c0e2-8256-484a-bbd5-f21743724671 on n-h1-846463-3 Sep 23 04:57:31.142233 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [req-fa05c82f-31d6-44c5-a938-3573abea02b7 req-ddbc1789-858e-4335-b842-d0a55cead09e service nova] Instance 9bd2c0e2-8256-484a-bbd5-f21743724671 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846463-3', 'n-h2-846463-3'} {{(pid=122698) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 23 04:57:31.173167 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-fa05c82f-31d6-44c5-a938-3573abea02b7 req-ddbc1789-858e-4335-b842-d0a55cead09e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122351 Sep 23 04:57:31.176455 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2695/5540] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:57:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:57:31.530944 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-be477453-dfbb-496d-9d81-6c3685b9c7f1 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:31.530944 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-be477453-dfbb-496d-9d81-6c3685b9c7f1 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] [instance: 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:31.530944 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-be477453-dfbb-496d-9d81-6c3685b9c7f1 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:31.530944 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-be477453-dfbb-496d-9d81-6c3685b9c7f1 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:31.530944 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-be477453-dfbb-496d-9d81-6c3685b9c7f1 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:31.530944 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-be477453-dfbb-496d-9d81-6c3685b9c7f1 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:31.530944 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-be477453-dfbb-496d-9d81-6c3685b9c7f1 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:31.530944 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-be477453-dfbb-496d-9d81-6c3685b9c7f1 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:31.533585 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d136ca6a-65f8-4b6e-992d-e709fd97279a tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:31.533585 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d136ca6a-65f8-4b6e-992d-e709fd97279a tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671" status: 200 len: 1693 microversion: 2.1 time: 0.479427 Sep 23 04:57:31.533585 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2846/5541] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:57:30 2022] GET /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671 => generated 1693 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:57:31.533585 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4860f9bd-f874-4aa2-8c8e-0dc0e6207b4e tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:31.533585 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4860f9bd-f874-4aa2-8c8e-0dc0e6207b4e tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] [instance: 6dfb2418-b235-4d35-b109-4bed20d1b96e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:31.533585 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4860f9bd-f874-4aa2-8c8e-0dc0e6207b4e tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:31.533585 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4860f9bd-f874-4aa2-8c8e-0dc0e6207b4e tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:31.533585 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4860f9bd-f874-4aa2-8c8e-0dc0e6207b4e tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:31.533585 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4860f9bd-f874-4aa2-8c8e-0dc0e6207b4e tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:31.533585 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4860f9bd-f874-4aa2-8c8e-0dc0e6207b4e tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:31.533585 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4860f9bd-f874-4aa2-8c8e-0dc0e6207b4e tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:31.716256 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-be477453-dfbb-496d-9d81-6c3685b9c7f1 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:31.740919 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-be477453-dfbb-496d-9d81-6c3685b9c7f1 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:31.751759 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-be477453-dfbb-496d-9d81-6c3685b9c7f1 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:31.755881 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-be477453-dfbb-496d-9d81-6c3685b9c7f1 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] 10.222.0.33 "GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7" status: 200 len: 1603 microversion: 2.32 time: 0.481159 Sep 23 04:57:31.759642 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2696/5542] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:57:31 2022] GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 => generated 1603 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:57:32.278749 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-4860f9bd-f874-4aa2-8c8e-0dc0e6207b4e tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bde73a530f4666aebdd5f7d9fa1046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71874a329e54494bb1b84f31c3826205', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:32.310247 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4860f9bd-f874-4aa2-8c8e-0dc0e6207b4e tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] 10.222.0.33 "GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e" status: 200 len: 1677 microversion: 2.1 time: 0.883519 Sep 23 04:57:32.310247 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2847/5543] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:57:31 2022] GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e => generated 1677 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:57:32.438836 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-cf081c06-568e-4fcd-9c65-e4c64d46a28f tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:32.438836 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-cf081c06-568e-4fcd-9c65-e4c64d46a28f tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 9bd2c0e2-8256-484a-bbd5-f21743724671] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:32.450709 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cf081c06-568e-4fcd-9c65-e4c64d46a28f tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:32.451726 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cf081c06-568e-4fcd-9c65-e4c64d46a28f tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:32.452424 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cf081c06-568e-4fcd-9c65-e4c64d46a28f tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:32.454299 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cf081c06-568e-4fcd-9c65-e4c64d46a28f tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:32.455309 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cf081c06-568e-4fcd-9c65-e4c64d46a28f tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:32.455947 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cf081c06-568e-4fcd-9c65-e4c64d46a28f tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:32.791656 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f350f04e-08b0-45bd-bb94-c7742d9803c1 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:32.793193 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f350f04e-08b0-45bd-bb94-c7742d9803c1 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] [instance: 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:32.813266 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f350f04e-08b0-45bd-bb94-c7742d9803c1 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:32.815705 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f350f04e-08b0-45bd-bb94-c7742d9803c1 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:32.818608 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f350f04e-08b0-45bd-bb94-c7742d9803c1 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:32.823645 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f350f04e-08b0-45bd-bb94-c7742d9803c1 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:32.827496 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f350f04e-08b0-45bd-bb94-c7742d9803c1 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:32.829079 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f350f04e-08b0-45bd-bb94-c7742d9803c1 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:32.893576 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-cf081c06-568e-4fcd-9c65-e4c64d46a28f tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:32.906530 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-cf081c06-568e-4fcd-9c65-e4c64d46a28f tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671" status: 200 len: 1693 microversion: 2.1 time: 0.472615 Sep 23 04:57:32.908834 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2697/5544] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:57:32 2022] GET /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671 => generated 1693 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:57:32.976828 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f350f04e-08b0-45bd-bb94-c7742d9803c1 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:32.991493 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f350f04e-08b0-45bd-bb94-c7742d9803c1 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:32.993984 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f350f04e-08b0-45bd-bb94-c7742d9803c1 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:32.995950 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f350f04e-08b0-45bd-bb94-c7742d9803c1 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] 10.222.0.33 "GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7" status: 200 len: 1603 microversion: 2.32 time: 0.209325 Sep 23 04:57:32.997935 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2848/5545] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:57:32 2022] GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 => generated 1603 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:57:33.275232 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5ed82629-2260-4069-99c1-5b3128a68475 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-1573162236", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "networks": [{"uuid": "96463fcc-f63b-41bf-b50a-af1146ec3a4c"}]}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:57:33.352090 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-738f2468-63ef-487a-8782-581ab80568a7 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:33.352090 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-738f2468-63ef-487a-8782-581ab80568a7 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] [instance: 6dfb2418-b235-4d35-b109-4bed20d1b96e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:33.369256 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-738f2468-63ef-487a-8782-581ab80568a7 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:33.369755 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-738f2468-63ef-487a-8782-581ab80568a7 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:33.371144 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-738f2468-63ef-487a-8782-581ab80568a7 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:33.372175 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-738f2468-63ef-487a-8782-581ab80568a7 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:33.375249 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-738f2468-63ef-487a-8782-581ab80568a7 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:33.375249 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-738f2468-63ef-487a-8782-581ab80568a7 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:33.435085 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.network.neutron [None req-5ed82629-2260-4069-99c1-5b3128a68475 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] validate_networks() for [('96463fcc-f63b-41bf-b50a-af1146ec3a4c', None, None, None, None, None)] {{(pid=122698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:57:33.774714 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-738f2468-63ef-487a-8782-581ab80568a7 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bde73a530f4666aebdd5f7d9fa1046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71874a329e54494bb1b84f31c3826205', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:33.787215 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-738f2468-63ef-487a-8782-581ab80568a7 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] 10.222.0.33 "GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e" status: 200 len: 1677 microversion: 2.1 time: 0.444947 Sep 23 04:57:33.788010 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2849/5546] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:57:33 2022] GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e => generated 1677 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:57:33.938343 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6b9b8f7d-0c5a-412d-89d7-991c2771c857 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:33.939622 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-6b9b8f7d-0c5a-412d-89d7-991c2771c857 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 9bd2c0e2-8256-484a-bbd5-f21743724671] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:33.964379 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6b9b8f7d-0c5a-412d-89d7-991c2771c857 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:33.965027 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6b9b8f7d-0c5a-412d-89d7-991c2771c857 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:33.965547 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6b9b8f7d-0c5a-412d-89d7-991c2771c857 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:33.969454 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6b9b8f7d-0c5a-412d-89d7-991c2771c857 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:33.969454 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6b9b8f7d-0c5a-412d-89d7-991c2771c857 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:33.969454 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6b9b8f7d-0c5a-412d-89d7-991c2771c857 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:34.424260 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-6b9b8f7d-0c5a-412d-89d7-991c2771c857 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:34.433329 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6b9b8f7d-0c5a-412d-89d7-991c2771c857 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671" status: 200 len: 1693 microversion: 2.1 time: 0.499974 Sep 23 04:57:34.439815 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2850/5547] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:57:33 2022] GET /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671 => generated 1693 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:57:34.451443 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-da5aafa6-fc71-482a-ac62-04f184fb5f0a tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:34.459782 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-da5aafa6-fc71-482a-ac62-04f184fb5f0a tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] [instance: 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:34.485313 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-da5aafa6-fc71-482a-ac62-04f184fb5f0a tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:34.486115 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-da5aafa6-fc71-482a-ac62-04f184fb5f0a tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:34.486798 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-da5aafa6-fc71-482a-ac62-04f184fb5f0a tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:34.489931 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-da5aafa6-fc71-482a-ac62-04f184fb5f0a tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:34.492734 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-da5aafa6-fc71-482a-ac62-04f184fb5f0a tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:34.493458 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-da5aafa6-fc71-482a-ac62-04f184fb5f0a tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:34.561710 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-5ed82629-2260-4069-99c1-5b3128a68475 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Flavor limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:57:34.561710 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-5ed82629-2260-4069-99c1-5b3128a68475 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Image limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:57:34.561710 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-5ed82629-2260-4069-99c1-5b3128a68475 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Flavor pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:57:34.561710 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-5ed82629-2260-4069-99c1-5b3128a68475 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Image pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:57:34.561710 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-5ed82629-2260-4069-99c1-5b3128a68475 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:57:34.573489 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5ed82629-2260-4069-99c1-5b3128a68475 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:34.578594 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5ed82629-2260-4069-99c1-5b3128a68475 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:34.578967 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5ed82629-2260-4069-99c1-5b3128a68475 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:34.579803 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5ed82629-2260-4069-99c1-5b3128a68475 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:34.580487 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5ed82629-2260-4069-99c1-5b3128a68475 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:34.580940 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5ed82629-2260-4069-99c1-5b3128a68475 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:34.605683 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-da5aafa6-fc71-482a-ac62-04f184fb5f0a tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:34.623082 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-da5aafa6-fc71-482a-ac62-04f184fb5f0a tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:34.626526 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-da5aafa6-fc71-482a-ac62-04f184fb5f0a tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:34.633119 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-da5aafa6-fc71-482a-ac62-04f184fb5f0a tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] 10.222.0.33 "GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7" status: 200 len: 1603 microversion: 2.32 time: 0.189290 Sep 23 04:57:34.633937 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2851/5548] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:57:34 2022] GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 => generated 1603 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:57:34.637151 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-5ed82629-2260-4069-99c1-5b3128a68475 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Getting quotas for project 5e1b229c7b244b61944a0650295dc90a. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:57:34.655311 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-5ed82629-2260-4069-99c1-5b3128a68475 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Getting quotas for user 7d028ec11a7b419dbe7f13c5ecfd7bfd and project 5e1b229c7b244b61944a0650295dc90a. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:57:34.715815 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5ed82629-2260-4069-99c1-5b3128a68475 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Going to run 1 instances... {{(pid=122698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:57:34.719235 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5ed82629-2260-4069-99c1-5b3128a68475 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] [instance: 2441b769-9668-41f1-9857-916c480df090] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:57:34.817261 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-69b18d6b-cd6b-4637-b149-9ad1d59b6b23 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:34.828872 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-69b18d6b-cd6b-4637-b149-9ad1d59b6b23 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] [instance: 6dfb2418-b235-4d35-b109-4bed20d1b96e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:34.836741 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-69b18d6b-cd6b-4637-b149-9ad1d59b6b23 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:34.837462 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-69b18d6b-cd6b-4637-b149-9ad1d59b6b23 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:34.838499 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-69b18d6b-cd6b-4637-b149-9ad1d59b6b23 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:34.839716 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-69b18d6b-cd6b-4637-b149-9ad1d59b6b23 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:34.840330 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-69b18d6b-cd6b-4637-b149-9ad1d59b6b23 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:34.840913 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-69b18d6b-cd6b-4637-b149-9ad1d59b6b23 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:34.891783 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5ed82629-2260-4069-99c1-5b3128a68475 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.979388 Sep 23 04:57:34.899668 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2698/5549] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:57:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1992 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:57:34.915444 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-330d4057-afc8-4341-aaed-fdfd27975d55 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:34.918358 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-330d4057-afc8-4341-aaed-fdfd27975d55 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] [instance: 2441b769-9668-41f1-9857-916c480df090] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:35.147533 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-330d4057-afc8-4341-aaed-fdfd27975d55 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d028ec11a7b419dbe7f13c5ecfd7bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1b229c7b244b61944a0650295dc90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:35.163014 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-330d4057-afc8-4341-aaed-fdfd27975d55 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] 10.222.0.33 "GET /compute/v2.1/servers/2441b769-9668-41f1-9857-916c480df090" status: 200 len: 1216 microversion: 2.1 time: 0.261752 Sep 23 04:57:35.166812 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2699/5550] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:57:34 2022] GET /compute/v2.1/servers/2441b769-9668-41f1-9857-916c480df090 => generated 1216 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:57:35.253039 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-69b18d6b-cd6b-4637-b149-9ad1d59b6b23 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bde73a530f4666aebdd5f7d9fa1046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71874a329e54494bb1b84f31c3826205', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:35.263859 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-69b18d6b-cd6b-4637-b149-9ad1d59b6b23 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] 10.222.0.33 "GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e" status: 200 len: 1677 microversion: 2.1 time: 0.450482 Sep 23 04:57:35.267630 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2852/5551] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:57:34 2022] GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e => generated 1677 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:57:35.460625 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7fd35988-2e43-401c-ab81-ed033ee4614b tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:35.480265 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7fd35988-2e43-401c-ab81-ed033ee4614b tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 9bd2c0e2-8256-484a-bbd5-f21743724671] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:35.503164 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7fd35988-2e43-401c-ab81-ed033ee4614b tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:35.507277 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7fd35988-2e43-401c-ab81-ed033ee4614b tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:35.508224 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7fd35988-2e43-401c-ab81-ed033ee4614b tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:35.509147 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7fd35988-2e43-401c-ab81-ed033ee4614b tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:35.511832 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7fd35988-2e43-401c-ab81-ed033ee4614b tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:35.514007 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7fd35988-2e43-401c-ab81-ed033ee4614b tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:35.664529 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1d0bf489-f9d6-43ca-a5a8-601e8806c0ac tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:35.664715 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1d0bf489-f9d6-43ca-a5a8-601e8806c0ac tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] [instance: 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:35.674012 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1d0bf489-f9d6-43ca-a5a8-601e8806c0ac tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:35.674530 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1d0bf489-f9d6-43ca-a5a8-601e8806c0ac tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:35.675111 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1d0bf489-f9d6-43ca-a5a8-601e8806c0ac tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:35.676148 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1d0bf489-f9d6-43ca-a5a8-601e8806c0ac tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:35.676481 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1d0bf489-f9d6-43ca-a5a8-601e8806c0ac tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:35.676926 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1d0bf489-f9d6-43ca-a5a8-601e8806c0ac tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:35.861043 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1d0bf489-f9d6-43ca-a5a8-601e8806c0ac tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:35.871251 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1d0bf489-f9d6-43ca-a5a8-601e8806c0ac tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:35.872724 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1d0bf489-f9d6-43ca-a5a8-601e8806c0ac tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:35.901273 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1d0bf489-f9d6-43ca-a5a8-601e8806c0ac tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] 10.222.0.33 "GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7" status: 200 len: 1603 microversion: 2.32 time: 0.241491 Sep 23 04:57:35.902331 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2853/5552] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:57:35 2022] GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 => generated 1603 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:57:35.955447 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-7fd35988-2e43-401c-ab81-ed033ee4614b tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:35.974127 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7fd35988-2e43-401c-ab81-ed033ee4614b tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671" status: 200 len: 1693 microversion: 2.1 time: 0.516953 Sep 23 04:57:35.979788 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2700/5553] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:57:35 2022] GET /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671 => generated 1693 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:57:36.191831 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-30d74439-40b7-4b5c-8791-07520d8f6d3d tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:36.192809 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-30d74439-40b7-4b5c-8791-07520d8f6d3d tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] [instance: 2441b769-9668-41f1-9857-916c480df090] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:36.302879 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-cd9f4d4e-c9a0-4331-9994-84ecd907a244 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:36.303901 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-cd9f4d4e-c9a0-4331-9994-84ecd907a244 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] [instance: 6dfb2418-b235-4d35-b109-4bed20d1b96e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:36.313527 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cd9f4d4e-c9a0-4331-9994-84ecd907a244 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:36.314636 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cd9f4d4e-c9a0-4331-9994-84ecd907a244 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:36.315225 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cd9f4d4e-c9a0-4331-9994-84ecd907a244 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:36.317237 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cd9f4d4e-c9a0-4331-9994-84ecd907a244 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:36.318246 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cd9f4d4e-c9a0-4331-9994-84ecd907a244 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:36.318836 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cd9f4d4e-c9a0-4331-9994-84ecd907a244 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:36.383878 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-30d74439-40b7-4b5c-8791-07520d8f6d3d tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d028ec11a7b419dbe7f13c5ecfd7bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1b229c7b244b61944a0650295dc90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:36.392299 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-30d74439-40b7-4b5c-8791-07520d8f6d3d tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] 10.222.0.33 "GET /compute/v2.1/servers/2441b769-9668-41f1-9857-916c480df090" status: 200 len: 1216 microversion: 2.1 time: 0.205222 Sep 23 04:57:36.396819 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2854/5554] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:57:36 2022] GET /compute/v2.1/servers/2441b769-9668-41f1-9857-916c480df090 => generated 1216 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:57:36.929590 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-51f9b31d-929a-48bb-a7f6-fa02d63b19e4 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:36.931042 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-51f9b31d-929a-48bb-a7f6-fa02d63b19e4 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] [instance: 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:36.946003 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-51f9b31d-929a-48bb-a7f6-fa02d63b19e4 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:36.951346 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-51f9b31d-929a-48bb-a7f6-fa02d63b19e4 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:36.954424 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-51f9b31d-929a-48bb-a7f6-fa02d63b19e4 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:36.956344 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-51f9b31d-929a-48bb-a7f6-fa02d63b19e4 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:36.959710 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-51f9b31d-929a-48bb-a7f6-fa02d63b19e4 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:36.960285 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-51f9b31d-929a-48bb-a7f6-fa02d63b19e4 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:37.180418 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-51f9b31d-929a-48bb-a7f6-fa02d63b19e4 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:37.203241 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-51f9b31d-929a-48bb-a7f6-fa02d63b19e4 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:37.203241 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-51f9b31d-929a-48bb-a7f6-fa02d63b19e4 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:37.203241 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-51f9b31d-929a-48bb-a7f6-fa02d63b19e4 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] 10.222.0.33 "GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7" status: 200 len: 1603 microversion: 2.32 time: 0.277595 Sep 23 04:57:37.203241 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2855/5555] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:57:36 2022] GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 => generated 1603 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 04:57:37.208282 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f87df98b-d0db-450d-8004-91084d7f32eb tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:37.209186 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f87df98b-d0db-450d-8004-91084d7f32eb tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 9bd2c0e2-8256-484a-bbd5-f21743724671] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:37.216469 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f87df98b-d0db-450d-8004-91084d7f32eb tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:37.217464 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f87df98b-d0db-450d-8004-91084d7f32eb tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:37.218209 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f87df98b-d0db-450d-8004-91084d7f32eb tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:37.219199 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f87df98b-d0db-450d-8004-91084d7f32eb tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:37.220281 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f87df98b-d0db-450d-8004-91084d7f32eb tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:37.220932 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f87df98b-d0db-450d-8004-91084d7f32eb tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:37.451175 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-cd9f4d4e-c9a0-4331-9994-84ecd907a244 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bde73a530f4666aebdd5f7d9fa1046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71874a329e54494bb1b84f31c3826205', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:37.486771 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-cd9f4d4e-c9a0-4331-9994-84ecd907a244 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] 10.222.0.33 "GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e" status: 200 len: 1677 microversion: 2.1 time: 1.191862 Sep 23 04:57:37.487809 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2701/5556] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:57:36 2022] GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e => generated 1677 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:57:37.497934 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-44e3c3bf-fce7-44f9-9217-f290ea42c2e3 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:37.498766 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-44e3c3bf-fce7-44f9-9217-f290ea42c2e3 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] [instance: 2441b769-9668-41f1-9857-916c480df090] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:37.513388 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-44e3c3bf-fce7-44f9-9217-f290ea42c2e3 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:37.513914 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-44e3c3bf-fce7-44f9-9217-f290ea42c2e3 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:37.514357 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-44e3c3bf-fce7-44f9-9217-f290ea42c2e3 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:37.515606 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-44e3c3bf-fce7-44f9-9217-f290ea42c2e3 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:37.516070 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-44e3c3bf-fce7-44f9-9217-f290ea42c2e3 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:37.516497 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-44e3c3bf-fce7-44f9-9217-f290ea42c2e3 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:37.756394 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-44e3c3bf-fce7-44f9-9217-f290ea42c2e3 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d028ec11a7b419dbe7f13c5ecfd7bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1b229c7b244b61944a0650295dc90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:37.770801 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-44e3c3bf-fce7-44f9-9217-f290ea42c2e3 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] 10.222.0.33 "GET /compute/v2.1/servers/2441b769-9668-41f1-9857-916c480df090" status: 200 len: 1268 microversion: 2.1 time: 0.281054 Sep 23 04:57:37.774278 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2702/5557] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:57:37 2022] GET /compute/v2.1/servers/2441b769-9668-41f1-9857-916c480df090 => generated 1268 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:57:37.868601 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f87df98b-d0db-450d-8004-91084d7f32eb tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:37.886635 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f87df98b-d0db-450d-8004-91084d7f32eb tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671" status: 200 len: 1691 microversion: 2.1 time: 0.682927 Sep 23 04:57:37.894762 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2856/5558] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:57:37 2022] GET /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671 => generated 1691 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:57:38.245787 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-db0d0fcf-b797-401f-a27a-c0093985d75d tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:38.247616 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-db0d0fcf-b797-401f-a27a-c0093985d75d tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] [instance: 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:38.273229 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-db0d0fcf-b797-401f-a27a-c0093985d75d tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:38.278113 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-db0d0fcf-b797-401f-a27a-c0093985d75d tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:38.281494 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-db0d0fcf-b797-401f-a27a-c0093985d75d tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:38.282819 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-db0d0fcf-b797-401f-a27a-c0093985d75d tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:38.284930 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-db0d0fcf-b797-401f-a27a-c0093985d75d tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:38.286668 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-db0d0fcf-b797-401f-a27a-c0093985d75d tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:38.511721 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-72eac5ff-a18e-4c0a-b388-4e0b4e54c1d6 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:38.512312 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-72eac5ff-a18e-4c0a-b388-4e0b4e54c1d6 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] [instance: 6dfb2418-b235-4d35-b109-4bed20d1b96e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:38.525041 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-72eac5ff-a18e-4c0a-b388-4e0b4e54c1d6 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:38.525556 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-72eac5ff-a18e-4c0a-b388-4e0b4e54c1d6 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:38.531496 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-72eac5ff-a18e-4c0a-b388-4e0b4e54c1d6 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:38.532492 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-72eac5ff-a18e-4c0a-b388-4e0b4e54c1d6 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:38.534802 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-db0d0fcf-b797-401f-a27a-c0093985d75d tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:38.539628 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-72eac5ff-a18e-4c0a-b388-4e0b4e54c1d6 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:38.540088 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-72eac5ff-a18e-4c0a-b388-4e0b4e54c1d6 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:38.556344 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-db0d0fcf-b797-401f-a27a-c0093985d75d tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:38.558547 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-db0d0fcf-b797-401f-a27a-c0093985d75d tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:38.561469 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-db0d0fcf-b797-401f-a27a-c0093985d75d tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lazy-loading 'fault' on Instance uuid 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:57:38.681618 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-db0d0fcf-b797-401f-a27a-c0093985d75d tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:38.697834 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-db0d0fcf-b797-401f-a27a-c0093985d75d tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:38.699740 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-db0d0fcf-b797-401f-a27a-c0093985d75d tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f58f4b86f06947268442533ec19ef25d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5513e89bb94c22854ef923561ef0ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:38.706110 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-db0d0fcf-b797-401f-a27a-c0093985d75d tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] 10.222.0.33 "GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7" status: 200 len: 1608 microversion: 2.32 time: 0.465474 Sep 23 04:57:38.708439 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2703/5559] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:57:38 2022] GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 => generated 1608 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 04:57:38.804168 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-bd2f84f6-c6f8-4995-af5c-8eb0d6273422 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:38.805962 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-bd2f84f6-c6f8-4995-af5c-8eb0d6273422 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] [instance: 2441b769-9668-41f1-9857-916c480df090] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:38.840215 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bd2f84f6-c6f8-4995-af5c-8eb0d6273422 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:38.847516 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bd2f84f6-c6f8-4995-af5c-8eb0d6273422 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:38.848545 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bd2f84f6-c6f8-4995-af5c-8eb0d6273422 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:38.854757 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bd2f84f6-c6f8-4995-af5c-8eb0d6273422 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:38.856512 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bd2f84f6-c6f8-4995-af5c-8eb0d6273422 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:38.858177 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bd2f84f6-c6f8-4995-af5c-8eb0d6273422 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:39.029123 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-bd2f84f6-c6f8-4995-af5c-8eb0d6273422 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d028ec11a7b419dbe7f13c5ecfd7bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1b229c7b244b61944a0650295dc90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:39.067991 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-bd2f84f6-c6f8-4995-af5c-8eb0d6273422 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] 10.222.0.33 "GET /compute/v2.1/servers/2441b769-9668-41f1-9857-916c480df090" status: 200 len: 1286 microversion: 2.1 time: 0.274134 Sep 23 04:57:39.069097 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-72eac5ff-a18e-4c0a-b388-4e0b4e54c1d6 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bde73a530f4666aebdd5f7d9fa1046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71874a329e54494bb1b84f31c3826205', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:39.069569 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2704/5560] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:57:38 2022] GET /compute/v2.1/servers/2441b769-9668-41f1-9857-916c480df090 => generated 1286 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:57:39.083322 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-72eac5ff-a18e-4c0a-b388-4e0b4e54c1d6 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] 10.222.0.33 "GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e" status: 200 len: 1677 microversion: 2.1 time: 0.577001 Sep 23 04:57:39.086556 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2857/5561] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:57:38 2022] GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e => generated 1677 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:57:39.089602 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c6df7097-929f-4109-b852-8c66a18fc255 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:39.091938 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c6df7097-929f-4109-b852-8c66a18fc255 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 9bd2c0e2-8256-484a-bbd5-f21743724671] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:39.122860 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c6df7097-929f-4109-b852-8c66a18fc255 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:39.124261 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c6df7097-929f-4109-b852-8c66a18fc255 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:39.125131 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c6df7097-929f-4109-b852-8c66a18fc255 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:39.126229 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c6df7097-929f-4109-b852-8c66a18fc255 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:39.126896 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c6df7097-929f-4109-b852-8c66a18fc255 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:39.127523 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c6df7097-929f-4109-b852-8c66a18fc255 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:39.492883 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c6df7097-929f-4109-b852-8c66a18fc255 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:39.507185 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c6df7097-929f-4109-b852-8c66a18fc255 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671" status: 200 len: 1688 microversion: 2.1 time: 0.434797 Sep 23 04:57:39.511285 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2705/5562] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:57:39 2022] GET /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671 => generated 1688 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:57:39.536412 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-603549d8-4ee5-4925-9add-ac62fe3ea56d tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:57:39.536960 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-603549d8-4ee5-4925-9add-ac62fe3ea56d tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 9bd2c0e2-8256-484a-bbd5-f21743724671] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:39.551717 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-603549d8-4ee5-4925-9add-ac62fe3ea56d tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:39.553248 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-603549d8-4ee5-4925-9add-ac62fe3ea56d tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:39.555193 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-603549d8-4ee5-4925-9add-ac62fe3ea56d tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:39.556315 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-603549d8-4ee5-4925-9add-ac62fe3ea56d tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:39.557441 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-603549d8-4ee5-4925-9add-ac62fe3ea56d tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:39.559699 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-603549d8-4ee5-4925-9add-ac62fe3ea56d tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:39.694468 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=100 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:57:39.740543 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5fd1879a-1135-4b97-85de-0aa4f5ab3621 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:39.741875 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5fd1879a-1135-4b97-85de-0aa4f5ab3621 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] [instance: 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:39.755054 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5fd1879a-1135-4b97-85de-0aa4f5ab3621 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:39.766598 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5fd1879a-1135-4b97-85de-0aa4f5ab3621 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:39.767066 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5fd1879a-1135-4b97-85de-0aa4f5ab3621 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:39.767812 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5fd1879a-1135-4b97-85de-0aa4f5ab3621 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:39.768277 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5fd1879a-1135-4b97-85de-0aa4f5ab3621 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:39.769061 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5fd1879a-1135-4b97-85de-0aa4f5ab3621 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:39.819052 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-5fd1879a-1135-4b97-85de-0aa4f5ab3621 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] HTTP exception thrown: Instance 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 could not be found. Sep 23 04:57:39.820770 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5fd1879a-1135-4b97-85de-0aa4f5ab3621 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Request method failure captured: Sep 23 04:57:39.820770 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 HTTP/1.1 Sep 23 04:57:39.820770 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:57:39.820770 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:57:39.820770 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:57:39.820770 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:57:39.820770 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:57:39.820770 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:57:39.820770 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:57:39.820770 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:57:39.820770 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTr_05znWFojQXNtGxttMrdSSP2-d-5zPFoi4iS_kker39szrBSJZH9sl8iDahlWmAmDeBc7tZDXFYhtg-AuC7-UQqxiLhNbem06tIDbegwD1IBCuJB6FXx22mJ2YEHzqXGLyts8uxcBdgZz9zf-4ojrPGnp1U1ykpUGYe-RHAOey6k Sep 23 04:57:39.820770 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:57:39.820770 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:57:39.820770 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:57:39.820770 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:57:39.820770 n-d-846463-3 devstack@n-api.service[122698]: X-Openstack-Nova-Api-Version: 2.32 Sep 23 04:57:39.820770 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:57:39.820770 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:57:39.820770 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: df5513e89bb94c22854ef923561ef0ef Sep 23 04:57:39.820770 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-TaggedBootDevicesTest-647285811 Sep 23 04:57:39.820770 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:57:39.820770 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:57:39.820770 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_df5513e89bb94c22854ef923561ef0ef", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/df5513e89bb94c22854ef923561ef0ef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/df5513e89bb94c22854ef923561ef0ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/df5513e89bb94c22854ef923561ef0ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:57:39.820770 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-TaggedBootDevicesTest-647285811 Sep 23 04:57:39.820770 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: df5513e89bb94c22854ef923561ef0ef Sep 23 04:57:39.820770 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-TaggedBootDevicesTest-647285811 Sep 23 04:57:39.820770 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-TaggedBootDevicesTest-647285811-project Sep 23 04:57:39.820770 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:57:39.820770 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:57:39.820770 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: f58f4b86f06947268442533ec19ef25d Sep 23 04:57:39.820770 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-TaggedBootDevicesTest-647285811-project Sep 23 04:57:39.820770 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:57:39.820770 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 could not be found. Sep 23 04:57:39.820770 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '49112e3f-73fc-4ee9-b48e-bcda5b7dcda7'} Sep 23 04:57:39.820770 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:57:39.820770 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:57:39.820770 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:57:39.820770 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:57:39.820770 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:57:39.820770 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:57:39.820770 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:57:39.820770 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:57:39.820770 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:57:39.820770 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:57:39.820770 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 could not be found. Sep 23 04:57:39.820770 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:57:39.820770 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:57:39.820770 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:57:39.820770 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:57:39.820770 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:57:39.820770 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:57:39.820770 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:57:39.820770 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:57:39.820770 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:57:39.820770 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:57:39.820770 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:57:39.820770 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:57:39.820770 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:57:39.820770 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:57:39.820770 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:57:39.820770 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:57:39.820770 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 could not be found. Sep 23 04:57:39.820770 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:57:39.820770 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:57:39.820770 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:57:39.834139 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:57:39.834139 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:57:39.834139 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:57:39.834139 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:57:39.834139 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:57:39.834139 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 could not be found. Sep 23 04:57:39.834139 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:57:39.834139 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5fd1879a-1135-4b97-85de-0aa4f5ab3621 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Returning 404 to user: Instance 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:57:39.834139 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5fd1879a-1135-4b97-85de-0aa4f5ab3621 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] 10.222.0.33 "GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7" status: 404 len: 111 microversion: 2.32 time: 0.097955 Sep 23 04:57:39.835510 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2706/5563] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:57:39 2022] GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 23 04:57:39.855991 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c40b54bb-bcdc-495b-a66c-e04ada6e2052 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Calling method '.version_select at 0x7ff1bab2b3a0>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:39.976705 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c40b54bb-bcdc-495b-a66c-e04ada6e2052 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-881461369" status: 204 len: 0 microversion: 2.32 time: 0.133695 Sep 23 04:57:39.978001 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2707/5564] 10.222.0.33 () {60 vars in 1259 bytes} [Fri Sep 23 04:57:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-881461369 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 23 04:57:40.102649 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-603549d8-4ee5-4925-9add-ac62fe3ea56d tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "POST /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671/action" status: 202 len: 0 microversion: 2.1 time: 0.568553 Sep 23 04:57:40.121932 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2858/5565] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:57:39 2022] POST /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671/action => generated 0 bytes in 591 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:57:40.134945 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9eb93340-52bb-4c74-98b8-cf8f7013e38c tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:40.136842 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-9eb93340-52bb-4c74-98b8-cf8f7013e38c tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] [instance: 2441b769-9668-41f1-9857-916c480df090] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:40.137498 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-83f13002-54ef-4d9e-9e23-8ec6387fb15d tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:40.141429 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-83f13002-54ef-4d9e-9e23-8ec6387fb15d tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] [instance: 6dfb2418-b235-4d35-b109-4bed20d1b96e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:40.163840 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-83f13002-54ef-4d9e-9e23-8ec6387fb15d tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:40.164664 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-83f13002-54ef-4d9e-9e23-8ec6387fb15d tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:40.166236 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-83f13002-54ef-4d9e-9e23-8ec6387fb15d tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:40.167376 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9eb93340-52bb-4c74-98b8-cf8f7013e38c tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:40.168978 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9eb93340-52bb-4c74-98b8-cf8f7013e38c tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:40.169650 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-83f13002-54ef-4d9e-9e23-8ec6387fb15d tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:40.170407 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-83f13002-54ef-4d9e-9e23-8ec6387fb15d tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:40.172245 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-83f13002-54ef-4d9e-9e23-8ec6387fb15d tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:40.174037 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9eb93340-52bb-4c74-98b8-cf8f7013e38c tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:40.175473 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9eb93340-52bb-4c74-98b8-cf8f7013e38c tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:40.175978 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9eb93340-52bb-4c74-98b8-cf8f7013e38c tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:40.179873 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9eb93340-52bb-4c74-98b8-cf8f7013e38c tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:40.359563 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-9eb93340-52bb-4c74-98b8-cf8f7013e38c tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d028ec11a7b419dbe7f13c5ecfd7bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1b229c7b244b61944a0650295dc90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:40.375433 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9eb93340-52bb-4c74-98b8-cf8f7013e38c tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] 10.222.0.33 "GET /compute/v2.1/servers/2441b769-9668-41f1-9857-916c480df090" status: 200 len: 1274 microversion: 2.1 time: 0.262068 Sep 23 04:57:40.381037 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2708/5566] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:57:40 2022] GET /compute/v2.1/servers/2441b769-9668-41f1-9857-916c480df090 => generated 1274 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:57:40.400272 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-49d50952-ec25-445c-a326-7e3710d3d690 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:40.401111 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-49d50952-ec25-445c-a326-7e3710d3d690 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 9bd2c0e2-8256-484a-bbd5-f21743724671] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:40.415930 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-49d50952-ec25-445c-a326-7e3710d3d690 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:40.416817 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-49d50952-ec25-445c-a326-7e3710d3d690 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:40.417665 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-49d50952-ec25-445c-a326-7e3710d3d690 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:40.418836 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-49d50952-ec25-445c-a326-7e3710d3d690 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:40.419472 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-49d50952-ec25-445c-a326-7e3710d3d690 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:40.420050 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-49d50952-ec25-445c-a326-7e3710d3d690 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:40.470003 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-83f13002-54ef-4d9e-9e23-8ec6387fb15d tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bde73a530f4666aebdd5f7d9fa1046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71874a329e54494bb1b84f31c3826205', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:40.478329 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-83f13002-54ef-4d9e-9e23-8ec6387fb15d tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] 10.222.0.33 "GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e" status: 200 len: 1654 microversion: 2.1 time: 0.354166 Sep 23 04:57:40.484354 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2859/5567] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:57:40 2022] GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e => generated 1654 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:57:40.503922 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1cfea1d2-4cc0-481f-be04-5799d10a65ab tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:57:40.513369 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1cfea1d2-4cc0-481f-be04-5799d10a65ab tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:40.513875 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1cfea1d2-4cc0-481f-be04-5799d10a65ab tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:40.514371 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1cfea1d2-4cc0-481f-be04-5799d10a65ab tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:40.539552 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1cfea1d2-4cc0-481f-be04-5799d10a65ab tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] [instance: 6dfb2418-b235-4d35-b109-4bed20d1b96e] Going to try to start instance {{(pid=122699) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 23 04:57:40.720547 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-49d50952-ec25-445c-a326-7e3710d3d690 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:40.729879 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-49d50952-ec25-445c-a326-7e3710d3d690 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671" status: 200 len: 1687 microversion: 2.1 time: 0.347329 Sep 23 04:57:40.741927 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2709/5568] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:57:40 2022] GET /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671 => generated 1687 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:57:40.839765 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1cfea1d2-4cc0-481f-be04-5799d10a65ab tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] 10.222.0.33 "POST /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e/action" status: 202 len: 0 microversion: 2.1 time: 0.339489 Sep 23 04:57:40.840726 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2860/5569] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:57:40 2022] POST /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e/action => generated 0 bytes in 341 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 23 04:57:40.852070 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5db36d7f-9823-4ad9-b92c-c1b141cead39 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:40.853137 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5db36d7f-9823-4ad9-b92c-c1b141cead39 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] [instance: 6dfb2418-b235-4d35-b109-4bed20d1b96e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:40.865079 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5db36d7f-9823-4ad9-b92c-c1b141cead39 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:40.867126 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5db36d7f-9823-4ad9-b92c-c1b141cead39 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:40.867801 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5db36d7f-9823-4ad9-b92c-c1b141cead39 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:40.869408 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5db36d7f-9823-4ad9-b92c-c1b141cead39 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:40.871426 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5db36d7f-9823-4ad9-b92c-c1b141cead39 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:40.872084 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5db36d7f-9823-4ad9-b92c-c1b141cead39 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:41.162871 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-5db36d7f-9823-4ad9-b92c-c1b141cead39 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bde73a530f4666aebdd5f7d9fa1046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71874a329e54494bb1b84f31c3826205', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:41.174551 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5db36d7f-9823-4ad9-b92c-c1b141cead39 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] 10.222.0.33 "GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e" status: 200 len: 1663 microversion: 2.1 time: 0.326407 Sep 23 04:57:41.176960 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2710/5570] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:57:40 2022] GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e => generated 1663 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:57:41.410264 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6cf23461-6d3e-4aa3-b056-785704bfc1ea tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:41.416310 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-6cf23461-6d3e-4aa3-b056-785704bfc1ea tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] [instance: 2441b769-9668-41f1-9857-916c480df090] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:41.425940 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6cf23461-6d3e-4aa3-b056-785704bfc1ea tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:41.426433 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6cf23461-6d3e-4aa3-b056-785704bfc1ea tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:41.426882 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6cf23461-6d3e-4aa3-b056-785704bfc1ea tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:41.427661 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6cf23461-6d3e-4aa3-b056-785704bfc1ea tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:41.428132 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6cf23461-6d3e-4aa3-b056-785704bfc1ea tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:41.428562 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6cf23461-6d3e-4aa3-b056-785704bfc1ea tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:41.759486 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-cfb0ea61-64dc-4e6d-ab1b-56e62095479d tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:41.760106 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-cfb0ea61-64dc-4e6d-ab1b-56e62095479d tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 9bd2c0e2-8256-484a-bbd5-f21743724671] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:41.771346 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cfb0ea61-64dc-4e6d-ab1b-56e62095479d tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:41.775653 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cfb0ea61-64dc-4e6d-ab1b-56e62095479d tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:41.775653 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cfb0ea61-64dc-4e6d-ab1b-56e62095479d tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:41.775653 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cfb0ea61-64dc-4e6d-ab1b-56e62095479d tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:41.775653 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cfb0ea61-64dc-4e6d-ab1b-56e62095479d tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:41.775653 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cfb0ea61-64dc-4e6d-ab1b-56e62095479d tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:41.843374 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-6cf23461-6d3e-4aa3-b056-785704bfc1ea tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d028ec11a7b419dbe7f13c5ecfd7bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1b229c7b244b61944a0650295dc90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:41.891142 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6cf23461-6d3e-4aa3-b056-785704bfc1ea tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] 10.222.0.33 "GET /compute/v2.1/servers/2441b769-9668-41f1-9857-916c480df090" status: 200 len: 1274 microversion: 2.1 time: 0.486056 Sep 23 04:57:41.933244 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2861/5571] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:57:41 2022] GET /compute/v2.1/servers/2441b769-9668-41f1-9857-916c480df090 => generated 1274 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:57:42.190580 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-cfb0ea61-64dc-4e6d-ab1b-56e62095479d tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:42.202871 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-cfb0ea61-64dc-4e6d-ab1b-56e62095479d tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671" status: 200 len: 1687 microversion: 2.1 time: 0.447472 Sep 23 04:57:42.203476 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2711/5572] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:57:41 2022] GET /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671 => generated 1687 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:57:42.208494 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b42cf6e8-279f-4c51-ae73-c3953ad0dac0 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:42.210849 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b42cf6e8-279f-4c51-ae73-c3953ad0dac0 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] [instance: 6dfb2418-b235-4d35-b109-4bed20d1b96e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:42.224107 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b42cf6e8-279f-4c51-ae73-c3953ad0dac0 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:42.227893 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b42cf6e8-279f-4c51-ae73-c3953ad0dac0 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:42.228881 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b42cf6e8-279f-4c51-ae73-c3953ad0dac0 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:42.229989 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b42cf6e8-279f-4c51-ae73-c3953ad0dac0 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:42.230769 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b42cf6e8-279f-4c51-ae73-c3953ad0dac0 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:42.231344 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b42cf6e8-279f-4c51-ae73-c3953ad0dac0 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:42.726703 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b42cf6e8-279f-4c51-ae73-c3953ad0dac0 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bde73a530f4666aebdd5f7d9fa1046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71874a329e54494bb1b84f31c3826205', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:42.743264 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b42cf6e8-279f-4c51-ae73-c3953ad0dac0 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] 10.222.0.33 "GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e" status: 200 len: 1663 microversion: 2.1 time: 0.544528 Sep 23 04:57:42.744384 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2862/5573] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:57:42 2022] GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e => generated 1663 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:57:42.918787 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-fa29c184-bbe2-486a-aaef-62dad34434d7 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:42.919415 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-fa29c184-bbe2-486a-aaef-62dad34434d7 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] [instance: 2441b769-9668-41f1-9857-916c480df090] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:42.928845 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fa29c184-bbe2-486a-aaef-62dad34434d7 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:42.929349 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fa29c184-bbe2-486a-aaef-62dad34434d7 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:42.930064 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fa29c184-bbe2-486a-aaef-62dad34434d7 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:42.932941 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fa29c184-bbe2-486a-aaef-62dad34434d7 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:42.933575 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fa29c184-bbe2-486a-aaef-62dad34434d7 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:42.934186 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fa29c184-bbe2-486a-aaef-62dad34434d7 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:43.232892 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-27c7f558-0954-4907-8202-93ee05419cc4 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:43.234002 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-27c7f558-0954-4907-8202-93ee05419cc4 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 9bd2c0e2-8256-484a-bbd5-f21743724671] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:43.248090 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-27c7f558-0954-4907-8202-93ee05419cc4 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:43.248594 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-27c7f558-0954-4907-8202-93ee05419cc4 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:43.249190 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-27c7f558-0954-4907-8202-93ee05419cc4 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:43.249950 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-27c7f558-0954-4907-8202-93ee05419cc4 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:43.253200 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-27c7f558-0954-4907-8202-93ee05419cc4 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:43.253682 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-27c7f558-0954-4907-8202-93ee05419cc4 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:43.650942 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-fa29c184-bbe2-486a-aaef-62dad34434d7 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d028ec11a7b419dbe7f13c5ecfd7bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1b229c7b244b61944a0650295dc90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:43.663431 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-fa29c184-bbe2-486a-aaef-62dad34434d7 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] 10.222.0.33 "GET /compute/v2.1/servers/2441b769-9668-41f1-9857-916c480df090" status: 200 len: 1316 microversion: 2.1 time: 0.744495 Sep 23 04:57:43.678296 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2712/5574] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:57:42 2022] GET /compute/v2.1/servers/2441b769-9668-41f1-9857-916c480df090 => generated 1316 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:57:43.690833 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-e0208c02-9382-40f5-b47b-ccd3bf0afc49 req-26b16554-b8e7-4f55-b852-82f62275bdfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bd2c0e2-8256-484a-bbd5-f21743724671", "name": "network-vif-plugged", "status": "completed", "tag": "909994da-1d1c-4fc5-955f-cc0ae5196ea8"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:57:43.695513 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-e0208c02-9382-40f5-b47b-ccd3bf0afc49 req-26b16554-b8e7-4f55-b852-82f62275bdfd service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:43.696238 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-e0208c02-9382-40f5-b47b-ccd3bf0afc49 req-26b16554-b8e7-4f55-b852-82f62275bdfd service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:43.696880 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-e0208c02-9382-40f5-b47b-ccd3bf0afc49 req-26b16554-b8e7-4f55-b852-82f62275bdfd service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:43.711791 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-e0208c02-9382-40f5-b47b-ccd3bf0afc49 req-26b16554-b8e7-4f55-b852-82f62275bdfd service nova] Creating event network-vif-plugged:909994da-1d1c-4fc5-955f-cc0ae5196ea8 for instance 9bd2c0e2-8256-484a-bbd5-f21743724671 on n-h1-846463-3 Sep 23 04:57:43.718634 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [req-e0208c02-9382-40f5-b47b-ccd3bf0afc49 req-26b16554-b8e7-4f55-b852-82f62275bdfd service nova] Instance 9bd2c0e2-8256-484a-bbd5-f21743724671 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846463-3', 'n-h2-846463-3'} {{(pid=122698) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 23 04:57:43.730927 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-e0208c02-9382-40f5-b47b-ccd3bf0afc49 req-26b16554-b8e7-4f55-b852-82f62275bdfd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050142 Sep 23 04:57:43.731798 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2713/5575] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:57:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:57:43.769295 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5f487bad-e01b-47b7-8f7f-89ec28ef1a4e tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:43.770305 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5f487bad-e01b-47b7-8f7f-89ec28ef1a4e tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] [instance: 6dfb2418-b235-4d35-b109-4bed20d1b96e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:43.783150 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5f487bad-e01b-47b7-8f7f-89ec28ef1a4e tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:43.783963 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5f487bad-e01b-47b7-8f7f-89ec28ef1a4e tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:43.784741 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5f487bad-e01b-47b7-8f7f-89ec28ef1a4e tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:43.785992 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5f487bad-e01b-47b7-8f7f-89ec28ef1a4e tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:43.786645 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5f487bad-e01b-47b7-8f7f-89ec28ef1a4e tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:43.790297 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5f487bad-e01b-47b7-8f7f-89ec28ef1a4e tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:44.223855 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-27c7f558-0954-4907-8202-93ee05419cc4 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:44.242575 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-27c7f558-0954-4907-8202-93ee05419cc4 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671" status: 200 len: 1687 microversion: 2.1 time: 1.014377 Sep 23 04:57:44.243282 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2863/5576] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:57:43 2022] GET /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671 => generated 1687 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:57:44.400544 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-5f487bad-e01b-47b7-8f7f-89ec28ef1a4e tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bde73a530f4666aebdd5f7d9fa1046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71874a329e54494bb1b84f31c3826205', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:44.404754 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=100 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:57:44.412144 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5f487bad-e01b-47b7-8f7f-89ec28ef1a4e tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] 10.222.0.33 "GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e" status: 200 len: 1663 microversion: 2.1 time: 0.648100 Sep 23 04:57:44.425814 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2714/5577] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:57:43 2022] GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e => generated 1663 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:57:44.449851 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-052798c2-d2d7-4d6e-b0d2-de7ea5655cd2 req-4e92201a-5ca4-4dab-978e-b178cdfe3029 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2441b769-9668-41f1-9857-916c480df090", "tag": "74cba2e3-7608-4bda-baae-d29cae296501"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:57:44.458441 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=74 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:57:44.469024 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-052798c2-d2d7-4d6e-b0d2-de7ea5655cd2 req-4e92201a-5ca4-4dab-978e-b178cdfe3029 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:44.469229 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-052798c2-d2d7-4d6e-b0d2-de7ea5655cd2 req-4e92201a-5ca4-4dab-978e-b178cdfe3029 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:44.470126 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-052798c2-d2d7-4d6e-b0d2-de7ea5655cd2 req-4e92201a-5ca4-4dab-978e-b178cdfe3029 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:44.500262 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-052798c2-d2d7-4d6e-b0d2-de7ea5655cd2 req-4e92201a-5ca4-4dab-978e-b178cdfe3029 service nova] Creating event network-changed:74cba2e3-7608-4bda-baae-d29cae296501 for instance 2441b769-9668-41f1-9857-916c480df090 on n-h2-846463-3 Sep 23 04:57:44.510824 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-052798c2-d2d7-4d6e-b0d2-de7ea5655cd2 req-4e92201a-5ca4-4dab-978e-b178cdfe3029 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069318 Sep 23 04:57:44.512235 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2864/5578] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:57:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:57:44.693731 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a85af982-5a10-4fd3-b583-5d13159bd185 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:44.696758 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a85af982-5a10-4fd3-b583-5d13159bd185 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] [instance: 2441b769-9668-41f1-9857-916c480df090] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:44.699285 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:57:44.705835 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a85af982-5a10-4fd3-b583-5d13159bd185 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:44.706909 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a85af982-5a10-4fd3-b583-5d13159bd185 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:44.707983 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a85af982-5a10-4fd3-b583-5d13159bd185 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:44.709399 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a85af982-5a10-4fd3-b583-5d13159bd185 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:44.710080 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a85af982-5a10-4fd3-b583-5d13159bd185 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:44.710691 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a85af982-5a10-4fd3-b583-5d13159bd185 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:45.000696 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a85af982-5a10-4fd3-b583-5d13159bd185 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d028ec11a7b419dbe7f13c5ecfd7bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1b229c7b244b61944a0650295dc90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:45.029219 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a85af982-5a10-4fd3-b583-5d13159bd185 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] 10.222.0.33 "GET /compute/v2.1/servers/2441b769-9668-41f1-9857-916c480df090" status: 200 len: 1316 microversion: 2.1 time: 0.342907 Sep 23 04:57:45.032217 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2715/5579] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:57:44 2022] GET /compute/v2.1/servers/2441b769-9668-41f1-9857-916c480df090 => generated 1316 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:57:45.270997 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1c1c2c28-979d-4bd6-b8f0-b2eec385005a tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:45.271749 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1c1c2c28-979d-4bd6-b8f0-b2eec385005a tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 9bd2c0e2-8256-484a-bbd5-f21743724671] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:45.295552 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1c1c2c28-979d-4bd6-b8f0-b2eec385005a tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:45.300006 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1c1c2c28-979d-4bd6-b8f0-b2eec385005a tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:45.307274 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1c1c2c28-979d-4bd6-b8f0-b2eec385005a tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:45.307274 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1c1c2c28-979d-4bd6-b8f0-b2eec385005a tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:45.308919 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1c1c2c28-979d-4bd6-b8f0-b2eec385005a tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:45.313359 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1c1c2c28-979d-4bd6-b8f0-b2eec385005a tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:45.441174 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-36b28f45-acf4-4f37-afe6-071902aa2dc3 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:45.441926 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-36b28f45-acf4-4f37-afe6-071902aa2dc3 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] [instance: 6dfb2418-b235-4d35-b109-4bed20d1b96e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:45.446084 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=8 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:57:45.450454 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-36b28f45-acf4-4f37-afe6-071902aa2dc3 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:45.450950 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-36b28f45-acf4-4f37-afe6-071902aa2dc3 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:45.451393 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-36b28f45-acf4-4f37-afe6-071902aa2dc3 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:45.452139 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-36b28f45-acf4-4f37-afe6-071902aa2dc3 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:45.452604 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-36b28f45-acf4-4f37-afe6-071902aa2dc3 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:45.453020 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-36b28f45-acf4-4f37-afe6-071902aa2dc3 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:46.215100 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1c1c2c28-979d-4bd6-b8f0-b2eec385005a tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:46.224787 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1c1c2c28-979d-4bd6-b8f0-b2eec385005a tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671" status: 200 len: 1687 microversion: 2.1 time: 0.960702 Sep 23 04:57:46.225604 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2865/5580] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:57:45 2022] GET /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671 => generated 1687 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:57:46.230469 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-20aa6946-4b2b-4095-80b1-664055444641 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:46.231141 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-20aa6946-4b2b-4095-80b1-664055444641 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] [instance: 2441b769-9668-41f1-9857-916c480df090] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:46.237913 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-20aa6946-4b2b-4095-80b1-664055444641 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:46.238443 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-20aa6946-4b2b-4095-80b1-664055444641 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:46.238883 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-20aa6946-4b2b-4095-80b1-664055444641 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:46.239742 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-20aa6946-4b2b-4095-80b1-664055444641 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:46.240341 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-20aa6946-4b2b-4095-80b1-664055444641 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:46.244143 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-20aa6946-4b2b-4095-80b1-664055444641 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:46.306524 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-36b28f45-acf4-4f37-afe6-071902aa2dc3 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bde73a530f4666aebdd5f7d9fa1046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71874a329e54494bb1b84f31c3826205', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:46.313156 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-36b28f45-acf4-4f37-afe6-071902aa2dc3 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] 10.222.0.33 "GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e" status: 200 len: 1667 microversion: 2.1 time: 0.876892 Sep 23 04:57:46.314771 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2716/5581] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:57:45 2022] GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e => generated 1667 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:57:46.392956 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:57:46.496887 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-20aa6946-4b2b-4095-80b1-664055444641 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d028ec11a7b419dbe7f13c5ecfd7bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1b229c7b244b61944a0650295dc90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:46.512625 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-20aa6946-4b2b-4095-80b1-664055444641 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] 10.222.0.33 "GET /compute/v2.1/servers/2441b769-9668-41f1-9857-916c480df090" status: 200 len: 1316 microversion: 2.1 time: 0.285725 Sep 23 04:57:46.513522 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2866/5582] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:57:46 2022] GET /compute/v2.1/servers/2441b769-9668-41f1-9857-916c480df090 => generated 1316 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:57:47.250866 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-37d8a5bc-ecc3-4316-b696-f91dc96c46c5 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:47.251501 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-37d8a5bc-ecc3-4316-b696-f91dc96c46c5 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 9bd2c0e2-8256-484a-bbd5-f21743724671] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:47.258896 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:57:47.260079 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-37d8a5bc-ecc3-4316-b696-f91dc96c46c5 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:47.260806 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-37d8a5bc-ecc3-4316-b696-f91dc96c46c5 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:47.261260 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-37d8a5bc-ecc3-4316-b696-f91dc96c46c5 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:47.262012 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-37d8a5bc-ecc3-4316-b696-f91dc96c46c5 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:47.262487 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-37d8a5bc-ecc3-4316-b696-f91dc96c46c5 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:47.267465 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-37d8a5bc-ecc3-4316-b696-f91dc96c46c5 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:47.541031 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2f1cd123-d093-4a7a-a03f-a3bb27ace3c8 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:47.542676 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-2f1cd123-d093-4a7a-a03f-a3bb27ace3c8 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] [instance: 2441b769-9668-41f1-9857-916c480df090] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:47.550238 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2f1cd123-d093-4a7a-a03f-a3bb27ace3c8 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:47.551066 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2f1cd123-d093-4a7a-a03f-a3bb27ace3c8 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:47.551507 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2f1cd123-d093-4a7a-a03f-a3bb27ace3c8 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:47.552458 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2f1cd123-d093-4a7a-a03f-a3bb27ace3c8 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:47.553129 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2f1cd123-d093-4a7a-a03f-a3bb27ace3c8 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:47.553959 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2f1cd123-d093-4a7a-a03f-a3bb27ace3c8 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:47.886660 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-37d8a5bc-ecc3-4316-b696-f91dc96c46c5 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:47.897345 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-37d8a5bc-ecc3-4316-b696-f91dc96c46c5 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671" status: 200 len: 1687 microversion: 2.1 time: 0.650741 Sep 23 04:57:47.897921 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2717/5583] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:57:47 2022] GET /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671 => generated 1687 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:57:47.902894 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-7d4ac77e-a7a2-4442-b598-8fb6428480f7 req-8abecc2a-5cd2-4fa7-ab78-e70ee576bdf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bd2c0e2-8256-484a-bbd5-f21743724671", "name": "network-vif-unplugged", "status": "completed", "tag": "909994da-1d1c-4fc5-955f-cc0ae5196ea8"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:57:47.914749 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-7d4ac77e-a7a2-4442-b598-8fb6428480f7 req-8abecc2a-5cd2-4fa7-ab78-e70ee576bdf1 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:47.915492 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-7d4ac77e-a7a2-4442-b598-8fb6428480f7 req-8abecc2a-5cd2-4fa7-ab78-e70ee576bdf1 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:47.916108 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-7d4ac77e-a7a2-4442-b598-8fb6428480f7 req-8abecc2a-5cd2-4fa7-ab78-e70ee576bdf1 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:47.933600 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-7d4ac77e-a7a2-4442-b598-8fb6428480f7 req-8abecc2a-5cd2-4fa7-ab78-e70ee576bdf1 service nova] Creating event network-vif-unplugged:909994da-1d1c-4fc5-955f-cc0ae5196ea8 for instance 9bd2c0e2-8256-484a-bbd5-f21743724671 on n-h2-846463-3 Sep 23 04:57:47.939724 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [req-7d4ac77e-a7a2-4442-b598-8fb6428480f7 req-8abecc2a-5cd2-4fa7-ab78-e70ee576bdf1 service nova] Instance 9bd2c0e2-8256-484a-bbd5-f21743724671 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846463-3', 'n-h2-846463-3'} {{(pid=122698) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 23 04:57:47.954648 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-7d4ac77e-a7a2-4442-b598-8fb6428480f7 req-8abecc2a-5cd2-4fa7-ab78-e70ee576bdf1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055330 Sep 23 04:57:47.955407 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2718/5584] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:57:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:57:48.056064 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2f1cd123-d093-4a7a-a03f-a3bb27ace3c8 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d028ec11a7b419dbe7f13c5ecfd7bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1b229c7b244b61944a0650295dc90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:48.074172 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2f1cd123-d093-4a7a-a03f-a3bb27ace3c8 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] 10.222.0.33 "GET /compute/v2.1/servers/2441b769-9668-41f1-9857-916c480df090" status: 200 len: 1316 microversion: 2.1 time: 0.537025 Sep 23 04:57:48.078084 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2867/5585] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:57:47 2022] GET /compute/v2.1/servers/2441b769-9668-41f1-9857-916c480df090 => generated 1316 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:57:48.934434 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-05d4dd52-da24-44a6-8370-8168efbd673d tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:48.940164 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-05d4dd52-da24-44a6-8370-8168efbd673d tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 9bd2c0e2-8256-484a-bbd5-f21743724671] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:48.960208 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-05d4dd52-da24-44a6-8370-8168efbd673d tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:48.962275 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-05d4dd52-da24-44a6-8370-8168efbd673d tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:48.963127 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-05d4dd52-da24-44a6-8370-8168efbd673d tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:48.964513 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-05d4dd52-da24-44a6-8370-8168efbd673d tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:48.965560 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-05d4dd52-da24-44a6-8370-8168efbd673d tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:48.968884 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-05d4dd52-da24-44a6-8370-8168efbd673d tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:49.105825 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-435fc3c3-9c99-410a-b8f1-b1995345d4b8 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:49.106445 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-435fc3c3-9c99-410a-b8f1-b1995345d4b8 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] [instance: 2441b769-9668-41f1-9857-916c480df090] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:49.118889 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-435fc3c3-9c99-410a-b8f1-b1995345d4b8 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:49.119397 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-435fc3c3-9c99-410a-b8f1-b1995345d4b8 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:49.119848 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-435fc3c3-9c99-410a-b8f1-b1995345d4b8 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:49.120570 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-435fc3c3-9c99-410a-b8f1-b1995345d4b8 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:49.121041 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-435fc3c3-9c99-410a-b8f1-b1995345d4b8 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:49.125601 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-435fc3c3-9c99-410a-b8f1-b1995345d4b8 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:49.797285 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-435fc3c3-9c99-410a-b8f1-b1995345d4b8 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d028ec11a7b419dbe7f13c5ecfd7bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1b229c7b244b61944a0650295dc90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:49.807154 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-435fc3c3-9c99-410a-b8f1-b1995345d4b8 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] 10.222.0.33 "GET /compute/v2.1/servers/2441b769-9668-41f1-9857-916c480df090" status: 200 len: 1316 microversion: 2.1 time: 0.710109 Sep 23 04:57:49.808278 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2868/5586] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:57:49 2022] GET /compute/v2.1/servers/2441b769-9668-41f1-9857-916c480df090 => generated 1316 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:57:49.875326 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-05d4dd52-da24-44a6-8370-8168efbd673d tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:49.891367 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-05d4dd52-da24-44a6-8370-8168efbd673d tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671" status: 200 len: 1687 microversion: 2.1 time: 0.972023 Sep 23 04:57:49.893015 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2719/5587] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:57:48 2022] GET /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671 => generated 1687 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:57:49.974883 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-8f4787bd-5ac5-4a6b-aefe-8660e612b71e req-fa3cf2db-c9b9-44bc-99a9-7e97a6d7a73d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bd2c0e2-8256-484a-bbd5-f21743724671", "tag": "909994da-1d1c-4fc5-955f-cc0ae5196ea8"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:57:49.998645 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-8f4787bd-5ac5-4a6b-aefe-8660e612b71e req-fa3cf2db-c9b9-44bc-99a9-7e97a6d7a73d service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:49.999945 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-8f4787bd-5ac5-4a6b-aefe-8660e612b71e req-fa3cf2db-c9b9-44bc-99a9-7e97a6d7a73d service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:50.000698 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-8f4787bd-5ac5-4a6b-aefe-8660e612b71e req-fa3cf2db-c9b9-44bc-99a9-7e97a6d7a73d service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:50.034583 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-8f4787bd-5ac5-4a6b-aefe-8660e612b71e req-fa3cf2db-c9b9-44bc-99a9-7e97a6d7a73d service nova] Creating event network-changed:909994da-1d1c-4fc5-955f-cc0ae5196ea8 for instance 9bd2c0e2-8256-484a-bbd5-f21743724671 on n-h2-846463-3 Sep 23 04:57:50.047701 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [req-8f4787bd-5ac5-4a6b-aefe-8660e612b71e req-fa3cf2db-c9b9-44bc-99a9-7e97a6d7a73d service nova] Instance 9bd2c0e2-8256-484a-bbd5-f21743724671 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846463-3', 'n-h2-846463-3'} {{(pid=122699) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 23 04:57:50.075204 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-8f4787bd-5ac5-4a6b-aefe-8660e612b71e req-fa3cf2db-c9b9-44bc-99a9-7e97a6d7a73d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106096 Sep 23 04:57:50.081780 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2869/5588] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:57:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:57:50.840105 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0546149d-7f12-40ad-a920-3797fd538a1b tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:50.841215 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-0546149d-7f12-40ad-a920-3797fd538a1b tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] [instance: 2441b769-9668-41f1-9857-916c480df090] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:50.852417 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0546149d-7f12-40ad-a920-3797fd538a1b tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:50.853106 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0546149d-7f12-40ad-a920-3797fd538a1b tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:50.853724 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0546149d-7f12-40ad-a920-3797fd538a1b tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:50.854817 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0546149d-7f12-40ad-a920-3797fd538a1b tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:50.855427 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0546149d-7f12-40ad-a920-3797fd538a1b tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:50.858627 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0546149d-7f12-40ad-a920-3797fd538a1b tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:50.919442 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b601afa0-f115-40db-948f-6c53a2ae2eea tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:50.921638 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b601afa0-f115-40db-948f-6c53a2ae2eea tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 9bd2c0e2-8256-484a-bbd5-f21743724671] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:50.935482 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b601afa0-f115-40db-948f-6c53a2ae2eea tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:50.935933 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b601afa0-f115-40db-948f-6c53a2ae2eea tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:50.936960 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b601afa0-f115-40db-948f-6c53a2ae2eea tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:50.941866 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b601afa0-f115-40db-948f-6c53a2ae2eea tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:50.941866 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b601afa0-f115-40db-948f-6c53a2ae2eea tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:50.941866 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b601afa0-f115-40db-948f-6c53a2ae2eea tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:51.375870 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-0546149d-7f12-40ad-a920-3797fd538a1b tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d028ec11a7b419dbe7f13c5ecfd7bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1b229c7b244b61944a0650295dc90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:51.396185 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0546149d-7f12-40ad-a920-3797fd538a1b tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] 10.222.0.33 "GET /compute/v2.1/servers/2441b769-9668-41f1-9857-916c480df090" status: 200 len: 1316 microversion: 2.1 time: 0.562323 Sep 23 04:57:51.397104 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2720/5589] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:57:50 2022] GET /compute/v2.1/servers/2441b769-9668-41f1-9857-916c480df090 => generated 1316 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:57:51.401682 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-9c677afb-cf6e-48ae-abda-0186a74785a5 req-17edfd7a-b646-41f4-a3b6-b3f471c28652 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2441b769-9668-41f1-9857-916c480df090", "name": "network-vif-plugged", "status": "completed", "tag": "74cba2e3-7608-4bda-baae-d29cae296501"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:57:51.426096 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-9c677afb-cf6e-48ae-abda-0186a74785a5 req-17edfd7a-b646-41f4-a3b6-b3f471c28652 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:51.426815 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-9c677afb-cf6e-48ae-abda-0186a74785a5 req-17edfd7a-b646-41f4-a3b6-b3f471c28652 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:51.427421 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-9c677afb-cf6e-48ae-abda-0186a74785a5 req-17edfd7a-b646-41f4-a3b6-b3f471c28652 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:51.442224 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-9c677afb-cf6e-48ae-abda-0186a74785a5 req-17edfd7a-b646-41f4-a3b6-b3f471c28652 service nova] Creating event network-vif-plugged:74cba2e3-7608-4bda-baae-d29cae296501 for instance 2441b769-9668-41f1-9857-916c480df090 on n-h2-846463-3 Sep 23 04:57:51.459057 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-9c677afb-cf6e-48ae-abda-0186a74785a5 req-17edfd7a-b646-41f4-a3b6-b3f471c28652 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060712 Sep 23 04:57:51.459925 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2721/5590] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:57:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:57:51.655628 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b601afa0-f115-40db-948f-6c53a2ae2eea tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:51.671957 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b601afa0-f115-40db-948f-6c53a2ae2eea tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671" status: 200 len: 1687 microversion: 2.1 time: 0.758887 Sep 23 04:57:51.673041 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2870/5591] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:57:50 2022] GET /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671 => generated 1687 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:57:51.830949 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ad10c6a6-5267-4e2e-8786-84e2de5a9117 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:51.831876 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-ad10c6a6-5267-4e2e-8786-84e2de5a9117 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] [instance: 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:51.839371 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ad10c6a6-5267-4e2e-8786-84e2de5a9117 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:51.840067 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ad10c6a6-5267-4e2e-8786-84e2de5a9117 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:51.840681 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ad10c6a6-5267-4e2e-8786-84e2de5a9117 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:51.842026 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ad10c6a6-5267-4e2e-8786-84e2de5a9117 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:51.843192 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ad10c6a6-5267-4e2e-8786-84e2de5a9117 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:51.843793 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ad10c6a6-5267-4e2e-8786-84e2de5a9117 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:51.863669 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-ad10c6a6-5267-4e2e-8786-84e2de5a9117 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] HTTP exception thrown: Instance 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 could not be found. Sep 23 04:57:51.865649 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ad10c6a6-5267-4e2e-8786-84e2de5a9117 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Request method failure captured: Sep 23 04:57:51.865649 n-d-846463-3 devstack@n-api.service[122698]: request: DELETE /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 HTTP/1.1 Sep 23 04:57:51.865649 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:57:51.865649 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:57:51.865649 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:57:51.865649 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:57:51.865649 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:57:51.865649 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:57:51.865649 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:57:51.865649 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:57:51.865649 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTr_05znWFojQXNtGxttMrdSSP2-d-5zPFoi4iS_kker39szrBSJZH9sl8iDahlWmAmDeBc7tZDXFYhtg-AuC7-UQqxiLhNbem06tIDbegwD1IBCuJB6FXx22mJ2YEHzqXGLyts8uxcBdgZz9zf-4ojrPGnp1U1ykpUGYe-RHAOey6k Sep 23 04:57:51.865649 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:57:51.865649 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:57:51.865649 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:57:51.865649 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:57:51.865649 n-d-846463-3 devstack@n-api.service[122698]: X-Openstack-Nova-Api-Version: 2.32 Sep 23 04:57:51.865649 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:57:51.865649 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:57:51.865649 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: df5513e89bb94c22854ef923561ef0ef Sep 23 04:57:51.865649 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-TaggedBootDevicesTest-647285811 Sep 23 04:57:51.865649 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:57:51.865649 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:57:51.865649 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_df5513e89bb94c22854ef923561ef0ef", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/df5513e89bb94c22854ef923561ef0ef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/df5513e89bb94c22854ef923561ef0ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/df5513e89bb94c22854ef923561ef0ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:57:51.865649 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-TaggedBootDevicesTest-647285811 Sep 23 04:57:51.865649 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: df5513e89bb94c22854ef923561ef0ef Sep 23 04:57:51.865649 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-TaggedBootDevicesTest-647285811 Sep 23 04:57:51.865649 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-TaggedBootDevicesTest-647285811-project Sep 23 04:57:51.865649 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:57:51.865649 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:57:51.865649 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: f58f4b86f06947268442533ec19ef25d Sep 23 04:57:51.865649 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-TaggedBootDevicesTest-647285811-project Sep 23 04:57:51.865649 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:57:51.865649 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 could not be found. Sep 23 04:57:51.865649 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '49112e3f-73fc-4ee9-b48e-bcda5b7dcda7'} Sep 23 04:57:51.865649 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:57:51.865649 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:57:51.865649 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:57:51.865649 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:57:51.865649 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:57:51.865649 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:57:51.865649 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:57:51.865649 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:57:51.865649 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:57:51.865649 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:57:51.865649 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 could not be found. Sep 23 04:57:51.865649 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:57:51.865649 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:57:51.865649 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:57:51.865649 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:57:51.865649 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:57:51.865649 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:57:51.865649 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:57:51.865649 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:57:51.865649 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:57:51.865649 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:57:51.865649 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 04:57:51.865649 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 04:57:51.865649 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 04:57:51.865649 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 04:57:51.865649 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:57:51.865649 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:57:51.865649 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:57:51.865649 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:57:51.869018 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 could not be found. Sep 23 04:57:51.869018 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:57:51.869018 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:57:51.869018 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:57:51.869018 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:57:51.869018 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:57:51.869018 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:57:51.869018 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:57:51.869018 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:57:51.869018 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 could not be found. Sep 23 04:57:51.869018 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:57:51.880252 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ad10c6a6-5267-4e2e-8786-84e2de5a9117 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Returning 404 to user: Instance 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:57:51.881420 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ad10c6a6-5267-4e2e-8786-84e2de5a9117 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] 10.222.0.33 "DELETE /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7" status: 404 len: 111 microversion: 2.32 time: 0.055316 Sep 23 04:57:51.882157 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2722/5592] 10.222.0.33 () {60 vars in 1280 bytes} [Fri Sep 23 04:57:51 2022] DELETE /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 23 04:57:51.900898 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-53a77507-5135-4735-a0b5-305662dc9fe2 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:51.901715 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-53a77507-5135-4735-a0b5-305662dc9fe2 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] [instance: 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:51.914602 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-53a77507-5135-4735-a0b5-305662dc9fe2 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:51.915543 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-53a77507-5135-4735-a0b5-305662dc9fe2 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:51.916079 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-53a77507-5135-4735-a0b5-305662dc9fe2 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:51.917141 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-53a77507-5135-4735-a0b5-305662dc9fe2 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:51.917700 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-53a77507-5135-4735-a0b5-305662dc9fe2 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:51.918576 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-53a77507-5135-4735-a0b5-305662dc9fe2 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:51.939377 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-53a77507-5135-4735-a0b5-305662dc9fe2 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] HTTP exception thrown: Instance 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 could not be found. Sep 23 04:57:51.941144 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-53a77507-5135-4735-a0b5-305662dc9fe2 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Request method failure captured: Sep 23 04:57:51.941144 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 HTTP/1.1 Sep 23 04:57:51.941144 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:57:51.941144 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:57:51.941144 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:57:51.941144 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:57:51.941144 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:57:51.941144 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:57:51.941144 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:57:51.941144 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:57:51.941144 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTr_05znWFojQXNtGxttMrdSSP2-d-5zPFoi4iS_kker39szrBSJZH9sl8iDahlWmAmDeBc7tZDXFYhtg-AuC7-UQqxiLhNbem06tIDbegwD1IBCuJB6FXx22mJ2YEHzqXGLyts8uxcBdgZz9zf-4ojrPGnp1U1ykpUGYe-RHAOey6k Sep 23 04:57:51.941144 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:57:51.941144 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:57:51.941144 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:57:51.941144 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:57:51.941144 n-d-846463-3 devstack@n-api.service[122699]: X-Openstack-Nova-Api-Version: 2.32 Sep 23 04:57:51.941144 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:57:51.941144 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:57:51.941144 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: df5513e89bb94c22854ef923561ef0ef Sep 23 04:57:51.941144 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-TaggedBootDevicesTest-647285811 Sep 23 04:57:51.941144 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:57:51.941144 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:57:51.941144 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_df5513e89bb94c22854ef923561ef0ef", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/df5513e89bb94c22854ef923561ef0ef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/df5513e89bb94c22854ef923561ef0ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/df5513e89bb94c22854ef923561ef0ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:57:51.941144 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-TaggedBootDevicesTest-647285811 Sep 23 04:57:51.941144 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: df5513e89bb94c22854ef923561ef0ef Sep 23 04:57:51.941144 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-TaggedBootDevicesTest-647285811 Sep 23 04:57:51.941144 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-TaggedBootDevicesTest-647285811-project Sep 23 04:57:51.941144 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:57:51.941144 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:57:51.941144 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: f58f4b86f06947268442533ec19ef25d Sep 23 04:57:51.941144 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-TaggedBootDevicesTest-647285811-project Sep 23 04:57:51.941144 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:57:51.941144 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 could not be found. Sep 23 04:57:51.941144 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '49112e3f-73fc-4ee9-b48e-bcda5b7dcda7'} Sep 23 04:57:51.941144 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:57:51.941144 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:57:51.941144 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:57:51.941144 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:57:51.941144 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:57:51.941144 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:57:51.941144 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:57:51.941144 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:57:51.941144 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:57:51.941144 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:57:51.941144 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 could not be found. Sep 23 04:57:51.941144 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:57:51.941144 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:57:51.941144 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:57:51.941144 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:57:51.941144 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:57:51.941144 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:57:51.941144 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:57:51.941144 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:57:51.941144 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:57:51.941144 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:57:51.941144 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:57:51.941144 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:57:51.941144 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:57:51.941144 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:57:51.941144 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:57:51.941144 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:57:51.941144 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 could not be found. Sep 23 04:57:51.941144 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:57:51.941144 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:57:51.941144 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:57:51.948392 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:57:51.948392 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:57:51.948392 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:57:51.948392 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:57:51.948392 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:57:51.948392 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 could not be found. Sep 23 04:57:51.948392 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:57:51.948392 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-53a77507-5135-4735-a0b5-305662dc9fe2 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] Returning 404 to user: Instance 49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:57:51.948392 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-53a77507-5135-4735-a0b5-305662dc9fe2 tempest-TaggedBootDevicesTest-647285811 tempest-TaggedBootDevicesTest-647285811-project] 10.222.0.33 "GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7" status: 404 len: 111 microversion: 2.32 time: 0.051141 Sep 23 04:57:51.948392 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2871/5593] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 04:57:51 2022] GET /compute/v2.1/servers/49112e3f-73fc-4ee9-b48e-bcda5b7dcda7 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 23 04:57:52.423044 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f94eb6f1-ada1-4f3f-b7d1-10168bafc7b6 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:52.425484 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f94eb6f1-ada1-4f3f-b7d1-10168bafc7b6 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] [instance: 2441b769-9668-41f1-9857-916c480df090] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:52.439329 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f94eb6f1-ada1-4f3f-b7d1-10168bafc7b6 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:52.441035 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f94eb6f1-ada1-4f3f-b7d1-10168bafc7b6 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:52.441700 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f94eb6f1-ada1-4f3f-b7d1-10168bafc7b6 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:52.445072 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f94eb6f1-ada1-4f3f-b7d1-10168bafc7b6 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:52.447063 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f94eb6f1-ada1-4f3f-b7d1-10168bafc7b6 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:52.450029 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f94eb6f1-ada1-4f3f-b7d1-10168bafc7b6 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:52.695827 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a795e047-b1d8-4c31-b4ce-47eb5324e714 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:52.697213 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a795e047-b1d8-4c31-b4ce-47eb5324e714 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 9bd2c0e2-8256-484a-bbd5-f21743724671] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:52.705699 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a795e047-b1d8-4c31-b4ce-47eb5324e714 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:52.710038 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a795e047-b1d8-4c31-b4ce-47eb5324e714 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:52.710526 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a795e047-b1d8-4c31-b4ce-47eb5324e714 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:52.712237 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a795e047-b1d8-4c31-b4ce-47eb5324e714 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:52.712237 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a795e047-b1d8-4c31-b4ce-47eb5324e714 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:52.712237 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a795e047-b1d8-4c31-b4ce-47eb5324e714 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:52.844622 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f94eb6f1-ada1-4f3f-b7d1-10168bafc7b6 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d028ec11a7b419dbe7f13c5ecfd7bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1b229c7b244b61944a0650295dc90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:52.882197 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f94eb6f1-ada1-4f3f-b7d1-10168bafc7b6 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] 10.222.0.33 "GET /compute/v2.1/servers/2441b769-9668-41f1-9857-916c480df090" status: 200 len: 1316 microversion: 2.1 time: 0.460772 Sep 23 04:57:52.902512 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2723/5594] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:57:52 2022] GET /compute/v2.1/servers/2441b769-9668-41f1-9857-916c480df090 => generated 1316 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:57:53.284753 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a795e047-b1d8-4c31-b4ce-47eb5324e714 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:53.297429 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a795e047-b1d8-4c31-b4ce-47eb5324e714 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671" status: 200 len: 1680 microversion: 2.1 time: 0.605370 Sep 23 04:57:53.307696 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2872/5595] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:57:52 2022] GET /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671 => generated 1680 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:57:53.912061 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-63c7316a-7d01-4754-932b-22136dbe19e3 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:53.913249 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-63c7316a-7d01-4754-932b-22136dbe19e3 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] [instance: 2441b769-9668-41f1-9857-916c480df090] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:53.931166 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-63c7316a-7d01-4754-932b-22136dbe19e3 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:53.932798 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-63c7316a-7d01-4754-932b-22136dbe19e3 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:53.934924 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-63c7316a-7d01-4754-932b-22136dbe19e3 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:53.938481 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-63c7316a-7d01-4754-932b-22136dbe19e3 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:53.941877 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-63c7316a-7d01-4754-932b-22136dbe19e3 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:53.942633 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-63c7316a-7d01-4754-932b-22136dbe19e3 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:54.170032 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-63c7316a-7d01-4754-932b-22136dbe19e3 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d028ec11a7b419dbe7f13c5ecfd7bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1b229c7b244b61944a0650295dc90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:54.179545 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-63c7316a-7d01-4754-932b-22136dbe19e3 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] 10.222.0.33 "GET /compute/v2.1/servers/2441b769-9668-41f1-9857-916c480df090" status: 200 len: 1503 microversion: 2.1 time: 0.272404 Sep 23 04:57:54.180347 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2724/5596] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:57:53 2022] GET /compute/v2.1/servers/2441b769-9668-41f1-9857-916c480df090 => generated 1503 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:57:54.209364 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7b412689-d34a-4443-a2ba-fa552e72e2a0 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:54.209865 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-7b412689-d34a-4443-a2ba-fa552e72e2a0 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] [instance: 2441b769-9668-41f1-9857-916c480df090] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:54.216828 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7b412689-d34a-4443-a2ba-fa552e72e2a0 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:54.217881 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7b412689-d34a-4443-a2ba-fa552e72e2a0 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:54.218352 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7b412689-d34a-4443-a2ba-fa552e72e2a0 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:54.219054 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7b412689-d34a-4443-a2ba-fa552e72e2a0 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:54.219515 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7b412689-d34a-4443-a2ba-fa552e72e2a0 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:54.220116 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7b412689-d34a-4443-a2ba-fa552e72e2a0 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:54.311687 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:57:54.411806 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-7b412689-d34a-4443-a2ba-fa552e72e2a0 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] 10.222.0.33 "DELETE /compute/v2.1/servers/2441b769-9668-41f1-9857-916c480df090/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.206696 Sep 23 04:57:54.412814 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2873/5597] 10.222.0.33 () {58 vars in 1296 bytes} [Fri Sep 23 04:57:54 2022] DELETE /compute/v2.1/servers/2441b769-9668-41f1-9857-916c480df090/os-server-password => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:57:54.430422 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b965a494-ac2e-458b-b80f-c816e36d9622 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:54.430946 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b965a494-ac2e-458b-b80f-c816e36d9622 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] [instance: 2441b769-9668-41f1-9857-916c480df090] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:54.445121 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b965a494-ac2e-458b-b80f-c816e36d9622 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:54.445632 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b965a494-ac2e-458b-b80f-c816e36d9622 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:54.446150 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b965a494-ac2e-458b-b80f-c816e36d9622 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:54.452291 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b965a494-ac2e-458b-b80f-c816e36d9622 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:54.452875 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b965a494-ac2e-458b-b80f-c816e36d9622 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:54.453352 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b965a494-ac2e-458b-b80f-c816e36d9622 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:54.522919 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b965a494-ac2e-458b-b80f-c816e36d9622 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] 10.222.0.33 "GET /compute/v2.1/servers/2441b769-9668-41f1-9857-916c480df090/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.104456 Sep 23 04:57:54.523524 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2874/5598] 10.222.0.33 () {58 vars in 1293 bytes} [Fri Sep 23 04:57:54 2022] GET /compute/v2.1/servers/2441b769-9668-41f1-9857-916c480df090/os-server-password => generated 16 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 04:57:54.538910 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9035727c-3c16-44a5-b2f6-f067455b8ccb tempest-PortsAdminExtendedAttrsTestJSON-893623957 tempest-PortsAdminExtendedAttrsTestJSON-893623957-project-admin] Calling method '.version_select at 0x7ff1bab2b940>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:54.543004 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9035727c-3c16-44a5-b2f6-f067455b8ccb tempest-PortsAdminExtendedAttrsTestJSON-893623957 tempest-PortsAdminExtendedAttrsTestJSON-893623957-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:54.543671 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9035727c-3c16-44a5-b2f6-f067455b8ccb tempest-PortsAdminExtendedAttrsTestJSON-893623957 tempest-PortsAdminExtendedAttrsTestJSON-893623957-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:54.544136 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9035727c-3c16-44a5-b2f6-f067455b8ccb tempest-PortsAdminExtendedAttrsTestJSON-893623957 tempest-PortsAdminExtendedAttrsTestJSON-893623957-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:54.548095 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0dd36910-3b9d-4728-9f40-1ba66b95c941 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:54.549046 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-0dd36910-3b9d-4728-9f40-1ba66b95c941 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] [instance: 2441b769-9668-41f1-9857-916c480df090] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:54.563432 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0dd36910-3b9d-4728-9f40-1ba66b95c941 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:54.566666 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0dd36910-3b9d-4728-9f40-1ba66b95c941 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:54.567198 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0dd36910-3b9d-4728-9f40-1ba66b95c941 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:54.568022 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0dd36910-3b9d-4728-9f40-1ba66b95c941 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:54.571916 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0dd36910-3b9d-4728-9f40-1ba66b95c941 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:54.572705 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0dd36910-3b9d-4728-9f40-1ba66b95c941 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:54.588866 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9035727c-3c16-44a5-b2f6-f067455b8ccb tempest-PortsAdminExtendedAttrsTestJSON-893623957 tempest-PortsAdminExtendedAttrsTestJSON-893623957-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:54.594369 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9035727c-3c16-44a5-b2f6-f067455b8ccb tempest-PortsAdminExtendedAttrsTestJSON-893623957 tempest-PortsAdminExtendedAttrsTestJSON-893623957-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:54.597788 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9035727c-3c16-44a5-b2f6-f067455b8ccb tempest-PortsAdminExtendedAttrsTestJSON-893623957 tempest-PortsAdminExtendedAttrsTestJSON-893623957-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:54.637416 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9035727c-3c16-44a5-b2f6-f067455b8ccb tempest-PortsAdminExtendedAttrsTestJSON-893623957 tempest-PortsAdminExtendedAttrsTestJSON-893623957-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:54.642547 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9035727c-3c16-44a5-b2f6-f067455b8ccb tempest-PortsAdminExtendedAttrsTestJSON-893623957 tempest-PortsAdminExtendedAttrsTestJSON-893623957-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:54.643174 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9035727c-3c16-44a5-b2f6-f067455b8ccb tempest-PortsAdminExtendedAttrsTestJSON-893623957 tempest-PortsAdminExtendedAttrsTestJSON-893623957-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:54.651739 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-0dd36910-3b9d-4728-9f40-1ba66b95c941 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] [instance: 2441b769-9668-41f1-9857-916c480df090] Going to try to terminate instance {{(pid=122699) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:57:54.672753 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9035727c-3c16-44a5-b2f6-f067455b8ccb tempest-PortsAdminExtendedAttrsTestJSON-893623957 tempest-PortsAdminExtendedAttrsTestJSON-893623957-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.415958 Sep 23 04:57:54.673871 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2725/5599] 10.222.0.33 () {58 vars in 1146 bytes} [Fri Sep 23 04:57:54 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:57:55.132755 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0dd36910-3b9d-4728-9f40-1ba66b95c941 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] 10.222.0.33 "DELETE /compute/v2.1/servers/2441b769-9668-41f1-9857-916c480df090" status: 204 len: 0 microversion: 2.1 time: 0.592738 Sep 23 04:57:55.133466 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2875/5600] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:57:54 2022] DELETE /compute/v2.1/servers/2441b769-9668-41f1-9857-916c480df090 => generated 0 bytes in 595 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:57:55.142335 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-774612fb-30ce-42a6-8d72-cd683837da52 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:55.144421 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-774612fb-30ce-42a6-8d72-cd683837da52 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] [instance: 2441b769-9668-41f1-9857-916c480df090] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:55.151022 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-774612fb-30ce-42a6-8d72-cd683837da52 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:55.151768 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-774612fb-30ce-42a6-8d72-cd683837da52 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:55.152470 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-774612fb-30ce-42a6-8d72-cd683837da52 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:55.153409 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-774612fb-30ce-42a6-8d72-cd683837da52 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:55.154649 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-774612fb-30ce-42a6-8d72-cd683837da52 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:55.155343 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-774612fb-30ce-42a6-8d72-cd683837da52 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:55.710361 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-774612fb-30ce-42a6-8d72-cd683837da52 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d028ec11a7b419dbe7f13c5ecfd7bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1b229c7b244b61944a0650295dc90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:55.725264 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-774612fb-30ce-42a6-8d72-cd683837da52 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] 10.222.0.33 "GET /compute/v2.1/servers/2441b769-9668-41f1-9857-916c480df090" status: 200 len: 1509 microversion: 2.1 time: 0.587362 Sep 23 04:57:55.734449 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2726/5601] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:57:55 2022] GET /compute/v2.1/servers/2441b769-9668-41f1-9857-916c480df090 => generated 1509 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:57:56.761006 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-67749c1a-74d3-4968-aae7-9a77930c8991 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:56.761920 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-67749c1a-74d3-4968-aae7-9a77930c8991 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] [instance: 2441b769-9668-41f1-9857-916c480df090] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:56.786822 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-67749c1a-74d3-4968-aae7-9a77930c8991 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:56.787347 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-67749c1a-74d3-4968-aae7-9a77930c8991 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:56.787813 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-67749c1a-74d3-4968-aae7-9a77930c8991 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:56.788562 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-67749c1a-74d3-4968-aae7-9a77930c8991 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:56.797282 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-67749c1a-74d3-4968-aae7-9a77930c8991 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:56.798324 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-67749c1a-74d3-4968-aae7-9a77930c8991 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:57.019361 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-511c50ef-98f6-44ca-b2b1-8f18ed4b8694 req-ab88f139-eb12-4160-95bd-7b371c52d8f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bd2c0e2-8256-484a-bbd5-f21743724671", "name": "network-vif-plugged", "status": "completed", "tag": "909994da-1d1c-4fc5-955f-cc0ae5196ea8"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:57:57.050506 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-511c50ef-98f6-44ca-b2b1-8f18ed4b8694 req-ab88f139-eb12-4160-95bd-7b371c52d8f4 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:57.050871 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-511c50ef-98f6-44ca-b2b1-8f18ed4b8694 req-ab88f139-eb12-4160-95bd-7b371c52d8f4 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:57.051189 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-511c50ef-98f6-44ca-b2b1-8f18ed4b8694 req-ab88f139-eb12-4160-95bd-7b371c52d8f4 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:57.098567 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-511c50ef-98f6-44ca-b2b1-8f18ed4b8694 req-ab88f139-eb12-4160-95bd-7b371c52d8f4 service nova] Creating event network-vif-plugged:909994da-1d1c-4fc5-955f-cc0ae5196ea8 for instance 9bd2c0e2-8256-484a-bbd5-f21743724671 on n-h2-846463-3 Sep 23 04:57:57.107881 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-511c50ef-98f6-44ca-b2b1-8f18ed4b8694 req-ab88f139-eb12-4160-95bd-7b371c52d8f4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106167 Sep 23 04:57:57.111491 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2727/5602] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:57:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:57:57.459946 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-67749c1a-74d3-4968-aae7-9a77930c8991 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d028ec11a7b419dbe7f13c5ecfd7bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1b229c7b244b61944a0650295dc90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:57.480652 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-67749c1a-74d3-4968-aae7-9a77930c8991 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] 10.222.0.33 "GET /compute/v2.1/servers/2441b769-9668-41f1-9857-916c480df090" status: 200 len: 1509 microversion: 2.1 time: 0.713925 Sep 23 04:57:57.481569 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2876/5603] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:57:56 2022] GET /compute/v2.1/servers/2441b769-9668-41f1-9857-916c480df090 => generated 1509 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:57:58.240802 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-e7e897fc-3287-4639-bf03-d3db68c450c2 req-053e0876-2521-410a-95e3-09a338f138bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2441b769-9668-41f1-9857-916c480df090", "name": "network-vif-deleted", "tag": "74cba2e3-7608-4bda-baae-d29cae296501"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:57:58.266208 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-e7e897fc-3287-4639-bf03-d3db68c450c2 req-053e0876-2521-410a-95e3-09a338f138bf service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:58.266705 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-e7e897fc-3287-4639-bf03-d3db68c450c2 req-053e0876-2521-410a-95e3-09a338f138bf service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:58.267145 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-e7e897fc-3287-4639-bf03-d3db68c450c2 req-053e0876-2521-410a-95e3-09a338f138bf service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:58.290662 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-e7e897fc-3287-4639-bf03-d3db68c450c2 req-053e0876-2521-410a-95e3-09a338f138bf service nova] Creating event network-vif-deleted:74cba2e3-7608-4bda-baae-d29cae296501 for instance 2441b769-9668-41f1-9857-916c480df090 on n-h2-846463-3 Sep 23 04:57:58.303476 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-e7e897fc-3287-4639-bf03-d3db68c450c2 req-053e0876-2521-410a-95e3-09a338f138bf service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067625 Sep 23 04:57:58.304314 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2728/5604] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:57:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:57:58.505291 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-cc1171eb-c298-4669-bbd4-696cabfc2de4 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:58.506619 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-cc1171eb-c298-4669-bbd4-696cabfc2de4 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] [instance: 2441b769-9668-41f1-9857-916c480df090] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:58.523231 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cc1171eb-c298-4669-bbd4-696cabfc2de4 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:58.524133 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cc1171eb-c298-4669-bbd4-696cabfc2de4 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:58.526380 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cc1171eb-c298-4669-bbd4-696cabfc2de4 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:58.527346 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cc1171eb-c298-4669-bbd4-696cabfc2de4 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:58.532778 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cc1171eb-c298-4669-bbd4-696cabfc2de4 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:58.533464 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cc1171eb-c298-4669-bbd4-696cabfc2de4 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:58.921257 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-cc1171eb-c298-4669-bbd4-696cabfc2de4 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d028ec11a7b419dbe7f13c5ecfd7bfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1b229c7b244b61944a0650295dc90a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:57:58.947075 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-cc1171eb-c298-4669-bbd4-696cabfc2de4 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] 10.222.0.33 "GET /compute/v2.1/servers/2441b769-9668-41f1-9857-916c480df090" status: 200 len: 1301 microversion: 2.1 time: 0.445690 Sep 23 04:57:58.969993 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2877/5605] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:57:58 2022] GET /compute/v2.1/servers/2441b769-9668-41f1-9857-916c480df090 => generated 1301 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:57:59.976956 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-42983d62-a829-4780-a24f-b979442a4402 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:57:59.978399 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-42983d62-a829-4780-a24f-b979442a4402 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] [instance: 2441b769-9668-41f1-9857-916c480df090] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:57:59.988291 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-42983d62-a829-4780-a24f-b979442a4402 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:59.989065 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-42983d62-a829-4780-a24f-b979442a4402 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:59.991047 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-42983d62-a829-4780-a24f-b979442a4402 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:57:59.992731 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-42983d62-a829-4780-a24f-b979442a4402 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:57:59.993511 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-42983d62-a829-4780-a24f-b979442a4402 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:57:59.994190 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-42983d62-a829-4780-a24f-b979442a4402 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:00.018260 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-42983d62-a829-4780-a24f-b979442a4402 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] HTTP exception thrown: Instance 2441b769-9668-41f1-9857-916c480df090 could not be found. Sep 23 04:58:00.022677 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-42983d62-a829-4780-a24f-b979442a4402 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Request method failure captured: Sep 23 04:58:00.022677 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/2441b769-9668-41f1-9857-916c480df090 HTTP/1.1 Sep 23 04:58:00.022677 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:58:00.022677 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:58:00.022677 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:58:00.022677 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:58:00.022677 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:58:00.022677 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:58:00.022677 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:58:00.022677 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:58:00.022677 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTy8a8BgOr8wnjcTASWw7bNupbGK4vCyJSbD76i6FsDxRUTyaRwJENp24LxRjIpEG798mdy7mfqobW_3DmuCEzK_YC66V4wEBgAL369wp_AWUilI_hHNXzweRTc25YIJg47yNXAM-nI2OS3SehfsoGd5nDDV9huh9L8JqDSgYeC7ZQ4 Sep 23 04:58:00.022677 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:58:00.022677 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:58:00.022677 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:58:00.022677 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:58:00.022677 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:58:00.022677 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:58:00.022677 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 5e1b229c7b244b61944a0650295dc90a Sep 23 04:58:00.022677 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ServerPasswordTestJSON-818287445 Sep 23 04:58:00.022677 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:58:00.022677 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:58:00.022677 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5e1b229c7b244b61944a0650295dc90a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5e1b229c7b244b61944a0650295dc90a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5e1b229c7b244b61944a0650295dc90a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5e1b229c7b244b61944a0650295dc90a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:58:00.022677 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ServerPasswordTestJSON-818287445 Sep 23 04:58:00.022677 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 5e1b229c7b244b61944a0650295dc90a Sep 23 04:58:00.022677 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ServerPasswordTestJSON-818287445 Sep 23 04:58:00.022677 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ServerPasswordTestJSON-818287445-project Sep 23 04:58:00.022677 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:58:00.022677 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:58:00.022677 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 7d028ec11a7b419dbe7f13c5ecfd7bfd Sep 23 04:58:00.022677 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ServerPasswordTestJSON-818287445-project Sep 23 04:58:00.022677 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:58:00.022677 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 2441b769-9668-41f1-9857-916c480df090 could not be found. Sep 23 04:58:00.022677 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '2441b769-9668-41f1-9857-916c480df090'} Sep 23 04:58:00.022677 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:58:00.022677 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:58:00.022677 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:58:00.022677 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:58:00.022677 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:58:00.022677 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:58:00.022677 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:58:00.022677 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:58:00.022677 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:58:00.022677 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:58:00.022677 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2441b769-9668-41f1-9857-916c480df090 could not be found. Sep 23 04:58:00.022677 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:58:00.022677 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:58:00.022677 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:58:00.022677 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:58:00.022677 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:58:00.022677 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:58:00.022677 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:58:00.022677 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:58:00.022677 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:58:00.022677 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:58:00.022677 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:58:00.022677 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:58:00.022677 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:58:00.022677 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:58:00.022677 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:58:00.022677 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:58:00.022677 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2441b769-9668-41f1-9857-916c480df090 could not be found. Sep 23 04:58:00.022677 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:58:00.022677 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:58:00.022677 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:58:00.029251 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:58:00.029251 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:58:00.029251 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:58:00.029251 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:58:00.029251 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:58:00.029251 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2441b769-9668-41f1-9857-916c480df090 could not be found. Sep 23 04:58:00.029251 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:58:00.029251 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-42983d62-a829-4780-a24f-b979442a4402 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] Returning 404 to user: Instance 2441b769-9668-41f1-9857-916c480df090 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:58:00.034326 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-42983d62-a829-4780-a24f-b979442a4402 tempest-ServerPasswordTestJSON-818287445 tempest-ServerPasswordTestJSON-818287445-project] 10.222.0.33 "GET /compute/v2.1/servers/2441b769-9668-41f1-9857-916c480df090" status: 404 len: 111 microversion: 2.1 time: 0.061379 Sep 23 04:58:00.035154 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2729/5606] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:57:59 2022] GET /compute/v2.1/servers/2441b769-9668-41f1-9857-916c480df090 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:58:15.231439 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-750f87bb-7746-43a6-bd71-02b3afe05b93 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:58:15.234697 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-750f87bb-7746-43a6-bd71-02b3afe05b93 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] [instance: 6dfb2418-b235-4d35-b109-4bed20d1b96e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:58:15.243241 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:58:15.244178 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:INSERT=4,nova_cell1:SELECT=30,nova_cell1:UPDATE=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:58:15.245742 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-750f87bb-7746-43a6-bd71-02b3afe05b93 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:15.246658 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-750f87bb-7746-43a6-bd71-02b3afe05b93 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:15.247252 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-750f87bb-7746-43a6-bd71-02b3afe05b93 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:15.248168 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-750f87bb-7746-43a6-bd71-02b3afe05b93 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:15.248772 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-750f87bb-7746-43a6-bd71-02b3afe05b93 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:15.249347 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-750f87bb-7746-43a6-bd71-02b3afe05b93 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:15.285530 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-750f87bb-7746-43a6-bd71-02b3afe05b93 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] 10.222.0.33 "GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058074 Sep 23 04:58:15.286833 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2878/5607] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Sep 23 04:58:15 2022] GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 04:58:15.371021 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2d098ebb-6e5e-441f-ba9a-52f88ff8b34c tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:58:15.374993 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-2d098ebb-6e5e-441f-ba9a-52f88ff8b34c tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] [instance: 6dfb2418-b235-4d35-b109-4bed20d1b96e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:58:15.374993 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=27 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:58:15.375646 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=69 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:58:15.381007 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2d098ebb-6e5e-441f-ba9a-52f88ff8b34c tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:15.381837 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2d098ebb-6e5e-441f-ba9a-52f88ff8b34c tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:15.382993 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2d098ebb-6e5e-441f-ba9a-52f88ff8b34c tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:15.383919 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2d098ebb-6e5e-441f-ba9a-52f88ff8b34c tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:15.384665 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2d098ebb-6e5e-441f-ba9a-52f88ff8b34c tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:15.385338 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2d098ebb-6e5e-441f-ba9a-52f88ff8b34c tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:15.426316 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-2d098ebb-6e5e-441f-ba9a-52f88ff8b34c tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] [instance: 6dfb2418-b235-4d35-b109-4bed20d1b96e] Going to try to terminate instance {{(pid=122698) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:58:15.544864 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8f67fe74-a441-4837-91b7-f1fe70560608 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:58:15.549687 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-8f67fe74-a441-4837-91b7-f1fe70560608 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 9bd2c0e2-8256-484a-bbd5-f21743724671] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:58:15.567125 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8f67fe74-a441-4837-91b7-f1fe70560608 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:15.567875 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8f67fe74-a441-4837-91b7-f1fe70560608 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:15.568524 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8f67fe74-a441-4837-91b7-f1fe70560608 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:15.569399 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8f67fe74-a441-4837-91b7-f1fe70560608 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:15.570120 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8f67fe74-a441-4837-91b7-f1fe70560608 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:15.570724 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8f67fe74-a441-4837-91b7-f1fe70560608 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:15.652100 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-8f67fe74-a441-4837-91b7-f1fe70560608 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "POST /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671/action" status: 200 len: 63226 microversion: 2.1 time: 0.114525 Sep 23 04:58:15.662220 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2879/5608] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:58:15 2022] POST /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671/action => generated 63226 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 23 04:58:15.863511 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2d098ebb-6e5e-441f-ba9a-52f88ff8b34c tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e" status: 204 len: 0 microversion: 2.1 time: 0.495553 Sep 23 04:58:15.865636 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2730/5609] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:58:15 2022] DELETE /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e => generated 0 bytes in 499 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:58:15.875400 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-76286059-1001-497c-a71b-8e9b63820d50 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:58:15.876537 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-76286059-1001-497c-a71b-8e9b63820d50 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] [instance: 6dfb2418-b235-4d35-b109-4bed20d1b96e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:58:15.883738 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-76286059-1001-497c-a71b-8e9b63820d50 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:15.884568 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-76286059-1001-497c-a71b-8e9b63820d50 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:15.885224 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-76286059-1001-497c-a71b-8e9b63820d50 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:15.886226 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-76286059-1001-497c-a71b-8e9b63820d50 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:15.886892 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-76286059-1001-497c-a71b-8e9b63820d50 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:15.887523 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-76286059-1001-497c-a71b-8e9b63820d50 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:16.119881 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-76286059-1001-497c-a71b-8e9b63820d50 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bde73a530f4666aebdd5f7d9fa1046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71874a329e54494bb1b84f31c3826205', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:58:16.129590 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-76286059-1001-497c-a71b-8e9b63820d50 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] 10.222.0.33 "GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e" status: 200 len: 1673 microversion: 2.1 time: 0.258948 Sep 23 04:58:16.132827 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2880/5610] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:58:15 2022] GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e => generated 1673 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:58:17.164205 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ae379414-e298-4ed6-b09e-2ca3fc13e7ec tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:58:17.166284 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-ae379414-e298-4ed6-b09e-2ca3fc13e7ec tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] [instance: 6dfb2418-b235-4d35-b109-4bed20d1b96e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:58:17.180922 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ae379414-e298-4ed6-b09e-2ca3fc13e7ec tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:17.182770 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ae379414-e298-4ed6-b09e-2ca3fc13e7ec tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:17.183981 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ae379414-e298-4ed6-b09e-2ca3fc13e7ec tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:17.186941 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ae379414-e298-4ed6-b09e-2ca3fc13e7ec tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:17.189282 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ae379414-e298-4ed6-b09e-2ca3fc13e7ec tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:17.194726 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ae379414-e298-4ed6-b09e-2ca3fc13e7ec tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:17.590860 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ae379414-e298-4ed6-b09e-2ca3fc13e7ec tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bde73a530f4666aebdd5f7d9fa1046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71874a329e54494bb1b84f31c3826205', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:58:17.602374 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ae379414-e298-4ed6-b09e-2ca3fc13e7ec tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] 10.222.0.33 "GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e" status: 200 len: 1673 microversion: 2.1 time: 0.448932 Sep 23 04:58:17.608297 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2731/5611] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:58:17 2022] GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e => generated 1673 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:58:18.641413 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5c642e4b-e60b-4e34-a98d-f24fb5b565e7 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:58:18.649478 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-5c642e4b-e60b-4e34-a98d-f24fb5b565e7 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] [instance: 6dfb2418-b235-4d35-b109-4bed20d1b96e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:58:18.663026 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5c642e4b-e60b-4e34-a98d-f24fb5b565e7 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:18.665335 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5c642e4b-e60b-4e34-a98d-f24fb5b565e7 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:18.666511 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5c642e4b-e60b-4e34-a98d-f24fb5b565e7 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:18.670786 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5c642e4b-e60b-4e34-a98d-f24fb5b565e7 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:18.671571 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5c642e4b-e60b-4e34-a98d-f24fb5b565e7 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:18.672839 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5c642e4b-e60b-4e34-a98d-f24fb5b565e7 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:19.542906 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-5c642e4b-e60b-4e34-a98d-f24fb5b565e7 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bde73a530f4666aebdd5f7d9fa1046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71874a329e54494bb1b84f31c3826205', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:58:19.563992 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5c642e4b-e60b-4e34-a98d-f24fb5b565e7 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] 10.222.0.33 "GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e" status: 200 len: 1673 microversion: 2.1 time: 0.929092 Sep 23 04:58:19.564800 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2881/5612] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:58:18 2022] GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e => generated 1673 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:58:20.593436 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7df9b6d2-2e87-46c4-872e-7b6ea07b97c3 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:58:20.595479 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7df9b6d2-2e87-46c4-872e-7b6ea07b97c3 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] [instance: 6dfb2418-b235-4d35-b109-4bed20d1b96e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:58:20.609623 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7df9b6d2-2e87-46c4-872e-7b6ea07b97c3 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:20.610809 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7df9b6d2-2e87-46c4-872e-7b6ea07b97c3 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:20.611691 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7df9b6d2-2e87-46c4-872e-7b6ea07b97c3 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:20.614237 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7df9b6d2-2e87-46c4-872e-7b6ea07b97c3 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:20.615285 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7df9b6d2-2e87-46c4-872e-7b6ea07b97c3 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:20.616740 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7df9b6d2-2e87-46c4-872e-7b6ea07b97c3 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:20.863739 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-7df9b6d2-2e87-46c4-872e-7b6ea07b97c3 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bde73a530f4666aebdd5f7d9fa1046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71874a329e54494bb1b84f31c3826205', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:58:20.876162 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7df9b6d2-2e87-46c4-872e-7b6ea07b97c3 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] 10.222.0.33 "GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e" status: 200 len: 1606 microversion: 2.1 time: 0.290099 Sep 23 04:58:20.876761 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2732/5613] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:58:20 2022] GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e => generated 1606 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:58:20.999947 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-f48b9106-1ca6-474d-96cf-f8ede7f47f1f req-1cc9be4f-f3b3-4533-bf9c-36d86503e2db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dfb2418-b235-4d35-b109-4bed20d1b96e", "name": "network-vif-deleted", "tag": "369581a4-2ccc-4f7e-ab3f-eaed6fc5cde6"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:58:21.023703 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-f48b9106-1ca6-474d-96cf-f8ede7f47f1f req-1cc9be4f-f3b3-4533-bf9c-36d86503e2db service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:21.024693 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-f48b9106-1ca6-474d-96cf-f8ede7f47f1f req-1cc9be4f-f3b3-4533-bf9c-36d86503e2db service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:21.028311 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-f48b9106-1ca6-474d-96cf-f8ede7f47f1f req-1cc9be4f-f3b3-4533-bf9c-36d86503e2db service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:21.045247 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-f48b9106-1ca6-474d-96cf-f8ede7f47f1f req-1cc9be4f-f3b3-4533-bf9c-36d86503e2db service nova] Creating event network-vif-deleted:369581a4-2ccc-4f7e-ab3f-eaed6fc5cde6 for instance 6dfb2418-b235-4d35-b109-4bed20d1b96e on n-h1-846463-3 Sep 23 04:58:21.052045 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-f48b9106-1ca6-474d-96cf-f8ede7f47f1f req-1cc9be4f-f3b3-4533-bf9c-36d86503e2db service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056954 Sep 23 04:58:21.054970 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2882/5614] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:58:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:58:21.902112 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4bd08030-9d90-43f9-be40-83f8b7d2fee5 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:58:21.902785 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4bd08030-9d90-43f9-be40-83f8b7d2fee5 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] [instance: 6dfb2418-b235-4d35-b109-4bed20d1b96e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:58:21.956388 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4bd08030-9d90-43f9-be40-83f8b7d2fee5 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:21.959861 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4bd08030-9d90-43f9-be40-83f8b7d2fee5 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:21.960342 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4bd08030-9d90-43f9-be40-83f8b7d2fee5 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:21.964831 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4bd08030-9d90-43f9-be40-83f8b7d2fee5 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:21.965374 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4bd08030-9d90-43f9-be40-83f8b7d2fee5 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:21.967042 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4bd08030-9d90-43f9-be40-83f8b7d2fee5 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:22.077001 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4bd08030-9d90-43f9-be40-83f8b7d2fee5 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:22.078567 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4bd08030-9d90-43f9-be40-83f8b7d2fee5 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:22.081444 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4bd08030-9d90-43f9-be40-83f8b7d2fee5 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:22.082848 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-4bd08030-9d90-43f9-be40-83f8b7d2fee5 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lazy-loading 'fault' on Instance uuid 6dfb2418-b235-4d35-b109-4bed20d1b96e {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:58:22.271201 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4bd08030-9d90-43f9-be40-83f8b7d2fee5 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bde73a530f4666aebdd5f7d9fa1046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71874a329e54494bb1b84f31c3826205', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:58:22.283948 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4bd08030-9d90-43f9-be40-83f8b7d2fee5 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] 10.222.0.33 "GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e" status: 200 len: 1328 microversion: 2.1 time: 0.386883 Sep 23 04:58:22.300115 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2733/5615] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:58:21 2022] GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e => generated 1328 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:58:22.552221 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f6e144b7-00de-4112-9a5c-03d6f4de8bb7 tempest-TestNetworkAdvancedServerOps-1586243358 tempest-TestNetworkAdvancedServerOps-1586243358-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:58:22.552950 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f6e144b7-00de-4112-9a5c-03d6f4de8bb7 tempest-TestNetworkAdvancedServerOps-1586243358 tempest-TestNetworkAdvancedServerOps-1586243358-project-admin] [instance: 9bd2c0e2-8256-484a-bbd5-f21743724671] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:58:22.573520 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f6e144b7-00de-4112-9a5c-03d6f4de8bb7 tempest-TestNetworkAdvancedServerOps-1586243358 tempest-TestNetworkAdvancedServerOps-1586243358-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:22.574341 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f6e144b7-00de-4112-9a5c-03d6f4de8bb7 tempest-TestNetworkAdvancedServerOps-1586243358 tempest-TestNetworkAdvancedServerOps-1586243358-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:22.580736 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f6e144b7-00de-4112-9a5c-03d6f4de8bb7 tempest-TestNetworkAdvancedServerOps-1586243358 tempest-TestNetworkAdvancedServerOps-1586243358-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:22.580736 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f6e144b7-00de-4112-9a5c-03d6f4de8bb7 tempest-TestNetworkAdvancedServerOps-1586243358 tempest-TestNetworkAdvancedServerOps-1586243358-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:22.580736 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f6e144b7-00de-4112-9a5c-03d6f4de8bb7 tempest-TestNetworkAdvancedServerOps-1586243358 tempest-TestNetworkAdvancedServerOps-1586243358-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:22.580736 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f6e144b7-00de-4112-9a5c-03d6f4de8bb7 tempest-TestNetworkAdvancedServerOps-1586243358 tempest-TestNetworkAdvancedServerOps-1586243358-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:23.308081 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9812ef4a-27c8-487f-aa1b-308e926dde2b tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:58:23.309342 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-9812ef4a-27c8-487f-aa1b-308e926dde2b tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] [instance: 6dfb2418-b235-4d35-b109-4bed20d1b96e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:58:23.318804 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9812ef4a-27c8-487f-aa1b-308e926dde2b tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:23.319553 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9812ef4a-27c8-487f-aa1b-308e926dde2b tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:23.321046 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9812ef4a-27c8-487f-aa1b-308e926dde2b tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:23.323216 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9812ef4a-27c8-487f-aa1b-308e926dde2b tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:23.326436 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9812ef4a-27c8-487f-aa1b-308e926dde2b tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:23.327333 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9812ef4a-27c8-487f-aa1b-308e926dde2b tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:23.354215 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-9812ef4a-27c8-487f-aa1b-308e926dde2b tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] HTTP exception thrown: Instance 6dfb2418-b235-4d35-b109-4bed20d1b96e could not be found. Sep 23 04:58:23.356512 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9812ef4a-27c8-487f-aa1b-308e926dde2b tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Request method failure captured: Sep 23 04:58:23.356512 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e HTTP/1.1 Sep 23 04:58:23.356512 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:58:23.356512 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:58:23.356512 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:58:23.356512 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:58:23.356512 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:58:23.356512 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:58:23.356512 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:58:23.356512 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:58:23.356512 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTwZ6hD01ljWPq1xreS5YxLz-W2KqjD0WPLQoW0Au27CF934gukXy-o49lsIDKKinKs1pcTiYV-ikQsekIlgK9dC6LOUuEwv22Zem7WQr0WR0EQsDz23DzzdBF5nDgi_v4ysG5FxUW01KI8aMXTcPwUObwGpA6gtBfYK6S3PhCMr6Lw Sep 23 04:58:23.356512 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:58:23.356512 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:58:23.356512 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:58:23.356512 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:58:23.356512 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:58:23.356512 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:58:23.356512 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 71874a329e54494bb1b84f31c3826205 Sep 23 04:58:23.356512 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-AttachVolumeTestJSON-905720098 Sep 23 04:58:23.356512 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:58:23.356512 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:58:23.356512 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_71874a329e54494bb1b84f31c3826205", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/71874a329e54494bb1b84f31c3826205"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/71874a329e54494bb1b84f31c3826205"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/71874a329e54494bb1b84f31c3826205"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:58:23.356512 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-AttachVolumeTestJSON-905720098 Sep 23 04:58:23.356512 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 71874a329e54494bb1b84f31c3826205 Sep 23 04:58:23.356512 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-AttachVolumeTestJSON-905720098 Sep 23 04:58:23.356512 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-AttachVolumeTestJSON-905720098-project Sep 23 04:58:23.356512 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:58:23.356512 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:58:23.356512 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: d1bde73a530f4666aebdd5f7d9fa1046 Sep 23 04:58:23.356512 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-AttachVolumeTestJSON-905720098-project Sep 23 04:58:23.356512 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:58:23.356512 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 6dfb2418-b235-4d35-b109-4bed20d1b96e could not be found. Sep 23 04:58:23.356512 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '6dfb2418-b235-4d35-b109-4bed20d1b96e'} Sep 23 04:58:23.356512 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:58:23.356512 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:58:23.356512 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:58:23.356512 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:58:23.356512 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:58:23.356512 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:58:23.356512 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:58:23.356512 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:58:23.356512 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:58:23.356512 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:58:23.356512 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6dfb2418-b235-4d35-b109-4bed20d1b96e could not be found. Sep 23 04:58:23.356512 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:58:23.356512 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:58:23.356512 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:58:23.356512 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:58:23.356512 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:58:23.356512 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:58:23.356512 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:58:23.356512 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:58:23.356512 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:58:23.356512 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:58:23.356512 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:58:23.356512 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:58:23.356512 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:58:23.356512 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:58:23.356512 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:58:23.356512 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:58:23.356512 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6dfb2418-b235-4d35-b109-4bed20d1b96e could not be found. Sep 23 04:58:23.356512 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:58:23.356512 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:58:23.356512 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:58:23.361394 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:58:23.361394 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:58:23.361394 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:58:23.361394 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:58:23.361394 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:58:23.361394 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6dfb2418-b235-4d35-b109-4bed20d1b96e could not be found. Sep 23 04:58:23.361394 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:58:23.369971 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9812ef4a-27c8-487f-aa1b-308e926dde2b tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Returning 404 to user: Instance 6dfb2418-b235-4d35-b109-4bed20d1b96e could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:58:23.373649 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9812ef4a-27c8-487f-aa1b-308e926dde2b tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] 10.222.0.33 "GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e" status: 404 len: 111 microversion: 2.1 time: 0.069770 Sep 23 04:58:23.375087 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2734/5616] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:58:23 2022] GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:58:23.390344 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8ce3cc57-0b5c-4669-9119-519a4ec0952f tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Calling method '.version_select at 0x7ff1bafe1310>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:58:23.503883 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8ce3cc57-0b5c-4669-9119-519a4ec0952f tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2084242172" status: 202 len: 0 microversion: 2.1 time: 0.124434 Sep 23 04:58:23.506782 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2735/5617] 10.222.0.33 () {58 vars in 1221 bytes} [Fri Sep 23 04:58:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2084242172 => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:58:23.727435 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f6e144b7-00de-4112-9a5c-03d6f4de8bb7 tempest-TestNetworkAdvancedServerOps-1586243358 tempest-TestNetworkAdvancedServerOps-1586243358-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671" status: 200 len: 1831 microversion: 2.1 time: 1.661487 Sep 23 04:58:23.727435 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2883/5618] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:58:22 2022] GET /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671 => generated 1831 bytes in 1663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:58:24.944078 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ce690117-9c7c-4b7d-abad-2002f43e8ddf tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-194050545", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:58:25.036849 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.network.neutron [None req-ce690117-9c7c-4b7d-abad-2002f43e8ddf tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] validate_networks() for [('0a90c0c3-89ec-488a-886e-b81891d0bcfa', None, None, None, None, None)] {{(pid=122698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:58:26.387053 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-ce690117-9c7c-4b7d-abad-2002f43e8ddf tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Flavor limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:58:26.387598 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-ce690117-9c7c-4b7d-abad-2002f43e8ddf tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Image limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:58:26.388500 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-ce690117-9c7c-4b7d-abad-2002f43e8ddf tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Flavor pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:58:26.388970 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-ce690117-9c7c-4b7d-abad-2002f43e8ddf tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Image pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:58:26.389396 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-ce690117-9c7c-4b7d-abad-2002f43e8ddf tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:58:26.408858 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ce690117-9c7c-4b7d-abad-2002f43e8ddf tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:26.409355 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ce690117-9c7c-4b7d-abad-2002f43e8ddf tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:26.409802 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ce690117-9c7c-4b7d-abad-2002f43e8ddf tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:26.410596 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ce690117-9c7c-4b7d-abad-2002f43e8ddf tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:26.411064 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ce690117-9c7c-4b7d-abad-2002f43e8ddf tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:26.411494 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ce690117-9c7c-4b7d-abad-2002f43e8ddf tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:26.448472 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-ce690117-9c7c-4b7d-abad-2002f43e8ddf tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Getting quotas for project ca57a0af591a43ee9cdef09134bc3fd8. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:58:26.454991 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-ce690117-9c7c-4b7d-abad-2002f43e8ddf tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Getting quotas for user 70a845ca1e7747fba0a987235d980098 and project ca57a0af591a43ee9cdef09134bc3fd8. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:58:26.486823 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-ce690117-9c7c-4b7d-abad-2002f43e8ddf tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Going to run 1 instances... {{(pid=122698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:58:26.489197 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-ce690117-9c7c-4b7d-abad-2002f43e8ddf tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] [instance: 13a0b913-5596-453f-a5fb-119e20b6b885] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:58:26.707405 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ce690117-9c7c-4b7d-abad-2002f43e8ddf tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.848141 Sep 23 04:58:26.714931 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2736/5619] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:58:24 2022] POST /compute/v2.1/servers => generated 383 bytes in 1851 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:58:26.724033 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4cc3efac-1a9e-4dce-97bc-5d2101ca90e5 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:58:26.725128 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4cc3efac-1a9e-4dce-97bc-5d2101ca90e5 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] [instance: 13a0b913-5596-453f-a5fb-119e20b6b885] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:58:27.225435 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-4cc3efac-1a9e-4dce-97bc-5d2101ca90e5 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a845ca1e7747fba0a987235d980098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca57a0af591a43ee9cdef09134bc3fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:58:27.235320 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4cc3efac-1a9e-4dce-97bc-5d2101ca90e5 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] 10.222.0.33 "GET /compute/v2.1/servers/13a0b913-5596-453f-a5fb-119e20b6b885" status: 200 len: 1213 microversion: 2.1 time: 0.518516 Sep 23 04:58:27.236223 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2884/5620] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:58:26 2022] GET /compute/v2.1/servers/13a0b913-5596-453f-a5fb-119e20b6b885 => generated 1213 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:58:27.259193 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-75a41439-4036-43e6-b64c-38e2c2f3cd45 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Action: 'create', calling method: .version_select at 0x7ff1ba9aa9d0>, body: {"keypair": {"name": "tempest-keypair-284355332", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBw8Eq2VF8EFRXgcUEZuIDWvnRSERMxKQn/DpFyHw2GC4+5adIQrRXzUKOksSgLENqYE1k7XDNJOsOOMR48sTTge2vtYReJKbODfLdt7/JaSSlD4regpcFRs656edmAP+w=="}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:58:27.347526 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-01cbd8f7-4cc7-42c6-942b-f2392e3e3c20 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:58:27.348029 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-01cbd8f7-4cc7-42c6-942b-f2392e3e3c20 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 9bd2c0e2-8256-484a-bbd5-f21743724671] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:58:27.359508 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-75a41439-4036-43e6-b64c-38e2c2f3cd45 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Getting quotas for project 71874a329e54494bb1b84f31c3826205. Resources: {'key_pairs'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:58:27.362405 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-01cbd8f7-4cc7-42c6-942b-f2392e3e3c20 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:27.362960 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-01cbd8f7-4cc7-42c6-942b-f2392e3e3c20 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:27.363412 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-01cbd8f7-4cc7-42c6-942b-f2392e3e3c20 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:27.364144 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-01cbd8f7-4cc7-42c6-942b-f2392e3e3c20 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:27.364600 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-01cbd8f7-4cc7-42c6-942b-f2392e3e3c20 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:27.371572 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-75a41439-4036-43e6-b64c-38e2c2f3cd45 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Getting quotas for user d1bde73a530f4666aebdd5f7d9fa1046 and project 71874a329e54494bb1b84f31c3826205. Resources: {'key_pairs'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:58:27.372154 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-01cbd8f7-4cc7-42c6-942b-f2392e3e3c20 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:27.430613 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-01cbd8f7-4cc7-42c6-942b-f2392e3e3c20 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 9bd2c0e2-8256-484a-bbd5-f21743724671] Going to try to terminate instance {{(pid=122699) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:58:27.532135 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-75a41439-4036-43e6-b64c-38e2c2f3cd45 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.306966 Sep 23 04:58:27.532135 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2737/5621] 10.222.0.33 () {60 vars in 1159 bytes} [Fri Sep 23 04:58:27 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:58:27.547450 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-a3856d9a-cc5a-4f95-b5f3-f618b1484b5f req-9e5b55e5-2b31-44e1-ad23-e9e348ae6613 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bd2c0e2-8256-484a-bbd5-f21743724671", "tag": "909994da-1d1c-4fc5-955f-cc0ae5196ea8"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:58:27.607284 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-a3856d9a-cc5a-4f95-b5f3-f618b1484b5f req-9e5b55e5-2b31-44e1-ad23-e9e348ae6613 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:27.608115 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-a3856d9a-cc5a-4f95-b5f3-f618b1484b5f req-9e5b55e5-2b31-44e1-ad23-e9e348ae6613 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:27.608836 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-a3856d9a-cc5a-4f95-b5f3-f618b1484b5f req-9e5b55e5-2b31-44e1-ad23-e9e348ae6613 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:27.645922 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-a3856d9a-cc5a-4f95-b5f3-f618b1484b5f req-9e5b55e5-2b31-44e1-ad23-e9e348ae6613 service nova] Creating event network-changed:909994da-1d1c-4fc5-955f-cc0ae5196ea8 for instance 9bd2c0e2-8256-484a-bbd5-f21743724671 on n-h2-846463-3 Sep 23 04:58:27.652862 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-a3856d9a-cc5a-4f95-b5f3-f618b1484b5f req-9e5b55e5-2b31-44e1-ad23-e9e348ae6613 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120816 Sep 23 04:58:27.679624 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2738/5622] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:58:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:58:27.896629 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-01cbd8f7-4cc7-42c6-942b-f2392e3e3c20 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671" status: 204 len: 0 microversion: 2.1 time: 0.553044 Sep 23 04:58:27.898121 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2885/5623] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:58:27 2022] DELETE /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:58:27.907839 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-94fa0fc9-1e25-4a13-a1bb-cbd0b80f7aea tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:58:27.908718 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-94fa0fc9-1e25-4a13-a1bb-cbd0b80f7aea tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 9bd2c0e2-8256-484a-bbd5-f21743724671] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:58:27.920463 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-94fa0fc9-1e25-4a13-a1bb-cbd0b80f7aea tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:27.920965 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-94fa0fc9-1e25-4a13-a1bb-cbd0b80f7aea tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:27.921411 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-94fa0fc9-1e25-4a13-a1bb-cbd0b80f7aea tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:27.925121 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-94fa0fc9-1e25-4a13-a1bb-cbd0b80f7aea tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:27.925603 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-94fa0fc9-1e25-4a13-a1bb-cbd0b80f7aea tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:27.926314 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-94fa0fc9-1e25-4a13-a1bb-cbd0b80f7aea tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:28.263601 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-025479e1-9576-4890-b1d4-ec5430ff9af0 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:58:28.264307 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-025479e1-9576-4890-b1d4-ec5430ff9af0 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] [instance: 13a0b913-5596-453f-a5fb-119e20b6b885] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:58:28.592961 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-025479e1-9576-4890-b1d4-ec5430ff9af0 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a845ca1e7747fba0a987235d980098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca57a0af591a43ee9cdef09134bc3fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:58:28.615810 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-025479e1-9576-4890-b1d4-ec5430ff9af0 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] 10.222.0.33 "GET /compute/v2.1/servers/13a0b913-5596-453f-a5fb-119e20b6b885" status: 200 len: 1213 microversion: 2.1 time: 0.356927 Sep 23 04:58:28.617299 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2886/5624] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:58:28 2022] GET /compute/v2.1/servers/13a0b913-5596-453f-a5fb-119e20b6b885 => generated 1213 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:58:29.082255 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-94fa0fc9-1e25-4a13-a1bb-cbd0b80f7aea tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:58:29.113390 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-94fa0fc9-1e25-4a13-a1bb-cbd0b80f7aea tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671" status: 200 len: 1686 microversion: 2.1 time: 1.210339 Sep 23 04:58:29.114922 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2739/5625] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:58:27 2022] GET /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671 => generated 1686 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:58:29.644168 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-af0cbff7-350a-4397-a46e-77f7b3f1641b tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:58:29.645389 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-af0cbff7-350a-4397-a46e-77f7b3f1641b tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] [instance: 13a0b913-5596-453f-a5fb-119e20b6b885] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:58:29.656129 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-af0cbff7-350a-4397-a46e-77f7b3f1641b tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:29.656848 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-af0cbff7-350a-4397-a46e-77f7b3f1641b tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:29.657478 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-af0cbff7-350a-4397-a46e-77f7b3f1641b tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:29.658391 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-af0cbff7-350a-4397-a46e-77f7b3f1641b tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:29.659016 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-af0cbff7-350a-4397-a46e-77f7b3f1641b tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:29.659698 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-af0cbff7-350a-4397-a46e-77f7b3f1641b tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:29.894298 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-af0cbff7-350a-4397-a46e-77f7b3f1641b tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a845ca1e7747fba0a987235d980098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca57a0af591a43ee9cdef09134bc3fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:58:29.933215 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-af0cbff7-350a-4397-a46e-77f7b3f1641b tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] 10.222.0.33 "GET /compute/v2.1/servers/13a0b913-5596-453f-a5fb-119e20b6b885" status: 200 len: 1265 microversion: 2.1 time: 0.291662 Sep 23 04:58:29.936346 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2887/5626] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:58:29 2022] GET /compute/v2.1/servers/13a0b913-5596-453f-a5fb-119e20b6b885 => generated 1265 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:58:30.144791 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-23a81d87-edb9-471a-b615-8e45cb49a14d tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:58:30.148658 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-23a81d87-edb9-471a-b615-8e45cb49a14d tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 9bd2c0e2-8256-484a-bbd5-f21743724671] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:58:30.157060 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-23a81d87-edb9-471a-b615-8e45cb49a14d tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:30.157822 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-23a81d87-edb9-471a-b615-8e45cb49a14d tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:30.158522 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-23a81d87-edb9-471a-b615-8e45cb49a14d tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:30.161069 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-23a81d87-edb9-471a-b615-8e45cb49a14d tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:30.161747 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-23a81d87-edb9-471a-b615-8e45cb49a14d tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:30.162939 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-23a81d87-edb9-471a-b615-8e45cb49a14d tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:30.551053 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-23a81d87-edb9-471a-b615-8e45cb49a14d tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:58:30.568444 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-31fa9341-bf20-47f5-8fba-b62391c95970 req-79ffba84-36c4-4290-a09c-7c9a9cfe94d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bd2c0e2-8256-484a-bbd5-f21743724671", "name": "network-vif-deleted", "tag": "909994da-1d1c-4fc5-955f-cc0ae5196ea8"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:58:30.577070 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-23a81d87-edb9-471a-b615-8e45cb49a14d tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671" status: 200 len: 1500 microversion: 2.1 time: 0.438042 Sep 23 04:58:30.588318 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2740/5627] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:58:30 2022] GET /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671 => generated 1500 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:58:30.606142 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-31fa9341-bf20-47f5-8fba-b62391c95970 req-79ffba84-36c4-4290-a09c-7c9a9cfe94d8 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:30.607756 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-31fa9341-bf20-47f5-8fba-b62391c95970 req-79ffba84-36c4-4290-a09c-7c9a9cfe94d8 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:30.609099 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-31fa9341-bf20-47f5-8fba-b62391c95970 req-79ffba84-36c4-4290-a09c-7c9a9cfe94d8 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:30.639361 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-31fa9341-bf20-47f5-8fba-b62391c95970 req-79ffba84-36c4-4290-a09c-7c9a9cfe94d8 service nova] Creating event network-vif-deleted:909994da-1d1c-4fc5-955f-cc0ae5196ea8 for instance 9bd2c0e2-8256-484a-bbd5-f21743724671 on n-h2-846463-3 Sep 23 04:58:30.652600 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-31fa9341-bf20-47f5-8fba-b62391c95970 req-79ffba84-36c4-4290-a09c-7c9a9cfe94d8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090789 Sep 23 04:58:30.656575 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2888/5628] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:58:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:58:30.970959 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-97fc7080-fa28-4396-8ebc-c25c3843579c tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:58:30.971607 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-97fc7080-fa28-4396-8ebc-c25c3843579c tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] [instance: 13a0b913-5596-453f-a5fb-119e20b6b885] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:58:31.016595 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-97fc7080-fa28-4396-8ebc-c25c3843579c tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:31.026144 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-97fc7080-fa28-4396-8ebc-c25c3843579c tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:31.028976 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-97fc7080-fa28-4396-8ebc-c25c3843579c tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:31.037988 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-97fc7080-fa28-4396-8ebc-c25c3843579c tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:31.050013 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-97fc7080-fa28-4396-8ebc-c25c3843579c tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:31.053671 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-97fc7080-fa28-4396-8ebc-c25c3843579c tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:31.358878 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-97fc7080-fa28-4396-8ebc-c25c3843579c tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a845ca1e7747fba0a987235d980098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca57a0af591a43ee9cdef09134bc3fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:58:31.368382 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-97fc7080-fa28-4396-8ebc-c25c3843579c tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] 10.222.0.33 "GET /compute/v2.1/servers/13a0b913-5596-453f-a5fb-119e20b6b885" status: 200 len: 1271 microversion: 2.1 time: 0.406876 Sep 23 04:58:31.371520 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2741/5629] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:58:30 2022] GET /compute/v2.1/servers/13a0b913-5596-453f-a5fb-119e20b6b885 => generated 1271 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:58:31.615926 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5c427123-46ce-4b13-8088-80b83dcc581c tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:58:31.616641 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-5c427123-46ce-4b13-8088-80b83dcc581c tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 9bd2c0e2-8256-484a-bbd5-f21743724671] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:58:31.635355 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5c427123-46ce-4b13-8088-80b83dcc581c tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:31.636108 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5c427123-46ce-4b13-8088-80b83dcc581c tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:31.636722 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5c427123-46ce-4b13-8088-80b83dcc581c tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:31.638759 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5c427123-46ce-4b13-8088-80b83dcc581c tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:31.638759 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5c427123-46ce-4b13-8088-80b83dcc581c tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:31.639308 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5c427123-46ce-4b13-8088-80b83dcc581c tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:31.683767 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5c427123-46ce-4b13-8088-80b83dcc581c tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:31.685519 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5c427123-46ce-4b13-8088-80b83dcc581c tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:31.688640 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5c427123-46ce-4b13-8088-80b83dcc581c tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:31.689316 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-5c427123-46ce-4b13-8088-80b83dcc581c tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lazy-loading 'fault' on Instance uuid 9bd2c0e2-8256-484a-bbd5-f21743724671 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:58:31.809842 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-5c427123-46ce-4b13-8088-80b83dcc581c tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:58:31.822184 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5c427123-46ce-4b13-8088-80b83dcc581c tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671" status: 200 len: 1355 microversion: 2.1 time: 0.210938 Sep 23 04:58:31.835733 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2889/5630] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:58:31 2022] GET /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671 => generated 1355 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:58:32.395194 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f68336ad-d77f-4c33-a296-466108e550b7 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:58:32.397786 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f68336ad-d77f-4c33-a296-466108e550b7 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] [instance: 13a0b913-5596-453f-a5fb-119e20b6b885] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:58:32.431934 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f68336ad-d77f-4c33-a296-466108e550b7 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:32.432712 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f68336ad-d77f-4c33-a296-466108e550b7 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:32.437858 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f68336ad-d77f-4c33-a296-466108e550b7 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:32.437858 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f68336ad-d77f-4c33-a296-466108e550b7 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:32.437858 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f68336ad-d77f-4c33-a296-466108e550b7 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:32.437858 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f68336ad-d77f-4c33-a296-466108e550b7 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:32.850538 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-abfb65ca-9bf3-4b56-8121-3a5c551ac562 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:58:32.851799 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-abfb65ca-9bf3-4b56-8121-3a5c551ac562 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 9bd2c0e2-8256-484a-bbd5-f21743724671] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:58:32.864934 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-abfb65ca-9bf3-4b56-8121-3a5c551ac562 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:32.864934 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-abfb65ca-9bf3-4b56-8121-3a5c551ac562 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:32.864934 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-abfb65ca-9bf3-4b56-8121-3a5c551ac562 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:32.865876 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-abfb65ca-9bf3-4b56-8121-3a5c551ac562 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:32.867360 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-abfb65ca-9bf3-4b56-8121-3a5c551ac562 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:32.868194 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-abfb65ca-9bf3-4b56-8121-3a5c551ac562 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:32.886153 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-abfb65ca-9bf3-4b56-8121-3a5c551ac562 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] HTTP exception thrown: Instance 9bd2c0e2-8256-484a-bbd5-f21743724671 could not be found. Sep 23 04:58:32.888866 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-abfb65ca-9bf3-4b56-8121-3a5c551ac562 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Request method failure captured: Sep 23 04:58:32.888866 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671 HTTP/1.1 Sep 23 04:58:32.888866 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:58:32.888866 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:58:32.888866 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:58:32.888866 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:58:32.888866 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:58:32.888866 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:58:32.888866 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:58:32.888866 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:58:32.888866 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTuh1c3OgRIe1BU7UL8-kD14hlRXf5-nFbACK4mxuSKPbpHtZ3lNSkhpLmoZL6fwvp0Ltsnj8vHhgRu38aM6jYq6FwsdCqK2OWFRVgv0DQ0vVXkecsl4CFvJWRuidyNHB1AUlKQZ5jbBIxVU9phuyFgTgBHHGat4T2qduHdIYS940-A Sep 23 04:58:32.888866 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:58:32.888866 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:58:32.888866 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:58:32.888866 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:58:32.888866 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:58:32.888866 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:58:32.888866 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 0edd6bd5b418494fbcb05c743967d36a Sep 23 04:58:32.888866 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-326863130 Sep 23 04:58:32.888866 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:58:32.888866 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:58:32.888866 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0edd6bd5b418494fbcb05c743967d36a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0edd6bd5b418494fbcb05c743967d36a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0edd6bd5b418494fbcb05c743967d36a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0edd6bd5b418494fbcb05c743967d36a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:58:32.888866 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-TestNetworkAdvancedServerOps-326863130 Sep 23 04:58:32.888866 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 0edd6bd5b418494fbcb05c743967d36a Sep 23 04:58:32.888866 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-326863130 Sep 23 04:58:32.888866 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-TestNetworkAdvancedServerOps-326863130-project Sep 23 04:58:32.888866 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:58:32.888866 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:58:32.888866 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 8d3d0a162e7e4beb81a54120cab246ff Sep 23 04:58:32.888866 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-TestNetworkAdvancedServerOps-326863130-project Sep 23 04:58:32.888866 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:58:32.888866 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 9bd2c0e2-8256-484a-bbd5-f21743724671 could not be found. Sep 23 04:58:32.888866 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '9bd2c0e2-8256-484a-bbd5-f21743724671'} Sep 23 04:58:32.888866 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:58:32.888866 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:58:32.888866 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:58:32.888866 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:58:32.888866 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:58:32.888866 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:58:32.888866 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:58:32.888866 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:58:32.888866 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:58:32.888866 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:58:32.888866 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9bd2c0e2-8256-484a-bbd5-f21743724671 could not be found. Sep 23 04:58:32.888866 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:58:32.888866 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:58:32.888866 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:58:32.888866 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:58:32.888866 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:58:32.888866 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:58:32.888866 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:58:32.888866 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:58:32.888866 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:58:32.888866 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:58:32.888866 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:58:32.888866 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:58:32.888866 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:58:32.888866 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:58:32.888866 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:58:32.888866 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:58:32.888866 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9bd2c0e2-8256-484a-bbd5-f21743724671 could not be found. Sep 23 04:58:32.888866 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:58:32.888866 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:58:32.897227 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:58:32.897227 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:58:32.897227 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:58:32.897227 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:58:32.897227 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:58:32.897227 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:58:32.897227 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9bd2c0e2-8256-484a-bbd5-f21743724671 could not be found. Sep 23 04:58:32.897227 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:58:32.897227 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-abfb65ca-9bf3-4b56-8121-3a5c551ac562 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Returning 404 to user: Instance 9bd2c0e2-8256-484a-bbd5-f21743724671 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:58:32.897227 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-abfb65ca-9bf3-4b56-8121-3a5c551ac562 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671" status: 404 len: 111 microversion: 2.1 time: 0.044274 Sep 23 04:58:32.897227 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2890/5631] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:58:32 2022] GET /compute/v2.1/servers/9bd2c0e2-8256-484a-bbd5-f21743724671 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:58:32.952253 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f68336ad-d77f-4c33-a296-466108e550b7 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a845ca1e7747fba0a987235d980098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca57a0af591a43ee9cdef09134bc3fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:58:32.964660 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f68336ad-d77f-4c33-a296-466108e550b7 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] 10.222.0.33 "GET /compute/v2.1/servers/13a0b913-5596-453f-a5fb-119e20b6b885" status: 200 len: 1271 microversion: 2.1 time: 0.573605 Sep 23 04:58:32.983804 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2742/5632] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:58:32 2022] GET /compute/v2.1/servers/13a0b913-5596-453f-a5fb-119e20b6b885 => generated 1271 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:58:33.997671 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d390dbf3-7717-431a-8fc4-192c28d62b10 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:58:34.006143 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d390dbf3-7717-431a-8fc4-192c28d62b10 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] [instance: 13a0b913-5596-453f-a5fb-119e20b6b885] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:58:34.020585 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d390dbf3-7717-431a-8fc4-192c28d62b10 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:34.021046 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d390dbf3-7717-431a-8fc4-192c28d62b10 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:34.021491 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d390dbf3-7717-431a-8fc4-192c28d62b10 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:34.022256 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d390dbf3-7717-431a-8fc4-192c28d62b10 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:34.022895 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d390dbf3-7717-431a-8fc4-192c28d62b10 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:34.023832 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d390dbf3-7717-431a-8fc4-192c28d62b10 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:34.984683 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d390dbf3-7717-431a-8fc4-192c28d62b10 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a845ca1e7747fba0a987235d980098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca57a0af591a43ee9cdef09134bc3fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:58:35.004184 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d390dbf3-7717-431a-8fc4-192c28d62b10 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] 10.222.0.33 "GET /compute/v2.1/servers/13a0b913-5596-453f-a5fb-119e20b6b885" status: 200 len: 1313 microversion: 2.1 time: 1.010795 Sep 23 04:58:35.004830 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2891/5633] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:58:33 2022] GET /compute/v2.1/servers/13a0b913-5596-453f-a5fb-119e20b6b885 => generated 1313 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:58:35.906648 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7df75168-a369-4b14-b417-8a1367c016c2 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1768025375", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b3d6df46-361b-46bb-b716-e96a928809dc"}], "security_groups": [{"name": "tempest-securitygroup--685514205"}], "key_name": "tempest-keypair-284355332", "user_data": "}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:58:36.032576 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-43fdad6d-5588-4452-b842-42af95536f76 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:58:36.033334 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-43fdad6d-5588-4452-b842-42af95536f76 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] [instance: 13a0b913-5596-453f-a5fb-119e20b6b885] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:58:36.042795 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-43fdad6d-5588-4452-b842-42af95536f76 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:36.047633 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-43fdad6d-5588-4452-b842-42af95536f76 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:36.048476 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-43fdad6d-5588-4452-b842-42af95536f76 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:36.049269 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-43fdad6d-5588-4452-b842-42af95536f76 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:36.052116 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-43fdad6d-5588-4452-b842-42af95536f76 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:36.052637 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-43fdad6d-5588-4452-b842-42af95536f76 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:36.324124 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.network.neutron [None req-7df75168-a369-4b14-b417-8a1367c016c2 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] validate_networks() for [('b3d6df46-361b-46bb-b716-e96a928809dc', None, None, None, None, None)] {{(pid=122698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:58:36.434387 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:58:36.552712 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-43fdad6d-5588-4452-b842-42af95536f76 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a845ca1e7747fba0a987235d980098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca57a0af591a43ee9cdef09134bc3fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:58:36.596096 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-43fdad6d-5588-4452-b842-42af95536f76 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] 10.222.0.33 "GET /compute/v2.1/servers/13a0b913-5596-453f-a5fb-119e20b6b885" status: 200 len: 1313 microversion: 2.1 time: 0.567254 Sep 23 04:58:36.603379 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2892/5634] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:58:36 2022] GET /compute/v2.1/servers/13a0b913-5596-453f-a5fb-119e20b6b885 => generated 1313 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:58:37.392431 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=10 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:58:37.476737 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-7df75168-a369-4b14-b417-8a1367c016c2 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Flavor limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:58:37.476737 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-7df75168-a369-4b14-b417-8a1367c016c2 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Image limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:58:37.476737 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-7df75168-a369-4b14-b417-8a1367c016c2 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Flavor pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:58:37.476737 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-7df75168-a369-4b14-b417-8a1367c016c2 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Image pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:58:37.476737 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-7df75168-a369-4b14-b417-8a1367c016c2 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:58:37.492398 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7df75168-a369-4b14-b417-8a1367c016c2 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:37.492904 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7df75168-a369-4b14-b417-8a1367c016c2 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:37.493359 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7df75168-a369-4b14-b417-8a1367c016c2 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:37.503524 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7df75168-a369-4b14-b417-8a1367c016c2 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:37.504125 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7df75168-a369-4b14-b417-8a1367c016c2 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:37.504577 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7df75168-a369-4b14-b417-8a1367c016c2 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:37.563219 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-7df75168-a369-4b14-b417-8a1367c016c2 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Getting quotas for project 71874a329e54494bb1b84f31c3826205. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:58:37.569706 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-7df75168-a369-4b14-b417-8a1367c016c2 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Getting quotas for user d1bde73a530f4666aebdd5f7d9fa1046 and project 71874a329e54494bb1b84f31c3826205. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:58:37.588455 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7df75168-a369-4b14-b417-8a1367c016c2 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Going to run 1 instances... {{(pid=122698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:58:37.591377 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7df75168-a369-4b14-b417-8a1367c016c2 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] [instance: ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:58:37.628499 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c01a7030-a2a4-4efa-9561-98ad30659c3b tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:58:37.629150 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c01a7030-a2a4-4efa-9561-98ad30659c3b tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] [instance: 13a0b913-5596-453f-a5fb-119e20b6b885] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:58:37.639773 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c01a7030-a2a4-4efa-9561-98ad30659c3b tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:37.643205 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c01a7030-a2a4-4efa-9561-98ad30659c3b tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:37.651502 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c01a7030-a2a4-4efa-9561-98ad30659c3b tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:37.657872 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c01a7030-a2a4-4efa-9561-98ad30659c3b tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:37.657872 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c01a7030-a2a4-4efa-9561-98ad30659c3b tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:37.657872 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c01a7030-a2a4-4efa-9561-98ad30659c3b tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:37.815707 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7df75168-a369-4b14-b417-8a1367c016c2 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.914325 Sep 23 04:58:37.817967 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2743/5635] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:58:35 2022] POST /compute/v2.1/servers => generated 401 bytes in 1917 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:58:37.837644 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-26e2bc7d-cbbe-47a2-b453-568a6d9d4af2 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:58:37.840217 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-26e2bc7d-cbbe-47a2-b453-568a6d9d4af2 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] [instance: ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:58:38.012525 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-26e2bc7d-cbbe-47a2-b453-568a6d9d4af2 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bde73a530f4666aebdd5f7d9fa1046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71874a329e54494bb1b84f31c3826205', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:58:38.027402 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-26e2bc7d-cbbe-47a2-b453-568a6d9d4af2 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] 10.222.0.33 "GET /compute/v2.1/servers/ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7" status: 200 len: 1237 microversion: 2.1 time: 0.202355 Sep 23 04:58:38.030278 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2744/5636] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:58:37 2022] GET /compute/v2.1/servers/ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7 => generated 1237 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:58:38.066352 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c01a7030-a2a4-4efa-9561-98ad30659c3b tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a845ca1e7747fba0a987235d980098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca57a0af591a43ee9cdef09134bc3fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:58:38.076739 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c01a7030-a2a4-4efa-9561-98ad30659c3b tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] 10.222.0.33 "GET /compute/v2.1/servers/13a0b913-5596-453f-a5fb-119e20b6b885" status: 200 len: 1313 microversion: 2.1 time: 0.453998 Sep 23 04:58:38.078955 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2893/5637] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:58:37 2022] GET /compute/v2.1/servers/13a0b913-5596-453f-a5fb-119e20b6b885 => generated 1313 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:58:38.670009 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-913d995f-42cd-4a31-a52f-c510f864651a req-aa2ba9f9-f375-44ab-b444-d89cafe4a9b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13a0b913-5596-453f-a5fb-119e20b6b885", "tag": "6099b480-fb1a-4e93-bd74-b14a7d6a610b"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:58:38.718342 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-913d995f-42cd-4a31-a52f-c510f864651a req-aa2ba9f9-f375-44ab-b444-d89cafe4a9b5 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:38.720240 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-913d995f-42cd-4a31-a52f-c510f864651a req-aa2ba9f9-f375-44ab-b444-d89cafe4a9b5 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:38.726739 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-913d995f-42cd-4a31-a52f-c510f864651a req-aa2ba9f9-f375-44ab-b444-d89cafe4a9b5 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:38.776255 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-913d995f-42cd-4a31-a52f-c510f864651a req-aa2ba9f9-f375-44ab-b444-d89cafe4a9b5 service nova] Creating event network-changed:6099b480-fb1a-4e93-bd74-b14a7d6a610b for instance 13a0b913-5596-453f-a5fb-119e20b6b885 on n-h1-846463-3 Sep 23 04:58:38.791103 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-913d995f-42cd-4a31-a52f-c510f864651a req-aa2ba9f9-f375-44ab-b444-d89cafe4a9b5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130247 Sep 23 04:58:38.793504 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2745/5638] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:58:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:58:39.054106 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b0f290d3-27f4-40ed-8779-ed4f506e9afa tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:58:39.054879 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b0f290d3-27f4-40ed-8779-ed4f506e9afa tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] [instance: ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:58:39.067379 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=4 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:58:39.106884 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-096675a4-9b16-48ba-8fee-7af55526b167 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:58:39.108011 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-096675a4-9b16-48ba-8fee-7af55526b167 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] [instance: 13a0b913-5596-453f-a5fb-119e20b6b885] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:58:39.129601 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-096675a4-9b16-48ba-8fee-7af55526b167 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:39.136635 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-096675a4-9b16-48ba-8fee-7af55526b167 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:39.138005 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-096675a4-9b16-48ba-8fee-7af55526b167 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:39.139304 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-096675a4-9b16-48ba-8fee-7af55526b167 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:39.144700 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-096675a4-9b16-48ba-8fee-7af55526b167 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:39.145776 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-096675a4-9b16-48ba-8fee-7af55526b167 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:39.370781 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b0f290d3-27f4-40ed-8779-ed4f506e9afa tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bde73a530f4666aebdd5f7d9fa1046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71874a329e54494bb1b84f31c3826205', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:58:39.370781 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b0f290d3-27f4-40ed-8779-ed4f506e9afa tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] 10.222.0.33 "GET /compute/v2.1/servers/ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7" status: 200 len: 1237 microversion: 2.1 time: 0.316788 Sep 23 04:58:39.370781 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2894/5639] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:58:39 2022] GET /compute/v2.1/servers/ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7 => generated 1237 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:58:39.804165 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-096675a4-9b16-48ba-8fee-7af55526b167 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a845ca1e7747fba0a987235d980098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca57a0af591a43ee9cdef09134bc3fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:58:39.813551 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-096675a4-9b16-48ba-8fee-7af55526b167 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] 10.222.0.33 "GET /compute/v2.1/servers/13a0b913-5596-453f-a5fb-119e20b6b885" status: 200 len: 1313 microversion: 2.1 time: 0.713207 Sep 23 04:58:39.815615 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2746/5640] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:58:39 2022] GET /compute/v2.1/servers/13a0b913-5596-453f-a5fb-119e20b6b885 => generated 1313 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:58:40.389881 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0a9ba55a-3883-4504-b121-82efa4b319c2 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:58:40.391172 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-0a9ba55a-3883-4504-b121-82efa4b319c2 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] [instance: ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:58:40.408894 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0a9ba55a-3883-4504-b121-82efa4b319c2 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:40.409620 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0a9ba55a-3883-4504-b121-82efa4b319c2 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:40.410111 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0a9ba55a-3883-4504-b121-82efa4b319c2 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:40.410920 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0a9ba55a-3883-4504-b121-82efa4b319c2 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:40.411297 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0a9ba55a-3883-4504-b121-82efa4b319c2 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:40.411727 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0a9ba55a-3883-4504-b121-82efa4b319c2 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:40.700599 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-0a9ba55a-3883-4504-b121-82efa4b319c2 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bde73a530f4666aebdd5f7d9fa1046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71874a329e54494bb1b84f31c3826205', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:58:40.712733 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0a9ba55a-3883-4504-b121-82efa4b319c2 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] 10.222.0.33 "GET /compute/v2.1/servers/ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7" status: 200 len: 1289 microversion: 2.1 time: 0.328390 Sep 23 04:58:40.718022 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2895/5641] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:58:40 2022] GET /compute/v2.1/servers/ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7 => generated 1289 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:58:40.851365 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-dd17474e-8ab5-426f-86bd-58cd71232902 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:58:40.852129 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-dd17474e-8ab5-426f-86bd-58cd71232902 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] [instance: 13a0b913-5596-453f-a5fb-119e20b6b885] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:58:40.872061 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dd17474e-8ab5-426f-86bd-58cd71232902 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:40.872819 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dd17474e-8ab5-426f-86bd-58cd71232902 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:40.874842 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dd17474e-8ab5-426f-86bd-58cd71232902 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:40.877316 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dd17474e-8ab5-426f-86bd-58cd71232902 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:40.879845 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dd17474e-8ab5-426f-86bd-58cd71232902 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:40.883282 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dd17474e-8ab5-426f-86bd-58cd71232902 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:41.733047 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-dd17474e-8ab5-426f-86bd-58cd71232902 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a845ca1e7747fba0a987235d980098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca57a0af591a43ee9cdef09134bc3fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:58:41.741727 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ae76ecdd-a565-4f73-95c1-4ed4d7dfc96a tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:58:41.747789 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ae76ecdd-a565-4f73-95c1-4ed4d7dfc96a tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] [instance: ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:58:41.747902 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-dd17474e-8ab5-426f-86bd-58cd71232902 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] 10.222.0.33 "GET /compute/v2.1/servers/13a0b913-5596-453f-a5fb-119e20b6b885" status: 200 len: 1313 microversion: 2.1 time: 0.907067 Sep 23 04:58:41.747902 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2747/5642] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:58:40 2022] GET /compute/v2.1/servers/13a0b913-5596-453f-a5fb-119e20b6b885 => generated 1313 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:58:41.752381 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ae76ecdd-a565-4f73-95c1-4ed4d7dfc96a tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:41.753039 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ae76ecdd-a565-4f73-95c1-4ed4d7dfc96a tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:41.753646 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ae76ecdd-a565-4f73-95c1-4ed4d7dfc96a tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:41.754531 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ae76ecdd-a565-4f73-95c1-4ed4d7dfc96a tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:41.754998 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ae76ecdd-a565-4f73-95c1-4ed4d7dfc96a tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:41.755430 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ae76ecdd-a565-4f73-95c1-4ed4d7dfc96a tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:41.829406 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ae76ecdd-a565-4f73-95c1-4ed4d7dfc96a tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bde73a530f4666aebdd5f7d9fa1046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71874a329e54494bb1b84f31c3826205', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:58:41.842177 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ae76ecdd-a565-4f73-95c1-4ed4d7dfc96a tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] 10.222.0.33 "GET /compute/v2.1/servers/ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7" status: 200 len: 1295 microversion: 2.1 time: 0.102176 Sep 23 04:58:41.843113 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2896/5643] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:58:41 2022] GET /compute/v2.1/servers/ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7 => generated 1295 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:58:42.770771 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f82b6a1a-845b-4b11-bf92-4db2cf25885e tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:58:42.772041 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f82b6a1a-845b-4b11-bf92-4db2cf25885e tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] [instance: 13a0b913-5596-453f-a5fb-119e20b6b885] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:58:42.780860 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f82b6a1a-845b-4b11-bf92-4db2cf25885e tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:42.781362 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f82b6a1a-845b-4b11-bf92-4db2cf25885e tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:42.781867 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f82b6a1a-845b-4b11-bf92-4db2cf25885e tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:42.782766 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f82b6a1a-845b-4b11-bf92-4db2cf25885e tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:42.783238 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f82b6a1a-845b-4b11-bf92-4db2cf25885e tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:42.783848 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f82b6a1a-845b-4b11-bf92-4db2cf25885e tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:42.865930 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3db3bcee-3d59-469f-8b64-96fdaa59833a tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:58:42.866469 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-3db3bcee-3d59-469f-8b64-96fdaa59833a tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] [instance: ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:58:42.877559 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3db3bcee-3d59-469f-8b64-96fdaa59833a tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:42.879572 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3db3bcee-3d59-469f-8b64-96fdaa59833a tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:42.881365 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3db3bcee-3d59-469f-8b64-96fdaa59833a tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:42.882642 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3db3bcee-3d59-469f-8b64-96fdaa59833a tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:42.884728 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3db3bcee-3d59-469f-8b64-96fdaa59833a tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:42.886506 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3db3bcee-3d59-469f-8b64-96fdaa59833a tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:43.151801 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-3db3bcee-3d59-469f-8b64-96fdaa59833a tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bde73a530f4666aebdd5f7d9fa1046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71874a329e54494bb1b84f31c3826205', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:58:43.157662 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:58:43.169562 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3db3bcee-3d59-469f-8b64-96fdaa59833a tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] 10.222.0.33 "GET /compute/v2.1/servers/ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7" status: 200 len: 1295 microversion: 2.1 time: 0.308066 Sep 23 04:58:43.170472 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2897/5644] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:58:42 2022] GET /compute/v2.1/servers/ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7 => generated 1295 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:58:43.444306 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f82b6a1a-845b-4b11-bf92-4db2cf25885e tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a845ca1e7747fba0a987235d980098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca57a0af591a43ee9cdef09134bc3fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:58:43.453137 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f82b6a1a-845b-4b11-bf92-4db2cf25885e tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] 10.222.0.33 "GET /compute/v2.1/servers/13a0b913-5596-453f-a5fb-119e20b6b885" status: 200 len: 1313 microversion: 2.1 time: 0.690155 Sep 23 04:58:43.466245 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2748/5645] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:58:42 2022] GET /compute/v2.1/servers/13a0b913-5596-453f-a5fb-119e20b6b885 => generated 1313 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:58:44.195330 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ef679b18-067b-4f2b-9ca3-b8469723451c tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:58:44.196824 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ef679b18-067b-4f2b-9ca3-b8469723451c tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] [instance: ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:58:44.205116 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ef679b18-067b-4f2b-9ca3-b8469723451c tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:44.206567 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ef679b18-067b-4f2b-9ca3-b8469723451c tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:44.207236 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ef679b18-067b-4f2b-9ca3-b8469723451c tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:44.208782 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ef679b18-067b-4f2b-9ca3-b8469723451c tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:44.209470 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ef679b18-067b-4f2b-9ca3-b8469723451c tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:44.210250 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ef679b18-067b-4f2b-9ca3-b8469723451c tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:44.494787 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5dee51e0-bd33-462a-bcc9-5415c695864e tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:58:44.494787 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5dee51e0-bd33-462a-bcc9-5415c695864e tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] [instance: 13a0b913-5596-453f-a5fb-119e20b6b885] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:58:44.536774 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5dee51e0-bd33-462a-bcc9-5415c695864e tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:44.540836 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5dee51e0-bd33-462a-bcc9-5415c695864e tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:44.542659 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5dee51e0-bd33-462a-bcc9-5415c695864e tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:44.545212 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5dee51e0-bd33-462a-bcc9-5415c695864e tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:44.548697 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5dee51e0-bd33-462a-bcc9-5415c695864e tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:44.550408 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5dee51e0-bd33-462a-bcc9-5415c695864e tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:44.630497 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ef679b18-067b-4f2b-9ca3-b8469723451c tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bde73a530f4666aebdd5f7d9fa1046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71874a329e54494bb1b84f31c3826205', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:58:44.646343 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ef679b18-067b-4f2b-9ca3-b8469723451c tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] 10.222.0.33 "GET /compute/v2.1/servers/ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7" status: 200 len: 1362 microversion: 2.1 time: 0.457406 Sep 23 04:58:44.649072 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2898/5646] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:58:44 2022] GET /compute/v2.1/servers/ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7 => generated 1362 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:58:44.755676 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f4ab001d-33e0-4c72-a80e-4b050cf5b7ad tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '.version_select at 0x7ff1bb09da60>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:58:44.890781 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-5dee51e0-bd33-462a-bcc9-5415c695864e tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a845ca1e7747fba0a987235d980098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca57a0af591a43ee9cdef09134bc3fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:58:44.890885 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f4ab001d-33e0-4c72-a80e-4b050cf5b7ad tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-152890243" status: 202 len: 0 microversion: 2.1 time: 0.132675 Sep 23 04:58:44.897699 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2899/5647] 10.222.0.33 () {58 vars in 1281 bytes} [Fri Sep 23 04:58:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-152890243 => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 04:58:44.905204 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5dee51e0-bd33-462a-bcc9-5415c695864e tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] 10.222.0.33 "GET /compute/v2.1/servers/13a0b913-5596-453f-a5fb-119e20b6b885" status: 200 len: 1313 microversion: 2.1 time: 0.429604 Sep 23 04:58:44.908449 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2749/5648] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:58:44 2022] GET /compute/v2.1/servers/13a0b913-5596-453f-a5fb-119e20b6b885 => generated 1313 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:58:44.942419 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d425780a-47ee-4631-af5c-0587927925ab tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Action: 'create', calling method: .version_select at 0x7ff1babf1e50>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1395192842", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC+oD2wfcP0Ia9qvJLvQhSxEfV1Vx2VXeB3i4bEyMcN+R+0gVuxTj1JymEb47W0b+8VH8exwrip1ao44IK9BNYDg1NWp91LxV2kdvzrcQa8c15RaLtHeolmt2dNH73iD4w=="}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:58:44.984240 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-d425780a-47ee-4631-af5c-0587927925ab tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Getting quotas for project 0edd6bd5b418494fbcb05c743967d36a. Resources: {'key_pairs'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:58:44.993174 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-d425780a-47ee-4631-af5c-0587927925ab tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Getting quotas for user 8d3d0a162e7e4beb81a54120cab246ff and project 0edd6bd5b418494fbcb05c743967d36a. Resources: {'key_pairs'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:58:45.186918 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d425780a-47ee-4631-af5c-0587927925ab tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.242721 Sep 23 04:58:45.199863 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2900/5649] 10.222.0.33 () {60 vars in 1159 bytes} [Fri Sep 23 04:58:44 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:58:45.408041 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-110d609a-51cb-4d86-805a-55d348ee7be2 req-7c18b532-105e-45ca-bc0b-c4247ef808c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7", "tag": "b1886339-f419-4169-8784-43f871380f08"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:58:45.429710 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-110d609a-51cb-4d86-805a-55d348ee7be2 req-7c18b532-105e-45ca-bc0b-c4247ef808c6 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:45.432108 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-110d609a-51cb-4d86-805a-55d348ee7be2 req-7c18b532-105e-45ca-bc0b-c4247ef808c6 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:45.433006 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-110d609a-51cb-4d86-805a-55d348ee7be2 req-7c18b532-105e-45ca-bc0b-c4247ef808c6 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:45.482469 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-110d609a-51cb-4d86-805a-55d348ee7be2 req-7c18b532-105e-45ca-bc0b-c4247ef808c6 service nova] Creating event network-changed:b1886339-f419-4169-8784-43f871380f08 for instance ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7 on n-h2-846463-3 Sep 23 04:58:45.489612 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-110d609a-51cb-4d86-805a-55d348ee7be2 req-7c18b532-105e-45ca-bc0b-c4247ef808c6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085248 Sep 23 04:58:45.496548 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2750/5650] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:58:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:58:45.673388 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8c5097a4-2627-4796-a694-19b92795ac60 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:58:45.674134 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-8c5097a4-2627-4796-a694-19b92795ac60 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] [instance: ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:58:45.686149 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8c5097a4-2627-4796-a694-19b92795ac60 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:45.686847 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8c5097a4-2627-4796-a694-19b92795ac60 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:45.688324 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8c5097a4-2627-4796-a694-19b92795ac60 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:45.695099 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8c5097a4-2627-4796-a694-19b92795ac60 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:45.695099 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8c5097a4-2627-4796-a694-19b92795ac60 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:45.695099 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8c5097a4-2627-4796-a694-19b92795ac60 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:45.789238 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-91c28282-a90d-46ca-a9ef-eab3c1568684 req-3280a4e9-19ab-4070-9e2c-3d4460030770 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13a0b913-5596-453f-a5fb-119e20b6b885", "name": "network-vif-plugged", "status": "completed", "tag": "6099b480-fb1a-4e93-bd74-b14a7d6a610b"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:58:45.811467 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-91c28282-a90d-46ca-a9ef-eab3c1568684 req-3280a4e9-19ab-4070-9e2c-3d4460030770 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:45.811960 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-91c28282-a90d-46ca-a9ef-eab3c1568684 req-3280a4e9-19ab-4070-9e2c-3d4460030770 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:45.814937 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-91c28282-a90d-46ca-a9ef-eab3c1568684 req-3280a4e9-19ab-4070-9e2c-3d4460030770 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:45.839751 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-91c28282-a90d-46ca-a9ef-eab3c1568684 req-3280a4e9-19ab-4070-9e2c-3d4460030770 service nova] Creating event network-vif-plugged:6099b480-fb1a-4e93-bd74-b14a7d6a610b for instance 13a0b913-5596-453f-a5fb-119e20b6b885 on n-h1-846463-3 Sep 23 04:58:45.848737 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-91c28282-a90d-46ca-a9ef-eab3c1568684 req-3280a4e9-19ab-4070-9e2c-3d4460030770 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063442 Sep 23 04:58:45.852584 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2751/5651] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:58:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:58:45.937327 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c9009979-7d3b-4420-a5c1-7161dbeb0ae8 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:58:45.938302 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c9009979-7d3b-4420-a5c1-7161dbeb0ae8 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] [instance: 13a0b913-5596-453f-a5fb-119e20b6b885] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:58:45.952277 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c9009979-7d3b-4420-a5c1-7161dbeb0ae8 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:45.952933 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c9009979-7d3b-4420-a5c1-7161dbeb0ae8 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:45.953534 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c9009979-7d3b-4420-a5c1-7161dbeb0ae8 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:45.954770 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c9009979-7d3b-4420-a5c1-7161dbeb0ae8 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:45.955666 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c9009979-7d3b-4420-a5c1-7161dbeb0ae8 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:45.956666 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c9009979-7d3b-4420-a5c1-7161dbeb0ae8 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:45.998829 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:58:46.524240 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-8c5097a4-2627-4796-a694-19b92795ac60 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bde73a530f4666aebdd5f7d9fa1046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71874a329e54494bb1b84f31c3826205', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:58:46.534466 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-8c5097a4-2627-4796-a694-19b92795ac60 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] 10.222.0.33 "GET /compute/v2.1/servers/ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7" status: 200 len: 1362 microversion: 2.1 time: 0.863586 Sep 23 04:58:46.536641 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2901/5652] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:58:45 2022] GET /compute/v2.1/servers/ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7 => generated 1362 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:58:46.703789 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c9009979-7d3b-4420-a5c1-7161dbeb0ae8 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a845ca1e7747fba0a987235d980098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca57a0af591a43ee9cdef09134bc3fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:58:46.711715 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c9009979-7d3b-4420-a5c1-7161dbeb0ae8 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] 10.222.0.33 "GET /compute/v2.1/servers/13a0b913-5596-453f-a5fb-119e20b6b885" status: 200 len: 1313 microversion: 2.1 time: 0.780280 Sep 23 04:58:46.712311 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2752/5653] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:58:45 2022] GET /compute/v2.1/servers/13a0b913-5596-453f-a5fb-119e20b6b885 => generated 1313 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:58:47.556989 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-bfe85daf-4388-4ddd-910a-ac22af1226c4 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:58:47.557608 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-bfe85daf-4388-4ddd-910a-ac22af1226c4 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] [instance: ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:58:47.576296 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bfe85daf-4388-4ddd-910a-ac22af1226c4 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:47.580039 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bfe85daf-4388-4ddd-910a-ac22af1226c4 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:47.580521 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bfe85daf-4388-4ddd-910a-ac22af1226c4 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:47.581288 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bfe85daf-4388-4ddd-910a-ac22af1226c4 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:47.581815 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bfe85daf-4388-4ddd-910a-ac22af1226c4 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:47.582246 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bfe85daf-4388-4ddd-910a-ac22af1226c4 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:47.737110 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6db596ec-f1af-40de-81ba-ea626ca464ff tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:58:47.738325 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-6db596ec-f1af-40de-81ba-ea626ca464ff tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] [instance: 13a0b913-5596-453f-a5fb-119e20b6b885] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:58:47.750875 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:58:47.751989 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=7 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:58:47.756342 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6db596ec-f1af-40de-81ba-ea626ca464ff tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:47.757325 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6db596ec-f1af-40de-81ba-ea626ca464ff tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:47.769685 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6db596ec-f1af-40de-81ba-ea626ca464ff tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:47.770858 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6db596ec-f1af-40de-81ba-ea626ca464ff tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:47.771509 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6db596ec-f1af-40de-81ba-ea626ca464ff tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:47.772108 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6db596ec-f1af-40de-81ba-ea626ca464ff tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:48.027385 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=8 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:58:48.602899 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-bfe85daf-4388-4ddd-910a-ac22af1226c4 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bde73a530f4666aebdd5f7d9fa1046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71874a329e54494bb1b84f31c3826205', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:58:48.612441 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-bfe85daf-4388-4ddd-910a-ac22af1226c4 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] 10.222.0.33 "GET /compute/v2.1/servers/ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7" status: 200 len: 1362 microversion: 2.1 time: 1.059263 Sep 23 04:58:48.617801 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2902/5654] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:58:47 2022] GET /compute/v2.1/servers/ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7 => generated 1362 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:58:48.689360 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6db596ec-f1af-40de-81ba-ea626ca464ff tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a845ca1e7747fba0a987235d980098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca57a0af591a43ee9cdef09134bc3fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:58:48.718752 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-6db596ec-f1af-40de-81ba-ea626ca464ff tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] 10.222.0.33 "GET /compute/v2.1/servers/13a0b913-5596-453f-a5fb-119e20b6b885" status: 200 len: 1499 microversion: 2.1 time: 0.985376 Sep 23 04:58:48.730542 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2753/5655] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:58:47 2022] GET /compute/v2.1/servers/13a0b913-5596-453f-a5fb-119e20b6b885 => generated 1499 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:58:48.746561 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f9882479-e68b-478d-963b-f31b9ebeb51f tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:58:48.749762 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f9882479-e68b-478d-963b-f31b9ebeb51f tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] [instance: 13a0b913-5596-453f-a5fb-119e20b6b885] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:58:48.754088 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:58:48.759781 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f9882479-e68b-478d-963b-f31b9ebeb51f tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:48.760463 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f9882479-e68b-478d-963b-f31b9ebeb51f tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:48.761327 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f9882479-e68b-478d-963b-f31b9ebeb51f tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:48.762855 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f9882479-e68b-478d-963b-f31b9ebeb51f tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:48.763434 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f9882479-e68b-478d-963b-f31b9ebeb51f tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:48.764027 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f9882479-e68b-478d-963b-f31b9ebeb51f tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:48.794187 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-f9882479-e68b-478d-963b-f31b9ebeb51f tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lazy-loading 'flavor' on Instance uuid 13a0b913-5596-453f-a5fb-119e20b6b885 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:58:49.216248 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f9882479-e68b-478d-963b-f31b9ebeb51f tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] 10.222.0.33 "POST /compute/v2.1/servers/13a0b913-5596-453f-a5fb-119e20b6b885/action" status: 200 len: 32 microversion: 2.1 time: 0.475181 Sep 23 04:58:49.219822 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2903/5656] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:58:48 2022] POST /compute/v2.1/servers/13a0b913-5596-453f-a5fb-119e20b6b885/action => generated 32 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 04:58:49.231554 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-12e53ff1-0959-4d8f-be2d-740481e73e34 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:58:49.232353 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-12e53ff1-0959-4d8f-be2d-740481e73e34 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] [instance: 13a0b913-5596-453f-a5fb-119e20b6b885] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:58:49.252150 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-12e53ff1-0959-4d8f-be2d-740481e73e34 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:49.252661 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-12e53ff1-0959-4d8f-be2d-740481e73e34 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:49.253105 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-12e53ff1-0959-4d8f-be2d-740481e73e34 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:49.253834 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-12e53ff1-0959-4d8f-be2d-740481e73e34 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:49.257577 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-12e53ff1-0959-4d8f-be2d-740481e73e34 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:49.258110 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-12e53ff1-0959-4d8f-be2d-740481e73e34 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:49.641084 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ec6446c0-4c97-485a-95aa-2fdc04909832 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:58:49.642579 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ec6446c0-4c97-485a-95aa-2fdc04909832 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] [instance: ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:58:49.650896 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ec6446c0-4c97-485a-95aa-2fdc04909832 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:49.652310 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ec6446c0-4c97-485a-95aa-2fdc04909832 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:49.652903 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ec6446c0-4c97-485a-95aa-2fdc04909832 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:49.653783 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ec6446c0-4c97-485a-95aa-2fdc04909832 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:49.654628 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ec6446c0-4c97-485a-95aa-2fdc04909832 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:49.655356 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ec6446c0-4c97-485a-95aa-2fdc04909832 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:49.792904 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-12e53ff1-0959-4d8f-be2d-740481e73e34 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a845ca1e7747fba0a987235d980098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca57a0af591a43ee9cdef09134bc3fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:58:49.805059 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-12e53ff1-0959-4d8f-be2d-740481e73e34 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] 10.222.0.33 "GET /compute/v2.1/servers/13a0b913-5596-453f-a5fb-119e20b6b885" status: 200 len: 1505 microversion: 2.1 time: 0.577076 Sep 23 04:58:49.806216 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2754/5657] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:58:49 2022] GET /compute/v2.1/servers/13a0b913-5596-453f-a5fb-119e20b6b885 => generated 1505 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:58:50.116918 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ec6446c0-4c97-485a-95aa-2fdc04909832 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bde73a530f4666aebdd5f7d9fa1046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71874a329e54494bb1b84f31c3826205', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:58:50.137506 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ec6446c0-4c97-485a-95aa-2fdc04909832 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] 10.222.0.33 "GET /compute/v2.1/servers/ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7" status: 200 len: 1362 microversion: 2.1 time: 0.501248 Sep 23 04:58:50.145669 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2904/5658] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:58:49 2022] GET /compute/v2.1/servers/ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7 => generated 1362 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:58:50.838295 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-371c2a13-1043-4225-81c4-5e4db03382e3 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:58:50.838295 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-371c2a13-1043-4225-81c4-5e4db03382e3 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] [instance: 13a0b913-5596-453f-a5fb-119e20b6b885] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:58:50.853012 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-371c2a13-1043-4225-81c4-5e4db03382e3 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:50.856639 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-371c2a13-1043-4225-81c4-5e4db03382e3 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:50.857321 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-371c2a13-1043-4225-81c4-5e4db03382e3 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:50.860349 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-371c2a13-1043-4225-81c4-5e4db03382e3 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:50.861773 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-371c2a13-1043-4225-81c4-5e4db03382e3 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:50.862536 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-371c2a13-1043-4225-81c4-5e4db03382e3 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:51.165068 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-dab63a67-f820-47f1-905c-4d9f79ab9059 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:58:51.165690 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-dab63a67-f820-47f1-905c-4d9f79ab9059 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] [instance: ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:58:51.175843 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dab63a67-f820-47f1-905c-4d9f79ab9059 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:51.179698 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dab63a67-f820-47f1-905c-4d9f79ab9059 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:51.179698 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dab63a67-f820-47f1-905c-4d9f79ab9059 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:51.179698 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dab63a67-f820-47f1-905c-4d9f79ab9059 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:51.179698 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dab63a67-f820-47f1-905c-4d9f79ab9059 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:51.179698 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dab63a67-f820-47f1-905c-4d9f79ab9059 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:51.226419 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-371c2a13-1043-4225-81c4-5e4db03382e3 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a845ca1e7747fba0a987235d980098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca57a0af591a43ee9cdef09134bc3fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:58:51.242140 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-371c2a13-1043-4225-81c4-5e4db03382e3 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] 10.222.0.33 "GET /compute/v2.1/servers/13a0b913-5596-453f-a5fb-119e20b6b885" status: 200 len: 1505 microversion: 2.1 time: 0.412567 Sep 23 04:58:51.265203 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2755/5659] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:58:50 2022] GET /compute/v2.1/servers/13a0b913-5596-453f-a5fb-119e20b6b885 => generated 1505 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:58:51.550272 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-dab63a67-f820-47f1-905c-4d9f79ab9059 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bde73a530f4666aebdd5f7d9fa1046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71874a329e54494bb1b84f31c3826205', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:58:51.563549 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-dab63a67-f820-47f1-905c-4d9f79ab9059 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] 10.222.0.33 "GET /compute/v2.1/servers/ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7" status: 200 len: 1362 microversion: 2.1 time: 0.399163 Sep 23 04:58:51.569542 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2905/5660] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:58:51 2022] GET /compute/v2.1/servers/ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7 => generated 1362 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:58:52.281653 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-cd501b19-39ad-4d13-9107-c254d87c1d31 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:58:52.282876 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-cd501b19-39ad-4d13-9107-c254d87c1d31 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] [instance: 13a0b913-5596-453f-a5fb-119e20b6b885] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:58:52.310772 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cd501b19-39ad-4d13-9107-c254d87c1d31 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:52.316560 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cd501b19-39ad-4d13-9107-c254d87c1d31 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:52.336068 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cd501b19-39ad-4d13-9107-c254d87c1d31 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:52.347045 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cd501b19-39ad-4d13-9107-c254d87c1d31 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:52.353868 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cd501b19-39ad-4d13-9107-c254d87c1d31 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:52.354946 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cd501b19-39ad-4d13-9107-c254d87c1d31 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:52.592530 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d4846527-fca3-42fb-93b8-f250a15bf4af tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:58:52.593111 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d4846527-fca3-42fb-93b8-f250a15bf4af tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] [instance: ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:58:52.606368 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d4846527-fca3-42fb-93b8-f250a15bf4af tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:52.612199 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d4846527-fca3-42fb-93b8-f250a15bf4af tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:52.612914 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d4846527-fca3-42fb-93b8-f250a15bf4af tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:52.613842 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d4846527-fca3-42fb-93b8-f250a15bf4af tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:52.614523 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d4846527-fca3-42fb-93b8-f250a15bf4af tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:52.615143 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d4846527-fca3-42fb-93b8-f250a15bf4af tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:53.237705 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d4846527-fca3-42fb-93b8-f250a15bf4af tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bde73a530f4666aebdd5f7d9fa1046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71874a329e54494bb1b84f31c3826205', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:58:53.250338 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d4846527-fca3-42fb-93b8-f250a15bf4af tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] 10.222.0.33 "GET /compute/v2.1/servers/ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7" status: 200 len: 1362 microversion: 2.1 time: 0.662396 Sep 23 04:58:53.250955 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2906/5661] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:58:52 2022] GET /compute/v2.1/servers/ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7 => generated 1362 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:58:53.300678 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-cd501b19-39ad-4d13-9107-c254d87c1d31 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a845ca1e7747fba0a987235d980098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca57a0af591a43ee9cdef09134bc3fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:58:53.322594 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-cd501b19-39ad-4d13-9107-c254d87c1d31 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] 10.222.0.33 "GET /compute/v2.1/servers/13a0b913-5596-453f-a5fb-119e20b6b885" status: 200 len: 1505 microversion: 2.1 time: 1.050038 Sep 23 04:58:53.339179 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2756/5662] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:58:52 2022] GET /compute/v2.1/servers/13a0b913-5596-453f-a5fb-119e20b6b885 => generated 1505 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:58:54.273846 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-58664952-a6ab-499d-b004-e92df03d774f tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:58:54.275135 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-58664952-a6ab-499d-b004-e92df03d774f tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] [instance: ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:58:54.289476 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-58664952-a6ab-499d-b004-e92df03d774f tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:54.290323 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-58664952-a6ab-499d-b004-e92df03d774f tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:54.292448 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-58664952-a6ab-499d-b004-e92df03d774f tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:54.293463 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-58664952-a6ab-499d-b004-e92df03d774f tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:54.295653 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-58664952-a6ab-499d-b004-e92df03d774f tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:54.299266 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-58664952-a6ab-499d-b004-e92df03d774f tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:54.345242 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b236bf15-34a2-4556-a691-72e799570a7e tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:58:54.346518 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b236bf15-34a2-4556-a691-72e799570a7e tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] [instance: 13a0b913-5596-453f-a5fb-119e20b6b885] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:58:54.359025 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b236bf15-34a2-4556-a691-72e799570a7e tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:54.359833 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b236bf15-34a2-4556-a691-72e799570a7e tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:54.362417 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b236bf15-34a2-4556-a691-72e799570a7e tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:54.364018 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b236bf15-34a2-4556-a691-72e799570a7e tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:54.366301 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b236bf15-34a2-4556-a691-72e799570a7e tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:54.366301 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b236bf15-34a2-4556-a691-72e799570a7e tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:54.687045 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-58664952-a6ab-499d-b004-e92df03d774f tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bde73a530f4666aebdd5f7d9fa1046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71874a329e54494bb1b84f31c3826205', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:58:54.700478 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-58664952-a6ab-499d-b004-e92df03d774f tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] 10.222.0.33 "GET /compute/v2.1/servers/ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7" status: 200 len: 1362 microversion: 2.1 time: 0.430329 Sep 23 04:58:54.721937 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2907/5663] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:58:54 2022] GET /compute/v2.1/servers/ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7 => generated 1362 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:58:54.784254 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b236bf15-34a2-4556-a691-72e799570a7e tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a845ca1e7747fba0a987235d980098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca57a0af591a43ee9cdef09134bc3fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:58:54.796092 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b236bf15-34a2-4556-a691-72e799570a7e tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] 10.222.0.33 "GET /compute/v2.1/servers/13a0b913-5596-453f-a5fb-119e20b6b885" status: 200 len: 1505 microversion: 2.1 time: 0.453027 Sep 23 04:58:54.796729 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2757/5664] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:58:54 2022] GET /compute/v2.1/servers/13a0b913-5596-453f-a5fb-119e20b6b885 => generated 1505 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:58:55.728184 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c6204a20-97ba-4f78-8bc0-265534a030da tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:58:55.728965 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c6204a20-97ba-4f78-8bc0-265534a030da tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] [instance: ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:58:55.740245 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=6 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:58:55.743457 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c6204a20-97ba-4f78-8bc0-265534a030da tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:55.746702 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c6204a20-97ba-4f78-8bc0-265534a030da tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:55.747282 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c6204a20-97ba-4f78-8bc0-265534a030da tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:55.748094 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c6204a20-97ba-4f78-8bc0-265534a030da tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:55.748696 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c6204a20-97ba-4f78-8bc0-265534a030da tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:55.749197 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c6204a20-97ba-4f78-8bc0-265534a030da tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:55.821847 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-44de23ca-84b7-4502-b808-26053a86e31e tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:58:55.823134 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-44de23ca-84b7-4502-b808-26053a86e31e tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] [instance: 13a0b913-5596-453f-a5fb-119e20b6b885] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:58:55.845507 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-44de23ca-84b7-4502-b808-26053a86e31e tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:55.846454 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-44de23ca-84b7-4502-b808-26053a86e31e tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:55.847161 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-44de23ca-84b7-4502-b808-26053a86e31e tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:55.848095 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-44de23ca-84b7-4502-b808-26053a86e31e tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:55.848746 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-44de23ca-84b7-4502-b808-26053a86e31e tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:55.849392 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-44de23ca-84b7-4502-b808-26053a86e31e tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:56.511739 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-44de23ca-84b7-4502-b808-26053a86e31e tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a845ca1e7747fba0a987235d980098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca57a0af591a43ee9cdef09134bc3fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:58:56.523437 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-44de23ca-84b7-4502-b808-26053a86e31e tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] 10.222.0.33 "GET /compute/v2.1/servers/13a0b913-5596-453f-a5fb-119e20b6b885" status: 200 len: 1505 microversion: 2.1 time: 0.706795 Sep 23 04:58:56.537491 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2758/5665] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:58:55 2022] GET /compute/v2.1/servers/13a0b913-5596-453f-a5fb-119e20b6b885 => generated 1505 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:58:56.558830 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-33a8cc94-e42e-45b0-a759-2a1abe9f4c6f req-a486f318-c366-4f17-bbc5-bb6089a5e01e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7", "name": "network-vif-plugged", "status": "completed", "tag": "b1886339-f419-4169-8784-43f871380f08"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:58:56.573241 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-33a8cc94-e42e-45b0-a759-2a1abe9f4c6f req-a486f318-c366-4f17-bbc5-bb6089a5e01e service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:56.573961 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-33a8cc94-e42e-45b0-a759-2a1abe9f4c6f req-a486f318-c366-4f17-bbc5-bb6089a5e01e service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:56.574557 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-33a8cc94-e42e-45b0-a759-2a1abe9f4c6f req-a486f318-c366-4f17-bbc5-bb6089a5e01e service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:56.595542 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-33a8cc94-e42e-45b0-a759-2a1abe9f4c6f req-a486f318-c366-4f17-bbc5-bb6089a5e01e service nova] Creating event network-vif-plugged:b1886339-f419-4169-8784-43f871380f08 for instance ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7 on n-h2-846463-3 Sep 23 04:58:56.610366 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-33a8cc94-e42e-45b0-a759-2a1abe9f4c6f req-a486f318-c366-4f17-bbc5-bb6089a5e01e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070964 Sep 23 04:58:56.611235 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2759/5666] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:58:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:58:56.823783 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c6204a20-97ba-4f78-8bc0-265534a030da tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bde73a530f4666aebdd5f7d9fa1046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71874a329e54494bb1b84f31c3826205', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:58:56.834121 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c6204a20-97ba-4f78-8bc0-265534a030da tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] 10.222.0.33 "GET /compute/v2.1/servers/ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7" status: 200 len: 1362 microversion: 2.1 time: 1.109844 Sep 23 04:58:56.855015 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2908/5667] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:58:55 2022] GET /compute/v2.1/servers/ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7 => generated 1362 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:58:57.565481 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6aafffe1-fa78-42fc-9605-e93f9c3754e2 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:58:57.566785 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-6aafffe1-fa78-42fc-9605-e93f9c3754e2 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] [instance: 13a0b913-5596-453f-a5fb-119e20b6b885] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:58:57.576548 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6aafffe1-fa78-42fc-9605-e93f9c3754e2 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:57.582305 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6aafffe1-fa78-42fc-9605-e93f9c3754e2 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:57.582305 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6aafffe1-fa78-42fc-9605-e93f9c3754e2 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:57.582305 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6aafffe1-fa78-42fc-9605-e93f9c3754e2 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:57.582305 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6aafffe1-fa78-42fc-9605-e93f9c3754e2 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:57.582305 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6aafffe1-fa78-42fc-9605-e93f9c3754e2 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:57.895842 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d6258d2c-e64e-479e-8835-5232abe07b6a tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-161024138", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "46c40d38-a611-4058-a404-e185de25537f"}]}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:58:58.023094 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.neutron [None req-d6258d2c-e64e-479e-8835-5232abe07b6a tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] validate_networks() for [('46c40d38-a611-4058-a404-e185de25537f', None, None, None, None, None)] {{(pid=122699) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:58:58.336214 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6aafffe1-fa78-42fc-9605-e93f9c3754e2 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a845ca1e7747fba0a987235d980098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca57a0af591a43ee9cdef09134bc3fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:58:58.356733 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-6aafffe1-fa78-42fc-9605-e93f9c3754e2 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] 10.222.0.33 "GET /compute/v2.1/servers/13a0b913-5596-453f-a5fb-119e20b6b885" status: 200 len: 1505 microversion: 2.1 time: 0.795325 Sep 23 04:58:58.377743 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2760/5668] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:58:57 2022] GET /compute/v2.1/servers/13a0b913-5596-453f-a5fb-119e20b6b885 => generated 1505 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:58:58.399026 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-818cfacc-69e4-43c4-adb9-245ff96edd35 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:58:58.403199 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-818cfacc-69e4-43c4-adb9-245ff96edd35 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] [instance: ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:58:58.420916 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-818cfacc-69e4-43c4-adb9-245ff96edd35 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:58.423912 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-818cfacc-69e4-43c4-adb9-245ff96edd35 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:58.429401 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-818cfacc-69e4-43c4-adb9-245ff96edd35 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:58.431204 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-818cfacc-69e4-43c4-adb9-245ff96edd35 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:58.433587 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-818cfacc-69e4-43c4-adb9-245ff96edd35 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:58.440121 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-818cfacc-69e4-43c4-adb9-245ff96edd35 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:58.920808 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-818cfacc-69e4-43c4-adb9-245ff96edd35 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bde73a530f4666aebdd5f7d9fa1046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71874a329e54494bb1b84f31c3826205', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:58:58.931640 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-818cfacc-69e4-43c4-adb9-245ff96edd35 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] 10.222.0.33 "GET /compute/v2.1/servers/ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7" status: 200 len: 1362 microversion: 2.1 time: 0.552627 Sep 23 04:58:58.939486 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2761/5669] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:58:58 2022] GET /compute/v2.1/servers/ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7 => generated 1362 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:58:59.391139 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c514f273-6e5c-4f84-b014-e30b2773eb29 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:58:59.392210 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c514f273-6e5c-4f84-b014-e30b2773eb29 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] [instance: 13a0b913-5596-453f-a5fb-119e20b6b885] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:58:59.410559 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c514f273-6e5c-4f84-b014-e30b2773eb29 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:59.411093 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c514f273-6e5c-4f84-b014-e30b2773eb29 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:59.411540 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c514f273-6e5c-4f84-b014-e30b2773eb29 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:59.412257 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c514f273-6e5c-4f84-b014-e30b2773eb29 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:59.412714 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c514f273-6e5c-4f84-b014-e30b2773eb29 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:59.413304 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c514f273-6e5c-4f84-b014-e30b2773eb29 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:59.516191 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-d6258d2c-e64e-479e-8835-5232abe07b6a tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Flavor limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:58:59.517164 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-d6258d2c-e64e-479e-8835-5232abe07b6a tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Image limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:58:59.517799 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-d6258d2c-e64e-479e-8835-5232abe07b6a tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Flavor pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:58:59.518619 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-d6258d2c-e64e-479e-8835-5232abe07b6a tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Image pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:58:59.519182 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-d6258d2c-e64e-479e-8835-5232abe07b6a tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:58:59.547336 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d6258d2c-e64e-479e-8835-5232abe07b6a tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:59.551431 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d6258d2c-e64e-479e-8835-5232abe07b6a tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:59.552263 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d6258d2c-e64e-479e-8835-5232abe07b6a tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:59.553297 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d6258d2c-e64e-479e-8835-5232abe07b6a tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:58:59.554245 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d6258d2c-e64e-479e-8835-5232abe07b6a tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:58:59.565829 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d6258d2c-e64e-479e-8835-5232abe07b6a tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:58:59.612625 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-d6258d2c-e64e-479e-8835-5232abe07b6a tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Getting quotas for project fea15e730b4749698d44b143f4f3f934. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:58:59.619409 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-d6258d2c-e64e-479e-8835-5232abe07b6a tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Getting quotas for user a9b6d10d4aa54985a0bd2a74d7602356 and project fea15e730b4749698d44b143f4f3f934. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:58:59.635609 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d6258d2c-e64e-479e-8835-5232abe07b6a tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Going to run 3 instances... {{(pid=122699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:58:59.639262 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d6258d2c-e64e-479e-8835-5232abe07b6a tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] [instance: b66d0d2e-8333-4bee-a062-21f3ad2cbdb2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:58:59.834519 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d6258d2c-e64e-479e-8835-5232abe07b6a tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] [instance: 818fa1c2-6041-4fda-baad-85c648e340f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=b66d0d2e-8333-4bee-a062-21f3ad2cbdb2,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:58:59.986384 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c514f273-6e5c-4f84-b014-e30b2773eb29 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a845ca1e7747fba0a987235d980098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca57a0af591a43ee9cdef09134bc3fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:58:59.996661 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c514f273-6e5c-4f84-b014-e30b2773eb29 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] 10.222.0.33 "GET /compute/v2.1/servers/13a0b913-5596-453f-a5fb-119e20b6b885" status: 200 len: 1505 microversion: 2.1 time: 0.614341 Sep 23 04:58:59.999273 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2762/5670] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:58:59 2022] GET /compute/v2.1/servers/13a0b913-5596-453f-a5fb-119e20b6b885 => generated 1505 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:59:00.004493 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-18d3d901-272a-4c45-8864-a285dbd4d9d4 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:00.005291 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-18d3d901-272a-4c45-8864-a285dbd4d9d4 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] [instance: ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:00.013044 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-18d3d901-272a-4c45-8864-a285dbd4d9d4 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:00.013909 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-18d3d901-272a-4c45-8864-a285dbd4d9d4 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:00.014800 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-18d3d901-272a-4c45-8864-a285dbd4d9d4 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:00.015693 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-18d3d901-272a-4c45-8864-a285dbd4d9d4 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:00.016313 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-18d3d901-272a-4c45-8864-a285dbd4d9d4 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:00.016902 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-18d3d901-272a-4c45-8864-a285dbd4d9d4 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:00.023434 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d6258d2c-e64e-479e-8835-5232abe07b6a tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] [instance: 325789fb-b74f-4a9a-a273-575a7366659d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=818fa1c2-6041-4fda-baad-85c648e340f5,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:59:00.263639 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-18d3d901-272a-4c45-8864-a285dbd4d9d4 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bde73a530f4666aebdd5f7d9fa1046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71874a329e54494bb1b84f31c3826205', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:00.272103 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-18d3d901-272a-4c45-8864-a285dbd4d9d4 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] 10.222.0.33 "GET /compute/v2.1/servers/ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7" status: 200 len: 1548 microversion: 2.1 time: 0.271522 Sep 23 04:59:00.278313 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2763/5671] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:58:59 2022] GET /compute/v2.1/servers/ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7 => generated 1548 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:59:00.300083 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d6258d2c-e64e-479e-8835-5232abe07b6a tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.728034 Sep 23 04:59:00.301082 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2909/5672] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:58:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 2730 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:59:00.303953 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d2700a50-7d5f-4d68-8b91-2a9f617dae58 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:00.306477 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d2700a50-7d5f-4d68-8b91-2a9f617dae58 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] [instance: ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:00.313550 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-755fc97b-bfb8-462c-8315-f81bbc2f9c30 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:00.319384 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d2700a50-7d5f-4d68-8b91-2a9f617dae58 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:00.322086 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d2700a50-7d5f-4d68-8b91-2a9f617dae58 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:00.324490 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d2700a50-7d5f-4d68-8b91-2a9f617dae58 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:00.325436 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d2700a50-7d5f-4d68-8b91-2a9f617dae58 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:00.326272 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d2700a50-7d5f-4d68-8b91-2a9f617dae58 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:00.326414 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-755fc97b-bfb8-462c-8315-f81bbc2f9c30 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a9b6d10d4aa54985a0bd2a74d7602356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea15e730b4749698d44b143f4f3f934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:00.327395 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-755fc97b-bfb8-462c-8315-f81bbc2f9c30 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Searching by: {'deleted': False, 'project_id': 'fea15e730b4749698d44b143f4f3f934'} {{(pid=122699) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 04:59:00.328019 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d2700a50-7d5f-4d68-8b91-2a9f617dae58 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:00.407239 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-755fc97b-bfb8-462c-8315-f81bbc2f9c30 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:00.408001 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-755fc97b-bfb8-462c-8315-f81bbc2f9c30 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:00.414198 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-755fc97b-bfb8-462c-8315-f81bbc2f9c30 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:00.416217 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-755fc97b-bfb8-462c-8315-f81bbc2f9c30 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:00.416886 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-755fc97b-bfb8-462c-8315-f81bbc2f9c30 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:00.420468 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-755fc97b-bfb8-462c-8315-f81bbc2f9c30 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:00.479189 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-755fc97b-bfb8-462c-8315-f81bbc2f9c30 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 1015 microversion: 2.1 time: 0.170521 Sep 23 04:59:00.495649 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2910/5673] 10.222.0.33 () {58 vars in 1125 bytes} [Fri Sep 23 04:59:00 2022] GET /compute/v2.1/servers => generated 1015 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:59:00.499883 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b025ea5c-feb6-4c08-a59e-bdb9fbab2306 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:00.499883 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b025ea5c-feb6-4c08-a59e-bdb9fbab2306 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] [instance: 325789fb-b74f-4a9a-a273-575a7366659d] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:00.541745 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d2700a50-7d5f-4d68-8b91-2a9f617dae58 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] 10.222.0.33 "GET /compute/v2.1/servers/ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.242149 Sep 23 04:59:00.554140 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2764/5674] 10.222.0.33 () {58 vars in 1275 bytes} [Fri Sep 23 04:59:00 2022] GET /compute/v2.1/servers/ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7/os-interface => generated 285 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:59:00.713692 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b025ea5c-feb6-4c08-a59e-bdb9fbab2306 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b6d10d4aa54985a0bd2a74d7602356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea15e730b4749698d44b143f4f3f934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:00.723683 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b025ea5c-feb6-4c08-a59e-bdb9fbab2306 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] 10.222.0.33 "GET /compute/v2.1/servers/325789fb-b74f-4a9a-a273-575a7366659d" status: 200 len: 1222 microversion: 2.1 time: 0.234888 Sep 23 04:59:00.724304 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2911/5675] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:00 2022] GET /compute/v2.1/servers/325789fb-b74f-4a9a-a273-575a7366659d => generated 1222 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:59:01.026461 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c0674326-8bb0-488a-a539-2e307d7c19fb tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:01.027709 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c0674326-8bb0-488a-a539-2e307d7c19fb tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] [instance: 13a0b913-5596-453f-a5fb-119e20b6b885] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:01.043342 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c0674326-8bb0-488a-a539-2e307d7c19fb tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:01.046290 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c0674326-8bb0-488a-a539-2e307d7c19fb tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:01.057007 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c0674326-8bb0-488a-a539-2e307d7c19fb tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:01.057775 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c0674326-8bb0-488a-a539-2e307d7c19fb tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:01.058516 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c0674326-8bb0-488a-a539-2e307d7c19fb tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:01.058967 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c0674326-8bb0-488a-a539-2e307d7c19fb tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:01.754309 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-39d02c80-307b-4af3-b8b4-eb642ba82c2c tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:01.755059 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-39d02c80-307b-4af3-b8b4-eb642ba82c2c tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] [instance: 325789fb-b74f-4a9a-a273-575a7366659d] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:02.091184 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-39d02c80-307b-4af3-b8b4-eb642ba82c2c tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b6d10d4aa54985a0bd2a74d7602356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea15e730b4749698d44b143f4f3f934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:02.108395 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-39d02c80-307b-4af3-b8b4-eb642ba82c2c tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] 10.222.0.33 "GET /compute/v2.1/servers/325789fb-b74f-4a9a-a273-575a7366659d" status: 200 len: 1222 microversion: 2.1 time: 0.361979 Sep 23 04:59:02.110664 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2912/5676] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:01 2022] GET /compute/v2.1/servers/325789fb-b74f-4a9a-a273-575a7366659d => generated 1222 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:59:02.305668 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c0674326-8bb0-488a-a539-2e307d7c19fb tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a845ca1e7747fba0a987235d980098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca57a0af591a43ee9cdef09134bc3fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:02.315392 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c0674326-8bb0-488a-a539-2e307d7c19fb tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] 10.222.0.33 "GET /compute/v2.1/servers/13a0b913-5596-453f-a5fb-119e20b6b885" status: 200 len: 1505 microversion: 2.1 time: 1.295041 Sep 23 04:59:02.334688 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2765/5677] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:01 2022] GET /compute/v2.1/servers/13a0b913-5596-453f-a5fb-119e20b6b885 => generated 1505 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:59:03.143623 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b2083eeb-bd5a-46c9-8b97-2a072252da09 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:03.144265 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b2083eeb-bd5a-46c9-8b97-2a072252da09 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] [instance: 325789fb-b74f-4a9a-a273-575a7366659d] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:03.351682 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c52170cf-aeac-496f-8f2b-3ea38eb2ae1e tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:03.356289 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c52170cf-aeac-496f-8f2b-3ea38eb2ae1e tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] [instance: 13a0b913-5596-453f-a5fb-119e20b6b885] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:03.399653 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c52170cf-aeac-496f-8f2b-3ea38eb2ae1e tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:03.400773 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c52170cf-aeac-496f-8f2b-3ea38eb2ae1e tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:03.401485 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c52170cf-aeac-496f-8f2b-3ea38eb2ae1e tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:03.403212 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c52170cf-aeac-496f-8f2b-3ea38eb2ae1e tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:03.404981 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c52170cf-aeac-496f-8f2b-3ea38eb2ae1e tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:03.407309 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c52170cf-aeac-496f-8f2b-3ea38eb2ae1e tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:03.460842 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b2083eeb-bd5a-46c9-8b97-2a072252da09 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b6d10d4aa54985a0bd2a74d7602356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea15e730b4749698d44b143f4f3f934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:03.475719 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b2083eeb-bd5a-46c9-8b97-2a072252da09 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] 10.222.0.33 "GET /compute/v2.1/servers/325789fb-b74f-4a9a-a273-575a7366659d" status: 200 len: 1222 microversion: 2.1 time: 0.342419 Sep 23 04:59:03.481101 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2913/5678] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:03 2022] GET /compute/v2.1/servers/325789fb-b74f-4a9a-a273-575a7366659d => generated 1222 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:59:03.921760 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c52170cf-aeac-496f-8f2b-3ea38eb2ae1e tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a845ca1e7747fba0a987235d980098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca57a0af591a43ee9cdef09134bc3fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:03.949669 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c52170cf-aeac-496f-8f2b-3ea38eb2ae1e tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] 10.222.0.33 "GET /compute/v2.1/servers/13a0b913-5596-453f-a5fb-119e20b6b885" status: 200 len: 1505 microversion: 2.1 time: 0.606557 Sep 23 04:59:03.963437 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2766/5679] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:03 2022] GET /compute/v2.1/servers/13a0b913-5596-453f-a5fb-119e20b6b885 => generated 1505 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:59:04.505022 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-07fa3a99-05a0-4e09-8bdd-49c0785e8a27 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:04.505022 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-07fa3a99-05a0-4e09-8bdd-49c0785e8a27 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] [instance: 325789fb-b74f-4a9a-a273-575a7366659d] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:04.801856 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-07fa3a99-05a0-4e09-8bdd-49c0785e8a27 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b6d10d4aa54985a0bd2a74d7602356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea15e730b4749698d44b143f4f3f934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:04.827976 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-07fa3a99-05a0-4e09-8bdd-49c0785e8a27 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] 10.222.0.33 "GET /compute/v2.1/servers/325789fb-b74f-4a9a-a273-575a7366659d" status: 200 len: 1222 microversion: 2.1 time: 0.331020 Sep 23 04:59:04.860776 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2914/5680] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:04 2022] GET /compute/v2.1/servers/325789fb-b74f-4a9a-a273-575a7366659d => generated 1222 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:59:05.003209 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-be9fca89-fea6-437f-9f92-509d58520e5f tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:05.028169 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-be9fca89-fea6-437f-9f92-509d58520e5f tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] [instance: 13a0b913-5596-453f-a5fb-119e20b6b885] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:05.093573 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-be9fca89-fea6-437f-9f92-509d58520e5f tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:05.096489 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-be9fca89-fea6-437f-9f92-509d58520e5f tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:05.103530 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-be9fca89-fea6-437f-9f92-509d58520e5f tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:05.111025 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-be9fca89-fea6-437f-9f92-509d58520e5f tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:05.125741 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-be9fca89-fea6-437f-9f92-509d58520e5f tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:05.133610 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-5ba2be7f-25cb-43d1-ba95-cb794f805902 req-513fc37b-4a46-4070-8c12-814939b173f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7", "tag": "b1886339-f419-4169-8784-43f871380f08"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:59:05.141130 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-be9fca89-fea6-437f-9f92-509d58520e5f tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:05.164888 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-5ba2be7f-25cb-43d1-ba95-cb794f805902 req-513fc37b-4a46-4070-8c12-814939b173f8 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:05.164888 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-5ba2be7f-25cb-43d1-ba95-cb794f805902 req-513fc37b-4a46-4070-8c12-814939b173f8 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:05.164888 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-5ba2be7f-25cb-43d1-ba95-cb794f805902 req-513fc37b-4a46-4070-8c12-814939b173f8 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:05.183976 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-5ba2be7f-25cb-43d1-ba95-cb794f805902 req-513fc37b-4a46-4070-8c12-814939b173f8 service nova] Creating event network-changed:b1886339-f419-4169-8784-43f871380f08 for instance ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7 on n-h2-846463-3 Sep 23 04:59:05.202168 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-5ba2be7f-25cb-43d1-ba95-cb794f805902 req-513fc37b-4a46-4070-8c12-814939b173f8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072397 Sep 23 04:59:05.203314 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2915/5681] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:59:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:59:05.832642 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-be9fca89-fea6-437f-9f92-509d58520e5f tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a845ca1e7747fba0a987235d980098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca57a0af591a43ee9cdef09134bc3fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:05.846270 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-be9fca89-fea6-437f-9f92-509d58520e5f tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] 10.222.0.33 "GET /compute/v2.1/servers/13a0b913-5596-453f-a5fb-119e20b6b885" status: 200 len: 1505 microversion: 2.1 time: 0.865137 Sep 23 04:59:05.855809 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2767/5682] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:04 2022] GET /compute/v2.1/servers/13a0b913-5596-453f-a5fb-119e20b6b885 => generated 1505 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:59:05.887451 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-272e0480-27ad-41a9-9fbf-e9d65b0d24e2 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:05.888319 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-272e0480-27ad-41a9-9fbf-e9d65b0d24e2 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] [instance: 325789fb-b74f-4a9a-a273-575a7366659d] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:05.900490 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-272e0480-27ad-41a9-9fbf-e9d65b0d24e2 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:05.901181 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-272e0480-27ad-41a9-9fbf-e9d65b0d24e2 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:05.901815 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-272e0480-27ad-41a9-9fbf-e9d65b0d24e2 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:05.911764 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-272e0480-27ad-41a9-9fbf-e9d65b0d24e2 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:05.911764 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-272e0480-27ad-41a9-9fbf-e9d65b0d24e2 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:05.911764 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-272e0480-27ad-41a9-9fbf-e9d65b0d24e2 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:06.142299 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-272e0480-27ad-41a9-9fbf-e9d65b0d24e2 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b6d10d4aa54985a0bd2a74d7602356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea15e730b4749698d44b143f4f3f934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:06.156965 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-272e0480-27ad-41a9-9fbf-e9d65b0d24e2 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] 10.222.0.33 "GET /compute/v2.1/servers/325789fb-b74f-4a9a-a273-575a7366659d" status: 200 len: 1218 microversion: 2.1 time: 0.279686 Sep 23 04:59:06.160169 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2916/5683] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:05 2022] GET /compute/v2.1/servers/325789fb-b74f-4a9a-a273-575a7366659d => generated 1218 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:59:06.879894 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-162c11d3-fd70-4a21-951f-bb88ff387267 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:06.882309 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-162c11d3-fd70-4a21-951f-bb88ff387267 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] [instance: 13a0b913-5596-453f-a5fb-119e20b6b885] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:06.893342 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-162c11d3-fd70-4a21-951f-bb88ff387267 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:06.896253 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-162c11d3-fd70-4a21-951f-bb88ff387267 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:06.896897 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-162c11d3-fd70-4a21-951f-bb88ff387267 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:06.897786 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-162c11d3-fd70-4a21-951f-bb88ff387267 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:06.906055 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-162c11d3-fd70-4a21-951f-bb88ff387267 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:06.917068 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-162c11d3-fd70-4a21-951f-bb88ff387267 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:07.184585 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f5237d41-7f2f-46f6-a6dd-75fd6d7f7aa7 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:07.185623 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f5237d41-7f2f-46f6-a6dd-75fd6d7f7aa7 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] [instance: 325789fb-b74f-4a9a-a273-575a7366659d] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:07.203487 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f5237d41-7f2f-46f6-a6dd-75fd6d7f7aa7 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:07.223205 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f5237d41-7f2f-46f6-a6dd-75fd6d7f7aa7 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:07.223205 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f5237d41-7f2f-46f6-a6dd-75fd6d7f7aa7 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:07.223205 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f5237d41-7f2f-46f6-a6dd-75fd6d7f7aa7 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:07.223205 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f5237d41-7f2f-46f6-a6dd-75fd6d7f7aa7 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:07.223205 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f5237d41-7f2f-46f6-a6dd-75fd6d7f7aa7 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:07.431841 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f5237d41-7f2f-46f6-a6dd-75fd6d7f7aa7 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b6d10d4aa54985a0bd2a74d7602356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea15e730b4749698d44b143f4f3f934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:07.454160 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f5237d41-7f2f-46f6-a6dd-75fd6d7f7aa7 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] 10.222.0.33 "GET /compute/v2.1/servers/325789fb-b74f-4a9a-a273-575a7366659d" status: 200 len: 1274 microversion: 2.1 time: 0.267804 Sep 23 04:59:07.458726 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2917/5684] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:07 2022] GET /compute/v2.1/servers/325789fb-b74f-4a9a-a273-575a7366659d => generated 1274 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:59:07.530444 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-162c11d3-fd70-4a21-951f-bb88ff387267 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a845ca1e7747fba0a987235d980098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca57a0af591a43ee9cdef09134bc3fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:07.552428 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-162c11d3-fd70-4a21-951f-bb88ff387267 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] 10.222.0.33 "GET /compute/v2.1/servers/13a0b913-5596-453f-a5fb-119e20b6b885" status: 200 len: 1505 microversion: 2.1 time: 0.673993 Sep 23 04:59:07.559330 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2768/5685] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:06 2022] GET /compute/v2.1/servers/13a0b913-5596-453f-a5fb-119e20b6b885 => generated 1505 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:59:08.481439 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2e21dcf0-14c8-4122-93f0-959674542fae tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:08.482959 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-2e21dcf0-14c8-4122-93f0-959674542fae tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] [instance: 325789fb-b74f-4a9a-a273-575a7366659d] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:08.496411 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2e21dcf0-14c8-4122-93f0-959674542fae tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:08.497205 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2e21dcf0-14c8-4122-93f0-959674542fae tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:08.497820 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2e21dcf0-14c8-4122-93f0-959674542fae tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:08.500640 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2e21dcf0-14c8-4122-93f0-959674542fae tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:08.503446 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2e21dcf0-14c8-4122-93f0-959674542fae tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:08.504146 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2e21dcf0-14c8-4122-93f0-959674542fae tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:08.584939 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5954772b-0c76-4b71-8ecc-c16ca7a44679 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:08.586214 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5954772b-0c76-4b71-8ecc-c16ca7a44679 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] [instance: 13a0b913-5596-453f-a5fb-119e20b6b885] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:08.600220 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5954772b-0c76-4b71-8ecc-c16ca7a44679 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:08.608754 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5954772b-0c76-4b71-8ecc-c16ca7a44679 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:08.608754 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5954772b-0c76-4b71-8ecc-c16ca7a44679 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:08.608754 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5954772b-0c76-4b71-8ecc-c16ca7a44679 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:08.609393 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5954772b-0c76-4b71-8ecc-c16ca7a44679 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:08.612973 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5954772b-0c76-4b71-8ecc-c16ca7a44679 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:08.725552 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2e21dcf0-14c8-4122-93f0-959674542fae tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b6d10d4aa54985a0bd2a74d7602356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea15e730b4749698d44b143f4f3f934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:08.742087 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2e21dcf0-14c8-4122-93f0-959674542fae tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] 10.222.0.33 "GET /compute/v2.1/servers/325789fb-b74f-4a9a-a273-575a7366659d" status: 200 len: 1282 microversion: 2.1 time: 0.262337 Sep 23 04:59:08.752490 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2918/5686] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:08 2022] GET /compute/v2.1/servers/325789fb-b74f-4a9a-a273-575a7366659d => generated 1282 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:59:08.992345 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-5954772b-0c76-4b71-8ecc-c16ca7a44679 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a845ca1e7747fba0a987235d980098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca57a0af591a43ee9cdef09134bc3fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:08.992345 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=100 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:59:09.003554 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5954772b-0c76-4b71-8ecc-c16ca7a44679 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] 10.222.0.33 "GET /compute/v2.1/servers/13a0b913-5596-453f-a5fb-119e20b6b885" status: 200 len: 1505 microversion: 2.1 time: 0.422765 Sep 23 04:59:09.004153 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2769/5687] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:08 2022] GET /compute/v2.1/servers/13a0b913-5596-453f-a5fb-119e20b6b885 => generated 1505 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:59:09.768016 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-953af50d-976f-4619-a198-a0e1dff95d60 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:09.769283 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-953af50d-976f-4619-a198-a0e1dff95d60 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] [instance: 325789fb-b74f-4a9a-a273-575a7366659d] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:09.787538 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-953af50d-976f-4619-a198-a0e1dff95d60 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:09.788370 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-953af50d-976f-4619-a198-a0e1dff95d60 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:09.789063 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-953af50d-976f-4619-a198-a0e1dff95d60 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:09.790141 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-953af50d-976f-4619-a198-a0e1dff95d60 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:09.791214 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-953af50d-976f-4619-a198-a0e1dff95d60 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:09.791869 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-953af50d-976f-4619-a198-a0e1dff95d60 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:09.987707 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-953af50d-976f-4619-a198-a0e1dff95d60 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b6d10d4aa54985a0bd2a74d7602356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea15e730b4749698d44b143f4f3f934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:09.997870 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-953af50d-976f-4619-a198-a0e1dff95d60 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] 10.222.0.33 "GET /compute/v2.1/servers/325789fb-b74f-4a9a-a273-575a7366659d" status: 200 len: 1280 microversion: 2.1 time: 0.234730 Sep 23 04:59:10.001028 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2919/5688] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:09 2022] GET /compute/v2.1/servers/325789fb-b74f-4a9a-a273-575a7366659d => generated 1280 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:59:10.030803 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-20e8855f-02e4-46af-b1ef-898d838ac05c tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:10.031429 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-20e8855f-02e4-46af-b1ef-898d838ac05c tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] [instance: 13a0b913-5596-453f-a5fb-119e20b6b885] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:10.044086 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-20e8855f-02e4-46af-b1ef-898d838ac05c tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:10.046583 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-20e8855f-02e4-46af-b1ef-898d838ac05c tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:10.051915 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-20e8855f-02e4-46af-b1ef-898d838ac05c tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:10.053067 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-20e8855f-02e4-46af-b1ef-898d838ac05c tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:10.053711 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-20e8855f-02e4-46af-b1ef-898d838ac05c tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:10.054357 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-20e8855f-02e4-46af-b1ef-898d838ac05c tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:10.420477 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-20e8855f-02e4-46af-b1ef-898d838ac05c tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a845ca1e7747fba0a987235d980098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca57a0af591a43ee9cdef09134bc3fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:10.430068 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-20e8855f-02e4-46af-b1ef-898d838ac05c tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] 10.222.0.33 "GET /compute/v2.1/servers/13a0b913-5596-453f-a5fb-119e20b6b885" status: 200 len: 1505 microversion: 2.1 time: 0.405154 Sep 23 04:59:10.436005 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2770/5689] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:10 2022] GET /compute/v2.1/servers/13a0b913-5596-453f-a5fb-119e20b6b885 => generated 1505 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:59:11.028514 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-203ec0e3-c95f-49bf-9c13-e03f74542f8e tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:11.030087 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-203ec0e3-c95f-49bf-9c13-e03f74542f8e tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] [instance: 325789fb-b74f-4a9a-a273-575a7366659d] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:11.033561 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=4 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:59:11.047099 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-203ec0e3-c95f-49bf-9c13-e03f74542f8e tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:11.047962 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-203ec0e3-c95f-49bf-9c13-e03f74542f8e tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:11.048651 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-203ec0e3-c95f-49bf-9c13-e03f74542f8e tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:11.049677 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-203ec0e3-c95f-49bf-9c13-e03f74542f8e tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:11.050423 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-203ec0e3-c95f-49bf-9c13-e03f74542f8e tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:11.051144 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-203ec0e3-c95f-49bf-9c13-e03f74542f8e tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:11.097166 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:59:11.208329 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-203ec0e3-c95f-49bf-9c13-e03f74542f8e tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b6d10d4aa54985a0bd2a74d7602356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea15e730b4749698d44b143f4f3f934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:11.227098 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-203ec0e3-c95f-49bf-9c13-e03f74542f8e tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] 10.222.0.33 "GET /compute/v2.1/servers/325789fb-b74f-4a9a-a273-575a7366659d" status: 200 len: 1280 microversion: 2.1 time: 0.206120 Sep 23 04:59:11.228852 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2920/5690] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:11 2022] GET /compute/v2.1/servers/325789fb-b74f-4a9a-a273-575a7366659d => generated 1280 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:59:11.353644 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-cecf65a8-bf23-407c-9513-55b71b83d24c tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-391827728", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "networks": [{"uuid": "ee50f551-d42e-4316-bea8-79e1cbdf1837"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1395192842", "security_groups": [{"name": "tempest-secgroup-smoke-536375292"}]}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:59:11.467563 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-69961903-0c2e-4ab3-b308-13d07c0a558e tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:11.470006 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-69961903-0c2e-4ab3-b308-13d07c0a558e tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] [instance: 13a0b913-5596-453f-a5fb-119e20b6b885] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:11.479309 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-69961903-0c2e-4ab3-b308-13d07c0a558e tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:11.480118 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-69961903-0c2e-4ab3-b308-13d07c0a558e tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:11.480632 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-69961903-0c2e-4ab3-b308-13d07c0a558e tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:11.481822 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-69961903-0c2e-4ab3-b308-13d07c0a558e tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:11.482541 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-69961903-0c2e-4ab3-b308-13d07c0a558e tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:11.483049 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-69961903-0c2e-4ab3-b308-13d07c0a558e tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:11.612901 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.network.neutron [None req-cecf65a8-bf23-407c-9513-55b71b83d24c tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] validate_networks() for [('ee50f551-d42e-4316-bea8-79e1cbdf1837', None, None, None, None, None)] {{(pid=122698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:59:12.440927 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-69961903-0c2e-4ab3-b308-13d07c0a558e tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a845ca1e7747fba0a987235d980098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca57a0af591a43ee9cdef09134bc3fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:12.469401 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-69961903-0c2e-4ab3-b308-13d07c0a558e tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] 10.222.0.33 "GET /compute/v2.1/servers/13a0b913-5596-453f-a5fb-119e20b6b885" status: 200 len: 1505 microversion: 2.1 time: 1.001763 Sep 23 04:59:12.483348 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2921/5691] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:11 2022] GET /compute/v2.1/servers/13a0b913-5596-453f-a5fb-119e20b6b885 => generated 1505 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:59:12.496178 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f3538eae-0658-45c5-ba5d-7b5ddc6aabc7 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:12.497436 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f3538eae-0658-45c5-ba5d-7b5ddc6aabc7 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] [instance: 325789fb-b74f-4a9a-a273-575a7366659d] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:12.505089 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f3538eae-0658-45c5-ba5d-7b5ddc6aabc7 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:12.510651 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f3538eae-0658-45c5-ba5d-7b5ddc6aabc7 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:12.510651 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f3538eae-0658-45c5-ba5d-7b5ddc6aabc7 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:12.510651 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f3538eae-0658-45c5-ba5d-7b5ddc6aabc7 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:12.510651 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f3538eae-0658-45c5-ba5d-7b5ddc6aabc7 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:12.510651 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f3538eae-0658-45c5-ba5d-7b5ddc6aabc7 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:12.813533 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-cecf65a8-bf23-407c-9513-55b71b83d24c tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Flavor limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:59:12.814620 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-cecf65a8-bf23-407c-9513-55b71b83d24c tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Image limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:59:12.815120 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-cecf65a8-bf23-407c-9513-55b71b83d24c tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Flavor pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:59:12.815539 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-cecf65a8-bf23-407c-9513-55b71b83d24c tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Image pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:59:12.816332 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-cecf65a8-bf23-407c-9513-55b71b83d24c tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:59:12.836916 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cecf65a8-bf23-407c-9513-55b71b83d24c tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:12.841344 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f3538eae-0658-45c5-ba5d-7b5ddc6aabc7 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b6d10d4aa54985a0bd2a74d7602356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea15e730b4749698d44b143f4f3f934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:12.842618 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cecf65a8-bf23-407c-9513-55b71b83d24c tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:12.843167 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cecf65a8-bf23-407c-9513-55b71b83d24c tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:12.844302 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cecf65a8-bf23-407c-9513-55b71b83d24c tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:12.845073 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cecf65a8-bf23-407c-9513-55b71b83d24c tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:12.852682 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cecf65a8-bf23-407c-9513-55b71b83d24c tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:12.852976 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f3538eae-0658-45c5-ba5d-7b5ddc6aabc7 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] 10.222.0.33 "GET /compute/v2.1/servers/325789fb-b74f-4a9a-a273-575a7366659d" status: 200 len: 1322 microversion: 2.1 time: 0.361892 Sep 23 04:59:12.860914 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2922/5692] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:12 2022] GET /compute/v2.1/servers/325789fb-b74f-4a9a-a273-575a7366659d => generated 1322 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:59:12.890333 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-cecf65a8-bf23-407c-9513-55b71b83d24c tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Getting quotas for project 0edd6bd5b418494fbcb05c743967d36a. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:59:12.899381 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-cecf65a8-bf23-407c-9513-55b71b83d24c tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Getting quotas for user 8d3d0a162e7e4beb81a54120cab246ff and project 0edd6bd5b418494fbcb05c743967d36a. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:59:12.916938 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-cecf65a8-bf23-407c-9513-55b71b83d24c tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Going to run 1 instances... {{(pid=122698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:59:12.921452 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-cecf65a8-bf23-407c-9513-55b71b83d24c tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 7f05d753-e297-4330-ba02-dc0aac76de96] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:59:13.212278 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-cecf65a8-bf23-407c-9513-55b71b83d24c tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.863074 Sep 23 04:59:13.214411 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2771/5693] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:59:11 2022] POST /compute/v2.1/servers => generated 405 bytes in 1866 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:59:13.232919 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6d86a745-30d8-44ea-bcc7-069560ef77d9 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:13.236000 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-6d86a745-30d8-44ea-bcc7-069560ef77d9 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 7f05d753-e297-4330-ba02-dc0aac76de96] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:13.349539 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-6d86a745-30d8-44ea-bcc7-069560ef77d9 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:13.357824 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6d86a745-30d8-44ea-bcc7-069560ef77d9 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/7f05d753-e297-4330-ba02-dc0aac76de96" status: 200 len: 1266 microversion: 2.1 time: 0.135781 Sep 23 04:59:13.382487 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2923/5694] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:13 2022] GET /compute/v2.1/servers/7f05d753-e297-4330-ba02-dc0aac76de96 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:59:13.500338 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-eb7082c5-6e52-46d5-90ce-fbecbe358f22 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:13.500975 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-eb7082c5-6e52-46d5-90ce-fbecbe358f22 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] [instance: 13a0b913-5596-453f-a5fb-119e20b6b885] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:13.524618 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-eb7082c5-6e52-46d5-90ce-fbecbe358f22 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:13.543311 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-eb7082c5-6e52-46d5-90ce-fbecbe358f22 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:13.544168 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-eb7082c5-6e52-46d5-90ce-fbecbe358f22 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:13.544563 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-eb7082c5-6e52-46d5-90ce-fbecbe358f22 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:13.545072 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-eb7082c5-6e52-46d5-90ce-fbecbe358f22 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:13.545514 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-eb7082c5-6e52-46d5-90ce-fbecbe358f22 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:13.879766 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-eb7082c5-6e52-46d5-90ce-fbecbe358f22 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a845ca1e7747fba0a987235d980098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca57a0af591a43ee9cdef09134bc3fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:13.880366 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-11e0e861-0666-4065-be36-cfc91baa6a8e tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:13.880366 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-11e0e861-0666-4065-be36-cfc91baa6a8e tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] [instance: 325789fb-b74f-4a9a-a273-575a7366659d] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:13.890198 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-eb7082c5-6e52-46d5-90ce-fbecbe358f22 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] 10.222.0.33 "GET /compute/v2.1/servers/13a0b913-5596-453f-a5fb-119e20b6b885" status: 200 len: 1505 microversion: 2.1 time: 0.392334 Sep 23 04:59:13.891100 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2772/5695] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:13 2022] GET /compute/v2.1/servers/13a0b913-5596-453f-a5fb-119e20b6b885 => generated 1505 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:59:13.894624 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-11e0e861-0666-4065-be36-cfc91baa6a8e tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:13.896318 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-11e0e861-0666-4065-be36-cfc91baa6a8e tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:13.897061 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-11e0e861-0666-4065-be36-cfc91baa6a8e tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:13.897971 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-11e0e861-0666-4065-be36-cfc91baa6a8e tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:13.898585 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-11e0e861-0666-4065-be36-cfc91baa6a8e tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:13.899760 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-11e0e861-0666-4065-be36-cfc91baa6a8e tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:14.384344 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e669092e-78d9-4960-9f14-c915fa981da6 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:14.385223 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e669092e-78d9-4960-9f14-c915fa981da6 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 7f05d753-e297-4330-ba02-dc0aac76de96] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:14.590177 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e669092e-78d9-4960-9f14-c915fa981da6 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:14.608601 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e669092e-78d9-4960-9f14-c915fa981da6 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/7f05d753-e297-4330-ba02-dc0aac76de96" status: 200 len: 1266 microversion: 2.1 time: 0.228297 Sep 23 04:59:14.629413 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2773/5696] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:14 2022] GET /compute/v2.1/servers/7f05d753-e297-4330-ba02-dc0aac76de96 => generated 1266 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:59:14.634632 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-11e0e861-0666-4065-be36-cfc91baa6a8e tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b6d10d4aa54985a0bd2a74d7602356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea15e730b4749698d44b143f4f3f934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:14.655740 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-11e0e861-0666-4065-be36-cfc91baa6a8e tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] 10.222.0.33 "GET /compute/v2.1/servers/325789fb-b74f-4a9a-a273-575a7366659d" status: 200 len: 1322 microversion: 2.1 time: 0.785460 Sep 23 04:59:14.658115 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2924/5697] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:13 2022] GET /compute/v2.1/servers/325789fb-b74f-4a9a-a273-575a7366659d => generated 1322 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:59:14.916253 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0485bf99-dffa-4864-bd6c-afadf3a83777 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:14.917392 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-0485bf99-dffa-4864-bd6c-afadf3a83777 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] [instance: 13a0b913-5596-453f-a5fb-119e20b6b885] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:14.930611 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0485bf99-dffa-4864-bd6c-afadf3a83777 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:14.931124 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0485bf99-dffa-4864-bd6c-afadf3a83777 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:14.931575 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0485bf99-dffa-4864-bd6c-afadf3a83777 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:14.932302 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0485bf99-dffa-4864-bd6c-afadf3a83777 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:14.949488 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0485bf99-dffa-4864-bd6c-afadf3a83777 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:14.954754 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0485bf99-dffa-4864-bd6c-afadf3a83777 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:15.637657 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-31b1e608-721b-4731-9d4e-cf6dceb5cce7 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:15.638498 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-31b1e608-721b-4731-9d4e-cf6dceb5cce7 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 7f05d753-e297-4330-ba02-dc0aac76de96] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:15.651947 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-31b1e608-721b-4731-9d4e-cf6dceb5cce7 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:15.652910 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-31b1e608-721b-4731-9d4e-cf6dceb5cce7 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:15.661377 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-31b1e608-721b-4731-9d4e-cf6dceb5cce7 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:15.663355 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-31b1e608-721b-4731-9d4e-cf6dceb5cce7 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:15.664036 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-31b1e608-721b-4731-9d4e-cf6dceb5cce7 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:15.678449 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-31b1e608-721b-4731-9d4e-cf6dceb5cce7 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:15.835431 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-31b1e608-721b-4731-9d4e-cf6dceb5cce7 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:15.854744 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-31b1e608-721b-4731-9d4e-cf6dceb5cce7 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/7f05d753-e297-4330-ba02-dc0aac76de96" status: 200 len: 1262 microversion: 2.1 time: 0.220898 Sep 23 04:59:15.869953 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2925/5698] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:15 2022] GET /compute/v2.1/servers/7f05d753-e297-4330-ba02-dc0aac76de96 => generated 1262 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:59:15.869953 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e10ab0bd-c8d2-4af5-ba5d-abf44069be2d tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:15.869953 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e10ab0bd-c8d2-4af5-ba5d-abf44069be2d tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] [instance: 325789fb-b74f-4a9a-a273-575a7366659d] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:15.873505 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e10ab0bd-c8d2-4af5-ba5d-abf44069be2d tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:15.874127 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e10ab0bd-c8d2-4af5-ba5d-abf44069be2d tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:15.875258 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e10ab0bd-c8d2-4af5-ba5d-abf44069be2d tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:15.877331 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e10ab0bd-c8d2-4af5-ba5d-abf44069be2d tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:15.880158 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e10ab0bd-c8d2-4af5-ba5d-abf44069be2d tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:15.881132 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e10ab0bd-c8d2-4af5-ba5d-abf44069be2d tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:16.045690 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-0485bf99-dffa-4864-bd6c-afadf3a83777 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a845ca1e7747fba0a987235d980098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca57a0af591a43ee9cdef09134bc3fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:16.062111 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0485bf99-dffa-4864-bd6c-afadf3a83777 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] 10.222.0.33 "GET /compute/v2.1/servers/13a0b913-5596-453f-a5fb-119e20b6b885" status: 200 len: 1505 microversion: 2.1 time: 1.149700 Sep 23 04:59:16.074260 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2774/5699] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:14 2022] GET /compute/v2.1/servers/13a0b913-5596-453f-a5fb-119e20b6b885 => generated 1505 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:59:16.884939 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8656de54-16d0-4d96-b93d-af8f3d118666 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:16.886516 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8656de54-16d0-4d96-b93d-af8f3d118666 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 7f05d753-e297-4330-ba02-dc0aac76de96] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:16.892592 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e10ab0bd-c8d2-4af5-ba5d-abf44069be2d tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b6d10d4aa54985a0bd2a74d7602356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea15e730b4749698d44b143f4f3f934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:16.908624 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e10ab0bd-c8d2-4af5-ba5d-abf44069be2d tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] 10.222.0.33 "GET /compute/v2.1/servers/325789fb-b74f-4a9a-a273-575a7366659d" status: 200 len: 1322 microversion: 2.1 time: 1.046957 Sep 23 04:59:16.909258 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2926/5700] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:15 2022] GET /compute/v2.1/servers/325789fb-b74f-4a9a-a273-575a7366659d => generated 1322 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:59:16.911604 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8656de54-16d0-4d96-b93d-af8f3d118666 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:16.916464 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8656de54-16d0-4d96-b93d-af8f3d118666 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:16.920924 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8656de54-16d0-4d96-b93d-af8f3d118666 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:16.921846 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8656de54-16d0-4d96-b93d-af8f3d118666 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:16.922781 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8656de54-16d0-4d96-b93d-af8f3d118666 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:16.923396 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8656de54-16d0-4d96-b93d-af8f3d118666 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:17.054357 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8656de54-16d0-4d96-b93d-af8f3d118666 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:17.063990 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8656de54-16d0-4d96-b93d-af8f3d118666 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/7f05d753-e297-4330-ba02-dc0aac76de96" status: 200 len: 1326 microversion: 2.1 time: 0.184595 Sep 23 04:59:17.083351 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2775/5701] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:16 2022] GET /compute/v2.1/servers/7f05d753-e297-4330-ba02-dc0aac76de96 => generated 1326 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:59:17.089156 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1e345724-a81f-4a3a-ab6e-65f8dbc7b2b4 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:17.090193 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1e345724-a81f-4a3a-ab6e-65f8dbc7b2b4 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] [instance: 13a0b913-5596-453f-a5fb-119e20b6b885] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:17.103602 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e345724-a81f-4a3a-ab6e-65f8dbc7b2b4 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:17.104401 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e345724-a81f-4a3a-ab6e-65f8dbc7b2b4 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:17.106424 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e345724-a81f-4a3a-ab6e-65f8dbc7b2b4 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:17.110528 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e345724-a81f-4a3a-ab6e-65f8dbc7b2b4 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:17.111114 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e345724-a81f-4a3a-ab6e-65f8dbc7b2b4 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:17.111641 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e345724-a81f-4a3a-ab6e-65f8dbc7b2b4 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:17.647855 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1e345724-a81f-4a3a-ab6e-65f8dbc7b2b4 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a845ca1e7747fba0a987235d980098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca57a0af591a43ee9cdef09134bc3fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:17.669293 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1e345724-a81f-4a3a-ab6e-65f8dbc7b2b4 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] 10.222.0.33 "GET /compute/v2.1/servers/13a0b913-5596-453f-a5fb-119e20b6b885" status: 200 len: 1505 microversion: 2.1 time: 0.585497 Sep 23 04:59:17.673034 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2927/5702] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:17 2022] GET /compute/v2.1/servers/13a0b913-5596-453f-a5fb-119e20b6b885 => generated 1505 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:59:17.931627 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e8cacbcb-dc99-4625-b061-3331be56a3ea tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:17.932743 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e8cacbcb-dc99-4625-b061-3331be56a3ea tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] [instance: 325789fb-b74f-4a9a-a273-575a7366659d] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:17.945525 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e8cacbcb-dc99-4625-b061-3331be56a3ea tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:17.945525 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e8cacbcb-dc99-4625-b061-3331be56a3ea tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:17.945525 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e8cacbcb-dc99-4625-b061-3331be56a3ea tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:17.945821 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e8cacbcb-dc99-4625-b061-3331be56a3ea tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:17.958659 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e8cacbcb-dc99-4625-b061-3331be56a3ea tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:17.959205 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e8cacbcb-dc99-4625-b061-3331be56a3ea tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:18.088604 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-561b93ca-148f-4106-85cd-f8e13efb45eb tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:18.094532 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-561b93ca-148f-4106-85cd-f8e13efb45eb tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 7f05d753-e297-4330-ba02-dc0aac76de96] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:18.101300 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-561b93ca-148f-4106-85cd-f8e13efb45eb tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:18.109940 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-561b93ca-148f-4106-85cd-f8e13efb45eb tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:18.111422 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-561b93ca-148f-4106-85cd-f8e13efb45eb tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:18.112548 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-561b93ca-148f-4106-85cd-f8e13efb45eb tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:18.117630 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-561b93ca-148f-4106-85cd-f8e13efb45eb tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:18.126391 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-561b93ca-148f-4106-85cd-f8e13efb45eb tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:18.405342 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-561b93ca-148f-4106-85cd-f8e13efb45eb tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:18.418528 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-561b93ca-148f-4106-85cd-f8e13efb45eb tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/7f05d753-e297-4330-ba02-dc0aac76de96" status: 200 len: 1324 microversion: 2.1 time: 0.333600 Sep 23 04:59:18.419311 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2928/5703] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:18 2022] GET /compute/v2.1/servers/7f05d753-e297-4330-ba02-dc0aac76de96 => generated 1324 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:59:18.459950 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e8cacbcb-dc99-4625-b061-3331be56a3ea tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b6d10d4aa54985a0bd2a74d7602356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea15e730b4749698d44b143f4f3f934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:18.478707 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e8cacbcb-dc99-4625-b061-3331be56a3ea tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] 10.222.0.33 "GET /compute/v2.1/servers/325789fb-b74f-4a9a-a273-575a7366659d" status: 200 len: 1322 microversion: 2.1 time: 0.551455 Sep 23 04:59:18.481669 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2776/5704] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:17 2022] GET /compute/v2.1/servers/325789fb-b74f-4a9a-a273-575a7366659d => generated 1322 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:59:18.685423 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-c153580c-1277-4a21-80d4-2dcc235d6574 req-e2d4bfde-98fe-4b7f-88b2-a33005557e8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "325789fb-b74f-4a9a-a273-575a7366659d", "tag": "7fd03a86-c81a-40da-a096-c9a56d2ed1a6"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:59:18.705664 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-774b6600-555d-49ef-a1ea-f47df225f5f9 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:18.706654 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-774b6600-555d-49ef-a1ea-f47df225f5f9 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] [instance: 13a0b913-5596-453f-a5fb-119e20b6b885] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:18.714166 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-c153580c-1277-4a21-80d4-2dcc235d6574 req-e2d4bfde-98fe-4b7f-88b2-a33005557e8b service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:18.726627 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-774b6600-555d-49ef-a1ea-f47df225f5f9 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:18.730441 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-774b6600-555d-49ef-a1ea-f47df225f5f9 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:18.730883 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-774b6600-555d-49ef-a1ea-f47df225f5f9 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:18.731636 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-774b6600-555d-49ef-a1ea-f47df225f5f9 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:18.732108 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-774b6600-555d-49ef-a1ea-f47df225f5f9 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:18.734507 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-774b6600-555d-49ef-a1ea-f47df225f5f9 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:18.736598 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-c153580c-1277-4a21-80d4-2dcc235d6574 req-e2d4bfde-98fe-4b7f-88b2-a33005557e8b service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:18.737526 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-c153580c-1277-4a21-80d4-2dcc235d6574 req-e2d4bfde-98fe-4b7f-88b2-a33005557e8b service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:18.772858 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-c153580c-1277-4a21-80d4-2dcc235d6574 req-e2d4bfde-98fe-4b7f-88b2-a33005557e8b service nova] Creating event network-changed:7fd03a86-c81a-40da-a096-c9a56d2ed1a6 for instance 325789fb-b74f-4a9a-a273-575a7366659d on n-h1-846463-3 Sep 23 04:59:18.785151 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-c153580c-1277-4a21-80d4-2dcc235d6574 req-e2d4bfde-98fe-4b7f-88b2-a33005557e8b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105968 Sep 23 04:59:18.796080 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2929/5705] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:59:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:59:19.444938 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-606235bd-2331-4ad2-b5de-777ffdc41482 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:19.445576 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-606235bd-2331-4ad2-b5de-777ffdc41482 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 7f05d753-e297-4330-ba02-dc0aac76de96] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:19.460440 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-606235bd-2331-4ad2-b5de-777ffdc41482 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:19.461292 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-606235bd-2331-4ad2-b5de-777ffdc41482 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:19.461942 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-606235bd-2331-4ad2-b5de-777ffdc41482 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:19.467475 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-606235bd-2331-4ad2-b5de-777ffdc41482 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:19.467475 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-606235bd-2331-4ad2-b5de-777ffdc41482 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:19.467475 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-606235bd-2331-4ad2-b5de-777ffdc41482 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:19.569815 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-606235bd-2331-4ad2-b5de-777ffdc41482 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:19.592614 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-606235bd-2331-4ad2-b5de-777ffdc41482 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/7f05d753-e297-4330-ba02-dc0aac76de96" status: 200 len: 1324 microversion: 2.1 time: 0.151844 Sep 23 04:59:19.599481 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2930/5706] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:19 2022] GET /compute/v2.1/servers/7f05d753-e297-4330-ba02-dc0aac76de96 => generated 1324 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:59:19.607739 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1d0e1a47-a1b0-4565-bd0f-95baceb6de02 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:19.608977 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1d0e1a47-a1b0-4565-bd0f-95baceb6de02 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] [instance: 325789fb-b74f-4a9a-a273-575a7366659d] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:19.619481 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1d0e1a47-a1b0-4565-bd0f-95baceb6de02 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:19.626130 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1d0e1a47-a1b0-4565-bd0f-95baceb6de02 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:19.626130 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1d0e1a47-a1b0-4565-bd0f-95baceb6de02 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:19.626130 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1d0e1a47-a1b0-4565-bd0f-95baceb6de02 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:19.626130 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1d0e1a47-a1b0-4565-bd0f-95baceb6de02 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:19.626130 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1d0e1a47-a1b0-4565-bd0f-95baceb6de02 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:19.626690 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-774b6600-555d-49ef-a1ea-f47df225f5f9 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a845ca1e7747fba0a987235d980098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca57a0af591a43ee9cdef09134bc3fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:19.638171 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-774b6600-555d-49ef-a1ea-f47df225f5f9 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] 10.222.0.33 "GET /compute/v2.1/servers/13a0b913-5596-453f-a5fb-119e20b6b885" status: 200 len: 1485 microversion: 2.1 time: 0.934580 Sep 23 04:59:19.654088 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2777/5707] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:18 2022] GET /compute/v2.1/servers/13a0b913-5596-453f-a5fb-119e20b6b885 => generated 1485 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:59:19.914183 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1ce8a238-d3a9-4617-8b53-843e918cc8cb tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1736543164", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:59:20.050647 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.network.neutron [None req-1ce8a238-d3a9-4617-8b53-843e918cc8cb tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] validate_networks() for [('0a90c0c3-89ec-488a-886e-b81891d0bcfa', None, None, None, None, None)] {{(pid=122698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:59:20.816230 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1d0e1a47-a1b0-4565-bd0f-95baceb6de02 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b6d10d4aa54985a0bd2a74d7602356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea15e730b4749698d44b143f4f3f934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:20.831315 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1d0e1a47-a1b0-4565-bd0f-95baceb6de02 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] 10.222.0.33 "GET /compute/v2.1/servers/325789fb-b74f-4a9a-a273-575a7366659d" status: 200 len: 1322 microversion: 2.1 time: 1.230234 Sep 23 04:59:20.831924 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2931/5708] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:19 2022] GET /compute/v2.1/servers/325789fb-b74f-4a9a-a273-575a7366659d => generated 1322 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:59:20.860090 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9b696395-45a7-4d50-9276-ef8be9491014 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:20.863124 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-9b696395-45a7-4d50-9276-ef8be9491014 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 7f05d753-e297-4330-ba02-dc0aac76de96] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:20.882662 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9b696395-45a7-4d50-9276-ef8be9491014 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:20.883403 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9b696395-45a7-4d50-9276-ef8be9491014 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:20.884012 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9b696395-45a7-4d50-9276-ef8be9491014 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:20.884906 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9b696395-45a7-4d50-9276-ef8be9491014 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:20.887546 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9b696395-45a7-4d50-9276-ef8be9491014 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:20.894220 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9b696395-45a7-4d50-9276-ef8be9491014 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:21.370251 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-9b696395-45a7-4d50-9276-ef8be9491014 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:21.382645 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-9b696395-45a7-4d50-9276-ef8be9491014 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/7f05d753-e297-4330-ba02-dc0aac76de96" status: 200 len: 1324 microversion: 2.1 time: 0.535153 Sep 23 04:59:21.385882 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2932/5709] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:20 2022] GET /compute/v2.1/servers/7f05d753-e297-4330-ba02-dc0aac76de96 => generated 1324 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:59:21.399511 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-09d9af5f-ab2a-4b12-90bc-1e3f654ccc7e req-7d8c38b0-824c-4413-9139-26a25f20c07f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "818fa1c2-6041-4fda-baad-85c648e340f5", "tag": "21b46ece-5736-4fe1-9c42-eff5474fadb4"}, {"name": "network-changed", "server_uuid": "b66d0d2e-8333-4bee-a062-21f3ad2cbdb2", "tag": "4f687495-3d9e-4251-a3ba-f7e37903c2e2"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:59:21.426577 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-09d9af5f-ab2a-4b12-90bc-1e3f654ccc7e req-7d8c38b0-824c-4413-9139-26a25f20c07f service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:21.432867 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-09d9af5f-ab2a-4b12-90bc-1e3f654ccc7e req-7d8c38b0-824c-4413-9139-26a25f20c07f service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:21.433625 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-09d9af5f-ab2a-4b12-90bc-1e3f654ccc7e req-7d8c38b0-824c-4413-9139-26a25f20c07f service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:21.490531 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-09d9af5f-ab2a-4b12-90bc-1e3f654ccc7e req-7d8c38b0-824c-4413-9139-26a25f20c07f service nova] Creating event network-changed:21b46ece-5736-4fe1-9c42-eff5474fadb4 for instance 818fa1c2-6041-4fda-baad-85c648e340f5 on n-h1-846463-3 Sep 23 04:59:21.491699 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-09d9af5f-ab2a-4b12-90bc-1e3f654ccc7e req-7d8c38b0-824c-4413-9139-26a25f20c07f service nova] Creating event network-changed:4f687495-3d9e-4251-a3ba-f7e37903c2e2 for instance b66d0d2e-8333-4bee-a062-21f3ad2cbdb2 on n-h2-846463-3 Sep 23 04:59:21.513180 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-09d9af5f-ab2a-4b12-90bc-1e3f654ccc7e req-7d8c38b0-824c-4413-9139-26a25f20c07f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.121746 Sep 23 04:59:21.513849 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2933/5710] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:59:21 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:59:21.862596 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-787f881d-40b9-483c-a86f-ae83310c0808 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:21.863306 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-787f881d-40b9-483c-a86f-ae83310c0808 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] [instance: 325789fb-b74f-4a9a-a273-575a7366659d] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:21.881277 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-787f881d-40b9-483c-a86f-ae83310c0808 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:21.882086 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-787f881d-40b9-483c-a86f-ae83310c0808 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:21.882554 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-787f881d-40b9-483c-a86f-ae83310c0808 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:21.883263 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-787f881d-40b9-483c-a86f-ae83310c0808 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:21.883720 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-787f881d-40b9-483c-a86f-ae83310c0808 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:21.884147 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-787f881d-40b9-483c-a86f-ae83310c0808 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:22.410972 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-787f881d-40b9-483c-a86f-ae83310c0808 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b6d10d4aa54985a0bd2a74d7602356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea15e730b4749698d44b143f4f3f934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:22.419280 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-787f881d-40b9-483c-a86f-ae83310c0808 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] 10.222.0.33 "GET /compute/v2.1/servers/325789fb-b74f-4a9a-a273-575a7366659d" status: 200 len: 1322 microversion: 2.1 time: 0.562279 Sep 23 04:59:22.419866 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2934/5711] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:21 2022] GET /compute/v2.1/servers/325789fb-b74f-4a9a-a273-575a7366659d => generated 1322 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:59:22.442026 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9071ea1f-ae9a-4095-a31c-be46a27aa3b0 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:22.442026 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-9071ea1f-ae9a-4095-a31c-be46a27aa3b0 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 7f05d753-e297-4330-ba02-dc0aac76de96] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:22.447333 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9071ea1f-ae9a-4095-a31c-be46a27aa3b0 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:22.448665 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9071ea1f-ae9a-4095-a31c-be46a27aa3b0 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:22.449271 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9071ea1f-ae9a-4095-a31c-be46a27aa3b0 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:22.453494 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9071ea1f-ae9a-4095-a31c-be46a27aa3b0 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:22.454025 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9071ea1f-ae9a-4095-a31c-be46a27aa3b0 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:22.454465 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9071ea1f-ae9a-4095-a31c-be46a27aa3b0 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:22.480366 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-1ce8a238-d3a9-4617-8b53-843e918cc8cb tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Flavor limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:59:22.480904 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-1ce8a238-d3a9-4617-8b53-843e918cc8cb tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Image limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:59:22.481869 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-1ce8a238-d3a9-4617-8b53-843e918cc8cb tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Flavor pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:59:22.481869 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-1ce8a238-d3a9-4617-8b53-843e918cc8cb tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Image pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:59:22.481869 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-1ce8a238-d3a9-4617-8b53-843e918cc8cb tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:59:22.484096 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:59:22.498337 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1ce8a238-d3a9-4617-8b53-843e918cc8cb tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:22.502679 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1ce8a238-d3a9-4617-8b53-843e918cc8cb tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:22.502679 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1ce8a238-d3a9-4617-8b53-843e918cc8cb tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:22.502679 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1ce8a238-d3a9-4617-8b53-843e918cc8cb tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:22.521257 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1ce8a238-d3a9-4617-8b53-843e918cc8cb tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:22.522001 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1ce8a238-d3a9-4617-8b53-843e918cc8cb tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:22.590248 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-1ce8a238-d3a9-4617-8b53-843e918cc8cb tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Getting quotas for project ca57a0af591a43ee9cdef09134bc3fd8. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:59:22.607025 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-1ce8a238-d3a9-4617-8b53-843e918cc8cb tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Getting quotas for user 70a845ca1e7747fba0a987235d980098 and project ca57a0af591a43ee9cdef09134bc3fd8. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:59:22.637869 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-1ce8a238-d3a9-4617-8b53-843e918cc8cb tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Going to run 1 instances... {{(pid=122698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:59:22.640285 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-1ce8a238-d3a9-4617-8b53-843e918cc8cb tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] [instance: 1d4b42f4-3285-41c7-8264-e596b9d8ac02] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:59:22.888765 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-1ce8a238-d3a9-4617-8b53-843e918cc8cb tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.983193 Sep 23 04:59:22.889423 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2778/5712] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:59:19 2022] POST /compute/v2.1/servers => generated 383 bytes in 2985 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:59:22.902618 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-69d9897e-ae6b-4bea-89f1-1d7d3a6d8264 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:22.903236 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-69d9897e-ae6b-4bea-89f1-1d7d3a6d8264 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] [instance: 1d4b42f4-3285-41c7-8264-e596b9d8ac02] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:23.082358 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-69d9897e-ae6b-4bea-89f1-1d7d3a6d8264 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a845ca1e7747fba0a987235d980098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca57a0af591a43ee9cdef09134bc3fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:23.094328 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-69d9897e-ae6b-4bea-89f1-1d7d3a6d8264 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] 10.222.0.33 "GET /compute/v2.1/servers/1d4b42f4-3285-41c7-8264-e596b9d8ac02" status: 200 len: 1214 microversion: 2.1 time: 0.196320 Sep 23 04:59:23.106678 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2779/5713] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:22 2022] GET /compute/v2.1/servers/1d4b42f4-3285-41c7-8264-e596b9d8ac02 => generated 1214 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:59:23.178859 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-9071ea1f-ae9a-4095-a31c-be46a27aa3b0 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:23.191924 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-9071ea1f-ae9a-4095-a31c-be46a27aa3b0 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/7f05d753-e297-4330-ba02-dc0aac76de96" status: 200 len: 1391 microversion: 2.1 time: 0.756616 Sep 23 04:59:23.196176 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2935/5714] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:22 2022] GET /compute/v2.1/servers/7f05d753-e297-4330-ba02-dc0aac76de96 => generated 1391 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:59:23.443297 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-28fbc5b9-bfe4-4e9a-83d7-8733357374e8 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:23.444273 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-28fbc5b9-bfe4-4e9a-83d7-8733357374e8 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] [instance: 325789fb-b74f-4a9a-a273-575a7366659d] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:23.454415 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-28fbc5b9-bfe4-4e9a-83d7-8733357374e8 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:23.456377 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-28fbc5b9-bfe4-4e9a-83d7-8733357374e8 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:23.457636 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-28fbc5b9-bfe4-4e9a-83d7-8733357374e8 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:23.458857 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-28fbc5b9-bfe4-4e9a-83d7-8733357374e8 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:23.459549 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-28fbc5b9-bfe4-4e9a-83d7-8733357374e8 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:23.460211 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-28fbc5b9-bfe4-4e9a-83d7-8733357374e8 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:23.794330 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-28fbc5b9-bfe4-4e9a-83d7-8733357374e8 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b6d10d4aa54985a0bd2a74d7602356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea15e730b4749698d44b143f4f3f934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:23.808005 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-28fbc5b9-bfe4-4e9a-83d7-8733357374e8 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] 10.222.0.33 "GET /compute/v2.1/servers/325789fb-b74f-4a9a-a273-575a7366659d" status: 200 len: 1322 microversion: 2.1 time: 0.369384 Sep 23 04:59:23.809484 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2780/5715] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:23 2022] GET /compute/v2.1/servers/325789fb-b74f-4a9a-a273-575a7366659d => generated 1322 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:59:24.124872 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-28c21b2b-ae70-4921-8c10-55b8e2a05e0b tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:24.125514 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-28c21b2b-ae70-4921-8c10-55b8e2a05e0b tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] [instance: 1d4b42f4-3285-41c7-8264-e596b9d8ac02] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:24.144419 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=16 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:59:24.150536 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:59:24.220868 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-316d3ab3-8580-4108-a231-b6f5ad1e4af8 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:24.221499 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-316d3ab3-8580-4108-a231-b6f5ad1e4af8 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 7f05d753-e297-4330-ba02-dc0aac76de96] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:24.233585 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-28c21b2b-ae70-4921-8c10-55b8e2a05e0b tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a845ca1e7747fba0a987235d980098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca57a0af591a43ee9cdef09134bc3fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:24.237511 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-28c21b2b-ae70-4921-8c10-55b8e2a05e0b tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] 10.222.0.33 "GET /compute/v2.1/servers/1d4b42f4-3285-41c7-8264-e596b9d8ac02" status: 200 len: 1214 microversion: 2.1 time: 0.118844 Sep 23 04:59:24.238146 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2936/5716] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:24 2022] GET /compute/v2.1/servers/1d4b42f4-3285-41c7-8264-e596b9d8ac02 => generated 1214 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:59:24.245171 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-316d3ab3-8580-4108-a231-b6f5ad1e4af8 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:24.245688 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-316d3ab3-8580-4108-a231-b6f5ad1e4af8 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:24.246170 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-316d3ab3-8580-4108-a231-b6f5ad1e4af8 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:24.246902 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-316d3ab3-8580-4108-a231-b6f5ad1e4af8 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:24.247387 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-316d3ab3-8580-4108-a231-b6f5ad1e4af8 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:24.247794 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-316d3ab3-8580-4108-a231-b6f5ad1e4af8 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:24.815755 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-316d3ab3-8580-4108-a231-b6f5ad1e4af8 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:24.830200 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-316d3ab3-8580-4108-a231-b6f5ad1e4af8 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/7f05d753-e297-4330-ba02-dc0aac76de96" status: 200 len: 1391 microversion: 2.1 time: 0.611569 Sep 23 04:59:24.837704 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e124cd5e-7215-4e4c-bcdf-494d42f9254d tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:24.838541 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e124cd5e-7215-4e4c-bcdf-494d42f9254d tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] [instance: 325789fb-b74f-4a9a-a273-575a7366659d] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:24.846564 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2781/5717] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:24 2022] GET /compute/v2.1/servers/7f05d753-e297-4330-ba02-dc0aac76de96 => generated 1391 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:59:24.855025 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e124cd5e-7215-4e4c-bcdf-494d42f9254d tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:24.856069 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e124cd5e-7215-4e4c-bcdf-494d42f9254d tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:24.856975 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e124cd5e-7215-4e4c-bcdf-494d42f9254d tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:24.858192 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e124cd5e-7215-4e4c-bcdf-494d42f9254d tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:24.859342 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e124cd5e-7215-4e4c-bcdf-494d42f9254d tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:24.860086 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e124cd5e-7215-4e4c-bcdf-494d42f9254d tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:25.268578 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d1163f8b-082c-419e-9e80-a893d82d9c31 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:25.268578 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d1163f8b-082c-419e-9e80-a893d82d9c31 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] [instance: 1d4b42f4-3285-41c7-8264-e596b9d8ac02] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:25.278561 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d1163f8b-082c-419e-9e80-a893d82d9c31 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:25.280750 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d1163f8b-082c-419e-9e80-a893d82d9c31 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:25.281269 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d1163f8b-082c-419e-9e80-a893d82d9c31 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:25.282084 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d1163f8b-082c-419e-9e80-a893d82d9c31 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:25.282570 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d1163f8b-082c-419e-9e80-a893d82d9c31 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:25.283008 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d1163f8b-082c-419e-9e80-a893d82d9c31 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:25.794187 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d1163f8b-082c-419e-9e80-a893d82d9c31 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a845ca1e7747fba0a987235d980098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca57a0af591a43ee9cdef09134bc3fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:25.806812 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d1163f8b-082c-419e-9e80-a893d82d9c31 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] 10.222.0.33 "GET /compute/v2.1/servers/1d4b42f4-3285-41c7-8264-e596b9d8ac02" status: 200 len: 1266 microversion: 2.1 time: 0.545004 Sep 23 04:59:25.809974 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2782/5718] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:25 2022] GET /compute/v2.1/servers/1d4b42f4-3285-41c7-8264-e596b9d8ac02 => generated 1266 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:59:25.870976 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-86ba1363-1ceb-4912-bfe7-d2a0f490e6df tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:25.876771 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-86ba1363-1ceb-4912-bfe7-d2a0f490e6df tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 7f05d753-e297-4330-ba02-dc0aac76de96] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:25.886371 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-86ba1363-1ceb-4912-bfe7-d2a0f490e6df tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:25.888033 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-86ba1363-1ceb-4912-bfe7-d2a0f490e6df tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:25.888706 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-86ba1363-1ceb-4912-bfe7-d2a0f490e6df tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:25.890582 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-86ba1363-1ceb-4912-bfe7-d2a0f490e6df tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:25.891059 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-86ba1363-1ceb-4912-bfe7-d2a0f490e6df tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:25.891495 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-86ba1363-1ceb-4912-bfe7-d2a0f490e6df tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:26.210063 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e124cd5e-7215-4e4c-bcdf-494d42f9254d tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b6d10d4aa54985a0bd2a74d7602356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea15e730b4749698d44b143f4f3f934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:26.229956 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e124cd5e-7215-4e4c-bcdf-494d42f9254d tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] 10.222.0.33 "GET /compute/v2.1/servers/325789fb-b74f-4a9a-a273-575a7366659d" status: 200 len: 1322 microversion: 2.1 time: 1.397448 Sep 23 04:59:26.231146 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2937/5719] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:24 2022] GET /compute/v2.1/servers/325789fb-b74f-4a9a-a273-575a7366659d => generated 1322 bytes in 1400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:59:26.469794 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-86ba1363-1ceb-4912-bfe7-d2a0f490e6df tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:26.482476 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-86ba1363-1ceb-4912-bfe7-d2a0f490e6df tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/7f05d753-e297-4330-ba02-dc0aac76de96" status: 200 len: 1391 microversion: 2.1 time: 0.615962 Sep 23 04:59:26.499800 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2783/5720] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:25 2022] GET /compute/v2.1/servers/7f05d753-e297-4330-ba02-dc0aac76de96 => generated 1391 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:59:26.565548 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-ac3f3dc0-6454-4713-a2e0-6632073557ee req-be566cd4-0b61-4198-aeb8-9415f564cd4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b66d0d2e-8333-4bee-a062-21f3ad2cbdb2", "name": "network-vif-plugged", "status": "completed", "tag": "4f687495-3d9e-4251-a3ba-f7e37903c2e2"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:59:26.585167 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-ac3f3dc0-6454-4713-a2e0-6632073557ee req-be566cd4-0b61-4198-aeb8-9415f564cd4e service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:26.585671 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-ac3f3dc0-6454-4713-a2e0-6632073557ee req-be566cd4-0b61-4198-aeb8-9415f564cd4e service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:26.586151 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-ac3f3dc0-6454-4713-a2e0-6632073557ee req-be566cd4-0b61-4198-aeb8-9415f564cd4e service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:26.619822 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-ac3f3dc0-6454-4713-a2e0-6632073557ee req-be566cd4-0b61-4198-aeb8-9415f564cd4e service nova] Creating event network-vif-plugged:4f687495-3d9e-4251-a3ba-f7e37903c2e2 for instance b66d0d2e-8333-4bee-a062-21f3ad2cbdb2 on n-h2-846463-3 Sep 23 04:59:26.632178 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-ac3f3dc0-6454-4713-a2e0-6632073557ee req-be566cd4-0b61-4198-aeb8-9415f564cd4e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065816 Sep 23 04:59:26.632178 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2938/5721] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:59:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:59:26.830766 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ae61d874-c05c-4c60-aad7-e11b7dbe6fc4 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:26.831824 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-ae61d874-c05c-4c60-aad7-e11b7dbe6fc4 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] [instance: 1d4b42f4-3285-41c7-8264-e596b9d8ac02] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:26.839260 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ae61d874-c05c-4c60-aad7-e11b7dbe6fc4 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:26.840098 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ae61d874-c05c-4c60-aad7-e11b7dbe6fc4 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:26.840770 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ae61d874-c05c-4c60-aad7-e11b7dbe6fc4 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:26.842015 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ae61d874-c05c-4c60-aad7-e11b7dbe6fc4 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:26.842862 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ae61d874-c05c-4c60-aad7-e11b7dbe6fc4 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:26.843605 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ae61d874-c05c-4c60-aad7-e11b7dbe6fc4 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:26.872994 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-158afdcc-4e90-43a8-8b4d-5aa379152c3c req-83cab122-d2fd-47cb-b65a-3d8477b284ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f05d753-e297-4330-ba02-dc0aac76de96", "tag": "9e975956-70a6-4752-9499-532298e87730"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:59:26.899487 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-158afdcc-4e90-43a8-8b4d-5aa379152c3c req-83cab122-d2fd-47cb-b65a-3d8477b284ae service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:26.899985 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-158afdcc-4e90-43a8-8b4d-5aa379152c3c req-83cab122-d2fd-47cb-b65a-3d8477b284ae service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:26.900435 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-158afdcc-4e90-43a8-8b4d-5aa379152c3c req-83cab122-d2fd-47cb-b65a-3d8477b284ae service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:26.914634 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-158afdcc-4e90-43a8-8b4d-5aa379152c3c req-83cab122-d2fd-47cb-b65a-3d8477b284ae service nova] Creating event network-changed:9e975956-70a6-4752-9499-532298e87730 for instance 7f05d753-e297-4330-ba02-dc0aac76de96 on n-h2-846463-3 Sep 23 04:59:26.920593 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-158afdcc-4e90-43a8-8b4d-5aa379152c3c req-83cab122-d2fd-47cb-b65a-3d8477b284ae service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052044 Sep 23 04:59:26.921630 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2939/5722] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:59:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:59:26.974350 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ae61d874-c05c-4c60-aad7-e11b7dbe6fc4 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a845ca1e7747fba0a987235d980098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca57a0af591a43ee9cdef09134bc3fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:26.984434 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ae61d874-c05c-4c60-aad7-e11b7dbe6fc4 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] 10.222.0.33 "GET /compute/v2.1/servers/1d4b42f4-3285-41c7-8264-e596b9d8ac02" status: 200 len: 1272 microversion: 2.1 time: 0.157442 Sep 23 04:59:26.986299 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2784/5723] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:26 2022] GET /compute/v2.1/servers/1d4b42f4-3285-41c7-8264-e596b9d8ac02 => generated 1272 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:59:27.257804 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-40f2c40c-2bb4-4d21-a182-bac91319f7f8 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:27.258652 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-40f2c40c-2bb4-4d21-a182-bac91319f7f8 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] [instance: 325789fb-b74f-4a9a-a273-575a7366659d] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:27.265699 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-40f2c40c-2bb4-4d21-a182-bac91319f7f8 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:27.266934 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-40f2c40c-2bb4-4d21-a182-bac91319f7f8 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:27.267496 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-40f2c40c-2bb4-4d21-a182-bac91319f7f8 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:27.268322 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-40f2c40c-2bb4-4d21-a182-bac91319f7f8 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:27.268930 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-40f2c40c-2bb4-4d21-a182-bac91319f7f8 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:27.269462 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-40f2c40c-2bb4-4d21-a182-bac91319f7f8 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:27.443530 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-40f2c40c-2bb4-4d21-a182-bac91319f7f8 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b6d10d4aa54985a0bd2a74d7602356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea15e730b4749698d44b143f4f3f934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:27.453282 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-40f2c40c-2bb4-4d21-a182-bac91319f7f8 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] 10.222.0.33 "GET /compute/v2.1/servers/325789fb-b74f-4a9a-a273-575a7366659d" status: 200 len: 1322 microversion: 2.1 time: 0.200722 Sep 23 04:59:27.458918 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2940/5724] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:27 2022] GET /compute/v2.1/servers/325789fb-b74f-4a9a-a273-575a7366659d => generated 1322 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:59:27.512789 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e84fe5fa-1ada-4df6-8e08-9dcb1f7cbadd tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:27.513452 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e84fe5fa-1ada-4df6-8e08-9dcb1f7cbadd tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 7f05d753-e297-4330-ba02-dc0aac76de96] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:27.531275 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e84fe5fa-1ada-4df6-8e08-9dcb1f7cbadd tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:27.534026 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e84fe5fa-1ada-4df6-8e08-9dcb1f7cbadd tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:27.534482 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e84fe5fa-1ada-4df6-8e08-9dcb1f7cbadd tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:27.541161 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e84fe5fa-1ada-4df6-8e08-9dcb1f7cbadd tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:27.541693 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e84fe5fa-1ada-4df6-8e08-9dcb1f7cbadd tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:27.544792 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e84fe5fa-1ada-4df6-8e08-9dcb1f7cbadd tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:27.797266 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e84fe5fa-1ada-4df6-8e08-9dcb1f7cbadd tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:27.811339 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e84fe5fa-1ada-4df6-8e08-9dcb1f7cbadd tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/7f05d753-e297-4330-ba02-dc0aac76de96" status: 200 len: 1391 microversion: 2.1 time: 0.302846 Sep 23 04:59:27.813418 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2785/5725] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:27 2022] GET /compute/v2.1/servers/7f05d753-e297-4330-ba02-dc0aac76de96 => generated 1391 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:59:28.016838 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c18cc4f4-6405-4de2-b779-f32a2d38389e tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:28.017753 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c18cc4f4-6405-4de2-b779-f32a2d38389e tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] [instance: 1d4b42f4-3285-41c7-8264-e596b9d8ac02] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:28.024032 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c18cc4f4-6405-4de2-b779-f32a2d38389e tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:28.024585 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c18cc4f4-6405-4de2-b779-f32a2d38389e tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:28.025038 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c18cc4f4-6405-4de2-b779-f32a2d38389e tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:28.026418 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c18cc4f4-6405-4de2-b779-f32a2d38389e tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:28.027064 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c18cc4f4-6405-4de2-b779-f32a2d38389e tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:28.027501 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c18cc4f4-6405-4de2-b779-f32a2d38389e tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:28.115302 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c18cc4f4-6405-4de2-b779-f32a2d38389e tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a845ca1e7747fba0a987235d980098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca57a0af591a43ee9cdef09134bc3fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:28.142792 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=100 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:59:28.154592 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c18cc4f4-6405-4de2-b779-f32a2d38389e tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] 10.222.0.33 "GET /compute/v2.1/servers/1d4b42f4-3285-41c7-8264-e596b9d8ac02" status: 200 len: 1272 microversion: 2.1 time: 0.136305 Sep 23 04:59:28.157609 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2941/5726] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:28 2022] GET /compute/v2.1/servers/1d4b42f4-3285-41c7-8264-e596b9d8ac02 => generated 1272 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:59:28.481343 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b0a7f9a5-c252-4003-8d1e-d145952ea126 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:28.482608 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b0a7f9a5-c252-4003-8d1e-d145952ea126 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] [instance: 325789fb-b74f-4a9a-a273-575a7366659d] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:28.489031 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b0a7f9a5-c252-4003-8d1e-d145952ea126 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:28.489742 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b0a7f9a5-c252-4003-8d1e-d145952ea126 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:28.490346 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b0a7f9a5-c252-4003-8d1e-d145952ea126 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:28.491210 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b0a7f9a5-c252-4003-8d1e-d145952ea126 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:28.491845 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b0a7f9a5-c252-4003-8d1e-d145952ea126 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:28.492627 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b0a7f9a5-c252-4003-8d1e-d145952ea126 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:28.664947 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-75072069-10fc-441f-a66e-d1ece0831dea req-5fd1fe2a-d0d3-496f-8dc4-bd6eae28b7ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "325789fb-b74f-4a9a-a273-575a7366659d", "name": "network-vif-plugged", "status": "completed", "tag": "7fd03a86-c81a-40da-a096-c9a56d2ed1a6"}, {"server_uuid": "818fa1c2-6041-4fda-baad-85c648e340f5", "name": "network-vif-plugged", "status": "completed", "tag": "21b46ece-5736-4fe1-9c42-eff5474fadb4"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:59:28.691241 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-75072069-10fc-441f-a66e-d1ece0831dea req-5fd1fe2a-d0d3-496f-8dc4-bd6eae28b7ec service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:28.691729 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-75072069-10fc-441f-a66e-d1ece0831dea req-5fd1fe2a-d0d3-496f-8dc4-bd6eae28b7ec service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:28.692616 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-75072069-10fc-441f-a66e-d1ece0831dea req-5fd1fe2a-d0d3-496f-8dc4-bd6eae28b7ec service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:28.715285 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-75072069-10fc-441f-a66e-d1ece0831dea req-5fd1fe2a-d0d3-496f-8dc4-bd6eae28b7ec service nova] Creating event network-vif-plugged:7fd03a86-c81a-40da-a096-c9a56d2ed1a6 for instance 325789fb-b74f-4a9a-a273-575a7366659d on n-h1-846463-3 Sep 23 04:59:28.716112 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-75072069-10fc-441f-a66e-d1ece0831dea req-5fd1fe2a-d0d3-496f-8dc4-bd6eae28b7ec service nova] Creating event network-vif-plugged:21b46ece-5736-4fe1-9c42-eff5474fadb4 for instance 818fa1c2-6041-4fda-baad-85c648e340f5 on n-h1-846463-3 Sep 23 04:59:28.732681 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-75072069-10fc-441f-a66e-d1ece0831dea req-5fd1fe2a-d0d3-496f-8dc4-bd6eae28b7ec service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.071373 Sep 23 04:59:28.733511 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2942/5727] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:59:28 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:59:28.837219 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-087b4cbc-7a76-4ad1-af46-c0167a134958 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:28.839077 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-087b4cbc-7a76-4ad1-af46-c0167a134958 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 7f05d753-e297-4330-ba02-dc0aac76de96] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:28.859083 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-087b4cbc-7a76-4ad1-af46-c0167a134958 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:28.859607 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-087b4cbc-7a76-4ad1-af46-c0167a134958 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:28.860455 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-087b4cbc-7a76-4ad1-af46-c0167a134958 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:28.861193 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-087b4cbc-7a76-4ad1-af46-c0167a134958 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:28.861656 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-087b4cbc-7a76-4ad1-af46-c0167a134958 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:28.862108 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-087b4cbc-7a76-4ad1-af46-c0167a134958 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:29.077354 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b0a7f9a5-c252-4003-8d1e-d145952ea126 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b6d10d4aa54985a0bd2a74d7602356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea15e730b4749698d44b143f4f3f934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:29.090758 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b0a7f9a5-c252-4003-8d1e-d145952ea126 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] 10.222.0.33 "GET /compute/v2.1/servers/325789fb-b74f-4a9a-a273-575a7366659d" status: 200 len: 1322 microversion: 2.1 time: 0.613588 Sep 23 04:59:29.093297 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2786/5728] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:28 2022] GET /compute/v2.1/servers/325789fb-b74f-4a9a-a273-575a7366659d => generated 1322 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:59:29.178770 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-da9f794b-3803-424a-a893-13f4126ce219 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:29.179395 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-da9f794b-3803-424a-a893-13f4126ce219 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] [instance: 1d4b42f4-3285-41c7-8264-e596b9d8ac02] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:29.186578 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-da9f794b-3803-424a-a893-13f4126ce219 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:29.187081 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-da9f794b-3803-424a-a893-13f4126ce219 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:29.187699 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-da9f794b-3803-424a-a893-13f4126ce219 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:29.190674 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-da9f794b-3803-424a-a893-13f4126ce219 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:29.196422 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-da9f794b-3803-424a-a893-13f4126ce219 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:29.197292 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-da9f794b-3803-424a-a893-13f4126ce219 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:29.248358 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-087b4cbc-7a76-4ad1-af46-c0167a134958 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:29.262398 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-087b4cbc-7a76-4ad1-af46-c0167a134958 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/7f05d753-e297-4330-ba02-dc0aac76de96" status: 200 len: 1391 microversion: 2.1 time: 0.429172 Sep 23 04:59:29.278601 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2943/5729] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:28 2022] GET /compute/v2.1/servers/7f05d753-e297-4330-ba02-dc0aac76de96 => generated 1391 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:59:29.570869 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-da9f794b-3803-424a-a893-13f4126ce219 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a845ca1e7747fba0a987235d980098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca57a0af591a43ee9cdef09134bc3fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:29.582046 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-da9f794b-3803-424a-a893-13f4126ce219 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] 10.222.0.33 "GET /compute/v2.1/servers/1d4b42f4-3285-41c7-8264-e596b9d8ac02" status: 200 len: 1314 microversion: 2.1 time: 0.406644 Sep 23 04:59:29.584256 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2787/5730] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:29 2022] GET /compute/v2.1/servers/1d4b42f4-3285-41c7-8264-e596b9d8ac02 => generated 1314 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:59:30.116655 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c6e23633-bc2c-41ab-99d3-32bf4b5551e0 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:30.121647 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c6e23633-bc2c-41ab-99d3-32bf4b5551e0 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] [instance: 325789fb-b74f-4a9a-a273-575a7366659d] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:30.146747 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c6e23633-bc2c-41ab-99d3-32bf4b5551e0 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:30.149104 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c6e23633-bc2c-41ab-99d3-32bf4b5551e0 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:30.150330 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c6e23633-bc2c-41ab-99d3-32bf4b5551e0 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:30.153228 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c6e23633-bc2c-41ab-99d3-32bf4b5551e0 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:30.154434 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c6e23633-bc2c-41ab-99d3-32bf4b5551e0 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:30.155142 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c6e23633-bc2c-41ab-99d3-32bf4b5551e0 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:30.288464 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-30c90c37-b5a1-47c5-915f-3eb2b26d3106 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:30.289460 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-30c90c37-b5a1-47c5-915f-3eb2b26d3106 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 7f05d753-e297-4330-ba02-dc0aac76de96] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:30.304557 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-30c90c37-b5a1-47c5-915f-3eb2b26d3106 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:30.306275 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-30c90c37-b5a1-47c5-915f-3eb2b26d3106 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:30.308103 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-30c90c37-b5a1-47c5-915f-3eb2b26d3106 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:30.308957 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-30c90c37-b5a1-47c5-915f-3eb2b26d3106 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:30.309737 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-30c90c37-b5a1-47c5-915f-3eb2b26d3106 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:30.313211 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-30c90c37-b5a1-47c5-915f-3eb2b26d3106 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:30.792687 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c6e23633-bc2c-41ab-99d3-32bf4b5551e0 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b6d10d4aa54985a0bd2a74d7602356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea15e730b4749698d44b143f4f3f934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:30.811434 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c6e23633-bc2c-41ab-99d3-32bf4b5551e0 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] 10.222.0.33 "GET /compute/v2.1/servers/325789fb-b74f-4a9a-a273-575a7366659d" status: 200 len: 1322 microversion: 2.1 time: 0.697959 Sep 23 04:59:30.829322 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2944/5731] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:30 2022] GET /compute/v2.1/servers/325789fb-b74f-4a9a-a273-575a7366659d => generated 1322 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:59:30.872095 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-bfa89932-f967-41a0-8318-95cc072254f8 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:30.872095 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-bfa89932-f967-41a0-8318-95cc072254f8 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] [instance: 1d4b42f4-3285-41c7-8264-e596b9d8ac02] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:30.881076 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bfa89932-f967-41a0-8318-95cc072254f8 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:30.881945 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bfa89932-f967-41a0-8318-95cc072254f8 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:30.882332 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bfa89932-f967-41a0-8318-95cc072254f8 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:30.883086 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bfa89932-f967-41a0-8318-95cc072254f8 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:30.883608 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bfa89932-f967-41a0-8318-95cc072254f8 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:30.883959 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bfa89932-f967-41a0-8318-95cc072254f8 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:30.944137 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-30c90c37-b5a1-47c5-915f-3eb2b26d3106 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:30.956687 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-30c90c37-b5a1-47c5-915f-3eb2b26d3106 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/7f05d753-e297-4330-ba02-dc0aac76de96" status: 200 len: 1391 microversion: 2.1 time: 0.672035 Sep 23 04:59:30.957294 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2788/5732] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:30 2022] GET /compute/v2.1/servers/7f05d753-e297-4330-ba02-dc0aac76de96 => generated 1391 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:59:31.008155 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-47abb331-e999-4a5d-8942-ca7c2daee8c7 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:31.008571 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-47abb331-e999-4a5d-8942-ca7c2daee8c7 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] [instance: ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:31.022785 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-47abb331-e999-4a5d-8942-ca7c2daee8c7 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:31.023288 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-47abb331-e999-4a5d-8942-ca7c2daee8c7 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:31.023920 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-47abb331-e999-4a5d-8942-ca7c2daee8c7 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:31.030147 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-47abb331-e999-4a5d-8942-ca7c2daee8c7 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:31.030956 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-47abb331-e999-4a5d-8942-ca7c2daee8c7 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:31.031656 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-47abb331-e999-4a5d-8942-ca7c2daee8c7 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:31.078782 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-47abb331-e999-4a5d-8942-ca7c2daee8c7 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] 10.222.0.33 "GET /compute/v2.1/servers/ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7/ips" status: 200 len: 146 microversion: 2.1 time: 0.074699 Sep 23 04:59:31.086341 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2789/5733] 10.222.0.33 () {58 vars in 1248 bytes} [Fri Sep 23 04:59:31 2022] GET /compute/v2.1/servers/ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7/ips => generated 146 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:59:31.325580 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-bfa89932-f967-41a0-8318-95cc072254f8 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a845ca1e7747fba0a987235d980098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca57a0af591a43ee9cdef09134bc3fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:31.344478 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-bfa89932-f967-41a0-8318-95cc072254f8 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] 10.222.0.33 "GET /compute/v2.1/servers/1d4b42f4-3285-41c7-8264-e596b9d8ac02" status: 200 len: 1314 microversion: 2.1 time: 0.510415 Sep 23 04:59:31.362661 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2945/5734] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:30 2022] GET /compute/v2.1/servers/1d4b42f4-3285-41c7-8264-e596b9d8ac02 => generated 1314 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:59:31.611046 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-dbe7c033-f205-4259-b3f3-1c46fc3343f7 req-dcdcd2a9-f1e3-486f-866f-269207710dd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d4b42f4-3285-41c7-8264-e596b9d8ac02", "tag": "13485893-9e3f-4bb0-b531-8796b4cebfd1"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:59:31.629299 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-dbe7c033-f205-4259-b3f3-1c46fc3343f7 req-dcdcd2a9-f1e3-486f-866f-269207710dd2 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:31.629788 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-dbe7c033-f205-4259-b3f3-1c46fc3343f7 req-dcdcd2a9-f1e3-486f-866f-269207710dd2 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:31.635714 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-dbe7c033-f205-4259-b3f3-1c46fc3343f7 req-dcdcd2a9-f1e3-486f-866f-269207710dd2 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:31.640588 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=100 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:59:31.687816 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-dbe7c033-f205-4259-b3f3-1c46fc3343f7 req-dcdcd2a9-f1e3-486f-866f-269207710dd2 service nova] Creating event network-changed:13485893-9e3f-4bb0-b531-8796b4cebfd1 for instance 1d4b42f4-3285-41c7-8264-e596b9d8ac02 on n-h2-846463-3 Sep 23 04:59:31.707744 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-dbe7c033-f205-4259-b3f3-1c46fc3343f7 req-dcdcd2a9-f1e3-486f-866f-269207710dd2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100445 Sep 23 04:59:31.708531 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2790/5735] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:59:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:59:31.834897 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-27e9dcc3-e051-4596-a968-a1fc4e14a0fa tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:31.835595 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-27e9dcc3-e051-4596-a968-a1fc4e14a0fa tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] [instance: 325789fb-b74f-4a9a-a273-575a7366659d] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:31.847985 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-27e9dcc3-e051-4596-a968-a1fc4e14a0fa tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:31.848798 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-27e9dcc3-e051-4596-a968-a1fc4e14a0fa tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:31.849466 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-27e9dcc3-e051-4596-a968-a1fc4e14a0fa tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:31.850492 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-27e9dcc3-e051-4596-a968-a1fc4e14a0fa tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:31.851280 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-27e9dcc3-e051-4596-a968-a1fc4e14a0fa tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:31.852198 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-27e9dcc3-e051-4596-a968-a1fc4e14a0fa tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:31.988155 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-bf2ccbf2-9f2e-4eaa-9a44-bcdcf491945d tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:31.988881 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-bf2ccbf2-9f2e-4eaa-9a44-bcdcf491945d tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 7f05d753-e297-4330-ba02-dc0aac76de96] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:32.001358 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bf2ccbf2-9f2e-4eaa-9a44-bcdcf491945d tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:32.001912 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bf2ccbf2-9f2e-4eaa-9a44-bcdcf491945d tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:32.002389 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bf2ccbf2-9f2e-4eaa-9a44-bcdcf491945d tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:32.011679 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bf2ccbf2-9f2e-4eaa-9a44-bcdcf491945d tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:32.012372 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bf2ccbf2-9f2e-4eaa-9a44-bcdcf491945d tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:32.013267 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bf2ccbf2-9f2e-4eaa-9a44-bcdcf491945d tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:32.285389 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-27e9dcc3-e051-4596-a968-a1fc4e14a0fa tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b6d10d4aa54985a0bd2a74d7602356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea15e730b4749698d44b143f4f3f934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:32.293190 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-27e9dcc3-e051-4596-a968-a1fc4e14a0fa tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] 10.222.0.33 "GET /compute/v2.1/servers/325789fb-b74f-4a9a-a273-575a7366659d" status: 200 len: 1515 microversion: 2.1 time: 0.462067 Sep 23 04:59:32.296645 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2946/5736] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:31 2022] GET /compute/v2.1/servers/325789fb-b74f-4a9a-a273-575a7366659d => generated 1515 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:59:32.330813 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e55bfc3f-18a2-4f71-9e7c-1ecc5d2597ab tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:32.331449 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e55bfc3f-18a2-4f71-9e7c-1ecc5d2597ab tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] [instance: 818fa1c2-6041-4fda-baad-85c648e340f5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:32.340482 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e55bfc3f-18a2-4f71-9e7c-1ecc5d2597ab tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:32.340999 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e55bfc3f-18a2-4f71-9e7c-1ecc5d2597ab tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:32.344071 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e55bfc3f-18a2-4f71-9e7c-1ecc5d2597ab tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:32.344866 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e55bfc3f-18a2-4f71-9e7c-1ecc5d2597ab tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:32.345353 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e55bfc3f-18a2-4f71-9e7c-1ecc5d2597ab tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:32.348300 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e55bfc3f-18a2-4f71-9e7c-1ecc5d2597ab tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:32.542411 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-bf2ccbf2-9f2e-4eaa-9a44-bcdcf491945d tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:32.554158 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=4 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:59:32.559281 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-bf2ccbf2-9f2e-4eaa-9a44-bcdcf491945d tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/7f05d753-e297-4330-ba02-dc0aac76de96" status: 200 len: 1391 microversion: 2.1 time: 0.576218 Sep 23 04:59:32.561448 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2791/5737] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:31 2022] GET /compute/v2.1/servers/7f05d753-e297-4330-ba02-dc0aac76de96 => generated 1391 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:59:32.573188 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3273fe60-691a-40d7-82ac-68b496b6efcd tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:32.576761 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3273fe60-691a-40d7-82ac-68b496b6efcd tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] [instance: 1d4b42f4-3285-41c7-8264-e596b9d8ac02] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:32.591203 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3273fe60-691a-40d7-82ac-68b496b6efcd tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:32.592125 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3273fe60-691a-40d7-82ac-68b496b6efcd tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:32.592751 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3273fe60-691a-40d7-82ac-68b496b6efcd tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:32.593794 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3273fe60-691a-40d7-82ac-68b496b6efcd tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:32.594463 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3273fe60-691a-40d7-82ac-68b496b6efcd tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:32.595256 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3273fe60-691a-40d7-82ac-68b496b6efcd tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:33.027395 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e55bfc3f-18a2-4f71-9e7c-1ecc5d2597ab tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b6d10d4aa54985a0bd2a74d7602356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea15e730b4749698d44b143f4f3f934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:33.044172 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e55bfc3f-18a2-4f71-9e7c-1ecc5d2597ab tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] 10.222.0.33 "GET /compute/v2.1/servers/818fa1c2-6041-4fda-baad-85c648e340f5" status: 200 len: 1515 microversion: 2.1 time: 0.724468 Sep 23 04:59:33.047634 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2947/5738] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:32 2022] GET /compute/v2.1/servers/818fa1c2-6041-4fda-baad-85c648e340f5 => generated 1515 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:59:33.070897 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e05341f1-ea60-4233-af4e-67788632b696 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:33.072114 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e05341f1-ea60-4233-af4e-67788632b696 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] [instance: b66d0d2e-8333-4bee-a062-21f3ad2cbdb2] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:33.083013 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-3273fe60-691a-40d7-82ac-68b496b6efcd tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a845ca1e7747fba0a987235d980098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca57a0af591a43ee9cdef09134bc3fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:33.083722 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e05341f1-ea60-4233-af4e-67788632b696 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:33.084485 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e05341f1-ea60-4233-af4e-67788632b696 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:33.085138 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e05341f1-ea60-4233-af4e-67788632b696 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:33.086100 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e05341f1-ea60-4233-af4e-67788632b696 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:33.086756 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e05341f1-ea60-4233-af4e-67788632b696 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:33.089857 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e05341f1-ea60-4233-af4e-67788632b696 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:33.091749 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=16 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:59:33.094673 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3273fe60-691a-40d7-82ac-68b496b6efcd tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] 10.222.0.33 "GET /compute/v2.1/servers/1d4b42f4-3285-41c7-8264-e596b9d8ac02" status: 200 len: 1314 microversion: 2.1 time: 0.531843 Sep 23 04:59:33.113992 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2792/5739] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:32 2022] GET /compute/v2.1/servers/1d4b42f4-3285-41c7-8264-e596b9d8ac02 => generated 1314 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:59:33.364261 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e05341f1-ea60-4233-af4e-67788632b696 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b6d10d4aa54985a0bd2a74d7602356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea15e730b4749698d44b143f4f3f934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:33.377520 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e05341f1-ea60-4233-af4e-67788632b696 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] 10.222.0.33 "GET /compute/v2.1/servers/b66d0d2e-8333-4bee-a062-21f3ad2cbdb2" status: 200 len: 1514 microversion: 2.1 time: 0.310504 Sep 23 04:59:33.378832 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2948/5740] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:33 2022] GET /compute/v2.1/servers/b66d0d2e-8333-4bee-a062-21f3ad2cbdb2 => generated 1514 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:59:33.415397 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-34d68bc4-0f85-46ef-9685-18be0c0e8d77 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:33.416443 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-34d68bc4-0f85-46ef-9685-18be0c0e8d77 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] [instance: b66d0d2e-8333-4bee-a062-21f3ad2cbdb2] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:33.435735 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-34d68bc4-0f85-46ef-9685-18be0c0e8d77 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:33.437912 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-34d68bc4-0f85-46ef-9685-18be0c0e8d77 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:33.440525 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-34d68bc4-0f85-46ef-9685-18be0c0e8d77 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:33.442450 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-34d68bc4-0f85-46ef-9685-18be0c0e8d77 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:33.444891 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-34d68bc4-0f85-46ef-9685-18be0c0e8d77 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:33.445783 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-34d68bc4-0f85-46ef-9685-18be0c0e8d77 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:33.519258 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-34d68bc4-0f85-46ef-9685-18be0c0e8d77 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] [instance: b66d0d2e-8333-4bee-a062-21f3ad2cbdb2] Going to try to terminate instance {{(pid=122698) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:59:33.587166 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-cf52daee-85c0-4a5c-a2b7-53fb788173bb tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:33.588901 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-cf52daee-85c0-4a5c-a2b7-53fb788173bb tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 7f05d753-e297-4330-ba02-dc0aac76de96] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:33.604387 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cf52daee-85c0-4a5c-a2b7-53fb788173bb tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:33.604905 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cf52daee-85c0-4a5c-a2b7-53fb788173bb tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:33.605387 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cf52daee-85c0-4a5c-a2b7-53fb788173bb tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:33.613532 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cf52daee-85c0-4a5c-a2b7-53fb788173bb tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:33.614134 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cf52daee-85c0-4a5c-a2b7-53fb788173bb tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:33.616212 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cf52daee-85c0-4a5c-a2b7-53fb788173bb tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:33.906507 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-34d68bc4-0f85-46ef-9685-18be0c0e8d77 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b66d0d2e-8333-4bee-a062-21f3ad2cbdb2" status: 204 len: 0 microversion: 2.1 time: 0.504286 Sep 23 04:59:33.907412 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2793/5741] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:59:33 2022] DELETE /compute/v2.1/servers/b66d0d2e-8333-4bee-a062-21f3ad2cbdb2 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:59:33.912778 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-5025ca39-e2e0-4a15-824e-3ede22fdcf6e req-3728da50-cca8-4473-a716-4aaaffe216d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f05d753-e297-4330-ba02-dc0aac76de96", "name": "network-vif-plugged", "status": "completed", "tag": "9e975956-70a6-4752-9499-532298e87730"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:59:33.935076 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-5025ca39-e2e0-4a15-824e-3ede22fdcf6e req-3728da50-cca8-4473-a716-4aaaffe216d0 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:33.935567 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-5025ca39-e2e0-4a15-824e-3ede22fdcf6e req-3728da50-cca8-4473-a716-4aaaffe216d0 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:33.938529 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-5025ca39-e2e0-4a15-824e-3ede22fdcf6e req-3728da50-cca8-4473-a716-4aaaffe216d0 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:33.955223 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-5025ca39-e2e0-4a15-824e-3ede22fdcf6e req-3728da50-cca8-4473-a716-4aaaffe216d0 service nova] Creating event network-vif-plugged:9e975956-70a6-4752-9499-532298e87730 for instance 7f05d753-e297-4330-ba02-dc0aac76de96 on n-h2-846463-3 Sep 23 04:59:33.960524 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-5025ca39-e2e0-4a15-824e-3ede22fdcf6e req-3728da50-cca8-4473-a716-4aaaffe216d0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051576 Sep 23 04:59:33.961747 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2794/5742] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:59:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:59:33.967856 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8d7bc2d3-7a26-46f5-b7da-001f00585503 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:33.968753 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8d7bc2d3-7a26-46f5-b7da-001f00585503 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] [instance: b66d0d2e-8333-4bee-a062-21f3ad2cbdb2] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:33.975725 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8d7bc2d3-7a26-46f5-b7da-001f00585503 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:33.976488 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8d7bc2d3-7a26-46f5-b7da-001f00585503 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:33.977101 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8d7bc2d3-7a26-46f5-b7da-001f00585503 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:33.978180 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8d7bc2d3-7a26-46f5-b7da-001f00585503 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:33.979613 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8d7bc2d3-7a26-46f5-b7da-001f00585503 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:33.980275 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8d7bc2d3-7a26-46f5-b7da-001f00585503 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:33.994036 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-cf52daee-85c0-4a5c-a2b7-53fb788173bb tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:34.004789 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-cf52daee-85c0-4a5c-a2b7-53fb788173bb tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/7f05d753-e297-4330-ba02-dc0aac76de96" status: 200 len: 1391 microversion: 2.1 time: 0.421696 Sep 23 04:59:34.005401 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2949/5743] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:33 2022] GET /compute/v2.1/servers/7f05d753-e297-4330-ba02-dc0aac76de96 => generated 1391 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:59:34.123291 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-15fceb6a-c1fd-49ee-a987-99abcf4d18c1 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:34.124364 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-15fceb6a-c1fd-49ee-a987-99abcf4d18c1 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] [instance: 1d4b42f4-3285-41c7-8264-e596b9d8ac02] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:34.138799 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-15fceb6a-c1fd-49ee-a987-99abcf4d18c1 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:34.140696 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-15fceb6a-c1fd-49ee-a987-99abcf4d18c1 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:34.141506 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-15fceb6a-c1fd-49ee-a987-99abcf4d18c1 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:34.151400 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-15fceb6a-c1fd-49ee-a987-99abcf4d18c1 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:34.153024 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-15fceb6a-c1fd-49ee-a987-99abcf4d18c1 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:34.154581 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-15fceb6a-c1fd-49ee-a987-99abcf4d18c1 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:34.167588 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8d7bc2d3-7a26-46f5-b7da-001f00585503 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b6d10d4aa54985a0bd2a74d7602356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea15e730b4749698d44b143f4f3f934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:34.177513 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8d7bc2d3-7a26-46f5-b7da-001f00585503 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] 10.222.0.33 "GET /compute/v2.1/servers/b66d0d2e-8333-4bee-a062-21f3ad2cbdb2" status: 200 len: 1520 microversion: 2.1 time: 0.214371 Sep 23 04:59:34.190501 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2795/5744] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:33 2022] GET /compute/v2.1/servers/b66d0d2e-8333-4bee-a062-21f3ad2cbdb2 => generated 1520 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:59:34.195835 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-27bff433-9f03-4403-a007-d79601811587 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0e3e692a-a65c-40d7-a31b-621abeb1ac09"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:59:34.202786 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-27bff433-9f03-4403-a007-d79601811587 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] [instance: ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:34.214096 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-27bff433-9f03-4403-a007-d79601811587 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:34.214665 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-27bff433-9f03-4403-a007-d79601811587 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:34.215179 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-27bff433-9f03-4403-a007-d79601811587 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:34.215973 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-27bff433-9f03-4403-a007-d79601811587 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:34.216506 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-27bff433-9f03-4403-a007-d79601811587 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:34.217126 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-27bff433-9f03-4403-a007-d79601811587 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:34.420619 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-15fceb6a-c1fd-49ee-a987-99abcf4d18c1 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a845ca1e7747fba0a987235d980098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca57a0af591a43ee9cdef09134bc3fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:34.430687 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-15fceb6a-c1fd-49ee-a987-99abcf4d18c1 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] 10.222.0.33 "GET /compute/v2.1/servers/1d4b42f4-3285-41c7-8264-e596b9d8ac02" status: 200 len: 1314 microversion: 2.1 time: 0.311524 Sep 23 04:59:34.446200 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2950/5745] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:34 2022] GET /compute/v2.1/servers/1d4b42f4-3285-41c7-8264-e596b9d8ac02 => generated 1314 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:59:35.029462 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-900b82e2-f454-497e-9da8-22eb81d424b2 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:35.030134 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-900b82e2-f454-497e-9da8-22eb81d424b2 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 7f05d753-e297-4330-ba02-dc0aac76de96] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:35.040567 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-900b82e2-f454-497e-9da8-22eb81d424b2 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:35.042083 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-900b82e2-f454-497e-9da8-22eb81d424b2 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:35.042866 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-900b82e2-f454-497e-9da8-22eb81d424b2 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:35.043849 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-900b82e2-f454-497e-9da8-22eb81d424b2 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:35.045401 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-900b82e2-f454-497e-9da8-22eb81d424b2 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:35.046144 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-900b82e2-f454-497e-9da8-22eb81d424b2 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:35.098961 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:59:35.839776 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-900b82e2-f454-497e-9da8-22eb81d424b2 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:35.848075 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-900b82e2-f454-497e-9da8-22eb81d424b2 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/7f05d753-e297-4330-ba02-dc0aac76de96" status: 200 len: 1391 microversion: 2.1 time: 0.823398 Sep 23 04:59:35.848749 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2951/5746] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:35 2022] GET /compute/v2.1/servers/7f05d753-e297-4330-ba02-dc0aac76de96 => generated 1391 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:59:35.853690 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-503332dc-dfeb-4356-b69d-92cc421bf862 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:35.854393 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-503332dc-dfeb-4356-b69d-92cc421bf862 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] [instance: b66d0d2e-8333-4bee-a062-21f3ad2cbdb2] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:35.860667 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-503332dc-dfeb-4356-b69d-92cc421bf862 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:35.861415 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-503332dc-dfeb-4356-b69d-92cc421bf862 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:35.861803 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-503332dc-dfeb-4356-b69d-92cc421bf862 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:35.862528 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-503332dc-dfeb-4356-b69d-92cc421bf862 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:35.863245 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-503332dc-dfeb-4356-b69d-92cc421bf862 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:35.866634 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-503332dc-dfeb-4356-b69d-92cc421bf862 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:36.113160 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-27bff433-9f03-4403-a007-d79601811587 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] 10.222.0.33 "POST /compute/v2.1/servers/ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.926929 Sep 23 04:59:36.121033 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2796/5747] 10.222.0.33 () {60 vars in 1323 bytes} [Fri Sep 23 04:59:34 2022] POST /compute/v2.1/servers/ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7/os-volume_attachments => generated 194 bytes in 1937 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:59:36.132150 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-502c111a-22bf-4478-b2e4-fb7d1cd73ff8 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:36.136617 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-502c111a-22bf-4478-b2e4-fb7d1cd73ff8 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] [instance: 1d4b42f4-3285-41c7-8264-e596b9d8ac02] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:36.152684 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-502c111a-22bf-4478-b2e4-fb7d1cd73ff8 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:36.155919 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-502c111a-22bf-4478-b2e4-fb7d1cd73ff8 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:36.157512 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-502c111a-22bf-4478-b2e4-fb7d1cd73ff8 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:36.158936 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-502c111a-22bf-4478-b2e4-fb7d1cd73ff8 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:36.159522 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-502c111a-22bf-4478-b2e4-fb7d1cd73ff8 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:36.160067 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-502c111a-22bf-4478-b2e4-fb7d1cd73ff8 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:36.373109 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-503332dc-dfeb-4356-b69d-92cc421bf862 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b6d10d4aa54985a0bd2a74d7602356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea15e730b4749698d44b143f4f3f934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:36.401160 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-503332dc-dfeb-4356-b69d-92cc421bf862 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] 10.222.0.33 "GET /compute/v2.1/servers/b66d0d2e-8333-4bee-a062-21f3ad2cbdb2" status: 200 len: 1520 microversion: 2.1 time: 0.550454 Sep 23 04:59:36.404366 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2952/5748] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:35 2022] GET /compute/v2.1/servers/b66d0d2e-8333-4bee-a062-21f3ad2cbdb2 => generated 1520 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:59:36.474211 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-502c111a-22bf-4478-b2e4-fb7d1cd73ff8 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a845ca1e7747fba0a987235d980098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca57a0af591a43ee9cdef09134bc3fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:36.491784 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-502c111a-22bf-4478-b2e4-fb7d1cd73ff8 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] 10.222.0.33 "GET /compute/v2.1/servers/1d4b42f4-3285-41c7-8264-e596b9d8ac02" status: 200 len: 1314 microversion: 2.1 time: 0.369018 Sep 23 04:59:36.492214 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2797/5749] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:36 2022] GET /compute/v2.1/servers/1d4b42f4-3285-41c7-8264-e596b9d8ac02 => generated 1314 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:59:36.873036 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-27472d8a-36cf-4a42-ab1b-e00d5a25d372 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:36.876504 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-27472d8a-36cf-4a42-ab1b-e00d5a25d372 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 7f05d753-e297-4330-ba02-dc0aac76de96] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:36.889792 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-2bbecc0b-5279-4db9-bf3b-ea589ae0675b req-3a30b071-8214-4121-ad6f-5aa36dfc6ee8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b66d0d2e-8333-4bee-a062-21f3ad2cbdb2", "name": "network-vif-deleted", "tag": "4f687495-3d9e-4251-a3ba-f7e37903c2e2"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:59:36.916644 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-27472d8a-36cf-4a42-ab1b-e00d5a25d372 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:36.920463 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-27472d8a-36cf-4a42-ab1b-e00d5a25d372 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:36.922772 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-27472d8a-36cf-4a42-ab1b-e00d5a25d372 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:36.926359 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-27472d8a-36cf-4a42-ab1b-e00d5a25d372 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:36.926865 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-27472d8a-36cf-4a42-ab1b-e00d5a25d372 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:36.933338 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-27472d8a-36cf-4a42-ab1b-e00d5a25d372 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:36.935649 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-2bbecc0b-5279-4db9-bf3b-ea589ae0675b req-3a30b071-8214-4121-ad6f-5aa36dfc6ee8 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:36.949928 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-2bbecc0b-5279-4db9-bf3b-ea589ae0675b req-3a30b071-8214-4121-ad6f-5aa36dfc6ee8 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:36.954412 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-2bbecc0b-5279-4db9-bf3b-ea589ae0675b req-3a30b071-8214-4121-ad6f-5aa36dfc6ee8 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:37.002135 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-2bbecc0b-5279-4db9-bf3b-ea589ae0675b req-3a30b071-8214-4121-ad6f-5aa36dfc6ee8 service nova] Creating event network-vif-deleted:4f687495-3d9e-4251-a3ba-f7e37903c2e2 for instance b66d0d2e-8333-4bee-a062-21f3ad2cbdb2 on n-h2-846463-3 Sep 23 04:59:37.013595 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-2bbecc0b-5279-4db9-bf3b-ea589ae0675b req-3a30b071-8214-4121-ad6f-5aa36dfc6ee8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127578 Sep 23 04:59:37.030675 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2798/5750] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:59:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:59:37.368068 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-27472d8a-36cf-4a42-ab1b-e00d5a25d372 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:37.401666 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-27472d8a-36cf-4a42-ab1b-e00d5a25d372 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/7f05d753-e297-4330-ba02-dc0aac76de96" status: 200 len: 1563 microversion: 2.1 time: 0.529509 Sep 23 04:59:37.406695 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2953/5751] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:36 2022] GET /compute/v2.1/servers/7f05d753-e297-4330-ba02-dc0aac76de96 => generated 1563 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:59:37.439253 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-309ab2b4-3a49-4a82-9174-d47dfc5b8ee2 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:37.440548 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-309ab2b4-3a49-4a82-9174-d47dfc5b8ee2 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] [instance: b66d0d2e-8333-4bee-a062-21f3ad2cbdb2] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:37.448908 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7bb128ab-415e-49c1-9feb-afa153a78e2f tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:37.449531 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-7bb128ab-415e-49c1-9feb-afa153a78e2f tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 7f05d753-e297-4330-ba02-dc0aac76de96] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:37.455584 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-309ab2b4-3a49-4a82-9174-d47dfc5b8ee2 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:37.456331 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-309ab2b4-3a49-4a82-9174-d47dfc5b8ee2 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:37.457057 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-309ab2b4-3a49-4a82-9174-d47dfc5b8ee2 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:37.459338 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-309ab2b4-3a49-4a82-9174-d47dfc5b8ee2 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:37.460644 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-309ab2b4-3a49-4a82-9174-d47dfc5b8ee2 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:37.462122 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-309ab2b4-3a49-4a82-9174-d47dfc5b8ee2 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:37.470600 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7bb128ab-415e-49c1-9feb-afa153a78e2f tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:37.471106 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7bb128ab-415e-49c1-9feb-afa153a78e2f tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:37.471547 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7bb128ab-415e-49c1-9feb-afa153a78e2f tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:37.472260 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7bb128ab-415e-49c1-9feb-afa153a78e2f tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:37.476475 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7bb128ab-415e-49c1-9feb-afa153a78e2f tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:37.477692 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7bb128ab-415e-49c1-9feb-afa153a78e2f tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:37.519596 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-309ab2b4-3a49-4a82-9174-d47dfc5b8ee2 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:37.520404 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-309ab2b4-3a49-4a82-9174-d47dfc5b8ee2 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:37.522621 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-309ab2b4-3a49-4a82-9174-d47dfc5b8ee2 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:37.522621 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-309ab2b4-3a49-4a82-9174-d47dfc5b8ee2 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lazy-loading 'fault' on Instance uuid b66d0d2e-8333-4bee-a062-21f3ad2cbdb2 {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:59:37.597997 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-309ab2b4-3a49-4a82-9174-d47dfc5b8ee2 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b6d10d4aa54985a0bd2a74d7602356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea15e730b4749698d44b143f4f3f934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:37.609599 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-309ab2b4-3a49-4a82-9174-d47dfc5b8ee2 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] 10.222.0.33 "GET /compute/v2.1/servers/b66d0d2e-8333-4bee-a062-21f3ad2cbdb2" status: 200 len: 1312 microversion: 2.1 time: 0.174738 Sep 23 04:59:37.611586 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2799/5752] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:37 2022] GET /compute/v2.1/servers/b66d0d2e-8333-4bee-a062-21f3ad2cbdb2 => generated 1312 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:59:37.633703 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-aa62d05e-39b5-4e8f-9662-beda5e5dd36f tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:37.634433 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-aa62d05e-39b5-4e8f-9662-beda5e5dd36f tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] [instance: 1d4b42f4-3285-41c7-8264-e596b9d8ac02] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:37.644408 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-aa62d05e-39b5-4e8f-9662-beda5e5dd36f tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:37.645127 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-aa62d05e-39b5-4e8f-9662-beda5e5dd36f tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:37.646681 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-aa62d05e-39b5-4e8f-9662-beda5e5dd36f tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:37.648177 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-aa62d05e-39b5-4e8f-9662-beda5e5dd36f tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:37.649400 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-aa62d05e-39b5-4e8f-9662-beda5e5dd36f tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:37.652759 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-aa62d05e-39b5-4e8f-9662-beda5e5dd36f tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:37.979823 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-7bb128ab-415e-49c1-9feb-afa153a78e2f tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:37.996027 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-7bb128ab-415e-49c1-9feb-afa153a78e2f tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/7f05d753-e297-4330-ba02-dc0aac76de96" status: 200 len: 1563 microversion: 2.1 time: 0.555780 Sep 23 04:59:37.996760 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2954/5753] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:37 2022] GET /compute/v2.1/servers/7f05d753-e297-4330-ba02-dc0aac76de96 => generated 1563 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:59:38.030856 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-aa62d05e-39b5-4e8f-9662-beda5e5dd36f tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a845ca1e7747fba0a987235d980098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca57a0af591a43ee9cdef09134bc3fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:38.041845 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-aa62d05e-39b5-4e8f-9662-beda5e5dd36f tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] 10.222.0.33 "GET /compute/v2.1/servers/1d4b42f4-3285-41c7-8264-e596b9d8ac02" status: 200 len: 1314 microversion: 2.1 time: 0.425429 Sep 23 04:59:38.045121 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2800/5754] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:37 2022] GET /compute/v2.1/servers/1d4b42f4-3285-41c7-8264-e596b9d8ac02 => generated 1314 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:59:38.514948 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-9caed3f0-a9fe-4638-a84c-1b7dc425f638 req-6192f094-51da-429d-8dee-6dd37b2381eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d4b42f4-3285-41c7-8264-e596b9d8ac02", "name": "network-vif-plugged", "status": "completed", "tag": "13485893-9e3f-4bb0-b531-8796b4cebfd1"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:59:38.526002 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-9caed3f0-a9fe-4638-a84c-1b7dc425f638 req-6192f094-51da-429d-8dee-6dd37b2381eb service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:38.526517 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-9caed3f0-a9fe-4638-a84c-1b7dc425f638 req-6192f094-51da-429d-8dee-6dd37b2381eb service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:38.526959 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-9caed3f0-a9fe-4638-a84c-1b7dc425f638 req-6192f094-51da-429d-8dee-6dd37b2381eb service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:38.540874 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-9caed3f0-a9fe-4638-a84c-1b7dc425f638 req-6192f094-51da-429d-8dee-6dd37b2381eb service nova] Creating event network-vif-plugged:13485893-9e3f-4bb0-b531-8796b4cebfd1 for instance 1d4b42f4-3285-41c7-8264-e596b9d8ac02 on n-h2-846463-3 Sep 23 04:59:38.552544 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-9caed3f0-a9fe-4638-a84c-1b7dc425f638 req-6192f094-51da-429d-8dee-6dd37b2381eb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041338 Sep 23 04:59:38.553457 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2955/5755] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:59:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:59:38.640846 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9566fe7c-74ab-48f8-8d0e-0a2d1903f4e3 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:38.646241 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-9566fe7c-74ab-48f8-8d0e-0a2d1903f4e3 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] [instance: b66d0d2e-8333-4bee-a062-21f3ad2cbdb2] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:38.658073 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9566fe7c-74ab-48f8-8d0e-0a2d1903f4e3 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:38.659063 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9566fe7c-74ab-48f8-8d0e-0a2d1903f4e3 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:38.659769 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9566fe7c-74ab-48f8-8d0e-0a2d1903f4e3 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:38.662942 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9566fe7c-74ab-48f8-8d0e-0a2d1903f4e3 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:38.666975 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9566fe7c-74ab-48f8-8d0e-0a2d1903f4e3 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:38.667783 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9566fe7c-74ab-48f8-8d0e-0a2d1903f4e3 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:38.703498 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-9566fe7c-74ab-48f8-8d0e-0a2d1903f4e3 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] HTTP exception thrown: Instance b66d0d2e-8333-4bee-a062-21f3ad2cbdb2 could not be found. Sep 23 04:59:38.705538 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9566fe7c-74ab-48f8-8d0e-0a2d1903f4e3 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Request method failure captured: Sep 23 04:59:38.705538 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/b66d0d2e-8333-4bee-a062-21f3ad2cbdb2 HTTP/1.1 Sep 23 04:59:38.705538 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:59:38.705538 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:59:38.705538 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:59:38.705538 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:59:38.705538 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:59:38.705538 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:59:38.705538 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:59:38.705538 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:59:38.705538 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLT0RQy8XnFFDqzLIQBqw5eTl_NQbd_bmWYDyRiMMs6O8XNx8ROIcyKlEonkc8ojvK89xmWZedi753D8VEH16QyPBywkueomZbkXYvKgiPdABpQ2jV2LFZtdOqVfa46zBxRUO2KIbQUCwayksMno6xYtL3NeCQSLKZq7KkFC73w-EzHc Sep 23 04:59:38.705538 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:59:38.705538 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:59:38.705538 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:59:38.705538 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:59:38.705538 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:59:38.705538 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:59:38.705538 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: fea15e730b4749698d44b143f4f3f934 Sep 23 04:59:38.705538 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ListServersNegativeTestJSON-314302562 Sep 23 04:59:38.705538 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:59:38.705538 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:59:38.705538 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fea15e730b4749698d44b143f4f3f934", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fea15e730b4749698d44b143f4f3f934"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fea15e730b4749698d44b143f4f3f934"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fea15e730b4749698d44b143f4f3f934"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:59:38.705538 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ListServersNegativeTestJSON-314302562 Sep 23 04:59:38.705538 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: fea15e730b4749698d44b143f4f3f934 Sep 23 04:59:38.705538 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-314302562 Sep 23 04:59:38.705538 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ListServersNegativeTestJSON-314302562-project Sep 23 04:59:38.705538 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:59:38.705538 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:59:38.705538 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: a9b6d10d4aa54985a0bd2a74d7602356 Sep 23 04:59:38.705538 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ListServersNegativeTestJSON-314302562-project Sep 23 04:59:38.705538 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:59:38.705538 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance b66d0d2e-8333-4bee-a062-21f3ad2cbdb2 could not be found. Sep 23 04:59:38.705538 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': 'b66d0d2e-8333-4bee-a062-21f3ad2cbdb2'} Sep 23 04:59:38.705538 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:59:38.705538 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:59:38.705538 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:59:38.705538 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:59:38.705538 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:59:38.705538 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:59:38.705538 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:59:38.705538 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:59:38.705538 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:59:38.705538 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:59:38.705538 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b66d0d2e-8333-4bee-a062-21f3ad2cbdb2 could not be found. Sep 23 04:59:38.705538 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:59:38.705538 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:59:38.705538 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:59:38.705538 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:59:38.705538 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:59:38.705538 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:59:38.705538 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:59:38.705538 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:59:38.705538 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:59:38.705538 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:59:38.705538 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:59:38.705538 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:59:38.705538 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:59:38.705538 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:59:38.705538 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:59:38.705538 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:59:38.705538 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b66d0d2e-8333-4bee-a062-21f3ad2cbdb2 could not be found. Sep 23 04:59:38.705538 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:59:38.705538 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:59:38.710438 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:59:38.710438 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:59:38.710438 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:59:38.710438 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:59:38.710438 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:59:38.710438 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:59:38.710438 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b66d0d2e-8333-4bee-a062-21f3ad2cbdb2 could not be found. Sep 23 04:59:38.710438 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:59:38.713318 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9566fe7c-74ab-48f8-8d0e-0a2d1903f4e3 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Returning 404 to user: Instance b66d0d2e-8333-4bee-a062-21f3ad2cbdb2 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:59:38.723229 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9566fe7c-74ab-48f8-8d0e-0a2d1903f4e3 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] 10.222.0.33 "GET /compute/v2.1/servers/b66d0d2e-8333-4bee-a062-21f3ad2cbdb2" status: 404 len: 111 microversion: 2.1 time: 0.081804 Sep 23 04:59:38.723229 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2801/5756] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:38 2022] GET /compute/v2.1/servers/b66d0d2e-8333-4bee-a062-21f3ad2cbdb2 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:59:38.729372 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-239501a5-9329-4910-a13b-c041529dc8fd tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:38.734950 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-239501a5-9329-4910-a13b-c041529dc8fd tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a9b6d10d4aa54985a0bd2a74d7602356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea15e730b4749698d44b143f4f3f934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:38.747985 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-239501a5-9329-4910-a13b-c041529dc8fd tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': 'fea15e730b4749698d44b143f4f3f934'} {{(pid=122699) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 04:59:38.754242 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-239501a5-9329-4910-a13b-c041529dc8fd tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:38.754415 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-239501a5-9329-4910-a13b-c041529dc8fd tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:38.755143 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-239501a5-9329-4910-a13b-c041529dc8fd tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:38.766814 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-239501a5-9329-4910-a13b-c041529dc8fd tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:38.767415 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-239501a5-9329-4910-a13b-c041529dc8fd tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:38.767956 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-239501a5-9329-4910-a13b-c041529dc8fd tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:38.988345 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-239501a5-9329-4910-a13b-c041529dc8fd tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] 10.222.0.33 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.263037 Sep 23 04:59:38.988989 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2956/5757] 10.222.0.33 () {58 vars in 1230 bytes} [Fri Sep 23 04:59:38 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 23 04:59:39.002334 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4cc5a67d-285e-446a-8659-fbdb2251b0f0 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:39.008212 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4cc5a67d-285e-446a-8659-fbdb2251b0f0 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Request method failure captured: Sep 23 04:59:39.008212 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Sep 23 04:59:39.008212 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:59:39.008212 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:59:39.008212 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:59:39.008212 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:59:39.008212 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:59:39.008212 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:59:39.008212 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:59:39.008212 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:59:39.008212 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLT0RQy8XnFFDqzLIQBqw5eTl_NQbd_bmWYDyRiMMs6O8XNx8ROIcyKlEonkc8ojvK89xmWZedi753D8VEH16QyPBywkueomZbkXYvKgiPdABpQ2jV2LFZtdOqVfa46zBxRUO2KIbQUCwayksMno6xYtL3NeCQSLKZq7KkFC73w-EzHc Sep 23 04:59:39.008212 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:59:39.008212 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:59:39.008212 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:59:39.008212 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:59:39.008212 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:59:39.008212 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:59:39.008212 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: fea15e730b4749698d44b143f4f3f934 Sep 23 04:59:39.008212 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ListServersNegativeTestJSON-314302562 Sep 23 04:59:39.008212 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:59:39.008212 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:59:39.008212 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fea15e730b4749698d44b143f4f3f934", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fea15e730b4749698d44b143f4f3f934"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fea15e730b4749698d44b143f4f3f934"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fea15e730b4749698d44b143f4f3f934"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:59:39.008212 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ListServersNegativeTestJSON-314302562 Sep 23 04:59:39.008212 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: fea15e730b4749698d44b143f4f3f934 Sep 23 04:59:39.008212 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-314302562 Sep 23 04:59:39.008212 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ListServersNegativeTestJSON-314302562-project Sep 23 04:59:39.008212 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:59:39.008212 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:59:39.008212 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: a9b6d10d4aa54985a0bd2a74d7602356 Sep 23 04:59:39.008212 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ListServersNegativeTestJSON-314302562-project Sep 23 04:59:39.008212 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:59:39.008212 n-d-846463-3 devstack@n-api.service[122698]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Sep 23 04:59:39.008212 n-d-846463-3 devstack@n-api.service[122698]: action_args: {} Sep 23 04:59:39.008212 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:59:39.008212 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:59:39.008212 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 23 04:59:39.008212 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 23 04:59:39.008212 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 23 04:59:39.008212 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise error Sep 23 04:59:39.008212 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Sep 23 04:59:39.008212 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:59:39.008212 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Sep 23 04:59:39.008212 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Sep 23 04:59:39.008212 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:59:39.008212 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi On instance[0]: Sep 23 04:59:39.008212 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi '2011/01/01' Sep 23 04:59:39.008212 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:59:39.008212 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:59:39.008212 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:59:39.008212 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:59:39.008212 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:59:39.008212 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:59:39.008212 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:59:39.008212 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:59:39.008212 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:59:39.008212 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:59:39.008212 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 23 04:59:39.008212 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:59:39.008212 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 23 04:59:39.008212 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:59:39.008212 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 23 04:59:39.008212 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:59:39.008212 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 23 04:59:39.008212 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Sep 23 04:59:39.008212 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Sep 23 04:59:39.008212 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 23 04:59:39.012963 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 23 04:59:39.012963 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 23 04:59:39.012963 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 23 04:59:39.012963 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Sep 23 04:59:39.012963 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:59:39.012963 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:59:39.012963 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:59:39.012963 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:59:39.012963 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:59:39.012963 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:59:39.012963 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 23 04:59:39.012963 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 23 04:59:39.012963 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Sep 23 04:59:39.012963 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:59:39.020605 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4cc5a67d-285e-446a-8659-fbdb2251b0f0 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:59:39.022823 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4cc5a67d-285e-446a-8659-fbdb2251b0f0 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] 10.222.0.33 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.024591 Sep 23 04:59:39.025812 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2802/5758] 10.222.0.33 () {58 vars in 1182 bytes} [Fri Sep 23 04:59:38 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 23 04:59:39.034760 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2b309741-cd07-43f5-8a0c-eeeabc331d7e tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:39.041841 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2b309741-cd07-43f5-8a0c-eeeabc331d7e tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a9b6d10d4aa54985a0bd2a74d7602356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea15e730b4749698d44b143f4f3f934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:39.042706 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-2b309741-cd07-43f5-8a0c-eeeabc331d7e tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Searching by: {'deleted': False, 'project_id': 'fea15e730b4749698d44b143f4f3f934'} {{(pid=122699) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 04:59:39.048752 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2b309741-cd07-43f5-8a0c-eeeabc331d7e tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:39.049475 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2b309741-cd07-43f5-8a0c-eeeabc331d7e tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:39.050195 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2b309741-cd07-43f5-8a0c-eeeabc331d7e tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:39.051129 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2b309741-cd07-43f5-8a0c-eeeabc331d7e tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:39.051806 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2b309741-cd07-43f5-8a0c-eeeabc331d7e tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:39.052432 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2b309741-cd07-43f5-8a0c-eeeabc331d7e tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:39.065593 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-54a45269-1abd-4702-abfb-f1f3bd24610e tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:39.067153 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-54a45269-1abd-4702-abfb-f1f3bd24610e tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] [instance: 1d4b42f4-3285-41c7-8264-e596b9d8ac02] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:39.079548 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-54a45269-1abd-4702-abfb-f1f3bd24610e tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:39.085379 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-54a45269-1abd-4702-abfb-f1f3bd24610e tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:39.086277 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-54a45269-1abd-4702-abfb-f1f3bd24610e tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:39.087283 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-54a45269-1abd-4702-abfb-f1f3bd24610e tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:39.088009 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-54a45269-1abd-4702-abfb-f1f3bd24610e tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:39.088650 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-54a45269-1abd-4702-abfb-f1f3bd24610e tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:39.121184 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.multi_cell_list [None req-2b309741-cd07-43f5-8a0c-eeeabc331d7e tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122699) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 23 04:59:39.196792 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2b309741-cd07-43f5-8a0c-eeeabc331d7e tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.165966 Sep 23 04:59:39.197641 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2957/5759] 10.222.0.33 () {58 vars in 1125 bytes} [Fri Sep 23 04:59:39 2022] GET /compute/v2.1/servers => generated 681 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:59:39.216156 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-58328bdb-81b6-4e85-aa16-5745a12e2181 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:39.226893 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-58328bdb-81b6-4e85-aa16-5745a12e2181 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a9b6d10d4aa54985a0bd2a74d7602356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea15e730b4749698d44b143f4f3f934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:39.227598 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.compute.servers [None req-58328bdb-81b6-4e85-aa16-5745a12e2181 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Removing options 'limit' from query {{(pid=122699) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 23 04:59:39.228982 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-58328bdb-81b6-4e85-aa16-5745a12e2181 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Searching by: {'deleted': False, 'project_id': 'fea15e730b4749698d44b143f4f3f934'} {{(pid=122699) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 04:59:39.251379 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-58328bdb-81b6-4e85-aa16-5745a12e2181 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:39.252194 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-58328bdb-81b6-4e85-aa16-5745a12e2181 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:39.252840 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-58328bdb-81b6-4e85-aa16-5745a12e2181 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:39.254068 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-58328bdb-81b6-4e85-aa16-5745a12e2181 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:39.254623 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-58328bdb-81b6-4e85-aa16-5745a12e2181 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:39.255289 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-58328bdb-81b6-4e85-aa16-5745a12e2181 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:39.338173 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.multi_cell_list [None req-58328bdb-81b6-4e85-aa16-5745a12e2181 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=122699) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 23 04:59:39.412475 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-58328bdb-81b6-4e85-aa16-5745a12e2181 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] 10.222.0.33 "GET /compute/v2.1/servers?limit=102" status: 200 len: 681 microversion: 2.1 time: 0.205149 Sep 23 04:59:39.415198 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2958/5760] 10.222.0.33 () {58 vars in 1144 bytes} [Fri Sep 23 04:59:39 2022] GET /compute/v2.1/servers?limit=102 => generated 681 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:59:39.429834 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ebbcd314-fb2b-41ff-8deb-68de352fdaeb tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:39.439395 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ebbcd314-fb2b-41ff-8deb-68de352fdaeb tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Request method failure captured: Sep 23 04:59:39.439395 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Sep 23 04:59:39.439395 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:59:39.439395 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:59:39.439395 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:59:39.439395 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:59:39.439395 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:59:39.439395 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:59:39.439395 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:59:39.439395 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:59:39.439395 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLT0RQy8XnFFDqzLIQBqw5eTl_NQbd_bmWYDyRiMMs6O8XNx8ROIcyKlEonkc8ojvK89xmWZedi753D8VEH16QyPBywkueomZbkXYvKgiPdABpQ2jV2LFZtdOqVfa46zBxRUO2KIbQUCwayksMno6xYtL3NeCQSLKZq7KkFC73w-EzHc Sep 23 04:59:39.439395 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:59:39.439395 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:59:39.439395 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:59:39.439395 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:59:39.439395 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:59:39.439395 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:59:39.439395 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: fea15e730b4749698d44b143f4f3f934 Sep 23 04:59:39.439395 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ListServersNegativeTestJSON-314302562 Sep 23 04:59:39.439395 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:59:39.439395 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:59:39.439395 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fea15e730b4749698d44b143f4f3f934", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fea15e730b4749698d44b143f4f3f934"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fea15e730b4749698d44b143f4f3f934"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fea15e730b4749698d44b143f4f3f934"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:59:39.439395 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ListServersNegativeTestJSON-314302562 Sep 23 04:59:39.439395 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: fea15e730b4749698d44b143f4f3f934 Sep 23 04:59:39.439395 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-314302562 Sep 23 04:59:39.439395 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ListServersNegativeTestJSON-314302562-project Sep 23 04:59:39.439395 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:59:39.439395 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:59:39.439395 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: a9b6d10d4aa54985a0bd2a74d7602356 Sep 23 04:59:39.439395 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ListServersNegativeTestJSON-314302562-project Sep 23 04:59:39.439395 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:59:39.439395 n-d-846463-3 devstack@n-api.service[122699]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Sep 23 04:59:39.439395 n-d-846463-3 devstack@n-api.service[122699]: action_args: {} Sep 23 04:59:39.439395 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:59:39.439395 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:59:39.439395 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 23 04:59:39.439395 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 23 04:59:39.439395 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 23 04:59:39.439395 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise error Sep 23 04:59:39.439395 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Sep 23 04:59:39.439395 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:59:39.439395 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Sep 23 04:59:39.439395 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 23 04:59:39.439395 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi 'minimum': 0, Sep 23 04:59:39.439395 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 23 04:59:39.439395 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 23 04:59:39.439395 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:59:39.439395 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi On instance[0]: Sep 23 04:59:39.439395 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi '-1' Sep 23 04:59:39.439395 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:59:39.439395 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:59:39.439395 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:59:39.439395 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:59:39.439395 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:59:39.439395 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:59:39.439395 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:59:39.439395 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:59:39.439395 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:59:39.439395 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:59:39.439395 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 23 04:59:39.439395 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:59:39.439395 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 23 04:59:39.439395 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:59:39.439395 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 23 04:59:39.439395 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:59:39.439395 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 23 04:59:39.439395 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Sep 23 04:59:39.439395 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Sep 23 04:59:39.443952 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 23 04:59:39.443952 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 23 04:59:39.443952 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 23 04:59:39.443952 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 23 04:59:39.443952 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Sep 23 04:59:39.443952 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:59:39.443952 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:59:39.443952 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:59:39.443952 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:59:39.443952 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:59:39.443952 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:59:39.443952 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 23 04:59:39.443952 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 23 04:59:39.443952 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Sep 23 04:59:39.443952 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:59:39.447739 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ebbcd314-fb2b-41ff-8deb-68de352fdaeb tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:59:39.449113 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ebbcd314-fb2b-41ff-8deb-68de352fdaeb tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] 10.222.0.33 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.024105 Sep 23 04:59:39.449264 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2959/5761] 10.222.0.33 () {58 vars in 1142 bytes} [Fri Sep 23 04:59:39 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 04:59:39.459015 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-bf31c07a-0d00-4777-94bb-1b75fa623aa6 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:39.472702 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-bf31c07a-0d00-4777-94bb-1b75fa623aa6 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Request method failure captured: Sep 23 04:59:39.472702 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Sep 23 04:59:39.472702 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:59:39.472702 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:59:39.472702 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:59:39.472702 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:59:39.472702 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:59:39.472702 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:59:39.472702 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:59:39.472702 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:59:39.472702 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLT0RQy8XnFFDqzLIQBqw5eTl_NQbd_bmWYDyRiMMs6O8XNx8ROIcyKlEonkc8ojvK89xmWZedi753D8VEH16QyPBywkueomZbkXYvKgiPdABpQ2jV2LFZtdOqVfa46zBxRUO2KIbQUCwayksMno6xYtL3NeCQSLKZq7KkFC73w-EzHc Sep 23 04:59:39.472702 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:59:39.472702 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:59:39.472702 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:59:39.472702 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:59:39.472702 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:59:39.472702 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:59:39.472702 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: fea15e730b4749698d44b143f4f3f934 Sep 23 04:59:39.472702 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ListServersNegativeTestJSON-314302562 Sep 23 04:59:39.472702 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:59:39.472702 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:59:39.472702 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fea15e730b4749698d44b143f4f3f934", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fea15e730b4749698d44b143f4f3f934"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fea15e730b4749698d44b143f4f3f934"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fea15e730b4749698d44b143f4f3f934"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:59:39.472702 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ListServersNegativeTestJSON-314302562 Sep 23 04:59:39.472702 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: fea15e730b4749698d44b143f4f3f934 Sep 23 04:59:39.472702 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-314302562 Sep 23 04:59:39.472702 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ListServersNegativeTestJSON-314302562-project Sep 23 04:59:39.472702 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:59:39.472702 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:59:39.472702 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: a9b6d10d4aa54985a0bd2a74d7602356 Sep 23 04:59:39.472702 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ListServersNegativeTestJSON-314302562-project Sep 23 04:59:39.472702 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:59:39.472702 n-d-846463-3 devstack@n-api.service[122699]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Sep 23 04:59:39.472702 n-d-846463-3 devstack@n-api.service[122699]: action_args: {} Sep 23 04:59:39.472702 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:59:39.472702 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:59:39.472702 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 23 04:59:39.472702 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 23 04:59:39.472702 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 23 04:59:39.472702 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise error Sep 23 04:59:39.472702 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Sep 23 04:59:39.472702 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:59:39.472702 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Sep 23 04:59:39.472702 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 23 04:59:39.472702 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi 'minimum': 0, Sep 23 04:59:39.472702 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 23 04:59:39.472702 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 23 04:59:39.472702 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:59:39.472702 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi On instance[0]: Sep 23 04:59:39.472702 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi 'testing' Sep 23 04:59:39.472702 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:59:39.472702 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:59:39.472702 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:59:39.472702 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:59:39.472702 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:59:39.472702 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:59:39.472702 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:59:39.472702 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:59:39.472702 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:59:39.472702 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:59:39.472702 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 23 04:59:39.472702 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:59:39.472702 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 23 04:59:39.472702 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:59:39.472702 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 23 04:59:39.472702 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 04:59:39.472702 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 23 04:59:39.472702 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Sep 23 04:59:39.472702 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Sep 23 04:59:39.477998 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 23 04:59:39.477998 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 23 04:59:39.477998 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 23 04:59:39.477998 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 23 04:59:39.477998 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Sep 23 04:59:39.477998 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:59:39.477998 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:59:39.477998 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:59:39.477998 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:59:39.477998 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:59:39.477998 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:59:39.477998 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 23 04:59:39.477998 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 23 04:59:39.477998 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Sep 23 04:59:39.477998 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:59:39.477998 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-bf31c07a-0d00-4777-94bb-1b75fa623aa6 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:59:39.477998 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-bf31c07a-0d00-4777-94bb-1b75fa623aa6 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] 10.222.0.33 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.019635 Sep 23 04:59:39.480744 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2960/5762] 10.222.0.33 () {58 vars in 1152 bytes} [Fri Sep 23 04:59:39 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 23 04:59:39.493177 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-47a17e49-6480-4e71-8c9e-56b46479a97d tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:39.503708 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-47a17e49-6480-4e71-8c9e-56b46479a97d tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a9b6d10d4aa54985a0bd2a74d7602356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea15e730b4749698d44b143f4f3f934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:39.504402 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-47a17e49-6480-4e71-8c9e-56b46479a97d tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': 'fea15e730b4749698d44b143f4f3f934'} {{(pid=122699) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 04:59:39.520696 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.compute.servers [None req-47a17e49-6480-4e71-8c9e-56b46479a97d tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Flavor 'non_existing_flavor' could not be found {{(pid=122699) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Sep 23 04:59:39.522825 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-47a17e49-6480-4e71-8c9e-56b46479a97d tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] 10.222.0.33 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.041598 Sep 23 04:59:39.524308 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2961/5763] 10.222.0.33 () {58 vars in 1178 bytes} [Fri Sep 23 04:59:39 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 04:59:39.539524 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9645a726-6674-4d4a-8400-ae55e9b34c2a tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:39.558609 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-9645a726-6674-4d4a-8400-ae55e9b34c2a tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a9b6d10d4aa54985a0bd2a74d7602356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea15e730b4749698d44b143f4f3f934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:39.559995 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-9645a726-6674-4d4a-8400-ae55e9b34c2a tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': 'fea15e730b4749698d44b143f4f3f934'} {{(pid=122699) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 04:59:39.568702 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9645a726-6674-4d4a-8400-ae55e9b34c2a tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:39.576573 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9645a726-6674-4d4a-8400-ae55e9b34c2a tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:39.577680 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9645a726-6674-4d4a-8400-ae55e9b34c2a tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:39.583050 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9645a726-6674-4d4a-8400-ae55e9b34c2a tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:39.584177 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9645a726-6674-4d4a-8400-ae55e9b34c2a tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:39.585111 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9645a726-6674-4d4a-8400-ae55e9b34c2a tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:39.640822 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-54a45269-1abd-4702-abfb-f1f3bd24610e tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a845ca1e7747fba0a987235d980098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca57a0af591a43ee9cdef09134bc3fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:39.654212 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-54a45269-1abd-4702-abfb-f1f3bd24610e tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] 10.222.0.33 "GET /compute/v2.1/servers/1d4b42f4-3285-41c7-8264-e596b9d8ac02" status: 200 len: 1314 microversion: 2.1 time: 0.593405 Sep 23 04:59:39.656148 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2803/5764] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:39 2022] GET /compute/v2.1/servers/1d4b42f4-3285-41c7-8264-e596b9d8ac02 => generated 1314 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:59:39.732309 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-9645a726-6674-4d4a-8400-ae55e9b34c2a tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] 10.222.0.33 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.197067 Sep 23 04:59:39.732914 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2962/5765] 10.222.0.33 () {58 vars in 1174 bytes} [Fri Sep 23 04:59:39 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 04:59:39.750141 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-178ff21e-9ecc-4d07-8bdb-251b7bec7a4b tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:39.756572 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-178ff21e-9ecc-4d07-8bdb-251b7bec7a4b tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a9b6d10d4aa54985a0bd2a74d7602356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea15e730b4749698d44b143f4f3f934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:39.760543 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-178ff21e-9ecc-4d07-8bdb-251b7bec7a4b tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': 'fea15e730b4749698d44b143f4f3f934'} {{(pid=122698) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 04:59:39.774586 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-178ff21e-9ecc-4d07-8bdb-251b7bec7a4b tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:39.776628 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-178ff21e-9ecc-4d07-8bdb-251b7bec7a4b tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:39.777372 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-178ff21e-9ecc-4d07-8bdb-251b7bec7a4b tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:39.779791 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-178ff21e-9ecc-4d07-8bdb-251b7bec7a4b tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:39.781920 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-178ff21e-9ecc-4d07-8bdb-251b7bec7a4b tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:39.785191 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-178ff21e-9ecc-4d07-8bdb-251b7bec7a4b tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:40.012971 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-178ff21e-9ecc-4d07-8bdb-251b7bec7a4b tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] 10.222.0.33 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.271566 Sep 23 04:59:40.013688 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2804/5766] 10.222.0.33 () {58 vars in 1184 bytes} [Fri Sep 23 04:59:39 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 23 04:59:40.027508 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e47bacd8-adc9-4e4b-b92e-71922e12f64a tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:40.034290 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e47bacd8-adc9-4e4b-b92e-71922e12f64a tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a9b6d10d4aa54985a0bd2a74d7602356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea15e730b4749698d44b143f4f3f934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:40.035104 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e47bacd8-adc9-4e4b-b92e-71922e12f64a tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Searching by: {'deleted': False, 'project_id': 'fea15e730b4749698d44b143f4f3f934'} {{(pid=122699) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 04:59:40.051151 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e47bacd8-adc9-4e4b-b92e-71922e12f64a tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:40.054385 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e47bacd8-adc9-4e4b-b92e-71922e12f64a tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:40.054930 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e47bacd8-adc9-4e4b-b92e-71922e12f64a tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:40.055762 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e47bacd8-adc9-4e4b-b92e-71922e12f64a tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:40.056243 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e47bacd8-adc9-4e4b-b92e-71922e12f64a tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:40.056243 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e47bacd8-adc9-4e4b-b92e-71922e12f64a tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:40.106733 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.multi_cell_list [None req-e47bacd8-adc9-4e4b-b92e-71922e12f64a tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122699) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 23 04:59:40.121903 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=100 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:59:40.145147 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e47bacd8-adc9-4e4b-b92e-71922e12f64a tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b6d10d4aa54985a0bd2a74d7602356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea15e730b4749698d44b143f4f3f934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:40.152283 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e47bacd8-adc9-4e4b-b92e-71922e12f64a tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:40.152756 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e47bacd8-adc9-4e4b-b92e-71922e12f64a tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:40.153419 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e47bacd8-adc9-4e4b-b92e-71922e12f64a tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:40.583055 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e47bacd8-adc9-4e4b-b92e-71922e12f64a tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] 10.222.0.33 "GET /compute/v2.1/servers/detail" status: 200 len: 3023 microversion: 2.1 time: 0.560039 Sep 23 04:59:40.584064 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2963/5767] 10.222.0.33 () {58 vars in 1146 bytes} [Fri Sep 23 04:59:40 2022] GET /compute/v2.1/servers/detail => generated 3023 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:59:40.613822 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-bb4d159b-9e20-459e-b321-19ab16484ee1 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:40.621343 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-bb4d159b-9e20-459e-b321-19ab16484ee1 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a9b6d10d4aa54985a0bd2a74d7602356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea15e730b4749698d44b143f4f3f934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:40.622705 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-bb4d159b-9e20-459e-b321-19ab16484ee1 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] 10.222.0.33 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.013767 Sep 23 04:59:40.633658 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2805/5768] 10.222.0.33 () {58 vars in 1178 bytes} [Fri Sep 23 04:59:40 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 04:59:40.638694 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2f8aff79-8614-40eb-acd1-4f98fb25132a tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:40.644581 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2f8aff79-8614-40eb-acd1-4f98fb25132a tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a9b6d10d4aa54985a0bd2a74d7602356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea15e730b4749698d44b143f4f3f934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:40.645533 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-2f8aff79-8614-40eb-acd1-4f98fb25132a tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Searching by: {'deleted': False, 'project_id': 'fea15e730b4749698d44b143f4f3f934'} {{(pid=122699) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 04:59:40.675839 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2f8aff79-8614-40eb-acd1-4f98fb25132a tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:40.677476 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2f8aff79-8614-40eb-acd1-4f98fb25132a tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:40.678211 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2f8aff79-8614-40eb-acd1-4f98fb25132a tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:40.679225 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f8ebe0f7-52f5-479b-947a-8244657915db tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:40.679854 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f8ebe0f7-52f5-479b-947a-8244657915db tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] [instance: 1d4b42f4-3285-41c7-8264-e596b9d8ac02] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:40.680785 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2f8aff79-8614-40eb-acd1-4f98fb25132a tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:40.682703 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2f8aff79-8614-40eb-acd1-4f98fb25132a tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:40.683823 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2f8aff79-8614-40eb-acd1-4f98fb25132a tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:40.694330 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f8ebe0f7-52f5-479b-947a-8244657915db tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:40.694853 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f8ebe0f7-52f5-479b-947a-8244657915db tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:40.695306 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f8ebe0f7-52f5-479b-947a-8244657915db tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:40.696030 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f8ebe0f7-52f5-479b-947a-8244657915db tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:40.696494 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f8ebe0f7-52f5-479b-947a-8244657915db tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:40.697442 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f8ebe0f7-52f5-479b-947a-8244657915db tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:40.749258 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.multi_cell_list [None req-2f8aff79-8614-40eb-acd1-4f98fb25132a tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122699) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 23 04:59:40.824346 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2f8aff79-8614-40eb-acd1-4f98fb25132a tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.191560 Sep 23 04:59:40.835583 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2964/5769] 10.222.0.33 () {58 vars in 1125 bytes} [Fri Sep 23 04:59:40 2022] GET /compute/v2.1/servers => generated 681 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:59:40.859079 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8bb55594-6f79-4c26-a7fb-eaac203b438c tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:40.859818 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-8bb55594-6f79-4c26-a7fb-eaac203b438c tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] [instance: b66d0d2e-8333-4bee-a062-21f3ad2cbdb2] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:40.886768 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8bb55594-6f79-4c26-a7fb-eaac203b438c tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:40.887266 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8bb55594-6f79-4c26-a7fb-eaac203b438c tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:40.887910 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8bb55594-6f79-4c26-a7fb-eaac203b438c tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:40.888829 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8bb55594-6f79-4c26-a7fb-eaac203b438c tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:40.889439 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8bb55594-6f79-4c26-a7fb-eaac203b438c tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:40.890328 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8bb55594-6f79-4c26-a7fb-eaac203b438c tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:40.909444 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-8bb55594-6f79-4c26-a7fb-eaac203b438c tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] HTTP exception thrown: Instance b66d0d2e-8333-4bee-a062-21f3ad2cbdb2 could not be found. Sep 23 04:59:40.911356 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8bb55594-6f79-4c26-a7fb-eaac203b438c tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Request method failure captured: Sep 23 04:59:40.911356 n-d-846463-3 devstack@n-api.service[122699]: request: DELETE /compute/v2.1/servers/b66d0d2e-8333-4bee-a062-21f3ad2cbdb2 HTTP/1.1 Sep 23 04:59:40.911356 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:59:40.911356 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:59:40.911356 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:59:40.911356 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:59:40.911356 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:59:40.911356 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:59:40.911356 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:59:40.911356 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:59:40.911356 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLT0RQy8XnFFDqzLIQBqw5eTl_NQbd_bmWYDyRiMMs6O8XNx8ROIcyKlEonkc8ojvK89xmWZedi753D8VEH16QyPBywkueomZbkXYvKgiPdABpQ2jV2LFZtdOqVfa46zBxRUO2KIbQUCwayksMno6xYtL3NeCQSLKZq7KkFC73w-EzHc Sep 23 04:59:40.911356 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:59:40.911356 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:59:40.911356 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:59:40.911356 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:59:40.911356 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:59:40.911356 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:59:40.911356 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: fea15e730b4749698d44b143f4f3f934 Sep 23 04:59:40.911356 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ListServersNegativeTestJSON-314302562 Sep 23 04:59:40.911356 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:59:40.911356 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:59:40.911356 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fea15e730b4749698d44b143f4f3f934", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fea15e730b4749698d44b143f4f3f934"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fea15e730b4749698d44b143f4f3f934"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fea15e730b4749698d44b143f4f3f934"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:59:40.911356 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ListServersNegativeTestJSON-314302562 Sep 23 04:59:40.911356 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: fea15e730b4749698d44b143f4f3f934 Sep 23 04:59:40.911356 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-314302562 Sep 23 04:59:40.911356 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ListServersNegativeTestJSON-314302562-project Sep 23 04:59:40.911356 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:59:40.911356 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:59:40.911356 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: a9b6d10d4aa54985a0bd2a74d7602356 Sep 23 04:59:40.911356 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ListServersNegativeTestJSON-314302562-project Sep 23 04:59:40.911356 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:59:40.911356 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance b66d0d2e-8333-4bee-a062-21f3ad2cbdb2 could not be found. Sep 23 04:59:40.911356 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': 'b66d0d2e-8333-4bee-a062-21f3ad2cbdb2'} Sep 23 04:59:40.911356 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:59:40.911356 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:59:40.911356 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:59:40.911356 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:59:40.911356 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:59:40.911356 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:59:40.911356 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:59:40.911356 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:59:40.911356 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:59:40.911356 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:59:40.911356 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b66d0d2e-8333-4bee-a062-21f3ad2cbdb2 could not be found. Sep 23 04:59:40.911356 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:59:40.911356 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:59:40.911356 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:59:40.911356 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:59:40.911356 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:59:40.911356 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:59:40.911356 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:59:40.911356 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:59:40.911356 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:59:40.911356 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:59:40.911356 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 04:59:40.911356 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 04:59:40.911356 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 04:59:40.911356 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 04:59:40.911356 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:59:40.911356 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:59:40.911356 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:59:40.911356 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:59:40.915942 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b66d0d2e-8333-4bee-a062-21f3ad2cbdb2 could not be found. Sep 23 04:59:40.915942 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:59:40.915942 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:59:40.915942 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:59:40.915942 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:59:40.915942 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:59:40.915942 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:59:40.915942 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:59:40.915942 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:59:40.915942 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b66d0d2e-8333-4bee-a062-21f3ad2cbdb2 could not be found. Sep 23 04:59:40.915942 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:59:40.920369 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8bb55594-6f79-4c26-a7fb-eaac203b438c tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Returning 404 to user: Instance b66d0d2e-8333-4bee-a062-21f3ad2cbdb2 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:59:40.921476 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-8bb55594-6f79-4c26-a7fb-eaac203b438c tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b66d0d2e-8333-4bee-a062-21f3ad2cbdb2" status: 404 len: 111 microversion: 2.1 time: 0.083926 Sep 23 04:59:40.922291 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2965/5770] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:59:40 2022] DELETE /compute/v2.1/servers/b66d0d2e-8333-4bee-a062-21f3ad2cbdb2 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:59:40.932721 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d43d8e4e-272c-4963-bbb9-21d6af96a043 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:40.933505 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d43d8e4e-272c-4963-bbb9-21d6af96a043 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] [instance: 818fa1c2-6041-4fda-baad-85c648e340f5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:40.949243 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d43d8e4e-272c-4963-bbb9-21d6af96a043 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:40.950431 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d43d8e4e-272c-4963-bbb9-21d6af96a043 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:40.951043 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d43d8e4e-272c-4963-bbb9-21d6af96a043 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:40.951918 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d43d8e4e-272c-4963-bbb9-21d6af96a043 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:40.952528 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d43d8e4e-272c-4963-bbb9-21d6af96a043 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:40.953131 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d43d8e4e-272c-4963-bbb9-21d6af96a043 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:41.026339 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d43d8e4e-272c-4963-bbb9-21d6af96a043 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] [instance: 818fa1c2-6041-4fda-baad-85c648e340f5] Going to try to terminate instance {{(pid=122699) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:59:41.240853 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f8ebe0f7-52f5-479b-947a-8244657915db tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a845ca1e7747fba0a987235d980098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca57a0af591a43ee9cdef09134bc3fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:41.242358 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f8ebe0f7-52f5-479b-947a-8244657915db tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] 10.222.0.33 "GET /compute/v2.1/servers/1d4b42f4-3285-41c7-8264-e596b9d8ac02" status: 200 len: 1314 microversion: 2.1 time: 0.567937 Sep 23 04:59:41.243848 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2806/5771] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:40 2022] GET /compute/v2.1/servers/1d4b42f4-3285-41c7-8264-e596b9d8ac02 => generated 1314 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:59:41.442831 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d43d8e4e-272c-4963-bbb9-21d6af96a043 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] 10.222.0.33 "DELETE /compute/v2.1/servers/818fa1c2-6041-4fda-baad-85c648e340f5" status: 204 len: 0 microversion: 2.1 time: 0.513963 Sep 23 04:59:41.444418 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2966/5772] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:59:40 2022] DELETE /compute/v2.1/servers/818fa1c2-6041-4fda-baad-85c648e340f5 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:59:41.453937 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1fe31406-6500-4d43-8ae7-cb1fe3f3543f tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:41.456015 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1fe31406-6500-4d43-8ae7-cb1fe3f3543f tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] [instance: 325789fb-b74f-4a9a-a273-575a7366659d] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:41.473222 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1fe31406-6500-4d43-8ae7-cb1fe3f3543f tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:41.475943 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1fe31406-6500-4d43-8ae7-cb1fe3f3543f tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:41.478796 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1fe31406-6500-4d43-8ae7-cb1fe3f3543f tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:41.479780 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1fe31406-6500-4d43-8ae7-cb1fe3f3543f tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:41.480666 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1fe31406-6500-4d43-8ae7-cb1fe3f3543f tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:41.481018 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1fe31406-6500-4d43-8ae7-cb1fe3f3543f tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:41.497425 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6433b740-d0fa-4543-af3c-de0732753f55 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-816711064", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "networks": [{"uuid": "e3b3bb72-5f4a-422c-85cf-20c498686750"}]}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:59:41.515370 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1fe31406-6500-4d43-8ae7-cb1fe3f3543f tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] [instance: 325789fb-b74f-4a9a-a273-575a7366659d] Going to try to terminate instance {{(pid=122699) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 04:59:41.599427 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.network.neutron [None req-6433b740-d0fa-4543-af3c-de0732753f55 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] validate_networks() for [('e3b3bb72-5f4a-422c-85cf-20c498686750', None, None, None, None, None)] {{(pid=122698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 04:59:41.940551 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1fe31406-6500-4d43-8ae7-cb1fe3f3543f tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] 10.222.0.33 "DELETE /compute/v2.1/servers/325789fb-b74f-4a9a-a273-575a7366659d" status: 204 len: 0 microversion: 2.1 time: 0.490646 Sep 23 04:59:41.943786 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2967/5773] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 04:59:41 2022] DELETE /compute/v2.1/servers/325789fb-b74f-4a9a-a273-575a7366659d => generated 0 bytes in 493 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 04:59:41.953757 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d3bd62f2-74d1-42ba-81cb-d66a62fc3478 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:41.954777 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d3bd62f2-74d1-42ba-81cb-d66a62fc3478 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] [instance: b66d0d2e-8333-4bee-a062-21f3ad2cbdb2] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:41.962371 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d3bd62f2-74d1-42ba-81cb-d66a62fc3478 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:41.966690 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d3bd62f2-74d1-42ba-81cb-d66a62fc3478 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:41.966690 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d3bd62f2-74d1-42ba-81cb-d66a62fc3478 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:41.966690 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d3bd62f2-74d1-42ba-81cb-d66a62fc3478 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:41.966690 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d3bd62f2-74d1-42ba-81cb-d66a62fc3478 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:41.966690 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d3bd62f2-74d1-42ba-81cb-d66a62fc3478 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:41.990683 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-d3bd62f2-74d1-42ba-81cb-d66a62fc3478 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] HTTP exception thrown: Instance b66d0d2e-8333-4bee-a062-21f3ad2cbdb2 could not be found. Sep 23 04:59:41.995662 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d3bd62f2-74d1-42ba-81cb-d66a62fc3478 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Request method failure captured: Sep 23 04:59:41.995662 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/b66d0d2e-8333-4bee-a062-21f3ad2cbdb2 HTTP/1.1 Sep 23 04:59:41.995662 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:59:41.995662 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:59:41.995662 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:59:41.995662 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:59:41.995662 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:59:41.995662 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:59:41.995662 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:59:41.995662 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:59:41.995662 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLT0RQy8XnFFDqzLIQBqw5eTl_NQbd_bmWYDyRiMMs6O8XNx8ROIcyKlEonkc8ojvK89xmWZedi753D8VEH16QyPBywkueomZbkXYvKgiPdABpQ2jV2LFZtdOqVfa46zBxRUO2KIbQUCwayksMno6xYtL3NeCQSLKZq7KkFC73w-EzHc Sep 23 04:59:41.995662 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:59:41.995662 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:59:41.995662 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:59:41.995662 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:59:41.995662 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:59:41.995662 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:59:41.995662 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: fea15e730b4749698d44b143f4f3f934 Sep 23 04:59:41.995662 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ListServersNegativeTestJSON-314302562 Sep 23 04:59:41.995662 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:59:41.995662 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:59:41.995662 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fea15e730b4749698d44b143f4f3f934", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fea15e730b4749698d44b143f4f3f934"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fea15e730b4749698d44b143f4f3f934"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fea15e730b4749698d44b143f4f3f934"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:59:41.995662 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ListServersNegativeTestJSON-314302562 Sep 23 04:59:41.995662 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: fea15e730b4749698d44b143f4f3f934 Sep 23 04:59:41.995662 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-314302562 Sep 23 04:59:41.995662 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ListServersNegativeTestJSON-314302562-project Sep 23 04:59:41.995662 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:59:41.995662 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:59:41.995662 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: a9b6d10d4aa54985a0bd2a74d7602356 Sep 23 04:59:41.995662 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ListServersNegativeTestJSON-314302562-project Sep 23 04:59:41.995662 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:59:41.995662 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance b66d0d2e-8333-4bee-a062-21f3ad2cbdb2 could not be found. Sep 23 04:59:41.995662 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': 'b66d0d2e-8333-4bee-a062-21f3ad2cbdb2'} Sep 23 04:59:41.995662 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:59:41.995662 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:59:41.995662 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:59:41.995662 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:59:41.995662 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:59:41.995662 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:59:41.995662 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:59:41.995662 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:59:41.995662 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:59:41.995662 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:59:41.995662 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b66d0d2e-8333-4bee-a062-21f3ad2cbdb2 could not be found. Sep 23 04:59:41.995662 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:59:41.995662 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:59:41.995662 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:59:41.995662 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:59:41.995662 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:59:41.995662 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:59:41.995662 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:59:41.995662 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:59:41.995662 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:59:41.995662 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:59:41.995662 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:59:41.995662 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:59:41.995662 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:59:41.995662 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:59:41.995662 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:59:41.995662 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:59:41.995662 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b66d0d2e-8333-4bee-a062-21f3ad2cbdb2 could not be found. Sep 23 04:59:41.995662 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:59:41.995662 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:59:41.999492 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:59:41.999492 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:59:41.999492 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:59:41.999492 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:59:41.999492 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:59:41.999492 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:59:41.999492 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b66d0d2e-8333-4bee-a062-21f3ad2cbdb2 could not be found. Sep 23 04:59:41.999492 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:59:41.999492 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d3bd62f2-74d1-42ba-81cb-d66a62fc3478 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Returning 404 to user: Instance b66d0d2e-8333-4bee-a062-21f3ad2cbdb2 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:59:41.999492 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d3bd62f2-74d1-42ba-81cb-d66a62fc3478 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] 10.222.0.33 "GET /compute/v2.1/servers/b66d0d2e-8333-4bee-a062-21f3ad2cbdb2" status: 404 len: 111 microversion: 2.1 time: 0.048134 Sep 23 04:59:41.999492 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2968/5774] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:41 2022] GET /compute/v2.1/servers/b66d0d2e-8333-4bee-a062-21f3ad2cbdb2 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:59:42.005019 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8526193f-3712-4fb0-aad7-2a740b446d5c tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:42.005631 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-8526193f-3712-4fb0-aad7-2a740b446d5c tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] [instance: 818fa1c2-6041-4fda-baad-85c648e340f5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:42.013948 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8526193f-3712-4fb0-aad7-2a740b446d5c tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:42.018755 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8526193f-3712-4fb0-aad7-2a740b446d5c tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:42.018755 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8526193f-3712-4fb0-aad7-2a740b446d5c tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:42.018755 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8526193f-3712-4fb0-aad7-2a740b446d5c tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:42.018755 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8526193f-3712-4fb0-aad7-2a740b446d5c tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:42.018755 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8526193f-3712-4fb0-aad7-2a740b446d5c tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:42.437386 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-8526193f-3712-4fb0-aad7-2a740b446d5c tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b6d10d4aa54985a0bd2a74d7602356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea15e730b4749698d44b143f4f3f934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:42.445225 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-8526193f-3712-4fb0-aad7-2a740b446d5c tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] 10.222.0.33 "GET /compute/v2.1/servers/818fa1c2-6041-4fda-baad-85c648e340f5" status: 200 len: 1521 microversion: 2.1 time: 0.445396 Sep 23 04:59:42.446604 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2969/5775] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:41 2022] GET /compute/v2.1/servers/818fa1c2-6041-4fda-baad-85c648e340f5 => generated 1521 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:59:42.469728 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-34feb9a1-7b48-4eca-936f-2789c2526d8d tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:42.470375 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-34feb9a1-7b48-4eca-936f-2789c2526d8d tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] [instance: 1d4b42f4-3285-41c7-8264-e596b9d8ac02] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:42.489703 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-34feb9a1-7b48-4eca-936f-2789c2526d8d tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:42.490499 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-34feb9a1-7b48-4eca-936f-2789c2526d8d tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:42.491119 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-34feb9a1-7b48-4eca-936f-2789c2526d8d tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:42.492005 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-34feb9a1-7b48-4eca-936f-2789c2526d8d tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:42.492626 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-34feb9a1-7b48-4eca-936f-2789c2526d8d tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:42.493213 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-34feb9a1-7b48-4eca-936f-2789c2526d8d tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:42.523888 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-6433b740-d0fa-4543-af3c-de0732753f55 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Flavor limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 04:59:42.524429 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-6433b740-d0fa-4543-af3c-de0732753f55 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Image limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 04:59:42.526275 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-6433b740-d0fa-4543-af3c-de0732753f55 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Flavor pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 04:59:42.538821 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-6433b740-d0fa-4543-af3c-de0732753f55 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Image pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 04:59:42.538821 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-6433b740-d0fa-4543-af3c-de0732753f55 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 04:59:42.561513 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6433b740-d0fa-4543-af3c-de0732753f55 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:42.563837 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6433b740-d0fa-4543-af3c-de0732753f55 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:42.564382 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6433b740-d0fa-4543-af3c-de0732753f55 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:42.567000 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6433b740-d0fa-4543-af3c-de0732753f55 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:42.570530 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6433b740-d0fa-4543-af3c-de0732753f55 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:42.570530 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6433b740-d0fa-4543-af3c-de0732753f55 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:42.626109 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-6433b740-d0fa-4543-af3c-de0732753f55 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Getting quotas for project 445c2c4630a5428cb51499a0fdf170fe. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 04:59:42.649342 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-6433b740-d0fa-4543-af3c-de0732753f55 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Getting quotas for user a04cca628a834f368a96738a56dd0244 and project 445c2c4630a5428cb51499a0fdf170fe. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 04:59:42.671285 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-6433b740-d0fa-4543-af3c-de0732753f55 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Going to run 1 instances... {{(pid=122698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 04:59:42.674466 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-6433b740-d0fa-4543-af3c-de0732753f55 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] [instance: 61ca86da-7aaf-4963-8a82-28358de74ec2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 04:59:42.855288 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-34feb9a1-7b48-4eca-936f-2789c2526d8d tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a845ca1e7747fba0a987235d980098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca57a0af591a43ee9cdef09134bc3fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:42.863887 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-34feb9a1-7b48-4eca-936f-2789c2526d8d tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] 10.222.0.33 "GET /compute/v2.1/servers/1d4b42f4-3285-41c7-8264-e596b9d8ac02" status: 200 len: 1500 microversion: 2.1 time: 0.397824 Sep 23 04:59:42.865476 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2970/5776] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:42 2022] GET /compute/v2.1/servers/1d4b42f4-3285-41c7-8264-e596b9d8ac02 => generated 1500 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:59:42.901052 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3ef0a383-4117-4e85-9c3f-07e0de18594d tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:59:42.906564 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-3ef0a383-4117-4e85-9c3f-07e0de18594d tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] [instance: 1d4b42f4-3285-41c7-8264-e596b9d8ac02] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:42.918085 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3ef0a383-4117-4e85-9c3f-07e0de18594d tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:42.918595 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3ef0a383-4117-4e85-9c3f-07e0de18594d tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:42.923194 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-6433b740-d0fa-4543-af3c-de0732753f55 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.647874 Sep 23 04:59:42.924431 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2807/5777] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 04:59:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1650 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 04:59:42.936551 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0bda85bd-8a98-4d30-b250-f90059060886 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:42.937188 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-0bda85bd-8a98-4d30-b250-f90059060886 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] [instance: 61ca86da-7aaf-4963-8a82-28358de74ec2] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:42.938584 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3ef0a383-4117-4e85-9c3f-07e0de18594d tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:42.939451 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3ef0a383-4117-4e85-9c3f-07e0de18594d tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:42.939961 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3ef0a383-4117-4e85-9c3f-07e0de18594d tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:42.940422 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3ef0a383-4117-4e85-9c3f-07e0de18594d tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:43.015082 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-3ef0a383-4117-4e85-9c3f-07e0de18594d tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lazy-loading 'flavor' on Instance uuid 1d4b42f4-3285-41c7-8264-e596b9d8ac02 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:59:43.095653 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-0bda85bd-8a98-4d30-b250-f90059060886 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04cca628a834f368a96738a56dd0244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445c2c4630a5428cb51499a0fdf170fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:43.104632 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0bda85bd-8a98-4d30-b250-f90059060886 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] 10.222.0.33 "GET /compute/v2.1/servers/61ca86da-7aaf-4963-8a82-28358de74ec2" status: 200 len: 1213 microversion: 2.1 time: 0.171910 Sep 23 04:59:43.105812 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2808/5778] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:42 2022] GET /compute/v2.1/servers/61ca86da-7aaf-4963-8a82-28358de74ec2 => generated 1213 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:59:43.404490 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3ef0a383-4117-4e85-9c3f-07e0de18594d tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] 10.222.0.33 "POST /compute/v2.1/servers/1d4b42f4-3285-41c7-8264-e596b9d8ac02/action" status: 200 len: 32 microversion: 2.1 time: 0.516122 Sep 23 04:59:43.412255 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2971/5779] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 04:59:42 2022] POST /compute/v2.1/servers/1d4b42f4-3285-41c7-8264-e596b9d8ac02/action => generated 32 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 23 04:59:43.415581 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3cee3afc-7425-4f3e-b1b2-004546ce0a48 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:43.416219 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3cee3afc-7425-4f3e-b1b2-004546ce0a48 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] [instance: 1d4b42f4-3285-41c7-8264-e596b9d8ac02] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:43.427145 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3cee3afc-7425-4f3e-b1b2-004546ce0a48 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:43.428573 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3cee3afc-7425-4f3e-b1b2-004546ce0a48 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:43.429925 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3cee3afc-7425-4f3e-b1b2-004546ce0a48 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:43.431010 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3cee3afc-7425-4f3e-b1b2-004546ce0a48 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:43.431870 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3cee3afc-7425-4f3e-b1b2-004546ce0a48 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:43.432527 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3cee3afc-7425-4f3e-b1b2-004546ce0a48 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:43.473344 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-00c7c4f2-0ea3-4d6a-a03e-d8446319e155 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:43.477018 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-00c7c4f2-0ea3-4d6a-a03e-d8446319e155 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] [instance: 818fa1c2-6041-4fda-baad-85c648e340f5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:43.489868 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-00c7c4f2-0ea3-4d6a-a03e-d8446319e155 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:43.491773 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-00c7c4f2-0ea3-4d6a-a03e-d8446319e155 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:43.495790 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-00c7c4f2-0ea3-4d6a-a03e-d8446319e155 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:43.497508 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-00c7c4f2-0ea3-4d6a-a03e-d8446319e155 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:43.498359 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-00c7c4f2-0ea3-4d6a-a03e-d8446319e155 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:43.500179 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-00c7c4f2-0ea3-4d6a-a03e-d8446319e155 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:44.085133 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-3cee3afc-7425-4f3e-b1b2-004546ce0a48 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a845ca1e7747fba0a987235d980098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca57a0af591a43ee9cdef09134bc3fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:44.087720 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-00c7c4f2-0ea3-4d6a-a03e-d8446319e155 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b6d10d4aa54985a0bd2a74d7602356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea15e730b4749698d44b143f4f3f934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:44.100987 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-00c7c4f2-0ea3-4d6a-a03e-d8446319e155 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] 10.222.0.33 "GET /compute/v2.1/servers/818fa1c2-6041-4fda-baad-85c648e340f5" status: 200 len: 1521 microversion: 2.1 time: 0.631997 Sep 23 04:59:44.101934 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2972/5780] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:43 2022] GET /compute/v2.1/servers/818fa1c2-6041-4fda-baad-85c648e340f5 => generated 1521 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:59:44.110381 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3cee3afc-7425-4f3e-b1b2-004546ce0a48 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] 10.222.0.33 "GET /compute/v2.1/servers/1d4b42f4-3285-41c7-8264-e596b9d8ac02" status: 200 len: 1506 microversion: 2.1 time: 0.698622 Sep 23 04:59:44.111953 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2809/5781] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:43 2022] GET /compute/v2.1/servers/1d4b42f4-3285-41c7-8264-e596b9d8ac02 => generated 1506 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:59:44.130546 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b42a0aeb-c60b-4950-85dd-5a0b6cdacd54 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:44.131234 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b42a0aeb-c60b-4950-85dd-5a0b6cdacd54 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] [instance: 61ca86da-7aaf-4963-8a82-28358de74ec2] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:44.261820 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b42a0aeb-c60b-4950-85dd-5a0b6cdacd54 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04cca628a834f368a96738a56dd0244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445c2c4630a5428cb51499a0fdf170fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:44.270639 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b42a0aeb-c60b-4950-85dd-5a0b6cdacd54 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] 10.222.0.33 "GET /compute/v2.1/servers/61ca86da-7aaf-4963-8a82-28358de74ec2" status: 200 len: 1213 microversion: 2.1 time: 0.144123 Sep 23 04:59:44.275264 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2973/5782] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:44 2022] GET /compute/v2.1/servers/61ca86da-7aaf-4963-8a82-28358de74ec2 => generated 1213 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:59:44.490645 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-178bcf19-5883-43dd-a705-d44ffdc2fc98 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:44.490645 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-178bcf19-5883-43dd-a705-d44ffdc2fc98 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 7f05d753-e297-4330-ba02-dc0aac76de96] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:44.496606 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-2d3cde00-c282-48a3-bfbc-869d8a99a00e req-63df3b42-326f-4be7-a1ca-ae274e62de1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f05d753-e297-4330-ba02-dc0aac76de96", "tag": "9e975956-70a6-4752-9499-532298e87730"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:59:44.497538 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-178bcf19-5883-43dd-a705-d44ffdc2fc98 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:44.498228 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-178bcf19-5883-43dd-a705-d44ffdc2fc98 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:44.500090 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-178bcf19-5883-43dd-a705-d44ffdc2fc98 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:44.501009 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-178bcf19-5883-43dd-a705-d44ffdc2fc98 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:44.501824 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-178bcf19-5883-43dd-a705-d44ffdc2fc98 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:44.502453 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-178bcf19-5883-43dd-a705-d44ffdc2fc98 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:44.518364 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-2d3cde00-c282-48a3-bfbc-869d8a99a00e req-63df3b42-326f-4be7-a1ca-ae274e62de1a service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:44.522701 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-2d3cde00-c282-48a3-bfbc-869d8a99a00e req-63df3b42-326f-4be7-a1ca-ae274e62de1a service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:44.522701 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-2d3cde00-c282-48a3-bfbc-869d8a99a00e req-63df3b42-326f-4be7-a1ca-ae274e62de1a service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:44.527451 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:59:44.564278 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-2d3cde00-c282-48a3-bfbc-869d8a99a00e req-63df3b42-326f-4be7-a1ca-ae274e62de1a service nova] Creating event network-changed:9e975956-70a6-4752-9499-532298e87730 for instance 7f05d753-e297-4330-ba02-dc0aac76de96 on n-h2-846463-3 Sep 23 04:59:44.569172 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-2d3cde00-c282-48a3-bfbc-869d8a99a00e req-63df3b42-326f-4be7-a1ca-ae274e62de1a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076624 Sep 23 04:59:44.570433 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2974/5783] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:59:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:59:44.732628 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-178bcf19-5883-43dd-a705-d44ffdc2fc98 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:44.742724 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-178bcf19-5883-43dd-a705-d44ffdc2fc98 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/7f05d753-e297-4330-ba02-dc0aac76de96" status: 200 len: 1563 microversion: 2.1 time: 0.258326 Sep 23 04:59:44.743600 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2810/5784] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:44 2022] GET /compute/v2.1/servers/7f05d753-e297-4330-ba02-dc0aac76de96 => generated 1563 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:59:45.130202 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b96e7ad7-46cc-4483-a4b1-c1a2bbb81e72 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:45.145540 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-71b580f3-49c4-4533-98b6-38f11894a22a tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:45.148165 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-71b580f3-49c4-4533-98b6-38f11894a22a tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] [instance: 1d4b42f4-3285-41c7-8264-e596b9d8ac02] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:45.155104 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b96e7ad7-46cc-4483-a4b1-c1a2bbb81e72 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] [instance: 818fa1c2-6041-4fda-baad-85c648e340f5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:45.198878 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:59:45.224321 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-71b580f3-49c4-4533-98b6-38f11894a22a tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:45.227367 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b96e7ad7-46cc-4483-a4b1-c1a2bbb81e72 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:45.229507 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-71b580f3-49c4-4533-98b6-38f11894a22a tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:45.230210 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b96e7ad7-46cc-4483-a4b1-c1a2bbb81e72 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:45.230689 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b96e7ad7-46cc-4483-a4b1-c1a2bbb81e72 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:45.234125 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-71b580f3-49c4-4533-98b6-38f11894a22a tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:45.240377 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-71b580f3-49c4-4533-98b6-38f11894a22a tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:45.242857 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-71b580f3-49c4-4533-98b6-38f11894a22a tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:45.243380 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-71b580f3-49c4-4533-98b6-38f11894a22a tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:45.245334 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b96e7ad7-46cc-4483-a4b1-c1a2bbb81e72 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:45.245877 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b96e7ad7-46cc-4483-a4b1-c1a2bbb81e72 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:45.246430 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b96e7ad7-46cc-4483-a4b1-c1a2bbb81e72 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:45.681851 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b96e7ad7-46cc-4483-a4b1-c1a2bbb81e72 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b6d10d4aa54985a0bd2a74d7602356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea15e730b4749698d44b143f4f3f934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:45.699582 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b96e7ad7-46cc-4483-a4b1-c1a2bbb81e72 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] 10.222.0.33 "GET /compute/v2.1/servers/818fa1c2-6041-4fda-baad-85c648e340f5" status: 200 len: 1521 microversion: 2.1 time: 0.576290 Sep 23 04:59:45.714791 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2975/5785] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:45 2022] GET /compute/v2.1/servers/818fa1c2-6041-4fda-baad-85c648e340f5 => generated 1521 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:59:45.721333 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1051978b-05c4-4a74-ab43-5c89809fd9d1 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:45.728638 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1051978b-05c4-4a74-ab43-5c89809fd9d1 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] [instance: 61ca86da-7aaf-4963-8a82-28358de74ec2] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:45.730135 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1051978b-05c4-4a74-ab43-5c89809fd9d1 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:45.730748 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1051978b-05c4-4a74-ab43-5c89809fd9d1 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:45.731290 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1051978b-05c4-4a74-ab43-5c89809fd9d1 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:45.732310 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1051978b-05c4-4a74-ab43-5c89809fd9d1 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:45.732996 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1051978b-05c4-4a74-ab43-5c89809fd9d1 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:45.733640 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1051978b-05c4-4a74-ab43-5c89809fd9d1 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:45.860058 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1051978b-05c4-4a74-ab43-5c89809fd9d1 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04cca628a834f368a96738a56dd0244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445c2c4630a5428cb51499a0fdf170fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:45.864567 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:59:45.870828 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1051978b-05c4-4a74-ab43-5c89809fd9d1 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] 10.222.0.33 "GET /compute/v2.1/servers/61ca86da-7aaf-4963-8a82-28358de74ec2" status: 200 len: 1265 microversion: 2.1 time: 0.154659 Sep 23 04:59:45.871900 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2976/5786] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:45 2022] GET /compute/v2.1/servers/61ca86da-7aaf-4963-8a82-28358de74ec2 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:59:45.892898 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-71b580f3-49c4-4533-98b6-38f11894a22a tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a845ca1e7747fba0a987235d980098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca57a0af591a43ee9cdef09134bc3fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:45.905632 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-71b580f3-49c4-4533-98b6-38f11894a22a tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] 10.222.0.33 "GET /compute/v2.1/servers/1d4b42f4-3285-41c7-8264-e596b9d8ac02" status: 200 len: 1506 microversion: 2.1 time: 0.769793 Sep 23 04:59:45.907981 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2811/5787] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:45 2022] GET /compute/v2.1/servers/1d4b42f4-3285-41c7-8264-e596b9d8ac02 => generated 1506 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:59:46.105665 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-f0769366-8949-480a-a171-194d6ebc0456 req-fffc740f-29be-41f4-873a-50f1a63aaa2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "818fa1c2-6041-4fda-baad-85c648e340f5", "name": "network-vif-deleted", "tag": "21b46ece-5736-4fe1-9c42-eff5474fadb4"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:59:46.120143 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-f0769366-8949-480a-a171-194d6ebc0456 req-fffc740f-29be-41f4-873a-50f1a63aaa2d service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:46.120924 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-f0769366-8949-480a-a171-194d6ebc0456 req-fffc740f-29be-41f4-873a-50f1a63aaa2d service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:46.122984 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-f0769366-8949-480a-a171-194d6ebc0456 req-fffc740f-29be-41f4-873a-50f1a63aaa2d service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:46.158789 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-f0769366-8949-480a-a171-194d6ebc0456 req-fffc740f-29be-41f4-873a-50f1a63aaa2d service nova] Creating event network-vif-deleted:21b46ece-5736-4fe1-9c42-eff5474fadb4 for instance 818fa1c2-6041-4fda-baad-85c648e340f5 on n-h1-846463-3 Sep 23 04:59:46.169502 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-f0769366-8949-480a-a171-194d6ebc0456 req-fffc740f-29be-41f4-873a-50f1a63aaa2d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067641 Sep 23 04:59:46.170528 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2977/5788] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:59:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:59:46.728921 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-daa7f821-fed5-4b75-9e81-66b6e38ecdb5 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:46.730300 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-daa7f821-fed5-4b75-9e81-66b6e38ecdb5 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] [instance: 818fa1c2-6041-4fda-baad-85c648e340f5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:46.747907 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-daa7f821-fed5-4b75-9e81-66b6e38ecdb5 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:46.748426 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-daa7f821-fed5-4b75-9e81-66b6e38ecdb5 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:46.748874 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-daa7f821-fed5-4b75-9e81-66b6e38ecdb5 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:46.752332 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-daa7f821-fed5-4b75-9e81-66b6e38ecdb5 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:46.754092 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-daa7f821-fed5-4b75-9e81-66b6e38ecdb5 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:46.766941 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-daa7f821-fed5-4b75-9e81-66b6e38ecdb5 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:46.896858 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-daa7f821-fed5-4b75-9e81-66b6e38ecdb5 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:46.897345 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d4e6523d-83b9-4086-85ee-a1ba07a3e64c tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:46.898462 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-daa7f821-fed5-4b75-9e81-66b6e38ecdb5 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:46.898928 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-daa7f821-fed5-4b75-9e81-66b6e38ecdb5 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:46.901379 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-daa7f821-fed5-4b75-9e81-66b6e38ecdb5 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lazy-loading 'fault' on Instance uuid 818fa1c2-6041-4fda-baad-85c648e340f5 {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 04:59:46.901761 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d4e6523d-83b9-4086-85ee-a1ba07a3e64c tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] [instance: 61ca86da-7aaf-4963-8a82-28358de74ec2] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:46.927731 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d4e6523d-83b9-4086-85ee-a1ba07a3e64c tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:46.928864 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d4e6523d-83b9-4086-85ee-a1ba07a3e64c tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:46.929496 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d4e6523d-83b9-4086-85ee-a1ba07a3e64c tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:46.930623 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d4e6523d-83b9-4086-85ee-a1ba07a3e64c tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:46.931308 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d4e6523d-83b9-4086-85ee-a1ba07a3e64c tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:46.931900 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d4e6523d-83b9-4086-85ee-a1ba07a3e64c tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:47.074496 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-daa7f821-fed5-4b75-9e81-66b6e38ecdb5 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9b6d10d4aa54985a0bd2a74d7602356', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea15e730b4749698d44b143f4f3f934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:47.085653 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-daa7f821-fed5-4b75-9e81-66b6e38ecdb5 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] 10.222.0.33 "GET /compute/v2.1/servers/818fa1c2-6041-4fda-baad-85c648e340f5" status: 200 len: 1312 microversion: 2.1 time: 0.361301 Sep 23 04:59:47.087048 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2812/5789] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:46 2022] GET /compute/v2.1/servers/818fa1c2-6041-4fda-baad-85c648e340f5 => generated 1312 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:59:47.104115 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-78d47fc8-2cf4-44ab-81e6-baa3e6c16e68 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:47.107432 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-78d47fc8-2cf4-44ab-81e6-baa3e6c16e68 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] [instance: 1d4b42f4-3285-41c7-8264-e596b9d8ac02] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:47.115376 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-78d47fc8-2cf4-44ab-81e6-baa3e6c16e68 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:47.115889 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-78d47fc8-2cf4-44ab-81e6-baa3e6c16e68 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:47.116344 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-78d47fc8-2cf4-44ab-81e6-baa3e6c16e68 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:47.121543 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-78d47fc8-2cf4-44ab-81e6-baa3e6c16e68 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:47.122014 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-78d47fc8-2cf4-44ab-81e6-baa3e6c16e68 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:47.122478 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-78d47fc8-2cf4-44ab-81e6-baa3e6c16e68 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:47.312104 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d4e6523d-83b9-4086-85ee-a1ba07a3e64c tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04cca628a834f368a96738a56dd0244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445c2c4630a5428cb51499a0fdf170fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:47.323705 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d4e6523d-83b9-4086-85ee-a1ba07a3e64c tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] 10.222.0.33 "GET /compute/v2.1/servers/61ca86da-7aaf-4963-8a82-28358de74ec2" status: 200 len: 1283 microversion: 2.1 time: 0.431164 Sep 23 04:59:47.354546 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2978/5790] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:46 2022] GET /compute/v2.1/servers/61ca86da-7aaf-4963-8a82-28358de74ec2 => generated 1283 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:59:47.751674 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-78d47fc8-2cf4-44ab-81e6-baa3e6c16e68 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a845ca1e7747fba0a987235d980098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca57a0af591a43ee9cdef09134bc3fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:47.766369 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-78d47fc8-2cf4-44ab-81e6-baa3e6c16e68 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] 10.222.0.33 "GET /compute/v2.1/servers/1d4b42f4-3285-41c7-8264-e596b9d8ac02" status: 200 len: 1506 microversion: 2.1 time: 0.677543 Sep 23 04:59:47.767330 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2813/5791] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:47 2022] GET /compute/v2.1/servers/1d4b42f4-3285-41c7-8264-e596b9d8ac02 => generated 1506 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:59:48.116946 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-29b8181c-e521-43f1-9e1c-93758d9cfc23 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:48.118596 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-29b8181c-e521-43f1-9e1c-93758d9cfc23 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] [instance: 818fa1c2-6041-4fda-baad-85c648e340f5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:48.133664 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-29b8181c-e521-43f1-9e1c-93758d9cfc23 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:48.135110 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-29b8181c-e521-43f1-9e1c-93758d9cfc23 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:48.138019 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-29b8181c-e521-43f1-9e1c-93758d9cfc23 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:48.138940 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-29b8181c-e521-43f1-9e1c-93758d9cfc23 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:48.140844 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-29b8181c-e521-43f1-9e1c-93758d9cfc23 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:48.141305 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-29b8181c-e521-43f1-9e1c-93758d9cfc23 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:48.181065 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-29b8181c-e521-43f1-9e1c-93758d9cfc23 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] HTTP exception thrown: Instance 818fa1c2-6041-4fda-baad-85c648e340f5 could not be found. Sep 23 04:59:48.183564 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-29b8181c-e521-43f1-9e1c-93758d9cfc23 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Request method failure captured: Sep 23 04:59:48.183564 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/818fa1c2-6041-4fda-baad-85c648e340f5 HTTP/1.1 Sep 23 04:59:48.183564 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 04:59:48.183564 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 04:59:48.183564 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 04:59:48.183564 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 04:59:48.183564 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 04:59:48.183564 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 04:59:48.183564 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 04:59:48.183564 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 04:59:48.183564 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLT0RQy8XnFFDqzLIQBqw5eTl_NQbd_bmWYDyRiMMs6O8XNx8ROIcyKlEonkc8ojvK89xmWZedi753D8VEH16QyPBywkueomZbkXYvKgiPdABpQ2jV2LFZtdOqVfa46zBxRUO2KIbQUCwayksMno6xYtL3NeCQSLKZq7KkFC73w-EzHc Sep 23 04:59:48.183564 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 04:59:48.183564 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 04:59:48.183564 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 04:59:48.183564 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 04:59:48.183564 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 04:59:48.183564 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 04:59:48.183564 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: fea15e730b4749698d44b143f4f3f934 Sep 23 04:59:48.183564 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ListServersNegativeTestJSON-314302562 Sep 23 04:59:48.183564 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 04:59:48.183564 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 04:59:48.183564 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fea15e730b4749698d44b143f4f3f934", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fea15e730b4749698d44b143f4f3f934"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fea15e730b4749698d44b143f4f3f934"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fea15e730b4749698d44b143f4f3f934"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:59:48.183564 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ListServersNegativeTestJSON-314302562 Sep 23 04:59:48.183564 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: fea15e730b4749698d44b143f4f3f934 Sep 23 04:59:48.183564 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-314302562 Sep 23 04:59:48.183564 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ListServersNegativeTestJSON-314302562-project Sep 23 04:59:48.183564 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 04:59:48.183564 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 04:59:48.183564 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: a9b6d10d4aa54985a0bd2a74d7602356 Sep 23 04:59:48.183564 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ListServersNegativeTestJSON-314302562-project Sep 23 04:59:48.183564 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 04:59:48.183564 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 818fa1c2-6041-4fda-baad-85c648e340f5 could not be found. Sep 23 04:59:48.183564 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '818fa1c2-6041-4fda-baad-85c648e340f5'} Sep 23 04:59:48.183564 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:59:48.183564 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:59:48.183564 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:59:48.183564 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:59:48.183564 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:59:48.183564 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:59:48.183564 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:59:48.183564 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:59:48.183564 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:59:48.183564 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:59:48.183564 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 818fa1c2-6041-4fda-baad-85c648e340f5 could not be found. Sep 23 04:59:48.183564 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:59:48.183564 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:59:48.183564 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:59:48.183564 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:59:48.183564 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:59:48.183564 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:59:48.183564 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:59:48.183564 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:59:48.183564 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:59:48.183564 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:59:48.183564 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:59:48.183564 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:59:48.183564 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:59:48.183564 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:59:48.183564 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:59:48.183564 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:59:48.183564 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 818fa1c2-6041-4fda-baad-85c648e340f5 could not be found. Sep 23 04:59:48.183564 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:59:48.183564 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:59:48.187213 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:59:48.187213 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:59:48.187213 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:59:48.187213 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:59:48.187213 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:59:48.187213 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:59:48.187213 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 818fa1c2-6041-4fda-baad-85c648e340f5 could not be found. Sep 23 04:59:48.187213 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 04:59:48.188499 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-29b8181c-e521-43f1-9e1c-93758d9cfc23 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Returning 404 to user: Instance 818fa1c2-6041-4fda-baad-85c648e340f5 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:59:48.189524 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-29b8181c-e521-43f1-9e1c-93758d9cfc23 tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] 10.222.0.33 "GET /compute/v2.1/servers/818fa1c2-6041-4fda-baad-85c648e340f5" status: 404 len: 111 microversion: 2.1 time: 0.077861 Sep 23 04:59:48.190342 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2979/5792] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:48 2022] GET /compute/v2.1/servers/818fa1c2-6041-4fda-baad-85c648e340f5 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:59:48.207854 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-baf91674-f8c4-4658-9e89-06e4d6bfe64b tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:48.207854 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-baf91674-f8c4-4658-9e89-06e4d6bfe64b tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] [instance: 325789fb-b74f-4a9a-a273-575a7366659d] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:48.209959 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-baf91674-f8c4-4658-9e89-06e4d6bfe64b tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:48.210953 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-baf91674-f8c4-4658-9e89-06e4d6bfe64b tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:48.211413 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-baf91674-f8c4-4658-9e89-06e4d6bfe64b tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:48.212806 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-baf91674-f8c4-4658-9e89-06e4d6bfe64b tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:48.213414 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-baf91674-f8c4-4658-9e89-06e4d6bfe64b tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:48.213957 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-baf91674-f8c4-4658-9e89-06e4d6bfe64b tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:48.247506 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-715a74f8-4d3b-4ca1-ba55-46984c073457 req-490f0916-8b73-41ea-a744-5231b7e165cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "325789fb-b74f-4a9a-a273-575a7366659d", "name": "network-vif-deleted", "tag": "7fd03a86-c81a-40da-a096-c9a56d2ed1a6"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:59:48.253638 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:59:48.261393 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-baf91674-f8c4-4658-9e89-06e4d6bfe64b tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] HTTP exception thrown: Instance 325789fb-b74f-4a9a-a273-575a7366659d could not be found. Sep 23 04:59:48.268736 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-715a74f8-4d3b-4ca1-ba55-46984c073457 req-490f0916-8b73-41ea-a744-5231b7e165cf service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:48.269579 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-715a74f8-4d3b-4ca1-ba55-46984c073457 req-490f0916-8b73-41ea-a744-5231b7e165cf service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:48.269730 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-baf91674-f8c4-4658-9e89-06e4d6bfe64b tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Request method failure captured: Sep 23 04:59:48.269730 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/325789fb-b74f-4a9a-a273-575a7366659d HTTP/1.1 Sep 23 04:59:48.269730 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 04:59:48.269730 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 04:59:48.269730 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 04:59:48.269730 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 04:59:48.269730 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 04:59:48.269730 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 04:59:48.269730 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 04:59:48.269730 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 04:59:48.269730 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLT0RQy8XnFFDqzLIQBqw5eTl_NQbd_bmWYDyRiMMs6O8XNx8ROIcyKlEonkc8ojvK89xmWZedi753D8VEH16QyPBywkueomZbkXYvKgiPdABpQ2jV2LFZtdOqVfa46zBxRUO2KIbQUCwayksMno6xYtL3NeCQSLKZq7KkFC73w-EzHc Sep 23 04:59:48.269730 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 04:59:48.269730 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 04:59:48.269730 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 04:59:48.269730 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 04:59:48.269730 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 04:59:48.269730 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 04:59:48.269730 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: fea15e730b4749698d44b143f4f3f934 Sep 23 04:59:48.269730 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ListServersNegativeTestJSON-314302562 Sep 23 04:59:48.269730 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 04:59:48.269730 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 04:59:48.269730 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fea15e730b4749698d44b143f4f3f934", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fea15e730b4749698d44b143f4f3f934"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fea15e730b4749698d44b143f4f3f934"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fea15e730b4749698d44b143f4f3f934"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 04:59:48.269730 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ListServersNegativeTestJSON-314302562 Sep 23 04:59:48.269730 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: fea15e730b4749698d44b143f4f3f934 Sep 23 04:59:48.269730 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-314302562 Sep 23 04:59:48.269730 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ListServersNegativeTestJSON-314302562-project Sep 23 04:59:48.269730 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 04:59:48.269730 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 04:59:48.269730 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: a9b6d10d4aa54985a0bd2a74d7602356 Sep 23 04:59:48.269730 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ListServersNegativeTestJSON-314302562-project Sep 23 04:59:48.269730 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 04:59:48.269730 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 325789fb-b74f-4a9a-a273-575a7366659d could not be found. Sep 23 04:59:48.269730 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '325789fb-b74f-4a9a-a273-575a7366659d'} Sep 23 04:59:48.269730 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 04:59:48.269730 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:59:48.269730 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 04:59:48.269730 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 04:59:48.269730 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 04:59:48.269730 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 04:59:48.269730 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 04:59:48.269730 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 04:59:48.269730 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 04:59:48.269730 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 04:59:48.269730 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 325789fb-b74f-4a9a-a273-575a7366659d could not be found. Sep 23 04:59:48.269730 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:59:48.269730 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:59:48.269730 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:59:48.269730 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:59:48.269730 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:59:48.269730 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:59:48.269730 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 04:59:48.269730 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 04:59:48.269730 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 04:59:48.269730 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 04:59:48.269730 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 04:59:48.269730 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 04:59:48.269730 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 04:59:48.269730 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 04:59:48.269730 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 04:59:48.269730 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 04:59:48.269730 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 325789fb-b74f-4a9a-a273-575a7366659d could not be found. Sep 23 04:59:48.269730 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:59:48.269730 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 04:59:48.279233 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:59:48.279233 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 04:59:48.279233 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 04:59:48.279233 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 04:59:48.279233 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 04:59:48.279233 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 04:59:48.279233 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 325789fb-b74f-4a9a-a273-575a7366659d could not be found. Sep 23 04:59:48.279233 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 04:59:48.279233 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-baf91674-f8c4-4658-9e89-06e4d6bfe64b tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] Returning 404 to user: Instance 325789fb-b74f-4a9a-a273-575a7366659d could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 04:59:48.279233 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-baf91674-f8c4-4658-9e89-06e4d6bfe64b tempest-ListServersNegativeTestJSON-314302562 tempest-ListServersNegativeTestJSON-314302562-project] 10.222.0.33 "GET /compute/v2.1/servers/325789fb-b74f-4a9a-a273-575a7366659d" status: 404 len: 111 microversion: 2.1 time: 0.077715 Sep 23 04:59:48.280250 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-715a74f8-4d3b-4ca1-ba55-46984c073457 req-490f0916-8b73-41ea-a744-5231b7e165cf service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:48.280345 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2814/5793] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:48 2022] GET /compute/v2.1/servers/325789fb-b74f-4a9a-a273-575a7366659d => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 04:59:48.312917 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-715a74f8-4d3b-4ca1-ba55-46984c073457 req-490f0916-8b73-41ea-a744-5231b7e165cf service nova] Creating event network-vif-deleted:7fd03a86-c81a-40da-a096-c9a56d2ed1a6 for instance 325789fb-b74f-4a9a-a273-575a7366659d on n-h1-846463-3 Sep 23 04:59:48.339377 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-715a74f8-4d3b-4ca1-ba55-46984c073457 req-490f0916-8b73-41ea-a744-5231b7e165cf service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098813 Sep 23 04:59:48.342452 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2980/5794] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:59:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:59:48.356933 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7fe6c34b-1e78-4b7d-9881-f1f2c8fe9e6c tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:48.357559 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7fe6c34b-1e78-4b7d-9881-f1f2c8fe9e6c tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] [instance: 61ca86da-7aaf-4963-8a82-28358de74ec2] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:48.365533 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7fe6c34b-1e78-4b7d-9881-f1f2c8fe9e6c tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:48.366064 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7fe6c34b-1e78-4b7d-9881-f1f2c8fe9e6c tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:48.366728 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7fe6c34b-1e78-4b7d-9881-f1f2c8fe9e6c tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:48.367576 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7fe6c34b-1e78-4b7d-9881-f1f2c8fe9e6c tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:48.368034 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7fe6c34b-1e78-4b7d-9881-f1f2c8fe9e6c tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:48.369159 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7fe6c34b-1e78-4b7d-9881-f1f2c8fe9e6c tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:48.692233 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-7fe6c34b-1e78-4b7d-9881-f1f2c8fe9e6c tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04cca628a834f368a96738a56dd0244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445c2c4630a5428cb51499a0fdf170fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:48.692233 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7fe6c34b-1e78-4b7d-9881-f1f2c8fe9e6c tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] 10.222.0.33 "GET /compute/v2.1/servers/61ca86da-7aaf-4963-8a82-28358de74ec2" status: 200 len: 1313 microversion: 2.1 time: 0.334110 Sep 23 04:59:48.692233 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2815/5795] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:48 2022] GET /compute/v2.1/servers/61ca86da-7aaf-4963-8a82-28358de74ec2 => generated 1313 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:59:48.796795 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2539f2b7-76f9-42b0-a936-6f8b07f59030 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:48.797691 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-2539f2b7-76f9-42b0-a936-6f8b07f59030 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] [instance: 1d4b42f4-3285-41c7-8264-e596b9d8ac02] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:48.806583 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2539f2b7-76f9-42b0-a936-6f8b07f59030 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:48.808786 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2539f2b7-76f9-42b0-a936-6f8b07f59030 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:48.809693 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2539f2b7-76f9-42b0-a936-6f8b07f59030 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:48.815126 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2539f2b7-76f9-42b0-a936-6f8b07f59030 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:48.816979 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2539f2b7-76f9-42b0-a936-6f8b07f59030 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:48.818618 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2539f2b7-76f9-42b0-a936-6f8b07f59030 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:49.101192 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2539f2b7-76f9-42b0-a936-6f8b07f59030 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a845ca1e7747fba0a987235d980098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca57a0af591a43ee9cdef09134bc3fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:49.125912 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2539f2b7-76f9-42b0-a936-6f8b07f59030 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] 10.222.0.33 "GET /compute/v2.1/servers/1d4b42f4-3285-41c7-8264-e596b9d8ac02" status: 200 len: 1506 microversion: 2.1 time: 0.329774 Sep 23 04:59:49.126940 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2981/5796] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:48 2022] GET /compute/v2.1/servers/1d4b42f4-3285-41c7-8264-e596b9d8ac02 => generated 1506 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:59:49.711735 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6d655a26-db94-4da0-8722-078af6712bd7 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:49.713026 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-6d655a26-db94-4da0-8722-078af6712bd7 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] [instance: 61ca86da-7aaf-4963-8a82-28358de74ec2] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:49.720137 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6d655a26-db94-4da0-8722-078af6712bd7 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:49.720954 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6d655a26-db94-4da0-8722-078af6712bd7 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:49.724683 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6d655a26-db94-4da0-8722-078af6712bd7 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:49.724683 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6d655a26-db94-4da0-8722-078af6712bd7 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:49.724683 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6d655a26-db94-4da0-8722-078af6712bd7 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:49.724683 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6d655a26-db94-4da0-8722-078af6712bd7 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:49.932416 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6d655a26-db94-4da0-8722-078af6712bd7 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04cca628a834f368a96738a56dd0244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445c2c4630a5428cb51499a0fdf170fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:49.942936 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-6d655a26-db94-4da0-8722-078af6712bd7 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] 10.222.0.33 "GET /compute/v2.1/servers/61ca86da-7aaf-4963-8a82-28358de74ec2" status: 200 len: 1313 microversion: 2.1 time: 0.235432 Sep 23 04:59:49.943965 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2816/5797] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:49 2022] GET /compute/v2.1/servers/61ca86da-7aaf-4963-8a82-28358de74ec2 => generated 1313 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:59:50.150246 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2c5b1e64-43b8-46b5-b0c8-177117f16ba0 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:50.150862 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-2c5b1e64-43b8-46b5-b0c8-177117f16ba0 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] [instance: 1d4b42f4-3285-41c7-8264-e596b9d8ac02] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:50.157983 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2c5b1e64-43b8-46b5-b0c8-177117f16ba0 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:50.158480 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2c5b1e64-43b8-46b5-b0c8-177117f16ba0 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:50.158921 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2c5b1e64-43b8-46b5-b0c8-177117f16ba0 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:50.159622 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2c5b1e64-43b8-46b5-b0c8-177117f16ba0 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:50.160076 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2c5b1e64-43b8-46b5-b0c8-177117f16ba0 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:50.160529 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2c5b1e64-43b8-46b5-b0c8-177117f16ba0 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:50.496653 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2c5b1e64-43b8-46b5-b0c8-177117f16ba0 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a845ca1e7747fba0a987235d980098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca57a0af591a43ee9cdef09134bc3fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:50.510937 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2c5b1e64-43b8-46b5-b0c8-177117f16ba0 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] 10.222.0.33 "GET /compute/v2.1/servers/1d4b42f4-3285-41c7-8264-e596b9d8ac02" status: 200 len: 1506 microversion: 2.1 time: 0.364857 Sep 23 04:59:50.511843 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2982/5798] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:50 2022] GET /compute/v2.1/servers/1d4b42f4-3285-41c7-8264-e596b9d8ac02 => generated 1506 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:59:50.628652 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-eddcd1b6-3f5f-4dda-96d8-f9b11b6e29e9 req-42f6585c-2877-48d0-b220-afb1750b27b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61ca86da-7aaf-4963-8a82-28358de74ec2", "tag": "cae6c210-c213-4d27-87ab-f0d87503e39d"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:59:50.645549 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-eddcd1b6-3f5f-4dda-96d8-f9b11b6e29e9 req-42f6585c-2877-48d0-b220-afb1750b27b9 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:50.646438 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-eddcd1b6-3f5f-4dda-96d8-f9b11b6e29e9 req-42f6585c-2877-48d0-b220-afb1750b27b9 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:50.646918 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-eddcd1b6-3f5f-4dda-96d8-f9b11b6e29e9 req-42f6585c-2877-48d0-b220-afb1750b27b9 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:50.660389 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-eddcd1b6-3f5f-4dda-96d8-f9b11b6e29e9 req-42f6585c-2877-48d0-b220-afb1750b27b9 service nova] Creating event network-changed:cae6c210-c213-4d27-87ab-f0d87503e39d for instance 61ca86da-7aaf-4963-8a82-28358de74ec2 on n-h2-846463-3 Sep 23 04:59:50.667524 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-eddcd1b6-3f5f-4dda-96d8-f9b11b6e29e9 req-42f6585c-2877-48d0-b220-afb1750b27b9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042228 Sep 23 04:59:50.668508 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2817/5799] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:59:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:59:50.971358 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9bca9963-09d1-4a9c-bb08-f4ff4667bfa7 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:50.972016 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-9bca9963-09d1-4a9c-bb08-f4ff4667bfa7 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] [instance: 61ca86da-7aaf-4963-8a82-28358de74ec2] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:50.975281 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=12 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:59:50.984041 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9bca9963-09d1-4a9c-bb08-f4ff4667bfa7 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:50.984557 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9bca9963-09d1-4a9c-bb08-f4ff4667bfa7 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:50.985102 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9bca9963-09d1-4a9c-bb08-f4ff4667bfa7 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:50.994374 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9bca9963-09d1-4a9c-bb08-f4ff4667bfa7 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:50.995135 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9bca9963-09d1-4a9c-bb08-f4ff4667bfa7 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:50.998261 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9bca9963-09d1-4a9c-bb08-f4ff4667bfa7 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:51.336400 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-fb401cc0-0b31-4678-8fa5-67e2d40d4e79 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:51.339993 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-fb401cc0-0b31-4678-8fa5-67e2d40d4e79 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] [instance: ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:51.359863 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fb401cc0-0b31-4678-8fa5-67e2d40d4e79 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:51.360966 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fb401cc0-0b31-4678-8fa5-67e2d40d4e79 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:51.361773 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fb401cc0-0b31-4678-8fa5-67e2d40d4e79 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:51.363286 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fb401cc0-0b31-4678-8fa5-67e2d40d4e79 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:51.364014 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fb401cc0-0b31-4678-8fa5-67e2d40d4e79 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:51.364857 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fb401cc0-0b31-4678-8fa5-67e2d40d4e79 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:51.402059 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-fb401cc0-0b31-4678-8fa5-67e2d40d4e79 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] 10.222.0.33 "GET /compute/v2.1/servers/ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074608 Sep 23 04:59:51.403130 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2818/5800] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Sep 23 04:59:51 2022] GET /compute/v2.1/servers/ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:59:51.416078 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-59ca6094-34d7-4703-8707-e0d8efb5dcc1 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:51.416988 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-59ca6094-34d7-4703-8707-e0d8efb5dcc1 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] [instance: ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:51.425265 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-59ca6094-34d7-4703-8707-e0d8efb5dcc1 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:51.425911 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-59ca6094-34d7-4703-8707-e0d8efb5dcc1 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:51.426774 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-59ca6094-34d7-4703-8707-e0d8efb5dcc1 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:51.427584 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-59ca6094-34d7-4703-8707-e0d8efb5dcc1 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:51.428159 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-59ca6094-34d7-4703-8707-e0d8efb5dcc1 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:51.429050 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-59ca6094-34d7-4703-8707-e0d8efb5dcc1 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:51.431484 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-9bca9963-09d1-4a9c-bb08-f4ff4667bfa7 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04cca628a834f368a96738a56dd0244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445c2c4630a5428cb51499a0fdf170fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:51.441067 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-9bca9963-09d1-4a9c-bb08-f4ff4667bfa7 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] 10.222.0.33 "GET /compute/v2.1/servers/61ca86da-7aaf-4963-8a82-28358de74ec2" status: 200 len: 1313 microversion: 2.1 time: 0.473032 Sep 23 04:59:51.442153 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2983/5801] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:50 2022] GET /compute/v2.1/servers/61ca86da-7aaf-4963-8a82-28358de74ec2 => generated 1313 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:59:51.480287 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-59ca6094-34d7-4703-8707-e0d8efb5dcc1 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] 10.222.0.33 "GET /compute/v2.1/servers/ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7/os-volume_attachments/0e3e692a-a65c-40d7-a31b-621abeb1ac09" status: 200 len: 194 microversion: 2.1 time: 0.069972 Sep 23 04:59:51.483252 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2819/5802] 10.222.0.33 () {58 vars in 1413 bytes} [Fri Sep 23 04:59:51 2022] GET /compute/v2.1/servers/ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7/os-volume_attachments/0e3e692a-a65c-40d7-a31b-621abeb1ac09 => generated 194 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:59:51.537255 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d88799be-7912-4e59-aa9c-5376b351d493 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:51.538204 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d88799be-7912-4e59-aa9c-5376b351d493 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] [instance: 1d4b42f4-3285-41c7-8264-e596b9d8ac02] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:51.551178 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d88799be-7912-4e59-aa9c-5376b351d493 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:51.551968 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d88799be-7912-4e59-aa9c-5376b351d493 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:51.552563 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d88799be-7912-4e59-aa9c-5376b351d493 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:51.553452 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d88799be-7912-4e59-aa9c-5376b351d493 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:51.556335 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d88799be-7912-4e59-aa9c-5376b351d493 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:51.561459 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d88799be-7912-4e59-aa9c-5376b351d493 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:51.836657 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d88799be-7912-4e59-aa9c-5376b351d493 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a845ca1e7747fba0a987235d980098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca57a0af591a43ee9cdef09134bc3fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:51.850302 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d88799be-7912-4e59-aa9c-5376b351d493 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] 10.222.0.33 "GET /compute/v2.1/servers/1d4b42f4-3285-41c7-8264-e596b9d8ac02" status: 200 len: 1506 microversion: 2.1 time: 0.316195 Sep 23 04:59:51.853320 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2984/5803] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:51 2022] GET /compute/v2.1/servers/1d4b42f4-3285-41c7-8264-e596b9d8ac02 => generated 1506 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:59:52.473231 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4f1b9cdd-1057-48a4-840a-c659701a5f5b tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:52.476056 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4f1b9cdd-1057-48a4-840a-c659701a5f5b tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] [instance: 61ca86da-7aaf-4963-8a82-28358de74ec2] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:52.490491 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4f1b9cdd-1057-48a4-840a-c659701a5f5b tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:52.506442 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4f1b9cdd-1057-48a4-840a-c659701a5f5b tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:52.508257 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4f1b9cdd-1057-48a4-840a-c659701a5f5b tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:52.511099 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4f1b9cdd-1057-48a4-840a-c659701a5f5b tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:52.511951 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4f1b9cdd-1057-48a4-840a-c659701a5f5b tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:52.515602 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4f1b9cdd-1057-48a4-840a-c659701a5f5b tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:52.596804 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=4 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:59:52.900427 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e7955502-89bb-4e1b-9154-f2a8bea9aa62 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:52.901113 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e7955502-89bb-4e1b-9154-f2a8bea9aa62 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] [instance: 1d4b42f4-3285-41c7-8264-e596b9d8ac02] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:52.938622 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4f1b9cdd-1057-48a4-840a-c659701a5f5b tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04cca628a834f368a96738a56dd0244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445c2c4630a5428cb51499a0fdf170fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:52.947748 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e7955502-89bb-4e1b-9154-f2a8bea9aa62 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:52.950580 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e7955502-89bb-4e1b-9154-f2a8bea9aa62 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:52.951441 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e7955502-89bb-4e1b-9154-f2a8bea9aa62 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:52.951743 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4f1b9cdd-1057-48a4-840a-c659701a5f5b tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] 10.222.0.33 "GET /compute/v2.1/servers/61ca86da-7aaf-4963-8a82-28358de74ec2" status: 200 len: 1313 microversion: 2.1 time: 0.489687 Sep 23 04:59:52.952686 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e7955502-89bb-4e1b-9154-f2a8bea9aa62 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:52.953342 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e7955502-89bb-4e1b-9154-f2a8bea9aa62 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:52.953704 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2820/5804] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:52 2022] GET /compute/v2.1/servers/61ca86da-7aaf-4963-8a82-28358de74ec2 => generated 1313 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:59:52.954234 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e7955502-89bb-4e1b-9154-f2a8bea9aa62 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:53.554606 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e7955502-89bb-4e1b-9154-f2a8bea9aa62 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a845ca1e7747fba0a987235d980098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca57a0af591a43ee9cdef09134bc3fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:53.582615 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e7955502-89bb-4e1b-9154-f2a8bea9aa62 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] 10.222.0.33 "GET /compute/v2.1/servers/1d4b42f4-3285-41c7-8264-e596b9d8ac02" status: 200 len: 1506 microversion: 2.1 time: 0.706712 Sep 23 04:59:53.585495 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2985/5805] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:52 2022] GET /compute/v2.1/servers/1d4b42f4-3285-41c7-8264-e596b9d8ac02 => generated 1506 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:59:53.997590 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f0e1f7fa-e780-490b-b580-a9fa50e69380 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:54.001045 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f0e1f7fa-e780-490b-b580-a9fa50e69380 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] [instance: 61ca86da-7aaf-4963-8a82-28358de74ec2] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:54.020939 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=8 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:59:54.024800 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f0e1f7fa-e780-490b-b580-a9fa50e69380 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:54.041031 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f0e1f7fa-e780-490b-b580-a9fa50e69380 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:54.051110 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f0e1f7fa-e780-490b-b580-a9fa50e69380 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:54.054151 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f0e1f7fa-e780-490b-b580-a9fa50e69380 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:54.054924 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f0e1f7fa-e780-490b-b580-a9fa50e69380 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:54.061200 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f0e1f7fa-e780-490b-b580-a9fa50e69380 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:54.546501 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-84e7ad8c-7971-4192-a79b-444b3953d3e0 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6a574473-962a-4e5b-ac78-ed92481a7017"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:59:54.553915 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-84e7ad8c-7971-4192-a79b-444b3953d3e0 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] [instance: ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:54.570521 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=4 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 04:59:54.572405 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-84e7ad8c-7971-4192-a79b-444b3953d3e0 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:54.573065 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-84e7ad8c-7971-4192-a79b-444b3953d3e0 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:54.573791 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-84e7ad8c-7971-4192-a79b-444b3953d3e0 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:54.574802 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-84e7ad8c-7971-4192-a79b-444b3953d3e0 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:54.575419 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-84e7ad8c-7971-4192-a79b-444b3953d3e0 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:54.575998 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-84e7ad8c-7971-4192-a79b-444b3953d3e0 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:54.599581 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f0e1f7fa-e780-490b-b580-a9fa50e69380 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04cca628a834f368a96738a56dd0244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445c2c4630a5428cb51499a0fdf170fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:54.616103 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f0e1f7fa-e780-490b-b580-a9fa50e69380 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] 10.222.0.33 "GET /compute/v2.1/servers/61ca86da-7aaf-4963-8a82-28358de74ec2" status: 200 len: 1313 microversion: 2.1 time: 0.632946 Sep 23 04:59:54.634977 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2821/5806] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:53 2022] GET /compute/v2.1/servers/61ca86da-7aaf-4963-8a82-28358de74ec2 => generated 1313 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:59:54.646124 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8d0633ee-5f14-43a8-a1b1-3dbe0490a125 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:54.646921 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8d0633ee-5f14-43a8-a1b1-3dbe0490a125 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] [instance: 1d4b42f4-3285-41c7-8264-e596b9d8ac02] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:54.654319 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8d0633ee-5f14-43a8-a1b1-3dbe0490a125 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:54.655096 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8d0633ee-5f14-43a8-a1b1-3dbe0490a125 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:54.656304 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8d0633ee-5f14-43a8-a1b1-3dbe0490a125 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:54.657437 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8d0633ee-5f14-43a8-a1b1-3dbe0490a125 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:54.658117 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8d0633ee-5f14-43a8-a1b1-3dbe0490a125 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:54.658879 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8d0633ee-5f14-43a8-a1b1-3dbe0490a125 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:54.969679 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8d0633ee-5f14-43a8-a1b1-3dbe0490a125 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a845ca1e7747fba0a987235d980098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca57a0af591a43ee9cdef09134bc3fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:54.985814 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8d0633ee-5f14-43a8-a1b1-3dbe0490a125 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] 10.222.0.33 "GET /compute/v2.1/servers/1d4b42f4-3285-41c7-8264-e596b9d8ac02" status: 200 len: 1506 microversion: 2.1 time: 0.345649 Sep 23 04:59:54.986490 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2822/5807] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:54 2022] GET /compute/v2.1/servers/1d4b42f4-3285-41c7-8264-e596b9d8ac02 => generated 1506 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:59:55.467248 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-c97ec117-56be-4560-8217-915b8f55f17c req-2caa7aaf-eca8-4e14-be5b-eddaf3f3f11d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61ca86da-7aaf-4963-8a82-28358de74ec2", "name": "network-vif-plugged", "status": "completed", "tag": "cae6c210-c213-4d27-87ab-f0d87503e39d"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:59:55.478443 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-c97ec117-56be-4560-8217-915b8f55f17c req-2caa7aaf-eca8-4e14-be5b-eddaf3f3f11d service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:55.481092 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-c97ec117-56be-4560-8217-915b8f55f17c req-2caa7aaf-eca8-4e14-be5b-eddaf3f3f11d service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:55.481092 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-c97ec117-56be-4560-8217-915b8f55f17c req-2caa7aaf-eca8-4e14-be5b-eddaf3f3f11d service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:55.491147 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-c97ec117-56be-4560-8217-915b8f55f17c req-2caa7aaf-eca8-4e14-be5b-eddaf3f3f11d service nova] Creating event network-vif-plugged:cae6c210-c213-4d27-87ab-f0d87503e39d for instance 61ca86da-7aaf-4963-8a82-28358de74ec2 on n-h2-846463-3 Sep 23 04:59:55.497057 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-c97ec117-56be-4560-8217-915b8f55f17c req-2caa7aaf-eca8-4e14-be5b-eddaf3f3f11d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038228 Sep 23 04:59:55.498778 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2823/5808] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 04:59:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 04:59:55.646792 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-36f3912e-c2ff-4066-91cc-ca508a3d5cd3 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:55.647513 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-36f3912e-c2ff-4066-91cc-ca508a3d5cd3 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] [instance: 61ca86da-7aaf-4963-8a82-28358de74ec2] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:55.661066 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-36f3912e-c2ff-4066-91cc-ca508a3d5cd3 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:55.661372 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-36f3912e-c2ff-4066-91cc-ca508a3d5cd3 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:55.661740 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-36f3912e-c2ff-4066-91cc-ca508a3d5cd3 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:55.666919 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-36f3912e-c2ff-4066-91cc-ca508a3d5cd3 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:55.667510 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-36f3912e-c2ff-4066-91cc-ca508a3d5cd3 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:55.667991 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-36f3912e-c2ff-4066-91cc-ca508a3d5cd3 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:55.685053 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-84e7ad8c-7971-4192-a79b-444b3953d3e0 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] 10.222.0.33 "POST /compute/v2.1/servers/ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.133585 Sep 23 04:59:55.685053 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2986/5809] 10.222.0.33 () {60 vars in 1323 bytes} [Fri Sep 23 04:59:54 2022] POST /compute/v2.1/servers/ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7/os-volume_attachments => generated 194 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 04:59:56.014509 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-86a0c529-029f-4838-97f5-644da3003c6c tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:56.015230 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-86a0c529-029f-4838-97f5-644da3003c6c tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] [instance: 1d4b42f4-3285-41c7-8264-e596b9d8ac02] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:56.033669 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-86a0c529-029f-4838-97f5-644da3003c6c tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:56.034499 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-86a0c529-029f-4838-97f5-644da3003c6c tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:56.035096 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-86a0c529-029f-4838-97f5-644da3003c6c tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:56.036041 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-86a0c529-029f-4838-97f5-644da3003c6c tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:56.036849 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-86a0c529-029f-4838-97f5-644da3003c6c tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:56.037433 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-86a0c529-029f-4838-97f5-644da3003c6c tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:56.313985 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-36f3912e-c2ff-4066-91cc-ca508a3d5cd3 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04cca628a834f368a96738a56dd0244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445c2c4630a5428cb51499a0fdf170fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:56.335087 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-36f3912e-c2ff-4066-91cc-ca508a3d5cd3 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] 10.222.0.33 "GET /compute/v2.1/servers/61ca86da-7aaf-4963-8a82-28358de74ec2" status: 200 len: 1313 microversion: 2.1 time: 0.692474 Sep 23 04:59:56.335685 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2824/5810] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:55 2022] GET /compute/v2.1/servers/61ca86da-7aaf-4963-8a82-28358de74ec2 => generated 1313 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:59:56.457803 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-86a0c529-029f-4838-97f5-644da3003c6c tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a845ca1e7747fba0a987235d980098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca57a0af591a43ee9cdef09134bc3fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:56.467470 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-86a0c529-029f-4838-97f5-644da3003c6c tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] 10.222.0.33 "GET /compute/v2.1/servers/1d4b42f4-3285-41c7-8264-e596b9d8ac02" status: 200 len: 1506 microversion: 2.1 time: 0.458116 Sep 23 04:59:56.468247 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2987/5811] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:56 2022] GET /compute/v2.1/servers/1d4b42f4-3285-41c7-8264-e596b9d8ac02 => generated 1506 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 04:59:57.360600 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1a588f51-4c72-4121-b544-94698cdb83f1 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:57.361219 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-1a588f51-4c72-4121-b544-94698cdb83f1 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] [instance: 61ca86da-7aaf-4963-8a82-28358de74ec2] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:57.373119 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1a588f51-4c72-4121-b544-94698cdb83f1 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:57.373925 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1a588f51-4c72-4121-b544-94698cdb83f1 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:57.374529 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1a588f51-4c72-4121-b544-94698cdb83f1 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:57.375404 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1a588f51-4c72-4121-b544-94698cdb83f1 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:57.376076 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1a588f51-4c72-4121-b544-94698cdb83f1 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:57.376839 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1a588f51-4c72-4121-b544-94698cdb83f1 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:57.492686 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-79fbe836-468f-45d9-bce0-a822155ccf2f tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:57.493710 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-79fbe836-468f-45d9-bce0-a822155ccf2f tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] [instance: 1d4b42f4-3285-41c7-8264-e596b9d8ac02] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:57.512342 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-79fbe836-468f-45d9-bce0-a822155ccf2f tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:57.512784 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-79fbe836-468f-45d9-bce0-a822155ccf2f tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:57.513224 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-79fbe836-468f-45d9-bce0-a822155ccf2f tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:57.514144 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-79fbe836-468f-45d9-bce0-a822155ccf2f tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:57.514762 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-79fbe836-468f-45d9-bce0-a822155ccf2f tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:57.515350 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-79fbe836-468f-45d9-bce0-a822155ccf2f tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:57.665796 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-1a588f51-4c72-4121-b544-94698cdb83f1 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04cca628a834f368a96738a56dd0244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445c2c4630a5428cb51499a0fdf170fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:57.665796 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-1a588f51-4c72-4121-b544-94698cdb83f1 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] 10.222.0.33 "GET /compute/v2.1/servers/61ca86da-7aaf-4963-8a82-28358de74ec2" status: 200 len: 1497 microversion: 2.1 time: 0.291810 Sep 23 04:59:57.665796 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2825/5812] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:57 2022] GET /compute/v2.1/servers/61ca86da-7aaf-4963-8a82-28358de74ec2 => generated 1497 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:59:57.802012 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-79fbe836-468f-45d9-bce0-a822155ccf2f tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a845ca1e7747fba0a987235d980098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca57a0af591a43ee9cdef09134bc3fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:57.815527 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-79fbe836-468f-45d9-bce0-a822155ccf2f tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] 10.222.0.33 "GET /compute/v2.1/servers/1d4b42f4-3285-41c7-8264-e596b9d8ac02" status: 200 len: 1506 microversion: 2.1 time: 0.326669 Sep 23 04:59:57.818642 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2988/5813] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:57 2022] GET /compute/v2.1/servers/1d4b42f4-3285-41c7-8264-e596b9d8ac02 => generated 1506 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 04:59:58.676042 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-793b821a-8c28-4fe5-af01-3c2a6b16a6f9 tempest-VolumesSnapshotsTestJSON-145105073 tempest-VolumesSnapshotsTestJSON-145105073-project] Action: 'create', calling method: .version_select at 0x7ff1ba8569d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-302001492"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 04:59:58.841112 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3fb234dd-929e-4cb2-a185-cbe096dc49b0 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 04:59:58.841724 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-3fb234dd-929e-4cb2-a185-cbe096dc49b0 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] [instance: 1d4b42f4-3285-41c7-8264-e596b9d8ac02] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 04:59:58.869110 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3fb234dd-929e-4cb2-a185-cbe096dc49b0 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:58.870438 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3fb234dd-929e-4cb2-a185-cbe096dc49b0 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:58.872830 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3fb234dd-929e-4cb2-a185-cbe096dc49b0 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:58.876352 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3fb234dd-929e-4cb2-a185-cbe096dc49b0 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 04:59:58.880463 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3fb234dd-929e-4cb2-a185-cbe096dc49b0 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 04:59:58.881086 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3fb234dd-929e-4cb2-a185-cbe096dc49b0 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 04:59:59.275170 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-3fb234dd-929e-4cb2-a185-cbe096dc49b0 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a845ca1e7747fba0a987235d980098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca57a0af591a43ee9cdef09134bc3fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 04:59:59.283395 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3fb234dd-929e-4cb2-a185-cbe096dc49b0 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] 10.222.0.33 "GET /compute/v2.1/servers/1d4b42f4-3285-41c7-8264-e596b9d8ac02" status: 200 len: 1506 microversion: 2.1 time: 0.446526 Sep 23 04:59:59.284983 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2989/5814] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 04:59:58 2022] GET /compute/v2.1/servers/1d4b42f4-3285-41c7-8264-e596b9d8ac02 => generated 1506 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:00:00.310388 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0f6bf75b-9877-4a0b-be2f-2a650a913790 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:00.315601 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-0f6bf75b-9877-4a0b-be2f-2a650a913790 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] [instance: 1d4b42f4-3285-41c7-8264-e596b9d8ac02] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:00:00.325611 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0f6bf75b-9877-4a0b-be2f-2a650a913790 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:00.326368 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0f6bf75b-9877-4a0b-be2f-2a650a913790 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:00.327024 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0f6bf75b-9877-4a0b-be2f-2a650a913790 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:00.327911 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0f6bf75b-9877-4a0b-be2f-2a650a913790 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:00.331092 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0f6bf75b-9877-4a0b-be2f-2a650a913790 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:00.331919 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0f6bf75b-9877-4a0b-be2f-2a650a913790 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:00.351880 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-793b821a-8c28-4fe5-af01-3c2a6b16a6f9 tempest-VolumesSnapshotsTestJSON-145105073 tempest-VolumesSnapshotsTestJSON-145105073-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 1.859326 Sep 23 05:00:00.361170 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2826/5815] 10.222.0.33 () {60 vars in 1155 bytes} [Fri Sep 23 04:59:58 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 1869 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 23 05:00:00.366135 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e847aad5-a769-47d2-9dc6-186f44347b92 tempest-VolumesSnapshotsTestJSON-145105073 tempest-VolumesSnapshotsTestJSON-145105073-project] Calling method '.version_select at 0x7ff1ba889ca0>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:01.114596 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-0f6bf75b-9877-4a0b-be2f-2a650a913790 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a845ca1e7747fba0a987235d980098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca57a0af591a43ee9cdef09134bc3fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:00:01.126738 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0f6bf75b-9877-4a0b-be2f-2a650a913790 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] 10.222.0.33 "GET /compute/v2.1/servers/1d4b42f4-3285-41c7-8264-e596b9d8ac02" status: 200 len: 1506 microversion: 2.1 time: 0.821090 Sep 23 05:00:01.127735 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2990/5816] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:00:00 2022] GET /compute/v2.1/servers/1d4b42f4-3285-41c7-8264-e596b9d8ac02 => generated 1506 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:00:01.744928 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e847aad5-a769-47d2-9dc6-186f44347b92 tempest-VolumesSnapshotsTestJSON-145105073 tempest-VolumesSnapshotsTestJSON-145105073-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/540b558a-91e5-4e5a-ac7c-d1622ea43daa" status: 200 len: 344 microversion: 2.1 time: 1.382616 Sep 23 05:00:01.751581 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2827/5817] 10.222.0.33 () {58 vars in 1245 bytes} [Fri Sep 23 05:00:00 2022] GET /compute/v2.1/os-volumes/540b558a-91e5-4e5a-ac7c-d1622ea43daa => generated 344 bytes in 1384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:00:02.150196 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-30318685-8d08-4062-9ec9-1e40fcf239fb tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:02.150817 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-30318685-8d08-4062-9ec9-1e40fcf239fb tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] [instance: 1d4b42f4-3285-41c7-8264-e596b9d8ac02] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:00:02.160519 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-30318685-8d08-4062-9ec9-1e40fcf239fb tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:02.161027 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-30318685-8d08-4062-9ec9-1e40fcf239fb tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:02.161475 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-30318685-8d08-4062-9ec9-1e40fcf239fb tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:02.162223 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-30318685-8d08-4062-9ec9-1e40fcf239fb tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:02.171121 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-30318685-8d08-4062-9ec9-1e40fcf239fb tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:02.171583 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-30318685-8d08-4062-9ec9-1e40fcf239fb tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:02.771603 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9d7ab958-9517-4cff-ad02-e5c6bc91b609 tempest-VolumesSnapshotsTestJSON-145105073 tempest-VolumesSnapshotsTestJSON-145105073-project] Calling method '.version_select at 0x7ff1ba7b38b0>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:02.782411 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-30318685-8d08-4062-9ec9-1e40fcf239fb tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a845ca1e7747fba0a987235d980098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca57a0af591a43ee9cdef09134bc3fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:00:02.791715 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-30318685-8d08-4062-9ec9-1e40fcf239fb tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] 10.222.0.33 "GET /compute/v2.1/servers/1d4b42f4-3285-41c7-8264-e596b9d8ac02" status: 200 len: 1506 microversion: 2.1 time: 0.645685 Sep 23 05:00:02.798268 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2991/5818] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:00:02 2022] GET /compute/v2.1/servers/1d4b42f4-3285-41c7-8264-e596b9d8ac02 => generated 1506 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:00:02.874499 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0f9559d5-fb69-4a90-9570-e6623ee47dde tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:00:02.876854 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-0f9559d5-fb69-4a90-9570-e6623ee47dde tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 7f05d753-e297-4330-ba02-dc0aac76de96] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:00:02.894023 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0f9559d5-fb69-4a90-9570-e6623ee47dde tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:02.895106 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0f9559d5-fb69-4a90-9570-e6623ee47dde tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:02.895557 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0f9559d5-fb69-4a90-9570-e6623ee47dde tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:02.896285 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0f9559d5-fb69-4a90-9570-e6623ee47dde tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:02.896747 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0f9559d5-fb69-4a90-9570-e6623ee47dde tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:02.897194 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0f9559d5-fb69-4a90-9570-e6623ee47dde tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:02.957466 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0f9559d5-fb69-4a90-9570-e6623ee47dde tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "POST /compute/v2.1/servers/7f05d753-e297-4330-ba02-dc0aac76de96/action" status: 200 len: 24572 microversion: 2.1 time: 0.097888 Sep 23 05:00:02.965348 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2992/5819] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 05:00:02 2022] POST /compute/v2.1/servers/7f05d753-e297-4330-ba02-dc0aac76de96/action => generated 24572 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 23 05:00:03.161971 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9d7ab958-9517-4cff-ad02-e5c6bc91b609 tempest-VolumesSnapshotsTestJSON-145105073 tempest-VolumesSnapshotsTestJSON-145105073-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/540b558a-91e5-4e5a-ac7c-d1622ea43daa" status: 200 len: 345 microversion: 2.1 time: 0.405311 Sep 23 05:00:03.163112 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2828/5820] 10.222.0.33 () {58 vars in 1245 bytes} [Fri Sep 23 05:00:02 2022] GET /compute/v2.1/os-volumes/540b558a-91e5-4e5a-ac7c-d1622ea43daa => generated 345 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:00:03.176417 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d474b24b-2abb-4ca9-9e17-01c1755af8e0 tempest-VolumesSnapshotsTestJSON-145105073 tempest-VolumesSnapshotsTestJSON-145105073-project] Action: 'create', calling method: .version_select at 0x7ff1bb8d8b80>, body: {"snapshot": {"volume_id": "540b558a-91e5-4e5a-ac7c-d1622ea43daa", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1235061695"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:00:03.817618 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b68f9c30-7c4b-491d-b521-b6822823c3b2 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:03.819189 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b68f9c30-7c4b-491d-b521-b6822823c3b2 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] [instance: 1d4b42f4-3285-41c7-8264-e596b9d8ac02] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:00:03.826558 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b68f9c30-7c4b-491d-b521-b6822823c3b2 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:03.827355 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b68f9c30-7c4b-491d-b521-b6822823c3b2 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:03.831511 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b68f9c30-7c4b-491d-b521-b6822823c3b2 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:03.831511 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b68f9c30-7c4b-491d-b521-b6822823c3b2 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:03.831511 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b68f9c30-7c4b-491d-b521-b6822823c3b2 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:03.831511 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b68f9c30-7c4b-491d-b521-b6822823c3b2 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:04.255333 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b68f9c30-7c4b-491d-b521-b6822823c3b2 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a845ca1e7747fba0a987235d980098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca57a0af591a43ee9cdef09134bc3fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:00:04.263891 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b68f9c30-7c4b-491d-b521-b6822823c3b2 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] 10.222.0.33 "GET /compute/v2.1/servers/1d4b42f4-3285-41c7-8264-e596b9d8ac02" status: 200 len: 1506 microversion: 2.1 time: 0.451016 Sep 23 05:00:04.274677 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2829/5821] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:00:03 2022] GET /compute/v2.1/servers/1d4b42f4-3285-41c7-8264-e596b9d8ac02 => generated 1506 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:00:04.623943 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d474b24b-2abb-4ca9-9e17-01c1755af8e0 tempest-VolumesSnapshotsTestJSON-145105073 tempest-VolumesSnapshotsTestJSON-145105073-project] 10.222.0.33 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 1.451650 Sep 23 05:00:04.625582 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2993/5822] 10.222.0.33 () {60 vars in 1162 bytes} [Fri Sep 23 05:00:03 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 1454 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:00:04.637549 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-588fe9d9-841c-427d-a66c-f201add33270 tempest-VolumesSnapshotsTestJSON-145105073 tempest-VolumesSnapshotsTestJSON-145105073-project] Calling method '.version_select at 0x7ff1ba89b790>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:04.694504 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-588fe9d9-841c-427d-a66c-f201add33270 tempest-VolumesSnapshotsTestJSON-145105073 tempest-VolumesSnapshotsTestJSON-145105073-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/cbf55dae-6101-4964-b9dc-aef20750da53" status: 200 len: 287 microversion: 2.1 time: 0.061657 Sep 23 05:00:04.701436 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2830/5823] 10.222.0.33 () {58 vars in 1251 bytes} [Fri Sep 23 05:00:04 2022] GET /compute/v2.1/os-snapshots/cbf55dae-6101-4964-b9dc-aef20750da53 => generated 287 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:00:04.706816 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-efd8ddaa-adb4-42ff-95af-9fcc6f919634 tempest-VolumesSnapshotsTestJSON-145105073 tempest-VolumesSnapshotsTestJSON-145105073-project] Calling method '.version_select at 0x7ff1bb824a60>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:04.738790 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-efd8ddaa-adb4-42ff-95af-9fcc6f919634 tempest-VolumesSnapshotsTestJSON-145105073 tempest-VolumesSnapshotsTestJSON-145105073-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.035913 Sep 23 05:00:04.739387 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2994/5824] 10.222.0.33 () {58 vars in 1140 bytes} [Fri Sep 23 05:00:04 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 05:00:04.753075 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d91cd852-0afd-44af-9392-e8407f2744bf tempest-VolumesSnapshotsTestJSON-145105073 tempest-VolumesSnapshotsTestJSON-145105073-project] Calling method '.version_select at 0x7ff1ba889dc0>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:04.781833 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d91cd852-0afd-44af-9392-e8407f2744bf tempest-VolumesSnapshotsTestJSON-145105073 tempest-VolumesSnapshotsTestJSON-145105073-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/cbf55dae-6101-4964-b9dc-aef20750da53" status: 200 len: 287 microversion: 2.1 time: 0.034493 Sep 23 05:00:04.782454 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2831/5825] 10.222.0.33 () {58 vars in 1251 bytes} [Fri Sep 23 05:00:04 2022] GET /compute/v2.1/os-snapshots/cbf55dae-6101-4964-b9dc-aef20750da53 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:00:05.292087 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8f04f70e-76be-4889-8c9d-a3273cb56032 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:05.292834 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-8f04f70e-76be-4889-8c9d-a3273cb56032 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] [instance: 1d4b42f4-3285-41c7-8264-e596b9d8ac02] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:00:05.314220 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8f04f70e-76be-4889-8c9d-a3273cb56032 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:05.314220 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8f04f70e-76be-4889-8c9d-a3273cb56032 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:05.314220 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8f04f70e-76be-4889-8c9d-a3273cb56032 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:05.314220 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8f04f70e-76be-4889-8c9d-a3273cb56032 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:05.314220 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8f04f70e-76be-4889-8c9d-a3273cb56032 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:05.314220 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8f04f70e-76be-4889-8c9d-a3273cb56032 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:05.600014 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-8f04f70e-76be-4889-8c9d-a3273cb56032 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a845ca1e7747fba0a987235d980098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca57a0af591a43ee9cdef09134bc3fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:00:05.608962 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-8f04f70e-76be-4889-8c9d-a3273cb56032 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] 10.222.0.33 "GET /compute/v2.1/servers/1d4b42f4-3285-41c7-8264-e596b9d8ac02" status: 200 len: 1506 microversion: 2.1 time: 0.321342 Sep 23 05:00:05.609563 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2995/5826] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:00:05 2022] GET /compute/v2.1/servers/1d4b42f4-3285-41c7-8264-e596b9d8ac02 => generated 1506 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:00:05.795296 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5b13a70d-10de-4723-8425-5cbb2127febd tempest-VolumesSnapshotsTestJSON-145105073 tempest-VolumesSnapshotsTestJSON-145105073-project] Calling method '.version_select at 0x7ff1ba7ac820>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:05.968769 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-494133ba-d8cd-4e9a-887c-44cc7d2048de tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:05.969285 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-494133ba-d8cd-4e9a-887c-44cc7d2048de tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] [instance: 61ca86da-7aaf-4963-8a82-28358de74ec2] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:00:05.994102 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-494133ba-d8cd-4e9a-887c-44cc7d2048de tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:05.999167 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-494133ba-d8cd-4e9a-887c-44cc7d2048de tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:06.001871 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5b13a70d-10de-4723-8425-5cbb2127febd tempest-VolumesSnapshotsTestJSON-145105073 tempest-VolumesSnapshotsTestJSON-145105073-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/cbf55dae-6101-4964-b9dc-aef20750da53" status: 200 len: 287 microversion: 2.1 time: 0.211593 Sep 23 05:00:06.003083 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2832/5827] 10.222.0.33 () {58 vars in 1251 bytes} [Fri Sep 23 05:00:05 2022] GET /compute/v2.1/os-snapshots/cbf55dae-6101-4964-b9dc-aef20750da53 => generated 287 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:00:06.011437 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-494133ba-d8cd-4e9a-887c-44cc7d2048de tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:06.011437 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-494133ba-d8cd-4e9a-887c-44cc7d2048de tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:06.011437 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-494133ba-d8cd-4e9a-887c-44cc7d2048de tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:06.011437 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-494133ba-d8cd-4e9a-887c-44cc7d2048de tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:06.088007 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:00:06.095070 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-494133ba-d8cd-4e9a-887c-44cc7d2048de tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] [instance: 61ca86da-7aaf-4963-8a82-28358de74ec2] Going to try to terminate instance {{(pid=122699) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 05:00:06.453230 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-494133ba-d8cd-4e9a-887c-44cc7d2048de tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] 10.222.0.33 "DELETE /compute/v2.1/servers/61ca86da-7aaf-4963-8a82-28358de74ec2" status: 204 len: 0 microversion: 2.1 time: 0.499439 Sep 23 05:00:06.453852 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2996/5828] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 05:00:05 2022] DELETE /compute/v2.1/servers/61ca86da-7aaf-4963-8a82-28358de74ec2 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 05:00:06.489760 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2ac4c69c-fdba-4834-818a-f5dbeedfb348 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:06.518573 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-2ac4c69c-fdba-4834-818a-f5dbeedfb348 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] [instance: 61ca86da-7aaf-4963-8a82-28358de74ec2] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:00:06.578384 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2ac4c69c-fdba-4834-818a-f5dbeedfb348 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:06.580431 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2ac4c69c-fdba-4834-818a-f5dbeedfb348 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:06.581536 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2ac4c69c-fdba-4834-818a-f5dbeedfb348 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:06.586309 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2ac4c69c-fdba-4834-818a-f5dbeedfb348 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:06.588842 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2ac4c69c-fdba-4834-818a-f5dbeedfb348 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:06.595863 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2ac4c69c-fdba-4834-818a-f5dbeedfb348 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:06.636774 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-675e27a7-f5ed-4a70-9e4e-5bf96392f841 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:06.637779 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-675e27a7-f5ed-4a70-9e4e-5bf96392f841 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] [instance: 1d4b42f4-3285-41c7-8264-e596b9d8ac02] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:00:06.649038 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-675e27a7-f5ed-4a70-9e4e-5bf96392f841 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:06.655105 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-675e27a7-f5ed-4a70-9e4e-5bf96392f841 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:06.655833 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-675e27a7-f5ed-4a70-9e4e-5bf96392f841 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:06.656608 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-675e27a7-f5ed-4a70-9e4e-5bf96392f841 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:06.657061 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-675e27a7-f5ed-4a70-9e4e-5bf96392f841 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:06.657483 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-675e27a7-f5ed-4a70-9e4e-5bf96392f841 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:07.333577 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-675e27a7-f5ed-4a70-9e4e-5bf96392f841 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a845ca1e7747fba0a987235d980098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca57a0af591a43ee9cdef09134bc3fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:00:07.342000 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-675e27a7-f5ed-4a70-9e4e-5bf96392f841 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] 10.222.0.33 "GET /compute/v2.1/servers/1d4b42f4-3285-41c7-8264-e596b9d8ac02" status: 200 len: 1506 microversion: 2.1 time: 0.711433 Sep 23 05:00:07.362119 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2997/5829] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:00:06 2022] GET /compute/v2.1/servers/1d4b42f4-3285-41c7-8264-e596b9d8ac02 => generated 1506 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:00:07.367185 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-79bc29fd-064e-4b9b-81c1-e04535fb44a4 tempest-VolumesSnapshotsTestJSON-145105073 tempest-VolumesSnapshotsTestJSON-145105073-project] Calling method '.version_select at 0x7ff1babf1f70>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:07.397833 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-2ac4c69c-fdba-4834-818a-f5dbeedfb348 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04cca628a834f368a96738a56dd0244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445c2c4630a5428cb51499a0fdf170fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:00:07.406390 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2ac4c69c-fdba-4834-818a-f5dbeedfb348 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] 10.222.0.33 "GET /compute/v2.1/servers/61ca86da-7aaf-4963-8a82-28358de74ec2" status: 200 len: 1503 microversion: 2.1 time: 0.947963 Sep 23 05:00:07.421913 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2833/5830] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:00:06 2022] GET /compute/v2.1/servers/61ca86da-7aaf-4963-8a82-28358de74ec2 => generated 1503 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:00:07.437292 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-79bc29fd-064e-4b9b-81c1-e04535fb44a4 tempest-VolumesSnapshotsTestJSON-145105073 tempest-VolumesSnapshotsTestJSON-145105073-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/cbf55dae-6101-4964-b9dc-aef20750da53" status: 200 len: 288 microversion: 2.1 time: 0.073739 Sep 23 05:00:07.437936 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2998/5831] 10.222.0.33 () {58 vars in 1251 bytes} [Fri Sep 23 05:00:07 2022] GET /compute/v2.1/os-snapshots/cbf55dae-6101-4964-b9dc-aef20750da53 => generated 288 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:00:07.453285 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-bf599bfb-3ebc-4a54-bd11-4db3793dbb2b tempest-VolumesSnapshotsTestJSON-145105073 tempest-VolumesSnapshotsTestJSON-145105073-project] Calling method '.version_select at 0x7ff1ba7acb80>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:07.612475 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-bf599bfb-3ebc-4a54-bd11-4db3793dbb2b tempest-VolumesSnapshotsTestJSON-145105073 tempest-VolumesSnapshotsTestJSON-145105073-project] 10.222.0.33 "DELETE /compute/v2.1/os-snapshots/cbf55dae-6101-4964-b9dc-aef20750da53" status: 202 len: 0 microversion: 2.1 time: 0.163307 Sep 23 05:00:07.617667 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2834/5832] 10.222.0.33 () {58 vars in 1254 bytes} [Fri Sep 23 05:00:07 2022] DELETE /compute/v2.1/os-snapshots/cbf55dae-6101-4964-b9dc-aef20750da53 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 05:00:07.622348 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-055076d3-07a9-4259-9490-434e98d8c5c4 tempest-VolumesSnapshotsTestJSON-145105073 tempest-VolumesSnapshotsTestJSON-145105073-project] Calling method '.version_select at 0x7ff1bb824b80>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:07.693424 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-055076d3-07a9-4259-9490-434e98d8c5c4 tempest-VolumesSnapshotsTestJSON-145105073 tempest-VolumesSnapshotsTestJSON-145105073-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/cbf55dae-6101-4964-b9dc-aef20750da53" status: 200 len: 287 microversion: 2.1 time: 0.075379 Sep 23 05:00:07.694036 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 2999/5833] 10.222.0.33 () {58 vars in 1251 bytes} [Fri Sep 23 05:00:07 2022] GET /compute/v2.1/os-snapshots/cbf55dae-6101-4964-b9dc-aef20750da53 => generated 287 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:00:08.364761 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c47a28e3-f822-4d69-ad1d-de46efb3aa08 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:08.365394 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c47a28e3-f822-4d69-ad1d-de46efb3aa08 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] [instance: 1d4b42f4-3285-41c7-8264-e596b9d8ac02] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:00:08.381871 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c47a28e3-f822-4d69-ad1d-de46efb3aa08 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:08.382394 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c47a28e3-f822-4d69-ad1d-de46efb3aa08 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:08.382834 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c47a28e3-f822-4d69-ad1d-de46efb3aa08 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:08.383593 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c47a28e3-f822-4d69-ad1d-de46efb3aa08 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:08.384052 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c47a28e3-f822-4d69-ad1d-de46efb3aa08 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:08.384476 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c47a28e3-f822-4d69-ad1d-de46efb3aa08 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:08.432961 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2e045b62-6525-49a1-9e35-da139c6f9ed8 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:08.433764 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-2e045b62-6525-49a1-9e35-da139c6f9ed8 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] [instance: 61ca86da-7aaf-4963-8a82-28358de74ec2] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:00:08.449589 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2e045b62-6525-49a1-9e35-da139c6f9ed8 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:08.450262 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2e045b62-6525-49a1-9e35-da139c6f9ed8 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:08.451517 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2e045b62-6525-49a1-9e35-da139c6f9ed8 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:08.452250 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2e045b62-6525-49a1-9e35-da139c6f9ed8 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:08.452726 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2e045b62-6525-49a1-9e35-da139c6f9ed8 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:08.453163 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2e045b62-6525-49a1-9e35-da139c6f9ed8 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:08.920152 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2e045b62-6525-49a1-9e35-da139c6f9ed8 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04cca628a834f368a96738a56dd0244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445c2c4630a5428cb51499a0fdf170fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:00:08.934394 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2e045b62-6525-49a1-9e35-da139c6f9ed8 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] 10.222.0.33 "GET /compute/v2.1/servers/61ca86da-7aaf-4963-8a82-28358de74ec2" status: 200 len: 1503 microversion: 2.1 time: 0.506230 Sep 23 05:00:08.934989 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3000/5834] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:00:08 2022] GET /compute/v2.1/servers/61ca86da-7aaf-4963-8a82-28358de74ec2 => generated 1503 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:00:08.949484 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-196c1439-7b0c-4658-8232-dfd96c9f3554 tempest-VolumesSnapshotsTestJSON-145105073 tempest-VolumesSnapshotsTestJSON-145105073-project] Calling method '.version_select at 0x7ff1bb705280>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:08.964348 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c47a28e3-f822-4d69-ad1d-de46efb3aa08 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a845ca1e7747fba0a987235d980098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca57a0af591a43ee9cdef09134bc3fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:00:08.969701 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=100 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:00:08.974179 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c47a28e3-f822-4d69-ad1d-de46efb3aa08 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] 10.222.0.33 "GET /compute/v2.1/servers/1d4b42f4-3285-41c7-8264-e596b9d8ac02" status: 200 len: 1506 microversion: 2.1 time: 0.612932 Sep 23 05:00:08.975017 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2835/5835] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:00:08 2022] GET /compute/v2.1/servers/1d4b42f4-3285-41c7-8264-e596b9d8ac02 => generated 1506 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:00:09.010695 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-196c1439-7b0c-4658-8232-dfd96c9f3554 tempest-VolumesSnapshotsTestJSON-145105073 tempest-VolumesSnapshotsTestJSON-145105073-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/cbf55dae-6101-4964-b9dc-aef20750da53" status: 200 len: 287 microversion: 2.1 time: 0.073097 Sep 23 05:00:09.012020 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3001/5836] 10.222.0.33 () {58 vars in 1251 bytes} [Fri Sep 23 05:00:08 2022] GET /compute/v2.1/os-snapshots/cbf55dae-6101-4964-b9dc-aef20750da53 => generated 287 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:00:09.699185 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-98cc47fc-5170-41b2-8cb2-43b97122277e req-dfe62ad7-7e6b-43f7-aaf0-93265b4e0fd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61ca86da-7aaf-4963-8a82-28358de74ec2", "name": "network-vif-deleted", "tag": "cae6c210-c213-4d27-87ab-f0d87503e39d"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:00:09.715368 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-98cc47fc-5170-41b2-8cb2-43b97122277e req-dfe62ad7-7e6b-43f7-aaf0-93265b4e0fd5 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:09.720492 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-98cc47fc-5170-41b2-8cb2-43b97122277e req-dfe62ad7-7e6b-43f7-aaf0-93265b4e0fd5 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:09.720756 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-98cc47fc-5170-41b2-8cb2-43b97122277e req-dfe62ad7-7e6b-43f7-aaf0-93265b4e0fd5 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:09.743018 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-98cc47fc-5170-41b2-8cb2-43b97122277e req-dfe62ad7-7e6b-43f7-aaf0-93265b4e0fd5 service nova] Creating event network-vif-deleted:cae6c210-c213-4d27-87ab-f0d87503e39d for instance 61ca86da-7aaf-4963-8a82-28358de74ec2 on n-h2-846463-3 Sep 23 05:00:09.755869 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-98cc47fc-5170-41b2-8cb2-43b97122277e req-dfe62ad7-7e6b-43f7-aaf0-93265b4e0fd5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060695 Sep 23 05:00:09.758855 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2836/5837] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:00:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:00:09.966077 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a216bc66-90b4-4c50-a951-3c56ef7e1f67 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:09.967559 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a216bc66-90b4-4c50-a951-3c56ef7e1f67 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] [instance: 61ca86da-7aaf-4963-8a82-28358de74ec2] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:00:09.979066 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a216bc66-90b4-4c50-a951-3c56ef7e1f67 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:09.980390 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a216bc66-90b4-4c50-a951-3c56ef7e1f67 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:09.981082 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a216bc66-90b4-4c50-a951-3c56ef7e1f67 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:09.983392 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a216bc66-90b4-4c50-a951-3c56ef7e1f67 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:09.984812 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a216bc66-90b4-4c50-a951-3c56ef7e1f67 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:09.989633 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a216bc66-90b4-4c50-a951-3c56ef7e1f67 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:10.001652 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4381bbca-d2ea-4897-b871-58c66bb18886 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:10.003104 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4381bbca-d2ea-4897-b871-58c66bb18886 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] [instance: 1d4b42f4-3285-41c7-8264-e596b9d8ac02] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:00:10.010313 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4381bbca-d2ea-4897-b871-58c66bb18886 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:10.011152 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4381bbca-d2ea-4897-b871-58c66bb18886 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:10.011826 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4381bbca-d2ea-4897-b871-58c66bb18886 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:10.012730 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4381bbca-d2ea-4897-b871-58c66bb18886 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:10.013368 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4381bbca-d2ea-4897-b871-58c66bb18886 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:10.014003 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4381bbca-d2ea-4897-b871-58c66bb18886 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:10.161797 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a216bc66-90b4-4c50-a951-3c56ef7e1f67 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a04cca628a834f368a96738a56dd0244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445c2c4630a5428cb51499a0fdf170fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:00:10.173534 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a216bc66-90b4-4c50-a951-3c56ef7e1f67 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] 10.222.0.33 "GET /compute/v2.1/servers/61ca86da-7aaf-4963-8a82-28358de74ec2" status: 200 len: 1298 microversion: 2.1 time: 0.212897 Sep 23 05:00:10.175752 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3002/5838] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:00:09 2022] GET /compute/v2.1/servers/61ca86da-7aaf-4963-8a82-28358de74ec2 => generated 1298 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:00:10.191495 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-934dbd10-6915-425e-a088-457a9514cf8e tempest-VolumesSnapshotsTestJSON-145105073 tempest-VolumesSnapshotsTestJSON-145105073-project] Calling method '.version_select at 0x7ff1babe80d0>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:10.223919 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-934dbd10-6915-425e-a088-457a9514cf8e tempest-VolumesSnapshotsTestJSON-145105073 tempest-VolumesSnapshotsTestJSON-145105073-project] HTTP exception thrown: Snapshot cbf55dae-6101-4964-b9dc-aef20750da53 could not be found. Sep 23 05:00:10.233803 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-934dbd10-6915-425e-a088-457a9514cf8e tempest-VolumesSnapshotsTestJSON-145105073 tempest-VolumesSnapshotsTestJSON-145105073-project] Request method failure captured: Sep 23 05:00:10.233803 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/os-snapshots/cbf55dae-6101-4964-b9dc-aef20750da53 HTTP/1.1 Sep 23 05:00:10.233803 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 05:00:10.233803 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 05:00:10.233803 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 05:00:10.233803 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 05:00:10.233803 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 05:00:10.233803 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 05:00:10.233803 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 05:00:10.233803 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 05:00:10.233803 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLT1OcGd3b1TP2TyLaydO0RLh4mmXClCiaFcVUe3YcjXohBAKgt1N1WLuaaVOph-S-KGQH1uiihIrYFVo088PEualPWOpZAdimuru95wosI6VPGqZ2_Ne4vqRX3AAkUDl1hdvwdei3giYjgt5_IHdBXqLrBh3_jYvxkC9LuC4EaXJvn0 Sep 23 05:00:10.233803 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 05:00:10.233803 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 05:00:10.233803 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 05:00:10.233803 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 05:00:10.233803 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 05:00:10.233803 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 05:00:10.233803 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 5cda4937eeb346c1814741d7d8462cfa Sep 23 05:00:10.233803 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-145105073 Sep 23 05:00:10.233803 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 05:00:10.233803 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 05:00:10.233803 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5cda4937eeb346c1814741d7d8462cfa", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5cda4937eeb346c1814741d7d8462cfa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5cda4937eeb346c1814741d7d8462cfa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5cda4937eeb346c1814741d7d8462cfa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:00:10.233803 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-VolumesSnapshotsTestJSON-145105073 Sep 23 05:00:10.233803 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 5cda4937eeb346c1814741d7d8462cfa Sep 23 05:00:10.233803 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-145105073 Sep 23 05:00:10.233803 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-VolumesSnapshotsTestJSON-145105073-project Sep 23 05:00:10.233803 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 05:00:10.233803 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 05:00:10.233803 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: e1c4e8864e954b09ab5aa642514eaf16 Sep 23 05:00:10.233803 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-VolumesSnapshotsTestJSON-145105073-project Sep 23 05:00:10.233803 n-d-846463-3 devstack@n-api.service[122699]: method: Sep 23 05:00:10.233803 n-d-846463-3 devstack@n-api.service[122699]: exception: Snapshot cbf55dae-6101-4964-b9dc-aef20750da53 could not be found. Sep 23 05:00:10.233803 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': 'cbf55dae-6101-4964-b9dc-aef20750da53'} Sep 23 05:00:10.233803 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:00:10.233803 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:00:10.233803 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 23 05:00:10.233803 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 23 05:00:10.233803 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 23 05:00:10.233803 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 23 05:00:10.233803 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 23 05:00:10.233803 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 23 05:00:10.233803 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 23 05:00:10.233803 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 23 05:00:10.233803 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 23 05:00:10.233803 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 23 05:00:10.233803 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 23 05:00:10.233803 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 23 05:00:10.233803 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 23 05:00:10.233803 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 23 05:00:10.233803 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot cbf55dae-6101-4964-b9dc-aef20750da53 could not be found. (HTTP 404) (Request-ID: req-0374a8b9-1af8-4152-ba7a-cbcdea75056b) Sep 23 05:00:10.233803 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:00:10.233803 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:00:10.233803 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:00:10.233803 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:00:10.233803 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 23 05:00:10.233803 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 23 05:00:10.233803 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 23 05:00:10.233803 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 23 05:00:10.233803 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 23 05:00:10.233803 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 23 05:00:10.233803 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 23 05:00:10.233803 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 23 05:00:10.237882 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 23 05:00:10.237882 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 23 05:00:10.237882 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 23 05:00:10.237882 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 23 05:00:10.237882 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 23 05:00:10.237882 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 23 05:00:10.237882 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 23 05:00:10.237882 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 23 05:00:10.237882 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 23 05:00:10.237882 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 23 05:00:10.237882 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 23 05:00:10.237882 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 23 05:00:10.237882 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 23 05:00:10.237882 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 23 05:00:10.237882 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot cbf55dae-6101-4964-b9dc-aef20750da53 could not be found. Sep 23 05:00:10.237882 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:00:10.237882 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:00:10.237882 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:00:10.237882 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:00:10.237882 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:00:10.237882 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:00:10.237882 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:00:10.237882 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:00:10.237882 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 05:00:10.237882 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 05:00:10.237882 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:00:10.237882 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:00:10.237882 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 23 05:00:10.237882 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:00:10.237882 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot cbf55dae-6101-4964-b9dc-aef20750da53 could not be found. Sep 23 05:00:10.237882 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:00:10.237882 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:00:10.237882 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:00:10.237882 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:00:10.237882 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:00:10.237882 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:00:10.237882 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:00:10.237882 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:00:10.237882 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot cbf55dae-6101-4964-b9dc-aef20750da53 could not be found. Sep 23 05:00:10.237882 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:00:10.237882 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-934dbd10-6915-425e-a088-457a9514cf8e tempest-VolumesSnapshotsTestJSON-145105073 tempest-VolumesSnapshotsTestJSON-145105073-project] Returning 404 to user: Snapshot cbf55dae-6101-4964-b9dc-aef20750da53 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:00:10.237882 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-934dbd10-6915-425e-a088-457a9514cf8e tempest-VolumesSnapshotsTestJSON-145105073 tempest-VolumesSnapshotsTestJSON-145105073-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/cbf55dae-6101-4964-b9dc-aef20750da53" status: 404 len: 111 microversion: 2.1 time: 0.058445 Sep 23 05:00:10.244586 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3003/5839] 10.222.0.33 () {58 vars in 1251 bytes} [Fri Sep 23 05:00:10 2022] GET /compute/v2.1/os-snapshots/cbf55dae-6101-4964-b9dc-aef20750da53 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 05:00:10.246661 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-91fea72c-5ce7-4914-a8fb-e7047b8361ef tempest-VolumesSnapshotsTestJSON-145105073 tempest-VolumesSnapshotsTestJSON-145105073-project] Calling method '.version_select at 0x7ff1c3e6d700>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:10.390480 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4381bbca-d2ea-4897-b871-58c66bb18886 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a845ca1e7747fba0a987235d980098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca57a0af591a43ee9cdef09134bc3fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:00:10.399223 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4381bbca-d2ea-4897-b871-58c66bb18886 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] 10.222.0.33 "GET /compute/v2.1/servers/1d4b42f4-3285-41c7-8264-e596b9d8ac02" status: 200 len: 1506 microversion: 2.1 time: 0.403055 Sep 23 05:00:10.409436 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2837/5840] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:00:09 2022] GET /compute/v2.1/servers/1d4b42f4-3285-41c7-8264-e596b9d8ac02 => generated 1506 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:00:10.554531 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-91fea72c-5ce7-4914-a8fb-e7047b8361ef tempest-VolumesSnapshotsTestJSON-145105073 tempest-VolumesSnapshotsTestJSON-145105073-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/540b558a-91e5-4e5a-ac7c-d1622ea43daa" status: 202 len: 0 microversion: 2.1 time: 0.311925 Sep 23 05:00:10.555926 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3004/5841] 10.222.0.33 () {58 vars in 1248 bytes} [Fri Sep 23 05:00:10 2022] DELETE /compute/v2.1/os-volumes/540b558a-91e5-4e5a-ac7c-d1622ea43daa => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 05:00:10.564188 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0b52c5f5-a95d-42a3-b09f-a088f453a9cd tempest-VolumesSnapshotsTestJSON-145105073 tempest-VolumesSnapshotsTestJSON-145105073-project] Calling method '.version_select at 0x7ff1bbbfb430>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:10.646145 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0b52c5f5-a95d-42a3-b09f-a088f453a9cd tempest-VolumesSnapshotsTestJSON-145105073 tempest-VolumesSnapshotsTestJSON-145105073-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/540b558a-91e5-4e5a-ac7c-d1622ea43daa" status: 200 len: 344 microversion: 2.1 time: 0.085990 Sep 23 05:00:10.646987 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2838/5842] 10.222.0.33 () {58 vars in 1245 bytes} [Fri Sep 23 05:00:10 2022] GET /compute/v2.1/os-volumes/540b558a-91e5-4e5a-ac7c-d1622ea43daa => generated 344 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:00:11.077646 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4c2fb14b-070f-4217-8a53-806985f209ae tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:11.080035 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4c2fb14b-070f-4217-8a53-806985f209ae tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] [instance: ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:00:11.094109 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4c2fb14b-070f-4217-8a53-806985f209ae tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:11.094619 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4c2fb14b-070f-4217-8a53-806985f209ae tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:11.095066 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4c2fb14b-070f-4217-8a53-806985f209ae tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:11.095787 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4c2fb14b-070f-4217-8a53-806985f209ae tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:11.096260 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4c2fb14b-070f-4217-8a53-806985f209ae tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:11.096697 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4c2fb14b-070f-4217-8a53-806985f209ae tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:11.200390 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-186a9997-296e-433c-b0bb-8cb46fbe9b30 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:11.201185 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-186a9997-296e-433c-b0bb-8cb46fbe9b30 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] [instance: 61ca86da-7aaf-4963-8a82-28358de74ec2] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:00:11.223671 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-186a9997-296e-433c-b0bb-8cb46fbe9b30 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:11.227595 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-186a9997-296e-433c-b0bb-8cb46fbe9b30 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:11.236081 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-186a9997-296e-433c-b0bb-8cb46fbe9b30 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:11.240790 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-186a9997-296e-433c-b0bb-8cb46fbe9b30 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:11.241293 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-186a9997-296e-433c-b0bb-8cb46fbe9b30 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:11.241733 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-186a9997-296e-433c-b0bb-8cb46fbe9b30 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:11.264841 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4c2fb14b-070f-4217-8a53-806985f209ae tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] 10.222.0.33 "GET /compute/v2.1/servers/ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.185611 Sep 23 05:00:11.270428 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3005/5843] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Sep 23 05:00:11 2022] GET /compute/v2.1/servers/ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7/os-volume_attachments => generated 371 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:00:11.338485 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-186a9997-296e-433c-b0bb-8cb46fbe9b30 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] HTTP exception thrown: Instance 61ca86da-7aaf-4963-8a82-28358de74ec2 could not be found. Sep 23 05:00:11.348612 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-186a9997-296e-433c-b0bb-8cb46fbe9b30 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Request method failure captured: Sep 23 05:00:11.348612 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/61ca86da-7aaf-4963-8a82-28358de74ec2 HTTP/1.1 Sep 23 05:00:11.348612 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 05:00:11.348612 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 05:00:11.348612 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 05:00:11.348612 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 05:00:11.348612 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 05:00:11.348612 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 05:00:11.348612 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 05:00:11.348612 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 05:00:11.348612 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLT0374jDMqnk8e1bY-xji1DrGY6dtEKbOvKcxzEd1tJ5BM7IAcIgObwEPLilc7QXfADYKBXCsi1nzl82GeGZE8vyEuN7iqHRJbSIa8J-PO4LR6ipEi4wpDeODRq17mMN0vHPtdJfvpyVRU29MBKvVF63xXX9OU5teWQXZie-jQR045I Sep 23 05:00:11.348612 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 05:00:11.348612 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 05:00:11.348612 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 05:00:11.348612 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 05:00:11.348612 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 05:00:11.348612 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 05:00:11.348612 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 445c2c4630a5428cb51499a0fdf170fe Sep 23 05:00:11.348612 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-VolumesActionsTest-1600379269 Sep 23 05:00:11.348612 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 05:00:11.348612 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 05:00:11.348612 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_445c2c4630a5428cb51499a0fdf170fe", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/445c2c4630a5428cb51499a0fdf170fe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/445c2c4630a5428cb51499a0fdf170fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/445c2c4630a5428cb51499a0fdf170fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:00:11.348612 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-VolumesActionsTest-1600379269 Sep 23 05:00:11.348612 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 445c2c4630a5428cb51499a0fdf170fe Sep 23 05:00:11.348612 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-VolumesActionsTest-1600379269 Sep 23 05:00:11.348612 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-VolumesActionsTest-1600379269-project Sep 23 05:00:11.348612 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 05:00:11.348612 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 05:00:11.348612 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: a04cca628a834f368a96738a56dd0244 Sep 23 05:00:11.348612 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-VolumesActionsTest-1600379269-project Sep 23 05:00:11.348612 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 05:00:11.348612 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 61ca86da-7aaf-4963-8a82-28358de74ec2 could not be found. Sep 23 05:00:11.348612 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '61ca86da-7aaf-4963-8a82-28358de74ec2'} Sep 23 05:00:11.348612 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:00:11.348612 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:00:11.348612 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 05:00:11.348612 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 05:00:11.348612 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 05:00:11.348612 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 05:00:11.348612 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 05:00:11.348612 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 05:00:11.348612 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 05:00:11.348612 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 05:00:11.348612 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61ca86da-7aaf-4963-8a82-28358de74ec2 could not be found. Sep 23 05:00:11.348612 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:00:11.348612 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:00:11.348612 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:00:11.348612 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:00:11.348612 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:00:11.348612 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:00:11.348612 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:00:11.348612 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:00:11.348612 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:00:11.348612 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:00:11.348612 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 05:00:11.348612 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 05:00:11.348612 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 05:00:11.348612 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 05:00:11.348612 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 05:00:11.348612 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:00:11.348612 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61ca86da-7aaf-4963-8a82-28358de74ec2 could not be found. Sep 23 05:00:11.348612 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:00:11.348612 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:00:11.348612 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:00:11.352612 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:00:11.352612 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:00:11.352612 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:00:11.352612 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:00:11.352612 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:00:11.352612 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61ca86da-7aaf-4963-8a82-28358de74ec2 could not be found. Sep 23 05:00:11.352612 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:00:11.352612 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-186a9997-296e-433c-b0bb-8cb46fbe9b30 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] Returning 404 to user: Instance 61ca86da-7aaf-4963-8a82-28358de74ec2 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:00:11.358739 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-186a9997-296e-433c-b0bb-8cb46fbe9b30 tempest-VolumesActionsTest-1600379269 tempest-VolumesActionsTest-1600379269-project] 10.222.0.33 "GET /compute/v2.1/servers/61ca86da-7aaf-4963-8a82-28358de74ec2" status: 404 len: 111 microversion: 2.1 time: 0.154268 Sep 23 05:00:11.366380 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2839/5844] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:00:11 2022] GET /compute/v2.1/servers/61ca86da-7aaf-4963-8a82-28358de74ec2 => generated 111 bytes in 171 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 05:00:11.425719 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ba1c75b3-61e3-43b1-9bf1-793aee60a27b tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:11.435235 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a8117592-fd0d-42c1-82cc-c9c154ea0da0 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:11.435752 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a8117592-fd0d-42c1-82cc-c9c154ea0da0 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] [instance: ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:00:11.448003 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ba1c75b3-61e3-43b1-9bf1-793aee60a27b tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] [instance: 1d4b42f4-3285-41c7-8264-e596b9d8ac02] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:00:11.454732 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a8117592-fd0d-42c1-82cc-c9c154ea0da0 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:11.462375 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a8117592-fd0d-42c1-82cc-c9c154ea0da0 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:11.463142 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a8117592-fd0d-42c1-82cc-c9c154ea0da0 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:11.464466 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a8117592-fd0d-42c1-82cc-c9c154ea0da0 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:11.465636 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ba1c75b3-61e3-43b1-9bf1-793aee60a27b tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:11.466342 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a8117592-fd0d-42c1-82cc-c9c154ea0da0 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:11.467151 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ba1c75b3-61e3-43b1-9bf1-793aee60a27b tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:11.467761 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a8117592-fd0d-42c1-82cc-c9c154ea0da0 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:11.469927 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ba1c75b3-61e3-43b1-9bf1-793aee60a27b tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:11.473057 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ba1c75b3-61e3-43b1-9bf1-793aee60a27b tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:11.477709 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ba1c75b3-61e3-43b1-9bf1-793aee60a27b tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:11.480579 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ba1c75b3-61e3-43b1-9bf1-793aee60a27b tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:11.582148 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a8117592-fd0d-42c1-82cc-c9c154ea0da0 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] 10.222.0.33 "GET /compute/v2.1/servers/ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7/os-volume_attachments/0e3e692a-a65c-40d7-a31b-621abeb1ac09" status: 200 len: 194 microversion: 2.1 time: 0.160113 Sep 23 05:00:11.587138 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2840/5845] 10.222.0.33 () {58 vars in 1413 bytes} [Fri Sep 23 05:00:11 2022] GET /compute/v2.1/servers/ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7/os-volume_attachments/0e3e692a-a65c-40d7-a31b-621abeb1ac09 => generated 194 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:00:11.601689 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b35238a7-64c1-48ff-a015-c5c7a41d28c0 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:11.603110 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b35238a7-64c1-48ff-a015-c5c7a41d28c0 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] [instance: ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:00:11.610945 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b35238a7-64c1-48ff-a015-c5c7a41d28c0 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:11.611455 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b35238a7-64c1-48ff-a015-c5c7a41d28c0 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:11.613978 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b35238a7-64c1-48ff-a015-c5c7a41d28c0 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:11.613978 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b35238a7-64c1-48ff-a015-c5c7a41d28c0 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:11.613978 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b35238a7-64c1-48ff-a015-c5c7a41d28c0 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:11.613978 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b35238a7-64c1-48ff-a015-c5c7a41d28c0 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:12.089991 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-b35238a7-64c1-48ff-a015-c5c7a41d28c0 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lazy-loading 'services' on Instance uuid ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7 {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 05:00:12.366401 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ba1c75b3-61e3-43b1-9bf1-793aee60a27b tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a845ca1e7747fba0a987235d980098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca57a0af591a43ee9cdef09134bc3fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:00:12.377983 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ba1c75b3-61e3-43b1-9bf1-793aee60a27b tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] 10.222.0.33 "GET /compute/v2.1/servers/1d4b42f4-3285-41c7-8264-e596b9d8ac02" status: 200 len: 1506 microversion: 2.1 time: 0.956894 Sep 23 05:00:12.379203 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3006/5846] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:00:11 2022] GET /compute/v2.1/servers/1d4b42f4-3285-41c7-8264-e596b9d8ac02 => generated 1506 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:00:12.386585 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-21c4050f-909b-4b37-aa39-f591905b8f7a tempest-VolumesSnapshotsTestJSON-145105073 tempest-VolumesSnapshotsTestJSON-145105073-project] Calling method '.version_select at 0x7ff1babe8670>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:12.413447 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b35238a7-64c1-48ff-a015-c5c7a41d28c0 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7/os-volume_attachments/0e3e692a-a65c-40d7-a31b-621abeb1ac09" status: 202 len: 0 microversion: 2.1 time: 0.818928 Sep 23 05:00:12.419529 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2841/5847] 10.222.0.33 () {58 vars in 1416 bytes} [Fri Sep 23 05:00:11 2022] DELETE /compute/v2.1/servers/ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7/os-volume_attachments/0e3e692a-a65c-40d7-a31b-621abeb1ac09 => generated 0 bytes in 824 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 05:00:12.509530 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-21c4050f-909b-4b37-aa39-f591905b8f7a tempest-VolumesSnapshotsTestJSON-145105073 tempest-VolumesSnapshotsTestJSON-145105073-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/540b558a-91e5-4e5a-ac7c-d1622ea43daa" status: 200 len: 344 microversion: 2.1 time: 0.122830 Sep 23 05:00:12.511088 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3007/5848] 10.222.0.33 () {58 vars in 1245 bytes} [Fri Sep 23 05:00:12 2022] GET /compute/v2.1/os-volumes/540b558a-91e5-4e5a-ac7c-d1622ea43daa => generated 344 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:00:13.404544 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-408417af-efbb-47b3-b803-ef96e27c4f9a tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:13.405179 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-408417af-efbb-47b3-b803-ef96e27c4f9a tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] [instance: 1d4b42f4-3285-41c7-8264-e596b9d8ac02] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:00:13.422744 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-408417af-efbb-47b3-b803-ef96e27c4f9a tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:13.423434 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-408417af-efbb-47b3-b803-ef96e27c4f9a tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:13.423671 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-408417af-efbb-47b3-b803-ef96e27c4f9a tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:13.433011 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-408417af-efbb-47b3-b803-ef96e27c4f9a tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:13.435080 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-408417af-efbb-47b3-b803-ef96e27c4f9a tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:13.436206 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-408417af-efbb-47b3-b803-ef96e27c4f9a tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:13.522733 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8cce49de-9433-4927-8ee0-e7cbc8ef7935 tempest-VolumesSnapshotsTestJSON-145105073 tempest-VolumesSnapshotsTestJSON-145105073-project] Calling method '.version_select at 0x7ff1bb731a60>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:13.678590 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-8cce49de-9433-4927-8ee0-e7cbc8ef7935 tempest-VolumesSnapshotsTestJSON-145105073 tempest-VolumesSnapshotsTestJSON-145105073-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/540b558a-91e5-4e5a-ac7c-d1622ea43daa" status: 200 len: 344 microversion: 2.1 time: 0.156715 Sep 23 05:00:13.681225 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3008/5849] 10.222.0.33 () {58 vars in 1245 bytes} [Fri Sep 23 05:00:13 2022] GET /compute/v2.1/os-volumes/540b558a-91e5-4e5a-ac7c-d1622ea43daa => generated 344 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 05:00:13.802304 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-408417af-efbb-47b3-b803-ef96e27c4f9a tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a845ca1e7747fba0a987235d980098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca57a0af591a43ee9cdef09134bc3fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:00:13.811427 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-408417af-efbb-47b3-b803-ef96e27c4f9a tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] 10.222.0.33 "GET /compute/v2.1/servers/1d4b42f4-3285-41c7-8264-e596b9d8ac02" status: 200 len: 1506 microversion: 2.1 time: 0.412390 Sep 23 05:00:13.813976 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2842/5850] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:00:13 2022] GET /compute/v2.1/servers/1d4b42f4-3285-41c7-8264-e596b9d8ac02 => generated 1506 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:00:13.875876 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e22268c9-08af-4ead-a3f6-66c936e2cccf tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:13.876504 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e22268c9-08af-4ead-a3f6-66c936e2cccf tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 7f05d753-e297-4330-ba02-dc0aac76de96] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:00:13.894868 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e22268c9-08af-4ead-a3f6-66c936e2cccf tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:13.895363 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e22268c9-08af-4ead-a3f6-66c936e2cccf tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:13.896977 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e22268c9-08af-4ead-a3f6-66c936e2cccf tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:13.896977 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e22268c9-08af-4ead-a3f6-66c936e2cccf tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:13.899602 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e22268c9-08af-4ead-a3f6-66c936e2cccf tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:13.902704 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e22268c9-08af-4ead-a3f6-66c936e2cccf tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:14.224700 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e22268c9-08af-4ead-a3f6-66c936e2cccf tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:00:14.235384 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e22268c9-08af-4ead-a3f6-66c936e2cccf tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/7f05d753-e297-4330-ba02-dc0aac76de96" status: 200 len: 1681 microversion: 2.1 time: 0.366214 Sep 23 05:00:14.251298 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3009/5851] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:00:13 2022] GET /compute/v2.1/servers/7f05d753-e297-4330-ba02-dc0aac76de96 => generated 1681 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:00:14.395661 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-fdf9600f-bbeb-4350-b69c-ffe38cf0f7c8 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:00:14.398290 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-fdf9600f-bbeb-4350-b69c-ffe38cf0f7c8 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 7f05d753-e297-4330-ba02-dc0aac76de96] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:00:14.405232 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fdf9600f-bbeb-4350-b69c-ffe38cf0f7c8 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:14.406016 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fdf9600f-bbeb-4350-b69c-ffe38cf0f7c8 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:14.406650 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fdf9600f-bbeb-4350-b69c-ffe38cf0f7c8 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:14.407535 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fdf9600f-bbeb-4350-b69c-ffe38cf0f7c8 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:14.408164 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fdf9600f-bbeb-4350-b69c-ffe38cf0f7c8 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:14.408762 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fdf9600f-bbeb-4350-b69c-ffe38cf0f7c8 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:14.498352 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-fdf9600f-bbeb-4350-b69c-ffe38cf0f7c8 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "POST /compute/v2.1/servers/7f05d753-e297-4330-ba02-dc0aac76de96/action" status: 200 len: 32645 microversion: 2.1 time: 0.106512 Sep 23 05:00:14.506952 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2843/5852] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 05:00:14 2022] POST /compute/v2.1/servers/7f05d753-e297-4330-ba02-dc0aac76de96/action => generated 32645 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 05:00:14.638524 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7b135a55-5d75-4055-b773-e2a916960b2b tempest-TestNetworkAdvancedServerOps-1586243358 tempest-TestNetworkAdvancedServerOps-1586243358-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:14.639831 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-7b135a55-5d75-4055-b773-e2a916960b2b tempest-TestNetworkAdvancedServerOps-1586243358 tempest-TestNetworkAdvancedServerOps-1586243358-project-admin] [instance: 7f05d753-e297-4330-ba02-dc0aac76de96] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:00:14.658697 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7b135a55-5d75-4055-b773-e2a916960b2b tempest-TestNetworkAdvancedServerOps-1586243358 tempest-TestNetworkAdvancedServerOps-1586243358-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:14.659442 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7b135a55-5d75-4055-b773-e2a916960b2b tempest-TestNetworkAdvancedServerOps-1586243358 tempest-TestNetworkAdvancedServerOps-1586243358-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:14.661348 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7b135a55-5d75-4055-b773-e2a916960b2b tempest-TestNetworkAdvancedServerOps-1586243358 tempest-TestNetworkAdvancedServerOps-1586243358-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:14.664170 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7b135a55-5d75-4055-b773-e2a916960b2b tempest-TestNetworkAdvancedServerOps-1586243358 tempest-TestNetworkAdvancedServerOps-1586243358-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:14.666176 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7b135a55-5d75-4055-b773-e2a916960b2b tempest-TestNetworkAdvancedServerOps-1586243358 tempest-TestNetworkAdvancedServerOps-1586243358-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:14.666795 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7b135a55-5d75-4055-b773-e2a916960b2b tempest-TestNetworkAdvancedServerOps-1586243358 tempest-TestNetworkAdvancedServerOps-1586243358-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:14.698670 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-93207e47-a3b2-41fd-8cca-5da41fe77440 tempest-VolumesSnapshotsTestJSON-145105073 tempest-VolumesSnapshotsTestJSON-145105073-project] Calling method '.version_select at 0x7ff1ba889430>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:14.794807 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-93207e47-a3b2-41fd-8cca-5da41fe77440 tempest-VolumesSnapshotsTestJSON-145105073 tempest-VolumesSnapshotsTestJSON-145105073-project] HTTP exception thrown: Volume 540b558a-91e5-4e5a-ac7c-d1622ea43daa could not be found. Sep 23 05:00:14.797246 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-93207e47-a3b2-41fd-8cca-5da41fe77440 tempest-VolumesSnapshotsTestJSON-145105073 tempest-VolumesSnapshotsTestJSON-145105073-project] Request method failure captured: Sep 23 05:00:14.797246 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/os-volumes/540b558a-91e5-4e5a-ac7c-d1622ea43daa HTTP/1.1 Sep 23 05:00:14.797246 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 05:00:14.797246 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 05:00:14.797246 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 05:00:14.797246 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 05:00:14.797246 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 05:00:14.797246 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 05:00:14.797246 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 05:00:14.797246 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 05:00:14.797246 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLT1OcGd3b1TP2TyLaydO0RLh4mmXClCiaFcVUe3YcjXohBAKgt1N1WLuaaVOph-S-KGQH1uiihIrYFVo088PEualPWOpZAdimuru95wosI6VPGqZ2_Ne4vqRX3AAkUDl1hdvwdei3giYjgt5_IHdBXqLrBh3_jYvxkC9LuC4EaXJvn0 Sep 23 05:00:14.797246 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 05:00:14.797246 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 05:00:14.797246 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 05:00:14.797246 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 05:00:14.797246 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 05:00:14.797246 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 05:00:14.797246 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 5cda4937eeb346c1814741d7d8462cfa Sep 23 05:00:14.797246 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-145105073 Sep 23 05:00:14.797246 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 05:00:14.797246 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 05:00:14.797246 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5cda4937eeb346c1814741d7d8462cfa", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5cda4937eeb346c1814741d7d8462cfa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5cda4937eeb346c1814741d7d8462cfa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5cda4937eeb346c1814741d7d8462cfa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:00:14.797246 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-VolumesSnapshotsTestJSON-145105073 Sep 23 05:00:14.797246 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 5cda4937eeb346c1814741d7d8462cfa Sep 23 05:00:14.797246 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-145105073 Sep 23 05:00:14.797246 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-VolumesSnapshotsTestJSON-145105073-project Sep 23 05:00:14.797246 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 05:00:14.797246 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 05:00:14.797246 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: e1c4e8864e954b09ab5aa642514eaf16 Sep 23 05:00:14.797246 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-VolumesSnapshotsTestJSON-145105073-project Sep 23 05:00:14.797246 n-d-846463-3 devstack@n-api.service[122698]: method: Sep 23 05:00:14.797246 n-d-846463-3 devstack@n-api.service[122698]: exception: Volume 540b558a-91e5-4e5a-ac7c-d1622ea43daa could not be found. Sep 23 05:00:14.797246 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '540b558a-91e5-4e5a-ac7c-d1622ea43daa'} Sep 23 05:00:14.797246 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:00:14.797246 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:00:14.797246 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 23 05:00:14.797246 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 23 05:00:14.797246 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 23 05:00:14.797246 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 23 05:00:14.797246 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 23 05:00:14.797246 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 23 05:00:14.797246 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 23 05:00:14.797246 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 23 05:00:14.797246 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 23 05:00:14.797246 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 23 05:00:14.797246 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 23 05:00:14.797246 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 23 05:00:14.797246 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 23 05:00:14.797246 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 23 05:00:14.797246 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 540b558a-91e5-4e5a-ac7c-d1622ea43daa could not be found. (HTTP 404) (Request-ID: req-e8551ee9-830a-4dab-8341-c4e7c21505cf) Sep 23 05:00:14.797246 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:00:14.797246 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:00:14.797246 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:00:14.797246 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:00:14.797246 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 23 05:00:14.797246 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 23 05:00:14.797246 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 23 05:00:14.797246 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 23 05:00:14.797246 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 23 05:00:14.797246 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 23 05:00:14.797246 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 23 05:00:14.797246 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 23 05:00:14.797246 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 23 05:00:14.806484 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 23 05:00:14.806484 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 23 05:00:14.806484 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 23 05:00:14.806484 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 23 05:00:14.806484 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 23 05:00:14.806484 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 23 05:00:14.806484 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 23 05:00:14.806484 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 23 05:00:14.806484 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 23 05:00:14.806484 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 23 05:00:14.806484 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 23 05:00:14.806484 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 23 05:00:14.806484 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 23 05:00:14.806484 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 540b558a-91e5-4e5a-ac7c-d1622ea43daa could not be found. Sep 23 05:00:14.806484 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:00:14.806484 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:00:14.806484 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:00:14.806484 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:00:14.806484 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:00:14.806484 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:00:14.806484 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:00:14.806484 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:00:14.806484 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 05:00:14.806484 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 05:00:14.806484 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:00:14.806484 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:00:14.806484 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 23 05:00:14.806484 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:00:14.806484 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 540b558a-91e5-4e5a-ac7c-d1622ea43daa could not be found. Sep 23 05:00:14.806484 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:00:14.806484 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:00:14.806484 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:00:14.806484 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:00:14.806484 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:00:14.806484 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:00:14.806484 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:00:14.806484 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:00:14.806484 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 540b558a-91e5-4e5a-ac7c-d1622ea43daa could not be found. Sep 23 05:00:14.806484 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:00:14.806484 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-93207e47-a3b2-41fd-8cca-5da41fe77440 tempest-VolumesSnapshotsTestJSON-145105073 tempest-VolumesSnapshotsTestJSON-145105073-project] Returning 404 to user: Volume 540b558a-91e5-4e5a-ac7c-d1622ea43daa could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:00:14.806484 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-93207e47-a3b2-41fd-8cca-5da41fe77440 tempest-VolumesSnapshotsTestJSON-145105073 tempest-VolumesSnapshotsTestJSON-145105073-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/540b558a-91e5-4e5a-ac7c-d1622ea43daa" status: 404 len: 109 microversion: 2.1 time: 0.108532 Sep 23 05:00:14.806484 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2844/5853] 10.222.0.33 () {58 vars in 1245 bytes} [Fri Sep 23 05:00:14 2022] GET /compute/v2.1/os-volumes/540b558a-91e5-4e5a-ac7c-d1622ea43daa => generated 109 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 05:00:14.811583 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b2802216-950c-497e-b77c-8a8ff8f940d9 tempest-VolumesSnapshotsTestJSON-145105073 tempest-VolumesSnapshotsTestJSON-145105073-project] Calling method '.version_select at 0x7ff1ba9ad5e0>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:14.947099 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-7b135a55-5d75-4055-b773-e2a916960b2b tempest-TestNetworkAdvancedServerOps-1586243358 tempest-TestNetworkAdvancedServerOps-1586243358-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/7f05d753-e297-4330-ba02-dc0aac76de96" status: 200 len: 1832 microversion: 2.1 time: 0.313933 Sep 23 05:00:14.949487 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3010/5854] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:00:14 2022] GET /compute/v2.1/servers/7f05d753-e297-4330-ba02-dc0aac76de96 => generated 1832 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:00:14.966549 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-78ec1954-5f41-4ef1-850a-7dedfa02ee59 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:14.969511 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-78ec1954-5f41-4ef1-850a-7dedfa02ee59 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] [instance: 1d4b42f4-3285-41c7-8264-e596b9d8ac02] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:00:14.986224 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-78ec1954-5f41-4ef1-850a-7dedfa02ee59 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:14.986224 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-78ec1954-5f41-4ef1-850a-7dedfa02ee59 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:14.986224 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-78ec1954-5f41-4ef1-850a-7dedfa02ee59 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:14.988851 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-78ec1954-5f41-4ef1-850a-7dedfa02ee59 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:14.992202 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-78ec1954-5f41-4ef1-850a-7dedfa02ee59 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:14.993144 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-78ec1954-5f41-4ef1-850a-7dedfa02ee59 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:15.021490 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-b2802216-950c-497e-b77c-8a8ff8f940d9 tempest-VolumesSnapshotsTestJSON-145105073 tempest-VolumesSnapshotsTestJSON-145105073-project] HTTP exception thrown: Volume 540b558a-91e5-4e5a-ac7c-d1622ea43daa could not be found. Sep 23 05:00:15.024555 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b2802216-950c-497e-b77c-8a8ff8f940d9 tempest-VolumesSnapshotsTestJSON-145105073 tempest-VolumesSnapshotsTestJSON-145105073-project] Request method failure captured: Sep 23 05:00:15.024555 n-d-846463-3 devstack@n-api.service[122698]: request: DELETE /compute/v2.1/os-volumes/540b558a-91e5-4e5a-ac7c-d1622ea43daa HTTP/1.1 Sep 23 05:00:15.024555 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 05:00:15.024555 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 05:00:15.024555 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 05:00:15.024555 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 05:00:15.024555 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 05:00:15.024555 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 05:00:15.024555 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 05:00:15.024555 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 05:00:15.024555 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLT1OcGd3b1TP2TyLaydO0RLh4mmXClCiaFcVUe3YcjXohBAKgt1N1WLuaaVOph-S-KGQH1uiihIrYFVo088PEualPWOpZAdimuru95wosI6VPGqZ2_Ne4vqRX3AAkUDl1hdvwdei3giYjgt5_IHdBXqLrBh3_jYvxkC9LuC4EaXJvn0 Sep 23 05:00:15.024555 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 05:00:15.024555 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 05:00:15.024555 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 05:00:15.024555 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 05:00:15.024555 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 05:00:15.024555 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 05:00:15.024555 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 5cda4937eeb346c1814741d7d8462cfa Sep 23 05:00:15.024555 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-145105073 Sep 23 05:00:15.024555 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 05:00:15.024555 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 05:00:15.024555 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5cda4937eeb346c1814741d7d8462cfa", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5cda4937eeb346c1814741d7d8462cfa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5cda4937eeb346c1814741d7d8462cfa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5cda4937eeb346c1814741d7d8462cfa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:00:15.024555 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-VolumesSnapshotsTestJSON-145105073 Sep 23 05:00:15.024555 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 5cda4937eeb346c1814741d7d8462cfa Sep 23 05:00:15.024555 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-145105073 Sep 23 05:00:15.024555 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-VolumesSnapshotsTestJSON-145105073-project Sep 23 05:00:15.024555 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 05:00:15.024555 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 05:00:15.024555 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: e1c4e8864e954b09ab5aa642514eaf16 Sep 23 05:00:15.024555 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-VolumesSnapshotsTestJSON-145105073-project Sep 23 05:00:15.024555 n-d-846463-3 devstack@n-api.service[122698]: method: Sep 23 05:00:15.024555 n-d-846463-3 devstack@n-api.service[122698]: exception: Volume 540b558a-91e5-4e5a-ac7c-d1622ea43daa could not be found. Sep 23 05:00:15.024555 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '540b558a-91e5-4e5a-ac7c-d1622ea43daa'} Sep 23 05:00:15.024555 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:00:15.024555 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:00:15.024555 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 23 05:00:15.024555 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 23 05:00:15.024555 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 23 05:00:15.024555 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 23 05:00:15.024555 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 23 05:00:15.024555 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 23 05:00:15.024555 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 23 05:00:15.024555 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 23 05:00:15.024555 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 23 05:00:15.024555 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 23 05:00:15.024555 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 23 05:00:15.024555 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 23 05:00:15.024555 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 23 05:00:15.024555 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 23 05:00:15.024555 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 540b558a-91e5-4e5a-ac7c-d1622ea43daa could not be found. (HTTP 404) (Request-ID: req-b698aaa0-91c3-471b-951d-88b7b24a8a74) Sep 23 05:00:15.024555 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:00:15.024555 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:00:15.024555 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:00:15.024555 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:00:15.024555 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 23 05:00:15.024555 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 23 05:00:15.024555 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 23 05:00:15.024555 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 23 05:00:15.024555 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 23 05:00:15.024555 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 23 05:00:15.024555 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 23 05:00:15.024555 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 23 05:00:15.024555 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 23 05:00:15.030626 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 23 05:00:15.030626 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 23 05:00:15.030626 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 23 05:00:15.030626 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 23 05:00:15.030626 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 23 05:00:15.030626 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 23 05:00:15.030626 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 23 05:00:15.030626 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 23 05:00:15.030626 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 23 05:00:15.030626 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 23 05:00:15.030626 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 23 05:00:15.030626 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 23 05:00:15.030626 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 23 05:00:15.030626 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 540b558a-91e5-4e5a-ac7c-d1622ea43daa could not be found. Sep 23 05:00:15.030626 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:00:15.030626 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:00:15.030626 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:00:15.030626 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:00:15.030626 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:00:15.030626 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:00:15.030626 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:00:15.030626 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:00:15.030626 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 05:00:15.030626 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 05:00:15.030626 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:00:15.030626 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:00:15.030626 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 23 05:00:15.030626 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:00:15.030626 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 540b558a-91e5-4e5a-ac7c-d1622ea43daa could not be found. Sep 23 05:00:15.030626 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:00:15.030626 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:00:15.030626 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:00:15.030626 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:00:15.030626 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:00:15.030626 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:00:15.030626 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:00:15.030626 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:00:15.030626 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 540b558a-91e5-4e5a-ac7c-d1622ea43daa could not be found. Sep 23 05:00:15.030626 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:00:15.030626 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b2802216-950c-497e-b77c-8a8ff8f940d9 tempest-VolumesSnapshotsTestJSON-145105073 tempest-VolumesSnapshotsTestJSON-145105073-project] Returning 404 to user: Volume 540b558a-91e5-4e5a-ac7c-d1622ea43daa could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:00:15.030626 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b2802216-950c-497e-b77c-8a8ff8f940d9 tempest-VolumesSnapshotsTestJSON-145105073 tempest-VolumesSnapshotsTestJSON-145105073-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/540b558a-91e5-4e5a-ac7c-d1622ea43daa" status: 404 len: 109 microversion: 2.1 time: 0.218947 Sep 23 05:00:15.030626 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2845/5855] 10.222.0.33 () {58 vars in 1248 bytes} [Fri Sep 23 05:00:14 2022] DELETE /compute/v2.1/os-volumes/540b558a-91e5-4e5a-ac7c-d1622ea43daa => generated 109 bytes in 220 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 05:00:15.043890 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-250c9b91-a456-4dbf-b3ba-93239ff42815 tempest-TestNetworkAdvancedServerOps-1586243358 tempest-TestNetworkAdvancedServerOps-1586243358-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:00:15.049942 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-250c9b91-a456-4dbf-b3ba-93239ff42815 tempest-TestNetworkAdvancedServerOps-1586243358 tempest-TestNetworkAdvancedServerOps-1586243358-project-admin] [instance: 7f05d753-e297-4330-ba02-dc0aac76de96] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:00:15.072280 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-250c9b91-a456-4dbf-b3ba-93239ff42815 tempest-TestNetworkAdvancedServerOps-1586243358 tempest-TestNetworkAdvancedServerOps-1586243358-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:15.072280 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-250c9b91-a456-4dbf-b3ba-93239ff42815 tempest-TestNetworkAdvancedServerOps-1586243358 tempest-TestNetworkAdvancedServerOps-1586243358-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:15.072280 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-250c9b91-a456-4dbf-b3ba-93239ff42815 tempest-TestNetworkAdvancedServerOps-1586243358 tempest-TestNetworkAdvancedServerOps-1586243358-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:15.072280 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-250c9b91-a456-4dbf-b3ba-93239ff42815 tempest-TestNetworkAdvancedServerOps-1586243358 tempest-TestNetworkAdvancedServerOps-1586243358-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:15.072949 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-250c9b91-a456-4dbf-b3ba-93239ff42815 tempest-TestNetworkAdvancedServerOps-1586243358 tempest-TestNetworkAdvancedServerOps-1586243358-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:15.073466 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-250c9b91-a456-4dbf-b3ba-93239ff42815 tempest-TestNetworkAdvancedServerOps-1586243358 tempest-TestNetworkAdvancedServerOps-1586243358-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:15.193610 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-250c9b91-a456-4dbf-b3ba-93239ff42815 tempest-TestNetworkAdvancedServerOps-1586243358 tempest-TestNetworkAdvancedServerOps-1586243358-project-admin] Lazy-loading 'flavor' on Instance uuid 7f05d753-e297-4330-ba02-dc0aac76de96 {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 05:00:15.217287 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-250c9b91-a456-4dbf-b3ba-93239ff42815 tempest-TestNetworkAdvancedServerOps-1586243358 tempest-TestNetworkAdvancedServerOps-1586243358-project-admin] [instance: 7f05d753-e297-4330-ba02-dc0aac76de96] Going to try to live migrate instance to another host {{(pid=122698) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 23 05:00:15.305236 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-78ec1954-5f41-4ef1-850a-7dedfa02ee59 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a845ca1e7747fba0a987235d980098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca57a0af591a43ee9cdef09134bc3fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:00:15.328566 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-78ec1954-5f41-4ef1-850a-7dedfa02ee59 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] 10.222.0.33 "GET /compute/v2.1/servers/1d4b42f4-3285-41c7-8264-e596b9d8ac02" status: 200 len: 1506 microversion: 2.1 time: 0.374674 Sep 23 05:00:15.329169 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3011/5856] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:00:14 2022] GET /compute/v2.1/servers/1d4b42f4-3285-41c7-8264-e596b9d8ac02 => generated 1506 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:00:15.360368 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-285e6a8c-3c93-44b1-88a0-fbb871fc7c8b tempest-VolumesSnapshotsTestJSON-145105073 tempest-VolumesSnapshotsTestJSON-145105073-project] Calling method '.version_select at 0x7ff1bb875b80>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:15.461839 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-285e6a8c-3c93-44b1-88a0-fbb871fc7c8b tempest-VolumesSnapshotsTestJSON-145105073 tempest-VolumesSnapshotsTestJSON-145105073-project] HTTP exception thrown: Volume 540b558a-91e5-4e5a-ac7c-d1622ea43daa could not be found. Sep 23 05:00:15.463826 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-285e6a8c-3c93-44b1-88a0-fbb871fc7c8b tempest-VolumesSnapshotsTestJSON-145105073 tempest-VolumesSnapshotsTestJSON-145105073-project] Request method failure captured: Sep 23 05:00:15.463826 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/os-volumes/540b558a-91e5-4e5a-ac7c-d1622ea43daa HTTP/1.1 Sep 23 05:00:15.463826 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 05:00:15.463826 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 05:00:15.463826 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 05:00:15.463826 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 05:00:15.463826 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 05:00:15.463826 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 05:00:15.463826 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 05:00:15.463826 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 05:00:15.463826 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLT1OcGd3b1TP2TyLaydO0RLh4mmXClCiaFcVUe3YcjXohBAKgt1N1WLuaaVOph-S-KGQH1uiihIrYFVo088PEualPWOpZAdimuru95wosI6VPGqZ2_Ne4vqRX3AAkUDl1hdvwdei3giYjgt5_IHdBXqLrBh3_jYvxkC9LuC4EaXJvn0 Sep 23 05:00:15.463826 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 05:00:15.463826 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 05:00:15.463826 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 05:00:15.463826 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 05:00:15.463826 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 05:00:15.463826 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 05:00:15.463826 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 5cda4937eeb346c1814741d7d8462cfa Sep 23 05:00:15.463826 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-145105073 Sep 23 05:00:15.463826 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 05:00:15.463826 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 05:00:15.463826 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5cda4937eeb346c1814741d7d8462cfa", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5cda4937eeb346c1814741d7d8462cfa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5cda4937eeb346c1814741d7d8462cfa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5cda4937eeb346c1814741d7d8462cfa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:00:15.463826 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-VolumesSnapshotsTestJSON-145105073 Sep 23 05:00:15.463826 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 5cda4937eeb346c1814741d7d8462cfa Sep 23 05:00:15.463826 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-145105073 Sep 23 05:00:15.463826 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-VolumesSnapshotsTestJSON-145105073-project Sep 23 05:00:15.463826 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 05:00:15.463826 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 05:00:15.463826 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: e1c4e8864e954b09ab5aa642514eaf16 Sep 23 05:00:15.463826 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-VolumesSnapshotsTestJSON-145105073-project Sep 23 05:00:15.463826 n-d-846463-3 devstack@n-api.service[122699]: method: Sep 23 05:00:15.463826 n-d-846463-3 devstack@n-api.service[122699]: exception: Volume 540b558a-91e5-4e5a-ac7c-d1622ea43daa could not be found. Sep 23 05:00:15.463826 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '540b558a-91e5-4e5a-ac7c-d1622ea43daa'} Sep 23 05:00:15.463826 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:00:15.463826 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:00:15.463826 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 23 05:00:15.463826 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 23 05:00:15.463826 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 23 05:00:15.463826 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 23 05:00:15.463826 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 23 05:00:15.463826 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 23 05:00:15.463826 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 23 05:00:15.463826 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 23 05:00:15.463826 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 23 05:00:15.463826 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 23 05:00:15.463826 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 23 05:00:15.463826 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 23 05:00:15.463826 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 23 05:00:15.463826 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 23 05:00:15.463826 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 540b558a-91e5-4e5a-ac7c-d1622ea43daa could not be found. (HTTP 404) (Request-ID: req-61cf19e4-18f0-4ce6-810b-8b6d107853a7) Sep 23 05:00:15.463826 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:00:15.463826 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:00:15.463826 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:00:15.463826 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:00:15.463826 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 23 05:00:15.463826 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 23 05:00:15.463826 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 23 05:00:15.463826 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 23 05:00:15.463826 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 23 05:00:15.463826 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 23 05:00:15.463826 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 23 05:00:15.463826 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 23 05:00:15.463826 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 23 05:00:15.471656 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 23 05:00:15.471656 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 23 05:00:15.471656 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 23 05:00:15.471656 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 23 05:00:15.471656 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 23 05:00:15.471656 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 23 05:00:15.471656 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 23 05:00:15.471656 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 23 05:00:15.471656 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 23 05:00:15.471656 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 23 05:00:15.471656 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 23 05:00:15.471656 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 23 05:00:15.471656 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 23 05:00:15.471656 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 540b558a-91e5-4e5a-ac7c-d1622ea43daa could not be found. Sep 23 05:00:15.471656 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:00:15.471656 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:00:15.471656 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:00:15.471656 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:00:15.471656 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:00:15.471656 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:00:15.471656 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:00:15.471656 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:00:15.471656 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 05:00:15.471656 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 05:00:15.471656 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:00:15.471656 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:00:15.471656 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 23 05:00:15.471656 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:00:15.471656 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 540b558a-91e5-4e5a-ac7c-d1622ea43daa could not be found. Sep 23 05:00:15.471656 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:00:15.471656 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:00:15.471656 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:00:15.471656 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:00:15.471656 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:00:15.471656 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:00:15.471656 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:00:15.471656 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:00:15.471656 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 540b558a-91e5-4e5a-ac7c-d1622ea43daa could not be found. Sep 23 05:00:15.471656 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:00:15.471656 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-285e6a8c-3c93-44b1-88a0-fbb871fc7c8b tempest-VolumesSnapshotsTestJSON-145105073 tempest-VolumesSnapshotsTestJSON-145105073-project] Returning 404 to user: Volume 540b558a-91e5-4e5a-ac7c-d1622ea43daa could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:00:15.471656 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-285e6a8c-3c93-44b1-88a0-fbb871fc7c8b tempest-VolumesSnapshotsTestJSON-145105073 tempest-VolumesSnapshotsTestJSON-145105073-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/540b558a-91e5-4e5a-ac7c-d1622ea43daa" status: 404 len: 109 microversion: 2.1 time: 0.122335 Sep 23 05:00:15.471656 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3012/5857] 10.222.0.33 () {58 vars in 1245 bytes} [Fri Sep 23 05:00:15 2022] GET /compute/v2.1/os-volumes/540b558a-91e5-4e5a-ac7c-d1622ea43daa => generated 109 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 05:00:16.356192 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6e1aa624-3a53-4413-9143-90b56dcbfd93 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:16.356793 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-6e1aa624-3a53-4413-9143-90b56dcbfd93 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] [instance: 1d4b42f4-3285-41c7-8264-e596b9d8ac02] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:00:16.365287 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6e1aa624-3a53-4413-9143-90b56dcbfd93 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:16.368560 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6e1aa624-3a53-4413-9143-90b56dcbfd93 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:16.368560 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6e1aa624-3a53-4413-9143-90b56dcbfd93 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:16.368560 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6e1aa624-3a53-4413-9143-90b56dcbfd93 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:16.368560 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6e1aa624-3a53-4413-9143-90b56dcbfd93 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:16.375984 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6e1aa624-3a53-4413-9143-90b56dcbfd93 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:16.879113 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-6e1aa624-3a53-4413-9143-90b56dcbfd93 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a845ca1e7747fba0a987235d980098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca57a0af591a43ee9cdef09134bc3fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:00:16.891870 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6e1aa624-3a53-4413-9143-90b56dcbfd93 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] 10.222.0.33 "GET /compute/v2.1/servers/1d4b42f4-3285-41c7-8264-e596b9d8ac02" status: 200 len: 1506 microversion: 2.1 time: 0.539269 Sep 23 05:00:16.913881 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3013/5858] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:00:16 2022] GET /compute/v2.1/servers/1d4b42f4-3285-41c7-8264-e596b9d8ac02 => generated 1506 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:00:17.918951 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e6439310-2c48-49e5-9734-2ec035b25992 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:17.919872 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e6439310-2c48-49e5-9734-2ec035b25992 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] [instance: 1d4b42f4-3285-41c7-8264-e596b9d8ac02] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:00:17.927081 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e6439310-2c48-49e5-9734-2ec035b25992 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:17.927657 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e6439310-2c48-49e5-9734-2ec035b25992 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:17.928294 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e6439310-2c48-49e5-9734-2ec035b25992 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:17.929755 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e6439310-2c48-49e5-9734-2ec035b25992 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:17.930269 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e6439310-2c48-49e5-9734-2ec035b25992 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:17.930712 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e6439310-2c48-49e5-9734-2ec035b25992 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:18.223967 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e6439310-2c48-49e5-9734-2ec035b25992 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a845ca1e7747fba0a987235d980098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca57a0af591a43ee9cdef09134bc3fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:00:18.234232 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e6439310-2c48-49e5-9734-2ec035b25992 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] 10.222.0.33 "GET /compute/v2.1/servers/1d4b42f4-3285-41c7-8264-e596b9d8ac02" status: 200 len: 1486 microversion: 2.1 time: 0.319974 Sep 23 05:00:18.237870 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3014/5859] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:00:17 2022] GET /compute/v2.1/servers/1d4b42f4-3285-41c7-8264-e596b9d8ac02 => generated 1486 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:00:18.271053 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a9bb501a-daea-4df4-b482-38b5f0ab60d8 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:00:18.272331 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a9bb501a-daea-4df4-b482-38b5f0ab60d8 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] [instance: 1d4b42f4-3285-41c7-8264-e596b9d8ac02] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:00:18.286585 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a9bb501a-daea-4df4-b482-38b5f0ab60d8 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:18.287953 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a9bb501a-daea-4df4-b482-38b5f0ab60d8 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:18.288412 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a9bb501a-daea-4df4-b482-38b5f0ab60d8 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:18.290605 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a9bb501a-daea-4df4-b482-38b5f0ab60d8 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:18.291732 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a9bb501a-daea-4df4-b482-38b5f0ab60d8 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:18.293459 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a9bb501a-daea-4df4-b482-38b5f0ab60d8 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:18.652656 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a9bb501a-daea-4df4-b482-38b5f0ab60d8 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] 10.222.0.33 "POST /compute/v2.1/servers/1d4b42f4-3285-41c7-8264-e596b9d8ac02/action" status: 202 len: 0 microversion: 2.1 time: 0.375609 Sep 23 05:00:18.653388 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3015/5860] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 05:00:18 2022] POST /compute/v2.1/servers/1d4b42f4-3285-41c7-8264-e596b9d8ac02/action => generated 0 bytes in 392 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 23 05:00:18.682227 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-13cb8cb0-8204-4b17-86bf-e68ac127256d tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:18.683769 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-13cb8cb0-8204-4b17-86bf-e68ac127256d tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] [instance: 1d4b42f4-3285-41c7-8264-e596b9d8ac02] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:00:18.693661 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-13cb8cb0-8204-4b17-86bf-e68ac127256d tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:18.694670 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-13cb8cb0-8204-4b17-86bf-e68ac127256d tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:18.695477 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-13cb8cb0-8204-4b17-86bf-e68ac127256d tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:18.697148 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-13cb8cb0-8204-4b17-86bf-e68ac127256d tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:18.697148 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-13cb8cb0-8204-4b17-86bf-e68ac127256d tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:18.697644 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-13cb8cb0-8204-4b17-86bf-e68ac127256d tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:19.096368 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-13cb8cb0-8204-4b17-86bf-e68ac127256d tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a845ca1e7747fba0a987235d980098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca57a0af591a43ee9cdef09134bc3fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:00:19.106475 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-13cb8cb0-8204-4b17-86bf-e68ac127256d tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] 10.222.0.33 "GET /compute/v2.1/servers/1d4b42f4-3285-41c7-8264-e596b9d8ac02" status: 200 len: 1494 microversion: 2.1 time: 0.442440 Sep 23 05:00:19.112361 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3016/5861] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:00:18 2022] GET /compute/v2.1/servers/1d4b42f4-3285-41c7-8264-e596b9d8ac02 => generated 1494 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:00:20.139824 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-41fd4807-8e2b-442c-88a8-70a4af40585c tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:20.151964 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-41fd4807-8e2b-442c-88a8-70a4af40585c tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] [instance: 1d4b42f4-3285-41c7-8264-e596b9d8ac02] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:00:20.170497 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-41fd4807-8e2b-442c-88a8-70a4af40585c tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:20.170497 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-41fd4807-8e2b-442c-88a8-70a4af40585c tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:20.170497 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-41fd4807-8e2b-442c-88a8-70a4af40585c tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:20.170497 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-41fd4807-8e2b-442c-88a8-70a4af40585c tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:20.170497 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-41fd4807-8e2b-442c-88a8-70a4af40585c tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:20.170497 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-41fd4807-8e2b-442c-88a8-70a4af40585c tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:20.559099 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-41fd4807-8e2b-442c-88a8-70a4af40585c tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a845ca1e7747fba0a987235d980098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca57a0af591a43ee9cdef09134bc3fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:00:20.575185 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-41fd4807-8e2b-442c-88a8-70a4af40585c tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] 10.222.0.33 "GET /compute/v2.1/servers/1d4b42f4-3285-41c7-8264-e596b9d8ac02" status: 200 len: 1494 microversion: 2.1 time: 0.442871 Sep 23 05:00:20.575967 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3017/5862] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:00:20 2022] GET /compute/v2.1/servers/1d4b42f4-3285-41c7-8264-e596b9d8ac02 => generated 1494 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:00:20.589090 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-599adf0d-0125-4099-ad14-31d3e74f097a tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:20.591707 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-599adf0d-0125-4099-ad14-31d3e74f097a tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] [instance: ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:00:20.607600 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-599adf0d-0125-4099-ad14-31d3e74f097a tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:20.608487 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-599adf0d-0125-4099-ad14-31d3e74f097a tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:20.613106 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-599adf0d-0125-4099-ad14-31d3e74f097a tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:20.619589 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-599adf0d-0125-4099-ad14-31d3e74f097a tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:20.619589 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-599adf0d-0125-4099-ad14-31d3e74f097a tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:20.619589 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-599adf0d-0125-4099-ad14-31d3e74f097a tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:20.653811 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:00:20.680206 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-599adf0d-0125-4099-ad14-31d3e74f097a tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] 10.222.0.33 "GET /compute/v2.1/servers/ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7/os-volume_attachments/6a574473-962a-4e5b-ac78-ed92481a7017" status: 200 len: 194 microversion: 2.1 time: 0.100546 Sep 23 05:00:20.680832 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-250c9b91-a456-4dbf-b3ba-93239ff42815 tempest-TestNetworkAdvancedServerOps-1586243358 tempest-TestNetworkAdvancedServerOps-1586243358-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/7f05d753-e297-4330-ba02-dc0aac76de96/action" status: 202 len: 0 microversion: 2.1 time: 5.652698 Sep 23 05:00:20.682992 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2846/5863] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 05:00:15 2022] POST /compute/v2.1/servers/7f05d753-e297-4330-ba02-dc0aac76de96/action => generated 0 bytes in 5655 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 05:00:20.690257 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3018/5864] 10.222.0.33 () {58 vars in 1413 bytes} [Fri Sep 23 05:00:20 2022] GET /compute/v2.1/servers/ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7/os-volume_attachments/6a574473-962a-4e5b-ac78-ed92481a7017 => generated 194 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:00:20.692713 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-523bb730-8167-4b00-a421-9ed7d3efc231 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:20.693804 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-523bb730-8167-4b00-a421-9ed7d3efc231 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 7f05d753-e297-4330-ba02-dc0aac76de96] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:00:20.700871 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4b050a0b-2dbe-441b-8d47-ecc95a67262f tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:20.701430 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4b050a0b-2dbe-441b-8d47-ecc95a67262f tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] [instance: ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:00:20.704531 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=56 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:00:20.709518 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-523bb730-8167-4b00-a421-9ed7d3efc231 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:20.713045 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-523bb730-8167-4b00-a421-9ed7d3efc231 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:20.713698 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-523bb730-8167-4b00-a421-9ed7d3efc231 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:20.713904 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4b050a0b-2dbe-441b-8d47-ecc95a67262f tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:20.714540 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4b050a0b-2dbe-441b-8d47-ecc95a67262f tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:20.715184 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-523bb730-8167-4b00-a421-9ed7d3efc231 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:20.715743 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4b050a0b-2dbe-441b-8d47-ecc95a67262f tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:20.716449 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-523bb730-8167-4b00-a421-9ed7d3efc231 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:20.717278 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4b050a0b-2dbe-441b-8d47-ecc95a67262f tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:20.718649 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-523bb730-8167-4b00-a421-9ed7d3efc231 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:20.719260 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4b050a0b-2dbe-441b-8d47-ecc95a67262f tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:20.719778 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4b050a0b-2dbe-441b-8d47-ecc95a67262f tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:20.905225 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-4b050a0b-2dbe-441b-8d47-ecc95a67262f tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lazy-loading 'services' on Instance uuid ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 05:00:21.105802 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-523bb730-8167-4b00-a421-9ed7d3efc231 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:00:21.127496 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-523bb730-8167-4b00-a421-9ed7d3efc231 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/7f05d753-e297-4330-ba02-dc0aac76de96" status: 200 len: 1691 microversion: 2.1 time: 0.439847 Sep 23 05:00:21.130864 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2847/5865] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:00:20 2022] GET /compute/v2.1/servers/7f05d753-e297-4330-ba02-dc0aac76de96 => generated 1691 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:00:21.251884 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4b050a0b-2dbe-441b-8d47-ecc95a67262f tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7/os-volume_attachments/6a574473-962a-4e5b-ac78-ed92481a7017" status: 202 len: 0 microversion: 2.1 time: 0.559898 Sep 23 05:00:21.266832 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3019/5866] 10.222.0.33 () {58 vars in 1416 bytes} [Fri Sep 23 05:00:20 2022] DELETE /compute/v2.1/servers/ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7/os-volume_attachments/6a574473-962a-4e5b-ac78-ed92481a7017 => generated 0 bytes in 575 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 05:00:21.606935 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-518798f4-a1e6-43e4-b41e-295862d730d2 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:21.607557 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-518798f4-a1e6-43e4-b41e-295862d730d2 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] [instance: 1d4b42f4-3285-41c7-8264-e596b9d8ac02] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:00:21.628032 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-518798f4-a1e6-43e4-b41e-295862d730d2 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:21.629966 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-518798f4-a1e6-43e4-b41e-295862d730d2 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:21.630901 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-518798f4-a1e6-43e4-b41e-295862d730d2 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:21.635645 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-518798f4-a1e6-43e4-b41e-295862d730d2 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:21.638264 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-518798f4-a1e6-43e4-b41e-295862d730d2 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:21.639678 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-518798f4-a1e6-43e4-b41e-295862d730d2 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:21.926187 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-518798f4-a1e6-43e4-b41e-295862d730d2 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a845ca1e7747fba0a987235d980098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca57a0af591a43ee9cdef09134bc3fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:00:21.938869 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-518798f4-a1e6-43e4-b41e-295862d730d2 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] 10.222.0.33 "GET /compute/v2.1/servers/1d4b42f4-3285-41c7-8264-e596b9d8ac02" status: 200 len: 1494 microversion: 2.1 time: 0.336167 Sep 23 05:00:21.939464 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2848/5867] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:00:21 2022] GET /compute/v2.1/servers/1d4b42f4-3285-41c7-8264-e596b9d8ac02 => generated 1494 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:00:22.166721 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-57e0c047-4532-4858-a004-b45ba276998d tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:22.167436 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-57e0c047-4532-4858-a004-b45ba276998d tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 7f05d753-e297-4330-ba02-dc0aac76de96] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:00:22.175099 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:00:22.192463 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-57e0c047-4532-4858-a004-b45ba276998d tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:22.192463 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-57e0c047-4532-4858-a004-b45ba276998d tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:22.192463 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-57e0c047-4532-4858-a004-b45ba276998d tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:22.192463 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-57e0c047-4532-4858-a004-b45ba276998d tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:22.193041 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-57e0c047-4532-4858-a004-b45ba276998d tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:22.193041 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-57e0c047-4532-4858-a004-b45ba276998d tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:22.517859 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-57e0c047-4532-4858-a004-b45ba276998d tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:00:22.527203 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-57e0c047-4532-4858-a004-b45ba276998d tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/7f05d753-e297-4330-ba02-dc0aac76de96" status: 200 len: 1691 microversion: 2.1 time: 0.366375 Sep 23 05:00:22.539660 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3020/5868] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:00:22 2022] GET /compute/v2.1/servers/7f05d753-e297-4330-ba02-dc0aac76de96 => generated 1691 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:00:22.970988 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-abcf4436-26f1-4b17-8541-0f6cb5899367 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:22.971787 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-abcf4436-26f1-4b17-8541-0f6cb5899367 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] [instance: 1d4b42f4-3285-41c7-8264-e596b9d8ac02] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:00:22.988197 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-abcf4436-26f1-4b17-8541-0f6cb5899367 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:22.988722 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-abcf4436-26f1-4b17-8541-0f6cb5899367 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:22.989173 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-abcf4436-26f1-4b17-8541-0f6cb5899367 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:22.992546 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-abcf4436-26f1-4b17-8541-0f6cb5899367 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:22.992546 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-abcf4436-26f1-4b17-8541-0f6cb5899367 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:22.992546 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-abcf4436-26f1-4b17-8541-0f6cb5899367 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:23.359572 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-abcf4436-26f1-4b17-8541-0f6cb5899367 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a845ca1e7747fba0a987235d980098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca57a0af591a43ee9cdef09134bc3fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:00:23.371403 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-abcf4436-26f1-4b17-8541-0f6cb5899367 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] 10.222.0.33 "GET /compute/v2.1/servers/1d4b42f4-3285-41c7-8264-e596b9d8ac02" status: 200 len: 1494 microversion: 2.1 time: 0.406197 Sep 23 05:00:23.374304 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2849/5869] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:00:22 2022] GET /compute/v2.1/servers/1d4b42f4-3285-41c7-8264-e596b9d8ac02 => generated 1494 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:00:23.557853 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-da4b9837-cc04-4584-b51c-81953c7a72f8 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:23.558492 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-da4b9837-cc04-4584-b51c-81953c7a72f8 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 7f05d753-e297-4330-ba02-dc0aac76de96] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:00:23.588378 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-da4b9837-cc04-4584-b51c-81953c7a72f8 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:23.589220 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-da4b9837-cc04-4584-b51c-81953c7a72f8 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:23.589850 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-da4b9837-cc04-4584-b51c-81953c7a72f8 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:23.592878 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-da4b9837-cc04-4584-b51c-81953c7a72f8 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:23.592878 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-da4b9837-cc04-4584-b51c-81953c7a72f8 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:23.592878 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-da4b9837-cc04-4584-b51c-81953c7a72f8 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:23.800050 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-da4b9837-cc04-4584-b51c-81953c7a72f8 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:00:23.814002 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-da4b9837-cc04-4584-b51c-81953c7a72f8 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/7f05d753-e297-4330-ba02-dc0aac76de96" status: 200 len: 1691 microversion: 2.1 time: 0.259350 Sep 23 05:00:23.814902 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3021/5870] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:00:23 2022] GET /compute/v2.1/servers/7f05d753-e297-4330-ba02-dc0aac76de96 => generated 1691 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:00:24.351657 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-2b2a6be9-4a44-490b-9ea2-c92b25d68fbe req-397500d3-242f-4060-a5fa-d8fcbe786d0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f05d753-e297-4330-ba02-dc0aac76de96", "name": "network-vif-unplugged", "status": "completed", "tag": "9e975956-70a6-4752-9499-532298e87730"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:00:24.362835 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-2b2a6be9-4a44-490b-9ea2-c92b25d68fbe req-397500d3-242f-4060-a5fa-d8fcbe786d0b service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:24.363662 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-2b2a6be9-4a44-490b-9ea2-c92b25d68fbe req-397500d3-242f-4060-a5fa-d8fcbe786d0b service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:24.364293 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-2b2a6be9-4a44-490b-9ea2-c92b25d68fbe req-397500d3-242f-4060-a5fa-d8fcbe786d0b service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:24.376963 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-2b2a6be9-4a44-490b-9ea2-c92b25d68fbe req-397500d3-242f-4060-a5fa-d8fcbe786d0b service nova] Creating event network-vif-unplugged:9e975956-70a6-4752-9499-532298e87730 for instance 7f05d753-e297-4330-ba02-dc0aac76de96 on n-h2-846463-3 Sep 23 05:00:24.383228 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-2b2a6be9-4a44-490b-9ea2-c92b25d68fbe req-397500d3-242f-4060-a5fa-d8fcbe786d0b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034508 Sep 23 05:00:24.383853 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2850/5871] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:00:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:00:24.397505 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d86fb861-baa2-4761-bcbb-6610dba0bff2 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:24.398942 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d86fb861-baa2-4761-bcbb-6610dba0bff2 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] [instance: 1d4b42f4-3285-41c7-8264-e596b9d8ac02] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:00:24.407036 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d86fb861-baa2-4761-bcbb-6610dba0bff2 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:24.407741 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d86fb861-baa2-4761-bcbb-6610dba0bff2 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:24.408413 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d86fb861-baa2-4761-bcbb-6610dba0bff2 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:24.409245 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d86fb861-baa2-4761-bcbb-6610dba0bff2 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:24.410469 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d86fb861-baa2-4761-bcbb-6610dba0bff2 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:24.414550 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d86fb861-baa2-4761-bcbb-6610dba0bff2 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:24.676696 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d86fb861-baa2-4761-bcbb-6610dba0bff2 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a845ca1e7747fba0a987235d980098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca57a0af591a43ee9cdef09134bc3fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:00:24.693389 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d86fb861-baa2-4761-bcbb-6610dba0bff2 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] 10.222.0.33 "GET /compute/v2.1/servers/1d4b42f4-3285-41c7-8264-e596b9d8ac02" status: 200 len: 1500 microversion: 2.1 time: 0.300078 Sep 23 05:00:24.694052 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3022/5872] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:00:24 2022] GET /compute/v2.1/servers/1d4b42f4-3285-41c7-8264-e596b9d8ac02 => generated 1500 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:00:24.732468 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a9083556-b1f9-4ee4-80e6-5b896ca4e515 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:24.733125 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a9083556-b1f9-4ee4-80e6-5b896ca4e515 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] [instance: 1d4b42f4-3285-41c7-8264-e596b9d8ac02] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:00:24.740494 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a9083556-b1f9-4ee4-80e6-5b896ca4e515 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:24.741311 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a9083556-b1f9-4ee4-80e6-5b896ca4e515 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:24.743310 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a9083556-b1f9-4ee4-80e6-5b896ca4e515 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:24.744236 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a9083556-b1f9-4ee4-80e6-5b896ca4e515 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:24.744879 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a9083556-b1f9-4ee4-80e6-5b896ca4e515 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:24.745479 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a9083556-b1f9-4ee4-80e6-5b896ca4e515 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:24.778753 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a9083556-b1f9-4ee4-80e6-5b896ca4e515 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] [instance: 1d4b42f4-3285-41c7-8264-e596b9d8ac02] Going to try to terminate instance {{(pid=122698) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 05:00:24.839247 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d7b743e5-b382-4faa-ba99-9af298c2fb83 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:24.840575 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d7b743e5-b382-4faa-ba99-9af298c2fb83 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 7f05d753-e297-4330-ba02-dc0aac76de96] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:00:24.852502 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d7b743e5-b382-4faa-ba99-9af298c2fb83 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:24.853185 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d7b743e5-b382-4faa-ba99-9af298c2fb83 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:24.855906 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d7b743e5-b382-4faa-ba99-9af298c2fb83 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:24.857055 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d7b743e5-b382-4faa-ba99-9af298c2fb83 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:24.862387 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d7b743e5-b382-4faa-ba99-9af298c2fb83 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:24.863055 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d7b743e5-b382-4faa-ba99-9af298c2fb83 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:25.162928 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a9083556-b1f9-4ee4-80e6-5b896ca4e515 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] 10.222.0.33 "DELETE /compute/v2.1/servers/1d4b42f4-3285-41c7-8264-e596b9d8ac02" status: 204 len: 0 microversion: 2.1 time: 0.434347 Sep 23 05:00:25.167096 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2851/5873] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 05:00:24 2022] DELETE /compute/v2.1/servers/1d4b42f4-3285-41c7-8264-e596b9d8ac02 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 05:00:25.173388 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-bef90734-d8a0-4844-9cd8-1d5921711aac tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:25.174143 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-bef90734-d8a0-4844-9cd8-1d5921711aac tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] [instance: 1d4b42f4-3285-41c7-8264-e596b9d8ac02] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:00:25.198463 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bef90734-d8a0-4844-9cd8-1d5921711aac tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:25.200259 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bef90734-d8a0-4844-9cd8-1d5921711aac tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:25.203323 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bef90734-d8a0-4844-9cd8-1d5921711aac tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:25.204109 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bef90734-d8a0-4844-9cd8-1d5921711aac tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:25.204590 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bef90734-d8a0-4844-9cd8-1d5921711aac tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:25.212114 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bef90734-d8a0-4844-9cd8-1d5921711aac tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:25.330233 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d7b743e5-b382-4faa-ba99-9af298c2fb83 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:00:25.345353 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d7b743e5-b382-4faa-ba99-9af298c2fb83 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/7f05d753-e297-4330-ba02-dc0aac76de96" status: 200 len: 1691 microversion: 2.1 time: 0.509999 Sep 23 05:00:25.353643 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3023/5874] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:00:24 2022] GET /compute/v2.1/servers/7f05d753-e297-4330-ba02-dc0aac76de96 => generated 1691 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:00:25.844100 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-bef90734-d8a0-4844-9cd8-1d5921711aac tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a845ca1e7747fba0a987235d980098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca57a0af591a43ee9cdef09134bc3fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:00:25.856266 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-bef90734-d8a0-4844-9cd8-1d5921711aac tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] 10.222.0.33 "GET /compute/v2.1/servers/1d4b42f4-3285-41c7-8264-e596b9d8ac02" status: 200 len: 1506 microversion: 2.1 time: 0.687824 Sep 23 05:00:25.858407 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2852/5875] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:00:25 2022] GET /compute/v2.1/servers/1d4b42f4-3285-41c7-8264-e596b9d8ac02 => generated 1506 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:00:26.369699 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d91cb121-25b5-4313-bc53-703df473383a tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:26.370351 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d91cb121-25b5-4313-bc53-703df473383a tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 7f05d753-e297-4330-ba02-dc0aac76de96] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:00:26.382328 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d91cb121-25b5-4313-bc53-703df473383a tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:26.383674 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d91cb121-25b5-4313-bc53-703df473383a tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:26.384282 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d91cb121-25b5-4313-bc53-703df473383a tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:26.390064 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d91cb121-25b5-4313-bc53-703df473383a tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:26.390897 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d91cb121-25b5-4313-bc53-703df473383a tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:26.394098 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d91cb121-25b5-4313-bc53-703df473383a tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:26.415009 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-88c78831-3839-4b12-b219-d082a9c6447b req-29b47a4b-f084-4ac0-94d3-44c6be9b68d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f05d753-e297-4330-ba02-dc0aac76de96", "tag": "9e975956-70a6-4752-9499-532298e87730"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:00:26.446287 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-88c78831-3839-4b12-b219-d082a9c6447b req-29b47a4b-f084-4ac0-94d3-44c6be9b68d2 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:26.450161 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-88c78831-3839-4b12-b219-d082a9c6447b req-29b47a4b-f084-4ac0-94d3-44c6be9b68d2 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:26.455025 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-88c78831-3839-4b12-b219-d082a9c6447b req-29b47a4b-f084-4ac0-94d3-44c6be9b68d2 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:26.514648 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-88c78831-3839-4b12-b219-d082a9c6447b req-29b47a4b-f084-4ac0-94d3-44c6be9b68d2 service nova] Creating event network-changed:9e975956-70a6-4752-9499-532298e87730 for instance 7f05d753-e297-4330-ba02-dc0aac76de96 on n-h2-846463-3 Sep 23 05:00:26.544530 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-88c78831-3839-4b12-b219-d082a9c6447b req-29b47a4b-f084-4ac0-94d3-44c6be9b68d2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126529 Sep 23 05:00:26.545208 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2853/5876] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:00:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:00:26.783901 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d91cb121-25b5-4313-bc53-703df473383a tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:00:26.793960 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d91cb121-25b5-4313-bc53-703df473383a tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/7f05d753-e297-4330-ba02-dc0aac76de96" status: 200 len: 1691 microversion: 2.1 time: 0.429161 Sep 23 05:00:26.815355 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3024/5877] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:00:26 2022] GET /compute/v2.1/servers/7f05d753-e297-4330-ba02-dc0aac76de96 => generated 1691 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:00:26.881232 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c31794a6-177f-4ef7-9fea-df4cce79548e tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:26.882237 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c31794a6-177f-4ef7-9fea-df4cce79548e tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] [instance: 1d4b42f4-3285-41c7-8264-e596b9d8ac02] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:00:26.897770 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c31794a6-177f-4ef7-9fea-df4cce79548e tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:26.898787 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c31794a6-177f-4ef7-9fea-df4cce79548e tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:26.899236 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c31794a6-177f-4ef7-9fea-df4cce79548e tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:26.899955 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c31794a6-177f-4ef7-9fea-df4cce79548e tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:26.900421 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c31794a6-177f-4ef7-9fea-df4cce79548e tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:26.900852 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c31794a6-177f-4ef7-9fea-df4cce79548e tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:26.973859 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:00:27.254923 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c31794a6-177f-4ef7-9fea-df4cce79548e tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a845ca1e7747fba0a987235d980098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca57a0af591a43ee9cdef09134bc3fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:00:27.264599 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c31794a6-177f-4ef7-9fea-df4cce79548e tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] 10.222.0.33 "GET /compute/v2.1/servers/1d4b42f4-3285-41c7-8264-e596b9d8ac02" status: 200 len: 1506 microversion: 2.1 time: 0.387580 Sep 23 05:00:27.270590 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2854/5878] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:00:26 2022] GET /compute/v2.1/servers/1d4b42f4-3285-41c7-8264-e596b9d8ac02 => generated 1506 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:00:27.820854 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-34cbf126-606c-43e1-ae5e-8f4669cb4493 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:27.822335 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-34cbf126-606c-43e1-ae5e-8f4669cb4493 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 7f05d753-e297-4330-ba02-dc0aac76de96] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:00:27.833679 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-34cbf126-606c-43e1-ae5e-8f4669cb4493 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:27.840098 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-34cbf126-606c-43e1-ae5e-8f4669cb4493 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:27.840769 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-34cbf126-606c-43e1-ae5e-8f4669cb4493 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:27.841677 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-34cbf126-606c-43e1-ae5e-8f4669cb4493 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:27.842330 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-34cbf126-606c-43e1-ae5e-8f4669cb4493 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:27.842930 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-34cbf126-606c-43e1-ae5e-8f4669cb4493 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:28.196370 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-34cbf126-606c-43e1-ae5e-8f4669cb4493 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:00:28.218800 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-34cbf126-606c-43e1-ae5e-8f4669cb4493 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/7f05d753-e297-4330-ba02-dc0aac76de96" status: 200 len: 1691 microversion: 2.1 time: 0.402545 Sep 23 05:00:28.251783 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3025/5879] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:00:27 2022] GET /compute/v2.1/servers/7f05d753-e297-4330-ba02-dc0aac76de96 => generated 1691 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:00:28.302098 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-946d42bc-e611-428a-9902-7616e2bc27e8 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:28.302722 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-946d42bc-e611-428a-9902-7616e2bc27e8 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] [instance: 1d4b42f4-3285-41c7-8264-e596b9d8ac02] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:00:28.319531 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-946d42bc-e611-428a-9902-7616e2bc27e8 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:28.320324 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-946d42bc-e611-428a-9902-7616e2bc27e8 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:28.324068 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-946d42bc-e611-428a-9902-7616e2bc27e8 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:28.325206 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-946d42bc-e611-428a-9902-7616e2bc27e8 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:28.325854 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-946d42bc-e611-428a-9902-7616e2bc27e8 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:28.326485 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-946d42bc-e611-428a-9902-7616e2bc27e8 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:28.729997 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-946d42bc-e611-428a-9902-7616e2bc27e8 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a845ca1e7747fba0a987235d980098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca57a0af591a43ee9cdef09134bc3fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:00:28.737836 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-946d42bc-e611-428a-9902-7616e2bc27e8 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] 10.222.0.33 "GET /compute/v2.1/servers/1d4b42f4-3285-41c7-8264-e596b9d8ac02" status: 200 len: 1506 microversion: 2.1 time: 0.439594 Sep 23 05:00:28.750313 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2855/5880] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:00:28 2022] GET /compute/v2.1/servers/1d4b42f4-3285-41c7-8264-e596b9d8ac02 => generated 1506 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:00:29.249594 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3b93f380-4e48-41c1-b9f9-266c8d11e92a tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:29.251050 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-3b93f380-4e48-41c1-b9f9-266c8d11e92a tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 7f05d753-e297-4330-ba02-dc0aac76de96] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:00:29.263443 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3b93f380-4e48-41c1-b9f9-266c8d11e92a tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:29.263955 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3b93f380-4e48-41c1-b9f9-266c8d11e92a tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:29.264408 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3b93f380-4e48-41c1-b9f9-266c8d11e92a tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:29.272055 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3b93f380-4e48-41c1-b9f9-266c8d11e92a tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:29.272628 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3b93f380-4e48-41c1-b9f9-266c8d11e92a tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:29.273332 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3b93f380-4e48-41c1-b9f9-266c8d11e92a tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:29.516563 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-3b93f380-4e48-41c1-b9f9-266c8d11e92a tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:00:29.526331 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3b93f380-4e48-41c1-b9f9-266c8d11e92a tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/7f05d753-e297-4330-ba02-dc0aac76de96" status: 200 len: 1691 microversion: 2.1 time: 0.280695 Sep 23 05:00:29.528925 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3026/5881] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:00:29 2022] GET /compute/v2.1/servers/7f05d753-e297-4330-ba02-dc0aac76de96 => generated 1691 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:00:29.769380 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-59a8d530-3456-44fb-9380-1d8ff511fb9a tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:29.770770 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-59a8d530-3456-44fb-9380-1d8ff511fb9a tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] [instance: 1d4b42f4-3285-41c7-8264-e596b9d8ac02] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:00:29.808672 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-59a8d530-3456-44fb-9380-1d8ff511fb9a tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:29.809601 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-59a8d530-3456-44fb-9380-1d8ff511fb9a tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:29.812346 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-59a8d530-3456-44fb-9380-1d8ff511fb9a tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:29.817562 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-59a8d530-3456-44fb-9380-1d8ff511fb9a tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:29.818287 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-59a8d530-3456-44fb-9380-1d8ff511fb9a tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:29.821883 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-59a8d530-3456-44fb-9380-1d8ff511fb9a tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:30.083804 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-59a8d530-3456-44fb-9380-1d8ff511fb9a tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a845ca1e7747fba0a987235d980098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca57a0af591a43ee9cdef09134bc3fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:00:30.095272 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-59a8d530-3456-44fb-9380-1d8ff511fb9a tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] 10.222.0.33 "GET /compute/v2.1/servers/1d4b42f4-3285-41c7-8264-e596b9d8ac02" status: 200 len: 1506 microversion: 2.1 time: 0.331027 Sep 23 05:00:30.096785 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2856/5882] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:00:29 2022] GET /compute/v2.1/servers/1d4b42f4-3285-41c7-8264-e596b9d8ac02 => generated 1506 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:00:30.294175 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f4c94086-ba34-4b76-ad12-6c5b096585d1 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:30.297198 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f4c94086-ba34-4b76-ad12-6c5b096585d1 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] [instance: ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:00:30.311595 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f4c94086-ba34-4b76-ad12-6c5b096585d1 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:30.312913 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f4c94086-ba34-4b76-ad12-6c5b096585d1 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:30.314756 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f4c94086-ba34-4b76-ad12-6c5b096585d1 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:30.315684 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f4c94086-ba34-4b76-ad12-6c5b096585d1 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:30.318455 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f4c94086-ba34-4b76-ad12-6c5b096585d1 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:30.319135 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f4c94086-ba34-4b76-ad12-6c5b096585d1 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:30.386475 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f4c94086-ba34-4b76-ad12-6c5b096585d1 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] 10.222.0.33 "GET /compute/v2.1/servers/ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.097635 Sep 23 05:00:30.387798 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3027/5883] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Sep 23 05:00:30 2022] GET /compute/v2.1/servers/ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7/os-volume_attachments => generated 25 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 05:00:30.473778 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-a57ce5f7-ff79-412a-89b1-96418faa42c3 req-1f29e228-d4e2-4a25-9987-0e2bd1d19e1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d4b42f4-3285-41c7-8264-e596b9d8ac02", "name": "network-vif-deleted", "tag": "13485893-9e3f-4bb0-b531-8796b4cebfd1"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:00:30.535883 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-a57ce5f7-ff79-412a-89b1-96418faa42c3 req-1f29e228-d4e2-4a25-9987-0e2bd1d19e1f service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:30.536583 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-a57ce5f7-ff79-412a-89b1-96418faa42c3 req-1f29e228-d4e2-4a25-9987-0e2bd1d19e1f service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:30.538652 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-a57ce5f7-ff79-412a-89b1-96418faa42c3 req-1f29e228-d4e2-4a25-9987-0e2bd1d19e1f service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:30.558759 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8dafd1e8-a350-4e61-9282-02be21a37271 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:30.559639 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-8dafd1e8-a350-4e61-9282-02be21a37271 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 7f05d753-e297-4330-ba02-dc0aac76de96] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:00:30.573760 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8dafd1e8-a350-4e61-9282-02be21a37271 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:30.578160 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8dafd1e8-a350-4e61-9282-02be21a37271 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:30.581400 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8dafd1e8-a350-4e61-9282-02be21a37271 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:30.583343 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8dafd1e8-a350-4e61-9282-02be21a37271 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:30.590369 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8dafd1e8-a350-4e61-9282-02be21a37271 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:30.592367 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8dafd1e8-a350-4e61-9282-02be21a37271 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:30.603263 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-a57ce5f7-ff79-412a-89b1-96418faa42c3 req-1f29e228-d4e2-4a25-9987-0e2bd1d19e1f service nova] Creating event network-vif-deleted:13485893-9e3f-4bb0-b531-8796b4cebfd1 for instance 1d4b42f4-3285-41c7-8264-e596b9d8ac02 on n-h2-846463-3 Sep 23 05:00:30.619543 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-a57ce5f7-ff79-412a-89b1-96418faa42c3 req-1f29e228-d4e2-4a25-9987-0e2bd1d19e1f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152502 Sep 23 05:00:30.621051 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2857/5884] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:00:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:00:30.654769 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a2c76546-21fe-4fe0-ad3b-ec5ccb86e2f6 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:30.657407 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a2c76546-21fe-4fe0-ad3b-ec5ccb86e2f6 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] [instance: ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:00:30.666062 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a2c76546-21fe-4fe0-ad3b-ec5ccb86e2f6 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:30.666797 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a2c76546-21fe-4fe0-ad3b-ec5ccb86e2f6 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:30.667895 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a2c76546-21fe-4fe0-ad3b-ec5ccb86e2f6 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:30.668874 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a2c76546-21fe-4fe0-ad3b-ec5ccb86e2f6 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:30.670524 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a2c76546-21fe-4fe0-ad3b-ec5ccb86e2f6 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:30.671144 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a2c76546-21fe-4fe0-ad3b-ec5ccb86e2f6 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:30.756792 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a2c76546-21fe-4fe0-ad3b-ec5ccb86e2f6 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] 10.222.0.33 "GET /compute/v2.1/servers/ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.105117 Sep 23 05:00:30.762873 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2858/5885] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Sep 23 05:00:30 2022] GET /compute/v2.1/servers/ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7/os-volume_attachments => generated 25 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 05:00:30.934238 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1c89737b-9443-483f-9068-4238d35c6e31 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:30.936739 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-1c89737b-9443-483f-9068-4238d35c6e31 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] [instance: ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:00:30.960217 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-8dafd1e8-a350-4e61-9282-02be21a37271 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:00:30.965717 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1c89737b-9443-483f-9068-4238d35c6e31 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:30.966587 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1c89737b-9443-483f-9068-4238d35c6e31 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:30.968483 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1c89737b-9443-483f-9068-4238d35c6e31 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:30.970983 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1c89737b-9443-483f-9068-4238d35c6e31 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:30.971751 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1c89737b-9443-483f-9068-4238d35c6e31 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:30.972396 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1c89737b-9443-483f-9068-4238d35c6e31 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:30.972654 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-8dafd1e8-a350-4e61-9282-02be21a37271 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/7f05d753-e297-4330-ba02-dc0aac76de96" status: 200 len: 1691 microversion: 2.1 time: 0.418172 Sep 23 05:00:30.978150 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3028/5886] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:00:30 2022] GET /compute/v2.1/servers/7f05d753-e297-4330-ba02-dc0aac76de96 => generated 1691 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:00:31.036720 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-1c89737b-9443-483f-9068-4238d35c6e31 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] [instance: ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7] Going to try to terminate instance {{(pid=122698) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 05:00:31.123081 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c9ad86b4-7f16-4c68-91b5-6c5e256a0a2a tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:31.123946 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c9ad86b4-7f16-4c68-91b5-6c5e256a0a2a tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] [instance: 1d4b42f4-3285-41c7-8264-e596b9d8ac02] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:00:31.155423 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c9ad86b4-7f16-4c68-91b5-6c5e256a0a2a tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:31.161243 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c9ad86b4-7f16-4c68-91b5-6c5e256a0a2a tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:31.162241 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c9ad86b4-7f16-4c68-91b5-6c5e256a0a2a tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:31.164009 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c9ad86b4-7f16-4c68-91b5-6c5e256a0a2a tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:31.164713 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c9ad86b4-7f16-4c68-91b5-6c5e256a0a2a tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:31.165612 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c9ad86b4-7f16-4c68-91b5-6c5e256a0a2a tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:31.225642 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c9ad86b4-7f16-4c68-91b5-6c5e256a0a2a tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:31.227231 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c9ad86b4-7f16-4c68-91b5-6c5e256a0a2a tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:31.231073 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c9ad86b4-7f16-4c68-91b5-6c5e256a0a2a tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:31.231073 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-c9ad86b4-7f16-4c68-91b5-6c5e256a0a2a tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lazy-loading 'fault' on Instance uuid 1d4b42f4-3285-41c7-8264-e596b9d8ac02 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 05:00:31.280322 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c9ad86b4-7f16-4c68-91b5-6c5e256a0a2a tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a845ca1e7747fba0a987235d980098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca57a0af591a43ee9cdef09134bc3fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:00:31.291008 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c9ad86b4-7f16-4c68-91b5-6c5e256a0a2a tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] 10.222.0.33 "GET /compute/v2.1/servers/1d4b42f4-3285-41c7-8264-e596b9d8ac02" status: 200 len: 1304 microversion: 2.1 time: 0.173045 Sep 23 05:00:31.292252 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3029/5887] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:00:31 2022] GET /compute/v2.1/servers/1d4b42f4-3285-41c7-8264-e596b9d8ac02 => generated 1304 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:00:31.470859 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-1c89737b-9443-483f-9068-4238d35c6e31 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7" status: 204 len: 0 microversion: 2.1 time: 0.543542 Sep 23 05:00:31.472487 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2859/5888] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 05:00:30 2022] DELETE /compute/v2.1/servers/ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 23 05:00:31.482496 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ea21c4e3-9ab3-40a6-a9cf-5253966db8d5 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:31.482496 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ea21c4e3-9ab3-40a6-a9cf-5253966db8d5 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] [instance: ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:00:31.492898 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ea21c4e3-9ab3-40a6-a9cf-5253966db8d5 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:31.496060 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ea21c4e3-9ab3-40a6-a9cf-5253966db8d5 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:31.496627 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ea21c4e3-9ab3-40a6-a9cf-5253966db8d5 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:31.498717 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ea21c4e3-9ab3-40a6-a9cf-5253966db8d5 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:31.500945 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ea21c4e3-9ab3-40a6-a9cf-5253966db8d5 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:31.501504 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ea21c4e3-9ab3-40a6-a9cf-5253966db8d5 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:31.799408 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ea21c4e3-9ab3-40a6-a9cf-5253966db8d5 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bde73a530f4666aebdd5f7d9fa1046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71874a329e54494bb1b84f31c3826205', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:00:31.813151 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ea21c4e3-9ab3-40a6-a9cf-5253966db8d5 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] 10.222.0.33 "GET /compute/v2.1/servers/ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7" status: 200 len: 1673 microversion: 2.1 time: 0.334965 Sep 23 05:00:31.813863 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3030/5889] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:00:31 2022] GET /compute/v2.1/servers/ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7 => generated 1673 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:00:32.008163 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-391406e2-38a2-4df1-9214-84e214b3d3c6 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:32.012549 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-391406e2-38a2-4df1-9214-84e214b3d3c6 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 7f05d753-e297-4330-ba02-dc0aac76de96] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:00:32.035534 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-391406e2-38a2-4df1-9214-84e214b3d3c6 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:32.040081 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-391406e2-38a2-4df1-9214-84e214b3d3c6 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:32.040081 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-391406e2-38a2-4df1-9214-84e214b3d3c6 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:32.040081 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-391406e2-38a2-4df1-9214-84e214b3d3c6 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:32.040081 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-391406e2-38a2-4df1-9214-84e214b3d3c6 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:32.040081 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-391406e2-38a2-4df1-9214-84e214b3d3c6 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:32.344939 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6aaf6c4c-9407-4044-abbc-8fbed11afc86 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:32.345702 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-6aaf6c4c-9407-4044-abbc-8fbed11afc86 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] [instance: 1d4b42f4-3285-41c7-8264-e596b9d8ac02] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:00:32.357325 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6aaf6c4c-9407-4044-abbc-8fbed11afc86 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:32.357878 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6aaf6c4c-9407-4044-abbc-8fbed11afc86 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:32.358333 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6aaf6c4c-9407-4044-abbc-8fbed11afc86 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:32.359379 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6aaf6c4c-9407-4044-abbc-8fbed11afc86 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:32.360201 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6aaf6c4c-9407-4044-abbc-8fbed11afc86 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:32.360962 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6aaf6c4c-9407-4044-abbc-8fbed11afc86 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:32.431315 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-391406e2-38a2-4df1-9214-84e214b3d3c6 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:00:32.441321 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-391406e2-38a2-4df1-9214-84e214b3d3c6 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/7f05d753-e297-4330-ba02-dc0aac76de96" status: 200 len: 1691 microversion: 2.1 time: 0.441345 Sep 23 05:00:32.442463 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2860/5890] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:00:31 2022] GET /compute/v2.1/servers/7f05d753-e297-4330-ba02-dc0aac76de96 => generated 1691 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:00:32.448345 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6aaf6c4c-9407-4044-abbc-8fbed11afc86 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:32.449071 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6aaf6c4c-9407-4044-abbc-8fbed11afc86 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:32.449695 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6aaf6c4c-9407-4044-abbc-8fbed11afc86 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:32.450368 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-6aaf6c4c-9407-4044-abbc-8fbed11afc86 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lazy-loading 'fault' on Instance uuid 1d4b42f4-3285-41c7-8264-e596b9d8ac02 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 05:00:32.509118 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-6aaf6c4c-9407-4044-abbc-8fbed11afc86 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a845ca1e7747fba0a987235d980098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca57a0af591a43ee9cdef09134bc3fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:00:32.524553 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6aaf6c4c-9407-4044-abbc-8fbed11afc86 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] 10.222.0.33 "GET /compute/v2.1/servers/1d4b42f4-3285-41c7-8264-e596b9d8ac02" status: 200 len: 1304 microversion: 2.1 time: 0.207227 Sep 23 05:00:32.524553 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3031/5891] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:00:32 2022] GET /compute/v2.1/servers/1d4b42f4-3285-41c7-8264-e596b9d8ac02 => generated 1304 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:00:32.842122 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f77553ed-70b6-4325-a54e-c8e370bdf785 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:32.842758 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f77553ed-70b6-4325-a54e-c8e370bdf785 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] [instance: ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:00:32.853879 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f77553ed-70b6-4325-a54e-c8e370bdf785 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:32.854447 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f77553ed-70b6-4325-a54e-c8e370bdf785 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:32.854987 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f77553ed-70b6-4325-a54e-c8e370bdf785 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:32.855728 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f77553ed-70b6-4325-a54e-c8e370bdf785 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:32.856472 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f77553ed-70b6-4325-a54e-c8e370bdf785 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:32.856948 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f77553ed-70b6-4325-a54e-c8e370bdf785 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:33.118097 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f77553ed-70b6-4325-a54e-c8e370bdf785 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bde73a530f4666aebdd5f7d9fa1046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71874a329e54494bb1b84f31c3826205', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:00:33.128965 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f77553ed-70b6-4325-a54e-c8e370bdf785 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] 10.222.0.33 "GET /compute/v2.1/servers/ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7" status: 200 len: 1673 microversion: 2.1 time: 0.291730 Sep 23 05:00:33.129565 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2861/5892] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:00:32 2022] GET /compute/v2.1/servers/ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7 => generated 1673 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:00:33.466090 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9a8dcbba-3e1b-43d2-9d6a-3f10f5324931 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:33.467294 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-9a8dcbba-3e1b-43d2-9d6a-3f10f5324931 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 7f05d753-e297-4330-ba02-dc0aac76de96] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:00:33.477188 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9a8dcbba-3e1b-43d2-9d6a-3f10f5324931 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:33.480927 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9a8dcbba-3e1b-43d2-9d6a-3f10f5324931 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:33.481570 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9a8dcbba-3e1b-43d2-9d6a-3f10f5324931 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:33.482526 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9a8dcbba-3e1b-43d2-9d6a-3f10f5324931 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:33.483337 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9a8dcbba-3e1b-43d2-9d6a-3f10f5324931 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:33.483953 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9a8dcbba-3e1b-43d2-9d6a-3f10f5324931 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:33.551371 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4197b81b-b904-4549-8980-1a72e3aafd01 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:33.552153 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4197b81b-b904-4549-8980-1a72e3aafd01 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] [instance: 1d4b42f4-3285-41c7-8264-e596b9d8ac02] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:00:33.572918 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4197b81b-b904-4549-8980-1a72e3aafd01 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:33.576839 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4197b81b-b904-4549-8980-1a72e3aafd01 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:33.586001 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4197b81b-b904-4549-8980-1a72e3aafd01 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:33.589019 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4197b81b-b904-4549-8980-1a72e3aafd01 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:33.593675 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4197b81b-b904-4549-8980-1a72e3aafd01 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:33.597640 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4197b81b-b904-4549-8980-1a72e3aafd01 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:33.644929 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-4197b81b-b904-4549-8980-1a72e3aafd01 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] HTTP exception thrown: Instance 1d4b42f4-3285-41c7-8264-e596b9d8ac02 could not be found. Sep 23 05:00:33.647017 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4197b81b-b904-4549-8980-1a72e3aafd01 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Request method failure captured: Sep 23 05:00:33.647017 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/1d4b42f4-3285-41c7-8264-e596b9d8ac02 HTTP/1.1 Sep 23 05:00:33.647017 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 05:00:33.647017 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 05:00:33.647017 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 05:00:33.647017 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 05:00:33.647017 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 05:00:33.647017 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 05:00:33.647017 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 05:00:33.647017 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 05:00:33.647017 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTzwU5gBnHT9n9nONq7g7wAiXWXAzOAHuHiBOLNRyiCty3bD9g8jf3QO9kWMvZ-QVlxCEVRW5E2Z5J0Drrb1gIat-vXuVPsK_8pX6WIM0P5v2n1rVcscNBxfdfKKlIBQ1LW3724N92k3Jd8WzSig10g5HdXiot_lXf3fVujFRb_lPVk Sep 23 05:00:33.647017 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 05:00:33.647017 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 05:00:33.647017 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 05:00:33.647017 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 05:00:33.647017 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 05:00:33.647017 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 05:00:33.647017 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: ca57a0af591a43ee9cdef09134bc3fd8 Sep 23 05:00:33.647017 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ServerRescueTestJSON-1281510613 Sep 23 05:00:33.647017 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 05:00:33.647017 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 05:00:33.647017 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ca57a0af591a43ee9cdef09134bc3fd8", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ca57a0af591a43ee9cdef09134bc3fd8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ca57a0af591a43ee9cdef09134bc3fd8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ca57a0af591a43ee9cdef09134bc3fd8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:00:33.647017 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ServerRescueTestJSON-1281510613 Sep 23 05:00:33.647017 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: ca57a0af591a43ee9cdef09134bc3fd8 Sep 23 05:00:33.647017 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ServerRescueTestJSON-1281510613 Sep 23 05:00:33.647017 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ServerRescueTestJSON-1281510613-project Sep 23 05:00:33.647017 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 05:00:33.647017 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 05:00:33.647017 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 70a845ca1e7747fba0a987235d980098 Sep 23 05:00:33.647017 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ServerRescueTestJSON-1281510613-project Sep 23 05:00:33.647017 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 05:00:33.647017 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 1d4b42f4-3285-41c7-8264-e596b9d8ac02 could not be found. Sep 23 05:00:33.647017 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '1d4b42f4-3285-41c7-8264-e596b9d8ac02'} Sep 23 05:00:33.647017 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:00:33.647017 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:00:33.647017 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 05:00:33.647017 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 05:00:33.647017 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 05:00:33.647017 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 05:00:33.647017 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 05:00:33.647017 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 05:00:33.647017 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 05:00:33.647017 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 05:00:33.647017 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d4b42f4-3285-41c7-8264-e596b9d8ac02 could not be found. Sep 23 05:00:33.647017 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:00:33.647017 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:00:33.647017 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:00:33.647017 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:00:33.647017 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:00:33.647017 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:00:33.647017 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:00:33.647017 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:00:33.647017 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:00:33.647017 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:00:33.647017 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 05:00:33.647017 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 05:00:33.647017 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 05:00:33.647017 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 05:00:33.647017 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 05:00:33.647017 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:00:33.647017 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d4b42f4-3285-41c7-8264-e596b9d8ac02 could not be found. Sep 23 05:00:33.647017 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:00:33.647017 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:00:33.647017 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:00:33.652296 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:00:33.652296 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:00:33.652296 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:00:33.652296 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:00:33.652296 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:00:33.652296 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d4b42f4-3285-41c7-8264-e596b9d8ac02 could not be found. Sep 23 05:00:33.652296 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:00:33.659852 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4197b81b-b904-4549-8980-1a72e3aafd01 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Returning 404 to user: Instance 1d4b42f4-3285-41c7-8264-e596b9d8ac02 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:00:33.661415 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4197b81b-b904-4549-8980-1a72e3aafd01 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] 10.222.0.33 "GET /compute/v2.1/servers/1d4b42f4-3285-41c7-8264-e596b9d8ac02" status: 404 len: 111 microversion: 2.1 time: 0.114822 Sep 23 05:00:33.666232 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2862/5893] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:00:33 2022] GET /compute/v2.1/servers/1d4b42f4-3285-41c7-8264-e596b9d8ac02 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 05:00:33.671848 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-fc961e7c-a450-4b1a-9246-51819bcc7ab8 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:33.676760 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-fc961e7c-a450-4b1a-9246-51819bcc7ab8 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] [instance: 13a0b913-5596-453f-a5fb-119e20b6b885] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:00:33.691711 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fc961e7c-a450-4b1a-9246-51819bcc7ab8 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:33.692397 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fc961e7c-a450-4b1a-9246-51819bcc7ab8 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:33.697048 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fc961e7c-a450-4b1a-9246-51819bcc7ab8 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:33.698194 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fc961e7c-a450-4b1a-9246-51819bcc7ab8 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:33.698936 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fc961e7c-a450-4b1a-9246-51819bcc7ab8 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:33.699614 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fc961e7c-a450-4b1a-9246-51819bcc7ab8 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:33.775694 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-fc961e7c-a450-4b1a-9246-51819bcc7ab8 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] [instance: 13a0b913-5596-453f-a5fb-119e20b6b885] Going to try to terminate instance {{(pid=122698) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 05:00:33.812770 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-9a8dcbba-3e1b-43d2-9d6a-3f10f5324931 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:00:33.828302 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-9a8dcbba-3e1b-43d2-9d6a-3f10f5324931 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/7f05d753-e297-4330-ba02-dc0aac76de96" status: 200 len: 1691 microversion: 2.1 time: 0.366222 Sep 23 05:00:33.829496 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3032/5894] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:00:33 2022] GET /compute/v2.1/servers/7f05d753-e297-4330-ba02-dc0aac76de96 => generated 1691 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:00:34.157300 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9fad068e-6207-462f-aabc-de264e28aaad tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:34.157929 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-9fad068e-6207-462f-aabc-de264e28aaad tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] [instance: ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:00:34.169611 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9fad068e-6207-462f-aabc-de264e28aaad tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:34.174728 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9fad068e-6207-462f-aabc-de264e28aaad tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:34.175211 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9fad068e-6207-462f-aabc-de264e28aaad tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:34.175966 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9fad068e-6207-462f-aabc-de264e28aaad tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:34.185428 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9fad068e-6207-462f-aabc-de264e28aaad tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:34.185916 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9fad068e-6207-462f-aabc-de264e28aaad tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:34.318822 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-fc961e7c-a450-4b1a-9246-51819bcc7ab8 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] 10.222.0.33 "DELETE /compute/v2.1/servers/13a0b913-5596-453f-a5fb-119e20b6b885" status: 204 len: 0 microversion: 2.1 time: 0.649518 Sep 23 05:00:34.322386 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2863/5895] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 05:00:33 2022] DELETE /compute/v2.1/servers/13a0b913-5596-453f-a5fb-119e20b6b885 => generated 0 bytes in 655 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 05:00:34.332179 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9313a67f-6657-48fa-931c-fe7183555562 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:34.334059 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-9313a67f-6657-48fa-931c-fe7183555562 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] [instance: 13a0b913-5596-453f-a5fb-119e20b6b885] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:00:34.370286 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9313a67f-6657-48fa-931c-fe7183555562 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:34.371090 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9313a67f-6657-48fa-931c-fe7183555562 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:34.372973 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9313a67f-6657-48fa-931c-fe7183555562 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:34.377239 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9313a67f-6657-48fa-931c-fe7183555562 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:34.379162 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9313a67f-6657-48fa-931c-fe7183555562 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:34.380716 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9313a67f-6657-48fa-931c-fe7183555562 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:34.623135 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-9fad068e-6207-462f-aabc-de264e28aaad tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bde73a530f4666aebdd5f7d9fa1046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71874a329e54494bb1b84f31c3826205', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:00:34.626849 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:00:34.639257 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-9fad068e-6207-462f-aabc-de264e28aaad tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] 10.222.0.33 "GET /compute/v2.1/servers/ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7" status: 200 len: 1673 microversion: 2.1 time: 0.480898 Sep 23 05:00:34.640885 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3033/5896] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:00:34 2022] GET /compute/v2.1/servers/ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7 => generated 1673 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:00:34.810519 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-9313a67f-6657-48fa-931c-fe7183555562 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a845ca1e7747fba0a987235d980098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca57a0af591a43ee9cdef09134bc3fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:00:34.819423 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9313a67f-6657-48fa-931c-fe7183555562 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] 10.222.0.33 "GET /compute/v2.1/servers/13a0b913-5596-453f-a5fb-119e20b6b885" status: 200 len: 1491 microversion: 2.1 time: 0.492225 Sep 23 05:00:34.822555 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2864/5897] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:00:34 2022] GET /compute/v2.1/servers/13a0b913-5596-453f-a5fb-119e20b6b885 => generated 1491 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:00:34.865409 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b4ec7aa5-ae97-4f3a-b891-950fb99563ce tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:34.867327 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b4ec7aa5-ae97-4f3a-b891-950fb99563ce tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 7f05d753-e297-4330-ba02-dc0aac76de96] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:00:34.887283 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b4ec7aa5-ae97-4f3a-b891-950fb99563ce tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:34.888082 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b4ec7aa5-ae97-4f3a-b891-950fb99563ce tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:34.889657 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b4ec7aa5-ae97-4f3a-b891-950fb99563ce tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:34.891157 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b4ec7aa5-ae97-4f3a-b891-950fb99563ce tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:34.892867 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b4ec7aa5-ae97-4f3a-b891-950fb99563ce tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:34.895783 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b4ec7aa5-ae97-4f3a-b891-950fb99563ce tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:35.350166 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b4ec7aa5-ae97-4f3a-b891-950fb99563ce tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:00:35.367371 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b4ec7aa5-ae97-4f3a-b891-950fb99563ce tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/7f05d753-e297-4330-ba02-dc0aac76de96" status: 200 len: 1691 microversion: 2.1 time: 0.512728 Sep 23 05:00:35.367978 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3034/5898] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:00:34 2022] GET /compute/v2.1/servers/7f05d753-e297-4330-ba02-dc0aac76de96 => generated 1691 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:00:35.666328 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9a83036b-04e4-460b-a6bb-c5cf4785a0ec tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:35.667532 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-9a83036b-04e4-460b-a6bb-c5cf4785a0ec tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] [instance: ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:00:35.678448 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9a83036b-04e4-460b-a6bb-c5cf4785a0ec tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:35.679496 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9a83036b-04e4-460b-a6bb-c5cf4785a0ec tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:35.679952 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9a83036b-04e4-460b-a6bb-c5cf4785a0ec tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:35.684207 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9a83036b-04e4-460b-a6bb-c5cf4785a0ec tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:35.684695 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9a83036b-04e4-460b-a6bb-c5cf4785a0ec tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:35.685135 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9a83036b-04e4-460b-a6bb-c5cf4785a0ec tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:35.848867 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-efab2cd2-7f90-4e46-9818-3347af27999c tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:35.849778 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-efab2cd2-7f90-4e46-9818-3347af27999c tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] [instance: 13a0b913-5596-453f-a5fb-119e20b6b885] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:00:35.860452 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-efab2cd2-7f90-4e46-9818-3347af27999c tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:35.861612 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-efab2cd2-7f90-4e46-9818-3347af27999c tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:35.862385 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-efab2cd2-7f90-4e46-9818-3347af27999c tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:35.863334 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-efab2cd2-7f90-4e46-9818-3347af27999c tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:35.864205 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-efab2cd2-7f90-4e46-9818-3347af27999c tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:35.864908 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-efab2cd2-7f90-4e46-9818-3347af27999c tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:35.930033 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-9a83036b-04e4-460b-a6bb-c5cf4785a0ec tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bde73a530f4666aebdd5f7d9fa1046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71874a329e54494bb1b84f31c3826205', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:00:35.939963 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9a83036b-04e4-460b-a6bb-c5cf4785a0ec tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] 10.222.0.33 "GET /compute/v2.1/servers/ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7" status: 200 len: 1673 microversion: 2.1 time: 0.277901 Sep 23 05:00:35.957750 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2865/5899] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:00:35 2022] GET /compute/v2.1/servers/ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7 => generated 1673 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:00:36.104964 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-efab2cd2-7f90-4e46-9818-3347af27999c tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a845ca1e7747fba0a987235d980098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca57a0af591a43ee9cdef09134bc3fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:00:36.118144 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-efab2cd2-7f90-4e46-9818-3347af27999c tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] 10.222.0.33 "GET /compute/v2.1/servers/13a0b913-5596-453f-a5fb-119e20b6b885" status: 200 len: 1491 microversion: 2.1 time: 0.273988 Sep 23 05:00:36.122130 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3035/5900] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:00:35 2022] GET /compute/v2.1/servers/13a0b913-5596-453f-a5fb-119e20b6b885 => generated 1491 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:00:36.392710 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2eb9baeb-9cdb-49f8-b81f-0b3d85fa7ba5 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:36.393487 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-2eb9baeb-9cdb-49f8-b81f-0b3d85fa7ba5 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 7f05d753-e297-4330-ba02-dc0aac76de96] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:00:36.409428 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2eb9baeb-9cdb-49f8-b81f-0b3d85fa7ba5 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:36.410197 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2eb9baeb-9cdb-49f8-b81f-0b3d85fa7ba5 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:36.410761 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2eb9baeb-9cdb-49f8-b81f-0b3d85fa7ba5 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:36.411603 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2eb9baeb-9cdb-49f8-b81f-0b3d85fa7ba5 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:36.412182 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2eb9baeb-9cdb-49f8-b81f-0b3d85fa7ba5 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:36.412716 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2eb9baeb-9cdb-49f8-b81f-0b3d85fa7ba5 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:36.774596 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-2eb9baeb-9cdb-49f8-b81f-0b3d85fa7ba5 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:00:36.787440 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2eb9baeb-9cdb-49f8-b81f-0b3d85fa7ba5 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/7f05d753-e297-4330-ba02-dc0aac76de96" status: 200 len: 1691 microversion: 2.1 time: 0.398540 Sep 23 05:00:36.798593 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2866/5901] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:00:36 2022] GET /compute/v2.1/servers/7f05d753-e297-4330-ba02-dc0aac76de96 => generated 1691 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:00:36.931357 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-ed4df9e3-f523-4963-ac40-83cc301f9e5d req-2bc41643-b42d-4da5-ab28-4fac6a3499b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7", "name": "network-vif-deleted", "tag": "b1886339-f419-4169-8784-43f871380f08"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:00:36.953285 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-ed4df9e3-f523-4963-ac40-83cc301f9e5d req-2bc41643-b42d-4da5-ab28-4fac6a3499b2 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:36.953781 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-ed4df9e3-f523-4963-ac40-83cc301f9e5d req-2bc41643-b42d-4da5-ab28-4fac6a3499b2 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:36.954245 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-ed4df9e3-f523-4963-ac40-83cc301f9e5d req-2bc41643-b42d-4da5-ab28-4fac6a3499b2 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:36.964814 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-dd29afd2-263a-4823-ae32-d4bad83ff9d9 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:36.965433 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-dd29afd2-263a-4823-ae32-d4bad83ff9d9 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] [instance: ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:00:36.978426 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dd29afd2-263a-4823-ae32-d4bad83ff9d9 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:36.978954 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dd29afd2-263a-4823-ae32-d4bad83ff9d9 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:36.979402 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dd29afd2-263a-4823-ae32-d4bad83ff9d9 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:36.980119 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dd29afd2-263a-4823-ae32-d4bad83ff9d9 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:36.980576 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dd29afd2-263a-4823-ae32-d4bad83ff9d9 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:37.001255 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dd29afd2-263a-4823-ae32-d4bad83ff9d9 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:37.015506 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-ed4df9e3-f523-4963-ac40-83cc301f9e5d req-2bc41643-b42d-4da5-ab28-4fac6a3499b2 service nova] Creating event network-vif-deleted:b1886339-f419-4169-8784-43f871380f08 for instance ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7 on n-h2-846463-3 Sep 23 05:00:37.035426 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-ed4df9e3-f523-4963-ac40-83cc301f9e5d req-2bc41643-b42d-4da5-ab28-4fac6a3499b2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108907 Sep 23 05:00:37.037638 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3036/5902] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:00:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:00:37.144630 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-268146d2-bb62-4829-9b0d-1929e50dabd0 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:37.146154 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-268146d2-bb62-4829-9b0d-1929e50dabd0 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] [instance: 13a0b913-5596-453f-a5fb-119e20b6b885] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:00:37.157018 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-268146d2-bb62-4829-9b0d-1929e50dabd0 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:37.157861 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-268146d2-bb62-4829-9b0d-1929e50dabd0 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:37.158019 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-268146d2-bb62-4829-9b0d-1929e50dabd0 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:37.158696 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-268146d2-bb62-4829-9b0d-1929e50dabd0 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:37.159162 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-268146d2-bb62-4829-9b0d-1929e50dabd0 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:37.159590 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-268146d2-bb62-4829-9b0d-1929e50dabd0 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:37.345662 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-dd29afd2-263a-4823-ae32-d4bad83ff9d9 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bde73a530f4666aebdd5f7d9fa1046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71874a329e54494bb1b84f31c3826205', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:00:37.374351 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-dd29afd2-263a-4823-ae32-d4bad83ff9d9 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] 10.222.0.33 "GET /compute/v2.1/servers/ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7" status: 200 len: 1606 microversion: 2.1 time: 0.410859 Sep 23 05:00:37.375125 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2867/5903] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:00:36 2022] GET /compute/v2.1/servers/ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7 => generated 1606 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:00:37.614683 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-268146d2-bb62-4829-9b0d-1929e50dabd0 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a845ca1e7747fba0a987235d980098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca57a0af591a43ee9cdef09134bc3fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:00:37.685494 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-268146d2-bb62-4829-9b0d-1929e50dabd0 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] 10.222.0.33 "GET /compute/v2.1/servers/13a0b913-5596-453f-a5fb-119e20b6b885" status: 200 len: 1491 microversion: 2.1 time: 0.479656 Sep 23 05:00:37.685494 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3037/5904] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:00:37 2022] GET /compute/v2.1/servers/13a0b913-5596-453f-a5fb-119e20b6b885 => generated 1491 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:00:37.811548 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-80021895-2689-48e9-b207-3368b8bba7f1 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:37.814859 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-80021895-2689-48e9-b207-3368b8bba7f1 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 7f05d753-e297-4330-ba02-dc0aac76de96] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:00:37.830867 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-80021895-2689-48e9-b207-3368b8bba7f1 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:37.831403 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-80021895-2689-48e9-b207-3368b8bba7f1 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:37.832030 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-80021895-2689-48e9-b207-3368b8bba7f1 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:37.832787 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-80021895-2689-48e9-b207-3368b8bba7f1 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:37.833304 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-80021895-2689-48e9-b207-3368b8bba7f1 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:37.833753 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-80021895-2689-48e9-b207-3368b8bba7f1 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:38.297197 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-80021895-2689-48e9-b207-3368b8bba7f1 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:00:38.313976 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-80021895-2689-48e9-b207-3368b8bba7f1 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/7f05d753-e297-4330-ba02-dc0aac76de96" status: 200 len: 1691 microversion: 2.1 time: 0.506824 Sep 23 05:00:38.321611 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2868/5905] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:00:37 2022] GET /compute/v2.1/servers/7f05d753-e297-4330-ba02-dc0aac76de96 => generated 1691 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:00:38.403447 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c2b03969-6ebf-47e4-8dff-887f27376122 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:38.404074 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c2b03969-6ebf-47e4-8dff-887f27376122 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] [instance: ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:00:38.417941 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c2b03969-6ebf-47e4-8dff-887f27376122 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:38.422118 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c2b03969-6ebf-47e4-8dff-887f27376122 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:38.422118 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c2b03969-6ebf-47e4-8dff-887f27376122 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:38.422118 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c2b03969-6ebf-47e4-8dff-887f27376122 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:38.422118 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c2b03969-6ebf-47e4-8dff-887f27376122 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:38.422118 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c2b03969-6ebf-47e4-8dff-887f27376122 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:38.455253 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-c2b03969-6ebf-47e4-8dff-887f27376122 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] HTTP exception thrown: Instance ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7 could not be found. Sep 23 05:00:38.459587 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c2b03969-6ebf-47e4-8dff-887f27376122 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Request method failure captured: Sep 23 05:00:38.459587 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7 HTTP/1.1 Sep 23 05:00:38.459587 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 05:00:38.459587 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 05:00:38.459587 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 05:00:38.459587 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 05:00:38.459587 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 05:00:38.459587 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 05:00:38.459587 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 05:00:38.459587 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 05:00:38.459587 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTwZ6hD01ljWPq1xreS5YxLz-W2KqjD0WPLQoW0Au27CF934gukXy-o49lsIDKKinKs1pcTiYV-ikQsekIlgK9dC6LOUuEwv22Zem7WQr0WR0EQsDz23DzzdBF5nDgi_v4ysG5FxUW01KI8aMXTcPwUObwGpA6gtBfYK6S3PhCMr6Lw Sep 23 05:00:38.459587 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 05:00:38.459587 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 05:00:38.459587 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 05:00:38.459587 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 05:00:38.459587 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 05:00:38.459587 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 05:00:38.459587 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 71874a329e54494bb1b84f31c3826205 Sep 23 05:00:38.459587 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-AttachVolumeTestJSON-905720098 Sep 23 05:00:38.459587 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 05:00:38.459587 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 05:00:38.459587 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_71874a329e54494bb1b84f31c3826205", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/71874a329e54494bb1b84f31c3826205"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/71874a329e54494bb1b84f31c3826205"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/71874a329e54494bb1b84f31c3826205"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:00:38.459587 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-AttachVolumeTestJSON-905720098 Sep 23 05:00:38.459587 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 71874a329e54494bb1b84f31c3826205 Sep 23 05:00:38.459587 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-AttachVolumeTestJSON-905720098 Sep 23 05:00:38.459587 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-AttachVolumeTestJSON-905720098-project Sep 23 05:00:38.459587 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 05:00:38.459587 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 05:00:38.459587 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: d1bde73a530f4666aebdd5f7d9fa1046 Sep 23 05:00:38.459587 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-AttachVolumeTestJSON-905720098-project Sep 23 05:00:38.459587 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 05:00:38.459587 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7 could not be found. Sep 23 05:00:38.459587 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': 'ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7'} Sep 23 05:00:38.459587 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:00:38.459587 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:00:38.459587 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 05:00:38.459587 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 05:00:38.459587 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 05:00:38.459587 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 05:00:38.459587 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 05:00:38.459587 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 05:00:38.459587 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 05:00:38.459587 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 05:00:38.459587 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7 could not be found. Sep 23 05:00:38.459587 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:00:38.459587 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:00:38.459587 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:00:38.459587 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:00:38.459587 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:00:38.459587 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:00:38.459587 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:00:38.459587 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:00:38.459587 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:00:38.459587 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:00:38.459587 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 05:00:38.459587 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 05:00:38.459587 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 05:00:38.459587 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 05:00:38.459587 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 05:00:38.459587 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:00:38.459587 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7 could not be found. Sep 23 05:00:38.459587 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:00:38.459587 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:00:38.459587 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:00:38.464211 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:00:38.464211 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:00:38.464211 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:00:38.464211 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:00:38.464211 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:00:38.464211 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7 could not be found. Sep 23 05:00:38.464211 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:00:38.464211 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c2b03969-6ebf-47e4-8dff-887f27376122 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Returning 404 to user: Instance ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:00:38.464211 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c2b03969-6ebf-47e4-8dff-887f27376122 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] 10.222.0.33 "GET /compute/v2.1/servers/ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7" status: 404 len: 111 microversion: 2.1 time: 0.063763 Sep 23 05:00:38.472949 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2c961618-8b5b-442f-baaf-cee243c48814 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Calling method '.version_select at 0x7ff1ba747310>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:38.481365 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3038/5906] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:00:38 2022] GET /compute/v2.1/servers/ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 05:00:38.601032 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2c961618-8b5b-442f-baaf-cee243c48814 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-284355332" status: 202 len: 0 microversion: 2.1 time: 0.130505 Sep 23 05:00:38.610857 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2869/5907] 10.222.0.33 () {58 vars in 1218 bytes} [Fri Sep 23 05:00:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-284355332 => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 05:00:38.645398 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-540b9410-fa0a-4387-aa59-1401a4fade05 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:38.646440 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-540b9410-fa0a-4387-aa59-1401a4fade05 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] [instance: 13a0b913-5596-453f-a5fb-119e20b6b885] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:00:38.672539 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-540b9410-fa0a-4387-aa59-1401a4fade05 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:38.672539 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-540b9410-fa0a-4387-aa59-1401a4fade05 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:38.674163 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-540b9410-fa0a-4387-aa59-1401a4fade05 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:38.676801 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-540b9410-fa0a-4387-aa59-1401a4fade05 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:38.677351 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-540b9410-fa0a-4387-aa59-1401a4fade05 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:38.679173 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-540b9410-fa0a-4387-aa59-1401a4fade05 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:38.791682 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-540b9410-fa0a-4387-aa59-1401a4fade05 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a845ca1e7747fba0a987235d980098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca57a0af591a43ee9cdef09134bc3fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:00:38.803137 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-540b9410-fa0a-4387-aa59-1401a4fade05 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] 10.222.0.33 "GET /compute/v2.1/servers/13a0b913-5596-453f-a5fb-119e20b6b885" status: 200 len: 1449 microversion: 2.1 time: 0.162986 Sep 23 05:00:38.805082 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3039/5908] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:00:38 2022] GET /compute/v2.1/servers/13a0b913-5596-453f-a5fb-119e20b6b885 => generated 1449 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:00:39.134689 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-5b3321c0-4eca-4ba8-949a-0ebc7b42a918 req-f3a32da4-a638-4a6a-a430-661c60754f71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13a0b913-5596-453f-a5fb-119e20b6b885", "name": "network-vif-deleted", "tag": "6099b480-fb1a-4e93-bd74-b14a7d6a610b"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:00:39.158401 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-5b3321c0-4eca-4ba8-949a-0ebc7b42a918 req-f3a32da4-a638-4a6a-a430-661c60754f71 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:39.159404 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-5b3321c0-4eca-4ba8-949a-0ebc7b42a918 req-f3a32da4-a638-4a6a-a430-661c60754f71 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:39.160067 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-5b3321c0-4eca-4ba8-949a-0ebc7b42a918 req-f3a32da4-a638-4a6a-a430-661c60754f71 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:39.173103 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:00:39.176504 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-5b3321c0-4eca-4ba8-949a-0ebc7b42a918 req-f3a32da4-a638-4a6a-a430-661c60754f71 service nova] Creating event network-vif-deleted:6099b480-fb1a-4e93-bd74-b14a7d6a610b for instance 13a0b913-5596-453f-a5fb-119e20b6b885 on n-h1-846463-3 Sep 23 05:00:39.183314 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-5b3321c0-4eca-4ba8-949a-0ebc7b42a918 req-f3a32da4-a638-4a6a-a430-661c60754f71 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066622 Sep 23 05:00:39.184871 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2870/5909] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:00:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 05:00:39.346611 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-44b60efc-6efe-4c9f-a105-72ea2542a03a tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:39.347410 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-44b60efc-6efe-4c9f-a105-72ea2542a03a tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 7f05d753-e297-4330-ba02-dc0aac76de96] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:00:39.369152 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-44b60efc-6efe-4c9f-a105-72ea2542a03a tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:39.369673 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-44b60efc-6efe-4c9f-a105-72ea2542a03a tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:39.370169 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-44b60efc-6efe-4c9f-a105-72ea2542a03a tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:39.378040 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-44b60efc-6efe-4c9f-a105-72ea2542a03a tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:39.378562 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-44b60efc-6efe-4c9f-a105-72ea2542a03a tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:39.383885 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-44b60efc-6efe-4c9f-a105-72ea2542a03a tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:39.725825 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-44b60efc-6efe-4c9f-a105-72ea2542a03a tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:00:39.735768 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-44b60efc-6efe-4c9f-a105-72ea2542a03a tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/7f05d753-e297-4330-ba02-dc0aac76de96" status: 200 len: 1681 microversion: 2.1 time: 0.395369 Sep 23 05:00:39.746456 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3040/5910] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:00:39 2022] GET /compute/v2.1/servers/7f05d753-e297-4330-ba02-dc0aac76de96 => generated 1681 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:00:39.781151 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-217f082b-35ac-4d85-a3b6-311a991092c5 tempest-TestNetworkAdvancedServerOps-1586243358 tempest-TestNetworkAdvancedServerOps-1586243358-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:39.781151 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-217f082b-35ac-4d85-a3b6-311a991092c5 tempest-TestNetworkAdvancedServerOps-1586243358 tempest-TestNetworkAdvancedServerOps-1586243358-project-admin] [instance: 7f05d753-e297-4330-ba02-dc0aac76de96] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:00:39.797983 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-217f082b-35ac-4d85-a3b6-311a991092c5 tempest-TestNetworkAdvancedServerOps-1586243358 tempest-TestNetworkAdvancedServerOps-1586243358-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:39.798833 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-217f082b-35ac-4d85-a3b6-311a991092c5 tempest-TestNetworkAdvancedServerOps-1586243358 tempest-TestNetworkAdvancedServerOps-1586243358-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:39.803583 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-217f082b-35ac-4d85-a3b6-311a991092c5 tempest-TestNetworkAdvancedServerOps-1586243358 tempest-TestNetworkAdvancedServerOps-1586243358-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:39.803583 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-217f082b-35ac-4d85-a3b6-311a991092c5 tempest-TestNetworkAdvancedServerOps-1586243358 tempest-TestNetworkAdvancedServerOps-1586243358-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:39.804597 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-217f082b-35ac-4d85-a3b6-311a991092c5 tempest-TestNetworkAdvancedServerOps-1586243358 tempest-TestNetworkAdvancedServerOps-1586243358-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:39.806968 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-217f082b-35ac-4d85-a3b6-311a991092c5 tempest-TestNetworkAdvancedServerOps-1586243358 tempest-TestNetworkAdvancedServerOps-1586243358-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:39.829037 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e64accc8-6a01-46be-bc25-8655ff70aae8 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:39.836000 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e64accc8-6a01-46be-bc25-8655ff70aae8 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] [instance: 13a0b913-5596-453f-a5fb-119e20b6b885] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:00:39.852541 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e64accc8-6a01-46be-bc25-8655ff70aae8 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:39.857024 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e64accc8-6a01-46be-bc25-8655ff70aae8 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:39.859764 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e64accc8-6a01-46be-bc25-8655ff70aae8 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:39.862772 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e64accc8-6a01-46be-bc25-8655ff70aae8 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:39.865033 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e64accc8-6a01-46be-bc25-8655ff70aae8 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:39.865504 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e64accc8-6a01-46be-bc25-8655ff70aae8 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:39.991195 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e64accc8-6a01-46be-bc25-8655ff70aae8 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:39.996261 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e64accc8-6a01-46be-bc25-8655ff70aae8 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:39.997522 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e64accc8-6a01-46be-bc25-8655ff70aae8 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:39.998215 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-e64accc8-6a01-46be-bc25-8655ff70aae8 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lazy-loading 'fault' on Instance uuid 13a0b913-5596-453f-a5fb-119e20b6b885 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 05:00:40.496971 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e64accc8-6a01-46be-bc25-8655ff70aae8 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70a845ca1e7747fba0a987235d980098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca57a0af591a43ee9cdef09134bc3fd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:00:40.508333 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e64accc8-6a01-46be-bc25-8655ff70aae8 tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] 10.222.0.33 "GET /compute/v2.1/servers/13a0b913-5596-453f-a5fb-119e20b6b885" status: 200 len: 1303 microversion: 2.1 time: 0.680989 Sep 23 05:00:40.509300 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3041/5911] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:00:39 2022] GET /compute/v2.1/servers/13a0b913-5596-453f-a5fb-119e20b6b885 => generated 1303 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:00:40.732916 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-217f082b-35ac-4d85-a3b6-311a991092c5 tempest-TestNetworkAdvancedServerOps-1586243358 tempest-TestNetworkAdvancedServerOps-1586243358-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/7f05d753-e297-4330-ba02-dc0aac76de96" status: 200 len: 1832 microversion: 2.1 time: 0.955674 Sep 23 05:00:40.732916 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2871/5912] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:00:39 2022] GET /compute/v2.1/servers/7f05d753-e297-4330-ba02-dc0aac76de96 => generated 1832 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:00:40.761641 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-08535604-9a28-4f49-aaef-47bdab9044bf tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:40.767075 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-08535604-9a28-4f49-aaef-47bdab9044bf tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 7f05d753-e297-4330-ba02-dc0aac76de96] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:00:40.773223 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-08535604-9a28-4f49-aaef-47bdab9044bf tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:40.773732 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-08535604-9a28-4f49-aaef-47bdab9044bf tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:40.775938 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-08535604-9a28-4f49-aaef-47bdab9044bf tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:40.776729 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-08535604-9a28-4f49-aaef-47bdab9044bf tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:40.777200 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-08535604-9a28-4f49-aaef-47bdab9044bf tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:40.777635 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-08535604-9a28-4f49-aaef-47bdab9044bf tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:41.169200 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-08535604-9a28-4f49-aaef-47bdab9044bf tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:00:41.183108 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-08535604-9a28-4f49-aaef-47bdab9044bf tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/7f05d753-e297-4330-ba02-dc0aac76de96" status: 200 len: 1681 microversion: 2.1 time: 0.431124 Sep 23 05:00:41.184118 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3042/5913] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:00:40 2022] GET /compute/v2.1/servers/7f05d753-e297-4330-ba02-dc0aac76de96 => generated 1681 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:00:41.339973 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d7b77a69-ab01-4a63-843e-190e71790179 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:00:41.342386 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d7b77a69-ab01-4a63-843e-190e71790179 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 7f05d753-e297-4330-ba02-dc0aac76de96] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:00:41.360286 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d7b77a69-ab01-4a63-843e-190e71790179 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:41.362566 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d7b77a69-ab01-4a63-843e-190e71790179 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:41.364566 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d7b77a69-ab01-4a63-843e-190e71790179 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:41.366848 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d7b77a69-ab01-4a63-843e-190e71790179 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:41.368873 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d7b77a69-ab01-4a63-843e-190e71790179 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:41.370107 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d7b77a69-ab01-4a63-843e-190e71790179 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:41.463510 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d7b77a69-ab01-4a63-843e-190e71790179 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "POST /compute/v2.1/servers/7f05d753-e297-4330-ba02-dc0aac76de96/action" status: 200 len: 38675 microversion: 2.1 time: 0.128627 Sep 23 05:00:41.464598 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2872/5914] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 05:00:41 2022] POST /compute/v2.1/servers/7f05d753-e297-4330-ba02-dc0aac76de96/action => generated 38675 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 05:00:41.537129 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-db8cfab9-9a61-4117-b2bf-137650af3f5f tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:41.538000 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-db8cfab9-9a61-4117-b2bf-137650af3f5f tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] [instance: 13a0b913-5596-453f-a5fb-119e20b6b885] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:00:41.550134 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-db8cfab9-9a61-4117-b2bf-137650af3f5f tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:41.552031 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-db8cfab9-9a61-4117-b2bf-137650af3f5f tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:41.552031 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-db8cfab9-9a61-4117-b2bf-137650af3f5f tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:41.554208 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-db8cfab9-9a61-4117-b2bf-137650af3f5f tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:41.554959 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-db8cfab9-9a61-4117-b2bf-137650af3f5f tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:41.555684 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-db8cfab9-9a61-4117-b2bf-137650af3f5f tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:41.600250 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-db8cfab9-9a61-4117-b2bf-137650af3f5f tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] HTTP exception thrown: Instance 13a0b913-5596-453f-a5fb-119e20b6b885 could not be found. Sep 23 05:00:41.603180 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-db8cfab9-9a61-4117-b2bf-137650af3f5f tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Request method failure captured: Sep 23 05:00:41.603180 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/13a0b913-5596-453f-a5fb-119e20b6b885 HTTP/1.1 Sep 23 05:00:41.603180 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 05:00:41.603180 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 05:00:41.603180 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 05:00:41.603180 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 05:00:41.603180 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 05:00:41.603180 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 05:00:41.603180 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 05:00:41.603180 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 05:00:41.603180 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTzwU5gBnHT9n9nONq7g7wAiXWXAzOAHuHiBOLNRyiCty3bD9g8jf3QO9kWMvZ-QVlxCEVRW5E2Z5J0Drrb1gIat-vXuVPsK_8pX6WIM0P5v2n1rVcscNBxfdfKKlIBQ1LW3724N92k3Jd8WzSig10g5HdXiot_lXf3fVujFRb_lPVk Sep 23 05:00:41.603180 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 05:00:41.603180 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 05:00:41.603180 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 05:00:41.603180 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 05:00:41.603180 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 05:00:41.603180 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 05:00:41.603180 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: ca57a0af591a43ee9cdef09134bc3fd8 Sep 23 05:00:41.603180 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ServerRescueTestJSON-1281510613 Sep 23 05:00:41.603180 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 05:00:41.603180 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 05:00:41.603180 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ca57a0af591a43ee9cdef09134bc3fd8", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ca57a0af591a43ee9cdef09134bc3fd8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ca57a0af591a43ee9cdef09134bc3fd8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ca57a0af591a43ee9cdef09134bc3fd8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:00:41.603180 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ServerRescueTestJSON-1281510613 Sep 23 05:00:41.603180 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: ca57a0af591a43ee9cdef09134bc3fd8 Sep 23 05:00:41.603180 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ServerRescueTestJSON-1281510613 Sep 23 05:00:41.603180 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ServerRescueTestJSON-1281510613-project Sep 23 05:00:41.603180 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 05:00:41.603180 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 05:00:41.603180 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 70a845ca1e7747fba0a987235d980098 Sep 23 05:00:41.603180 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ServerRescueTestJSON-1281510613-project Sep 23 05:00:41.603180 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 05:00:41.603180 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 13a0b913-5596-453f-a5fb-119e20b6b885 could not be found. Sep 23 05:00:41.603180 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '13a0b913-5596-453f-a5fb-119e20b6b885'} Sep 23 05:00:41.603180 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:00:41.603180 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:00:41.603180 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 05:00:41.603180 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 05:00:41.603180 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 05:00:41.603180 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 05:00:41.603180 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 05:00:41.603180 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 05:00:41.603180 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 05:00:41.603180 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 05:00:41.603180 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13a0b913-5596-453f-a5fb-119e20b6b885 could not be found. Sep 23 05:00:41.603180 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:00:41.603180 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:00:41.603180 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:00:41.603180 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:00:41.603180 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:00:41.603180 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:00:41.603180 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:00:41.603180 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:00:41.603180 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:00:41.603180 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:00:41.603180 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 05:00:41.603180 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 05:00:41.603180 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 05:00:41.603180 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 05:00:41.603180 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 05:00:41.603180 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:00:41.603180 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13a0b913-5596-453f-a5fb-119e20b6b885 could not be found. Sep 23 05:00:41.603180 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:00:41.603180 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:00:41.603180 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:00:41.607210 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:00:41.607210 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:00:41.607210 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:00:41.607210 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:00:41.607210 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:00:41.607210 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13a0b913-5596-453f-a5fb-119e20b6b885 could not be found. Sep 23 05:00:41.607210 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:00:41.609410 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-db8cfab9-9a61-4117-b2bf-137650af3f5f tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] Returning 404 to user: Instance 13a0b913-5596-453f-a5fb-119e20b6b885 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:00:41.615793 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-db8cfab9-9a61-4117-b2bf-137650af3f5f tempest-ServerRescueTestJSON-1281510613 tempest-ServerRescueTestJSON-1281510613-project] 10.222.0.33 "GET /compute/v2.1/servers/13a0b913-5596-453f-a5fb-119e20b6b885" status: 404 len: 111 microversion: 2.1 time: 0.078077 Sep 23 05:00:41.615793 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3043/5915] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:00:41 2022] GET /compute/v2.1/servers/13a0b913-5596-453f-a5fb-119e20b6b885 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 05:00:47.088115 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-7f9a6de3-6730-42ac-8cd1-7e80bde8dca3 req-5dcb07a2-e0e4-47d2-9a22-31a83ad19155 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f05d753-e297-4330-ba02-dc0aac76de96", "tag": "9e975956-70a6-4752-9499-532298e87730"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:00:47.090122 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f655621d-59ca-4572-a21e-b03d29a77bc1 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:47.091980 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f655621d-59ca-4572-a21e-b03d29a77bc1 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 7f05d753-e297-4330-ba02-dc0aac76de96] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:00:47.112531 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f655621d-59ca-4572-a21e-b03d29a77bc1 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:47.113550 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f655621d-59ca-4572-a21e-b03d29a77bc1 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:47.114609 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-7f9a6de3-6730-42ac-8cd1-7e80bde8dca3 req-5dcb07a2-e0e4-47d2-9a22-31a83ad19155 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:47.115229 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f655621d-59ca-4572-a21e-b03d29a77bc1 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:47.116690 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f655621d-59ca-4572-a21e-b03d29a77bc1 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:47.118469 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-7f9a6de3-6730-42ac-8cd1-7e80bde8dca3 req-5dcb07a2-e0e4-47d2-9a22-31a83ad19155 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:47.119105 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-7f9a6de3-6730-42ac-8cd1-7e80bde8dca3 req-5dcb07a2-e0e4-47d2-9a22-31a83ad19155 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:47.121984 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f655621d-59ca-4572-a21e-b03d29a77bc1 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:47.122845 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f655621d-59ca-4572-a21e-b03d29a77bc1 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:47.156503 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-7f9a6de3-6730-42ac-8cd1-7e80bde8dca3 req-5dcb07a2-e0e4-47d2-9a22-31a83ad19155 service nova] Creating event network-changed:9e975956-70a6-4752-9499-532298e87730 for instance 7f05d753-e297-4330-ba02-dc0aac76de96 on n-h1-846463-3 Sep 23 05:00:47.175354 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-7f9a6de3-6730-42ac-8cd1-7e80bde8dca3 req-5dcb07a2-e0e4-47d2-9a22-31a83ad19155 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091835 Sep 23 05:00:47.176017 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3044/5916] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:00:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:00:47.220158 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f655621d-59ca-4572-a21e-b03d29a77bc1 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 7f05d753-e297-4330-ba02-dc0aac76de96] Going to try to terminate instance {{(pid=122698) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 05:00:47.741697 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f655621d-59ca-4572-a21e-b03d29a77bc1 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "DELETE /compute/v2.1/servers/7f05d753-e297-4330-ba02-dc0aac76de96" status: 204 len: 0 microversion: 2.1 time: 0.655182 Sep 23 05:00:47.741697 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2873/5917] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 05:00:47 2022] DELETE /compute/v2.1/servers/7f05d753-e297-4330-ba02-dc0aac76de96 => generated 0 bytes in 659 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 05:00:47.743243 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3a7dd9a9-c5e7-45ab-8e4c-9f8610c1e7a6 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:47.744680 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-3a7dd9a9-c5e7-45ab-8e4c-9f8610c1e7a6 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 7f05d753-e297-4330-ba02-dc0aac76de96] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:00:47.764011 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3a7dd9a9-c5e7-45ab-8e4c-9f8610c1e7a6 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:47.764538 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3a7dd9a9-c5e7-45ab-8e4c-9f8610c1e7a6 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:47.766828 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3a7dd9a9-c5e7-45ab-8e4c-9f8610c1e7a6 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:47.767599 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3a7dd9a9-c5e7-45ab-8e4c-9f8610c1e7a6 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:47.768081 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3a7dd9a9-c5e7-45ab-8e4c-9f8610c1e7a6 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:47.768516 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3a7dd9a9-c5e7-45ab-8e4c-9f8610c1e7a6 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:48.559357 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-3a7dd9a9-c5e7-45ab-8e4c-9f8610c1e7a6 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:00:48.567900 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3a7dd9a9-c5e7-45ab-8e4c-9f8610c1e7a6 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/7f05d753-e297-4330-ba02-dc0aac76de96" status: 200 len: 1687 microversion: 2.1 time: 0.829808 Sep 23 05:00:48.582275 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3045/5918] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:00:47 2022] GET /compute/v2.1/servers/7f05d753-e297-4330-ba02-dc0aac76de96 => generated 1687 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:00:49.595925 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-23626dd0-c297-44f6-8ab5-3d01a77c0ffc tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:49.596755 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-23626dd0-c297-44f6-8ab5-3d01a77c0ffc tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 7f05d753-e297-4330-ba02-dc0aac76de96] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:00:49.655288 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-23626dd0-c297-44f6-8ab5-3d01a77c0ffc tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:49.655969 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-23626dd0-c297-44f6-8ab5-3d01a77c0ffc tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:49.656589 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-23626dd0-c297-44f6-8ab5-3d01a77c0ffc tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:49.658834 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-23626dd0-c297-44f6-8ab5-3d01a77c0ffc tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:49.660462 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-23626dd0-c297-44f6-8ab5-3d01a77c0ffc tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:49.675985 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-23626dd0-c297-44f6-8ab5-3d01a77c0ffc tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:50.526978 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-23626dd0-c297-44f6-8ab5-3d01a77c0ffc tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:00:50.536043 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-23626dd0-c297-44f6-8ab5-3d01a77c0ffc tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/7f05d753-e297-4330-ba02-dc0aac76de96" status: 200 len: 1687 microversion: 2.1 time: 0.946223 Sep 23 05:00:50.542577 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2874/5919] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:00:49 2022] GET /compute/v2.1/servers/7f05d753-e297-4330-ba02-dc0aac76de96 => generated 1687 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:00:51.566500 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9692abe7-69b7-4dde-ac0f-e290076ffb6e tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:51.567726 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-9692abe7-69b7-4dde-ac0f-e290076ffb6e tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 7f05d753-e297-4330-ba02-dc0aac76de96] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:00:51.585921 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9692abe7-69b7-4dde-ac0f-e290076ffb6e tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:51.588068 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9692abe7-69b7-4dde-ac0f-e290076ffb6e tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:51.589488 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9692abe7-69b7-4dde-ac0f-e290076ffb6e tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:51.592372 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9692abe7-69b7-4dde-ac0f-e290076ffb6e tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:51.594300 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9692abe7-69b7-4dde-ac0f-e290076ffb6e tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:51.596073 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9692abe7-69b7-4dde-ac0f-e290076ffb6e tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:52.758309 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-9692abe7-69b7-4dde-ac0f-e290076ffb6e tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:00:52.777228 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-9692abe7-69b7-4dde-ac0f-e290076ffb6e tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/7f05d753-e297-4330-ba02-dc0aac76de96" status: 200 len: 1569 microversion: 2.1 time: 1.208956 Sep 23 05:00:52.780091 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3046/5920] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:00:51 2022] GET /compute/v2.1/servers/7f05d753-e297-4330-ba02-dc0aac76de96 => generated 1569 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:00:52.891928 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-d0e67ced-7647-44e7-951d-1f5f6b342703 req-fac1100a-ef01-4bf5-ae59-3455b9f48c59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f05d753-e297-4330-ba02-dc0aac76de96", "name": "network-vif-deleted", "tag": "9e975956-70a6-4752-9499-532298e87730"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:00:52.903006 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=4,nova_api:DELETE=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:00:52.955178 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-d0e67ced-7647-44e7-951d-1f5f6b342703 req-fac1100a-ef01-4bf5-ae59-3455b9f48c59 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:52.956314 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-d0e67ced-7647-44e7-951d-1f5f6b342703 req-fac1100a-ef01-4bf5-ae59-3455b9f48c59 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:52.956982 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-d0e67ced-7647-44e7-951d-1f5f6b342703 req-fac1100a-ef01-4bf5-ae59-3455b9f48c59 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:53.005762 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-d0e67ced-7647-44e7-951d-1f5f6b342703 req-fac1100a-ef01-4bf5-ae59-3455b9f48c59 service nova] Creating event network-vif-deleted:9e975956-70a6-4752-9499-532298e87730 for instance 7f05d753-e297-4330-ba02-dc0aac76de96 on n-h1-846463-3 Sep 23 05:00:53.024245 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-d0e67ced-7647-44e7-951d-1f5f6b342703 req-fac1100a-ef01-4bf5-ae59-3455b9f48c59 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132400 Sep 23 05:00:53.045359 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2875/5921] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:00:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:00:53.804751 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-de8138e0-85a9-4260-a358-170625827d26 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:53.805576 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-de8138e0-85a9-4260-a358-170625827d26 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 7f05d753-e297-4330-ba02-dc0aac76de96] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:00:53.826432 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-de8138e0-85a9-4260-a358-170625827d26 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:53.827057 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-de8138e0-85a9-4260-a358-170625827d26 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:53.827582 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-de8138e0-85a9-4260-a358-170625827d26 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:53.828421 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-de8138e0-85a9-4260-a358-170625827d26 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:53.832614 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-de8138e0-85a9-4260-a358-170625827d26 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:53.833321 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-de8138e0-85a9-4260-a358-170625827d26 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:53.938589 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-de8138e0-85a9-4260-a358-170625827d26 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:53.939371 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-de8138e0-85a9-4260-a358-170625827d26 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:53.941937 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-de8138e0-85a9-4260-a358-170625827d26 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:53.942602 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-de8138e0-85a9-4260-a358-170625827d26 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lazy-loading 'fault' on Instance uuid 7f05d753-e297-4330-ba02-dc0aac76de96 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 05:00:54.280729 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-de8138e0-85a9-4260-a358-170625827d26 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:00:54.296697 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-de8138e0-85a9-4260-a358-170625827d26 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/7f05d753-e297-4330-ba02-dc0aac76de96" status: 200 len: 1356 microversion: 2.1 time: 0.496848 Sep 23 05:00:54.318386 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3047/5922] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:00:53 2022] GET /compute/v2.1/servers/7f05d753-e297-4330-ba02-dc0aac76de96 => generated 1356 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:00:55.342242 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-579b38ef-6b2e-4b90-80e6-4cf2695faa43 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:55.343725 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-579b38ef-6b2e-4b90-80e6-4cf2695faa43 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 7f05d753-e297-4330-ba02-dc0aac76de96] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:00:55.356064 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-579b38ef-6b2e-4b90-80e6-4cf2695faa43 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:55.365313 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-579b38ef-6b2e-4b90-80e6-4cf2695faa43 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:55.369161 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-579b38ef-6b2e-4b90-80e6-4cf2695faa43 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:55.370311 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-579b38ef-6b2e-4b90-80e6-4cf2695faa43 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:55.371026 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-579b38ef-6b2e-4b90-80e6-4cf2695faa43 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:55.374904 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-579b38ef-6b2e-4b90-80e6-4cf2695faa43 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:55.416160 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-579b38ef-6b2e-4b90-80e6-4cf2695faa43 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] HTTP exception thrown: Instance 7f05d753-e297-4330-ba02-dc0aac76de96 could not be found. Sep 23 05:00:55.416285 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-579b38ef-6b2e-4b90-80e6-4cf2695faa43 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Request method failure captured: Sep 23 05:00:55.416285 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/7f05d753-e297-4330-ba02-dc0aac76de96 HTTP/1.1 Sep 23 05:00:55.416285 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 05:00:55.416285 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 05:00:55.416285 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 05:00:55.416285 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 05:00:55.416285 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 05:00:55.416285 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 05:00:55.416285 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 05:00:55.416285 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 05:00:55.416285 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTuh1c3OgRIe1BU7UL8-kD14hlRXf5-nFbACK4mxuSKPbpHtZ3lNSkhpLmoZL6fwvp0Ltsnj8vHhgRu38aM6jYq6FwsdCqK2OWFRVgv0DQ0vVXkecsl4CFvJWRuidyNHB1AUlKQZ5jbBIxVU9phuyFgTgBHHGat4T2qduHdIYS940-A Sep 23 05:00:55.416285 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 05:00:55.416285 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 05:00:55.416285 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 05:00:55.416285 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 05:00:55.416285 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 05:00:55.416285 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 05:00:55.416285 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 0edd6bd5b418494fbcb05c743967d36a Sep 23 05:00:55.416285 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-326863130 Sep 23 05:00:55.416285 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 05:00:55.416285 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 05:00:55.416285 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0edd6bd5b418494fbcb05c743967d36a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0edd6bd5b418494fbcb05c743967d36a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0edd6bd5b418494fbcb05c743967d36a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0edd6bd5b418494fbcb05c743967d36a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:00:55.416285 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-TestNetworkAdvancedServerOps-326863130 Sep 23 05:00:55.416285 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 0edd6bd5b418494fbcb05c743967d36a Sep 23 05:00:55.416285 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-326863130 Sep 23 05:00:55.416285 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-TestNetworkAdvancedServerOps-326863130-project Sep 23 05:00:55.416285 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 05:00:55.416285 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 05:00:55.416285 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 8d3d0a162e7e4beb81a54120cab246ff Sep 23 05:00:55.416285 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-TestNetworkAdvancedServerOps-326863130-project Sep 23 05:00:55.416285 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 05:00:55.416285 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 7f05d753-e297-4330-ba02-dc0aac76de96 could not be found. Sep 23 05:00:55.416285 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '7f05d753-e297-4330-ba02-dc0aac76de96'} Sep 23 05:00:55.416285 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:00:55.416285 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:00:55.416285 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 05:00:55.416285 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 05:00:55.416285 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 05:00:55.416285 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 05:00:55.416285 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 05:00:55.416285 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 05:00:55.416285 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 05:00:55.416285 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 05:00:55.416285 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f05d753-e297-4330-ba02-dc0aac76de96 could not be found. Sep 23 05:00:55.416285 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:00:55.416285 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:00:55.416285 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:00:55.416285 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:00:55.416285 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:00:55.416285 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:00:55.416285 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:00:55.416285 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:00:55.416285 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:00:55.416285 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:00:55.416285 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 05:00:55.416285 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 05:00:55.416285 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 05:00:55.416285 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 05:00:55.416285 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 05:00:55.416285 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:00:55.416285 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f05d753-e297-4330-ba02-dc0aac76de96 could not be found. Sep 23 05:00:55.416285 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:00:55.416285 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:00:55.420315 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:00:55.420315 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:00:55.420315 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:00:55.420315 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:00:55.420315 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:00:55.420315 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:00:55.420315 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f05d753-e297-4330-ba02-dc0aac76de96 could not be found. Sep 23 05:00:55.420315 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:00:55.420315 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-579b38ef-6b2e-4b90-80e6-4cf2695faa43 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Returning 404 to user: Instance 7f05d753-e297-4330-ba02-dc0aac76de96 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:00:55.420315 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-579b38ef-6b2e-4b90-80e6-4cf2695faa43 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/7f05d753-e297-4330-ba02-dc0aac76de96" status: 404 len: 111 microversion: 2.1 time: 0.081732 Sep 23 05:00:55.420315 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2876/5923] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:00:55 2022] GET /compute/v2.1/servers/7f05d753-e297-4330-ba02-dc0aac76de96 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 05:00:59.818664 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-32390593-f0b9-427a-a04f-ec2f3e4e805a tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-312889415", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "networks": "none"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:00:59.851316 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5cd0777b-e6d7-4a5e-b77f-a7d8a3f65a47 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:59.851910 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5cd0777b-e6d7-4a5e-b77f-a7d8a3f65a47 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] [instance: ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:00:59.852013 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=64 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:00:59.862770 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5cd0777b-e6d7-4a5e-b77f-a7d8a3f65a47 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:59.863257 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5cd0777b-e6d7-4a5e-b77f-a7d8a3f65a47 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:59.863702 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5cd0777b-e6d7-4a5e-b77f-a7d8a3f65a47 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:59.864427 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5cd0777b-e6d7-4a5e-b77f-a7d8a3f65a47 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:59.873139 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5cd0777b-e6d7-4a5e-b77f-a7d8a3f65a47 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:59.873717 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5cd0777b-e6d7-4a5e-b77f-a7d8a3f65a47 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:59.918617 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-5cd0777b-e6d7-4a5e-b77f-a7d8a3f65a47 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] HTTP exception thrown: Instance ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7 could not be found. Sep 23 05:00:59.920274 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5cd0777b-e6d7-4a5e-b77f-a7d8a3f65a47 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Request method failure captured: Sep 23 05:00:59.920274 n-d-846463-3 devstack@n-api.service[122698]: request: DELETE /compute/v2.1/servers/ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7 HTTP/1.1 Sep 23 05:00:59.920274 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 05:00:59.920274 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 05:00:59.920274 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 05:00:59.920274 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 05:00:59.920274 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 05:00:59.920274 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 05:00:59.920274 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 05:00:59.920274 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 05:00:59.920274 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTwZ6hD01ljWPq1xreS5YxLz-W2KqjD0WPLQoW0Au27CF934gukXy-o49lsIDKKinKs1pcTiYV-ikQsekIlgK9dC6LOUuEwv22Zem7WQr0WR0EQsDz23DzzdBF5nDgi_v4ysG5FxUW01KI8aMXTcPwUObwGpA6gtBfYK6S3PhCMr6Lw Sep 23 05:00:59.920274 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 05:00:59.920274 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 05:00:59.920274 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 05:00:59.920274 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 05:00:59.920274 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 05:00:59.920274 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 05:00:59.920274 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 71874a329e54494bb1b84f31c3826205 Sep 23 05:00:59.920274 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-AttachVolumeTestJSON-905720098 Sep 23 05:00:59.920274 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 05:00:59.920274 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 05:00:59.920274 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_71874a329e54494bb1b84f31c3826205", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/71874a329e54494bb1b84f31c3826205"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/71874a329e54494bb1b84f31c3826205"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/71874a329e54494bb1b84f31c3826205"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:00:59.920274 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-AttachVolumeTestJSON-905720098 Sep 23 05:00:59.920274 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 71874a329e54494bb1b84f31c3826205 Sep 23 05:00:59.920274 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-AttachVolumeTestJSON-905720098 Sep 23 05:00:59.920274 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-AttachVolumeTestJSON-905720098-project Sep 23 05:00:59.920274 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 05:00:59.920274 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 05:00:59.920274 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: d1bde73a530f4666aebdd5f7d9fa1046 Sep 23 05:00:59.920274 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-AttachVolumeTestJSON-905720098-project Sep 23 05:00:59.920274 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 05:00:59.920274 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7 could not be found. Sep 23 05:00:59.920274 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': 'ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7'} Sep 23 05:00:59.920274 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:00:59.920274 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:00:59.920274 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 05:00:59.920274 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 05:00:59.920274 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 05:00:59.920274 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 05:00:59.920274 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 05:00:59.920274 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 05:00:59.920274 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 05:00:59.920274 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 05:00:59.920274 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7 could not be found. Sep 23 05:00:59.920274 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:00:59.920274 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:00:59.920274 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:00:59.920274 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:00:59.920274 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:00:59.920274 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:00:59.920274 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:00:59.920274 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:00:59.920274 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:00:59.920274 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:00:59.920274 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 05:00:59.920274 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 05:00:59.920274 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 05:00:59.920274 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 05:00:59.920274 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 05:00:59.920274 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 05:00:59.920274 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 05:00:59.920274 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:00:59.930040 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7 could not be found. Sep 23 05:00:59.930040 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:00:59.930040 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:00:59.930040 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:00:59.930040 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:00:59.930040 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:00:59.930040 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:00:59.930040 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:00:59.930040 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:00:59.930040 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7 could not be found. Sep 23 05:00:59.930040 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:00:59.930040 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5cd0777b-e6d7-4a5e-b77f-a7d8a3f65a47 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Returning 404 to user: Instance ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:00:59.930040 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5cd0777b-e6d7-4a5e-b77f-a7d8a3f65a47 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7" status: 404 len: 111 microversion: 2.1 time: 0.080758 Sep 23 05:00:59.930040 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2877/5924] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 05:00:59 2022] DELETE /compute/v2.1/servers/ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 05:00:59.948875 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3b01c42a-cfd8-4bbe-8473-0e287b71a5f3 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:00:59.949504 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3b01c42a-cfd8-4bbe-8473-0e287b71a5f3 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] [instance: ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:00:59.963725 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-32390593-f0b9-427a-a04f-ec2f3e4e805a tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Flavor limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 05:00:59.966772 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-32390593-f0b9-427a-a04f-ec2f3e4e805a tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Image limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 05:00:59.967271 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-32390593-f0b9-427a-a04f-ec2f3e4e805a tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Flavor pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 05:00:59.968042 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-32390593-f0b9-427a-a04f-ec2f3e4e805a tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Image pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 05:00:59.969073 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-32390593-f0b9-427a-a04f-ec2f3e4e805a tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 05:00:59.971088 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3b01c42a-cfd8-4bbe-8473-0e287b71a5f3 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:59.971594 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3b01c42a-cfd8-4bbe-8473-0e287b71a5f3 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:59.982167 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3b01c42a-cfd8-4bbe-8473-0e287b71a5f3 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:59.982894 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-32390593-f0b9-427a-a04f-ec2f3e4e805a tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:59.983299 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3b01c42a-cfd8-4bbe-8473-0e287b71a5f3 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:59.983767 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-32390593-f0b9-427a-a04f-ec2f3e4e805a tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:59.983888 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3b01c42a-cfd8-4bbe-8473-0e287b71a5f3 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:59.984223 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3b01c42a-cfd8-4bbe-8473-0e287b71a5f3 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:59.985152 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-32390593-f0b9-427a-a04f-ec2f3e4e805a tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:00:59.986085 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-32390593-f0b9-427a-a04f-ec2f3e4e805a tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:00:59.987445 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-32390593-f0b9-427a-a04f-ec2f3e4e805a tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:00:59.988052 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-32390593-f0b9-427a-a04f-ec2f3e4e805a tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:00.016651 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-32390593-f0b9-427a-a04f-ec2f3e4e805a tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Getting quotas for project ab29c0466c5b4c7f884ac227a88f0aea. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 05:01:00.020638 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-3b01c42a-cfd8-4bbe-8473-0e287b71a5f3 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] HTTP exception thrown: Instance ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7 could not be found. Sep 23 05:01:00.022755 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3b01c42a-cfd8-4bbe-8473-0e287b71a5f3 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Request method failure captured: Sep 23 05:01:00.022755 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7 HTTP/1.1 Sep 23 05:01:00.022755 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 05:01:00.022755 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 05:01:00.022755 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 05:01:00.022755 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 05:01:00.022755 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 05:01:00.022755 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 05:01:00.022755 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 05:01:00.022755 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 05:01:00.022755 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTwZ6hD01ljWPq1xreS5YxLz-W2KqjD0WPLQoW0Au27CF934gukXy-o49lsIDKKinKs1pcTiYV-ikQsekIlgK9dC6LOUuEwv22Zem7WQr0WR0EQsDz23DzzdBF5nDgi_v4ysG5FxUW01KI8aMXTcPwUObwGpA6gtBfYK6S3PhCMr6Lw Sep 23 05:01:00.022755 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 05:01:00.022755 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 05:01:00.022755 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 05:01:00.022755 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 05:01:00.022755 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 05:01:00.022755 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 05:01:00.022755 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 71874a329e54494bb1b84f31c3826205 Sep 23 05:01:00.022755 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-AttachVolumeTestJSON-905720098 Sep 23 05:01:00.022755 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 05:01:00.022755 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 05:01:00.022755 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_71874a329e54494bb1b84f31c3826205", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/71874a329e54494bb1b84f31c3826205"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/71874a329e54494bb1b84f31c3826205"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/71874a329e54494bb1b84f31c3826205"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:01:00.022755 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-AttachVolumeTestJSON-905720098 Sep 23 05:01:00.022755 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 71874a329e54494bb1b84f31c3826205 Sep 23 05:01:00.022755 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-AttachVolumeTestJSON-905720098 Sep 23 05:01:00.022755 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-AttachVolumeTestJSON-905720098-project Sep 23 05:01:00.022755 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 05:01:00.022755 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 05:01:00.022755 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: d1bde73a530f4666aebdd5f7d9fa1046 Sep 23 05:01:00.022755 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-AttachVolumeTestJSON-905720098-project Sep 23 05:01:00.022755 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 05:01:00.022755 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7 could not be found. Sep 23 05:01:00.022755 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': 'ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7'} Sep 23 05:01:00.022755 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:01:00.022755 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:01:00.022755 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 05:01:00.022755 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 05:01:00.022755 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 05:01:00.022755 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 05:01:00.022755 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 05:01:00.022755 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 05:01:00.022755 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 05:01:00.022755 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 05:01:00.022755 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7 could not be found. Sep 23 05:01:00.022755 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:01:00.022755 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:01:00.022755 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:01:00.022755 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:01:00.022755 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:01:00.022755 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:01:00.022755 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:01:00.022755 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:01:00.022755 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:01:00.022755 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:01:00.022755 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 05:01:00.022755 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 05:01:00.022755 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 05:01:00.022755 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 05:01:00.022755 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 05:01:00.022755 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:01:00.022755 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7 could not be found. Sep 23 05:01:00.022755 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:01:00.022755 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:01:00.022755 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:01:00.027539 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:01:00.027539 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:01:00.027539 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:01:00.027539 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:01:00.027539 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:01:00.027539 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7 could not be found. Sep 23 05:01:00.027539 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:01:00.027539 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3b01c42a-cfd8-4bbe-8473-0e287b71a5f3 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Returning 404 to user: Instance ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:01:00.027539 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3b01c42a-cfd8-4bbe-8473-0e287b71a5f3 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] 10.222.0.33 "GET /compute/v2.1/servers/ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7" status: 404 len: 111 microversion: 2.1 time: 0.088407 Sep 23 05:01:00.030439 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-32390593-f0b9-427a-a04f-ec2f3e4e805a tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Getting quotas for user a3ee5406821b46e189d1cacd2124905f and project ab29c0466c5b4c7f884ac227a88f0aea. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 05:01:00.043856 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2878/5925] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:00:59 2022] GET /compute/v2.1/servers/ddffeb98-f4e3-48b1-ac0d-1e23148c4cd7 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 05:01:00.050946 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-32390593-f0b9-427a-a04f-ec2f3e4e805a tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Going to run 1 instances... {{(pid=122699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 05:01:00.053860 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-32390593-f0b9-427a-a04f-ec2f3e4e805a tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] [instance: eee49fca-510f-4ede-bc22-f85973409489] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 05:01:00.266967 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-32390593-f0b9-427a-a04f-ec2f3e4e805a tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 1.138984 Sep 23 05:01:00.267677 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3048/5926] 10.222.0.33 () {62 vars in 1188 bytes} [Fri Sep 23 05:00:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1143 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 23 05:01:00.279636 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e2dc7045-a89f-477d-96e0-3019309e8d7e tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:00.280265 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e2dc7045-a89f-477d-96e0-3019309e8d7e tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] [instance: eee49fca-510f-4ede-bc22-f85973409489] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:02.319247 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e2dc7045-a89f-477d-96e0-3019309e8d7e tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:02.328510 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e2dc7045-a89f-477d-96e0-3019309e8d7e tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:02.345382 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e2dc7045-a89f-477d-96e0-3019309e8d7e tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:02.348439 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e2dc7045-a89f-477d-96e0-3019309e8d7e tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] 10.222.0.33 "GET /compute/v2.1/servers/eee49fca-510f-4ede-bc22-f85973409489" status: 200 len: 1277 microversion: 2.47 time: 2.073007 Sep 23 05:01:02.356602 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2879/5927] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 05:01:00 2022] GET /compute/v2.1/servers/eee49fca-510f-4ede-bc22-f85973409489 => generated 1277 bytes in 2081 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 05:01:02.997593 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8f2ee572-0e3b-41f9-8b8c-beff7fc6909c tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1252054559", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "networks": "none"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:01:03.113234 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-8f2ee572-0e3b-41f9-8b8c-beff7fc6909c tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Flavor limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 05:01:03.113666 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-8f2ee572-0e3b-41f9-8b8c-beff7fc6909c tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Image limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 05:01:03.114174 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-8f2ee572-0e3b-41f9-8b8c-beff7fc6909c tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Flavor pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 05:01:03.114589 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-8f2ee572-0e3b-41f9-8b8c-beff7fc6909c tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Image pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 05:01:03.115316 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-8f2ee572-0e3b-41f9-8b8c-beff7fc6909c tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 05:01:03.149291 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8f2ee572-0e3b-41f9-8b8c-beff7fc6909c tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:03.153653 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8f2ee572-0e3b-41f9-8b8c-beff7fc6909c tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:03.154400 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8f2ee572-0e3b-41f9-8b8c-beff7fc6909c tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:03.158816 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8f2ee572-0e3b-41f9-8b8c-beff7fc6909c tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:03.163174 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8f2ee572-0e3b-41f9-8b8c-beff7fc6909c tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:03.164951 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8f2ee572-0e3b-41f9-8b8c-beff7fc6909c tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:03.249662 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-8f2ee572-0e3b-41f9-8b8c-beff7fc6909c tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Getting quotas for project ab29c0466c5b4c7f884ac227a88f0aea. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 05:01:03.276328 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-8f2ee572-0e3b-41f9-8b8c-beff7fc6909c tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Getting quotas for user a3ee5406821b46e189d1cacd2124905f and project ab29c0466c5b4c7f884ac227a88f0aea. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 05:01:03.321627 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-8f2ee572-0e3b-41f9-8b8c-beff7fc6909c tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Going to run 1 instances... {{(pid=122699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 05:01:03.323995 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-8f2ee572-0e3b-41f9-8b8c-beff7fc6909c tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] [instance: 190c8460-79bf-45a8-a441-75f8f05f713e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 05:01:03.680834 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-8f2ee572-0e3b-41f9-8b8c-beff7fc6909c tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.686526 Sep 23 05:01:03.680834 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3049/5928] 10.222.0.33 () {62 vars in 1188 bytes} [Fri Sep 23 05:01:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 688 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 23 05:01:03.698338 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-776b5d71-09c2-44b4-bd14-bfa9cf41b556 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:01:03.700926 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-776b5d71-09c2-44b4-bd14-bfa9cf41b556 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] [instance: 190c8460-79bf-45a8-a441-75f8f05f713e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:03.863398 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-776b5d71-09c2-44b4-bd14-bfa9cf41b556 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] 10.222.0.33 "PUT /compute/v2.1/servers/190c8460-79bf-45a8-a441-75f8f05f713e" status: 200 len: 992 microversion: 2.47 time: 0.169405 Sep 23 05:01:03.886155 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2880/5929] 10.222.0.33 () {62 vars in 1297 bytes} [Fri Sep 23 05:01:03 2022] PUT /compute/v2.1/servers/190c8460-79bf-45a8-a441-75f8f05f713e => generated 992 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 05:01:03.907143 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-46c754d9-811f-4d09-83fe-ecbdc558b5c0 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:03.907907 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-46c754d9-811f-4d09-83fe-ecbdc558b5c0 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] [instance: 190c8460-79bf-45a8-a441-75f8f05f713e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:04.335423 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-46c754d9-811f-4d09-83fe-ecbdc558b5c0 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:04.352161 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-46c754d9-811f-4d09-83fe-ecbdc558b5c0 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:04.377660 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-46c754d9-811f-4d09-83fe-ecbdc558b5c0 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:04.378931 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-46c754d9-811f-4d09-83fe-ecbdc558b5c0 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] 10.222.0.33 "GET /compute/v2.1/servers/190c8460-79bf-45a8-a441-75f8f05f713e" status: 200 len: 1278 microversion: 2.47 time: 0.476241 Sep 23 05:01:04.386787 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3050/5930] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 05:01:03 2022] GET /compute/v2.1/servers/190c8460-79bf-45a8-a441-75f8f05f713e => generated 1278 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 05:01:05.409385 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0addc034-f076-48a3-8bbb-3a8c6b39307f tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:05.410209 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-0addc034-f076-48a3-8bbb-3a8c6b39307f tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] [instance: 190c8460-79bf-45a8-a441-75f8f05f713e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:06.003541 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-0addc034-f076-48a3-8bbb-3a8c6b39307f tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:06.018601 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-0addc034-f076-48a3-8bbb-3a8c6b39307f tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:06.024787 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-0addc034-f076-48a3-8bbb-3a8c6b39307f tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:06.026668 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0addc034-f076-48a3-8bbb-3a8c6b39307f tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] 10.222.0.33 "GET /compute/v2.1/servers/190c8460-79bf-45a8-a441-75f8f05f713e" status: 200 len: 1278 microversion: 2.47 time: 0.621082 Sep 23 05:01:06.032091 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2881/5931] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 05:01:05 2022] GET /compute/v2.1/servers/190c8460-79bf-45a8-a441-75f8f05f713e => generated 1278 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 05:01:07.065618 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d21a0e5d-1837-48de-9736-8c5d877e1ff3 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:07.066902 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d21a0e5d-1837-48de-9736-8c5d877e1ff3 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] [instance: 190c8460-79bf-45a8-a441-75f8f05f713e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:07.095257 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d21a0e5d-1837-48de-9736-8c5d877e1ff3 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:07.098452 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d21a0e5d-1837-48de-9736-8c5d877e1ff3 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:07.103447 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d21a0e5d-1837-48de-9736-8c5d877e1ff3 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:07.105921 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d21a0e5d-1837-48de-9736-8c5d877e1ff3 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:07.110187 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d21a0e5d-1837-48de-9736-8c5d877e1ff3 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:07.116246 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d21a0e5d-1837-48de-9736-8c5d877e1ff3 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:07.213199 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=77 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:01:07.706681 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d21a0e5d-1837-48de-9736-8c5d877e1ff3 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:07.723864 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d21a0e5d-1837-48de-9736-8c5d877e1ff3 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:07.732108 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d21a0e5d-1837-48de-9736-8c5d877e1ff3 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:07.737687 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d21a0e5d-1837-48de-9736-8c5d877e1ff3 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] 10.222.0.33 "GET /compute/v2.1/servers/190c8460-79bf-45a8-a441-75f8f05f713e" status: 200 len: 1282 microversion: 2.47 time: 0.677463 Sep 23 05:01:07.743155 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3051/5932] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 05:01:07 2022] GET /compute/v2.1/servers/190c8460-79bf-45a8-a441-75f8f05f713e => generated 1282 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 05:01:08.768880 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-54dfeb5a-7128-4b50-8f7e-d42338084625 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:08.770135 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-54dfeb5a-7128-4b50-8f7e-d42338084625 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] [instance: 190c8460-79bf-45a8-a441-75f8f05f713e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:08.803164 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-54dfeb5a-7128-4b50-8f7e-d42338084625 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:08.813585 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-54dfeb5a-7128-4b50-8f7e-d42338084625 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:08.814537 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-54dfeb5a-7128-4b50-8f7e-d42338084625 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:08.817214 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-54dfeb5a-7128-4b50-8f7e-d42338084625 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:08.819405 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-54dfeb5a-7128-4b50-8f7e-d42338084625 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:08.830878 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-54dfeb5a-7128-4b50-8f7e-d42338084625 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:09.200422 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-54dfeb5a-7128-4b50-8f7e-d42338084625 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:09.216722 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-54dfeb5a-7128-4b50-8f7e-d42338084625 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:09.221557 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-54dfeb5a-7128-4b50-8f7e-d42338084625 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:09.227268 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-54dfeb5a-7128-4b50-8f7e-d42338084625 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] 10.222.0.33 "GET /compute/v2.1/servers/190c8460-79bf-45a8-a441-75f8f05f713e" status: 200 len: 1330 microversion: 2.47 time: 0.459437 Sep 23 05:01:09.229248 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2882/5933] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 05:01:08 2022] GET /compute/v2.1/servers/190c8460-79bf-45a8-a441-75f8f05f713e => generated 1330 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 05:01:10.267442 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-14600335-c964-4cec-a0d7-3302ce917244 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:10.268615 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-14600335-c964-4cec-a0d7-3302ce917244 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] [instance: 190c8460-79bf-45a8-a441-75f8f05f713e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:10.297504 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-14600335-c964-4cec-a0d7-3302ce917244 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:10.298443 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-14600335-c964-4cec-a0d7-3302ce917244 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:10.299078 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-14600335-c964-4cec-a0d7-3302ce917244 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:10.305654 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-14600335-c964-4cec-a0d7-3302ce917244 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:10.307563 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-14600335-c964-4cec-a0d7-3302ce917244 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:10.308447 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-14600335-c964-4cec-a0d7-3302ce917244 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:10.744668 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2be2464a-a28e-473b-a132-36817cb2f5f6 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '.version_select at 0x7ff1ba720310>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:11.082661 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2be2464a-a28e-473b-a132-36817cb2f5f6 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1395192842" status: 202 len: 0 microversion: 2.1 time: 0.341962 Sep 23 05:01:11.083265 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2883/5934] 10.222.0.33 () {58 vars in 1284 bytes} [Fri Sep 23 05:01:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1395192842 => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 23 05:01:11.119094 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6f8f2262-85ac-45e8-881f-dc8d2243288d tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Action: 'create', calling method: .version_select at 0x7ff1ba85c310>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1122301964", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEOBrIIN9bwpVcQNXuYdL6C39adZWf8fpu5wiIu+V3vcyXbfqB1tOsN2y44K4Kz4Lot+KPW/8BnF9L5GI67mCiFxfvZSusQDpXIVDtMKedPNvC/vH3a8paMk3rMVBX0AiQ=="}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:01:11.149869 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-6f8f2262-85ac-45e8-881f-dc8d2243288d tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Getting quotas for project 0edd6bd5b418494fbcb05c743967d36a. Resources: {'key_pairs'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 05:01:11.172127 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-6f8f2262-85ac-45e8-881f-dc8d2243288d tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Getting quotas for user 8d3d0a162e7e4beb81a54120cab246ff and project 0edd6bd5b418494fbcb05c743967d36a. Resources: {'key_pairs'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 05:01:11.320613 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-6f8f2262-85ac-45e8-881f-dc8d2243288d tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.206893 Sep 23 05:01:11.338126 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2884/5935] 10.222.0.33 () {60 vars in 1159 bytes} [Fri Sep 23 05:01:11 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 05:01:11.477574 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-14600335-c964-4cec-a0d7-3302ce917244 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:11.487120 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-14600335-c964-4cec-a0d7-3302ce917244 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:11.488588 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-14600335-c964-4cec-a0d7-3302ce917244 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:11.501154 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-14600335-c964-4cec-a0d7-3302ce917244 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] 10.222.0.33 "GET /compute/v2.1/servers/190c8460-79bf-45a8-a441-75f8f05f713e" status: 200 len: 1336 microversion: 2.47 time: 1.236299 Sep 23 05:01:11.502386 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3052/5936] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 05:01:10 2022] GET /compute/v2.1/servers/190c8460-79bf-45a8-a441-75f8f05f713e => generated 1336 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 05:01:12.399479 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-665fb09c-1b96-4866-8e87-65d5d769c9bb tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:12.400131 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-665fb09c-1b96-4866-8e87-65d5d769c9bb tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] [instance: 6dfb2418-b235-4d35-b109-4bed20d1b96e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:12.420041 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-665fb09c-1b96-4866-8e87-65d5d769c9bb tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:12.424890 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-665fb09c-1b96-4866-8e87-65d5d769c9bb tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:12.425782 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-665fb09c-1b96-4866-8e87-65d5d769c9bb tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:12.431632 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-665fb09c-1b96-4866-8e87-65d5d769c9bb tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:12.439610 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-665fb09c-1b96-4866-8e87-65d5d769c9bb tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:12.441213 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-665fb09c-1b96-4866-8e87-65d5d769c9bb tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:12.499104 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-665fb09c-1b96-4866-8e87-65d5d769c9bb tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] HTTP exception thrown: Instance 6dfb2418-b235-4d35-b109-4bed20d1b96e could not be found. Sep 23 05:01:12.503935 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-665fb09c-1b96-4866-8e87-65d5d769c9bb tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Request method failure captured: Sep 23 05:01:12.503935 n-d-846463-3 devstack@n-api.service[122698]: request: DELETE /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e HTTP/1.1 Sep 23 05:01:12.503935 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 05:01:12.503935 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 05:01:12.503935 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 05:01:12.503935 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 05:01:12.503935 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 05:01:12.503935 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 05:01:12.503935 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 05:01:12.503935 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 05:01:12.503935 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTwZ6hD01ljWPq1xreS5YxLz-W2KqjD0WPLQoW0Au27CF934gukXy-o49lsIDKKinKs1pcTiYV-ikQsekIlgK9dC6LOUuEwv22Zem7WQr0WR0EQsDz23DzzdBF5nDgi_v4ysG5FxUW01KI8aMXTcPwUObwGpA6gtBfYK6S3PhCMr6Lw Sep 23 05:01:12.503935 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 05:01:12.503935 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 05:01:12.503935 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 05:01:12.503935 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 05:01:12.503935 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 05:01:12.503935 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 05:01:12.503935 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 71874a329e54494bb1b84f31c3826205 Sep 23 05:01:12.503935 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-AttachVolumeTestJSON-905720098 Sep 23 05:01:12.503935 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 05:01:12.503935 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 05:01:12.503935 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_71874a329e54494bb1b84f31c3826205", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/71874a329e54494bb1b84f31c3826205"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/71874a329e54494bb1b84f31c3826205"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/71874a329e54494bb1b84f31c3826205"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:01:12.503935 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-AttachVolumeTestJSON-905720098 Sep 23 05:01:12.503935 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 71874a329e54494bb1b84f31c3826205 Sep 23 05:01:12.503935 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-AttachVolumeTestJSON-905720098 Sep 23 05:01:12.503935 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-AttachVolumeTestJSON-905720098-project Sep 23 05:01:12.503935 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 05:01:12.503935 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 05:01:12.503935 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: d1bde73a530f4666aebdd5f7d9fa1046 Sep 23 05:01:12.503935 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-AttachVolumeTestJSON-905720098-project Sep 23 05:01:12.503935 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 05:01:12.503935 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 6dfb2418-b235-4d35-b109-4bed20d1b96e could not be found. Sep 23 05:01:12.503935 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '6dfb2418-b235-4d35-b109-4bed20d1b96e'} Sep 23 05:01:12.503935 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:01:12.503935 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:01:12.503935 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 05:01:12.503935 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 05:01:12.503935 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 05:01:12.503935 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 05:01:12.503935 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 05:01:12.503935 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 05:01:12.503935 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 05:01:12.503935 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 05:01:12.503935 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6dfb2418-b235-4d35-b109-4bed20d1b96e could not be found. Sep 23 05:01:12.503935 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:01:12.503935 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:01:12.503935 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:01:12.503935 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:01:12.503935 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:01:12.503935 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:01:12.503935 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:01:12.503935 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:01:12.503935 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:01:12.503935 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:01:12.503935 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 05:01:12.503935 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 05:01:12.503935 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 05:01:12.503935 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 05:01:12.503935 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 05:01:12.503935 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 05:01:12.503935 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 05:01:12.503935 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:01:12.513651 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6dfb2418-b235-4d35-b109-4bed20d1b96e could not be found. Sep 23 05:01:12.513651 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:01:12.513651 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:01:12.513651 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:01:12.513651 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:01:12.513651 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:01:12.513651 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:01:12.513651 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:01:12.513651 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:01:12.513651 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6dfb2418-b235-4d35-b109-4bed20d1b96e could not be found. Sep 23 05:01:12.513651 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:01:12.513651 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-665fb09c-1b96-4866-8e87-65d5d769c9bb tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Returning 404 to user: Instance 6dfb2418-b235-4d35-b109-4bed20d1b96e could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:01:12.513651 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-665fb09c-1b96-4866-8e87-65d5d769c9bb tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e" status: 404 len: 111 microversion: 2.1 time: 0.114891 Sep 23 05:01:12.518313 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2885/5937] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 05:01:12 2022] DELETE /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 05:01:12.522709 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f626b2d9-4abc-48d7-a504-e6883dc02b15 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:12.523426 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f626b2d9-4abc-48d7-a504-e6883dc02b15 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] [instance: 6dfb2418-b235-4d35-b109-4bed20d1b96e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:12.540859 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-bde89553-f941-4f75-b07b-563540a33bfb tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:12.541594 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-bde89553-f941-4f75-b07b-563540a33bfb tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] [instance: 190c8460-79bf-45a8-a441-75f8f05f713e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:12.556820 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bde89553-f941-4f75-b07b-563540a33bfb tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:12.557453 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bde89553-f941-4f75-b07b-563540a33bfb tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:12.558256 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f626b2d9-4abc-48d7-a504-e6883dc02b15 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:12.560263 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f626b2d9-4abc-48d7-a504-e6883dc02b15 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:12.561173 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bde89553-f941-4f75-b07b-563540a33bfb tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:12.562315 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bde89553-f941-4f75-b07b-563540a33bfb tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:12.562916 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bde89553-f941-4f75-b07b-563540a33bfb tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:12.563740 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bde89553-f941-4f75-b07b-563540a33bfb tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:12.572867 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f626b2d9-4abc-48d7-a504-e6883dc02b15 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:12.575869 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f626b2d9-4abc-48d7-a504-e6883dc02b15 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:12.577949 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f626b2d9-4abc-48d7-a504-e6883dc02b15 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:12.581630 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f626b2d9-4abc-48d7-a504-e6883dc02b15 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:12.636163 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-f626b2d9-4abc-48d7-a504-e6883dc02b15 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] HTTP exception thrown: Instance 6dfb2418-b235-4d35-b109-4bed20d1b96e could not be found. Sep 23 05:01:12.644018 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f626b2d9-4abc-48d7-a504-e6883dc02b15 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Request method failure captured: Sep 23 05:01:12.644018 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e HTTP/1.1 Sep 23 05:01:12.644018 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 05:01:12.644018 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 05:01:12.644018 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 05:01:12.644018 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 05:01:12.644018 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 05:01:12.644018 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 05:01:12.644018 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 05:01:12.644018 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 05:01:12.644018 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLTwZ6hD01ljWPq1xreS5YxLz-W2KqjD0WPLQoW0Au27CF934gukXy-o49lsIDKKinKs1pcTiYV-ikQsekIlgK9dC6LOUuEwv22Zem7WQr0WR0EQsDz23DzzdBF5nDgi_v4ysG5FxUW01KI8aMXTcPwUObwGpA6gtBfYK6S3PhCMr6Lw Sep 23 05:01:12.644018 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 05:01:12.644018 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 05:01:12.644018 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 05:01:12.644018 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 05:01:12.644018 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 05:01:12.644018 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 05:01:12.644018 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 71874a329e54494bb1b84f31c3826205 Sep 23 05:01:12.644018 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-AttachVolumeTestJSON-905720098 Sep 23 05:01:12.644018 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 05:01:12.644018 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 05:01:12.644018 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_71874a329e54494bb1b84f31c3826205", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/71874a329e54494bb1b84f31c3826205"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/71874a329e54494bb1b84f31c3826205"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/71874a329e54494bb1b84f31c3826205"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:01:12.644018 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-AttachVolumeTestJSON-905720098 Sep 23 05:01:12.644018 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 71874a329e54494bb1b84f31c3826205 Sep 23 05:01:12.644018 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-AttachVolumeTestJSON-905720098 Sep 23 05:01:12.644018 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-AttachVolumeTestJSON-905720098-project Sep 23 05:01:12.644018 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 05:01:12.644018 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 05:01:12.644018 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: d1bde73a530f4666aebdd5f7d9fa1046 Sep 23 05:01:12.644018 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-AttachVolumeTestJSON-905720098-project Sep 23 05:01:12.644018 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 05:01:12.644018 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 6dfb2418-b235-4d35-b109-4bed20d1b96e could not be found. Sep 23 05:01:12.644018 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '6dfb2418-b235-4d35-b109-4bed20d1b96e'} Sep 23 05:01:12.644018 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:01:12.644018 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:01:12.644018 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 05:01:12.644018 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 05:01:12.644018 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 05:01:12.644018 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 05:01:12.644018 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 05:01:12.644018 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 05:01:12.644018 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 05:01:12.644018 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 05:01:12.644018 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6dfb2418-b235-4d35-b109-4bed20d1b96e could not be found. Sep 23 05:01:12.644018 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:01:12.644018 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:01:12.644018 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:01:12.644018 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:01:12.644018 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:01:12.644018 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:01:12.644018 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:01:12.644018 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:01:12.644018 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:01:12.644018 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:01:12.644018 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 05:01:12.644018 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 05:01:12.644018 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 05:01:12.644018 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 05:01:12.644018 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 05:01:12.644018 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:01:12.644018 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6dfb2418-b235-4d35-b109-4bed20d1b96e could not be found. Sep 23 05:01:12.644018 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:01:12.644018 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:01:12.644018 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:01:12.649212 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:01:12.649212 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:01:12.649212 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:01:12.649212 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:01:12.649212 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:01:12.649212 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6dfb2418-b235-4d35-b109-4bed20d1b96e could not be found. Sep 23 05:01:12.649212 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:01:12.649212 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f626b2d9-4abc-48d7-a504-e6883dc02b15 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] Returning 404 to user: Instance 6dfb2418-b235-4d35-b109-4bed20d1b96e could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:01:12.649212 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f626b2d9-4abc-48d7-a504-e6883dc02b15 tempest-AttachVolumeTestJSON-905720098 tempest-AttachVolumeTestJSON-905720098-project] 10.222.0.33 "GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e" status: 404 len: 111 microversion: 2.1 time: 0.130139 Sep 23 05:01:12.652420 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3053/5938] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:01:12 2022] GET /compute/v2.1/servers/6dfb2418-b235-4d35-b109-4bed20d1b96e => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 05:01:12.907963 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-bde89553-f941-4f75-b07b-563540a33bfb tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:12.930852 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-bde89553-f941-4f75-b07b-563540a33bfb tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:12.932432 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-bde89553-f941-4f75-b07b-563540a33bfb tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:12.933678 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-bde89553-f941-4f75-b07b-563540a33bfb tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] 10.222.0.33 "GET /compute/v2.1/servers/190c8460-79bf-45a8-a441-75f8f05f713e" status: 200 len: 1357 microversion: 2.47 time: 0.397945 Sep 23 05:01:12.953354 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2886/5939] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 05:01:12 2022] GET /compute/v2.1/servers/190c8460-79bf-45a8-a441-75f8f05f713e => generated 1357 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 05:01:12.988589 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-cb9bad78-3883-4415-8444-a99c71bd1264 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:01:12.995362 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-cb9bad78-3883-4415-8444-a99c71bd1264 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] [instance: 190c8460-79bf-45a8-a441-75f8f05f713e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:13.026276 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cb9bad78-3883-4415-8444-a99c71bd1264 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:13.026812 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cb9bad78-3883-4415-8444-a99c71bd1264 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:13.029195 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cb9bad78-3883-4415-8444-a99c71bd1264 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:13.032747 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cb9bad78-3883-4415-8444-a99c71bd1264 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:13.035674 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cb9bad78-3883-4415-8444-a99c71bd1264 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:13.038529 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cb9bad78-3883-4415-8444-a99c71bd1264 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:13.209509 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=4 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:01:13.280174 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-cb9bad78-3883-4415-8444-a99c71bd1264 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Flavor limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 05:01:13.280832 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-cb9bad78-3883-4415-8444-a99c71bd1264 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Image limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 05:01:13.286010 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-cb9bad78-3883-4415-8444-a99c71bd1264 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Flavor pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 05:01:13.286632 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-cb9bad78-3883-4415-8444-a99c71bd1264 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Image pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 05:01:13.287174 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-cb9bad78-3883-4415-8444-a99c71bd1264 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 05:01:13.659925 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-cb9bad78-3883-4415-8444-a99c71bd1264 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] [instance: 190c8460-79bf-45a8-a441-75f8f05f713e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:13.690930 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cb9bad78-3883-4415-8444-a99c71bd1264 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:13.706042 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cb9bad78-3883-4415-8444-a99c71bd1264 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:13.707961 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cb9bad78-3883-4415-8444-a99c71bd1264 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:13.720161 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cb9bad78-3883-4415-8444-a99c71bd1264 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:13.720981 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cb9bad78-3883-4415-8444-a99c71bd1264 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:13.721823 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cb9bad78-3883-4415-8444-a99c71bd1264 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:13.830207 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-cb9bad78-3883-4415-8444-a99c71bd1264 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] 10.222.0.33 "POST /compute/v2.1/servers/190c8460-79bf-45a8-a441-75f8f05f713e/action" status: 202 len: 1079 microversion: 2.47 time: 0.841990 Sep 23 05:01:13.831718 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3054/5940] 10.222.0.33 () {62 vars in 1319 bytes} [Fri Sep 23 05:01:12 2022] POST /compute/v2.1/servers/190c8460-79bf-45a8-a441-75f8f05f713e/action => generated 1079 bytes in 848 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Sep 23 05:01:13.853372 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8f8f3a04-4739-46ac-994c-01ea3b78e1dd tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:13.854376 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8f8f3a04-4739-46ac-994c-01ea3b78e1dd tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] [instance: 190c8460-79bf-45a8-a441-75f8f05f713e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:13.903373 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8f8f3a04-4739-46ac-994c-01ea3b78e1dd tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:13.903895 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8f8f3a04-4739-46ac-994c-01ea3b78e1dd tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:13.904348 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8f8f3a04-4739-46ac-994c-01ea3b78e1dd tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:13.905081 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8f8f3a04-4739-46ac-994c-01ea3b78e1dd tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:13.905614 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8f8f3a04-4739-46ac-994c-01ea3b78e1dd tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:13.927690 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8f8f3a04-4739-46ac-994c-01ea3b78e1dd tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:14.318259 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8f8f3a04-4739-46ac-994c-01ea3b78e1dd tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:14.331625 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8f8f3a04-4739-46ac-994c-01ea3b78e1dd tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:14.335006 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8f8f3a04-4739-46ac-994c-01ea3b78e1dd tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:14.338802 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8f8f3a04-4739-46ac-994c-01ea3b78e1dd tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] 10.222.0.33 "GET /compute/v2.1/servers/190c8460-79bf-45a8-a441-75f8f05f713e" status: 200 len: 1366 microversion: 2.47 time: 0.489330 Sep 23 05:01:14.340703 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2887/5941] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 05:01:13 2022] GET /compute/v2.1/servers/190c8460-79bf-45a8-a441-75f8f05f713e => generated 1366 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 05:01:15.482319 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4aed7e3d-cab6-4d13-b009-eae5f41016c3 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:15.483163 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4aed7e3d-cab6-4d13-b009-eae5f41016c3 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] [instance: 190c8460-79bf-45a8-a441-75f8f05f713e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:15.494898 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=14 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:01:15.497316 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4aed7e3d-cab6-4d13-b009-eae5f41016c3 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:15.499938 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4aed7e3d-cab6-4d13-b009-eae5f41016c3 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:15.500669 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4aed7e3d-cab6-4d13-b009-eae5f41016c3 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:15.508383 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4aed7e3d-cab6-4d13-b009-eae5f41016c3 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:15.512268 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4aed7e3d-cab6-4d13-b009-eae5f41016c3 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:15.512753 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4aed7e3d-cab6-4d13-b009-eae5f41016c3 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:15.648827 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-4aed7e3d-cab6-4d13-b009-eae5f41016c3 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:15.670763 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-4aed7e3d-cab6-4d13-b009-eae5f41016c3 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:15.680068 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-4aed7e3d-cab6-4d13-b009-eae5f41016c3 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:15.683587 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4aed7e3d-cab6-4d13-b009-eae5f41016c3 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] 10.222.0.33 "GET /compute/v2.1/servers/190c8460-79bf-45a8-a441-75f8f05f713e" status: 200 len: 1366 microversion: 2.47 time: 0.205573 Sep 23 05:01:15.690516 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3055/5942] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 05:01:15 2022] GET /compute/v2.1/servers/190c8460-79bf-45a8-a441-75f8f05f713e => generated 1366 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 05:01:16.721481 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8ffd440b-3688-411b-8dfa-52fb6af8b528 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:16.722525 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8ffd440b-3688-411b-8dfa-52fb6af8b528 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] [instance: 190c8460-79bf-45a8-a441-75f8f05f713e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:16.738800 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8ffd440b-3688-411b-8dfa-52fb6af8b528 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:16.741332 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8ffd440b-3688-411b-8dfa-52fb6af8b528 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:16.741770 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8ffd440b-3688-411b-8dfa-52fb6af8b528 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:16.744787 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8ffd440b-3688-411b-8dfa-52fb6af8b528 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:16.746943 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8ffd440b-3688-411b-8dfa-52fb6af8b528 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:16.749305 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8ffd440b-3688-411b-8dfa-52fb6af8b528 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:16.969176 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8ffd440b-3688-411b-8dfa-52fb6af8b528 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:16.980355 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8ffd440b-3688-411b-8dfa-52fb6af8b528 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:16.985873 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8ffd440b-3688-411b-8dfa-52fb6af8b528 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:16.987157 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8ffd440b-3688-411b-8dfa-52fb6af8b528 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] 10.222.0.33 "GET /compute/v2.1/servers/190c8460-79bf-45a8-a441-75f8f05f713e" status: 200 len: 1366 microversion: 2.47 time: 0.270778 Sep 23 05:01:17.001926 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2888/5943] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 05:01:16 2022] GET /compute/v2.1/servers/190c8460-79bf-45a8-a441-75f8f05f713e => generated 1366 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 05:01:18.018273 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-48a28f1e-b822-4b7f-b228-ee241cd78c83 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:18.019466 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-48a28f1e-b822-4b7f-b228-ee241cd78c83 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] [instance: 190c8460-79bf-45a8-a441-75f8f05f713e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:18.031648 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-48a28f1e-b822-4b7f-b228-ee241cd78c83 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:18.032458 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-48a28f1e-b822-4b7f-b228-ee241cd78c83 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:18.034511 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-48a28f1e-b822-4b7f-b228-ee241cd78c83 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:18.035761 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-48a28f1e-b822-4b7f-b228-ee241cd78c83 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:18.037358 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-48a28f1e-b822-4b7f-b228-ee241cd78c83 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:18.040507 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-48a28f1e-b822-4b7f-b228-ee241cd78c83 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:18.215015 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-48a28f1e-b822-4b7f-b228-ee241cd78c83 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:18.231243 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-48a28f1e-b822-4b7f-b228-ee241cd78c83 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:18.238206 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-48a28f1e-b822-4b7f-b228-ee241cd78c83 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:18.244380 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-48a28f1e-b822-4b7f-b228-ee241cd78c83 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] 10.222.0.33 "GET /compute/v2.1/servers/190c8460-79bf-45a8-a441-75f8f05f713e" status: 200 len: 1366 microversion: 2.47 time: 0.229908 Sep 23 05:01:18.264287 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3056/5944] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 05:01:18 2022] GET /compute/v2.1/servers/190c8460-79bf-45a8-a441-75f8f05f713e => generated 1366 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 05:01:19.274828 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4d5750c9-cf5c-4067-97a7-291cdcaee47f tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:19.277099 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4d5750c9-cf5c-4067-97a7-291cdcaee47f tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] [instance: 190c8460-79bf-45a8-a441-75f8f05f713e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:19.293864 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4d5750c9-cf5c-4067-97a7-291cdcaee47f tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:19.296591 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4d5750c9-cf5c-4067-97a7-291cdcaee47f tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:19.297209 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4d5750c9-cf5c-4067-97a7-291cdcaee47f tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:19.298565 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4d5750c9-cf5c-4067-97a7-291cdcaee47f tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:19.301689 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4d5750c9-cf5c-4067-97a7-291cdcaee47f tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:19.303049 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4d5750c9-cf5c-4067-97a7-291cdcaee47f tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:19.439336 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:01:19.764672 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4d5750c9-cf5c-4067-97a7-291cdcaee47f tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:19.773768 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4d5750c9-cf5c-4067-97a7-291cdcaee47f tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:19.779172 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4d5750c9-cf5c-4067-97a7-291cdcaee47f tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:19.781588 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4d5750c9-cf5c-4067-97a7-291cdcaee47f tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] 10.222.0.33 "GET /compute/v2.1/servers/190c8460-79bf-45a8-a441-75f8f05f713e" status: 200 len: 1366 microversion: 2.47 time: 0.511335 Sep 23 05:01:19.785145 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2889/5945] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 05:01:19 2022] GET /compute/v2.1/servers/190c8460-79bf-45a8-a441-75f8f05f713e => generated 1366 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 05:01:20.815263 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-fbb7885f-1345-49cc-82ae-f0d5dfc1479b tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:20.815997 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-fbb7885f-1345-49cc-82ae-f0d5dfc1479b tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] [instance: 190c8460-79bf-45a8-a441-75f8f05f713e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:20.835799 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fbb7885f-1345-49cc-82ae-f0d5dfc1479b tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:20.836657 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fbb7885f-1345-49cc-82ae-f0d5dfc1479b tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:20.839645 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fbb7885f-1345-49cc-82ae-f0d5dfc1479b tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:20.842031 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fbb7885f-1345-49cc-82ae-f0d5dfc1479b tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:20.845014 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fbb7885f-1345-49cc-82ae-f0d5dfc1479b tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:20.846167 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fbb7885f-1345-49cc-82ae-f0d5dfc1479b tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:20.923688 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3ecc92f5-f51b-4b1c-b844-93bf4ca73570 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1544919856", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "networks": [{"uuid": "8fb59659-623a-4a6f-840a-5340bf4cbf4c"}]}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:01:21.013343 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-fbb7885f-1345-49cc-82ae-f0d5dfc1479b tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:21.026885 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-fbb7885f-1345-49cc-82ae-f0d5dfc1479b tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:21.028706 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-fbb7885f-1345-49cc-82ae-f0d5dfc1479b tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:21.031385 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-fbb7885f-1345-49cc-82ae-f0d5dfc1479b tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] 10.222.0.33 "GET /compute/v2.1/servers/190c8460-79bf-45a8-a441-75f8f05f713e" status: 200 len: 1366 microversion: 2.47 time: 0.221636 Sep 23 05:01:21.033240 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3057/5946] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 05:01:20 2022] GET /compute/v2.1/servers/190c8460-79bf-45a8-a441-75f8f05f713e => generated 1366 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 05:01:21.052733 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.network.neutron [None req-3ecc92f5-f51b-4b1c-b844-93bf4ca73570 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] validate_networks() for [('8fb59659-623a-4a6f-840a-5340bf4cbf4c', None, None, None, None, None)] {{(pid=122698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 05:01:21.212970 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=8 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:01:22.070068 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f3d3b8c0-346b-4599-8f07-0a1d2ca18326 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:22.079885 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f3d3b8c0-346b-4599-8f07-0a1d2ca18326 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] [instance: 190c8460-79bf-45a8-a441-75f8f05f713e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:22.091430 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f3d3b8c0-346b-4599-8f07-0a1d2ca18326 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:22.092325 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f3d3b8c0-346b-4599-8f07-0a1d2ca18326 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:22.093022 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f3d3b8c0-346b-4599-8f07-0a1d2ca18326 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:22.096202 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f3d3b8c0-346b-4599-8f07-0a1d2ca18326 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:22.097006 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f3d3b8c0-346b-4599-8f07-0a1d2ca18326 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:22.097735 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f3d3b8c0-346b-4599-8f07-0a1d2ca18326 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:22.340937 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f3d3b8c0-346b-4599-8f07-0a1d2ca18326 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:22.363312 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f3d3b8c0-346b-4599-8f07-0a1d2ca18326 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:22.365831 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f3d3b8c0-346b-4599-8f07-0a1d2ca18326 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:22.367592 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f3d3b8c0-346b-4599-8f07-0a1d2ca18326 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] 10.222.0.33 "GET /compute/v2.1/servers/190c8460-79bf-45a8-a441-75f8f05f713e" status: 200 len: 1366 microversion: 2.47 time: 0.303695 Sep 23 05:01:22.368807 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3058/5947] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 05:01:22 2022] GET /compute/v2.1/servers/190c8460-79bf-45a8-a441-75f8f05f713e => generated 1366 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 05:01:22.495216 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-3ecc92f5-f51b-4b1c-b844-93bf4ca73570 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Flavor limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 05:01:22.496335 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-3ecc92f5-f51b-4b1c-b844-93bf4ca73570 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Image limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 05:01:22.497113 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-3ecc92f5-f51b-4b1c-b844-93bf4ca73570 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Flavor pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 05:01:22.497753 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-3ecc92f5-f51b-4b1c-b844-93bf4ca73570 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Image pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 05:01:22.498449 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-3ecc92f5-f51b-4b1c-b844-93bf4ca73570 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 05:01:22.530576 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3ecc92f5-f51b-4b1c-b844-93bf4ca73570 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:22.531076 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3ecc92f5-f51b-4b1c-b844-93bf4ca73570 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:22.534622 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3ecc92f5-f51b-4b1c-b844-93bf4ca73570 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:22.536811 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3ecc92f5-f51b-4b1c-b844-93bf4ca73570 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:22.538287 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3ecc92f5-f51b-4b1c-b844-93bf4ca73570 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:22.539412 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3ecc92f5-f51b-4b1c-b844-93bf4ca73570 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:22.577847 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-3ecc92f5-f51b-4b1c-b844-93bf4ca73570 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Getting quotas for project da3327b2d3674f019c300935bb84945a. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 05:01:22.585159 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-3ecc92f5-f51b-4b1c-b844-93bf4ca73570 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Getting quotas for user d1af38bb9e9a4cbab4a8935a01e7afba and project da3327b2d3674f019c300935bb84945a. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 05:01:22.631633 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3ecc92f5-f51b-4b1c-b844-93bf4ca73570 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Going to run 1 instances... {{(pid=122698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 05:01:22.635773 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3ecc92f5-f51b-4b1c-b844-93bf4ca73570 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] [instance: eb57fbfa-f7ab-482e-be43-d88659fc3063] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 05:01:22.826262 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3ecc92f5-f51b-4b1c-b844-93bf4ca73570 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.906979 Sep 23 05:01:22.828660 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2890/5948] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 05:01:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1911 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 05:01:22.840555 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b91ed23c-293c-41ae-baff-04d3c98a603a tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:22.842553 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b91ed23c-293c-41ae-baff-04d3c98a603a tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] [instance: eb57fbfa-f7ab-482e-be43-d88659fc3063] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:22.986000 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b91ed23c-293c-41ae-baff-04d3c98a603a tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1af38bb9e9a4cbab4a8935a01e7afba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da3327b2d3674f019c300935bb84945a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:23.001646 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b91ed23c-293c-41ae-baff-04d3c98a603a tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] 10.222.0.33 "GET /compute/v2.1/servers/eb57fbfa-f7ab-482e-be43-d88659fc3063" status: 200 len: 1214 microversion: 2.1 time: 0.164403 Sep 23 05:01:23.013912 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3059/5949] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:01:22 2022] GET /compute/v2.1/servers/eb57fbfa-f7ab-482e-be43-d88659fc3063 => generated 1214 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:01:23.406274 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-cbe4ee45-02ac-4ee3-8991-4b5219098ca7 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:23.407290 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-cbe4ee45-02ac-4ee3-8991-4b5219098ca7 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] [instance: 190c8460-79bf-45a8-a441-75f8f05f713e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:23.425552 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cbe4ee45-02ac-4ee3-8991-4b5219098ca7 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:23.432175 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cbe4ee45-02ac-4ee3-8991-4b5219098ca7 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:23.432975 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cbe4ee45-02ac-4ee3-8991-4b5219098ca7 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:23.435668 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cbe4ee45-02ac-4ee3-8991-4b5219098ca7 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:23.436943 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cbe4ee45-02ac-4ee3-8991-4b5219098ca7 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:23.438197 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cbe4ee45-02ac-4ee3-8991-4b5219098ca7 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:23.711642 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-cbe4ee45-02ac-4ee3-8991-4b5219098ca7 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:23.723661 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-cbe4ee45-02ac-4ee3-8991-4b5219098ca7 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:23.729477 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-cbe4ee45-02ac-4ee3-8991-4b5219098ca7 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:23.735630 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-cbe4ee45-02ac-4ee3-8991-4b5219098ca7 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] 10.222.0.33 "GET /compute/v2.1/servers/190c8460-79bf-45a8-a441-75f8f05f713e" status: 200 len: 1366 microversion: 2.47 time: 0.332397 Sep 23 05:01:23.736027 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2891/5950] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 05:01:23 2022] GET /compute/v2.1/servers/190c8460-79bf-45a8-a441-75f8f05f713e => generated 1366 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 05:01:24.032591 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b090e574-fa51-44dc-82d7-2dcce1087e33 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:24.032591 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b090e574-fa51-44dc-82d7-2dcce1087e33 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] [instance: eb57fbfa-f7ab-482e-be43-d88659fc3063] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:24.155581 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b090e574-fa51-44dc-82d7-2dcce1087e33 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1af38bb9e9a4cbab4a8935a01e7afba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da3327b2d3674f019c300935bb84945a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:24.172182 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b090e574-fa51-44dc-82d7-2dcce1087e33 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] 10.222.0.33 "GET /compute/v2.1/servers/eb57fbfa-f7ab-482e-be43-d88659fc3063" status: 200 len: 1214 microversion: 2.1 time: 0.143043 Sep 23 05:01:24.173428 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3060/5951] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:01:24 2022] GET /compute/v2.1/servers/eb57fbfa-f7ab-482e-be43-d88659fc3063 => generated 1214 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:01:24.761460 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-79a3bf9d-4f8e-4324-93bc-87a0c9f17e8d tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:24.763807 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-79a3bf9d-4f8e-4324-93bc-87a0c9f17e8d tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] [instance: 190c8460-79bf-45a8-a441-75f8f05f713e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:24.783411 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-79a3bf9d-4f8e-4324-93bc-87a0c9f17e8d tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:24.784287 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-79a3bf9d-4f8e-4324-93bc-87a0c9f17e8d tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:24.784962 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-79a3bf9d-4f8e-4324-93bc-87a0c9f17e8d tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:24.785934 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-79a3bf9d-4f8e-4324-93bc-87a0c9f17e8d tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:24.786663 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-79a3bf9d-4f8e-4324-93bc-87a0c9f17e8d tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:24.788769 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-79a3bf9d-4f8e-4324-93bc-87a0c9f17e8d tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:24.957914 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-79a3bf9d-4f8e-4324-93bc-87a0c9f17e8d tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:24.968563 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-79a3bf9d-4f8e-4324-93bc-87a0c9f17e8d tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:24.973312 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-79a3bf9d-4f8e-4324-93bc-87a0c9f17e8d tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:24.974975 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-79a3bf9d-4f8e-4324-93bc-87a0c9f17e8d tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] 10.222.0.33 "GET /compute/v2.1/servers/190c8460-79bf-45a8-a441-75f8f05f713e" status: 200 len: 1366 microversion: 2.47 time: 0.217419 Sep 23 05:01:24.978668 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2892/5952] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 05:01:24 2022] GET /compute/v2.1/servers/190c8460-79bf-45a8-a441-75f8f05f713e => generated 1366 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 05:01:25.200904 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-98cb730e-160b-4f54-8e44-fd2f4adecca5 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:25.202291 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-98cb730e-160b-4f54-8e44-fd2f4adecca5 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] [instance: eb57fbfa-f7ab-482e-be43-d88659fc3063] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:25.214359 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-98cb730e-160b-4f54-8e44-fd2f4adecca5 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:25.215671 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-98cb730e-160b-4f54-8e44-fd2f4adecca5 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:25.216635 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-98cb730e-160b-4f54-8e44-fd2f4adecca5 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:25.217849 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-98cb730e-160b-4f54-8e44-fd2f4adecca5 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:25.219969 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-98cb730e-160b-4f54-8e44-fd2f4adecca5 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:25.220429 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-98cb730e-160b-4f54-8e44-fd2f4adecca5 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:25.517515 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-98cb730e-160b-4f54-8e44-fd2f4adecca5 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1af38bb9e9a4cbab4a8935a01e7afba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da3327b2d3674f019c300935bb84945a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:25.528407 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-98cb730e-160b-4f54-8e44-fd2f4adecca5 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] 10.222.0.33 "GET /compute/v2.1/servers/eb57fbfa-f7ab-482e-be43-d88659fc3063" status: 200 len: 1218 microversion: 2.1 time: 0.332394 Sep 23 05:01:25.529590 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3061/5953] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:01:25 2022] GET /compute/v2.1/servers/eb57fbfa-f7ab-482e-be43-d88659fc3063 => generated 1218 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:01:26.006380 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ee7ab2d2-349a-4ac6-99e6-2da550ebfb3f tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:26.007319 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-ee7ab2d2-349a-4ac6-99e6-2da550ebfb3f tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] [instance: 190c8460-79bf-45a8-a441-75f8f05f713e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:26.031424 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ee7ab2d2-349a-4ac6-99e6-2da550ebfb3f tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:26.032581 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ee7ab2d2-349a-4ac6-99e6-2da550ebfb3f tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:26.033533 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ee7ab2d2-349a-4ac6-99e6-2da550ebfb3f tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:26.034587 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ee7ab2d2-349a-4ac6-99e6-2da550ebfb3f tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:26.036448 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ee7ab2d2-349a-4ac6-99e6-2da550ebfb3f tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:26.037321 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ee7ab2d2-349a-4ac6-99e6-2da550ebfb3f tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:26.322241 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ee7ab2d2-349a-4ac6-99e6-2da550ebfb3f tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:26.341651 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ee7ab2d2-349a-4ac6-99e6-2da550ebfb3f tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:26.344727 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ee7ab2d2-349a-4ac6-99e6-2da550ebfb3f tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:26.346203 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ee7ab2d2-349a-4ac6-99e6-2da550ebfb3f tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] 10.222.0.33 "GET /compute/v2.1/servers/190c8460-79bf-45a8-a441-75f8f05f713e" status: 200 len: 1366 microversion: 2.47 time: 0.346036 Sep 23 05:01:26.369479 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2893/5954] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 05:01:25 2022] GET /compute/v2.1/servers/190c8460-79bf-45a8-a441-75f8f05f713e => generated 1366 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 05:01:26.551328 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0adb4a35-6d98-47f5-a579-1190f6a2e58e tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:26.555068 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-0adb4a35-6d98-47f5-a579-1190f6a2e58e tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] [instance: eb57fbfa-f7ab-482e-be43-d88659fc3063] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:26.566143 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0adb4a35-6d98-47f5-a579-1190f6a2e58e tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:26.569492 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0adb4a35-6d98-47f5-a579-1190f6a2e58e tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:26.570602 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0adb4a35-6d98-47f5-a579-1190f6a2e58e tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:26.571506 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0adb4a35-6d98-47f5-a579-1190f6a2e58e tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:26.572128 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0adb4a35-6d98-47f5-a579-1190f6a2e58e tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:26.574169 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0adb4a35-6d98-47f5-a579-1190f6a2e58e tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:26.729248 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-0adb4a35-6d98-47f5-a579-1190f6a2e58e tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1af38bb9e9a4cbab4a8935a01e7afba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da3327b2d3674f019c300935bb84945a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:26.767381 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0adb4a35-6d98-47f5-a579-1190f6a2e58e tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] 10.222.0.33 "GET /compute/v2.1/servers/eb57fbfa-f7ab-482e-be43-d88659fc3063" status: 200 len: 1266 microversion: 2.1 time: 0.219759 Sep 23 05:01:26.770131 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3062/5955] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:01:26 2022] GET /compute/v2.1/servers/eb57fbfa-f7ab-482e-be43-d88659fc3063 => generated 1266 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:01:27.376688 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b52cfa5d-d91a-448b-9048-36103a8c1a52 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:27.377156 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b52cfa5d-d91a-448b-9048-36103a8c1a52 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] [instance: 190c8460-79bf-45a8-a441-75f8f05f713e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:27.389476 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b52cfa5d-d91a-448b-9048-36103a8c1a52 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:27.392410 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b52cfa5d-d91a-448b-9048-36103a8c1a52 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:27.393260 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b52cfa5d-d91a-448b-9048-36103a8c1a52 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:27.394355 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b52cfa5d-d91a-448b-9048-36103a8c1a52 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:27.395669 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b52cfa5d-d91a-448b-9048-36103a8c1a52 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:27.398048 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b52cfa5d-d91a-448b-9048-36103a8c1a52 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:27.614889 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b52cfa5d-d91a-448b-9048-36103a8c1a52 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:27.625059 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b52cfa5d-d91a-448b-9048-36103a8c1a52 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:27.627738 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b52cfa5d-d91a-448b-9048-36103a8c1a52 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:27.629233 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b52cfa5d-d91a-448b-9048-36103a8c1a52 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] 10.222.0.33 "GET /compute/v2.1/servers/190c8460-79bf-45a8-a441-75f8f05f713e" status: 200 len: 1366 microversion: 2.47 time: 0.259360 Sep 23 05:01:27.642768 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2894/5956] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 05:01:27 2022] GET /compute/v2.1/servers/190c8460-79bf-45a8-a441-75f8f05f713e => generated 1366 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 05:01:27.799605 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0d59cf16-d01c-4d87-a3a2-036aa070be89 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:27.800974 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-0d59cf16-d01c-4d87-a3a2-036aa070be89 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] [instance: eb57fbfa-f7ab-482e-be43-d88659fc3063] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:27.810805 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0d59cf16-d01c-4d87-a3a2-036aa070be89 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:27.814686 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0d59cf16-d01c-4d87-a3a2-036aa070be89 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:27.815433 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0d59cf16-d01c-4d87-a3a2-036aa070be89 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:27.816398 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0d59cf16-d01c-4d87-a3a2-036aa070be89 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:27.819582 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0d59cf16-d01c-4d87-a3a2-036aa070be89 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:27.820323 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0d59cf16-d01c-4d87-a3a2-036aa070be89 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:27.957383 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-0d59cf16-d01c-4d87-a3a2-036aa070be89 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1af38bb9e9a4cbab4a8935a01e7afba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da3327b2d3674f019c300935bb84945a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:27.971502 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0d59cf16-d01c-4d87-a3a2-036aa070be89 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] 10.222.0.33 "GET /compute/v2.1/servers/eb57fbfa-f7ab-482e-be43-d88659fc3063" status: 200 len: 1272 microversion: 2.1 time: 0.177666 Sep 23 05:01:27.986475 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3063/5957] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:01:27 2022] GET /compute/v2.1/servers/eb57fbfa-f7ab-482e-be43-d88659fc3063 => generated 1272 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:01:28.659863 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3614e93e-86d5-463b-a96b-c48037c977e1 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:28.660488 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3614e93e-86d5-463b-a96b-c48037c977e1 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] [instance: 190c8460-79bf-45a8-a441-75f8f05f713e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:28.675085 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3614e93e-86d5-463b-a96b-c48037c977e1 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:28.690034 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3614e93e-86d5-463b-a96b-c48037c977e1 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:28.690034 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3614e93e-86d5-463b-a96b-c48037c977e1 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:28.690034 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3614e93e-86d5-463b-a96b-c48037c977e1 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:28.690034 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3614e93e-86d5-463b-a96b-c48037c977e1 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:28.690034 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3614e93e-86d5-463b-a96b-c48037c977e1 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:28.843804 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-3614e93e-86d5-463b-a96b-c48037c977e1 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:28.859509 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-3614e93e-86d5-463b-a96b-c48037c977e1 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:28.863666 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-3614e93e-86d5-463b-a96b-c48037c977e1 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:28.873165 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3614e93e-86d5-463b-a96b-c48037c977e1 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] 10.222.0.33 "GET /compute/v2.1/servers/190c8460-79bf-45a8-a441-75f8f05f713e" status: 200 len: 1366 microversion: 2.47 time: 0.216372 Sep 23 05:01:28.875560 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2895/5958] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 05:01:28 2022] GET /compute/v2.1/servers/190c8460-79bf-45a8-a441-75f8f05f713e => generated 1366 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 05:01:28.997469 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0a471566-d10f-4107-b9bd-2c04147a84f6 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:28.998879 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-0a471566-d10f-4107-b9bd-2c04147a84f6 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] [instance: eb57fbfa-f7ab-482e-be43-d88659fc3063] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:29.022289 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0a471566-d10f-4107-b9bd-2c04147a84f6 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:29.023351 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0a471566-d10f-4107-b9bd-2c04147a84f6 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:29.025854 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0a471566-d10f-4107-b9bd-2c04147a84f6 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:29.026978 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0a471566-d10f-4107-b9bd-2c04147a84f6 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:29.031172 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0a471566-d10f-4107-b9bd-2c04147a84f6 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:29.031935 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0a471566-d10f-4107-b9bd-2c04147a84f6 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:29.406530 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-0a471566-d10f-4107-b9bd-2c04147a84f6 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1af38bb9e9a4cbab4a8935a01e7afba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da3327b2d3674f019c300935bb84945a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:29.424937 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0a471566-d10f-4107-b9bd-2c04147a84f6 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] 10.222.0.33 "GET /compute/v2.1/servers/eb57fbfa-f7ab-482e-be43-d88659fc3063" status: 200 len: 1272 microversion: 2.1 time: 0.429712 Sep 23 05:01:29.432241 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3064/5959] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:01:28 2022] GET /compute/v2.1/servers/eb57fbfa-f7ab-482e-be43-d88659fc3063 => generated 1272 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:01:29.908552 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2562bd9a-f5dc-473c-8545-b3bb7292860e tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:29.909164 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-2562bd9a-f5dc-473c-8545-b3bb7292860e tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] [instance: 190c8460-79bf-45a8-a441-75f8f05f713e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:29.924313 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2562bd9a-f5dc-473c-8545-b3bb7292860e tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:29.926355 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2562bd9a-f5dc-473c-8545-b3bb7292860e tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:29.929516 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2562bd9a-f5dc-473c-8545-b3bb7292860e tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:29.930994 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2562bd9a-f5dc-473c-8545-b3bb7292860e tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:29.931479 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2562bd9a-f5dc-473c-8545-b3bb7292860e tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:29.931904 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2562bd9a-f5dc-473c-8545-b3bb7292860e tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:30.180867 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-2562bd9a-f5dc-473c-8545-b3bb7292860e tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:30.191431 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-2562bd9a-f5dc-473c-8545-b3bb7292860e tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:30.192938 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-2562bd9a-f5dc-473c-8545-b3bb7292860e tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:30.207195 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2562bd9a-f5dc-473c-8545-b3bb7292860e tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] 10.222.0.33 "GET /compute/v2.1/servers/190c8460-79bf-45a8-a441-75f8f05f713e" status: 200 len: 1366 microversion: 2.47 time: 0.302539 Sep 23 05:01:30.208397 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2896/5960] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 05:01:29 2022] GET /compute/v2.1/servers/190c8460-79bf-45a8-a441-75f8f05f713e => generated 1366 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 05:01:30.456069 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a0dc1650-5d5a-4de8-bb33-db946887adc2 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:30.457358 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a0dc1650-5d5a-4de8-bb33-db946887adc2 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] [instance: eb57fbfa-f7ab-482e-be43-d88659fc3063] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:30.475841 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a0dc1650-5d5a-4de8-bb33-db946887adc2 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:30.481215 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a0dc1650-5d5a-4de8-bb33-db946887adc2 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:30.481678 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a0dc1650-5d5a-4de8-bb33-db946887adc2 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:30.484910 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a0dc1650-5d5a-4de8-bb33-db946887adc2 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:30.485465 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a0dc1650-5d5a-4de8-bb33-db946887adc2 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:30.493804 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a0dc1650-5d5a-4de8-bb33-db946887adc2 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:31.039104 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a0dc1650-5d5a-4de8-bb33-db946887adc2 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1af38bb9e9a4cbab4a8935a01e7afba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da3327b2d3674f019c300935bb84945a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:31.052984 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a0dc1650-5d5a-4de8-bb33-db946887adc2 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] 10.222.0.33 "GET /compute/v2.1/servers/eb57fbfa-f7ab-482e-be43-d88659fc3063" status: 200 len: 1314 microversion: 2.1 time: 0.601732 Sep 23 05:01:31.077169 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3065/5961] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:01:30 2022] GET /compute/v2.1/servers/eb57fbfa-f7ab-482e-be43-d88659fc3063 => generated 1314 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:01:31.239523 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6357ef48-eb1c-43f2-9167-473f4cc49684 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:31.245241 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-6357ef48-eb1c-43f2-9167-473f4cc49684 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] [instance: 190c8460-79bf-45a8-a441-75f8f05f713e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:31.254001 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=75,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:01:31.257852 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6357ef48-eb1c-43f2-9167-473f4cc49684 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:31.260589 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6357ef48-eb1c-43f2-9167-473f4cc49684 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:31.261514 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6357ef48-eb1c-43f2-9167-473f4cc49684 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:31.266099 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6357ef48-eb1c-43f2-9167-473f4cc49684 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:31.266099 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6357ef48-eb1c-43f2-9167-473f4cc49684 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:31.266099 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6357ef48-eb1c-43f2-9167-473f4cc49684 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:31.475575 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6357ef48-eb1c-43f2-9167-473f4cc49684 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:31.512460 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6357ef48-eb1c-43f2-9167-473f4cc49684 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:31.524137 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6357ef48-eb1c-43f2-9167-473f4cc49684 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:31.539319 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-6357ef48-eb1c-43f2-9167-473f4cc49684 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] 10.222.0.33 "GET /compute/v2.1/servers/190c8460-79bf-45a8-a441-75f8f05f713e" status: 200 len: 1366 microversion: 2.47 time: 0.291105 Sep 23 05:01:31.543988 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2897/5962] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 05:01:31 2022] GET /compute/v2.1/servers/190c8460-79bf-45a8-a441-75f8f05f713e => generated 1366 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 05:01:32.080669 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9a43897c-68a6-4828-b190-51f5e71a993e tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:32.081245 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-9a43897c-68a6-4828-b190-51f5e71a993e tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] [instance: eb57fbfa-f7ab-482e-be43-d88659fc3063] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:32.097727 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9a43897c-68a6-4828-b190-51f5e71a993e tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:32.098312 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9a43897c-68a6-4828-b190-51f5e71a993e tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:32.099093 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9a43897c-68a6-4828-b190-51f5e71a993e tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:32.099992 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9a43897c-68a6-4828-b190-51f5e71a993e tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:32.100654 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9a43897c-68a6-4828-b190-51f5e71a993e tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:32.101345 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9a43897c-68a6-4828-b190-51f5e71a993e tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:32.167381 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-ddfbea4a-12b8-4804-9b9b-e77f83030a2e req-6f51db0d-8004-4a9c-b100-c1b7a797ef7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb57fbfa-f7ab-482e-be43-d88659fc3063", "tag": "86b01531-b24a-420f-8fce-92614d52df83"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:01:32.187425 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-ddfbea4a-12b8-4804-9b9b-e77f83030a2e req-6f51db0d-8004-4a9c-b100-c1b7a797ef7d service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:32.187864 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-ddfbea4a-12b8-4804-9b9b-e77f83030a2e req-6f51db0d-8004-4a9c-b100-c1b7a797ef7d service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:32.188506 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-ddfbea4a-12b8-4804-9b9b-e77f83030a2e req-6f51db0d-8004-4a9c-b100-c1b7a797ef7d service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:32.202837 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-ddfbea4a-12b8-4804-9b9b-e77f83030a2e req-6f51db0d-8004-4a9c-b100-c1b7a797ef7d service nova] Creating event network-changed:86b01531-b24a-420f-8fce-92614d52df83 for instance eb57fbfa-f7ab-482e-be43-d88659fc3063 on n-h1-846463-3 Sep 23 05:01:32.209147 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-ddfbea4a-12b8-4804-9b9b-e77f83030a2e req-6f51db0d-8004-4a9c-b100-c1b7a797ef7d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045708 Sep 23 05:01:32.210041 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2898/5963] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:01:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 05:01:32.570369 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-9a43897c-68a6-4828-b190-51f5e71a993e tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1af38bb9e9a4cbab4a8935a01e7afba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da3327b2d3674f019c300935bb84945a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:32.570894 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:01:32.575155 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-00e378be-d597-45eb-9153-56d15dee326c tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:32.575888 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-00e378be-d597-45eb-9153-56d15dee326c tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] [instance: 190c8460-79bf-45a8-a441-75f8f05f713e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:32.581117 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-9a43897c-68a6-4828-b190-51f5e71a993e tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] 10.222.0.33 "GET /compute/v2.1/servers/eb57fbfa-f7ab-482e-be43-d88659fc3063" status: 200 len: 1314 microversion: 2.1 time: 0.504363 Sep 23 05:01:32.581795 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3066/5964] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:01:32 2022] GET /compute/v2.1/servers/eb57fbfa-f7ab-482e-be43-d88659fc3063 => generated 1314 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:01:32.589152 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-00e378be-d597-45eb-9153-56d15dee326c tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:32.589682 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-00e378be-d597-45eb-9153-56d15dee326c tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:32.590171 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-00e378be-d597-45eb-9153-56d15dee326c tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:32.592356 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-00e378be-d597-45eb-9153-56d15dee326c tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:32.592845 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-00e378be-d597-45eb-9153-56d15dee326c tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:32.593292 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-00e378be-d597-45eb-9153-56d15dee326c tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:32.611392 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=6 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:01:32.935833 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-00e378be-d597-45eb-9153-56d15dee326c tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:32.950379 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-00e378be-d597-45eb-9153-56d15dee326c tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:32.951864 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-00e378be-d597-45eb-9153-56d15dee326c tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:32.962395 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-00e378be-d597-45eb-9153-56d15dee326c tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] 10.222.0.33 "GET /compute/v2.1/servers/190c8460-79bf-45a8-a441-75f8f05f713e" status: 200 len: 1366 microversion: 2.47 time: 0.383990 Sep 23 05:01:32.982709 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2899/5965] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 05:01:32 2022] GET /compute/v2.1/servers/190c8460-79bf-45a8-a441-75f8f05f713e => generated 1366 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 05:01:33.610231 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-536d593f-10ae-4f41-a8bf-b9819e9b381d tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:33.610998 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-536d593f-10ae-4f41-a8bf-b9819e9b381d tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] [instance: eb57fbfa-f7ab-482e-be43-d88659fc3063] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:33.626774 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=6 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:01:33.632624 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-536d593f-10ae-4f41-a8bf-b9819e9b381d tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:33.634520 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-536d593f-10ae-4f41-a8bf-b9819e9b381d tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:33.639021 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-536d593f-10ae-4f41-a8bf-b9819e9b381d tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:33.640075 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-536d593f-10ae-4f41-a8bf-b9819e9b381d tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:33.640924 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-536d593f-10ae-4f41-a8bf-b9819e9b381d tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:33.641367 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-536d593f-10ae-4f41-a8bf-b9819e9b381d tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:34.000199 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1f3ca953-a8fc-4c2e-8cb9-53832febf0fc tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:34.000742 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-1f3ca953-a8fc-4c2e-8cb9-53832febf0fc tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] [instance: 190c8460-79bf-45a8-a441-75f8f05f713e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:34.024094 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1f3ca953-a8fc-4c2e-8cb9-53832febf0fc tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:34.028900 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1f3ca953-a8fc-4c2e-8cb9-53832febf0fc tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:34.029612 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1f3ca953-a8fc-4c2e-8cb9-53832febf0fc tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:34.031574 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1f3ca953-a8fc-4c2e-8cb9-53832febf0fc tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:34.040314 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1f3ca953-a8fc-4c2e-8cb9-53832febf0fc tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:34.042013 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1f3ca953-a8fc-4c2e-8cb9-53832febf0fc tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:34.169259 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=4 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:01:34.389534 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-1f3ca953-a8fc-4c2e-8cb9-53832febf0fc tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:34.400462 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-1f3ca953-a8fc-4c2e-8cb9-53832febf0fc tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:34.401964 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-1f3ca953-a8fc-4c2e-8cb9-53832febf0fc tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:34.412163 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-1f3ca953-a8fc-4c2e-8cb9-53832febf0fc tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] 10.222.0.33 "GET /compute/v2.1/servers/190c8460-79bf-45a8-a441-75f8f05f713e" status: 200 len: 1366 microversion: 2.47 time: 0.416076 Sep 23 05:01:34.421935 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2900/5966] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 05:01:33 2022] GET /compute/v2.1/servers/190c8460-79bf-45a8-a441-75f8f05f713e => generated 1366 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 05:01:34.543462 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-536d593f-10ae-4f41-a8bf-b9819e9b381d tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1af38bb9e9a4cbab4a8935a01e7afba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da3327b2d3674f019c300935bb84945a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:34.552732 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-536d593f-10ae-4f41-a8bf-b9819e9b381d tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] 10.222.0.33 "GET /compute/v2.1/servers/eb57fbfa-f7ab-482e-be43-d88659fc3063" status: 200 len: 1314 microversion: 2.1 time: 0.947708 Sep 23 05:01:34.554789 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3067/5967] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:01:33 2022] GET /compute/v2.1/servers/eb57fbfa-f7ab-482e-be43-d88659fc3063 => generated 1314 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:01:35.442535 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-61b73469-7f2f-4895-9038-9ab1122e6247 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:35.443411 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-61b73469-7f2f-4895-9038-9ab1122e6247 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] [instance: 190c8460-79bf-45a8-a441-75f8f05f713e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:35.453017 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-61b73469-7f2f-4895-9038-9ab1122e6247 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:35.453526 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-61b73469-7f2f-4895-9038-9ab1122e6247 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:35.455643 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-61b73469-7f2f-4895-9038-9ab1122e6247 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:35.460731 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-61b73469-7f2f-4895-9038-9ab1122e6247 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:35.461336 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-61b73469-7f2f-4895-9038-9ab1122e6247 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:35.462963 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-61b73469-7f2f-4895-9038-9ab1122e6247 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:35.578806 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0e6c5962-21f7-4eaf-9ce5-94ebc45b008b tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:35.579637 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-0e6c5962-21f7-4eaf-9ce5-94ebc45b008b tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] [instance: eb57fbfa-f7ab-482e-be43-d88659fc3063] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:35.619527 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0e6c5962-21f7-4eaf-9ce5-94ebc45b008b tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:35.620039 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0e6c5962-21f7-4eaf-9ce5-94ebc45b008b tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:35.620481 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0e6c5962-21f7-4eaf-9ce5-94ebc45b008b tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:35.621204 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0e6c5962-21f7-4eaf-9ce5-94ebc45b008b tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:35.621667 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0e6c5962-21f7-4eaf-9ce5-94ebc45b008b tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:35.622140 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0e6c5962-21f7-4eaf-9ce5-94ebc45b008b tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:35.689412 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-61b73469-7f2f-4895-9038-9ab1122e6247 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:35.710160 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:01:35.723835 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-61b73469-7f2f-4895-9038-9ab1122e6247 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:35.734342 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-61b73469-7f2f-4895-9038-9ab1122e6247 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:35.750202 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-61b73469-7f2f-4895-9038-9ab1122e6247 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] 10.222.0.33 "GET /compute/v2.1/servers/190c8460-79bf-45a8-a441-75f8f05f713e" status: 200 len: 1366 microversion: 2.47 time: 0.309380 Sep 23 05:01:35.777566 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2901/5968] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 05:01:35 2022] GET /compute/v2.1/servers/190c8460-79bf-45a8-a441-75f8f05f713e => generated 1366 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 05:01:36.244947 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-0e6c5962-21f7-4eaf-9ce5-94ebc45b008b tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1af38bb9e9a4cbab4a8935a01e7afba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da3327b2d3674f019c300935bb84945a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:36.256147 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0e6c5962-21f7-4eaf-9ce5-94ebc45b008b tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] 10.222.0.33 "GET /compute/v2.1/servers/eb57fbfa-f7ab-482e-be43-d88659fc3063" status: 200 len: 1314 microversion: 2.1 time: 0.681297 Sep 23 05:01:36.257725 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3068/5969] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:01:35 2022] GET /compute/v2.1/servers/eb57fbfa-f7ab-482e-be43-d88659fc3063 => generated 1314 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:01:36.789827 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7afae40b-b412-4d20-9b75-1468b4d45df9 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:36.791720 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7afae40b-b412-4d20-9b75-1468b4d45df9 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] [instance: 190c8460-79bf-45a8-a441-75f8f05f713e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:36.802875 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7afae40b-b412-4d20-9b75-1468b4d45df9 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:36.805374 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7afae40b-b412-4d20-9b75-1468b4d45df9 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:36.806336 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7afae40b-b412-4d20-9b75-1468b4d45df9 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:36.807456 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7afae40b-b412-4d20-9b75-1468b4d45df9 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:36.808447 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7afae40b-b412-4d20-9b75-1468b4d45df9 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:36.809880 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7afae40b-b412-4d20-9b75-1468b4d45df9 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:36.936083 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-7afae40b-b412-4d20-9b75-1468b4d45df9 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:36.946896 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-7afae40b-b412-4d20-9b75-1468b4d45df9 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:36.948995 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-7afae40b-b412-4d20-9b75-1468b4d45df9 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:36.950633 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7afae40b-b412-4d20-9b75-1468b4d45df9 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] 10.222.0.33 "GET /compute/v2.1/servers/190c8460-79bf-45a8-a441-75f8f05f713e" status: 200 len: 1366 microversion: 2.47 time: 0.169017 Sep 23 05:01:36.951957 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2902/5970] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 05:01:36 2022] GET /compute/v2.1/servers/190c8460-79bf-45a8-a441-75f8f05f713e => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 05:01:37.248502 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-60bd88fb-9acf-41cf-9394-29f9de85866f tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-670843125", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "networks": [{"uuid": "7528a77c-d2af-4c49-9dd2-7c9acb2f89ec"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1122301964", "security_groups": [{"name": "tempest-secgroup-smoke-447726912"}]}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:01:37.280769 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-60bea18b-ff9a-4259-aa20-d1cc8f30d34e tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:37.281413 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-60bea18b-ff9a-4259-aa20-d1cc8f30d34e tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] [instance: eb57fbfa-f7ab-482e-be43-d88659fc3063] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:37.303941 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-60bea18b-ff9a-4259-aa20-d1cc8f30d34e tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:37.307223 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-60bea18b-ff9a-4259-aa20-d1cc8f30d34e tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:37.310448 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-60bea18b-ff9a-4259-aa20-d1cc8f30d34e tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:37.313623 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-60bea18b-ff9a-4259-aa20-d1cc8f30d34e tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:37.320773 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-60bea18b-ff9a-4259-aa20-d1cc8f30d34e tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:37.320773 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-60bea18b-ff9a-4259-aa20-d1cc8f30d34e tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:37.497182 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.neutron [None req-60bd88fb-9acf-41cf-9394-29f9de85866f tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] validate_networks() for [('7528a77c-d2af-4c49-9dd2-7c9acb2f89ec', None, None, None, None, None)] {{(pid=122699) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 05:01:38.142095 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-60bea18b-ff9a-4259-aa20-d1cc8f30d34e tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1af38bb9e9a4cbab4a8935a01e7afba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da3327b2d3674f019c300935bb84945a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:38.153086 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-60bea18b-ff9a-4259-aa20-d1cc8f30d34e tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] 10.222.0.33 "GET /compute/v2.1/servers/eb57fbfa-f7ab-482e-be43-d88659fc3063" status: 200 len: 1314 microversion: 2.1 time: 0.875854 Sep 23 05:01:38.153932 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2903/5971] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:01:37 2022] GET /compute/v2.1/servers/eb57fbfa-f7ab-482e-be43-d88659fc3063 => generated 1314 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:01:38.165801 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1da6653b-2cc0-4881-a436-d4a9eb9ec7db tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:38.173187 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-1da6653b-2cc0-4881-a436-d4a9eb9ec7db tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] [instance: 190c8460-79bf-45a8-a441-75f8f05f713e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:38.194238 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1da6653b-2cc0-4881-a436-d4a9eb9ec7db tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:38.204280 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1da6653b-2cc0-4881-a436-d4a9eb9ec7db tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:38.204280 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1da6653b-2cc0-4881-a436-d4a9eb9ec7db tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:38.204280 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1da6653b-2cc0-4881-a436-d4a9eb9ec7db tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:38.205967 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1da6653b-2cc0-4881-a436-d4a9eb9ec7db tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:38.206561 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1da6653b-2cc0-4881-a436-d4a9eb9ec7db tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:38.365608 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-1da6653b-2cc0-4881-a436-d4a9eb9ec7db tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:38.380492 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-1da6653b-2cc0-4881-a436-d4a9eb9ec7db tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:38.390437 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-1da6653b-2cc0-4881-a436-d4a9eb9ec7db tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:38.391351 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-1da6653b-2cc0-4881-a436-d4a9eb9ec7db tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] 10.222.0.33 "GET /compute/v2.1/servers/190c8460-79bf-45a8-a441-75f8f05f713e" status: 200 len: 1366 microversion: 2.47 time: 0.236156 Sep 23 05:01:38.391933 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2904/5972] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 05:01:38 2022] GET /compute/v2.1/servers/190c8460-79bf-45a8-a441-75f8f05f713e => generated 1366 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 05:01:38.572184 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-60bd88fb-9acf-41cf-9394-29f9de85866f tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Flavor limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 05:01:38.572707 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-60bd88fb-9acf-41cf-9394-29f9de85866f tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Image limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 05:01:38.573279 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-60bd88fb-9acf-41cf-9394-29f9de85866f tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Flavor pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 05:01:38.573979 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-60bd88fb-9acf-41cf-9394-29f9de85866f tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Image pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 05:01:38.575265 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-60bd88fb-9acf-41cf-9394-29f9de85866f tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 05:01:38.588372 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-60bd88fb-9acf-41cf-9394-29f9de85866f tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:38.589466 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-60bd88fb-9acf-41cf-9394-29f9de85866f tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:38.590285 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-60bd88fb-9acf-41cf-9394-29f9de85866f tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:38.591224 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-60bd88fb-9acf-41cf-9394-29f9de85866f tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:38.591854 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-60bd88fb-9acf-41cf-9394-29f9de85866f tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:38.592494 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-60bd88fb-9acf-41cf-9394-29f9de85866f tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:38.618178 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-60bd88fb-9acf-41cf-9394-29f9de85866f tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Getting quotas for project 0edd6bd5b418494fbcb05c743967d36a. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 05:01:38.624655 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-60bd88fb-9acf-41cf-9394-29f9de85866f tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Getting quotas for user 8d3d0a162e7e4beb81a54120cab246ff and project 0edd6bd5b418494fbcb05c743967d36a. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 05:01:38.642260 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-60bd88fb-9acf-41cf-9394-29f9de85866f tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Going to run 1 instances... {{(pid=122699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 05:01:38.647462 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-60bd88fb-9acf-41cf-9394-29f9de85866f tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 7534fa45-8669-4295-b3c9-0d7478dd2eb8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 05:01:38.916066 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-60bd88fb-9acf-41cf-9394-29f9de85866f tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.671956 Sep 23 05:01:38.918473 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3069/5973] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 05:01:37 2022] POST /compute/v2.1/servers => generated 405 bytes in 1675 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 05:01:38.931258 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c38b6223-b6aa-4128-9e94-91fe3f59ba48 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:38.931874 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c38b6223-b6aa-4128-9e94-91fe3f59ba48 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 7534fa45-8669-4295-b3c9-0d7478dd2eb8] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:39.141281 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c38b6223-b6aa-4128-9e94-91fe3f59ba48 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:39.164997 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c38b6223-b6aa-4128-9e94-91fe3f59ba48 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/7534fa45-8669-4295-b3c9-0d7478dd2eb8" status: 200 len: 1266 microversion: 2.1 time: 0.237993 Sep 23 05:01:39.166972 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2905/5974] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:01:38 2022] GET /compute/v2.1/servers/7534fa45-8669-4295-b3c9-0d7478dd2eb8 => generated 1266 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:01:39.177706 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-55f4fe84-98ac-42bd-96b3-ad0c61362414 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:39.178691 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-55f4fe84-98ac-42bd-96b3-ad0c61362414 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] [instance: eb57fbfa-f7ab-482e-be43-d88659fc3063] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:39.202657 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-55f4fe84-98ac-42bd-96b3-ad0c61362414 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:39.203617 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-55f4fe84-98ac-42bd-96b3-ad0c61362414 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:39.206262 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-55f4fe84-98ac-42bd-96b3-ad0c61362414 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:39.210660 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-55f4fe84-98ac-42bd-96b3-ad0c61362414 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:39.212669 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-55f4fe84-98ac-42bd-96b3-ad0c61362414 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:39.214337 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-55f4fe84-98ac-42bd-96b3-ad0c61362414 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:39.425027 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-343e329f-b219-45c5-9b45-a67f0410cc1e tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:39.425920 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-343e329f-b219-45c5-9b45-a67f0410cc1e tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] [instance: 190c8460-79bf-45a8-a441-75f8f05f713e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:39.450508 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-343e329f-b219-45c5-9b45-a67f0410cc1e tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:39.451182 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-343e329f-b219-45c5-9b45-a67f0410cc1e tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:39.451790 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-343e329f-b219-45c5-9b45-a67f0410cc1e tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:39.456864 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-343e329f-b219-45c5-9b45-a67f0410cc1e tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:39.458263 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-343e329f-b219-45c5-9b45-a67f0410cc1e tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:39.460299 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-343e329f-b219-45c5-9b45-a67f0410cc1e tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:39.691925 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-343e329f-b219-45c5-9b45-a67f0410cc1e tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:39.700819 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-343e329f-b219-45c5-9b45-a67f0410cc1e tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:39.708200 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-343e329f-b219-45c5-9b45-a67f0410cc1e tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:39.715735 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-343e329f-b219-45c5-9b45-a67f0410cc1e tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] 10.222.0.33 "GET /compute/v2.1/servers/190c8460-79bf-45a8-a441-75f8f05f713e" status: 200 len: 1366 microversion: 2.47 time: 0.294856 Sep 23 05:01:39.723920 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2906/5975] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 05:01:39 2022] GET /compute/v2.1/servers/190c8460-79bf-45a8-a441-75f8f05f713e => generated 1366 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 05:01:39.772399 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-55f4fe84-98ac-42bd-96b3-ad0c61362414 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1af38bb9e9a4cbab4a8935a01e7afba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da3327b2d3674f019c300935bb84945a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:39.786756 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-55f4fe84-98ac-42bd-96b3-ad0c61362414 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] 10.222.0.33 "GET /compute/v2.1/servers/eb57fbfa-f7ab-482e-be43-d88659fc3063" status: 200 len: 1314 microversion: 2.1 time: 0.613782 Sep 23 05:01:39.791198 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3070/5976] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:01:39 2022] GET /compute/v2.1/servers/eb57fbfa-f7ab-482e-be43-d88659fc3063 => generated 1314 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:01:40.193280 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-cea74053-3791-49e4-a9c9-9c5496cc33e2 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:40.195715 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-cea74053-3791-49e4-a9c9-9c5496cc33e2 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 7534fa45-8669-4295-b3c9-0d7478dd2eb8] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:40.429604 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-cea74053-3791-49e4-a9c9-9c5496cc33e2 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:40.443828 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-cea74053-3791-49e4-a9c9-9c5496cc33e2 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/7534fa45-8669-4295-b3c9-0d7478dd2eb8" status: 200 len: 1266 microversion: 2.1 time: 0.256154 Sep 23 05:01:40.444407 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2907/5977] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:01:40 2022] GET /compute/v2.1/servers/7534fa45-8669-4295-b3c9-0d7478dd2eb8 => generated 1266 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:01:40.752120 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-279ee528-81e1-4b1b-b791-47475bd3a30c tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:40.752982 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-279ee528-81e1-4b1b-b791-47475bd3a30c tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] [instance: 190c8460-79bf-45a8-a441-75f8f05f713e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:40.763715 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-279ee528-81e1-4b1b-b791-47475bd3a30c tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:40.765825 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-279ee528-81e1-4b1b-b791-47475bd3a30c tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:40.765825 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-279ee528-81e1-4b1b-b791-47475bd3a30c tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:40.765825 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-279ee528-81e1-4b1b-b791-47475bd3a30c tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:40.766547 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-279ee528-81e1-4b1b-b791-47475bd3a30c tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:40.767145 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-279ee528-81e1-4b1b-b791-47475bd3a30c tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:40.815800 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d5b92059-77ec-4116-8013-64e61a3a9e4c tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:40.816433 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d5b92059-77ec-4116-8013-64e61a3a9e4c tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] [instance: eb57fbfa-f7ab-482e-be43-d88659fc3063] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:40.839858 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d5b92059-77ec-4116-8013-64e61a3a9e4c tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:40.840373 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d5b92059-77ec-4116-8013-64e61a3a9e4c tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:40.845862 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d5b92059-77ec-4116-8013-64e61a3a9e4c tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:40.846781 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d5b92059-77ec-4116-8013-64e61a3a9e4c tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:40.851998 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d5b92059-77ec-4116-8013-64e61a3a9e4c tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:40.852516 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d5b92059-77ec-4116-8013-64e61a3a9e4c tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:40.919096 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-279ee528-81e1-4b1b-b791-47475bd3a30c tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:40.931496 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-279ee528-81e1-4b1b-b791-47475bd3a30c tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:40.941752 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-279ee528-81e1-4b1b-b791-47475bd3a30c tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:40.943855 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-279ee528-81e1-4b1b-b791-47475bd3a30c tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] 10.222.0.33 "GET /compute/v2.1/servers/190c8460-79bf-45a8-a441-75f8f05f713e" status: 200 len: 1366 microversion: 2.47 time: 0.198984 Sep 23 05:01:40.951973 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3071/5978] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 05:01:40 2022] GET /compute/v2.1/servers/190c8460-79bf-45a8-a441-75f8f05f713e => generated 1366 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 05:01:41.171179 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d5b92059-77ec-4116-8013-64e61a3a9e4c tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1af38bb9e9a4cbab4a8935a01e7afba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da3327b2d3674f019c300935bb84945a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:41.182711 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d5b92059-77ec-4116-8013-64e61a3a9e4c tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] 10.222.0.33 "GET /compute/v2.1/servers/eb57fbfa-f7ab-482e-be43-d88659fc3063" status: 200 len: 1314 microversion: 2.1 time: 0.369684 Sep 23 05:01:41.185625 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2908/5979] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:01:40 2022] GET /compute/v2.1/servers/eb57fbfa-f7ab-482e-be43-d88659fc3063 => generated 1314 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:01:41.469707 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d294278e-7df4-472e-b50c-b6863214dc61 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:41.482694 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d294278e-7df4-472e-b50c-b6863214dc61 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 7534fa45-8669-4295-b3c9-0d7478dd2eb8] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:41.494120 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d294278e-7df4-472e-b50c-b6863214dc61 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:41.496498 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d294278e-7df4-472e-b50c-b6863214dc61 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:41.497011 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d294278e-7df4-472e-b50c-b6863214dc61 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:41.499431 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d294278e-7df4-472e-b50c-b6863214dc61 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:41.499926 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d294278e-7df4-472e-b50c-b6863214dc61 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:41.503938 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d294278e-7df4-472e-b50c-b6863214dc61 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:41.509679 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-a31e2173-ac64-448b-b80b-e120c3a8054e req-28da782e-d2e3-4838-aee4-88506ed32738 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb57fbfa-f7ab-482e-be43-d88659fc3063", "name": "network-vif-plugged", "status": "completed", "tag": "86b01531-b24a-420f-8fce-92614d52df83"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:01:41.527787 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-a31e2173-ac64-448b-b80b-e120c3a8054e req-28da782e-d2e3-4838-aee4-88506ed32738 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:41.528279 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-a31e2173-ac64-448b-b80b-e120c3a8054e req-28da782e-d2e3-4838-aee4-88506ed32738 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:41.533353 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-a31e2173-ac64-448b-b80b-e120c3a8054e req-28da782e-d2e3-4838-aee4-88506ed32738 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:41.558146 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=100 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:01:41.585745 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-a31e2173-ac64-448b-b80b-e120c3a8054e req-28da782e-d2e3-4838-aee4-88506ed32738 service nova] Creating event network-vif-plugged:86b01531-b24a-420f-8fce-92614d52df83 for instance eb57fbfa-f7ab-482e-be43-d88659fc3063 on n-h1-846463-3 Sep 23 05:01:41.601994 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-a31e2173-ac64-448b-b80b-e120c3a8054e req-28da782e-d2e3-4838-aee4-88506ed32738 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095227 Sep 23 05:01:41.605500 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2909/5980] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:01:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 05:01:41.667526 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d294278e-7df4-472e-b50c-b6863214dc61 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:41.691930 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d294278e-7df4-472e-b50c-b6863214dc61 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/7534fa45-8669-4295-b3c9-0d7478dd2eb8" status: 200 len: 1270 microversion: 2.1 time: 0.226951 Sep 23 05:01:41.700441 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3072/5981] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:01:41 2022] GET /compute/v2.1/servers/7534fa45-8669-4295-b3c9-0d7478dd2eb8 => generated 1270 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:01:41.974727 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-166a345e-f17f-4603-8994-c785e047ec76 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:41.977793 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-166a345e-f17f-4603-8994-c785e047ec76 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] [instance: 190c8460-79bf-45a8-a441-75f8f05f713e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:41.987880 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-166a345e-f17f-4603-8994-c785e047ec76 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:41.990857 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-166a345e-f17f-4603-8994-c785e047ec76 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:41.991519 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-166a345e-f17f-4603-8994-c785e047ec76 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:41.995637 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-166a345e-f17f-4603-8994-c785e047ec76 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:41.996300 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-166a345e-f17f-4603-8994-c785e047ec76 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:41.996901 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-166a345e-f17f-4603-8994-c785e047ec76 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:42.142515 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-166a345e-f17f-4603-8994-c785e047ec76 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:42.148813 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-166a345e-f17f-4603-8994-c785e047ec76 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:42.155357 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-166a345e-f17f-4603-8994-c785e047ec76 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:42.160775 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-166a345e-f17f-4603-8994-c785e047ec76 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] 10.222.0.33 "GET /compute/v2.1/servers/190c8460-79bf-45a8-a441-75f8f05f713e" status: 200 len: 1366 microversion: 2.47 time: 0.191671 Sep 23 05:01:42.178764 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2910/5982] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 05:01:41 2022] GET /compute/v2.1/servers/190c8460-79bf-45a8-a441-75f8f05f713e => generated 1366 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 05:01:42.207846 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-eecbb637-5b6c-40c2-89e6-e768cf999dce tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:42.211037 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-eecbb637-5b6c-40c2-89e6-e768cf999dce tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] [instance: eb57fbfa-f7ab-482e-be43-d88659fc3063] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:42.221841 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eecbb637-5b6c-40c2-89e6-e768cf999dce tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:42.222604 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eecbb637-5b6c-40c2-89e6-e768cf999dce tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:42.223266 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eecbb637-5b6c-40c2-89e6-e768cf999dce tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:42.224180 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eecbb637-5b6c-40c2-89e6-e768cf999dce tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:42.226935 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eecbb637-5b6c-40c2-89e6-e768cf999dce tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:42.227564 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eecbb637-5b6c-40c2-89e6-e768cf999dce tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:42.576609 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-eecbb637-5b6c-40c2-89e6-e768cf999dce tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1af38bb9e9a4cbab4a8935a01e7afba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da3327b2d3674f019c300935bb84945a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:42.584722 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-eecbb637-5b6c-40c2-89e6-e768cf999dce tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] 10.222.0.33 "GET /compute/v2.1/servers/eb57fbfa-f7ab-482e-be43-d88659fc3063" status: 200 len: 1314 microversion: 2.1 time: 0.380967 Sep 23 05:01:42.593213 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3073/5983] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:01:42 2022] GET /compute/v2.1/servers/eb57fbfa-f7ab-482e-be43-d88659fc3063 => generated 1314 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:01:42.731836 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b1f39d60-7c93-48b2-a05a-fe0ba64a88cf tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:42.732783 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b1f39d60-7c93-48b2-a05a-fe0ba64a88cf tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 7534fa45-8669-4295-b3c9-0d7478dd2eb8] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:42.755495 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b1f39d60-7c93-48b2-a05a-fe0ba64a88cf tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:42.758069 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b1f39d60-7c93-48b2-a05a-fe0ba64a88cf tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:42.763856 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b1f39d60-7c93-48b2-a05a-fe0ba64a88cf tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:42.763856 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b1f39d60-7c93-48b2-a05a-fe0ba64a88cf tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:42.763856 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b1f39d60-7c93-48b2-a05a-fe0ba64a88cf tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:42.763856 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b1f39d60-7c93-48b2-a05a-fe0ba64a88cf tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:43.193131 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b1f39d60-7c93-48b2-a05a-fe0ba64a88cf tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:43.198054 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c27a5e31-f97a-4072-bca4-4a7703756fc3 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:43.199003 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c27a5e31-f97a-4072-bca4-4a7703756fc3 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] [instance: 190c8460-79bf-45a8-a441-75f8f05f713e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:43.204676 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b1f39d60-7c93-48b2-a05a-fe0ba64a88cf tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/7534fa45-8669-4295-b3c9-0d7478dd2eb8" status: 200 len: 1318 microversion: 2.1 time: 0.481372 Sep 23 05:01:43.205280 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2911/5984] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:01:42 2022] GET /compute/v2.1/servers/7534fa45-8669-4295-b3c9-0d7478dd2eb8 => generated 1318 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:01:43.221579 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c27a5e31-f97a-4072-bca4-4a7703756fc3 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:43.221579 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c27a5e31-f97a-4072-bca4-4a7703756fc3 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:43.221579 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c27a5e31-f97a-4072-bca4-4a7703756fc3 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:43.221579 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c27a5e31-f97a-4072-bca4-4a7703756fc3 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:43.221579 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c27a5e31-f97a-4072-bca4-4a7703756fc3 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:43.221579 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c27a5e31-f97a-4072-bca4-4a7703756fc3 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:43.617053 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ace3b811-33de-41aa-9869-9d538b0535ac tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:43.617602 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-ace3b811-33de-41aa-9869-9d538b0535ac tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] [instance: eb57fbfa-f7ab-482e-be43-d88659fc3063] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:43.627745 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ace3b811-33de-41aa-9869-9d538b0535ac tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:43.632897 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ace3b811-33de-41aa-9869-9d538b0535ac tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:43.632897 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ace3b811-33de-41aa-9869-9d538b0535ac tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:43.632897 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ace3b811-33de-41aa-9869-9d538b0535ac tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:43.632897 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ace3b811-33de-41aa-9869-9d538b0535ac tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:43.632897 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ace3b811-33de-41aa-9869-9d538b0535ac tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:43.975766 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c27a5e31-f97a-4072-bca4-4a7703756fc3 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:43.993371 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c27a5e31-f97a-4072-bca4-4a7703756fc3 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:44.009653 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c27a5e31-f97a-4072-bca4-4a7703756fc3 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:44.026240 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c27a5e31-f97a-4072-bca4-4a7703756fc3 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] 10.222.0.33 "GET /compute/v2.1/servers/190c8460-79bf-45a8-a441-75f8f05f713e" status: 200 len: 1366 microversion: 2.47 time: 0.829077 Sep 23 05:01:44.029797 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3074/5985] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 05:01:43 2022] GET /compute/v2.1/servers/190c8460-79bf-45a8-a441-75f8f05f713e => generated 1366 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 05:01:44.169425 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ace3b811-33de-41aa-9869-9d538b0535ac tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1af38bb9e9a4cbab4a8935a01e7afba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da3327b2d3674f019c300935bb84945a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:44.186095 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ace3b811-33de-41aa-9869-9d538b0535ac tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] 10.222.0.33 "GET /compute/v2.1/servers/eb57fbfa-f7ab-482e-be43-d88659fc3063" status: 200 len: 1314 microversion: 2.1 time: 0.572495 Sep 23 05:01:44.189761 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2912/5986] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:01:43 2022] GET /compute/v2.1/servers/eb57fbfa-f7ab-482e-be43-d88659fc3063 => generated 1314 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:01:44.228867 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-81fe260e-d6c0-4868-a411-3b716dd05177 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:44.230299 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-81fe260e-d6c0-4868-a411-3b716dd05177 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 7534fa45-8669-4295-b3c9-0d7478dd2eb8] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:44.243637 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-81fe260e-d6c0-4868-a411-3b716dd05177 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:44.248549 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-81fe260e-d6c0-4868-a411-3b716dd05177 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:44.249153 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-81fe260e-d6c0-4868-a411-3b716dd05177 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:44.250013 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-81fe260e-d6c0-4868-a411-3b716dd05177 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:44.250542 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-81fe260e-d6c0-4868-a411-3b716dd05177 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:44.251047 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-81fe260e-d6c0-4868-a411-3b716dd05177 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:44.418741 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-81fe260e-d6c0-4868-a411-3b716dd05177 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:44.427870 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-81fe260e-d6c0-4868-a411-3b716dd05177 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/7534fa45-8669-4295-b3c9-0d7478dd2eb8" status: 200 len: 1336 microversion: 2.1 time: 0.203001 Sep 23 05:01:44.431490 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3075/5987] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:01:44 2022] GET /compute/v2.1/servers/7534fa45-8669-4295-b3c9-0d7478dd2eb8 => generated 1336 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:01:45.056085 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c99196cd-eab3-436e-ac5a-e2289acd77c8 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:45.064820 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c99196cd-eab3-436e-ac5a-e2289acd77c8 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] [instance: 190c8460-79bf-45a8-a441-75f8f05f713e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:45.069955 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c99196cd-eab3-436e-ac5a-e2289acd77c8 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:45.070480 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c99196cd-eab3-436e-ac5a-e2289acd77c8 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:45.070942 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c99196cd-eab3-436e-ac5a-e2289acd77c8 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:45.071668 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c99196cd-eab3-436e-ac5a-e2289acd77c8 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:45.072133 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c99196cd-eab3-436e-ac5a-e2289acd77c8 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:45.072570 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c99196cd-eab3-436e-ac5a-e2289acd77c8 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:45.212690 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2aa015bf-76af-437a-87aa-d5f602d267d5 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:45.213051 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-2aa015bf-76af-437a-87aa-d5f602d267d5 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] [instance: eb57fbfa-f7ab-482e-be43-d88659fc3063] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:45.222007 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2aa015bf-76af-437a-87aa-d5f602d267d5 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:45.222809 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2aa015bf-76af-437a-87aa-d5f602d267d5 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:45.223418 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2aa015bf-76af-437a-87aa-d5f602d267d5 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:45.224699 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2aa015bf-76af-437a-87aa-d5f602d267d5 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:45.225327 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2aa015bf-76af-437a-87aa-d5f602d267d5 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:45.226111 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2aa015bf-76af-437a-87aa-d5f602d267d5 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:45.289200 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c99196cd-eab3-436e-ac5a-e2289acd77c8 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:45.299449 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c99196cd-eab3-436e-ac5a-e2289acd77c8 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:45.316766 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c99196cd-eab3-436e-ac5a-e2289acd77c8 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:45.316766 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c99196cd-eab3-436e-ac5a-e2289acd77c8 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] 10.222.0.33 "GET /compute/v2.1/servers/190c8460-79bf-45a8-a441-75f8f05f713e" status: 200 len: 1366 microversion: 2.47 time: 0.253218 Sep 23 05:01:45.316766 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2913/5988] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 05:01:45 2022] GET /compute/v2.1/servers/190c8460-79bf-45a8-a441-75f8f05f713e => generated 1366 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 05:01:45.462146 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b73242d4-d238-4ad9-a258-68f447ab6c83 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:45.463634 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b73242d4-d238-4ad9-a258-68f447ab6c83 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 7534fa45-8669-4295-b3c9-0d7478dd2eb8] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:45.475603 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b73242d4-d238-4ad9-a258-68f447ab6c83 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:45.478085 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b73242d4-d238-4ad9-a258-68f447ab6c83 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:45.478721 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b73242d4-d238-4ad9-a258-68f447ab6c83 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:45.482341 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b73242d4-d238-4ad9-a258-68f447ab6c83 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:45.483734 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b73242d4-d238-4ad9-a258-68f447ab6c83 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:45.485601 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b73242d4-d238-4ad9-a258-68f447ab6c83 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:45.889500 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2aa015bf-76af-437a-87aa-d5f602d267d5 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1af38bb9e9a4cbab4a8935a01e7afba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da3327b2d3674f019c300935bb84945a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:45.900046 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2aa015bf-76af-437a-87aa-d5f602d267d5 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] 10.222.0.33 "GET /compute/v2.1/servers/eb57fbfa-f7ab-482e-be43-d88659fc3063" status: 200 len: 1497 microversion: 2.1 time: 0.693206 Sep 23 05:01:45.912001 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3076/5989] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:01:45 2022] GET /compute/v2.1/servers/eb57fbfa-f7ab-482e-be43-d88659fc3063 => generated 1497 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:01:45.926417 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b73242d4-d238-4ad9-a258-68f447ab6c83 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:45.936376 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b73242d4-d238-4ad9-a258-68f447ab6c83 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/7534fa45-8669-4295-b3c9-0d7478dd2eb8" status: 200 len: 1391 microversion: 2.1 time: 0.482200 Sep 23 05:01:45.939483 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2914/5990] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:01:45 2022] GET /compute/v2.1/servers/7534fa45-8669-4295-b3c9-0d7478dd2eb8 => generated 1391 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:01:46.335958 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8d7294ea-facf-445f-80f2-a4a652b99558 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:46.336957 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-8d7294ea-facf-445f-80f2-a4a652b99558 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] [instance: 190c8460-79bf-45a8-a441-75f8f05f713e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:46.352758 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8d7294ea-facf-445f-80f2-a4a652b99558 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:46.353650 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8d7294ea-facf-445f-80f2-a4a652b99558 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:46.355707 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8d7294ea-facf-445f-80f2-a4a652b99558 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:46.357956 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8d7294ea-facf-445f-80f2-a4a652b99558 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:46.361792 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8d7294ea-facf-445f-80f2-a4a652b99558 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:46.363141 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8d7294ea-facf-445f-80f2-a4a652b99558 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:46.747827 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-8d7294ea-facf-445f-80f2-a4a652b99558 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:46.757612 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-8d7294ea-facf-445f-80f2-a4a652b99558 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:46.759133 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-8d7294ea-facf-445f-80f2-a4a652b99558 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:46.770234 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-8d7294ea-facf-445f-80f2-a4a652b99558 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] 10.222.0.33 "GET /compute/v2.1/servers/190c8460-79bf-45a8-a441-75f8f05f713e" status: 200 len: 1384 microversion: 2.47 time: 0.429247 Sep 23 05:01:46.789979 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3077/5991] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 05:01:46 2022] GET /compute/v2.1/servers/190c8460-79bf-45a8-a441-75f8f05f713e => generated 1384 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 05:01:46.968034 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3fb3bcb6-3f1d-4a39-a420-efe6fb75ccc5 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:46.969218 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3fb3bcb6-3f1d-4a39-a420-efe6fb75ccc5 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 7534fa45-8669-4295-b3c9-0d7478dd2eb8] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:46.990870 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3fb3bcb6-3f1d-4a39-a420-efe6fb75ccc5 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:46.992906 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3fb3bcb6-3f1d-4a39-a420-efe6fb75ccc5 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:46.993371 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3fb3bcb6-3f1d-4a39-a420-efe6fb75ccc5 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:46.994249 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3fb3bcb6-3f1d-4a39-a420-efe6fb75ccc5 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:46.995288 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3fb3bcb6-3f1d-4a39-a420-efe6fb75ccc5 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:47.000962 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3fb3bcb6-3f1d-4a39-a420-efe6fb75ccc5 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:47.276161 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-3fb3bcb6-3f1d-4a39-a420-efe6fb75ccc5 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:47.286948 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3fb3bcb6-3f1d-4a39-a420-efe6fb75ccc5 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/7534fa45-8669-4295-b3c9-0d7478dd2eb8" status: 200 len: 1391 microversion: 2.1 time: 0.323471 Sep 23 05:01:47.289822 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2915/5992] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:01:46 2022] GET /compute/v2.1/servers/7534fa45-8669-4295-b3c9-0d7478dd2eb8 => generated 1391 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:01:47.498988 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ecbb5a13-cda1-4d3e-9c0c-0885414f9fb7 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:47.498988 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ecbb5a13-cda1-4d3e-9c0c-0885414f9fb7 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] [instance: eb57fbfa-f7ab-482e-be43-d88659fc3063] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:47.511298 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ecbb5a13-cda1-4d3e-9c0c-0885414f9fb7 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:47.511298 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ecbb5a13-cda1-4d3e-9c0c-0885414f9fb7 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:47.511298 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ecbb5a13-cda1-4d3e-9c0c-0885414f9fb7 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:47.511538 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ecbb5a13-cda1-4d3e-9c0c-0885414f9fb7 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:47.518055 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ecbb5a13-cda1-4d3e-9c0c-0885414f9fb7 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:47.518602 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ecbb5a13-cda1-4d3e-9c0c-0885414f9fb7 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:47.569621 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ecbb5a13-cda1-4d3e-9c0c-0885414f9fb7 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] [instance: eb57fbfa-f7ab-482e-be43-d88659fc3063] Going to try to terminate instance {{(pid=122699) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 05:01:47.800619 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4450abf4-5d07-4655-b959-2c68d7f301db tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:47.801775 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4450abf4-5d07-4655-b959-2c68d7f301db tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] [instance: 190c8460-79bf-45a8-a441-75f8f05f713e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:47.815260 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4450abf4-5d07-4655-b959-2c68d7f301db tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:47.815771 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4450abf4-5d07-4655-b959-2c68d7f301db tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:47.816248 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4450abf4-5d07-4655-b959-2c68d7f301db tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:47.817494 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4450abf4-5d07-4655-b959-2c68d7f301db tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:47.817995 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4450abf4-5d07-4655-b959-2c68d7f301db tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:47.818436 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4450abf4-5d07-4655-b959-2c68d7f301db tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:47.956537 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4450abf4-5d07-4655-b959-2c68d7f301db tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:47.968363 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4450abf4-5d07-4655-b959-2c68d7f301db tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:47.969862 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4450abf4-5d07-4655-b959-2c68d7f301db tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:47.971101 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4450abf4-5d07-4655-b959-2c68d7f301db tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] 10.222.0.33 "GET /compute/v2.1/servers/190c8460-79bf-45a8-a441-75f8f05f713e" status: 200 len: 1372 microversion: 2.47 time: 0.174411 Sep 23 05:01:47.998684 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2916/5993] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 05:01:47 2022] GET /compute/v2.1/servers/190c8460-79bf-45a8-a441-75f8f05f713e => generated 1372 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 05:01:48.063283 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ecbb5a13-cda1-4d3e-9c0c-0885414f9fb7 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] 10.222.0.33 "DELETE /compute/v2.1/servers/eb57fbfa-f7ab-482e-be43-d88659fc3063" status: 204 len: 0 microversion: 2.1 time: 0.582909 Sep 23 05:01:48.064662 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3078/5994] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 05:01:47 2022] DELETE /compute/v2.1/servers/eb57fbfa-f7ab-482e-be43-d88659fc3063 => generated 0 bytes in 585 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 05:01:48.079785 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f9ba88fc-8b71-44f8-83e3-974127e51411 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:48.080684 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f9ba88fc-8b71-44f8-83e3-974127e51411 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] [instance: eb57fbfa-f7ab-482e-be43-d88659fc3063] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:48.087970 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f9ba88fc-8b71-44f8-83e3-974127e51411 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:48.088736 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f9ba88fc-8b71-44f8-83e3-974127e51411 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:48.089380 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f9ba88fc-8b71-44f8-83e3-974127e51411 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:48.090341 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f9ba88fc-8b71-44f8-83e3-974127e51411 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:48.091251 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f9ba88fc-8b71-44f8-83e3-974127e51411 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:48.092050 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f9ba88fc-8b71-44f8-83e3-974127e51411 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:48.320447 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1f3378e4-1ce5-49f1-99ee-f0e30d03e5bf tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:48.323863 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1f3378e4-1ce5-49f1-99ee-f0e30d03e5bf tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 7534fa45-8669-4295-b3c9-0d7478dd2eb8] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:48.358371 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1f3378e4-1ce5-49f1-99ee-f0e30d03e5bf tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:48.359307 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1f3378e4-1ce5-49f1-99ee-f0e30d03e5bf tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:48.364410 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1f3378e4-1ce5-49f1-99ee-f0e30d03e5bf tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:48.365284 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1f3378e4-1ce5-49f1-99ee-f0e30d03e5bf tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:48.367406 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1f3378e4-1ce5-49f1-99ee-f0e30d03e5bf tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:48.369808 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1f3378e4-1ce5-49f1-99ee-f0e30d03e5bf tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:48.606250 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:01:48.636469 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=6 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:01:48.717783 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f9ba88fc-8b71-44f8-83e3-974127e51411 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1af38bb9e9a4cbab4a8935a01e7afba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da3327b2d3674f019c300935bb84945a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:48.747539 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f9ba88fc-8b71-44f8-83e3-974127e51411 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] 10.222.0.33 "GET /compute/v2.1/servers/eb57fbfa-f7ab-482e-be43-d88659fc3063" status: 200 len: 1503 microversion: 2.1 time: 0.675449 Sep 23 05:01:48.751331 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2917/5995] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:01:48 2022] GET /compute/v2.1/servers/eb57fbfa-f7ab-482e-be43-d88659fc3063 => generated 1503 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:01:48.925008 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1f3378e4-1ce5-49f1-99ee-f0e30d03e5bf tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:48.958102 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1f3378e4-1ce5-49f1-99ee-f0e30d03e5bf tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/7534fa45-8669-4295-b3c9-0d7478dd2eb8" status: 200 len: 1391 microversion: 2.1 time: 0.634725 Sep 23 05:01:48.973772 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3079/5996] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:01:48 2022] GET /compute/v2.1/servers/7534fa45-8669-4295-b3c9-0d7478dd2eb8 => generated 1391 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:01:49.008580 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d726ad8b-2c4a-4051-9a91-d68334fbf442 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:49.009491 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d726ad8b-2c4a-4051-9a91-d68334fbf442 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] [instance: 190c8460-79bf-45a8-a441-75f8f05f713e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:49.027180 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d726ad8b-2c4a-4051-9a91-d68334fbf442 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:49.027882 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d726ad8b-2c4a-4051-9a91-d68334fbf442 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:49.029022 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d726ad8b-2c4a-4051-9a91-d68334fbf442 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:49.039177 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d726ad8b-2c4a-4051-9a91-d68334fbf442 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:49.039177 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d726ad8b-2c4a-4051-9a91-d68334fbf442 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:49.039177 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d726ad8b-2c4a-4051-9a91-d68334fbf442 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:49.193841 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d726ad8b-2c4a-4051-9a91-d68334fbf442 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:49.209185 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d726ad8b-2c4a-4051-9a91-d68334fbf442 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:49.211477 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d726ad8b-2c4a-4051-9a91-d68334fbf442 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:49.213648 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d726ad8b-2c4a-4051-9a91-d68334fbf442 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] 10.222.0.33 "GET /compute/v2.1/servers/190c8460-79bf-45a8-a441-75f8f05f713e" status: 200 len: 1357 microversion: 2.47 time: 0.211460 Sep 23 05:01:49.236783 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2918/5997] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 05:01:49 2022] GET /compute/v2.1/servers/190c8460-79bf-45a8-a441-75f8f05f713e => generated 1357 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 05:01:49.243450 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0b3cc04f-9c6b-49aa-ac30-fe44136eff6f tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:49.250181 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-0b3cc04f-9c6b-49aa-ac30-fe44136eff6f tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:49.251158 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-0b3cc04f-9c6b-49aa-ac30-fe44136eff6f tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Searching by: {'deleted': False, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea'} {{(pid=122699) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 05:01:49.260516 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0b3cc04f-9c6b-49aa-ac30-fe44136eff6f tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:49.260853 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0b3cc04f-9c6b-49aa-ac30-fe44136eff6f tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:49.261497 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0b3cc04f-9c6b-49aa-ac30-fe44136eff6f tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:49.262492 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0b3cc04f-9c6b-49aa-ac30-fe44136eff6f tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:49.263120 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0b3cc04f-9c6b-49aa-ac30-fe44136eff6f tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:49.264673 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0b3cc04f-9c6b-49aa-ac30-fe44136eff6f tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:49.437119 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.multi_cell_list [None req-0b3cc04f-9c6b-49aa-ac30-fe44136eff6f tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122699) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 23 05:01:49.614621 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-fa390005-22a2-4f7d-aaac-7e855a2e7551 req-fa31d7fc-a464-4a4d-8de4-58b2334d2615 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7534fa45-8669-4295-b3c9-0d7478dd2eb8", "tag": "1be06b6d-5ecd-4f40-ad6a-3263a045a87c"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:01:49.635319 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-fa390005-22a2-4f7d-aaac-7e855a2e7551 req-fa31d7fc-a464-4a4d-8de4-58b2334d2615 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:49.635319 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-fa390005-22a2-4f7d-aaac-7e855a2e7551 req-fa31d7fc-a464-4a4d-8de4-58b2334d2615 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:49.635319 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-fa390005-22a2-4f7d-aaac-7e855a2e7551 req-fa31d7fc-a464-4a4d-8de4-58b2334d2615 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:49.640931 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-0b3cc04f-9c6b-49aa-ac30-fe44136eff6f tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:49.648955 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0b3cc04f-9c6b-49aa-ac30-fe44136eff6f tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:49.649455 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0b3cc04f-9c6b-49aa-ac30-fe44136eff6f tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:49.649921 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0b3cc04f-9c6b-49aa-ac30-fe44136eff6f tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:49.657074 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-fa390005-22a2-4f7d-aaac-7e855a2e7551 req-fa31d7fc-a464-4a4d-8de4-58b2334d2615 service nova] Creating event network-changed:1be06b6d-5ecd-4f40-ad6a-3263a045a87c for instance 7534fa45-8669-4295-b3c9-0d7478dd2eb8 on n-h1-846463-3 Sep 23 05:01:49.663291 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-0b3cc04f-9c6b-49aa-ac30-fe44136eff6f tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:49.676249 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-fa390005-22a2-4f7d-aaac-7e855a2e7551 req-fa31d7fc-a464-4a4d-8de4-58b2334d2615 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.320449 Sep 23 05:01:49.676249 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2919/5998] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:01:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:01:49.676925 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-0b3cc04f-9c6b-49aa-ac30-fe44136eff6f tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:49.704358 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0b3cc04f-9c6b-49aa-ac30-fe44136eff6f tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] 10.222.0.33 "GET /compute/v2.1/servers/detail" status: 200 len: 2706 microversion: 2.47 time: 0.466234 Sep 23 05:01:49.705207 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3080/5999] 10.222.0.33 () {60 vars in 1187 bytes} [Fri Sep 23 05:01:49 2022] GET /compute/v2.1/servers/detail => generated 2706 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 05:01:49.740946 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9c121c10-578b-42b7-8bf3-765fd09834ae tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:49.741656 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-9c121c10-578b-42b7-8bf3-765fd09834ae tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] [instance: 190c8460-79bf-45a8-a441-75f8f05f713e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:49.774139 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-26fb0332-2ddc-4bfb-a05c-c65e1a9d3f0d tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:49.774758 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-26fb0332-2ddc-4bfb-a05c-c65e1a9d3f0d tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] [instance: eb57fbfa-f7ab-482e-be43-d88659fc3063] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:49.780016 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9c121c10-578b-42b7-8bf3-765fd09834ae tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:49.784085 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9c121c10-578b-42b7-8bf3-765fd09834ae tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:49.785689 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9c121c10-578b-42b7-8bf3-765fd09834ae tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:49.786661 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-26fb0332-2ddc-4bfb-a05c-c65e1a9d3f0d tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:49.788315 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9c121c10-578b-42b7-8bf3-765fd09834ae tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:49.790429 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9c121c10-578b-42b7-8bf3-765fd09834ae tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:49.791195 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-26fb0332-2ddc-4bfb-a05c-c65e1a9d3f0d tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:49.791756 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9c121c10-578b-42b7-8bf3-765fd09834ae tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:49.791887 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-26fb0332-2ddc-4bfb-a05c-c65e1a9d3f0d tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:49.792551 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-26fb0332-2ddc-4bfb-a05c-c65e1a9d3f0d tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:49.793040 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-26fb0332-2ddc-4bfb-a05c-c65e1a9d3f0d tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:49.793480 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-26fb0332-2ddc-4bfb-a05c-c65e1a9d3f0d tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:49.874378 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-9c121c10-578b-42b7-8bf3-765fd09834ae tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] [instance: 190c8460-79bf-45a8-a441-75f8f05f713e] Going to try to terminate instance {{(pid=122698) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 05:01:50.085140 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-26fb0332-2ddc-4bfb-a05c-c65e1a9d3f0d tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1af38bb9e9a4cbab4a8935a01e7afba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da3327b2d3674f019c300935bb84945a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:50.109917 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-26fb0332-2ddc-4bfb-a05c-c65e1a9d3f0d tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] 10.222.0.33 "GET /compute/v2.1/servers/eb57fbfa-f7ab-482e-be43-d88659fc3063" status: 200 len: 1503 microversion: 2.1 time: 0.339674 Sep 23 05:01:50.121631 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3081/6000] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:01:49 2022] GET /compute/v2.1/servers/eb57fbfa-f7ab-482e-be43-d88659fc3063 => generated 1503 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:01:50.127277 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4a6f2640-d0c6-48f4-aff7-a7a252c0685a tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:50.127889 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4a6f2640-d0c6-48f4-aff7-a7a252c0685a tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 7534fa45-8669-4295-b3c9-0d7478dd2eb8] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:50.166751 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4a6f2640-d0c6-48f4-aff7-a7a252c0685a tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:50.167302 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4a6f2640-d0c6-48f4-aff7-a7a252c0685a tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:50.169043 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4a6f2640-d0c6-48f4-aff7-a7a252c0685a tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:50.181215 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4a6f2640-d0c6-48f4-aff7-a7a252c0685a tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:50.182118 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4a6f2640-d0c6-48f4-aff7-a7a252c0685a tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:50.182916 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4a6f2640-d0c6-48f4-aff7-a7a252c0685a tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:50.375326 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9c121c10-578b-42b7-8bf3-765fd09834ae tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] 10.222.0.33 "DELETE /compute/v2.1/servers/190c8460-79bf-45a8-a441-75f8f05f713e" status: 204 len: 0 microversion: 2.47 time: 0.632496 Sep 23 05:01:50.375326 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2920/6001] 10.222.0.33 () {60 vars in 1280 bytes} [Fri Sep 23 05:01:49 2022] DELETE /compute/v2.1/servers/190c8460-79bf-45a8-a441-75f8f05f713e => generated 0 bytes in 637 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 23 05:01:50.387343 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-531ad1d7-2614-4985-8b26-6f74592fcf58 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:50.388678 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-531ad1d7-2614-4985-8b26-6f74592fcf58 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] [instance: 190c8460-79bf-45a8-a441-75f8f05f713e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:50.406224 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-531ad1d7-2614-4985-8b26-6f74592fcf58 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:50.408192 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-531ad1d7-2614-4985-8b26-6f74592fcf58 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:50.410426 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-531ad1d7-2614-4985-8b26-6f74592fcf58 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:50.413148 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-531ad1d7-2614-4985-8b26-6f74592fcf58 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:50.413844 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-531ad1d7-2614-4985-8b26-6f74592fcf58 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:50.415897 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-531ad1d7-2614-4985-8b26-6f74592fcf58 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:50.458040 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=4 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:01:50.549999 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-4a6f2640-d0c6-48f4-aff7-a7a252c0685a tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:50.572687 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4a6f2640-d0c6-48f4-aff7-a7a252c0685a tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/7534fa45-8669-4295-b3c9-0d7478dd2eb8" status: 200 len: 1391 microversion: 2.1 time: 0.446259 Sep 23 05:01:50.574277 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3082/6002] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:01:50 2022] GET /compute/v2.1/servers/7534fa45-8669-4295-b3c9-0d7478dd2eb8 => generated 1391 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:01:50.598532 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-531ad1d7-2614-4985-8b26-6f74592fcf58 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:50.609585 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-531ad1d7-2614-4985-8b26-6f74592fcf58 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:50.611787 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-531ad1d7-2614-4985-8b26-6f74592fcf58 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:50.613831 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-531ad1d7-2614-4985-8b26-6f74592fcf58 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] 10.222.0.33 "GET /compute/v2.1/servers/190c8460-79bf-45a8-a441-75f8f05f713e" status: 200 len: 1363 microversion: 2.47 time: 0.234263 Sep 23 05:01:50.614957 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2921/6003] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 05:01:50 2022] GET /compute/v2.1/servers/190c8460-79bf-45a8-a441-75f8f05f713e => generated 1363 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 05:01:51.149234 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d1738efe-7763-4beb-b26b-5ee15998ae4d tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:51.152739 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d1738efe-7763-4beb-b26b-5ee15998ae4d tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] [instance: eb57fbfa-f7ab-482e-be43-d88659fc3063] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:51.162432 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d1738efe-7763-4beb-b26b-5ee15998ae4d tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:51.168830 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d1738efe-7763-4beb-b26b-5ee15998ae4d tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:51.169842 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d1738efe-7763-4beb-b26b-5ee15998ae4d tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:51.172787 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d1738efe-7763-4beb-b26b-5ee15998ae4d tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:51.177228 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d1738efe-7763-4beb-b26b-5ee15998ae4d tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:51.177228 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d1738efe-7763-4beb-b26b-5ee15998ae4d tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:51.229610 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:01:51.604139 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a66f82f6-3a00-4fa7-b526-7ae618f01bbe tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:51.605147 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a66f82f6-3a00-4fa7-b526-7ae618f01bbe tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 7534fa45-8669-4295-b3c9-0d7478dd2eb8] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:51.627708 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a66f82f6-3a00-4fa7-b526-7ae618f01bbe tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:51.628219 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a66f82f6-3a00-4fa7-b526-7ae618f01bbe tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:51.629958 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a66f82f6-3a00-4fa7-b526-7ae618f01bbe tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:51.635110 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a66f82f6-3a00-4fa7-b526-7ae618f01bbe tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:51.636522 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a66f82f6-3a00-4fa7-b526-7ae618f01bbe tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:51.637243 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a66f82f6-3a00-4fa7-b526-7ae618f01bbe tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:51.770512 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d1738efe-7763-4beb-b26b-5ee15998ae4d tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1af38bb9e9a4cbab4a8935a01e7afba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da3327b2d3674f019c300935bb84945a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:51.783161 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d1738efe-7763-4beb-b26b-5ee15998ae4d tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] 10.222.0.33 "GET /compute/v2.1/servers/eb57fbfa-f7ab-482e-be43-d88659fc3063" status: 200 len: 1503 microversion: 2.1 time: 0.639272 Sep 23 05:01:51.787017 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3083/6004] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:01:51 2022] GET /compute/v2.1/servers/eb57fbfa-f7ab-482e-be43-d88659fc3063 => generated 1503 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:01:51.795331 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-71eb489a-83df-411e-99ee-eedead34e3f0 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:51.797518 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-71eb489a-83df-411e-99ee-eedead34e3f0 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] [instance: 190c8460-79bf-45a8-a441-75f8f05f713e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:51.818141 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-71eb489a-83df-411e-99ee-eedead34e3f0 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:51.819837 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-71eb489a-83df-411e-99ee-eedead34e3f0 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:51.829183 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-71eb489a-83df-411e-99ee-eedead34e3f0 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:51.830331 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-71eb489a-83df-411e-99ee-eedead34e3f0 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:51.831026 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-71eb489a-83df-411e-99ee-eedead34e3f0 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:51.836368 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-71eb489a-83df-411e-99ee-eedead34e3f0 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:51.905818 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a66f82f6-3a00-4fa7-b526-7ae618f01bbe tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:51.928792 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a66f82f6-3a00-4fa7-b526-7ae618f01bbe tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/7534fa45-8669-4295-b3c9-0d7478dd2eb8" status: 200 len: 1391 microversion: 2.1 time: 0.330518 Sep 23 05:01:51.929725 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2922/6005] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:01:51 2022] GET /compute/v2.1/servers/7534fa45-8669-4295-b3c9-0d7478dd2eb8 => generated 1391 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:01:51.953743 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-1b97dd69-d41a-4889-9f03-9307ba8a02f0 req-aebb4ab7-f443-45b9-b59f-3fc58f141f37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb57fbfa-f7ab-482e-be43-d88659fc3063", "name": "network-vif-deleted", "tag": "86b01531-b24a-420f-8fce-92614d52df83"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:01:51.953979 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-71eb489a-83df-411e-99ee-eedead34e3f0 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:51.962750 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-71eb489a-83df-411e-99ee-eedead34e3f0 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:51.964345 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-71eb489a-83df-411e-99ee-eedead34e3f0 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:51.965882 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-71eb489a-83df-411e-99ee-eedead34e3f0 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] 10.222.0.33 "GET /compute/v2.1/servers/190c8460-79bf-45a8-a441-75f8f05f713e" status: 200 len: 1363 microversion: 2.47 time: 0.177921 Sep 23 05:01:51.986172 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-1b97dd69-d41a-4889-9f03-9307ba8a02f0 req-aebb4ab7-f443-45b9-b59f-3fc58f141f37 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:51.986779 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-1b97dd69-d41a-4889-9f03-9307ba8a02f0 req-aebb4ab7-f443-45b9-b59f-3fc58f141f37 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:51.989000 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-1b97dd69-d41a-4889-9f03-9307ba8a02f0 req-aebb4ab7-f443-45b9-b59f-3fc58f141f37 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:52.004339 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3084/6006] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 05:01:51 2022] GET /compute/v2.1/servers/190c8460-79bf-45a8-a441-75f8f05f713e => generated 1363 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 05:01:52.021176 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-1b97dd69-d41a-4889-9f03-9307ba8a02f0 req-aebb4ab7-f443-45b9-b59f-3fc58f141f37 service nova] Creating event network-vif-deleted:86b01531-b24a-420f-8fce-92614d52df83 for instance eb57fbfa-f7ab-482e-be43-d88659fc3063 on n-h1-846463-3 Sep 23 05:01:52.037521 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-1b97dd69-d41a-4889-9f03-9307ba8a02f0 req-aebb4ab7-f443-45b9-b59f-3fc58f141f37 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105050 Sep 23 05:01:52.054108 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2923/6007] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:01:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:01:52.813710 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2774a98b-e5c4-418d-a8ea-ea6563c89116 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:52.815176 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-2774a98b-e5c4-418d-a8ea-ea6563c89116 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] [instance: eb57fbfa-f7ab-482e-be43-d88659fc3063] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:52.827080 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2774a98b-e5c4-418d-a8ea-ea6563c89116 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:52.830232 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2774a98b-e5c4-418d-a8ea-ea6563c89116 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:52.830936 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2774a98b-e5c4-418d-a8ea-ea6563c89116 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:52.834148 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2774a98b-e5c4-418d-a8ea-ea6563c89116 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:52.835441 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2774a98b-e5c4-418d-a8ea-ea6563c89116 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:52.835945 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2774a98b-e5c4-418d-a8ea-ea6563c89116 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:52.879477 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2774a98b-e5c4-418d-a8ea-ea6563c89116 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:52.879989 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2774a98b-e5c4-418d-a8ea-ea6563c89116 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:52.880433 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2774a98b-e5c4-418d-a8ea-ea6563c89116 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:52.881495 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-2774a98b-e5c4-418d-a8ea-ea6563c89116 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lazy-loading 'fault' on Instance uuid eb57fbfa-f7ab-482e-be43-d88659fc3063 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 05:01:52.945236 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2774a98b-e5c4-418d-a8ea-ea6563c89116 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1af38bb9e9a4cbab4a8935a01e7afba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da3327b2d3674f019c300935bb84945a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:52.957792 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-69cfba0f-ba78-443e-96db-17d7133c35ef tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:52.958395 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-69cfba0f-ba78-443e-96db-17d7133c35ef tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 7534fa45-8669-4295-b3c9-0d7478dd2eb8] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:52.960250 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2774a98b-e5c4-418d-a8ea-ea6563c89116 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] 10.222.0.33 "GET /compute/v2.1/servers/eb57fbfa-f7ab-482e-be43-d88659fc3063" status: 200 len: 1304 microversion: 2.1 time: 0.151976 Sep 23 05:01:52.963587 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3085/6008] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:01:52 2022] GET /compute/v2.1/servers/eb57fbfa-f7ab-482e-be43-d88659fc3063 => generated 1304 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:01:52.980072 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-69cfba0f-ba78-443e-96db-17d7133c35ef tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:52.980783 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-69cfba0f-ba78-443e-96db-17d7133c35ef tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:52.981522 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-69cfba0f-ba78-443e-96db-17d7133c35ef tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:52.982976 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-69cfba0f-ba78-443e-96db-17d7133c35ef tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:52.983621 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-69cfba0f-ba78-443e-96db-17d7133c35ef tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:52.984220 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-69cfba0f-ba78-443e-96db-17d7133c35ef tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:53.006894 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-dac01dde-27e2-4ec4-8487-dfe10114ec9b tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:53.008627 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-dac01dde-27e2-4ec4-8487-dfe10114ec9b tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] [instance: 190c8460-79bf-45a8-a441-75f8f05f713e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:53.033190 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dac01dde-27e2-4ec4-8487-dfe10114ec9b tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:53.033708 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dac01dde-27e2-4ec4-8487-dfe10114ec9b tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:53.038449 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dac01dde-27e2-4ec4-8487-dfe10114ec9b tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:53.041258 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dac01dde-27e2-4ec4-8487-dfe10114ec9b tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:53.041762 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dac01dde-27e2-4ec4-8487-dfe10114ec9b tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:53.046930 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dac01dde-27e2-4ec4-8487-dfe10114ec9b tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:53.167682 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dac01dde-27e2-4ec4-8487-dfe10114ec9b tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:53.168204 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dac01dde-27e2-4ec4-8487-dfe10114ec9b tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:53.171905 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dac01dde-27e2-4ec4-8487-dfe10114ec9b tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:53.172284 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-dac01dde-27e2-4ec4-8487-dfe10114ec9b tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lazy-loading 'fault' on Instance uuid 190c8460-79bf-45a8-a441-75f8f05f713e {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 05:01:53.283273 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-dac01dde-27e2-4ec4-8487-dfe10114ec9b tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:53.321024 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-dac01dde-27e2-4ec4-8487-dfe10114ec9b tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:53.322872 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-dac01dde-27e2-4ec4-8487-dfe10114ec9b tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:53.324195 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-dac01dde-27e2-4ec4-8487-dfe10114ec9b tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] 10.222.0.33 "GET /compute/v2.1/servers/190c8460-79bf-45a8-a441-75f8f05f713e" status: 200 len: 1368 microversion: 2.47 time: 0.329973 Sep 23 05:01:53.329972 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3086/6009] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 05:01:52 2022] GET /compute/v2.1/servers/190c8460-79bf-45a8-a441-75f8f05f713e => generated 1368 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 05:01:53.983940 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b500c8a6-d007-47fd-8829-2d0f134828e4 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:53.984660 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b500c8a6-d007-47fd-8829-2d0f134828e4 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] [instance: eb57fbfa-f7ab-482e-be43-d88659fc3063] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:53.999761 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b500c8a6-d007-47fd-8829-2d0f134828e4 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:54.000344 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b500c8a6-d007-47fd-8829-2d0f134828e4 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:54.000884 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b500c8a6-d007-47fd-8829-2d0f134828e4 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:54.001682 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b500c8a6-d007-47fd-8829-2d0f134828e4 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:54.002251 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b500c8a6-d007-47fd-8829-2d0f134828e4 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:54.002755 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b500c8a6-d007-47fd-8829-2d0f134828e4 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:54.047478 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-b500c8a6-d007-47fd-8829-2d0f134828e4 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] HTTP exception thrown: Instance eb57fbfa-f7ab-482e-be43-d88659fc3063 could not be found. Sep 23 05:01:54.051816 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b500c8a6-d007-47fd-8829-2d0f134828e4 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Request method failure captured: Sep 23 05:01:54.051816 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/eb57fbfa-f7ab-482e-be43-d88659fc3063 HTTP/1.1 Sep 23 05:01:54.051816 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 05:01:54.051816 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 05:01:54.051816 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 05:01:54.051816 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 05:01:54.051816 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 05:01:54.051816 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 05:01:54.051816 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 05:01:54.051816 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 05:01:54.051816 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLT2bk0LzgL4H52lnvj0ZxkxDeBOAlVAmcq-rM2H6QMjegLGCOxZrOn097uCrSDyA8hBNairne71hIZY_6WlP196RP6-SmFIFilEdUGWtONexBlV_YlYu5SPt7q05bPBsFb8WDm5Xq60-vxxC7XEpHfG_3BX1vw6H52dH0j4hJz8syvE Sep 23 05:01:54.051816 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 05:01:54.051816 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 05:01:54.051816 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 05:01:54.051816 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 05:01:54.051816 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 05:01:54.051816 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 05:01:54.051816 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: da3327b2d3674f019c300935bb84945a Sep 23 05:01:54.051816 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-VolumesActionsTest-969491916 Sep 23 05:01:54.051816 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 05:01:54.051816 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 05:01:54.051816 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_da3327b2d3674f019c300935bb84945a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/da3327b2d3674f019c300935bb84945a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/da3327b2d3674f019c300935bb84945a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/da3327b2d3674f019c300935bb84945a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:01:54.051816 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-VolumesActionsTest-969491916 Sep 23 05:01:54.051816 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: da3327b2d3674f019c300935bb84945a Sep 23 05:01:54.051816 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-VolumesActionsTest-969491916 Sep 23 05:01:54.051816 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-VolumesActionsTest-969491916-project Sep 23 05:01:54.051816 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 05:01:54.051816 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 05:01:54.051816 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: d1af38bb9e9a4cbab4a8935a01e7afba Sep 23 05:01:54.051816 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-VolumesActionsTest-969491916-project Sep 23 05:01:54.051816 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 05:01:54.051816 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance eb57fbfa-f7ab-482e-be43-d88659fc3063 could not be found. Sep 23 05:01:54.051816 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': 'eb57fbfa-f7ab-482e-be43-d88659fc3063'} Sep 23 05:01:54.051816 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:01:54.051816 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:01:54.051816 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 05:01:54.051816 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 05:01:54.051816 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 05:01:54.051816 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 05:01:54.051816 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 05:01:54.051816 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 05:01:54.051816 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 05:01:54.051816 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 05:01:54.051816 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb57fbfa-f7ab-482e-be43-d88659fc3063 could not be found. Sep 23 05:01:54.051816 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:01:54.051816 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:01:54.051816 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:01:54.051816 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:01:54.051816 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:01:54.051816 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:01:54.051816 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:01:54.051816 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:01:54.051816 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:01:54.051816 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:01:54.051816 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 05:01:54.051816 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 05:01:54.051816 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 05:01:54.051816 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 05:01:54.051816 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 05:01:54.051816 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:01:54.051816 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb57fbfa-f7ab-482e-be43-d88659fc3063 could not be found. Sep 23 05:01:54.051816 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:01:54.051816 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:01:54.051816 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:01:54.057590 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:01:54.057590 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:01:54.057590 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:01:54.057590 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:01:54.057590 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:01:54.057590 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb57fbfa-f7ab-482e-be43-d88659fc3063 could not be found. Sep 23 05:01:54.057590 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:01:54.062493 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b500c8a6-d007-47fd-8829-2d0f134828e4 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Returning 404 to user: Instance eb57fbfa-f7ab-482e-be43-d88659fc3063 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:01:54.063658 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b500c8a6-d007-47fd-8829-2d0f134828e4 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] 10.222.0.33 "GET /compute/v2.1/servers/eb57fbfa-f7ab-482e-be43-d88659fc3063" status: 404 len: 111 microversion: 2.1 time: 0.084121 Sep 23 05:01:54.067360 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3087/6010] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:01:53 2022] GET /compute/v2.1/servers/eb57fbfa-f7ab-482e-be43-d88659fc3063 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 05:01:54.113405 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-69cfba0f-ba78-443e-96db-17d7133c35ef tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:54.131645 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-69cfba0f-ba78-443e-96db-17d7133c35ef tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/7534fa45-8669-4295-b3c9-0d7478dd2eb8" status: 200 len: 1391 microversion: 2.1 time: 1.173916 Sep 23 05:01:54.133034 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2924/6011] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:01:52 2022] GET /compute/v2.1/servers/7534fa45-8669-4295-b3c9-0d7478dd2eb8 => generated 1391 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:01:54.257309 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b86a994d-0662-40bb-96d6-a4147489388d tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-987367232", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "networks": [{"uuid": "8fb59659-623a-4a6f-840a-5340bf4cbf4c"}]}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:01:54.361845 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6050be16-c2cb-40d1-95bb-0c5d8b42d2ff tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:54.362992 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-6050be16-c2cb-40d1-95bb-0c5d8b42d2ff tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] [instance: 190c8460-79bf-45a8-a441-75f8f05f713e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:54.385756 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.neutron [None req-b86a994d-0662-40bb-96d6-a4147489388d tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] validate_networks() for [('8fb59659-623a-4a6f-840a-5340bf4cbf4c', None, None, None, None, None)] {{(pid=122699) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 05:01:54.387363 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6050be16-c2cb-40d1-95bb-0c5d8b42d2ff tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:54.396810 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6050be16-c2cb-40d1-95bb-0c5d8b42d2ff tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:54.401191 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6050be16-c2cb-40d1-95bb-0c5d8b42d2ff tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:54.402178 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6050be16-c2cb-40d1-95bb-0c5d8b42d2ff tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:54.402777 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6050be16-c2cb-40d1-95bb-0c5d8b42d2ff tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:54.403620 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6050be16-c2cb-40d1-95bb-0c5d8b42d2ff tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:54.449788 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-6050be16-c2cb-40d1-95bb-0c5d8b42d2ff tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] HTTP exception thrown: Instance 190c8460-79bf-45a8-a441-75f8f05f713e could not be found. Sep 23 05:01:54.460496 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6050be16-c2cb-40d1-95bb-0c5d8b42d2ff tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Request method failure captured: Sep 23 05:01:54.460496 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/190c8460-79bf-45a8-a441-75f8f05f713e HTTP/1.1 Sep 23 05:01:54.460496 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 05:01:54.460496 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 05:01:54.460496 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 05:01:54.460496 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 05:01:54.460496 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 05:01:54.460496 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 05:01:54.460496 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 05:01:54.460496 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 05:01:54.460496 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLT2KUQxJHKE1DoozR_ohTZIBK3BGLJ6mMW9WQh78PG8tnrcO_YO9Pn7_ah7zcBTpPjmGBEYRH-xjPL-xCBbp_ggW5ogWHmAxuGrXNt9p7zZbTM5CaNLhiURUldeB7iM0sa7-Px4737XyQ4BOf8HOoV-yi4QK-2V39OFHJqBCs7k3ODc Sep 23 05:01:54.460496 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 05:01:54.460496 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 05:01:54.460496 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 05:01:54.460496 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 05:01:54.460496 n-d-846463-3 devstack@n-api.service[122698]: X-Openstack-Nova-Api-Version: 2.47 Sep 23 05:01:54.460496 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 05:01:54.460496 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 05:01:54.460496 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: ab29c0466c5b4c7f884ac227a88f0aea Sep 23 05:01:54.460496 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ServerShowV247Test-829986642 Sep 23 05:01:54.460496 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 05:01:54.460496 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 05:01:54.460496 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ab29c0466c5b4c7f884ac227a88f0aea", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ab29c0466c5b4c7f884ac227a88f0aea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ab29c0466c5b4c7f884ac227a88f0aea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ab29c0466c5b4c7f884ac227a88f0aea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:01:54.460496 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ServerShowV247Test-829986642 Sep 23 05:01:54.460496 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: ab29c0466c5b4c7f884ac227a88f0aea Sep 23 05:01:54.460496 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ServerShowV247Test-829986642 Sep 23 05:01:54.460496 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ServerShowV247Test-829986642-project Sep 23 05:01:54.460496 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 05:01:54.460496 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 05:01:54.460496 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: a3ee5406821b46e189d1cacd2124905f Sep 23 05:01:54.460496 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ServerShowV247Test-829986642-project Sep 23 05:01:54.460496 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 05:01:54.460496 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 190c8460-79bf-45a8-a441-75f8f05f713e could not be found. Sep 23 05:01:54.460496 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '190c8460-79bf-45a8-a441-75f8f05f713e'} Sep 23 05:01:54.460496 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:01:54.460496 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:01:54.460496 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 05:01:54.460496 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 05:01:54.460496 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 05:01:54.460496 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 05:01:54.460496 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 05:01:54.460496 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 05:01:54.460496 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 05:01:54.460496 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 05:01:54.460496 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 190c8460-79bf-45a8-a441-75f8f05f713e could not be found. Sep 23 05:01:54.460496 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:01:54.460496 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:01:54.460496 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:01:54.460496 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:01:54.460496 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:01:54.460496 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:01:54.460496 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:01:54.460496 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:01:54.460496 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:01:54.460496 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:01:54.460496 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 05:01:54.460496 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 05:01:54.460496 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 05:01:54.460496 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 05:01:54.460496 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 05:01:54.460496 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:01:54.460496 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 190c8460-79bf-45a8-a441-75f8f05f713e could not be found. Sep 23 05:01:54.460496 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:01:54.460496 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:01:54.460496 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:01:54.464762 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:01:54.464762 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:01:54.464762 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:01:54.464762 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:01:54.464762 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:01:54.464762 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 190c8460-79bf-45a8-a441-75f8f05f713e could not be found. Sep 23 05:01:54.464762 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:01:54.464762 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6050be16-c2cb-40d1-95bb-0c5d8b42d2ff tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Returning 404 to user: Instance 190c8460-79bf-45a8-a441-75f8f05f713e could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:01:54.464762 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-6050be16-c2cb-40d1-95bb-0c5d8b42d2ff tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] 10.222.0.33 "GET /compute/v2.1/servers/190c8460-79bf-45a8-a441-75f8f05f713e" status: 404 len: 111 microversion: 2.47 time: 0.109768 Sep 23 05:01:54.466442 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2925/6012] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 05:01:54 2022] GET /compute/v2.1/servers/190c8460-79bf-45a8-a441-75f8f05f713e => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 23 05:01:54.479712 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-43b8443a-7957-4e11-8f9f-6f27c30e7e9b tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:54.480522 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-43b8443a-7957-4e11-8f9f-6f27c30e7e9b tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] [instance: eee49fca-510f-4ede-bc22-f85973409489] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:54.491398 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-43b8443a-7957-4e11-8f9f-6f27c30e7e9b tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:54.497201 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-43b8443a-7957-4e11-8f9f-6f27c30e7e9b tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:54.497780 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-43b8443a-7957-4e11-8f9f-6f27c30e7e9b tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:54.498641 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-43b8443a-7957-4e11-8f9f-6f27c30e7e9b tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:54.499197 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-43b8443a-7957-4e11-8f9f-6f27c30e7e9b tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:54.499717 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-43b8443a-7957-4e11-8f9f-6f27c30e7e9b tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:54.569308 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-43b8443a-7957-4e11-8f9f-6f27c30e7e9b tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] [instance: eee49fca-510f-4ede-bc22-f85973409489] Going to try to terminate instance {{(pid=122698) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 05:01:54.577061 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:01:55.139307 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-43b8443a-7957-4e11-8f9f-6f27c30e7e9b tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] 10.222.0.33 "DELETE /compute/v2.1/servers/eee49fca-510f-4ede-bc22-f85973409489" status: 204 len: 0 microversion: 2.47 time: 0.669137 Sep 23 05:01:55.139990 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2926/6013] 10.222.0.33 () {60 vars in 1280 bytes} [Fri Sep 23 05:01:54 2022] DELETE /compute/v2.1/servers/eee49fca-510f-4ede-bc22-f85973409489 => generated 0 bytes in 672 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 23 05:01:55.152421 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e4596968-bf8d-4048-a211-3caa52af93a4 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:55.154342 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e4596968-bf8d-4048-a211-3caa52af93a4 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] [instance: eee49fca-510f-4ede-bc22-f85973409489] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:55.172074 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e4596968-bf8d-4048-a211-3caa52af93a4 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:55.174077 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e4596968-bf8d-4048-a211-3caa52af93a4 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:55.174564 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e4596968-bf8d-4048-a211-3caa52af93a4 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:55.176639 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e4596968-bf8d-4048-a211-3caa52af93a4 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:55.178323 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e4596968-bf8d-4048-a211-3caa52af93a4 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:55.180435 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e4596968-bf8d-4048-a211-3caa52af93a4 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:55.645659 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-b86a994d-0662-40bb-96d6-a4147489388d tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Flavor limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 05:01:55.646265 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-b86a994d-0662-40bb-96d6-a4147489388d tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Image limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 05:01:55.646788 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-b86a994d-0662-40bb-96d6-a4147489388d tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Flavor pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 05:01:55.647266 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-b86a994d-0662-40bb-96d6-a4147489388d tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Image pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 05:01:55.647805 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-b86a994d-0662-40bb-96d6-a4147489388d tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 05:01:55.668548 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b86a994d-0662-40bb-96d6-a4147489388d tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:55.669333 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b86a994d-0662-40bb-96d6-a4147489388d tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:55.670006 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b86a994d-0662-40bb-96d6-a4147489388d tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:55.670933 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b86a994d-0662-40bb-96d6-a4147489388d tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:55.671649 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b86a994d-0662-40bb-96d6-a4147489388d tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:55.672286 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b86a994d-0662-40bb-96d6-a4147489388d tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:55.731171 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-b86a994d-0662-40bb-96d6-a4147489388d tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Getting quotas for project da3327b2d3674f019c300935bb84945a. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 05:01:55.745436 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-b86a994d-0662-40bb-96d6-a4147489388d tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Getting quotas for user d1af38bb9e9a4cbab4a8935a01e7afba and project da3327b2d3674f019c300935bb84945a. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 05:01:55.769544 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e4596968-bf8d-4048-a211-3caa52af93a4 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:55.780256 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b86a994d-0662-40bb-96d6-a4147489388d tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Going to run 1 instances... {{(pid=122699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 05:01:55.783437 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e4596968-bf8d-4048-a211-3caa52af93a4 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:55.788872 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b86a994d-0662-40bb-96d6-a4147489388d tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] [instance: 3fb65df8-a1b0-423f-a64d-738fa779c7bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 05:01:55.791208 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e4596968-bf8d-4048-a211-3caa52af93a4 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:55.794917 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e4596968-bf8d-4048-a211-3caa52af93a4 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] 10.222.0.33 "GET /compute/v2.1/servers/eee49fca-510f-4ede-bc22-f85973409489" status: 200 len: 1362 microversion: 2.47 time: 0.650251 Sep 23 05:01:55.798768 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2927/6014] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 05:01:55 2022] GET /compute/v2.1/servers/eee49fca-510f-4ede-bc22-f85973409489 => generated 1362 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 05:01:55.814586 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a4b037d2-ae27-4e69-bd4a-8e9588505fa4 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:55.815420 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a4b037d2-ae27-4e69-bd4a-8e9588505fa4 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 7534fa45-8669-4295-b3c9-0d7478dd2eb8] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:55.830327 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a4b037d2-ae27-4e69-bd4a-8e9588505fa4 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:55.831271 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a4b037d2-ae27-4e69-bd4a-8e9588505fa4 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:55.833088 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a4b037d2-ae27-4e69-bd4a-8e9588505fa4 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:55.838520 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a4b037d2-ae27-4e69-bd4a-8e9588505fa4 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:55.840224 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a4b037d2-ae27-4e69-bd4a-8e9588505fa4 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:55.842637 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a4b037d2-ae27-4e69-bd4a-8e9588505fa4 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:55.992861 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b86a994d-0662-40bb-96d6-a4147489388d tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.753220 Sep 23 05:01:56.001938 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3088/6015] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 05:01:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1766 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 05:01:56.009353 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5f276b8a-a8ec-4346-8303-509a64eeac1a tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:56.025674 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-5f276b8a-a8ec-4346-8303-509a64eeac1a tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] [instance: 3fb65df8-a1b0-423f-a64d-738fa779c7bc] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:56.228159 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-5f276b8a-a8ec-4346-8303-509a64eeac1a tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1af38bb9e9a4cbab4a8935a01e7afba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da3327b2d3674f019c300935bb84945a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:56.247750 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5f276b8a-a8ec-4346-8303-509a64eeac1a tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] 10.222.0.33 "GET /compute/v2.1/servers/3fb65df8-a1b0-423f-a64d-738fa779c7bc" status: 200 len: 1213 microversion: 2.1 time: 0.244850 Sep 23 05:01:56.249112 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3089/6016] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:01:56 2022] GET /compute/v2.1/servers/3fb65df8-a1b0-423f-a64d-738fa779c7bc => generated 1213 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:01:56.499191 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a4b037d2-ae27-4e69-bd4a-8e9588505fa4 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:56.513876 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a4b037d2-ae27-4e69-bd4a-8e9588505fa4 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/7534fa45-8669-4295-b3c9-0d7478dd2eb8" status: 200 len: 1391 microversion: 2.1 time: 0.710709 Sep 23 05:01:56.514562 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2928/6017] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:01:55 2022] GET /compute/v2.1/servers/7534fa45-8669-4295-b3c9-0d7478dd2eb8 => generated 1391 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:01:56.836531 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c02f774d-c5b7-4e33-a55a-c0cea372f891 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:56.841126 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c02f774d-c5b7-4e33-a55a-c0cea372f891 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] [instance: eee49fca-510f-4ede-bc22-f85973409489] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:56.905240 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c02f774d-c5b7-4e33-a55a-c0cea372f891 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:56.917720 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c02f774d-c5b7-4e33-a55a-c0cea372f891 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:56.919236 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c02f774d-c5b7-4e33-a55a-c0cea372f891 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:56.930195 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c02f774d-c5b7-4e33-a55a-c0cea372f891 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:56.939992 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c02f774d-c5b7-4e33-a55a-c0cea372f891 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:56.941708 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c02f774d-c5b7-4e33-a55a-c0cea372f891 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:57.163334 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c02f774d-c5b7-4e33-a55a-c0cea372f891 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:57.177561 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c02f774d-c5b7-4e33-a55a-c0cea372f891 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:57.180667 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c02f774d-c5b7-4e33-a55a-c0cea372f891 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3ee5406821b46e189d1cacd2124905f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab29c0466c5b4c7f884ac227a88f0aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:57.183310 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c02f774d-c5b7-4e33-a55a-c0cea372f891 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] 10.222.0.33 "GET /compute/v2.1/servers/eee49fca-510f-4ede-bc22-f85973409489" status: 200 len: 1362 microversion: 2.47 time: 0.354189 Sep 23 05:01:57.184506 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3090/6018] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 05:01:56 2022] GET /compute/v2.1/servers/eee49fca-510f-4ede-bc22-f85973409489 => generated 1362 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 05:01:57.274034 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d616e938-3698-4c21-926b-75b5201e7301 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:57.274730 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d616e938-3698-4c21-926b-75b5201e7301 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] [instance: 3fb65df8-a1b0-423f-a64d-738fa779c7bc] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:57.314534 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-b478ab57-5708-442a-8d7f-a9e5652144ad req-0e066e91-41d3-4a9d-bd44-eb3503b0d751 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7534fa45-8669-4295-b3c9-0d7478dd2eb8", "name": "network-vif-plugged", "status": "completed", "tag": "1be06b6d-5ecd-4f40-ad6a-3263a045a87c"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:01:57.326876 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-b478ab57-5708-442a-8d7f-a9e5652144ad req-0e066e91-41d3-4a9d-bd44-eb3503b0d751 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:57.327649 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-b478ab57-5708-442a-8d7f-a9e5652144ad req-0e066e91-41d3-4a9d-bd44-eb3503b0d751 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:57.328346 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-b478ab57-5708-442a-8d7f-a9e5652144ad req-0e066e91-41d3-4a9d-bd44-eb3503b0d751 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:57.340751 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-b478ab57-5708-442a-8d7f-a9e5652144ad req-0e066e91-41d3-4a9d-bd44-eb3503b0d751 service nova] Creating event network-vif-plugged:1be06b6d-5ecd-4f40-ad6a-3263a045a87c for instance 7534fa45-8669-4295-b3c9-0d7478dd2eb8 on n-h1-846463-3 Sep 23 05:01:57.346093 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-b478ab57-5708-442a-8d7f-a9e5652144ad req-0e066e91-41d3-4a9d-bd44-eb3503b0d751 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.329363 Sep 23 05:01:57.346785 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2929/6019] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:01:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 05:01:57.351912 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d616e938-3698-4c21-926b-75b5201e7301 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1af38bb9e9a4cbab4a8935a01e7afba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da3327b2d3674f019c300935bb84945a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:57.359894 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d616e938-3698-4c21-926b-75b5201e7301 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] 10.222.0.33 "GET /compute/v2.1/servers/3fb65df8-a1b0-423f-a64d-738fa779c7bc" status: 200 len: 1213 microversion: 2.1 time: 0.091325 Sep 23 05:01:57.374379 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3091/6020] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:01:57 2022] GET /compute/v2.1/servers/3fb65df8-a1b0-423f-a64d-738fa779c7bc => generated 1213 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:01:57.537079 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6b20e00a-2b5f-4c5a-9227-bc8a6e0a9aac tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:57.537807 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-6b20e00a-2b5f-4c5a-9227-bc8a6e0a9aac tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 7534fa45-8669-4295-b3c9-0d7478dd2eb8] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:57.543975 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6b20e00a-2b5f-4c5a-9227-bc8a6e0a9aac tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:57.544459 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6b20e00a-2b5f-4c5a-9227-bc8a6e0a9aac tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:57.544897 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6b20e00a-2b5f-4c5a-9227-bc8a6e0a9aac tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:57.545586 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6b20e00a-2b5f-4c5a-9227-bc8a6e0a9aac tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:57.546096 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6b20e00a-2b5f-4c5a-9227-bc8a6e0a9aac tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:57.546525 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6b20e00a-2b5f-4c5a-9227-bc8a6e0a9aac tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:57.688429 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6b20e00a-2b5f-4c5a-9227-bc8a6e0a9aac tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:57.712234 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-6b20e00a-2b5f-4c5a-9227-bc8a6e0a9aac tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/7534fa45-8669-4295-b3c9-0d7478dd2eb8" status: 200 len: 1391 microversion: 2.1 time: 0.179291 Sep 23 05:01:57.712831 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2930/6021] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:01:57 2022] GET /compute/v2.1/servers/7534fa45-8669-4295-b3c9-0d7478dd2eb8 => generated 1391 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:01:58.214526 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d4bb365f-b65d-4e13-971c-55c957d14c35 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:58.222206 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d4bb365f-b65d-4e13-971c-55c957d14c35 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] [instance: eee49fca-510f-4ede-bc22-f85973409489] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:58.233484 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d4bb365f-b65d-4e13-971c-55c957d14c35 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:58.234179 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d4bb365f-b65d-4e13-971c-55c957d14c35 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:58.235124 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d4bb365f-b65d-4e13-971c-55c957d14c35 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:58.235493 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d4bb365f-b65d-4e13-971c-55c957d14c35 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:58.236035 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d4bb365f-b65d-4e13-971c-55c957d14c35 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:58.236536 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d4bb365f-b65d-4e13-971c-55c957d14c35 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:58.256894 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-d4bb365f-b65d-4e13-971c-55c957d14c35 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] HTTP exception thrown: Instance eee49fca-510f-4ede-bc22-f85973409489 could not be found. Sep 23 05:01:58.260338 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d4bb365f-b65d-4e13-971c-55c957d14c35 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Request method failure captured: Sep 23 05:01:58.260338 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/eee49fca-510f-4ede-bc22-f85973409489 HTTP/1.1 Sep 23 05:01:58.260338 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 05:01:58.260338 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 05:01:58.260338 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 05:01:58.260338 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 05:01:58.260338 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 05:01:58.260338 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 05:01:58.260338 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 05:01:58.260338 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 05:01:58.260338 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLT2KUQxJHKE1DoozR_ohTZIBK3BGLJ6mMW9WQh78PG8tnrcO_YO9Pn7_ah7zcBTpPjmGBEYRH-xjPL-xCBbp_ggW5ogWHmAxuGrXNt9p7zZbTM5CaNLhiURUldeB7iM0sa7-Px4737XyQ4BOf8HOoV-yi4QK-2V39OFHJqBCs7k3ODc Sep 23 05:01:58.260338 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 05:01:58.260338 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 05:01:58.260338 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 05:01:58.260338 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 05:01:58.260338 n-d-846463-3 devstack@n-api.service[122699]: X-Openstack-Nova-Api-Version: 2.47 Sep 23 05:01:58.260338 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 05:01:58.260338 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 05:01:58.260338 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: ab29c0466c5b4c7f884ac227a88f0aea Sep 23 05:01:58.260338 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ServerShowV247Test-829986642 Sep 23 05:01:58.260338 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 05:01:58.260338 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 05:01:58.260338 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ab29c0466c5b4c7f884ac227a88f0aea", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ab29c0466c5b4c7f884ac227a88f0aea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ab29c0466c5b4c7f884ac227a88f0aea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ab29c0466c5b4c7f884ac227a88f0aea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:01:58.260338 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ServerShowV247Test-829986642 Sep 23 05:01:58.260338 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: ab29c0466c5b4c7f884ac227a88f0aea Sep 23 05:01:58.260338 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ServerShowV247Test-829986642 Sep 23 05:01:58.260338 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ServerShowV247Test-829986642-project Sep 23 05:01:58.260338 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 05:01:58.260338 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 05:01:58.260338 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: a3ee5406821b46e189d1cacd2124905f Sep 23 05:01:58.260338 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ServerShowV247Test-829986642-project Sep 23 05:01:58.260338 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 05:01:58.260338 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance eee49fca-510f-4ede-bc22-f85973409489 could not be found. Sep 23 05:01:58.260338 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': 'eee49fca-510f-4ede-bc22-f85973409489'} Sep 23 05:01:58.260338 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:01:58.260338 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:01:58.260338 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 05:01:58.260338 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 05:01:58.260338 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 05:01:58.260338 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 05:01:58.260338 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 05:01:58.260338 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 05:01:58.260338 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 05:01:58.260338 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 05:01:58.260338 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eee49fca-510f-4ede-bc22-f85973409489 could not be found. Sep 23 05:01:58.260338 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:01:58.260338 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:01:58.260338 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:01:58.260338 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:01:58.260338 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:01:58.260338 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:01:58.260338 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:01:58.260338 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:01:58.260338 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:01:58.260338 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:01:58.260338 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 05:01:58.260338 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 05:01:58.260338 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 05:01:58.260338 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 05:01:58.260338 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 05:01:58.260338 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:01:58.260338 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eee49fca-510f-4ede-bc22-f85973409489 could not be found. Sep 23 05:01:58.260338 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:01:58.260338 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:01:58.260338 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:01:58.267731 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:01:58.267731 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:01:58.267731 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:01:58.267731 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:01:58.267731 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:01:58.267731 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eee49fca-510f-4ede-bc22-f85973409489 could not be found. Sep 23 05:01:58.267731 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:01:58.267731 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d4bb365f-b65d-4e13-971c-55c957d14c35 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] Returning 404 to user: Instance eee49fca-510f-4ede-bc22-f85973409489 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:01:58.267731 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d4bb365f-b65d-4e13-971c-55c957d14c35 tempest-ServerShowV247Test-829986642 tempest-ServerShowV247Test-829986642-project] 10.222.0.33 "GET /compute/v2.1/servers/eee49fca-510f-4ede-bc22-f85973409489" status: 404 len: 111 microversion: 2.47 time: 0.052127 Sep 23 05:01:58.267731 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3092/6022] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Sep 23 05:01:58 2022] GET /compute/v2.1/servers/eee49fca-510f-4ede-bc22-f85973409489 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 23 05:01:58.396383 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2a11571f-0818-4c58-8d22-51529e433100 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:58.396383 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-2a11571f-0818-4c58-8d22-51529e433100 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] [instance: 3fb65df8-a1b0-423f-a64d-738fa779c7bc] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:58.399654 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2a11571f-0818-4c58-8d22-51529e433100 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:58.400152 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2a11571f-0818-4c58-8d22-51529e433100 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:58.400612 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2a11571f-0818-4c58-8d22-51529e433100 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:58.401332 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2a11571f-0818-4c58-8d22-51529e433100 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:58.401789 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2a11571f-0818-4c58-8d22-51529e433100 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:58.402439 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2a11571f-0818-4c58-8d22-51529e433100 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:58.469914 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-2a11571f-0818-4c58-8d22-51529e433100 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1af38bb9e9a4cbab4a8935a01e7afba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da3327b2d3674f019c300935bb84945a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:58.510135 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2a11571f-0818-4c58-8d22-51529e433100 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] 10.222.0.33 "GET /compute/v2.1/servers/3fb65df8-a1b0-423f-a64d-738fa779c7bc" status: 200 len: 1209 microversion: 2.1 time: 0.124812 Sep 23 05:01:58.510135 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2931/6023] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:01:58 2022] GET /compute/v2.1/servers/3fb65df8-a1b0-423f-a64d-738fa779c7bc => generated 1209 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:01:58.736572 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2eda83ba-b8d5-4fdf-b5ed-b06f231939b6 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:58.737359 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-2eda83ba-b8d5-4fdf-b5ed-b06f231939b6 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 7534fa45-8669-4295-b3c9-0d7478dd2eb8] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:58.744226 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2eda83ba-b8d5-4fdf-b5ed-b06f231939b6 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:58.744729 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2eda83ba-b8d5-4fdf-b5ed-b06f231939b6 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:58.745181 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2eda83ba-b8d5-4fdf-b5ed-b06f231939b6 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:58.745989 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2eda83ba-b8d5-4fdf-b5ed-b06f231939b6 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:58.746666 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2eda83ba-b8d5-4fdf-b5ed-b06f231939b6 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:58.747103 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2eda83ba-b8d5-4fdf-b5ed-b06f231939b6 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:58.942564 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2eda83ba-b8d5-4fdf-b5ed-b06f231939b6 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:58.954574 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2eda83ba-b8d5-4fdf-b5ed-b06f231939b6 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/7534fa45-8669-4295-b3c9-0d7478dd2eb8" status: 200 len: 1391 microversion: 2.1 time: 0.221946 Sep 23 05:01:58.955175 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3093/6024] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:01:58 2022] GET /compute/v2.1/servers/7534fa45-8669-4295-b3c9-0d7478dd2eb8 => generated 1391 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:01:59.533104 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-85dc568a-200b-4090-ac4a-41525a148ebe tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:59.533845 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-85dc568a-200b-4090-ac4a-41525a148ebe tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] [instance: 3fb65df8-a1b0-423f-a64d-738fa779c7bc] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:59.546981 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-85dc568a-200b-4090-ac4a-41525a148ebe tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:59.552395 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-85dc568a-200b-4090-ac4a-41525a148ebe tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:59.557022 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-85dc568a-200b-4090-ac4a-41525a148ebe tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:59.557802 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-85dc568a-200b-4090-ac4a-41525a148ebe tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:59.558382 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-85dc568a-200b-4090-ac4a-41525a148ebe tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:59.558824 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-85dc568a-200b-4090-ac4a-41525a148ebe tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:59.634536 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-85dc568a-200b-4090-ac4a-41525a148ebe tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1af38bb9e9a4cbab4a8935a01e7afba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da3327b2d3674f019c300935bb84945a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:01:59.644470 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-85dc568a-200b-4090-ac4a-41525a148ebe tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] 10.222.0.33 "GET /compute/v2.1/servers/3fb65df8-a1b0-423f-a64d-738fa779c7bc" status: 200 len: 1273 microversion: 2.1 time: 0.115253 Sep 23 05:01:59.646316 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2932/6025] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:01:59 2022] GET /compute/v2.1/servers/3fb65df8-a1b0-423f-a64d-738fa779c7bc => generated 1273 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:01:59.978721 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a759c99e-f4bd-4fc4-81b9-dd3f1beab0c2 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:01:59.979337 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a759c99e-f4bd-4fc4-81b9-dd3f1beab0c2 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 7534fa45-8669-4295-b3c9-0d7478dd2eb8] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:01:59.985347 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:01:59.990451 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a759c99e-f4bd-4fc4-81b9-dd3f1beab0c2 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:59.990961 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a759c99e-f4bd-4fc4-81b9-dd3f1beab0c2 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:59.991534 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a759c99e-f4bd-4fc4-81b9-dd3f1beab0c2 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:01:59.992330 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a759c99e-f4bd-4fc4-81b9-dd3f1beab0c2 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:01:59.992835 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a759c99e-f4bd-4fc4-81b9-dd3f1beab0c2 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:01:59.993266 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a759c99e-f4bd-4fc4-81b9-dd3f1beab0c2 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:00.164123 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a759c99e-f4bd-4fc4-81b9-dd3f1beab0c2 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:02:00.175208 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a759c99e-f4bd-4fc4-81b9-dd3f1beab0c2 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/7534fa45-8669-4295-b3c9-0d7478dd2eb8" status: 200 len: 1564 microversion: 2.1 time: 0.200204 Sep 23 05:02:00.191687 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3094/6026] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:01:59 2022] GET /compute/v2.1/servers/7534fa45-8669-4295-b3c9-0d7478dd2eb8 => generated 1564 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:02:00.204673 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-92948a98-0f11-40d2-9dd3-c0b44a5a14dd tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:02:00.205418 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-92948a98-0f11-40d2-9dd3-c0b44a5a14dd tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 7534fa45-8669-4295-b3c9-0d7478dd2eb8] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:02:00.213544 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-92948a98-0f11-40d2-9dd3-c0b44a5a14dd tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:00.215349 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-92948a98-0f11-40d2-9dd3-c0b44a5a14dd tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:00.215349 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-92948a98-0f11-40d2-9dd3-c0b44a5a14dd tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:00.215924 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-92948a98-0f11-40d2-9dd3-c0b44a5a14dd tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:00.216562 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-92948a98-0f11-40d2-9dd3-c0b44a5a14dd tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:00.217163 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-92948a98-0f11-40d2-9dd3-c0b44a5a14dd tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:00.416055 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-92948a98-0f11-40d2-9dd3-c0b44a5a14dd tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:02:00.427423 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-92948a98-0f11-40d2-9dd3-c0b44a5a14dd tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/7534fa45-8669-4295-b3c9-0d7478dd2eb8" status: 200 len: 1564 microversion: 2.1 time: 0.227515 Sep 23 05:02:00.428766 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2933/6027] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:02:00 2022] GET /compute/v2.1/servers/7534fa45-8669-4295-b3c9-0d7478dd2eb8 => generated 1564 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:02:00.675870 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-23dc7b5b-8ad2-41ec-ad36-5d6b1bc4b37c tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:02:00.675870 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-23dc7b5b-8ad2-41ec-ad36-5d6b1bc4b37c tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] [instance: 3fb65df8-a1b0-423f-a64d-738fa779c7bc] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:02:00.679760 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-23dc7b5b-8ad2-41ec-ad36-5d6b1bc4b37c tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:00.683096 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-23dc7b5b-8ad2-41ec-ad36-5d6b1bc4b37c tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:00.683635 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-23dc7b5b-8ad2-41ec-ad36-5d6b1bc4b37c tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:00.685029 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-23dc7b5b-8ad2-41ec-ad36-5d6b1bc4b37c tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:00.685686 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-23dc7b5b-8ad2-41ec-ad36-5d6b1bc4b37c tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:00.687331 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-23dc7b5b-8ad2-41ec-ad36-5d6b1bc4b37c tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:00.943276 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-23dc7b5b-8ad2-41ec-ad36-5d6b1bc4b37c tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1af38bb9e9a4cbab4a8935a01e7afba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da3327b2d3674f019c300935bb84945a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:02:00.951533 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-23dc7b5b-8ad2-41ec-ad36-5d6b1bc4b37c tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] 10.222.0.33 "GET /compute/v2.1/servers/3fb65df8-a1b0-423f-a64d-738fa779c7bc" status: 200 len: 1313 microversion: 2.1 time: 0.286616 Sep 23 05:02:00.952124 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3095/6028] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:02:00 2022] GET /compute/v2.1/servers/3fb65df8-a1b0-423f-a64d-738fa779c7bc => generated 1313 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:02:01.976872 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f995f876-73d3-4519-9130-4aa47291deb5 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:02:01.977497 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f995f876-73d3-4519-9130-4aa47291deb5 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] [instance: 3fb65df8-a1b0-423f-a64d-738fa779c7bc] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:02:01.990539 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f995f876-73d3-4519-9130-4aa47291deb5 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:01.995144 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f995f876-73d3-4519-9130-4aa47291deb5 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:01.999164 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f995f876-73d3-4519-9130-4aa47291deb5 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:01.999164 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f995f876-73d3-4519-9130-4aa47291deb5 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:01.999164 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f995f876-73d3-4519-9130-4aa47291deb5 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:02.001262 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f995f876-73d3-4519-9130-4aa47291deb5 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:02.257687 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-60921314-884e-4b5f-9f60-ff0d2f620355 req-35afea7b-dddf-4f3b-a2b6-1bc04fecb5e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fb65df8-a1b0-423f-a64d-738fa779c7bc", "tag": "ab5cf1de-8ff0-4466-99f4-47d3f42f45bb"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:02:02.268467 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-60921314-884e-4b5f-9f60-ff0d2f620355 req-35afea7b-dddf-4f3b-a2b6-1bc04fecb5e0 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:02.268996 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-60921314-884e-4b5f-9f60-ff0d2f620355 req-35afea7b-dddf-4f3b-a2b6-1bc04fecb5e0 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:02.269476 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-60921314-884e-4b5f-9f60-ff0d2f620355 req-35afea7b-dddf-4f3b-a2b6-1bc04fecb5e0 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:02.302018 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-60921314-884e-4b5f-9f60-ff0d2f620355 req-35afea7b-dddf-4f3b-a2b6-1bc04fecb5e0 service nova] Creating event network-changed:ab5cf1de-8ff0-4466-99f4-47d3f42f45bb for instance 3fb65df8-a1b0-423f-a64d-738fa779c7bc on n-h1-846463-3 Sep 23 05:02:02.309448 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-60921314-884e-4b5f-9f60-ff0d2f620355 req-35afea7b-dddf-4f3b-a2b6-1bc04fecb5e0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055372 Sep 23 05:02:02.311132 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3096/6029] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:02:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 05:02:02.337845 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f995f876-73d3-4519-9130-4aa47291deb5 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1af38bb9e9a4cbab4a8935a01e7afba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da3327b2d3674f019c300935bb84945a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:02:02.353829 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f995f876-73d3-4519-9130-4aa47291deb5 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] 10.222.0.33 "GET /compute/v2.1/servers/3fb65df8-a1b0-423f-a64d-738fa779c7bc" status: 200 len: 1313 microversion: 2.1 time: 0.382215 Sep 23 05:02:02.354997 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2934/6030] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:02:01 2022] GET /compute/v2.1/servers/3fb65df8-a1b0-423f-a64d-738fa779c7bc => generated 1313 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:02:03.383377 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a0711161-3a62-4604-b1a6-33eb0cc48f37 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:02:03.385833 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a0711161-3a62-4604-b1a6-33eb0cc48f37 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] [instance: 3fb65df8-a1b0-423f-a64d-738fa779c7bc] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:02:03.420675 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a0711161-3a62-4604-b1a6-33eb0cc48f37 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:03.423967 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a0711161-3a62-4604-b1a6-33eb0cc48f37 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:03.432301 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a0711161-3a62-4604-b1a6-33eb0cc48f37 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:03.435086 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a0711161-3a62-4604-b1a6-33eb0cc48f37 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:03.443154 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a0711161-3a62-4604-b1a6-33eb0cc48f37 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:03.443154 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a0711161-3a62-4604-b1a6-33eb0cc48f37 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:03.638247 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-05303015-be13-4ec1-8ac3-12e7367bb742 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:02:03.639781 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-05303015-be13-4ec1-8ac3-12e7367bb742 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 7534fa45-8669-4295-b3c9-0d7478dd2eb8] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:02:03.654719 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-05303015-be13-4ec1-8ac3-12e7367bb742 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:03.655467 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-05303015-be13-4ec1-8ac3-12e7367bb742 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:03.657706 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-05303015-be13-4ec1-8ac3-12e7367bb742 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:03.658828 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-05303015-be13-4ec1-8ac3-12e7367bb742 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:03.661235 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-05303015-be13-4ec1-8ac3-12e7367bb742 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:03.661692 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-05303015-be13-4ec1-8ac3-12e7367bb742 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:03.820151 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a0711161-3a62-4604-b1a6-33eb0cc48f37 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1af38bb9e9a4cbab4a8935a01e7afba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da3327b2d3674f019c300935bb84945a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:02:03.834374 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a0711161-3a62-4604-b1a6-33eb0cc48f37 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] 10.222.0.33 "GET /compute/v2.1/servers/3fb65df8-a1b0-423f-a64d-738fa779c7bc" status: 200 len: 1313 microversion: 2.1 time: 0.459108 Sep 23 05:02:03.850075 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3097/6031] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:02:03 2022] GET /compute/v2.1/servers/3fb65df8-a1b0-423f-a64d-738fa779c7bc => generated 1313 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:02:03.904625 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-05303015-be13-4ec1-8ac3-12e7367bb742 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:02:03.921811 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-05303015-be13-4ec1-8ac3-12e7367bb742 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/7534fa45-8669-4295-b3c9-0d7478dd2eb8" status: 200 len: 1564 microversion: 2.1 time: 0.290084 Sep 23 05:02:03.922749 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2935/6032] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:02:03 2022] GET /compute/v2.1/servers/7534fa45-8669-4295-b3c9-0d7478dd2eb8 => generated 1564 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:02:04.264985 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-07860b8d-5e20-4f03-a590-90663f5fc68b req-20b32fd7-846e-47b0-a61e-88b731bcb7c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7534fa45-8669-4295-b3c9-0d7478dd2eb8", "tag": "1be06b6d-5ecd-4f40-ad6a-3263a045a87c"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:02:04.284482 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-07860b8d-5e20-4f03-a590-90663f5fc68b req-20b32fd7-846e-47b0-a61e-88b731bcb7c8 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:04.285237 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-07860b8d-5e20-4f03-a590-90663f5fc68b req-20b32fd7-846e-47b0-a61e-88b731bcb7c8 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:04.285835 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-07860b8d-5e20-4f03-a590-90663f5fc68b req-20b32fd7-846e-47b0-a61e-88b731bcb7c8 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:04.332820 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-07860b8d-5e20-4f03-a590-90663f5fc68b req-20b32fd7-846e-47b0-a61e-88b731bcb7c8 service nova] Creating event network-changed:1be06b6d-5ecd-4f40-ad6a-3263a045a87c for instance 7534fa45-8669-4295-b3c9-0d7478dd2eb8 on n-h1-846463-3 Sep 23 05:02:04.362888 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-07860b8d-5e20-4f03-a590-90663f5fc68b req-20b32fd7-846e-47b0-a61e-88b731bcb7c8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.511224 Sep 23 05:02:04.366810 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3098/6033] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:02:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:02:04.874136 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d66199a0-cebe-48a5-83d8-fb161dd30996 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:02:04.874136 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d66199a0-cebe-48a5-83d8-fb161dd30996 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] [instance: 3fb65df8-a1b0-423f-a64d-738fa779c7bc] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:02:04.882996 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:02:04.884817 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d66199a0-cebe-48a5-83d8-fb161dd30996 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:04.885992 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d66199a0-cebe-48a5-83d8-fb161dd30996 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:04.886711 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d66199a0-cebe-48a5-83d8-fb161dd30996 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:04.887641 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d66199a0-cebe-48a5-83d8-fb161dd30996 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:04.888221 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d66199a0-cebe-48a5-83d8-fb161dd30996 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:04.888888 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d66199a0-cebe-48a5-83d8-fb161dd30996 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:05.181461 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d66199a0-cebe-48a5-83d8-fb161dd30996 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1af38bb9e9a4cbab4a8935a01e7afba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da3327b2d3674f019c300935bb84945a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:02:05.194135 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d66199a0-cebe-48a5-83d8-fb161dd30996 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] 10.222.0.33 "GET /compute/v2.1/servers/3fb65df8-a1b0-423f-a64d-738fa779c7bc" status: 200 len: 1313 microversion: 2.1 time: 0.333036 Sep 23 05:02:05.194726 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2936/6034] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:02:04 2022] GET /compute/v2.1/servers/3fb65df8-a1b0-423f-a64d-738fa779c7bc => generated 1313 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:02:06.217826 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=4 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:02:06.224674 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-87a9f859-30ec-4a95-8614-1bd1e94cf80c tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:02:06.225769 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-87a9f859-30ec-4a95-8614-1bd1e94cf80c tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] [instance: 3fb65df8-a1b0-423f-a64d-738fa779c7bc] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:02:06.245749 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-87a9f859-30ec-4a95-8614-1bd1e94cf80c tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:06.262236 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-87a9f859-30ec-4a95-8614-1bd1e94cf80c tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:06.263369 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-87a9f859-30ec-4a95-8614-1bd1e94cf80c tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:06.264669 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-87a9f859-30ec-4a95-8614-1bd1e94cf80c tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:06.266133 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-87a9f859-30ec-4a95-8614-1bd1e94cf80c tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:06.267171 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-87a9f859-30ec-4a95-8614-1bd1e94cf80c tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:06.520451 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-87a9f859-30ec-4a95-8614-1bd1e94cf80c tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1af38bb9e9a4cbab4a8935a01e7afba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da3327b2d3674f019c300935bb84945a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:02:06.533512 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-87a9f859-30ec-4a95-8614-1bd1e94cf80c tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] 10.222.0.33 "GET /compute/v2.1/servers/3fb65df8-a1b0-423f-a64d-738fa779c7bc" status: 200 len: 1313 microversion: 2.1 time: 0.320245 Sep 23 05:02:06.551608 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3099/6035] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:02:06 2022] GET /compute/v2.1/servers/3fb65df8-a1b0-423f-a64d-738fa779c7bc => generated 1313 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:02:07.579997 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0dd82526-709e-4875-8e41-382fd2408e98 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:02:07.580657 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-0dd82526-709e-4875-8e41-382fd2408e98 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] [instance: 3fb65df8-a1b0-423f-a64d-738fa779c7bc] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:02:07.593861 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0dd82526-709e-4875-8e41-382fd2408e98 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:07.594253 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0dd82526-709e-4875-8e41-382fd2408e98 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:07.595002 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0dd82526-709e-4875-8e41-382fd2408e98 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:07.595802 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0dd82526-709e-4875-8e41-382fd2408e98 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:07.596663 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0dd82526-709e-4875-8e41-382fd2408e98 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:07.597280 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0dd82526-709e-4875-8e41-382fd2408e98 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:07.810835 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-0dd82526-709e-4875-8e41-382fd2408e98 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1af38bb9e9a4cbab4a8935a01e7afba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da3327b2d3674f019c300935bb84945a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:02:07.820240 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0dd82526-709e-4875-8e41-382fd2408e98 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] 10.222.0.33 "GET /compute/v2.1/servers/3fb65df8-a1b0-423f-a64d-738fa779c7bc" status: 200 len: 1313 microversion: 2.1 time: 0.244122 Sep 23 05:02:07.823889 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2937/6036] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:02:07 2022] GET /compute/v2.1/servers/3fb65df8-a1b0-423f-a64d-738fa779c7bc => generated 1313 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:02:08.850539 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-80d93e89-5dd2-4b89-823c-9a0ed3977009 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:02:08.851079 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-80d93e89-5dd2-4b89-823c-9a0ed3977009 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] [instance: 3fb65df8-a1b0-423f-a64d-738fa779c7bc] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:02:08.859883 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=12 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:02:08.863592 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-80d93e89-5dd2-4b89-823c-9a0ed3977009 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:08.864812 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-80d93e89-5dd2-4b89-823c-9a0ed3977009 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:08.865427 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-80d93e89-5dd2-4b89-823c-9a0ed3977009 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:08.866557 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-80d93e89-5dd2-4b89-823c-9a0ed3977009 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:08.867190 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-80d93e89-5dd2-4b89-823c-9a0ed3977009 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:08.867782 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-80d93e89-5dd2-4b89-823c-9a0ed3977009 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:09.334708 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-2c7f85e2-7431-4904-af8c-3a03c1a7d818 req-afc53ebf-b1b2-4277-b924-dd166cd56604 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fb65df8-a1b0-423f-a64d-738fa779c7bc", "name": "network-vif-plugged", "status": "completed", "tag": "ab5cf1de-8ff0-4466-99f4-47d3f42f45bb"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:02:09.382120 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-2c7f85e2-7431-4904-af8c-3a03c1a7d818 req-afc53ebf-b1b2-4277-b924-dd166cd56604 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:09.383747 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-2c7f85e2-7431-4904-af8c-3a03c1a7d818 req-afc53ebf-b1b2-4277-b924-dd166cd56604 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:09.384944 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-2c7f85e2-7431-4904-af8c-3a03c1a7d818 req-afc53ebf-b1b2-4277-b924-dd166cd56604 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:09.415246 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-2c7f85e2-7431-4904-af8c-3a03c1a7d818 req-afc53ebf-b1b2-4277-b924-dd166cd56604 service nova] Creating event network-vif-plugged:ab5cf1de-8ff0-4466-99f4-47d3f42f45bb for instance 3fb65df8-a1b0-423f-a64d-738fa779c7bc on n-h1-846463-3 Sep 23 05:02:09.431757 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-2c7f85e2-7431-4904-af8c-3a03c1a7d818 req-afc53ebf-b1b2-4277-b924-dd166cd56604 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107008 Sep 23 05:02:09.432978 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2938/6037] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:02:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 05:02:09.742181 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-80d93e89-5dd2-4b89-823c-9a0ed3977009 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1af38bb9e9a4cbab4a8935a01e7afba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da3327b2d3674f019c300935bb84945a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:02:09.755154 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-80d93e89-5dd2-4b89-823c-9a0ed3977009 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] 10.222.0.33 "GET /compute/v2.1/servers/3fb65df8-a1b0-423f-a64d-738fa779c7bc" status: 200 len: 1313 microversion: 2.1 time: 0.908903 Sep 23 05:02:09.758944 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3100/6038] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:02:08 2022] GET /compute/v2.1/servers/3fb65df8-a1b0-423f-a64d-738fa779c7bc => generated 1313 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:02:10.790321 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-373bb60b-81d8-406f-a0fc-c4819b1d1dbe tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:02:10.794944 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-373bb60b-81d8-406f-a0fc-c4819b1d1dbe tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] [instance: 3fb65df8-a1b0-423f-a64d-738fa779c7bc] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:02:10.821639 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-373bb60b-81d8-406f-a0fc-c4819b1d1dbe tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:10.822183 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-373bb60b-81d8-406f-a0fc-c4819b1d1dbe tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:10.822640 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-373bb60b-81d8-406f-a0fc-c4819b1d1dbe tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:10.838893 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-373bb60b-81d8-406f-a0fc-c4819b1d1dbe tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:10.863422 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-373bb60b-81d8-406f-a0fc-c4819b1d1dbe tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:10.863422 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-373bb60b-81d8-406f-a0fc-c4819b1d1dbe tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:11.476302 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-373bb60b-81d8-406f-a0fc-c4819b1d1dbe tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1af38bb9e9a4cbab4a8935a01e7afba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da3327b2d3674f019c300935bb84945a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:02:11.492616 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-373bb60b-81d8-406f-a0fc-c4819b1d1dbe tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] 10.222.0.33 "GET /compute/v2.1/servers/3fb65df8-a1b0-423f-a64d-738fa779c7bc" status: 200 len: 1313 microversion: 2.1 time: 0.706672 Sep 23 05:02:11.499035 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2939/6039] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:02:10 2022] GET /compute/v2.1/servers/3fb65df8-a1b0-423f-a64d-738fa779c7bc => generated 1313 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:02:12.542698 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4013da1a-d2c1-454f-918e-97371e06d533 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:02:12.543334 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4013da1a-d2c1-454f-918e-97371e06d533 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] [instance: 3fb65df8-a1b0-423f-a64d-738fa779c7bc] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:02:12.584385 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4013da1a-d2c1-454f-918e-97371e06d533 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:12.584892 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4013da1a-d2c1-454f-918e-97371e06d533 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:12.605436 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4013da1a-d2c1-454f-918e-97371e06d533 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:12.606405 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4013da1a-d2c1-454f-918e-97371e06d533 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:12.606744 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4013da1a-d2c1-454f-918e-97371e06d533 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:12.607182 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4013da1a-d2c1-454f-918e-97371e06d533 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:13.029685 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-4013da1a-d2c1-454f-918e-97371e06d533 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1af38bb9e9a4cbab4a8935a01e7afba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da3327b2d3674f019c300935bb84945a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:02:13.042338 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4013da1a-d2c1-454f-918e-97371e06d533 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] 10.222.0.33 "GET /compute/v2.1/servers/3fb65df8-a1b0-423f-a64d-738fa779c7bc" status: 200 len: 1497 microversion: 2.1 time: 0.521021 Sep 23 05:02:13.049376 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3101/6040] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:02:12 2022] GET /compute/v2.1/servers/3fb65df8-a1b0-423f-a64d-738fa779c7bc => generated 1497 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:02:14.399407 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-856de0f1-4048-4a65-84d9-a2f470a69340 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:02:14.405021 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-856de0f1-4048-4a65-84d9-a2f470a69340 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] [instance: 3fb65df8-a1b0-423f-a64d-738fa779c7bc] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:02:14.424984 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-856de0f1-4048-4a65-84d9-a2f470a69340 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:14.436947 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-856de0f1-4048-4a65-84d9-a2f470a69340 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:14.443408 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-856de0f1-4048-4a65-84d9-a2f470a69340 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:14.446875 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-856de0f1-4048-4a65-84d9-a2f470a69340 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:14.448916 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-856de0f1-4048-4a65-84d9-a2f470a69340 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:14.452110 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-856de0f1-4048-4a65-84d9-a2f470a69340 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:14.567971 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-856de0f1-4048-4a65-84d9-a2f470a69340 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] [instance: 3fb65df8-a1b0-423f-a64d-738fa779c7bc] Going to try to terminate instance {{(pid=122698) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 05:02:15.205274 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-856de0f1-4048-4a65-84d9-a2f470a69340 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] 10.222.0.33 "DELETE /compute/v2.1/servers/3fb65df8-a1b0-423f-a64d-738fa779c7bc" status: 204 len: 0 microversion: 2.1 time: 0.809547 Sep 23 05:02:15.206522 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2940/6041] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 05:02:14 2022] DELETE /compute/v2.1/servers/3fb65df8-a1b0-423f-a64d-738fa779c7bc => generated 0 bytes in 812 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 05:02:15.217303 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-885e33a3-fe3a-412b-8070-690a5065c61b tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:02:15.219107 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-885e33a3-fe3a-412b-8070-690a5065c61b tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] [instance: 3fb65df8-a1b0-423f-a64d-738fa779c7bc] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:02:15.240423 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-885e33a3-fe3a-412b-8070-690a5065c61b tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:15.241122 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-885e33a3-fe3a-412b-8070-690a5065c61b tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:15.244697 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-885e33a3-fe3a-412b-8070-690a5065c61b tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:15.248005 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-885e33a3-fe3a-412b-8070-690a5065c61b tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:15.248005 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-885e33a3-fe3a-412b-8070-690a5065c61b tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:15.248005 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-885e33a3-fe3a-412b-8070-690a5065c61b tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:15.843568 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-885e33a3-fe3a-412b-8070-690a5065c61b tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1af38bb9e9a4cbab4a8935a01e7afba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da3327b2d3674f019c300935bb84945a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:02:15.856521 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-885e33a3-fe3a-412b-8070-690a5065c61b tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] 10.222.0.33 "GET /compute/v2.1/servers/3fb65df8-a1b0-423f-a64d-738fa779c7bc" status: 200 len: 1503 microversion: 2.1 time: 0.644681 Sep 23 05:02:15.859089 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3102/6042] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:02:15 2022] GET /compute/v2.1/servers/3fb65df8-a1b0-423f-a64d-738fa779c7bc => generated 1503 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:02:16.917208 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6a5107b4-a109-4f10-8121-d14f5904a814 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:02:16.918561 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-6a5107b4-a109-4f10-8121-d14f5904a814 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] [instance: 3fb65df8-a1b0-423f-a64d-738fa779c7bc] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:02:16.941241 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6a5107b4-a109-4f10-8121-d14f5904a814 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:16.964434 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6a5107b4-a109-4f10-8121-d14f5904a814 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:16.971107 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6a5107b4-a109-4f10-8121-d14f5904a814 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:16.975719 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6a5107b4-a109-4f10-8121-d14f5904a814 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:16.976420 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6a5107b4-a109-4f10-8121-d14f5904a814 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:16.977782 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6a5107b4-a109-4f10-8121-d14f5904a814 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:17.063559 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:02:17.568248 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6a5107b4-a109-4f10-8121-d14f5904a814 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1af38bb9e9a4cbab4a8935a01e7afba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da3327b2d3674f019c300935bb84945a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:02:17.579526 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-6a5107b4-a109-4f10-8121-d14f5904a814 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] 10.222.0.33 "GET /compute/v2.1/servers/3fb65df8-a1b0-423f-a64d-738fa779c7bc" status: 200 len: 1503 microversion: 2.1 time: 0.695043 Sep 23 05:02:17.580290 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2941/6043] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:02:16 2022] GET /compute/v2.1/servers/3fb65df8-a1b0-423f-a64d-738fa779c7bc => generated 1503 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:02:17.936678 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-bce5412b-d0ee-40db-a93e-00ae1fc4c92b req-8ef5fcb3-a78f-4a93-9e1d-d5c952116c17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fb65df8-a1b0-423f-a64d-738fa779c7bc", "name": "network-vif-deleted", "tag": "ab5cf1de-8ff0-4466-99f4-47d3f42f45bb"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:02:17.965361 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-bce5412b-d0ee-40db-a93e-00ae1fc4c92b req-8ef5fcb3-a78f-4a93-9e1d-d5c952116c17 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:17.965361 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-bce5412b-d0ee-40db-a93e-00ae1fc4c92b req-8ef5fcb3-a78f-4a93-9e1d-d5c952116c17 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:17.965760 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-bce5412b-d0ee-40db-a93e-00ae1fc4c92b req-8ef5fcb3-a78f-4a93-9e1d-d5c952116c17 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:18.008492 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-bce5412b-d0ee-40db-a93e-00ae1fc4c92b req-8ef5fcb3-a78f-4a93-9e1d-d5c952116c17 service nova] Creating event network-vif-deleted:ab5cf1de-8ff0-4466-99f4-47d3f42f45bb for instance 3fb65df8-a1b0-423f-a64d-738fa779c7bc on n-h1-846463-3 Sep 23 05:02:18.019133 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-bce5412b-d0ee-40db-a93e-00ae1fc4c92b req-8ef5fcb3-a78f-4a93-9e1d-d5c952116c17 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085378 Sep 23 05:02:18.020394 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3103/6044] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:02:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:02:18.610445 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9504c49d-f486-4b41-bb16-f7188db6ea13 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:02:18.612689 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-9504c49d-f486-4b41-bb16-f7188db6ea13 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] [instance: 3fb65df8-a1b0-423f-a64d-738fa779c7bc] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:02:18.620869 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9504c49d-f486-4b41-bb16-f7188db6ea13 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:18.621708 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9504c49d-f486-4b41-bb16-f7188db6ea13 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:18.622456 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9504c49d-f486-4b41-bb16-f7188db6ea13 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:18.624461 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9504c49d-f486-4b41-bb16-f7188db6ea13 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:18.625393 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9504c49d-f486-4b41-bb16-f7188db6ea13 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:18.626427 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9504c49d-f486-4b41-bb16-f7188db6ea13 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:18.713440 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9504c49d-f486-4b41-bb16-f7188db6ea13 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:18.713857 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9504c49d-f486-4b41-bb16-f7188db6ea13 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:18.714510 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9504c49d-f486-4b41-bb16-f7188db6ea13 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:18.715229 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-9504c49d-f486-4b41-bb16-f7188db6ea13 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lazy-loading 'fault' on Instance uuid 3fb65df8-a1b0-423f-a64d-738fa779c7bc {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 05:02:18.789182 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-9504c49d-f486-4b41-bb16-f7188db6ea13 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1af38bb9e9a4cbab4a8935a01e7afba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da3327b2d3674f019c300935bb84945a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:02:18.800275 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-9504c49d-f486-4b41-bb16-f7188db6ea13 tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] 10.222.0.33 "GET /compute/v2.1/servers/3fb65df8-a1b0-423f-a64d-738fa779c7bc" status: 200 len: 1303 microversion: 2.1 time: 0.196157 Sep 23 05:02:18.805295 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3104/6045] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:02:18 2022] GET /compute/v2.1/servers/3fb65df8-a1b0-423f-a64d-738fa779c7bc => generated 1303 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:02:18.941548 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d771836a-9a1c-42d2-b169-8bd7a2848bd6 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Action: 'create', calling method: .version_select at 0x7ff1ba6c0820>, body: {"keypair": {"name": "tempest-keypair-628481799", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAlnPYVyNsA6YH6KOlTyzJw7szNFoqjMiBBjTYRzq121t2M5dqaFrKebq/d1jAnbYvjdzPh8C4iTS9I6g9rX4l3+yFJ0KkKxGsVcF+bYD+VmYgR3h6hxzbip0aOc7CjpGw=="}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:02:19.010372 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-d771836a-9a1c-42d2-b169-8bd7a2848bd6 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Getting quotas for project daad67f26fe246d6b4d28cad1707a119. Resources: {'key_pairs'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 05:02:19.023580 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-d771836a-9a1c-42d2-b169-8bd7a2848bd6 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Getting quotas for user 59d90150ed7d477fab33129cb3b068ed and project daad67f26fe246d6b4d28cad1707a119. Resources: {'key_pairs'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 05:02:19.183773 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d771836a-9a1c-42d2-b169-8bd7a2848bd6 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.841341 Sep 23 05:02:19.184398 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2942/6046] 10.222.0.33 () {60 vars in 1159 bytes} [Fri Sep 23 05:02:18 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:02:19.836167 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-dcf55075-eb43-49b4-8afb-c17216f7eece tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:02:19.841649 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-dcf55075-eb43-49b4-8afb-c17216f7eece tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] [instance: 3fb65df8-a1b0-423f-a64d-738fa779c7bc] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:02:19.852094 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dcf55075-eb43-49b4-8afb-c17216f7eece tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:19.852874 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dcf55075-eb43-49b4-8afb-c17216f7eece tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:19.854214 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dcf55075-eb43-49b4-8afb-c17216f7eece tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:19.856540 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dcf55075-eb43-49b4-8afb-c17216f7eece tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:19.857154 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dcf55075-eb43-49b4-8afb-c17216f7eece tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:19.857807 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dcf55075-eb43-49b4-8afb-c17216f7eece tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:19.868686 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=100 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:02:19.892779 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-dcf55075-eb43-49b4-8afb-c17216f7eece tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] HTTP exception thrown: Instance 3fb65df8-a1b0-423f-a64d-738fa779c7bc could not be found. Sep 23 05:02:19.897063 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-dcf55075-eb43-49b4-8afb-c17216f7eece tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Request method failure captured: Sep 23 05:02:19.897063 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/3fb65df8-a1b0-423f-a64d-738fa779c7bc HTTP/1.1 Sep 23 05:02:19.897063 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 05:02:19.897063 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 05:02:19.897063 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 05:02:19.897063 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 05:02:19.897063 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 05:02:19.897063 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 05:02:19.897063 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 05:02:19.897063 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 05:02:19.897063 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLT2bk0LzgL4H52lnvj0ZxkxDeBOAlVAmcq-rM2H6QMjegLGCOxZrOn097uCrSDyA8hBNairne71hIZY_6WlP196RP6-SmFIFilEdUGWtONexBlV_YlYu5SPt7q05bPBsFb8WDm5Xq60-vxxC7XEpHfG_3BX1vw6H52dH0j4hJz8syvE Sep 23 05:02:19.897063 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 05:02:19.897063 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 05:02:19.897063 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 05:02:19.897063 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 05:02:19.897063 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 05:02:19.897063 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 05:02:19.897063 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: da3327b2d3674f019c300935bb84945a Sep 23 05:02:19.897063 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-VolumesActionsTest-969491916 Sep 23 05:02:19.897063 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 05:02:19.897063 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 05:02:19.897063 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_da3327b2d3674f019c300935bb84945a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/da3327b2d3674f019c300935bb84945a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/da3327b2d3674f019c300935bb84945a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/da3327b2d3674f019c300935bb84945a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:02:19.897063 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-VolumesActionsTest-969491916 Sep 23 05:02:19.897063 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: da3327b2d3674f019c300935bb84945a Sep 23 05:02:19.897063 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-VolumesActionsTest-969491916 Sep 23 05:02:19.897063 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-VolumesActionsTest-969491916-project Sep 23 05:02:19.897063 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 05:02:19.897063 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 05:02:19.897063 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: d1af38bb9e9a4cbab4a8935a01e7afba Sep 23 05:02:19.897063 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-VolumesActionsTest-969491916-project Sep 23 05:02:19.897063 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 05:02:19.897063 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 3fb65df8-a1b0-423f-a64d-738fa779c7bc could not be found. Sep 23 05:02:19.897063 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '3fb65df8-a1b0-423f-a64d-738fa779c7bc'} Sep 23 05:02:19.897063 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:02:19.897063 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:02:19.897063 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 05:02:19.897063 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 05:02:19.897063 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 05:02:19.897063 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 05:02:19.897063 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 05:02:19.897063 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 05:02:19.897063 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 05:02:19.897063 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 05:02:19.897063 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fb65df8-a1b0-423f-a64d-738fa779c7bc could not be found. Sep 23 05:02:19.897063 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:02:19.897063 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:02:19.897063 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:02:19.897063 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:02:19.897063 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:02:19.897063 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:02:19.897063 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:02:19.897063 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:02:19.897063 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:02:19.897063 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:02:19.897063 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 05:02:19.897063 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 05:02:19.897063 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 05:02:19.897063 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 05:02:19.897063 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 05:02:19.897063 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:02:19.897063 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fb65df8-a1b0-423f-a64d-738fa779c7bc could not be found. Sep 23 05:02:19.897063 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:02:19.897063 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:02:19.897063 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:02:19.901204 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:02:19.901204 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:02:19.901204 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:02:19.901204 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:02:19.901204 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:02:19.901204 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fb65df8-a1b0-423f-a64d-738fa779c7bc could not be found. Sep 23 05:02:19.901204 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:02:19.901204 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-dcf55075-eb43-49b4-8afb-c17216f7eece tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] Returning 404 to user: Instance 3fb65df8-a1b0-423f-a64d-738fa779c7bc could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:02:19.901204 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-dcf55075-eb43-49b4-8afb-c17216f7eece tempest-VolumesActionsTest-969491916 tempest-VolumesActionsTest-969491916-project] 10.222.0.33 "GET /compute/v2.1/servers/3fb65df8-a1b0-423f-a64d-738fa779c7bc" status: 404 len: 111 microversion: 2.1 time: 0.070224 Sep 23 05:02:19.903637 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3105/6047] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:02:19 2022] GET /compute/v2.1/servers/3fb65df8-a1b0-423f-a64d-738fa779c7bc => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 05:02:24.572485 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d5a948f6-9e36-4c1f-b22c-d36f136e650c tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1783911814", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0ed8d15f-c597-425d-b882-0a82aeae94d2"}], "security_groups": [{"name": "tempest-securitygroup--888494214"}], "key_name": "tempest-keypair-628481799", "user_data": "}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:02:24.886845 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-40b3ec6d-eb0b-479c-8708-bad853aeedf0 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:02:24.891891 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-40b3ec6d-eb0b-479c-8708-bad853aeedf0 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 7534fa45-8669-4295-b3c9-0d7478dd2eb8] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:02:24.912641 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-40b3ec6d-eb0b-479c-8708-bad853aeedf0 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:24.913152 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-40b3ec6d-eb0b-479c-8708-bad853aeedf0 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:24.915811 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-40b3ec6d-eb0b-479c-8708-bad853aeedf0 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:24.918017 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-40b3ec6d-eb0b-479c-8708-bad853aeedf0 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:24.919064 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-40b3ec6d-eb0b-479c-8708-bad853aeedf0 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:24.919517 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-40b3ec6d-eb0b-479c-8708-bad853aeedf0 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:24.952617 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.network.neutron [None req-d5a948f6-9e36-4c1f-b22c-d36f136e650c tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] validate_networks() for [('0ed8d15f-c597-425d-b882-0a82aeae94d2', None, None, None, None, None)] {{(pid=122698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 05:02:25.008702 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-40b3ec6d-eb0b-479c-8708-bad853aeedf0 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "POST /compute/v2.1/servers/7534fa45-8669-4295-b3c9-0d7478dd2eb8/action" status: 200 len: 24575 microversion: 2.1 time: 0.127214 Sep 23 05:02:25.015767 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3106/6048] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 05:02:24 2022] POST /compute/v2.1/servers/7534fa45-8669-4295-b3c9-0d7478dd2eb8/action => generated 24575 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 23 05:02:27.330970 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-d5a948f6-9e36-4c1f-b22c-d36f136e650c tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Flavor limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 05:02:27.331484 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-d5a948f6-9e36-4c1f-b22c-d36f136e650c tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Image limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 05:02:27.331870 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-d5a948f6-9e36-4c1f-b22c-d36f136e650c tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Flavor pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 05:02:27.332346 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-d5a948f6-9e36-4c1f-b22c-d36f136e650c tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Image pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 05:02:27.332957 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-d5a948f6-9e36-4c1f-b22c-d36f136e650c tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 05:02:27.389997 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d5a948f6-9e36-4c1f-b22c-d36f136e650c tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:27.391346 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d5a948f6-9e36-4c1f-b22c-d36f136e650c tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:27.391808 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d5a948f6-9e36-4c1f-b22c-d36f136e650c tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:27.394025 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d5a948f6-9e36-4c1f-b22c-d36f136e650c tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:27.394517 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d5a948f6-9e36-4c1f-b22c-d36f136e650c tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:27.401914 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d5a948f6-9e36-4c1f-b22c-d36f136e650c tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:27.476788 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-d5a948f6-9e36-4c1f-b22c-d36f136e650c tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Getting quotas for project daad67f26fe246d6b4d28cad1707a119. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 05:02:27.499625 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-d5a948f6-9e36-4c1f-b22c-d36f136e650c tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Getting quotas for user 59d90150ed7d477fab33129cb3b068ed and project daad67f26fe246d6b4d28cad1707a119. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 05:02:27.546288 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d5a948f6-9e36-4c1f-b22c-d36f136e650c tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Going to run 1 instances... {{(pid=122698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 05:02:27.557431 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d5a948f6-9e36-4c1f-b22c-d36f136e650c tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 9984baa4-fc75-4d8f-a660-0647326196af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 05:02:28.219781 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d5a948f6-9e36-4c1f-b22c-d36f136e650c tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.658063 Sep 23 05:02:28.227458 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2943/6049] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 05:02:24 2022] POST /compute/v2.1/servers => generated 401 bytes in 3665 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 05:02:28.234795 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-024181d9-0f21-40e1-8e30-0f7616a9ce7b tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:02:28.235566 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-024181d9-0f21-40e1-8e30-0f7616a9ce7b tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 9984baa4-fc75-4d8f-a660-0647326196af] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:02:28.397104 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-024181d9-0f21-40e1-8e30-0f7616a9ce7b tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d90150ed7d477fab33129cb3b068ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daad67f26fe246d6b4d28cad1707a119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:02:28.410645 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-024181d9-0f21-40e1-8e30-0f7616a9ce7b tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/9984baa4-fc75-4d8f-a660-0647326196af" status: 200 len: 1241 microversion: 2.1 time: 0.180048 Sep 23 05:02:28.413334 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3107/6050] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:02:28 2022] GET /compute/v2.1/servers/9984baa4-fc75-4d8f-a660-0647326196af => generated 1241 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:02:29.441165 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f0e7bbe6-08a5-48da-b32a-ccb8b2538cb8 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:02:29.442432 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f0e7bbe6-08a5-48da-b32a-ccb8b2538cb8 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 9984baa4-fc75-4d8f-a660-0647326196af] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:02:29.718857 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f0e7bbe6-08a5-48da-b32a-ccb8b2538cb8 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d90150ed7d477fab33129cb3b068ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daad67f26fe246d6b4d28cad1707a119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:02:29.738662 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f0e7bbe6-08a5-48da-b32a-ccb8b2538cb8 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/9984baa4-fc75-4d8f-a660-0647326196af" status: 200 len: 1241 microversion: 2.1 time: 0.298335 Sep 23 05:02:29.742287 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2944/6051] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:02:29 2022] GET /compute/v2.1/servers/9984baa4-fc75-4d8f-a660-0647326196af => generated 1241 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:02:30.763092 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f639fb46-2114-41e7-9ef4-d9466c3a2736 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:02:30.763867 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f639fb46-2114-41e7-9ef4-d9466c3a2736 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 9984baa4-fc75-4d8f-a660-0647326196af] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:02:30.772712 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f639fb46-2114-41e7-9ef4-d9466c3a2736 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:30.773219 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f639fb46-2114-41e7-9ef4-d9466c3a2736 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:30.779971 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f639fb46-2114-41e7-9ef4-d9466c3a2736 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:30.789586 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f639fb46-2114-41e7-9ef4-d9466c3a2736 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:30.794382 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f639fb46-2114-41e7-9ef4-d9466c3a2736 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:30.798596 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f639fb46-2114-41e7-9ef4-d9466c3a2736 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:31.122449 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f639fb46-2114-41e7-9ef4-d9466c3a2736 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d90150ed7d477fab33129cb3b068ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daad67f26fe246d6b4d28cad1707a119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:02:31.132218 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f639fb46-2114-41e7-9ef4-d9466c3a2736 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/9984baa4-fc75-4d8f-a660-0647326196af" status: 200 len: 1245 microversion: 2.1 time: 0.373557 Sep 23 05:02:31.132808 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3108/6052] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:02:30 2022] GET /compute/v2.1/servers/9984baa4-fc75-4d8f-a660-0647326196af => generated 1245 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:02:31.436844 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4aacb2fb-5c9c-42fa-8000-1da3a7a82fed tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:02:31.456037 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4aacb2fb-5c9c-42fa-8000-1da3a7a82fed tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 7534fa45-8669-4295-b3c9-0d7478dd2eb8] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:02:31.477216 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4aacb2fb-5c9c-42fa-8000-1da3a7a82fed tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:31.478243 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4aacb2fb-5c9c-42fa-8000-1da3a7a82fed tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:31.478934 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4aacb2fb-5c9c-42fa-8000-1da3a7a82fed tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:31.479935 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4aacb2fb-5c9c-42fa-8000-1da3a7a82fed tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:31.480788 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4aacb2fb-5c9c-42fa-8000-1da3a7a82fed tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:31.481457 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4aacb2fb-5c9c-42fa-8000-1da3a7a82fed tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:31.644210 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-4aacb2fb-5c9c-42fa-8000-1da3a7a82fed tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Flavor limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 05:02:31.644941 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-4aacb2fb-5c9c-42fa-8000-1da3a7a82fed tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Image limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 05:02:31.645600 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-4aacb2fb-5c9c-42fa-8000-1da3a7a82fed tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Flavor pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 05:02:31.646224 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-4aacb2fb-5c9c-42fa-8000-1da3a7a82fed tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Image pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 05:02:31.646812 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-4aacb2fb-5c9c-42fa-8000-1da3a7a82fed tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 05:02:31.995960 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4aacb2fb-5c9c-42fa-8000-1da3a7a82fed tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 7534fa45-8669-4295-b3c9-0d7478dd2eb8] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:02:32.023698 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4aacb2fb-5c9c-42fa-8000-1da3a7a82fed tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:32.024690 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4aacb2fb-5c9c-42fa-8000-1da3a7a82fed tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:32.026734 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4aacb2fb-5c9c-42fa-8000-1da3a7a82fed tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:32.027974 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4aacb2fb-5c9c-42fa-8000-1da3a7a82fed tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:32.031908 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4aacb2fb-5c9c-42fa-8000-1da3a7a82fed tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:32.034564 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4aacb2fb-5c9c-42fa-8000-1da3a7a82fed tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:32.093028 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4aacb2fb-5c9c-42fa-8000-1da3a7a82fed tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "POST /compute/v2.1/servers/7534fa45-8669-4295-b3c9-0d7478dd2eb8/action" status: 202 len: 1136 microversion: 2.1 time: 0.661349 Sep 23 05:02:32.105954 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2945/6053] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 05:02:31 2022] POST /compute/v2.1/servers/7534fa45-8669-4295-b3c9-0d7478dd2eb8/action => generated 1136 bytes in 663 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 23 05:02:32.113191 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-95c65c9b-113e-4492-98eb-5e14e7cf5d9b tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:02:32.113976 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-95c65c9b-113e-4492-98eb-5e14e7cf5d9b tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 7534fa45-8669-4295-b3c9-0d7478dd2eb8] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:02:32.133659 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-95c65c9b-113e-4492-98eb-5e14e7cf5d9b tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:32.142404 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-95c65c9b-113e-4492-98eb-5e14e7cf5d9b tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:32.148223 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-95c65c9b-113e-4492-98eb-5e14e7cf5d9b tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:32.148840 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-95c65c9b-113e-4492-98eb-5e14e7cf5d9b tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:32.149467 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-95c65c9b-113e-4492-98eb-5e14e7cf5d9b tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:32.150050 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-95c65c9b-113e-4492-98eb-5e14e7cf5d9b tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:32.167069 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b6733832-8c07-489d-b5d7-a12f9d220b86 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:02:32.167704 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b6733832-8c07-489d-b5d7-a12f9d220b86 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 9984baa4-fc75-4d8f-a660-0647326196af] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:02:32.184122 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b6733832-8c07-489d-b5d7-a12f9d220b86 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:32.188465 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b6733832-8c07-489d-b5d7-a12f9d220b86 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:32.192555 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b6733832-8c07-489d-b5d7-a12f9d220b86 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:32.197467 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b6733832-8c07-489d-b5d7-a12f9d220b86 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:32.201583 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b6733832-8c07-489d-b5d7-a12f9d220b86 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:32.211304 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b6733832-8c07-489d-b5d7-a12f9d220b86 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:33.284832 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b6733832-8c07-489d-b5d7-a12f9d220b86 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d90150ed7d477fab33129cb3b068ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daad67f26fe246d6b4d28cad1707a119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:02:33.305042 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b6733832-8c07-489d-b5d7-a12f9d220b86 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/9984baa4-fc75-4d8f-a660-0647326196af" status: 200 len: 1301 microversion: 2.1 time: 1.144876 Sep 23 05:02:33.315454 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2946/6054] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:02:32 2022] GET /compute/v2.1/servers/9984baa4-fc75-4d8f-a660-0647326196af => generated 1301 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:02:33.981151 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-95c65c9b-113e-4492-98eb-5e14e7cf5d9b tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:02:33.981151 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-95c65c9b-113e-4492-98eb-5e14e7cf5d9b tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/7534fa45-8669-4295-b3c9-0d7478dd2eb8" status: 200 len: 1690 microversion: 2.1 time: 1.807675 Sep 23 05:02:33.981151 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3109/6055] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:02:32 2022] GET /compute/v2.1/servers/7534fa45-8669-4295-b3c9-0d7478dd2eb8 => generated 1690 bytes in 1813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:02:34.334352 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-387158d5-0653-4669-a5a0-fb80f8e0fe96 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:02:34.336380 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-387158d5-0653-4669-a5a0-fb80f8e0fe96 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 9984baa4-fc75-4d8f-a660-0647326196af] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:02:34.363699 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-387158d5-0653-4669-a5a0-fb80f8e0fe96 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:34.371522 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-387158d5-0653-4669-a5a0-fb80f8e0fe96 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:34.383870 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-387158d5-0653-4669-a5a0-fb80f8e0fe96 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:34.388531 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-387158d5-0653-4669-a5a0-fb80f8e0fe96 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:34.390570 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-387158d5-0653-4669-a5a0-fb80f8e0fe96 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:34.393577 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-387158d5-0653-4669-a5a0-fb80f8e0fe96 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:35.009317 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-fd3d31f0-d2d9-4559-a8cd-7e30f8b5ffa3 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:02:35.010839 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-fd3d31f0-d2d9-4559-a8cd-7e30f8b5ffa3 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 7534fa45-8669-4295-b3c9-0d7478dd2eb8] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:02:35.027591 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=36 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:02:35.041249 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fd3d31f0-d2d9-4559-a8cd-7e30f8b5ffa3 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:35.043606 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fd3d31f0-d2d9-4559-a8cd-7e30f8b5ffa3 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:35.045382 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fd3d31f0-d2d9-4559-a8cd-7e30f8b5ffa3 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:35.049378 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fd3d31f0-d2d9-4559-a8cd-7e30f8b5ffa3 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:35.051482 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fd3d31f0-d2d9-4559-a8cd-7e30f8b5ffa3 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:35.053213 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fd3d31f0-d2d9-4559-a8cd-7e30f8b5ffa3 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:35.545024 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-387158d5-0653-4669-a5a0-fb80f8e0fe96 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d90150ed7d477fab33129cb3b068ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daad67f26fe246d6b4d28cad1707a119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:02:35.555432 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-387158d5-0653-4669-a5a0-fb80f8e0fe96 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/9984baa4-fc75-4d8f-a660-0647326196af" status: 200 len: 1299 microversion: 2.1 time: 1.226966 Sep 23 05:02:35.560656 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2947/6056] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:02:34 2022] GET /compute/v2.1/servers/9984baa4-fc75-4d8f-a660-0647326196af => generated 1299 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:02:35.761660 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-fd3d31f0-d2d9-4559-a8cd-7e30f8b5ffa3 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:02:35.787026 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-fd3d31f0-d2d9-4559-a8cd-7e30f8b5ffa3 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/7534fa45-8669-4295-b3c9-0d7478dd2eb8" status: 200 len: 1690 microversion: 2.1 time: 0.781275 Sep 23 05:02:35.787718 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3110/6057] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:02:35 2022] GET /compute/v2.1/servers/7534fa45-8669-4295-b3c9-0d7478dd2eb8 => generated 1690 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:02:36.585794 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c3755b5c-2ab0-498c-b399-9d8b2f8af8bb tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:02:36.585794 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c3755b5c-2ab0-498c-b399-9d8b2f8af8bb tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 9984baa4-fc75-4d8f-a660-0647326196af] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:02:36.599572 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c3755b5c-2ab0-498c-b399-9d8b2f8af8bb tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:36.600321 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c3755b5c-2ab0-498c-b399-9d8b2f8af8bb tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:36.601613 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c3755b5c-2ab0-498c-b399-9d8b2f8af8bb tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:36.602632 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c3755b5c-2ab0-498c-b399-9d8b2f8af8bb tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:36.603308 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c3755b5c-2ab0-498c-b399-9d8b2f8af8bb tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:36.603940 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c3755b5c-2ab0-498c-b399-9d8b2f8af8bb tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:36.816097 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a38b1f00-175b-44d1-be1f-8d0a6be80b6e tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:02:36.821474 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a38b1f00-175b-44d1-be1f-8d0a6be80b6e tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 7534fa45-8669-4295-b3c9-0d7478dd2eb8] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:02:36.824486 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a38b1f00-175b-44d1-be1f-8d0a6be80b6e tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:36.825008 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a38b1f00-175b-44d1-be1f-8d0a6be80b6e tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:36.825433 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a38b1f00-175b-44d1-be1f-8d0a6be80b6e tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:36.826180 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a38b1f00-175b-44d1-be1f-8d0a6be80b6e tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:36.826640 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a38b1f00-175b-44d1-be1f-8d0a6be80b6e tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:36.827069 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a38b1f00-175b-44d1-be1f-8d0a6be80b6e tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:36.992535 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c3755b5c-2ab0-498c-b399-9d8b2f8af8bb tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d90150ed7d477fab33129cb3b068ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daad67f26fe246d6b4d28cad1707a119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:02:37.000670 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c3755b5c-2ab0-498c-b399-9d8b2f8af8bb tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/9984baa4-fc75-4d8f-a660-0647326196af" status: 200 len: 1366 microversion: 2.1 time: 0.419399 Sep 23 05:02:37.001262 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2948/6058] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:02:36 2022] GET /compute/v2.1/servers/9984baa4-fc75-4d8f-a660-0647326196af => generated 1366 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:02:37.770586 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a38b1f00-175b-44d1-be1f-8d0a6be80b6e tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:02:37.799079 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a38b1f00-175b-44d1-be1f-8d0a6be80b6e tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/7534fa45-8669-4295-b3c9-0d7478dd2eb8" status: 200 len: 1690 microversion: 2.1 time: 0.982179 Sep 23 05:02:37.810247 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3111/6059] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:02:36 2022] GET /compute/v2.1/servers/7534fa45-8669-4295-b3c9-0d7478dd2eb8 => generated 1690 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:02:38.028639 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4c88a230-70eb-4b5b-a84d-d3d2c02267f8 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:02:38.030642 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4c88a230-70eb-4b5b-a84d-d3d2c02267f8 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 9984baa4-fc75-4d8f-a660-0647326196af] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:02:38.034589 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:02:38.052251 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4c88a230-70eb-4b5b-a84d-d3d2c02267f8 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:38.053575 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4c88a230-70eb-4b5b-a84d-d3d2c02267f8 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:38.054066 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4c88a230-70eb-4b5b-a84d-d3d2c02267f8 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:38.054805 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4c88a230-70eb-4b5b-a84d-d3d2c02267f8 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:38.055271 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4c88a230-70eb-4b5b-a84d-d3d2c02267f8 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:38.060760 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4c88a230-70eb-4b5b-a84d-d3d2c02267f8 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:38.482137 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4c88a230-70eb-4b5b-a84d-d3d2c02267f8 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d90150ed7d477fab33129cb3b068ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daad67f26fe246d6b4d28cad1707a119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:02:38.497395 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4c88a230-70eb-4b5b-a84d-d3d2c02267f8 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/9984baa4-fc75-4d8f-a660-0647326196af" status: 200 len: 1366 microversion: 2.1 time: 0.476442 Sep 23 05:02:38.507870 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2949/6060] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:02:38 2022] GET /compute/v2.1/servers/9984baa4-fc75-4d8f-a660-0647326196af => generated 1366 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:02:38.828386 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7aaba6fe-3834-42e9-a11a-9749fde25a61 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:02:38.829190 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-7aaba6fe-3834-42e9-a11a-9749fde25a61 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 7534fa45-8669-4295-b3c9-0d7478dd2eb8] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:02:38.849702 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:02:38.855922 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7aaba6fe-3834-42e9-a11a-9749fde25a61 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:38.856258 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7aaba6fe-3834-42e9-a11a-9749fde25a61 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:38.856716 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7aaba6fe-3834-42e9-a11a-9749fde25a61 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:38.861405 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7aaba6fe-3834-42e9-a11a-9749fde25a61 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:38.863399 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7aaba6fe-3834-42e9-a11a-9749fde25a61 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:38.866586 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7aaba6fe-3834-42e9-a11a-9749fde25a61 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:39.533326 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b6a4dbb6-235a-4245-a708-6da388fede66 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:02:39.534724 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b6a4dbb6-235a-4245-a708-6da388fede66 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 9984baa4-fc75-4d8f-a660-0647326196af] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:02:39.545316 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:02:39.547180 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b6a4dbb6-235a-4245-a708-6da388fede66 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:39.556268 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b6a4dbb6-235a-4245-a708-6da388fede66 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:39.556268 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b6a4dbb6-235a-4245-a708-6da388fede66 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:39.556268 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b6a4dbb6-235a-4245-a708-6da388fede66 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:39.556268 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b6a4dbb6-235a-4245-a708-6da388fede66 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:39.556268 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b6a4dbb6-235a-4245-a708-6da388fede66 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:39.726951 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=12 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:02:40.185282 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-7aaba6fe-3834-42e9-a11a-9749fde25a61 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:02:40.196714 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-7aaba6fe-3834-42e9-a11a-9749fde25a61 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/7534fa45-8669-4295-b3c9-0d7478dd2eb8" status: 200 len: 1690 microversion: 2.1 time: 1.373094 Sep 23 05:02:40.217667 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3112/6061] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:02:38 2022] GET /compute/v2.1/servers/7534fa45-8669-4295-b3c9-0d7478dd2eb8 => generated 1690 bytes in 1395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:02:40.236467 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-d574559f-b46e-44f1-a3a4-f58911c40812 req-a6fdbb99-dce1-4689-9904-263ef078e17b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9984baa4-fc75-4d8f-a660-0647326196af", "tag": "0ebe47f0-172b-4bca-9906-d73e1e79522b"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:02:40.280001 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-d574559f-b46e-44f1-a3a4-f58911c40812 req-a6fdbb99-dce1-4689-9904-263ef078e17b service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:40.288646 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-d574559f-b46e-44f1-a3a4-f58911c40812 req-a6fdbb99-dce1-4689-9904-263ef078e17b service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:40.289345 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-d574559f-b46e-44f1-a3a4-f58911c40812 req-a6fdbb99-dce1-4689-9904-263ef078e17b service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:40.343264 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-d574559f-b46e-44f1-a3a4-f58911c40812 req-a6fdbb99-dce1-4689-9904-263ef078e17b service nova] Creating event network-changed:0ebe47f0-172b-4bca-9906-d73e1e79522b for instance 9984baa4-fc75-4d8f-a660-0647326196af on n-h2-846463-3 Sep 23 05:02:40.349301 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b6a4dbb6-235a-4245-a708-6da388fede66 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d90150ed7d477fab33129cb3b068ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daad67f26fe246d6b4d28cad1707a119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:02:40.358024 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-d574559f-b46e-44f1-a3a4-f58911c40812 req-a6fdbb99-dce1-4689-9904-263ef078e17b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138646 Sep 23 05:02:40.361052 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3113/6062] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:02:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:02:40.368073 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b6a4dbb6-235a-4245-a708-6da388fede66 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/9984baa4-fc75-4d8f-a660-0647326196af" status: 200 len: 1366 microversion: 2.1 time: 0.837494 Sep 23 05:02:40.368830 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2950/6063] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:02:39 2022] GET /compute/v2.1/servers/9984baa4-fc75-4d8f-a660-0647326196af => generated 1366 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:02:41.226331 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-fecd2655-1e30-43d8-85e6-c89d6c796104 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:02:41.229972 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-fecd2655-1e30-43d8-85e6-c89d6c796104 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 7534fa45-8669-4295-b3c9-0d7478dd2eb8] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:02:41.245149 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fecd2655-1e30-43d8-85e6-c89d6c796104 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:41.254926 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fecd2655-1e30-43d8-85e6-c89d6c796104 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:41.256293 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fecd2655-1e30-43d8-85e6-c89d6c796104 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:41.257597 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fecd2655-1e30-43d8-85e6-c89d6c796104 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:41.263108 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fecd2655-1e30-43d8-85e6-c89d6c796104 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:41.263691 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fecd2655-1e30-43d8-85e6-c89d6c796104 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:41.400743 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7a86de93-e36d-4b3d-bc5f-7fadf6eea225 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:02:41.401634 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7a86de93-e36d-4b3d-bc5f-7fadf6eea225 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 9984baa4-fc75-4d8f-a660-0647326196af] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:02:41.420803 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7a86de93-e36d-4b3d-bc5f-7fadf6eea225 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:41.426025 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7a86de93-e36d-4b3d-bc5f-7fadf6eea225 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:41.430104 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7a86de93-e36d-4b3d-bc5f-7fadf6eea225 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:41.432941 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7a86de93-e36d-4b3d-bc5f-7fadf6eea225 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:41.434019 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7a86de93-e36d-4b3d-bc5f-7fadf6eea225 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:41.435911 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7a86de93-e36d-4b3d-bc5f-7fadf6eea225 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:42.316083 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-fecd2655-1e30-43d8-85e6-c89d6c796104 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:02:42.331033 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-fecd2655-1e30-43d8-85e6-c89d6c796104 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/7534fa45-8669-4295-b3c9-0d7478dd2eb8" status: 200 len: 1690 microversion: 2.1 time: 1.109987 Sep 23 05:02:42.360212 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3114/6064] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:02:41 2022] GET /compute/v2.1/servers/7534fa45-8669-4295-b3c9-0d7478dd2eb8 => generated 1690 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:02:42.559400 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-7a86de93-e36d-4b3d-bc5f-7fadf6eea225 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d90150ed7d477fab33129cb3b068ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daad67f26fe246d6b4d28cad1707a119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:02:42.575091 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7a86de93-e36d-4b3d-bc5f-7fadf6eea225 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/9984baa4-fc75-4d8f-a660-0647326196af" status: 200 len: 1366 microversion: 2.1 time: 1.176153 Sep 23 05:02:42.596383 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2951/6065] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:02:41 2022] GET /compute/v2.1/servers/9984baa4-fc75-4d8f-a660-0647326196af => generated 1366 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:02:43.360329 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c3ed650d-db63-4b1b-a2a4-f42674ed0992 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:02:43.361553 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c3ed650d-db63-4b1b-a2a4-f42674ed0992 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 7534fa45-8669-4295-b3c9-0d7478dd2eb8] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:02:43.378234 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c3ed650d-db63-4b1b-a2a4-f42674ed0992 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:43.379874 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c3ed650d-db63-4b1b-a2a4-f42674ed0992 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:43.386661 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c3ed650d-db63-4b1b-a2a4-f42674ed0992 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:43.390190 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c3ed650d-db63-4b1b-a2a4-f42674ed0992 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:43.390190 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c3ed650d-db63-4b1b-a2a4-f42674ed0992 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:43.390837 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c3ed650d-db63-4b1b-a2a4-f42674ed0992 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:43.608041 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2a58aa40-696b-41ec-82a1-45b1da23fbfe tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:02:43.609639 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-2a58aa40-696b-41ec-82a1-45b1da23fbfe tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 9984baa4-fc75-4d8f-a660-0647326196af] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:02:43.629266 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2a58aa40-696b-41ec-82a1-45b1da23fbfe tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:43.630864 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2a58aa40-696b-41ec-82a1-45b1da23fbfe tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:43.634103 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2a58aa40-696b-41ec-82a1-45b1da23fbfe tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:43.639339 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2a58aa40-696b-41ec-82a1-45b1da23fbfe tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:43.641706 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2a58aa40-696b-41ec-82a1-45b1da23fbfe tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:43.644539 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2a58aa40-696b-41ec-82a1-45b1da23fbfe tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:44.413434 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c3ed650d-db63-4b1b-a2a4-f42674ed0992 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:02:44.434478 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c3ed650d-db63-4b1b-a2a4-f42674ed0992 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/7534fa45-8669-4295-b3c9-0d7478dd2eb8" status: 200 len: 1690 microversion: 2.1 time: 1.069919 Sep 23 05:02:44.450042 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3115/6066] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:02:43 2022] GET /compute/v2.1/servers/7534fa45-8669-4295-b3c9-0d7478dd2eb8 => generated 1690 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:02:44.572530 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-2a58aa40-696b-41ec-82a1-45b1da23fbfe tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d90150ed7d477fab33129cb3b068ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daad67f26fe246d6b4d28cad1707a119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:02:44.619842 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2a58aa40-696b-41ec-82a1-45b1da23fbfe tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/9984baa4-fc75-4d8f-a660-0647326196af" status: 200 len: 1366 microversion: 2.1 time: 1.016726 Sep 23 05:02:44.623405 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2952/6067] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:02:43 2022] GET /compute/v2.1/servers/9984baa4-fc75-4d8f-a660-0647326196af => generated 1366 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:02:45.469840 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5b1f2b78-4de4-4810-9d2f-41c0eb79fa2b tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:02:45.471260 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-5b1f2b78-4de4-4810-9d2f-41c0eb79fa2b tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 7534fa45-8669-4295-b3c9-0d7478dd2eb8] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:02:45.480816 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5b1f2b78-4de4-4810-9d2f-41c0eb79fa2b tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:45.481417 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5b1f2b78-4de4-4810-9d2f-41c0eb79fa2b tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:45.481862 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5b1f2b78-4de4-4810-9d2f-41c0eb79fa2b tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:45.495991 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5b1f2b78-4de4-4810-9d2f-41c0eb79fa2b tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:45.495991 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5b1f2b78-4de4-4810-9d2f-41c0eb79fa2b tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:45.495991 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5b1f2b78-4de4-4810-9d2f-41c0eb79fa2b tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:45.647199 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-81ab064c-824e-4786-a896-e51fc6831dfd tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:02:45.649089 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-81ab064c-824e-4786-a896-e51fc6831dfd tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 9984baa4-fc75-4d8f-a660-0647326196af] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:02:45.670827 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-81ab064c-824e-4786-a896-e51fc6831dfd tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:45.671138 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-81ab064c-824e-4786-a896-e51fc6831dfd tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:45.680429 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-81ab064c-824e-4786-a896-e51fc6831dfd tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:45.681272 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-81ab064c-824e-4786-a896-e51fc6831dfd tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:45.686816 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-81ab064c-824e-4786-a896-e51fc6831dfd tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:45.687552 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-81ab064c-824e-4786-a896-e51fc6831dfd tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:46.104183 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-5b1f2b78-4de4-4810-9d2f-41c0eb79fa2b tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:02:46.113974 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5b1f2b78-4de4-4810-9d2f-41c0eb79fa2b tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/7534fa45-8669-4295-b3c9-0d7478dd2eb8" status: 200 len: 1696 microversion: 2.1 time: 0.651104 Sep 23 05:02:46.119281 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3116/6068] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:02:45 2022] GET /compute/v2.1/servers/7534fa45-8669-4295-b3c9-0d7478dd2eb8 => generated 1696 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:02:46.482023 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-81ab064c-824e-4786-a896-e51fc6831dfd tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d90150ed7d477fab33129cb3b068ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daad67f26fe246d6b4d28cad1707a119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:02:46.502002 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-81ab064c-824e-4786-a896-e51fc6831dfd tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/9984baa4-fc75-4d8f-a660-0647326196af" status: 200 len: 1366 microversion: 2.1 time: 0.856917 Sep 23 05:02:46.504656 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2953/6069] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:02:45 2022] GET /compute/v2.1/servers/9984baa4-fc75-4d8f-a660-0647326196af => generated 1366 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:02:47.145463 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-55e2f1a9-d7fb-4279-9f9c-59bf7eb6a106 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:02:47.146212 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-55e2f1a9-d7fb-4279-9f9c-59bf7eb6a106 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 7534fa45-8669-4295-b3c9-0d7478dd2eb8] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:02:47.161522 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-55e2f1a9-d7fb-4279-9f9c-59bf7eb6a106 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:47.163520 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-55e2f1a9-d7fb-4279-9f9c-59bf7eb6a106 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:47.163520 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-55e2f1a9-d7fb-4279-9f9c-59bf7eb6a106 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:47.163520 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-55e2f1a9-d7fb-4279-9f9c-59bf7eb6a106 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:47.163857 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-55e2f1a9-d7fb-4279-9f9c-59bf7eb6a106 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:47.164068 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-55e2f1a9-d7fb-4279-9f9c-59bf7eb6a106 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:47.484842 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-55e2f1a9-d7fb-4279-9f9c-59bf7eb6a106 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:02:47.496647 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-55e2f1a9-d7fb-4279-9f9c-59bf7eb6a106 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/7534fa45-8669-4295-b3c9-0d7478dd2eb8" status: 200 len: 1696 microversion: 2.1 time: 0.358214 Sep 23 05:02:47.497247 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3117/6070] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:02:47 2022] GET /compute/v2.1/servers/7534fa45-8669-4295-b3c9-0d7478dd2eb8 => generated 1696 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:02:47.537561 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e03684b6-9ff7-4912-aa84-c5d169796eb8 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:02:47.541417 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e03684b6-9ff7-4912-aa84-c5d169796eb8 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 9984baa4-fc75-4d8f-a660-0647326196af] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:02:47.556015 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e03684b6-9ff7-4912-aa84-c5d169796eb8 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:47.561248 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e03684b6-9ff7-4912-aa84-c5d169796eb8 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:47.563483 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e03684b6-9ff7-4912-aa84-c5d169796eb8 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:47.565590 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e03684b6-9ff7-4912-aa84-c5d169796eb8 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:47.568812 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e03684b6-9ff7-4912-aa84-c5d169796eb8 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:47.570503 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e03684b6-9ff7-4912-aa84-c5d169796eb8 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:48.288084 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e03684b6-9ff7-4912-aa84-c5d169796eb8 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d90150ed7d477fab33129cb3b068ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daad67f26fe246d6b4d28cad1707a119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:02:48.300329 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e03684b6-9ff7-4912-aa84-c5d169796eb8 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/9984baa4-fc75-4d8f-a660-0647326196af" status: 200 len: 1366 microversion: 2.1 time: 0.774213 Sep 23 05:02:48.318389 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2954/6071] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:02:47 2022] GET /compute/v2.1/servers/9984baa4-fc75-4d8f-a660-0647326196af => generated 1366 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:02:48.548042 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-17073d34-b859-4012-8344-6b0268320413 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:02:48.552219 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-17073d34-b859-4012-8344-6b0268320413 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 7534fa45-8669-4295-b3c9-0d7478dd2eb8] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:02:48.576247 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-17073d34-b859-4012-8344-6b0268320413 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:48.580304 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-17073d34-b859-4012-8344-6b0268320413 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:48.580304 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-17073d34-b859-4012-8344-6b0268320413 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:48.580304 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-17073d34-b859-4012-8344-6b0268320413 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:48.582709 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-17073d34-b859-4012-8344-6b0268320413 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:48.584894 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-17073d34-b859-4012-8344-6b0268320413 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:48.849000 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-17073d34-b859-4012-8344-6b0268320413 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:02:48.856863 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-17073d34-b859-4012-8344-6b0268320413 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/7534fa45-8669-4295-b3c9-0d7478dd2eb8" status: 200 len: 1681 microversion: 2.1 time: 0.336617 Sep 23 05:02:48.863471 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3118/6072] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:02:48 2022] GET /compute/v2.1/servers/7534fa45-8669-4295-b3c9-0d7478dd2eb8 => generated 1681 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:02:49.262471 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-09557c5a-ea0f-40b7-8199-176319344ca9 req-95564481-adca-478e-8ed1-8897cfaeabf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9984baa4-fc75-4d8f-a660-0647326196af", "name": "network-vif-plugged", "status": "completed", "tag": "0ebe47f0-172b-4bca-9906-d73e1e79522b"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:02:49.291311 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-09557c5a-ea0f-40b7-8199-176319344ca9 req-95564481-adca-478e-8ed1-8897cfaeabf7 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:49.292933 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-09557c5a-ea0f-40b7-8199-176319344ca9 req-95564481-adca-478e-8ed1-8897cfaeabf7 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:49.293387 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-09557c5a-ea0f-40b7-8199-176319344ca9 req-95564481-adca-478e-8ed1-8897cfaeabf7 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:49.317155 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-09557c5a-ea0f-40b7-8199-176319344ca9 req-95564481-adca-478e-8ed1-8897cfaeabf7 service nova] Creating event network-vif-plugged:0ebe47f0-172b-4bca-9906-d73e1e79522b for instance 9984baa4-fc75-4d8f-a660-0647326196af on n-h2-846463-3 Sep 23 05:02:49.325107 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-09557c5a-ea0f-40b7-8199-176319344ca9 req-95564481-adca-478e-8ed1-8897cfaeabf7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069593 Sep 23 05:02:49.326660 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2955/6073] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:02:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:02:49.327941 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4ff8487c-1327-429e-a254-54fbf2c0b0c3 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:02:49.328707 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4ff8487c-1327-429e-a254-54fbf2c0b0c3 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 9984baa4-fc75-4d8f-a660-0647326196af] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:02:49.343049 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4ff8487c-1327-429e-a254-54fbf2c0b0c3 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:49.345721 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4ff8487c-1327-429e-a254-54fbf2c0b0c3 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:49.347352 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4ff8487c-1327-429e-a254-54fbf2c0b0c3 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:49.352646 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4ff8487c-1327-429e-a254-54fbf2c0b0c3 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:49.354753 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4ff8487c-1327-429e-a254-54fbf2c0b0c3 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:49.356039 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4ff8487c-1327-429e-a254-54fbf2c0b0c3 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:49.790227 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-4ff8487c-1327-429e-a254-54fbf2c0b0c3 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d90150ed7d477fab33129cb3b068ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daad67f26fe246d6b4d28cad1707a119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:02:49.805532 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4ff8487c-1327-429e-a254-54fbf2c0b0c3 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/9984baa4-fc75-4d8f-a660-0647326196af" status: 200 len: 1366 microversion: 2.1 time: 0.483255 Sep 23 05:02:49.806470 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3119/6074] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:02:49 2022] GET /compute/v2.1/servers/9984baa4-fc75-4d8f-a660-0647326196af => generated 1366 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:02:50.830834 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-eada4587-2da4-4874-8d42-c213cc8baba2 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:02:50.831629 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-eada4587-2da4-4874-8d42-c213cc8baba2 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 9984baa4-fc75-4d8f-a660-0647326196af] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:02:50.863466 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-eada4587-2da4-4874-8d42-c213cc8baba2 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:50.866359 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-eada4587-2da4-4874-8d42-c213cc8baba2 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:50.866919 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-eada4587-2da4-4874-8d42-c213cc8baba2 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:50.867656 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-eada4587-2da4-4874-8d42-c213cc8baba2 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:50.868125 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-eada4587-2da4-4874-8d42-c213cc8baba2 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:50.868564 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-eada4587-2da4-4874-8d42-c213cc8baba2 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:51.270589 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-eada4587-2da4-4874-8d42-c213cc8baba2 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d90150ed7d477fab33129cb3b068ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daad67f26fe246d6b4d28cad1707a119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:02:51.281444 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-eada4587-2da4-4874-8d42-c213cc8baba2 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/9984baa4-fc75-4d8f-a660-0647326196af" status: 200 len: 1366 microversion: 2.1 time: 0.456427 Sep 23 05:02:51.291953 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2956/6075] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:02:50 2022] GET /compute/v2.1/servers/9984baa4-fc75-4d8f-a660-0647326196af => generated 1366 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:02:51.537259 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-a30550a6-4ff4-4b26-8622-df11b6e9955a req-2c6bb8e7-c900-45a9-9d4c-6ea18fe512ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7534fa45-8669-4295-b3c9-0d7478dd2eb8", "name": "network-vif-unplugged", "status": "completed", "tag": "1be06b6d-5ecd-4f40-ad6a-3263a045a87c"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:02:51.569554 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-a30550a6-4ff4-4b26-8622-df11b6e9955a req-2c6bb8e7-c900-45a9-9d4c-6ea18fe512ba service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:51.577800 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-a30550a6-4ff4-4b26-8622-df11b6e9955a req-2c6bb8e7-c900-45a9-9d4c-6ea18fe512ba service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:51.582062 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-a30550a6-4ff4-4b26-8622-df11b6e9955a req-2c6bb8e7-c900-45a9-9d4c-6ea18fe512ba service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:51.622278 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-a30550a6-4ff4-4b26-8622-df11b6e9955a req-2c6bb8e7-c900-45a9-9d4c-6ea18fe512ba service nova] Creating event network-vif-unplugged:1be06b6d-5ecd-4f40-ad6a-3263a045a87c for instance 7534fa45-8669-4295-b3c9-0d7478dd2eb8 on n-h1-846463-3 Sep 23 05:02:51.649670 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-a30550a6-4ff4-4b26-8622-df11b6e9955a req-2c6bb8e7-c900-45a9-9d4c-6ea18fe512ba service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.113694 Sep 23 05:02:51.653128 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3120/6076] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:02:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:02:52.321381 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c525f8f4-6d93-4671-937e-98906c61a532 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:02:52.322806 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c525f8f4-6d93-4671-937e-98906c61a532 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 9984baa4-fc75-4d8f-a660-0647326196af] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:02:52.339886 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c525f8f4-6d93-4671-937e-98906c61a532 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:52.341771 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c525f8f4-6d93-4671-937e-98906c61a532 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:52.342448 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c525f8f4-6d93-4671-937e-98906c61a532 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:52.343361 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c525f8f4-6d93-4671-937e-98906c61a532 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:52.346294 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c525f8f4-6d93-4671-937e-98906c61a532 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:52.347389 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c525f8f4-6d93-4671-937e-98906c61a532 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:53.155126 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c525f8f4-6d93-4671-937e-98906c61a532 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d90150ed7d477fab33129cb3b068ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daad67f26fe246d6b4d28cad1707a119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:02:53.164223 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c525f8f4-6d93-4671-937e-98906c61a532 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/9984baa4-fc75-4d8f-a660-0647326196af" status: 200 len: 1555 microversion: 2.1 time: 0.850803 Sep 23 05:02:53.170200 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2957/6077] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:02:52 2022] GET /compute/v2.1/servers/9984baa4-fc75-4d8f-a660-0647326196af => generated 1555 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:02:53.199143 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e1eee2fe-aa79-4856-9ace-a80cd1a69acc tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:02:53.199710 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e1eee2fe-aa79-4856-9ace-a80cd1a69acc tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 9984baa4-fc75-4d8f-a660-0647326196af] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:02:53.220919 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e1eee2fe-aa79-4856-9ace-a80cd1a69acc tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:53.222399 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e1eee2fe-aa79-4856-9ace-a80cd1a69acc tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:53.222861 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e1eee2fe-aa79-4856-9ace-a80cd1a69acc tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:53.223603 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e1eee2fe-aa79-4856-9ace-a80cd1a69acc tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:53.224076 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e1eee2fe-aa79-4856-9ace-a80cd1a69acc tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:53.224510 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e1eee2fe-aa79-4856-9ace-a80cd1a69acc tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:53.646917 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e1eee2fe-aa79-4856-9ace-a80cd1a69acc tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/9984baa4-fc75-4d8f-a660-0647326196af/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.452870 Sep 23 05:02:53.647546 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3121/6078] 10.222.0.33 () {58 vars in 1275 bytes} [Fri Sep 23 05:02:53 2022] GET /compute/v2.1/servers/9984baa4-fc75-4d8f-a660-0647326196af/os-interface => generated 284 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:02:57.530219 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-bae660b1-10a4-4e1e-b787-ee8d1b6f508b req-f0e5dd38-8802-42b6-a4b8-9ca38597b778 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7534fa45-8669-4295-b3c9-0d7478dd2eb8", "name": "network-vif-plugged", "status": "completed", "tag": "1be06b6d-5ecd-4f40-ad6a-3263a045a87c"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:02:57.561574 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-bae660b1-10a4-4e1e-b787-ee8d1b6f508b req-f0e5dd38-8802-42b6-a4b8-9ca38597b778 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:57.561574 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-bae660b1-10a4-4e1e-b787-ee8d1b6f508b req-f0e5dd38-8802-42b6-a4b8-9ca38597b778 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:57.563649 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-bae660b1-10a4-4e1e-b787-ee8d1b6f508b req-f0e5dd38-8802-42b6-a4b8-9ca38597b778 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:57.571013 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:02:57.591787 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-bae660b1-10a4-4e1e-b787-ee8d1b6f508b req-f0e5dd38-8802-42b6-a4b8-9ca38597b778 service nova] Creating event network-vif-plugged:1be06b6d-5ecd-4f40-ad6a-3263a045a87c for instance 7534fa45-8669-4295-b3c9-0d7478dd2eb8 on n-h1-846463-3 Sep 23 05:02:57.616632 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-bae660b1-10a4-4e1e-b787-ee8d1b6f508b req-f0e5dd38-8802-42b6-a4b8-9ca38597b778 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091695 Sep 23 05:02:57.617525 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2958/6079] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:02:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:02:58.512788 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-4bacfbf8-484f-418c-adc4-f3a867f946cd req-93877b5a-7f45-48eb-b8ca-b30d8f25a429 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9984baa4-fc75-4d8f-a660-0647326196af", "tag": "0ebe47f0-172b-4bca-9906-d73e1e79522b"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:02:58.541658 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-4bacfbf8-484f-418c-adc4-f3a867f946cd req-93877b5a-7f45-48eb-b8ca-b30d8f25a429 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:02:58.541658 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-4bacfbf8-484f-418c-adc4-f3a867f946cd req-93877b5a-7f45-48eb-b8ca-b30d8f25a429 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:02:58.541930 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-4bacfbf8-484f-418c-adc4-f3a867f946cd req-93877b5a-7f45-48eb-b8ca-b30d8f25a429 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:02:58.544705 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=80 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:02:58.598186 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-4bacfbf8-484f-418c-adc4-f3a867f946cd req-93877b5a-7f45-48eb-b8ca-b30d8f25a429 service nova] Creating event network-changed:0ebe47f0-172b-4bca-9906-d73e1e79522b for instance 9984baa4-fc75-4d8f-a660-0647326196af on n-h2-846463-3 Sep 23 05:02:58.622351 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-4bacfbf8-484f-418c-adc4-f3a867f946cd req-93877b5a-7f45-48eb-b8ca-b30d8f25a429 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115992 Sep 23 05:02:58.628235 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3122/6080] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:02:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 05:03:06.790048 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-de2cea27-de64-4950-a740-349b7e67e75d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2103601251", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "07d98526-c56d-4bc7-8475-9f0784f63b1d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4600129e-ae78-4842-a9e8-005f0a31ee9b"}]}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:03:06.986427 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.network.neutron [None req-de2cea27-de64-4950-a740-349b7e67e75d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] validate_networks() for [('4600129e-ae78-4842-a9e8-005f0a31ee9b', None, None, None, None, None)] {{(pid=122698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 05:03:07.818466 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-de2cea27-de64-4950-a740-349b7e67e75d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Flavor limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 05:03:07.819161 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-de2cea27-de64-4950-a740-349b7e67e75d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Image limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 05:03:07.819578 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-de2cea27-de64-4950-a740-349b7e67e75d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Flavor pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 05:03:07.820453 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-de2cea27-de64-4950-a740-349b7e67e75d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Image pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 05:03:07.821062 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-de2cea27-de64-4950-a740-349b7e67e75d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 05:03:07.856098 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-de2cea27-de64-4950-a740-349b7e67e75d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:07.856726 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-de2cea27-de64-4950-a740-349b7e67e75d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:07.857764 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-de2cea27-de64-4950-a740-349b7e67e75d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:07.871641 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-de2cea27-de64-4950-a740-349b7e67e75d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:07.872612 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-de2cea27-de64-4950-a740-349b7e67e75d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:07.875995 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-de2cea27-de64-4950-a740-349b7e67e75d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:07.918598 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-de2cea27-de64-4950-a740-349b7e67e75d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Getting quotas for project cceaa1e24146497fbf3f79cebc112211. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 05:03:07.936209 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-de2cea27-de64-4950-a740-349b7e67e75d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Getting quotas for user 0d55fe5072c14752846eb4ffc0eef91b and project cceaa1e24146497fbf3f79cebc112211. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 05:03:08.048818 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-de2cea27-de64-4950-a740-349b7e67e75d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Going to run 1 instances... {{(pid=122698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 05:03:08.051117 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-de2cea27-de64-4950-a740-349b7e67e75d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: ad2b8720-200e-4c72-8195-a62f69c2e687] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='07d98526-c56d-4bc7-8475-9f0784f63b1d',volume_size=None,volume_type=None)] {{(pid=122698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 05:03:08.741316 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-de2cea27-de64-4950-a740-349b7e67e75d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.961234 Sep 23 05:03:08.751431 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=25 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:03:08.756240 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c7b63f89-083e-40f1-8ed9-e6fba16f0496 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:03:08.756946 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c7b63f89-083e-40f1-8ed9-e6fba16f0496 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: ad2b8720-200e-4c72-8195-a62f69c2e687] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:03:08.768337 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2959/6081] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 05:03:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1982 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 05:03:08.972093 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c7b63f89-083e-40f1-8ed9-e6fba16f0496 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:03:08.984214 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c7b63f89-083e-40f1-8ed9-e6fba16f0496 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/ad2b8720-200e-4c72-8195-a62f69c2e687" status: 200 len: 1057 microversion: 2.1 time: 0.234806 Sep 23 05:03:08.988633 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3123/6082] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:03:08 2022] GET /compute/v2.1/servers/ad2b8720-200e-4c72-8195-a62f69c2e687 => generated 1057 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:03:10.012605 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-06fecf37-b129-4ce9-b781-eebe81c965db tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:03:10.014778 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-06fecf37-b129-4ce9-b781-eebe81c965db tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: ad2b8720-200e-4c72-8195-a62f69c2e687] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:03:10.264859 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-06fecf37-b129-4ce9-b781-eebe81c965db tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:03:10.272678 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-06fecf37-b129-4ce9-b781-eebe81c965db tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/ad2b8720-200e-4c72-8195-a62f69c2e687" status: 200 len: 1057 microversion: 2.1 time: 0.264135 Sep 23 05:03:10.276486 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2960/6083] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:03:10 2022] GET /compute/v2.1/servers/ad2b8720-200e-4c72-8195-a62f69c2e687 => generated 1057 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:03:11.313626 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0cff8a47-1b0f-4716-8f85-4f4d34f6ee8e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:03:11.314360 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-0cff8a47-1b0f-4716-8f85-4f4d34f6ee8e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: ad2b8720-200e-4c72-8195-a62f69c2e687] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:03:11.336163 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0cff8a47-1b0f-4716-8f85-4f4d34f6ee8e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:11.336877 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0cff8a47-1b0f-4716-8f85-4f4d34f6ee8e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:11.337199 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0cff8a47-1b0f-4716-8f85-4f4d34f6ee8e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:11.338082 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0cff8a47-1b0f-4716-8f85-4f4d34f6ee8e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:11.340149 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0cff8a47-1b0f-4716-8f85-4f4d34f6ee8e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:11.340790 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0cff8a47-1b0f-4716-8f85-4f4d34f6ee8e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:11.537845 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-0cff8a47-1b0f-4716-8f85-4f4d34f6ee8e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:03:11.564958 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0cff8a47-1b0f-4716-8f85-4f4d34f6ee8e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/ad2b8720-200e-4c72-8195-a62f69c2e687" status: 200 len: 1099 microversion: 2.1 time: 0.267431 Sep 23 05:03:11.567585 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3124/6084] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:03:11 2022] GET /compute/v2.1/servers/ad2b8720-200e-4c72-8195-a62f69c2e687 => generated 1099 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:03:12.589425 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-dbcc99e2-a836-4e4e-99c5-848ffd5418bb tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:03:12.590874 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-dbcc99e2-a836-4e4e-99c5-848ffd5418bb tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: ad2b8720-200e-4c72-8195-a62f69c2e687] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:03:12.595919 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:03:12.611085 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dbcc99e2-a836-4e4e-99c5-848ffd5418bb tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:12.612792 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dbcc99e2-a836-4e4e-99c5-848ffd5418bb tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:12.613265 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dbcc99e2-a836-4e4e-99c5-848ffd5418bb tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:12.616352 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dbcc99e2-a836-4e4e-99c5-848ffd5418bb tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:12.616855 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dbcc99e2-a836-4e4e-99c5-848ffd5418bb tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:12.617310 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dbcc99e2-a836-4e4e-99c5-848ffd5418bb tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:12.977803 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-dbcc99e2-a836-4e4e-99c5-848ffd5418bb tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:03:12.987319 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-dbcc99e2-a836-4e4e-99c5-848ffd5418bb tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/ad2b8720-200e-4c72-8195-a62f69c2e687" status: 200 len: 1163 microversion: 2.1 time: 0.402186 Sep 23 05:03:12.990442 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2961/6085] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:03:12 2022] GET /compute/v2.1/servers/ad2b8720-200e-4c72-8195-a62f69c2e687 => generated 1163 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:03:13.877164 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-34767860-26c0-4fb2-ae51-a1a59db30304 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:03:13.892085 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-34767860-26c0-4fb2-ae51-a1a59db30304 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 7534fa45-8669-4295-b3c9-0d7478dd2eb8] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:03:13.914993 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-34767860-26c0-4fb2-ae51-a1a59db30304 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:13.916402 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-34767860-26c0-4fb2-ae51-a1a59db30304 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:13.918737 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-34767860-26c0-4fb2-ae51-a1a59db30304 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:13.923246 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-34767860-26c0-4fb2-ae51-a1a59db30304 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:13.925216 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-34767860-26c0-4fb2-ae51-a1a59db30304 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:13.926857 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-34767860-26c0-4fb2-ae51-a1a59db30304 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:14.023763 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1d106f17-017c-4064-aafb-9c51800893a1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:03:14.024449 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-1d106f17-017c-4064-aafb-9c51800893a1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: ad2b8720-200e-4c72-8195-a62f69c2e687] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:03:14.084369 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1d106f17-017c-4064-aafb-9c51800893a1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:14.087203 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1d106f17-017c-4064-aafb-9c51800893a1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:14.087203 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1d106f17-017c-4064-aafb-9c51800893a1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:14.087203 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1d106f17-017c-4064-aafb-9c51800893a1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:14.087693 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1d106f17-017c-4064-aafb-9c51800893a1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:14.088609 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1d106f17-017c-4064-aafb-9c51800893a1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:14.105863 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-34767860-26c0-4fb2-ae51-a1a59db30304 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "POST /compute/v2.1/servers/7534fa45-8669-4295-b3c9-0d7478dd2eb8/action" status: 200 len: 24567 microversion: 2.1 time: 0.972929 Sep 23 05:03:14.113860 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3125/6086] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 05:03:13 2022] POST /compute/v2.1/servers/7534fa45-8669-4295-b3c9-0d7478dd2eb8/action => generated 24567 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 05:03:14.305836 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-1d106f17-017c-4064-aafb-9c51800893a1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:03:14.318423 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-1d106f17-017c-4064-aafb-9c51800893a1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/ad2b8720-200e-4c72-8195-a62f69c2e687" status: 200 len: 1173 microversion: 2.1 time: 0.306317 Sep 23 05:03:14.334819 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2962/6087] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:03:14 2022] GET /compute/v2.1/servers/ad2b8720-200e-4c72-8195-a62f69c2e687 => generated 1173 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:03:15.346657 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-647a9237-499d-442a-978a-5bf3b365c775 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:03:15.349383 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-647a9237-499d-442a-978a-5bf3b365c775 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: ad2b8720-200e-4c72-8195-a62f69c2e687] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:03:15.369806 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-647a9237-499d-442a-978a-5bf3b365c775 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:15.371361 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-647a9237-499d-442a-978a-5bf3b365c775 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:15.371830 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-647a9237-499d-442a-978a-5bf3b365c775 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:15.374681 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-647a9237-499d-442a-978a-5bf3b365c775 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:15.375338 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-647a9237-499d-442a-978a-5bf3b365c775 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:15.379539 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-647a9237-499d-442a-978a-5bf3b365c775 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:15.991094 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-647a9237-499d-442a-978a-5bf3b365c775 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:03:16.005970 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-647a9237-499d-442a-978a-5bf3b365c775 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/ad2b8720-200e-4c72-8195-a62f69c2e687" status: 200 len: 1215 microversion: 2.1 time: 0.664918 Sep 23 05:03:16.008904 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3126/6088] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:03:15 2022] GET /compute/v2.1/servers/ad2b8720-200e-4c72-8195-a62f69c2e687 => generated 1215 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:03:17.032152 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-69416b7b-74a5-4905-be2a-1157208f94e1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:03:17.032771 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-69416b7b-74a5-4905-be2a-1157208f94e1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: ad2b8720-200e-4c72-8195-a62f69c2e687] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:03:17.052708 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-69416b7b-74a5-4905-be2a-1157208f94e1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:17.053217 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-69416b7b-74a5-4905-be2a-1157208f94e1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:17.053865 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-69416b7b-74a5-4905-be2a-1157208f94e1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:17.065823 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-69416b7b-74a5-4905-be2a-1157208f94e1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:17.066299 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-69416b7b-74a5-4905-be2a-1157208f94e1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:17.066757 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-69416b7b-74a5-4905-be2a-1157208f94e1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:17.185139 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-feda3496-1c01-4d6a-82a2-10e871851621 req-991751e9-274f-47da-ae1a-be1ef9b24bc3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad2b8720-200e-4c72-8195-a62f69c2e687", "tag": "20f7b10b-a976-4861-9d48-1b77a8203784"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:03:17.220425 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-feda3496-1c01-4d6a-82a2-10e871851621 req-991751e9-274f-47da-ae1a-be1ef9b24bc3 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:17.224616 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-feda3496-1c01-4d6a-82a2-10e871851621 req-991751e9-274f-47da-ae1a-be1ef9b24bc3 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:17.226631 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-feda3496-1c01-4d6a-82a2-10e871851621 req-991751e9-274f-47da-ae1a-be1ef9b24bc3 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:17.263636 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-feda3496-1c01-4d6a-82a2-10e871851621 req-991751e9-274f-47da-ae1a-be1ef9b24bc3 service nova] Creating event network-changed:20f7b10b-a976-4861-9d48-1b77a8203784 for instance ad2b8720-200e-4c72-8195-a62f69c2e687 on n-h1-846463-3 Sep 23 05:03:17.276216 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-feda3496-1c01-4d6a-82a2-10e871851621 req-991751e9-274f-47da-ae1a-be1ef9b24bc3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097803 Sep 23 05:03:17.278975 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3127/6089] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:03:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 05:03:17.896285 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:03:18.326066 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-69416b7b-74a5-4905-be2a-1157208f94e1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:03:18.346238 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-69416b7b-74a5-4905-be2a-1157208f94e1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/ad2b8720-200e-4c72-8195-a62f69c2e687" status: 200 len: 1215 microversion: 2.1 time: 1.316161 Sep 23 05:03:18.347038 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2963/6090] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:03:17 2022] GET /compute/v2.1/servers/ad2b8720-200e-4c72-8195-a62f69c2e687 => generated 1215 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:03:19.376933 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:03:19.385817 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-77256e35-7da6-421b-9777-b8fe706a4d87 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:03:19.393938 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-77256e35-7da6-421b-9777-b8fe706a4d87 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: ad2b8720-200e-4c72-8195-a62f69c2e687] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:03:19.432026 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-77256e35-7da6-421b-9777-b8fe706a4d87 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:19.432783 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-77256e35-7da6-421b-9777-b8fe706a4d87 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:19.434857 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-77256e35-7da6-421b-9777-b8fe706a4d87 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:19.439389 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-77256e35-7da6-421b-9777-b8fe706a4d87 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:19.440774 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-77256e35-7da6-421b-9777-b8fe706a4d87 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:19.447113 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-77256e35-7da6-421b-9777-b8fe706a4d87 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:19.835161 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-77256e35-7da6-421b-9777-b8fe706a4d87 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:03:19.845032 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-77256e35-7da6-421b-9777-b8fe706a4d87 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/ad2b8720-200e-4c72-8195-a62f69c2e687" status: 200 len: 1215 microversion: 2.1 time: 0.470882 Sep 23 05:03:19.868226 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3128/6091] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:03:19 2022] GET /compute/v2.1/servers/ad2b8720-200e-4c72-8195-a62f69c2e687 => generated 1215 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:03:20.879739 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a68a3d07-eee3-4497-b651-d3e1702100ea tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:03:20.888777 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a68a3d07-eee3-4497-b651-d3e1702100ea tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: ad2b8720-200e-4c72-8195-a62f69c2e687] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:03:20.927048 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=8 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:03:20.927048 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a68a3d07-eee3-4497-b651-d3e1702100ea tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:20.927048 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a68a3d07-eee3-4497-b651-d3e1702100ea tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:20.927048 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a68a3d07-eee3-4497-b651-d3e1702100ea tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:20.927048 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a68a3d07-eee3-4497-b651-d3e1702100ea tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:20.933355 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a68a3d07-eee3-4497-b651-d3e1702100ea tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:20.933870 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a68a3d07-eee3-4497-b651-d3e1702100ea tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:21.433807 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a68a3d07-eee3-4497-b651-d3e1702100ea tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:03:21.443678 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a68a3d07-eee3-4497-b651-d3e1702100ea tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/ad2b8720-200e-4c72-8195-a62f69c2e687" status: 200 len: 1215 microversion: 2.1 time: 0.578797 Sep 23 05:03:21.450392 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2964/6092] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:03:20 2022] GET /compute/v2.1/servers/ad2b8720-200e-4c72-8195-a62f69c2e687 => generated 1215 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:03:22.475213 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f926ba11-3e92-43e1-8a49-494e7bf4661c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:03:22.476565 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f926ba11-3e92-43e1-8a49-494e7bf4661c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: ad2b8720-200e-4c72-8195-a62f69c2e687] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:03:22.492330 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f926ba11-3e92-43e1-8a49-494e7bf4661c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:22.499617 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f926ba11-3e92-43e1-8a49-494e7bf4661c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:22.508862 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f926ba11-3e92-43e1-8a49-494e7bf4661c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:22.509918 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f926ba11-3e92-43e1-8a49-494e7bf4661c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:22.516783 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f926ba11-3e92-43e1-8a49-494e7bf4661c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:22.518009 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f926ba11-3e92-43e1-8a49-494e7bf4661c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:22.762945 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ebffc118-a996-41a4-9327-6177e1f3b5f8 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:03:22.763456 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-ebffc118-a996-41a4-9327-6177e1f3b5f8 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 9984baa4-fc75-4d8f-a660-0647326196af] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:03:22.782805 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ebffc118-a996-41a4-9327-6177e1f3b5f8 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:22.791258 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ebffc118-a996-41a4-9327-6177e1f3b5f8 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:22.793960 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ebffc118-a996-41a4-9327-6177e1f3b5f8 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:22.799819 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ebffc118-a996-41a4-9327-6177e1f3b5f8 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:22.806991 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ebffc118-a996-41a4-9327-6177e1f3b5f8 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:22.808013 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ebffc118-a996-41a4-9327-6177e1f3b5f8 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:22.908987 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ebffc118-a996-41a4-9327-6177e1f3b5f8 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/9984baa4-fc75-4d8f-a660-0647326196af/ips" status: 200 len: 149 microversion: 2.1 time: 0.149879 Sep 23 05:03:22.919927 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f926ba11-3e92-43e1-8a49-494e7bf4661c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:03:22.933371 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2965/6093] 10.222.0.33 () {58 vars in 1248 bytes} [Fri Sep 23 05:03:22 2022] GET /compute/v2.1/servers/9984baa4-fc75-4d8f-a660-0647326196af/ips => generated 149 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:03:22.939478 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f926ba11-3e92-43e1-8a49-494e7bf4661c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/ad2b8720-200e-4c72-8195-a62f69c2e687" status: 200 len: 1215 microversion: 2.1 time: 0.468184 Sep 23 05:03:22.956944 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3129/6094] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:03:22 2022] GET /compute/v2.1/servers/ad2b8720-200e-4c72-8195-a62f69c2e687 => generated 1215 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:03:22.965372 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-78f72869-e9c7-43ad-a6c1-6a4076d580c3 req-f1f87ebc-4cfa-488d-89fb-8ae5dd61fd7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7534fa45-8669-4295-b3c9-0d7478dd2eb8", "tag": "1be06b6d-5ecd-4f40-ad6a-3263a045a87c"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:03:22.970043 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4781e4da-f38a-403c-bb7b-fe06401252a1 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:03:22.970557 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4781e4da-f38a-403c-bb7b-fe06401252a1 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 7534fa45-8669-4295-b3c9-0d7478dd2eb8] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:03:22.983004 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-78f72869-e9c7-43ad-a6c1-6a4076d580c3 req-f1f87ebc-4cfa-488d-89fb-8ae5dd61fd7d service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:22.984557 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-78f72869-e9c7-43ad-a6c1-6a4076d580c3 req-f1f87ebc-4cfa-488d-89fb-8ae5dd61fd7d service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:22.985308 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-78f72869-e9c7-43ad-a6c1-6a4076d580c3 req-f1f87ebc-4cfa-488d-89fb-8ae5dd61fd7d service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:23.003795 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-78f72869-e9c7-43ad-a6c1-6a4076d580c3 req-f1f87ebc-4cfa-488d-89fb-8ae5dd61fd7d service nova] Creating event network-changed:1be06b6d-5ecd-4f40-ad6a-3263a045a87c for instance 7534fa45-8669-4295-b3c9-0d7478dd2eb8 on n-h1-846463-3 Sep 23 05:03:23.011549 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4781e4da-f38a-403c-bb7b-fe06401252a1 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:23.026211 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4781e4da-f38a-403c-bb7b-fe06401252a1 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:23.026789 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4781e4da-f38a-403c-bb7b-fe06401252a1 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:23.027766 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-78f72869-e9c7-43ad-a6c1-6a4076d580c3 req-f1f87ebc-4cfa-488d-89fb-8ae5dd61fd7d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068328 Sep 23 05:03:23.033143 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4781e4da-f38a-403c-bb7b-fe06401252a1 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:23.036148 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3130/6095] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:03:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:03:23.038835 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4781e4da-f38a-403c-bb7b-fe06401252a1 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:23.046277 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4781e4da-f38a-403c-bb7b-fe06401252a1 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:23.147524 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4781e4da-f38a-403c-bb7b-fe06401252a1 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 7534fa45-8669-4295-b3c9-0d7478dd2eb8] Going to try to terminate instance {{(pid=122698) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 05:03:23.734524 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4781e4da-f38a-403c-bb7b-fe06401252a1 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "DELETE /compute/v2.1/servers/7534fa45-8669-4295-b3c9-0d7478dd2eb8" status: 204 len: 0 microversion: 2.1 time: 0.786699 Sep 23 05:03:23.739332 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2966/6096] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 05:03:22 2022] DELETE /compute/v2.1/servers/7534fa45-8669-4295-b3c9-0d7478dd2eb8 => generated 0 bytes in 789 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 05:03:23.749213 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c6c03204-acbc-45a6-a9a0-ece38759bf3e tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:03:23.752184 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c6c03204-acbc-45a6-a9a0-ece38759bf3e tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 7534fa45-8669-4295-b3c9-0d7478dd2eb8] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:03:23.788336 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c6c03204-acbc-45a6-a9a0-ece38759bf3e tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:23.788961 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c6c03204-acbc-45a6-a9a0-ece38759bf3e tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:23.789422 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c6c03204-acbc-45a6-a9a0-ece38759bf3e tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:23.800539 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c6c03204-acbc-45a6-a9a0-ece38759bf3e tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:23.801109 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c6c03204-acbc-45a6-a9a0-ece38759bf3e tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:23.810266 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c6c03204-acbc-45a6-a9a0-ece38759bf3e tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:23.977075 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f1fa50fd-26eb-486f-8c88-2deb64d8c174 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:03:23.977075 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f1fa50fd-26eb-486f-8c88-2deb64d8c174 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: ad2b8720-200e-4c72-8195-a62f69c2e687] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:03:23.986406 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f1fa50fd-26eb-486f-8c88-2deb64d8c174 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:23.999238 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f1fa50fd-26eb-486f-8c88-2deb64d8c174 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:24.004953 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f1fa50fd-26eb-486f-8c88-2deb64d8c174 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:24.004953 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f1fa50fd-26eb-486f-8c88-2deb64d8c174 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:24.004953 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f1fa50fd-26eb-486f-8c88-2deb64d8c174 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:24.004953 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f1fa50fd-26eb-486f-8c88-2deb64d8c174 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:24.712781 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c6c03204-acbc-45a6-a9a0-ece38759bf3e tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:03:24.721121 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c6c03204-acbc-45a6-a9a0-ece38759bf3e tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/7534fa45-8669-4295-b3c9-0d7478dd2eb8" status: 200 len: 1687 microversion: 2.1 time: 0.980852 Sep 23 05:03:24.725450 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3131/6097] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:03:23 2022] GET /compute/v2.1/servers/7534fa45-8669-4295-b3c9-0d7478dd2eb8 => generated 1687 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:03:24.996736 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f1fa50fd-26eb-486f-8c88-2deb64d8c174 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:03:25.012917 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f1fa50fd-26eb-486f-8c88-2deb64d8c174 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/ad2b8720-200e-4c72-8195-a62f69c2e687" status: 200 len: 1215 microversion: 2.1 time: 1.048172 Sep 23 05:03:25.014160 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2967/6098] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:03:23 2022] GET /compute/v2.1/servers/ad2b8720-200e-4c72-8195-a62f69c2e687 => generated 1215 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:03:25.755644 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2a4cdffa-edaf-496c-83f0-dcb1cfe84c79 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:03:25.756263 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-2a4cdffa-edaf-496c-83f0-dcb1cfe84c79 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 7534fa45-8669-4295-b3c9-0d7478dd2eb8] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:03:25.769106 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2a4cdffa-edaf-496c-83f0-dcb1cfe84c79 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:25.769631 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2a4cdffa-edaf-496c-83f0-dcb1cfe84c79 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:25.782978 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2a4cdffa-edaf-496c-83f0-dcb1cfe84c79 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:25.783809 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2a4cdffa-edaf-496c-83f0-dcb1cfe84c79 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:25.784295 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2a4cdffa-edaf-496c-83f0-dcb1cfe84c79 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:25.784735 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2a4cdffa-edaf-496c-83f0-dcb1cfe84c79 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:26.040883 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a35b07fa-5b72-4e24-aea1-41c4a7291e1d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:03:26.041518 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a35b07fa-5b72-4e24-aea1-41c4a7291e1d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: ad2b8720-200e-4c72-8195-a62f69c2e687] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:03:26.063249 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a35b07fa-5b72-4e24-aea1-41c4a7291e1d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:26.064057 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a35b07fa-5b72-4e24-aea1-41c4a7291e1d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:26.066408 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a35b07fa-5b72-4e24-aea1-41c4a7291e1d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:26.067201 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a35b07fa-5b72-4e24-aea1-41c4a7291e1d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:26.067694 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a35b07fa-5b72-4e24-aea1-41c4a7291e1d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:26.068139 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a35b07fa-5b72-4e24-aea1-41c4a7291e1d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:27.008483 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2a4cdffa-edaf-496c-83f0-dcb1cfe84c79 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:03:27.025185 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a35b07fa-5b72-4e24-aea1-41c4a7291e1d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:03:27.031178 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2a4cdffa-edaf-496c-83f0-dcb1cfe84c79 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/7534fa45-8669-4295-b3c9-0d7478dd2eb8" status: 200 len: 1687 microversion: 2.1 time: 1.279506 Sep 23 05:03:27.044435 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a35b07fa-5b72-4e24-aea1-41c4a7291e1d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/ad2b8720-200e-4c72-8195-a62f69c2e687" status: 200 len: 1215 microversion: 2.1 time: 1.007463 Sep 23 05:03:27.057397 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2968/6099] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:03:26 2022] GET /compute/v2.1/servers/ad2b8720-200e-4c72-8195-a62f69c2e687 => generated 1215 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:03:27.057572 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3132/6100] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:03:25 2022] GET /compute/v2.1/servers/7534fa45-8669-4295-b3c9-0d7478dd2eb8 => generated 1687 bytes in 1304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:03:27.191537 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-ea4c8ba4-99f2-4708-bfe6-fa99ce3fe938 req-5a8890d0-4f39-4691-b313-8532b0b0f677 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7534fa45-8669-4295-b3c9-0d7478dd2eb8", "name": "network-vif-deleted", "tag": "1be06b6d-5ecd-4f40-ad6a-3263a045a87c"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:03:27.203761 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-ea4c8ba4-99f2-4708-bfe6-fa99ce3fe938 req-5a8890d0-4f39-4691-b313-8532b0b0f677 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:27.205013 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-ea4c8ba4-99f2-4708-bfe6-fa99ce3fe938 req-5a8890d0-4f39-4691-b313-8532b0b0f677 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:27.205697 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-ea4c8ba4-99f2-4708-bfe6-fa99ce3fe938 req-5a8890d0-4f39-4691-b313-8532b0b0f677 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:27.219889 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-ea4c8ba4-99f2-4708-bfe6-fa99ce3fe938 req-5a8890d0-4f39-4691-b313-8532b0b0f677 service nova] Creating event network-vif-deleted:1be06b6d-5ecd-4f40-ad6a-3263a045a87c for instance 7534fa45-8669-4295-b3c9-0d7478dd2eb8 on n-h1-846463-3 Sep 23 05:03:27.226110 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-ea4c8ba4-99f2-4708-bfe6-fa99ce3fe938 req-5a8890d0-4f39-4691-b313-8532b0b0f677 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038107 Sep 23 05:03:27.227029 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2969/6101] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:03:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:03:28.061556 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-07860e25-2db1-4247-9fce-8d9d96489a36 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:03:28.062714 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-07860e25-2db1-4247-9fce-8d9d96489a36 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 7534fa45-8669-4295-b3c9-0d7478dd2eb8] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:03:28.070606 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d5385d00-3a95-4e98-be47-7f869780f496 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:03:28.071912 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d5385d00-3a95-4e98-be47-7f869780f496 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: ad2b8720-200e-4c72-8195-a62f69c2e687] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:03:28.072139 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-07860e25-2db1-4247-9fce-8d9d96489a36 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:28.082436 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d5385d00-3a95-4e98-be47-7f869780f496 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:28.083182 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d5385d00-3a95-4e98-be47-7f869780f496 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:28.086602 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d5385d00-3a95-4e98-be47-7f869780f496 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:28.091257 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-07860e25-2db1-4247-9fce-8d9d96489a36 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:28.091399 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d5385d00-3a95-4e98-be47-7f869780f496 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:28.091399 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d5385d00-3a95-4e98-be47-7f869780f496 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:28.091399 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d5385d00-3a95-4e98-be47-7f869780f496 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:28.093767 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-07860e25-2db1-4247-9fce-8d9d96489a36 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:28.095294 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-07860e25-2db1-4247-9fce-8d9d96489a36 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:28.104252 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-07860e25-2db1-4247-9fce-8d9d96489a36 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:28.108601 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-07860e25-2db1-4247-9fce-8d9d96489a36 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:28.227900 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-07860e25-2db1-4247-9fce-8d9d96489a36 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:28.228310 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-07860e25-2db1-4247-9fce-8d9d96489a36 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:28.228769 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-07860e25-2db1-4247-9fce-8d9d96489a36 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:28.233741 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-07860e25-2db1-4247-9fce-8d9d96489a36 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lazy-loading 'fault' on Instance uuid 7534fa45-8669-4295-b3c9-0d7478dd2eb8 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 05:03:28.653010 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-07860e25-2db1-4247-9fce-8d9d96489a36 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d3d0a162e7e4beb81a54120cab246ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0edd6bd5b418494fbcb05c743967d36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:03:28.662458 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-07860e25-2db1-4247-9fce-8d9d96489a36 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/7534fa45-8669-4295-b3c9-0d7478dd2eb8" status: 200 len: 1356 microversion: 2.1 time: 0.603854 Sep 23 05:03:28.674104 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3133/6102] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:03:28 2022] GET /compute/v2.1/servers/7534fa45-8669-4295-b3c9-0d7478dd2eb8 => generated 1356 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:03:28.699375 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ea2ec14d-6e66-44d9-a3c4-0f9814742c89 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0f463ce8-486f-4168-98b1-75c12f7dd2b7"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:03:28.705420 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ea2ec14d-6e66-44d9-a3c4-0f9814742c89 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 9984baa4-fc75-4d8f-a660-0647326196af] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:03:28.715403 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ea2ec14d-6e66-44d9-a3c4-0f9814742c89 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:28.716383 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ea2ec14d-6e66-44d9-a3c4-0f9814742c89 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:28.717102 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ea2ec14d-6e66-44d9-a3c4-0f9814742c89 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:28.718752 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ea2ec14d-6e66-44d9-a3c4-0f9814742c89 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:28.719507 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ea2ec14d-6e66-44d9-a3c4-0f9814742c89 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:28.720406 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ea2ec14d-6e66-44d9-a3c4-0f9814742c89 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:28.884526 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d5385d00-3a95-4e98-be47-7f869780f496 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:03:28.900210 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d5385d00-3a95-4e98-be47-7f869780f496 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/ad2b8720-200e-4c72-8195-a62f69c2e687" status: 200 len: 1203 microversion: 2.1 time: 0.833605 Sep 23 05:03:28.902096 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2970/6103] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:03:28 2022] GET /compute/v2.1/servers/ad2b8720-200e-4c72-8195-a62f69c2e687 => generated 1203 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:03:29.694542 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-aade9fb7-3da4-44c8-a47e-4526964f195c tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:03:29.695304 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-aade9fb7-3da4-44c8-a47e-4526964f195c tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [instance: 7534fa45-8669-4295-b3c9-0d7478dd2eb8] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:03:29.706291 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-aade9fb7-3da4-44c8-a47e-4526964f195c tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:29.706790 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-aade9fb7-3da4-44c8-a47e-4526964f195c tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:29.707251 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-aade9fb7-3da4-44c8-a47e-4526964f195c tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:29.707949 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-aade9fb7-3da4-44c8-a47e-4526964f195c tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:29.708432 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-aade9fb7-3da4-44c8-a47e-4526964f195c tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:29.708865 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-aade9fb7-3da4-44c8-a47e-4526964f195c tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:29.724587 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-aade9fb7-3da4-44c8-a47e-4526964f195c tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] HTTP exception thrown: Instance 7534fa45-8669-4295-b3c9-0d7478dd2eb8 could not be found. Sep 23 05:03:29.730393 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-aade9fb7-3da4-44c8-a47e-4526964f195c tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Request method failure captured: Sep 23 05:03:29.730393 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/7534fa45-8669-4295-b3c9-0d7478dd2eb8 HTTP/1.1 Sep 23 05:03:29.730393 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 05:03:29.730393 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 05:03:29.730393 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 05:03:29.730393 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 05:03:29.730393 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 05:03:29.730393 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 05:03:29.730393 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 05:03:29.730393 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 05:03:29.730393 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLTuh1c3OgRIe1BU7UL8-kD14hlRXf5-nFbACK4mxuSKPbpHtZ3lNSkhpLmoZL6fwvp0Ltsnj8vHhgRu38aM6jYq6FwsdCqK2OWFRVgv0DQ0vVXkecsl4CFvJWRuidyNHB1AUlKQZ5jbBIxVU9phuyFgTgBHHGat4T2qduHdIYS940-A Sep 23 05:03:29.730393 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 05:03:29.730393 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 05:03:29.730393 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 05:03:29.730393 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 05:03:29.730393 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 05:03:29.730393 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 05:03:29.730393 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 0edd6bd5b418494fbcb05c743967d36a Sep 23 05:03:29.730393 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-326863130 Sep 23 05:03:29.730393 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 05:03:29.730393 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 05:03:29.730393 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0edd6bd5b418494fbcb05c743967d36a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0edd6bd5b418494fbcb05c743967d36a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0edd6bd5b418494fbcb05c743967d36a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0edd6bd5b418494fbcb05c743967d36a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:03:29.730393 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-TestNetworkAdvancedServerOps-326863130 Sep 23 05:03:29.730393 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 0edd6bd5b418494fbcb05c743967d36a Sep 23 05:03:29.730393 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-326863130 Sep 23 05:03:29.730393 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-TestNetworkAdvancedServerOps-326863130-project Sep 23 05:03:29.730393 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 05:03:29.730393 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 05:03:29.730393 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 8d3d0a162e7e4beb81a54120cab246ff Sep 23 05:03:29.730393 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-TestNetworkAdvancedServerOps-326863130-project Sep 23 05:03:29.730393 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 05:03:29.730393 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 7534fa45-8669-4295-b3c9-0d7478dd2eb8 could not be found. Sep 23 05:03:29.730393 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '7534fa45-8669-4295-b3c9-0d7478dd2eb8'} Sep 23 05:03:29.730393 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:03:29.730393 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:03:29.730393 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 05:03:29.730393 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 05:03:29.730393 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 05:03:29.730393 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 05:03:29.730393 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 05:03:29.730393 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 05:03:29.730393 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 05:03:29.730393 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 05:03:29.730393 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7534fa45-8669-4295-b3c9-0d7478dd2eb8 could not be found. Sep 23 05:03:29.730393 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:03:29.730393 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:03:29.730393 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:03:29.730393 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:03:29.730393 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:03:29.730393 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:03:29.730393 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:03:29.730393 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:03:29.730393 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:03:29.730393 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:03:29.730393 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 05:03:29.730393 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 05:03:29.730393 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 05:03:29.730393 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 05:03:29.730393 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 05:03:29.730393 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:03:29.730393 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7534fa45-8669-4295-b3c9-0d7478dd2eb8 could not be found. Sep 23 05:03:29.730393 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:03:29.730393 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:03:29.737421 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:03:29.737421 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:03:29.737421 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:03:29.737421 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:03:29.737421 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:03:29.737421 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:03:29.737421 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7534fa45-8669-4295-b3c9-0d7478dd2eb8 could not be found. Sep 23 05:03:29.737421 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:03:29.744774 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ea2ec14d-6e66-44d9-a3c4-0f9814742c89 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "POST /compute/v2.1/servers/9984baa4-fc75-4d8f-a660-0647326196af/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.061337 Sep 23 05:03:29.745419 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3134/6104] 10.222.0.33 () {60 vars in 1323 bytes} [Fri Sep 23 05:03:28 2022] POST /compute/v2.1/servers/9984baa4-fc75-4d8f-a660-0647326196af/os-volume_attachments => generated 194 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:03:29.746288 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-aade9fb7-3da4-44c8-a47e-4526964f195c tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Returning 404 to user: Instance 7534fa45-8669-4295-b3c9-0d7478dd2eb8 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:03:29.748133 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-aade9fb7-3da4-44c8-a47e-4526964f195c tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "GET /compute/v2.1/servers/7534fa45-8669-4295-b3c9-0d7478dd2eb8" status: 404 len: 111 microversion: 2.1 time: 0.057524 Sep 23 05:03:29.749300 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2971/6105] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:03:29 2022] GET /compute/v2.1/servers/7534fa45-8669-4295-b3c9-0d7478dd2eb8 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 05:03:29.930831 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-913dc4f4-3860-463b-a1a7-aa8468cc41b1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:03:29.931794 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-913dc4f4-3860-463b-a1a7-aa8468cc41b1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: ad2b8720-200e-4c72-8195-a62f69c2e687] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:03:29.939459 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-913dc4f4-3860-463b-a1a7-aa8468cc41b1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:29.941228 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-913dc4f4-3860-463b-a1a7-aa8468cc41b1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:29.942207 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-913dc4f4-3860-463b-a1a7-aa8468cc41b1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:29.943695 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-913dc4f4-3860-463b-a1a7-aa8468cc41b1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:29.944833 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-913dc4f4-3860-463b-a1a7-aa8468cc41b1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:29.945931 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-913dc4f4-3860-463b-a1a7-aa8468cc41b1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:30.345527 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-913dc4f4-3860-463b-a1a7-aa8468cc41b1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:03:30.354247 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-913dc4f4-3860-463b-a1a7-aa8468cc41b1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/ad2b8720-200e-4c72-8195-a62f69c2e687" status: 200 len: 1203 microversion: 2.1 time: 0.427776 Sep 23 05:03:30.360816 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3135/6106] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:03:29 2022] GET /compute/v2.1/servers/ad2b8720-200e-4c72-8195-a62f69c2e687 => generated 1203 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:03:31.384366 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-cb3735ee-c510-4375-b131-aca835deb890 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:03:31.385671 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-cb3735ee-c510-4375-b131-aca835deb890 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: ad2b8720-200e-4c72-8195-a62f69c2e687] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:03:31.396234 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cb3735ee-c510-4375-b131-aca835deb890 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:31.398223 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cb3735ee-c510-4375-b131-aca835deb890 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:31.398760 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cb3735ee-c510-4375-b131-aca835deb890 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:31.401035 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cb3735ee-c510-4375-b131-aca835deb890 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:31.401590 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cb3735ee-c510-4375-b131-aca835deb890 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:31.402747 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cb3735ee-c510-4375-b131-aca835deb890 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:32.676117 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-cb3735ee-c510-4375-b131-aca835deb890 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:03:32.689928 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-cb3735ee-c510-4375-b131-aca835deb890 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/ad2b8720-200e-4c72-8195-a62f69c2e687" status: 200 len: 1203 microversion: 2.1 time: 1.309340 Sep 23 05:03:32.704918 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2972/6107] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:03:31 2022] GET /compute/v2.1/servers/ad2b8720-200e-4c72-8195-a62f69c2e687 => generated 1203 bytes in 1315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:03:33.720236 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f0d111e8-779d-4b9a-9ddc-83b3e699e907 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:03:33.721523 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f0d111e8-779d-4b9a-9ddc-83b3e699e907 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: ad2b8720-200e-4c72-8195-a62f69c2e687] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:03:33.732277 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f0d111e8-779d-4b9a-9ddc-83b3e699e907 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:33.741077 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f0d111e8-779d-4b9a-9ddc-83b3e699e907 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:33.741820 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f0d111e8-779d-4b9a-9ddc-83b3e699e907 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:33.745764 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f0d111e8-779d-4b9a-9ddc-83b3e699e907 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:33.746668 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f0d111e8-779d-4b9a-9ddc-83b3e699e907 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:33.748591 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f0d111e8-779d-4b9a-9ddc-83b3e699e907 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:34.189457 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f0d111e8-779d-4b9a-9ddc-83b3e699e907 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:03:34.198953 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f0d111e8-779d-4b9a-9ddc-83b3e699e907 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/ad2b8720-200e-4c72-8195-a62f69c2e687" status: 200 len: 1203 microversion: 2.1 time: 0.483213 Sep 23 05:03:34.203266 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3136/6108] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:03:33 2022] GET /compute/v2.1/servers/ad2b8720-200e-4c72-8195-a62f69c2e687 => generated 1203 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:03:35.224327 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-96869018-7710-4f2a-9b2a-3c4d37b93f24 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:03:35.224958 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-96869018-7710-4f2a-9b2a-3c4d37b93f24 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: ad2b8720-200e-4c72-8195-a62f69c2e687] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:03:35.258088 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-96869018-7710-4f2a-9b2a-3c4d37b93f24 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:35.267111 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-96869018-7710-4f2a-9b2a-3c4d37b93f24 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:35.267572 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-96869018-7710-4f2a-9b2a-3c4d37b93f24 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:35.276219 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-96869018-7710-4f2a-9b2a-3c4d37b93f24 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:35.276219 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-96869018-7710-4f2a-9b2a-3c4d37b93f24 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:35.276219 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-96869018-7710-4f2a-9b2a-3c4d37b93f24 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:35.620435 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-96869018-7710-4f2a-9b2a-3c4d37b93f24 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:03:35.634267 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-96869018-7710-4f2a-9b2a-3c4d37b93f24 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/ad2b8720-200e-4c72-8195-a62f69c2e687" status: 200 len: 1203 microversion: 2.1 time: 0.413758 Sep 23 05:03:35.635558 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2973/6109] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:03:35 2022] GET /compute/v2.1/servers/ad2b8720-200e-4c72-8195-a62f69c2e687 => generated 1203 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:03:36.666749 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3b23fe7f-8853-4d86-9ad2-9c23dacb76dc tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:03:36.666749 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-3b23fe7f-8853-4d86-9ad2-9c23dacb76dc tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: ad2b8720-200e-4c72-8195-a62f69c2e687] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:03:36.678434 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3b23fe7f-8853-4d86-9ad2-9c23dacb76dc tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:36.678902 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3b23fe7f-8853-4d86-9ad2-9c23dacb76dc tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:36.679346 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3b23fe7f-8853-4d86-9ad2-9c23dacb76dc tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:36.680077 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3b23fe7f-8853-4d86-9ad2-9c23dacb76dc tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:36.680540 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3b23fe7f-8853-4d86-9ad2-9c23dacb76dc tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:36.696483 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3b23fe7f-8853-4d86-9ad2-9c23dacb76dc tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:37.525029 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-3b23fe7f-8853-4d86-9ad2-9c23dacb76dc tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:03:37.539086 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3b23fe7f-8853-4d86-9ad2-9c23dacb76dc tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/ad2b8720-200e-4c72-8195-a62f69c2e687" status: 200 len: 1203 microversion: 2.1 time: 0.878153 Sep 23 05:03:37.540528 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3137/6110] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:03:36 2022] GET /compute/v2.1/servers/ad2b8720-200e-4c72-8195-a62f69c2e687 => generated 1203 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:03:38.570594 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d508c879-6205-4fe7-b76d-e744904745e5 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:03:38.571207 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d508c879-6205-4fe7-b76d-e744904745e5 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: ad2b8720-200e-4c72-8195-a62f69c2e687] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:03:38.593468 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d508c879-6205-4fe7-b76d-e744904745e5 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:38.595020 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d508c879-6205-4fe7-b76d-e744904745e5 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:38.602585 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d508c879-6205-4fe7-b76d-e744904745e5 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:38.602585 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d508c879-6205-4fe7-b76d-e744904745e5 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:38.602585 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d508c879-6205-4fe7-b76d-e744904745e5 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:38.602585 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d508c879-6205-4fe7-b76d-e744904745e5 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:38.653054 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-aeb9b7ea-0d50-4dcb-a3ef-6617e0892574 req-b6e42f9d-8e43-4ece-ae03-e466978ea2b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad2b8720-200e-4c72-8195-a62f69c2e687", "name": "network-vif-plugged", "status": "completed", "tag": "20f7b10b-a976-4861-9d48-1b77a8203784"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:03:38.683882 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-aeb9b7ea-0d50-4dcb-a3ef-6617e0892574 req-b6e42f9d-8e43-4ece-ae03-e466978ea2b7 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:38.684797 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-aeb9b7ea-0d50-4dcb-a3ef-6617e0892574 req-b6e42f9d-8e43-4ece-ae03-e466978ea2b7 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:38.690925 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-aeb9b7ea-0d50-4dcb-a3ef-6617e0892574 req-b6e42f9d-8e43-4ece-ae03-e466978ea2b7 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:38.728132 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:03:38.736129 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-aeb9b7ea-0d50-4dcb-a3ef-6617e0892574 req-b6e42f9d-8e43-4ece-ae03-e466978ea2b7 service nova] Creating event network-vif-plugged:20f7b10b-a976-4861-9d48-1b77a8203784 for instance ad2b8720-200e-4c72-8195-a62f69c2e687 on n-h1-846463-3 Sep 23 05:03:38.754205 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-aeb9b7ea-0d50-4dcb-a3ef-6617e0892574 req-b6e42f9d-8e43-4ece-ae03-e466978ea2b7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105979 Sep 23 05:03:38.758770 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3138/6111] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:03:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Sep 23 05:03:39.758535 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d508c879-6205-4fe7-b76d-e744904745e5 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:03:39.773187 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d508c879-6205-4fe7-b76d-e744904745e5 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/ad2b8720-200e-4c72-8195-a62f69c2e687" status: 200 len: 1203 microversion: 2.1 time: 1.208029 Sep 23 05:03:39.787603 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2974/6112] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:03:38 2022] GET /compute/v2.1/servers/ad2b8720-200e-4c72-8195-a62f69c2e687 => generated 1203 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:03:40.391736 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b7f7db04-8ab5-46c4-b93b-3c2e4baa0a54 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] Calling method '.version_select at 0x7ff1babf11f0>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:03:40.416955 n-d-846463-3 devstack@n-api.service[122699]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b7f7db04-8ab5-46c4-b93b-3c2e4baa0a54 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [77f72e41-09e4-435a-9369-351999b7498d] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 23 05:03:40.801114 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6c794ed3-73a2-46e5-8d9d-b1a9a0c5de26 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:03:40.802529 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-6c794ed3-73a2-46e5-8d9d-b1a9a0c5de26 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: ad2b8720-200e-4c72-8195-a62f69c2e687] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:03:40.823135 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6c794ed3-73a2-46e5-8d9d-b1a9a0c5de26 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:40.823929 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6c794ed3-73a2-46e5-8d9d-b1a9a0c5de26 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:40.829366 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6c794ed3-73a2-46e5-8d9d-b1a9a0c5de26 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:40.829366 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6c794ed3-73a2-46e5-8d9d-b1a9a0c5de26 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:40.830105 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6c794ed3-73a2-46e5-8d9d-b1a9a0c5de26 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:40.830719 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6c794ed3-73a2-46e5-8d9d-b1a9a0c5de26 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:41.292449 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6c794ed3-73a2-46e5-8d9d-b1a9a0c5de26 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:03:41.301944 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-6c794ed3-73a2-46e5-8d9d-b1a9a0c5de26 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/ad2b8720-200e-4c72-8195-a62f69c2e687" status: 200 len: 1391 microversion: 2.1 time: 0.504978 Sep 23 05:03:41.303125 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2975/6113] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:03:40 2022] GET /compute/v2.1/servers/ad2b8720-200e-4c72-8195-a62f69c2e687 => generated 1391 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:03:41.329381 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e68fdfca-9f2b-45a9-82b3-cd82efc44424 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:03:41.330048 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e68fdfca-9f2b-45a9-82b3-cd82efc44424 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: ad2b8720-200e-4c72-8195-a62f69c2e687] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:03:41.344733 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e68fdfca-9f2b-45a9-82b3-cd82efc44424 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:41.344733 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e68fdfca-9f2b-45a9-82b3-cd82efc44424 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:41.344733 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e68fdfca-9f2b-45a9-82b3-cd82efc44424 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:41.344733 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e68fdfca-9f2b-45a9-82b3-cd82efc44424 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:41.344733 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e68fdfca-9f2b-45a9-82b3-cd82efc44424 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:41.344733 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e68fdfca-9f2b-45a9-82b3-cd82efc44424 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:41.419854 n-d-846463-3 devstack@n-api.service[122699]: INFO oslo.messaging._drivers.impl_rabbit [None req-b7f7db04-8ab5-46c4-b93b-3c2e4baa0a54 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] [77f72e41-09e4-435a-9369-351999b7498d] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 57134. Sep 23 05:03:41.437068 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=37 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:03:41.621554 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b7f7db04-8ab5-46c4-b93b-3c2e4baa0a54 tempest-TestNetworkAdvancedServerOps-326863130 tempest-TestNetworkAdvancedServerOps-326863130-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1122301964" status: 202 len: 0 microversion: 2.1 time: 1.235345 Sep 23 05:03:41.623156 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3139/6114] 10.222.0.33 () {58 vars in 1284 bytes} [Fri Sep 23 05:03:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1122301964 => generated 0 bytes in 1238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 05:03:41.847564 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e68fdfca-9f2b-45a9-82b3-cd82efc44424 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:03:41.867266 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e68fdfca-9f2b-45a9-82b3-cd82efc44424 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/ad2b8720-200e-4c72-8195-a62f69c2e687" status: 200 len: 1391 microversion: 2.1 time: 0.541972 Sep 23 05:03:41.870885 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2976/6115] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:03:41 2022] GET /compute/v2.1/servers/ad2b8720-200e-4c72-8195-a62f69c2e687 => generated 1391 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:03:41.893393 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-65c860ca-703e-453e-a8eb-4595080470e5 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:03:41.894778 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-65c860ca-703e-453e-a8eb-4595080470e5 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: ad2b8720-200e-4c72-8195-a62f69c2e687] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:03:41.903924 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-65c860ca-703e-453e-a8eb-4595080470e5 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:41.904672 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-65c860ca-703e-453e-a8eb-4595080470e5 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:41.906203 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-65c860ca-703e-453e-a8eb-4595080470e5 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:41.907158 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-65c860ca-703e-453e-a8eb-4595080470e5 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:41.907850 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-65c860ca-703e-453e-a8eb-4595080470e5 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:41.908454 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-65c860ca-703e-453e-a8eb-4595080470e5 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:41.935109 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:03:42.305115 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-65c860ca-703e-453e-a8eb-4595080470e5 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:03:42.320947 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-65c860ca-703e-453e-a8eb-4595080470e5 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/ad2b8720-200e-4c72-8195-a62f69c2e687" status: 200 len: 1391 microversion: 2.1 time: 0.427304 Sep 23 05:03:42.331904 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3140/6116] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:03:41 2022] GET /compute/v2.1/servers/ad2b8720-200e-4c72-8195-a62f69c2e687 => generated 1391 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:03:42.352824 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-513b0dd6-a42c-4702-aa42-1adf719ea3c0 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:03:42.353263 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-513b0dd6-a42c-4702-aa42-1adf719ea3c0 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: ad2b8720-200e-4c72-8195-a62f69c2e687] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:03:42.363027 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-513b0dd6-a42c-4702-aa42-1adf719ea3c0 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:42.363561 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-513b0dd6-a42c-4702-aa42-1adf719ea3c0 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:42.366017 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-513b0dd6-a42c-4702-aa42-1adf719ea3c0 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:42.366945 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-513b0dd6-a42c-4702-aa42-1adf719ea3c0 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:42.371391 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-513b0dd6-a42c-4702-aa42-1adf719ea3c0 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:42.372084 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-513b0dd6-a42c-4702-aa42-1adf719ea3c0 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:42.431495 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-513b0dd6-a42c-4702-aa42-1adf719ea3c0 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: ad2b8720-200e-4c72-8195-a62f69c2e687] Going to try to terminate instance {{(pid=122698) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 05:03:42.905589 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-513b0dd6-a42c-4702-aa42-1adf719ea3c0 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ad2b8720-200e-4c72-8195-a62f69c2e687" status: 204 len: 0 microversion: 2.1 time: 0.557205 Sep 23 05:03:42.906990 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2977/6117] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 05:03:42 2022] DELETE /compute/v2.1/servers/ad2b8720-200e-4c72-8195-a62f69c2e687 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 05:03:42.918961 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4d2cda85-2b83-4d2e-9ebb-88fc08fe46a6 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:03:42.920986 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4d2cda85-2b83-4d2e-9ebb-88fc08fe46a6 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: ad2b8720-200e-4c72-8195-a62f69c2e687] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:03:42.958533 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4d2cda85-2b83-4d2e-9ebb-88fc08fe46a6 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:42.968072 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4d2cda85-2b83-4d2e-9ebb-88fc08fe46a6 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:42.970079 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4d2cda85-2b83-4d2e-9ebb-88fc08fe46a6 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:42.971458 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4d2cda85-2b83-4d2e-9ebb-88fc08fe46a6 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:42.974533 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4d2cda85-2b83-4d2e-9ebb-88fc08fe46a6 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:42.979875 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4d2cda85-2b83-4d2e-9ebb-88fc08fe46a6 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:44.004002 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-4d2cda85-2b83-4d2e-9ebb-88fc08fe46a6 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:03:44.027167 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4d2cda85-2b83-4d2e-9ebb-88fc08fe46a6 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/ad2b8720-200e-4c72-8195-a62f69c2e687" status: 200 len: 1397 microversion: 2.1 time: 1.112963 Sep 23 05:03:44.027330 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3141/6118] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:03:42 2022] GET /compute/v2.1/servers/ad2b8720-200e-4c72-8195-a62f69c2e687 => generated 1397 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:03:45.053616 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-bef8bd94-f18a-4f7a-9c13-5f4f6650e97f tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:03:45.054375 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-bef8bd94-f18a-4f7a-9c13-5f4f6650e97f tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: ad2b8720-200e-4c72-8195-a62f69c2e687] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:03:45.088682 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bef8bd94-f18a-4f7a-9c13-5f4f6650e97f tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:45.091349 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bef8bd94-f18a-4f7a-9c13-5f4f6650e97f tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:45.092163 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bef8bd94-f18a-4f7a-9c13-5f4f6650e97f tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:45.094768 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bef8bd94-f18a-4f7a-9c13-5f4f6650e97f tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:45.096131 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bef8bd94-f18a-4f7a-9c13-5f4f6650e97f tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:45.096946 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bef8bd94-f18a-4f7a-9c13-5f4f6650e97f tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:45.761410 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-39501611-bc36-428c-b082-bc7588e800b5 req-51253474-7d1d-404f-b46c-042c98ef2f01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad2b8720-200e-4c72-8195-a62f69c2e687", "name": "network-vif-deleted", "tag": "20f7b10b-a976-4861-9d48-1b77a8203784"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:03:45.805460 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-39501611-bc36-428c-b082-bc7588e800b5 req-51253474-7d1d-404f-b46c-042c98ef2f01 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:45.810332 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-39501611-bc36-428c-b082-bc7588e800b5 req-51253474-7d1d-404f-b46c-042c98ef2f01 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:45.812531 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-39501611-bc36-428c-b082-bc7588e800b5 req-51253474-7d1d-404f-b46c-042c98ef2f01 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:45.886284 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-39501611-bc36-428c-b082-bc7588e800b5 req-51253474-7d1d-404f-b46c-042c98ef2f01 service nova] Creating event network-vif-deleted:20f7b10b-a976-4861-9d48-1b77a8203784 for instance ad2b8720-200e-4c72-8195-a62f69c2e687 on n-h1-846463-3 Sep 23 05:03:45.908790 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-39501611-bc36-428c-b082-bc7588e800b5 req-51253474-7d1d-404f-b46c-042c98ef2f01 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149886 Sep 23 05:03:45.912877 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3142/6119] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:03:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:03:45.994259 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-bef8bd94-f18a-4f7a-9c13-5f4f6650e97f tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:03:46.004744 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-bef8bd94-f18a-4f7a-9c13-5f4f6650e97f tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/ad2b8720-200e-4c72-8195-a62f69c2e687" status: 200 len: 1397 microversion: 2.1 time: 0.956801 Sep 23 05:03:46.005826 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2978/6120] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:03:45 2022] GET /compute/v2.1/servers/ad2b8720-200e-4c72-8195-a62f69c2e687 => generated 1397 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:03:46.599607 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c1929cb0-15f0-439f-89f5-4dd25a9d035d tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Action: 'create', calling method: .version_select at 0x7ff1bb875d30>, body: {"keypair": {"name": "tempest-keypair-513613458", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP9Z066Iy0CBhEf0hF1hOFwBEMt+1presX4ZcQ5Dtfb4powy1zVsuhj1N/pqb+5bchfldmSIOWTpP9WTRVzsJ+VouaX2RcT4lDHGd7M2jipLIfP+A1sQwVUl6IOnA2WFkw=="}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:03:46.618216 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-c1929cb0-15f0-439f-89f5-4dd25a9d035d tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Getting quotas for project daad67f26fe246d6b4d28cad1707a119. Resources: {'key_pairs'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 05:03:46.628225 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-c1929cb0-15f0-439f-89f5-4dd25a9d035d tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Getting quotas for user 59d90150ed7d477fab33129cb3b068ed and project daad67f26fe246d6b4d28cad1707a119. Resources: {'key_pairs'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 05:03:46.848180 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c1929cb0-15f0-439f-89f5-4dd25a9d035d tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.265862 Sep 23 05:03:46.850585 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3143/6121] 10.222.0.33 () {60 vars in 1159 bytes} [Fri Sep 23 05:03:46 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:03:47.029643 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4bba3f14-ee15-4b44-8c08-3340b9acea60 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:03:47.030864 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4bba3f14-ee15-4b44-8c08-3340b9acea60 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: ad2b8720-200e-4c72-8195-a62f69c2e687] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:03:47.046200 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4bba3f14-ee15-4b44-8c08-3340b9acea60 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:47.058509 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4bba3f14-ee15-4b44-8c08-3340b9acea60 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:47.063446 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4bba3f14-ee15-4b44-8c08-3340b9acea60 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:47.063446 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4bba3f14-ee15-4b44-8c08-3340b9acea60 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:47.063446 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4bba3f14-ee15-4b44-8c08-3340b9acea60 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:47.063820 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4bba3f14-ee15-4b44-8c08-3340b9acea60 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:47.175013 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4bba3f14-ee15-4b44-8c08-3340b9acea60 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:03:47.187467 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4bba3f14-ee15-4b44-8c08-3340b9acea60 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/ad2b8720-200e-4c72-8195-a62f69c2e687" status: 200 len: 1188 microversion: 2.1 time: 0.160450 Sep 23 05:03:47.188137 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2979/6122] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:03:47 2022] GET /compute/v2.1/servers/ad2b8720-200e-4c72-8195-a62f69c2e687 => generated 1188 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:03:48.211123 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-67a1e38c-f91a-493a-9f8c-de397b481094 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:03:48.211123 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-67a1e38c-f91a-493a-9f8c-de397b481094 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: ad2b8720-200e-4c72-8195-a62f69c2e687] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:03:48.234161 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-67a1e38c-f91a-493a-9f8c-de397b481094 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:48.234683 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-67a1e38c-f91a-493a-9f8c-de397b481094 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:48.235129 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-67a1e38c-f91a-493a-9f8c-de397b481094 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:48.242673 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-67a1e38c-f91a-493a-9f8c-de397b481094 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:48.243181 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-67a1e38c-f91a-493a-9f8c-de397b481094 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:48.243629 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-67a1e38c-f91a-493a-9f8c-de397b481094 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:48.413127 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-67a1e38c-f91a-493a-9f8c-de397b481094 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:03:48.451970 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-67a1e38c-f91a-493a-9f8c-de397b481094 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/ad2b8720-200e-4c72-8195-a62f69c2e687" status: 200 len: 1188 microversion: 2.1 time: 0.238146 Sep 23 05:03:48.455787 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3144/6123] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:03:48 2022] GET /compute/v2.1/servers/ad2b8720-200e-4c72-8195-a62f69c2e687 => generated 1188 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:03:49.481466 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3852b419-8b3d-4547-89fe-d5ce5ce3bf54 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:03:49.482199 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3852b419-8b3d-4547-89fe-d5ce5ce3bf54 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: ad2b8720-200e-4c72-8195-a62f69c2e687] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:03:49.493078 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:03:49.496002 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3852b419-8b3d-4547-89fe-d5ce5ce3bf54 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:49.496498 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3852b419-8b3d-4547-89fe-d5ce5ce3bf54 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:49.500653 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3852b419-8b3d-4547-89fe-d5ce5ce3bf54 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:49.502059 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3852b419-8b3d-4547-89fe-d5ce5ce3bf54 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:49.503581 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3852b419-8b3d-4547-89fe-d5ce5ce3bf54 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:49.509024 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3852b419-8b3d-4547-89fe-d5ce5ce3bf54 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:49.767844 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-3852b419-8b3d-4547-89fe-d5ce5ce3bf54 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:03:49.792817 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3852b419-8b3d-4547-89fe-d5ce5ce3bf54 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/ad2b8720-200e-4c72-8195-a62f69c2e687" status: 200 len: 1188 microversion: 2.1 time: 0.316020 Sep 23 05:03:49.801085 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2980/6124] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:03:49 2022] GET /compute/v2.1/servers/ad2b8720-200e-4c72-8195-a62f69c2e687 => generated 1188 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:03:50.840590 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e7c6b5c4-8cd6-45a4-901d-9dc5af2c3d67 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:03:50.841855 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e7c6b5c4-8cd6-45a4-901d-9dc5af2c3d67 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: ad2b8720-200e-4c72-8195-a62f69c2e687] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:03:50.874064 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e7c6b5c4-8cd6-45a4-901d-9dc5af2c3d67 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:50.875519 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e7c6b5c4-8cd6-45a4-901d-9dc5af2c3d67 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:50.876974 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e7c6b5c4-8cd6-45a4-901d-9dc5af2c3d67 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:50.880356 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e7c6b5c4-8cd6-45a4-901d-9dc5af2c3d67 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:50.883241 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e7c6b5c4-8cd6-45a4-901d-9dc5af2c3d67 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:50.884838 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e7c6b5c4-8cd6-45a4-901d-9dc5af2c3d67 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:51.881396 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e7c6b5c4-8cd6-45a4-901d-9dc5af2c3d67 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:03:51.911773 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e7c6b5c4-8cd6-45a4-901d-9dc5af2c3d67 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/ad2b8720-200e-4c72-8195-a62f69c2e687" status: 200 len: 1188 microversion: 2.1 time: 1.085320 Sep 23 05:03:51.930164 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3145/6125] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:03:50 2022] GET /compute/v2.1/servers/ad2b8720-200e-4c72-8195-a62f69c2e687 => generated 1188 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:03:52.950544 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0e3891cd-f221-48b5-bf85-3dbbf7c819ed tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:03:52.952022 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-0e3891cd-f221-48b5-bf85-3dbbf7c819ed tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: ad2b8720-200e-4c72-8195-a62f69c2e687] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:03:52.984835 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0e3891cd-f221-48b5-bf85-3dbbf7c819ed tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:52.990721 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0e3891cd-f221-48b5-bf85-3dbbf7c819ed tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:52.992039 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0e3891cd-f221-48b5-bf85-3dbbf7c819ed tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:52.994709 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0e3891cd-f221-48b5-bf85-3dbbf7c819ed tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:52.997424 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0e3891cd-f221-48b5-bf85-3dbbf7c819ed tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:52.999062 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0e3891cd-f221-48b5-bf85-3dbbf7c819ed tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:53.580029 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-0e3891cd-f221-48b5-bf85-3dbbf7c819ed tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:03:53.598317 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0e3891cd-f221-48b5-bf85-3dbbf7c819ed tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/ad2b8720-200e-4c72-8195-a62f69c2e687" status: 200 len: 1188 microversion: 2.1 time: 0.662912 Sep 23 05:03:53.602016 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2981/6126] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:03:52 2022] GET /compute/v2.1/servers/ad2b8720-200e-4c72-8195-a62f69c2e687 => generated 1188 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:03:54.629854 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9a034f5f-1f97-45bb-8941-0f8cb8bd5615 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:03:54.631484 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-9a034f5f-1f97-45bb-8941-0f8cb8bd5615 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: ad2b8720-200e-4c72-8195-a62f69c2e687] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:03:54.646309 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9a034f5f-1f97-45bb-8941-0f8cb8bd5615 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:54.647084 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9a034f5f-1f97-45bb-8941-0f8cb8bd5615 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:54.650587 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9a034f5f-1f97-45bb-8941-0f8cb8bd5615 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:54.652074 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9a034f5f-1f97-45bb-8941-0f8cb8bd5615 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:54.652778 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9a034f5f-1f97-45bb-8941-0f8cb8bd5615 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:54.653443 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9a034f5f-1f97-45bb-8941-0f8cb8bd5615 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:54.858711 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-9a034f5f-1f97-45bb-8941-0f8cb8bd5615 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:03:54.892479 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-9a034f5f-1f97-45bb-8941-0f8cb8bd5615 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/ad2b8720-200e-4c72-8195-a62f69c2e687" status: 200 len: 1188 microversion: 2.1 time: 0.267048 Sep 23 05:03:54.901104 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3146/6127] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:03:54 2022] GET /compute/v2.1/servers/ad2b8720-200e-4c72-8195-a62f69c2e687 => generated 1188 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:03:55.605325 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a8702321-2b10-4c6b-8957-9c59aba466f2 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-570318559", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0ed8d15f-c597-425d-b882-0a82aeae94d2"}], "security_groups": [{"name": "tempest-securitygroup--444252255"}], "key_name": "tempest-keypair-513613458", "user_data": "}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:03:55.921402 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d935c0fe-feca-408e-93a6-1dc971376637 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:03:55.922731 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d935c0fe-feca-408e-93a6-1dc971376637 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: ad2b8720-200e-4c72-8195-a62f69c2e687] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:03:55.944410 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d935c0fe-feca-408e-93a6-1dc971376637 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:55.945461 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d935c0fe-feca-408e-93a6-1dc971376637 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:55.948488 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d935c0fe-feca-408e-93a6-1dc971376637 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:55.951911 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d935c0fe-feca-408e-93a6-1dc971376637 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:55.958695 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d935c0fe-feca-408e-93a6-1dc971376637 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:55.959558 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d935c0fe-feca-408e-93a6-1dc971376637 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:56.217721 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d935c0fe-feca-408e-93a6-1dc971376637 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:03:56.228600 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d935c0fe-feca-408e-93a6-1dc971376637 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/ad2b8720-200e-4c72-8195-a62f69c2e687" status: 200 len: 1188 microversion: 2.1 time: 0.311703 Sep 23 05:03:56.233550 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3147/6128] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:03:55 2022] GET /compute/v2.1/servers/ad2b8720-200e-4c72-8195-a62f69c2e687 => generated 1188 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:03:56.368783 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.network.neutron [None req-a8702321-2b10-4c6b-8957-9c59aba466f2 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] validate_networks() for [('0ed8d15f-c597-425d-b882-0a82aeae94d2', None, None, None, None, None)] {{(pid=122698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 05:03:57.260521 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-61177c27-c516-4950-a59e-943c74e9485e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:03:57.263067 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-61177c27-c516-4950-a59e-943c74e9485e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: ad2b8720-200e-4c72-8195-a62f69c2e687] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:03:57.267161 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=4 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:03:57.277554 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-61177c27-c516-4950-a59e-943c74e9485e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:57.278102 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-61177c27-c516-4950-a59e-943c74e9485e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:57.280746 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-61177c27-c516-4950-a59e-943c74e9485e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:57.281708 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-61177c27-c516-4950-a59e-943c74e9485e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:57.282234 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-61177c27-c516-4950-a59e-943c74e9485e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:57.282808 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-61177c27-c516-4950-a59e-943c74e9485e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:57.705353 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-61177c27-c516-4950-a59e-943c74e9485e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:03:57.727808 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-61177c27-c516-4950-a59e-943c74e9485e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/ad2b8720-200e-4c72-8195-a62f69c2e687" status: 200 len: 1188 microversion: 2.1 time: 0.464340 Sep 23 05:03:57.753573 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3148/6129] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:03:57 2022] GET /compute/v2.1/servers/ad2b8720-200e-4c72-8195-a62f69c2e687 => generated 1188 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:03:58.753311 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a85b5113-84ec-4b2b-98f3-fe0e0c9ed76c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:03:58.754041 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a85b5113-84ec-4b2b-98f3-fe0e0c9ed76c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: ad2b8720-200e-4c72-8195-a62f69c2e687] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:03:58.766342 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a85b5113-84ec-4b2b-98f3-fe0e0c9ed76c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:58.767042 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a85b5113-84ec-4b2b-98f3-fe0e0c9ed76c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:58.767814 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a85b5113-84ec-4b2b-98f3-fe0e0c9ed76c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:58.768721 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a85b5113-84ec-4b2b-98f3-fe0e0c9ed76c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:58.769514 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a85b5113-84ec-4b2b-98f3-fe0e0c9ed76c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:58.770178 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a85b5113-84ec-4b2b-98f3-fe0e0c9ed76c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:58.853667 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a85b5113-84ec-4b2b-98f3-fe0e0c9ed76c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:58.854772 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a85b5113-84ec-4b2b-98f3-fe0e0c9ed76c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:58.858087 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a85b5113-84ec-4b2b-98f3-fe0e0c9ed76c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:58.864475 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-a85b5113-84ec-4b2b-98f3-fe0e0c9ed76c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lazy-loading 'fault' on Instance uuid ad2b8720-200e-4c72-8195-a62f69c2e687 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 05:03:59.267818 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a85b5113-84ec-4b2b-98f3-fe0e0c9ed76c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:03:59.277788 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a85b5113-84ec-4b2b-98f3-fe0e0c9ed76c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/ad2b8720-200e-4c72-8195-a62f69c2e687" status: 200 len: 1147 microversion: 2.1 time: 0.529528 Sep 23 05:03:59.291845 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3149/6130] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:03:58 2022] GET /compute/v2.1/servers/ad2b8720-200e-4c72-8195-a62f69c2e687 => generated 1147 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:03:59.753485 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-a8702321-2b10-4c6b-8957-9c59aba466f2 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Flavor limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 05:03:59.754089 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-a8702321-2b10-4c6b-8957-9c59aba466f2 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Image limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 05:03:59.754416 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-a8702321-2b10-4c6b-8957-9c59aba466f2 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Flavor pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 05:03:59.755080 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-a8702321-2b10-4c6b-8957-9c59aba466f2 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Image pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 05:03:59.756050 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-a8702321-2b10-4c6b-8957-9c59aba466f2 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 05:03:59.784602 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a8702321-2b10-4c6b-8957-9c59aba466f2 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:59.786079 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a8702321-2b10-4c6b-8957-9c59aba466f2 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:59.789263 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a8702321-2b10-4c6b-8957-9c59aba466f2 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:59.794488 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a8702321-2b10-4c6b-8957-9c59aba466f2 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:03:59.797451 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a8702321-2b10-4c6b-8957-9c59aba466f2 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:03:59.798138 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a8702321-2b10-4c6b-8957-9c59aba466f2 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:03:59.871923 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-a8702321-2b10-4c6b-8957-9c59aba466f2 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Getting quotas for project daad67f26fe246d6b4d28cad1707a119. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 05:03:59.894758 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-a8702321-2b10-4c6b-8957-9c59aba466f2 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Getting quotas for user 59d90150ed7d477fab33129cb3b068ed and project daad67f26fe246d6b4d28cad1707a119. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 05:03:59.919252 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a8702321-2b10-4c6b-8957-9c59aba466f2 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Going to run 1 instances... {{(pid=122698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 05:03:59.923091 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a8702321-2b10-4c6b-8957-9c59aba466f2 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: f67681e5-fced-41b4-ae7c-7ce922f09df1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 05:04:00.093645 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a8702321-2b10-4c6b-8957-9c59aba466f2 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 4.495262 Sep 23 05:04:00.108837 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2982/6131] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 05:03:55 2022] POST /compute/v2.1/servers => generated 401 bytes in 4511 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 05:04:00.114288 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-cee88b98-6a0f-4d42-86bd-e8bd7c7b76b3 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:04:00.115081 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-cee88b98-6a0f-4d42-86bd-e8bd7c7b76b3 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: f67681e5-fced-41b4-ae7c-7ce922f09df1] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:04:00.264043 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c49fb3fc-6af7-4227-ba8b-709aa9a1a398 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Action: 'create', calling method: .version_select at 0x7ff1ba9aa3a0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-303851972", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO5mJTAonNRA4B8EVU8zK5G2j8Bxa7dHt91+8I0ZevFVE7YShLAJiPGgqc7N+tRHXm8V+IP/0iT1/o9e31TQ/EPBCUMXbG67b713eyQt2yPVmSCfvAc1geIgtnR4DeCpUQ=="}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:04:00.273747 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-cee88b98-6a0f-4d42-86bd-e8bd7c7b76b3 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d90150ed7d477fab33129cb3b068ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daad67f26fe246d6b4d28cad1707a119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:04:00.289361 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-cee88b98-6a0f-4d42-86bd-e8bd7c7b76b3 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/f67681e5-fced-41b4-ae7c-7ce922f09df1" status: 200 len: 1240 microversion: 2.1 time: 0.180031 Sep 23 05:04:00.296296 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3150/6132] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:04:00 2022] GET /compute/v2.1/servers/f67681e5-fced-41b4-ae7c-7ce922f09df1 => generated 1240 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:04:00.311435 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a1357bb3-cb09-4457-b870-f58d134d0982 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:04:00.322617 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a1357bb3-cb09-4457-b870-f58d134d0982 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: ad2b8720-200e-4c72-8195-a62f69c2e687] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:04:00.344475 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a1357bb3-cb09-4457-b870-f58d134d0982 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:00.346409 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a1357bb3-cb09-4457-b870-f58d134d0982 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:00.347323 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-c49fb3fc-6af7-4227-ba8b-709aa9a1a398 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Getting quotas for project 5fefb9fd80184955a7856e1c41d081be. Resources: {'key_pairs'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 05:04:00.348888 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a1357bb3-cb09-4457-b870-f58d134d0982 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:00.350604 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a1357bb3-cb09-4457-b870-f58d134d0982 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:00.353237 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a1357bb3-cb09-4457-b870-f58d134d0982 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:00.353987 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a1357bb3-cb09-4457-b870-f58d134d0982 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:00.373610 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-c49fb3fc-6af7-4227-ba8b-709aa9a1a398 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Getting quotas for user b3e8ce1f6821424080453f994dbcd604 and project 5fefb9fd80184955a7856e1c41d081be. Resources: {'key_pairs'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 05:04:00.392332 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-a1357bb3-cb09-4457-b870-f58d134d0982 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] HTTP exception thrown: Instance ad2b8720-200e-4c72-8195-a62f69c2e687 could not be found. Sep 23 05:04:00.395265 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a1357bb3-cb09-4457-b870-f58d134d0982 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Request method failure captured: Sep 23 05:04:00.395265 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/ad2b8720-200e-4c72-8195-a62f69c2e687 HTTP/1.1 Sep 23 05:04:00.395265 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 05:04:00.395265 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 05:04:00.395265 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 05:04:00.395265 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 05:04:00.395265 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 05:04:00.395265 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 05:04:00.395265 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 05:04:00.395265 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 05:04:00.395265 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLT3uLjiu4nPUFbkjrA4MyWVqiSG18wQr6d8tQl_P_I7oXAw8rp2FE6LolJR7q-NpMkbDL2xBtL-Km4xLll-czE6HybNQXkbhp5AdNp7lc8uSbgBeOP-qACziHhtaYPCszQMgYlHiKqFljv5hFyHB9WCa7Y2j2z8m1qKy7sQfYfHm2rE Sep 23 05:04:00.395265 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 05:04:00.395265 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 05:04:00.395265 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 05:04:00.395265 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 05:04:00.395265 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 05:04:00.395265 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 05:04:00.395265 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: cceaa1e24146497fbf3f79cebc112211 Sep 23 05:04:00.395265 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-TestVolumeBootPattern-1815855430 Sep 23 05:04:00.395265 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 05:04:00.395265 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 05:04:00.395265 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cceaa1e24146497fbf3f79cebc112211", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cceaa1e24146497fbf3f79cebc112211"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cceaa1e24146497fbf3f79cebc112211"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cceaa1e24146497fbf3f79cebc112211"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:04:00.395265 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-TestVolumeBootPattern-1815855430 Sep 23 05:04:00.395265 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: cceaa1e24146497fbf3f79cebc112211 Sep 23 05:04:00.395265 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-TestVolumeBootPattern-1815855430 Sep 23 05:04:00.395265 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-TestVolumeBootPattern-1815855430-project Sep 23 05:04:00.395265 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 05:04:00.395265 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 05:04:00.395265 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 0d55fe5072c14752846eb4ffc0eef91b Sep 23 05:04:00.395265 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-TestVolumeBootPattern-1815855430-project Sep 23 05:04:00.395265 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 05:04:00.395265 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance ad2b8720-200e-4c72-8195-a62f69c2e687 could not be found. Sep 23 05:04:00.395265 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': 'ad2b8720-200e-4c72-8195-a62f69c2e687'} Sep 23 05:04:00.395265 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:04:00.395265 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:04:00.395265 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 05:04:00.395265 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 05:04:00.395265 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 05:04:00.395265 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 05:04:00.395265 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 05:04:00.395265 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 05:04:00.395265 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 05:04:00.395265 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 05:04:00.395265 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad2b8720-200e-4c72-8195-a62f69c2e687 could not be found. Sep 23 05:04:00.395265 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:04:00.395265 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:04:00.395265 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:04:00.395265 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:04:00.395265 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:04:00.395265 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:04:00.395265 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:04:00.395265 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:04:00.395265 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:04:00.395265 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:04:00.395265 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 05:04:00.395265 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 05:04:00.395265 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 05:04:00.395265 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 05:04:00.395265 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 05:04:00.395265 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:04:00.395265 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad2b8720-200e-4c72-8195-a62f69c2e687 could not be found. Sep 23 05:04:00.395265 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:04:00.395265 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:04:00.395265 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:04:00.399861 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:04:00.399861 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:04:00.399861 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:04:00.399861 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:04:00.399861 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:04:00.399861 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad2b8720-200e-4c72-8195-a62f69c2e687 could not be found. Sep 23 05:04:00.399861 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:04:00.404980 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a1357bb3-cb09-4457-b870-f58d134d0982 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Returning 404 to user: Instance ad2b8720-200e-4c72-8195-a62f69c2e687 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:04:00.406256 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a1357bb3-cb09-4457-b870-f58d134d0982 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/ad2b8720-200e-4c72-8195-a62f69c2e687" status: 404 len: 111 microversion: 2.1 time: 0.101790 Sep 23 05:04:00.410664 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3151/6133] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:04:00 2022] GET /compute/v2.1/servers/ad2b8720-200e-4c72-8195-a62f69c2e687 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 05:04:00.572992 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c49fb3fc-6af7-4227-ba8b-709aa9a1a398 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.315559 Sep 23 05:04:00.573936 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2983/6134] 10.222.0.33 () {60 vars in 1159 bytes} [Fri Sep 23 05:04:00 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:04:01.331507 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e53d7f41-6f7e-40ec-883f-50e66bc9faa8 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:04:01.332145 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e53d7f41-6f7e-40ec-883f-50e66bc9faa8 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: f67681e5-fced-41b4-ae7c-7ce922f09df1] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:04:01.578780 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e53d7f41-6f7e-40ec-883f-50e66bc9faa8 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d90150ed7d477fab33129cb3b068ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daad67f26fe246d6b4d28cad1707a119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:04:01.590586 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e53d7f41-6f7e-40ec-883f-50e66bc9faa8 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/f67681e5-fced-41b4-ae7c-7ce922f09df1" status: 200 len: 1240 microversion: 2.1 time: 0.267672 Sep 23 05:04:01.592937 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3152/6135] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:04:01 2022] GET /compute/v2.1/servers/f67681e5-fced-41b4-ae7c-7ce922f09df1 => generated 1240 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:04:02.631176 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3557c580-d2f8-4244-a828-9d2a054c8af7 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:04:02.632550 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3557c580-d2f8-4244-a828-9d2a054c8af7 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: f67681e5-fced-41b4-ae7c-7ce922f09df1] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:04:02.672199 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3557c580-d2f8-4244-a828-9d2a054c8af7 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:02.672709 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3557c580-d2f8-4244-a828-9d2a054c8af7 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:02.673235 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3557c580-d2f8-4244-a828-9d2a054c8af7 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:02.673967 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3557c580-d2f8-4244-a828-9d2a054c8af7 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:02.674421 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3557c580-d2f8-4244-a828-9d2a054c8af7 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:02.674854 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3557c580-d2f8-4244-a828-9d2a054c8af7 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:03.088118 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-3557c580-d2f8-4244-a828-9d2a054c8af7 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d90150ed7d477fab33129cb3b068ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daad67f26fe246d6b4d28cad1707a119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:04:03.098522 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3557c580-d2f8-4244-a828-9d2a054c8af7 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/f67681e5-fced-41b4-ae7c-7ce922f09df1" status: 200 len: 1244 microversion: 2.1 time: 0.473485 Sep 23 05:04:03.109941 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2984/6136] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:04:02 2022] GET /compute/v2.1/servers/f67681e5-fced-41b4-ae7c-7ce922f09df1 => generated 1244 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:04:04.126037 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-30dcc0f2-ed34-4300-b566-d22cf68d3c00 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:04:04.126723 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-30dcc0f2-ed34-4300-b566-d22cf68d3c00 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: f67681e5-fced-41b4-ae7c-7ce922f09df1] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:04:04.140738 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-30dcc0f2-ed34-4300-b566-d22cf68d3c00 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:04.146690 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-30dcc0f2-ed34-4300-b566-d22cf68d3c00 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:04.149831 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-30dcc0f2-ed34-4300-b566-d22cf68d3c00 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:04.150807 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-30dcc0f2-ed34-4300-b566-d22cf68d3c00 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:04.155725 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-30dcc0f2-ed34-4300-b566-d22cf68d3c00 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:04.162298 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-30dcc0f2-ed34-4300-b566-d22cf68d3c00 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:04.607693 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-30dcc0f2-ed34-4300-b566-d22cf68d3c00 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d90150ed7d477fab33129cb3b068ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daad67f26fe246d6b4d28cad1707a119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:04:04.626904 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-30dcc0f2-ed34-4300-b566-d22cf68d3c00 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/f67681e5-fced-41b4-ae7c-7ce922f09df1" status: 200 len: 1292 microversion: 2.1 time: 0.504894 Sep 23 05:04:04.645343 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3153/6137] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:04:04 2022] GET /compute/v2.1/servers/f67681e5-fced-41b4-ae7c-7ce922f09df1 => generated 1292 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:04:05.656603 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5927a4c8-438f-466e-8231-8a6a676565c5 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:04:05.657235 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5927a4c8-438f-466e-8231-8a6a676565c5 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: f67681e5-fced-41b4-ae7c-7ce922f09df1] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:04:05.696632 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5927a4c8-438f-466e-8231-8a6a676565c5 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:05.702917 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5927a4c8-438f-466e-8231-8a6a676565c5 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:05.702917 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5927a4c8-438f-466e-8231-8a6a676565c5 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:05.702917 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5927a4c8-438f-466e-8231-8a6a676565c5 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:05.702917 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5927a4c8-438f-466e-8231-8a6a676565c5 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:05.702917 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5927a4c8-438f-466e-8231-8a6a676565c5 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:06.573437 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-5927a4c8-438f-466e-8231-8a6a676565c5 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d90150ed7d477fab33129cb3b068ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daad67f26fe246d6b4d28cad1707a119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:04:06.582512 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5927a4c8-438f-466e-8231-8a6a676565c5 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/f67681e5-fced-41b4-ae7c-7ce922f09df1" status: 200 len: 1310 microversion: 2.1 time: 0.929738 Sep 23 05:04:06.583135 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2985/6138] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:04:05 2022] GET /compute/v2.1/servers/f67681e5-fced-41b4-ae7c-7ce922f09df1 => generated 1310 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:04:07.610480 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f31974b9-7493-46e3-a488-41b106022676 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:04:07.612546 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f31974b9-7493-46e3-a488-41b106022676 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: f67681e5-fced-41b4-ae7c-7ce922f09df1] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:04:07.632635 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f31974b9-7493-46e3-a488-41b106022676 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:07.633146 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f31974b9-7493-46e3-a488-41b106022676 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:07.633595 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f31974b9-7493-46e3-a488-41b106022676 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:07.641863 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f31974b9-7493-46e3-a488-41b106022676 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:07.642408 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f31974b9-7493-46e3-a488-41b106022676 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:07.642858 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f31974b9-7493-46e3-a488-41b106022676 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:08.082242 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f31974b9-7493-46e3-a488-41b106022676 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d90150ed7d477fab33129cb3b068ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daad67f26fe246d6b4d28cad1707a119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:04:08.097505 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f31974b9-7493-46e3-a488-41b106022676 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/f67681e5-fced-41b4-ae7c-7ce922f09df1" status: 200 len: 1298 microversion: 2.1 time: 0.487557 Sep 23 05:04:08.110767 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3154/6139] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:04:07 2022] GET /compute/v2.1/servers/f67681e5-fced-41b4-ae7c-7ce922f09df1 => generated 1298 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:04:09.126772 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-18a902af-8dd7-4ed9-922b-38c37a477054 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:04:09.127406 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-18a902af-8dd7-4ed9-922b-38c37a477054 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: f67681e5-fced-41b4-ae7c-7ce922f09df1] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:04:09.137500 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-18a902af-8dd7-4ed9-922b-38c37a477054 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:09.138046 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-18a902af-8dd7-4ed9-922b-38c37a477054 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:09.138532 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-18a902af-8dd7-4ed9-922b-38c37a477054 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:09.139260 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-18a902af-8dd7-4ed9-922b-38c37a477054 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:09.159638 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-18a902af-8dd7-4ed9-922b-38c37a477054 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:09.160324 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-18a902af-8dd7-4ed9-922b-38c37a477054 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:09.826980 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:04:10.063625 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-18a902af-8dd7-4ed9-922b-38c37a477054 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d90150ed7d477fab33129cb3b068ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daad67f26fe246d6b4d28cad1707a119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:04:10.095310 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-18a902af-8dd7-4ed9-922b-38c37a477054 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/f67681e5-fced-41b4-ae7c-7ce922f09df1" status: 200 len: 1365 microversion: 2.1 time: 0.972040 Sep 23 05:04:10.097006 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2986/6140] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:04:09 2022] GET /compute/v2.1/servers/f67681e5-fced-41b4-ae7c-7ce922f09df1 => generated 1365 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:04:11.115149 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d917a186-6af9-4dcd-bc7c-c0d872bb55e9 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-358369436", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "networks": [{"uuid": "c3967d63-8e19-46c7-a6e7-bb2b92783c8a"}], "key_name": "tempest-TestNetworkBasicOps-303851972", "security_groups": [{"name": "tempest-secgroup-smoke-52549737"}]}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:04:11.123567 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e067c2d0-f91c-4a26-991f-adde49890a53 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:04:11.124211 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e067c2d0-f91c-4a26-991f-adde49890a53 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: f67681e5-fced-41b4-ae7c-7ce922f09df1] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:04:11.133263 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=10 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:04:11.135031 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e067c2d0-f91c-4a26-991f-adde49890a53 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:11.135881 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e067c2d0-f91c-4a26-991f-adde49890a53 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:11.136590 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e067c2d0-f91c-4a26-991f-adde49890a53 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:11.138867 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e067c2d0-f91c-4a26-991f-adde49890a53 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:11.139965 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e067c2d0-f91c-4a26-991f-adde49890a53 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:11.140597 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e067c2d0-f91c-4a26-991f-adde49890a53 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:11.147991 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:04:11.588784 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=4 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:04:11.963258 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.neutron [None req-d917a186-6af9-4dcd-bc7c-c0d872bb55e9 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] validate_networks() for [('c3967d63-8e19-46c7-a6e7-bb2b92783c8a', None, None, None, None, None)] {{(pid=122699) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 05:04:12.052389 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e067c2d0-f91c-4a26-991f-adde49890a53 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d90150ed7d477fab33129cb3b068ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daad67f26fe246d6b4d28cad1707a119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:04:12.061668 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e067c2d0-f91c-4a26-991f-adde49890a53 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/f67681e5-fced-41b4-ae7c-7ce922f09df1" status: 200 len: 1365 microversion: 2.1 time: 0.944515 Sep 23 05:04:12.066397 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2987/6141] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:04:11 2022] GET /compute/v2.1/servers/f67681e5-fced-41b4-ae7c-7ce922f09df1 => generated 1365 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:04:12.787085 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-4733220b-8469-400e-8ee5-cc8a5ef885ab req-892a80b2-3a78-417c-85b4-66e1f4ca675e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f67681e5-fced-41b4-ae7c-7ce922f09df1", "tag": "986f2735-a2c6-460f-99e9-55e9f43e905f"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:04:12.877352 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-4733220b-8469-400e-8ee5-cc8a5ef885ab req-892a80b2-3a78-417c-85b4-66e1f4ca675e service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:12.882580 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-4733220b-8469-400e-8ee5-cc8a5ef885ab req-892a80b2-3a78-417c-85b4-66e1f4ca675e service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:12.882580 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-4733220b-8469-400e-8ee5-cc8a5ef885ab req-892a80b2-3a78-417c-85b4-66e1f4ca675e service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:12.940099 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-4733220b-8469-400e-8ee5-cc8a5ef885ab req-892a80b2-3a78-417c-85b4-66e1f4ca675e service nova] Creating event network-changed:986f2735-a2c6-460f-99e9-55e9f43e905f for instance f67681e5-fced-41b4-ae7c-7ce922f09df1 on n-h1-846463-3 Sep 23 05:04:12.994909 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-4733220b-8469-400e-8ee5-cc8a5ef885ab req-892a80b2-3a78-417c-85b4-66e1f4ca675e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.217058 Sep 23 05:04:13.000515 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2988/6142] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:04:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:04:13.095390 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9c990c91-60ab-49f2-9a01-e04792141296 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:04:13.096123 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-9c990c91-60ab-49f2-9a01-e04792141296 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: f67681e5-fced-41b4-ae7c-7ce922f09df1] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:04:13.110163 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9c990c91-60ab-49f2-9a01-e04792141296 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:13.111653 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9c990c91-60ab-49f2-9a01-e04792141296 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:13.112644 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9c990c91-60ab-49f2-9a01-e04792141296 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:13.113622 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9c990c91-60ab-49f2-9a01-e04792141296 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:13.114338 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9c990c91-60ab-49f2-9a01-e04792141296 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:13.114973 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9c990c91-60ab-49f2-9a01-e04792141296 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:14.465988 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=50,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:04:14.693408 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-9c990c91-60ab-49f2-9a01-e04792141296 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d90150ed7d477fab33129cb3b068ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daad67f26fe246d6b4d28cad1707a119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:04:14.712911 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9c990c91-60ab-49f2-9a01-e04792141296 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/f67681e5-fced-41b4-ae7c-7ce922f09df1" status: 200 len: 1365 microversion: 2.1 time: 1.624519 Sep 23 05:04:14.719007 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2989/6143] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:04:13 2022] GET /compute/v2.1/servers/f67681e5-fced-41b4-ae7c-7ce922f09df1 => generated 1365 bytes in 1631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:04:14.865002 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5bd7d7d7-ac80-412c-b891-3a9b82ccdc58 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-540196123", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "41e94058-a5f2-4f45-b6cf-66f0c2a4fa9d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4600129e-ae78-4842-a9e8-005f0a31ee9b"}]}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:04:15.004490 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.network.neutron [None req-5bd7d7d7-ac80-412c-b891-3a9b82ccdc58 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] validate_networks() for [('4600129e-ae78-4842-a9e8-005f0a31ee9b', None, None, None, None, None)] {{(pid=122698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 05:04:15.257644 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-d917a186-6af9-4dcd-bc7c-c0d872bb55e9 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Flavor limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 05:04:15.258181 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-d917a186-6af9-4dcd-bc7c-c0d872bb55e9 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Image limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 05:04:15.258724 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-d917a186-6af9-4dcd-bc7c-c0d872bb55e9 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Flavor pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 05:04:15.259384 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-d917a186-6af9-4dcd-bc7c-c0d872bb55e9 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Image pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 05:04:15.260168 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-d917a186-6af9-4dcd-bc7c-c0d872bb55e9 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 05:04:15.272570 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d917a186-6af9-4dcd-bc7c-c0d872bb55e9 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:15.273977 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d917a186-6af9-4dcd-bc7c-c0d872bb55e9 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:15.274581 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d917a186-6af9-4dcd-bc7c-c0d872bb55e9 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:15.275550 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d917a186-6af9-4dcd-bc7c-c0d872bb55e9 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:15.276184 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d917a186-6af9-4dcd-bc7c-c0d872bb55e9 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:15.276789 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d917a186-6af9-4dcd-bc7c-c0d872bb55e9 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:15.300056 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-d917a186-6af9-4dcd-bc7c-c0d872bb55e9 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Getting quotas for project 5fefb9fd80184955a7856e1c41d081be. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 05:04:15.308751 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-d917a186-6af9-4dcd-bc7c-c0d872bb55e9 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Getting quotas for user b3e8ce1f6821424080453f994dbcd604 and project 5fefb9fd80184955a7856e1c41d081be. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 05:04:15.323483 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d917a186-6af9-4dcd-bc7c-c0d872bb55e9 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Going to run 1 instances... {{(pid=122699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 05:04:15.326706 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d917a186-6af9-4dcd-bc7c-c0d872bb55e9 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] [instance: 8f9812de-fd1b-49c4-b6de-8f5147f05c89] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 05:04:15.500616 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d917a186-6af9-4dcd-bc7c-c0d872bb55e9 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 4.389468 Sep 23 05:04:15.507788 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3155/6144] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 05:04:11 2022] POST /compute/v2.1/servers => generated 404 bytes in 4397 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 23 05:04:15.522796 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6753fcfd-a2a7-46fa-92d8-18d1c1ac8a25 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:04:15.530936 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-6753fcfd-a2a7-46fa-92d8-18d1c1ac8a25 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] [instance: 8f9812de-fd1b-49c4-b6de-8f5147f05c89] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:04:15.674440 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-6753fcfd-a2a7-46fa-92d8-18d1c1ac8a25 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e8ce1f6821424080453f994dbcd604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fefb9fd80184955a7856e1c41d081be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:04:15.690868 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6753fcfd-a2a7-46fa-92d8-18d1c1ac8a25 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] 10.222.0.33 "GET /compute/v2.1/servers/8f9812de-fd1b-49c4-b6de-8f5147f05c89" status: 200 len: 1247 microversion: 2.1 time: 0.174889 Sep 23 05:04:15.691778 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3156/6145] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:04:15 2022] GET /compute/v2.1/servers/8f9812de-fd1b-49c4-b6de-8f5147f05c89 => generated 1247 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:04:15.744036 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9adbb5e8-8a58-43a2-b688-cbf5e462861e tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:04:15.745044 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-9adbb5e8-8a58-43a2-b688-cbf5e462861e tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: f67681e5-fced-41b4-ae7c-7ce922f09df1] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:04:15.777632 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9adbb5e8-8a58-43a2-b688-cbf5e462861e tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:15.777632 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9adbb5e8-8a58-43a2-b688-cbf5e462861e tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:15.778859 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9adbb5e8-8a58-43a2-b688-cbf5e462861e tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:15.779682 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9adbb5e8-8a58-43a2-b688-cbf5e462861e tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:15.780151 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9adbb5e8-8a58-43a2-b688-cbf5e462861e tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:15.780583 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9adbb5e8-8a58-43a2-b688-cbf5e462861e tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:15.885663 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=71 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:04:16.197643 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-9adbb5e8-8a58-43a2-b688-cbf5e462861e tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d90150ed7d477fab33129cb3b068ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daad67f26fe246d6b4d28cad1707a119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:04:16.215339 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-9adbb5e8-8a58-43a2-b688-cbf5e462861e tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/f67681e5-fced-41b4-ae7c-7ce922f09df1" status: 200 len: 1365 microversion: 2.1 time: 0.475858 Sep 23 05:04:16.228259 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3157/6146] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:04:15 2022] GET /compute/v2.1/servers/f67681e5-fced-41b4-ae7c-7ce922f09df1 => generated 1365 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:04:16.250475 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-5bd7d7d7-ac80-412c-b891-3a9b82ccdc58 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Flavor limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 05:04:16.251085 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-5bd7d7d7-ac80-412c-b891-3a9b82ccdc58 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Image limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 05:04:16.251435 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-5bd7d7d7-ac80-412c-b891-3a9b82ccdc58 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Flavor pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 05:04:16.252140 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-5bd7d7d7-ac80-412c-b891-3a9b82ccdc58 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Image pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 05:04:16.252586 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-5bd7d7d7-ac80-412c-b891-3a9b82ccdc58 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 05:04:16.276974 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5bd7d7d7-ac80-412c-b891-3a9b82ccdc58 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:16.277747 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5bd7d7d7-ac80-412c-b891-3a9b82ccdc58 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:16.279495 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5bd7d7d7-ac80-412c-b891-3a9b82ccdc58 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:16.280649 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5bd7d7d7-ac80-412c-b891-3a9b82ccdc58 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:16.281370 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5bd7d7d7-ac80-412c-b891-3a9b82ccdc58 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:16.282251 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5bd7d7d7-ac80-412c-b891-3a9b82ccdc58 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:16.305744 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-5bd7d7d7-ac80-412c-b891-3a9b82ccdc58 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Getting quotas for project cceaa1e24146497fbf3f79cebc112211. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 05:04:16.313408 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-5bd7d7d7-ac80-412c-b891-3a9b82ccdc58 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Getting quotas for user 0d55fe5072c14752846eb4ffc0eef91b and project cceaa1e24146497fbf3f79cebc112211. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 05:04:16.401822 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5bd7d7d7-ac80-412c-b891-3a9b82ccdc58 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Going to run 1 instances... {{(pid=122698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 05:04:16.405314 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5bd7d7d7-ac80-412c-b891-3a9b82ccdc58 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 0902e252-5bb9-462a-979a-0fe67d8884e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='41e94058-a5f2-4f45-b6cf-66f0c2a4fa9d',volume_size=None,volume_type=None)] {{(pid=122698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 05:04:16.721469 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-22fa1015-9f6a-432b-84e7-7b7fb6378260 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:04:16.723720 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-22fa1015-9f6a-432b-84e7-7b7fb6378260 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] [instance: 8f9812de-fd1b-49c4-b6de-8f5147f05c89] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:04:16.840679 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-22fa1015-9f6a-432b-84e7-7b7fb6378260 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e8ce1f6821424080453f994dbcd604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fefb9fd80184955a7856e1c41d081be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:04:16.852443 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-22fa1015-9f6a-432b-84e7-7b7fb6378260 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] 10.222.0.33 "GET /compute/v2.1/servers/8f9812de-fd1b-49c4-b6de-8f5147f05c89" status: 200 len: 1247 microversion: 2.1 time: 0.136758 Sep 23 05:04:16.853224 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3158/6147] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:04:16 2022] GET /compute/v2.1/servers/8f9812de-fd1b-49c4-b6de-8f5147f05c89 => generated 1247 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:04:17.205852 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5bd7d7d7-ac80-412c-b891-3a9b82ccdc58 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.345755 Sep 23 05:04:17.213045 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2990/6148] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 05:04:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 2353 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 05:04:17.226582 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b75b419a-0e2a-456b-8259-f4ad9e8615e3 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:04:17.227374 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b75b419a-0e2a-456b-8259-f4ad9e8615e3 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 0902e252-5bb9-462a-979a-0fe67d8884e3] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:04:17.240692 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-58d13d77-210d-4bd6-95f3-be49c22f237c tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:04:17.241807 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-58d13d77-210d-4bd6-95f3-be49c22f237c tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: f67681e5-fced-41b4-ae7c-7ce922f09df1] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:04:17.251264 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-58d13d77-210d-4bd6-95f3-be49c22f237c tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:17.255461 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-58d13d77-210d-4bd6-95f3-be49c22f237c tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:17.260962 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-58d13d77-210d-4bd6-95f3-be49c22f237c tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:17.260962 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-58d13d77-210d-4bd6-95f3-be49c22f237c tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:17.263208 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-58d13d77-210d-4bd6-95f3-be49c22f237c tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:17.263910 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-58d13d77-210d-4bd6-95f3-be49c22f237c tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:17.515922 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b75b419a-0e2a-456b-8259-f4ad9e8615e3 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:04:17.530352 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b75b419a-0e2a-456b-8259-f4ad9e8615e3 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/0902e252-5bb9-462a-979a-0fe67d8884e3" status: 200 len: 1056 microversion: 2.1 time: 0.305511 Sep 23 05:04:17.534126 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3159/6149] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:04:17 2022] GET /compute/v2.1/servers/0902e252-5bb9-462a-979a-0fe67d8884e3 => generated 1056 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:04:17.877462 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4d5704c1-cad3-4a32-be4b-81e47b4b54e1 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:04:17.878328 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4d5704c1-cad3-4a32-be4b-81e47b4b54e1 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] [instance: 8f9812de-fd1b-49c4-b6de-8f5147f05c89] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:04:17.903325 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4d5704c1-cad3-4a32-be4b-81e47b4b54e1 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:17.906182 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4d5704c1-cad3-4a32-be4b-81e47b4b54e1 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:17.910833 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4d5704c1-cad3-4a32-be4b-81e47b4b54e1 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:17.913789 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4d5704c1-cad3-4a32-be4b-81e47b4b54e1 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:17.920555 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4d5704c1-cad3-4a32-be4b-81e47b4b54e1 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:17.926553 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4d5704c1-cad3-4a32-be4b-81e47b4b54e1 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:18.103651 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-58d13d77-210d-4bd6-95f3-be49c22f237c tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d90150ed7d477fab33129cb3b068ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daad67f26fe246d6b4d28cad1707a119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:04:18.113864 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-58d13d77-210d-4bd6-95f3-be49c22f237c tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/f67681e5-fced-41b4-ae7c-7ce922f09df1" status: 200 len: 1365 microversion: 2.1 time: 0.877025 Sep 23 05:04:18.117404 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2991/6150] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:04:17 2022] GET /compute/v2.1/servers/f67681e5-fced-41b4-ae7c-7ce922f09df1 => generated 1365 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:04:18.175309 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-4d5704c1-cad3-4a32-be4b-81e47b4b54e1 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e8ce1f6821424080453f994dbcd604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fefb9fd80184955a7856e1c41d081be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:04:18.187789 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4d5704c1-cad3-4a32-be4b-81e47b4b54e1 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] 10.222.0.33 "GET /compute/v2.1/servers/8f9812de-fd1b-49c4-b6de-8f5147f05c89" status: 200 len: 1251 microversion: 2.1 time: 0.312263 Sep 23 05:04:18.188621 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3160/6151] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:04:17 2022] GET /compute/v2.1/servers/8f9812de-fd1b-49c4-b6de-8f5147f05c89 => generated 1251 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:04:18.554965 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-fafeca25-5d1b-4ea7-950f-859134db68c5 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:04:18.556221 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-fafeca25-5d1b-4ea7-950f-859134db68c5 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 0902e252-5bb9-462a-979a-0fe67d8884e3] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:04:18.674937 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-fafeca25-5d1b-4ea7-950f-859134db68c5 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:04:18.686917 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-fafeca25-5d1b-4ea7-950f-859134db68c5 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/0902e252-5bb9-462a-979a-0fe67d8884e3" status: 200 len: 1056 microversion: 2.1 time: 0.135732 Sep 23 05:04:18.702867 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2992/6152] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:04:18 2022] GET /compute/v2.1/servers/0902e252-5bb9-462a-979a-0fe67d8884e3 => generated 1056 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:04:19.145568 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-47d8959f-2702-4f14-8788-e6699e858b60 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:04:19.146934 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-47d8959f-2702-4f14-8788-e6699e858b60 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: f67681e5-fced-41b4-ae7c-7ce922f09df1] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:04:19.159497 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-47d8959f-2702-4f14-8788-e6699e858b60 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:19.160260 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-47d8959f-2702-4f14-8788-e6699e858b60 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:19.160957 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-47d8959f-2702-4f14-8788-e6699e858b60 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:19.162234 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-47d8959f-2702-4f14-8788-e6699e858b60 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:19.163305 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-47d8959f-2702-4f14-8788-e6699e858b60 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:19.163952 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-47d8959f-2702-4f14-8788-e6699e858b60 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:19.217524 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e9b83a0e-c502-4616-a311-980a0d5ed53c tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:04:19.218152 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e9b83a0e-c502-4616-a311-980a0d5ed53c tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] [instance: 8f9812de-fd1b-49c4-b6de-8f5147f05c89] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:04:19.258916 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e9b83a0e-c502-4616-a311-980a0d5ed53c tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:19.259429 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e9b83a0e-c502-4616-a311-980a0d5ed53c tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:19.261044 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e9b83a0e-c502-4616-a311-980a0d5ed53c tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:19.261790 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e9b83a0e-c502-4616-a311-980a0d5ed53c tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:19.262289 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e9b83a0e-c502-4616-a311-980a0d5ed53c tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:19.262779 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e9b83a0e-c502-4616-a311-980a0d5ed53c tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:19.468019 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e9b83a0e-c502-4616-a311-980a0d5ed53c tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e8ce1f6821424080453f994dbcd604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fefb9fd80184955a7856e1c41d081be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:04:19.477054 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e9b83a0e-c502-4616-a311-980a0d5ed53c tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] 10.222.0.33 "GET /compute/v2.1/servers/8f9812de-fd1b-49c4-b6de-8f5147f05c89" status: 200 len: 1299 microversion: 2.1 time: 0.264159 Sep 23 05:04:19.481054 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2993/6153] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:04:19 2022] GET /compute/v2.1/servers/8f9812de-fd1b-49c4-b6de-8f5147f05c89 => generated 1299 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:04:19.621124 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-47d8959f-2702-4f14-8788-e6699e858b60 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d90150ed7d477fab33129cb3b068ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daad67f26fe246d6b4d28cad1707a119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:04:19.632333 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-47d8959f-2702-4f14-8788-e6699e858b60 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/f67681e5-fced-41b4-ae7c-7ce922f09df1" status: 200 len: 1365 microversion: 2.1 time: 0.494556 Sep 23 05:04:19.633652 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3161/6154] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:04:19 2022] GET /compute/v2.1/servers/f67681e5-fced-41b4-ae7c-7ce922f09df1 => generated 1365 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:04:19.713768 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e21cd4b2-94b0-48d0-9999-d5cb5a8734a7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:04:19.714520 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e21cd4b2-94b0-48d0-9999-d5cb5a8734a7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 0902e252-5bb9-462a-979a-0fe67d8884e3] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:04:19.727324 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e21cd4b2-94b0-48d0-9999-d5cb5a8734a7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:19.727324 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e21cd4b2-94b0-48d0-9999-d5cb5a8734a7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:19.727324 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e21cd4b2-94b0-48d0-9999-d5cb5a8734a7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:19.727324 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e21cd4b2-94b0-48d0-9999-d5cb5a8734a7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:19.727324 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e21cd4b2-94b0-48d0-9999-d5cb5a8734a7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:19.727324 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e21cd4b2-94b0-48d0-9999-d5cb5a8734a7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:19.824000 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e21cd4b2-94b0-48d0-9999-d5cb5a8734a7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:04:19.837743 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e21cd4b2-94b0-48d0-9999-d5cb5a8734a7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/0902e252-5bb9-462a-979a-0fe67d8884e3" status: 200 len: 1106 microversion: 2.1 time: 0.130322 Sep 23 05:04:19.839544 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2994/6155] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:04:19 2022] GET /compute/v2.1/servers/0902e252-5bb9-462a-979a-0fe67d8884e3 => generated 1106 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:04:20.504328 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1f235a99-411b-499d-9fd6-1cfbce2efd17 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:04:20.505190 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1f235a99-411b-499d-9fd6-1cfbce2efd17 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] [instance: 8f9812de-fd1b-49c4-b6de-8f5147f05c89] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:04:20.513731 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1f235a99-411b-499d-9fd6-1cfbce2efd17 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:20.514640 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1f235a99-411b-499d-9fd6-1cfbce2efd17 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:20.515340 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1f235a99-411b-499d-9fd6-1cfbce2efd17 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:20.516320 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1f235a99-411b-499d-9fd6-1cfbce2efd17 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:20.517014 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1f235a99-411b-499d-9fd6-1cfbce2efd17 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:20.517691 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1f235a99-411b-499d-9fd6-1cfbce2efd17 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:20.674786 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0b79b162-9504-4c42-bb8e-0ca6c233ff05 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:04:20.676503 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-0b79b162-9504-4c42-bb8e-0ca6c233ff05 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: f67681e5-fced-41b4-ae7c-7ce922f09df1] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:04:20.697077 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1f235a99-411b-499d-9fd6-1cfbce2efd17 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e8ce1f6821424080453f994dbcd604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fefb9fd80184955a7856e1c41d081be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:04:20.702251 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0b79b162-9504-4c42-bb8e-0ca6c233ff05 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:20.703072 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0b79b162-9504-4c42-bb8e-0ca6c233ff05 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:20.704013 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0b79b162-9504-4c42-bb8e-0ca6c233ff05 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:20.704973 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0b79b162-9504-4c42-bb8e-0ca6c233ff05 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:20.706783 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0b79b162-9504-4c42-bb8e-0ca6c233ff05 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:20.707538 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0b79b162-9504-4c42-bb8e-0ca6c233ff05 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:20.720853 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1f235a99-411b-499d-9fd6-1cfbce2efd17 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] 10.222.0.33 "GET /compute/v2.1/servers/8f9812de-fd1b-49c4-b6de-8f5147f05c89" status: 200 len: 1317 microversion: 2.1 time: 0.216688 Sep 23 05:04:20.727543 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3162/6156] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:04:20 2022] GET /compute/v2.1/servers/8f9812de-fd1b-49c4-b6de-8f5147f05c89 => generated 1317 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:04:20.868246 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d6a5338d-b73d-4c21-9e7b-579a3e0111da tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:04:20.872615 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d6a5338d-b73d-4c21-9e7b-579a3e0111da tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 0902e252-5bb9-462a-979a-0fe67d8884e3] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:04:20.887415 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d6a5338d-b73d-4c21-9e7b-579a3e0111da tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:20.888892 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d6a5338d-b73d-4c21-9e7b-579a3e0111da tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:20.891632 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d6a5338d-b73d-4c21-9e7b-579a3e0111da tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:20.893240 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d6a5338d-b73d-4c21-9e7b-579a3e0111da tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:20.895508 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d6a5338d-b73d-4c21-9e7b-579a3e0111da tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:20.898047 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d6a5338d-b73d-4c21-9e7b-579a3e0111da tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:21.088653 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d6a5338d-b73d-4c21-9e7b-579a3e0111da tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:04:21.099772 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d6a5338d-b73d-4c21-9e7b-579a3e0111da tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/0902e252-5bb9-462a-979a-0fe67d8884e3" status: 200 len: 1154 microversion: 2.1 time: 0.237911 Sep 23 05:04:21.106819 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3163/6157] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:04:20 2022] GET /compute/v2.1/servers/0902e252-5bb9-462a-979a-0fe67d8884e3 => generated 1154 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:04:21.113360 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-fba58bcc-b68c-455e-8707-2010dfe293b5 req-cd4c6aed-97f5-4bc0-b8fb-9ee94cc43275 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f67681e5-fced-41b4-ae7c-7ce922f09df1", "name": "network-vif-plugged", "status": "completed", "tag": "986f2735-a2c6-460f-99e9-55e9f43e905f"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:04:21.162594 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-fba58bcc-b68c-455e-8707-2010dfe293b5 req-cd4c6aed-97f5-4bc0-b8fb-9ee94cc43275 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:21.166553 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-fba58bcc-b68c-455e-8707-2010dfe293b5 req-cd4c6aed-97f5-4bc0-b8fb-9ee94cc43275 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:21.167888 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-fba58bcc-b68c-455e-8707-2010dfe293b5 req-cd4c6aed-97f5-4bc0-b8fb-9ee94cc43275 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:21.198158 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-fba58bcc-b68c-455e-8707-2010dfe293b5 req-cd4c6aed-97f5-4bc0-b8fb-9ee94cc43275 service nova] Creating event network-vif-plugged:986f2735-a2c6-460f-99e9-55e9f43e905f for instance f67681e5-fced-41b4-ae7c-7ce922f09df1 on n-h1-846463-3 Sep 23 05:04:21.206837 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-fba58bcc-b68c-455e-8707-2010dfe293b5 req-cd4c6aed-97f5-4bc0-b8fb-9ee94cc43275 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096652 Sep 23 05:04:21.208967 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3164/6158] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:04:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:04:21.236239 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-0b79b162-9504-4c42-bb8e-0ca6c233ff05 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d90150ed7d477fab33129cb3b068ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daad67f26fe246d6b4d28cad1707a119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:04:21.251548 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0b79b162-9504-4c42-bb8e-0ca6c233ff05 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/f67681e5-fced-41b4-ae7c-7ce922f09df1" status: 200 len: 1365 microversion: 2.1 time: 0.597774 Sep 23 05:04:21.281712 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2995/6159] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:04:20 2022] GET /compute/v2.1/servers/f67681e5-fced-41b4-ae7c-7ce922f09df1 => generated 1365 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:04:21.754392 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9cefc6bc-1a02-4784-bc65-ddba8c1fc108 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:04:21.756407 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-9cefc6bc-1a02-4784-bc65-ddba8c1fc108 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] [instance: 8f9812de-fd1b-49c4-b6de-8f5147f05c89] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:04:21.773552 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9cefc6bc-1a02-4784-bc65-ddba8c1fc108 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:21.774518 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9cefc6bc-1a02-4784-bc65-ddba8c1fc108 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:21.775169 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9cefc6bc-1a02-4784-bc65-ddba8c1fc108 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:21.776098 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9cefc6bc-1a02-4784-bc65-ddba8c1fc108 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:21.776848 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9cefc6bc-1a02-4784-bc65-ddba8c1fc108 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:21.777356 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9cefc6bc-1a02-4784-bc65-ddba8c1fc108 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:21.913120 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-9cefc6bc-1a02-4784-bc65-ddba8c1fc108 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e8ce1f6821424080453f994dbcd604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fefb9fd80184955a7856e1c41d081be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:04:21.936601 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-9cefc6bc-1a02-4784-bc65-ddba8c1fc108 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] 10.222.0.33 "GET /compute/v2.1/servers/8f9812de-fd1b-49c4-b6de-8f5147f05c89" status: 200 len: 1305 microversion: 2.1 time: 0.187336 Sep 23 05:04:21.941834 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3165/6160] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:04:21 2022] GET /compute/v2.1/servers/8f9812de-fd1b-49c4-b6de-8f5147f05c89 => generated 1305 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:04:22.130561 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1fd12fa8-7650-47aa-81fb-6e9ca7cf7ec9 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:04:22.130561 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-1fd12fa8-7650-47aa-81fb-6e9ca7cf7ec9 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 0902e252-5bb9-462a-979a-0fe67d8884e3] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:04:22.145279 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1fd12fa8-7650-47aa-81fb-6e9ca7cf7ec9 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:22.145902 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1fd12fa8-7650-47aa-81fb-6e9ca7cf7ec9 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:22.146438 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1fd12fa8-7650-47aa-81fb-6e9ca7cf7ec9 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:22.147248 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1fd12fa8-7650-47aa-81fb-6e9ca7cf7ec9 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:22.148043 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1fd12fa8-7650-47aa-81fb-6e9ca7cf7ec9 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:22.149263 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1fd12fa8-7650-47aa-81fb-6e9ca7cf7ec9 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:22.281369 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5f3f3d5a-9882-405b-8e5b-e76de873e811 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:04:22.282099 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-5f3f3d5a-9882-405b-8e5b-e76de873e811 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: f67681e5-fced-41b4-ae7c-7ce922f09df1] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:04:22.292867 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5f3f3d5a-9882-405b-8e5b-e76de873e811 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:22.296411 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5f3f3d5a-9882-405b-8e5b-e76de873e811 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:22.298483 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5f3f3d5a-9882-405b-8e5b-e76de873e811 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:22.304612 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5f3f3d5a-9882-405b-8e5b-e76de873e811 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:22.305258 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5f3f3d5a-9882-405b-8e5b-e76de873e811 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:22.305771 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5f3f3d5a-9882-405b-8e5b-e76de873e811 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:22.881503 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-1fd12fa8-7650-47aa-81fb-6e9ca7cf7ec9 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:04:22.892539 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-1fd12fa8-7650-47aa-81fb-6e9ca7cf7ec9 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/0902e252-5bb9-462a-979a-0fe67d8884e3" status: 200 len: 1172 microversion: 2.1 time: 0.767139 Sep 23 05:04:22.911750 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2996/6161] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:04:22 2022] GET /compute/v2.1/servers/0902e252-5bb9-462a-979a-0fe67d8884e3 => generated 1172 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:04:22.962796 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-17d543ca-67ad-4e43-b889-5531a51a6aef tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:04:22.963809 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-17d543ca-67ad-4e43-b889-5531a51a6aef tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] [instance: 8f9812de-fd1b-49c4-b6de-8f5147f05c89] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:04:22.971254 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-17d543ca-67ad-4e43-b889-5531a51a6aef tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:22.971758 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-17d543ca-67ad-4e43-b889-5531a51a6aef tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:22.972420 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-17d543ca-67ad-4e43-b889-5531a51a6aef tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:22.973312 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-17d543ca-67ad-4e43-b889-5531a51a6aef tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:22.973967 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-17d543ca-67ad-4e43-b889-5531a51a6aef tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:22.974571 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-17d543ca-67ad-4e43-b889-5531a51a6aef tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:23.194569 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-17d543ca-67ad-4e43-b889-5531a51a6aef tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e8ce1f6821424080453f994dbcd604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fefb9fd80184955a7856e1c41d081be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:04:23.217978 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-5f3f3d5a-9882-405b-8e5b-e76de873e811 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d90150ed7d477fab33129cb3b068ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daad67f26fe246d6b4d28cad1707a119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:04:23.219890 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-17d543ca-67ad-4e43-b889-5531a51a6aef tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] 10.222.0.33 "GET /compute/v2.1/servers/8f9812de-fd1b-49c4-b6de-8f5147f05c89" status: 200 len: 1305 microversion: 2.1 time: 0.262274 Sep 23 05:04:23.221088 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2997/6162] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:04:22 2022] GET /compute/v2.1/servers/8f9812de-fd1b-49c4-b6de-8f5147f05c89 => generated 1305 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:04:23.278264 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5f3f3d5a-9882-405b-8e5b-e76de873e811 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/f67681e5-fced-41b4-ae7c-7ce922f09df1" status: 200 len: 1365 microversion: 2.1 time: 0.999990 Sep 23 05:04:23.285320 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3166/6163] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:04:22 2022] GET /compute/v2.1/servers/f67681e5-fced-41b4-ae7c-7ce922f09df1 => generated 1365 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:04:23.919553 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-19e7794c-ff9d-4f83-8edb-bb6e431bff36 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:04:23.921086 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-19e7794c-ff9d-4f83-8edb-bb6e431bff36 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 0902e252-5bb9-462a-979a-0fe67d8884e3] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:04:23.927582 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=7 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:04:23.929562 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-19e7794c-ff9d-4f83-8edb-bb6e431bff36 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:23.930373 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-19e7794c-ff9d-4f83-8edb-bb6e431bff36 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:23.933187 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-19e7794c-ff9d-4f83-8edb-bb6e431bff36 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:23.935071 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-19e7794c-ff9d-4f83-8edb-bb6e431bff36 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:23.935968 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-19e7794c-ff9d-4f83-8edb-bb6e431bff36 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:23.936681 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-19e7794c-ff9d-4f83-8edb-bb6e431bff36 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:24.109451 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-19e7794c-ff9d-4f83-8edb-bb6e431bff36 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:04:24.126179 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-19e7794c-ff9d-4f83-8edb-bb6e431bff36 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/0902e252-5bb9-462a-979a-0fe67d8884e3" status: 200 len: 1172 microversion: 2.1 time: 0.211457 Sep 23 05:04:24.127595 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2998/6164] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:04:23 2022] GET /compute/v2.1/servers/0902e252-5bb9-462a-979a-0fe67d8884e3 => generated 1172 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:04:24.244329 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e004f4c1-f2c5-4a1c-9760-24594ac29309 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:04:24.244940 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e004f4c1-f2c5-4a1c-9760-24594ac29309 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] [instance: 8f9812de-fd1b-49c4-b6de-8f5147f05c89] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:04:24.257748 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e004f4c1-f2c5-4a1c-9760-24594ac29309 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:24.262819 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e004f4c1-f2c5-4a1c-9760-24594ac29309 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:24.263593 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e004f4c1-f2c5-4a1c-9760-24594ac29309 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:24.264548 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e004f4c1-f2c5-4a1c-9760-24594ac29309 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:24.265218 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e004f4c1-f2c5-4a1c-9760-24594ac29309 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:24.265854 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e004f4c1-f2c5-4a1c-9760-24594ac29309 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:24.304914 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d2f50916-1e23-4d34-ae2c-56e37cbf9228 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:04:24.305697 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d2f50916-1e23-4d34-ae2c-56e37cbf9228 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: f67681e5-fced-41b4-ae7c-7ce922f09df1] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:04:24.317967 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d2f50916-1e23-4d34-ae2c-56e37cbf9228 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:24.339361 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d2f50916-1e23-4d34-ae2c-56e37cbf9228 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:24.340191 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d2f50916-1e23-4d34-ae2c-56e37cbf9228 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:24.341859 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d2f50916-1e23-4d34-ae2c-56e37cbf9228 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:24.344133 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d2f50916-1e23-4d34-ae2c-56e37cbf9228 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:24.346655 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d2f50916-1e23-4d34-ae2c-56e37cbf9228 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:24.758306 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d2f50916-1e23-4d34-ae2c-56e37cbf9228 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d90150ed7d477fab33129cb3b068ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daad67f26fe246d6b4d28cad1707a119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:04:24.767779 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d2f50916-1e23-4d34-ae2c-56e37cbf9228 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/f67681e5-fced-41b4-ae7c-7ce922f09df1" status: 200 len: 1555 microversion: 2.1 time: 0.468378 Sep 23 05:04:24.775167 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 2999/6165] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:04:24 2022] GET /compute/v2.1/servers/f67681e5-fced-41b4-ae7c-7ce922f09df1 => generated 1555 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:04:24.806512 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-fa189e8e-bb18-430d-9139-0ff7b846bebd tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:04:24.810111 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-fa189e8e-bb18-430d-9139-0ff7b846bebd tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: f67681e5-fced-41b4-ae7c-7ce922f09df1] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:04:24.826931 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fa189e8e-bb18-430d-9139-0ff7b846bebd tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:24.830500 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fa189e8e-bb18-430d-9139-0ff7b846bebd tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:24.833744 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fa189e8e-bb18-430d-9139-0ff7b846bebd tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:24.835412 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fa189e8e-bb18-430d-9139-0ff7b846bebd tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:24.839363 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fa189e8e-bb18-430d-9139-0ff7b846bebd tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:24.841424 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fa189e8e-bb18-430d-9139-0ff7b846bebd tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:24.906280 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e004f4c1-f2c5-4a1c-9760-24594ac29309 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e8ce1f6821424080453f994dbcd604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fefb9fd80184955a7856e1c41d081be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:04:24.918437 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e004f4c1-f2c5-4a1c-9760-24594ac29309 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] 10.222.0.33 "GET /compute/v2.1/servers/8f9812de-fd1b-49c4-b6de-8f5147f05c89" status: 200 len: 1371 microversion: 2.1 time: 0.677127 Sep 23 05:04:24.920919 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3167/6166] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:04:24 2022] GET /compute/v2.1/servers/8f9812de-fd1b-49c4-b6de-8f5147f05c89 => generated 1371 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:04:25.064408 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-fa189e8e-bb18-430d-9139-0ff7b846bebd tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/f67681e5-fced-41b4-ae7c-7ce922f09df1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.265703 Sep 23 05:04:25.069021 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3000/6167] 10.222.0.33 () {58 vars in 1275 bytes} [Fri Sep 23 05:04:24 2022] GET /compute/v2.1/servers/f67681e5-fced-41b4-ae7c-7ce922f09df1/os-interface => generated 285 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:04:25.154948 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-24c98d73-8e4e-4df3-9b2e-fea6470ec4a0 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:04:25.154948 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-24c98d73-8e4e-4df3-9b2e-fea6470ec4a0 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 0902e252-5bb9-462a-979a-0fe67d8884e3] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:04:25.170471 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-24c98d73-8e4e-4df3-9b2e-fea6470ec4a0 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:25.171055 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-24c98d73-8e4e-4df3-9b2e-fea6470ec4a0 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:25.171724 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-24c98d73-8e4e-4df3-9b2e-fea6470ec4a0 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:25.172654 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-24c98d73-8e4e-4df3-9b2e-fea6470ec4a0 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:25.177111 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-24c98d73-8e4e-4df3-9b2e-fea6470ec4a0 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:25.178244 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-24c98d73-8e4e-4df3-9b2e-fea6470ec4a0 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:25.290130 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:04:25.946483 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a77a81ed-b185-4f63-acdd-e29c99d10f53 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:04:25.947291 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a77a81ed-b185-4f63-acdd-e29c99d10f53 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] [instance: 8f9812de-fd1b-49c4-b6de-8f5147f05c89] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:04:25.962262 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a77a81ed-b185-4f63-acdd-e29c99d10f53 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:25.962511 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a77a81ed-b185-4f63-acdd-e29c99d10f53 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:25.963145 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a77a81ed-b185-4f63-acdd-e29c99d10f53 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:25.967533 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a77a81ed-b185-4f63-acdd-e29c99d10f53 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:25.968314 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a77a81ed-b185-4f63-acdd-e29c99d10f53 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:25.968837 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a77a81ed-b185-4f63-acdd-e29c99d10f53 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:26.296423 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:04:26.329762 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-24c98d73-8e4e-4df3-9b2e-fea6470ec4a0 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:04:26.358320 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-24c98d73-8e4e-4df3-9b2e-fea6470ec4a0 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/0902e252-5bb9-462a-979a-0fe67d8884e3" status: 200 len: 1214 microversion: 2.1 time: 1.208198 Sep 23 05:04:26.360306 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3168/6168] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:04:25 2022] GET /compute/v2.1/servers/0902e252-5bb9-462a-979a-0fe67d8884e3 => generated 1214 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:04:26.647615 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a77a81ed-b185-4f63-acdd-e29c99d10f53 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e8ce1f6821424080453f994dbcd604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fefb9fd80184955a7856e1c41d081be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:04:26.665609 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a77a81ed-b185-4f63-acdd-e29c99d10f53 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] 10.222.0.33 "GET /compute/v2.1/servers/8f9812de-fd1b-49c4-b6de-8f5147f05c89" status: 200 len: 1371 microversion: 2.1 time: 0.722762 Sep 23 05:04:26.669716 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3001/6169] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:04:25 2022] GET /compute/v2.1/servers/8f9812de-fd1b-49c4-b6de-8f5147f05c89 => generated 1371 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:04:27.386732 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f6bbb65a-be81-4c6c-a872-e527fbebea48 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:04:27.388103 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f6bbb65a-be81-4c6c-a872-e527fbebea48 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 0902e252-5bb9-462a-979a-0fe67d8884e3] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:04:27.394697 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f6bbb65a-be81-4c6c-a872-e527fbebea48 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:27.407103 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f6bbb65a-be81-4c6c-a872-e527fbebea48 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:27.407909 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f6bbb65a-be81-4c6c-a872-e527fbebea48 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:27.409038 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f6bbb65a-be81-4c6c-a872-e527fbebea48 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:27.409720 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f6bbb65a-be81-4c6c-a872-e527fbebea48 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:27.410387 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f6bbb65a-be81-4c6c-a872-e527fbebea48 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:27.521655 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=12 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:04:27.695128 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f84d783d-4ac8-4619-a602-a2c321518809 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:04:27.695752 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f84d783d-4ac8-4619-a602-a2c321518809 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] [instance: 8f9812de-fd1b-49c4-b6de-8f5147f05c89] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:04:27.713004 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f84d783d-4ac8-4619-a602-a2c321518809 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:27.716708 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f84d783d-4ac8-4619-a602-a2c321518809 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:27.720412 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f84d783d-4ac8-4619-a602-a2c321518809 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:27.722754 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f84d783d-4ac8-4619-a602-a2c321518809 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:27.724147 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f84d783d-4ac8-4619-a602-a2c321518809 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:27.728464 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f84d783d-4ac8-4619-a602-a2c321518809 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:27.949692 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f6bbb65a-be81-4c6c-a872-e527fbebea48 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:04:27.955296 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f6bbb65a-be81-4c6c-a872-e527fbebea48 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/0902e252-5bb9-462a-979a-0fe67d8884e3" status: 200 len: 1214 microversion: 2.1 time: 0.570552 Sep 23 05:04:27.956032 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3169/6170] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:04:27 2022] GET /compute/v2.1/servers/0902e252-5bb9-462a-979a-0fe67d8884e3 => generated 1214 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:04:28.402154 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f84d783d-4ac8-4619-a602-a2c321518809 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e8ce1f6821424080453f994dbcd604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fefb9fd80184955a7856e1c41d081be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:04:28.454879 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f84d783d-4ac8-4619-a602-a2c321518809 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] 10.222.0.33 "GET /compute/v2.1/servers/8f9812de-fd1b-49c4-b6de-8f5147f05c89" status: 200 len: 1371 microversion: 2.1 time: 0.763804 Sep 23 05:04:28.456835 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3002/6171] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:04:27 2022] GET /compute/v2.1/servers/8f9812de-fd1b-49c4-b6de-8f5147f05c89 => generated 1371 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:04:28.980597 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5a70411f-1756-4888-9c64-087fa8ed05c4 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:04:28.985610 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-5a70411f-1756-4888-9c64-087fa8ed05c4 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 0902e252-5bb9-462a-979a-0fe67d8884e3] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:04:28.992470 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5a70411f-1756-4888-9c64-087fa8ed05c4 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:28.994424 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5a70411f-1756-4888-9c64-087fa8ed05c4 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:28.994995 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5a70411f-1756-4888-9c64-087fa8ed05c4 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:29.003191 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5a70411f-1756-4888-9c64-087fa8ed05c4 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:29.003708 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5a70411f-1756-4888-9c64-087fa8ed05c4 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:29.004267 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5a70411f-1756-4888-9c64-087fa8ed05c4 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:29.486682 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3ee62661-636c-451f-9f37-60111a0df6eb tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:04:29.487475 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3ee62661-636c-451f-9f37-60111a0df6eb tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] [instance: 8f9812de-fd1b-49c4-b6de-8f5147f05c89] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:04:29.489820 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=8 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:04:29.497376 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3ee62661-636c-451f-9f37-60111a0df6eb tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:29.506052 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3ee62661-636c-451f-9f37-60111a0df6eb tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:29.508943 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3ee62661-636c-451f-9f37-60111a0df6eb tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:29.510080 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3ee62661-636c-451f-9f37-60111a0df6eb tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:29.510940 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3ee62661-636c-451f-9f37-60111a0df6eb tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:29.511637 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3ee62661-636c-451f-9f37-60111a0df6eb tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:29.586678 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-5a70411f-1756-4888-9c64-087fa8ed05c4 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:04:29.595465 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5a70411f-1756-4888-9c64-087fa8ed05c4 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/0902e252-5bb9-462a-979a-0fe67d8884e3" status: 200 len: 1214 microversion: 2.1 time: 0.618663 Sep 23 05:04:29.601464 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3170/6172] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:04:28 2022] GET /compute/v2.1/servers/0902e252-5bb9-462a-979a-0fe67d8884e3 => generated 1214 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:04:30.267182 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-f68d063c-633d-47bb-a264-eec26a61c94c req-7db7bf5c-e40c-4c9b-ad1f-49697906f08b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f9812de-fd1b-49c4-b6de-8f5147f05c89", "tag": "8869d70a-7591-4bb3-9139-d911ff4a1324"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:04:30.322428 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-f68d063c-633d-47bb-a264-eec26a61c94c req-7db7bf5c-e40c-4c9b-ad1f-49697906f08b service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:30.332820 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-f68d063c-633d-47bb-a264-eec26a61c94c req-7db7bf5c-e40c-4c9b-ad1f-49697906f08b service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:30.335705 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-f68d063c-633d-47bb-a264-eec26a61c94c req-7db7bf5c-e40c-4c9b-ad1f-49697906f08b service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:30.372709 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-f68d063c-633d-47bb-a264-eec26a61c94c req-7db7bf5c-e40c-4c9b-ad1f-49697906f08b service nova] Creating event network-changed:8869d70a-7591-4bb3-9139-d911ff4a1324 for instance 8f9812de-fd1b-49c4-b6de-8f5147f05c89 on n-h2-846463-3 Sep 23 05:04:30.378865 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-f68d063c-633d-47bb-a264-eec26a61c94c req-7db7bf5c-e40c-4c9b-ad1f-49697906f08b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115283 Sep 23 05:04:30.380529 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3171/6173] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:04:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:04:30.632376 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-84b5fa08-6bb9-458e-883c-c4d825fa3c00 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:04:30.633320 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-84b5fa08-6bb9-458e-883c-c4d825fa3c00 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 0902e252-5bb9-462a-979a-0fe67d8884e3] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:04:30.653538 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-84b5fa08-6bb9-458e-883c-c4d825fa3c00 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:30.656285 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-84b5fa08-6bb9-458e-883c-c4d825fa3c00 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:30.658302 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-84b5fa08-6bb9-458e-883c-c4d825fa3c00 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:30.659292 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-84b5fa08-6bb9-458e-883c-c4d825fa3c00 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:30.661409 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-84b5fa08-6bb9-458e-883c-c4d825fa3c00 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:30.661857 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-84b5fa08-6bb9-458e-883c-c4d825fa3c00 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:30.998971 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-3ee62661-636c-451f-9f37-60111a0df6eb tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e8ce1f6821424080453f994dbcd604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fefb9fd80184955a7856e1c41d081be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:04:31.013695 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3ee62661-636c-451f-9f37-60111a0df6eb tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] 10.222.0.33 "GET /compute/v2.1/servers/8f9812de-fd1b-49c4-b6de-8f5147f05c89" status: 200 len: 1371 microversion: 2.1 time: 1.530829 Sep 23 05:04:31.014614 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3003/6174] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:04:29 2022] GET /compute/v2.1/servers/8f9812de-fd1b-49c4-b6de-8f5147f05c89 => generated 1371 bytes in 1533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:04:31.038877 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-43bdcd93-2d3f-4bcb-b041-c2e89737c414 req-e1be1e60-6ad1-4c13-b195-7ea89ec162bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f67681e5-fced-41b4-ae7c-7ce922f09df1", "tag": "986f2735-a2c6-460f-99e9-55e9f43e905f"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:04:31.090293 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-43bdcd93-2d3f-4bcb-b041-c2e89737c414 req-e1be1e60-6ad1-4c13-b195-7ea89ec162bc service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:31.091710 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-43bdcd93-2d3f-4bcb-b041-c2e89737c414 req-e1be1e60-6ad1-4c13-b195-7ea89ec162bc service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:31.092920 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-43bdcd93-2d3f-4bcb-b041-c2e89737c414 req-e1be1e60-6ad1-4c13-b195-7ea89ec162bc service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:31.133476 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-43bdcd93-2d3f-4bcb-b041-c2e89737c414 req-e1be1e60-6ad1-4c13-b195-7ea89ec162bc service nova] Creating event network-changed:986f2735-a2c6-460f-99e9-55e9f43e905f for instance f67681e5-fced-41b4-ae7c-7ce922f09df1 on n-h1-846463-3 Sep 23 05:04:31.152757 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-43bdcd93-2d3f-4bcb-b041-c2e89737c414 req-e1be1e60-6ad1-4c13-b195-7ea89ec162bc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133790 Sep 23 05:04:31.153584 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3004/6175] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:04:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:04:31.536772 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-84b5fa08-6bb9-458e-883c-c4d825fa3c00 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:04:31.545393 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-84b5fa08-6bb9-458e-883c-c4d825fa3c00 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/0902e252-5bb9-462a-979a-0fe67d8884e3" status: 200 len: 1214 microversion: 2.1 time: 0.919771 Sep 23 05:04:31.558051 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3172/6176] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:04:30 2022] GET /compute/v2.1/servers/0902e252-5bb9-462a-979a-0fe67d8884e3 => generated 1214 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:04:32.040217 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b6e443dc-da18-49f7-9909-bf41943710df tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:04:32.041741 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b6e443dc-da18-49f7-9909-bf41943710df tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] [instance: 8f9812de-fd1b-49c4-b6de-8f5147f05c89] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:04:32.053295 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b6e443dc-da18-49f7-9909-bf41943710df tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:32.054717 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b6e443dc-da18-49f7-9909-bf41943710df tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:32.060208 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b6e443dc-da18-49f7-9909-bf41943710df tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:32.063399 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b6e443dc-da18-49f7-9909-bf41943710df tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:32.064255 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b6e443dc-da18-49f7-9909-bf41943710df tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:32.066205 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b6e443dc-da18-49f7-9909-bf41943710df tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:32.424388 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-6b8d4f86-6b4d-4be4-9b01-928fd08b1814 req-bea16319-a986-41d5-b9b3-82fe94f758cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0902e252-5bb9-462a-979a-0fe67d8884e3", "tag": "af349a22-4554-45e6-856f-99acd4214448"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:04:32.444112 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-6b8d4f86-6b4d-4be4-9b01-928fd08b1814 req-bea16319-a986-41d5-b9b3-82fe94f758cc service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:32.444868 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-6b8d4f86-6b4d-4be4-9b01-928fd08b1814 req-bea16319-a986-41d5-b9b3-82fe94f758cc service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:32.445475 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-6b8d4f86-6b4d-4be4-9b01-928fd08b1814 req-bea16319-a986-41d5-b9b3-82fe94f758cc service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:32.494516 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-6b8d4f86-6b4d-4be4-9b01-928fd08b1814 req-bea16319-a986-41d5-b9b3-82fe94f758cc service nova] Creating event network-changed:af349a22-4554-45e6-856f-99acd4214448 for instance 0902e252-5bb9-462a-979a-0fe67d8884e3 on n-h2-846463-3 Sep 23 05:04:32.511999 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-6b8d4f86-6b4d-4be4-9b01-928fd08b1814 req-bea16319-a986-41d5-b9b3-82fe94f758cc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087874 Sep 23 05:04:32.513476 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3173/6177] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:04:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:04:32.572754 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-729b3ef7-3f6d-4e39-8a28-a4e3a49acef0 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:04:32.574238 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-729b3ef7-3f6d-4e39-8a28-a4e3a49acef0 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 0902e252-5bb9-462a-979a-0fe67d8884e3] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:04:32.587237 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-729b3ef7-3f6d-4e39-8a28-a4e3a49acef0 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:32.587756 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-729b3ef7-3f6d-4e39-8a28-a4e3a49acef0 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:32.588206 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-729b3ef7-3f6d-4e39-8a28-a4e3a49acef0 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:32.588925 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-729b3ef7-3f6d-4e39-8a28-a4e3a49acef0 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:32.589387 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-729b3ef7-3f6d-4e39-8a28-a4e3a49acef0 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:32.602656 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-729b3ef7-3f6d-4e39-8a28-a4e3a49acef0 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:32.820883 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b6e443dc-da18-49f7-9909-bf41943710df tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e8ce1f6821424080453f994dbcd604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fefb9fd80184955a7856e1c41d081be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:04:32.839446 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b6e443dc-da18-49f7-9909-bf41943710df tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] 10.222.0.33 "GET /compute/v2.1/servers/8f9812de-fd1b-49c4-b6de-8f5147f05c89" status: 200 len: 1371 microversion: 2.1 time: 0.799144 Sep 23 05:04:32.852452 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3005/6178] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:04:32 2022] GET /compute/v2.1/servers/8f9812de-fd1b-49c4-b6de-8f5147f05c89 => generated 1371 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:04:32.983664 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-729b3ef7-3f6d-4e39-8a28-a4e3a49acef0 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:04:32.993187 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-729b3ef7-3f6d-4e39-8a28-a4e3a49acef0 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/0902e252-5bb9-462a-979a-0fe67d8884e3" status: 200 len: 1214 microversion: 2.1 time: 0.426490 Sep 23 05:04:32.994293 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3174/6179] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:04:32 2022] GET /compute/v2.1/servers/0902e252-5bb9-462a-979a-0fe67d8884e3 => generated 1214 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:04:33.857758 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ce8e1d0f-966f-4650-acc6-aa5e257618c8 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:04:33.858454 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-ce8e1d0f-966f-4650-acc6-aa5e257618c8 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] [instance: 8f9812de-fd1b-49c4-b6de-8f5147f05c89] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:04:33.871347 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ce8e1d0f-966f-4650-acc6-aa5e257618c8 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:33.877217 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ce8e1d0f-966f-4650-acc6-aa5e257618c8 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:33.878451 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ce8e1d0f-966f-4650-acc6-aa5e257618c8 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:33.880286 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ce8e1d0f-966f-4650-acc6-aa5e257618c8 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:33.881678 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ce8e1d0f-966f-4650-acc6-aa5e257618c8 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:33.882450 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ce8e1d0f-966f-4650-acc6-aa5e257618c8 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:34.032473 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-42daff13-dd76-4c2a-b032-bc0929cc43e2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:04:34.033194 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-42daff13-dd76-4c2a-b032-bc0929cc43e2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 0902e252-5bb9-462a-979a-0fe67d8884e3] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:04:34.047771 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-42daff13-dd76-4c2a-b032-bc0929cc43e2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:34.048827 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-42daff13-dd76-4c2a-b032-bc0929cc43e2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:34.050204 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-42daff13-dd76-4c2a-b032-bc0929cc43e2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:34.054431 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-42daff13-dd76-4c2a-b032-bc0929cc43e2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:34.059414 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-42daff13-dd76-4c2a-b032-bc0929cc43e2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:34.061376 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-42daff13-dd76-4c2a-b032-bc0929cc43e2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:34.537209 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-42daff13-dd76-4c2a-b032-bc0929cc43e2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:04:34.550622 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-42daff13-dd76-4c2a-b032-bc0929cc43e2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/0902e252-5bb9-462a-979a-0fe67d8884e3" status: 200 len: 1214 microversion: 2.1 time: 0.534906 Sep 23 05:04:34.552707 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3175/6180] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:04:34 2022] GET /compute/v2.1/servers/0902e252-5bb9-462a-979a-0fe67d8884e3 => generated 1214 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:04:34.664478 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ce8e1d0f-966f-4650-acc6-aa5e257618c8 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e8ce1f6821424080453f994dbcd604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fefb9fd80184955a7856e1c41d081be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:04:34.677132 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ce8e1d0f-966f-4650-acc6-aa5e257618c8 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] 10.222.0.33 "GET /compute/v2.1/servers/8f9812de-fd1b-49c4-b6de-8f5147f05c89" status: 200 len: 1371 microversion: 2.1 time: 0.823972 Sep 23 05:04:34.682923 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3006/6181] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:04:33 2022] GET /compute/v2.1/servers/8f9812de-fd1b-49c4-b6de-8f5147f05c89 => generated 1371 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:04:35.552826 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-54bd99ce-e221-465a-a80c-fe7a5996026f tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Action: 'create', calling method: .version_select at 0x7ff1ba935790>, body: {"keypair": {"name": "tempest-TestServerBasicOps-188609765", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOEkcSpcLEmcMWdjDD98W8oZ1gkKDwYMokdFsuHoE0dR10v5j+df/1goAGg37D7OGpBFHbW9aHOaXVyipLNM6Udsi5AWbt7Cy5sat7f8csNvOvmOhLDZQpiCXvR+9Pf91A=="}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:04:35.577131 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a59408f1-c4ff-4e4e-8abb-13585b7ba145 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:04:35.577673 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a59408f1-c4ff-4e4e-8abb-13585b7ba145 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 0902e252-5bb9-462a-979a-0fe67d8884e3] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:04:35.588092 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-54bd99ce-e221-465a-a80c-fe7a5996026f tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Getting quotas for project 3384c4863e35469b96482ce27d56a36a. Resources: {'key_pairs'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 05:04:35.592806 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a59408f1-c4ff-4e4e-8abb-13585b7ba145 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:35.593370 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a59408f1-c4ff-4e4e-8abb-13585b7ba145 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:35.593838 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a59408f1-c4ff-4e4e-8abb-13585b7ba145 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:35.594625 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a59408f1-c4ff-4e4e-8abb-13585b7ba145 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:35.597118 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a59408f1-c4ff-4e4e-8abb-13585b7ba145 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:35.597584 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a59408f1-c4ff-4e4e-8abb-13585b7ba145 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:35.599473 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-54bd99ce-e221-465a-a80c-fe7a5996026f tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Getting quotas for user fc338a28098d48bc931a2c29213d1dbb and project 3384c4863e35469b96482ce27d56a36a. Resources: {'key_pairs'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 05:04:35.607997 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=100 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:04:35.772161 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-54bd99ce-e221-465a-a80c-fe7a5996026f tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.644737 Sep 23 05:04:35.773665 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3176/6182] 10.222.0.33 () {60 vars in 1159 bytes} [Fri Sep 23 05:04:35 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:04:35.779076 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8b97376f-793b-4a7c-b539-f6108ebcf203 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:04:35.780087 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-8b97376f-793b-4a7c-b539-f6108ebcf203 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] [instance: 8f9812de-fd1b-49c4-b6de-8f5147f05c89] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:04:35.800268 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8b97376f-793b-4a7c-b539-f6108ebcf203 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:35.802615 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8b97376f-793b-4a7c-b539-f6108ebcf203 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:35.803329 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8b97376f-793b-4a7c-b539-f6108ebcf203 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:35.804407 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8b97376f-793b-4a7c-b539-f6108ebcf203 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:35.806392 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8b97376f-793b-4a7c-b539-f6108ebcf203 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:35.808690 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8b97376f-793b-4a7c-b539-f6108ebcf203 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:36.052974 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a59408f1-c4ff-4e4e-8abb-13585b7ba145 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:04:36.052974 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a59408f1-c4ff-4e4e-8abb-13585b7ba145 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/0902e252-5bb9-462a-979a-0fe67d8884e3" status: 200 len: 1202 microversion: 2.1 time: 0.477298 Sep 23 05:04:36.052974 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3007/6183] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:04:35 2022] GET /compute/v2.1/servers/0902e252-5bb9-462a-979a-0fe67d8884e3 => generated 1202 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:04:36.223425 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-8b97376f-793b-4a7c-b539-f6108ebcf203 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e8ce1f6821424080453f994dbcd604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fefb9fd80184955a7856e1c41d081be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:04:36.232413 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-8b97376f-793b-4a7c-b539-f6108ebcf203 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] 10.222.0.33 "GET /compute/v2.1/servers/8f9812de-fd1b-49c4-b6de-8f5147f05c89" status: 200 len: 1371 microversion: 2.1 time: 0.457414 Sep 23 05:04:36.233000 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3177/6184] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:04:35 2022] GET /compute/v2.1/servers/8f9812de-fd1b-49c4-b6de-8f5147f05c89 => generated 1371 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:04:37.076885 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-aab60e23-cd6a-4638-8b97-7e80f6e02041 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:04:37.078180 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-aab60e23-cd6a-4638-8b97-7e80f6e02041 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 0902e252-5bb9-462a-979a-0fe67d8884e3] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:04:37.107909 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-aab60e23-cd6a-4638-8b97-7e80f6e02041 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:37.109085 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-aab60e23-cd6a-4638-8b97-7e80f6e02041 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:37.112625 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-aab60e23-cd6a-4638-8b97-7e80f6e02041 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:37.113593 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-aab60e23-cd6a-4638-8b97-7e80f6e02041 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:37.116046 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-aab60e23-cd6a-4638-8b97-7e80f6e02041 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:37.116576 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-aab60e23-cd6a-4638-8b97-7e80f6e02041 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:37.257408 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9a132aa9-c7c1-44ec-be21-b6dd4fd5b6d7 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:04:37.258310 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-9a132aa9-c7c1-44ec-be21-b6dd4fd5b6d7 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] [instance: 8f9812de-fd1b-49c4-b6de-8f5147f05c89] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:04:37.274106 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9a132aa9-c7c1-44ec-be21-b6dd4fd5b6d7 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:37.274283 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9a132aa9-c7c1-44ec-be21-b6dd4fd5b6d7 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:37.280245 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9a132aa9-c7c1-44ec-be21-b6dd4fd5b6d7 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:37.280245 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9a132aa9-c7c1-44ec-be21-b6dd4fd5b6d7 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:37.287936 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9a132aa9-c7c1-44ec-be21-b6dd4fd5b6d7 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:37.288094 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9a132aa9-c7c1-44ec-be21-b6dd4fd5b6d7 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:38.567896 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-9a132aa9-c7c1-44ec-be21-b6dd4fd5b6d7 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e8ce1f6821424080453f994dbcd604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fefb9fd80184955a7856e1c41d081be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:04:38.587230 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-9a132aa9-c7c1-44ec-be21-b6dd4fd5b6d7 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] 10.222.0.33 "GET /compute/v2.1/servers/8f9812de-fd1b-49c4-b6de-8f5147f05c89" status: 200 len: 1371 microversion: 2.1 time: 1.334560 Sep 23 05:04:38.587967 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3178/6185] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:04:37 2022] GET /compute/v2.1/servers/8f9812de-fd1b-49c4-b6de-8f5147f05c89 => generated 1371 bytes in 1336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:04:38.612368 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-aab60e23-cd6a-4638-8b97-7e80f6e02041 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:04:38.630833 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-aab60e23-cd6a-4638-8b97-7e80f6e02041 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/0902e252-5bb9-462a-979a-0fe67d8884e3" status: 200 len: 1202 microversion: 2.1 time: 1.559681 Sep 23 05:04:38.631853 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3008/6186] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:04:37 2022] GET /compute/v2.1/servers/0902e252-5bb9-462a-979a-0fe67d8884e3 => generated 1202 bytes in 1561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:04:39.611534 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8fc9948e-ddff-46c7-b5b1-5ec56004cf09 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:04:39.612152 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-8fc9948e-ddff-46c7-b5b1-5ec56004cf09 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] [instance: 8f9812de-fd1b-49c4-b6de-8f5147f05c89] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:04:39.630769 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8fc9948e-ddff-46c7-b5b1-5ec56004cf09 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:39.635276 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8fc9948e-ddff-46c7-b5b1-5ec56004cf09 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:39.635276 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8fc9948e-ddff-46c7-b5b1-5ec56004cf09 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:39.635276 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8fc9948e-ddff-46c7-b5b1-5ec56004cf09 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:39.635276 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8fc9948e-ddff-46c7-b5b1-5ec56004cf09 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:39.635276 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8fc9948e-ddff-46c7-b5b1-5ec56004cf09 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:39.658668 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-72b16d73-dfa1-4ebb-aa4a-f86637b81968 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:04:39.666571 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-72b16d73-dfa1-4ebb-aa4a-f86637b81968 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 0902e252-5bb9-462a-979a-0fe67d8884e3] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:04:39.666850 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=100 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:04:39.677673 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-72b16d73-dfa1-4ebb-aa4a-f86637b81968 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:39.686698 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-72b16d73-dfa1-4ebb-aa4a-f86637b81968 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:39.687162 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-72b16d73-dfa1-4ebb-aa4a-f86637b81968 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:39.691145 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-72b16d73-dfa1-4ebb-aa4a-f86637b81968 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:39.695207 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-72b16d73-dfa1-4ebb-aa4a-f86637b81968 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:39.695207 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-72b16d73-dfa1-4ebb-aa4a-f86637b81968 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:40.053210 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-72b16d73-dfa1-4ebb-aa4a-f86637b81968 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:04:40.066664 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-72b16d73-dfa1-4ebb-aa4a-f86637b81968 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/0902e252-5bb9-462a-979a-0fe67d8884e3" status: 200 len: 1202 microversion: 2.1 time: 0.411757 Sep 23 05:04:40.069610 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3009/6187] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:04:39 2022] GET /compute/v2.1/servers/0902e252-5bb9-462a-979a-0fe67d8884e3 => generated 1202 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:04:40.105981 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-8fc9948e-ddff-46c7-b5b1-5ec56004cf09 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e8ce1f6821424080453f994dbcd604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fefb9fd80184955a7856e1c41d081be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:04:40.114999 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-8fc9948e-ddff-46c7-b5b1-5ec56004cf09 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] 10.222.0.33 "GET /compute/v2.1/servers/8f9812de-fd1b-49c4-b6de-8f5147f05c89" status: 200 len: 1371 microversion: 2.1 time: 0.507258 Sep 23 05:04:40.128469 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3179/6188] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:04:39 2022] GET /compute/v2.1/servers/8f9812de-fd1b-49c4-b6de-8f5147f05c89 => generated 1371 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:04:41.093725 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c6fc8de3-769b-4862-a9c5-06ccfab8c48e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:04:41.094374 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c6fc8de3-769b-4862-a9c5-06ccfab8c48e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 0902e252-5bb9-462a-979a-0fe67d8884e3] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:04:41.124875 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c6fc8de3-769b-4862-a9c5-06ccfab8c48e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:41.125386 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c6fc8de3-769b-4862-a9c5-06ccfab8c48e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:41.125839 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c6fc8de3-769b-4862-a9c5-06ccfab8c48e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:41.126595 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c6fc8de3-769b-4862-a9c5-06ccfab8c48e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:41.127196 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c6fc8de3-769b-4862-a9c5-06ccfab8c48e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:41.127480 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c6fc8de3-769b-4862-a9c5-06ccfab8c48e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:41.142726 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-51a7bc90-9387-4ec5-8251-2f822e49c85f tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:04:41.143983 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-51a7bc90-9387-4ec5-8251-2f822e49c85f tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] [instance: 8f9812de-fd1b-49c4-b6de-8f5147f05c89] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:04:41.151582 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-51a7bc90-9387-4ec5-8251-2f822e49c85f tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:41.152381 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-51a7bc90-9387-4ec5-8251-2f822e49c85f tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:41.156901 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-51a7bc90-9387-4ec5-8251-2f822e49c85f tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:41.157873 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-51a7bc90-9387-4ec5-8251-2f822e49c85f tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:41.158536 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-51a7bc90-9387-4ec5-8251-2f822e49c85f tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:41.159135 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-51a7bc90-9387-4ec5-8251-2f822e49c85f tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:41.795091 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c6fc8de3-769b-4862-a9c5-06ccfab8c48e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:04:41.812273 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c6fc8de3-769b-4862-a9c5-06ccfab8c48e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/0902e252-5bb9-462a-979a-0fe67d8884e3" status: 200 len: 1202 microversion: 2.1 time: 0.722542 Sep 23 05:04:41.813214 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3010/6189] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:04:41 2022] GET /compute/v2.1/servers/0902e252-5bb9-462a-979a-0fe67d8884e3 => generated 1202 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:04:41.817778 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-e7d7b9ba-5ed0-4784-8db1-33a009792f82 req-a1d26186-ce80-4eb6-b20b-641d4aaf9425 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f9812de-fd1b-49c4-b6de-8f5147f05c89", "name": "network-vif-plugged", "status": "completed", "tag": "8869d70a-7591-4bb3-9139-d911ff4a1324"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:04:41.841920 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-e7d7b9ba-5ed0-4784-8db1-33a009792f82 req-a1d26186-ce80-4eb6-b20b-641d4aaf9425 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:41.845112 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-e7d7b9ba-5ed0-4784-8db1-33a009792f82 req-a1d26186-ce80-4eb6-b20b-641d4aaf9425 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:41.845112 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-e7d7b9ba-5ed0-4784-8db1-33a009792f82 req-a1d26186-ce80-4eb6-b20b-641d4aaf9425 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:41.854885 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-e7d7b9ba-5ed0-4784-8db1-33a009792f82 req-a1d26186-ce80-4eb6-b20b-641d4aaf9425 service nova] Creating event network-vif-plugged:8869d70a-7591-4bb3-9139-d911ff4a1324 for instance 8f9812de-fd1b-49c4-b6de-8f5147f05c89 on n-h2-846463-3 Sep 23 05:04:41.860245 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-e7d7b9ba-5ed0-4784-8db1-33a009792f82 req-a1d26186-ce80-4eb6-b20b-641d4aaf9425 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045856 Sep 23 05:04:41.860859 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3011/6190] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:04:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:04:42.094108 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-51a7bc90-9387-4ec5-8251-2f822e49c85f tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e8ce1f6821424080453f994dbcd604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fefb9fd80184955a7856e1c41d081be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:04:42.113659 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-51a7bc90-9387-4ec5-8251-2f822e49c85f tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] 10.222.0.33 "GET /compute/v2.1/servers/8f9812de-fd1b-49c4-b6de-8f5147f05c89" status: 200 len: 1371 microversion: 2.1 time: 0.972543 Sep 23 05:04:42.115920 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3180/6191] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:04:41 2022] GET /compute/v2.1/servers/8f9812de-fd1b-49c4-b6de-8f5147f05c89 => generated 1371 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:04:42.482213 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-50912391-1d27-44bd-82ff-a08bd7e3874d tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-1195020552", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-188609765", "security_groups": [{"name": "tempest-secgroup-smoke-195783981"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "3e6e113c-fb60-4b2f-bc69-c593c3c4ef32"}]}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:04:42.715680 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.network.neutron [None req-50912391-1d27-44bd-82ff-a08bd7e3874d tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] validate_networks() for [('3e6e113c-fb60-4b2f-bc69-c593c3c4ef32', None, None, None, None, None)] {{(pid=122698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 05:04:42.837369 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4509bb84-8374-4536-af71-0ab2d49641dc tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:04:42.838629 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4509bb84-8374-4536-af71-0ab2d49641dc tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 0902e252-5bb9-462a-979a-0fe67d8884e3] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:04:42.847373 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4509bb84-8374-4536-af71-0ab2d49641dc tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:42.848154 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4509bb84-8374-4536-af71-0ab2d49641dc tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:42.849150 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4509bb84-8374-4536-af71-0ab2d49641dc tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:42.852811 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4509bb84-8374-4536-af71-0ab2d49641dc tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:42.852811 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4509bb84-8374-4536-af71-0ab2d49641dc tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:42.852811 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4509bb84-8374-4536-af71-0ab2d49641dc tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:43.278651 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-4509bb84-8374-4536-af71-0ab2d49641dc tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:04:43.293436 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4509bb84-8374-4536-af71-0ab2d49641dc tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/0902e252-5bb9-462a-979a-0fe67d8884e3" status: 200 len: 1202 microversion: 2.1 time: 0.457422 Sep 23 05:04:43.293861 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3181/6192] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:04:42 2022] GET /compute/v2.1/servers/0902e252-5bb9-462a-979a-0fe67d8884e3 => generated 1202 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:04:43.303904 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-114f4bfc-1e65-4a40-8126-29bd40c0dd13 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:04:43.304879 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-114f4bfc-1e65-4a40-8126-29bd40c0dd13 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] [instance: 8f9812de-fd1b-49c4-b6de-8f5147f05c89] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:04:43.314099 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-114f4bfc-1e65-4a40-8126-29bd40c0dd13 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:43.314717 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-114f4bfc-1e65-4a40-8126-29bd40c0dd13 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:43.315534 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-114f4bfc-1e65-4a40-8126-29bd40c0dd13 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:43.316810 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-114f4bfc-1e65-4a40-8126-29bd40c0dd13 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:43.318360 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-114f4bfc-1e65-4a40-8126-29bd40c0dd13 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:43.319064 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-114f4bfc-1e65-4a40-8126-29bd40c0dd13 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:44.105448 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-114f4bfc-1e65-4a40-8126-29bd40c0dd13 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e8ce1f6821424080453f994dbcd604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fefb9fd80184955a7856e1c41d081be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:04:44.116594 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-114f4bfc-1e65-4a40-8126-29bd40c0dd13 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] 10.222.0.33 "GET /compute/v2.1/servers/8f9812de-fd1b-49c4-b6de-8f5147f05c89" status: 200 len: 1371 microversion: 2.1 time: 0.821225 Sep 23 05:04:44.118136 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3182/6193] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:04:43 2022] GET /compute/v2.1/servers/8f9812de-fd1b-49c4-b6de-8f5147f05c89 => generated 1371 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:04:44.316957 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1e037079-6935-4c11-844d-d1964a47474d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:04:44.317862 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1e037079-6935-4c11-844d-d1964a47474d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 0902e252-5bb9-462a-979a-0fe67d8884e3] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:04:44.331386 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e037079-6935-4c11-844d-d1964a47474d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:44.332500 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e037079-6935-4c11-844d-d1964a47474d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:44.333178 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e037079-6935-4c11-844d-d1964a47474d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:44.334129 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e037079-6935-4c11-844d-d1964a47474d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:44.336044 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e037079-6935-4c11-844d-d1964a47474d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:44.338181 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e037079-6935-4c11-844d-d1964a47474d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:44.396720 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-50912391-1d27-44bd-82ff-a08bd7e3874d tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Getting quotas for project 3384c4863e35469b96482ce27d56a36a. Resources: dict_keys(['metadata_items']) {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 05:04:44.414481 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-50912391-1d27-44bd-82ff-a08bd7e3874d tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Getting quotas for user fc338a28098d48bc931a2c29213d1dbb and project 3384c4863e35469b96482ce27d56a36a. Resources: dict_keys(['metadata_items']) {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 05:04:44.452230 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-50912391-1d27-44bd-82ff-a08bd7e3874d tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Flavor limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 05:04:44.452668 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-50912391-1d27-44bd-82ff-a08bd7e3874d tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Image limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 05:04:44.457426 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-50912391-1d27-44bd-82ff-a08bd7e3874d tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Flavor pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 05:04:44.457923 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-50912391-1d27-44bd-82ff-a08bd7e3874d tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Image pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 05:04:44.458349 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-50912391-1d27-44bd-82ff-a08bd7e3874d tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 05:04:44.474761 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-50912391-1d27-44bd-82ff-a08bd7e3874d tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:44.475272 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-50912391-1d27-44bd-82ff-a08bd7e3874d tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:44.475952 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-50912391-1d27-44bd-82ff-a08bd7e3874d tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:44.476888 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-50912391-1d27-44bd-82ff-a08bd7e3874d tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:44.477706 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-50912391-1d27-44bd-82ff-a08bd7e3874d tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:44.478358 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-50912391-1d27-44bd-82ff-a08bd7e3874d tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:44.519994 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-50912391-1d27-44bd-82ff-a08bd7e3874d tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Getting quotas for project 3384c4863e35469b96482ce27d56a36a. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 05:04:44.529707 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-50912391-1d27-44bd-82ff-a08bd7e3874d tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Getting quotas for user fc338a28098d48bc931a2c29213d1dbb and project 3384c4863e35469b96482ce27d56a36a. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 05:04:44.554678 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-50912391-1d27-44bd-82ff-a08bd7e3874d tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Going to run 1 instances... {{(pid=122698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 05:04:44.559744 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-50912391-1d27-44bd-82ff-a08bd7e3874d tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] [instance: 928fb88c-a689-46ee-a069-de58089ceba6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 05:04:44.727583 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-50912391-1d27-44bd-82ff-a08bd7e3874d tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.251233 Sep 23 05:04:44.730767 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3012/6194] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 05:04:42 2022] POST /compute/v2.1/servers => generated 405 bytes in 2256 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 23 05:04:44.745090 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0d55a14d-ae98-4fd1-ace8-2fb0bd05c834 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:04:44.746829 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-0d55a14d-ae98-4fd1-ace8-2fb0bd05c834 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] [instance: 928fb88c-a689-46ee-a069-de58089ceba6] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:04:45.071635 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-0d55a14d-ae98-4fd1-ace8-2fb0bd05c834 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc338a28098d48bc931a2c29213d1dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3384c4863e35469b96482ce27d56a36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:04:45.095121 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0d55a14d-ae98-4fd1-ace8-2fb0bd05c834 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] 10.222.0.33 "GET /compute/v2.1/servers/928fb88c-a689-46ee-a069-de58089ceba6" status: 200 len: 1302 microversion: 2.1 time: 0.352775 Sep 23 05:04:45.096059 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3013/6195] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:04:44 2022] GET /compute/v2.1/servers/928fb88c-a689-46ee-a069-de58089ceba6 => generated 1302 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:04:45.142975 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e8cd82c6-f7c3-4eba-913d-891a0c57aa4b tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:04:45.143652 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e8cd82c6-f7c3-4eba-913d-891a0c57aa4b tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] [instance: 8f9812de-fd1b-49c4-b6de-8f5147f05c89] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:04:45.155673 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e8cd82c6-f7c3-4eba-913d-891a0c57aa4b tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:45.156336 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e8cd82c6-f7c3-4eba-913d-891a0c57aa4b tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:45.156812 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e8cd82c6-f7c3-4eba-913d-891a0c57aa4b tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:45.157581 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e8cd82c6-f7c3-4eba-913d-891a0c57aa4b tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:45.158117 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e8cd82c6-f7c3-4eba-913d-891a0c57aa4b tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:45.160993 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e8cd82c6-f7c3-4eba-913d-891a0c57aa4b tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:45.249735 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1e037079-6935-4c11-844d-d1964a47474d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:04:45.268569 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1e037079-6935-4c11-844d-d1964a47474d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/0902e252-5bb9-462a-979a-0fe67d8884e3" status: 200 len: 1202 microversion: 2.1 time: 0.957569 Sep 23 05:04:45.282390 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3183/6196] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:04:44 2022] GET /compute/v2.1/servers/0902e252-5bb9-462a-979a-0fe67d8884e3 => generated 1202 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:04:45.558086 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e8cd82c6-f7c3-4eba-913d-891a0c57aa4b tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e8ce1f6821424080453f994dbcd604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fefb9fd80184955a7856e1c41d081be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:04:45.568388 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e8cd82c6-f7c3-4eba-913d-891a0c57aa4b tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] 10.222.0.33 "GET /compute/v2.1/servers/8f9812de-fd1b-49c4-b6de-8f5147f05c89" status: 200 len: 1542 microversion: 2.1 time: 0.430387 Sep 23 05:04:45.576834 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3014/6197] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:04:45 2022] GET /compute/v2.1/servers/8f9812de-fd1b-49c4-b6de-8f5147f05c89 => generated 1542 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:04:45.600537 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4ce5141e-aaa6-4198-afaa-2643b9ca11b8 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:04:45.601159 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4ce5141e-aaa6-4198-afaa-2643b9ca11b8 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] [instance: 8f9812de-fd1b-49c4-b6de-8f5147f05c89] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:04:45.613213 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4ce5141e-aaa6-4198-afaa-2643b9ca11b8 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:45.613728 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4ce5141e-aaa6-4198-afaa-2643b9ca11b8 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:45.614247 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4ce5141e-aaa6-4198-afaa-2643b9ca11b8 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:45.614961 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4ce5141e-aaa6-4198-afaa-2643b9ca11b8 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:45.619689 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4ce5141e-aaa6-4198-afaa-2643b9ca11b8 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:45.620502 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4ce5141e-aaa6-4198-afaa-2643b9ca11b8 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:45.622020 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=4 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:04:46.121352 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-873f4eee-63a7-4730-a3d1-debb9856fbe0 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:04:46.122010 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-873f4eee-63a7-4730-a3d1-debb9856fbe0 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] [instance: 928fb88c-a689-46ee-a069-de58089ceba6] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:04:46.137378 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-4ce5141e-aaa6-4198-afaa-2643b9ca11b8 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e8ce1f6821424080453f994dbcd604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fefb9fd80184955a7856e1c41d081be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:04:46.151424 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4ce5141e-aaa6-4198-afaa-2643b9ca11b8 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] 10.222.0.33 "GET /compute/v2.1/servers/8f9812de-fd1b-49c4-b6de-8f5147f05c89" status: 200 len: 1542 microversion: 2.1 time: 0.554651 Sep 23 05:04:46.153793 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3184/6198] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:04:45 2022] GET /compute/v2.1/servers/8f9812de-fd1b-49c4-b6de-8f5147f05c89 => generated 1542 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:04:46.284959 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-873f4eee-63a7-4730-a3d1-debb9856fbe0 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc338a28098d48bc931a2c29213d1dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3384c4863e35469b96482ce27d56a36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:04:46.296155 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-667d4bf8-fa19-48d4-98fc-8171ff17d200 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:04:46.299864 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-667d4bf8-fa19-48d4-98fc-8171ff17d200 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 0902e252-5bb9-462a-979a-0fe67d8884e3] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:04:46.305328 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-873f4eee-63a7-4730-a3d1-debb9856fbe0 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] 10.222.0.33 "GET /compute/v2.1/servers/928fb88c-a689-46ee-a069-de58089ceba6" status: 200 len: 1302 microversion: 2.1 time: 0.188081 Sep 23 05:04:46.307721 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3015/6199] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:04:46 2022] GET /compute/v2.1/servers/928fb88c-a689-46ee-a069-de58089ceba6 => generated 1302 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:04:46.312567 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-667d4bf8-fa19-48d4-98fc-8171ff17d200 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:46.313091 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-667d4bf8-fa19-48d4-98fc-8171ff17d200 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:46.313543 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-667d4bf8-fa19-48d4-98fc-8171ff17d200 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:46.317442 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-667d4bf8-fa19-48d4-98fc-8171ff17d200 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:46.318802 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-667d4bf8-fa19-48d4-98fc-8171ff17d200 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:46.319479 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-667d4bf8-fa19-48d4-98fc-8171ff17d200 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:46.657640 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-667d4bf8-fa19-48d4-98fc-8171ff17d200 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:04:46.669453 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-667d4bf8-fa19-48d4-98fc-8171ff17d200 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/0902e252-5bb9-462a-979a-0fe67d8884e3" status: 200 len: 1202 microversion: 2.1 time: 0.375608 Sep 23 05:04:46.671579 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3185/6200] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:04:46 2022] GET /compute/v2.1/servers/0902e252-5bb9-462a-979a-0fe67d8884e3 => generated 1202 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:04:47.345217 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d5655f1e-f59f-4feb-95e2-494fb896f053 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:04:47.346551 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d5655f1e-f59f-4feb-95e2-494fb896f053 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] [instance: 928fb88c-a689-46ee-a069-de58089ceba6] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:04:47.389509 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d5655f1e-f59f-4feb-95e2-494fb896f053 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:47.391874 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d5655f1e-f59f-4feb-95e2-494fb896f053 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:47.396489 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d5655f1e-f59f-4feb-95e2-494fb896f053 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:47.396489 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d5655f1e-f59f-4feb-95e2-494fb896f053 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:47.396489 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d5655f1e-f59f-4feb-95e2-494fb896f053 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:47.396489 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d5655f1e-f59f-4feb-95e2-494fb896f053 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:47.504039 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d5655f1e-f59f-4feb-95e2-494fb896f053 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc338a28098d48bc931a2c29213d1dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3384c4863e35469b96482ce27d56a36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:04:47.533873 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-c10a324b-009b-41d7-887f-c7a95a908be0 req-c53f53ea-af35-47b1-92a8-67f2ddd06b81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0902e252-5bb9-462a-979a-0fe67d8884e3", "name": "network-vif-plugged", "status": "completed", "tag": "af349a22-4554-45e6-856f-99acd4214448"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:04:47.574557 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d5655f1e-f59f-4feb-95e2-494fb896f053 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] 10.222.0.33 "GET /compute/v2.1/servers/928fb88c-a689-46ee-a069-de58089ceba6" status: 200 len: 1306 microversion: 2.1 time: 0.231528 Sep 23 05:04:47.585024 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-c10a324b-009b-41d7-887f-c7a95a908be0 req-c53f53ea-af35-47b1-92a8-67f2ddd06b81 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:47.585940 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-c10a324b-009b-41d7-887f-c7a95a908be0 req-c53f53ea-af35-47b1-92a8-67f2ddd06b81 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:47.586589 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-c10a324b-009b-41d7-887f-c7a95a908be0 req-c53f53ea-af35-47b1-92a8-67f2ddd06b81 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:47.590080 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3016/6201] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:04:47 2022] GET /compute/v2.1/servers/928fb88c-a689-46ee-a069-de58089ceba6 => generated 1306 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:04:47.615943 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-c10a324b-009b-41d7-887f-c7a95a908be0 req-c53f53ea-af35-47b1-92a8-67f2ddd06b81 service nova] Creating event network-vif-plugged:af349a22-4554-45e6-856f-99acd4214448 for instance 0902e252-5bb9-462a-979a-0fe67d8884e3 on n-h2-846463-3 Sep 23 05:04:47.626376 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-c10a324b-009b-41d7-887f-c7a95a908be0 req-c53f53ea-af35-47b1-92a8-67f2ddd06b81 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103145 Sep 23 05:04:47.627894 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3186/6202] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:04:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:04:47.701189 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3b34c619-673c-4287-8604-08f33d0adbd3 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:04:47.702103 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3b34c619-673c-4287-8604-08f33d0adbd3 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 0902e252-5bb9-462a-979a-0fe67d8884e3] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:04:47.728701 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3b34c619-673c-4287-8604-08f33d0adbd3 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:47.731308 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3b34c619-673c-4287-8604-08f33d0adbd3 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:47.732041 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3b34c619-673c-4287-8604-08f33d0adbd3 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:47.738168 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3b34c619-673c-4287-8604-08f33d0adbd3 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:47.739022 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3b34c619-673c-4287-8604-08f33d0adbd3 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:47.741121 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3b34c619-673c-4287-8604-08f33d0adbd3 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:48.518095 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-3b34c619-673c-4287-8604-08f33d0adbd3 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:04:48.531885 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3b34c619-673c-4287-8604-08f33d0adbd3 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/0902e252-5bb9-462a-979a-0fe67d8884e3" status: 200 len: 1202 microversion: 2.1 time: 0.841262 Sep 23 05:04:48.558837 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3017/6203] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:04:47 2022] GET /compute/v2.1/servers/0902e252-5bb9-462a-979a-0fe67d8884e3 => generated 1202 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:04:48.601114 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-aff50218-e056-44c0-8ad4-a27009bc293a tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:04:48.602216 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-aff50218-e056-44c0-8ad4-a27009bc293a tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] [instance: 928fb88c-a689-46ee-a069-de58089ceba6] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:04:48.616935 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aff50218-e056-44c0-8ad4-a27009bc293a tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:48.618926 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aff50218-e056-44c0-8ad4-a27009bc293a tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:48.619562 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aff50218-e056-44c0-8ad4-a27009bc293a tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:48.621191 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aff50218-e056-44c0-8ad4-a27009bc293a tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:48.624025 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aff50218-e056-44c0-8ad4-a27009bc293a tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:48.624726 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aff50218-e056-44c0-8ad4-a27009bc293a tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:48.836691 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-aff50218-e056-44c0-8ad4-a27009bc293a tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc338a28098d48bc931a2c29213d1dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3384c4863e35469b96482ce27d56a36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:04:48.848700 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-aff50218-e056-44c0-8ad4-a27009bc293a tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] 10.222.0.33 "GET /compute/v2.1/servers/928fb88c-a689-46ee-a069-de58089ceba6" status: 200 len: 1354 microversion: 2.1 time: 0.252858 Sep 23 05:04:48.854652 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3187/6204] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:04:48 2022] GET /compute/v2.1/servers/928fb88c-a689-46ee-a069-de58089ceba6 => generated 1354 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:04:49.558337 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-68ab34f1-d791-4e30-b9e6-feef76316be7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:04:49.559738 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-68ab34f1-d791-4e30-b9e6-feef76316be7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 0902e252-5bb9-462a-979a-0fe67d8884e3] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:04:49.586816 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-68ab34f1-d791-4e30-b9e6-feef76316be7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:49.587619 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-68ab34f1-d791-4e30-b9e6-feef76316be7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:49.588280 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-68ab34f1-d791-4e30-b9e6-feef76316be7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:49.589231 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-68ab34f1-d791-4e30-b9e6-feef76316be7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:49.590472 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-68ab34f1-d791-4e30-b9e6-feef76316be7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:49.591120 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-68ab34f1-d791-4e30-b9e6-feef76316be7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:49.881727 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-883dde5d-2e24-40ea-b88b-3939e4576e23 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:04:49.883039 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-883dde5d-2e24-40ea-b88b-3939e4576e23 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] [instance: 928fb88c-a689-46ee-a069-de58089ceba6] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:04:49.889484 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:04:49.917464 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-883dde5d-2e24-40ea-b88b-3939e4576e23 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:49.918079 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-883dde5d-2e24-40ea-b88b-3939e4576e23 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:49.921851 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-883dde5d-2e24-40ea-b88b-3939e4576e23 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:49.922739 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-883dde5d-2e24-40ea-b88b-3939e4576e23 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:49.931994 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-883dde5d-2e24-40ea-b88b-3939e4576e23 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:49.932449 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-883dde5d-2e24-40ea-b88b-3939e4576e23 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:49.974693 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-68ab34f1-d791-4e30-b9e6-feef76316be7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:04:49.983439 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-68ab34f1-d791-4e30-b9e6-feef76316be7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/0902e252-5bb9-462a-979a-0fe67d8884e3" status: 200 len: 1202 microversion: 2.1 time: 0.431414 Sep 23 05:04:50.002846 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3018/6205] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:04:49 2022] GET /compute/v2.1/servers/0902e252-5bb9-462a-979a-0fe67d8884e3 => generated 1202 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:04:50.103161 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-883dde5d-2e24-40ea-b88b-3939e4576e23 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc338a28098d48bc931a2c29213d1dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3384c4863e35469b96482ce27d56a36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:04:50.115460 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-883dde5d-2e24-40ea-b88b-3939e4576e23 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] 10.222.0.33 "GET /compute/v2.1/servers/928fb88c-a689-46ee-a069-de58089ceba6" status: 200 len: 1360 microversion: 2.1 time: 0.236102 Sep 23 05:04:50.118198 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3188/6206] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:04:49 2022] GET /compute/v2.1/servers/928fb88c-a689-46ee-a069-de58089ceba6 => generated 1360 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:04:50.923023 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-2c462a39-ee17-40fe-b148-731fe4cb208a req-8ac283fc-81dd-4eed-85b3-da6793b2ac48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f9812de-fd1b-49c4-b6de-8f5147f05c89", "tag": "8869d70a-7591-4bb3-9139-d911ff4a1324"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:04:50.958295 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-2c462a39-ee17-40fe-b148-731fe4cb208a req-8ac283fc-81dd-4eed-85b3-da6793b2ac48 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:50.958295 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-2c462a39-ee17-40fe-b148-731fe4cb208a req-8ac283fc-81dd-4eed-85b3-da6793b2ac48 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:50.958295 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-2c462a39-ee17-40fe-b148-731fe4cb208a req-8ac283fc-81dd-4eed-85b3-da6793b2ac48 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:50.995861 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-2c462a39-ee17-40fe-b148-731fe4cb208a req-8ac283fc-81dd-4eed-85b3-da6793b2ac48 service nova] Creating event network-changed:8869d70a-7591-4bb3-9139-d911ff4a1324 for instance 8f9812de-fd1b-49c4-b6de-8f5147f05c89 on n-h2-846463-3 Sep 23 05:04:51.012420 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-2c462a39-ee17-40fe-b148-731fe4cb208a req-8ac283fc-81dd-4eed-85b3-da6793b2ac48 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094276 Sep 23 05:04:51.013474 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7e16491b-aa0e-4bea-a01f-3d015f583af2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:04:51.014196 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-7e16491b-aa0e-4bea-a01f-3d015f583af2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 0902e252-5bb9-462a-979a-0fe67d8884e3] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:04:51.017228 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3019/6207] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:04:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:04:51.026513 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7e16491b-aa0e-4bea-a01f-3d015f583af2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:51.026513 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7e16491b-aa0e-4bea-a01f-3d015f583af2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:51.026778 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7e16491b-aa0e-4bea-a01f-3d015f583af2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:51.028061 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7e16491b-aa0e-4bea-a01f-3d015f583af2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:51.032776 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7e16491b-aa0e-4bea-a01f-3d015f583af2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:51.033245 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7e16491b-aa0e-4bea-a01f-3d015f583af2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:51.155470 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7bdcd085-665c-4e0d-9258-0d80eed79ab5 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:04:51.158394 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7bdcd085-665c-4e0d-9258-0d80eed79ab5 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] [instance: 928fb88c-a689-46ee-a069-de58089ceba6] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:04:51.174170 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7bdcd085-665c-4e0d-9258-0d80eed79ab5 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:51.191037 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7bdcd085-665c-4e0d-9258-0d80eed79ab5 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:51.195620 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7bdcd085-665c-4e0d-9258-0d80eed79ab5 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:51.196501 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7bdcd085-665c-4e0d-9258-0d80eed79ab5 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:51.196999 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7bdcd085-665c-4e0d-9258-0d80eed79ab5 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:51.197530 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7bdcd085-665c-4e0d-9258-0d80eed79ab5 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:51.372700 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-7bdcd085-665c-4e0d-9258-0d80eed79ab5 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc338a28098d48bc931a2c29213d1dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3384c4863e35469b96482ce27d56a36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:04:51.388461 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7bdcd085-665c-4e0d-9258-0d80eed79ab5 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] 10.222.0.33 "GET /compute/v2.1/servers/928fb88c-a689-46ee-a069-de58089ceba6" status: 200 len: 1360 microversion: 2.1 time: 0.246371 Sep 23 05:04:51.391603 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3020/6208] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:04:51 2022] GET /compute/v2.1/servers/928fb88c-a689-46ee-a069-de58089ceba6 => generated 1360 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:04:51.467136 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-7e16491b-aa0e-4bea-a01f-3d015f583af2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:04:51.478625 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-7e16491b-aa0e-4bea-a01f-3d015f583af2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/0902e252-5bb9-462a-979a-0fe67d8884e3" status: 200 len: 1389 microversion: 2.1 time: 0.471597 Sep 23 05:04:51.482596 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3189/6209] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:04:51 2022] GET /compute/v2.1/servers/0902e252-5bb9-462a-979a-0fe67d8884e3 => generated 1389 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:04:51.509323 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8d28316b-20f4-4a4c-aab3-c01193408dda tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:04:51.509973 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8d28316b-20f4-4a4c-aab3-c01193408dda tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 0902e252-5bb9-462a-979a-0fe67d8884e3] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:04:51.520181 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8d28316b-20f4-4a4c-aab3-c01193408dda tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:51.527808 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8d28316b-20f4-4a4c-aab3-c01193408dda tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:51.529082 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8d28316b-20f4-4a4c-aab3-c01193408dda tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:51.530144 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8d28316b-20f4-4a4c-aab3-c01193408dda tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:51.531153 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8d28316b-20f4-4a4c-aab3-c01193408dda tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:51.536783 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8d28316b-20f4-4a4c-aab3-c01193408dda tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:51.816519 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8d28316b-20f4-4a4c-aab3-c01193408dda tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:04:51.829586 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8d28316b-20f4-4a4c-aab3-c01193408dda tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/0902e252-5bb9-462a-979a-0fe67d8884e3" status: 200 len: 1389 microversion: 2.1 time: 0.324555 Sep 23 05:04:51.830528 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3021/6210] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:04:51 2022] GET /compute/v2.1/servers/0902e252-5bb9-462a-979a-0fe67d8884e3 => generated 1389 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:04:51.855933 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-186552a0-86e4-47b7-a035-5a4a441de095 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:04:51.856744 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-186552a0-86e4-47b7-a035-5a4a441de095 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 0902e252-5bb9-462a-979a-0fe67d8884e3] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:04:51.866332 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-186552a0-86e4-47b7-a035-5a4a441de095 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:51.866717 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-186552a0-86e4-47b7-a035-5a4a441de095 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:51.868461 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-186552a0-86e4-47b7-a035-5a4a441de095 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:51.869427 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-186552a0-86e4-47b7-a035-5a4a441de095 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:51.870122 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-186552a0-86e4-47b7-a035-5a4a441de095 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:51.870863 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-186552a0-86e4-47b7-a035-5a4a441de095 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:52.117437 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-186552a0-86e4-47b7-a035-5a4a441de095 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:04:52.142026 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-186552a0-86e4-47b7-a035-5a4a441de095 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/0902e252-5bb9-462a-979a-0fe67d8884e3" status: 200 len: 1389 microversion: 2.1 time: 0.291825 Sep 23 05:04:52.144704 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3190/6211] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:04:51 2022] GET /compute/v2.1/servers/0902e252-5bb9-462a-979a-0fe67d8884e3 => generated 1389 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:04:52.196086 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8e110379-f7e4-42d4-8012-34d28a69167d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:04:52.197351 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8e110379-f7e4-42d4-8012-34d28a69167d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 0902e252-5bb9-462a-979a-0fe67d8884e3] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:04:52.211854 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8e110379-f7e4-42d4-8012-34d28a69167d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:52.212666 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8e110379-f7e4-42d4-8012-34d28a69167d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:52.215772 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8e110379-f7e4-42d4-8012-34d28a69167d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:52.216771 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8e110379-f7e4-42d4-8012-34d28a69167d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:52.218353 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8e110379-f7e4-42d4-8012-34d28a69167d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:52.224410 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8e110379-f7e4-42d4-8012-34d28a69167d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:52.278686 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8e110379-f7e4-42d4-8012-34d28a69167d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 0902e252-5bb9-462a-979a-0fe67d8884e3] Going to try to terminate instance {{(pid=122698) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 05:04:52.419522 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-389b2276-38ee-4112-96be-1e784c2d4024 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:04:52.420265 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-389b2276-38ee-4112-96be-1e784c2d4024 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] [instance: 928fb88c-a689-46ee-a069-de58089ceba6] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:04:52.427579 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-389b2276-38ee-4112-96be-1e784c2d4024 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:52.428180 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-389b2276-38ee-4112-96be-1e784c2d4024 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:52.428686 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-389b2276-38ee-4112-96be-1e784c2d4024 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:52.429468 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-389b2276-38ee-4112-96be-1e784c2d4024 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:52.430054 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-389b2276-38ee-4112-96be-1e784c2d4024 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:52.430546 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-389b2276-38ee-4112-96be-1e784c2d4024 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:52.504838 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-389b2276-38ee-4112-96be-1e784c2d4024 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc338a28098d48bc931a2c29213d1dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3384c4863e35469b96482ce27d56a36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:04:52.516430 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-389b2276-38ee-4112-96be-1e784c2d4024 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] 10.222.0.33 "GET /compute/v2.1/servers/928fb88c-a689-46ee-a069-de58089ceba6" status: 200 len: 1360 microversion: 2.1 time: 0.102411 Sep 23 05:04:52.517284 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3191/6212] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:04:52 2022] GET /compute/v2.1/servers/928fb88c-a689-46ee-a069-de58089ceba6 => generated 1360 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:04:52.922583 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8e110379-f7e4-42d4-8012-34d28a69167d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "DELETE /compute/v2.1/servers/0902e252-5bb9-462a-979a-0fe67d8884e3" status: 204 len: 0 microversion: 2.1 time: 0.730829 Sep 23 05:04:52.923241 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3022/6213] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 05:04:52 2022] DELETE /compute/v2.1/servers/0902e252-5bb9-462a-979a-0fe67d8884e3 => generated 0 bytes in 733 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 05:04:52.932967 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-93987741-d8bf-482d-a98e-880acc2ee288 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:04:52.934008 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-93987741-d8bf-482d-a98e-880acc2ee288 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 0902e252-5bb9-462a-979a-0fe67d8884e3] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:04:52.951265 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-93987741-d8bf-482d-a98e-880acc2ee288 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:52.951778 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-93987741-d8bf-482d-a98e-880acc2ee288 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:52.952256 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-93987741-d8bf-482d-a98e-880acc2ee288 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:52.953184 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-93987741-d8bf-482d-a98e-880acc2ee288 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:52.953426 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-93987741-d8bf-482d-a98e-880acc2ee288 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:52.953861 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-93987741-d8bf-482d-a98e-880acc2ee288 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:53.342744 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-93987741-d8bf-482d-a98e-880acc2ee288 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:04:53.353940 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-93987741-d8bf-482d-a98e-880acc2ee288 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/0902e252-5bb9-462a-979a-0fe67d8884e3" status: 200 len: 1395 microversion: 2.1 time: 0.425863 Sep 23 05:04:53.355981 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3192/6214] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:04:52 2022] GET /compute/v2.1/servers/0902e252-5bb9-462a-979a-0fe67d8884e3 => generated 1395 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:04:53.541658 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3260f9ad-ad1a-4a17-8c66-683d84391520 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:04:53.548920 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3260f9ad-ad1a-4a17-8c66-683d84391520 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] [instance: 928fb88c-a689-46ee-a069-de58089ceba6] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:04:53.574199 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3260f9ad-ad1a-4a17-8c66-683d84391520 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:53.578474 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3260f9ad-ad1a-4a17-8c66-683d84391520 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:53.579217 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3260f9ad-ad1a-4a17-8c66-683d84391520 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:53.580240 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3260f9ad-ad1a-4a17-8c66-683d84391520 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:53.583480 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3260f9ad-ad1a-4a17-8c66-683d84391520 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:53.584114 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3260f9ad-ad1a-4a17-8c66-683d84391520 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:53.921036 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-3260f9ad-ad1a-4a17-8c66-683d84391520 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc338a28098d48bc931a2c29213d1dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3384c4863e35469b96482ce27d56a36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:04:53.937641 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3260f9ad-ad1a-4a17-8c66-683d84391520 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] 10.222.0.33 "GET /compute/v2.1/servers/928fb88c-a689-46ee-a069-de58089ceba6" status: 200 len: 1427 microversion: 2.1 time: 0.400373 Sep 23 05:04:53.938308 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3023/6215] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:04:53 2022] GET /compute/v2.1/servers/928fb88c-a689-46ee-a069-de58089ceba6 => generated 1427 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:04:54.387293 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-957029d9-3fde-4a81-a10d-e228bc06f815 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:04:54.388097 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-957029d9-3fde-4a81-a10d-e228bc06f815 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 0902e252-5bb9-462a-979a-0fe67d8884e3] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:04:54.405932 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-957029d9-3fde-4a81-a10d-e228bc06f815 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:54.407680 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-957029d9-3fde-4a81-a10d-e228bc06f815 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:54.411486 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-957029d9-3fde-4a81-a10d-e228bc06f815 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:54.412530 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-957029d9-3fde-4a81-a10d-e228bc06f815 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:54.413182 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-957029d9-3fde-4a81-a10d-e228bc06f815 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:54.415821 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-957029d9-3fde-4a81-a10d-e228bc06f815 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:54.966545 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-035132cb-e439-4137-920c-95fe75c67483 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:04:54.967882 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-035132cb-e439-4137-920c-95fe75c67483 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] [instance: 928fb88c-a689-46ee-a069-de58089ceba6] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:04:54.974854 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:04:54.978782 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-035132cb-e439-4137-920c-95fe75c67483 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:54.979532 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-035132cb-e439-4137-920c-95fe75c67483 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:54.980875 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-035132cb-e439-4137-920c-95fe75c67483 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:54.995509 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-035132cb-e439-4137-920c-95fe75c67483 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:54.996795 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-035132cb-e439-4137-920c-95fe75c67483 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:54.997584 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-035132cb-e439-4137-920c-95fe75c67483 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:55.246749 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-957029d9-3fde-4a81-a10d-e228bc06f815 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:04:55.255840 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-957029d9-3fde-4a81-a10d-e228bc06f815 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/0902e252-5bb9-462a-979a-0fe67d8884e3" status: 200 len: 1395 microversion: 2.1 time: 0.879314 Sep 23 05:04:55.261288 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3193/6216] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:04:54 2022] GET /compute/v2.1/servers/0902e252-5bb9-462a-979a-0fe67d8884e3 => generated 1395 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:04:55.461384 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-035132cb-e439-4137-920c-95fe75c67483 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc338a28098d48bc931a2c29213d1dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3384c4863e35469b96482ce27d56a36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:04:55.489789 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-035132cb-e439-4137-920c-95fe75c67483 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] 10.222.0.33 "GET /compute/v2.1/servers/928fb88c-a689-46ee-a069-de58089ceba6" status: 200 len: 1427 microversion: 2.1 time: 0.525452 Sep 23 05:04:55.492021 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3024/6217] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:04:54 2022] GET /compute/v2.1/servers/928fb88c-a689-46ee-a069-de58089ceba6 => generated 1427 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:04:56.290315 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-544ae6de-43c7-43f5-86c3-0ede338b855b tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:04:56.291766 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-544ae6de-43c7-43f5-86c3-0ede338b855b tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 0902e252-5bb9-462a-979a-0fe67d8884e3] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:04:56.300808 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-544ae6de-43c7-43f5-86c3-0ede338b855b tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:56.301682 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-544ae6de-43c7-43f5-86c3-0ede338b855b tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:56.302365 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-544ae6de-43c7-43f5-86c3-0ede338b855b tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:56.303280 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-544ae6de-43c7-43f5-86c3-0ede338b855b tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:56.303924 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-544ae6de-43c7-43f5-86c3-0ede338b855b tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:56.304547 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-544ae6de-43c7-43f5-86c3-0ede338b855b tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:56.480509 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-544ae6de-43c7-43f5-86c3-0ede338b855b tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:04:56.491078 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-544ae6de-43c7-43f5-86c3-0ede338b855b tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/0902e252-5bb9-462a-979a-0fe67d8884e3" status: 200 len: 1353 microversion: 2.1 time: 0.205710 Sep 23 05:04:56.507830 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3194/6218] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:04:56 2022] GET /compute/v2.1/servers/0902e252-5bb9-462a-979a-0fe67d8884e3 => generated 1353 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:04:56.523369 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-121db0e9-0b8f-4167-8f7b-83a446af8937 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:04:56.523369 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-121db0e9-0b8f-4167-8f7b-83a446af8937 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] [instance: 928fb88c-a689-46ee-a069-de58089ceba6] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:04:56.554705 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=14 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:04:56.558537 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:04:56.568428 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-121db0e9-0b8f-4167-8f7b-83a446af8937 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:56.568936 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-121db0e9-0b8f-4167-8f7b-83a446af8937 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:56.569410 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-121db0e9-0b8f-4167-8f7b-83a446af8937 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:56.570162 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-121db0e9-0b8f-4167-8f7b-83a446af8937 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:56.570617 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-121db0e9-0b8f-4167-8f7b-83a446af8937 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:56.577559 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-121db0e9-0b8f-4167-8f7b-83a446af8937 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:56.768543 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-42151381-100f-422d-ad5b-86be33e8313b req-449f8bfd-3b15-4c67-8e3e-f3da084b6b5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0902e252-5bb9-462a-979a-0fe67d8884e3", "name": "network-vif-deleted", "tag": "af349a22-4554-45e6-856f-99acd4214448"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:04:56.783042 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-42151381-100f-422d-ad5b-86be33e8313b req-449f8bfd-3b15-4c67-8e3e-f3da084b6b5a service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:56.784879 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-42151381-100f-422d-ad5b-86be33e8313b req-449f8bfd-3b15-4c67-8e3e-f3da084b6b5a service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:56.787154 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-42151381-100f-422d-ad5b-86be33e8313b req-449f8bfd-3b15-4c67-8e3e-f3da084b6b5a service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:56.820034 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-42151381-100f-422d-ad5b-86be33e8313b req-449f8bfd-3b15-4c67-8e3e-f3da084b6b5a service nova] Creating event network-vif-deleted:af349a22-4554-45e6-856f-99acd4214448 for instance 0902e252-5bb9-462a-979a-0fe67d8884e3 on n-h2-846463-3 Sep 23 05:04:56.838423 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-42151381-100f-422d-ad5b-86be33e8313b req-449f8bfd-3b15-4c67-8e3e-f3da084b6b5a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073255 Sep 23 05:04:56.840181 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3195/6219] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:04:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:04:56.859172 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-121db0e9-0b8f-4167-8f7b-83a446af8937 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc338a28098d48bc931a2c29213d1dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3384c4863e35469b96482ce27d56a36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:04:56.867646 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-121db0e9-0b8f-4167-8f7b-83a446af8937 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] 10.222.0.33 "GET /compute/v2.1/servers/928fb88c-a689-46ee-a069-de58089ceba6" status: 200 len: 1427 microversion: 2.1 time: 0.350838 Sep 23 05:04:56.868245 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3025/6220] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:04:56 2022] GET /compute/v2.1/servers/928fb88c-a689-46ee-a069-de58089ceba6 => generated 1427 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:04:57.537441 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f730dc34-857e-4d9b-b522-eabdf5007b7f tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:04:57.538213 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f730dc34-857e-4d9b-b522-eabdf5007b7f tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 0902e252-5bb9-462a-979a-0fe67d8884e3] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:04:57.552125 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f730dc34-857e-4d9b-b522-eabdf5007b7f tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:57.555979 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f730dc34-857e-4d9b-b522-eabdf5007b7f tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:57.556726 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f730dc34-857e-4d9b-b522-eabdf5007b7f tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:57.562359 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f730dc34-857e-4d9b-b522-eabdf5007b7f tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:57.563106 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f730dc34-857e-4d9b-b522-eabdf5007b7f tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:57.563722 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f730dc34-857e-4d9b-b522-eabdf5007b7f tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:57.699654 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f730dc34-857e-4d9b-b522-eabdf5007b7f tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:04:57.712544 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f730dc34-857e-4d9b-b522-eabdf5007b7f tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/0902e252-5bb9-462a-979a-0fe67d8884e3" status: 200 len: 1187 microversion: 2.1 time: 0.180429 Sep 23 05:04:57.713782 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3196/6221] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:04:57 2022] GET /compute/v2.1/servers/0902e252-5bb9-462a-979a-0fe67d8884e3 => generated 1187 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:04:57.759363 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0b47a31c-c0e7-441b-bc61-92afcc3e1114 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:04:57.760056 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-0b47a31c-c0e7-441b-bc61-92afcc3e1114 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: f67681e5-fced-41b4-ae7c-7ce922f09df1] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:04:57.786009 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0b47a31c-c0e7-441b-bc61-92afcc3e1114 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:57.795215 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0b47a31c-c0e7-441b-bc61-92afcc3e1114 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:57.796856 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0b47a31c-c0e7-441b-bc61-92afcc3e1114 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:57.802773 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0b47a31c-c0e7-441b-bc61-92afcc3e1114 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:57.803962 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0b47a31c-c0e7-441b-bc61-92afcc3e1114 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:57.804667 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0b47a31c-c0e7-441b-bc61-92afcc3e1114 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:57.809722 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:04:57.857425 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0b47a31c-c0e7-441b-bc61-92afcc3e1114 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/f67681e5-fced-41b4-ae7c-7ce922f09df1/ips" status: 200 len: 150 microversion: 2.1 time: 0.100387 Sep 23 05:04:57.858152 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3026/6222] 10.222.0.33 () {58 vars in 1248 bytes} [Fri Sep 23 05:04:57 2022] GET /compute/v2.1/servers/f67681e5-fced-41b4-ae7c-7ce922f09df1/ips => generated 150 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:04:57.877541 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6e1fecad-a47e-49a4-a72e-5439105db743 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0f463ce8-486f-4168-98b1-75c12f7dd2b7"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:04:57.880415 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-6e1fecad-a47e-49a4-a72e-5439105db743 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: f67681e5-fced-41b4-ae7c-7ce922f09df1] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:04:57.899730 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-bb0e4a1b-0fe2-44a8-8aa9-4cb31e1aa932 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:04:57.910327 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-bb0e4a1b-0fe2-44a8-8aa9-4cb31e1aa932 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] [instance: 928fb88c-a689-46ee-a069-de58089ceba6] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:04:57.912205 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6e1fecad-a47e-49a4-a72e-5439105db743 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:57.918072 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6e1fecad-a47e-49a4-a72e-5439105db743 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:57.918709 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6e1fecad-a47e-49a4-a72e-5439105db743 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:57.922347 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bb0e4a1b-0fe2-44a8-8aa9-4cb31e1aa932 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:57.925201 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6e1fecad-a47e-49a4-a72e-5439105db743 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:57.925827 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6e1fecad-a47e-49a4-a72e-5439105db743 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:57.928067 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6e1fecad-a47e-49a4-a72e-5439105db743 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:57.935803 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bb0e4a1b-0fe2-44a8-8aa9-4cb31e1aa932 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:57.936483 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bb0e4a1b-0fe2-44a8-8aa9-4cb31e1aa932 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:57.937368 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bb0e4a1b-0fe2-44a8-8aa9-4cb31e1aa932 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:57.939537 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=100 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:04:57.940183 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bb0e4a1b-0fe2-44a8-8aa9-4cb31e1aa932 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:57.940743 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bb0e4a1b-0fe2-44a8-8aa9-4cb31e1aa932 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:58.150805 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-6e1fecad-a47e-49a4-a72e-5439105db743 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] HTTP exception thrown: Invalid volume: volume 0f463ce8-486f-4168-98b1-75c12f7dd2b7 is already attached to instances: 9984baa4-fc75-4d8f-a660-0647326196af Sep 23 05:04:58.182582 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6e1fecad-a47e-49a4-a72e-5439105db743 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Request method failure captured: Sep 23 05:04:58.182582 n-d-846463-3 devstack@n-api.service[122699]: request: POST /compute/v2.1/servers/f67681e5-fced-41b4-ae7c-7ce922f09df1/os-volume_attachments HTTP/1.1 Sep 23 05:04:58.182582 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 05:04:58.182582 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 05:04:58.182582 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 05:04:58.182582 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 74 Sep 23 05:04:58.182582 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 05:04:58.182582 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 05:04:58.182582 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 05:04:58.182582 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 05:04:58.182582 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLT3a68wnGhJ1ri_wJa0c61-k-Mmu1aJqy0y8F08NYCjz_D70vilLx9G5I0GwzbhL1w2apyr58UgTWfFCoyEumWwAPT_5jEMZEFbxFGBL8lKHDufPcaCD0r7hhVTJQk-EQJ3nL8ZwWE56HAQoDgwteQ7RqvbmQmN2QkHgdyJgN3h_vQg Sep 23 05:04:58.182582 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 05:04:58.182582 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 05:04:58.182582 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 05:04:58.182582 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 05:04:58.182582 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 05:04:58.182582 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 05:04:58.182582 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: daad67f26fe246d6b4d28cad1707a119 Sep 23 05:04:58.182582 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-AttachVolumeNegativeTest-1007727461 Sep 23 05:04:58.182582 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 05:04:58.182582 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 05:04:58.182582 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_daad67f26fe246d6b4d28cad1707a119", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/daad67f26fe246d6b4d28cad1707a119"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/daad67f26fe246d6b4d28cad1707a119"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/daad67f26fe246d6b4d28cad1707a119"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:04:58.182582 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-AttachVolumeNegativeTest-1007727461 Sep 23 05:04:58.182582 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: daad67f26fe246d6b4d28cad1707a119 Sep 23 05:04:58.182582 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1007727461 Sep 23 05:04:58.182582 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-AttachVolumeNegativeTest-1007727461-project Sep 23 05:04:58.182582 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 05:04:58.182582 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 05:04:58.182582 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 59d90150ed7d477fab33129cb3b068ed Sep 23 05:04:58.182582 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-AttachVolumeNegativeTest-1007727461-project Sep 23 05:04:58.182582 n-d-846463-3 devstack@n-api.service[122699]: Sep 23 05:04:58.182582 n-d-846463-3 devstack@n-api.service[122699]: {"volumeAttachment": {"volumeId": "0f463ce8-486f-4168-98b1-75c12f7dd2b7"}} Sep 23 05:04:58.182582 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 05:04:58.182582 n-d-846463-3 devstack@n-api.service[122699]: exception: Invalid volume: volume 0f463ce8-486f-4168-98b1-75c12f7dd2b7 is already attached to instances: 9984baa4-fc75-4d8f-a660-0647326196af Sep 23 05:04:58.182582 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'server_id': 'f67681e5-fced-41b4-ae7c-7ce922f09df1', 'body': {'volumeAttachment': {'volumeId': '0f463ce8-486f-4168-98b1-75c12f7dd2b7'}}} Sep 23 05:04:58.182582 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:04:58.182582 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:04:58.182582 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 23 05:04:58.182582 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 23 05:04:58.182582 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 23 05:04:58.182582 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 23 05:04:58.182582 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 23 05:04:58.182582 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 23 05:04:58.182582 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 23 05:04:58.182582 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 23 05:04:58.182582 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 23 05:04:58.182582 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 23 05:04:58.182582 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 0f463ce8-486f-4168-98b1-75c12f7dd2b7 is already attached to instances: 9984baa4-fc75-4d8f-a660-0647326196af Sep 23 05:04:58.182582 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:04:58.182582 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:04:58.182582 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:04:58.182582 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:04:58.182582 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:04:58.182582 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:04:58.182582 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:04:58.182582 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:04:58.182582 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:04:58.182582 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:04:58.182582 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 05:04:58.182582 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 05:04:58.182582 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 05:04:58.182582 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 05:04:58.189978 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 05:04:58.189978 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 05:04:58.189978 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 23 05:04:58.189978 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 23 05:04:58.189978 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 0f463ce8-486f-4168-98b1-75c12f7dd2b7 is already attached to instances: 9984baa4-fc75-4d8f-a660-0647326196af Sep 23 05:04:58.189978 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:04:58.189978 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:04:58.189978 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:04:58.189978 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:04:58.189978 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:04:58.189978 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:04:58.189978 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:04:58.189978 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:04:58.189978 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 0f463ce8-486f-4168-98b1-75c12f7dd2b7 is already attached to instances: 9984baa4-fc75-4d8f-a660-0647326196af Sep 23 05:04:58.189978 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:04:58.189978 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6e1fecad-a47e-49a4-a72e-5439105db743 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Returning 400 to user: Invalid volume: volume 0f463ce8-486f-4168-98b1-75c12f7dd2b7 is already attached to instances: 9984baa4-fc75-4d8f-a660-0647326196af {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:04:58.189978 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6e1fecad-a47e-49a4-a72e-5439105db743 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "POST /compute/v2.1/servers/f67681e5-fced-41b4-ae7c-7ce922f09df1/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.320060 Sep 23 05:04:58.192013 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3197/6223] 10.222.0.33 () {60 vars in 1323 bytes} [Fri Sep 23 05:04:57 2022] POST /compute/v2.1/servers/f67681e5-fced-41b4-ae7c-7ce922f09df1/os-volume_attachments => generated 174 bytes in 324 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 05:04:58.199019 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ad454e55-ed96-44f5-85c9-6ea1816f88d2 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:04:58.199629 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ad454e55-ed96-44f5-85c9-6ea1816f88d2 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: f67681e5-fced-41b4-ae7c-7ce922f09df1] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:04:58.209213 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ad454e55-ed96-44f5-85c9-6ea1816f88d2 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:58.216609 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ad454e55-ed96-44f5-85c9-6ea1816f88d2 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:58.217225 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ad454e55-ed96-44f5-85c9-6ea1816f88d2 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:58.218131 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ad454e55-ed96-44f5-85c9-6ea1816f88d2 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:58.218729 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ad454e55-ed96-44f5-85c9-6ea1816f88d2 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:58.219281 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ad454e55-ed96-44f5-85c9-6ea1816f88d2 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:58.289665 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ad454e55-ed96-44f5-85c9-6ea1816f88d2 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: f67681e5-fced-41b4-ae7c-7ce922f09df1] Going to try to terminate instance {{(pid=122699) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 05:04:58.323465 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-bb0e4a1b-0fe2-44a8-8aa9-4cb31e1aa932 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc338a28098d48bc931a2c29213d1dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3384c4863e35469b96482ce27d56a36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:04:58.334849 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-bb0e4a1b-0fe2-44a8-8aa9-4cb31e1aa932 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] 10.222.0.33 "GET /compute/v2.1/servers/928fb88c-a689-46ee-a069-de58089ceba6" status: 200 len: 1427 microversion: 2.1 time: 0.440726 Sep 23 05:04:58.337120 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3027/6224] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:04:57 2022] GET /compute/v2.1/servers/928fb88c-a689-46ee-a069-de58089ceba6 => generated 1427 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:04:58.748330 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ad454e55-ed96-44f5-85c9-6ea1816f88d2 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f67681e5-fced-41b4-ae7c-7ce922f09df1" status: 204 len: 0 microversion: 2.1 time: 0.553430 Sep 23 05:04:58.755042 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-399a249f-4f02-48f3-9f64-00c91085fcb0 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:04:58.755210 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3198/6225] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 05:04:58 2022] DELETE /compute/v2.1/servers/f67681e5-fced-41b4-ae7c-7ce922f09df1 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 23 05:04:58.755311 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-399a249f-4f02-48f3-9f64-00c91085fcb0 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 0902e252-5bb9-462a-979a-0fe67d8884e3] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:04:58.758888 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5f955aa1-0be0-40ea-9c25-dfe9cae7b039 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:04:58.760406 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-399a249f-4f02-48f3-9f64-00c91085fcb0 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:58.762216 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-5f955aa1-0be0-40ea-9c25-dfe9cae7b039 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: f67681e5-fced-41b4-ae7c-7ce922f09df1] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:04:58.766253 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-399a249f-4f02-48f3-9f64-00c91085fcb0 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:58.767203 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-399a249f-4f02-48f3-9f64-00c91085fcb0 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:58.768102 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-399a249f-4f02-48f3-9f64-00c91085fcb0 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:58.768906 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-399a249f-4f02-48f3-9f64-00c91085fcb0 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:58.769609 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-399a249f-4f02-48f3-9f64-00c91085fcb0 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:58.774919 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5f955aa1-0be0-40ea-9c25-dfe9cae7b039 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:58.778786 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5f955aa1-0be0-40ea-9c25-dfe9cae7b039 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:58.778786 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5f955aa1-0be0-40ea-9c25-dfe9cae7b039 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:58.778786 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5f955aa1-0be0-40ea-9c25-dfe9cae7b039 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:58.778786 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5f955aa1-0be0-40ea-9c25-dfe9cae7b039 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:58.778786 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5f955aa1-0be0-40ea-9c25-dfe9cae7b039 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:58.915008 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-399a249f-4f02-48f3-9f64-00c91085fcb0 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:04:58.927718 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-399a249f-4f02-48f3-9f64-00c91085fcb0 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/0902e252-5bb9-462a-979a-0fe67d8884e3" status: 200 len: 1187 microversion: 2.1 time: 0.194233 Sep 23 05:04:58.928325 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3028/6226] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:04:58 2022] GET /compute/v2.1/servers/0902e252-5bb9-462a-979a-0fe67d8884e3 => generated 1187 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:04:58.962934 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-47c99806-3487-4b42-bcf5-b331bc9d319b req-c8773a46-f2f3-4712-bc1e-8e161b925155 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "928fb88c-a689-46ee-a069-de58089ceba6", "tag": "138b0b6f-3e79-4ed9-a4e8-3cf14b605b8d"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:04:58.982353 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-47c99806-3487-4b42-bcf5-b331bc9d319b req-c8773a46-f2f3-4712-bc1e-8e161b925155 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:58.984806 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-47c99806-3487-4b42-bcf5-b331bc9d319b req-c8773a46-f2f3-4712-bc1e-8e161b925155 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:58.987804 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-47c99806-3487-4b42-bcf5-b331bc9d319b req-c8773a46-f2f3-4712-bc1e-8e161b925155 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:59.019108 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-47c99806-3487-4b42-bcf5-b331bc9d319b req-c8773a46-f2f3-4712-bc1e-8e161b925155 service nova] Creating event network-changed:138b0b6f-3e79-4ed9-a4e8-3cf14b605b8d for instance 928fb88c-a689-46ee-a069-de58089ceba6 on n-h1-846463-3 Sep 23 05:04:59.029723 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-47c99806-3487-4b42-bcf5-b331bc9d319b req-c8773a46-f2f3-4712-bc1e-8e161b925155 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070864 Sep 23 05:04:59.034590 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-5f955aa1-0be0-40ea-9c25-dfe9cae7b039 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d90150ed7d477fab33129cb3b068ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daad67f26fe246d6b4d28cad1707a119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:04:59.045351 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5f955aa1-0be0-40ea-9c25-dfe9cae7b039 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/f67681e5-fced-41b4-ae7c-7ce922f09df1" status: 200 len: 1680 microversion: 2.1 time: 0.291415 Sep 23 05:04:59.046302 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3029/6227] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:04:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 05:04:59.048284 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3199/6228] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:04:58 2022] GET /compute/v2.1/servers/f67681e5-fced-41b4-ae7c-7ce922f09df1 => generated 1680 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:04:59.366904 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-080586a0-598c-4e55-8676-91989fcc16e0 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:04:59.367612 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-080586a0-598c-4e55-8676-91989fcc16e0 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] [instance: 928fb88c-a689-46ee-a069-de58089ceba6] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:04:59.375093 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-080586a0-598c-4e55-8676-91989fcc16e0 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:59.376223 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-080586a0-598c-4e55-8676-91989fcc16e0 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:59.376626 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-080586a0-598c-4e55-8676-91989fcc16e0 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:59.377642 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-080586a0-598c-4e55-8676-91989fcc16e0 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:59.378315 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-080586a0-598c-4e55-8676-91989fcc16e0 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:59.379183 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-080586a0-598c-4e55-8676-91989fcc16e0 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:59.801546 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-080586a0-598c-4e55-8676-91989fcc16e0 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc338a28098d48bc931a2c29213d1dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3384c4863e35469b96482ce27d56a36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:04:59.807661 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-080586a0-598c-4e55-8676-91989fcc16e0 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] 10.222.0.33 "GET /compute/v2.1/servers/928fb88c-a689-46ee-a069-de58089ceba6" status: 200 len: 1427 microversion: 2.1 time: 0.445898 Sep 23 05:04:59.808767 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3030/6229] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:04:59 2022] GET /compute/v2.1/servers/928fb88c-a689-46ee-a069-de58089ceba6 => generated 1427 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:04:59.955423 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8be829cf-ef24-4e53-b387-2da046def165 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:04:59.956706 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-8be829cf-ef24-4e53-b387-2da046def165 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 0902e252-5bb9-462a-979a-0fe67d8884e3] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:04:59.968630 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8be829cf-ef24-4e53-b387-2da046def165 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:59.969411 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8be829cf-ef24-4e53-b387-2da046def165 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:59.970060 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8be829cf-ef24-4e53-b387-2da046def165 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:04:59.973579 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8be829cf-ef24-4e53-b387-2da046def165 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:04:59.974393 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8be829cf-ef24-4e53-b387-2da046def165 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:04:59.975059 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8be829cf-ef24-4e53-b387-2da046def165 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:00.086516 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d7aec81d-816f-4f54-8257-da1b6dbfc0f2 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:05:00.087345 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d7aec81d-816f-4f54-8257-da1b6dbfc0f2 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: f67681e5-fced-41b4-ae7c-7ce922f09df1] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:05:00.099303 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d7aec81d-816f-4f54-8257-da1b6dbfc0f2 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:00.100514 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d7aec81d-816f-4f54-8257-da1b6dbfc0f2 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:00.102375 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d7aec81d-816f-4f54-8257-da1b6dbfc0f2 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:00.105676 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d7aec81d-816f-4f54-8257-da1b6dbfc0f2 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:00.107958 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d7aec81d-816f-4f54-8257-da1b6dbfc0f2 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:00.114821 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d7aec81d-816f-4f54-8257-da1b6dbfc0f2 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:00.149047 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-8be829cf-ef24-4e53-b387-2da046def165 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:05:00.160353 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-8be829cf-ef24-4e53-b387-2da046def165 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/0902e252-5bb9-462a-979a-0fe67d8884e3" status: 200 len: 1187 microversion: 2.1 time: 0.209350 Sep 23 05:05:00.164703 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3200/6230] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:04:59 2022] GET /compute/v2.1/servers/0902e252-5bb9-462a-979a-0fe67d8884e3 => generated 1187 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:05:00.501245 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d7aec81d-816f-4f54-8257-da1b6dbfc0f2 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d90150ed7d477fab33129cb3b068ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daad67f26fe246d6b4d28cad1707a119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:05:00.527236 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d7aec81d-816f-4f54-8257-da1b6dbfc0f2 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/f67681e5-fced-41b4-ae7c-7ce922f09df1" status: 200 len: 1680 microversion: 2.1 time: 0.436365 Sep 23 05:05:00.545919 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3031/6231] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:05:00 2022] GET /compute/v2.1/servers/f67681e5-fced-41b4-ae7c-7ce922f09df1 => generated 1680 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:05:00.832150 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-724982ea-312c-45e4-b84c-33387f000478 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:05:00.833147 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-724982ea-312c-45e4-b84c-33387f000478 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] [instance: 928fb88c-a689-46ee-a069-de58089ceba6] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:05:00.842740 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-724982ea-312c-45e4-b84c-33387f000478 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:00.845626 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-724982ea-312c-45e4-b84c-33387f000478 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:00.847539 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-724982ea-312c-45e4-b84c-33387f000478 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:00.849814 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-724982ea-312c-45e4-b84c-33387f000478 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:00.852801 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-724982ea-312c-45e4-b84c-33387f000478 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:00.853496 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-724982ea-312c-45e4-b84c-33387f000478 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:01.117837 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-724982ea-312c-45e4-b84c-33387f000478 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc338a28098d48bc931a2c29213d1dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3384c4863e35469b96482ce27d56a36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:05:01.133937 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-724982ea-312c-45e4-b84c-33387f000478 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] 10.222.0.33 "GET /compute/v2.1/servers/928fb88c-a689-46ee-a069-de58089ceba6" status: 200 len: 1427 microversion: 2.1 time: 0.305693 Sep 23 05:05:01.134939 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3201/6232] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:05:00 2022] GET /compute/v2.1/servers/928fb88c-a689-46ee-a069-de58089ceba6 => generated 1427 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:05:01.190202 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4291a5f9-b3c4-4e7a-85b7-81b0eb47e237 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:05:01.192355 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4291a5f9-b3c4-4e7a-85b7-81b0eb47e237 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 0902e252-5bb9-462a-979a-0fe67d8884e3] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:05:01.201090 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4291a5f9-b3c4-4e7a-85b7-81b0eb47e237 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:01.201829 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4291a5f9-b3c4-4e7a-85b7-81b0eb47e237 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:01.202453 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4291a5f9-b3c4-4e7a-85b7-81b0eb47e237 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:01.203657 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4291a5f9-b3c4-4e7a-85b7-81b0eb47e237 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:01.204299 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4291a5f9-b3c4-4e7a-85b7-81b0eb47e237 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:01.205041 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4291a5f9-b3c4-4e7a-85b7-81b0eb47e237 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:01.345854 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4291a5f9-b3c4-4e7a-85b7-81b0eb47e237 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:05:01.365376 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4291a5f9-b3c4-4e7a-85b7-81b0eb47e237 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/0902e252-5bb9-462a-979a-0fe67d8884e3" status: 200 len: 1187 microversion: 2.1 time: 0.176639 Sep 23 05:05:01.369477 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3032/6233] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:05:01 2022] GET /compute/v2.1/servers/0902e252-5bb9-462a-979a-0fe67d8884e3 => generated 1187 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:05:01.561682 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f8967efa-4e17-4582-b1c3-28e8da3f486c tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:05:01.569952 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f8967efa-4e17-4582-b1c3-28e8da3f486c tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: f67681e5-fced-41b4-ae7c-7ce922f09df1] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:05:01.583629 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f8967efa-4e17-4582-b1c3-28e8da3f486c tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:01.584145 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f8967efa-4e17-4582-b1c3-28e8da3f486c tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:01.584587 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f8967efa-4e17-4582-b1c3-28e8da3f486c tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:01.594249 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f8967efa-4e17-4582-b1c3-28e8da3f486c tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:01.594249 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f8967efa-4e17-4582-b1c3-28e8da3f486c tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:01.594249 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f8967efa-4e17-4582-b1c3-28e8da3f486c tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:01.862397 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f8967efa-4e17-4582-b1c3-28e8da3f486c tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d90150ed7d477fab33129cb3b068ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daad67f26fe246d6b4d28cad1707a119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:05:01.873921 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f8967efa-4e17-4582-b1c3-28e8da3f486c tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/f67681e5-fced-41b4-ae7c-7ce922f09df1" status: 200 len: 1680 microversion: 2.1 time: 0.317304 Sep 23 05:05:01.875240 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3202/6234] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:05:01 2022] GET /compute/v2.1/servers/f67681e5-fced-41b4-ae7c-7ce922f09df1 => generated 1680 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:05:02.162101 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-70c9deca-5aa5-4c0a-a5e0-b5b53bc0a15a tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:05:02.163089 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-70c9deca-5aa5-4c0a-a5e0-b5b53bc0a15a tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] [instance: 928fb88c-a689-46ee-a069-de58089ceba6] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:05:02.187134 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-70c9deca-5aa5-4c0a-a5e0-b5b53bc0a15a tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:02.189619 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-70c9deca-5aa5-4c0a-a5e0-b5b53bc0a15a tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:02.191316 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-70c9deca-5aa5-4c0a-a5e0-b5b53bc0a15a tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:02.207068 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-70c9deca-5aa5-4c0a-a5e0-b5b53bc0a15a tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:02.211354 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-70c9deca-5aa5-4c0a-a5e0-b5b53bc0a15a tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:02.213535 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-70c9deca-5aa5-4c0a-a5e0-b5b53bc0a15a tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:02.394169 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-667441d0-37c0-4224-82b3-bee8f94fa02b tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:05:02.395683 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-667441d0-37c0-4224-82b3-bee8f94fa02b tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 0902e252-5bb9-462a-979a-0fe67d8884e3] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:05:02.407011 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-667441d0-37c0-4224-82b3-bee8f94fa02b tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:02.407809 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-667441d0-37c0-4224-82b3-bee8f94fa02b tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:02.408721 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-667441d0-37c0-4224-82b3-bee8f94fa02b tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:02.410257 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-667441d0-37c0-4224-82b3-bee8f94fa02b tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:02.411251 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-667441d0-37c0-4224-82b3-bee8f94fa02b tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:02.412019 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-667441d0-37c0-4224-82b3-bee8f94fa02b tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:02.542473 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-667441d0-37c0-4224-82b3-bee8f94fa02b tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:05:02.545311 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-70c9deca-5aa5-4c0a-a5e0-b5b53bc0a15a tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc338a28098d48bc931a2c29213d1dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3384c4863e35469b96482ce27d56a36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:05:02.555027 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-70c9deca-5aa5-4c0a-a5e0-b5b53bc0a15a tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] 10.222.0.33 "GET /compute/v2.1/servers/928fb88c-a689-46ee-a069-de58089ceba6" status: 200 len: 1427 microversion: 2.1 time: 0.398116 Sep 23 05:05:02.556604 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-667441d0-37c0-4224-82b3-bee8f94fa02b tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/0902e252-5bb9-462a-979a-0fe67d8884e3" status: 200 len: 1187 microversion: 2.1 time: 0.167656 Sep 23 05:05:02.558958 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3203/6235] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:05:02 2022] GET /compute/v2.1/servers/0902e252-5bb9-462a-979a-0fe67d8884e3 => generated 1187 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:05:02.559344 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3033/6236] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:05:02 2022] GET /compute/v2.1/servers/928fb88c-a689-46ee-a069-de58089ceba6 => generated 1427 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:05:02.899177 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-dea43aff-e5aa-47e5-a38a-c9042794e1f0 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:05:02.899810 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-dea43aff-e5aa-47e5-a38a-c9042794e1f0 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: f67681e5-fced-41b4-ae7c-7ce922f09df1] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:05:02.914030 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dea43aff-e5aa-47e5-a38a-c9042794e1f0 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:02.914535 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dea43aff-e5aa-47e5-a38a-c9042794e1f0 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:02.919646 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dea43aff-e5aa-47e5-a38a-c9042794e1f0 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:02.921869 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dea43aff-e5aa-47e5-a38a-c9042794e1f0 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:02.923460 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dea43aff-e5aa-47e5-a38a-c9042794e1f0 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:02.924765 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dea43aff-e5aa-47e5-a38a-c9042794e1f0 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:03.193473 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-dea43aff-e5aa-47e5-a38a-c9042794e1f0 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d90150ed7d477fab33129cb3b068ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daad67f26fe246d6b4d28cad1707a119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:05:03.206529 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-dea43aff-e5aa-47e5-a38a-c9042794e1f0 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/f67681e5-fced-41b4-ae7c-7ce922f09df1" status: 200 len: 1680 microversion: 2.1 time: 0.312044 Sep 23 05:05:03.207691 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3204/6237] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:05:02 2022] GET /compute/v2.1/servers/f67681e5-fced-41b4-ae7c-7ce922f09df1 => generated 1680 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:05:03.578144 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4e7a528d-0129-4814-9eec-8daea303050d tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:05:03.579287 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4e7a528d-0129-4814-9eec-8daea303050d tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] [instance: 928fb88c-a689-46ee-a069-de58089ceba6] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:05:03.585255 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d18a4853-a0f3-4d80-90b2-a71e399abe16 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:05:03.586180 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4e7a528d-0129-4814-9eec-8daea303050d tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:03.586777 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d18a4853-a0f3-4d80-90b2-a71e399abe16 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 0902e252-5bb9-462a-979a-0fe67d8884e3] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:05:03.587089 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4e7a528d-0129-4814-9eec-8daea303050d tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:03.587787 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4e7a528d-0129-4814-9eec-8daea303050d tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:03.588480 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4e7a528d-0129-4814-9eec-8daea303050d tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:03.589661 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4e7a528d-0129-4814-9eec-8daea303050d tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:03.590333 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4e7a528d-0129-4814-9eec-8daea303050d tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:03.595818 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d18a4853-a0f3-4d80-90b2-a71e399abe16 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:03.597041 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d18a4853-a0f3-4d80-90b2-a71e399abe16 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:03.597041 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d18a4853-a0f3-4d80-90b2-a71e399abe16 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:03.597505 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d18a4853-a0f3-4d80-90b2-a71e399abe16 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:03.597998 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d18a4853-a0f3-4d80-90b2-a71e399abe16 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:03.598424 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d18a4853-a0f3-4d80-90b2-a71e399abe16 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:03.654959 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d18a4853-a0f3-4d80-90b2-a71e399abe16 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:03.655548 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d18a4853-a0f3-4d80-90b2-a71e399abe16 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:03.656204 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d18a4853-a0f3-4d80-90b2-a71e399abe16 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:03.658593 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-d18a4853-a0f3-4d80-90b2-a71e399abe16 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lazy-loading 'fault' on Instance uuid 0902e252-5bb9-462a-979a-0fe67d8884e3 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 05:05:03.795631 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d18a4853-a0f3-4d80-90b2-a71e399abe16 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:05:03.806003 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d18a4853-a0f3-4d80-90b2-a71e399abe16 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/0902e252-5bb9-462a-979a-0fe67d8884e3" status: 200 len: 1192 microversion: 2.1 time: 0.224881 Sep 23 05:05:03.807649 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3205/6238] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:05:03 2022] GET /compute/v2.1/servers/0902e252-5bb9-462a-979a-0fe67d8884e3 => generated 1192 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:05:03.903810 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4e7a528d-0129-4814-9eec-8daea303050d tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc338a28098d48bc931a2c29213d1dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3384c4863e35469b96482ce27d56a36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:05:03.917070 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4e7a528d-0129-4814-9eec-8daea303050d tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] 10.222.0.33 "GET /compute/v2.1/servers/928fb88c-a689-46ee-a069-de58089ceba6" status: 200 len: 1427 microversion: 2.1 time: 0.342632 Sep 23 05:05:03.918146 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3034/6239] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:05:03 2022] GET /compute/v2.1/servers/928fb88c-a689-46ee-a069-de58089ceba6 => generated 1427 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:05:04.049271 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-6d7b2027-9a49-4c0f-96d4-17da7c1feb36 req-f4311e70-4cec-4203-b691-33d56b791381 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f67681e5-fced-41b4-ae7c-7ce922f09df1", "name": "network-vif-deleted", "tag": "986f2735-a2c6-460f-99e9-55e9f43e905f"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:05:04.068392 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-6d7b2027-9a49-4c0f-96d4-17da7c1feb36 req-f4311e70-4cec-4203-b691-33d56b791381 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:04.072255 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-6d7b2027-9a49-4c0f-96d4-17da7c1feb36 req-f4311e70-4cec-4203-b691-33d56b791381 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:04.072255 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-6d7b2027-9a49-4c0f-96d4-17da7c1feb36 req-f4311e70-4cec-4203-b691-33d56b791381 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:04.134673 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-6d7b2027-9a49-4c0f-96d4-17da7c1feb36 req-f4311e70-4cec-4203-b691-33d56b791381 service nova] Creating event network-vif-deleted:986f2735-a2c6-460f-99e9-55e9f43e905f for instance f67681e5-fced-41b4-ae7c-7ce922f09df1 on n-h1-846463-3 Sep 23 05:05:04.142233 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-6d7b2027-9a49-4c0f-96d4-17da7c1feb36 req-f4311e70-4cec-4203-b691-33d56b791381 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096036 Sep 23 05:05:04.143661 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3206/6240] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:05:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:05:04.235814 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1aefca95-4f54-4cd8-895f-ba092761f1c5 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:05:04.236568 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-1aefca95-4f54-4cd8-895f-ba092761f1c5 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: f67681e5-fced-41b4-ae7c-7ce922f09df1] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:05:04.252715 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1aefca95-4f54-4cd8-895f-ba092761f1c5 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:04.253436 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1aefca95-4f54-4cd8-895f-ba092761f1c5 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:04.254010 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1aefca95-4f54-4cd8-895f-ba092761f1c5 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:04.255148 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1aefca95-4f54-4cd8-895f-ba092761f1c5 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:04.255680 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1aefca95-4f54-4cd8-895f-ba092761f1c5 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:04.256186 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1aefca95-4f54-4cd8-895f-ba092761f1c5 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:04.409319 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-1aefca95-4f54-4cd8-895f-ba092761f1c5 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d90150ed7d477fab33129cb3b068ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daad67f26fe246d6b4d28cad1707a119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:05:04.419335 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-1aefca95-4f54-4cd8-895f-ba092761f1c5 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/f67681e5-fced-41b4-ae7c-7ce922f09df1" status: 200 len: 1325 microversion: 2.1 time: 0.190599 Sep 23 05:05:04.420591 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3035/6241] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:05:04 2022] GET /compute/v2.1/servers/f67681e5-fced-41b4-ae7c-7ce922f09df1 => generated 1325 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:05:04.832933 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-516f496d-51b5-42db-850a-cd46762be8c2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:05:04.833623 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-516f496d-51b5-42db-850a-cd46762be8c2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 0902e252-5bb9-462a-979a-0fe67d8884e3] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:05:04.840468 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-516f496d-51b5-42db-850a-cd46762be8c2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:04.843292 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-516f496d-51b5-42db-850a-cd46762be8c2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:04.843292 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-516f496d-51b5-42db-850a-cd46762be8c2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:04.843292 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-516f496d-51b5-42db-850a-cd46762be8c2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:04.843292 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-516f496d-51b5-42db-850a-cd46762be8c2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:04.843845 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-516f496d-51b5-42db-850a-cd46762be8c2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:04.859134 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-516f496d-51b5-42db-850a-cd46762be8c2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] HTTP exception thrown: Instance 0902e252-5bb9-462a-979a-0fe67d8884e3 could not be found. Sep 23 05:05:04.861747 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-516f496d-51b5-42db-850a-cd46762be8c2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Request method failure captured: Sep 23 05:05:04.861747 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/0902e252-5bb9-462a-979a-0fe67d8884e3 HTTP/1.1 Sep 23 05:05:04.861747 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 05:05:04.861747 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 05:05:04.861747 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 05:05:04.861747 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 05:05:04.861747 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 05:05:04.861747 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 05:05:04.861747 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 05:05:04.861747 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 05:05:04.861747 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLT3uLjiu4nPUFbkjrA4MyWVqiSG18wQr6d8tQl_P_I7oXAw8rp2FE6LolJR7q-NpMkbDL2xBtL-Km4xLll-czE6HybNQXkbhp5AdNp7lc8uSbgBeOP-qACziHhtaYPCszQMgYlHiKqFljv5hFyHB9WCa7Y2j2z8m1qKy7sQfYfHm2rE Sep 23 05:05:04.861747 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 05:05:04.861747 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 05:05:04.861747 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 05:05:04.861747 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 05:05:04.861747 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 05:05:04.861747 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 05:05:04.861747 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: cceaa1e24146497fbf3f79cebc112211 Sep 23 05:05:04.861747 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-TestVolumeBootPattern-1815855430 Sep 23 05:05:04.861747 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 05:05:04.861747 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 05:05:04.861747 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cceaa1e24146497fbf3f79cebc112211", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cceaa1e24146497fbf3f79cebc112211"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cceaa1e24146497fbf3f79cebc112211"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cceaa1e24146497fbf3f79cebc112211"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:05:04.861747 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-TestVolumeBootPattern-1815855430 Sep 23 05:05:04.861747 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: cceaa1e24146497fbf3f79cebc112211 Sep 23 05:05:04.861747 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-TestVolumeBootPattern-1815855430 Sep 23 05:05:04.861747 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-TestVolumeBootPattern-1815855430-project Sep 23 05:05:04.861747 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 05:05:04.861747 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 05:05:04.861747 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 0d55fe5072c14752846eb4ffc0eef91b Sep 23 05:05:04.861747 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-TestVolumeBootPattern-1815855430-project Sep 23 05:05:04.861747 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 05:05:04.861747 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 0902e252-5bb9-462a-979a-0fe67d8884e3 could not be found. Sep 23 05:05:04.861747 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '0902e252-5bb9-462a-979a-0fe67d8884e3'} Sep 23 05:05:04.861747 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:05:04.861747 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:05:04.861747 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 05:05:04.861747 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 05:05:04.861747 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 05:05:04.861747 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 05:05:04.861747 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 05:05:04.861747 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 05:05:04.861747 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 05:05:04.861747 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 05:05:04.861747 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0902e252-5bb9-462a-979a-0fe67d8884e3 could not be found. Sep 23 05:05:04.861747 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:05:04.861747 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:05:04.861747 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:05:04.861747 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:05:04.861747 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:05:04.861747 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:05:04.861747 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:05:04.861747 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:05:04.861747 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:05:04.861747 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:05:04.861747 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 05:05:04.861747 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 05:05:04.861747 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 05:05:04.861747 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 05:05:04.861747 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 05:05:04.861747 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:05:04.861747 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0902e252-5bb9-462a-979a-0fe67d8884e3 could not be found. Sep 23 05:05:04.861747 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:05:04.861747 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:05:04.861747 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:05:04.868003 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:05:04.868003 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:05:04.868003 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:05:04.868003 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:05:04.868003 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:05:04.868003 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0902e252-5bb9-462a-979a-0fe67d8884e3 could not be found. Sep 23 05:05:04.868003 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:05:04.869479 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-516f496d-51b5-42db-850a-cd46762be8c2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Returning 404 to user: Instance 0902e252-5bb9-462a-979a-0fe67d8884e3 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:05:04.871137 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-516f496d-51b5-42db-850a-cd46762be8c2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/0902e252-5bb9-462a-979a-0fe67d8884e3" status: 404 len: 111 microversion: 2.1 time: 0.044548 Sep 23 05:05:04.875946 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3207/6242] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:05:04 2022] GET /compute/v2.1/servers/0902e252-5bb9-462a-979a-0fe67d8884e3 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 05:05:04.946851 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ceccf080-5f91-43ac-90a5-c54adb2da1e1 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:05:04.947838 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-ceccf080-5f91-43ac-90a5-c54adb2da1e1 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] [instance: 928fb88c-a689-46ee-a069-de58089ceba6] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:05:04.962686 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ceccf080-5f91-43ac-90a5-c54adb2da1e1 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:04.965969 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ceccf080-5f91-43ac-90a5-c54adb2da1e1 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:04.966974 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ceccf080-5f91-43ac-90a5-c54adb2da1e1 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:04.970637 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ceccf080-5f91-43ac-90a5-c54adb2da1e1 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:04.974573 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ceccf080-5f91-43ac-90a5-c54adb2da1e1 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:04.974573 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ceccf080-5f91-43ac-90a5-c54adb2da1e1 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:05.277600 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ceccf080-5f91-43ac-90a5-c54adb2da1e1 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc338a28098d48bc931a2c29213d1dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3384c4863e35469b96482ce27d56a36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:05:05.289564 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ceccf080-5f91-43ac-90a5-c54adb2da1e1 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] 10.222.0.33 "GET /compute/v2.1/servers/928fb88c-a689-46ee-a069-de58089ceba6" status: 200 len: 1427 microversion: 2.1 time: 0.345658 Sep 23 05:05:05.317919 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3036/6243] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:05:04 2022] GET /compute/v2.1/servers/928fb88c-a689-46ee-a069-de58089ceba6 => generated 1427 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:05:05.444409 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-15488ea0-290c-4c20-bdcf-49d28cdce0fb tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:05:05.445385 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-15488ea0-290c-4c20-bdcf-49d28cdce0fb tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: f67681e5-fced-41b4-ae7c-7ce922f09df1] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:05:05.462995 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-15488ea0-290c-4c20-bdcf-49d28cdce0fb tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:05.468223 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-15488ea0-290c-4c20-bdcf-49d28cdce0fb tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:05.469023 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-15488ea0-290c-4c20-bdcf-49d28cdce0fb tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:05.472245 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-15488ea0-290c-4c20-bdcf-49d28cdce0fb tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:05.473021 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-15488ea0-290c-4c20-bdcf-49d28cdce0fb tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:05.479441 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-15488ea0-290c-4c20-bdcf-49d28cdce0fb tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:05.576644 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-15488ea0-290c-4c20-bdcf-49d28cdce0fb tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:05.577145 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-15488ea0-290c-4c20-bdcf-49d28cdce0fb tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:05.577584 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-15488ea0-290c-4c20-bdcf-49d28cdce0fb tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:05.578075 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-15488ea0-290c-4c20-bdcf-49d28cdce0fb tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lazy-loading 'fault' on Instance uuid f67681e5-fced-41b4-ae7c-7ce922f09df1 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 05:05:05.707280 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-15488ea0-290c-4c20-bdcf-49d28cdce0fb tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d90150ed7d477fab33129cb3b068ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daad67f26fe246d6b4d28cad1707a119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:05:05.717579 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-15488ea0-290c-4c20-bdcf-49d28cdce0fb tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/f67681e5-fced-41b4-ae7c-7ce922f09df1" status: 200 len: 1330 microversion: 2.1 time: 0.278486 Sep 23 05:05:05.727565 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3208/6244] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:05:05 2022] GET /compute/v2.1/servers/f67681e5-fced-41b4-ae7c-7ce922f09df1 => generated 1330 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:05:06.331449 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-bf1af06e-b9df-4195-b10c-b13da31e9744 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:05:06.334130 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-bf1af06e-b9df-4195-b10c-b13da31e9744 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] [instance: 928fb88c-a689-46ee-a069-de58089ceba6] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:05:06.342696 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bf1af06e-b9df-4195-b10c-b13da31e9744 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:06.343533 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bf1af06e-b9df-4195-b10c-b13da31e9744 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:06.344465 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bf1af06e-b9df-4195-b10c-b13da31e9744 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:06.345704 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bf1af06e-b9df-4195-b10c-b13da31e9744 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:06.346973 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bf1af06e-b9df-4195-b10c-b13da31e9744 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:06.348267 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bf1af06e-b9df-4195-b10c-b13da31e9744 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:06.753659 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-dcc0b016-1151-48c8-acb9-def5cc3fb9d9 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:05:06.754811 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-dcc0b016-1151-48c8-acb9-def5cc3fb9d9 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: f67681e5-fced-41b4-ae7c-7ce922f09df1] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:05:06.769492 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dcc0b016-1151-48c8-acb9-def5cc3fb9d9 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:06.770412 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dcc0b016-1151-48c8-acb9-def5cc3fb9d9 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:06.771116 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dcc0b016-1151-48c8-acb9-def5cc3fb9d9 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:06.775843 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dcc0b016-1151-48c8-acb9-def5cc3fb9d9 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:06.777318 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dcc0b016-1151-48c8-acb9-def5cc3fb9d9 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:06.779184 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dcc0b016-1151-48c8-acb9-def5cc3fb9d9 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:06.806182 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-dcc0b016-1151-48c8-acb9-def5cc3fb9d9 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] HTTP exception thrown: Instance f67681e5-fced-41b4-ae7c-7ce922f09df1 could not be found. Sep 23 05:05:06.810665 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-dcc0b016-1151-48c8-acb9-def5cc3fb9d9 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Request method failure captured: Sep 23 05:05:06.810665 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/f67681e5-fced-41b4-ae7c-7ce922f09df1 HTTP/1.1 Sep 23 05:05:06.810665 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 05:05:06.810665 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 05:05:06.810665 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 05:05:06.810665 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 05:05:06.810665 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 05:05:06.810665 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 05:05:06.810665 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 05:05:06.810665 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 05:05:06.810665 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLT3a68wnGhJ1ri_wJa0c61-k-Mmu1aJqy0y8F08NYCjz_D70vilLx9G5I0GwzbhL1w2apyr58UgTWfFCoyEumWwAPT_5jEMZEFbxFGBL8lKHDufPcaCD0r7hhVTJQk-EQJ3nL8ZwWE56HAQoDgwteQ7RqvbmQmN2QkHgdyJgN3h_vQg Sep 23 05:05:06.810665 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 05:05:06.810665 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 05:05:06.810665 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 05:05:06.810665 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 05:05:06.810665 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 05:05:06.810665 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 05:05:06.810665 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: daad67f26fe246d6b4d28cad1707a119 Sep 23 05:05:06.810665 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-AttachVolumeNegativeTest-1007727461 Sep 23 05:05:06.810665 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 05:05:06.810665 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 05:05:06.810665 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_daad67f26fe246d6b4d28cad1707a119", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/daad67f26fe246d6b4d28cad1707a119"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/daad67f26fe246d6b4d28cad1707a119"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/daad67f26fe246d6b4d28cad1707a119"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:05:06.810665 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-AttachVolumeNegativeTest-1007727461 Sep 23 05:05:06.810665 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: daad67f26fe246d6b4d28cad1707a119 Sep 23 05:05:06.810665 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1007727461 Sep 23 05:05:06.810665 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-AttachVolumeNegativeTest-1007727461-project Sep 23 05:05:06.810665 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 05:05:06.810665 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 05:05:06.810665 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 59d90150ed7d477fab33129cb3b068ed Sep 23 05:05:06.810665 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-AttachVolumeNegativeTest-1007727461-project Sep 23 05:05:06.810665 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 05:05:06.810665 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance f67681e5-fced-41b4-ae7c-7ce922f09df1 could not be found. Sep 23 05:05:06.810665 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': 'f67681e5-fced-41b4-ae7c-7ce922f09df1'} Sep 23 05:05:06.810665 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:05:06.810665 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:05:06.810665 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 05:05:06.810665 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 05:05:06.810665 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 05:05:06.810665 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 05:05:06.810665 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 05:05:06.810665 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 05:05:06.810665 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 05:05:06.810665 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 05:05:06.810665 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f67681e5-fced-41b4-ae7c-7ce922f09df1 could not be found. Sep 23 05:05:06.810665 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:05:06.810665 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:05:06.810665 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:05:06.810665 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:05:06.810665 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:05:06.810665 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:05:06.810665 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:05:06.810665 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:05:06.810665 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:05:06.810665 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:05:06.810665 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 05:05:06.810665 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 05:05:06.810665 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 05:05:06.810665 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 05:05:06.810665 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 05:05:06.810665 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:05:06.810665 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f67681e5-fced-41b4-ae7c-7ce922f09df1 could not be found. Sep 23 05:05:06.810665 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:05:06.810665 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:05:06.810665 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:05:06.817358 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:05:06.817358 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:05:06.817358 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:05:06.817358 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:05:06.817358 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:05:06.817358 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f67681e5-fced-41b4-ae7c-7ce922f09df1 could not be found. Sep 23 05:05:06.817358 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:05:06.817358 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-dcc0b016-1151-48c8-acb9-def5cc3fb9d9 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Returning 404 to user: Instance f67681e5-fced-41b4-ae7c-7ce922f09df1 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:05:06.817358 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-dcc0b016-1151-48c8-acb9-def5cc3fb9d9 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/f67681e5-fced-41b4-ae7c-7ce922f09df1" status: 404 len: 111 microversion: 2.1 time: 0.064144 Sep 23 05:05:06.817358 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3209/6245] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:05:06 2022] GET /compute/v2.1/servers/f67681e5-fced-41b4-ae7c-7ce922f09df1 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 05:05:06.824540 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-aae2fbef-4533-4993-8d98-1ea56f560cfc tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '.version_select at 0x7ff1c03cc430>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:05:06.886266 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-bf1af06e-b9df-4195-b10c-b13da31e9744 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc338a28098d48bc931a2c29213d1dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3384c4863e35469b96482ce27d56a36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:05:06.908093 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-bf1af06e-b9df-4195-b10c-b13da31e9744 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] 10.222.0.33 "GET /compute/v2.1/servers/928fb88c-a689-46ee-a069-de58089ceba6" status: 200 len: 1427 microversion: 2.1 time: 0.581326 Sep 23 05:05:06.909072 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3037/6246] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:05:06 2022] GET /compute/v2.1/servers/928fb88c-a689-46ee-a069-de58089ceba6 => generated 1427 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:05:06.953844 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-aae2fbef-4533-4993-8d98-1ea56f560cfc tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-513613458" status: 202 len: 0 microversion: 2.1 time: 0.132987 Sep 23 05:05:06.963765 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3210/6247] 10.222.0.33 () {58 vars in 1218 bytes} [Fri Sep 23 05:05:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-513613458 => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 05:05:07.942119 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-758ab2b5-ef3f-4637-9a57-a5896e0b8dea tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:05:07.944055 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-758ab2b5-ef3f-4637-9a57-a5896e0b8dea tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] [instance: 928fb88c-a689-46ee-a069-de58089ceba6] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:05:07.957011 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-758ab2b5-ef3f-4637-9a57-a5896e0b8dea tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:07.957852 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-758ab2b5-ef3f-4637-9a57-a5896e0b8dea tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:07.958546 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-758ab2b5-ef3f-4637-9a57-a5896e0b8dea tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:07.959441 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-758ab2b5-ef3f-4637-9a57-a5896e0b8dea tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:07.960217 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-758ab2b5-ef3f-4637-9a57-a5896e0b8dea tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:07.961051 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-758ab2b5-ef3f-4637-9a57-a5896e0b8dea tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:08.248385 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-758ab2b5-ef3f-4637-9a57-a5896e0b8dea tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc338a28098d48bc931a2c29213d1dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3384c4863e35469b96482ce27d56a36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:05:08.263083 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-758ab2b5-ef3f-4637-9a57-a5896e0b8dea tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] 10.222.0.33 "GET /compute/v2.1/servers/928fb88c-a689-46ee-a069-de58089ceba6" status: 200 len: 1427 microversion: 2.1 time: 0.331716 Sep 23 05:05:08.266886 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3038/6248] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:05:07 2022] GET /compute/v2.1/servers/928fb88c-a689-46ee-a069-de58089ceba6 => generated 1427 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:05:08.421379 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a17b9529-204a-4778-9041-d6c68f5dce66 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:05:08.422065 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a17b9529-204a-4778-9041-d6c68f5dce66 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 9984baa4-fc75-4d8f-a660-0647326196af] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:05:08.429664 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a17b9529-204a-4778-9041-d6c68f5dce66 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:08.430712 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a17b9529-204a-4778-9041-d6c68f5dce66 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:08.431273 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a17b9529-204a-4778-9041-d6c68f5dce66 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:08.432091 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a17b9529-204a-4778-9041-d6c68f5dce66 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:08.432663 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a17b9529-204a-4778-9041-d6c68f5dce66 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:08.433222 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a17b9529-204a-4778-9041-d6c68f5dce66 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:08.646057 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-a17b9529-204a-4778-9041-d6c68f5dce66 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lazy-loading 'services' on Instance uuid 9984baa4-fc75-4d8f-a660-0647326196af {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 05:05:08.986296 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a17b9529-204a-4778-9041-d6c68f5dce66 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9984baa4-fc75-4d8f-a660-0647326196af/os-volume_attachments/0f463ce8-486f-4168-98b1-75c12f7dd2b7" status: 202 len: 0 microversion: 2.1 time: 0.569960 Sep 23 05:05:08.987257 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3211/6249] 10.222.0.33 () {58 vars in 1416 bytes} [Fri Sep 23 05:05:08 2022] DELETE /compute/v2.1/servers/9984baa4-fc75-4d8f-a660-0647326196af/os-volume_attachments/0f463ce8-486f-4168-98b1-75c12f7dd2b7 => generated 0 bytes in 572 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 05:05:08.996226 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-74f54184-e992-4367-bcd3-1ba225b65c5f tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:05:08.998871 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-74f54184-e992-4367-bcd3-1ba225b65c5f tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 9984baa4-fc75-4d8f-a660-0647326196af] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:05:09.019374 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-74f54184-e992-4367-bcd3-1ba225b65c5f tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:09.020088 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-74f54184-e992-4367-bcd3-1ba225b65c5f tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:09.020705 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-74f54184-e992-4367-bcd3-1ba225b65c5f tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:09.021612 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-74f54184-e992-4367-bcd3-1ba225b65c5f tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:09.022277 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-74f54184-e992-4367-bcd3-1ba225b65c5f tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:09.022878 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-74f54184-e992-4367-bcd3-1ba225b65c5f tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:09.059545 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d1d5dd22-1689-4538-91de-839d9d0c3851 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:05:09.061841 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d1d5dd22-1689-4538-91de-839d9d0c3851 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] [instance: 8f9812de-fd1b-49c4-b6de-8f5147f05c89] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:05:09.074439 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d1d5dd22-1689-4538-91de-839d9d0c3851 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:09.074948 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d1d5dd22-1689-4538-91de-839d9d0c3851 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:09.075399 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d1d5dd22-1689-4538-91de-839d9d0c3851 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:09.095202 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d1d5dd22-1689-4538-91de-839d9d0c3851 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:09.095711 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d1d5dd22-1689-4538-91de-839d9d0c3851 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:09.096369 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d1d5dd22-1689-4538-91de-839d9d0c3851 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:09.120923 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-74f54184-e992-4367-bcd3-1ba225b65c5f tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/9984baa4-fc75-4d8f-a660-0647326196af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.129234 Sep 23 05:05:09.130066 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3039/6250] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Sep 23 05:05:08 2022] GET /compute/v2.1/servers/9984baa4-fc75-4d8f-a660-0647326196af/os-volume_attachments => generated 197 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:05:09.194957 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d1d5dd22-1689-4538-91de-839d9d0c3851 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] 10.222.0.33 "POST /compute/v2.1/servers/8f9812de-fd1b-49c4-b6de-8f5147f05c89/action" status: 200 len: 24571 microversion: 2.1 time: 0.139501 Sep 23 05:05:09.202054 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3212/6251] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 05:05:09 2022] POST /compute/v2.1/servers/8f9812de-fd1b-49c4-b6de-8f5147f05c89/action => generated 24571 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 05:05:09.292967 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0d9d05a9-e8f0-4ea7-b8c5-b02494ec0080 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:05:09.296785 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-0d9d05a9-e8f0-4ea7-b8c5-b02494ec0080 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] [instance: 928fb88c-a689-46ee-a069-de58089ceba6] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:05:09.304282 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0d9d05a9-e8f0-4ea7-b8c5-b02494ec0080 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:09.304788 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0d9d05a9-e8f0-4ea7-b8c5-b02494ec0080 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:09.305234 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0d9d05a9-e8f0-4ea7-b8c5-b02494ec0080 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:09.323888 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0d9d05a9-e8f0-4ea7-b8c5-b02494ec0080 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:09.323888 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0d9d05a9-e8f0-4ea7-b8c5-b02494ec0080 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:09.323888 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0d9d05a9-e8f0-4ea7-b8c5-b02494ec0080 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:09.353141 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-912f69f7-02d3-414b-b44c-5d9f4dcf39c5 req-2e1837c9-4d9e-4ef2-90e7-d4fc65aaa25b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "928fb88c-a689-46ee-a069-de58089ceba6", "name": "network-vif-plugged", "status": "completed", "tag": "138b0b6f-3e79-4ed9-a4e8-3cf14b605b8d"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:05:09.376771 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-912f69f7-02d3-414b-b44c-5d9f4dcf39c5 req-2e1837c9-4d9e-4ef2-90e7-d4fc65aaa25b service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:09.380747 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-912f69f7-02d3-414b-b44c-5d9f4dcf39c5 req-2e1837c9-4d9e-4ef2-90e7-d4fc65aaa25b service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:09.386194 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-912f69f7-02d3-414b-b44c-5d9f4dcf39c5 req-2e1837c9-4d9e-4ef2-90e7-d4fc65aaa25b service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:09.405313 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-912f69f7-02d3-414b-b44c-5d9f4dcf39c5 req-2e1837c9-4d9e-4ef2-90e7-d4fc65aaa25b service nova] Creating event network-vif-plugged:138b0b6f-3e79-4ed9-a4e8-3cf14b605b8d for instance 928fb88c-a689-46ee-a069-de58089ceba6 on n-h1-846463-3 Sep 23 05:05:09.421871 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-912f69f7-02d3-414b-b44c-5d9f4dcf39c5 req-2e1837c9-4d9e-4ef2-90e7-d4fc65aaa25b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072701 Sep 23 05:05:09.424116 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3213/6252] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:05:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 05:05:09.843793 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-0d9d05a9-e8f0-4ea7-b8c5-b02494ec0080 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc338a28098d48bc931a2c29213d1dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3384c4863e35469b96482ce27d56a36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:05:09.867319 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0d9d05a9-e8f0-4ea7-b8c5-b02494ec0080 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] 10.222.0.33 "GET /compute/v2.1/servers/928fb88c-a689-46ee-a069-de58089ceba6" status: 200 len: 1427 microversion: 2.1 time: 0.579857 Sep 23 05:05:09.868519 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3040/6253] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:05:09 2022] GET /compute/v2.1/servers/928fb88c-a689-46ee-a069-de58089ceba6 => generated 1427 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:05:10.144249 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5e5d4096-2d27-439d-be04-716eab759542 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:05:10.146528 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-5e5d4096-2d27-439d-be04-716eab759542 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 9984baa4-fc75-4d8f-a660-0647326196af] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:05:10.162485 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5e5d4096-2d27-439d-be04-716eab759542 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:10.162987 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5e5d4096-2d27-439d-be04-716eab759542 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:10.163430 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5e5d4096-2d27-439d-be04-716eab759542 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:10.164147 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5e5d4096-2d27-439d-be04-716eab759542 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:10.169044 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5e5d4096-2d27-439d-be04-716eab759542 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:10.169044 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5e5d4096-2d27-439d-be04-716eab759542 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:10.200200 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:05:10.209923 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5e5d4096-2d27-439d-be04-716eab759542 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/9984baa4-fc75-4d8f-a660-0647326196af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070586 Sep 23 05:05:10.250137 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3214/6254] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Sep 23 05:05:10 2022] GET /compute/v2.1/servers/9984baa4-fc75-4d8f-a660-0647326196af/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:05:10.901218 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-af8b9cb5-58ea-427d-9d1c-2b6707b8e368 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:05:10.901218 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-af8b9cb5-58ea-427d-9d1c-2b6707b8e368 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] [instance: 928fb88c-a689-46ee-a069-de58089ceba6] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:05:10.921855 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-af8b9cb5-58ea-427d-9d1c-2b6707b8e368 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:10.923622 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-af8b9cb5-58ea-427d-9d1c-2b6707b8e368 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:10.927680 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-af8b9cb5-58ea-427d-9d1c-2b6707b8e368 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:10.930795 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-af8b9cb5-58ea-427d-9d1c-2b6707b8e368 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:10.931413 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-af8b9cb5-58ea-427d-9d1c-2b6707b8e368 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:10.931953 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-af8b9cb5-58ea-427d-9d1c-2b6707b8e368 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:11.261281 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-aa70889c-c7e2-4442-95f3-b1fdfaf03290 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:05:11.265197 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-aa70889c-c7e2-4442-95f3-b1fdfaf03290 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 9984baa4-fc75-4d8f-a660-0647326196af] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:05:11.285479 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aa70889c-c7e2-4442-95f3-b1fdfaf03290 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:11.287701 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aa70889c-c7e2-4442-95f3-b1fdfaf03290 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:11.288370 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aa70889c-c7e2-4442-95f3-b1fdfaf03290 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:11.292114 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aa70889c-c7e2-4442-95f3-b1fdfaf03290 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:11.294060 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aa70889c-c7e2-4442-95f3-b1fdfaf03290 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:11.295494 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aa70889c-c7e2-4442-95f3-b1fdfaf03290 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:11.384245 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-aa70889c-c7e2-4442-95f3-b1fdfaf03290 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/9984baa4-fc75-4d8f-a660-0647326196af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.127159 Sep 23 05:05:11.404526 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3215/6255] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Sep 23 05:05:11 2022] GET /compute/v2.1/servers/9984baa4-fc75-4d8f-a660-0647326196af/os-volume_attachments => generated 197 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:05:11.701384 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-af8b9cb5-58ea-427d-9d1c-2b6707b8e368 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc338a28098d48bc931a2c29213d1dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3384c4863e35469b96482ce27d56a36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:05:11.714187 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-af8b9cb5-58ea-427d-9d1c-2b6707b8e368 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] 10.222.0.33 "GET /compute/v2.1/servers/928fb88c-a689-46ee-a069-de58089ceba6" status: 200 len: 1427 microversion: 2.1 time: 0.818587 Sep 23 05:05:11.718007 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3041/6256] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:05:10 2022] GET /compute/v2.1/servers/928fb88c-a689-46ee-a069-de58089ceba6 => generated 1427 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:05:12.421454 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-dafd6f14-19d1-42c5-9167-79546d032fe9 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:05:12.424802 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-dafd6f14-19d1-42c5-9167-79546d032fe9 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 9984baa4-fc75-4d8f-a660-0647326196af] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:05:12.447727 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dafd6f14-19d1-42c5-9167-79546d032fe9 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:12.452779 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dafd6f14-19d1-42c5-9167-79546d032fe9 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:12.453922 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dafd6f14-19d1-42c5-9167-79546d032fe9 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:12.454922 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dafd6f14-19d1-42c5-9167-79546d032fe9 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:12.457329 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dafd6f14-19d1-42c5-9167-79546d032fe9 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:12.459001 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dafd6f14-19d1-42c5-9167-79546d032fe9 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:12.599290 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-dafd6f14-19d1-42c5-9167-79546d032fe9 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/9984baa4-fc75-4d8f-a660-0647326196af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.182733 Sep 23 05:05:12.602919 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3216/6257] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Sep 23 05:05:12 2022] GET /compute/v2.1/servers/9984baa4-fc75-4d8f-a660-0647326196af/os-volume_attachments => generated 197 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:05:12.738056 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1f4869f8-a7e1-4d5a-8750-3d8b0c734f12 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:05:12.738693 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-1f4869f8-a7e1-4d5a-8750-3d8b0c734f12 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] [instance: 928fb88c-a689-46ee-a069-de58089ceba6] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:05:12.776290 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1f4869f8-a7e1-4d5a-8750-3d8b0c734f12 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:12.777854 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1f4869f8-a7e1-4d5a-8750-3d8b0c734f12 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:12.780705 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1f4869f8-a7e1-4d5a-8750-3d8b0c734f12 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:12.781779 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1f4869f8-a7e1-4d5a-8750-3d8b0c734f12 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:12.785483 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1f4869f8-a7e1-4d5a-8750-3d8b0c734f12 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:12.786266 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1f4869f8-a7e1-4d5a-8750-3d8b0c734f12 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:13.124739 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-1f4869f8-a7e1-4d5a-8750-3d8b0c734f12 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc338a28098d48bc931a2c29213d1dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3384c4863e35469b96482ce27d56a36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:05:13.135770 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-1f4869f8-a7e1-4d5a-8750-3d8b0c734f12 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] 10.222.0.33 "GET /compute/v2.1/servers/928fb88c-a689-46ee-a069-de58089ceba6" status: 200 len: 1608 microversion: 2.1 time: 0.402662 Sep 23 05:05:13.136642 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3042/6258] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:05:12 2022] GET /compute/v2.1/servers/928fb88c-a689-46ee-a069-de58089ceba6 => generated 1608 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:05:13.170789 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-42ea3192-4040-4f7d-99da-e7771b5005ce tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:05:13.172592 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-42ea3192-4040-4f7d-99da-e7771b5005ce tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] [instance: 928fb88c-a689-46ee-a069-de58089ceba6] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:05:13.190255 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-42ea3192-4040-4f7d-99da-e7771b5005ce tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:13.190940 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-42ea3192-4040-4f7d-99da-e7771b5005ce tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:13.191395 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-42ea3192-4040-4f7d-99da-e7771b5005ce tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:13.199096 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-42ea3192-4040-4f7d-99da-e7771b5005ce tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:13.200139 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-42ea3192-4040-4f7d-99da-e7771b5005ce tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:13.206529 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-42ea3192-4040-4f7d-99da-e7771b5005ce tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:13.615731 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e49a8d05-edc4-4752-801a-ce8588099da1 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:05:13.619164 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e49a8d05-edc4-4752-801a-ce8588099da1 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 9984baa4-fc75-4d8f-a660-0647326196af] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:05:13.636761 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e49a8d05-edc4-4752-801a-ce8588099da1 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:13.643146 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e49a8d05-edc4-4752-801a-ce8588099da1 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:13.647687 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e49a8d05-edc4-4752-801a-ce8588099da1 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:13.648819 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e49a8d05-edc4-4752-801a-ce8588099da1 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:13.654180 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e49a8d05-edc4-4752-801a-ce8588099da1 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:13.658103 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e49a8d05-edc4-4752-801a-ce8588099da1 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:13.722311 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=100 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:05:13.746812 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e49a8d05-edc4-4752-801a-ce8588099da1 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/9984baa4-fc75-4d8f-a660-0647326196af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.138098 Sep 23 05:05:13.750234 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3043/6259] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Sep 23 05:05:13 2022] GET /compute/v2.1/servers/9984baa4-fc75-4d8f-a660-0647326196af/os-volume_attachments => generated 197 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 05:05:13.751873 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-42ea3192-4040-4f7d-99da-e7771b5005ce tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc338a28098d48bc931a2c29213d1dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3384c4863e35469b96482ce27d56a36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:05:13.764028 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-42ea3192-4040-4f7d-99da-e7771b5005ce tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] 10.222.0.33 "GET /compute/v2.1/servers/928fb88c-a689-46ee-a069-de58089ceba6" status: 200 len: 1608 microversion: 2.1 time: 0.604183 Sep 23 05:05:13.764935 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3217/6260] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:05:13 2022] GET /compute/v2.1/servers/928fb88c-a689-46ee-a069-de58089ceba6 => generated 1608 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:05:13.792151 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c19a8578-c4a6-4cc7-8e1c-e70097581eb5 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:05:13.793073 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c19a8578-c4a6-4cc7-8e1c-e70097581eb5 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] [instance: 928fb88c-a689-46ee-a069-de58089ceba6] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:05:13.808258 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c19a8578-c4a6-4cc7-8e1c-e70097581eb5 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:13.812576 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c19a8578-c4a6-4cc7-8e1c-e70097581eb5 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:13.812576 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c19a8578-c4a6-4cc7-8e1c-e70097581eb5 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:13.812576 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c19a8578-c4a6-4cc7-8e1c-e70097581eb5 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:13.812576 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c19a8578-c4a6-4cc7-8e1c-e70097581eb5 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:13.812576 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c19a8578-c4a6-4cc7-8e1c-e70097581eb5 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:14.302469 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c19a8578-c4a6-4cc7-8e1c-e70097581eb5 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc338a28098d48bc931a2c29213d1dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3384c4863e35469b96482ce27d56a36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:05:14.340014 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c19a8578-c4a6-4cc7-8e1c-e70097581eb5 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] 10.222.0.33 "GET /compute/v2.1/servers/928fb88c-a689-46ee-a069-de58089ceba6" status: 200 len: 1608 microversion: 2.1 time: 0.544830 Sep 23 05:05:14.340903 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3044/6261] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:05:13 2022] GET /compute/v2.1/servers/928fb88c-a689-46ee-a069-de58089ceba6 => generated 1608 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:05:14.768101 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c60795bd-10df-4add-a59b-ba92cfc79e04 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:05:14.771504 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c60795bd-10df-4add-a59b-ba92cfc79e04 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 9984baa4-fc75-4d8f-a660-0647326196af] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:05:14.790546 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c60795bd-10df-4add-a59b-ba92cfc79e04 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:14.791654 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c60795bd-10df-4add-a59b-ba92cfc79e04 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:14.792371 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c60795bd-10df-4add-a59b-ba92cfc79e04 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:14.793950 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c60795bd-10df-4add-a59b-ba92cfc79e04 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:14.794941 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c60795bd-10df-4add-a59b-ba92cfc79e04 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:14.795595 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c60795bd-10df-4add-a59b-ba92cfc79e04 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:14.848111 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c60795bd-10df-4add-a59b-ba92cfc79e04 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/9984baa4-fc75-4d8f-a660-0647326196af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085690 Sep 23 05:05:14.849658 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3218/6262] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Sep 23 05:05:14 2022] GET /compute/v2.1/servers/9984baa4-fc75-4d8f-a660-0647326196af/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:05:15.865700 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-befa6f47-9dfa-4a3c-b84a-502d6bbde93f tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:05:15.873425 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-befa6f47-9dfa-4a3c-b84a-502d6bbde93f tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 9984baa4-fc75-4d8f-a660-0647326196af] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:05:15.891357 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-befa6f47-9dfa-4a3c-b84a-502d6bbde93f tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:15.892324 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-befa6f47-9dfa-4a3c-b84a-502d6bbde93f tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:15.893222 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-befa6f47-9dfa-4a3c-b84a-502d6bbde93f tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:15.898820 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-befa6f47-9dfa-4a3c-b84a-502d6bbde93f tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:15.899586 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-befa6f47-9dfa-4a3c-b84a-502d6bbde93f tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:15.900216 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-befa6f47-9dfa-4a3c-b84a-502d6bbde93f tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:16.006993 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-befa6f47-9dfa-4a3c-b84a-502d6bbde93f tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/9984baa4-fc75-4d8f-a660-0647326196af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.143421 Sep 23 05:05:16.012559 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3045/6263] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Sep 23 05:05:15 2022] GET /compute/v2.1/servers/9984baa4-fc75-4d8f-a660-0647326196af/os-volume_attachments => generated 197 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:05:17.019517 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-958212f7-d443-48fb-882d-53bdc027eeb5 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:05:17.025499 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-958212f7-d443-48fb-882d-53bdc027eeb5 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 9984baa4-fc75-4d8f-a660-0647326196af] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:05:17.040418 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-958212f7-d443-48fb-882d-53bdc027eeb5 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:17.053727 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-958212f7-d443-48fb-882d-53bdc027eeb5 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:17.056966 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-958212f7-d443-48fb-882d-53bdc027eeb5 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:17.061256 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-958212f7-d443-48fb-882d-53bdc027eeb5 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:17.062138 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-958212f7-d443-48fb-882d-53bdc027eeb5 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:17.064387 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-958212f7-d443-48fb-882d-53bdc027eeb5 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:17.155676 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-958212f7-d443-48fb-882d-53bdc027eeb5 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/9984baa4-fc75-4d8f-a660-0647326196af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.140360 Sep 23 05:05:17.159586 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3219/6264] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Sep 23 05:05:17 2022] GET /compute/v2.1/servers/9984baa4-fc75-4d8f-a660-0647326196af/os-volume_attachments => generated 197 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:05:18.172395 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5c8d4e82-3522-4c5d-90b3-768017b8a173 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:05:18.174958 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5c8d4e82-3522-4c5d-90b3-768017b8a173 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 9984baa4-fc75-4d8f-a660-0647326196af] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:05:18.200786 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5c8d4e82-3522-4c5d-90b3-768017b8a173 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:18.201957 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5c8d4e82-3522-4c5d-90b3-768017b8a173 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:18.204316 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5c8d4e82-3522-4c5d-90b3-768017b8a173 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:18.215766 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5c8d4e82-3522-4c5d-90b3-768017b8a173 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:18.215766 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5c8d4e82-3522-4c5d-90b3-768017b8a173 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:18.215766 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5c8d4e82-3522-4c5d-90b3-768017b8a173 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:18.348591 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5c8d4e82-3522-4c5d-90b3-768017b8a173 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/9984baa4-fc75-4d8f-a660-0647326196af/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.181246 Sep 23 05:05:18.349209 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3046/6265] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Sep 23 05:05:18 2022] GET /compute/v2.1/servers/9984baa4-fc75-4d8f-a660-0647326196af/os-volume_attachments => generated 197 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:05:19.364914 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-39139952-99e8-49f1-9ac4-7faf7ed4b12a tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:05:19.368812 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-39139952-99e8-49f1-9ac4-7faf7ed4b12a tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 9984baa4-fc75-4d8f-a660-0647326196af] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:05:19.383683 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-39139952-99e8-49f1-9ac4-7faf7ed4b12a tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:19.384128 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-39139952-99e8-49f1-9ac4-7faf7ed4b12a tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:19.384583 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-39139952-99e8-49f1-9ac4-7faf7ed4b12a tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:19.390740 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-39139952-99e8-49f1-9ac4-7faf7ed4b12a tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:19.391739 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-39139952-99e8-49f1-9ac4-7faf7ed4b12a tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:19.392206 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-39139952-99e8-49f1-9ac4-7faf7ed4b12a tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:19.441458 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-39139952-99e8-49f1-9ac4-7faf7ed4b12a tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/9984baa4-fc75-4d8f-a660-0647326196af/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.083582 Sep 23 05:05:19.443680 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3220/6266] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Sep 23 05:05:19 2022] GET /compute/v2.1/servers/9984baa4-fc75-4d8f-a660-0647326196af/os-volume_attachments => generated 25 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 05:05:19.566881 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-aadbd7e6-b8a1-46f0-9364-a6a67ea50b10 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:05:19.568163 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-aadbd7e6-b8a1-46f0-9364-a6a67ea50b10 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 9984baa4-fc75-4d8f-a660-0647326196af] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:05:19.580778 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-aadbd7e6-b8a1-46f0-9364-a6a67ea50b10 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:19.582980 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-aadbd7e6-b8a1-46f0-9364-a6a67ea50b10 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:19.583973 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-aadbd7e6-b8a1-46f0-9364-a6a67ea50b10 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:19.585605 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-aadbd7e6-b8a1-46f0-9364-a6a67ea50b10 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:19.587485 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-aadbd7e6-b8a1-46f0-9364-a6a67ea50b10 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:19.589098 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-aadbd7e6-b8a1-46f0-9364-a6a67ea50b10 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:19.641047 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-aadbd7e6-b8a1-46f0-9364-a6a67ea50b10 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 9984baa4-fc75-4d8f-a660-0647326196af] Going to try to terminate instance {{(pid=122698) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 05:05:20.092158 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-aadbd7e6-b8a1-46f0-9364-a6a67ea50b10 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9984baa4-fc75-4d8f-a660-0647326196af" status: 204 len: 0 microversion: 2.1 time: 0.529367 Sep 23 05:05:20.093362 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3047/6267] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 05:05:19 2022] DELETE /compute/v2.1/servers/9984baa4-fc75-4d8f-a660-0647326196af => generated 0 bytes in 531 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 05:05:20.110793 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-afed39ff-ea9c-4b77-9e2b-e6b24f71c6a0 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:05:20.111630 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-afed39ff-ea9c-4b77-9e2b-e6b24f71c6a0 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 9984baa4-fc75-4d8f-a660-0647326196af] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:05:20.123740 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-afed39ff-ea9c-4b77-9e2b-e6b24f71c6a0 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:20.127153 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-afed39ff-ea9c-4b77-9e2b-e6b24f71c6a0 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:20.127709 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-afed39ff-ea9c-4b77-9e2b-e6b24f71c6a0 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:20.131090 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-afed39ff-ea9c-4b77-9e2b-e6b24f71c6a0 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:20.131746 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-afed39ff-ea9c-4b77-9e2b-e6b24f71c6a0 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:20.132264 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-afed39ff-ea9c-4b77-9e2b-e6b24f71c6a0 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:20.790661 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-afed39ff-ea9c-4b77-9e2b-e6b24f71c6a0 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d90150ed7d477fab33129cb3b068ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daad67f26fe246d6b4d28cad1707a119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:05:20.796185 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-afed39ff-ea9c-4b77-9e2b-e6b24f71c6a0 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/9984baa4-fc75-4d8f-a660-0647326196af" status: 200 len: 1680 microversion: 2.1 time: 0.692670 Sep 23 05:05:20.797823 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-d3398dea-d8f1-4f62-a138-8e7f55639a1d req-31909dfd-cb8e-4054-af97-06db9187aecf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "928fb88c-a689-46ee-a069-de58089ceba6", "tag": "138b0b6f-3e79-4ed9-a4e8-3cf14b605b8d"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:05:20.809925 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3221/6268] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:05:20 2022] GET /compute/v2.1/servers/9984baa4-fc75-4d8f-a660-0647326196af => generated 1680 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:05:20.842133 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-d3398dea-d8f1-4f62-a138-8e7f55639a1d req-31909dfd-cb8e-4054-af97-06db9187aecf service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:20.842830 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-d3398dea-d8f1-4f62-a138-8e7f55639a1d req-31909dfd-cb8e-4054-af97-06db9187aecf service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:20.843382 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-d3398dea-d8f1-4f62-a138-8e7f55639a1d req-31909dfd-cb8e-4054-af97-06db9187aecf service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:20.865510 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-d3398dea-d8f1-4f62-a138-8e7f55639a1d req-31909dfd-cb8e-4054-af97-06db9187aecf service nova] Creating event network-changed:138b0b6f-3e79-4ed9-a4e8-3cf14b605b8d for instance 928fb88c-a689-46ee-a069-de58089ceba6 on n-h1-846463-3 Sep 23 05:05:20.877616 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-d3398dea-d8f1-4f62-a138-8e7f55639a1d req-31909dfd-cb8e-4054-af97-06db9187aecf service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098038 Sep 23 05:05:20.880009 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3048/6269] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:05:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:05:21.827999 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ad7b376a-e4fc-4ec0-89b5-18d00e67f4f0 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:05:21.830031 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ad7b376a-e4fc-4ec0-89b5-18d00e67f4f0 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 9984baa4-fc75-4d8f-a660-0647326196af] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:05:21.844872 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:05:21.846179 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ad7b376a-e4fc-4ec0-89b5-18d00e67f4f0 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:21.847357 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ad7b376a-e4fc-4ec0-89b5-18d00e67f4f0 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:21.847805 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ad7b376a-e4fc-4ec0-89b5-18d00e67f4f0 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:21.851694 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ad7b376a-e4fc-4ec0-89b5-18d00e67f4f0 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:21.852392 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ad7b376a-e4fc-4ec0-89b5-18d00e67f4f0 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:21.852849 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ad7b376a-e4fc-4ec0-89b5-18d00e67f4f0 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:22.591843 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ad7b376a-e4fc-4ec0-89b5-18d00e67f4f0 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d90150ed7d477fab33129cb3b068ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daad67f26fe246d6b4d28cad1707a119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:05:22.606485 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ad7b376a-e4fc-4ec0-89b5-18d00e67f4f0 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/9984baa4-fc75-4d8f-a660-0647326196af" status: 200 len: 1680 microversion: 2.1 time: 0.782746 Sep 23 05:05:22.606881 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3222/6270] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:05:21 2022] GET /compute/v2.1/servers/9984baa4-fc75-4d8f-a660-0647326196af => generated 1680 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:05:23.634121 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c391b340-6cfe-4adc-acd8-00ae15569941 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:05:23.635135 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c391b340-6cfe-4adc-acd8-00ae15569941 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 9984baa4-fc75-4d8f-a660-0647326196af] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:05:23.647810 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c391b340-6cfe-4adc-acd8-00ae15569941 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:23.653236 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c391b340-6cfe-4adc-acd8-00ae15569941 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:23.654580 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c391b340-6cfe-4adc-acd8-00ae15569941 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:23.659121 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c391b340-6cfe-4adc-acd8-00ae15569941 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:23.664416 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c391b340-6cfe-4adc-acd8-00ae15569941 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:23.665463 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c391b340-6cfe-4adc-acd8-00ae15569941 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:23.922185 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c391b340-6cfe-4adc-acd8-00ae15569941 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d90150ed7d477fab33129cb3b068ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daad67f26fe246d6b4d28cad1707a119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:05:23.941424 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c391b340-6cfe-4adc-acd8-00ae15569941 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/9984baa4-fc75-4d8f-a660-0647326196af" status: 200 len: 1613 microversion: 2.1 time: 0.307074 Sep 23 05:05:23.942838 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3049/6271] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:05:23 2022] GET /compute/v2.1/servers/9984baa4-fc75-4d8f-a660-0647326196af => generated 1613 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:05:24.975827 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-11162044-533d-4182-b372-55f3ba4dfe6f tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:05:24.981771 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-11162044-533d-4182-b372-55f3ba4dfe6f tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 9984baa4-fc75-4d8f-a660-0647326196af] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:05:24.992642 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-11162044-533d-4182-b372-55f3ba4dfe6f tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:24.993606 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-11162044-533d-4182-b372-55f3ba4dfe6f tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:24.994821 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-11162044-533d-4182-b372-55f3ba4dfe6f tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:24.996415 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-11162044-533d-4182-b372-55f3ba4dfe6f tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:24.996697 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-11162044-533d-4182-b372-55f3ba4dfe6f tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:25.001202 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-11162044-533d-4182-b372-55f3ba4dfe6f tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:25.360214 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-05af7c64-6cf5-45b0-aa67-8a791e8e77fc req-ce5ce3b7-c367-4726-b608-ee1f5faf5f77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9984baa4-fc75-4d8f-a660-0647326196af", "name": "network-vif-deleted", "tag": "0ebe47f0-172b-4bca-9906-d73e1e79522b"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:05:25.425446 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-05af7c64-6cf5-45b0-aa67-8a791e8e77fc req-ce5ce3b7-c367-4726-b608-ee1f5faf5f77 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:25.426039 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-05af7c64-6cf5-45b0-aa67-8a791e8e77fc req-ce5ce3b7-c367-4726-b608-ee1f5faf5f77 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:25.426505 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-05af7c64-6cf5-45b0-aa67-8a791e8e77fc req-ce5ce3b7-c367-4726-b608-ee1f5faf5f77 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:25.502362 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-05af7c64-6cf5-45b0-aa67-8a791e8e77fc req-ce5ce3b7-c367-4726-b608-ee1f5faf5f77 service nova] Creating event network-vif-deleted:0ebe47f0-172b-4bca-9906-d73e1e79522b for instance 9984baa4-fc75-4d8f-a660-0647326196af on n-h2-846463-3 Sep 23 05:05:25.528165 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-05af7c64-6cf5-45b0-aa67-8a791e8e77fc req-ce5ce3b7-c367-4726-b608-ee1f5faf5f77 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.168042 Sep 23 05:05:25.546919 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3050/6272] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:05:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:05:25.970169 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-11162044-533d-4182-b372-55f3ba4dfe6f tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d90150ed7d477fab33129cb3b068ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daad67f26fe246d6b4d28cad1707a119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:05:25.980827 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-11162044-533d-4182-b372-55f3ba4dfe6f tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/9984baa4-fc75-4d8f-a660-0647326196af" status: 200 len: 1613 microversion: 2.1 time: 1.018713 Sep 23 05:05:25.997779 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3223/6273] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:05:24 2022] GET /compute/v2.1/servers/9984baa4-fc75-4d8f-a660-0647326196af => generated 1613 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:05:27.013371 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c2d9f203-c663-4699-aa01-1014bed045dc tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:05:27.019846 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c2d9f203-c663-4699-aa01-1014bed045dc tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 9984baa4-fc75-4d8f-a660-0647326196af] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:05:27.020033 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-91c037c6-6a79-4dc4-ab81-55e98275c7fb tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Action: 'create', calling method: .version_select at 0x7ff1bb731790>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-822294140", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCjYwrpuhmF9HnQHJ628U5NtJHB3vpnUTebqOy8T/nQ5Ohu7N7cTEAHsj8DcjiblKl7BlNbO/8DhwNxG6xGTExrGBc0jADzsF4w9k+WlwOV09SdILElLVpGPXCp3fulRzA=="}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:05:27.028128 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c2d9f203-c663-4699-aa01-1014bed045dc tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:27.031513 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c2d9f203-c663-4699-aa01-1014bed045dc tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:27.033867 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c2d9f203-c663-4699-aa01-1014bed045dc tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:27.035058 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c2d9f203-c663-4699-aa01-1014bed045dc tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:27.036024 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c2d9f203-c663-4699-aa01-1014bed045dc tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:27.036640 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c2d9f203-c663-4699-aa01-1014bed045dc tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:27.064005 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-91c037c6-6a79-4dc4-ab81-55e98275c7fb tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Getting quotas for project 5fefb9fd80184955a7856e1c41d081be. Resources: {'key_pairs'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 05:05:27.078078 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-91c037c6-6a79-4dc4-ab81-55e98275c7fb tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Getting quotas for user b3e8ce1f6821424080453f994dbcd604 and project 5fefb9fd80184955a7856e1c41d081be. Resources: {'key_pairs'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 05:05:27.085234 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-c2d9f203-c663-4699-aa01-1014bed045dc tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] HTTP exception thrown: Instance 9984baa4-fc75-4d8f-a660-0647326196af could not be found. Sep 23 05:05:27.085234 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c2d9f203-c663-4699-aa01-1014bed045dc tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Request method failure captured: Sep 23 05:05:27.085234 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/9984baa4-fc75-4d8f-a660-0647326196af HTTP/1.1 Sep 23 05:05:27.085234 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 05:05:27.085234 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 05:05:27.085234 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 05:05:27.085234 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 05:05:27.085234 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 05:05:27.085234 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 05:05:27.085234 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 05:05:27.085234 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 05:05:27.085234 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLT3a68wnGhJ1ri_wJa0c61-k-Mmu1aJqy0y8F08NYCjz_D70vilLx9G5I0GwzbhL1w2apyr58UgTWfFCoyEumWwAPT_5jEMZEFbxFGBL8lKHDufPcaCD0r7hhVTJQk-EQJ3nL8ZwWE56HAQoDgwteQ7RqvbmQmN2QkHgdyJgN3h_vQg Sep 23 05:05:27.085234 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 05:05:27.085234 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 05:05:27.085234 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 05:05:27.085234 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 05:05:27.085234 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 05:05:27.085234 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 05:05:27.085234 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: daad67f26fe246d6b4d28cad1707a119 Sep 23 05:05:27.085234 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-AttachVolumeNegativeTest-1007727461 Sep 23 05:05:27.085234 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 05:05:27.085234 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 05:05:27.085234 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_daad67f26fe246d6b4d28cad1707a119", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/daad67f26fe246d6b4d28cad1707a119"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/daad67f26fe246d6b4d28cad1707a119"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/daad67f26fe246d6b4d28cad1707a119"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:05:27.085234 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-AttachVolumeNegativeTest-1007727461 Sep 23 05:05:27.085234 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: daad67f26fe246d6b4d28cad1707a119 Sep 23 05:05:27.085234 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1007727461 Sep 23 05:05:27.085234 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-AttachVolumeNegativeTest-1007727461-project Sep 23 05:05:27.085234 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 05:05:27.085234 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 05:05:27.085234 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 59d90150ed7d477fab33129cb3b068ed Sep 23 05:05:27.085234 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-AttachVolumeNegativeTest-1007727461-project Sep 23 05:05:27.085234 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 05:05:27.085234 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 9984baa4-fc75-4d8f-a660-0647326196af could not be found. Sep 23 05:05:27.085234 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '9984baa4-fc75-4d8f-a660-0647326196af'} Sep 23 05:05:27.085234 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:05:27.085234 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:05:27.085234 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 05:05:27.085234 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 05:05:27.085234 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 05:05:27.085234 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 05:05:27.085234 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 05:05:27.085234 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 05:05:27.085234 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 05:05:27.085234 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 05:05:27.085234 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9984baa4-fc75-4d8f-a660-0647326196af could not be found. Sep 23 05:05:27.085234 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:05:27.085234 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:05:27.085234 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:05:27.085234 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:05:27.085234 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:05:27.085234 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:05:27.085234 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:05:27.085234 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:05:27.085234 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:05:27.085234 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:05:27.085234 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 05:05:27.085234 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 05:05:27.085234 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 05:05:27.085234 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 05:05:27.085234 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 05:05:27.085234 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:05:27.091827 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9984baa4-fc75-4d8f-a660-0647326196af could not be found. Sep 23 05:05:27.091827 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:05:27.091827 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:05:27.091827 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:05:27.091827 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:05:27.091827 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:05:27.091827 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:05:27.091827 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:05:27.091827 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:05:27.091827 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9984baa4-fc75-4d8f-a660-0647326196af could not be found. Sep 23 05:05:27.091827 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:05:27.091827 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c2d9f203-c663-4699-aa01-1014bed045dc tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Returning 404 to user: Instance 9984baa4-fc75-4d8f-a660-0647326196af could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:05:27.091827 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c2d9f203-c663-4699-aa01-1014bed045dc tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/9984baa4-fc75-4d8f-a660-0647326196af" status: 404 len: 111 microversion: 2.1 time: 0.080714 Sep 23 05:05:27.091827 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3051/6274] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:05:26 2022] GET /compute/v2.1/servers/9984baa4-fc75-4d8f-a660-0647326196af => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 05:05:27.104957 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8865cadd-056f-4ea3-9a7d-6f2411913352 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '.version_select at 0x7ff1ba8539d0>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:05:27.199874 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-91c037c6-6a79-4dc4-ab81-55e98275c7fb tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.188921 Sep 23 05:05:27.201319 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3224/6275] 10.222.0.33 () {60 vars in 1159 bytes} [Fri Sep 23 05:05:27 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:05:27.232227 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8865cadd-056f-4ea3-9a7d-6f2411913352 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-628481799" status: 202 len: 0 microversion: 2.1 time: 0.133447 Sep 23 05:05:27.233214 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3052/6276] 10.222.0.33 () {58 vars in 1218 bytes} [Fri Sep 23 05:05:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-628481799 => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 05:05:29.851349 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3d25db93-a2f6-417e-8bb8-3004d66d60b9 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Action: 'create', calling method: .version_select at 0x7ff1ba94d280>, body: {"keypair": {"name": "tempest-keypair-1325542104", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMjVqWAKT/8bodyI8saf0KorZdtx0uraSxO42FC/Lm67RRVdIomlM4W3Oudxn9p5/RZBkqLoSkWi+6wk315YGFYeRHAc/smAeixN1DujV1Mx23sO8sy1HluRS89HM4MfXQ=="}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:05:29.881861 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-3d25db93-a2f6-417e-8bb8-3004d66d60b9 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Getting quotas for project daad67f26fe246d6b4d28cad1707a119. Resources: {'key_pairs'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 05:05:29.904745 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-3d25db93-a2f6-417e-8bb8-3004d66d60b9 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Getting quotas for user 59d90150ed7d477fab33129cb3b068ed and project daad67f26fe246d6b4d28cad1707a119. Resources: {'key_pairs'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 05:05:30.009060 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3d25db93-a2f6-417e-8bb8-3004d66d60b9 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.162018 Sep 23 05:05:30.010780 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3225/6277] 10.222.0.33 () {60 vars in 1159 bytes} [Fri Sep 23 05:05:29 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:05:34.454224 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-af8f6ef8-2b1f-4dfc-b8fd-350e3903d626 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-868473411", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "networks": [{"uuid": "a5af7e45-3318-4114-a601-176e8b17dc41"}], "key_name": "tempest-TestNetworkBasicOps-822294140", "security_groups": [{"name": "tempest-secgroup-smoke-275220672"}]}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:05:34.505157 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:05:34.874548 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.network.neutron [None req-af8f6ef8-2b1f-4dfc-b8fd-350e3903d626 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] validate_networks() for [('a5af7e45-3318-4114-a601-176e8b17dc41', None, None, None, None, None)] {{(pid=122698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 05:05:36.153880 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-af8f6ef8-2b1f-4dfc-b8fd-350e3903d626 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Flavor limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 05:05:36.155174 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-af8f6ef8-2b1f-4dfc-b8fd-350e3903d626 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Image limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 05:05:36.158605 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-af8f6ef8-2b1f-4dfc-b8fd-350e3903d626 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Flavor pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 05:05:36.159309 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-af8f6ef8-2b1f-4dfc-b8fd-350e3903d626 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Image pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 05:05:36.159976 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-af8f6ef8-2b1f-4dfc-b8fd-350e3903d626 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 05:05:36.178040 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-af8f6ef8-2b1f-4dfc-b8fd-350e3903d626 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:36.179069 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-af8f6ef8-2b1f-4dfc-b8fd-350e3903d626 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:36.179755 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-af8f6ef8-2b1f-4dfc-b8fd-350e3903d626 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:36.181144 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-af8f6ef8-2b1f-4dfc-b8fd-350e3903d626 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:36.182450 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-af8f6ef8-2b1f-4dfc-b8fd-350e3903d626 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:36.183370 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-af8f6ef8-2b1f-4dfc-b8fd-350e3903d626 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:36.208067 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-af8f6ef8-2b1f-4dfc-b8fd-350e3903d626 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Getting quotas for project 5fefb9fd80184955a7856e1c41d081be. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 05:05:36.215613 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-af8f6ef8-2b1f-4dfc-b8fd-350e3903d626 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Getting quotas for user b3e8ce1f6821424080453f994dbcd604 and project 5fefb9fd80184955a7856e1c41d081be. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 05:05:36.237175 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-af8f6ef8-2b1f-4dfc-b8fd-350e3903d626 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Going to run 1 instances... {{(pid=122698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 05:05:36.241928 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-af8f6ef8-2b1f-4dfc-b8fd-350e3903d626 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] [instance: 44b4cfe5-2174-4dcb-ab59-4b7bdaf6d4ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 05:05:36.481882 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-af8f6ef8-2b1f-4dfc-b8fd-350e3903d626 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.034112 Sep 23 05:05:36.482597 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3053/6278] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 05:05:34 2022] POST /compute/v2.1/servers => generated 405 bytes in 2036 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 05:05:36.495208 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ae24f2ef-dda5-4c09-9131-447bf112f007 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:05:36.495874 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ae24f2ef-dda5-4c09-9131-447bf112f007 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] [instance: 44b4cfe5-2174-4dcb-ab59-4b7bdaf6d4ff] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:05:36.499596 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=54 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:05:36.689712 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ae24f2ef-dda5-4c09-9131-447bf112f007 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e8ce1f6821424080453f994dbcd604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fefb9fd80184955a7856e1c41d081be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:05:36.701725 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ae24f2ef-dda5-4c09-9131-447bf112f007 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] 10.222.0.33 "GET /compute/v2.1/servers/44b4cfe5-2174-4dcb-ab59-4b7bdaf6d4ff" status: 200 len: 1247 microversion: 2.1 time: 0.210737 Sep 23 05:05:36.705996 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3226/6279] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:05:36 2022] GET /compute/v2.1/servers/44b4cfe5-2174-4dcb-ab59-4b7bdaf6d4ff => generated 1247 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:05:37.217001 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b655e205-025b-4e93-86fe-97259fb49d93 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-854810633", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0ed8d15f-c597-425d-b882-0a82aeae94d2"}], "security_groups": [{"name": "tempest-securitygroup--2108081912"}], "key_name": "tempest-keypair-1325542104", "user_data": "}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:05:37.731057 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-120101d7-fa8e-4c56-bf5c-d47980b6e7cc tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:05:37.731679 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-120101d7-fa8e-4c56-bf5c-d47980b6e7cc tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] [instance: 44b4cfe5-2174-4dcb-ab59-4b7bdaf6d4ff] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:05:38.194783 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-120101d7-fa8e-4c56-bf5c-d47980b6e7cc tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e8ce1f6821424080453f994dbcd604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fefb9fd80184955a7856e1c41d081be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:05:38.203120 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-120101d7-fa8e-4c56-bf5c-d47980b6e7cc tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] 10.222.0.33 "GET /compute/v2.1/servers/44b4cfe5-2174-4dcb-ab59-4b7bdaf6d4ff" status: 200 len: 1247 microversion: 2.1 time: 0.478152 Sep 23 05:05:38.203699 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3227/6280] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:05:37 2022] GET /compute/v2.1/servers/44b4cfe5-2174-4dcb-ab59-4b7bdaf6d4ff => generated 1247 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:05:38.221416 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.network.neutron [None req-b655e205-025b-4e93-86fe-97259fb49d93 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] validate_networks() for [('0ed8d15f-c597-425d-b882-0a82aeae94d2', None, None, None, None, None)] {{(pid=122698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 05:05:39.015421 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-b655e205-025b-4e93-86fe-97259fb49d93 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Flavor limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 05:05:39.015863 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-b655e205-025b-4e93-86fe-97259fb49d93 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Image limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 05:05:39.016348 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-b655e205-025b-4e93-86fe-97259fb49d93 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Flavor pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 05:05:39.016976 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-b655e205-025b-4e93-86fe-97259fb49d93 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Image pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 05:05:39.017410 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-b655e205-025b-4e93-86fe-97259fb49d93 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 05:05:39.028285 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b655e205-025b-4e93-86fe-97259fb49d93 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:39.028770 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b655e205-025b-4e93-86fe-97259fb49d93 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:39.029440 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b655e205-025b-4e93-86fe-97259fb49d93 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:39.030257 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b655e205-025b-4e93-86fe-97259fb49d93 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:39.030730 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b655e205-025b-4e93-86fe-97259fb49d93 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:39.031295 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b655e205-025b-4e93-86fe-97259fb49d93 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:39.052746 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-b655e205-025b-4e93-86fe-97259fb49d93 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Getting quotas for project daad67f26fe246d6b4d28cad1707a119. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 05:05:39.069223 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-b655e205-025b-4e93-86fe-97259fb49d93 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Getting quotas for user 59d90150ed7d477fab33129cb3b068ed and project daad67f26fe246d6b4d28cad1707a119. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 05:05:39.084486 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b655e205-025b-4e93-86fe-97259fb49d93 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Going to run 1 instances... {{(pid=122698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 05:05:39.086983 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b655e205-025b-4e93-86fe-97259fb49d93 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 0d5dd84a-5c19-4af9-bd05-c95d93da0069] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 05:05:39.229252 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0e080139-14c3-4795-80a3-99ab216de1a4 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:05:39.230183 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-0e080139-14c3-4795-80a3-99ab216de1a4 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] [instance: 44b4cfe5-2174-4dcb-ab59-4b7bdaf6d4ff] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:05:39.237014 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0e080139-14c3-4795-80a3-99ab216de1a4 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:39.237505 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0e080139-14c3-4795-80a3-99ab216de1a4 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:39.238074 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0e080139-14c3-4795-80a3-99ab216de1a4 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:39.238798 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0e080139-14c3-4795-80a3-99ab216de1a4 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:39.239264 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0e080139-14c3-4795-80a3-99ab216de1a4 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:39.239696 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0e080139-14c3-4795-80a3-99ab216de1a4 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:39.306582 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-0e080139-14c3-4795-80a3-99ab216de1a4 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e8ce1f6821424080453f994dbcd604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fefb9fd80184955a7856e1c41d081be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:05:39.315145 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0e080139-14c3-4795-80a3-99ab216de1a4 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] 10.222.0.33 "GET /compute/v2.1/servers/44b4cfe5-2174-4dcb-ab59-4b7bdaf6d4ff" status: 200 len: 1243 microversion: 2.1 time: 0.090340 Sep 23 05:05:39.315742 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3228/6281] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:05:39 2022] GET /compute/v2.1/servers/44b4cfe5-2174-4dcb-ab59-4b7bdaf6d4ff => generated 1243 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:05:40.338725 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2c8e2735-f70a-4064-b796-5c60f6f6049c tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:05:40.339601 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-2c8e2735-f70a-4064-b796-5c60f6f6049c tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] [instance: 44b4cfe5-2174-4dcb-ab59-4b7bdaf6d4ff] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:05:40.344478 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b655e205-025b-4e93-86fe-97259fb49d93 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.136248 Sep 23 05:05:40.355662 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2c8e2735-f70a-4064-b796-5c60f6f6049c tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:40.356441 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2c8e2735-f70a-4064-b796-5c60f6f6049c tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:40.357080 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3054/6282] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 05:05:37 2022] POST /compute/v2.1/servers => generated 402 bytes in 3150 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 05:05:40.357227 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2c8e2735-f70a-4064-b796-5c60f6f6049c tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:40.357762 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2c8e2735-f70a-4064-b796-5c60f6f6049c tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:40.358276 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2c8e2735-f70a-4064-b796-5c60f6f6049c tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:40.358719 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2c8e2735-f70a-4064-b796-5c60f6f6049c tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:40.365196 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-84c39326-9735-4468-82b0-2ffc50befd39 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:05:40.366967 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-84c39326-9735-4468-82b0-2ffc50befd39 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 0d5dd84a-5c19-4af9-bd05-c95d93da0069] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:05:40.549561 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2c8e2735-f70a-4064-b796-5c60f6f6049c tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e8ce1f6821424080453f994dbcd604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fefb9fd80184955a7856e1c41d081be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:05:40.566155 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2c8e2735-f70a-4064-b796-5c60f6f6049c tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] 10.222.0.33 "GET /compute/v2.1/servers/44b4cfe5-2174-4dcb-ab59-4b7bdaf6d4ff" status: 200 len: 1243 microversion: 2.1 time: 0.231497 Sep 23 05:05:40.567339 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3229/6283] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:05:40 2022] GET /compute/v2.1/servers/44b4cfe5-2174-4dcb-ab59-4b7bdaf6d4ff => generated 1243 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:05:40.579630 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-84c39326-9735-4468-82b0-2ffc50befd39 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d90150ed7d477fab33129cb3b068ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daad67f26fe246d6b4d28cad1707a119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:05:40.595069 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-84c39326-9735-4468-82b0-2ffc50befd39 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/0d5dd84a-5c19-4af9-bd05-c95d93da0069" status: 200 len: 1241 microversion: 2.1 time: 0.236775 Sep 23 05:05:40.598020 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3055/6284] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:05:40 2022] GET /compute/v2.1/servers/0d5dd84a-5c19-4af9-bd05-c95d93da0069 => generated 1241 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:05:41.590999 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-606b9b42-1202-44eb-a7cb-16b2304df920 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:05:41.591475 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-606b9b42-1202-44eb-a7cb-16b2304df920 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] [instance: 44b4cfe5-2174-4dcb-ab59-4b7bdaf6d4ff] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:05:41.605266 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-606b9b42-1202-44eb-a7cb-16b2304df920 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:41.620898 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ae5c50d4-0903-4e0f-b9f3-dc43349d6874 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:05:41.621635 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-ae5c50d4-0903-4e0f-b9f3-dc43349d6874 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 0d5dd84a-5c19-4af9-bd05-c95d93da0069] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:05:41.622829 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-606b9b42-1202-44eb-a7cb-16b2304df920 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:41.623991 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-606b9b42-1202-44eb-a7cb-16b2304df920 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:41.625125 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-606b9b42-1202-44eb-a7cb-16b2304df920 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:41.625991 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-606b9b42-1202-44eb-a7cb-16b2304df920 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:41.627418 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-606b9b42-1202-44eb-a7cb-16b2304df920 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:41.897614 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ae5c50d4-0903-4e0f-b9f3-dc43349d6874 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d90150ed7d477fab33129cb3b068ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daad67f26fe246d6b4d28cad1707a119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:05:41.906679 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ae5c50d4-0903-4e0f-b9f3-dc43349d6874 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/0d5dd84a-5c19-4af9-bd05-c95d93da0069" status: 200 len: 1241 microversion: 2.1 time: 0.290219 Sep 23 05:05:41.919452 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3056/6285] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:05:41 2022] GET /compute/v2.1/servers/0d5dd84a-5c19-4af9-bd05-c95d93da0069 => generated 1241 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:05:42.085371 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-606b9b42-1202-44eb-a7cb-16b2304df920 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e8ce1f6821424080453f994dbcd604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fefb9fd80184955a7856e1c41d081be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:05:42.101776 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-606b9b42-1202-44eb-a7cb-16b2304df920 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] 10.222.0.33 "GET /compute/v2.1/servers/44b4cfe5-2174-4dcb-ab59-4b7bdaf6d4ff" status: 200 len: 1307 microversion: 2.1 time: 0.513930 Sep 23 05:05:42.106539 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3230/6286] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:05:41 2022] GET /compute/v2.1/servers/44b4cfe5-2174-4dcb-ab59-4b7bdaf6d4ff => generated 1307 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:05:42.939499 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7f646e95-54de-4a22-88cf-9625f3bcf8a1 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:05:42.940909 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7f646e95-54de-4a22-88cf-9625f3bcf8a1 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 0d5dd84a-5c19-4af9-bd05-c95d93da0069] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:05:42.955671 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7f646e95-54de-4a22-88cf-9625f3bcf8a1 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:42.956187 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7f646e95-54de-4a22-88cf-9625f3bcf8a1 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:42.956692 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7f646e95-54de-4a22-88cf-9625f3bcf8a1 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:42.957426 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7f646e95-54de-4a22-88cf-9625f3bcf8a1 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:42.967559 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7f646e95-54de-4a22-88cf-9625f3bcf8a1 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:42.968266 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7f646e95-54de-4a22-88cf-9625f3bcf8a1 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:43.142434 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f80c7246-bf0c-4863-9c13-da66a7577a18 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:05:43.143934 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f80c7246-bf0c-4863-9c13-da66a7577a18 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] [instance: 44b4cfe5-2174-4dcb-ab59-4b7bdaf6d4ff] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:05:43.158711 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f80c7246-bf0c-4863-9c13-da66a7577a18 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:43.162161 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f80c7246-bf0c-4863-9c13-da66a7577a18 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:43.163132 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f80c7246-bf0c-4863-9c13-da66a7577a18 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:43.164655 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f80c7246-bf0c-4863-9c13-da66a7577a18 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:43.165933 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f80c7246-bf0c-4863-9c13-da66a7577a18 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:43.166775 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f80c7246-bf0c-4863-9c13-da66a7577a18 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:43.377560 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-7f646e95-54de-4a22-88cf-9625f3bcf8a1 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d90150ed7d477fab33129cb3b068ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daad67f26fe246d6b4d28cad1707a119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:05:43.392104 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7f646e95-54de-4a22-88cf-9625f3bcf8a1 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/0d5dd84a-5c19-4af9-bd05-c95d93da0069" status: 200 len: 1293 microversion: 2.1 time: 0.463741 Sep 23 05:05:43.396422 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3057/6287] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:05:42 2022] GET /compute/v2.1/servers/0d5dd84a-5c19-4af9-bd05-c95d93da0069 => generated 1293 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:05:43.443057 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f80c7246-bf0c-4863-9c13-da66a7577a18 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e8ce1f6821424080453f994dbcd604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fefb9fd80184955a7856e1c41d081be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:05:43.453035 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f80c7246-bf0c-4863-9c13-da66a7577a18 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] 10.222.0.33 "GET /compute/v2.1/servers/44b4cfe5-2174-4dcb-ab59-4b7bdaf6d4ff" status: 200 len: 1305 microversion: 2.1 time: 0.322229 Sep 23 05:05:43.458083 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3231/6288] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:05:43 2022] GET /compute/v2.1/servers/44b4cfe5-2174-4dcb-ab59-4b7bdaf6d4ff => generated 1305 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:05:44.423055 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9e87fde7-3872-4b11-889f-5bbd0165b87c tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:05:44.423055 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-9e87fde7-3872-4b11-889f-5bbd0165b87c tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 0d5dd84a-5c19-4af9-bd05-c95d93da0069] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:05:44.435186 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9e87fde7-3872-4b11-889f-5bbd0165b87c tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:44.435876 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9e87fde7-3872-4b11-889f-5bbd0165b87c tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:44.436439 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9e87fde7-3872-4b11-889f-5bbd0165b87c tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:44.437319 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9e87fde7-3872-4b11-889f-5bbd0165b87c tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:44.437976 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9e87fde7-3872-4b11-889f-5bbd0165b87c tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:44.438795 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9e87fde7-3872-4b11-889f-5bbd0165b87c tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:44.443702 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:05:44.479433 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8111e5a3-ba03-449c-a3d4-7c59432f1799 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:05:44.480434 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-8111e5a3-ba03-449c-a3d4-7c59432f1799 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] [instance: 44b4cfe5-2174-4dcb-ab59-4b7bdaf6d4ff] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:05:44.494372 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8111e5a3-ba03-449c-a3d4-7c59432f1799 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:44.498462 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8111e5a3-ba03-449c-a3d4-7c59432f1799 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:44.499734 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8111e5a3-ba03-449c-a3d4-7c59432f1799 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:44.501756 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8111e5a3-ba03-449c-a3d4-7c59432f1799 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:44.502482 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8111e5a3-ba03-449c-a3d4-7c59432f1799 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:44.503025 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8111e5a3-ba03-449c-a3d4-7c59432f1799 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:44.686531 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-9e87fde7-3872-4b11-889f-5bbd0165b87c tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d90150ed7d477fab33129cb3b068ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daad67f26fe246d6b4d28cad1707a119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:05:44.707886 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9e87fde7-3872-4b11-889f-5bbd0165b87c tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/0d5dd84a-5c19-4af9-bd05-c95d93da0069" status: 200 len: 1299 microversion: 2.1 time: 0.289829 Sep 23 05:05:44.711348 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3058/6289] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:05:44 2022] GET /compute/v2.1/servers/0d5dd84a-5c19-4af9-bd05-c95d93da0069 => generated 1299 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:05:44.847404 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-8111e5a3-ba03-449c-a3d4-7c59432f1799 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e8ce1f6821424080453f994dbcd604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fefb9fd80184955a7856e1c41d081be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:05:44.879508 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-8111e5a3-ba03-449c-a3d4-7c59432f1799 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] 10.222.0.33 "GET /compute/v2.1/servers/44b4cfe5-2174-4dcb-ab59-4b7bdaf6d4ff" status: 200 len: 1305 microversion: 2.1 time: 0.403534 Sep 23 05:05:44.893919 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3232/6290] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:05:44 2022] GET /compute/v2.1/servers/44b4cfe5-2174-4dcb-ab59-4b7bdaf6d4ff => generated 1305 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:05:45.743650 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e1987641-f757-4b2b-90ee-30f4016a95c4 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:05:45.744563 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e1987641-f757-4b2b-90ee-30f4016a95c4 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 0d5dd84a-5c19-4af9-bd05-c95d93da0069] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:05:45.759976 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e1987641-f757-4b2b-90ee-30f4016a95c4 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:45.761009 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e1987641-f757-4b2b-90ee-30f4016a95c4 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:45.761755 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e1987641-f757-4b2b-90ee-30f4016a95c4 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:45.762560 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e1987641-f757-4b2b-90ee-30f4016a95c4 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:45.763063 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e1987641-f757-4b2b-90ee-30f4016a95c4 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:45.763511 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e1987641-f757-4b2b-90ee-30f4016a95c4 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:45.908225 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3a3a9e47-160a-4f96-a92e-ccfe9541b414 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:05:45.908961 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-3a3a9e47-160a-4f96-a92e-ccfe9541b414 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] [instance: 44b4cfe5-2174-4dcb-ab59-4b7bdaf6d4ff] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:05:45.913953 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e1987641-f757-4b2b-90ee-30f4016a95c4 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d90150ed7d477fab33129cb3b068ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daad67f26fe246d6b4d28cad1707a119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:05:45.923914 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e1987641-f757-4b2b-90ee-30f4016a95c4 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/0d5dd84a-5c19-4af9-bd05-c95d93da0069" status: 200 len: 1299 microversion: 2.1 time: 0.187373 Sep 23 05:05:45.927255 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3059/6291] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:05:45 2022] GET /compute/v2.1/servers/0d5dd84a-5c19-4af9-bd05-c95d93da0069 => generated 1299 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:05:45.946145 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3a3a9e47-160a-4f96-a92e-ccfe9541b414 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:45.946145 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3a3a9e47-160a-4f96-a92e-ccfe9541b414 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:45.946145 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3a3a9e47-160a-4f96-a92e-ccfe9541b414 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:45.946145 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3a3a9e47-160a-4f96-a92e-ccfe9541b414 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:45.946145 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3a3a9e47-160a-4f96-a92e-ccfe9541b414 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:45.946841 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3a3a9e47-160a-4f96-a92e-ccfe9541b414 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:46.342338 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-3a3a9e47-160a-4f96-a92e-ccfe9541b414 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e8ce1f6821424080453f994dbcd604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fefb9fd80184955a7856e1c41d081be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:05:46.358618 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3a3a9e47-160a-4f96-a92e-ccfe9541b414 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] 10.222.0.33 "GET /compute/v2.1/servers/44b4cfe5-2174-4dcb-ab59-4b7bdaf6d4ff" status: 200 len: 1372 microversion: 2.1 time: 0.449666 Sep 23 05:05:46.373918 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3233/6292] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:05:45 2022] GET /compute/v2.1/servers/44b4cfe5-2174-4dcb-ab59-4b7bdaf6d4ff => generated 1372 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:05:46.953075 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-10fce37b-72d5-47a3-bb8d-f7d1a00f2326 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:05:46.954635 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-10fce37b-72d5-47a3-bb8d-f7d1a00f2326 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 0d5dd84a-5c19-4af9-bd05-c95d93da0069] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:05:46.971321 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-10fce37b-72d5-47a3-bb8d-f7d1a00f2326 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:46.972814 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-10fce37b-72d5-47a3-bb8d-f7d1a00f2326 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:46.976496 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-10fce37b-72d5-47a3-bb8d-f7d1a00f2326 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:46.977312 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-10fce37b-72d5-47a3-bb8d-f7d1a00f2326 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:46.980601 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-10fce37b-72d5-47a3-bb8d-f7d1a00f2326 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:46.981202 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-10fce37b-72d5-47a3-bb8d-f7d1a00f2326 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:47.387918 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e9b3e640-d8b3-4154-a136-705921316a08 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:05:47.389392 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e9b3e640-d8b3-4154-a136-705921316a08 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] [instance: 44b4cfe5-2174-4dcb-ab59-4b7bdaf6d4ff] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:05:47.410055 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e9b3e640-d8b3-4154-a136-705921316a08 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:47.410857 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e9b3e640-d8b3-4154-a136-705921316a08 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:47.411482 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e9b3e640-d8b3-4154-a136-705921316a08 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:47.419674 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e9b3e640-d8b3-4154-a136-705921316a08 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:47.419674 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e9b3e640-d8b3-4154-a136-705921316a08 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:47.419674 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e9b3e640-d8b3-4154-a136-705921316a08 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:47.470386 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-10fce37b-72d5-47a3-bb8d-f7d1a00f2326 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d90150ed7d477fab33129cb3b068ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daad67f26fe246d6b4d28cad1707a119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:05:47.482957 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-10fce37b-72d5-47a3-bb8d-f7d1a00f2326 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/0d5dd84a-5c19-4af9-bd05-c95d93da0069" status: 200 len: 1367 microversion: 2.1 time: 0.535453 Sep 23 05:05:47.484068 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3060/6293] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:05:46 2022] GET /compute/v2.1/servers/0d5dd84a-5c19-4af9-bd05-c95d93da0069 => generated 1367 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:05:47.626109 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e9b3e640-d8b3-4154-a136-705921316a08 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e8ce1f6821424080453f994dbcd604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fefb9fd80184955a7856e1c41d081be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:05:47.637456 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e9b3e640-d8b3-4154-a136-705921316a08 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] 10.222.0.33 "GET /compute/v2.1/servers/44b4cfe5-2174-4dcb-ab59-4b7bdaf6d4ff" status: 200 len: 1372 microversion: 2.1 time: 0.253577 Sep 23 05:05:47.656597 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3234/6294] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:05:47 2022] GET /compute/v2.1/servers/44b4cfe5-2174-4dcb-ab59-4b7bdaf6d4ff => generated 1372 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:05:48.510418 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-953a6061-193a-480d-943a-8680a633269e tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:05:48.511684 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-953a6061-193a-480d-943a-8680a633269e tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 0d5dd84a-5c19-4af9-bd05-c95d93da0069] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:05:48.518832 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-953a6061-193a-480d-943a-8680a633269e tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:48.525704 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-953a6061-193a-480d-943a-8680a633269e tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:48.526481 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-953a6061-193a-480d-943a-8680a633269e tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:48.532959 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-953a6061-193a-480d-943a-8680a633269e tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:48.533528 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-953a6061-193a-480d-943a-8680a633269e tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:48.534447 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-953a6061-193a-480d-943a-8680a633269e tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:48.667098 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-94580428-3460-4005-b51a-96f8c38d6ca3 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:05:48.667098 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-94580428-3460-4005-b51a-96f8c38d6ca3 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] [instance: 44b4cfe5-2174-4dcb-ab59-4b7bdaf6d4ff] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:05:48.684310 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=12 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:05:48.688897 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-94580428-3460-4005-b51a-96f8c38d6ca3 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:48.689459 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-94580428-3460-4005-b51a-96f8c38d6ca3 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:48.690087 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-94580428-3460-4005-b51a-96f8c38d6ca3 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:48.690833 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-94580428-3460-4005-b51a-96f8c38d6ca3 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:48.691398 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-94580428-3460-4005-b51a-96f8c38d6ca3 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:48.691876 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-94580428-3460-4005-b51a-96f8c38d6ca3 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:48.902299 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-953a6061-193a-480d-943a-8680a633269e tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d90150ed7d477fab33129cb3b068ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daad67f26fe246d6b4d28cad1707a119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:05:48.920277 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-953a6061-193a-480d-943a-8680a633269e tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/0d5dd84a-5c19-4af9-bd05-c95d93da0069" status: 200 len: 1367 microversion: 2.1 time: 0.412616 Sep 23 05:05:48.920277 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3061/6295] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:05:48 2022] GET /compute/v2.1/servers/0d5dd84a-5c19-4af9-bd05-c95d93da0069 => generated 1367 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:05:48.970232 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-94580428-3460-4005-b51a-96f8c38d6ca3 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e8ce1f6821424080453f994dbcd604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fefb9fd80184955a7856e1c41d081be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:05:49.013227 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-94580428-3460-4005-b51a-96f8c38d6ca3 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] 10.222.0.33 "GET /compute/v2.1/servers/44b4cfe5-2174-4dcb-ab59-4b7bdaf6d4ff" status: 200 len: 1372 microversion: 2.1 time: 0.356361 Sep 23 05:05:49.014544 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3235/6296] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:05:48 2022] GET /compute/v2.1/servers/44b4cfe5-2174-4dcb-ab59-4b7bdaf6d4ff => generated 1372 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:05:49.120521 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ecc0db71-00f4-4784-8c40-5907c5ce13b3 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:05:49.121034 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-ecc0db71-00f4-4784-8c40-5907c5ce13b3 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] [instance: 928fb88c-a689-46ee-a069-de58089ceba6] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:05:49.124003 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=4 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:05:49.127883 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ecc0db71-00f4-4784-8c40-5907c5ce13b3 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:49.128602 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ecc0db71-00f4-4784-8c40-5907c5ce13b3 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:49.129479 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ecc0db71-00f4-4784-8c40-5907c5ce13b3 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:49.130453 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ecc0db71-00f4-4784-8c40-5907c5ce13b3 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:49.130921 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ecc0db71-00f4-4784-8c40-5907c5ce13b3 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:49.131532 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ecc0db71-00f4-4784-8c40-5907c5ce13b3 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:49.166977 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ecc0db71-00f4-4784-8c40-5907c5ce13b3 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] 10.222.0.33 "GET /compute/v2.1/servers/928fb88c-a689-46ee-a069-de58089ceba6/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.050882 Sep 23 05:05:49.178000 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3062/6297] 10.222.0.33 () {58 vars in 1293 bytes} [Fri Sep 23 05:05:49 2022] GET /compute/v2.1/servers/928fb88c-a689-46ee-a069-de58089ceba6/os-server-password => generated 116 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:05:49.521258 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-22412269-5701-4786-bc19-db261d1d5615 req-8a652f01-d1d1-4bca-bf88-89a105f6db4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44b4cfe5-2174-4dcb-ab59-4b7bdaf6d4ff", "tag": "e9853be9-f62c-43e9-805e-80b2fe61ab14"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:05:49.543308 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-22412269-5701-4786-bc19-db261d1d5615 req-8a652f01-d1d1-4bca-bf88-89a105f6db4d service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:49.545569 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-22412269-5701-4786-bc19-db261d1d5615 req-8a652f01-d1d1-4bca-bf88-89a105f6db4d service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:49.546330 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-22412269-5701-4786-bc19-db261d1d5615 req-8a652f01-d1d1-4bca-bf88-89a105f6db4d service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:49.564162 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-22412269-5701-4786-bc19-db261d1d5615 req-8a652f01-d1d1-4bca-bf88-89a105f6db4d service nova] Creating event network-changed:e9853be9-f62c-43e9-805e-80b2fe61ab14 for instance 44b4cfe5-2174-4dcb-ab59-4b7bdaf6d4ff on n-h2-846463-3 Sep 23 05:05:49.570600 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-22412269-5701-4786-bc19-db261d1d5615 req-8a652f01-d1d1-4bca-bf88-89a105f6db4d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061331 Sep 23 05:05:49.572119 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3236/6298] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:05:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:05:49.946143 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-646a7847-670d-4721-84f4-4755e261e5fd tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:05:49.946841 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-646a7847-670d-4721-84f4-4755e261e5fd tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 0d5dd84a-5c19-4af9-bd05-c95d93da0069] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:05:49.958135 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-646a7847-670d-4721-84f4-4755e261e5fd tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:49.958575 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-646a7847-670d-4721-84f4-4755e261e5fd tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:49.959002 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-646a7847-670d-4721-84f4-4755e261e5fd tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:49.962644 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-646a7847-670d-4721-84f4-4755e261e5fd tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:49.963130 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-646a7847-670d-4721-84f4-4755e261e5fd tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:49.963575 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-646a7847-670d-4721-84f4-4755e261e5fd tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:50.039835 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-99a0faaf-b682-4861-8cc3-91df6747ddce tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:05:50.041210 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-99a0faaf-b682-4861-8cc3-91df6747ddce tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] [instance: 44b4cfe5-2174-4dcb-ab59-4b7bdaf6d4ff] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:05:50.051463 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-99a0faaf-b682-4861-8cc3-91df6747ddce tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:50.052225 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-99a0faaf-b682-4861-8cc3-91df6747ddce tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:50.052840 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-99a0faaf-b682-4861-8cc3-91df6747ddce tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:50.053979 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-99a0faaf-b682-4861-8cc3-91df6747ddce tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:50.054843 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-99a0faaf-b682-4861-8cc3-91df6747ddce tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:50.056154 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-99a0faaf-b682-4861-8cc3-91df6747ddce tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:50.751310 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-646a7847-670d-4721-84f4-4755e261e5fd tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d90150ed7d477fab33129cb3b068ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daad67f26fe246d6b4d28cad1707a119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:05:50.754656 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-99a0faaf-b682-4861-8cc3-91df6747ddce tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e8ce1f6821424080453f994dbcd604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fefb9fd80184955a7856e1c41d081be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:05:50.765429 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-646a7847-670d-4721-84f4-4755e261e5fd tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/0d5dd84a-5c19-4af9-bd05-c95d93da0069" status: 200 len: 1367 microversion: 2.1 time: 0.822364 Sep 23 05:05:50.780199 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-99a0faaf-b682-4861-8cc3-91df6747ddce tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] 10.222.0.33 "GET /compute/v2.1/servers/44b4cfe5-2174-4dcb-ab59-4b7bdaf6d4ff" status: 200 len: 1372 microversion: 2.1 time: 0.733187 Sep 23 05:05:50.780199 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3237/6299] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:05:50 2022] GET /compute/v2.1/servers/44b4cfe5-2174-4dcb-ab59-4b7bdaf6d4ff => generated 1372 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:05:50.782688 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3063/6300] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:05:49 2022] GET /compute/v2.1/servers/0d5dd84a-5c19-4af9-bd05-c95d93da0069 => generated 1367 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:05:51.796701 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-edf16f96-785b-4048-aed7-015ea2da7252 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:05:51.807060 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-edf16f96-785b-4048-aed7-015ea2da7252 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] [instance: 44b4cfe5-2174-4dcb-ab59-4b7bdaf6d4ff] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:05:51.807223 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-dcbfd16c-14f3-4f49-84f0-1f79ed6a190f tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:05:51.807695 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-edf16f96-785b-4048-aed7-015ea2da7252 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:51.807970 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-edf16f96-785b-4048-aed7-015ea2da7252 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:51.808094 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-dcbfd16c-14f3-4f49-84f0-1f79ed6a190f tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 0d5dd84a-5c19-4af9-bd05-c95d93da0069] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:05:51.808286 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-edf16f96-785b-4048-aed7-015ea2da7252 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:51.809264 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-edf16f96-785b-4048-aed7-015ea2da7252 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:51.810018 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-edf16f96-785b-4048-aed7-015ea2da7252 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:51.810643 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-edf16f96-785b-4048-aed7-015ea2da7252 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:51.825513 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dcbfd16c-14f3-4f49-84f0-1f79ed6a190f tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:51.825967 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dcbfd16c-14f3-4f49-84f0-1f79ed6a190f tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:51.826426 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dcbfd16c-14f3-4f49-84f0-1f79ed6a190f tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:51.827209 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dcbfd16c-14f3-4f49-84f0-1f79ed6a190f tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:51.827683 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dcbfd16c-14f3-4f49-84f0-1f79ed6a190f tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:51.828122 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dcbfd16c-14f3-4f49-84f0-1f79ed6a190f tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:51.905596 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=16 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:05:53.043844 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-dcbfd16c-14f3-4f49-84f0-1f79ed6a190f tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d90150ed7d477fab33129cb3b068ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daad67f26fe246d6b4d28cad1707a119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:05:53.056106 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-dcbfd16c-14f3-4f49-84f0-1f79ed6a190f tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/0d5dd84a-5c19-4af9-bd05-c95d93da0069" status: 200 len: 1367 microversion: 2.1 time: 1.252847 Sep 23 05:05:53.058231 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3064/6301] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:05:51 2022] GET /compute/v2.1/servers/0d5dd84a-5c19-4af9-bd05-c95d93da0069 => generated 1367 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:05:53.087662 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-a0ad4bc0-bb5a-419a-8f78-7575f27436ef req-3aeab846-b12c-49d4-a531-17b8fffd7e38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d5dd84a-5c19-4af9-bd05-c95d93da0069", "tag": "5835071a-ff9e-4eb0-8397-f6d087882ded"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:05:53.107465 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-a0ad4bc0-bb5a-419a-8f78-7575f27436ef req-3aeab846-b12c-49d4-a531-17b8fffd7e38 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:53.110839 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-edf16f96-785b-4048-aed7-015ea2da7252 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e8ce1f6821424080453f994dbcd604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fefb9fd80184955a7856e1c41d081be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:05:53.111644 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-a0ad4bc0-bb5a-419a-8f78-7575f27436ef req-3aeab846-b12c-49d4-a531-17b8fffd7e38 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:53.112218 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-a0ad4bc0-bb5a-419a-8f78-7575f27436ef req-3aeab846-b12c-49d4-a531-17b8fffd7e38 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:53.132188 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-a0ad4bc0-bb5a-419a-8f78-7575f27436ef req-3aeab846-b12c-49d4-a531-17b8fffd7e38 service nova] Creating event network-changed:5835071a-ff9e-4eb0-8397-f6d087882ded for instance 0d5dd84a-5c19-4af9-bd05-c95d93da0069 on n-h2-846463-3 Sep 23 05:05:53.135457 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-a0ad4bc0-bb5a-419a-8f78-7575f27436ef req-3aeab846-b12c-49d4-a531-17b8fffd7e38 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063259 Sep 23 05:05:53.136187 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3065/6302] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:05:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:05:53.138920 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-edf16f96-785b-4048-aed7-015ea2da7252 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] 10.222.0.33 "GET /compute/v2.1/servers/44b4cfe5-2174-4dcb-ab59-4b7bdaf6d4ff" status: 200 len: 1372 microversion: 2.1 time: 1.347331 Sep 23 05:05:53.142508 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3238/6303] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:05:51 2022] GET /compute/v2.1/servers/44b4cfe5-2174-4dcb-ab59-4b7bdaf6d4ff => generated 1372 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:05:54.083799 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d31c2011-51b0-486c-990c-f352541edefd tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:05:54.084523 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d31c2011-51b0-486c-990c-f352541edefd tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 0d5dd84a-5c19-4af9-bd05-c95d93da0069] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:05:54.098624 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d31c2011-51b0-486c-990c-f352541edefd tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:54.099196 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d31c2011-51b0-486c-990c-f352541edefd tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:54.099602 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d31c2011-51b0-486c-990c-f352541edefd tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:54.100339 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d31c2011-51b0-486c-990c-f352541edefd tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:54.100812 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d31c2011-51b0-486c-990c-f352541edefd tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:54.101253 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d31c2011-51b0-486c-990c-f352541edefd tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:54.174514 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f2aa6b2f-1895-4112-ae35-91d389ea6201 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:05:54.175127 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f2aa6b2f-1895-4112-ae35-91d389ea6201 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] [instance: 44b4cfe5-2174-4dcb-ab59-4b7bdaf6d4ff] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:05:54.192939 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f2aa6b2f-1895-4112-ae35-91d389ea6201 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:54.193444 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f2aa6b2f-1895-4112-ae35-91d389ea6201 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:54.194005 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f2aa6b2f-1895-4112-ae35-91d389ea6201 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:54.194709 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f2aa6b2f-1895-4112-ae35-91d389ea6201 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:54.195169 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f2aa6b2f-1895-4112-ae35-91d389ea6201 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:54.195615 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f2aa6b2f-1895-4112-ae35-91d389ea6201 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:54.951770 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f2aa6b2f-1895-4112-ae35-91d389ea6201 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e8ce1f6821424080453f994dbcd604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fefb9fd80184955a7856e1c41d081be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:05:54.951770 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f2aa6b2f-1895-4112-ae35-91d389ea6201 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] 10.222.0.33 "GET /compute/v2.1/servers/44b4cfe5-2174-4dcb-ab59-4b7bdaf6d4ff" status: 200 len: 1372 microversion: 2.1 time: 0.425624 Sep 23 05:05:54.951770 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3239/6304] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:05:54 2022] GET /compute/v2.1/servers/44b4cfe5-2174-4dcb-ab59-4b7bdaf6d4ff => generated 1372 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:05:54.953716 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d31c2011-51b0-486c-990c-f352541edefd tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d90150ed7d477fab33129cb3b068ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daad67f26fe246d6b4d28cad1707a119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:05:54.953716 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d31c2011-51b0-486c-990c-f352541edefd tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/0d5dd84a-5c19-4af9-bd05-c95d93da0069" status: 200 len: 1367 microversion: 2.1 time: 0.551855 Sep 23 05:05:54.953716 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3066/6305] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:05:54 2022] GET /compute/v2.1/servers/0d5dd84a-5c19-4af9-bd05-c95d93da0069 => generated 1367 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:05:55.628090 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c587abc7-9791-4ee0-88f0-ce622a2d21cb tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:05:55.629359 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c587abc7-9791-4ee0-88f0-ce622a2d21cb tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] [instance: 44b4cfe5-2174-4dcb-ab59-4b7bdaf6d4ff] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:05:55.665011 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2b956b44-aadc-43b9-8c73-a68f5ee92cf0 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:05:55.666185 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-2b956b44-aadc-43b9-8c73-a68f5ee92cf0 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 0d5dd84a-5c19-4af9-bd05-c95d93da0069] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:05:55.667803 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:05:55.684316 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c587abc7-9791-4ee0-88f0-ce622a2d21cb tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:55.686641 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c587abc7-9791-4ee0-88f0-ce622a2d21cb tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:55.688670 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c587abc7-9791-4ee0-88f0-ce622a2d21cb tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:55.692021 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c587abc7-9791-4ee0-88f0-ce622a2d21cb tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:55.702504 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c587abc7-9791-4ee0-88f0-ce622a2d21cb tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:55.704663 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c587abc7-9791-4ee0-88f0-ce622a2d21cb tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:55.719079 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2b956b44-aadc-43b9-8c73-a68f5ee92cf0 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:55.722683 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2b956b44-aadc-43b9-8c73-a68f5ee92cf0 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:55.727400 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2b956b44-aadc-43b9-8c73-a68f5ee92cf0 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:55.756690 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2b956b44-aadc-43b9-8c73-a68f5ee92cf0 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:55.756690 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2b956b44-aadc-43b9-8c73-a68f5ee92cf0 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:55.756690 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2b956b44-aadc-43b9-8c73-a68f5ee92cf0 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:56.171126 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c587abc7-9791-4ee0-88f0-ce622a2d21cb tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e8ce1f6821424080453f994dbcd604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fefb9fd80184955a7856e1c41d081be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:05:56.235783 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-2b956b44-aadc-43b9-8c73-a68f5ee92cf0 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d90150ed7d477fab33129cb3b068ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daad67f26fe246d6b4d28cad1707a119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:05:56.249801 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c587abc7-9791-4ee0-88f0-ce622a2d21cb tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] 10.222.0.33 "GET /compute/v2.1/servers/44b4cfe5-2174-4dcb-ab59-4b7bdaf6d4ff" status: 200 len: 1372 microversion: 2.1 time: 0.628137 Sep 23 05:05:56.252218 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2b956b44-aadc-43b9-8c73-a68f5ee92cf0 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/0d5dd84a-5c19-4af9-bd05-c95d93da0069" status: 200 len: 1367 microversion: 2.1 time: 0.589011 Sep 23 05:05:56.253129 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3067/6306] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:05:55 2022] GET /compute/v2.1/servers/0d5dd84a-5c19-4af9-bd05-c95d93da0069 => generated 1367 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:05:56.274708 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3240/6307] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:05:55 2022] GET /compute/v2.1/servers/44b4cfe5-2174-4dcb-ab59-4b7bdaf6d4ff => generated 1372 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:05:57.292080 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5125b4cc-c2e1-414f-bff1-374e1ab7adfc tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:05:57.292821 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5125b4cc-c2e1-414f-bff1-374e1ab7adfc tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] [instance: 44b4cfe5-2174-4dcb-ab59-4b7bdaf6d4ff] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:05:57.293307 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7b8cfee9-3f46-43f8-813e-d4c592a07786 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:05:57.293959 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-7b8cfee9-3f46-43f8-813e-d4c592a07786 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 0d5dd84a-5c19-4af9-bd05-c95d93da0069] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:05:57.309024 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7b8cfee9-3f46-43f8-813e-d4c592a07786 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:57.311735 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7b8cfee9-3f46-43f8-813e-d4c592a07786 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:57.316216 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7b8cfee9-3f46-43f8-813e-d4c592a07786 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:57.316216 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7b8cfee9-3f46-43f8-813e-d4c592a07786 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:57.316216 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7b8cfee9-3f46-43f8-813e-d4c592a07786 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:57.316216 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7b8cfee9-3f46-43f8-813e-d4c592a07786 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:57.316605 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5125b4cc-c2e1-414f-bff1-374e1ab7adfc tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:57.317150 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5125b4cc-c2e1-414f-bff1-374e1ab7adfc tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:57.320008 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5125b4cc-c2e1-414f-bff1-374e1ab7adfc tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:57.326821 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5125b4cc-c2e1-414f-bff1-374e1ab7adfc tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:57.334687 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5125b4cc-c2e1-414f-bff1-374e1ab7adfc tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:57.336332 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5125b4cc-c2e1-414f-bff1-374e1ab7adfc tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:57.896587 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-7b8cfee9-3f46-43f8-813e-d4c592a07786 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d90150ed7d477fab33129cb3b068ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daad67f26fe246d6b4d28cad1707a119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:05:57.904901 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-7b8cfee9-3f46-43f8-813e-d4c592a07786 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/0d5dd84a-5c19-4af9-bd05-c95d93da0069" status: 200 len: 1367 microversion: 2.1 time: 0.615876 Sep 23 05:05:57.908175 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3241/6308] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:05:57 2022] GET /compute/v2.1/servers/0d5dd84a-5c19-4af9-bd05-c95d93da0069 => generated 1367 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:05:57.944425 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-5125b4cc-c2e1-414f-bff1-374e1ab7adfc tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e8ce1f6821424080453f994dbcd604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fefb9fd80184955a7856e1c41d081be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:05:57.960827 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5125b4cc-c2e1-414f-bff1-374e1ab7adfc tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] 10.222.0.33 "GET /compute/v2.1/servers/44b4cfe5-2174-4dcb-ab59-4b7bdaf6d4ff" status: 200 len: 1372 microversion: 2.1 time: 0.685165 Sep 23 05:05:57.962563 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3068/6309] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:05:57 2022] GET /compute/v2.1/servers/44b4cfe5-2174-4dcb-ab59-4b7bdaf6d4ff => generated 1372 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:05:58.937373 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5060265e-8e68-41ae-a57c-b1df5f0cc724 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:05:58.938029 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-5060265e-8e68-41ae-a57c-b1df5f0cc724 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 0d5dd84a-5c19-4af9-bd05-c95d93da0069] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:05:58.954086 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5060265e-8e68-41ae-a57c-b1df5f0cc724 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:58.954585 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5060265e-8e68-41ae-a57c-b1df5f0cc724 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:58.959006 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5060265e-8e68-41ae-a57c-b1df5f0cc724 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:58.959791 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5060265e-8e68-41ae-a57c-b1df5f0cc724 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:58.960267 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5060265e-8e68-41ae-a57c-b1df5f0cc724 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:58.960695 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5060265e-8e68-41ae-a57c-b1df5f0cc724 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:58.987946 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9eb40f46-1566-47b4-9077-346406d25f54 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:05:58.989274 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-9eb40f46-1566-47b4-9077-346406d25f54 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] [instance: 44b4cfe5-2174-4dcb-ab59-4b7bdaf6d4ff] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:05:59.010387 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9eb40f46-1566-47b4-9077-346406d25f54 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:59.015441 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9eb40f46-1566-47b4-9077-346406d25f54 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:59.015441 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9eb40f46-1566-47b4-9077-346406d25f54 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:59.015441 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9eb40f46-1566-47b4-9077-346406d25f54 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:59.015441 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9eb40f46-1566-47b4-9077-346406d25f54 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:59.015441 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9eb40f46-1566-47b4-9077-346406d25f54 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:59.517715 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-9eb40f46-1566-47b4-9077-346406d25f54 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e8ce1f6821424080453f994dbcd604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fefb9fd80184955a7856e1c41d081be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:05:59.550172 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9eb40f46-1566-47b4-9077-346406d25f54 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] 10.222.0.33 "GET /compute/v2.1/servers/44b4cfe5-2174-4dcb-ab59-4b7bdaf6d4ff" status: 200 len: 1372 microversion: 2.1 time: 0.566972 Sep 23 05:05:59.551206 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-5060265e-8e68-41ae-a57c-b1df5f0cc724 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d90150ed7d477fab33129cb3b068ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daad67f26fe246d6b4d28cad1707a119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:05:59.556274 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3069/6310] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:05:58 2022] GET /compute/v2.1/servers/44b4cfe5-2174-4dcb-ab59-4b7bdaf6d4ff => generated 1372 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:05:59.562675 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5060265e-8e68-41ae-a57c-b1df5f0cc724 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/0d5dd84a-5c19-4af9-bd05-c95d93da0069" status: 200 len: 1367 microversion: 2.1 time: 0.633759 Sep 23 05:05:59.571431 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3242/6311] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:05:58 2022] GET /compute/v2.1/servers/0d5dd84a-5c19-4af9-bd05-c95d93da0069 => generated 1367 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:05:59.626063 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-a87b0986-8920-4e05-b5ef-8ae418e38e7d req-d03319f6-b535-4e14-b084-b858b2a4ed3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44b4cfe5-2174-4dcb-ab59-4b7bdaf6d4ff", "name": "network-vif-plugged", "status": "completed", "tag": "e9853be9-f62c-43e9-805e-80b2fe61ab14"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:05:59.646919 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-a87b0986-8920-4e05-b5ef-8ae418e38e7d req-d03319f6-b535-4e14-b084-b858b2a4ed3d service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:05:59.649276 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-a87b0986-8920-4e05-b5ef-8ae418e38e7d req-d03319f6-b535-4e14-b084-b858b2a4ed3d service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:05:59.650922 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-a87b0986-8920-4e05-b5ef-8ae418e38e7d req-d03319f6-b535-4e14-b084-b858b2a4ed3d service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:05:59.688358 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-a87b0986-8920-4e05-b5ef-8ae418e38e7d req-d03319f6-b535-4e14-b084-b858b2a4ed3d service nova] Creating event network-vif-plugged:e9853be9-f62c-43e9-805e-80b2fe61ab14 for instance 44b4cfe5-2174-4dcb-ab59-4b7bdaf6d4ff on n-h2-846463-3 Sep 23 05:05:59.701341 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-a87b0986-8920-4e05-b5ef-8ae418e38e7d req-d03319f6-b535-4e14-b084-b858b2a4ed3d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081524 Sep 23 05:05:59.704675 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3070/6312] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:05:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:06:00.585578 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-00d2001a-79d3-4c35-9538-86e557ec4523 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:06:00.587992 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-00d2001a-79d3-4c35-9538-86e557ec4523 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] [instance: 44b4cfe5-2174-4dcb-ab59-4b7bdaf6d4ff] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:06:00.598116 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-00d2001a-79d3-4c35-9538-86e557ec4523 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:00.598628 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-00d2001a-79d3-4c35-9538-86e557ec4523 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:00.599072 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-00d2001a-79d3-4c35-9538-86e557ec4523 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:00.603376 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-00d2001a-79d3-4c35-9538-86e557ec4523 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:00.604107 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-00d2001a-79d3-4c35-9538-86e557ec4523 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:00.605635 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-00d2001a-79d3-4c35-9538-86e557ec4523 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:00.606682 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-cba4053c-791a-494c-9e73-d8cdafa1f852 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:06:00.608470 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-cba4053c-791a-494c-9e73-d8cdafa1f852 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 0d5dd84a-5c19-4af9-bd05-c95d93da0069] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:06:00.628483 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cba4053c-791a-494c-9e73-d8cdafa1f852 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:00.630935 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cba4053c-791a-494c-9e73-d8cdafa1f852 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:00.632534 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cba4053c-791a-494c-9e73-d8cdafa1f852 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:00.637408 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cba4053c-791a-494c-9e73-d8cdafa1f852 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:00.640680 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cba4053c-791a-494c-9e73-d8cdafa1f852 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:00.642262 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cba4053c-791a-494c-9e73-d8cdafa1f852 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:01.271586 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-00d2001a-79d3-4c35-9538-86e557ec4523 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e8ce1f6821424080453f994dbcd604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fefb9fd80184955a7856e1c41d081be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:06:01.288460 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-00d2001a-79d3-4c35-9538-86e557ec4523 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] 10.222.0.33 "GET /compute/v2.1/servers/44b4cfe5-2174-4dcb-ab59-4b7bdaf6d4ff" status: 200 len: 1372 microversion: 2.1 time: 0.707690 Sep 23 05:06:01.294038 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3243/6313] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:06:00 2022] GET /compute/v2.1/servers/44b4cfe5-2174-4dcb-ab59-4b7bdaf6d4ff => generated 1372 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:06:01.720510 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-cba4053c-791a-494c-9e73-d8cdafa1f852 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d90150ed7d477fab33129cb3b068ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daad67f26fe246d6b4d28cad1707a119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:06:01.731686 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-cba4053c-791a-494c-9e73-d8cdafa1f852 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/0d5dd84a-5c19-4af9-bd05-c95d93da0069" status: 200 len: 1367 microversion: 2.1 time: 1.132282 Sep 23 05:06:01.737230 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3071/6314] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:06:00 2022] GET /compute/v2.1/servers/0d5dd84a-5c19-4af9-bd05-c95d93da0069 => generated 1367 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:06:01.895997 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-ed657c68-7333-43fb-a991-6414f0982fab req-3163db6e-b173-4953-a694-990f3f1135f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d5dd84a-5c19-4af9-bd05-c95d93da0069", "name": "network-vif-plugged", "status": "completed", "tag": "5835071a-ff9e-4eb0-8397-f6d087882ded"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:06:01.918111 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-ed657c68-7333-43fb-a991-6414f0982fab req-3163db6e-b173-4953-a694-990f3f1135f4 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:01.918657 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-ed657c68-7333-43fb-a991-6414f0982fab req-3163db6e-b173-4953-a694-990f3f1135f4 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:01.921318 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-ed657c68-7333-43fb-a991-6414f0982fab req-3163db6e-b173-4953-a694-990f3f1135f4 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:01.946083 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-ed657c68-7333-43fb-a991-6414f0982fab req-3163db6e-b173-4953-a694-990f3f1135f4 service nova] Creating event network-vif-plugged:5835071a-ff9e-4eb0-8397-f6d087882ded for instance 0d5dd84a-5c19-4af9-bd05-c95d93da0069 on n-h2-846463-3 Sep 23 05:06:01.960226 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-ed657c68-7333-43fb-a991-6414f0982fab req-3163db6e-b173-4953-a694-990f3f1135f4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069185 Sep 23 05:06:01.961143 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3244/6315] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:06:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:06:02.279271 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e14f158d-56da-4c01-8aa7-839c0aec6b3b tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1860812235", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "baecf5bc-8eb5-4061-a65e-d929720ba659", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "4600129e-ae78-4842-a9e8-005f0a31ee9b"}]}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:06:02.313607 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-827040bf-e9f0-4879-81bd-2ea4563e6dee tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:06:02.314346 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-827040bf-e9f0-4879-81bd-2ea4563e6dee tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] [instance: 44b4cfe5-2174-4dcb-ab59-4b7bdaf6d4ff] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:06:02.321389 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-827040bf-e9f0-4879-81bd-2ea4563e6dee tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:02.321978 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-827040bf-e9f0-4879-81bd-2ea4563e6dee tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:02.342645 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-827040bf-e9f0-4879-81bd-2ea4563e6dee tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:02.357646 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-827040bf-e9f0-4879-81bd-2ea4563e6dee tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:02.357646 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-827040bf-e9f0-4879-81bd-2ea4563e6dee tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:02.357646 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-827040bf-e9f0-4879-81bd-2ea4563e6dee tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:02.565033 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.network.neutron [None req-e14f158d-56da-4c01-8aa7-839c0aec6b3b tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] validate_networks() for [('4600129e-ae78-4842-a9e8-005f0a31ee9b', None, None, None, None, None)] {{(pid=122698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 05:06:02.741212 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-827040bf-e9f0-4879-81bd-2ea4563e6dee tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e8ce1f6821424080453f994dbcd604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fefb9fd80184955a7856e1c41d081be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:06:02.745664 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=100 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:06:02.754760 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-827040bf-e9f0-4879-81bd-2ea4563e6dee tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] 10.222.0.33 "GET /compute/v2.1/servers/44b4cfe5-2174-4dcb-ab59-4b7bdaf6d4ff" status: 200 len: 1543 microversion: 2.1 time: 0.441855 Sep 23 05:06:02.756281 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3245/6316] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:06:02 2022] GET /compute/v2.1/servers/44b4cfe5-2174-4dcb-ab59-4b7bdaf6d4ff => generated 1543 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:06:02.765705 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-676621c4-9200-4f0e-9336-01ad74508b73 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:06:02.769371 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-676621c4-9200-4f0e-9336-01ad74508b73 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 0d5dd84a-5c19-4af9-bd05-c95d93da0069] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:06:02.783258 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-676621c4-9200-4f0e-9336-01ad74508b73 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:02.790473 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-676621c4-9200-4f0e-9336-01ad74508b73 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:02.790473 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-676621c4-9200-4f0e-9336-01ad74508b73 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:02.790473 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-676621c4-9200-4f0e-9336-01ad74508b73 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:02.790473 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-676621c4-9200-4f0e-9336-01ad74508b73 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:02.790473 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-676621c4-9200-4f0e-9336-01ad74508b73 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:03.066332 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-676621c4-9200-4f0e-9336-01ad74508b73 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d90150ed7d477fab33129cb3b068ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daad67f26fe246d6b4d28cad1707a119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:06:03.077142 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-676621c4-9200-4f0e-9336-01ad74508b73 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/0d5dd84a-5c19-4af9-bd05-c95d93da0069" status: 200 len: 1367 microversion: 2.1 time: 0.318712 Sep 23 05:06:03.093949 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3246/6317] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:06:02 2022] GET /compute/v2.1/servers/0d5dd84a-5c19-4af9-bd05-c95d93da0069 => generated 1367 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:06:03.093949 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4ed55f69-b67a-4278-bbf1-629a7c34f314 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:06:03.093949 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4ed55f69-b67a-4278-bbf1-629a7c34f314 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] [instance: 44b4cfe5-2174-4dcb-ab59-4b7bdaf6d4ff] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:06:03.096216 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4ed55f69-b67a-4278-bbf1-629a7c34f314 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:03.096989 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4ed55f69-b67a-4278-bbf1-629a7c34f314 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:03.097694 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4ed55f69-b67a-4278-bbf1-629a7c34f314 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:03.098760 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4ed55f69-b67a-4278-bbf1-629a7c34f314 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:03.099335 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4ed55f69-b67a-4278-bbf1-629a7c34f314 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:03.099874 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4ed55f69-b67a-4278-bbf1-629a7c34f314 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:03.411769 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-4ed55f69-b67a-4278-bbf1-629a7c34f314 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e8ce1f6821424080453f994dbcd604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fefb9fd80184955a7856e1c41d081be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:06:03.434683 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4ed55f69-b67a-4278-bbf1-629a7c34f314 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] 10.222.0.33 "GET /compute/v2.1/servers/44b4cfe5-2174-4dcb-ab59-4b7bdaf6d4ff" status: 200 len: 1543 microversion: 2.1 time: 0.351458 Sep 23 05:06:03.440992 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3247/6318] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:06:03 2022] GET /compute/v2.1/servers/44b4cfe5-2174-4dcb-ab59-4b7bdaf6d4ff => generated 1543 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:06:03.513658 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-e14f158d-56da-4c01-8aa7-839c0aec6b3b tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Flavor limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 05:06:03.514836 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-e14f158d-56da-4c01-8aa7-839c0aec6b3b tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Image limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 05:06:03.515400 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-e14f158d-56da-4c01-8aa7-839c0aec6b3b tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Flavor pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 05:06:03.516063 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-e14f158d-56da-4c01-8aa7-839c0aec6b3b tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Image pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 05:06:03.516731 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-e14f158d-56da-4c01-8aa7-839c0aec6b3b tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 05:06:03.531495 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e14f158d-56da-4c01-8aa7-839c0aec6b3b tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:03.533655 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e14f158d-56da-4c01-8aa7-839c0aec6b3b tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:03.534380 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e14f158d-56da-4c01-8aa7-839c0aec6b3b tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:03.537245 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e14f158d-56da-4c01-8aa7-839c0aec6b3b tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:03.556585 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e14f158d-56da-4c01-8aa7-839c0aec6b3b tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:03.557267 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e14f158d-56da-4c01-8aa7-839c0aec6b3b tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:03.599854 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-e14f158d-56da-4c01-8aa7-839c0aec6b3b tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Getting quotas for project cceaa1e24146497fbf3f79cebc112211. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 05:06:03.609278 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-e14f158d-56da-4c01-8aa7-839c0aec6b3b tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Getting quotas for user 0d55fe5072c14752846eb4ffc0eef91b and project cceaa1e24146497fbf3f79cebc112211. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 05:06:03.632483 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e14f158d-56da-4c01-8aa7-839c0aec6b3b tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Going to run 1 instances... {{(pid=122698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 05:06:03.637045 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e14f158d-56da-4c01-8aa7-839c0aec6b3b tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 907407f9-5788-487a-80aa-0782bd4230a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='baecf5bc-8eb5-4061-a65e-d929720ba659',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 05:06:03.878469 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e14f158d-56da-4c01-8aa7-839c0aec6b3b tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.602563 Sep 23 05:06:03.880208 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3072/6319] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 05:06:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1605 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 05:06:03.894756 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-bee2be74-22e2-482d-a593-e428da20441a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:06:03.895391 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-bee2be74-22e2-482d-a593-e428da20441a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 907407f9-5788-487a-80aa-0782bd4230a5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:06:04.020699 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-bee2be74-22e2-482d-a593-e428da20441a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:06:04.031213 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-bee2be74-22e2-482d-a593-e428da20441a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5" status: 200 len: 1057 microversion: 2.1 time: 0.143471 Sep 23 05:06:04.032207 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3248/6320] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:06:03 2022] GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5 => generated 1057 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:06:04.105945 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-cdede0f7-ec08-4806-8069-ac6e4419d311 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:06:04.107412 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-cdede0f7-ec08-4806-8069-ac6e4419d311 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 0d5dd84a-5c19-4af9-bd05-c95d93da0069] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:06:04.121360 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cdede0f7-ec08-4806-8069-ac6e4419d311 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:04.122262 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cdede0f7-ec08-4806-8069-ac6e4419d311 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:04.122922 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cdede0f7-ec08-4806-8069-ac6e4419d311 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:04.123885 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cdede0f7-ec08-4806-8069-ac6e4419d311 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:04.124569 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cdede0f7-ec08-4806-8069-ac6e4419d311 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:04.125209 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cdede0f7-ec08-4806-8069-ac6e4419d311 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:04.448359 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-cdede0f7-ec08-4806-8069-ac6e4419d311 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d90150ed7d477fab33129cb3b068ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daad67f26fe246d6b4d28cad1707a119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:06:04.479128 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-cdede0f7-ec08-4806-8069-ac6e4419d311 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/0d5dd84a-5c19-4af9-bd05-c95d93da0069" status: 200 len: 1556 microversion: 2.1 time: 0.374452 Sep 23 05:06:04.479128 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3073/6321] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:06:04 2022] GET /compute/v2.1/servers/0d5dd84a-5c19-4af9-bd05-c95d93da0069 => generated 1556 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:06:04.501950 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-72f7913d-cf1e-4b3f-8708-2b5ef3cf829f tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:06:04.503455 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-72f7913d-cf1e-4b3f-8708-2b5ef3cf829f tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 0d5dd84a-5c19-4af9-bd05-c95d93da0069] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:06:04.511150 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-72f7913d-cf1e-4b3f-8708-2b5ef3cf829f tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:04.511963 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-72f7913d-cf1e-4b3f-8708-2b5ef3cf829f tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:04.512601 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-72f7913d-cf1e-4b3f-8708-2b5ef3cf829f tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:04.513512 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-72f7913d-cf1e-4b3f-8708-2b5ef3cf829f tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:04.514662 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-72f7913d-cf1e-4b3f-8708-2b5ef3cf829f tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:04.515230 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-72f7913d-cf1e-4b3f-8708-2b5ef3cf829f tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:04.667068 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-72f7913d-cf1e-4b3f-8708-2b5ef3cf829f tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/0d5dd84a-5c19-4af9-bd05-c95d93da0069/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.170489 Sep 23 05:06:04.668318 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3249/6322] 10.222.0.33 () {58 vars in 1275 bytes} [Fri Sep 23 05:06:04 2022] GET /compute/v2.1/servers/0d5dd84a-5c19-4af9-bd05-c95d93da0069/os-interface => generated 284 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:06:05.055498 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-90def49e-dca0-4ad9-a152-12d89c90a435 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:06:05.056344 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-90def49e-dca0-4ad9-a152-12d89c90a435 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 907407f9-5788-487a-80aa-0782bd4230a5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:06:05.229875 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-90def49e-dca0-4ad9-a152-12d89c90a435 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:06:05.244162 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-90def49e-dca0-4ad9-a152-12d89c90a435 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5" status: 200 len: 1057 microversion: 2.1 time: 0.193891 Sep 23 05:06:05.269550 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3074/6323] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:06:05 2022] GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5 => generated 1057 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:06:06.277026 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-cf09200d-de4d-4f05-9092-3bf4b2dccfdb tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:06:06.277933 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-cf09200d-de4d-4f05-9092-3bf4b2dccfdb tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 907407f9-5788-487a-80aa-0782bd4230a5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:06:06.293240 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cf09200d-de4d-4f05-9092-3bf4b2dccfdb tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:06.294142 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cf09200d-de4d-4f05-9092-3bf4b2dccfdb tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:06.295850 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cf09200d-de4d-4f05-9092-3bf4b2dccfdb tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:06.299057 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cf09200d-de4d-4f05-9092-3bf4b2dccfdb tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:06.299832 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cf09200d-de4d-4f05-9092-3bf4b2dccfdb tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:06.301201 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cf09200d-de4d-4f05-9092-3bf4b2dccfdb tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:06.851096 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-cf09200d-de4d-4f05-9092-3bf4b2dccfdb tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:06:06.861905 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-cf09200d-de4d-4f05-9092-3bf4b2dccfdb tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5" status: 200 len: 1109 microversion: 2.1 time: 0.592812 Sep 23 05:06:06.874265 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3250/6324] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:06:06 2022] GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5 => generated 1109 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:06:07.897387 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f0a3abcf-0a60-429c-a99f-b4cf33795473 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:06:07.897387 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f0a3abcf-0a60-429c-a99f-b4cf33795473 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 907407f9-5788-487a-80aa-0782bd4230a5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:06:07.914922 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f0a3abcf-0a60-429c-a99f-b4cf33795473 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:07.917610 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f0a3abcf-0a60-429c-a99f-b4cf33795473 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:07.919387 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f0a3abcf-0a60-429c-a99f-b4cf33795473 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:07.942209 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f0a3abcf-0a60-429c-a99f-b4cf33795473 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:07.942209 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f0a3abcf-0a60-429c-a99f-b4cf33795473 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:07.942209 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f0a3abcf-0a60-429c-a99f-b4cf33795473 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:08.163136 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f0a3abcf-0a60-429c-a99f-b4cf33795473 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:06:08.172899 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f0a3abcf-0a60-429c-a99f-b4cf33795473 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5" status: 200 len: 1127 microversion: 2.1 time: 0.281239 Sep 23 05:06:08.179357 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3075/6325] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:06:07 2022] GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5 => generated 1127 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:06:08.972200 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-b6cc3577-402c-42f2-aae5-5616c84f0802 req-2b65fe35-dc2e-4a5b-996d-6a0ebca0bd13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d5dd84a-5c19-4af9-bd05-c95d93da0069", "tag": "5835071a-ff9e-4eb0-8397-f6d087882ded"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:06:09.003770 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-b6cc3577-402c-42f2-aae5-5616c84f0802 req-2b65fe35-dc2e-4a5b-996d-6a0ebca0bd13 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:09.004531 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-b6cc3577-402c-42f2-aae5-5616c84f0802 req-2b65fe35-dc2e-4a5b-996d-6a0ebca0bd13 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:09.025084 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-b6cc3577-402c-42f2-aae5-5616c84f0802 req-2b65fe35-dc2e-4a5b-996d-6a0ebca0bd13 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:09.065935 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-b6cc3577-402c-42f2-aae5-5616c84f0802 req-2b65fe35-dc2e-4a5b-996d-6a0ebca0bd13 service nova] Creating event network-changed:5835071a-ff9e-4eb0-8397-f6d087882ded for instance 0d5dd84a-5c19-4af9-bd05-c95d93da0069 on n-h2-846463-3 Sep 23 05:06:09.073565 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-b6cc3577-402c-42f2-aae5-5616c84f0802 req-2b65fe35-dc2e-4a5b-996d-6a0ebca0bd13 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107500 Sep 23 05:06:09.076308 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3251/6326] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:06:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:06:09.203332 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d32c674d-c071-40ec-9e96-5cd1a2324714 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:06:09.203959 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d32c674d-c071-40ec-9e96-5cd1a2324714 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 907407f9-5788-487a-80aa-0782bd4230a5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:06:09.211112 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=9 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:06:09.217007 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d32c674d-c071-40ec-9e96-5cd1a2324714 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:09.218422 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d32c674d-c071-40ec-9e96-5cd1a2324714 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:09.221697 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d32c674d-c071-40ec-9e96-5cd1a2324714 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:09.222706 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d32c674d-c071-40ec-9e96-5cd1a2324714 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:09.223364 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d32c674d-c071-40ec-9e96-5cd1a2324714 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:09.227149 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d32c674d-c071-40ec-9e96-5cd1a2324714 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:09.937550 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d32c674d-c071-40ec-9e96-5cd1a2324714 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:06:09.954589 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d32c674d-c071-40ec-9e96-5cd1a2324714 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5" status: 200 len: 1169 microversion: 2.1 time: 0.748733 Sep 23 05:06:09.960991 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3076/6327] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:06:09 2022] GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5 => generated 1169 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:06:10.981224 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-06abfd43-c538-48aa-adc7-86a9ff60150e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:06:10.982603 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-06abfd43-c538-48aa-adc7-86a9ff60150e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 907407f9-5788-487a-80aa-0782bd4230a5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:06:11.006003 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-06abfd43-c538-48aa-adc7-86a9ff60150e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:11.006794 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-06abfd43-c538-48aa-adc7-86a9ff60150e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:11.010706 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-06abfd43-c538-48aa-adc7-86a9ff60150e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:11.013188 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-06abfd43-c538-48aa-adc7-86a9ff60150e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:11.013681 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-06abfd43-c538-48aa-adc7-86a9ff60150e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:11.014152 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-06abfd43-c538-48aa-adc7-86a9ff60150e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:11.646158 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-06abfd43-c538-48aa-adc7-86a9ff60150e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:06:11.658039 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-06abfd43-c538-48aa-adc7-86a9ff60150e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5" status: 200 len: 1169 microversion: 2.1 time: 0.682943 Sep 23 05:06:11.676826 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3252/6328] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:06:10 2022] GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5 => generated 1169 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:06:12.684138 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c8a73fc4-eddb-4778-9e02-17dacce92920 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:06:12.685922 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c8a73fc4-eddb-4778-9e02-17dacce92920 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 907407f9-5788-487a-80aa-0782bd4230a5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:06:12.711819 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c8a73fc4-eddb-4778-9e02-17dacce92920 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:12.712327 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c8a73fc4-eddb-4778-9e02-17dacce92920 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:12.712773 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c8a73fc4-eddb-4778-9e02-17dacce92920 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:12.713495 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c8a73fc4-eddb-4778-9e02-17dacce92920 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:12.713985 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c8a73fc4-eddb-4778-9e02-17dacce92920 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:12.714422 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c8a73fc4-eddb-4778-9e02-17dacce92920 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:13.259363 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c8a73fc4-eddb-4778-9e02-17dacce92920 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:06:13.271265 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c8a73fc4-eddb-4778-9e02-17dacce92920 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5" status: 200 len: 1169 microversion: 2.1 time: 0.593673 Sep 23 05:06:13.272597 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3077/6329] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:06:12 2022] GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5 => generated 1169 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:06:14.300627 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-eeaceae3-4a03-4bee-b086-e2ac7335bce1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:06:14.301850 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-eeaceae3-4a03-4bee-b086-e2ac7335bce1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 907407f9-5788-487a-80aa-0782bd4230a5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:06:14.304371 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:06:14.310017 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eeaceae3-4a03-4bee-b086-e2ac7335bce1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:14.310524 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eeaceae3-4a03-4bee-b086-e2ac7335bce1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:14.310967 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eeaceae3-4a03-4bee-b086-e2ac7335bce1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:14.311677 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eeaceae3-4a03-4bee-b086-e2ac7335bce1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:14.312134 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eeaceae3-4a03-4bee-b086-e2ac7335bce1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:14.312569 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eeaceae3-4a03-4bee-b086-e2ac7335bce1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:14.430234 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-bfc53448-a82b-4141-8054-7277f275ef20 req-c3d7df7d-66ed-4815-89a5-8a15db3fbf16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "907407f9-5788-487a-80aa-0782bd4230a5", "tag": "f3bf0e41-8570-4941-85cf-568159f808b9"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:06:14.472417 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:06:14.485398 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-bfc53448-a82b-4141-8054-7277f275ef20 req-c3d7df7d-66ed-4815-89a5-8a15db3fbf16 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:14.485919 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-bfc53448-a82b-4141-8054-7277f275ef20 req-c3d7df7d-66ed-4815-89a5-8a15db3fbf16 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:14.494817 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-bfc53448-a82b-4141-8054-7277f275ef20 req-c3d7df7d-66ed-4815-89a5-8a15db3fbf16 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:14.518654 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=100 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:06:14.562043 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-bfc53448-a82b-4141-8054-7277f275ef20 req-c3d7df7d-66ed-4815-89a5-8a15db3fbf16 service nova] Creating event network-changed:f3bf0e41-8570-4941-85cf-568159f808b9 for instance 907407f9-5788-487a-80aa-0782bd4230a5 on n-h1-846463-3 Sep 23 05:06:14.583357 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-bfc53448-a82b-4141-8054-7277f275ef20 req-c3d7df7d-66ed-4815-89a5-8a15db3fbf16 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.163530 Sep 23 05:06:14.584568 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3078/6330] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:06:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:06:15.690513 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-eeaceae3-4a03-4bee-b086-e2ac7335bce1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:06:15.704544 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-eeaceae3-4a03-4bee-b086-e2ac7335bce1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5" status: 200 len: 1169 microversion: 2.1 time: 1.407675 Sep 23 05:06:15.719415 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3253/6331] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:06:14 2022] GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5 => generated 1169 bytes in 1414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:06:16.735284 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9090bfb7-0ae0-41ee-8b15-b3cc4f9acbce tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:06:16.736550 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-9090bfb7-0ae0-41ee-8b15-b3cc4f9acbce tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 907407f9-5788-487a-80aa-0782bd4230a5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:06:16.745382 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=8 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:06:16.761836 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9090bfb7-0ae0-41ee-8b15-b3cc4f9acbce tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:16.764797 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9090bfb7-0ae0-41ee-8b15-b3cc4f9acbce tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:16.765445 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9090bfb7-0ae0-41ee-8b15-b3cc4f9acbce tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:16.766586 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9090bfb7-0ae0-41ee-8b15-b3cc4f9acbce tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:16.768916 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9090bfb7-0ae0-41ee-8b15-b3cc4f9acbce tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:16.769842 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9090bfb7-0ae0-41ee-8b15-b3cc4f9acbce tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:16.984950 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-9090bfb7-0ae0-41ee-8b15-b3cc4f9acbce tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:06:16.996319 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9090bfb7-0ae0-41ee-8b15-b3cc4f9acbce tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5" status: 200 len: 1169 microversion: 2.1 time: 0.269922 Sep 23 05:06:17.011710 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3079/6332] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:06:16 2022] GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5 => generated 1169 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:06:18.026585 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-829ccdc5-ced1-49af-9032-b85ac0550487 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:06:18.028058 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-829ccdc5-ced1-49af-9032-b85ac0550487 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 907407f9-5788-487a-80aa-0782bd4230a5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:06:18.035652 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-829ccdc5-ced1-49af-9032-b85ac0550487 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:18.036154 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-829ccdc5-ced1-49af-9032-b85ac0550487 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:18.042120 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-829ccdc5-ced1-49af-9032-b85ac0550487 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:18.042120 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-829ccdc5-ced1-49af-9032-b85ac0550487 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:18.042120 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-829ccdc5-ced1-49af-9032-b85ac0550487 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:18.042120 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-829ccdc5-ced1-49af-9032-b85ac0550487 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:18.287998 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-829ccdc5-ced1-49af-9032-b85ac0550487 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:06:18.301629 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-829ccdc5-ced1-49af-9032-b85ac0550487 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5" status: 200 len: 1169 microversion: 2.1 time: 0.281296 Sep 23 05:06:18.303042 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3254/6333] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:06:18 2022] GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5 => generated 1169 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:06:19.327973 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d125393a-7efa-41a8-9469-402d04973c18 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:06:19.328521 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d125393a-7efa-41a8-9469-402d04973c18 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 907407f9-5788-487a-80aa-0782bd4230a5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:06:19.349210 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d125393a-7efa-41a8-9469-402d04973c18 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:19.352495 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d125393a-7efa-41a8-9469-402d04973c18 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:19.356048 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d125393a-7efa-41a8-9469-402d04973c18 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:19.357560 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d125393a-7efa-41a8-9469-402d04973c18 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:19.358572 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d125393a-7efa-41a8-9469-402d04973c18 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:19.359217 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d125393a-7efa-41a8-9469-402d04973c18 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:19.561932 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d125393a-7efa-41a8-9469-402d04973c18 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:06:19.572230 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d125393a-7efa-41a8-9469-402d04973c18 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5" status: 200 len: 1169 microversion: 2.1 time: 0.248908 Sep 23 05:06:19.582062 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3080/6334] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:06:19 2022] GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5 => generated 1169 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:06:20.597176 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-02c3d6d8-eae4-41ec-80aa-6f0a78f82c51 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:06:20.598479 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-02c3d6d8-eae4-41ec-80aa-6f0a78f82c51 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 907407f9-5788-487a-80aa-0782bd4230a5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:06:20.615175 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-02c3d6d8-eae4-41ec-80aa-6f0a78f82c51 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:20.615998 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-02c3d6d8-eae4-41ec-80aa-6f0a78f82c51 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:20.616810 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-02c3d6d8-eae4-41ec-80aa-6f0a78f82c51 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:20.617849 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-02c3d6d8-eae4-41ec-80aa-6f0a78f82c51 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:20.618533 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-02c3d6d8-eae4-41ec-80aa-6f0a78f82c51 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:20.619632 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-02c3d6d8-eae4-41ec-80aa-6f0a78f82c51 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:20.941654 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-02c3d6d8-eae4-41ec-80aa-6f0a78f82c51 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:06:20.955465 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-02c3d6d8-eae4-41ec-80aa-6f0a78f82c51 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5" status: 200 len: 1169 microversion: 2.1 time: 0.363813 Sep 23 05:06:20.965641 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3255/6335] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:06:20 2022] GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5 => generated 1169 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:06:21.987271 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e10ddffb-6c1c-4f36-bfcf-22b1953276da tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:06:21.988065 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e10ddffb-6c1c-4f36-bfcf-22b1953276da tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 907407f9-5788-487a-80aa-0782bd4230a5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:06:22.003841 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e10ddffb-6c1c-4f36-bfcf-22b1953276da tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:22.009969 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e10ddffb-6c1c-4f36-bfcf-22b1953276da tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:22.011250 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e10ddffb-6c1c-4f36-bfcf-22b1953276da tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:22.012361 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e10ddffb-6c1c-4f36-bfcf-22b1953276da tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:22.019599 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e10ddffb-6c1c-4f36-bfcf-22b1953276da tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:22.020139 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e10ddffb-6c1c-4f36-bfcf-22b1953276da tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:22.320245 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e10ddffb-6c1c-4f36-bfcf-22b1953276da tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:06:22.349217 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e10ddffb-6c1c-4f36-bfcf-22b1953276da tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5" status: 200 len: 1169 microversion: 2.1 time: 0.363595 Sep 23 05:06:22.349217 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3081/6336] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:06:21 2022] GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5 => generated 1169 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:06:23.370931 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c4bf5450-658c-4ef4-8c07-9691707a16e6 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:06:23.371801 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c4bf5450-658c-4ef4-8c07-9691707a16e6 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 907407f9-5788-487a-80aa-0782bd4230a5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:06:23.382752 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c4bf5450-658c-4ef4-8c07-9691707a16e6 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:23.383557 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c4bf5450-658c-4ef4-8c07-9691707a16e6 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:23.384198 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c4bf5450-658c-4ef4-8c07-9691707a16e6 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:23.384935 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c4bf5450-658c-4ef4-8c07-9691707a16e6 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:23.385382 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c4bf5450-658c-4ef4-8c07-9691707a16e6 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:23.386282 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c4bf5450-658c-4ef4-8c07-9691707a16e6 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:23.576962 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c4bf5450-658c-4ef4-8c07-9691707a16e6 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:06:23.593484 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c4bf5450-658c-4ef4-8c07-9691707a16e6 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5" status: 200 len: 1169 microversion: 2.1 time: 0.226428 Sep 23 05:06:23.597993 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3256/6337] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:06:23 2022] GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5 => generated 1169 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:06:24.636372 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ef961d29-5c85-4454-9371-986325ca2ed4 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:06:24.637719 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-ef961d29-5c85-4454-9371-986325ca2ed4 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 907407f9-5788-487a-80aa-0782bd4230a5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:06:24.652858 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ef961d29-5c85-4454-9371-986325ca2ed4 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:24.654202 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ef961d29-5c85-4454-9371-986325ca2ed4 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:24.656056 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ef961d29-5c85-4454-9371-986325ca2ed4 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:24.667891 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ef961d29-5c85-4454-9371-986325ca2ed4 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:24.670111 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ef961d29-5c85-4454-9371-986325ca2ed4 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:24.670965 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ef961d29-5c85-4454-9371-986325ca2ed4 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:24.985976 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ef961d29-5c85-4454-9371-986325ca2ed4 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:06:24.997247 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ef961d29-5c85-4454-9371-986325ca2ed4 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5" status: 200 len: 1169 microversion: 2.1 time: 0.378167 Sep 23 05:06:24.998030 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3082/6338] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:06:24 2022] GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5 => generated 1169 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:06:26.028072 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f14dd0a7-a666-453f-b34c-cbe97dbfc329 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:06:26.031778 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f14dd0a7-a666-453f-b34c-cbe97dbfc329 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 907407f9-5788-487a-80aa-0782bd4230a5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:06:26.053302 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f14dd0a7-a666-453f-b34c-cbe97dbfc329 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:26.053712 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f14dd0a7-a666-453f-b34c-cbe97dbfc329 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:26.055572 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f14dd0a7-a666-453f-b34c-cbe97dbfc329 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:26.059963 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f14dd0a7-a666-453f-b34c-cbe97dbfc329 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:26.059963 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f14dd0a7-a666-453f-b34c-cbe97dbfc329 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:26.059963 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f14dd0a7-a666-453f-b34c-cbe97dbfc329 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:26.399507 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f14dd0a7-a666-453f-b34c-cbe97dbfc329 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:06:26.414048 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f14dd0a7-a666-453f-b34c-cbe97dbfc329 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5" status: 200 len: 1169 microversion: 2.1 time: 0.391352 Sep 23 05:06:26.417247 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3257/6339] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:06:26 2022] GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5 => generated 1169 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:06:27.450042 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7cd22b99-6ff9-4ed9-b3b4-317c6a84cbd7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:06:27.450042 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7cd22b99-6ff9-4ed9-b3b4-317c6a84cbd7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 907407f9-5788-487a-80aa-0782bd4230a5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:06:27.473461 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7cd22b99-6ff9-4ed9-b3b4-317c6a84cbd7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:27.474489 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7cd22b99-6ff9-4ed9-b3b4-317c6a84cbd7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:27.475177 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7cd22b99-6ff9-4ed9-b3b4-317c6a84cbd7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:27.476882 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7cd22b99-6ff9-4ed9-b3b4-317c6a84cbd7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:27.477575 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7cd22b99-6ff9-4ed9-b3b4-317c6a84cbd7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:27.478736 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7cd22b99-6ff9-4ed9-b3b4-317c6a84cbd7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:27.708696 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-7cd22b99-6ff9-4ed9-b3b4-317c6a84cbd7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:06:27.731118 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7cd22b99-6ff9-4ed9-b3b4-317c6a84cbd7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5" status: 200 len: 1169 microversion: 2.1 time: 0.292727 Sep 23 05:06:27.732126 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3083/6340] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:06:27 2022] GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5 => generated 1169 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:06:28.753541 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7e88c7fc-5d0e-49de-a9c7-0b9179fefd65 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:06:28.756686 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-7e88c7fc-5d0e-49de-a9c7-0b9179fefd65 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 907407f9-5788-487a-80aa-0782bd4230a5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:06:28.783033 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7e88c7fc-5d0e-49de-a9c7-0b9179fefd65 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:28.785017 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7e88c7fc-5d0e-49de-a9c7-0b9179fefd65 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:28.785700 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7e88c7fc-5d0e-49de-a9c7-0b9179fefd65 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:28.790293 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7e88c7fc-5d0e-49de-a9c7-0b9179fefd65 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:28.790998 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7e88c7fc-5d0e-49de-a9c7-0b9179fefd65 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:28.791722 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7e88c7fc-5d0e-49de-a9c7-0b9179fefd65 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:29.096090 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-7e88c7fc-5d0e-49de-a9c7-0b9179fefd65 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:06:29.107287 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-7e88c7fc-5d0e-49de-a9c7-0b9179fefd65 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5" status: 200 len: 1169 microversion: 2.1 time: 0.357820 Sep 23 05:06:29.109997 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3258/6341] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:06:28 2022] GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5 => generated 1169 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:06:30.139355 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7ac68670-2013-4f0a-a873-dcdeca15f567 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:06:30.140850 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7ac68670-2013-4f0a-a873-dcdeca15f567 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 907407f9-5788-487a-80aa-0782bd4230a5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:06:30.148834 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7ac68670-2013-4f0a-a873-dcdeca15f567 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:30.149638 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7ac68670-2013-4f0a-a873-dcdeca15f567 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:30.150491 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7ac68670-2013-4f0a-a873-dcdeca15f567 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:30.151632 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7ac68670-2013-4f0a-a873-dcdeca15f567 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:30.152400 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7ac68670-2013-4f0a-a873-dcdeca15f567 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:30.153402 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7ac68670-2013-4f0a-a873-dcdeca15f567 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:30.550711 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-7ac68670-2013-4f0a-a873-dcdeca15f567 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:06:30.570838 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7ac68670-2013-4f0a-a873-dcdeca15f567 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5" status: 200 len: 1169 microversion: 2.1 time: 0.432104 Sep 23 05:06:30.571987 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3084/6342] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:06:30 2022] GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5 => generated 1169 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:06:31.543224 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3fe6a1a2-3168-4361-93c4-15d5afa3a1d4 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:06:31.544411 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-3fe6a1a2-3168-4361-93c4-15d5afa3a1d4 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] [instance: 44b4cfe5-2174-4dcb-ab59-4b7bdaf6d4ff] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:06:31.552419 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=40 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:06:31.554319 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3fe6a1a2-3168-4361-93c4-15d5afa3a1d4 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:31.554973 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3fe6a1a2-3168-4361-93c4-15d5afa3a1d4 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:31.556025 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3fe6a1a2-3168-4361-93c4-15d5afa3a1d4 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:31.559843 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3fe6a1a2-3168-4361-93c4-15d5afa3a1d4 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:31.559843 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3fe6a1a2-3168-4361-93c4-15d5afa3a1d4 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:31.559843 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3fe6a1a2-3168-4361-93c4-15d5afa3a1d4 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:31.596749 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a2d4d3c3-296b-4477-8fd0-abe1525c7315 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:06:31.598929 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-3fe6a1a2-3168-4361-93c4-15d5afa3a1d4 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] [instance: 44b4cfe5-2174-4dcb-ab59-4b7bdaf6d4ff] Going to try to terminate instance {{(pid=122699) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 05:06:31.599193 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a2d4d3c3-296b-4477-8fd0-abe1525c7315 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 907407f9-5788-487a-80aa-0782bd4230a5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:06:31.607908 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a2d4d3c3-296b-4477-8fd0-abe1525c7315 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:31.609370 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a2d4d3c3-296b-4477-8fd0-abe1525c7315 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:31.611253 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a2d4d3c3-296b-4477-8fd0-abe1525c7315 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:31.612242 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a2d4d3c3-296b-4477-8fd0-abe1525c7315 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:31.613000 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a2d4d3c3-296b-4477-8fd0-abe1525c7315 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:31.613633 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a2d4d3c3-296b-4477-8fd0-abe1525c7315 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:31.871036 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a2d4d3c3-296b-4477-8fd0-abe1525c7315 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:06:31.882403 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a2d4d3c3-296b-4477-8fd0-abe1525c7315 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5" status: 200 len: 1169 microversion: 2.1 time: 0.290224 Sep 23 05:06:31.883565 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3085/6343] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:06:31 2022] GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5 => generated 1169 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:06:32.273833 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3fe6a1a2-3168-4361-93c4-15d5afa3a1d4 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] 10.222.0.33 "DELETE /compute/v2.1/servers/44b4cfe5-2174-4dcb-ab59-4b7bdaf6d4ff" status: 204 len: 0 microversion: 2.1 time: 0.734685 Sep 23 05:06:32.274521 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3259/6344] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 05:06:31 2022] DELETE /compute/v2.1/servers/44b4cfe5-2174-4dcb-ab59-4b7bdaf6d4ff => generated 0 bytes in 737 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 05:06:32.283119 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c9d020c8-50b6-4886-94bd-1436378dea0c tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:06:32.283854 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c9d020c8-50b6-4886-94bd-1436378dea0c tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] [instance: 44b4cfe5-2174-4dcb-ab59-4b7bdaf6d4ff] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:06:32.310065 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c9d020c8-50b6-4886-94bd-1436378dea0c tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:32.314987 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c9d020c8-50b6-4886-94bd-1436378dea0c tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:32.315696 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c9d020c8-50b6-4886-94bd-1436378dea0c tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:32.316666 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c9d020c8-50b6-4886-94bd-1436378dea0c tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:32.317349 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c9d020c8-50b6-4886-94bd-1436378dea0c tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:32.333721 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c9d020c8-50b6-4886-94bd-1436378dea0c tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:32.621579 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c9d020c8-50b6-4886-94bd-1436378dea0c tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e8ce1f6821424080453f994dbcd604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fefb9fd80184955a7856e1c41d081be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:06:32.640988 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c9d020c8-50b6-4886-94bd-1436378dea0c tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] 10.222.0.33 "GET /compute/v2.1/servers/44b4cfe5-2174-4dcb-ab59-4b7bdaf6d4ff" status: 200 len: 1549 microversion: 2.1 time: 0.361306 Sep 23 05:06:32.660158 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3086/6345] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:06:32 2022] GET /compute/v2.1/servers/44b4cfe5-2174-4dcb-ab59-4b7bdaf6d4ff => generated 1549 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:06:32.909734 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4733e212-5c68-4001-b6bb-ec4552826714 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:06:32.911136 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4733e212-5c68-4001-b6bb-ec4552826714 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 907407f9-5788-487a-80aa-0782bd4230a5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:06:32.921029 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4733e212-5c68-4001-b6bb-ec4552826714 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:32.921757 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4733e212-5c68-4001-b6bb-ec4552826714 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:32.922392 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4733e212-5c68-4001-b6bb-ec4552826714 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:32.923382 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4733e212-5c68-4001-b6bb-ec4552826714 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:32.923903 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4733e212-5c68-4001-b6bb-ec4552826714 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:32.925312 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4733e212-5c68-4001-b6bb-ec4552826714 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:33.182896 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-4733e212-5c68-4001-b6bb-ec4552826714 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:06:33.194430 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4733e212-5c68-4001-b6bb-ec4552826714 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5" status: 200 len: 1169 microversion: 2.1 time: 0.288908 Sep 23 05:06:33.218485 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3260/6346] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:06:32 2022] GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5 => generated 1169 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:06:33.667940 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-133f460a-b4d3-45f5-aa74-9504035b1f93 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:06:33.670209 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-133f460a-b4d3-45f5-aa74-9504035b1f93 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] [instance: 44b4cfe5-2174-4dcb-ab59-4b7bdaf6d4ff] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:06:33.691967 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-133f460a-b4d3-45f5-aa74-9504035b1f93 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:33.694929 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-133f460a-b4d3-45f5-aa74-9504035b1f93 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:33.694929 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-133f460a-b4d3-45f5-aa74-9504035b1f93 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:33.695918 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-133f460a-b4d3-45f5-aa74-9504035b1f93 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:33.700767 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-133f460a-b4d3-45f5-aa74-9504035b1f93 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:33.701474 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-133f460a-b4d3-45f5-aa74-9504035b1f93 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:34.034370 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-133f460a-b4d3-45f5-aa74-9504035b1f93 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e8ce1f6821424080453f994dbcd604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fefb9fd80184955a7856e1c41d081be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:06:34.049176 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-133f460a-b4d3-45f5-aa74-9504035b1f93 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] 10.222.0.33 "GET /compute/v2.1/servers/44b4cfe5-2174-4dcb-ab59-4b7bdaf6d4ff" status: 200 len: 1549 microversion: 2.1 time: 0.385258 Sep 23 05:06:34.050436 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3087/6347] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:06:33 2022] GET /compute/v2.1/servers/44b4cfe5-2174-4dcb-ab59-4b7bdaf6d4ff => generated 1549 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:06:34.224663 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-286e64c1-e9ef-47d1-88ea-ca94f986d4d7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:06:34.226001 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-286e64c1-e9ef-47d1-88ea-ca94f986d4d7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 907407f9-5788-487a-80aa-0782bd4230a5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:06:34.238923 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-286e64c1-e9ef-47d1-88ea-ca94f986d4d7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:34.248268 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-286e64c1-e9ef-47d1-88ea-ca94f986d4d7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:34.249348 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-286e64c1-e9ef-47d1-88ea-ca94f986d4d7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:34.250648 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-286e64c1-e9ef-47d1-88ea-ca94f986d4d7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:34.251272 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-286e64c1-e9ef-47d1-88ea-ca94f986d4d7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:34.251844 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-286e64c1-e9ef-47d1-88ea-ca94f986d4d7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:34.264327 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:06:34.556853 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-286e64c1-e9ef-47d1-88ea-ca94f986d4d7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:06:34.586946 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-286e64c1-e9ef-47d1-88ea-ca94f986d4d7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5" status: 200 len: 1169 microversion: 2.1 time: 0.363616 Sep 23 05:06:34.616596 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3261/6348] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:06:34 2022] GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5 => generated 1169 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:06:35.074488 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-586a612d-39e4-4106-a4b8-93d9b989b374 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:06:35.074990 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-586a612d-39e4-4106-a4b8-93d9b989b374 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] [instance: 44b4cfe5-2174-4dcb-ab59-4b7bdaf6d4ff] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:06:35.096596 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-586a612d-39e4-4106-a4b8-93d9b989b374 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:35.097101 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-586a612d-39e4-4106-a4b8-93d9b989b374 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:35.097560 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-586a612d-39e4-4106-a4b8-93d9b989b374 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:35.098313 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-586a612d-39e4-4106-a4b8-93d9b989b374 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:35.098786 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-586a612d-39e4-4106-a4b8-93d9b989b374 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:35.099221 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-586a612d-39e4-4106-a4b8-93d9b989b374 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:35.251168 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-586a612d-39e4-4106-a4b8-93d9b989b374 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e8ce1f6821424080453f994dbcd604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fefb9fd80184955a7856e1c41d081be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:06:35.297755 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-aa2779ed-2c51-4537-b2e5-a6e23afdb8c2 req-07f328b5-edfb-4e83-9122-5e81c2cc0f9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44b4cfe5-2174-4dcb-ab59-4b7bdaf6d4ff", "name": "network-vif-deleted", "tag": "e9853be9-f62c-43e9-805e-80b2fe61ab14"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:06:35.331986 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-586a612d-39e4-4106-a4b8-93d9b989b374 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] 10.222.0.33 "GET /compute/v2.1/servers/44b4cfe5-2174-4dcb-ab59-4b7bdaf6d4ff" status: 200 len: 1482 microversion: 2.1 time: 0.261968 Sep 23 05:06:35.341387 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3088/6349] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:06:35 2022] GET /compute/v2.1/servers/44b4cfe5-2174-4dcb-ab59-4b7bdaf6d4ff => generated 1482 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:06:35.345102 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-aa2779ed-2c51-4537-b2e5-a6e23afdb8c2 req-07f328b5-edfb-4e83-9122-5e81c2cc0f9b service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:35.345584 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-aa2779ed-2c51-4537-b2e5-a6e23afdb8c2 req-07f328b5-edfb-4e83-9122-5e81c2cc0f9b service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:35.346083 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-aa2779ed-2c51-4537-b2e5-a6e23afdb8c2 req-07f328b5-edfb-4e83-9122-5e81c2cc0f9b service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:35.373417 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-aa2779ed-2c51-4537-b2e5-a6e23afdb8c2 req-07f328b5-edfb-4e83-9122-5e81c2cc0f9b service nova] Creating event network-vif-deleted:e9853be9-f62c-43e9-805e-80b2fe61ab14 for instance 44b4cfe5-2174-4dcb-ab59-4b7bdaf6d4ff on n-h2-846463-3 Sep 23 05:06:35.381155 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-aa2779ed-2c51-4537-b2e5-a6e23afdb8c2 req-07f328b5-edfb-4e83-9122-5e81c2cc0f9b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100939 Sep 23 05:06:35.383315 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3262/6350] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:06:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:06:35.643492 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c6ae2e36-e1e3-4c9f-a11b-47bea5bca1c4 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:06:35.644278 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c6ae2e36-e1e3-4c9f-a11b-47bea5bca1c4 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 907407f9-5788-487a-80aa-0782bd4230a5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:06:35.652845 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c6ae2e36-e1e3-4c9f-a11b-47bea5bca1c4 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:35.653355 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c6ae2e36-e1e3-4c9f-a11b-47bea5bca1c4 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:35.653797 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c6ae2e36-e1e3-4c9f-a11b-47bea5bca1c4 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:35.654546 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c6ae2e36-e1e3-4c9f-a11b-47bea5bca1c4 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:35.655180 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c6ae2e36-e1e3-4c9f-a11b-47bea5bca1c4 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:35.655613 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c6ae2e36-e1e3-4c9f-a11b-47bea5bca1c4 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:35.840866 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c6ae2e36-e1e3-4c9f-a11b-47bea5bca1c4 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:06:35.854549 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c6ae2e36-e1e3-4c9f-a11b-47bea5bca1c4 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5" status: 200 len: 1169 microversion: 2.1 time: 0.215028 Sep 23 05:06:35.864998 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3089/6351] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:06:35 2022] GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5 => generated 1169 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:06:36.363817 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6c5bcb82-abf5-4bc9-9d9f-8227b4fc035f tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:06:36.365351 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-6c5bcb82-abf5-4bc9-9d9f-8227b4fc035f tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] [instance: 44b4cfe5-2174-4dcb-ab59-4b7bdaf6d4ff] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:06:36.393670 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6c5bcb82-abf5-4bc9-9d9f-8227b4fc035f tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:36.396586 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6c5bcb82-abf5-4bc9-9d9f-8227b4fc035f tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:36.397650 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6c5bcb82-abf5-4bc9-9d9f-8227b4fc035f tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:36.398748 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6c5bcb82-abf5-4bc9-9d9f-8227b4fc035f tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:36.408592 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6c5bcb82-abf5-4bc9-9d9f-8227b4fc035f tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:36.423721 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6c5bcb82-abf5-4bc9-9d9f-8227b4fc035f tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:36.461962 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6c5bcb82-abf5-4bc9-9d9f-8227b4fc035f tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:36.462552 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6c5bcb82-abf5-4bc9-9d9f-8227b4fc035f tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:36.463014 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6c5bcb82-abf5-4bc9-9d9f-8227b4fc035f tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:36.463603 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-6c5bcb82-abf5-4bc9-9d9f-8227b4fc035f tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lazy-loading 'fault' on Instance uuid 44b4cfe5-2174-4dcb-ab59-4b7bdaf6d4ff {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 05:06:36.536958 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-6c5bcb82-abf5-4bc9-9d9f-8227b4fc035f tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e8ce1f6821424080453f994dbcd604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fefb9fd80184955a7856e1c41d081be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:06:36.546719 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6c5bcb82-abf5-4bc9-9d9f-8227b4fc035f tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] 10.222.0.33 "GET /compute/v2.1/servers/44b4cfe5-2174-4dcb-ab59-4b7bdaf6d4ff" status: 200 len: 1337 microversion: 2.1 time: 0.187926 Sep 23 05:06:36.547309 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3263/6352] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:06:36 2022] GET /compute/v2.1/servers/44b4cfe5-2174-4dcb-ab59-4b7bdaf6d4ff => generated 1337 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:06:36.878166 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-531e33f3-7ead-414e-81a7-013ba09a6b40 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:06:36.879722 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-531e33f3-7ead-414e-81a7-013ba09a6b40 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 907407f9-5788-487a-80aa-0782bd4230a5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:06:36.893628 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-531e33f3-7ead-414e-81a7-013ba09a6b40 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:36.894501 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-531e33f3-7ead-414e-81a7-013ba09a6b40 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:36.895435 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-531e33f3-7ead-414e-81a7-013ba09a6b40 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:36.896622 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-531e33f3-7ead-414e-81a7-013ba09a6b40 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:36.898190 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-531e33f3-7ead-414e-81a7-013ba09a6b40 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:36.899832 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-531e33f3-7ead-414e-81a7-013ba09a6b40 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:37.554091 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-531e33f3-7ead-414e-81a7-013ba09a6b40 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:06:37.563537 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-531e33f3-7ead-414e-81a7-013ba09a6b40 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5" status: 200 len: 1169 microversion: 2.1 time: 0.690139 Sep 23 05:06:37.571682 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a511004b-ac3c-4de7-93c0-48c263004e8e tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:06:37.572454 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a511004b-ac3c-4de7-93c0-48c263004e8e tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] [instance: 44b4cfe5-2174-4dcb-ab59-4b7bdaf6d4ff] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:06:37.578267 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3090/6353] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:06:36 2022] GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5 => generated 1169 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:06:37.586374 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a511004b-ac3c-4de7-93c0-48c263004e8e tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:37.587023 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a511004b-ac3c-4de7-93c0-48c263004e8e tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:37.587804 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a511004b-ac3c-4de7-93c0-48c263004e8e tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:37.589323 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a511004b-ac3c-4de7-93c0-48c263004e8e tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:37.589915 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a511004b-ac3c-4de7-93c0-48c263004e8e tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:37.592402 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a511004b-ac3c-4de7-93c0-48c263004e8e tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:37.638169 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-a511004b-ac3c-4de7-93c0-48c263004e8e tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] HTTP exception thrown: Instance 44b4cfe5-2174-4dcb-ab59-4b7bdaf6d4ff could not be found. Sep 23 05:06:37.646136 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a511004b-ac3c-4de7-93c0-48c263004e8e tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Request method failure captured: Sep 23 05:06:37.646136 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/44b4cfe5-2174-4dcb-ab59-4b7bdaf6d4ff HTTP/1.1 Sep 23 05:06:37.646136 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 05:06:37.646136 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 05:06:37.646136 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 05:06:37.646136 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 05:06:37.646136 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 05:06:37.646136 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 05:06:37.646136 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 05:06:37.646136 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 05:06:37.646136 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLT4jjbkkyDoZWHfPR1V0ShIocEZsrsl9xhOl39rTPs2JfkhWYUIQ1QBstT_UDtJPYbFOkCdWqhVVT4oPil_cmn0Gon-JSdsMVZWBhquD_JTT_sM242Gl5m-9DFc-8J1dr0llZqGhhH-M6_yAF2mLvUsCDZpXw0h-uybxfIrmdII4ntk Sep 23 05:06:37.646136 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 05:06:37.646136 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 05:06:37.646136 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 05:06:37.646136 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 05:06:37.646136 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 05:06:37.646136 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 05:06:37.646136 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 5fefb9fd80184955a7856e1c41d081be Sep 23 05:06:37.646136 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-TestNetworkBasicOps-560522400 Sep 23 05:06:37.646136 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 05:06:37.646136 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 05:06:37.646136 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5fefb9fd80184955a7856e1c41d081be", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5fefb9fd80184955a7856e1c41d081be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5fefb9fd80184955a7856e1c41d081be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5fefb9fd80184955a7856e1c41d081be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:06:37.646136 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-TestNetworkBasicOps-560522400 Sep 23 05:06:37.646136 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 5fefb9fd80184955a7856e1c41d081be Sep 23 05:06:37.646136 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-TestNetworkBasicOps-560522400 Sep 23 05:06:37.646136 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-TestNetworkBasicOps-560522400-project Sep 23 05:06:37.646136 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 05:06:37.646136 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 05:06:37.646136 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: b3e8ce1f6821424080453f994dbcd604 Sep 23 05:06:37.646136 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-TestNetworkBasicOps-560522400-project Sep 23 05:06:37.646136 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 05:06:37.646136 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 44b4cfe5-2174-4dcb-ab59-4b7bdaf6d4ff could not be found. Sep 23 05:06:37.646136 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '44b4cfe5-2174-4dcb-ab59-4b7bdaf6d4ff'} Sep 23 05:06:37.646136 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:06:37.646136 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:06:37.646136 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 05:06:37.646136 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 05:06:37.646136 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 05:06:37.646136 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 05:06:37.646136 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 05:06:37.646136 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 05:06:37.646136 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 05:06:37.646136 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 05:06:37.646136 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44b4cfe5-2174-4dcb-ab59-4b7bdaf6d4ff could not be found. Sep 23 05:06:37.646136 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:06:37.646136 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:06:37.646136 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:06:37.646136 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:06:37.646136 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:06:37.646136 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:06:37.646136 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:06:37.646136 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:06:37.646136 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:06:37.646136 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:06:37.646136 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 05:06:37.646136 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 05:06:37.646136 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 05:06:37.646136 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 05:06:37.646136 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 05:06:37.646136 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:06:37.646136 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44b4cfe5-2174-4dcb-ab59-4b7bdaf6d4ff could not be found. Sep 23 05:06:37.646136 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:06:37.646136 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:06:37.646136 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:06:37.651123 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:06:37.651123 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:06:37.651123 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:06:37.651123 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:06:37.651123 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:06:37.651123 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44b4cfe5-2174-4dcb-ab59-4b7bdaf6d4ff could not be found. Sep 23 05:06:37.651123 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:06:37.653931 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a511004b-ac3c-4de7-93c0-48c263004e8e tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Returning 404 to user: Instance 44b4cfe5-2174-4dcb-ab59-4b7bdaf6d4ff could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:06:37.655010 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a511004b-ac3c-4de7-93c0-48c263004e8e tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] 10.222.0.33 "GET /compute/v2.1/servers/44b4cfe5-2174-4dcb-ab59-4b7bdaf6d4ff" status: 404 len: 111 microversion: 2.1 time: 0.087578 Sep 23 05:06:37.656409 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3264/6354] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:06:37 2022] GET /compute/v2.1/servers/44b4cfe5-2174-4dcb-ab59-4b7bdaf6d4ff => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 05:06:38.047108 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9b729183-8190-41df-ae38-76336835c92b tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Calling method '.version_select at 0x7ff1c3e6f790>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:06:38.239684 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9b729183-8190-41df-ae38-76336835c92b tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-822294140" status: 202 len: 0 microversion: 2.1 time: 0.200292 Sep 23 05:06:38.242878 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3091/6355] 10.222.0.33 () {58 vars in 1254 bytes} [Fri Sep 23 05:06:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-822294140 => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 05:06:38.603777 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a7c7c9c1-07dd-474f-935e-d50e532ddb91 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:06:38.605120 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a7c7c9c1-07dd-474f-935e-d50e532ddb91 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 907407f9-5788-487a-80aa-0782bd4230a5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:06:38.619213 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a7c7c9c1-07dd-474f-935e-d50e532ddb91 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:38.620028 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a7c7c9c1-07dd-474f-935e-d50e532ddb91 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:38.621511 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a7c7c9c1-07dd-474f-935e-d50e532ddb91 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:38.623266 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a7c7c9c1-07dd-474f-935e-d50e532ddb91 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:38.624860 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a7c7c9c1-07dd-474f-935e-d50e532ddb91 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:38.625349 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a7c7c9c1-07dd-474f-935e-d50e532ddb91 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:39.269232 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a7c7c9c1-07dd-474f-935e-d50e532ddb91 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:06:39.269232 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a7c7c9c1-07dd-474f-935e-d50e532ddb91 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5" status: 200 len: 1169 microversion: 2.1 time: 0.622139 Sep 23 05:06:39.269232 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3265/6356] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:06:38 2022] GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5 => generated 1169 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:06:40.299114 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-42a7b258-141e-4b4f-91d0-1702ef53cb2c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:06:40.300029 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-42a7b258-141e-4b4f-91d0-1702ef53cb2c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 907407f9-5788-487a-80aa-0782bd4230a5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:06:40.313710 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-42a7b258-141e-4b4f-91d0-1702ef53cb2c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:40.317083 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-42a7b258-141e-4b4f-91d0-1702ef53cb2c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:40.317974 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-42a7b258-141e-4b4f-91d0-1702ef53cb2c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:40.319343 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-42a7b258-141e-4b4f-91d0-1702ef53cb2c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:40.320007 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-42a7b258-141e-4b4f-91d0-1702ef53cb2c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:40.321114 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-42a7b258-141e-4b4f-91d0-1702ef53cb2c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:40.619189 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-42a7b258-141e-4b4f-91d0-1702ef53cb2c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:06:40.633174 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-42a7b258-141e-4b4f-91d0-1702ef53cb2c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5" status: 200 len: 1169 microversion: 2.1 time: 0.337301 Sep 23 05:06:40.634598 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3092/6357] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:06:40 2022] GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5 => generated 1169 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:06:41.661201 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1d615f1e-af9c-438e-9076-34c89560a51a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:06:41.662253 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1d615f1e-af9c-438e-9076-34c89560a51a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 907407f9-5788-487a-80aa-0782bd4230a5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:06:41.673041 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1d615f1e-af9c-438e-9076-34c89560a51a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:41.673969 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1d615f1e-af9c-438e-9076-34c89560a51a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:41.676428 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1d615f1e-af9c-438e-9076-34c89560a51a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:41.676428 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1d615f1e-af9c-438e-9076-34c89560a51a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:41.676428 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1d615f1e-af9c-438e-9076-34c89560a51a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:41.677085 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1d615f1e-af9c-438e-9076-34c89560a51a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:42.138387 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1d615f1e-af9c-438e-9076-34c89560a51a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:06:42.147277 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1d615f1e-af9c-438e-9076-34c89560a51a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5" status: 200 len: 1169 microversion: 2.1 time: 0.491820 Sep 23 05:06:42.147864 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3266/6358] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:06:41 2022] GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5 => generated 1169 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:06:43.061635 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8ebb0113-2fb3-40dd-bac3-cdfec046df06 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:06:43.064350 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8ebb0113-2fb3-40dd-bac3-cdfec046df06 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 0d5dd84a-5c19-4af9-bd05-c95d93da0069] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:06:43.077265 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d25b6fc9-ffb7-450b-a70d-188ed855b291 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:06:43.077776 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d25b6fc9-ffb7-450b-a70d-188ed855b291 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] [instance: 8f9812de-fd1b-49c4-b6de-8f5147f05c89] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:06:43.082162 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=35,nova_api:DELETE=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:06:43.089000 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8ebb0113-2fb3-40dd-bac3-cdfec046df06 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:43.089364 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8ebb0113-2fb3-40dd-bac3-cdfec046df06 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:43.090695 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d25b6fc9-ffb7-450b-a70d-188ed855b291 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:43.092653 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d25b6fc9-ffb7-450b-a70d-188ed855b291 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:43.092803 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8ebb0113-2fb3-40dd-bac3-cdfec046df06 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:43.094636 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d25b6fc9-ffb7-450b-a70d-188ed855b291 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:43.094820 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8ebb0113-2fb3-40dd-bac3-cdfec046df06 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:43.095813 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d25b6fc9-ffb7-450b-a70d-188ed855b291 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:43.096180 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d25b6fc9-ffb7-450b-a70d-188ed855b291 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:43.096955 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8ebb0113-2fb3-40dd-bac3-cdfec046df06 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:43.098850 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d25b6fc9-ffb7-450b-a70d-188ed855b291 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:43.100622 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8ebb0113-2fb3-40dd-bac3-cdfec046df06 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:43.150176 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8ebb0113-2fb3-40dd-bac3-cdfec046df06 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/0d5dd84a-5c19-4af9-bd05-c95d93da0069/ips" status: 200 len: 149 microversion: 2.1 time: 0.118667 Sep 23 05:06:43.157510 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d25b6fc9-ffb7-450b-a70d-188ed855b291 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] [instance: 8f9812de-fd1b-49c4-b6de-8f5147f05c89] Going to try to terminate instance {{(pid=122699) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 05:06:43.158493 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3093/6359] 10.222.0.33 () {58 vars in 1248 bytes} [Fri Sep 23 05:06:43 2022] GET /compute/v2.1/servers/0d5dd84a-5c19-4af9-bd05-c95d93da0069/ips => generated 149 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:06:43.169383 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-2142ac7e-a8e6-4586-8ecb-fec7e3f1b86b req-2f7457ad-7eba-44d2-baf0-79009c5da89e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f9812de-fd1b-49c4-b6de-8f5147f05c89", "tag": "8869d70a-7591-4bb3-9139-d911ff4a1324"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:06:43.178020 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-2142ac7e-a8e6-4586-8ecb-fec7e3f1b86b req-2f7457ad-7eba-44d2-baf0-79009c5da89e service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:43.178619 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-2142ac7e-a8e6-4586-8ecb-fec7e3f1b86b req-2f7457ad-7eba-44d2-baf0-79009c5da89e service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:43.179182 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-2142ac7e-a8e6-4586-8ecb-fec7e3f1b86b req-2f7457ad-7eba-44d2-baf0-79009c5da89e service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:43.196930 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-2142ac7e-a8e6-4586-8ecb-fec7e3f1b86b req-2f7457ad-7eba-44d2-baf0-79009c5da89e service nova] Creating event network-changed:8869d70a-7591-4bb3-9139-d911ff4a1324 for instance 8f9812de-fd1b-49c4-b6de-8f5147f05c89 on n-h2-846463-3 Sep 23 05:06:43.202920 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-2142ac7e-a8e6-4586-8ecb-fec7e3f1b86b req-2f7457ad-7eba-44d2-baf0-79009c5da89e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042765 Sep 23 05:06:43.207586 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3094/6360] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:06:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:06:43.215786 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4c0954d7-b6f7-4d68-8674-39c5324f0ea2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:06:43.216514 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4c0954d7-b6f7-4d68-8674-39c5324f0ea2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 907407f9-5788-487a-80aa-0782bd4230a5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:06:43.239114 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4c0954d7-b6f7-4d68-8674-39c5324f0ea2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:43.240716 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4c0954d7-b6f7-4d68-8674-39c5324f0ea2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:43.241112 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4c0954d7-b6f7-4d68-8674-39c5324f0ea2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:43.242269 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4c0954d7-b6f7-4d68-8674-39c5324f0ea2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:43.242880 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4c0954d7-b6f7-4d68-8674-39c5324f0ea2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:43.243328 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4c0954d7-b6f7-4d68-8674-39c5324f0ea2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:43.696614 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4c0954d7-b6f7-4d68-8674-39c5324f0ea2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:06:43.718410 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4c0954d7-b6f7-4d68-8674-39c5324f0ea2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5" status: 200 len: 1169 microversion: 2.1 time: 0.504194 Sep 23 05:06:43.719273 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3095/6361] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:06:43 2022] GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5 => generated 1169 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:06:43.734107 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d25b6fc9-ffb7-450b-a70d-188ed855b291 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] 10.222.0.33 "DELETE /compute/v2.1/servers/8f9812de-fd1b-49c4-b6de-8f5147f05c89" status: 204 len: 0 microversion: 2.1 time: 0.646513 Sep 23 05:06:43.735180 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3267/6362] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 05:06:43 2022] DELETE /compute/v2.1/servers/8f9812de-fd1b-49c4-b6de-8f5147f05c89 => generated 0 bytes in 663 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 05:06:43.755290 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-940ea002-8dcf-4cfa-abf3-576341aaf496 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:06:43.756408 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-940ea002-8dcf-4cfa-abf3-576341aaf496 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] [instance: 8f9812de-fd1b-49c4-b6de-8f5147f05c89] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:06:43.774227 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-940ea002-8dcf-4cfa-abf3-576341aaf496 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:43.779444 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-940ea002-8dcf-4cfa-abf3-576341aaf496 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:43.780040 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-940ea002-8dcf-4cfa-abf3-576341aaf496 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:43.781930 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-940ea002-8dcf-4cfa-abf3-576341aaf496 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:43.793727 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-940ea002-8dcf-4cfa-abf3-576341aaf496 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:43.796652 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-940ea002-8dcf-4cfa-abf3-576341aaf496 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:44.094114 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-940ea002-8dcf-4cfa-abf3-576341aaf496 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e8ce1f6821424080453f994dbcd604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fefb9fd80184955a7856e1c41d081be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:06:44.109368 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-940ea002-8dcf-4cfa-abf3-576341aaf496 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] 10.222.0.33 "GET /compute/v2.1/servers/8f9812de-fd1b-49c4-b6de-8f5147f05c89" status: 200 len: 1666 microversion: 2.1 time: 0.360051 Sep 23 05:06:44.110658 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3096/6363] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:06:43 2022] GET /compute/v2.1/servers/8f9812de-fd1b-49c4-b6de-8f5147f05c89 => generated 1666 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:06:44.753520 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6b85bd7e-2b4a-4876-9100-ecabfbb2a416 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:06:44.758439 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-6b85bd7e-2b4a-4876-9100-ecabfbb2a416 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 907407f9-5788-487a-80aa-0782bd4230a5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:06:44.778386 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6b85bd7e-2b4a-4876-9100-ecabfbb2a416 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:44.781156 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6b85bd7e-2b4a-4876-9100-ecabfbb2a416 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:44.781156 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6b85bd7e-2b4a-4876-9100-ecabfbb2a416 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:44.781156 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6b85bd7e-2b4a-4876-9100-ecabfbb2a416 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:44.791737 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6b85bd7e-2b4a-4876-9100-ecabfbb2a416 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:44.792252 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6b85bd7e-2b4a-4876-9100-ecabfbb2a416 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:45.135153 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3bef2363-2928-492e-968c-1761318b37f3 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:06:45.135810 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3bef2363-2928-492e-968c-1761318b37f3 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] [instance: 8f9812de-fd1b-49c4-b6de-8f5147f05c89] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:06:45.147296 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-6b85bd7e-2b4a-4876-9100-ecabfbb2a416 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:06:45.150156 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3bef2363-2928-492e-968c-1761318b37f3 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:45.151466 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3bef2363-2928-492e-968c-1761318b37f3 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:45.156668 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6b85bd7e-2b4a-4876-9100-ecabfbb2a416 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5" status: 200 len: 1169 microversion: 2.1 time: 0.408297 Sep 23 05:06:45.157564 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3bef2363-2928-492e-968c-1761318b37f3 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:45.158768 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3bef2363-2928-492e-968c-1761318b37f3 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:45.160467 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3bef2363-2928-492e-968c-1761318b37f3 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:45.160605 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3268/6364] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:06:44 2022] GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5 => generated 1169 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:06:45.170828 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3bef2363-2928-492e-968c-1761318b37f3 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:45.210241 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=100 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:06:45.558126 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-3bef2363-2928-492e-968c-1761318b37f3 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e8ce1f6821424080453f994dbcd604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fefb9fd80184955a7856e1c41d081be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:06:45.565927 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3bef2363-2928-492e-968c-1761318b37f3 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] 10.222.0.33 "GET /compute/v2.1/servers/8f9812de-fd1b-49c4-b6de-8f5147f05c89" status: 200 len: 1666 microversion: 2.1 time: 0.435586 Sep 23 05:06:45.566550 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3097/6365] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:06:45 2022] GET /compute/v2.1/servers/8f9812de-fd1b-49c4-b6de-8f5147f05c89 => generated 1666 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:06:46.189400 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f9b11a92-a0fd-4277-9eb6-811f31d2eccd tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:06:46.189400 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f9b11a92-a0fd-4277-9eb6-811f31d2eccd tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 907407f9-5788-487a-80aa-0782bd4230a5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:06:46.198162 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f9b11a92-a0fd-4277-9eb6-811f31d2eccd tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:46.199119 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f9b11a92-a0fd-4277-9eb6-811f31d2eccd tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:46.199528 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f9b11a92-a0fd-4277-9eb6-811f31d2eccd tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:46.200350 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f9b11a92-a0fd-4277-9eb6-811f31d2eccd tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:46.200832 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f9b11a92-a0fd-4277-9eb6-811f31d2eccd tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:46.201951 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f9b11a92-a0fd-4277-9eb6-811f31d2eccd tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:46.427510 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-892481c8-83e3-4d08-a303-8e3e10fd5d0a req-b917307f-a16e-4d0d-be57-b9ab1ef3fd34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f9812de-fd1b-49c4-b6de-8f5147f05c89", "name": "network-vif-deleted", "tag": "8869d70a-7591-4bb3-9139-d911ff4a1324"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:06:46.446121 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-892481c8-83e3-4d08-a303-8e3e10fd5d0a req-b917307f-a16e-4d0d-be57-b9ab1ef3fd34 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:46.448195 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-892481c8-83e3-4d08-a303-8e3e10fd5d0a req-b917307f-a16e-4d0d-be57-b9ab1ef3fd34 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:46.448195 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-892481c8-83e3-4d08-a303-8e3e10fd5d0a req-b917307f-a16e-4d0d-be57-b9ab1ef3fd34 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:46.464707 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-892481c8-83e3-4d08-a303-8e3e10fd5d0a req-b917307f-a16e-4d0d-be57-b9ab1ef3fd34 service nova] Creating event network-vif-deleted:8869d70a-7591-4bb3-9139-d911ff4a1324 for instance 8f9812de-fd1b-49c4-b6de-8f5147f05c89 on n-h2-846463-3 Sep 23 05:06:46.470932 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-892481c8-83e3-4d08-a303-8e3e10fd5d0a req-b917307f-a16e-4d0d-be57-b9ab1ef3fd34 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051317 Sep 23 05:06:46.471904 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3098/6366] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:06:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:06:46.529271 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f9b11a92-a0fd-4277-9eb6-811f31d2eccd tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:06:46.546709 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-004330eb-bc7e-4e55-9715-758459fb272b tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f5baaefd-218e-4cf6-8132-44b48166c4f6"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:06:46.546709 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-004330eb-bc7e-4e55-9715-758459fb272b tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 0d5dd84a-5c19-4af9-bd05-c95d93da0069] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:06:46.556273 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f9b11a92-a0fd-4277-9eb6-811f31d2eccd tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5" status: 200 len: 1169 microversion: 2.1 time: 0.368213 Sep 23 05:06:46.562382 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-004330eb-bc7e-4e55-9715-758459fb272b tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:46.563049 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3269/6367] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:06:46 2022] GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5 => generated 1169 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:06:46.566976 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-004330eb-bc7e-4e55-9715-758459fb272b tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:46.567648 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-004330eb-bc7e-4e55-9715-758459fb272b tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:46.569126 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-004330eb-bc7e-4e55-9715-758459fb272b tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:46.570171 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-004330eb-bc7e-4e55-9715-758459fb272b tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:46.570818 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-004330eb-bc7e-4e55-9715-758459fb272b tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:46.607226 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b91d7809-0e35-4a9e-9957-20474bd20ed9 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:06:46.608412 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b91d7809-0e35-4a9e-9957-20474bd20ed9 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] [instance: 8f9812de-fd1b-49c4-b6de-8f5147f05c89] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:06:46.629694 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b91d7809-0e35-4a9e-9957-20474bd20ed9 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:46.630565 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b91d7809-0e35-4a9e-9957-20474bd20ed9 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:46.632037 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b91d7809-0e35-4a9e-9957-20474bd20ed9 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:46.633092 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b91d7809-0e35-4a9e-9957-20474bd20ed9 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:46.635844 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b91d7809-0e35-4a9e-9957-20474bd20ed9 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:46.636503 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b91d7809-0e35-4a9e-9957-20474bd20ed9 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:46.864014 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b91d7809-0e35-4a9e-9957-20474bd20ed9 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e8ce1f6821424080453f994dbcd604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fefb9fd80184955a7856e1c41d081be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:06:46.883695 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b91d7809-0e35-4a9e-9957-20474bd20ed9 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] 10.222.0.33 "GET /compute/v2.1/servers/8f9812de-fd1b-49c4-b6de-8f5147f05c89" status: 200 len: 1332 microversion: 2.1 time: 0.280784 Sep 23 05:06:46.916673 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3270/6368] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:06:46 2022] GET /compute/v2.1/servers/8f9812de-fd1b-49c4-b6de-8f5147f05c89 => generated 1332 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:06:47.592299 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c272766f-9f53-4736-a14a-214c99e0e060 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:06:47.594281 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c272766f-9f53-4736-a14a-214c99e0e060 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 907407f9-5788-487a-80aa-0782bd4230a5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:06:47.614510 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c272766f-9f53-4736-a14a-214c99e0e060 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:47.614510 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c272766f-9f53-4736-a14a-214c99e0e060 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:47.616853 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c272766f-9f53-4736-a14a-214c99e0e060 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:47.617779 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c272766f-9f53-4736-a14a-214c99e0e060 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:47.618754 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c272766f-9f53-4736-a14a-214c99e0e060 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:47.620722 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c272766f-9f53-4736-a14a-214c99e0e060 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:48.202672 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c272766f-9f53-4736-a14a-214c99e0e060 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:06:48.213038 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c272766f-9f53-4736-a14a-214c99e0e060 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5" status: 200 len: 1169 microversion: 2.1 time: 0.624693 Sep 23 05:06:48.214333 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3271/6369] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:06:47 2022] GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5 => generated 1169 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:06:48.260749 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-004330eb-bc7e-4e55-9715-758459fb272b tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "POST /compute/v2.1/servers/0d5dd84a-5c19-4af9-bd05-c95d93da0069/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.728745 Sep 23 05:06:48.269342 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3099/6370] 10.222.0.33 () {60 vars in 1323 bytes} [Fri Sep 23 05:06:46 2022] POST /compute/v2.1/servers/0d5dd84a-5c19-4af9-bd05-c95d93da0069/os-volume_attachments => generated 194 bytes in 1738 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:06:48.283877 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b404f290-84db-4509-bafb-fb1cfe8d917b tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:06:48.287814 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b404f290-84db-4509-bafb-fb1cfe8d917b tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] [instance: 8f9812de-fd1b-49c4-b6de-8f5147f05c89] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:06:48.314565 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b404f290-84db-4509-bafb-fb1cfe8d917b tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:48.315074 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b404f290-84db-4509-bafb-fb1cfe8d917b tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:48.315528 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b404f290-84db-4509-bafb-fb1cfe8d917b tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:48.317631 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b404f290-84db-4509-bafb-fb1cfe8d917b tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:48.317631 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b404f290-84db-4509-bafb-fb1cfe8d917b tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:48.320736 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b404f290-84db-4509-bafb-fb1cfe8d917b tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:48.352134 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-b404f290-84db-4509-bafb-fb1cfe8d917b tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] HTTP exception thrown: Instance 8f9812de-fd1b-49c4-b6de-8f5147f05c89 could not be found. Sep 23 05:06:48.354340 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b404f290-84db-4509-bafb-fb1cfe8d917b tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Request method failure captured: Sep 23 05:06:48.354340 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/8f9812de-fd1b-49c4-b6de-8f5147f05c89 HTTP/1.1 Sep 23 05:06:48.354340 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 05:06:48.354340 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 05:06:48.354340 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 05:06:48.354340 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 05:06:48.354340 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 05:06:48.354340 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 05:06:48.354340 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 05:06:48.354340 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 05:06:48.354340 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLT4jjbkkyDoZWHfPR1V0ShIocEZsrsl9xhOl39rTPs2JfkhWYUIQ1QBstT_UDtJPYbFOkCdWqhVVT4oPil_cmn0Gon-JSdsMVZWBhquD_JTT_sM242Gl5m-9DFc-8J1dr0llZqGhhH-M6_yAF2mLvUsCDZpXw0h-uybxfIrmdII4ntk Sep 23 05:06:48.354340 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 05:06:48.354340 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 05:06:48.354340 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 05:06:48.354340 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 05:06:48.354340 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 05:06:48.354340 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 05:06:48.354340 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 5fefb9fd80184955a7856e1c41d081be Sep 23 05:06:48.354340 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-TestNetworkBasicOps-560522400 Sep 23 05:06:48.354340 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 05:06:48.354340 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 05:06:48.354340 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5fefb9fd80184955a7856e1c41d081be", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5fefb9fd80184955a7856e1c41d081be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5fefb9fd80184955a7856e1c41d081be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5fefb9fd80184955a7856e1c41d081be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:06:48.354340 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-TestNetworkBasicOps-560522400 Sep 23 05:06:48.354340 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 5fefb9fd80184955a7856e1c41d081be Sep 23 05:06:48.354340 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-TestNetworkBasicOps-560522400 Sep 23 05:06:48.354340 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-TestNetworkBasicOps-560522400-project Sep 23 05:06:48.354340 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 05:06:48.354340 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 05:06:48.354340 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: b3e8ce1f6821424080453f994dbcd604 Sep 23 05:06:48.354340 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-TestNetworkBasicOps-560522400-project Sep 23 05:06:48.354340 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 05:06:48.354340 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 8f9812de-fd1b-49c4-b6de-8f5147f05c89 could not be found. Sep 23 05:06:48.354340 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '8f9812de-fd1b-49c4-b6de-8f5147f05c89'} Sep 23 05:06:48.354340 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:06:48.354340 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:06:48.354340 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 05:06:48.354340 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 05:06:48.354340 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 05:06:48.354340 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 05:06:48.354340 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 05:06:48.354340 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 05:06:48.354340 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 05:06:48.354340 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 05:06:48.354340 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f9812de-fd1b-49c4-b6de-8f5147f05c89 could not be found. Sep 23 05:06:48.354340 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:06:48.354340 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:06:48.354340 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:06:48.354340 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:06:48.354340 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:06:48.354340 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:06:48.354340 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:06:48.354340 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:06:48.354340 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:06:48.354340 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:06:48.354340 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 05:06:48.354340 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 05:06:48.354340 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 05:06:48.354340 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 05:06:48.354340 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 05:06:48.354340 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:06:48.354340 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f9812de-fd1b-49c4-b6de-8f5147f05c89 could not be found. Sep 23 05:06:48.354340 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:06:48.354340 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:06:48.354340 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:06:48.360460 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:06:48.360460 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:06:48.360460 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:06:48.360460 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:06:48.360460 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:06:48.360460 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f9812de-fd1b-49c4-b6de-8f5147f05c89 could not be found. Sep 23 05:06:48.360460 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:06:48.360460 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b404f290-84db-4509-bafb-fb1cfe8d917b tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Returning 404 to user: Instance 8f9812de-fd1b-49c4-b6de-8f5147f05c89 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:06:48.360460 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b404f290-84db-4509-bafb-fb1cfe8d917b tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] 10.222.0.33 "GET /compute/v2.1/servers/8f9812de-fd1b-49c4-b6de-8f5147f05c89" status: 404 len: 111 microversion: 2.1 time: 0.141841 Sep 23 05:06:48.360460 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3272/6371] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:06:48 2022] GET /compute/v2.1/servers/8f9812de-fd1b-49c4-b6de-8f5147f05c89 => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 05:06:48.765368 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a5dd4491-442d-416a-a7c5-07b27c20bad2 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Calling method '.version_select at 0x7ff1ba93f310>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:06:48.889512 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a5dd4491-442d-416a-a7c5-07b27c20bad2 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-303851972" status: 202 len: 0 microversion: 2.1 time: 0.127661 Sep 23 05:06:48.890479 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3100/6372] 10.222.0.33 () {58 vars in 1254 bytes} [Fri Sep 23 05:06:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-303851972 => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 05:06:49.247364 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8ca4f8a9-0268-4769-8a10-34597cafbef9 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:06:49.248000 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-8ca4f8a9-0268-4769-8a10-34597cafbef9 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 907407f9-5788-487a-80aa-0782bd4230a5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:06:49.261976 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8ca4f8a9-0268-4769-8a10-34597cafbef9 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:49.265361 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8ca4f8a9-0268-4769-8a10-34597cafbef9 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:49.266092 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8ca4f8a9-0268-4769-8a10-34597cafbef9 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:49.267200 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8ca4f8a9-0268-4769-8a10-34597cafbef9 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:49.267862 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8ca4f8a9-0268-4769-8a10-34597cafbef9 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:49.268840 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8ca4f8a9-0268-4769-8a10-34597cafbef9 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:49.617011 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-8ca4f8a9-0268-4769-8a10-34597cafbef9 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:06:49.635230 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-8ca4f8a9-0268-4769-8a10-34597cafbef9 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5" status: 200 len: 1169 microversion: 2.1 time: 0.399323 Sep 23 05:06:49.648352 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3273/6373] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:06:49 2022] GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5 => generated 1169 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:06:50.657934 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1fe87145-e588-428c-a3d7-842d13514235 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:06:50.658672 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-1fe87145-e588-428c-a3d7-842d13514235 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 907407f9-5788-487a-80aa-0782bd4230a5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:06:50.666410 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1fe87145-e588-428c-a3d7-842d13514235 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:50.667173 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1fe87145-e588-428c-a3d7-842d13514235 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:50.667787 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1fe87145-e588-428c-a3d7-842d13514235 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:50.668708 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1fe87145-e588-428c-a3d7-842d13514235 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:50.669314 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1fe87145-e588-428c-a3d7-842d13514235 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:50.669910 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1fe87145-e588-428c-a3d7-842d13514235 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:50.866599 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-1fe87145-e588-428c-a3d7-842d13514235 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:06:50.875480 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-1fe87145-e588-428c-a3d7-842d13514235 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5" status: 200 len: 1169 microversion: 2.1 time: 0.223341 Sep 23 05:06:50.876832 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3101/6374] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:06:50 2022] GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5 => generated 1169 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:06:51.901882 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-30767fec-6484-44d0-af3e-c00b609e2067 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:06:51.902535 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-30767fec-6484-44d0-af3e-c00b609e2067 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 907407f9-5788-487a-80aa-0782bd4230a5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:06:51.914336 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-30767fec-6484-44d0-af3e-c00b609e2067 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:51.914828 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-30767fec-6484-44d0-af3e-c00b609e2067 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:51.915273 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-30767fec-6484-44d0-af3e-c00b609e2067 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:51.916005 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-30767fec-6484-44d0-af3e-c00b609e2067 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:51.916472 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-30767fec-6484-44d0-af3e-c00b609e2067 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:51.916907 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-30767fec-6484-44d0-af3e-c00b609e2067 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:52.390263 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-30767fec-6484-44d0-af3e-c00b609e2067 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:06:52.399640 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-30767fec-6484-44d0-af3e-c00b609e2067 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5" status: 200 len: 1169 microversion: 2.1 time: 0.501976 Sep 23 05:06:52.400802 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3274/6375] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:06:51 2022] GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5 => generated 1169 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:06:53.424829 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-17336995-7ff7-42d8-93f2-464014df7e01 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:06:53.425462 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-17336995-7ff7-42d8-93f2-464014df7e01 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 907407f9-5788-487a-80aa-0782bd4230a5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:06:53.435602 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-17336995-7ff7-42d8-93f2-464014df7e01 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:53.438615 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-17336995-7ff7-42d8-93f2-464014df7e01 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:53.440908 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-17336995-7ff7-42d8-93f2-464014df7e01 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:53.445454 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-17336995-7ff7-42d8-93f2-464014df7e01 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:53.446231 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-17336995-7ff7-42d8-93f2-464014df7e01 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:53.447016 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-17336995-7ff7-42d8-93f2-464014df7e01 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:53.707449 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-17336995-7ff7-42d8-93f2-464014df7e01 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:06:53.721653 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-17336995-7ff7-42d8-93f2-464014df7e01 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5" status: 200 len: 1169 microversion: 2.1 time: 0.300686 Sep 23 05:06:53.730544 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3102/6376] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:06:53 2022] GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5 => generated 1169 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:06:54.756181 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e97e10c5-ca43-4a83-9004-42f60682579a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:06:54.757657 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e97e10c5-ca43-4a83-9004-42f60682579a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 907407f9-5788-487a-80aa-0782bd4230a5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:06:54.771357 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e97e10c5-ca43-4a83-9004-42f60682579a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:54.772245 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e97e10c5-ca43-4a83-9004-42f60682579a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:54.773026 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e97e10c5-ca43-4a83-9004-42f60682579a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:54.774126 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e97e10c5-ca43-4a83-9004-42f60682579a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:54.776868 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e97e10c5-ca43-4a83-9004-42f60682579a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:54.778983 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e97e10c5-ca43-4a83-9004-42f60682579a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:55.154335 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e97e10c5-ca43-4a83-9004-42f60682579a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:06:55.179316 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e97e10c5-ca43-4a83-9004-42f60682579a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5" status: 200 len: 1169 microversion: 2.1 time: 0.428718 Sep 23 05:06:55.181723 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3275/6377] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:06:54 2022] GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5 => generated 1169 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:06:56.204905 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-422f6738-a105-410c-9901-f97b7235013b tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:06:56.206195 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-422f6738-a105-410c-9901-f97b7235013b tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 907407f9-5788-487a-80aa-0782bd4230a5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:06:56.215843 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-422f6738-a105-410c-9901-f97b7235013b tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:56.215843 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-422f6738-a105-410c-9901-f97b7235013b tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:56.215843 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-422f6738-a105-410c-9901-f97b7235013b tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:56.215843 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-422f6738-a105-410c-9901-f97b7235013b tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:56.216131 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-422f6738-a105-410c-9901-f97b7235013b tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:56.216523 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-422f6738-a105-410c-9901-f97b7235013b tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:56.450358 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-422f6738-a105-410c-9901-f97b7235013b tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:06:56.458477 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-422f6738-a105-410c-9901-f97b7235013b tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5" status: 200 len: 1169 microversion: 2.1 time: 0.258244 Sep 23 05:06:56.459319 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3103/6378] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:06:56 2022] GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5 => generated 1169 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:06:57.490628 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-69d7eb47-fe26-4b75-8c38-f990cb0fdffb tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:06:57.491386 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-69d7eb47-fe26-4b75-8c38-f990cb0fdffb tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 907407f9-5788-487a-80aa-0782bd4230a5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:06:57.499608 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-69d7eb47-fe26-4b75-8c38-f990cb0fdffb tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:57.500343 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-69d7eb47-fe26-4b75-8c38-f990cb0fdffb tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:57.500935 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-69d7eb47-fe26-4b75-8c38-f990cb0fdffb tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:57.501947 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-69d7eb47-fe26-4b75-8c38-f990cb0fdffb tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:57.502584 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-69d7eb47-fe26-4b75-8c38-f990cb0fdffb tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:57.503168 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-69d7eb47-fe26-4b75-8c38-f990cb0fdffb tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:57.649908 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-69d7eb47-fe26-4b75-8c38-f990cb0fdffb tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:06:57.658551 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-69d7eb47-fe26-4b75-8c38-f990cb0fdffb tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5" status: 200 len: 1215 microversion: 2.1 time: 0.171847 Sep 23 05:06:57.659139 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3276/6379] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:06:57 2022] GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5 => generated 1215 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:06:58.686728 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7b03d96f-5868-4caa-bae9-16a0f16f1274 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:06:58.688256 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7b03d96f-5868-4caa-bae9-16a0f16f1274 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 907407f9-5788-487a-80aa-0782bd4230a5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:06:58.701432 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7b03d96f-5868-4caa-bae9-16a0f16f1274 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:58.702361 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7b03d96f-5868-4caa-bae9-16a0f16f1274 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:58.703121 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7b03d96f-5868-4caa-bae9-16a0f16f1274 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:58.704232 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7b03d96f-5868-4caa-bae9-16a0f16f1274 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:06:58.705041 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7b03d96f-5868-4caa-bae9-16a0f16f1274 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:06:58.705682 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7b03d96f-5868-4caa-bae9-16a0f16f1274 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:06:58.968873 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-7b03d96f-5868-4caa-bae9-16a0f16f1274 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:06:58.978393 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7b03d96f-5868-4caa-bae9-16a0f16f1274 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5" status: 200 len: 1203 microversion: 2.1 time: 0.299512 Sep 23 05:06:58.980242 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3104/6380] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:06:58 2022] GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5 => generated 1203 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:07:00.015806 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-eb0c7bf2-204e-4279-ba9c-ef30f93d09fd tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:07:00.017448 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-eb0c7bf2-204e-4279-ba9c-ef30f93d09fd tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 907407f9-5788-487a-80aa-0782bd4230a5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:07:00.037709 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eb0c7bf2-204e-4279-ba9c-ef30f93d09fd tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:00.038843 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eb0c7bf2-204e-4279-ba9c-ef30f93d09fd tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:00.039439 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eb0c7bf2-204e-4279-ba9c-ef30f93d09fd tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:00.040340 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eb0c7bf2-204e-4279-ba9c-ef30f93d09fd tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:00.040968 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eb0c7bf2-204e-4279-ba9c-ef30f93d09fd tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:00.041540 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eb0c7bf2-204e-4279-ba9c-ef30f93d09fd tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:00.204165 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-eb0c7bf2-204e-4279-ba9c-ef30f93d09fd tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:07:00.206935 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:07:00.213993 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-eb0c7bf2-204e-4279-ba9c-ef30f93d09fd tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5" status: 200 len: 1203 microversion: 2.1 time: 0.204571 Sep 23 05:07:00.214569 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3277/6381] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:07:00 2022] GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5 => generated 1203 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:07:01.238046 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-884acce4-2085-4c61-95e6-bdc5b8c33d45 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:07:01.239288 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-884acce4-2085-4c61-95e6-bdc5b8c33d45 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 907407f9-5788-487a-80aa-0782bd4230a5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:07:01.272065 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-884acce4-2085-4c61-95e6-bdc5b8c33d45 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:01.273663 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-884acce4-2085-4c61-95e6-bdc5b8c33d45 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:01.277579 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-884acce4-2085-4c61-95e6-bdc5b8c33d45 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:01.278684 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-884acce4-2085-4c61-95e6-bdc5b8c33d45 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:01.281752 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-884acce4-2085-4c61-95e6-bdc5b8c33d45 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:01.282750 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-884acce4-2085-4c61-95e6-bdc5b8c33d45 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:01.685330 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-884acce4-2085-4c61-95e6-bdc5b8c33d45 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:07:01.705576 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-884acce4-2085-4c61-95e6-bdc5b8c33d45 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5" status: 200 len: 1203 microversion: 2.1 time: 0.472190 Sep 23 05:07:01.710313 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3105/6382] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:07:01 2022] GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5 => generated 1203 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:07:02.743100 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9fe09ddf-dfc7-4e00-bc93-f29f85140b4e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:07:02.744688 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-9fe09ddf-dfc7-4e00-bc93-f29f85140b4e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 907407f9-5788-487a-80aa-0782bd4230a5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:07:02.756827 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9fe09ddf-dfc7-4e00-bc93-f29f85140b4e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:02.757671 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9fe09ddf-dfc7-4e00-bc93-f29f85140b4e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:02.758566 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9fe09ddf-dfc7-4e00-bc93-f29f85140b4e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:02.760472 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9fe09ddf-dfc7-4e00-bc93-f29f85140b4e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:02.762170 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9fe09ddf-dfc7-4e00-bc93-f29f85140b4e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:02.763126 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9fe09ddf-dfc7-4e00-bc93-f29f85140b4e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:03.152612 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-9fe09ddf-dfc7-4e00-bc93-f29f85140b4e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:07:03.163318 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-9fe09ddf-dfc7-4e00-bc93-f29f85140b4e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5" status: 200 len: 1203 microversion: 2.1 time: 0.423930 Sep 23 05:07:03.164698 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3278/6383] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:07:02 2022] GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5 => generated 1203 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:07:04.187838 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6e014766-c4fb-47d4-96c5-27200fe390a8 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:07:04.188635 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-6e014766-c4fb-47d4-96c5-27200fe390a8 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 907407f9-5788-487a-80aa-0782bd4230a5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:07:04.203250 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6e014766-c4fb-47d4-96c5-27200fe390a8 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:04.205127 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6e014766-c4fb-47d4-96c5-27200fe390a8 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:04.205703 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6e014766-c4fb-47d4-96c5-27200fe390a8 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:04.207228 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6e014766-c4fb-47d4-96c5-27200fe390a8 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:04.210666 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6e014766-c4fb-47d4-96c5-27200fe390a8 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:04.211277 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6e014766-c4fb-47d4-96c5-27200fe390a8 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:04.576750 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6e014766-c4fb-47d4-96c5-27200fe390a8 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:07:04.591083 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-6e014766-c4fb-47d4-96c5-27200fe390a8 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5" status: 200 len: 1203 microversion: 2.1 time: 0.408423 Sep 23 05:07:04.606111 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3106/6384] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:07:04 2022] GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5 => generated 1203 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:07:05.621663 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7ec3fbf7-7343-48b7-a7ed-e94c8b99c396 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:07:05.622321 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-7ec3fbf7-7343-48b7-a7ed-e94c8b99c396 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 907407f9-5788-487a-80aa-0782bd4230a5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:07:05.627076 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:07:05.639225 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7ec3fbf7-7343-48b7-a7ed-e94c8b99c396 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:05.642278 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7ec3fbf7-7343-48b7-a7ed-e94c8b99c396 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:05.642926 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7ec3fbf7-7343-48b7-a7ed-e94c8b99c396 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:05.651502 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7ec3fbf7-7343-48b7-a7ed-e94c8b99c396 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:05.652450 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7ec3fbf7-7343-48b7-a7ed-e94c8b99c396 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:05.653111 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7ec3fbf7-7343-48b7-a7ed-e94c8b99c396 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:05.854794 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7667158f-f001-4396-b7b7-ad99608d03f5 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f5baaefd-218e-4cf6-8132-44b48166c4f6"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:07:05.857206 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7667158f-f001-4396-b7b7-ad99608d03f5 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 0d5dd84a-5c19-4af9-bd05-c95d93da0069] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:07:05.872236 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7667158f-f001-4396-b7b7-ad99608d03f5 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:05.872749 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7667158f-f001-4396-b7b7-ad99608d03f5 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:05.873391 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7667158f-f001-4396-b7b7-ad99608d03f5 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:05.874315 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7667158f-f001-4396-b7b7-ad99608d03f5 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:05.874937 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7667158f-f001-4396-b7b7-ad99608d03f5 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:05.875527 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7667158f-f001-4396-b7b7-ad99608d03f5 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:06.041568 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-7667158f-f001-4396-b7b7-ad99608d03f5 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] HTTP exception thrown: Invalid volume: volume f5baaefd-218e-4cf6-8132-44b48166c4f6 is already attached to instances: 0d5dd84a-5c19-4af9-bd05-c95d93da0069 Sep 23 05:07:06.044397 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7667158f-f001-4396-b7b7-ad99608d03f5 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Request method failure captured: Sep 23 05:07:06.044397 n-d-846463-3 devstack@n-api.service[122698]: request: POST /compute/v2.1/servers/0d5dd84a-5c19-4af9-bd05-c95d93da0069/os-volume_attachments HTTP/1.1 Sep 23 05:07:06.044397 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 05:07:06.044397 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 05:07:06.044397 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 05:07:06.044397 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 74 Sep 23 05:07:06.044397 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 05:07:06.044397 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 05:07:06.044397 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 05:07:06.044397 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 05:07:06.044397 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLT3a68wnGhJ1ri_wJa0c61-k-Mmu1aJqy0y8F08NYCjz_D70vilLx9G5I0GwzbhL1w2apyr58UgTWfFCoyEumWwAPT_5jEMZEFbxFGBL8lKHDufPcaCD0r7hhVTJQk-EQJ3nL8ZwWE56HAQoDgwteQ7RqvbmQmN2QkHgdyJgN3h_vQg Sep 23 05:07:06.044397 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 05:07:06.044397 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 05:07:06.044397 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 05:07:06.044397 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 05:07:06.044397 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 05:07:06.044397 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 05:07:06.044397 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: daad67f26fe246d6b4d28cad1707a119 Sep 23 05:07:06.044397 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-AttachVolumeNegativeTest-1007727461 Sep 23 05:07:06.044397 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 05:07:06.044397 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 05:07:06.044397 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_daad67f26fe246d6b4d28cad1707a119", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/daad67f26fe246d6b4d28cad1707a119"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/daad67f26fe246d6b4d28cad1707a119"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/daad67f26fe246d6b4d28cad1707a119"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:07:06.044397 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-AttachVolumeNegativeTest-1007727461 Sep 23 05:07:06.044397 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: daad67f26fe246d6b4d28cad1707a119 Sep 23 05:07:06.044397 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1007727461 Sep 23 05:07:06.044397 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-AttachVolumeNegativeTest-1007727461-project Sep 23 05:07:06.044397 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 05:07:06.044397 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 05:07:06.044397 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 59d90150ed7d477fab33129cb3b068ed Sep 23 05:07:06.044397 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-AttachVolumeNegativeTest-1007727461-project Sep 23 05:07:06.044397 n-d-846463-3 devstack@n-api.service[122698]: Sep 23 05:07:06.044397 n-d-846463-3 devstack@n-api.service[122698]: {"volumeAttachment": {"volumeId": "f5baaefd-218e-4cf6-8132-44b48166c4f6"}} Sep 23 05:07:06.044397 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 05:07:06.044397 n-d-846463-3 devstack@n-api.service[122698]: exception: Invalid volume: volume f5baaefd-218e-4cf6-8132-44b48166c4f6 is already attached to instances: 0d5dd84a-5c19-4af9-bd05-c95d93da0069 Sep 23 05:07:06.044397 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'server_id': '0d5dd84a-5c19-4af9-bd05-c95d93da0069', 'body': {'volumeAttachment': {'volumeId': 'f5baaefd-218e-4cf6-8132-44b48166c4f6'}}} Sep 23 05:07:06.044397 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:07:06.044397 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:07:06.044397 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 23 05:07:06.044397 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 23 05:07:06.044397 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 23 05:07:06.044397 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 23 05:07:06.044397 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 23 05:07:06.044397 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 23 05:07:06.044397 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 23 05:07:06.044397 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 23 05:07:06.044397 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 23 05:07:06.044397 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 23 05:07:06.044397 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume f5baaefd-218e-4cf6-8132-44b48166c4f6 is already attached to instances: 0d5dd84a-5c19-4af9-bd05-c95d93da0069 Sep 23 05:07:06.044397 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:07:06.044397 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:07:06.044397 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:07:06.044397 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:07:06.044397 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:07:06.044397 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:07:06.044397 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:07:06.044397 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:07:06.044397 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:07:06.044397 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:07:06.044397 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 05:07:06.044397 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 05:07:06.044397 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 05:07:06.044397 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 05:07:06.049513 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 05:07:06.049513 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 05:07:06.049513 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 23 05:07:06.049513 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 23 05:07:06.049513 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume f5baaefd-218e-4cf6-8132-44b48166c4f6 is already attached to instances: 0d5dd84a-5c19-4af9-bd05-c95d93da0069 Sep 23 05:07:06.049513 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:07:06.049513 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:07:06.049513 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:07:06.049513 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:07:06.049513 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:07:06.049513 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:07:06.049513 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:07:06.049513 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:07:06.049513 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume f5baaefd-218e-4cf6-8132-44b48166c4f6 is already attached to instances: 0d5dd84a-5c19-4af9-bd05-c95d93da0069 Sep 23 05:07:06.049513 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:07:06.060019 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7667158f-f001-4396-b7b7-ad99608d03f5 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Returning 400 to user: Invalid volume: volume f5baaefd-218e-4cf6-8132-44b48166c4f6 is already attached to instances: 0d5dd84a-5c19-4af9-bd05-c95d93da0069 {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:07:06.061132 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7667158f-f001-4396-b7b7-ad99608d03f5 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "POST /compute/v2.1/servers/0d5dd84a-5c19-4af9-bd05-c95d93da0069/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.210447 Sep 23 05:07:06.067067 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3107/6385] 10.222.0.33 () {60 vars in 1323 bytes} [Fri Sep 23 05:07:05 2022] POST /compute/v2.1/servers/0d5dd84a-5c19-4af9-bd05-c95d93da0069/os-volume_attachments => generated 174 bytes in 217 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 05:07:06.120020 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-7ec3fbf7-7343-48b7-a7ed-e94c8b99c396 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:07:06.138323 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-7ec3fbf7-7343-48b7-a7ed-e94c8b99c396 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5" status: 200 len: 1203 microversion: 2.1 time: 0.516947 Sep 23 05:07:06.138971 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3279/6386] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:07:05 2022] GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5 => generated 1203 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:07:06.210489 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-fe520693-632d-410b-9085-94a6299c263d tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:07:06.210489 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-fe520693-632d-410b-9085-94a6299c263d tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 0d5dd84a-5c19-4af9-bd05-c95d93da0069] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:07:06.223101 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fe520693-632d-410b-9085-94a6299c263d tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:06.223617 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fe520693-632d-410b-9085-94a6299c263d tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:06.224901 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fe520693-632d-410b-9085-94a6299c263d tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:06.225998 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fe520693-632d-410b-9085-94a6299c263d tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:06.226673 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fe520693-632d-410b-9085-94a6299c263d tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:06.227472 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fe520693-632d-410b-9085-94a6299c263d tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:06.434476 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-fe520693-632d-410b-9085-94a6299c263d tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lazy-loading 'services' on Instance uuid 0d5dd84a-5c19-4af9-bd05-c95d93da0069 {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 05:07:06.900892 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-fe520693-632d-410b-9085-94a6299c263d tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "DELETE /compute/v2.1/servers/0d5dd84a-5c19-4af9-bd05-c95d93da0069/os-volume_attachments/f5baaefd-218e-4cf6-8132-44b48166c4f6" status: 202 len: 0 microversion: 2.1 time: 0.699936 Sep 23 05:07:06.901900 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3108/6387] 10.222.0.33 () {58 vars in 1416 bytes} [Fri Sep 23 05:07:06 2022] DELETE /compute/v2.1/servers/0d5dd84a-5c19-4af9-bd05-c95d93da0069/os-volume_attachments/f5baaefd-218e-4cf6-8132-44b48166c4f6 => generated 0 bytes in 702 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 05:07:06.910774 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-510f6e4c-3564-441b-80b1-d7ffa28af958 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:07:06.915175 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-510f6e4c-3564-441b-80b1-d7ffa28af958 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 0d5dd84a-5c19-4af9-bd05-c95d93da0069] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:07:06.943117 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-510f6e4c-3564-441b-80b1-d7ffa28af958 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:06.943527 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-510f6e4c-3564-441b-80b1-d7ffa28af958 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:06.943984 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-510f6e4c-3564-441b-80b1-d7ffa28af958 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:06.944716 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-510f6e4c-3564-441b-80b1-d7ffa28af958 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:06.945190 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-510f6e4c-3564-441b-80b1-d7ffa28af958 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:06.945628 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-510f6e4c-3564-441b-80b1-d7ffa28af958 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:07.080022 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-510f6e4c-3564-441b-80b1-d7ffa28af958 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/0d5dd84a-5c19-4af9-bd05-c95d93da0069/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.143727 Sep 23 05:07:07.086978 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3280/6388] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Sep 23 05:07:06 2022] GET /compute/v2.1/servers/0d5dd84a-5c19-4af9-bd05-c95d93da0069/os-volume_attachments => generated 197 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:07:07.167673 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-300d50bf-b5d8-4292-8190-ab1f1c49054e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:07:07.168747 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-300d50bf-b5d8-4292-8190-ab1f1c49054e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 907407f9-5788-487a-80aa-0782bd4230a5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:07:07.188321 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-300d50bf-b5d8-4292-8190-ab1f1c49054e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:07.199521 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-300d50bf-b5d8-4292-8190-ab1f1c49054e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:07.200326 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-300d50bf-b5d8-4292-8190-ab1f1c49054e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:07.201639 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-300d50bf-b5d8-4292-8190-ab1f1c49054e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:07.202364 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-300d50bf-b5d8-4292-8190-ab1f1c49054e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:07.203715 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-300d50bf-b5d8-4292-8190-ab1f1c49054e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:07.922199 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-300d50bf-b5d8-4292-8190-ab1f1c49054e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:07:07.934915 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-300d50bf-b5d8-4292-8190-ab1f1c49054e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5" status: 200 len: 1203 microversion: 2.1 time: 0.772699 Sep 23 05:07:07.941104 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3109/6389] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:07:07 2022] GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5 => generated 1203 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:07:08.100003 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7a97763f-e70e-405e-b392-8773ff309147 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:07:08.102296 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-7a97763f-e70e-405e-b392-8773ff309147 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 0d5dd84a-5c19-4af9-bd05-c95d93da0069] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:07:08.117200 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7a97763f-e70e-405e-b392-8773ff309147 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:08.117706 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7a97763f-e70e-405e-b392-8773ff309147 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:08.121772 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7a97763f-e70e-405e-b392-8773ff309147 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:08.122632 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7a97763f-e70e-405e-b392-8773ff309147 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:08.125258 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7a97763f-e70e-405e-b392-8773ff309147 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:08.125730 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7a97763f-e70e-405e-b392-8773ff309147 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:08.222328 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-7a97763f-e70e-405e-b392-8773ff309147 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/0d5dd84a-5c19-4af9-bd05-c95d93da0069/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.127213 Sep 23 05:07:08.225200 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3281/6390] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Sep 23 05:07:08 2022] GET /compute/v2.1/servers/0d5dd84a-5c19-4af9-bd05-c95d93da0069/os-volume_attachments => generated 197 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 05:07:08.969361 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e6a5a967-b87b-4bf6-9157-3c12ece97952 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:07:08.970652 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e6a5a967-b87b-4bf6-9157-3c12ece97952 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 907407f9-5788-487a-80aa-0782bd4230a5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:07:08.982788 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e6a5a967-b87b-4bf6-9157-3c12ece97952 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:08.991489 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e6a5a967-b87b-4bf6-9157-3c12ece97952 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:08.991962 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e6a5a967-b87b-4bf6-9157-3c12ece97952 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:08.992826 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e6a5a967-b87b-4bf6-9157-3c12ece97952 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:08.993309 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e6a5a967-b87b-4bf6-9157-3c12ece97952 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:08.993754 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e6a5a967-b87b-4bf6-9157-3c12ece97952 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:09.237871 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-78f1d710-5335-4e48-aebf-c133c9108201 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:07:09.240874 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-78f1d710-5335-4e48-aebf-c133c9108201 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 0d5dd84a-5c19-4af9-bd05-c95d93da0069] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:07:09.266263 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-78f1d710-5335-4e48-aebf-c133c9108201 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:09.286791 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-78f1d710-5335-4e48-aebf-c133c9108201 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:09.290422 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-78f1d710-5335-4e48-aebf-c133c9108201 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:09.293655 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-78f1d710-5335-4e48-aebf-c133c9108201 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:09.296975 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-78f1d710-5335-4e48-aebf-c133c9108201 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:09.298363 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-78f1d710-5335-4e48-aebf-c133c9108201 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:09.406866 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-78f1d710-5335-4e48-aebf-c133c9108201 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/0d5dd84a-5c19-4af9-bd05-c95d93da0069/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.173371 Sep 23 05:07:09.410099 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3282/6391] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Sep 23 05:07:09 2022] GET /compute/v2.1/servers/0d5dd84a-5c19-4af9-bd05-c95d93da0069/os-volume_attachments => generated 197 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:07:09.450696 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-35730f2b-fc41-4d95-b71f-063f2dd634cb tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Action: 'create', calling method: .version_select at 0x7ff1ba9811f0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1822468595", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7z2xAgP7N83FIH6CCwEki1IoKKBRkrz3Tou9NPhSuaGj/X5kDvGnO6a1FOW0iUaG6VSyWt9vKHMKj0XeVTCK8VFS82d/Umg6rpnFapIrckYuM2O4vkaU8S4OMUzzAy+A=="}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:07:09.489925 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e6a5a967-b87b-4bf6-9157-3c12ece97952 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:07:09.501061 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e6a5a967-b87b-4bf6-9157-3c12ece97952 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5" status: 200 len: 1203 microversion: 2.1 time: 0.535683 Sep 23 05:07:09.519418 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-35730f2b-fc41-4d95-b71f-063f2dd634cb tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Getting quotas for project 5fefb9fd80184955a7856e1c41d081be. Resources: {'key_pairs'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 05:07:09.522312 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3110/6392] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:07:08 2022] GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5 => generated 1203 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:07:09.542450 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-35730f2b-fc41-4d95-b71f-063f2dd634cb tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Getting quotas for user b3e8ce1f6821424080453f994dbcd604 and project 5fefb9fd80184955a7856e1c41d081be. Resources: {'key_pairs'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 05:07:09.698009 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-35730f2b-fc41-4d95-b71f-063f2dd634cb tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.282719 Sep 23 05:07:09.698935 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3283/6393] 10.222.0.33 () {60 vars in 1159 bytes} [Fri Sep 23 05:07:09 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:07:10.419406 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1b28e259-6df2-4090-984b-9eee059994b5 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:07:10.421742 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-1b28e259-6df2-4090-984b-9eee059994b5 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 0d5dd84a-5c19-4af9-bd05-c95d93da0069] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:07:10.437456 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1b28e259-6df2-4090-984b-9eee059994b5 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:10.437988 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1b28e259-6df2-4090-984b-9eee059994b5 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:10.438447 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1b28e259-6df2-4090-984b-9eee059994b5 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:10.439172 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1b28e259-6df2-4090-984b-9eee059994b5 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:10.439642 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1b28e259-6df2-4090-984b-9eee059994b5 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:10.440080 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1b28e259-6df2-4090-984b-9eee059994b5 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:10.502511 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-1b28e259-6df2-4090-984b-9eee059994b5 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/0d5dd84a-5c19-4af9-bd05-c95d93da0069/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086935 Sep 23 05:07:10.507768 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3111/6394] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Sep 23 05:07:10 2022] GET /compute/v2.1/servers/0d5dd84a-5c19-4af9-bd05-c95d93da0069/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:07:10.527584 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a7dc4bbe-1354-45ee-8875-06c6a49b89be tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:07:10.528203 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a7dc4bbe-1354-45ee-8875-06c6a49b89be tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 907407f9-5788-487a-80aa-0782bd4230a5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:07:10.546945 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a7dc4bbe-1354-45ee-8875-06c6a49b89be tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:10.550427 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a7dc4bbe-1354-45ee-8875-06c6a49b89be tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:10.550427 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a7dc4bbe-1354-45ee-8875-06c6a49b89be tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:10.550427 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a7dc4bbe-1354-45ee-8875-06c6a49b89be tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:10.550427 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a7dc4bbe-1354-45ee-8875-06c6a49b89be tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:10.550427 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a7dc4bbe-1354-45ee-8875-06c6a49b89be tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:11.024125 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a7dc4bbe-1354-45ee-8875-06c6a49b89be tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:07:11.036220 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a7dc4bbe-1354-45ee-8875-06c6a49b89be tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5" status: 200 len: 1203 microversion: 2.1 time: 0.512925 Sep 23 05:07:11.037612 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3284/6395] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:07:10 2022] GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5 => generated 1203 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:07:11.515344 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-46707f59-82d8-4a60-bafb-c1d9394d8dc9 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:07:11.517616 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-46707f59-82d8-4a60-bafb-c1d9394d8dc9 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 0d5dd84a-5c19-4af9-bd05-c95d93da0069] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:07:11.528321 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-46707f59-82d8-4a60-bafb-c1d9394d8dc9 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:11.528831 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-46707f59-82d8-4a60-bafb-c1d9394d8dc9 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:11.529286 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-46707f59-82d8-4a60-bafb-c1d9394d8dc9 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:11.535114 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-46707f59-82d8-4a60-bafb-c1d9394d8dc9 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:11.535685 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-46707f59-82d8-4a60-bafb-c1d9394d8dc9 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:11.536146 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-46707f59-82d8-4a60-bafb-c1d9394d8dc9 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:11.577459 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-46707f59-82d8-4a60-bafb-c1d9394d8dc9 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/0d5dd84a-5c19-4af9-bd05-c95d93da0069/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066065 Sep 23 05:07:11.582420 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3112/6396] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Sep 23 05:07:11 2022] GET /compute/v2.1/servers/0d5dd84a-5c19-4af9-bd05-c95d93da0069/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:07:12.066261 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4ec731b0-d272-4547-9989-c0e0117be36e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:07:12.067818 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4ec731b0-d272-4547-9989-c0e0117be36e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 907407f9-5788-487a-80aa-0782bd4230a5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:07:12.080943 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4ec731b0-d272-4547-9989-c0e0117be36e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:12.086263 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4ec731b0-d272-4547-9989-c0e0117be36e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:12.087546 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4ec731b0-d272-4547-9989-c0e0117be36e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:12.088344 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4ec731b0-d272-4547-9989-c0e0117be36e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:12.092192 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4ec731b0-d272-4547-9989-c0e0117be36e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:12.092667 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4ec731b0-d272-4547-9989-c0e0117be36e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:12.354700 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-4ec731b0-d272-4547-9989-c0e0117be36e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:07:12.368163 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4ec731b0-d272-4547-9989-c0e0117be36e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5" status: 200 len: 1203 microversion: 2.1 time: 0.306774 Sep 23 05:07:12.371481 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3285/6397] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:07:12 2022] GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5 => generated 1203 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:07:12.590573 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-801bc8aa-03e3-4a36-a1aa-a15f2258d529 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:07:12.593534 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-801bc8aa-03e3-4a36-a1aa-a15f2258d529 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 0d5dd84a-5c19-4af9-bd05-c95d93da0069] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:07:12.608426 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-801bc8aa-03e3-4a36-a1aa-a15f2258d529 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:12.609250 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-801bc8aa-03e3-4a36-a1aa-a15f2258d529 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:12.611148 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-801bc8aa-03e3-4a36-a1aa-a15f2258d529 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:12.614364 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-801bc8aa-03e3-4a36-a1aa-a15f2258d529 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:12.615114 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-801bc8aa-03e3-4a36-a1aa-a15f2258d529 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:12.615782 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-801bc8aa-03e3-4a36-a1aa-a15f2258d529 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:12.682928 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:07:12.688790 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-801bc8aa-03e3-4a36-a1aa-a15f2258d529 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/0d5dd84a-5c19-4af9-bd05-c95d93da0069/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102184 Sep 23 05:07:12.697762 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3113/6398] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Sep 23 05:07:12 2022] GET /compute/v2.1/servers/0d5dd84a-5c19-4af9-bd05-c95d93da0069/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:07:13.405509 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c15b4ee3-a6f8-44a1-9cdc-32709466eb75 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:07:13.406166 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c15b4ee3-a6f8-44a1-9cdc-32709466eb75 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 907407f9-5788-487a-80aa-0782bd4230a5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:07:13.431162 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c15b4ee3-a6f8-44a1-9cdc-32709466eb75 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:13.439329 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c15b4ee3-a6f8-44a1-9cdc-32709466eb75 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:13.439926 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c15b4ee3-a6f8-44a1-9cdc-32709466eb75 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:13.440690 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c15b4ee3-a6f8-44a1-9cdc-32709466eb75 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:13.441156 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c15b4ee3-a6f8-44a1-9cdc-32709466eb75 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:13.441586 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c15b4ee3-a6f8-44a1-9cdc-32709466eb75 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:14.002403 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c15b4ee3-a6f8-44a1-9cdc-32709466eb75 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:07:14.015230 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c15b4ee3-a6f8-44a1-9cdc-32709466eb75 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5" status: 200 len: 1203 microversion: 2.1 time: 0.621069 Sep 23 05:07:14.019469 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-aba1c0af-f484-45ff-821d-26c3f5fb250a req-e885c864-d6db-4537-8bf1-7518d3be7391 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "907407f9-5788-487a-80aa-0782bd4230a5", "name": "network-vif-plugged", "status": "completed", "tag": "f3bf0e41-8570-4941-85cf-568159f808b9"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:07:14.050278 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3114/6399] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:07:13 2022] GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5 => generated 1203 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:07:14.051570 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-aba1c0af-f484-45ff-821d-26c3f5fb250a req-e885c864-d6db-4537-8bf1-7518d3be7391 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:14.054633 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-aba1c0af-f484-45ff-821d-26c3f5fb250a req-e885c864-d6db-4537-8bf1-7518d3be7391 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:14.055942 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-aba1c0af-f484-45ff-821d-26c3f5fb250a req-e885c864-d6db-4537-8bf1-7518d3be7391 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:14.056128 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-605deef6-17f3-4843-958c-3f3b6f0e8687 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:07:14.065221 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-605deef6-17f3-4843-958c-3f3b6f0e8687 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 0d5dd84a-5c19-4af9-bd05-c95d93da0069] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:07:14.088728 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-aba1c0af-f484-45ff-821d-26c3f5fb250a req-e885c864-d6db-4537-8bf1-7518d3be7391 service nova] Creating event network-vif-plugged:f3bf0e41-8570-4941-85cf-568159f808b9 for instance 907407f9-5788-487a-80aa-0782bd4230a5 on n-h1-846463-3 Sep 23 05:07:14.094717 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-aba1c0af-f484-45ff-821d-26c3f5fb250a req-e885c864-d6db-4537-8bf1-7518d3be7391 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.703914 Sep 23 05:07:14.097162 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-605deef6-17f3-4843-958c-3f3b6f0e8687 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:14.097668 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-605deef6-17f3-4843-958c-3f3b6f0e8687 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:14.107996 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-605deef6-17f3-4843-958c-3f3b6f0e8687 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:14.112113 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-605deef6-17f3-4843-958c-3f3b6f0e8687 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:14.115701 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-605deef6-17f3-4843-958c-3f3b6f0e8687 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:14.116681 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-605deef6-17f3-4843-958c-3f3b6f0e8687 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:14.118322 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3286/6400] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:07:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:07:14.259031 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-605deef6-17f3-4843-958c-3f3b6f0e8687 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/0d5dd84a-5c19-4af9-bd05-c95d93da0069/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.216672 Sep 23 05:07:14.265812 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3115/6401] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Sep 23 05:07:14 2022] GET /compute/v2.1/servers/0d5dd84a-5c19-4af9-bd05-c95d93da0069/os-volume_attachments => generated 197 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:07:15.071809 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-44568513-72fd-4b2f-9097-d04ad8ffe661 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:07:15.072574 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-44568513-72fd-4b2f-9097-d04ad8ffe661 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 907407f9-5788-487a-80aa-0782bd4230a5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:07:15.092746 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-44568513-72fd-4b2f-9097-d04ad8ffe661 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:15.093857 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-44568513-72fd-4b2f-9097-d04ad8ffe661 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:15.094575 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-44568513-72fd-4b2f-9097-d04ad8ffe661 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:15.098786 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-44568513-72fd-4b2f-9097-d04ad8ffe661 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:15.104186 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-44568513-72fd-4b2f-9097-d04ad8ffe661 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:15.104908 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-44568513-72fd-4b2f-9097-d04ad8ffe661 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:15.273170 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3453f151-86d6-411b-a715-7c4384d6eee7 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:07:15.275438 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3453f151-86d6-411b-a715-7c4384d6eee7 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 0d5dd84a-5c19-4af9-bd05-c95d93da0069] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:07:15.284643 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:07:15.291017 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3453f151-86d6-411b-a715-7c4384d6eee7 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:15.291700 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3453f151-86d6-411b-a715-7c4384d6eee7 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:15.292166 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3453f151-86d6-411b-a715-7c4384d6eee7 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:15.293688 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3453f151-86d6-411b-a715-7c4384d6eee7 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:15.294215 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3453f151-86d6-411b-a715-7c4384d6eee7 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:15.294748 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3453f151-86d6-411b-a715-7c4384d6eee7 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:15.476021 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3453f151-86d6-411b-a715-7c4384d6eee7 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/0d5dd84a-5c19-4af9-bd05-c95d93da0069/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.207583 Sep 23 05:07:15.476611 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3116/6402] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Sep 23 05:07:15 2022] GET /compute/v2.1/servers/0d5dd84a-5c19-4af9-bd05-c95d93da0069/os-volume_attachments => generated 197 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:07:15.618394 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-44568513-72fd-4b2f-9097-d04ad8ffe661 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:07:15.627558 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-44568513-72fd-4b2f-9097-d04ad8ffe661 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5" status: 200 len: 1203 microversion: 2.1 time: 0.560313 Sep 23 05:07:15.628299 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3287/6403] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:07:15 2022] GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5 => generated 1203 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:07:15.870029 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-664536d1-8eb1-45f1-813c-646e81057a62 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-867858848", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "networks": [{"uuid": "1e4a37cc-1b71-42d8-9711-bd94a9a650fa"}], "key_name": "tempest-TestNetworkBasicOps-1822468595", "security_groups": [{"name": "tempest-secgroup-smoke-1785681969"}]}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:07:16.119902 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.network.neutron [None req-664536d1-8eb1-45f1-813c-646e81057a62 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] validate_networks() for [('1e4a37cc-1b71-42d8-9711-bd94a9a650fa', None, None, None, None, None)] {{(pid=122698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 05:07:16.493343 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3165a4cf-0a17-4c2f-821c-648a4c64d90f tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:07:16.496488 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-3165a4cf-0a17-4c2f-821c-648a4c64d90f tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 0d5dd84a-5c19-4af9-bd05-c95d93da0069] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:07:16.505278 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3165a4cf-0a17-4c2f-821c-648a4c64d90f tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:16.506795 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3165a4cf-0a17-4c2f-821c-648a4c64d90f tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:16.507227 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3165a4cf-0a17-4c2f-821c-648a4c64d90f tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:16.508557 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3165a4cf-0a17-4c2f-821c-648a4c64d90f tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:16.509444 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3165a4cf-0a17-4c2f-821c-648a4c64d90f tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:16.510297 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3165a4cf-0a17-4c2f-821c-648a4c64d90f tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:16.556756 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3165a4cf-0a17-4c2f-821c-648a4c64d90f tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/0d5dd84a-5c19-4af9-bd05-c95d93da0069/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070176 Sep 23 05:07:16.559072 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3288/6404] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Sep 23 05:07:16 2022] GET /compute/v2.1/servers/0d5dd84a-5c19-4af9-bd05-c95d93da0069/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:07:16.630334 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-664536d1-8eb1-45f1-813c-646e81057a62 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Flavor limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 05:07:16.631171 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-664536d1-8eb1-45f1-813c-646e81057a62 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Image limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 05:07:16.632033 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-664536d1-8eb1-45f1-813c-646e81057a62 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Flavor pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 05:07:16.632459 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-664536d1-8eb1-45f1-813c-646e81057a62 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Image pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 05:07:16.632883 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-664536d1-8eb1-45f1-813c-646e81057a62 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 05:07:16.643661 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-664536d1-8eb1-45f1-813c-646e81057a62 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:16.646822 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-664536d1-8eb1-45f1-813c-646e81057a62 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:16.646822 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-664536d1-8eb1-45f1-813c-646e81057a62 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:16.646822 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-664536d1-8eb1-45f1-813c-646e81057a62 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:16.646822 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-664536d1-8eb1-45f1-813c-646e81057a62 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:16.646822 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-664536d1-8eb1-45f1-813c-646e81057a62 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:16.657313 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-72c28540-296d-4619-a7e8-b13c11e2a3e0 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:07:16.658328 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-72c28540-296d-4619-a7e8-b13c11e2a3e0 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 907407f9-5788-487a-80aa-0782bd4230a5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:07:16.666586 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-72c28540-296d-4619-a7e8-b13c11e2a3e0 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:16.667119 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-664536d1-8eb1-45f1-813c-646e81057a62 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Getting quotas for project 5fefb9fd80184955a7856e1c41d081be. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 05:07:16.667365 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-72c28540-296d-4619-a7e8-b13c11e2a3e0 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:16.672338 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-72c28540-296d-4619-a7e8-b13c11e2a3e0 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:16.674002 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-72c28540-296d-4619-a7e8-b13c11e2a3e0 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:16.674109 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-664536d1-8eb1-45f1-813c-646e81057a62 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Getting quotas for user b3e8ce1f6821424080453f994dbcd604 and project 5fefb9fd80184955a7856e1c41d081be. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 05:07:16.674745 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-72c28540-296d-4619-a7e8-b13c11e2a3e0 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:16.676968 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-72c28540-296d-4619-a7e8-b13c11e2a3e0 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:16.688209 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-664536d1-8eb1-45f1-813c-646e81057a62 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Going to run 1 instances... {{(pid=122698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 05:07:16.690955 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-664536d1-8eb1-45f1-813c-646e81057a62 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] [instance: 428b73b8-21f1-47cb-83bb-df2b45f210dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 05:07:16.874560 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-664536d1-8eb1-45f1-813c-646e81057a62 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.010007 Sep 23 05:07:16.887357 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3117/6405] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 05:07:15 2022] POST /compute/v2.1/servers => generated 406 bytes in 1023 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 05:07:16.903319 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2a2070d0-379c-47b2-a379-795a526f69a3 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:07:16.903319 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-2a2070d0-379c-47b2-a379-795a526f69a3 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] [instance: 428b73b8-21f1-47cb-83bb-df2b45f210dc] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:07:16.904840 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-72c28540-296d-4619-a7e8-b13c11e2a3e0 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:07:16.916950 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-72c28540-296d-4619-a7e8-b13c11e2a3e0 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5" status: 200 len: 1391 microversion: 2.1 time: 0.262924 Sep 23 05:07:16.952118 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3289/6406] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:07:16 2022] GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5 => generated 1391 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:07:16.981406 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-2a2070d0-379c-47b2-a379-795a526f69a3 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e8ce1f6821424080453f994dbcd604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fefb9fd80184955a7856e1c41d081be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:07:16.984873 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-64fc1f9e-b74f-478c-ba2a-1ccf85d56118 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:07:16.985605 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-64fc1f9e-b74f-478c-ba2a-1ccf85d56118 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 907407f9-5788-487a-80aa-0782bd4230a5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:07:16.991727 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2a2070d0-379c-47b2-a379-795a526f69a3 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] 10.222.0.33 "GET /compute/v2.1/servers/428b73b8-21f1-47cb-83bb-df2b45f210dc" status: 200 len: 1248 microversion: 2.1 time: 0.102285 Sep 23 05:07:16.992683 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3118/6407] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:07:16 2022] GET /compute/v2.1/servers/428b73b8-21f1-47cb-83bb-df2b45f210dc => generated 1248 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:07:16.996883 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-64fc1f9e-b74f-478c-ba2a-1ccf85d56118 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:16.997406 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-64fc1f9e-b74f-478c-ba2a-1ccf85d56118 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:16.998072 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-64fc1f9e-b74f-478c-ba2a-1ccf85d56118 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:16.999060 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-64fc1f9e-b74f-478c-ba2a-1ccf85d56118 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:16.999885 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-64fc1f9e-b74f-478c-ba2a-1ccf85d56118 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:17.000969 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-64fc1f9e-b74f-478c-ba2a-1ccf85d56118 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:17.283175 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-64fc1f9e-b74f-478c-ba2a-1ccf85d56118 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:07:17.292063 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-64fc1f9e-b74f-478c-ba2a-1ccf85d56118 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5" status: 200 len: 1391 microversion: 2.1 time: 0.338492 Sep 23 05:07:17.292795 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3290/6408] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:07:16 2022] GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5 => generated 1391 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:07:17.316024 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9c8a080c-6ce3-4f35-8df0-b9ca8bbf912d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:07:17.317074 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-9c8a080c-6ce3-4f35-8df0-b9ca8bbf912d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 907407f9-5788-487a-80aa-0782bd4230a5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:07:17.327871 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9c8a080c-6ce3-4f35-8df0-b9ca8bbf912d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:17.329512 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9c8a080c-6ce3-4f35-8df0-b9ca8bbf912d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:17.330390 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9c8a080c-6ce3-4f35-8df0-b9ca8bbf912d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:17.333116 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9c8a080c-6ce3-4f35-8df0-b9ca8bbf912d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:17.333773 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9c8a080c-6ce3-4f35-8df0-b9ca8bbf912d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:17.335024 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9c8a080c-6ce3-4f35-8df0-b9ca8bbf912d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:17.534086 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-9c8a080c-6ce3-4f35-8df0-b9ca8bbf912d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:07:17.543251 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9c8a080c-6ce3-4f35-8df0-b9ca8bbf912d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5" status: 200 len: 1391 microversion: 2.1 time: 0.231914 Sep 23 05:07:17.553026 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3119/6409] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:07:17 2022] GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5 => generated 1391 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:07:17.572322 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-00d7d3cf-f04e-4a3a-a628-60a46ed51e09 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:07:17.575171 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-00d7d3cf-f04e-4a3a-a628-60a46ed51e09 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 0d5dd84a-5c19-4af9-bd05-c95d93da0069] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:07:17.588293 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-00d7d3cf-f04e-4a3a-a628-60a46ed51e09 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:17.588893 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-00d7d3cf-f04e-4a3a-a628-60a46ed51e09 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:17.589427 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-00d7d3cf-f04e-4a3a-a628-60a46ed51e09 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:17.591312 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-00d7d3cf-f04e-4a3a-a628-60a46ed51e09 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:17.592370 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-00d7d3cf-f04e-4a3a-a628-60a46ed51e09 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:17.593794 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-00d7d3cf-f04e-4a3a-a628-60a46ed51e09 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:17.667538 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5f548ae5-2ec5-435c-ab4a-9885e5d8ede2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:07:17.668632 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5f548ae5-2ec5-435c-ab4a-9885e5d8ede2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 907407f9-5788-487a-80aa-0782bd4230a5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:07:17.675785 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5f548ae5-2ec5-435c-ab4a-9885e5d8ede2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:17.676676 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5f548ae5-2ec5-435c-ab4a-9885e5d8ede2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:17.677204 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5f548ae5-2ec5-435c-ab4a-9885e5d8ede2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:17.678729 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5f548ae5-2ec5-435c-ab4a-9885e5d8ede2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:17.679381 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5f548ae5-2ec5-435c-ab4a-9885e5d8ede2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:17.680653 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5f548ae5-2ec5-435c-ab4a-9885e5d8ede2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:17.695324 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-00d7d3cf-f04e-4a3a-a628-60a46ed51e09 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/0d5dd84a-5c19-4af9-bd05-c95d93da0069/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.129292 Sep 23 05:07:17.696570 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3291/6410] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Sep 23 05:07:17 2022] GET /compute/v2.1/servers/0d5dd84a-5c19-4af9-bd05-c95d93da0069/os-volume_attachments => generated 25 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 05:07:17.720134 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5f548ae5-2ec5-435c-ab4a-9885e5d8ede2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 907407f9-5788-487a-80aa-0782bd4230a5] Going to try to terminate instance {{(pid=122698) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 05:07:17.803150 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-fd73a9f1-1abf-44a5-90ff-44db01050357 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:07:17.803817 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-fd73a9f1-1abf-44a5-90ff-44db01050357 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 0d5dd84a-5c19-4af9-bd05-c95d93da0069] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:07:17.812370 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fd73a9f1-1abf-44a5-90ff-44db01050357 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:17.815060 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fd73a9f1-1abf-44a5-90ff-44db01050357 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:17.816265 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fd73a9f1-1abf-44a5-90ff-44db01050357 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:17.817265 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fd73a9f1-1abf-44a5-90ff-44db01050357 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:17.817962 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fd73a9f1-1abf-44a5-90ff-44db01050357 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:17.820414 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fd73a9f1-1abf-44a5-90ff-44db01050357 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:17.856415 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-fd73a9f1-1abf-44a5-90ff-44db01050357 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 0d5dd84a-5c19-4af9-bd05-c95d93da0069] Going to try to terminate instance {{(pid=122699) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 05:07:18.278171 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5f548ae5-2ec5-435c-ab4a-9885e5d8ede2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "DELETE /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5" status: 204 len: 0 microversion: 2.1 time: 0.613748 Sep 23 05:07:18.279194 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3120/6411] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 05:07:17 2022] DELETE /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5 => generated 0 bytes in 617 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 23 05:07:18.286554 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-341cd5bd-96c6-4c3b-ba52-fa7f5c010c9d tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:07:18.287338 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-341cd5bd-96c6-4c3b-ba52-fa7f5c010c9d tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] [instance: 428b73b8-21f1-47cb-83bb-df2b45f210dc] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:07:18.364988 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-341cd5bd-96c6-4c3b-ba52-fa7f5c010c9d tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e8ce1f6821424080453f994dbcd604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fefb9fd80184955a7856e1c41d081be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:07:18.379957 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-341cd5bd-96c6-4c3b-ba52-fa7f5c010c9d tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] 10.222.0.33 "GET /compute/v2.1/servers/428b73b8-21f1-47cb-83bb-df2b45f210dc" status: 200 len: 1248 microversion: 2.1 time: 0.098917 Sep 23 05:07:18.380556 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3121/6412] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:07:18 2022] GET /compute/v2.1/servers/428b73b8-21f1-47cb-83bb-df2b45f210dc => generated 1248 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:07:18.385411 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f4032879-2f4f-484a-ac1d-d8a6d9edc2e8 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:07:18.386053 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f4032879-2f4f-484a-ac1d-d8a6d9edc2e8 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 907407f9-5788-487a-80aa-0782bd4230a5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:07:18.392268 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f4032879-2f4f-484a-ac1d-d8a6d9edc2e8 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:18.393135 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f4032879-2f4f-484a-ac1d-d8a6d9edc2e8 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:18.393736 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f4032879-2f4f-484a-ac1d-d8a6d9edc2e8 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:18.394640 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f4032879-2f4f-484a-ac1d-d8a6d9edc2e8 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:18.395291 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f4032879-2f4f-484a-ac1d-d8a6d9edc2e8 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:18.395806 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f4032879-2f4f-484a-ac1d-d8a6d9edc2e8 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:18.452865 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-fd73a9f1-1abf-44a5-90ff-44db01050357 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "DELETE /compute/v2.1/servers/0d5dd84a-5c19-4af9-bd05-c95d93da0069" status: 204 len: 0 microversion: 2.1 time: 0.654776 Sep 23 05:07:18.454028 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3292/6413] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 05:07:17 2022] DELETE /compute/v2.1/servers/0d5dd84a-5c19-4af9-bd05-c95d93da0069 => generated 0 bytes in 657 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 05:07:18.591980 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f4032879-2f4f-484a-ac1d-d8a6d9edc2e8 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:07:18.610557 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f4032879-2f4f-484a-ac1d-d8a6d9edc2e8 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5" status: 200 len: 1397 microversion: 2.1 time: 0.228743 Sep 23 05:07:18.611414 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3122/6414] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:07:18 2022] GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5 => generated 1397 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:07:18.853405 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6ae4a5ed-4b96-4c82-9729-3d912753940d tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:07:18.854160 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-6ae4a5ed-4b96-4c82-9729-3d912753940d tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 0d5dd84a-5c19-4af9-bd05-c95d93da0069] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:07:18.860390 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6ae4a5ed-4b96-4c82-9729-3d912753940d tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:18.860896 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6ae4a5ed-4b96-4c82-9729-3d912753940d tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:18.861401 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6ae4a5ed-4b96-4c82-9729-3d912753940d tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:18.862342 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6ae4a5ed-4b96-4c82-9729-3d912753940d tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:18.862948 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6ae4a5ed-4b96-4c82-9729-3d912753940d tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:18.863390 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6ae4a5ed-4b96-4c82-9729-3d912753940d tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:19.030034 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-6ae4a5ed-4b96-4c82-9729-3d912753940d tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d90150ed7d477fab33129cb3b068ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daad67f26fe246d6b4d28cad1707a119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:07:19.038367 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6ae4a5ed-4b96-4c82-9729-3d912753940d tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/0d5dd84a-5c19-4af9-bd05-c95d93da0069" status: 200 len: 1681 microversion: 2.1 time: 0.579628 Sep 23 05:07:19.039038 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3293/6415] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:07:18 2022] GET /compute/v2.1/servers/0d5dd84a-5c19-4af9-bd05-c95d93da0069 => generated 1681 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:07:19.405782 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5071ea74-d522-488c-9ae8-ee0b5e12c4cb tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:07:19.407989 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5071ea74-d522-488c-9ae8-ee0b5e12c4cb tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] [instance: 428b73b8-21f1-47cb-83bb-df2b45f210dc] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:07:19.419529 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5071ea74-d522-488c-9ae8-ee0b5e12c4cb tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:19.420118 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5071ea74-d522-488c-9ae8-ee0b5e12c4cb tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:19.420636 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5071ea74-d522-488c-9ae8-ee0b5e12c4cb tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:19.421426 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5071ea74-d522-488c-9ae8-ee0b5e12c4cb tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:19.422009 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5071ea74-d522-488c-9ae8-ee0b5e12c4cb tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:19.422550 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5071ea74-d522-488c-9ae8-ee0b5e12c4cb tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:19.522667 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-5071ea74-d522-488c-9ae8-ee0b5e12c4cb tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e8ce1f6821424080453f994dbcd604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fefb9fd80184955a7856e1c41d081be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:07:19.531685 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5071ea74-d522-488c-9ae8-ee0b5e12c4cb tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] 10.222.0.33 "GET /compute/v2.1/servers/428b73b8-21f1-47cb-83bb-df2b45f210dc" status: 200 len: 1252 microversion: 2.1 time: 0.132378 Sep 23 05:07:19.542024 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3123/6416] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:07:19 2022] GET /compute/v2.1/servers/428b73b8-21f1-47cb-83bb-df2b45f210dc => generated 1252 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:07:19.634279 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-255c4d3a-950b-467e-9588-918fde126d1d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:07:19.634900 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-255c4d3a-950b-467e-9588-918fde126d1d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 907407f9-5788-487a-80aa-0782bd4230a5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:07:19.636906 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=4 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:07:19.642346 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-255c4d3a-950b-467e-9588-918fde126d1d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:19.642842 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-255c4d3a-950b-467e-9588-918fde126d1d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:19.649159 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-255c4d3a-950b-467e-9588-918fde126d1d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:19.649159 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-255c4d3a-950b-467e-9588-918fde126d1d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:19.649159 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-255c4d3a-950b-467e-9588-918fde126d1d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:19.649159 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-255c4d3a-950b-467e-9588-918fde126d1d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:19.667724 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:07:19.863762 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-255c4d3a-950b-467e-9588-918fde126d1d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:07:19.874727 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-255c4d3a-950b-467e-9588-918fde126d1d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5" status: 200 len: 1397 microversion: 2.1 time: 0.244632 Sep 23 05:07:19.875313 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3294/6417] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:07:19 2022] GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5 => generated 1397 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:07:20.070755 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-26681fc1-a305-4f95-83c8-a2061999efc1 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:07:20.071389 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-26681fc1-a305-4f95-83c8-a2061999efc1 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 0d5dd84a-5c19-4af9-bd05-c95d93da0069] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:07:20.077675 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-26681fc1-a305-4f95-83c8-a2061999efc1 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:20.088147 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-26681fc1-a305-4f95-83c8-a2061999efc1 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:20.088147 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-26681fc1-a305-4f95-83c8-a2061999efc1 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:20.088147 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-26681fc1-a305-4f95-83c8-a2061999efc1 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:20.088147 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-26681fc1-a305-4f95-83c8-a2061999efc1 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:20.088147 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-26681fc1-a305-4f95-83c8-a2061999efc1 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:20.352321 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-26681fc1-a305-4f95-83c8-a2061999efc1 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d90150ed7d477fab33129cb3b068ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daad67f26fe246d6b4d28cad1707a119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:07:20.363551 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-26681fc1-a305-4f95-83c8-a2061999efc1 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/0d5dd84a-5c19-4af9-bd05-c95d93da0069" status: 200 len: 1681 microversion: 2.1 time: 0.297700 Sep 23 05:07:20.374089 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3124/6418] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:07:20 2022] GET /compute/v2.1/servers/0d5dd84a-5c19-4af9-bd05-c95d93da0069 => generated 1681 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:07:20.556985 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ab1e61b7-bef0-45c5-994a-9b6abdb1f81f tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:07:20.558035 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ab1e61b7-bef0-45c5-994a-9b6abdb1f81f tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] [instance: 428b73b8-21f1-47cb-83bb-df2b45f210dc] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:07:20.564903 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ab1e61b7-bef0-45c5-994a-9b6abdb1f81f tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:20.565753 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ab1e61b7-bef0-45c5-994a-9b6abdb1f81f tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:20.566422 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ab1e61b7-bef0-45c5-994a-9b6abdb1f81f tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:20.567517 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ab1e61b7-bef0-45c5-994a-9b6abdb1f81f tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:20.568256 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ab1e61b7-bef0-45c5-994a-9b6abdb1f81f tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:20.569389 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ab1e61b7-bef0-45c5-994a-9b6abdb1f81f tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:20.670068 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ab1e61b7-bef0-45c5-994a-9b6abdb1f81f tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e8ce1f6821424080453f994dbcd604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fefb9fd80184955a7856e1c41d081be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:07:20.681238 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ab1e61b7-bef0-45c5-994a-9b6abdb1f81f tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] 10.222.0.33 "GET /compute/v2.1/servers/428b73b8-21f1-47cb-83bb-df2b45f210dc" status: 200 len: 1244 microversion: 2.1 time: 0.128833 Sep 23 05:07:20.683062 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3295/6419] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:07:20 2022] GET /compute/v2.1/servers/428b73b8-21f1-47cb-83bb-df2b45f210dc => generated 1244 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:07:20.917515 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ff8262d1-61fc-401c-8371-c007b756cd79 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:07:20.919712 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-ff8262d1-61fc-401c-8371-c007b756cd79 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 907407f9-5788-487a-80aa-0782bd4230a5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:07:20.933486 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ff8262d1-61fc-401c-8371-c007b756cd79 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:20.934626 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ff8262d1-61fc-401c-8371-c007b756cd79 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:20.935305 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ff8262d1-61fc-401c-8371-c007b756cd79 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:20.936438 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ff8262d1-61fc-401c-8371-c007b756cd79 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:20.943705 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ff8262d1-61fc-401c-8371-c007b756cd79 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:20.945066 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ff8262d1-61fc-401c-8371-c007b756cd79 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:21.152427 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ff8262d1-61fc-401c-8371-c007b756cd79 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:07:21.161803 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ff8262d1-61fc-401c-8371-c007b756cd79 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5" status: 200 len: 1397 microversion: 2.1 time: 0.265350 Sep 23 05:07:21.163507 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3125/6420] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:07:20 2022] GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5 => generated 1397 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:07:21.394519 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3b8850f3-dc00-4af2-9d67-579922adb5f0 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:07:21.395256 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-3b8850f3-dc00-4af2-9d67-579922adb5f0 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 0d5dd84a-5c19-4af9-bd05-c95d93da0069] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:07:21.415977 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3b8850f3-dc00-4af2-9d67-579922adb5f0 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:21.416841 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3b8850f3-dc00-4af2-9d67-579922adb5f0 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:21.417478 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3b8850f3-dc00-4af2-9d67-579922adb5f0 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:21.418716 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3b8850f3-dc00-4af2-9d67-579922adb5f0 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:21.419418 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3b8850f3-dc00-4af2-9d67-579922adb5f0 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:21.420036 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3b8850f3-dc00-4af2-9d67-579922adb5f0 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:21.759956 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-3b8850f3-dc00-4af2-9d67-579922adb5f0 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d90150ed7d477fab33129cb3b068ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daad67f26fe246d6b4d28cad1707a119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:07:21.797325 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3b8850f3-dc00-4af2-9d67-579922adb5f0 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/0d5dd84a-5c19-4af9-bd05-c95d93da0069" status: 200 len: 1681 microversion: 2.1 time: 0.406845 Sep 23 05:07:21.805429 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3296/6421] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:07:21 2022] GET /compute/v2.1/servers/0d5dd84a-5c19-4af9-bd05-c95d93da0069 => generated 1681 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:07:21.823232 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-cba2bfa2-50dd-49ee-95aa-db1f8e6b427f tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:07:21.827485 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-cba2bfa2-50dd-49ee-95aa-db1f8e6b427f tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] [instance: 428b73b8-21f1-47cb-83bb-df2b45f210dc] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:07:21.850226 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cba2bfa2-50dd-49ee-95aa-db1f8e6b427f tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:21.850226 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cba2bfa2-50dd-49ee-95aa-db1f8e6b427f tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:21.850226 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cba2bfa2-50dd-49ee-95aa-db1f8e6b427f tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:21.850226 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cba2bfa2-50dd-49ee-95aa-db1f8e6b427f tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:21.850226 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cba2bfa2-50dd-49ee-95aa-db1f8e6b427f tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:21.850226 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cba2bfa2-50dd-49ee-95aa-db1f8e6b427f tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:21.857353 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-c1900324-9060-48df-9692-9e8da349550f req-3ac98371-5a08-4dee-84b3-862f0b01b41a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "907407f9-5788-487a-80aa-0782bd4230a5", "name": "network-vif-deleted", "tag": "f3bf0e41-8570-4941-85cf-568159f808b9"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:07:21.887835 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-c1900324-9060-48df-9692-9e8da349550f req-3ac98371-5a08-4dee-84b3-862f0b01b41a service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:21.888314 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-c1900324-9060-48df-9692-9e8da349550f req-3ac98371-5a08-4dee-84b3-862f0b01b41a service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:21.888768 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-c1900324-9060-48df-9692-9e8da349550f req-3ac98371-5a08-4dee-84b3-862f0b01b41a service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:21.902611 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-c1900324-9060-48df-9692-9e8da349550f req-3ac98371-5a08-4dee-84b3-862f0b01b41a service nova] Creating event network-vif-deleted:f3bf0e41-8570-4941-85cf-568159f808b9 for instance 907407f9-5788-487a-80aa-0782bd4230a5 on n-h1-846463-3 Sep 23 05:07:21.908466 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-c1900324-9060-48df-9692-9e8da349550f req-3ac98371-5a08-4dee-84b3-862f0b01b41a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.424788 Sep 23 05:07:21.909837 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3126/6422] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:07:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:07:21.987303 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-cba2bfa2-50dd-49ee-95aa-db1f8e6b427f tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e8ce1f6821424080453f994dbcd604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fefb9fd80184955a7856e1c41d081be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:07:22.001984 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-cba2bfa2-50dd-49ee-95aa-db1f8e6b427f tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] 10.222.0.33 "GET /compute/v2.1/servers/428b73b8-21f1-47cb-83bb-df2b45f210dc" status: 200 len: 1308 microversion: 2.1 time: 0.191077 Sep 23 05:07:22.016466 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3297/6423] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:07:21 2022] GET /compute/v2.1/servers/428b73b8-21f1-47cb-83bb-df2b45f210dc => generated 1308 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:07:22.188498 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c24b4937-828c-4379-92d2-8958d139f5eb tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:07:22.189217 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c24b4937-828c-4379-92d2-8958d139f5eb tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 907407f9-5788-487a-80aa-0782bd4230a5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:07:22.196610 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c24b4937-828c-4379-92d2-8958d139f5eb tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:22.197368 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c24b4937-828c-4379-92d2-8958d139f5eb tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:22.197995 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c24b4937-828c-4379-92d2-8958d139f5eb tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:22.198877 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c24b4937-828c-4379-92d2-8958d139f5eb tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:22.206334 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c24b4937-828c-4379-92d2-8958d139f5eb tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:22.207232 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c24b4937-828c-4379-92d2-8958d139f5eb tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:22.278462 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c24b4937-828c-4379-92d2-8958d139f5eb tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:07:22.290223 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c24b4937-828c-4379-92d2-8958d139f5eb tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5" status: 200 len: 1188 microversion: 2.1 time: 0.107033 Sep 23 05:07:22.322921 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3127/6424] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:07:22 2022] GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5 => generated 1188 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:07:22.831612 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-757430f6-bb14-441a-97ae-1ae1741597e3 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:07:22.832255 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-757430f6-bb14-441a-97ae-1ae1741597e3 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 0d5dd84a-5c19-4af9-bd05-c95d93da0069] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:07:22.859570 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-757430f6-bb14-441a-97ae-1ae1741597e3 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:22.859570 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-757430f6-bb14-441a-97ae-1ae1741597e3 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:22.859570 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-757430f6-bb14-441a-97ae-1ae1741597e3 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:22.861571 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-757430f6-bb14-441a-97ae-1ae1741597e3 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:22.863543 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-757430f6-bb14-441a-97ae-1ae1741597e3 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:22.864039 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-757430f6-bb14-441a-97ae-1ae1741597e3 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:23.039986 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d1d86951-bb20-4cc8-82f1-cb0764e6f32a tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:07:23.040868 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d1d86951-bb20-4cc8-82f1-cb0764e6f32a tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] [instance: 428b73b8-21f1-47cb-83bb-df2b45f210dc] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:07:23.061804 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d1d86951-bb20-4cc8-82f1-cb0764e6f32a tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:23.062353 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d1d86951-bb20-4cc8-82f1-cb0764e6f32a tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:23.062804 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d1d86951-bb20-4cc8-82f1-cb0764e6f32a tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:23.063530 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d1d86951-bb20-4cc8-82f1-cb0764e6f32a tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:23.064003 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d1d86951-bb20-4cc8-82f1-cb0764e6f32a tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:23.064443 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d1d86951-bb20-4cc8-82f1-cb0764e6f32a tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:23.121026 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-757430f6-bb14-441a-97ae-1ae1741597e3 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d90150ed7d477fab33129cb3b068ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daad67f26fe246d6b4d28cad1707a119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:07:23.138345 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-757430f6-bb14-441a-97ae-1ae1741597e3 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/0d5dd84a-5c19-4af9-bd05-c95d93da0069" status: 200 len: 1613 microversion: 2.1 time: 0.309541 Sep 23 05:07:23.158081 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3298/6425] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:07:22 2022] GET /compute/v2.1/servers/0d5dd84a-5c19-4af9-bd05-c95d93da0069 => generated 1613 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:07:23.207235 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d1d86951-bb20-4cc8-82f1-cb0764e6f32a tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e8ce1f6821424080453f994dbcd604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fefb9fd80184955a7856e1c41d081be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:07:23.240047 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d1d86951-bb20-4cc8-82f1-cb0764e6f32a tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] 10.222.0.33 "GET /compute/v2.1/servers/428b73b8-21f1-47cb-83bb-df2b45f210dc" status: 200 len: 1306 microversion: 2.1 time: 0.202197 Sep 23 05:07:23.251204 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3128/6426] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:07:23 2022] GET /compute/v2.1/servers/428b73b8-21f1-47cb-83bb-df2b45f210dc => generated 1306 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:07:23.340357 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ed8919e8-79f3-4ebe-8315-a1cf0162a33e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:07:23.341082 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ed8919e8-79f3-4ebe-8315-a1cf0162a33e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 907407f9-5788-487a-80aa-0782bd4230a5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:07:23.348809 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ed8919e8-79f3-4ebe-8315-a1cf0162a33e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:23.350173 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ed8919e8-79f3-4ebe-8315-a1cf0162a33e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:23.350790 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ed8919e8-79f3-4ebe-8315-a1cf0162a33e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:23.351672 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ed8919e8-79f3-4ebe-8315-a1cf0162a33e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:23.352296 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ed8919e8-79f3-4ebe-8315-a1cf0162a33e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:23.352885 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ed8919e8-79f3-4ebe-8315-a1cf0162a33e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:23.482651 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ed8919e8-79f3-4ebe-8315-a1cf0162a33e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:07:23.511494 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ed8919e8-79f3-4ebe-8315-a1cf0162a33e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5" status: 200 len: 1188 microversion: 2.1 time: 0.195173 Sep 23 05:07:23.532075 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3299/6427] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:07:23 2022] GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5 => generated 1188 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:07:24.018246 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-5666d648-7a6b-4b67-abba-93955bc1dc03 req-5d01ce04-91a1-44aa-8af4-ef990aef6226 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d5dd84a-5c19-4af9-bd05-c95d93da0069", "name": "network-vif-deleted", "tag": "5835071a-ff9e-4eb0-8397-f6d087882ded"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:07:24.050265 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-5666d648-7a6b-4b67-abba-93955bc1dc03 req-5d01ce04-91a1-44aa-8af4-ef990aef6226 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:24.061225 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-5666d648-7a6b-4b67-abba-93955bc1dc03 req-5d01ce04-91a1-44aa-8af4-ef990aef6226 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:24.061225 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-5666d648-7a6b-4b67-abba-93955bc1dc03 req-5d01ce04-91a1-44aa-8af4-ef990aef6226 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:24.122908 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-5666d648-7a6b-4b67-abba-93955bc1dc03 req-5d01ce04-91a1-44aa-8af4-ef990aef6226 service nova] Creating event network-vif-deleted:5835071a-ff9e-4eb0-8397-f6d087882ded for instance 0d5dd84a-5c19-4af9-bd05-c95d93da0069 on n-h2-846463-3 Sep 23 05:07:24.135680 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-5666d648-7a6b-4b67-abba-93955bc1dc03 req-5d01ce04-91a1-44aa-8af4-ef990aef6226 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130223 Sep 23 05:07:24.138996 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3129/6428] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:07:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:07:24.170375 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-fcc27206-c730-41ec-be7a-7cc6941e96ca tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:07:24.172510 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-fcc27206-c730-41ec-be7a-7cc6941e96ca tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 0d5dd84a-5c19-4af9-bd05-c95d93da0069] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:07:24.190673 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fcc27206-c730-41ec-be7a-7cc6941e96ca tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:24.194241 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fcc27206-c730-41ec-be7a-7cc6941e96ca tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:24.194723 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fcc27206-c730-41ec-be7a-7cc6941e96ca tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:24.195491 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fcc27206-c730-41ec-be7a-7cc6941e96ca tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:24.196131 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fcc27206-c730-41ec-be7a-7cc6941e96ca tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:24.196579 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fcc27206-c730-41ec-be7a-7cc6941e96ca tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:24.261675 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fcc27206-c730-41ec-be7a-7cc6941e96ca tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:24.274760 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-846f858a-5864-405f-8faf-2a0cdfab1ccd tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:07:24.275290 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fcc27206-c730-41ec-be7a-7cc6941e96ca tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:24.275499 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-846f858a-5864-405f-8faf-2a0cdfab1ccd tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] [instance: 428b73b8-21f1-47cb-83bb-df2b45f210dc] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:07:24.275622 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fcc27206-c730-41ec-be7a-7cc6941e96ca tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:24.276313 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-fcc27206-c730-41ec-be7a-7cc6941e96ca tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lazy-loading 'fault' on Instance uuid 0d5dd84a-5c19-4af9-bd05-c95d93da0069 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 05:07:24.297878 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-846f858a-5864-405f-8faf-2a0cdfab1ccd tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:24.298419 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-846f858a-5864-405f-8faf-2a0cdfab1ccd tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:24.302920 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-846f858a-5864-405f-8faf-2a0cdfab1ccd tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:24.304020 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-846f858a-5864-405f-8faf-2a0cdfab1ccd tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:24.305439 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-846f858a-5864-405f-8faf-2a0cdfab1ccd tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:24.306101 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-846f858a-5864-405f-8faf-2a0cdfab1ccd tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:24.389626 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-fcc27206-c730-41ec-be7a-7cc6941e96ca tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d90150ed7d477fab33129cb3b068ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daad67f26fe246d6b4d28cad1707a119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:07:24.408815 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-fcc27206-c730-41ec-be7a-7cc6941e96ca tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/0d5dd84a-5c19-4af9-bd05-c95d93da0069" status: 200 len: 1331 microversion: 2.1 time: 0.244521 Sep 23 05:07:24.425696 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3300/6429] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:07:24 2022] GET /compute/v2.1/servers/0d5dd84a-5c19-4af9-bd05-c95d93da0069 => generated 1331 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:07:24.549532 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b5362132-71dd-4602-809e-cc932e504e6b tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:07:24.559319 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b5362132-71dd-4602-809e-cc932e504e6b tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 907407f9-5788-487a-80aa-0782bd4230a5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:07:24.574236 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b5362132-71dd-4602-809e-cc932e504e6b tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:24.578532 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b5362132-71dd-4602-809e-cc932e504e6b tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:24.579492 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b5362132-71dd-4602-809e-cc932e504e6b tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:24.580480 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b5362132-71dd-4602-809e-cc932e504e6b tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:24.581186 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b5362132-71dd-4602-809e-cc932e504e6b tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:24.585559 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b5362132-71dd-4602-809e-cc932e504e6b tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:24.875173 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b5362132-71dd-4602-809e-cc932e504e6b tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:07:24.907394 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b5362132-71dd-4602-809e-cc932e504e6b tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5" status: 200 len: 1188 microversion: 2.1 time: 0.351500 Sep 23 05:07:24.923183 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3301/6430] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:07:24 2022] GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5 => generated 1188 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:07:24.945800 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-846f858a-5864-405f-8faf-2a0cdfab1ccd tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e8ce1f6821424080453f994dbcd604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fefb9fd80184955a7856e1c41d081be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:07:24.957839 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-846f858a-5864-405f-8faf-2a0cdfab1ccd tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] 10.222.0.33 "GET /compute/v2.1/servers/428b73b8-21f1-47cb-83bb-df2b45f210dc" status: 200 len: 1374 microversion: 2.1 time: 0.692835 Sep 23 05:07:24.973620 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3130/6431] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:07:24 2022] GET /compute/v2.1/servers/428b73b8-21f1-47cb-83bb-df2b45f210dc => generated 1374 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:07:25.433608 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a6a406f7-bc1f-4495-a16c-105669c19456 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:07:25.434887 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a6a406f7-bc1f-4495-a16c-105669c19456 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 0d5dd84a-5c19-4af9-bd05-c95d93da0069] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:07:25.451941 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a6a406f7-bc1f-4495-a16c-105669c19456 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:25.458605 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a6a406f7-bc1f-4495-a16c-105669c19456 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:25.459916 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a6a406f7-bc1f-4495-a16c-105669c19456 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:25.460780 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a6a406f7-bc1f-4495-a16c-105669c19456 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:25.461377 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a6a406f7-bc1f-4495-a16c-105669c19456 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:25.462075 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a6a406f7-bc1f-4495-a16c-105669c19456 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:25.491708 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-a6a406f7-bc1f-4495-a16c-105669c19456 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] HTTP exception thrown: Instance 0d5dd84a-5c19-4af9-bd05-c95d93da0069 could not be found. Sep 23 05:07:25.493556 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a6a406f7-bc1f-4495-a16c-105669c19456 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Request method failure captured: Sep 23 05:07:25.493556 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/0d5dd84a-5c19-4af9-bd05-c95d93da0069 HTTP/1.1 Sep 23 05:07:25.493556 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 05:07:25.493556 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 05:07:25.493556 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 05:07:25.493556 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 05:07:25.493556 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 05:07:25.493556 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 05:07:25.493556 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 05:07:25.493556 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 05:07:25.493556 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLT3a68wnGhJ1ri_wJa0c61-k-Mmu1aJqy0y8F08NYCjz_D70vilLx9G5I0GwzbhL1w2apyr58UgTWfFCoyEumWwAPT_5jEMZEFbxFGBL8lKHDufPcaCD0r7hhVTJQk-EQJ3nL8ZwWE56HAQoDgwteQ7RqvbmQmN2QkHgdyJgN3h_vQg Sep 23 05:07:25.493556 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 05:07:25.493556 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 05:07:25.493556 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 05:07:25.493556 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 05:07:25.493556 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 05:07:25.493556 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 05:07:25.493556 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: daad67f26fe246d6b4d28cad1707a119 Sep 23 05:07:25.493556 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-AttachVolumeNegativeTest-1007727461 Sep 23 05:07:25.493556 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 05:07:25.493556 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 05:07:25.493556 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_daad67f26fe246d6b4d28cad1707a119", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/daad67f26fe246d6b4d28cad1707a119"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/daad67f26fe246d6b4d28cad1707a119"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/daad67f26fe246d6b4d28cad1707a119"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:07:25.493556 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-AttachVolumeNegativeTest-1007727461 Sep 23 05:07:25.493556 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: daad67f26fe246d6b4d28cad1707a119 Sep 23 05:07:25.493556 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1007727461 Sep 23 05:07:25.493556 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-AttachVolumeNegativeTest-1007727461-project Sep 23 05:07:25.493556 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 05:07:25.493556 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 05:07:25.493556 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 59d90150ed7d477fab33129cb3b068ed Sep 23 05:07:25.493556 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-AttachVolumeNegativeTest-1007727461-project Sep 23 05:07:25.493556 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 05:07:25.493556 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 0d5dd84a-5c19-4af9-bd05-c95d93da0069 could not be found. Sep 23 05:07:25.493556 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '0d5dd84a-5c19-4af9-bd05-c95d93da0069'} Sep 23 05:07:25.493556 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:07:25.493556 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:07:25.493556 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 05:07:25.493556 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 05:07:25.493556 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 05:07:25.493556 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 05:07:25.493556 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 05:07:25.493556 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 05:07:25.493556 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 05:07:25.493556 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 05:07:25.493556 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d5dd84a-5c19-4af9-bd05-c95d93da0069 could not be found. Sep 23 05:07:25.493556 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:07:25.493556 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:07:25.493556 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:07:25.493556 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:07:25.493556 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:07:25.493556 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:07:25.493556 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:07:25.493556 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:07:25.493556 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:07:25.493556 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:07:25.493556 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 05:07:25.493556 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 05:07:25.493556 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 05:07:25.493556 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 05:07:25.493556 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 05:07:25.493556 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:07:25.493556 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d5dd84a-5c19-4af9-bd05-c95d93da0069 could not be found. Sep 23 05:07:25.493556 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:07:25.493556 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:07:25.493556 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:07:25.497866 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:07:25.497866 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:07:25.497866 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:07:25.497866 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:07:25.497866 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:07:25.497866 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d5dd84a-5c19-4af9-bd05-c95d93da0069 could not be found. Sep 23 05:07:25.497866 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:07:25.510742 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a6a406f7-bc1f-4495-a16c-105669c19456 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Returning 404 to user: Instance 0d5dd84a-5c19-4af9-bd05-c95d93da0069 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:07:25.511801 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a6a406f7-bc1f-4495-a16c-105669c19456 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/0d5dd84a-5c19-4af9-bd05-c95d93da0069" status: 404 len: 111 microversion: 2.1 time: 0.082473 Sep 23 05:07:25.515959 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3302/6432] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:07:25 2022] GET /compute/v2.1/servers/0d5dd84a-5c19-4af9-bd05-c95d93da0069 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 05:07:25.522856 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2fce7b9f-829f-4d47-9a41-61756cca630f tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '.version_select at 0x7ff1baa7d790>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:07:25.643989 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2fce7b9f-829f-4d47-9a41-61756cca630f tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1325542104" status: 202 len: 0 microversion: 2.1 time: 0.126567 Sep 23 05:07:25.645185 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3131/6433] 10.222.0.33 () {58 vars in 1221 bytes} [Fri Sep 23 05:07:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1325542104 => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 05:07:25.946400 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9327cc88-654e-4020-84a3-45021f813168 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:07:25.947240 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-9327cc88-654e-4020-84a3-45021f813168 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 907407f9-5788-487a-80aa-0782bd4230a5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:07:25.976864 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9327cc88-654e-4020-84a3-45021f813168 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:25.976864 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9327cc88-654e-4020-84a3-45021f813168 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:25.976864 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9327cc88-654e-4020-84a3-45021f813168 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:25.976864 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9327cc88-654e-4020-84a3-45021f813168 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:25.976864 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9327cc88-654e-4020-84a3-45021f813168 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:25.988892 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-cc732520-d232-4e6b-9365-dec0656fb4d3 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:07:25.990886 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-cc732520-d232-4e6b-9365-dec0656fb4d3 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] [instance: 428b73b8-21f1-47cb-83bb-df2b45f210dc] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:07:25.991584 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9327cc88-654e-4020-84a3-45021f813168 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:26.026602 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cc732520-d232-4e6b-9365-dec0656fb4d3 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:26.027441 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cc732520-d232-4e6b-9365-dec0656fb4d3 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:26.028203 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cc732520-d232-4e6b-9365-dec0656fb4d3 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:26.029543 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cc732520-d232-4e6b-9365-dec0656fb4d3 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:26.031466 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cc732520-d232-4e6b-9365-dec0656fb4d3 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:26.032205 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cc732520-d232-4e6b-9365-dec0656fb4d3 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:26.206876 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-9327cc88-654e-4020-84a3-45021f813168 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:07:26.243453 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-9327cc88-654e-4020-84a3-45021f813168 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5" status: 200 len: 1188 microversion: 2.1 time: 0.307649 Sep 23 05:07:26.254635 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3303/6434] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:07:25 2022] GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5 => generated 1188 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:07:26.438849 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-cc732520-d232-4e6b-9365-dec0656fb4d3 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e8ce1f6821424080453f994dbcd604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fefb9fd80184955a7856e1c41d081be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:07:26.454003 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-cc732520-d232-4e6b-9365-dec0656fb4d3 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] 10.222.0.33 "GET /compute/v2.1/servers/428b73b8-21f1-47cb-83bb-df2b45f210dc" status: 200 len: 1374 microversion: 2.1 time: 0.471250 Sep 23 05:07:26.456010 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3132/6435] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:07:25 2022] GET /compute/v2.1/servers/428b73b8-21f1-47cb-83bb-df2b45f210dc => generated 1374 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:07:26.956198 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-8049abd9-fd36-4c93-9772-e40a0e60e36e req-be3a4676-8f08-4a12-b96b-1c51fcf501fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "428b73b8-21f1-47cb-83bb-df2b45f210dc", "tag": "0bce6435-2556-4f98-8e9f-841185913c4c"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:07:26.984936 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-8049abd9-fd36-4c93-9772-e40a0e60e36e req-be3a4676-8f08-4a12-b96b-1c51fcf501fb service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:26.985449 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-8049abd9-fd36-4c93-9772-e40a0e60e36e req-be3a4676-8f08-4a12-b96b-1c51fcf501fb service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:26.985919 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-8049abd9-fd36-4c93-9772-e40a0e60e36e req-be3a4676-8f08-4a12-b96b-1c51fcf501fb service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:27.043026 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-8049abd9-fd36-4c93-9772-e40a0e60e36e req-be3a4676-8f08-4a12-b96b-1c51fcf501fb service nova] Creating event network-changed:0bce6435-2556-4f98-8e9f-841185913c4c for instance 428b73b8-21f1-47cb-83bb-df2b45f210dc on n-h2-846463-3 Sep 23 05:07:27.054357 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-8049abd9-fd36-4c93-9772-e40a0e60e36e req-be3a4676-8f08-4a12-b96b-1c51fcf501fb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097669 Sep 23 05:07:27.055383 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3304/6436] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:07:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:07:27.269999 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1118f376-2d0e-42b2-b225-f718fae7d4f8 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:07:27.270757 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-1118f376-2d0e-42b2-b225-f718fae7d4f8 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 907407f9-5788-487a-80aa-0782bd4230a5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:07:27.288130 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:07:27.292228 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1118f376-2d0e-42b2-b225-f718fae7d4f8 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:27.292740 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1118f376-2d0e-42b2-b225-f718fae7d4f8 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:27.295043 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1118f376-2d0e-42b2-b225-f718fae7d4f8 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:27.297359 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1118f376-2d0e-42b2-b225-f718fae7d4f8 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:27.301682 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1118f376-2d0e-42b2-b225-f718fae7d4f8 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:27.302180 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1118f376-2d0e-42b2-b225-f718fae7d4f8 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:27.465618 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-1118f376-2d0e-42b2-b225-f718fae7d4f8 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:07:27.476283 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:07:27.479069 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-1118f376-2d0e-42b2-b225-f718fae7d4f8 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5" status: 200 len: 1188 microversion: 2.1 time: 0.213353 Sep 23 05:07:27.482110 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3133/6437] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:07:27 2022] GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5 => generated 1188 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:07:27.499392 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f0bf3fa6-a7bd-481e-a44d-1ec2ab8128f4 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:07:27.500409 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f0bf3fa6-a7bd-481e-a44d-1ec2ab8128f4 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] [instance: 428b73b8-21f1-47cb-83bb-df2b45f210dc] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:07:27.525626 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f0bf3fa6-a7bd-481e-a44d-1ec2ab8128f4 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:27.527517 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f0bf3fa6-a7bd-481e-a44d-1ec2ab8128f4 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:27.528030 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f0bf3fa6-a7bd-481e-a44d-1ec2ab8128f4 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:27.535178 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f0bf3fa6-a7bd-481e-a44d-1ec2ab8128f4 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:27.536059 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-bd5486a6-4f6f-48de-ac91-468581d21b94 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Action: 'create', calling method: .version_select at 0x7ff1bbbfe820>, body: {"keypair": {"name": "tempest-keypair-158534011", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBClngP0KgPVrvt2KEDmNsgdT0928bR2mm9qCpfYVeZ/XozTk/JWg0Gk14+5u/uGwG95vudD1KQ3N0eOpdajspQkWRvNqQnaEllXi7eiXgHSMekPFVlzxsGI6MDs3NrqWgw=="}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:07:27.551622 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f0bf3fa6-a7bd-481e-a44d-1ec2ab8128f4 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:27.554012 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f0bf3fa6-a7bd-481e-a44d-1ec2ab8128f4 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:27.587667 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-bd5486a6-4f6f-48de-ac91-468581d21b94 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Getting quotas for project daad67f26fe246d6b4d28cad1707a119. Resources: {'key_pairs'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 05:07:27.604727 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-bd5486a6-4f6f-48de-ac91-468581d21b94 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Getting quotas for user 59d90150ed7d477fab33129cb3b068ed and project daad67f26fe246d6b4d28cad1707a119. Resources: {'key_pairs'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 05:07:27.780628 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-bd5486a6-4f6f-48de-ac91-468581d21b94 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.250933 Sep 23 05:07:27.781807 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3134/6438] 10.222.0.33 () {60 vars in 1159 bytes} [Fri Sep 23 05:07:27 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Sep 23 05:07:27.911345 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f0bf3fa6-a7bd-481e-a44d-1ec2ab8128f4 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e8ce1f6821424080453f994dbcd604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fefb9fd80184955a7856e1c41d081be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:07:27.938450 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f0bf3fa6-a7bd-481e-a44d-1ec2ab8128f4 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] 10.222.0.33 "GET /compute/v2.1/servers/428b73b8-21f1-47cb-83bb-df2b45f210dc" status: 200 len: 1374 microversion: 2.1 time: 0.452271 Sep 23 05:07:27.967061 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3305/6439] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:07:27 2022] GET /compute/v2.1/servers/428b73b8-21f1-47cb-83bb-df2b45f210dc => generated 1374 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:07:28.514849 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-877dcc81-5119-42ad-abc8-c70b39a21563 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:07:28.516659 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-877dcc81-5119-42ad-abc8-c70b39a21563 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 907407f9-5788-487a-80aa-0782bd4230a5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:07:28.530876 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-877dcc81-5119-42ad-abc8-c70b39a21563 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:28.532315 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-877dcc81-5119-42ad-abc8-c70b39a21563 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:28.536308 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-877dcc81-5119-42ad-abc8-c70b39a21563 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:28.536308 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-877dcc81-5119-42ad-abc8-c70b39a21563 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:28.536308 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-877dcc81-5119-42ad-abc8-c70b39a21563 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:28.536308 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-877dcc81-5119-42ad-abc8-c70b39a21563 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:28.658596 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-877dcc81-5119-42ad-abc8-c70b39a21563 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:07:28.674732 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-877dcc81-5119-42ad-abc8-c70b39a21563 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5" status: 200 len: 1188 microversion: 2.1 time: 0.164387 Sep 23 05:07:28.691219 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3135/6440] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:07:28 2022] GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5 => generated 1188 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:07:28.966638 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d03b286a-8a02-4494-81eb-2a0e9bdce686 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:07:28.967298 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d03b286a-8a02-4494-81eb-2a0e9bdce686 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] [instance: 428b73b8-21f1-47cb-83bb-df2b45f210dc] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:07:28.980970 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d03b286a-8a02-4494-81eb-2a0e9bdce686 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:28.981682 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d03b286a-8a02-4494-81eb-2a0e9bdce686 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:28.985758 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d03b286a-8a02-4494-81eb-2a0e9bdce686 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:28.991368 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d03b286a-8a02-4494-81eb-2a0e9bdce686 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:28.992133 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d03b286a-8a02-4494-81eb-2a0e9bdce686 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:28.997212 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d03b286a-8a02-4494-81eb-2a0e9bdce686 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:29.593290 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d03b286a-8a02-4494-81eb-2a0e9bdce686 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e8ce1f6821424080453f994dbcd604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fefb9fd80184955a7856e1c41d081be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:07:29.607904 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d03b286a-8a02-4494-81eb-2a0e9bdce686 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] 10.222.0.33 "GET /compute/v2.1/servers/428b73b8-21f1-47cb-83bb-df2b45f210dc" status: 200 len: 1374 microversion: 2.1 time: 0.643067 Sep 23 05:07:29.608775 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3306/6441] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:07:28 2022] GET /compute/v2.1/servers/428b73b8-21f1-47cb-83bb-df2b45f210dc => generated 1374 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:07:29.700766 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ede6ae64-cb76-48c2-bcc1-05237271f3ca tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:07:29.702132 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-ede6ae64-cb76-48c2-bcc1-05237271f3ca tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 907407f9-5788-487a-80aa-0782bd4230a5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:07:29.712674 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ede6ae64-cb76-48c2-bcc1-05237271f3ca tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:29.716977 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ede6ae64-cb76-48c2-bcc1-05237271f3ca tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:29.719275 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ede6ae64-cb76-48c2-bcc1-05237271f3ca tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:29.720941 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ede6ae64-cb76-48c2-bcc1-05237271f3ca tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:29.723004 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ede6ae64-cb76-48c2-bcc1-05237271f3ca tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:29.724042 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ede6ae64-cb76-48c2-bcc1-05237271f3ca tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:29.840481 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ede6ae64-cb76-48c2-bcc1-05237271f3ca tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:07:29.855453 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ede6ae64-cb76-48c2-bcc1-05237271f3ca tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5" status: 200 len: 1188 microversion: 2.1 time: 0.159365 Sep 23 05:07:29.856124 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3136/6442] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:07:29 2022] GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5 => generated 1188 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:07:30.639100 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b1a5526e-09dd-4efd-81fc-d6b9f109dc89 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:07:30.639991 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b1a5526e-09dd-4efd-81fc-d6b9f109dc89 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] [instance: 428b73b8-21f1-47cb-83bb-df2b45f210dc] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:07:30.659291 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b1a5526e-09dd-4efd-81fc-d6b9f109dc89 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:30.660076 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b1a5526e-09dd-4efd-81fc-d6b9f109dc89 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:30.660696 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b1a5526e-09dd-4efd-81fc-d6b9f109dc89 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:30.661563 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b1a5526e-09dd-4efd-81fc-d6b9f109dc89 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:30.662378 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b1a5526e-09dd-4efd-81fc-d6b9f109dc89 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:30.662985 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b1a5526e-09dd-4efd-81fc-d6b9f109dc89 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:30.882224 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ffdd2ba1-3526-449f-aaab-bd8672505f33 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:07:30.883378 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-ffdd2ba1-3526-449f-aaab-bd8672505f33 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 907407f9-5788-487a-80aa-0782bd4230a5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:07:30.891585 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ffdd2ba1-3526-449f-aaab-bd8672505f33 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:30.892375 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ffdd2ba1-3526-449f-aaab-bd8672505f33 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:30.892994 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ffdd2ba1-3526-449f-aaab-bd8672505f33 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:30.893938 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ffdd2ba1-3526-449f-aaab-bd8672505f33 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:30.894549 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ffdd2ba1-3526-449f-aaab-bd8672505f33 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:30.895127 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ffdd2ba1-3526-449f-aaab-bd8672505f33 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:30.943232 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ffdd2ba1-3526-449f-aaab-bd8672505f33 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:30.943232 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ffdd2ba1-3526-449f-aaab-bd8672505f33 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:30.943232 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ffdd2ba1-3526-449f-aaab-bd8672505f33 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:30.943232 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-ffdd2ba1-3526-449f-aaab-bd8672505f33 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lazy-loading 'fault' on Instance uuid 907407f9-5788-487a-80aa-0782bd4230a5 {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 05:07:31.068411 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ffdd2ba1-3526-449f-aaab-bd8672505f33 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:07:31.091836 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ffdd2ba1-3526-449f-aaab-bd8672505f33 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5" status: 200 len: 1193 microversion: 2.1 time: 0.212446 Sep 23 05:07:31.094078 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3137/6443] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:07:30 2022] GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5 => generated 1193 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:07:31.152345 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b1a5526e-09dd-4efd-81fc-d6b9f109dc89 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e8ce1f6821424080453f994dbcd604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fefb9fd80184955a7856e1c41d081be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:07:31.162548 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b1a5526e-09dd-4efd-81fc-d6b9f109dc89 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] 10.222.0.33 "GET /compute/v2.1/servers/428b73b8-21f1-47cb-83bb-df2b45f210dc" status: 200 len: 1374 microversion: 2.1 time: 0.528608 Sep 23 05:07:31.163337 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3307/6444] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:07:30 2022] GET /compute/v2.1/servers/428b73b8-21f1-47cb-83bb-df2b45f210dc => generated 1374 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:07:32.127636 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5aaeb064-b1df-4686-8804-ea60d67272fa tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:07:32.129105 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5aaeb064-b1df-4686-8804-ea60d67272fa tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 907407f9-5788-487a-80aa-0782bd4230a5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:07:32.159337 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5aaeb064-b1df-4686-8804-ea60d67272fa tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:32.163093 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5aaeb064-b1df-4686-8804-ea60d67272fa tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:32.164521 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5aaeb064-b1df-4686-8804-ea60d67272fa tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:32.165817 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5aaeb064-b1df-4686-8804-ea60d67272fa tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:32.166921 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5aaeb064-b1df-4686-8804-ea60d67272fa tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:32.168562 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5aaeb064-b1df-4686-8804-ea60d67272fa tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:32.193377 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-11e02500-3e03-4700-aefa-bc7051ca12cc tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:07:32.197072 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-11e02500-3e03-4700-aefa-bc7051ca12cc tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] [instance: 428b73b8-21f1-47cb-83bb-df2b45f210dc] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:07:32.226113 n-d-846463-3 devstack@n-api.service[122699]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 05:07:32.226113 n-d-846463-3 devstack@n-api.service[122699]: Fri Sep 23 05:07:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/428b73b8-21f1-47cb-83bb-df2b45f210dc (ip 10.222.0.33) !!! Sep 23 05:07:32.232383 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-11e02500-3e03-4700-aefa-bc7051ca12cc tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:32.234546 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-11e02500-3e03-4700-aefa-bc7051ca12cc tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:32.235366 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-11e02500-3e03-4700-aefa-bc7051ca12cc tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:32.236827 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-11e02500-3e03-4700-aefa-bc7051ca12cc tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:32.255281 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-11e02500-3e03-4700-aefa-bc7051ca12cc tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:32.257547 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-11e02500-3e03-4700-aefa-bc7051ca12cc tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:32.296740 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-5aaeb064-b1df-4686-8804-ea60d67272fa tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] HTTP exception thrown: Instance 907407f9-5788-487a-80aa-0782bd4230a5 could not be found. Sep 23 05:07:32.301480 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5aaeb064-b1df-4686-8804-ea60d67272fa tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Request method failure captured: Sep 23 05:07:32.301480 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5 HTTP/1.1 Sep 23 05:07:32.301480 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 05:07:32.301480 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 05:07:32.301480 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 05:07:32.301480 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 05:07:32.301480 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 05:07:32.301480 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 05:07:32.301480 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 05:07:32.301480 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 05:07:32.301480 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLT3uLjiu4nPUFbkjrA4MyWVqiSG18wQr6d8tQl_P_I7oXAw8rp2FE6LolJR7q-NpMkbDL2xBtL-Km4xLll-czE6HybNQXkbhp5AdNp7lc8uSbgBeOP-qACziHhtaYPCszQMgYlHiKqFljv5hFyHB9WCa7Y2j2z8m1qKy7sQfYfHm2rE Sep 23 05:07:32.301480 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 05:07:32.301480 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 05:07:32.301480 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 05:07:32.301480 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 05:07:32.301480 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 05:07:32.301480 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 05:07:32.301480 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: cceaa1e24146497fbf3f79cebc112211 Sep 23 05:07:32.301480 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-TestVolumeBootPattern-1815855430 Sep 23 05:07:32.301480 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 05:07:32.301480 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 05:07:32.301480 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cceaa1e24146497fbf3f79cebc112211", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cceaa1e24146497fbf3f79cebc112211"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cceaa1e24146497fbf3f79cebc112211"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cceaa1e24146497fbf3f79cebc112211"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:07:32.301480 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-TestVolumeBootPattern-1815855430 Sep 23 05:07:32.301480 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: cceaa1e24146497fbf3f79cebc112211 Sep 23 05:07:32.301480 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-TestVolumeBootPattern-1815855430 Sep 23 05:07:32.301480 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-TestVolumeBootPattern-1815855430-project Sep 23 05:07:32.301480 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 05:07:32.301480 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 05:07:32.301480 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 0d55fe5072c14752846eb4ffc0eef91b Sep 23 05:07:32.301480 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-TestVolumeBootPattern-1815855430-project Sep 23 05:07:32.301480 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 05:07:32.301480 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 907407f9-5788-487a-80aa-0782bd4230a5 could not be found. Sep 23 05:07:32.301480 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '907407f9-5788-487a-80aa-0782bd4230a5'} Sep 23 05:07:32.301480 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:07:32.301480 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:07:32.301480 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 05:07:32.301480 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 05:07:32.301480 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 05:07:32.301480 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 05:07:32.301480 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 05:07:32.301480 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 05:07:32.301480 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 05:07:32.301480 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 05:07:32.301480 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 907407f9-5788-487a-80aa-0782bd4230a5 could not be found. Sep 23 05:07:32.301480 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:07:32.301480 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:07:32.301480 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:07:32.301480 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:07:32.301480 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:07:32.301480 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:07:32.301480 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:07:32.301480 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:07:32.301480 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:07:32.301480 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:07:32.301480 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 05:07:32.301480 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 05:07:32.301480 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 05:07:32.301480 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 05:07:32.301480 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 05:07:32.301480 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:07:32.301480 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 907407f9-5788-487a-80aa-0782bd4230a5 could not be found. Sep 23 05:07:32.301480 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:07:32.301480 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:07:32.301480 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:07:32.306293 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:07:32.306293 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:07:32.306293 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:07:32.306293 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:07:32.306293 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:07:32.306293 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 907407f9-5788-487a-80aa-0782bd4230a5 could not be found. Sep 23 05:07:32.306293 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:07:32.312140 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5aaeb064-b1df-4686-8804-ea60d67272fa tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Returning 404 to user: Instance 907407f9-5788-487a-80aa-0782bd4230a5 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:07:32.316773 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5aaeb064-b1df-4686-8804-ea60d67272fa tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5" status: 404 len: 111 microversion: 2.1 time: 0.203074 Sep 23 05:07:32.318890 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3138/6445] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:07:32 2022] GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5 => generated 111 bytes in 207 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 05:07:32.662437 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-11e02500-3e03-4700-aefa-bc7051ca12cc tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e8ce1f6821424080453f994dbcd604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fefb9fd80184955a7856e1c41d081be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:07:32.680021 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-11e02500-3e03-4700-aefa-bc7051ca12cc tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] 10.222.0.33 "GET /compute/v2.1/servers/428b73b8-21f1-47cb-83bb-df2b45f210dc" status: 200 len: 1374 microversion: 2.1 time: 0.490088 Sep 23 05:07:32.700312 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3308/6446] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:07:32 2022] GET /compute/v2.1/servers/428b73b8-21f1-47cb-83bb-df2b45f210dc => generated 1374 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:07:33.710022 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8a8f18eb-56eb-4846-bf2f-9fc2c05e6e51 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:07:33.713789 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8a8f18eb-56eb-4846-bf2f-9fc2c05e6e51 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] [instance: 428b73b8-21f1-47cb-83bb-df2b45f210dc] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:07:33.751594 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8a8f18eb-56eb-4846-bf2f-9fc2c05e6e51 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:33.752455 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8a8f18eb-56eb-4846-bf2f-9fc2c05e6e51 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:33.753348 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8a8f18eb-56eb-4846-bf2f-9fc2c05e6e51 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:33.754442 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8a8f18eb-56eb-4846-bf2f-9fc2c05e6e51 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:33.755384 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8a8f18eb-56eb-4846-bf2f-9fc2c05e6e51 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:33.757517 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8a8f18eb-56eb-4846-bf2f-9fc2c05e6e51 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:33.963998 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-53747564-af3f-4cea-bb01-2973f81b26d8 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1788871927", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0ed8d15f-c597-425d-b882-0a82aeae94d2"}], "security_groups": [{"name": "tempest-securitygroup--1812710390"}], "key_name": "tempest-keypair-158534011", "user_data": "}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:07:34.248959 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.neutron [None req-53747564-af3f-4cea-bb01-2973f81b26d8 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] validate_networks() for [('0ed8d15f-c597-425d-b882-0a82aeae94d2', None, None, None, None, None)] {{(pid=122699) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 05:07:34.664198 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8a8f18eb-56eb-4846-bf2f-9fc2c05e6e51 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e8ce1f6821424080453f994dbcd604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fefb9fd80184955a7856e1c41d081be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:07:34.689196 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8a8f18eb-56eb-4846-bf2f-9fc2c05e6e51 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] 10.222.0.33 "GET /compute/v2.1/servers/428b73b8-21f1-47cb-83bb-df2b45f210dc" status: 200 len: 1374 microversion: 2.1 time: 0.984901 Sep 23 05:07:34.695542 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3139/6447] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:07:33 2022] GET /compute/v2.1/servers/428b73b8-21f1-47cb-83bb-df2b45f210dc => generated 1374 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:07:35.609752 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-f73dcf45-9e1c-4e80-8134-1bb0b7e439ba req-312242f8-53af-4ef9-a97f-503bb55dff9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "428b73b8-21f1-47cb-83bb-df2b45f210dc", "name": "network-vif-plugged", "status": "completed", "tag": "0bce6435-2556-4f98-8e9f-841185913c4c"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:07:35.635898 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-f73dcf45-9e1c-4e80-8134-1bb0b7e439ba req-312242f8-53af-4ef9-a97f-503bb55dff9e service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:35.642741 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-f73dcf45-9e1c-4e80-8134-1bb0b7e439ba req-312242f8-53af-4ef9-a97f-503bb55dff9e service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:35.643200 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-f73dcf45-9e1c-4e80-8134-1bb0b7e439ba req-312242f8-53af-4ef9-a97f-503bb55dff9e service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:35.694276 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-f73dcf45-9e1c-4e80-8134-1bb0b7e439ba req-312242f8-53af-4ef9-a97f-503bb55dff9e service nova] Creating event network-vif-plugged:0bce6435-2556-4f98-8e9f-841185913c4c for instance 428b73b8-21f1-47cb-83bb-df2b45f210dc on n-h2-846463-3 Sep 23 05:07:35.715706 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-f73dcf45-9e1c-4e80-8134-1bb0b7e439ba req-312242f8-53af-4ef9-a97f-503bb55dff9e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108276 Sep 23 05:07:35.716796 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3140/6448] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:07:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:07:35.730801 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0d25f5ad-cbd2-4d37-8a1e-5abf69649e0b tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:07:35.731862 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-0d25f5ad-cbd2-4d37-8a1e-5abf69649e0b tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] [instance: 428b73b8-21f1-47cb-83bb-df2b45f210dc] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:07:35.775602 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0d25f5ad-cbd2-4d37-8a1e-5abf69649e0b tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:35.778863 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0d25f5ad-cbd2-4d37-8a1e-5abf69649e0b tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:35.779779 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0d25f5ad-cbd2-4d37-8a1e-5abf69649e0b tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:35.781067 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0d25f5ad-cbd2-4d37-8a1e-5abf69649e0b tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:35.783609 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0d25f5ad-cbd2-4d37-8a1e-5abf69649e0b tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:35.784759 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0d25f5ad-cbd2-4d37-8a1e-5abf69649e0b tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:36.422992 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-0d25f5ad-cbd2-4d37-8a1e-5abf69649e0b tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e8ce1f6821424080453f994dbcd604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fefb9fd80184955a7856e1c41d081be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:07:36.432088 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0d25f5ad-cbd2-4d37-8a1e-5abf69649e0b tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] 10.222.0.33 "GET /compute/v2.1/servers/428b73b8-21f1-47cb-83bb-df2b45f210dc" status: 200 len: 1374 microversion: 2.1 time: 0.710452 Sep 23 05:07:36.438380 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3141/6449] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:07:35 2022] GET /compute/v2.1/servers/428b73b8-21f1-47cb-83bb-df2b45f210dc => generated 1374 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:07:36.445190 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d483109f-e8ab-4f76-8dd7-4f96661a76a2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:07:36.462842 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d483109f-e8ab-4f76-8dd7-4f96661a76a2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 907407f9-5788-487a-80aa-0782bd4230a5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:07:36.471789 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d483109f-e8ab-4f76-8dd7-4f96661a76a2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:36.472863 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d483109f-e8ab-4f76-8dd7-4f96661a76a2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:36.473525 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d483109f-e8ab-4f76-8dd7-4f96661a76a2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:36.475004 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d483109f-e8ab-4f76-8dd7-4f96661a76a2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:36.475624 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d483109f-e8ab-4f76-8dd7-4f96661a76a2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:36.476351 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d483109f-e8ab-4f76-8dd7-4f96661a76a2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:36.499140 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-d483109f-e8ab-4f76-8dd7-4f96661a76a2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] HTTP exception thrown: Instance 907407f9-5788-487a-80aa-0782bd4230a5 could not be found. Sep 23 05:07:36.501725 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d483109f-e8ab-4f76-8dd7-4f96661a76a2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Request method failure captured: Sep 23 05:07:36.501725 n-d-846463-3 devstack@n-api.service[122698]: request: DELETE /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5 HTTP/1.1 Sep 23 05:07:36.501725 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 05:07:36.501725 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 05:07:36.501725 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 05:07:36.501725 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 05:07:36.501725 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 05:07:36.501725 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 05:07:36.501725 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 05:07:36.501725 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 05:07:36.501725 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLT3uLjiu4nPUFbkjrA4MyWVqiSG18wQr6d8tQl_P_I7oXAw8rp2FE6LolJR7q-NpMkbDL2xBtL-Km4xLll-czE6HybNQXkbhp5AdNp7lc8uSbgBeOP-qACziHhtaYPCszQMgYlHiKqFljv5hFyHB9WCa7Y2j2z8m1qKy7sQfYfHm2rE Sep 23 05:07:36.501725 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 05:07:36.501725 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 05:07:36.501725 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 05:07:36.501725 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 05:07:36.501725 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 05:07:36.501725 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 05:07:36.501725 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: cceaa1e24146497fbf3f79cebc112211 Sep 23 05:07:36.501725 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-TestVolumeBootPattern-1815855430 Sep 23 05:07:36.501725 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 05:07:36.501725 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 05:07:36.501725 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cceaa1e24146497fbf3f79cebc112211", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cceaa1e24146497fbf3f79cebc112211"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cceaa1e24146497fbf3f79cebc112211"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cceaa1e24146497fbf3f79cebc112211"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:07:36.501725 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-TestVolumeBootPattern-1815855430 Sep 23 05:07:36.501725 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: cceaa1e24146497fbf3f79cebc112211 Sep 23 05:07:36.501725 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-TestVolumeBootPattern-1815855430 Sep 23 05:07:36.501725 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-TestVolumeBootPattern-1815855430-project Sep 23 05:07:36.501725 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 05:07:36.501725 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 05:07:36.501725 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 0d55fe5072c14752846eb4ffc0eef91b Sep 23 05:07:36.501725 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-TestVolumeBootPattern-1815855430-project Sep 23 05:07:36.501725 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 05:07:36.501725 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 907407f9-5788-487a-80aa-0782bd4230a5 could not be found. Sep 23 05:07:36.501725 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '907407f9-5788-487a-80aa-0782bd4230a5'} Sep 23 05:07:36.501725 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:07:36.501725 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:07:36.501725 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 05:07:36.501725 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 05:07:36.501725 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 05:07:36.501725 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 05:07:36.501725 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 05:07:36.501725 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 05:07:36.501725 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 05:07:36.501725 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 05:07:36.501725 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 907407f9-5788-487a-80aa-0782bd4230a5 could not be found. Sep 23 05:07:36.501725 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:07:36.501725 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:07:36.501725 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:07:36.501725 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:07:36.501725 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:07:36.501725 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:07:36.501725 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:07:36.501725 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:07:36.501725 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:07:36.501725 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:07:36.501725 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 05:07:36.501725 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 05:07:36.501725 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 05:07:36.501725 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 05:07:36.501725 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 05:07:36.501725 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 05:07:36.501725 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 05:07:36.501725 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:07:36.509015 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 907407f9-5788-487a-80aa-0782bd4230a5 could not be found. Sep 23 05:07:36.509015 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:07:36.509015 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:07:36.509015 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:07:36.509015 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:07:36.509015 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:07:36.509015 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:07:36.509015 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:07:36.509015 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:07:36.509015 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 907407f9-5788-487a-80aa-0782bd4230a5 could not be found. Sep 23 05:07:36.509015 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:07:36.509015 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d483109f-e8ab-4f76-8dd7-4f96661a76a2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Returning 404 to user: Instance 907407f9-5788-487a-80aa-0782bd4230a5 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:07:36.510816 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d483109f-e8ab-4f76-8dd7-4f96661a76a2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "DELETE /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5" status: 404 len: 111 microversion: 2.1 time: 0.069526 Sep 23 05:07:36.511873 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3142/6450] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 05:07:36 2022] DELETE /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 05:07:36.521440 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-fc0a8adf-188e-4111-b5fa-d6d57b529548 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:07:36.522496 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-fc0a8adf-188e-4111-b5fa-d6d57b529548 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 907407f9-5788-487a-80aa-0782bd4230a5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:07:36.529789 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fc0a8adf-188e-4111-b5fa-d6d57b529548 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:36.530791 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fc0a8adf-188e-4111-b5fa-d6d57b529548 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:36.531706 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fc0a8adf-188e-4111-b5fa-d6d57b529548 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:36.532779 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fc0a8adf-188e-4111-b5fa-d6d57b529548 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:36.533471 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fc0a8adf-188e-4111-b5fa-d6d57b529548 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:36.534082 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fc0a8adf-188e-4111-b5fa-d6d57b529548 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:36.557373 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-fc0a8adf-188e-4111-b5fa-d6d57b529548 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] HTTP exception thrown: Instance 907407f9-5788-487a-80aa-0782bd4230a5 could not be found. Sep 23 05:07:36.560351 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-fc0a8adf-188e-4111-b5fa-d6d57b529548 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Request method failure captured: Sep 23 05:07:36.560351 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5 HTTP/1.1 Sep 23 05:07:36.560351 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 05:07:36.560351 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 05:07:36.560351 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 05:07:36.560351 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 05:07:36.560351 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 05:07:36.560351 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 05:07:36.560351 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 05:07:36.560351 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 05:07:36.560351 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLT3uLjiu4nPUFbkjrA4MyWVqiSG18wQr6d8tQl_P_I7oXAw8rp2FE6LolJR7q-NpMkbDL2xBtL-Km4xLll-czE6HybNQXkbhp5AdNp7lc8uSbgBeOP-qACziHhtaYPCszQMgYlHiKqFljv5hFyHB9WCa7Y2j2z8m1qKy7sQfYfHm2rE Sep 23 05:07:36.560351 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 05:07:36.560351 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 05:07:36.560351 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 05:07:36.560351 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 05:07:36.560351 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 05:07:36.560351 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 05:07:36.560351 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: cceaa1e24146497fbf3f79cebc112211 Sep 23 05:07:36.560351 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-TestVolumeBootPattern-1815855430 Sep 23 05:07:36.560351 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 05:07:36.560351 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 05:07:36.560351 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cceaa1e24146497fbf3f79cebc112211", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cceaa1e24146497fbf3f79cebc112211"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cceaa1e24146497fbf3f79cebc112211"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cceaa1e24146497fbf3f79cebc112211"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:07:36.560351 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-TestVolumeBootPattern-1815855430 Sep 23 05:07:36.560351 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: cceaa1e24146497fbf3f79cebc112211 Sep 23 05:07:36.560351 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-TestVolumeBootPattern-1815855430 Sep 23 05:07:36.560351 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-TestVolumeBootPattern-1815855430-project Sep 23 05:07:36.560351 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 05:07:36.560351 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 05:07:36.560351 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 0d55fe5072c14752846eb4ffc0eef91b Sep 23 05:07:36.560351 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-TestVolumeBootPattern-1815855430-project Sep 23 05:07:36.560351 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 05:07:36.560351 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 907407f9-5788-487a-80aa-0782bd4230a5 could not be found. Sep 23 05:07:36.560351 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '907407f9-5788-487a-80aa-0782bd4230a5'} Sep 23 05:07:36.560351 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:07:36.560351 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:07:36.560351 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 05:07:36.560351 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 05:07:36.560351 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 05:07:36.560351 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 05:07:36.560351 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 05:07:36.560351 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 05:07:36.560351 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 05:07:36.560351 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 05:07:36.560351 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 907407f9-5788-487a-80aa-0782bd4230a5 could not be found. Sep 23 05:07:36.560351 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:07:36.560351 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:07:36.560351 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:07:36.560351 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:07:36.560351 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:07:36.560351 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:07:36.560351 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:07:36.560351 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:07:36.560351 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:07:36.560351 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:07:36.560351 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 05:07:36.560351 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 05:07:36.560351 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 05:07:36.560351 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 05:07:36.560351 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 05:07:36.560351 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:07:36.560351 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 907407f9-5788-487a-80aa-0782bd4230a5 could not be found. Sep 23 05:07:36.560351 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:07:36.560351 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:07:36.560351 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:07:36.564486 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:07:36.564486 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:07:36.564486 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:07:36.564486 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:07:36.564486 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:07:36.564486 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 907407f9-5788-487a-80aa-0782bd4230a5 could not be found. Sep 23 05:07:36.564486 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:07:36.566175 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-fc0a8adf-188e-4111-b5fa-d6d57b529548 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Returning 404 to user: Instance 907407f9-5788-487a-80aa-0782bd4230a5 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:07:36.567770 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-fc0a8adf-188e-4111-b5fa-d6d57b529548 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5" status: 404 len: 111 microversion: 2.1 time: 0.051287 Sep 23 05:07:36.573073 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3143/6451] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:07:36 2022] GET /compute/v2.1/servers/907407f9-5788-487a-80aa-0782bd4230a5 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 05:07:36.747529 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-53747564-af3f-4cea-bb01-2973f81b26d8 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Flavor limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 05:07:36.748094 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-53747564-af3f-4cea-bb01-2973f81b26d8 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Image limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 05:07:36.748555 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-53747564-af3f-4cea-bb01-2973f81b26d8 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Flavor pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 05:07:36.748976 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-53747564-af3f-4cea-bb01-2973f81b26d8 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Image pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 05:07:36.749527 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-53747564-af3f-4cea-bb01-2973f81b26d8 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 05:07:36.759805 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-53747564-af3f-4cea-bb01-2973f81b26d8 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:36.760502 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-53747564-af3f-4cea-bb01-2973f81b26d8 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:36.761118 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-53747564-af3f-4cea-bb01-2973f81b26d8 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:36.761869 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-53747564-af3f-4cea-bb01-2973f81b26d8 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:36.762361 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-53747564-af3f-4cea-bb01-2973f81b26d8 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:36.762800 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-53747564-af3f-4cea-bb01-2973f81b26d8 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:36.817138 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-53747564-af3f-4cea-bb01-2973f81b26d8 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Getting quotas for project daad67f26fe246d6b4d28cad1707a119. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 05:07:36.834858 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-53747564-af3f-4cea-bb01-2973f81b26d8 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Getting quotas for user 59d90150ed7d477fab33129cb3b068ed and project daad67f26fe246d6b4d28cad1707a119. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 05:07:36.873344 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-53747564-af3f-4cea-bb01-2973f81b26d8 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Going to run 1 instances... {{(pid=122699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 05:07:36.877421 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-53747564-af3f-4cea-bb01-2973f81b26d8 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 3b1a8172-f2d4-4308-8a1f-423b492fc023] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 05:07:37.192313 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-53747564-af3f-4cea-bb01-2973f81b26d8 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.218168 Sep 23 05:07:37.213982 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7782f182-1ae5-417c-8e20-edd4c5438604 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:07:37.213982 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7782f182-1ae5-417c-8e20-edd4c5438604 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 3b1a8172-f2d4-4308-8a1f-423b492fc023] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:07:37.218678 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3309/6452] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 05:07:33 2022] POST /compute/v2.1/servers => generated 402 bytes in 3260 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 05:07:37.466558 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e558a743-b1b8-4f90-992c-92569f7e6f69 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:07:37.468362 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e558a743-b1b8-4f90-992c-92569f7e6f69 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] [instance: 428b73b8-21f1-47cb-83bb-df2b45f210dc] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:07:37.504962 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e558a743-b1b8-4f90-992c-92569f7e6f69 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:37.514205 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e558a743-b1b8-4f90-992c-92569f7e6f69 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:37.514737 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e558a743-b1b8-4f90-992c-92569f7e6f69 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:37.515514 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e558a743-b1b8-4f90-992c-92569f7e6f69 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:37.519848 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e558a743-b1b8-4f90-992c-92569f7e6f69 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:37.526109 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e558a743-b1b8-4f90-992c-92569f7e6f69 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:37.623645 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-7782f182-1ae5-417c-8e20-edd4c5438604 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d90150ed7d477fab33129cb3b068ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daad67f26fe246d6b4d28cad1707a119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:07:37.637527 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7782f182-1ae5-417c-8e20-edd4c5438604 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/3b1a8172-f2d4-4308-8a1f-423b492fc023" status: 200 len: 1241 microversion: 2.1 time: 0.434998 Sep 23 05:07:37.638823 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3144/6453] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:07:37 2022] GET /compute/v2.1/servers/3b1a8172-f2d4-4308-8a1f-423b492fc023 => generated 1241 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:07:37.997778 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e558a743-b1b8-4f90-992c-92569f7e6f69 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e8ce1f6821424080453f994dbcd604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fefb9fd80184955a7856e1c41d081be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:07:38.021055 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e558a743-b1b8-4f90-992c-92569f7e6f69 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] 10.222.0.33 "GET /compute/v2.1/servers/428b73b8-21f1-47cb-83bb-df2b45f210dc" status: 200 len: 1547 microversion: 2.1 time: 0.559451 Sep 23 05:07:38.051287 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d2ec4a0d-cdb3-47b5-9948-692e8f906850 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:07:38.061805 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d2ec4a0d-cdb3-47b5-9948-692e8f906850 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] [instance: 428b73b8-21f1-47cb-83bb-df2b45f210dc] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:07:38.061805 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:07:38.062053 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3310/6454] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:07:37 2022] GET /compute/v2.1/servers/428b73b8-21f1-47cb-83bb-df2b45f210dc => generated 1547 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:07:38.068851 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d2ec4a0d-cdb3-47b5-9948-692e8f906850 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:38.073748 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d2ec4a0d-cdb3-47b5-9948-692e8f906850 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:38.075298 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d2ec4a0d-cdb3-47b5-9948-692e8f906850 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:38.080870 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d2ec4a0d-cdb3-47b5-9948-692e8f906850 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:38.082317 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d2ec4a0d-cdb3-47b5-9948-692e8f906850 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:38.084912 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d2ec4a0d-cdb3-47b5-9948-692e8f906850 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:38.660998 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-fd01aa24-43bf-4ab6-86db-69a715b945c4 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:07:38.662818 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-fd01aa24-43bf-4ab6-86db-69a715b945c4 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 3b1a8172-f2d4-4308-8a1f-423b492fc023] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:07:38.678807 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:07:38.838514 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-fd01aa24-43bf-4ab6-86db-69a715b945c4 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d90150ed7d477fab33129cb3b068ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daad67f26fe246d6b4d28cad1707a119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:07:38.845816 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-fd01aa24-43bf-4ab6-86db-69a715b945c4 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/3b1a8172-f2d4-4308-8a1f-423b492fc023" status: 200 len: 1241 microversion: 2.1 time: 0.188843 Sep 23 05:07:38.852701 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3311/6455] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:07:38 2022] GET /compute/v2.1/servers/3b1a8172-f2d4-4308-8a1f-423b492fc023 => generated 1241 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:07:38.992269 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d2ec4a0d-cdb3-47b5-9948-692e8f906850 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e8ce1f6821424080453f994dbcd604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fefb9fd80184955a7856e1c41d081be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:07:39.012226 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d2ec4a0d-cdb3-47b5-9948-692e8f906850 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] 10.222.0.33 "GET /compute/v2.1/servers/428b73b8-21f1-47cb-83bb-df2b45f210dc" status: 200 len: 1547 microversion: 2.1 time: 0.963470 Sep 23 05:07:39.018681 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3145/6456] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:07:38 2022] GET /compute/v2.1/servers/428b73b8-21f1-47cb-83bb-df2b45f210dc => generated 1547 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:07:39.875439 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-45db809d-b25e-4cc1-b155-4b94c382e4a5 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:07:39.876816 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-45db809d-b25e-4cc1-b155-4b94c382e4a5 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 3b1a8172-f2d4-4308-8a1f-423b492fc023] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:07:39.898943 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-45db809d-b25e-4cc1-b155-4b94c382e4a5 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:39.900346 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-45db809d-b25e-4cc1-b155-4b94c382e4a5 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:39.902713 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-45db809d-b25e-4cc1-b155-4b94c382e4a5 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:39.904931 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-45db809d-b25e-4cc1-b155-4b94c382e4a5 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:39.906136 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-45db809d-b25e-4cc1-b155-4b94c382e4a5 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:39.910170 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-45db809d-b25e-4cc1-b155-4b94c382e4a5 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:40.203025 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-45db809d-b25e-4cc1-b155-4b94c382e4a5 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d90150ed7d477fab33129cb3b068ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daad67f26fe246d6b4d28cad1707a119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:07:40.238801 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-45db809d-b25e-4cc1-b155-4b94c382e4a5 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/3b1a8172-f2d4-4308-8a1f-423b492fc023" status: 200 len: 1237 microversion: 2.1 time: 0.369860 Sep 23 05:07:40.246381 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3312/6457] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:07:39 2022] GET /compute/v2.1/servers/3b1a8172-f2d4-4308-8a1f-423b492fc023 => generated 1237 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:07:41.274882 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-90116a53-1bfb-49e7-bc51-d24fb22a1561 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:07:41.277530 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-90116a53-1bfb-49e7-bc51-d24fb22a1561 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 3b1a8172-f2d4-4308-8a1f-423b492fc023] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:07:41.303969 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-90116a53-1bfb-49e7-bc51-d24fb22a1561 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:41.304782 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-90116a53-1bfb-49e7-bc51-d24fb22a1561 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:41.305389 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-90116a53-1bfb-49e7-bc51-d24fb22a1561 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:41.310840 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-90116a53-1bfb-49e7-bc51-d24fb22a1561 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:41.311242 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-90116a53-1bfb-49e7-bc51-d24fb22a1561 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:41.311693 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-90116a53-1bfb-49e7-bc51-d24fb22a1561 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:41.481855 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-90116a53-1bfb-49e7-bc51-d24fb22a1561 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d90150ed7d477fab33129cb3b068ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daad67f26fe246d6b4d28cad1707a119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:07:41.498499 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-90116a53-1bfb-49e7-bc51-d24fb22a1561 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/3b1a8172-f2d4-4308-8a1f-423b492fc023" status: 200 len: 1301 microversion: 2.1 time: 0.228612 Sep 23 05:07:41.519558 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3146/6458] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:07:41 2022] GET /compute/v2.1/servers/3b1a8172-f2d4-4308-8a1f-423b492fc023 => generated 1301 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:07:42.527785 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7e29fcfc-691f-442e-a4bb-44411deb7579 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:07:42.529433 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-7e29fcfc-691f-442e-a4bb-44411deb7579 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 3b1a8172-f2d4-4308-8a1f-423b492fc023] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:07:42.543311 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7e29fcfc-691f-442e-a4bb-44411deb7579 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:42.547777 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7e29fcfc-691f-442e-a4bb-44411deb7579 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:42.553847 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7e29fcfc-691f-442e-a4bb-44411deb7579 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:42.553847 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7e29fcfc-691f-442e-a4bb-44411deb7579 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:42.554766 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7e29fcfc-691f-442e-a4bb-44411deb7579 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:42.555385 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7e29fcfc-691f-442e-a4bb-44411deb7579 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:42.663203 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-7e29fcfc-691f-442e-a4bb-44411deb7579 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d90150ed7d477fab33129cb3b068ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daad67f26fe246d6b4d28cad1707a119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:07:42.667941 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=100 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:07:42.674827 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-7e29fcfc-691f-442e-a4bb-44411deb7579 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/3b1a8172-f2d4-4308-8a1f-423b492fc023" status: 200 len: 1299 microversion: 2.1 time: 0.151136 Sep 23 05:07:42.676112 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3313/6459] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:07:42 2022] GET /compute/v2.1/servers/3b1a8172-f2d4-4308-8a1f-423b492fc023 => generated 1299 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:07:43.714099 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-19de0499-82e3-4cb5-ac1e-d742db8fbf27 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:07:43.716159 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-19de0499-82e3-4cb5-ac1e-d742db8fbf27 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 3b1a8172-f2d4-4308-8a1f-423b492fc023] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:07:43.739720 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-19de0499-82e3-4cb5-ac1e-d742db8fbf27 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:43.745072 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-19de0499-82e3-4cb5-ac1e-d742db8fbf27 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:43.745072 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-19de0499-82e3-4cb5-ac1e-d742db8fbf27 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:43.753725 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-19de0499-82e3-4cb5-ac1e-d742db8fbf27 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:43.754394 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-19de0499-82e3-4cb5-ac1e-d742db8fbf27 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:43.754854 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-19de0499-82e3-4cb5-ac1e-d742db8fbf27 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:43.956085 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-9a4f750d-9de5-41b1-856c-957f026cf065 req-473bf750-042f-4149-a248-14508aa14bec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "428b73b8-21f1-47cb-83bb-df2b45f210dc", "tag": "0bce6435-2556-4f98-8e9f-841185913c4c"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:07:43.988268 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-9a4f750d-9de5-41b1-856c-957f026cf065 req-473bf750-042f-4149-a248-14508aa14bec service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:43.990910 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-9a4f750d-9de5-41b1-856c-957f026cf065 req-473bf750-042f-4149-a248-14508aa14bec service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:43.993044 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-9a4f750d-9de5-41b1-856c-957f026cf065 req-473bf750-042f-4149-a248-14508aa14bec service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:44.060626 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-9a4f750d-9de5-41b1-856c-957f026cf065 req-473bf750-042f-4149-a248-14508aa14bec service nova] Creating event network-changed:0bce6435-2556-4f98-8e9f-841185913c4c for instance 428b73b8-21f1-47cb-83bb-df2b45f210dc on n-h2-846463-3 Sep 23 05:07:44.093556 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-9a4f750d-9de5-41b1-856c-957f026cf065 req-473bf750-042f-4149-a248-14508aa14bec service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141163 Sep 23 05:07:44.093764 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3314/6460] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:07:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 05:07:45.483436 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-19de0499-82e3-4cb5-ac1e-d742db8fbf27 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d90150ed7d477fab33129cb3b068ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daad67f26fe246d6b4d28cad1707a119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:07:45.492435 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-19de0499-82e3-4cb5-ac1e-d742db8fbf27 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/3b1a8172-f2d4-4308-8a1f-423b492fc023" status: 200 len: 1367 microversion: 2.1 time: 1.788924 Sep 23 05:07:45.493030 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3147/6461] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:07:43 2022] GET /compute/v2.1/servers/3b1a8172-f2d4-4308-8a1f-423b492fc023 => generated 1367 bytes in 1790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:07:46.168631 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-4ae2e4d6-08d2-4db9-9aca-0b78cf087e5d req-0f3b98e0-297b-4b14-ac97-2ff2cd5bd0d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b1a8172-f2d4-4308-8a1f-423b492fc023", "tag": "fd78c6cf-de4b-4138-86bb-e546703947dd"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:07:46.188695 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-4ae2e4d6-08d2-4db9-9aca-0b78cf087e5d req-0f3b98e0-297b-4b14-ac97-2ff2cd5bd0d7 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:46.189190 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-4ae2e4d6-08d2-4db9-9aca-0b78cf087e5d req-0f3b98e0-297b-4b14-ac97-2ff2cd5bd0d7 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:46.189642 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-4ae2e4d6-08d2-4db9-9aca-0b78cf087e5d req-0f3b98e0-297b-4b14-ac97-2ff2cd5bd0d7 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:46.220056 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-4ae2e4d6-08d2-4db9-9aca-0b78cf087e5d req-0f3b98e0-297b-4b14-ac97-2ff2cd5bd0d7 service nova] Creating event network-changed:fd78c6cf-de4b-4138-86bb-e546703947dd for instance 3b1a8172-f2d4-4308-8a1f-423b492fc023 on n-h1-846463-3 Sep 23 05:07:46.245815 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-4ae2e4d6-08d2-4db9-9aca-0b78cf087e5d req-0f3b98e0-297b-4b14-ac97-2ff2cd5bd0d7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081693 Sep 23 05:07:46.252107 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3315/6462] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:07:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:07:46.516708 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1a15236d-7e51-4dc5-aa53-c11494857503 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:07:46.517944 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-1a15236d-7e51-4dc5-aa53-c11494857503 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 3b1a8172-f2d4-4308-8a1f-423b492fc023] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:07:46.538772 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1a15236d-7e51-4dc5-aa53-c11494857503 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:46.538772 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1a15236d-7e51-4dc5-aa53-c11494857503 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:46.538772 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1a15236d-7e51-4dc5-aa53-c11494857503 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:46.538772 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1a15236d-7e51-4dc5-aa53-c11494857503 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:46.538772 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1a15236d-7e51-4dc5-aa53-c11494857503 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:46.538772 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1a15236d-7e51-4dc5-aa53-c11494857503 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:46.813212 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-1a15236d-7e51-4dc5-aa53-c11494857503 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d90150ed7d477fab33129cb3b068ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daad67f26fe246d6b4d28cad1707a119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:07:46.825994 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-1a15236d-7e51-4dc5-aa53-c11494857503 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/3b1a8172-f2d4-4308-8a1f-423b492fc023" status: 200 len: 1367 microversion: 2.1 time: 0.313133 Sep 23 05:07:46.826777 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3148/6463] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:07:46 2022] GET /compute/v2.1/servers/3b1a8172-f2d4-4308-8a1f-423b492fc023 => generated 1367 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:07:47.852086 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:07:47.855681 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1e3b2e10-cdc5-48a7-9ecf-5b41ef36641f tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:07:47.857074 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1e3b2e10-cdc5-48a7-9ecf-5b41ef36641f tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 3b1a8172-f2d4-4308-8a1f-423b492fc023] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:07:47.872544 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e3b2e10-cdc5-48a7-9ecf-5b41ef36641f tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:47.873899 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e3b2e10-cdc5-48a7-9ecf-5b41ef36641f tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:47.875583 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e3b2e10-cdc5-48a7-9ecf-5b41ef36641f tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:47.876335 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e3b2e10-cdc5-48a7-9ecf-5b41ef36641f tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:47.879047 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e3b2e10-cdc5-48a7-9ecf-5b41ef36641f tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:47.879508 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e3b2e10-cdc5-48a7-9ecf-5b41ef36641f tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:48.260890 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1e3b2e10-cdc5-48a7-9ecf-5b41ef36641f tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d90150ed7d477fab33129cb3b068ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daad67f26fe246d6b4d28cad1707a119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:07:48.270488 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1e3b2e10-cdc5-48a7-9ecf-5b41ef36641f tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/3b1a8172-f2d4-4308-8a1f-423b492fc023" status: 200 len: 1367 microversion: 2.1 time: 0.421991 Sep 23 05:07:48.271194 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3316/6464] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:07:47 2022] GET /compute/v2.1/servers/3b1a8172-f2d4-4308-8a1f-423b492fc023 => generated 1367 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:07:49.296658 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d7fd1955-fef3-45b3-a3a8-a2ab60a071a6 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:07:49.297931 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d7fd1955-fef3-45b3-a3a8-a2ab60a071a6 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 3b1a8172-f2d4-4308-8a1f-423b492fc023] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:07:49.301106 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=16 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:07:49.341610 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d7fd1955-fef3-45b3-a3a8-a2ab60a071a6 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:49.342252 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d7fd1955-fef3-45b3-a3a8-a2ab60a071a6 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:49.342738 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d7fd1955-fef3-45b3-a3a8-a2ab60a071a6 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:49.343468 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d7fd1955-fef3-45b3-a3a8-a2ab60a071a6 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:49.343937 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d7fd1955-fef3-45b3-a3a8-a2ab60a071a6 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:49.344372 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d7fd1955-fef3-45b3-a3a8-a2ab60a071a6 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:50.026230 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d7fd1955-fef3-45b3-a3a8-a2ab60a071a6 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d90150ed7d477fab33129cb3b068ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daad67f26fe246d6b4d28cad1707a119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:07:50.036075 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d7fd1955-fef3-45b3-a3a8-a2ab60a071a6 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/3b1a8172-f2d4-4308-8a1f-423b492fc023" status: 200 len: 1367 microversion: 2.1 time: 0.743229 Sep 23 05:07:50.060104 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3149/6465] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:07:49 2022] GET /compute/v2.1/servers/3b1a8172-f2d4-4308-8a1f-423b492fc023 => generated 1367 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:07:51.072409 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d8f4f742-d109-40a7-afa6-12953acd4c0b tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:07:51.073543 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d8f4f742-d109-40a7-afa6-12953acd4c0b tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 3b1a8172-f2d4-4308-8a1f-423b492fc023] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:07:51.075623 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=8 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:07:51.093512 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d8f4f742-d109-40a7-afa6-12953acd4c0b tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:51.094314 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d8f4f742-d109-40a7-afa6-12953acd4c0b tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:51.094933 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d8f4f742-d109-40a7-afa6-12953acd4c0b tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:51.096318 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d8f4f742-d109-40a7-afa6-12953acd4c0b tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:51.096940 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d8f4f742-d109-40a7-afa6-12953acd4c0b tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:51.097525 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d8f4f742-d109-40a7-afa6-12953acd4c0b tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:51.477014 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d8f4f742-d109-40a7-afa6-12953acd4c0b tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d90150ed7d477fab33129cb3b068ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daad67f26fe246d6b4d28cad1707a119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:07:51.486508 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d8f4f742-d109-40a7-afa6-12953acd4c0b tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/3b1a8172-f2d4-4308-8a1f-423b492fc023" status: 200 len: 1367 microversion: 2.1 time: 0.418493 Sep 23 05:07:51.506321 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3317/6466] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:07:51 2022] GET /compute/v2.1/servers/3b1a8172-f2d4-4308-8a1f-423b492fc023 => generated 1367 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:07:52.521721 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d25378e5-1298-4de0-b1bd-fea5f7aea3a3 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:07:52.522371 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d25378e5-1298-4de0-b1bd-fea5f7aea3a3 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 3b1a8172-f2d4-4308-8a1f-423b492fc023] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:07:52.545068 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d25378e5-1298-4de0-b1bd-fea5f7aea3a3 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:52.545820 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d25378e5-1298-4de0-b1bd-fea5f7aea3a3 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:52.546520 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d25378e5-1298-4de0-b1bd-fea5f7aea3a3 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:52.547462 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d25378e5-1298-4de0-b1bd-fea5f7aea3a3 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:52.548148 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d25378e5-1298-4de0-b1bd-fea5f7aea3a3 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:52.548786 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d25378e5-1298-4de0-b1bd-fea5f7aea3a3 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:53.283873 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d25378e5-1298-4de0-b1bd-fea5f7aea3a3 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d90150ed7d477fab33129cb3b068ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daad67f26fe246d6b4d28cad1707a119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:07:53.296374 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d25378e5-1298-4de0-b1bd-fea5f7aea3a3 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/3b1a8172-f2d4-4308-8a1f-423b492fc023" status: 200 len: 1367 microversion: 2.1 time: 0.777354 Sep 23 05:07:53.317553 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3150/6467] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:07:52 2022] GET /compute/v2.1/servers/3b1a8172-f2d4-4308-8a1f-423b492fc023 => generated 1367 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:07:53.933627 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-02253131-776b-4e60-8dde-4f8932b314bc req-e6736d1a-f32f-49f3-a0e7-f4b3e889eb34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b1a8172-f2d4-4308-8a1f-423b492fc023", "name": "network-vif-plugged", "status": "completed", "tag": "fd78c6cf-de4b-4138-86bb-e546703947dd"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:07:53.944734 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-02253131-776b-4e60-8dde-4f8932b314bc req-e6736d1a-f32f-49f3-a0e7-f4b3e889eb34 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:53.945229 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-02253131-776b-4e60-8dde-4f8932b314bc req-e6736d1a-f32f-49f3-a0e7-f4b3e889eb34 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:53.945666 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-02253131-776b-4e60-8dde-4f8932b314bc req-e6736d1a-f32f-49f3-a0e7-f4b3e889eb34 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:53.957275 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-02253131-776b-4e60-8dde-4f8932b314bc req-e6736d1a-f32f-49f3-a0e7-f4b3e889eb34 service nova] Creating event network-vif-plugged:fd78c6cf-de4b-4138-86bb-e546703947dd for instance 3b1a8172-f2d4-4308-8a1f-423b492fc023 on n-h1-846463-3 Sep 23 05:07:53.963248 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-02253131-776b-4e60-8dde-4f8932b314bc req-e6736d1a-f32f-49f3-a0e7-f4b3e889eb34 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036301 Sep 23 05:07:53.964998 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3318/6468] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:07:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:07:54.348567 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-630381fb-39f7-4ed6-81ed-4da1d427f842 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:07:54.350264 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-630381fb-39f7-4ed6-81ed-4da1d427f842 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 3b1a8172-f2d4-4308-8a1f-423b492fc023] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:07:54.358390 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-630381fb-39f7-4ed6-81ed-4da1d427f842 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:54.359144 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-630381fb-39f7-4ed6-81ed-4da1d427f842 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:54.359741 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-630381fb-39f7-4ed6-81ed-4da1d427f842 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:54.360612 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-630381fb-39f7-4ed6-81ed-4da1d427f842 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:54.361215 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-630381fb-39f7-4ed6-81ed-4da1d427f842 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:54.361815 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-630381fb-39f7-4ed6-81ed-4da1d427f842 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:54.682992 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-630381fb-39f7-4ed6-81ed-4da1d427f842 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d90150ed7d477fab33129cb3b068ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daad67f26fe246d6b4d28cad1707a119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:07:54.719870 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-630381fb-39f7-4ed6-81ed-4da1d427f842 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/3b1a8172-f2d4-4308-8a1f-423b492fc023" status: 200 len: 1367 microversion: 2.1 time: 0.400722 Sep 23 05:07:54.720652 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3151/6469] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:07:54 2022] GET /compute/v2.1/servers/3b1a8172-f2d4-4308-8a1f-423b492fc023 => generated 1367 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:07:55.748610 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6da84077-0887-4e46-a9fb-5eecfdfc5195 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:07:55.753158 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-6da84077-0887-4e46-a9fb-5eecfdfc5195 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 3b1a8172-f2d4-4308-8a1f-423b492fc023] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:07:55.766818 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6da84077-0887-4e46-a9fb-5eecfdfc5195 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:55.766818 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6da84077-0887-4e46-a9fb-5eecfdfc5195 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:55.766818 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6da84077-0887-4e46-a9fb-5eecfdfc5195 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:55.766818 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6da84077-0887-4e46-a9fb-5eecfdfc5195 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:55.766818 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6da84077-0887-4e46-a9fb-5eecfdfc5195 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:55.766818 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6da84077-0887-4e46-a9fb-5eecfdfc5195 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:56.033082 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-6da84077-0887-4e46-a9fb-5eecfdfc5195 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d90150ed7d477fab33129cb3b068ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daad67f26fe246d6b4d28cad1707a119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:07:56.041738 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6da84077-0887-4e46-a9fb-5eecfdfc5195 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/3b1a8172-f2d4-4308-8a1f-423b492fc023" status: 200 len: 1557 microversion: 2.1 time: 0.298160 Sep 23 05:07:56.064204 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3319/6470] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:07:55 2022] GET /compute/v2.1/servers/3b1a8172-f2d4-4308-8a1f-423b492fc023 => generated 1557 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:07:56.065818 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-847544d4-7fdf-4746-aee7-e641a6ea3c8c tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:07:56.073309 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-847544d4-7fdf-4746-aee7-e641a6ea3c8c tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 3b1a8172-f2d4-4308-8a1f-423b492fc023] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:07:56.076080 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-847544d4-7fdf-4746-aee7-e641a6ea3c8c tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:56.076742 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-847544d4-7fdf-4746-aee7-e641a6ea3c8c tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:56.077351 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-847544d4-7fdf-4746-aee7-e641a6ea3c8c tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:56.078277 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-847544d4-7fdf-4746-aee7-e641a6ea3c8c tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:56.078889 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-847544d4-7fdf-4746-aee7-e641a6ea3c8c tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:56.079481 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-847544d4-7fdf-4746-aee7-e641a6ea3c8c tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:56.235695 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-847544d4-7fdf-4746-aee7-e641a6ea3c8c tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/3b1a8172-f2d4-4308-8a1f-423b492fc023/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.173842 Sep 23 05:07:56.245172 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3152/6471] 10.222.0.33 () {58 vars in 1275 bytes} [Fri Sep 23 05:07:56 2022] GET /compute/v2.1/servers/3b1a8172-f2d4-4308-8a1f-423b492fc023/os-interface => generated 285 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:07:58.960816 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-b42845c8-59aa-40ed-aa8e-d4b5b4b34cd7 req-751b4d00-db3c-43ed-b42e-b9284b34b6df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b1a8172-f2d4-4308-8a1f-423b492fc023", "tag": "fd78c6cf-de4b-4138-86bb-e546703947dd"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:07:58.983867 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-b42845c8-59aa-40ed-aa8e-d4b5b4b34cd7 req-751b4d00-db3c-43ed-b42e-b9284b34b6df service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:07:58.985917 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-b42845c8-59aa-40ed-aa8e-d4b5b4b34cd7 req-751b4d00-db3c-43ed-b42e-b9284b34b6df service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:07:58.986484 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-b42845c8-59aa-40ed-aa8e-d4b5b4b34cd7 req-751b4d00-db3c-43ed-b42e-b9284b34b6df service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:07:59.018535 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-b42845c8-59aa-40ed-aa8e-d4b5b4b34cd7 req-751b4d00-db3c-43ed-b42e-b9284b34b6df service nova] Creating event network-changed:fd78c6cf-de4b-4138-86bb-e546703947dd for instance 3b1a8172-f2d4-4308-8a1f-423b492fc023 on n-h1-846463-3 Sep 23 05:07:59.034430 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-b42845c8-59aa-40ed-aa8e-d4b5b4b34cd7 req-751b4d00-db3c-43ed-b42e-b9284b34b6df service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.545377 Sep 23 05:07:59.045275 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3320/6472] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:07:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:08:01.709974 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-19842af2-04ef-4b68-8ac7-694da5b3e3b6 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:08:01.715592 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-19842af2-04ef-4b68-8ac7-694da5b3e3b6 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] [instance: 428b73b8-21f1-47cb-83bb-df2b45f210dc] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:08:01.789151 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-19842af2-04ef-4b68-8ac7-694da5b3e3b6 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:01.789151 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-19842af2-04ef-4b68-8ac7-694da5b3e3b6 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:01.789151 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-19842af2-04ef-4b68-8ac7-694da5b3e3b6 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:01.789151 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-19842af2-04ef-4b68-8ac7-694da5b3e3b6 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:01.789151 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-19842af2-04ef-4b68-8ac7-694da5b3e3b6 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:01.789151 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-19842af2-04ef-4b68-8ac7-694da5b3e3b6 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:01.789151 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=88 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:08:01.917206 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-19842af2-04ef-4b68-8ac7-694da5b3e3b6 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] 10.222.0.33 "POST /compute/v2.1/servers/428b73b8-21f1-47cb-83bb-df2b45f210dc/action" status: 200 len: 24567 microversion: 2.1 time: 0.212612 Sep 23 05:08:01.918599 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3153/6473] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 05:08:01 2022] POST /compute/v2.1/servers/428b73b8-21f1-47cb-83bb-df2b45f210dc/action => generated 24567 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 05:08:13.155477 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=21 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:08:13.156233 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=27 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:08:13.161095 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-792ceee0-e3cf-4ce4-98f6-7fd3d9c51031 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:08:13.167038 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-792ceee0-e3cf-4ce4-98f6-7fd3d9c51031 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] [instance: 428b73b8-21f1-47cb-83bb-df2b45f210dc] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:08:13.187117 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-792ceee0-e3cf-4ce4-98f6-7fd3d9c51031 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:13.187951 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-792ceee0-e3cf-4ce4-98f6-7fd3d9c51031 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:13.188623 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-792ceee0-e3cf-4ce4-98f6-7fd3d9c51031 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:13.189703 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-792ceee0-e3cf-4ce4-98f6-7fd3d9c51031 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:13.190809 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-792ceee0-e3cf-4ce4-98f6-7fd3d9c51031 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:13.191393 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-792ceee0-e3cf-4ce4-98f6-7fd3d9c51031 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:13.286626 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-792ceee0-e3cf-4ce4-98f6-7fd3d9c51031 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] 10.222.0.33 "POST /compute/v2.1/servers/428b73b8-21f1-47cb-83bb-df2b45f210dc/action" status: 200 len: 32637 microversion: 2.1 time: 0.130769 Sep 23 05:08:13.287959 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3321/6474] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 05:08:13 2022] POST /compute/v2.1/servers/428b73b8-21f1-47cb-83bb-df2b45f210dc/action => generated 32637 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 05:08:15.874228 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1ac125f2-0e33-44b8-8662-5811c46b1efd tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:08:15.874228 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-1ac125f2-0e33-44b8-8662-5811c46b1efd tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] [instance: 428b73b8-21f1-47cb-83bb-df2b45f210dc] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:08:15.877925 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=17 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:08:15.895282 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-04f68d2d-50c5-4fd9-80b4-8b992681da38 req-de653302-3a78-4221-90a7-0f0f7ae7d2cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "428b73b8-21f1-47cb-83bb-df2b45f210dc", "tag": "0bce6435-2556-4f98-8e9f-841185913c4c"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:08:15.912744 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1ac125f2-0e33-44b8-8662-5811c46b1efd tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:15.912744 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1ac125f2-0e33-44b8-8662-5811c46b1efd tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:15.912744 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1ac125f2-0e33-44b8-8662-5811c46b1efd tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:15.912744 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1ac125f2-0e33-44b8-8662-5811c46b1efd tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:15.913099 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1ac125f2-0e33-44b8-8662-5811c46b1efd tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:15.913472 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1ac125f2-0e33-44b8-8662-5811c46b1efd tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:15.917467 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-04f68d2d-50c5-4fd9-80b4-8b992681da38 req-de653302-3a78-4221-90a7-0f0f7ae7d2cb service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:15.918000 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-04f68d2d-50c5-4fd9-80b4-8b992681da38 req-de653302-3a78-4221-90a7-0f0f7ae7d2cb service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:15.918448 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-04f68d2d-50c5-4fd9-80b4-8b992681da38 req-de653302-3a78-4221-90a7-0f0f7ae7d2cb service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:15.950358 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-04f68d2d-50c5-4fd9-80b4-8b992681da38 req-de653302-3a78-4221-90a7-0f0f7ae7d2cb service nova] Creating event network-changed:0bce6435-2556-4f98-8e9f-841185913c4c for instance 428b73b8-21f1-47cb-83bb-df2b45f210dc on n-h2-846463-3 Sep 23 05:08:15.979288 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-04f68d2d-50c5-4fd9-80b4-8b992681da38 req-de653302-3a78-4221-90a7-0f0f7ae7d2cb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094370 Sep 23 05:08:15.986712 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3322/6475] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:08:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Sep 23 05:08:16.061765 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-1ac125f2-0e33-44b8-8662-5811c46b1efd tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] [instance: 428b73b8-21f1-47cb-83bb-df2b45f210dc] Going to try to terminate instance {{(pid=122698) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 05:08:16.571242 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-1ac125f2-0e33-44b8-8662-5811c46b1efd tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] 10.222.0.33 "DELETE /compute/v2.1/servers/428b73b8-21f1-47cb-83bb-df2b45f210dc" status: 204 len: 0 microversion: 2.1 time: 0.703014 Sep 23 05:08:16.577450 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3154/6476] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 05:08:15 2022] DELETE /compute/v2.1/servers/428b73b8-21f1-47cb-83bb-df2b45f210dc => generated 0 bytes in 705 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 05:08:16.582581 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a7d6a2d3-9bc7-4bac-b1a4-8c9367b2232b tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:08:16.583919 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a7d6a2d3-9bc7-4bac-b1a4-8c9367b2232b tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] [instance: 428b73b8-21f1-47cb-83bb-df2b45f210dc] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:08:16.604559 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a7d6a2d3-9bc7-4bac-b1a4-8c9367b2232b tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:16.605148 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a7d6a2d3-9bc7-4bac-b1a4-8c9367b2232b tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:16.605697 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a7d6a2d3-9bc7-4bac-b1a4-8c9367b2232b tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:16.608768 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a7d6a2d3-9bc7-4bac-b1a4-8c9367b2232b tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:16.609263 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a7d6a2d3-9bc7-4bac-b1a4-8c9367b2232b tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:16.610440 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a7d6a2d3-9bc7-4bac-b1a4-8c9367b2232b tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:17.216882 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a7d6a2d3-9bc7-4bac-b1a4-8c9367b2232b tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e8ce1f6821424080453f994dbcd604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fefb9fd80184955a7856e1c41d081be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:08:17.219280 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a7d6a2d3-9bc7-4bac-b1a4-8c9367b2232b tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] 10.222.0.33 "GET /compute/v2.1/servers/428b73b8-21f1-47cb-83bb-df2b45f210dc" status: 200 len: 1672 microversion: 2.1 time: 0.642270 Sep 23 05:08:17.227990 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3323/6477] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:08:16 2022] GET /compute/v2.1/servers/428b73b8-21f1-47cb-83bb-df2b45f210dc => generated 1672 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:08:18.260155 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a48fce31-3ecb-4263-804f-64fc0c4fb538 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:08:18.260888 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a48fce31-3ecb-4263-804f-64fc0c4fb538 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] [instance: 428b73b8-21f1-47cb-83bb-df2b45f210dc] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:08:18.299997 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a48fce31-3ecb-4263-804f-64fc0c4fb538 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:18.300530 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a48fce31-3ecb-4263-804f-64fc0c4fb538 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:18.300984 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a48fce31-3ecb-4263-804f-64fc0c4fb538 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:18.301734 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a48fce31-3ecb-4263-804f-64fc0c4fb538 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:18.303223 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a48fce31-3ecb-4263-804f-64fc0c4fb538 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:18.303675 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a48fce31-3ecb-4263-804f-64fc0c4fb538 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:18.707453 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a48fce31-3ecb-4263-804f-64fc0c4fb538 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e8ce1f6821424080453f994dbcd604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fefb9fd80184955a7856e1c41d081be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:08:18.734863 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a48fce31-3ecb-4263-804f-64fc0c4fb538 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] 10.222.0.33 "GET /compute/v2.1/servers/428b73b8-21f1-47cb-83bb-df2b45f210dc" status: 200 len: 1672 microversion: 2.1 time: 0.471309 Sep 23 05:08:18.737467 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3155/6478] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:08:18 2022] GET /compute/v2.1/servers/428b73b8-21f1-47cb-83bb-df2b45f210dc => generated 1672 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:08:19.318872 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-758795be-4ca1-4f70-bb5e-86e407f9a718 req-3eba3b34-bbc4-47c1-840e-dfc2103dadfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "428b73b8-21f1-47cb-83bb-df2b45f210dc", "name": "network-vif-deleted", "tag": "0bce6435-2556-4f98-8e9f-841185913c4c"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:08:19.345658 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-758795be-4ca1-4f70-bb5e-86e407f9a718 req-3eba3b34-bbc4-47c1-840e-dfc2103dadfc service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:19.346305 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-758795be-4ca1-4f70-bb5e-86e407f9a718 req-3eba3b34-bbc4-47c1-840e-dfc2103dadfc service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:19.346903 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-758795be-4ca1-4f70-bb5e-86e407f9a718 req-3eba3b34-bbc4-47c1-840e-dfc2103dadfc service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:19.363293 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-758795be-4ca1-4f70-bb5e-86e407f9a718 req-3eba3b34-bbc4-47c1-840e-dfc2103dadfc service nova] Creating event network-vif-deleted:0bce6435-2556-4f98-8e9f-841185913c4c for instance 428b73b8-21f1-47cb-83bb-df2b45f210dc on n-h2-846463-3 Sep 23 05:08:19.368701 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-758795be-4ca1-4f70-bb5e-86e407f9a718 req-3eba3b34-bbc4-47c1-840e-dfc2103dadfc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054304 Sep 23 05:08:19.369815 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3324/6479] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:08:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:08:19.763836 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-fa53357a-d3d4-4477-aa1a-2a6b48de01ed tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:08:19.765296 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-fa53357a-d3d4-4477-aa1a-2a6b48de01ed tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] [instance: 428b73b8-21f1-47cb-83bb-df2b45f210dc] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:08:19.795446 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fa53357a-d3d4-4477-aa1a-2a6b48de01ed tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:19.796619 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fa53357a-d3d4-4477-aa1a-2a6b48de01ed tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:19.804737 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fa53357a-d3d4-4477-aa1a-2a6b48de01ed tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:19.806710 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fa53357a-d3d4-4477-aa1a-2a6b48de01ed tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:19.819330 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fa53357a-d3d4-4477-aa1a-2a6b48de01ed tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:19.820147 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fa53357a-d3d4-4477-aa1a-2a6b48de01ed tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:20.002668 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-fa53357a-d3d4-4477-aa1a-2a6b48de01ed tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e8ce1f6821424080453f994dbcd604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fefb9fd80184955a7856e1c41d081be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:08:20.013728 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-fa53357a-d3d4-4477-aa1a-2a6b48de01ed tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] 10.222.0.33 "GET /compute/v2.1/servers/428b73b8-21f1-47cb-83bb-df2b45f210dc" status: 200 len: 1333 microversion: 2.1 time: 0.254460 Sep 23 05:08:20.014807 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3156/6480] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:08:19 2022] GET /compute/v2.1/servers/428b73b8-21f1-47cb-83bb-df2b45f210dc => generated 1333 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:08:21.041094 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-277f410f-34e4-4288-b082-05b629a0c037 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:08:21.042237 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-277f410f-34e4-4288-b082-05b629a0c037 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] [instance: 428b73b8-21f1-47cb-83bb-df2b45f210dc] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:08:21.053529 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-277f410f-34e4-4288-b082-05b629a0c037 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:21.057996 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-277f410f-34e4-4288-b082-05b629a0c037 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:21.059358 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-277f410f-34e4-4288-b082-05b629a0c037 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:21.060290 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-277f410f-34e4-4288-b082-05b629a0c037 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:21.064208 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-277f410f-34e4-4288-b082-05b629a0c037 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:21.065038 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-277f410f-34e4-4288-b082-05b629a0c037 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:21.085239 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-277f410f-34e4-4288-b082-05b629a0c037 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] HTTP exception thrown: Instance 428b73b8-21f1-47cb-83bb-df2b45f210dc could not be found. Sep 23 05:08:21.087179 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-277f410f-34e4-4288-b082-05b629a0c037 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Request method failure captured: Sep 23 05:08:21.087179 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/428b73b8-21f1-47cb-83bb-df2b45f210dc HTTP/1.1 Sep 23 05:08:21.087179 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 05:08:21.087179 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 05:08:21.087179 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 05:08:21.087179 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 05:08:21.087179 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 05:08:21.087179 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 05:08:21.087179 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 05:08:21.087179 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 05:08:21.087179 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLT4jjbkkyDoZWHfPR1V0ShIocEZsrsl9xhOl39rTPs2JfkhWYUIQ1QBstT_UDtJPYbFOkCdWqhVVT4oPil_cmn0Gon-JSdsMVZWBhquD_JTT_sM242Gl5m-9DFc-8J1dr0llZqGhhH-M6_yAF2mLvUsCDZpXw0h-uybxfIrmdII4ntk Sep 23 05:08:21.087179 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 05:08:21.087179 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 05:08:21.087179 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 05:08:21.087179 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 05:08:21.087179 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 05:08:21.087179 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 05:08:21.087179 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 5fefb9fd80184955a7856e1c41d081be Sep 23 05:08:21.087179 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-TestNetworkBasicOps-560522400 Sep 23 05:08:21.087179 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 05:08:21.087179 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 05:08:21.087179 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5fefb9fd80184955a7856e1c41d081be", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5fefb9fd80184955a7856e1c41d081be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5fefb9fd80184955a7856e1c41d081be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5fefb9fd80184955a7856e1c41d081be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:08:21.087179 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-TestNetworkBasicOps-560522400 Sep 23 05:08:21.087179 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 5fefb9fd80184955a7856e1c41d081be Sep 23 05:08:21.087179 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-TestNetworkBasicOps-560522400 Sep 23 05:08:21.087179 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-TestNetworkBasicOps-560522400-project Sep 23 05:08:21.087179 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 05:08:21.087179 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 05:08:21.087179 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: b3e8ce1f6821424080453f994dbcd604 Sep 23 05:08:21.087179 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-TestNetworkBasicOps-560522400-project Sep 23 05:08:21.087179 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 05:08:21.087179 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 428b73b8-21f1-47cb-83bb-df2b45f210dc could not be found. Sep 23 05:08:21.087179 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '428b73b8-21f1-47cb-83bb-df2b45f210dc'} Sep 23 05:08:21.087179 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:08:21.087179 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:08:21.087179 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 05:08:21.087179 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 05:08:21.087179 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 05:08:21.087179 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 05:08:21.087179 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 05:08:21.087179 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 05:08:21.087179 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 05:08:21.087179 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 05:08:21.087179 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 428b73b8-21f1-47cb-83bb-df2b45f210dc could not be found. Sep 23 05:08:21.087179 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:08:21.087179 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:08:21.087179 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:08:21.087179 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:08:21.087179 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:08:21.087179 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:08:21.087179 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:08:21.087179 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:08:21.087179 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:08:21.087179 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:08:21.087179 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 05:08:21.087179 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 05:08:21.087179 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 05:08:21.087179 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 05:08:21.087179 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 05:08:21.087179 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:08:21.087179 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 428b73b8-21f1-47cb-83bb-df2b45f210dc could not be found. Sep 23 05:08:21.087179 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:08:21.087179 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:08:21.087179 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:08:21.090828 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:08:21.090828 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:08:21.090828 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:08:21.090828 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:08:21.090828 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:08:21.090828 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 428b73b8-21f1-47cb-83bb-df2b45f210dc could not be found. Sep 23 05:08:21.090828 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:08:21.090828 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-277f410f-34e4-4288-b082-05b629a0c037 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Returning 404 to user: Instance 428b73b8-21f1-47cb-83bb-df2b45f210dc could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:08:21.090828 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-277f410f-34e4-4288-b082-05b629a0c037 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] 10.222.0.33 "GET /compute/v2.1/servers/428b73b8-21f1-47cb-83bb-df2b45f210dc" status: 404 len: 111 microversion: 2.1 time: 0.055604 Sep 23 05:08:21.090828 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3325/6481] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:08:21 2022] GET /compute/v2.1/servers/428b73b8-21f1-47cb-83bb-df2b45f210dc => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 05:08:21.464751 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-bc79b46a-c73c-4466-84d1-e37591e23e98 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] Calling method '.version_select at 0x7ff1bbcce550>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:08:21.616344 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-bc79b46a-c73c-4466-84d1-e37591e23e98 tempest-TestNetworkBasicOps-560522400 tempest-TestNetworkBasicOps-560522400-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1822468595" status: 202 len: 0 microversion: 2.1 time: 0.156130 Sep 23 05:08:21.621731 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3157/6482] 10.222.0.33 () {58 vars in 1257 bytes} [Fri Sep 23 05:08:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1822468595 => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 23 05:08:32.207051 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-db4c6448-3260-4b17-b1b2-9832cf6dfaaa tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:08:32.208160 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-db4c6448-3260-4b17-b1b2-9832cf6dfaaa tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 3b1a8172-f2d4-4308-8a1f-423b492fc023] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:08:32.211060 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=10 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:08:32.211719 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=16 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:08:32.216753 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-db4c6448-3260-4b17-b1b2-9832cf6dfaaa tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:32.217266 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-db4c6448-3260-4b17-b1b2-9832cf6dfaaa tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:32.217706 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-db4c6448-3260-4b17-b1b2-9832cf6dfaaa tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:32.218663 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-db4c6448-3260-4b17-b1b2-9832cf6dfaaa tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:32.219308 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-db4c6448-3260-4b17-b1b2-9832cf6dfaaa tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:32.219898 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-db4c6448-3260-4b17-b1b2-9832cf6dfaaa tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:32.246419 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-db4c6448-3260-4b17-b1b2-9832cf6dfaaa tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/3b1a8172-f2d4-4308-8a1f-423b492fc023/ips" status: 200 len: 150 microversion: 2.1 time: 0.043332 Sep 23 05:08:32.247616 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3326/6483] 10.222.0.33 () {58 vars in 1248 bytes} [Fri Sep 23 05:08:32 2022] GET /compute/v2.1/servers/3b1a8172-f2d4-4308-8a1f-423b492fc023/ips => generated 150 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 05:08:33.476437 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a604c32d-aeb8-4815-b250-a99da34d7d6e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1279839090", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "bf62dbcf-35db-4d5b-a32c-a8db98d1e05e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "4600129e-ae78-4842-a9e8-005f0a31ee9b"}]}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:08:33.492784 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:08:33.492784 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:08:33.548420 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.network.neutron [None req-a604c32d-aeb8-4815-b250-a99da34d7d6e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] validate_networks() for [('4600129e-ae78-4842-a9e8-005f0a31ee9b', None, None, None, None, None)] {{(pid=122698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 05:08:34.500282 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-a604c32d-aeb8-4815-b250-a99da34d7d6e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Flavor limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 05:08:34.500854 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-a604c32d-aeb8-4815-b250-a99da34d7d6e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Image limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 05:08:34.501451 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-a604c32d-aeb8-4815-b250-a99da34d7d6e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Flavor pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 05:08:34.502047 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-a604c32d-aeb8-4815-b250-a99da34d7d6e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Image pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 05:08:34.503196 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-a604c32d-aeb8-4815-b250-a99da34d7d6e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 05:08:34.517755 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a604c32d-aeb8-4815-b250-a99da34d7d6e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:34.525454 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a604c32d-aeb8-4815-b250-a99da34d7d6e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:34.526463 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a604c32d-aeb8-4815-b250-a99da34d7d6e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:34.528083 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a604c32d-aeb8-4815-b250-a99da34d7d6e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:34.528771 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a604c32d-aeb8-4815-b250-a99da34d7d6e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:34.529452 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a604c32d-aeb8-4815-b250-a99da34d7d6e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:34.611645 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-a604c32d-aeb8-4815-b250-a99da34d7d6e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Getting quotas for project cceaa1e24146497fbf3f79cebc112211. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 05:08:34.643605 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-a604c32d-aeb8-4815-b250-a99da34d7d6e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Getting quotas for user 0d55fe5072c14752846eb4ffc0eef91b and project cceaa1e24146497fbf3f79cebc112211. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 05:08:34.746187 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a604c32d-aeb8-4815-b250-a99da34d7d6e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Going to run 1 instances... {{(pid=122698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 05:08:34.750043 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a604c32d-aeb8-4815-b250-a99da34d7d6e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 362777d0-bfa6-4058-8875-e4c28c85f576] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bf62dbcf-35db-4d5b-a32c-a8db98d1e05e',volume_size=None,volume_type=None)] {{(pid=122698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 05:08:35.295657 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a604c32d-aeb8-4815-b250-a99da34d7d6e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.823199 Sep 23 05:08:35.296723 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3158/6484] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 05:08:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1825 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 05:08:35.315316 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1307a2fc-6a94-41f1-ae1c-40e4b314e356 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:08:35.315316 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1307a2fc-6a94-41f1-ae1c-40e4b314e356 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 362777d0-bfa6-4058-8875-e4c28c85f576] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:08:35.433626 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1307a2fc-6a94-41f1-ae1c-40e4b314e356 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:08:35.446327 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1307a2fc-6a94-41f1-ae1c-40e4b314e356 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/362777d0-bfa6-4058-8875-e4c28c85f576" status: 200 len: 1071 microversion: 2.1 time: 0.141890 Sep 23 05:08:35.461775 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3327/6485] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:08:35 2022] GET /compute/v2.1/servers/362777d0-bfa6-4058-8875-e4c28c85f576 => generated 1071 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:08:35.529358 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-01ce346f-ea54-4476-bafd-815713181441 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fa451b32-0fe9-4d4e-9014-c8adb2b294ac"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:08:35.534894 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-01ce346f-ea54-4476-bafd-815713181441 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 3b1a8172-f2d4-4308-8a1f-423b492fc023] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:08:35.547026 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-01ce346f-ea54-4476-bafd-815713181441 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:35.547683 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-01ce346f-ea54-4476-bafd-815713181441 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:35.548596 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-01ce346f-ea54-4476-bafd-815713181441 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:35.549634 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-01ce346f-ea54-4476-bafd-815713181441 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:35.550209 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-01ce346f-ea54-4476-bafd-815713181441 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:35.555755 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-01ce346f-ea54-4476-bafd-815713181441 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:36.470343 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-429a06ad-a024-4491-834c-f37f74f30c7a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:08:36.470969 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-429a06ad-a024-4491-834c-f37f74f30c7a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 362777d0-bfa6-4058-8875-e4c28c85f576] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:08:36.576669 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-429a06ad-a024-4491-834c-f37f74f30c7a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:08:36.586008 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-429a06ad-a024-4491-834c-f37f74f30c7a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/362777d0-bfa6-4058-8875-e4c28c85f576" status: 200 len: 1071 microversion: 2.1 time: 0.121171 Sep 23 05:08:36.590800 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3328/6486] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:08:36 2022] GET /compute/v2.1/servers/362777d0-bfa6-4058-8875-e4c28c85f576 => generated 1071 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:08:36.680341 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-01ce346f-ea54-4476-bafd-815713181441 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "POST /compute/v2.1/servers/3b1a8172-f2d4-4308-8a1f-423b492fc023/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.157256 Sep 23 05:08:36.698091 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3159/6487] 10.222.0.33 () {60 vars in 1323 bytes} [Fri Sep 23 05:08:35 2022] POST /compute/v2.1/servers/3b1a8172-f2d4-4308-8a1f-423b492fc023/os-volume_attachments => generated 194 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:08:37.612959 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ee0122dd-ad16-4323-8e4d-cf8a4583cedc tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:08:37.613581 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ee0122dd-ad16-4323-8e4d-cf8a4583cedc tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 362777d0-bfa6-4058-8875-e4c28c85f576] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:08:37.633293 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ee0122dd-ad16-4323-8e4d-cf8a4583cedc tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:37.634606 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ee0122dd-ad16-4323-8e4d-cf8a4583cedc tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:37.635265 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ee0122dd-ad16-4323-8e4d-cf8a4583cedc tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:37.636198 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ee0122dd-ad16-4323-8e4d-cf8a4583cedc tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:37.636821 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ee0122dd-ad16-4323-8e4d-cf8a4583cedc tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:37.637412 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ee0122dd-ad16-4323-8e4d-cf8a4583cedc tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:37.802299 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ee0122dd-ad16-4323-8e4d-cf8a4583cedc tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:08:37.819420 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ee0122dd-ad16-4323-8e4d-cf8a4583cedc tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/362777d0-bfa6-4058-8875-e4c28c85f576" status: 200 len: 1169 microversion: 2.1 time: 0.211464 Sep 23 05:08:37.821523 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3329/6488] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:08:37 2022] GET /compute/v2.1/servers/362777d0-bfa6-4058-8875-e4c28c85f576 => generated 1169 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:08:38.847317 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2a5f80b7-e302-4604-b651-e68f3bfcd738 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:08:38.848790 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-2a5f80b7-e302-4604-b651-e68f3bfcd738 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 362777d0-bfa6-4058-8875-e4c28c85f576] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:08:38.884620 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2a5f80b7-e302-4604-b651-e68f3bfcd738 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:38.885390 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2a5f80b7-e302-4604-b651-e68f3bfcd738 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:38.886179 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2a5f80b7-e302-4604-b651-e68f3bfcd738 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:38.887210 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2a5f80b7-e302-4604-b651-e68f3bfcd738 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:38.888919 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2a5f80b7-e302-4604-b651-e68f3bfcd738 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:38.890474 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2a5f80b7-e302-4604-b651-e68f3bfcd738 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:39.057135 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-2a5f80b7-e302-4604-b651-e68f3bfcd738 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:08:39.074644 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2a5f80b7-e302-4604-b651-e68f3bfcd738 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/362777d0-bfa6-4058-8875-e4c28c85f576" status: 200 len: 1187 microversion: 2.1 time: 0.222561 Sep 23 05:08:39.082113 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3160/6489] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:08:38 2022] GET /compute/v2.1/servers/362777d0-bfa6-4058-8875-e4c28c85f576 => generated 1187 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:08:39.554953 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-af681edf-67cc-4162-a50f-552abf8c624f tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-684748771", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "networks": [{"uuid": "46b0aeba-d8ea-4eb7-80ad-b281d35a944b"}]}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:08:39.656945 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.neutron [None req-af681edf-67cc-4162-a50f-552abf8c624f tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] validate_networks() for [('46b0aeba-d8ea-4eb7-80ad-b281d35a944b', None, None, None, None, None)] {{(pid=122699) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 05:08:40.111574 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e1d4b4e1-9417-4c95-839d-77e07a2226f5 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:08:40.111574 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e1d4b4e1-9417-4c95-839d-77e07a2226f5 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 362777d0-bfa6-4058-8875-e4c28c85f576] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:08:40.122087 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e1d4b4e1-9417-4c95-839d-77e07a2226f5 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:40.123180 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e1d4b4e1-9417-4c95-839d-77e07a2226f5 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:40.123640 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e1d4b4e1-9417-4c95-839d-77e07a2226f5 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:40.124838 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e1d4b4e1-9417-4c95-839d-77e07a2226f5 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:40.125319 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e1d4b4e1-9417-4c95-839d-77e07a2226f5 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:40.125759 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e1d4b4e1-9417-4c95-839d-77e07a2226f5 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:40.315360 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e1d4b4e1-9417-4c95-839d-77e07a2226f5 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:08:40.335155 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e1d4b4e1-9417-4c95-839d-77e07a2226f5 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/362777d0-bfa6-4058-8875-e4c28c85f576" status: 200 len: 1187 microversion: 2.1 time: 0.236841 Sep 23 05:08:40.359043 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3161/6490] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:08:40 2022] GET /compute/v2.1/servers/362777d0-bfa6-4058-8875-e4c28c85f576 => generated 1187 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:08:40.359586 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-af681edf-67cc-4162-a50f-552abf8c624f tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Flavor limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 05:08:40.360081 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-af681edf-67cc-4162-a50f-552abf8c624f tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Image limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 05:08:40.360645 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-af681edf-67cc-4162-a50f-552abf8c624f tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Flavor pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 05:08:40.361126 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-af681edf-67cc-4162-a50f-552abf8c624f tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Image pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 05:08:40.361862 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-af681edf-67cc-4162-a50f-552abf8c624f tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 05:08:40.376855 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-af681edf-67cc-4162-a50f-552abf8c624f tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:40.377384 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-af681edf-67cc-4162-a50f-552abf8c624f tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:40.377858 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-af681edf-67cc-4162-a50f-552abf8c624f tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:40.378641 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-af681edf-67cc-4162-a50f-552abf8c624f tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:40.379123 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-af681edf-67cc-4162-a50f-552abf8c624f tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:40.379624 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-af681edf-67cc-4162-a50f-552abf8c624f tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:40.422548 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-af681edf-67cc-4162-a50f-552abf8c624f tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Getting quotas for project a4873cc166584624b8c00d6f14ccf3ab. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 05:08:40.430376 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-af681edf-67cc-4162-a50f-552abf8c624f tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Getting quotas for user a1bb2f4659524c3d9e5a15758d73ff93 and project a4873cc166584624b8c00d6f14ccf3ab. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 05:08:40.475527 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-af681edf-67cc-4162-a50f-552abf8c624f tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Going to run 1 instances... {{(pid=122699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 05:08:40.486117 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-af681edf-67cc-4162-a50f-552abf8c624f tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] [instance: f42825c1-35fe-47b7-9fcc-ed93a82070eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 05:08:40.725380 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-af681edf-67cc-4162-a50f-552abf8c624f tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.425503 Sep 23 05:08:40.729703 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3330/6491] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 05:08:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1429 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 05:08:40.738638 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-500a05ad-8306-40b5-899c-959d75b2f38d tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:08:40.742085 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-500a05ad-8306-40b5-899c-959d75b2f38d tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] [instance: f42825c1-35fe-47b7-9fcc-ed93a82070eb] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:08:40.816450 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-500a05ad-8306-40b5-899c-959d75b2f38d tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bb2f4659524c3d9e5a15758d73ff93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4873cc166584624b8c00d6f14ccf3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:08:40.824898 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-500a05ad-8306-40b5-899c-959d75b2f38d tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] 10.222.0.33 "GET /compute/v2.1/servers/f42825c1-35fe-47b7-9fcc-ed93a82070eb" status: 200 len: 1214 microversion: 2.1 time: 0.090768 Sep 23 05:08:40.828207 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3162/6492] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:08:40 2022] GET /compute/v2.1/servers/f42825c1-35fe-47b7-9fcc-ed93a82070eb => generated 1214 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:08:41.375091 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7ae89b32-3f33-4ff0-b50d-287a0813c9c4 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:08:41.376003 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-7ae89b32-3f33-4ff0-b50d-287a0813c9c4 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 362777d0-bfa6-4058-8875-e4c28c85f576] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:08:41.385158 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7ae89b32-3f33-4ff0-b50d-287a0813c9c4 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:41.387074 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7ae89b32-3f33-4ff0-b50d-287a0813c9c4 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:41.387074 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7ae89b32-3f33-4ff0-b50d-287a0813c9c4 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:41.387793 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7ae89b32-3f33-4ff0-b50d-287a0813c9c4 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:41.388276 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7ae89b32-3f33-4ff0-b50d-287a0813c9c4 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:41.388719 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7ae89b32-3f33-4ff0-b50d-287a0813c9c4 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:41.851865 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8454b593-aacb-45e1-8b3f-d06d5e8c987f tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:08:41.852484 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8454b593-aacb-45e1-8b3f-d06d5e8c987f tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] [instance: f42825c1-35fe-47b7-9fcc-ed93a82070eb] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:08:41.883730 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-7ae89b32-3f33-4ff0-b50d-287a0813c9c4 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:08:41.897428 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-7ae89b32-3f33-4ff0-b50d-287a0813c9c4 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/362777d0-bfa6-4058-8875-e4c28c85f576" status: 200 len: 1229 microversion: 2.1 time: 0.526201 Sep 23 05:08:41.898449 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3331/6493] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:08:41 2022] GET /compute/v2.1/servers/362777d0-bfa6-4058-8875-e4c28c85f576 => generated 1229 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:08:41.949085 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8454b593-aacb-45e1-8b3f-d06d5e8c987f tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bb2f4659524c3d9e5a15758d73ff93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4873cc166584624b8c00d6f14ccf3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:08:41.958011 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8454b593-aacb-45e1-8b3f-d06d5e8c987f tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] 10.222.0.33 "GET /compute/v2.1/servers/f42825c1-35fe-47b7-9fcc-ed93a82070eb" status: 200 len: 1214 microversion: 2.1 time: 0.110649 Sep 23 05:08:41.964542 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3163/6494] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:08:41 2022] GET /compute/v2.1/servers/f42825c1-35fe-47b7-9fcc-ed93a82070eb => generated 1214 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:08:42.131523 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-89fbc65f-6b13-40b3-b4b7-013878c3c384 req-059fd36c-f9b9-4ae5-8dfa-df3e63af85b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "362777d0-bfa6-4058-8875-e4c28c85f576", "tag": "da0ab434-f9ad-4d6b-bd5e-206238561f05"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:08:42.148024 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-89fbc65f-6b13-40b3-b4b7-013878c3c384 req-059fd36c-f9b9-4ae5-8dfa-df3e63af85b1 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:42.148643 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-89fbc65f-6b13-40b3-b4b7-013878c3c384 req-059fd36c-f9b9-4ae5-8dfa-df3e63af85b1 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:42.149245 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-89fbc65f-6b13-40b3-b4b7-013878c3c384 req-059fd36c-f9b9-4ae5-8dfa-df3e63af85b1 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:42.172851 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-89fbc65f-6b13-40b3-b4b7-013878c3c384 req-059fd36c-f9b9-4ae5-8dfa-df3e63af85b1 service nova] Creating event network-changed:da0ab434-f9ad-4d6b-bd5e-206238561f05 for instance 362777d0-bfa6-4058-8875-e4c28c85f576 on n-h2-846463-3 Sep 23 05:08:42.179746 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-89fbc65f-6b13-40b3-b4b7-013878c3c384 req-059fd36c-f9b9-4ae5-8dfa-df3e63af85b1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055063 Sep 23 05:08:42.181507 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3332/6495] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:08:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:08:42.922478 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9bc9f770-2a66-4329-ab73-705a61904cc2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:08:42.923105 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-9bc9f770-2a66-4329-ab73-705a61904cc2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 362777d0-bfa6-4058-8875-e4c28c85f576] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:08:42.937962 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9bc9f770-2a66-4329-ab73-705a61904cc2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:42.938955 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9bc9f770-2a66-4329-ab73-705a61904cc2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:42.940103 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9bc9f770-2a66-4329-ab73-705a61904cc2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:42.941504 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9bc9f770-2a66-4329-ab73-705a61904cc2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:42.944140 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9bc9f770-2a66-4329-ab73-705a61904cc2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:42.944869 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9bc9f770-2a66-4329-ab73-705a61904cc2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:42.988144 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5b8fe18f-48ac-42fd-abe0-c758f2d58d3f tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:08:42.997014 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-5b8fe18f-48ac-42fd-abe0-c758f2d58d3f tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] [instance: f42825c1-35fe-47b7-9fcc-ed93a82070eb] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:08:43.014983 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5b8fe18f-48ac-42fd-abe0-c758f2d58d3f tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:43.015791 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5b8fe18f-48ac-42fd-abe0-c758f2d58d3f tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:43.016630 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5b8fe18f-48ac-42fd-abe0-c758f2d58d3f tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:43.017587 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5b8fe18f-48ac-42fd-abe0-c758f2d58d3f tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:43.018551 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5b8fe18f-48ac-42fd-abe0-c758f2d58d3f tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:43.019283 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5b8fe18f-48ac-42fd-abe0-c758f2d58d3f tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:43.191940 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-5b8fe18f-48ac-42fd-abe0-c758f2d58d3f tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bb2f4659524c3d9e5a15758d73ff93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4873cc166584624b8c00d6f14ccf3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:08:43.215894 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5b8fe18f-48ac-42fd-abe0-c758f2d58d3f tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] 10.222.0.33 "GET /compute/v2.1/servers/f42825c1-35fe-47b7-9fcc-ed93a82070eb" status: 200 len: 1210 microversion: 2.1 time: 0.231670 Sep 23 05:08:43.217422 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3333/6496] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:08:42 2022] GET /compute/v2.1/servers/f42825c1-35fe-47b7-9fcc-ed93a82070eb => generated 1210 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:08:43.344396 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-9bc9f770-2a66-4329-ab73-705a61904cc2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:08:43.356728 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9bc9f770-2a66-4329-ab73-705a61904cc2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/362777d0-bfa6-4058-8875-e4c28c85f576" status: 200 len: 1229 microversion: 2.1 time: 0.438818 Sep 23 05:08:43.357833 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3164/6497] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:08:42 2022] GET /compute/v2.1/servers/362777d0-bfa6-4058-8875-e4c28c85f576 => generated 1229 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:08:44.246562 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ff5f8409-4752-4f13-ae09-d29e3f05c085 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:08:44.247332 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ff5f8409-4752-4f13-ae09-d29e3f05c085 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] [instance: f42825c1-35fe-47b7-9fcc-ed93a82070eb] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:08:44.258567 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ff5f8409-4752-4f13-ae09-d29e3f05c085 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:44.268206 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ff5f8409-4752-4f13-ae09-d29e3f05c085 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:44.268831 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ff5f8409-4752-4f13-ae09-d29e3f05c085 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:44.269736 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ff5f8409-4752-4f13-ae09-d29e3f05c085 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:44.270335 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ff5f8409-4752-4f13-ae09-d29e3f05c085 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:44.270871 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ff5f8409-4752-4f13-ae09-d29e3f05c085 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:44.383292 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7c1925aa-81b4-41f3-bd5f-7a4c2d60504e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:08:44.384455 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7c1925aa-81b4-41f3-bd5f-7a4c2d60504e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 362777d0-bfa6-4058-8875-e4c28c85f576] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:08:44.444545 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7c1925aa-81b4-41f3-bd5f-7a4c2d60504e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:44.448527 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7c1925aa-81b4-41f3-bd5f-7a4c2d60504e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:44.449658 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7c1925aa-81b4-41f3-bd5f-7a4c2d60504e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:44.450748 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7c1925aa-81b4-41f3-bd5f-7a4c2d60504e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:44.451857 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7c1925aa-81b4-41f3-bd5f-7a4c2d60504e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:44.454074 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7c1925aa-81b4-41f3-bd5f-7a4c2d60504e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:44.572045 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ff5f8409-4752-4f13-ae09-d29e3f05c085 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bb2f4659524c3d9e5a15758d73ff93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4873cc166584624b8c00d6f14ccf3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:08:44.583699 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:08:44.584914 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ff5f8409-4752-4f13-ae09-d29e3f05c085 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] 10.222.0.33 "GET /compute/v2.1/servers/f42825c1-35fe-47b7-9fcc-ed93a82070eb" status: 200 len: 1274 microversion: 2.1 time: 0.342192 Sep 23 05:08:44.585935 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3334/6498] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:08:44 2022] GET /compute/v2.1/servers/f42825c1-35fe-47b7-9fcc-ed93a82070eb => generated 1274 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:08:44.742980 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-7c1925aa-81b4-41f3-bd5f-7a4c2d60504e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:08:44.761328 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7c1925aa-81b4-41f3-bd5f-7a4c2d60504e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/362777d0-bfa6-4058-8875-e4c28c85f576" status: 200 len: 1229 microversion: 2.1 time: 0.383965 Sep 23 05:08:44.762294 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3165/6499] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:08:44 2022] GET /compute/v2.1/servers/362777d0-bfa6-4058-8875-e4c28c85f576 => generated 1229 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:08:45.608675 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b981319a-ef17-42b3-9f8d-ce648710011e tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:08:45.609292 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b981319a-ef17-42b3-9f8d-ce648710011e tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] [instance: f42825c1-35fe-47b7-9fcc-ed93a82070eb] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:08:45.630845 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b981319a-ef17-42b3-9f8d-ce648710011e tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:45.635198 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b981319a-ef17-42b3-9f8d-ce648710011e tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:45.635198 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b981319a-ef17-42b3-9f8d-ce648710011e tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:45.635198 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b981319a-ef17-42b3-9f8d-ce648710011e tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:45.635198 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b981319a-ef17-42b3-9f8d-ce648710011e tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:45.635198 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b981319a-ef17-42b3-9f8d-ce648710011e tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:45.784590 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2daac387-144f-499b-a3cd-53a794db8e2d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:08:45.785367 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-2daac387-144f-499b-a3cd-53a794db8e2d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 362777d0-bfa6-4058-8875-e4c28c85f576] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:08:45.799070 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2daac387-144f-499b-a3cd-53a794db8e2d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:45.799070 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2daac387-144f-499b-a3cd-53a794db8e2d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:45.799070 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2daac387-144f-499b-a3cd-53a794db8e2d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:45.799785 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2daac387-144f-499b-a3cd-53a794db8e2d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:45.804623 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2daac387-144f-499b-a3cd-53a794db8e2d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:45.805270 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2daac387-144f-499b-a3cd-53a794db8e2d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:45.857153 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b981319a-ef17-42b3-9f8d-ce648710011e tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bb2f4659524c3d9e5a15758d73ff93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4873cc166584624b8c00d6f14ccf3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:08:45.870106 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b981319a-ef17-42b3-9f8d-ce648710011e tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] 10.222.0.33 "GET /compute/v2.1/servers/f42825c1-35fe-47b7-9fcc-ed93a82070eb" status: 200 len: 1314 microversion: 2.1 time: 0.262877 Sep 23 05:08:45.872876 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3335/6500] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:08:45 2022] GET /compute/v2.1/servers/f42825c1-35fe-47b7-9fcc-ed93a82070eb => generated 1314 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:08:46.026247 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-2daac387-144f-499b-a3cd-53a794db8e2d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:08:46.044203 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2daac387-144f-499b-a3cd-53a794db8e2d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/362777d0-bfa6-4058-8875-e4c28c85f576" status: 200 len: 1229 microversion: 2.1 time: 0.261831 Sep 23 05:08:46.059665 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3166/6501] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:08:45 2022] GET /compute/v2.1/servers/362777d0-bfa6-4058-8875-e4c28c85f576 => generated 1229 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:08:46.495565 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-ed292792-1e97-4f1a-894a-400e68c37234 req-d069072e-61a4-441e-8737-9ad68aacfb61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f42825c1-35fe-47b7-9fcc-ed93a82070eb", "tag": "2ba12267-c2f9-4bf7-84dc-9306f8d2a7c0"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:08:46.545755 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-ed292792-1e97-4f1a-894a-400e68c37234 req-d069072e-61a4-441e-8737-9ad68aacfb61 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:46.546332 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-ed292792-1e97-4f1a-894a-400e68c37234 req-d069072e-61a4-441e-8737-9ad68aacfb61 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:46.547279 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-ed292792-1e97-4f1a-894a-400e68c37234 req-d069072e-61a4-441e-8737-9ad68aacfb61 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:46.579583 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-ed292792-1e97-4f1a-894a-400e68c37234 req-d069072e-61a4-441e-8737-9ad68aacfb61 service nova] Creating event network-changed:2ba12267-c2f9-4bf7-84dc-9306f8d2a7c0 for instance f42825c1-35fe-47b7-9fcc-ed93a82070eb on n-h1-846463-3 Sep 23 05:08:46.603279 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-ed292792-1e97-4f1a-894a-400e68c37234 req-d069072e-61a4-441e-8737-9ad68aacfb61 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112354 Sep 23 05:08:46.603939 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3336/6502] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:08:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:08:46.904910 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6ec7522d-da4e-46b9-8e59-8ec6d36aaedd tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:08:46.909375 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-6ec7522d-da4e-46b9-8e59-8ec6d36aaedd tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] [instance: f42825c1-35fe-47b7-9fcc-ed93a82070eb] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:08:46.928563 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6ec7522d-da4e-46b9-8e59-8ec6d36aaedd tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:46.928563 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6ec7522d-da4e-46b9-8e59-8ec6d36aaedd tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:46.928563 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6ec7522d-da4e-46b9-8e59-8ec6d36aaedd tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:46.928563 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6ec7522d-da4e-46b9-8e59-8ec6d36aaedd tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:46.928563 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6ec7522d-da4e-46b9-8e59-8ec6d36aaedd tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:46.928563 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6ec7522d-da4e-46b9-8e59-8ec6d36aaedd tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:47.086553 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a2f1ebe0-1171-4447-a5d4-a637434fa34c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:08:47.087859 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a2f1ebe0-1171-4447-a5d4-a637434fa34c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 362777d0-bfa6-4058-8875-e4c28c85f576] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:08:47.095009 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a2f1ebe0-1171-4447-a5d4-a637434fa34c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:47.095747 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a2f1ebe0-1171-4447-a5d4-a637434fa34c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:47.096363 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a2f1ebe0-1171-4447-a5d4-a637434fa34c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:47.097745 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a2f1ebe0-1171-4447-a5d4-a637434fa34c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:47.098392 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a2f1ebe0-1171-4447-a5d4-a637434fa34c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:47.098982 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a2f1ebe0-1171-4447-a5d4-a637434fa34c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:47.264072 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6ec7522d-da4e-46b9-8e59-8ec6d36aaedd tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bb2f4659524c3d9e5a15758d73ff93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4873cc166584624b8c00d6f14ccf3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:08:47.285819 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-6ec7522d-da4e-46b9-8e59-8ec6d36aaedd tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] 10.222.0.33 "GET /compute/v2.1/servers/f42825c1-35fe-47b7-9fcc-ed93a82070eb" status: 200 len: 1314 microversion: 2.1 time: 0.384811 Sep 23 05:08:47.302241 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3167/6503] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:08:46 2022] GET /compute/v2.1/servers/f42825c1-35fe-47b7-9fcc-ed93a82070eb => generated 1314 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:08:47.349084 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a2f1ebe0-1171-4447-a5d4-a637434fa34c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:08:47.354742 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a2f1ebe0-1171-4447-a5d4-a637434fa34c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/362777d0-bfa6-4058-8875-e4c28c85f576" status: 200 len: 1229 microversion: 2.1 time: 0.274793 Sep 23 05:08:47.355488 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3337/6504] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:08:47 2022] GET /compute/v2.1/servers/362777d0-bfa6-4058-8875-e4c28c85f576 => generated 1229 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:08:48.309365 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4e5d922c-b9f9-4d98-bd79-2cdfbf7d19b0 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:08:48.310497 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4e5d922c-b9f9-4d98-bd79-2cdfbf7d19b0 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] [instance: f42825c1-35fe-47b7-9fcc-ed93a82070eb] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:08:48.322779 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4e5d922c-b9f9-4d98-bd79-2cdfbf7d19b0 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:48.329703 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4e5d922c-b9f9-4d98-bd79-2cdfbf7d19b0 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:48.330700 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4e5d922c-b9f9-4d98-bd79-2cdfbf7d19b0 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:48.331601 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4e5d922c-b9f9-4d98-bd79-2cdfbf7d19b0 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:48.332227 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4e5d922c-b9f9-4d98-bd79-2cdfbf7d19b0 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:48.336723 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4e5d922c-b9f9-4d98-bd79-2cdfbf7d19b0 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:48.378543 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-54aa9ec8-51d1-4bdb-aff1-5673b6b983fb tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:08:48.379176 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-54aa9ec8-51d1-4bdb-aff1-5673b6b983fb tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 362777d0-bfa6-4058-8875-e4c28c85f576] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:08:48.398220 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-54aa9ec8-51d1-4bdb-aff1-5673b6b983fb tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:48.398980 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-54aa9ec8-51d1-4bdb-aff1-5673b6b983fb tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:48.399605 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-54aa9ec8-51d1-4bdb-aff1-5673b6b983fb tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:48.400516 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-54aa9ec8-51d1-4bdb-aff1-5673b6b983fb tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:48.401325 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-54aa9ec8-51d1-4bdb-aff1-5673b6b983fb tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:48.402184 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-54aa9ec8-51d1-4bdb-aff1-5673b6b983fb tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:48.548860 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4e5d922c-b9f9-4d98-bd79-2cdfbf7d19b0 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bb2f4659524c3d9e5a15758d73ff93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4873cc166584624b8c00d6f14ccf3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:08:48.559592 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4e5d922c-b9f9-4d98-bd79-2cdfbf7d19b0 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] 10.222.0.33 "GET /compute/v2.1/servers/f42825c1-35fe-47b7-9fcc-ed93a82070eb" status: 200 len: 1314 microversion: 2.1 time: 0.254673 Sep 23 05:08:48.561207 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3168/6505] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:08:48 2022] GET /compute/v2.1/servers/f42825c1-35fe-47b7-9fcc-ed93a82070eb => generated 1314 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:08:48.614767 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-54aa9ec8-51d1-4bdb-aff1-5673b6b983fb tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:08:48.626349 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-54aa9ec8-51d1-4bdb-aff1-5673b6b983fb tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/362777d0-bfa6-4058-8875-e4c28c85f576" status: 200 len: 1229 microversion: 2.1 time: 0.250990 Sep 23 05:08:48.627427 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3338/6506] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:08:48 2022] GET /compute/v2.1/servers/362777d0-bfa6-4058-8875-e4c28c85f576 => generated 1229 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:08:49.584056 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4f8eeb81-2450-469e-b923-4429818272e3 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:08:49.584680 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4f8eeb81-2450-469e-b923-4429818272e3 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] [instance: f42825c1-35fe-47b7-9fcc-ed93a82070eb] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:08:49.591633 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4f8eeb81-2450-469e-b923-4429818272e3 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:49.592128 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4f8eeb81-2450-469e-b923-4429818272e3 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:49.592576 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4f8eeb81-2450-469e-b923-4429818272e3 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:49.593279 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4f8eeb81-2450-469e-b923-4429818272e3 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:49.593742 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4f8eeb81-2450-469e-b923-4429818272e3 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:49.594208 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4f8eeb81-2450-469e-b923-4429818272e3 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:49.654441 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-30373d22-15e8-47fc-84f4-cc37fec7177e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:08:49.655973 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-30373d22-15e8-47fc-84f4-cc37fec7177e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 362777d0-bfa6-4058-8875-e4c28c85f576] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:08:49.665684 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-30373d22-15e8-47fc-84f4-cc37fec7177e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:49.666473 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-30373d22-15e8-47fc-84f4-cc37fec7177e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:49.667077 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-30373d22-15e8-47fc-84f4-cc37fec7177e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:49.667964 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-30373d22-15e8-47fc-84f4-cc37fec7177e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:49.676096 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-30373d22-15e8-47fc-84f4-cc37fec7177e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:49.676604 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-30373d22-15e8-47fc-84f4-cc37fec7177e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:49.866690 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4f8eeb81-2450-469e-b923-4429818272e3 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bb2f4659524c3d9e5a15758d73ff93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4873cc166584624b8c00d6f14ccf3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:08:49.875869 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4f8eeb81-2450-469e-b923-4429818272e3 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] 10.222.0.33 "GET /compute/v2.1/servers/f42825c1-35fe-47b7-9fcc-ed93a82070eb" status: 200 len: 1314 microversion: 2.1 time: 0.295905 Sep 23 05:08:49.879807 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3169/6507] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:08:49 2022] GET /compute/v2.1/servers/f42825c1-35fe-47b7-9fcc-ed93a82070eb => generated 1314 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:08:49.944926 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-30373d22-15e8-47fc-84f4-cc37fec7177e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:08:49.953166 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-30373d22-15e8-47fc-84f4-cc37fec7177e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/362777d0-bfa6-4058-8875-e4c28c85f576" status: 200 len: 1229 microversion: 2.1 time: 0.306506 Sep 23 05:08:49.954024 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3339/6508] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:08:49 2022] GET /compute/v2.1/servers/362777d0-bfa6-4058-8875-e4c28c85f576 => generated 1229 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:08:50.904348 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7621e9b1-8bc5-4948-ab8d-16e3f7353f39 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:08:50.907045 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7621e9b1-8bc5-4948-ab8d-16e3f7353f39 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] [instance: f42825c1-35fe-47b7-9fcc-ed93a82070eb] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:08:50.916049 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7621e9b1-8bc5-4948-ab8d-16e3f7353f39 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:50.916049 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7621e9b1-8bc5-4948-ab8d-16e3f7353f39 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:50.916903 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7621e9b1-8bc5-4948-ab8d-16e3f7353f39 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:50.917804 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7621e9b1-8bc5-4948-ab8d-16e3f7353f39 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:50.918490 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7621e9b1-8bc5-4948-ab8d-16e3f7353f39 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:50.919100 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7621e9b1-8bc5-4948-ab8d-16e3f7353f39 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:50.978246 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4cadf771-b51f-48cd-b012-f0713d6a9329 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:08:50.979086 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4cadf771-b51f-48cd-b012-f0713d6a9329 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 362777d0-bfa6-4058-8875-e4c28c85f576] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:08:50.982322 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:08:50.982999 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=10 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:08:50.995117 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4cadf771-b51f-48cd-b012-f0713d6a9329 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:50.995726 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4cadf771-b51f-48cd-b012-f0713d6a9329 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:51.000762 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4cadf771-b51f-48cd-b012-f0713d6a9329 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:51.000762 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4cadf771-b51f-48cd-b012-f0713d6a9329 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:51.000762 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4cadf771-b51f-48cd-b012-f0713d6a9329 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:51.000762 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4cadf771-b51f-48cd-b012-f0713d6a9329 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:51.153142 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-7621e9b1-8bc5-4948-ab8d-16e3f7353f39 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bb2f4659524c3d9e5a15758d73ff93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4873cc166584624b8c00d6f14ccf3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:08:51.161605 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7621e9b1-8bc5-4948-ab8d-16e3f7353f39 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] 10.222.0.33 "GET /compute/v2.1/servers/f42825c1-35fe-47b7-9fcc-ed93a82070eb" status: 200 len: 1314 microversion: 2.1 time: 0.262101 Sep 23 05:08:51.162841 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3170/6509] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:08:50 2022] GET /compute/v2.1/servers/f42825c1-35fe-47b7-9fcc-ed93a82070eb => generated 1314 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:08:51.188460 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-4cadf771-b51f-48cd-b012-f0713d6a9329 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:08:51.194076 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4cadf771-b51f-48cd-b012-f0713d6a9329 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/362777d0-bfa6-4058-8875-e4c28c85f576" status: 200 len: 1217 microversion: 2.1 time: 0.221237 Sep 23 05:08:51.194697 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3340/6510] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:08:50 2022] GET /compute/v2.1/servers/362777d0-bfa6-4058-8875-e4c28c85f576 => generated 1217 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:08:52.047228 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-1a175208-8f6b-4480-bc1f-22d6d8c9bf08 req-62470c2a-48dd-495c-87ba-6e1d80473885 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f42825c1-35fe-47b7-9fcc-ed93a82070eb", "name": "network-vif-plugged", "status": "completed", "tag": "2ba12267-c2f9-4bf7-84dc-9306f8d2a7c0"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:08:52.055844 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=10 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:08:52.077554 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-1a175208-8f6b-4480-bc1f-22d6d8c9bf08 req-62470c2a-48dd-495c-87ba-6e1d80473885 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:52.078176 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-1a175208-8f6b-4480-bc1f-22d6d8c9bf08 req-62470c2a-48dd-495c-87ba-6e1d80473885 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:52.078620 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-1a175208-8f6b-4480-bc1f-22d6d8c9bf08 req-62470c2a-48dd-495c-87ba-6e1d80473885 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:52.100564 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-1a175208-8f6b-4480-bc1f-22d6d8c9bf08 req-62470c2a-48dd-495c-87ba-6e1d80473885 service nova] Creating event network-vif-plugged:2ba12267-c2f9-4bf7-84dc-9306f8d2a7c0 for instance f42825c1-35fe-47b7-9fcc-ed93a82070eb on n-h1-846463-3 Sep 23 05:08:52.106460 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-1a175208-8f6b-4480-bc1f-22d6d8c9bf08 req-62470c2a-48dd-495c-87ba-6e1d80473885 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064479 Sep 23 05:08:52.107518 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3171/6511] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:08:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:08:52.188796 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4bd72245-1031-4aa1-b38d-3f6c2f4ed0f9 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:08:52.190031 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4bd72245-1031-4aa1-b38d-3f6c2f4ed0f9 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] [instance: f42825c1-35fe-47b7-9fcc-ed93a82070eb] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:08:52.198047 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4bd72245-1031-4aa1-b38d-3f6c2f4ed0f9 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:52.198745 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4bd72245-1031-4aa1-b38d-3f6c2f4ed0f9 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:52.199374 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4bd72245-1031-4aa1-b38d-3f6c2f4ed0f9 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:52.200248 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4bd72245-1031-4aa1-b38d-3f6c2f4ed0f9 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:52.200866 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4bd72245-1031-4aa1-b38d-3f6c2f4ed0f9 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:52.201560 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4bd72245-1031-4aa1-b38d-3f6c2f4ed0f9 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:52.225530 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-42115ded-dab2-4bb9-8286-b1d8296afeb9 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:08:52.226987 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-42115ded-dab2-4bb9-8286-b1d8296afeb9 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 362777d0-bfa6-4058-8875-e4c28c85f576] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:08:52.237626 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-42115ded-dab2-4bb9-8286-b1d8296afeb9 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:52.238423 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-42115ded-dab2-4bb9-8286-b1d8296afeb9 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:52.239627 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-42115ded-dab2-4bb9-8286-b1d8296afeb9 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:52.241261 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-42115ded-dab2-4bb9-8286-b1d8296afeb9 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:52.241978 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-42115ded-dab2-4bb9-8286-b1d8296afeb9 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:52.242883 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-42115ded-dab2-4bb9-8286-b1d8296afeb9 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:52.450720 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-4bd72245-1031-4aa1-b38d-3f6c2f4ed0f9 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bb2f4659524c3d9e5a15758d73ff93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4873cc166584624b8c00d6f14ccf3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:08:52.461965 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4bd72245-1031-4aa1-b38d-3f6c2f4ed0f9 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] 10.222.0.33 "GET /compute/v2.1/servers/f42825c1-35fe-47b7-9fcc-ed93a82070eb" status: 200 len: 1314 microversion: 2.1 time: 0.276945 Sep 23 05:08:52.466980 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3341/6512] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:08:52 2022] GET /compute/v2.1/servers/f42825c1-35fe-47b7-9fcc-ed93a82070eb => generated 1314 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:08:52.492335 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-42115ded-dab2-4bb9-8286-b1d8296afeb9 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:08:52.500289 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-42115ded-dab2-4bb9-8286-b1d8296afeb9 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/362777d0-bfa6-4058-8875-e4c28c85f576" status: 200 len: 1217 microversion: 2.1 time: 0.283364 Sep 23 05:08:52.500879 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3172/6513] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:08:52 2022] GET /compute/v2.1/servers/362777d0-bfa6-4058-8875-e4c28c85f576 => generated 1217 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:08:53.484773 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f2255974-78eb-46ee-b3ce-6b45a3aff994 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:08:53.485543 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f2255974-78eb-46ee-b3ce-6b45a3aff994 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] [instance: f42825c1-35fe-47b7-9fcc-ed93a82070eb] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:08:53.492425 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f2255974-78eb-46ee-b3ce-6b45a3aff994 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:53.493002 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f2255974-78eb-46ee-b3ce-6b45a3aff994 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:53.493530 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f2255974-78eb-46ee-b3ce-6b45a3aff994 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:53.494346 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f2255974-78eb-46ee-b3ce-6b45a3aff994 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:53.494881 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f2255974-78eb-46ee-b3ce-6b45a3aff994 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:53.495465 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f2255974-78eb-46ee-b3ce-6b45a3aff994 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:53.525175 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4dad9620-238b-40bf-aad1-5e1f756c42c2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:08:53.526450 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4dad9620-238b-40bf-aad1-5e1f756c42c2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 362777d0-bfa6-4058-8875-e4c28c85f576] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:08:53.539133 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4dad9620-238b-40bf-aad1-5e1f756c42c2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:53.541651 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4dad9620-238b-40bf-aad1-5e1f756c42c2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:53.541651 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4dad9620-238b-40bf-aad1-5e1f756c42c2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:53.541651 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4dad9620-238b-40bf-aad1-5e1f756c42c2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:53.541651 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4dad9620-238b-40bf-aad1-5e1f756c42c2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:53.546184 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4dad9620-238b-40bf-aad1-5e1f756c42c2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:53.767187 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f2255974-78eb-46ee-b3ce-6b45a3aff994 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bb2f4659524c3d9e5a15758d73ff93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4873cc166584624b8c00d6f14ccf3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:08:53.770943 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4dad9620-238b-40bf-aad1-5e1f756c42c2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:08:53.782640 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f2255974-78eb-46ee-b3ce-6b45a3aff994 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] 10.222.0.33 "GET /compute/v2.1/servers/f42825c1-35fe-47b7-9fcc-ed93a82070eb" status: 200 len: 1314 microversion: 2.1 time: 0.301713 Sep 23 05:08:53.786117 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3342/6514] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:08:53 2022] GET /compute/v2.1/servers/f42825c1-35fe-47b7-9fcc-ed93a82070eb => generated 1314 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:08:53.789954 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4dad9620-238b-40bf-aad1-5e1f756c42c2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/362777d0-bfa6-4058-8875-e4c28c85f576" status: 200 len: 1217 microversion: 2.1 time: 0.270401 Sep 23 05:08:53.790764 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3173/6515] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:08:53 2022] GET /compute/v2.1/servers/362777d0-bfa6-4058-8875-e4c28c85f576 => generated 1217 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:08:54.807080 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f715cf4b-b7f6-40af-bc8e-32ffa2fb2703 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:08:54.807737 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f715cf4b-b7f6-40af-bc8e-32ffa2fb2703 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] [instance: f42825c1-35fe-47b7-9fcc-ed93a82070eb] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:08:54.816422 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f715cf4b-b7f6-40af-bc8e-32ffa2fb2703 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:54.817762 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f715cf4b-b7f6-40af-bc8e-32ffa2fb2703 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:54.817860 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-bc643f00-b44b-4424-8735-5c3a54b1a4bf tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:08:54.818845 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f715cf4b-b7f6-40af-bc8e-32ffa2fb2703 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:54.819303 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-bc643f00-b44b-4424-8735-5c3a54b1a4bf tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 362777d0-bfa6-4058-8875-e4c28c85f576] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:08:54.819920 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f715cf4b-b7f6-40af-bc8e-32ffa2fb2703 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:54.820545 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f715cf4b-b7f6-40af-bc8e-32ffa2fb2703 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:54.821147 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f715cf4b-b7f6-40af-bc8e-32ffa2fb2703 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:54.839173 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bc643f00-b44b-4424-8735-5c3a54b1a4bf tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:54.839773 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bc643f00-b44b-4424-8735-5c3a54b1a4bf tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:54.841930 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bc643f00-b44b-4424-8735-5c3a54b1a4bf tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:54.843059 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bc643f00-b44b-4424-8735-5c3a54b1a4bf tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:54.844502 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bc643f00-b44b-4424-8735-5c3a54b1a4bf tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:54.845401 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bc643f00-b44b-4424-8735-5c3a54b1a4bf tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:55.098066 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-bc643f00-b44b-4424-8735-5c3a54b1a4bf tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:08:55.105175 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f715cf4b-b7f6-40af-bc8e-32ffa2fb2703 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bb2f4659524c3d9e5a15758d73ff93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4873cc166584624b8c00d6f14ccf3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:08:55.109211 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-bc643f00-b44b-4424-8735-5c3a54b1a4bf tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/362777d0-bfa6-4058-8875-e4c28c85f576" status: 200 len: 1217 microversion: 2.1 time: 0.299167 Sep 23 05:08:55.110418 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3174/6516] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:08:54 2022] GET /compute/v2.1/servers/362777d0-bfa6-4058-8875-e4c28c85f576 => generated 1217 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:08:55.113438 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f715cf4b-b7f6-40af-bc8e-32ffa2fb2703 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] 10.222.0.33 "GET /compute/v2.1/servers/f42825c1-35fe-47b7-9fcc-ed93a82070eb" status: 200 len: 1501 microversion: 2.1 time: 0.310227 Sep 23 05:08:55.122053 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3343/6517] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:08:54 2022] GET /compute/v2.1/servers/f42825c1-35fe-47b7-9fcc-ed93a82070eb => generated 1501 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:08:55.124028 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5b0bd0c9-1306-4be5-96d4-736aa1b8a2f6 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:08:55.124691 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5b0bd0c9-1306-4be5-96d4-736aa1b8a2f6 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 3b1a8172-f2d4-4308-8a1f-423b492fc023] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:08:55.131334 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5b0bd0c9-1306-4be5-96d4-736aa1b8a2f6 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:55.132525 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5b0bd0c9-1306-4be5-96d4-736aa1b8a2f6 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:55.133152 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5b0bd0c9-1306-4be5-96d4-736aa1b8a2f6 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:55.133874 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5b0bd0c9-1306-4be5-96d4-736aa1b8a2f6 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:55.134420 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5b0bd0c9-1306-4be5-96d4-736aa1b8a2f6 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:55.134886 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5b0bd0c9-1306-4be5-96d4-736aa1b8a2f6 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:55.160560 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0be19828-dfbd-4225-9c33-9b8622a9e02c tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:08:55.166567 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-0be19828-dfbd-4225-9c33-9b8622a9e02c tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] [instance: f42825c1-35fe-47b7-9fcc-ed93a82070eb] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:08:55.173294 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0be19828-dfbd-4225-9c33-9b8622a9e02c tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:55.179232 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0be19828-dfbd-4225-9c33-9b8622a9e02c tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:55.179232 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0be19828-dfbd-4225-9c33-9b8622a9e02c tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:55.179232 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0be19828-dfbd-4225-9c33-9b8622a9e02c tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:55.179232 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0be19828-dfbd-4225-9c33-9b8622a9e02c tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:55.179549 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0be19828-dfbd-4225-9c33-9b8622a9e02c tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:55.239924 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-5b0bd0c9-1306-4be5-96d4-736aa1b8a2f6 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lazy-loading 'services' on Instance uuid 3b1a8172-f2d4-4308-8a1f-423b492fc023 {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 05:08:55.364377 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-0be19828-dfbd-4225-9c33-9b8622a9e02c tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bb2f4659524c3d9e5a15758d73ff93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4873cc166584624b8c00d6f14ccf3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:08:55.374822 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0be19828-dfbd-4225-9c33-9b8622a9e02c tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] 10.222.0.33 "GET /compute/v2.1/servers/f42825c1-35fe-47b7-9fcc-ed93a82070eb" status: 200 len: 1501 microversion: 2.1 time: 0.230708 Sep 23 05:08:55.375425 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3344/6518] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:08:55 2022] GET /compute/v2.1/servers/f42825c1-35fe-47b7-9fcc-ed93a82070eb => generated 1501 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:08:55.391641 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:08:55.401762 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ee912c5e-c45a-43fc-8b29-73759d8d496a tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:08:55.402480 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ee912c5e-c45a-43fc-8b29-73759d8d496a tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] [instance: f42825c1-35fe-47b7-9fcc-ed93a82070eb] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:08:55.409268 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ee912c5e-c45a-43fc-8b29-73759d8d496a tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:55.409769 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ee912c5e-c45a-43fc-8b29-73759d8d496a tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:55.410278 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ee912c5e-c45a-43fc-8b29-73759d8d496a tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:55.414541 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ee912c5e-c45a-43fc-8b29-73759d8d496a tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:55.414541 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ee912c5e-c45a-43fc-8b29-73759d8d496a tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:55.414541 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ee912c5e-c45a-43fc-8b29-73759d8d496a tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:55.441373 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-ee912c5e-c45a-43fc-8b29-73759d8d496a tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lazy-loading 'flavor' on Instance uuid f42825c1-35fe-47b7-9fcc-ed93a82070eb {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 05:08:55.468547 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5b0bd0c9-1306-4be5-96d4-736aa1b8a2f6 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "DELETE /compute/v2.1/servers/3b1a8172-f2d4-4308-8a1f-423b492fc023/os-volume_attachments/fa451b32-0fe9-4d4e-9014-c8adb2b294ac" status: 202 len: 0 microversion: 2.1 time: 0.356637 Sep 23 05:08:55.472542 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3175/6519] 10.222.0.33 () {58 vars in 1416 bytes} [Fri Sep 23 05:08:55 2022] DELETE /compute/v2.1/servers/3b1a8172-f2d4-4308-8a1f-423b492fc023/os-volume_attachments/fa451b32-0fe9-4d4e-9014-c8adb2b294ac => generated 0 bytes in 361 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 05:08:55.478377 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-87cd1b94-fc3b-441b-9f8c-e77768b8cd8e tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:08:55.480777 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-87cd1b94-fc3b-441b-9f8c-e77768b8cd8e tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 3b1a8172-f2d4-4308-8a1f-423b492fc023] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:08:55.488024 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-87cd1b94-fc3b-441b-9f8c-e77768b8cd8e tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:55.488531 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-87cd1b94-fc3b-441b-9f8c-e77768b8cd8e tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:55.488996 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-87cd1b94-fc3b-441b-9f8c-e77768b8cd8e tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:55.489697 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-87cd1b94-fc3b-441b-9f8c-e77768b8cd8e tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:55.490735 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-87cd1b94-fc3b-441b-9f8c-e77768b8cd8e tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:55.491171 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-87cd1b94-fc3b-441b-9f8c-e77768b8cd8e tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:55.522573 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-87cd1b94-fc3b-441b-9f8c-e77768b8cd8e tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/3b1a8172-f2d4-4308-8a1f-423b492fc023/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048559 Sep 23 05:08:55.523142 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3176/6520] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Sep 23 05:08:55 2022] GET /compute/v2.1/servers/3b1a8172-f2d4-4308-8a1f-423b492fc023/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:08:55.603964 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:08:55.838305 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ee912c5e-c45a-43fc-8b29-73759d8d496a tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] 10.222.0.33 "POST /compute/v2.1/servers/f42825c1-35fe-47b7-9fcc-ed93a82070eb/action" status: 202 len: 0 microversion: 2.1 time: 0.440469 Sep 23 05:08:55.842322 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3345/6521] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 05:08:55 2022] POST /compute/v2.1/servers/f42825c1-35fe-47b7-9fcc-ed93a82070eb/action => generated 0 bytes in 442 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 23 05:08:55.847534 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3e27ccb8-a3d9-4bff-aa30-ae688e48c8d5 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:08:55.848168 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3e27ccb8-a3d9-4bff-aa30-ae688e48c8d5 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] [instance: f42825c1-35fe-47b7-9fcc-ed93a82070eb] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:08:55.856623 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3e27ccb8-a3d9-4bff-aa30-ae688e48c8d5 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:55.858504 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3e27ccb8-a3d9-4bff-aa30-ae688e48c8d5 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:55.858504 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3e27ccb8-a3d9-4bff-aa30-ae688e48c8d5 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:55.858504 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3e27ccb8-a3d9-4bff-aa30-ae688e48c8d5 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:55.858791 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3e27ccb8-a3d9-4bff-aa30-ae688e48c8d5 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:55.859238 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3e27ccb8-a3d9-4bff-aa30-ae688e48c8d5 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:56.023445 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-3e27ccb8-a3d9-4bff-aa30-ae688e48c8d5 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bb2f4659524c3d9e5a15758d73ff93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4873cc166584624b8c00d6f14ccf3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:08:56.031498 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3e27ccb8-a3d9-4bff-aa30-ae688e48c8d5 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] 10.222.0.33 "GET /compute/v2.1/servers/f42825c1-35fe-47b7-9fcc-ed93a82070eb" status: 200 len: 1509 microversion: 2.1 time: 0.188129 Sep 23 05:08:56.032185 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3177/6522] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:08:55 2022] GET /compute/v2.1/servers/f42825c1-35fe-47b7-9fcc-ed93a82070eb => generated 1509 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:08:56.137189 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3ec0811c-7a93-4f19-96a9-8bc6dbaaa2dd tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:08:56.138231 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-3ec0811c-7a93-4f19-96a9-8bc6dbaaa2dd tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 362777d0-bfa6-4058-8875-e4c28c85f576] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:08:56.151871 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3ec0811c-7a93-4f19-96a9-8bc6dbaaa2dd tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:56.152439 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3ec0811c-7a93-4f19-96a9-8bc6dbaaa2dd tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:56.152890 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3ec0811c-7a93-4f19-96a9-8bc6dbaaa2dd tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:56.153980 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3ec0811c-7a93-4f19-96a9-8bc6dbaaa2dd tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:56.154445 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3ec0811c-7a93-4f19-96a9-8bc6dbaaa2dd tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:56.154881 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3ec0811c-7a93-4f19-96a9-8bc6dbaaa2dd tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:56.357156 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-3ec0811c-7a93-4f19-96a9-8bc6dbaaa2dd tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:08:56.366444 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3ec0811c-7a93-4f19-96a9-8bc6dbaaa2dd tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/362777d0-bfa6-4058-8875-e4c28c85f576" status: 200 len: 1217 microversion: 2.1 time: 0.236724 Sep 23 05:08:56.377833 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3346/6523] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:08:56 2022] GET /compute/v2.1/servers/362777d0-bfa6-4058-8875-e4c28c85f576 => generated 1217 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:08:56.535961 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-cbb91fd5-710a-46a7-b991-0415f578ba14 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:08:56.538588 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-cbb91fd5-710a-46a7-b991-0415f578ba14 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 3b1a8172-f2d4-4308-8a1f-423b492fc023] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:08:56.560181 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cbb91fd5-710a-46a7-b991-0415f578ba14 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:56.566712 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cbb91fd5-710a-46a7-b991-0415f578ba14 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:56.567408 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cbb91fd5-710a-46a7-b991-0415f578ba14 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:56.568967 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cbb91fd5-710a-46a7-b991-0415f578ba14 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:56.569741 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cbb91fd5-710a-46a7-b991-0415f578ba14 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:56.572931 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cbb91fd5-710a-46a7-b991-0415f578ba14 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:56.666640 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-cbb91fd5-710a-46a7-b991-0415f578ba14 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/3b1a8172-f2d4-4308-8a1f-423b492fc023/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.134925 Sep 23 05:08:56.668248 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3178/6524] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Sep 23 05:08:56 2022] GET /compute/v2.1/servers/3b1a8172-f2d4-4308-8a1f-423b492fc023/os-volume_attachments => generated 197 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:08:57.056636 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-abacc561-c471-4ec5-8233-a25d3fcb2a59 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:08:57.057266 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-abacc561-c471-4ec5-8233-a25d3fcb2a59 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] [instance: f42825c1-35fe-47b7-9fcc-ed93a82070eb] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:08:57.064414 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-abacc561-c471-4ec5-8233-a25d3fcb2a59 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:57.064924 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-abacc561-c471-4ec5-8233-a25d3fcb2a59 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:57.065445 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-abacc561-c471-4ec5-8233-a25d3fcb2a59 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:57.066187 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-abacc561-c471-4ec5-8233-a25d3fcb2a59 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:57.066651 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-abacc561-c471-4ec5-8233-a25d3fcb2a59 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:57.067192 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-abacc561-c471-4ec5-8233-a25d3fcb2a59 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:57.253947 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-abacc561-c471-4ec5-8233-a25d3fcb2a59 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bb2f4659524c3d9e5a15758d73ff93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4873cc166584624b8c00d6f14ccf3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:08:57.263943 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-abacc561-c471-4ec5-8233-a25d3fcb2a59 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] 10.222.0.33 "GET /compute/v2.1/servers/f42825c1-35fe-47b7-9fcc-ed93a82070eb" status: 200 len: 1492 microversion: 2.1 time: 0.211936 Sep 23 05:08:57.266291 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3347/6525] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:08:57 2022] GET /compute/v2.1/servers/f42825c1-35fe-47b7-9fcc-ed93a82070eb => generated 1492 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:08:57.295829 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-301eaaba-5a69-45e6-b543-85ffc4d8c5a2 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:08:57.296884 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-301eaaba-5a69-45e6-b543-85ffc4d8c5a2 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] [instance: f42825c1-35fe-47b7-9fcc-ed93a82070eb] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:08:57.309123 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-301eaaba-5a69-45e6-b543-85ffc4d8c5a2 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:57.309628 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-301eaaba-5a69-45e6-b543-85ffc4d8c5a2 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:57.310105 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-301eaaba-5a69-45e6-b543-85ffc4d8c5a2 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:57.310821 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-301eaaba-5a69-45e6-b543-85ffc4d8c5a2 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:57.311283 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-301eaaba-5a69-45e6-b543-85ffc4d8c5a2 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:57.311712 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-301eaaba-5a69-45e6-b543-85ffc4d8c5a2 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:57.400955 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1169dd15-0fce-49e6-b904-10a47c4e7a99 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:08:57.401567 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1169dd15-0fce-49e6-b904-10a47c4e7a99 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 362777d0-bfa6-4058-8875-e4c28c85f576] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:08:57.408605 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1169dd15-0fce-49e6-b904-10a47c4e7a99 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:57.409104 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1169dd15-0fce-49e6-b904-10a47c4e7a99 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:57.409543 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1169dd15-0fce-49e6-b904-10a47c4e7a99 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:57.410271 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1169dd15-0fce-49e6-b904-10a47c4e7a99 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:57.410728 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1169dd15-0fce-49e6-b904-10a47c4e7a99 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:57.411159 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1169dd15-0fce-49e6-b904-10a47c4e7a99 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:57.534123 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-301eaaba-5a69-45e6-b543-85ffc4d8c5a2 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] 10.222.0.33 "POST /compute/v2.1/servers/f42825c1-35fe-47b7-9fcc-ed93a82070eb/action" status: 202 len: 0 microversion: 2.1 time: 0.242798 Sep 23 05:08:57.537717 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3179/6526] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 05:08:57 2022] POST /compute/v2.1/servers/f42825c1-35fe-47b7-9fcc-ed93a82070eb/action => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 05:08:57.544535 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c89a3491-3587-4437-811f-cdc393e9edad tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:08:57.545234 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c89a3491-3587-4437-811f-cdc393e9edad tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] [instance: f42825c1-35fe-47b7-9fcc-ed93a82070eb] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:08:57.559083 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c89a3491-3587-4437-811f-cdc393e9edad tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:57.562183 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c89a3491-3587-4437-811f-cdc393e9edad tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:57.562952 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c89a3491-3587-4437-811f-cdc393e9edad tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:57.563846 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c89a3491-3587-4437-811f-cdc393e9edad tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:57.569595 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c89a3491-3587-4437-811f-cdc393e9edad tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:57.570463 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c89a3491-3587-4437-811f-cdc393e9edad tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:57.574191 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1169dd15-0fce-49e6-b904-10a47c4e7a99 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:08:57.587333 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1169dd15-0fce-49e6-b904-10a47c4e7a99 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/362777d0-bfa6-4058-8875-e4c28c85f576" status: 200 len: 1217 microversion: 2.1 time: 0.190142 Sep 23 05:08:57.589942 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3348/6527] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:08:57 2022] GET /compute/v2.1/servers/362777d0-bfa6-4058-8875-e4c28c85f576 => generated 1217 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:08:57.686610 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c2d66212-aaf5-4c62-8e43-3260d3d8303a tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:08:57.690471 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c2d66212-aaf5-4c62-8e43-3260d3d8303a tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 3b1a8172-f2d4-4308-8a1f-423b492fc023] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:08:57.703854 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c2d66212-aaf5-4c62-8e43-3260d3d8303a tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:57.707130 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c2d66212-aaf5-4c62-8e43-3260d3d8303a tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:57.707602 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c2d66212-aaf5-4c62-8e43-3260d3d8303a tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:57.712144 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c2d66212-aaf5-4c62-8e43-3260d3d8303a tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:57.712737 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c2d66212-aaf5-4c62-8e43-3260d3d8303a tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:57.713204 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c2d66212-aaf5-4c62-8e43-3260d3d8303a tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:57.759174 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c2d66212-aaf5-4c62-8e43-3260d3d8303a tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/3b1a8172-f2d4-4308-8a1f-423b492fc023/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084002 Sep 23 05:08:57.778215 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3349/6528] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Sep 23 05:08:57 2022] GET /compute/v2.1/servers/3b1a8172-f2d4-4308-8a1f-423b492fc023/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:08:57.814016 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c89a3491-3587-4437-811f-cdc393e9edad tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bb2f4659524c3d9e5a15758d73ff93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4873cc166584624b8c00d6f14ccf3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:08:57.823501 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c89a3491-3587-4437-811f-cdc393e9edad tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] 10.222.0.33 "GET /compute/v2.1/servers/f42825c1-35fe-47b7-9fcc-ed93a82070eb" status: 200 len: 1498 microversion: 2.1 time: 0.283808 Sep 23 05:08:57.824821 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3180/6529] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:08:57 2022] GET /compute/v2.1/servers/f42825c1-35fe-47b7-9fcc-ed93a82070eb => generated 1498 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:08:58.611841 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a658e929-1a79-41e5-9895-9736fef30867 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:08:58.612454 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a658e929-1a79-41e5-9895-9736fef30867 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 362777d0-bfa6-4058-8875-e4c28c85f576] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:08:58.619149 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a658e929-1a79-41e5-9895-9736fef30867 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:58.619641 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a658e929-1a79-41e5-9895-9736fef30867 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:58.620078 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a658e929-1a79-41e5-9895-9736fef30867 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:58.620781 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a658e929-1a79-41e5-9895-9736fef30867 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:58.621239 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a658e929-1a79-41e5-9895-9736fef30867 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:58.621667 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a658e929-1a79-41e5-9895-9736fef30867 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:58.775757 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a658e929-1a79-41e5-9895-9736fef30867 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:08:58.785558 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a658e929-1a79-41e5-9895-9736fef30867 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/362777d0-bfa6-4058-8875-e4c28c85f576" status: 200 len: 1217 microversion: 2.1 time: 0.177779 Sep 23 05:08:58.786698 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3350/6530] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:08:58 2022] GET /compute/v2.1/servers/362777d0-bfa6-4058-8875-e4c28c85f576 => generated 1217 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:08:58.801192 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-47952800-564b-4671-98ab-1e89b4b65895 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:08:58.842155 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-47952800-564b-4671-98ab-1e89b4b65895 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 3b1a8172-f2d4-4308-8a1f-423b492fc023] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:08:58.842155 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-47952800-564b-4671-98ab-1e89b4b65895 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:58.842155 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-47952800-564b-4671-98ab-1e89b4b65895 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:58.842155 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-47952800-564b-4671-98ab-1e89b4b65895 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:58.842155 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-47952800-564b-4671-98ab-1e89b4b65895 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:58.842155 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-47952800-564b-4671-98ab-1e89b4b65895 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:58.842155 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-47952800-564b-4671-98ab-1e89b4b65895 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:58.849189 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-82099388-3b1f-4a42-8925-015b34d3803b tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:08:58.850037 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-82099388-3b1f-4a42-8925-015b34d3803b tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] [instance: f42825c1-35fe-47b7-9fcc-ed93a82070eb] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:08:58.858023 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-82099388-3b1f-4a42-8925-015b34d3803b tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:58.858711 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-82099388-3b1f-4a42-8925-015b34d3803b tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:58.859429 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-82099388-3b1f-4a42-8925-015b34d3803b tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:58.860252 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-82099388-3b1f-4a42-8925-015b34d3803b tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:58.860784 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-82099388-3b1f-4a42-8925-015b34d3803b tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:58.861286 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-82099388-3b1f-4a42-8925-015b34d3803b tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:58.867306 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-47952800-564b-4671-98ab-1e89b4b65895 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/3b1a8172-f2d4-4308-8a1f-423b492fc023/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082282 Sep 23 05:08:58.868590 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3181/6531] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Sep 23 05:08:58 2022] GET /compute/v2.1/servers/3b1a8172-f2d4-4308-8a1f-423b492fc023/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:08:59.293166 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-82099388-3b1f-4a42-8925-015b34d3803b tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bb2f4659524c3d9e5a15758d73ff93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4873cc166584624b8c00d6f14ccf3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:08:59.301402 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-82099388-3b1f-4a42-8925-015b34d3803b tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] 10.222.0.33 "GET /compute/v2.1/servers/f42825c1-35fe-47b7-9fcc-ed93a82070eb" status: 200 len: 1498 microversion: 2.1 time: 0.456191 Sep 23 05:08:59.304311 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3351/6532] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:08:58 2022] GET /compute/v2.1/servers/f42825c1-35fe-47b7-9fcc-ed93a82070eb => generated 1498 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:08:59.813731 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6fb9dea7-ac08-4652-b802-a30d36749635 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:08:59.814339 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-6fb9dea7-ac08-4652-b802-a30d36749635 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 362777d0-bfa6-4058-8875-e4c28c85f576] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:08:59.823324 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6fb9dea7-ac08-4652-b802-a30d36749635 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:59.823862 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6fb9dea7-ac08-4652-b802-a30d36749635 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:59.824321 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6fb9dea7-ac08-4652-b802-a30d36749635 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:59.827384 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6fb9dea7-ac08-4652-b802-a30d36749635 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:59.827920 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6fb9dea7-ac08-4652-b802-a30d36749635 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:59.828372 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6fb9dea7-ac08-4652-b802-a30d36749635 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:59.880468 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-eadf9244-d1f6-4463-968c-8dd680856139 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:08:59.882970 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-eadf9244-d1f6-4463-968c-8dd680856139 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 3b1a8172-f2d4-4308-8a1f-423b492fc023] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:08:59.896146 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eadf9244-d1f6-4463-968c-8dd680856139 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:59.897341 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eadf9244-d1f6-4463-968c-8dd680856139 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:59.897786 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eadf9244-d1f6-4463-968c-8dd680856139 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:59.898713 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eadf9244-d1f6-4463-968c-8dd680856139 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:08:59.899246 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eadf9244-d1f6-4463-968c-8dd680856139 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:08:59.899750 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eadf9244-d1f6-4463-968c-8dd680856139 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:08:59.935968 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-eadf9244-d1f6-4463-968c-8dd680856139 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/3b1a8172-f2d4-4308-8a1f-423b492fc023/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059420 Sep 23 05:08:59.936558 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3352/6533] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Sep 23 05:08:59 2022] GET /compute/v2.1/servers/3b1a8172-f2d4-4308-8a1f-423b492fc023/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:09:00.001288 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6fb9dea7-ac08-4652-b802-a30d36749635 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:09:00.016571 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-6fb9dea7-ac08-4652-b802-a30d36749635 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/362777d0-bfa6-4058-8875-e4c28c85f576" status: 200 len: 1217 microversion: 2.1 time: 0.206347 Sep 23 05:09:00.017594 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3182/6534] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:08:59 2022] GET /compute/v2.1/servers/362777d0-bfa6-4058-8875-e4c28c85f576 => generated 1217 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:09:00.331284 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b2e1e1ff-cc79-428f-a3a0-96bb897fbd32 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:09:00.332069 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b2e1e1ff-cc79-428f-a3a0-96bb897fbd32 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] [instance: f42825c1-35fe-47b7-9fcc-ed93a82070eb] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:09:00.340454 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b2e1e1ff-cc79-428f-a3a0-96bb897fbd32 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:00.340964 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b2e1e1ff-cc79-428f-a3a0-96bb897fbd32 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:00.341408 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b2e1e1ff-cc79-428f-a3a0-96bb897fbd32 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:00.342141 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b2e1e1ff-cc79-428f-a3a0-96bb897fbd32 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:00.342604 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b2e1e1ff-cc79-428f-a3a0-96bb897fbd32 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:00.343245 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b2e1e1ff-cc79-428f-a3a0-96bb897fbd32 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:00.493394 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b2e1e1ff-cc79-428f-a3a0-96bb897fbd32 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bb2f4659524c3d9e5a15758d73ff93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4873cc166584624b8c00d6f14ccf3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:09:00.503486 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b2e1e1ff-cc79-428f-a3a0-96bb897fbd32 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] 10.222.0.33 "GET /compute/v2.1/servers/f42825c1-35fe-47b7-9fcc-ed93a82070eb" status: 200 len: 1501 microversion: 2.1 time: 0.177318 Sep 23 05:09:00.504780 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3353/6535] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:09:00 2022] GET /compute/v2.1/servers/f42825c1-35fe-47b7-9fcc-ed93a82070eb => generated 1501 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:09:00.530922 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-72c9c99a-bf30-4482-9311-52fde26a3bef tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:09:00.531471 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-72c9c99a-bf30-4482-9311-52fde26a3bef tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] [instance: f42825c1-35fe-47b7-9fcc-ed93a82070eb] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:09:00.537690 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-72c9c99a-bf30-4482-9311-52fde26a3bef tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:00.538218 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-72c9c99a-bf30-4482-9311-52fde26a3bef tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:00.538663 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-72c9c99a-bf30-4482-9311-52fde26a3bef tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:00.539367 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-72c9c99a-bf30-4482-9311-52fde26a3bef tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:00.539835 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-72c9c99a-bf30-4482-9311-52fde26a3bef tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:00.540269 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-72c9c99a-bf30-4482-9311-52fde26a3bef tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:00.565109 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-72c9c99a-bf30-4482-9311-52fde26a3bef tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lazy-loading 'flavor' on Instance uuid f42825c1-35fe-47b7-9fcc-ed93a82070eb {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 05:09:00.835372 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-72c9c99a-bf30-4482-9311-52fde26a3bef tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] 10.222.0.33 "POST /compute/v2.1/servers/f42825c1-35fe-47b7-9fcc-ed93a82070eb/action" status: 202 len: 0 microversion: 2.1 time: 0.299549 Sep 23 05:09:00.835372 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3183/6536] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 05:09:00 2022] POST /compute/v2.1/servers/f42825c1-35fe-47b7-9fcc-ed93a82070eb/action => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 05:09:00.842667 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8202c97e-26fa-4f90-8266-c12748627df2 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:09:00.843551 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-8202c97e-26fa-4f90-8266-c12748627df2 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] [instance: f42825c1-35fe-47b7-9fcc-ed93a82070eb] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:09:00.850428 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8202c97e-26fa-4f90-8266-c12748627df2 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:00.851499 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8202c97e-26fa-4f90-8266-c12748627df2 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:00.852034 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8202c97e-26fa-4f90-8266-c12748627df2 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:00.853663 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8202c97e-26fa-4f90-8266-c12748627df2 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:00.854260 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8202c97e-26fa-4f90-8266-c12748627df2 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:00.855132 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8202c97e-26fa-4f90-8266-c12748627df2 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:00.955323 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-43198117-6f78-4855-a9bd-a04571118cd0 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:09:00.957658 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-43198117-6f78-4855-a9bd-a04571118cd0 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 3b1a8172-f2d4-4308-8a1f-423b492fc023] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:09:00.984310 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-43198117-6f78-4855-a9bd-a04571118cd0 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:00.987228 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-43198117-6f78-4855-a9bd-a04571118cd0 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:00.987228 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-43198117-6f78-4855-a9bd-a04571118cd0 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:00.987228 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-43198117-6f78-4855-a9bd-a04571118cd0 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:00.987228 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-43198117-6f78-4855-a9bd-a04571118cd0 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:00.987228 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-43198117-6f78-4855-a9bd-a04571118cd0 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:01.019705 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-8202c97e-26fa-4f90-8266-c12748627df2 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bb2f4659524c3d9e5a15758d73ff93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4873cc166584624b8c00d6f14ccf3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:09:01.025342 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-43198117-6f78-4855-a9bd-a04571118cd0 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/3b1a8172-f2d4-4308-8a1f-423b492fc023/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080065 Sep 23 05:09:01.026253 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3184/6537] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Sep 23 05:09:00 2022] GET /compute/v2.1/servers/3b1a8172-f2d4-4308-8a1f-423b492fc023/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:09:01.039613 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-8202c97e-26fa-4f90-8266-c12748627df2 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] 10.222.0.33 "GET /compute/v2.1/servers/f42825c1-35fe-47b7-9fcc-ed93a82070eb" status: 200 len: 1509 microversion: 2.1 time: 0.199085 Sep 23 05:09:01.049920 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3354/6538] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:09:00 2022] GET /compute/v2.1/servers/f42825c1-35fe-47b7-9fcc-ed93a82070eb => generated 1509 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:09:01.050487 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-762ce70a-9fc4-4bb1-8ee8-43d799fbf694 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:09:01.050487 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-762ce70a-9fc4-4bb1-8ee8-43d799fbf694 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 362777d0-bfa6-4058-8875-e4c28c85f576] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:09:01.050911 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-762ce70a-9fc4-4bb1-8ee8-43d799fbf694 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:01.051592 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-762ce70a-9fc4-4bb1-8ee8-43d799fbf694 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:01.052196 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-762ce70a-9fc4-4bb1-8ee8-43d799fbf694 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:01.054744 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-762ce70a-9fc4-4bb1-8ee8-43d799fbf694 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:01.055382 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-762ce70a-9fc4-4bb1-8ee8-43d799fbf694 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:01.056167 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-762ce70a-9fc4-4bb1-8ee8-43d799fbf694 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:01.213730 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-762ce70a-9fc4-4bb1-8ee8-43d799fbf694 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:09:01.222050 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-762ce70a-9fc4-4bb1-8ee8-43d799fbf694 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/362777d0-bfa6-4058-8875-e4c28c85f576" status: 200 len: 1217 microversion: 2.1 time: 0.186023 Sep 23 05:09:01.222723 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3185/6539] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:09:01 2022] GET /compute/v2.1/servers/362777d0-bfa6-4058-8875-e4c28c85f576 => generated 1217 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:09:01.472837 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-0c90443b-0545-4770-9bbe-cbc8a2d234b3 req-7b1799d6-2273-45b9-b0fe-36c31a8578f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "362777d0-bfa6-4058-8875-e4c28c85f576", "name": "network-vif-plugged", "status": "completed", "tag": "da0ab434-f9ad-4d6b-bd5e-206238561f05"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:09:01.487635 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-0c90443b-0545-4770-9bbe-cbc8a2d234b3 req-7b1799d6-2273-45b9-b0fe-36c31a8578f1 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:01.488351 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-0c90443b-0545-4770-9bbe-cbc8a2d234b3 req-7b1799d6-2273-45b9-b0fe-36c31a8578f1 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:01.489037 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-0c90443b-0545-4770-9bbe-cbc8a2d234b3 req-7b1799d6-2273-45b9-b0fe-36c31a8578f1 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:01.512371 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-0c90443b-0545-4770-9bbe-cbc8a2d234b3 req-7b1799d6-2273-45b9-b0fe-36c31a8578f1 service nova] Creating event network-vif-plugged:da0ab434-f9ad-4d6b-bd5e-206238561f05 for instance 362777d0-bfa6-4058-8875-e4c28c85f576 on n-h2-846463-3 Sep 23 05:09:01.520682 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-0c90443b-0545-4770-9bbe-cbc8a2d234b3 req-7b1799d6-2273-45b9-b0fe-36c31a8578f1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050951 Sep 23 05:09:01.522747 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3355/6540] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:09:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:09:02.039777 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4c20b8f5-46eb-45c3-bb0f-2f0805d00ab2 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:09:02.042617 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4c20b8f5-46eb-45c3-bb0f-2f0805d00ab2 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 3b1a8172-f2d4-4308-8a1f-423b492fc023] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:09:02.049293 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4c20b8f5-46eb-45c3-bb0f-2f0805d00ab2 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:02.049675 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4c20b8f5-46eb-45c3-bb0f-2f0805d00ab2 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:02.050319 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4c20b8f5-46eb-45c3-bb0f-2f0805d00ab2 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:02.051203 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4c20b8f5-46eb-45c3-bb0f-2f0805d00ab2 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:02.051505 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4c20b8f5-46eb-45c3-bb0f-2f0805d00ab2 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:02.052013 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4c20b8f5-46eb-45c3-bb0f-2f0805d00ab2 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:02.072707 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-90990d70-05b5-4a3d-a587-2db70f91b98c tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:09:02.074741 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-90990d70-05b5-4a3d-a587-2db70f91b98c tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] [instance: f42825c1-35fe-47b7-9fcc-ed93a82070eb] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:09:02.086582 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4c20b8f5-46eb-45c3-bb0f-2f0805d00ab2 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/3b1a8172-f2d4-4308-8a1f-423b492fc023/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050824 Sep 23 05:09:02.094489 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3186/6541] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Sep 23 05:09:02 2022] GET /compute/v2.1/servers/3b1a8172-f2d4-4308-8a1f-423b492fc023/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 05:09:02.107344 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-90990d70-05b5-4a3d-a587-2db70f91b98c tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:02.107344 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-90990d70-05b5-4a3d-a587-2db70f91b98c tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:02.107344 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-90990d70-05b5-4a3d-a587-2db70f91b98c tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:02.107344 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-90990d70-05b5-4a3d-a587-2db70f91b98c tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:02.107344 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-90990d70-05b5-4a3d-a587-2db70f91b98c tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:02.107770 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-90990d70-05b5-4a3d-a587-2db70f91b98c tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:02.183687 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b2bfb608-6844-4880-86a3-8ab7e1ef5baf tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:09:02.191503 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b2bfb608-6844-4880-86a3-8ab7e1ef5baf tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 3b1a8172-f2d4-4308-8a1f-423b492fc023] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:09:02.200238 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b2bfb608-6844-4880-86a3-8ab7e1ef5baf tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:02.200755 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b2bfb608-6844-4880-86a3-8ab7e1ef5baf tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:02.201350 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b2bfb608-6844-4880-86a3-8ab7e1ef5baf tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:02.202139 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b2bfb608-6844-4880-86a3-8ab7e1ef5baf tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:02.203231 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b2bfb608-6844-4880-86a3-8ab7e1ef5baf tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:02.203884 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b2bfb608-6844-4880-86a3-8ab7e1ef5baf tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:02.237471 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b2bfb608-6844-4880-86a3-8ab7e1ef5baf tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 3b1a8172-f2d4-4308-8a1f-423b492fc023] Going to try to terminate instance {{(pid=122698) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 05:09:02.350068 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-90990d70-05b5-4a3d-a587-2db70f91b98c tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bb2f4659524c3d9e5a15758d73ff93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4873cc166584624b8c00d6f14ccf3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:09:02.360633 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-90990d70-05b5-4a3d-a587-2db70f91b98c tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] 10.222.0.33 "GET /compute/v2.1/servers/f42825c1-35fe-47b7-9fcc-ed93a82070eb" status: 200 len: 1492 microversion: 2.1 time: 0.295698 Sep 23 05:09:02.361448 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3356/6542] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:09:02 2022] GET /compute/v2.1/servers/f42825c1-35fe-47b7-9fcc-ed93a82070eb => generated 1492 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:09:02.381817 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c68c945b-0e82-410c-95c6-f3ccd24eb645 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:09:02.383259 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c68c945b-0e82-410c-95c6-f3ccd24eb645 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 362777d0-bfa6-4058-8875-e4c28c85f576] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:09:02.391714 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c68c945b-0e82-410c-95c6-f3ccd24eb645 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:02.392468 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c68c945b-0e82-410c-95c6-f3ccd24eb645 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:02.393216 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c68c945b-0e82-410c-95c6-f3ccd24eb645 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:02.394129 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c68c945b-0e82-410c-95c6-f3ccd24eb645 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:02.394749 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c68c945b-0e82-410c-95c6-f3ccd24eb645 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:02.395340 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c68c945b-0e82-410c-95c6-f3ccd24eb645 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:02.524919 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b2bfb608-6844-4880-86a3-8ab7e1ef5baf tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "DELETE /compute/v2.1/servers/3b1a8172-f2d4-4308-8a1f-423b492fc023" status: 204 len: 0 microversion: 2.1 time: 0.345494 Sep 23 05:09:02.526008 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3187/6543] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 05:09:02 2022] DELETE /compute/v2.1/servers/3b1a8172-f2d4-4308-8a1f-423b492fc023 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 23 05:09:02.534194 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-75b8e169-f811-4b55-a06d-78bac2458423 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:09:02.534892 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-75b8e169-f811-4b55-a06d-78bac2458423 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] [instance: f42825c1-35fe-47b7-9fcc-ed93a82070eb] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:09:02.542636 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-75b8e169-f811-4b55-a06d-78bac2458423 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:02.543599 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-75b8e169-f811-4b55-a06d-78bac2458423 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:02.544062 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-75b8e169-f811-4b55-a06d-78bac2458423 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:02.544803 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-75b8e169-f811-4b55-a06d-78bac2458423 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:02.545279 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-75b8e169-f811-4b55-a06d-78bac2458423 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:02.545830 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-75b8e169-f811-4b55-a06d-78bac2458423 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:02.549165 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c68c945b-0e82-410c-95c6-f3ccd24eb645 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:09:02.551325 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:09:02.559621 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c68c945b-0e82-410c-95c6-f3ccd24eb645 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/362777d0-bfa6-4058-8875-e4c28c85f576" status: 200 len: 1217 microversion: 2.1 time: 0.196579 Sep 23 05:09:02.566086 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3357/6544] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:09:02 2022] GET /compute/v2.1/servers/362777d0-bfa6-4058-8875-e4c28c85f576 => generated 1217 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:09:02.572224 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-13f57804-f597-4dca-a7a8-6e5c8c596ad1 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:09:02.573048 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-13f57804-f597-4dca-a7a8-6e5c8c596ad1 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 3b1a8172-f2d4-4308-8a1f-423b492fc023] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:09:02.580480 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-13f57804-f597-4dca-a7a8-6e5c8c596ad1 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:02.581276 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-13f57804-f597-4dca-a7a8-6e5c8c596ad1 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:02.581958 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-13f57804-f597-4dca-a7a8-6e5c8c596ad1 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:02.584403 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-13f57804-f597-4dca-a7a8-6e5c8c596ad1 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:02.585112 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-13f57804-f597-4dca-a7a8-6e5c8c596ad1 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:02.585747 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-13f57804-f597-4dca-a7a8-6e5c8c596ad1 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:02.753322 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-13f57804-f597-4dca-a7a8-6e5c8c596ad1 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d90150ed7d477fab33129cb3b068ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daad67f26fe246d6b4d28cad1707a119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:09:02.762099 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-13f57804-f597-4dca-a7a8-6e5c8c596ad1 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/3b1a8172-f2d4-4308-8a1f-423b492fc023" status: 200 len: 1682 microversion: 2.1 time: 0.200330 Sep 23 05:09:02.762679 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3358/6545] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:09:02 2022] GET /compute/v2.1/servers/3b1a8172-f2d4-4308-8a1f-423b492fc023 => generated 1682 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:09:02.800551 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-75b8e169-f811-4b55-a06d-78bac2458423 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] 10.222.0.33 "POST /compute/v2.1/servers/f42825c1-35fe-47b7-9fcc-ed93a82070eb/action" status: 202 len: 0 microversion: 2.1 time: 0.272243 Sep 23 05:09:02.801449 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3188/6546] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 05:09:02 2022] POST /compute/v2.1/servers/f42825c1-35fe-47b7-9fcc-ed93a82070eb/action => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 05:09:02.810440 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ee624180-b03a-4855-abd9-8342d01f02d3 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:09:02.811311 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ee624180-b03a-4855-abd9-8342d01f02d3 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] [instance: f42825c1-35fe-47b7-9fcc-ed93a82070eb] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:09:02.817544 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ee624180-b03a-4855-abd9-8342d01f02d3 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:02.823099 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ee624180-b03a-4855-abd9-8342d01f02d3 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:02.823099 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ee624180-b03a-4855-abd9-8342d01f02d3 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:02.823099 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ee624180-b03a-4855-abd9-8342d01f02d3 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:02.823099 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ee624180-b03a-4855-abd9-8342d01f02d3 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:02.823099 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ee624180-b03a-4855-abd9-8342d01f02d3 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:02.968437 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ee624180-b03a-4855-abd9-8342d01f02d3 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bb2f4659524c3d9e5a15758d73ff93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4873cc166584624b8c00d6f14ccf3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:09:02.976533 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ee624180-b03a-4855-abd9-8342d01f02d3 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] 10.222.0.33 "GET /compute/v2.1/servers/f42825c1-35fe-47b7-9fcc-ed93a82070eb" status: 200 len: 1498 microversion: 2.1 time: 0.170626 Sep 23 05:09:02.977638 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3359/6547] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:09:02 2022] GET /compute/v2.1/servers/f42825c1-35fe-47b7-9fcc-ed93a82070eb => generated 1498 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:09:03.593379 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f2f2d61d-850a-4439-b16b-4983b4fc8844 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:09:03.596891 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f2f2d61d-850a-4439-b16b-4983b4fc8844 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 362777d0-bfa6-4058-8875-e4c28c85f576] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:09:03.609560 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f2f2d61d-850a-4439-b16b-4983b4fc8844 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:03.610175 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f2f2d61d-850a-4439-b16b-4983b4fc8844 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:03.610689 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f2f2d61d-850a-4439-b16b-4983b4fc8844 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:03.611474 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f2f2d61d-850a-4439-b16b-4983b4fc8844 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:03.612027 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f2f2d61d-850a-4439-b16b-4983b4fc8844 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:03.612601 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f2f2d61d-850a-4439-b16b-4983b4fc8844 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:03.747219 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f2f2d61d-850a-4439-b16b-4983b4fc8844 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:09:03.756160 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f2f2d61d-850a-4439-b16b-4983b4fc8844 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/362777d0-bfa6-4058-8875-e4c28c85f576" status: 200 len: 1404 microversion: 2.1 time: 0.173149 Sep 23 05:09:03.757513 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3189/6548] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:09:03 2022] GET /compute/v2.1/servers/362777d0-bfa6-4058-8875-e4c28c85f576 => generated 1404 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:09:03.784465 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7bf519c7-35ad-40d7-a204-2e6ebc540ad1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:09:03.787959 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-7bf519c7-35ad-40d7-a204-2e6ebc540ad1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 362777d0-bfa6-4058-8875-e4c28c85f576] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:09:03.801934 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7bf519c7-35ad-40d7-a204-2e6ebc540ad1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:03.802875 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-61a65d68-eb5c-48af-babf-3516991b79e7 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:09:03.803438 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7bf519c7-35ad-40d7-a204-2e6ebc540ad1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:03.804865 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7bf519c7-35ad-40d7-a204-2e6ebc540ad1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:03.805216 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-61a65d68-eb5c-48af-babf-3516991b79e7 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 3b1a8172-f2d4-4308-8a1f-423b492fc023] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:09:03.807189 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7bf519c7-35ad-40d7-a204-2e6ebc540ad1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:03.812718 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7bf519c7-35ad-40d7-a204-2e6ebc540ad1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:03.812718 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7bf519c7-35ad-40d7-a204-2e6ebc540ad1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:03.817581 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-61a65d68-eb5c-48af-babf-3516991b79e7 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:03.820282 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-61a65d68-eb5c-48af-babf-3516991b79e7 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:03.820741 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-61a65d68-eb5c-48af-babf-3516991b79e7 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:03.821472 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-61a65d68-eb5c-48af-babf-3516991b79e7 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:03.822668 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-61a65d68-eb5c-48af-babf-3516991b79e7 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:03.823303 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-61a65d68-eb5c-48af-babf-3516991b79e7 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:04.068812 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-7bf519c7-35ad-40d7-a204-2e6ebc540ad1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:09:04.074334 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-7bf519c7-35ad-40d7-a204-2e6ebc540ad1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/362777d0-bfa6-4058-8875-e4c28c85f576" status: 200 len: 1404 microversion: 2.1 time: 0.297347 Sep 23 05:09:04.074952 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3360/6549] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:09:03 2022] GET /compute/v2.1/servers/362777d0-bfa6-4058-8875-e4c28c85f576 => generated 1404 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:09:04.091490 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5b227ebf-4f9a-4393-b2c9-371dfdccb300 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:09:04.092114 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-5b227ebf-4f9a-4393-b2c9-371dfdccb300 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] [instance: f42825c1-35fe-47b7-9fcc-ed93a82070eb] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:09:04.098439 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-61a65d68-eb5c-48af-babf-3516991b79e7 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d90150ed7d477fab33129cb3b068ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daad67f26fe246d6b4d28cad1707a119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:09:04.102636 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5b227ebf-4f9a-4393-b2c9-371dfdccb300 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:04.103400 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5b227ebf-4f9a-4393-b2c9-371dfdccb300 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:04.104026 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5b227ebf-4f9a-4393-b2c9-371dfdccb300 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:04.104927 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5b227ebf-4f9a-4393-b2c9-371dfdccb300 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:04.105747 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5b227ebf-4f9a-4393-b2c9-371dfdccb300 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:04.107231 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-61a65d68-eb5c-48af-babf-3516991b79e7 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/3b1a8172-f2d4-4308-8a1f-423b492fc023" status: 200 len: 1682 microversion: 2.1 time: 0.315032 Sep 23 05:09:04.107702 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5b227ebf-4f9a-4393-b2c9-371dfdccb300 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:04.107816 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3190/6550] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:09:03 2022] GET /compute/v2.1/servers/3b1a8172-f2d4-4308-8a1f-423b492fc023 => generated 1682 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:09:04.112456 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b0cd571f-6b6a-4332-95d0-1ca63f0084c2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-632386655"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:09:04.114912 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b0cd571f-6b6a-4332-95d0-1ca63f0084c2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 362777d0-bfa6-4058-8875-e4c28c85f576] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:09:04.121026 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b0cd571f-6b6a-4332-95d0-1ca63f0084c2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:04.121528 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b0cd571f-6b6a-4332-95d0-1ca63f0084c2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:04.121999 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b0cd571f-6b6a-4332-95d0-1ca63f0084c2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:04.122710 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b0cd571f-6b6a-4332-95d0-1ca63f0084c2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:04.123171 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b0cd571f-6b6a-4332-95d0-1ca63f0084c2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:04.123596 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b0cd571f-6b6a-4332-95d0-1ca63f0084c2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:04.315272 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.compute.api [None req-b0cd571f-6b6a-4332-95d0-1ca63f0084c2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 362777d0-bfa6-4058-8875-e4c28c85f576] Attempting to quiesce instance before volume snapshot. Sep 23 05:09:04.326062 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-5b227ebf-4f9a-4393-b2c9-371dfdccb300 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bb2f4659524c3d9e5a15758d73ff93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4873cc166584624b8c00d6f14ccf3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:09:04.345052 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5b227ebf-4f9a-4393-b2c9-371dfdccb300 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] 10.222.0.33 "GET /compute/v2.1/servers/f42825c1-35fe-47b7-9fcc-ed93a82070eb" status: 200 len: 1498 microversion: 2.1 time: 0.269020 Sep 23 05:09:04.361802 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3361/6551] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:09:04 2022] GET /compute/v2.1/servers/f42825c1-35fe-47b7-9fcc-ed93a82070eb => generated 1498 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:09:04.386358 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.compute.api [None req-b0cd571f-6b6a-4332-95d0-1ca63f0084c2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 362777d0-bfa6-4058-8875-e4c28c85f576] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Sep 23 05:09:04.709738 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b0cd571f-6b6a-4332-95d0-1ca63f0084c2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 362777d0-bfa6-4058-8875-e4c28c85f576] Creating snapshot from volume bf62dbcf-35db-4d5b-a32c-a8db98d1e05e. {{(pid=122698) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Sep 23 05:09:05.131968 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1c5be9ca-4661-4729-a2cc-1ad8a1848ae5 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:09:05.133556 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1c5be9ca-4661-4729-a2cc-1ad8a1848ae5 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 3b1a8172-f2d4-4308-8a1f-423b492fc023] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:09:05.149663 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1c5be9ca-4661-4729-a2cc-1ad8a1848ae5 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:05.150209 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1c5be9ca-4661-4729-a2cc-1ad8a1848ae5 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:05.150664 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1c5be9ca-4661-4729-a2cc-1ad8a1848ae5 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:05.151397 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1c5be9ca-4661-4729-a2cc-1ad8a1848ae5 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:05.151861 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1c5be9ca-4661-4729-a2cc-1ad8a1848ae5 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:05.152291 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1c5be9ca-4661-4729-a2cc-1ad8a1848ae5 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:05.182173 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:09:05.365632 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1c5be9ca-4661-4729-a2cc-1ad8a1848ae5 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d90150ed7d477fab33129cb3b068ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daad67f26fe246d6b4d28cad1707a119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:09:05.377245 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1c5be9ca-4661-4729-a2cc-1ad8a1848ae5 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/3b1a8172-f2d4-4308-8a1f-423b492fc023" status: 200 len: 1682 microversion: 2.1 time: 0.249423 Sep 23 05:09:05.394422 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3362/6552] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:09:05 2022] GET /compute/v2.1/servers/3b1a8172-f2d4-4308-8a1f-423b492fc023 => generated 1682 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:09:05.399032 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-42dadf48-5456-413f-bada-4d80e36e07c7 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:09:05.399686 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-42dadf48-5456-413f-bada-4d80e36e07c7 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] [instance: f42825c1-35fe-47b7-9fcc-ed93a82070eb] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:09:05.409746 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=3 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:09:05.409746 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-42dadf48-5456-413f-bada-4d80e36e07c7 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:05.409746 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-42dadf48-5456-413f-bada-4d80e36e07c7 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:05.409746 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-42dadf48-5456-413f-bada-4d80e36e07c7 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:05.409746 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-42dadf48-5456-413f-bada-4d80e36e07c7 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:05.409746 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-42dadf48-5456-413f-bada-4d80e36e07c7 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:05.410364 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-42dadf48-5456-413f-bada-4d80e36e07c7 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:05.640332 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-42dadf48-5456-413f-bada-4d80e36e07c7 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bb2f4659524c3d9e5a15758d73ff93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4873cc166584624b8c00d6f14ccf3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:09:05.651451 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-42dadf48-5456-413f-bada-4d80e36e07c7 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] 10.222.0.33 "GET /compute/v2.1/servers/f42825c1-35fe-47b7-9fcc-ed93a82070eb" status: 200 len: 1498 microversion: 2.1 time: 0.262613 Sep 23 05:09:05.652460 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3363/6553] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:09:05 2022] GET /compute/v2.1/servers/f42825c1-35fe-47b7-9fcc-ed93a82070eb => generated 1498 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:09:06.016224 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-dc363502-d67b-4aff-a3bb-62d9ae5b4420 req-07422a46-87b2-42c5-83f7-fa32c35848be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b1a8172-f2d4-4308-8a1f-423b492fc023", "name": "network-vif-deleted", "tag": "fd78c6cf-de4b-4138-86bb-e546703947dd"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:09:06.078580 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-dc363502-d67b-4aff-a3bb-62d9ae5b4420 req-07422a46-87b2-42c5-83f7-fa32c35848be service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:06.079312 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-dc363502-d67b-4aff-a3bb-62d9ae5b4420 req-07422a46-87b2-42c5-83f7-fa32c35848be service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:06.081220 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-dc363502-d67b-4aff-a3bb-62d9ae5b4420 req-07422a46-87b2-42c5-83f7-fa32c35848be service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:06.119376 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-dc363502-d67b-4aff-a3bb-62d9ae5b4420 req-07422a46-87b2-42c5-83f7-fa32c35848be service nova] Creating event network-vif-deleted:fd78c6cf-de4b-4138-86bb-e546703947dd for instance 3b1a8172-f2d4-4308-8a1f-423b492fc023 on n-h1-846463-3 Sep 23 05:09:06.134282 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-dc363502-d67b-4aff-a3bb-62d9ae5b4420 req-07422a46-87b2-42c5-83f7-fa32c35848be service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118629 Sep 23 05:09:06.134938 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3364/6554] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:09:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 05:09:06.409556 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-97edbdcf-2a3a-4da3-95f1-2d31ef496fec tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:09:06.410590 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-97edbdcf-2a3a-4da3-95f1-2d31ef496fec tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 3b1a8172-f2d4-4308-8a1f-423b492fc023] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:09:06.441619 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-97edbdcf-2a3a-4da3-95f1-2d31ef496fec tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:06.448475 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-97edbdcf-2a3a-4da3-95f1-2d31ef496fec tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:06.450173 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-97edbdcf-2a3a-4da3-95f1-2d31ef496fec tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:06.450955 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-97edbdcf-2a3a-4da3-95f1-2d31ef496fec tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:06.451446 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-97edbdcf-2a3a-4da3-95f1-2d31ef496fec tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:06.451896 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-97edbdcf-2a3a-4da3-95f1-2d31ef496fec tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:06.600066 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-97edbdcf-2a3a-4da3-95f1-2d31ef496fec tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d90150ed7d477fab33129cb3b068ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daad67f26fe246d6b4d28cad1707a119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:09:06.612845 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-97edbdcf-2a3a-4da3-95f1-2d31ef496fec tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/3b1a8172-f2d4-4308-8a1f-423b492fc023" status: 200 len: 1326 microversion: 2.1 time: 0.211667 Sep 23 05:09:06.615616 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3365/6555] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:09:06 2022] GET /compute/v2.1/servers/3b1a8172-f2d4-4308-8a1f-423b492fc023 => generated 1326 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:09:06.679960 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-47ceb8f3-b40f-4eb8-9952-fd43a64e1ca3 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:09:06.680685 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-47ceb8f3-b40f-4eb8-9952-fd43a64e1ca3 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] [instance: f42825c1-35fe-47b7-9fcc-ed93a82070eb] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:09:06.689375 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-47ceb8f3-b40f-4eb8-9952-fd43a64e1ca3 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:06.690296 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-47ceb8f3-b40f-4eb8-9952-fd43a64e1ca3 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:06.694784 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-47ceb8f3-b40f-4eb8-9952-fd43a64e1ca3 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:06.694784 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-47ceb8f3-b40f-4eb8-9952-fd43a64e1ca3 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:06.694784 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-47ceb8f3-b40f-4eb8-9952-fd43a64e1ca3 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:06.694784 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-47ceb8f3-b40f-4eb8-9952-fd43a64e1ca3 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:06.982751 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-47ceb8f3-b40f-4eb8-9952-fd43a64e1ca3 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bb2f4659524c3d9e5a15758d73ff93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4873cc166584624b8c00d6f14ccf3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:09:06.991231 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-47ceb8f3-b40f-4eb8-9952-fd43a64e1ca3 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] 10.222.0.33 "GET /compute/v2.1/servers/f42825c1-35fe-47b7-9fcc-ed93a82070eb" status: 200 len: 1501 microversion: 2.1 time: 0.317154 Sep 23 05:09:06.992730 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3366/6556] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:09:06 2022] GET /compute/v2.1/servers/f42825c1-35fe-47b7-9fcc-ed93a82070eb => generated 1501 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:09:07.015769 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-84548526-226b-4dc4-b94d-bd0950f88ada tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:09:07.016605 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-84548526-226b-4dc4-b94d-bd0950f88ada tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] [instance: f42825c1-35fe-47b7-9fcc-ed93a82070eb] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:09:07.032868 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-84548526-226b-4dc4-b94d-bd0950f88ada tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:07.033868 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-84548526-226b-4dc4-b94d-bd0950f88ada tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:07.033868 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-84548526-226b-4dc4-b94d-bd0950f88ada tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:07.037517 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-84548526-226b-4dc4-b94d-bd0950f88ada tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:07.039103 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-84548526-226b-4dc4-b94d-bd0950f88ada tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:07.039741 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-84548526-226b-4dc4-b94d-bd0950f88ada tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:07.109067 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b0cd571f-6b6a-4332-95d0-1ca63f0084c2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "POST /compute/v2.1/servers/362777d0-bfa6-4058-8875-e4c28c85f576/action" status: 202 len: 0 microversion: 2.1 time: 3.000131 Sep 23 05:09:07.116685 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3191/6557] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 05:09:04 2022] POST /compute/v2.1/servers/362777d0-bfa6-4058-8875-e4c28c85f576/action => generated 0 bytes in 3001 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 23 05:09:07.116980 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-84548526-226b-4dc4-b94d-bd0950f88ada tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] [instance: f42825c1-35fe-47b7-9fcc-ed93a82070eb] Going to try to terminate instance {{(pid=122699) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 05:09:07.518198 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-84548526-226b-4dc4-b94d-bd0950f88ada tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f42825c1-35fe-47b7-9fcc-ed93a82070eb" status: 204 len: 0 microversion: 2.1 time: 0.505208 Sep 23 05:09:07.525934 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3367/6558] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 05:09:07 2022] DELETE /compute/v2.1/servers/f42825c1-35fe-47b7-9fcc-ed93a82070eb => generated 0 bytes in 509 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 23 05:09:07.533968 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ea377be6-5408-45ff-bb96-834a652d7ea8 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:09:07.534754 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-ea377be6-5408-45ff-bb96-834a652d7ea8 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] [instance: f42825c1-35fe-47b7-9fcc-ed93a82070eb] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:09:07.538805 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:09:07.544627 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ea377be6-5408-45ff-bb96-834a652d7ea8 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:07.545170 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ea377be6-5408-45ff-bb96-834a652d7ea8 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:07.554702 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ea377be6-5408-45ff-bb96-834a652d7ea8 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:07.554702 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ea377be6-5408-45ff-bb96-834a652d7ea8 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:07.554702 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ea377be6-5408-45ff-bb96-834a652d7ea8 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:07.554702 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ea377be6-5408-45ff-bb96-834a652d7ea8 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:07.642104 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-929ab92e-0717-47df-ab84-5188c40b984e tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:09:07.642841 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-929ab92e-0717-47df-ab84-5188c40b984e tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 3b1a8172-f2d4-4308-8a1f-423b492fc023] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:09:07.662494 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-929ab92e-0717-47df-ab84-5188c40b984e tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:07.663257 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-929ab92e-0717-47df-ab84-5188c40b984e tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:07.663700 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-929ab92e-0717-47df-ab84-5188c40b984e tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:07.664412 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-929ab92e-0717-47df-ab84-5188c40b984e tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:07.664992 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-929ab92e-0717-47df-ab84-5188c40b984e tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:07.665326 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-929ab92e-0717-47df-ab84-5188c40b984e tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:07.841198 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-929ab92e-0717-47df-ab84-5188c40b984e tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:07.841814 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-929ab92e-0717-47df-ab84-5188c40b984e tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:07.842318 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-929ab92e-0717-47df-ab84-5188c40b984e tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:07.842795 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-929ab92e-0717-47df-ab84-5188c40b984e tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lazy-loading 'fault' on Instance uuid 3b1a8172-f2d4-4308-8a1f-423b492fc023 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 05:09:07.959693 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ea377be6-5408-45ff-bb96-834a652d7ea8 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bb2f4659524c3d9e5a15758d73ff93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4873cc166584624b8c00d6f14ccf3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:09:07.969751 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ea377be6-5408-45ff-bb96-834a652d7ea8 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] 10.222.0.33 "GET /compute/v2.1/servers/f42825c1-35fe-47b7-9fcc-ed93a82070eb" status: 200 len: 1507 microversion: 2.1 time: 0.440542 Sep 23 05:09:07.970718 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3192/6559] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:09:07 2022] GET /compute/v2.1/servers/f42825c1-35fe-47b7-9fcc-ed93a82070eb => generated 1507 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:09:07.985390 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-929ab92e-0717-47df-ab84-5188c40b984e tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d90150ed7d477fab33129cb3b068ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daad67f26fe246d6b4d28cad1707a119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:09:07.995501 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-929ab92e-0717-47df-ab84-5188c40b984e tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/3b1a8172-f2d4-4308-8a1f-423b492fc023" status: 200 len: 1331 microversion: 2.1 time: 0.358352 Sep 23 05:09:07.997454 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3368/6560] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:09:07 2022] GET /compute/v2.1/servers/3b1a8172-f2d4-4308-8a1f-423b492fc023 => generated 1331 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:09:08.993808 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8c7ec48e-0314-4bcd-8d60-055efa0e3042 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:09:08.994875 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8c7ec48e-0314-4bcd-8d60-055efa0e3042 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] [instance: f42825c1-35fe-47b7-9fcc-ed93a82070eb] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:09:09.002058 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8c7ec48e-0314-4bcd-8d60-055efa0e3042 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:09.002586 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8c7ec48e-0314-4bcd-8d60-055efa0e3042 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:09.003044 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8c7ec48e-0314-4bcd-8d60-055efa0e3042 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:09.003778 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8c7ec48e-0314-4bcd-8d60-055efa0e3042 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:09.004254 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8c7ec48e-0314-4bcd-8d60-055efa0e3042 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:09.004701 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8c7ec48e-0314-4bcd-8d60-055efa0e3042 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:09.020655 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b6bba3f7-e0d1-469a-8b28-898fd7fa6e9c tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:09:09.021838 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b6bba3f7-e0d1-469a-8b28-898fd7fa6e9c tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 3b1a8172-f2d4-4308-8a1f-423b492fc023] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:09:09.036610 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b6bba3f7-e0d1-469a-8b28-898fd7fa6e9c tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:09.037164 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b6bba3f7-e0d1-469a-8b28-898fd7fa6e9c tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:09.037608 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b6bba3f7-e0d1-469a-8b28-898fd7fa6e9c tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:09.038362 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b6bba3f7-e0d1-469a-8b28-898fd7fa6e9c tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:09.038822 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b6bba3f7-e0d1-469a-8b28-898fd7fa6e9c tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:09.039250 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b6bba3f7-e0d1-469a-8b28-898fd7fa6e9c tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:09.095345 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b6bba3f7-e0d1-469a-8b28-898fd7fa6e9c tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:09.095901 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b6bba3f7-e0d1-469a-8b28-898fd7fa6e9c tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:09.098338 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b6bba3f7-e0d1-469a-8b28-898fd7fa6e9c tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:09.098745 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-b6bba3f7-e0d1-469a-8b28-898fd7fa6e9c tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lazy-loading 'fault' on Instance uuid 3b1a8172-f2d4-4308-8a1f-423b492fc023 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 05:09:09.171957 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b6bba3f7-e0d1-469a-8b28-898fd7fa6e9c tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d90150ed7d477fab33129cb3b068ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daad67f26fe246d6b4d28cad1707a119', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:09:09.195618 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b6bba3f7-e0d1-469a-8b28-898fd7fa6e9c tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/3b1a8172-f2d4-4308-8a1f-423b492fc023" status: 200 len: 1331 microversion: 2.1 time: 0.178578 Sep 23 05:09:09.206220 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3369/6561] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:09:09 2022] GET /compute/v2.1/servers/3b1a8172-f2d4-4308-8a1f-423b492fc023 => generated 1331 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:09:09.209649 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8c7ec48e-0314-4bcd-8d60-055efa0e3042 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bb2f4659524c3d9e5a15758d73ff93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4873cc166584624b8c00d6f14ccf3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:09:09.218697 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8c7ec48e-0314-4bcd-8d60-055efa0e3042 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] 10.222.0.33 "GET /compute/v2.1/servers/f42825c1-35fe-47b7-9fcc-ed93a82070eb" status: 200 len: 1507 microversion: 2.1 time: 0.229780 Sep 23 05:09:09.219367 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3193/6562] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:09:08 2022] GET /compute/v2.1/servers/f42825c1-35fe-47b7-9fcc-ed93a82070eb => generated 1507 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:09:09.425962 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9d2e8f52-18e8-41f0-a87a-d05f9ca43ebf tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-1714465822", "imageRef": "582779ba-461b-4a03-a2c7-a2e14f459700", "flavorRef": "452", "networks": [{"uuid": "4600129e-ae78-4842-a9e8-005f0a31ee9b"}]}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:09:09.513027 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.neutron [None req-9d2e8f52-18e8-41f0-a87a-d05f9ca43ebf tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] validate_networks() for [('4600129e-ae78-4842-a9e8-005f0a31ee9b', None, None, None, None, None)] {{(pid=122699) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 05:09:10.056502 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-9d2e8f52-18e8-41f0-a87a-d05f9ca43ebf tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Flavor limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 05:09:10.056502 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-9d2e8f52-18e8-41f0-a87a-d05f9ca43ebf tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Image limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 05:09:10.056502 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-9d2e8f52-18e8-41f0-a87a-d05f9ca43ebf tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Flavor pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 05:09:10.056502 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-9d2e8f52-18e8-41f0-a87a-d05f9ca43ebf tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Image pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 05:09:10.056502 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-9d2e8f52-18e8-41f0-a87a-d05f9ca43ebf tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 05:09:10.078189 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9d2e8f52-18e8-41f0-a87a-d05f9ca43ebf tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:10.078772 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9d2e8f52-18e8-41f0-a87a-d05f9ca43ebf tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:10.082228 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9d2e8f52-18e8-41f0-a87a-d05f9ca43ebf tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:10.082228 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9d2e8f52-18e8-41f0-a87a-d05f9ca43ebf tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:10.082228 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9d2e8f52-18e8-41f0-a87a-d05f9ca43ebf tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:10.082228 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9d2e8f52-18e8-41f0-a87a-d05f9ca43ebf tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:10.120768 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-7cb10492-3040-46e5-852b-489562b84d26 req-76426db3-9982-4c92-8493-f020f54d1e32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f42825c1-35fe-47b7-9fcc-ed93a82070eb", "name": "network-vif-deleted", "tag": "2ba12267-c2f9-4bf7-84dc-9306f8d2a7c0"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:09:10.135347 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-7cb10492-3040-46e5-852b-489562b84d26 req-76426db3-9982-4c92-8493-f020f54d1e32 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:10.136068 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-7cb10492-3040-46e5-852b-489562b84d26 req-76426db3-9982-4c92-8493-f020f54d1e32 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:10.136585 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-7cb10492-3040-46e5-852b-489562b84d26 req-76426db3-9982-4c92-8493-f020f54d1e32 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:10.141518 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-9d2e8f52-18e8-41f0-a87a-d05f9ca43ebf tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Getting quotas for project cceaa1e24146497fbf3f79cebc112211. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 05:09:10.148475 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-9d2e8f52-18e8-41f0-a87a-d05f9ca43ebf tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Getting quotas for user 0d55fe5072c14752846eb4ffc0eef91b and project cceaa1e24146497fbf3f79cebc112211. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 05:09:10.150978 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-7cb10492-3040-46e5-852b-489562b84d26 req-76426db3-9982-4c92-8493-f020f54d1e32 service nova] Creating event network-vif-deleted:2ba12267-c2f9-4bf7-84dc-9306f8d2a7c0 for instance f42825c1-35fe-47b7-9fcc-ed93a82070eb on n-h1-846463-3 Sep 23 05:09:10.160724 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-7cb10492-3040-46e5-852b-489562b84d26 req-76426db3-9982-4c92-8493-f020f54d1e32 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041766 Sep 23 05:09:10.165760 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3194/6563] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:09:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 05:09:10.173422 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-9d2e8f52-18e8-41f0-a87a-d05f9ca43ebf tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Going to run 1 instances... {{(pid=122699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 05:09:10.176236 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-9d2e8f52-18e8-41f0-a87a-d05f9ca43ebf tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 7ad3508b-1d37-4c7b-82c7-be195566aacb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='7bed74e9-46fb-4fc2-b75c-2154d2f34afb',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=122699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 05:09:10.223985 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a567db9c-6526-4a26-84c7-9addbbad4a57 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:09:10.226213 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a567db9c-6526-4a26-84c7-9addbbad4a57 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 3b1a8172-f2d4-4308-8a1f-423b492fc023] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:09:10.234164 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a567db9c-6526-4a26-84c7-9addbbad4a57 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:10.235328 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a567db9c-6526-4a26-84c7-9addbbad4a57 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:10.236365 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a567db9c-6526-4a26-84c7-9addbbad4a57 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:10.252284 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a567db9c-6526-4a26-84c7-9addbbad4a57 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:10.255187 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a567db9c-6526-4a26-84c7-9addbbad4a57 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:10.257255 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a567db9c-6526-4a26-84c7-9addbbad4a57 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:10.301700 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-a567db9c-6526-4a26-84c7-9addbbad4a57 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] HTTP exception thrown: Instance 3b1a8172-f2d4-4308-8a1f-423b492fc023 could not be found. Sep 23 05:09:10.304056 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a567db9c-6526-4a26-84c7-9addbbad4a57 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Request method failure captured: Sep 23 05:09:10.304056 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/3b1a8172-f2d4-4308-8a1f-423b492fc023 HTTP/1.1 Sep 23 05:09:10.304056 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 05:09:10.304056 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 05:09:10.304056 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 05:09:10.304056 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 05:09:10.304056 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 05:09:10.304056 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 05:09:10.304056 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 05:09:10.304056 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 05:09:10.304056 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLT3a68wnGhJ1ri_wJa0c61-k-Mmu1aJqy0y8F08NYCjz_D70vilLx9G5I0GwzbhL1w2apyr58UgTWfFCoyEumWwAPT_5jEMZEFbxFGBL8lKHDufPcaCD0r7hhVTJQk-EQJ3nL8ZwWE56HAQoDgwteQ7RqvbmQmN2QkHgdyJgN3h_vQg Sep 23 05:09:10.304056 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 05:09:10.304056 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 05:09:10.304056 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 05:09:10.304056 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 05:09:10.304056 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 05:09:10.304056 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 05:09:10.304056 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: daad67f26fe246d6b4d28cad1707a119 Sep 23 05:09:10.304056 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-AttachVolumeNegativeTest-1007727461 Sep 23 05:09:10.304056 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 05:09:10.304056 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 05:09:10.304056 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_daad67f26fe246d6b4d28cad1707a119", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/daad67f26fe246d6b4d28cad1707a119"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/daad67f26fe246d6b4d28cad1707a119"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/daad67f26fe246d6b4d28cad1707a119"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:09:10.304056 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-AttachVolumeNegativeTest-1007727461 Sep 23 05:09:10.304056 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: daad67f26fe246d6b4d28cad1707a119 Sep 23 05:09:10.304056 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1007727461 Sep 23 05:09:10.304056 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-AttachVolumeNegativeTest-1007727461-project Sep 23 05:09:10.304056 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 05:09:10.304056 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 05:09:10.304056 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 59d90150ed7d477fab33129cb3b068ed Sep 23 05:09:10.304056 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-AttachVolumeNegativeTest-1007727461-project Sep 23 05:09:10.304056 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 05:09:10.304056 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 3b1a8172-f2d4-4308-8a1f-423b492fc023 could not be found. Sep 23 05:09:10.304056 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '3b1a8172-f2d4-4308-8a1f-423b492fc023'} Sep 23 05:09:10.304056 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:09:10.304056 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:09:10.304056 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 05:09:10.304056 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 05:09:10.304056 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 05:09:10.304056 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 05:09:10.304056 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 05:09:10.304056 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 05:09:10.304056 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 05:09:10.304056 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 05:09:10.304056 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b1a8172-f2d4-4308-8a1f-423b492fc023 could not be found. Sep 23 05:09:10.304056 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:09:10.304056 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:09:10.304056 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:09:10.304056 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:09:10.304056 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:09:10.304056 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:09:10.304056 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:09:10.304056 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:09:10.304056 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:09:10.304056 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:09:10.304056 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 05:09:10.304056 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 05:09:10.304056 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 05:09:10.304056 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 05:09:10.304056 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 05:09:10.304056 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:09:10.304056 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b1a8172-f2d4-4308-8a1f-423b492fc023 could not be found. Sep 23 05:09:10.304056 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:09:10.304056 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:09:10.304056 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:09:10.311982 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:09:10.311982 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:09:10.311982 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:09:10.311982 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:09:10.311982 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:09:10.311982 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b1a8172-f2d4-4308-8a1f-423b492fc023 could not be found. Sep 23 05:09:10.311982 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:09:10.311982 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a567db9c-6526-4a26-84c7-9addbbad4a57 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Returning 404 to user: Instance 3b1a8172-f2d4-4308-8a1f-423b492fc023 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:09:10.311982 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a567db9c-6526-4a26-84c7-9addbbad4a57 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/3b1a8172-f2d4-4308-8a1f-423b492fc023" status: 404 len: 111 microversion: 2.1 time: 0.089595 Sep 23 05:09:10.311982 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3195/6564] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:09:10 2022] GET /compute/v2.1/servers/3b1a8172-f2d4-4308-8a1f-423b492fc023 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 05:09:10.322352 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f73fb72b-2b4c-474d-a3bb-180feb1192f6 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:09:10.323033 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f73fb72b-2b4c-474d-a3bb-180feb1192f6 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] [instance: f42825c1-35fe-47b7-9fcc-ed93a82070eb] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:09:10.331611 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f73fb72b-2b4c-474d-a3bb-180feb1192f6 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:10.332345 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f73fb72b-2b4c-474d-a3bb-180feb1192f6 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:10.333059 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f73fb72b-2b4c-474d-a3bb-180feb1192f6 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:10.335448 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f73fb72b-2b4c-474d-a3bb-180feb1192f6 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:10.340040 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f73fb72b-2b4c-474d-a3bb-180feb1192f6 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:10.341490 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f73fb72b-2b4c-474d-a3bb-180feb1192f6 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:10.425509 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f73fb72b-2b4c-474d-a3bb-180feb1192f6 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bb2f4659524c3d9e5a15758d73ff93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4873cc166584624b8c00d6f14ccf3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:09:10.432503 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f73fb72b-2b4c-474d-a3bb-180feb1192f6 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] 10.222.0.33 "GET /compute/v2.1/servers/f42825c1-35fe-47b7-9fcc-ed93a82070eb" status: 200 len: 1299 microversion: 2.1 time: 0.118835 Sep 23 05:09:10.433198 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3196/6565] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:09:10 2022] GET /compute/v2.1/servers/f42825c1-35fe-47b7-9fcc-ed93a82070eb => generated 1299 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:09:10.438760 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-52f2abe7-567d-43f9-9e7c-d82477162904 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '.version_select at 0x7ff1bbaa8700>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:09:10.468529 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-9d2e8f52-18e8-41f0-a87a-d05f9ca43ebf tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.046089 Sep 23 05:09:10.475651 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3370/6566] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 05:09:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1048 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 05:09:10.481843 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-bee89e88-c7dd-4023-bae7-c39d5566ed17 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:09:10.482785 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-bee89e88-c7dd-4023-bae7-c39d5566ed17 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 7ad3508b-1d37-4c7b-82c7-be195566aacb] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:09:10.701715 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-bee89e88-c7dd-4023-bae7-c39d5566ed17 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:09:10.701715 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-bee89e88-c7dd-4023-bae7-c39d5566ed17 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb" status: 200 len: 1230 microversion: 2.1 time: 0.094567 Sep 23 05:09:10.701715 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3371/6567] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:09:10 2022] GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb => generated 1230 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:09:10.812173 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-52f2abe7-567d-43f9-9e7c-d82477162904 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-158534011" status: 202 len: 0 microversion: 2.1 time: 0.377447 Sep 23 05:09:10.812782 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3197/6568] 10.222.0.33 () {58 vars in 1218 bytes} [Fri Sep 23 05:09:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-158534011 => generated 0 bytes in 379 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 05:09:11.456372 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5467c7e5-5e21-426a-925f-9caf06b6b487 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:09:11.456988 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-5467c7e5-5e21-426a-925f-9caf06b6b487 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] [instance: f42825c1-35fe-47b7-9fcc-ed93a82070eb] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:09:11.468716 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5467c7e5-5e21-426a-925f-9caf06b6b487 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:11.469306 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5467c7e5-5e21-426a-925f-9caf06b6b487 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:11.470051 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5467c7e5-5e21-426a-925f-9caf06b6b487 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:11.470799 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5467c7e5-5e21-426a-925f-9caf06b6b487 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:11.473656 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5467c7e5-5e21-426a-925f-9caf06b6b487 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:11.477882 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5467c7e5-5e21-426a-925f-9caf06b6b487 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:11.536277 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5467c7e5-5e21-426a-925f-9caf06b6b487 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:11.538327 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5467c7e5-5e21-426a-925f-9caf06b6b487 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:11.538866 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5467c7e5-5e21-426a-925f-9caf06b6b487 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:11.539539 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-5467c7e5-5e21-426a-925f-9caf06b6b487 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lazy-loading 'fault' on Instance uuid f42825c1-35fe-47b7-9fcc-ed93a82070eb {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 05:09:11.607671 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-5467c7e5-5e21-426a-925f-9caf06b6b487 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bb2f4659524c3d9e5a15758d73ff93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4873cc166584624b8c00d6f14ccf3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:09:11.622460 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5467c7e5-5e21-426a-925f-9caf06b6b487 tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] 10.222.0.33 "GET /compute/v2.1/servers/f42825c1-35fe-47b7-9fcc-ed93a82070eb" status: 200 len: 1304 microversion: 2.1 time: 0.164927 Sep 23 05:09:11.622460 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3372/6569] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:09:11 2022] GET /compute/v2.1/servers/f42825c1-35fe-47b7-9fcc-ed93a82070eb => generated 1304 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:09:11.719927 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c348f2df-d41a-4934-b7b9-1df912fcd69b tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:09:11.721095 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c348f2df-d41a-4934-b7b9-1df912fcd69b tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 7ad3508b-1d37-4c7b-82c7-be195566aacb] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:09:11.845774 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c348f2df-d41a-4934-b7b9-1df912fcd69b tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:09:11.853754 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c348f2df-d41a-4934-b7b9-1df912fcd69b tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb" status: 200 len: 1230 microversion: 2.1 time: 0.138951 Sep 23 05:09:11.854386 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3198/6570] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:09:11 2022] GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb => generated 1230 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:09:12.641257 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0df395fe-c23f-4a9f-af03-b2da418f53ea tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:09:12.642771 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-0df395fe-c23f-4a9f-af03-b2da418f53ea tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] [instance: f42825c1-35fe-47b7-9fcc-ed93a82070eb] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:09:12.651171 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0df395fe-c23f-4a9f-af03-b2da418f53ea tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:12.651676 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0df395fe-c23f-4a9f-af03-b2da418f53ea tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:12.652334 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0df395fe-c23f-4a9f-af03-b2da418f53ea tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:12.653239 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0df395fe-c23f-4a9f-af03-b2da418f53ea tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:12.653710 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0df395fe-c23f-4a9f-af03-b2da418f53ea tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:12.654177 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0df395fe-c23f-4a9f-af03-b2da418f53ea tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:12.673862 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-0df395fe-c23f-4a9f-af03-b2da418f53ea tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] HTTP exception thrown: Instance f42825c1-35fe-47b7-9fcc-ed93a82070eb could not be found. Sep 23 05:09:12.675677 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0df395fe-c23f-4a9f-af03-b2da418f53ea tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Request method failure captured: Sep 23 05:09:12.675677 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/f42825c1-35fe-47b7-9fcc-ed93a82070eb HTTP/1.1 Sep 23 05:09:12.675677 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 05:09:12.675677 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 05:09:12.675677 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 05:09:12.675677 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 05:09:12.675677 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 05:09:12.675677 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 05:09:12.675677 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 05:09:12.675677 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 05:09:12.675677 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLT9Tl64Z2nlaFb5_742fDJ3bBrXa9vftY5LHRxGmjZP8AF5IFqPorzheRGMuvC6Nu35fwisGTyimq0mVSNbzFqs6zYqQm7fvEhKM-Sb2isCiYyl1di8aQrlbbjoxys-jMYENEk5w_Utrwhm58ZG-I7GLxBlZFJLpnzeZfnwOt0Z723c Sep 23 05:09:12.675677 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 05:09:12.675677 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 05:09:12.675677 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 05:09:12.675677 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 05:09:12.675677 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 05:09:12.675677 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 05:09:12.675677 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: a4873cc166584624b8c00d6f14ccf3ab Sep 23 05:09:12.675677 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-TestServerAdvancedOps-526088856 Sep 23 05:09:12.675677 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 05:09:12.675677 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 05:09:12.675677 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a4873cc166584624b8c00d6f14ccf3ab", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a4873cc166584624b8c00d6f14ccf3ab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a4873cc166584624b8c00d6f14ccf3ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a4873cc166584624b8c00d6f14ccf3ab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:09:12.675677 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-TestServerAdvancedOps-526088856 Sep 23 05:09:12.675677 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: a4873cc166584624b8c00d6f14ccf3ab Sep 23 05:09:12.675677 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-TestServerAdvancedOps-526088856 Sep 23 05:09:12.675677 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-TestServerAdvancedOps-526088856-project Sep 23 05:09:12.675677 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 05:09:12.675677 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 05:09:12.675677 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: a1bb2f4659524c3d9e5a15758d73ff93 Sep 23 05:09:12.675677 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-TestServerAdvancedOps-526088856-project Sep 23 05:09:12.675677 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 05:09:12.675677 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance f42825c1-35fe-47b7-9fcc-ed93a82070eb could not be found. Sep 23 05:09:12.675677 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': 'f42825c1-35fe-47b7-9fcc-ed93a82070eb'} Sep 23 05:09:12.675677 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:09:12.675677 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:09:12.675677 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 05:09:12.675677 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 05:09:12.675677 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 05:09:12.675677 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 05:09:12.675677 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 05:09:12.675677 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 05:09:12.675677 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 05:09:12.675677 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 05:09:12.675677 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f42825c1-35fe-47b7-9fcc-ed93a82070eb could not be found. Sep 23 05:09:12.675677 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:09:12.675677 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:09:12.675677 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:09:12.675677 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:09:12.675677 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:09:12.675677 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:09:12.675677 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:09:12.675677 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:09:12.675677 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:09:12.675677 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:09:12.675677 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 05:09:12.675677 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 05:09:12.675677 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 05:09:12.675677 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 05:09:12.675677 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 05:09:12.675677 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:09:12.675677 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f42825c1-35fe-47b7-9fcc-ed93a82070eb could not be found. Sep 23 05:09:12.675677 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:09:12.675677 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:09:12.675677 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:09:12.683535 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:09:12.683535 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:09:12.683535 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:09:12.683535 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:09:12.683535 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:09:12.683535 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f42825c1-35fe-47b7-9fcc-ed93a82070eb could not be found. Sep 23 05:09:12.683535 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:09:12.683535 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0df395fe-c23f-4a9f-af03-b2da418f53ea tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] Returning 404 to user: Instance f42825c1-35fe-47b7-9fcc-ed93a82070eb could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:09:12.683535 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0df395fe-c23f-4a9f-af03-b2da418f53ea tempest-TestServerAdvancedOps-526088856 tempest-TestServerAdvancedOps-526088856-project] 10.222.0.33 "GET /compute/v2.1/servers/f42825c1-35fe-47b7-9fcc-ed93a82070eb" status: 404 len: 111 microversion: 2.1 time: 0.040599 Sep 23 05:09:12.683535 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3373/6571] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:09:12 2022] GET /compute/v2.1/servers/f42825c1-35fe-47b7-9fcc-ed93a82070eb => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 05:09:12.879508 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e952fa62-dd5a-4766-89e8-b75933b6b37a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:09:12.880711 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e952fa62-dd5a-4766-89e8-b75933b6b37a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 7ad3508b-1d37-4c7b-82c7-be195566aacb] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:09:12.888780 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e952fa62-dd5a-4766-89e8-b75933b6b37a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:12.889448 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e952fa62-dd5a-4766-89e8-b75933b6b37a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:12.890226 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e952fa62-dd5a-4766-89e8-b75933b6b37a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:12.891169 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e952fa62-dd5a-4766-89e8-b75933b6b37a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:12.892187 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e952fa62-dd5a-4766-89e8-b75933b6b37a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:12.892841 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e952fa62-dd5a-4766-89e8-b75933b6b37a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:13.020385 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e952fa62-dd5a-4766-89e8-b75933b6b37a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:09:13.038562 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e952fa62-dd5a-4766-89e8-b75933b6b37a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb" status: 200 len: 1282 microversion: 2.1 time: 0.164006 Sep 23 05:09:13.041236 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3199/6572] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:09:12 2022] GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb => generated 1282 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:09:14.063430 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-240c3852-e95a-4fcf-af0e-9432ff584700 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:09:14.064057 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-240c3852-e95a-4fcf-af0e-9432ff584700 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 7ad3508b-1d37-4c7b-82c7-be195566aacb] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:09:14.079177 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-240c3852-e95a-4fcf-af0e-9432ff584700 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:14.079177 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-240c3852-e95a-4fcf-af0e-9432ff584700 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:14.079565 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-240c3852-e95a-4fcf-af0e-9432ff584700 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:14.081485 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-240c3852-e95a-4fcf-af0e-9432ff584700 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:14.082072 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-240c3852-e95a-4fcf-af0e-9432ff584700 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:14.082525 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-240c3852-e95a-4fcf-af0e-9432ff584700 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:14.291416 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-240c3852-e95a-4fcf-af0e-9432ff584700 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:09:14.303865 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-240c3852-e95a-4fcf-af0e-9432ff584700 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb" status: 200 len: 1300 microversion: 2.1 time: 0.244684 Sep 23 05:09:14.306637 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3374/6573] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:09:14 2022] GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb => generated 1300 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:09:15.340723 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-50967ffe-1c52-4028-9f19-7889005f4320 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:09:15.341414 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-50967ffe-1c52-4028-9f19-7889005f4320 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 7ad3508b-1d37-4c7b-82c7-be195566aacb] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:09:15.361064 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-50967ffe-1c52-4028-9f19-7889005f4320 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:15.363358 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-50967ffe-1c52-4028-9f19-7889005f4320 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:15.368547 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-50967ffe-1c52-4028-9f19-7889005f4320 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:15.371317 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-50967ffe-1c52-4028-9f19-7889005f4320 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:15.372962 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-50967ffe-1c52-4028-9f19-7889005f4320 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:15.373515 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-50967ffe-1c52-4028-9f19-7889005f4320 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:15.712783 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-50967ffe-1c52-4028-9f19-7889005f4320 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:09:15.726874 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-50967ffe-1c52-4028-9f19-7889005f4320 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb" status: 200 len: 1342 microversion: 2.1 time: 0.390361 Sep 23 05:09:15.727476 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3200/6574] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:09:15 2022] GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb => generated 1342 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:09:16.751434 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-249710be-7efb-4373-bf90-22559d74994b tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:09:16.752649 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-249710be-7efb-4373-bf90-22559d74994b tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 7ad3508b-1d37-4c7b-82c7-be195566aacb] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:09:16.768958 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-249710be-7efb-4373-bf90-22559d74994b tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:16.769468 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-249710be-7efb-4373-bf90-22559d74994b tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:16.776296 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-249710be-7efb-4373-bf90-22559d74994b tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:16.777583 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-249710be-7efb-4373-bf90-22559d74994b tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:16.780740 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-249710be-7efb-4373-bf90-22559d74994b tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:16.781416 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-249710be-7efb-4373-bf90-22559d74994b tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:17.140291 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-249710be-7efb-4373-bf90-22559d74994b tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:09:17.162158 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-249710be-7efb-4373-bf90-22559d74994b tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb" status: 200 len: 1342 microversion: 2.1 time: 0.414788 Sep 23 05:09:17.165469 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3375/6575] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:09:16 2022] GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb => generated 1342 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:09:17.962940 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-bd03fbdd-2389-44b8-9a48-2abff9e0a976 req-456481c1-c9f0-4fc9-9236-2e7e23153339 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ad3508b-1d37-4c7b-82c7-be195566aacb", "tag": "4eaae8ce-f836-493a-ba9b-c19cc5da65aa"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:09:17.993253 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-bd03fbdd-2389-44b8-9a48-2abff9e0a976 req-456481c1-c9f0-4fc9-9236-2e7e23153339 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:17.993253 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-bd03fbdd-2389-44b8-9a48-2abff9e0a976 req-456481c1-c9f0-4fc9-9236-2e7e23153339 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:17.993253 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-bd03fbdd-2389-44b8-9a48-2abff9e0a976 req-456481c1-c9f0-4fc9-9236-2e7e23153339 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:18.020905 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-bd03fbdd-2389-44b8-9a48-2abff9e0a976 req-456481c1-c9f0-4fc9-9236-2e7e23153339 service nova] Creating event network-changed:4eaae8ce-f836-493a-ba9b-c19cc5da65aa for instance 7ad3508b-1d37-4c7b-82c7-be195566aacb on n-h2-846463-3 Sep 23 05:09:18.039246 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-bd03fbdd-2389-44b8-9a48-2abff9e0a976 req-456481c1-c9f0-4fc9-9236-2e7e23153339 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076685 Sep 23 05:09:18.039246 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3201/6576] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:09:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:09:18.191793 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-49a9781f-ea91-43e8-88e7-1ee8203ec1bd tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:09:18.193975 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-49a9781f-ea91-43e8-88e7-1ee8203ec1bd tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 7ad3508b-1d37-4c7b-82c7-be195566aacb] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:09:18.210532 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-49a9781f-ea91-43e8-88e7-1ee8203ec1bd tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:18.211340 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-49a9781f-ea91-43e8-88e7-1ee8203ec1bd tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:18.211975 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-49a9781f-ea91-43e8-88e7-1ee8203ec1bd tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:18.212928 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-49a9781f-ea91-43e8-88e7-1ee8203ec1bd tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:18.215048 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-49a9781f-ea91-43e8-88e7-1ee8203ec1bd tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:18.216029 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-49a9781f-ea91-43e8-88e7-1ee8203ec1bd tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:18.508667 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-49a9781f-ea91-43e8-88e7-1ee8203ec1bd tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:09:18.519675 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-49a9781f-ea91-43e8-88e7-1ee8203ec1bd tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb" status: 200 len: 1342 microversion: 2.1 time: 0.331067 Sep 23 05:09:18.520589 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3376/6577] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:09:18 2022] GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb => generated 1342 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:09:19.195199 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-621e241d-81c2-4718-9a11-783db27fd2ab tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:09:19.195199 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-621e241d-81c2-4718-9a11-783db27fd2ab tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 3b1a8172-f2d4-4308-8a1f-423b492fc023] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:09:19.197698 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-621e241d-81c2-4718-9a11-783db27fd2ab tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:19.202362 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-621e241d-81c2-4718-9a11-783db27fd2ab tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:19.203148 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-621e241d-81c2-4718-9a11-783db27fd2ab tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:19.206705 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-621e241d-81c2-4718-9a11-783db27fd2ab tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:19.207385 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-621e241d-81c2-4718-9a11-783db27fd2ab tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:19.208001 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-621e241d-81c2-4718-9a11-783db27fd2ab tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:19.266272 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-621e241d-81c2-4718-9a11-783db27fd2ab tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] HTTP exception thrown: Instance 3b1a8172-f2d4-4308-8a1f-423b492fc023 could not be found. Sep 23 05:09:19.269953 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-621e241d-81c2-4718-9a11-783db27fd2ab tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Request method failure captured: Sep 23 05:09:19.269953 n-d-846463-3 devstack@n-api.service[122698]: request: DELETE /compute/v2.1/servers/3b1a8172-f2d4-4308-8a1f-423b492fc023 HTTP/1.1 Sep 23 05:09:19.269953 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 05:09:19.269953 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 05:09:19.269953 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 05:09:19.269953 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 05:09:19.269953 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 05:09:19.269953 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 05:09:19.269953 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 05:09:19.269953 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 05:09:19.269953 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLT3a68wnGhJ1ri_wJa0c61-k-Mmu1aJqy0y8F08NYCjz_D70vilLx9G5I0GwzbhL1w2apyr58UgTWfFCoyEumWwAPT_5jEMZEFbxFGBL8lKHDufPcaCD0r7hhVTJQk-EQJ3nL8ZwWE56HAQoDgwteQ7RqvbmQmN2QkHgdyJgN3h_vQg Sep 23 05:09:19.269953 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 05:09:19.269953 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 05:09:19.269953 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 05:09:19.269953 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 05:09:19.269953 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 05:09:19.269953 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 05:09:19.269953 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: daad67f26fe246d6b4d28cad1707a119 Sep 23 05:09:19.269953 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-AttachVolumeNegativeTest-1007727461 Sep 23 05:09:19.269953 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 05:09:19.269953 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 05:09:19.269953 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_daad67f26fe246d6b4d28cad1707a119", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/daad67f26fe246d6b4d28cad1707a119"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/daad67f26fe246d6b4d28cad1707a119"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/daad67f26fe246d6b4d28cad1707a119"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:09:19.269953 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-AttachVolumeNegativeTest-1007727461 Sep 23 05:09:19.269953 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: daad67f26fe246d6b4d28cad1707a119 Sep 23 05:09:19.269953 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1007727461 Sep 23 05:09:19.269953 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-AttachVolumeNegativeTest-1007727461-project Sep 23 05:09:19.269953 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 05:09:19.269953 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 05:09:19.269953 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 59d90150ed7d477fab33129cb3b068ed Sep 23 05:09:19.269953 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-AttachVolumeNegativeTest-1007727461-project Sep 23 05:09:19.269953 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 05:09:19.269953 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 3b1a8172-f2d4-4308-8a1f-423b492fc023 could not be found. Sep 23 05:09:19.269953 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '3b1a8172-f2d4-4308-8a1f-423b492fc023'} Sep 23 05:09:19.269953 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:09:19.269953 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:09:19.269953 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 05:09:19.269953 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 05:09:19.269953 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 05:09:19.269953 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 05:09:19.269953 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 05:09:19.269953 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 05:09:19.269953 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 05:09:19.269953 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 05:09:19.269953 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b1a8172-f2d4-4308-8a1f-423b492fc023 could not be found. Sep 23 05:09:19.269953 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:09:19.269953 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:09:19.269953 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:09:19.269953 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:09:19.269953 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:09:19.269953 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:09:19.269953 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:09:19.269953 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:09:19.269953 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:09:19.269953 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:09:19.269953 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 05:09:19.269953 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 05:09:19.269953 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 05:09:19.269953 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 05:09:19.269953 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 05:09:19.269953 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 05:09:19.269953 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 05:09:19.269953 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:09:19.274873 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b1a8172-f2d4-4308-8a1f-423b492fc023 could not be found. Sep 23 05:09:19.274873 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:09:19.274873 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:09:19.274873 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:09:19.274873 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:09:19.274873 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:09:19.274873 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:09:19.274873 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:09:19.274873 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:09:19.274873 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b1a8172-f2d4-4308-8a1f-423b492fc023 could not be found. Sep 23 05:09:19.274873 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:09:19.276282 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-621e241d-81c2-4718-9a11-783db27fd2ab tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Returning 404 to user: Instance 3b1a8172-f2d4-4308-8a1f-423b492fc023 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:09:19.279475 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-621e241d-81c2-4718-9a11-783db27fd2ab tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "DELETE /compute/v2.1/servers/3b1a8172-f2d4-4308-8a1f-423b492fc023" status: 404 len: 111 microversion: 2.1 time: 0.102374 Sep 23 05:09:19.283402 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3202/6578] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 05:09:19 2022] DELETE /compute/v2.1/servers/3b1a8172-f2d4-4308-8a1f-423b492fc023 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 05:09:19.289333 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f257f9f4-8a4f-4af9-ba51-0dd00a583af7 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:09:19.292004 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f257f9f4-8a4f-4af9-ba51-0dd00a583af7 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 3b1a8172-f2d4-4308-8a1f-423b492fc023] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:09:19.304437 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f257f9f4-8a4f-4af9-ba51-0dd00a583af7 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:19.307540 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f257f9f4-8a4f-4af9-ba51-0dd00a583af7 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:19.316669 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f257f9f4-8a4f-4af9-ba51-0dd00a583af7 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:19.324432 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f257f9f4-8a4f-4af9-ba51-0dd00a583af7 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:19.324432 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f257f9f4-8a4f-4af9-ba51-0dd00a583af7 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:19.334671 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f257f9f4-8a4f-4af9-ba51-0dd00a583af7 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:19.447662 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-f257f9f4-8a4f-4af9-ba51-0dd00a583af7 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] HTTP exception thrown: Instance 3b1a8172-f2d4-4308-8a1f-423b492fc023 could not be found. Sep 23 05:09:19.449614 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f257f9f4-8a4f-4af9-ba51-0dd00a583af7 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Request method failure captured: Sep 23 05:09:19.449614 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/3b1a8172-f2d4-4308-8a1f-423b492fc023 HTTP/1.1 Sep 23 05:09:19.449614 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 05:09:19.449614 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 05:09:19.449614 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 05:09:19.449614 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 05:09:19.449614 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 05:09:19.449614 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 05:09:19.449614 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 05:09:19.449614 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 05:09:19.449614 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLT3a68wnGhJ1ri_wJa0c61-k-Mmu1aJqy0y8F08NYCjz_D70vilLx9G5I0GwzbhL1w2apyr58UgTWfFCoyEumWwAPT_5jEMZEFbxFGBL8lKHDufPcaCD0r7hhVTJQk-EQJ3nL8ZwWE56HAQoDgwteQ7RqvbmQmN2QkHgdyJgN3h_vQg Sep 23 05:09:19.449614 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 05:09:19.449614 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 05:09:19.449614 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 05:09:19.449614 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 05:09:19.449614 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 05:09:19.449614 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 05:09:19.449614 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: daad67f26fe246d6b4d28cad1707a119 Sep 23 05:09:19.449614 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-AttachVolumeNegativeTest-1007727461 Sep 23 05:09:19.449614 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 05:09:19.449614 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 05:09:19.449614 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_daad67f26fe246d6b4d28cad1707a119", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/daad67f26fe246d6b4d28cad1707a119"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/daad67f26fe246d6b4d28cad1707a119"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/daad67f26fe246d6b4d28cad1707a119"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:09:19.449614 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-AttachVolumeNegativeTest-1007727461 Sep 23 05:09:19.449614 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: daad67f26fe246d6b4d28cad1707a119 Sep 23 05:09:19.449614 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1007727461 Sep 23 05:09:19.449614 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-AttachVolumeNegativeTest-1007727461-project Sep 23 05:09:19.449614 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 05:09:19.449614 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 05:09:19.449614 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 59d90150ed7d477fab33129cb3b068ed Sep 23 05:09:19.449614 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-AttachVolumeNegativeTest-1007727461-project Sep 23 05:09:19.449614 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 05:09:19.449614 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 3b1a8172-f2d4-4308-8a1f-423b492fc023 could not be found. Sep 23 05:09:19.449614 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '3b1a8172-f2d4-4308-8a1f-423b492fc023'} Sep 23 05:09:19.449614 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:09:19.449614 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:09:19.449614 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 05:09:19.449614 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 05:09:19.449614 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 05:09:19.449614 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 05:09:19.449614 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 05:09:19.449614 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 05:09:19.449614 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 05:09:19.449614 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 05:09:19.449614 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b1a8172-f2d4-4308-8a1f-423b492fc023 could not be found. Sep 23 05:09:19.449614 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:09:19.449614 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:09:19.449614 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:09:19.449614 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:09:19.449614 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:09:19.449614 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:09:19.449614 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:09:19.449614 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:09:19.449614 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:09:19.449614 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:09:19.449614 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 05:09:19.449614 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 05:09:19.449614 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 05:09:19.449614 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 05:09:19.449614 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 05:09:19.449614 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:09:19.449614 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b1a8172-f2d4-4308-8a1f-423b492fc023 could not be found. Sep 23 05:09:19.449614 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:09:19.449614 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:09:19.449614 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:09:19.454042 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:09:19.454042 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:09:19.454042 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:09:19.454042 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:09:19.454042 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:09:19.454042 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b1a8172-f2d4-4308-8a1f-423b492fc023 could not be found. Sep 23 05:09:19.454042 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:09:19.472977 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f257f9f4-8a4f-4af9-ba51-0dd00a583af7 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Returning 404 to user: Instance 3b1a8172-f2d4-4308-8a1f-423b492fc023 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:09:19.483284 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f257f9f4-8a4f-4af9-ba51-0dd00a583af7 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/3b1a8172-f2d4-4308-8a1f-423b492fc023" status: 404 len: 111 microversion: 2.1 time: 0.192059 Sep 23 05:09:19.506297 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3377/6579] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:09:19 2022] GET /compute/v2.1/servers/3b1a8172-f2d4-4308-8a1f-423b492fc023 => generated 111 bytes in 222 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 05:09:19.545685 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-402fb49a-bbda-435c-a55e-f56a65fa749a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:09:19.546408 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-402fb49a-bbda-435c-a55e-f56a65fa749a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 7ad3508b-1d37-4c7b-82c7-be195566aacb] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:09:19.554547 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-402fb49a-bbda-435c-a55e-f56a65fa749a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:19.556485 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-402fb49a-bbda-435c-a55e-f56a65fa749a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:19.557391 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-402fb49a-bbda-435c-a55e-f56a65fa749a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:19.558383 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-402fb49a-bbda-435c-a55e-f56a65fa749a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:19.559137 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-402fb49a-bbda-435c-a55e-f56a65fa749a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:19.559824 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-402fb49a-bbda-435c-a55e-f56a65fa749a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:19.817140 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-402fb49a-bbda-435c-a55e-f56a65fa749a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:09:19.830946 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-402fb49a-bbda-435c-a55e-f56a65fa749a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb" status: 200 len: 1342 microversion: 2.1 time: 0.289134 Sep 23 05:09:19.845924 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3203/6580] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:09:19 2022] GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb => generated 1342 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:09:20.856754 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1eb4106a-c41b-4bb7-9ac8-ab11fba5e527 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:09:20.857346 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1eb4106a-c41b-4bb7-9ac8-ab11fba5e527 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 7ad3508b-1d37-4c7b-82c7-be195566aacb] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:09:20.859940 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:09:20.862044 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=8 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:09:20.869397 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1eb4106a-c41b-4bb7-9ac8-ab11fba5e527 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:20.870014 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1eb4106a-c41b-4bb7-9ac8-ab11fba5e527 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:20.870471 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1eb4106a-c41b-4bb7-9ac8-ab11fba5e527 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:20.871193 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1eb4106a-c41b-4bb7-9ac8-ab11fba5e527 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:20.871781 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1eb4106a-c41b-4bb7-9ac8-ab11fba5e527 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:20.872268 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1eb4106a-c41b-4bb7-9ac8-ab11fba5e527 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:21.206873 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1eb4106a-c41b-4bb7-9ac8-ab11fba5e527 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:09:21.217702 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1eb4106a-c41b-4bb7-9ac8-ab11fba5e527 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb" status: 200 len: 1342 microversion: 2.1 time: 0.366083 Sep 23 05:09:21.218410 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3378/6581] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:09:20 2022] GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb => generated 1342 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:09:22.251599 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-23c39f01-cd33-47f7-870c-ce01e67aedb4 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:09:22.252915 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-23c39f01-cd33-47f7-870c-ce01e67aedb4 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 7ad3508b-1d37-4c7b-82c7-be195566aacb] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:09:22.263803 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:09:22.269607 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-23c39f01-cd33-47f7-870c-ce01e67aedb4 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:22.284220 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-23c39f01-cd33-47f7-870c-ce01e67aedb4 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:22.286427 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-23c39f01-cd33-47f7-870c-ce01e67aedb4 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:22.289505 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-23c39f01-cd33-47f7-870c-ce01e67aedb4 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:22.291511 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-23c39f01-cd33-47f7-870c-ce01e67aedb4 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:22.294399 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-23c39f01-cd33-47f7-870c-ce01e67aedb4 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:22.613338 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-23c39f01-cd33-47f7-870c-ce01e67aedb4 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:09:22.631512 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-23c39f01-cd33-47f7-870c-ce01e67aedb4 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb" status: 200 len: 1342 microversion: 2.1 time: 0.387656 Sep 23 05:09:22.632831 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3204/6582] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:09:22 2022] GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb => generated 1342 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:09:23.665280 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9c6e422a-62ce-4c0a-913d-ef1471d44250 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:09:23.667353 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-9c6e422a-62ce-4c0a-913d-ef1471d44250 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 7ad3508b-1d37-4c7b-82c7-be195566aacb] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:09:23.675284 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9c6e422a-62ce-4c0a-913d-ef1471d44250 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:23.676743 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9c6e422a-62ce-4c0a-913d-ef1471d44250 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:23.678119 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9c6e422a-62ce-4c0a-913d-ef1471d44250 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:23.679002 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9c6e422a-62ce-4c0a-913d-ef1471d44250 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:23.679758 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9c6e422a-62ce-4c0a-913d-ef1471d44250 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:23.680339 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9c6e422a-62ce-4c0a-913d-ef1471d44250 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:23.892077 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-9c6e422a-62ce-4c0a-913d-ef1471d44250 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:09:23.901166 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-9c6e422a-62ce-4c0a-913d-ef1471d44250 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb" status: 200 len: 1342 microversion: 2.1 time: 0.241099 Sep 23 05:09:23.903199 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3379/6583] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:09:23 2022] GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb => generated 1342 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:09:24.927645 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3096d9fb-df79-48b2-b2df-b2e8e8405e8d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:09:24.928286 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3096d9fb-df79-48b2-b2df-b2e8e8405e8d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 7ad3508b-1d37-4c7b-82c7-be195566aacb] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:09:24.970392 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3096d9fb-df79-48b2-b2df-b2e8e8405e8d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:24.970392 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3096d9fb-df79-48b2-b2df-b2e8e8405e8d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:24.970392 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3096d9fb-df79-48b2-b2df-b2e8e8405e8d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:24.970392 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3096d9fb-df79-48b2-b2df-b2e8e8405e8d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:24.970392 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3096d9fb-df79-48b2-b2df-b2e8e8405e8d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:24.970392 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3096d9fb-df79-48b2-b2df-b2e8e8405e8d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:25.273295 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-3096d9fb-df79-48b2-b2df-b2e8e8405e8d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:09:25.284740 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3096d9fb-df79-48b2-b2df-b2e8e8405e8d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb" status: 200 len: 1342 microversion: 2.1 time: 0.361445 Sep 23 05:09:25.286335 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3205/6584] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:09:24 2022] GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb => generated 1342 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:09:26.310993 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-cdd40d0f-9313-4670-9399-496575bd79e0 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:09:26.312428 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-cdd40d0f-9313-4670-9399-496575bd79e0 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 7ad3508b-1d37-4c7b-82c7-be195566aacb] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:09:26.319557 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cdd40d0f-9313-4670-9399-496575bd79e0 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:26.329379 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cdd40d0f-9313-4670-9399-496575bd79e0 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:26.330163 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cdd40d0f-9313-4670-9399-496575bd79e0 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:26.331085 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cdd40d0f-9313-4670-9399-496575bd79e0 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:26.331710 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cdd40d0f-9313-4670-9399-496575bd79e0 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:26.332349 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cdd40d0f-9313-4670-9399-496575bd79e0 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:26.393005 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:09:26.615612 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-cdd40d0f-9313-4670-9399-496575bd79e0 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:09:26.632633 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-cdd40d0f-9313-4670-9399-496575bd79e0 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb" status: 200 len: 1342 microversion: 2.1 time: 0.324507 Sep 23 05:09:26.634936 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3380/6585] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:09:26 2022] GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb => generated 1342 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:09:27.652301 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8cc9312f-5b99-4419-9b92-db0bb46890aa tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:09:27.653014 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8cc9312f-5b99-4419-9b92-db0bb46890aa tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 0d5dd84a-5c19-4af9-bd05-c95d93da0069] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:09:27.658421 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-23c9be85-0b7c-4939-95b0-e57529352ba8 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:09:27.659654 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-23c9be85-0b7c-4939-95b0-e57529352ba8 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 7ad3508b-1d37-4c7b-82c7-be195566aacb] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:09:27.673308 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-23c9be85-0b7c-4939-95b0-e57529352ba8 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:27.673813 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-23c9be85-0b7c-4939-95b0-e57529352ba8 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:27.674300 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-23c9be85-0b7c-4939-95b0-e57529352ba8 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:27.675035 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-23c9be85-0b7c-4939-95b0-e57529352ba8 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:27.675502 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-23c9be85-0b7c-4939-95b0-e57529352ba8 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:27.675933 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-23c9be85-0b7c-4939-95b0-e57529352ba8 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:27.681963 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8cc9312f-5b99-4419-9b92-db0bb46890aa tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:27.683195 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8cc9312f-5b99-4419-9b92-db0bb46890aa tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:27.685087 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8cc9312f-5b99-4419-9b92-db0bb46890aa tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:27.691991 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8cc9312f-5b99-4419-9b92-db0bb46890aa tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:27.699749 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8cc9312f-5b99-4419-9b92-db0bb46890aa tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:27.699749 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8cc9312f-5b99-4419-9b92-db0bb46890aa tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:27.726043 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-8cc9312f-5b99-4419-9b92-db0bb46890aa tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] HTTP exception thrown: Instance 0d5dd84a-5c19-4af9-bd05-c95d93da0069 could not be found. Sep 23 05:09:27.727947 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8cc9312f-5b99-4419-9b92-db0bb46890aa tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Request method failure captured: Sep 23 05:09:27.727947 n-d-846463-3 devstack@n-api.service[122698]: request: DELETE /compute/v2.1/servers/0d5dd84a-5c19-4af9-bd05-c95d93da0069 HTTP/1.1 Sep 23 05:09:27.727947 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 05:09:27.727947 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 05:09:27.727947 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 05:09:27.727947 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 05:09:27.727947 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 05:09:27.727947 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 05:09:27.727947 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 05:09:27.727947 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 05:09:27.727947 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLT3a68wnGhJ1ri_wJa0c61-k-Mmu1aJqy0y8F08NYCjz_D70vilLx9G5I0GwzbhL1w2apyr58UgTWfFCoyEumWwAPT_5jEMZEFbxFGBL8lKHDufPcaCD0r7hhVTJQk-EQJ3nL8ZwWE56HAQoDgwteQ7RqvbmQmN2QkHgdyJgN3h_vQg Sep 23 05:09:27.727947 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 05:09:27.727947 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 05:09:27.727947 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 05:09:27.727947 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 05:09:27.727947 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 05:09:27.727947 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 05:09:27.727947 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: daad67f26fe246d6b4d28cad1707a119 Sep 23 05:09:27.727947 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-AttachVolumeNegativeTest-1007727461 Sep 23 05:09:27.727947 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 05:09:27.727947 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 05:09:27.727947 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_daad67f26fe246d6b4d28cad1707a119", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/daad67f26fe246d6b4d28cad1707a119"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/daad67f26fe246d6b4d28cad1707a119"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/daad67f26fe246d6b4d28cad1707a119"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:09:27.727947 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-AttachVolumeNegativeTest-1007727461 Sep 23 05:09:27.727947 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: daad67f26fe246d6b4d28cad1707a119 Sep 23 05:09:27.727947 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1007727461 Sep 23 05:09:27.727947 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-AttachVolumeNegativeTest-1007727461-project Sep 23 05:09:27.727947 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 05:09:27.727947 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 05:09:27.727947 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 59d90150ed7d477fab33129cb3b068ed Sep 23 05:09:27.727947 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-AttachVolumeNegativeTest-1007727461-project Sep 23 05:09:27.727947 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 05:09:27.727947 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 0d5dd84a-5c19-4af9-bd05-c95d93da0069 could not be found. Sep 23 05:09:27.727947 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '0d5dd84a-5c19-4af9-bd05-c95d93da0069'} Sep 23 05:09:27.727947 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:09:27.727947 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:09:27.727947 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 05:09:27.727947 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 05:09:27.727947 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 05:09:27.727947 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 05:09:27.727947 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 05:09:27.727947 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 05:09:27.727947 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 05:09:27.727947 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 05:09:27.727947 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d5dd84a-5c19-4af9-bd05-c95d93da0069 could not be found. Sep 23 05:09:27.727947 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:09:27.727947 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:09:27.727947 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:09:27.727947 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:09:27.727947 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:09:27.727947 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:09:27.727947 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:09:27.727947 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:09:27.727947 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:09:27.727947 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:09:27.727947 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 05:09:27.727947 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 05:09:27.727947 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 05:09:27.727947 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 05:09:27.727947 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 05:09:27.727947 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 05:09:27.727947 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 05:09:27.727947 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:09:27.732117 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d5dd84a-5c19-4af9-bd05-c95d93da0069 could not be found. Sep 23 05:09:27.732117 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:09:27.732117 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:09:27.732117 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:09:27.732117 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:09:27.732117 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:09:27.732117 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:09:27.732117 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:09:27.732117 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:09:27.732117 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d5dd84a-5c19-4af9-bd05-c95d93da0069 could not be found. Sep 23 05:09:27.732117 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:09:27.737307 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8cc9312f-5b99-4419-9b92-db0bb46890aa tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Returning 404 to user: Instance 0d5dd84a-5c19-4af9-bd05-c95d93da0069 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:09:27.738430 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8cc9312f-5b99-4419-9b92-db0bb46890aa tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "DELETE /compute/v2.1/servers/0d5dd84a-5c19-4af9-bd05-c95d93da0069" status: 404 len: 111 microversion: 2.1 time: 0.090128 Sep 23 05:09:27.740200 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3206/6586] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 05:09:27 2022] DELETE /compute/v2.1/servers/0d5dd84a-5c19-4af9-bd05-c95d93da0069 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 05:09:27.756089 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-08fab51a-e1a7-42ad-895c-90959e9b71fc tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:09:27.757017 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-08fab51a-e1a7-42ad-895c-90959e9b71fc tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 0d5dd84a-5c19-4af9-bd05-c95d93da0069] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:09:27.773266 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-08fab51a-e1a7-42ad-895c-90959e9b71fc tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:27.774180 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-08fab51a-e1a7-42ad-895c-90959e9b71fc tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:27.774818 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-08fab51a-e1a7-42ad-895c-90959e9b71fc tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:27.775944 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-08fab51a-e1a7-42ad-895c-90959e9b71fc tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:27.777321 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-08fab51a-e1a7-42ad-895c-90959e9b71fc tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:27.780355 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-08fab51a-e1a7-42ad-895c-90959e9b71fc tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:27.818006 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:09:27.822775 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-08fab51a-e1a7-42ad-895c-90959e9b71fc tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] HTTP exception thrown: Instance 0d5dd84a-5c19-4af9-bd05-c95d93da0069 could not be found. Sep 23 05:09:27.825038 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-08fab51a-e1a7-42ad-895c-90959e9b71fc tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Request method failure captured: Sep 23 05:09:27.825038 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/0d5dd84a-5c19-4af9-bd05-c95d93da0069 HTTP/1.1 Sep 23 05:09:27.825038 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 05:09:27.825038 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 05:09:27.825038 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 05:09:27.825038 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 05:09:27.825038 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 05:09:27.825038 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 05:09:27.825038 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 05:09:27.825038 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 05:09:27.825038 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLT3a68wnGhJ1ri_wJa0c61-k-Mmu1aJqy0y8F08NYCjz_D70vilLx9G5I0GwzbhL1w2apyr58UgTWfFCoyEumWwAPT_5jEMZEFbxFGBL8lKHDufPcaCD0r7hhVTJQk-EQJ3nL8ZwWE56HAQoDgwteQ7RqvbmQmN2QkHgdyJgN3h_vQg Sep 23 05:09:27.825038 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 05:09:27.825038 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 05:09:27.825038 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 05:09:27.825038 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 05:09:27.825038 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 05:09:27.825038 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 05:09:27.825038 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: daad67f26fe246d6b4d28cad1707a119 Sep 23 05:09:27.825038 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-AttachVolumeNegativeTest-1007727461 Sep 23 05:09:27.825038 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 05:09:27.825038 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 05:09:27.825038 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_daad67f26fe246d6b4d28cad1707a119", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/daad67f26fe246d6b4d28cad1707a119"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/daad67f26fe246d6b4d28cad1707a119"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/daad67f26fe246d6b4d28cad1707a119"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:09:27.825038 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-AttachVolumeNegativeTest-1007727461 Sep 23 05:09:27.825038 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: daad67f26fe246d6b4d28cad1707a119 Sep 23 05:09:27.825038 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1007727461 Sep 23 05:09:27.825038 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-AttachVolumeNegativeTest-1007727461-project Sep 23 05:09:27.825038 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 05:09:27.825038 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 05:09:27.825038 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 59d90150ed7d477fab33129cb3b068ed Sep 23 05:09:27.825038 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-AttachVolumeNegativeTest-1007727461-project Sep 23 05:09:27.825038 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 05:09:27.825038 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 0d5dd84a-5c19-4af9-bd05-c95d93da0069 could not be found. Sep 23 05:09:27.825038 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '0d5dd84a-5c19-4af9-bd05-c95d93da0069'} Sep 23 05:09:27.825038 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:09:27.825038 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:09:27.825038 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 05:09:27.825038 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 05:09:27.825038 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 05:09:27.825038 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 05:09:27.825038 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 05:09:27.825038 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 05:09:27.825038 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 05:09:27.825038 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 05:09:27.825038 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d5dd84a-5c19-4af9-bd05-c95d93da0069 could not be found. Sep 23 05:09:27.825038 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:09:27.825038 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:09:27.825038 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:09:27.825038 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:09:27.825038 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:09:27.825038 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:09:27.825038 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:09:27.825038 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:09:27.825038 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:09:27.825038 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:09:27.825038 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 05:09:27.825038 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 05:09:27.825038 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 05:09:27.825038 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 05:09:27.825038 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 05:09:27.825038 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:09:27.825038 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d5dd84a-5c19-4af9-bd05-c95d93da0069 could not be found. Sep 23 05:09:27.825038 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:09:27.825038 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:09:27.825038 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:09:27.829641 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:09:27.829641 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:09:27.829641 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:09:27.829641 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:09:27.829641 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:09:27.829641 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d5dd84a-5c19-4af9-bd05-c95d93da0069 could not be found. Sep 23 05:09:27.829641 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:09:27.835086 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-08fab51a-e1a7-42ad-895c-90959e9b71fc tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Returning 404 to user: Instance 0d5dd84a-5c19-4af9-bd05-c95d93da0069 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:09:27.838182 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-08fab51a-e1a7-42ad-895c-90959e9b71fc tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/0d5dd84a-5c19-4af9-bd05-c95d93da0069" status: 404 len: 111 microversion: 2.1 time: 0.092366 Sep 23 05:09:27.839265 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3207/6587] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:09:27 2022] GET /compute/v2.1/servers/0d5dd84a-5c19-4af9-bd05-c95d93da0069 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 05:09:27.851991 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1ae04a59-26a7-4376-867f-ce5244e79d15 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:09:27.856097 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-1ae04a59-26a7-4376-867f-ce5244e79d15 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: f67681e5-fced-41b4-ae7c-7ce922f09df1] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:09:27.869630 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1ae04a59-26a7-4376-867f-ce5244e79d15 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:27.872348 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1ae04a59-26a7-4376-867f-ce5244e79d15 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:27.873113 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1ae04a59-26a7-4376-867f-ce5244e79d15 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:27.874032 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1ae04a59-26a7-4376-867f-ce5244e79d15 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:27.878203 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1ae04a59-26a7-4376-867f-ce5244e79d15 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:27.879264 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1ae04a59-26a7-4376-867f-ce5244e79d15 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:27.942439 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-1ae04a59-26a7-4376-867f-ce5244e79d15 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] HTTP exception thrown: Instance f67681e5-fced-41b4-ae7c-7ce922f09df1 could not be found. Sep 23 05:09:27.953480 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1ae04a59-26a7-4376-867f-ce5244e79d15 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Request method failure captured: Sep 23 05:09:27.953480 n-d-846463-3 devstack@n-api.service[122698]: request: DELETE /compute/v2.1/servers/f67681e5-fced-41b4-ae7c-7ce922f09df1 HTTP/1.1 Sep 23 05:09:27.953480 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 05:09:27.953480 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 05:09:27.953480 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 05:09:27.953480 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 05:09:27.953480 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 05:09:27.953480 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 05:09:27.953480 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 05:09:27.953480 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 05:09:27.953480 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLT3a68wnGhJ1ri_wJa0c61-k-Mmu1aJqy0y8F08NYCjz_D70vilLx9G5I0GwzbhL1w2apyr58UgTWfFCoyEumWwAPT_5jEMZEFbxFGBL8lKHDufPcaCD0r7hhVTJQk-EQJ3nL8ZwWE56HAQoDgwteQ7RqvbmQmN2QkHgdyJgN3h_vQg Sep 23 05:09:27.953480 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 05:09:27.953480 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 05:09:27.953480 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 05:09:27.953480 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 05:09:27.953480 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 05:09:27.953480 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 05:09:27.953480 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: daad67f26fe246d6b4d28cad1707a119 Sep 23 05:09:27.953480 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-AttachVolumeNegativeTest-1007727461 Sep 23 05:09:27.953480 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 05:09:27.953480 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 05:09:27.953480 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_daad67f26fe246d6b4d28cad1707a119", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/daad67f26fe246d6b4d28cad1707a119"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/daad67f26fe246d6b4d28cad1707a119"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/daad67f26fe246d6b4d28cad1707a119"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:09:27.953480 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-AttachVolumeNegativeTest-1007727461 Sep 23 05:09:27.953480 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: daad67f26fe246d6b4d28cad1707a119 Sep 23 05:09:27.953480 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1007727461 Sep 23 05:09:27.953480 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-AttachVolumeNegativeTest-1007727461-project Sep 23 05:09:27.953480 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 05:09:27.953480 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 05:09:27.953480 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 59d90150ed7d477fab33129cb3b068ed Sep 23 05:09:27.953480 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-AttachVolumeNegativeTest-1007727461-project Sep 23 05:09:27.953480 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 05:09:27.953480 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance f67681e5-fced-41b4-ae7c-7ce922f09df1 could not be found. Sep 23 05:09:27.953480 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': 'f67681e5-fced-41b4-ae7c-7ce922f09df1'} Sep 23 05:09:27.953480 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:09:27.953480 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:09:27.953480 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 05:09:27.953480 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 05:09:27.953480 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 05:09:27.953480 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 05:09:27.953480 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 05:09:27.953480 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 05:09:27.953480 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 05:09:27.953480 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 05:09:27.953480 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f67681e5-fced-41b4-ae7c-7ce922f09df1 could not be found. Sep 23 05:09:27.953480 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:09:27.953480 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:09:27.953480 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:09:27.953480 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:09:27.953480 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:09:27.953480 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:09:27.953480 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:09:27.953480 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:09:27.953480 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:09:27.953480 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:09:27.953480 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 05:09:27.953480 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 05:09:27.953480 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 05:09:27.953480 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 05:09:27.953480 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 05:09:27.953480 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 05:09:27.953480 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 05:09:27.953480 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:09:27.959512 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f67681e5-fced-41b4-ae7c-7ce922f09df1 could not be found. Sep 23 05:09:27.959512 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:09:27.959512 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:09:27.959512 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:09:27.959512 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:09:27.959512 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:09:27.959512 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:09:27.959512 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:09:27.959512 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:09:27.959512 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f67681e5-fced-41b4-ae7c-7ce922f09df1 could not be found. Sep 23 05:09:27.959512 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:09:27.959512 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1ae04a59-26a7-4376-867f-ce5244e79d15 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Returning 404 to user: Instance f67681e5-fced-41b4-ae7c-7ce922f09df1 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:09:27.974467 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-1ae04a59-26a7-4376-867f-ce5244e79d15 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f67681e5-fced-41b4-ae7c-7ce922f09df1" status: 404 len: 111 microversion: 2.1 time: 0.112792 Sep 23 05:09:27.977343 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3208/6588] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 05:09:27 2022] DELETE /compute/v2.1/servers/f67681e5-fced-41b4-ae7c-7ce922f09df1 => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 05:09:27.987308 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ec5a0b4d-8120-4a36-997c-3cefd2890cb3 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:09:27.993128 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-ec5a0b4d-8120-4a36-997c-3cefd2890cb3 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: f67681e5-fced-41b4-ae7c-7ce922f09df1] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:09:28.017586 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ec5a0b4d-8120-4a36-997c-3cefd2890cb3 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:28.027177 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ec5a0b4d-8120-4a36-997c-3cefd2890cb3 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:28.027177 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ec5a0b4d-8120-4a36-997c-3cefd2890cb3 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:28.027177 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ec5a0b4d-8120-4a36-997c-3cefd2890cb3 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:28.027177 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ec5a0b4d-8120-4a36-997c-3cefd2890cb3 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:28.027177 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ec5a0b4d-8120-4a36-997c-3cefd2890cb3 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:28.028169 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-23c9be85-0b7c-4939-95b0-e57529352ba8 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:09:28.039497 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-23c9be85-0b7c-4939-95b0-e57529352ba8 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb" status: 200 len: 1342 microversion: 2.1 time: 0.385133 Sep 23 05:09:28.054396 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3381/6589] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:09:27 2022] GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb => generated 1342 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:09:28.070782 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-ec5a0b4d-8120-4a36-997c-3cefd2890cb3 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] HTTP exception thrown: Instance f67681e5-fced-41b4-ae7c-7ce922f09df1 could not be found. Sep 23 05:09:28.073009 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ec5a0b4d-8120-4a36-997c-3cefd2890cb3 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Request method failure captured: Sep 23 05:09:28.073009 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/f67681e5-fced-41b4-ae7c-7ce922f09df1 HTTP/1.1 Sep 23 05:09:28.073009 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 05:09:28.073009 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 05:09:28.073009 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 05:09:28.073009 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 05:09:28.073009 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 05:09:28.073009 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 05:09:28.073009 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 05:09:28.073009 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 05:09:28.073009 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLT3a68wnGhJ1ri_wJa0c61-k-Mmu1aJqy0y8F08NYCjz_D70vilLx9G5I0GwzbhL1w2apyr58UgTWfFCoyEumWwAPT_5jEMZEFbxFGBL8lKHDufPcaCD0r7hhVTJQk-EQJ3nL8ZwWE56HAQoDgwteQ7RqvbmQmN2QkHgdyJgN3h_vQg Sep 23 05:09:28.073009 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 05:09:28.073009 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 05:09:28.073009 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 05:09:28.073009 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 05:09:28.073009 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 05:09:28.073009 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 05:09:28.073009 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: daad67f26fe246d6b4d28cad1707a119 Sep 23 05:09:28.073009 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-AttachVolumeNegativeTest-1007727461 Sep 23 05:09:28.073009 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 05:09:28.073009 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 05:09:28.073009 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_daad67f26fe246d6b4d28cad1707a119", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/daad67f26fe246d6b4d28cad1707a119"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/daad67f26fe246d6b4d28cad1707a119"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/daad67f26fe246d6b4d28cad1707a119"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:09:28.073009 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-AttachVolumeNegativeTest-1007727461 Sep 23 05:09:28.073009 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: daad67f26fe246d6b4d28cad1707a119 Sep 23 05:09:28.073009 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1007727461 Sep 23 05:09:28.073009 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-AttachVolumeNegativeTest-1007727461-project Sep 23 05:09:28.073009 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 05:09:28.073009 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 05:09:28.073009 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 59d90150ed7d477fab33129cb3b068ed Sep 23 05:09:28.073009 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-AttachVolumeNegativeTest-1007727461-project Sep 23 05:09:28.073009 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 05:09:28.073009 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance f67681e5-fced-41b4-ae7c-7ce922f09df1 could not be found. Sep 23 05:09:28.073009 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': 'f67681e5-fced-41b4-ae7c-7ce922f09df1'} Sep 23 05:09:28.073009 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:09:28.073009 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:09:28.073009 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 05:09:28.073009 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 05:09:28.073009 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 05:09:28.073009 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 05:09:28.073009 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 05:09:28.073009 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 05:09:28.073009 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 05:09:28.073009 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 05:09:28.073009 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f67681e5-fced-41b4-ae7c-7ce922f09df1 could not be found. Sep 23 05:09:28.073009 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:09:28.073009 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:09:28.073009 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:09:28.073009 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:09:28.073009 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:09:28.073009 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:09:28.073009 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:09:28.073009 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:09:28.073009 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:09:28.073009 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:09:28.073009 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 05:09:28.073009 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 05:09:28.073009 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 05:09:28.073009 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 05:09:28.073009 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 05:09:28.073009 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:09:28.073009 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f67681e5-fced-41b4-ae7c-7ce922f09df1 could not be found. Sep 23 05:09:28.073009 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:09:28.073009 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:09:28.073009 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:09:28.076679 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:09:28.076679 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:09:28.076679 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:09:28.076679 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:09:28.076679 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:09:28.076679 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f67681e5-fced-41b4-ae7c-7ce922f09df1 could not be found. Sep 23 05:09:28.076679 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:09:28.080922 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ec5a0b4d-8120-4a36-997c-3cefd2890cb3 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Returning 404 to user: Instance f67681e5-fced-41b4-ae7c-7ce922f09df1 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:09:28.082103 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ec5a0b4d-8120-4a36-997c-3cefd2890cb3 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/f67681e5-fced-41b4-ae7c-7ce922f09df1" status: 404 len: 111 microversion: 2.1 time: 0.098801 Sep 23 05:09:28.083250 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3209/6590] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:09:27 2022] GET /compute/v2.1/servers/f67681e5-fced-41b4-ae7c-7ce922f09df1 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 05:09:29.068700 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8a53df5e-2233-4ecb-a166-59ff1599fa1d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:09:29.069984 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-8a53df5e-2233-4ecb-a166-59ff1599fa1d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 7ad3508b-1d37-4c7b-82c7-be195566aacb] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:09:29.088818 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8a53df5e-2233-4ecb-a166-59ff1599fa1d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:29.091836 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8a53df5e-2233-4ecb-a166-59ff1599fa1d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:29.093227 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8a53df5e-2233-4ecb-a166-59ff1599fa1d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:29.100321 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8a53df5e-2233-4ecb-a166-59ff1599fa1d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:29.107994 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8a53df5e-2233-4ecb-a166-59ff1599fa1d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:29.108904 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8a53df5e-2233-4ecb-a166-59ff1599fa1d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:29.555419 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-8a53df5e-2233-4ecb-a166-59ff1599fa1d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:09:29.575163 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-8a53df5e-2233-4ecb-a166-59ff1599fa1d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb" status: 200 len: 1342 microversion: 2.1 time: 0.511256 Sep 23 05:09:29.579831 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3382/6591] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:09:29 2022] GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb => generated 1342 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:09:30.602917 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-98231ce7-8384-4bc5-a8c7-9aa67395f1d7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:09:30.603629 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-98231ce7-8384-4bc5-a8c7-9aa67395f1d7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 7ad3508b-1d37-4c7b-82c7-be195566aacb] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:09:30.613695 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-98231ce7-8384-4bc5-a8c7-9aa67395f1d7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:30.615023 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-98231ce7-8384-4bc5-a8c7-9aa67395f1d7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:30.615676 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-98231ce7-8384-4bc5-a8c7-9aa67395f1d7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:30.616671 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-98231ce7-8384-4bc5-a8c7-9aa67395f1d7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:30.617801 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-98231ce7-8384-4bc5-a8c7-9aa67395f1d7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:30.618906 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-98231ce7-8384-4bc5-a8c7-9aa67395f1d7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:31.173250 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-98231ce7-8384-4bc5-a8c7-9aa67395f1d7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:09:31.186095 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-98231ce7-8384-4bc5-a8c7-9aa67395f1d7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb" status: 200 len: 1342 microversion: 2.1 time: 0.588400 Sep 23 05:09:31.187512 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3210/6592] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:09:30 2022] GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb => generated 1342 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:09:32.214329 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ff851337-3e1d-4289-b843-44ff6e26f360 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:09:32.219888 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ff851337-3e1d-4289-b843-44ff6e26f360 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 7ad3508b-1d37-4c7b-82c7-be195566aacb] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:09:32.242718 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ff851337-3e1d-4289-b843-44ff6e26f360 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:32.248830 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ff851337-3e1d-4289-b843-44ff6e26f360 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:32.249343 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ff851337-3e1d-4289-b843-44ff6e26f360 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:32.254556 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ff851337-3e1d-4289-b843-44ff6e26f360 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:32.255095 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ff851337-3e1d-4289-b843-44ff6e26f360 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:32.255554 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ff851337-3e1d-4289-b843-44ff6e26f360 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:32.575846 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ff851337-3e1d-4289-b843-44ff6e26f360 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:09:32.588945 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ff851337-3e1d-4289-b843-44ff6e26f360 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb" status: 200 len: 1342 microversion: 2.1 time: 0.383740 Sep 23 05:09:32.591488 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3383/6593] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:09:32 2022] GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb => generated 1342 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:09:33.615057 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-dde2a514-462c-4ebe-9123-898578c33536 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:09:33.618971 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-dde2a514-462c-4ebe-9123-898578c33536 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 7ad3508b-1d37-4c7b-82c7-be195566aacb] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:09:33.623211 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dde2a514-462c-4ebe-9123-898578c33536 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:33.624210 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dde2a514-462c-4ebe-9123-898578c33536 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:33.624210 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dde2a514-462c-4ebe-9123-898578c33536 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:33.624903 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dde2a514-462c-4ebe-9123-898578c33536 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:33.625385 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dde2a514-462c-4ebe-9123-898578c33536 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:33.625836 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dde2a514-462c-4ebe-9123-898578c33536 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:33.834907 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-dde2a514-462c-4ebe-9123-898578c33536 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:09:33.845506 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-dde2a514-462c-4ebe-9123-898578c33536 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb" status: 200 len: 1342 microversion: 2.1 time: 0.233874 Sep 23 05:09:33.846991 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3211/6594] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:09:33 2022] GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb => generated 1342 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:09:34.869067 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4fdd68a6-9c9e-4e0e-b98c-42129e3ecfa0 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:09:34.869919 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4fdd68a6-9c9e-4e0e-b98c-42129e3ecfa0 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 7ad3508b-1d37-4c7b-82c7-be195566aacb] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:09:34.877024 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4fdd68a6-9c9e-4e0e-b98c-42129e3ecfa0 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:34.877668 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4fdd68a6-9c9e-4e0e-b98c-42129e3ecfa0 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:34.878313 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4fdd68a6-9c9e-4e0e-b98c-42129e3ecfa0 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:34.879364 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4fdd68a6-9c9e-4e0e-b98c-42129e3ecfa0 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:34.880621 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4fdd68a6-9c9e-4e0e-b98c-42129e3ecfa0 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:34.881340 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4fdd68a6-9c9e-4e0e-b98c-42129e3ecfa0 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:35.067505 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-4fdd68a6-9c9e-4e0e-b98c-42129e3ecfa0 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:09:35.080778 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4fdd68a6-9c9e-4e0e-b98c-42129e3ecfa0 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb" status: 200 len: 1342 microversion: 2.1 time: 0.215902 Sep 23 05:09:35.082118 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3384/6595] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:09:34 2022] GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb => generated 1342 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:09:36.108336 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0885692c-248a-4c4e-9da7-efcc10a98f93 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:09:36.108963 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-0885692c-248a-4c4e-9da7-efcc10a98f93 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 7ad3508b-1d37-4c7b-82c7-be195566aacb] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:09:36.144961 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0885692c-248a-4c4e-9da7-efcc10a98f93 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:36.148919 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0885692c-248a-4c4e-9da7-efcc10a98f93 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:36.153495 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0885692c-248a-4c4e-9da7-efcc10a98f93 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:36.159005 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0885692c-248a-4c4e-9da7-efcc10a98f93 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:36.160498 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0885692c-248a-4c4e-9da7-efcc10a98f93 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:36.165681 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0885692c-248a-4c4e-9da7-efcc10a98f93 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:36.221728 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3aee2133-20cc-486e-9a88-c581ffc2a757 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:09:36.221728 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-3aee2133-20cc-486e-9a88-c581ffc2a757 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 9984baa4-fc75-4d8f-a660-0647326196af] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:09:36.226270 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3aee2133-20cc-486e-9a88-c581ffc2a757 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:36.231661 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3aee2133-20cc-486e-9a88-c581ffc2a757 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:36.232708 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3aee2133-20cc-486e-9a88-c581ffc2a757 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:36.235494 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3aee2133-20cc-486e-9a88-c581ffc2a757 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:36.237336 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3aee2133-20cc-486e-9a88-c581ffc2a757 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:36.239913 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3aee2133-20cc-486e-9a88-c581ffc2a757 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:36.263277 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-3aee2133-20cc-486e-9a88-c581ffc2a757 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] HTTP exception thrown: Instance 9984baa4-fc75-4d8f-a660-0647326196af could not be found. Sep 23 05:09:36.264888 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3aee2133-20cc-486e-9a88-c581ffc2a757 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Request method failure captured: Sep 23 05:09:36.264888 n-d-846463-3 devstack@n-api.service[122699]: request: DELETE /compute/v2.1/servers/9984baa4-fc75-4d8f-a660-0647326196af HTTP/1.1 Sep 23 05:09:36.264888 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 05:09:36.264888 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 05:09:36.264888 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 05:09:36.264888 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 05:09:36.264888 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 05:09:36.264888 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 05:09:36.264888 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 05:09:36.264888 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 05:09:36.264888 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLT3a68wnGhJ1ri_wJa0c61-k-Mmu1aJqy0y8F08NYCjz_D70vilLx9G5I0GwzbhL1w2apyr58UgTWfFCoyEumWwAPT_5jEMZEFbxFGBL8lKHDufPcaCD0r7hhVTJQk-EQJ3nL8ZwWE56HAQoDgwteQ7RqvbmQmN2QkHgdyJgN3h_vQg Sep 23 05:09:36.264888 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 05:09:36.264888 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 05:09:36.264888 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 05:09:36.264888 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 05:09:36.264888 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 05:09:36.264888 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 05:09:36.264888 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: daad67f26fe246d6b4d28cad1707a119 Sep 23 05:09:36.264888 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-AttachVolumeNegativeTest-1007727461 Sep 23 05:09:36.264888 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 05:09:36.264888 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 05:09:36.264888 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_daad67f26fe246d6b4d28cad1707a119", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/daad67f26fe246d6b4d28cad1707a119"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/daad67f26fe246d6b4d28cad1707a119"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/daad67f26fe246d6b4d28cad1707a119"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:09:36.264888 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-AttachVolumeNegativeTest-1007727461 Sep 23 05:09:36.264888 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: daad67f26fe246d6b4d28cad1707a119 Sep 23 05:09:36.264888 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1007727461 Sep 23 05:09:36.264888 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-AttachVolumeNegativeTest-1007727461-project Sep 23 05:09:36.264888 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 05:09:36.264888 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 05:09:36.264888 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 59d90150ed7d477fab33129cb3b068ed Sep 23 05:09:36.264888 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-AttachVolumeNegativeTest-1007727461-project Sep 23 05:09:36.264888 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 05:09:36.264888 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 9984baa4-fc75-4d8f-a660-0647326196af could not be found. Sep 23 05:09:36.264888 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '9984baa4-fc75-4d8f-a660-0647326196af'} Sep 23 05:09:36.264888 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:09:36.264888 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:09:36.264888 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 05:09:36.264888 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 05:09:36.264888 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 05:09:36.264888 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 05:09:36.264888 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 05:09:36.264888 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 05:09:36.264888 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 05:09:36.264888 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 05:09:36.264888 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9984baa4-fc75-4d8f-a660-0647326196af could not be found. Sep 23 05:09:36.264888 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:09:36.264888 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:09:36.264888 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:09:36.264888 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:09:36.264888 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:09:36.264888 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:09:36.264888 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:09:36.264888 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:09:36.264888 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:09:36.264888 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:09:36.264888 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 05:09:36.264888 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 05:09:36.264888 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 05:09:36.264888 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 05:09:36.264888 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 05:09:36.264888 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 05:09:36.264888 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 05:09:36.264888 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:09:36.268729 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9984baa4-fc75-4d8f-a660-0647326196af could not be found. Sep 23 05:09:36.268729 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:09:36.268729 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:09:36.268729 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:09:36.268729 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:09:36.268729 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:09:36.268729 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:09:36.268729 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:09:36.268729 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:09:36.268729 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9984baa4-fc75-4d8f-a660-0647326196af could not be found. Sep 23 05:09:36.268729 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:09:36.268729 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3aee2133-20cc-486e-9a88-c581ffc2a757 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Returning 404 to user: Instance 9984baa4-fc75-4d8f-a660-0647326196af could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:09:36.276547 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3aee2133-20cc-486e-9a88-c581ffc2a757 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9984baa4-fc75-4d8f-a660-0647326196af" status: 404 len: 111 microversion: 2.1 time: 0.063620 Sep 23 05:09:36.280497 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3385/6596] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 05:09:36 2022] DELETE /compute/v2.1/servers/9984baa4-fc75-4d8f-a660-0647326196af => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 05:09:36.297516 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a65605de-c09c-45f6-b2ea-dd8660746d03 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:09:36.300694 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a65605de-c09c-45f6-b2ea-dd8660746d03 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] [instance: 9984baa4-fc75-4d8f-a660-0647326196af] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:09:36.314294 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a65605de-c09c-45f6-b2ea-dd8660746d03 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:36.315204 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a65605de-c09c-45f6-b2ea-dd8660746d03 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:36.315814 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a65605de-c09c-45f6-b2ea-dd8660746d03 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:36.316728 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a65605de-c09c-45f6-b2ea-dd8660746d03 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:36.317346 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a65605de-c09c-45f6-b2ea-dd8660746d03 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:36.318116 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a65605de-c09c-45f6-b2ea-dd8660746d03 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:36.335953 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-a65605de-c09c-45f6-b2ea-dd8660746d03 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] HTTP exception thrown: Instance 9984baa4-fc75-4d8f-a660-0647326196af could not be found. Sep 23 05:09:36.337701 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a65605de-c09c-45f6-b2ea-dd8660746d03 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Request method failure captured: Sep 23 05:09:36.337701 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/9984baa4-fc75-4d8f-a660-0647326196af HTTP/1.1 Sep 23 05:09:36.337701 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 05:09:36.337701 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 05:09:36.337701 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 05:09:36.337701 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 05:09:36.337701 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 05:09:36.337701 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 05:09:36.337701 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 05:09:36.337701 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 05:09:36.337701 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLT3a68wnGhJ1ri_wJa0c61-k-Mmu1aJqy0y8F08NYCjz_D70vilLx9G5I0GwzbhL1w2apyr58UgTWfFCoyEumWwAPT_5jEMZEFbxFGBL8lKHDufPcaCD0r7hhVTJQk-EQJ3nL8ZwWE56HAQoDgwteQ7RqvbmQmN2QkHgdyJgN3h_vQg Sep 23 05:09:36.337701 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 05:09:36.337701 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 05:09:36.337701 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 05:09:36.337701 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 05:09:36.337701 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 05:09:36.337701 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 05:09:36.337701 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: daad67f26fe246d6b4d28cad1707a119 Sep 23 05:09:36.337701 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-AttachVolumeNegativeTest-1007727461 Sep 23 05:09:36.337701 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 05:09:36.337701 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 05:09:36.337701 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_daad67f26fe246d6b4d28cad1707a119", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/daad67f26fe246d6b4d28cad1707a119"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/daad67f26fe246d6b4d28cad1707a119"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/daad67f26fe246d6b4d28cad1707a119"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:09:36.337701 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-AttachVolumeNegativeTest-1007727461 Sep 23 05:09:36.337701 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: daad67f26fe246d6b4d28cad1707a119 Sep 23 05:09:36.337701 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1007727461 Sep 23 05:09:36.337701 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-AttachVolumeNegativeTest-1007727461-project Sep 23 05:09:36.337701 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 05:09:36.337701 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 05:09:36.337701 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 59d90150ed7d477fab33129cb3b068ed Sep 23 05:09:36.337701 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-AttachVolumeNegativeTest-1007727461-project Sep 23 05:09:36.337701 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 05:09:36.337701 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 9984baa4-fc75-4d8f-a660-0647326196af could not be found. Sep 23 05:09:36.337701 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '9984baa4-fc75-4d8f-a660-0647326196af'} Sep 23 05:09:36.337701 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:09:36.337701 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:09:36.337701 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 05:09:36.337701 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 05:09:36.337701 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 05:09:36.337701 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 05:09:36.337701 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 05:09:36.337701 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 05:09:36.337701 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 05:09:36.337701 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 05:09:36.337701 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9984baa4-fc75-4d8f-a660-0647326196af could not be found. Sep 23 05:09:36.337701 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:09:36.337701 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:09:36.337701 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:09:36.337701 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:09:36.337701 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:09:36.337701 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:09:36.337701 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:09:36.337701 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:09:36.337701 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:09:36.337701 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:09:36.337701 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 05:09:36.337701 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 05:09:36.337701 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 05:09:36.337701 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 05:09:36.337701 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 05:09:36.337701 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:09:36.337701 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9984baa4-fc75-4d8f-a660-0647326196af could not be found. Sep 23 05:09:36.337701 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:09:36.337701 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:09:36.337701 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:09:36.341865 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:09:36.341865 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:09:36.341865 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:09:36.341865 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:09:36.341865 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:09:36.341865 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9984baa4-fc75-4d8f-a660-0647326196af could not be found. Sep 23 05:09:36.341865 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:09:36.343808 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a65605de-c09c-45f6-b2ea-dd8660746d03 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] Returning 404 to user: Instance 9984baa4-fc75-4d8f-a660-0647326196af could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:09:36.345387 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a65605de-c09c-45f6-b2ea-dd8660746d03 tempest-AttachVolumeNegativeTest-1007727461 tempest-AttachVolumeNegativeTest-1007727461-project] 10.222.0.33 "GET /compute/v2.1/servers/9984baa4-fc75-4d8f-a660-0647326196af" status: 404 len: 111 microversion: 2.1 time: 0.057362 Sep 23 05:09:36.346393 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3386/6597] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:09:36 2022] GET /compute/v2.1/servers/9984baa4-fc75-4d8f-a660-0647326196af => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 05:09:37.127786 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-0885692c-248a-4c4e-9da7-efcc10a98f93 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:09:37.146496 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0885692c-248a-4c4e-9da7-efcc10a98f93 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb" status: 200 len: 1342 microversion: 2.1 time: 1.042840 Sep 23 05:09:37.150316 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3212/6598] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:09:36 2022] GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb => generated 1342 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:09:38.173274 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1820620f-2cc5-46cd-8c56-a4336273fba5 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:09:38.173912 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1820620f-2cc5-46cd-8c56-a4336273fba5 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 7ad3508b-1d37-4c7b-82c7-be195566aacb] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:09:38.185107 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:09:38.194710 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1820620f-2cc5-46cd-8c56-a4336273fba5 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:38.196865 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1820620f-2cc5-46cd-8c56-a4336273fba5 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:38.200046 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1820620f-2cc5-46cd-8c56-a4336273fba5 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:38.205922 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1820620f-2cc5-46cd-8c56-a4336273fba5 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:38.212178 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1820620f-2cc5-46cd-8c56-a4336273fba5 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:38.212178 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1820620f-2cc5-46cd-8c56-a4336273fba5 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:38.857491 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1820620f-2cc5-46cd-8c56-a4336273fba5 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:09:38.867413 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1820620f-2cc5-46cd-8c56-a4336273fba5 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb" status: 200 len: 1342 microversion: 2.1 time: 0.698497 Sep 23 05:09:38.884377 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3387/6599] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:09:38 2022] GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb => generated 1342 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:09:39.891862 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c902d28f-cea0-41a7-b49c-bf2509ea30f7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:09:39.892626 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c902d28f-cea0-41a7-b49c-bf2509ea30f7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 7ad3508b-1d37-4c7b-82c7-be195566aacb] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:09:39.897165 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=45,nova_api:DELETE=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:09:39.906520 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c902d28f-cea0-41a7-b49c-bf2509ea30f7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:39.907043 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c902d28f-cea0-41a7-b49c-bf2509ea30f7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:39.914680 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c902d28f-cea0-41a7-b49c-bf2509ea30f7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:39.915982 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c902d28f-cea0-41a7-b49c-bf2509ea30f7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:39.916514 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c902d28f-cea0-41a7-b49c-bf2509ea30f7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:39.917029 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c902d28f-cea0-41a7-b49c-bf2509ea30f7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:40.444853 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c902d28f-cea0-41a7-b49c-bf2509ea30f7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:09:40.466014 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c902d28f-cea0-41a7-b49c-bf2509ea30f7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb" status: 200 len: 1342 microversion: 2.1 time: 0.578106 Sep 23 05:09:40.475256 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3213/6600] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:09:39 2022] GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb => generated 1342 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:09:41.512323 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0e337eef-aa69-4e64-a9ee-329975b0a5e9 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:09:41.513506 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-0e337eef-aa69-4e64-a9ee-329975b0a5e9 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 7ad3508b-1d37-4c7b-82c7-be195566aacb] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:09:41.541731 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0e337eef-aa69-4e64-a9ee-329975b0a5e9 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:41.542277 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0e337eef-aa69-4e64-a9ee-329975b0a5e9 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:41.542729 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0e337eef-aa69-4e64-a9ee-329975b0a5e9 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:41.543472 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0e337eef-aa69-4e64-a9ee-329975b0a5e9 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:41.543939 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0e337eef-aa69-4e64-a9ee-329975b0a5e9 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:41.544375 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0e337eef-aa69-4e64-a9ee-329975b0a5e9 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:41.836421 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-0e337eef-aa69-4e64-a9ee-329975b0a5e9 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:09:41.847497 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0e337eef-aa69-4e64-a9ee-329975b0a5e9 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb" status: 200 len: 1342 microversion: 2.1 time: 0.343601 Sep 23 05:09:41.864998 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3388/6601] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:09:41 2022] GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb => generated 1342 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:09:42.873982 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e80d8767-480b-4e5d-b5e4-ad8cfd6d9005 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:09:42.874638 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e80d8767-480b-4e5d-b5e4-ad8cfd6d9005 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 7ad3508b-1d37-4c7b-82c7-be195566aacb] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:09:42.890988 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e80d8767-480b-4e5d-b5e4-ad8cfd6d9005 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:42.891516 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e80d8767-480b-4e5d-b5e4-ad8cfd6d9005 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:42.892041 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e80d8767-480b-4e5d-b5e4-ad8cfd6d9005 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:42.892801 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e80d8767-480b-4e5d-b5e4-ad8cfd6d9005 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:42.893288 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e80d8767-480b-4e5d-b5e4-ad8cfd6d9005 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:42.893742 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e80d8767-480b-4e5d-b5e4-ad8cfd6d9005 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:43.188089 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e80d8767-480b-4e5d-b5e4-ad8cfd6d9005 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:09:43.199303 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e80d8767-480b-4e5d-b5e4-ad8cfd6d9005 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb" status: 200 len: 1342 microversion: 2.1 time: 0.330088 Sep 23 05:09:43.199906 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3214/6602] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:09:42 2022] GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb => generated 1342 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:09:44.225631 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-65c84d6d-334f-4d45-b297-54824310f4f8 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:09:44.226131 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-65c84d6d-334f-4d45-b297-54824310f4f8 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 7ad3508b-1d37-4c7b-82c7-be195566aacb] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:09:44.233120 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-65c84d6d-334f-4d45-b297-54824310f4f8 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:44.233962 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-65c84d6d-334f-4d45-b297-54824310f4f8 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:44.234971 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-65c84d6d-334f-4d45-b297-54824310f4f8 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:44.235875 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-65c84d6d-334f-4d45-b297-54824310f4f8 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:44.236699 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-65c84d6d-334f-4d45-b297-54824310f4f8 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:44.237300 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-65c84d6d-334f-4d45-b297-54824310f4f8 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:44.517078 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-65c84d6d-334f-4d45-b297-54824310f4f8 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:09:44.531954 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-65c84d6d-334f-4d45-b297-54824310f4f8 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb" status: 200 len: 1342 microversion: 2.1 time: 0.311257 Sep 23 05:09:44.532785 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3389/6603] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:09:44 2022] GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb => generated 1342 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:09:44.950739 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a921d21b-8bb8-4389-b5d1-e91ee4d10a4a tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:09:44.953196 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a921d21b-8bb8-4389-b5d1-e91ee4d10a4a tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:44.953946 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a921d21b-8bb8-4389-b5d1-e91ee4d10a4a tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:44.954582 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a921d21b-8bb8-4389-b5d1-e91ee4d10a4a tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:44.955341 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a921d21b-8bb8-4389-b5d1-e91ee4d10a4a tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:44.955834 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a921d21b-8bb8-4389-b5d1-e91ee4d10a4a tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:44.956439 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a921d21b-8bb8-4389-b5d1-e91ee4d10a4a tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:44.987142 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a921d21b-8bb8-4389-b5d1-e91ee4d10a4a tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] 10.222.0.33 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.244105 Sep 23 05:09:44.988063 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3215/6604] 10.222.0.33 () {58 vars in 1185 bytes} [Fri Sep 23 05:09:44 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:09:45.203815 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-45894ed3-9698-4d42-af04-8abbeadb13c1 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-541100054", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "availability_zone": "nova:n-h1-846463-3", "networks": [{"uuid": "b06aaec9-1bfc-44e2-96d5-ca5221a6df27"}]}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:09:45.305952 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.neutron [None req-45894ed3-9698-4d42-af04-8abbeadb13c1 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] validate_networks() for [('b06aaec9-1bfc-44e2-96d5-ca5221a6df27', None, None, None, None, None)] {{(pid=122699) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 05:09:45.557401 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3cd52be7-4251-4da6-8ddb-371abe70e0aa tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:09:45.558527 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3cd52be7-4251-4da6-8ddb-371abe70e0aa tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 7ad3508b-1d37-4c7b-82c7-be195566aacb] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:09:45.573838 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3cd52be7-4251-4da6-8ddb-371abe70e0aa tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:45.574613 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3cd52be7-4251-4da6-8ddb-371abe70e0aa tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:45.575447 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3cd52be7-4251-4da6-8ddb-371abe70e0aa tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:45.576957 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3cd52be7-4251-4da6-8ddb-371abe70e0aa tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:45.588059 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3cd52be7-4251-4da6-8ddb-371abe70e0aa tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:45.588059 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3cd52be7-4251-4da6-8ddb-371abe70e0aa tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:45.863436 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-3cd52be7-4251-4da6-8ddb-371abe70e0aa tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:09:45.872164 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3cd52be7-4251-4da6-8ddb-371abe70e0aa tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb" status: 200 len: 1342 microversion: 2.1 time: 0.318896 Sep 23 05:09:45.873185 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3216/6605] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:09:45 2022] GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb => generated 1342 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:09:46.269921 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-45894ed3-9698-4d42-af04-8abbeadb13c1 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Flavor limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 05:09:46.270399 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-45894ed3-9698-4d42-af04-8abbeadb13c1 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Image limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 05:09:46.271221 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-45894ed3-9698-4d42-af04-8abbeadb13c1 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Flavor pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 05:09:46.271640 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-45894ed3-9698-4d42-af04-8abbeadb13c1 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Image pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 05:09:46.272055 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-45894ed3-9698-4d42-af04-8abbeadb13c1 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 05:09:46.284940 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-45894ed3-9698-4d42-af04-8abbeadb13c1 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:46.285869 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-45894ed3-9698-4d42-af04-8abbeadb13c1 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:46.287093 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-45894ed3-9698-4d42-af04-8abbeadb13c1 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:46.288526 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-45894ed3-9698-4d42-af04-8abbeadb13c1 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:46.289149 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-45894ed3-9698-4d42-af04-8abbeadb13c1 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:46.289740 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-45894ed3-9698-4d42-af04-8abbeadb13c1 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:46.312422 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-45894ed3-9698-4d42-af04-8abbeadb13c1 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Getting quotas for project 101ce576f12c41519e9120f803ce1064. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 05:09:46.322778 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-45894ed3-9698-4d42-af04-8abbeadb13c1 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Getting quotas for user 3c490bfc9eee403f9448b6967a2e5665 and project 101ce576f12c41519e9120f803ce1064. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 05:09:46.353789 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-45894ed3-9698-4d42-af04-8abbeadb13c1 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Going to run 1 instances... {{(pid=122699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 05:09:46.358268 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-45894ed3-9698-4d42-af04-8abbeadb13c1 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] [instance: a8c3a4c4-20d7-4d1b-beae-e013b32a74aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 05:09:46.524071 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-45894ed3-9698-4d42-af04-8abbeadb13c1 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.323901 Sep 23 05:09:46.528278 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3390/6606] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 05:09:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1329 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 05:09:46.541671 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-55d6c559-5a70-41fd-adb5-31d53c5aaf5a tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:09:46.542437 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-55d6c559-5a70-41fd-adb5-31d53c5aaf5a tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] [instance: a8c3a4c4-20d7-4d1b-beae-e013b32a74aa] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:09:46.609403 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-55d6c559-5a70-41fd-adb5-31d53c5aaf5a tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/a8c3a4c4-20d7-4d1b-beae-e013b32a74aa" status: 200 len: 1328 microversion: 2.1 time: 0.071570 Sep 23 05:09:46.611463 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3217/6607] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:09:46 2022] GET /compute/v2.1/servers/a8c3a4c4-20d7-4d1b-beae-e013b32a74aa => generated 1328 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:09:46.910011 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-16b0ec11-83f1-49c0-b468-d4fa1659c4d1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:09:46.915378 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-16b0ec11-83f1-49c0-b468-d4fa1659c4d1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 7ad3508b-1d37-4c7b-82c7-be195566aacb] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:09:46.936807 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-16b0ec11-83f1-49c0-b468-d4fa1659c4d1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:46.937867 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-16b0ec11-83f1-49c0-b468-d4fa1659c4d1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:46.938547 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-16b0ec11-83f1-49c0-b468-d4fa1659c4d1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:46.939516 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-16b0ec11-83f1-49c0-b468-d4fa1659c4d1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:46.940485 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-16b0ec11-83f1-49c0-b468-d4fa1659c4d1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:46.941093 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-16b0ec11-83f1-49c0-b468-d4fa1659c4d1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:47.104672 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-16b0ec11-83f1-49c0-b468-d4fa1659c4d1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:09:47.110741 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-16b0ec11-83f1-49c0-b468-d4fa1659c4d1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb" status: 200 len: 1342 microversion: 2.1 time: 0.218475 Sep 23 05:09:47.111310 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3391/6608] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:09:46 2022] GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb => generated 1342 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:09:47.638918 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-272efc66-1056-4787-8b2c-dbdd6f9f9f3c tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:09:47.640383 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-272efc66-1056-4787-8b2c-dbdd6f9f9f3c tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] [instance: a8c3a4c4-20d7-4d1b-beae-e013b32a74aa] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:09:47.751721 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-272efc66-1056-4787-8b2c-dbdd6f9f9f3c tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/a8c3a4c4-20d7-4d1b-beae-e013b32a74aa" status: 200 len: 1328 microversion: 2.1 time: 0.119732 Sep 23 05:09:47.752343 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3218/6609] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:09:47 2022] GET /compute/v2.1/servers/a8c3a4c4-20d7-4d1b-beae-e013b32a74aa => generated 1328 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:09:48.138031 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-fc9b04a6-20f3-4fe2-95cb-e4161abf0f41 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:09:48.138743 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-fc9b04a6-20f3-4fe2-95cb-e4161abf0f41 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 7ad3508b-1d37-4c7b-82c7-be195566aacb] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:09:48.150871 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fc9b04a6-20f3-4fe2-95cb-e4161abf0f41 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:48.159686 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fc9b04a6-20f3-4fe2-95cb-e4161abf0f41 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:48.159686 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fc9b04a6-20f3-4fe2-95cb-e4161abf0f41 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:48.159686 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fc9b04a6-20f3-4fe2-95cb-e4161abf0f41 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:48.159686 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fc9b04a6-20f3-4fe2-95cb-e4161abf0f41 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:48.159686 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fc9b04a6-20f3-4fe2-95cb-e4161abf0f41 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:48.355648 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-fc9b04a6-20f3-4fe2-95cb-e4161abf0f41 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:09:48.364280 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-fc9b04a6-20f3-4fe2-95cb-e4161abf0f41 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb" status: 200 len: 1342 microversion: 2.1 time: 0.233668 Sep 23 05:09:48.364877 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3392/6610] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:09:48 2022] GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb => generated 1342 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:09:48.776104 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-90230cf0-af03-4522-ae3f-5ae23ea95b06 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:09:48.776737 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-90230cf0-af03-4522-ae3f-5ae23ea95b06 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] [instance: a8c3a4c4-20d7-4d1b-beae-e013b32a74aa] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:09:48.783902 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-90230cf0-af03-4522-ae3f-5ae23ea95b06 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:48.784418 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-90230cf0-af03-4522-ae3f-5ae23ea95b06 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:48.784877 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-90230cf0-af03-4522-ae3f-5ae23ea95b06 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:48.785802 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-90230cf0-af03-4522-ae3f-5ae23ea95b06 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:48.787042 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-90230cf0-af03-4522-ae3f-5ae23ea95b06 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:48.787498 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-90230cf0-af03-4522-ae3f-5ae23ea95b06 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:48.909515 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-90230cf0-af03-4522-ae3f-5ae23ea95b06 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/a8c3a4c4-20d7-4d1b-beae-e013b32a74aa" status: 200 len: 1345 microversion: 2.1 time: 0.137257 Sep 23 05:09:48.925654 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3219/6611] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:09:48 2022] GET /compute/v2.1/servers/a8c3a4c4-20d7-4d1b-beae-e013b32a74aa => generated 1345 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:09:49.392930 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-92ea4362-903a-4220-bad1-ff58dc19b08a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:09:49.393557 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-92ea4362-903a-4220-bad1-ff58dc19b08a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 7ad3508b-1d37-4c7b-82c7-be195566aacb] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:09:49.408703 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-92ea4362-903a-4220-bad1-ff58dc19b08a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:49.409211 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-92ea4362-903a-4220-bad1-ff58dc19b08a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:49.409657 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-92ea4362-903a-4220-bad1-ff58dc19b08a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:49.410418 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-92ea4362-903a-4220-bad1-ff58dc19b08a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:49.410883 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-92ea4362-903a-4220-bad1-ff58dc19b08a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:49.412082 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-92ea4362-903a-4220-bad1-ff58dc19b08a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:49.565849 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-92ea4362-903a-4220-bad1-ff58dc19b08a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:09:49.574252 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-92ea4362-903a-4220-bad1-ff58dc19b08a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb" status: 200 len: 1342 microversion: 2.1 time: 0.188278 Sep 23 05:09:49.574833 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3393/6612] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:09:49 2022] GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb => generated 1342 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:09:49.933119 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e1076c55-4609-4b68-851e-e883b381a9e9 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:09:49.936285 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e1076c55-4609-4b68-851e-e883b381a9e9 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] [instance: a8c3a4c4-20d7-4d1b-beae-e013b32a74aa] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:09:49.941842 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e1076c55-4609-4b68-851e-e883b381a9e9 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:49.942838 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e1076c55-4609-4b68-851e-e883b381a9e9 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:49.943298 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e1076c55-4609-4b68-851e-e883b381a9e9 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:49.944159 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e1076c55-4609-4b68-851e-e883b381a9e9 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:49.944556 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e1076c55-4609-4b68-851e-e883b381a9e9 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:49.945015 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e1076c55-4609-4b68-851e-e883b381a9e9 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:50.026235 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e1076c55-4609-4b68-851e-e883b381a9e9 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/a8c3a4c4-20d7-4d1b-beae-e013b32a74aa" status: 200 len: 1415 microversion: 2.1 time: 0.097332 Sep 23 05:09:50.026863 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3220/6613] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:09:49 2022] GET /compute/v2.1/servers/a8c3a4c4-20d7-4d1b-beae-e013b32a74aa => generated 1415 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:09:50.597930 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-04a3ffb3-66bd-446f-a0fd-cca6f6a56fbf tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:09:50.599154 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-04a3ffb3-66bd-446f-a0fd-cca6f6a56fbf tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 7ad3508b-1d37-4c7b-82c7-be195566aacb] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:09:50.605778 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-04a3ffb3-66bd-446f-a0fd-cca6f6a56fbf tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:50.606315 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-04a3ffb3-66bd-446f-a0fd-cca6f6a56fbf tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:50.609749 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-04a3ffb3-66bd-446f-a0fd-cca6f6a56fbf tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:50.609749 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-04a3ffb3-66bd-446f-a0fd-cca6f6a56fbf tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:50.609749 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-04a3ffb3-66bd-446f-a0fd-cca6f6a56fbf tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:50.609749 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-04a3ffb3-66bd-446f-a0fd-cca6f6a56fbf tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:50.816213 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-04a3ffb3-66bd-446f-a0fd-cca6f6a56fbf tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:09:50.824426 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-04a3ffb3-66bd-446f-a0fd-cca6f6a56fbf tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb" status: 200 len: 1342 microversion: 2.1 time: 0.230306 Sep 23 05:09:50.825011 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3394/6614] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:09:50 2022] GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb => generated 1342 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:09:51.050209 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-312b5b2c-9db5-4d88-9015-72424f2cc214 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:09:51.050843 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-312b5b2c-9db5-4d88-9015-72424f2cc214 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] [instance: a8c3a4c4-20d7-4d1b-beae-e013b32a74aa] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:09:51.058660 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-312b5b2c-9db5-4d88-9015-72424f2cc214 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:51.059188 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-312b5b2c-9db5-4d88-9015-72424f2cc214 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:51.060026 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-312b5b2c-9db5-4d88-9015-72424f2cc214 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:51.061283 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-312b5b2c-9db5-4d88-9015-72424f2cc214 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:51.061990 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-312b5b2c-9db5-4d88-9015-72424f2cc214 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:51.062590 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-312b5b2c-9db5-4d88-9015-72424f2cc214 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:51.155552 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-312b5b2c-9db5-4d88-9015-72424f2cc214 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/a8c3a4c4-20d7-4d1b-beae-e013b32a74aa" status: 200 len: 1421 microversion: 2.1 time: 0.109049 Sep 23 05:09:51.156200 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3221/6615] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:09:51 2022] GET /compute/v2.1/servers/a8c3a4c4-20d7-4d1b-beae-e013b32a74aa => generated 1421 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:09:51.847398 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ec81a400-1e97-4b15-8ac2-c05dd8e8fee4 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:09:51.848021 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ec81a400-1e97-4b15-8ac2-c05dd8e8fee4 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 7ad3508b-1d37-4c7b-82c7-be195566aacb] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:09:51.855330 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ec81a400-1e97-4b15-8ac2-c05dd8e8fee4 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:51.856249 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ec81a400-1e97-4b15-8ac2-c05dd8e8fee4 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:51.856705 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ec81a400-1e97-4b15-8ac2-c05dd8e8fee4 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:51.857413 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ec81a400-1e97-4b15-8ac2-c05dd8e8fee4 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:51.857904 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ec81a400-1e97-4b15-8ac2-c05dd8e8fee4 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:51.858356 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ec81a400-1e97-4b15-8ac2-c05dd8e8fee4 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:52.005471 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ec81a400-1e97-4b15-8ac2-c05dd8e8fee4 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:09:52.015032 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ec81a400-1e97-4b15-8ac2-c05dd8e8fee4 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb" status: 200 len: 1342 microversion: 2.1 time: 0.171476 Sep 23 05:09:52.015759 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3395/6616] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:09:51 2022] GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb => generated 1342 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:09:52.183647 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6dcb6df8-4d8f-440c-a3c0-fb81f4b9c499 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:09:52.188601 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-6dcb6df8-4d8f-440c-a3c0-fb81f4b9c499 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] [instance: a8c3a4c4-20d7-4d1b-beae-e013b32a74aa] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:09:52.200470 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6dcb6df8-4d8f-440c-a3c0-fb81f4b9c499 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:52.202120 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6dcb6df8-4d8f-440c-a3c0-fb81f4b9c499 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:52.202120 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6dcb6df8-4d8f-440c-a3c0-fb81f4b9c499 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:52.202514 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6dcb6df8-4d8f-440c-a3c0-fb81f4b9c499 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:52.203005 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6dcb6df8-4d8f-440c-a3c0-fb81f4b9c499 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:52.203449 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6dcb6df8-4d8f-440c-a3c0-fb81f4b9c499 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:52.403427 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-6dcb6df8-4d8f-440c-a3c0-fb81f4b9c499 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/a8c3a4c4-20d7-4d1b-beae-e013b32a74aa" status: 200 len: 1463 microversion: 2.1 time: 0.226525 Sep 23 05:09:52.403996 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3222/6617] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:09:52 2022] GET /compute/v2.1/servers/a8c3a4c4-20d7-4d1b-beae-e013b32a74aa => generated 1463 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:09:52.489004 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-7d236a8a-0958-4808-a517-fb26811224cb req-7bf4aa0c-a0c0-47ef-bfc4-435221661ac5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8c3a4c4-20d7-4d1b-beae-e013b32a74aa", "tag": "fc484bc1-2e91-4100-97ee-985c85d519f2"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:09:52.505705 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-7d236a8a-0958-4808-a517-fb26811224cb req-7bf4aa0c-a0c0-47ef-bfc4-435221661ac5 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:52.506374 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-7d236a8a-0958-4808-a517-fb26811224cb req-7bf4aa0c-a0c0-47ef-bfc4-435221661ac5 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:52.506812 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-7d236a8a-0958-4808-a517-fb26811224cb req-7bf4aa0c-a0c0-47ef-bfc4-435221661ac5 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:52.520189 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-7d236a8a-0958-4808-a517-fb26811224cb req-7bf4aa0c-a0c0-47ef-bfc4-435221661ac5 service nova] Creating event network-changed:fc484bc1-2e91-4100-97ee-985c85d519f2 for instance a8c3a4c4-20d7-4d1b-beae-e013b32a74aa on n-h1-846463-3 Sep 23 05:09:52.525662 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-7d236a8a-0958-4808-a517-fb26811224cb req-7bf4aa0c-a0c0-47ef-bfc4-435221661ac5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042212 Sep 23 05:09:52.526297 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3396/6618] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:09:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 05:09:53.040586 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5b628f16-de05-4fc2-bf10-390e2a25bd24 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:09:53.041207 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-5b628f16-de05-4fc2-bf10-390e2a25bd24 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 7ad3508b-1d37-4c7b-82c7-be195566aacb] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:09:53.052059 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2fbfd897-8e31-4c4d-9909-a84ff8c41273 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:09:53.053272 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-2fbfd897-8e31-4c4d-9909-a84ff8c41273 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] [instance: 928fb88c-a689-46ee-a069-de58089ceba6] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:09:53.062865 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5b628f16-de05-4fc2-bf10-390e2a25bd24 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:53.063634 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5b628f16-de05-4fc2-bf10-390e2a25bd24 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:53.072986 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5b628f16-de05-4fc2-bf10-390e2a25bd24 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:53.076037 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5b628f16-de05-4fc2-bf10-390e2a25bd24 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:53.076892 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5b628f16-de05-4fc2-bf10-390e2a25bd24 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:53.077562 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5b628f16-de05-4fc2-bf10-390e2a25bd24 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:53.081541 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2fbfd897-8e31-4c4d-9909-a84ff8c41273 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:53.083659 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2fbfd897-8e31-4c4d-9909-a84ff8c41273 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:53.084503 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2fbfd897-8e31-4c4d-9909-a84ff8c41273 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:53.087682 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2fbfd897-8e31-4c4d-9909-a84ff8c41273 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:53.089006 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2fbfd897-8e31-4c4d-9909-a84ff8c41273 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:53.090741 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2fbfd897-8e31-4c4d-9909-a84ff8c41273 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:53.284965 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-2fbfd897-8e31-4c4d-9909-a84ff8c41273 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] [instance: 928fb88c-a689-46ee-a069-de58089ceba6] Going to try to terminate instance {{(pid=122698) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 05:09:53.420504 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-5b628f16-de05-4fc2-bf10-390e2a25bd24 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:09:53.429138 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5b628f16-de05-4fc2-bf10-390e2a25bd24 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb" status: 200 len: 1342 microversion: 2.1 time: 0.393289 Sep 23 05:09:53.429707 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3397/6619] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:09:53 2022] GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb => generated 1342 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:09:53.435083 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a5e589a1-0e90-40aa-8a7f-2650a8ea65a0 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:09:53.448417 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a5e589a1-0e90-40aa-8a7f-2650a8ea65a0 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] [instance: a8c3a4c4-20d7-4d1b-beae-e013b32a74aa] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:09:53.448417 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a5e589a1-0e90-40aa-8a7f-2650a8ea65a0 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:53.448417 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a5e589a1-0e90-40aa-8a7f-2650a8ea65a0 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:53.448417 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a5e589a1-0e90-40aa-8a7f-2650a8ea65a0 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:53.448417 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a5e589a1-0e90-40aa-8a7f-2650a8ea65a0 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:53.448417 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a5e589a1-0e90-40aa-8a7f-2650a8ea65a0 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:53.448417 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a5e589a1-0e90-40aa-8a7f-2650a8ea65a0 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:53.599662 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a5e589a1-0e90-40aa-8a7f-2650a8ea65a0 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/a8c3a4c4-20d7-4d1b-beae-e013b32a74aa" status: 200 len: 1463 microversion: 2.1 time: 0.168889 Sep 23 05:09:53.600233 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3398/6620] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:09:53 2022] GET /compute/v2.1/servers/a8c3a4c4-20d7-4d1b-beae-e013b32a74aa => generated 1463 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:09:53.871029 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2fbfd897-8e31-4c4d-9909-a84ff8c41273 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] 10.222.0.33 "DELETE /compute/v2.1/servers/928fb88c-a689-46ee-a069-de58089ceba6" status: 204 len: 0 microversion: 2.1 time: 1.038157 Sep 23 05:09:53.874880 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3223/6621] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 05:09:52 2022] DELETE /compute/v2.1/servers/928fb88c-a689-46ee-a069-de58089ceba6 => generated 0 bytes in 1040 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 05:09:53.881651 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-53086d05-186f-4bfb-a4d3-faf8dc71b853 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:09:53.881651 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-53086d05-186f-4bfb-a4d3-faf8dc71b853 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] [instance: 928fb88c-a689-46ee-a069-de58089ceba6] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:09:53.888958 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-53086d05-186f-4bfb-a4d3-faf8dc71b853 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:53.889872 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-53086d05-186f-4bfb-a4d3-faf8dc71b853 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:53.890920 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-53086d05-186f-4bfb-a4d3-faf8dc71b853 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:53.892091 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-53086d05-186f-4bfb-a4d3-faf8dc71b853 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:53.892767 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-53086d05-186f-4bfb-a4d3-faf8dc71b853 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:53.893670 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-53086d05-186f-4bfb-a4d3-faf8dc71b853 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:53.916065 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=100 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:09:54.042488 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-53086d05-186f-4bfb-a4d3-faf8dc71b853 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc338a28098d48bc931a2c29213d1dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3384c4863e35469b96482ce27d56a36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:09:54.052360 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-53086d05-186f-4bfb-a4d3-faf8dc71b853 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] 10.222.0.33 "GET /compute/v2.1/servers/928fb88c-a689-46ee-a069-de58089ceba6" status: 200 len: 1733 microversion: 2.1 time: 0.175419 Sep 23 05:09:54.056104 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3399/6622] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:09:53 2022] GET /compute/v2.1/servers/928fb88c-a689-46ee-a069-de58089ceba6 => generated 1733 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:09:54.454944 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-eb155b3d-228f-4145-9bc9-dd3375a831b0 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:09:54.455695 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-eb155b3d-228f-4145-9bc9-dd3375a831b0 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 7ad3508b-1d37-4c7b-82c7-be195566aacb] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:09:54.462599 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-eb155b3d-228f-4145-9bc9-dd3375a831b0 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:54.463109 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-eb155b3d-228f-4145-9bc9-dd3375a831b0 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:54.463568 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-eb155b3d-228f-4145-9bc9-dd3375a831b0 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:54.464280 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-eb155b3d-228f-4145-9bc9-dd3375a831b0 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:54.464758 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-eb155b3d-228f-4145-9bc9-dd3375a831b0 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:54.465206 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-eb155b3d-228f-4145-9bc9-dd3375a831b0 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:54.610417 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-eb155b3d-228f-4145-9bc9-dd3375a831b0 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:09:54.620511 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-eb155b3d-228f-4145-9bc9-dd3375a831b0 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb" status: 200 len: 1342 microversion: 2.1 time: 0.170047 Sep 23 05:09:54.621100 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3224/6623] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:09:54 2022] GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb => generated 1342 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:09:54.622359 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6c5d6cd6-c938-4e79-b0c1-2b2e34a977c9 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:09:54.622978 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-6c5d6cd6-c938-4e79-b0c1-2b2e34a977c9 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] [instance: a8c3a4c4-20d7-4d1b-beae-e013b32a74aa] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:09:54.634391 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6c5d6cd6-c938-4e79-b0c1-2b2e34a977c9 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:54.634882 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6c5d6cd6-c938-4e79-b0c1-2b2e34a977c9 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:54.635318 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6c5d6cd6-c938-4e79-b0c1-2b2e34a977c9 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:54.636015 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6c5d6cd6-c938-4e79-b0c1-2b2e34a977c9 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:54.636496 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6c5d6cd6-c938-4e79-b0c1-2b2e34a977c9 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:54.636916 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6c5d6cd6-c938-4e79-b0c1-2b2e34a977c9 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:54.782372 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6c5d6cd6-c938-4e79-b0c1-2b2e34a977c9 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/a8c3a4c4-20d7-4d1b-beae-e013b32a74aa" status: 200 len: 1463 microversion: 2.1 time: 0.163928 Sep 23 05:09:54.783085 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3400/6624] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:09:54 2022] GET /compute/v2.1/servers/a8c3a4c4-20d7-4d1b-beae-e013b32a74aa => generated 1463 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:09:55.077590 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-79ea0f8f-4ecf-4409-837f-dee9717baa6a tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:09:55.078173 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-79ea0f8f-4ecf-4409-837f-dee9717baa6a tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] [instance: 928fb88c-a689-46ee-a069-de58089ceba6] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:09:55.080150 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:09:55.086178 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-79ea0f8f-4ecf-4409-837f-dee9717baa6a tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:55.086726 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-79ea0f8f-4ecf-4409-837f-dee9717baa6a tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:55.087410 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-79ea0f8f-4ecf-4409-837f-dee9717baa6a tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:55.088587 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-79ea0f8f-4ecf-4409-837f-dee9717baa6a tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:55.089076 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-79ea0f8f-4ecf-4409-837f-dee9717baa6a tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:55.089577 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-79ea0f8f-4ecf-4409-837f-dee9717baa6a tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:55.348357 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-79ea0f8f-4ecf-4409-837f-dee9717baa6a tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc338a28098d48bc931a2c29213d1dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3384c4863e35469b96482ce27d56a36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:09:55.348357 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-79ea0f8f-4ecf-4409-837f-dee9717baa6a tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] 10.222.0.33 "GET /compute/v2.1/servers/928fb88c-a689-46ee-a069-de58089ceba6" status: 200 len: 1733 microversion: 2.1 time: 0.258117 Sep 23 05:09:55.348357 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3225/6625] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:09:55 2022] GET /compute/v2.1/servers/928fb88c-a689-46ee-a069-de58089ceba6 => generated 1733 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:09:55.643648 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3e2221b2-75e7-4374-8d2b-e197c81f0e0f tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:09:55.644262 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-3e2221b2-75e7-4374-8d2b-e197c81f0e0f tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 7ad3508b-1d37-4c7b-82c7-be195566aacb] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:09:55.651456 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3e2221b2-75e7-4374-8d2b-e197c81f0e0f tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:55.651946 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3e2221b2-75e7-4374-8d2b-e197c81f0e0f tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:55.652494 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3e2221b2-75e7-4374-8d2b-e197c81f0e0f tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:55.653123 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3e2221b2-75e7-4374-8d2b-e197c81f0e0f tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:55.653517 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3e2221b2-75e7-4374-8d2b-e197c81f0e0f tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:55.653969 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3e2221b2-75e7-4374-8d2b-e197c81f0e0f tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:55.806439 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-43f521b5-2dc7-4dea-a4b7-cf8f8462c08c tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:09:55.807715 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-43f521b5-2dc7-4dea-a4b7-cf8f8462c08c tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] [instance: a8c3a4c4-20d7-4d1b-beae-e013b32a74aa] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:09:55.808144 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-3e2221b2-75e7-4374-8d2b-e197c81f0e0f tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:09:55.816595 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-43f521b5-2dc7-4dea-a4b7-cf8f8462c08c tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:55.816595 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-43f521b5-2dc7-4dea-a4b7-cf8f8462c08c tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:55.816595 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-43f521b5-2dc7-4dea-a4b7-cf8f8462c08c tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:55.816838 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3e2221b2-75e7-4374-8d2b-e197c81f0e0f tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb" status: 200 len: 1342 microversion: 2.1 time: 0.176572 Sep 23 05:09:55.817011 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-43f521b5-2dc7-4dea-a4b7-cf8f8462c08c tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:55.817114 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3401/6626] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:09:55 2022] GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb => generated 1342 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:09:55.817785 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-43f521b5-2dc7-4dea-a4b7-cf8f8462c08c tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:55.822462 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-43f521b5-2dc7-4dea-a4b7-cf8f8462c08c tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:56.016355 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:09:56.031922 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-43f521b5-2dc7-4dea-a4b7-cf8f8462c08c tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/a8c3a4c4-20d7-4d1b-beae-e013b32a74aa" status: 200 len: 1463 microversion: 2.1 time: 0.229630 Sep 23 05:09:56.036489 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3226/6627] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:09:55 2022] GET /compute/v2.1/servers/a8c3a4c4-20d7-4d1b-beae-e013b32a74aa => generated 1463 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:09:56.355184 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7ef9f401-4906-495c-9075-47864af3f67a tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:09:56.355841 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-7ef9f401-4906-495c-9075-47864af3f67a tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] [instance: 928fb88c-a689-46ee-a069-de58089ceba6] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:09:56.357717 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:09:56.358542 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=6 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:09:56.366800 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7ef9f401-4906-495c-9075-47864af3f67a tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:56.367496 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7ef9f401-4906-495c-9075-47864af3f67a tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:56.368311 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7ef9f401-4906-495c-9075-47864af3f67a tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:56.369704 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7ef9f401-4906-495c-9075-47864af3f67a tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:56.370489 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7ef9f401-4906-495c-9075-47864af3f67a tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:56.371554 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7ef9f401-4906-495c-9075-47864af3f67a tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:56.559469 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-7ef9f401-4906-495c-9075-47864af3f67a tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc338a28098d48bc931a2c29213d1dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3384c4863e35469b96482ce27d56a36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:09:56.570157 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-7ef9f401-4906-495c-9075-47864af3f67a tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] 10.222.0.33 "GET /compute/v2.1/servers/928fb88c-a689-46ee-a069-de58089ceba6" status: 200 len: 1733 microversion: 2.1 time: 0.218687 Sep 23 05:09:56.573225 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3402/6628] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:09:56 2022] GET /compute/v2.1/servers/928fb88c-a689-46ee-a069-de58089ceba6 => generated 1733 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:09:56.840582 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2c492cea-b431-472f-a009-4a93a0392422 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:09:56.841118 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-2c492cea-b431-472f-a009-4a93a0392422 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 7ad3508b-1d37-4c7b-82c7-be195566aacb] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:09:56.848699 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2c492cea-b431-472f-a009-4a93a0392422 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:56.849203 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2c492cea-b431-472f-a009-4a93a0392422 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:56.849658 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2c492cea-b431-472f-a009-4a93a0392422 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:56.851102 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2c492cea-b431-472f-a009-4a93a0392422 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:56.851102 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2c492cea-b431-472f-a009-4a93a0392422 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:56.851313 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2c492cea-b431-472f-a009-4a93a0392422 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:57.034896 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-2c492cea-b431-472f-a009-4a93a0392422 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:09:57.043280 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2c492cea-b431-472f-a009-4a93a0392422 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb" status: 200 len: 1342 microversion: 2.1 time: 0.206731 Sep 23 05:09:57.052540 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3227/6629] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:09:56 2022] GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb => generated 1342 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:09:57.069414 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d25dd38e-a143-473c-bfbf-fd63c6dfdd5c tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:09:57.069414 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d25dd38e-a143-473c-bfbf-fd63c6dfdd5c tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] [instance: a8c3a4c4-20d7-4d1b-beae-e013b32a74aa] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:09:57.075447 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d25dd38e-a143-473c-bfbf-fd63c6dfdd5c tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:57.076039 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d25dd38e-a143-473c-bfbf-fd63c6dfdd5c tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:57.076557 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d25dd38e-a143-473c-bfbf-fd63c6dfdd5c tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:57.077372 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d25dd38e-a143-473c-bfbf-fd63c6dfdd5c tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:57.078031 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d25dd38e-a143-473c-bfbf-fd63c6dfdd5c tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:57.078466 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d25dd38e-a143-473c-bfbf-fd63c6dfdd5c tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:57.235122 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d25dd38e-a143-473c-bfbf-fd63c6dfdd5c tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/a8c3a4c4-20d7-4d1b-beae-e013b32a74aa" status: 200 len: 1463 microversion: 2.1 time: 0.172034 Sep 23 05:09:57.235744 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3403/6630] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:09:57 2022] GET /compute/v2.1/servers/a8c3a4c4-20d7-4d1b-beae-e013b32a74aa => generated 1463 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:09:57.363887 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-460d5167-0aec-4dac-9921-7c803ea3d904 req-d5ca5b9d-d3d6-4fec-bd30-c76e0e9cad1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "928fb88c-a689-46ee-a069-de58089ceba6", "name": "network-vif-deleted", "tag": "138b0b6f-3e79-4ed9-a4e8-3cf14b605b8d"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:09:57.392423 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-460d5167-0aec-4dac-9921-7c803ea3d904 req-d5ca5b9d-d3d6-4fec-bd30-c76e0e9cad1e service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:57.393136 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-460d5167-0aec-4dac-9921-7c803ea3d904 req-d5ca5b9d-d3d6-4fec-bd30-c76e0e9cad1e service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:57.393787 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-460d5167-0aec-4dac-9921-7c803ea3d904 req-d5ca5b9d-d3d6-4fec-bd30-c76e0e9cad1e service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:57.425962 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-460d5167-0aec-4dac-9921-7c803ea3d904 req-d5ca5b9d-d3d6-4fec-bd30-c76e0e9cad1e service nova] Creating event network-vif-deleted:138b0b6f-3e79-4ed9-a4e8-3cf14b605b8d for instance 928fb88c-a689-46ee-a069-de58089ceba6 on n-h1-846463-3 Sep 23 05:09:57.432893 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-460d5167-0aec-4dac-9921-7c803ea3d904 req-d5ca5b9d-d3d6-4fec-bd30-c76e0e9cad1e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073317 Sep 23 05:09:57.434260 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3228/6631] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:09:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:09:57.597058 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-32011fe0-16a7-470d-bd8c-4e15032b7699 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:09:57.600066 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-32011fe0-16a7-470d-bd8c-4e15032b7699 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] [instance: 928fb88c-a689-46ee-a069-de58089ceba6] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:09:57.606741 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-32011fe0-16a7-470d-bd8c-4e15032b7699 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:57.607326 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-32011fe0-16a7-470d-bd8c-4e15032b7699 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:57.608006 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-32011fe0-16a7-470d-bd8c-4e15032b7699 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:57.609095 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-32011fe0-16a7-470d-bd8c-4e15032b7699 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:57.609580 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-32011fe0-16a7-470d-bd8c-4e15032b7699 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:57.610034 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-32011fe0-16a7-470d-bd8c-4e15032b7699 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:57.695860 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-32011fe0-16a7-470d-bd8c-4e15032b7699 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc338a28098d48bc931a2c29213d1dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3384c4863e35469b96482ce27d56a36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:09:57.709914 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-32011fe0-16a7-470d-bd8c-4e15032b7699 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] 10.222.0.33 "GET /compute/v2.1/servers/928fb88c-a689-46ee-a069-de58089ceba6" status: 200 len: 1383 microversion: 2.1 time: 0.111397 Sep 23 05:09:57.709914 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3404/6632] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:09:57 2022] GET /compute/v2.1/servers/928fb88c-a689-46ee-a069-de58089ceba6 => generated 1383 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:09:58.066043 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=4 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:09:58.073442 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-705a3443-71ee-4e0b-ab4e-ca7cd732b9bf tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:09:58.074471 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-705a3443-71ee-4e0b-ab4e-ca7cd732b9bf tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 7ad3508b-1d37-4c7b-82c7-be195566aacb] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:09:58.082219 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-705a3443-71ee-4e0b-ab4e-ca7cd732b9bf tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:58.082736 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-705a3443-71ee-4e0b-ab4e-ca7cd732b9bf tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:58.083778 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-705a3443-71ee-4e0b-ab4e-ca7cd732b9bf tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:58.084608 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-705a3443-71ee-4e0b-ab4e-ca7cd732b9bf tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:58.085091 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-705a3443-71ee-4e0b-ab4e-ca7cd732b9bf tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:58.085538 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-705a3443-71ee-4e0b-ab4e-ca7cd732b9bf tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:58.263211 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ab7823ca-dd45-4d19-adb2-f6750b52ef55 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:09:58.264013 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ab7823ca-dd45-4d19-adb2-f6750b52ef55 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] [instance: a8c3a4c4-20d7-4d1b-beae-e013b32a74aa] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:09:58.278338 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ab7823ca-dd45-4d19-adb2-f6750b52ef55 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:58.279503 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ab7823ca-dd45-4d19-adb2-f6750b52ef55 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:58.280051 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ab7823ca-dd45-4d19-adb2-f6750b52ef55 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:58.280968 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ab7823ca-dd45-4d19-adb2-f6750b52ef55 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:58.281637 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ab7823ca-dd45-4d19-adb2-f6750b52ef55 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:58.282308 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ab7823ca-dd45-4d19-adb2-f6750b52ef55 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:58.298125 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-705a3443-71ee-4e0b-ab4e-ca7cd732b9bf tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:09:58.317687 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-705a3443-71ee-4e0b-ab4e-ca7cd732b9bf tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb" status: 200 len: 1342 microversion: 2.1 time: 0.251960 Sep 23 05:09:58.331542 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3229/6633] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:09:58 2022] GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb => generated 1342 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:09:58.450433 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ab7823ca-dd45-4d19-adb2-f6750b52ef55 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/a8c3a4c4-20d7-4d1b-beae-e013b32a74aa" status: 200 len: 1463 microversion: 2.1 time: 0.193720 Sep 23 05:09:58.451238 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3405/6634] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:09:58 2022] GET /compute/v2.1/servers/a8c3a4c4-20d7-4d1b-beae-e013b32a74aa => generated 1463 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:09:58.625863 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-ff4f4e64-90dc-4a23-ab4c-8ebb0ef48d60 req-2502e546-9ed6-480f-8598-c1ae2e429d89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8c3a4c4-20d7-4d1b-beae-e013b32a74aa", "name": "network-vif-plugged", "status": "completed", "tag": "fc484bc1-2e91-4100-97ee-985c85d519f2"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:09:58.642827 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-ff4f4e64-90dc-4a23-ab4c-8ebb0ef48d60 req-2502e546-9ed6-480f-8598-c1ae2e429d89 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:58.643412 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-ff4f4e64-90dc-4a23-ab4c-8ebb0ef48d60 req-2502e546-9ed6-480f-8598-c1ae2e429d89 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:58.643937 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-ff4f4e64-90dc-4a23-ab4c-8ebb0ef48d60 req-2502e546-9ed6-480f-8598-c1ae2e429d89 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:58.659196 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-ff4f4e64-90dc-4a23-ab4c-8ebb0ef48d60 req-2502e546-9ed6-480f-8598-c1ae2e429d89 service nova] Creating event network-vif-plugged:fc484bc1-2e91-4100-97ee-985c85d519f2 for instance a8c3a4c4-20d7-4d1b-beae-e013b32a74aa on n-h1-846463-3 Sep 23 05:09:58.663692 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-ff4f4e64-90dc-4a23-ab4c-8ebb0ef48d60 req-2502e546-9ed6-480f-8598-c1ae2e429d89 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041574 Sep 23 05:09:58.664292 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3230/6635] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:09:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:09:58.727816 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-67e5722c-399f-4178-b48c-bd86abbb66e5 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:09:58.728574 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-67e5722c-399f-4178-b48c-bd86abbb66e5 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] [instance: 928fb88c-a689-46ee-a069-de58089ceba6] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:09:58.735115 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-67e5722c-399f-4178-b48c-bd86abbb66e5 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:58.736245 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-67e5722c-399f-4178-b48c-bd86abbb66e5 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:58.736929 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-67e5722c-399f-4178-b48c-bd86abbb66e5 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:58.737878 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-67e5722c-399f-4178-b48c-bd86abbb66e5 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:58.738599 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-67e5722c-399f-4178-b48c-bd86abbb66e5 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:58.739937 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-67e5722c-399f-4178-b48c-bd86abbb66e5 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:58.794282 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-67e5722c-399f-4178-b48c-bd86abbb66e5 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:58.795122 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-67e5722c-399f-4178-b48c-bd86abbb66e5 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:58.795314 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-67e5722c-399f-4178-b48c-bd86abbb66e5 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:58.795838 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-67e5722c-399f-4178-b48c-bd86abbb66e5 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lazy-loading 'fault' on Instance uuid 928fb88c-a689-46ee-a069-de58089ceba6 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 05:09:58.846989 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-67e5722c-399f-4178-b48c-bd86abbb66e5 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc338a28098d48bc931a2c29213d1dbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3384c4863e35469b96482ce27d56a36a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:09:58.851144 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-67e5722c-399f-4178-b48c-bd86abbb66e5 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] 10.222.0.33 "GET /compute/v2.1/servers/928fb88c-a689-46ee-a069-de58089ceba6" status: 200 len: 1388 microversion: 2.1 time: 0.127357 Sep 23 05:09:58.852022 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3406/6636] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:09:58 2022] GET /compute/v2.1/servers/928fb88c-a689-46ee-a069-de58089ceba6 => generated 1388 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:09:59.344422 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c6e2c02b-5364-4642-b466-a64d3107fd97 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:09:59.349594 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c6e2c02b-5364-4642-b466-a64d3107fd97 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 7ad3508b-1d37-4c7b-82c7-be195566aacb] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:09:59.354549 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c6e2c02b-5364-4642-b466-a64d3107fd97 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:59.354549 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c6e2c02b-5364-4642-b466-a64d3107fd97 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:59.356328 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c6e2c02b-5364-4642-b466-a64d3107fd97 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:59.357090 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c6e2c02b-5364-4642-b466-a64d3107fd97 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:59.357760 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c6e2c02b-5364-4642-b466-a64d3107fd97 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:59.358458 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c6e2c02b-5364-4642-b466-a64d3107fd97 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:59.472602 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4bb6938b-a3e5-42e3-8a2d-c581c45aa779 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:09:59.474629 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4bb6938b-a3e5-42e3-8a2d-c581c45aa779 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] [instance: a8c3a4c4-20d7-4d1b-beae-e013b32a74aa] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:09:59.486000 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4bb6938b-a3e5-42e3-8a2d-c581c45aa779 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:59.486000 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4bb6938b-a3e5-42e3-8a2d-c581c45aa779 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:59.486000 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4bb6938b-a3e5-42e3-8a2d-c581c45aa779 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:59.486000 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4bb6938b-a3e5-42e3-8a2d-c581c45aa779 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:59.493458 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4bb6938b-a3e5-42e3-8a2d-c581c45aa779 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:59.494502 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4bb6938b-a3e5-42e3-8a2d-c581c45aa779 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:59.532077 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c6e2c02b-5364-4642-b466-a64d3107fd97 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:09:59.540731 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c6e2c02b-5364-4642-b466-a64d3107fd97 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb" status: 200 len: 1342 microversion: 2.1 time: 0.201097 Sep 23 05:09:59.541319 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3231/6637] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:09:59 2022] GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb => generated 1342 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:09:59.661409 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4bb6938b-a3e5-42e3-8a2d-c581c45aa779 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/a8c3a4c4-20d7-4d1b-beae-e013b32a74aa" status: 200 len: 1463 microversion: 2.1 time: 0.189224 Sep 23 05:09:59.661409 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3407/6638] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:09:59 2022] GET /compute/v2.1/servers/a8c3a4c4-20d7-4d1b-beae-e013b32a74aa => generated 1463 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:09:59.877354 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-39af4052-4833-4863-9a1f-6b5e9d880e5b tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:09:59.877354 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-39af4052-4833-4863-9a1f-6b5e9d880e5b tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] [instance: 928fb88c-a689-46ee-a069-de58089ceba6] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:09:59.884411 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-39af4052-4833-4863-9a1f-6b5e9d880e5b tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:59.884929 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-39af4052-4833-4863-9a1f-6b5e9d880e5b tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:59.885385 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-39af4052-4833-4863-9a1f-6b5e9d880e5b tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:59.886307 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-39af4052-4833-4863-9a1f-6b5e9d880e5b tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:09:59.887147 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-39af4052-4833-4863-9a1f-6b5e9d880e5b tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:09:59.887597 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-39af4052-4833-4863-9a1f-6b5e9d880e5b tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:09:59.903658 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-39af4052-4833-4863-9a1f-6b5e9d880e5b tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] HTTP exception thrown: Instance 928fb88c-a689-46ee-a069-de58089ceba6 could not be found. Sep 23 05:09:59.905352 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-39af4052-4833-4863-9a1f-6b5e9d880e5b tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Request method failure captured: Sep 23 05:09:59.905352 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/928fb88c-a689-46ee-a069-de58089ceba6 HTTP/1.1 Sep 23 05:09:59.905352 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 05:09:59.905352 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 05:09:59.905352 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 05:09:59.905352 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 05:09:59.905352 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 05:09:59.905352 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 05:09:59.905352 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 05:09:59.905352 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 05:09:59.905352 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLT5IFsoiKYvlR_Bk9yl91IDSP5uiXFvmhUiSwgUDJkLA-ttUJJLtOOWbUU-ATOhlR8jdt-cT_acDW5YE5RGSh6MP6-hbK7qxLdC2tWxXf70mOcmYqWzVnZKY1ZhLSzxmm6OeneWpbFTWRAjUmkzNC6k5X7QXZ0YjMA8V1pKnserm4l4 Sep 23 05:09:59.905352 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 05:09:59.905352 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 05:09:59.905352 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 05:09:59.905352 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 05:09:59.905352 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 05:09:59.905352 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 05:09:59.905352 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 3384c4863e35469b96482ce27d56a36a Sep 23 05:09:59.905352 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-TestServerBasicOps-1281419752 Sep 23 05:09:59.905352 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 05:09:59.905352 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 05:09:59.905352 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3384c4863e35469b96482ce27d56a36a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3384c4863e35469b96482ce27d56a36a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3384c4863e35469b96482ce27d56a36a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3384c4863e35469b96482ce27d56a36a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:09:59.905352 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-TestServerBasicOps-1281419752 Sep 23 05:09:59.905352 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 3384c4863e35469b96482ce27d56a36a Sep 23 05:09:59.905352 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-TestServerBasicOps-1281419752 Sep 23 05:09:59.905352 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-TestServerBasicOps-1281419752-project Sep 23 05:09:59.905352 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 05:09:59.905352 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 05:09:59.905352 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: fc338a28098d48bc931a2c29213d1dbb Sep 23 05:09:59.905352 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-TestServerBasicOps-1281419752-project Sep 23 05:09:59.905352 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 05:09:59.905352 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 928fb88c-a689-46ee-a069-de58089ceba6 could not be found. Sep 23 05:09:59.905352 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '928fb88c-a689-46ee-a069-de58089ceba6'} Sep 23 05:09:59.905352 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:09:59.905352 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:09:59.905352 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 05:09:59.905352 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 05:09:59.905352 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 05:09:59.905352 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 05:09:59.905352 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 05:09:59.905352 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 05:09:59.905352 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 05:09:59.905352 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 05:09:59.905352 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 928fb88c-a689-46ee-a069-de58089ceba6 could not be found. Sep 23 05:09:59.905352 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:09:59.905352 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:09:59.905352 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:09:59.905352 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:09:59.905352 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:09:59.905352 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:09:59.905352 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:09:59.905352 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:09:59.905352 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:09:59.905352 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:09:59.905352 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 05:09:59.905352 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 05:09:59.905352 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 05:09:59.905352 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 05:09:59.905352 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 05:09:59.905352 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:09:59.905352 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 928fb88c-a689-46ee-a069-de58089ceba6 could not be found. Sep 23 05:09:59.905352 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:09:59.905352 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:09:59.905352 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:09:59.914444 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:09:59.914444 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:09:59.914444 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:09:59.914444 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:09:59.914444 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:09:59.914444 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 928fb88c-a689-46ee-a069-de58089ceba6 could not be found. Sep 23 05:09:59.914444 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:09:59.914444 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-39af4052-4833-4863-9a1f-6b5e9d880e5b tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Returning 404 to user: Instance 928fb88c-a689-46ee-a069-de58089ceba6 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:09:59.914444 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-39af4052-4833-4863-9a1f-6b5e9d880e5b tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] 10.222.0.33 "GET /compute/v2.1/servers/928fb88c-a689-46ee-a069-de58089ceba6" status: 404 len: 111 microversion: 2.1 time: 0.036397 Sep 23 05:09:59.914444 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3232/6639] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:09:59 2022] GET /compute/v2.1/servers/928fb88c-a689-46ee-a069-de58089ceba6 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 05:10:00.543930 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-17bc3309-0fbf-480e-a2a1-d6c25d463134 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:10:00.544458 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-17bc3309-0fbf-480e-a2a1-d6c25d463134 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] [instance: 928fb88c-a689-46ee-a069-de58089ceba6] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:10:00.551111 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-17bc3309-0fbf-480e-a2a1-d6c25d463134 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:00.556354 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-17bc3309-0fbf-480e-a2a1-d6c25d463134 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:00.556354 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-17bc3309-0fbf-480e-a2a1-d6c25d463134 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:00.556354 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-17bc3309-0fbf-480e-a2a1-d6c25d463134 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:00.556354 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-17bc3309-0fbf-480e-a2a1-d6c25d463134 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:00.556354 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-17bc3309-0fbf-480e-a2a1-d6c25d463134 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:00.563886 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-61c972e9-8e8d-4e9a-b2a3-26bd58e35548 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:10:00.564813 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-61c972e9-8e8d-4e9a-b2a3-26bd58e35548 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 7ad3508b-1d37-4c7b-82c7-be195566aacb] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:10:00.568532 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-17bc3309-0fbf-480e-a2a1-d6c25d463134 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] HTTP exception thrown: Instance 928fb88c-a689-46ee-a069-de58089ceba6 could not be found. Sep 23 05:10:00.570296 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-17bc3309-0fbf-480e-a2a1-d6c25d463134 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Request method failure captured: Sep 23 05:10:00.570296 n-d-846463-3 devstack@n-api.service[122699]: request: DELETE /compute/v2.1/servers/928fb88c-a689-46ee-a069-de58089ceba6 HTTP/1.1 Sep 23 05:10:00.570296 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 05:10:00.570296 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 05:10:00.570296 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 05:10:00.570296 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 05:10:00.570296 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 05:10:00.570296 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 05:10:00.570296 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 05:10:00.570296 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 05:10:00.570296 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLT5IFsoiKYvlR_Bk9yl91IDSP5uiXFvmhUiSwgUDJkLA-ttUJJLtOOWbUU-ATOhlR8jdt-cT_acDW5YE5RGSh6MP6-hbK7qxLdC2tWxXf70mOcmYqWzVnZKY1ZhLSzxmm6OeneWpbFTWRAjUmkzNC6k5X7QXZ0YjMA8V1pKnserm4l4 Sep 23 05:10:00.570296 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 05:10:00.570296 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 05:10:00.570296 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 05:10:00.570296 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 05:10:00.570296 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 05:10:00.570296 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 05:10:00.570296 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 3384c4863e35469b96482ce27d56a36a Sep 23 05:10:00.570296 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-TestServerBasicOps-1281419752 Sep 23 05:10:00.570296 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 05:10:00.570296 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 05:10:00.570296 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3384c4863e35469b96482ce27d56a36a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3384c4863e35469b96482ce27d56a36a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3384c4863e35469b96482ce27d56a36a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3384c4863e35469b96482ce27d56a36a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:10:00.570296 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-TestServerBasicOps-1281419752 Sep 23 05:10:00.570296 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 3384c4863e35469b96482ce27d56a36a Sep 23 05:10:00.570296 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-TestServerBasicOps-1281419752 Sep 23 05:10:00.570296 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-TestServerBasicOps-1281419752-project Sep 23 05:10:00.570296 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 05:10:00.570296 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 05:10:00.570296 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: fc338a28098d48bc931a2c29213d1dbb Sep 23 05:10:00.570296 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-TestServerBasicOps-1281419752-project Sep 23 05:10:00.570296 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 05:10:00.570296 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 928fb88c-a689-46ee-a069-de58089ceba6 could not be found. Sep 23 05:10:00.570296 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '928fb88c-a689-46ee-a069-de58089ceba6'} Sep 23 05:10:00.570296 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:10:00.570296 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:10:00.570296 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 05:10:00.570296 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 05:10:00.570296 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 05:10:00.570296 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 05:10:00.570296 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 05:10:00.570296 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 05:10:00.570296 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 05:10:00.570296 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 05:10:00.570296 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 928fb88c-a689-46ee-a069-de58089ceba6 could not be found. Sep 23 05:10:00.570296 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:10:00.570296 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:10:00.570296 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:10:00.570296 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:10:00.570296 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:10:00.570296 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:10:00.570296 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:10:00.570296 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:10:00.570296 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:10:00.570296 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:10:00.570296 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 05:10:00.570296 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 05:10:00.570296 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 05:10:00.570296 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 05:10:00.570296 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 05:10:00.570296 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 05:10:00.570296 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 05:10:00.570296 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:10:00.588019 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 928fb88c-a689-46ee-a069-de58089ceba6 could not be found. Sep 23 05:10:00.588019 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:10:00.588019 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:10:00.588019 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:10:00.588019 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:10:00.588019 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:10:00.588019 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:10:00.588019 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:10:00.588019 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:10:00.588019 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 928fb88c-a689-46ee-a069-de58089ceba6 could not be found. Sep 23 05:10:00.588019 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:10:00.588019 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-17bc3309-0fbf-480e-a2a1-d6c25d463134 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Returning 404 to user: Instance 928fb88c-a689-46ee-a069-de58089ceba6 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:10:00.588019 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-17bc3309-0fbf-480e-a2a1-d6c25d463134 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] 10.222.0.33 "DELETE /compute/v2.1/servers/928fb88c-a689-46ee-a069-de58089ceba6" status: 404 len: 111 microversion: 2.1 time: 0.031868 Sep 23 05:10:00.588019 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3408/6640] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 05:10:00 2022] DELETE /compute/v2.1/servers/928fb88c-a689-46ee-a069-de58089ceba6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 05:10:00.589114 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-61c972e9-8e8d-4e9a-b2a3-26bd58e35548 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:00.589114 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-61c972e9-8e8d-4e9a-b2a3-26bd58e35548 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:00.589114 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-61c972e9-8e8d-4e9a-b2a3-26bd58e35548 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:00.589114 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-61c972e9-8e8d-4e9a-b2a3-26bd58e35548 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:00.589114 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-61c972e9-8e8d-4e9a-b2a3-26bd58e35548 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:00.589114 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-61c972e9-8e8d-4e9a-b2a3-26bd58e35548 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:00.593142 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0cd01eb7-37c5-46cc-9658-284fc0da6e2f tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:10:00.593802 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-0cd01eb7-37c5-46cc-9658-284fc0da6e2f tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] [instance: 928fb88c-a689-46ee-a069-de58089ceba6] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:10:00.605388 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0cd01eb7-37c5-46cc-9658-284fc0da6e2f tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:00.605954 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0cd01eb7-37c5-46cc-9658-284fc0da6e2f tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:00.606390 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0cd01eb7-37c5-46cc-9658-284fc0da6e2f tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:00.607135 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0cd01eb7-37c5-46cc-9658-284fc0da6e2f tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:00.607601 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0cd01eb7-37c5-46cc-9658-284fc0da6e2f tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:00.608553 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0cd01eb7-37c5-46cc-9658-284fc0da6e2f tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:00.627305 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-0cd01eb7-37c5-46cc-9658-284fc0da6e2f tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] HTTP exception thrown: Instance 928fb88c-a689-46ee-a069-de58089ceba6 could not be found. Sep 23 05:10:00.629234 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0cd01eb7-37c5-46cc-9658-284fc0da6e2f tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Request method failure captured: Sep 23 05:10:00.629234 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/928fb88c-a689-46ee-a069-de58089ceba6 HTTP/1.1 Sep 23 05:10:00.629234 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 05:10:00.629234 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 05:10:00.629234 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 05:10:00.629234 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 05:10:00.629234 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 05:10:00.629234 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 05:10:00.629234 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 05:10:00.629234 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 05:10:00.629234 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLT5IFsoiKYvlR_Bk9yl91IDSP5uiXFvmhUiSwgUDJkLA-ttUJJLtOOWbUU-ATOhlR8jdt-cT_acDW5YE5RGSh6MP6-hbK7qxLdC2tWxXf70mOcmYqWzVnZKY1ZhLSzxmm6OeneWpbFTWRAjUmkzNC6k5X7QXZ0YjMA8V1pKnserm4l4 Sep 23 05:10:00.629234 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 05:10:00.629234 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 05:10:00.629234 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 05:10:00.629234 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 05:10:00.629234 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 05:10:00.629234 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 05:10:00.629234 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 3384c4863e35469b96482ce27d56a36a Sep 23 05:10:00.629234 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-TestServerBasicOps-1281419752 Sep 23 05:10:00.629234 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 05:10:00.629234 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 05:10:00.629234 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3384c4863e35469b96482ce27d56a36a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3384c4863e35469b96482ce27d56a36a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3384c4863e35469b96482ce27d56a36a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3384c4863e35469b96482ce27d56a36a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:10:00.629234 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-TestServerBasicOps-1281419752 Sep 23 05:10:00.629234 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 3384c4863e35469b96482ce27d56a36a Sep 23 05:10:00.629234 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-TestServerBasicOps-1281419752 Sep 23 05:10:00.629234 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-TestServerBasicOps-1281419752-project Sep 23 05:10:00.629234 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 05:10:00.629234 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 05:10:00.629234 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: fc338a28098d48bc931a2c29213d1dbb Sep 23 05:10:00.629234 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-TestServerBasicOps-1281419752-project Sep 23 05:10:00.629234 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 05:10:00.629234 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 928fb88c-a689-46ee-a069-de58089ceba6 could not be found. Sep 23 05:10:00.629234 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '928fb88c-a689-46ee-a069-de58089ceba6'} Sep 23 05:10:00.629234 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:10:00.629234 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:10:00.629234 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 05:10:00.629234 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 05:10:00.629234 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 05:10:00.629234 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 05:10:00.629234 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 05:10:00.629234 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 05:10:00.629234 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 05:10:00.629234 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 05:10:00.629234 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 928fb88c-a689-46ee-a069-de58089ceba6 could not be found. Sep 23 05:10:00.629234 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:10:00.629234 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:10:00.629234 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:10:00.629234 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:10:00.629234 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:10:00.629234 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:10:00.629234 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:10:00.629234 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:10:00.629234 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:10:00.629234 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:10:00.629234 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 05:10:00.629234 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 05:10:00.629234 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 05:10:00.629234 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 05:10:00.629234 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 05:10:00.629234 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:10:00.629234 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 928fb88c-a689-46ee-a069-de58089ceba6 could not be found. Sep 23 05:10:00.629234 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:10:00.629234 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:10:00.629234 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:10:00.634297 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:10:00.634297 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:10:00.634297 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:10:00.634297 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:10:00.634297 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:10:00.634297 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 928fb88c-a689-46ee-a069-de58089ceba6 could not be found. Sep 23 05:10:00.634297 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:10:00.635782 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0cd01eb7-37c5-46cc-9658-284fc0da6e2f tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Returning 404 to user: Instance 928fb88c-a689-46ee-a069-de58089ceba6 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:10:00.637230 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0cd01eb7-37c5-46cc-9658-284fc0da6e2f tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] 10.222.0.33 "GET /compute/v2.1/servers/928fb88c-a689-46ee-a069-de58089ceba6" status: 404 len: 111 microversion: 2.1 time: 0.048249 Sep 23 05:10:00.642210 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3409/6641] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:10:00 2022] GET /compute/v2.1/servers/928fb88c-a689-46ee-a069-de58089ceba6 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 05:10:00.682981 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5c391aea-ccb0-4105-9c33-39d4398db077 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:10:00.683718 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-5c391aea-ccb0-4105-9c33-39d4398db077 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] [instance: a8c3a4c4-20d7-4d1b-beae-e013b32a74aa] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:10:00.690699 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5c391aea-ccb0-4105-9c33-39d4398db077 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:00.691307 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5c391aea-ccb0-4105-9c33-39d4398db077 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:00.692735 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5c391aea-ccb0-4105-9c33-39d4398db077 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:00.694564 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5c391aea-ccb0-4105-9c33-39d4398db077 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:00.695656 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5c391aea-ccb0-4105-9c33-39d4398db077 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:00.696265 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5c391aea-ccb0-4105-9c33-39d4398db077 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:00.772085 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-61c972e9-8e8d-4e9a-b2a3-26bd58e35548 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:10:00.786361 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-61c972e9-8e8d-4e9a-b2a3-26bd58e35548 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb" status: 200 len: 1342 microversion: 2.1 time: 0.222523 Sep 23 05:10:00.790641 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3233/6642] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:10:00 2022] GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb => generated 1342 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:10:00.902481 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5c391aea-ccb0-4105-9c33-39d4398db077 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/a8c3a4c4-20d7-4d1b-beae-e013b32a74aa" status: 200 len: 1647 microversion: 2.1 time: 0.223558 Sep 23 05:10:00.903115 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3410/6643] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:10:00 2022] GET /compute/v2.1/servers/a8c3a4c4-20d7-4d1b-beae-e013b32a74aa => generated 1647 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:10:00.924671 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b6d161c9-d05a-40da-80e8-64d08b18b470 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:10:00.925309 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b6d161c9-d05a-40da-80e8-64d08b18b470 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] [instance: a8c3a4c4-20d7-4d1b-beae-e013b32a74aa] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:10:00.931867 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b6d161c9-d05a-40da-80e8-64d08b18b470 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:00.932374 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b6d161c9-d05a-40da-80e8-64d08b18b470 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:00.932835 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b6d161c9-d05a-40da-80e8-64d08b18b470 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:00.933551 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b6d161c9-d05a-40da-80e8-64d08b18b470 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:00.934079 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b6d161c9-d05a-40da-80e8-64d08b18b470 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:00.934529 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b6d161c9-d05a-40da-80e8-64d08b18b470 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:00.987969 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d7e01f0d-5e04-446f-8707-868297a5a177 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] Calling method '.version_select at 0x7ff1bb8d5280>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:10:01.085038 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b6d161c9-d05a-40da-80e8-64d08b18b470 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/a8c3a4c4-20d7-4d1b-beae-e013b32a74aa" status: 200 len: 1647 microversion: 2.1 time: 0.164010 Sep 23 05:10:01.085597 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3234/6644] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:10:00 2022] GET /compute/v2.1/servers/a8c3a4c4-20d7-4d1b-beae-e013b32a74aa => generated 1647 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:10:01.106233 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d7e01f0d-5e04-446f-8707-868297a5a177 tempest-TestServerBasicOps-1281419752 tempest-TestServerBasicOps-1281419752-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-188609765" status: 202 len: 0 microversion: 2.1 time: 0.122354 Sep 23 05:10:01.107948 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8c6b1191-723b-4fc4-a383-dbce124261f2 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:10:01.108580 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8c6b1191-723b-4fc4-a383-dbce124261f2 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] [instance: a8c3a4c4-20d7-4d1b-beae-e013b32a74aa] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:10:01.109131 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3411/6645] 10.222.0.33 () {58 vars in 1251 bytes} [Fri Sep 23 05:10:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-188609765 => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 05:10:01.115751 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8c6b1191-723b-4fc4-a383-dbce124261f2 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:01.119395 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8c6b1191-723b-4fc4-a383-dbce124261f2 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:01.120909 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8c6b1191-723b-4fc4-a383-dbce124261f2 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:01.121818 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8c6b1191-723b-4fc4-a383-dbce124261f2 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:01.122473 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8c6b1191-723b-4fc4-a383-dbce124261f2 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:01.123071 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8c6b1191-723b-4fc4-a383-dbce124261f2 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:01.311262 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8c6b1191-723b-4fc4-a383-dbce124261f2 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/a8c3a4c4-20d7-4d1b-beae-e013b32a74aa" status: 200 len: 1647 microversion: 2.1 time: 0.207737 Sep 23 05:10:01.311850 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3235/6646] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:10:01 2022] GET /compute/v2.1/servers/a8c3a4c4-20d7-4d1b-beae-e013b32a74aa => generated 1647 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:10:01.456905 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3e7a847e-1e46-4b61-9730-d2ee6ad3aa60 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-390766716", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "availability_zone": "nova:n-h2-846463-3", "networks": [{"uuid": "b06aaec9-1bfc-44e2-96d5-ca5221a6df27"}]}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:10:01.584077 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.neutron [None req-3e7a847e-1e46-4b61-9730-d2ee6ad3aa60 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] validate_networks() for [('b06aaec9-1bfc-44e2-96d5-ca5221a6df27', None, None, None, None, None)] {{(pid=122699) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 05:10:01.821067 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7bc231b2-7449-474c-b2ab-357ce138692d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:10:01.822374 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7bc231b2-7449-474c-b2ab-357ce138692d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 7ad3508b-1d37-4c7b-82c7-be195566aacb] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:10:01.829557 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7bc231b2-7449-474c-b2ab-357ce138692d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:01.830121 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7bc231b2-7449-474c-b2ab-357ce138692d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:01.830791 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7bc231b2-7449-474c-b2ab-357ce138692d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:01.831519 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7bc231b2-7449-474c-b2ab-357ce138692d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:01.832141 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7bc231b2-7449-474c-b2ab-357ce138692d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:01.832602 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7bc231b2-7449-474c-b2ab-357ce138692d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:02.114653 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-7bc231b2-7449-474c-b2ab-357ce138692d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:10:02.128911 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7bc231b2-7449-474c-b2ab-357ce138692d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb" status: 200 len: 1342 microversion: 2.1 time: 0.311128 Sep 23 05:10:02.144035 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3236/6647] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:10:01 2022] GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb => generated 1342 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:10:02.177745 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-3e7a847e-1e46-4b61-9730-d2ee6ad3aa60 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Flavor limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 05:10:02.178228 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-3e7a847e-1e46-4b61-9730-d2ee6ad3aa60 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Image limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 05:10:02.178719 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-3e7a847e-1e46-4b61-9730-d2ee6ad3aa60 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Flavor pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 05:10:02.179137 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-3e7a847e-1e46-4b61-9730-d2ee6ad3aa60 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Image pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 05:10:02.179915 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-3e7a847e-1e46-4b61-9730-d2ee6ad3aa60 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 05:10:02.199526 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3e7a847e-1e46-4b61-9730-d2ee6ad3aa60 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:02.199526 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3e7a847e-1e46-4b61-9730-d2ee6ad3aa60 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:02.199526 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3e7a847e-1e46-4b61-9730-d2ee6ad3aa60 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:02.199526 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3e7a847e-1e46-4b61-9730-d2ee6ad3aa60 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:02.199526 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3e7a847e-1e46-4b61-9730-d2ee6ad3aa60 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:02.199526 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3e7a847e-1e46-4b61-9730-d2ee6ad3aa60 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:02.237523 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-3e7a847e-1e46-4b61-9730-d2ee6ad3aa60 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Getting quotas for project 101ce576f12c41519e9120f803ce1064. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 05:10:02.247640 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-3e7a847e-1e46-4b61-9730-d2ee6ad3aa60 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Getting quotas for user 3c490bfc9eee403f9448b6967a2e5665 and project 101ce576f12c41519e9120f803ce1064. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 05:10:02.277424 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-3e7a847e-1e46-4b61-9730-d2ee6ad3aa60 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Going to run 1 instances... {{(pid=122699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 05:10:02.279897 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-3e7a847e-1e46-4b61-9730-d2ee6ad3aa60 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] [instance: 40abe9d9-d1bf-402c-b5a2-38d02d991aeb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 05:10:02.484382 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3e7a847e-1e46-4b61-9730-d2ee6ad3aa60 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.031496 Sep 23 05:10:02.485102 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3412/6648] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 05:10:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1033 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 05:10:02.496972 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-52c03c72-d439-4b2b-a171-d134dc9463eb tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:10:02.497605 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-52c03c72-d439-4b2b-a171-d134dc9463eb tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] [instance: 40abe9d9-d1bf-402c-b5a2-38d02d991aeb] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:10:02.562344 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-52c03c72-d439-4b2b-a171-d134dc9463eb tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/40abe9d9-d1bf-402c-b5a2-38d02d991aeb" status: 200 len: 1328 microversion: 2.1 time: 0.069345 Sep 23 05:10:02.568420 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3237/6649] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:10:02 2022] GET /compute/v2.1/servers/40abe9d9-d1bf-402c-b5a2-38d02d991aeb => generated 1328 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:10:03.161835 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-595e1995-3837-47bd-a037-54db94f9a7db tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:10:03.161835 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-595e1995-3837-47bd-a037-54db94f9a7db tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 7ad3508b-1d37-4c7b-82c7-be195566aacb] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:10:03.168109 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-595e1995-3837-47bd-a037-54db94f9a7db tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:03.168857 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-595e1995-3837-47bd-a037-54db94f9a7db tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:03.169298 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-595e1995-3837-47bd-a037-54db94f9a7db tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:03.170232 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-595e1995-3837-47bd-a037-54db94f9a7db tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:03.170695 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-595e1995-3837-47bd-a037-54db94f9a7db tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:03.171128 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-595e1995-3837-47bd-a037-54db94f9a7db tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:03.379408 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-595e1995-3837-47bd-a037-54db94f9a7db tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:10:03.392325 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-595e1995-3837-47bd-a037-54db94f9a7db tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb" status: 200 len: 1342 microversion: 2.1 time: 0.237744 Sep 23 05:10:03.393355 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3413/6650] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:10:03 2022] GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb => generated 1342 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:10:03.588592 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-cbcc43ac-895e-4a23-80d1-09730c6bc566 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:10:03.589825 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-cbcc43ac-895e-4a23-80d1-09730c6bc566 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] [instance: 40abe9d9-d1bf-402c-b5a2-38d02d991aeb] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:10:03.653673 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-cbcc43ac-895e-4a23-80d1-09730c6bc566 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/40abe9d9-d1bf-402c-b5a2-38d02d991aeb" status: 200 len: 1328 microversion: 2.1 time: 0.070598 Sep 23 05:10:03.654903 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3238/6651] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:10:03 2022] GET /compute/v2.1/servers/40abe9d9-d1bf-402c-b5a2-38d02d991aeb => generated 1328 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:10:04.417747 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2a657437-3b00-4d47-b18d-4a332e818005 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:10:04.418412 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-2a657437-3b00-4d47-b18d-4a332e818005 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 7ad3508b-1d37-4c7b-82c7-be195566aacb] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:10:04.428417 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2a657437-3b00-4d47-b18d-4a332e818005 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:04.428417 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2a657437-3b00-4d47-b18d-4a332e818005 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:04.428417 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2a657437-3b00-4d47-b18d-4a332e818005 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:04.428417 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2a657437-3b00-4d47-b18d-4a332e818005 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:04.428417 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2a657437-3b00-4d47-b18d-4a332e818005 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:04.428417 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2a657437-3b00-4d47-b18d-4a332e818005 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:04.618430 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2a657437-3b00-4d47-b18d-4a332e818005 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:10:04.629063 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2a657437-3b00-4d47-b18d-4a332e818005 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb" status: 200 len: 1342 microversion: 2.1 time: 0.215635 Sep 23 05:10:04.631070 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3414/6652] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:10:04 2022] GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb => generated 1342 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:10:04.677379 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-bb6ce825-4a25-453a-be53-8d6a8bc26970 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:10:04.678712 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-bb6ce825-4a25-453a-be53-8d6a8bc26970 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] [instance: 40abe9d9-d1bf-402c-b5a2-38d02d991aeb] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:10:04.686685 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bb6ce825-4a25-453a-be53-8d6a8bc26970 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:04.687349 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bb6ce825-4a25-453a-be53-8d6a8bc26970 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:04.688027 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bb6ce825-4a25-453a-be53-8d6a8bc26970 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:04.688842 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bb6ce825-4a25-453a-be53-8d6a8bc26970 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:04.689754 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bb6ce825-4a25-453a-be53-8d6a8bc26970 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:04.690402 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bb6ce825-4a25-453a-be53-8d6a8bc26970 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:04.844020 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-bb6ce825-4a25-453a-be53-8d6a8bc26970 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/40abe9d9-d1bf-402c-b5a2-38d02d991aeb" status: 200 len: 1415 microversion: 2.1 time: 0.170891 Sep 23 05:10:04.844866 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3239/6653] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:10:04 2022] GET /compute/v2.1/servers/40abe9d9-d1bf-402c-b5a2-38d02d991aeb => generated 1415 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:10:05.654080 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-bad480d6-8837-4e97-a6b9-acf3285004b6 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:10:05.655284 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-bad480d6-8837-4e97-a6b9-acf3285004b6 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 7ad3508b-1d37-4c7b-82c7-be195566aacb] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:10:05.662996 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bad480d6-8837-4e97-a6b9-acf3285004b6 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:05.668734 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bad480d6-8837-4e97-a6b9-acf3285004b6 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:05.668734 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bad480d6-8837-4e97-a6b9-acf3285004b6 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:05.668734 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bad480d6-8837-4e97-a6b9-acf3285004b6 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:05.668734 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bad480d6-8837-4e97-a6b9-acf3285004b6 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:05.668734 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bad480d6-8837-4e97-a6b9-acf3285004b6 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:05.883291 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-dcb6bbe2-4da3-4285-b8b5-a49e59277c7d tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:10:05.883291 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-dcb6bbe2-4da3-4285-b8b5-a49e59277c7d tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] [instance: 40abe9d9-d1bf-402c-b5a2-38d02d991aeb] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:10:05.911558 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dcb6bbe2-4da3-4285-b8b5-a49e59277c7d tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:05.917474 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dcb6bbe2-4da3-4285-b8b5-a49e59277c7d tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:05.919466 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dcb6bbe2-4da3-4285-b8b5-a49e59277c7d tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:05.922034 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dcb6bbe2-4da3-4285-b8b5-a49e59277c7d tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:05.923622 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dcb6bbe2-4da3-4285-b8b5-a49e59277c7d tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:05.927979 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dcb6bbe2-4da3-4285-b8b5-a49e59277c7d tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:06.086319 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-dcb6bbe2-4da3-4285-b8b5-a49e59277c7d tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/40abe9d9-d1bf-402c-b5a2-38d02d991aeb" status: 200 len: 1423 microversion: 2.1 time: 0.214387 Sep 23 05:10:06.087872 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3240/6654] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:10:05 2022] GET /compute/v2.1/servers/40abe9d9-d1bf-402c-b5a2-38d02d991aeb => generated 1423 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:10:06.376737 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-bad480d6-8837-4e97-a6b9-acf3285004b6 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:10:06.392078 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-bad480d6-8837-4e97-a6b9-acf3285004b6 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb" status: 200 len: 1342 microversion: 2.1 time: 0.741950 Sep 23 05:10:06.393083 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3415/6655] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:10:05 2022] GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb => generated 1342 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:10:07.120549 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2b3f5643-51e2-48ae-97c7-ccb372da8cff tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:10:07.122008 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-2b3f5643-51e2-48ae-97c7-ccb372da8cff tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] [instance: 40abe9d9-d1bf-402c-b5a2-38d02d991aeb] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:10:07.150723 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2b3f5643-51e2-48ae-97c7-ccb372da8cff tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:07.151778 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2b3f5643-51e2-48ae-97c7-ccb372da8cff tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:07.152481 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2b3f5643-51e2-48ae-97c7-ccb372da8cff tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:07.154616 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2b3f5643-51e2-48ae-97c7-ccb372da8cff tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:07.155326 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2b3f5643-51e2-48ae-97c7-ccb372da8cff tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:07.156633 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2b3f5643-51e2-48ae-97c7-ccb372da8cff tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:07.371033 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2b3f5643-51e2-48ae-97c7-ccb372da8cff tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/40abe9d9-d1bf-402c-b5a2-38d02d991aeb" status: 200 len: 1463 microversion: 2.1 time: 0.257583 Sep 23 05:10:07.374748 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3241/6656] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:10:07 2022] GET /compute/v2.1/servers/40abe9d9-d1bf-402c-b5a2-38d02d991aeb => generated 1463 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:10:07.416988 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1f9b0586-aaf7-4ac4-958f-2a2761f245d4 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:10:07.417632 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1f9b0586-aaf7-4ac4-958f-2a2761f245d4 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 7ad3508b-1d37-4c7b-82c7-be195566aacb] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:10:07.424851 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1f9b0586-aaf7-4ac4-958f-2a2761f245d4 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:07.425344 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1f9b0586-aaf7-4ac4-958f-2a2761f245d4 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:07.426839 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1f9b0586-aaf7-4ac4-958f-2a2761f245d4 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:07.427633 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1f9b0586-aaf7-4ac4-958f-2a2761f245d4 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:07.428273 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1f9b0586-aaf7-4ac4-958f-2a2761f245d4 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:07.428715 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1f9b0586-aaf7-4ac4-958f-2a2761f245d4 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:07.732643 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1f9b0586-aaf7-4ac4-958f-2a2761f245d4 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:10:07.744153 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1f9b0586-aaf7-4ac4-958f-2a2761f245d4 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb" status: 200 len: 1342 microversion: 2.1 time: 0.331800 Sep 23 05:10:07.745854 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3416/6657] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:10:07 2022] GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb => generated 1342 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:10:08.025374 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-b03887ca-ae21-4642-9c1a-1d53696e2bb4 req-eedecdaf-a114-4b6d-974c-7be5182ca038 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40abe9d9-d1bf-402c-b5a2-38d02d991aeb", "tag": "6c40ca06-6258-48a3-871c-a0965cfb57ad"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:10:08.037828 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-b03887ca-ae21-4642-9c1a-1d53696e2bb4 req-eedecdaf-a114-4b6d-974c-7be5182ca038 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:08.038411 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-b03887ca-ae21-4642-9c1a-1d53696e2bb4 req-eedecdaf-a114-4b6d-974c-7be5182ca038 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:08.039040 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-b03887ca-ae21-4642-9c1a-1d53696e2bb4 req-eedecdaf-a114-4b6d-974c-7be5182ca038 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:08.054763 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-b03887ca-ae21-4642-9c1a-1d53696e2bb4 req-eedecdaf-a114-4b6d-974c-7be5182ca038 service nova] Creating event network-changed:6c40ca06-6258-48a3-871c-a0965cfb57ad for instance 40abe9d9-d1bf-402c-b5a2-38d02d991aeb on n-h2-846463-3 Sep 23 05:10:08.060200 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-b03887ca-ae21-4642-9c1a-1d53696e2bb4 req-eedecdaf-a114-4b6d-974c-7be5182ca038 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047361 Sep 23 05:10:08.061361 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3242/6658] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:10:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:10:08.394229 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a733b0cd-4c69-49fc-9578-860257443e44 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:10:08.395752 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a733b0cd-4c69-49fc-9578-860257443e44 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] [instance: 40abe9d9-d1bf-402c-b5a2-38d02d991aeb] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:10:08.402291 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a733b0cd-4c69-49fc-9578-860257443e44 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:08.402791 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a733b0cd-4c69-49fc-9578-860257443e44 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:08.403233 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a733b0cd-4c69-49fc-9578-860257443e44 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:08.403942 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a733b0cd-4c69-49fc-9578-860257443e44 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:08.404409 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a733b0cd-4c69-49fc-9578-860257443e44 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:08.404875 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a733b0cd-4c69-49fc-9578-860257443e44 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:08.668468 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a733b0cd-4c69-49fc-9578-860257443e44 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/40abe9d9-d1bf-402c-b5a2-38d02d991aeb" status: 200 len: 1463 microversion: 2.1 time: 0.277440 Sep 23 05:10:08.693917 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3417/6659] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:10:08 2022] GET /compute/v2.1/servers/40abe9d9-d1bf-402c-b5a2-38d02d991aeb => generated 1463 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:10:08.790980 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-aaf96750-13cc-467c-91bc-261ccd9eead9 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:10:08.791772 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-aaf96750-13cc-467c-91bc-261ccd9eead9 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 7ad3508b-1d37-4c7b-82c7-be195566aacb] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:10:08.814323 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-aaf96750-13cc-467c-91bc-261ccd9eead9 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:08.814924 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-aaf96750-13cc-467c-91bc-261ccd9eead9 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:08.815405 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-aaf96750-13cc-467c-91bc-261ccd9eead9 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:08.816176 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-aaf96750-13cc-467c-91bc-261ccd9eead9 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:08.820154 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-aaf96750-13cc-467c-91bc-261ccd9eead9 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:08.820917 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-aaf96750-13cc-467c-91bc-261ccd9eead9 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:09.100223 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-aaf96750-13cc-467c-91bc-261ccd9eead9 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:10:09.110304 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-aaf96750-13cc-467c-91bc-261ccd9eead9 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb" status: 200 len: 1342 microversion: 2.1 time: 0.343517 Sep 23 05:10:09.110924 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3243/6660] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:10:08 2022] GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb => generated 1342 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:10:09.705317 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-43caaf7d-728d-404a-a7c4-65f541f0d4c0 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:10:09.708813 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-43caaf7d-728d-404a-a7c4-65f541f0d4c0 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] [instance: 40abe9d9-d1bf-402c-b5a2-38d02d991aeb] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:10:09.713050 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-43caaf7d-728d-404a-a7c4-65f541f0d4c0 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:09.713685 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-43caaf7d-728d-404a-a7c4-65f541f0d4c0 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:09.714170 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-43caaf7d-728d-404a-a7c4-65f541f0d4c0 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:09.714894 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-43caaf7d-728d-404a-a7c4-65f541f0d4c0 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:09.715364 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-43caaf7d-728d-404a-a7c4-65f541f0d4c0 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:09.715932 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-43caaf7d-728d-404a-a7c4-65f541f0d4c0 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:09.928751 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=100 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:10:09.933730 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-43caaf7d-728d-404a-a7c4-65f541f0d4c0 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/40abe9d9-d1bf-402c-b5a2-38d02d991aeb" status: 200 len: 1463 microversion: 2.1 time: 0.232727 Sep 23 05:10:09.944996 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3418/6661] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:10:09 2022] GET /compute/v2.1/servers/40abe9d9-d1bf-402c-b5a2-38d02d991aeb => generated 1463 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:10:10.137499 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9efed24e-2bb4-4553-962a-03a4bd492784 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:10:10.137499 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-9efed24e-2bb4-4553-962a-03a4bd492784 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 7ad3508b-1d37-4c7b-82c7-be195566aacb] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:10:10.150181 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9efed24e-2bb4-4553-962a-03a4bd492784 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:10.154339 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9efed24e-2bb4-4553-962a-03a4bd492784 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:10.154998 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9efed24e-2bb4-4553-962a-03a4bd492784 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:10.161392 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9efed24e-2bb4-4553-962a-03a4bd492784 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:10.162100 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9efed24e-2bb4-4553-962a-03a4bd492784 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:10.162712 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9efed24e-2bb4-4553-962a-03a4bd492784 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:10.376201 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-9efed24e-2bb4-4553-962a-03a4bd492784 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:10:10.387317 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9efed24e-2bb4-4553-962a-03a4bd492784 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb" status: 200 len: 1342 microversion: 2.1 time: 0.255522 Sep 23 05:10:10.388123 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3244/6662] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:10:10 2022] GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb => generated 1342 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:10:10.960884 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a4da5936-950e-4dd5-9b8c-c876b099bbd2 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:10:10.965048 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a4da5936-950e-4dd5-9b8c-c876b099bbd2 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] [instance: 40abe9d9-d1bf-402c-b5a2-38d02d991aeb] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:10:10.974648 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:10:10.984952 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a4da5936-950e-4dd5-9b8c-c876b099bbd2 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:10.986477 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a4da5936-950e-4dd5-9b8c-c876b099bbd2 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:10.987202 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a4da5936-950e-4dd5-9b8c-c876b099bbd2 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:10.989865 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a4da5936-950e-4dd5-9b8c-c876b099bbd2 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:10.993548 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a4da5936-950e-4dd5-9b8c-c876b099bbd2 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:10.994964 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a4da5936-950e-4dd5-9b8c-c876b099bbd2 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:11.198642 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a4da5936-950e-4dd5-9b8c-c876b099bbd2 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/40abe9d9-d1bf-402c-b5a2-38d02d991aeb" status: 200 len: 1463 microversion: 2.1 time: 0.239614 Sep 23 05:10:11.200733 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3419/6663] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:10:10 2022] GET /compute/v2.1/servers/40abe9d9-d1bf-402c-b5a2-38d02d991aeb => generated 1463 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:10:11.412881 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-37ebd9f1-2740-4086-be41-3089b903c753 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:10:11.413520 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-37ebd9f1-2740-4086-be41-3089b903c753 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 7ad3508b-1d37-4c7b-82c7-be195566aacb] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:10:11.435541 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:10:11.437523 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-37ebd9f1-2740-4086-be41-3089b903c753 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:11.438226 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-37ebd9f1-2740-4086-be41-3089b903c753 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:11.439464 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-37ebd9f1-2740-4086-be41-3089b903c753 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:11.439838 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-37ebd9f1-2740-4086-be41-3089b903c753 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:11.440536 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-37ebd9f1-2740-4086-be41-3089b903c753 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:11.441202 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-37ebd9f1-2740-4086-be41-3089b903c753 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:11.630062 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-37ebd9f1-2740-4086-be41-3089b903c753 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:10:11.643946 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-37ebd9f1-2740-4086-be41-3089b903c753 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb" status: 200 len: 1342 microversion: 2.1 time: 0.235391 Sep 23 05:10:11.651407 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3245/6664] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:10:11 2022] GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb => generated 1342 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:10:12.225763 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-05115127-0e7a-43da-94a5-00885888ae8c tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:10:12.225763 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-05115127-0e7a-43da-94a5-00885888ae8c tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] [instance: 40abe9d9-d1bf-402c-b5a2-38d02d991aeb] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:10:12.237556 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:10:12.241149 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-05115127-0e7a-43da-94a5-00885888ae8c tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:12.245170 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-05115127-0e7a-43da-94a5-00885888ae8c tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:12.246260 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-05115127-0e7a-43da-94a5-00885888ae8c tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:12.248782 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-05115127-0e7a-43da-94a5-00885888ae8c tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:12.248782 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-05115127-0e7a-43da-94a5-00885888ae8c tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:12.248782 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-05115127-0e7a-43da-94a5-00885888ae8c tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:12.289176 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=6 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:10:12.593261 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-05115127-0e7a-43da-94a5-00885888ae8c tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/40abe9d9-d1bf-402c-b5a2-38d02d991aeb" status: 200 len: 1463 microversion: 2.1 time: 0.372036 Sep 23 05:10:12.594017 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3420/6665] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:10:12 2022] GET /compute/v2.1/servers/40abe9d9-d1bf-402c-b5a2-38d02d991aeb => generated 1463 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:10:12.679470 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5d3bfca4-7a78-41c8-bf3a-5f7b648ddca7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:10:12.680558 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5d3bfca4-7a78-41c8-bf3a-5f7b648ddca7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 7ad3508b-1d37-4c7b-82c7-be195566aacb] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:10:12.697433 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5d3bfca4-7a78-41c8-bf3a-5f7b648ddca7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:12.697433 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5d3bfca4-7a78-41c8-bf3a-5f7b648ddca7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:12.697817 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5d3bfca4-7a78-41c8-bf3a-5f7b648ddca7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:12.699070 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5d3bfca4-7a78-41c8-bf3a-5f7b648ddca7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:12.699971 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5d3bfca4-7a78-41c8-bf3a-5f7b648ddca7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:12.700834 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5d3bfca4-7a78-41c8-bf3a-5f7b648ddca7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:12.883358 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-5d3bfca4-7a78-41c8-bf3a-5f7b648ddca7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:10:12.891764 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5d3bfca4-7a78-41c8-bf3a-5f7b648ddca7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb" status: 200 len: 1342 microversion: 2.1 time: 0.217469 Sep 23 05:10:12.892365 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3246/6666] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:10:12 2022] GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb => generated 1342 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:10:13.619163 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ad7e02a4-54ba-483f-bb62-34cd3f65498a tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:10:13.621488 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ad7e02a4-54ba-483f-bb62-34cd3f65498a tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] [instance: 40abe9d9-d1bf-402c-b5a2-38d02d991aeb] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:10:13.628567 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ad7e02a4-54ba-483f-bb62-34cd3f65498a tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:13.629099 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ad7e02a4-54ba-483f-bb62-34cd3f65498a tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:13.629525 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ad7e02a4-54ba-483f-bb62-34cd3f65498a tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:13.632115 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ad7e02a4-54ba-483f-bb62-34cd3f65498a tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:13.634476 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ad7e02a4-54ba-483f-bb62-34cd3f65498a tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:13.634933 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ad7e02a4-54ba-483f-bb62-34cd3f65498a tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:13.747477 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-414ce1a7-e9e0-4cac-9bb8-b53c98a9dd80 req-8d320dd6-8980-4529-a3f1-3c21ca4a5615 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40abe9d9-d1bf-402c-b5a2-38d02d991aeb", "name": "network-vif-plugged", "status": "completed", "tag": "6c40ca06-6258-48a3-871c-a0965cfb57ad"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:10:13.768081 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=4 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:10:13.774146 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-414ce1a7-e9e0-4cac-9bb8-b53c98a9dd80 req-8d320dd6-8980-4529-a3f1-3c21ca4a5615 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:13.774648 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-414ce1a7-e9e0-4cac-9bb8-b53c98a9dd80 req-8d320dd6-8980-4529-a3f1-3c21ca4a5615 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:13.775095 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-414ce1a7-e9e0-4cac-9bb8-b53c98a9dd80 req-8d320dd6-8980-4529-a3f1-3c21ca4a5615 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:13.799739 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-414ce1a7-e9e0-4cac-9bb8-b53c98a9dd80 req-8d320dd6-8980-4529-a3f1-3c21ca4a5615 service nova] Creating event network-vif-plugged:6c40ca06-6258-48a3-871c-a0965cfb57ad for instance 40abe9d9-d1bf-402c-b5a2-38d02d991aeb on n-h2-846463-3 Sep 23 05:10:13.811327 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-414ce1a7-e9e0-4cac-9bb8-b53c98a9dd80 req-8d320dd6-8980-4529-a3f1-3c21ca4a5615 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068915 Sep 23 05:10:13.813522 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3247/6667] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:10:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 05:10:13.919378 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-eb72c716-cd87-4bce-9949-a255ef4e9366 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:10:13.919672 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-eb72c716-cd87-4bce-9949-a255ef4e9366 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 7ad3508b-1d37-4c7b-82c7-be195566aacb] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:10:13.950154 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-eb72c716-cd87-4bce-9949-a255ef4e9366 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:13.951193 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-eb72c716-cd87-4bce-9949-a255ef4e9366 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:13.951692 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-eb72c716-cd87-4bce-9949-a255ef4e9366 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:13.954768 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-eb72c716-cd87-4bce-9949-a255ef4e9366 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:13.955601 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-eb72c716-cd87-4bce-9949-a255ef4e9366 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:13.958265 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-eb72c716-cd87-4bce-9949-a255ef4e9366 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:13.973746 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ad7e02a4-54ba-483f-bb62-34cd3f65498a tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/40abe9d9-d1bf-402c-b5a2-38d02d991aeb" status: 200 len: 1463 microversion: 2.1 time: 0.359433 Sep 23 05:10:13.976688 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3421/6668] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:10:13 2022] GET /compute/v2.1/servers/40abe9d9-d1bf-402c-b5a2-38d02d991aeb => generated 1463 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:10:14.155300 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-eb72c716-cd87-4bce-9949-a255ef4e9366 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:10:14.162129 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=100 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:10:14.165130 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-eb72c716-cd87-4bce-9949-a255ef4e9366 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb" status: 200 len: 1342 microversion: 2.1 time: 0.252867 Sep 23 05:10:14.165805 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3248/6669] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:10:13 2022] GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb => generated 1342 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:10:14.997699 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-fc5baab8-d0a8-4255-957a-434d0f712f19 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:10:14.998288 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-fc5baab8-d0a8-4255-957a-434d0f712f19 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] [instance: 40abe9d9-d1bf-402c-b5a2-38d02d991aeb] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:10:15.015437 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fc5baab8-d0a8-4255-957a-434d0f712f19 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:15.016044 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fc5baab8-d0a8-4255-957a-434d0f712f19 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:15.016495 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fc5baab8-d0a8-4255-957a-434d0f712f19 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:15.017201 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fc5baab8-d0a8-4255-957a-434d0f712f19 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:15.017674 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fc5baab8-d0a8-4255-957a-434d0f712f19 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:15.018158 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fc5baab8-d0a8-4255-957a-434d0f712f19 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:15.182898 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-fc5baab8-d0a8-4255-957a-434d0f712f19 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/40abe9d9-d1bf-402c-b5a2-38d02d991aeb" status: 200 len: 1463 microversion: 2.1 time: 0.188798 Sep 23 05:10:15.185069 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3422/6670] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:10:14 2022] GET /compute/v2.1/servers/40abe9d9-d1bf-402c-b5a2-38d02d991aeb => generated 1463 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:10:15.208171 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0072eec8-0431-4c81-b061-179aaac86422 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:10:15.213198 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-0072eec8-0431-4c81-b061-179aaac86422 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 7ad3508b-1d37-4c7b-82c7-be195566aacb] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:10:15.217523 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0072eec8-0431-4c81-b061-179aaac86422 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:15.218519 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0072eec8-0431-4c81-b061-179aaac86422 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:15.224845 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0072eec8-0431-4c81-b061-179aaac86422 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:15.225925 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0072eec8-0431-4c81-b061-179aaac86422 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:15.226586 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0072eec8-0431-4c81-b061-179aaac86422 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:15.228557 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0072eec8-0431-4c81-b061-179aaac86422 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:15.413956 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-0072eec8-0431-4c81-b061-179aaac86422 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:10:15.422091 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0072eec8-0431-4c81-b061-179aaac86422 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb" status: 200 len: 1342 microversion: 2.1 time: 0.220326 Sep 23 05:10:15.423843 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3249/6671] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:10:15 2022] GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb => generated 1342 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:10:16.209741 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-572c589c-eda1-4618-87e7-c245edfc9194 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:10:16.210891 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-572c589c-eda1-4618-87e7-c245edfc9194 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] [instance: 40abe9d9-d1bf-402c-b5a2-38d02d991aeb] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:10:16.223415 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-572c589c-eda1-4618-87e7-c245edfc9194 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:16.223917 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-572c589c-eda1-4618-87e7-c245edfc9194 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:16.264542 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-572c589c-eda1-4618-87e7-c245edfc9194 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:16.266101 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-572c589c-eda1-4618-87e7-c245edfc9194 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:16.267498 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-572c589c-eda1-4618-87e7-c245edfc9194 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:16.268135 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-572c589c-eda1-4618-87e7-c245edfc9194 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:16.453393 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a76e0520-e54d-4974-9122-975a77385d01 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:10:16.454618 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a76e0520-e54d-4974-9122-975a77385d01 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 7ad3508b-1d37-4c7b-82c7-be195566aacb] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:10:16.462286 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a76e0520-e54d-4974-9122-975a77385d01 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:16.463111 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a76e0520-e54d-4974-9122-975a77385d01 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:16.463778 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a76e0520-e54d-4974-9122-975a77385d01 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:16.464729 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a76e0520-e54d-4974-9122-975a77385d01 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:16.465508 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a76e0520-e54d-4974-9122-975a77385d01 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:16.466188 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a76e0520-e54d-4974-9122-975a77385d01 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:16.511156 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-572c589c-eda1-4618-87e7-c245edfc9194 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/40abe9d9-d1bf-402c-b5a2-38d02d991aeb" status: 200 len: 1648 microversion: 2.1 time: 0.306996 Sep 23 05:10:16.512386 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3423/6672] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:10:16 2022] GET /compute/v2.1/servers/40abe9d9-d1bf-402c-b5a2-38d02d991aeb => generated 1648 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:10:16.535748 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-821d9143-77fc-462b-89ff-d509727604f3 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:10:16.537314 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-821d9143-77fc-462b-89ff-d509727604f3 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] [instance: 40abe9d9-d1bf-402c-b5a2-38d02d991aeb] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:10:16.544829 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-821d9143-77fc-462b-89ff-d509727604f3 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:16.545595 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-821d9143-77fc-462b-89ff-d509727604f3 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:16.546268 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-821d9143-77fc-462b-89ff-d509727604f3 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:16.547384 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-821d9143-77fc-462b-89ff-d509727604f3 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:16.548115 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-821d9143-77fc-462b-89ff-d509727604f3 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:16.548724 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-821d9143-77fc-462b-89ff-d509727604f3 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:16.969155 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a76e0520-e54d-4974-9122-975a77385d01 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:10:16.981252 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a76e0520-e54d-4974-9122-975a77385d01 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb" status: 200 len: 1342 microversion: 2.1 time: 0.532372 Sep 23 05:10:16.982012 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3250/6673] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:10:16 2022] GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb => generated 1342 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:10:16.988610 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-821d9143-77fc-462b-89ff-d509727604f3 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/40abe9d9-d1bf-402c-b5a2-38d02d991aeb" status: 200 len: 1648 microversion: 2.1 time: 0.458333 Sep 23 05:10:16.989865 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3424/6674] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:10:16 2022] GET /compute/v2.1/servers/40abe9d9-d1bf-402c-b5a2-38d02d991aeb => generated 1648 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:10:17.016554 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0edba0f2-47ab-430e-b389-3c40bb3f087e tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:10:17.017232 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-0edba0f2-47ab-430e-b389-3c40bb3f087e tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] [instance: 40abe9d9-d1bf-402c-b5a2-38d02d991aeb] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:10:17.023580 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0edba0f2-47ab-430e-b389-3c40bb3f087e tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:17.024097 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0edba0f2-47ab-430e-b389-3c40bb3f087e tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:17.024558 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0edba0f2-47ab-430e-b389-3c40bb3f087e tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:17.025353 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0edba0f2-47ab-430e-b389-3c40bb3f087e tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:17.025828 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0edba0f2-47ab-430e-b389-3c40bb3f087e tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:17.026305 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0edba0f2-47ab-430e-b389-3c40bb3f087e tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:17.214432 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0edba0f2-47ab-430e-b389-3c40bb3f087e tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/40abe9d9-d1bf-402c-b5a2-38d02d991aeb" status: 200 len: 1648 microversion: 2.1 time: 0.201683 Sep 23 05:10:17.219865 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3251/6675] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:10:17 2022] GET /compute/v2.1/servers/40abe9d9-d1bf-402c-b5a2-38d02d991aeb => generated 1648 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:10:17.237127 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3cea8ee8-34bf-450d-9d84-a25e347797cc tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:10:17.238232 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-3cea8ee8-34bf-450d-9d84-a25e347797cc tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] [instance: 40abe9d9-d1bf-402c-b5a2-38d02d991aeb] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:10:17.245026 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3cea8ee8-34bf-450d-9d84-a25e347797cc tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:17.245530 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3cea8ee8-34bf-450d-9d84-a25e347797cc tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:17.245995 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3cea8ee8-34bf-450d-9d84-a25e347797cc tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:17.246941 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3cea8ee8-34bf-450d-9d84-a25e347797cc tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:17.247603 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3cea8ee8-34bf-450d-9d84-a25e347797cc tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:17.248245 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3cea8ee8-34bf-450d-9d84-a25e347797cc tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:17.276464 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-3cea8ee8-34bf-450d-9d84-a25e347797cc tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] [instance: 40abe9d9-d1bf-402c-b5a2-38d02d991aeb] Going to try to terminate instance {{(pid=122699) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 05:10:17.681665 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3cea8ee8-34bf-450d-9d84-a25e347797cc tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] 10.222.0.33 "DELETE /compute/v2.1/servers/40abe9d9-d1bf-402c-b5a2-38d02d991aeb" status: 204 len: 0 microversion: 2.1 time: 0.447805 Sep 23 05:10:17.682194 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3425/6676] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 05:10:17 2022] DELETE /compute/v2.1/servers/40abe9d9-d1bf-402c-b5a2-38d02d991aeb => generated 0 bytes in 449 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 05:10:17.691037 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-99e07062-92da-46a8-887d-db3ece41feb6 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:10:17.692403 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-99e07062-92da-46a8-887d-db3ece41feb6 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] [instance: 40abe9d9-d1bf-402c-b5a2-38d02d991aeb] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:10:17.699442 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-99e07062-92da-46a8-887d-db3ece41feb6 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:17.700020 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-99e07062-92da-46a8-887d-db3ece41feb6 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:17.700547 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-99e07062-92da-46a8-887d-db3ece41feb6 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:17.701455 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-99e07062-92da-46a8-887d-db3ece41feb6 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:17.702190 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-99e07062-92da-46a8-887d-db3ece41feb6 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:17.702707 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-99e07062-92da-46a8-887d-db3ece41feb6 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:17.843185 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-99e07062-92da-46a8-887d-db3ece41feb6 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/40abe9d9-d1bf-402c-b5a2-38d02d991aeb" status: 200 len: 1654 microversion: 2.1 time: 0.155965 Sep 23 05:10:17.843791 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3252/6677] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:10:17 2022] GET /compute/v2.1/servers/40abe9d9-d1bf-402c-b5a2-38d02d991aeb => generated 1654 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:10:18.005950 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1797a804-78d9-402f-af0c-0e9b56b31197 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:10:18.006673 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1797a804-78d9-402f-af0c-0e9b56b31197 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 7ad3508b-1d37-4c7b-82c7-be195566aacb] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:10:18.013846 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1797a804-78d9-402f-af0c-0e9b56b31197 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:18.014602 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1797a804-78d9-402f-af0c-0e9b56b31197 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:18.015063 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1797a804-78d9-402f-af0c-0e9b56b31197 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:18.016489 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1797a804-78d9-402f-af0c-0e9b56b31197 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:18.016489 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1797a804-78d9-402f-af0c-0e9b56b31197 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:18.017092 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1797a804-78d9-402f-af0c-0e9b56b31197 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:18.156930 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1797a804-78d9-402f-af0c-0e9b56b31197 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:10:18.165372 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1797a804-78d9-402f-af0c-0e9b56b31197 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb" status: 200 len: 1342 microversion: 2.1 time: 0.164462 Sep 23 05:10:18.166075 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3426/6678] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:10:17 2022] GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb => generated 1342 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:10:18.541845 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3b07ed55-22fd-4b1f-a7e2-5cecd5621272 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Action: 'create', calling method: .version_select at 0x7ff1bb96a8b0>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-491251806", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIhF96WFA4rThhwhUwXfGZvd2tk8Qk89SbHVk1qW3oE9Sn/5j0neYr0WbBxtLoAVN4bGlvCIBkLVMWJZHGzHs+gzgD3ZTlA8hyYO6XnqsYjO/AIeILP+b5R5SIH5rNH95Q=="}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:10:18.559874 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-3b07ed55-22fd-4b1f-a7e2-5cecd5621272 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Getting quotas for project 116ae3ab00e447f89c7e8210ba89be75. Resources: {'key_pairs'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 05:10:18.565323 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-3b07ed55-22fd-4b1f-a7e2-5cecd5621272 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Getting quotas for user 82736eb912544711991da4f27c321f8a and project 116ae3ab00e447f89c7e8210ba89be75. Resources: {'key_pairs'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 05:10:18.688300 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3b07ed55-22fd-4b1f-a7e2-5cecd5621272 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 0.149201 Sep 23 05:10:18.688300 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3253/6679] 10.222.0.33 () {60 vars in 1159 bytes} [Fri Sep 23 05:10:18 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:10:18.867749 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ec5dd941-e869-43f7-96b6-32dd83163309 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:10:18.868379 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ec5dd941-e869-43f7-96b6-32dd83163309 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] [instance: 40abe9d9-d1bf-402c-b5a2-38d02d991aeb] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:10:18.878788 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ec5dd941-e869-43f7-96b6-32dd83163309 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:18.879303 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ec5dd941-e869-43f7-96b6-32dd83163309 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:18.879964 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ec5dd941-e869-43f7-96b6-32dd83163309 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:18.880912 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ec5dd941-e869-43f7-96b6-32dd83163309 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:18.881470 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ec5dd941-e869-43f7-96b6-32dd83163309 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:18.881992 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ec5dd941-e869-43f7-96b6-32dd83163309 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:19.085705 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ec5dd941-e869-43f7-96b6-32dd83163309 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/40abe9d9-d1bf-402c-b5a2-38d02d991aeb" status: 200 len: 1654 microversion: 2.1 time: 0.222027 Sep 23 05:10:19.086314 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3427/6680] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:10:18 2022] GET /compute/v2.1/servers/40abe9d9-d1bf-402c-b5a2-38d02d991aeb => generated 1654 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:10:19.195973 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6cbd87da-f60a-4eec-ba6d-0c396b8e591d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:10:19.195973 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-6cbd87da-f60a-4eec-ba6d-0c396b8e591d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 7ad3508b-1d37-4c7b-82c7-be195566aacb] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:10:19.200851 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6cbd87da-f60a-4eec-ba6d-0c396b8e591d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:19.201369 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6cbd87da-f60a-4eec-ba6d-0c396b8e591d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:19.201832 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6cbd87da-f60a-4eec-ba6d-0c396b8e591d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:19.202582 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6cbd87da-f60a-4eec-ba6d-0c396b8e591d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:19.203064 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6cbd87da-f60a-4eec-ba6d-0c396b8e591d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:19.203536 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6cbd87da-f60a-4eec-ba6d-0c396b8e591d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:19.399601 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6cbd87da-f60a-4eec-ba6d-0c396b8e591d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:10:19.408453 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-6cbd87da-f60a-4eec-ba6d-0c396b8e591d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb" status: 200 len: 1342 microversion: 2.1 time: 0.223220 Sep 23 05:10:19.411302 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3254/6681] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:10:19 2022] GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb => generated 1342 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:10:19.781125 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-3343ee22-4614-42f8-8e31-ad42308cf023 req-ef8b4f13-1ec8-4f66-9e1f-c2d5115446a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40abe9d9-d1bf-402c-b5a2-38d02d991aeb", "name": "network-vif-deleted", "tag": "6c40ca06-6258-48a3-871c-a0965cfb57ad"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:10:19.795964 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-3343ee22-4614-42f8-8e31-ad42308cf023 req-ef8b4f13-1ec8-4f66-9e1f-c2d5115446a5 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:19.801624 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-3343ee22-4614-42f8-8e31-ad42308cf023 req-ef8b4f13-1ec8-4f66-9e1f-c2d5115446a5 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:19.802303 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-3343ee22-4614-42f8-8e31-ad42308cf023 req-ef8b4f13-1ec8-4f66-9e1f-c2d5115446a5 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:19.837528 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-3343ee22-4614-42f8-8e31-ad42308cf023 req-ef8b4f13-1ec8-4f66-9e1f-c2d5115446a5 service nova] Creating event network-vif-deleted:6c40ca06-6258-48a3-871c-a0965cfb57ad for instance 40abe9d9-d1bf-402c-b5a2-38d02d991aeb on n-h2-846463-3 Sep 23 05:10:19.851767 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-3343ee22-4614-42f8-8e31-ad42308cf023 req-ef8b4f13-1ec8-4f66-9e1f-c2d5115446a5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076992 Sep 23 05:10:19.856326 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3428/6682] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:10:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 05:10:20.111209 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ee49fc3e-e097-4d1c-bbc0-60484205bd61 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:10:20.112211 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-ee49fc3e-e097-4d1c-bbc0-60484205bd61 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] [instance: 40abe9d9-d1bf-402c-b5a2-38d02d991aeb] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:10:20.124822 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ee49fc3e-e097-4d1c-bbc0-60484205bd61 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:20.125565 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ee49fc3e-e097-4d1c-bbc0-60484205bd61 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:20.126137 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ee49fc3e-e097-4d1c-bbc0-60484205bd61 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:20.128176 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ee49fc3e-e097-4d1c-bbc0-60484205bd61 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:20.135085 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ee49fc3e-e097-4d1c-bbc0-60484205bd61 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:20.135627 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ee49fc3e-e097-4d1c-bbc0-60484205bd61 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:20.221678 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ee49fc3e-e097-4d1c-bbc0-60484205bd61 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/40abe9d9-d1bf-402c-b5a2-38d02d991aeb" status: 200 len: 1448 microversion: 2.1 time: 0.114201 Sep 23 05:10:20.222629 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3255/6683] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:10:20 2022] GET /compute/v2.1/servers/40abe9d9-d1bf-402c-b5a2-38d02d991aeb => generated 1448 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:10:20.434149 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-36bf5470-af5c-4237-9f2d-b307c8f70a64 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:10:20.435600 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-36bf5470-af5c-4237-9f2d-b307c8f70a64 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 7ad3508b-1d37-4c7b-82c7-be195566aacb] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:10:20.442950 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-36bf5470-af5c-4237-9f2d-b307c8f70a64 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:20.443452 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-36bf5470-af5c-4237-9f2d-b307c8f70a64 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:20.443889 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-36bf5470-af5c-4237-9f2d-b307c8f70a64 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:20.444984 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-36bf5470-af5c-4237-9f2d-b307c8f70a64 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:20.445654 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-36bf5470-af5c-4237-9f2d-b307c8f70a64 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:20.446322 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-36bf5470-af5c-4237-9f2d-b307c8f70a64 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:20.639814 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-36bf5470-af5c-4237-9f2d-b307c8f70a64 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:10:20.648170 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-36bf5470-af5c-4237-9f2d-b307c8f70a64 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb" status: 200 len: 1342 microversion: 2.1 time: 0.218404 Sep 23 05:10:20.648758 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3429/6684] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:10:20 2022] GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb => generated 1342 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:10:21.247193 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7443374a-c478-4003-ba55-bb5fc2c1f4e2 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:10:21.247830 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7443374a-c478-4003-ba55-bb5fc2c1f4e2 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] [instance: 40abe9d9-d1bf-402c-b5a2-38d02d991aeb] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:10:21.255815 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7443374a-c478-4003-ba55-bb5fc2c1f4e2 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:21.256259 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7443374a-c478-4003-ba55-bb5fc2c1f4e2 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:21.256724 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7443374a-c478-4003-ba55-bb5fc2c1f4e2 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:21.257462 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7443374a-c478-4003-ba55-bb5fc2c1f4e2 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:21.258142 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7443374a-c478-4003-ba55-bb5fc2c1f4e2 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:21.258764 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7443374a-c478-4003-ba55-bb5fc2c1f4e2 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:21.293488 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7443374a-c478-4003-ba55-bb5fc2c1f4e2 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:21.294053 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7443374a-c478-4003-ba55-bb5fc2c1f4e2 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:21.294520 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7443374a-c478-4003-ba55-bb5fc2c1f4e2 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:21.295178 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-7443374a-c478-4003-ba55-bb5fc2c1f4e2 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lazy-loading 'fault' on Instance uuid 40abe9d9-d1bf-402c-b5a2-38d02d991aeb {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 05:10:21.351256 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7443374a-c478-4003-ba55-bb5fc2c1f4e2 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/40abe9d9-d1bf-402c-b5a2-38d02d991aeb" status: 200 len: 1453 microversion: 2.1 time: 0.109575 Sep 23 05:10:21.357655 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3256/6685] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:10:21 2022] GET /compute/v2.1/servers/40abe9d9-d1bf-402c-b5a2-38d02d991aeb => generated 1453 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:10:21.671745 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5532aa8c-4905-4e65-807c-4b3415b9b637 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:10:21.672298 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-5532aa8c-4905-4e65-807c-4b3415b9b637 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 7ad3508b-1d37-4c7b-82c7-be195566aacb] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:10:21.679067 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5532aa8c-4905-4e65-807c-4b3415b9b637 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:21.692292 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5532aa8c-4905-4e65-807c-4b3415b9b637 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:21.692292 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5532aa8c-4905-4e65-807c-4b3415b9b637 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:21.692292 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5532aa8c-4905-4e65-807c-4b3415b9b637 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:21.692292 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5532aa8c-4905-4e65-807c-4b3415b9b637 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:21.692292 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5532aa8c-4905-4e65-807c-4b3415b9b637 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:21.849578 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-5532aa8c-4905-4e65-807c-4b3415b9b637 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:10:21.860163 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5532aa8c-4905-4e65-807c-4b3415b9b637 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb" status: 200 len: 1342 microversion: 2.1 time: 0.192450 Sep 23 05:10:21.861308 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3430/6686] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:10:21 2022] GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb => generated 1342 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:10:22.123247 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c0c5012c-85c9-42e4-ae74-9f2cb9b6548e tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-754743845", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "3636ff5f-73ca-4d71-bbd7-745ced8a6d44", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-491251806", "security_groups": [{"name": "tempest-secgroup-smoke-2050622483"}], "networks": [{"uuid": "8ac78fd7-9719-49c9-9308-661c66efa780"}]}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:10:22.262792 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.network.neutron [None req-c0c5012c-85c9-42e4-ae74-9f2cb9b6548e tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] validate_networks() for [('8ac78fd7-9719-49c9-9308-661c66efa780', None, None, None, None, None)] {{(pid=122698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 05:10:22.378858 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-75c1a3a3-458c-4f7d-809d-08f39d48969b tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:10:22.380920 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-75c1a3a3-458c-4f7d-809d-08f39d48969b tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] [instance: 40abe9d9-d1bf-402c-b5a2-38d02d991aeb] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:10:22.390288 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-75c1a3a3-458c-4f7d-809d-08f39d48969b tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:22.394963 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-75c1a3a3-458c-4f7d-809d-08f39d48969b tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:22.394963 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-75c1a3a3-458c-4f7d-809d-08f39d48969b tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:22.394963 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-75c1a3a3-458c-4f7d-809d-08f39d48969b tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:22.394963 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-75c1a3a3-458c-4f7d-809d-08f39d48969b tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:22.394963 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-75c1a3a3-458c-4f7d-809d-08f39d48969b tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:22.409462 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-75c1a3a3-458c-4f7d-809d-08f39d48969b tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] HTTP exception thrown: Instance 40abe9d9-d1bf-402c-b5a2-38d02d991aeb could not be found. Sep 23 05:10:22.411663 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-75c1a3a3-458c-4f7d-809d-08f39d48969b tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Request method failure captured: Sep 23 05:10:22.411663 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/40abe9d9-d1bf-402c-b5a2-38d02d991aeb HTTP/1.1 Sep 23 05:10:22.411663 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 05:10:22.411663 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 05:10:22.411663 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 05:10:22.411663 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 05:10:22.411663 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 05:10:22.411663 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 05:10:22.411663 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 05:10:22.411663 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 05:10:22.411663 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLT-YnRJ7fZ-CqkT5_9FtnKb77Hj-2TJAJuE2qVJUV7D8gtVrp3QSbhTO_l3aQC1pNw0auHkvgAy83lYmN3_mehG_dvP_ESTDLgsHJX7kRfKG46vpMAn4BhJbuKZDsu6FsunHTxOjRbdI1s05iYZozLuZ3OXTHLCG03yDD1-NskhUKvs Sep 23 05:10:22.411663 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 05:10:22.411663 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 05:10:22.411663 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 05:10:22.411663 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 05:10:22.411663 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 05:10:22.411663 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 05:10:22.411663 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 101ce576f12c41519e9120f803ce1064 Sep 23 05:10:22.411663 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-TestServerMultinode-1831957826 Sep 23 05:10:22.411663 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,admin,member Sep 23 05:10:22.411663 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,admin,member Sep 23 05:10:22.411663 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_101ce576f12c41519e9120f803ce1064", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/101ce576f12c41519e9120f803ce1064"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/101ce576f12c41519e9120f803ce1064"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/101ce576f12c41519e9120f803ce1064"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:10:22.411663 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-TestServerMultinode-1831957826 Sep 23 05:10:22.411663 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 101ce576f12c41519e9120f803ce1064 Sep 23 05:10:22.411663 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-TestServerMultinode-1831957826 Sep 23 05:10:22.411663 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-TestServerMultinode-1831957826-project-admin Sep 23 05:10:22.411663 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 05:10:22.411663 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 05:10:22.411663 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 3c490bfc9eee403f9448b6967a2e5665 Sep 23 05:10:22.411663 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-TestServerMultinode-1831957826-project-admin Sep 23 05:10:22.411663 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 05:10:22.411663 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 40abe9d9-d1bf-402c-b5a2-38d02d991aeb could not be found. Sep 23 05:10:22.411663 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '40abe9d9-d1bf-402c-b5a2-38d02d991aeb'} Sep 23 05:10:22.411663 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:10:22.411663 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:10:22.411663 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 05:10:22.411663 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 05:10:22.411663 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 05:10:22.411663 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 05:10:22.411663 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 05:10:22.411663 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 05:10:22.411663 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 05:10:22.411663 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 05:10:22.411663 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40abe9d9-d1bf-402c-b5a2-38d02d991aeb could not be found. Sep 23 05:10:22.411663 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:10:22.411663 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:10:22.411663 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:10:22.411663 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:10:22.411663 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:10:22.411663 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:10:22.411663 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:10:22.411663 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:10:22.411663 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:10:22.411663 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:10:22.411663 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 05:10:22.411663 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 05:10:22.411663 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 05:10:22.411663 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 05:10:22.411663 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 05:10:22.411663 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:10:22.411663 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40abe9d9-d1bf-402c-b5a2-38d02d991aeb could not be found. Sep 23 05:10:22.411663 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:10:22.411663 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:10:22.411663 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:10:22.415725 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:10:22.415725 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:10:22.415725 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:10:22.415725 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:10:22.415725 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:10:22.415725 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40abe9d9-d1bf-402c-b5a2-38d02d991aeb could not be found. Sep 23 05:10:22.415725 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:10:22.417658 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-75c1a3a3-458c-4f7d-809d-08f39d48969b tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Returning 404 to user: Instance 40abe9d9-d1bf-402c-b5a2-38d02d991aeb could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:10:22.418837 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-75c1a3a3-458c-4f7d-809d-08f39d48969b tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/40abe9d9-d1bf-402c-b5a2-38d02d991aeb" status: 404 len: 111 microversion: 2.1 time: 0.046198 Sep 23 05:10:22.419910 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3431/6687] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:10:22 2022] GET /compute/v2.1/servers/40abe9d9-d1bf-402c-b5a2-38d02d991aeb => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 05:10:22.432423 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-dd12b2ce-0a0d-499d-a519-dc9007912078 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:10:22.433038 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-dd12b2ce-0a0d-499d-a519-dc9007912078 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] [instance: a8c3a4c4-20d7-4d1b-beae-e013b32a74aa] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:10:22.440734 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dd12b2ce-0a0d-499d-a519-dc9007912078 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:22.441323 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dd12b2ce-0a0d-499d-a519-dc9007912078 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:22.442569 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dd12b2ce-0a0d-499d-a519-dc9007912078 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:22.443371 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dd12b2ce-0a0d-499d-a519-dc9007912078 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:22.444048 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dd12b2ce-0a0d-499d-a519-dc9007912078 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:22.444610 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dd12b2ce-0a0d-499d-a519-dc9007912078 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:22.480019 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-dd12b2ce-0a0d-499d-a519-dc9007912078 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] [instance: a8c3a4c4-20d7-4d1b-beae-e013b32a74aa] Going to try to terminate instance {{(pid=122699) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 05:10:22.809665 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-c0c5012c-85c9-42e4-ae74-9f2cb9b6548e tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Flavor limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 05:10:22.810783 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-c0c5012c-85c9-42e4-ae74-9f2cb9b6548e tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Image limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 05:10:22.810783 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-c0c5012c-85c9-42e4-ae74-9f2cb9b6548e tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Flavor pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 05:10:22.811372 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-c0c5012c-85c9-42e4-ae74-9f2cb9b6548e tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Image pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 05:10:22.811998 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-c0c5012c-85c9-42e4-ae74-9f2cb9b6548e tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 05:10:22.822105 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c0c5012c-85c9-42e4-ae74-9f2cb9b6548e tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:22.822614 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c0c5012c-85c9-42e4-ae74-9f2cb9b6548e tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:22.823218 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c0c5012c-85c9-42e4-ae74-9f2cb9b6548e tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:22.824044 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c0c5012c-85c9-42e4-ae74-9f2cb9b6548e tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:22.824606 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c0c5012c-85c9-42e4-ae74-9f2cb9b6548e tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:22.825256 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c0c5012c-85c9-42e4-ae74-9f2cb9b6548e tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:22.843293 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-c0c5012c-85c9-42e4-ae74-9f2cb9b6548e tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Getting quotas for project 116ae3ab00e447f89c7e8210ba89be75. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 05:10:22.849222 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-c0c5012c-85c9-42e4-ae74-9f2cb9b6548e tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Getting quotas for user 82736eb912544711991da4f27c321f8a and project 116ae3ab00e447f89c7e8210ba89be75. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 05:10:22.862816 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-dd12b2ce-0a0d-499d-a519-dc9007912078 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] 10.222.0.33 "DELETE /compute/v2.1/servers/a8c3a4c4-20d7-4d1b-beae-e013b32a74aa" status: 204 len: 0 microversion: 2.1 time: 0.437921 Sep 23 05:10:22.864353 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3432/6688] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 05:10:22 2022] DELETE /compute/v2.1/servers/a8c3a4c4-20d7-4d1b-beae-e013b32a74aa => generated 0 bytes in 440 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 05:10:22.875063 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1975b283-94c2-49a4-a7de-2df39a029df3 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:10:22.875811 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1975b283-94c2-49a4-a7de-2df39a029df3 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] [instance: a8c3a4c4-20d7-4d1b-beae-e013b32a74aa] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:10:22.882710 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1975b283-94c2-49a4-a7de-2df39a029df3 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:22.883204 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1975b283-94c2-49a4-a7de-2df39a029df3 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:22.883649 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1975b283-94c2-49a4-a7de-2df39a029df3 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:22.884610 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1975b283-94c2-49a4-a7de-2df39a029df3 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:22.885072 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1975b283-94c2-49a4-a7de-2df39a029df3 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:22.885492 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1975b283-94c2-49a4-a7de-2df39a029df3 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:22.908487 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:10:22.914173 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c0c5012c-85c9-42e4-ae74-9f2cb9b6548e tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Going to run 1 instances... {{(pid=122698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 05:10:22.916948 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c0c5012c-85c9-42e4-ae74-9f2cb9b6548e tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] [instance: 0d0f17c3-e777-4c71-a9df-b2de76f0615a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3636ff5f-73ca-4d71-bbd7-745ced8a6d44',volume_size=None,volume_type=None)] {{(pid=122698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 05:10:23.032267 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1975b283-94c2-49a4-a7de-2df39a029df3 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/a8c3a4c4-20d7-4d1b-beae-e013b32a74aa" status: 200 len: 1653 microversion: 2.1 time: 0.161166 Sep 23 05:10:23.032926 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3433/6689] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:10:22 2022] GET /compute/v2.1/servers/a8c3a4c4-20d7-4d1b-beae-e013b32a74aa => generated 1653 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:10:23.041730 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c8f50a89-68f3-4de9-b3e7-7c8149325e66 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:10:23.042380 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c8f50a89-68f3-4de9-b3e7-7c8149325e66 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 7ad3508b-1d37-4c7b-82c7-be195566aacb] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:10:23.049108 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c8f50a89-68f3-4de9-b3e7-7c8149325e66 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:23.049602 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c8f50a89-68f3-4de9-b3e7-7c8149325e66 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:23.050086 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c8f50a89-68f3-4de9-b3e7-7c8149325e66 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:23.050785 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c8f50a89-68f3-4de9-b3e7-7c8149325e66 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:23.051309 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c8f50a89-68f3-4de9-b3e7-7c8149325e66 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:23.051709 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c8f50a89-68f3-4de9-b3e7-7c8149325e66 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:23.219915 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c8f50a89-68f3-4de9-b3e7-7c8149325e66 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:10:23.228139 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c8f50a89-68f3-4de9-b3e7-7c8149325e66 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb" status: 200 len: 1342 microversion: 2.1 time: 0.193812 Sep 23 05:10:23.228697 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3434/6690] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:10:23 2022] GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb => generated 1342 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:10:23.488190 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c0c5012c-85c9-42e4-ae74-9f2cb9b6548e tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.369224 Sep 23 05:10:23.489661 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3257/6691] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 05:10:22 2022] POST /compute/v2.1/servers => generated 406 bytes in 1372 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 05:10:23.501450 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-bbebcfe9-8119-4d31-aa5c-82b22799d60e tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:10:23.502114 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-bbebcfe9-8119-4d31-aa5c-82b22799d60e tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] [instance: 0d0f17c3-e777-4c71-a9df-b2de76f0615a] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:10:23.593391 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-bbebcfe9-8119-4d31-aa5c-82b22799d60e tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82736eb912544711991da4f27c321f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116ae3ab00e447f89c7e8210ba89be75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:10:23.603022 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-bbebcfe9-8119-4d31-aa5c-82b22799d60e tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] 10.222.0.33 "GET /compute/v2.1/servers/0d0f17c3-e777-4c71-a9df-b2de76f0615a" status: 200 len: 1097 microversion: 2.1 time: 0.106243 Sep 23 05:10:23.604077 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3435/6692] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:10:23 2022] GET /compute/v2.1/servers/0d0f17c3-e777-4c71-a9df-b2de76f0615a => generated 1097 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:10:24.056992 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d885aaa4-fcf5-4788-87b9-c90309c4e7f6 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:10:24.057532 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d885aaa4-fcf5-4788-87b9-c90309c4e7f6 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] [instance: a8c3a4c4-20d7-4d1b-beae-e013b32a74aa] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:10:24.067344 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d885aaa4-fcf5-4788-87b9-c90309c4e7f6 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:24.068888 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d885aaa4-fcf5-4788-87b9-c90309c4e7f6 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:24.069359 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d885aaa4-fcf5-4788-87b9-c90309c4e7f6 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:24.070141 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d885aaa4-fcf5-4788-87b9-c90309c4e7f6 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:24.070620 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d885aaa4-fcf5-4788-87b9-c90309c4e7f6 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:24.072023 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d885aaa4-fcf5-4788-87b9-c90309c4e7f6 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:24.219227 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d885aaa4-fcf5-4788-87b9-c90309c4e7f6 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/a8c3a4c4-20d7-4d1b-beae-e013b32a74aa" status: 200 len: 1653 microversion: 2.1 time: 0.166026 Sep 23 05:10:24.219810 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3258/6693] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:10:24 2022] GET /compute/v2.1/servers/a8c3a4c4-20d7-4d1b-beae-e013b32a74aa => generated 1653 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:10:24.256190 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a277b318-48e0-4920-9cd8-712a5869d5e5 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:10:24.256190 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a277b318-48e0-4920-9cd8-712a5869d5e5 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 7ad3508b-1d37-4c7b-82c7-be195566aacb] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:10:24.266465 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a277b318-48e0-4920-9cd8-712a5869d5e5 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:24.267100 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a277b318-48e0-4920-9cd8-712a5869d5e5 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:24.267603 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a277b318-48e0-4920-9cd8-712a5869d5e5 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:24.268319 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a277b318-48e0-4920-9cd8-712a5869d5e5 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:24.268782 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a277b318-48e0-4920-9cd8-712a5869d5e5 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:24.269246 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a277b318-48e0-4920-9cd8-712a5869d5e5 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:24.425768 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a277b318-48e0-4920-9cd8-712a5869d5e5 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:10:24.435848 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a277b318-48e0-4920-9cd8-712a5869d5e5 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb" status: 200 len: 1342 microversion: 2.1 time: 0.187353 Sep 23 05:10:24.436455 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3436/6694] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:10:24 2022] GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb => generated 1342 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:10:24.629494 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b4967a2f-e026-4752-a9f2-ccaeb9afeb05 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:10:24.630710 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b4967a2f-e026-4752-a9f2-ccaeb9afeb05 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] [instance: 0d0f17c3-e777-4c71-a9df-b2de76f0615a] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:10:24.711568 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b4967a2f-e026-4752-a9f2-ccaeb9afeb05 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82736eb912544711991da4f27c321f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116ae3ab00e447f89c7e8210ba89be75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:10:24.721424 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b4967a2f-e026-4752-a9f2-ccaeb9afeb05 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] 10.222.0.33 "GET /compute/v2.1/servers/0d0f17c3-e777-4c71-a9df-b2de76f0615a" status: 200 len: 1097 microversion: 2.1 time: 0.097108 Sep 23 05:10:24.722140 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3259/6695] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:10:24 2022] GET /compute/v2.1/servers/0d0f17c3-e777-4c71-a9df-b2de76f0615a => generated 1097 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:10:25.003845 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-f79257dc-8ae8-4010-80de-5f30f7a33c39 req-a688037b-462f-413d-86af-3bad60c7a1ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8c3a4c4-20d7-4d1b-beae-e013b32a74aa", "name": "network-vif-deleted", "tag": "fc484bc1-2e91-4100-97ee-985c85d519f2"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:10:25.014357 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-f79257dc-8ae8-4010-80de-5f30f7a33c39 req-a688037b-462f-413d-86af-3bad60c7a1ea service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:25.014854 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-f79257dc-8ae8-4010-80de-5f30f7a33c39 req-a688037b-462f-413d-86af-3bad60c7a1ea service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:25.015294 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-f79257dc-8ae8-4010-80de-5f30f7a33c39 req-a688037b-462f-413d-86af-3bad60c7a1ea service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:25.027663 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-f79257dc-8ae8-4010-80de-5f30f7a33c39 req-a688037b-462f-413d-86af-3bad60c7a1ea service nova] Creating event network-vif-deleted:fc484bc1-2e91-4100-97ee-985c85d519f2 for instance a8c3a4c4-20d7-4d1b-beae-e013b32a74aa on n-h1-846463-3 Sep 23 05:10:25.032585 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-f79257dc-8ae8-4010-80de-5f30f7a33c39 req-a688037b-462f-413d-86af-3bad60c7a1ea service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033249 Sep 23 05:10:25.033188 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3437/6696] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:10:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:10:25.247816 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-38a1a6a9-5e35-47ad-a49f-3f1a9abe579f tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:10:25.248524 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-38a1a6a9-5e35-47ad-a49f-3f1a9abe579f tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] [instance: a8c3a4c4-20d7-4d1b-beae-e013b32a74aa] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:10:25.259783 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-38a1a6a9-5e35-47ad-a49f-3f1a9abe579f tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:25.260384 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-38a1a6a9-5e35-47ad-a49f-3f1a9abe579f tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:25.260921 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-38a1a6a9-5e35-47ad-a49f-3f1a9abe579f tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:25.264750 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-38a1a6a9-5e35-47ad-a49f-3f1a9abe579f tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:25.264750 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-38a1a6a9-5e35-47ad-a49f-3f1a9abe579f tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:25.264750 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-38a1a6a9-5e35-47ad-a49f-3f1a9abe579f tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:25.388249 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-38a1a6a9-5e35-47ad-a49f-3f1a9abe579f tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/a8c3a4c4-20d7-4d1b-beae-e013b32a74aa" status: 200 len: 1448 microversion: 2.1 time: 0.144462 Sep 23 05:10:25.404919 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3260/6697] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:10:25 2022] GET /compute/v2.1/servers/a8c3a4c4-20d7-4d1b-beae-e013b32a74aa => generated 1448 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:10:25.461259 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2eb5cc73-aacf-4228-99ae-adbc8d1a059a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:10:25.462096 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-2eb5cc73-aacf-4228-99ae-adbc8d1a059a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 7ad3508b-1d37-4c7b-82c7-be195566aacb] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:10:25.468474 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2eb5cc73-aacf-4228-99ae-adbc8d1a059a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:25.468975 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2eb5cc73-aacf-4228-99ae-adbc8d1a059a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:25.469677 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2eb5cc73-aacf-4228-99ae-adbc8d1a059a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:25.470653 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2eb5cc73-aacf-4228-99ae-adbc8d1a059a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:25.479302 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2eb5cc73-aacf-4228-99ae-adbc8d1a059a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:25.490212 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2eb5cc73-aacf-4228-99ae-adbc8d1a059a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:25.692677 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2eb5cc73-aacf-4228-99ae-adbc8d1a059a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:10:25.701996 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2eb5cc73-aacf-4228-99ae-adbc8d1a059a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb" status: 200 len: 1342 microversion: 2.1 time: 0.245989 Sep 23 05:10:25.703826 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3438/6698] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:10:25 2022] GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb => generated 1342 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:10:25.754142 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8b373c9c-3f69-4d82-9bcd-0dc3e7c3e242 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:10:25.767983 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8b373c9c-3f69-4d82-9bcd-0dc3e7c3e242 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] [instance: 0d0f17c3-e777-4c71-a9df-b2de76f0615a] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:10:25.778392 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8b373c9c-3f69-4d82-9bcd-0dc3e7c3e242 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:25.779499 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8b373c9c-3f69-4d82-9bcd-0dc3e7c3e242 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:25.780112 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8b373c9c-3f69-4d82-9bcd-0dc3e7c3e242 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:25.781115 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8b373c9c-3f69-4d82-9bcd-0dc3e7c3e242 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:25.781754 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8b373c9c-3f69-4d82-9bcd-0dc3e7c3e242 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:25.782572 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8b373c9c-3f69-4d82-9bcd-0dc3e7c3e242 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:25.888395 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8b373c9c-3f69-4d82-9bcd-0dc3e7c3e242 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82736eb912544711991da4f27c321f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116ae3ab00e447f89c7e8210ba89be75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:10:25.896953 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8b373c9c-3f69-4d82-9bcd-0dc3e7c3e242 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] 10.222.0.33 "GET /compute/v2.1/servers/0d0f17c3-e777-4c71-a9df-b2de76f0615a" status: 200 len: 1139 microversion: 2.1 time: 0.154860 Sep 23 05:10:25.897513 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3261/6699] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:10:25 2022] GET /compute/v2.1/servers/0d0f17c3-e777-4c71-a9df-b2de76f0615a => generated 1139 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:10:26.413271 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-914c0aa4-e9d2-485a-84b5-ed14c29cfb10 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:10:26.429637 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-914c0aa4-e9d2-485a-84b5-ed14c29cfb10 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] [instance: a8c3a4c4-20d7-4d1b-beae-e013b32a74aa] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:10:26.439804 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-914c0aa4-e9d2-485a-84b5-ed14c29cfb10 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:26.440671 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-914c0aa4-e9d2-485a-84b5-ed14c29cfb10 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:26.443519 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-914c0aa4-e9d2-485a-84b5-ed14c29cfb10 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:26.444331 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-914c0aa4-e9d2-485a-84b5-ed14c29cfb10 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:26.444909 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-914c0aa4-e9d2-485a-84b5-ed14c29cfb10 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:26.449519 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-914c0aa4-e9d2-485a-84b5-ed14c29cfb10 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:26.490248 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-914c0aa4-e9d2-485a-84b5-ed14c29cfb10 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:26.490844 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-914c0aa4-e9d2-485a-84b5-ed14c29cfb10 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:26.491355 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-914c0aa4-e9d2-485a-84b5-ed14c29cfb10 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:26.491893 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-914c0aa4-e9d2-485a-84b5-ed14c29cfb10 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lazy-loading 'fault' on Instance uuid a8c3a4c4-20d7-4d1b-beae-e013b32a74aa {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 05:10:26.545698 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-914c0aa4-e9d2-485a-84b5-ed14c29cfb10 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/a8c3a4c4-20d7-4d1b-beae-e013b32a74aa" status: 200 len: 1453 microversion: 2.1 time: 0.137218 Sep 23 05:10:26.546323 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3439/6700] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:10:26 2022] GET /compute/v2.1/servers/a8c3a4c4-20d7-4d1b-beae-e013b32a74aa => generated 1453 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:10:26.724870 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-cca0df9c-ffae-4bc8-9601-58603689664c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:10:26.725593 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-cca0df9c-ffae-4bc8-9601-58603689664c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 7ad3508b-1d37-4c7b-82c7-be195566aacb] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:10:26.732602 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cca0df9c-ffae-4bc8-9601-58603689664c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:26.733177 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cca0df9c-ffae-4bc8-9601-58603689664c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:26.733692 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cca0df9c-ffae-4bc8-9601-58603689664c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:26.734497 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cca0df9c-ffae-4bc8-9601-58603689664c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:26.735022 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cca0df9c-ffae-4bc8-9601-58603689664c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:26.735549 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cca0df9c-ffae-4bc8-9601-58603689664c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:26.884540 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-cca0df9c-ffae-4bc8-9601-58603689664c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:10:26.894034 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-cca0df9c-ffae-4bc8-9601-58603689664c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb" status: 200 len: 1376 microversion: 2.1 time: 0.172951 Sep 23 05:10:26.894708 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3262/6701] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:10:26 2022] GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb => generated 1376 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:10:26.920632 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2512b582-ddb7-4471-939e-b2b272760c8c tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:10:26.921650 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-2512b582-ddb7-4471-939e-b2b272760c8c tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] [instance: 0d0f17c3-e777-4c71-a9df-b2de76f0615a] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:10:26.929192 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2512b582-ddb7-4471-939e-b2b272760c8c tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:26.929823 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2512b582-ddb7-4471-939e-b2b272760c8c tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:26.930457 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2512b582-ddb7-4471-939e-b2b272760c8c tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:26.931478 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2512b582-ddb7-4471-939e-b2b272760c8c tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:26.932269 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2512b582-ddb7-4471-939e-b2b272760c8c tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:26.932904 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2512b582-ddb7-4471-939e-b2b272760c8c tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:27.017103 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2512b582-ddb7-4471-939e-b2b272760c8c tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82736eb912544711991da4f27c321f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116ae3ab00e447f89c7e8210ba89be75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:10:27.027121 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2512b582-ddb7-4471-939e-b2b272760c8c tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] 10.222.0.33 "GET /compute/v2.1/servers/0d0f17c3-e777-4c71-a9df-b2de76f0615a" status: 200 len: 1195 microversion: 2.1 time: 0.110573 Sep 23 05:10:27.027703 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3440/6702] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:10:26 2022] GET /compute/v2.1/servers/0d0f17c3-e777-4c71-a9df-b2de76f0615a => generated 1195 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:10:27.568810 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d49803cd-da7f-44dc-a4c0-ac79fc6727a8 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:10:27.569577 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d49803cd-da7f-44dc-a4c0-ac79fc6727a8 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] [instance: a8c3a4c4-20d7-4d1b-beae-e013b32a74aa] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:10:27.580462 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d49803cd-da7f-44dc-a4c0-ac79fc6727a8 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:27.584663 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d49803cd-da7f-44dc-a4c0-ac79fc6727a8 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:27.584663 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d49803cd-da7f-44dc-a4c0-ac79fc6727a8 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:27.584663 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d49803cd-da7f-44dc-a4c0-ac79fc6727a8 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:27.588688 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d49803cd-da7f-44dc-a4c0-ac79fc6727a8 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:27.590305 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d49803cd-da7f-44dc-a4c0-ac79fc6727a8 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:27.606765 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-d49803cd-da7f-44dc-a4c0-ac79fc6727a8 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] HTTP exception thrown: Instance a8c3a4c4-20d7-4d1b-beae-e013b32a74aa could not be found. Sep 23 05:10:27.615158 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d49803cd-da7f-44dc-a4c0-ac79fc6727a8 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Request method failure captured: Sep 23 05:10:27.615158 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/a8c3a4c4-20d7-4d1b-beae-e013b32a74aa HTTP/1.1 Sep 23 05:10:27.615158 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 05:10:27.615158 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 05:10:27.615158 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 05:10:27.615158 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 05:10:27.615158 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 05:10:27.615158 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 05:10:27.615158 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 05:10:27.615158 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 05:10:27.615158 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLT-YnRJ7fZ-CqkT5_9FtnKb77Hj-2TJAJuE2qVJUV7D8gtVrp3QSbhTO_l3aQC1pNw0auHkvgAy83lYmN3_mehG_dvP_ESTDLgsHJX7kRfKG46vpMAn4BhJbuKZDsu6FsunHTxOjRbdI1s05iYZozLuZ3OXTHLCG03yDD1-NskhUKvs Sep 23 05:10:27.615158 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 05:10:27.615158 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 05:10:27.615158 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 05:10:27.615158 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 05:10:27.615158 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 05:10:27.615158 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 05:10:27.615158 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 101ce576f12c41519e9120f803ce1064 Sep 23 05:10:27.615158 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-TestServerMultinode-1831957826 Sep 23 05:10:27.615158 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,admin,member Sep 23 05:10:27.615158 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,admin,member Sep 23 05:10:27.615158 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_101ce576f12c41519e9120f803ce1064", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/101ce576f12c41519e9120f803ce1064"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/101ce576f12c41519e9120f803ce1064"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/101ce576f12c41519e9120f803ce1064"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:10:27.615158 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-TestServerMultinode-1831957826 Sep 23 05:10:27.615158 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 101ce576f12c41519e9120f803ce1064 Sep 23 05:10:27.615158 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-TestServerMultinode-1831957826 Sep 23 05:10:27.615158 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-TestServerMultinode-1831957826-project-admin Sep 23 05:10:27.615158 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 05:10:27.615158 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 05:10:27.615158 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 3c490bfc9eee403f9448b6967a2e5665 Sep 23 05:10:27.615158 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-TestServerMultinode-1831957826-project-admin Sep 23 05:10:27.615158 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 05:10:27.615158 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance a8c3a4c4-20d7-4d1b-beae-e013b32a74aa could not be found. Sep 23 05:10:27.615158 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': 'a8c3a4c4-20d7-4d1b-beae-e013b32a74aa'} Sep 23 05:10:27.615158 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:10:27.615158 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:10:27.615158 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 05:10:27.615158 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 05:10:27.615158 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 05:10:27.615158 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 05:10:27.615158 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 05:10:27.615158 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 05:10:27.615158 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 05:10:27.615158 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 05:10:27.615158 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8c3a4c4-20d7-4d1b-beae-e013b32a74aa could not be found. Sep 23 05:10:27.615158 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:10:27.615158 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:10:27.615158 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:10:27.615158 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:10:27.615158 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:10:27.615158 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:10:27.615158 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:10:27.615158 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:10:27.615158 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:10:27.615158 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:10:27.615158 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 05:10:27.615158 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 05:10:27.615158 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 05:10:27.615158 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 05:10:27.615158 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 05:10:27.615158 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:10:27.615158 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8c3a4c4-20d7-4d1b-beae-e013b32a74aa could not be found. Sep 23 05:10:27.615158 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:10:27.615158 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:10:27.615158 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:10:27.619605 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:10:27.619605 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:10:27.619605 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:10:27.619605 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:10:27.619605 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:10:27.619605 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8c3a4c4-20d7-4d1b-beae-e013b32a74aa could not be found. Sep 23 05:10:27.619605 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:10:27.619605 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d49803cd-da7f-44dc-a4c0-ac79fc6727a8 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] Returning 404 to user: Instance a8c3a4c4-20d7-4d1b-beae-e013b32a74aa could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:10:27.619605 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d49803cd-da7f-44dc-a4c0-ac79fc6727a8 tempest-TestServerMultinode-1831957826 tempest-TestServerMultinode-1831957826-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/a8c3a4c4-20d7-4d1b-beae-e013b32a74aa" status: 404 len: 111 microversion: 2.1 time: 0.045930 Sep 23 05:10:27.619605 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3263/6703] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:10:27 2022] GET /compute/v2.1/servers/a8c3a4c4-20d7-4d1b-beae-e013b32a74aa => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 05:10:27.920491 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-620eb028-6558-4dab-875b-ad2328ccd4eb tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:10:27.921672 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-620eb028-6558-4dab-875b-ad2328ccd4eb tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 7ad3508b-1d37-4c7b-82c7-be195566aacb] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:10:27.933241 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-620eb028-6558-4dab-875b-ad2328ccd4eb tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:27.934079 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-620eb028-6558-4dab-875b-ad2328ccd4eb tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:27.934739 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-620eb028-6558-4dab-875b-ad2328ccd4eb tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:27.935735 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-620eb028-6558-4dab-875b-ad2328ccd4eb tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:27.936390 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-620eb028-6558-4dab-875b-ad2328ccd4eb tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:27.937052 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-620eb028-6558-4dab-875b-ad2328ccd4eb tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:28.052315 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0b8139ec-2e5a-454a-80fd-794bdc396671 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:10:28.053630 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-0b8139ec-2e5a-454a-80fd-794bdc396671 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] [instance: 0d0f17c3-e777-4c71-a9df-b2de76f0615a] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:10:28.064543 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0b8139ec-2e5a-454a-80fd-794bdc396671 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:28.087965 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0b8139ec-2e5a-454a-80fd-794bdc396671 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:28.095245 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0b8139ec-2e5a-454a-80fd-794bdc396671 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:28.096521 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0b8139ec-2e5a-454a-80fd-794bdc396671 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:28.098008 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0b8139ec-2e5a-454a-80fd-794bdc396671 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:28.098695 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0b8139ec-2e5a-454a-80fd-794bdc396671 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:28.124312 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-620eb028-6558-4dab-875b-ad2328ccd4eb tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:10:28.135153 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-620eb028-6558-4dab-875b-ad2328ccd4eb tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb" status: 200 len: 1376 microversion: 2.1 time: 0.219404 Sep 23 05:10:28.136441 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3441/6704] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:10:27 2022] GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb => generated 1376 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:10:28.187566 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-0b8139ec-2e5a-454a-80fd-794bdc396671 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82736eb912544711991da4f27c321f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116ae3ab00e447f89c7e8210ba89be75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:10:28.200317 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0b8139ec-2e5a-454a-80fd-794bdc396671 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] 10.222.0.33 "GET /compute/v2.1/servers/0d0f17c3-e777-4c71-a9df-b2de76f0615a" status: 200 len: 1213 microversion: 2.1 time: 0.152556 Sep 23 05:10:28.201511 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3264/6705] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:10:28 2022] GET /compute/v2.1/servers/0d0f17c3-e777-4c71-a9df-b2de76f0615a => generated 1213 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:10:29.165050 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-07517915-1d3c-4bbf-b88d-bb2e605f0038 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:10:29.167433 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-07517915-1d3c-4bbf-b88d-bb2e605f0038 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 7ad3508b-1d37-4c7b-82c7-be195566aacb] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:10:29.186269 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-07517915-1d3c-4bbf-b88d-bb2e605f0038 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:29.186797 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-07517915-1d3c-4bbf-b88d-bb2e605f0038 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:29.189962 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-07517915-1d3c-4bbf-b88d-bb2e605f0038 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:29.193851 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-07517915-1d3c-4bbf-b88d-bb2e605f0038 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:29.195571 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-07517915-1d3c-4bbf-b88d-bb2e605f0038 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:29.197013 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-07517915-1d3c-4bbf-b88d-bb2e605f0038 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:29.228773 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e3cd464a-a12c-4ecd-a701-a21f58315942 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:10:29.233949 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e3cd464a-a12c-4ecd-a701-a21f58315942 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] [instance: 0d0f17c3-e777-4c71-a9df-b2de76f0615a] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:10:29.244755 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e3cd464a-a12c-4ecd-a701-a21f58315942 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:29.245444 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e3cd464a-a12c-4ecd-a701-a21f58315942 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:29.246060 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e3cd464a-a12c-4ecd-a701-a21f58315942 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:29.248279 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e3cd464a-a12c-4ecd-a701-a21f58315942 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:29.249021 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e3cd464a-a12c-4ecd-a701-a21f58315942 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:29.250719 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e3cd464a-a12c-4ecd-a701-a21f58315942 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:29.645735 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e3cd464a-a12c-4ecd-a701-a21f58315942 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82736eb912544711991da4f27c321f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116ae3ab00e447f89c7e8210ba89be75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:10:29.651020 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-07517915-1d3c-4bbf-b88d-bb2e605f0038 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:10:29.666069 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-07517915-1d3c-4bbf-b88d-bb2e605f0038 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb" status: 200 len: 1376 microversion: 2.1 time: 0.507730 Sep 23 05:10:29.667441 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3442/6706] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:10:29 2022] GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb => generated 1376 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:10:29.671243 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e3cd464a-a12c-4ecd-a701-a21f58315942 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] 10.222.0.33 "GET /compute/v2.1/servers/0d0f17c3-e777-4c71-a9df-b2de76f0615a" status: 200 len: 1281 microversion: 2.1 time: 0.449519 Sep 23 05:10:29.673337 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3265/6707] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:10:29 2022] GET /compute/v2.1/servers/0d0f17c3-e777-4c71-a9df-b2de76f0615a => generated 1281 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:10:30.705101 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8d6a180b-9038-42da-be94-a2d014cb6c0e tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:10:30.706759 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f76ea47d-afc8-4e22-8c64-3aa9fb3ebf7d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:10:30.707918 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f76ea47d-afc8-4e22-8c64-3aa9fb3ebf7d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 7ad3508b-1d37-4c7b-82c7-be195566aacb] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:10:30.708443 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-8d6a180b-9038-42da-be94-a2d014cb6c0e tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] [instance: 0d0f17c3-e777-4c71-a9df-b2de76f0615a] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:10:30.729074 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f76ea47d-afc8-4e22-8c64-3aa9fb3ebf7d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:30.729818 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f76ea47d-afc8-4e22-8c64-3aa9fb3ebf7d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:30.730474 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f76ea47d-afc8-4e22-8c64-3aa9fb3ebf7d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:30.731388 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f76ea47d-afc8-4e22-8c64-3aa9fb3ebf7d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:30.732496 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f76ea47d-afc8-4e22-8c64-3aa9fb3ebf7d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:30.733103 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f76ea47d-afc8-4e22-8c64-3aa9fb3ebf7d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:30.744044 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8d6a180b-9038-42da-be94-a2d014cb6c0e tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:30.755590 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8d6a180b-9038-42da-be94-a2d014cb6c0e tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:30.755590 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8d6a180b-9038-42da-be94-a2d014cb6c0e tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:30.764358 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8d6a180b-9038-42da-be94-a2d014cb6c0e tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:30.764876 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8d6a180b-9038-42da-be94-a2d014cb6c0e tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:30.765325 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8d6a180b-9038-42da-be94-a2d014cb6c0e tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:31.179929 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-8d6a180b-9038-42da-be94-a2d014cb6c0e tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82736eb912544711991da4f27c321f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116ae3ab00e447f89c7e8210ba89be75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:10:31.200029 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-8d6a180b-9038-42da-be94-a2d014cb6c0e tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] 10.222.0.33 "GET /compute/v2.1/servers/0d0f17c3-e777-4c71-a9df-b2de76f0615a" status: 200 len: 1281 microversion: 2.1 time: 0.498174 Sep 23 05:10:31.203248 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3443/6708] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:10:30 2022] GET /compute/v2.1/servers/0d0f17c3-e777-4c71-a9df-b2de76f0615a => generated 1281 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:10:31.281620 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-40825d2a-ec11-4c0a-baa9-4f391f541fbf req-8a70f9ce-01b9-469d-bc09-217afffe4d79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d0f17c3-e777-4c71-a9df-b2de76f0615a", "tag": "5ea5a3a5-1af1-43c1-8697-61d4b860eea6"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:10:31.298276 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-40825d2a-ec11-4c0a-baa9-4f391f541fbf req-8a70f9ce-01b9-469d-bc09-217afffe4d79 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:31.298770 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-40825d2a-ec11-4c0a-baa9-4f391f541fbf req-8a70f9ce-01b9-469d-bc09-217afffe4d79 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:31.299214 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-40825d2a-ec11-4c0a-baa9-4f391f541fbf req-8a70f9ce-01b9-469d-bc09-217afffe4d79 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:31.329675 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-40825d2a-ec11-4c0a-baa9-4f391f541fbf req-8a70f9ce-01b9-469d-bc09-217afffe4d79 service nova] Creating event network-changed:5ea5a3a5-1af1-43c1-8697-61d4b860eea6 for instance 0d0f17c3-e777-4c71-a9df-b2de76f0615a on n-h1-846463-3 Sep 23 05:10:31.334773 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f76ea47d-afc8-4e22-8c64-3aa9fb3ebf7d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:10:31.344155 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-40825d2a-ec11-4c0a-baa9-4f391f541fbf req-8a70f9ce-01b9-469d-bc09-217afffe4d79 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066215 Sep 23 05:10:31.345057 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3444/6709] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:10:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 05:10:31.353916 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f76ea47d-afc8-4e22-8c64-3aa9fb3ebf7d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb" status: 200 len: 1376 microversion: 2.1 time: 0.650846 Sep 23 05:10:31.358261 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3266/6710] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:10:30 2022] GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb => generated 1376 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:10:32.229486 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5ad1bb1e-b757-4059-9087-123071bc24ca tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:10:32.230304 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-5ad1bb1e-b757-4059-9087-123071bc24ca tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] [instance: 0d0f17c3-e777-4c71-a9df-b2de76f0615a] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:10:32.245057 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5ad1bb1e-b757-4059-9087-123071bc24ca tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:32.245557 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5ad1bb1e-b757-4059-9087-123071bc24ca tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:32.246030 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5ad1bb1e-b757-4059-9087-123071bc24ca tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:32.246839 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5ad1bb1e-b757-4059-9087-123071bc24ca tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:32.247202 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5ad1bb1e-b757-4059-9087-123071bc24ca tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:32.255656 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5ad1bb1e-b757-4059-9087-123071bc24ca tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:32.386547 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-abe43bb0-a593-4744-a6a2-e8a7956d87e5 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:10:32.388365 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-abe43bb0-a593-4744-a6a2-e8a7956d87e5 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 7ad3508b-1d37-4c7b-82c7-be195566aacb] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:10:32.398812 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-abe43bb0-a593-4744-a6a2-e8a7956d87e5 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:32.399599 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-abe43bb0-a593-4744-a6a2-e8a7956d87e5 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:32.400065 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-abe43bb0-a593-4744-a6a2-e8a7956d87e5 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:32.401006 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-abe43bb0-a593-4744-a6a2-e8a7956d87e5 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:32.401496 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-abe43bb0-a593-4744-a6a2-e8a7956d87e5 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:32.402026 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-abe43bb0-a593-4744-a6a2-e8a7956d87e5 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:32.667398 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-5ad1bb1e-b757-4059-9087-123071bc24ca tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82736eb912544711991da4f27c321f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116ae3ab00e447f89c7e8210ba89be75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:10:32.678296 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5ad1bb1e-b757-4059-9087-123071bc24ca tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] 10.222.0.33 "GET /compute/v2.1/servers/0d0f17c3-e777-4c71-a9df-b2de76f0615a" status: 200 len: 1281 microversion: 2.1 time: 0.455016 Sep 23 05:10:32.678895 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3445/6711] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:10:32 2022] GET /compute/v2.1/servers/0d0f17c3-e777-4c71-a9df-b2de76f0615a => generated 1281 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:10:32.689468 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-abe43bb0-a593-4744-a6a2-e8a7956d87e5 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:10:32.704117 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-abe43bb0-a593-4744-a6a2-e8a7956d87e5 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb" status: 200 len: 1376 microversion: 2.1 time: 0.316155 Sep 23 05:10:32.704117 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3267/6712] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:10:32 2022] GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb => generated 1376 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:10:33.703570 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f7ca38ef-0881-4d89-8a9f-56aae0881a9e tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:10:33.704441 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f7ca38ef-0881-4d89-8a9f-56aae0881a9e tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] [instance: 0d0f17c3-e777-4c71-a9df-b2de76f0615a] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:10:33.711298 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:10:33.721099 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f7ca38ef-0881-4d89-8a9f-56aae0881a9e tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:33.722436 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f7ca38ef-0881-4d89-8a9f-56aae0881a9e tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:33.724697 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f7ca38ef-0881-4d89-8a9f-56aae0881a9e tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:33.725702 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f7ca38ef-0881-4d89-8a9f-56aae0881a9e tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:33.727157 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-afee7e8f-69cd-47ef-a219-d9b744a6bcf0 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:10:33.727972 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-afee7e8f-69cd-47ef-a219-d9b744a6bcf0 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 7ad3508b-1d37-4c7b-82c7-be195566aacb] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:10:33.731284 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:10:33.731915 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f7ca38ef-0881-4d89-8a9f-56aae0881a9e tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:33.732873 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f7ca38ef-0881-4d89-8a9f-56aae0881a9e tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:33.739724 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-afee7e8f-69cd-47ef-a219-d9b744a6bcf0 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:33.740407 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-afee7e8f-69cd-47ef-a219-d9b744a6bcf0 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:33.740872 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-afee7e8f-69cd-47ef-a219-d9b744a6bcf0 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:33.741591 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-afee7e8f-69cd-47ef-a219-d9b744a6bcf0 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:33.742252 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-afee7e8f-69cd-47ef-a219-d9b744a6bcf0 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:33.742699 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-afee7e8f-69cd-47ef-a219-d9b744a6bcf0 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:33.758445 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=100 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:10:34.078360 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f7ca38ef-0881-4d89-8a9f-56aae0881a9e tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82736eb912544711991da4f27c321f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116ae3ab00e447f89c7e8210ba89be75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:10:34.088448 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f7ca38ef-0881-4d89-8a9f-56aae0881a9e tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] 10.222.0.33 "GET /compute/v2.1/servers/0d0f17c3-e777-4c71-a9df-b2de76f0615a" status: 200 len: 1281 microversion: 2.1 time: 0.389917 Sep 23 05:10:34.091044 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3446/6713] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:10:33 2022] GET /compute/v2.1/servers/0d0f17c3-e777-4c71-a9df-b2de76f0615a => generated 1281 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:10:34.125035 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-afee7e8f-69cd-47ef-a219-d9b744a6bcf0 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:10:34.137928 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-afee7e8f-69cd-47ef-a219-d9b744a6bcf0 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb" status: 200 len: 1376 microversion: 2.1 time: 0.416711 Sep 23 05:10:34.141477 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3268/6714] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:10:33 2022] GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb => generated 1376 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:10:35.115379 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c17b37b6-396d-4a16-990f-04b4f46761ee tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:10:35.116011 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c17b37b6-396d-4a16-990f-04b4f46761ee tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] [instance: 0d0f17c3-e777-4c71-a9df-b2de76f0615a] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:10:35.124442 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c17b37b6-396d-4a16-990f-04b4f46761ee tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:35.125154 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c17b37b6-396d-4a16-990f-04b4f46761ee tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:35.130949 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c17b37b6-396d-4a16-990f-04b4f46761ee tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:35.132171 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c17b37b6-396d-4a16-990f-04b4f46761ee tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:35.132665 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c17b37b6-396d-4a16-990f-04b4f46761ee tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:35.133109 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c17b37b6-396d-4a16-990f-04b4f46761ee tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:35.164965 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e3a655d3-d8b4-43cc-a0b3-0e456ae62c85 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:10:35.166284 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e3a655d3-d8b4-43cc-a0b3-0e456ae62c85 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 7ad3508b-1d37-4c7b-82c7-be195566aacb] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:10:35.168908 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=12 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:10:35.177541 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e3a655d3-d8b4-43cc-a0b3-0e456ae62c85 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:35.178482 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e3a655d3-d8b4-43cc-a0b3-0e456ae62c85 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:35.179123 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e3a655d3-d8b4-43cc-a0b3-0e456ae62c85 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:35.180128 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e3a655d3-d8b4-43cc-a0b3-0e456ae62c85 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:35.180763 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e3a655d3-d8b4-43cc-a0b3-0e456ae62c85 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:35.181446 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e3a655d3-d8b4-43cc-a0b3-0e456ae62c85 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:35.463665 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c17b37b6-396d-4a16-990f-04b4f46761ee tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82736eb912544711991da4f27c321f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116ae3ab00e447f89c7e8210ba89be75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:10:35.469138 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c17b37b6-396d-4a16-990f-04b4f46761ee tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] 10.222.0.33 "GET /compute/v2.1/servers/0d0f17c3-e777-4c71-a9df-b2de76f0615a" status: 200 len: 1269 microversion: 2.1 time: 0.360645 Sep 23 05:10:35.483797 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e3a655d3-d8b4-43cc-a0b3-0e456ae62c85 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:10:35.486361 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3447/6715] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:10:35 2022] GET /compute/v2.1/servers/0d0f17c3-e777-4c71-a9df-b2de76f0615a => generated 1269 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:10:35.496059 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e3a655d3-d8b4-43cc-a0b3-0e456ae62c85 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb" status: 200 len: 1376 microversion: 2.1 time: 0.335167 Sep 23 05:10:35.496839 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3269/6716] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:10:35 2022] GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb => generated 1376 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:10:35.872469 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-5cb1ca5b-6263-4041-90b0-242be53d1786 req-5490c0ff-ef05-4819-b719-771ddc31d76a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ad3508b-1d37-4c7b-82c7-be195566aacb", "name": "network-vif-plugged", "status": "completed", "tag": "4eaae8ce-f836-493a-ba9b-c19cc5da65aa"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:10:35.883802 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-5cb1ca5b-6263-4041-90b0-242be53d1786 req-5490c0ff-ef05-4819-b719-771ddc31d76a service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:35.884883 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-5cb1ca5b-6263-4041-90b0-242be53d1786 req-5490c0ff-ef05-4819-b719-771ddc31d76a service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:35.885502 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-5cb1ca5b-6263-4041-90b0-242be53d1786 req-5490c0ff-ef05-4819-b719-771ddc31d76a service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:35.900071 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-5cb1ca5b-6263-4041-90b0-242be53d1786 req-5490c0ff-ef05-4819-b719-771ddc31d76a service nova] Creating event network-vif-plugged:4eaae8ce-f836-493a-ba9b-c19cc5da65aa for instance 7ad3508b-1d37-4c7b-82c7-be195566aacb on n-h2-846463-3 Sep 23 05:10:35.906240 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-5cb1ca5b-6263-4041-90b0-242be53d1786 req-5490c0ff-ef05-4819-b719-771ddc31d76a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038226 Sep 23 05:10:35.907259 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3448/6717] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:10:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:10:36.495690 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e7bc46fc-a91e-4c57-af2e-ccc171ab3736 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:10:36.496522 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e7bc46fc-a91e-4c57-af2e-ccc171ab3736 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] [instance: 0d0f17c3-e777-4c71-a9df-b2de76f0615a] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:10:36.504836 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e7bc46fc-a91e-4c57-af2e-ccc171ab3736 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:36.505357 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e7bc46fc-a91e-4c57-af2e-ccc171ab3736 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:36.505812 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e7bc46fc-a91e-4c57-af2e-ccc171ab3736 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:36.506558 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e7bc46fc-a91e-4c57-af2e-ccc171ab3736 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:36.507100 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e7bc46fc-a91e-4c57-af2e-ccc171ab3736 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:36.507803 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e7bc46fc-a91e-4c57-af2e-ccc171ab3736 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:36.524283 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-43eb7dcc-d0a9-4b03-9827-5156278e2fab tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:10:36.525958 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-43eb7dcc-d0a9-4b03-9827-5156278e2fab tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 7ad3508b-1d37-4c7b-82c7-be195566aacb] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:10:36.533715 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-43eb7dcc-d0a9-4b03-9827-5156278e2fab tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:36.534898 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-43eb7dcc-d0a9-4b03-9827-5156278e2fab tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:36.536112 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-43eb7dcc-d0a9-4b03-9827-5156278e2fab tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:36.537153 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-43eb7dcc-d0a9-4b03-9827-5156278e2fab tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:36.537726 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-43eb7dcc-d0a9-4b03-9827-5156278e2fab tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:36.538284 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-43eb7dcc-d0a9-4b03-9827-5156278e2fab tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:36.818965 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e7bc46fc-a91e-4c57-af2e-ccc171ab3736 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82736eb912544711991da4f27c321f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116ae3ab00e447f89c7e8210ba89be75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:10:36.830853 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e7bc46fc-a91e-4c57-af2e-ccc171ab3736 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] 10.222.0.33 "GET /compute/v2.1/servers/0d0f17c3-e777-4c71-a9df-b2de76f0615a" status: 200 len: 1269 microversion: 2.1 time: 0.341790 Sep 23 05:10:36.832815 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3270/6718] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:10:36 2022] GET /compute/v2.1/servers/0d0f17c3-e777-4c71-a9df-b2de76f0615a => generated 1269 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:10:36.847162 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-43eb7dcc-d0a9-4b03-9827-5156278e2fab tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:10:36.858520 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-43eb7dcc-d0a9-4b03-9827-5156278e2fab tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb" status: 200 len: 1376 microversion: 2.1 time: 0.341301 Sep 23 05:10:36.859122 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3449/6719] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:10:36 2022] GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb => generated 1376 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:10:37.855305 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-08086ea5-4e59-4dd3-9775-e04572f0a6b6 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:10:37.856479 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-08086ea5-4e59-4dd3-9775-e04572f0a6b6 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] [instance: 0d0f17c3-e777-4c71-a9df-b2de76f0615a] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:10:37.870215 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-08086ea5-4e59-4dd3-9775-e04572f0a6b6 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:37.870739 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-08086ea5-4e59-4dd3-9775-e04572f0a6b6 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:37.871200 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-08086ea5-4e59-4dd3-9775-e04572f0a6b6 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:37.871938 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-08086ea5-4e59-4dd3-9775-e04572f0a6b6 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:37.872414 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-08086ea5-4e59-4dd3-9775-e04572f0a6b6 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:37.872961 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-08086ea5-4e59-4dd3-9775-e04572f0a6b6 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:37.881109 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3cea44f4-4133-41fb-b7fc-33c9a8d6203f tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:10:37.881730 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-3cea44f4-4133-41fb-b7fc-33c9a8d6203f tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 7ad3508b-1d37-4c7b-82c7-be195566aacb] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:10:37.890207 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3cea44f4-4133-41fb-b7fc-33c9a8d6203f tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:37.897270 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3cea44f4-4133-41fb-b7fc-33c9a8d6203f tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:37.897944 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3cea44f4-4133-41fb-b7fc-33c9a8d6203f tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:37.898687 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3cea44f4-4133-41fb-b7fc-33c9a8d6203f tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:37.899149 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3cea44f4-4133-41fb-b7fc-33c9a8d6203f tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:37.899754 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3cea44f4-4133-41fb-b7fc-33c9a8d6203f tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:38.229131 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-3cea44f4-4133-41fb-b7fc-33c9a8d6203f tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:10:38.256999 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3cea44f4-4133-41fb-b7fc-33c9a8d6203f tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb" status: 200 len: 1564 microversion: 2.1 time: 0.380137 Sep 23 05:10:38.257607 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3450/6720] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:10:37 2022] GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb => generated 1564 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:10:38.270142 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-08086ea5-4e59-4dd3-9775-e04572f0a6b6 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82736eb912544711991da4f27c321f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116ae3ab00e447f89c7e8210ba89be75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:10:38.284176 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-228f8786-f19b-4864-9390-f57218018d02 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:10:38.284797 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-228f8786-f19b-4864-9390-f57218018d02 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 7ad3508b-1d37-4c7b-82c7-be195566aacb] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:10:38.286973 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-08086ea5-4e59-4dd3-9775-e04572f0a6b6 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] 10.222.0.33 "GET /compute/v2.1/servers/0d0f17c3-e777-4c71-a9df-b2de76f0615a" status: 200 len: 1269 microversion: 2.1 time: 0.433980 Sep 23 05:10:38.288123 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3271/6721] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:10:37 2022] GET /compute/v2.1/servers/0d0f17c3-e777-4c71-a9df-b2de76f0615a => generated 1269 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:10:38.291743 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-228f8786-f19b-4864-9390-f57218018d02 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:38.298433 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-228f8786-f19b-4864-9390-f57218018d02 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:38.298433 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-228f8786-f19b-4864-9390-f57218018d02 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:38.298433 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-228f8786-f19b-4864-9390-f57218018d02 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:38.298433 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-228f8786-f19b-4864-9390-f57218018d02 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:38.298433 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-228f8786-f19b-4864-9390-f57218018d02 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:38.466867 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-228f8786-f19b-4864-9390-f57218018d02 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:10:38.480648 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-228f8786-f19b-4864-9390-f57218018d02 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb" status: 200 len: 1564 microversion: 2.1 time: 0.195944 Sep 23 05:10:38.480648 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3451/6722] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:10:38 2022] GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb => generated 1564 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:10:38.584674 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8ed14db3-85e2-490a-90de-aa7350461cf5 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:10:38.585760 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8ed14db3-85e2-490a-90de-aa7350461cf5 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 7ad3508b-1d37-4c7b-82c7-be195566aacb] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:10:38.594746 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8ed14db3-85e2-490a-90de-aa7350461cf5 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:38.595788 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8ed14db3-85e2-490a-90de-aa7350461cf5 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:38.596513 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8ed14db3-85e2-490a-90de-aa7350461cf5 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:38.597589 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8ed14db3-85e2-490a-90de-aa7350461cf5 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:38.598439 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8ed14db3-85e2-490a-90de-aa7350461cf5 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:38.599117 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8ed14db3-85e2-490a-90de-aa7350461cf5 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:38.635057 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8ed14db3-85e2-490a-90de-aa7350461cf5 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 7ad3508b-1d37-4c7b-82c7-be195566aacb] Going to try to terminate instance {{(pid=122698) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 05:10:39.093248 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8ed14db3-85e2-490a-90de-aa7350461cf5 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "DELETE /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb" status: 204 len: 0 microversion: 2.1 time: 0.514114 Sep 23 05:10:39.093248 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3272/6723] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 05:10:38 2022] DELETE /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb => generated 0 bytes in 516 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 05:10:39.110987 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-cc85bea5-95cf-4a17-a8df-dc96de5cd6f6 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:10:39.126390 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-cc85bea5-95cf-4a17-a8df-dc96de5cd6f6 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 7ad3508b-1d37-4c7b-82c7-be195566aacb] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:10:39.141756 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cc85bea5-95cf-4a17-a8df-dc96de5cd6f6 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:39.142320 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cc85bea5-95cf-4a17-a8df-dc96de5cd6f6 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:39.142768 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cc85bea5-95cf-4a17-a8df-dc96de5cd6f6 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:39.146114 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cc85bea5-95cf-4a17-a8df-dc96de5cd6f6 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:39.149048 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cc85bea5-95cf-4a17-a8df-dc96de5cd6f6 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:39.149762 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cc85bea5-95cf-4a17-a8df-dc96de5cd6f6 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:39.305104 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-cc85bea5-95cf-4a17-a8df-dc96de5cd6f6 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:10:39.310057 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=100 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:10:39.312109 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c99a8121-5af8-4491-8741-8980241f94b5 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:10:39.312931 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c99a8121-5af8-4491-8741-8980241f94b5 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] [instance: 0d0f17c3-e777-4c71-a9df-b2de76f0615a] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:10:39.314888 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-cc85bea5-95cf-4a17-a8df-dc96de5cd6f6 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb" status: 200 len: 1570 microversion: 2.1 time: 0.217890 Sep 23 05:10:39.315660 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3452/6724] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:10:39 2022] GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb => generated 1570 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:10:39.320131 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c99a8121-5af8-4491-8741-8980241f94b5 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:39.320659 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c99a8121-5af8-4491-8741-8980241f94b5 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:39.326109 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c99a8121-5af8-4491-8741-8980241f94b5 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:39.326109 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c99a8121-5af8-4491-8741-8980241f94b5 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:39.326109 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c99a8121-5af8-4491-8741-8980241f94b5 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:39.326109 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c99a8121-5af8-4491-8741-8980241f94b5 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:39.498201 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c99a8121-5af8-4491-8741-8980241f94b5 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82736eb912544711991da4f27c321f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116ae3ab00e447f89c7e8210ba89be75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:10:39.527197 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c99a8121-5af8-4491-8741-8980241f94b5 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] 10.222.0.33 "GET /compute/v2.1/servers/0d0f17c3-e777-4c71-a9df-b2de76f0615a" status: 200 len: 1269 microversion: 2.1 time: 0.217366 Sep 23 05:10:39.527197 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3273/6725] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:10:39 2022] GET /compute/v2.1/servers/0d0f17c3-e777-4c71-a9df-b2de76f0615a => generated 1269 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:10:40.345037 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-29db328e-0626-4c07-8167-2424187537b9 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:10:40.345662 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-29db328e-0626-4c07-8167-2424187537b9 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 7ad3508b-1d37-4c7b-82c7-be195566aacb] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:10:40.361418 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-29db328e-0626-4c07-8167-2424187537b9 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:40.362251 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-29db328e-0626-4c07-8167-2424187537b9 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:40.362792 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-29db328e-0626-4c07-8167-2424187537b9 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:40.364439 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-29db328e-0626-4c07-8167-2424187537b9 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:40.365230 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-29db328e-0626-4c07-8167-2424187537b9 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:40.365698 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-29db328e-0626-4c07-8167-2424187537b9 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:40.522952 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-29db328e-0626-4c07-8167-2424187537b9 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:10:40.531046 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-29db328e-0626-4c07-8167-2424187537b9 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb" status: 200 len: 1570 microversion: 2.1 time: 0.190761 Sep 23 05:10:40.532053 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3453/6726] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:10:40 2022] GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb => generated 1570 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:10:40.549033 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-12e660b6-a3c4-4fa3-bc58-70a1373f3298 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:10:40.549843 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-12e660b6-a3c4-4fa3-bc58-70a1373f3298 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] [instance: 0d0f17c3-e777-4c71-a9df-b2de76f0615a] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:10:40.557762 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-12e660b6-a3c4-4fa3-bc58-70a1373f3298 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:40.564438 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-12e660b6-a3c4-4fa3-bc58-70a1373f3298 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:40.564438 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-12e660b6-a3c4-4fa3-bc58-70a1373f3298 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:40.564438 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-12e660b6-a3c4-4fa3-bc58-70a1373f3298 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:40.564438 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-12e660b6-a3c4-4fa3-bc58-70a1373f3298 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:40.564438 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-12e660b6-a3c4-4fa3-bc58-70a1373f3298 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:40.728006 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-12e660b6-a3c4-4fa3-bc58-70a1373f3298 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82736eb912544711991da4f27c321f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116ae3ab00e447f89c7e8210ba89be75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:10:40.736540 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-12e660b6-a3c4-4fa3-bc58-70a1373f3298 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] 10.222.0.33 "GET /compute/v2.1/servers/0d0f17c3-e777-4c71-a9df-b2de76f0615a" status: 200 len: 1269 microversion: 2.1 time: 0.191675 Sep 23 05:10:40.743238 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3274/6727] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:10:40 2022] GET /compute/v2.1/servers/0d0f17c3-e777-4c71-a9df-b2de76f0615a => generated 1269 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:10:41.556853 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3282489a-dec5-4976-9970-cf49d4aaaf8b tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:10:41.558293 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-3282489a-dec5-4976-9970-cf49d4aaaf8b tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 7ad3508b-1d37-4c7b-82c7-be195566aacb] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:10:41.565534 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3282489a-dec5-4976-9970-cf49d4aaaf8b tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:41.566068 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3282489a-dec5-4976-9970-cf49d4aaaf8b tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:41.566759 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3282489a-dec5-4976-9970-cf49d4aaaf8b tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:41.567699 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3282489a-dec5-4976-9970-cf49d4aaaf8b tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:41.568171 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3282489a-dec5-4976-9970-cf49d4aaaf8b tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:41.568786 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3282489a-dec5-4976-9970-cf49d4aaaf8b tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:41.673652 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-3282489a-dec5-4976-9970-cf49d4aaaf8b tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:10:41.684254 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3282489a-dec5-4976-9970-cf49d4aaaf8b tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb" status: 200 len: 1528 microversion: 2.1 time: 0.131259 Sep 23 05:10:41.699778 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3454/6728] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:10:41 2022] GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb => generated 1528 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:10:41.766808 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-3f99d784-1b86-4c66-9e05-60f601918b98 req-2c88e2b7-4ee0-4788-a100-fb7a8d19de20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ad3508b-1d37-4c7b-82c7-be195566aacb", "name": "network-vif-deleted", "tag": "4eaae8ce-f836-493a-ba9b-c19cc5da65aa"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:10:41.775038 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-291a6695-0422-420e-8458-b0a9a27174e6 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:10:41.778906 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-291a6695-0422-420e-8458-b0a9a27174e6 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] [instance: 0d0f17c3-e777-4c71-a9df-b2de76f0615a] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:10:41.784750 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-3f99d784-1b86-4c66-9e05-60f601918b98 req-2c88e2b7-4ee0-4788-a100-fb7a8d19de20 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:41.786419 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-3f99d784-1b86-4c66-9e05-60f601918b98 req-2c88e2b7-4ee0-4788-a100-fb7a8d19de20 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:41.786419 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-3f99d784-1b86-4c66-9e05-60f601918b98 req-2c88e2b7-4ee0-4788-a100-fb7a8d19de20 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:41.803570 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-291a6695-0422-420e-8458-b0a9a27174e6 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:41.804544 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-291a6695-0422-420e-8458-b0a9a27174e6 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:41.805929 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-291a6695-0422-420e-8458-b0a9a27174e6 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:41.809506 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-291a6695-0422-420e-8458-b0a9a27174e6 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:41.809506 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-291a6695-0422-420e-8458-b0a9a27174e6 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:41.809506 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-291a6695-0422-420e-8458-b0a9a27174e6 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:41.811600 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-3f99d784-1b86-4c66-9e05-60f601918b98 req-2c88e2b7-4ee0-4788-a100-fb7a8d19de20 service nova] Creating event network-vif-deleted:4eaae8ce-f836-493a-ba9b-c19cc5da65aa for instance 7ad3508b-1d37-4c7b-82c7-be195566aacb on n-h2-846463-3 Sep 23 05:10:41.818898 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-3f99d784-1b86-4c66-9e05-60f601918b98 req-2c88e2b7-4ee0-4788-a100-fb7a8d19de20 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055792 Sep 23 05:10:41.827984 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3455/6729] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:10:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 05:10:42.277429 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-291a6695-0422-420e-8458-b0a9a27174e6 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82736eb912544711991da4f27c321f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116ae3ab00e447f89c7e8210ba89be75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:10:42.286840 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-291a6695-0422-420e-8458-b0a9a27174e6 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] 10.222.0.33 "GET /compute/v2.1/servers/0d0f17c3-e777-4c71-a9df-b2de76f0615a" status: 200 len: 1269 microversion: 2.1 time: 0.529727 Sep 23 05:10:42.287431 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3275/6730] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:10:41 2022] GET /compute/v2.1/servers/0d0f17c3-e777-4c71-a9df-b2de76f0615a => generated 1269 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:10:42.723739 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e86a491e-30db-49d4-a07d-d94e59d330d9 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:10:42.725544 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e86a491e-30db-49d4-a07d-d94e59d330d9 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 7ad3508b-1d37-4c7b-82c7-be195566aacb] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:10:42.767618 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e86a491e-30db-49d4-a07d-d94e59d330d9 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:42.769306 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e86a491e-30db-49d4-a07d-d94e59d330d9 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:42.773692 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e86a491e-30db-49d4-a07d-d94e59d330d9 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:42.778267 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e86a491e-30db-49d4-a07d-d94e59d330d9 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:42.780334 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e86a491e-30db-49d4-a07d-d94e59d330d9 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:42.780841 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e86a491e-30db-49d4-a07d-d94e59d330d9 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:42.937628 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e86a491e-30db-49d4-a07d-d94e59d330d9 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:10:42.965175 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e86a491e-30db-49d4-a07d-d94e59d330d9 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb" status: 200 len: 1361 microversion: 2.1 time: 0.247677 Sep 23 05:10:42.966169 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3456/6731] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:10:42 2022] GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb => generated 1361 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:10:43.314556 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c952104d-d6f1-41de-9e62-9f89dffa78ba tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:10:43.315230 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c952104d-d6f1-41de-9e62-9f89dffa78ba tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] [instance: 0d0f17c3-e777-4c71-a9df-b2de76f0615a] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:10:43.322687 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c952104d-d6f1-41de-9e62-9f89dffa78ba tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:43.323578 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c952104d-d6f1-41de-9e62-9f89dffa78ba tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:43.324039 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c952104d-d6f1-41de-9e62-9f89dffa78ba tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:43.324956 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c952104d-d6f1-41de-9e62-9f89dffa78ba tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:43.325440 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c952104d-d6f1-41de-9e62-9f89dffa78ba tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:43.325918 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c952104d-d6f1-41de-9e62-9f89dffa78ba tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:43.580412 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c952104d-d6f1-41de-9e62-9f89dffa78ba tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82736eb912544711991da4f27c321f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116ae3ab00e447f89c7e8210ba89be75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:10:43.592500 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c952104d-d6f1-41de-9e62-9f89dffa78ba tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] 10.222.0.33 "GET /compute/v2.1/servers/0d0f17c3-e777-4c71-a9df-b2de76f0615a" status: 200 len: 1269 microversion: 2.1 time: 0.283436 Sep 23 05:10:43.593200 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3276/6732] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:10:43 2022] GET /compute/v2.1/servers/0d0f17c3-e777-4c71-a9df-b2de76f0615a => generated 1269 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:10:43.989648 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d4855a29-da8d-4842-a8ec-6bf4b31b197a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:10:43.990344 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d4855a29-da8d-4842-a8ec-6bf4b31b197a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 7ad3508b-1d37-4c7b-82c7-be195566aacb] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:10:43.997783 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d4855a29-da8d-4842-a8ec-6bf4b31b197a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:43.998334 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d4855a29-da8d-4842-a8ec-6bf4b31b197a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:43.998995 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d4855a29-da8d-4842-a8ec-6bf4b31b197a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:43.999741 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d4855a29-da8d-4842-a8ec-6bf4b31b197a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:44.000220 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d4855a29-da8d-4842-a8ec-6bf4b31b197a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:44.000659 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d4855a29-da8d-4842-a8ec-6bf4b31b197a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:44.079981 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d4855a29-da8d-4842-a8ec-6bf4b31b197a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:10:44.088315 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d4855a29-da8d-4842-a8ec-6bf4b31b197a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb" status: 200 len: 1361 microversion: 2.1 time: 0.103277 Sep 23 05:10:44.094255 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3457/6733] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:10:43 2022] GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb => generated 1361 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:10:44.616019 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b2b96d11-8a9d-405a-99e3-9e66076552d9 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:10:44.617436 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b2b96d11-8a9d-405a-99e3-9e66076552d9 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] [instance: 0d0f17c3-e777-4c71-a9df-b2de76f0615a] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:10:44.620847 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:10:44.626424 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b2b96d11-8a9d-405a-99e3-9e66076552d9 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:44.626956 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b2b96d11-8a9d-405a-99e3-9e66076552d9 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:44.627426 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b2b96d11-8a9d-405a-99e3-9e66076552d9 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:44.628174 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b2b96d11-8a9d-405a-99e3-9e66076552d9 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:44.628658 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b2b96d11-8a9d-405a-99e3-9e66076552d9 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:44.629365 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b2b96d11-8a9d-405a-99e3-9e66076552d9 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:44.787388 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-b953f4d0-a162-4924-a8ae-095a7ef9ce63 req-b90b90b3-335e-4d5a-ad78-8fc5d84ce9c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d0f17c3-e777-4c71-a9df-b2de76f0615a", "name": "network-vif-plugged", "status": "completed", "tag": "5ea5a3a5-1af1-43c1-8697-61d4b860eea6"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:10:44.798386 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b2b96d11-8a9d-405a-99e3-9e66076552d9 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82736eb912544711991da4f27c321f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116ae3ab00e447f89c7e8210ba89be75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:10:44.806012 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b2b96d11-8a9d-405a-99e3-9e66076552d9 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] 10.222.0.33 "GET /compute/v2.1/servers/0d0f17c3-e777-4c71-a9df-b2de76f0615a" status: 200 len: 1269 microversion: 2.1 time: 0.194093 Sep 23 05:10:44.809941 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3277/6734] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:10:44 2022] GET /compute/v2.1/servers/0d0f17c3-e777-4c71-a9df-b2de76f0615a => generated 1269 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:10:44.811098 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-b953f4d0-a162-4924-a8ae-095a7ef9ce63 req-b90b90b3-335e-4d5a-ad78-8fc5d84ce9c5 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:44.811808 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-b953f4d0-a162-4924-a8ae-095a7ef9ce63 req-b90b90b3-335e-4d5a-ad78-8fc5d84ce9c5 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:44.812283 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-b953f4d0-a162-4924-a8ae-095a7ef9ce63 req-b90b90b3-335e-4d5a-ad78-8fc5d84ce9c5 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:44.825788 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-b953f4d0-a162-4924-a8ae-095a7ef9ce63 req-b90b90b3-335e-4d5a-ad78-8fc5d84ce9c5 service nova] Creating event network-vif-plugged:5ea5a3a5-1af1-43c1-8697-61d4b860eea6 for instance 0d0f17c3-e777-4c71-a9df-b2de76f0615a on n-h1-846463-3 Sep 23 05:10:44.834163 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-b953f4d0-a162-4924-a8ae-095a7ef9ce63 req-b90b90b3-335e-4d5a-ad78-8fc5d84ce9c5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053260 Sep 23 05:10:44.834804 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3458/6735] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:10:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:10:45.113273 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-072c8556-7814-4668-ae38-ceb7897d0c0c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:10:45.114252 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-072c8556-7814-4668-ae38-ceb7897d0c0c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 7ad3508b-1d37-4c7b-82c7-be195566aacb] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:10:45.126372 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-072c8556-7814-4668-ae38-ceb7897d0c0c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:45.127363 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-072c8556-7814-4668-ae38-ceb7897d0c0c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:45.128283 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-072c8556-7814-4668-ae38-ceb7897d0c0c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:45.129365 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-072c8556-7814-4668-ae38-ceb7897d0c0c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:45.130259 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-072c8556-7814-4668-ae38-ceb7897d0c0c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:45.131129 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-072c8556-7814-4668-ae38-ceb7897d0c0c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:45.227873 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-072c8556-7814-4668-ae38-ceb7897d0c0c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:10:45.237918 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-072c8556-7814-4668-ae38-ceb7897d0c0c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb" status: 200 len: 1361 microversion: 2.1 time: 0.129364 Sep 23 05:10:45.238540 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3278/6736] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:10:45 2022] GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb => generated 1361 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:10:45.830994 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a6a04ed1-3642-4dd1-988f-33332cfce760 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:10:45.831709 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a6a04ed1-3642-4dd1-988f-33332cfce760 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] [instance: 0d0f17c3-e777-4c71-a9df-b2de76f0615a] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:10:45.841644 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a6a04ed1-3642-4dd1-988f-33332cfce760 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:45.842253 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a6a04ed1-3642-4dd1-988f-33332cfce760 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:45.842695 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a6a04ed1-3642-4dd1-988f-33332cfce760 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:45.843414 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a6a04ed1-3642-4dd1-988f-33332cfce760 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:45.843881 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a6a04ed1-3642-4dd1-988f-33332cfce760 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:45.844310 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a6a04ed1-3642-4dd1-988f-33332cfce760 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:46.008126 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a6a04ed1-3642-4dd1-988f-33332cfce760 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82736eb912544711991da4f27c321f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116ae3ab00e447f89c7e8210ba89be75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:10:46.012299 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a6a04ed1-3642-4dd1-988f-33332cfce760 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] 10.222.0.33 "GET /compute/v2.1/servers/0d0f17c3-e777-4c71-a9df-b2de76f0615a" status: 200 len: 1269 microversion: 2.1 time: 0.187143 Sep 23 05:10:46.023328 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3459/6737] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:10:45 2022] GET /compute/v2.1/servers/0d0f17c3-e777-4c71-a9df-b2de76f0615a => generated 1269 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:10:46.264849 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5f06b9fc-85b8-4090-bf4a-5eedab151a31 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:10:46.266237 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5f06b9fc-85b8-4090-bf4a-5eedab151a31 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 7ad3508b-1d37-4c7b-82c7-be195566aacb] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:10:46.278842 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5f06b9fc-85b8-4090-bf4a-5eedab151a31 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:46.279563 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5f06b9fc-85b8-4090-bf4a-5eedab151a31 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:46.280128 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5f06b9fc-85b8-4090-bf4a-5eedab151a31 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:46.280938 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5f06b9fc-85b8-4090-bf4a-5eedab151a31 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:46.281486 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5f06b9fc-85b8-4090-bf4a-5eedab151a31 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:46.282282 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5f06b9fc-85b8-4090-bf4a-5eedab151a31 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:46.348715 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-5f06b9fc-85b8-4090-bf4a-5eedab151a31 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:10:46.358392 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5f06b9fc-85b8-4090-bf4a-5eedab151a31 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb" status: 200 len: 1361 microversion: 2.1 time: 0.097843 Sep 23 05:10:46.359438 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3279/6738] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:10:46 2022] GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb => generated 1361 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:10:47.036677 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a63b7c30-2377-4dc8-87ff-e8bc8cf47057 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:10:47.037414 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a63b7c30-2377-4dc8-87ff-e8bc8cf47057 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] [instance: 0d0f17c3-e777-4c71-a9df-b2de76f0615a] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:10:47.040091 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:10:47.045028 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a63b7c30-2377-4dc8-87ff-e8bc8cf47057 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:47.047008 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a63b7c30-2377-4dc8-87ff-e8bc8cf47057 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:47.047008 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a63b7c30-2377-4dc8-87ff-e8bc8cf47057 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:47.047008 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a63b7c30-2377-4dc8-87ff-e8bc8cf47057 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:47.047398 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a63b7c30-2377-4dc8-87ff-e8bc8cf47057 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:47.047567 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a63b7c30-2377-4dc8-87ff-e8bc8cf47057 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:47.204714 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a63b7c30-2377-4dc8-87ff-e8bc8cf47057 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82736eb912544711991da4f27c321f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116ae3ab00e447f89c7e8210ba89be75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:10:47.218793 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a63b7c30-2377-4dc8-87ff-e8bc8cf47057 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] 10.222.0.33 "GET /compute/v2.1/servers/0d0f17c3-e777-4c71-a9df-b2de76f0615a" status: 200 len: 1458 microversion: 2.1 time: 0.186038 Sep 23 05:10:47.219390 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3460/6739] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:10:47 2022] GET /compute/v2.1/servers/0d0f17c3-e777-4c71-a9df-b2de76f0615a => generated 1458 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:10:47.246618 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8fc05910-24f8-42cc-95c1-7a44e1211407 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:10:47.247245 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8fc05910-24f8-42cc-95c1-7a44e1211407 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] [instance: 0d0f17c3-e777-4c71-a9df-b2de76f0615a] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:10:47.254875 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8fc05910-24f8-42cc-95c1-7a44e1211407 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:47.255677 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8fc05910-24f8-42cc-95c1-7a44e1211407 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:47.256287 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8fc05910-24f8-42cc-95c1-7a44e1211407 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:47.257258 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8fc05910-24f8-42cc-95c1-7a44e1211407 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:47.258003 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8fc05910-24f8-42cc-95c1-7a44e1211407 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:47.258653 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8fc05910-24f8-42cc-95c1-7a44e1211407 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:47.385021 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8f5953de-fee4-4f16-9daf-a763c7bc9d31 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:10:47.386036 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-8f5953de-fee4-4f16-9daf-a763c7bc9d31 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 7ad3508b-1d37-4c7b-82c7-be195566aacb] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:10:47.393134 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8f5953de-fee4-4f16-9daf-a763c7bc9d31 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:47.393936 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8f5953de-fee4-4f16-9daf-a763c7bc9d31 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:47.396374 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8f5953de-fee4-4f16-9daf-a763c7bc9d31 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:47.396374 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8f5953de-fee4-4f16-9daf-a763c7bc9d31 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:47.397095 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8f5953de-fee4-4f16-9daf-a763c7bc9d31 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:47.397609 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8f5953de-fee4-4f16-9daf-a763c7bc9d31 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:47.426551 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8fc05910-24f8-42cc-95c1-7a44e1211407 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82736eb912544711991da4f27c321f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116ae3ab00e447f89c7e8210ba89be75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:10:47.434957 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8fc05910-24f8-42cc-95c1-7a44e1211407 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] 10.222.0.33 "GET /compute/v2.1/servers/0d0f17c3-e777-4c71-a9df-b2de76f0615a" status: 200 len: 1458 microversion: 2.1 time: 0.192206 Sep 23 05:10:47.435751 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3280/6740] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:10:47 2022] GET /compute/v2.1/servers/0d0f17c3-e777-4c71-a9df-b2de76f0615a => generated 1458 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:10:47.474560 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-8f5953de-fee4-4f16-9daf-a763c7bc9d31 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:10:47.488691 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-8f5953de-fee4-4f16-9daf-a763c7bc9d31 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb" status: 200 len: 1361 microversion: 2.1 time: 0.106025 Sep 23 05:10:47.488691 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3461/6741] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:10:47 2022] GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb => generated 1361 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:10:48.514114 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1f9bea0a-4f1c-46e7-99fc-189f69cc895e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:10:48.514738 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-1f9bea0a-4f1c-46e7-99fc-189f69cc895e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 7ad3508b-1d37-4c7b-82c7-be195566aacb] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:10:48.525262 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1f9bea0a-4f1c-46e7-99fc-189f69cc895e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:48.525262 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1f9bea0a-4f1c-46e7-99fc-189f69cc895e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:48.530842 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1f9bea0a-4f1c-46e7-99fc-189f69cc895e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:48.531737 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1f9bea0a-4f1c-46e7-99fc-189f69cc895e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:48.532242 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1f9bea0a-4f1c-46e7-99fc-189f69cc895e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:48.532696 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1f9bea0a-4f1c-46e7-99fc-189f69cc895e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:48.556925 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-1f9bea0a-4f1c-46e7-99fc-189f69cc895e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] HTTP exception thrown: Instance 7ad3508b-1d37-4c7b-82c7-be195566aacb could not be found. Sep 23 05:10:48.559064 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1f9bea0a-4f1c-46e7-99fc-189f69cc895e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Request method failure captured: Sep 23 05:10:48.559064 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb HTTP/1.1 Sep 23 05:10:48.559064 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 05:10:48.559064 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 05:10:48.559064 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 05:10:48.559064 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 05:10:48.559064 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 05:10:48.559064 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 05:10:48.559064 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 05:10:48.559064 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 05:10:48.559064 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLT3uLjiu4nPUFbkjrA4MyWVqiSG18wQr6d8tQl_P_I7oXAw8rp2FE6LolJR7q-NpMkbDL2xBtL-Km4xLll-czE6HybNQXkbhp5AdNp7lc8uSbgBeOP-qACziHhtaYPCszQMgYlHiKqFljv5hFyHB9WCa7Y2j2z8m1qKy7sQfYfHm2rE Sep 23 05:10:48.559064 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 05:10:48.559064 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 05:10:48.559064 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 05:10:48.559064 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 05:10:48.559064 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 05:10:48.559064 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 05:10:48.559064 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: cceaa1e24146497fbf3f79cebc112211 Sep 23 05:10:48.559064 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-TestVolumeBootPattern-1815855430 Sep 23 05:10:48.559064 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 05:10:48.559064 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 05:10:48.559064 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cceaa1e24146497fbf3f79cebc112211", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cceaa1e24146497fbf3f79cebc112211"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cceaa1e24146497fbf3f79cebc112211"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cceaa1e24146497fbf3f79cebc112211"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:10:48.559064 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-TestVolumeBootPattern-1815855430 Sep 23 05:10:48.559064 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: cceaa1e24146497fbf3f79cebc112211 Sep 23 05:10:48.559064 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-TestVolumeBootPattern-1815855430 Sep 23 05:10:48.559064 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-TestVolumeBootPattern-1815855430-project Sep 23 05:10:48.559064 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 05:10:48.559064 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 05:10:48.559064 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 0d55fe5072c14752846eb4ffc0eef91b Sep 23 05:10:48.559064 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-TestVolumeBootPattern-1815855430-project Sep 23 05:10:48.559064 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 05:10:48.559064 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 7ad3508b-1d37-4c7b-82c7-be195566aacb could not be found. Sep 23 05:10:48.559064 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '7ad3508b-1d37-4c7b-82c7-be195566aacb'} Sep 23 05:10:48.559064 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:10:48.559064 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:10:48.559064 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 05:10:48.559064 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 05:10:48.559064 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 05:10:48.559064 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 05:10:48.559064 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 05:10:48.559064 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 05:10:48.559064 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 05:10:48.559064 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 05:10:48.559064 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ad3508b-1d37-4c7b-82c7-be195566aacb could not be found. Sep 23 05:10:48.559064 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:10:48.559064 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:10:48.559064 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:10:48.559064 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:10:48.559064 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:10:48.559064 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:10:48.559064 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:10:48.559064 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:10:48.559064 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:10:48.559064 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:10:48.559064 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 05:10:48.559064 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 05:10:48.559064 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 05:10:48.559064 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 05:10:48.559064 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 05:10:48.559064 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:10:48.559064 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ad3508b-1d37-4c7b-82c7-be195566aacb could not be found. Sep 23 05:10:48.559064 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:10:48.559064 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:10:48.559064 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:10:48.568419 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:10:48.568419 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:10:48.568419 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:10:48.568419 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:10:48.568419 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:10:48.568419 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ad3508b-1d37-4c7b-82c7-be195566aacb could not be found. Sep 23 05:10:48.568419 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:10:48.568419 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1f9bea0a-4f1c-46e7-99fc-189f69cc895e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Returning 404 to user: Instance 7ad3508b-1d37-4c7b-82c7-be195566aacb could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:10:48.568419 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-1f9bea0a-4f1c-46e7-99fc-189f69cc895e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb" status: 404 len: 111 microversion: 2.1 time: 0.050810 Sep 23 05:10:48.568419 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3281/6742] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:10:48 2022] GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 05:10:50.026232 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-439261e8-3b98-4cf0-9eef-a9dd22add591 req-ac2df655-13f8-4624-be16-82b9e65384bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d0f17c3-e777-4c71-a9df-b2de76f0615a", "tag": "5ea5a3a5-1af1-43c1-8697-61d4b860eea6"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:10:50.050163 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-439261e8-3b98-4cf0-9eef-a9dd22add591 req-ac2df655-13f8-4624-be16-82b9e65384bc service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:50.051101 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-439261e8-3b98-4cf0-9eef-a9dd22add591 req-ac2df655-13f8-4624-be16-82b9e65384bc service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:50.051714 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-439261e8-3b98-4cf0-9eef-a9dd22add591 req-ac2df655-13f8-4624-be16-82b9e65384bc service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:50.090051 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-439261e8-3b98-4cf0-9eef-a9dd22add591 req-ac2df655-13f8-4624-be16-82b9e65384bc service nova] Creating event network-changed:5ea5a3a5-1af1-43c1-8697-61d4b860eea6 for instance 0d0f17c3-e777-4c71-a9df-b2de76f0615a on n-h1-846463-3 Sep 23 05:10:50.100448 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-439261e8-3b98-4cf0-9eef-a9dd22add591 req-ac2df655-13f8-4624-be16-82b9e65384bc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078249 Sep 23 05:10:50.101490 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3462/6743] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:10:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:10:52.348251 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-fd3c9848-ca73-41bf-95a2-25131866ff39 req-26834c12-a288-4e6b-83b6-2d26d2e7bde3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d0f17c3-e777-4c71-a9df-b2de76f0615a", "tag": "5ea5a3a5-1af1-43c1-8697-61d4b860eea6"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:10:52.373314 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-fd3c9848-ca73-41bf-95a2-25131866ff39 req-26834c12-a288-4e6b-83b6-2d26d2e7bde3 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:52.374453 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-fd3c9848-ca73-41bf-95a2-25131866ff39 req-26834c12-a288-4e6b-83b6-2d26d2e7bde3 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:52.380929 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-fd3c9848-ca73-41bf-95a2-25131866ff39 req-26834c12-a288-4e6b-83b6-2d26d2e7bde3 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:52.400457 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-fd3c9848-ca73-41bf-95a2-25131866ff39 req-26834c12-a288-4e6b-83b6-2d26d2e7bde3 service nova] Creating event network-changed:5ea5a3a5-1af1-43c1-8697-61d4b860eea6 for instance 0d0f17c3-e777-4c71-a9df-b2de76f0615a on n-h1-846463-3 Sep 23 05:10:52.406478 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-fd3c9848-ca73-41bf-95a2-25131866ff39 req-26834c12-a288-4e6b-83b6-2d26d2e7bde3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061917 Sep 23 05:10:52.407446 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3282/6744] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:10:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:10:54.452944 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-55aa39f2-9e16-4dd6-8bae-88f58eeefcda req-952f4a50-7810-435a-bdc6-be6da97c9555 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d0f17c3-e777-4c71-a9df-b2de76f0615a", "tag": "5ea5a3a5-1af1-43c1-8697-61d4b860eea6"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:10:54.481175 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-55aa39f2-9e16-4dd6-8bae-88f58eeefcda req-952f4a50-7810-435a-bdc6-be6da97c9555 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:54.485472 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-55aa39f2-9e16-4dd6-8bae-88f58eeefcda req-952f4a50-7810-435a-bdc6-be6da97c9555 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:54.485620 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-55aa39f2-9e16-4dd6-8bae-88f58eeefcda req-952f4a50-7810-435a-bdc6-be6da97c9555 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:54.542771 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-55aa39f2-9e16-4dd6-8bae-88f58eeefcda req-952f4a50-7810-435a-bdc6-be6da97c9555 service nova] Creating event network-changed:5ea5a3a5-1af1-43c1-8697-61d4b860eea6 for instance 0d0f17c3-e777-4c71-a9df-b2de76f0615a on n-h1-846463-3 Sep 23 05:10:54.548189 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-55aa39f2-9e16-4dd6-8bae-88f58eeefcda req-952f4a50-7810-435a-bdc6-be6da97c9555 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101084 Sep 23 05:10:54.549408 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3463/6745] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:10:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:10:57.411834 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-abeefb41-c8ff-45fd-9262-d8f36fdd0ca1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:10:57.412440 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-abeefb41-c8ff-45fd-9262-d8f36fdd0ca1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 362777d0-bfa6-4058-8875-e4c28c85f576] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:10:57.419524 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-abeefb41-c8ff-45fd-9262-d8f36fdd0ca1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:57.420542 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-abeefb41-c8ff-45fd-9262-d8f36fdd0ca1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:57.421089 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-abeefb41-c8ff-45fd-9262-d8f36fdd0ca1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:57.421839 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-abeefb41-c8ff-45fd-9262-d8f36fdd0ca1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:57.422326 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-abeefb41-c8ff-45fd-9262-d8f36fdd0ca1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:57.422776 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-abeefb41-c8ff-45fd-9262-d8f36fdd0ca1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:57.449919 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-abeefb41-c8ff-45fd-9262-d8f36fdd0ca1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 362777d0-bfa6-4058-8875-e4c28c85f576] Going to try to terminate instance {{(pid=122698) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 05:10:57.485369 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:10:57.858600 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-abeefb41-c8ff-45fd-9262-d8f36fdd0ca1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "DELETE /compute/v2.1/servers/362777d0-bfa6-4058-8875-e4c28c85f576" status: 204 len: 0 microversion: 2.1 time: 0.453233 Sep 23 05:10:57.862369 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3283/6746] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 05:10:57 2022] DELETE /compute/v2.1/servers/362777d0-bfa6-4058-8875-e4c28c85f576 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 05:10:57.870394 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e8d2c09b-69be-46de-9657-418da819d8b9 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:10:57.871206 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e8d2c09b-69be-46de-9657-418da819d8b9 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 362777d0-bfa6-4058-8875-e4c28c85f576] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:10:57.877700 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e8d2c09b-69be-46de-9657-418da819d8b9 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:57.878522 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e8d2c09b-69be-46de-9657-418da819d8b9 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:57.878972 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e8d2c09b-69be-46de-9657-418da819d8b9 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:57.879980 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e8d2c09b-69be-46de-9657-418da819d8b9 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:57.880447 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e8d2c09b-69be-46de-9657-418da819d8b9 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:57.880884 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e8d2c09b-69be-46de-9657-418da819d8b9 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:58.191611 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e8d2c09b-69be-46de-9657-418da819d8b9 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:10:58.214951 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e8d2c09b-69be-46de-9657-418da819d8b9 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/362777d0-bfa6-4058-8875-e4c28c85f576" status: 200 len: 1410 microversion: 2.1 time: 0.350579 Sep 23 05:10:58.215541 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3464/6747] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:10:57 2022] GET /compute/v2.1/servers/362777d0-bfa6-4058-8875-e4c28c85f576 => generated 1410 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:10:59.244964 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-cdad120f-bfb3-4225-bbca-60c50d60cec3 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:10:59.245917 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-cdad120f-bfb3-4225-bbca-60c50d60cec3 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 362777d0-bfa6-4058-8875-e4c28c85f576] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:10:59.253144 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cdad120f-bfb3-4225-bbca-60c50d60cec3 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:59.258025 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cdad120f-bfb3-4225-bbca-60c50d60cec3 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:59.258025 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cdad120f-bfb3-4225-bbca-60c50d60cec3 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:59.258025 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cdad120f-bfb3-4225-bbca-60c50d60cec3 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:10:59.258025 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cdad120f-bfb3-4225-bbca-60c50d60cec3 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:10:59.258025 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cdad120f-bfb3-4225-bbca-60c50d60cec3 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:10:59.419700 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-cdad120f-bfb3-4225-bbca-60c50d60cec3 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:10:59.428630 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-cdad120f-bfb3-4225-bbca-60c50d60cec3 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/362777d0-bfa6-4058-8875-e4c28c85f576" status: 200 len: 1410 microversion: 2.1 time: 0.188914 Sep 23 05:10:59.438228 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3284/6748] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:10:59 2022] GET /compute/v2.1/servers/362777d0-bfa6-4058-8875-e4c28c85f576 => generated 1410 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:10:59.992791 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-21042dd2-1824-42f8-b92c-723c67a3ee17 req-2b5504a6-efa1-403e-9030-57e48a9140ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "362777d0-bfa6-4058-8875-e4c28c85f576", "name": "network-vif-deleted", "tag": "da0ab434-f9ad-4d6b-bd5e-206238561f05"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:11:00.002790 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-21042dd2-1824-42f8-b92c-723c67a3ee17 req-2b5504a6-efa1-403e-9030-57e48a9140ae service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:11:00.003269 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-21042dd2-1824-42f8-b92c-723c67a3ee17 req-2b5504a6-efa1-403e-9030-57e48a9140ae service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:11:00.003731 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-21042dd2-1824-42f8-b92c-723c67a3ee17 req-2b5504a6-efa1-403e-9030-57e48a9140ae service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:11:00.019022 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-21042dd2-1824-42f8-b92c-723c67a3ee17 req-2b5504a6-efa1-403e-9030-57e48a9140ae service nova] Creating event network-vif-deleted:da0ab434-f9ad-4d6b-bd5e-206238561f05 for instance 362777d0-bfa6-4058-8875-e4c28c85f576 on n-h2-846463-3 Sep 23 05:11:00.024868 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-21042dd2-1824-42f8-b92c-723c67a3ee17 req-2b5504a6-efa1-403e-9030-57e48a9140ae service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035794 Sep 23 05:11:00.025516 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3465/6749] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:10:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:11:00.453323 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a4809d91-544d-4996-82e8-d88b9fae29f7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:11:00.453906 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a4809d91-544d-4996-82e8-d88b9fae29f7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 362777d0-bfa6-4058-8875-e4c28c85f576] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:11:00.471645 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a4809d91-544d-4996-82e8-d88b9fae29f7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:11:00.472460 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a4809d91-544d-4996-82e8-d88b9fae29f7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:11:00.473081 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a4809d91-544d-4996-82e8-d88b9fae29f7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:11:00.477070 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a4809d91-544d-4996-82e8-d88b9fae29f7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:11:00.477070 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a4809d91-544d-4996-82e8-d88b9fae29f7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:11:00.477070 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a4809d91-544d-4996-82e8-d88b9fae29f7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:11:00.553396 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a4809d91-544d-4996-82e8-d88b9fae29f7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:11:00.564344 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a4809d91-544d-4996-82e8-d88b9fae29f7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/362777d0-bfa6-4058-8875-e4c28c85f576" status: 200 len: 1202 microversion: 2.1 time: 0.115362 Sep 23 05:11:00.566655 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3285/6750] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:11:00 2022] GET /compute/v2.1/servers/362777d0-bfa6-4058-8875-e4c28c85f576 => generated 1202 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:11:01.595199 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a254822a-94b9-4d71-9a4f-3cb2b4b599de tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:11:01.596568 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a254822a-94b9-4d71-9a4f-3cb2b4b599de tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 362777d0-bfa6-4058-8875-e4c28c85f576] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:11:01.606718 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a254822a-94b9-4d71-9a4f-3cb2b4b599de tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:11:01.607397 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a254822a-94b9-4d71-9a4f-3cb2b4b599de tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:11:01.608010 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a254822a-94b9-4d71-9a4f-3cb2b4b599de tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:11:01.609013 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a254822a-94b9-4d71-9a4f-3cb2b4b599de tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:11:01.610497 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a254822a-94b9-4d71-9a4f-3cb2b4b599de tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:11:01.611443 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a254822a-94b9-4d71-9a4f-3cb2b4b599de tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:11:01.697812 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a254822a-94b9-4d71-9a4f-3cb2b4b599de tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:11:01.706127 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a254822a-94b9-4d71-9a4f-3cb2b4b599de tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/362777d0-bfa6-4058-8875-e4c28c85f576" status: 200 len: 1202 microversion: 2.1 time: 0.116836 Sep 23 05:11:01.707537 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3466/6751] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:11:01 2022] GET /compute/v2.1/servers/362777d0-bfa6-4058-8875-e4c28c85f576 => generated 1202 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:11:02.732174 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8d9df18f-65c4-41eb-b459-67122338251f tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:11:02.733481 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8d9df18f-65c4-41eb-b459-67122338251f tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 362777d0-bfa6-4058-8875-e4c28c85f576] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:11:02.743764 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8d9df18f-65c4-41eb-b459-67122338251f tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:11:02.744725 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8d9df18f-65c4-41eb-b459-67122338251f tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:11:02.745400 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8d9df18f-65c4-41eb-b459-67122338251f tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:11:02.746379 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8d9df18f-65c4-41eb-b459-67122338251f tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:11:02.747932 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8d9df18f-65c4-41eb-b459-67122338251f tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:11:02.748600 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8d9df18f-65c4-41eb-b459-67122338251f tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:11:02.964187 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8d9df18f-65c4-41eb-b459-67122338251f tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:11:02.975897 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8d9df18f-65c4-41eb-b459-67122338251f tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/362777d0-bfa6-4058-8875-e4c28c85f576" status: 200 len: 1202 microversion: 2.1 time: 0.248506 Sep 23 05:11:02.977228 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3286/6752] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:11:02 2022] GET /compute/v2.1/servers/362777d0-bfa6-4058-8875-e4c28c85f576 => generated 1202 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:11:04.004787 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-619b8357-7993-4eab-809d-76ae1af1e0d5 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:11:04.005428 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-619b8357-7993-4eab-809d-76ae1af1e0d5 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 362777d0-bfa6-4058-8875-e4c28c85f576] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:11:04.013143 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-619b8357-7993-4eab-809d-76ae1af1e0d5 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:11:04.013946 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-619b8357-7993-4eab-809d-76ae1af1e0d5 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:11:04.014573 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-619b8357-7993-4eab-809d-76ae1af1e0d5 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:11:04.015456 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-619b8357-7993-4eab-809d-76ae1af1e0d5 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:11:04.016080 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-619b8357-7993-4eab-809d-76ae1af1e0d5 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:11:04.016672 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-619b8357-7993-4eab-809d-76ae1af1e0d5 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:11:04.115198 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-619b8357-7993-4eab-809d-76ae1af1e0d5 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:11:04.123349 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-619b8357-7993-4eab-809d-76ae1af1e0d5 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/362777d0-bfa6-4058-8875-e4c28c85f576" status: 200 len: 1202 microversion: 2.1 time: 0.126084 Sep 23 05:11:04.134371 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3467/6753] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:11:03 2022] GET /compute/v2.1/servers/362777d0-bfa6-4058-8875-e4c28c85f576 => generated 1202 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:11:05.149765 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3819ccbf-f731-434a-a28f-9b0b48a12d57 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:11:05.151311 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3819ccbf-f731-434a-a28f-9b0b48a12d57 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 362777d0-bfa6-4058-8875-e4c28c85f576] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:11:05.163438 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3819ccbf-f731-434a-a28f-9b0b48a12d57 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:11:05.174793 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3819ccbf-f731-434a-a28f-9b0b48a12d57 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:11:05.175581 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3819ccbf-f731-434a-a28f-9b0b48a12d57 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:11:05.176511 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3819ccbf-f731-434a-a28f-9b0b48a12d57 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:11:05.177151 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3819ccbf-f731-434a-a28f-9b0b48a12d57 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:11:05.177767 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3819ccbf-f731-434a-a28f-9b0b48a12d57 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:11:05.218159 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3819ccbf-f731-434a-a28f-9b0b48a12d57 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:11:05.219144 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3819ccbf-f731-434a-a28f-9b0b48a12d57 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:11:05.220139 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3819ccbf-f731-434a-a28f-9b0b48a12d57 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:11:05.220938 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-3819ccbf-f731-434a-a28f-9b0b48a12d57 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lazy-loading 'fault' on Instance uuid 362777d0-bfa6-4058-8875-e4c28c85f576 {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 05:11:05.282733 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-3819ccbf-f731-434a-a28f-9b0b48a12d57 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:11:05.294819 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3819ccbf-f731-434a-a28f-9b0b48a12d57 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/362777d0-bfa6-4058-8875-e4c28c85f576" status: 200 len: 1207 microversion: 2.1 time: 0.148703 Sep 23 05:11:05.295417 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3287/6754] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:11:05 2022] GET /compute/v2.1/servers/362777d0-bfa6-4058-8875-e4c28c85f576 => generated 1207 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:11:06.320268 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3929ecf8-e075-4292-9f6f-e6c70d7c21c1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:11:06.324873 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-3929ecf8-e075-4292-9f6f-e6c70d7c21c1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 362777d0-bfa6-4058-8875-e4c28c85f576] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:11:06.336648 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3929ecf8-e075-4292-9f6f-e6c70d7c21c1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:11:06.337406 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3929ecf8-e075-4292-9f6f-e6c70d7c21c1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:11:06.341338 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3929ecf8-e075-4292-9f6f-e6c70d7c21c1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:11:06.342832 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3929ecf8-e075-4292-9f6f-e6c70d7c21c1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:11:06.343657 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3929ecf8-e075-4292-9f6f-e6c70d7c21c1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:11:06.345086 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3929ecf8-e075-4292-9f6f-e6c70d7c21c1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:11:06.367404 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-3929ecf8-e075-4292-9f6f-e6c70d7c21c1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] HTTP exception thrown: Instance 362777d0-bfa6-4058-8875-e4c28c85f576 could not be found. Sep 23 05:11:06.369192 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3929ecf8-e075-4292-9f6f-e6c70d7c21c1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Request method failure captured: Sep 23 05:11:06.369192 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/362777d0-bfa6-4058-8875-e4c28c85f576 HTTP/1.1 Sep 23 05:11:06.369192 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 05:11:06.369192 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 05:11:06.369192 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 05:11:06.369192 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 05:11:06.369192 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 05:11:06.369192 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 05:11:06.369192 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 05:11:06.369192 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 05:11:06.369192 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLT3uLjiu4nPUFbkjrA4MyWVqiSG18wQr6d8tQl_P_I7oXAw8rp2FE6LolJR7q-NpMkbDL2xBtL-Km4xLll-czE6HybNQXkbhp5AdNp7lc8uSbgBeOP-qACziHhtaYPCszQMgYlHiKqFljv5hFyHB9WCa7Y2j2z8m1qKy7sQfYfHm2rE Sep 23 05:11:06.369192 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 05:11:06.369192 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 05:11:06.369192 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 05:11:06.369192 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 05:11:06.369192 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 05:11:06.369192 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 05:11:06.369192 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: cceaa1e24146497fbf3f79cebc112211 Sep 23 05:11:06.369192 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-TestVolumeBootPattern-1815855430 Sep 23 05:11:06.369192 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 05:11:06.369192 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 05:11:06.369192 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cceaa1e24146497fbf3f79cebc112211", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cceaa1e24146497fbf3f79cebc112211"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cceaa1e24146497fbf3f79cebc112211"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cceaa1e24146497fbf3f79cebc112211"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:11:06.369192 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-TestVolumeBootPattern-1815855430 Sep 23 05:11:06.369192 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: cceaa1e24146497fbf3f79cebc112211 Sep 23 05:11:06.369192 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-TestVolumeBootPattern-1815855430 Sep 23 05:11:06.369192 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-TestVolumeBootPattern-1815855430-project Sep 23 05:11:06.369192 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 05:11:06.369192 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 05:11:06.369192 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 0d55fe5072c14752846eb4ffc0eef91b Sep 23 05:11:06.369192 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-TestVolumeBootPattern-1815855430-project Sep 23 05:11:06.369192 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 05:11:06.369192 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 362777d0-bfa6-4058-8875-e4c28c85f576 could not be found. Sep 23 05:11:06.369192 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '362777d0-bfa6-4058-8875-e4c28c85f576'} Sep 23 05:11:06.369192 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:11:06.369192 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:11:06.369192 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 05:11:06.369192 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 05:11:06.369192 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 05:11:06.369192 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 05:11:06.369192 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 05:11:06.369192 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 05:11:06.369192 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 05:11:06.369192 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 05:11:06.369192 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 362777d0-bfa6-4058-8875-e4c28c85f576 could not be found. Sep 23 05:11:06.369192 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:11:06.369192 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:11:06.369192 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:11:06.369192 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:11:06.369192 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:11:06.369192 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:11:06.369192 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:11:06.369192 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:11:06.369192 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:11:06.369192 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:11:06.369192 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 05:11:06.369192 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 05:11:06.369192 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 05:11:06.369192 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 05:11:06.369192 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 05:11:06.369192 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:11:06.369192 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 362777d0-bfa6-4058-8875-e4c28c85f576 could not be found. Sep 23 05:11:06.369192 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:11:06.369192 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:11:06.369192 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:11:06.374040 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:11:06.374040 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:11:06.374040 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:11:06.374040 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:11:06.374040 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:11:06.374040 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 362777d0-bfa6-4058-8875-e4c28c85f576 could not be found. Sep 23 05:11:06.374040 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:11:06.374040 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3929ecf8-e075-4292-9f6f-e6c70d7c21c1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Returning 404 to user: Instance 362777d0-bfa6-4058-8875-e4c28c85f576 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:11:06.374040 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3929ecf8-e075-4292-9f6f-e6c70d7c21c1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/362777d0-bfa6-4058-8875-e4c28c85f576" status: 404 len: 111 microversion: 2.1 time: 0.055771 Sep 23 05:11:06.375125 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3468/6755] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:11:06 2022] GET /compute/v2.1/servers/362777d0-bfa6-4058-8875-e4c28c85f576 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 05:11:09.628525 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2ce79514-cac2-4d6a-80f2-9c10d083edba tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:11:09.628525 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-2ce79514-cac2-4d6a-80f2-9c10d083edba tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 7ad3508b-1d37-4c7b-82c7-be195566aacb] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:11:09.641468 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2ce79514-cac2-4d6a-80f2-9c10d083edba tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:11:09.642616 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2ce79514-cac2-4d6a-80f2-9c10d083edba tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:11:09.645572 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2ce79514-cac2-4d6a-80f2-9c10d083edba tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:11:09.646554 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2ce79514-cac2-4d6a-80f2-9c10d083edba tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:11:09.647055 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2ce79514-cac2-4d6a-80f2-9c10d083edba tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:11:09.647522 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2ce79514-cac2-4d6a-80f2-9c10d083edba tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:11:09.683000 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-2ce79514-cac2-4d6a-80f2-9c10d083edba tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] HTTP exception thrown: Instance 7ad3508b-1d37-4c7b-82c7-be195566aacb could not be found. Sep 23 05:11:09.685444 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2ce79514-cac2-4d6a-80f2-9c10d083edba tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Request method failure captured: Sep 23 05:11:09.685444 n-d-846463-3 devstack@n-api.service[122698]: request: DELETE /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb HTTP/1.1 Sep 23 05:11:09.685444 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 05:11:09.685444 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 05:11:09.685444 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 05:11:09.685444 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 05:11:09.685444 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 05:11:09.685444 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 05:11:09.685444 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 05:11:09.685444 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 05:11:09.685444 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLT3uLjiu4nPUFbkjrA4MyWVqiSG18wQr6d8tQl_P_I7oXAw8rp2FE6LolJR7q-NpMkbDL2xBtL-Km4xLll-czE6HybNQXkbhp5AdNp7lc8uSbgBeOP-qACziHhtaYPCszQMgYlHiKqFljv5hFyHB9WCa7Y2j2z8m1qKy7sQfYfHm2rE Sep 23 05:11:09.685444 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 05:11:09.685444 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 05:11:09.685444 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 05:11:09.685444 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 05:11:09.685444 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 05:11:09.685444 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 05:11:09.685444 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: cceaa1e24146497fbf3f79cebc112211 Sep 23 05:11:09.685444 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-TestVolumeBootPattern-1815855430 Sep 23 05:11:09.685444 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 05:11:09.685444 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 05:11:09.685444 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cceaa1e24146497fbf3f79cebc112211", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cceaa1e24146497fbf3f79cebc112211"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cceaa1e24146497fbf3f79cebc112211"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cceaa1e24146497fbf3f79cebc112211"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:11:09.685444 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-TestVolumeBootPattern-1815855430 Sep 23 05:11:09.685444 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: cceaa1e24146497fbf3f79cebc112211 Sep 23 05:11:09.685444 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-TestVolumeBootPattern-1815855430 Sep 23 05:11:09.685444 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-TestVolumeBootPattern-1815855430-project Sep 23 05:11:09.685444 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 05:11:09.685444 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 05:11:09.685444 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 0d55fe5072c14752846eb4ffc0eef91b Sep 23 05:11:09.685444 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-TestVolumeBootPattern-1815855430-project Sep 23 05:11:09.685444 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 05:11:09.685444 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 7ad3508b-1d37-4c7b-82c7-be195566aacb could not be found. Sep 23 05:11:09.685444 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '7ad3508b-1d37-4c7b-82c7-be195566aacb'} Sep 23 05:11:09.685444 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:11:09.685444 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:11:09.685444 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 05:11:09.685444 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 05:11:09.685444 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 05:11:09.685444 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 05:11:09.685444 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 05:11:09.685444 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 05:11:09.685444 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 05:11:09.685444 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 05:11:09.685444 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ad3508b-1d37-4c7b-82c7-be195566aacb could not be found. Sep 23 05:11:09.685444 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:11:09.685444 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:11:09.685444 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:11:09.685444 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:11:09.685444 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:11:09.685444 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:11:09.685444 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:11:09.685444 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:11:09.685444 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:11:09.685444 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:11:09.685444 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 05:11:09.685444 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 05:11:09.685444 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 05:11:09.685444 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 05:11:09.685444 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 05:11:09.685444 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 05:11:09.685444 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 05:11:09.685444 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:11:09.689468 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ad3508b-1d37-4c7b-82c7-be195566aacb could not be found. Sep 23 05:11:09.689468 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:11:09.689468 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:11:09.689468 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:11:09.689468 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:11:09.689468 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:11:09.689468 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:11:09.689468 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:11:09.689468 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:11:09.689468 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ad3508b-1d37-4c7b-82c7-be195566aacb could not be found. Sep 23 05:11:09.689468 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:11:09.697675 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2ce79514-cac2-4d6a-80f2-9c10d083edba tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Returning 404 to user: Instance 7ad3508b-1d37-4c7b-82c7-be195566aacb could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:11:09.697675 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2ce79514-cac2-4d6a-80f2-9c10d083edba tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "DELETE /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb" status: 404 len: 111 microversion: 2.1 time: 0.074497 Sep 23 05:11:09.697675 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3288/6756] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 05:11:09 2022] DELETE /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 05:11:09.701235 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d850620e-59e2-4cb2-b8b2-846b65661937 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:11:09.702524 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d850620e-59e2-4cb2-b8b2-846b65661937 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 7ad3508b-1d37-4c7b-82c7-be195566aacb] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:11:09.716429 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d850620e-59e2-4cb2-b8b2-846b65661937 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:11:09.717433 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d850620e-59e2-4cb2-b8b2-846b65661937 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:11:09.718130 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d850620e-59e2-4cb2-b8b2-846b65661937 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:11:09.719306 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d850620e-59e2-4cb2-b8b2-846b65661937 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:11:09.719961 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d850620e-59e2-4cb2-b8b2-846b65661937 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:11:09.723055 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d850620e-59e2-4cb2-b8b2-846b65661937 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:11:09.749743 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-d850620e-59e2-4cb2-b8b2-846b65661937 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] HTTP exception thrown: Instance 7ad3508b-1d37-4c7b-82c7-be195566aacb could not be found. Sep 23 05:11:09.751736 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d850620e-59e2-4cb2-b8b2-846b65661937 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Request method failure captured: Sep 23 05:11:09.751736 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb HTTP/1.1 Sep 23 05:11:09.751736 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 05:11:09.751736 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 05:11:09.751736 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 05:11:09.751736 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 05:11:09.751736 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 05:11:09.751736 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 05:11:09.751736 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 05:11:09.751736 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 05:11:09.751736 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLT3uLjiu4nPUFbkjrA4MyWVqiSG18wQr6d8tQl_P_I7oXAw8rp2FE6LolJR7q-NpMkbDL2xBtL-Km4xLll-czE6HybNQXkbhp5AdNp7lc8uSbgBeOP-qACziHhtaYPCszQMgYlHiKqFljv5hFyHB9WCa7Y2j2z8m1qKy7sQfYfHm2rE Sep 23 05:11:09.751736 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 05:11:09.751736 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 05:11:09.751736 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 05:11:09.751736 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 05:11:09.751736 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 05:11:09.751736 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 05:11:09.751736 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: cceaa1e24146497fbf3f79cebc112211 Sep 23 05:11:09.751736 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-TestVolumeBootPattern-1815855430 Sep 23 05:11:09.751736 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 05:11:09.751736 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 05:11:09.751736 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cceaa1e24146497fbf3f79cebc112211", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cceaa1e24146497fbf3f79cebc112211"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cceaa1e24146497fbf3f79cebc112211"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cceaa1e24146497fbf3f79cebc112211"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:11:09.751736 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-TestVolumeBootPattern-1815855430 Sep 23 05:11:09.751736 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: cceaa1e24146497fbf3f79cebc112211 Sep 23 05:11:09.751736 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-TestVolumeBootPattern-1815855430 Sep 23 05:11:09.751736 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-TestVolumeBootPattern-1815855430-project Sep 23 05:11:09.751736 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 05:11:09.751736 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 05:11:09.751736 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 0d55fe5072c14752846eb4ffc0eef91b Sep 23 05:11:09.751736 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-TestVolumeBootPattern-1815855430-project Sep 23 05:11:09.751736 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 05:11:09.751736 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 7ad3508b-1d37-4c7b-82c7-be195566aacb could not be found. Sep 23 05:11:09.751736 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '7ad3508b-1d37-4c7b-82c7-be195566aacb'} Sep 23 05:11:09.751736 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:11:09.751736 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:11:09.751736 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 05:11:09.751736 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 05:11:09.751736 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 05:11:09.751736 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 05:11:09.751736 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 05:11:09.751736 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 05:11:09.751736 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 05:11:09.751736 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 05:11:09.751736 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ad3508b-1d37-4c7b-82c7-be195566aacb could not be found. Sep 23 05:11:09.751736 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:11:09.751736 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:11:09.751736 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:11:09.751736 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:11:09.751736 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:11:09.751736 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:11:09.751736 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:11:09.751736 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:11:09.751736 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:11:09.751736 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:11:09.751736 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 05:11:09.751736 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 05:11:09.751736 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 05:11:09.751736 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 05:11:09.751736 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 05:11:09.751736 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:11:09.751736 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ad3508b-1d37-4c7b-82c7-be195566aacb could not be found. Sep 23 05:11:09.751736 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:11:09.751736 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:11:09.751736 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:11:09.756164 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:11:09.756164 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:11:09.756164 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:11:09.756164 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:11:09.756164 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:11:09.756164 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ad3508b-1d37-4c7b-82c7-be195566aacb could not be found. Sep 23 05:11:09.756164 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:11:09.756164 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d850620e-59e2-4cb2-b8b2-846b65661937 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Returning 404 to user: Instance 7ad3508b-1d37-4c7b-82c7-be195566aacb could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:11:09.756164 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d850620e-59e2-4cb2-b8b2-846b65661937 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb" status: 404 len: 111 microversion: 2.1 time: 0.056616 Sep 23 05:11:09.756164 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3469/6757] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:11:09 2022] GET /compute/v2.1/servers/7ad3508b-1d37-4c7b-82c7-be195566aacb => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 05:11:10.981605 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-23c9db81-f94f-4f8e-959e-538959043c5a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:11:10.982178 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-23c9db81-f94f-4f8e-959e-538959043c5a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 362777d0-bfa6-4058-8875-e4c28c85f576] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:11:10.990718 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-23c9db81-f94f-4f8e-959e-538959043c5a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:11:10.991243 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-23c9db81-f94f-4f8e-959e-538959043c5a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:11:10.991739 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-23c9db81-f94f-4f8e-959e-538959043c5a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:11:10.992521 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-23c9db81-f94f-4f8e-959e-538959043c5a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:11:10.993046 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-23c9db81-f94f-4f8e-959e-538959043c5a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:11:10.993501 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-23c9db81-f94f-4f8e-959e-538959043c5a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:11:11.011342 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-23c9db81-f94f-4f8e-959e-538959043c5a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] HTTP exception thrown: Instance 362777d0-bfa6-4058-8875-e4c28c85f576 could not be found. Sep 23 05:11:11.013180 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-23c9db81-f94f-4f8e-959e-538959043c5a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Request method failure captured: Sep 23 05:11:11.013180 n-d-846463-3 devstack@n-api.service[122698]: request: DELETE /compute/v2.1/servers/362777d0-bfa6-4058-8875-e4c28c85f576 HTTP/1.1 Sep 23 05:11:11.013180 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 05:11:11.013180 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 05:11:11.013180 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 05:11:11.013180 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 05:11:11.013180 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 05:11:11.013180 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 05:11:11.013180 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 05:11:11.013180 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 05:11:11.013180 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLT3uLjiu4nPUFbkjrA4MyWVqiSG18wQr6d8tQl_P_I7oXAw8rp2FE6LolJR7q-NpMkbDL2xBtL-Km4xLll-czE6HybNQXkbhp5AdNp7lc8uSbgBeOP-qACziHhtaYPCszQMgYlHiKqFljv5hFyHB9WCa7Y2j2z8m1qKy7sQfYfHm2rE Sep 23 05:11:11.013180 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 05:11:11.013180 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 05:11:11.013180 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 05:11:11.013180 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 05:11:11.013180 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 05:11:11.013180 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 05:11:11.013180 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: cceaa1e24146497fbf3f79cebc112211 Sep 23 05:11:11.013180 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-TestVolumeBootPattern-1815855430 Sep 23 05:11:11.013180 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 05:11:11.013180 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 05:11:11.013180 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cceaa1e24146497fbf3f79cebc112211", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cceaa1e24146497fbf3f79cebc112211"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cceaa1e24146497fbf3f79cebc112211"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cceaa1e24146497fbf3f79cebc112211"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:11:11.013180 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-TestVolumeBootPattern-1815855430 Sep 23 05:11:11.013180 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: cceaa1e24146497fbf3f79cebc112211 Sep 23 05:11:11.013180 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-TestVolumeBootPattern-1815855430 Sep 23 05:11:11.013180 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-TestVolumeBootPattern-1815855430-project Sep 23 05:11:11.013180 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 05:11:11.013180 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 05:11:11.013180 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 0d55fe5072c14752846eb4ffc0eef91b Sep 23 05:11:11.013180 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-TestVolumeBootPattern-1815855430-project Sep 23 05:11:11.013180 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 05:11:11.013180 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 362777d0-bfa6-4058-8875-e4c28c85f576 could not be found. Sep 23 05:11:11.013180 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '362777d0-bfa6-4058-8875-e4c28c85f576'} Sep 23 05:11:11.013180 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:11:11.013180 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:11:11.013180 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 05:11:11.013180 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 05:11:11.013180 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 05:11:11.013180 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 05:11:11.013180 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 05:11:11.013180 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 05:11:11.013180 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 05:11:11.013180 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 05:11:11.013180 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 362777d0-bfa6-4058-8875-e4c28c85f576 could not be found. Sep 23 05:11:11.013180 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:11:11.013180 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:11:11.013180 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:11:11.013180 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:11:11.013180 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:11:11.013180 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:11:11.013180 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:11:11.013180 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:11:11.013180 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:11:11.013180 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:11:11.013180 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 05:11:11.013180 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 05:11:11.013180 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 05:11:11.013180 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 05:11:11.013180 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 05:11:11.013180 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 05:11:11.013180 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 05:11:11.013180 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:11:11.018218 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 362777d0-bfa6-4058-8875-e4c28c85f576 could not be found. Sep 23 05:11:11.018218 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:11:11.018218 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:11:11.018218 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:11:11.018218 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:11:11.018218 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:11:11.018218 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:11:11.018218 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:11:11.018218 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:11:11.018218 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 362777d0-bfa6-4058-8875-e4c28c85f576 could not be found. Sep 23 05:11:11.018218 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:11:11.020408 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-23c9db81-f94f-4f8e-959e-538959043c5a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Returning 404 to user: Instance 362777d0-bfa6-4058-8875-e4c28c85f576 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:11:11.021479 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-23c9db81-f94f-4f8e-959e-538959043c5a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "DELETE /compute/v2.1/servers/362777d0-bfa6-4058-8875-e4c28c85f576" status: 404 len: 111 microversion: 2.1 time: 0.045210 Sep 23 05:11:11.022251 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3289/6758] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 05:11:10 2022] DELETE /compute/v2.1/servers/362777d0-bfa6-4058-8875-e4c28c85f576 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 05:11:11.039137 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1da7a9b5-fc30-4e62-a2b3-9b9e2b22cf8c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:11:11.039955 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1da7a9b5-fc30-4e62-a2b3-9b9e2b22cf8c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 362777d0-bfa6-4058-8875-e4c28c85f576] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:11:11.049528 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1da7a9b5-fc30-4e62-a2b3-9b9e2b22cf8c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:11:11.049982 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1da7a9b5-fc30-4e62-a2b3-9b9e2b22cf8c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:11:11.050478 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1da7a9b5-fc30-4e62-a2b3-9b9e2b22cf8c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:11:11.051316 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1da7a9b5-fc30-4e62-a2b3-9b9e2b22cf8c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:11:11.051866 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1da7a9b5-fc30-4e62-a2b3-9b9e2b22cf8c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:11:11.052301 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1da7a9b5-fc30-4e62-a2b3-9b9e2b22cf8c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:11:11.055192 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=75 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:11:11.068905 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-1da7a9b5-fc30-4e62-a2b3-9b9e2b22cf8c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] HTTP exception thrown: Instance 362777d0-bfa6-4058-8875-e4c28c85f576 could not be found. Sep 23 05:11:11.073283 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1da7a9b5-fc30-4e62-a2b3-9b9e2b22cf8c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Request method failure captured: Sep 23 05:11:11.073283 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/362777d0-bfa6-4058-8875-e4c28c85f576 HTTP/1.1 Sep 23 05:11:11.073283 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 05:11:11.073283 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 05:11:11.073283 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 05:11:11.073283 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 05:11:11.073283 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 05:11:11.073283 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 05:11:11.073283 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 05:11:11.073283 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 05:11:11.073283 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLT3uLjiu4nPUFbkjrA4MyWVqiSG18wQr6d8tQl_P_I7oXAw8rp2FE6LolJR7q-NpMkbDL2xBtL-Km4xLll-czE6HybNQXkbhp5AdNp7lc8uSbgBeOP-qACziHhtaYPCszQMgYlHiKqFljv5hFyHB9WCa7Y2j2z8m1qKy7sQfYfHm2rE Sep 23 05:11:11.073283 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 05:11:11.073283 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 05:11:11.073283 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 05:11:11.073283 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 05:11:11.073283 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 05:11:11.073283 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 05:11:11.073283 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: cceaa1e24146497fbf3f79cebc112211 Sep 23 05:11:11.073283 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-TestVolumeBootPattern-1815855430 Sep 23 05:11:11.073283 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 05:11:11.073283 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 05:11:11.073283 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cceaa1e24146497fbf3f79cebc112211", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cceaa1e24146497fbf3f79cebc112211"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cceaa1e24146497fbf3f79cebc112211"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cceaa1e24146497fbf3f79cebc112211"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:11:11.073283 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-TestVolumeBootPattern-1815855430 Sep 23 05:11:11.073283 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: cceaa1e24146497fbf3f79cebc112211 Sep 23 05:11:11.073283 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-TestVolumeBootPattern-1815855430 Sep 23 05:11:11.073283 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-TestVolumeBootPattern-1815855430-project Sep 23 05:11:11.073283 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 05:11:11.073283 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 05:11:11.073283 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 0d55fe5072c14752846eb4ffc0eef91b Sep 23 05:11:11.073283 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-TestVolumeBootPattern-1815855430-project Sep 23 05:11:11.073283 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 05:11:11.073283 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 362777d0-bfa6-4058-8875-e4c28c85f576 could not be found. Sep 23 05:11:11.073283 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '362777d0-bfa6-4058-8875-e4c28c85f576'} Sep 23 05:11:11.073283 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:11:11.073283 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:11:11.073283 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 05:11:11.073283 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 05:11:11.073283 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 05:11:11.073283 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 05:11:11.073283 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 05:11:11.073283 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 05:11:11.073283 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 05:11:11.073283 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 05:11:11.073283 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 362777d0-bfa6-4058-8875-e4c28c85f576 could not be found. Sep 23 05:11:11.073283 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:11:11.073283 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:11:11.073283 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:11:11.073283 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:11:11.073283 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:11:11.073283 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:11:11.073283 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:11:11.073283 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:11:11.073283 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:11:11.073283 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:11:11.073283 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 05:11:11.073283 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 05:11:11.073283 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 05:11:11.073283 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 05:11:11.073283 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 05:11:11.073283 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:11:11.073283 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 362777d0-bfa6-4058-8875-e4c28c85f576 could not be found. Sep 23 05:11:11.073283 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:11:11.073283 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:11:11.073283 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:11:11.077371 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:11:11.077371 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:11:11.077371 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:11:11.077371 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:11:11.077371 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:11:11.077371 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 362777d0-bfa6-4058-8875-e4c28c85f576 could not be found. Sep 23 05:11:11.077371 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:11:11.077371 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1da7a9b5-fc30-4e62-a2b3-9b9e2b22cf8c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Returning 404 to user: Instance 362777d0-bfa6-4058-8875-e4c28c85f576 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:11:11.077371 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1da7a9b5-fc30-4e62-a2b3-9b9e2b22cf8c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/362777d0-bfa6-4058-8875-e4c28c85f576" status: 404 len: 111 microversion: 2.1 time: 0.044900 Sep 23 05:11:11.077371 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3470/6759] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:11:11 2022] GET /compute/v2.1/servers/362777d0-bfa6-4058-8875-e4c28c85f576 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 05:11:11.186784 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-cf1a18ff-adf5-493f-ba09-1b55b256d81e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Action: 'create', calling method: .version_select at 0x7ff1bbd584c0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-63253902", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKytLv/YJoXRMC9t6EU8ZSJ4PMd304qaS5w+LthMa5FWX7tkN/DPXwUVq+Fcv1r520I6/Ph2GlLvCAGE+oKNzzsfGvfDVBk3VFuTWG31E6GmNERZTVfJdE4WRtyPLAM9aA=="}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:11:11.216756 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-cf1a18ff-adf5-493f-ba09-1b55b256d81e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Getting quotas for project cceaa1e24146497fbf3f79cebc112211. Resources: {'key_pairs'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 05:11:11.231525 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-cf1a18ff-adf5-493f-ba09-1b55b256d81e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Getting quotas for user 0d55fe5072c14752846eb4ffc0eef91b and project cceaa1e24146497fbf3f79cebc112211. Resources: {'key_pairs'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 05:11:11.455407 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-cf1a18ff-adf5-493f-ba09-1b55b256d81e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.275879 Sep 23 05:11:11.456163 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3290/6760] 10.222.0.33 () {60 vars in 1159 bytes} [Fri Sep 23 05:11:11 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:11:48.044132 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2d7e032d-6de0-44fc-a7ef-883790afa8ba tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-753807667", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-63253902", "security_groups": [{"name": "tempest-secgroup-smoke-427164122"}], "block_device_mapping_v2": [{"uuid": "7f8703c2-6e49-418e-870f-0902dcea3a06", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4600129e-ae78-4842-a9e8-005f0a31ee9b"}]}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:11:48.067006 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=21 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:11:48.187289 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.neutron [None req-2d7e032d-6de0-44fc-a7ef-883790afa8ba tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] validate_networks() for [('4600129e-ae78-4842-a9e8-005f0a31ee9b', None, None, None, None, None)] {{(pid=122699) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 05:11:49.007660 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-2d7e032d-6de0-44fc-a7ef-883790afa8ba tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Flavor limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 05:11:49.008469 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-2d7e032d-6de0-44fc-a7ef-883790afa8ba tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Image limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 05:11:49.009358 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-2d7e032d-6de0-44fc-a7ef-883790afa8ba tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Flavor pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 05:11:49.010625 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-2d7e032d-6de0-44fc-a7ef-883790afa8ba tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Image pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 05:11:49.011454 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-2d7e032d-6de0-44fc-a7ef-883790afa8ba tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 05:11:49.022218 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2d7e032d-6de0-44fc-a7ef-883790afa8ba tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:11:49.022801 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2d7e032d-6de0-44fc-a7ef-883790afa8ba tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:11:49.023284 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2d7e032d-6de0-44fc-a7ef-883790afa8ba tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:11:49.024003 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2d7e032d-6de0-44fc-a7ef-883790afa8ba tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:11:49.024466 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2d7e032d-6de0-44fc-a7ef-883790afa8ba tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:11:49.024901 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2d7e032d-6de0-44fc-a7ef-883790afa8ba tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:11:49.044594 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-2d7e032d-6de0-44fc-a7ef-883790afa8ba tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Getting quotas for project cceaa1e24146497fbf3f79cebc112211. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 05:11:49.051676 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-2d7e032d-6de0-44fc-a7ef-883790afa8ba tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Getting quotas for user 0d55fe5072c14752846eb4ffc0eef91b and project cceaa1e24146497fbf3f79cebc112211. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 05:11:49.121638 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-2d7e032d-6de0-44fc-a7ef-883790afa8ba tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Going to run 1 instances... {{(pid=122699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 05:11:49.123850 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-2d7e032d-6de0-44fc-a7ef-883790afa8ba tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: d51a5b7d-90cb-4bd7-a258-22fd5a0df673] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7f8703c2-6e49-418e-870f-0902dcea3a06',volume_size=None,volume_type=None)] {{(pid=122699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 05:11:49.609413 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2d7e032d-6de0-44fc-a7ef-883790afa8ba tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.569765 Sep 23 05:11:49.610775 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3471/6761] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 05:11:48 2022] POST /compute/v2.1/servers => generated 405 bytes in 1572 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 05:11:49.620927 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=34,nova_cell1:INSERT=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:11:49.621733 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=4 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:11:49.622472 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:11:49.626680 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7588fa27-8135-490c-91c0-640535507c71 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:11:49.628249 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7588fa27-8135-490c-91c0-640535507c71 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: d51a5b7d-90cb-4bd7-a258-22fd5a0df673] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:11:49.738173 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-7588fa27-8135-490c-91c0-640535507c71 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:11:49.745162 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7588fa27-8135-490c-91c0-640535507c71 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/d51a5b7d-90cb-4bd7-a258-22fd5a0df673" status: 200 len: 1092 microversion: 2.1 time: 0.126268 Sep 23 05:11:49.759040 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3291/6762] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:11:49 2022] GET /compute/v2.1/servers/d51a5b7d-90cb-4bd7-a258-22fd5a0df673 => generated 1092 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:11:50.768884 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6818eaef-f8ab-4b6e-8131-b046cbbabe71 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:11:50.769573 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-6818eaef-f8ab-4b6e-8131-b046cbbabe71 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: d51a5b7d-90cb-4bd7-a258-22fd5a0df673] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:11:50.777660 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6818eaef-f8ab-4b6e-8131-b046cbbabe71 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:11:50.778188 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6818eaef-f8ab-4b6e-8131-b046cbbabe71 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:11:50.778636 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6818eaef-f8ab-4b6e-8131-b046cbbabe71 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:11:50.779406 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6818eaef-f8ab-4b6e-8131-b046cbbabe71 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:11:50.779850 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6818eaef-f8ab-4b6e-8131-b046cbbabe71 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:11:50.780311 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6818eaef-f8ab-4b6e-8131-b046cbbabe71 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:11:51.147499 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-6818eaef-f8ab-4b6e-8131-b046cbbabe71 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:11:51.156922 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6818eaef-f8ab-4b6e-8131-b046cbbabe71 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/d51a5b7d-90cb-4bd7-a258-22fd5a0df673" status: 200 len: 1142 microversion: 2.1 time: 0.392079 Sep 23 05:11:51.157637 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3472/6763] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:11:50 2022] GET /compute/v2.1/servers/d51a5b7d-90cb-4bd7-a258-22fd5a0df673 => generated 1142 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:11:52.182255 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2549d77d-b986-4118-ac50-3b673226fb2e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:11:52.183623 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-2549d77d-b986-4118-ac50-3b673226fb2e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: d51a5b7d-90cb-4bd7-a258-22fd5a0df673] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:11:52.192298 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2549d77d-b986-4118-ac50-3b673226fb2e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:11:52.192974 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2549d77d-b986-4118-ac50-3b673226fb2e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:11:52.193470 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2549d77d-b986-4118-ac50-3b673226fb2e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:11:52.194326 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2549d77d-b986-4118-ac50-3b673226fb2e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:11:52.194797 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2549d77d-b986-4118-ac50-3b673226fb2e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:11:52.195238 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2549d77d-b986-4118-ac50-3b673226fb2e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:11:52.266451 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-2549d77d-b986-4118-ac50-3b673226fb2e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:11:52.274859 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2549d77d-b986-4118-ac50-3b673226fb2e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/d51a5b7d-90cb-4bd7-a258-22fd5a0df673" status: 200 len: 1198 microversion: 2.1 time: 0.097300 Sep 23 05:11:52.275784 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3292/6764] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:11:52 2022] GET /compute/v2.1/servers/d51a5b7d-90cb-4bd7-a258-22fd5a0df673 => generated 1198 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:11:53.307177 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c3b62f65-0784-430a-91ca-3d114bf674f6 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:11:53.307940 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c3b62f65-0784-430a-91ca-3d114bf674f6 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: d51a5b7d-90cb-4bd7-a258-22fd5a0df673] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:11:53.316160 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c3b62f65-0784-430a-91ca-3d114bf674f6 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:11:53.331489 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c3b62f65-0784-430a-91ca-3d114bf674f6 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:11:53.336664 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c3b62f65-0784-430a-91ca-3d114bf674f6 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:11:53.339272 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c3b62f65-0784-430a-91ca-3d114bf674f6 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:11:53.339851 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c3b62f65-0784-430a-91ca-3d114bf674f6 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:11:53.342162 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c3b62f65-0784-430a-91ca-3d114bf674f6 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:11:53.573879 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c3b62f65-0784-430a-91ca-3d114bf674f6 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:11:53.586440 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c3b62f65-0784-430a-91ca-3d114bf674f6 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/d51a5b7d-90cb-4bd7-a258-22fd5a0df673" status: 200 len: 1275 microversion: 2.1 time: 0.283572 Sep 23 05:11:53.607630 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3473/6765] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:11:53 2022] GET /compute/v2.1/servers/d51a5b7d-90cb-4bd7-a258-22fd5a0df673 => generated 1275 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:11:54.548878 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-6a7e6f51-d10a-4251-90e0-d297d2f4d63a req-d35ad931-8f38-4245-951e-1ff058892e09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d51a5b7d-90cb-4bd7-a258-22fd5a0df673", "tag": "a4f83f8e-f207-4a15-b4f5-55906228e2e5"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:11:54.561364 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-6a7e6f51-d10a-4251-90e0-d297d2f4d63a req-d35ad931-8f38-4245-951e-1ff058892e09 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:11:54.579625 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-6a7e6f51-d10a-4251-90e0-d297d2f4d63a req-d35ad931-8f38-4245-951e-1ff058892e09 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:11:54.581191 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-6a7e6f51-d10a-4251-90e0-d297d2f4d63a req-d35ad931-8f38-4245-951e-1ff058892e09 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:11:54.593906 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-6a7e6f51-d10a-4251-90e0-d297d2f4d63a req-d35ad931-8f38-4245-951e-1ff058892e09 service nova] Creating event network-changed:a4f83f8e-f207-4a15-b4f5-55906228e2e5 for instance d51a5b7d-90cb-4bd7-a258-22fd5a0df673 on n-h2-846463-3 Sep 23 05:11:54.600607 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-6a7e6f51-d10a-4251-90e0-d297d2f4d63a req-d35ad931-8f38-4245-951e-1ff058892e09 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055762 Sep 23 05:11:54.602913 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3293/6766] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:11:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:11:54.613367 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-bfb55636-3d36-4f83-9504-a3b45ba3f3d8 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:11:54.614119 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-bfb55636-3d36-4f83-9504-a3b45ba3f3d8 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: d51a5b7d-90cb-4bd7-a258-22fd5a0df673] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:11:54.621429 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bfb55636-3d36-4f83-9504-a3b45ba3f3d8 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:11:54.622099 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bfb55636-3d36-4f83-9504-a3b45ba3f3d8 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:11:54.622543 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bfb55636-3d36-4f83-9504-a3b45ba3f3d8 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:11:54.623302 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bfb55636-3d36-4f83-9504-a3b45ba3f3d8 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:11:54.623820 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bfb55636-3d36-4f83-9504-a3b45ba3f3d8 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:11:54.624254 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bfb55636-3d36-4f83-9504-a3b45ba3f3d8 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:11:54.801009 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-bfb55636-3d36-4f83-9504-a3b45ba3f3d8 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:11:54.811362 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-bfb55636-3d36-4f83-9504-a3b45ba3f3d8 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/d51a5b7d-90cb-4bd7-a258-22fd5a0df673" status: 200 len: 1275 microversion: 2.1 time: 0.202103 Sep 23 05:11:54.831854 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3474/6767] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:11:54 2022] GET /compute/v2.1/servers/d51a5b7d-90cb-4bd7-a258-22fd5a0df673 => generated 1275 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:11:55.842456 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a2059780-3840-4a2a-8355-4b182655f374 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:11:55.843922 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a2059780-3840-4a2a-8355-4b182655f374 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: d51a5b7d-90cb-4bd7-a258-22fd5a0df673] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:11:55.859508 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a2059780-3840-4a2a-8355-4b182655f374 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:11:55.860301 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a2059780-3840-4a2a-8355-4b182655f374 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:11:55.860764 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a2059780-3840-4a2a-8355-4b182655f374 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:11:55.861535 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a2059780-3840-4a2a-8355-4b182655f374 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:11:55.862592 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a2059780-3840-4a2a-8355-4b182655f374 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:11:55.863040 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a2059780-3840-4a2a-8355-4b182655f374 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:11:56.175109 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a2059780-3840-4a2a-8355-4b182655f374 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:11:56.184033 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a2059780-3840-4a2a-8355-4b182655f374 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/d51a5b7d-90cb-4bd7-a258-22fd5a0df673" status: 200 len: 1275 microversion: 2.1 time: 0.351081 Sep 23 05:11:56.184674 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3294/6768] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:11:55 2022] GET /compute/v2.1/servers/d51a5b7d-90cb-4bd7-a258-22fd5a0df673 => generated 1275 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:11:57.211980 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0fa0a921-6fb9-406f-9664-10b225ab52c2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:11:57.212696 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-0fa0a921-6fb9-406f-9664-10b225ab52c2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: d51a5b7d-90cb-4bd7-a258-22fd5a0df673] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:11:57.220493 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0fa0a921-6fb9-406f-9664-10b225ab52c2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:11:57.221739 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0fa0a921-6fb9-406f-9664-10b225ab52c2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:11:57.222373 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0fa0a921-6fb9-406f-9664-10b225ab52c2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:11:57.223588 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0fa0a921-6fb9-406f-9664-10b225ab52c2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:11:57.229770 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0fa0a921-6fb9-406f-9664-10b225ab52c2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:11:57.236396 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0fa0a921-6fb9-406f-9664-10b225ab52c2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:11:57.402182 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-0fa0a921-6fb9-406f-9664-10b225ab52c2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:11:57.420175 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0fa0a921-6fb9-406f-9664-10b225ab52c2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/d51a5b7d-90cb-4bd7-a258-22fd5a0df673" status: 200 len: 1275 microversion: 2.1 time: 0.213591 Sep 23 05:11:57.441040 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3475/6769] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:11:57 2022] GET /compute/v2.1/servers/d51a5b7d-90cb-4bd7-a258-22fd5a0df673 => generated 1275 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:11:58.445556 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6c569da5-cd72-450b-a4a1-ca232a731e70 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:11:58.446470 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-6c569da5-cd72-450b-a4a1-ca232a731e70 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: d51a5b7d-90cb-4bd7-a258-22fd5a0df673] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:11:58.453282 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6c569da5-cd72-450b-a4a1-ca232a731e70 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:11:58.453784 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6c569da5-cd72-450b-a4a1-ca232a731e70 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:11:58.454271 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6c569da5-cd72-450b-a4a1-ca232a731e70 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:11:58.454983 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6c569da5-cd72-450b-a4a1-ca232a731e70 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:11:58.456037 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6c569da5-cd72-450b-a4a1-ca232a731e70 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:11:58.460867 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6c569da5-cd72-450b-a4a1-ca232a731e70 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:11:58.613720 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6c569da5-cd72-450b-a4a1-ca232a731e70 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:11:58.622131 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-6c569da5-cd72-450b-a4a1-ca232a731e70 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/d51a5b7d-90cb-4bd7-a258-22fd5a0df673" status: 200 len: 1275 microversion: 2.1 time: 0.180926 Sep 23 05:11:58.623452 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3295/6770] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:11:58 2022] GET /compute/v2.1/servers/d51a5b7d-90cb-4bd7-a258-22fd5a0df673 => generated 1275 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:11:59.647395 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f3b38f0f-a6b3-4e6f-91b1-43eb0a8e5e49 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:11:59.648116 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f3b38f0f-a6b3-4e6f-91b1-43eb0a8e5e49 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: d51a5b7d-90cb-4bd7-a258-22fd5a0df673] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:11:59.654578 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:11:59.655595 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=6 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:11:59.657601 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f3b38f0f-a6b3-4e6f-91b1-43eb0a8e5e49 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:11:59.658193 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f3b38f0f-a6b3-4e6f-91b1-43eb0a8e5e49 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:11:59.661827 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f3b38f0f-a6b3-4e6f-91b1-43eb0a8e5e49 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:11:59.661827 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f3b38f0f-a6b3-4e6f-91b1-43eb0a8e5e49 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:11:59.661827 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f3b38f0f-a6b3-4e6f-91b1-43eb0a8e5e49 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:11:59.661827 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f3b38f0f-a6b3-4e6f-91b1-43eb0a8e5e49 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:11:59.808268 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f3b38f0f-a6b3-4e6f-91b1-43eb0a8e5e49 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:11:59.817387 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f3b38f0f-a6b3-4e6f-91b1-43eb0a8e5e49 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/d51a5b7d-90cb-4bd7-a258-22fd5a0df673" status: 200 len: 1263 microversion: 2.1 time: 0.175565 Sep 23 05:11:59.818095 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3476/6771] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:11:59 2022] GET /compute/v2.1/servers/d51a5b7d-90cb-4bd7-a258-22fd5a0df673 => generated 1263 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:12:00.845549 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3877e5bd-c51d-4fba-a817-b515f5bf2f29 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:12:00.847031 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3877e5bd-c51d-4fba-a817-b515f5bf2f29 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: d51a5b7d-90cb-4bd7-a258-22fd5a0df673] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:12:00.850491 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:12:00.857000 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3877e5bd-c51d-4fba-a817-b515f5bf2f29 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:12:00.858022 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3877e5bd-c51d-4fba-a817-b515f5bf2f29 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:12:00.858489 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3877e5bd-c51d-4fba-a817-b515f5bf2f29 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:12:00.859442 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3877e5bd-c51d-4fba-a817-b515f5bf2f29 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:12:00.859889 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3877e5bd-c51d-4fba-a817-b515f5bf2f29 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:12:00.860348 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3877e5bd-c51d-4fba-a817-b515f5bf2f29 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:12:01.029531 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-3877e5bd-c51d-4fba-a817-b515f5bf2f29 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:12:01.037701 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3877e5bd-c51d-4fba-a817-b515f5bf2f29 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/d51a5b7d-90cb-4bd7-a258-22fd5a0df673" status: 200 len: 1263 microversion: 2.1 time: 0.196730 Sep 23 05:12:01.038454 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3296/6772] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:12:00 2022] GET /compute/v2.1/servers/d51a5b7d-90cb-4bd7-a258-22fd5a0df673 => generated 1263 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:12:02.061506 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b7047887-b2d5-4d10-b839-f37ccba386f1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:12:02.062079 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b7047887-b2d5-4d10-b839-f37ccba386f1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: d51a5b7d-90cb-4bd7-a258-22fd5a0df673] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:12:02.070549 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b7047887-b2d5-4d10-b839-f37ccba386f1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:12:02.071053 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b7047887-b2d5-4d10-b839-f37ccba386f1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:12:02.071525 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b7047887-b2d5-4d10-b839-f37ccba386f1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:12:02.072404 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b7047887-b2d5-4d10-b839-f37ccba386f1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:12:02.073169 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b7047887-b2d5-4d10-b839-f37ccba386f1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:12:02.073626 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b7047887-b2d5-4d10-b839-f37ccba386f1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:12:02.230991 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b7047887-b2d5-4d10-b839-f37ccba386f1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:12:02.252713 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b7047887-b2d5-4d10-b839-f37ccba386f1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/d51a5b7d-90cb-4bd7-a258-22fd5a0df673" status: 200 len: 1263 microversion: 2.1 time: 0.195409 Sep 23 05:12:02.253324 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3477/6773] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:12:02 2022] GET /compute/v2.1/servers/d51a5b7d-90cb-4bd7-a258-22fd5a0df673 => generated 1263 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:12:03.277071 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e6584d65-53ba-4853-8606-61a249f782d5 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:12:03.277643 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e6584d65-53ba-4853-8606-61a249f782d5 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: d51a5b7d-90cb-4bd7-a258-22fd5a0df673] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:12:03.285394 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e6584d65-53ba-4853-8606-61a249f782d5 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:12:03.285946 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e6584d65-53ba-4853-8606-61a249f782d5 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:12:03.286407 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e6584d65-53ba-4853-8606-61a249f782d5 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:12:03.287137 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e6584d65-53ba-4853-8606-61a249f782d5 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:12:03.287608 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e6584d65-53ba-4853-8606-61a249f782d5 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:12:03.288048 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e6584d65-53ba-4853-8606-61a249f782d5 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:12:03.700986 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e6584d65-53ba-4853-8606-61a249f782d5 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:12:03.718999 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e6584d65-53ba-4853-8606-61a249f782d5 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/d51a5b7d-90cb-4bd7-a258-22fd5a0df673" status: 200 len: 1263 microversion: 2.1 time: 0.446042 Sep 23 05:12:03.719595 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3297/6774] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:12:03 2022] GET /compute/v2.1/servers/d51a5b7d-90cb-4bd7-a258-22fd5a0df673 => generated 1263 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:12:04.743175 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e3fb3e07-8fa0-4588-b06e-c1e93d9e6a7e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:12:04.745036 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e3fb3e07-8fa0-4588-b06e-c1e93d9e6a7e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: d51a5b7d-90cb-4bd7-a258-22fd5a0df673] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:12:04.754378 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e3fb3e07-8fa0-4588-b06e-c1e93d9e6a7e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:12:04.755150 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e3fb3e07-8fa0-4588-b06e-c1e93d9e6a7e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:12:04.756168 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e3fb3e07-8fa0-4588-b06e-c1e93d9e6a7e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:12:04.757015 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e3fb3e07-8fa0-4588-b06e-c1e93d9e6a7e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:12:04.757903 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e3fb3e07-8fa0-4588-b06e-c1e93d9e6a7e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:12:04.758718 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e3fb3e07-8fa0-4588-b06e-c1e93d9e6a7e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:12:04.995741 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e3fb3e07-8fa0-4588-b06e-c1e93d9e6a7e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:12:05.004880 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e3fb3e07-8fa0-4588-b06e-c1e93d9e6a7e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/d51a5b7d-90cb-4bd7-a258-22fd5a0df673" status: 200 len: 1263 microversion: 2.1 time: 0.266265 Sep 23 05:12:05.005679 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3478/6775] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:12:04 2022] GET /compute/v2.1/servers/d51a5b7d-90cb-4bd7-a258-22fd5a0df673 => generated 1263 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:12:06.029635 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-99ac3ef5-01af-46dc-aec3-016c9b68efc7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:12:06.031196 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-99ac3ef5-01af-46dc-aec3-016c9b68efc7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: d51a5b7d-90cb-4bd7-a258-22fd5a0df673] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:12:06.047519 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-99ac3ef5-01af-46dc-aec3-016c9b68efc7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:12:06.053621 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-99ac3ef5-01af-46dc-aec3-016c9b68efc7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:12:06.054494 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-99ac3ef5-01af-46dc-aec3-016c9b68efc7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:12:06.057440 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-99ac3ef5-01af-46dc-aec3-016c9b68efc7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:12:06.059916 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-99ac3ef5-01af-46dc-aec3-016c9b68efc7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:12:06.063755 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-99ac3ef5-01af-46dc-aec3-016c9b68efc7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:12:06.744717 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-99ac3ef5-01af-46dc-aec3-016c9b68efc7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:12:06.758753 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-99ac3ef5-01af-46dc-aec3-016c9b68efc7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/d51a5b7d-90cb-4bd7-a258-22fd5a0df673" status: 200 len: 1263 microversion: 2.1 time: 0.733779 Sep 23 05:12:06.770462 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3298/6776] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:12:06 2022] GET /compute/v2.1/servers/d51a5b7d-90cb-4bd7-a258-22fd5a0df673 => generated 1263 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:12:07.000499 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4524abed-3567-4006-a94d-fe613843c62a tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:12:07.001131 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4524abed-3567-4006-a94d-fe613843c62a tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] [instance: 0d0f17c3-e777-4c71-a9df-b2de76f0615a] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:12:07.003528 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-bc015aae-fd20-4190-8da9-30a7a7b978fd req-ab625c36-f2ed-431c-aa24-775ec3172dbe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d0f17c3-e777-4c71-a9df-b2de76f0615a", "tag": "5ea5a3a5-1af1-43c1-8697-61d4b860eea6"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:12:07.014024 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4524abed-3567-4006-a94d-fe613843c62a tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:12:07.014924 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4524abed-3567-4006-a94d-fe613843c62a tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:12:07.017767 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-bc015aae-fd20-4190-8da9-30a7a7b978fd req-ab625c36-f2ed-431c-aa24-775ec3172dbe service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:12:07.019945 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4524abed-3567-4006-a94d-fe613843c62a tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:12:07.020792 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4524abed-3567-4006-a94d-fe613843c62a tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:12:07.022702 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-bc015aae-fd20-4190-8da9-30a7a7b978fd req-ab625c36-f2ed-431c-aa24-775ec3172dbe service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:12:07.023189 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-bc015aae-fd20-4190-8da9-30a7a7b978fd req-ab625c36-f2ed-431c-aa24-775ec3172dbe service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:12:07.023703 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4524abed-3567-4006-a94d-fe613843c62a tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:12:07.024318 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4524abed-3567-4006-a94d-fe613843c62a tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:12:07.041474 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-bc015aae-fd20-4190-8da9-30a7a7b978fd req-ab625c36-f2ed-431c-aa24-775ec3172dbe service nova] Creating event network-changed:5ea5a3a5-1af1-43c1-8697-61d4b860eea6 for instance 0d0f17c3-e777-4c71-a9df-b2de76f0615a on n-h1-846463-3 Sep 23 05:12:07.060830 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-bc015aae-fd20-4190-8da9-30a7a7b978fd req-ab625c36-f2ed-431c-aa24-775ec3172dbe service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061416 Sep 23 05:12:07.065446 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3299/6777] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:12:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:12:07.081574 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4524abed-3567-4006-a94d-fe613843c62a tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] [instance: 0d0f17c3-e777-4c71-a9df-b2de76f0615a] Going to try to terminate instance {{(pid=122699) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 05:12:07.470492 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4524abed-3567-4006-a94d-fe613843c62a tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] 10.222.0.33 "DELETE /compute/v2.1/servers/0d0f17c3-e777-4c71-a9df-b2de76f0615a" status: 204 len: 0 microversion: 2.1 time: 0.473719 Sep 23 05:12:07.471938 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3479/6778] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 05:12:06 2022] DELETE /compute/v2.1/servers/0d0f17c3-e777-4c71-a9df-b2de76f0615a => generated 0 bytes in 476 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 05:12:07.481042 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d8914f50-a769-4785-8b8a-43b40fd604a7 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:12:07.481777 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d8914f50-a769-4785-8b8a-43b40fd604a7 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] [instance: 0d0f17c3-e777-4c71-a9df-b2de76f0615a] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:12:07.499824 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d8914f50-a769-4785-8b8a-43b40fd604a7 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:12:07.500353 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d8914f50-a769-4785-8b8a-43b40fd604a7 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:12:07.500913 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d8914f50-a769-4785-8b8a-43b40fd604a7 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:12:07.504435 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d8914f50-a769-4785-8b8a-43b40fd604a7 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:12:07.506373 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d8914f50-a769-4785-8b8a-43b40fd604a7 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:12:07.508441 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d8914f50-a769-4785-8b8a-43b40fd604a7 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:12:07.776929 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d8914f50-a769-4785-8b8a-43b40fd604a7 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82736eb912544711991da4f27c321f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116ae3ab00e447f89c7e8210ba89be75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:12:07.789253 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ca14bdd7-708d-40ad-9057-e1d41d80ce11 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:12:07.790688 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ca14bdd7-708d-40ad-9057-e1d41d80ce11 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: d51a5b7d-90cb-4bd7-a258-22fd5a0df673] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:12:07.805210 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d8914f50-a769-4785-8b8a-43b40fd604a7 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] 10.222.0.33 "GET /compute/v2.1/servers/0d0f17c3-e777-4c71-a9df-b2de76f0615a" status: 200 len: 1582 microversion: 2.1 time: 0.328479 Sep 23 05:12:07.812594 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3300/6779] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:12:07 2022] GET /compute/v2.1/servers/0d0f17c3-e777-4c71-a9df-b2de76f0615a => generated 1582 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:12:07.813630 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ca14bdd7-708d-40ad-9057-e1d41d80ce11 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:12:07.814442 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ca14bdd7-708d-40ad-9057-e1d41d80ce11 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:12:07.815708 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ca14bdd7-708d-40ad-9057-e1d41d80ce11 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:12:07.816714 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ca14bdd7-708d-40ad-9057-e1d41d80ce11 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:12:07.817439 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ca14bdd7-708d-40ad-9057-e1d41d80ce11 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:12:07.818168 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ca14bdd7-708d-40ad-9057-e1d41d80ce11 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:12:07.982821 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ca14bdd7-708d-40ad-9057-e1d41d80ce11 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:12:07.991804 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ca14bdd7-708d-40ad-9057-e1d41d80ce11 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/d51a5b7d-90cb-4bd7-a258-22fd5a0df673" status: 200 len: 1263 microversion: 2.1 time: 0.212262 Sep 23 05:12:07.992389 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3480/6780] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:12:07 2022] GET /compute/v2.1/servers/d51a5b7d-90cb-4bd7-a258-22fd5a0df673 => generated 1263 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:12:08.317170 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-6ab01c9f-c0f9-4954-b587-95ba79123975 req-4d48b7f1-e87f-4a69-9467-615bde9cf1cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d51a5b7d-90cb-4bd7-a258-22fd5a0df673", "name": "network-vif-plugged", "status": "completed", "tag": "a4f83f8e-f207-4a15-b4f5-55906228e2e5"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:12:08.343690 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-6ab01c9f-c0f9-4954-b587-95ba79123975 req-4d48b7f1-e87f-4a69-9467-615bde9cf1cf service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:12:08.344190 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-6ab01c9f-c0f9-4954-b587-95ba79123975 req-4d48b7f1-e87f-4a69-9467-615bde9cf1cf service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:12:08.344646 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-6ab01c9f-c0f9-4954-b587-95ba79123975 req-4d48b7f1-e87f-4a69-9467-615bde9cf1cf service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:12:08.360250 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-6ab01c9f-c0f9-4954-b587-95ba79123975 req-4d48b7f1-e87f-4a69-9467-615bde9cf1cf service nova] Creating event network-vif-plugged:a4f83f8e-f207-4a15-b4f5-55906228e2e5 for instance d51a5b7d-90cb-4bd7-a258-22fd5a0df673 on n-h2-846463-3 Sep 23 05:12:08.365492 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-6ab01c9f-c0f9-4954-b587-95ba79123975 req-4d48b7f1-e87f-4a69-9467-615bde9cf1cf service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052264 Sep 23 05:12:08.366211 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3301/6781] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:12:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:12:08.841165 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-61de3d39-79e3-4f56-9a9f-98417806d513 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:12:08.842085 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-61de3d39-79e3-4f56-9a9f-98417806d513 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] [instance: 0d0f17c3-e777-4c71-a9df-b2de76f0615a] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:12:08.849745 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-61de3d39-79e3-4f56-9a9f-98417806d513 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:12:08.850296 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-61de3d39-79e3-4f56-9a9f-98417806d513 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:12:08.850742 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-61de3d39-79e3-4f56-9a9f-98417806d513 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:12:08.851460 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-61de3d39-79e3-4f56-9a9f-98417806d513 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:12:08.851951 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-61de3d39-79e3-4f56-9a9f-98417806d513 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:12:08.852419 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-61de3d39-79e3-4f56-9a9f-98417806d513 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:12:09.006084 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-61de3d39-79e3-4f56-9a9f-98417806d513 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82736eb912544711991da4f27c321f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116ae3ab00e447f89c7e8210ba89be75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:12:09.019935 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8e0f3bcd-1aa8-4e8a-9886-2b996cd1f360 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:12:09.021674 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8e0f3bcd-1aa8-4e8a-9886-2b996cd1f360 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: d51a5b7d-90cb-4bd7-a258-22fd5a0df673] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:12:09.027967 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-61de3d39-79e3-4f56-9a9f-98417806d513 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] 10.222.0.33 "GET /compute/v2.1/servers/0d0f17c3-e777-4c71-a9df-b2de76f0615a" status: 200 len: 1582 microversion: 2.1 time: 0.190465 Sep 23 05:12:09.028705 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8e0f3bcd-1aa8-4e8a-9886-2b996cd1f360 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:12:09.029226 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8e0f3bcd-1aa8-4e8a-9886-2b996cd1f360 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:12:09.030099 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8e0f3bcd-1aa8-4e8a-9886-2b996cd1f360 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:12:09.031035 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8e0f3bcd-1aa8-4e8a-9886-2b996cd1f360 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:12:09.031661 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8e0f3bcd-1aa8-4e8a-9886-2b996cd1f360 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:12:09.032252 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8e0f3bcd-1aa8-4e8a-9886-2b996cd1f360 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:12:09.041228 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3481/6782] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:12:08 2022] GET /compute/v2.1/servers/0d0f17c3-e777-4c71-a9df-b2de76f0615a => generated 1582 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:12:09.206424 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8e0f3bcd-1aa8-4e8a-9886-2b996cd1f360 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:12:09.215031 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8e0f3bcd-1aa8-4e8a-9886-2b996cd1f360 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/d51a5b7d-90cb-4bd7-a258-22fd5a0df673" status: 200 len: 1263 microversion: 2.1 time: 0.204555 Sep 23 05:12:09.220391 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3302/6783] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:12:09 2022] GET /compute/v2.1/servers/d51a5b7d-90cb-4bd7-a258-22fd5a0df673 => generated 1263 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:12:09.733320 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-2c817d6c-0d95-4ab8-b5fd-5713cc5878a3 req-194a6887-4ee5-472f-b69d-b7589975023d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d0f17c3-e777-4c71-a9df-b2de76f0615a", "name": "network-vif-deleted", "tag": "5ea5a3a5-1af1-43c1-8697-61d4b860eea6"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:12:09.743533 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-2c817d6c-0d95-4ab8-b5fd-5713cc5878a3 req-194a6887-4ee5-472f-b69d-b7589975023d service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:12:09.744015 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-2c817d6c-0d95-4ab8-b5fd-5713cc5878a3 req-194a6887-4ee5-472f-b69d-b7589975023d service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:12:09.744447 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-2c817d6c-0d95-4ab8-b5fd-5713cc5878a3 req-194a6887-4ee5-472f-b69d-b7589975023d service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:12:09.757993 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-2c817d6c-0d95-4ab8-b5fd-5713cc5878a3 req-194a6887-4ee5-472f-b69d-b7589975023d service nova] Creating event network-vif-deleted:5ea5a3a5-1af1-43c1-8697-61d4b860eea6 for instance 0d0f17c3-e777-4c71-a9df-b2de76f0615a on n-h1-846463-3 Sep 23 05:12:09.764470 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-2c817d6c-0d95-4ab8-b5fd-5713cc5878a3 req-194a6887-4ee5-472f-b69d-b7589975023d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034312 Sep 23 05:12:09.765438 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3482/6784] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:12:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:12:10.054042 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-fc4f30b7-ccf2-4458-8bec-efe2e2d22b3e tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:12:10.055285 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-fc4f30b7-ccf2-4458-8bec-efe2e2d22b3e tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] [instance: 0d0f17c3-e777-4c71-a9df-b2de76f0615a] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:12:10.062894 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fc4f30b7-ccf2-4458-8bec-efe2e2d22b3e tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:12:10.063864 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fc4f30b7-ccf2-4458-8bec-efe2e2d22b3e tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:12:10.064545 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fc4f30b7-ccf2-4458-8bec-efe2e2d22b3e tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:12:10.065272 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fc4f30b7-ccf2-4458-8bec-efe2e2d22b3e tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:12:10.065918 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fc4f30b7-ccf2-4458-8bec-efe2e2d22b3e tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:12:10.066521 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fc4f30b7-ccf2-4458-8bec-efe2e2d22b3e tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:12:10.155605 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-fc4f30b7-ccf2-4458-8bec-efe2e2d22b3e tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82736eb912544711991da4f27c321f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116ae3ab00e447f89c7e8210ba89be75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:12:10.170544 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-fc4f30b7-ccf2-4458-8bec-efe2e2d22b3e tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] 10.222.0.33 "GET /compute/v2.1/servers/0d0f17c3-e777-4c71-a9df-b2de76f0615a" status: 200 len: 1228 microversion: 2.1 time: 0.119001 Sep 23 05:12:10.188874 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3303/6785] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:12:10 2022] GET /compute/v2.1/servers/0d0f17c3-e777-4c71-a9df-b2de76f0615a => generated 1228 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:12:10.239797 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1b0f8c60-59be-4ff3-a0d0-dd8feac15f84 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:12:10.240618 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1b0f8c60-59be-4ff3-a0d0-dd8feac15f84 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: d51a5b7d-90cb-4bd7-a258-22fd5a0df673] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:12:10.256042 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1b0f8c60-59be-4ff3-a0d0-dd8feac15f84 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:12:10.257241 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1b0f8c60-59be-4ff3-a0d0-dd8feac15f84 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:12:10.261240 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1b0f8c60-59be-4ff3-a0d0-dd8feac15f84 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:12:10.262273 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1b0f8c60-59be-4ff3-a0d0-dd8feac15f84 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:12:10.262960 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1b0f8c60-59be-4ff3-a0d0-dd8feac15f84 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:12:10.263556 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1b0f8c60-59be-4ff3-a0d0-dd8feac15f84 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:12:10.503486 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1b0f8c60-59be-4ff3-a0d0-dd8feac15f84 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:12:10.516973 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1b0f8c60-59be-4ff3-a0d0-dd8feac15f84 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/d51a5b7d-90cb-4bd7-a258-22fd5a0df673" status: 200 len: 1451 microversion: 2.1 time: 0.278910 Sep 23 05:12:10.518682 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3483/6786] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:12:10 2022] GET /compute/v2.1/servers/d51a5b7d-90cb-4bd7-a258-22fd5a0df673 => generated 1451 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:12:10.549270 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-52f6f0a1-7a59-4a32-97dd-41b944bd77ea tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:12:10.549933 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-52f6f0a1-7a59-4a32-97dd-41b944bd77ea tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: d51a5b7d-90cb-4bd7-a258-22fd5a0df673] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:12:10.565574 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-52f6f0a1-7a59-4a32-97dd-41b944bd77ea tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:12:10.566580 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-52f6f0a1-7a59-4a32-97dd-41b944bd77ea tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:12:10.567251 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-52f6f0a1-7a59-4a32-97dd-41b944bd77ea tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:12:10.568230 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-52f6f0a1-7a59-4a32-97dd-41b944bd77ea tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:12:10.568901 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-52f6f0a1-7a59-4a32-97dd-41b944bd77ea tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:12:10.569831 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-52f6f0a1-7a59-4a32-97dd-41b944bd77ea tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:12:10.768392 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-52f6f0a1-7a59-4a32-97dd-41b944bd77ea tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:12:10.777428 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-52f6f0a1-7a59-4a32-97dd-41b944bd77ea tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/d51a5b7d-90cb-4bd7-a258-22fd5a0df673" status: 200 len: 1451 microversion: 2.1 time: 0.232340 Sep 23 05:12:10.778950 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3304/6787] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:12:10 2022] GET /compute/v2.1/servers/d51a5b7d-90cb-4bd7-a258-22fd5a0df673 => generated 1451 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:12:11.196947 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-61593972-26d8-44c3-ab52-444c93ba74d5 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:12:11.198341 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-61593972-26d8-44c3-ab52-444c93ba74d5 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] [instance: 0d0f17c3-e777-4c71-a9df-b2de76f0615a] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:12:11.204610 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-61593972-26d8-44c3-ab52-444c93ba74d5 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:12:11.205365 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-61593972-26d8-44c3-ab52-444c93ba74d5 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:12:11.206009 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-61593972-26d8-44c3-ab52-444c93ba74d5 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:12:11.206913 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-61593972-26d8-44c3-ab52-444c93ba74d5 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:12:11.207728 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-61593972-26d8-44c3-ab52-444c93ba74d5 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:12:11.208326 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-61593972-26d8-44c3-ab52-444c93ba74d5 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:12:11.357750 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-61593972-26d8-44c3-ab52-444c93ba74d5 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82736eb912544711991da4f27c321f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116ae3ab00e447f89c7e8210ba89be75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:12:11.372953 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-61593972-26d8-44c3-ab52-444c93ba74d5 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] 10.222.0.33 "GET /compute/v2.1/servers/0d0f17c3-e777-4c71-a9df-b2de76f0615a" status: 200 len: 1228 microversion: 2.1 time: 0.179803 Sep 23 05:12:11.378267 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3484/6788] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:12:11 2022] GET /compute/v2.1/servers/0d0f17c3-e777-4c71-a9df-b2de76f0615a => generated 1228 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:12:12.400343 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-26daa25c-59fa-4e3d-9d33-e92e2de637c9 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:12:12.401111 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-26daa25c-59fa-4e3d-9d33-e92e2de637c9 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] [instance: 0d0f17c3-e777-4c71-a9df-b2de76f0615a] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:12:12.411644 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-26daa25c-59fa-4e3d-9d33-e92e2de637c9 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:12:12.412738 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-26daa25c-59fa-4e3d-9d33-e92e2de637c9 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:12:12.413409 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-26daa25c-59fa-4e3d-9d33-e92e2de637c9 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:12:12.414603 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-26daa25c-59fa-4e3d-9d33-e92e2de637c9 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:12:12.415483 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-26daa25c-59fa-4e3d-9d33-e92e2de637c9 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:12:12.416105 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-26daa25c-59fa-4e3d-9d33-e92e2de637c9 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:12:12.556603 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-26daa25c-59fa-4e3d-9d33-e92e2de637c9 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82736eb912544711991da4f27c321f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116ae3ab00e447f89c7e8210ba89be75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:12:12.575568 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-26daa25c-59fa-4e3d-9d33-e92e2de637c9 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] 10.222.0.33 "GET /compute/v2.1/servers/0d0f17c3-e777-4c71-a9df-b2de76f0615a" status: 200 len: 1228 microversion: 2.1 time: 0.177486 Sep 23 05:12:12.581711 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3305/6789] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:12:12 2022] GET /compute/v2.1/servers/0d0f17c3-e777-4c71-a9df-b2de76f0615a => generated 1228 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:12:13.612862 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-95e8e53c-e68a-4031-a61e-b45c48b79efe tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:12:13.613572 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-95e8e53c-e68a-4031-a61e-b45c48b79efe tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] [instance: 0d0f17c3-e777-4c71-a9df-b2de76f0615a] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:12:13.620251 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-95e8e53c-e68a-4031-a61e-b45c48b79efe tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:12:13.620747 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-95e8e53c-e68a-4031-a61e-b45c48b79efe tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:12:13.621372 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-95e8e53c-e68a-4031-a61e-b45c48b79efe tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:12:13.622327 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-95e8e53c-e68a-4031-a61e-b45c48b79efe tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:12:13.622800 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-95e8e53c-e68a-4031-a61e-b45c48b79efe tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:12:13.623227 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-95e8e53c-e68a-4031-a61e-b45c48b79efe tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:12:13.714444 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-95e8e53c-e68a-4031-a61e-b45c48b79efe tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82736eb912544711991da4f27c321f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116ae3ab00e447f89c7e8210ba89be75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:12:13.726995 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-95e8e53c-e68a-4031-a61e-b45c48b79efe tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] 10.222.0.33 "GET /compute/v2.1/servers/0d0f17c3-e777-4c71-a9df-b2de76f0615a" status: 200 len: 1228 microversion: 2.1 time: 0.122640 Sep 23 05:12:13.728099 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3485/6790] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:12:13 2022] GET /compute/v2.1/servers/0d0f17c3-e777-4c71-a9df-b2de76f0615a => generated 1228 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:12:14.752927 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8e53a348-b6da-4afa-8e38-abc4da6c2d2f tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:12:14.754396 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8e53a348-b6da-4afa-8e38-abc4da6c2d2f tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] [instance: 0d0f17c3-e777-4c71-a9df-b2de76f0615a] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:12:14.768143 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8e53a348-b6da-4afa-8e38-abc4da6c2d2f tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:12:14.770004 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8e53a348-b6da-4afa-8e38-abc4da6c2d2f tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:12:14.770487 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8e53a348-b6da-4afa-8e38-abc4da6c2d2f tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:12:14.772666 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8e53a348-b6da-4afa-8e38-abc4da6c2d2f tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:12:14.773347 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8e53a348-b6da-4afa-8e38-abc4da6c2d2f tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:12:14.775387 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8e53a348-b6da-4afa-8e38-abc4da6c2d2f tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:12:14.912073 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8e53a348-b6da-4afa-8e38-abc4da6c2d2f tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82736eb912544711991da4f27c321f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116ae3ab00e447f89c7e8210ba89be75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:12:14.924291 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8e53a348-b6da-4afa-8e38-abc4da6c2d2f tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] 10.222.0.33 "GET /compute/v2.1/servers/0d0f17c3-e777-4c71-a9df-b2de76f0615a" status: 200 len: 1228 microversion: 2.1 time: 0.173602 Sep 23 05:12:14.926327 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3306/6791] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:12:14 2022] GET /compute/v2.1/servers/0d0f17c3-e777-4c71-a9df-b2de76f0615a => generated 1228 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:12:15.326645 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-1f418dbd-8bee-4aa2-a5f7-94586b44811c req-5e980f59-83b5-4c3d-837b-ea65cae12b4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d51a5b7d-90cb-4bd7-a258-22fd5a0df673", "tag": "a4f83f8e-f207-4a15-b4f5-55906228e2e5"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:12:15.338908 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-1f418dbd-8bee-4aa2-a5f7-94586b44811c req-5e980f59-83b5-4c3d-837b-ea65cae12b4d service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:12:15.339663 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-1f418dbd-8bee-4aa2-a5f7-94586b44811c req-5e980f59-83b5-4c3d-837b-ea65cae12b4d service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:12:15.340274 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-1f418dbd-8bee-4aa2-a5f7-94586b44811c req-5e980f59-83b5-4c3d-837b-ea65cae12b4d service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:12:15.353392 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-1f418dbd-8bee-4aa2-a5f7-94586b44811c req-5e980f59-83b5-4c3d-837b-ea65cae12b4d service nova] Creating event network-changed:a4f83f8e-f207-4a15-b4f5-55906228e2e5 for instance d51a5b7d-90cb-4bd7-a258-22fd5a0df673 on n-h2-846463-3 Sep 23 05:12:15.362986 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-1f418dbd-8bee-4aa2-a5f7-94586b44811c req-5e980f59-83b5-4c3d-837b-ea65cae12b4d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062238 Sep 23 05:12:15.370411 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3486/6792] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:12:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 05:12:15.952488 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6bee5945-befe-4202-8bd5-0355fd9be855 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:12:15.953696 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-6bee5945-befe-4202-8bd5-0355fd9be855 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] [instance: 0d0f17c3-e777-4c71-a9df-b2de76f0615a] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:12:15.968521 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6bee5945-befe-4202-8bd5-0355fd9be855 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:12:15.969278 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6bee5945-befe-4202-8bd5-0355fd9be855 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:12:15.969941 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6bee5945-befe-4202-8bd5-0355fd9be855 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:12:15.970919 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6bee5945-befe-4202-8bd5-0355fd9be855 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:12:15.971433 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6bee5945-befe-4202-8bd5-0355fd9be855 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:12:15.971926 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6bee5945-befe-4202-8bd5-0355fd9be855 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:12:16.020074 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6bee5945-befe-4202-8bd5-0355fd9be855 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:12:16.020584 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6bee5945-befe-4202-8bd5-0355fd9be855 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:12:16.021746 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6bee5945-befe-4202-8bd5-0355fd9be855 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:12:16.022643 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-6bee5945-befe-4202-8bd5-0355fd9be855 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lazy-loading 'fault' on Instance uuid 0d0f17c3-e777-4c71-a9df-b2de76f0615a {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 05:12:16.072093 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6bee5945-befe-4202-8bd5-0355fd9be855 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82736eb912544711991da4f27c321f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116ae3ab00e447f89c7e8210ba89be75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:12:16.091058 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-6bee5945-befe-4202-8bd5-0355fd9be855 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] 10.222.0.33 "GET /compute/v2.1/servers/0d0f17c3-e777-4c71-a9df-b2de76f0615a" status: 200 len: 1233 microversion: 2.1 time: 0.146109 Sep 23 05:12:16.119494 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3307/6793] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:12:15 2022] GET /compute/v2.1/servers/0d0f17c3-e777-4c71-a9df-b2de76f0615a => generated 1233 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:12:17.122319 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e848a638-4e5e-40c3-8f46-fbe04ac2a7e6 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:12:17.123253 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e848a638-4e5e-40c3-8f46-fbe04ac2a7e6 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] [instance: 0d0f17c3-e777-4c71-a9df-b2de76f0615a] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:12:17.130871 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e848a638-4e5e-40c3-8f46-fbe04ac2a7e6 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:12:17.131487 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e848a638-4e5e-40c3-8f46-fbe04ac2a7e6 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:12:17.132026 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e848a638-4e5e-40c3-8f46-fbe04ac2a7e6 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:12:17.133171 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e848a638-4e5e-40c3-8f46-fbe04ac2a7e6 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:12:17.133944 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e848a638-4e5e-40c3-8f46-fbe04ac2a7e6 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:12:17.134484 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e848a638-4e5e-40c3-8f46-fbe04ac2a7e6 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:12:17.153098 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-e848a638-4e5e-40c3-8f46-fbe04ac2a7e6 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] HTTP exception thrown: Instance 0d0f17c3-e777-4c71-a9df-b2de76f0615a could not be found. Sep 23 05:12:17.156114 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e848a638-4e5e-40c3-8f46-fbe04ac2a7e6 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Request method failure captured: Sep 23 05:12:17.156114 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/0d0f17c3-e777-4c71-a9df-b2de76f0615a HTTP/1.1 Sep 23 05:12:17.156114 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 05:12:17.156114 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 05:12:17.156114 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 05:12:17.156114 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 05:12:17.156114 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 05:12:17.156114 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 05:12:17.156114 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 05:12:17.156114 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 05:12:17.156114 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLT6cFRV2g-VrHe9hNuCU85JxyMwiInWHiGoRX7tPeM8sNd0ezMqXoRAG-BGIlagEA8KtczdKkoku37X8q_gHZLCW4UdHZuSlPUlMz-5He5Lt1SwZSRt_Rlt9CPI5MT0svydUlgOkTT6RYPci2hDM0pArYHnpWrV16Eo55PBSifpj7cw Sep 23 05:12:17.156114 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 05:12:17.156114 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 05:12:17.156114 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 05:12:17.156114 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 05:12:17.156114 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 05:12:17.156114 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 05:12:17.156114 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 116ae3ab00e447f89c7e8210ba89be75 Sep 23 05:12:17.156114 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-TestVolumeBackupRestore-736781623 Sep 23 05:12:17.156114 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 05:12:17.156114 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 05:12:17.156114 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_116ae3ab00e447f89c7e8210ba89be75", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/116ae3ab00e447f89c7e8210ba89be75"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/116ae3ab00e447f89c7e8210ba89be75"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/116ae3ab00e447f89c7e8210ba89be75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:12:17.156114 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-TestVolumeBackupRestore-736781623 Sep 23 05:12:17.156114 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 116ae3ab00e447f89c7e8210ba89be75 Sep 23 05:12:17.156114 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-TestVolumeBackupRestore-736781623 Sep 23 05:12:17.156114 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-TestVolumeBackupRestore-736781623-project Sep 23 05:12:17.156114 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 05:12:17.156114 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 05:12:17.156114 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 82736eb912544711991da4f27c321f8a Sep 23 05:12:17.156114 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-TestVolumeBackupRestore-736781623-project Sep 23 05:12:17.156114 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 05:12:17.156114 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 0d0f17c3-e777-4c71-a9df-b2de76f0615a could not be found. Sep 23 05:12:17.156114 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '0d0f17c3-e777-4c71-a9df-b2de76f0615a'} Sep 23 05:12:17.156114 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:12:17.156114 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:12:17.156114 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 05:12:17.156114 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 05:12:17.156114 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 05:12:17.156114 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 05:12:17.156114 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 05:12:17.156114 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 05:12:17.156114 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 05:12:17.156114 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 05:12:17.156114 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d0f17c3-e777-4c71-a9df-b2de76f0615a could not be found. Sep 23 05:12:17.156114 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:12:17.156114 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:12:17.156114 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:12:17.156114 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:12:17.156114 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:12:17.156114 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:12:17.156114 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:12:17.156114 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:12:17.156114 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:12:17.156114 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:12:17.156114 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 05:12:17.156114 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 05:12:17.156114 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 05:12:17.156114 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 05:12:17.156114 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 05:12:17.156114 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:12:17.156114 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d0f17c3-e777-4c71-a9df-b2de76f0615a could not be found. Sep 23 05:12:17.156114 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:12:17.156114 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:12:17.156114 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:12:17.161930 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:12:17.161930 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:12:17.161930 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:12:17.161930 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:12:17.161930 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:12:17.161930 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d0f17c3-e777-4c71-a9df-b2de76f0615a could not be found. Sep 23 05:12:17.161930 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:12:17.161930 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e848a638-4e5e-40c3-8f46-fbe04ac2a7e6 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Returning 404 to user: Instance 0d0f17c3-e777-4c71-a9df-b2de76f0615a could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:12:17.161930 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e848a638-4e5e-40c3-8f46-fbe04ac2a7e6 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] 10.222.0.33 "GET /compute/v2.1/servers/0d0f17c3-e777-4c71-a9df-b2de76f0615a" status: 404 len: 111 microversion: 2.1 time: 0.044232 Sep 23 05:12:17.163899 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3487/6794] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:12:17 2022] GET /compute/v2.1/servers/0d0f17c3-e777-4c71-a9df-b2de76f0615a => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 05:12:17.455102 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3d12aeba-36f3-4989-95d2-534b713f8810 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] Calling method '.version_select at 0x7ff1bab66550>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:12:17.553830 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3d12aeba-36f3-4989-95d2-534b713f8810 tempest-TestVolumeBackupRestore-736781623 tempest-TestVolumeBackupRestore-736781623-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-491251806" status: 202 len: 0 microversion: 2.1 time: 0.102607 Sep 23 05:12:17.554885 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3308/6795] 10.222.0.33 () {58 vars in 1266 bytes} [Fri Sep 23 05:12:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-491251806 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 05:12:21.232326 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-19b0c131-2e87-45d1-9286-0f73835580f6 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-1763512028", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:12:21.267745 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:12:21.339282 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.neutron [None req-19b0c131-2e87-45d1-9286-0f73835580f6 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] validate_networks() for None {{(pid=122699) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 05:12:21.825508 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-19b0c131-2e87-45d1-9286-0f73835580f6 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Flavor limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 05:12:21.826079 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-19b0c131-2e87-45d1-9286-0f73835580f6 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Image limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 05:12:21.826876 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-19b0c131-2e87-45d1-9286-0f73835580f6 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Flavor pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 05:12:21.835530 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-19b0c131-2e87-45d1-9286-0f73835580f6 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Image pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 05:12:21.835530 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-19b0c131-2e87-45d1-9286-0f73835580f6 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 05:12:21.840219 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-19b0c131-2e87-45d1-9286-0f73835580f6 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:12:21.840843 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-19b0c131-2e87-45d1-9286-0f73835580f6 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:12:21.841355 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-19b0c131-2e87-45d1-9286-0f73835580f6 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:12:21.842537 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-19b0c131-2e87-45d1-9286-0f73835580f6 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:12:21.843085 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-19b0c131-2e87-45d1-9286-0f73835580f6 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:12:21.843716 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-19b0c131-2e87-45d1-9286-0f73835580f6 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:12:21.851492 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:12:21.893258 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-19b0c131-2e87-45d1-9286-0f73835580f6 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Getting quotas for project 9de4c236b606402b85da314ea689d62d. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 05:12:21.893258 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-19b0c131-2e87-45d1-9286-0f73835580f6 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Getting quotas for user 31e87a776dc343afb9ff1eae2785aa0e and project 9de4c236b606402b85da314ea689d62d. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 05:12:21.893258 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-19b0c131-2e87-45d1-9286-0f73835580f6 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Going to run 1 instances... {{(pid=122699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 05:12:21.893258 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-19b0c131-2e87-45d1-9286-0f73835580f6 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] [instance: 1dab78e1-8c76-498e-822f-cece61560222] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 05:12:22.066960 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-19b0c131-2e87-45d1-9286-0f73835580f6 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.838697 Sep 23 05:12:22.069509 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3488/6796] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 05:12:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 843 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 05:12:22.080985 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-92d0473d-bbd2-48d5-82f8-aa50500c653b tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:12:22.082340 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-92d0473d-bbd2-48d5-82f8-aa50500c653b tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] [instance: 1dab78e1-8c76-498e-822f-cece61560222] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:12:22.175600 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-92d0473d-bbd2-48d5-82f8-aa50500c653b tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e87a776dc343afb9ff1eae2785aa0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de4c236b606402b85da314ea689d62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:12:22.185293 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-92d0473d-bbd2-48d5-82f8-aa50500c653b tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] 10.222.0.33 "GET /compute/v2.1/servers/1dab78e1-8c76-498e-822f-cece61560222" status: 200 len: 1214 microversion: 2.1 time: 0.108944 Sep 23 05:12:22.186235 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3309/6797] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:12:22 2022] GET /compute/v2.1/servers/1dab78e1-8c76-498e-822f-cece61560222 => generated 1214 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:12:23.210135 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-96d7d973-7d81-458c-8cce-ee96dea02763 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:12:23.211547 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-96d7d973-7d81-458c-8cce-ee96dea02763 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] [instance: 1dab78e1-8c76-498e-822f-cece61560222] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:12:23.335985 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-96d7d973-7d81-458c-8cce-ee96dea02763 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e87a776dc343afb9ff1eae2785aa0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de4c236b606402b85da314ea689d62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:12:23.344885 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-96d7d973-7d81-458c-8cce-ee96dea02763 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] 10.222.0.33 "GET /compute/v2.1/servers/1dab78e1-8c76-498e-822f-cece61560222" status: 200 len: 1214 microversion: 2.1 time: 0.140005 Sep 23 05:12:23.349828 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3489/6798] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:12:23 2022] GET /compute/v2.1/servers/1dab78e1-8c76-498e-822f-cece61560222 => generated 1214 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:12:24.375627 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f5c6652f-22c5-4e95-83c0-02cf010064f0 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:12:24.377374 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f5c6652f-22c5-4e95-83c0-02cf010064f0 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] [instance: 1dab78e1-8c76-498e-822f-cece61560222] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:12:24.394223 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f5c6652f-22c5-4e95-83c0-02cf010064f0 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:12:24.394985 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f5c6652f-22c5-4e95-83c0-02cf010064f0 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:12:24.395609 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f5c6652f-22c5-4e95-83c0-02cf010064f0 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:12:24.397185 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f5c6652f-22c5-4e95-83c0-02cf010064f0 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:12:24.397185 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f5c6652f-22c5-4e95-83c0-02cf010064f0 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:12:24.397726 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f5c6652f-22c5-4e95-83c0-02cf010064f0 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:12:24.400917 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=87 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:12:24.558148 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f5c6652f-22c5-4e95-83c0-02cf010064f0 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e87a776dc343afb9ff1eae2785aa0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de4c236b606402b85da314ea689d62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:12:24.569744 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f5c6652f-22c5-4e95-83c0-02cf010064f0 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] 10.222.0.33 "GET /compute/v2.1/servers/1dab78e1-8c76-498e-822f-cece61560222" status: 200 len: 1210 microversion: 2.1 time: 0.198061 Sep 23 05:12:24.593674 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3310/6799] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:12:24 2022] GET /compute/v2.1/servers/1dab78e1-8c76-498e-822f-cece61560222 => generated 1210 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:12:25.620968 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a61d7e0f-f67e-4528-b692-a9e19f302e7e tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:12:25.621681 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a61d7e0f-f67e-4528-b692-a9e19f302e7e tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] [instance: 1dab78e1-8c76-498e-822f-cece61560222] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:12:25.637850 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a61d7e0f-f67e-4528-b692-a9e19f302e7e tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:12:25.652884 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a61d7e0f-f67e-4528-b692-a9e19f302e7e tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:12:25.661544 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a61d7e0f-f67e-4528-b692-a9e19f302e7e tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:12:25.661544 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a61d7e0f-f67e-4528-b692-a9e19f302e7e tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:12:25.661544 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a61d7e0f-f67e-4528-b692-a9e19f302e7e tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:12:25.661544 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a61d7e0f-f67e-4528-b692-a9e19f302e7e tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:12:25.798609 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a61d7e0f-f67e-4528-b692-a9e19f302e7e tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e87a776dc343afb9ff1eae2785aa0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de4c236b606402b85da314ea689d62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:12:25.805213 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a61d7e0f-f67e-4528-b692-a9e19f302e7e tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] 10.222.0.33 "GET /compute/v2.1/servers/1dab78e1-8c76-498e-822f-cece61560222" status: 200 len: 1284 microversion: 2.1 time: 0.188652 Sep 23 05:12:25.821435 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3490/6800] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:12:25 2022] GET /compute/v2.1/servers/1dab78e1-8c76-498e-822f-cece61560222 => generated 1284 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:12:26.829927 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4c756059-732b-48e1-b99b-135aaa760c2c tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:12:26.832182 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4c756059-732b-48e1-b99b-135aaa760c2c tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] [instance: 1dab78e1-8c76-498e-822f-cece61560222] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:12:26.837039 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=48,nova_api:DELETE=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:12:26.848706 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4c756059-732b-48e1-b99b-135aaa760c2c tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:12:26.856660 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4c756059-732b-48e1-b99b-135aaa760c2c tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:12:26.858421 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4c756059-732b-48e1-b99b-135aaa760c2c tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:12:26.859379 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4c756059-732b-48e1-b99b-135aaa760c2c tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:12:26.860056 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4c756059-732b-48e1-b99b-135aaa760c2c tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:12:26.860666 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4c756059-732b-48e1-b99b-135aaa760c2c tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:12:27.296519 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4c756059-732b-48e1-b99b-135aaa760c2c tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e87a776dc343afb9ff1eae2785aa0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de4c236b606402b85da314ea689d62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:12:27.309459 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4c756059-732b-48e1-b99b-135aaa760c2c tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] 10.222.0.33 "GET /compute/v2.1/servers/1dab78e1-8c76-498e-822f-cece61560222" status: 200 len: 1272 microversion: 2.1 time: 0.483964 Sep 23 05:12:27.325490 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3311/6801] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:12:26 2022] GET /compute/v2.1/servers/1dab78e1-8c76-498e-822f-cece61560222 => generated 1272 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:12:28.345727 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4802b115-9422-4445-a725-f9c6a6c11b28 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:12:28.347460 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4802b115-9422-4445-a725-f9c6a6c11b28 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] [instance: 1dab78e1-8c76-498e-822f-cece61560222] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:12:28.372554 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4802b115-9422-4445-a725-f9c6a6c11b28 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:12:28.372554 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4802b115-9422-4445-a725-f9c6a6c11b28 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:12:28.372554 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4802b115-9422-4445-a725-f9c6a6c11b28 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:12:28.372554 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4802b115-9422-4445-a725-f9c6a6c11b28 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:12:28.372554 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4802b115-9422-4445-a725-f9c6a6c11b28 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:12:28.372554 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4802b115-9422-4445-a725-f9c6a6c11b28 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:12:28.867128 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-4802b115-9422-4445-a725-f9c6a6c11b28 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e87a776dc343afb9ff1eae2785aa0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de4c236b606402b85da314ea689d62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:12:28.880306 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4802b115-9422-4445-a725-f9c6a6c11b28 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] 10.222.0.33 "GET /compute/v2.1/servers/1dab78e1-8c76-498e-822f-cece61560222" status: 200 len: 1314 microversion: 2.1 time: 0.551457 Sep 23 05:12:28.882927 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3491/6802] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:12:28 2022] GET /compute/v2.1/servers/1dab78e1-8c76-498e-822f-cece61560222 => generated 1314 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:12:29.694293 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-c0d29b91-68e8-45d3-8cfc-8f84e6c6d3bf req-a89d141f-9a11-40f6-848d-ea9ec5b17ef2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1dab78e1-8c76-498e-822f-cece61560222", "tag": "215781e9-b961-4743-b233-be83f4621104"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:12:29.707224 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-c0d29b91-68e8-45d3-8cfc-8f84e6c6d3bf req-a89d141f-9a11-40f6-848d-ea9ec5b17ef2 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:12:29.708051 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-c0d29b91-68e8-45d3-8cfc-8f84e6c6d3bf req-a89d141f-9a11-40f6-848d-ea9ec5b17ef2 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:12:29.708695 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-c0d29b91-68e8-45d3-8cfc-8f84e6c6d3bf req-a89d141f-9a11-40f6-848d-ea9ec5b17ef2 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:12:29.730252 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-c0d29b91-68e8-45d3-8cfc-8f84e6c6d3bf req-a89d141f-9a11-40f6-848d-ea9ec5b17ef2 service nova] Creating event network-changed:215781e9-b961-4743-b233-be83f4621104 for instance 1dab78e1-8c76-498e-822f-cece61560222 on n-h1-846463-3 Sep 23 05:12:29.741824 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-c0d29b91-68e8-45d3-8cfc-8f84e6c6d3bf req-a89d141f-9a11-40f6-848d-ea9ec5b17ef2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.287167 Sep 23 05:12:29.743768 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3312/6803] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:12:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:12:29.907464 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7dd7b0ff-99fc-457a-a8ac-16ea97294e6a tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:12:29.907464 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-7dd7b0ff-99fc-457a-a8ac-16ea97294e6a tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] [instance: 1dab78e1-8c76-498e-822f-cece61560222] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:12:29.917869 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7dd7b0ff-99fc-457a-a8ac-16ea97294e6a tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:12:29.932106 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7dd7b0ff-99fc-457a-a8ac-16ea97294e6a tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:12:29.932106 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7dd7b0ff-99fc-457a-a8ac-16ea97294e6a tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:12:29.932106 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7dd7b0ff-99fc-457a-a8ac-16ea97294e6a tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:12:29.932106 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7dd7b0ff-99fc-457a-a8ac-16ea97294e6a tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:12:29.932106 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7dd7b0ff-99fc-457a-a8ac-16ea97294e6a tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:12:30.339441 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-7dd7b0ff-99fc-457a-a8ac-16ea97294e6a tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e87a776dc343afb9ff1eae2785aa0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de4c236b606402b85da314ea689d62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:12:30.351078 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-7dd7b0ff-99fc-457a-a8ac-16ea97294e6a tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] 10.222.0.33 "GET /compute/v2.1/servers/1dab78e1-8c76-498e-822f-cece61560222" status: 200 len: 1314 microversion: 2.1 time: 0.449820 Sep 23 05:12:30.352970 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3492/6804] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:12:29 2022] GET /compute/v2.1/servers/1dab78e1-8c76-498e-822f-cece61560222 => generated 1314 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:12:31.375898 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-81fbc3e9-f619-4437-8a9b-1f6cc42dd517 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:12:31.378167 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-81fbc3e9-f619-4437-8a9b-1f6cc42dd517 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] [instance: 1dab78e1-8c76-498e-822f-cece61560222] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:12:31.386446 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-81fbc3e9-f619-4437-8a9b-1f6cc42dd517 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:12:31.387264 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-81fbc3e9-f619-4437-8a9b-1f6cc42dd517 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:12:31.388442 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-81fbc3e9-f619-4437-8a9b-1f6cc42dd517 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:12:31.389431 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-81fbc3e9-f619-4437-8a9b-1f6cc42dd517 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:12:31.390373 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-81fbc3e9-f619-4437-8a9b-1f6cc42dd517 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:12:31.390907 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-81fbc3e9-f619-4437-8a9b-1f6cc42dd517 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:12:31.634465 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-81fbc3e9-f619-4437-8a9b-1f6cc42dd517 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e87a776dc343afb9ff1eae2785aa0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de4c236b606402b85da314ea689d62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:12:31.646297 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-81fbc3e9-f619-4437-8a9b-1f6cc42dd517 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] 10.222.0.33 "GET /compute/v2.1/servers/1dab78e1-8c76-498e-822f-cece61560222" status: 200 len: 1314 microversion: 2.1 time: 0.274680 Sep 23 05:12:31.656784 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3313/6805] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:12:31 2022] GET /compute/v2.1/servers/1dab78e1-8c76-498e-822f-cece61560222 => generated 1314 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:12:32.670296 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-94549c9a-4ec9-4189-a1eb-2212549ddc91 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:12:32.671652 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-94549c9a-4ec9-4189-a1eb-2212549ddc91 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] [instance: 1dab78e1-8c76-498e-822f-cece61560222] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:12:32.681168 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:12:32.683145 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-94549c9a-4ec9-4189-a1eb-2212549ddc91 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:12:32.683924 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-94549c9a-4ec9-4189-a1eb-2212549ddc91 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:12:32.684533 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-94549c9a-4ec9-4189-a1eb-2212549ddc91 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:12:32.685355 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-94549c9a-4ec9-4189-a1eb-2212549ddc91 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:12:32.685972 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-94549c9a-4ec9-4189-a1eb-2212549ddc91 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:12:32.686419 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-94549c9a-4ec9-4189-a1eb-2212549ddc91 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:12:32.916351 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-94549c9a-4ec9-4189-a1eb-2212549ddc91 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e87a776dc343afb9ff1eae2785aa0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de4c236b606402b85da314ea689d62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:12:32.926783 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-94549c9a-4ec9-4189-a1eb-2212549ddc91 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] 10.222.0.33 "GET /compute/v2.1/servers/1dab78e1-8c76-498e-822f-cece61560222" status: 200 len: 1314 microversion: 2.1 time: 0.260643 Sep 23 05:12:32.928229 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3493/6806] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:12:32 2022] GET /compute/v2.1/servers/1dab78e1-8c76-498e-822f-cece61560222 => generated 1314 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:12:33.952359 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-80bbcd0d-577e-4424-9a1b-561200297dfd tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:12:33.953784 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-80bbcd0d-577e-4424-9a1b-561200297dfd tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] [instance: 1dab78e1-8c76-498e-822f-cece61560222] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:12:33.961954 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:12:33.971301 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-80bbcd0d-577e-4424-9a1b-561200297dfd tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:12:33.971949 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-80bbcd0d-577e-4424-9a1b-561200297dfd tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:12:33.972555 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-80bbcd0d-577e-4424-9a1b-561200297dfd tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:12:33.975869 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-80bbcd0d-577e-4424-9a1b-561200297dfd tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:12:33.976485 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-80bbcd0d-577e-4424-9a1b-561200297dfd tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:12:33.977025 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-80bbcd0d-577e-4424-9a1b-561200297dfd tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:12:34.489380 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-80bbcd0d-577e-4424-9a1b-561200297dfd tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e87a776dc343afb9ff1eae2785aa0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de4c236b606402b85da314ea689d62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:12:34.506424 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-80bbcd0d-577e-4424-9a1b-561200297dfd tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] 10.222.0.33 "GET /compute/v2.1/servers/1dab78e1-8c76-498e-822f-cece61560222" status: 200 len: 1314 microversion: 2.1 time: 0.558802 Sep 23 05:12:34.508799 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3314/6807] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:12:33 2022] GET /compute/v2.1/servers/1dab78e1-8c76-498e-822f-cece61560222 => generated 1314 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:12:35.536148 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-75b4d753-6bf8-4cbb-ba67-5f1eae1d2b2b tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:12:35.536844 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-75b4d753-6bf8-4cbb-ba67-5f1eae1d2b2b tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] [instance: 1dab78e1-8c76-498e-822f-cece61560222] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:12:35.544636 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=8 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:12:35.552468 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-75b4d753-6bf8-4cbb-ba67-5f1eae1d2b2b tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:12:35.553049 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-75b4d753-6bf8-4cbb-ba67-5f1eae1d2b2b tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:12:35.553806 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-75b4d753-6bf8-4cbb-ba67-5f1eae1d2b2b tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:12:35.555240 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-75b4d753-6bf8-4cbb-ba67-5f1eae1d2b2b tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:12:35.556037 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-75b4d753-6bf8-4cbb-ba67-5f1eae1d2b2b tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:12:35.557055 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-75b4d753-6bf8-4cbb-ba67-5f1eae1d2b2b tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:12:35.839980 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-75b4d753-6bf8-4cbb-ba67-5f1eae1d2b2b tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e87a776dc343afb9ff1eae2785aa0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de4c236b606402b85da314ea689d62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:12:35.851915 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-75b4d753-6bf8-4cbb-ba67-5f1eae1d2b2b tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] 10.222.0.33 "GET /compute/v2.1/servers/1dab78e1-8c76-498e-822f-cece61560222" status: 200 len: 1314 microversion: 2.1 time: 0.320874 Sep 23 05:12:35.853206 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3494/6808] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:12:35 2022] GET /compute/v2.1/servers/1dab78e1-8c76-498e-822f-cece61560222 => generated 1314 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:12:36.875996 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2938e4be-7543-4c8f-bdb0-010c7efeb63b tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:12:36.876820 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-2938e4be-7543-4c8f-bdb0-010c7efeb63b tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] [instance: 1dab78e1-8c76-498e-822f-cece61560222] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:12:36.884412 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2938e4be-7543-4c8f-bdb0-010c7efeb63b tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:12:36.884932 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2938e4be-7543-4c8f-bdb0-010c7efeb63b tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:12:36.885396 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2938e4be-7543-4c8f-bdb0-010c7efeb63b tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:12:36.886716 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2938e4be-7543-4c8f-bdb0-010c7efeb63b tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:12:36.887207 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2938e4be-7543-4c8f-bdb0-010c7efeb63b tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:12:36.887657 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2938e4be-7543-4c8f-bdb0-010c7efeb63b tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:12:37.176786 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-2938e4be-7543-4c8f-bdb0-010c7efeb63b tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e87a776dc343afb9ff1eae2785aa0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de4c236b606402b85da314ea689d62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:12:37.186295 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2938e4be-7543-4c8f-bdb0-010c7efeb63b tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] 10.222.0.33 "GET /compute/v2.1/servers/1dab78e1-8c76-498e-822f-cece61560222" status: 200 len: 1314 microversion: 2.1 time: 0.314118 Sep 23 05:12:37.187243 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3315/6809] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:12:36 2022] GET /compute/v2.1/servers/1dab78e1-8c76-498e-822f-cece61560222 => generated 1314 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:12:38.215448 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4dbd6522-ed1e-437d-aef5-9da70c627076 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:12:38.215448 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4dbd6522-ed1e-437d-aef5-9da70c627076 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] [instance: 1dab78e1-8c76-498e-822f-cece61560222] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:12:38.229711 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4dbd6522-ed1e-437d-aef5-9da70c627076 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:12:38.230291 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4dbd6522-ed1e-437d-aef5-9da70c627076 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:12:38.230758 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4dbd6522-ed1e-437d-aef5-9da70c627076 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:12:38.233732 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4dbd6522-ed1e-437d-aef5-9da70c627076 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:12:38.234348 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4dbd6522-ed1e-437d-aef5-9da70c627076 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:12:38.234817 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4dbd6522-ed1e-437d-aef5-9da70c627076 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:12:38.293946 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-90a710f3-931f-4f1e-97f7-5bcfcb712c8b req-a57c55f3-75f4-4330-bae1-c05eafff0e64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dab78e1-8c76-498e-822f-cece61560222", "name": "network-vif-plugged", "status": "completed", "tag": "215781e9-b961-4743-b233-be83f4621104"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:12:38.307658 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-90a710f3-931f-4f1e-97f7-5bcfcb712c8b req-a57c55f3-75f4-4330-bae1-c05eafff0e64 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:12:38.309435 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-90a710f3-931f-4f1e-97f7-5bcfcb712c8b req-a57c55f3-75f4-4330-bae1-c05eafff0e64 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:12:38.310136 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-90a710f3-931f-4f1e-97f7-5bcfcb712c8b req-a57c55f3-75f4-4330-bae1-c05eafff0e64 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:12:38.327028 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-90a710f3-931f-4f1e-97f7-5bcfcb712c8b req-a57c55f3-75f4-4330-bae1-c05eafff0e64 service nova] Creating event network-vif-plugged:215781e9-b961-4743-b233-be83f4621104 for instance 1dab78e1-8c76-498e-822f-cece61560222 on n-h1-846463-3 Sep 23 05:12:38.338849 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-90a710f3-931f-4f1e-97f7-5bcfcb712c8b req-a57c55f3-75f4-4330-bae1-c05eafff0e64 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.508999 Sep 23 05:12:38.340326 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3495/6810] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:12:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:12:38.451470 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4dbd6522-ed1e-437d-aef5-9da70c627076 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e87a776dc343afb9ff1eae2785aa0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de4c236b606402b85da314ea689d62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:12:38.462340 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4dbd6522-ed1e-437d-aef5-9da70c627076 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] 10.222.0.33 "GET /compute/v2.1/servers/1dab78e1-8c76-498e-822f-cece61560222" status: 200 len: 1314 microversion: 2.1 time: 0.254270 Sep 23 05:12:38.479294 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3316/6811] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:12:38 2022] GET /compute/v2.1/servers/1dab78e1-8c76-498e-822f-cece61560222 => generated 1314 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:12:39.492601 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-21d26deb-1407-4d17-a55d-94ed73f628f0 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:12:39.498252 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-21d26deb-1407-4d17-a55d-94ed73f628f0 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] [instance: 1dab78e1-8c76-498e-822f-cece61560222] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:12:39.511929 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-21d26deb-1407-4d17-a55d-94ed73f628f0 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:12:39.512774 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-21d26deb-1407-4d17-a55d-94ed73f628f0 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:12:39.513460 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-21d26deb-1407-4d17-a55d-94ed73f628f0 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:12:39.514424 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-21d26deb-1407-4d17-a55d-94ed73f628f0 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:12:39.515058 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-21d26deb-1407-4d17-a55d-94ed73f628f0 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:12:39.515656 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-21d26deb-1407-4d17-a55d-94ed73f628f0 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:12:39.742114 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-21d26deb-1407-4d17-a55d-94ed73f628f0 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e87a776dc343afb9ff1eae2785aa0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de4c236b606402b85da314ea689d62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:12:39.750778 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-21d26deb-1407-4d17-a55d-94ed73f628f0 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] 10.222.0.33 "GET /compute/v2.1/servers/1dab78e1-8c76-498e-822f-cece61560222" status: 200 len: 1314 microversion: 2.1 time: 0.266565 Sep 23 05:12:39.751626 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3496/6812] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:12:39 2022] GET /compute/v2.1/servers/1dab78e1-8c76-498e-822f-cece61560222 => generated 1314 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:12:40.774869 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3ac8e227-16cd-4ef7-954f-824928d0b456 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:12:40.775532 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3ac8e227-16cd-4ef7-954f-824928d0b456 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] [instance: 1dab78e1-8c76-498e-822f-cece61560222] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:12:40.784123 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3ac8e227-16cd-4ef7-954f-824928d0b456 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:12:40.784634 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3ac8e227-16cd-4ef7-954f-824928d0b456 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:12:40.785280 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3ac8e227-16cd-4ef7-954f-824928d0b456 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:12:40.786074 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3ac8e227-16cd-4ef7-954f-824928d0b456 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:12:40.786735 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3ac8e227-16cd-4ef7-954f-824928d0b456 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:12:40.787176 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3ac8e227-16cd-4ef7-954f-824928d0b456 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:12:40.941027 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-3ac8e227-16cd-4ef7-954f-824928d0b456 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e87a776dc343afb9ff1eae2785aa0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de4c236b606402b85da314ea689d62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:12:40.952645 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3ac8e227-16cd-4ef7-954f-824928d0b456 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] 10.222.0.33 "GET /compute/v2.1/servers/1dab78e1-8c76-498e-822f-cece61560222" status: 200 len: 1464 microversion: 2.1 time: 0.181827 Sep 23 05:12:40.966026 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3317/6813] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:12:40 2022] GET /compute/v2.1/servers/1dab78e1-8c76-498e-822f-cece61560222 => generated 1464 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:12:40.977410 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-795b0d54-4850-4cb7-9152-baf53286d184 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3de3f253-9dfb-4a97-be2c-502ebd460017", "device": "/dev/sdb"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:12:40.983389 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-795b0d54-4850-4cb7-9152-baf53286d184 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] [instance: 1dab78e1-8c76-498e-822f-cece61560222] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:12:40.987443 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-795b0d54-4850-4cb7-9152-baf53286d184 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:12:40.987942 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-795b0d54-4850-4cb7-9152-baf53286d184 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:12:40.988390 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-795b0d54-4850-4cb7-9152-baf53286d184 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:12:40.989117 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-795b0d54-4850-4cb7-9152-baf53286d184 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:12:40.989582 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-795b0d54-4850-4cb7-9152-baf53286d184 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:12:40.990060 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-795b0d54-4850-4cb7-9152-baf53286d184 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:12:42.007142 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-795b0d54-4850-4cb7-9152-baf53286d184 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] 10.222.0.33 "POST /compute/v2.1/servers/1dab78e1-8c76-498e-822f-cece61560222/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.026963 Sep 23 05:12:42.007142 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3497/6814] 10.222.0.33 () {60 vars in 1323 bytes} [Fri Sep 23 05:12:40 2022] POST /compute/v2.1/servers/1dab78e1-8c76-498e-822f-cece61560222/os-volume_attachments => generated 194 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:14:24.652856 n-d-846463-3 devstack@n-api.service[122698]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f191bc7a-c250-407c-bbf3-646bef550c22] AMQP server on 10.222.0.33:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 23 05:14:24.653864 n-d-846463-3 devstack@n-api.service[122698]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2416b61d-0aee-4a62-9508-aa1fc06b9213] AMQP server on 10.222.0.33:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 23 05:14:24.654728 n-d-846463-3 devstack@n-api.service[122698]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 05:14:24.654860 n-d-846463-3 devstack@n-api.service[122698]: Fri Sep 23 05:14:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1dab78e1-8c76-498e-822f-cece61560222/os-volume_attachments/3de3f253-9dfb-4a97-be2c-502ebd460017 (ip 10.222.0.33) !!! Sep 23 05:14:24.656874 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=13 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:14:24.657657 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=43 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:14:24.664860 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9f38a567-6ce3-4625-b8c0-0e2d6736f765 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:14:24.665380 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-9f38a567-6ce3-4625-b8c0-0e2d6736f765 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] [instance: 1dab78e1-8c76-498e-822f-cece61560222] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:14:24.673553 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9f38a567-6ce3-4625-b8c0-0e2d6736f765 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:14:24.673553 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9f38a567-6ce3-4625-b8c0-0e2d6736f765 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:14:24.673553 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9f38a567-6ce3-4625-b8c0-0e2d6736f765 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:14:24.673935 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9f38a567-6ce3-4625-b8c0-0e2d6736f765 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:14:24.674176 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9f38a567-6ce3-4625-b8c0-0e2d6736f765 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:14:24.674591 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9f38a567-6ce3-4625-b8c0-0e2d6736f765 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:14:24.759850 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-9f38a567-6ce3-4625-b8c0-0e2d6736f765 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Lazy-loading 'services' on Instance uuid 1dab78e1-8c76-498e-822f-cece61560222 {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 05:14:24.942091 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9f38a567-6ce3-4625-b8c0-0e2d6736f765 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] 10.222.0.33 "DELETE /compute/v2.1/servers/1dab78e1-8c76-498e-822f-cece61560222/os-volume_attachments/3de3f253-9dfb-4a97-be2c-502ebd460017" status: 202 len: 0 microversion: 2.1 time: 0.290493 Sep 23 05:14:24.943048 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3318/6815] 10.222.0.33 () {58 vars in 1416 bytes} [Fri Sep 23 05:14:24 2022] DELETE /compute/v2.1/servers/1dab78e1-8c76-498e-822f-cece61560222/os-volume_attachments/3de3f253-9dfb-4a97-be2c-502ebd460017 => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 05:14:30.336913 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:14:30.337715 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:14:30.343105 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e5a8b0e3-672a-489a-b46f-a36825b2d77d tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:14:30.343698 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e5a8b0e3-672a-489a-b46f-a36825b2d77d tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] [instance: 1dab78e1-8c76-498e-822f-cece61560222] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:14:30.351195 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e5a8b0e3-672a-489a-b46f-a36825b2d77d tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:14:30.351195 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e5a8b0e3-672a-489a-b46f-a36825b2d77d tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:14:30.351195 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e5a8b0e3-672a-489a-b46f-a36825b2d77d tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:14:30.351855 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e5a8b0e3-672a-489a-b46f-a36825b2d77d tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:14:30.352319 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e5a8b0e3-672a-489a-b46f-a36825b2d77d tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:14:30.352751 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e5a8b0e3-672a-489a-b46f-a36825b2d77d tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:14:30.381734 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e5a8b0e3-672a-489a-b46f-a36825b2d77d tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] [instance: 1dab78e1-8c76-498e-822f-cece61560222] Going to try to terminate instance {{(pid=122699) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 05:14:30.681225 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e5a8b0e3-672a-489a-b46f-a36825b2d77d tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] 10.222.0.33 "DELETE /compute/v2.1/servers/1dab78e1-8c76-498e-822f-cece61560222" status: 204 len: 0 microversion: 2.1 time: 0.345981 Sep 23 05:14:30.681847 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3498/6816] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 05:14:30 2022] DELETE /compute/v2.1/servers/1dab78e1-8c76-498e-822f-cece61560222 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 05:14:30.692961 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b5cd3203-cd00-4253-bffa-cb94404de441 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:14:30.693683 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b5cd3203-cd00-4253-bffa-cb94404de441 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] [instance: 1dab78e1-8c76-498e-822f-cece61560222] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:14:30.701565 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b5cd3203-cd00-4253-bffa-cb94404de441 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:14:30.703538 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b5cd3203-cd00-4253-bffa-cb94404de441 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:14:30.703538 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b5cd3203-cd00-4253-bffa-cb94404de441 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:14:30.703538 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b5cd3203-cd00-4253-bffa-cb94404de441 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:14:30.703933 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b5cd3203-cd00-4253-bffa-cb94404de441 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:14:30.704384 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b5cd3203-cd00-4253-bffa-cb94404de441 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:14:30.713333 n-d-846463-3 devstack@n-api.service[122698]: INFO oslo.messaging._drivers.impl_rabbit [-] [f191bc7a-c250-407c-bbf3-646bef550c22] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 43444. Sep 23 05:14:30.724800 n-d-846463-3 devstack@n-api.service[122698]: INFO oslo.messaging._drivers.impl_rabbit [-] [2416b61d-0aee-4a62-9508-aa1fc06b9213] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 43446. Sep 23 05:14:30.848778 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b5cd3203-cd00-4253-bffa-cb94404de441 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e87a776dc343afb9ff1eae2785aa0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de4c236b606402b85da314ea689d62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:14:30.857133 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b5cd3203-cd00-4253-bffa-cb94404de441 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] 10.222.0.33 "GET /compute/v2.1/servers/1dab78e1-8c76-498e-822f-cece61560222" status: 200 len: 1470 microversion: 2.1 time: 0.170462 Sep 23 05:14:30.857728 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3319/6817] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:14:30 2022] GET /compute/v2.1/servers/1dab78e1-8c76-498e-822f-cece61560222 => generated 1470 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:14:31.882172 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a61c3825-40b7-4361-a75a-27261990f5f8 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:14:31.882910 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a61c3825-40b7-4361-a75a-27261990f5f8 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] [instance: 1dab78e1-8c76-498e-822f-cece61560222] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:14:31.889771 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a61c3825-40b7-4361-a75a-27261990f5f8 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:14:31.890306 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a61c3825-40b7-4361-a75a-27261990f5f8 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:14:31.890756 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a61c3825-40b7-4361-a75a-27261990f5f8 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:14:31.891483 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a61c3825-40b7-4361-a75a-27261990f5f8 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:14:31.891945 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a61c3825-40b7-4361-a75a-27261990f5f8 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:14:31.892358 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a61c3825-40b7-4361-a75a-27261990f5f8 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:14:32.032719 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a61c3825-40b7-4361-a75a-27261990f5f8 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e87a776dc343afb9ff1eae2785aa0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de4c236b606402b85da314ea689d62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:14:32.042635 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a61c3825-40b7-4361-a75a-27261990f5f8 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] 10.222.0.33 "GET /compute/v2.1/servers/1dab78e1-8c76-498e-822f-cece61560222" status: 200 len: 1470 microversion: 2.1 time: 0.165457 Sep 23 05:14:32.043247 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3499/6818] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:14:31 2022] GET /compute/v2.1/servers/1dab78e1-8c76-498e-822f-cece61560222 => generated 1470 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:14:32.781452 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-34905b50-fc67-4e72-9d81-5686f6cf05c0 req-6d859652-794f-4fcb-af02-b5e6f2e2c5db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dab78e1-8c76-498e-822f-cece61560222", "name": "network-vif-deleted", "tag": "215781e9-b961-4743-b233-be83f4621104"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:14:32.793197 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-34905b50-fc67-4e72-9d81-5686f6cf05c0 req-6d859652-794f-4fcb-af02-b5e6f2e2c5db service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:14:32.793728 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-34905b50-fc67-4e72-9d81-5686f6cf05c0 req-6d859652-794f-4fcb-af02-b5e6f2e2c5db service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:14:32.794207 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-34905b50-fc67-4e72-9d81-5686f6cf05c0 req-6d859652-794f-4fcb-af02-b5e6f2e2c5db service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:14:32.806684 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-34905b50-fc67-4e72-9d81-5686f6cf05c0 req-6d859652-794f-4fcb-af02-b5e6f2e2c5db service nova] Creating event network-vif-deleted:215781e9-b961-4743-b233-be83f4621104 for instance 1dab78e1-8c76-498e-822f-cece61560222 on n-h1-846463-3 Sep 23 05:14:32.812030 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-34905b50-fc67-4e72-9d81-5686f6cf05c0 req-6d859652-794f-4fcb-af02-b5e6f2e2c5db service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034528 Sep 23 05:14:32.818200 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3320/6819] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:14:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:14:33.067109 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-15de3c77-f77b-4f07-9795-b0b47dc2865c tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:14:33.074174 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-15de3c77-f77b-4f07-9795-b0b47dc2865c tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] [instance: 1dab78e1-8c76-498e-822f-cece61560222] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:14:33.084422 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-15de3c77-f77b-4f07-9795-b0b47dc2865c tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:14:33.085370 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-15de3c77-f77b-4f07-9795-b0b47dc2865c tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:14:33.085824 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-15de3c77-f77b-4f07-9795-b0b47dc2865c tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:14:33.086807 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-15de3c77-f77b-4f07-9795-b0b47dc2865c tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:14:33.087631 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-15de3c77-f77b-4f07-9795-b0b47dc2865c tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:14:33.088242 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-15de3c77-f77b-4f07-9795-b0b47dc2865c tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:14:33.125635 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-15de3c77-f77b-4f07-9795-b0b47dc2865c tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:14:33.126294 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-15de3c77-f77b-4f07-9795-b0b47dc2865c tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:14:33.126845 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-15de3c77-f77b-4f07-9795-b0b47dc2865c tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:14:33.127492 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-15de3c77-f77b-4f07-9795-b0b47dc2865c tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Lazy-loading 'fault' on Instance uuid 1dab78e1-8c76-498e-822f-cece61560222 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 05:14:33.173068 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-15de3c77-f77b-4f07-9795-b0b47dc2865c tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31e87a776dc343afb9ff1eae2785aa0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9de4c236b606402b85da314ea689d62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:14:33.182184 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-15de3c77-f77b-4f07-9795-b0b47dc2865c tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] 10.222.0.33 "GET /compute/v2.1/servers/1dab78e1-8c76-498e-822f-cece61560222" status: 200 len: 1304 microversion: 2.1 time: 0.119474 Sep 23 05:14:33.182916 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3500/6820] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:14:33 2022] GET /compute/v2.1/servers/1dab78e1-8c76-498e-822f-cece61560222 => generated 1304 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:14:34.211250 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3eedb00b-0c8c-429a-9d8a-28027b6d8f68 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:14:34.212025 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3eedb00b-0c8c-429a-9d8a-28027b6d8f68 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] [instance: 1dab78e1-8c76-498e-822f-cece61560222] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:14:34.218553 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3eedb00b-0c8c-429a-9d8a-28027b6d8f68 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:14:34.219059 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3eedb00b-0c8c-429a-9d8a-28027b6d8f68 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:14:34.219508 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3eedb00b-0c8c-429a-9d8a-28027b6d8f68 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:14:34.220219 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3eedb00b-0c8c-429a-9d8a-28027b6d8f68 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:14:34.220687 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3eedb00b-0c8c-429a-9d8a-28027b6d8f68 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:14:34.221123 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3eedb00b-0c8c-429a-9d8a-28027b6d8f68 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:14:34.235721 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-3eedb00b-0c8c-429a-9d8a-28027b6d8f68 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] HTTP exception thrown: Instance 1dab78e1-8c76-498e-822f-cece61560222 could not be found. Sep 23 05:14:34.237336 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3eedb00b-0c8c-429a-9d8a-28027b6d8f68 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Request method failure captured: Sep 23 05:14:34.237336 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/1dab78e1-8c76-498e-822f-cece61560222 HTTP/1.1 Sep 23 05:14:34.237336 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 05:14:34.237336 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 05:14:34.237336 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 05:14:34.237336 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 05:14:34.237336 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 05:14:34.237336 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 05:14:34.237336 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 05:14:34.237336 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 05:14:34.237336 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLUAxNe415Haxg7eFQ2b6B8NeFc6kNHeyDN1bPTryb-sS9_hewWyuikFZxJ-geEzt9pzu19TikSrWxu7g9MMj_DYR_vgD9ULhQqnNSt4OeoZoHk547MoOCoF-M-e3Qy95mnCSMR4tYw30cKfPdLXWXnZVJhbEmturRyGIXzYf5VDxTDQ Sep 23 05:14:34.237336 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 05:14:34.237336 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 05:14:34.237336 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 05:14:34.237336 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 05:14:34.237336 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 05:14:34.237336 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 05:14:34.237336 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 9de4c236b606402b85da314ea689d62d Sep 23 05:14:34.237336 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-VolumesBackupsTest-945947790 Sep 23 05:14:34.237336 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 05:14:34.237336 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 05:14:34.237336 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9de4c236b606402b85da314ea689d62d", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9de4c236b606402b85da314ea689d62d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9de4c236b606402b85da314ea689d62d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9de4c236b606402b85da314ea689d62d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:14:34.237336 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-VolumesBackupsTest-945947790 Sep 23 05:14:34.237336 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 9de4c236b606402b85da314ea689d62d Sep 23 05:14:34.237336 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-VolumesBackupsTest-945947790 Sep 23 05:14:34.237336 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-VolumesBackupsTest-945947790-project Sep 23 05:14:34.237336 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 05:14:34.237336 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 05:14:34.237336 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 31e87a776dc343afb9ff1eae2785aa0e Sep 23 05:14:34.237336 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-VolumesBackupsTest-945947790-project Sep 23 05:14:34.237336 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 05:14:34.237336 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 1dab78e1-8c76-498e-822f-cece61560222 could not be found. Sep 23 05:14:34.237336 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '1dab78e1-8c76-498e-822f-cece61560222'} Sep 23 05:14:34.237336 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:14:34.237336 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:14:34.237336 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 05:14:34.237336 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 05:14:34.237336 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 05:14:34.237336 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 05:14:34.237336 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 05:14:34.237336 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 05:14:34.237336 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 05:14:34.237336 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 05:14:34.237336 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1dab78e1-8c76-498e-822f-cece61560222 could not be found. Sep 23 05:14:34.237336 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:14:34.237336 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:14:34.237336 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:14:34.237336 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:14:34.237336 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:14:34.237336 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:14:34.237336 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:14:34.237336 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:14:34.237336 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:14:34.237336 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:14:34.237336 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 05:14:34.237336 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 05:14:34.237336 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 05:14:34.237336 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 05:14:34.237336 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 05:14:34.237336 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:14:34.237336 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1dab78e1-8c76-498e-822f-cece61560222 could not be found. Sep 23 05:14:34.237336 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:14:34.237336 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:14:34.237336 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:14:34.243498 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:14:34.243498 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:14:34.243498 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:14:34.243498 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:14:34.243498 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:14:34.243498 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1dab78e1-8c76-498e-822f-cece61560222 could not be found. Sep 23 05:14:34.243498 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:14:34.243498 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3eedb00b-0c8c-429a-9d8a-28027b6d8f68 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] Returning 404 to user: Instance 1dab78e1-8c76-498e-822f-cece61560222 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:14:34.243498 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3eedb00b-0c8c-429a-9d8a-28027b6d8f68 tempest-VolumesBackupsTest-945947790 tempest-VolumesBackupsTest-945947790-project] 10.222.0.33 "GET /compute/v2.1/servers/1dab78e1-8c76-498e-822f-cece61560222" status: 404 len: 111 microversion: 2.1 time: 0.033471 Sep 23 05:14:34.243498 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3321/6821] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:14:34 2022] GET /compute/v2.1/servers/1dab78e1-8c76-498e-822f-cece61560222 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 05:14:43.241190 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:14:43.242867 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:14:43.485719 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e681144e-c604-42ba-9fb2-881f91545bfa tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:14:43.485719 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e681144e-c604-42ba-9fb2-881f91545bfa tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: d51a5b7d-90cb-4bd7-a258-22fd5a0df673] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:14:43.485719 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e681144e-c604-42ba-9fb2-881f91545bfa tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:14:43.485719 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e681144e-c604-42ba-9fb2-881f91545bfa tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:14:43.485719 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e681144e-c604-42ba-9fb2-881f91545bfa tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:14:43.485719 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e681144e-c604-42ba-9fb2-881f91545bfa tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:14:43.485719 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e681144e-c604-42ba-9fb2-881f91545bfa tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:14:43.485719 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e681144e-c604-42ba-9fb2-881f91545bfa tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:14:43.512023 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e681144e-c604-42ba-9fb2-881f91545bfa tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: d51a5b7d-90cb-4bd7-a258-22fd5a0df673] Going to try to terminate instance {{(pid=122699) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 05:14:43.804361 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e681144e-c604-42ba-9fb2-881f91545bfa tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "DELETE /compute/v2.1/servers/d51a5b7d-90cb-4bd7-a258-22fd5a0df673" status: 204 len: 0 microversion: 2.1 time: 0.567820 Sep 23 05:14:43.805917 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3501/6822] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 05:14:43 2022] DELETE /compute/v2.1/servers/d51a5b7d-90cb-4bd7-a258-22fd5a0df673 => generated 0 bytes in 569 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 05:14:43.817124 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-16e0617f-e2e8-4827-9eae-0190626a0ca2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:14:43.818516 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-16e0617f-e2e8-4827-9eae-0190626a0ca2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: d51a5b7d-90cb-4bd7-a258-22fd5a0df673] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:14:43.825763 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-16e0617f-e2e8-4827-9eae-0190626a0ca2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:14:43.826626 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-16e0617f-e2e8-4827-9eae-0190626a0ca2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:14:43.827287 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-16e0617f-e2e8-4827-9eae-0190626a0ca2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:14:43.828208 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-16e0617f-e2e8-4827-9eae-0190626a0ca2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:14:43.828866 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-16e0617f-e2e8-4827-9eae-0190626a0ca2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:14:43.829306 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-16e0617f-e2e8-4827-9eae-0190626a0ca2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:14:43.978512 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-16e0617f-e2e8-4827-9eae-0190626a0ca2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:14:43.988270 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-16e0617f-e2e8-4827-9eae-0190626a0ca2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/d51a5b7d-90cb-4bd7-a258-22fd5a0df673" status: 200 len: 1575 microversion: 2.1 time: 0.175467 Sep 23 05:14:43.997948 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3322/6823] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:14:43 2022] GET /compute/v2.1/servers/d51a5b7d-90cb-4bd7-a258-22fd5a0df673 => generated 1575 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:14:45.015527 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-30807934-0e33-4ecb-9bdf-c77625ea6a65 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:14:45.016293 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-30807934-0e33-4ecb-9bdf-c77625ea6a65 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: d51a5b7d-90cb-4bd7-a258-22fd5a0df673] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:14:45.023600 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-30807934-0e33-4ecb-9bdf-c77625ea6a65 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:14:45.024487 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-30807934-0e33-4ecb-9bdf-c77625ea6a65 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:14:45.025154 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-30807934-0e33-4ecb-9bdf-c77625ea6a65 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:14:45.026090 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-30807934-0e33-4ecb-9bdf-c77625ea6a65 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:14:45.026745 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-30807934-0e33-4ecb-9bdf-c77625ea6a65 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:14:45.027188 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-30807934-0e33-4ecb-9bdf-c77625ea6a65 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:14:45.173682 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-30807934-0e33-4ecb-9bdf-c77625ea6a65 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:14:45.182379 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-30807934-0e33-4ecb-9bdf-c77625ea6a65 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/d51a5b7d-90cb-4bd7-a258-22fd5a0df673" status: 200 len: 1575 microversion: 2.1 time: 0.171979 Sep 23 05:14:45.185335 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3502/6824] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:14:45 2022] GET /compute/v2.1/servers/d51a5b7d-90cb-4bd7-a258-22fd5a0df673 => generated 1575 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:14:46.206599 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8abcda4c-314e-4421-b999-0e9909ab27a9 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:14:46.208428 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8abcda4c-314e-4421-b999-0e9909ab27a9 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: d51a5b7d-90cb-4bd7-a258-22fd5a0df673] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:14:46.215880 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8abcda4c-314e-4421-b999-0e9909ab27a9 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:14:46.216715 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8abcda4c-314e-4421-b999-0e9909ab27a9 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:14:46.217445 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8abcda4c-314e-4421-b999-0e9909ab27a9 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:14:46.218446 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8abcda4c-314e-4421-b999-0e9909ab27a9 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:14:46.219090 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8abcda4c-314e-4421-b999-0e9909ab27a9 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:14:46.219712 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8abcda4c-314e-4421-b999-0e9909ab27a9 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:14:46.300387 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8abcda4c-314e-4421-b999-0e9909ab27a9 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:14:46.315603 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8abcda4c-314e-4421-b999-0e9909ab27a9 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/d51a5b7d-90cb-4bd7-a258-22fd5a0df673" status: 200 len: 1508 microversion: 2.1 time: 0.109519 Sep 23 05:14:46.315603 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3323/6825] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:14:46 2022] GET /compute/v2.1/servers/d51a5b7d-90cb-4bd7-a258-22fd5a0df673 => generated 1508 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:14:46.358557 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-fc326255-b6e0-47ed-8fb1-75a6312dd751 req-52e213d6-5a88-40fc-abdf-fc05d28d763d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d51a5b7d-90cb-4bd7-a258-22fd5a0df673", "name": "network-vif-deleted", "tag": "a4f83f8e-f207-4a15-b4f5-55906228e2e5"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:14:46.371605 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-fc326255-b6e0-47ed-8fb1-75a6312dd751 req-52e213d6-5a88-40fc-abdf-fc05d28d763d service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:14:46.372205 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-fc326255-b6e0-47ed-8fb1-75a6312dd751 req-52e213d6-5a88-40fc-abdf-fc05d28d763d service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:14:46.372939 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-fc326255-b6e0-47ed-8fb1-75a6312dd751 req-52e213d6-5a88-40fc-abdf-fc05d28d763d service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:14:46.388326 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-fc326255-b6e0-47ed-8fb1-75a6312dd751 req-52e213d6-5a88-40fc-abdf-fc05d28d763d service nova] Creating event network-vif-deleted:a4f83f8e-f207-4a15-b4f5-55906228e2e5 for instance d51a5b7d-90cb-4bd7-a258-22fd5a0df673 on n-h2-846463-3 Sep 23 05:14:46.394132 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-fc326255-b6e0-47ed-8fb1-75a6312dd751 req-52e213d6-5a88-40fc-abdf-fc05d28d763d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039467 Sep 23 05:14:46.395353 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3503/6826] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:14:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:14:47.347576 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c3b5864f-a79b-46af-a39f-a9dd05dfaeae tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:14:47.347576 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c3b5864f-a79b-46af-a39f-a9dd05dfaeae tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: d51a5b7d-90cb-4bd7-a258-22fd5a0df673] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:14:47.381079 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c3b5864f-a79b-46af-a39f-a9dd05dfaeae tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:14:47.382438 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c3b5864f-a79b-46af-a39f-a9dd05dfaeae tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:14:47.386019 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c3b5864f-a79b-46af-a39f-a9dd05dfaeae tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:14:47.387793 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c3b5864f-a79b-46af-a39f-a9dd05dfaeae tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:14:47.388528 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c3b5864f-a79b-46af-a39f-a9dd05dfaeae tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:14:47.391221 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c3b5864f-a79b-46af-a39f-a9dd05dfaeae tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:14:47.508902 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c3b5864f-a79b-46af-a39f-a9dd05dfaeae tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:14:47.518022 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c3b5864f-a79b-46af-a39f-a9dd05dfaeae tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/d51a5b7d-90cb-4bd7-a258-22fd5a0df673" status: 200 len: 1223 microversion: 2.1 time: 0.179382 Sep 23 05:14:47.519368 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3324/6827] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:14:47 2022] GET /compute/v2.1/servers/d51a5b7d-90cb-4bd7-a258-22fd5a0df673 => generated 1223 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:14:48.548911 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4306787d-4c27-4561-a97e-5e7d7fc72338 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:14:48.549773 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4306787d-4c27-4561-a97e-5e7d7fc72338 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: d51a5b7d-90cb-4bd7-a258-22fd5a0df673] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:14:48.560627 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4306787d-4c27-4561-a97e-5e7d7fc72338 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:14:48.561047 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4306787d-4c27-4561-a97e-5e7d7fc72338 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:14:48.561535 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4306787d-4c27-4561-a97e-5e7d7fc72338 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:14:48.565199 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4306787d-4c27-4561-a97e-5e7d7fc72338 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:14:48.570106 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4306787d-4c27-4561-a97e-5e7d7fc72338 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:14:48.570571 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4306787d-4c27-4561-a97e-5e7d7fc72338 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:14:48.653556 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-4306787d-4c27-4561-a97e-5e7d7fc72338 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:14:48.662618 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4306787d-4c27-4561-a97e-5e7d7fc72338 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/d51a5b7d-90cb-4bd7-a258-22fd5a0df673" status: 200 len: 1223 microversion: 2.1 time: 0.122078 Sep 23 05:14:48.663541 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3504/6828] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:14:48 2022] GET /compute/v2.1/servers/d51a5b7d-90cb-4bd7-a258-22fd5a0df673 => generated 1223 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:14:49.686804 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c86b6702-496d-42e8-b1cc-2a9bee066fb7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:14:49.688291 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c86b6702-496d-42e8-b1cc-2a9bee066fb7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: d51a5b7d-90cb-4bd7-a258-22fd5a0df673] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:14:49.697781 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c86b6702-496d-42e8-b1cc-2a9bee066fb7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:14:49.698588 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c86b6702-496d-42e8-b1cc-2a9bee066fb7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:14:49.699039 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c86b6702-496d-42e8-b1cc-2a9bee066fb7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:14:49.699811 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c86b6702-496d-42e8-b1cc-2a9bee066fb7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:14:49.700285 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c86b6702-496d-42e8-b1cc-2a9bee066fb7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:14:49.700755 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c86b6702-496d-42e8-b1cc-2a9bee066fb7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:14:49.770832 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c86b6702-496d-42e8-b1cc-2a9bee066fb7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:14:49.781869 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c86b6702-496d-42e8-b1cc-2a9bee066fb7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/d51a5b7d-90cb-4bd7-a258-22fd5a0df673" status: 200 len: 1223 microversion: 2.1 time: 0.100923 Sep 23 05:14:49.782783 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3325/6829] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:14:49 2022] GET /compute/v2.1/servers/d51a5b7d-90cb-4bd7-a258-22fd5a0df673 => generated 1223 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:14:50.804687 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4f7da32a-2f14-41a0-b6ff-2213bede08fc tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:14:50.805319 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4f7da32a-2f14-41a0-b6ff-2213bede08fc tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: d51a5b7d-90cb-4bd7-a258-22fd5a0df673] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:14:50.812456 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4f7da32a-2f14-41a0-b6ff-2213bede08fc tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:14:50.812959 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4f7da32a-2f14-41a0-b6ff-2213bede08fc tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:14:50.813406 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4f7da32a-2f14-41a0-b6ff-2213bede08fc tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:14:50.814158 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4f7da32a-2f14-41a0-b6ff-2213bede08fc tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:14:50.814626 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4f7da32a-2f14-41a0-b6ff-2213bede08fc tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:14:50.815068 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4f7da32a-2f14-41a0-b6ff-2213bede08fc tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:14:50.883138 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-4f7da32a-2f14-41a0-b6ff-2213bede08fc tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:14:50.892184 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4f7da32a-2f14-41a0-b6ff-2213bede08fc tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/d51a5b7d-90cb-4bd7-a258-22fd5a0df673" status: 200 len: 1223 microversion: 2.1 time: 0.091529 Sep 23 05:14:50.892780 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3505/6830] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:14:50 2022] GET /compute/v2.1/servers/d51a5b7d-90cb-4bd7-a258-22fd5a0df673 => generated 1223 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:14:51.916163 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-06884910-c58f-4694-a0ad-837e3db83d33 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:14:51.916969 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-06884910-c58f-4694-a0ad-837e3db83d33 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: d51a5b7d-90cb-4bd7-a258-22fd5a0df673] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:14:51.924935 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-06884910-c58f-4694-a0ad-837e3db83d33 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:14:51.925453 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-06884910-c58f-4694-a0ad-837e3db83d33 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:14:51.926822 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-06884910-c58f-4694-a0ad-837e3db83d33 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:14:51.927963 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-06884910-c58f-4694-a0ad-837e3db83d33 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:14:51.928724 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-06884910-c58f-4694-a0ad-837e3db83d33 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:14:51.929286 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-06884910-c58f-4694-a0ad-837e3db83d33 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:14:51.963850 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-06884910-c58f-4694-a0ad-837e3db83d33 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:14:51.964480 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-06884910-c58f-4694-a0ad-837e3db83d33 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:14:51.965017 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-06884910-c58f-4694-a0ad-837e3db83d33 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:14:51.965572 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-06884910-c58f-4694-a0ad-837e3db83d33 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lazy-loading 'fault' on Instance uuid d51a5b7d-90cb-4bd7-a258-22fd5a0df673 {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 05:14:52.072863 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-06884910-c58f-4694-a0ad-837e3db83d33 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:14:52.072863 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-06884910-c58f-4694-a0ad-837e3db83d33 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/d51a5b7d-90cb-4bd7-a258-22fd5a0df673" status: 200 len: 1228 microversion: 2.1 time: 0.107572 Sep 23 05:14:52.072863 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3326/6831] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:14:51 2022] GET /compute/v2.1/servers/d51a5b7d-90cb-4bd7-a258-22fd5a0df673 => generated 1228 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:14:53.092828 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-53a2c0d1-7399-4de7-a27c-c746165536e3 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:14:53.093390 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-53a2c0d1-7399-4de7-a27c-c746165536e3 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: d51a5b7d-90cb-4bd7-a258-22fd5a0df673] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:14:53.099993 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-53a2c0d1-7399-4de7-a27c-c746165536e3 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:14:53.100487 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-53a2c0d1-7399-4de7-a27c-c746165536e3 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:14:53.108259 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-53a2c0d1-7399-4de7-a27c-c746165536e3 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:14:53.108259 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-53a2c0d1-7399-4de7-a27c-c746165536e3 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:14:53.108259 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-53a2c0d1-7399-4de7-a27c-c746165536e3 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:14:53.108259 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-53a2c0d1-7399-4de7-a27c-c746165536e3 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:14:53.116763 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-53a2c0d1-7399-4de7-a27c-c746165536e3 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] HTTP exception thrown: Instance d51a5b7d-90cb-4bd7-a258-22fd5a0df673 could not be found. Sep 23 05:14:53.118520 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-53a2c0d1-7399-4de7-a27c-c746165536e3 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Request method failure captured: Sep 23 05:14:53.118520 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/d51a5b7d-90cb-4bd7-a258-22fd5a0df673 HTTP/1.1 Sep 23 05:14:53.118520 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 05:14:53.118520 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 05:14:53.118520 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 05:14:53.118520 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 05:14:53.118520 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 05:14:53.118520 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 05:14:53.118520 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 05:14:53.118520 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 05:14:53.118520 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLT3uLjiu4nPUFbkjrA4MyWVqiSG18wQr6d8tQl_P_I7oXAw8rp2FE6LolJR7q-NpMkbDL2xBtL-Km4xLll-czE6HybNQXkbhp5AdNp7lc8uSbgBeOP-qACziHhtaYPCszQMgYlHiKqFljv5hFyHB9WCa7Y2j2z8m1qKy7sQfYfHm2rE Sep 23 05:14:53.118520 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 05:14:53.118520 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 05:14:53.118520 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 05:14:53.118520 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 05:14:53.118520 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 05:14:53.118520 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 05:14:53.118520 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: cceaa1e24146497fbf3f79cebc112211 Sep 23 05:14:53.118520 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-TestVolumeBootPattern-1815855430 Sep 23 05:14:53.118520 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 05:14:53.118520 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 05:14:53.118520 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cceaa1e24146497fbf3f79cebc112211", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cceaa1e24146497fbf3f79cebc112211"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cceaa1e24146497fbf3f79cebc112211"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cceaa1e24146497fbf3f79cebc112211"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:14:53.118520 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-TestVolumeBootPattern-1815855430 Sep 23 05:14:53.118520 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: cceaa1e24146497fbf3f79cebc112211 Sep 23 05:14:53.118520 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-TestVolumeBootPattern-1815855430 Sep 23 05:14:53.118520 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-TestVolumeBootPattern-1815855430-project Sep 23 05:14:53.118520 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 05:14:53.118520 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 05:14:53.118520 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 0d55fe5072c14752846eb4ffc0eef91b Sep 23 05:14:53.118520 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-TestVolumeBootPattern-1815855430-project Sep 23 05:14:53.118520 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 05:14:53.118520 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance d51a5b7d-90cb-4bd7-a258-22fd5a0df673 could not be found. Sep 23 05:14:53.118520 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': 'd51a5b7d-90cb-4bd7-a258-22fd5a0df673'} Sep 23 05:14:53.118520 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:14:53.118520 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:14:53.118520 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 05:14:53.118520 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 05:14:53.118520 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 05:14:53.118520 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 05:14:53.118520 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 05:14:53.118520 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 05:14:53.118520 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 05:14:53.118520 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 05:14:53.118520 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d51a5b7d-90cb-4bd7-a258-22fd5a0df673 could not be found. Sep 23 05:14:53.118520 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:14:53.118520 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:14:53.118520 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:14:53.118520 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:14:53.118520 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:14:53.118520 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:14:53.118520 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:14:53.118520 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:14:53.118520 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:14:53.118520 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:14:53.118520 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 05:14:53.118520 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 05:14:53.118520 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 05:14:53.118520 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 05:14:53.118520 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 05:14:53.118520 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:14:53.118520 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d51a5b7d-90cb-4bd7-a258-22fd5a0df673 could not be found. Sep 23 05:14:53.118520 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:14:53.118520 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:14:53.118520 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:14:53.124155 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:14:53.124155 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:14:53.124155 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:14:53.124155 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:14:53.124155 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:14:53.124155 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d51a5b7d-90cb-4bd7-a258-22fd5a0df673 could not be found. Sep 23 05:14:53.124155 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:14:53.124155 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-53a2c0d1-7399-4de7-a27c-c746165536e3 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Returning 404 to user: Instance d51a5b7d-90cb-4bd7-a258-22fd5a0df673 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:14:53.124155 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-53a2c0d1-7399-4de7-a27c-c746165536e3 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/d51a5b7d-90cb-4bd7-a258-22fd5a0df673" status: 404 len: 111 microversion: 2.1 time: 0.031181 Sep 23 05:14:53.124155 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3506/6832] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:14:53 2022] GET /compute/v2.1/servers/d51a5b7d-90cb-4bd7-a258-22fd5a0df673 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 05:14:53.249961 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b3ebc0bb-6fbf-4840-a96a-963f276dce1b tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1741959877", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-63253902", "security_groups": [{"name": "tempest-secgroup-smoke-427164122"}], "block_device_mapping_v2": [{"uuid": "7f8703c2-6e49-418e-870f-0902dcea3a06", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4600129e-ae78-4842-a9e8-005f0a31ee9b"}]}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:14:53.379383 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.network.neutron [None req-b3ebc0bb-6fbf-4840-a96a-963f276dce1b tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] validate_networks() for [('4600129e-ae78-4842-a9e8-005f0a31ee9b', None, None, None, None, None)] {{(pid=122698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 05:14:53.806518 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-b3ebc0bb-6fbf-4840-a96a-963f276dce1b tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Flavor limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 05:14:53.807089 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-b3ebc0bb-6fbf-4840-a96a-963f276dce1b tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Image limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 05:14:53.807794 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-b3ebc0bb-6fbf-4840-a96a-963f276dce1b tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Flavor pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 05:14:53.808228 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-b3ebc0bb-6fbf-4840-a96a-963f276dce1b tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Image pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 05:14:53.808695 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-b3ebc0bb-6fbf-4840-a96a-963f276dce1b tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 05:14:53.818442 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b3ebc0bb-6fbf-4840-a96a-963f276dce1b tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:14:53.818957 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b3ebc0bb-6fbf-4840-a96a-963f276dce1b tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:14:53.819420 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b3ebc0bb-6fbf-4840-a96a-963f276dce1b tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:14:53.820172 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b3ebc0bb-6fbf-4840-a96a-963f276dce1b tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:14:53.820654 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b3ebc0bb-6fbf-4840-a96a-963f276dce1b tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:14:53.821106 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b3ebc0bb-6fbf-4840-a96a-963f276dce1b tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:14:53.839248 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-b3ebc0bb-6fbf-4840-a96a-963f276dce1b tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Getting quotas for project cceaa1e24146497fbf3f79cebc112211. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 05:14:53.845448 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-b3ebc0bb-6fbf-4840-a96a-963f276dce1b tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Getting quotas for user 0d55fe5072c14752846eb4ffc0eef91b and project cceaa1e24146497fbf3f79cebc112211. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 05:14:53.911383 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b3ebc0bb-6fbf-4840-a96a-963f276dce1b tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Going to run 1 instances... {{(pid=122698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 05:14:53.914032 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b3ebc0bb-6fbf-4840-a96a-963f276dce1b tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 9aded1fa-828e-4b24-9492-1ad1ea8ebfca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7f8703c2-6e49-418e-870f-0902dcea3a06',volume_size=None,volume_type=None)] {{(pid=122698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 05:14:54.411707 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b3ebc0bb-6fbf-4840-a96a-963f276dce1b tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.165808 Sep 23 05:14:54.417417 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3327/6833] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 05:14:53 2022] POST /compute/v2.1/servers => generated 405 bytes in 1172 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 05:14:54.425283 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ebcaac0f-952c-41f3-b03c-b46f3d97979e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:14:54.425283 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ebcaac0f-952c-41f3-b03c-b46f3d97979e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 9aded1fa-828e-4b24-9492-1ad1ea8ebfca] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:14:54.482261 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ebcaac0f-952c-41f3-b03c-b46f3d97979e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:14:54.490412 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ebcaac0f-952c-41f3-b03c-b46f3d97979e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/9aded1fa-828e-4b24-9492-1ad1ea8ebfca" status: 200 len: 1093 microversion: 2.1 time: 0.070409 Sep 23 05:14:54.497934 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3507/6834] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:14:54 2022] GET /compute/v2.1/servers/9aded1fa-828e-4b24-9492-1ad1ea8ebfca => generated 1093 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:14:55.514277 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-75d18fb6-4b6b-4b91-ad24-9d5467d04577 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:14:55.514951 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-75d18fb6-4b6b-4b91-ad24-9d5467d04577 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 9aded1fa-828e-4b24-9492-1ad1ea8ebfca] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:14:55.517024 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:14:55.521849 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-75d18fb6-4b6b-4b91-ad24-9d5467d04577 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:14:55.522386 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-75d18fb6-4b6b-4b91-ad24-9d5467d04577 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:14:55.522885 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-75d18fb6-4b6b-4b91-ad24-9d5467d04577 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:14:55.523600 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-75d18fb6-4b6b-4b91-ad24-9d5467d04577 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:14:55.524078 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-75d18fb6-4b6b-4b91-ad24-9d5467d04577 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:14:55.524526 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-75d18fb6-4b6b-4b91-ad24-9d5467d04577 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:14:55.528507 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=54,nova_cell1:INSERT=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:14:55.595557 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-75d18fb6-4b6b-4b91-ad24-9d5467d04577 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:14:55.605838 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-75d18fb6-4b6b-4b91-ad24-9d5467d04577 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/9aded1fa-828e-4b24-9492-1ad1ea8ebfca" status: 200 len: 1143 microversion: 2.1 time: 0.096644 Sep 23 05:14:55.606436 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3328/6835] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:14:55 2022] GET /compute/v2.1/servers/9aded1fa-828e-4b24-9492-1ad1ea8ebfca => generated 1143 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:14:56.633190 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3721566d-6577-4152-8ee5-57650cb0cd5e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:14:56.633803 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-3721566d-6577-4152-8ee5-57650cb0cd5e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 9aded1fa-828e-4b24-9492-1ad1ea8ebfca] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:14:56.643689 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3721566d-6577-4152-8ee5-57650cb0cd5e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:14:56.644376 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3721566d-6577-4152-8ee5-57650cb0cd5e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:14:56.645673 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3721566d-6577-4152-8ee5-57650cb0cd5e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:14:56.646696 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3721566d-6577-4152-8ee5-57650cb0cd5e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:14:56.647628 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3721566d-6577-4152-8ee5-57650cb0cd5e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:14:56.648443 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3721566d-6577-4152-8ee5-57650cb0cd5e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:14:56.731127 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-3721566d-6577-4152-8ee5-57650cb0cd5e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:14:56.743675 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3721566d-6577-4152-8ee5-57650cb0cd5e tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/9aded1fa-828e-4b24-9492-1ad1ea8ebfca" status: 200 len: 1199 microversion: 2.1 time: 0.115428 Sep 23 05:14:56.745149 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3508/6836] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:14:56 2022] GET /compute/v2.1/servers/9aded1fa-828e-4b24-9492-1ad1ea8ebfca => generated 1199 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:14:57.777939 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-080b95e0-822c-4f90-b440-c394e8da4b4c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:14:57.779782 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-080b95e0-822c-4f90-b440-c394e8da4b4c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 9aded1fa-828e-4b24-9492-1ad1ea8ebfca] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:14:57.789349 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-080b95e0-822c-4f90-b440-c394e8da4b4c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:14:57.790036 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-080b95e0-822c-4f90-b440-c394e8da4b4c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:14:57.790772 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-080b95e0-822c-4f90-b440-c394e8da4b4c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:14:57.791738 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-080b95e0-822c-4f90-b440-c394e8da4b4c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:14:57.793071 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-080b95e0-822c-4f90-b440-c394e8da4b4c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:14:57.793846 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-080b95e0-822c-4f90-b440-c394e8da4b4c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:14:57.998529 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-080b95e0-822c-4f90-b440-c394e8da4b4c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:14:58.008665 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-080b95e0-822c-4f90-b440-c394e8da4b4c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/9aded1fa-828e-4b24-9492-1ad1ea8ebfca" status: 200 len: 1276 microversion: 2.1 time: 0.244401 Sep 23 05:14:58.017828 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3329/6837] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:14:57 2022] GET /compute/v2.1/servers/9aded1fa-828e-4b24-9492-1ad1ea8ebfca => generated 1276 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:14:58.965421 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-025841c9-9daa-4a58-b12e-ec626bb8c635 req-4f47303d-e264-4484-bb66-c4fcd9d98e2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9aded1fa-828e-4b24-9492-1ad1ea8ebfca", "tag": "cc8e0cff-5468-4bb5-9da3-b06f41c72657"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:14:58.983963 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-025841c9-9daa-4a58-b12e-ec626bb8c635 req-4f47303d-e264-4484-bb66-c4fcd9d98e2d service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:14:58.984486 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-025841c9-9daa-4a58-b12e-ec626bb8c635 req-4f47303d-e264-4484-bb66-c4fcd9d98e2d service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:14:58.985138 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-025841c9-9daa-4a58-b12e-ec626bb8c635 req-4f47303d-e264-4484-bb66-c4fcd9d98e2d service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:14:58.997849 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-025841c9-9daa-4a58-b12e-ec626bb8c635 req-4f47303d-e264-4484-bb66-c4fcd9d98e2d service nova] Creating event network-changed:cc8e0cff-5468-4bb5-9da3-b06f41c72657 for instance 9aded1fa-828e-4b24-9492-1ad1ea8ebfca on n-h2-846463-3 Sep 23 05:14:59.004010 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-025841c9-9daa-4a58-b12e-ec626bb8c635 req-4f47303d-e264-4484-bb66-c4fcd9d98e2d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042180 Sep 23 05:14:59.005339 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3509/6838] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:14:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:14:59.035724 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-94f794e7-aa2f-4180-8f42-0feb5408153a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:14:59.036353 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-94f794e7-aa2f-4180-8f42-0feb5408153a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 9aded1fa-828e-4b24-9492-1ad1ea8ebfca] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:14:59.045459 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-94f794e7-aa2f-4180-8f42-0feb5408153a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:14:59.045774 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-94f794e7-aa2f-4180-8f42-0feb5408153a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:14:59.059726 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-94f794e7-aa2f-4180-8f42-0feb5408153a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:14:59.063388 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-94f794e7-aa2f-4180-8f42-0feb5408153a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:14:59.066594 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-94f794e7-aa2f-4180-8f42-0feb5408153a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:14:59.067126 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-94f794e7-aa2f-4180-8f42-0feb5408153a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:14:59.251439 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-94f794e7-aa2f-4180-8f42-0feb5408153a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:14:59.261466 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-94f794e7-aa2f-4180-8f42-0feb5408153a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/9aded1fa-828e-4b24-9492-1ad1ea8ebfca" status: 200 len: 1276 microversion: 2.1 time: 0.231025 Sep 23 05:14:59.262981 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3330/6839] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:14:59 2022] GET /compute/v2.1/servers/9aded1fa-828e-4b24-9492-1ad1ea8ebfca => generated 1276 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:15:00.289737 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9a3bfee2-eecd-470a-a4be-c75ecae735df tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:15:00.290662 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-9a3bfee2-eecd-470a-a4be-c75ecae735df tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 9aded1fa-828e-4b24-9492-1ad1ea8ebfca] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:15:00.298406 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9a3bfee2-eecd-470a-a4be-c75ecae735df tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:15:00.305098 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9a3bfee2-eecd-470a-a4be-c75ecae735df tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:15:00.305098 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9a3bfee2-eecd-470a-a4be-c75ecae735df tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:15:00.305098 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9a3bfee2-eecd-470a-a4be-c75ecae735df tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:15:00.305098 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9a3bfee2-eecd-470a-a4be-c75ecae735df tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:15:00.305098 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9a3bfee2-eecd-470a-a4be-c75ecae735df tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:15:00.445271 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-9a3bfee2-eecd-470a-a4be-c75ecae735df tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:15:00.453229 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-9a3bfee2-eecd-470a-a4be-c75ecae735df tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/9aded1fa-828e-4b24-9492-1ad1ea8ebfca" status: 200 len: 1276 microversion: 2.1 time: 0.168834 Sep 23 05:15:00.453813 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3510/6840] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:15:00 2022] GET /compute/v2.1/servers/9aded1fa-828e-4b24-9492-1ad1ea8ebfca => generated 1276 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:15:01.476950 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ccab2e6c-3b19-414c-8cca-79ae6f4c25e7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:15:01.478243 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-ccab2e6c-3b19-414c-8cca-79ae6f4c25e7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 9aded1fa-828e-4b24-9492-1ad1ea8ebfca] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:15:01.489996 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ccab2e6c-3b19-414c-8cca-79ae6f4c25e7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:15:01.490847 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ccab2e6c-3b19-414c-8cca-79ae6f4c25e7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:15:01.491518 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ccab2e6c-3b19-414c-8cca-79ae6f4c25e7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:15:01.492243 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ccab2e6c-3b19-414c-8cca-79ae6f4c25e7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:15:01.493012 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ccab2e6c-3b19-414c-8cca-79ae6f4c25e7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:15:01.493748 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ccab2e6c-3b19-414c-8cca-79ae6f4c25e7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:15:01.654878 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ccab2e6c-3b19-414c-8cca-79ae6f4c25e7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:15:01.663950 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ccab2e6c-3b19-414c-8cca-79ae6f4c25e7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/9aded1fa-828e-4b24-9492-1ad1ea8ebfca" status: 200 len: 1276 microversion: 2.1 time: 0.191080 Sep 23 05:15:01.664736 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3331/6841] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:15:01 2022] GET /compute/v2.1/servers/9aded1fa-828e-4b24-9492-1ad1ea8ebfca => generated 1276 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:15:02.688663 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-dd99efe0-8748-46d7-9e43-bd820a4aef88 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:15:02.689223 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-dd99efe0-8748-46d7-9e43-bd820a4aef88 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 9aded1fa-828e-4b24-9492-1ad1ea8ebfca] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:15:02.696787 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dd99efe0-8748-46d7-9e43-bd820a4aef88 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:15:02.697288 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dd99efe0-8748-46d7-9e43-bd820a4aef88 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:15:02.697767 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dd99efe0-8748-46d7-9e43-bd820a4aef88 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:15:02.698512 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dd99efe0-8748-46d7-9e43-bd820a4aef88 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:15:02.698977 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dd99efe0-8748-46d7-9e43-bd820a4aef88 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:15:02.699409 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dd99efe0-8748-46d7-9e43-bd820a4aef88 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:15:02.839645 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-dd99efe0-8748-46d7-9e43-bd820a4aef88 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:15:02.849019 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-dd99efe0-8748-46d7-9e43-bd820a4aef88 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/9aded1fa-828e-4b24-9492-1ad1ea8ebfca" status: 200 len: 1276 microversion: 2.1 time: 0.164778 Sep 23 05:15:02.849612 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3511/6842] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:15:02 2022] GET /compute/v2.1/servers/9aded1fa-828e-4b24-9492-1ad1ea8ebfca => generated 1276 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:15:03.872367 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-24c2d8a0-ea8f-416d-b0e8-cee224700fb5 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:15:03.872987 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-24c2d8a0-ea8f-416d-b0e8-cee224700fb5 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 9aded1fa-828e-4b24-9492-1ad1ea8ebfca] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:15:03.876206 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:15:03.876919 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=6 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:15:03.882701 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-24c2d8a0-ea8f-416d-b0e8-cee224700fb5 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:15:03.883436 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-24c2d8a0-ea8f-416d-b0e8-cee224700fb5 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:15:03.884078 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-24c2d8a0-ea8f-416d-b0e8-cee224700fb5 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:15:03.884798 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-24c2d8a0-ea8f-416d-b0e8-cee224700fb5 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:15:03.885536 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-24c2d8a0-ea8f-416d-b0e8-cee224700fb5 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:15:03.886006 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-24c2d8a0-ea8f-416d-b0e8-cee224700fb5 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:15:04.039048 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-24c2d8a0-ea8f-416d-b0e8-cee224700fb5 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:15:04.048829 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-24c2d8a0-ea8f-416d-b0e8-cee224700fb5 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/9aded1fa-828e-4b24-9492-1ad1ea8ebfca" status: 200 len: 1264 microversion: 2.1 time: 0.178990 Sep 23 05:15:04.048829 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3332/6843] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:15:03 2022] GET /compute/v2.1/servers/9aded1fa-828e-4b24-9492-1ad1ea8ebfca => generated 1264 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:15:05.073090 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3b95ea68-346f-424e-9fca-b393af1cfdfc tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:15:05.073651 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-3b95ea68-346f-424e-9fca-b393af1cfdfc tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 9aded1fa-828e-4b24-9492-1ad1ea8ebfca] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:15:05.075735 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:15:05.082714 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3b95ea68-346f-424e-9fca-b393af1cfdfc tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:15:05.083219 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3b95ea68-346f-424e-9fca-b393af1cfdfc tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:15:05.083666 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3b95ea68-346f-424e-9fca-b393af1cfdfc tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:15:05.084459 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3b95ea68-346f-424e-9fca-b393af1cfdfc tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:15:05.088630 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3b95ea68-346f-424e-9fca-b393af1cfdfc tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:15:05.088630 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3b95ea68-346f-424e-9fca-b393af1cfdfc tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:15:05.227785 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-3b95ea68-346f-424e-9fca-b393af1cfdfc tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:15:05.235658 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3b95ea68-346f-424e-9fca-b393af1cfdfc tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/9aded1fa-828e-4b24-9492-1ad1ea8ebfca" status: 200 len: 1264 microversion: 2.1 time: 0.166890 Sep 23 05:15:05.236436 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3512/6844] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:15:05 2022] GET /compute/v2.1/servers/9aded1fa-828e-4b24-9492-1ad1ea8ebfca => generated 1264 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:15:06.258553 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b85550e8-f5d1-4d2f-a116-4a571bccea2c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:15:06.273802 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b85550e8-f5d1-4d2f-a116-4a571bccea2c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 9aded1fa-828e-4b24-9492-1ad1ea8ebfca] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:15:06.273802 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b85550e8-f5d1-4d2f-a116-4a571bccea2c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:15:06.273802 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b85550e8-f5d1-4d2f-a116-4a571bccea2c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:15:06.273802 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b85550e8-f5d1-4d2f-a116-4a571bccea2c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:15:06.273802 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b85550e8-f5d1-4d2f-a116-4a571bccea2c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:15:06.273802 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b85550e8-f5d1-4d2f-a116-4a571bccea2c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:15:06.273802 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b85550e8-f5d1-4d2f-a116-4a571bccea2c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:15:06.411962 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b85550e8-f5d1-4d2f-a116-4a571bccea2c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:15:06.420595 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b85550e8-f5d1-4d2f-a116-4a571bccea2c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/9aded1fa-828e-4b24-9492-1ad1ea8ebfca" status: 200 len: 1264 microversion: 2.1 time: 0.165982 Sep 23 05:15:06.421199 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3333/6845] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:15:06 2022] GET /compute/v2.1/servers/9aded1fa-828e-4b24-9492-1ad1ea8ebfca => generated 1264 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:15:07.445500 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-163250f8-284c-45b7-b453-697bc95eba3f tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:15:07.446158 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-163250f8-284c-45b7-b453-697bc95eba3f tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 9aded1fa-828e-4b24-9492-1ad1ea8ebfca] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:15:07.452896 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-163250f8-284c-45b7-b453-697bc95eba3f tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:15:07.453403 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-163250f8-284c-45b7-b453-697bc95eba3f tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:15:07.454010 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-163250f8-284c-45b7-b453-697bc95eba3f tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:15:07.454737 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-163250f8-284c-45b7-b453-697bc95eba3f tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:15:07.455210 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-163250f8-284c-45b7-b453-697bc95eba3f tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:15:07.455640 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-163250f8-284c-45b7-b453-697bc95eba3f tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:15:07.609295 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-163250f8-284c-45b7-b453-697bc95eba3f tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:15:07.617867 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-163250f8-284c-45b7-b453-697bc95eba3f tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/9aded1fa-828e-4b24-9492-1ad1ea8ebfca" status: 200 len: 1264 microversion: 2.1 time: 0.177453 Sep 23 05:15:07.625709 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3513/6846] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:15:07 2022] GET /compute/v2.1/servers/9aded1fa-828e-4b24-9492-1ad1ea8ebfca => generated 1264 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:15:08.640904 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e3d9858c-d5a5-4ff6-aaf8-65af43e44651 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:15:08.641538 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e3d9858c-d5a5-4ff6-aaf8-65af43e44651 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 9aded1fa-828e-4b24-9492-1ad1ea8ebfca] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:15:08.648775 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e3d9858c-d5a5-4ff6-aaf8-65af43e44651 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:15:08.649293 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e3d9858c-d5a5-4ff6-aaf8-65af43e44651 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:15:08.649756 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e3d9858c-d5a5-4ff6-aaf8-65af43e44651 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:15:08.650532 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e3d9858c-d5a5-4ff6-aaf8-65af43e44651 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:15:08.651373 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e3d9858c-d5a5-4ff6-aaf8-65af43e44651 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:15:08.651942 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e3d9858c-d5a5-4ff6-aaf8-65af43e44651 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:15:08.801376 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e3d9858c-d5a5-4ff6-aaf8-65af43e44651 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:15:08.814502 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e3d9858c-d5a5-4ff6-aaf8-65af43e44651 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/9aded1fa-828e-4b24-9492-1ad1ea8ebfca" status: 200 len: 1264 microversion: 2.1 time: 0.177638 Sep 23 05:15:08.821572 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3334/6847] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:15:08 2022] GET /compute/v2.1/servers/9aded1fa-828e-4b24-9492-1ad1ea8ebfca => generated 1264 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:15:09.843194 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4984148f-20af-4fb1-8860-0112b9aaa89d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:15:09.846582 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4984148f-20af-4fb1-8860-0112b9aaa89d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 9aded1fa-828e-4b24-9492-1ad1ea8ebfca] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:15:09.853942 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4984148f-20af-4fb1-8860-0112b9aaa89d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:15:09.854498 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4984148f-20af-4fb1-8860-0112b9aaa89d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:15:09.855169 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4984148f-20af-4fb1-8860-0112b9aaa89d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:15:09.856377 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4984148f-20af-4fb1-8860-0112b9aaa89d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:15:09.857032 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4984148f-20af-4fb1-8860-0112b9aaa89d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:15:09.857721 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4984148f-20af-4fb1-8860-0112b9aaa89d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:15:10.023128 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-4984148f-20af-4fb1-8860-0112b9aaa89d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:15:10.031125 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4984148f-20af-4fb1-8860-0112b9aaa89d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/9aded1fa-828e-4b24-9492-1ad1ea8ebfca" status: 200 len: 1264 microversion: 2.1 time: 0.192088 Sep 23 05:15:10.032005 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3514/6848] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:15:09 2022] GET /compute/v2.1/servers/9aded1fa-828e-4b24-9492-1ad1ea8ebfca => generated 1264 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:15:11.055549 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8865098a-c76c-4ae3-83e0-e35f1bc6422f tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:15:11.056857 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8865098a-c76c-4ae3-83e0-e35f1bc6422f tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 9aded1fa-828e-4b24-9492-1ad1ea8ebfca] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:15:11.063774 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8865098a-c76c-4ae3-83e0-e35f1bc6422f tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:15:11.064282 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8865098a-c76c-4ae3-83e0-e35f1bc6422f tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:15:11.064739 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8865098a-c76c-4ae3-83e0-e35f1bc6422f tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:15:11.067344 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8865098a-c76c-4ae3-83e0-e35f1bc6422f tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:15:11.067879 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8865098a-c76c-4ae3-83e0-e35f1bc6422f tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:15:11.070903 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8865098a-c76c-4ae3-83e0-e35f1bc6422f tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:15:11.224423 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8865098a-c76c-4ae3-83e0-e35f1bc6422f tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:15:11.233462 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8865098a-c76c-4ae3-83e0-e35f1bc6422f tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/9aded1fa-828e-4b24-9492-1ad1ea8ebfca" status: 200 len: 1264 microversion: 2.1 time: 0.182850 Sep 23 05:15:11.234984 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3335/6849] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:15:11 2022] GET /compute/v2.1/servers/9aded1fa-828e-4b24-9492-1ad1ea8ebfca => generated 1264 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:15:12.261478 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b77225f1-b29c-47da-b5f0-6d8c5be3d65c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:15:12.262241 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b77225f1-b29c-47da-b5f0-6d8c5be3d65c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 9aded1fa-828e-4b24-9492-1ad1ea8ebfca] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:15:12.270394 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b77225f1-b29c-47da-b5f0-6d8c5be3d65c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:15:12.270972 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b77225f1-b29c-47da-b5f0-6d8c5be3d65c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:15:12.271488 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b77225f1-b29c-47da-b5f0-6d8c5be3d65c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:15:12.272285 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b77225f1-b29c-47da-b5f0-6d8c5be3d65c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:15:12.276472 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b77225f1-b29c-47da-b5f0-6d8c5be3d65c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:15:12.277282 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b77225f1-b29c-47da-b5f0-6d8c5be3d65c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:15:12.445921 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b77225f1-b29c-47da-b5f0-6d8c5be3d65c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:15:12.458428 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b77225f1-b29c-47da-b5f0-6d8c5be3d65c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/9aded1fa-828e-4b24-9492-1ad1ea8ebfca" status: 200 len: 1264 microversion: 2.1 time: 0.202484 Sep 23 05:15:12.459122 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3515/6850] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:15:12 2022] GET /compute/v2.1/servers/9aded1fa-828e-4b24-9492-1ad1ea8ebfca => generated 1264 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:15:13.088572 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-c2f93c35-fb02-4495-aceb-c360cc9668d8 req-0948005f-9ab3-4203-a2a1-48e413dd8076 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9aded1fa-828e-4b24-9492-1ad1ea8ebfca", "name": "network-vif-plugged", "status": "completed", "tag": "cc8e0cff-5468-4bb5-9da3-b06f41c72657"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:15:13.104233 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-c2f93c35-fb02-4495-aceb-c360cc9668d8 req-0948005f-9ab3-4203-a2a1-48e413dd8076 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:15:13.104847 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-c2f93c35-fb02-4495-aceb-c360cc9668d8 req-0948005f-9ab3-4203-a2a1-48e413dd8076 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:15:13.105518 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-c2f93c35-fb02-4495-aceb-c360cc9668d8 req-0948005f-9ab3-4203-a2a1-48e413dd8076 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:15:13.118280 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-c2f93c35-fb02-4495-aceb-c360cc9668d8 req-0948005f-9ab3-4203-a2a1-48e413dd8076 service nova] Creating event network-vif-plugged:cc8e0cff-5468-4bb5-9da3-b06f41c72657 for instance 9aded1fa-828e-4b24-9492-1ad1ea8ebfca on n-h2-846463-3 Sep 23 05:15:13.123915 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-c2f93c35-fb02-4495-aceb-c360cc9668d8 req-0948005f-9ab3-4203-a2a1-48e413dd8076 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041666 Sep 23 05:15:13.124797 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3336/6851] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:15:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:15:13.482970 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-81903b0f-e0d3-4eca-a2a7-93bab59492ca tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:15:13.483612 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-81903b0f-e0d3-4eca-a2a7-93bab59492ca tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 9aded1fa-828e-4b24-9492-1ad1ea8ebfca] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:15:13.486332 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:15:13.491562 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-81903b0f-e0d3-4eca-a2a7-93bab59492ca tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:15:13.492066 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-81903b0f-e0d3-4eca-a2a7-93bab59492ca tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:15:13.492509 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-81903b0f-e0d3-4eca-a2a7-93bab59492ca tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:15:13.493216 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-81903b0f-e0d3-4eca-a2a7-93bab59492ca tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:15:13.493862 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-81903b0f-e0d3-4eca-a2a7-93bab59492ca tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:15:13.494318 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-81903b0f-e0d3-4eca-a2a7-93bab59492ca tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:15:13.642580 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-81903b0f-e0d3-4eca-a2a7-93bab59492ca tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:15:13.645989 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:15:13.652433 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-81903b0f-e0d3-4eca-a2a7-93bab59492ca tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/9aded1fa-828e-4b24-9492-1ad1ea8ebfca" status: 200 len: 1264 microversion: 2.1 time: 0.174861 Sep 23 05:15:13.657407 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3516/6852] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:15:13 2022] GET /compute/v2.1/servers/9aded1fa-828e-4b24-9492-1ad1ea8ebfca => generated 1264 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:15:14.679172 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2e548feb-e9a1-4615-8cff-19bc44fea386 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:15:14.680094 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-2e548feb-e9a1-4615-8cff-19bc44fea386 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 9aded1fa-828e-4b24-9492-1ad1ea8ebfca] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:15:14.686436 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2e548feb-e9a1-4615-8cff-19bc44fea386 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:15:14.686945 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2e548feb-e9a1-4615-8cff-19bc44fea386 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:15:14.687408 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2e548feb-e9a1-4615-8cff-19bc44fea386 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:15:14.688123 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2e548feb-e9a1-4615-8cff-19bc44fea386 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:15:14.689144 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2e548feb-e9a1-4615-8cff-19bc44fea386 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:15:14.689762 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2e548feb-e9a1-4615-8cff-19bc44fea386 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:15:14.841171 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-2e548feb-e9a1-4615-8cff-19bc44fea386 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:15:14.849955 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2e548feb-e9a1-4615-8cff-19bc44fea386 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/9aded1fa-828e-4b24-9492-1ad1ea8ebfca" status: 200 len: 1452 microversion: 2.1 time: 0.177677 Sep 23 05:15:14.850576 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3337/6853] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:15:14 2022] GET /compute/v2.1/servers/9aded1fa-828e-4b24-9492-1ad1ea8ebfca => generated 1452 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:15:14.871839 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3b8653fd-b731-4888-8eea-d22aba8fed37 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:15:14.872462 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-3b8653fd-b731-4888-8eea-d22aba8fed37 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 9aded1fa-828e-4b24-9492-1ad1ea8ebfca] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:15:14.879989 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3b8653fd-b731-4888-8eea-d22aba8fed37 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:15:14.880487 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3b8653fd-b731-4888-8eea-d22aba8fed37 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:15:14.881128 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3b8653fd-b731-4888-8eea-d22aba8fed37 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:15:14.881841 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3b8653fd-b731-4888-8eea-d22aba8fed37 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:15:14.882336 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3b8653fd-b731-4888-8eea-d22aba8fed37 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:15:14.882782 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3b8653fd-b731-4888-8eea-d22aba8fed37 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:15:15.026179 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-3b8653fd-b731-4888-8eea-d22aba8fed37 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:15:15.034759 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3b8653fd-b731-4888-8eea-d22aba8fed37 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/9aded1fa-828e-4b24-9492-1ad1ea8ebfca" status: 200 len: 1452 microversion: 2.1 time: 0.166666 Sep 23 05:15:15.035380 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3517/6854] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:15:14 2022] GET /compute/v2.1/servers/9aded1fa-828e-4b24-9492-1ad1ea8ebfca => generated 1452 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:15:17.603841 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-c5cd6c99-749b-490e-a781-6a1a9fbeb8f3 req-70427858-2107-44ee-a573-f4643d08fb71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9aded1fa-828e-4b24-9492-1ad1ea8ebfca", "tag": "cc8e0cff-5468-4bb5-9da3-b06f41c72657"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:15:17.616188 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-c5cd6c99-749b-490e-a781-6a1a9fbeb8f3 req-70427858-2107-44ee-a573-f4643d08fb71 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:15:17.616637 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-c5cd6c99-749b-490e-a781-6a1a9fbeb8f3 req-70427858-2107-44ee-a573-f4643d08fb71 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:15:17.617122 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-c5cd6c99-749b-490e-a781-6a1a9fbeb8f3 req-70427858-2107-44ee-a573-f4643d08fb71 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:15:17.632313 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-c5cd6c99-749b-490e-a781-6a1a9fbeb8f3 req-70427858-2107-44ee-a573-f4643d08fb71 service nova] Creating event network-changed:cc8e0cff-5468-4bb5-9da3-b06f41c72657 for instance 9aded1fa-828e-4b24-9492-1ad1ea8ebfca on n-h2-846463-3 Sep 23 05:15:17.638724 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-c5cd6c99-749b-490e-a781-6a1a9fbeb8f3 req-70427858-2107-44ee-a573-f4643d08fb71 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.182365 Sep 23 05:15:17.639445 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3338/6855] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:15:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:15:35.853806 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f86097ae-1d23-42cd-a1b9-fb58ca629476 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-820521339", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:15:35.861412 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=3 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:15:35.862100 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=7 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:15:35.910390 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.neutron [None req-f86097ae-1d23-42cd-a1b9-fb58ca629476 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] validate_networks() for None {{(pid=122699) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 05:15:36.109148 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-f86097ae-1d23-42cd-a1b9-fb58ca629476 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Flavor limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 05:15:36.109579 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-f86097ae-1d23-42cd-a1b9-fb58ca629476 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Image limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 05:15:36.110108 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-f86097ae-1d23-42cd-a1b9-fb58ca629476 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Flavor pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 05:15:36.110528 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-f86097ae-1d23-42cd-a1b9-fb58ca629476 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Image pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 05:15:36.110948 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-f86097ae-1d23-42cd-a1b9-fb58ca629476 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 05:15:36.120780 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f86097ae-1d23-42cd-a1b9-fb58ca629476 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:15:36.121272 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f86097ae-1d23-42cd-a1b9-fb58ca629476 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:15:36.121719 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f86097ae-1d23-42cd-a1b9-fb58ca629476 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:15:36.122496 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f86097ae-1d23-42cd-a1b9-fb58ca629476 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:15:36.122969 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f86097ae-1d23-42cd-a1b9-fb58ca629476 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:15:36.123566 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f86097ae-1d23-42cd-a1b9-fb58ca629476 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:15:36.142671 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-f86097ae-1d23-42cd-a1b9-fb58ca629476 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Getting quotas for project fa1e011b93a64042b59b02f923feec87. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 05:15:36.149326 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-f86097ae-1d23-42cd-a1b9-fb58ca629476 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Getting quotas for user ed1313b2d4e54acf82a313e0b6441e5a and project fa1e011b93a64042b59b02f923feec87. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 05:15:36.162624 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f86097ae-1d23-42cd-a1b9-fb58ca629476 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Going to run 1 instances... {{(pid=122699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 05:15:36.165146 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f86097ae-1d23-42cd-a1b9-fb58ca629476 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] [instance: 3b669088-6b49-4c8f-ab6a-0cf72763876d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 05:15:36.264053 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f86097ae-1d23-42cd-a1b9-fb58ca629476 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.414682 Sep 23 05:15:36.265042 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3518/6856] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 05:15:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 416 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 05:15:36.276961 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-aac96187-a19b-4923-9bfb-78f3b80f1da7 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:15:36.279274 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-aac96187-a19b-4923-9bfb-78f3b80f1da7 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] [instance: 3b669088-6b49-4c8f-ab6a-0cf72763876d] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:15:36.283454 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=21 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:15:36.284311 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=57 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:15:36.345004 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-aac96187-a19b-4923-9bfb-78f3b80f1da7 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1313b2d4e54acf82a313e0b6441e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1e011b93a64042b59b02f923feec87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:15:36.353262 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-aac96187-a19b-4923-9bfb-78f3b80f1da7 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] 10.222.0.33 "GET /compute/v2.1/servers/3b669088-6b49-4c8f-ab6a-0cf72763876d" status: 200 len: 1214 microversion: 2.1 time: 0.080534 Sep 23 05:15:36.358265 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3339/6857] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:15:36 2022] GET /compute/v2.1/servers/3b669088-6b49-4c8f-ab6a-0cf72763876d => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:15:37.377175 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-bfeec44a-e7d5-4471-a34d-fb6245bf94b2 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:15:37.378684 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-bfeec44a-e7d5-4471-a34d-fb6245bf94b2 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] [instance: 3b669088-6b49-4c8f-ab6a-0cf72763876d] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:15:37.648043 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-bfeec44a-e7d5-4471-a34d-fb6245bf94b2 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1313b2d4e54acf82a313e0b6441e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1e011b93a64042b59b02f923feec87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:15:37.648043 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-bfeec44a-e7d5-4471-a34d-fb6245bf94b2 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] 10.222.0.33 "GET /compute/v2.1/servers/3b669088-6b49-4c8f-ab6a-0cf72763876d" status: 200 len: 1214 microversion: 2.1 time: 0.076590 Sep 23 05:15:37.648043 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3519/6858] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:15:37 2022] GET /compute/v2.1/servers/3b669088-6b49-4c8f-ab6a-0cf72763876d => generated 1214 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:15:38.472290 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f19ebd03-e493-4018-bc23-887c8a974346 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:15:38.473067 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f19ebd03-e493-4018-bc23-887c8a974346 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] [instance: 3b669088-6b49-4c8f-ab6a-0cf72763876d] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:15:38.480939 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f19ebd03-e493-4018-bc23-887c8a974346 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:15:38.481460 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f19ebd03-e493-4018-bc23-887c8a974346 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:15:38.482177 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f19ebd03-e493-4018-bc23-887c8a974346 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:15:38.483083 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f19ebd03-e493-4018-bc23-887c8a974346 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:15:38.483728 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f19ebd03-e493-4018-bc23-887c8a974346 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:15:38.484336 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f19ebd03-e493-4018-bc23-887c8a974346 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:15:38.552471 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f19ebd03-e493-4018-bc23-887c8a974346 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1313b2d4e54acf82a313e0b6441e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1e011b93a64042b59b02f923feec87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:15:38.560810 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f19ebd03-e493-4018-bc23-887c8a974346 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] 10.222.0.33 "GET /compute/v2.1/servers/3b669088-6b49-4c8f-ab6a-0cf72763876d" status: 200 len: 1266 microversion: 2.1 time: 0.092370 Sep 23 05:15:38.561930 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3340/6859] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:15:38 2022] GET /compute/v2.1/servers/3b669088-6b49-4c8f-ab6a-0cf72763876d => generated 1266 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:15:39.585727 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6bdd1111-fc02-49ea-9425-6a674e83ffac tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:15:39.586375 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-6bdd1111-fc02-49ea-9425-6a674e83ffac tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] [instance: 3b669088-6b49-4c8f-ab6a-0cf72763876d] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:15:39.593027 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6bdd1111-fc02-49ea-9425-6a674e83ffac tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:15:39.593532 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6bdd1111-fc02-49ea-9425-6a674e83ffac tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:15:39.594000 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6bdd1111-fc02-49ea-9425-6a674e83ffac tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:15:39.594717 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6bdd1111-fc02-49ea-9425-6a674e83ffac tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:15:39.595184 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6bdd1111-fc02-49ea-9425-6a674e83ffac tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:15:39.595613 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6bdd1111-fc02-49ea-9425-6a674e83ffac tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:15:39.666063 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-6bdd1111-fc02-49ea-9425-6a674e83ffac tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1313b2d4e54acf82a313e0b6441e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1e011b93a64042b59b02f923feec87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:15:39.674232 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6bdd1111-fc02-49ea-9425-6a674e83ffac tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] 10.222.0.33 "GET /compute/v2.1/servers/3b669088-6b49-4c8f-ab6a-0cf72763876d" status: 200 len: 1272 microversion: 2.1 time: 0.093431 Sep 23 05:15:39.677627 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3520/6860] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:15:39 2022] GET /compute/v2.1/servers/3b669088-6b49-4c8f-ab6a-0cf72763876d => generated 1272 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:15:40.697140 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-fbfbf277-d3b4-43d9-bb43-6b3662d9a22c tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:15:40.697766 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-fbfbf277-d3b4-43d9-bb43-6b3662d9a22c tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] [instance: 3b669088-6b49-4c8f-ab6a-0cf72763876d] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:15:40.704773 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fbfbf277-d3b4-43d9-bb43-6b3662d9a22c tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:15:40.705287 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fbfbf277-d3b4-43d9-bb43-6b3662d9a22c tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:15:40.705743 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fbfbf277-d3b4-43d9-bb43-6b3662d9a22c tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:15:40.706545 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fbfbf277-d3b4-43d9-bb43-6b3662d9a22c tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:15:40.707045 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fbfbf277-d3b4-43d9-bb43-6b3662d9a22c tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:15:40.707557 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fbfbf277-d3b4-43d9-bb43-6b3662d9a22c tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:15:40.862690 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-fbfbf277-d3b4-43d9-bb43-6b3662d9a22c tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1313b2d4e54acf82a313e0b6441e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1e011b93a64042b59b02f923feec87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:15:40.870683 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-fbfbf277-d3b4-43d9-bb43-6b3662d9a22c tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] 10.222.0.33 "GET /compute/v2.1/servers/3b669088-6b49-4c8f-ab6a-0cf72763876d" status: 200 len: 1314 microversion: 2.1 time: 0.177493 Sep 23 05:15:40.871399 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3341/6861] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:15:40 2022] GET /compute/v2.1/servers/3b669088-6b49-4c8f-ab6a-0cf72763876d => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:15:40.902033 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-ff7d6074-306e-4f74-9655-a4bbfa7818b6 req-2eaf2f39-4b9b-41ef-acd0-26f075003f11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b669088-6b49-4c8f-ab6a-0cf72763876d", "tag": "6fdd73fc-a6d6-4709-99c8-515e9f17d33d"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:15:40.921122 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-ff7d6074-306e-4f74-9655-a4bbfa7818b6 req-2eaf2f39-4b9b-41ef-acd0-26f075003f11 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:15:40.921613 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-ff7d6074-306e-4f74-9655-a4bbfa7818b6 req-2eaf2f39-4b9b-41ef-acd0-26f075003f11 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:15:40.922076 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-ff7d6074-306e-4f74-9655-a4bbfa7818b6 req-2eaf2f39-4b9b-41ef-acd0-26f075003f11 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:15:40.933687 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-ff7d6074-306e-4f74-9655-a4bbfa7818b6 req-2eaf2f39-4b9b-41ef-acd0-26f075003f11 service nova] Creating event network-changed:6fdd73fc-a6d6-4709-99c8-515e9f17d33d for instance 3b669088-6b49-4c8f-ab6a-0cf72763876d on n-h1-846463-3 Sep 23 05:15:40.938918 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-ff7d6074-306e-4f74-9655-a4bbfa7818b6 req-2eaf2f39-4b9b-41ef-acd0-26f075003f11 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040693 Sep 23 05:15:40.939788 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3521/6862] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:15:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:15:41.895165 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8eedc395-9783-42df-a773-dcbd6fd85fba tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:15:41.895792 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8eedc395-9783-42df-a773-dcbd6fd85fba tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] [instance: 3b669088-6b49-4c8f-ab6a-0cf72763876d] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:15:41.902719 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8eedc395-9783-42df-a773-dcbd6fd85fba tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:15:41.903214 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8eedc395-9783-42df-a773-dcbd6fd85fba tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:15:41.903663 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8eedc395-9783-42df-a773-dcbd6fd85fba tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:15:41.904392 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8eedc395-9783-42df-a773-dcbd6fd85fba tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:15:41.904863 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8eedc395-9783-42df-a773-dcbd6fd85fba tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:15:41.905309 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8eedc395-9783-42df-a773-dcbd6fd85fba tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:15:42.039196 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8eedc395-9783-42df-a773-dcbd6fd85fba tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1313b2d4e54acf82a313e0b6441e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1e011b93a64042b59b02f923feec87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:15:42.047182 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8eedc395-9783-42df-a773-dcbd6fd85fba tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] 10.222.0.33 "GET /compute/v2.1/servers/3b669088-6b49-4c8f-ab6a-0cf72763876d" status: 200 len: 1314 microversion: 2.1 time: 0.156452 Sep 23 05:15:42.047758 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3342/6863] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:15:41 2022] GET /compute/v2.1/servers/3b669088-6b49-4c8f-ab6a-0cf72763876d => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:15:43.072484 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b23a39fa-e814-4afb-bba6-8754d9f40e58 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:15:43.073191 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b23a39fa-e814-4afb-bba6-8754d9f40e58 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] [instance: 3b669088-6b49-4c8f-ab6a-0cf72763876d] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:15:43.079557 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b23a39fa-e814-4afb-bba6-8754d9f40e58 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:15:43.085601 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b23a39fa-e814-4afb-bba6-8754d9f40e58 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:15:43.085601 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b23a39fa-e814-4afb-bba6-8754d9f40e58 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:15:43.085601 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b23a39fa-e814-4afb-bba6-8754d9f40e58 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:15:43.085601 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b23a39fa-e814-4afb-bba6-8754d9f40e58 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:15:43.085601 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b23a39fa-e814-4afb-bba6-8754d9f40e58 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:15:43.211972 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b23a39fa-e814-4afb-bba6-8754d9f40e58 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1313b2d4e54acf82a313e0b6441e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1e011b93a64042b59b02f923feec87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:15:43.220094 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b23a39fa-e814-4afb-bba6-8754d9f40e58 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] 10.222.0.33 "GET /compute/v2.1/servers/3b669088-6b49-4c8f-ab6a-0cf72763876d" status: 200 len: 1314 microversion: 2.1 time: 0.152291 Sep 23 05:15:43.220602 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3522/6864] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:15:43 2022] GET /compute/v2.1/servers/3b669088-6b49-4c8f-ab6a-0cf72763876d => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:15:44.242849 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-86c83c49-ec71-4ff7-b122-3b32bb25a00c tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:15:44.243685 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-86c83c49-ec71-4ff7-b122-3b32bb25a00c tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] [instance: 3b669088-6b49-4c8f-ab6a-0cf72763876d] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:15:44.250672 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-86c83c49-ec71-4ff7-b122-3b32bb25a00c tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:15:44.251170 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-86c83c49-ec71-4ff7-b122-3b32bb25a00c tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:15:44.251623 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-86c83c49-ec71-4ff7-b122-3b32bb25a00c tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:15:44.252328 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-86c83c49-ec71-4ff7-b122-3b32bb25a00c tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:15:44.252799 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-86c83c49-ec71-4ff7-b122-3b32bb25a00c tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:15:44.253848 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-86c83c49-ec71-4ff7-b122-3b32bb25a00c tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:15:44.395864 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-86c83c49-ec71-4ff7-b122-3b32bb25a00c tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1313b2d4e54acf82a313e0b6441e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1e011b93a64042b59b02f923feec87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:15:44.414797 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-86c83c49-ec71-4ff7-b122-3b32bb25a00c tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] 10.222.0.33 "GET /compute/v2.1/servers/3b669088-6b49-4c8f-ab6a-0cf72763876d" status: 200 len: 1314 microversion: 2.1 time: 0.175767 Sep 23 05:15:44.415704 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3343/6865] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:15:44 2022] GET /compute/v2.1/servers/3b669088-6b49-4c8f-ab6a-0cf72763876d => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:15:45.438823 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a93e84c0-b6ab-40f4-b5ae-ae3dfab984fc tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:15:45.439540 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a93e84c0-b6ab-40f4-b5ae-ae3dfab984fc tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] [instance: 3b669088-6b49-4c8f-ab6a-0cf72763876d] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:15:45.446411 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a93e84c0-b6ab-40f4-b5ae-ae3dfab984fc tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:15:45.446912 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a93e84c0-b6ab-40f4-b5ae-ae3dfab984fc tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:15:45.447366 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a93e84c0-b6ab-40f4-b5ae-ae3dfab984fc tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:15:45.448178 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a93e84c0-b6ab-40f4-b5ae-ae3dfab984fc tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:15:45.448694 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a93e84c0-b6ab-40f4-b5ae-ae3dfab984fc tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:15:45.449253 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a93e84c0-b6ab-40f4-b5ae-ae3dfab984fc tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:15:45.590243 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a93e84c0-b6ab-40f4-b5ae-ae3dfab984fc tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1313b2d4e54acf82a313e0b6441e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1e011b93a64042b59b02f923feec87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:15:45.595081 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a93e84c0-b6ab-40f4-b5ae-ae3dfab984fc tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] 10.222.0.33 "GET /compute/v2.1/servers/3b669088-6b49-4c8f-ab6a-0cf72763876d" status: 200 len: 1314 microversion: 2.1 time: 0.160236 Sep 23 05:15:45.596060 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3523/6866] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:15:45 2022] GET /compute/v2.1/servers/3b669088-6b49-4c8f-ab6a-0cf72763876d => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:15:46.097791 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-ad99ace1-e9af-4382-9f42-224955f80001 req-261ceacb-24d4-49c8-940b-775cd3958536 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b669088-6b49-4c8f-ab6a-0cf72763876d", "name": "network-vif-plugged", "status": "completed", "tag": "6fdd73fc-a6d6-4709-99c8-515e9f17d33d"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:15:46.108483 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-ad99ace1-e9af-4382-9f42-224955f80001 req-261ceacb-24d4-49c8-940b-775cd3958536 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:15:46.109060 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-ad99ace1-e9af-4382-9f42-224955f80001 req-261ceacb-24d4-49c8-940b-775cd3958536 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:15:46.109588 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-ad99ace1-e9af-4382-9f42-224955f80001 req-261ceacb-24d4-49c8-940b-775cd3958536 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:15:46.121234 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-ad99ace1-e9af-4382-9f42-224955f80001 req-261ceacb-24d4-49c8-940b-775cd3958536 service nova] Creating event network-vif-plugged:6fdd73fc-a6d6-4709-99c8-515e9f17d33d for instance 3b669088-6b49-4c8f-ab6a-0cf72763876d on n-h1-846463-3 Sep 23 05:15:46.126858 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-ad99ace1-e9af-4382-9f42-224955f80001 req-261ceacb-24d4-49c8-940b-775cd3958536 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033342 Sep 23 05:15:46.127977 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3344/6867] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:15:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:15:46.618443 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9ca6ca1e-8e4b-4d4e-b4fc-3696d79bbb83 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:15:46.619058 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-9ca6ca1e-8e4b-4d4e-b4fc-3696d79bbb83 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] [instance: 3b669088-6b49-4c8f-ab6a-0cf72763876d] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:15:46.621122 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:15:46.626780 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9ca6ca1e-8e4b-4d4e-b4fc-3696d79bbb83 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:15:46.627308 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9ca6ca1e-8e4b-4d4e-b4fc-3696d79bbb83 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:15:46.627787 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9ca6ca1e-8e4b-4d4e-b4fc-3696d79bbb83 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:15:46.629066 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9ca6ca1e-8e4b-4d4e-b4fc-3696d79bbb83 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:15:46.629558 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9ca6ca1e-8e4b-4d4e-b4fc-3696d79bbb83 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:15:46.630069 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9ca6ca1e-8e4b-4d4e-b4fc-3696d79bbb83 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:15:46.761576 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-9ca6ca1e-8e4b-4d4e-b4fc-3696d79bbb83 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1313b2d4e54acf82a313e0b6441e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1e011b93a64042b59b02f923feec87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:15:46.770244 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-9ca6ca1e-8e4b-4d4e-b4fc-3696d79bbb83 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] 10.222.0.33 "GET /compute/v2.1/servers/3b669088-6b49-4c8f-ab6a-0cf72763876d" status: 200 len: 1314 microversion: 2.1 time: 0.155438 Sep 23 05:15:46.771693 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3524/6868] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:15:46 2022] GET /compute/v2.1/servers/3b669088-6b49-4c8f-ab6a-0cf72763876d => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:15:47.795424 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e4067c2b-1ee7-48a3-b2de-ed16d613eb60 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:15:47.796271 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e4067c2b-1ee7-48a3-b2de-ed16d613eb60 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] [instance: 3b669088-6b49-4c8f-ab6a-0cf72763876d] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:15:47.798902 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:15:47.805671 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e4067c2b-1ee7-48a3-b2de-ed16d613eb60 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:15:47.809142 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e4067c2b-1ee7-48a3-b2de-ed16d613eb60 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:15:47.809142 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e4067c2b-1ee7-48a3-b2de-ed16d613eb60 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:15:47.809142 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e4067c2b-1ee7-48a3-b2de-ed16d613eb60 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:15:47.809142 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e4067c2b-1ee7-48a3-b2de-ed16d613eb60 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:15:47.809142 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e4067c2b-1ee7-48a3-b2de-ed16d613eb60 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:15:47.961067 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e4067c2b-1ee7-48a3-b2de-ed16d613eb60 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1313b2d4e54acf82a313e0b6441e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1e011b93a64042b59b02f923feec87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:15:47.969517 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e4067c2b-1ee7-48a3-b2de-ed16d613eb60 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] 10.222.0.33 "GET /compute/v2.1/servers/3b669088-6b49-4c8f-ab6a-0cf72763876d" status: 200 len: 1464 microversion: 2.1 time: 0.178704 Sep 23 05:15:47.970211 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3345/6869] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:15:47 2022] GET /compute/v2.1/servers/3b669088-6b49-4c8f-ab6a-0cf72763876d => generated 1464 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:15:48.027644 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e84010e8-b155-4cdc-834b-a2c6bbb3ae85 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:15:48.027644 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e84010e8-b155-4cdc-834b-a2c6bbb3ae85 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] [instance: 3b669088-6b49-4c8f-ab6a-0cf72763876d] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:15:48.028650 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=8 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:15:48.034000 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e84010e8-b155-4cdc-834b-a2c6bbb3ae85 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:15:48.035105 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e84010e8-b155-4cdc-834b-a2c6bbb3ae85 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:15:48.035557 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e84010e8-b155-4cdc-834b-a2c6bbb3ae85 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:15:48.036310 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e84010e8-b155-4cdc-834b-a2c6bbb3ae85 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:15:48.036781 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e84010e8-b155-4cdc-834b-a2c6bbb3ae85 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:15:48.037220 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e84010e8-b155-4cdc-834b-a2c6bbb3ae85 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:15:48.062495 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e84010e8-b155-4cdc-834b-a2c6bbb3ae85 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] [instance: 3b669088-6b49-4c8f-ab6a-0cf72763876d] Going to try to terminate instance {{(pid=122699) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 05:15:48.370525 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e84010e8-b155-4cdc-834b-a2c6bbb3ae85 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] 10.222.0.33 "DELETE /compute/v2.1/servers/3b669088-6b49-4c8f-ab6a-0cf72763876d" status: 204 len: 0 microversion: 2.1 time: 0.348038 Sep 23 05:15:48.375371 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3525/6870] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 05:15:48 2022] DELETE /compute/v2.1/servers/3b669088-6b49-4c8f-ab6a-0cf72763876d => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 05:15:48.379523 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1a4a06f0-8314-45ab-a2c9-c64bec29cc37 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:15:48.380212 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-1a4a06f0-8314-45ab-a2c9-c64bec29cc37 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] [instance: 3b669088-6b49-4c8f-ab6a-0cf72763876d] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:15:48.386686 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1a4a06f0-8314-45ab-a2c9-c64bec29cc37 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:15:48.387214 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1a4a06f0-8314-45ab-a2c9-c64bec29cc37 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:15:48.387684 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1a4a06f0-8314-45ab-a2c9-c64bec29cc37 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:15:48.388719 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1a4a06f0-8314-45ab-a2c9-c64bec29cc37 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:15:48.389200 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1a4a06f0-8314-45ab-a2c9-c64bec29cc37 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:15:48.389653 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1a4a06f0-8314-45ab-a2c9-c64bec29cc37 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:15:48.529530 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-1a4a06f0-8314-45ab-a2c9-c64bec29cc37 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1313b2d4e54acf82a313e0b6441e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1e011b93a64042b59b02f923feec87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:15:48.538303 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-1a4a06f0-8314-45ab-a2c9-c64bec29cc37 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] 10.222.0.33 "GET /compute/v2.1/servers/3b669088-6b49-4c8f-ab6a-0cf72763876d" status: 200 len: 1470 microversion: 2.1 time: 0.162787 Sep 23 05:15:48.539096 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3346/6871] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:15:48 2022] GET /compute/v2.1/servers/3b669088-6b49-4c8f-ab6a-0cf72763876d => generated 1470 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:15:49.561292 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e0c35dd1-6b78-4cc1-b999-c3c6809c7c65 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:15:49.561955 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e0c35dd1-6b78-4cc1-b999-c3c6809c7c65 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] [instance: 3b669088-6b49-4c8f-ab6a-0cf72763876d] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:15:49.568901 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e0c35dd1-6b78-4cc1-b999-c3c6809c7c65 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:15:49.569395 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e0c35dd1-6b78-4cc1-b999-c3c6809c7c65 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:15:49.569835 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e0c35dd1-6b78-4cc1-b999-c3c6809c7c65 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:15:49.570558 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e0c35dd1-6b78-4cc1-b999-c3c6809c7c65 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:15:49.571018 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e0c35dd1-6b78-4cc1-b999-c3c6809c7c65 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:15:49.571449 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e0c35dd1-6b78-4cc1-b999-c3c6809c7c65 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:15:49.718061 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e0c35dd1-6b78-4cc1-b999-c3c6809c7c65 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1313b2d4e54acf82a313e0b6441e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1e011b93a64042b59b02f923feec87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:15:49.724438 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e0c35dd1-6b78-4cc1-b999-c3c6809c7c65 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] 10.222.0.33 "GET /compute/v2.1/servers/3b669088-6b49-4c8f-ab6a-0cf72763876d" status: 200 len: 1470 microversion: 2.1 time: 0.167420 Sep 23 05:15:49.725028 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3526/6872] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:15:49 2022] GET /compute/v2.1/servers/3b669088-6b49-4c8f-ab6a-0cf72763876d => generated 1470 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:15:50.313214 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-fed35a1e-29c7-4859-bbb4-0c7605517e4c req-643d72c1-6561-4de6-bd85-750910223b50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b669088-6b49-4c8f-ab6a-0cf72763876d", "name": "network-vif-deleted", "tag": "6fdd73fc-a6d6-4709-99c8-515e9f17d33d"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:15:50.326481 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-fed35a1e-29c7-4859-bbb4-0c7605517e4c req-643d72c1-6561-4de6-bd85-750910223b50 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:15:50.327252 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-fed35a1e-29c7-4859-bbb4-0c7605517e4c req-643d72c1-6561-4de6-bd85-750910223b50 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:15:50.328101 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-fed35a1e-29c7-4859-bbb4-0c7605517e4c req-643d72c1-6561-4de6-bd85-750910223b50 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:15:50.342935 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-fed35a1e-29c7-4859-bbb4-0c7605517e4c req-643d72c1-6561-4de6-bd85-750910223b50 service nova] Creating event network-vif-deleted:6fdd73fc-a6d6-4709-99c8-515e9f17d33d for instance 3b669088-6b49-4c8f-ab6a-0cf72763876d on n-h1-846463-3 Sep 23 05:15:50.348743 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-fed35a1e-29c7-4859-bbb4-0c7605517e4c req-643d72c1-6561-4de6-bd85-750910223b50 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039570 Sep 23 05:15:50.349698 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3347/6873] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:15:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:15:50.747540 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-766a08eb-73c6-42ef-a9d7-c8e7cb3bb0f6 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:15:50.748159 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-766a08eb-73c6-42ef-a9d7-c8e7cb3bb0f6 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] [instance: 3b669088-6b49-4c8f-ab6a-0cf72763876d] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:15:50.756174 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-766a08eb-73c6-42ef-a9d7-c8e7cb3bb0f6 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:15:50.756671 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-766a08eb-73c6-42ef-a9d7-c8e7cb3bb0f6 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:15:50.758219 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-766a08eb-73c6-42ef-a9d7-c8e7cb3bb0f6 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:15:50.758219 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-766a08eb-73c6-42ef-a9d7-c8e7cb3bb0f6 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:15:50.758428 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-766a08eb-73c6-42ef-a9d7-c8e7cb3bb0f6 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:15:50.758706 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-766a08eb-73c6-42ef-a9d7-c8e7cb3bb0f6 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:15:50.790733 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-766a08eb-73c6-42ef-a9d7-c8e7cb3bb0f6 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:15:50.791229 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-766a08eb-73c6-42ef-a9d7-c8e7cb3bb0f6 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:15:50.791668 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-766a08eb-73c6-42ef-a9d7-c8e7cb3bb0f6 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:15:50.792121 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-766a08eb-73c6-42ef-a9d7-c8e7cb3bb0f6 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Lazy-loading 'fault' on Instance uuid 3b669088-6b49-4c8f-ab6a-0cf72763876d {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 05:15:50.832446 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-766a08eb-73c6-42ef-a9d7-c8e7cb3bb0f6 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1313b2d4e54acf82a313e0b6441e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa1e011b93a64042b59b02f923feec87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:15:50.840084 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-766a08eb-73c6-42ef-a9d7-c8e7cb3bb0f6 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] 10.222.0.33 "GET /compute/v2.1/servers/3b669088-6b49-4c8f-ab6a-0cf72763876d" status: 200 len: 1304 microversion: 2.1 time: 0.096511 Sep 23 05:15:50.840655 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3527/6874] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:15:50 2022] GET /compute/v2.1/servers/3b669088-6b49-4c8f-ab6a-0cf72763876d => generated 1304 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:15:51.864436 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-33a54402-bf6e-4689-913c-2b931a54b732 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:15:51.865188 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-33a54402-bf6e-4689-913c-2b931a54b732 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] [instance: 3b669088-6b49-4c8f-ab6a-0cf72763876d] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:15:51.871551 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-33a54402-bf6e-4689-913c-2b931a54b732 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:15:51.872061 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-33a54402-bf6e-4689-913c-2b931a54b732 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:15:51.872523 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-33a54402-bf6e-4689-913c-2b931a54b732 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:15:51.873240 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-33a54402-bf6e-4689-913c-2b931a54b732 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:15:51.873722 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-33a54402-bf6e-4689-913c-2b931a54b732 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:15:51.874198 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-33a54402-bf6e-4689-913c-2b931a54b732 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:15:51.888512 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-33a54402-bf6e-4689-913c-2b931a54b732 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] HTTP exception thrown: Instance 3b669088-6b49-4c8f-ab6a-0cf72763876d could not be found. Sep 23 05:15:51.890227 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-33a54402-bf6e-4689-913c-2b931a54b732 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Request method failure captured: Sep 23 05:15:51.890227 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/3b669088-6b49-4c8f-ab6a-0cf72763876d HTTP/1.1 Sep 23 05:15:51.890227 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 05:15:51.890227 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 05:15:51.890227 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 05:15:51.890227 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 05:15:51.890227 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 05:15:51.890227 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 05:15:51.890227 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 05:15:51.890227 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 05:15:51.890227 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLUD0s96eZFOJH0z1pezfKaJ_7dalPA45Ni-nOmNlcVAnZcjQB7pHmqDdgeXr7ZW0659TkWbhSbxuEu25AXdEtmclnxGrCcOcjFDr52XU83h4akJjsu9TrcYqmPa1I_biGg4_uyLbSfxWiVWj-3wdRodO0AVEaU0e5k-N9PntjbQOEjo Sep 23 05:15:51.890227 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 05:15:51.890227 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 05:15:51.890227 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 05:15:51.890227 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 05:15:51.890227 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 05:15:51.890227 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 05:15:51.890227 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: fa1e011b93a64042b59b02f923feec87 Sep 23 05:15:51.890227 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-VolumesNegativeTest-2135568335 Sep 23 05:15:51.890227 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 05:15:51.890227 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 05:15:51.890227 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fa1e011b93a64042b59b02f923feec87", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fa1e011b93a64042b59b02f923feec87"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fa1e011b93a64042b59b02f923feec87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fa1e011b93a64042b59b02f923feec87"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:15:51.890227 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-VolumesNegativeTest-2135568335 Sep 23 05:15:51.890227 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: fa1e011b93a64042b59b02f923feec87 Sep 23 05:15:51.890227 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-VolumesNegativeTest-2135568335 Sep 23 05:15:51.890227 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-VolumesNegativeTest-2135568335-project Sep 23 05:15:51.890227 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 05:15:51.890227 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 05:15:51.890227 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: ed1313b2d4e54acf82a313e0b6441e5a Sep 23 05:15:51.890227 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-VolumesNegativeTest-2135568335-project Sep 23 05:15:51.890227 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 05:15:51.890227 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 3b669088-6b49-4c8f-ab6a-0cf72763876d could not be found. Sep 23 05:15:51.890227 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '3b669088-6b49-4c8f-ab6a-0cf72763876d'} Sep 23 05:15:51.890227 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:15:51.890227 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:15:51.890227 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 05:15:51.890227 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 05:15:51.890227 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 05:15:51.890227 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 05:15:51.890227 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 05:15:51.890227 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 05:15:51.890227 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 05:15:51.890227 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 05:15:51.890227 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b669088-6b49-4c8f-ab6a-0cf72763876d could not be found. Sep 23 05:15:51.890227 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:15:51.890227 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:15:51.890227 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:15:51.890227 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:15:51.890227 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:15:51.890227 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:15:51.890227 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:15:51.890227 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:15:51.890227 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:15:51.890227 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:15:51.890227 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 05:15:51.890227 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 05:15:51.890227 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 05:15:51.890227 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 05:15:51.890227 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 05:15:51.890227 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:15:51.890227 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b669088-6b49-4c8f-ab6a-0cf72763876d could not be found. Sep 23 05:15:51.890227 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:15:51.890227 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:15:51.890227 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:15:51.897192 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:15:51.897192 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:15:51.897192 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:15:51.897192 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:15:51.897192 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:15:51.897192 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b669088-6b49-4c8f-ab6a-0cf72763876d could not be found. Sep 23 05:15:51.897192 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:15:51.897192 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-33a54402-bf6e-4689-913c-2b931a54b732 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] Returning 404 to user: Instance 3b669088-6b49-4c8f-ab6a-0cf72763876d could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:15:51.897192 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-33a54402-bf6e-4689-913c-2b931a54b732 tempest-VolumesNegativeTest-2135568335 tempest-VolumesNegativeTest-2135568335-project] 10.222.0.33 "GET /compute/v2.1/servers/3b669088-6b49-4c8f-ab6a-0cf72763876d" status: 404 len: 111 microversion: 2.1 time: 0.032504 Sep 23 05:15:51.897192 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3348/6875] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:15:51 2022] GET /compute/v2.1/servers/3b669088-6b49-4c8f-ab6a-0cf72763876d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 05:16:28.412013 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:16:28.418532 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:16:28.418532 n-d-846463-3 devstack@n-api.service[122699]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 05:16:28.418532 n-d-846463-3 devstack@n-api.service[122699]: Fri Sep 23 05:16:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-aggregates (ip 10.222.0.33) !!! Sep 23 05:16:28.558691 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0c634587-81d5-48b5-9355-86068a4c983b tempest-TestAggregatesBasicOps-81187397 tempest-TestAggregatesBasicOps-81187397-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-920584993", "availability_zone": "foo_zone"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:16:28.563204 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.aggregate [None req-0c634587-81d5-48b5-9355-86068a4c983b tempest-TestAggregatesBasicOps-81187397 tempest-TestAggregatesBasicOps-81187397-project-admin] Generated uuid aa50a7c3-857d-4d83-97bf-7b4f5046dbb7 for aggregate {{(pid=122699) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 23 05:16:28.659542 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0c634587-81d5-48b5-9355-86068a4c983b tempest-TestAggregatesBasicOps-81187397 tempest-TestAggregatesBasicOps-81187397-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 208 microversion: 2.1 time: 0.256002 Sep 23 05:16:28.660348 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3528/6876] 10.222.0.33 () {60 vars in 1164 bytes} [Fri Sep 23 05:16:28 2022] POST /compute/v2.1/os-aggregates => generated 208 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 05:16:28.673452 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-28da7338-aadd-4e46-b3df-ab3c1e1fd302 tempest-TestAggregatesBasicOps-81187397 tempest-TestAggregatesBasicOps-81187397-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:16:28.682016 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=22 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:16:28.682958 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=42 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:16:28.831133 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-28da7338-aadd-4e46-b3df-ab3c1e1fd302 tempest-TestAggregatesBasicOps-81187397 tempest-TestAggregatesBasicOps-81187397-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 318 microversion: 2.1 time: 0.162525 Sep 23 05:16:28.831920 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3349/6877] 10.222.0.33 () {60 vars in 1194 bytes} [Fri Sep 23 05:16:28 2022] POST /compute/v2.1/os-aggregates/19/action => generated 318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:16:28.847931 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e2eb6e84-8718-40e7-ba97-8fb70fed273b tempest-TestAggregatesBasicOps-81187397 tempest-TestAggregatesBasicOps-81187397-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:16:28.852133 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e2eb6e84-8718-40e7-ba97-8fb70fed273b tempest-TestAggregatesBasicOps-81187397 tempest-TestAggregatesBasicOps-81187397-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:16:28.852711 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e2eb6e84-8718-40e7-ba97-8fb70fed273b tempest-TestAggregatesBasicOps-81187397 tempest-TestAggregatesBasicOps-81187397-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:16:28.853159 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e2eb6e84-8718-40e7-ba97-8fb70fed273b tempest-TestAggregatesBasicOps-81187397 tempest-TestAggregatesBasicOps-81187397-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:16:28.853921 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e2eb6e84-8718-40e7-ba97-8fb70fed273b tempest-TestAggregatesBasicOps-81187397 tempest-TestAggregatesBasicOps-81187397-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:16:28.854393 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e2eb6e84-8718-40e7-ba97-8fb70fed273b tempest-TestAggregatesBasicOps-81187397 tempest-TestAggregatesBasicOps-81187397-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:16:28.854981 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e2eb6e84-8718-40e7-ba97-8fb70fed273b tempest-TestAggregatesBasicOps-81187397 tempest-TestAggregatesBasicOps-81187397-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:16:28.883760 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e2eb6e84-8718-40e7-ba97-8fb70fed273b tempest-TestAggregatesBasicOps-81187397 tempest-TestAggregatesBasicOps-81187397-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.043719 Sep 23 05:16:28.884390 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3529/6878] 10.222.0.33 () {58 vars in 1176 bytes} [Fri Sep 23 05:16:28 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:16:28.897217 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-eec9c60d-e37d-4556-b659-fa23bb97dcc9 tempest-TestAggregatesBasicOps-81187397 tempest-TestAggregatesBasicOps-81187397-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:16:28.913188 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-eec9c60d-e37d-4556-b659-fa23bb97dcc9 tempest-TestAggregatesBasicOps-81187397 tempest-TestAggregatesBasicOps-81187397-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates" status: 200 len: 297 microversion: 2.1 time: 0.019740 Sep 23 05:16:28.913788 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3350/6879] 10.222.0.33 () {58 vars in 1143 bytes} [Fri Sep 23 05:16:28 2022] GET /compute/v2.1/os-aggregates => generated 297 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:16:28.927068 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4b494d2b-a83f-4834-b2a7-b76f41cbdcd9 tempest-TestAggregatesBasicOps-81187397 tempest-TestAggregatesBasicOps-81187397-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-846463-3"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:16:28.938474 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4b494d2b-a83f-4834-b2a7-b76f41cbdcd9 tempest-TestAggregatesBasicOps-81187397 tempest-TestAggregatesBasicOps-81187397-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:16:28.939023 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4b494d2b-a83f-4834-b2a7-b76f41cbdcd9 tempest-TestAggregatesBasicOps-81187397 tempest-TestAggregatesBasicOps-81187397-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:16:28.939500 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4b494d2b-a83f-4834-b2a7-b76f41cbdcd9 tempest-TestAggregatesBasicOps-81187397 tempest-TestAggregatesBasicOps-81187397-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:16:29.429878 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4b494d2b-a83f-4834-b2a7-b76f41cbdcd9 tempest-TestAggregatesBasicOps-81187397 tempest-TestAggregatesBasicOps-81187397-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 309 microversion: 2.1 time: 0.507507 Sep 23 05:16:29.430848 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3530/6880] 10.222.0.33 () {60 vars in 1194 bytes} [Fri Sep 23 05:16:28 2022] POST /compute/v2.1/os-aggregates/19/action => generated 309 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 05:16:29.445291 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-edde6dbd-2933-47d0-8a24-5550fd8850cd tempest-TestAggregatesBasicOps-81187397 tempest-TestAggregatesBasicOps-81187397-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:16:29.456621 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-edde6dbd-2933-47d0-8a24-5550fd8850cd tempest-TestAggregatesBasicOps-81187397 tempest-TestAggregatesBasicOps-81187397-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 309 microversion: 2.1 time: 0.014872 Sep 23 05:16:29.457746 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3351/6881] 10.222.0.33 () {58 vars in 1152 bytes} [Fri Sep 23 05:16:29 2022] GET /compute/v2.1/os-aggregates/19 => generated 309 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:16:29.470636 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8a019c8b-bf52-436f-8257-1d868c43672c tempest-TestAggregatesBasicOps-81187397 tempest-TestAggregatesBasicOps-81187397-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-204635911", "availability_zone": "foo_zone"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:16:29.594206 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-8a019c8b-bf52-436f-8257-1d868c43672c tempest-TestAggregatesBasicOps-81187397 tempest-TestAggregatesBasicOps-81187397-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 341 microversion: 2.1 time: 0.127822 Sep 23 05:16:29.595419 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3531/6882] 10.222.0.33 () {60 vars in 1173 bytes} [Fri Sep 23 05:16:29 2022] PUT /compute/v2.1/os-aggregates/19 => generated 341 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 05:16:29.607918 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-29855e5b-7036-4acc-ae1a-c14eacf4ffa5 tempest-TestAggregatesBasicOps-81187397 tempest-TestAggregatesBasicOps-81187397-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:16:29.718528 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-29855e5b-7036-4acc-ae1a-c14eacf4ffa5 tempest-TestAggregatesBasicOps-81187397 tempest-TestAggregatesBasicOps-81187397-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 355 microversion: 2.1 time: 0.115092 Sep 23 05:16:29.726210 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3352/6883] 10.222.0.33 () {60 vars in 1194 bytes} [Fri Sep 23 05:16:29 2022] POST /compute/v2.1/os-aggregates/19/action => generated 355 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:16:29.738628 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c52b2e99-cae5-44fc-a3d4-a741e30a8f0f tempest-TestAggregatesBasicOps-81187397 tempest-TestAggregatesBasicOps-81187397-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:16:29.760181 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c52b2e99-cae5-44fc-a3d4-a741e30a8f0f tempest-TestAggregatesBasicOps-81187397 tempest-TestAggregatesBasicOps-81187397-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 355 microversion: 2.1 time: 0.026395 Sep 23 05:16:29.760972 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3532/6884] 10.222.0.33 () {58 vars in 1152 bytes} [Fri Sep 23 05:16:29 2022] GET /compute/v2.1/os-aggregates/19 => generated 355 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:16:29.773683 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c2c6b0ef-77a1-4e4b-9af6-b4494cb13764 tempest-TestAggregatesBasicOps-81187397 tempest-TestAggregatesBasicOps-81187397-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-846463-3"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:16:29.786670 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c2c6b0ef-77a1-4e4b-9af6-b4494cb13764 tempest-TestAggregatesBasicOps-81187397 tempest-TestAggregatesBasicOps-81187397-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:16:29.787189 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c2c6b0ef-77a1-4e4b-9af6-b4494cb13764 tempest-TestAggregatesBasicOps-81187397 tempest-TestAggregatesBasicOps-81187397-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:16:29.787777 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c2c6b0ef-77a1-4e4b-9af6-b4494cb13764 tempest-TestAggregatesBasicOps-81187397 tempest-TestAggregatesBasicOps-81187397-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:16:30.123855 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c2c6b0ef-77a1-4e4b-9af6-b4494cb13764 tempest-TestAggregatesBasicOps-81187397 tempest-TestAggregatesBasicOps-81187397-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 340 microversion: 2.1 time: 0.353958 Sep 23 05:16:30.124752 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3353/6885] 10.222.0.33 () {60 vars in 1194 bytes} [Fri Sep 23 05:16:29 2022] POST /compute/v2.1/os-aggregates/19/action => generated 340 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:16:30.136631 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-cb45865b-b85e-44fa-b398-e5ceafe2bf30 tempest-TestAggregatesBasicOps-81187397 tempest-TestAggregatesBasicOps-81187397-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:16:30.238104 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-cb45865b-b85e-44fa-b398-e5ceafe2bf30 tempest-TestAggregatesBasicOps-81187397 tempest-TestAggregatesBasicOps-81187397-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.103602 Sep 23 05:16:30.238970 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3533/6886] 10.222.0.33 () {58 vars in 1155 bytes} [Fri Sep 23 05:16:30 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 23 05:17:59.319348 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=4 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:17:59.320139 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=20,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:17:59.326555 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-93dfb9ef-b1e0-406d-9ed9-e9fbc1a39f59 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-584337393", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-63253902", "security_groups": [{"name": "tempest-secgroup-smoke-427164122"}], "block_device_mapping_v2": [{"uuid": "bfb12b99-bfe2-4fae-b576-dcb190422be6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4600129e-ae78-4842-a9e8-005f0a31ee9b"}]}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:17:59.586492 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.network.neutron [None req-93dfb9ef-b1e0-406d-9ed9-e9fbc1a39f59 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] validate_networks() for [('4600129e-ae78-4842-a9e8-005f0a31ee9b', None, None, None, None, None)] {{(pid=122698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 05:18:00.025178 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-93dfb9ef-b1e0-406d-9ed9-e9fbc1a39f59 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Flavor limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 05:18:00.025634 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-93dfb9ef-b1e0-406d-9ed9-e9fbc1a39f59 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Image limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 05:18:00.026161 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-93dfb9ef-b1e0-406d-9ed9-e9fbc1a39f59 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Flavor pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 05:18:00.026586 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-93dfb9ef-b1e0-406d-9ed9-e9fbc1a39f59 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Image pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 05:18:00.028083 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-93dfb9ef-b1e0-406d-9ed9-e9fbc1a39f59 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 05:18:00.036808 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-93dfb9ef-b1e0-406d-9ed9-e9fbc1a39f59 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:18:00.037295 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-93dfb9ef-b1e0-406d-9ed9-e9fbc1a39f59 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:18:00.037743 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-93dfb9ef-b1e0-406d-9ed9-e9fbc1a39f59 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:18:00.038516 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-93dfb9ef-b1e0-406d-9ed9-e9fbc1a39f59 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:18:00.038986 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-93dfb9ef-b1e0-406d-9ed9-e9fbc1a39f59 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:18:00.039478 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-93dfb9ef-b1e0-406d-9ed9-e9fbc1a39f59 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:18:00.056450 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-93dfb9ef-b1e0-406d-9ed9-e9fbc1a39f59 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Getting quotas for project cceaa1e24146497fbf3f79cebc112211. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 05:18:00.061923 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-93dfb9ef-b1e0-406d-9ed9-e9fbc1a39f59 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Getting quotas for user 0d55fe5072c14752846eb4ffc0eef91b and project cceaa1e24146497fbf3f79cebc112211. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 05:18:00.122964 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-93dfb9ef-b1e0-406d-9ed9-e9fbc1a39f59 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Going to run 1 instances... {{(pid=122698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 05:18:00.131460 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-93dfb9ef-b1e0-406d-9ed9-e9fbc1a39f59 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: de566974-620a-4faa-9da4-62621e7b69bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bfb12b99-bfe2-4fae-b576-dcb190422be6',volume_size=None,volume_type=None)] {{(pid=122698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 05:18:00.582526 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-93dfb9ef-b1e0-406d-9ed9-e9fbc1a39f59 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.265510 Sep 23 05:18:00.583229 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3354/6887] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 05:17:59 2022] POST /compute/v2.1/servers => generated 405 bytes in 1267 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 05:18:00.592815 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:18:00.593616 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=6 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:18:00.594275 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:18:00.598947 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ff2f3e98-1d6d-40e6-a29a-aa11df9ef109 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:18:00.599797 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ff2f3e98-1d6d-40e6-a29a-aa11df9ef109 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: de566974-620a-4faa-9da4-62621e7b69bc] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:18:00.727571 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ff2f3e98-1d6d-40e6-a29a-aa11df9ef109 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:18:00.735178 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ff2f3e98-1d6d-40e6-a29a-aa11df9ef109 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/de566974-620a-4faa-9da4-62621e7b69bc" status: 200 len: 1092 microversion: 2.1 time: 0.144518 Sep 23 05:18:00.736073 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3534/6888] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:18:00 2022] GET /compute/v2.1/servers/de566974-620a-4faa-9da4-62621e7b69bc => generated 1092 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:18:01.761359 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-51b06d2c-1d8f-4a8a-936c-89e8d4368d65 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:18:01.762119 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-51b06d2c-1d8f-4a8a-936c-89e8d4368d65 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: de566974-620a-4faa-9da4-62621e7b69bc] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:18:01.768805 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-51b06d2c-1d8f-4a8a-936c-89e8d4368d65 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:18:01.769412 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-51b06d2c-1d8f-4a8a-936c-89e8d4368d65 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:18:01.769870 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-51b06d2c-1d8f-4a8a-936c-89e8d4368d65 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:18:01.770620 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-51b06d2c-1d8f-4a8a-936c-89e8d4368d65 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:18:01.771101 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-51b06d2c-1d8f-4a8a-936c-89e8d4368d65 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:18:01.771545 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-51b06d2c-1d8f-4a8a-936c-89e8d4368d65 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:18:01.836538 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-51b06d2c-1d8f-4a8a-936c-89e8d4368d65 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:18:01.844263 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-51b06d2c-1d8f-4a8a-936c-89e8d4368d65 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/de566974-620a-4faa-9da4-62621e7b69bc" status: 200 len: 1142 microversion: 2.1 time: 0.087820 Sep 23 05:18:01.844852 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3355/6889] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:18:01 2022] GET /compute/v2.1/servers/de566974-620a-4faa-9da4-62621e7b69bc => generated 1142 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:18:02.868534 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-51d3cb82-5341-4939-b8da-e75f888400e1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:18:02.869161 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-51d3cb82-5341-4939-b8da-e75f888400e1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: de566974-620a-4faa-9da4-62621e7b69bc] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:18:02.878083 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-51d3cb82-5341-4939-b8da-e75f888400e1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:18:02.878584 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-51d3cb82-5341-4939-b8da-e75f888400e1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:18:02.879034 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-51d3cb82-5341-4939-b8da-e75f888400e1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:18:02.882638 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-51d3cb82-5341-4939-b8da-e75f888400e1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:18:02.882638 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-51d3cb82-5341-4939-b8da-e75f888400e1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:18:02.882638 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-51d3cb82-5341-4939-b8da-e75f888400e1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:18:02.989803 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-51d3cb82-5341-4939-b8da-e75f888400e1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:18:02.999280 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-51d3cb82-5341-4939-b8da-e75f888400e1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/de566974-620a-4faa-9da4-62621e7b69bc" status: 200 len: 1198 microversion: 2.1 time: 0.134839 Sep 23 05:18:03.000172 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3535/6890] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:18:02 2022] GET /compute/v2.1/servers/de566974-620a-4faa-9da4-62621e7b69bc => generated 1198 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:18:04.028541 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-969918c0-ce00-4935-bcc5-3d295e5f7ada tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:18:04.029823 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-969918c0-ce00-4935-bcc5-3d295e5f7ada tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: de566974-620a-4faa-9da4-62621e7b69bc] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:18:04.038950 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-969918c0-ce00-4935-bcc5-3d295e5f7ada tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:18:04.039675 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-969918c0-ce00-4935-bcc5-3d295e5f7ada tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:18:04.040314 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-969918c0-ce00-4935-bcc5-3d295e5f7ada tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:18:04.041220 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-969918c0-ce00-4935-bcc5-3d295e5f7ada tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:18:04.041873 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-969918c0-ce00-4935-bcc5-3d295e5f7ada tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:18:04.042640 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-969918c0-ce00-4935-bcc5-3d295e5f7ada tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:18:04.196698 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-969918c0-ce00-4935-bcc5-3d295e5f7ada tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:18:04.205066 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-969918c0-ce00-4935-bcc5-3d295e5f7ada tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/de566974-620a-4faa-9da4-62621e7b69bc" status: 200 len: 1275 microversion: 2.1 time: 0.180694 Sep 23 05:18:04.206479 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3356/6891] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:18:04 2022] GET /compute/v2.1/servers/de566974-620a-4faa-9da4-62621e7b69bc => generated 1275 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:18:04.835470 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-ebce81b2-6ea1-48bc-b0b1-1e7a18540395 req-3b1c4b4b-394c-462d-ae5d-231f90d7de5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de566974-620a-4faa-9da4-62621e7b69bc", "tag": "359e7214-274a-422a-8b16-0d5af8aa16e9"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:18:04.850854 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-ebce81b2-6ea1-48bc-b0b1-1e7a18540395 req-3b1c4b4b-394c-462d-ae5d-231f90d7de5e service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:18:04.851515 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-ebce81b2-6ea1-48bc-b0b1-1e7a18540395 req-3b1c4b4b-394c-462d-ae5d-231f90d7de5e service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:18:04.852214 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-ebce81b2-6ea1-48bc-b0b1-1e7a18540395 req-3b1c4b4b-394c-462d-ae5d-231f90d7de5e service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:18:04.868639 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-ebce81b2-6ea1-48bc-b0b1-1e7a18540395 req-3b1c4b4b-394c-462d-ae5d-231f90d7de5e service nova] Creating event network-changed:359e7214-274a-422a-8b16-0d5af8aa16e9 for instance de566974-620a-4faa-9da4-62621e7b69bc on n-h1-846463-3 Sep 23 05:18:04.874578 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-ebce81b2-6ea1-48bc-b0b1-1e7a18540395 req-3b1c4b4b-394c-462d-ae5d-231f90d7de5e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.159132 Sep 23 05:18:04.875264 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3536/6892] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:18:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:18:05.230789 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-19293dd0-aad3-48da-a314-67f152b1dab8 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:18:05.231499 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-19293dd0-aad3-48da-a314-67f152b1dab8 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: de566974-620a-4faa-9da4-62621e7b69bc] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:18:05.238965 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-19293dd0-aad3-48da-a314-67f152b1dab8 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:18:05.239625 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-19293dd0-aad3-48da-a314-67f152b1dab8 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:18:05.240116 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-19293dd0-aad3-48da-a314-67f152b1dab8 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:18:05.241103 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-19293dd0-aad3-48da-a314-67f152b1dab8 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:18:05.241653 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-19293dd0-aad3-48da-a314-67f152b1dab8 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:18:05.242288 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-19293dd0-aad3-48da-a314-67f152b1dab8 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:18:05.412072 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-19293dd0-aad3-48da-a314-67f152b1dab8 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:18:05.420771 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-19293dd0-aad3-48da-a314-67f152b1dab8 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/de566974-620a-4faa-9da4-62621e7b69bc" status: 200 len: 1275 microversion: 2.1 time: 0.194841 Sep 23 05:18:05.421368 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3357/6893] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:18:05 2022] GET /compute/v2.1/servers/de566974-620a-4faa-9da4-62621e7b69bc => generated 1275 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:18:06.451973 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-35a94bf9-dab9-4908-8ed2-a4e979782ac7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:18:06.452740 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-35a94bf9-dab9-4908-8ed2-a4e979782ac7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: de566974-620a-4faa-9da4-62621e7b69bc] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:18:06.459423 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-35a94bf9-dab9-4908-8ed2-a4e979782ac7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:18:06.460001 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-35a94bf9-dab9-4908-8ed2-a4e979782ac7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:18:06.460791 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-35a94bf9-dab9-4908-8ed2-a4e979782ac7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:18:06.461586 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-35a94bf9-dab9-4908-8ed2-a4e979782ac7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:18:06.462175 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-35a94bf9-dab9-4908-8ed2-a4e979782ac7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:18:06.462732 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-35a94bf9-dab9-4908-8ed2-a4e979782ac7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:18:06.645773 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-35a94bf9-dab9-4908-8ed2-a4e979782ac7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:18:06.654518 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-35a94bf9-dab9-4908-8ed2-a4e979782ac7 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/de566974-620a-4faa-9da4-62621e7b69bc" status: 200 len: 1275 microversion: 2.1 time: 0.207363 Sep 23 05:18:06.655148 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3537/6894] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:18:06 2022] GET /compute/v2.1/servers/de566974-620a-4faa-9da4-62621e7b69bc => generated 1275 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:18:07.680253 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-50afb146-de64-487b-996d-2350a65faadb tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:18:07.681655 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-50afb146-de64-487b-996d-2350a65faadb tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: de566974-620a-4faa-9da4-62621e7b69bc] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:18:07.688644 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-50afb146-de64-487b-996d-2350a65faadb tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:18:07.689145 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-50afb146-de64-487b-996d-2350a65faadb tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:18:07.689596 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-50afb146-de64-487b-996d-2350a65faadb tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:18:07.690376 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-50afb146-de64-487b-996d-2350a65faadb tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:18:07.690853 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-50afb146-de64-487b-996d-2350a65faadb tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:18:07.691366 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-50afb146-de64-487b-996d-2350a65faadb tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:18:07.863266 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-50afb146-de64-487b-996d-2350a65faadb tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:18:07.871404 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-50afb146-de64-487b-996d-2350a65faadb tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/de566974-620a-4faa-9da4-62621e7b69bc" status: 200 len: 1275 microversion: 2.1 time: 0.195089 Sep 23 05:18:07.871976 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3358/6895] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:18:07 2022] GET /compute/v2.1/servers/de566974-620a-4faa-9da4-62621e7b69bc => generated 1275 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:18:08.905308 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-011624b1-0785-4b11-8675-7c8719378658 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:18:08.905950 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-011624b1-0785-4b11-8675-7c8719378658 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: de566974-620a-4faa-9da4-62621e7b69bc] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:18:08.913658 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-011624b1-0785-4b11-8675-7c8719378658 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:18:08.914294 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-011624b1-0785-4b11-8675-7c8719378658 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:18:08.922885 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-011624b1-0785-4b11-8675-7c8719378658 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:18:08.922885 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-011624b1-0785-4b11-8675-7c8719378658 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:18:08.922885 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-011624b1-0785-4b11-8675-7c8719378658 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:18:08.922885 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-011624b1-0785-4b11-8675-7c8719378658 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:18:09.057176 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-011624b1-0785-4b11-8675-7c8719378658 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:18:09.066475 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-011624b1-0785-4b11-8675-7c8719378658 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/de566974-620a-4faa-9da4-62621e7b69bc" status: 200 len: 1275 microversion: 2.1 time: 0.165040 Sep 23 05:18:09.067192 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3538/6896] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:18:08 2022] GET /compute/v2.1/servers/de566974-620a-4faa-9da4-62621e7b69bc => generated 1275 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:18:10.089301 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f91150c8-ed31-43a1-8041-72f928f17115 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:18:10.089977 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f91150c8-ed31-43a1-8041-72f928f17115 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: de566974-620a-4faa-9da4-62621e7b69bc] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:18:10.092780 n-d-846463-3 devstack@n-api.service[122698]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 05:18:10.092916 n-d-846463-3 devstack@n-api.service[122698]: Fri Sep 23 05:18:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/de566974-620a-4faa-9da4-62621e7b69bc (ip 10.222.0.33) !!! Sep 23 05:18:10.094350 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:18:10.095075 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=6 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:18:10.101676 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f91150c8-ed31-43a1-8041-72f928f17115 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:18:10.102223 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f91150c8-ed31-43a1-8041-72f928f17115 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:18:10.102687 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f91150c8-ed31-43a1-8041-72f928f17115 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:18:10.103424 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f91150c8-ed31-43a1-8041-72f928f17115 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:18:10.103899 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f91150c8-ed31-43a1-8041-72f928f17115 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:18:10.104348 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f91150c8-ed31-43a1-8041-72f928f17115 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:18:10.243062 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f91150c8-ed31-43a1-8041-72f928f17115 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:18:10.251062 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f91150c8-ed31-43a1-8041-72f928f17115 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/de566974-620a-4faa-9da4-62621e7b69bc" status: 200 len: 1263 microversion: 2.1 time: 0.165698 Sep 23 05:18:10.251639 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3359/6897] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:18:10 2022] GET /compute/v2.1/servers/de566974-620a-4faa-9da4-62621e7b69bc => generated 1263 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:18:11.280180 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-70e1fcca-924f-405b-be5f-38aeb052c0e6 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:18:11.280887 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-70e1fcca-924f-405b-be5f-38aeb052c0e6 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: de566974-620a-4faa-9da4-62621e7b69bc] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:18:11.283356 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:18:11.288382 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-70e1fcca-924f-405b-be5f-38aeb052c0e6 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:18:11.288870 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-70e1fcca-924f-405b-be5f-38aeb052c0e6 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:18:11.289315 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-70e1fcca-924f-405b-be5f-38aeb052c0e6 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:18:11.290107 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-70e1fcca-924f-405b-be5f-38aeb052c0e6 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:18:11.290575 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-70e1fcca-924f-405b-be5f-38aeb052c0e6 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:18:11.291032 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-70e1fcca-924f-405b-be5f-38aeb052c0e6 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:18:11.432463 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-70e1fcca-924f-405b-be5f-38aeb052c0e6 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:18:11.440522 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-70e1fcca-924f-405b-be5f-38aeb052c0e6 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/de566974-620a-4faa-9da4-62621e7b69bc" status: 200 len: 1263 microversion: 2.1 time: 0.164421 Sep 23 05:18:11.441102 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3539/6898] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:18:11 2022] GET /compute/v2.1/servers/de566974-620a-4faa-9da4-62621e7b69bc => generated 1263 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:18:12.463880 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-cda40a2b-9561-40b9-8fd5-9b5618bf788c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:18:12.464454 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-cda40a2b-9561-40b9-8fd5-9b5618bf788c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: de566974-620a-4faa-9da4-62621e7b69bc] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:18:12.471927 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cda40a2b-9561-40b9-8fd5-9b5618bf788c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:18:12.472446 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cda40a2b-9561-40b9-8fd5-9b5618bf788c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:18:12.472916 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cda40a2b-9561-40b9-8fd5-9b5618bf788c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:18:12.473649 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cda40a2b-9561-40b9-8fd5-9b5618bf788c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:18:12.474159 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cda40a2b-9561-40b9-8fd5-9b5618bf788c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:18:12.474615 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cda40a2b-9561-40b9-8fd5-9b5618bf788c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:18:12.609845 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-cda40a2b-9561-40b9-8fd5-9b5618bf788c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:18:12.617863 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-cda40a2b-9561-40b9-8fd5-9b5618bf788c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/de566974-620a-4faa-9da4-62621e7b69bc" status: 200 len: 1263 microversion: 2.1 time: 0.158006 Sep 23 05:18:12.618463 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3360/6899] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:18:12 2022] GET /compute/v2.1/servers/de566974-620a-4faa-9da4-62621e7b69bc => generated 1263 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:18:13.641043 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1320867d-6951-4dfb-b4bc-99505f26f0ef tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:18:13.641668 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1320867d-6951-4dfb-b4bc-99505f26f0ef tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: de566974-620a-4faa-9da4-62621e7b69bc] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:18:13.648979 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1320867d-6951-4dfb-b4bc-99505f26f0ef tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:18:13.649480 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1320867d-6951-4dfb-b4bc-99505f26f0ef tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:18:13.650023 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1320867d-6951-4dfb-b4bc-99505f26f0ef tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:18:13.650732 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1320867d-6951-4dfb-b4bc-99505f26f0ef tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:18:13.651271 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1320867d-6951-4dfb-b4bc-99505f26f0ef tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:18:13.651708 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1320867d-6951-4dfb-b4bc-99505f26f0ef tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:18:13.792997 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1320867d-6951-4dfb-b4bc-99505f26f0ef tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:18:13.802277 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1320867d-6951-4dfb-b4bc-99505f26f0ef tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/de566974-620a-4faa-9da4-62621e7b69bc" status: 200 len: 1263 microversion: 2.1 time: 0.165406 Sep 23 05:18:13.812925 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3540/6900] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:18:13 2022] GET /compute/v2.1/servers/de566974-620a-4faa-9da4-62621e7b69bc => generated 1263 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:18:14.826881 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-cca6f7be-b374-4704-974d-fef536343a97 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:18:14.827543 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-cca6f7be-b374-4704-974d-fef536343a97 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: de566974-620a-4faa-9da4-62621e7b69bc] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:18:14.835724 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cca6f7be-b374-4704-974d-fef536343a97 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:18:14.836420 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cca6f7be-b374-4704-974d-fef536343a97 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:18:14.836694 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cca6f7be-b374-4704-974d-fef536343a97 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:18:14.837459 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cca6f7be-b374-4704-974d-fef536343a97 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:18:14.837976 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cca6f7be-b374-4704-974d-fef536343a97 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:18:14.838429 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cca6f7be-b374-4704-974d-fef536343a97 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:18:14.988798 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-cca6f7be-b374-4704-974d-fef536343a97 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:18:14.996822 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-cca6f7be-b374-4704-974d-fef536343a97 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/de566974-620a-4faa-9da4-62621e7b69bc" status: 200 len: 1263 microversion: 2.1 time: 0.173794 Sep 23 05:18:14.997414 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3361/6901] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:18:14 2022] GET /compute/v2.1/servers/de566974-620a-4faa-9da4-62621e7b69bc => generated 1263 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:18:16.021143 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-bd24e96c-0cdf-4a13-abb5-a4f6e4a48152 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:18:16.022124 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-bd24e96c-0cdf-4a13-abb5-a4f6e4a48152 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: de566974-620a-4faa-9da4-62621e7b69bc] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:18:16.029758 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bd24e96c-0cdf-4a13-abb5-a4f6e4a48152 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:18:16.030375 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bd24e96c-0cdf-4a13-abb5-a4f6e4a48152 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:18:16.030871 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bd24e96c-0cdf-4a13-abb5-a4f6e4a48152 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:18:16.031778 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bd24e96c-0cdf-4a13-abb5-a4f6e4a48152 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:18:16.032413 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bd24e96c-0cdf-4a13-abb5-a4f6e4a48152 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:18:16.033020 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bd24e96c-0cdf-4a13-abb5-a4f6e4a48152 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:18:16.179668 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-bd24e96c-0cdf-4a13-abb5-a4f6e4a48152 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:18:16.187551 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-bd24e96c-0cdf-4a13-abb5-a4f6e4a48152 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/de566974-620a-4faa-9da4-62621e7b69bc" status: 200 len: 1263 microversion: 2.1 time: 0.170373 Sep 23 05:18:16.188132 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3541/6902] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:18:16 2022] GET /compute/v2.1/servers/de566974-620a-4faa-9da4-62621e7b69bc => generated 1263 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:18:17.210832 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-055a92c7-291e-46f1-8881-65af38d4e1ac tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:18:17.211590 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-055a92c7-291e-46f1-8881-65af38d4e1ac tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: de566974-620a-4faa-9da4-62621e7b69bc] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:18:17.218747 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-055a92c7-291e-46f1-8881-65af38d4e1ac tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:18:17.219347 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-055a92c7-291e-46f1-8881-65af38d4e1ac tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:18:17.219904 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-055a92c7-291e-46f1-8881-65af38d4e1ac tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:18:17.220707 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-055a92c7-291e-46f1-8881-65af38d4e1ac tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:18:17.221446 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-055a92c7-291e-46f1-8881-65af38d4e1ac tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:18:17.222080 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-055a92c7-291e-46f1-8881-65af38d4e1ac tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:18:17.379928 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-055a92c7-291e-46f1-8881-65af38d4e1ac tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:18:17.387956 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-055a92c7-291e-46f1-8881-65af38d4e1ac tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/de566974-620a-4faa-9da4-62621e7b69bc" status: 200 len: 1263 microversion: 2.1 time: 0.181086 Sep 23 05:18:17.388488 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3362/6903] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:18:17 2022] GET /compute/v2.1/servers/de566974-620a-4faa-9da4-62621e7b69bc => generated 1263 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:18:18.411644 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f8efa60c-707e-4a1e-a65c-a51b84a9e764 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:18:18.412285 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f8efa60c-707e-4a1e-a65c-a51b84a9e764 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: de566974-620a-4faa-9da4-62621e7b69bc] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:18:18.419094 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f8efa60c-707e-4a1e-a65c-a51b84a9e764 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:18:18.419582 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f8efa60c-707e-4a1e-a65c-a51b84a9e764 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:18:18.420134 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f8efa60c-707e-4a1e-a65c-a51b84a9e764 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:18:18.420940 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f8efa60c-707e-4a1e-a65c-a51b84a9e764 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:18:18.421400 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f8efa60c-707e-4a1e-a65c-a51b84a9e764 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:18:18.421825 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f8efa60c-707e-4a1e-a65c-a51b84a9e764 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:18:18.552851 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f8efa60c-707e-4a1e-a65c-a51b84a9e764 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:18:18.561377 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f8efa60c-707e-4a1e-a65c-a51b84a9e764 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/de566974-620a-4faa-9da4-62621e7b69bc" status: 200 len: 1263 microversion: 2.1 time: 0.154307 Sep 23 05:18:18.561974 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3542/6904] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:18:18 2022] GET /compute/v2.1/servers/de566974-620a-4faa-9da4-62621e7b69bc => generated 1263 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:18:18.930781 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-e4c3d18a-2690-4049-9546-4bb094ce63da req-458cde01-41fa-4010-bdf8-66e9f4bb9381 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de566974-620a-4faa-9da4-62621e7b69bc", "name": "network-vif-plugged", "status": "completed", "tag": "359e7214-274a-422a-8b16-0d5af8aa16e9"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:18:18.942132 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-e4c3d18a-2690-4049-9546-4bb094ce63da req-458cde01-41fa-4010-bdf8-66e9f4bb9381 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:18:18.942884 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-e4c3d18a-2690-4049-9546-4bb094ce63da req-458cde01-41fa-4010-bdf8-66e9f4bb9381 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:18:18.943415 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-e4c3d18a-2690-4049-9546-4bb094ce63da req-458cde01-41fa-4010-bdf8-66e9f4bb9381 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:18:18.955386 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-e4c3d18a-2690-4049-9546-4bb094ce63da req-458cde01-41fa-4010-bdf8-66e9f4bb9381 service nova] Creating event network-vif-plugged:359e7214-274a-422a-8b16-0d5af8aa16e9 for instance de566974-620a-4faa-9da4-62621e7b69bc on n-h1-846463-3 Sep 23 05:18:18.962371 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-e4c3d18a-2690-4049-9546-4bb094ce63da req-458cde01-41fa-4010-bdf8-66e9f4bb9381 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107177 Sep 23 05:18:18.963480 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3363/6905] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:18:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:18:19.585450 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6688caa0-5dcd-4f94-9d7e-a6ab48f34066 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:18:19.586238 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-6688caa0-5dcd-4f94-9d7e-a6ab48f34066 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: de566974-620a-4faa-9da4-62621e7b69bc] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:18:19.592833 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6688caa0-5dcd-4f94-9d7e-a6ab48f34066 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:18:19.593330 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6688caa0-5dcd-4f94-9d7e-a6ab48f34066 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:18:19.593774 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6688caa0-5dcd-4f94-9d7e-a6ab48f34066 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:18:19.594519 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6688caa0-5dcd-4f94-9d7e-a6ab48f34066 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:18:19.594981 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6688caa0-5dcd-4f94-9d7e-a6ab48f34066 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:18:19.596593 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6688caa0-5dcd-4f94-9d7e-a6ab48f34066 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:18:19.743274 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-6688caa0-5dcd-4f94-9d7e-a6ab48f34066 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:18:19.751180 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6688caa0-5dcd-4f94-9d7e-a6ab48f34066 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/de566974-620a-4faa-9da4-62621e7b69bc" status: 200 len: 1263 microversion: 2.1 time: 0.170421 Sep 23 05:18:19.751759 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3543/6906] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:18:19 2022] GET /compute/v2.1/servers/de566974-620a-4faa-9da4-62621e7b69bc => generated 1263 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:18:20.776978 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-cb2bffbc-451c-4e9c-bf77-fbd89edc7d2c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:18:20.777699 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-cb2bffbc-451c-4e9c-bf77-fbd89edc7d2c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: de566974-620a-4faa-9da4-62621e7b69bc] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:18:20.784022 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cb2bffbc-451c-4e9c-bf77-fbd89edc7d2c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:18:20.784530 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cb2bffbc-451c-4e9c-bf77-fbd89edc7d2c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:18:20.785073 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cb2bffbc-451c-4e9c-bf77-fbd89edc7d2c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:18:20.786436 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cb2bffbc-451c-4e9c-bf77-fbd89edc7d2c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:18:20.786926 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cb2bffbc-451c-4e9c-bf77-fbd89edc7d2c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:18:20.787373 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cb2bffbc-451c-4e9c-bf77-fbd89edc7d2c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:18:20.924961 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-cb2bffbc-451c-4e9c-bf77-fbd89edc7d2c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:18:20.933352 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-cb2bffbc-451c-4e9c-bf77-fbd89edc7d2c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/de566974-620a-4faa-9da4-62621e7b69bc" status: 200 len: 1450 microversion: 2.1 time: 0.161510 Sep 23 05:18:20.934181 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3364/6907] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:18:20 2022] GET /compute/v2.1/servers/de566974-620a-4faa-9da4-62621e7b69bc => generated 1450 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:18:20.958050 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2cea43ff-890f-4d28-93af-4e86ecf2945a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:18:20.963040 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-2cea43ff-890f-4d28-93af-4e86ecf2945a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: de566974-620a-4faa-9da4-62621e7b69bc] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:18:20.965413 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2cea43ff-890f-4d28-93af-4e86ecf2945a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:18:20.965929 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2cea43ff-890f-4d28-93af-4e86ecf2945a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:18:20.966380 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2cea43ff-890f-4d28-93af-4e86ecf2945a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:18:20.967085 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2cea43ff-890f-4d28-93af-4e86ecf2945a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:18:20.967546 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2cea43ff-890f-4d28-93af-4e86ecf2945a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:18:20.967976 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2cea43ff-890f-4d28-93af-4e86ecf2945a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:18:21.108314 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2cea43ff-890f-4d28-93af-4e86ecf2945a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:18:21.116792 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2cea43ff-890f-4d28-93af-4e86ecf2945a tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/de566974-620a-4faa-9da4-62621e7b69bc" status: 200 len: 1450 microversion: 2.1 time: 0.163520 Sep 23 05:18:21.117484 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3544/6908] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:18:20 2022] GET /compute/v2.1/servers/de566974-620a-4faa-9da4-62621e7b69bc => generated 1450 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:18:23.649390 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-5da1cefc-84d7-425e-a233-635e8e0cb361 req-ca2dc2b1-b2b3-4d4b-b2fa-89d07a8651cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de566974-620a-4faa-9da4-62621e7b69bc", "tag": "359e7214-274a-422a-8b16-0d5af8aa16e9"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:18:23.662706 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-5da1cefc-84d7-425e-a233-635e8e0cb361 req-ca2dc2b1-b2b3-4d4b-b2fa-89d07a8651cf service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:18:23.663289 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-5da1cefc-84d7-425e-a233-635e8e0cb361 req-ca2dc2b1-b2b3-4d4b-b2fa-89d07a8651cf service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:18:23.663747 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-5da1cefc-84d7-425e-a233-635e8e0cb361 req-ca2dc2b1-b2b3-4d4b-b2fa-89d07a8651cf service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:18:23.677105 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-5da1cefc-84d7-425e-a233-635e8e0cb361 req-ca2dc2b1-b2b3-4d4b-b2fa-89d07a8651cf service nova] Creating event network-changed:359e7214-274a-422a-8b16-0d5af8aa16e9 for instance de566974-620a-4faa-9da4-62621e7b69bc on n-h1-846463-3 Sep 23 05:18:23.683228 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-5da1cefc-84d7-425e-a233-635e8e0cb361 req-ca2dc2b1-b2b3-4d4b-b2fa-89d07a8651cf service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039453 Sep 23 05:18:23.684238 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3365/6909] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:18:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:20:27.281367 n-d-846463-3 devstack@n-api.service[122698]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2416b61d-0aee-4a62-9508-aa1fc06b9213] AMQP server on 10.222.0.33:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Sep 23 05:20:27.282248 n-d-846463-3 devstack@n-api.service[122698]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f191bc7a-c250-407c-bbf3-646bef550c22] AMQP server on 10.222.0.33:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Sep 23 05:20:27.283079 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:20:27.283612 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=60 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:20:27.284671 n-d-846463-3 devstack@n-api.service[122698]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 05:20:27.284824 n-d-846463-3 devstack@n-api.service[122698]: Fri Sep 23 05:20:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.33) !!! Sep 23 05:20:27.285283 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a083b2e8-fa80-465d-9bd9-a83c97a70553 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:20:27.285968 n-d-846463-3 devstack@n-api.service[122698]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 05:20:27.286064 n-d-846463-3 devstack@n-api.service[122698]: Fri Sep 23 05:20:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.33) !!! Sep 23 05:20:27.287843 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a083b2e8-fa80-465d-9bd9-a83c97a70553 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: de566974-620a-4faa-9da4-62621e7b69bc] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:20:27.292566 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=24 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:20:27.296873 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=56 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:20:27.297929 n-d-846463-3 devstack@n-api.service[122699]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 05:20:27.298894 n-d-846463-3 devstack@n-api.service[122699]: Fri Sep 23 05:20:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/de566974-620a-4faa-9da4-62621e7b69bc (ip 10.222.0.33) !!! Sep 23 05:20:27.300963 n-d-846463-3 devstack@n-api.service[122699]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 05:20:27.301402 n-d-846463-3 devstack@n-api.service[122699]: Fri Sep 23 05:20:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/de566974-620a-4faa-9da4-62621e7b69bc (ip 10.222.0.33) !!! Sep 23 05:20:27.305286 n-d-846463-3 devstack@n-api.service[122699]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 05:20:27.305627 n-d-846463-3 devstack@n-api.service[122699]: Fri Sep 23 05:20:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/de566974-620a-4faa-9da4-62621e7b69bc (ip 10.222.0.33) !!! Sep 23 05:20:27.328854 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a083b2e8-fa80-465d-9bd9-a83c97a70553 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:20:27.329736 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a083b2e8-fa80-465d-9bd9-a83c97a70553 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:20:27.330432 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a083b2e8-fa80-465d-9bd9-a83c97a70553 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:20:27.331630 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a083b2e8-fa80-465d-9bd9-a83c97a70553 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:20:27.335000 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a083b2e8-fa80-465d-9bd9-a83c97a70553 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:20:27.336105 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a083b2e8-fa80-465d-9bd9-a83c97a70553 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:20:27.375786 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a083b2e8-fa80-465d-9bd9-a83c97a70553 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: de566974-620a-4faa-9da4-62621e7b69bc] Going to try to terminate instance {{(pid=122699) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 05:20:27.491484 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-112d4401-2921-417e-a11e-2ca954cd4d22 req-4ac1a660-8c9b-46af-adf5-c2872f36d1f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de566974-620a-4faa-9da4-62621e7b69bc", "tag": "359e7214-274a-422a-8b16-0d5af8aa16e9"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:20:27.506068 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-112d4401-2921-417e-a11e-2ca954cd4d22 req-4ac1a660-8c9b-46af-adf5-c2872f36d1f9 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:20:27.506536 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-112d4401-2921-417e-a11e-2ca954cd4d22 req-4ac1a660-8c9b-46af-adf5-c2872f36d1f9 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:20:27.507168 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-112d4401-2921-417e-a11e-2ca954cd4d22 req-4ac1a660-8c9b-46af-adf5-c2872f36d1f9 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:20:27.531748 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-112d4401-2921-417e-a11e-2ca954cd4d22 req-4ac1a660-8c9b-46af-adf5-c2872f36d1f9 service nova] Creating event network-changed:359e7214-274a-422a-8b16-0d5af8aa16e9 for instance de566974-620a-4faa-9da4-62621e7b69bc on n-h1-846463-3 Sep 23 05:20:27.542987 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-112d4401-2921-417e-a11e-2ca954cd4d22 req-4ac1a660-8c9b-46af-adf5-c2872f36d1f9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.263359 Sep 23 05:20:27.544181 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3366/6910] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:20:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:20:27.692617 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a083b2e8-fa80-465d-9bd9-a83c97a70553 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "DELETE /compute/v2.1/servers/de566974-620a-4faa-9da4-62621e7b69bc" status: 204 len: 0 microversion: 2.1 time: 0.416384 Sep 23 05:20:27.693407 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3545/6911] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 05:20:27 2022] DELETE /compute/v2.1/servers/de566974-620a-4faa-9da4-62621e7b69bc => generated 0 bytes in 418 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 05:20:27.704701 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3cd17ff7-76ef-4f2a-bfa3-8b47adc2ddee tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:20:27.706518 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3cd17ff7-76ef-4f2a-bfa3-8b47adc2ddee tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: de566974-620a-4faa-9da4-62621e7b69bc] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:20:27.716958 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3cd17ff7-76ef-4f2a-bfa3-8b47adc2ddee tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:20:27.721406 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3cd17ff7-76ef-4f2a-bfa3-8b47adc2ddee tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:20:27.721406 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3cd17ff7-76ef-4f2a-bfa3-8b47adc2ddee tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:20:27.721406 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3cd17ff7-76ef-4f2a-bfa3-8b47adc2ddee tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:20:27.721406 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3cd17ff7-76ef-4f2a-bfa3-8b47adc2ddee tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:20:27.721406 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3cd17ff7-76ef-4f2a-bfa3-8b47adc2ddee tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:20:27.876816 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-3cd17ff7-76ef-4f2a-bfa3-8b47adc2ddee tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:20:27.884606 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3cd17ff7-76ef-4f2a-bfa3-8b47adc2ddee tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/de566974-620a-4faa-9da4-62621e7b69bc" status: 200 len: 1574 microversion: 2.1 time: 0.186625 Sep 23 05:20:27.885215 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3367/6912] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:20:27 2022] GET /compute/v2.1/servers/de566974-620a-4faa-9da4-62621e7b69bc => generated 1574 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:20:28.910144 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-adec913f-1dfe-414c-b832-f09c216d8516 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:20:28.910944 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-adec913f-1dfe-414c-b832-f09c216d8516 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: de566974-620a-4faa-9da4-62621e7b69bc] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:20:28.918306 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-adec913f-1dfe-414c-b832-f09c216d8516 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:20:28.919374 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-adec913f-1dfe-414c-b832-f09c216d8516 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:20:28.920010 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-adec913f-1dfe-414c-b832-f09c216d8516 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:20:28.920721 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-adec913f-1dfe-414c-b832-f09c216d8516 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:20:28.921187 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-adec913f-1dfe-414c-b832-f09c216d8516 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:20:28.921615 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-adec913f-1dfe-414c-b832-f09c216d8516 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:20:29.067665 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-adec913f-1dfe-414c-b832-f09c216d8516 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:20:29.075818 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-adec913f-1dfe-414c-b832-f09c216d8516 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/de566974-620a-4faa-9da4-62621e7b69bc" status: 200 len: 1574 microversion: 2.1 time: 0.170014 Sep 23 05:20:29.076393 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3546/6913] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:20:28 2022] GET /compute/v2.1/servers/de566974-620a-4faa-9da4-62621e7b69bc => generated 1574 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:20:30.024831 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-6cd91032-f6fe-4478-928e-25e746bf01ca req-ea708815-d5d4-4ad3-8f1b-29075622e9b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de566974-620a-4faa-9da4-62621e7b69bc", "name": "network-vif-deleted", "tag": "359e7214-274a-422a-8b16-0d5af8aa16e9"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:20:30.045120 n-d-846463-3 devstack@n-api.service[122698]: INFO oslo.messaging._drivers.impl_rabbit [-] [2416b61d-0aee-4a62-9508-aa1fc06b9213] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 48828. Sep 23 05:20:30.051394 n-d-846463-3 devstack@n-api.service[122698]: INFO oslo.messaging._drivers.impl_rabbit [-] [f191bc7a-c250-407c-bbf3-646bef550c22] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 48830. Sep 23 05:20:30.053767 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-6cd91032-f6fe-4478-928e-25e746bf01ca req-ea708815-d5d4-4ad3-8f1b-29075622e9b7 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:20:30.054300 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-6cd91032-f6fe-4478-928e-25e746bf01ca req-ea708815-d5d4-4ad3-8f1b-29075622e9b7 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:20:30.054750 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-6cd91032-f6fe-4478-928e-25e746bf01ca req-ea708815-d5d4-4ad3-8f1b-29075622e9b7 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:20:30.066529 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-6cd91032-f6fe-4478-928e-25e746bf01ca req-ea708815-d5d4-4ad3-8f1b-29075622e9b7 service nova] Creating event network-vif-deleted:359e7214-274a-422a-8b16-0d5af8aa16e9 for instance de566974-620a-4faa-9da4-62621e7b69bc on n-h1-846463-3 Sep 23 05:20:30.071598 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-6cd91032-f6fe-4478-928e-25e746bf01ca req-ea708815-d5d4-4ad3-8f1b-29075622e9b7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052182 Sep 23 05:20:30.072386 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3368/6914] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:20:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:20:30.099540 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6f8d3b99-6aaa-4743-b9da-a68788d5c3c4 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:20:30.100164 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-6f8d3b99-6aaa-4743-b9da-a68788d5c3c4 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: de566974-620a-4faa-9da4-62621e7b69bc] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:20:30.107434 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6f8d3b99-6aaa-4743-b9da-a68788d5c3c4 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:20:30.107951 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6f8d3b99-6aaa-4743-b9da-a68788d5c3c4 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:20:30.108376 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6f8d3b99-6aaa-4743-b9da-a68788d5c3c4 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:20:30.109078 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6f8d3b99-6aaa-4743-b9da-a68788d5c3c4 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:20:30.109539 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6f8d3b99-6aaa-4743-b9da-a68788d5c3c4 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:20:30.109998 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6f8d3b99-6aaa-4743-b9da-a68788d5c3c4 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:20:30.216992 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-6f8d3b99-6aaa-4743-b9da-a68788d5c3c4 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:20:30.226350 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6f8d3b99-6aaa-4743-b9da-a68788d5c3c4 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/de566974-620a-4faa-9da4-62621e7b69bc" status: 200 len: 1389 microversion: 2.1 time: 0.130478 Sep 23 05:20:30.227475 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3547/6915] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:20:30 2022] GET /compute/v2.1/servers/de566974-620a-4faa-9da4-62621e7b69bc => generated 1389 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:20:31.252518 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2207c917-49a9-46da-b46f-827beccbb600 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:20:31.253470 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-2207c917-49a9-46da-b46f-827beccbb600 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: de566974-620a-4faa-9da4-62621e7b69bc] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:20:31.260804 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2207c917-49a9-46da-b46f-827beccbb600 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:20:31.261308 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2207c917-49a9-46da-b46f-827beccbb600 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:20:31.261762 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2207c917-49a9-46da-b46f-827beccbb600 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:20:31.263047 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2207c917-49a9-46da-b46f-827beccbb600 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:20:31.263528 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2207c917-49a9-46da-b46f-827beccbb600 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:20:31.263989 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2207c917-49a9-46da-b46f-827beccbb600 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:20:31.335813 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-2207c917-49a9-46da-b46f-827beccbb600 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:20:31.344530 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2207c917-49a9-46da-b46f-827beccbb600 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/de566974-620a-4faa-9da4-62621e7b69bc" status: 200 len: 1223 microversion: 2.1 time: 0.098440 Sep 23 05:20:31.345052 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3369/6916] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:20:31 2022] GET /compute/v2.1/servers/de566974-620a-4faa-9da4-62621e7b69bc => generated 1223 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:20:32.368521 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c579702f-715e-4c05-a30d-d118eda4f3f8 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:20:32.369397 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c579702f-715e-4c05-a30d-d118eda4f3f8 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: de566974-620a-4faa-9da4-62621e7b69bc] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:20:32.376538 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c579702f-715e-4c05-a30d-d118eda4f3f8 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:20:32.377128 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c579702f-715e-4c05-a30d-d118eda4f3f8 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:20:32.377624 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c579702f-715e-4c05-a30d-d118eda4f3f8 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:20:32.381500 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c579702f-715e-4c05-a30d-d118eda4f3f8 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:20:32.381500 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c579702f-715e-4c05-a30d-d118eda4f3f8 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:20:32.381500 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c579702f-715e-4c05-a30d-d118eda4f3f8 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:20:32.450614 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c579702f-715e-4c05-a30d-d118eda4f3f8 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:20:32.460460 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c579702f-715e-4c05-a30d-d118eda4f3f8 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/de566974-620a-4faa-9da4-62621e7b69bc" status: 200 len: 1223 microversion: 2.1 time: 0.095796 Sep 23 05:20:32.461123 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3548/6917] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:20:32 2022] GET /compute/v2.1/servers/de566974-620a-4faa-9da4-62621e7b69bc => generated 1223 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:20:33.484127 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b972ab00-149f-4e8a-8503-ec4a1f468a92 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:20:33.485439 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b972ab00-149f-4e8a-8503-ec4a1f468a92 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: de566974-620a-4faa-9da4-62621e7b69bc] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:20:33.492664 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b972ab00-149f-4e8a-8503-ec4a1f468a92 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:20:33.493176 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b972ab00-149f-4e8a-8503-ec4a1f468a92 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:20:33.493640 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b972ab00-149f-4e8a-8503-ec4a1f468a92 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:20:33.494391 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b972ab00-149f-4e8a-8503-ec4a1f468a92 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:20:33.494869 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b972ab00-149f-4e8a-8503-ec4a1f468a92 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:20:33.495309 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b972ab00-149f-4e8a-8503-ec4a1f468a92 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:20:33.563398 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b972ab00-149f-4e8a-8503-ec4a1f468a92 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:20:33.571589 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b972ab00-149f-4e8a-8503-ec4a1f468a92 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/de566974-620a-4faa-9da4-62621e7b69bc" status: 200 len: 1223 microversion: 2.1 time: 0.091862 Sep 23 05:20:33.572179 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3370/6918] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:20:33 2022] GET /compute/v2.1/servers/de566974-620a-4faa-9da4-62621e7b69bc => generated 1223 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:20:34.596032 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a13a1cf9-4b0f-4202-8de3-ca2ed4e8c223 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:20:34.596570 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a13a1cf9-4b0f-4202-8de3-ca2ed4e8c223 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: de566974-620a-4faa-9da4-62621e7b69bc] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:20:34.602790 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a13a1cf9-4b0f-4202-8de3-ca2ed4e8c223 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:20:34.603291 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a13a1cf9-4b0f-4202-8de3-ca2ed4e8c223 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:20:34.603744 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a13a1cf9-4b0f-4202-8de3-ca2ed4e8c223 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:20:34.604456 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a13a1cf9-4b0f-4202-8de3-ca2ed4e8c223 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:20:34.604916 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a13a1cf9-4b0f-4202-8de3-ca2ed4e8c223 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:20:34.605351 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a13a1cf9-4b0f-4202-8de3-ca2ed4e8c223 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:20:34.672957 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a13a1cf9-4b0f-4202-8de3-ca2ed4e8c223 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:20:34.681487 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a13a1cf9-4b0f-4202-8de3-ca2ed4e8c223 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/de566974-620a-4faa-9da4-62621e7b69bc" status: 200 len: 1223 microversion: 2.1 time: 0.089753 Sep 23 05:20:34.682099 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3549/6919] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:20:34 2022] GET /compute/v2.1/servers/de566974-620a-4faa-9da4-62621e7b69bc => generated 1223 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:20:35.705838 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e71a02eb-39ae-40b8-bc14-7338822bcac0 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:20:35.706639 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e71a02eb-39ae-40b8-bc14-7338822bcac0 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: de566974-620a-4faa-9da4-62621e7b69bc] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:20:35.713668 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e71a02eb-39ae-40b8-bc14-7338822bcac0 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:20:35.714208 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e71a02eb-39ae-40b8-bc14-7338822bcac0 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:20:35.714905 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e71a02eb-39ae-40b8-bc14-7338822bcac0 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:20:35.716177 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e71a02eb-39ae-40b8-bc14-7338822bcac0 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:20:35.716672 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e71a02eb-39ae-40b8-bc14-7338822bcac0 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:20:35.717110 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e71a02eb-39ae-40b8-bc14-7338822bcac0 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:20:35.731985 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-e71a02eb-39ae-40b8-bc14-7338822bcac0 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] HTTP exception thrown: Instance de566974-620a-4faa-9da4-62621e7b69bc could not be found. Sep 23 05:20:35.733670 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e71a02eb-39ae-40b8-bc14-7338822bcac0 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Request method failure captured: Sep 23 05:20:35.733670 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/de566974-620a-4faa-9da4-62621e7b69bc HTTP/1.1 Sep 23 05:20:35.733670 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 05:20:35.733670 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 05:20:35.733670 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 05:20:35.733670 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 05:20:35.733670 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 05:20:35.733670 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 05:20:35.733670 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 05:20:35.733670 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 05:20:35.733670 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLT3uLjiu4nPUFbkjrA4MyWVqiSG18wQr6d8tQl_P_I7oXAw8rp2FE6LolJR7q-NpMkbDL2xBtL-Km4xLll-czE6HybNQXkbhp5AdNp7lc8uSbgBeOP-qACziHhtaYPCszQMgYlHiKqFljv5hFyHB9WCa7Y2j2z8m1qKy7sQfYfHm2rE Sep 23 05:20:35.733670 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 05:20:35.733670 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 05:20:35.733670 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 05:20:35.733670 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 05:20:35.733670 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 05:20:35.733670 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 05:20:35.733670 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: cceaa1e24146497fbf3f79cebc112211 Sep 23 05:20:35.733670 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-TestVolumeBootPattern-1815855430 Sep 23 05:20:35.733670 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 05:20:35.733670 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 05:20:35.733670 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cceaa1e24146497fbf3f79cebc112211", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cceaa1e24146497fbf3f79cebc112211"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cceaa1e24146497fbf3f79cebc112211"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cceaa1e24146497fbf3f79cebc112211"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:20:35.733670 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-TestVolumeBootPattern-1815855430 Sep 23 05:20:35.733670 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: cceaa1e24146497fbf3f79cebc112211 Sep 23 05:20:35.733670 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-TestVolumeBootPattern-1815855430 Sep 23 05:20:35.733670 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-TestVolumeBootPattern-1815855430-project Sep 23 05:20:35.733670 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 05:20:35.733670 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 05:20:35.733670 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 0d55fe5072c14752846eb4ffc0eef91b Sep 23 05:20:35.733670 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-TestVolumeBootPattern-1815855430-project Sep 23 05:20:35.733670 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 05:20:35.733670 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance de566974-620a-4faa-9da4-62621e7b69bc could not be found. Sep 23 05:20:35.733670 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': 'de566974-620a-4faa-9da4-62621e7b69bc'} Sep 23 05:20:35.733670 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:20:35.733670 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:20:35.733670 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 05:20:35.733670 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 05:20:35.733670 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 05:20:35.733670 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 05:20:35.733670 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 05:20:35.733670 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 05:20:35.733670 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 05:20:35.733670 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 05:20:35.733670 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de566974-620a-4faa-9da4-62621e7b69bc could not be found. Sep 23 05:20:35.733670 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:20:35.733670 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:20:35.733670 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:20:35.733670 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:20:35.733670 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:20:35.733670 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:20:35.733670 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:20:35.733670 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:20:35.733670 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:20:35.733670 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:20:35.733670 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 05:20:35.733670 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 05:20:35.733670 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 05:20:35.733670 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 05:20:35.733670 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 05:20:35.733670 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:20:35.733670 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de566974-620a-4faa-9da4-62621e7b69bc could not be found. Sep 23 05:20:35.733670 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:20:35.733670 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:20:35.733670 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:20:35.738880 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:20:35.738880 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:20:35.738880 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:20:35.738880 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:20:35.738880 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:20:35.738880 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de566974-620a-4faa-9da4-62621e7b69bc could not be found. Sep 23 05:20:35.738880 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:20:35.738880 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e71a02eb-39ae-40b8-bc14-7338822bcac0 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Returning 404 to user: Instance de566974-620a-4faa-9da4-62621e7b69bc could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:20:35.738880 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e71a02eb-39ae-40b8-bc14-7338822bcac0 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/de566974-620a-4faa-9da4-62621e7b69bc" status: 404 len: 111 microversion: 2.1 time: 0.033757 Sep 23 05:20:35.738880 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3371/6920] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:20:35 2022] GET /compute/v2.1/servers/de566974-620a-4faa-9da4-62621e7b69bc => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 05:20:42.340717 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-86a5f757-8ad4-4254-96b7-edd202a281e2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:20:42.341391 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-86a5f757-8ad4-4254-96b7-edd202a281e2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 9aded1fa-828e-4b24-9492-1ad1ea8ebfca] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:20:42.342253 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-2d3e1554-b449-4d1f-bca0-970ed2fff11f req-9d30f737-8297-451b-b3e5-3b9e22ec4bda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9aded1fa-828e-4b24-9492-1ad1ea8ebfca", "tag": "cc8e0cff-5468-4bb5-9da3-b06f41c72657"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:20:42.348582 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-86a5f757-8ad4-4254-96b7-edd202a281e2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:20:42.349265 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-86a5f757-8ad4-4254-96b7-edd202a281e2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:20:42.349858 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-86a5f757-8ad4-4254-96b7-edd202a281e2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:20:42.350759 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-86a5f757-8ad4-4254-96b7-edd202a281e2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:20:42.351361 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-86a5f757-8ad4-4254-96b7-edd202a281e2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:20:42.351995 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-86a5f757-8ad4-4254-96b7-edd202a281e2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:20:42.353754 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-2d3e1554-b449-4d1f-bca0-970ed2fff11f req-9d30f737-8297-451b-b3e5-3b9e22ec4bda service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:20:42.354437 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-2d3e1554-b449-4d1f-bca0-970ed2fff11f req-9d30f737-8297-451b-b3e5-3b9e22ec4bda service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:20:42.355073 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-2d3e1554-b449-4d1f-bca0-970ed2fff11f req-9d30f737-8297-451b-b3e5-3b9e22ec4bda service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:20:42.367668 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-2d3e1554-b449-4d1f-bca0-970ed2fff11f req-9d30f737-8297-451b-b3e5-3b9e22ec4bda service nova] Creating event network-changed:cc8e0cff-5468-4bb5-9da3-b06f41c72657 for instance 9aded1fa-828e-4b24-9492-1ad1ea8ebfca on n-h2-846463-3 Sep 23 05:20:42.383860 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-86a5f757-8ad4-4254-96b7-edd202a281e2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 9aded1fa-828e-4b24-9492-1ad1ea8ebfca] Going to try to terminate instance {{(pid=122699) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 05:20:42.386320 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-2d3e1554-b449-4d1f-bca0-970ed2fff11f req-9d30f737-8297-451b-b3e5-3b9e22ec4bda service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048792 Sep 23 05:20:42.388561 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3372/6921] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:20:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 05:20:42.731661 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-86a5f757-8ad4-4254-96b7-edd202a281e2 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9aded1fa-828e-4b24-9492-1ad1ea8ebfca" status: 204 len: 0 microversion: 2.1 time: 0.396455 Sep 23 05:20:42.738216 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3550/6922] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 05:20:42 2022] DELETE /compute/v2.1/servers/9aded1fa-828e-4b24-9492-1ad1ea8ebfca => generated 0 bytes in 398 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 05:20:42.741302 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-efc19f3f-397b-42dc-b0e7-1fd13e8b6681 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:20:42.742092 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-efc19f3f-397b-42dc-b0e7-1fd13e8b6681 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 9aded1fa-828e-4b24-9492-1ad1ea8ebfca] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:20:42.748954 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-efc19f3f-397b-42dc-b0e7-1fd13e8b6681 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:20:42.749471 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-efc19f3f-397b-42dc-b0e7-1fd13e8b6681 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:20:42.749950 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-efc19f3f-397b-42dc-b0e7-1fd13e8b6681 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:20:42.750673 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-efc19f3f-397b-42dc-b0e7-1fd13e8b6681 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:20:42.751156 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-efc19f3f-397b-42dc-b0e7-1fd13e8b6681 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:20:42.751659 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-efc19f3f-397b-42dc-b0e7-1fd13e8b6681 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:20:42.914193 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-efc19f3f-397b-42dc-b0e7-1fd13e8b6681 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:20:42.927303 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-efc19f3f-397b-42dc-b0e7-1fd13e8b6681 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/9aded1fa-828e-4b24-9492-1ad1ea8ebfca" status: 200 len: 1577 microversion: 2.1 time: 0.190228 Sep 23 05:20:42.927902 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3373/6923] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:20:42 2022] GET /compute/v2.1/servers/9aded1fa-828e-4b24-9492-1ad1ea8ebfca => generated 1577 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:20:43.952380 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-bc3f0ca5-49d8-42d2-a094-a8dffb391f19 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:20:43.953096 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-bc3f0ca5-49d8-42d2-a094-a8dffb391f19 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 9aded1fa-828e-4b24-9492-1ad1ea8ebfca] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:20:43.959823 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bc3f0ca5-49d8-42d2-a094-a8dffb391f19 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:20:43.960307 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bc3f0ca5-49d8-42d2-a094-a8dffb391f19 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:20:43.960924 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bc3f0ca5-49d8-42d2-a094-a8dffb391f19 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:20:43.961702 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bc3f0ca5-49d8-42d2-a094-a8dffb391f19 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:20:43.962197 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bc3f0ca5-49d8-42d2-a094-a8dffb391f19 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:20:43.962643 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bc3f0ca5-49d8-42d2-a094-a8dffb391f19 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:20:44.030870 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-bc3f0ca5-49d8-42d2-a094-a8dffb391f19 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:20:44.039399 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-bc3f0ca5-49d8-42d2-a094-a8dffb391f19 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/9aded1fa-828e-4b24-9492-1ad1ea8ebfca" status: 200 len: 1391 microversion: 2.1 time: 0.091488 Sep 23 05:20:44.048284 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3551/6924] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:20:43 2022] GET /compute/v2.1/servers/9aded1fa-828e-4b24-9492-1ad1ea8ebfca => generated 1391 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:20:44.414286 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-a3c21a76-b182-41e2-a9e6-0806833c967f req-3d803e2d-7997-4765-93d2-b89dceedc602 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9aded1fa-828e-4b24-9492-1ad1ea8ebfca", "name": "network-vif-deleted", "tag": "cc8e0cff-5468-4bb5-9da3-b06f41c72657"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:20:44.425083 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-a3c21a76-b182-41e2-a9e6-0806833c967f req-3d803e2d-7997-4765-93d2-b89dceedc602 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:20:44.425707 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-a3c21a76-b182-41e2-a9e6-0806833c967f req-3d803e2d-7997-4765-93d2-b89dceedc602 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:20:44.426297 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-a3c21a76-b182-41e2-a9e6-0806833c967f req-3d803e2d-7997-4765-93d2-b89dceedc602 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:20:44.438414 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-a3c21a76-b182-41e2-a9e6-0806833c967f req-3d803e2d-7997-4765-93d2-b89dceedc602 service nova] Creating event network-vif-deleted:cc8e0cff-5468-4bb5-9da3-b06f41c72657 for instance 9aded1fa-828e-4b24-9492-1ad1ea8ebfca on n-h2-846463-3 Sep 23 05:20:44.443544 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-a3c21a76-b182-41e2-a9e6-0806833c967f req-3d803e2d-7997-4765-93d2-b89dceedc602 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033357 Sep 23 05:20:44.444240 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3374/6925] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:20:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 05:20:45.064553 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-877301a6-208e-4255-8994-5208fc5d429d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:20:45.065097 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-877301a6-208e-4255-8994-5208fc5d429d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 9aded1fa-828e-4b24-9492-1ad1ea8ebfca] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:20:45.073554 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-877301a6-208e-4255-8994-5208fc5d429d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:20:45.074907 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-877301a6-208e-4255-8994-5208fc5d429d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:20:45.075523 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-877301a6-208e-4255-8994-5208fc5d429d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:20:45.076388 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-877301a6-208e-4255-8994-5208fc5d429d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:20:45.077015 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-877301a6-208e-4255-8994-5208fc5d429d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:20:45.077450 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-877301a6-208e-4255-8994-5208fc5d429d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:20:45.150137 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-877301a6-208e-4255-8994-5208fc5d429d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:20:45.158554 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-877301a6-208e-4255-8994-5208fc5d429d tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/9aded1fa-828e-4b24-9492-1ad1ea8ebfca" status: 200 len: 1224 microversion: 2.1 time: 0.097937 Sep 23 05:20:45.159085 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3552/6926] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:20:45 2022] GET /compute/v2.1/servers/9aded1fa-828e-4b24-9492-1ad1ea8ebfca => generated 1224 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:20:46.181294 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4d453edd-6f62-453e-9c75-7eb25ed0ba7c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:20:46.182050 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4d453edd-6f62-453e-9c75-7eb25ed0ba7c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 9aded1fa-828e-4b24-9492-1ad1ea8ebfca] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:20:46.190335 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4d453edd-6f62-453e-9c75-7eb25ed0ba7c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:20:46.191208 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4d453edd-6f62-453e-9c75-7eb25ed0ba7c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:20:46.191864 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4d453edd-6f62-453e-9c75-7eb25ed0ba7c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:20:46.192793 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4d453edd-6f62-453e-9c75-7eb25ed0ba7c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:20:46.193280 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4d453edd-6f62-453e-9c75-7eb25ed0ba7c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:20:46.193740 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4d453edd-6f62-453e-9c75-7eb25ed0ba7c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:20:46.258440 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4d453edd-6f62-453e-9c75-7eb25ed0ba7c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:20:46.266930 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4d453edd-6f62-453e-9c75-7eb25ed0ba7c tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/9aded1fa-828e-4b24-9492-1ad1ea8ebfca" status: 200 len: 1224 microversion: 2.1 time: 0.089960 Sep 23 05:20:46.267527 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3375/6927] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:20:46 2022] GET /compute/v2.1/servers/9aded1fa-828e-4b24-9492-1ad1ea8ebfca => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:20:47.289447 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c69615ef-9170-4014-b52b-bf54efee83db tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:20:47.290088 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c69615ef-9170-4014-b52b-bf54efee83db tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 9aded1fa-828e-4b24-9492-1ad1ea8ebfca] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:20:47.299328 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c69615ef-9170-4014-b52b-bf54efee83db tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:20:47.299328 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c69615ef-9170-4014-b52b-bf54efee83db tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:20:47.299328 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c69615ef-9170-4014-b52b-bf54efee83db tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:20:47.299328 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c69615ef-9170-4014-b52b-bf54efee83db tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:20:47.299328 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c69615ef-9170-4014-b52b-bf54efee83db tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:20:47.300895 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c69615ef-9170-4014-b52b-bf54efee83db tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:20:47.366976 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c69615ef-9170-4014-b52b-bf54efee83db tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:20:47.374920 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c69615ef-9170-4014-b52b-bf54efee83db tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/9aded1fa-828e-4b24-9492-1ad1ea8ebfca" status: 200 len: 1224 microversion: 2.1 time: 0.089447 Sep 23 05:20:47.375499 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3553/6928] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:20:47 2022] GET /compute/v2.1/servers/9aded1fa-828e-4b24-9492-1ad1ea8ebfca => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:20:48.400602 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d87e53ef-3162-4ec2-9823-34829c50b2b1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:20:48.403405 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d87e53ef-3162-4ec2-9823-34829c50b2b1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 9aded1fa-828e-4b24-9492-1ad1ea8ebfca] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:20:48.410917 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d87e53ef-3162-4ec2-9823-34829c50b2b1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:20:48.411430 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d87e53ef-3162-4ec2-9823-34829c50b2b1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:20:48.411890 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d87e53ef-3162-4ec2-9823-34829c50b2b1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:20:48.412625 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d87e53ef-3162-4ec2-9823-34829c50b2b1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:20:48.413100 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d87e53ef-3162-4ec2-9823-34829c50b2b1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:20:48.413689 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d87e53ef-3162-4ec2-9823-34829c50b2b1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:20:48.448509 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d87e53ef-3162-4ec2-9823-34829c50b2b1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:20:48.449035 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d87e53ef-3162-4ec2-9823-34829c50b2b1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:20:48.449486 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d87e53ef-3162-4ec2-9823-34829c50b2b1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:20:48.450884 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-d87e53ef-3162-4ec2-9823-34829c50b2b1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lazy-loading 'fault' on Instance uuid 9aded1fa-828e-4b24-9492-1ad1ea8ebfca {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 05:20:48.499777 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d87e53ef-3162-4ec2-9823-34829c50b2b1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d55fe5072c14752846eb4ffc0eef91b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cceaa1e24146497fbf3f79cebc112211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:20:48.507709 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d87e53ef-3162-4ec2-9823-34829c50b2b1 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/9aded1fa-828e-4b24-9492-1ad1ea8ebfca" status: 200 len: 1229 microversion: 2.1 time: 0.112866 Sep 23 05:20:48.511586 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3376/6929] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:20:48 2022] GET /compute/v2.1/servers/9aded1fa-828e-4b24-9492-1ad1ea8ebfca => generated 1229 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:20:49.531291 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-84ca5da1-9c3f-4186-b84f-83f322e8a613 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:20:49.531925 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-84ca5da1-9c3f-4186-b84f-83f322e8a613 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: 9aded1fa-828e-4b24-9492-1ad1ea8ebfca] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:20:49.538669 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-84ca5da1-9c3f-4186-b84f-83f322e8a613 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:20:49.539165 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-84ca5da1-9c3f-4186-b84f-83f322e8a613 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:20:49.539609 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-84ca5da1-9c3f-4186-b84f-83f322e8a613 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:20:49.540321 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-84ca5da1-9c3f-4186-b84f-83f322e8a613 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:20:49.540786 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-84ca5da1-9c3f-4186-b84f-83f322e8a613 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:20:49.541217 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-84ca5da1-9c3f-4186-b84f-83f322e8a613 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:20:49.554667 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-84ca5da1-9c3f-4186-b84f-83f322e8a613 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] HTTP exception thrown: Instance 9aded1fa-828e-4b24-9492-1ad1ea8ebfca could not be found. Sep 23 05:20:49.563425 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-84ca5da1-9c3f-4186-b84f-83f322e8a613 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Request method failure captured: Sep 23 05:20:49.563425 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/9aded1fa-828e-4b24-9492-1ad1ea8ebfca HTTP/1.1 Sep 23 05:20:49.563425 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 05:20:49.563425 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 05:20:49.563425 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 05:20:49.563425 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 05:20:49.563425 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 05:20:49.563425 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 05:20:49.563425 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 05:20:49.563425 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 05:20:49.563425 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLT3uLjiu4nPUFbkjrA4MyWVqiSG18wQr6d8tQl_P_I7oXAw8rp2FE6LolJR7q-NpMkbDL2xBtL-Km4xLll-czE6HybNQXkbhp5AdNp7lc8uSbgBeOP-qACziHhtaYPCszQMgYlHiKqFljv5hFyHB9WCa7Y2j2z8m1qKy7sQfYfHm2rE Sep 23 05:20:49.563425 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 05:20:49.563425 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 05:20:49.563425 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 05:20:49.563425 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 05:20:49.563425 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 05:20:49.563425 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 05:20:49.563425 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: cceaa1e24146497fbf3f79cebc112211 Sep 23 05:20:49.563425 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-TestVolumeBootPattern-1815855430 Sep 23 05:20:49.563425 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 05:20:49.563425 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 05:20:49.563425 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cceaa1e24146497fbf3f79cebc112211", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cceaa1e24146497fbf3f79cebc112211"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cceaa1e24146497fbf3f79cebc112211"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cceaa1e24146497fbf3f79cebc112211"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:20:49.563425 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-TestVolumeBootPattern-1815855430 Sep 23 05:20:49.563425 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: cceaa1e24146497fbf3f79cebc112211 Sep 23 05:20:49.563425 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-TestVolumeBootPattern-1815855430 Sep 23 05:20:49.563425 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-TestVolumeBootPattern-1815855430-project Sep 23 05:20:49.563425 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 05:20:49.563425 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 05:20:49.563425 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 0d55fe5072c14752846eb4ffc0eef91b Sep 23 05:20:49.563425 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-TestVolumeBootPattern-1815855430-project Sep 23 05:20:49.563425 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 05:20:49.563425 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 9aded1fa-828e-4b24-9492-1ad1ea8ebfca could not be found. Sep 23 05:20:49.563425 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '9aded1fa-828e-4b24-9492-1ad1ea8ebfca'} Sep 23 05:20:49.563425 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:20:49.563425 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:20:49.563425 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 05:20:49.563425 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 05:20:49.563425 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 05:20:49.563425 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 05:20:49.563425 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 05:20:49.563425 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 05:20:49.563425 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 05:20:49.563425 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 05:20:49.563425 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9aded1fa-828e-4b24-9492-1ad1ea8ebfca could not be found. Sep 23 05:20:49.563425 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:20:49.563425 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:20:49.563425 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:20:49.563425 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:20:49.563425 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:20:49.563425 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:20:49.563425 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:20:49.563425 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:20:49.563425 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:20:49.563425 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:20:49.563425 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 05:20:49.563425 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 05:20:49.563425 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 05:20:49.563425 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 05:20:49.563425 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 05:20:49.563425 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:20:49.563425 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9aded1fa-828e-4b24-9492-1ad1ea8ebfca could not be found. Sep 23 05:20:49.563425 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:20:49.563425 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:20:49.563425 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:20:49.567399 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:20:49.567399 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:20:49.567399 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:20:49.567399 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:20:49.567399 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:20:49.567399 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9aded1fa-828e-4b24-9492-1ad1ea8ebfca could not be found. Sep 23 05:20:49.567399 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:20:49.567399 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-84ca5da1-9c3f-4186-b84f-83f322e8a613 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Returning 404 to user: Instance 9aded1fa-828e-4b24-9492-1ad1ea8ebfca could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:20:49.567399 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-84ca5da1-9c3f-4186-b84f-83f322e8a613 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/9aded1fa-828e-4b24-9492-1ad1ea8ebfca" status: 404 len: 111 microversion: 2.1 time: 0.030478 Sep 23 05:20:49.567399 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3554/6930] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:20:49 2022] GET /compute/v2.1/servers/9aded1fa-828e-4b24-9492-1ad1ea8ebfca => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 05:20:50.092598 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-bf979747-7a90-4e77-905a-17558524f1c3 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:20:50.093125 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-bf979747-7a90-4e77-905a-17558524f1c3 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: d51a5b7d-90cb-4bd7-a258-22fd5a0df673] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:20:50.100001 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bf979747-7a90-4e77-905a-17558524f1c3 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:20:50.100504 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bf979747-7a90-4e77-905a-17558524f1c3 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:20:50.100959 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bf979747-7a90-4e77-905a-17558524f1c3 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:20:50.101668 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bf979747-7a90-4e77-905a-17558524f1c3 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:20:50.102188 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bf979747-7a90-4e77-905a-17558524f1c3 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:20:50.102631 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bf979747-7a90-4e77-905a-17558524f1c3 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:20:50.122972 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-bf979747-7a90-4e77-905a-17558524f1c3 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] HTTP exception thrown: Instance d51a5b7d-90cb-4bd7-a258-22fd5a0df673 could not be found. Sep 23 05:20:50.124673 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-bf979747-7a90-4e77-905a-17558524f1c3 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Request method failure captured: Sep 23 05:20:50.124673 n-d-846463-3 devstack@n-api.service[122698]: request: DELETE /compute/v2.1/servers/d51a5b7d-90cb-4bd7-a258-22fd5a0df673 HTTP/1.1 Sep 23 05:20:50.124673 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 05:20:50.124673 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 05:20:50.124673 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 05:20:50.124673 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 05:20:50.124673 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 05:20:50.124673 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 05:20:50.124673 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 05:20:50.124673 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 05:20:50.124673 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLT3uLjiu4nPUFbkjrA4MyWVqiSG18wQr6d8tQl_P_I7oXAw8rp2FE6LolJR7q-NpMkbDL2xBtL-Km4xLll-czE6HybNQXkbhp5AdNp7lc8uSbgBeOP-qACziHhtaYPCszQMgYlHiKqFljv5hFyHB9WCa7Y2j2z8m1qKy7sQfYfHm2rE Sep 23 05:20:50.124673 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 05:20:50.124673 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 05:20:50.124673 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 05:20:50.124673 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 05:20:50.124673 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 05:20:50.124673 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 05:20:50.124673 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: cceaa1e24146497fbf3f79cebc112211 Sep 23 05:20:50.124673 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-TestVolumeBootPattern-1815855430 Sep 23 05:20:50.124673 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 05:20:50.124673 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 05:20:50.124673 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cceaa1e24146497fbf3f79cebc112211", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cceaa1e24146497fbf3f79cebc112211"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cceaa1e24146497fbf3f79cebc112211"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cceaa1e24146497fbf3f79cebc112211"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:20:50.124673 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-TestVolumeBootPattern-1815855430 Sep 23 05:20:50.124673 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: cceaa1e24146497fbf3f79cebc112211 Sep 23 05:20:50.124673 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-TestVolumeBootPattern-1815855430 Sep 23 05:20:50.124673 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-TestVolumeBootPattern-1815855430-project Sep 23 05:20:50.124673 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 05:20:50.124673 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 05:20:50.124673 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 0d55fe5072c14752846eb4ffc0eef91b Sep 23 05:20:50.124673 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-TestVolumeBootPattern-1815855430-project Sep 23 05:20:50.124673 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 05:20:50.124673 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance d51a5b7d-90cb-4bd7-a258-22fd5a0df673 could not be found. Sep 23 05:20:50.124673 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': 'd51a5b7d-90cb-4bd7-a258-22fd5a0df673'} Sep 23 05:20:50.124673 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:20:50.124673 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:20:50.124673 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 05:20:50.124673 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 05:20:50.124673 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 05:20:50.124673 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 05:20:50.124673 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 05:20:50.124673 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 05:20:50.124673 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 05:20:50.124673 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 05:20:50.124673 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d51a5b7d-90cb-4bd7-a258-22fd5a0df673 could not be found. Sep 23 05:20:50.124673 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:20:50.124673 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:20:50.124673 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:20:50.124673 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:20:50.124673 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:20:50.124673 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:20:50.124673 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:20:50.124673 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:20:50.124673 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:20:50.124673 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:20:50.124673 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 05:20:50.124673 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 05:20:50.124673 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 05:20:50.124673 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 05:20:50.124673 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 05:20:50.124673 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 05:20:50.124673 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 05:20:50.124673 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:20:50.128219 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d51a5b7d-90cb-4bd7-a258-22fd5a0df673 could not be found. Sep 23 05:20:50.128219 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:20:50.128219 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:20:50.128219 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:20:50.128219 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:20:50.128219 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:20:50.128219 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:20:50.128219 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:20:50.128219 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:20:50.128219 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d51a5b7d-90cb-4bd7-a258-22fd5a0df673 could not be found. Sep 23 05:20:50.128219 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:20:50.128219 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-bf979747-7a90-4e77-905a-17558524f1c3 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Returning 404 to user: Instance d51a5b7d-90cb-4bd7-a258-22fd5a0df673 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:20:50.128219 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-bf979747-7a90-4e77-905a-17558524f1c3 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "DELETE /compute/v2.1/servers/d51a5b7d-90cb-4bd7-a258-22fd5a0df673" status: 404 len: 111 microversion: 2.1 time: 0.038335 Sep 23 05:20:50.129797 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3377/6931] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 05:20:50 2022] DELETE /compute/v2.1/servers/d51a5b7d-90cb-4bd7-a258-22fd5a0df673 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 05:20:50.134941 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-cd4a4a3b-a316-4d98-90cd-05ae1af4eb30 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:20:50.135644 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-cd4a4a3b-a316-4d98-90cd-05ae1af4eb30 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] [instance: d51a5b7d-90cb-4bd7-a258-22fd5a0df673] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:20:50.142789 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cd4a4a3b-a316-4d98-90cd-05ae1af4eb30 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:20:50.143283 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cd4a4a3b-a316-4d98-90cd-05ae1af4eb30 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:20:50.143724 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cd4a4a3b-a316-4d98-90cd-05ae1af4eb30 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:20:50.144421 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cd4a4a3b-a316-4d98-90cd-05ae1af4eb30 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:20:50.144881 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cd4a4a3b-a316-4d98-90cd-05ae1af4eb30 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:20:50.145310 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cd4a4a3b-a316-4d98-90cd-05ae1af4eb30 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:20:50.159424 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-cd4a4a3b-a316-4d98-90cd-05ae1af4eb30 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] HTTP exception thrown: Instance d51a5b7d-90cb-4bd7-a258-22fd5a0df673 could not be found. Sep 23 05:20:50.160961 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-cd4a4a3b-a316-4d98-90cd-05ae1af4eb30 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Request method failure captured: Sep 23 05:20:50.160961 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/d51a5b7d-90cb-4bd7-a258-22fd5a0df673 HTTP/1.1 Sep 23 05:20:50.160961 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 05:20:50.160961 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 05:20:50.160961 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 05:20:50.160961 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 05:20:50.160961 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 05:20:50.160961 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 05:20:50.160961 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 05:20:50.160961 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 05:20:50.160961 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLT3uLjiu4nPUFbkjrA4MyWVqiSG18wQr6d8tQl_P_I7oXAw8rp2FE6LolJR7q-NpMkbDL2xBtL-Km4xLll-czE6HybNQXkbhp5AdNp7lc8uSbgBeOP-qACziHhtaYPCszQMgYlHiKqFljv5hFyHB9WCa7Y2j2z8m1qKy7sQfYfHm2rE Sep 23 05:20:50.160961 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 05:20:50.160961 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 05:20:50.160961 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 05:20:50.160961 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 05:20:50.160961 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 05:20:50.160961 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 05:20:50.160961 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: cceaa1e24146497fbf3f79cebc112211 Sep 23 05:20:50.160961 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-TestVolumeBootPattern-1815855430 Sep 23 05:20:50.160961 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 05:20:50.160961 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 05:20:50.160961 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cceaa1e24146497fbf3f79cebc112211", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cceaa1e24146497fbf3f79cebc112211"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cceaa1e24146497fbf3f79cebc112211"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cceaa1e24146497fbf3f79cebc112211"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:20:50.160961 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-TestVolumeBootPattern-1815855430 Sep 23 05:20:50.160961 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: cceaa1e24146497fbf3f79cebc112211 Sep 23 05:20:50.160961 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-TestVolumeBootPattern-1815855430 Sep 23 05:20:50.160961 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-TestVolumeBootPattern-1815855430-project Sep 23 05:20:50.160961 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 05:20:50.160961 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 05:20:50.160961 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 0d55fe5072c14752846eb4ffc0eef91b Sep 23 05:20:50.160961 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-TestVolumeBootPattern-1815855430-project Sep 23 05:20:50.160961 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 05:20:50.160961 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance d51a5b7d-90cb-4bd7-a258-22fd5a0df673 could not be found. Sep 23 05:20:50.160961 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': 'd51a5b7d-90cb-4bd7-a258-22fd5a0df673'} Sep 23 05:20:50.160961 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:20:50.160961 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:20:50.160961 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 05:20:50.160961 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 05:20:50.160961 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 05:20:50.160961 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 05:20:50.160961 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 05:20:50.160961 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 05:20:50.160961 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 05:20:50.160961 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 05:20:50.160961 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d51a5b7d-90cb-4bd7-a258-22fd5a0df673 could not be found. Sep 23 05:20:50.160961 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:20:50.160961 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:20:50.160961 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:20:50.160961 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:20:50.160961 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:20:50.160961 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:20:50.160961 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:20:50.160961 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:20:50.160961 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:20:50.160961 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:20:50.160961 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 05:20:50.160961 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 05:20:50.160961 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 05:20:50.160961 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 05:20:50.160961 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 05:20:50.160961 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:20:50.160961 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d51a5b7d-90cb-4bd7-a258-22fd5a0df673 could not be found. Sep 23 05:20:50.160961 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:20:50.160961 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:20:50.160961 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:20:50.165290 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:20:50.165290 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:20:50.165290 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:20:50.165290 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:20:50.165290 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:20:50.165290 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d51a5b7d-90cb-4bd7-a258-22fd5a0df673 could not be found. Sep 23 05:20:50.165290 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:20:50.165290 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-cd4a4a3b-a316-4d98-90cd-05ae1af4eb30 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Returning 404 to user: Instance d51a5b7d-90cb-4bd7-a258-22fd5a0df673 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:20:50.165290 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-cd4a4a3b-a316-4d98-90cd-05ae1af4eb30 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "GET /compute/v2.1/servers/d51a5b7d-90cb-4bd7-a258-22fd5a0df673" status: 404 len: 111 microversion: 2.1 time: 0.031366 Sep 23 05:20:50.165290 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3555/6932] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:20:50 2022] GET /compute/v2.1/servers/d51a5b7d-90cb-4bd7-a258-22fd5a0df673 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 05:20:53.838253 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c356aa84-5ca0-48a2-bb57-344a302f4265 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] Calling method '.version_select at 0x7ff1ba714a60>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:20:53.938380 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c356aa84-5ca0-48a2-bb57-344a302f4265 tempest-TestVolumeBootPattern-1815855430 tempest-TestVolumeBootPattern-1815855430-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-63253902" status: 202 len: 0 microversion: 2.1 time: 0.105461 Sep 23 05:20:53.939206 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3378/6933] 10.222.0.33 () {58 vars in 1257 bytes} [Fri Sep 23 05:20:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-63253902 => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 05:21:54.454312 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:21:54.455100 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:21:54.459016 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7d8b13a3-1c87-47e3-8cf3-d0bda636ef7b tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-267894223", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "networks": [{"uuid": "07bcedf4-2eec-47c7-8054-9a76d691c1dc"}]}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:21:54.513477 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.neutron [None req-7d8b13a3-1c87-47e3-8cf3-d0bda636ef7b tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] validate_networks() for [('07bcedf4-2eec-47c7-8054-9a76d691c1dc', None, None, None, None, None)] {{(pid=122699) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 05:21:54.997116 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-7d8b13a3-1c87-47e3-8cf3-d0bda636ef7b tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Flavor limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 05:21:54.997549 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-7d8b13a3-1c87-47e3-8cf3-d0bda636ef7b tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Image limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 05:21:54.998070 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-7d8b13a3-1c87-47e3-8cf3-d0bda636ef7b tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Flavor pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 05:21:54.998504 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-7d8b13a3-1c87-47e3-8cf3-d0bda636ef7b tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Image pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 05:21:54.998902 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-7d8b13a3-1c87-47e3-8cf3-d0bda636ef7b tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 05:21:55.008068 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7d8b13a3-1c87-47e3-8cf3-d0bda636ef7b tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:21:55.008503 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7d8b13a3-1c87-47e3-8cf3-d0bda636ef7b tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:21:55.008980 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7d8b13a3-1c87-47e3-8cf3-d0bda636ef7b tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:21:55.009748 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7d8b13a3-1c87-47e3-8cf3-d0bda636ef7b tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:21:55.010244 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7d8b13a3-1c87-47e3-8cf3-d0bda636ef7b tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:21:55.010680 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7d8b13a3-1c87-47e3-8cf3-d0bda636ef7b tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:21:55.029154 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-7d8b13a3-1c87-47e3-8cf3-d0bda636ef7b tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Getting quotas for project bb4c94bbd5524e6c93e6e0c80181dbab. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 05:21:55.034504 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-7d8b13a3-1c87-47e3-8cf3-d0bda636ef7b tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Getting quotas for user a53f9b80a8c3436c96d42482086fd588 and project bb4c94bbd5524e6c93e6e0c80181dbab. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 05:21:55.046945 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-7d8b13a3-1c87-47e3-8cf3-d0bda636ef7b tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Going to run 1 instances... {{(pid=122699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 05:21:55.049287 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-7d8b13a3-1c87-47e3-8cf3-d0bda636ef7b tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] [instance: 8a0b9633-813c-47a4-aecc-04a94178e936] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 05:21:55.187181 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-7d8b13a3-1c87-47e3-8cf3-d0bda636ef7b tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.734935 Sep 23 05:21:55.187840 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3556/6934] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 05:21:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 736 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 05:21:55.200974 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=50 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:21:55.201869 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=29,nova_api:DELETE=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:21:55.206218 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f4ae226d-956f-423c-af86-da34c96db725 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:21:55.206844 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f4ae226d-956f-423c-af86-da34c96db725 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] [instance: 8a0b9633-813c-47a4-aecc-04a94178e936] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:21:55.262448 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f4ae226d-956f-423c-af86-da34c96db725 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53f9b80a8c3436c96d42482086fd588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c94bbd5524e6c93e6e0c80181dbab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:21:55.270597 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f4ae226d-956f-423c-af86-da34c96db725 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] 10.222.0.33 "GET /compute/v2.1/servers/8a0b9633-813c-47a4-aecc-04a94178e936" status: 200 len: 1218 microversion: 2.1 time: 0.073930 Sep 23 05:21:55.271171 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3379/6935] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:21:55 2022] GET /compute/v2.1/servers/8a0b9633-813c-47a4-aecc-04a94178e936 => generated 1218 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:21:56.294416 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a6851497-1a00-4364-b208-74f48ae150fb tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:21:56.295037 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a6851497-1a00-4364-b208-74f48ae150fb tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] [instance: 8a0b9633-813c-47a4-aecc-04a94178e936] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:21:56.353570 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a6851497-1a00-4364-b208-74f48ae150fb tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53f9b80a8c3436c96d42482086fd588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c94bbd5524e6c93e6e0c80181dbab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:21:56.360661 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a6851497-1a00-4364-b208-74f48ae150fb tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] 10.222.0.33 "GET /compute/v2.1/servers/8a0b9633-813c-47a4-aecc-04a94178e936" status: 200 len: 1218 microversion: 2.1 time: 0.071653 Sep 23 05:21:56.361245 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3557/6936] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:21:56 2022] GET /compute/v2.1/servers/8a0b9633-813c-47a4-aecc-04a94178e936 => generated 1218 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:21:57.383395 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-21718d3a-8aee-40a4-9cb2-0be0c354fd82 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:21:57.384032 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-21718d3a-8aee-40a4-9cb2-0be0c354fd82 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] [instance: 8a0b9633-813c-47a4-aecc-04a94178e936] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:21:57.391183 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-21718d3a-8aee-40a4-9cb2-0be0c354fd82 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:21:57.391694 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-21718d3a-8aee-40a4-9cb2-0be0c354fd82 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:21:57.392156 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-21718d3a-8aee-40a4-9cb2-0be0c354fd82 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:21:57.392869 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-21718d3a-8aee-40a4-9cb2-0be0c354fd82 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:21:57.393344 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-21718d3a-8aee-40a4-9cb2-0be0c354fd82 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:21:57.393790 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-21718d3a-8aee-40a4-9cb2-0be0c354fd82 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:21:57.461326 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-21718d3a-8aee-40a4-9cb2-0be0c354fd82 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53f9b80a8c3436c96d42482086fd588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c94bbd5524e6c93e6e0c80181dbab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:21:57.471600 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-21718d3a-8aee-40a4-9cb2-0be0c354fd82 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] 10.222.0.33 "GET /compute/v2.1/servers/8a0b9633-813c-47a4-aecc-04a94178e936" status: 200 len: 1278 microversion: 2.1 time: 0.092129 Sep 23 05:21:57.472461 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3380/6937] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:21:57 2022] GET /compute/v2.1/servers/8a0b9633-813c-47a4-aecc-04a94178e936 => generated 1278 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:21:58.495718 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4adc7187-87b9-4093-8382-ace9dfbf80a4 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:21:58.496341 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4adc7187-87b9-4093-8382-ace9dfbf80a4 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] [instance: 8a0b9633-813c-47a4-aecc-04a94178e936] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:21:58.503037 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4adc7187-87b9-4093-8382-ace9dfbf80a4 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:21:58.503535 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4adc7187-87b9-4093-8382-ace9dfbf80a4 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:21:58.503983 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4adc7187-87b9-4093-8382-ace9dfbf80a4 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:21:58.504722 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4adc7187-87b9-4093-8382-ace9dfbf80a4 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:21:58.505364 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4adc7187-87b9-4093-8382-ace9dfbf80a4 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:21:58.505804 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4adc7187-87b9-4093-8382-ace9dfbf80a4 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:21:58.637577 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-4adc7187-87b9-4093-8382-ace9dfbf80a4 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53f9b80a8c3436c96d42482086fd588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c94bbd5524e6c93e6e0c80181dbab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:21:58.645748 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4adc7187-87b9-4093-8382-ace9dfbf80a4 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] 10.222.0.33 "GET /compute/v2.1/servers/8a0b9633-813c-47a4-aecc-04a94178e936" status: 200 len: 1318 microversion: 2.1 time: 0.153991 Sep 23 05:21:58.646362 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3558/6938] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:21:58 2022] GET /compute/v2.1/servers/8a0b9633-813c-47a4-aecc-04a94178e936 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:21:59.066298 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-b5d871c7-188b-41e7-84f3-006d91738ab5 req-e7ac4ac3-6180-46f3-b6c8-6c0cd69e87f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a0b9633-813c-47a4-aecc-04a94178e936", "tag": "41466f51-a82d-44bc-8611-5d566b79d30e"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:21:59.077574 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-b5d871c7-188b-41e7-84f3-006d91738ab5 req-e7ac4ac3-6180-46f3-b6c8-6c0cd69e87f7 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:21:59.078106 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-b5d871c7-188b-41e7-84f3-006d91738ab5 req-e7ac4ac3-6180-46f3-b6c8-6c0cd69e87f7 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:21:59.078551 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-b5d871c7-188b-41e7-84f3-006d91738ab5 req-e7ac4ac3-6180-46f3-b6c8-6c0cd69e87f7 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:21:59.089649 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-b5d871c7-188b-41e7-84f3-006d91738ab5 req-e7ac4ac3-6180-46f3-b6c8-6c0cd69e87f7 service nova] Creating event network-changed:41466f51-a82d-44bc-8611-5d566b79d30e for instance 8a0b9633-813c-47a4-aecc-04a94178e936 on n-h2-846463-3 Sep 23 05:21:59.094843 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-b5d871c7-188b-41e7-84f3-006d91738ab5 req-e7ac4ac3-6180-46f3-b6c8-6c0cd69e87f7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032415 Sep 23 05:21:59.095656 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3381/6939] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:21:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:21:59.669334 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-48bbee10-6a1c-432b-9a87-80e83ca5e975 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:21:59.669986 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-48bbee10-6a1c-432b-9a87-80e83ca5e975 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] [instance: 8a0b9633-813c-47a4-aecc-04a94178e936] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:21:59.677060 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-48bbee10-6a1c-432b-9a87-80e83ca5e975 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:21:59.677559 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-48bbee10-6a1c-432b-9a87-80e83ca5e975 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:21:59.678026 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-48bbee10-6a1c-432b-9a87-80e83ca5e975 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:21:59.678734 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-48bbee10-6a1c-432b-9a87-80e83ca5e975 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:21:59.679210 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-48bbee10-6a1c-432b-9a87-80e83ca5e975 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:21:59.679647 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-48bbee10-6a1c-432b-9a87-80e83ca5e975 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:21:59.816008 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-48bbee10-6a1c-432b-9a87-80e83ca5e975 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53f9b80a8c3436c96d42482086fd588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c94bbd5524e6c93e6e0c80181dbab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:21:59.823863 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-48bbee10-6a1c-432b-9a87-80e83ca5e975 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] 10.222.0.33 "GET /compute/v2.1/servers/8a0b9633-813c-47a4-aecc-04a94178e936" status: 200 len: 1318 microversion: 2.1 time: 0.158988 Sep 23 05:21:59.824784 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3559/6940] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:21:59 2022] GET /compute/v2.1/servers/8a0b9633-813c-47a4-aecc-04a94178e936 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:22:00.848380 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f80439b1-2a2b-4936-bb4d-23b22c0c971a tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:22:00.849103 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f80439b1-2a2b-4936-bb4d-23b22c0c971a tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] [instance: 8a0b9633-813c-47a4-aecc-04a94178e936] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:22:00.857464 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f80439b1-2a2b-4936-bb4d-23b22c0c971a tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:22:00.858001 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f80439b1-2a2b-4936-bb4d-23b22c0c971a tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:22:00.858458 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f80439b1-2a2b-4936-bb4d-23b22c0c971a tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:22:00.859163 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f80439b1-2a2b-4936-bb4d-23b22c0c971a tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:22:00.859632 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f80439b1-2a2b-4936-bb4d-23b22c0c971a tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:22:00.860069 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f80439b1-2a2b-4936-bb4d-23b22c0c971a tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:22:00.988595 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f80439b1-2a2b-4936-bb4d-23b22c0c971a tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53f9b80a8c3436c96d42482086fd588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c94bbd5524e6c93e6e0c80181dbab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:22:00.996923 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f80439b1-2a2b-4936-bb4d-23b22c0c971a tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] 10.222.0.33 "GET /compute/v2.1/servers/8a0b9633-813c-47a4-aecc-04a94178e936" status: 200 len: 1318 microversion: 2.1 time: 0.153766 Sep 23 05:22:00.997505 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3382/6941] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:22:00 2022] GET /compute/v2.1/servers/8a0b9633-813c-47a4-aecc-04a94178e936 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:22:02.019589 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-45053790-3daa-46d1-843a-f8d9e39cc3c4 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:22:02.020231 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-45053790-3daa-46d1-843a-f8d9e39cc3c4 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] [instance: 8a0b9633-813c-47a4-aecc-04a94178e936] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:22:02.026711 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-45053790-3daa-46d1-843a-f8d9e39cc3c4 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:22:02.027250 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-45053790-3daa-46d1-843a-f8d9e39cc3c4 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:22:02.027713 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-45053790-3daa-46d1-843a-f8d9e39cc3c4 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:22:02.028403 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-45053790-3daa-46d1-843a-f8d9e39cc3c4 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:22:02.028862 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-45053790-3daa-46d1-843a-f8d9e39cc3c4 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:22:02.029285 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-45053790-3daa-46d1-843a-f8d9e39cc3c4 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:22:02.155524 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-45053790-3daa-46d1-843a-f8d9e39cc3c4 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53f9b80a8c3436c96d42482086fd588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c94bbd5524e6c93e6e0c80181dbab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:22:02.163319 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-45053790-3daa-46d1-843a-f8d9e39cc3c4 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] 10.222.0.33 "GET /compute/v2.1/servers/8a0b9633-813c-47a4-aecc-04a94178e936" status: 200 len: 1318 microversion: 2.1 time: 0.147978 Sep 23 05:22:02.167487 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3560/6942] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:22:02 2022] GET /compute/v2.1/servers/8a0b9633-813c-47a4-aecc-04a94178e936 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:22:03.185880 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-07345620-ad0e-4073-a8f1-b4a42d11cb52 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:22:03.186607 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-07345620-ad0e-4073-a8f1-b4a42d11cb52 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] [instance: 8a0b9633-813c-47a4-aecc-04a94178e936] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:22:03.193443 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-07345620-ad0e-4073-a8f1-b4a42d11cb52 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:22:03.193989 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-07345620-ad0e-4073-a8f1-b4a42d11cb52 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:22:03.194451 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-07345620-ad0e-4073-a8f1-b4a42d11cb52 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:22:03.195163 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-07345620-ad0e-4073-a8f1-b4a42d11cb52 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:22:03.195642 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-07345620-ad0e-4073-a8f1-b4a42d11cb52 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:22:03.196085 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-07345620-ad0e-4073-a8f1-b4a42d11cb52 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:22:03.331663 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-07345620-ad0e-4073-a8f1-b4a42d11cb52 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53f9b80a8c3436c96d42482086fd588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c94bbd5524e6c93e6e0c80181dbab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:22:03.340111 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-07345620-ad0e-4073-a8f1-b4a42d11cb52 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] 10.222.0.33 "GET /compute/v2.1/servers/8a0b9633-813c-47a4-aecc-04a94178e936" status: 200 len: 1318 microversion: 2.1 time: 0.157469 Sep 23 05:22:03.340685 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3383/6943] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:22:03 2022] GET /compute/v2.1/servers/8a0b9633-813c-47a4-aecc-04a94178e936 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:22:04.363081 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-aae95993-db48-458b-8bc6-369e8a76dd06 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:22:04.363701 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-aae95993-db48-458b-8bc6-369e8a76dd06 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] [instance: 8a0b9633-813c-47a4-aecc-04a94178e936] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:22:04.370209 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aae95993-db48-458b-8bc6-369e8a76dd06 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:22:04.371201 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aae95993-db48-458b-8bc6-369e8a76dd06 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:22:04.371668 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aae95993-db48-458b-8bc6-369e8a76dd06 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:22:04.372399 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aae95993-db48-458b-8bc6-369e8a76dd06 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:22:04.372863 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aae95993-db48-458b-8bc6-369e8a76dd06 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:22:04.373293 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aae95993-db48-458b-8bc6-369e8a76dd06 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:22:04.504179 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-aae95993-db48-458b-8bc6-369e8a76dd06 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53f9b80a8c3436c96d42482086fd588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c94bbd5524e6c93e6e0c80181dbab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:22:04.513759 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-aae95993-db48-458b-8bc6-369e8a76dd06 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] 10.222.0.33 "GET /compute/v2.1/servers/8a0b9633-813c-47a4-aecc-04a94178e936" status: 200 len: 1318 microversion: 2.1 time: 0.154521 Sep 23 05:22:04.514451 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3561/6944] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:22:04 2022] GET /compute/v2.1/servers/8a0b9633-813c-47a4-aecc-04a94178e936 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:22:04.554509 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-107ac85a-a41c-4b81-bb7e-23bc1263e2f3 req-8dd63e74-d683-4991-ae68-fbe5052fe497 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a0b9633-813c-47a4-aecc-04a94178e936", "name": "network-vif-plugged", "status": "completed", "tag": "41466f51-a82d-44bc-8611-5d566b79d30e"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:22:04.565544 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-107ac85a-a41c-4b81-bb7e-23bc1263e2f3 req-8dd63e74-d683-4991-ae68-fbe5052fe497 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:22:04.566080 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-107ac85a-a41c-4b81-bb7e-23bc1263e2f3 req-8dd63e74-d683-4991-ae68-fbe5052fe497 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:22:04.566534 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-107ac85a-a41c-4b81-bb7e-23bc1263e2f3 req-8dd63e74-d683-4991-ae68-fbe5052fe497 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:22:04.578091 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-107ac85a-a41c-4b81-bb7e-23bc1263e2f3 req-8dd63e74-d683-4991-ae68-fbe5052fe497 service nova] Creating event network-vif-plugged:41466f51-a82d-44bc-8611-5d566b79d30e for instance 8a0b9633-813c-47a4-aecc-04a94178e936 on n-h2-846463-3 Sep 23 05:22:04.582983 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-107ac85a-a41c-4b81-bb7e-23bc1263e2f3 req-8dd63e74-d683-4991-ae68-fbe5052fe497 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032337 Sep 23 05:22:04.583563 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3384/6945] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:22:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:22:05.537175 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7b7cc13c-f999-4125-b196-3b7ab6e6d9c6 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:22:05.537812 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-7b7cc13c-f999-4125-b196-3b7ab6e6d9c6 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] [instance: 8a0b9633-813c-47a4-aecc-04a94178e936] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:22:05.539765 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:22:05.545686 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7b7cc13c-f999-4125-b196-3b7ab6e6d9c6 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:22:05.546202 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7b7cc13c-f999-4125-b196-3b7ab6e6d9c6 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:22:05.546643 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7b7cc13c-f999-4125-b196-3b7ab6e6d9c6 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:22:05.547430 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7b7cc13c-f999-4125-b196-3b7ab6e6d9c6 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:22:05.547887 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7b7cc13c-f999-4125-b196-3b7ab6e6d9c6 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:22:05.548312 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7b7cc13c-f999-4125-b196-3b7ab6e6d9c6 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:22:05.681877 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-7b7cc13c-f999-4125-b196-3b7ab6e6d9c6 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53f9b80a8c3436c96d42482086fd588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c94bbd5524e6c93e6e0c80181dbab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:22:05.690181 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-7b7cc13c-f999-4125-b196-3b7ab6e6d9c6 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] 10.222.0.33 "GET /compute/v2.1/servers/8a0b9633-813c-47a4-aecc-04a94178e936" status: 200 len: 1318 microversion: 2.1 time: 0.157198 Sep 23 05:22:05.690746 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3562/6946] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:22:05 2022] GET /compute/v2.1/servers/8a0b9633-813c-47a4-aecc-04a94178e936 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:22:06.710084 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:22:06.715183 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-533ec9c2-a972-461e-8e70-0e41f65ab6d3 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:22:06.715909 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-533ec9c2-a972-461e-8e70-0e41f65ab6d3 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] [instance: 8a0b9633-813c-47a4-aecc-04a94178e936] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:22:06.722351 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-533ec9c2-a972-461e-8e70-0e41f65ab6d3 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:22:06.722856 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-533ec9c2-a972-461e-8e70-0e41f65ab6d3 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:22:06.723315 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-533ec9c2-a972-461e-8e70-0e41f65ab6d3 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:22:06.724026 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-533ec9c2-a972-461e-8e70-0e41f65ab6d3 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:22:06.724502 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-533ec9c2-a972-461e-8e70-0e41f65ab6d3 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:22:06.724985 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-533ec9c2-a972-461e-8e70-0e41f65ab6d3 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:22:06.858009 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-533ec9c2-a972-461e-8e70-0e41f65ab6d3 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53f9b80a8c3436c96d42482086fd588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c94bbd5524e6c93e6e0c80181dbab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:22:06.865728 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-533ec9c2-a972-461e-8e70-0e41f65ab6d3 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] 10.222.0.33 "GET /compute/v2.1/servers/8a0b9633-813c-47a4-aecc-04a94178e936" status: 200 len: 1507 microversion: 2.1 time: 0.156692 Sep 23 05:22:06.866341 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3385/6947] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:22:06 2022] GET /compute/v2.1/servers/8a0b9633-813c-47a4-aecc-04a94178e936 => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:22:27.598048 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c9fc81ae-9a29-493a-911e-e5f8d13c30b6 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1a1dce81-b49d-480b-8662-18de81bf7a42", "device": "/dev/sdb"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:22:27.600486 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c9fc81ae-9a29-493a-911e-e5f8d13c30b6 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] [instance: 8a0b9633-813c-47a4-aecc-04a94178e936] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:22:27.602421 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=8 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:22:27.604405 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:22:27.605123 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=32 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:22:27.610643 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c9fc81ae-9a29-493a-911e-e5f8d13c30b6 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:22:27.616515 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c9fc81ae-9a29-493a-911e-e5f8d13c30b6 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:22:27.616515 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c9fc81ae-9a29-493a-911e-e5f8d13c30b6 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:22:27.616515 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c9fc81ae-9a29-493a-911e-e5f8d13c30b6 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:22:27.616515 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c9fc81ae-9a29-493a-911e-e5f8d13c30b6 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:22:27.616515 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c9fc81ae-9a29-493a-911e-e5f8d13c30b6 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:22:28.271308 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c9fc81ae-9a29-493a-911e-e5f8d13c30b6 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] 10.222.0.33 "POST /compute/v2.1/servers/8a0b9633-813c-47a4-aecc-04a94178e936/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.677074 Sep 23 05:22:28.272219 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3563/6948] 10.222.0.33 () {60 vars in 1323 bytes} [Fri Sep 23 05:22:27 2022] POST /compute/v2.1/servers/8a0b9633-813c-47a4-aecc-04a94178e936/os-volume_attachments => generated 194 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:22:53.784158 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ef3f0dd1-aec4-4fad-bad6-7102cc592ccc tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:22:53.784667 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-ef3f0dd1-aec4-4fad-bad6-7102cc592ccc tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] [instance: 8a0b9633-813c-47a4-aecc-04a94178e936] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:22:53.787812 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=16 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:22:53.788605 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=28 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:22:53.793220 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ef3f0dd1-aec4-4fad-bad6-7102cc592ccc tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:22:53.793716 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ef3f0dd1-aec4-4fad-bad6-7102cc592ccc tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:22:53.794890 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ef3f0dd1-aec4-4fad-bad6-7102cc592ccc tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:22:53.795650 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ef3f0dd1-aec4-4fad-bad6-7102cc592ccc tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:22:53.796125 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ef3f0dd1-aec4-4fad-bad6-7102cc592ccc tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:22:53.796566 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ef3f0dd1-aec4-4fad-bad6-7102cc592ccc tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:22:53.881802 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-ef3f0dd1-aec4-4fad-bad6-7102cc592ccc tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lazy-loading 'services' on Instance uuid 8a0b9633-813c-47a4-aecc-04a94178e936 {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 05:22:54.127587 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ef3f0dd1-aec4-4fad-bad6-7102cc592ccc tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] 10.222.0.33 "DELETE /compute/v2.1/servers/8a0b9633-813c-47a4-aecc-04a94178e936/os-volume_attachments/1a1dce81-b49d-480b-8662-18de81bf7a42" status: 202 len: 0 microversion: 2.1 time: 0.347190 Sep 23 05:22:54.128210 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3386/6949] 10.222.0.33 () {58 vars in 1416 bytes} [Fri Sep 23 05:22:53 2022] DELETE /compute/v2.1/servers/8a0b9633-813c-47a4-aecc-04a94178e936/os-volume_attachments/1a1dce81-b49d-480b-8662-18de81bf7a42 => generated 0 bytes in 349 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 05:22:59.496566 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:22:59.497372 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:22:59.501460 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-727614d4-df4d-42f8-b410-37db25261ce8 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:22:59.502077 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-727614d4-df4d-42f8-b410-37db25261ce8 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] [instance: 8a0b9633-813c-47a4-aecc-04a94178e936] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:22:59.508131 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-727614d4-df4d-42f8-b410-37db25261ce8 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:22:59.516028 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-727614d4-df4d-42f8-b410-37db25261ce8 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:22:59.516028 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-727614d4-df4d-42f8-b410-37db25261ce8 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:22:59.516028 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-727614d4-df4d-42f8-b410-37db25261ce8 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:22:59.516028 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-727614d4-df4d-42f8-b410-37db25261ce8 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:22:59.516028 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-727614d4-df4d-42f8-b410-37db25261ce8 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:22:59.537144 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-727614d4-df4d-42f8-b410-37db25261ce8 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] [instance: 8a0b9633-813c-47a4-aecc-04a94178e936] Going to try to terminate instance {{(pid=122699) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 05:22:59.831298 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-727614d4-df4d-42f8-b410-37db25261ce8 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] 10.222.0.33 "DELETE /compute/v2.1/servers/8a0b9633-813c-47a4-aecc-04a94178e936" status: 204 len: 0 microversion: 2.1 time: 0.335826 Sep 23 05:22:59.831900 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3564/6950] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 05:22:59 2022] DELETE /compute/v2.1/servers/8a0b9633-813c-47a4-aecc-04a94178e936 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 05:22:59.841598 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-45e442c3-1b25-483c-83ba-9f4c5f31115d tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:22:59.842348 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-45e442c3-1b25-483c-83ba-9f4c5f31115d tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] [instance: 8a0b9633-813c-47a4-aecc-04a94178e936] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:22:59.848597 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-45e442c3-1b25-483c-83ba-9f4c5f31115d tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:22:59.849100 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-45e442c3-1b25-483c-83ba-9f4c5f31115d tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:22:59.849559 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-45e442c3-1b25-483c-83ba-9f4c5f31115d tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:22:59.850301 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-45e442c3-1b25-483c-83ba-9f4c5f31115d tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:22:59.850780 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-45e442c3-1b25-483c-83ba-9f4c5f31115d tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:22:59.851229 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-45e442c3-1b25-483c-83ba-9f4c5f31115d tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:23:00.094976 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-45e442c3-1b25-483c-83ba-9f4c5f31115d tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53f9b80a8c3436c96d42482086fd588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c94bbd5524e6c93e6e0c80181dbab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:23:00.102704 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-45e442c3-1b25-483c-83ba-9f4c5f31115d tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] 10.222.0.33 "GET /compute/v2.1/servers/8a0b9633-813c-47a4-aecc-04a94178e936" status: 200 len: 1513 microversion: 2.1 time: 0.266319 Sep 23 05:23:00.103282 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3387/6951] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:22:59 2022] GET /compute/v2.1/servers/8a0b9633-813c-47a4-aecc-04a94178e936 => generated 1513 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:23:01.127786 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-bd97325f-5992-4ff1-8ebc-691f445f73d7 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:23:01.138202 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-bd97325f-5992-4ff1-8ebc-691f445f73d7 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] [instance: 8a0b9633-813c-47a4-aecc-04a94178e936] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:23:01.138202 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bd97325f-5992-4ff1-8ebc-691f445f73d7 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:23:01.138202 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bd97325f-5992-4ff1-8ebc-691f445f73d7 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:23:01.138202 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bd97325f-5992-4ff1-8ebc-691f445f73d7 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:23:01.138202 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bd97325f-5992-4ff1-8ebc-691f445f73d7 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:23:01.138202 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bd97325f-5992-4ff1-8ebc-691f445f73d7 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:23:01.138677 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bd97325f-5992-4ff1-8ebc-691f445f73d7 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:23:01.328941 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-bd97325f-5992-4ff1-8ebc-691f445f73d7 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53f9b80a8c3436c96d42482086fd588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c94bbd5524e6c93e6e0c80181dbab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:23:01.338125 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-bd97325f-5992-4ff1-8ebc-691f445f73d7 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] 10.222.0.33 "GET /compute/v2.1/servers/8a0b9633-813c-47a4-aecc-04a94178e936" status: 200 len: 1513 microversion: 2.1 time: 0.214649 Sep 23 05:23:01.338712 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3565/6952] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:23:01 2022] GET /compute/v2.1/servers/8a0b9633-813c-47a4-aecc-04a94178e936 => generated 1513 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:23:01.821468 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-3962dfb8-e7e5-49db-9803-688f1d9da1a6 req-c7eb5cef-b55d-4678-bc2d-3a8518333181 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a0b9633-813c-47a4-aecc-04a94178e936", "name": "network-vif-deleted", "tag": "41466f51-a82d-44bc-8611-5d566b79d30e"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:23:01.832455 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-3962dfb8-e7e5-49db-9803-688f1d9da1a6 req-c7eb5cef-b55d-4678-bc2d-3a8518333181 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:23:01.836205 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-3962dfb8-e7e5-49db-9803-688f1d9da1a6 req-c7eb5cef-b55d-4678-bc2d-3a8518333181 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:23:01.836205 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-3962dfb8-e7e5-49db-9803-688f1d9da1a6 req-c7eb5cef-b55d-4678-bc2d-3a8518333181 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:23:01.845004 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-3962dfb8-e7e5-49db-9803-688f1d9da1a6 req-c7eb5cef-b55d-4678-bc2d-3a8518333181 service nova] Creating event network-vif-deleted:41466f51-a82d-44bc-8611-5d566b79d30e for instance 8a0b9633-813c-47a4-aecc-04a94178e936 on n-h2-846463-3 Sep 23 05:23:01.849976 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-3962dfb8-e7e5-49db-9803-688f1d9da1a6 req-c7eb5cef-b55d-4678-bc2d-3a8518333181 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032254 Sep 23 05:23:01.850563 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3388/6953] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:23:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:23:02.361241 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-61d9c44b-766a-46f9-8bda-4a739f52d41e tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:23:02.369475 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-61d9c44b-766a-46f9-8bda-4a739f52d41e tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] [instance: 8a0b9633-813c-47a4-aecc-04a94178e936] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:23:02.369475 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-61d9c44b-766a-46f9-8bda-4a739f52d41e tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:23:02.369475 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-61d9c44b-766a-46f9-8bda-4a739f52d41e tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:23:02.369475 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-61d9c44b-766a-46f9-8bda-4a739f52d41e tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:23:02.369960 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-61d9c44b-766a-46f9-8bda-4a739f52d41e tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:23:02.370430 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-61d9c44b-766a-46f9-8bda-4a739f52d41e tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:23:02.370861 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-61d9c44b-766a-46f9-8bda-4a739f52d41e tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:23:02.402907 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-61d9c44b-766a-46f9-8bda-4a739f52d41e tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:23:02.403403 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-61d9c44b-766a-46f9-8bda-4a739f52d41e tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:23:02.403852 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-61d9c44b-766a-46f9-8bda-4a739f52d41e tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:23:02.404309 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-61d9c44b-766a-46f9-8bda-4a739f52d41e tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lazy-loading 'fault' on Instance uuid 8a0b9633-813c-47a4-aecc-04a94178e936 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 05:23:02.446781 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-61d9c44b-766a-46f9-8bda-4a739f52d41e tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53f9b80a8c3436c96d42482086fd588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c94bbd5524e6c93e6e0c80181dbab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:23:02.454634 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-61d9c44b-766a-46f9-8bda-4a739f52d41e tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] 10.222.0.33 "GET /compute/v2.1/servers/8a0b9633-813c-47a4-aecc-04a94178e936" status: 200 len: 1308 microversion: 2.1 time: 0.097316 Sep 23 05:23:02.455221 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3566/6954] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:23:02 2022] GET /compute/v2.1/servers/8a0b9633-813c-47a4-aecc-04a94178e936 => generated 1308 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:23:03.479322 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f1a0e89e-0d05-4668-9077-8a6e9741e03a tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:23:03.480029 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f1a0e89e-0d05-4668-9077-8a6e9741e03a tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] [instance: 8a0b9633-813c-47a4-aecc-04a94178e936] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:23:03.486936 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f1a0e89e-0d05-4668-9077-8a6e9741e03a tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:23:03.487432 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f1a0e89e-0d05-4668-9077-8a6e9741e03a tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:23:03.487880 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f1a0e89e-0d05-4668-9077-8a6e9741e03a tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:23:03.488576 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f1a0e89e-0d05-4668-9077-8a6e9741e03a tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:23:03.489045 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f1a0e89e-0d05-4668-9077-8a6e9741e03a tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:23:03.489482 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f1a0e89e-0d05-4668-9077-8a6e9741e03a tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:23:03.502630 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-f1a0e89e-0d05-4668-9077-8a6e9741e03a tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] HTTP exception thrown: Instance 8a0b9633-813c-47a4-aecc-04a94178e936 could not be found. Sep 23 05:23:03.504254 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f1a0e89e-0d05-4668-9077-8a6e9741e03a tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Request method failure captured: Sep 23 05:23:03.504254 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/8a0b9633-813c-47a4-aecc-04a94178e936 HTTP/1.1 Sep 23 05:23:03.504254 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 05:23:03.504254 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 05:23:03.504254 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 05:23:03.504254 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 05:23:03.504254 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 05:23:03.504254 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 05:23:03.504254 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 05:23:03.504254 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 05:23:03.504254 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLUIe4T5F349Ztt23MHahFWPtR9XQhL16AZzOT2jtO6c3sfAsvUVEwXQJ7K4lF3ULQRV-VtG8_pzYEAY_uUMLQr64Ik2H5pY_1Szhp3TmNarQSr9nZq6SVkpYPeTZ6KJPqWI2hAg40Wp7Nr5CrjcNppItrgUuY5iDQAo5e5u07aI9CKQ Sep 23 05:23:03.504254 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 05:23:03.504254 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 05:23:03.504254 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 05:23:03.504254 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 05:23:03.504254 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 05:23:03.504254 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 05:23:03.504254 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: bb4c94bbd5524e6c93e6e0c80181dbab Sep 23 05:23:03.504254 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-VolumesSnapshotTestJSON-727293568 Sep 23 05:23:03.504254 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 05:23:03.504254 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 05:23:03.504254 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bb4c94bbd5524e6c93e6e0c80181dbab", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bb4c94bbd5524e6c93e6e0c80181dbab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bb4c94bbd5524e6c93e6e0c80181dbab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bb4c94bbd5524e6c93e6e0c80181dbab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:23:03.504254 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-VolumesSnapshotTestJSON-727293568 Sep 23 05:23:03.504254 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: bb4c94bbd5524e6c93e6e0c80181dbab Sep 23 05:23:03.504254 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-727293568 Sep 23 05:23:03.504254 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-VolumesSnapshotTestJSON-727293568-project Sep 23 05:23:03.504254 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 05:23:03.504254 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 05:23:03.504254 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: a53f9b80a8c3436c96d42482086fd588 Sep 23 05:23:03.504254 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-VolumesSnapshotTestJSON-727293568-project Sep 23 05:23:03.504254 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 05:23:03.504254 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 8a0b9633-813c-47a4-aecc-04a94178e936 could not be found. Sep 23 05:23:03.504254 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '8a0b9633-813c-47a4-aecc-04a94178e936'} Sep 23 05:23:03.504254 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:23:03.504254 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:23:03.504254 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 05:23:03.504254 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 05:23:03.504254 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 05:23:03.504254 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 05:23:03.504254 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 05:23:03.504254 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 05:23:03.504254 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 05:23:03.504254 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 05:23:03.504254 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a0b9633-813c-47a4-aecc-04a94178e936 could not be found. Sep 23 05:23:03.504254 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:23:03.504254 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:23:03.504254 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:23:03.504254 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:23:03.504254 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:23:03.504254 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:23:03.504254 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:23:03.504254 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:23:03.504254 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:23:03.504254 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:23:03.504254 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 05:23:03.504254 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 05:23:03.504254 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 05:23:03.504254 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 05:23:03.504254 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 05:23:03.504254 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:23:03.504254 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a0b9633-813c-47a4-aecc-04a94178e936 could not be found. Sep 23 05:23:03.504254 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:23:03.504254 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:23:03.504254 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:23:03.508798 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:23:03.508798 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:23:03.508798 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:23:03.508798 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:23:03.508798 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:23:03.508798 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a0b9633-813c-47a4-aecc-04a94178e936 could not be found. Sep 23 05:23:03.508798 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:23:03.508798 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f1a0e89e-0d05-4668-9077-8a6e9741e03a tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Returning 404 to user: Instance 8a0b9633-813c-47a4-aecc-04a94178e936 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:23:03.508798 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f1a0e89e-0d05-4668-9077-8a6e9741e03a tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] 10.222.0.33 "GET /compute/v2.1/servers/8a0b9633-813c-47a4-aecc-04a94178e936" status: 404 len: 111 microversion: 2.1 time: 0.031506 Sep 23 05:23:03.508798 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3389/6955] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:23:03 2022] GET /compute/v2.1/servers/8a0b9633-813c-47a4-aecc-04a94178e936 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 05:23:10.788138 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b473b056-0295-472e-a764-0dcdeb20d389 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-73623387", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "networks": [{"uuid": "07bcedf4-2eec-47c7-8054-9a76d691c1dc"}]}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:23:10.844150 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.neutron [None req-b473b056-0295-472e-a764-0dcdeb20d389 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] validate_networks() for [('07bcedf4-2eec-47c7-8054-9a76d691c1dc', None, None, None, None, None)] {{(pid=122699) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 05:23:11.489153 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-b473b056-0295-472e-a764-0dcdeb20d389 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Flavor limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 05:23:11.489581 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-b473b056-0295-472e-a764-0dcdeb20d389 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Image limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 05:23:11.490173 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-b473b056-0295-472e-a764-0dcdeb20d389 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Flavor pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 05:23:11.491044 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-b473b056-0295-472e-a764-0dcdeb20d389 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Image pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 05:23:11.491497 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-b473b056-0295-472e-a764-0dcdeb20d389 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 05:23:11.501563 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b473b056-0295-472e-a764-0dcdeb20d389 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:23:11.502082 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b473b056-0295-472e-a764-0dcdeb20d389 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:23:11.502519 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b473b056-0295-472e-a764-0dcdeb20d389 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:23:11.503239 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b473b056-0295-472e-a764-0dcdeb20d389 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:23:11.503694 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b473b056-0295-472e-a764-0dcdeb20d389 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:23:11.504125 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b473b056-0295-472e-a764-0dcdeb20d389 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:23:11.521002 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-b473b056-0295-472e-a764-0dcdeb20d389 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Getting quotas for project bb4c94bbd5524e6c93e6e0c80181dbab. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 05:23:11.526162 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-b473b056-0295-472e-a764-0dcdeb20d389 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Getting quotas for user a53f9b80a8c3436c96d42482086fd588 and project bb4c94bbd5524e6c93e6e0c80181dbab. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 05:23:11.538164 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b473b056-0295-472e-a764-0dcdeb20d389 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Going to run 1 instances... {{(pid=122699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 05:23:11.540419 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b473b056-0295-472e-a764-0dcdeb20d389 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] [instance: e3f085d6-c3dc-4db5-a240-77c1390b87a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 05:23:11.644483 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b473b056-0295-472e-a764-0dcdeb20d389 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.860188 Sep 23 05:23:11.645401 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3567/6956] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 05:23:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 862 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 05:23:11.656915 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5bdbe125-a3f1-4102-9250-94a0d2c0c0d9 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:23:11.661232 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5bdbe125-a3f1-4102-9250-94a0d2c0c0d9 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] [instance: e3f085d6-c3dc-4db5-a240-77c1390b87a8] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:23:11.713539 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-5bdbe125-a3f1-4102-9250-94a0d2c0c0d9 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53f9b80a8c3436c96d42482086fd588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c94bbd5524e6c93e6e0c80181dbab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:23:11.722362 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5bdbe125-a3f1-4102-9250-94a0d2c0c0d9 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] 10.222.0.33 "GET /compute/v2.1/servers/e3f085d6-c3dc-4db5-a240-77c1390b87a8" status: 200 len: 1217 microversion: 2.1 time: 0.069730 Sep 23 05:23:11.722928 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3390/6957] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:23:11 2022] GET /compute/v2.1/servers/e3f085d6-c3dc-4db5-a240-77c1390b87a8 => generated 1217 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:23:12.745767 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-12780f62-e9a3-4f09-a3e7-b9983f44dba0 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:23:12.746521 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-12780f62-e9a3-4f09-a3e7-b9983f44dba0 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] [instance: e3f085d6-c3dc-4db5-a240-77c1390b87a8] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:23:12.753278 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-12780f62-e9a3-4f09-a3e7-b9983f44dba0 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:23:12.753764 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-12780f62-e9a3-4f09-a3e7-b9983f44dba0 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:23:12.754244 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-12780f62-e9a3-4f09-a3e7-b9983f44dba0 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:23:12.754986 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-12780f62-e9a3-4f09-a3e7-b9983f44dba0 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:23:12.755447 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-12780f62-e9a3-4f09-a3e7-b9983f44dba0 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:23:12.755874 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-12780f62-e9a3-4f09-a3e7-b9983f44dba0 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:23:12.820457 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-12780f62-e9a3-4f09-a3e7-b9983f44dba0 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53f9b80a8c3436c96d42482086fd588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c94bbd5524e6c93e6e0c80181dbab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:23:12.829322 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-12780f62-e9a3-4f09-a3e7-b9983f44dba0 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] 10.222.0.33 "GET /compute/v2.1/servers/e3f085d6-c3dc-4db5-a240-77c1390b87a8" status: 200 len: 1221 microversion: 2.1 time: 0.088089 Sep 23 05:23:12.835007 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3568/6958] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:23:12 2022] GET /compute/v2.1/servers/e3f085d6-c3dc-4db5-a240-77c1390b87a8 => generated 1221 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:23:13.852762 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a4fb0db8-ad59-4577-9bef-8a471539641d tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:23:13.853320 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a4fb0db8-ad59-4577-9bef-8a471539641d tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] [instance: e3f085d6-c3dc-4db5-a240-77c1390b87a8] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:23:13.856802 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:23:13.861949 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a4fb0db8-ad59-4577-9bef-8a471539641d tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:23:13.862502 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a4fb0db8-ad59-4577-9bef-8a471539641d tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:23:13.862964 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a4fb0db8-ad59-4577-9bef-8a471539641d tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:23:13.863714 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a4fb0db8-ad59-4577-9bef-8a471539641d tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:23:13.864199 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a4fb0db8-ad59-4577-9bef-8a471539641d tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:23:13.864642 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a4fb0db8-ad59-4577-9bef-8a471539641d tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:23:13.929029 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a4fb0db8-ad59-4577-9bef-8a471539641d tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53f9b80a8c3436c96d42482086fd588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c94bbd5524e6c93e6e0c80181dbab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:23:13.937423 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a4fb0db8-ad59-4577-9bef-8a471539641d tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] 10.222.0.33 "GET /compute/v2.1/servers/e3f085d6-c3dc-4db5-a240-77c1390b87a8" status: 200 len: 1275 microversion: 2.1 time: 0.088719 Sep 23 05:23:13.938143 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3391/6959] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:23:13 2022] GET /compute/v2.1/servers/e3f085d6-c3dc-4db5-a240-77c1390b87a8 => generated 1275 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:23:14.960576 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-259c85b0-c83c-4c2a-8974-c820082cd027 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:23:14.961224 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-259c85b0-c83c-4c2a-8974-c820082cd027 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] [instance: e3f085d6-c3dc-4db5-a240-77c1390b87a8] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:23:14.968474 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-259c85b0-c83c-4c2a-8974-c820082cd027 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:23:14.969092 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-259c85b0-c83c-4c2a-8974-c820082cd027 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:23:14.969536 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-259c85b0-c83c-4c2a-8974-c820082cd027 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:23:14.970446 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-259c85b0-c83c-4c2a-8974-c820082cd027 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:23:14.970905 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-259c85b0-c83c-4c2a-8974-c820082cd027 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:23:14.971446 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-259c85b0-c83c-4c2a-8974-c820082cd027 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:23:15.103437 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-259c85b0-c83c-4c2a-8974-c820082cd027 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53f9b80a8c3436c96d42482086fd588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c94bbd5524e6c93e6e0c80181dbab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:23:15.111349 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-259c85b0-c83c-4c2a-8974-c820082cd027 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] 10.222.0.33 "GET /compute/v2.1/servers/e3f085d6-c3dc-4db5-a240-77c1390b87a8" status: 200 len: 1317 microversion: 2.1 time: 0.154738 Sep 23 05:23:15.111926 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3569/6960] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:23:14 2022] GET /compute/v2.1/servers/e3f085d6-c3dc-4db5-a240-77c1390b87a8 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:23:15.239476 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-1145aa02-9566-4ae6-885b-d181fc8bb889 req-f914ed26-b209-4f33-ad5f-b846f64c5710 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3f085d6-c3dc-4db5-a240-77c1390b87a8", "tag": "af74d2d4-9a11-41d4-a301-dd2a7599c9e0"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:23:15.249393 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-1145aa02-9566-4ae6-885b-d181fc8bb889 req-f914ed26-b209-4f33-ad5f-b846f64c5710 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:23:15.249993 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-1145aa02-9566-4ae6-885b-d181fc8bb889 req-f914ed26-b209-4f33-ad5f-b846f64c5710 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:23:15.250820 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-1145aa02-9566-4ae6-885b-d181fc8bb889 req-f914ed26-b209-4f33-ad5f-b846f64c5710 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:23:15.262715 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-1145aa02-9566-4ae6-885b-d181fc8bb889 req-f914ed26-b209-4f33-ad5f-b846f64c5710 service nova] Creating event network-changed:af74d2d4-9a11-41d4-a301-dd2a7599c9e0 for instance e3f085d6-c3dc-4db5-a240-77c1390b87a8 on n-h1-846463-3 Sep 23 05:23:15.268161 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-1145aa02-9566-4ae6-885b-d181fc8bb889 req-f914ed26-b209-4f33-ad5f-b846f64c5710 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107407 Sep 23 05:23:15.268717 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3392/6961] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:23:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:23:16.136013 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5dd1860e-53e0-4b89-8515-547b1a02dd41 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:23:16.136635 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-5dd1860e-53e0-4b89-8515-547b1a02dd41 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] [instance: e3f085d6-c3dc-4db5-a240-77c1390b87a8] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:23:16.144208 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5dd1860e-53e0-4b89-8515-547b1a02dd41 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:23:16.144697 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5dd1860e-53e0-4b89-8515-547b1a02dd41 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:23:16.145138 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5dd1860e-53e0-4b89-8515-547b1a02dd41 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:23:16.146218 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5dd1860e-53e0-4b89-8515-547b1a02dd41 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:23:16.146686 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5dd1860e-53e0-4b89-8515-547b1a02dd41 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:23:16.147121 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5dd1860e-53e0-4b89-8515-547b1a02dd41 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:23:16.280830 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-5dd1860e-53e0-4b89-8515-547b1a02dd41 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53f9b80a8c3436c96d42482086fd588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c94bbd5524e6c93e6e0c80181dbab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:23:16.288506 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5dd1860e-53e0-4b89-8515-547b1a02dd41 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] 10.222.0.33 "GET /compute/v2.1/servers/e3f085d6-c3dc-4db5-a240-77c1390b87a8" status: 200 len: 1317 microversion: 2.1 time: 0.157562 Sep 23 05:23:16.289081 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3570/6962] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:23:16 2022] GET /compute/v2.1/servers/e3f085d6-c3dc-4db5-a240-77c1390b87a8 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:23:17.312385 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c7a185be-1a51-4f7d-bd2e-38de5b47ce4e tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:23:17.313138 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c7a185be-1a51-4f7d-bd2e-38de5b47ce4e tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] [instance: e3f085d6-c3dc-4db5-a240-77c1390b87a8] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:23:17.319428 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c7a185be-1a51-4f7d-bd2e-38de5b47ce4e tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:23:17.319939 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c7a185be-1a51-4f7d-bd2e-38de5b47ce4e tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:23:17.320396 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c7a185be-1a51-4f7d-bd2e-38de5b47ce4e tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:23:17.321110 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c7a185be-1a51-4f7d-bd2e-38de5b47ce4e tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:23:17.321587 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c7a185be-1a51-4f7d-bd2e-38de5b47ce4e tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:23:17.322064 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c7a185be-1a51-4f7d-bd2e-38de5b47ce4e tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:23:17.453534 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c7a185be-1a51-4f7d-bd2e-38de5b47ce4e tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53f9b80a8c3436c96d42482086fd588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c94bbd5524e6c93e6e0c80181dbab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:23:17.461531 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c7a185be-1a51-4f7d-bd2e-38de5b47ce4e tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] 10.222.0.33 "GET /compute/v2.1/servers/e3f085d6-c3dc-4db5-a240-77c1390b87a8" status: 200 len: 1317 microversion: 2.1 time: 0.154235 Sep 23 05:23:17.462163 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3393/6963] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:23:17 2022] GET /compute/v2.1/servers/e3f085d6-c3dc-4db5-a240-77c1390b87a8 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:23:18.485368 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-509ba1aa-f28a-4519-be5b-0b3516974b3d tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:23:18.485960 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-509ba1aa-f28a-4519-be5b-0b3516974b3d tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] [instance: e3f085d6-c3dc-4db5-a240-77c1390b87a8] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:23:18.492370 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-509ba1aa-f28a-4519-be5b-0b3516974b3d tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:23:18.492869 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-509ba1aa-f28a-4519-be5b-0b3516974b3d tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:23:18.493318 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-509ba1aa-f28a-4519-be5b-0b3516974b3d tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:23:18.494054 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-509ba1aa-f28a-4519-be5b-0b3516974b3d tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:23:18.494526 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-509ba1aa-f28a-4519-be5b-0b3516974b3d tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:23:18.494960 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-509ba1aa-f28a-4519-be5b-0b3516974b3d tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:23:18.627486 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-509ba1aa-f28a-4519-be5b-0b3516974b3d tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53f9b80a8c3436c96d42482086fd588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c94bbd5524e6c93e6e0c80181dbab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:23:18.635241 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-509ba1aa-f28a-4519-be5b-0b3516974b3d tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] 10.222.0.33 "GET /compute/v2.1/servers/e3f085d6-c3dc-4db5-a240-77c1390b87a8" status: 200 len: 1317 microversion: 2.1 time: 0.154472 Sep 23 05:23:18.635864 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3571/6964] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:23:18 2022] GET /compute/v2.1/servers/e3f085d6-c3dc-4db5-a240-77c1390b87a8 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:23:19.657339 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b5bd0bf1-b417-4576-bf30-e7117110e350 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:23:19.657998 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b5bd0bf1-b417-4576-bf30-e7117110e350 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] [instance: e3f085d6-c3dc-4db5-a240-77c1390b87a8] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:23:19.664873 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b5bd0bf1-b417-4576-bf30-e7117110e350 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:23:19.665380 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b5bd0bf1-b417-4576-bf30-e7117110e350 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:23:19.665839 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b5bd0bf1-b417-4576-bf30-e7117110e350 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:23:19.666582 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b5bd0bf1-b417-4576-bf30-e7117110e350 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:23:19.667057 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b5bd0bf1-b417-4576-bf30-e7117110e350 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:23:19.667502 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b5bd0bf1-b417-4576-bf30-e7117110e350 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:23:19.802030 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b5bd0bf1-b417-4576-bf30-e7117110e350 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53f9b80a8c3436c96d42482086fd588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c94bbd5524e6c93e6e0c80181dbab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:23:19.810483 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b5bd0bf1-b417-4576-bf30-e7117110e350 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] 10.222.0.33 "GET /compute/v2.1/servers/e3f085d6-c3dc-4db5-a240-77c1390b87a8" status: 200 len: 1317 microversion: 2.1 time: 0.157022 Sep 23 05:23:19.811078 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3394/6965] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:23:19 2022] GET /compute/v2.1/servers/e3f085d6-c3dc-4db5-a240-77c1390b87a8 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:23:20.313244 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-b4820c6e-f30e-4c04-a215-faca7e21c850 req-49c813ac-20cf-43c6-9de7-d18a6655d70e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3f085d6-c3dc-4db5-a240-77c1390b87a8", "name": "network-vif-plugged", "status": "completed", "tag": "af74d2d4-9a11-41d4-a301-dd2a7599c9e0"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:23:20.323480 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-b4820c6e-f30e-4c04-a215-faca7e21c850 req-49c813ac-20cf-43c6-9de7-d18a6655d70e service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:23:20.323972 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-b4820c6e-f30e-4c04-a215-faca7e21c850 req-49c813ac-20cf-43c6-9de7-d18a6655d70e service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:23:20.324957 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-b4820c6e-f30e-4c04-a215-faca7e21c850 req-49c813ac-20cf-43c6-9de7-d18a6655d70e service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:23:20.336955 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-b4820c6e-f30e-4c04-a215-faca7e21c850 req-49c813ac-20cf-43c6-9de7-d18a6655d70e service nova] Creating event network-vif-plugged:af74d2d4-9a11-41d4-a301-dd2a7599c9e0 for instance e3f085d6-c3dc-4db5-a240-77c1390b87a8 on n-h1-846463-3 Sep 23 05:23:20.342705 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-b4820c6e-f30e-4c04-a215-faca7e21c850 req-49c813ac-20cf-43c6-9de7-d18a6655d70e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106277 Sep 23 05:23:20.343490 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3572/6966] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:23:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:23:20.832781 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-53968fae-4e32-4c24-a1e1-862e6cbdfb53 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:23:20.833849 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-53968fae-4e32-4c24-a1e1-862e6cbdfb53 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] [instance: e3f085d6-c3dc-4db5-a240-77c1390b87a8] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:23:20.840809 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-53968fae-4e32-4c24-a1e1-862e6cbdfb53 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:23:20.841326 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-53968fae-4e32-4c24-a1e1-862e6cbdfb53 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:23:20.841789 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-53968fae-4e32-4c24-a1e1-862e6cbdfb53 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:23:20.843133 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-53968fae-4e32-4c24-a1e1-862e6cbdfb53 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:23:20.843622 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-53968fae-4e32-4c24-a1e1-862e6cbdfb53 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:23:20.844279 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-53968fae-4e32-4c24-a1e1-862e6cbdfb53 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:23:20.976753 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-53968fae-4e32-4c24-a1e1-862e6cbdfb53 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53f9b80a8c3436c96d42482086fd588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c94bbd5524e6c93e6e0c80181dbab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:23:20.985322 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-53968fae-4e32-4c24-a1e1-862e6cbdfb53 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] 10.222.0.33 "GET /compute/v2.1/servers/e3f085d6-c3dc-4db5-a240-77c1390b87a8" status: 200 len: 1317 microversion: 2.1 time: 0.156525 Sep 23 05:23:20.986257 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3395/6967] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:23:20 2022] GET /compute/v2.1/servers/e3f085d6-c3dc-4db5-a240-77c1390b87a8 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:23:22.006317 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:23:22.007126 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=6 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:23:22.011253 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-19bd789d-6768-48b2-8ea4-f484d4e75cc2 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:23:22.011966 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-19bd789d-6768-48b2-8ea4-f484d4e75cc2 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] [instance: e3f085d6-c3dc-4db5-a240-77c1390b87a8] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:23:22.018574 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-19bd789d-6768-48b2-8ea4-f484d4e75cc2 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:23:22.019094 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-19bd789d-6768-48b2-8ea4-f484d4e75cc2 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:23:22.019536 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-19bd789d-6768-48b2-8ea4-f484d4e75cc2 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:23:22.020242 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-19bd789d-6768-48b2-8ea4-f484d4e75cc2 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:23:22.020761 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-19bd789d-6768-48b2-8ea4-f484d4e75cc2 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:23:22.021194 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-19bd789d-6768-48b2-8ea4-f484d4e75cc2 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:23:22.163748 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-19bd789d-6768-48b2-8ea4-f484d4e75cc2 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53f9b80a8c3436c96d42482086fd588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c94bbd5524e6c93e6e0c80181dbab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:23:22.172530 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-19bd789d-6768-48b2-8ea4-f484d4e75cc2 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] 10.222.0.33 "GET /compute/v2.1/servers/e3f085d6-c3dc-4db5-a240-77c1390b87a8" status: 200 len: 1507 microversion: 2.1 time: 0.167672 Sep 23 05:23:22.173121 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3573/6968] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:23:22 2022] GET /compute/v2.1/servers/e3f085d6-c3dc-4db5-a240-77c1390b87a8 => generated 1507 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:23:22.194969 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a1a01f75-fecb-4f3d-a780-17f3370dbf23 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6902052f-ace0-4bda-a5ab-46ac112c5298", "device": "/dev/sdb"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:23:22.197443 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a1a01f75-fecb-4f3d-a780-17f3370dbf23 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] [instance: e3f085d6-c3dc-4db5-a240-77c1390b87a8] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:23:22.199565 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:23:22.205256 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a1a01f75-fecb-4f3d-a780-17f3370dbf23 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:23:22.205835 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a1a01f75-fecb-4f3d-a780-17f3370dbf23 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:23:22.206275 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a1a01f75-fecb-4f3d-a780-17f3370dbf23 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:23:22.206979 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a1a01f75-fecb-4f3d-a780-17f3370dbf23 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:23:22.207482 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a1a01f75-fecb-4f3d-a780-17f3370dbf23 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:23:22.207928 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a1a01f75-fecb-4f3d-a780-17f3370dbf23 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:23:22.932310 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a1a01f75-fecb-4f3d-a780-17f3370dbf23 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] 10.222.0.33 "POST /compute/v2.1/servers/e3f085d6-c3dc-4db5-a240-77c1390b87a8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.741055 Sep 23 05:23:22.933084 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3396/6969] 10.222.0.33 () {60 vars in 1323 bytes} [Fri Sep 23 05:23:22 2022] POST /compute/v2.1/servers/e3f085d6-c3dc-4db5-a240-77c1390b87a8/os-volume_attachments => generated 194 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:23:46.118755 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-59b018d2-f163-4ae2-a0c4-2e169b30321a tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:23:46.119264 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-59b018d2-f163-4ae2-a0c4-2e169b30321a tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] [instance: e3f085d6-c3dc-4db5-a240-77c1390b87a8] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:23:46.121312 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:23:46.122139 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:23:46.126887 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-59b018d2-f163-4ae2-a0c4-2e169b30321a tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:23:46.127374 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-59b018d2-f163-4ae2-a0c4-2e169b30321a tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:23:46.127825 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-59b018d2-f163-4ae2-a0c4-2e169b30321a tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:23:46.128494 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-59b018d2-f163-4ae2-a0c4-2e169b30321a tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:23:46.128953 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-59b018d2-f163-4ae2-a0c4-2e169b30321a tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:23:46.129374 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-59b018d2-f163-4ae2-a0c4-2e169b30321a tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:23:46.210702 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-59b018d2-f163-4ae2-a0c4-2e169b30321a tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lazy-loading 'services' on Instance uuid e3f085d6-c3dc-4db5-a240-77c1390b87a8 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 05:23:46.400603 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-59b018d2-f163-4ae2-a0c4-2e169b30321a tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e3f085d6-c3dc-4db5-a240-77c1390b87a8/os-volume_attachments/6902052f-ace0-4bda-a5ab-46ac112c5298" status: 202 len: 0 microversion: 2.1 time: 0.285557 Sep 23 05:23:46.401243 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3574/6970] 10.222.0.33 () {58 vars in 1416 bytes} [Fri Sep 23 05:23:46 2022] DELETE /compute/v2.1/servers/e3f085d6-c3dc-4db5-a240-77c1390b87a8/os-volume_attachments/6902052f-ace0-4bda-a5ab-46ac112c5298 => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 05:23:51.755005 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=24 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:23:51.755855 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:23:51.759989 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-12d3c139-77a4-4249-b8cb-66db41d2e2e1 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:23:51.760610 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-12d3c139-77a4-4249-b8cb-66db41d2e2e1 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] [instance: e3f085d6-c3dc-4db5-a240-77c1390b87a8] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:23:51.768440 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-12d3c139-77a4-4249-b8cb-66db41d2e2e1 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:23:51.774443 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-12d3c139-77a4-4249-b8cb-66db41d2e2e1 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:23:51.774443 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-12d3c139-77a4-4249-b8cb-66db41d2e2e1 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:23:51.774443 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-12d3c139-77a4-4249-b8cb-66db41d2e2e1 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:23:51.774443 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-12d3c139-77a4-4249-b8cb-66db41d2e2e1 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:23:51.774443 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-12d3c139-77a4-4249-b8cb-66db41d2e2e1 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:23:51.798454 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-12d3c139-77a4-4249-b8cb-66db41d2e2e1 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] [instance: e3f085d6-c3dc-4db5-a240-77c1390b87a8] Going to try to terminate instance {{(pid=122698) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 05:23:52.002377 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-12d3c139-77a4-4249-b8cb-66db41d2e2e1 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e3f085d6-c3dc-4db5-a240-77c1390b87a8" status: 204 len: 0 microversion: 2.1 time: 0.248936 Sep 23 05:23:52.002902 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3397/6971] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 05:23:51 2022] DELETE /compute/v2.1/servers/e3f085d6-c3dc-4db5-a240-77c1390b87a8 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 05:23:52.012792 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ffdbaf8c-add6-4969-9e2e-7b9b7aa417ca tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:23:52.013505 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ffdbaf8c-add6-4969-9e2e-7b9b7aa417ca tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] [instance: e3f085d6-c3dc-4db5-a240-77c1390b87a8] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:23:52.021419 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ffdbaf8c-add6-4969-9e2e-7b9b7aa417ca tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:23:52.022056 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ffdbaf8c-add6-4969-9e2e-7b9b7aa417ca tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:23:52.022557 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ffdbaf8c-add6-4969-9e2e-7b9b7aa417ca tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:23:52.023320 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ffdbaf8c-add6-4969-9e2e-7b9b7aa417ca tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:23:52.023884 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ffdbaf8c-add6-4969-9e2e-7b9b7aa417ca tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:23:52.024358 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ffdbaf8c-add6-4969-9e2e-7b9b7aa417ca tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:23:52.159301 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ffdbaf8c-add6-4969-9e2e-7b9b7aa417ca tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53f9b80a8c3436c96d42482086fd588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c94bbd5524e6c93e6e0c80181dbab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:23:52.167115 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ffdbaf8c-add6-4969-9e2e-7b9b7aa417ca tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] 10.222.0.33 "GET /compute/v2.1/servers/e3f085d6-c3dc-4db5-a240-77c1390b87a8" status: 200 len: 1513 microversion: 2.1 time: 0.159765 Sep 23 05:23:52.167770 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3575/6972] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:23:52 2022] GET /compute/v2.1/servers/e3f085d6-c3dc-4db5-a240-77c1390b87a8 => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:23:53.190657 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b4defe11-b97a-4e0f-acd7-32eb31b3ecbe tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:23:53.191366 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b4defe11-b97a-4e0f-acd7-32eb31b3ecbe tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] [instance: e3f085d6-c3dc-4db5-a240-77c1390b87a8] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:23:53.198505 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b4defe11-b97a-4e0f-acd7-32eb31b3ecbe tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:23:53.199519 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b4defe11-b97a-4e0f-acd7-32eb31b3ecbe tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:23:53.199989 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b4defe11-b97a-4e0f-acd7-32eb31b3ecbe tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:23:53.200693 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b4defe11-b97a-4e0f-acd7-32eb31b3ecbe tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:23:53.201161 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b4defe11-b97a-4e0f-acd7-32eb31b3ecbe tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:23:53.201599 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b4defe11-b97a-4e0f-acd7-32eb31b3ecbe tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:23:53.347281 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b4defe11-b97a-4e0f-acd7-32eb31b3ecbe tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53f9b80a8c3436c96d42482086fd588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c94bbd5524e6c93e6e0c80181dbab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:23:53.355172 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b4defe11-b97a-4e0f-acd7-32eb31b3ecbe tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] 10.222.0.33 "GET /compute/v2.1/servers/e3f085d6-c3dc-4db5-a240-77c1390b87a8" status: 200 len: 1513 microversion: 2.1 time: 0.168787 Sep 23 05:23:53.355760 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3398/6973] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:23:53 2022] GET /compute/v2.1/servers/e3f085d6-c3dc-4db5-a240-77c1390b87a8 => generated 1513 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:23:54.042054 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-f3575ba1-ac48-4847-8545-58e9897366d5 req-3b4f5076-8329-4e9a-bf94-45cc6df74dc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3f085d6-c3dc-4db5-a240-77c1390b87a8", "name": "network-vif-deleted", "tag": "af74d2d4-9a11-41d4-a301-dd2a7599c9e0"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:23:54.052589 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-f3575ba1-ac48-4847-8545-58e9897366d5 req-3b4f5076-8329-4e9a-bf94-45cc6df74dc0 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:23:54.053205 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-f3575ba1-ac48-4847-8545-58e9897366d5 req-3b4f5076-8329-4e9a-bf94-45cc6df74dc0 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:23:54.053490 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-f3575ba1-ac48-4847-8545-58e9897366d5 req-3b4f5076-8329-4e9a-bf94-45cc6df74dc0 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:23:54.067236 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-f3575ba1-ac48-4847-8545-58e9897366d5 req-3b4f5076-8329-4e9a-bf94-45cc6df74dc0 service nova] Creating event network-vif-deleted:af74d2d4-9a11-41d4-a301-dd2a7599c9e0 for instance e3f085d6-c3dc-4db5-a240-77c1390b87a8 on n-h1-846463-3 Sep 23 05:23:54.072437 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-f3575ba1-ac48-4847-8545-58e9897366d5 req-3b4f5076-8329-4e9a-bf94-45cc6df74dc0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034287 Sep 23 05:23:54.073223 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3576/6974] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:23:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:23:54.377656 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4c508d0f-22a4-4199-bebc-dd99be5024ca tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:23:54.378317 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4c508d0f-22a4-4199-bebc-dd99be5024ca tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] [instance: e3f085d6-c3dc-4db5-a240-77c1390b87a8] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:23:54.385398 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4c508d0f-22a4-4199-bebc-dd99be5024ca tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:23:54.390198 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4c508d0f-22a4-4199-bebc-dd99be5024ca tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:23:54.390198 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4c508d0f-22a4-4199-bebc-dd99be5024ca tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:23:54.390198 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4c508d0f-22a4-4199-bebc-dd99be5024ca tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:23:54.390198 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4c508d0f-22a4-4199-bebc-dd99be5024ca tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:23:54.390198 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4c508d0f-22a4-4199-bebc-dd99be5024ca tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:23:54.423186 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4c508d0f-22a4-4199-bebc-dd99be5024ca tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:23:54.423685 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4c508d0f-22a4-4199-bebc-dd99be5024ca tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:23:54.424137 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4c508d0f-22a4-4199-bebc-dd99be5024ca tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:23:54.424602 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-4c508d0f-22a4-4199-bebc-dd99be5024ca tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lazy-loading 'fault' on Instance uuid e3f085d6-c3dc-4db5-a240-77c1390b87a8 {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 05:23:54.464853 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4c508d0f-22a4-4199-bebc-dd99be5024ca tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a53f9b80a8c3436c96d42482086fd588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb4c94bbd5524e6c93e6e0c80181dbab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:23:54.472469 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4c508d0f-22a4-4199-bebc-dd99be5024ca tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] 10.222.0.33 "GET /compute/v2.1/servers/e3f085d6-c3dc-4db5-a240-77c1390b87a8" status: 200 len: 1307 microversion: 2.1 time: 0.098942 Sep 23 05:23:54.473040 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3399/6975] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:23:54 2022] GET /compute/v2.1/servers/e3f085d6-c3dc-4db5-a240-77c1390b87a8 => generated 1307 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:23:55.497797 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-811f55fa-13e4-4073-ad12-d163ae47f807 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:23:55.498534 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-811f55fa-13e4-4073-ad12-d163ae47f807 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] [instance: e3f085d6-c3dc-4db5-a240-77c1390b87a8] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:23:55.504839 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-811f55fa-13e4-4073-ad12-d163ae47f807 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:23:55.505334 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-811f55fa-13e4-4073-ad12-d163ae47f807 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:23:55.505777 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-811f55fa-13e4-4073-ad12-d163ae47f807 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:23:55.506543 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-811f55fa-13e4-4073-ad12-d163ae47f807 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:23:55.507007 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-811f55fa-13e4-4073-ad12-d163ae47f807 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:23:55.507439 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-811f55fa-13e4-4073-ad12-d163ae47f807 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:23:55.520824 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-811f55fa-13e4-4073-ad12-d163ae47f807 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] HTTP exception thrown: Instance e3f085d6-c3dc-4db5-a240-77c1390b87a8 could not be found. Sep 23 05:23:55.522488 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-811f55fa-13e4-4073-ad12-d163ae47f807 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Request method failure captured: Sep 23 05:23:55.522488 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/e3f085d6-c3dc-4db5-a240-77c1390b87a8 HTTP/1.1 Sep 23 05:23:55.522488 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 05:23:55.522488 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 05:23:55.522488 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 05:23:55.522488 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 05:23:55.522488 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 05:23:55.522488 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 05:23:55.522488 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 05:23:55.522488 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 05:23:55.522488 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLUIe4T5F349Ztt23MHahFWPtR9XQhL16AZzOT2jtO6c3sfAsvUVEwXQJ7K4lF3ULQRV-VtG8_pzYEAY_uUMLQr64Ik2H5pY_1Szhp3TmNarQSr9nZq6SVkpYPeTZ6KJPqWI2hAg40Wp7Nr5CrjcNppItrgUuY5iDQAo5e5u07aI9CKQ Sep 23 05:23:55.522488 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 05:23:55.522488 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 05:23:55.522488 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 05:23:55.522488 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 05:23:55.522488 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 05:23:55.522488 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 05:23:55.522488 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: bb4c94bbd5524e6c93e6e0c80181dbab Sep 23 05:23:55.522488 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-VolumesSnapshotTestJSON-727293568 Sep 23 05:23:55.522488 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 05:23:55.522488 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 05:23:55.522488 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bb4c94bbd5524e6c93e6e0c80181dbab", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bb4c94bbd5524e6c93e6e0c80181dbab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bb4c94bbd5524e6c93e6e0c80181dbab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bb4c94bbd5524e6c93e6e0c80181dbab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:23:55.522488 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-VolumesSnapshotTestJSON-727293568 Sep 23 05:23:55.522488 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: bb4c94bbd5524e6c93e6e0c80181dbab Sep 23 05:23:55.522488 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-727293568 Sep 23 05:23:55.522488 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-VolumesSnapshotTestJSON-727293568-project Sep 23 05:23:55.522488 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 05:23:55.522488 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 05:23:55.522488 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: a53f9b80a8c3436c96d42482086fd588 Sep 23 05:23:55.522488 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-VolumesSnapshotTestJSON-727293568-project Sep 23 05:23:55.522488 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 05:23:55.522488 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance e3f085d6-c3dc-4db5-a240-77c1390b87a8 could not be found. Sep 23 05:23:55.522488 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': 'e3f085d6-c3dc-4db5-a240-77c1390b87a8'} Sep 23 05:23:55.522488 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:23:55.522488 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:23:55.522488 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 05:23:55.522488 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 05:23:55.522488 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 05:23:55.522488 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 05:23:55.522488 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 05:23:55.522488 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 05:23:55.522488 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 05:23:55.522488 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 05:23:55.522488 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3f085d6-c3dc-4db5-a240-77c1390b87a8 could not be found. Sep 23 05:23:55.522488 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:23:55.522488 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:23:55.522488 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:23:55.522488 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:23:55.522488 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:23:55.522488 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:23:55.522488 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:23:55.522488 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:23:55.522488 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:23:55.522488 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:23:55.522488 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 05:23:55.522488 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 05:23:55.522488 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 05:23:55.522488 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 05:23:55.522488 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 05:23:55.522488 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:23:55.522488 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3f085d6-c3dc-4db5-a240-77c1390b87a8 could not be found. Sep 23 05:23:55.522488 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:23:55.522488 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:23:55.522488 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:23:55.527069 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:23:55.527069 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:23:55.527069 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:23:55.527069 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:23:55.527069 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:23:55.527069 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3f085d6-c3dc-4db5-a240-77c1390b87a8 could not be found. Sep 23 05:23:55.527069 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:23:55.527069 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-811f55fa-13e4-4073-ad12-d163ae47f807 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] Returning 404 to user: Instance e3f085d6-c3dc-4db5-a240-77c1390b87a8 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:23:55.527069 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-811f55fa-13e4-4073-ad12-d163ae47f807 tempest-VolumesSnapshotTestJSON-727293568 tempest-VolumesSnapshotTestJSON-727293568-project] 10.222.0.33 "GET /compute/v2.1/servers/e3f085d6-c3dc-4db5-a240-77c1390b87a8" status: 404 len: 111 microversion: 2.1 time: 0.031528 Sep 23 05:23:55.527069 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3577/6976] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:23:55 2022] GET /compute/v2.1/servers/e3f085d6-c3dc-4db5-a240-77c1390b87a8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 05:25:11.178689 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:25:11.183239 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:25:11.183239 n-d-846463-3 devstack@n-api.service[122698]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 05:25:11.183239 n-d-846463-3 devstack@n-api.service[122698]: Fri Sep 23 05:25:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.33) !!! Sep 23 05:25:11.183239 n-d-846463-3 devstack@n-api.service[122698]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 05:25:11.183239 n-d-846463-3 devstack@n-api.service[122698]: Fri Sep 23 05:25:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.33) !!! Sep 23 05:25:11.353660 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-13219704-b1c9-4eaf-9793-3ec0fe36f61b tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Action: 'create', calling method: .version_select at 0x7ff1ba7291f0>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-908113039", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJqwMKG0wlBTQxiy/rTHCb51DLtVnomAJROczS+rJrFwupdbmWr2DO84WqkABETJHDy1YV/l9KV1CYKR6CSfNw7hmiTxnqUGwngvIoDtlbPXPIXMleY1tv99h+henA5KtA=="}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:25:11.368975 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-13219704-b1c9-4eaf-9793-3ec0fe36f61b tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Getting quotas for project 1edb7eea4b4746c49c85305ce134d8bd. Resources: {'key_pairs'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 05:25:11.374925 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-13219704-b1c9-4eaf-9793-3ec0fe36f61b tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Getting quotas for user e209b72025e2476abc40f48e9ee676ce and project 1edb7eea4b4746c49c85305ce134d8bd. Resources: {'key_pairs'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 05:25:11.470277 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-13219704-b1c9-4eaf-9793-3ec0fe36f61b tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.293560 Sep 23 05:25:11.470814 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3400/6977] 10.222.0.33 () {60 vars in 1159 bytes} [Fri Sep 23 05:25:11 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:25:18.473757 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=8 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:25:18.474722 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:25:18.475930 n-d-846463-3 devstack@n-api.service[122699]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 05:25:18.476076 n-d-846463-3 devstack@n-api.service[122699]: Fri Sep 23 05:25:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.33) !!! Sep 23 05:25:18.483282 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-23a7b0ec-5eae-4a3a-a5d8-1f5cd5f26980 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-264661762-access_point-1482039759", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "networks": [{"uuid": "ff4010d8-77b6-4d4e-b4ee-de923c28a605"}], "key_name": "tempest-TestSecurityGroupsBasicOps-908113039", "security_groups": [{"name": "tempest-secgroup_access--962529486"}, {"name": "tempest-secgroup_general--1615035398"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:25:18.678409 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.neutron [None req-23a7b0ec-5eae-4a3a-a5d8-1f5cd5f26980 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] validate_networks() for [('ff4010d8-77b6-4d4e-b4ee-de923c28a605', None, None, None, None, None)] {{(pid=122699) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 05:25:19.104250 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-23a7b0ec-5eae-4a3a-a5d8-1f5cd5f26980 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Flavor limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 05:25:19.104800 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-23a7b0ec-5eae-4a3a-a5d8-1f5cd5f26980 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Image limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 05:25:19.105391 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-23a7b0ec-5eae-4a3a-a5d8-1f5cd5f26980 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Flavor pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 05:25:19.105939 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-23a7b0ec-5eae-4a3a-a5d8-1f5cd5f26980 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Image pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 05:25:19.106621 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-23a7b0ec-5eae-4a3a-a5d8-1f5cd5f26980 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 05:25:19.116681 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-23a7b0ec-5eae-4a3a-a5d8-1f5cd5f26980 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:25:19.117318 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-23a7b0ec-5eae-4a3a-a5d8-1f5cd5f26980 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:25:19.117981 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-23a7b0ec-5eae-4a3a-a5d8-1f5cd5f26980 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:25:19.118866 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-23a7b0ec-5eae-4a3a-a5d8-1f5cd5f26980 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:25:19.119405 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-23a7b0ec-5eae-4a3a-a5d8-1f5cd5f26980 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:25:19.119918 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-23a7b0ec-5eae-4a3a-a5d8-1f5cd5f26980 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:25:19.141509 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-23a7b0ec-5eae-4a3a-a5d8-1f5cd5f26980 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Getting quotas for project 1edb7eea4b4746c49c85305ce134d8bd. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 05:25:19.147920 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-23a7b0ec-5eae-4a3a-a5d8-1f5cd5f26980 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Getting quotas for user e209b72025e2476abc40f48e9ee676ce and project 1edb7eea4b4746c49c85305ce134d8bd. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 05:25:19.162841 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-23a7b0ec-5eae-4a3a-a5d8-1f5cd5f26980 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Going to run 1 instances... {{(pid=122699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 05:25:19.164906 n-d-846463-3 devstack@n-api.service[122699]: WARNING nova.utils [None req-23a7b0ec-5eae-4a3a-a5d8-1f5cd5f26980 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-264661762-access_point-1482039759 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-264661762-acc Sep 23 05:25:19.165675 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-23a7b0ec-5eae-4a3a-a5d8-1f5cd5f26980 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] [instance: aa6e610d-51e7-4c09-91ca-d38f9a219a0b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 05:25:19.330009 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-23a7b0ec-5eae-4a3a-a5d8-1f5cd5f26980 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 457 microversion: 2.1 time: 0.853265 Sep 23 05:25:19.330744 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3578/6978] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 05:25:18 2022] POST /compute/v2.1/servers => generated 457 bytes in 859 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 05:25:19.342832 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-cc1cac07-5682-4105-a0c0-83653f31cd69 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:25:19.343505 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-cc1cac07-5682-4105-a0c0-83653f31cd69 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] [instance: aa6e610d-51e7-4c09-91ca-d38f9a219a0b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:25:19.411854 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-cc1cac07-5682-4105-a0c0-83653f31cd69 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e209b72025e2476abc40f48e9ee676ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1edb7eea4b4746c49c85305ce134d8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:25:19.426650 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-cc1cac07-5682-4105-a0c0-83653f31cd69 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] 10.222.0.33 "GET /compute/v2.1/servers/aa6e610d-51e7-4c09-91ca-d38f9a219a0b" status: 200 len: 1293 microversion: 2.1 time: 0.088169 Sep 23 05:25:19.429502 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3401/6979] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:25:19 2022] GET /compute/v2.1/servers/aa6e610d-51e7-4c09-91ca-d38f9a219a0b => generated 1293 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:25:20.451469 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7acfcc92-62d8-4ad7-b211-b43fc669b9b3 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:25:20.452616 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-7acfcc92-62d8-4ad7-b211-b43fc669b9b3 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] [instance: aa6e610d-51e7-4c09-91ca-d38f9a219a0b] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:25:20.460223 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7acfcc92-62d8-4ad7-b211-b43fc669b9b3 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:25:20.463481 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7acfcc92-62d8-4ad7-b211-b43fc669b9b3 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:25:20.463481 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7acfcc92-62d8-4ad7-b211-b43fc669b9b3 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:25:20.463481 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7acfcc92-62d8-4ad7-b211-b43fc669b9b3 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:25:20.463481 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7acfcc92-62d8-4ad7-b211-b43fc669b9b3 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:25:20.463481 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7acfcc92-62d8-4ad7-b211-b43fc669b9b3 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:25:20.526394 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-7acfcc92-62d8-4ad7-b211-b43fc669b9b3 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e209b72025e2476abc40f48e9ee676ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1edb7eea4b4746c49c85305ce134d8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:25:20.534314 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-7acfcc92-62d8-4ad7-b211-b43fc669b9b3 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] 10.222.0.33 "GET /compute/v2.1/servers/aa6e610d-51e7-4c09-91ca-d38f9a219a0b" status: 200 len: 1297 microversion: 2.1 time: 0.088478 Sep 23 05:25:20.534896 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3579/6980] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:25:20 2022] GET /compute/v2.1/servers/aa6e610d-51e7-4c09-91ca-d38f9a219a0b => generated 1297 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:25:21.557802 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0d50e801-aef0-4f69-b71a-135a03a5e864 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:25:21.558463 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-0d50e801-aef0-4f69-b71a-135a03a5e864 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] [instance: aa6e610d-51e7-4c09-91ca-d38f9a219a0b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:25:21.566681 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0d50e801-aef0-4f69-b71a-135a03a5e864 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:25:21.567198 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0d50e801-aef0-4f69-b71a-135a03a5e864 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:25:21.567657 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0d50e801-aef0-4f69-b71a-135a03a5e864 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:25:21.568378 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0d50e801-aef0-4f69-b71a-135a03a5e864 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:25:21.569029 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0d50e801-aef0-4f69-b71a-135a03a5e864 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:25:21.569637 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0d50e801-aef0-4f69-b71a-135a03a5e864 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:25:21.652198 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-0d50e801-aef0-4f69-b71a-135a03a5e864 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e209b72025e2476abc40f48e9ee676ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1edb7eea4b4746c49c85305ce134d8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:25:21.660551 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0d50e801-aef0-4f69-b71a-135a03a5e864 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] 10.222.0.33 "GET /compute/v2.1/servers/aa6e610d-51e7-4c09-91ca-d38f9a219a0b" status: 200 len: 1363 microversion: 2.1 time: 0.107256 Sep 23 05:25:21.661163 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3402/6981] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:25:21 2022] GET /compute/v2.1/servers/aa6e610d-51e7-4c09-91ca-d38f9a219a0b => generated 1363 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:25:22.682973 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d6b73246-c473-47e0-956d-d02b2c8a2346 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:25:22.683648 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d6b73246-c473-47e0-956d-d02b2c8a2346 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] [instance: aa6e610d-51e7-4c09-91ca-d38f9a219a0b] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:25:22.690768 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d6b73246-c473-47e0-956d-d02b2c8a2346 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:25:22.691255 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d6b73246-c473-47e0-956d-d02b2c8a2346 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:25:22.691692 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d6b73246-c473-47e0-956d-d02b2c8a2346 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:25:22.692380 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d6b73246-c473-47e0-956d-d02b2c8a2346 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:25:22.692837 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d6b73246-c473-47e0-956d-d02b2c8a2346 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:25:22.693259 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d6b73246-c473-47e0-956d-d02b2c8a2346 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:25:22.836536 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d6b73246-c473-47e0-956d-d02b2c8a2346 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e209b72025e2476abc40f48e9ee676ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1edb7eea4b4746c49c85305ce134d8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:25:22.844851 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d6b73246-c473-47e0-956d-d02b2c8a2346 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] 10.222.0.33 "GET /compute/v2.1/servers/aa6e610d-51e7-4c09-91ca-d38f9a219a0b" status: 200 len: 1470 microversion: 2.1 time: 0.166007 Sep 23 05:25:22.845510 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3580/6982] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:25:22 2022] GET /compute/v2.1/servers/aa6e610d-51e7-4c09-91ca-d38f9a219a0b => generated 1470 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:25:23.069731 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-cd0c67e0-dc05-44aa-b13a-d1945e06b27f req-5e8da2a0-881a-4400-9108-0865a1702eee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa6e610d-51e7-4c09-91ca-d38f9a219a0b", "tag": "b66c39af-ce15-4aee-9bea-e6b6449d1ad5"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:25:23.080606 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-cd0c67e0-dc05-44aa-b13a-d1945e06b27f req-5e8da2a0-881a-4400-9108-0865a1702eee service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:25:23.081103 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-cd0c67e0-dc05-44aa-b13a-d1945e06b27f req-5e8da2a0-881a-4400-9108-0865a1702eee service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:25:23.081551 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-cd0c67e0-dc05-44aa-b13a-d1945e06b27f req-5e8da2a0-881a-4400-9108-0865a1702eee service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:25:23.092522 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-cd0c67e0-dc05-44aa-b13a-d1945e06b27f req-5e8da2a0-881a-4400-9108-0865a1702eee service nova] Creating event network-changed:b66c39af-ce15-4aee-9bea-e6b6449d1ad5 for instance aa6e610d-51e7-4c09-91ca-d38f9a219a0b on n-h2-846463-3 Sep 23 05:25:23.098726 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-cd0c67e0-dc05-44aa-b13a-d1945e06b27f req-5e8da2a0-881a-4400-9108-0865a1702eee service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032543 Sep 23 05:25:23.099648 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3403/6983] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:25:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:25:23.868792 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b8bde158-9eb8-4acc-af3c-1086ca68e08c tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:25:23.869404 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b8bde158-9eb8-4acc-af3c-1086ca68e08c tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] [instance: aa6e610d-51e7-4c09-91ca-d38f9a219a0b] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:25:23.877009 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b8bde158-9eb8-4acc-af3c-1086ca68e08c tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:25:23.877513 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b8bde158-9eb8-4acc-af3c-1086ca68e08c tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:25:23.877995 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b8bde158-9eb8-4acc-af3c-1086ca68e08c tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:25:23.878765 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b8bde158-9eb8-4acc-af3c-1086ca68e08c tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:25:23.879233 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b8bde158-9eb8-4acc-af3c-1086ca68e08c tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:25:23.879696 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b8bde158-9eb8-4acc-af3c-1086ca68e08c tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:25:24.022256 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b8bde158-9eb8-4acc-af3c-1086ca68e08c tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e209b72025e2476abc40f48e9ee676ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1edb7eea4b4746c49c85305ce134d8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:25:24.029867 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b8bde158-9eb8-4acc-af3c-1086ca68e08c tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] 10.222.0.33 "GET /compute/v2.1/servers/aa6e610d-51e7-4c09-91ca-d38f9a219a0b" status: 200 len: 1470 microversion: 2.1 time: 0.165063 Sep 23 05:25:24.030461 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3581/6984] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:25:23 2022] GET /compute/v2.1/servers/aa6e610d-51e7-4c09-91ca-d38f9a219a0b => generated 1470 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:25:25.053048 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-31ebe2f0-6ee4-4ac4-a277-9bfb8845d068 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:25:25.053761 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-31ebe2f0-6ee4-4ac4-a277-9bfb8845d068 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] [instance: aa6e610d-51e7-4c09-91ca-d38f9a219a0b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:25:25.060785 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-31ebe2f0-6ee4-4ac4-a277-9bfb8845d068 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:25:25.061285 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-31ebe2f0-6ee4-4ac4-a277-9bfb8845d068 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:25:25.062251 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-31ebe2f0-6ee4-4ac4-a277-9bfb8845d068 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:25:25.062954 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-31ebe2f0-6ee4-4ac4-a277-9bfb8845d068 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:25:25.063424 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-31ebe2f0-6ee4-4ac4-a277-9bfb8845d068 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:25:25.063863 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-31ebe2f0-6ee4-4ac4-a277-9bfb8845d068 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:25:25.203073 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-31ebe2f0-6ee4-4ac4-a277-9bfb8845d068 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e209b72025e2476abc40f48e9ee676ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1edb7eea4b4746c49c85305ce134d8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:25:25.210941 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-31ebe2f0-6ee4-4ac4-a277-9bfb8845d068 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] 10.222.0.33 "GET /compute/v2.1/servers/aa6e610d-51e7-4c09-91ca-d38f9a219a0b" status: 200 len: 1470 microversion: 2.1 time: 0.162128 Sep 23 05:25:25.211538 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3404/6985] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:25:25 2022] GET /compute/v2.1/servers/aa6e610d-51e7-4c09-91ca-d38f9a219a0b => generated 1470 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:25:26.233876 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c13b845f-b7bb-4ef9-b181-d54faf33e56a tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:25:26.234519 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c13b845f-b7bb-4ef9-b181-d54faf33e56a tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] [instance: aa6e610d-51e7-4c09-91ca-d38f9a219a0b] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:25:26.241092 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c13b845f-b7bb-4ef9-b181-d54faf33e56a tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:25:26.241591 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c13b845f-b7bb-4ef9-b181-d54faf33e56a tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:25:26.242070 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c13b845f-b7bb-4ef9-b181-d54faf33e56a tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:25:26.242774 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c13b845f-b7bb-4ef9-b181-d54faf33e56a tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:25:26.249821 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c13b845f-b7bb-4ef9-b181-d54faf33e56a tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:25:26.249821 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c13b845f-b7bb-4ef9-b181-d54faf33e56a tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:25:26.388371 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c13b845f-b7bb-4ef9-b181-d54faf33e56a tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e209b72025e2476abc40f48e9ee676ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1edb7eea4b4746c49c85305ce134d8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:25:26.396958 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c13b845f-b7bb-4ef9-b181-d54faf33e56a tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] 10.222.0.33 "GET /compute/v2.1/servers/aa6e610d-51e7-4c09-91ca-d38f9a219a0b" status: 200 len: 1470 microversion: 2.1 time: 0.167077 Sep 23 05:25:26.397537 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3582/6986] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:25:26 2022] GET /compute/v2.1/servers/aa6e610d-51e7-4c09-91ca-d38f9a219a0b => generated 1470 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:25:27.420744 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a6eb089f-9d53-447d-b046-04abbdad09f3 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:25:27.421949 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a6eb089f-9d53-447d-b046-04abbdad09f3 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] [instance: aa6e610d-51e7-4c09-91ca-d38f9a219a0b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:25:27.428895 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a6eb089f-9d53-447d-b046-04abbdad09f3 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:25:27.429411 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a6eb089f-9d53-447d-b046-04abbdad09f3 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:25:27.429998 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a6eb089f-9d53-447d-b046-04abbdad09f3 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:25:27.430732 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a6eb089f-9d53-447d-b046-04abbdad09f3 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:25:27.431215 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a6eb089f-9d53-447d-b046-04abbdad09f3 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:25:27.431668 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a6eb089f-9d53-447d-b046-04abbdad09f3 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:25:27.583450 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a6eb089f-9d53-447d-b046-04abbdad09f3 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e209b72025e2476abc40f48e9ee676ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1edb7eea4b4746c49c85305ce134d8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:25:27.587579 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a6eb089f-9d53-447d-b046-04abbdad09f3 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] 10.222.0.33 "GET /compute/v2.1/servers/aa6e610d-51e7-4c09-91ca-d38f9a219a0b" status: 200 len: 1470 microversion: 2.1 time: 0.170912 Sep 23 05:25:27.588155 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3405/6987] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:25:27 2022] GET /compute/v2.1/servers/aa6e610d-51e7-4c09-91ca-d38f9a219a0b => generated 1470 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:25:28.613217 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ecbfb22f-b3d4-4b7b-b099-99d6fe676c09 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:25:28.613829 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ecbfb22f-b3d4-4b7b-b099-99d6fe676c09 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] [instance: aa6e610d-51e7-4c09-91ca-d38f9a219a0b] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:25:28.620652 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ecbfb22f-b3d4-4b7b-b099-99d6fe676c09 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:25:28.621211 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ecbfb22f-b3d4-4b7b-b099-99d6fe676c09 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:25:28.621657 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ecbfb22f-b3d4-4b7b-b099-99d6fe676c09 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:25:28.622415 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ecbfb22f-b3d4-4b7b-b099-99d6fe676c09 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:25:28.622880 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ecbfb22f-b3d4-4b7b-b099-99d6fe676c09 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:25:28.623315 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ecbfb22f-b3d4-4b7b-b099-99d6fe676c09 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:25:28.774424 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ecbfb22f-b3d4-4b7b-b099-99d6fe676c09 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e209b72025e2476abc40f48e9ee676ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1edb7eea4b4746c49c85305ce134d8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:25:28.782270 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ecbfb22f-b3d4-4b7b-b099-99d6fe676c09 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] 10.222.0.33 "GET /compute/v2.1/servers/aa6e610d-51e7-4c09-91ca-d38f9a219a0b" status: 200 len: 1470 microversion: 2.1 time: 0.172909 Sep 23 05:25:28.782856 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3583/6988] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:25:28 2022] GET /compute/v2.1/servers/aa6e610d-51e7-4c09-91ca-d38f9a219a0b => generated 1470 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:25:29.597938 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-6479985d-8168-45dc-849b-389f43c5ea02 req-49261039-ab4f-4a93-8614-940b4d25a2a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa6e610d-51e7-4c09-91ca-d38f9a219a0b", "name": "network-vif-plugged", "status": "completed", "tag": "b66c39af-ce15-4aee-9bea-e6b6449d1ad5"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:25:29.603717 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=6 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:25:29.609637 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-6479985d-8168-45dc-849b-389f43c5ea02 req-49261039-ab4f-4a93-8614-940b4d25a2a4 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:25:29.610159 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-6479985d-8168-45dc-849b-389f43c5ea02 req-49261039-ab4f-4a93-8614-940b4d25a2a4 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:25:29.610599 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-6479985d-8168-45dc-849b-389f43c5ea02 req-49261039-ab4f-4a93-8614-940b4d25a2a4 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:25:29.621363 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-6479985d-8168-45dc-849b-389f43c5ea02 req-49261039-ab4f-4a93-8614-940b4d25a2a4 service nova] Creating event network-vif-plugged:b66c39af-ce15-4aee-9bea-e6b6449d1ad5 for instance aa6e610d-51e7-4c09-91ca-d38f9a219a0b on n-h2-846463-3 Sep 23 05:25:29.626471 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-6479985d-8168-45dc-849b-389f43c5ea02 req-49261039-ab4f-4a93-8614-940b4d25a2a4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032251 Sep 23 05:25:29.627053 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3406/6989] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:25:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:25:29.804859 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4bf570e4-b753-4781-bb63-141710714715 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:25:29.805470 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4bf570e4-b753-4781-bb63-141710714715 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] [instance: aa6e610d-51e7-4c09-91ca-d38f9a219a0b] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:25:29.807426 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:25:29.808092 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=6 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:25:29.813308 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4bf570e4-b753-4781-bb63-141710714715 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:25:29.813793 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4bf570e4-b753-4781-bb63-141710714715 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:25:29.814275 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4bf570e4-b753-4781-bb63-141710714715 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:25:29.814998 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4bf570e4-b753-4781-bb63-141710714715 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:25:29.815458 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4bf570e4-b753-4781-bb63-141710714715 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:25:29.815881 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4bf570e4-b753-4781-bb63-141710714715 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:25:29.956144 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-4bf570e4-b753-4781-bb63-141710714715 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e209b72025e2476abc40f48e9ee676ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1edb7eea4b4746c49c85305ce134d8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:25:29.964010 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4bf570e4-b753-4781-bb63-141710714715 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] 10.222.0.33 "GET /compute/v2.1/servers/aa6e610d-51e7-4c09-91ca-d38f9a219a0b" status: 200 len: 1470 microversion: 2.1 time: 0.163045 Sep 23 05:25:29.964578 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3584/6990] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:25:29 2022] GET /compute/v2.1/servers/aa6e610d-51e7-4c09-91ca-d38f9a219a0b => generated 1470 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:25:30.995777 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-64c7f9c1-c3ed-43e9-9519-738cc3932d61 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:25:30.996509 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-64c7f9c1-c3ed-43e9-9519-738cc3932d61 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] [instance: aa6e610d-51e7-4c09-91ca-d38f9a219a0b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:25:31.002884 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-64c7f9c1-c3ed-43e9-9519-738cc3932d61 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:25:31.006559 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-64c7f9c1-c3ed-43e9-9519-738cc3932d61 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:25:31.006559 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-64c7f9c1-c3ed-43e9-9519-738cc3932d61 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:25:31.006559 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-64c7f9c1-c3ed-43e9-9519-738cc3932d61 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:25:31.006559 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-64c7f9c1-c3ed-43e9-9519-738cc3932d61 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:25:31.006559 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-64c7f9c1-c3ed-43e9-9519-738cc3932d61 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:25:31.146005 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-64c7f9c1-c3ed-43e9-9519-738cc3932d61 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e209b72025e2476abc40f48e9ee676ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1edb7eea4b4746c49c85305ce134d8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:25:31.153869 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-64c7f9c1-c3ed-43e9-9519-738cc3932d61 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] 10.222.0.33 "GET /compute/v2.1/servers/aa6e610d-51e7-4c09-91ca-d38f9a219a0b" status: 200 len: 1641 microversion: 2.1 time: 0.163652 Sep 23 05:25:31.154471 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3407/6991] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:25:30 2022] GET /compute/v2.1/servers/aa6e610d-51e7-4c09-91ca-d38f9a219a0b => generated 1641 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:25:31.176875 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-eaa5181c-aebe-4e53-b07c-3e195d57bec4 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:25:31.177487 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-eaa5181c-aebe-4e53-b07c-3e195d57bec4 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] [instance: aa6e610d-51e7-4c09-91ca-d38f9a219a0b] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:25:31.184037 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eaa5181c-aebe-4e53-b07c-3e195d57bec4 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:25:31.185620 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eaa5181c-aebe-4e53-b07c-3e195d57bec4 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:25:31.185620 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eaa5181c-aebe-4e53-b07c-3e195d57bec4 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:25:31.185822 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eaa5181c-aebe-4e53-b07c-3e195d57bec4 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:25:31.186224 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eaa5181c-aebe-4e53-b07c-3e195d57bec4 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:25:31.186671 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eaa5181c-aebe-4e53-b07c-3e195d57bec4 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:25:31.328145 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-eaa5181c-aebe-4e53-b07c-3e195d57bec4 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e209b72025e2476abc40f48e9ee676ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1edb7eea4b4746c49c85305ce134d8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:25:31.336127 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-eaa5181c-aebe-4e53-b07c-3e195d57bec4 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] 10.222.0.33 "GET /compute/v2.1/servers/aa6e610d-51e7-4c09-91ca-d38f9a219a0b" status: 200 len: 1641 microversion: 2.1 time: 0.163054 Sep 23 05:25:31.336713 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3585/6992] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:25:31 2022] GET /compute/v2.1/servers/aa6e610d-51e7-4c09-91ca-d38f9a219a0b => generated 1641 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:25:31.358248 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-911d542d-2887-4cb4-97da-d36d49ebab72 tempest-TestSecurityGroupsBasicOps-1043220844 tempest-TestSecurityGroupsBasicOps-1043220844-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:25:31.358873 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-911d542d-2887-4cb4-97da-d36d49ebab72 tempest-TestSecurityGroupsBasicOps-1043220844 tempest-TestSecurityGroupsBasicOps-1043220844-project-admin] [instance: aa6e610d-51e7-4c09-91ca-d38f9a219a0b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:25:31.364858 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-911d542d-2887-4cb4-97da-d36d49ebab72 tempest-TestSecurityGroupsBasicOps-1043220844 tempest-TestSecurityGroupsBasicOps-1043220844-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:25:31.365358 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-911d542d-2887-4cb4-97da-d36d49ebab72 tempest-TestSecurityGroupsBasicOps-1043220844 tempest-TestSecurityGroupsBasicOps-1043220844-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:25:31.365810 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-911d542d-2887-4cb4-97da-d36d49ebab72 tempest-TestSecurityGroupsBasicOps-1043220844 tempest-TestSecurityGroupsBasicOps-1043220844-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:25:31.366537 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-911d542d-2887-4cb4-97da-d36d49ebab72 tempest-TestSecurityGroupsBasicOps-1043220844 tempest-TestSecurityGroupsBasicOps-1043220844-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:25:31.367008 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-911d542d-2887-4cb4-97da-d36d49ebab72 tempest-TestSecurityGroupsBasicOps-1043220844 tempest-TestSecurityGroupsBasicOps-1043220844-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:25:31.367470 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-911d542d-2887-4cb4-97da-d36d49ebab72 tempest-TestSecurityGroupsBasicOps-1043220844 tempest-TestSecurityGroupsBasicOps-1043220844-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:25:31.667679 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-911d542d-2887-4cb4-97da-d36d49ebab72 tempest-TestSecurityGroupsBasicOps-1043220844 tempest-TestSecurityGroupsBasicOps-1043220844-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/aa6e610d-51e7-4c09-91ca-d38f9a219a0b" status: 200 len: 1792 microversion: 2.1 time: 0.313024 Sep 23 05:25:31.668264 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3408/6993] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:25:31 2022] GET /compute/v2.1/servers/aa6e610d-51e7-4c09-91ca-d38f9a219a0b => generated 1792 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:25:33.610657 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-0f6de6bf-6a1f-45a1-b6e1-8aca69f61d5a req-4e3cf370-58fa-40c3-afa1-5d5100065da9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa6e610d-51e7-4c09-91ca-d38f9a219a0b", "tag": "b66c39af-ce15-4aee-9bea-e6b6449d1ad5"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:25:33.620218 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-0f6de6bf-6a1f-45a1-b6e1-8aca69f61d5a req-4e3cf370-58fa-40c3-afa1-5d5100065da9 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:25:33.620715 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-0f6de6bf-6a1f-45a1-b6e1-8aca69f61d5a req-4e3cf370-58fa-40c3-afa1-5d5100065da9 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:25:33.621156 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-0f6de6bf-6a1f-45a1-b6e1-8aca69f61d5a req-4e3cf370-58fa-40c3-afa1-5d5100065da9 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:25:33.633107 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-0f6de6bf-6a1f-45a1-b6e1-8aca69f61d5a req-4e3cf370-58fa-40c3-afa1-5d5100065da9 service nova] Creating event network-changed:b66c39af-ce15-4aee-9bea-e6b6449d1ad5 for instance aa6e610d-51e7-4c09-91ca-d38f9a219a0b on n-h2-846463-3 Sep 23 05:25:33.639468 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-0f6de6bf-6a1f-45a1-b6e1-8aca69f61d5a req-4e3cf370-58fa-40c3-afa1-5d5100065da9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101284 Sep 23 05:25:33.641258 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3586/6994] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:25:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:26:14.435829 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0eecb284-ec3d-4e31-98ff-a0b9c7a5be11 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-372852389", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "networks": [{"uuid": "b664fc35-0e7d-4f7e-bfdc-efddc0c7fff5"}], "key_name": "tempest-TestSecurityGroupsBasicOps-908113039", "security_groups": []}, "os:scheduler_hints": {"different_host": ["aa6e610d-51e7-4c09-91ca-d38f9a219a0b"]}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:26:14.463349 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:26:14.464508 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=34 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:26:14.507339 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.network.neutron [None req-0eecb284-ec3d-4e31-98ff-a0b9c7a5be11 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] validate_networks() for [('b664fc35-0e7d-4f7e-bfdc-efddc0c7fff5', None, None, None, None, None)] {{(pid=122698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 05:26:15.015444 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-0eecb284-ec3d-4e31-98ff-a0b9c7a5be11 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Flavor limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 05:26:15.016147 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-0eecb284-ec3d-4e31-98ff-a0b9c7a5be11 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Image limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 05:26:15.016648 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-0eecb284-ec3d-4e31-98ff-a0b9c7a5be11 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Flavor pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 05:26:15.017080 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-0eecb284-ec3d-4e31-98ff-a0b9c7a5be11 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Image pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 05:26:15.017543 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-0eecb284-ec3d-4e31-98ff-a0b9c7a5be11 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 05:26:15.027900 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0eecb284-ec3d-4e31-98ff-a0b9c7a5be11 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:26:15.028396 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0eecb284-ec3d-4e31-98ff-a0b9c7a5be11 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:26:15.028854 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0eecb284-ec3d-4e31-98ff-a0b9c7a5be11 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:26:15.029642 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0eecb284-ec3d-4e31-98ff-a0b9c7a5be11 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:26:15.030158 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0eecb284-ec3d-4e31-98ff-a0b9c7a5be11 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:26:15.030612 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0eecb284-ec3d-4e31-98ff-a0b9c7a5be11 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:26:15.047915 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-0eecb284-ec3d-4e31-98ff-a0b9c7a5be11 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Getting quotas for project 1edb7eea4b4746c49c85305ce134d8bd. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 05:26:15.053306 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-0eecb284-ec3d-4e31-98ff-a0b9c7a5be11 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Getting quotas for user e209b72025e2476abc40f48e9ee676ce and project 1edb7eea4b4746c49c85305ce134d8bd. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 05:26:15.066493 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-0eecb284-ec3d-4e31-98ff-a0b9c7a5be11 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Going to run 1 instances... {{(pid=122698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 05:26:15.069424 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-0eecb284-ec3d-4e31-98ff-a0b9c7a5be11 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] [instance: ec42e293-9499-458e-9d17-e05431e138cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 05:26:15.159279 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0eecb284-ec3d-4e31-98ff-a0b9c7a5be11 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 0.727604 Sep 23 05:26:15.165975 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3409/6995] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 05:26:14 2022] POST /compute/v2.1/servers => generated 361 bytes in 729 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 05:26:15.169214 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:26:15.170009 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=46 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:26:15.174058 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d6109f38-43f6-4c3d-9000-ae0b79793bdb tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:26:15.178987 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d6109f38-43f6-4c3d-9000-ae0b79793bdb tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] [instance: ec42e293-9499-458e-9d17-e05431e138cb] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:26:15.235948 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d6109f38-43f6-4c3d-9000-ae0b79793bdb tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e209b72025e2476abc40f48e9ee676ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1edb7eea4b4746c49c85305ce134d8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:26:15.240030 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d6109f38-43f6-4c3d-9000-ae0b79793bdb tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] 10.222.0.33 "GET /compute/v2.1/servers/ec42e293-9499-458e-9d17-e05431e138cb" status: 200 len: 1240 microversion: 2.1 time: 0.072552 Sep 23 05:26:15.240974 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3587/6996] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:26:15 2022] GET /compute/v2.1/servers/ec42e293-9499-458e-9d17-e05431e138cb => generated 1240 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:26:16.263597 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ff3af668-8af6-45ec-865d-70466ae380fb tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:26:16.264234 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-ff3af668-8af6-45ec-865d-70466ae380fb tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] [instance: ec42e293-9499-458e-9d17-e05431e138cb] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:26:16.271179 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ff3af668-8af6-45ec-865d-70466ae380fb tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:26:16.271696 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ff3af668-8af6-45ec-865d-70466ae380fb tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:26:16.272162 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ff3af668-8af6-45ec-865d-70466ae380fb tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:26:16.272885 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ff3af668-8af6-45ec-865d-70466ae380fb tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:26:16.273367 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ff3af668-8af6-45ec-865d-70466ae380fb tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:26:16.273815 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ff3af668-8af6-45ec-865d-70466ae380fb tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:26:16.361207 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ff3af668-8af6-45ec-865d-70466ae380fb tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e209b72025e2476abc40f48e9ee676ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1edb7eea4b4746c49c85305ce134d8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:26:16.370678 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ff3af668-8af6-45ec-865d-70466ae380fb tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] 10.222.0.33 "GET /compute/v2.1/servers/ec42e293-9499-458e-9d17-e05431e138cb" status: 200 len: 1244 microversion: 2.1 time: 0.111791 Sep 23 05:26:16.382851 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3410/6997] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:26:16 2022] GET /compute/v2.1/servers/ec42e293-9499-458e-9d17-e05431e138cb => generated 1244 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:26:17.394585 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-96b1ae3c-ed52-4fe6-beef-f525f8da0435 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:26:17.395846 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-96b1ae3c-ed52-4fe6-beef-f525f8da0435 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] [instance: ec42e293-9499-458e-9d17-e05431e138cb] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:26:17.404721 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-96b1ae3c-ed52-4fe6-beef-f525f8da0435 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:26:17.405212 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-96b1ae3c-ed52-4fe6-beef-f525f8da0435 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:26:17.405651 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-96b1ae3c-ed52-4fe6-beef-f525f8da0435 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:26:17.406424 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-96b1ae3c-ed52-4fe6-beef-f525f8da0435 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:26:17.406888 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-96b1ae3c-ed52-4fe6-beef-f525f8da0435 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:26:17.407328 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-96b1ae3c-ed52-4fe6-beef-f525f8da0435 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:26:17.477746 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-96b1ae3c-ed52-4fe6-beef-f525f8da0435 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e209b72025e2476abc40f48e9ee676ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1edb7eea4b4746c49c85305ce134d8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:26:17.487552 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-96b1ae3c-ed52-4fe6-beef-f525f8da0435 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] 10.222.0.33 "GET /compute/v2.1/servers/ec42e293-9499-458e-9d17-e05431e138cb" status: 200 len: 1310 microversion: 2.1 time: 0.097154 Sep 23 05:26:17.488142 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3588/6998] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:26:17 2022] GET /compute/v2.1/servers/ec42e293-9499-458e-9d17-e05431e138cb => generated 1310 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:26:18.511819 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7d5b6ec7-b193-46b7-b264-10ed50f21d5d tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:26:18.513795 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7d5b6ec7-b193-46b7-b264-10ed50f21d5d tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] [instance: ec42e293-9499-458e-9d17-e05431e138cb] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:26:18.520549 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7d5b6ec7-b193-46b7-b264-10ed50f21d5d tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:26:18.521309 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7d5b6ec7-b193-46b7-b264-10ed50f21d5d tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:26:18.521917 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7d5b6ec7-b193-46b7-b264-10ed50f21d5d tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:26:18.526594 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7d5b6ec7-b193-46b7-b264-10ed50f21d5d tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:26:18.529100 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7d5b6ec7-b193-46b7-b264-10ed50f21d5d tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:26:18.529761 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7d5b6ec7-b193-46b7-b264-10ed50f21d5d tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:26:18.616402 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-7d5b6ec7-b193-46b7-b264-10ed50f21d5d tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e209b72025e2476abc40f48e9ee676ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1edb7eea4b4746c49c85305ce134d8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:26:18.625198 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7d5b6ec7-b193-46b7-b264-10ed50f21d5d tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] 10.222.0.33 "GET /compute/v2.1/servers/ec42e293-9499-458e-9d17-e05431e138cb" status: 200 len: 1298 microversion: 2.1 time: 0.117750 Sep 23 05:26:18.625812 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3411/6999] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:26:18 2022] GET /compute/v2.1/servers/ec42e293-9499-458e-9d17-e05431e138cb => generated 1298 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:26:18.873334 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-01687642-752a-44ee-b7b3-cceae4ed1bbc req-801fc6c0-5338-4a03-9878-94514c3a9b0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec42e293-9499-458e-9d17-e05431e138cb", "tag": "a8660beb-d514-4d42-bcfe-015ecff274ac"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:26:18.883256 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-01687642-752a-44ee-b7b3-cceae4ed1bbc req-801fc6c0-5338-4a03-9878-94514c3a9b0e service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:26:18.883737 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-01687642-752a-44ee-b7b3-cceae4ed1bbc req-801fc6c0-5338-4a03-9878-94514c3a9b0e service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:26:18.884181 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-01687642-752a-44ee-b7b3-cceae4ed1bbc req-801fc6c0-5338-4a03-9878-94514c3a9b0e service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:26:18.895776 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-01687642-752a-44ee-b7b3-cceae4ed1bbc req-801fc6c0-5338-4a03-9878-94514c3a9b0e service nova] Creating event network-changed:a8660beb-d514-4d42-bcfe-015ecff274ac for instance ec42e293-9499-458e-9d17-e05431e138cb on n-h1-846463-3 Sep 23 05:26:18.901447 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-01687642-752a-44ee-b7b3-cceae4ed1bbc req-801fc6c0-5338-4a03-9878-94514c3a9b0e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031894 Sep 23 05:26:18.903126 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3589/7000] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:26:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:26:19.649493 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-262fcc0b-faa1-44c2-8160-34624857ddcc tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:26:19.650183 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-262fcc0b-faa1-44c2-8160-34624857ddcc tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] [instance: ec42e293-9499-458e-9d17-e05431e138cb] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:26:19.657203 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-262fcc0b-faa1-44c2-8160-34624857ddcc tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:26:19.657709 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-262fcc0b-faa1-44c2-8160-34624857ddcc tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:26:19.658203 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-262fcc0b-faa1-44c2-8160-34624857ddcc tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:26:19.658915 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-262fcc0b-faa1-44c2-8160-34624857ddcc tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:26:19.659438 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-262fcc0b-faa1-44c2-8160-34624857ddcc tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:26:19.659877 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-262fcc0b-faa1-44c2-8160-34624857ddcc tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:26:19.739584 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-262fcc0b-faa1-44c2-8160-34624857ddcc tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e209b72025e2476abc40f48e9ee676ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1edb7eea4b4746c49c85305ce134d8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:26:19.747422 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-262fcc0b-faa1-44c2-8160-34624857ddcc tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] 10.222.0.33 "GET /compute/v2.1/servers/ec42e293-9499-458e-9d17-e05431e138cb" status: 200 len: 1298 microversion: 2.1 time: 0.102475 Sep 23 05:26:19.748008 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3412/7001] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:26:19 2022] GET /compute/v2.1/servers/ec42e293-9499-458e-9d17-e05431e138cb => generated 1298 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:26:20.771964 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-dd86d2be-7f7b-456a-b7e7-d910956d798b tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:26:20.772671 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-dd86d2be-7f7b-456a-b7e7-d910956d798b tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] [instance: ec42e293-9499-458e-9d17-e05431e138cb] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:26:20.778941 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dd86d2be-7f7b-456a-b7e7-d910956d798b tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:26:20.779439 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dd86d2be-7f7b-456a-b7e7-d910956d798b tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:26:20.779886 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dd86d2be-7f7b-456a-b7e7-d910956d798b tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:26:20.780588 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dd86d2be-7f7b-456a-b7e7-d910956d798b tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:26:20.781086 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dd86d2be-7f7b-456a-b7e7-d910956d798b tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:26:20.781524 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dd86d2be-7f7b-456a-b7e7-d910956d798b tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:26:20.866276 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-dd86d2be-7f7b-456a-b7e7-d910956d798b tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e209b72025e2476abc40f48e9ee676ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1edb7eea4b4746c49c85305ce134d8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:26:20.874108 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-dd86d2be-7f7b-456a-b7e7-d910956d798b tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] 10.222.0.33 "GET /compute/v2.1/servers/ec42e293-9499-458e-9d17-e05431e138cb" status: 200 len: 1298 microversion: 2.1 time: 0.107382 Sep 23 05:26:20.874692 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3590/7002] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:26:20 2022] GET /compute/v2.1/servers/ec42e293-9499-458e-9d17-e05431e138cb => generated 1298 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:26:21.896783 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-032c28b1-fad5-4b6a-9bec-9524e4f2574e tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:26:21.897416 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-032c28b1-fad5-4b6a-9bec-9524e4f2574e tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] [instance: ec42e293-9499-458e-9d17-e05431e138cb] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:26:21.904802 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-032c28b1-fad5-4b6a-9bec-9524e4f2574e tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:26:21.905346 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-032c28b1-fad5-4b6a-9bec-9524e4f2574e tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:26:21.905810 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-032c28b1-fad5-4b6a-9bec-9524e4f2574e tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:26:21.906554 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-032c28b1-fad5-4b6a-9bec-9524e4f2574e tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:26:21.907034 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-032c28b1-fad5-4b6a-9bec-9524e4f2574e tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:26:21.907479 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-032c28b1-fad5-4b6a-9bec-9524e4f2574e tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:26:21.988342 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-032c28b1-fad5-4b6a-9bec-9524e4f2574e tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e209b72025e2476abc40f48e9ee676ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1edb7eea4b4746c49c85305ce134d8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:26:21.996681 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-032c28b1-fad5-4b6a-9bec-9524e4f2574e tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] 10.222.0.33 "GET /compute/v2.1/servers/ec42e293-9499-458e-9d17-e05431e138cb" status: 200 len: 1298 microversion: 2.1 time: 0.103856 Sep 23 05:26:21.997260 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3413/7003] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:26:21 2022] GET /compute/v2.1/servers/ec42e293-9499-458e-9d17-e05431e138cb => generated 1298 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:26:23.019467 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ebf40d5e-b1b9-43fe-aa22-172b1a9eab6c tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:26:23.020302 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ebf40d5e-b1b9-43fe-aa22-172b1a9eab6c tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] [instance: ec42e293-9499-458e-9d17-e05431e138cb] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:26:23.028998 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ebf40d5e-b1b9-43fe-aa22-172b1a9eab6c tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:26:23.029528 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ebf40d5e-b1b9-43fe-aa22-172b1a9eab6c tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:26:23.030042 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ebf40d5e-b1b9-43fe-aa22-172b1a9eab6c tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:26:23.030733 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ebf40d5e-b1b9-43fe-aa22-172b1a9eab6c tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:26:23.031227 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ebf40d5e-b1b9-43fe-aa22-172b1a9eab6c tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:26:23.031678 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ebf40d5e-b1b9-43fe-aa22-172b1a9eab6c tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:26:23.116173 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ebf40d5e-b1b9-43fe-aa22-172b1a9eab6c tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e209b72025e2476abc40f48e9ee676ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1edb7eea4b4746c49c85305ce134d8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:26:23.124291 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ebf40d5e-b1b9-43fe-aa22-172b1a9eab6c tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] 10.222.0.33 "GET /compute/v2.1/servers/ec42e293-9499-458e-9d17-e05431e138cb" status: 200 len: 1298 microversion: 2.1 time: 0.109025 Sep 23 05:26:23.125065 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3591/7004] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:26:23 2022] GET /compute/v2.1/servers/ec42e293-9499-458e-9d17-e05431e138cb => generated 1298 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:26:23.202404 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-68164684-24a7-4262-af0c-96dfe1256e58 req-8069494d-63d8-442a-814d-d26595f917da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec42e293-9499-458e-9d17-e05431e138cb", "name": "network-vif-plugged", "status": "completed", "tag": "a8660beb-d514-4d42-bcfe-015ecff274ac"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:26:23.213205 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-68164684-24a7-4262-af0c-96dfe1256e58 req-8069494d-63d8-442a-814d-d26595f917da service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:26:23.213924 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-68164684-24a7-4262-af0c-96dfe1256e58 req-8069494d-63d8-442a-814d-d26595f917da service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:26:23.214377 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-68164684-24a7-4262-af0c-96dfe1256e58 req-8069494d-63d8-442a-814d-d26595f917da service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:26:23.225793 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-68164684-24a7-4262-af0c-96dfe1256e58 req-8069494d-63d8-442a-814d-d26595f917da service nova] Creating event network-vif-plugged:a8660beb-d514-4d42-bcfe-015ecff274ac for instance ec42e293-9499-458e-9d17-e05431e138cb on n-h1-846463-3 Sep 23 05:26:23.231122 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-68164684-24a7-4262-af0c-96dfe1256e58 req-8069494d-63d8-442a-814d-d26595f917da service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032808 Sep 23 05:26:23.231719 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3414/7005] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:26:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:26:24.148778 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-703a14c1-c285-41e4-8686-52edbde0ef43 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:26:24.149385 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-703a14c1-c285-41e4-8686-52edbde0ef43 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] [instance: ec42e293-9499-458e-9d17-e05431e138cb] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:26:24.155927 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-703a14c1-c285-41e4-8686-52edbde0ef43 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:26:24.156419 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-703a14c1-c285-41e4-8686-52edbde0ef43 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:26:24.156849 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-703a14c1-c285-41e4-8686-52edbde0ef43 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:26:24.157534 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-703a14c1-c285-41e4-8686-52edbde0ef43 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:26:24.158010 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-703a14c1-c285-41e4-8686-52edbde0ef43 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:26:24.158434 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-703a14c1-c285-41e4-8686-52edbde0ef43 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:26:24.240799 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-703a14c1-c285-41e4-8686-52edbde0ef43 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e209b72025e2476abc40f48e9ee676ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1edb7eea4b4746c49c85305ce134d8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:26:24.248759 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-703a14c1-c285-41e4-8686-52edbde0ef43 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] 10.222.0.33 "GET /compute/v2.1/servers/ec42e293-9499-458e-9d17-e05431e138cb" status: 200 len: 1298 microversion: 2.1 time: 0.104289 Sep 23 05:26:24.249360 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3592/7006] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:26:24 2022] GET /compute/v2.1/servers/ec42e293-9499-458e-9d17-e05431e138cb => generated 1298 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:26:25.271445 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:26:25.272346 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=6 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:26:25.276530 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3ec06fa3-5350-48fc-9de4-be94965eee6f tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:26:25.277301 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3ec06fa3-5350-48fc-9de4-be94965eee6f tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] [instance: ec42e293-9499-458e-9d17-e05431e138cb] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:26:25.283684 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3ec06fa3-5350-48fc-9de4-be94965eee6f tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:26:25.284221 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3ec06fa3-5350-48fc-9de4-be94965eee6f tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:26:25.284706 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3ec06fa3-5350-48fc-9de4-be94965eee6f tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:26:25.294426 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3ec06fa3-5350-48fc-9de4-be94965eee6f tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:26:25.294426 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3ec06fa3-5350-48fc-9de4-be94965eee6f tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:26:25.294426 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3ec06fa3-5350-48fc-9de4-be94965eee6f tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:26:25.379922 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-3ec06fa3-5350-48fc-9de4-be94965eee6f tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e209b72025e2476abc40f48e9ee676ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1edb7eea4b4746c49c85305ce134d8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:26:25.387876 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3ec06fa3-5350-48fc-9de4-be94965eee6f tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] 10.222.0.33 "GET /compute/v2.1/servers/ec42e293-9499-458e-9d17-e05431e138cb" status: 200 len: 1469 microversion: 2.1 time: 0.119821 Sep 23 05:26:25.388573 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3415/7007] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:26:25 2022] GET /compute/v2.1/servers/ec42e293-9499-458e-9d17-e05431e138cb => generated 1469 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:26:25.411725 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c2148f40-e499-4a1b-a9e3-45ea5bc8715a tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:26:25.412349 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c2148f40-e499-4a1b-a9e3-45ea5bc8715a tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] [instance: ec42e293-9499-458e-9d17-e05431e138cb] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:26:25.415056 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:26:25.420166 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c2148f40-e499-4a1b-a9e3-45ea5bc8715a tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:26:25.424709 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c2148f40-e499-4a1b-a9e3-45ea5bc8715a tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:26:25.424709 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c2148f40-e499-4a1b-a9e3-45ea5bc8715a tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:26:25.424709 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c2148f40-e499-4a1b-a9e3-45ea5bc8715a tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:26:25.424709 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c2148f40-e499-4a1b-a9e3-45ea5bc8715a tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:26:25.424709 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c2148f40-e499-4a1b-a9e3-45ea5bc8715a tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:26:25.504765 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c2148f40-e499-4a1b-a9e3-45ea5bc8715a tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e209b72025e2476abc40f48e9ee676ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1edb7eea4b4746c49c85305ce134d8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:26:25.512887 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c2148f40-e499-4a1b-a9e3-45ea5bc8715a tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] 10.222.0.33 "GET /compute/v2.1/servers/ec42e293-9499-458e-9d17-e05431e138cb" status: 200 len: 1469 microversion: 2.1 time: 0.105643 Sep 23 05:26:25.513457 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3593/7008] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:26:25 2022] GET /compute/v2.1/servers/ec42e293-9499-458e-9d17-e05431e138cb => generated 1469 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:26:25.535449 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5d944ba7-597d-4ba5-8892-a293e819423b tempest-TestSecurityGroupsBasicOps-1043220844 tempest-TestSecurityGroupsBasicOps-1043220844-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:26:25.536071 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5d944ba7-597d-4ba5-8892-a293e819423b tempest-TestSecurityGroupsBasicOps-1043220844 tempest-TestSecurityGroupsBasicOps-1043220844-project-admin] [instance: ec42e293-9499-458e-9d17-e05431e138cb] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:26:25.542595 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5d944ba7-597d-4ba5-8892-a293e819423b tempest-TestSecurityGroupsBasicOps-1043220844 tempest-TestSecurityGroupsBasicOps-1043220844-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:26:25.543107 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5d944ba7-597d-4ba5-8892-a293e819423b tempest-TestSecurityGroupsBasicOps-1043220844 tempest-TestSecurityGroupsBasicOps-1043220844-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:26:25.543567 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5d944ba7-597d-4ba5-8892-a293e819423b tempest-TestSecurityGroupsBasicOps-1043220844 tempest-TestSecurityGroupsBasicOps-1043220844-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:26:25.544278 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5d944ba7-597d-4ba5-8892-a293e819423b tempest-TestSecurityGroupsBasicOps-1043220844 tempest-TestSecurityGroupsBasicOps-1043220844-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:26:25.544756 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5d944ba7-597d-4ba5-8892-a293e819423b tempest-TestSecurityGroupsBasicOps-1043220844 tempest-TestSecurityGroupsBasicOps-1043220844-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:26:25.545203 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5d944ba7-597d-4ba5-8892-a293e819423b tempest-TestSecurityGroupsBasicOps-1043220844 tempest-TestSecurityGroupsBasicOps-1043220844-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:26:25.625041 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5d944ba7-597d-4ba5-8892-a293e819423b tempest-TestSecurityGroupsBasicOps-1043220844 tempest-TestSecurityGroupsBasicOps-1043220844-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/ec42e293-9499-458e-9d17-e05431e138cb" status: 200 len: 1620 microversion: 2.1 time: 0.093269 Sep 23 05:26:25.625634 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3416/7009] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:26:25 2022] GET /compute/v2.1/servers/ec42e293-9499-458e-9d17-e05431e138cb => generated 1620 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:26:25.648149 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-05079689-ceb1-4981-bf5f-a52cc7cf755e tempest-TestSecurityGroupsBasicOps-1043220844 tempest-TestSecurityGroupsBasicOps-1043220844-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:26:25.648997 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-05079689-ceb1-4981-bf5f-a52cc7cf755e tempest-TestSecurityGroupsBasicOps-1043220844 tempest-TestSecurityGroupsBasicOps-1043220844-project-admin] [instance: aa6e610d-51e7-4c09-91ca-d38f9a219a0b] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:26:25.655239 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-05079689-ceb1-4981-bf5f-a52cc7cf755e tempest-TestSecurityGroupsBasicOps-1043220844 tempest-TestSecurityGroupsBasicOps-1043220844-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:26:25.655741 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-05079689-ceb1-4981-bf5f-a52cc7cf755e tempest-TestSecurityGroupsBasicOps-1043220844 tempest-TestSecurityGroupsBasicOps-1043220844-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:26:25.656192 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-05079689-ceb1-4981-bf5f-a52cc7cf755e tempest-TestSecurityGroupsBasicOps-1043220844 tempest-TestSecurityGroupsBasicOps-1043220844-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:26:25.656894 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-05079689-ceb1-4981-bf5f-a52cc7cf755e tempest-TestSecurityGroupsBasicOps-1043220844 tempest-TestSecurityGroupsBasicOps-1043220844-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:26:25.657361 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-05079689-ceb1-4981-bf5f-a52cc7cf755e tempest-TestSecurityGroupsBasicOps-1043220844 tempest-TestSecurityGroupsBasicOps-1043220844-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:26:25.657795 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-05079689-ceb1-4981-bf5f-a52cc7cf755e tempest-TestSecurityGroupsBasicOps-1043220844 tempest-TestSecurityGroupsBasicOps-1043220844-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:26:25.793355 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-05079689-ceb1-4981-bf5f-a52cc7cf755e tempest-TestSecurityGroupsBasicOps-1043220844 tempest-TestSecurityGroupsBasicOps-1043220844-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/aa6e610d-51e7-4c09-91ca-d38f9a219a0b" status: 200 len: 1911 microversion: 2.1 time: 0.149732 Sep 23 05:26:25.794051 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3594/7010] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:26:25 2022] GET /compute/v2.1/servers/aa6e610d-51e7-4c09-91ca-d38f9a219a0b => generated 1911 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:26:25.861512 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f6ef8d4f-7738-414a-84cd-2d7ede8b9557 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:26:25.862075 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f6ef8d4f-7738-414a-84cd-2d7ede8b9557 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] [instance: ec42e293-9499-458e-9d17-e05431e138cb] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:26:25.868532 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f6ef8d4f-7738-414a-84cd-2d7ede8b9557 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:26:25.869039 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f6ef8d4f-7738-414a-84cd-2d7ede8b9557 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:26:25.869496 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f6ef8d4f-7738-414a-84cd-2d7ede8b9557 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:26:25.870239 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f6ef8d4f-7738-414a-84cd-2d7ede8b9557 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:26:25.871075 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f6ef8d4f-7738-414a-84cd-2d7ede8b9557 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:26:25.871532 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f6ef8d4f-7738-414a-84cd-2d7ede8b9557 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:26:25.896631 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f6ef8d4f-7738-414a-84cd-2d7ede8b9557 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] [instance: ec42e293-9499-458e-9d17-e05431e138cb] Going to try to terminate instance {{(pid=122698) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 05:26:26.199178 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f6ef8d4f-7738-414a-84cd-2d7ede8b9557 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ec42e293-9499-458e-9d17-e05431e138cb" status: 204 len: 0 microversion: 2.1 time: 0.341679 Sep 23 05:26:26.199813 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3417/7011] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 05:26:25 2022] DELETE /compute/v2.1/servers/ec42e293-9499-458e-9d17-e05431e138cb => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 05:26:26.208078 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-903e3ede-bb9f-413f-a214-95d59ca775b6 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:26:26.208728 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-903e3ede-bb9f-413f-a214-95d59ca775b6 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] [instance: ec42e293-9499-458e-9d17-e05431e138cb] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:26:26.214893 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-903e3ede-bb9f-413f-a214-95d59ca775b6 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:26:26.215389 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-903e3ede-bb9f-413f-a214-95d59ca775b6 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:26:26.215832 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-903e3ede-bb9f-413f-a214-95d59ca775b6 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:26:26.216531 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-903e3ede-bb9f-413f-a214-95d59ca775b6 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:26:26.217051 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-903e3ede-bb9f-413f-a214-95d59ca775b6 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:26:26.217486 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-903e3ede-bb9f-413f-a214-95d59ca775b6 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:26:26.300016 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-903e3ede-bb9f-413f-a214-95d59ca775b6 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e209b72025e2476abc40f48e9ee676ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1edb7eea4b4746c49c85305ce134d8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:26:26.308474 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-903e3ede-bb9f-413f-a214-95d59ca775b6 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] 10.222.0.33 "GET /compute/v2.1/servers/ec42e293-9499-458e-9d17-e05431e138cb" status: 200 len: 1475 microversion: 2.1 time: 0.104358 Sep 23 05:26:26.309052 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3595/7012] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:26:26 2022] GET /compute/v2.1/servers/ec42e293-9499-458e-9d17-e05431e138cb => generated 1475 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:26:27.334038 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d3bde584-7322-464b-999d-ef77919e8612 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:26:27.334761 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d3bde584-7322-464b-999d-ef77919e8612 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] [instance: ec42e293-9499-458e-9d17-e05431e138cb] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:26:27.343097 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d3bde584-7322-464b-999d-ef77919e8612 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:26:27.343882 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d3bde584-7322-464b-999d-ef77919e8612 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:26:27.344436 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d3bde584-7322-464b-999d-ef77919e8612 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:26:27.345143 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d3bde584-7322-464b-999d-ef77919e8612 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:26:27.345611 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d3bde584-7322-464b-999d-ef77919e8612 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:26:27.346093 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d3bde584-7322-464b-999d-ef77919e8612 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:26:27.427845 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d3bde584-7322-464b-999d-ef77919e8612 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e209b72025e2476abc40f48e9ee676ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1edb7eea4b4746c49c85305ce134d8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:26:27.435857 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d3bde584-7322-464b-999d-ef77919e8612 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] 10.222.0.33 "GET /compute/v2.1/servers/ec42e293-9499-458e-9d17-e05431e138cb" status: 200 len: 1475 microversion: 2.1 time: 0.107620 Sep 23 05:26:27.436430 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3418/7013] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:26:27 2022] GET /compute/v2.1/servers/ec42e293-9499-458e-9d17-e05431e138cb => generated 1475 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:26:28.020403 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-b9765d49-5d71-4b51-b584-cb440a2142ba req-ca40180f-4c07-4b0e-807c-f1c851d46c04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec42e293-9499-458e-9d17-e05431e138cb", "name": "network-vif-deleted", "tag": "a8660beb-d514-4d42-bcfe-015ecff274ac"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:26:28.031742 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-b9765d49-5d71-4b51-b584-cb440a2142ba req-ca40180f-4c07-4b0e-807c-f1c851d46c04 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:26:28.032502 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-b9765d49-5d71-4b51-b584-cb440a2142ba req-ca40180f-4c07-4b0e-807c-f1c851d46c04 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:26:28.032939 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-b9765d49-5d71-4b51-b584-cb440a2142ba req-ca40180f-4c07-4b0e-807c-f1c851d46c04 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:26:28.045617 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-b9765d49-5d71-4b51-b584-cb440a2142ba req-ca40180f-4c07-4b0e-807c-f1c851d46c04 service nova] Creating event network-vif-deleted:a8660beb-d514-4d42-bcfe-015ecff274ac for instance ec42e293-9499-458e-9d17-e05431e138cb on n-h1-846463-3 Sep 23 05:26:28.051835 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-b9765d49-5d71-4b51-b584-cb440a2142ba req-ca40180f-4c07-4b0e-807c-f1c851d46c04 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034423 Sep 23 05:26:28.052771 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3596/7014] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:26:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:26:28.460143 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-168601f1-5a9b-482b-958a-646e04a7353f tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:26:28.460770 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-168601f1-5a9b-482b-958a-646e04a7353f tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] [instance: ec42e293-9499-458e-9d17-e05431e138cb] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:26:28.467631 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-168601f1-5a9b-482b-958a-646e04a7353f tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:26:28.468133 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-168601f1-5a9b-482b-958a-646e04a7353f tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:26:28.468589 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-168601f1-5a9b-482b-958a-646e04a7353f tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:26:28.469291 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-168601f1-5a9b-482b-958a-646e04a7353f tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:26:28.469759 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-168601f1-5a9b-482b-958a-646e04a7353f tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:26:28.470231 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-168601f1-5a9b-482b-958a-646e04a7353f tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:26:28.500410 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-168601f1-5a9b-482b-958a-646e04a7353f tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:26:28.500898 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-168601f1-5a9b-482b-958a-646e04a7353f tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:26:28.501346 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-168601f1-5a9b-482b-958a-646e04a7353f tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:26:28.501804 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-168601f1-5a9b-482b-958a-646e04a7353f tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lazy-loading 'fault' on Instance uuid ec42e293-9499-458e-9d17-e05431e138cb {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 05:26:28.545665 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-168601f1-5a9b-482b-958a-646e04a7353f tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e209b72025e2476abc40f48e9ee676ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1edb7eea4b4746c49c85305ce134d8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:26:28.553342 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-168601f1-5a9b-482b-958a-646e04a7353f tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] 10.222.0.33 "GET /compute/v2.1/servers/ec42e293-9499-458e-9d17-e05431e138cb" status: 200 len: 1330 microversion: 2.1 time: 0.097651 Sep 23 05:26:28.553993 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3419/7015] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:26:28 2022] GET /compute/v2.1/servers/ec42e293-9499-458e-9d17-e05431e138cb => generated 1330 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:26:29.577092 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b647736d-db2d-4222-b128-42d8c70af7b2 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:26:29.577805 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b647736d-db2d-4222-b128-42d8c70af7b2 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] [instance: ec42e293-9499-458e-9d17-e05431e138cb] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:26:29.584152 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b647736d-db2d-4222-b128-42d8c70af7b2 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:26:29.584591 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b647736d-db2d-4222-b128-42d8c70af7b2 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:26:29.585039 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b647736d-db2d-4222-b128-42d8c70af7b2 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:26:29.585734 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b647736d-db2d-4222-b128-42d8c70af7b2 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:26:29.586227 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b647736d-db2d-4222-b128-42d8c70af7b2 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:26:29.586660 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b647736d-db2d-4222-b128-42d8c70af7b2 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:26:29.600386 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-b647736d-db2d-4222-b128-42d8c70af7b2 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] HTTP exception thrown: Instance ec42e293-9499-458e-9d17-e05431e138cb could not be found. Sep 23 05:26:29.602022 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b647736d-db2d-4222-b128-42d8c70af7b2 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Request method failure captured: Sep 23 05:26:29.602022 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/ec42e293-9499-458e-9d17-e05431e138cb HTTP/1.1 Sep 23 05:26:29.602022 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 05:26:29.602022 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 05:26:29.602022 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 05:26:29.602022 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 05:26:29.602022 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 05:26:29.602022 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 05:26:29.602022 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 05:26:29.602022 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 05:26:29.602022 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLUM1VEByLDcOt38lPkY1HmYiW-21WgW14veGiZG7UQJpsIdE-761FZ61AEEvx36iDJpZ2TttLhJDfpjnnl0OfAnPxf98fpYMn5b_j3YrElYCLP9ba52iuxLsCFaa88osr2a5mnccV-Zpb-JpN5ALnCb4EXx3R01e7D0Zi-ThpmeE3WI Sep 23 05:26:29.602022 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 05:26:29.602022 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 05:26:29.602022 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 05:26:29.602022 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 05:26:29.602022 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 05:26:29.602022 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 05:26:29.602022 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 1edb7eea4b4746c49c85305ce134d8bd Sep 23 05:26:29.602022 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-264661762 Sep 23 05:26:29.602022 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 05:26:29.602022 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 05:26:29.602022 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1edb7eea4b4746c49c85305ce134d8bd", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1edb7eea4b4746c49c85305ce134d8bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1edb7eea4b4746c49c85305ce134d8bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1edb7eea4b4746c49c85305ce134d8bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:26:29.602022 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-TestSecurityGroupsBasicOps-264661762 Sep 23 05:26:29.602022 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 1edb7eea4b4746c49c85305ce134d8bd Sep 23 05:26:29.602022 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-264661762 Sep 23 05:26:29.602022 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-TestSecurityGroupsBasicOps-264661762-project Sep 23 05:26:29.602022 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 05:26:29.602022 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 05:26:29.602022 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: e209b72025e2476abc40f48e9ee676ce Sep 23 05:26:29.602022 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-TestSecurityGroupsBasicOps-264661762-project Sep 23 05:26:29.602022 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 05:26:29.602022 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance ec42e293-9499-458e-9d17-e05431e138cb could not be found. Sep 23 05:26:29.602022 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': 'ec42e293-9499-458e-9d17-e05431e138cb'} Sep 23 05:26:29.602022 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:26:29.602022 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:26:29.602022 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 05:26:29.602022 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 05:26:29.602022 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 05:26:29.602022 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 05:26:29.602022 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 05:26:29.602022 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 05:26:29.602022 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 05:26:29.602022 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 05:26:29.602022 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec42e293-9499-458e-9d17-e05431e138cb could not be found. Sep 23 05:26:29.602022 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:26:29.602022 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:26:29.602022 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:26:29.602022 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:26:29.602022 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:26:29.602022 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:26:29.602022 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:26:29.602022 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:26:29.602022 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:26:29.602022 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:26:29.602022 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 05:26:29.602022 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 05:26:29.602022 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 05:26:29.602022 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 05:26:29.602022 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 05:26:29.602022 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:26:29.602022 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec42e293-9499-458e-9d17-e05431e138cb could not be found. Sep 23 05:26:29.602022 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:26:29.602022 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:26:29.602022 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:26:29.606674 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:26:29.606674 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:26:29.606674 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:26:29.606674 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:26:29.606674 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:26:29.606674 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec42e293-9499-458e-9d17-e05431e138cb could not be found. Sep 23 05:26:29.606674 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:26:29.606674 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b647736d-db2d-4222-b128-42d8c70af7b2 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Returning 404 to user: Instance ec42e293-9499-458e-9d17-e05431e138cb could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:26:29.606674 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b647736d-db2d-4222-b128-42d8c70af7b2 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] 10.222.0.33 "GET /compute/v2.1/servers/ec42e293-9499-458e-9d17-e05431e138cb" status: 404 len: 111 microversion: 2.1 time: 0.031106 Sep 23 05:26:29.606674 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3597/7016] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:26:29 2022] GET /compute/v2.1/servers/ec42e293-9499-458e-9d17-e05431e138cb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 05:26:33.978973 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e2346120-e824-44ed-bf52-ba2a5af74c08 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:26:33.979622 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e2346120-e824-44ed-bf52-ba2a5af74c08 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] [instance: aa6e610d-51e7-4c09-91ca-d38f9a219a0b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:26:33.981563 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-c1ba2381-071f-487d-9453-142d7bc35212 req-bd1014ee-849f-4afc-813a-cb30e2605ed3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa6e610d-51e7-4c09-91ca-d38f9a219a0b", "tag": "b66c39af-ce15-4aee-9bea-e6b6449d1ad5"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:26:33.987238 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e2346120-e824-44ed-bf52-ba2a5af74c08 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:26:33.987739 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e2346120-e824-44ed-bf52-ba2a5af74c08 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:26:33.989048 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e2346120-e824-44ed-bf52-ba2a5af74c08 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:26:33.989956 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e2346120-e824-44ed-bf52-ba2a5af74c08 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:26:33.990611 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e2346120-e824-44ed-bf52-ba2a5af74c08 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:26:33.991281 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e2346120-e824-44ed-bf52-ba2a5af74c08 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:26:33.993321 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-c1ba2381-071f-487d-9453-142d7bc35212 req-bd1014ee-849f-4afc-813a-cb30e2605ed3 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:26:33.993815 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-c1ba2381-071f-487d-9453-142d7bc35212 req-bd1014ee-849f-4afc-813a-cb30e2605ed3 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:26:33.994293 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-c1ba2381-071f-487d-9453-142d7bc35212 req-bd1014ee-849f-4afc-813a-cb30e2605ed3 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:26:34.006205 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-c1ba2381-071f-487d-9453-142d7bc35212 req-bd1014ee-849f-4afc-813a-cb30e2605ed3 service nova] Creating event network-changed:b66c39af-ce15-4aee-9bea-e6b6449d1ad5 for instance aa6e610d-51e7-4c09-91ca-d38f9a219a0b on n-h2-846463-3 Sep 23 05:26:34.013006 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-c1ba2381-071f-487d-9453-142d7bc35212 req-bd1014ee-849f-4afc-813a-cb30e2605ed3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035495 Sep 23 05:26:34.014160 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3598/7017] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:26:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:26:34.022727 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e2346120-e824-44ed-bf52-ba2a5af74c08 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] [instance: aa6e610d-51e7-4c09-91ca-d38f9a219a0b] Going to try to terminate instance {{(pid=122698) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 05:26:34.314167 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e2346120-e824-44ed-bf52-ba2a5af74c08 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] 10.222.0.33 "DELETE /compute/v2.1/servers/aa6e610d-51e7-4c09-91ca-d38f9a219a0b" status: 204 len: 0 microversion: 2.1 time: 0.339007 Sep 23 05:26:34.315013 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3420/7018] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 05:26:33 2022] DELETE /compute/v2.1/servers/aa6e610d-51e7-4c09-91ca-d38f9a219a0b => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 05:26:34.324358 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e88adabf-d550-4cf6-ba86-71deb8e2fc24 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:26:34.328700 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e88adabf-d550-4cf6-ba86-71deb8e2fc24 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] [instance: aa6e610d-51e7-4c09-91ca-d38f9a219a0b] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:26:34.333476 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e88adabf-d550-4cf6-ba86-71deb8e2fc24 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:26:34.334147 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e88adabf-d550-4cf6-ba86-71deb8e2fc24 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:26:34.334758 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e88adabf-d550-4cf6-ba86-71deb8e2fc24 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:26:34.335707 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e88adabf-d550-4cf6-ba86-71deb8e2fc24 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:26:34.336177 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e88adabf-d550-4cf6-ba86-71deb8e2fc24 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:26:34.336611 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e88adabf-d550-4cf6-ba86-71deb8e2fc24 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:26:34.520123 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e88adabf-d550-4cf6-ba86-71deb8e2fc24 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e209b72025e2476abc40f48e9ee676ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1edb7eea4b4746c49c85305ce134d8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:26:34.528181 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e88adabf-d550-4cf6-ba86-71deb8e2fc24 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] 10.222.0.33 "GET /compute/v2.1/servers/aa6e610d-51e7-4c09-91ca-d38f9a219a0b" status: 200 len: 1766 microversion: 2.1 time: 0.208322 Sep 23 05:26:34.528850 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3599/7019] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:26:34 2022] GET /compute/v2.1/servers/aa6e610d-51e7-4c09-91ca-d38f9a219a0b => generated 1766 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:26:35.552174 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2ea841b1-1a9f-4cb0-8352-3fd02e69c407 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:26:35.552901 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-2ea841b1-1a9f-4cb0-8352-3fd02e69c407 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] [instance: aa6e610d-51e7-4c09-91ca-d38f9a219a0b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:26:35.559911 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2ea841b1-1a9f-4cb0-8352-3fd02e69c407 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:26:35.564207 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2ea841b1-1a9f-4cb0-8352-3fd02e69c407 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:26:35.564207 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2ea841b1-1a9f-4cb0-8352-3fd02e69c407 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:26:35.564207 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2ea841b1-1a9f-4cb0-8352-3fd02e69c407 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:26:35.564207 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2ea841b1-1a9f-4cb0-8352-3fd02e69c407 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:26:35.564207 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2ea841b1-1a9f-4cb0-8352-3fd02e69c407 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:26:35.702334 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-2ea841b1-1a9f-4cb0-8352-3fd02e69c407 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e209b72025e2476abc40f48e9ee676ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1edb7eea4b4746c49c85305ce134d8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:26:35.710706 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2ea841b1-1a9f-4cb0-8352-3fd02e69c407 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] 10.222.0.33 "GET /compute/v2.1/servers/aa6e610d-51e7-4c09-91ca-d38f9a219a0b" status: 200 len: 1647 microversion: 2.1 time: 0.163453 Sep 23 05:26:35.712143 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3421/7020] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:26:35 2022] GET /compute/v2.1/servers/aa6e610d-51e7-4c09-91ca-d38f9a219a0b => generated 1647 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:26:36.214602 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-f8395a50-56e8-4d3c-98eb-93ec6d7ea02a req-176f6aed-8a3e-4d41-b9ae-b843467f5448 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa6e610d-51e7-4c09-91ca-d38f9a219a0b", "name": "network-vif-deleted", "tag": "b66c39af-ce15-4aee-9bea-e6b6449d1ad5"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:26:36.224669 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-f8395a50-56e8-4d3c-98eb-93ec6d7ea02a req-176f6aed-8a3e-4d41-b9ae-b843467f5448 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:26:36.225151 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-f8395a50-56e8-4d3c-98eb-93ec6d7ea02a req-176f6aed-8a3e-4d41-b9ae-b843467f5448 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:26:36.225624 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-f8395a50-56e8-4d3c-98eb-93ec6d7ea02a req-176f6aed-8a3e-4d41-b9ae-b843467f5448 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:26:36.238476 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-f8395a50-56e8-4d3c-98eb-93ec6d7ea02a req-176f6aed-8a3e-4d41-b9ae-b843467f5448 service nova] Creating event network-vif-deleted:b66c39af-ce15-4aee-9bea-e6b6449d1ad5 for instance aa6e610d-51e7-4c09-91ca-d38f9a219a0b on n-h2-846463-3 Sep 23 05:26:36.243371 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-f8395a50-56e8-4d3c-98eb-93ec6d7ea02a req-176f6aed-8a3e-4d41-b9ae-b843467f5448 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032533 Sep 23 05:26:36.243951 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3600/7021] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:26:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:26:36.736121 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-98c74600-2b4b-4c39-b04f-399913810fda tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:26:36.736715 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-98c74600-2b4b-4c39-b04f-399913810fda tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] [instance: aa6e610d-51e7-4c09-91ca-d38f9a219a0b] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:26:36.744242 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-98c74600-2b4b-4c39-b04f-399913810fda tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:26:36.744807 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-98c74600-2b4b-4c39-b04f-399913810fda tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:26:36.745268 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-98c74600-2b4b-4c39-b04f-399913810fda tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:26:36.746032 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-98c74600-2b4b-4c39-b04f-399913810fda tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:26:36.746525 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-98c74600-2b4b-4c39-b04f-399913810fda tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:26:36.746978 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-98c74600-2b4b-4c39-b04f-399913810fda tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:26:36.781854 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-98c74600-2b4b-4c39-b04f-399913810fda tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:26:36.782398 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-98c74600-2b4b-4c39-b04f-399913810fda tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:26:36.782861 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-98c74600-2b4b-4c39-b04f-399913810fda tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:26:36.783337 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-98c74600-2b4b-4c39-b04f-399913810fda tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lazy-loading 'fault' on Instance uuid aa6e610d-51e7-4c09-91ca-d38f9a219a0b {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 05:26:36.834593 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-98c74600-2b4b-4c39-b04f-399913810fda tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e209b72025e2476abc40f48e9ee676ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1edb7eea4b4746c49c85305ce134d8bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:26:36.839206 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:26:36.849847 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-98c74600-2b4b-4c39-b04f-399913810fda tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] 10.222.0.33 "GET /compute/v2.1/servers/aa6e610d-51e7-4c09-91ca-d38f9a219a0b" status: 200 len: 1383 microversion: 2.1 time: 0.117956 Sep 23 05:26:36.850463 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3422/7022] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:26:36 2022] GET /compute/v2.1/servers/aa6e610d-51e7-4c09-91ca-d38f9a219a0b => generated 1383 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:26:37.891760 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c5447e1f-eb7b-474e-914a-7b0096e78b8c tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:26:37.892468 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c5447e1f-eb7b-474e-914a-7b0096e78b8c tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] [instance: aa6e610d-51e7-4c09-91ca-d38f9a219a0b] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:26:37.898755 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c5447e1f-eb7b-474e-914a-7b0096e78b8c tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:26:37.899251 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c5447e1f-eb7b-474e-914a-7b0096e78b8c tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:26:37.899699 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c5447e1f-eb7b-474e-914a-7b0096e78b8c tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:26:37.900406 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c5447e1f-eb7b-474e-914a-7b0096e78b8c tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:26:37.900868 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c5447e1f-eb7b-474e-914a-7b0096e78b8c tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:26:37.901305 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c5447e1f-eb7b-474e-914a-7b0096e78b8c tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:26:37.914707 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-c5447e1f-eb7b-474e-914a-7b0096e78b8c tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] HTTP exception thrown: Instance aa6e610d-51e7-4c09-91ca-d38f9a219a0b could not be found. Sep 23 05:26:37.916336 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c5447e1f-eb7b-474e-914a-7b0096e78b8c tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Request method failure captured: Sep 23 05:26:37.916336 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/aa6e610d-51e7-4c09-91ca-d38f9a219a0b HTTP/1.1 Sep 23 05:26:37.916336 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 05:26:37.916336 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 05:26:37.916336 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 05:26:37.916336 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 05:26:37.916336 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 05:26:37.916336 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 05:26:37.916336 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 05:26:37.916336 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 05:26:37.916336 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLUM1VEByLDcOt38lPkY1HmYiW-21WgW14veGiZG7UQJpsIdE-761FZ61AEEvx36iDJpZ2TttLhJDfpjnnl0OfAnPxf98fpYMn5b_j3YrElYCLP9ba52iuxLsCFaa88osr2a5mnccV-Zpb-JpN5ALnCb4EXx3R01e7D0Zi-ThpmeE3WI Sep 23 05:26:37.916336 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 05:26:37.916336 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 05:26:37.916336 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 05:26:37.916336 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 05:26:37.916336 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 05:26:37.916336 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 05:26:37.916336 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 1edb7eea4b4746c49c85305ce134d8bd Sep 23 05:26:37.916336 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-264661762 Sep 23 05:26:37.916336 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 05:26:37.916336 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 05:26:37.916336 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1edb7eea4b4746c49c85305ce134d8bd", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1edb7eea4b4746c49c85305ce134d8bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1edb7eea4b4746c49c85305ce134d8bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1edb7eea4b4746c49c85305ce134d8bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:26:37.916336 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-TestSecurityGroupsBasicOps-264661762 Sep 23 05:26:37.916336 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 1edb7eea4b4746c49c85305ce134d8bd Sep 23 05:26:37.916336 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-264661762 Sep 23 05:26:37.916336 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-TestSecurityGroupsBasicOps-264661762-project Sep 23 05:26:37.916336 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 05:26:37.916336 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 05:26:37.916336 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: e209b72025e2476abc40f48e9ee676ce Sep 23 05:26:37.916336 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-TestSecurityGroupsBasicOps-264661762-project Sep 23 05:26:37.916336 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 05:26:37.916336 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance aa6e610d-51e7-4c09-91ca-d38f9a219a0b could not be found. Sep 23 05:26:37.916336 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': 'aa6e610d-51e7-4c09-91ca-d38f9a219a0b'} Sep 23 05:26:37.916336 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:26:37.916336 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:26:37.916336 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 05:26:37.916336 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 05:26:37.916336 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 05:26:37.916336 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 05:26:37.916336 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 05:26:37.916336 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 05:26:37.916336 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 05:26:37.916336 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 05:26:37.916336 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa6e610d-51e7-4c09-91ca-d38f9a219a0b could not be found. Sep 23 05:26:37.916336 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:26:37.916336 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:26:37.916336 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:26:37.916336 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:26:37.916336 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:26:37.916336 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:26:37.916336 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:26:37.916336 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:26:37.916336 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:26:37.916336 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:26:37.916336 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 05:26:37.916336 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 05:26:37.916336 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 05:26:37.916336 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 05:26:37.916336 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 05:26:37.916336 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:26:37.916336 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa6e610d-51e7-4c09-91ca-d38f9a219a0b could not be found. Sep 23 05:26:37.916336 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:26:37.916336 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:26:37.916336 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:26:37.923713 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:26:37.923713 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:26:37.923713 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:26:37.923713 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:26:37.923713 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:26:37.923713 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa6e610d-51e7-4c09-91ca-d38f9a219a0b could not be found. Sep 23 05:26:37.923713 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:26:37.923713 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c5447e1f-eb7b-474e-914a-7b0096e78b8c tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Returning 404 to user: Instance aa6e610d-51e7-4c09-91ca-d38f9a219a0b could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:26:37.923713 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c5447e1f-eb7b-474e-914a-7b0096e78b8c tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] 10.222.0.33 "GET /compute/v2.1/servers/aa6e610d-51e7-4c09-91ca-d38f9a219a0b" status: 404 len: 111 microversion: 2.1 time: 0.031110 Sep 23 05:26:37.923713 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3601/7023] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:26:37 2022] GET /compute/v2.1/servers/aa6e610d-51e7-4c09-91ca-d38f9a219a0b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 05:26:41.872680 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b077c67e-212c-4e3d-a00d-23e64d903d35 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] Calling method '.version_select at 0x7ff1ba6fb160>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:26:41.988686 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b077c67e-212c-4e3d-a00d-23e64d903d35 tempest-TestSecurityGroupsBasicOps-264661762 tempest-TestSecurityGroupsBasicOps-264661762-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-908113039" status: 202 len: 0 microversion: 2.1 time: 0.120143 Sep 23 05:26:41.989213 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3423/7024] 10.222.0.33 () {58 vars in 1275 bytes} [Fri Sep 23 05:26:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-908113039 => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 05:27:08.185085 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=32 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:27:08.185844 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=60 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:27:08.298965 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b52ec964-eca8-4362-9d83-940f2ebd2c0f tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1554415700", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:27:08.355526 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.neutron [None req-b52ec964-eca8-4362-9d83-940f2ebd2c0f tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] validate_networks() for None {{(pid=122699) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 05:27:08.545084 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-b52ec964-eca8-4362-9d83-940f2ebd2c0f tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Flavor limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 05:27:08.545513 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-b52ec964-eca8-4362-9d83-940f2ebd2c0f tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Image limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 05:27:08.546034 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-b52ec964-eca8-4362-9d83-940f2ebd2c0f tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Flavor pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 05:27:08.546452 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-b52ec964-eca8-4362-9d83-940f2ebd2c0f tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Image pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 05:27:08.546871 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-b52ec964-eca8-4362-9d83-940f2ebd2c0f tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 05:27:08.556342 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b52ec964-eca8-4362-9d83-940f2ebd2c0f tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:27:08.556834 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b52ec964-eca8-4362-9d83-940f2ebd2c0f tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:27:08.557278 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b52ec964-eca8-4362-9d83-940f2ebd2c0f tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:27:08.558059 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b52ec964-eca8-4362-9d83-940f2ebd2c0f tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:27:08.558528 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b52ec964-eca8-4362-9d83-940f2ebd2c0f tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:27:08.558963 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b52ec964-eca8-4362-9d83-940f2ebd2c0f tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:27:08.576048 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-b52ec964-eca8-4362-9d83-940f2ebd2c0f tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Getting quotas for project dc4ba6ac6a444e62bd03a52d5b46497b. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 05:27:08.581286 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-b52ec964-eca8-4362-9d83-940f2ebd2c0f tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Getting quotas for user e09dd6c1aade461f96a4d57ebb66c98f and project dc4ba6ac6a444e62bd03a52d5b46497b. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 05:27:08.593483 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b52ec964-eca8-4362-9d83-940f2ebd2c0f tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Going to run 1 instances... {{(pid=122699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 05:27:08.595834 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b52ec964-eca8-4362-9d83-940f2ebd2c0f tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] [instance: f92e4209-c5f1-4795-9887-cbb28040720c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 05:27:08.702199 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b52ec964-eca8-4362-9d83-940f2ebd2c0f tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.521970 Sep 23 05:27:08.702851 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3602/7025] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 05:27:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 523 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 05:27:08.713814 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:27:08.718240 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6549a75d-8045-472a-a270-4b3300db9954 tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:27:08.718879 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-6549a75d-8045-472a-a270-4b3300db9954 tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] [instance: f92e4209-c5f1-4795-9887-cbb28040720c] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:27:08.772911 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6549a75d-8045-472a-a270-4b3300db9954 tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09dd6c1aade461f96a4d57ebb66c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc4ba6ac6a444e62bd03a52d5b46497b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:27:08.780441 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-6549a75d-8045-472a-a270-4b3300db9954 tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] 10.222.0.33 "GET /compute/v2.1/servers/f92e4209-c5f1-4795-9887-cbb28040720c" status: 200 len: 1222 microversion: 2.1 time: 0.068813 Sep 23 05:27:08.781022 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3424/7026] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:27:08 2022] GET /compute/v2.1/servers/f92e4209-c5f1-4795-9887-cbb28040720c => generated 1222 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:27:09.805208 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-22bf14c0-c166-4729-b258-79c709289bbc tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:27:09.805829 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-22bf14c0-c166-4729-b258-79c709289bbc tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] [instance: f92e4209-c5f1-4795-9887-cbb28040720c] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:27:09.812751 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-22bf14c0-c166-4729-b258-79c709289bbc tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:27:09.813238 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-22bf14c0-c166-4729-b258-79c709289bbc tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:27:09.813682 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-22bf14c0-c166-4729-b258-79c709289bbc tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:27:09.814986 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-22bf14c0-c166-4729-b258-79c709289bbc tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:27:09.814986 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-22bf14c0-c166-4729-b258-79c709289bbc tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:27:09.815310 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-22bf14c0-c166-4729-b258-79c709289bbc tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:27:09.876252 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-22bf14c0-c166-4729-b258-79c709289bbc tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09dd6c1aade461f96a4d57ebb66c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc4ba6ac6a444e62bd03a52d5b46497b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:27:09.884186 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-22bf14c0-c166-4729-b258-79c709289bbc tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] 10.222.0.33 "GET /compute/v2.1/servers/f92e4209-c5f1-4795-9887-cbb28040720c" status: 200 len: 1226 microversion: 2.1 time: 0.084049 Sep 23 05:27:09.884764 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3603/7027] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:27:09 2022] GET /compute/v2.1/servers/f92e4209-c5f1-4795-9887-cbb28040720c => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:27:10.908271 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9f13cfd8-ef3b-4b6d-a31c-517b8f1b9ddb tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:27:10.909002 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-9f13cfd8-ef3b-4b6d-a31c-517b8f1b9ddb tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] [instance: f92e4209-c5f1-4795-9887-cbb28040720c] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:27:10.916133 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9f13cfd8-ef3b-4b6d-a31c-517b8f1b9ddb tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:27:10.916632 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9f13cfd8-ef3b-4b6d-a31c-517b8f1b9ddb tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:27:10.917092 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9f13cfd8-ef3b-4b6d-a31c-517b8f1b9ddb tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:27:10.917814 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9f13cfd8-ef3b-4b6d-a31c-517b8f1b9ddb tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:27:10.918331 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9f13cfd8-ef3b-4b6d-a31c-517b8f1b9ddb tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:27:10.918754 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9f13cfd8-ef3b-4b6d-a31c-517b8f1b9ddb tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:27:10.986069 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-9f13cfd8-ef3b-4b6d-a31c-517b8f1b9ddb tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09dd6c1aade461f96a4d57ebb66c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc4ba6ac6a444e62bd03a52d5b46497b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:27:10.994611 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9f13cfd8-ef3b-4b6d-a31c-517b8f1b9ddb tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] 10.222.0.33 "GET /compute/v2.1/servers/f92e4209-c5f1-4795-9887-cbb28040720c" status: 200 len: 1282 microversion: 2.1 time: 0.090681 Sep 23 05:27:10.995313 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3425/7028] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:27:10 2022] GET /compute/v2.1/servers/f92e4209-c5f1-4795-9887-cbb28040720c => generated 1282 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:27:12.024491 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5aa02c7d-080b-47bf-a723-06badcf1a453 tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:27:12.024491 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-5aa02c7d-080b-47bf-a723-06badcf1a453 tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] [instance: f92e4209-c5f1-4795-9887-cbb28040720c] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:27:12.026769 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5aa02c7d-080b-47bf-a723-06badcf1a453 tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:27:12.027491 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5aa02c7d-080b-47bf-a723-06badcf1a453 tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:27:12.027936 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5aa02c7d-080b-47bf-a723-06badcf1a453 tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:27:12.028652 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5aa02c7d-080b-47bf-a723-06badcf1a453 tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:27:12.029117 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5aa02c7d-080b-47bf-a723-06badcf1a453 tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:27:12.029548 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5aa02c7d-080b-47bf-a723-06badcf1a453 tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:27:12.163797 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-5aa02c7d-080b-47bf-a723-06badcf1a453 tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09dd6c1aade461f96a4d57ebb66c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc4ba6ac6a444e62bd03a52d5b46497b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:27:12.171736 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5aa02c7d-080b-47bf-a723-06badcf1a453 tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] 10.222.0.33 "GET /compute/v2.1/servers/f92e4209-c5f1-4795-9887-cbb28040720c" status: 200 len: 1322 microversion: 2.1 time: 0.157724 Sep 23 05:27:12.172310 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3604/7029] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:27:12 2022] GET /compute/v2.1/servers/f92e4209-c5f1-4795-9887-cbb28040720c => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:27:12.759799 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-b40a4348-2ec3-4265-8556-b3c190f914e1 req-8c9214a6-9bb2-42bf-9bd8-6814d5a326f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f92e4209-c5f1-4795-9887-cbb28040720c", "tag": "b26c4693-4bbc-4261-99c8-3800258b6252"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:27:12.771237 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-b40a4348-2ec3-4265-8556-b3c190f914e1 req-8c9214a6-9bb2-42bf-9bd8-6814d5a326f9 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:27:12.771739 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-b40a4348-2ec3-4265-8556-b3c190f914e1 req-8c9214a6-9bb2-42bf-9bd8-6814d5a326f9 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:27:12.772187 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-b40a4348-2ec3-4265-8556-b3c190f914e1 req-8c9214a6-9bb2-42bf-9bd8-6814d5a326f9 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:27:12.783717 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-b40a4348-2ec3-4265-8556-b3c190f914e1 req-8c9214a6-9bb2-42bf-9bd8-6814d5a326f9 service nova] Creating event network-changed:b26c4693-4bbc-4261-99c8-3800258b6252 for instance f92e4209-c5f1-4795-9887-cbb28040720c on n-h2-846463-3 Sep 23 05:27:12.789459 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-b40a4348-2ec3-4265-8556-b3c190f914e1 req-8c9214a6-9bb2-42bf-9bd8-6814d5a326f9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033943 Sep 23 05:27:12.790310 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3426/7030] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:27:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:27:13.195336 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-244204c3-86ee-4b82-9e93-f880cc33227c tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:27:13.195990 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-244204c3-86ee-4b82-9e93-f880cc33227c tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] [instance: f92e4209-c5f1-4795-9887-cbb28040720c] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:27:13.202543 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-244204c3-86ee-4b82-9e93-f880cc33227c tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:27:13.203095 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-244204c3-86ee-4b82-9e93-f880cc33227c tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:27:13.203494 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-244204c3-86ee-4b82-9e93-f880cc33227c tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:27:13.204199 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-244204c3-86ee-4b82-9e93-f880cc33227c tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:27:13.204668 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-244204c3-86ee-4b82-9e93-f880cc33227c tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:27:13.205105 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-244204c3-86ee-4b82-9e93-f880cc33227c tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:27:13.340197 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-244204c3-86ee-4b82-9e93-f880cc33227c tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09dd6c1aade461f96a4d57ebb66c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc4ba6ac6a444e62bd03a52d5b46497b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:27:13.347890 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-244204c3-86ee-4b82-9e93-f880cc33227c tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] 10.222.0.33 "GET /compute/v2.1/servers/f92e4209-c5f1-4795-9887-cbb28040720c" status: 200 len: 1322 microversion: 2.1 time: 0.156564 Sep 23 05:27:13.348673 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3605/7031] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:27:13 2022] GET /compute/v2.1/servers/f92e4209-c5f1-4795-9887-cbb28040720c => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:27:14.371879 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-42481cfc-ee36-4329-bc14-b7794178dc92 tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:27:14.372635 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-42481cfc-ee36-4329-bc14-b7794178dc92 tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] [instance: f92e4209-c5f1-4795-9887-cbb28040720c] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:27:14.379433 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-42481cfc-ee36-4329-bc14-b7794178dc92 tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:27:14.379945 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-42481cfc-ee36-4329-bc14-b7794178dc92 tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:27:14.380436 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-42481cfc-ee36-4329-bc14-b7794178dc92 tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:27:14.381152 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-42481cfc-ee36-4329-bc14-b7794178dc92 tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:27:14.381629 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-42481cfc-ee36-4329-bc14-b7794178dc92 tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:27:14.382107 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-42481cfc-ee36-4329-bc14-b7794178dc92 tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:27:14.511454 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-42481cfc-ee36-4329-bc14-b7794178dc92 tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09dd6c1aade461f96a4d57ebb66c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc4ba6ac6a444e62bd03a52d5b46497b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:27:14.519899 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-42481cfc-ee36-4329-bc14-b7794178dc92 tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] 10.222.0.33 "GET /compute/v2.1/servers/f92e4209-c5f1-4795-9887-cbb28040720c" status: 200 len: 1322 microversion: 2.1 time: 0.152575 Sep 23 05:27:14.520475 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3427/7032] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:27:14 2022] GET /compute/v2.1/servers/f92e4209-c5f1-4795-9887-cbb28040720c => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:27:15.542555 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-abbdb7fa-4752-45cb-9ae2-1aa4e985ad9a tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:27:15.543171 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-abbdb7fa-4752-45cb-9ae2-1aa4e985ad9a tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] [instance: f92e4209-c5f1-4795-9887-cbb28040720c] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:27:15.549687 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-abbdb7fa-4752-45cb-9ae2-1aa4e985ad9a tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:27:15.550798 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-abbdb7fa-4752-45cb-9ae2-1aa4e985ad9a tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:27:15.551257 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-abbdb7fa-4752-45cb-9ae2-1aa4e985ad9a tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:27:15.551949 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-abbdb7fa-4752-45cb-9ae2-1aa4e985ad9a tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:27:15.552408 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-abbdb7fa-4752-45cb-9ae2-1aa4e985ad9a tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:27:15.552835 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-abbdb7fa-4752-45cb-9ae2-1aa4e985ad9a tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:27:15.680642 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-abbdb7fa-4752-45cb-9ae2-1aa4e985ad9a tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09dd6c1aade461f96a4d57ebb66c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc4ba6ac6a444e62bd03a52d5b46497b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:27:15.688367 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-abbdb7fa-4752-45cb-9ae2-1aa4e985ad9a tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] 10.222.0.33 "GET /compute/v2.1/servers/f92e4209-c5f1-4795-9887-cbb28040720c" status: 200 len: 1322 microversion: 2.1 time: 0.149687 Sep 23 05:27:15.688944 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3606/7033] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:27:15 2022] GET /compute/v2.1/servers/f92e4209-c5f1-4795-9887-cbb28040720c => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:27:16.711303 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-824dbe01-a23f-4c6d-b56a-d0b0f04d68fe tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:27:16.711854 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-824dbe01-a23f-4c6d-b56a-d0b0f04d68fe tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] [instance: f92e4209-c5f1-4795-9887-cbb28040720c] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:27:16.718720 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-824dbe01-a23f-4c6d-b56a-d0b0f04d68fe tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:27:16.719202 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-824dbe01-a23f-4c6d-b56a-d0b0f04d68fe tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:27:16.721665 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-824dbe01-a23f-4c6d-b56a-d0b0f04d68fe tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:27:16.721665 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-824dbe01-a23f-4c6d-b56a-d0b0f04d68fe tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:27:16.721665 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-824dbe01-a23f-4c6d-b56a-d0b0f04d68fe tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:27:16.721665 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-824dbe01-a23f-4c6d-b56a-d0b0f04d68fe tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:27:16.854648 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-824dbe01-a23f-4c6d-b56a-d0b0f04d68fe tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09dd6c1aade461f96a4d57ebb66c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc4ba6ac6a444e62bd03a52d5b46497b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:27:16.862559 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-824dbe01-a23f-4c6d-b56a-d0b0f04d68fe tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] 10.222.0.33 "GET /compute/v2.1/servers/f92e4209-c5f1-4795-9887-cbb28040720c" status: 200 len: 1322 microversion: 2.1 time: 0.155298 Sep 23 05:27:16.863682 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3428/7034] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:27:16 2022] GET /compute/v2.1/servers/f92e4209-c5f1-4795-9887-cbb28040720c => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:27:17.886833 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-cebc2dcb-6039-4aa9-8228-196ce79ad636 tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:27:17.887447 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-cebc2dcb-6039-4aa9-8228-196ce79ad636 tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] [instance: f92e4209-c5f1-4795-9887-cbb28040720c] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:27:17.894727 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cebc2dcb-6039-4aa9-8228-196ce79ad636 tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:27:17.897324 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cebc2dcb-6039-4aa9-8228-196ce79ad636 tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:27:17.897324 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cebc2dcb-6039-4aa9-8228-196ce79ad636 tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:27:17.897324 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cebc2dcb-6039-4aa9-8228-196ce79ad636 tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:27:17.897324 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cebc2dcb-6039-4aa9-8228-196ce79ad636 tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:27:17.897324 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cebc2dcb-6039-4aa9-8228-196ce79ad636 tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:27:18.028471 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-cebc2dcb-6039-4aa9-8228-196ce79ad636 tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09dd6c1aade461f96a4d57ebb66c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc4ba6ac6a444e62bd03a52d5b46497b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:27:18.036501 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-cebc2dcb-6039-4aa9-8228-196ce79ad636 tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] 10.222.0.33 "GET /compute/v2.1/servers/f92e4209-c5f1-4795-9887-cbb28040720c" status: 200 len: 1322 microversion: 2.1 time: 0.154364 Sep 23 05:27:18.037429 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3607/7035] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:27:17 2022] GET /compute/v2.1/servers/f92e4209-c5f1-4795-9887-cbb28040720c => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:27:18.142259 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-67c149ff-0af0-4470-b49d-38591f2f9e01 req-5dd09da3-a395-44c2-9980-104fdf7454dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f92e4209-c5f1-4795-9887-cbb28040720c", "name": "network-vif-plugged", "status": "completed", "tag": "b26c4693-4bbc-4261-99c8-3800258b6252"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:27:18.152701 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-67c149ff-0af0-4470-b49d-38591f2f9e01 req-5dd09da3-a395-44c2-9980-104fdf7454dc service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:27:18.153206 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-67c149ff-0af0-4470-b49d-38591f2f9e01 req-5dd09da3-a395-44c2-9980-104fdf7454dc service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:27:18.153662 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-67c149ff-0af0-4470-b49d-38591f2f9e01 req-5dd09da3-a395-44c2-9980-104fdf7454dc service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:27:18.164595 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-67c149ff-0af0-4470-b49d-38591f2f9e01 req-5dd09da3-a395-44c2-9980-104fdf7454dc service nova] Creating event network-vif-plugged:b26c4693-4bbc-4261-99c8-3800258b6252 for instance f92e4209-c5f1-4795-9887-cbb28040720c on n-h2-846463-3 Sep 23 05:27:18.169860 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-67c149ff-0af0-4470-b49d-38591f2f9e01 req-5dd09da3-a395-44c2-9980-104fdf7454dc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031779 Sep 23 05:27:18.173446 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3429/7036] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:27:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:27:19.061842 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-dc5e52ad-4ed6-43d6-98ee-c8ef33160c66 tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:27:19.062479 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-dc5e52ad-4ed6-43d6-98ee-c8ef33160c66 tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] [instance: f92e4209-c5f1-4795-9887-cbb28040720c] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:27:19.064402 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:27:19.065060 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=6 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:27:19.070708 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dc5e52ad-4ed6-43d6-98ee-c8ef33160c66 tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:27:19.076112 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dc5e52ad-4ed6-43d6-98ee-c8ef33160c66 tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:27:19.076112 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dc5e52ad-4ed6-43d6-98ee-c8ef33160c66 tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:27:19.076112 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dc5e52ad-4ed6-43d6-98ee-c8ef33160c66 tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:27:19.076112 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dc5e52ad-4ed6-43d6-98ee-c8ef33160c66 tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:27:19.076112 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dc5e52ad-4ed6-43d6-98ee-c8ef33160c66 tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:27:19.209831 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-dc5e52ad-4ed6-43d6-98ee-c8ef33160c66 tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09dd6c1aade461f96a4d57ebb66c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc4ba6ac6a444e62bd03a52d5b46497b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:27:19.217544 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-dc5e52ad-4ed6-43d6-98ee-c8ef33160c66 tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] 10.222.0.33 "GET /compute/v2.1/servers/f92e4209-c5f1-4795-9887-cbb28040720c" status: 200 len: 1322 microversion: 2.1 time: 0.159568 Sep 23 05:27:19.218384 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3608/7037] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:27:19 2022] GET /compute/v2.1/servers/f92e4209-c5f1-4795-9887-cbb28040720c => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:27:20.237951 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:27:20.243029 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9a7f84e7-6d20-433e-a9ff-8f1eae4f7795 tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:27:20.243755 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-9a7f84e7-6d20-433e-a9ff-8f1eae4f7795 tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] [instance: f92e4209-c5f1-4795-9887-cbb28040720c] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:27:20.249916 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9a7f84e7-6d20-433e-a9ff-8f1eae4f7795 tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:27:20.252773 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9a7f84e7-6d20-433e-a9ff-8f1eae4f7795 tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:27:20.252773 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9a7f84e7-6d20-433e-a9ff-8f1eae4f7795 tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:27:20.252773 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9a7f84e7-6d20-433e-a9ff-8f1eae4f7795 tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:27:20.252773 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9a7f84e7-6d20-433e-a9ff-8f1eae4f7795 tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:27:20.252773 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9a7f84e7-6d20-433e-a9ff-8f1eae4f7795 tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:27:20.385980 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-9a7f84e7-6d20-433e-a9ff-8f1eae4f7795 tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09dd6c1aade461f96a4d57ebb66c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc4ba6ac6a444e62bd03a52d5b46497b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:27:20.394186 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9a7f84e7-6d20-433e-a9ff-8f1eae4f7795 tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] 10.222.0.33 "GET /compute/v2.1/servers/f92e4209-c5f1-4795-9887-cbb28040720c" status: 200 len: 1471 microversion: 2.1 time: 0.157144 Sep 23 05:27:20.394778 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3430/7038] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:27:20 2022] GET /compute/v2.1/servers/f92e4209-c5f1-4795-9887-cbb28040720c => generated 1471 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:27:20.467373 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6dad1ae5-99c1-4d26-a832-043b2f57e054 tempest-ServersAdminNegativeTestJSON-2109596363 tempest-ServersAdminNegativeTestJSON-2109596363-project-admin] Calling method '.version_select at 0x7ff1ba81e940>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:27:20.533095 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6dad1ae5-99c1-4d26-a832-043b2f57e054 tempest-ServersAdminNegativeTestJSON-2109596363 tempest-ServersAdminNegativeTestJSON-2109596363-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/657f9ebf1d3a4ecb81f7c226f27a22ab" status: 200 len: 371 microversion: 2.1 time: 0.117962 Sep 23 05:27:20.533679 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3609/7039] 10.222.0.33 () {58 vars in 1242 bytes} [Fri Sep 23 05:27:20 2022] GET /compute/v2.1/os-quota-sets/657f9ebf1d3a4ecb81f7c226f27a22ab => generated 371 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 05:27:20.545603 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d1320d91-2e58-477b-aeab-20e54c80b2a9 tempest-ServersAdminNegativeTestJSON-2109596363 tempest-ServersAdminNegativeTestJSON-2109596363-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1433179149", "id": 1868892366, "os-flavor-access:is_public": "True"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:27:20.615620 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d1320d91-2e58-477b-aeab-20e54c80b2a9 tempest-ServersAdminNegativeTestJSON-2109596363 tempest-ServersAdminNegativeTestJSON-2109596363-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.073528 Sep 23 05:27:20.616223 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3431/7040] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 05:27:20 2022] POST /compute/v2.1/flavors => generated 438 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:27:20.629004 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-47e723fc-590a-4a0b-bae5-11a0df01167f tempest-ServersAdminNegativeTestJSON-2109596363 tempest-ServersAdminNegativeTestJSON-2109596363-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1868892366"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:27:20.631407 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-47e723fc-590a-4a0b-bae5-11a0df01167f tempest-ServersAdminNegativeTestJSON-2109596363 tempest-ServersAdminNegativeTestJSON-2109596363-project-admin] [instance: f92e4209-c5f1-4795-9887-cbb28040720c] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:27:20.638257 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-47e723fc-590a-4a0b-bae5-11a0df01167f tempest-ServersAdminNegativeTestJSON-2109596363 tempest-ServersAdminNegativeTestJSON-2109596363-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:27:20.638751 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-47e723fc-590a-4a0b-bae5-11a0df01167f tempest-ServersAdminNegativeTestJSON-2109596363 tempest-ServersAdminNegativeTestJSON-2109596363-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:27:20.639190 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-47e723fc-590a-4a0b-bae5-11a0df01167f tempest-ServersAdminNegativeTestJSON-2109596363 tempest-ServersAdminNegativeTestJSON-2109596363-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:27:20.639884 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-47e723fc-590a-4a0b-bae5-11a0df01167f tempest-ServersAdminNegativeTestJSON-2109596363 tempest-ServersAdminNegativeTestJSON-2109596363-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:27:20.640345 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-47e723fc-590a-4a0b-bae5-11a0df01167f tempest-ServersAdminNegativeTestJSON-2109596363 tempest-ServersAdminNegativeTestJSON-2109596363-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:27:20.641032 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-47e723fc-590a-4a0b-bae5-11a0df01167f tempest-ServersAdminNegativeTestJSON-2109596363 tempest-ServersAdminNegativeTestJSON-2109596363-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:27:20.824566 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-47e723fc-590a-4a0b-bae5-11a0df01167f tempest-ServersAdminNegativeTestJSON-2109596363 tempest-ServersAdminNegativeTestJSON-2109596363-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '6916ecadc5344a8b8b520cd162b1cd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '657f9ebf1d3a4ecb81f7c226f27a22ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:27:20.831534 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-47e723fc-590a-4a0b-bae5-11a0df01167f tempest-ServersAdminNegativeTestJSON-2109596363 tempest-ServersAdminNegativeTestJSON-2109596363-project-admin] [instance: f92e4209-c5f1-4795-9887-cbb28040720c] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1433179149 {{(pid=122699) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 23 05:27:20.838887 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-47e723fc-590a-4a0b-bae5-11a0df01167f tempest-ServersAdminNegativeTestJSON-2109596363 tempest-ServersAdminNegativeTestJSON-2109596363-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:27:20.839448 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-47e723fc-590a-4a0b-bae5-11a0df01167f tempest-ServersAdminNegativeTestJSON-2109596363 tempest-ServersAdminNegativeTestJSON-2109596363-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:27:20.839895 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-47e723fc-590a-4a0b-bae5-11a0df01167f tempest-ServersAdminNegativeTestJSON-2109596363 tempest-ServersAdminNegativeTestJSON-2109596363-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:27:20.840629 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-47e723fc-590a-4a0b-bae5-11a0df01167f tempest-ServersAdminNegativeTestJSON-2109596363 tempest-ServersAdminNegativeTestJSON-2109596363-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:27:20.841103 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-47e723fc-590a-4a0b-bae5-11a0df01167f tempest-ServersAdminNegativeTestJSON-2109596363 tempest-ServersAdminNegativeTestJSON-2109596363-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:27:20.841578 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-47e723fc-590a-4a0b-bae5-11a0df01167f tempest-ServersAdminNegativeTestJSON-2109596363 tempest-ServersAdminNegativeTestJSON-2109596363-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:27:20.864092 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-47e723fc-590a-4a0b-bae5-11a0df01167f tempest-ServersAdminNegativeTestJSON-2109596363 tempest-ServersAdminNegativeTestJSON-2109596363-project-admin] Getting quotas for project dc4ba6ac6a444e62bd03a52d5b46497b. Resources: {'cores', 'ram'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 05:27:20.869140 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-47e723fc-590a-4a0b-bae5-11a0df01167f tempest-ServersAdminNegativeTestJSON-2109596363 tempest-ServersAdminNegativeTestJSON-2109596363-project-admin] Getting quotas for user e09dd6c1aade461f96a4d57ebb66c98f and project dc4ba6ac6a444e62bd03a52d5b46497b. Resources: {'cores', 'ram'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 05:27:20.881200 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.compute.api [None req-47e723fc-590a-4a0b-bae5-11a0df01167f tempest-ServersAdminNegativeTestJSON-2109596363 tempest-ServersAdminNegativeTestJSON-2109596363-project-admin] ram quota exceeded for 657f9ebf1d3a4ecb81f7c226f27a22ab, tried to resize instance. Sep 23 05:27:20.881799 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-47e723fc-590a-4a0b-bae5-11a0df01167f tempest-ServersAdminNegativeTestJSON-2109596363 tempest-ServersAdminNegativeTestJSON-2109596363-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 23 05:27:20.883788 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-47e723fc-590a-4a0b-bae5-11a0df01167f tempest-ServersAdminNegativeTestJSON-2109596363 tempest-ServersAdminNegativeTestJSON-2109596363-project-admin] Request method failure captured: Sep 23 05:27:20.883788 n-d-846463-3 devstack@n-api.service[122699]: request: POST /compute/v2.1/servers/f92e4209-c5f1-4795-9887-cbb28040720c/action HTTP/1.1 Sep 23 05:27:20.883788 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 05:27:20.883788 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 05:27:20.883788 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 05:27:20.883788 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 39 Sep 23 05:27:20.883788 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 05:27:20.883788 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 05:27:20.883788 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 05:27:20.883788 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 05:27:20.883788 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLUOsHZ0mLijTjXQEmk1qamtD9jPo7GVrKu0uJz4UgINFOLKAGDhmmnf6edad3cDm0VWU5yFKiOPynvNd9aaeEqgk0jNNJexdqtjzHpmjd6q-4c-u21x6kAP0pURO4je7aM-GzW2MrTbEFOgdm6-6CNUcsAT_bb3oFEBPbSMsIfaP6AE Sep 23 05:27:20.883788 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 05:27:20.883788 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 05:27:20.883788 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 05:27:20.883788 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 05:27:20.883788 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 05:27:20.883788 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 05:27:20.883788 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 657f9ebf1d3a4ecb81f7c226f27a22ab Sep 23 05:27:20.883788 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2109596363 Sep 23 05:27:20.883788 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,admin,member Sep 23 05:27:20.883788 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,admin,member Sep 23 05:27:20.883788 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_657f9ebf1d3a4ecb81f7c226f27a22ab", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/657f9ebf1d3a4ecb81f7c226f27a22ab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/657f9ebf1d3a4ecb81f7c226f27a22ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/657f9ebf1d3a4ecb81f7c226f27a22ab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:27:20.883788 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2109596363 Sep 23 05:27:20.883788 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 657f9ebf1d3a4ecb81f7c226f27a22ab Sep 23 05:27:20.883788 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2109596363 Sep 23 05:27:20.883788 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ServersAdminNegativeTestJSON-2109596363-project-admin Sep 23 05:27:20.883788 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 05:27:20.883788 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 05:27:20.883788 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 6916ecadc5344a8b8b520cd162b1cd9e Sep 23 05:27:20.883788 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2109596363-project-admin Sep 23 05:27:20.883788 n-d-846463-3 devstack@n-api.service[122699]: Sep 23 05:27:20.883788 n-d-846463-3 devstack@n-api.service[122699]: {"resize": {"flavorRef": "1868892366"}} Sep 23 05:27:20.883788 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 05:27:20.883788 n-d-846463-3 devstack@n-api.service[122699]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 23 05:27:20.883788 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': 'f92e4209-c5f1-4795-9887-cbb28040720c', 'body': {'resize': {'flavorRef': '1868892366'}}} Sep 23 05:27:20.883788 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:27:20.883788 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:27:20.883788 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Sep 23 05:27:20.883788 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Sep 23 05:27:20.883788 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 05:27:20.883788 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 05:27:20.883788 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 23 05:27:20.883788 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc Sep 23 05:27:20.883788 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 23 05:27:20.883788 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 23 05:27:20.883788 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 05:27:20.883788 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 05:27:20.883788 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 23 05:27:20.883788 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 23 05:27:20.883788 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 23 05:27:20.883788 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 23 05:27:20.883788 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Sep 23 05:27:20.883788 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 23 05:27:20.883788 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Sep 23 05:27:20.883788 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:27:20.883788 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:27:20.883788 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:27:20.883788 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:27:20.883788 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Sep 23 05:27:20.883788 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Sep 23 05:27:20.883788 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 23 05:27:20.883788 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 23 05:27:20.883788 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 23 05:27:20.888757 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 23 05:27:20.888757 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 23 05:27:20.888757 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 23 05:27:20.888757 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 23 05:27:20.888757 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 23 05:27:20.888757 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 23 05:27:20.888757 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 23 05:27:20.888757 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 23 05:27:20.888757 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 23 05:27:20.888757 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Sep 23 05:27:20.888757 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Sep 23 05:27:20.888757 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Sep 23 05:27:20.888757 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 23 05:27:20.888757 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 23 05:27:20.888757 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:27:20.888757 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:27:20.888757 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:27:20.888757 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:27:20.888757 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:27:20.888757 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:27:20.888757 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:27:20.888757 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:27:20.888757 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:27:20.888757 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:27:20.888757 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 05:27:20.888757 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 05:27:20.888757 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Sep 23 05:27:20.888757 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Sep 23 05:27:20.888757 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Sep 23 05:27:20.888757 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 23 05:27:20.888757 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 23 05:27:20.888757 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:27:20.888757 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:27:20.888757 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:27:20.888757 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:27:20.888757 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:27:20.888757 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:27:20.888757 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:27:20.888757 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:27:20.888757 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 23 05:27:20.888757 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:27:20.888757 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-47e723fc-590a-4a0b-bae5-11a0df01167f tempest-ServersAdminNegativeTestJSON-2109596363 tempest-ServersAdminNegativeTestJSON-2109596363-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:27:20.888757 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-47e723fc-590a-4a0b-bae5-11a0df01167f tempest-ServersAdminNegativeTestJSON-2109596363 tempest-ServersAdminNegativeTestJSON-2109596363-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/f92e4209-c5f1-4795-9887-cbb28040720c/action" status: 403 len: 118 microversion: 2.1 time: 0.260715 Sep 23 05:27:20.888757 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3610/7041] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 05:27:20 2022] POST /compute/v2.1/servers/f92e4209-c5f1-4795-9887-cbb28040720c/action => generated 118 bytes in 262 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 23 05:27:20.894503 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-75b65450-76d8-491c-91a9-d98c4666a3bc tempest-ServersAdminNegativeTestJSON-2109596363 tempest-ServersAdminNegativeTestJSON-2109596363-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:27:20.952592 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-75b65450-76d8-491c-91a9-d98c4666a3bc tempest-ServersAdminNegativeTestJSON-2109596363 tempest-ServersAdminNegativeTestJSON-2109596363-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/1868892366" status: 202 len: 0 microversion: 2.1 time: 0.062025 Sep 23 05:27:20.953152 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3432/7042] 10.222.0.33 () {58 vars in 1161 bytes} [Fri Sep 23 05:27:20 2022] DELETE /compute/v2.1/flavors/1868892366 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 05:27:20.961026 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ebef75de-1983-43a6-96c1-d796ad865433 tempest-ServersAdminNegativeTestJSON-2109596363 tempest-ServersAdminNegativeTestJSON-2109596363-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:27:20.982123 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ebef75de-1983-43a6-96c1-d796ad865433 tempest-ServersAdminNegativeTestJSON-2109596363 tempest-ServersAdminNegativeTestJSON-2109596363-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024697 Sep 23 05:27:20.982609 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3611/7043] 10.222.0.33 () {58 vars in 1146 bytes} [Fri Sep 23 05:27:20 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:27:21.003391 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-91d4ec07-d706-4368-ba5f-5c081c94d38d tempest-ServersAdminNegativeTestJSON-2109596363 tempest-ServersAdminNegativeTestJSON-2109596363-project-admin] Calling method '.version_select at 0x7ff1ba714820>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:27:21.085407 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-91d4ec07-d706-4368-ba5f-5c081c94d38d tempest-ServersAdminNegativeTestJSON-2109596363 tempest-ServersAdminNegativeTestJSON-2109596363-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/657f9ebf1d3a4ecb81f7c226f27a22ab" status: 200 len: 371 microversion: 2.1 time: 0.085761 Sep 23 05:27:21.087984 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3433/7044] 10.222.0.33 () {58 vars in 1242 bytes} [Fri Sep 23 05:27:20 2022] GET /compute/v2.1/os-quota-sets/657f9ebf1d3a4ecb81f7c226f27a22ab => generated 371 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:27:21.098329 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-09450de8-3d35-4dfe-87a6-5866e9f551db tempest-ServersAdminNegativeTestJSON-2109596363 tempest-ServersAdminNegativeTestJSON-2109596363-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1365939083", "id": 950368466, "os-flavor-access:is_public": "True"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:27:21.192567 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-09450de8-3d35-4dfe-87a6-5866e9f551db tempest-ServersAdminNegativeTestJSON-2109596363 tempest-ServersAdminNegativeTestJSON-2109596363-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.098501 Sep 23 05:27:21.193339 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3612/7045] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 05:27:21 2022] POST /compute/v2.1/flavors => generated 434 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:27:21.205707 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-af0e0ff4-efe4-4e37-923c-7c9df8f81246 tempest-ServersAdminNegativeTestJSON-2109596363 tempest-ServersAdminNegativeTestJSON-2109596363-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "950368466"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:27:21.208654 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-af0e0ff4-efe4-4e37-923c-7c9df8f81246 tempest-ServersAdminNegativeTestJSON-2109596363 tempest-ServersAdminNegativeTestJSON-2109596363-project-admin] [instance: f92e4209-c5f1-4795-9887-cbb28040720c] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:27:21.214706 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-af0e0ff4-efe4-4e37-923c-7c9df8f81246 tempest-ServersAdminNegativeTestJSON-2109596363 tempest-ServersAdminNegativeTestJSON-2109596363-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:27:21.215205 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-af0e0ff4-efe4-4e37-923c-7c9df8f81246 tempest-ServersAdminNegativeTestJSON-2109596363 tempest-ServersAdminNegativeTestJSON-2109596363-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:27:21.215654 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-af0e0ff4-efe4-4e37-923c-7c9df8f81246 tempest-ServersAdminNegativeTestJSON-2109596363 tempest-ServersAdminNegativeTestJSON-2109596363-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:27:21.216356 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-af0e0ff4-efe4-4e37-923c-7c9df8f81246 tempest-ServersAdminNegativeTestJSON-2109596363 tempest-ServersAdminNegativeTestJSON-2109596363-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:27:21.216828 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-af0e0ff4-efe4-4e37-923c-7c9df8f81246 tempest-ServersAdminNegativeTestJSON-2109596363 tempest-ServersAdminNegativeTestJSON-2109596363-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:27:21.217264 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-af0e0ff4-efe4-4e37-923c-7c9df8f81246 tempest-ServersAdminNegativeTestJSON-2109596363 tempest-ServersAdminNegativeTestJSON-2109596363-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:27:21.301032 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-af0e0ff4-efe4-4e37-923c-7c9df8f81246 tempest-ServersAdminNegativeTestJSON-2109596363 tempest-ServersAdminNegativeTestJSON-2109596363-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '6916ecadc5344a8b8b520cd162b1cd9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '657f9ebf1d3a4ecb81f7c226f27a22ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:27:21.306897 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-af0e0ff4-efe4-4e37-923c-7c9df8f81246 tempest-ServersAdminNegativeTestJSON-2109596363 tempest-ServersAdminNegativeTestJSON-2109596363-project-admin] [instance: f92e4209-c5f1-4795-9887-cbb28040720c] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1365939083 {{(pid=122698) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 23 05:27:21.313548 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-af0e0ff4-efe4-4e37-923c-7c9df8f81246 tempest-ServersAdminNegativeTestJSON-2109596363 tempest-ServersAdminNegativeTestJSON-2109596363-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:27:21.314081 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-af0e0ff4-efe4-4e37-923c-7c9df8f81246 tempest-ServersAdminNegativeTestJSON-2109596363 tempest-ServersAdminNegativeTestJSON-2109596363-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:27:21.314528 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-af0e0ff4-efe4-4e37-923c-7c9df8f81246 tempest-ServersAdminNegativeTestJSON-2109596363 tempest-ServersAdminNegativeTestJSON-2109596363-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:27:21.315260 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-af0e0ff4-efe4-4e37-923c-7c9df8f81246 tempest-ServersAdminNegativeTestJSON-2109596363 tempest-ServersAdminNegativeTestJSON-2109596363-project-admin] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:27:21.315765 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-af0e0ff4-efe4-4e37-923c-7c9df8f81246 tempest-ServersAdminNegativeTestJSON-2109596363 tempest-ServersAdminNegativeTestJSON-2109596363-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:27:21.316210 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-af0e0ff4-efe4-4e37-923c-7c9df8f81246 tempest-ServersAdminNegativeTestJSON-2109596363 tempest-ServersAdminNegativeTestJSON-2109596363-project-admin] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:27:21.336775 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-af0e0ff4-efe4-4e37-923c-7c9df8f81246 tempest-ServersAdminNegativeTestJSON-2109596363 tempest-ServersAdminNegativeTestJSON-2109596363-project-admin] Getting quotas for project dc4ba6ac6a444e62bd03a52d5b46497b. Resources: {'cores', 'ram'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 05:27:21.341740 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-af0e0ff4-efe4-4e37-923c-7c9df8f81246 tempest-ServersAdminNegativeTestJSON-2109596363 tempest-ServersAdminNegativeTestJSON-2109596363-project-admin] Getting quotas for user e09dd6c1aade461f96a4d57ebb66c98f and project dc4ba6ac6a444e62bd03a52d5b46497b. Resources: {'cores', 'ram'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 05:27:21.354289 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.compute.api [None req-af0e0ff4-efe4-4e37-923c-7c9df8f81246 tempest-ServersAdminNegativeTestJSON-2109596363 tempest-ServersAdminNegativeTestJSON-2109596363-project-admin] cores quota exceeded for 657f9ebf1d3a4ecb81f7c226f27a22ab, tried to resize instance. Sep 23 05:27:21.354842 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-af0e0ff4-efe4-4e37-923c-7c9df8f81246 tempest-ServersAdminNegativeTestJSON-2109596363 tempest-ServersAdminNegativeTestJSON-2109596363-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 23 05:27:21.356909 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-af0e0ff4-efe4-4e37-923c-7c9df8f81246 tempest-ServersAdminNegativeTestJSON-2109596363 tempest-ServersAdminNegativeTestJSON-2109596363-project-admin] Request method failure captured: Sep 23 05:27:21.356909 n-d-846463-3 devstack@n-api.service[122698]: request: POST /compute/v2.1/servers/f92e4209-c5f1-4795-9887-cbb28040720c/action HTTP/1.1 Sep 23 05:27:21.356909 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 05:27:21.356909 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 05:27:21.356909 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 05:27:21.356909 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 38 Sep 23 05:27:21.356909 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 05:27:21.356909 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 05:27:21.356909 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 05:27:21.356909 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 05:27:21.356909 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLUOsHZ0mLijTjXQEmk1qamtD9jPo7GVrKu0uJz4UgINFOLKAGDhmmnf6edad3cDm0VWU5yFKiOPynvNd9aaeEqgk0jNNJexdqtjzHpmjd6q-4c-u21x6kAP0pURO4je7aM-GzW2MrTbEFOgdm6-6CNUcsAT_bb3oFEBPbSMsIfaP6AE Sep 23 05:27:21.356909 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 05:27:21.356909 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 05:27:21.356909 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 05:27:21.356909 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 05:27:21.356909 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 05:27:21.356909 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 05:27:21.356909 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 657f9ebf1d3a4ecb81f7c226f27a22ab Sep 23 05:27:21.356909 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2109596363 Sep 23 05:27:21.356909 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,admin,member Sep 23 05:27:21.356909 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,admin,member Sep 23 05:27:21.356909 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_657f9ebf1d3a4ecb81f7c226f27a22ab", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/657f9ebf1d3a4ecb81f7c226f27a22ab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/657f9ebf1d3a4ecb81f7c226f27a22ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/657f9ebf1d3a4ecb81f7c226f27a22ab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:27:21.356909 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2109596363 Sep 23 05:27:21.356909 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 657f9ebf1d3a4ecb81f7c226f27a22ab Sep 23 05:27:21.356909 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2109596363 Sep 23 05:27:21.356909 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ServersAdminNegativeTestJSON-2109596363-project-admin Sep 23 05:27:21.356909 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 05:27:21.356909 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 05:27:21.356909 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 6916ecadc5344a8b8b520cd162b1cd9e Sep 23 05:27:21.356909 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2109596363-project-admin Sep 23 05:27:21.356909 n-d-846463-3 devstack@n-api.service[122698]: Sep 23 05:27:21.356909 n-d-846463-3 devstack@n-api.service[122698]: {"resize": {"flavorRef": "950368466"}} Sep 23 05:27:21.356909 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 05:27:21.356909 n-d-846463-3 devstack@n-api.service[122698]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 23 05:27:21.356909 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': 'f92e4209-c5f1-4795-9887-cbb28040720c', 'body': {'resize': {'flavorRef': '950368466'}}} Sep 23 05:27:21.356909 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:27:21.356909 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:27:21.356909 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Sep 23 05:27:21.356909 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Sep 23 05:27:21.356909 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 05:27:21.356909 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 05:27:21.356909 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 23 05:27:21.356909 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc Sep 23 05:27:21.356909 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 23 05:27:21.356909 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 23 05:27:21.356909 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 05:27:21.356909 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 05:27:21.356909 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 23 05:27:21.356909 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 23 05:27:21.356909 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 23 05:27:21.356909 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 23 05:27:21.356909 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Sep 23 05:27:21.356909 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 23 05:27:21.356909 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Sep 23 05:27:21.356909 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:27:21.356909 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:27:21.356909 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:27:21.356909 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:27:21.356909 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Sep 23 05:27:21.356909 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Sep 23 05:27:21.356909 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 23 05:27:21.356909 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 23 05:27:21.356909 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 23 05:27:21.361304 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 23 05:27:21.361304 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 23 05:27:21.361304 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 23 05:27:21.361304 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 23 05:27:21.361304 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 23 05:27:21.361304 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 23 05:27:21.361304 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 23 05:27:21.361304 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 23 05:27:21.361304 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 23 05:27:21.361304 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Sep 23 05:27:21.361304 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Sep 23 05:27:21.361304 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Sep 23 05:27:21.361304 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 23 05:27:21.361304 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 23 05:27:21.361304 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:27:21.361304 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:27:21.361304 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:27:21.361304 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:27:21.361304 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:27:21.361304 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:27:21.361304 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:27:21.361304 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:27:21.361304 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:27:21.361304 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:27:21.361304 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 05:27:21.361304 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 05:27:21.361304 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Sep 23 05:27:21.361304 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Sep 23 05:27:21.361304 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Sep 23 05:27:21.361304 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 23 05:27:21.361304 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 23 05:27:21.361304 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:27:21.361304 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:27:21.361304 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:27:21.361304 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:27:21.361304 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:27:21.361304 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:27:21.361304 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:27:21.361304 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:27:21.361304 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 23 05:27:21.361304 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:27:21.361304 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-af0e0ff4-efe4-4e37-923c-7c9df8f81246 tempest-ServersAdminNegativeTestJSON-2109596363 tempest-ServersAdminNegativeTestJSON-2109596363-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:27:21.361304 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-af0e0ff4-efe4-4e37-923c-7c9df8f81246 tempest-ServersAdminNegativeTestJSON-2109596363 tempest-ServersAdminNegativeTestJSON-2109596363-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/f92e4209-c5f1-4795-9887-cbb28040720c/action" status: 403 len: 113 microversion: 2.1 time: 0.156823 Sep 23 05:27:21.361304 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3434/7046] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 05:27:21 2022] POST /compute/v2.1/servers/f92e4209-c5f1-4795-9887-cbb28040720c/action => generated 113 bytes in 158 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 23 05:27:21.367437 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-066b6e11-7baa-4263-9af7-62af661728e8 tempest-ServersAdminNegativeTestJSON-2109596363 tempest-ServersAdminNegativeTestJSON-2109596363-project-admin] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:27:21.432443 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-066b6e11-7baa-4263-9af7-62af661728e8 tempest-ServersAdminNegativeTestJSON-2109596363 tempest-ServersAdminNegativeTestJSON-2109596363-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/950368466" status: 202 len: 0 microversion: 2.1 time: 0.068859 Sep 23 05:27:21.433027 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3613/7047] 10.222.0.33 () {58 vars in 1158 bytes} [Fri Sep 23 05:27:21 2022] DELETE /compute/v2.1/flavors/950368466 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 05:27:21.441731 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-929033ae-c938-4e19-af4d-701414c12922 tempest-ServersAdminNegativeTestJSON-2109596363 tempest-ServersAdminNegativeTestJSON-2109596363-project-admin] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:27:21.462958 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-929033ae-c938-4e19-af4d-701414c12922 tempest-ServersAdminNegativeTestJSON-2109596363 tempest-ServersAdminNegativeTestJSON-2109596363-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025470 Sep 23 05:27:21.463512 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3435/7048] 10.222.0.33 () {58 vars in 1146 bytes} [Fri Sep 23 05:27:21 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:27:21.483885 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d548fd6e-6bba-4bbc-a61a-eb69fb8868cf tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:27:21.484393 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d548fd6e-6bba-4bbc-a61a-eb69fb8868cf tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] [instance: f92e4209-c5f1-4795-9887-cbb28040720c] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:27:21.491067 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d548fd6e-6bba-4bbc-a61a-eb69fb8868cf tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:27:21.491558 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d548fd6e-6bba-4bbc-a61a-eb69fb8868cf tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:27:21.492003 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d548fd6e-6bba-4bbc-a61a-eb69fb8868cf tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:27:21.492699 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d548fd6e-6bba-4bbc-a61a-eb69fb8868cf tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:27:21.493160 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d548fd6e-6bba-4bbc-a61a-eb69fb8868cf tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:27:21.493593 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d548fd6e-6bba-4bbc-a61a-eb69fb8868cf tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:27:21.517882 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d548fd6e-6bba-4bbc-a61a-eb69fb8868cf tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] [instance: f92e4209-c5f1-4795-9887-cbb28040720c] Going to try to terminate instance {{(pid=122699) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 05:27:21.758747 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d548fd6e-6bba-4bbc-a61a-eb69fb8868cf tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f92e4209-c5f1-4795-9887-cbb28040720c" status: 204 len: 0 microversion: 2.1 time: 0.278271 Sep 23 05:27:21.759826 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3614/7049] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 05:27:21 2022] DELETE /compute/v2.1/servers/f92e4209-c5f1-4795-9887-cbb28040720c => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 05:27:21.768376 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-fe2aeef5-1914-40b4-9f52-d1315788c759 tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:27:21.769665 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-fe2aeef5-1914-40b4-9f52-d1315788c759 tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] [instance: f92e4209-c5f1-4795-9887-cbb28040720c] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:27:21.776041 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fe2aeef5-1914-40b4-9f52-d1315788c759 tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:27:21.776543 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fe2aeef5-1914-40b4-9f52-d1315788c759 tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:27:21.776992 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fe2aeef5-1914-40b4-9f52-d1315788c759 tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:27:21.777695 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fe2aeef5-1914-40b4-9f52-d1315788c759 tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:27:21.778257 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fe2aeef5-1914-40b4-9f52-d1315788c759 tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:27:21.778701 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fe2aeef5-1914-40b4-9f52-d1315788c759 tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:27:21.914548 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-fe2aeef5-1914-40b4-9f52-d1315788c759 tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09dd6c1aade461f96a4d57ebb66c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc4ba6ac6a444e62bd03a52d5b46497b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:27:21.922783 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-fe2aeef5-1914-40b4-9f52-d1315788c759 tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] 10.222.0.33 "GET /compute/v2.1/servers/f92e4209-c5f1-4795-9887-cbb28040720c" status: 200 len: 1477 microversion: 2.1 time: 0.158811 Sep 23 05:27:21.923552 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3436/7050] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:27:21 2022] GET /compute/v2.1/servers/f92e4209-c5f1-4795-9887-cbb28040720c => generated 1477 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:27:22.946110 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-42f856ca-d05e-4d2d-ac17-1cd90f691872 tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:27:22.946809 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-42f856ca-d05e-4d2d-ac17-1cd90f691872 tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] [instance: f92e4209-c5f1-4795-9887-cbb28040720c] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:27:22.953205 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-42f856ca-d05e-4d2d-ac17-1cd90f691872 tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:27:22.953687 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-42f856ca-d05e-4d2d-ac17-1cd90f691872 tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:27:22.954159 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-42f856ca-d05e-4d2d-ac17-1cd90f691872 tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:27:22.954847 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-42f856ca-d05e-4d2d-ac17-1cd90f691872 tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:27:22.955302 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-42f856ca-d05e-4d2d-ac17-1cd90f691872 tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:27:22.955753 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-42f856ca-d05e-4d2d-ac17-1cd90f691872 tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:27:23.095561 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-42f856ca-d05e-4d2d-ac17-1cd90f691872 tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09dd6c1aade461f96a4d57ebb66c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc4ba6ac6a444e62bd03a52d5b46497b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:27:23.104037 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-42f856ca-d05e-4d2d-ac17-1cd90f691872 tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] 10.222.0.33 "GET /compute/v2.1/servers/f92e4209-c5f1-4795-9887-cbb28040720c" status: 200 len: 1477 microversion: 2.1 time: 0.162216 Sep 23 05:27:23.104621 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3615/7051] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:27:22 2022] GET /compute/v2.1/servers/f92e4209-c5f1-4795-9887-cbb28040720c => generated 1477 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:27:23.609166 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-e3072327-e571-49cc-b05e-eb2984db9500 req-b869770c-9d21-4083-9221-ed45026dea6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f92e4209-c5f1-4795-9887-cbb28040720c", "name": "network-vif-deleted", "tag": "b26c4693-4bbc-4261-99c8-3800258b6252"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:27:23.620393 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-e3072327-e571-49cc-b05e-eb2984db9500 req-b869770c-9d21-4083-9221-ed45026dea6f service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:27:23.620895 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-e3072327-e571-49cc-b05e-eb2984db9500 req-b869770c-9d21-4083-9221-ed45026dea6f service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:27:23.621338 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-e3072327-e571-49cc-b05e-eb2984db9500 req-b869770c-9d21-4083-9221-ed45026dea6f service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:27:23.633472 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-e3072327-e571-49cc-b05e-eb2984db9500 req-b869770c-9d21-4083-9221-ed45026dea6f service nova] Creating event network-vif-deleted:b26c4693-4bbc-4261-99c8-3800258b6252 for instance f92e4209-c5f1-4795-9887-cbb28040720c on n-h2-846463-3 Sep 23 05:27:23.638848 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-e3072327-e571-49cc-b05e-eb2984db9500 req-b869770c-9d21-4083-9221-ed45026dea6f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035400 Sep 23 05:27:23.645795 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3437/7052] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:27:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:27:24.127803 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-fb6cb711-6bd3-4e31-bce8-4f238d04e531 tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:27:24.129034 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-fb6cb711-6bd3-4e31-bce8-4f238d04e531 tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] [instance: f92e4209-c5f1-4795-9887-cbb28040720c] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:27:24.136077 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fb6cb711-6bd3-4e31-bce8-4f238d04e531 tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:27:24.136575 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fb6cb711-6bd3-4e31-bce8-4f238d04e531 tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:27:24.137025 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fb6cb711-6bd3-4e31-bce8-4f238d04e531 tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:27:24.137723 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fb6cb711-6bd3-4e31-bce8-4f238d04e531 tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:27:24.138225 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fb6cb711-6bd3-4e31-bce8-4f238d04e531 tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:27:24.138662 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fb6cb711-6bd3-4e31-bce8-4f238d04e531 tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:27:24.171510 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fb6cb711-6bd3-4e31-bce8-4f238d04e531 tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:27:24.172019 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fb6cb711-6bd3-4e31-bce8-4f238d04e531 tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:27:24.172604 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fb6cb711-6bd3-4e31-bce8-4f238d04e531 tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:27:24.173114 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-fb6cb711-6bd3-4e31-bce8-4f238d04e531 tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Lazy-loading 'fault' on Instance uuid f92e4209-c5f1-4795-9887-cbb28040720c {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 05:27:24.216342 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-fb6cb711-6bd3-4e31-bce8-4f238d04e531 tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e09dd6c1aade461f96a4d57ebb66c98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc4ba6ac6a444e62bd03a52d5b46497b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:27:24.224605 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-fb6cb711-6bd3-4e31-bce8-4f238d04e531 tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] 10.222.0.33 "GET /compute/v2.1/servers/f92e4209-c5f1-4795-9887-cbb28040720c" status: 200 len: 1312 microversion: 2.1 time: 0.100680 Sep 23 05:27:24.225127 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3616/7053] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:27:24 2022] GET /compute/v2.1/servers/f92e4209-c5f1-4795-9887-cbb28040720c => generated 1312 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:27:25.249480 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2ed86491-ebd3-41e1-a4a2-c862204b2b7e tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:27:25.250225 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-2ed86491-ebd3-41e1-a4a2-c862204b2b7e tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] [instance: f92e4209-c5f1-4795-9887-cbb28040720c] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:27:25.256995 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2ed86491-ebd3-41e1-a4a2-c862204b2b7e tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:27:25.257505 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2ed86491-ebd3-41e1-a4a2-c862204b2b7e tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:27:25.258005 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2ed86491-ebd3-41e1-a4a2-c862204b2b7e tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:27:25.258724 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2ed86491-ebd3-41e1-a4a2-c862204b2b7e tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:27:25.259203 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2ed86491-ebd3-41e1-a4a2-c862204b2b7e tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:27:25.259650 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2ed86491-ebd3-41e1-a4a2-c862204b2b7e tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:27:25.273637 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-2ed86491-ebd3-41e1-a4a2-c862204b2b7e tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] HTTP exception thrown: Instance f92e4209-c5f1-4795-9887-cbb28040720c could not be found. Sep 23 05:27:25.275301 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2ed86491-ebd3-41e1-a4a2-c862204b2b7e tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Request method failure captured: Sep 23 05:27:25.275301 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/f92e4209-c5f1-4795-9887-cbb28040720c HTTP/1.1 Sep 23 05:27:25.275301 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 05:27:25.275301 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 05:27:25.275301 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 05:27:25.275301 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 05:27:25.275301 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 05:27:25.275301 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 05:27:25.275301 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 05:27:25.275301 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 05:27:25.275301 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLUOrlhq6vouCJmsQbwKue7ozKOQhIwnIruk5uPZpLSU8oBZzk3Z3tc93qDxGE_4v69SOqvnJVTqBvYoUkjDiUQ3exYk2crRsIQQMuCxuruOvmjap_1fvaB3HiD79j_sz2lKVtY-eaTO1Z04stQVfP5DhomII9rf_6Wk8lQAGNnEt0Yk Sep 23 05:27:25.275301 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 05:27:25.275301 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 05:27:25.275301 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 05:27:25.275301 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 05:27:25.275301 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 05:27:25.275301 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 05:27:25.275301 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: dc4ba6ac6a444e62bd03a52d5b46497b Sep 23 05:27:25.275301 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2027249919 Sep 23 05:27:25.275301 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 05:27:25.275301 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 05:27:25.275301 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_dc4ba6ac6a444e62bd03a52d5b46497b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dc4ba6ac6a444e62bd03a52d5b46497b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/dc4ba6ac6a444e62bd03a52d5b46497b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dc4ba6ac6a444e62bd03a52d5b46497b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:27:25.275301 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2027249919 Sep 23 05:27:25.275301 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: dc4ba6ac6a444e62bd03a52d5b46497b Sep 23 05:27:25.275301 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2027249919 Sep 23 05:27:25.275301 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ServersAdminNegativeTestJSON-2027249919-project Sep 23 05:27:25.275301 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 05:27:25.275301 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 05:27:25.275301 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: e09dd6c1aade461f96a4d57ebb66c98f Sep 23 05:27:25.275301 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2027249919-project Sep 23 05:27:25.275301 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 05:27:25.275301 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance f92e4209-c5f1-4795-9887-cbb28040720c could not be found. Sep 23 05:27:25.275301 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': 'f92e4209-c5f1-4795-9887-cbb28040720c'} Sep 23 05:27:25.275301 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:27:25.275301 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:27:25.275301 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 05:27:25.275301 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 05:27:25.275301 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 05:27:25.275301 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 05:27:25.275301 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 05:27:25.275301 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 05:27:25.275301 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 05:27:25.275301 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 05:27:25.275301 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f92e4209-c5f1-4795-9887-cbb28040720c could not be found. Sep 23 05:27:25.275301 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:27:25.275301 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:27:25.275301 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:27:25.275301 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:27:25.275301 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:27:25.275301 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:27:25.275301 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:27:25.275301 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:27:25.275301 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:27:25.275301 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:27:25.275301 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 05:27:25.275301 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 05:27:25.275301 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 05:27:25.275301 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 05:27:25.275301 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 05:27:25.275301 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:27:25.275301 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f92e4209-c5f1-4795-9887-cbb28040720c could not be found. Sep 23 05:27:25.275301 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:27:25.275301 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:27:25.280177 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:27:25.280177 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:27:25.280177 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:27:25.280177 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:27:25.280177 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:27:25.280177 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:27:25.280177 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f92e4209-c5f1-4795-9887-cbb28040720c could not be found. Sep 23 05:27:25.280177 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:27:25.280177 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2ed86491-ebd3-41e1-a4a2-c862204b2b7e tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] Returning 404 to user: Instance f92e4209-c5f1-4795-9887-cbb28040720c could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:27:25.280177 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2ed86491-ebd3-41e1-a4a2-c862204b2b7e tempest-ServersAdminNegativeTestJSON-2027249919 tempest-ServersAdminNegativeTestJSON-2027249919-project] 10.222.0.33 "GET /compute/v2.1/servers/f92e4209-c5f1-4795-9887-cbb28040720c" status: 404 len: 111 microversion: 2.1 time: 0.032456 Sep 23 05:27:25.280177 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3438/7054] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:27:25 2022] GET /compute/v2.1/servers/f92e4209-c5f1-4795-9887-cbb28040720c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 05:27:33.969728 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:27:33.970527 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=3 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:27:34.082238 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4986f3a7-c268-44b1-8c62-462eaa2da1aa tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-55568280", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "networks": [{"uuid": "5b4f3c11-f28f-49e8-9ffb-4f67c250dbce"}]}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:27:34.136111 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.neutron [None req-4986f3a7-c268-44b1-8c62-462eaa2da1aa tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] validate_networks() for [('5b4f3c11-f28f-49e8-9ffb-4f67c250dbce', None, None, None, None, None)] {{(pid=122699) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 05:27:34.221477 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:27:34.541410 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-4986f3a7-c268-44b1-8c62-462eaa2da1aa tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Flavor limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 05:27:34.541841 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-4986f3a7-c268-44b1-8c62-462eaa2da1aa tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Image limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 05:27:34.542531 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-4986f3a7-c268-44b1-8c62-462eaa2da1aa tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Flavor pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 05:27:34.543064 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-4986f3a7-c268-44b1-8c62-462eaa2da1aa tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Image pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 05:27:34.543489 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-4986f3a7-c268-44b1-8c62-462eaa2da1aa tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 05:27:34.553307 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4986f3a7-c268-44b1-8c62-462eaa2da1aa tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:27:34.553799 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4986f3a7-c268-44b1-8c62-462eaa2da1aa tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:27:34.554279 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4986f3a7-c268-44b1-8c62-462eaa2da1aa tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:27:34.555023 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4986f3a7-c268-44b1-8c62-462eaa2da1aa tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:27:34.555490 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4986f3a7-c268-44b1-8c62-462eaa2da1aa tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:27:34.555922 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4986f3a7-c268-44b1-8c62-462eaa2da1aa tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:27:34.573407 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-4986f3a7-c268-44b1-8c62-462eaa2da1aa tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Getting quotas for project 104ea789993c43769c2c913081eced60. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 05:27:34.578856 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-4986f3a7-c268-44b1-8c62-462eaa2da1aa tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Getting quotas for user 8248e0249d7a44819194c7d9418d3587 and project 104ea789993c43769c2c913081eced60. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 05:27:34.592105 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4986f3a7-c268-44b1-8c62-462eaa2da1aa tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Going to run 1 instances... {{(pid=122699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 05:27:34.594452 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4986f3a7-c268-44b1-8c62-462eaa2da1aa tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] [instance: 9e316060-0e03-4fe1-b50e-1373af3344a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 05:27:34.723767 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4986f3a7-c268-44b1-8c62-462eaa2da1aa tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.757284 Sep 23 05:27:34.723767 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3617/7055] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 05:27:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 759 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 05:27:34.734199 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-166a6c96-718f-4eb3-9729-37ff61adddd2 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:27:34.735142 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-166a6c96-718f-4eb3-9729-37ff61adddd2 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] [instance: 9e316060-0e03-4fe1-b50e-1373af3344a2] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:27:34.737550 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:27:34.738538 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=3 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:27:34.809548 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-166a6c96-718f-4eb3-9729-37ff61adddd2 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8248e0249d7a44819194c7d9418d3587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104ea789993c43769c2c913081eced60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:27:34.818291 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-166a6c96-718f-4eb3-9729-37ff61adddd2 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] 10.222.0.33 "GET /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2" status: 200 len: 1213 microversion: 2.1 time: 0.088130 Sep 23 05:27:34.819209 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3439/7056] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:27:34 2022] GET /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2 => generated 1213 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:27:35.843773 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-244a8eed-37d9-4038-b10d-8e71b2e9d020 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:27:35.845687 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-244a8eed-37d9-4038-b10d-8e71b2e9d020 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] [instance: 9e316060-0e03-4fe1-b50e-1373af3344a2] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:27:35.853558 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-244a8eed-37d9-4038-b10d-8e71b2e9d020 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:27:35.854093 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-244a8eed-37d9-4038-b10d-8e71b2e9d020 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:27:35.854543 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-244a8eed-37d9-4038-b10d-8e71b2e9d020 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:27:35.855260 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-244a8eed-37d9-4038-b10d-8e71b2e9d020 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:27:35.855724 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-244a8eed-37d9-4038-b10d-8e71b2e9d020 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:27:35.856155 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-244a8eed-37d9-4038-b10d-8e71b2e9d020 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:27:35.922082 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-244a8eed-37d9-4038-b10d-8e71b2e9d020 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8248e0249d7a44819194c7d9418d3587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104ea789993c43769c2c913081eced60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:27:35.930778 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-244a8eed-37d9-4038-b10d-8e71b2e9d020 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] 10.222.0.33 "GET /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2" status: 200 len: 1217 microversion: 2.1 time: 0.091920 Sep 23 05:27:35.931582 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3618/7057] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:27:35 2022] GET /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2 => generated 1217 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:27:36.955198 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a1c0c38f-c908-4196-b8f1-fe626be745b6 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:27:36.955970 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a1c0c38f-c908-4196-b8f1-fe626be745b6 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] [instance: 9e316060-0e03-4fe1-b50e-1373af3344a2] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:27:36.959189 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=51 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:27:36.965054 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a1c0c38f-c908-4196-b8f1-fe626be745b6 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:27:36.967564 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a1c0c38f-c908-4196-b8f1-fe626be745b6 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:27:36.967564 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a1c0c38f-c908-4196-b8f1-fe626be745b6 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:27:36.967564 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a1c0c38f-c908-4196-b8f1-fe626be745b6 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:27:36.967564 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a1c0c38f-c908-4196-b8f1-fe626be745b6 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:27:36.967939 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a1c0c38f-c908-4196-b8f1-fe626be745b6 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:27:37.075406 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a1c0c38f-c908-4196-b8f1-fe626be745b6 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8248e0249d7a44819194c7d9418d3587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104ea789993c43769c2c913081eced60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:27:37.086319 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a1c0c38f-c908-4196-b8f1-fe626be745b6 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] 10.222.0.33 "GET /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2" status: 200 len: 1273 microversion: 2.1 time: 0.135128 Sep 23 05:27:37.087469 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3440/7058] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:27:36 2022] GET /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2 => generated 1273 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:27:38.113290 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0d2e09bb-a5e9-4db0-b490-dd76115189a6 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:27:38.113929 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-0d2e09bb-a5e9-4db0-b490-dd76115189a6 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] [instance: 9e316060-0e03-4fe1-b50e-1373af3344a2] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:27:38.120617 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0d2e09bb-a5e9-4db0-b490-dd76115189a6 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:27:38.121347 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0d2e09bb-a5e9-4db0-b490-dd76115189a6 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:27:38.121793 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0d2e09bb-a5e9-4db0-b490-dd76115189a6 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:27:38.122527 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0d2e09bb-a5e9-4db0-b490-dd76115189a6 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:27:38.122992 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0d2e09bb-a5e9-4db0-b490-dd76115189a6 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:27:38.123416 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0d2e09bb-a5e9-4db0-b490-dd76115189a6 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:27:38.274356 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-0d2e09bb-a5e9-4db0-b490-dd76115189a6 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8248e0249d7a44819194c7d9418d3587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104ea789993c43769c2c913081eced60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:27:38.284043 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0d2e09bb-a5e9-4db0-b490-dd76115189a6 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] 10.222.0.33 "GET /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2" status: 200 len: 1313 microversion: 2.1 time: 0.175049 Sep 23 05:27:38.284826 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3619/7059] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:27:38 2022] GET /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2 => generated 1313 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:27:38.830694 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-b3a977e9-cdb0-4312-834c-b47a4eb62352 req-839a1d11-5d50-4d4d-9ab1-3afdcd000079 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e316060-0e03-4fe1-b50e-1373af3344a2", "tag": "81c2ae4b-6f58-4025-8d57-b72173ca1306"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:27:38.843347 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-b3a977e9-cdb0-4312-834c-b47a4eb62352 req-839a1d11-5d50-4d4d-9ab1-3afdcd000079 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:27:38.843856 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-b3a977e9-cdb0-4312-834c-b47a4eb62352 req-839a1d11-5d50-4d4d-9ab1-3afdcd000079 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:27:38.844301 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-b3a977e9-cdb0-4312-834c-b47a4eb62352 req-839a1d11-5d50-4d4d-9ab1-3afdcd000079 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:27:39.132014 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-b3a977e9-cdb0-4312-834c-b47a4eb62352 req-839a1d11-5d50-4d4d-9ab1-3afdcd000079 service nova] Creating event network-changed:81c2ae4b-6f58-4025-8d57-b72173ca1306 for instance 9e316060-0e03-4fe1-b50e-1373af3344a2 on n-h2-846463-3 Sep 23 05:27:39.137472 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-b3a977e9-cdb0-4312-834c-b47a4eb62352 req-839a1d11-5d50-4d4d-9ab1-3afdcd000079 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.311952 Sep 23 05:27:39.138294 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3441/7060] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:27:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:27:39.307708 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-19f1815d-c33c-489c-98ca-46bc665f525d tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:27:39.308328 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-19f1815d-c33c-489c-98ca-46bc665f525d tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] [instance: 9e316060-0e03-4fe1-b50e-1373af3344a2] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:27:39.310731 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=7,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:27:39.316219 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-19f1815d-c33c-489c-98ca-46bc665f525d tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:27:39.316743 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-19f1815d-c33c-489c-98ca-46bc665f525d tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:27:39.317195 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-19f1815d-c33c-489c-98ca-46bc665f525d tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:27:39.318100 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-19f1815d-c33c-489c-98ca-46bc665f525d tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:27:39.318578 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-19f1815d-c33c-489c-98ca-46bc665f525d tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:27:39.319014 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-19f1815d-c33c-489c-98ca-46bc665f525d tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:27:39.455216 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-19f1815d-c33c-489c-98ca-46bc665f525d tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8248e0249d7a44819194c7d9418d3587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104ea789993c43769c2c913081eced60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:27:39.464135 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-19f1815d-c33c-489c-98ca-46bc665f525d tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] 10.222.0.33 "GET /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2" status: 200 len: 1313 microversion: 2.1 time: 0.160465 Sep 23 05:27:39.464712 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3620/7061] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:27:39 2022] GET /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:27:40.488898 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ef5aff49-56a1-4c65-97a6-3ece9a638bcc tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:27:40.489523 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-ef5aff49-56a1-4c65-97a6-3ece9a638bcc tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] [instance: 9e316060-0e03-4fe1-b50e-1373af3344a2] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:27:40.495687 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ef5aff49-56a1-4c65-97a6-3ece9a638bcc tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:27:40.496190 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ef5aff49-56a1-4c65-97a6-3ece9a638bcc tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:27:40.496647 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ef5aff49-56a1-4c65-97a6-3ece9a638bcc tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:27:40.497345 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ef5aff49-56a1-4c65-97a6-3ece9a638bcc tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:27:40.497815 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ef5aff49-56a1-4c65-97a6-3ece9a638bcc tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:27:40.498275 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ef5aff49-56a1-4c65-97a6-3ece9a638bcc tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:27:40.627761 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ef5aff49-56a1-4c65-97a6-3ece9a638bcc tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8248e0249d7a44819194c7d9418d3587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104ea789993c43769c2c913081eced60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:27:40.635481 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ef5aff49-56a1-4c65-97a6-3ece9a638bcc tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] 10.222.0.33 "GET /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2" status: 200 len: 1313 microversion: 2.1 time: 0.152301 Sep 23 05:27:40.636058 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3442/7062] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:27:40 2022] GET /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:27:41.659726 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-21b4f807-42d2-4606-bdbc-649d0957782f tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:27:41.660369 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-21b4f807-42d2-4606-bdbc-649d0957782f tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] [instance: 9e316060-0e03-4fe1-b50e-1373af3344a2] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:27:41.667057 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-21b4f807-42d2-4606-bdbc-649d0957782f tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:27:41.667551 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-21b4f807-42d2-4606-bdbc-649d0957782f tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:27:41.667998 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-21b4f807-42d2-4606-bdbc-649d0957782f tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:27:41.668699 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-21b4f807-42d2-4606-bdbc-649d0957782f tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:27:41.669166 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-21b4f807-42d2-4606-bdbc-649d0957782f tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:27:41.669598 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-21b4f807-42d2-4606-bdbc-649d0957782f tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:27:41.805423 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-21b4f807-42d2-4606-bdbc-649d0957782f tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8248e0249d7a44819194c7d9418d3587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104ea789993c43769c2c913081eced60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:27:41.813067 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-21b4f807-42d2-4606-bdbc-649d0957782f tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] 10.222.0.33 "GET /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2" status: 200 len: 1313 microversion: 2.1 time: 0.157755 Sep 23 05:27:41.813640 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3621/7063] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:27:41 2022] GET /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:27:42.836794 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-27034dab-e65c-45a5-b8db-3608b49b6852 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:27:42.837340 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-27034dab-e65c-45a5-b8db-3608b49b6852 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] [instance: 9e316060-0e03-4fe1-b50e-1373af3344a2] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:27:42.844133 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-27034dab-e65c-45a5-b8db-3608b49b6852 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:27:42.844680 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-27034dab-e65c-45a5-b8db-3608b49b6852 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:27:42.845135 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-27034dab-e65c-45a5-b8db-3608b49b6852 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:27:42.845842 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-27034dab-e65c-45a5-b8db-3608b49b6852 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:27:42.846435 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-27034dab-e65c-45a5-b8db-3608b49b6852 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:27:42.846876 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-27034dab-e65c-45a5-b8db-3608b49b6852 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:27:42.979621 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-27034dab-e65c-45a5-b8db-3608b49b6852 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8248e0249d7a44819194c7d9418d3587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104ea789993c43769c2c913081eced60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:27:42.987942 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-27034dab-e65c-45a5-b8db-3608b49b6852 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] 10.222.0.33 "GET /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2" status: 200 len: 1313 microversion: 2.1 time: 0.155294 Sep 23 05:27:42.988520 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3443/7064] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:27:42 2022] GET /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:27:44.012344 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-cf3530d2-f515-42a8-9079-980e2b895344 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:27:44.012963 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-cf3530d2-f515-42a8-9079-980e2b895344 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] [instance: 9e316060-0e03-4fe1-b50e-1373af3344a2] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:27:44.019767 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cf3530d2-f515-42a8-9079-980e2b895344 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:27:44.020258 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cf3530d2-f515-42a8-9079-980e2b895344 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:27:44.020699 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cf3530d2-f515-42a8-9079-980e2b895344 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:27:44.021399 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cf3530d2-f515-42a8-9079-980e2b895344 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:27:44.021858 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cf3530d2-f515-42a8-9079-980e2b895344 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:27:44.022308 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cf3530d2-f515-42a8-9079-980e2b895344 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:27:44.154402 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-cf3530d2-f515-42a8-9079-980e2b895344 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8248e0249d7a44819194c7d9418d3587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104ea789993c43769c2c913081eced60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:27:44.162828 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-cf3530d2-f515-42a8-9079-980e2b895344 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] 10.222.0.33 "GET /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2" status: 200 len: 1313 microversion: 2.1 time: 0.155240 Sep 23 05:27:44.163414 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3622/7065] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:27:44 2022] GET /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:27:44.236472 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-300b7dff-8329-44aa-b446-87a7d65d879b req-a11532de-2877-46c0-8d70-98ac25871b09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e316060-0e03-4fe1-b50e-1373af3344a2", "name": "network-vif-plugged", "status": "completed", "tag": "81c2ae4b-6f58-4025-8d57-b72173ca1306"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:27:44.244976 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-300b7dff-8329-44aa-b446-87a7d65d879b req-a11532de-2877-46c0-8d70-98ac25871b09 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:27:44.245483 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-300b7dff-8329-44aa-b446-87a7d65d879b req-a11532de-2877-46c0-8d70-98ac25871b09 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:27:44.246027 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-300b7dff-8329-44aa-b446-87a7d65d879b req-a11532de-2877-46c0-8d70-98ac25871b09 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:27:44.257001 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-300b7dff-8329-44aa-b446-87a7d65d879b req-a11532de-2877-46c0-8d70-98ac25871b09 service nova] Creating event network-vif-plugged:81c2ae4b-6f58-4025-8d57-b72173ca1306 for instance 9e316060-0e03-4fe1-b50e-1373af3344a2 on n-h2-846463-3 Sep 23 05:27:44.262352 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-300b7dff-8329-44aa-b446-87a7d65d879b req-a11532de-2877-46c0-8d70-98ac25871b09 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032305 Sep 23 05:27:44.263288 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3444/7066] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:27:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:27:45.186867 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-68fa774a-bb2e-4678-89f0-f15a44ead414 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:27:45.187374 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-68fa774a-bb2e-4678-89f0-f15a44ead414 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] [instance: 9e316060-0e03-4fe1-b50e-1373af3344a2] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:27:45.189205 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:27:45.190589 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=6 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:27:45.195758 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-68fa774a-bb2e-4678-89f0-f15a44ead414 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:27:45.196245 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-68fa774a-bb2e-4678-89f0-f15a44ead414 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:27:45.196683 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-68fa774a-bb2e-4678-89f0-f15a44ead414 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:27:45.197370 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-68fa774a-bb2e-4678-89f0-f15a44ead414 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:27:45.197852 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-68fa774a-bb2e-4678-89f0-f15a44ead414 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:27:45.201595 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-68fa774a-bb2e-4678-89f0-f15a44ead414 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:27:45.331851 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-68fa774a-bb2e-4678-89f0-f15a44ead414 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8248e0249d7a44819194c7d9418d3587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104ea789993c43769c2c913081eced60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:27:45.339695 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-68fa774a-bb2e-4678-89f0-f15a44ead414 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] 10.222.0.33 "GET /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2" status: 200 len: 1313 microversion: 2.1 time: 0.156737 Sep 23 05:27:45.340258 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3623/7067] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:27:45 2022] GET /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:27:46.362888 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-19f8ea36-f876-4c80-a1a0-7adafd184f6c tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:27:46.363612 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-19f8ea36-f876-4c80-a1a0-7adafd184f6c tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] [instance: 9e316060-0e03-4fe1-b50e-1373af3344a2] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:27:46.365593 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:27:46.367130 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=1,nova_api:DELETE=3 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:27:46.372216 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-19f8ea36-f876-4c80-a1a0-7adafd184f6c tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:27:46.372731 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-19f8ea36-f876-4c80-a1a0-7adafd184f6c tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:27:46.373189 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-19f8ea36-f876-4c80-a1a0-7adafd184f6c tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:27:46.373954 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-19f8ea36-f876-4c80-a1a0-7adafd184f6c tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:27:46.374433 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-19f8ea36-f876-4c80-a1a0-7adafd184f6c tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:27:46.374878 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-19f8ea36-f876-4c80-a1a0-7adafd184f6c tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:27:46.508369 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-19f8ea36-f876-4c80-a1a0-7adafd184f6c tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8248e0249d7a44819194c7d9418d3587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104ea789993c43769c2c913081eced60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:27:46.516610 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-19f8ea36-f876-4c80-a1a0-7adafd184f6c tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] 10.222.0.33 "GET /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2" status: 200 len: 1501 microversion: 2.1 time: 0.158054 Sep 23 05:27:46.517188 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3445/7068] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:27:46 2022] GET /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2 => generated 1501 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:27:46.539619 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-148ad210-76ca-4090-a654-1decd3bf4de1 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:27:46.542029 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-148ad210-76ca-4090-a654-1decd3bf4de1 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] [instance: 9e316060-0e03-4fe1-b50e-1373af3344a2] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:27:46.548499 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-148ad210-76ca-4090-a654-1decd3bf4de1 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:27:46.549037 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-148ad210-76ca-4090-a654-1decd3bf4de1 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:27:46.550076 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-148ad210-76ca-4090-a654-1decd3bf4de1 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:27:46.550774 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-148ad210-76ca-4090-a654-1decd3bf4de1 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:27:46.551239 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-148ad210-76ca-4090-a654-1decd3bf4de1 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:27:46.551673 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-148ad210-76ca-4090-a654-1decd3bf4de1 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:27:46.579986 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-148ad210-76ca-4090-a654-1decd3bf4de1 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '8248e0249d7a44819194c7d9418d3587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104ea789993c43769c2c913081eced60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:27:46.585546 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-148ad210-76ca-4090-a654-1decd3bf4de1 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] [instance: 9e316060-0e03-4fe1-b50e-1373af3344a2] Old instance type m1.heat2, new instance type m1.heat {{(pid=122699) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 23 05:27:46.592429 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-148ad210-76ca-4090-a654-1decd3bf4de1 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Flavor limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 05:27:46.592856 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-148ad210-76ca-4090-a654-1decd3bf4de1 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Image limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 05:27:46.593352 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-148ad210-76ca-4090-a654-1decd3bf4de1 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Flavor pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 05:27:46.593773 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-148ad210-76ca-4090-a654-1decd3bf4de1 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Image pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 05:27:46.594252 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-148ad210-76ca-4090-a654-1decd3bf4de1 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 05:27:46.785287 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-148ad210-76ca-4090-a654-1decd3bf4de1 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] 10.222.0.33 "POST /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2/action" status: 202 len: 0 microversion: 2.1 time: 0.249552 Sep 23 05:27:46.785949 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3624/7069] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 05:27:46 2022] POST /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2/action => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 05:27:46.793913 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b55af851-5fb2-4b79-bde3-8521c169804c tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:27:46.794565 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b55af851-5fb2-4b79-bde3-8521c169804c tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] [instance: 9e316060-0e03-4fe1-b50e-1373af3344a2] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:27:46.803100 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b55af851-5fb2-4b79-bde3-8521c169804c tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:27:46.803100 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b55af851-5fb2-4b79-bde3-8521c169804c tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:27:46.803100 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b55af851-5fb2-4b79-bde3-8521c169804c tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:27:46.803100 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b55af851-5fb2-4b79-bde3-8521c169804c tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:27:46.803100 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b55af851-5fb2-4b79-bde3-8521c169804c tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:27:46.803100 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b55af851-5fb2-4b79-bde3-8521c169804c tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:27:46.933588 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b55af851-5fb2-4b79-bde3-8521c169804c tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8248e0249d7a44819194c7d9418d3587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104ea789993c43769c2c913081eced60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:27:46.942077 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b55af851-5fb2-4b79-bde3-8521c169804c tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] 10.222.0.33 "GET /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2" status: 200 len: 1510 microversion: 2.1 time: 0.151967 Sep 23 05:27:46.942656 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3446/7070] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:27:46 2022] GET /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2 => generated 1510 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:27:47.965246 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b3c35773-4a24-48cd-a227-63e240956dc9 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:27:47.965871 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b3c35773-4a24-48cd-a227-63e240956dc9 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] [instance: 9e316060-0e03-4fe1-b50e-1373af3344a2] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:27:47.972375 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b3c35773-4a24-48cd-a227-63e240956dc9 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:27:47.977384 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b3c35773-4a24-48cd-a227-63e240956dc9 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:27:47.977384 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b3c35773-4a24-48cd-a227-63e240956dc9 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:27:47.977384 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b3c35773-4a24-48cd-a227-63e240956dc9 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:27:47.977384 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b3c35773-4a24-48cd-a227-63e240956dc9 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:27:47.977384 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b3c35773-4a24-48cd-a227-63e240956dc9 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:27:48.111474 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b3c35773-4a24-48cd-a227-63e240956dc9 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8248e0249d7a44819194c7d9418d3587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104ea789993c43769c2c913081eced60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:27:48.122050 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b3c35773-4a24-48cd-a227-63e240956dc9 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] 10.222.0.33 "GET /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2" status: 200 len: 1510 microversion: 2.1 time: 0.161044 Sep 23 05:27:48.122752 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3625/7071] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:27:47 2022] GET /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2 => generated 1510 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:27:49.146059 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-070af121-66b7-47f1-838e-8f1d69488dec tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:27:49.146696 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-070af121-66b7-47f1-838e-8f1d69488dec tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] [instance: 9e316060-0e03-4fe1-b50e-1373af3344a2] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:27:49.153665 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-070af121-66b7-47f1-838e-8f1d69488dec tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:27:49.154205 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-070af121-66b7-47f1-838e-8f1d69488dec tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:27:49.154712 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-070af121-66b7-47f1-838e-8f1d69488dec tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:27:49.155429 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-070af121-66b7-47f1-838e-8f1d69488dec tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:27:49.155910 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-070af121-66b7-47f1-838e-8f1d69488dec tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:27:49.156359 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-070af121-66b7-47f1-838e-8f1d69488dec tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:27:49.296588 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-070af121-66b7-47f1-838e-8f1d69488dec tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8248e0249d7a44819194c7d9418d3587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104ea789993c43769c2c913081eced60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:27:49.305168 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-070af121-66b7-47f1-838e-8f1d69488dec tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] 10.222.0.33 "GET /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2" status: 200 len: 1510 microversion: 2.1 time: 0.163222 Sep 23 05:27:49.310402 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3447/7072] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:27:49 2022] GET /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2 => generated 1510 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:27:50.329672 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e0f5bfa2-6eef-4227-bbf4-6e3f27831d20 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:27:50.331267 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e0f5bfa2-6eef-4227-bbf4-6e3f27831d20 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] [instance: 9e316060-0e03-4fe1-b50e-1373af3344a2] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:27:50.337679 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e0f5bfa2-6eef-4227-bbf4-6e3f27831d20 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:27:50.338220 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e0f5bfa2-6eef-4227-bbf4-6e3f27831d20 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:27:50.338666 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e0f5bfa2-6eef-4227-bbf4-6e3f27831d20 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:27:50.339378 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e0f5bfa2-6eef-4227-bbf4-6e3f27831d20 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:27:50.339844 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e0f5bfa2-6eef-4227-bbf4-6e3f27831d20 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:27:50.340280 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e0f5bfa2-6eef-4227-bbf4-6e3f27831d20 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:27:50.467493 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e0f5bfa2-6eef-4227-bbf4-6e3f27831d20 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8248e0249d7a44819194c7d9418d3587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104ea789993c43769c2c913081eced60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:27:50.475222 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e0f5bfa2-6eef-4227-bbf4-6e3f27831d20 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] 10.222.0.33 "GET /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2" status: 200 len: 1515 microversion: 2.1 time: 0.150614 Sep 23 05:27:50.475875 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3626/7073] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:27:50 2022] GET /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2 => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:27:51.499594 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-42786430-2422-4bf1-bc93-aac70e6c207f tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:27:51.500228 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-42786430-2422-4bf1-bc93-aac70e6c207f tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] [instance: 9e316060-0e03-4fe1-b50e-1373af3344a2] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:27:51.507627 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-42786430-2422-4bf1-bc93-aac70e6c207f tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:27:51.508135 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-42786430-2422-4bf1-bc93-aac70e6c207f tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:27:51.508593 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-42786430-2422-4bf1-bc93-aac70e6c207f tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:27:51.509305 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-42786430-2422-4bf1-bc93-aac70e6c207f tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:27:51.509782 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-42786430-2422-4bf1-bc93-aac70e6c207f tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:27:51.510254 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-42786430-2422-4bf1-bc93-aac70e6c207f tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:27:51.644251 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-42786430-2422-4bf1-bc93-aac70e6c207f tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8248e0249d7a44819194c7d9418d3587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104ea789993c43769c2c913081eced60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:27:51.651965 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-42786430-2422-4bf1-bc93-aac70e6c207f tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] 10.222.0.33 "GET /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2" status: 200 len: 1515 microversion: 2.1 time: 0.156275 Sep 23 05:27:51.652542 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3448/7074] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:27:51 2022] GET /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:27:52.675084 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-63009cda-e65d-4c88-8cee-76f7f58e36f6 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:27:52.675640 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-63009cda-e65d-4c88-8cee-76f7f58e36f6 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] [instance: 9e316060-0e03-4fe1-b50e-1373af3344a2] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:27:52.682111 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-63009cda-e65d-4c88-8cee-76f7f58e36f6 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:27:52.682599 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-63009cda-e65d-4c88-8cee-76f7f58e36f6 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:27:52.683038 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-63009cda-e65d-4c88-8cee-76f7f58e36f6 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:27:52.683729 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-63009cda-e65d-4c88-8cee-76f7f58e36f6 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:27:52.684195 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-63009cda-e65d-4c88-8cee-76f7f58e36f6 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:27:52.684623 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-63009cda-e65d-4c88-8cee-76f7f58e36f6 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:27:52.815599 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-63009cda-e65d-4c88-8cee-76f7f58e36f6 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8248e0249d7a44819194c7d9418d3587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104ea789993c43769c2c913081eced60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:27:52.823509 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-63009cda-e65d-4c88-8cee-76f7f58e36f6 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] 10.222.0.33 "GET /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2" status: 200 len: 1515 microversion: 2.1 time: 0.152414 Sep 23 05:27:52.835541 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3627/7075] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:27:52 2022] GET /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2 => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:27:53.849728 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-fd49b8b7-94e0-4aeb-93a7-981cc6df2c17 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:27:53.850818 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-fd49b8b7-94e0-4aeb-93a7-981cc6df2c17 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] [instance: 9e316060-0e03-4fe1-b50e-1373af3344a2] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:27:53.858244 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fd49b8b7-94e0-4aeb-93a7-981cc6df2c17 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:27:53.858753 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fd49b8b7-94e0-4aeb-93a7-981cc6df2c17 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:27:53.859208 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fd49b8b7-94e0-4aeb-93a7-981cc6df2c17 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:27:53.859926 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fd49b8b7-94e0-4aeb-93a7-981cc6df2c17 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:27:53.860491 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fd49b8b7-94e0-4aeb-93a7-981cc6df2c17 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:27:53.860991 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fd49b8b7-94e0-4aeb-93a7-981cc6df2c17 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:27:54.008778 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-fd49b8b7-94e0-4aeb-93a7-981cc6df2c17 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8248e0249d7a44819194c7d9418d3587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104ea789993c43769c2c913081eced60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:27:54.016990 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-fd49b8b7-94e0-4aeb-93a7-981cc6df2c17 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] 10.222.0.33 "GET /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2" status: 200 len: 1515 microversion: 2.1 time: 0.173053 Sep 23 05:27:54.018213 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3449/7076] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:27:53 2022] GET /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2 => generated 1515 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:27:55.040549 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9c91fcbe-6ee5-4ba6-b643-227e4f924b81 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:27:55.041195 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-9c91fcbe-6ee5-4ba6-b643-227e4f924b81 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] [instance: 9e316060-0e03-4fe1-b50e-1373af3344a2] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:27:55.047760 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9c91fcbe-6ee5-4ba6-b643-227e4f924b81 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:27:55.048254 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9c91fcbe-6ee5-4ba6-b643-227e4f924b81 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:27:55.048775 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9c91fcbe-6ee5-4ba6-b643-227e4f924b81 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:27:55.049476 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9c91fcbe-6ee5-4ba6-b643-227e4f924b81 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:27:55.049962 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9c91fcbe-6ee5-4ba6-b643-227e4f924b81 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:27:55.050396 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9c91fcbe-6ee5-4ba6-b643-227e4f924b81 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:27:55.181638 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-9c91fcbe-6ee5-4ba6-b643-227e4f924b81 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8248e0249d7a44819194c7d9418d3587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104ea789993c43769c2c913081eced60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:27:55.189307 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-9c91fcbe-6ee5-4ba6-b643-227e4f924b81 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] 10.222.0.33 "GET /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2" status: 200 len: 1515 microversion: 2.1 time: 0.152623 Sep 23 05:27:55.189871 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3628/7077] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:27:55 2022] GET /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2 => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:27:56.212633 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d9c967b3-2f9a-4e4a-a86e-e2c83802d8d2 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:27:56.213270 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d9c967b3-2f9a-4e4a-a86e-e2c83802d8d2 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] [instance: 9e316060-0e03-4fe1-b50e-1373af3344a2] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:27:56.220237 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d9c967b3-2f9a-4e4a-a86e-e2c83802d8d2 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:27:56.220752 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d9c967b3-2f9a-4e4a-a86e-e2c83802d8d2 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:27:56.221214 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d9c967b3-2f9a-4e4a-a86e-e2c83802d8d2 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:27:56.221976 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d9c967b3-2f9a-4e4a-a86e-e2c83802d8d2 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:27:56.222445 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d9c967b3-2f9a-4e4a-a86e-e2c83802d8d2 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:27:56.222896 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d9c967b3-2f9a-4e4a-a86e-e2c83802d8d2 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:27:56.354353 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d9c967b3-2f9a-4e4a-a86e-e2c83802d8d2 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8248e0249d7a44819194c7d9418d3587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104ea789993c43769c2c913081eced60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:27:56.362467 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d9c967b3-2f9a-4e4a-a86e-e2c83802d8d2 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] 10.222.0.33 "GET /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2" status: 200 len: 1515 microversion: 2.1 time: 0.153936 Sep 23 05:27:56.363036 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3450/7078] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:27:56 2022] GET /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2 => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:27:57.386298 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-89b5c309-370e-44c7-b711-1dc45b7c3972 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:27:57.386939 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-89b5c309-370e-44c7-b711-1dc45b7c3972 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] [instance: 9e316060-0e03-4fe1-b50e-1373af3344a2] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:27:57.394333 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-89b5c309-370e-44c7-b711-1dc45b7c3972 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:27:57.394827 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-89b5c309-370e-44c7-b711-1dc45b7c3972 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:27:57.395271 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-89b5c309-370e-44c7-b711-1dc45b7c3972 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:27:57.395966 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-89b5c309-370e-44c7-b711-1dc45b7c3972 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:27:57.396458 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-89b5c309-370e-44c7-b711-1dc45b7c3972 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:27:57.396886 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-89b5c309-370e-44c7-b711-1dc45b7c3972 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:27:57.525765 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-89b5c309-370e-44c7-b711-1dc45b7c3972 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8248e0249d7a44819194c7d9418d3587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104ea789993c43769c2c913081eced60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:27:57.533693 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-89b5c309-370e-44c7-b711-1dc45b7c3972 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] 10.222.0.33 "GET /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2" status: 200 len: 1515 microversion: 2.1 time: 0.151238 Sep 23 05:27:57.534245 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3629/7079] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:27:57 2022] GET /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2 => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:27:58.556174 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ba875ae1-2610-4bf9-840f-2d39c9cfb6a6 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:27:58.556842 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-ba875ae1-2610-4bf9-840f-2d39c9cfb6a6 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] [instance: 9e316060-0e03-4fe1-b50e-1373af3344a2] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:27:58.563924 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ba875ae1-2610-4bf9-840f-2d39c9cfb6a6 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:27:58.564438 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ba875ae1-2610-4bf9-840f-2d39c9cfb6a6 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:27:58.564901 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ba875ae1-2610-4bf9-840f-2d39c9cfb6a6 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:27:58.565619 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ba875ae1-2610-4bf9-840f-2d39c9cfb6a6 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:27:58.566138 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ba875ae1-2610-4bf9-840f-2d39c9cfb6a6 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:27:58.566589 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ba875ae1-2610-4bf9-840f-2d39c9cfb6a6 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:27:58.696494 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ba875ae1-2610-4bf9-840f-2d39c9cfb6a6 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8248e0249d7a44819194c7d9418d3587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104ea789993c43769c2c913081eced60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:27:58.704291 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ba875ae1-2610-4bf9-840f-2d39c9cfb6a6 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] 10.222.0.33 "GET /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2" status: 200 len: 1515 microversion: 2.1 time: 0.152060 Sep 23 05:27:58.705420 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3451/7080] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:27:58 2022] GET /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2 => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:27:59.728439 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-04852a69-d7f6-4a45-be5e-3d080fd37bb6 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:27:59.729060 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-04852a69-d7f6-4a45-be5e-3d080fd37bb6 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] [instance: 9e316060-0e03-4fe1-b50e-1373af3344a2] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:27:59.735586 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-04852a69-d7f6-4a45-be5e-3d080fd37bb6 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:27:59.736603 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-04852a69-d7f6-4a45-be5e-3d080fd37bb6 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:27:59.737088 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-04852a69-d7f6-4a45-be5e-3d080fd37bb6 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:27:59.737790 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-04852a69-d7f6-4a45-be5e-3d080fd37bb6 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:27:59.738281 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-04852a69-d7f6-4a45-be5e-3d080fd37bb6 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:27:59.738796 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-04852a69-d7f6-4a45-be5e-3d080fd37bb6 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:27:59.870797 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-04852a69-d7f6-4a45-be5e-3d080fd37bb6 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8248e0249d7a44819194c7d9418d3587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104ea789993c43769c2c913081eced60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:27:59.878638 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-04852a69-d7f6-4a45-be5e-3d080fd37bb6 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] 10.222.0.33 "GET /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2" status: 200 len: 1515 microversion: 2.1 time: 0.154073 Sep 23 05:27:59.879241 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3630/7081] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:27:59 2022] GET /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2 => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:28:00.902424 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e0ee4638-7473-4b60-8486-ab39cf3e6bbd tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:28:00.903114 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e0ee4638-7473-4b60-8486-ab39cf3e6bbd tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] [instance: 9e316060-0e03-4fe1-b50e-1373af3344a2] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:28:00.909448 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e0ee4638-7473-4b60-8486-ab39cf3e6bbd tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:28:00.909988 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e0ee4638-7473-4b60-8486-ab39cf3e6bbd tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:28:00.910453 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e0ee4638-7473-4b60-8486-ab39cf3e6bbd tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:28:00.911166 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e0ee4638-7473-4b60-8486-ab39cf3e6bbd tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:28:00.911647 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e0ee4638-7473-4b60-8486-ab39cf3e6bbd tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:28:00.912098 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e0ee4638-7473-4b60-8486-ab39cf3e6bbd tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:28:01.104624 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e0ee4638-7473-4b60-8486-ab39cf3e6bbd tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8248e0249d7a44819194c7d9418d3587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104ea789993c43769c2c913081eced60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:28:01.114461 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e0ee4638-7473-4b60-8486-ab39cf3e6bbd tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] 10.222.0.33 "GET /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2" status: 200 len: 1515 microversion: 2.1 time: 0.216211 Sep 23 05:28:01.115078 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3452/7082] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:28:00 2022] GET /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2 => generated 1515 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:28:02.138345 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e3c38cf6-1a5f-4e8d-8fab-c68c6441a4bf tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:28:02.138999 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e3c38cf6-1a5f-4e8d-8fab-c68c6441a4bf tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] [instance: 9e316060-0e03-4fe1-b50e-1373af3344a2] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:28:02.146510 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e3c38cf6-1a5f-4e8d-8fab-c68c6441a4bf tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:28:02.147002 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e3c38cf6-1a5f-4e8d-8fab-c68c6441a4bf tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:28:02.147451 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e3c38cf6-1a5f-4e8d-8fab-c68c6441a4bf tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:28:02.148148 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e3c38cf6-1a5f-4e8d-8fab-c68c6441a4bf tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:28:02.148612 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e3c38cf6-1a5f-4e8d-8fab-c68c6441a4bf tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:28:02.149061 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e3c38cf6-1a5f-4e8d-8fab-c68c6441a4bf tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:28:02.339222 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e3c38cf6-1a5f-4e8d-8fab-c68c6441a4bf tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8248e0249d7a44819194c7d9418d3587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104ea789993c43769c2c913081eced60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:28:02.347264 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e3c38cf6-1a5f-4e8d-8fab-c68c6441a4bf tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] 10.222.0.33 "GET /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2" status: 200 len: 1515 microversion: 2.1 time: 0.212801 Sep 23 05:28:02.347843 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3631/7083] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:28:02 2022] GET /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2 => generated 1515 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:28:03.370995 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-46de6d4f-07bd-46f2-80c0-938918410171 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:28:03.371666 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-46de6d4f-07bd-46f2-80c0-938918410171 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] [instance: 9e316060-0e03-4fe1-b50e-1373af3344a2] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:28:03.378698 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-46de6d4f-07bd-46f2-80c0-938918410171 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:28:03.379209 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-46de6d4f-07bd-46f2-80c0-938918410171 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:28:03.379762 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-46de6d4f-07bd-46f2-80c0-938918410171 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:28:03.380528 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-46de6d4f-07bd-46f2-80c0-938918410171 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:28:03.381016 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-46de6d4f-07bd-46f2-80c0-938918410171 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:28:03.381467 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-46de6d4f-07bd-46f2-80c0-938918410171 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:28:03.512453 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-46de6d4f-07bd-46f2-80c0-938918410171 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8248e0249d7a44819194c7d9418d3587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104ea789993c43769c2c913081eced60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:28:03.521091 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-46de6d4f-07bd-46f2-80c0-938918410171 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] 10.222.0.33 "GET /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2" status: 200 len: 1515 microversion: 2.1 time: 0.154056 Sep 23 05:28:03.521671 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3453/7084] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:28:03 2022] GET /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2 => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:28:04.544625 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-97db827e-ae33-4c07-9111-246cd8b67ee5 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:28:04.545236 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-97db827e-ae33-4c07-9111-246cd8b67ee5 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] [instance: 9e316060-0e03-4fe1-b50e-1373af3344a2] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:28:04.551255 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-97db827e-ae33-4c07-9111-246cd8b67ee5 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:28:04.551741 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-97db827e-ae33-4c07-9111-246cd8b67ee5 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:28:04.552178 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-97db827e-ae33-4c07-9111-246cd8b67ee5 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:28:04.552865 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-97db827e-ae33-4c07-9111-246cd8b67ee5 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:28:04.553321 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-97db827e-ae33-4c07-9111-246cd8b67ee5 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:28:04.553744 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-97db827e-ae33-4c07-9111-246cd8b67ee5 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:28:04.556262 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:28:04.688295 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-97db827e-ae33-4c07-9111-246cd8b67ee5 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8248e0249d7a44819194c7d9418d3587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104ea789993c43769c2c913081eced60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:28:04.697078 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-97db827e-ae33-4c07-9111-246cd8b67ee5 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] 10.222.0.33 "GET /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2" status: 200 len: 1515 microversion: 2.1 time: 0.156429 Sep 23 05:28:04.697658 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3632/7085] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:28:04 2022] GET /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2 => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:28:05.720449 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6f77ad94-8037-408c-83c9-cab96b7477bc tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:28:05.721105 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-6f77ad94-8037-408c-83c9-cab96b7477bc tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] [instance: 9e316060-0e03-4fe1-b50e-1373af3344a2] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:28:05.728869 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6f77ad94-8037-408c-83c9-cab96b7477bc tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:28:05.729374 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6f77ad94-8037-408c-83c9-cab96b7477bc tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:28:05.729825 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6f77ad94-8037-408c-83c9-cab96b7477bc tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:28:05.730554 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6f77ad94-8037-408c-83c9-cab96b7477bc tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:28:05.731026 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6f77ad94-8037-408c-83c9-cab96b7477bc tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:28:05.731462 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6f77ad94-8037-408c-83c9-cab96b7477bc tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:28:05.862369 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6f77ad94-8037-408c-83c9-cab96b7477bc tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8248e0249d7a44819194c7d9418d3587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104ea789993c43769c2c913081eced60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:28:05.870237 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-6f77ad94-8037-408c-83c9-cab96b7477bc tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] 10.222.0.33 "GET /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2" status: 200 len: 1515 microversion: 2.1 time: 0.153561 Sep 23 05:28:05.873877 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3454/7086] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:28:05 2022] GET /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2 => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:28:06.894652 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-815117f2-9529-4544-98a1-27a5b5f090a3 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:28:06.895266 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-815117f2-9529-4544-98a1-27a5b5f090a3 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] [instance: 9e316060-0e03-4fe1-b50e-1373af3344a2] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:28:06.901858 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-815117f2-9529-4544-98a1-27a5b5f090a3 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:28:06.902378 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-815117f2-9529-4544-98a1-27a5b5f090a3 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:28:06.902900 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-815117f2-9529-4544-98a1-27a5b5f090a3 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:28:06.903580 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-815117f2-9529-4544-98a1-27a5b5f090a3 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:28:06.904037 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-815117f2-9529-4544-98a1-27a5b5f090a3 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:28:06.904464 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-815117f2-9529-4544-98a1-27a5b5f090a3 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:28:07.037274 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-815117f2-9529-4544-98a1-27a5b5f090a3 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8248e0249d7a44819194c7d9418d3587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104ea789993c43769c2c913081eced60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:28:07.044938 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-815117f2-9529-4544-98a1-27a5b5f090a3 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] 10.222.0.33 "GET /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2" status: 200 len: 1515 microversion: 2.1 time: 0.155104 Sep 23 05:28:07.045509 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3633/7087] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:28:06 2022] GET /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:28:08.068045 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d74dd48b-8e90-47a7-91c8-5d3210a8ec7b tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:28:08.068696 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d74dd48b-8e90-47a7-91c8-5d3210a8ec7b tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] [instance: 9e316060-0e03-4fe1-b50e-1373af3344a2] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:28:08.075559 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d74dd48b-8e90-47a7-91c8-5d3210a8ec7b tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:28:08.080165 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d74dd48b-8e90-47a7-91c8-5d3210a8ec7b tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:28:08.080165 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d74dd48b-8e90-47a7-91c8-5d3210a8ec7b tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:28:08.080165 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d74dd48b-8e90-47a7-91c8-5d3210a8ec7b tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:28:08.080165 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d74dd48b-8e90-47a7-91c8-5d3210a8ec7b tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:28:08.080165 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d74dd48b-8e90-47a7-91c8-5d3210a8ec7b tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:28:08.082096 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=83 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:28:08.209770 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d74dd48b-8e90-47a7-91c8-5d3210a8ec7b tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8248e0249d7a44819194c7d9418d3587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104ea789993c43769c2c913081eced60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:28:08.217557 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d74dd48b-8e90-47a7-91c8-5d3210a8ec7b tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] 10.222.0.33 "GET /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2" status: 200 len: 1515 microversion: 2.1 time: 0.153486 Sep 23 05:28:08.218181 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3455/7088] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:28:08 2022] GET /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2 => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:28:09.241055 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9356d313-7c29-4e28-9ed4-a3a0c91cf09e tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:28:09.241647 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-9356d313-7c29-4e28-9ed4-a3a0c91cf09e tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] [instance: 9e316060-0e03-4fe1-b50e-1373af3344a2] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:28:09.248151 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9356d313-7c29-4e28-9ed4-a3a0c91cf09e tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:28:09.248635 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9356d313-7c29-4e28-9ed4-a3a0c91cf09e tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:28:09.249069 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9356d313-7c29-4e28-9ed4-a3a0c91cf09e tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:28:09.249752 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9356d313-7c29-4e28-9ed4-a3a0c91cf09e tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:28:09.250230 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9356d313-7c29-4e28-9ed4-a3a0c91cf09e tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:28:09.250654 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9356d313-7c29-4e28-9ed4-a3a0c91cf09e tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:28:09.380987 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-9356d313-7c29-4e28-9ed4-a3a0c91cf09e tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8248e0249d7a44819194c7d9418d3587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104ea789993c43769c2c913081eced60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:28:09.388812 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-9356d313-7c29-4e28-9ed4-a3a0c91cf09e tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] 10.222.0.33 "GET /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2" status: 200 len: 1515 microversion: 2.1 time: 0.152113 Sep 23 05:28:09.389382 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3634/7089] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:28:09 2022] GET /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2 => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:28:10.412075 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2e855b00-345f-4b80-bf76-e5335702c911 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:28:10.412705 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-2e855b00-345f-4b80-bf76-e5335702c911 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] [instance: 9e316060-0e03-4fe1-b50e-1373af3344a2] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:28:10.419812 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2e855b00-345f-4b80-bf76-e5335702c911 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:28:10.420216 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2e855b00-345f-4b80-bf76-e5335702c911 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:28:10.420679 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2e855b00-345f-4b80-bf76-e5335702c911 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:28:10.421377 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2e855b00-345f-4b80-bf76-e5335702c911 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:28:10.421858 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2e855b00-345f-4b80-bf76-e5335702c911 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:28:10.422334 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2e855b00-345f-4b80-bf76-e5335702c911 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:28:10.551851 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-2e855b00-345f-4b80-bf76-e5335702c911 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8248e0249d7a44819194c7d9418d3587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104ea789993c43769c2c913081eced60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:28:10.559567 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2e855b00-345f-4b80-bf76-e5335702c911 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] 10.222.0.33 "GET /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2" status: 200 len: 1515 microversion: 2.1 time: 0.151512 Sep 23 05:28:10.560146 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3456/7090] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:28:10 2022] GET /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2 => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:28:11.583736 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-eaad4271-ec4e-483f-addf-838540433b13 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:28:11.584278 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-eaad4271-ec4e-483f-addf-838540433b13 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] [instance: 9e316060-0e03-4fe1-b50e-1373af3344a2] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:28:11.590782 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eaad4271-ec4e-483f-addf-838540433b13 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:28:11.591274 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eaad4271-ec4e-483f-addf-838540433b13 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:28:11.591719 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eaad4271-ec4e-483f-addf-838540433b13 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:28:11.592418 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eaad4271-ec4e-483f-addf-838540433b13 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:28:11.592879 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eaad4271-ec4e-483f-addf-838540433b13 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:28:11.593305 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-eaad4271-ec4e-483f-addf-838540433b13 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:28:11.722280 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-eaad4271-ec4e-483f-addf-838540433b13 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8248e0249d7a44819194c7d9418d3587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104ea789993c43769c2c913081eced60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:28:11.729871 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-eaad4271-ec4e-483f-addf-838540433b13 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] 10.222.0.33 "GET /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2" status: 200 len: 1515 microversion: 2.1 time: 0.150678 Sep 23 05:28:11.730454 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3635/7091] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:28:11 2022] GET /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2 => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:28:12.752762 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-18a82073-5aa0-4401-8130-8fed0bb7e4e2 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:28:12.753383 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-18a82073-5aa0-4401-8130-8fed0bb7e4e2 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] [instance: 9e316060-0e03-4fe1-b50e-1373af3344a2] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:28:12.760265 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-18a82073-5aa0-4401-8130-8fed0bb7e4e2 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:28:12.760766 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-18a82073-5aa0-4401-8130-8fed0bb7e4e2 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:28:12.761219 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-18a82073-5aa0-4401-8130-8fed0bb7e4e2 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:28:12.761975 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-18a82073-5aa0-4401-8130-8fed0bb7e4e2 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:28:12.762450 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-18a82073-5aa0-4401-8130-8fed0bb7e4e2 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:28:12.762892 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-18a82073-5aa0-4401-8130-8fed0bb7e4e2 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:28:12.892221 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-18a82073-5aa0-4401-8130-8fed0bb7e4e2 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8248e0249d7a44819194c7d9418d3587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104ea789993c43769c2c913081eced60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:28:12.904498 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-18a82073-5aa0-4401-8130-8fed0bb7e4e2 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] 10.222.0.33 "GET /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2" status: 200 len: 1515 microversion: 2.1 time: 0.155177 Sep 23 05:28:12.907113 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3457/7092] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:28:12 2022] GET /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:28:13.929272 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0000cdd9-579e-4fd9-ac0d-400ded05a253 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:28:13.929914 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-0000cdd9-579e-4fd9-ac0d-400ded05a253 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] [instance: 9e316060-0e03-4fe1-b50e-1373af3344a2] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:28:13.932270 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=36 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:28:13.937013 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0000cdd9-579e-4fd9-ac0d-400ded05a253 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:28:13.939512 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0000cdd9-579e-4fd9-ac0d-400ded05a253 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:28:13.939512 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0000cdd9-579e-4fd9-ac0d-400ded05a253 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:28:13.939512 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0000cdd9-579e-4fd9-ac0d-400ded05a253 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:28:13.939512 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0000cdd9-579e-4fd9-ac0d-400ded05a253 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:28:13.939512 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0000cdd9-579e-4fd9-ac0d-400ded05a253 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:28:14.072180 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-0000cdd9-579e-4fd9-ac0d-400ded05a253 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8248e0249d7a44819194c7d9418d3587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104ea789993c43769c2c913081eced60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:28:14.079908 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0000cdd9-579e-4fd9-ac0d-400ded05a253 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] 10.222.0.33 "GET /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2" status: 200 len: 1515 microversion: 2.1 time: 0.154734 Sep 23 05:28:14.080560 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3636/7093] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:28:13 2022] GET /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:28:15.103173 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-70c6db1c-869a-4410-9601-492b679243aa tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:28:15.103810 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-70c6db1c-869a-4410-9601-492b679243aa tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] [instance: 9e316060-0e03-4fe1-b50e-1373af3344a2] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:28:15.110737 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-70c6db1c-869a-4410-9601-492b679243aa tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:28:15.111250 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-70c6db1c-869a-4410-9601-492b679243aa tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:28:15.112210 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-70c6db1c-869a-4410-9601-492b679243aa tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:28:15.112918 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-70c6db1c-869a-4410-9601-492b679243aa tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:28:15.113392 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-70c6db1c-869a-4410-9601-492b679243aa tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:28:15.113834 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-70c6db1c-869a-4410-9601-492b679243aa tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:28:15.241562 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-70c6db1c-869a-4410-9601-492b679243aa tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8248e0249d7a44819194c7d9418d3587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104ea789993c43769c2c913081eced60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:28:15.249293 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-70c6db1c-869a-4410-9601-492b679243aa tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] 10.222.0.33 "GET /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2" status: 200 len: 1515 microversion: 2.1 time: 0.150047 Sep 23 05:28:15.249877 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3458/7094] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:28:15 2022] GET /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2 => generated 1515 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:28:16.273355 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-53082e19-728a-45e9-8a2e-1c36776f38cb tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:28:16.273984 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-53082e19-728a-45e9-8a2e-1c36776f38cb tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] [instance: 9e316060-0e03-4fe1-b50e-1373af3344a2] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:28:16.280652 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-53082e19-728a-45e9-8a2e-1c36776f38cb tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:28:16.281146 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-53082e19-728a-45e9-8a2e-1c36776f38cb tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:28:16.281588 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-53082e19-728a-45e9-8a2e-1c36776f38cb tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:28:16.282311 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-53082e19-728a-45e9-8a2e-1c36776f38cb tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:28:16.282775 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-53082e19-728a-45e9-8a2e-1c36776f38cb tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:28:16.283201 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-53082e19-728a-45e9-8a2e-1c36776f38cb tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:28:16.414307 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-53082e19-728a-45e9-8a2e-1c36776f38cb tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8248e0249d7a44819194c7d9418d3587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104ea789993c43769c2c913081eced60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:28:16.421963 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-53082e19-728a-45e9-8a2e-1c36776f38cb tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] 10.222.0.33 "GET /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2" status: 200 len: 1515 microversion: 2.1 time: 0.152579 Sep 23 05:28:16.422537 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3637/7095] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:28:16 2022] GET /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2 => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:28:17.445428 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-921dcb27-76e6-486d-b323-d467f53e2e16 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:28:17.446094 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-921dcb27-76e6-486d-b323-d467f53e2e16 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] [instance: 9e316060-0e03-4fe1-b50e-1373af3344a2] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:28:17.448796 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=28 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:28:17.453553 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-921dcb27-76e6-486d-b323-d467f53e2e16 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:28:17.454094 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-921dcb27-76e6-486d-b323-d467f53e2e16 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:28:17.454559 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-921dcb27-76e6-486d-b323-d467f53e2e16 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:28:17.455757 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-921dcb27-76e6-486d-b323-d467f53e2e16 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:28:17.456237 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-921dcb27-76e6-486d-b323-d467f53e2e16 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:28:17.456679 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-921dcb27-76e6-486d-b323-d467f53e2e16 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:28:17.586537 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-921dcb27-76e6-486d-b323-d467f53e2e16 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8248e0249d7a44819194c7d9418d3587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104ea789993c43769c2c913081eced60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:28:17.594185 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-921dcb27-76e6-486d-b323-d467f53e2e16 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] 10.222.0.33 "GET /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2" status: 200 len: 1515 microversion: 2.1 time: 0.152642 Sep 23 05:28:17.594785 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3459/7096] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:28:17 2022] GET /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2 => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:28:18.618571 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-81793f57-d402-4d7f-9aec-5650aa522737 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:28:18.619198 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-81793f57-d402-4d7f-9aec-5650aa522737 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] [instance: 9e316060-0e03-4fe1-b50e-1373af3344a2] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:28:18.625724 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-81793f57-d402-4d7f-9aec-5650aa522737 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:28:18.626254 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-81793f57-d402-4d7f-9aec-5650aa522737 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:28:18.626696 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-81793f57-d402-4d7f-9aec-5650aa522737 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:28:18.627442 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-81793f57-d402-4d7f-9aec-5650aa522737 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:28:18.627904 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-81793f57-d402-4d7f-9aec-5650aa522737 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:28:18.628331 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-81793f57-d402-4d7f-9aec-5650aa522737 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:28:18.756736 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-81793f57-d402-4d7f-9aec-5650aa522737 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8248e0249d7a44819194c7d9418d3587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104ea789993c43769c2c913081eced60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:28:18.764545 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-81793f57-d402-4d7f-9aec-5650aa522737 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] 10.222.0.33 "GET /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2" status: 200 len: 1515 microversion: 2.1 time: 0.149862 Sep 23 05:28:18.765116 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3638/7097] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:28:18 2022] GET /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2 => generated 1515 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:28:19.788743 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-127e065a-2a3b-4b4d-a1e1-a6f78a4a8d3e tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:28:19.789436 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-127e065a-2a3b-4b4d-a1e1-a6f78a4a8d3e tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] [instance: 9e316060-0e03-4fe1-b50e-1373af3344a2] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:28:19.796270 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-127e065a-2a3b-4b4d-a1e1-a6f78a4a8d3e tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:28:19.796768 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-127e065a-2a3b-4b4d-a1e1-a6f78a4a8d3e tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:28:19.797221 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-127e065a-2a3b-4b4d-a1e1-a6f78a4a8d3e tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:28:19.797952 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-127e065a-2a3b-4b4d-a1e1-a6f78a4a8d3e tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:28:19.798424 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-127e065a-2a3b-4b4d-a1e1-a6f78a4a8d3e tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:28:19.798857 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-127e065a-2a3b-4b4d-a1e1-a6f78a4a8d3e tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:28:19.933175 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-127e065a-2a3b-4b4d-a1e1-a6f78a4a8d3e tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8248e0249d7a44819194c7d9418d3587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104ea789993c43769c2c913081eced60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:28:19.941675 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-127e065a-2a3b-4b4d-a1e1-a6f78a4a8d3e tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] 10.222.0.33 "GET /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2" status: 200 len: 1515 microversion: 2.1 time: 0.158033 Sep 23 05:28:19.942284 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3460/7098] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:28:19 2022] GET /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:28:20.964921 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a96b07cd-afac-493d-8136-85445938e462 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:28:20.965470 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a96b07cd-afac-493d-8136-85445938e462 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] [instance: 9e316060-0e03-4fe1-b50e-1373af3344a2] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:28:20.972145 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a96b07cd-afac-493d-8136-85445938e462 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:28:20.972650 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a96b07cd-afac-493d-8136-85445938e462 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:28:20.973098 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a96b07cd-afac-493d-8136-85445938e462 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:28:20.973802 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a96b07cd-afac-493d-8136-85445938e462 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:28:20.974293 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a96b07cd-afac-493d-8136-85445938e462 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:28:20.974728 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a96b07cd-afac-493d-8136-85445938e462 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:28:21.103616 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a96b07cd-afac-493d-8136-85445938e462 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8248e0249d7a44819194c7d9418d3587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104ea789993c43769c2c913081eced60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:28:21.112086 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a96b07cd-afac-493d-8136-85445938e462 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] 10.222.0.33 "GET /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2" status: 200 len: 1515 microversion: 2.1 time: 0.150683 Sep 23 05:28:21.112666 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3639/7099] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:28:20 2022] GET /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2 => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:28:22.140305 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-fd55a8c7-caac-4676-bf0f-234c4944a16e tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:28:22.141329 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-fd55a8c7-caac-4676-bf0f-234c4944a16e tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] [instance: 9e316060-0e03-4fe1-b50e-1373af3344a2] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:28:22.148876 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fd55a8c7-caac-4676-bf0f-234c4944a16e tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:28:22.156134 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fd55a8c7-caac-4676-bf0f-234c4944a16e tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:28:22.156134 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fd55a8c7-caac-4676-bf0f-234c4944a16e tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:28:22.156134 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fd55a8c7-caac-4676-bf0f-234c4944a16e tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:28:22.156134 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fd55a8c7-caac-4676-bf0f-234c4944a16e tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:28:22.156134 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fd55a8c7-caac-4676-bf0f-234c4944a16e tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:28:22.297134 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-fd55a8c7-caac-4676-bf0f-234c4944a16e tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8248e0249d7a44819194c7d9418d3587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104ea789993c43769c2c913081eced60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:28:22.305705 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-fd55a8c7-caac-4676-bf0f-234c4944a16e tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] 10.222.0.33 "GET /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2" status: 200 len: 1515 microversion: 2.1 time: 0.169487 Sep 23 05:28:22.306316 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3461/7100] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:28:22 2022] GET /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2 => generated 1515 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:28:23.311894 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-11192ac6-19da-4ba2-89d8-4b3002537c86 req-e29b68bc-dde5-449f-a9f7-7ba077265c24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e316060-0e03-4fe1-b50e-1373af3344a2", "name": "network-vif-unplugged", "status": "completed", "tag": "81c2ae4b-6f58-4025-8d57-b72173ca1306"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:28:23.322062 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-11192ac6-19da-4ba2-89d8-4b3002537c86 req-e29b68bc-dde5-449f-a9f7-7ba077265c24 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:28:23.322921 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-11192ac6-19da-4ba2-89d8-4b3002537c86 req-e29b68bc-dde5-449f-a9f7-7ba077265c24 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:28:23.323590 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-11192ac6-19da-4ba2-89d8-4b3002537c86 req-e29b68bc-dde5-449f-a9f7-7ba077265c24 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:28:23.335325 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b2827578-12df-41a8-af3e-631b5741219d tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:28:23.336017 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b2827578-12df-41a8-af3e-631b5741219d tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] [instance: 9e316060-0e03-4fe1-b50e-1373af3344a2] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:28:23.340347 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-11192ac6-19da-4ba2-89d8-4b3002537c86 req-e29b68bc-dde5-449f-a9f7-7ba077265c24 service nova] Creating event network-vif-unplugged:81c2ae4b-6f58-4025-8d57-b72173ca1306 for instance 9e316060-0e03-4fe1-b50e-1373af3344a2 on n-h1-846463-3 Sep 23 05:28:23.343330 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b2827578-12df-41a8-af3e-631b5741219d tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:28:23.344217 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b2827578-12df-41a8-af3e-631b5741219d tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:28:23.344790 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b2827578-12df-41a8-af3e-631b5741219d tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:28:23.346454 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b2827578-12df-41a8-af3e-631b5741219d tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:28:23.346922 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [req-11192ac6-19da-4ba2-89d8-4b3002537c86 req-e29b68bc-dde5-449f-a9f7-7ba077265c24 service nova] Instance 9e316060-0e03-4fe1-b50e-1373af3344a2 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846463-3', 'n-h2-846463-3'} {{(pid=122699) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 23 05:28:23.347062 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b2827578-12df-41a8-af3e-631b5741219d tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:28:23.347446 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b2827578-12df-41a8-af3e-631b5741219d tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:28:23.358118 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-11192ac6-19da-4ba2-89d8-4b3002537c86 req-e29b68bc-dde5-449f-a9f7-7ba077265c24 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.111780 Sep 23 05:28:23.359035 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3640/7101] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:28:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:28:23.481762 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b2827578-12df-41a8-af3e-631b5741219d tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8248e0249d7a44819194c7d9418d3587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104ea789993c43769c2c913081eced60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:28:23.489640 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b2827578-12df-41a8-af3e-631b5741219d tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] 10.222.0.33 "GET /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2" status: 200 len: 1514 microversion: 2.1 time: 0.159431 Sep 23 05:28:23.490253 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3462/7102] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:28:23 2022] GET /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2 => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:28:24.513393 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a39d5bf6-e867-4b9c-b0da-e80efe8d4da5 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:28:24.514145 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a39d5bf6-e867-4b9c-b0da-e80efe8d4da5 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] [instance: 9e316060-0e03-4fe1-b50e-1373af3344a2] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:28:24.520533 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a39d5bf6-e867-4b9c-b0da-e80efe8d4da5 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:28:24.521026 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a39d5bf6-e867-4b9c-b0da-e80efe8d4da5 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:28:24.521470 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a39d5bf6-e867-4b9c-b0da-e80efe8d4da5 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:28:24.522188 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a39d5bf6-e867-4b9c-b0da-e80efe8d4da5 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:28:24.522654 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a39d5bf6-e867-4b9c-b0da-e80efe8d4da5 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:28:24.523083 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a39d5bf6-e867-4b9c-b0da-e80efe8d4da5 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:28:24.654961 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a39d5bf6-e867-4b9c-b0da-e80efe8d4da5 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8248e0249d7a44819194c7d9418d3587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104ea789993c43769c2c913081eced60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:28:24.663201 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a39d5bf6-e867-4b9c-b0da-e80efe8d4da5 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] 10.222.0.33 "GET /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2" status: 200 len: 1512 microversion: 2.1 time: 0.154462 Sep 23 05:28:24.663770 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3641/7103] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:28:24 2022] GET /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2 => generated 1512 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:28:25.379291 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-525523b5-5475-4711-a9df-2f7a8f5412dc req-f2ba9f45-b217-46bf-8ad5-f77bb0341f30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e316060-0e03-4fe1-b50e-1373af3344a2", "tag": "81c2ae4b-6f58-4025-8d57-b72173ca1306"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:28:25.389548 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-525523b5-5475-4711-a9df-2f7a8f5412dc req-f2ba9f45-b217-46bf-8ad5-f77bb0341f30 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:28:25.390078 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-525523b5-5475-4711-a9df-2f7a8f5412dc req-f2ba9f45-b217-46bf-8ad5-f77bb0341f30 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:28:25.390526 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-525523b5-5475-4711-a9df-2f7a8f5412dc req-f2ba9f45-b217-46bf-8ad5-f77bb0341f30 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:28:25.402941 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-525523b5-5475-4711-a9df-2f7a8f5412dc req-f2ba9f45-b217-46bf-8ad5-f77bb0341f30 service nova] Creating event network-changed:81c2ae4b-6f58-4025-8d57-b72173ca1306 for instance 9e316060-0e03-4fe1-b50e-1373af3344a2 on n-h1-846463-3 Sep 23 05:28:25.408517 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [req-525523b5-5475-4711-a9df-2f7a8f5412dc req-f2ba9f45-b217-46bf-8ad5-f77bb0341f30 service nova] Instance 9e316060-0e03-4fe1-b50e-1373af3344a2 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846463-3', 'n-h2-846463-3'} {{(pid=122698) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 23 05:28:25.419493 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-525523b5-5475-4711-a9df-2f7a8f5412dc req-f2ba9f45-b217-46bf-8ad5-f77bb0341f30 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044614 Sep 23 05:28:25.420095 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3463/7104] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:28:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:28:25.686557 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0f0d6992-eaa2-43eb-a121-b14f5d0a4afd tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:28:25.687173 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-0f0d6992-eaa2-43eb-a121-b14f5d0a4afd tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] [instance: 9e316060-0e03-4fe1-b50e-1373af3344a2] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:28:25.694544 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0f0d6992-eaa2-43eb-a121-b14f5d0a4afd tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:28:25.695038 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0f0d6992-eaa2-43eb-a121-b14f5d0a4afd tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:28:25.695487 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0f0d6992-eaa2-43eb-a121-b14f5d0a4afd tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:28:25.696190 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0f0d6992-eaa2-43eb-a121-b14f5d0a4afd tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:28:25.696650 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0f0d6992-eaa2-43eb-a121-b14f5d0a4afd tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:28:25.697077 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0f0d6992-eaa2-43eb-a121-b14f5d0a4afd tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:28:25.838194 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-0f0d6992-eaa2-43eb-a121-b14f5d0a4afd tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8248e0249d7a44819194c7d9418d3587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104ea789993c43769c2c913081eced60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:28:25.840728 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0f0d6992-eaa2-43eb-a121-b14f5d0a4afd tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] 10.222.0.33 "GET /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2" status: 200 len: 1512 microversion: 2.1 time: 0.158115 Sep 23 05:28:25.841309 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3642/7105] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:28:25 2022] GET /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2 => generated 1512 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:28:26.866238 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9781f574-bc65-4fe9-81aa-0cd7d3e52ea8 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:28:26.866963 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-9781f574-bc65-4fe9-81aa-0cd7d3e52ea8 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] [instance: 9e316060-0e03-4fe1-b50e-1373af3344a2] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:28:26.873236 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9781f574-bc65-4fe9-81aa-0cd7d3e52ea8 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:28:26.873742 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9781f574-bc65-4fe9-81aa-0cd7d3e52ea8 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:28:26.874230 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9781f574-bc65-4fe9-81aa-0cd7d3e52ea8 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:28:26.874992 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9781f574-bc65-4fe9-81aa-0cd7d3e52ea8 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:28:26.875466 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9781f574-bc65-4fe9-81aa-0cd7d3e52ea8 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:28:26.875911 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9781f574-bc65-4fe9-81aa-0cd7d3e52ea8 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:28:27.004045 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-9781f574-bc65-4fe9-81aa-0cd7d3e52ea8 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8248e0249d7a44819194c7d9418d3587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104ea789993c43769c2c913081eced60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:28:27.011813 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9781f574-bc65-4fe9-81aa-0cd7d3e52ea8 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] 10.222.0.33 "GET /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2" status: 200 len: 1509 microversion: 2.1 time: 0.151370 Sep 23 05:28:27.012385 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3464/7106] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:28:26 2022] GET /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2 => generated 1509 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:28:27.034426 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7fbf9346-0bf1-4bde-b817-cb4852764e33 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:28:27.034953 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-7fbf9346-0bf1-4bde-b817-cb4852764e33 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] [instance: 9e316060-0e03-4fe1-b50e-1373af3344a2] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:28:27.041306 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7fbf9346-0bf1-4bde-b817-cb4852764e33 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:28:27.041832 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7fbf9346-0bf1-4bde-b817-cb4852764e33 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:28:27.042311 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7fbf9346-0bf1-4bde-b817-cb4852764e33 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:28:27.043010 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7fbf9346-0bf1-4bde-b817-cb4852764e33 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:28:27.043476 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7fbf9346-0bf1-4bde-b817-cb4852764e33 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:28:27.043911 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7fbf9346-0bf1-4bde-b817-cb4852764e33 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:28:27.069911 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-7fbf9346-0bf1-4bde-b817-cb4852764e33 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] [instance: 9e316060-0e03-4fe1-b50e-1373af3344a2] Going to try to terminate instance {{(pid=122699) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 05:28:27.171406 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.compute.api [None req-7fbf9346-0bf1-4bde-b817-cb4852764e33 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] [instance: 9e316060-0e03-4fe1-b50e-1373af3344a2] Found an unconfirmed migration during delete, id: 16, status: finished Sep 23 05:28:29.414473 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-7fbf9346-0bf1-4bde-b817-cb4852764e33 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2" status: 204 len: 0 microversion: 2.1 time: 2.383901 Sep 23 05:28:29.415063 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3643/7107] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 05:28:27 2022] DELETE /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2 => generated 0 bytes in 2386 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 05:28:29.424233 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-bb230c1f-b226-4d6e-ab77-1d36ca6f3203 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:28:29.424985 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-bb230c1f-b226-4d6e-ab77-1d36ca6f3203 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] [instance: 9e316060-0e03-4fe1-b50e-1373af3344a2] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:28:29.431915 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bb230c1f-b226-4d6e-ab77-1d36ca6f3203 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:28:29.435309 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bb230c1f-b226-4d6e-ab77-1d36ca6f3203 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:28:29.435309 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bb230c1f-b226-4d6e-ab77-1d36ca6f3203 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:28:29.435309 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bb230c1f-b226-4d6e-ab77-1d36ca6f3203 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:28:29.435309 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bb230c1f-b226-4d6e-ab77-1d36ca6f3203 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:28:29.435309 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bb230c1f-b226-4d6e-ab77-1d36ca6f3203 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:28:29.567951 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-bb230c1f-b226-4d6e-ab77-1d36ca6f3203 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8248e0249d7a44819194c7d9418d3587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104ea789993c43769c2c913081eced60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:28:29.578143 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-bb230c1f-b226-4d6e-ab77-1d36ca6f3203 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] 10.222.0.33 "GET /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2" status: 200 len: 1501 microversion: 2.1 time: 0.156255 Sep 23 05:28:29.578143 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3465/7108] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:28:29 2022] GET /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2 => generated 1501 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:28:29.648280 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-6d4bc501-0180-4c36-8f20-0cb6951efe0c req-355a3f88-4ed0-40dc-bff0-e842f85bd983 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e316060-0e03-4fe1-b50e-1373af3344a2", "name": "network-vif-plugged", "status": "completed", "tag": "81c2ae4b-6f58-4025-8d57-b72173ca1306"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:28:29.657821 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-6d4bc501-0180-4c36-8f20-0cb6951efe0c req-355a3f88-4ed0-40dc-bff0-e842f85bd983 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:28:29.658343 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-6d4bc501-0180-4c36-8f20-0cb6951efe0c req-355a3f88-4ed0-40dc-bff0-e842f85bd983 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:28:29.658780 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-6d4bc501-0180-4c36-8f20-0cb6951efe0c req-355a3f88-4ed0-40dc-bff0-e842f85bd983 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:28:29.669792 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-6d4bc501-0180-4c36-8f20-0cb6951efe0c req-355a3f88-4ed0-40dc-bff0-e842f85bd983 service nova] Creating event network-vif-plugged:81c2ae4b-6f58-4025-8d57-b72173ca1306 for instance 9e316060-0e03-4fe1-b50e-1373af3344a2 on n-h1-846463-3 Sep 23 05:28:29.675566 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-6d4bc501-0180-4c36-8f20-0cb6951efe0c req-355a3f88-4ed0-40dc-bff0-e842f85bd983 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095160 Sep 23 05:28:29.676194 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3644/7109] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:28:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 05:28:30.600205 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-593e2fc9-e82a-4705-b3f5-b5d854da682b tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:28:30.600736 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-593e2fc9-e82a-4705-b3f5-b5d854da682b tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] [instance: 9e316060-0e03-4fe1-b50e-1373af3344a2] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:28:30.606911 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-593e2fc9-e82a-4705-b3f5-b5d854da682b tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:28:30.607418 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-593e2fc9-e82a-4705-b3f5-b5d854da682b tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:28:30.607878 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-593e2fc9-e82a-4705-b3f5-b5d854da682b tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:28:30.608592 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-593e2fc9-e82a-4705-b3f5-b5d854da682b tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:28:30.609070 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-593e2fc9-e82a-4705-b3f5-b5d854da682b tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:28:30.609517 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-593e2fc9-e82a-4705-b3f5-b5d854da682b tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:28:30.742354 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-593e2fc9-e82a-4705-b3f5-b5d854da682b tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8248e0249d7a44819194c7d9418d3587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104ea789993c43769c2c913081eced60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:28:30.750689 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-593e2fc9-e82a-4705-b3f5-b5d854da682b tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] 10.222.0.33 "GET /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2" status: 200 len: 1501 microversion: 2.1 time: 0.154823 Sep 23 05:28:30.751289 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3466/7110] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:28:30 2022] GET /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2 => generated 1501 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:28:31.280776 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-e07ae922-5cae-4c97-818b-1bfc451ec6de req-1e0b6898-b3f0-4130-b745-dbcbec820929 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e316060-0e03-4fe1-b50e-1373af3344a2", "name": "network-vif-deleted", "tag": "81c2ae4b-6f58-4025-8d57-b72173ca1306"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:28:31.291030 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-e07ae922-5cae-4c97-818b-1bfc451ec6de req-1e0b6898-b3f0-4130-b745-dbcbec820929 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:28:31.294624 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-e07ae922-5cae-4c97-818b-1bfc451ec6de req-1e0b6898-b3f0-4130-b745-dbcbec820929 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:28:31.294624 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-e07ae922-5cae-4c97-818b-1bfc451ec6de req-1e0b6898-b3f0-4130-b745-dbcbec820929 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:28:31.303846 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-e07ae922-5cae-4c97-818b-1bfc451ec6de req-1e0b6898-b3f0-4130-b745-dbcbec820929 service nova] Creating event network-vif-deleted:81c2ae4b-6f58-4025-8d57-b72173ca1306 for instance 9e316060-0e03-4fe1-b50e-1373af3344a2 on n-h1-846463-3 Sep 23 05:28:31.308745 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-e07ae922-5cae-4c97-818b-1bfc451ec6de req-1e0b6898-b3f0-4130-b745-dbcbec820929 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033042 Sep 23 05:28:31.309490 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3645/7111] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:28:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:28:31.774946 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9656b8e6-564b-4afb-bc95-be44aa256056 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:28:31.775604 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-9656b8e6-564b-4afb-bc95-be44aa256056 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] [instance: 9e316060-0e03-4fe1-b50e-1373af3344a2] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:28:31.782462 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9656b8e6-564b-4afb-bc95-be44aa256056 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:28:31.782991 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9656b8e6-564b-4afb-bc95-be44aa256056 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:28:31.783446 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9656b8e6-564b-4afb-bc95-be44aa256056 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:28:31.784153 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9656b8e6-564b-4afb-bc95-be44aa256056 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:28:31.784628 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9656b8e6-564b-4afb-bc95-be44aa256056 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:28:31.785071 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9656b8e6-564b-4afb-bc95-be44aa256056 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:28:31.816218 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9656b8e6-564b-4afb-bc95-be44aa256056 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:28:31.816713 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9656b8e6-564b-4afb-bc95-be44aa256056 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:28:31.817169 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9656b8e6-564b-4afb-bc95-be44aa256056 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:28:31.817636 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-9656b8e6-564b-4afb-bc95-be44aa256056 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lazy-loading 'fault' on Instance uuid 9e316060-0e03-4fe1-b50e-1373af3344a2 {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 05:28:31.857047 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-9656b8e6-564b-4afb-bc95-be44aa256056 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8248e0249d7a44819194c7d9418d3587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104ea789993c43769c2c913081eced60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:28:31.865712 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9656b8e6-564b-4afb-bc95-be44aa256056 tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] 10.222.0.33 "GET /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2" status: 200 len: 1303 microversion: 2.1 time: 0.094670 Sep 23 05:28:31.866335 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3467/7112] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:28:31 2022] GET /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2 => generated 1303 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:28:32.890987 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-97f3a542-6efd-4c53-b096-cb7da7c4e96d tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:28:32.891737 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-97f3a542-6efd-4c53-b096-cb7da7c4e96d tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] [instance: 9e316060-0e03-4fe1-b50e-1373af3344a2] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:28:32.898137 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-97f3a542-6efd-4c53-b096-cb7da7c4e96d tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:28:32.898652 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-97f3a542-6efd-4c53-b096-cb7da7c4e96d tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:28:32.899080 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-97f3a542-6efd-4c53-b096-cb7da7c4e96d tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:28:32.899841 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-97f3a542-6efd-4c53-b096-cb7da7c4e96d tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:28:32.900300 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-97f3a542-6efd-4c53-b096-cb7da7c4e96d tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:28:32.900728 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-97f3a542-6efd-4c53-b096-cb7da7c4e96d tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:28:32.914443 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-97f3a542-6efd-4c53-b096-cb7da7c4e96d tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] HTTP exception thrown: Instance 9e316060-0e03-4fe1-b50e-1373af3344a2 could not be found. Sep 23 05:28:32.916073 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-97f3a542-6efd-4c53-b096-cb7da7c4e96d tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Request method failure captured: Sep 23 05:28:32.916073 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2 HTTP/1.1 Sep 23 05:28:32.916073 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 05:28:32.916073 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 05:28:32.916073 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 05:28:32.916073 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 05:28:32.916073 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 05:28:32.916073 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 05:28:32.916073 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 05:28:32.916073 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 05:28:32.916073 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLUPF_XCj4n_y_XCrx4ePqhrn1BPZ7D0DvDyVIBvqSE3WFmuWAke-RS_6gpfttwpisTINbH7HROVF1sbyFeXsSyc4J3qrrM0f0MYcqD5uCm_WzYnVYwOloDWjWrPE5tywxF2XYy084Aa7pKoJ0Hm4uXbvlADBGEtHDAdM73F2U3U2NCs Sep 23 05:28:32.916073 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 05:28:32.916073 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 05:28:32.916073 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 05:28:32.916073 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 05:28:32.916073 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 05:28:32.916073 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 05:28:32.916073 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 104ea789993c43769c2c913081eced60 Sep 23 05:28:32.916073 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-DeleteServersTestJSON-1048693038 Sep 23 05:28:32.916073 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 05:28:32.916073 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 05:28:32.916073 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_104ea789993c43769c2c913081eced60", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/104ea789993c43769c2c913081eced60"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/104ea789993c43769c2c913081eced60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/104ea789993c43769c2c913081eced60"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:28:32.916073 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-DeleteServersTestJSON-1048693038 Sep 23 05:28:32.916073 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 104ea789993c43769c2c913081eced60 Sep 23 05:28:32.916073 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-DeleteServersTestJSON-1048693038 Sep 23 05:28:32.916073 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-DeleteServersTestJSON-1048693038-project Sep 23 05:28:32.916073 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 05:28:32.916073 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 05:28:32.916073 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 8248e0249d7a44819194c7d9418d3587 Sep 23 05:28:32.916073 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-DeleteServersTestJSON-1048693038-project Sep 23 05:28:32.916073 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 05:28:32.916073 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 9e316060-0e03-4fe1-b50e-1373af3344a2 could not be found. Sep 23 05:28:32.916073 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '9e316060-0e03-4fe1-b50e-1373af3344a2'} Sep 23 05:28:32.916073 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:28:32.916073 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:28:32.916073 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 05:28:32.916073 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 05:28:32.916073 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 05:28:32.916073 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 05:28:32.916073 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 05:28:32.916073 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 05:28:32.916073 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 05:28:32.916073 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 05:28:32.916073 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e316060-0e03-4fe1-b50e-1373af3344a2 could not be found. Sep 23 05:28:32.916073 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:28:32.916073 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:28:32.916073 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:28:32.916073 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:28:32.916073 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:28:32.916073 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:28:32.916073 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:28:32.916073 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:28:32.916073 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:28:32.916073 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:28:32.916073 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 05:28:32.916073 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 05:28:32.916073 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 05:28:32.916073 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 05:28:32.916073 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 05:28:32.916073 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:28:32.916073 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e316060-0e03-4fe1-b50e-1373af3344a2 could not be found. Sep 23 05:28:32.916073 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:28:32.916073 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:28:32.916073 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:28:32.921006 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:28:32.921006 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:28:32.921006 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:28:32.921006 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:28:32.921006 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:28:32.921006 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e316060-0e03-4fe1-b50e-1373af3344a2 could not be found. Sep 23 05:28:32.921006 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:28:32.921006 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-97f3a542-6efd-4c53-b096-cb7da7c4e96d tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Returning 404 to user: Instance 9e316060-0e03-4fe1-b50e-1373af3344a2 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:28:32.921006 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-97f3a542-6efd-4c53-b096-cb7da7c4e96d tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] 10.222.0.33 "GET /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2" status: 404 len: 111 microversion: 2.1 time: 0.031606 Sep 23 05:28:32.921006 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3646/7113] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:28:32 2022] GET /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 05:28:32.935317 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4ab40510-6bee-49e0-91ec-bd3924dfd35f tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:28:32.939908 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4ab40510-6bee-49e0-91ec-bd3924dfd35f tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] [instance: 9e316060-0e03-4fe1-b50e-1373af3344a2] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:28:32.942996 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4ab40510-6bee-49e0-91ec-bd3924dfd35f tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:28:32.943553 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4ab40510-6bee-49e0-91ec-bd3924dfd35f tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:28:32.944016 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4ab40510-6bee-49e0-91ec-bd3924dfd35f tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:28:32.944736 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4ab40510-6bee-49e0-91ec-bd3924dfd35f tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:28:32.945219 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4ab40510-6bee-49e0-91ec-bd3924dfd35f tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:28:32.945710 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4ab40510-6bee-49e0-91ec-bd3924dfd35f tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:28:32.959179 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-4ab40510-6bee-49e0-91ec-bd3924dfd35f tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] HTTP exception thrown: Instance 9e316060-0e03-4fe1-b50e-1373af3344a2 could not be found. Sep 23 05:28:32.960882 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4ab40510-6bee-49e0-91ec-bd3924dfd35f tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Request method failure captured: Sep 23 05:28:32.960882 n-d-846463-3 devstack@n-api.service[122698]: request: DELETE /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2 HTTP/1.1 Sep 23 05:28:32.960882 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 05:28:32.960882 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 05:28:32.960882 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 05:28:32.960882 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 05:28:32.960882 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 05:28:32.960882 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 05:28:32.960882 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 05:28:32.960882 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 05:28:32.960882 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLUPF_XCj4n_y_XCrx4ePqhrn1BPZ7D0DvDyVIBvqSE3WFmuWAke-RS_6gpfttwpisTINbH7HROVF1sbyFeXsSyc4J3qrrM0f0MYcqD5uCm_WzYnVYwOloDWjWrPE5tywxF2XYy084Aa7pKoJ0Hm4uXbvlADBGEtHDAdM73F2U3U2NCs Sep 23 05:28:32.960882 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 05:28:32.960882 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 05:28:32.960882 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 05:28:32.960882 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 05:28:32.960882 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 05:28:32.960882 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 05:28:32.960882 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 104ea789993c43769c2c913081eced60 Sep 23 05:28:32.960882 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-DeleteServersTestJSON-1048693038 Sep 23 05:28:32.960882 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 05:28:32.960882 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 05:28:32.960882 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_104ea789993c43769c2c913081eced60", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/104ea789993c43769c2c913081eced60"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/104ea789993c43769c2c913081eced60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/104ea789993c43769c2c913081eced60"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:28:32.960882 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-DeleteServersTestJSON-1048693038 Sep 23 05:28:32.960882 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 104ea789993c43769c2c913081eced60 Sep 23 05:28:32.960882 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-DeleteServersTestJSON-1048693038 Sep 23 05:28:32.960882 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-DeleteServersTestJSON-1048693038-project Sep 23 05:28:32.960882 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 05:28:32.960882 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 05:28:32.960882 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 8248e0249d7a44819194c7d9418d3587 Sep 23 05:28:32.960882 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-DeleteServersTestJSON-1048693038-project Sep 23 05:28:32.960882 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 05:28:32.960882 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 9e316060-0e03-4fe1-b50e-1373af3344a2 could not be found. Sep 23 05:28:32.960882 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '9e316060-0e03-4fe1-b50e-1373af3344a2'} Sep 23 05:28:32.960882 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:28:32.960882 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:28:32.960882 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 05:28:32.960882 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 05:28:32.960882 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 05:28:32.960882 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 05:28:32.960882 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 05:28:32.960882 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 05:28:32.960882 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 05:28:32.960882 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 05:28:32.960882 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e316060-0e03-4fe1-b50e-1373af3344a2 could not be found. Sep 23 05:28:32.960882 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:28:32.960882 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:28:32.960882 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:28:32.960882 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:28:32.960882 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:28:32.960882 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:28:32.960882 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:28:32.960882 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:28:32.960882 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:28:32.960882 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:28:32.960882 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 05:28:32.960882 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 05:28:32.960882 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 05:28:32.960882 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 05:28:32.960882 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 05:28:32.960882 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 05:28:32.960882 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 05:28:32.960882 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:28:32.965848 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e316060-0e03-4fe1-b50e-1373af3344a2 could not be found. Sep 23 05:28:32.965848 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:28:32.965848 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:28:32.965848 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:28:32.965848 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:28:32.965848 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:28:32.965848 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:28:32.965848 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:28:32.965848 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:28:32.965848 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e316060-0e03-4fe1-b50e-1373af3344a2 could not be found. Sep 23 05:28:32.965848 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:28:32.965848 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4ab40510-6bee-49e0-91ec-bd3924dfd35f tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Returning 404 to user: Instance 9e316060-0e03-4fe1-b50e-1373af3344a2 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:28:32.965848 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4ab40510-6bee-49e0-91ec-bd3924dfd35f tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2" status: 404 len: 111 microversion: 2.1 time: 0.031015 Sep 23 05:28:32.965848 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3468/7114] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 05:28:32 2022] DELETE /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 05:28:32.970646 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9943a148-fd33-4f38-b5bf-f6f0f62fac5d tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:28:32.971271 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-9943a148-fd33-4f38-b5bf-f6f0f62fac5d tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] [instance: 9e316060-0e03-4fe1-b50e-1373af3344a2] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:28:32.977686 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9943a148-fd33-4f38-b5bf-f6f0f62fac5d tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:28:32.978240 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9943a148-fd33-4f38-b5bf-f6f0f62fac5d tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:28:32.978661 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9943a148-fd33-4f38-b5bf-f6f0f62fac5d tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:28:32.979356 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9943a148-fd33-4f38-b5bf-f6f0f62fac5d tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:28:32.979819 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9943a148-fd33-4f38-b5bf-f6f0f62fac5d tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:28:32.980252 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9943a148-fd33-4f38-b5bf-f6f0f62fac5d tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:28:32.996631 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-9943a148-fd33-4f38-b5bf-f6f0f62fac5d tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] HTTP exception thrown: Instance 9e316060-0e03-4fe1-b50e-1373af3344a2 could not be found. Sep 23 05:28:32.998191 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9943a148-fd33-4f38-b5bf-f6f0f62fac5d tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Request method failure captured: Sep 23 05:28:32.998191 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2 HTTP/1.1 Sep 23 05:28:32.998191 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 05:28:32.998191 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 05:28:32.998191 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 05:28:32.998191 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 05:28:32.998191 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 05:28:32.998191 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 05:28:32.998191 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 05:28:32.998191 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 05:28:32.998191 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLUPF_XCj4n_y_XCrx4ePqhrn1BPZ7D0DvDyVIBvqSE3WFmuWAke-RS_6gpfttwpisTINbH7HROVF1sbyFeXsSyc4J3qrrM0f0MYcqD5uCm_WzYnVYwOloDWjWrPE5tywxF2XYy084Aa7pKoJ0Hm4uXbvlADBGEtHDAdM73F2U3U2NCs Sep 23 05:28:32.998191 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 05:28:32.998191 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 05:28:32.998191 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 05:28:32.998191 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 05:28:32.998191 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 05:28:32.998191 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 05:28:32.998191 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 104ea789993c43769c2c913081eced60 Sep 23 05:28:32.998191 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-DeleteServersTestJSON-1048693038 Sep 23 05:28:32.998191 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 05:28:32.998191 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 05:28:32.998191 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_104ea789993c43769c2c913081eced60", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/104ea789993c43769c2c913081eced60"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/104ea789993c43769c2c913081eced60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/104ea789993c43769c2c913081eced60"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:28:32.998191 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-DeleteServersTestJSON-1048693038 Sep 23 05:28:32.998191 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 104ea789993c43769c2c913081eced60 Sep 23 05:28:32.998191 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-DeleteServersTestJSON-1048693038 Sep 23 05:28:32.998191 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-DeleteServersTestJSON-1048693038-project Sep 23 05:28:32.998191 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 05:28:32.998191 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 05:28:32.998191 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 8248e0249d7a44819194c7d9418d3587 Sep 23 05:28:32.998191 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-DeleteServersTestJSON-1048693038-project Sep 23 05:28:32.998191 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 05:28:32.998191 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 9e316060-0e03-4fe1-b50e-1373af3344a2 could not be found. Sep 23 05:28:32.998191 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '9e316060-0e03-4fe1-b50e-1373af3344a2'} Sep 23 05:28:32.998191 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:28:32.998191 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:28:32.998191 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 05:28:32.998191 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 05:28:32.998191 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 05:28:32.998191 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 05:28:32.998191 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 05:28:32.998191 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 05:28:32.998191 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 05:28:32.998191 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 05:28:32.998191 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e316060-0e03-4fe1-b50e-1373af3344a2 could not be found. Sep 23 05:28:32.998191 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:28:32.998191 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:28:32.998191 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:28:32.998191 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:28:32.998191 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:28:32.998191 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:28:32.998191 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:28:32.998191 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:28:32.998191 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:28:32.998191 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:28:32.998191 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 05:28:32.998191 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 05:28:32.998191 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 05:28:32.998191 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 05:28:32.998191 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 05:28:32.998191 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:28:32.998191 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e316060-0e03-4fe1-b50e-1373af3344a2 could not be found. Sep 23 05:28:32.998191 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:28:32.998191 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:28:32.998191 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:28:33.002785 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:28:33.002785 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:28:33.002785 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:28:33.002785 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:28:33.002785 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:28:33.002785 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e316060-0e03-4fe1-b50e-1373af3344a2 could not be found. Sep 23 05:28:33.002785 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:28:33.002785 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9943a148-fd33-4f38-b5bf-f6f0f62fac5d tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] Returning 404 to user: Instance 9e316060-0e03-4fe1-b50e-1373af3344a2 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:28:33.002785 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-9943a148-fd33-4f38-b5bf-f6f0f62fac5d tempest-DeleteServersTestJSON-1048693038 tempest-DeleteServersTestJSON-1048693038-project] 10.222.0.33 "GET /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2" status: 404 len: 111 microversion: 2.1 time: 0.032687 Sep 23 05:28:33.002785 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3647/7115] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:28:32 2022] GET /compute/v2.1/servers/9e316060-0e03-4fe1-b50e-1373af3344a2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 05:28:43.835313 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=21 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:28:43.836269 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=79 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:28:43.959150 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4a06f3f3-9dad-45db-8330-759f8dbe00bb tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-866578273", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "networks": [{"uuid": "2341cdaf-e95f-4c41-aba4-9ed974187f59"}]}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:28:44.016056 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.network.neutron [None req-4a06f3f3-9dad-45db-8330-759f8dbe00bb tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] validate_networks() for [('2341cdaf-e95f-4c41-aba4-9ed974187f59', None, None, None, None, None)] {{(pid=122698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 05:28:44.393244 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-4a06f3f3-9dad-45db-8330-759f8dbe00bb tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Flavor limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 05:28:44.393688 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-4a06f3f3-9dad-45db-8330-759f8dbe00bb tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Image limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 05:28:44.394218 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-4a06f3f3-9dad-45db-8330-759f8dbe00bb tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Flavor pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 05:28:44.394655 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-4a06f3f3-9dad-45db-8330-759f8dbe00bb tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Image pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 05:28:44.395104 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-4a06f3f3-9dad-45db-8330-759f8dbe00bb tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 05:28:44.404291 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4a06f3f3-9dad-45db-8330-759f8dbe00bb tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:28:44.404799 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4a06f3f3-9dad-45db-8330-759f8dbe00bb tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:28:44.405255 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4a06f3f3-9dad-45db-8330-759f8dbe00bb tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:28:44.406150 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4a06f3f3-9dad-45db-8330-759f8dbe00bb tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:28:44.406699 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4a06f3f3-9dad-45db-8330-759f8dbe00bb tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:28:44.407151 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4a06f3f3-9dad-45db-8330-759f8dbe00bb tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:28:44.424488 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-4a06f3f3-9dad-45db-8330-759f8dbe00bb tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Getting quotas for project 353a08b792f7473fa857996c3214c8ce. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 05:28:44.429788 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-4a06f3f3-9dad-45db-8330-759f8dbe00bb tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Getting quotas for user 71fcf3e705ed4f539b04b3606703c610 and project 353a08b792f7473fa857996c3214c8ce. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 05:28:44.443757 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4a06f3f3-9dad-45db-8330-759f8dbe00bb tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Going to run 1 instances... {{(pid=122698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 05:28:44.446162 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4a06f3f3-9dad-45db-8330-759f8dbe00bb tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: 5fb4a959-b664-485a-aa90-7f3e741ad5d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 05:28:44.605274 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4a06f3f3-9dad-45db-8330-759f8dbe00bb tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.776479 Sep 23 05:28:44.606113 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3469/7116] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 05:28:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 778 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 05:28:44.617588 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-296f6fd0-8fff-4c98-8b85-e67e2abf0a59 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:28:44.620123 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-296f6fd0-8fff-4c98-8b85-e67e2abf0a59 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: 5fb4a959-b664-485a-aa90-7f3e741ad5d3] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:28:44.628110 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:28:44.629390 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:28:44.701488 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-296f6fd0-8fff-4c98-8b85-e67e2abf0a59 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:28:44.709678 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-296f6fd0-8fff-4c98-8b85-e67e2abf0a59 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3" status: 200 len: 1217 microversion: 2.1 time: 0.095743 Sep 23 05:28:44.722346 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3648/7117] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:28:44 2022] GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3 => generated 1217 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:28:45.734537 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7478c137-c972-4e3f-ba79-2057d4d596db tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:28:45.735766 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7478c137-c972-4e3f-ba79-2057d4d596db tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: 5fb4a959-b664-485a-aa90-7f3e741ad5d3] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:28:45.744609 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7478c137-c972-4e3f-ba79-2057d4d596db tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:28:45.746910 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7478c137-c972-4e3f-ba79-2057d4d596db tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:28:45.746910 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7478c137-c972-4e3f-ba79-2057d4d596db tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:28:45.746910 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7478c137-c972-4e3f-ba79-2057d4d596db tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:28:45.746910 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7478c137-c972-4e3f-ba79-2057d4d596db tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:28:45.747318 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7478c137-c972-4e3f-ba79-2057d4d596db tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:28:45.811382 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-7478c137-c972-4e3f-ba79-2057d4d596db tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:28:45.820285 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7478c137-c972-4e3f-ba79-2057d4d596db tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3" status: 200 len: 1221 microversion: 2.1 time: 0.091428 Sep 23 05:28:45.820886 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3470/7118] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:28:45 2022] GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3 => generated 1221 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:28:46.843987 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-278dbc83-9607-4da5-bb07-f6042bd68bbb tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:28:46.851396 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-278dbc83-9607-4da5-bb07-f6042bd68bbb tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: 5fb4a959-b664-485a-aa90-7f3e741ad5d3] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:28:46.865043 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-278dbc83-9607-4da5-bb07-f6042bd68bbb tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:28:46.865543 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-278dbc83-9607-4da5-bb07-f6042bd68bbb tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:28:46.872311 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-278dbc83-9607-4da5-bb07-f6042bd68bbb tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:28:46.873258 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-278dbc83-9607-4da5-bb07-f6042bd68bbb tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:28:46.874230 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-278dbc83-9607-4da5-bb07-f6042bd68bbb tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:28:46.874765 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-278dbc83-9607-4da5-bb07-f6042bd68bbb tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:28:46.972359 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-278dbc83-9607-4da5-bb07-f6042bd68bbb tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:28:46.985189 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-278dbc83-9607-4da5-bb07-f6042bd68bbb tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3" status: 200 len: 1277 microversion: 2.1 time: 0.144915 Sep 23 05:28:46.987406 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3649/7119] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:28:46 2022] GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3 => generated 1277 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:28:48.010160 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-71705b3e-5588-4b32-b0f1-58f0d633a442 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:28:48.010741 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-71705b3e-5588-4b32-b0f1-58f0d633a442 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: 5fb4a959-b664-485a-aa90-7f3e741ad5d3] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:28:48.018649 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-71705b3e-5588-4b32-b0f1-58f0d633a442 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:28:48.019187 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-71705b3e-5588-4b32-b0f1-58f0d633a442 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:28:48.019653 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-71705b3e-5588-4b32-b0f1-58f0d633a442 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:28:48.020384 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-71705b3e-5588-4b32-b0f1-58f0d633a442 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:28:48.020866 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-71705b3e-5588-4b32-b0f1-58f0d633a442 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:28:48.021320 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-71705b3e-5588-4b32-b0f1-58f0d633a442 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:28:48.218460 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-71705b3e-5588-4b32-b0f1-58f0d633a442 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:28:48.226367 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-71705b3e-5588-4b32-b0f1-58f0d633a442 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3" status: 200 len: 1317 microversion: 2.1 time: 0.220268 Sep 23 05:28:48.230620 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3471/7120] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:28:48 2022] GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3 => generated 1317 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:28:48.621239 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-5b26c38c-8bdf-4bc1-aadf-0449215f084e req-d9059953-fc64-4e37-b429-7bedb68e3ded service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fb4a959-b664-485a-aa90-7f3e741ad5d3", "tag": "c597fdad-e003-4548-914f-20801a0ecbf8"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:28:48.628337 n-d-846463-3 devstack@n-api.service[122699]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 05:28:48.628995 n-d-846463-3 devstack@n-api.service[122699]: Fri Sep 23 05:28:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.33) !!! Sep 23 05:28:48.638688 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-5b26c38c-8bdf-4bc1-aadf-0449215f084e req-d9059953-fc64-4e37-b429-7bedb68e3ded service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:28:48.639176 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-5b26c38c-8bdf-4bc1-aadf-0449215f084e req-d9059953-fc64-4e37-b429-7bedb68e3ded service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:28:48.639610 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-5b26c38c-8bdf-4bc1-aadf-0449215f084e req-d9059953-fc64-4e37-b429-7bedb68e3ded service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:28:48.651723 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-5b26c38c-8bdf-4bc1-aadf-0449215f084e req-d9059953-fc64-4e37-b429-7bedb68e3ded service nova] Creating event network-changed:c597fdad-e003-4548-914f-20801a0ecbf8 for instance 5fb4a959-b664-485a-aa90-7f3e741ad5d3 on n-h2-846463-3 Sep 23 05:28:48.657157 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-5b26c38c-8bdf-4bc1-aadf-0449215f084e req-d9059953-fc64-4e37-b429-7bedb68e3ded service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039846 Sep 23 05:28:48.657755 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3650/7121] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:28:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:28:49.250255 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-681edf92-cee7-451d-8c1f-5e1b80e655d9 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:28:49.251063 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-681edf92-cee7-451d-8c1f-5e1b80e655d9 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: 5fb4a959-b664-485a-aa90-7f3e741ad5d3] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:28:49.259292 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-681edf92-cee7-451d-8c1f-5e1b80e655d9 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:28:49.259860 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-681edf92-cee7-451d-8c1f-5e1b80e655d9 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:28:49.260319 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-681edf92-cee7-451d-8c1f-5e1b80e655d9 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:28:49.261068 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-681edf92-cee7-451d-8c1f-5e1b80e655d9 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:28:49.261539 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-681edf92-cee7-451d-8c1f-5e1b80e655d9 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:28:49.262042 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-681edf92-cee7-451d-8c1f-5e1b80e655d9 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:28:49.394599 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-681edf92-cee7-451d-8c1f-5e1b80e655d9 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:28:49.402756 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-681edf92-cee7-451d-8c1f-5e1b80e655d9 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3" status: 200 len: 1317 microversion: 2.1 time: 0.156373 Sep 23 05:28:49.403339 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3472/7122] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:28:49 2022] GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:28:50.427242 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-43bb08bc-cf17-4700-a06b-eb8512b0de61 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:28:50.427869 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-43bb08bc-cf17-4700-a06b-eb8512b0de61 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: 5fb4a959-b664-485a-aa90-7f3e741ad5d3] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:28:50.434117 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-43bb08bc-cf17-4700-a06b-eb8512b0de61 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:28:50.434613 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-43bb08bc-cf17-4700-a06b-eb8512b0de61 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:28:50.435061 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-43bb08bc-cf17-4700-a06b-eb8512b0de61 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:28:50.435760 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-43bb08bc-cf17-4700-a06b-eb8512b0de61 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:28:50.436226 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-43bb08bc-cf17-4700-a06b-eb8512b0de61 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:28:50.436655 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-43bb08bc-cf17-4700-a06b-eb8512b0de61 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:28:50.691294 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-43bb08bc-cf17-4700-a06b-eb8512b0de61 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:28:50.699048 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-43bb08bc-cf17-4700-a06b-eb8512b0de61 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3" status: 200 len: 1317 microversion: 2.1 time: 0.277278 Sep 23 05:28:50.699622 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3651/7123] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:28:50 2022] GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3 => generated 1317 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:28:51.721881 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-07579db1-00b7-400b-83d1-47c8a59d54ed tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:28:51.722547 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-07579db1-00b7-400b-83d1-47c8a59d54ed tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: 5fb4a959-b664-485a-aa90-7f3e741ad5d3] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:28:51.729399 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-07579db1-00b7-400b-83d1-47c8a59d54ed tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:28:51.732030 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-07579db1-00b7-400b-83d1-47c8a59d54ed tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:28:51.732030 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-07579db1-00b7-400b-83d1-47c8a59d54ed tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:28:51.732030 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-07579db1-00b7-400b-83d1-47c8a59d54ed tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:28:51.732030 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-07579db1-00b7-400b-83d1-47c8a59d54ed tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:28:51.732030 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-07579db1-00b7-400b-83d1-47c8a59d54ed tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:28:51.863180 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-07579db1-00b7-400b-83d1-47c8a59d54ed tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:28:51.870972 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-07579db1-00b7-400b-83d1-47c8a59d54ed tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3" status: 200 len: 1317 microversion: 2.1 time: 0.153087 Sep 23 05:28:51.871658 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3473/7124] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:28:51 2022] GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3 => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:28:52.895112 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-784aecfb-e29b-4992-ac1c-da59e5b92de3 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:28:52.896378 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-784aecfb-e29b-4992-ac1c-da59e5b92de3 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: 5fb4a959-b664-485a-aa90-7f3e741ad5d3] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:28:52.902896 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-784aecfb-e29b-4992-ac1c-da59e5b92de3 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:28:52.903434 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-784aecfb-e29b-4992-ac1c-da59e5b92de3 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:28:52.904656 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-784aecfb-e29b-4992-ac1c-da59e5b92de3 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:28:52.904656 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-784aecfb-e29b-4992-ac1c-da59e5b92de3 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:28:52.905153 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-784aecfb-e29b-4992-ac1c-da59e5b92de3 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:28:52.905584 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-784aecfb-e29b-4992-ac1c-da59e5b92de3 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:28:53.039349 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-784aecfb-e29b-4992-ac1c-da59e5b92de3 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:28:53.047085 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-784aecfb-e29b-4992-ac1c-da59e5b92de3 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3" status: 200 len: 1317 microversion: 2.1 time: 0.156963 Sep 23 05:28:53.047974 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3652/7125] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:28:52 2022] GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:28:54.069867 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b4220059-e606-482a-a13b-bcff6850e45a tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:28:54.070527 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b4220059-e606-482a-a13b-bcff6850e45a tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: 5fb4a959-b664-485a-aa90-7f3e741ad5d3] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:28:54.077486 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b4220059-e606-482a-a13b-bcff6850e45a tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:28:54.078055 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b4220059-e606-482a-a13b-bcff6850e45a tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:28:54.078520 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b4220059-e606-482a-a13b-bcff6850e45a tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:28:54.079245 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b4220059-e606-482a-a13b-bcff6850e45a tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:28:54.079723 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b4220059-e606-482a-a13b-bcff6850e45a tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:28:54.080707 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b4220059-e606-482a-a13b-bcff6850e45a tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:28:54.297655 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b4220059-e606-482a-a13b-bcff6850e45a tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:28:54.305466 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b4220059-e606-482a-a13b-bcff6850e45a tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3" status: 200 len: 1317 microversion: 2.1 time: 0.239578 Sep 23 05:28:54.306076 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3474/7126] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:28:54 2022] GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3 => generated 1317 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:28:54.643397 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-e890c804-31bd-4eb5-a745-11a9c2a3697d req-6cd3bb54-49d2-40b4-8d8b-cf720510da92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fb4a959-b664-485a-aa90-7f3e741ad5d3", "name": "network-vif-plugged", "status": "completed", "tag": "c597fdad-e003-4548-914f-20801a0ecbf8"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:28:54.653235 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-e890c804-31bd-4eb5-a745-11a9c2a3697d req-6cd3bb54-49d2-40b4-8d8b-cf720510da92 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:28:54.653721 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-e890c804-31bd-4eb5-a745-11a9c2a3697d req-6cd3bb54-49d2-40b4-8d8b-cf720510da92 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:28:54.654183 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-e890c804-31bd-4eb5-a745-11a9c2a3697d req-6cd3bb54-49d2-40b4-8d8b-cf720510da92 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:28:54.664924 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-e890c804-31bd-4eb5-a745-11a9c2a3697d req-6cd3bb54-49d2-40b4-8d8b-cf720510da92 service nova] Creating event network-vif-plugged:c597fdad-e003-4548-914f-20801a0ecbf8 for instance 5fb4a959-b664-485a-aa90-7f3e741ad5d3 on n-h2-846463-3 Sep 23 05:28:54.669843 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-e890c804-31bd-4eb5-a745-11a9c2a3697d req-6cd3bb54-49d2-40b4-8d8b-cf720510da92 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031043 Sep 23 05:28:54.670457 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3653/7127] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:28:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:28:55.328459 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2ac310c7-6780-46c6-a526-196619157bef tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:28:55.329094 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-2ac310c7-6780-46c6-a526-196619157bef tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: 5fb4a959-b664-485a-aa90-7f3e741ad5d3] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:28:55.331656 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:28:55.332523 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=6 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:28:55.338037 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2ac310c7-6780-46c6-a526-196619157bef tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:28:55.338548 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2ac310c7-6780-46c6-a526-196619157bef tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:28:55.339007 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2ac310c7-6780-46c6-a526-196619157bef tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:28:55.339723 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2ac310c7-6780-46c6-a526-196619157bef tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:28:55.340209 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2ac310c7-6780-46c6-a526-196619157bef tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:28:55.340645 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2ac310c7-6780-46c6-a526-196619157bef tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:28:55.471479 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-2ac310c7-6780-46c6-a526-196619157bef tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:28:55.479335 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2ac310c7-6780-46c6-a526-196619157bef tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3" status: 200 len: 1317 microversion: 2.1 time: 0.154812 Sep 23 05:28:55.479903 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3475/7128] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:28:55 2022] GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:28:56.500428 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:28:56.505066 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-24877211-9fb7-4a8b-b08f-db50d4defc5a tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:28:56.506775 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-24877211-9fb7-4a8b-b08f-db50d4defc5a tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: 5fb4a959-b664-485a-aa90-7f3e741ad5d3] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:28:56.511997 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-24877211-9fb7-4a8b-b08f-db50d4defc5a tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:28:56.512491 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-24877211-9fb7-4a8b-b08f-db50d4defc5a tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:28:56.512962 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-24877211-9fb7-4a8b-b08f-db50d4defc5a tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:28:56.513638 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-24877211-9fb7-4a8b-b08f-db50d4defc5a tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:28:56.514133 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-24877211-9fb7-4a8b-b08f-db50d4defc5a tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:28:56.514574 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-24877211-9fb7-4a8b-b08f-db50d4defc5a tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:28:56.651428 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-24877211-9fb7-4a8b-b08f-db50d4defc5a tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:28:56.659944 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-24877211-9fb7-4a8b-b08f-db50d4defc5a tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3" status: 200 len: 1507 microversion: 2.1 time: 0.160470 Sep 23 05:28:56.660514 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3654/7129] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:28:56 2022] GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3 => generated 1507 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:28:56.681987 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d1f0af30-3e34-4b2a-9239-66c76386d567 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:28:56.682630 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d1f0af30-3e34-4b2a-9239-66c76386d567 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: 5fb4a959-b664-485a-aa90-7f3e741ad5d3] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:28:56.690188 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d1f0af30-3e34-4b2a-9239-66c76386d567 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:28:56.690713 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d1f0af30-3e34-4b2a-9239-66c76386d567 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:28:56.691174 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d1f0af30-3e34-4b2a-9239-66c76386d567 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:28:56.691951 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d1f0af30-3e34-4b2a-9239-66c76386d567 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:28:56.692432 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d1f0af30-3e34-4b2a-9239-66c76386d567 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:28:56.692882 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d1f0af30-3e34-4b2a-9239-66c76386d567 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:28:56.820931 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d1f0af30-3e34-4b2a-9239-66c76386d567 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:28:56.828863 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d1f0af30-3e34-4b2a-9239-66c76386d567 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3" status: 200 len: 1507 microversion: 2.1 time: 0.150886 Sep 23 05:28:56.829451 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3476/7130] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:28:56 2022] GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3 => generated 1507 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:28:56.852454 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3d34fdc6-816c-45ef-9304-db7437c5f901 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:28:56.856483 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-3d34fdc6-816c-45ef-9304-db7437c5f901 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: 5fb4a959-b664-485a-aa90-7f3e741ad5d3] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:28:56.863148 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3d34fdc6-816c-45ef-9304-db7437c5f901 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:28:56.863647 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3d34fdc6-816c-45ef-9304-db7437c5f901 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:28:56.864092 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3d34fdc6-816c-45ef-9304-db7437c5f901 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:28:56.864799 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3d34fdc6-816c-45ef-9304-db7437c5f901 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:28:56.865264 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3d34fdc6-816c-45ef-9304-db7437c5f901 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:28:56.865699 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3d34fdc6-816c-45ef-9304-db7437c5f901 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:28:57.006685 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3d34fdc6-816c-45ef-9304-db7437c5f901 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "PUT /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3" status: 200 len: 1079 microversion: 2.1 time: 0.158581 Sep 23 05:28:57.007335 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3655/7131] 10.222.0.33 () {60 vars in 1256 bytes} [Fri Sep 23 05:28:56 2022] PUT /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3 => generated 1079 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:28:57.026785 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-dca95eae-c3d5-4058-a161-39704a2f1386 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:28:57.027409 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-dca95eae-c3d5-4058-a161-39704a2f1386 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: 5fb4a959-b664-485a-aa90-7f3e741ad5d3] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:28:57.033865 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dca95eae-c3d5-4058-a161-39704a2f1386 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:28:57.034407 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dca95eae-c3d5-4058-a161-39704a2f1386 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:28:57.034868 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dca95eae-c3d5-4058-a161-39704a2f1386 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:28:57.035573 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dca95eae-c3d5-4058-a161-39704a2f1386 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:28:57.036047 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dca95eae-c3d5-4058-a161-39704a2f1386 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:28:57.036486 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dca95eae-c3d5-4058-a161-39704a2f1386 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:28:57.163210 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-dca95eae-c3d5-4058-a161-39704a2f1386 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:28:57.170994 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-dca95eae-c3d5-4058-a161-39704a2f1386 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3" status: 200 len: 1505 microversion: 2.1 time: 0.148094 Sep 23 05:28:57.171570 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3477/7132] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:28:57 2022] GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3 => generated 1505 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:28:57.193545 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ed05f473-5034-49e7-9b70-fcaa5d4a99a1 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:28:57.194193 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ed05f473-5034-49e7-9b70-fcaa5d4a99a1 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: 5fb4a959-b664-485a-aa90-7f3e741ad5d3] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:28:57.200204 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ed05f473-5034-49e7-9b70-fcaa5d4a99a1 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:28:57.200698 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ed05f473-5034-49e7-9b70-fcaa5d4a99a1 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:28:57.201140 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ed05f473-5034-49e7-9b70-fcaa5d4a99a1 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:28:57.201834 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ed05f473-5034-49e7-9b70-fcaa5d4a99a1 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:28:57.202322 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ed05f473-5034-49e7-9b70-fcaa5d4a99a1 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:28:57.202751 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ed05f473-5034-49e7-9b70-fcaa5d4a99a1 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:28:57.333442 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ed05f473-5034-49e7-9b70-fcaa5d4a99a1 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:28:57.341129 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ed05f473-5034-49e7-9b70-fcaa5d4a99a1 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3" status: 200 len: 1505 microversion: 2.1 time: 0.152084 Sep 23 05:28:57.341711 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3656/7133] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:28:57 2022] GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3 => generated 1505 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:28:57.363768 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-eedebd86-6a75-4b1c-94fd-cbcb32f132ea tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:28:57.366145 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-eedebd86-6a75-4b1c-94fd-cbcb32f132ea tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: 5fb4a959-b664-485a-aa90-7f3e741ad5d3] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:28:57.372072 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-eedebd86-6a75-4b1c-94fd-cbcb32f132ea tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:28:57.372575 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-eedebd86-6a75-4b1c-94fd-cbcb32f132ea tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:28:57.373035 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-eedebd86-6a75-4b1c-94fd-cbcb32f132ea tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:28:57.373740 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-eedebd86-6a75-4b1c-94fd-cbcb32f132ea tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:28:57.374247 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-eedebd86-6a75-4b1c-94fd-cbcb32f132ea tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:28:57.374693 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-eedebd86-6a75-4b1c-94fd-cbcb32f132ea tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:28:57.402655 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-eedebd86-6a75-4b1c-94fd-cbcb32f132ea tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:28:57.408063 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-eedebd86-6a75-4b1c-94fd-cbcb32f132ea tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: 5fb4a959-b664-485a-aa90-7f3e741ad5d3] Old instance type m1.heat2, new instance type m1.heat {{(pid=122698) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 23 05:28:57.414481 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-eedebd86-6a75-4b1c-94fd-cbcb32f132ea tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Flavor limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 05:28:57.414922 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-eedebd86-6a75-4b1c-94fd-cbcb32f132ea tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Image limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 05:28:57.415413 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-eedebd86-6a75-4b1c-94fd-cbcb32f132ea tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Flavor pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 05:28:57.415867 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-eedebd86-6a75-4b1c-94fd-cbcb32f132ea tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Image pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 05:28:57.416316 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-eedebd86-6a75-4b1c-94fd-cbcb32f132ea tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 05:28:57.634541 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-eedebd86-6a75-4b1c-94fd-cbcb32f132ea tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "POST /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3/action" status: 202 len: 0 microversion: 2.1 time: 0.275053 Sep 23 05:28:57.635093 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3478/7134] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 05:28:57 2022] POST /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3/action => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 23 05:28:57.643500 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-29457d1e-2cf3-4308-b672-9cf1b8d5f8b4 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:28:57.644151 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-29457d1e-2cf3-4308-b672-9cf1b8d5f8b4 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: 5fb4a959-b664-485a-aa90-7f3e741ad5d3] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:28:57.650787 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-29457d1e-2cf3-4308-b672-9cf1b8d5f8b4 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:28:57.651277 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-29457d1e-2cf3-4308-b672-9cf1b8d5f8b4 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:28:57.651719 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-29457d1e-2cf3-4308-b672-9cf1b8d5f8b4 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:28:57.652422 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-29457d1e-2cf3-4308-b672-9cf1b8d5f8b4 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:28:57.652880 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-29457d1e-2cf3-4308-b672-9cf1b8d5f8b4 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:28:57.653310 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-29457d1e-2cf3-4308-b672-9cf1b8d5f8b4 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:28:57.782409 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-29457d1e-2cf3-4308-b672-9cf1b8d5f8b4 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:28:57.790669 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-29457d1e-2cf3-4308-b672-9cf1b8d5f8b4 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3" status: 200 len: 1516 microversion: 2.1 time: 0.151387 Sep 23 05:28:57.791248 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3657/7135] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:28:57 2022] GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3 => generated 1516 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:28:58.816047 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4109100f-2feb-42ba-a7b8-f5d0dd07b83c tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:28:58.816796 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4109100f-2feb-42ba-a7b8-f5d0dd07b83c tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: 5fb4a959-b664-485a-aa90-7f3e741ad5d3] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:28:58.826786 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4109100f-2feb-42ba-a7b8-f5d0dd07b83c tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:28:58.832385 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4109100f-2feb-42ba-a7b8-f5d0dd07b83c tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:28:58.832385 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4109100f-2feb-42ba-a7b8-f5d0dd07b83c tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:28:58.832385 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4109100f-2feb-42ba-a7b8-f5d0dd07b83c tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:28:58.832385 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4109100f-2feb-42ba-a7b8-f5d0dd07b83c tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:28:58.832385 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4109100f-2feb-42ba-a7b8-f5d0dd07b83c tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:28:58.960533 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4109100f-2feb-42ba-a7b8-f5d0dd07b83c tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:28:58.968246 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4109100f-2feb-42ba-a7b8-f5d0dd07b83c tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3" status: 200 len: 1516 microversion: 2.1 time: 0.157852 Sep 23 05:28:58.968954 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3479/7136] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:28:58 2022] GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3 => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:28:59.995615 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8fa9879a-a247-43b3-936b-3dd087296d43 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:28:59.996386 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-8fa9879a-a247-43b3-936b-3dd087296d43 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: 5fb4a959-b664-485a-aa90-7f3e741ad5d3] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:29:00.003495 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8fa9879a-a247-43b3-936b-3dd087296d43 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:00.004065 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8fa9879a-a247-43b3-936b-3dd087296d43 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:00.004583 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8fa9879a-a247-43b3-936b-3dd087296d43 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:00.005383 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8fa9879a-a247-43b3-936b-3dd087296d43 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:00.005953 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8fa9879a-a247-43b3-936b-3dd087296d43 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:00.006455 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8fa9879a-a247-43b3-936b-3dd087296d43 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:00.139310 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-8fa9879a-a247-43b3-936b-3dd087296d43 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:29:00.147626 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-8fa9879a-a247-43b3-936b-3dd087296d43 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3" status: 200 len: 1516 microversion: 2.1 time: 0.155938 Sep 23 05:29:00.148207 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3658/7137] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:28:59 2022] GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3 => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:29:01.170628 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-29f8819a-79b7-475f-b703-fad128f76cf2 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:29:01.171262 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-29f8819a-79b7-475f-b703-fad128f76cf2 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: 5fb4a959-b664-485a-aa90-7f3e741ad5d3] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:29:01.177614 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-29f8819a-79b7-475f-b703-fad128f76cf2 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:01.178154 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-29f8819a-79b7-475f-b703-fad128f76cf2 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:01.178618 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-29f8819a-79b7-475f-b703-fad128f76cf2 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:01.179328 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-29f8819a-79b7-475f-b703-fad128f76cf2 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:01.179807 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-29f8819a-79b7-475f-b703-fad128f76cf2 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:01.180283 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-29f8819a-79b7-475f-b703-fad128f76cf2 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:01.311031 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-29f8819a-79b7-475f-b703-fad128f76cf2 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:29:01.319369 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-29f8819a-79b7-475f-b703-fad128f76cf2 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3" status: 200 len: 1521 microversion: 2.1 time: 0.152660 Sep 23 05:29:01.319948 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3480/7138] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:29:01 2022] GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:29:02.343971 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-aaf41db6-d9e1-4357-b156-d7b4b5d0b4f4 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:29:02.344629 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-aaf41db6-d9e1-4357-b156-d7b4b5d0b4f4 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: 5fb4a959-b664-485a-aa90-7f3e741ad5d3] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:29:02.352002 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aaf41db6-d9e1-4357-b156-d7b4b5d0b4f4 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:02.352497 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aaf41db6-d9e1-4357-b156-d7b4b5d0b4f4 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:02.352941 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aaf41db6-d9e1-4357-b156-d7b4b5d0b4f4 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:02.353645 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aaf41db6-d9e1-4357-b156-d7b4b5d0b4f4 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:02.354177 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aaf41db6-d9e1-4357-b156-d7b4b5d0b4f4 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:02.354617 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aaf41db6-d9e1-4357-b156-d7b4b5d0b4f4 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:02.484214 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-aaf41db6-d9e1-4357-b156-d7b4b5d0b4f4 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:29:02.492065 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-aaf41db6-d9e1-4357-b156-d7b4b5d0b4f4 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3" status: 200 len: 1521 microversion: 2.1 time: 0.152125 Sep 23 05:29:02.492646 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3659/7139] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:29:02 2022] GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:29:03.515474 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d957e6ea-27f4-43c6-91a4-7fafacfb16a5 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:29:03.516377 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d957e6ea-27f4-43c6-91a4-7fafacfb16a5 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: 5fb4a959-b664-485a-aa90-7f3e741ad5d3] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:29:03.523810 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d957e6ea-27f4-43c6-91a4-7fafacfb16a5 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:03.524324 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d957e6ea-27f4-43c6-91a4-7fafacfb16a5 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:03.524790 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d957e6ea-27f4-43c6-91a4-7fafacfb16a5 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:03.525509 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d957e6ea-27f4-43c6-91a4-7fafacfb16a5 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:03.526027 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d957e6ea-27f4-43c6-91a4-7fafacfb16a5 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:03.526483 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d957e6ea-27f4-43c6-91a4-7fafacfb16a5 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:03.658250 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d957e6ea-27f4-43c6-91a4-7fafacfb16a5 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:29:03.666707 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d957e6ea-27f4-43c6-91a4-7fafacfb16a5 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3" status: 200 len: 1521 microversion: 2.1 time: 0.155175 Sep 23 05:29:03.667287 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3481/7140] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:29:03 2022] GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:29:04.689655 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-54423c13-ae50-42ef-bc3b-6e409852376b tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:29:04.692131 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-54423c13-ae50-42ef-bc3b-6e409852376b tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: 5fb4a959-b664-485a-aa90-7f3e741ad5d3] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:29:04.698261 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-54423c13-ae50-42ef-bc3b-6e409852376b tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:04.698754 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-54423c13-ae50-42ef-bc3b-6e409852376b tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:04.699197 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-54423c13-ae50-42ef-bc3b-6e409852376b tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:04.699917 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-54423c13-ae50-42ef-bc3b-6e409852376b tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:04.700371 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-54423c13-ae50-42ef-bc3b-6e409852376b tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:04.700793 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-54423c13-ae50-42ef-bc3b-6e409852376b tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:04.829974 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-54423c13-ae50-42ef-bc3b-6e409852376b tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:29:04.837875 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-54423c13-ae50-42ef-bc3b-6e409852376b tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3" status: 200 len: 1521 microversion: 2.1 time: 0.152254 Sep 23 05:29:04.838467 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3660/7141] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:29:04 2022] GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:29:05.861945 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4650e628-6748-49b7-b9dc-ace520c0c369 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:29:05.862690 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4650e628-6748-49b7-b9dc-ace520c0c369 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: 5fb4a959-b664-485a-aa90-7f3e741ad5d3] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:29:05.869984 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4650e628-6748-49b7-b9dc-ace520c0c369 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:05.870642 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4650e628-6748-49b7-b9dc-ace520c0c369 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:05.871106 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4650e628-6748-49b7-b9dc-ace520c0c369 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:05.871825 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4650e628-6748-49b7-b9dc-ace520c0c369 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:05.872311 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4650e628-6748-49b7-b9dc-ace520c0c369 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:05.872760 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4650e628-6748-49b7-b9dc-ace520c0c369 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:06.002948 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4650e628-6748-49b7-b9dc-ace520c0c369 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:29:06.010799 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4650e628-6748-49b7-b9dc-ace520c0c369 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3" status: 200 len: 1521 microversion: 2.1 time: 0.153228 Sep 23 05:29:06.011384 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3482/7142] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:29:05 2022] GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:29:07.035175 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ebae5c5b-14f0-48ba-9be3-ece37f214a3f tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:29:07.035790 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ebae5c5b-14f0-48ba-9be3-ece37f214a3f tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: 5fb4a959-b664-485a-aa90-7f3e741ad5d3] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:29:07.042409 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ebae5c5b-14f0-48ba-9be3-ece37f214a3f tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:07.042906 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ebae5c5b-14f0-48ba-9be3-ece37f214a3f tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:07.043351 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ebae5c5b-14f0-48ba-9be3-ece37f214a3f tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:07.044056 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ebae5c5b-14f0-48ba-9be3-ece37f214a3f tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:07.044521 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ebae5c5b-14f0-48ba-9be3-ece37f214a3f tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:07.044954 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ebae5c5b-14f0-48ba-9be3-ece37f214a3f tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:07.178783 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ebae5c5b-14f0-48ba-9be3-ece37f214a3f tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:29:07.186562 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ebae5c5b-14f0-48ba-9be3-ece37f214a3f tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3" status: 200 len: 1521 microversion: 2.1 time: 0.155856 Sep 23 05:29:07.187139 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3661/7143] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:29:07 2022] GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:29:08.208686 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2013f7f4-1a3d-4a8b-85eb-56c12993cb78 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:29:08.209311 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-2013f7f4-1a3d-4a8b-85eb-56c12993cb78 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: 5fb4a959-b664-485a-aa90-7f3e741ad5d3] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:29:08.216369 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2013f7f4-1a3d-4a8b-85eb-56c12993cb78 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:08.216868 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2013f7f4-1a3d-4a8b-85eb-56c12993cb78 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:08.217321 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2013f7f4-1a3d-4a8b-85eb-56c12993cb78 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:08.218056 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2013f7f4-1a3d-4a8b-85eb-56c12993cb78 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:08.218525 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2013f7f4-1a3d-4a8b-85eb-56c12993cb78 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:08.218963 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2013f7f4-1a3d-4a8b-85eb-56c12993cb78 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:08.346298 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-2013f7f4-1a3d-4a8b-85eb-56c12993cb78 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:29:08.354527 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2013f7f4-1a3d-4a8b-85eb-56c12993cb78 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3" status: 200 len: 1521 microversion: 2.1 time: 0.149782 Sep 23 05:29:08.355099 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3483/7144] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:29:08 2022] GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:29:09.378945 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2c302404-464b-4ad2-b373-ff42371d8a2c tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:29:09.379585 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-2c302404-464b-4ad2-b373-ff42371d8a2c tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: 5fb4a959-b664-485a-aa90-7f3e741ad5d3] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:29:09.386020 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2c302404-464b-4ad2-b373-ff42371d8a2c tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:09.386558 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2c302404-464b-4ad2-b373-ff42371d8a2c tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:09.386952 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2c302404-464b-4ad2-b373-ff42371d8a2c tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:09.387632 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2c302404-464b-4ad2-b373-ff42371d8a2c tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:09.388083 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2c302404-464b-4ad2-b373-ff42371d8a2c tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:09.388502 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2c302404-464b-4ad2-b373-ff42371d8a2c tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:09.520028 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2c302404-464b-4ad2-b373-ff42371d8a2c tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:29:09.527751 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2c302404-464b-4ad2-b373-ff42371d8a2c tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3" status: 200 len: 1521 microversion: 2.1 time: 0.153161 Sep 23 05:29:09.528321 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3662/7145] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:29:09 2022] GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:29:10.550719 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e9beac6e-c383-4f03-b265-de7524be025e tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:29:10.551362 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e9beac6e-c383-4f03-b265-de7524be025e tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: 5fb4a959-b664-485a-aa90-7f3e741ad5d3] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:29:10.558343 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e9beac6e-c383-4f03-b265-de7524be025e tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:10.558861 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e9beac6e-c383-4f03-b265-de7524be025e tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:10.559325 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e9beac6e-c383-4f03-b265-de7524be025e tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:10.560047 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e9beac6e-c383-4f03-b265-de7524be025e tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:10.560525 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e9beac6e-c383-4f03-b265-de7524be025e tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:10.560975 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e9beac6e-c383-4f03-b265-de7524be025e tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:10.689451 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e9beac6e-c383-4f03-b265-de7524be025e tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:29:10.693446 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:29:10.698131 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e9beac6e-c383-4f03-b265-de7524be025e tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3" status: 200 len: 1521 microversion: 2.1 time: 0.151390 Sep 23 05:29:10.698734 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3484/7146] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:29:10 2022] GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:29:11.722026 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3bfcd78f-bc6c-45c9-9c2e-f68d9c5216af tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:29:11.722732 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-3bfcd78f-bc6c-45c9-9c2e-f68d9c5216af tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: 5fb4a959-b664-485a-aa90-7f3e741ad5d3] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:29:11.729309 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3bfcd78f-bc6c-45c9-9c2e-f68d9c5216af tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:11.729806 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3bfcd78f-bc6c-45c9-9c2e-f68d9c5216af tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:11.730280 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3bfcd78f-bc6c-45c9-9c2e-f68d9c5216af tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:11.730979 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3bfcd78f-bc6c-45c9-9c2e-f68d9c5216af tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:11.731503 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3bfcd78f-bc6c-45c9-9c2e-f68d9c5216af tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:11.731945 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3bfcd78f-bc6c-45c9-9c2e-f68d9c5216af tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:11.863697 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-3bfcd78f-bc6c-45c9-9c2e-f68d9c5216af tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:29:11.871472 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3bfcd78f-bc6c-45c9-9c2e-f68d9c5216af tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3" status: 200 len: 1521 microversion: 2.1 time: 0.153357 Sep 23 05:29:11.872040 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3663/7147] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:29:11 2022] GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:29:12.898335 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b33c11f1-8adb-4bf9-9697-83cd990f18e4 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:29:12.898977 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b33c11f1-8adb-4bf9-9697-83cd990f18e4 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: 5fb4a959-b664-485a-aa90-7f3e741ad5d3] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:29:12.906731 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b33c11f1-8adb-4bf9-9697-83cd990f18e4 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:12.907270 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b33c11f1-8adb-4bf9-9697-83cd990f18e4 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:12.907735 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b33c11f1-8adb-4bf9-9697-83cd990f18e4 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:12.908491 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b33c11f1-8adb-4bf9-9697-83cd990f18e4 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:12.908972 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b33c11f1-8adb-4bf9-9697-83cd990f18e4 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:12.909421 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b33c11f1-8adb-4bf9-9697-83cd990f18e4 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:13.043725 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b33c11f1-8adb-4bf9-9697-83cd990f18e4 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:29:13.052045 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b33c11f1-8adb-4bf9-9697-83cd990f18e4 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3" status: 200 len: 1521 microversion: 2.1 time: 0.157785 Sep 23 05:29:13.052641 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3485/7148] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:29:12 2022] GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:29:14.075311 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-34214af2-99b6-4cc8-ba80-f12111aa832a tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:29:14.075921 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-34214af2-99b6-4cc8-ba80-f12111aa832a tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: 5fb4a959-b664-485a-aa90-7f3e741ad5d3] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:29:14.082415 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-34214af2-99b6-4cc8-ba80-f12111aa832a tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:14.082908 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-34214af2-99b6-4cc8-ba80-f12111aa832a tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:14.083347 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-34214af2-99b6-4cc8-ba80-f12111aa832a tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:14.084039 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-34214af2-99b6-4cc8-ba80-f12111aa832a tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:14.084497 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-34214af2-99b6-4cc8-ba80-f12111aa832a tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:14.084924 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-34214af2-99b6-4cc8-ba80-f12111aa832a tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:14.212260 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-34214af2-99b6-4cc8-ba80-f12111aa832a tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:29:14.220027 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-34214af2-99b6-4cc8-ba80-f12111aa832a tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3" status: 200 len: 1521 microversion: 2.1 time: 0.148582 Sep 23 05:29:14.220601 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3664/7149] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:29:14 2022] GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:29:15.243523 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f6f4c77e-d141-45f5-86bf-541090713782 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:29:15.244183 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f6f4c77e-d141-45f5-86bf-541090713782 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: 5fb4a959-b664-485a-aa90-7f3e741ad5d3] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:29:15.247132 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:29:15.251893 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f6f4c77e-d141-45f5-86bf-541090713782 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:15.252404 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f6f4c77e-d141-45f5-86bf-541090713782 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:15.252867 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f6f4c77e-d141-45f5-86bf-541090713782 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:15.254113 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f6f4c77e-d141-45f5-86bf-541090713782 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:15.254600 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f6f4c77e-d141-45f5-86bf-541090713782 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:15.255051 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f6f4c77e-d141-45f5-86bf-541090713782 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:15.389015 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f6f4c77e-d141-45f5-86bf-541090713782 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:29:15.397843 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f6f4c77e-d141-45f5-86bf-541090713782 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3" status: 200 len: 1521 microversion: 2.1 time: 0.158265 Sep 23 05:29:15.398448 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3486/7150] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:29:15 2022] GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:29:16.421081 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7c77ad17-67ee-484e-963a-3c74495105d4 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:29:16.421724 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-7c77ad17-67ee-484e-963a-3c74495105d4 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: 5fb4a959-b664-485a-aa90-7f3e741ad5d3] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:29:16.428391 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7c77ad17-67ee-484e-963a-3c74495105d4 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:16.428886 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7c77ad17-67ee-484e-963a-3c74495105d4 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:16.429334 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7c77ad17-67ee-484e-963a-3c74495105d4 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:16.430062 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7c77ad17-67ee-484e-963a-3c74495105d4 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:16.430539 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7c77ad17-67ee-484e-963a-3c74495105d4 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:16.430971 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7c77ad17-67ee-484e-963a-3c74495105d4 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:16.558738 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-7c77ad17-67ee-484e-963a-3c74495105d4 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:29:16.567035 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-7c77ad17-67ee-484e-963a-3c74495105d4 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3" status: 200 len: 1521 microversion: 2.1 time: 0.149851 Sep 23 05:29:16.567608 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3665/7151] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:29:16 2022] GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:29:17.590870 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6ec19b54-8b70-456e-8c1b-b6834f1557a1 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:29:17.591426 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-6ec19b54-8b70-456e-8c1b-b6834f1557a1 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: 5fb4a959-b664-485a-aa90-7f3e741ad5d3] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:29:17.599049 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6ec19b54-8b70-456e-8c1b-b6834f1557a1 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:17.599589 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6ec19b54-8b70-456e-8c1b-b6834f1557a1 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:17.600052 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6ec19b54-8b70-456e-8c1b-b6834f1557a1 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:17.600767 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6ec19b54-8b70-456e-8c1b-b6834f1557a1 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:17.601247 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6ec19b54-8b70-456e-8c1b-b6834f1557a1 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:17.601703 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6ec19b54-8b70-456e-8c1b-b6834f1557a1 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:17.732954 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6ec19b54-8b70-456e-8c1b-b6834f1557a1 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:29:17.740895 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-6ec19b54-8b70-456e-8c1b-b6834f1557a1 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3" status: 200 len: 1521 microversion: 2.1 time: 0.154041 Sep 23 05:29:17.741532 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3487/7152] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:29:17 2022] GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:29:18.764265 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3bb3abb7-ba31-456d-8d70-c2ed3189ea8e tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:29:18.764886 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-3bb3abb7-ba31-456d-8d70-c2ed3189ea8e tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: 5fb4a959-b664-485a-aa90-7f3e741ad5d3] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:29:18.767615 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=39 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:29:18.772408 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3bb3abb7-ba31-456d-8d70-c2ed3189ea8e tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:18.772904 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3bb3abb7-ba31-456d-8d70-c2ed3189ea8e tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:18.773352 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3bb3abb7-ba31-456d-8d70-c2ed3189ea8e tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:18.774095 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3bb3abb7-ba31-456d-8d70-c2ed3189ea8e tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:18.774562 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3bb3abb7-ba31-456d-8d70-c2ed3189ea8e tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:18.774994 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3bb3abb7-ba31-456d-8d70-c2ed3189ea8e tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:18.777562 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:29:18.904168 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-3bb3abb7-ba31-456d-8d70-c2ed3189ea8e tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:29:18.914166 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3bb3abb7-ba31-456d-8d70-c2ed3189ea8e tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3" status: 200 len: 1521 microversion: 2.1 time: 0.153806 Sep 23 05:29:18.914743 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3666/7153] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:29:18 2022] GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:29:19.938385 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-190d5475-635f-4f24-b439-b0ce0f2b0a2c tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:29:19.939019 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-190d5475-635f-4f24-b439-b0ce0f2b0a2c tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: 5fb4a959-b664-485a-aa90-7f3e741ad5d3] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:29:19.946667 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-190d5475-635f-4f24-b439-b0ce0f2b0a2c tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:19.947178 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-190d5475-635f-4f24-b439-b0ce0f2b0a2c tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:19.947635 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-190d5475-635f-4f24-b439-b0ce0f2b0a2c tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:19.948350 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-190d5475-635f-4f24-b439-b0ce0f2b0a2c tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:19.948827 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-190d5475-635f-4f24-b439-b0ce0f2b0a2c tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:19.949276 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-190d5475-635f-4f24-b439-b0ce0f2b0a2c tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:20.078452 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-190d5475-635f-4f24-b439-b0ce0f2b0a2c tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:29:20.086498 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-190d5475-635f-4f24-b439-b0ce0f2b0a2c tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3" status: 200 len: 1521 microversion: 2.1 time: 0.152024 Sep 23 05:29:20.087082 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3488/7154] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:29:19 2022] GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:29:21.109279 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8808b092-33d6-425b-aaed-eb5aaaf6ea09 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:29:21.109912 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-8808b092-33d6-425b-aaed-eb5aaaf6ea09 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: 5fb4a959-b664-485a-aa90-7f3e741ad5d3] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:29:21.116539 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8808b092-33d6-425b-aaed-eb5aaaf6ea09 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:21.117024 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8808b092-33d6-425b-aaed-eb5aaaf6ea09 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:21.117464 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8808b092-33d6-425b-aaed-eb5aaaf6ea09 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:21.118183 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8808b092-33d6-425b-aaed-eb5aaaf6ea09 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:21.118648 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8808b092-33d6-425b-aaed-eb5aaaf6ea09 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:21.119075 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8808b092-33d6-425b-aaed-eb5aaaf6ea09 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:21.252690 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-8808b092-33d6-425b-aaed-eb5aaaf6ea09 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:29:21.261058 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-8808b092-33d6-425b-aaed-eb5aaaf6ea09 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3" status: 200 len: 1521 microversion: 2.1 time: 0.155905 Sep 23 05:29:21.261634 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3667/7155] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:29:21 2022] GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:29:22.284968 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1980e0c7-5abd-46eb-ad36-976d1e9513b4 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:29:22.285796 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-1980e0c7-5abd-46eb-ad36-976d1e9513b4 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: 5fb4a959-b664-485a-aa90-7f3e741ad5d3] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:29:22.293181 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1980e0c7-5abd-46eb-ad36-976d1e9513b4 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:22.293707 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1980e0c7-5abd-46eb-ad36-976d1e9513b4 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:22.294209 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1980e0c7-5abd-46eb-ad36-976d1e9513b4 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:22.294943 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1980e0c7-5abd-46eb-ad36-976d1e9513b4 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:22.295426 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1980e0c7-5abd-46eb-ad36-976d1e9513b4 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:22.296103 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1980e0c7-5abd-46eb-ad36-976d1e9513b4 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:22.432485 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-1980e0c7-5abd-46eb-ad36-976d1e9513b4 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:29:22.441146 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-1980e0c7-5abd-46eb-ad36-976d1e9513b4 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3" status: 200 len: 1521 microversion: 2.1 time: 0.159754 Sep 23 05:29:22.445935 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3489/7156] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:29:22 2022] GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:29:23.464261 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-293cb83f-a57b-4f52-bebc-63db9ff27a33 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:29:23.465160 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-293cb83f-a57b-4f52-bebc-63db9ff27a33 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: 5fb4a959-b664-485a-aa90-7f3e741ad5d3] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:29:23.471741 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-293cb83f-a57b-4f52-bebc-63db9ff27a33 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:23.472237 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-293cb83f-a57b-4f52-bebc-63db9ff27a33 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:23.472681 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-293cb83f-a57b-4f52-bebc-63db9ff27a33 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:23.473381 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-293cb83f-a57b-4f52-bebc-63db9ff27a33 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:23.473844 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-293cb83f-a57b-4f52-bebc-63db9ff27a33 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:23.474301 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-293cb83f-a57b-4f52-bebc-63db9ff27a33 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:23.603426 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-293cb83f-a57b-4f52-bebc-63db9ff27a33 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:29:23.611145 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-293cb83f-a57b-4f52-bebc-63db9ff27a33 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3" status: 200 len: 1521 microversion: 2.1 time: 0.150801 Sep 23 05:29:23.611728 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3668/7157] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:29:23 2022] GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:29:24.634000 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d7f540ac-999e-40ff-acf3-9d8e652b1751 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:29:24.634635 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d7f540ac-999e-40ff-acf3-9d8e652b1751 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: 5fb4a959-b664-485a-aa90-7f3e741ad5d3] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:29:24.641705 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d7f540ac-999e-40ff-acf3-9d8e652b1751 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:24.642241 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d7f540ac-999e-40ff-acf3-9d8e652b1751 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:24.642698 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d7f540ac-999e-40ff-acf3-9d8e652b1751 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:24.643903 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d7f540ac-999e-40ff-acf3-9d8e652b1751 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:24.644374 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d7f540ac-999e-40ff-acf3-9d8e652b1751 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:24.644813 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d7f540ac-999e-40ff-acf3-9d8e652b1751 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:24.772460 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d7f540ac-999e-40ff-acf3-9d8e652b1751 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:29:24.780257 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d7f540ac-999e-40ff-acf3-9d8e652b1751 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3" status: 200 len: 1521 microversion: 2.1 time: 0.150279 Sep 23 05:29:24.780834 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3490/7158] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:29:24 2022] GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:29:25.804527 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-33b1592d-8063-4e69-847f-5faebb585054 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:29:25.805134 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-33b1592d-8063-4e69-847f-5faebb585054 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: 5fb4a959-b664-485a-aa90-7f3e741ad5d3] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:29:25.811723 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-33b1592d-8063-4e69-847f-5faebb585054 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:25.812204 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-33b1592d-8063-4e69-847f-5faebb585054 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:25.812637 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-33b1592d-8063-4e69-847f-5faebb585054 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:25.813320 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-33b1592d-8063-4e69-847f-5faebb585054 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:25.813775 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-33b1592d-8063-4e69-847f-5faebb585054 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:25.814227 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-33b1592d-8063-4e69-847f-5faebb585054 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:25.946247 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-33b1592d-8063-4e69-847f-5faebb585054 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:29:25.953879 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-33b1592d-8063-4e69-847f-5faebb585054 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3" status: 200 len: 1521 microversion: 2.1 time: 0.153219 Sep 23 05:29:25.954478 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3669/7159] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:29:25 2022] GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:29:26.980814 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e8c56fec-f7c7-4cd1-9889-1ac5cab7a75a tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:29:26.981444 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e8c56fec-f7c7-4cd1-9889-1ac5cab7a75a tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: 5fb4a959-b664-485a-aa90-7f3e741ad5d3] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:29:26.989019 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e8c56fec-f7c7-4cd1-9889-1ac5cab7a75a tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:26.989529 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e8c56fec-f7c7-4cd1-9889-1ac5cab7a75a tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:26.990013 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e8c56fec-f7c7-4cd1-9889-1ac5cab7a75a tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:26.990728 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e8c56fec-f7c7-4cd1-9889-1ac5cab7a75a tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:26.991204 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e8c56fec-f7c7-4cd1-9889-1ac5cab7a75a tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:26.991651 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e8c56fec-f7c7-4cd1-9889-1ac5cab7a75a tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:27.123608 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e8c56fec-f7c7-4cd1-9889-1ac5cab7a75a tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:29:27.131441 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e8c56fec-f7c7-4cd1-9889-1ac5cab7a75a tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3" status: 200 len: 1521 microversion: 2.1 time: 0.154682 Sep 23 05:29:27.132037 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3491/7160] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:29:26 2022] GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:29:28.154811 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c9269187-dd04-4b43-8942-3273218b5fb8 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:29:28.155491 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c9269187-dd04-4b43-8942-3273218b5fb8 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: 5fb4a959-b664-485a-aa90-7f3e741ad5d3] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:29:28.162677 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c9269187-dd04-4b43-8942-3273218b5fb8 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:28.163619 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c9269187-dd04-4b43-8942-3273218b5fb8 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:28.163619 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c9269187-dd04-4b43-8942-3273218b5fb8 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:28.164287 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c9269187-dd04-4b43-8942-3273218b5fb8 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:28.164748 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c9269187-dd04-4b43-8942-3273218b5fb8 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:28.165179 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c9269187-dd04-4b43-8942-3273218b5fb8 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:28.292805 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c9269187-dd04-4b43-8942-3273218b5fb8 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:29:28.300577 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c9269187-dd04-4b43-8942-3273218b5fb8 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3" status: 200 len: 1521 microversion: 2.1 time: 0.149714 Sep 23 05:29:28.301147 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3670/7161] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:29:28 2022] GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:29:29.323328 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0aae9c87-8c6e-4bb7-a647-c0d16f6563e8 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:29:29.323961 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-0aae9c87-8c6e-4bb7-a647-c0d16f6563e8 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: 5fb4a959-b664-485a-aa90-7f3e741ad5d3] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:29:29.331694 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0aae9c87-8c6e-4bb7-a647-c0d16f6563e8 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:29.332228 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0aae9c87-8c6e-4bb7-a647-c0d16f6563e8 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:29.332838 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0aae9c87-8c6e-4bb7-a647-c0d16f6563e8 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:29.333399 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0aae9c87-8c6e-4bb7-a647-c0d16f6563e8 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:29.333877 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0aae9c87-8c6e-4bb7-a647-c0d16f6563e8 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:29.334351 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0aae9c87-8c6e-4bb7-a647-c0d16f6563e8 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:29.465268 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-0aae9c87-8c6e-4bb7-a647-c0d16f6563e8 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:29:29.473034 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0aae9c87-8c6e-4bb7-a647-c0d16f6563e8 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3" status: 200 len: 1521 microversion: 2.1 time: 0.153715 Sep 23 05:29:29.473615 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3492/7162] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:29:29 2022] GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:29:30.495532 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-33145087-e597-4176-8b5f-ffef96b07cb7 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:29:30.496159 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-33145087-e597-4176-8b5f-ffef96b07cb7 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: 5fb4a959-b664-485a-aa90-7f3e741ad5d3] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:29:30.502995 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-33145087-e597-4176-8b5f-ffef96b07cb7 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:30.503487 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-33145087-e597-4176-8b5f-ffef96b07cb7 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:30.503920 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-33145087-e597-4176-8b5f-ffef96b07cb7 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:30.504620 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-33145087-e597-4176-8b5f-ffef96b07cb7 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:30.505085 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-33145087-e597-4176-8b5f-ffef96b07cb7 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:30.505525 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-33145087-e597-4176-8b5f-ffef96b07cb7 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:30.636415 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-33145087-e597-4176-8b5f-ffef96b07cb7 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:29:30.644948 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-33145087-e597-4176-8b5f-ffef96b07cb7 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3" status: 200 len: 1521 microversion: 2.1 time: 0.153275 Sep 23 05:29:30.645528 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3671/7163] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:29:30 2022] GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:29:31.668769 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9801fc48-2404-4f7a-983c-36e8c36058a4 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:29:31.669409 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-9801fc48-2404-4f7a-983c-36e8c36058a4 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: 5fb4a959-b664-485a-aa90-7f3e741ad5d3] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:29:31.676295 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9801fc48-2404-4f7a-983c-36e8c36058a4 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:31.676802 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9801fc48-2404-4f7a-983c-36e8c36058a4 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:31.677264 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9801fc48-2404-4f7a-983c-36e8c36058a4 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:31.678006 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9801fc48-2404-4f7a-983c-36e8c36058a4 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:31.678490 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9801fc48-2404-4f7a-983c-36e8c36058a4 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:31.678936 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9801fc48-2404-4f7a-983c-36e8c36058a4 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:31.806992 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-9801fc48-2404-4f7a-983c-36e8c36058a4 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:29:31.814738 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9801fc48-2404-4f7a-983c-36e8c36058a4 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3" status: 200 len: 1521 microversion: 2.1 time: 0.150104 Sep 23 05:29:31.815373 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3493/7164] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:29:31 2022] GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:29:32.838022 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-32f06432-bf52-4fcc-b6e4-775e19378a28 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:29:32.838640 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-32f06432-bf52-4fcc-b6e4-775e19378a28 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: 5fb4a959-b664-485a-aa90-7f3e741ad5d3] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:29:32.845063 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-32f06432-bf52-4fcc-b6e4-775e19378a28 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:32.845551 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-32f06432-bf52-4fcc-b6e4-775e19378a28 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:32.846023 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-32f06432-bf52-4fcc-b6e4-775e19378a28 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:32.846716 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-32f06432-bf52-4fcc-b6e4-775e19378a28 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:32.847212 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-32f06432-bf52-4fcc-b6e4-775e19378a28 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:32.847641 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-32f06432-bf52-4fcc-b6e4-775e19378a28 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:32.983070 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-32f06432-bf52-4fcc-b6e4-775e19378a28 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:29:32.991375 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-32f06432-bf52-4fcc-b6e4-775e19378a28 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3" status: 200 len: 1520 microversion: 2.1 time: 0.157230 Sep 23 05:29:32.992174 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3672/7165] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:29:32 2022] GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:29:33.577167 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-ab6ce353-798e-407d-bac8-8f422058dfa8 req-02818e91-d25e-4f22-aa68-5ac476a11be0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fb4a959-b664-485a-aa90-7f3e741ad5d3", "name": "network-vif-unplugged", "status": "completed", "tag": "c597fdad-e003-4548-914f-20801a0ecbf8"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:29:33.587480 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-ab6ce353-798e-407d-bac8-8f422058dfa8 req-02818e91-d25e-4f22-aa68-5ac476a11be0 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:33.587986 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-ab6ce353-798e-407d-bac8-8f422058dfa8 req-02818e91-d25e-4f22-aa68-5ac476a11be0 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:33.588443 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-ab6ce353-798e-407d-bac8-8f422058dfa8 req-02818e91-d25e-4f22-aa68-5ac476a11be0 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:33.601349 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-ab6ce353-798e-407d-bac8-8f422058dfa8 req-02818e91-d25e-4f22-aa68-5ac476a11be0 service nova] Creating event network-vif-unplugged:c597fdad-e003-4548-914f-20801a0ecbf8 for instance 5fb4a959-b664-485a-aa90-7f3e741ad5d3 on n-h1-846463-3 Sep 23 05:29:33.606785 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [req-ab6ce353-798e-407d-bac8-8f422058dfa8 req-02818e91-d25e-4f22-aa68-5ac476a11be0 service nova] Instance 5fb4a959-b664-485a-aa90-7f3e741ad5d3 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846463-3', 'n-h2-846463-3'} {{(pid=122698) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 23 05:29:33.618812 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-ab6ce353-798e-407d-bac8-8f422058dfa8 req-02818e91-d25e-4f22-aa68-5ac476a11be0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.096684 Sep 23 05:29:33.619422 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3494/7166] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:29:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:29:34.015151 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-663605e3-63a1-4d9c-9596-34fe9b419018 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:29:34.016018 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-663605e3-63a1-4d9c-9596-34fe9b419018 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: 5fb4a959-b664-485a-aa90-7f3e741ad5d3] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:29:34.023212 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-663605e3-63a1-4d9c-9596-34fe9b419018 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:34.031944 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-663605e3-63a1-4d9c-9596-34fe9b419018 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:34.031944 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-663605e3-63a1-4d9c-9596-34fe9b419018 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:34.031944 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-663605e3-63a1-4d9c-9596-34fe9b419018 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:34.031944 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-663605e3-63a1-4d9c-9596-34fe9b419018 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:34.031944 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-663605e3-63a1-4d9c-9596-34fe9b419018 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:34.162582 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-663605e3-63a1-4d9c-9596-34fe9b419018 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:29:34.170481 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-663605e3-63a1-4d9c-9596-34fe9b419018 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3" status: 200 len: 1520 microversion: 2.1 time: 0.159234 Sep 23 05:29:34.171285 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3673/7167] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:29:34 2022] GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:29:35.196539 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9405c919-3c23-4237-9bf7-831b3fd3f058 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:29:35.197257 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-9405c919-3c23-4237-9bf7-831b3fd3f058 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: 5fb4a959-b664-485a-aa90-7f3e741ad5d3] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:29:35.203511 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9405c919-3c23-4237-9bf7-831b3fd3f058 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:35.204018 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9405c919-3c23-4237-9bf7-831b3fd3f058 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:35.204588 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9405c919-3c23-4237-9bf7-831b3fd3f058 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:35.205301 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9405c919-3c23-4237-9bf7-831b3fd3f058 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:35.205791 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9405c919-3c23-4237-9bf7-831b3fd3f058 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:35.206237 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9405c919-3c23-4237-9bf7-831b3fd3f058 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:35.338570 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-9405c919-3c23-4237-9bf7-831b3fd3f058 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:29:35.346790 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9405c919-3c23-4237-9bf7-831b3fd3f058 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3" status: 200 len: 1518 microversion: 2.1 time: 0.154891 Sep 23 05:29:35.347369 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3495/7168] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:29:35 2022] GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3 => generated 1518 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:29:35.645964 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-b76632e1-ff4e-4e1b-b180-f146159df18e req-3e3616ef-84f6-4b18-8aed-75cd747861f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fb4a959-b664-485a-aa90-7f3e741ad5d3", "tag": "c597fdad-e003-4548-914f-20801a0ecbf8"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:29:35.655349 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-b76632e1-ff4e-4e1b-b180-f146159df18e req-3e3616ef-84f6-4b18-8aed-75cd747861f5 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:35.655830 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-b76632e1-ff4e-4e1b-b180-f146159df18e req-3e3616ef-84f6-4b18-8aed-75cd747861f5 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:35.656262 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-b76632e1-ff4e-4e1b-b180-f146159df18e req-3e3616ef-84f6-4b18-8aed-75cd747861f5 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:35.670344 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-b76632e1-ff4e-4e1b-b180-f146159df18e req-3e3616ef-84f6-4b18-8aed-75cd747861f5 service nova] Creating event network-changed:c597fdad-e003-4548-914f-20801a0ecbf8 for instance 5fb4a959-b664-485a-aa90-7f3e741ad5d3 on n-h1-846463-3 Sep 23 05:29:35.675547 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [req-b76632e1-ff4e-4e1b-b180-f146159df18e req-3e3616ef-84f6-4b18-8aed-75cd747861f5 service nova] Instance 5fb4a959-b664-485a-aa90-7f3e741ad5d3 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846463-3', 'n-h2-846463-3'} {{(pid=122699) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 23 05:29:35.686226 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-b76632e1-ff4e-4e1b-b180-f146159df18e req-3e3616ef-84f6-4b18-8aed-75cd747861f5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044409 Sep 23 05:29:35.686799 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3674/7169] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:29:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:29:36.370827 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-566475b0-c9a0-41d7-95bc-9e7da8ae9c18 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:29:36.371553 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-566475b0-c9a0-41d7-95bc-9e7da8ae9c18 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: 5fb4a959-b664-485a-aa90-7f3e741ad5d3] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:29:36.379277 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-566475b0-c9a0-41d7-95bc-9e7da8ae9c18 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:36.379794 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-566475b0-c9a0-41d7-95bc-9e7da8ae9c18 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:36.380294 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-566475b0-c9a0-41d7-95bc-9e7da8ae9c18 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:36.381033 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-566475b0-c9a0-41d7-95bc-9e7da8ae9c18 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:36.381513 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-566475b0-c9a0-41d7-95bc-9e7da8ae9c18 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:36.382132 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-566475b0-c9a0-41d7-95bc-9e7da8ae9c18 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:36.513370 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-566475b0-c9a0-41d7-95bc-9e7da8ae9c18 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:29:36.521649 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-566475b0-c9a0-41d7-95bc-9e7da8ae9c18 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3" status: 200 len: 1515 microversion: 2.1 time: 0.154752 Sep 23 05:29:36.522280 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3496/7170] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:29:36 2022] GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:29:36.545458 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c0086ce4-5d0c-4a61-901a-feb5da6c3b8e tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:29:36.546551 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c0086ce4-5d0c-4a61-901a-feb5da6c3b8e tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: 5fb4a959-b664-485a-aa90-7f3e741ad5d3] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:29:36.553817 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c0086ce4-5d0c-4a61-901a-feb5da6c3b8e tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:36.554839 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c0086ce4-5d0c-4a61-901a-feb5da6c3b8e tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:36.555410 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c0086ce4-5d0c-4a61-901a-feb5da6c3b8e tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:36.556133 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c0086ce4-5d0c-4a61-901a-feb5da6c3b8e tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:36.556600 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c0086ce4-5d0c-4a61-901a-feb5da6c3b8e tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:36.557036 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c0086ce4-5d0c-4a61-901a-feb5da6c3b8e tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:36.703066 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c0086ce4-5d0c-4a61-901a-feb5da6c3b8e tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "POST /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3/action" status: 204 len: 0 microversion: 2.1 time: 0.162385 Sep 23 05:29:36.703774 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3675/7171] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 05:29:36 2022] POST /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3/action => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 05:29:36.713464 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-984372dd-331e-4e90-8d74-f666e718c039 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:29:36.714089 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-984372dd-331e-4e90-8d74-f666e718c039 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: 5fb4a959-b664-485a-aa90-7f3e741ad5d3] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:29:36.720568 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-984372dd-331e-4e90-8d74-f666e718c039 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:36.721111 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-984372dd-331e-4e90-8d74-f666e718c039 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:36.721572 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-984372dd-331e-4e90-8d74-f666e718c039 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:36.722383 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-984372dd-331e-4e90-8d74-f666e718c039 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:36.723079 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-984372dd-331e-4e90-8d74-f666e718c039 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:36.723525 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-984372dd-331e-4e90-8d74-f666e718c039 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:37.179734 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-984372dd-331e-4e90-8d74-f666e718c039 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:29:37.188026 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-984372dd-331e-4e90-8d74-f666e718c039 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3" status: 200 len: 1515 microversion: 2.1 time: 0.480025 Sep 23 05:29:37.198941 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3497/7172] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:29:36 2022] GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3 => generated 1515 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:29:38.218358 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-bf801919-3ea5-43bc-90e2-54b9fc1439c1 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:29:38.219114 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-bf801919-3ea5-43bc-90e2-54b9fc1439c1 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: 5fb4a959-b664-485a-aa90-7f3e741ad5d3] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:29:38.226165 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bf801919-3ea5-43bc-90e2-54b9fc1439c1 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:38.227010 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bf801919-3ea5-43bc-90e2-54b9fc1439c1 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:38.227658 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bf801919-3ea5-43bc-90e2-54b9fc1439c1 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:38.228566 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bf801919-3ea5-43bc-90e2-54b9fc1439c1 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:38.229224 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bf801919-3ea5-43bc-90e2-54b9fc1439c1 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:38.229665 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bf801919-3ea5-43bc-90e2-54b9fc1439c1 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:38.392687 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-bf801919-3ea5-43bc-90e2-54b9fc1439c1 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:29:38.406164 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-bf801919-3ea5-43bc-90e2-54b9fc1439c1 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3" status: 200 len: 1515 microversion: 2.1 time: 0.194109 Sep 23 05:29:38.406164 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3676/7173] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:29:38 2022] GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3 => generated 1515 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:29:39.428833 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-fc3a5cbc-9ba3-4c05-b95e-410b1d893f16 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:29:39.429496 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-fc3a5cbc-9ba3-4c05-b95e-410b1d893f16 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: 5fb4a959-b664-485a-aa90-7f3e741ad5d3] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:29:39.436487 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fc3a5cbc-9ba3-4c05-b95e-410b1d893f16 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:39.436993 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fc3a5cbc-9ba3-4c05-b95e-410b1d893f16 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:39.437450 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fc3a5cbc-9ba3-4c05-b95e-410b1d893f16 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:39.438194 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fc3a5cbc-9ba3-4c05-b95e-410b1d893f16 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:39.438671 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fc3a5cbc-9ba3-4c05-b95e-410b1d893f16 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:39.439113 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fc3a5cbc-9ba3-4c05-b95e-410b1d893f16 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:39.570194 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-fc3a5cbc-9ba3-4c05-b95e-410b1d893f16 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:29:39.577969 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-fc3a5cbc-9ba3-4c05-b95e-410b1d893f16 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3" status: 200 len: 1507 microversion: 2.1 time: 0.153153 Sep 23 05:29:39.578557 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3498/7174] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:29:39 2022] GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3 => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:29:39.601145 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-cc5ea195-fc8d-499c-bd50-21d3cc3a297c tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:29:39.601695 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-cc5ea195-fc8d-499c-bd50-21d3cc3a297c tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: 5fb4a959-b664-485a-aa90-7f3e741ad5d3] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:29:39.608183 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cc5ea195-fc8d-499c-bd50-21d3cc3a297c tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:39.608676 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cc5ea195-fc8d-499c-bd50-21d3cc3a297c tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:39.609137 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cc5ea195-fc8d-499c-bd50-21d3cc3a297c tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:39.609844 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cc5ea195-fc8d-499c-bd50-21d3cc3a297c tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:39.610330 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cc5ea195-fc8d-499c-bd50-21d3cc3a297c tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:39.610765 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cc5ea195-fc8d-499c-bd50-21d3cc3a297c tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:39.737610 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-cc5ea195-fc8d-499c-bd50-21d3cc3a297c tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:29:39.745528 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-cc5ea195-fc8d-499c-bd50-21d3cc3a297c tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3" status: 200 len: 1507 microversion: 2.1 time: 0.148990 Sep 23 05:29:39.746139 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3677/7175] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:29:39 2022] GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3 => generated 1507 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:29:39.771647 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f50c9d38-cc68-42b4-9290-32f8a8b5c9c3 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Action: 'create', calling method: .version_select at 0x7ff1ba79d040>, body: {"keypair": {"name": "tempest-keypair-122837463", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOVJ63WzjwKSyiR2FVWmKgHEC2x/faIGnEtw/EsCHX9SmUPWgq/opD+CTayVof6kiQZjW4e2QLA3WtIsa7C/h/pp+vMGVlvm4gwL4VDMYBI/h8ZTLBJ5yKSWmfo/FbN/sw=="}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:29:39.787926 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-f50c9d38-cc68-42b4-9290-32f8a8b5c9c3 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Getting quotas for project 353a08b792f7473fa857996c3214c8ce. Resources: {'key_pairs'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 05:29:39.793032 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-f50c9d38-cc68-42b4-9290-32f8a8b5c9c3 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Getting quotas for user 71fcf3e705ed4f539b04b3606703c610 and project 353a08b792f7473fa857996c3214c8ce. Resources: {'key_pairs'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 05:29:39.883439 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f50c9d38-cc68-42b4-9290-32f8a8b5c9c3 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.116243 Sep 23 05:29:39.890269 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3499/7176] 10.222.0.33 () {60 vars in 1159 bytes} [Fri Sep 23 05:29:39 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 05:29:39.997103 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-b1af97aa-203e-4984-98cd-c89ea764bdbc req-3393f00d-daf4-4ea5-a14e-f0f75582c655 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fb4a959-b664-485a-aa90-7f3e741ad5d3", "name": "network-vif-plugged", "status": "completed", "tag": "c597fdad-e003-4548-914f-20801a0ecbf8"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:29:40.011260 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-b1af97aa-203e-4984-98cd-c89ea764bdbc req-3393f00d-daf4-4ea5-a14e-f0f75582c655 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:40.011756 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-b1af97aa-203e-4984-98cd-c89ea764bdbc req-3393f00d-daf4-4ea5-a14e-f0f75582c655 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:40.012456 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-b1af97aa-203e-4984-98cd-c89ea764bdbc req-3393f00d-daf4-4ea5-a14e-f0f75582c655 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:40.026505 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-b1af97aa-203e-4984-98cd-c89ea764bdbc req-3393f00d-daf4-4ea5-a14e-f0f75582c655 service nova] Creating event network-vif-plugged:c597fdad-e003-4548-914f-20801a0ecbf8 for instance 5fb4a959-b664-485a-aa90-7f3e741ad5d3 on n-h1-846463-3 Sep 23 05:29:40.031883 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-b1af97aa-203e-4984-98cd-c89ea764bdbc req-3393f00d-daf4-4ea5-a14e-f0f75582c655 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088873 Sep 23 05:29:40.032837 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3678/7177] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:29:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:29:42.271627 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a6ad8e91-454d-4d60-b168-b4a42832716a tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:29:42.272313 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a6ad8e91-454d-4d60-b168-b4a42832716a tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: 5fb4a959-b664-485a-aa90-7f3e741ad5d3] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:29:42.279049 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a6ad8e91-454d-4d60-b168-b4a42832716a tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:42.279550 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a6ad8e91-454d-4d60-b168-b4a42832716a tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:42.280002 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a6ad8e91-454d-4d60-b168-b4a42832716a tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:42.280709 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a6ad8e91-454d-4d60-b168-b4a42832716a tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:42.281176 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a6ad8e91-454d-4d60-b168-b4a42832716a tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:42.281614 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a6ad8e91-454d-4d60-b168-b4a42832716a tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:42.414090 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a6ad8e91-454d-4d60-b168-b4a42832716a tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:29:42.422121 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a6ad8e91-454d-4d60-b168-b4a42832716a tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3" status: 200 len: 1507 microversion: 2.1 time: 0.157322 Sep 23 05:29:42.424444 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3500/7178] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:29:42 2022] GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3 => generated 1507 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:29:42.447235 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-975c1839-85ac-4b47-8520-f2d3b540a1fe tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:29:42.447785 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-975c1839-85ac-4b47-8520-f2d3b540a1fe tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: 5fb4a959-b664-485a-aa90-7f3e741ad5d3] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:29:42.454120 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-975c1839-85ac-4b47-8520-f2d3b540a1fe tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:42.454615 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-975c1839-85ac-4b47-8520-f2d3b540a1fe tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:42.455058 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-975c1839-85ac-4b47-8520-f2d3b540a1fe tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:42.456259 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-975c1839-85ac-4b47-8520-f2d3b540a1fe tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:42.456725 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-975c1839-85ac-4b47-8520-f2d3b540a1fe tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:42.457162 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-975c1839-85ac-4b47-8520-f2d3b540a1fe tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:42.482840 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-975c1839-85ac-4b47-8520-f2d3b540a1fe tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: 5fb4a959-b664-485a-aa90-7f3e741ad5d3] Going to try to terminate instance {{(pid=122699) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 05:29:42.737751 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-975c1839-85ac-4b47-8520-f2d3b540a1fe tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "DELETE /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3" status: 204 len: 0 microversion: 2.1 time: 0.295089 Sep 23 05:29:42.738417 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3679/7179] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 05:29:42 2022] DELETE /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 05:29:42.796200 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3aa547c7-9ee6-49a4-b719-023387b8bfb7 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1313933158", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "networks": [{"uuid": "2341cdaf-e95f-4c41-aba4-9ed974187f59"}]}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:29:42.849468 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.network.neutron [None req-3aa547c7-9ee6-49a4-b719-023387b8bfb7 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] validate_networks() for [('2341cdaf-e95f-4c41-aba4-9ed974187f59', None, None, None, None, None)] {{(pid=122698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 05:29:43.220713 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-3aa547c7-9ee6-49a4-b719-023387b8bfb7 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Flavor limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 05:29:43.221153 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-3aa547c7-9ee6-49a4-b719-023387b8bfb7 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Image limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 05:29:43.221640 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-3aa547c7-9ee6-49a4-b719-023387b8bfb7 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Flavor pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 05:29:43.222105 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-3aa547c7-9ee6-49a4-b719-023387b8bfb7 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Image pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 05:29:43.222533 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-3aa547c7-9ee6-49a4-b719-023387b8bfb7 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 05:29:43.231315 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3aa547c7-9ee6-49a4-b719-023387b8bfb7 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:43.231810 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3aa547c7-9ee6-49a4-b719-023387b8bfb7 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:43.232258 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3aa547c7-9ee6-49a4-b719-023387b8bfb7 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:43.232995 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3aa547c7-9ee6-49a4-b719-023387b8bfb7 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:43.233463 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3aa547c7-9ee6-49a4-b719-023387b8bfb7 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:43.233922 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3aa547c7-9ee6-49a4-b719-023387b8bfb7 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:43.241105 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=89 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:29:43.251378 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-3aa547c7-9ee6-49a4-b719-023387b8bfb7 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Getting quotas for project 353a08b792f7473fa857996c3214c8ce. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 05:29:43.257217 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-3aa547c7-9ee6-49a4-b719-023387b8bfb7 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Getting quotas for user 71fcf3e705ed4f539b04b3606703c610 and project 353a08b792f7473fa857996c3214c8ce. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 05:29:43.270881 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3aa547c7-9ee6-49a4-b719-023387b8bfb7 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Going to run 1 instances... {{(pid=122698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 05:29:43.273183 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3aa547c7-9ee6-49a4-b719-023387b8bfb7 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: b2f23f3b-a932-4d64-b6c1-189920f2ea2f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 05:29:43.381134 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3aa547c7-9ee6-49a4-b719-023387b8bfb7 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.588806 Sep 23 05:29:43.381846 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3501/7180] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 05:29:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 590 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 05:29:43.393802 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f51c8a77-956c-4871-af97-c9282fc62eb2 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:29:43.394537 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f51c8a77-956c-4871-af97-c9282fc62eb2 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: b2f23f3b-a932-4d64-b6c1-189920f2ea2f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:29:43.449065 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f51c8a77-956c-4871-af97-c9282fc62eb2 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:29:43.456916 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f51c8a77-956c-4871-af97-c9282fc62eb2 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f" status: 200 len: 1218 microversion: 2.1 time: 0.067449 Sep 23 05:29:43.457409 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3680/7181] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:29:43 2022] GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f => generated 1218 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:29:44.479149 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e312a2bb-9a6a-42ae-abec-2578db176baf tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:29:44.480096 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e312a2bb-9a6a-42ae-abec-2578db176baf tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: b2f23f3b-a932-4d64-b6c1-189920f2ea2f] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:29:44.487986 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e312a2bb-9a6a-42ae-abec-2578db176baf tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:44.488495 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e312a2bb-9a6a-42ae-abec-2578db176baf tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:44.488952 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e312a2bb-9a6a-42ae-abec-2578db176baf tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:44.489666 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e312a2bb-9a6a-42ae-abec-2578db176baf tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:44.490172 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e312a2bb-9a6a-42ae-abec-2578db176baf tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:44.490619 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e312a2bb-9a6a-42ae-abec-2578db176baf tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:44.568002 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e312a2bb-9a6a-42ae-abec-2578db176baf tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:29:44.576419 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e312a2bb-9a6a-42ae-abec-2578db176baf tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f" status: 200 len: 1222 microversion: 2.1 time: 0.101289 Sep 23 05:29:44.577006 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3502/7182] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:29:44 2022] GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f => generated 1222 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:29:44.623526 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-c87f1996-8108-45d4-89ba-e62aaed9976c req-f2b9658e-6960-4a23-ae53-e527970ee502 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fb4a959-b664-485a-aa90-7f3e741ad5d3", "name": "network-vif-deleted", "tag": "c597fdad-e003-4548-914f-20801a0ecbf8"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:29:44.634766 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-c87f1996-8108-45d4-89ba-e62aaed9976c req-f2b9658e-6960-4a23-ae53-e527970ee502 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:44.635260 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-c87f1996-8108-45d4-89ba-e62aaed9976c req-f2b9658e-6960-4a23-ae53-e527970ee502 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:44.635701 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-c87f1996-8108-45d4-89ba-e62aaed9976c req-f2b9658e-6960-4a23-ae53-e527970ee502 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:44.651764 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-c87f1996-8108-45d4-89ba-e62aaed9976c req-f2b9658e-6960-4a23-ae53-e527970ee502 service nova] Creating event network-vif-deleted:c597fdad-e003-4548-914f-20801a0ecbf8 for instance 5fb4a959-b664-485a-aa90-7f3e741ad5d3 on n-h1-846463-3 Sep 23 05:29:44.657686 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-c87f1996-8108-45d4-89ba-e62aaed9976c req-f2b9658e-6960-4a23-ae53-e527970ee502 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037567 Sep 23 05:29:44.662895 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3681/7183] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:29:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:29:45.601314 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-912f21be-73fd-4836-bb4f-f61eab97c33d tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:29:45.601934 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-912f21be-73fd-4836-bb4f-f61eab97c33d tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: b2f23f3b-a932-4d64-b6c1-189920f2ea2f] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:29:45.604684 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=4 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:29:45.609371 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-912f21be-73fd-4836-bb4f-f61eab97c33d tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:45.610003 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-912f21be-73fd-4836-bb4f-f61eab97c33d tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:45.610471 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-912f21be-73fd-4836-bb4f-f61eab97c33d tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:45.611200 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-912f21be-73fd-4836-bb4f-f61eab97c33d tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:45.611716 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-912f21be-73fd-4836-bb4f-f61eab97c33d tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:45.612166 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-912f21be-73fd-4836-bb4f-f61eab97c33d tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:45.676981 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-912f21be-73fd-4836-bb4f-f61eab97c33d tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:29:45.683125 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-912f21be-73fd-4836-bb4f-f61eab97c33d tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f" status: 200 len: 1288 microversion: 2.1 time: 0.085832 Sep 23 05:29:45.683968 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3503/7184] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:29:45 2022] GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f => generated 1288 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:29:46.714717 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-01338ac4-099a-4276-8c34-2ca5d9eaf2f1 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:29:46.715472 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-01338ac4-099a-4276-8c34-2ca5d9eaf2f1 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: b2f23f3b-a932-4d64-b6c1-189920f2ea2f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:29:46.722471 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-01338ac4-099a-4276-8c34-2ca5d9eaf2f1 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:46.722972 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-01338ac4-099a-4276-8c34-2ca5d9eaf2f1 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:46.723419 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-01338ac4-099a-4276-8c34-2ca5d9eaf2f1 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:46.724129 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-01338ac4-099a-4276-8c34-2ca5d9eaf2f1 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:46.724784 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-01338ac4-099a-4276-8c34-2ca5d9eaf2f1 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:46.725152 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-01338ac4-099a-4276-8c34-2ca5d9eaf2f1 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:46.747928 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:29:46.867498 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-01338ac4-099a-4276-8c34-2ca5d9eaf2f1 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:29:46.876806 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-01338ac4-099a-4276-8c34-2ca5d9eaf2f1 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f" status: 200 len: 1318 microversion: 2.1 time: 0.167039 Sep 23 05:29:46.877947 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3682/7185] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:29:46 2022] GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:29:47.047539 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-40f6abde-a720-41e9-bea0-976babbdf241 req-0130455a-2c14-4034-98d2-b22a0ef5a9f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2f23f3b-a932-4d64-b6c1-189920f2ea2f", "tag": "d7e04581-d07a-4165-a40e-431bdbe66f75"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:29:47.058010 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-40f6abde-a720-41e9-bea0-976babbdf241 req-0130455a-2c14-4034-98d2-b22a0ef5a9f3 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:47.058508 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-40f6abde-a720-41e9-bea0-976babbdf241 req-0130455a-2c14-4034-98d2-b22a0ef5a9f3 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:47.058957 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-40f6abde-a720-41e9-bea0-976babbdf241 req-0130455a-2c14-4034-98d2-b22a0ef5a9f3 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:47.070094 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-40f6abde-a720-41e9-bea0-976babbdf241 req-0130455a-2c14-4034-98d2-b22a0ef5a9f3 service nova] Creating event network-changed:d7e04581-d07a-4165-a40e-431bdbe66f75 for instance b2f23f3b-a932-4d64-b6c1-189920f2ea2f on n-h2-846463-3 Sep 23 05:29:47.075263 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-40f6abde-a720-41e9-bea0-976babbdf241 req-0130455a-2c14-4034-98d2-b22a0ef5a9f3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031842 Sep 23 05:29:47.076006 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3504/7186] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:29:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:29:47.903423 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6ea351ec-388c-48ca-b76f-515013e9ccd6 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:29:47.904032 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-6ea351ec-388c-48ca-b76f-515013e9ccd6 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: b2f23f3b-a932-4d64-b6c1-189920f2ea2f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:29:47.910692 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6ea351ec-388c-48ca-b76f-515013e9ccd6 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:47.911114 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6ea351ec-388c-48ca-b76f-515013e9ccd6 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:47.911552 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6ea351ec-388c-48ca-b76f-515013e9ccd6 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:47.912237 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6ea351ec-388c-48ca-b76f-515013e9ccd6 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:47.912692 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6ea351ec-388c-48ca-b76f-515013e9ccd6 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:47.913122 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6ea351ec-388c-48ca-b76f-515013e9ccd6 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:48.040341 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-6ea351ec-388c-48ca-b76f-515013e9ccd6 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:29:48.048002 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6ea351ec-388c-48ca-b76f-515013e9ccd6 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f" status: 200 len: 1318 microversion: 2.1 time: 0.148957 Sep 23 05:29:48.048807 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3683/7187] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:29:47 2022] GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:29:49.073107 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9a6743b4-ab17-4e23-bed9-a7e7976f320a tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:29:49.073739 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-9a6743b4-ab17-4e23-bed9-a7e7976f320a tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: b2f23f3b-a932-4d64-b6c1-189920f2ea2f] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:29:49.079925 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9a6743b4-ab17-4e23-bed9-a7e7976f320a tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:49.080423 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9a6743b4-ab17-4e23-bed9-a7e7976f320a tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:49.080879 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9a6743b4-ab17-4e23-bed9-a7e7976f320a tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:49.081583 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9a6743b4-ab17-4e23-bed9-a7e7976f320a tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:49.082090 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9a6743b4-ab17-4e23-bed9-a7e7976f320a tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:49.082536 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9a6743b4-ab17-4e23-bed9-a7e7976f320a tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:49.217612 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-9a6743b4-ab17-4e23-bed9-a7e7976f320a tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:29:49.226255 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9a6743b4-ab17-4e23-bed9-a7e7976f320a tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f" status: 200 len: 1318 microversion: 2.1 time: 0.158290 Sep 23 05:29:49.226850 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3505/7188] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:29:49 2022] GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:29:50.248733 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ef2c4421-78ee-4fb7-a3b6-44259b141200 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:29:50.249273 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ef2c4421-78ee-4fb7-a3b6-44259b141200 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: b2f23f3b-a932-4d64-b6c1-189920f2ea2f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:29:50.251702 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:29:50.257044 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ef2c4421-78ee-4fb7-a3b6-44259b141200 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:50.257547 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ef2c4421-78ee-4fb7-a3b6-44259b141200 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:50.258096 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ef2c4421-78ee-4fb7-a3b6-44259b141200 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:50.258802 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ef2c4421-78ee-4fb7-a3b6-44259b141200 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:50.259264 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ef2c4421-78ee-4fb7-a3b6-44259b141200 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:50.259694 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ef2c4421-78ee-4fb7-a3b6-44259b141200 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:50.388098 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ef2c4421-78ee-4fb7-a3b6-44259b141200 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:29:50.396141 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ef2c4421-78ee-4fb7-a3b6-44259b141200 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f" status: 200 len: 1318 microversion: 2.1 time: 0.151432 Sep 23 05:29:50.396740 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3684/7189] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:29:50 2022] GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:29:51.419322 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7455c319-312f-4abb-83d9-0fec2387c802 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:29:51.419948 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7455c319-312f-4abb-83d9-0fec2387c802 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: b2f23f3b-a932-4d64-b6c1-189920f2ea2f] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:29:51.427384 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7455c319-312f-4abb-83d9-0fec2387c802 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:51.427888 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7455c319-312f-4abb-83d9-0fec2387c802 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:51.428342 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7455c319-312f-4abb-83d9-0fec2387c802 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:51.429049 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7455c319-312f-4abb-83d9-0fec2387c802 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:51.429517 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7455c319-312f-4abb-83d9-0fec2387c802 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:51.429983 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7455c319-312f-4abb-83d9-0fec2387c802 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:51.559184 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-7455c319-312f-4abb-83d9-0fec2387c802 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:29:51.567556 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7455c319-312f-4abb-83d9-0fec2387c802 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f" status: 200 len: 1318 microversion: 2.1 time: 0.152150 Sep 23 05:29:51.568145 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3506/7190] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:29:51 2022] GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:29:52.590055 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f59d6b6d-a2f0-4aab-82f6-0209e22c813f tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:29:52.590676 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f59d6b6d-a2f0-4aab-82f6-0209e22c813f tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: b2f23f3b-a932-4d64-b6c1-189920f2ea2f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:29:52.598326 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f59d6b6d-a2f0-4aab-82f6-0209e22c813f tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:52.598821 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f59d6b6d-a2f0-4aab-82f6-0209e22c813f tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:52.599265 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f59d6b6d-a2f0-4aab-82f6-0209e22c813f tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:52.599959 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f59d6b6d-a2f0-4aab-82f6-0209e22c813f tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:52.600422 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f59d6b6d-a2f0-4aab-82f6-0209e22c813f tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:52.600851 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f59d6b6d-a2f0-4aab-82f6-0209e22c813f tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:52.731139 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f59d6b6d-a2f0-4aab-82f6-0209e22c813f tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:29:52.739190 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f59d6b6d-a2f0-4aab-82f6-0209e22c813f tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f" status: 200 len: 1318 microversion: 2.1 time: 0.152990 Sep 23 05:29:52.739830 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3685/7191] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:29:52 2022] GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:29:52.929346 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-59265bdb-0f44-451f-a4b4-08edd6ea2a14 req-f6af944d-fe86-49f7-b98e-717f0c9808b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2f23f3b-a932-4d64-b6c1-189920f2ea2f", "name": "network-vif-plugged", "status": "completed", "tag": "d7e04581-d07a-4165-a40e-431bdbe66f75"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:29:52.940889 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-59265bdb-0f44-451f-a4b4-08edd6ea2a14 req-f6af944d-fe86-49f7-b98e-717f0c9808b3 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:52.941449 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-59265bdb-0f44-451f-a4b4-08edd6ea2a14 req-f6af944d-fe86-49f7-b98e-717f0c9808b3 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:52.941919 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-59265bdb-0f44-451f-a4b4-08edd6ea2a14 req-f6af944d-fe86-49f7-b98e-717f0c9808b3 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:52.953201 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-59265bdb-0f44-451f-a4b4-08edd6ea2a14 req-f6af944d-fe86-49f7-b98e-717f0c9808b3 service nova] Creating event network-vif-plugged:d7e04581-d07a-4165-a40e-431bdbe66f75 for instance b2f23f3b-a932-4d64-b6c1-189920f2ea2f on n-h2-846463-3 Sep 23 05:29:52.958564 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-59265bdb-0f44-451f-a4b4-08edd6ea2a14 req-f6af944d-fe86-49f7-b98e-717f0c9808b3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032785 Sep 23 05:29:52.959117 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3507/7192] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:29:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:29:53.762397 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6c02ae1c-e030-4aa7-ae30-93c836fc1469 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:29:53.763015 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-6c02ae1c-e030-4aa7-ae30-93c836fc1469 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: b2f23f3b-a932-4d64-b6c1-189920f2ea2f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:29:53.765909 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:29:53.771774 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6c02ae1c-e030-4aa7-ae30-93c836fc1469 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:53.772267 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6c02ae1c-e030-4aa7-ae30-93c836fc1469 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:53.772748 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6c02ae1c-e030-4aa7-ae30-93c836fc1469 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:53.773507 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6c02ae1c-e030-4aa7-ae30-93c836fc1469 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:53.773951 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6c02ae1c-e030-4aa7-ae30-93c836fc1469 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:53.777388 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6c02ae1c-e030-4aa7-ae30-93c836fc1469 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:53.906587 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-6c02ae1c-e030-4aa7-ae30-93c836fc1469 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:29:53.914857 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6c02ae1c-e030-4aa7-ae30-93c836fc1469 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f" status: 200 len: 1318 microversion: 2.1 time: 0.156348 Sep 23 05:29:53.915435 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3686/7193] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:29:53 2022] GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:29:54.935173 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:29:54.935986 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=10 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:29:54.940926 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e84670af-389a-4ebb-b47c-08e01f78ec36 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:29:54.941637 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e84670af-389a-4ebb-b47c-08e01f78ec36 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: b2f23f3b-a932-4d64-b6c1-189920f2ea2f] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:29:54.947815 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e84670af-389a-4ebb-b47c-08e01f78ec36 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:54.949663 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e84670af-389a-4ebb-b47c-08e01f78ec36 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:54.949663 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e84670af-389a-4ebb-b47c-08e01f78ec36 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:54.949663 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e84670af-389a-4ebb-b47c-08e01f78ec36 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:54.950006 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e84670af-389a-4ebb-b47c-08e01f78ec36 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:54.950383 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e84670af-389a-4ebb-b47c-08e01f78ec36 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:55.086840 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e84670af-389a-4ebb-b47c-08e01f78ec36 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:29:55.094723 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e84670af-389a-4ebb-b47c-08e01f78ec36 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f" status: 200 len: 1508 microversion: 2.1 time: 0.160608 Sep 23 05:29:55.095304 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3508/7194] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:29:54 2022] GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f => generated 1508 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:29:55.118133 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1b40a22e-3344-4034-92a4-5dbafe9a4b39 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:29:55.123689 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1b40a22e-3344-4034-92a4-5dbafe9a4b39 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: b2f23f3b-a932-4d64-b6c1-189920f2ea2f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:29:55.125187 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1b40a22e-3344-4034-92a4-5dbafe9a4b39 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:55.125675 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1b40a22e-3344-4034-92a4-5dbafe9a4b39 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:55.126175 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1b40a22e-3344-4034-92a4-5dbafe9a4b39 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:55.126900 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1b40a22e-3344-4034-92a4-5dbafe9a4b39 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:55.127370 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1b40a22e-3344-4034-92a4-5dbafe9a4b39 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:55.127797 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1b40a22e-3344-4034-92a4-5dbafe9a4b39 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:55.258472 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1b40a22e-3344-4034-92a4-5dbafe9a4b39 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:29:55.266474 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1b40a22e-3344-4034-92a4-5dbafe9a4b39 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f" status: 200 len: 1508 microversion: 2.1 time: 0.152185 Sep 23 05:29:55.267059 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3687/7195] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:29:55 2022] GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:29:55.289472 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8cda048b-9aaf-4e5b-9c5b-42f37f55fd50 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:29:55.291817 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8cda048b-9aaf-4e5b-9c5b-42f37f55fd50 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: b2f23f3b-a932-4d64-b6c1-189920f2ea2f] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:29:55.297811 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8cda048b-9aaf-4e5b-9c5b-42f37f55fd50 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:55.298356 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8cda048b-9aaf-4e5b-9c5b-42f37f55fd50 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:55.298819 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8cda048b-9aaf-4e5b-9c5b-42f37f55fd50 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:55.299525 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8cda048b-9aaf-4e5b-9c5b-42f37f55fd50 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:55.300009 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8cda048b-9aaf-4e5b-9c5b-42f37f55fd50 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:55.300458 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8cda048b-9aaf-4e5b-9c5b-42f37f55fd50 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:55.328241 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8cda048b-9aaf-4e5b-9c5b-42f37f55fd50 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:29:55.334470 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8cda048b-9aaf-4e5b-9c5b-42f37f55fd50 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: b2f23f3b-a932-4d64-b6c1-189920f2ea2f] Old instance type m1.heat2, new instance type m1.heat {{(pid=122698) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 23 05:29:55.341051 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-8cda048b-9aaf-4e5b-9c5b-42f37f55fd50 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Flavor limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 05:29:55.341494 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-8cda048b-9aaf-4e5b-9c5b-42f37f55fd50 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Image limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 05:29:55.342027 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-8cda048b-9aaf-4e5b-9c5b-42f37f55fd50 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Flavor pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 05:29:55.342463 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-8cda048b-9aaf-4e5b-9c5b-42f37f55fd50 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Image pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 05:29:55.342902 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-8cda048b-9aaf-4e5b-9c5b-42f37f55fd50 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 05:29:55.559472 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8cda048b-9aaf-4e5b-9c5b-42f37f55fd50 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "POST /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f/action" status: 202 len: 0 microversion: 2.1 time: 0.273793 Sep 23 05:29:55.560023 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3509/7196] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 05:29:55 2022] POST /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f/action => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 05:29:55.575829 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1399c391-4123-4e3b-a3d4-e4329a75eae2 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:29:55.576530 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1399c391-4123-4e3b-a3d4-e4329a75eae2 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: b2f23f3b-a932-4d64-b6c1-189920f2ea2f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:29:55.583409 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1399c391-4123-4e3b-a3d4-e4329a75eae2 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:55.583982 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1399c391-4123-4e3b-a3d4-e4329a75eae2 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:55.584507 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1399c391-4123-4e3b-a3d4-e4329a75eae2 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:55.585286 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1399c391-4123-4e3b-a3d4-e4329a75eae2 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:55.585828 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1399c391-4123-4e3b-a3d4-e4329a75eae2 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:55.586378 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1399c391-4123-4e3b-a3d4-e4329a75eae2 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:55.727053 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1399c391-4123-4e3b-a3d4-e4329a75eae2 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:29:55.736273 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1399c391-4123-4e3b-a3d4-e4329a75eae2 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f" status: 200 len: 1515 microversion: 2.1 time: 0.164405 Sep 23 05:29:55.750106 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3688/7197] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:29:55 2022] GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f => generated 1515 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:29:56.761570 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0a799f23-378b-4547-977d-1f651c043ca9 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:29:56.762134 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-0a799f23-378b-4547-977d-1f651c043ca9 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: b2f23f3b-a932-4d64-b6c1-189920f2ea2f] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:29:56.769830 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0a799f23-378b-4547-977d-1f651c043ca9 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:56.770388 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0a799f23-378b-4547-977d-1f651c043ca9 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:56.770901 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0a799f23-378b-4547-977d-1f651c043ca9 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:56.771611 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0a799f23-378b-4547-977d-1f651c043ca9 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:56.772086 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0a799f23-378b-4547-977d-1f651c043ca9 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:56.772524 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0a799f23-378b-4547-977d-1f651c043ca9 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:56.904145 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-0a799f23-378b-4547-977d-1f651c043ca9 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:29:56.912644 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0a799f23-378b-4547-977d-1f651c043ca9 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f" status: 200 len: 1515 microversion: 2.1 time: 0.155994 Sep 23 05:29:56.913152 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3510/7198] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:29:56 2022] GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:29:57.936145 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b9d965e0-5eee-4b6e-a16e-a54daec649f3 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:29:57.936767 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b9d965e0-5eee-4b6e-a16e-a54daec649f3 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: b2f23f3b-a932-4d64-b6c1-189920f2ea2f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:29:57.943312 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b9d965e0-5eee-4b6e-a16e-a54daec649f3 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:57.943810 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b9d965e0-5eee-4b6e-a16e-a54daec649f3 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:57.944277 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b9d965e0-5eee-4b6e-a16e-a54daec649f3 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:57.944965 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b9d965e0-5eee-4b6e-a16e-a54daec649f3 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:57.945426 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b9d965e0-5eee-4b6e-a16e-a54daec649f3 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:57.945877 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b9d965e0-5eee-4b6e-a16e-a54daec649f3 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:58.083993 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b9d965e0-5eee-4b6e-a16e-a54daec649f3 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:29:58.092231 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b9d965e0-5eee-4b6e-a16e-a54daec649f3 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f" status: 200 len: 1515 microversion: 2.1 time: 0.160091 Sep 23 05:29:58.092824 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3689/7199] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:29:57 2022] GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:29:59.120897 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5e160158-2955-4d22-a904-dd5f4a931fbf tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:29:59.121542 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5e160158-2955-4d22-a904-dd5f4a931fbf tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: b2f23f3b-a932-4d64-b6c1-189920f2ea2f] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:29:59.129219 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5e160158-2955-4d22-a904-dd5f4a931fbf tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:59.129733 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5e160158-2955-4d22-a904-dd5f4a931fbf tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:59.130237 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5e160158-2955-4d22-a904-dd5f4a931fbf tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:59.130958 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5e160158-2955-4d22-a904-dd5f4a931fbf tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:29:59.131438 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5e160158-2955-4d22-a904-dd5f4a931fbf tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:29:59.131895 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5e160158-2955-4d22-a904-dd5f4a931fbf tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:29:59.261138 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-5e160158-2955-4d22-a904-dd5f4a931fbf tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:29:59.269106 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5e160158-2955-4d22-a904-dd5f4a931fbf tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f" status: 200 len: 1520 microversion: 2.1 time: 0.152182 Sep 23 05:29:59.269679 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3511/7200] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:29:59 2022] GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:30:00.292568 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d311a4ad-ccff-4a97-991b-084608c43e12 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:30:00.293195 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d311a4ad-ccff-4a97-991b-084608c43e12 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: b2f23f3b-a932-4d64-b6c1-189920f2ea2f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:30:00.300370 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d311a4ad-ccff-4a97-991b-084608c43e12 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:30:00.300862 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d311a4ad-ccff-4a97-991b-084608c43e12 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:30:00.301295 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d311a4ad-ccff-4a97-991b-084608c43e12 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:30:00.302013 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d311a4ad-ccff-4a97-991b-084608c43e12 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:30:00.302471 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d311a4ad-ccff-4a97-991b-084608c43e12 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:30:00.302901 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d311a4ad-ccff-4a97-991b-084608c43e12 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:30:00.430935 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d311a4ad-ccff-4a97-991b-084608c43e12 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:30:00.438698 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d311a4ad-ccff-4a97-991b-084608c43e12 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f" status: 200 len: 1520 microversion: 2.1 time: 0.150000 Sep 23 05:30:00.439267 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3690/7201] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:30:00 2022] GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:30:01.461195 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7b200381-707b-4713-9201-6c1aaed2a1a3 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:30:01.461821 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7b200381-707b-4713-9201-6c1aaed2a1a3 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: b2f23f3b-a932-4d64-b6c1-189920f2ea2f] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:30:01.467956 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7b200381-707b-4713-9201-6c1aaed2a1a3 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:30:01.468458 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7b200381-707b-4713-9201-6c1aaed2a1a3 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:30:01.468910 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7b200381-707b-4713-9201-6c1aaed2a1a3 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:30:01.469612 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7b200381-707b-4713-9201-6c1aaed2a1a3 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:30:01.470121 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7b200381-707b-4713-9201-6c1aaed2a1a3 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:30:01.470564 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7b200381-707b-4713-9201-6c1aaed2a1a3 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:30:01.605390 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-7b200381-707b-4713-9201-6c1aaed2a1a3 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:30:01.614038 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7b200381-707b-4713-9201-6c1aaed2a1a3 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f" status: 200 len: 1520 microversion: 2.1 time: 0.157018 Sep 23 05:30:01.614632 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3512/7202] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:30:01 2022] GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:30:02.637146 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-34dae60e-5b77-4667-8555-344e8cb8902d tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:30:02.637767 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-34dae60e-5b77-4667-8555-344e8cb8902d tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: b2f23f3b-a932-4d64-b6c1-189920f2ea2f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:30:02.645210 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-34dae60e-5b77-4667-8555-344e8cb8902d tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:30:02.645704 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-34dae60e-5b77-4667-8555-344e8cb8902d tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:30:02.646185 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-34dae60e-5b77-4667-8555-344e8cb8902d tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:30:02.646887 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-34dae60e-5b77-4667-8555-344e8cb8902d tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:30:02.647354 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-34dae60e-5b77-4667-8555-344e8cb8902d tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:30:02.647792 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-34dae60e-5b77-4667-8555-344e8cb8902d tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:30:02.774846 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-34dae60e-5b77-4667-8555-344e8cb8902d tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:30:02.782616 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-34dae60e-5b77-4667-8555-344e8cb8902d tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f" status: 200 len: 1520 microversion: 2.1 time: 0.149385 Sep 23 05:30:02.783194 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3691/7203] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:30:02 2022] GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:30:03.805040 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-05b912cf-37f0-4bdc-97cd-f647cf6f5fad tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:30:03.805707 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-05b912cf-37f0-4bdc-97cd-f647cf6f5fad tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: b2f23f3b-a932-4d64-b6c1-189920f2ea2f] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:30:03.814360 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-05b912cf-37f0-4bdc-97cd-f647cf6f5fad tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:30:03.814934 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-05b912cf-37f0-4bdc-97cd-f647cf6f5fad tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:30:03.815405 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-05b912cf-37f0-4bdc-97cd-f647cf6f5fad tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:30:03.816143 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-05b912cf-37f0-4bdc-97cd-f647cf6f5fad tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:30:03.816625 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-05b912cf-37f0-4bdc-97cd-f647cf6f5fad tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:30:03.817074 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-05b912cf-37f0-4bdc-97cd-f647cf6f5fad tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:30:03.951409 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-05b912cf-37f0-4bdc-97cd-f647cf6f5fad tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:30:03.959911 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-05b912cf-37f0-4bdc-97cd-f647cf6f5fad tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f" status: 200 len: 1520 microversion: 2.1 time: 0.159037 Sep 23 05:30:03.960482 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3513/7204] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:30:03 2022] GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:30:04.982681 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-91bc1701-46ce-43cd-8d1d-68423239ede6 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:30:04.983288 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-91bc1701-46ce-43cd-8d1d-68423239ede6 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: b2f23f3b-a932-4d64-b6c1-189920f2ea2f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:30:04.989323 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-91bc1701-46ce-43cd-8d1d-68423239ede6 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:30:04.989807 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-91bc1701-46ce-43cd-8d1d-68423239ede6 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:30:04.990275 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-91bc1701-46ce-43cd-8d1d-68423239ede6 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:30:04.990967 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-91bc1701-46ce-43cd-8d1d-68423239ede6 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:30:04.991422 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-91bc1701-46ce-43cd-8d1d-68423239ede6 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:30:04.991837 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-91bc1701-46ce-43cd-8d1d-68423239ede6 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:30:05.120253 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-91bc1701-46ce-43cd-8d1d-68423239ede6 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:30:05.127927 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-91bc1701-46ce-43cd-8d1d-68423239ede6 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f" status: 200 len: 1520 microversion: 2.1 time: 0.149306 Sep 23 05:30:05.128492 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3692/7205] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:30:04 2022] GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:30:06.152083 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0979bcc8-f6e9-437e-a0d9-d64c1265676d tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:30:06.152704 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-0979bcc8-f6e9-437e-a0d9-d64c1265676d tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: b2f23f3b-a932-4d64-b6c1-189920f2ea2f] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:30:06.161424 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0979bcc8-f6e9-437e-a0d9-d64c1265676d tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:30:06.161951 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0979bcc8-f6e9-437e-a0d9-d64c1265676d tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:30:06.163398 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0979bcc8-f6e9-437e-a0d9-d64c1265676d tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:30:06.164099 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0979bcc8-f6e9-437e-a0d9-d64c1265676d tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:30:06.164593 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0979bcc8-f6e9-437e-a0d9-d64c1265676d tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:30:06.165048 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0979bcc8-f6e9-437e-a0d9-d64c1265676d tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:30:06.327037 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-0979bcc8-f6e9-437e-a0d9-d64c1265676d tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:30:06.336133 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0979bcc8-f6e9-437e-a0d9-d64c1265676d tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f" status: 200 len: 1520 microversion: 2.1 time: 0.187068 Sep 23 05:30:06.339156 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3514/7206] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:30:06 2022] GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f => generated 1520 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:30:07.362582 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-fcdd9d6e-c4ff-4887-94d0-f6c2fc969626 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:30:07.363190 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-fcdd9d6e-c4ff-4887-94d0-f6c2fc969626 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: b2f23f3b-a932-4d64-b6c1-189920f2ea2f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:30:07.371852 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fcdd9d6e-c4ff-4887-94d0-f6c2fc969626 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:30:07.372340 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fcdd9d6e-c4ff-4887-94d0-f6c2fc969626 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:30:07.372778 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fcdd9d6e-c4ff-4887-94d0-f6c2fc969626 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:30:07.373476 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fcdd9d6e-c4ff-4887-94d0-f6c2fc969626 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:30:07.373957 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fcdd9d6e-c4ff-4887-94d0-f6c2fc969626 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:30:07.374389 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fcdd9d6e-c4ff-4887-94d0-f6c2fc969626 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:30:07.506074 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-fcdd9d6e-c4ff-4887-94d0-f6c2fc969626 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:30:07.513814 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-fcdd9d6e-c4ff-4887-94d0-f6c2fc969626 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f" status: 200 len: 1520 microversion: 2.1 time: 0.155630 Sep 23 05:30:07.514425 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3693/7207] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:30:07 2022] GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:30:08.536752 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3f05323d-46d0-4112-b1b0-d63df22b4027 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:30:08.537384 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3f05323d-46d0-4112-b1b0-d63df22b4027 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: b2f23f3b-a932-4d64-b6c1-189920f2ea2f] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:30:08.544318 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3f05323d-46d0-4112-b1b0-d63df22b4027 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:30:08.544827 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3f05323d-46d0-4112-b1b0-d63df22b4027 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:30:08.545284 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3f05323d-46d0-4112-b1b0-d63df22b4027 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:30:08.546026 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3f05323d-46d0-4112-b1b0-d63df22b4027 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:30:08.546504 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3f05323d-46d0-4112-b1b0-d63df22b4027 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:30:08.546948 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3f05323d-46d0-4112-b1b0-d63df22b4027 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:30:08.674532 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-3f05323d-46d0-4112-b1b0-d63df22b4027 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:30:08.682290 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3f05323d-46d0-4112-b1b0-d63df22b4027 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f" status: 200 len: 1520 microversion: 2.1 time: 0.149468 Sep 23 05:30:08.682873 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3515/7208] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:30:08 2022] GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:30:09.706456 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4d5451ff-c5b8-4dc0-92c4-1d4f23d2b0d6 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:30:09.707131 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4d5451ff-c5b8-4dc0-92c4-1d4f23d2b0d6 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: b2f23f3b-a932-4d64-b6c1-189920f2ea2f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:30:09.713632 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4d5451ff-c5b8-4dc0-92c4-1d4f23d2b0d6 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:30:09.714161 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4d5451ff-c5b8-4dc0-92c4-1d4f23d2b0d6 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:30:09.714611 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4d5451ff-c5b8-4dc0-92c4-1d4f23d2b0d6 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:30:09.715312 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4d5451ff-c5b8-4dc0-92c4-1d4f23d2b0d6 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:30:09.715776 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4d5451ff-c5b8-4dc0-92c4-1d4f23d2b0d6 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:30:09.716208 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4d5451ff-c5b8-4dc0-92c4-1d4f23d2b0d6 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:30:09.862234 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-4d5451ff-c5b8-4dc0-92c4-1d4f23d2b0d6 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:30:09.862234 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4d5451ff-c5b8-4dc0-92c4-1d4f23d2b0d6 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f" status: 200 len: 1520 microversion: 2.1 time: 0.156476 Sep 23 05:30:09.862234 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3694/7209] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:30:09 2022] GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:30:10.881687 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-65a6ee0b-d64b-45b2-a388-14c30f469afb tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:30:10.882364 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-65a6ee0b-d64b-45b2-a388-14c30f469afb tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: b2f23f3b-a932-4d64-b6c1-189920f2ea2f] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:30:10.889354 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-65a6ee0b-d64b-45b2-a388-14c30f469afb tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:30:10.889908 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-65a6ee0b-d64b-45b2-a388-14c30f469afb tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:30:10.890399 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-65a6ee0b-d64b-45b2-a388-14c30f469afb tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:30:10.891366 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-65a6ee0b-d64b-45b2-a388-14c30f469afb tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:30:10.892330 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-65a6ee0b-d64b-45b2-a388-14c30f469afb tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:30:10.892776 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-65a6ee0b-d64b-45b2-a388-14c30f469afb tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:30:11.019586 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-65a6ee0b-d64b-45b2-a388-14c30f469afb tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:30:11.027277 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-65a6ee0b-d64b-45b2-a388-14c30f469afb tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f" status: 200 len: 1520 microversion: 2.1 time: 0.149578 Sep 23 05:30:11.027850 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3516/7210] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:30:10 2022] GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:30:12.051429 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-526e6c3a-dae5-412c-8ed7-1105900f276c tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:30:12.052091 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-526e6c3a-dae5-412c-8ed7-1105900f276c tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: b2f23f3b-a932-4d64-b6c1-189920f2ea2f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:30:12.058598 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-526e6c3a-dae5-412c-8ed7-1105900f276c tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:30:12.059084 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-526e6c3a-dae5-412c-8ed7-1105900f276c tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:30:12.059521 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-526e6c3a-dae5-412c-8ed7-1105900f276c tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:30:12.060203 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-526e6c3a-dae5-412c-8ed7-1105900f276c tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:30:12.060685 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-526e6c3a-dae5-412c-8ed7-1105900f276c tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:30:12.061124 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-526e6c3a-dae5-412c-8ed7-1105900f276c tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:30:12.193105 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-526e6c3a-dae5-412c-8ed7-1105900f276c tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:30:12.200771 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-526e6c3a-dae5-412c-8ed7-1105900f276c tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f" status: 200 len: 1520 microversion: 2.1 time: 0.153834 Sep 23 05:30:12.201337 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3695/7211] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:30:12 2022] GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:30:13.226991 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1f87f9e1-ab0f-4bd3-89af-91185232df0c tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:30:13.227632 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-1f87f9e1-ab0f-4bd3-89af-91185232df0c tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: b2f23f3b-a932-4d64-b6c1-189920f2ea2f] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:30:13.237184 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1f87f9e1-ab0f-4bd3-89af-91185232df0c tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:30:13.237695 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1f87f9e1-ab0f-4bd3-89af-91185232df0c tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:30:13.238187 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1f87f9e1-ab0f-4bd3-89af-91185232df0c tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:30:13.238913 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1f87f9e1-ab0f-4bd3-89af-91185232df0c tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:30:13.239390 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1f87f9e1-ab0f-4bd3-89af-91185232df0c tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:30:13.239842 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1f87f9e1-ab0f-4bd3-89af-91185232df0c tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:30:13.369042 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-1f87f9e1-ab0f-4bd3-89af-91185232df0c tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:30:13.371311 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:30:13.378167 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-1f87f9e1-ab0f-4bd3-89af-91185232df0c tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f" status: 200 len: 1520 microversion: 2.1 time: 0.155289 Sep 23 05:30:13.378820 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3517/7212] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:30:13 2022] GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:30:14.401293 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1658c272-fc69-44f8-b8d5-eab993734e55 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:30:14.401921 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1658c272-fc69-44f8-b8d5-eab993734e55 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: b2f23f3b-a932-4d64-b6c1-189920f2ea2f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:30:14.408388 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1658c272-fc69-44f8-b8d5-eab993734e55 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:30:14.408865 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1658c272-fc69-44f8-b8d5-eab993734e55 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:30:14.409295 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1658c272-fc69-44f8-b8d5-eab993734e55 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:30:14.410007 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1658c272-fc69-44f8-b8d5-eab993734e55 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:30:14.410460 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1658c272-fc69-44f8-b8d5-eab993734e55 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:30:14.410909 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1658c272-fc69-44f8-b8d5-eab993734e55 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:30:14.538741 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1658c272-fc69-44f8-b8d5-eab993734e55 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:30:14.546415 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1658c272-fc69-44f8-b8d5-eab993734e55 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f" status: 200 len: 1520 microversion: 2.1 time: 0.148909 Sep 23 05:30:14.546996 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3696/7213] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:30:14 2022] GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:30:15.569413 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-97b9cead-f4cb-4372-9555-31650dae65be tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:30:15.570106 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-97b9cead-f4cb-4372-9555-31650dae65be tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: b2f23f3b-a932-4d64-b6c1-189920f2ea2f] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:30:15.577663 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-97b9cead-f4cb-4372-9555-31650dae65be tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:30:15.578207 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-97b9cead-f4cb-4372-9555-31650dae65be tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:30:15.578669 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-97b9cead-f4cb-4372-9555-31650dae65be tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:30:15.579928 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-97b9cead-f4cb-4372-9555-31650dae65be tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:30:15.580364 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-97b9cead-f4cb-4372-9555-31650dae65be tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:30:15.580815 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-97b9cead-f4cb-4372-9555-31650dae65be tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:30:15.716054 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-97b9cead-f4cb-4372-9555-31650dae65be tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:30:15.724444 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-97b9cead-f4cb-4372-9555-31650dae65be tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f" status: 200 len: 1520 microversion: 2.1 time: 0.158941 Sep 23 05:30:15.725035 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3518/7214] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:30:15 2022] GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:30:16.748448 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a1317e13-46d7-40f8-9a2d-67506a4a8dab tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:30:16.749186 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a1317e13-46d7-40f8-9a2d-67506a4a8dab tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: b2f23f3b-a932-4d64-b6c1-189920f2ea2f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:30:16.756151 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a1317e13-46d7-40f8-9a2d-67506a4a8dab tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:30:16.756669 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a1317e13-46d7-40f8-9a2d-67506a4a8dab tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:30:16.757117 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a1317e13-46d7-40f8-9a2d-67506a4a8dab tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:30:16.757820 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a1317e13-46d7-40f8-9a2d-67506a4a8dab tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:30:16.758311 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a1317e13-46d7-40f8-9a2d-67506a4a8dab tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:30:16.758742 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a1317e13-46d7-40f8-9a2d-67506a4a8dab tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:30:16.894445 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a1317e13-46d7-40f8-9a2d-67506a4a8dab tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:30:16.902359 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a1317e13-46d7-40f8-9a2d-67506a4a8dab tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f" status: 200 len: 1520 microversion: 2.1 time: 0.157849 Sep 23 05:30:16.902933 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3697/7215] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:30:16 2022] GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:30:17.926827 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6c34e14d-7cc5-48a8-91d3-2dbe75549393 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:30:17.927457 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-6c34e14d-7cc5-48a8-91d3-2dbe75549393 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: b2f23f3b-a932-4d64-b6c1-189920f2ea2f] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:30:17.930295 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=36 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:30:17.934974 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6c34e14d-7cc5-48a8-91d3-2dbe75549393 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:30:17.935490 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6c34e14d-7cc5-48a8-91d3-2dbe75549393 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:30:17.935946 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6c34e14d-7cc5-48a8-91d3-2dbe75549393 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:30:17.936659 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6c34e14d-7cc5-48a8-91d3-2dbe75549393 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:30:17.937134 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6c34e14d-7cc5-48a8-91d3-2dbe75549393 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:30:17.937606 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6c34e14d-7cc5-48a8-91d3-2dbe75549393 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:30:18.070957 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6c34e14d-7cc5-48a8-91d3-2dbe75549393 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:30:18.078959 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-6c34e14d-7cc5-48a8-91d3-2dbe75549393 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f" status: 200 len: 1520 microversion: 2.1 time: 0.156628 Sep 23 05:30:18.079540 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3519/7216] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:30:17 2022] GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:30:19.101197 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9b6176ee-e15e-4b8b-bc02-6f3614a6b29f tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:30:19.101840 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-9b6176ee-e15e-4b8b-bc02-6f3614a6b29f tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: b2f23f3b-a932-4d64-b6c1-189920f2ea2f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:30:19.108131 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9b6176ee-e15e-4b8b-bc02-6f3614a6b29f tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:30:19.108624 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9b6176ee-e15e-4b8b-bc02-6f3614a6b29f tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:30:19.109066 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9b6176ee-e15e-4b8b-bc02-6f3614a6b29f tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:30:19.109762 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9b6176ee-e15e-4b8b-bc02-6f3614a6b29f tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:30:19.110260 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9b6176ee-e15e-4b8b-bc02-6f3614a6b29f tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:30:19.110693 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9b6176ee-e15e-4b8b-bc02-6f3614a6b29f tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:30:19.113779 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=93 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:30:19.246955 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-9b6176ee-e15e-4b8b-bc02-6f3614a6b29f tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:30:19.255824 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-9b6176ee-e15e-4b8b-bc02-6f3614a6b29f tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f" status: 200 len: 1520 microversion: 2.1 time: 0.158518 Sep 23 05:30:19.256408 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3698/7217] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:30:19 2022] GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:30:20.279383 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-21ea9a64-ccf2-41a2-8c65-9512c80eddde tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:30:20.280001 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-21ea9a64-ccf2-41a2-8c65-9512c80eddde tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: b2f23f3b-a932-4d64-b6c1-189920f2ea2f] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:30:20.287965 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-21ea9a64-ccf2-41a2-8c65-9512c80eddde tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:30:20.288484 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-21ea9a64-ccf2-41a2-8c65-9512c80eddde tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:30:20.288946 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-21ea9a64-ccf2-41a2-8c65-9512c80eddde tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:30:20.289665 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-21ea9a64-ccf2-41a2-8c65-9512c80eddde tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:30:20.290175 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-21ea9a64-ccf2-41a2-8c65-9512c80eddde tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:30:20.290629 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-21ea9a64-ccf2-41a2-8c65-9512c80eddde tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:30:20.420480 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-21ea9a64-ccf2-41a2-8c65-9512c80eddde tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:30:20.428250 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-21ea9a64-ccf2-41a2-8c65-9512c80eddde tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f" status: 200 len: 1520 microversion: 2.1 time: 0.152896 Sep 23 05:30:20.428840 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3520/7218] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:30:20 2022] GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:30:21.451757 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-43bd7409-75e0-40d0-a020-abe1d9f96a25 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:30:21.452412 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-43bd7409-75e0-40d0-a020-abe1d9f96a25 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: b2f23f3b-a932-4d64-b6c1-189920f2ea2f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:30:21.455280 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=30 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:30:21.460012 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-43bd7409-75e0-40d0-a020-abe1d9f96a25 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:30:21.460516 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-43bd7409-75e0-40d0-a020-abe1d9f96a25 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:30:21.460964 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-43bd7409-75e0-40d0-a020-abe1d9f96a25 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:30:21.461765 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-43bd7409-75e0-40d0-a020-abe1d9f96a25 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:30:21.462286 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-43bd7409-75e0-40d0-a020-abe1d9f96a25 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:30:21.462701 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-43bd7409-75e0-40d0-a020-abe1d9f96a25 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:30:21.595943 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-43bd7409-75e0-40d0-a020-abe1d9f96a25 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:30:21.603707 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-43bd7409-75e0-40d0-a020-abe1d9f96a25 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f" status: 200 len: 1520 microversion: 2.1 time: 0.155794 Sep 23 05:30:21.604287 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3699/7219] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:30:21 2022] GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:30:22.626852 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-438f7f5a-9ae2-48a5-b683-b51c3f8e4380 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:30:22.627484 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-438f7f5a-9ae2-48a5-b683-b51c3f8e4380 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: b2f23f3b-a932-4d64-b6c1-189920f2ea2f] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:30:22.634472 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-438f7f5a-9ae2-48a5-b683-b51c3f8e4380 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:30:22.634986 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-438f7f5a-9ae2-48a5-b683-b51c3f8e4380 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:30:22.635449 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-438f7f5a-9ae2-48a5-b683-b51c3f8e4380 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:30:22.636212 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-438f7f5a-9ae2-48a5-b683-b51c3f8e4380 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:30:22.636694 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-438f7f5a-9ae2-48a5-b683-b51c3f8e4380 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:30:22.637143 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-438f7f5a-9ae2-48a5-b683-b51c3f8e4380 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:30:22.768972 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-438f7f5a-9ae2-48a5-b683-b51c3f8e4380 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:30:22.776743 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-438f7f5a-9ae2-48a5-b683-b51c3f8e4380 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f" status: 200 len: 1520 microversion: 2.1 time: 0.153917 Sep 23 05:30:22.777320 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3521/7220] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:30:22 2022] GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:30:23.800660 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c6670131-910a-4187-b20d-804dbf24d823 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:30:23.801278 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c6670131-910a-4187-b20d-804dbf24d823 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: b2f23f3b-a932-4d64-b6c1-189920f2ea2f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:30:23.807891 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c6670131-910a-4187-b20d-804dbf24d823 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:30:23.808386 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c6670131-910a-4187-b20d-804dbf24d823 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:30:23.808829 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c6670131-910a-4187-b20d-804dbf24d823 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:30:23.809554 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c6670131-910a-4187-b20d-804dbf24d823 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:30:23.810047 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c6670131-910a-4187-b20d-804dbf24d823 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:30:23.810485 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c6670131-910a-4187-b20d-804dbf24d823 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:30:23.946761 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c6670131-910a-4187-b20d-804dbf24d823 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:30:23.954948 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c6670131-910a-4187-b20d-804dbf24d823 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f" status: 200 len: 1520 microversion: 2.1 time: 0.158691 Sep 23 05:30:23.955529 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3700/7221] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:30:23 2022] GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:30:24.978151 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-05c7dcb6-0af4-456a-8614-a88e034b4ff8 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:30:24.978768 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-05c7dcb6-0af4-456a-8614-a88e034b4ff8 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: b2f23f3b-a932-4d64-b6c1-189920f2ea2f] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:30:24.986853 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-05c7dcb6-0af4-456a-8614-a88e034b4ff8 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:30:24.987367 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-05c7dcb6-0af4-456a-8614-a88e034b4ff8 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:30:24.987826 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-05c7dcb6-0af4-456a-8614-a88e034b4ff8 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:30:24.988544 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-05c7dcb6-0af4-456a-8614-a88e034b4ff8 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:30:24.989023 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-05c7dcb6-0af4-456a-8614-a88e034b4ff8 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:30:24.989471 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-05c7dcb6-0af4-456a-8614-a88e034b4ff8 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:30:25.117782 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-05c7dcb6-0af4-456a-8614-a88e034b4ff8 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:30:25.125726 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-05c7dcb6-0af4-456a-8614-a88e034b4ff8 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f" status: 200 len: 1520 microversion: 2.1 time: 0.151597 Sep 23 05:30:25.126339 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3522/7222] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:30:24 2022] GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:30:26.149742 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e3ea957e-8ac7-4c9e-bec5-a5eec7bc41f4 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:30:26.150412 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e3ea957e-8ac7-4c9e-bec5-a5eec7bc41f4 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: b2f23f3b-a932-4d64-b6c1-189920f2ea2f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:30:26.156941 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e3ea957e-8ac7-4c9e-bec5-a5eec7bc41f4 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:30:26.157429 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e3ea957e-8ac7-4c9e-bec5-a5eec7bc41f4 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:30:26.157873 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e3ea957e-8ac7-4c9e-bec5-a5eec7bc41f4 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:30:26.158595 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e3ea957e-8ac7-4c9e-bec5-a5eec7bc41f4 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:30:26.159061 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e3ea957e-8ac7-4c9e-bec5-a5eec7bc41f4 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:30:26.159494 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e3ea957e-8ac7-4c9e-bec5-a5eec7bc41f4 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:30:26.293447 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e3ea957e-8ac7-4c9e-bec5-a5eec7bc41f4 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:30:26.301906 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e3ea957e-8ac7-4c9e-bec5-a5eec7bc41f4 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f" status: 200 len: 1520 microversion: 2.1 time: 0.156099 Sep 23 05:30:26.302502 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3701/7223] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:30:26 2022] GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:30:27.329506 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8a003147-6517-49e6-ba44-71f02b9e8fd1 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:30:27.330152 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8a003147-6517-49e6-ba44-71f02b9e8fd1 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: b2f23f3b-a932-4d64-b6c1-189920f2ea2f] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:30:27.337141 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8a003147-6517-49e6-ba44-71f02b9e8fd1 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:30:27.337651 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8a003147-6517-49e6-ba44-71f02b9e8fd1 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:30:27.338158 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8a003147-6517-49e6-ba44-71f02b9e8fd1 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:30:27.338884 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8a003147-6517-49e6-ba44-71f02b9e8fd1 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:30:27.339373 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8a003147-6517-49e6-ba44-71f02b9e8fd1 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:30:27.339823 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8a003147-6517-49e6-ba44-71f02b9e8fd1 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:30:27.466496 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8a003147-6517-49e6-ba44-71f02b9e8fd1 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:30:27.474142 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8a003147-6517-49e6-ba44-71f02b9e8fd1 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f" status: 200 len: 1520 microversion: 2.1 time: 0.149068 Sep 23 05:30:27.474727 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3523/7224] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:30:27 2022] GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:30:28.497503 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9ab81364-ba57-497c-8070-268816244afc tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:30:28.498231 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-9ab81364-ba57-497c-8070-268816244afc tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: b2f23f3b-a932-4d64-b6c1-189920f2ea2f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:30:28.504788 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9ab81364-ba57-497c-8070-268816244afc tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:30:28.505283 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9ab81364-ba57-497c-8070-268816244afc tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:30:28.505729 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9ab81364-ba57-497c-8070-268816244afc tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:30:28.506463 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9ab81364-ba57-497c-8070-268816244afc tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:30:28.506969 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9ab81364-ba57-497c-8070-268816244afc tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:30:28.507398 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9ab81364-ba57-497c-8070-268816244afc tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:30:28.633699 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-9ab81364-ba57-497c-8070-268816244afc tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:30:28.636056 n-d-846463-3 devstack@n-api.service[122699]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 05:30:28.636195 n-d-846463-3 devstack@n-api.service[122699]: Fri Sep 23 05:30:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f (ip 10.222.0.33) !!! Sep 23 05:30:28.645594 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-9ab81364-ba57-497c-8070-268816244afc tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f" status: 200 len: 1520 microversion: 2.1 time: 0.151949 Sep 23 05:30:28.646207 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3702/7225] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:30:28 2022] GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:30:29.668582 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ba1fe915-c38d-4133-bc29-647627d84b72 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:30:29.669218 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-ba1fe915-c38d-4133-bc29-647627d84b72 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: b2f23f3b-a932-4d64-b6c1-189920f2ea2f] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:30:29.676915 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ba1fe915-c38d-4133-bc29-647627d84b72 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:30:29.677421 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ba1fe915-c38d-4133-bc29-647627d84b72 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:30:29.677877 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ba1fe915-c38d-4133-bc29-647627d84b72 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:30:29.678613 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ba1fe915-c38d-4133-bc29-647627d84b72 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:30:29.679087 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ba1fe915-c38d-4133-bc29-647627d84b72 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:30:29.679535 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ba1fe915-c38d-4133-bc29-647627d84b72 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:30:29.813101 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ba1fe915-c38d-4133-bc29-647627d84b72 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:30:29.820936 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ba1fe915-c38d-4133-bc29-647627d84b72 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f" status: 200 len: 1520 microversion: 2.1 time: 0.156272 Sep 23 05:30:29.821533 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3524/7226] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:30:29 2022] GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:30:30.844512 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-da035636-5190-473f-a1d3-f0db12245253 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:30:30.845127 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-da035636-5190-473f-a1d3-f0db12245253 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: b2f23f3b-a932-4d64-b6c1-189920f2ea2f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:30:30.851668 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-da035636-5190-473f-a1d3-f0db12245253 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:30:30.852154 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-da035636-5190-473f-a1d3-f0db12245253 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:30:30.852593 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-da035636-5190-473f-a1d3-f0db12245253 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:30:30.853286 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-da035636-5190-473f-a1d3-f0db12245253 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:30:30.853743 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-da035636-5190-473f-a1d3-f0db12245253 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:30:30.854191 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-da035636-5190-473f-a1d3-f0db12245253 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:30:30.989968 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-da035636-5190-473f-a1d3-f0db12245253 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:30:30.997971 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-da035636-5190-473f-a1d3-f0db12245253 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f" status: 200 len: 1519 microversion: 2.1 time: 0.157597 Sep 23 05:30:30.998594 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3703/7227] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:30:30 2022] GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:30:31.018117 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-1f8a4dc8-5c5a-40a6-b477-123f6cf3507b req-d0857a98-7f28-4bce-8b33-65de9156351b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2f23f3b-a932-4d64-b6c1-189920f2ea2f", "name": "network-vif-unplugged", "status": "completed", "tag": "d7e04581-d07a-4165-a40e-431bdbe66f75"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:30:31.027972 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-1f8a4dc8-5c5a-40a6-b477-123f6cf3507b req-d0857a98-7f28-4bce-8b33-65de9156351b service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:30:31.028473 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-1f8a4dc8-5c5a-40a6-b477-123f6cf3507b req-d0857a98-7f28-4bce-8b33-65de9156351b service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:30:31.028921 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-1f8a4dc8-5c5a-40a6-b477-123f6cf3507b req-d0857a98-7f28-4bce-8b33-65de9156351b service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:30:31.040629 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-1f8a4dc8-5c5a-40a6-b477-123f6cf3507b req-d0857a98-7f28-4bce-8b33-65de9156351b service nova] Creating event network-vif-unplugged:d7e04581-d07a-4165-a40e-431bdbe66f75 for instance b2f23f3b-a932-4d64-b6c1-189920f2ea2f on n-h1-846463-3 Sep 23 05:30:31.046331 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [req-1f8a4dc8-5c5a-40a6-b477-123f6cf3507b req-d0857a98-7f28-4bce-8b33-65de9156351b service nova] Instance b2f23f3b-a932-4d64-b6c1-189920f2ea2f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846463-3', 'n-h2-846463-3'} {{(pid=122698) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 23 05:30:31.057347 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-1f8a4dc8-5c5a-40a6-b477-123f6cf3507b req-d0857a98-7f28-4bce-8b33-65de9156351b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044070 Sep 23 05:30:31.057988 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3525/7228] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:30:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:30:32.022759 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7ef21553-0398-48d0-9cb9-2bc106eac636 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:30:32.023323 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-7ef21553-0398-48d0-9cb9-2bc106eac636 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: b2f23f3b-a932-4d64-b6c1-189920f2ea2f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:30:32.029912 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7ef21553-0398-48d0-9cb9-2bc106eac636 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:30:32.032278 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7ef21553-0398-48d0-9cb9-2bc106eac636 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:30:32.032278 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7ef21553-0398-48d0-9cb9-2bc106eac636 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:30:32.032278 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7ef21553-0398-48d0-9cb9-2bc106eac636 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:30:32.032782 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7ef21553-0398-48d0-9cb9-2bc106eac636 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:30:32.033220 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7ef21553-0398-48d0-9cb9-2bc106eac636 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:30:32.167165 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-7ef21553-0398-48d0-9cb9-2bc106eac636 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:30:32.175052 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-7ef21553-0398-48d0-9cb9-2bc106eac636 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f" status: 200 len: 1519 microversion: 2.1 time: 0.156295 Sep 23 05:30:32.175666 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3704/7229] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:30:32 2022] GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:30:33.073826 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-555a4962-f489-4a04-b6b7-8605cdb7ae08 req-ce939372-d749-4562-9b6d-bb9783176ead service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2f23f3b-a932-4d64-b6c1-189920f2ea2f", "tag": "d7e04581-d07a-4165-a40e-431bdbe66f75"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:30:33.083459 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-555a4962-f489-4a04-b6b7-8605cdb7ae08 req-ce939372-d749-4562-9b6d-bb9783176ead service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:30:33.083963 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-555a4962-f489-4a04-b6b7-8605cdb7ae08 req-ce939372-d749-4562-9b6d-bb9783176ead service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:30:33.084416 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-555a4962-f489-4a04-b6b7-8605cdb7ae08 req-ce939372-d749-4562-9b6d-bb9783176ead service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:30:33.096446 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-555a4962-f489-4a04-b6b7-8605cdb7ae08 req-ce939372-d749-4562-9b6d-bb9783176ead service nova] Creating event network-changed:d7e04581-d07a-4165-a40e-431bdbe66f75 for instance b2f23f3b-a932-4d64-b6c1-189920f2ea2f on n-h1-846463-3 Sep 23 05:30:33.101711 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [req-555a4962-f489-4a04-b6b7-8605cdb7ae08 req-ce939372-d749-4562-9b6d-bb9783176ead service nova] Instance b2f23f3b-a932-4d64-b6c1-189920f2ea2f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846463-3', 'n-h2-846463-3'} {{(pid=122698) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 23 05:30:33.112839 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-555a4962-f489-4a04-b6b7-8605cdb7ae08 req-ce939372-d749-4562-9b6d-bb9783176ead service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043964 Sep 23 05:30:33.113426 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3526/7230] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:30:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:30:33.197477 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2f3ef075-8700-4a53-9acf-b922db501f69 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:30:33.198152 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-2f3ef075-8700-4a53-9acf-b922db501f69 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: b2f23f3b-a932-4d64-b6c1-189920f2ea2f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:30:33.204909 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2f3ef075-8700-4a53-9acf-b922db501f69 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:30:33.205395 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2f3ef075-8700-4a53-9acf-b922db501f69 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:30:33.205832 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2f3ef075-8700-4a53-9acf-b922db501f69 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:30:33.206554 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2f3ef075-8700-4a53-9acf-b922db501f69 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:30:33.207009 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2f3ef075-8700-4a53-9acf-b922db501f69 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:30:33.207438 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2f3ef075-8700-4a53-9acf-b922db501f69 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:30:33.336826 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2f3ef075-8700-4a53-9acf-b922db501f69 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:30:33.346594 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2f3ef075-8700-4a53-9acf-b922db501f69 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f" status: 200 len: 1517 microversion: 2.1 time: 0.152898 Sep 23 05:30:33.357931 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3705/7231] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:30:33 2022] GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f => generated 1517 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:30:34.374109 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9788dc8b-c9b2-4a1a-9c04-af16ee1d2153 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:30:34.374755 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-9788dc8b-c9b2-4a1a-9c04-af16ee1d2153 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: b2f23f3b-a932-4d64-b6c1-189920f2ea2f] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:30:34.382202 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9788dc8b-c9b2-4a1a-9c04-af16ee1d2153 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:30:34.382716 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9788dc8b-c9b2-4a1a-9c04-af16ee1d2153 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:30:34.383175 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9788dc8b-c9b2-4a1a-9c04-af16ee1d2153 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:30:34.383905 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9788dc8b-c9b2-4a1a-9c04-af16ee1d2153 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:30:34.384381 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9788dc8b-c9b2-4a1a-9c04-af16ee1d2153 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:30:34.384827 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9788dc8b-c9b2-4a1a-9c04-af16ee1d2153 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:30:34.522813 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-9788dc8b-c9b2-4a1a-9c04-af16ee1d2153 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:30:34.530831 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9788dc8b-c9b2-4a1a-9c04-af16ee1d2153 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f" status: 200 len: 1514 microversion: 2.1 time: 0.162446 Sep 23 05:30:34.531917 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3527/7232] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:30:34 2022] GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f => generated 1514 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:30:34.554171 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d0e67131-0754-4dee-b67c-e30925c2e787 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:30:34.554960 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d0e67131-0754-4dee-b67c-e30925c2e787 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: b2f23f3b-a932-4d64-b6c1-189920f2ea2f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:30:34.561037 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d0e67131-0754-4dee-b67c-e30925c2e787 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:30:34.561529 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d0e67131-0754-4dee-b67c-e30925c2e787 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:30:34.561986 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d0e67131-0754-4dee-b67c-e30925c2e787 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:30:34.562805 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d0e67131-0754-4dee-b67c-e30925c2e787 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:30:34.563259 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d0e67131-0754-4dee-b67c-e30925c2e787 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:30:34.563683 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d0e67131-0754-4dee-b67c-e30925c2e787 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:30:34.738212 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d0e67131-0754-4dee-b67c-e30925c2e787 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "POST /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f/action" status: 204 len: 0 microversion: 2.1 time: 0.187755 Sep 23 05:30:34.738803 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3706/7233] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 05:30:34 2022] POST /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f/action => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 05:30:34.748249 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-71caa5b1-acd3-417c-aa12-05a360c41d4e tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:30:34.749267 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-71caa5b1-acd3-417c-aa12-05a360c41d4e tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: b2f23f3b-a932-4d64-b6c1-189920f2ea2f] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:30:34.755448 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-71caa5b1-acd3-417c-aa12-05a360c41d4e tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:30:34.758502 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-71caa5b1-acd3-417c-aa12-05a360c41d4e tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:30:34.758502 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-71caa5b1-acd3-417c-aa12-05a360c41d4e tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:30:34.758502 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-71caa5b1-acd3-417c-aa12-05a360c41d4e tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:30:34.758502 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-71caa5b1-acd3-417c-aa12-05a360c41d4e tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:30:34.758502 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-71caa5b1-acd3-417c-aa12-05a360c41d4e tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:30:34.894925 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-71caa5b1-acd3-417c-aa12-05a360c41d4e tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:30:34.902979 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-71caa5b1-acd3-417c-aa12-05a360c41d4e tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f" status: 200 len: 1514 microversion: 2.1 time: 0.159174 Sep 23 05:30:34.903573 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3528/7234] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:30:34 2022] GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:30:35.927919 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4c65845e-6ed6-47ff-bd2e-1e2122f45b97 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:30:35.928757 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4c65845e-6ed6-47ff-bd2e-1e2122f45b97 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: b2f23f3b-a932-4d64-b6c1-189920f2ea2f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:30:35.934968 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4c65845e-6ed6-47ff-bd2e-1e2122f45b97 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:30:35.935468 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4c65845e-6ed6-47ff-bd2e-1e2122f45b97 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:30:35.935917 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4c65845e-6ed6-47ff-bd2e-1e2122f45b97 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:30:35.936621 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4c65845e-6ed6-47ff-bd2e-1e2122f45b97 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:30:35.937084 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4c65845e-6ed6-47ff-bd2e-1e2122f45b97 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:30:35.937517 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4c65845e-6ed6-47ff-bd2e-1e2122f45b97 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:30:36.080527 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-4c65845e-6ed6-47ff-bd2e-1e2122f45b97 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:30:36.089309 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4c65845e-6ed6-47ff-bd2e-1e2122f45b97 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f" status: 200 len: 1514 microversion: 2.1 time: 0.166215 Sep 23 05:30:36.089902 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3707/7235] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:30:35 2022] GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f => generated 1514 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:30:37.114759 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e87d1a56-4943-4020-906f-bdfb5b97b829 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:30:37.115395 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e87d1a56-4943-4020-906f-bdfb5b97b829 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: b2f23f3b-a932-4d64-b6c1-189920f2ea2f] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:30:37.122376 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e87d1a56-4943-4020-906f-bdfb5b97b829 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:30:37.122886 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e87d1a56-4943-4020-906f-bdfb5b97b829 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:30:37.123347 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e87d1a56-4943-4020-906f-bdfb5b97b829 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:30:37.124064 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e87d1a56-4943-4020-906f-bdfb5b97b829 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:30:37.124545 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e87d1a56-4943-4020-906f-bdfb5b97b829 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:30:37.124993 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e87d1a56-4943-4020-906f-bdfb5b97b829 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:30:37.256997 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e87d1a56-4943-4020-906f-bdfb5b97b829 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:30:37.264772 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e87d1a56-4943-4020-906f-bdfb5b97b829 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f" status: 200 len: 1506 microversion: 2.1 time: 0.154658 Sep 23 05:30:37.265352 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3529/7236] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:30:37 2022] GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:30:37.288382 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e1d9b019-0b91-4afe-84fb-bcd0d6dba61c tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:30:37.289007 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e1d9b019-0b91-4afe-84fb-bcd0d6dba61c tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: b2f23f3b-a932-4d64-b6c1-189920f2ea2f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:30:37.295648 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e1d9b019-0b91-4afe-84fb-bcd0d6dba61c tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:30:37.296140 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e1d9b019-0b91-4afe-84fb-bcd0d6dba61c tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:30:37.296586 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e1d9b019-0b91-4afe-84fb-bcd0d6dba61c tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:30:37.297286 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e1d9b019-0b91-4afe-84fb-bcd0d6dba61c tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:30:37.297798 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e1d9b019-0b91-4afe-84fb-bcd0d6dba61c tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:30:37.298260 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e1d9b019-0b91-4afe-84fb-bcd0d6dba61c tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:30:37.431477 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e1d9b019-0b91-4afe-84fb-bcd0d6dba61c tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:30:37.439245 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e1d9b019-0b91-4afe-84fb-bcd0d6dba61c tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f" status: 200 len: 1506 microversion: 2.1 time: 0.154681 Sep 23 05:30:37.439812 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3708/7237] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:30:37 2022] GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:30:37.461479 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-cf28c679-6bb3-4a9c-99b9-6087a3eac150 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:30:37.462159 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-cf28c679-6bb3-4a9c-99b9-6087a3eac150 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: b2f23f3b-a932-4d64-b6c1-189920f2ea2f] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:30:37.468151 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cf28c679-6bb3-4a9c-99b9-6087a3eac150 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:30:37.468658 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cf28c679-6bb3-4a9c-99b9-6087a3eac150 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:30:37.469121 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cf28c679-6bb3-4a9c-99b9-6087a3eac150 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:30:37.470488 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cf28c679-6bb3-4a9c-99b9-6087a3eac150 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:30:37.470973 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cf28c679-6bb3-4a9c-99b9-6087a3eac150 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:30:37.471423 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cf28c679-6bb3-4a9c-99b9-6087a3eac150 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:30:37.600455 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-cf28c679-6bb3-4a9c-99b9-6087a3eac150 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:30:37.608243 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-cf28c679-6bb3-4a9c-99b9-6087a3eac150 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f" status: 200 len: 1506 microversion: 2.1 time: 0.150665 Sep 23 05:30:37.608827 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3530/7238] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:30:37 2022] GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f => generated 1506 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:30:37.630807 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6121088e-9fd7-465b-aa8f-f9ffda498849 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:30:37.631250 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-6121088e-9fd7-465b-aa8f-f9ffda498849 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: b2f23f3b-a932-4d64-b6c1-189920f2ea2f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:30:37.637178 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6121088e-9fd7-465b-aa8f-f9ffda498849 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:30:37.637671 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6121088e-9fd7-465b-aa8f-f9ffda498849 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:30:37.638151 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6121088e-9fd7-465b-aa8f-f9ffda498849 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:30:37.638851 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6121088e-9fd7-465b-aa8f-f9ffda498849 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:30:37.639326 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6121088e-9fd7-465b-aa8f-f9ffda498849 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:30:37.639761 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6121088e-9fd7-465b-aa8f-f9ffda498849 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:30:37.664940 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-6121088e-9fd7-465b-aa8f-f9ffda498849 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: b2f23f3b-a932-4d64-b6c1-189920f2ea2f] Going to try to terminate instance {{(pid=122699) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 05:30:38.047228 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6121088e-9fd7-465b-aa8f-f9ffda498849 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f" status: 204 len: 0 microversion: 2.1 time: 0.419958 Sep 23 05:30:38.062527 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3709/7239] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 05:30:37 2022] DELETE /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f => generated 0 bytes in 423 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 05:30:38.070169 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d79de9b7-6a7b-4a1d-9698-c0e8a1d930f5 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:30:38.070740 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d79de9b7-6a7b-4a1d-9698-c0e8a1d930f5 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: b2f23f3b-a932-4d64-b6c1-189920f2ea2f] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:30:38.076927 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d79de9b7-6a7b-4a1d-9698-c0e8a1d930f5 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:30:38.077447 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d79de9b7-6a7b-4a1d-9698-c0e8a1d930f5 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:30:38.077929 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d79de9b7-6a7b-4a1d-9698-c0e8a1d930f5 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:30:38.078671 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d79de9b7-6a7b-4a1d-9698-c0e8a1d930f5 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:30:38.079183 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d79de9b7-6a7b-4a1d-9698-c0e8a1d930f5 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:30:38.079825 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d79de9b7-6a7b-4a1d-9698-c0e8a1d930f5 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:30:38.113733 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d79de9b7-6a7b-4a1d-9698-c0e8a1d930f5 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: b2f23f3b-a932-4d64-b6c1-189920f2ea2f] Going to try to terminate instance {{(pid=122698) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 05:30:38.116752 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-b3f18a40-ce19-426f-83b8-3d4a818ef2d7 req-33d2840f-c090-4e3a-97d6-69f478f3d3a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2f23f3b-a932-4d64-b6c1-189920f2ea2f", "name": "network-vif-plugged", "status": "completed", "tag": "d7e04581-d07a-4165-a40e-431bdbe66f75"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:30:38.129829 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-b3f18a40-ce19-426f-83b8-3d4a818ef2d7 req-33d2840f-c090-4e3a-97d6-69f478f3d3a0 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:30:38.130469 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-b3f18a40-ce19-426f-83b8-3d4a818ef2d7 req-33d2840f-c090-4e3a-97d6-69f478f3d3a0 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:30:38.130963 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-b3f18a40-ce19-426f-83b8-3d4a818ef2d7 req-33d2840f-c090-4e3a-97d6-69f478f3d3a0 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:30:38.144544 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-b3f18a40-ce19-426f-83b8-3d4a818ef2d7 req-33d2840f-c090-4e3a-97d6-69f478f3d3a0 service nova] Creating event network-vif-plugged:d7e04581-d07a-4165-a40e-431bdbe66f75 for instance b2f23f3b-a932-4d64-b6c1-189920f2ea2f on n-h1-846463-3 Sep 23 05:30:38.149665 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-b3f18a40-ce19-426f-83b8-3d4a818ef2d7 req-33d2840f-c090-4e3a-97d6-69f478f3d3a0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047991 Sep 23 05:30:38.150858 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3710/7240] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:30:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:30:38.176751 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.compute.api [None req-d79de9b7-6a7b-4a1d-9698-c0e8a1d930f5 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: b2f23f3b-a932-4d64-b6c1-189920f2ea2f] Instance is already in deleting state, ignoring this request Sep 23 05:30:38.177625 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d79de9b7-6a7b-4a1d-9698-c0e8a1d930f5 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f" status: 204 len: 0 microversion: 2.1 time: 0.111450 Sep 23 05:30:38.178225 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3531/7241] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 05:30:38 2022] DELETE /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 23 05:30:38.187651 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c065081b-de22-4564-b61f-b5ee68d2030a tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:30:38.191748 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c065081b-de22-4564-b61f-b5ee68d2030a tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: b2f23f3b-a932-4d64-b6c1-189920f2ea2f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:30:38.195390 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c065081b-de22-4564-b61f-b5ee68d2030a tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:30:38.195889 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c065081b-de22-4564-b61f-b5ee68d2030a tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:30:38.196348 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c065081b-de22-4564-b61f-b5ee68d2030a tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:30:38.197040 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c065081b-de22-4564-b61f-b5ee68d2030a tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:30:38.197535 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c065081b-de22-4564-b61f-b5ee68d2030a tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:30:38.198009 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c065081b-de22-4564-b61f-b5ee68d2030a tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:30:38.338150 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c065081b-de22-4564-b61f-b5ee68d2030a tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:30:38.346953 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c065081b-de22-4564-b61f-b5ee68d2030a tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f" status: 200 len: 1512 microversion: 2.1 time: 0.164124 Sep 23 05:30:38.347555 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3711/7242] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:30:38 2022] GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f => generated 1512 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:30:39.371664 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2c0dc18a-04c7-4c93-8174-c03eae9b630a tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:30:39.372327 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-2c0dc18a-04c7-4c93-8174-c03eae9b630a tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: b2f23f3b-a932-4d64-b6c1-189920f2ea2f] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:30:39.379684 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2c0dc18a-04c7-4c93-8174-c03eae9b630a tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:30:39.380196 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2c0dc18a-04c7-4c93-8174-c03eae9b630a tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:30:39.380658 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2c0dc18a-04c7-4c93-8174-c03eae9b630a tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:30:39.381372 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2c0dc18a-04c7-4c93-8174-c03eae9b630a tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:30:39.381850 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2c0dc18a-04c7-4c93-8174-c03eae9b630a tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:30:39.382325 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2c0dc18a-04c7-4c93-8174-c03eae9b630a tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:30:39.516584 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-2c0dc18a-04c7-4c93-8174-c03eae9b630a tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:30:39.524517 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2c0dc18a-04c7-4c93-8174-c03eae9b630a tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f" status: 200 len: 1512 microversion: 2.1 time: 0.156782 Sep 23 05:30:39.525287 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3532/7243] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:30:39 2022] GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f => generated 1512 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:30:39.935039 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-fd627e2d-d804-4270-8650-307a42692dc0 req-512d01be-d66e-47ab-aeaf-dd672aa3edf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2f23f3b-a932-4d64-b6c1-189920f2ea2f", "name": "network-vif-deleted", "tag": "d7e04581-d07a-4165-a40e-431bdbe66f75"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:30:39.946222 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-fd627e2d-d804-4270-8650-307a42692dc0 req-512d01be-d66e-47ab-aeaf-dd672aa3edf8 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:30:39.946698 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-fd627e2d-d804-4270-8650-307a42692dc0 req-512d01be-d66e-47ab-aeaf-dd672aa3edf8 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:30:39.947126 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-fd627e2d-d804-4270-8650-307a42692dc0 req-512d01be-d66e-47ab-aeaf-dd672aa3edf8 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:30:39.958855 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-fd627e2d-d804-4270-8650-307a42692dc0 req-512d01be-d66e-47ab-aeaf-dd672aa3edf8 service nova] Creating event network-vif-deleted:d7e04581-d07a-4165-a40e-431bdbe66f75 for instance b2f23f3b-a932-4d64-b6c1-189920f2ea2f on n-h1-846463-3 Sep 23 05:30:39.963673 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-fd627e2d-d804-4270-8650-307a42692dc0 req-512d01be-d66e-47ab-aeaf-dd672aa3edf8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032715 Sep 23 05:30:39.964584 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3712/7244] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:30:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:30:40.547434 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-cfbf0b70-99a8-4e5f-877f-d4076a6dd91d tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:30:40.548089 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-cfbf0b70-99a8-4e5f-877f-d4076a6dd91d tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: b2f23f3b-a932-4d64-b6c1-189920f2ea2f] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:30:40.555161 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cfbf0b70-99a8-4e5f-877f-d4076a6dd91d tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:30:40.555657 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cfbf0b70-99a8-4e5f-877f-d4076a6dd91d tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:30:40.556234 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cfbf0b70-99a8-4e5f-877f-d4076a6dd91d tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:30:40.556817 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cfbf0b70-99a8-4e5f-877f-d4076a6dd91d tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:30:40.557286 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cfbf0b70-99a8-4e5f-877f-d4076a6dd91d tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:30:40.557728 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cfbf0b70-99a8-4e5f-877f-d4076a6dd91d tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:30:40.589594 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cfbf0b70-99a8-4e5f-877f-d4076a6dd91d tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:30:40.590143 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cfbf0b70-99a8-4e5f-877f-d4076a6dd91d tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:30:40.590597 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cfbf0b70-99a8-4e5f-877f-d4076a6dd91d tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:30:40.591089 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-cfbf0b70-99a8-4e5f-877f-d4076a6dd91d tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lazy-loading 'fault' on Instance uuid b2f23f3b-a932-4d64-b6c1-189920f2ea2f {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 05:30:40.593990 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:30:40.635172 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-cfbf0b70-99a8-4e5f-877f-d4076a6dd91d tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71fcf3e705ed4f539b04b3606703c610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '353a08b792f7473fa857996c3214c8ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:30:40.643693 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-cfbf0b70-99a8-4e5f-877f-d4076a6dd91d tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f" status: 200 len: 1306 microversion: 2.1 time: 0.100152 Sep 23 05:30:40.644261 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3533/7245] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:30:40 2022] GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f => generated 1306 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:30:41.670171 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a074c21a-4e53-4850-b309-734cfa60f509 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:30:41.670873 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a074c21a-4e53-4850-b309-734cfa60f509 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: b2f23f3b-a932-4d64-b6c1-189920f2ea2f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:30:41.677508 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a074c21a-4e53-4850-b309-734cfa60f509 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:30:41.678019 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a074c21a-4e53-4850-b309-734cfa60f509 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:30:41.678458 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a074c21a-4e53-4850-b309-734cfa60f509 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:30:41.679145 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a074c21a-4e53-4850-b309-734cfa60f509 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:30:41.679599 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a074c21a-4e53-4850-b309-734cfa60f509 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:30:41.680020 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a074c21a-4e53-4850-b309-734cfa60f509 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:30:41.684048 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:30:41.693739 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-a074c21a-4e53-4850-b309-734cfa60f509 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] HTTP exception thrown: Instance b2f23f3b-a932-4d64-b6c1-189920f2ea2f could not be found. Sep 23 05:30:41.711489 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a074c21a-4e53-4850-b309-734cfa60f509 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Request method failure captured: Sep 23 05:30:41.711489 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f HTTP/1.1 Sep 23 05:30:41.711489 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 05:30:41.711489 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 05:30:41.711489 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 05:30:41.711489 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 05:30:41.711489 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 05:30:41.711489 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 05:30:41.711489 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 05:30:41.711489 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 05:30:41.711489 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLUQLhI-o7SBxMbLwaWSq2NJxMsA7TGkRwR_ZKmclWsv_Hr2Zb8Vdb-RNZejaG7Rpo369G40JJB5Fnl2LRYetXyoFovXZH1yV5_A4NCsybZgWQs1MEXKoXQjynMGz1XThG4RogtLBTChVkle7SR-Ef-LCr3b0B7oU4_M9x2OBonRusfI Sep 23 05:30:41.711489 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 05:30:41.711489 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 05:30:41.711489 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 05:30:41.711489 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 05:30:41.711489 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 05:30:41.711489 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 05:30:41.711489 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 353a08b792f7473fa857996c3214c8ce Sep 23 05:30:41.711489 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ServerDiskConfigTestJSON-365779100 Sep 23 05:30:41.711489 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 05:30:41.711489 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 05:30:41.711489 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_353a08b792f7473fa857996c3214c8ce", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/353a08b792f7473fa857996c3214c8ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/353a08b792f7473fa857996c3214c8ce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/353a08b792f7473fa857996c3214c8ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:30:41.711489 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ServerDiskConfigTestJSON-365779100 Sep 23 05:30:41.711489 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 353a08b792f7473fa857996c3214c8ce Sep 23 05:30:41.711489 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-365779100 Sep 23 05:30:41.711489 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ServerDiskConfigTestJSON-365779100-project Sep 23 05:30:41.711489 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 05:30:41.711489 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 05:30:41.711489 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 71fcf3e705ed4f539b04b3606703c610 Sep 23 05:30:41.711489 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ServerDiskConfigTestJSON-365779100-project Sep 23 05:30:41.711489 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 05:30:41.711489 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance b2f23f3b-a932-4d64-b6c1-189920f2ea2f could not be found. Sep 23 05:30:41.711489 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': 'b2f23f3b-a932-4d64-b6c1-189920f2ea2f'} Sep 23 05:30:41.711489 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:30:41.711489 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:30:41.711489 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 05:30:41.711489 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 05:30:41.711489 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 05:30:41.711489 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 05:30:41.711489 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 05:30:41.711489 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 05:30:41.711489 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 05:30:41.711489 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 05:30:41.711489 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2f23f3b-a932-4d64-b6c1-189920f2ea2f could not be found. Sep 23 05:30:41.711489 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:30:41.711489 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:30:41.711489 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:30:41.711489 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:30:41.711489 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:30:41.711489 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:30:41.711489 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:30:41.711489 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:30:41.711489 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:30:41.711489 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:30:41.711489 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 05:30:41.711489 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 05:30:41.711489 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 05:30:41.711489 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 05:30:41.711489 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 05:30:41.711489 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:30:41.711489 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2f23f3b-a932-4d64-b6c1-189920f2ea2f could not be found. Sep 23 05:30:41.711489 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:30:41.711489 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:30:41.711489 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:30:41.716580 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:30:41.716580 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:30:41.716580 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:30:41.716580 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:30:41.716580 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:30:41.716580 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2f23f3b-a932-4d64-b6c1-189920f2ea2f could not be found. Sep 23 05:30:41.716580 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:30:41.716580 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a074c21a-4e53-4850-b309-734cfa60f509 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Returning 404 to user: Instance b2f23f3b-a932-4d64-b6c1-189920f2ea2f could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:30:41.716580 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a074c21a-4e53-4850-b309-734cfa60f509 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f" status: 404 len: 111 microversion: 2.1 time: 0.031875 Sep 23 05:30:41.716580 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3713/7246] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:30:41 2022] GET /compute/v2.1/servers/b2f23f3b-a932-4d64-b6c1-189920f2ea2f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 05:30:41.717367 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5f2d487b-0d13-4602-b44c-070d207058ef tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '.version_select at 0x7ff1ba75b430>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:30:41.812613 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5f2d487b-0d13-4602-b44c-070d207058ef tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-122837463" status: 202 len: 0 microversion: 2.1 time: 0.110960 Sep 23 05:30:41.813911 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3534/7247] 10.222.0.33 () {58 vars in 1218 bytes} [Fri Sep 23 05:30:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-122837463 => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 05:30:42.614949 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-73d608c9-f3e9-4333-884a-a12cb0ef1182 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:30:42.615452 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-73d608c9-f3e9-4333-884a-a12cb0ef1182 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: 5fb4a959-b664-485a-aa90-7f3e741ad5d3] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:30:42.622135 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-73d608c9-f3e9-4333-884a-a12cb0ef1182 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:30:42.622626 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-73d608c9-f3e9-4333-884a-a12cb0ef1182 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:30:42.623067 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-73d608c9-f3e9-4333-884a-a12cb0ef1182 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:30:42.623763 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-73d608c9-f3e9-4333-884a-a12cb0ef1182 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:30:42.624228 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-73d608c9-f3e9-4333-884a-a12cb0ef1182 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:30:42.624656 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-73d608c9-f3e9-4333-884a-a12cb0ef1182 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:30:42.638548 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-73d608c9-f3e9-4333-884a-a12cb0ef1182 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] HTTP exception thrown: Instance 5fb4a959-b664-485a-aa90-7f3e741ad5d3 could not be found. Sep 23 05:30:42.640076 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-73d608c9-f3e9-4333-884a-a12cb0ef1182 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Request method failure captured: Sep 23 05:30:42.640076 n-d-846463-3 devstack@n-api.service[122699]: request: DELETE /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3 HTTP/1.1 Sep 23 05:30:42.640076 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 05:30:42.640076 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 05:30:42.640076 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 05:30:42.640076 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 05:30:42.640076 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 05:30:42.640076 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 05:30:42.640076 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 05:30:42.640076 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 05:30:42.640076 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLUQLhI-o7SBxMbLwaWSq2NJxMsA7TGkRwR_ZKmclWsv_Hr2Zb8Vdb-RNZejaG7Rpo369G40JJB5Fnl2LRYetXyoFovXZH1yV5_A4NCsybZgWQs1MEXKoXQjynMGz1XThG4RogtLBTChVkle7SR-Ef-LCr3b0B7oU4_M9x2OBonRusfI Sep 23 05:30:42.640076 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 05:30:42.640076 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 05:30:42.640076 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 05:30:42.640076 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 05:30:42.640076 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 05:30:42.640076 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 05:30:42.640076 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 353a08b792f7473fa857996c3214c8ce Sep 23 05:30:42.640076 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ServerDiskConfigTestJSON-365779100 Sep 23 05:30:42.640076 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 05:30:42.640076 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 05:30:42.640076 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_353a08b792f7473fa857996c3214c8ce", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/353a08b792f7473fa857996c3214c8ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/353a08b792f7473fa857996c3214c8ce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/353a08b792f7473fa857996c3214c8ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:30:42.640076 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ServerDiskConfigTestJSON-365779100 Sep 23 05:30:42.640076 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 353a08b792f7473fa857996c3214c8ce Sep 23 05:30:42.640076 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-365779100 Sep 23 05:30:42.640076 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ServerDiskConfigTestJSON-365779100-project Sep 23 05:30:42.640076 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 05:30:42.640076 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 05:30:42.640076 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 71fcf3e705ed4f539b04b3606703c610 Sep 23 05:30:42.640076 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ServerDiskConfigTestJSON-365779100-project Sep 23 05:30:42.640076 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 05:30:42.640076 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 5fb4a959-b664-485a-aa90-7f3e741ad5d3 could not be found. Sep 23 05:30:42.640076 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '5fb4a959-b664-485a-aa90-7f3e741ad5d3'} Sep 23 05:30:42.640076 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:30:42.640076 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:30:42.640076 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 05:30:42.640076 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 05:30:42.640076 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 05:30:42.640076 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 05:30:42.640076 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 05:30:42.640076 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 05:30:42.640076 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 05:30:42.640076 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 05:30:42.640076 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fb4a959-b664-485a-aa90-7f3e741ad5d3 could not be found. Sep 23 05:30:42.640076 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:30:42.640076 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:30:42.640076 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:30:42.640076 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:30:42.640076 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:30:42.640076 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:30:42.640076 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:30:42.640076 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:30:42.640076 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:30:42.640076 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:30:42.640076 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 05:30:42.640076 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 05:30:42.640076 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 05:30:42.640076 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 05:30:42.640076 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 05:30:42.640076 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 05:30:42.640076 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 05:30:42.640076 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:30:42.644743 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fb4a959-b664-485a-aa90-7f3e741ad5d3 could not be found. Sep 23 05:30:42.644743 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:30:42.644743 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:30:42.644743 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:30:42.644743 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:30:42.644743 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:30:42.644743 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:30:42.644743 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:30:42.644743 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:30:42.644743 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fb4a959-b664-485a-aa90-7f3e741ad5d3 could not be found. Sep 23 05:30:42.644743 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:30:42.644743 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-73d608c9-f3e9-4333-884a-a12cb0ef1182 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Returning 404 to user: Instance 5fb4a959-b664-485a-aa90-7f3e741ad5d3 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:30:42.644743 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-73d608c9-f3e9-4333-884a-a12cb0ef1182 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "DELETE /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3" status: 404 len: 111 microversion: 2.1 time: 0.030685 Sep 23 05:30:42.644743 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3714/7248] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 05:30:42 2022] DELETE /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 05:30:42.651032 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-74898e85-7e4b-443c-b31e-80a97610a894 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:30:42.651705 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-74898e85-7e4b-443c-b31e-80a97610a894 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] [instance: 5fb4a959-b664-485a-aa90-7f3e741ad5d3] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:30:42.660643 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-74898e85-7e4b-443c-b31e-80a97610a894 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:30:42.661489 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-74898e85-7e4b-443c-b31e-80a97610a894 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:30:42.662279 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-74898e85-7e4b-443c-b31e-80a97610a894 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:30:42.663968 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-74898e85-7e4b-443c-b31e-80a97610a894 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:30:42.663968 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-74898e85-7e4b-443c-b31e-80a97610a894 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:30:42.664274 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-74898e85-7e4b-443c-b31e-80a97610a894 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:30:42.678526 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-74898e85-7e4b-443c-b31e-80a97610a894 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] HTTP exception thrown: Instance 5fb4a959-b664-485a-aa90-7f3e741ad5d3 could not be found. Sep 23 05:30:42.680337 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-74898e85-7e4b-443c-b31e-80a97610a894 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Request method failure captured: Sep 23 05:30:42.680337 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3 HTTP/1.1 Sep 23 05:30:42.680337 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 05:30:42.680337 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 05:30:42.680337 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 05:30:42.680337 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 05:30:42.680337 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 05:30:42.680337 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 05:30:42.680337 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 05:30:42.680337 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 05:30:42.680337 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLUQLhI-o7SBxMbLwaWSq2NJxMsA7TGkRwR_ZKmclWsv_Hr2Zb8Vdb-RNZejaG7Rpo369G40JJB5Fnl2LRYetXyoFovXZH1yV5_A4NCsybZgWQs1MEXKoXQjynMGz1XThG4RogtLBTChVkle7SR-Ef-LCr3b0B7oU4_M9x2OBonRusfI Sep 23 05:30:42.680337 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 05:30:42.680337 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 05:30:42.680337 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 05:30:42.680337 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 05:30:42.680337 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 05:30:42.680337 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 05:30:42.680337 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 353a08b792f7473fa857996c3214c8ce Sep 23 05:30:42.680337 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ServerDiskConfigTestJSON-365779100 Sep 23 05:30:42.680337 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 05:30:42.680337 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 05:30:42.680337 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_353a08b792f7473fa857996c3214c8ce", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/353a08b792f7473fa857996c3214c8ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/353a08b792f7473fa857996c3214c8ce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/353a08b792f7473fa857996c3214c8ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:30:42.680337 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ServerDiskConfigTestJSON-365779100 Sep 23 05:30:42.680337 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 353a08b792f7473fa857996c3214c8ce Sep 23 05:30:42.680337 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-365779100 Sep 23 05:30:42.680337 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ServerDiskConfigTestJSON-365779100-project Sep 23 05:30:42.680337 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 05:30:42.680337 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 05:30:42.680337 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 71fcf3e705ed4f539b04b3606703c610 Sep 23 05:30:42.680337 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ServerDiskConfigTestJSON-365779100-project Sep 23 05:30:42.680337 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 05:30:42.680337 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 5fb4a959-b664-485a-aa90-7f3e741ad5d3 could not be found. Sep 23 05:30:42.680337 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '5fb4a959-b664-485a-aa90-7f3e741ad5d3'} Sep 23 05:30:42.680337 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:30:42.680337 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:30:42.680337 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 05:30:42.680337 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 05:30:42.680337 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 05:30:42.680337 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 05:30:42.680337 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 05:30:42.680337 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 05:30:42.680337 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 05:30:42.680337 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 05:30:42.680337 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fb4a959-b664-485a-aa90-7f3e741ad5d3 could not be found. Sep 23 05:30:42.680337 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:30:42.680337 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:30:42.680337 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:30:42.680337 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:30:42.680337 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:30:42.680337 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:30:42.680337 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:30:42.680337 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:30:42.680337 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:30:42.680337 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:30:42.680337 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 05:30:42.680337 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 05:30:42.680337 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 05:30:42.680337 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 05:30:42.680337 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 05:30:42.680337 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:30:42.680337 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fb4a959-b664-485a-aa90-7f3e741ad5d3 could not be found. Sep 23 05:30:42.680337 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:30:42.680337 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:30:42.680337 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:30:42.684669 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:30:42.684669 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:30:42.684669 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:30:42.684669 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:30:42.684669 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:30:42.684669 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fb4a959-b664-485a-aa90-7f3e741ad5d3 could not be found. Sep 23 05:30:42.684669 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:30:42.684669 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-74898e85-7e4b-443c-b31e-80a97610a894 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] Returning 404 to user: Instance 5fb4a959-b664-485a-aa90-7f3e741ad5d3 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:30:42.684669 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-74898e85-7e4b-443c-b31e-80a97610a894 tempest-ServerDiskConfigTestJSON-365779100 tempest-ServerDiskConfigTestJSON-365779100-project] 10.222.0.33 "GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3" status: 404 len: 111 microversion: 2.1 time: 0.035213 Sep 23 05:30:42.684669 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3535/7249] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:30:42 2022] GET /compute/v2.1/servers/5fb4a959-b664-485a-aa90-7f3e741ad5d3 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 05:30:53.574044 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:30:53.709219 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-444669bd-98f0-4901-8df5-f3e2c6189b96 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Action: 'create', calling method: .version_select at 0x7ff1ba6021f0>, body: {"keypair": {"name": "tempest-keypair-2117157152", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPG2re+uDy2dwRFJkWGGWm8YrakWwon59AKhoS/kJniSIwJtB5Oy3VRH+f7NjdOVXssAYjb3/bhKtZ1K1bHj/2s14Gl3FCeOgeo/FY6aqBNPC224n31o9BoT8Kvrdfq3sw=="}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:30:53.727548 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-444669bd-98f0-4901-8df5-f3e2c6189b96 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Getting quotas for project f991e11ed0c44131a4bd9be0110dffe0. Resources: {'key_pairs'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 05:30:53.732572 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-444669bd-98f0-4901-8df5-f3e2c6189b96 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Getting quotas for user f398aeafcbcb48d88d8cfd3bdf59bbed and project f991e11ed0c44131a4bd9be0110dffe0. Resources: {'key_pairs'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 05:30:53.828741 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-444669bd-98f0-4901-8df5-f3e2c6189b96 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.260246 Sep 23 05:30:53.829348 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3715/7250] 10.222.0.33 () {60 vars in 1159 bytes} [Fri Sep 23 05:30:53 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:30:56.083024 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0e211370-2052-45e8-b5e3-14d7a0c6a881 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1447970875", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "37e382a2-7105-4d7e-b7ef-1b58c783c9f2"}], "security_groups": [{"name": "tempest-securitygroup--381295551"}], "key_name": "tempest-keypair-2117157152", "user_data": "}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:30:56.093999 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=36,nova_api:DELETE=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:30:56.094863 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=5 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:30:56.214476 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.network.neutron [None req-0e211370-2052-45e8-b5e3-14d7a0c6a881 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] validate_networks() for [('37e382a2-7105-4d7e-b7ef-1b58c783c9f2', None, None, None, None, None)] {{(pid=122698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 05:30:56.725190 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-0e211370-2052-45e8-b5e3-14d7a0c6a881 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Flavor limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 05:30:56.725693 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-0e211370-2052-45e8-b5e3-14d7a0c6a881 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Image limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 05:30:56.726401 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-0e211370-2052-45e8-b5e3-14d7a0c6a881 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Flavor pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 05:30:56.726825 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-0e211370-2052-45e8-b5e3-14d7a0c6a881 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Image pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 05:30:56.727443 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-0e211370-2052-45e8-b5e3-14d7a0c6a881 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 05:30:56.739928 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0e211370-2052-45e8-b5e3-14d7a0c6a881 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:30:56.740440 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0e211370-2052-45e8-b5e3-14d7a0c6a881 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:30:56.740898 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0e211370-2052-45e8-b5e3-14d7a0c6a881 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:30:56.741648 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0e211370-2052-45e8-b5e3-14d7a0c6a881 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:30:56.742154 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0e211370-2052-45e8-b5e3-14d7a0c6a881 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:30:56.742596 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0e211370-2052-45e8-b5e3-14d7a0c6a881 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:30:56.763802 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-0e211370-2052-45e8-b5e3-14d7a0c6a881 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Getting quotas for project f991e11ed0c44131a4bd9be0110dffe0. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 05:30:56.771430 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-0e211370-2052-45e8-b5e3-14d7a0c6a881 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Getting quotas for user f398aeafcbcb48d88d8cfd3bdf59bbed and project f991e11ed0c44131a4bd9be0110dffe0. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 05:30:56.785465 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-0e211370-2052-45e8-b5e3-14d7a0c6a881 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Going to run 1 instances... {{(pid=122698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 05:30:56.787886 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-0e211370-2052-45e8-b5e3-14d7a0c6a881 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: c3c9b3c1-515c-4cd1-adcc-b8fa755fa489] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 05:30:56.931161 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0e211370-2052-45e8-b5e3-14d7a0c6a881 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.853029 Sep 23 05:30:56.932560 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3536/7251] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 05:30:56 2022] POST /compute/v2.1/servers => generated 408 bytes in 855 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 05:30:56.943234 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-29e61dae-3146-430f-9180-0ae10125120b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:30:56.944574 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-29e61dae-3146-430f-9180-0ae10125120b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: c3c9b3c1-515c-4cd1-adcc-b8fa755fa489] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:30:57.010264 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-29e61dae-3146-430f-9180-0ae10125120b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:30:57.018420 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-29e61dae-3146-430f-9180-0ae10125120b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/c3c9b3c1-515c-4cd1-adcc-b8fa755fa489" status: 200 len: 1239 microversion: 2.1 time: 0.079084 Sep 23 05:30:57.019154 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3716/7252] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:30:56 2022] GET /compute/v2.1/servers/c3c9b3c1-515c-4cd1-adcc-b8fa755fa489 => generated 1239 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:30:58.041270 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9b01ef97-0bbd-4766-8709-e1d7814960b9 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:30:58.041834 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-9b01ef97-0bbd-4766-8709-e1d7814960b9 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: c3c9b3c1-515c-4cd1-adcc-b8fa755fa489] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:30:58.050450 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9b01ef97-0bbd-4766-8709-e1d7814960b9 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:30:58.050995 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9b01ef97-0bbd-4766-8709-e1d7814960b9 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:30:58.051459 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9b01ef97-0bbd-4766-8709-e1d7814960b9 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:30:58.052185 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9b01ef97-0bbd-4766-8709-e1d7814960b9 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:30:58.052713 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9b01ef97-0bbd-4766-8709-e1d7814960b9 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:30:58.053164 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9b01ef97-0bbd-4766-8709-e1d7814960b9 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:30:58.116648 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-9b01ef97-0bbd-4766-8709-e1d7814960b9 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:30:58.124643 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9b01ef97-0bbd-4766-8709-e1d7814960b9 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/c3c9b3c1-515c-4cd1-adcc-b8fa755fa489" status: 200 len: 1243 microversion: 2.1 time: 0.087468 Sep 23 05:30:58.125306 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3537/7253] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:30:58 2022] GET /compute/v2.1/servers/c3c9b3c1-515c-4cd1-adcc-b8fa755fa489 => generated 1243 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:30:59.149357 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-bc1ebdc3-23cd-4a3f-beea-a921d9654775 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:30:59.150374 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-bc1ebdc3-23cd-4a3f-beea-a921d9654775 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: c3c9b3c1-515c-4cd1-adcc-b8fa755fa489] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:30:59.157915 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bc1ebdc3-23cd-4a3f-beea-a921d9654775 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:30:59.158435 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bc1ebdc3-23cd-4a3f-beea-a921d9654775 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:30:59.158877 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bc1ebdc3-23cd-4a3f-beea-a921d9654775 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:30:59.159585 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bc1ebdc3-23cd-4a3f-beea-a921d9654775 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:30:59.160054 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bc1ebdc3-23cd-4a3f-beea-a921d9654775 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:30:59.160678 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bc1ebdc3-23cd-4a3f-beea-a921d9654775 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:30:59.225138 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-bc1ebdc3-23cd-4a3f-beea-a921d9654775 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:30:59.233008 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-bc1ebdc3-23cd-4a3f-beea-a921d9654775 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/c3c9b3c1-515c-4cd1-adcc-b8fa755fa489" status: 200 len: 1309 microversion: 2.1 time: 0.087616 Sep 23 05:30:59.235401 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3717/7254] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:30:59 2022] GET /compute/v2.1/servers/c3c9b3c1-515c-4cd1-adcc-b8fa755fa489 => generated 1309 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:31:00.256468 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-20b358c6-aba7-4e57-ad47-69d2fcff8bd0 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:31:00.257101 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-20b358c6-aba7-4e57-ad47-69d2fcff8bd0 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: c3c9b3c1-515c-4cd1-adcc-b8fa755fa489] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:31:00.263343 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-20b358c6-aba7-4e57-ad47-69d2fcff8bd0 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:31:00.263851 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-20b358c6-aba7-4e57-ad47-69d2fcff8bd0 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:31:00.264333 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-20b358c6-aba7-4e57-ad47-69d2fcff8bd0 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:31:00.265030 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-20b358c6-aba7-4e57-ad47-69d2fcff8bd0 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:31:00.265754 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-20b358c6-aba7-4e57-ad47-69d2fcff8bd0 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:31:00.266240 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-20b358c6-aba7-4e57-ad47-69d2fcff8bd0 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:31:00.402117 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-20b358c6-aba7-4e57-ad47-69d2fcff8bd0 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:31:00.410706 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-20b358c6-aba7-4e57-ad47-69d2fcff8bd0 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/c3c9b3c1-515c-4cd1-adcc-b8fa755fa489" status: 200 len: 1364 microversion: 2.1 time: 0.158382 Sep 23 05:31:00.411289 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3538/7255] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:31:00 2022] GET /compute/v2.1/servers/c3c9b3c1-515c-4cd1-adcc-b8fa755fa489 => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:31:00.649093 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-20c562ba-2714-4b4a-87e6-9a8254b3d58c req-a71ef1b1-a948-44d4-bdf3-773d3b1011da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3c9b3c1-515c-4cd1-adcc-b8fa755fa489", "tag": "ecca24fc-9235-426a-a657-fefd048187c4"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:31:00.657074 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-20c562ba-2714-4b4a-87e6-9a8254b3d58c req-a71ef1b1-a948-44d4-bdf3-773d3b1011da service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:31:00.657559 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-20c562ba-2714-4b4a-87e6-9a8254b3d58c req-a71ef1b1-a948-44d4-bdf3-773d3b1011da service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:31:00.658018 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-20c562ba-2714-4b4a-87e6-9a8254b3d58c req-a71ef1b1-a948-44d4-bdf3-773d3b1011da service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:31:00.671672 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-20c562ba-2714-4b4a-87e6-9a8254b3d58c req-a71ef1b1-a948-44d4-bdf3-773d3b1011da service nova] Creating event network-changed:ecca24fc-9235-426a-a657-fefd048187c4 for instance c3c9b3c1-515c-4cd1-adcc-b8fa755fa489 on n-h2-846463-3 Sep 23 05:31:00.676898 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-20c562ba-2714-4b4a-87e6-9a8254b3d58c req-a71ef1b1-a948-44d4-bdf3-773d3b1011da service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034622 Sep 23 05:31:00.677510 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3718/7256] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:31:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:31:01.434070 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-dff33bf8-7ae2-4a49-abc8-2631b6a9bed8 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:31:01.434698 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-dff33bf8-7ae2-4a49-abc8-2631b6a9bed8 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: c3c9b3c1-515c-4cd1-adcc-b8fa755fa489] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:31:01.441592 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dff33bf8-7ae2-4a49-abc8-2631b6a9bed8 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:31:01.442140 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dff33bf8-7ae2-4a49-abc8-2631b6a9bed8 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:31:01.442596 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dff33bf8-7ae2-4a49-abc8-2631b6a9bed8 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:31:01.443327 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dff33bf8-7ae2-4a49-abc8-2631b6a9bed8 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:31:01.443800 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dff33bf8-7ae2-4a49-abc8-2631b6a9bed8 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:31:01.444239 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dff33bf8-7ae2-4a49-abc8-2631b6a9bed8 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:31:01.576771 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-dff33bf8-7ae2-4a49-abc8-2631b6a9bed8 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:31:01.584967 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-dff33bf8-7ae2-4a49-abc8-2631b6a9bed8 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/c3c9b3c1-515c-4cd1-adcc-b8fa755fa489" status: 200 len: 1364 microversion: 2.1 time: 0.154895 Sep 23 05:31:01.585538 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3539/7257] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:31:01 2022] GET /compute/v2.1/servers/c3c9b3c1-515c-4cd1-adcc-b8fa755fa489 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:31:02.608463 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-db86af04-4171-4ef9-a7c3-d4eacccf81dc tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:31:02.609172 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-db86af04-4171-4ef9-a7c3-d4eacccf81dc tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: c3c9b3c1-515c-4cd1-adcc-b8fa755fa489] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:31:02.616299 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-db86af04-4171-4ef9-a7c3-d4eacccf81dc tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:31:02.616773 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-db86af04-4171-4ef9-a7c3-d4eacccf81dc tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:31:02.617214 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-db86af04-4171-4ef9-a7c3-d4eacccf81dc tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:31:02.617932 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-db86af04-4171-4ef9-a7c3-d4eacccf81dc tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:31:02.618397 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-db86af04-4171-4ef9-a7c3-d4eacccf81dc tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:31:02.618826 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-db86af04-4171-4ef9-a7c3-d4eacccf81dc tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:31:02.754837 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-db86af04-4171-4ef9-a7c3-d4eacccf81dc tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:31:02.762551 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-db86af04-4171-4ef9-a7c3-d4eacccf81dc tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/c3c9b3c1-515c-4cd1-adcc-b8fa755fa489" status: 200 len: 1364 microversion: 2.1 time: 0.158372 Sep 23 05:31:02.763129 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3719/7258] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:31:02 2022] GET /compute/v2.1/servers/c3c9b3c1-515c-4cd1-adcc-b8fa755fa489 => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:31:03.785469 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-74bf7682-7b17-4856-822c-5af7bd344bd6 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:31:03.786147 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-74bf7682-7b17-4856-822c-5af7bd344bd6 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: c3c9b3c1-515c-4cd1-adcc-b8fa755fa489] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:31:03.793061 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-74bf7682-7b17-4856-822c-5af7bd344bd6 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:31:03.793578 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-74bf7682-7b17-4856-822c-5af7bd344bd6 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:31:03.794079 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-74bf7682-7b17-4856-822c-5af7bd344bd6 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:31:03.794803 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-74bf7682-7b17-4856-822c-5af7bd344bd6 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:31:03.795306 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-74bf7682-7b17-4856-822c-5af7bd344bd6 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:31:03.795740 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-74bf7682-7b17-4856-822c-5af7bd344bd6 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:31:03.932278 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-74bf7682-7b17-4856-822c-5af7bd344bd6 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:31:03.940780 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-74bf7682-7b17-4856-822c-5af7bd344bd6 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/c3c9b3c1-515c-4cd1-adcc-b8fa755fa489" status: 200 len: 1364 microversion: 2.1 time: 0.159269 Sep 23 05:31:03.941362 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3540/7259] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:31:03 2022] GET /compute/v2.1/servers/c3c9b3c1-515c-4cd1-adcc-b8fa755fa489 => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:31:04.964102 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3256d365-cd2e-456a-8182-5e7bac2439c1 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:31:04.964728 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-3256d365-cd2e-456a-8182-5e7bac2439c1 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: c3c9b3c1-515c-4cd1-adcc-b8fa755fa489] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:31:04.970967 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3256d365-cd2e-456a-8182-5e7bac2439c1 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:31:04.971475 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3256d365-cd2e-456a-8182-5e7bac2439c1 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:31:04.971941 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3256d365-cd2e-456a-8182-5e7bac2439c1 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:31:04.972637 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3256d365-cd2e-456a-8182-5e7bac2439c1 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:31:04.973102 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3256d365-cd2e-456a-8182-5e7bac2439c1 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:31:04.973899 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3256d365-cd2e-456a-8182-5e7bac2439c1 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:31:05.103752 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-3256d365-cd2e-456a-8182-5e7bac2439c1 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:31:05.111582 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3256d365-cd2e-456a-8182-5e7bac2439c1 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/c3c9b3c1-515c-4cd1-adcc-b8fa755fa489" status: 200 len: 1364 microversion: 2.1 time: 0.151816 Sep 23 05:31:05.112165 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3720/7260] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:31:04 2022] GET /compute/v2.1/servers/c3c9b3c1-515c-4cd1-adcc-b8fa755fa489 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:31:05.160801 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-5cb8ccd2-7c82-4d6a-9ee3-35b4ecc6bbc1 req-2059f857-277c-4407-96d1-6137eca32e1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3c9b3c1-515c-4cd1-adcc-b8fa755fa489", "name": "network-vif-plugged", "status": "completed", "tag": "ecca24fc-9235-426a-a657-fefd048187c4"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:31:05.172773 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-5cb8ccd2-7c82-4d6a-9ee3-35b4ecc6bbc1 req-2059f857-277c-4407-96d1-6137eca32e1c service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:31:05.173296 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-5cb8ccd2-7c82-4d6a-9ee3-35b4ecc6bbc1 req-2059f857-277c-4407-96d1-6137eca32e1c service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:31:05.173765 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-5cb8ccd2-7c82-4d6a-9ee3-35b4ecc6bbc1 req-2059f857-277c-4407-96d1-6137eca32e1c service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:31:05.185032 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-5cb8ccd2-7c82-4d6a-9ee3-35b4ecc6bbc1 req-2059f857-277c-4407-96d1-6137eca32e1c service nova] Creating event network-vif-plugged:ecca24fc-9235-426a-a657-fefd048187c4 for instance c3c9b3c1-515c-4cd1-adcc-b8fa755fa489 on n-h2-846463-3 Sep 23 05:31:05.190561 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-5cb8ccd2-7c82-4d6a-9ee3-35b4ecc6bbc1 req-2059f857-277c-4407-96d1-6137eca32e1c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033572 Sep 23 05:31:05.197664 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3541/7261] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:31:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:31:06.135208 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-99c2cf89-6771-4b45-b34f-90da73e30f2e tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:31:06.135828 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-99c2cf89-6771-4b45-b34f-90da73e30f2e tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: c3c9b3c1-515c-4cd1-adcc-b8fa755fa489] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:31:06.143102 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-99c2cf89-6771-4b45-b34f-90da73e30f2e tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:31:06.143626 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-99c2cf89-6771-4b45-b34f-90da73e30f2e tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:31:06.144069 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-99c2cf89-6771-4b45-b34f-90da73e30f2e tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:31:06.144767 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-99c2cf89-6771-4b45-b34f-90da73e30f2e tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:31:06.145230 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-99c2cf89-6771-4b45-b34f-90da73e30f2e tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:31:06.145664 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-99c2cf89-6771-4b45-b34f-90da73e30f2e tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:31:06.279017 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-99c2cf89-6771-4b45-b34f-90da73e30f2e tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:31:06.287460 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-99c2cf89-6771-4b45-b34f-90da73e30f2e tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/c3c9b3c1-515c-4cd1-adcc-b8fa755fa489" status: 200 len: 1364 microversion: 2.1 time: 0.156053 Sep 23 05:31:06.287968 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3721/7262] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:31:06 2022] GET /compute/v2.1/servers/c3c9b3c1-515c-4cd1-adcc-b8fa755fa489 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:31:07.308767 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:31:07.309562 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=6 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:31:07.313718 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f5faac6e-85e2-4b32-84fd-00f9f2b63710 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:31:07.314476 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f5faac6e-85e2-4b32-84fd-00f9f2b63710 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: c3c9b3c1-515c-4cd1-adcc-b8fa755fa489] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:31:07.320608 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f5faac6e-85e2-4b32-84fd-00f9f2b63710 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:31:07.322608 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f5faac6e-85e2-4b32-84fd-00f9f2b63710 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:31:07.322608 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f5faac6e-85e2-4b32-84fd-00f9f2b63710 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:31:07.322608 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f5faac6e-85e2-4b32-84fd-00f9f2b63710 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:31:07.322876 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f5faac6e-85e2-4b32-84fd-00f9f2b63710 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:31:07.323306 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f5faac6e-85e2-4b32-84fd-00f9f2b63710 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:31:07.452338 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f5faac6e-85e2-4b32-84fd-00f9f2b63710 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:31:07.460234 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f5faac6e-85e2-4b32-84fd-00f9f2b63710 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/c3c9b3c1-515c-4cd1-adcc-b8fa755fa489" status: 200 len: 1551 microversion: 2.1 time: 0.153323 Sep 23 05:31:07.460808 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3542/7263] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:31:07 2022] GET /compute/v2.1/servers/c3c9b3c1-515c-4cd1-adcc-b8fa755fa489 => generated 1551 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:31:07.482707 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e00b66f5-92e5-4b2c-bf97-88485ee4a5e5 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:31:07.483229 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e00b66f5-92e5-4b2c-bf97-88485ee4a5e5 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: c3c9b3c1-515c-4cd1-adcc-b8fa755fa489] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:31:07.485189 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=6 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:31:07.491084 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e00b66f5-92e5-4b2c-bf97-88485ee4a5e5 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:31:07.491589 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e00b66f5-92e5-4b2c-bf97-88485ee4a5e5 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:31:07.492039 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e00b66f5-92e5-4b2c-bf97-88485ee4a5e5 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:31:07.492744 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e00b66f5-92e5-4b2c-bf97-88485ee4a5e5 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:31:07.493267 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e00b66f5-92e5-4b2c-bf97-88485ee4a5e5 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:31:07.493703 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e00b66f5-92e5-4b2c-bf97-88485ee4a5e5 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:31:07.570147 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e00b66f5-92e5-4b2c-bf97-88485ee4a5e5 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/c3c9b3c1-515c-4cd1-adcc-b8fa755fa489/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091240 Sep 23 05:31:07.570740 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3722/7264] 10.222.0.33 () {58 vars in 1275 bytes} [Fri Sep 23 05:31:07 2022] GET /compute/v2.1/servers/c3c9b3c1-515c-4cd1-adcc-b8fa755fa489/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:31:08.684886 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-9af10c00-ee47-4a73-b75b-4416f66a6c8e req-3d71e6f7-fa45-4430-868c-39708aff4452 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3c9b3c1-515c-4cd1-adcc-b8fa755fa489", "tag": "ecca24fc-9235-426a-a657-fefd048187c4"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:31:08.694654 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-9af10c00-ee47-4a73-b75b-4416f66a6c8e req-3d71e6f7-fa45-4430-868c-39708aff4452 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:31:08.695248 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-9af10c00-ee47-4a73-b75b-4416f66a6c8e req-3d71e6f7-fa45-4430-868c-39708aff4452 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:31:08.695769 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-9af10c00-ee47-4a73-b75b-4416f66a6c8e req-3d71e6f7-fa45-4430-868c-39708aff4452 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:31:08.707173 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-9af10c00-ee47-4a73-b75b-4416f66a6c8e req-3d71e6f7-fa45-4430-868c-39708aff4452 service nova] Creating event network-changed:ecca24fc-9235-426a-a657-fefd048187c4 for instance c3c9b3c1-515c-4cd1-adcc-b8fa755fa489 on n-h2-846463-3 Sep 23 05:31:08.712556 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-9af10c00-ee47-4a73-b75b-4416f66a6c8e req-3d71e6f7-fa45-4430-868c-39708aff4452 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087576 Sep 23 05:31:08.713156 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3543/7265] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:31:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:31:42.707786 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:31:42.708561 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=32 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:31:42.712478 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2ab9d76e-b04d-4c84-84a3-94e0b1e5f3f5 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:31:42.713101 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-2ab9d76e-b04d-4c84-84a3-94e0b1e5f3f5 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: c3c9b3c1-515c-4cd1-adcc-b8fa755fa489] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:31:42.719050 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2ab9d76e-b04d-4c84-84a3-94e0b1e5f3f5 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:31:42.720675 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2ab9d76e-b04d-4c84-84a3-94e0b1e5f3f5 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:31:42.720675 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2ab9d76e-b04d-4c84-84a3-94e0b1e5f3f5 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:31:42.720675 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2ab9d76e-b04d-4c84-84a3-94e0b1e5f3f5 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:31:42.721778 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2ab9d76e-b04d-4c84-84a3-94e0b1e5f3f5 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:31:42.722238 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2ab9d76e-b04d-4c84-84a3-94e0b1e5f3f5 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:31:42.854165 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2ab9d76e-b04d-4c84-84a3-94e0b1e5f3f5 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:31:42.862017 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2ab9d76e-b04d-4c84-84a3-94e0b1e5f3f5 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/c3c9b3c1-515c-4cd1-adcc-b8fa755fa489" status: 200 len: 1670 microversion: 2.1 time: 0.155709 Sep 23 05:31:42.862594 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3723/7266] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:31:42 2022] GET /compute/v2.1/servers/c3c9b3c1-515c-4cd1-adcc-b8fa755fa489 => generated 1670 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:31:42.883744 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:31:42.884508 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=36 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:31:42.888535 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0dd7d22e-95b2-493a-82ca-0410dd500d27 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:31:42.889251 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-0dd7d22e-95b2-493a-82ca-0410dd500d27 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: c3c9b3c1-515c-4cd1-adcc-b8fa755fa489] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:31:42.896147 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0dd7d22e-95b2-493a-82ca-0410dd500d27 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:31:42.896643 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0dd7d22e-95b2-493a-82ca-0410dd500d27 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:31:42.897097 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0dd7d22e-95b2-493a-82ca-0410dd500d27 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:31:42.897799 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0dd7d22e-95b2-493a-82ca-0410dd500d27 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:31:42.898297 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0dd7d22e-95b2-493a-82ca-0410dd500d27 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:31:42.898735 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0dd7d22e-95b2-493a-82ca-0410dd500d27 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:31:43.034277 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-0dd7d22e-95b2-493a-82ca-0410dd500d27 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:31:43.042169 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0dd7d22e-95b2-493a-82ca-0410dd500d27 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/c3c9b3c1-515c-4cd1-adcc-b8fa755fa489" status: 200 len: 1670 microversion: 2.1 time: 0.160605 Sep 23 05:31:43.047673 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3544/7267] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:31:42 2022] GET /compute/v2.1/servers/c3c9b3c1-515c-4cd1-adcc-b8fa755fa489 => generated 1670 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:31:43.064084 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3ffb4498-ec4f-4a34-97cb-8b55cb5500c6 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:31:43.065290 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-3ffb4498-ec4f-4a34-97cb-8b55cb5500c6 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: c3c9b3c1-515c-4cd1-adcc-b8fa755fa489] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:31:43.071925 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3ffb4498-ec4f-4a34-97cb-8b55cb5500c6 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:31:43.072411 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3ffb4498-ec4f-4a34-97cb-8b55cb5500c6 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:31:43.072846 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3ffb4498-ec4f-4a34-97cb-8b55cb5500c6 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:31:43.073540 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3ffb4498-ec4f-4a34-97cb-8b55cb5500c6 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:31:43.074019 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3ffb4498-ec4f-4a34-97cb-8b55cb5500c6 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:31:43.074443 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3ffb4498-ec4f-4a34-97cb-8b55cb5500c6 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:31:43.202164 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-3ffb4498-ec4f-4a34-97cb-8b55cb5500c6 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:31:43.209950 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3ffb4498-ec4f-4a34-97cb-8b55cb5500c6 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/c3c9b3c1-515c-4cd1-adcc-b8fa755fa489" status: 200 len: 1670 microversion: 2.1 time: 0.149704 Sep 23 05:31:43.210526 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3724/7268] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:31:43 2022] GET /compute/v2.1/servers/c3c9b3c1-515c-4cd1-adcc-b8fa755fa489 => generated 1670 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:31:43.232305 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f608c52c-a24b-49da-840b-da4079938379 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:31:43.234547 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f608c52c-a24b-49da-840b-da4079938379 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: c3c9b3c1-515c-4cd1-adcc-b8fa755fa489] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:31:43.241181 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f608c52c-a24b-49da-840b-da4079938379 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:31:43.241717 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f608c52c-a24b-49da-840b-da4079938379 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:31:43.242201 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f608c52c-a24b-49da-840b-da4079938379 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:31:43.242909 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f608c52c-a24b-49da-840b-da4079938379 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:31:43.243384 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f608c52c-a24b-49da-840b-da4079938379 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:31:43.243826 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f608c52c-a24b-49da-840b-da4079938379 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:31:43.272281 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f608c52c-a24b-49da-840b-da4079938379 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:31:43.277626 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f608c52c-a24b-49da-840b-da4079938379 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: c3c9b3c1-515c-4cd1-adcc-b8fa755fa489] Old instance type m1.heat2, new instance type m1.heat {{(pid=122698) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 23 05:31:43.284199 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-f608c52c-a24b-49da-840b-da4079938379 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Flavor limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 05:31:43.284647 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-f608c52c-a24b-49da-840b-da4079938379 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Image limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 05:31:43.285135 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-f608c52c-a24b-49da-840b-da4079938379 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Flavor pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 05:31:43.285567 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-f608c52c-a24b-49da-840b-da4079938379 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Image pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 05:31:43.286018 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-f608c52c-a24b-49da-840b-da4079938379 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 05:31:43.465213 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f608c52c-a24b-49da-840b-da4079938379 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "POST /compute/v2.1/servers/c3c9b3c1-515c-4cd1-adcc-b8fa755fa489/action" status: 202 len: 0 microversion: 2.1 time: 0.236906 Sep 23 05:31:43.465822 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3545/7269] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 05:31:43 2022] POST /compute/v2.1/servers/c3c9b3c1-515c-4cd1-adcc-b8fa755fa489/action => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 05:31:43.474695 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d3b34f2a-a45c-48c2-ac82-873144551f79 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:31:43.476194 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d3b34f2a-a45c-48c2-ac82-873144551f79 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: c3c9b3c1-515c-4cd1-adcc-b8fa755fa489] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:31:43.481469 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d3b34f2a-a45c-48c2-ac82-873144551f79 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:31:43.482377 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d3b34f2a-a45c-48c2-ac82-873144551f79 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:31:43.482821 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d3b34f2a-a45c-48c2-ac82-873144551f79 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:31:43.483567 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d3b34f2a-a45c-48c2-ac82-873144551f79 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:31:43.484038 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d3b34f2a-a45c-48c2-ac82-873144551f79 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:31:43.484471 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d3b34f2a-a45c-48c2-ac82-873144551f79 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:31:43.617145 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d3b34f2a-a45c-48c2-ac82-873144551f79 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:31:43.624908 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d3b34f2a-a45c-48c2-ac82-873144551f79 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/c3c9b3c1-515c-4cd1-adcc-b8fa755fa489" status: 200 len: 1679 microversion: 2.1 time: 0.154766 Sep 23 05:31:43.625556 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3725/7270] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:31:43 2022] GET /compute/v2.1/servers/c3c9b3c1-515c-4cd1-adcc-b8fa755fa489 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:31:44.649614 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-475f0eeb-c871-417f-9708-c527d14290c7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:31:44.650217 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-475f0eeb-c871-417f-9708-c527d14290c7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: c3c9b3c1-515c-4cd1-adcc-b8fa755fa489] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:31:44.657533 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-475f0eeb-c871-417f-9708-c527d14290c7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:31:44.658091 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-475f0eeb-c871-417f-9708-c527d14290c7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:31:44.658561 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-475f0eeb-c871-417f-9708-c527d14290c7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:31:44.659377 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-475f0eeb-c871-417f-9708-c527d14290c7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:31:44.659865 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-475f0eeb-c871-417f-9708-c527d14290c7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:31:44.660311 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-475f0eeb-c871-417f-9708-c527d14290c7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:31:44.801515 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-475f0eeb-c871-417f-9708-c527d14290c7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:31:44.809766 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-475f0eeb-c871-417f-9708-c527d14290c7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/c3c9b3c1-515c-4cd1-adcc-b8fa755fa489" status: 200 len: 1679 microversion: 2.1 time: 0.165142 Sep 23 05:31:44.810383 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3546/7271] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:31:44 2022] GET /compute/v2.1/servers/c3c9b3c1-515c-4cd1-adcc-b8fa755fa489 => generated 1679 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:31:45.836363 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-30220099-91fb-48d3-a5f7-8e07bb20c570 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:31:45.836976 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-30220099-91fb-48d3-a5f7-8e07bb20c570 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: c3c9b3c1-515c-4cd1-adcc-b8fa755fa489] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:31:45.843705 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-30220099-91fb-48d3-a5f7-8e07bb20c570 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:31:45.844198 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-30220099-91fb-48d3-a5f7-8e07bb20c570 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:31:45.844635 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-30220099-91fb-48d3-a5f7-8e07bb20c570 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:31:45.845329 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-30220099-91fb-48d3-a5f7-8e07bb20c570 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:31:45.845788 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-30220099-91fb-48d3-a5f7-8e07bb20c570 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:31:45.846263 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-30220099-91fb-48d3-a5f7-8e07bb20c570 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:31:45.981568 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-30220099-91fb-48d3-a5f7-8e07bb20c570 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:31:45.989496 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-30220099-91fb-48d3-a5f7-8e07bb20c570 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/c3c9b3c1-515c-4cd1-adcc-b8fa755fa489" status: 200 len: 1679 microversion: 2.1 time: 0.157008 Sep 23 05:31:45.990119 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3726/7272] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:31:45 2022] GET /compute/v2.1/servers/c3c9b3c1-515c-4cd1-adcc-b8fa755fa489 => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:31:47.014003 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-701b7d9a-bc3c-455b-a582-f593b178faf2 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:31:47.014529 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-701b7d9a-bc3c-455b-a582-f593b178faf2 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: c3c9b3c1-515c-4cd1-adcc-b8fa755fa489] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:31:47.022145 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-701b7d9a-bc3c-455b-a582-f593b178faf2 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:31:47.022649 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-701b7d9a-bc3c-455b-a582-f593b178faf2 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:31:47.023106 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-701b7d9a-bc3c-455b-a582-f593b178faf2 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:31:47.023813 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-701b7d9a-bc3c-455b-a582-f593b178faf2 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:31:47.024285 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-701b7d9a-bc3c-455b-a582-f593b178faf2 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:31:47.024726 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-701b7d9a-bc3c-455b-a582-f593b178faf2 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:31:47.153446 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-701b7d9a-bc3c-455b-a582-f593b178faf2 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:31:47.161811 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-701b7d9a-bc3c-455b-a582-f593b178faf2 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/c3c9b3c1-515c-4cd1-adcc-b8fa755fa489" status: 200 len: 1684 microversion: 2.1 time: 0.151932 Sep 23 05:31:47.162441 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3547/7273] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:31:47 2022] GET /compute/v2.1/servers/c3c9b3c1-515c-4cd1-adcc-b8fa755fa489 => generated 1684 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:31:48.184617 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0e27b4d2-72f9-45b3-9195-8a498f6e242f tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:31:48.185315 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-0e27b4d2-72f9-45b3-9195-8a498f6e242f tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: c3c9b3c1-515c-4cd1-adcc-b8fa755fa489] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:31:48.191781 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0e27b4d2-72f9-45b3-9195-8a498f6e242f tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:31:48.192269 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0e27b4d2-72f9-45b3-9195-8a498f6e242f tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:31:48.192702 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0e27b4d2-72f9-45b3-9195-8a498f6e242f tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:31:48.193388 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0e27b4d2-72f9-45b3-9195-8a498f6e242f tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:31:48.193842 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0e27b4d2-72f9-45b3-9195-8a498f6e242f tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:31:48.194289 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0e27b4d2-72f9-45b3-9195-8a498f6e242f tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:31:48.327576 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-0e27b4d2-72f9-45b3-9195-8a498f6e242f tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:31:48.335545 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0e27b4d2-72f9-45b3-9195-8a498f6e242f tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/c3c9b3c1-515c-4cd1-adcc-b8fa755fa489" status: 200 len: 1684 microversion: 2.1 time: 0.154834 Sep 23 05:31:48.336123 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3727/7274] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:31:48 2022] GET /compute/v2.1/servers/c3c9b3c1-515c-4cd1-adcc-b8fa755fa489 => generated 1684 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:31:49.359505 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-76551301-5ddc-47a6-850c-4af7da23c1f1 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:31:49.360144 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-76551301-5ddc-47a6-850c-4af7da23c1f1 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: c3c9b3c1-515c-4cd1-adcc-b8fa755fa489] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:31:49.367579 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-76551301-5ddc-47a6-850c-4af7da23c1f1 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:31:49.368089 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-76551301-5ddc-47a6-850c-4af7da23c1f1 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:31:49.368550 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-76551301-5ddc-47a6-850c-4af7da23c1f1 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:31:49.369269 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-76551301-5ddc-47a6-850c-4af7da23c1f1 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:31:49.369754 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-76551301-5ddc-47a6-850c-4af7da23c1f1 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:31:49.370239 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-76551301-5ddc-47a6-850c-4af7da23c1f1 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:31:49.499977 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-76551301-5ddc-47a6-850c-4af7da23c1f1 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:31:49.507807 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-76551301-5ddc-47a6-850c-4af7da23c1f1 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/c3c9b3c1-515c-4cd1-adcc-b8fa755fa489" status: 200 len: 1684 microversion: 2.1 time: 0.152310 Sep 23 05:31:49.508388 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3548/7275] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:31:49 2022] GET /compute/v2.1/servers/c3c9b3c1-515c-4cd1-adcc-b8fa755fa489 => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:31:50.531380 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-00df3a21-5c50-486c-a8cb-6964557264ae tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:31:50.532022 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-00df3a21-5c50-486c-a8cb-6964557264ae tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: c3c9b3c1-515c-4cd1-adcc-b8fa755fa489] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:31:50.538549 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-00df3a21-5c50-486c-a8cb-6964557264ae tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:31:50.540960 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-00df3a21-5c50-486c-a8cb-6964557264ae tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:31:50.540960 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-00df3a21-5c50-486c-a8cb-6964557264ae tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:31:50.540960 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-00df3a21-5c50-486c-a8cb-6964557264ae tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:31:50.540960 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-00df3a21-5c50-486c-a8cb-6964557264ae tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:31:50.540960 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-00df3a21-5c50-486c-a8cb-6964557264ae tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:31:50.673564 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-00df3a21-5c50-486c-a8cb-6964557264ae tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:31:50.681905 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-00df3a21-5c50-486c-a8cb-6964557264ae tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/c3c9b3c1-515c-4cd1-adcc-b8fa755fa489" status: 200 len: 1684 microversion: 2.1 time: 0.154434 Sep 23 05:31:50.682489 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3728/7276] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:31:50 2022] GET /compute/v2.1/servers/c3c9b3c1-515c-4cd1-adcc-b8fa755fa489 => generated 1684 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:31:51.706299 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8a00e7a2-b541-43d9-996d-b648955a84ed tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:31:51.706922 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8a00e7a2-b541-43d9-996d-b648955a84ed tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: c3c9b3c1-515c-4cd1-adcc-b8fa755fa489] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:31:51.713656 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8a00e7a2-b541-43d9-996d-b648955a84ed tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:31:51.714185 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8a00e7a2-b541-43d9-996d-b648955a84ed tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:31:51.714643 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8a00e7a2-b541-43d9-996d-b648955a84ed tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:31:51.715344 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8a00e7a2-b541-43d9-996d-b648955a84ed tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:31:51.715820 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8a00e7a2-b541-43d9-996d-b648955a84ed tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:31:51.716262 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8a00e7a2-b541-43d9-996d-b648955a84ed tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:31:51.846919 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8a00e7a2-b541-43d9-996d-b648955a84ed tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:31:51.854659 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8a00e7a2-b541-43d9-996d-b648955a84ed tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/c3c9b3c1-515c-4cd1-adcc-b8fa755fa489" status: 200 len: 1684 microversion: 2.1 time: 0.152792 Sep 23 05:31:51.855227 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3549/7277] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:31:51 2022] GET /compute/v2.1/servers/c3c9b3c1-515c-4cd1-adcc-b8fa755fa489 => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:31:52.878852 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2245205c-e759-48b4-b934-94ed3f3067ef tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:31:52.879472 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-2245205c-e759-48b4-b934-94ed3f3067ef tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: c3c9b3c1-515c-4cd1-adcc-b8fa755fa489] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:31:52.886098 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2245205c-e759-48b4-b934-94ed3f3067ef tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:31:52.886594 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2245205c-e759-48b4-b934-94ed3f3067ef tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:31:52.887038 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2245205c-e759-48b4-b934-94ed3f3067ef tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:31:52.887735 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2245205c-e759-48b4-b934-94ed3f3067ef tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:31:52.888202 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2245205c-e759-48b4-b934-94ed3f3067ef tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:31:52.888632 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2245205c-e759-48b4-b934-94ed3f3067ef tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:31:53.024901 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2245205c-e759-48b4-b934-94ed3f3067ef tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:31:53.027046 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2245205c-e759-48b4-b934-94ed3f3067ef tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/c3c9b3c1-515c-4cd1-adcc-b8fa755fa489" status: 200 len: 1684 microversion: 2.1 time: 0.152056 Sep 23 05:31:53.027680 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3729/7278] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:31:52 2022] GET /compute/v2.1/servers/c3c9b3c1-515c-4cd1-adcc-b8fa755fa489 => generated 1684 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:31:54.052051 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-194f15f5-276b-4f0e-bcd4-9142a2999af4 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:31:54.052659 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-194f15f5-276b-4f0e-bcd4-9142a2999af4 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: c3c9b3c1-515c-4cd1-adcc-b8fa755fa489] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:31:54.059737 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-194f15f5-276b-4f0e-bcd4-9142a2999af4 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:31:54.060243 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-194f15f5-276b-4f0e-bcd4-9142a2999af4 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:31:54.060699 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-194f15f5-276b-4f0e-bcd4-9142a2999af4 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:31:54.061409 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-194f15f5-276b-4f0e-bcd4-9142a2999af4 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:31:54.061923 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-194f15f5-276b-4f0e-bcd4-9142a2999af4 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:31:54.062375 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-194f15f5-276b-4f0e-bcd4-9142a2999af4 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:31:54.199613 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-194f15f5-276b-4f0e-bcd4-9142a2999af4 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:31:54.207579 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-194f15f5-276b-4f0e-bcd4-9142a2999af4 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/c3c9b3c1-515c-4cd1-adcc-b8fa755fa489" status: 200 len: 1684 microversion: 2.1 time: 0.160067 Sep 23 05:31:54.208165 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3550/7279] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:31:54 2022] GET /compute/v2.1/servers/c3c9b3c1-515c-4cd1-adcc-b8fa755fa489 => generated 1684 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:31:55.232212 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-db5584b0-1c46-417e-b4ea-f7624c90b5cf tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:31:55.232855 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-db5584b0-1c46-417e-b4ea-f7624c90b5cf tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: c3c9b3c1-515c-4cd1-adcc-b8fa755fa489] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:31:55.239911 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-db5584b0-1c46-417e-b4ea-f7624c90b5cf tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:31:55.240399 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-db5584b0-1c46-417e-b4ea-f7624c90b5cf tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:31:55.240838 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-db5584b0-1c46-417e-b4ea-f7624c90b5cf tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:31:55.241524 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-db5584b0-1c46-417e-b4ea-f7624c90b5cf tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:31:55.242009 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-db5584b0-1c46-417e-b4ea-f7624c90b5cf tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:31:55.242436 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-db5584b0-1c46-417e-b4ea-f7624c90b5cf tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:31:55.385728 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-db5584b0-1c46-417e-b4ea-f7624c90b5cf tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:31:55.394260 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-db5584b0-1c46-417e-b4ea-f7624c90b5cf tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/c3c9b3c1-515c-4cd1-adcc-b8fa755fa489" status: 200 len: 1684 microversion: 2.1 time: 0.165722 Sep 23 05:31:55.394862 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3730/7280] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:31:55 2022] GET /compute/v2.1/servers/c3c9b3c1-515c-4cd1-adcc-b8fa755fa489 => generated 1684 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:31:56.418033 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e348803e-7479-4191-9cf5-637076c02ad8 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:31:56.418703 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e348803e-7479-4191-9cf5-637076c02ad8 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: c3c9b3c1-515c-4cd1-adcc-b8fa755fa489] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:31:56.425612 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e348803e-7479-4191-9cf5-637076c02ad8 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:31:56.426157 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e348803e-7479-4191-9cf5-637076c02ad8 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:31:56.426620 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e348803e-7479-4191-9cf5-637076c02ad8 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:31:56.427334 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e348803e-7479-4191-9cf5-637076c02ad8 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:31:56.427812 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e348803e-7479-4191-9cf5-637076c02ad8 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:31:56.428257 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e348803e-7479-4191-9cf5-637076c02ad8 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:31:56.559392 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e348803e-7479-4191-9cf5-637076c02ad8 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:31:56.567661 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e348803e-7479-4191-9cf5-637076c02ad8 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/c3c9b3c1-515c-4cd1-adcc-b8fa755fa489" status: 200 len: 1684 microversion: 2.1 time: 0.153669 Sep 23 05:31:56.568241 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3551/7281] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:31:56 2022] GET /compute/v2.1/servers/c3c9b3c1-515c-4cd1-adcc-b8fa755fa489 => generated 1684 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:31:57.591851 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8624ec87-fd9e-49c8-bd84-ead68111d8dd tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:31:57.592389 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-8624ec87-fd9e-49c8-bd84-ead68111d8dd tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: c3c9b3c1-515c-4cd1-adcc-b8fa755fa489] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:31:57.599484 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8624ec87-fd9e-49c8-bd84-ead68111d8dd tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:31:57.599978 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8624ec87-fd9e-49c8-bd84-ead68111d8dd tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:31:57.600427 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8624ec87-fd9e-49c8-bd84-ead68111d8dd tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:31:57.601124 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8624ec87-fd9e-49c8-bd84-ead68111d8dd tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:31:57.601588 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8624ec87-fd9e-49c8-bd84-ead68111d8dd tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:31:57.602052 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8624ec87-fd9e-49c8-bd84-ead68111d8dd tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:31:57.728509 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-8624ec87-fd9e-49c8-bd84-ead68111d8dd tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:31:57.736227 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-8624ec87-fd9e-49c8-bd84-ead68111d8dd tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/c3c9b3c1-515c-4cd1-adcc-b8fa755fa489" status: 200 len: 1684 microversion: 2.1 time: 0.148357 Sep 23 05:31:57.736809 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3731/7282] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:31:57 2022] GET /compute/v2.1/servers/c3c9b3c1-515c-4cd1-adcc-b8fa755fa489 => generated 1684 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:31:58.759692 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-60aab26a-15ae-4667-8482-039001d4e7c0 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:31:58.760339 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-60aab26a-15ae-4667-8482-039001d4e7c0 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: c3c9b3c1-515c-4cd1-adcc-b8fa755fa489] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:31:58.767854 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-60aab26a-15ae-4667-8482-039001d4e7c0 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:31:58.768297 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-60aab26a-15ae-4667-8482-039001d4e7c0 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:31:58.768764 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-60aab26a-15ae-4667-8482-039001d4e7c0 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:31:58.769494 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-60aab26a-15ae-4667-8482-039001d4e7c0 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:31:58.770014 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-60aab26a-15ae-4667-8482-039001d4e7c0 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:31:58.770470 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-60aab26a-15ae-4667-8482-039001d4e7c0 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:31:58.909763 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-60aab26a-15ae-4667-8482-039001d4e7c0 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:31:58.917553 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-60aab26a-15ae-4667-8482-039001d4e7c0 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/c3c9b3c1-515c-4cd1-adcc-b8fa755fa489" status: 200 len: 1683 microversion: 2.1 time: 0.161934 Sep 23 05:31:58.918174 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3552/7283] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:31:58 2022] GET /compute/v2.1/servers/c3c9b3c1-515c-4cd1-adcc-b8fa755fa489 => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:31:59.221778 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-36b5fd69-25cc-4cf7-86ef-64bc96e63f39 req-9da090b1-9032-4dc6-9b6f-4ebff052bd5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3c9b3c1-515c-4cd1-adcc-b8fa755fa489", "name": "network-vif-unplugged", "status": "completed", "tag": "ecca24fc-9235-426a-a657-fefd048187c4"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:31:59.232235 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-36b5fd69-25cc-4cf7-86ef-64bc96e63f39 req-9da090b1-9032-4dc6-9b6f-4ebff052bd5a service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:31:59.232719 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-36b5fd69-25cc-4cf7-86ef-64bc96e63f39 req-9da090b1-9032-4dc6-9b6f-4ebff052bd5a service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:31:59.233185 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-36b5fd69-25cc-4cf7-86ef-64bc96e63f39 req-9da090b1-9032-4dc6-9b6f-4ebff052bd5a service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:31:59.244965 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-36b5fd69-25cc-4cf7-86ef-64bc96e63f39 req-9da090b1-9032-4dc6-9b6f-4ebff052bd5a service nova] Creating event network-vif-unplugged:ecca24fc-9235-426a-a657-fefd048187c4 for instance c3c9b3c1-515c-4cd1-adcc-b8fa755fa489 on n-h1-846463-3 Sep 23 05:31:59.250351 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [req-36b5fd69-25cc-4cf7-86ef-64bc96e63f39 req-9da090b1-9032-4dc6-9b6f-4ebff052bd5a service nova] Instance c3c9b3c1-515c-4cd1-adcc-b8fa755fa489 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846463-3', 'n-h2-846463-3'} {{(pid=122699) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 23 05:31:59.261957 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-36b5fd69-25cc-4cf7-86ef-64bc96e63f39 req-9da090b1-9032-4dc6-9b6f-4ebff052bd5a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043895 Sep 23 05:31:59.262908 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3732/7284] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:31:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:31:59.941429 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c848872e-c6a8-41a7-b9fd-3124b79d0dd0 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:31:59.942155 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c848872e-c6a8-41a7-b9fd-3124b79d0dd0 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: c3c9b3c1-515c-4cd1-adcc-b8fa755fa489] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:31:59.949226 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c848872e-c6a8-41a7-b9fd-3124b79d0dd0 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:31:59.949746 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c848872e-c6a8-41a7-b9fd-3124b79d0dd0 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:31:59.950247 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c848872e-c6a8-41a7-b9fd-3124b79d0dd0 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:31:59.951111 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c848872e-c6a8-41a7-b9fd-3124b79d0dd0 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:31:59.951601 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c848872e-c6a8-41a7-b9fd-3124b79d0dd0 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:31:59.952053 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c848872e-c6a8-41a7-b9fd-3124b79d0dd0 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:32:00.087142 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c848872e-c6a8-41a7-b9fd-3124b79d0dd0 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:32:00.095025 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c848872e-c6a8-41a7-b9fd-3124b79d0dd0 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/c3c9b3c1-515c-4cd1-adcc-b8fa755fa489" status: 200 len: 1683 microversion: 2.1 time: 0.158276 Sep 23 05:32:00.095605 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3553/7285] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:31:59 2022] GET /compute/v2.1/servers/c3c9b3c1-515c-4cd1-adcc-b8fa755fa489 => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:32:01.119266 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-96dcc88e-3bff-494a-b8b0-16d24cf1f9b7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:32:01.119998 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-96dcc88e-3bff-494a-b8b0-16d24cf1f9b7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: c3c9b3c1-515c-4cd1-adcc-b8fa755fa489] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:32:01.126080 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-96dcc88e-3bff-494a-b8b0-16d24cf1f9b7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:32:01.126564 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-96dcc88e-3bff-494a-b8b0-16d24cf1f9b7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:32:01.126998 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-96dcc88e-3bff-494a-b8b0-16d24cf1f9b7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:32:01.127687 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-96dcc88e-3bff-494a-b8b0-16d24cf1f9b7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:32:01.128142 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-96dcc88e-3bff-494a-b8b0-16d24cf1f9b7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:32:01.128566 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-96dcc88e-3bff-494a-b8b0-16d24cf1f9b7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:32:01.258347 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-96dcc88e-3bff-494a-b8b0-16d24cf1f9b7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:32:01.266259 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-96dcc88e-3bff-494a-b8b0-16d24cf1f9b7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/c3c9b3c1-515c-4cd1-adcc-b8fa755fa489" status: 200 len: 1681 microversion: 2.1 time: 0.151747 Sep 23 05:32:01.266873 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3733/7286] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:32:01 2022] GET /compute/v2.1/servers/c3c9b3c1-515c-4cd1-adcc-b8fa755fa489 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:32:01.276669 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-f6e3454a-87f0-40c7-a600-9f1cba622dfb req-d1830ba7-1789-4168-8de7-3f951d2a66dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3c9b3c1-515c-4cd1-adcc-b8fa755fa489", "tag": "ecca24fc-9235-426a-a657-fefd048187c4"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:32:01.287870 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-f6e3454a-87f0-40c7-a600-9f1cba622dfb req-d1830ba7-1789-4168-8de7-3f951d2a66dd service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:32:01.288371 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-f6e3454a-87f0-40c7-a600-9f1cba622dfb req-d1830ba7-1789-4168-8de7-3f951d2a66dd service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:32:01.288859 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-f6e3454a-87f0-40c7-a600-9f1cba622dfb req-d1830ba7-1789-4168-8de7-3f951d2a66dd service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:32:01.300551 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-f6e3454a-87f0-40c7-a600-9f1cba622dfb req-d1830ba7-1789-4168-8de7-3f951d2a66dd service nova] Creating event network-changed:ecca24fc-9235-426a-a657-fefd048187c4 for instance c3c9b3c1-515c-4cd1-adcc-b8fa755fa489 on n-h1-846463-3 Sep 23 05:32:01.305752 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [req-f6e3454a-87f0-40c7-a600-9f1cba622dfb req-d1830ba7-1789-4168-8de7-3f951d2a66dd service nova] Instance c3c9b3c1-515c-4cd1-adcc-b8fa755fa489 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846463-3', 'n-h2-846463-3'} {{(pid=122698) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 23 05:32:01.316441 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-f6e3454a-87f0-40c7-a600-9f1cba622dfb req-d1830ba7-1789-4168-8de7-3f951d2a66dd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043544 Sep 23 05:32:01.317025 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3554/7287] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:32:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:32:02.290803 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d0b7be3b-436d-4c90-8f87-69fe4b892631 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:32:02.291503 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d0b7be3b-436d-4c90-8f87-69fe4b892631 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: c3c9b3c1-515c-4cd1-adcc-b8fa755fa489] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:32:02.298199 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d0b7be3b-436d-4c90-8f87-69fe4b892631 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:32:02.298571 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d0b7be3b-436d-4c90-8f87-69fe4b892631 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:32:02.299104 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d0b7be3b-436d-4c90-8f87-69fe4b892631 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:32:02.300390 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d0b7be3b-436d-4c90-8f87-69fe4b892631 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:32:02.300848 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d0b7be3b-436d-4c90-8f87-69fe4b892631 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:32:02.301357 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d0b7be3b-436d-4c90-8f87-69fe4b892631 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:32:02.447374 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d0b7be3b-436d-4c90-8f87-69fe4b892631 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:32:02.455241 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d0b7be3b-436d-4c90-8f87-69fe4b892631 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/c3c9b3c1-515c-4cd1-adcc-b8fa755fa489" status: 200 len: 1681 microversion: 2.1 time: 0.168478 Sep 23 05:32:02.464845 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3734/7288] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:32:02 2022] GET /compute/v2.1/servers/c3c9b3c1-515c-4cd1-adcc-b8fa755fa489 => generated 1681 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:32:03.479468 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5471b7c8-3fb1-4181-8e82-7ff278ccaa90 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:32:03.480112 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5471b7c8-3fb1-4181-8e82-7ff278ccaa90 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: c3c9b3c1-515c-4cd1-adcc-b8fa755fa489] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:32:03.486309 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5471b7c8-3fb1-4181-8e82-7ff278ccaa90 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:32:03.487329 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5471b7c8-3fb1-4181-8e82-7ff278ccaa90 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:32:03.487791 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5471b7c8-3fb1-4181-8e82-7ff278ccaa90 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:32:03.488507 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5471b7c8-3fb1-4181-8e82-7ff278ccaa90 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:32:03.488988 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5471b7c8-3fb1-4181-8e82-7ff278ccaa90 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:32:03.489440 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5471b7c8-3fb1-4181-8e82-7ff278ccaa90 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:32:03.618888 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-5471b7c8-3fb1-4181-8e82-7ff278ccaa90 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:32:03.626659 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5471b7c8-3fb1-4181-8e82-7ff278ccaa90 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/c3c9b3c1-515c-4cd1-adcc-b8fa755fa489" status: 200 len: 1678 microversion: 2.1 time: 0.152460 Sep 23 05:32:03.627286 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3555/7289] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:32:03 2022] GET /compute/v2.1/servers/c3c9b3c1-515c-4cd1-adcc-b8fa755fa489 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:32:03.650227 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0aeeae01-c973-435e-8860-651152deb1ac tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:32:03.650772 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-0aeeae01-c973-435e-8860-651152deb1ac tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: c3c9b3c1-515c-4cd1-adcc-b8fa755fa489] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:32:03.657268 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0aeeae01-c973-435e-8860-651152deb1ac tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:32:03.657765 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0aeeae01-c973-435e-8860-651152deb1ac tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:32:03.658251 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0aeeae01-c973-435e-8860-651152deb1ac tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:32:03.658951 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0aeeae01-c973-435e-8860-651152deb1ac tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:32:03.659422 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0aeeae01-c973-435e-8860-651152deb1ac tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:32:03.659854 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0aeeae01-c973-435e-8860-651152deb1ac tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:32:03.843265 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0aeeae01-c973-435e-8860-651152deb1ac tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "POST /compute/v2.1/servers/c3c9b3c1-515c-4cd1-adcc-b8fa755fa489/action" status: 204 len: 0 microversion: 2.1 time: 0.196615 Sep 23 05:32:03.843824 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3735/7290] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 05:32:03 2022] POST /compute/v2.1/servers/c3c9b3c1-515c-4cd1-adcc-b8fa755fa489/action => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 05:32:03.854482 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6775bbc1-6191-4a89-a79c-ec1e63f41195 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:32:03.855113 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-6775bbc1-6191-4a89-a79c-ec1e63f41195 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: c3c9b3c1-515c-4cd1-adcc-b8fa755fa489] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:32:03.861363 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6775bbc1-6191-4a89-a79c-ec1e63f41195 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:32:03.862542 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6775bbc1-6191-4a89-a79c-ec1e63f41195 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:32:03.863010 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6775bbc1-6191-4a89-a79c-ec1e63f41195 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:32:03.863786 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6775bbc1-6191-4a89-a79c-ec1e63f41195 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:32:03.864272 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6775bbc1-6191-4a89-a79c-ec1e63f41195 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:32:03.864723 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6775bbc1-6191-4a89-a79c-ec1e63f41195 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:32:04.004268 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6775bbc1-6191-4a89-a79c-ec1e63f41195 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:32:04.012618 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-6775bbc1-6191-4a89-a79c-ec1e63f41195 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/c3c9b3c1-515c-4cd1-adcc-b8fa755fa489" status: 200 len: 1678 microversion: 2.1 time: 0.162746 Sep 23 05:32:04.013269 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3556/7291] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:32:03 2022] GET /compute/v2.1/servers/c3c9b3c1-515c-4cd1-adcc-b8fa755fa489 => generated 1678 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:32:05.037424 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-517f4535-5a3f-4668-b1a7-c36c2edeb344 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:32:05.038220 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-517f4535-5a3f-4668-b1a7-c36c2edeb344 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: c3c9b3c1-515c-4cd1-adcc-b8fa755fa489] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:32:05.044529 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-517f4535-5a3f-4668-b1a7-c36c2edeb344 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:32:05.045026 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-517f4535-5a3f-4668-b1a7-c36c2edeb344 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:32:05.045490 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-517f4535-5a3f-4668-b1a7-c36c2edeb344 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:32:05.046238 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-517f4535-5a3f-4668-b1a7-c36c2edeb344 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:32:05.046702 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-517f4535-5a3f-4668-b1a7-c36c2edeb344 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:32:05.047137 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-517f4535-5a3f-4668-b1a7-c36c2edeb344 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:32:05.181238 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-517f4535-5a3f-4668-b1a7-c36c2edeb344 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:32:05.189330 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-517f4535-5a3f-4668-b1a7-c36c2edeb344 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/c3c9b3c1-515c-4cd1-adcc-b8fa755fa489" status: 200 len: 1678 microversion: 2.1 time: 0.156761 Sep 23 05:32:05.190942 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3736/7292] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:32:05 2022] GET /compute/v2.1/servers/c3c9b3c1-515c-4cd1-adcc-b8fa755fa489 => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:32:06.213215 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-47c9889f-55eb-4ee9-805e-d90a2c62c23b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:32:06.213755 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-47c9889f-55eb-4ee9-805e-d90a2c62c23b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: c3c9b3c1-515c-4cd1-adcc-b8fa755fa489] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:32:06.220827 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-47c9889f-55eb-4ee9-805e-d90a2c62c23b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:32:06.221371 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-47c9889f-55eb-4ee9-805e-d90a2c62c23b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:32:06.221826 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-47c9889f-55eb-4ee9-805e-d90a2c62c23b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:32:06.222561 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-47c9889f-55eb-4ee9-805e-d90a2c62c23b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:32:06.223034 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-47c9889f-55eb-4ee9-805e-d90a2c62c23b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:32:06.223477 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-47c9889f-55eb-4ee9-805e-d90a2c62c23b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:32:06.353118 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-47c9889f-55eb-4ee9-805e-d90a2c62c23b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:32:06.361392 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-47c9889f-55eb-4ee9-805e-d90a2c62c23b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/c3c9b3c1-515c-4cd1-adcc-b8fa755fa489" status: 200 len: 1670 microversion: 2.1 time: 0.152189 Sep 23 05:32:06.362524 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3557/7293] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:32:06 2022] GET /compute/v2.1/servers/c3c9b3c1-515c-4cd1-adcc-b8fa755fa489 => generated 1670 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:32:06.385411 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-34cdabbc-75f3-4e8d-aa0b-2a27abcfa76f tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:32:06.386066 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-34cdabbc-75f3-4e8d-aa0b-2a27abcfa76f tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: c3c9b3c1-515c-4cd1-adcc-b8fa755fa489] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:32:06.392974 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-34cdabbc-75f3-4e8d-aa0b-2a27abcfa76f tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:32:06.393519 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-34cdabbc-75f3-4e8d-aa0b-2a27abcfa76f tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:32:06.394109 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-34cdabbc-75f3-4e8d-aa0b-2a27abcfa76f tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:32:06.394810 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-34cdabbc-75f3-4e8d-aa0b-2a27abcfa76f tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:32:06.395266 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-34cdabbc-75f3-4e8d-aa0b-2a27abcfa76f tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:32:06.395717 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-34cdabbc-75f3-4e8d-aa0b-2a27abcfa76f tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:32:06.449251 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-7a41a4ff-2960-4622-9b08-22ed99b9da6c req-bdddf042-5abe-4aa1-972f-3fc670d01520 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3c9b3c1-515c-4cd1-adcc-b8fa755fa489", "name": "network-vif-plugged", "status": "completed", "tag": "ecca24fc-9235-426a-a657-fefd048187c4"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:32:06.459172 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-7a41a4ff-2960-4622-9b08-22ed99b9da6c req-bdddf042-5abe-4aa1-972f-3fc670d01520 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:32:06.459783 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-7a41a4ff-2960-4622-9b08-22ed99b9da6c req-bdddf042-5abe-4aa1-972f-3fc670d01520 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:32:06.460314 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-7a41a4ff-2960-4622-9b08-22ed99b9da6c req-bdddf042-5abe-4aa1-972f-3fc670d01520 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:32:06.471771 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-7a41a4ff-2960-4622-9b08-22ed99b9da6c req-bdddf042-5abe-4aa1-972f-3fc670d01520 service nova] Creating event network-vif-plugged:ecca24fc-9235-426a-a657-fefd048187c4 for instance c3c9b3c1-515c-4cd1-adcc-b8fa755fa489 on n-h1-846463-3 Sep 23 05:32:06.477040 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-7a41a4ff-2960-4622-9b08-22ed99b9da6c req-bdddf042-5abe-4aa1-972f-3fc670d01520 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031469 Sep 23 05:32:06.477768 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3558/7294] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:32:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 05:32:06.529564 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-34cdabbc-75f3-4e8d-aa0b-2a27abcfa76f tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:32:06.537338 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-34cdabbc-75f3-4e8d-aa0b-2a27abcfa76f tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/c3c9b3c1-515c-4cd1-adcc-b8fa755fa489" status: 200 len: 1670 microversion: 2.1 time: 0.155931 Sep 23 05:32:06.538181 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3737/7295] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:32:06 2022] GET /compute/v2.1/servers/c3c9b3c1-515c-4cd1-adcc-b8fa755fa489 => generated 1670 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:32:06.561262 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-988db4f0-1217-4155-af4c-8125e9d36d18 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:32:06.562015 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-988db4f0-1217-4155-af4c-8125e9d36d18 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: c3c9b3c1-515c-4cd1-adcc-b8fa755fa489] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:32:06.568843 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-988db4f0-1217-4155-af4c-8125e9d36d18 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:32:06.569358 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-988db4f0-1217-4155-af4c-8125e9d36d18 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:32:06.569813 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-988db4f0-1217-4155-af4c-8125e9d36d18 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:32:06.570557 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-988db4f0-1217-4155-af4c-8125e9d36d18 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:32:06.571030 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-988db4f0-1217-4155-af4c-8125e9d36d18 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:32:06.571473 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-988db4f0-1217-4155-af4c-8125e9d36d18 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:32:06.703767 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-988db4f0-1217-4155-af4c-8125e9d36d18 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:32:06.714108 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-988db4f0-1217-4155-af4c-8125e9d36d18 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/c3c9b3c1-515c-4cd1-adcc-b8fa755fa489" status: 200 len: 1670 microversion: 2.1 time: 0.157001 Sep 23 05:32:06.714711 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3559/7296] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:32:06 2022] GET /compute/v2.1/servers/c3c9b3c1-515c-4cd1-adcc-b8fa755fa489 => generated 1670 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:32:06.737405 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-bf1657f3-dbfe-4531-a98f-fc697d8035e6 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:32:06.737838 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-bf1657f3-dbfe-4531-a98f-fc697d8035e6 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: c3c9b3c1-515c-4cd1-adcc-b8fa755fa489] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:32:06.743786 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bf1657f3-dbfe-4531-a98f-fc697d8035e6 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:32:06.744292 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bf1657f3-dbfe-4531-a98f-fc697d8035e6 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:32:06.744737 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bf1657f3-dbfe-4531-a98f-fc697d8035e6 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:32:06.745474 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bf1657f3-dbfe-4531-a98f-fc697d8035e6 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:32:06.745962 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bf1657f3-dbfe-4531-a98f-fc697d8035e6 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:32:06.746395 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bf1657f3-dbfe-4531-a98f-fc697d8035e6 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:32:06.772664 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-bf1657f3-dbfe-4531-a98f-fc697d8035e6 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: c3c9b3c1-515c-4cd1-adcc-b8fa755fa489] Going to try to terminate instance {{(pid=122699) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 05:32:06.775749 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:32:07.042456 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-bf1657f3-dbfe-4531-a98f-fc697d8035e6 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c3c9b3c1-515c-4cd1-adcc-b8fa755fa489" status: 204 len: 0 microversion: 2.1 time: 0.309098 Sep 23 05:32:07.042971 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3738/7297] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 05:32:06 2022] DELETE /compute/v2.1/servers/c3c9b3c1-515c-4cd1-adcc-b8fa755fa489 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 05:32:07.055967 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d80e69c6-2bf2-4a2c-8816-c77338ec5ea9 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:32:07.056668 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d80e69c6-2bf2-4a2c-8816-c77338ec5ea9 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: c3c9b3c1-515c-4cd1-adcc-b8fa755fa489] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:32:07.064321 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d80e69c6-2bf2-4a2c-8816-c77338ec5ea9 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:32:07.068929 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d80e69c6-2bf2-4a2c-8816-c77338ec5ea9 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:32:07.068929 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d80e69c6-2bf2-4a2c-8816-c77338ec5ea9 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:32:07.068929 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d80e69c6-2bf2-4a2c-8816-c77338ec5ea9 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:32:07.068929 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d80e69c6-2bf2-4a2c-8816-c77338ec5ea9 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:32:07.068929 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d80e69c6-2bf2-4a2c-8816-c77338ec5ea9 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:32:07.072635 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:32:07.201938 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d80e69c6-2bf2-4a2c-8816-c77338ec5ea9 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:32:07.210377 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d80e69c6-2bf2-4a2c-8816-c77338ec5ea9 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/c3c9b3c1-515c-4cd1-adcc-b8fa755fa489" status: 200 len: 1676 microversion: 2.1 time: 0.158298 Sep 23 05:32:07.210956 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3560/7298] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:32:07 2022] GET /compute/v2.1/servers/c3c9b3c1-515c-4cd1-adcc-b8fa755fa489 => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:32:08.234255 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0749549b-064a-4665-bd65-4e9d18b9474b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:32:08.234963 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-0749549b-064a-4665-bd65-4e9d18b9474b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: c3c9b3c1-515c-4cd1-adcc-b8fa755fa489] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:32:08.242081 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0749549b-064a-4665-bd65-4e9d18b9474b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:32:08.242580 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0749549b-064a-4665-bd65-4e9d18b9474b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:32:08.243028 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0749549b-064a-4665-bd65-4e9d18b9474b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:32:08.243729 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0749549b-064a-4665-bd65-4e9d18b9474b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:32:08.244197 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0749549b-064a-4665-bd65-4e9d18b9474b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:32:08.244631 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0749549b-064a-4665-bd65-4e9d18b9474b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:32:08.375067 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-0749549b-064a-4665-bd65-4e9d18b9474b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:32:08.383227 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0749549b-064a-4665-bd65-4e9d18b9474b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/c3c9b3c1-515c-4cd1-adcc-b8fa755fa489" status: 200 len: 1676 microversion: 2.1 time: 0.153207 Sep 23 05:32:08.383823 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3739/7299] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:32:08 2022] GET /compute/v2.1/servers/c3c9b3c1-515c-4cd1-adcc-b8fa755fa489 => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:32:09.271611 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-c177652f-06b9-405a-b808-1d898c3dc9eb req-a5e8acbf-9f5f-42e2-8618-0c991b5dac09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3c9b3c1-515c-4cd1-adcc-b8fa755fa489", "name": "network-vif-deleted", "tag": "ecca24fc-9235-426a-a657-fefd048187c4"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:32:09.282443 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-c177652f-06b9-405a-b808-1d898c3dc9eb req-a5e8acbf-9f5f-42e2-8618-0c991b5dac09 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:32:09.283116 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-c177652f-06b9-405a-b808-1d898c3dc9eb req-a5e8acbf-9f5f-42e2-8618-0c991b5dac09 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:32:09.283598 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-c177652f-06b9-405a-b808-1d898c3dc9eb req-a5e8acbf-9f5f-42e2-8618-0c991b5dac09 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:32:09.299520 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-c177652f-06b9-405a-b808-1d898c3dc9eb req-a5e8acbf-9f5f-42e2-8618-0c991b5dac09 service nova] Creating event network-vif-deleted:ecca24fc-9235-426a-a657-fefd048187c4 for instance c3c9b3c1-515c-4cd1-adcc-b8fa755fa489 on n-h1-846463-3 Sep 23 05:32:09.301467 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-c177652f-06b9-405a-b808-1d898c3dc9eb req-a5e8acbf-9f5f-42e2-8618-0c991b5dac09 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034517 Sep 23 05:32:09.302105 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3561/7300] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:32:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:32:09.408468 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4ebdce44-9082-4c86-9583-9ed9eeb61878 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:32:09.409137 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4ebdce44-9082-4c86-9583-9ed9eeb61878 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: c3c9b3c1-515c-4cd1-adcc-b8fa755fa489] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:32:09.415811 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4ebdce44-9082-4c86-9583-9ed9eeb61878 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:32:09.416305 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4ebdce44-9082-4c86-9583-9ed9eeb61878 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:32:09.416752 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4ebdce44-9082-4c86-9583-9ed9eeb61878 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:32:09.417553 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4ebdce44-9082-4c86-9583-9ed9eeb61878 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:32:09.418042 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4ebdce44-9082-4c86-9583-9ed9eeb61878 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:32:09.418474 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4ebdce44-9082-4c86-9583-9ed9eeb61878 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:32:09.491053 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-4ebdce44-9082-4c86-9583-9ed9eeb61878 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:32:09.499078 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4ebdce44-9082-4c86-9583-9ed9eeb61878 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/c3c9b3c1-515c-4cd1-adcc-b8fa755fa489" status: 200 len: 1324 microversion: 2.1 time: 0.094540 Sep 23 05:32:09.499665 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3740/7301] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:32:09 2022] GET /compute/v2.1/servers/c3c9b3c1-515c-4cd1-adcc-b8fa755fa489 => generated 1324 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:32:10.524821 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-93f56cd8-c5c2-4cf2-8d88-d3d641deee05 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:32:10.525515 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-93f56cd8-c5c2-4cf2-8d88-d3d641deee05 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: c3c9b3c1-515c-4cd1-adcc-b8fa755fa489] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:32:10.533200 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-93f56cd8-c5c2-4cf2-8d88-d3d641deee05 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:32:10.533715 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-93f56cd8-c5c2-4cf2-8d88-d3d641deee05 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:32:10.534202 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-93f56cd8-c5c2-4cf2-8d88-d3d641deee05 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:32:10.535103 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-93f56cd8-c5c2-4cf2-8d88-d3d641deee05 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:32:10.535604 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-93f56cd8-c5c2-4cf2-8d88-d3d641deee05 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:32:10.536069 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-93f56cd8-c5c2-4cf2-8d88-d3d641deee05 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:32:10.551846 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-93f56cd8-c5c2-4cf2-8d88-d3d641deee05 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] HTTP exception thrown: Instance c3c9b3c1-515c-4cd1-adcc-b8fa755fa489 could not be found. Sep 23 05:32:10.553551 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-93f56cd8-c5c2-4cf2-8d88-d3d641deee05 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Request method failure captured: Sep 23 05:32:10.553551 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/c3c9b3c1-515c-4cd1-adcc-b8fa755fa489 HTTP/1.1 Sep 23 05:32:10.553551 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 05:32:10.553551 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 05:32:10.553551 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 05:32:10.553551 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 05:32:10.553551 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 05:32:10.553551 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 05:32:10.553551 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 05:32:10.553551 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 05:32:10.553551 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLUSNPTcpFt7b1SQrBrdC4rAqFbUXLEG8j5xh3rTP1qyrEhV8SHPScnfZxRBpUy9MBZ19dFgqZBh9ggYKPA2VLn9rpizyOQlJ_nBmDT4jVqC1BV3Kf2f8DXLNaNiW44Z1VNZeBb_3I4dNJUWbXOX8beHhp39Bmiy2ImuZpbhlNdAaR6A Sep 23 05:32:10.553551 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 05:32:10.553551 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 05:32:10.553551 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 05:32:10.553551 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 05:32:10.553551 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 05:32:10.553551 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 05:32:10.553551 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: f991e11ed0c44131a4bd9be0110dffe0 Sep 23 05:32:10.553551 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ServerActionsTestJSON-551956227 Sep 23 05:32:10.553551 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 05:32:10.553551 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 05:32:10.553551 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f991e11ed0c44131a4bd9be0110dffe0", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f991e11ed0c44131a4bd9be0110dffe0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f991e11ed0c44131a4bd9be0110dffe0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f991e11ed0c44131a4bd9be0110dffe0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:32:10.553551 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ServerActionsTestJSON-551956227 Sep 23 05:32:10.553551 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: f991e11ed0c44131a4bd9be0110dffe0 Sep 23 05:32:10.553551 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ServerActionsTestJSON-551956227 Sep 23 05:32:10.553551 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ServerActionsTestJSON-551956227-project Sep 23 05:32:10.553551 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 05:32:10.553551 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 05:32:10.553551 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: f398aeafcbcb48d88d8cfd3bdf59bbed Sep 23 05:32:10.553551 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ServerActionsTestJSON-551956227-project Sep 23 05:32:10.553551 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 05:32:10.553551 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance c3c9b3c1-515c-4cd1-adcc-b8fa755fa489 could not be found. Sep 23 05:32:10.553551 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': 'c3c9b3c1-515c-4cd1-adcc-b8fa755fa489'} Sep 23 05:32:10.553551 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:32:10.553551 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:32:10.553551 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 05:32:10.553551 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 05:32:10.553551 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 05:32:10.553551 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 05:32:10.553551 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 05:32:10.553551 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 05:32:10.553551 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 05:32:10.553551 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 05:32:10.553551 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3c9b3c1-515c-4cd1-adcc-b8fa755fa489 could not be found. Sep 23 05:32:10.553551 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:32:10.553551 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:32:10.553551 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:32:10.553551 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:32:10.553551 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:32:10.553551 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:32:10.553551 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:32:10.553551 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:32:10.553551 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:32:10.553551 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:32:10.553551 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 05:32:10.553551 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 05:32:10.553551 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 05:32:10.553551 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 05:32:10.553551 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 05:32:10.553551 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:32:10.553551 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3c9b3c1-515c-4cd1-adcc-b8fa755fa489 could not be found. Sep 23 05:32:10.553551 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:32:10.553551 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:32:10.553551 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:32:10.558836 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:32:10.558836 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:32:10.558836 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:32:10.558836 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:32:10.558836 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:32:10.558836 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3c9b3c1-515c-4cd1-adcc-b8fa755fa489 could not be found. Sep 23 05:32:10.558836 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:32:10.558836 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-93f56cd8-c5c2-4cf2-8d88-d3d641deee05 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Returning 404 to user: Instance c3c9b3c1-515c-4cd1-adcc-b8fa755fa489 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:32:10.558836 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-93f56cd8-c5c2-4cf2-8d88-d3d641deee05 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/c3c9b3c1-515c-4cd1-adcc-b8fa755fa489" status: 404 len: 111 microversion: 2.1 time: 0.034673 Sep 23 05:32:10.558836 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3562/7302] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:32:10 2022] GET /compute/v2.1/servers/c3c9b3c1-515c-4cd1-adcc-b8fa755fa489 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 05:32:10.568004 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c7942c78-4c9c-4104-ad32-b01487ccb63a tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:32:10.568622 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c7942c78-4c9c-4104-ad32-b01487ccb63a tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: c3c9b3c1-515c-4cd1-adcc-b8fa755fa489] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:32:10.575181 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c7942c78-4c9c-4104-ad32-b01487ccb63a tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:32:10.575676 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c7942c78-4c9c-4104-ad32-b01487ccb63a tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:32:10.576122 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c7942c78-4c9c-4104-ad32-b01487ccb63a tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:32:10.576827 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c7942c78-4c9c-4104-ad32-b01487ccb63a tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:32:10.577339 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c7942c78-4c9c-4104-ad32-b01487ccb63a tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:32:10.577724 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c7942c78-4c9c-4104-ad32-b01487ccb63a tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:32:10.591569 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-c7942c78-4c9c-4104-ad32-b01487ccb63a tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] HTTP exception thrown: Instance c3c9b3c1-515c-4cd1-adcc-b8fa755fa489 could not be found. Sep 23 05:32:10.593192 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c7942c78-4c9c-4104-ad32-b01487ccb63a tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Request method failure captured: Sep 23 05:32:10.593192 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/c3c9b3c1-515c-4cd1-adcc-b8fa755fa489 HTTP/1.1 Sep 23 05:32:10.593192 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 05:32:10.593192 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 05:32:10.593192 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 05:32:10.593192 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 05:32:10.593192 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 05:32:10.593192 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 05:32:10.593192 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 05:32:10.593192 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 05:32:10.593192 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLUSNPTcpFt7b1SQrBrdC4rAqFbUXLEG8j5xh3rTP1qyrEhV8SHPScnfZxRBpUy9MBZ19dFgqZBh9ggYKPA2VLn9rpizyOQlJ_nBmDT4jVqC1BV3Kf2f8DXLNaNiW44Z1VNZeBb_3I4dNJUWbXOX8beHhp39Bmiy2ImuZpbhlNdAaR6A Sep 23 05:32:10.593192 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 05:32:10.593192 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 05:32:10.593192 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 05:32:10.593192 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 05:32:10.593192 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 05:32:10.593192 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 05:32:10.593192 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: f991e11ed0c44131a4bd9be0110dffe0 Sep 23 05:32:10.593192 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ServerActionsTestJSON-551956227 Sep 23 05:32:10.593192 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 05:32:10.593192 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 05:32:10.593192 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f991e11ed0c44131a4bd9be0110dffe0", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f991e11ed0c44131a4bd9be0110dffe0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f991e11ed0c44131a4bd9be0110dffe0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f991e11ed0c44131a4bd9be0110dffe0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:32:10.593192 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ServerActionsTestJSON-551956227 Sep 23 05:32:10.593192 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: f991e11ed0c44131a4bd9be0110dffe0 Sep 23 05:32:10.593192 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ServerActionsTestJSON-551956227 Sep 23 05:32:10.593192 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ServerActionsTestJSON-551956227-project Sep 23 05:32:10.593192 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 05:32:10.593192 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 05:32:10.593192 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: f398aeafcbcb48d88d8cfd3bdf59bbed Sep 23 05:32:10.593192 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ServerActionsTestJSON-551956227-project Sep 23 05:32:10.593192 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 05:32:10.593192 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance c3c9b3c1-515c-4cd1-adcc-b8fa755fa489 could not be found. Sep 23 05:32:10.593192 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': 'c3c9b3c1-515c-4cd1-adcc-b8fa755fa489'} Sep 23 05:32:10.593192 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:32:10.593192 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:32:10.593192 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 05:32:10.593192 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 05:32:10.593192 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 05:32:10.593192 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 05:32:10.593192 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 05:32:10.593192 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 05:32:10.593192 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 05:32:10.593192 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 05:32:10.593192 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3c9b3c1-515c-4cd1-adcc-b8fa755fa489 could not be found. Sep 23 05:32:10.593192 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:32:10.593192 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:32:10.593192 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:32:10.593192 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:32:10.593192 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:32:10.593192 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:32:10.593192 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:32:10.593192 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:32:10.593192 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:32:10.593192 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:32:10.593192 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 05:32:10.593192 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 05:32:10.593192 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 05:32:10.593192 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 05:32:10.593192 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 05:32:10.593192 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:32:10.593192 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3c9b3c1-515c-4cd1-adcc-b8fa755fa489 could not be found. Sep 23 05:32:10.593192 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:32:10.593192 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:32:10.593192 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:32:10.602641 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:32:10.602641 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:32:10.602641 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:32:10.602641 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:32:10.602641 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:32:10.602641 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3c9b3c1-515c-4cd1-adcc-b8fa755fa489 could not be found. Sep 23 05:32:10.602641 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:32:10.602641 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c7942c78-4c9c-4104-ad32-b01487ccb63a tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Returning 404 to user: Instance c3c9b3c1-515c-4cd1-adcc-b8fa755fa489 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:32:10.602641 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c7942c78-4c9c-4104-ad32-b01487ccb63a tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/c3c9b3c1-515c-4cd1-adcc-b8fa755fa489" status: 404 len: 111 microversion: 2.1 time: 0.030956 Sep 23 05:32:10.602641 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3741/7303] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:32:10 2022] GET /compute/v2.1/servers/c3c9b3c1-515c-4cd1-adcc-b8fa755fa489 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 05:32:10.645416 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3fae9406-5b67-4130-aa26-b84c22447f63 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1560149032", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "networks": [{"uuid": "37e382a2-7105-4d7e-b7ef-1b58c783c9f2"}], "security_groups": [{"name": "tempest-securitygroup--381295551"}], "key_name": "tempest-keypair-2117157152", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:32:10.748444 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.network.neutron [None req-3fae9406-5b67-4130-aa26-b84c22447f63 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] validate_networks() for [('37e382a2-7105-4d7e-b7ef-1b58c783c9f2', None, None, None, None, None)] {{(pid=122698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 05:32:11.127677 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-3fae9406-5b67-4130-aa26-b84c22447f63 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Flavor limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 05:32:11.128127 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-3fae9406-5b67-4130-aa26-b84c22447f63 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Image limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 05:32:11.128615 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-3fae9406-5b67-4130-aa26-b84c22447f63 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Flavor pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 05:32:11.129039 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-3fae9406-5b67-4130-aa26-b84c22447f63 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Image pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 05:32:11.129464 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-3fae9406-5b67-4130-aa26-b84c22447f63 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 05:32:11.138319 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3fae9406-5b67-4130-aa26-b84c22447f63 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:32:11.138815 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3fae9406-5b67-4130-aa26-b84c22447f63 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:32:11.139264 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3fae9406-5b67-4130-aa26-b84c22447f63 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:32:11.140001 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3fae9406-5b67-4130-aa26-b84c22447f63 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:32:11.140821 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3fae9406-5b67-4130-aa26-b84c22447f63 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:32:11.141197 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3fae9406-5b67-4130-aa26-b84c22447f63 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:32:11.157789 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-3fae9406-5b67-4130-aa26-b84c22447f63 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Getting quotas for project f991e11ed0c44131a4bd9be0110dffe0. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 05:32:11.163132 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-3fae9406-5b67-4130-aa26-b84c22447f63 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Getting quotas for user f398aeafcbcb48d88d8cfd3bdf59bbed and project f991e11ed0c44131a4bd9be0110dffe0. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 05:32:11.175747 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3fae9406-5b67-4130-aa26-b84c22447f63 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Going to run 1 instances... {{(pid=122698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 05:32:11.178090 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3fae9406-5b67-4130-aa26-b84c22447f63 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 05:32:11.291277 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3fae9406-5b67-4130-aa26-b84c22447f63 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.650526 Sep 23 05:32:11.292314 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3563/7304] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 05:32:10 2022] POST /compute/v2.1/servers => generated 405 bytes in 652 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 05:32:11.303878 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9d760c82-fd9b-4ad5-80b5-ee53c04aff99 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:32:11.304494 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-9d760c82-fd9b-4ad5-80b5-ee53c04aff99 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:32:11.357857 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-9d760c82-fd9b-4ad5-80b5-ee53c04aff99 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:32:11.365862 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-9d760c82-fd9b-4ad5-80b5-ee53c04aff99 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4" status: 200 len: 1239 microversion: 2.1 time: 0.065939 Sep 23 05:32:11.366653 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3742/7305] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:32:11 2022] GET /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4 => generated 1239 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:32:12.388907 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-efa20d4a-485a-46b4-b6cb-e1b8d0ca31fd tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:32:12.389542 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-efa20d4a-485a-46b4-b6cb-e1b8d0ca31fd tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:32:12.398259 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-efa20d4a-485a-46b4-b6cb-e1b8d0ca31fd tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:32:12.398768 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-efa20d4a-485a-46b4-b6cb-e1b8d0ca31fd tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:32:12.399225 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-efa20d4a-485a-46b4-b6cb-e1b8d0ca31fd tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:32:12.399947 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-efa20d4a-485a-46b4-b6cb-e1b8d0ca31fd tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:32:12.400420 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-efa20d4a-485a-46b4-b6cb-e1b8d0ca31fd tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:32:12.400861 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-efa20d4a-485a-46b4-b6cb-e1b8d0ca31fd tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:32:12.464259 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-efa20d4a-485a-46b4-b6cb-e1b8d0ca31fd tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:32:12.472096 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-efa20d4a-485a-46b4-b6cb-e1b8d0ca31fd tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4" status: 200 len: 1235 microversion: 2.1 time: 0.087555 Sep 23 05:32:12.472675 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3564/7306] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:32:12 2022] GET /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4 => generated 1235 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:32:13.497506 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-04a95f2f-3aaa-4000-befc-020fbe7ed9c0 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:32:13.498773 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-04a95f2f-3aaa-4000-befc-020fbe7ed9c0 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:32:13.502711 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:32:13.507635 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-04a95f2f-3aaa-4000-befc-020fbe7ed9c0 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:32:13.508133 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-04a95f2f-3aaa-4000-befc-020fbe7ed9c0 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:32:13.508576 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-04a95f2f-3aaa-4000-befc-020fbe7ed9c0 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:32:13.509285 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-04a95f2f-3aaa-4000-befc-020fbe7ed9c0 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:32:13.509746 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-04a95f2f-3aaa-4000-befc-020fbe7ed9c0 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:32:13.510201 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-04a95f2f-3aaa-4000-befc-020fbe7ed9c0 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:32:13.574075 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-04a95f2f-3aaa-4000-befc-020fbe7ed9c0 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:32:13.582666 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-04a95f2f-3aaa-4000-befc-020fbe7ed9c0 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4" status: 200 len: 1309 microversion: 2.1 time: 0.089151 Sep 23 05:32:13.583142 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3743/7307] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:32:13 2022] GET /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4 => generated 1309 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:32:14.607287 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e6214a1a-b809-4718-a8ad-f01f68dc1be8 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:32:14.608038 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e6214a1a-b809-4718-a8ad-f01f68dc1be8 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:32:14.610931 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:32:14.615928 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e6214a1a-b809-4718-a8ad-f01f68dc1be8 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:32:14.621125 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e6214a1a-b809-4718-a8ad-f01f68dc1be8 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:32:14.621125 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e6214a1a-b809-4718-a8ad-f01f68dc1be8 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:32:14.621125 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e6214a1a-b809-4718-a8ad-f01f68dc1be8 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:32:14.621125 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e6214a1a-b809-4718-a8ad-f01f68dc1be8 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:32:14.621125 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e6214a1a-b809-4718-a8ad-f01f68dc1be8 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:32:14.755072 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e6214a1a-b809-4718-a8ad-f01f68dc1be8 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:32:14.763255 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e6214a1a-b809-4718-a8ad-f01f68dc1be8 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4" status: 200 len: 1364 microversion: 2.1 time: 0.159878 Sep 23 05:32:14.764557 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3565/7308] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:32:14 2022] GET /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4 => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:32:15.047813 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-3a51db5f-679d-4a12-ae74-a841a866a999 req-4e1fc622-3717-46e5-9534-759b7eb0c187 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4", "tag": "8499eebc-622d-4a41-b95a-b1d3f1462201"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:32:15.058595 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-3a51db5f-679d-4a12-ae74-a841a866a999 req-4e1fc622-3717-46e5-9534-759b7eb0c187 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:32:15.059740 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-3a51db5f-679d-4a12-ae74-a841a866a999 req-4e1fc622-3717-46e5-9534-759b7eb0c187 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:32:15.060183 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-3a51db5f-679d-4a12-ae74-a841a866a999 req-4e1fc622-3717-46e5-9534-759b7eb0c187 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:32:15.072809 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-3a51db5f-679d-4a12-ae74-a841a866a999 req-4e1fc622-3717-46e5-9534-759b7eb0c187 service nova] Creating event network-changed:8499eebc-622d-4a41-b95a-b1d3f1462201 for instance 6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4 on n-h2-846463-3 Sep 23 05:32:15.077856 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-3a51db5f-679d-4a12-ae74-a841a866a999 req-4e1fc622-3717-46e5-9534-759b7eb0c187 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033556 Sep 23 05:32:15.078724 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3744/7309] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:32:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:32:15.789209 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-34974f47-f116-48e0-9836-4fcb5917d201 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:32:15.789858 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-34974f47-f116-48e0-9836-4fcb5917d201 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:32:15.796644 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-34974f47-f116-48e0-9836-4fcb5917d201 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:32:15.797148 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-34974f47-f116-48e0-9836-4fcb5917d201 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:32:15.797602 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-34974f47-f116-48e0-9836-4fcb5917d201 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:32:15.798345 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-34974f47-f116-48e0-9836-4fcb5917d201 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:32:15.799417 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-34974f47-f116-48e0-9836-4fcb5917d201 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:32:15.799863 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-34974f47-f116-48e0-9836-4fcb5917d201 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:32:15.929342 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-34974f47-f116-48e0-9836-4fcb5917d201 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:32:15.937401 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-34974f47-f116-48e0-9836-4fcb5917d201 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4" status: 200 len: 1364 microversion: 2.1 time: 0.152156 Sep 23 05:32:15.938010 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3566/7310] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:32:15 2022] GET /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:32:16.961652 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2adea5d3-bca1-4763-a3f6-afe5feff9299 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:32:16.962416 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-2adea5d3-bca1-4763-a3f6-afe5feff9299 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:32:16.968843 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2adea5d3-bca1-4763-a3f6-afe5feff9299 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:32:16.969339 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2adea5d3-bca1-4763-a3f6-afe5feff9299 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:32:16.969810 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2adea5d3-bca1-4763-a3f6-afe5feff9299 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:32:16.970527 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2adea5d3-bca1-4763-a3f6-afe5feff9299 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:32:16.970997 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2adea5d3-bca1-4763-a3f6-afe5feff9299 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:32:16.971427 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2adea5d3-bca1-4763-a3f6-afe5feff9299 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:32:17.108370 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2adea5d3-bca1-4763-a3f6-afe5feff9299 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:32:17.116599 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2adea5d3-bca1-4763-a3f6-afe5feff9299 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4" status: 200 len: 1364 microversion: 2.1 time: 0.159649 Sep 23 05:32:17.117175 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3745/7311] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:32:16 2022] GET /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4 => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:32:18.141002 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-31dc10b7-12d9-4c05-aa63-8b5d3b318d7a tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:32:18.141643 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-31dc10b7-12d9-4c05-aa63-8b5d3b318d7a tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:32:18.149288 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-31dc10b7-12d9-4c05-aa63-8b5d3b318d7a tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:32:18.149803 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-31dc10b7-12d9-4c05-aa63-8b5d3b318d7a tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:32:18.150297 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-31dc10b7-12d9-4c05-aa63-8b5d3b318d7a tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:32:18.151014 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-31dc10b7-12d9-4c05-aa63-8b5d3b318d7a tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:32:18.151494 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-31dc10b7-12d9-4c05-aa63-8b5d3b318d7a tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:32:18.151943 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-31dc10b7-12d9-4c05-aa63-8b5d3b318d7a tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:32:18.286166 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-31dc10b7-12d9-4c05-aa63-8b5d3b318d7a tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:32:18.293932 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-31dc10b7-12d9-4c05-aa63-8b5d3b318d7a tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4" status: 200 len: 1364 microversion: 2.1 time: 0.157134 Sep 23 05:32:18.294531 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3567/7312] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:32:18 2022] GET /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4 => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:32:19.316877 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-fac415b9-827a-41c8-bb2f-5c9985a62230 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:32:19.317488 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-fac415b9-827a-41c8-bb2f-5c9985a62230 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:32:19.324124 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fac415b9-827a-41c8-bb2f-5c9985a62230 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:32:19.324615 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fac415b9-827a-41c8-bb2f-5c9985a62230 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:32:19.325648 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fac415b9-827a-41c8-bb2f-5c9985a62230 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:32:19.325775 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fac415b9-827a-41c8-bb2f-5c9985a62230 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:32:19.326239 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fac415b9-827a-41c8-bb2f-5c9985a62230 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:32:19.326718 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fac415b9-827a-41c8-bb2f-5c9985a62230 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:32:19.459396 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-fac415b9-827a-41c8-bb2f-5c9985a62230 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:32:19.467113 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-fac415b9-827a-41c8-bb2f-5c9985a62230 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4" status: 200 len: 1364 microversion: 2.1 time: 0.154213 Sep 23 05:32:19.467659 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3746/7313] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:32:19 2022] GET /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:32:20.490922 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-bb2c8a69-9f68-49e7-a2ea-4a28ea8be3c6 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:32:20.491556 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-bb2c8a69-9f68-49e7-a2ea-4a28ea8be3c6 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:32:20.498428 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bb2c8a69-9f68-49e7-a2ea-4a28ea8be3c6 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:32:20.498937 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bb2c8a69-9f68-49e7-a2ea-4a28ea8be3c6 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:32:20.499394 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bb2c8a69-9f68-49e7-a2ea-4a28ea8be3c6 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:32:20.500105 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bb2c8a69-9f68-49e7-a2ea-4a28ea8be3c6 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:32:20.500610 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bb2c8a69-9f68-49e7-a2ea-4a28ea8be3c6 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:32:20.501055 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bb2c8a69-9f68-49e7-a2ea-4a28ea8be3c6 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:32:20.634696 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-bb2c8a69-9f68-49e7-a2ea-4a28ea8be3c6 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:32:20.643082 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-bb2c8a69-9f68-49e7-a2ea-4a28ea8be3c6 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4" status: 200 len: 1364 microversion: 2.1 time: 0.156174 Sep 23 05:32:20.643661 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3568/7314] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:32:20 2022] GET /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4 => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:32:21.470380 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-28d63c8a-e0a4-4fa2-813f-fb0833e4f1b3 req-138af1ec-3f85-4a16-9e3a-5d89e43cb202 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4", "name": "network-vif-plugged", "status": "completed", "tag": "8499eebc-622d-4a41-b95a-b1d3f1462201"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:32:21.475947 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:32:21.481293 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-28d63c8a-e0a4-4fa2-813f-fb0833e4f1b3 req-138af1ec-3f85-4a16-9e3a-5d89e43cb202 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:32:21.481784 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-28d63c8a-e0a4-4fa2-813f-fb0833e4f1b3 req-138af1ec-3f85-4a16-9e3a-5d89e43cb202 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:32:21.482251 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-28d63c8a-e0a4-4fa2-813f-fb0833e4f1b3 req-138af1ec-3f85-4a16-9e3a-5d89e43cb202 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:32:21.493774 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-28d63c8a-e0a4-4fa2-813f-fb0833e4f1b3 req-138af1ec-3f85-4a16-9e3a-5d89e43cb202 service nova] Creating event network-vif-plugged:8499eebc-622d-4a41-b95a-b1d3f1462201 for instance 6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4 on n-h2-846463-3 Sep 23 05:32:21.499587 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-28d63c8a-e0a4-4fa2-813f-fb0833e4f1b3 req-138af1ec-3f85-4a16-9e3a-5d89e43cb202 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032402 Sep 23 05:32:21.500175 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3747/7315] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:32:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:32:21.667611 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-97d539e7-9b8c-4dc0-a5ee-98f43d7164bc tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:32:21.668248 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-97d539e7-9b8c-4dc0-a5ee-98f43d7164bc tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:32:21.670245 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:32:21.670933 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=6 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:32:21.677127 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-97d539e7-9b8c-4dc0-a5ee-98f43d7164bc tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:32:21.677753 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-97d539e7-9b8c-4dc0-a5ee-98f43d7164bc tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:32:21.678259 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-97d539e7-9b8c-4dc0-a5ee-98f43d7164bc tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:32:21.678979 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-97d539e7-9b8c-4dc0-a5ee-98f43d7164bc tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:32:21.679544 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-97d539e7-9b8c-4dc0-a5ee-98f43d7164bc tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:32:21.680173 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-97d539e7-9b8c-4dc0-a5ee-98f43d7164bc tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:32:21.810218 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-97d539e7-9b8c-4dc0-a5ee-98f43d7164bc tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:32:21.817803 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-97d539e7-9b8c-4dc0-a5ee-98f43d7164bc tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4" status: 200 len: 1364 microversion: 2.1 time: 0.154279 Sep 23 05:32:21.818418 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3569/7316] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:32:21 2022] GET /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:32:22.841992 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b985c686-07bb-4cf4-a1df-560430ef4a1d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:32:22.842636 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b985c686-07bb-4cf4-a1df-560430ef4a1d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:32:22.849396 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b985c686-07bb-4cf4-a1df-560430ef4a1d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:32:22.849906 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b985c686-07bb-4cf4-a1df-560430ef4a1d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:32:22.850360 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b985c686-07bb-4cf4-a1df-560430ef4a1d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:32:22.851066 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b985c686-07bb-4cf4-a1df-560430ef4a1d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:32:22.851543 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b985c686-07bb-4cf4-a1df-560430ef4a1d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:32:22.851994 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b985c686-07bb-4cf4-a1df-560430ef4a1d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:32:22.984920 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b985c686-07bb-4cf4-a1df-560430ef4a1d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:32:22.993758 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b985c686-07bb-4cf4-a1df-560430ef4a1d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4" status: 200 len: 1364 microversion: 2.1 time: 0.156415 Sep 23 05:32:22.997556 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3748/7317] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:32:22 2022] GET /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4 => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:32:24.018992 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-96b95f5e-5121-4165-bf3e-6ec50ad304e3 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:32:24.019629 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-96b95f5e-5121-4165-bf3e-6ec50ad304e3 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:32:24.026757 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-96b95f5e-5121-4165-bf3e-6ec50ad304e3 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:32:24.027268 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-96b95f5e-5121-4165-bf3e-6ec50ad304e3 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:32:24.027730 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-96b95f5e-5121-4165-bf3e-6ec50ad304e3 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:32:24.028445 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-96b95f5e-5121-4165-bf3e-6ec50ad304e3 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:32:24.029049 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-96b95f5e-5121-4165-bf3e-6ec50ad304e3 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:32:24.029497 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-96b95f5e-5121-4165-bf3e-6ec50ad304e3 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:32:24.157365 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-96b95f5e-5121-4165-bf3e-6ec50ad304e3 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:32:24.165189 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-96b95f5e-5121-4165-bf3e-6ec50ad304e3 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4" status: 200 len: 1551 microversion: 2.1 time: 0.151077 Sep 23 05:32:24.165767 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3570/7318] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:32:24 2022] GET /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4 => generated 1551 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:32:24.187990 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-fe5b09de-41b1-472e-880e-6e58d2617b4e tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:32:24.188531 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-fe5b09de-41b1-472e-880e-6e58d2617b4e tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:32:24.195423 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fe5b09de-41b1-472e-880e-6e58d2617b4e tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:32:24.195924 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fe5b09de-41b1-472e-880e-6e58d2617b4e tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:32:24.196370 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fe5b09de-41b1-472e-880e-6e58d2617b4e tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:32:24.197102 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fe5b09de-41b1-472e-880e-6e58d2617b4e tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:32:24.197568 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fe5b09de-41b1-472e-880e-6e58d2617b4e tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:32:24.198066 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fe5b09de-41b1-472e-880e-6e58d2617b4e tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:32:24.274504 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-fe5b09de-41b1-472e-880e-6e58d2617b4e tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090250 Sep 23 05:32:24.275112 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3749/7319] 10.222.0.33 () {58 vars in 1275 bytes} [Fri Sep 23 05:32:24 2022] GET /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:32:25.565777 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-fc21fff8-6adb-4c76-9594-96ecea38a161 req-817de3bd-6d5a-4879-bdce-3f1a6bbf8f86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4", "tag": "8499eebc-622d-4a41-b95a-b1d3f1462201"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:32:25.576683 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-fc21fff8-6adb-4c76-9594-96ecea38a161 req-817de3bd-6d5a-4879-bdce-3f1a6bbf8f86 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:32:25.577195 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-fc21fff8-6adb-4c76-9594-96ecea38a161 req-817de3bd-6d5a-4879-bdce-3f1a6bbf8f86 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:32:25.577651 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-fc21fff8-6adb-4c76-9594-96ecea38a161 req-817de3bd-6d5a-4879-bdce-3f1a6bbf8f86 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:32:25.590017 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-fc21fff8-6adb-4c76-9594-96ecea38a161 req-817de3bd-6d5a-4879-bdce-3f1a6bbf8f86 service nova] Creating event network-changed:8499eebc-622d-4a41-b95a-b1d3f1462201 for instance 6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4 on n-h2-846463-3 Sep 23 05:32:25.595783 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-fc21fff8-6adb-4c76-9594-96ecea38a161 req-817de3bd-6d5a-4879-bdce-3f1a6bbf8f86 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033938 Sep 23 05:32:25.596396 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3571/7320] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:32:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 05:32:58.489185 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=13 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:32:58.490275 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:32:58.495973 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-14788459-e1ab-4afb-a5ae-70ad18bd2fd8 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:32:58.502028 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-14788459-e1ab-4afb-a5ae-70ad18bd2fd8 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:32:58.503163 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-14788459-e1ab-4afb-a5ae-70ad18bd2fd8 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:32:58.503602 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-14788459-e1ab-4afb-a5ae-70ad18bd2fd8 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:32:58.529751 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-14788459-e1ab-4afb-a5ae-70ad18bd2fd8 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4] Going to try to stop instance {{(pid=122699) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 23 05:32:58.684476 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-14788459-e1ab-4afb-a5ae-70ad18bd2fd8 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "POST /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4/action" status: 202 len: 0 microversion: 2.1 time: 0.196675 Sep 23 05:32:58.685220 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3750/7321] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 05:32:58 2022] POST /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4/action => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 05:32:58.696495 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-41b3b432-10dc-4e32-8526-2c964b1a55cd tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:32:58.697839 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-41b3b432-10dc-4e32-8526-2c964b1a55cd tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:32:58.700845 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=13 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:32:58.701667 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=54 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:32:58.707650 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-41b3b432-10dc-4e32-8526-2c964b1a55cd tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:32:58.708203 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-41b3b432-10dc-4e32-8526-2c964b1a55cd tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:32:58.708663 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-41b3b432-10dc-4e32-8526-2c964b1a55cd tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:32:58.709452 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-41b3b432-10dc-4e32-8526-2c964b1a55cd tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:32:58.709956 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-41b3b432-10dc-4e32-8526-2c964b1a55cd tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:32:58.714029 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-41b3b432-10dc-4e32-8526-2c964b1a55cd tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:32:58.845946 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-41b3b432-10dc-4e32-8526-2c964b1a55cd tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:32:58.856122 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-41b3b432-10dc-4e32-8526-2c964b1a55cd tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4" status: 200 len: 1680 microversion: 2.1 time: 0.166465 Sep 23 05:32:58.856720 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3572/7322] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:32:58 2022] GET /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4 => generated 1680 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:32:59.881018 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0b1baff4-dca9-4734-9657-137c68cad723 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:32:59.881777 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-0b1baff4-dca9-4734-9657-137c68cad723 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:32:59.887985 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0b1baff4-dca9-4734-9657-137c68cad723 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:32:59.888471 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0b1baff4-dca9-4734-9657-137c68cad723 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:32:59.888908 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0b1baff4-dca9-4734-9657-137c68cad723 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:32:59.889597 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0b1baff4-dca9-4734-9657-137c68cad723 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:32:59.890178 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0b1baff4-dca9-4734-9657-137c68cad723 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:32:59.890850 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0b1baff4-dca9-4734-9657-137c68cad723 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:33:00.025227 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-0b1baff4-dca9-4734-9657-137c68cad723 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:33:00.032955 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0b1baff4-dca9-4734-9657-137c68cad723 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4" status: 200 len: 1680 microversion: 2.1 time: 0.156721 Sep 23 05:33:00.033552 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3751/7323] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:32:59 2022] GET /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:33:01.057074 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-741ddbfc-ed05-4a7a-9f9f-42e9651196da tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:33:01.057832 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-741ddbfc-ed05-4a7a-9f9f-42e9651196da tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:33:01.063908 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-741ddbfc-ed05-4a7a-9f9f-42e9651196da tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:33:01.064423 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-741ddbfc-ed05-4a7a-9f9f-42e9651196da tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:33:01.065538 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-741ddbfc-ed05-4a7a-9f9f-42e9651196da tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:33:01.066284 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-741ddbfc-ed05-4a7a-9f9f-42e9651196da tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:33:01.066766 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-741ddbfc-ed05-4a7a-9f9f-42e9651196da tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:33:01.067214 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-741ddbfc-ed05-4a7a-9f9f-42e9651196da tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:33:01.195280 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-741ddbfc-ed05-4a7a-9f9f-42e9651196da tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:33:01.203079 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-741ddbfc-ed05-4a7a-9f9f-42e9651196da tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4" status: 200 len: 1680 microversion: 2.1 time: 0.150320 Sep 23 05:33:01.203657 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3573/7324] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:33:01 2022] GET /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:33:02.226445 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-da092ca1-7756-4a45-87e8-b0c27082fc8f tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:33:02.227059 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-da092ca1-7756-4a45-87e8-b0c27082fc8f tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:33:02.233708 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-da092ca1-7756-4a45-87e8-b0c27082fc8f tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:33:02.234247 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-da092ca1-7756-4a45-87e8-b0c27082fc8f tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:33:02.234720 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-da092ca1-7756-4a45-87e8-b0c27082fc8f tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:33:02.235428 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-da092ca1-7756-4a45-87e8-b0c27082fc8f tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:33:02.235894 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-da092ca1-7756-4a45-87e8-b0c27082fc8f tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:33:02.236361 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-da092ca1-7756-4a45-87e8-b0c27082fc8f tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:33:02.368145 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-da092ca1-7756-4a45-87e8-b0c27082fc8f tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:33:02.375922 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-da092ca1-7756-4a45-87e8-b0c27082fc8f tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4" status: 200 len: 1680 microversion: 2.1 time: 0.153353 Sep 23 05:33:02.376684 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3752/7325] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:33:02 2022] GET /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:33:03.399971 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a909873c-ce25-4898-a4d7-bf77b2f891ed tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:33:03.400610 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a909873c-ce25-4898-a4d7-bf77b2f891ed tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:33:03.407882 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a909873c-ce25-4898-a4d7-bf77b2f891ed tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:33:03.409003 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a909873c-ce25-4898-a4d7-bf77b2f891ed tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:33:03.409470 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a909873c-ce25-4898-a4d7-bf77b2f891ed tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:33:03.410212 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a909873c-ce25-4898-a4d7-bf77b2f891ed tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:33:03.410693 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a909873c-ce25-4898-a4d7-bf77b2f891ed tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:33:03.411139 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a909873c-ce25-4898-a4d7-bf77b2f891ed tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:33:03.545401 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a909873c-ce25-4898-a4d7-bf77b2f891ed tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:33:03.553149 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a909873c-ce25-4898-a4d7-bf77b2f891ed tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4" status: 200 len: 1680 microversion: 2.1 time: 0.157106 Sep 23 05:33:03.553717 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3574/7326] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:33:03 2022] GET /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:33:04.576493 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1864246b-f575-4f64-8421-8a2225983756 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:33:04.577100 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1864246b-f575-4f64-8421-8a2225983756 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:33:04.583128 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1864246b-f575-4f64-8421-8a2225983756 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:33:04.583551 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1864246b-f575-4f64-8421-8a2225983756 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:33:04.583987 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1864246b-f575-4f64-8421-8a2225983756 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:33:04.584666 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1864246b-f575-4f64-8421-8a2225983756 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:33:04.585116 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1864246b-f575-4f64-8421-8a2225983756 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:33:04.585540 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1864246b-f575-4f64-8421-8a2225983756 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:33:04.715034 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1864246b-f575-4f64-8421-8a2225983756 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:33:04.723193 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1864246b-f575-4f64-8421-8a2225983756 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4" status: 200 len: 1680 microversion: 2.1 time: 0.150769 Sep 23 05:33:04.723763 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3753/7327] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:33:04 2022] GET /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:33:05.746868 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9488bbc9-3b91-4086-a9df-bbe3374308d5 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:33:05.747511 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-9488bbc9-3b91-4086-a9df-bbe3374308d5 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:33:05.755073 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9488bbc9-3b91-4086-a9df-bbe3374308d5 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:33:05.755589 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9488bbc9-3b91-4086-a9df-bbe3374308d5 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:33:05.756053 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9488bbc9-3b91-4086-a9df-bbe3374308d5 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:33:05.756775 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9488bbc9-3b91-4086-a9df-bbe3374308d5 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:33:05.757258 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9488bbc9-3b91-4086-a9df-bbe3374308d5 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:33:05.757710 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9488bbc9-3b91-4086-a9df-bbe3374308d5 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:33:05.888717 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-9488bbc9-3b91-4086-a9df-bbe3374308d5 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:33:05.896801 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9488bbc9-3b91-4086-a9df-bbe3374308d5 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4" status: 200 len: 1680 microversion: 2.1 time: 0.153892 Sep 23 05:33:05.897380 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3575/7328] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:33:05 2022] GET /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:33:06.920459 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3d47eae2-7acb-4c89-851e-3f774c36fba0 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:33:06.921070 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-3d47eae2-7acb-4c89-851e-3f774c36fba0 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:33:06.927566 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3d47eae2-7acb-4c89-851e-3f774c36fba0 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:33:06.928061 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3d47eae2-7acb-4c89-851e-3f774c36fba0 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:33:06.928502 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3d47eae2-7acb-4c89-851e-3f774c36fba0 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:33:06.929196 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3d47eae2-7acb-4c89-851e-3f774c36fba0 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:33:06.929650 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3d47eae2-7acb-4c89-851e-3f774c36fba0 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:33:06.930113 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3d47eae2-7acb-4c89-851e-3f774c36fba0 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:33:07.062110 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-3d47eae2-7acb-4c89-851e-3f774c36fba0 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:33:07.070512 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3d47eae2-7acb-4c89-851e-3f774c36fba0 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4" status: 200 len: 1680 microversion: 2.1 time: 0.153971 Sep 23 05:33:07.071088 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3754/7329] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:33:06 2022] GET /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:33:08.093765 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a5854da0-f3ef-4f1e-9b96-440a0de82891 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:33:08.094416 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a5854da0-f3ef-4f1e-9b96-440a0de82891 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:33:08.104058 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a5854da0-f3ef-4f1e-9b96-440a0de82891 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:33:08.104568 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a5854da0-f3ef-4f1e-9b96-440a0de82891 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:33:08.105027 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a5854da0-f3ef-4f1e-9b96-440a0de82891 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:33:08.105746 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a5854da0-f3ef-4f1e-9b96-440a0de82891 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:33:08.106267 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a5854da0-f3ef-4f1e-9b96-440a0de82891 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:33:08.106714 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a5854da0-f3ef-4f1e-9b96-440a0de82891 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:33:08.239753 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a5854da0-f3ef-4f1e-9b96-440a0de82891 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:33:08.247612 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a5854da0-f3ef-4f1e-9b96-440a0de82891 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4" status: 200 len: 1680 microversion: 2.1 time: 0.157882 Sep 23 05:33:08.248196 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3576/7330] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:33:08 2022] GET /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:33:09.271881 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b7167cc9-84cf-47aa-881b-09910fe9d816 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:33:09.272498 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b7167cc9-84cf-47aa-881b-09910fe9d816 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:33:09.279168 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b7167cc9-84cf-47aa-881b-09910fe9d816 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:33:09.279666 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b7167cc9-84cf-47aa-881b-09910fe9d816 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:33:09.280111 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b7167cc9-84cf-47aa-881b-09910fe9d816 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:33:09.280805 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b7167cc9-84cf-47aa-881b-09910fe9d816 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:33:09.281267 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b7167cc9-84cf-47aa-881b-09910fe9d816 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:33:09.281695 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b7167cc9-84cf-47aa-881b-09910fe9d816 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:33:09.410733 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b7167cc9-84cf-47aa-881b-09910fe9d816 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:33:09.418393 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b7167cc9-84cf-47aa-881b-09910fe9d816 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4" status: 200 len: 1680 microversion: 2.1 time: 0.150881 Sep 23 05:33:09.418967 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3755/7331] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:33:09 2022] GET /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:33:10.441498 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3a6e1a68-d599-46ca-a75c-c5afba9e16b2 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:33:10.442167 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3a6e1a68-d599-46ca-a75c-c5afba9e16b2 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:33:10.449128 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3a6e1a68-d599-46ca-a75c-c5afba9e16b2 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:33:10.449641 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3a6e1a68-d599-46ca-a75c-c5afba9e16b2 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:33:10.450136 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3a6e1a68-d599-46ca-a75c-c5afba9e16b2 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:33:10.450859 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3a6e1a68-d599-46ca-a75c-c5afba9e16b2 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:33:10.451344 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3a6e1a68-d599-46ca-a75c-c5afba9e16b2 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:33:10.451794 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3a6e1a68-d599-46ca-a75c-c5afba9e16b2 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:33:10.579605 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-3a6e1a68-d599-46ca-a75c-c5afba9e16b2 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:33:10.587706 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3a6e1a68-d599-46ca-a75c-c5afba9e16b2 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4" status: 200 len: 1680 microversion: 2.1 time: 0.150116 Sep 23 05:33:10.588284 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3577/7332] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:33:10 2022] GET /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4 => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:33:11.611449 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-60d9b5b8-3030-40b7-b5e9-64ef18d0ad78 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:33:11.612063 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-60d9b5b8-3030-40b7-b5e9-64ef18d0ad78 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:33:11.619035 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-60d9b5b8-3030-40b7-b5e9-64ef18d0ad78 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:33:11.619526 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-60d9b5b8-3030-40b7-b5e9-64ef18d0ad78 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:33:11.619968 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-60d9b5b8-3030-40b7-b5e9-64ef18d0ad78 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:33:11.620659 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-60d9b5b8-3030-40b7-b5e9-64ef18d0ad78 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:33:11.621145 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-60d9b5b8-3030-40b7-b5e9-64ef18d0ad78 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:33:11.621577 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-60d9b5b8-3030-40b7-b5e9-64ef18d0ad78 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:33:11.754535 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-60d9b5b8-3030-40b7-b5e9-64ef18d0ad78 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:33:11.762215 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-60d9b5b8-3030-40b7-b5e9-64ef18d0ad78 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4" status: 200 len: 1680 microversion: 2.1 time: 0.154650 Sep 23 05:33:11.762788 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3756/7333] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:33:11 2022] GET /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:33:12.786245 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4281fe4a-ff5d-453f-85fa-5fb507d7e3bf tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:33:12.786880 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4281fe4a-ff5d-453f-85fa-5fb507d7e3bf tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:33:12.793877 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4281fe4a-ff5d-453f-85fa-5fb507d7e3bf tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:33:12.794422 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4281fe4a-ff5d-453f-85fa-5fb507d7e3bf tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:33:12.794889 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4281fe4a-ff5d-453f-85fa-5fb507d7e3bf tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:33:12.795608 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4281fe4a-ff5d-453f-85fa-5fb507d7e3bf tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:33:12.796093 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4281fe4a-ff5d-453f-85fa-5fb507d7e3bf tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:33:12.796545 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4281fe4a-ff5d-453f-85fa-5fb507d7e3bf tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:33:12.927153 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4281fe4a-ff5d-453f-85fa-5fb507d7e3bf tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:33:12.934972 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4281fe4a-ff5d-453f-85fa-5fb507d7e3bf tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4" status: 200 len: 1680 microversion: 2.1 time: 0.152799 Sep 23 05:33:12.935634 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3578/7334] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:33:12 2022] GET /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:33:13.958302 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1c45cbc6-8223-4a74-ab65-e141198150e7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:33:13.958937 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1c45cbc6-8223-4a74-ab65-e141198150e7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:33:13.965561 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1c45cbc6-8223-4a74-ab65-e141198150e7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:33:13.966172 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1c45cbc6-8223-4a74-ab65-e141198150e7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:33:13.966631 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1c45cbc6-8223-4a74-ab65-e141198150e7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:33:13.967333 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1c45cbc6-8223-4a74-ab65-e141198150e7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:33:13.967788 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1c45cbc6-8223-4a74-ab65-e141198150e7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:33:13.968215 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1c45cbc6-8223-4a74-ab65-e141198150e7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:33:14.103737 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1c45cbc6-8223-4a74-ab65-e141198150e7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:33:14.111613 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1c45cbc6-8223-4a74-ab65-e141198150e7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4" status: 200 len: 1680 microversion: 2.1 time: 0.157240 Sep 23 05:33:14.112684 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3757/7335] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:33:13 2022] GET /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:33:15.136181 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c01b8510-7903-4069-bb8a-a71f0ae03a6e tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:33:15.136819 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c01b8510-7903-4069-bb8a-a71f0ae03a6e tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:33:15.144636 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c01b8510-7903-4069-bb8a-a71f0ae03a6e tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:33:15.145152 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c01b8510-7903-4069-bb8a-a71f0ae03a6e tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:33:15.145615 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c01b8510-7903-4069-bb8a-a71f0ae03a6e tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:33:15.146377 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c01b8510-7903-4069-bb8a-a71f0ae03a6e tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:33:15.146862 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c01b8510-7903-4069-bb8a-a71f0ae03a6e tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:33:15.147312 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c01b8510-7903-4069-bb8a-a71f0ae03a6e tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:33:15.275235 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c01b8510-7903-4069-bb8a-a71f0ae03a6e tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:33:15.283001 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c01b8510-7903-4069-bb8a-a71f0ae03a6e tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4" status: 200 len: 1657 microversion: 2.1 time: 0.150789 Sep 23 05:33:15.283565 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3579/7336] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:33:15 2022] GET /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4 => generated 1657 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:33:15.305768 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d9683819-f676-408b-af7b-2fc28f0ea06b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:33:15.308068 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d9683819-f676-408b-af7b-2fc28f0ea06b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:33:15.314766 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d9683819-f676-408b-af7b-2fc28f0ea06b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:33:15.315884 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d9683819-f676-408b-af7b-2fc28f0ea06b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:33:15.316339 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d9683819-f676-408b-af7b-2fc28f0ea06b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:33:15.317108 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d9683819-f676-408b-af7b-2fc28f0ea06b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:33:15.317576 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d9683819-f676-408b-af7b-2fc28f0ea06b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:33:15.318060 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d9683819-f676-408b-af7b-2fc28f0ea06b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:33:15.346228 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d9683819-f676-408b-af7b-2fc28f0ea06b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:33:15.351645 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d9683819-f676-408b-af7b-2fc28f0ea06b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4] Old instance type m1.heat2, new instance type m1.heat {{(pid=122699) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 23 05:33:15.358114 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-d9683819-f676-408b-af7b-2fc28f0ea06b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Flavor limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 05:33:15.358539 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-d9683819-f676-408b-af7b-2fc28f0ea06b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Image limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 05:33:15.359017 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-d9683819-f676-408b-af7b-2fc28f0ea06b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Flavor pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 05:33:15.359427 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-d9683819-f676-408b-af7b-2fc28f0ea06b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Image pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 05:33:15.359847 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-d9683819-f676-408b-af7b-2fc28f0ea06b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 05:33:15.536995 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d9683819-f676-408b-af7b-2fc28f0ea06b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "POST /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4/action" status: 202 len: 0 microversion: 2.1 time: 0.235034 Sep 23 05:33:15.537532 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3758/7337] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 05:33:15 2022] POST /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4/action => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 05:33:15.545776 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-91824479-4106-4109-b2a8-331d1ed51bf6 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:33:15.546444 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-91824479-4106-4109-b2a8-331d1ed51bf6 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:33:15.553070 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-91824479-4106-4109-b2a8-331d1ed51bf6 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:33:15.553607 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-91824479-4106-4109-b2a8-331d1ed51bf6 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:33:15.554097 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-91824479-4106-4109-b2a8-331d1ed51bf6 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:33:15.554832 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-91824479-4106-4109-b2a8-331d1ed51bf6 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:33:15.555313 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-91824479-4106-4109-b2a8-331d1ed51bf6 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:33:15.555763 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-91824479-4106-4109-b2a8-331d1ed51bf6 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:33:15.689499 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-91824479-4106-4109-b2a8-331d1ed51bf6 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:33:15.697378 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-91824479-4106-4109-b2a8-331d1ed51bf6 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4" status: 200 len: 1680 microversion: 2.1 time: 0.155642 Sep 23 05:33:15.697982 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3580/7338] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:33:15 2022] GET /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:33:16.720664 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2863b28f-a88e-421d-a02a-8927bf1c77b3 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:33:16.721261 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-2863b28f-a88e-421d-a02a-8927bf1c77b3 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:33:16.728529 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2863b28f-a88e-421d-a02a-8927bf1c77b3 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:33:16.729024 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2863b28f-a88e-421d-a02a-8927bf1c77b3 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:33:16.729466 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2863b28f-a88e-421d-a02a-8927bf1c77b3 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:33:16.730199 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2863b28f-a88e-421d-a02a-8927bf1c77b3 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:33:16.736779 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2863b28f-a88e-421d-a02a-8927bf1c77b3 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:33:16.736779 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2863b28f-a88e-421d-a02a-8927bf1c77b3 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:33:16.863917 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2863b28f-a88e-421d-a02a-8927bf1c77b3 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:33:16.872297 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2863b28f-a88e-421d-a02a-8927bf1c77b3 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4" status: 200 len: 1680 microversion: 2.1 time: 0.155570 Sep 23 05:33:16.872887 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3759/7339] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:33:16 2022] GET /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:33:17.897317 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2e036e1b-8968-416e-915d-68309e3b6b1b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:33:17.898004 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-2e036e1b-8968-416e-915d-68309e3b6b1b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:33:17.904809 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2e036e1b-8968-416e-915d-68309e3b6b1b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:33:17.905321 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2e036e1b-8968-416e-915d-68309e3b6b1b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:33:17.905784 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2e036e1b-8968-416e-915d-68309e3b6b1b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:33:17.906532 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2e036e1b-8968-416e-915d-68309e3b6b1b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:33:17.907011 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2e036e1b-8968-416e-915d-68309e3b6b1b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:33:17.907460 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2e036e1b-8968-416e-915d-68309e3b6b1b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:33:18.041824 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-2e036e1b-8968-416e-915d-68309e3b6b1b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:33:18.049840 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2e036e1b-8968-416e-915d-68309e3b6b1b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4" status: 200 len: 1680 microversion: 2.1 time: 0.157087 Sep 23 05:33:18.050450 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3581/7340] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:33:17 2022] GET /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:33:19.073405 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5014292c-63f9-470d-9482-6128327319ed tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:33:19.074071 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-5014292c-63f9-470d-9482-6128327319ed tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:33:19.080583 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5014292c-63f9-470d-9482-6128327319ed tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:33:19.081079 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5014292c-63f9-470d-9482-6128327319ed tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:33:19.081526 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5014292c-63f9-470d-9482-6128327319ed tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:33:19.082779 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5014292c-63f9-470d-9482-6128327319ed tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:33:19.083235 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5014292c-63f9-470d-9482-6128327319ed tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:33:19.083670 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5014292c-63f9-470d-9482-6128327319ed tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:33:19.216683 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-5014292c-63f9-470d-9482-6128327319ed tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:33:19.225040 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5014292c-63f9-470d-9482-6128327319ed tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4" status: 200 len: 1685 microversion: 2.1 time: 0.155638 Sep 23 05:33:19.225624 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3760/7341] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:33:19 2022] GET /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4 => generated 1685 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:33:20.249726 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-637a2344-65bd-4ff8-91d7-d44ad9a92b11 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:33:20.250318 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-637a2344-65bd-4ff8-91d7-d44ad9a92b11 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:33:20.257230 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-637a2344-65bd-4ff8-91d7-d44ad9a92b11 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:33:20.257739 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-637a2344-65bd-4ff8-91d7-d44ad9a92b11 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:33:20.258232 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-637a2344-65bd-4ff8-91d7-d44ad9a92b11 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:33:20.258953 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-637a2344-65bd-4ff8-91d7-d44ad9a92b11 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:33:20.259429 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-637a2344-65bd-4ff8-91d7-d44ad9a92b11 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:33:20.259872 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-637a2344-65bd-4ff8-91d7-d44ad9a92b11 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:33:20.390856 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-637a2344-65bd-4ff8-91d7-d44ad9a92b11 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:33:20.398885 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-637a2344-65bd-4ff8-91d7-d44ad9a92b11 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4" status: 200 len: 1685 microversion: 2.1 time: 0.153195 Sep 23 05:33:20.399467 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3582/7342] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:33:20 2022] GET /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4 => generated 1685 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:33:21.178680 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-a71d152b-f20d-4f39-95ae-67c3e3823306 req-fc491a91-8582-4ac8-9816-fe4d274ac22e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4", "name": "network-vif-unplugged", "status": "completed", "tag": "8499eebc-622d-4a41-b95a-b1d3f1462201"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:33:21.188783 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-a71d152b-f20d-4f39-95ae-67c3e3823306 req-fc491a91-8582-4ac8-9816-fe4d274ac22e service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:33:21.189264 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-a71d152b-f20d-4f39-95ae-67c3e3823306 req-fc491a91-8582-4ac8-9816-fe4d274ac22e service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:33:21.189697 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-a71d152b-f20d-4f39-95ae-67c3e3823306 req-fc491a91-8582-4ac8-9816-fe4d274ac22e service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:33:21.201289 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-a71d152b-f20d-4f39-95ae-67c3e3823306 req-fc491a91-8582-4ac8-9816-fe4d274ac22e service nova] Creating event network-vif-unplugged:8499eebc-622d-4a41-b95a-b1d3f1462201 for instance 6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4 on n-h1-846463-3 Sep 23 05:33:21.206528 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [req-a71d152b-f20d-4f39-95ae-67c3e3823306 req-fc491a91-8582-4ac8-9816-fe4d274ac22e service nova] Instance 6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846463-3', 'n-h2-846463-3'} {{(pid=122699) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 23 05:33:21.217975 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-a71d152b-f20d-4f39-95ae-67c3e3823306 req-fc491a91-8582-4ac8-9816-fe4d274ac22e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043760 Sep 23 05:33:21.218558 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3761/7343] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:33:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:33:21.423115 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-aa507c3a-08e5-4b98-8e71-d3cb8f2d5f14 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:33:21.423791 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-aa507c3a-08e5-4b98-8e71-d3cb8f2d5f14 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:33:21.430932 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-aa507c3a-08e5-4b98-8e71-d3cb8f2d5f14 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:33:21.431450 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-aa507c3a-08e5-4b98-8e71-d3cb8f2d5f14 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:33:21.431914 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-aa507c3a-08e5-4b98-8e71-d3cb8f2d5f14 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:33:21.432640 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-aa507c3a-08e5-4b98-8e71-d3cb8f2d5f14 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:33:21.433125 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-aa507c3a-08e5-4b98-8e71-d3cb8f2d5f14 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:33:21.433575 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-aa507c3a-08e5-4b98-8e71-d3cb8f2d5f14 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:33:21.566153 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-aa507c3a-08e5-4b98-8e71-d3cb8f2d5f14 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:33:21.574135 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-aa507c3a-08e5-4b98-8e71-d3cb8f2d5f14 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4" status: 200 len: 1684 microversion: 2.1 time: 0.155323 Sep 23 05:33:21.574744 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3583/7344] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:33:21 2022] GET /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4 => generated 1684 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:33:22.599101 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9d4f818a-cc56-433e-902b-1eb2d7591266 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:33:22.599808 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-9d4f818a-cc56-433e-902b-1eb2d7591266 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:33:22.605968 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9d4f818a-cc56-433e-902b-1eb2d7591266 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:33:22.606467 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9d4f818a-cc56-433e-902b-1eb2d7591266 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:33:22.606912 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9d4f818a-cc56-433e-902b-1eb2d7591266 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:33:22.607605 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9d4f818a-cc56-433e-902b-1eb2d7591266 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:33:22.608065 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9d4f818a-cc56-433e-902b-1eb2d7591266 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:33:22.608498 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9d4f818a-cc56-433e-902b-1eb2d7591266 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:33:22.739840 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-9d4f818a-cc56-433e-902b-1eb2d7591266 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:33:22.747793 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-9d4f818a-cc56-433e-902b-1eb2d7591266 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4" status: 200 len: 1682 microversion: 2.1 time: 0.153920 Sep 23 05:33:22.748372 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3762/7345] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:33:22 2022] GET /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:33:23.233494 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-4b3a2e24-662b-4dbe-aeb8-ab41fa9b7400 req-204cdbe0-473e-4d07-ab20-ed47fb9a2d6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4", "tag": "8499eebc-622d-4a41-b95a-b1d3f1462201"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:33:23.244218 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-4b3a2e24-662b-4dbe-aeb8-ab41fa9b7400 req-204cdbe0-473e-4d07-ab20-ed47fb9a2d6d service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:33:23.244719 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-4b3a2e24-662b-4dbe-aeb8-ab41fa9b7400 req-204cdbe0-473e-4d07-ab20-ed47fb9a2d6d service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:33:23.245171 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-4b3a2e24-662b-4dbe-aeb8-ab41fa9b7400 req-204cdbe0-473e-4d07-ab20-ed47fb9a2d6d service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:33:23.258322 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-4b3a2e24-662b-4dbe-aeb8-ab41fa9b7400 req-204cdbe0-473e-4d07-ab20-ed47fb9a2d6d service nova] Creating event network-changed:8499eebc-622d-4a41-b95a-b1d3f1462201 for instance 6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4 on n-h1-846463-3 Sep 23 05:33:23.263791 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [req-4b3a2e24-662b-4dbe-aeb8-ab41fa9b7400 req-204cdbe0-473e-4d07-ab20-ed47fb9a2d6d service nova] Instance 6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846463-3', 'n-h2-846463-3'} {{(pid=122698) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 23 05:33:23.277570 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-4b3a2e24-662b-4dbe-aeb8-ab41fa9b7400 req-204cdbe0-473e-4d07-ab20-ed47fb9a2d6d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048604 Sep 23 05:33:23.278213 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3584/7346] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:33:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:33:23.771341 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f3cc623d-3828-49d3-9160-0944118e5866 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:33:23.771913 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f3cc623d-3828-49d3-9160-0944118e5866 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:33:23.778667 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f3cc623d-3828-49d3-9160-0944118e5866 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:33:23.779169 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f3cc623d-3828-49d3-9160-0944118e5866 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:33:23.779609 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f3cc623d-3828-49d3-9160-0944118e5866 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:33:23.780507 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f3cc623d-3828-49d3-9160-0944118e5866 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:33:23.780979 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f3cc623d-3828-49d3-9160-0944118e5866 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:33:23.781411 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f3cc623d-3828-49d3-9160-0944118e5866 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:33:23.924610 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f3cc623d-3828-49d3-9160-0944118e5866 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:33:23.933185 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f3cc623d-3828-49d3-9160-0944118e5866 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4" status: 200 len: 1678 microversion: 2.1 time: 0.165912 Sep 23 05:33:23.933786 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3763/7347] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:33:23 2022] GET /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4 => generated 1678 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:33:23.958226 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c0d65376-b167-4197-b962-2ab2ad140a08 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:33:23.958891 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c0d65376-b167-4197-b962-2ab2ad140a08 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:33:23.965125 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c0d65376-b167-4197-b962-2ab2ad140a08 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:33:23.965640 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c0d65376-b167-4197-b962-2ab2ad140a08 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:33:23.966122 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c0d65376-b167-4197-b962-2ab2ad140a08 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:33:23.966851 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c0d65376-b167-4197-b962-2ab2ad140a08 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:33:23.967332 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c0d65376-b167-4197-b962-2ab2ad140a08 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:33:23.967774 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c0d65376-b167-4197-b962-2ab2ad140a08 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:33:24.154680 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c0d65376-b167-4197-b962-2ab2ad140a08 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "POST /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4/action" status: 204 len: 0 microversion: 2.1 time: 0.200756 Sep 23 05:33:24.155397 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3585/7348] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 05:33:23 2022] POST /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4/action => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 05:33:24.163942 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c8a228e7-c5d3-410c-b736-027a9511ada9 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:33:24.164563 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c8a228e7-c5d3-410c-b736-027a9511ada9 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:33:24.170679 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c8a228e7-c5d3-410c-b736-027a9511ada9 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:33:24.171185 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c8a228e7-c5d3-410c-b736-027a9511ada9 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:33:24.171635 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c8a228e7-c5d3-410c-b736-027a9511ada9 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:33:24.172346 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c8a228e7-c5d3-410c-b736-027a9511ada9 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:33:24.172811 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c8a228e7-c5d3-410c-b736-027a9511ada9 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:33:24.173240 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c8a228e7-c5d3-410c-b736-027a9511ada9 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:33:24.192378 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:33:24.309370 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c8a228e7-c5d3-410c-b736-027a9511ada9 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:33:24.317182 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c8a228e7-c5d3-410c-b736-027a9511ada9 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4" status: 200 len: 1678 microversion: 2.1 time: 0.157606 Sep 23 05:33:24.318169 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3764/7349] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:33:24 2022] GET /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4 => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:33:25.342037 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-47cc12c0-4dc4-4ae8-a508-61be80403c28 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:33:25.342767 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-47cc12c0-4dc4-4ae8-a508-61be80403c28 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:33:25.349496 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-47cc12c0-4dc4-4ae8-a508-61be80403c28 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:33:25.350036 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-47cc12c0-4dc4-4ae8-a508-61be80403c28 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:33:25.350499 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-47cc12c0-4dc4-4ae8-a508-61be80403c28 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:33:25.351220 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-47cc12c0-4dc4-4ae8-a508-61be80403c28 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:33:25.351693 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-47cc12c0-4dc4-4ae8-a508-61be80403c28 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:33:25.352140 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-47cc12c0-4dc4-4ae8-a508-61be80403c28 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:33:25.488745 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-47cc12c0-4dc4-4ae8-a508-61be80403c28 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:33:25.497315 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-47cc12c0-4dc4-4ae8-a508-61be80403c28 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4" status: 200 len: 1678 microversion: 2.1 time: 0.160462 Sep 23 05:33:25.497917 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3586/7350] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:33:25 2022] GET /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4 => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:33:26.520610 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-80a5eb0a-cc78-40c5-b6c7-765cc6b05373 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:33:26.521217 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-80a5eb0a-cc78-40c5-b6c7-765cc6b05373 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:33:26.527918 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-80a5eb0a-cc78-40c5-b6c7-765cc6b05373 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:33:26.528401 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-80a5eb0a-cc78-40c5-b6c7-765cc6b05373 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:33:26.528835 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-80a5eb0a-cc78-40c5-b6c7-765cc6b05373 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:33:26.529522 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-80a5eb0a-cc78-40c5-b6c7-765cc6b05373 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:33:26.530007 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-80a5eb0a-cc78-40c5-b6c7-765cc6b05373 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:33:26.530428 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-80a5eb0a-cc78-40c5-b6c7-765cc6b05373 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:33:26.662793 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-80a5eb0a-cc78-40c5-b6c7-765cc6b05373 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:33:26.670469 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-80a5eb0a-cc78-40c5-b6c7-765cc6b05373 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4" status: 200 len: 1657 microversion: 2.1 time: 0.154101 Sep 23 05:33:26.671049 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3765/7351] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:33:26 2022] GET /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4 => generated 1657 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:33:26.694434 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-603ef88d-2b9a-448f-804d-942cd6a3e752 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:33:26.696037 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-603ef88d-2b9a-448f-804d-942cd6a3e752 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:33:26.701783 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-603ef88d-2b9a-448f-804d-942cd6a3e752 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:33:26.702320 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-603ef88d-2b9a-448f-804d-942cd6a3e752 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:33:26.702802 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-603ef88d-2b9a-448f-804d-942cd6a3e752 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:33:26.703511 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-603ef88d-2b9a-448f-804d-942cd6a3e752 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:33:26.703984 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-603ef88d-2b9a-448f-804d-942cd6a3e752 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:33:26.704428 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-603ef88d-2b9a-448f-804d-942cd6a3e752 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:33:26.827848 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-a40fd488-9c4a-4e5d-8c12-b604c56090f3 req-bb9ea629-059a-4780-82d5-da04a304480a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4", "name": "network-vif-plugged", "status": "completed", "tag": "8499eebc-622d-4a41-b95a-b1d3f1462201"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:33:26.838888 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-a40fd488-9c4a-4e5d-8c12-b604c56090f3 req-bb9ea629-059a-4780-82d5-da04a304480a service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:33:26.839494 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-a40fd488-9c4a-4e5d-8c12-b604c56090f3 req-bb9ea629-059a-4780-82d5-da04a304480a service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:33:26.839940 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-a40fd488-9c4a-4e5d-8c12-b604c56090f3 req-bb9ea629-059a-4780-82d5-da04a304480a service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:33:26.843279 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-603ef88d-2b9a-448f-804d-942cd6a3e752 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:33:26.845606 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:33:26.852844 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-603ef88d-2b9a-448f-804d-942cd6a3e752 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4" status: 200 len: 1657 microversion: 2.1 time: 0.162916 Sep 23 05:33:26.853437 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3587/7352] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:33:26 2022] GET /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4 => generated 1657 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:33:26.856485 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-a40fd488-9c4a-4e5d-8c12-b604c56090f3 req-bb9ea629-059a-4780-82d5-da04a304480a service nova] Creating event network-vif-plugged:8499eebc-622d-4a41-b95a-b1d3f1462201 for instance 6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4 on n-h1-846463-3 Sep 23 05:33:26.862754 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-a40fd488-9c4a-4e5d-8c12-b604c56090f3 req-bb9ea629-059a-4780-82d5-da04a304480a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039195 Sep 23 05:33:26.863561 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3766/7353] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:33:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 05:33:26.876299 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5585c1dd-50b9-4b99-a6d7-291e625009b4 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:33:26.882677 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5585c1dd-50b9-4b99-a6d7-291e625009b4 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:33:26.883264 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5585c1dd-50b9-4b99-a6d7-291e625009b4 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:33:26.883728 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5585c1dd-50b9-4b99-a6d7-291e625009b4 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:33:26.907407 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5585c1dd-50b9-4b99-a6d7-291e625009b4 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4] Going to try to start instance {{(pid=122698) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 23 05:33:27.040417 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5585c1dd-50b9-4b99-a6d7-291e625009b4 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "POST /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4/action" status: 202 len: 0 microversion: 2.1 time: 0.168154 Sep 23 05:33:27.041076 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3588/7354] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 05:33:26 2022] POST /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4/action => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 05:33:27.050297 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d932ec40-09b2-4859-bc95-06f6463578f3 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:33:27.053050 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d932ec40-09b2-4859-bc95-06f6463578f3 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:33:27.058087 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d932ec40-09b2-4859-bc95-06f6463578f3 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:33:27.058584 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d932ec40-09b2-4859-bc95-06f6463578f3 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:33:27.059024 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d932ec40-09b2-4859-bc95-06f6463578f3 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:33:27.059724 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d932ec40-09b2-4859-bc95-06f6463578f3 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:33:27.060179 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d932ec40-09b2-4859-bc95-06f6463578f3 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:33:27.060605 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d932ec40-09b2-4859-bc95-06f6463578f3 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:33:27.198287 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d932ec40-09b2-4859-bc95-06f6463578f3 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:33:27.207237 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d932ec40-09b2-4859-bc95-06f6463578f3 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4" status: 200 len: 1666 microversion: 2.1 time: 0.161149 Sep 23 05:33:27.208447 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3767/7355] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:33:27 2022] GET /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4 => generated 1666 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:33:28.233442 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c539e441-3c31-40d9-b968-d4c47237b447 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:33:28.234232 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c539e441-3c31-40d9-b968-d4c47237b447 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:33:28.241545 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c539e441-3c31-40d9-b968-d4c47237b447 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:33:28.242084 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c539e441-3c31-40d9-b968-d4c47237b447 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:33:28.246027 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c539e441-3c31-40d9-b968-d4c47237b447 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:33:28.246027 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c539e441-3c31-40d9-b968-d4c47237b447 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:33:28.246027 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c539e441-3c31-40d9-b968-d4c47237b447 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:33:28.246027 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c539e441-3c31-40d9-b968-d4c47237b447 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:33:28.381770 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c539e441-3c31-40d9-b968-d4c47237b447 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:33:28.389800 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c539e441-3c31-40d9-b968-d4c47237b447 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4" status: 200 len: 1666 microversion: 2.1 time: 0.161578 Sep 23 05:33:28.390685 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3589/7356] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:33:28 2022] GET /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4 => generated 1666 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:33:29.413411 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-65687bd8-e84c-49e7-b3db-a29d3936616b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:33:29.414064 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-65687bd8-e84c-49e7-b3db-a29d3936616b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:33:29.416550 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=41 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:33:29.421387 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-65687bd8-e84c-49e7-b3db-a29d3936616b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:33:29.421901 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-65687bd8-e84c-49e7-b3db-a29d3936616b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:33:29.422360 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-65687bd8-e84c-49e7-b3db-a29d3936616b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:33:29.423059 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-65687bd8-e84c-49e7-b3db-a29d3936616b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:33:29.423527 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-65687bd8-e84c-49e7-b3db-a29d3936616b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:33:29.423961 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-65687bd8-e84c-49e7-b3db-a29d3936616b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:33:29.557120 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-65687bd8-e84c-49e7-b3db-a29d3936616b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:33:29.564785 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-65687bd8-e84c-49e7-b3db-a29d3936616b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4" status: 200 len: 1670 microversion: 2.1 time: 0.155254 Sep 23 05:33:29.565359 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3768/7357] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:33:29 2022] GET /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4 => generated 1670 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:33:29.588374 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b29e4965-a839-415a-aba5-122c2076fc2d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:33:29.588909 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b29e4965-a839-415a-aba5-122c2076fc2d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:33:29.591779 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=37 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:33:29.596492 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b29e4965-a839-415a-aba5-122c2076fc2d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:33:29.603075 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b29e4965-a839-415a-aba5-122c2076fc2d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:33:29.603075 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b29e4965-a839-415a-aba5-122c2076fc2d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:33:29.603075 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b29e4965-a839-415a-aba5-122c2076fc2d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:33:29.603075 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b29e4965-a839-415a-aba5-122c2076fc2d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:33:29.603075 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b29e4965-a839-415a-aba5-122c2076fc2d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:33:29.624760 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b29e4965-a839-415a-aba5-122c2076fc2d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4] Going to try to terminate instance {{(pid=122698) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 05:33:29.915136 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b29e4965-a839-415a-aba5-122c2076fc2d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4" status: 204 len: 0 microversion: 2.1 time: 0.330388 Sep 23 05:33:29.915738 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3590/7358] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 05:33:29 2022] DELETE /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 05:33:29.924875 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-871f360d-a964-4c34-9579-eebe0796f38a tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:33:29.925496 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-871f360d-a964-4c34-9579-eebe0796f38a tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:33:29.932186 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-871f360d-a964-4c34-9579-eebe0796f38a tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:33:29.932673 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-871f360d-a964-4c34-9579-eebe0796f38a tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:33:29.933114 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-871f360d-a964-4c34-9579-eebe0796f38a tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:33:29.933808 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-871f360d-a964-4c34-9579-eebe0796f38a tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:33:29.934301 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-871f360d-a964-4c34-9579-eebe0796f38a tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:33:29.934731 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-871f360d-a964-4c34-9579-eebe0796f38a tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:33:30.064054 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-871f360d-a964-4c34-9579-eebe0796f38a tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:33:30.072588 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-871f360d-a964-4c34-9579-eebe0796f38a tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4" status: 200 len: 1676 microversion: 2.1 time: 0.152504 Sep 23 05:33:30.073163 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3769/7359] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:33:29 2022] GET /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4 => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:33:31.096459 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8d266e64-3a97-43ce-b00a-c29a0d0b7d8c tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:33:31.097179 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8d266e64-3a97-43ce-b00a-c29a0d0b7d8c tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:33:31.103331 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8d266e64-3a97-43ce-b00a-c29a0d0b7d8c tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:33:31.103840 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8d266e64-3a97-43ce-b00a-c29a0d0b7d8c tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:33:31.104297 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8d266e64-3a97-43ce-b00a-c29a0d0b7d8c tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:33:31.105010 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8d266e64-3a97-43ce-b00a-c29a0d0b7d8c tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:33:31.105484 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8d266e64-3a97-43ce-b00a-c29a0d0b7d8c tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:33:31.105974 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8d266e64-3a97-43ce-b00a-c29a0d0b7d8c tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:33:31.234185 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8d266e64-3a97-43ce-b00a-c29a0d0b7d8c tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:33:31.242442 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8d266e64-3a97-43ce-b00a-c29a0d0b7d8c tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4" status: 200 len: 1676 microversion: 2.1 time: 0.150640 Sep 23 05:33:31.243030 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3591/7360] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:33:31 2022] GET /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4 => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:33:32.131259 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-5ac85f10-28e9-4769-8066-4bb80d7d6a8e req-86d512e0-21e6-4ea9-97a4-a0f279ef8831 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4", "name": "network-vif-deleted", "tag": "8499eebc-622d-4a41-b95a-b1d3f1462201"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:33:32.142289 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-5ac85f10-28e9-4769-8066-4bb80d7d6a8e req-86d512e0-21e6-4ea9-97a4-a0f279ef8831 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:33:32.142800 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-5ac85f10-28e9-4769-8066-4bb80d7d6a8e req-86d512e0-21e6-4ea9-97a4-a0f279ef8831 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:33:32.143522 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-5ac85f10-28e9-4769-8066-4bb80d7d6a8e req-86d512e0-21e6-4ea9-97a4-a0f279ef8831 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:33:32.156451 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-5ac85f10-28e9-4769-8066-4bb80d7d6a8e req-86d512e0-21e6-4ea9-97a4-a0f279ef8831 service nova] Creating event network-vif-deleted:8499eebc-622d-4a41-b95a-b1d3f1462201 for instance 6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4 on n-h1-846463-3 Sep 23 05:33:32.161882 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-5ac85f10-28e9-4769-8066-4bb80d7d6a8e req-86d512e0-21e6-4ea9-97a4-a0f279ef8831 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035112 Sep 23 05:33:32.174997 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3770/7361] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:33:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 05:33:32.267092 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-541b793b-ee95-4e7d-88ff-172a81083aa2 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:33:32.267733 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-541b793b-ee95-4e7d-88ff-172a81083aa2 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:33:32.275677 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-541b793b-ee95-4e7d-88ff-172a81083aa2 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:33:32.276190 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-541b793b-ee95-4e7d-88ff-172a81083aa2 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:33:32.276645 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-541b793b-ee95-4e7d-88ff-172a81083aa2 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:33:32.277360 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-541b793b-ee95-4e7d-88ff-172a81083aa2 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:33:32.277846 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-541b793b-ee95-4e7d-88ff-172a81083aa2 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:33:32.278336 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-541b793b-ee95-4e7d-88ff-172a81083aa2 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:33:32.365651 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-541b793b-ee95-4e7d-88ff-172a81083aa2 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:33:32.373569 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-541b793b-ee95-4e7d-88ff-172a81083aa2 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4" status: 200 len: 1324 microversion: 2.1 time: 0.110794 Sep 23 05:33:32.374499 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3592/7362] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:33:32 2022] GET /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4 => generated 1324 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:33:33.399092 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3f589651-390d-407e-9b9b-2b22e3ac070c tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:33:33.399858 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-3f589651-390d-407e-9b9b-2b22e3ac070c tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:33:33.406204 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3f589651-390d-407e-9b9b-2b22e3ac070c tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:33:33.406698 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3f589651-390d-407e-9b9b-2b22e3ac070c tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:33:33.407145 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3f589651-390d-407e-9b9b-2b22e3ac070c tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:33:33.407846 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3f589651-390d-407e-9b9b-2b22e3ac070c tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:33:33.408312 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3f589651-390d-407e-9b9b-2b22e3ac070c tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:33:33.408751 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3f589651-390d-407e-9b9b-2b22e3ac070c tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:33:33.422729 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-3f589651-390d-407e-9b9b-2b22e3ac070c tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] HTTP exception thrown: Instance 6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4 could not be found. Sep 23 05:33:33.424354 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3f589651-390d-407e-9b9b-2b22e3ac070c tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Request method failure captured: Sep 23 05:33:33.424354 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4 HTTP/1.1 Sep 23 05:33:33.424354 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 05:33:33.424354 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 05:33:33.424354 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 05:33:33.424354 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 05:33:33.424354 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 05:33:33.424354 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 05:33:33.424354 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 05:33:33.424354 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 05:33:33.424354 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLUSNPTcpFt7b1SQrBrdC4rAqFbUXLEG8j5xh3rTP1qyrEhV8SHPScnfZxRBpUy9MBZ19dFgqZBh9ggYKPA2VLn9rpizyOQlJ_nBmDT4jVqC1BV3Kf2f8DXLNaNiW44Z1VNZeBb_3I4dNJUWbXOX8beHhp39Bmiy2ImuZpbhlNdAaR6A Sep 23 05:33:33.424354 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 05:33:33.424354 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 05:33:33.424354 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 05:33:33.424354 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 05:33:33.424354 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 05:33:33.424354 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 05:33:33.424354 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: f991e11ed0c44131a4bd9be0110dffe0 Sep 23 05:33:33.424354 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ServerActionsTestJSON-551956227 Sep 23 05:33:33.424354 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 05:33:33.424354 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 05:33:33.424354 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f991e11ed0c44131a4bd9be0110dffe0", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f991e11ed0c44131a4bd9be0110dffe0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f991e11ed0c44131a4bd9be0110dffe0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f991e11ed0c44131a4bd9be0110dffe0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:33:33.424354 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ServerActionsTestJSON-551956227 Sep 23 05:33:33.424354 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: f991e11ed0c44131a4bd9be0110dffe0 Sep 23 05:33:33.424354 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ServerActionsTestJSON-551956227 Sep 23 05:33:33.424354 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ServerActionsTestJSON-551956227-project Sep 23 05:33:33.424354 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 05:33:33.424354 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 05:33:33.424354 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: f398aeafcbcb48d88d8cfd3bdf59bbed Sep 23 05:33:33.424354 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ServerActionsTestJSON-551956227-project Sep 23 05:33:33.424354 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 05:33:33.424354 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4 could not be found. Sep 23 05:33:33.424354 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4'} Sep 23 05:33:33.424354 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:33:33.424354 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:33:33.424354 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 05:33:33.424354 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 05:33:33.424354 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 05:33:33.424354 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 05:33:33.424354 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 05:33:33.424354 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 05:33:33.424354 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 05:33:33.424354 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 05:33:33.424354 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4 could not be found. Sep 23 05:33:33.424354 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:33:33.424354 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:33:33.424354 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:33:33.424354 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:33:33.424354 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:33:33.424354 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:33:33.424354 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:33:33.424354 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:33:33.424354 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:33:33.424354 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:33:33.424354 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 05:33:33.424354 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 05:33:33.424354 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 05:33:33.424354 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 05:33:33.424354 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 05:33:33.424354 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:33:33.424354 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4 could not be found. Sep 23 05:33:33.424354 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:33:33.424354 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:33:33.424354 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:33:33.429437 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:33:33.429437 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:33:33.429437 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:33:33.429437 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:33:33.429437 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:33:33.429437 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4 could not be found. Sep 23 05:33:33.429437 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:33:33.429437 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3f589651-390d-407e-9b9b-2b22e3ac070c tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Returning 404 to user: Instance 6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:33:33.429437 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3f589651-390d-407e-9b9b-2b22e3ac070c tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4" status: 404 len: 111 microversion: 2.1 time: 0.031997 Sep 23 05:33:33.429437 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3771/7363] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:33:33 2022] GET /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 05:33:33.443326 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0977151e-e657-42a0-b52a-ce00553f447b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:33:33.443966 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-0977151e-e657-42a0-b52a-ce00553f447b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:33:33.450873 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0977151e-e657-42a0-b52a-ce00553f447b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:33:33.451384 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0977151e-e657-42a0-b52a-ce00553f447b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:33:33.451849 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0977151e-e657-42a0-b52a-ce00553f447b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:33:33.452567 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0977151e-e657-42a0-b52a-ce00553f447b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:33:33.453051 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0977151e-e657-42a0-b52a-ce00553f447b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:33:33.453500 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0977151e-e657-42a0-b52a-ce00553f447b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:33:33.467420 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-0977151e-e657-42a0-b52a-ce00553f447b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] HTTP exception thrown: Instance 6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4 could not be found. Sep 23 05:33:33.469072 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0977151e-e657-42a0-b52a-ce00553f447b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Request method failure captured: Sep 23 05:33:33.469072 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4 HTTP/1.1 Sep 23 05:33:33.469072 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 05:33:33.469072 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 05:33:33.469072 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 05:33:33.469072 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 05:33:33.469072 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 05:33:33.469072 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 05:33:33.469072 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 05:33:33.469072 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 05:33:33.469072 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLUSNPTcpFt7b1SQrBrdC4rAqFbUXLEG8j5xh3rTP1qyrEhV8SHPScnfZxRBpUy9MBZ19dFgqZBh9ggYKPA2VLn9rpizyOQlJ_nBmDT4jVqC1BV3Kf2f8DXLNaNiW44Z1VNZeBb_3I4dNJUWbXOX8beHhp39Bmiy2ImuZpbhlNdAaR6A Sep 23 05:33:33.469072 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 05:33:33.469072 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 05:33:33.469072 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 05:33:33.469072 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 05:33:33.469072 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 05:33:33.469072 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 05:33:33.469072 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: f991e11ed0c44131a4bd9be0110dffe0 Sep 23 05:33:33.469072 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ServerActionsTestJSON-551956227 Sep 23 05:33:33.469072 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 05:33:33.469072 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 05:33:33.469072 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f991e11ed0c44131a4bd9be0110dffe0", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f991e11ed0c44131a4bd9be0110dffe0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f991e11ed0c44131a4bd9be0110dffe0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f991e11ed0c44131a4bd9be0110dffe0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:33:33.469072 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ServerActionsTestJSON-551956227 Sep 23 05:33:33.469072 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: f991e11ed0c44131a4bd9be0110dffe0 Sep 23 05:33:33.469072 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ServerActionsTestJSON-551956227 Sep 23 05:33:33.469072 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ServerActionsTestJSON-551956227-project Sep 23 05:33:33.469072 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 05:33:33.469072 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 05:33:33.469072 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: f398aeafcbcb48d88d8cfd3bdf59bbed Sep 23 05:33:33.469072 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ServerActionsTestJSON-551956227-project Sep 23 05:33:33.469072 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 05:33:33.469072 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4 could not be found. Sep 23 05:33:33.469072 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4'} Sep 23 05:33:33.469072 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:33:33.469072 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:33:33.469072 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 05:33:33.469072 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 05:33:33.469072 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 05:33:33.469072 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 05:33:33.469072 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 05:33:33.469072 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 05:33:33.469072 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 05:33:33.469072 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 05:33:33.469072 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4 could not be found. Sep 23 05:33:33.469072 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:33:33.469072 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:33:33.469072 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:33:33.469072 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:33:33.469072 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:33:33.469072 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:33:33.469072 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:33:33.469072 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:33:33.469072 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:33:33.469072 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:33:33.469072 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 05:33:33.469072 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 05:33:33.469072 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 05:33:33.469072 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 05:33:33.469072 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 05:33:33.469072 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:33:33.469072 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4 could not be found. Sep 23 05:33:33.469072 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:33:33.469072 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:33:33.469072 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:33:33.474451 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:33:33.474451 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:33:33.474451 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:33:33.474451 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:33:33.474451 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:33:33.474451 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4 could not be found. Sep 23 05:33:33.474451 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:33:33.474451 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0977151e-e657-42a0-b52a-ce00553f447b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Returning 404 to user: Instance 6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:33:33.474451 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0977151e-e657-42a0-b52a-ce00553f447b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4" status: 404 len: 111 microversion: 2.1 time: 0.031137 Sep 23 05:33:33.475453 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3593/7364] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:33:33 2022] GET /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 05:33:33.518564 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-af546b30-948d-4d5f-a6f3-2dc9e758228d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2095166206", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "networks": [{"uuid": "37e382a2-7105-4d7e-b7ef-1b58c783c9f2"}], "security_groups": [{"name": "tempest-securitygroup--381295551"}], "key_name": "tempest-keypair-2117157152", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:33:33.624217 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.neutron [None req-af546b30-948d-4d5f-a6f3-2dc9e758228d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] validate_networks() for [('37e382a2-7105-4d7e-b7ef-1b58c783c9f2', None, None, None, None, None)] {{(pid=122699) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 05:33:34.078295 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-af546b30-948d-4d5f-a6f3-2dc9e758228d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Flavor limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 05:33:34.078725 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-af546b30-948d-4d5f-a6f3-2dc9e758228d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Image limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 05:33:34.079205 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-af546b30-948d-4d5f-a6f3-2dc9e758228d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Flavor pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 05:33:34.079623 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-af546b30-948d-4d5f-a6f3-2dc9e758228d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Image pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 05:33:34.080131 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-af546b30-948d-4d5f-a6f3-2dc9e758228d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 05:33:34.089258 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-af546b30-948d-4d5f-a6f3-2dc9e758228d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:33:34.089751 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-af546b30-948d-4d5f-a6f3-2dc9e758228d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:33:34.090231 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-af546b30-948d-4d5f-a6f3-2dc9e758228d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:33:34.090975 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-af546b30-948d-4d5f-a6f3-2dc9e758228d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:33:34.091441 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-af546b30-948d-4d5f-a6f3-2dc9e758228d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:33:34.091931 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-af546b30-948d-4d5f-a6f3-2dc9e758228d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:33:34.111292 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-af546b30-948d-4d5f-a6f3-2dc9e758228d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Getting quotas for project f991e11ed0c44131a4bd9be0110dffe0. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 05:33:34.117020 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-af546b30-948d-4d5f-a6f3-2dc9e758228d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Getting quotas for user f398aeafcbcb48d88d8cfd3bdf59bbed and project f991e11ed0c44131a4bd9be0110dffe0. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 05:33:34.129967 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-af546b30-948d-4d5f-a6f3-2dc9e758228d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Going to run 1 instances... {{(pid=122699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 05:33:34.132315 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-af546b30-948d-4d5f-a6f3-2dc9e758228d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: e597857c-9b3b-4406-83d7-395c5ad5912e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 05:33:34.233212 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-af546b30-948d-4d5f-a6f3-2dc9e758228d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.718813 Sep 23 05:33:34.233854 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3772/7365] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 05:33:33 2022] POST /compute/v2.1/servers => generated 405 bytes in 720 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 05:33:34.245920 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d1efec21-f570-40a4-a16d-60449aea9b98 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:33:34.246593 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d1efec21-f570-40a4-a16d-60449aea9b98 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: e597857c-9b3b-4406-83d7-395c5ad5912e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:33:34.300238 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d1efec21-f570-40a4-a16d-60449aea9b98 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:33:34.308094 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d1efec21-f570-40a4-a16d-60449aea9b98 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e" status: 200 len: 1239 microversion: 2.1 time: 0.066222 Sep 23 05:33:34.308675 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3594/7366] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:33:34 2022] GET /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e => generated 1239 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:33:35.333278 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-47c89c8e-2d45-480f-8502-f9b0726cdab9 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:33:35.333923 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-47c89c8e-2d45-480f-8502-f9b0726cdab9 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: e597857c-9b3b-4406-83d7-395c5ad5912e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:33:35.341173 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-47c89c8e-2d45-480f-8502-f9b0726cdab9 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:33:35.341703 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-47c89c8e-2d45-480f-8502-f9b0726cdab9 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:33:35.342440 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-47c89c8e-2d45-480f-8502-f9b0726cdab9 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:33:35.343008 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-47c89c8e-2d45-480f-8502-f9b0726cdab9 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:33:35.343504 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-47c89c8e-2d45-480f-8502-f9b0726cdab9 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:33:35.343939 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-47c89c8e-2d45-480f-8502-f9b0726cdab9 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:33:35.405981 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-47c89c8e-2d45-480f-8502-f9b0726cdab9 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:33:35.414082 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-47c89c8e-2d45-480f-8502-f9b0726cdab9 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e" status: 200 len: 1243 microversion: 2.1 time: 0.085970 Sep 23 05:33:35.414653 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3773/7367] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:33:35 2022] GET /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e => generated 1243 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:33:36.439343 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-810b4113-5065-4d3b-a985-5a94d424a005 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:33:36.439997 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-810b4113-5065-4d3b-a985-5a94d424a005 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: e597857c-9b3b-4406-83d7-395c5ad5912e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:33:36.448970 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-810b4113-5065-4d3b-a985-5a94d424a005 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:33:36.449495 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-810b4113-5065-4d3b-a985-5a94d424a005 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:33:36.449994 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-810b4113-5065-4d3b-a985-5a94d424a005 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:33:36.450790 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-810b4113-5065-4d3b-a985-5a94d424a005 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:33:36.451282 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-810b4113-5065-4d3b-a985-5a94d424a005 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:33:36.452400 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-810b4113-5065-4d3b-a985-5a94d424a005 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:33:36.515088 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-810b4113-5065-4d3b-a985-5a94d424a005 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:33:36.523834 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-810b4113-5065-4d3b-a985-5a94d424a005 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e" status: 200 len: 1309 microversion: 2.1 time: 0.088568 Sep 23 05:33:36.524459 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3595/7368] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:33:36 2022] GET /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e => generated 1309 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:33:37.553526 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9f884b41-ffb7-4db1-88df-eb7aaf5c2c83 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:33:37.554858 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-9f884b41-ffb7-4db1-88df-eb7aaf5c2c83 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: e597857c-9b3b-4406-83d7-395c5ad5912e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:33:37.561784 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9f884b41-ffb7-4db1-88df-eb7aaf5c2c83 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:33:37.562319 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9f884b41-ffb7-4db1-88df-eb7aaf5c2c83 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:33:37.562809 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9f884b41-ffb7-4db1-88df-eb7aaf5c2c83 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:33:37.563494 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9f884b41-ffb7-4db1-88df-eb7aaf5c2c83 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:33:37.563950 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9f884b41-ffb7-4db1-88df-eb7aaf5c2c83 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:33:37.564382 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9f884b41-ffb7-4db1-88df-eb7aaf5c2c83 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:33:37.700117 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-9f884b41-ffb7-4db1-88df-eb7aaf5c2c83 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:33:37.708610 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-9f884b41-ffb7-4db1-88df-eb7aaf5c2c83 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e" status: 200 len: 1364 microversion: 2.1 time: 0.158947 Sep 23 05:33:37.717512 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3774/7369] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:33:37 2022] GET /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e => generated 1364 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:33:37.877941 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-2e0d664c-0e7f-466e-a994-7763d648e130 req-37bc0282-ce4b-4c63-aa76-db8891303406 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e597857c-9b3b-4406-83d7-395c5ad5912e", "tag": "e5785a72-0c01-4a0e-959b-809f065d425b"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:33:37.889388 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-2e0d664c-0e7f-466e-a994-7763d648e130 req-37bc0282-ce4b-4c63-aa76-db8891303406 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:33:37.890136 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-2e0d664c-0e7f-466e-a994-7763d648e130 req-37bc0282-ce4b-4c63-aa76-db8891303406 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:33:37.891012 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-2e0d664c-0e7f-466e-a994-7763d648e130 req-37bc0282-ce4b-4c63-aa76-db8891303406 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:33:37.904747 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-2e0d664c-0e7f-466e-a994-7763d648e130 req-37bc0282-ce4b-4c63-aa76-db8891303406 service nova] Creating event network-changed:e5785a72-0c01-4a0e-959b-809f065d425b for instance e597857c-9b3b-4406-83d7-395c5ad5912e on n-h2-846463-3 Sep 23 05:33:37.910321 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-2e0d664c-0e7f-466e-a994-7763d648e130 req-37bc0282-ce4b-4c63-aa76-db8891303406 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036899 Sep 23 05:33:37.911870 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3596/7370] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:33:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:33:38.732768 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-83058318-677a-4988-be6d-1215406017f7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:33:38.733295 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-83058318-677a-4988-be6d-1215406017f7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: e597857c-9b3b-4406-83d7-395c5ad5912e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:33:38.740574 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-83058318-677a-4988-be6d-1215406017f7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:33:38.741074 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-83058318-677a-4988-be6d-1215406017f7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:33:38.741521 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-83058318-677a-4988-be6d-1215406017f7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:33:38.742253 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-83058318-677a-4988-be6d-1215406017f7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:33:38.742724 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-83058318-677a-4988-be6d-1215406017f7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:33:38.743160 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-83058318-677a-4988-be6d-1215406017f7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:33:38.874721 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-83058318-677a-4988-be6d-1215406017f7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:33:38.882565 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-83058318-677a-4988-be6d-1215406017f7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e" status: 200 len: 1364 microversion: 2.1 time: 0.153749 Sep 23 05:33:38.883143 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3775/7371] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:33:38 2022] GET /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:33:39.906816 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0ca353ed-40f4-483e-8ac0-835225381887 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:33:39.907543 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-0ca353ed-40f4-483e-8ac0-835225381887 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: e597857c-9b3b-4406-83d7-395c5ad5912e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:33:39.913779 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0ca353ed-40f4-483e-8ac0-835225381887 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:33:39.914332 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0ca353ed-40f4-483e-8ac0-835225381887 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:33:39.914799 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0ca353ed-40f4-483e-8ac0-835225381887 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:33:39.915546 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0ca353ed-40f4-483e-8ac0-835225381887 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:33:39.916025 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0ca353ed-40f4-483e-8ac0-835225381887 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:33:39.916479 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0ca353ed-40f4-483e-8ac0-835225381887 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:33:40.049076 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-0ca353ed-40f4-483e-8ac0-835225381887 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:33:40.057331 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0ca353ed-40f4-483e-8ac0-835225381887 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e" status: 200 len: 1364 microversion: 2.1 time: 0.155789 Sep 23 05:33:40.057924 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3597/7372] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:33:39 2022] GET /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:33:41.081024 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-656e0a53-8cc3-448f-a121-12390b93d0c7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:33:41.081643 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-656e0a53-8cc3-448f-a121-12390b93d0c7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: e597857c-9b3b-4406-83d7-395c5ad5912e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:33:41.088867 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-656e0a53-8cc3-448f-a121-12390b93d0c7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:33:41.089366 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-656e0a53-8cc3-448f-a121-12390b93d0c7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:33:41.089832 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-656e0a53-8cc3-448f-a121-12390b93d0c7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:33:41.090775 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-656e0a53-8cc3-448f-a121-12390b93d0c7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:33:41.091243 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-656e0a53-8cc3-448f-a121-12390b93d0c7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:33:41.091681 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-656e0a53-8cc3-448f-a121-12390b93d0c7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:33:41.222735 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-656e0a53-8cc3-448f-a121-12390b93d0c7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:33:41.230588 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-656e0a53-8cc3-448f-a121-12390b93d0c7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e" status: 200 len: 1364 microversion: 2.1 time: 0.153394 Sep 23 05:33:41.231166 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3776/7373] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:33:41 2022] GET /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:33:42.253811 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-01a85323-673c-436c-b8ed-55464af0a535 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:33:42.254426 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-01a85323-673c-436c-b8ed-55464af0a535 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: e597857c-9b3b-4406-83d7-395c5ad5912e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:33:42.261327 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-01a85323-673c-436c-b8ed-55464af0a535 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:33:42.261919 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-01a85323-673c-436c-b8ed-55464af0a535 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:33:42.262388 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-01a85323-673c-436c-b8ed-55464af0a535 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:33:42.263117 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-01a85323-673c-436c-b8ed-55464af0a535 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:33:42.263601 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-01a85323-673c-436c-b8ed-55464af0a535 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:33:42.264055 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-01a85323-673c-436c-b8ed-55464af0a535 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:33:42.400471 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-01a85323-673c-436c-b8ed-55464af0a535 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:33:42.408591 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-01a85323-673c-436c-b8ed-55464af0a535 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e" status: 200 len: 1364 microversion: 2.1 time: 0.158769 Sep 23 05:33:42.409177 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3598/7374] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:33:42 2022] GET /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:33:43.433107 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ac46c4c1-29fc-4025-880a-0cc58eba4bd8 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:33:43.433744 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ac46c4c1-29fc-4025-880a-0cc58eba4bd8 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: e597857c-9b3b-4406-83d7-395c5ad5912e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:33:43.440190 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ac46c4c1-29fc-4025-880a-0cc58eba4bd8 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:33:43.440687 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ac46c4c1-29fc-4025-880a-0cc58eba4bd8 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:33:43.441135 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ac46c4c1-29fc-4025-880a-0cc58eba4bd8 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:33:43.441836 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ac46c4c1-29fc-4025-880a-0cc58eba4bd8 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:33:43.442327 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ac46c4c1-29fc-4025-880a-0cc58eba4bd8 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:33:43.442761 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ac46c4c1-29fc-4025-880a-0cc58eba4bd8 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:33:43.570405 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ac46c4c1-29fc-4025-880a-0cc58eba4bd8 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:33:43.578192 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ac46c4c1-29fc-4025-880a-0cc58eba4bd8 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e" status: 200 len: 1364 microversion: 2.1 time: 0.148929 Sep 23 05:33:43.578883 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3777/7375] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:33:43 2022] GET /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:33:43.949584 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-2d9169dd-02c5-4dd6-94ee-9c6ef432cb0c req-6773268e-70dd-4e60-ac52-8f1338ecf6d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e597857c-9b3b-4406-83d7-395c5ad5912e", "name": "network-vif-plugged", "status": "completed", "tag": "e5785a72-0c01-4a0e-959b-809f065d425b"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:33:43.960769 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-2d9169dd-02c5-4dd6-94ee-9c6ef432cb0c req-6773268e-70dd-4e60-ac52-8f1338ecf6d6 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:33:43.961276 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-2d9169dd-02c5-4dd6-94ee-9c6ef432cb0c req-6773268e-70dd-4e60-ac52-8f1338ecf6d6 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:33:43.961731 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-2d9169dd-02c5-4dd6-94ee-9c6ef432cb0c req-6773268e-70dd-4e60-ac52-8f1338ecf6d6 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:33:43.974418 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-2d9169dd-02c5-4dd6-94ee-9c6ef432cb0c req-6773268e-70dd-4e60-ac52-8f1338ecf6d6 service nova] Creating event network-vif-plugged:e5785a72-0c01-4a0e-959b-809f065d425b for instance e597857c-9b3b-4406-83d7-395c5ad5912e on n-h2-846463-3 Sep 23 05:33:43.979848 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-2d9169dd-02c5-4dd6-94ee-9c6ef432cb0c req-6773268e-70dd-4e60-ac52-8f1338ecf6d6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034102 Sep 23 05:33:43.980621 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3599/7376] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:33:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 05:33:44.602504 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9f895a62-4da1-482b-81e0-98b243357eb8 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:33:44.603118 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-9f895a62-4da1-482b-81e0-98b243357eb8 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: e597857c-9b3b-4406-83d7-395c5ad5912e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:33:44.605093 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:33:44.605753 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=6 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:33:44.611052 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9f895a62-4da1-482b-81e0-98b243357eb8 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:33:44.614311 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9f895a62-4da1-482b-81e0-98b243357eb8 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:33:44.614311 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9f895a62-4da1-482b-81e0-98b243357eb8 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:33:44.614311 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9f895a62-4da1-482b-81e0-98b243357eb8 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:33:44.614311 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9f895a62-4da1-482b-81e0-98b243357eb8 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:33:44.614311 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9f895a62-4da1-482b-81e0-98b243357eb8 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:33:44.741322 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-9f895a62-4da1-482b-81e0-98b243357eb8 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:33:44.749455 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-9f895a62-4da1-482b-81e0-98b243357eb8 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e" status: 200 len: 1364 microversion: 2.1 time: 0.151015 Sep 23 05:33:44.750055 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3778/7377] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:33:44 2022] GET /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:33:45.771569 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:33:45.776610 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0dfb91fa-c9db-4f94-b041-d910b43d933d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:33:45.777352 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-0dfb91fa-c9db-4f94-b041-d910b43d933d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: e597857c-9b3b-4406-83d7-395c5ad5912e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:33:45.783546 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0dfb91fa-c9db-4f94-b041-d910b43d933d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:33:45.784047 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0dfb91fa-c9db-4f94-b041-d910b43d933d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:33:45.786105 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0dfb91fa-c9db-4f94-b041-d910b43d933d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:33:45.786105 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0dfb91fa-c9db-4f94-b041-d910b43d933d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:33:45.786105 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0dfb91fa-c9db-4f94-b041-d910b43d933d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:33:45.786478 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0dfb91fa-c9db-4f94-b041-d910b43d933d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:33:45.919274 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-0dfb91fa-c9db-4f94-b041-d910b43d933d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:33:45.927528 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0dfb91fa-c9db-4f94-b041-d910b43d933d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e" status: 200 len: 1552 microversion: 2.1 time: 0.156918 Sep 23 05:33:45.928098 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3600/7378] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:33:45 2022] GET /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e => generated 1552 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:33:45.950913 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-38b32dd3-294f-48e7-8b78-99c96f781c5b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:33:45.951423 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-38b32dd3-294f-48e7-8b78-99c96f781c5b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: e597857c-9b3b-4406-83d7-395c5ad5912e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:33:45.957688 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-38b32dd3-294f-48e7-8b78-99c96f781c5b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:33:45.958202 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-38b32dd3-294f-48e7-8b78-99c96f781c5b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:33:45.958638 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-38b32dd3-294f-48e7-8b78-99c96f781c5b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:33:45.959330 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-38b32dd3-294f-48e7-8b78-99c96f781c5b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:33:45.959784 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-38b32dd3-294f-48e7-8b78-99c96f781c5b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:33:45.960207 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-38b32dd3-294f-48e7-8b78-99c96f781c5b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:33:46.035868 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-38b32dd3-294f-48e7-8b78-99c96f781c5b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088706 Sep 23 05:33:46.036470 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3779/7379] 10.222.0.33 () {58 vars in 1275 bytes} [Fri Sep 23 05:33:45 2022] GET /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:33:47.331813 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-0384be05-4c08-4882-ba32-31d3d10f3e3a req-6fc22a17-6318-4962-be0d-bb6734261fc3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e597857c-9b3b-4406-83d7-395c5ad5912e", "tag": "e5785a72-0c01-4a0e-959b-809f065d425b"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:33:47.342862 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-0384be05-4c08-4882-ba32-31d3d10f3e3a req-6fc22a17-6318-4962-be0d-bb6734261fc3 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:33:47.343366 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-0384be05-4c08-4882-ba32-31d3d10f3e3a req-6fc22a17-6318-4962-be0d-bb6734261fc3 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:33:47.343836 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-0384be05-4c08-4882-ba32-31d3d10f3e3a req-6fc22a17-6318-4962-be0d-bb6734261fc3 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:33:47.358295 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-0384be05-4c08-4882-ba32-31d3d10f3e3a req-6fc22a17-6318-4962-be0d-bb6734261fc3 service nova] Creating event network-changed:e5785a72-0c01-4a0e-959b-809f065d425b for instance e597857c-9b3b-4406-83d7-395c5ad5912e on n-h2-846463-3 Sep 23 05:33:47.363360 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-0384be05-4c08-4882-ba32-31d3d10f3e3a req-6fc22a17-6318-4962-be0d-bb6734261fc3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035336 Sep 23 05:33:47.364228 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3601/7380] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:33:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:34:20.232059 n-d-846463-3 devstack@n-api.service[122699]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 05:34:20.232722 n-d-846463-3 devstack@n-api.service[122699]: Fri Sep 23 05:34:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e/action (ip 10.222.0.33) !!! Sep 23 05:34:20.233281 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:34:20.234065 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=74 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:34:20.238486 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4bd6892f-4013-4fb4-b8ef-26e4a9a4df9c tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:34:20.240832 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4bd6892f-4013-4fb4-b8ef-26e4a9a4df9c tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: e597857c-9b3b-4406-83d7-395c5ad5912e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:34:20.249040 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4bd6892f-4013-4fb4-b8ef-26e4a9a4df9c tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:34:20.249531 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4bd6892f-4013-4fb4-b8ef-26e4a9a4df9c tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:34:20.250008 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4bd6892f-4013-4fb4-b8ef-26e4a9a4df9c tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:34:20.250726 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4bd6892f-4013-4fb4-b8ef-26e4a9a4df9c tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:34:20.251238 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4bd6892f-4013-4fb4-b8ef-26e4a9a4df9c tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:34:20.251667 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4bd6892f-4013-4fb4-b8ef-26e4a9a4df9c tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:34:20.281501 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-4bd6892f-4013-4fb4-b8ef-26e4a9a4df9c tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:34:20.287038 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4bd6892f-4013-4fb4-b8ef-26e4a9a4df9c tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: e597857c-9b3b-4406-83d7-395c5ad5912e] Old instance type m1.heat2, new instance type m1.heat {{(pid=122699) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 23 05:34:20.293727 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-4bd6892f-4013-4fb4-b8ef-26e4a9a4df9c tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Flavor limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 05:34:20.294194 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-4bd6892f-4013-4fb4-b8ef-26e4a9a4df9c tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Image limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 05:34:20.294677 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-4bd6892f-4013-4fb4-b8ef-26e4a9a4df9c tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Flavor pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 05:34:20.295095 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-4bd6892f-4013-4fb4-b8ef-26e4a9a4df9c tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Image pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 05:34:20.295513 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-4bd6892f-4013-4fb4-b8ef-26e4a9a4df9c tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 05:34:20.479325 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4bd6892f-4013-4fb4-b8ef-26e4a9a4df9c tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "POST /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e/action" status: 202 len: 0 microversion: 2.1 time: 0.249021 Sep 23 05:34:20.479945 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3780/7381] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 05:34:20 2022] POST /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e/action => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 05:34:20.488745 n-d-846463-3 devstack@n-api.service[122698]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 05:34:20.489277 n-d-846463-3 devstack@n-api.service[122698]: Fri Sep 23 05:34:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e (ip 10.222.0.33) !!! Sep 23 05:34:20.490150 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:34:20.491412 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:34:20.496771 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3241d70d-8f3d-4985-97f9-a3d0c9e85648 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:34:20.497505 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3241d70d-8f3d-4985-97f9-a3d0c9e85648 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: e597857c-9b3b-4406-83d7-395c5ad5912e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:34:20.506220 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3241d70d-8f3d-4985-97f9-a3d0c9e85648 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:34:20.510202 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3241d70d-8f3d-4985-97f9-a3d0c9e85648 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:34:20.510202 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3241d70d-8f3d-4985-97f9-a3d0c9e85648 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:34:20.510202 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3241d70d-8f3d-4985-97f9-a3d0c9e85648 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:34:20.510202 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3241d70d-8f3d-4985-97f9-a3d0c9e85648 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:34:20.510202 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3241d70d-8f3d-4985-97f9-a3d0c9e85648 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:34:20.730587 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-3241d70d-8f3d-4985-97f9-a3d0c9e85648 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:34:20.741981 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3241d70d-8f3d-4985-97f9-a3d0c9e85648 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e" status: 200 len: 1680 microversion: 2.1 time: 0.254859 Sep 23 05:34:20.741981 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3602/7382] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:34:20 2022] GET /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e => generated 1680 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:34:21.765554 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-12eb351d-edbd-4d9d-8ef1-1eab10c6e42c tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:34:21.766379 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-12eb351d-edbd-4d9d-8ef1-1eab10c6e42c tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: e597857c-9b3b-4406-83d7-395c5ad5912e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:34:21.772884 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-12eb351d-edbd-4d9d-8ef1-1eab10c6e42c tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:34:21.773377 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-12eb351d-edbd-4d9d-8ef1-1eab10c6e42c tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:34:21.773829 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-12eb351d-edbd-4d9d-8ef1-1eab10c6e42c tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:34:21.774538 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-12eb351d-edbd-4d9d-8ef1-1eab10c6e42c tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:34:21.775058 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-12eb351d-edbd-4d9d-8ef1-1eab10c6e42c tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:34:21.775487 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-12eb351d-edbd-4d9d-8ef1-1eab10c6e42c tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:34:21.957108 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-12eb351d-edbd-4d9d-8ef1-1eab10c6e42c tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:34:21.964794 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-12eb351d-edbd-4d9d-8ef1-1eab10c6e42c tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e" status: 200 len: 1680 microversion: 2.1 time: 0.204034 Sep 23 05:34:21.965364 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3781/7383] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:34:21 2022] GET /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e => generated 1680 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:34:22.988651 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-87ae2b4b-61a7-4e35-a2c3-b3c391524d14 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:34:22.989291 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-87ae2b4b-61a7-4e35-a2c3-b3c391524d14 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: e597857c-9b3b-4406-83d7-395c5ad5912e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:34:22.996656 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-87ae2b4b-61a7-4e35-a2c3-b3c391524d14 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:34:22.997304 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-87ae2b4b-61a7-4e35-a2c3-b3c391524d14 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:34:22.997773 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-87ae2b4b-61a7-4e35-a2c3-b3c391524d14 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:34:22.998533 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-87ae2b4b-61a7-4e35-a2c3-b3c391524d14 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:34:22.999013 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-87ae2b4b-61a7-4e35-a2c3-b3c391524d14 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:34:22.999455 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-87ae2b4b-61a7-4e35-a2c3-b3c391524d14 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:34:23.131739 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-87ae2b4b-61a7-4e35-a2c3-b3c391524d14 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:34:23.140010 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-87ae2b4b-61a7-4e35-a2c3-b3c391524d14 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e" status: 200 len: 1680 microversion: 2.1 time: 0.155658 Sep 23 05:34:23.140779 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3603/7384] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:34:22 2022] GET /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:34:24.165759 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9b24ccf7-19e7-4c87-9365-a5be34852945 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:34:24.166395 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-9b24ccf7-19e7-4c87-9365-a5be34852945 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: e597857c-9b3b-4406-83d7-395c5ad5912e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:34:24.172839 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9b24ccf7-19e7-4c87-9365-a5be34852945 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:34:24.173330 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9b24ccf7-19e7-4c87-9365-a5be34852945 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:34:24.173763 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9b24ccf7-19e7-4c87-9365-a5be34852945 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:34:24.175157 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9b24ccf7-19e7-4c87-9365-a5be34852945 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:34:24.175610 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9b24ccf7-19e7-4c87-9365-a5be34852945 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:34:24.176037 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9b24ccf7-19e7-4c87-9365-a5be34852945 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:34:24.307067 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-9b24ccf7-19e7-4c87-9365-a5be34852945 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:34:24.314823 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-9b24ccf7-19e7-4c87-9365-a5be34852945 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e" status: 200 len: 1685 microversion: 2.1 time: 0.152908 Sep 23 05:34:24.315408 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3782/7385] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:34:24 2022] GET /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e => generated 1685 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:34:25.337711 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1970b9fe-afbe-47bf-8c88-b1a9f3a671d1 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:34:25.338382 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-1970b9fe-afbe-47bf-8c88-b1a9f3a671d1 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: e597857c-9b3b-4406-83d7-395c5ad5912e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:34:25.345318 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1970b9fe-afbe-47bf-8c88-b1a9f3a671d1 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:34:25.345839 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1970b9fe-afbe-47bf-8c88-b1a9f3a671d1 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:34:25.346837 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1970b9fe-afbe-47bf-8c88-b1a9f3a671d1 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:34:25.347560 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1970b9fe-afbe-47bf-8c88-b1a9f3a671d1 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:34:25.348040 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1970b9fe-afbe-47bf-8c88-b1a9f3a671d1 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:34:25.348491 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1970b9fe-afbe-47bf-8c88-b1a9f3a671d1 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:34:25.476181 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-1970b9fe-afbe-47bf-8c88-b1a9f3a671d1 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:34:25.483873 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-1970b9fe-afbe-47bf-8c88-b1a9f3a671d1 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e" status: 200 len: 1685 microversion: 2.1 time: 0.150101 Sep 23 05:34:25.484442 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3604/7386] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:34:25 2022] GET /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e => generated 1685 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:34:26.508389 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-922a9feb-e0f6-4a3f-b4ca-6aac49471e51 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:34:26.509042 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-922a9feb-e0f6-4a3f-b4ca-6aac49471e51 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: e597857c-9b3b-4406-83d7-395c5ad5912e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:34:26.515742 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-922a9feb-e0f6-4a3f-b4ca-6aac49471e51 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:34:26.516227 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-922a9feb-e0f6-4a3f-b4ca-6aac49471e51 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:34:26.516662 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-922a9feb-e0f6-4a3f-b4ca-6aac49471e51 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:34:26.517347 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-922a9feb-e0f6-4a3f-b4ca-6aac49471e51 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:34:26.517799 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-922a9feb-e0f6-4a3f-b4ca-6aac49471e51 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:34:26.518250 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-922a9feb-e0f6-4a3f-b4ca-6aac49471e51 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:34:26.648538 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-922a9feb-e0f6-4a3f-b4ca-6aac49471e51 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:34:26.656314 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-922a9feb-e0f6-4a3f-b4ca-6aac49471e51 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e" status: 200 len: 1685 microversion: 2.1 time: 0.151796 Sep 23 05:34:26.656878 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3783/7387] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:34:26 2022] GET /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e => generated 1685 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:34:27.679335 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-785e0d6e-2944-402a-b031-340ae336eeba tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:34:27.679958 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-785e0d6e-2944-402a-b031-340ae336eeba tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: e597857c-9b3b-4406-83d7-395c5ad5912e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:34:27.686924 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-785e0d6e-2944-402a-b031-340ae336eeba tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:34:27.687430 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-785e0d6e-2944-402a-b031-340ae336eeba tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:34:27.687886 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-785e0d6e-2944-402a-b031-340ae336eeba tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:34:27.688590 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-785e0d6e-2944-402a-b031-340ae336eeba tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:34:27.689062 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-785e0d6e-2944-402a-b031-340ae336eeba tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:34:27.689503 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-785e0d6e-2944-402a-b031-340ae336eeba tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:34:27.816589 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-785e0d6e-2944-402a-b031-340ae336eeba tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:34:27.824440 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-785e0d6e-2944-402a-b031-340ae336eeba tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e" status: 200 len: 1685 microversion: 2.1 time: 0.149062 Sep 23 05:34:27.825026 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3605/7388] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:34:27 2022] GET /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e => generated 1685 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:34:28.849054 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0e589113-cdce-46ee-9306-f08c23836b26 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:34:28.849667 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-0e589113-cdce-46ee-9306-f08c23836b26 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: e597857c-9b3b-4406-83d7-395c5ad5912e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:34:28.856063 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0e589113-cdce-46ee-9306-f08c23836b26 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:34:28.856556 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0e589113-cdce-46ee-9306-f08c23836b26 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:34:28.856998 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0e589113-cdce-46ee-9306-f08c23836b26 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:34:28.857756 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0e589113-cdce-46ee-9306-f08c23836b26 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:34:28.858256 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0e589113-cdce-46ee-9306-f08c23836b26 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:34:28.858689 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0e589113-cdce-46ee-9306-f08c23836b26 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:34:28.992474 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-0e589113-cdce-46ee-9306-f08c23836b26 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:34:29.000409 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0e589113-cdce-46ee-9306-f08c23836b26 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e" status: 200 len: 1685 microversion: 2.1 time: 0.155930 Sep 23 05:34:29.000987 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3784/7389] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:34:28 2022] GET /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e => generated 1685 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:34:30.024341 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-89f900bf-99b9-4000-821c-083d179ab568 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:34:30.024980 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-89f900bf-99b9-4000-821c-083d179ab568 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: e597857c-9b3b-4406-83d7-395c5ad5912e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:34:30.032011 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-89f900bf-99b9-4000-821c-083d179ab568 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:34:30.032696 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-89f900bf-99b9-4000-821c-083d179ab568 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:34:30.033123 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-89f900bf-99b9-4000-821c-083d179ab568 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:34:30.034387 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-89f900bf-99b9-4000-821c-083d179ab568 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:34:30.034872 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-89f900bf-99b9-4000-821c-083d179ab568 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:34:30.035330 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-89f900bf-99b9-4000-821c-083d179ab568 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:34:30.163704 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-89f900bf-99b9-4000-821c-083d179ab568 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:34:30.171474 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-89f900bf-99b9-4000-821c-083d179ab568 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e" status: 200 len: 1685 microversion: 2.1 time: 0.151231 Sep 23 05:34:30.172046 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3606/7390] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:34:30 2022] GET /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e => generated 1685 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:34:31.195913 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b916471e-8b2a-488d-afcf-77307ab0f71a tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:34:31.196524 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b916471e-8b2a-488d-afcf-77307ab0f71a tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: e597857c-9b3b-4406-83d7-395c5ad5912e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:34:31.203082 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b916471e-8b2a-488d-afcf-77307ab0f71a tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:34:31.203575 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b916471e-8b2a-488d-afcf-77307ab0f71a tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:34:31.204021 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b916471e-8b2a-488d-afcf-77307ab0f71a tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:34:31.204720 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b916471e-8b2a-488d-afcf-77307ab0f71a tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:34:31.205176 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b916471e-8b2a-488d-afcf-77307ab0f71a tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:34:31.205600 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b916471e-8b2a-488d-afcf-77307ab0f71a tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:34:31.337350 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b916471e-8b2a-488d-afcf-77307ab0f71a tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:34:31.345195 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b916471e-8b2a-488d-afcf-77307ab0f71a tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e" status: 200 len: 1685 microversion: 2.1 time: 0.153203 Sep 23 05:34:31.345763 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3785/7391] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:34:31 2022] GET /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e => generated 1685 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:34:32.368894 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-90413bbf-065e-4437-a4b9-606bef8feb86 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:34:32.369531 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-90413bbf-065e-4437-a4b9-606bef8feb86 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: e597857c-9b3b-4406-83d7-395c5ad5912e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:34:32.376668 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-90413bbf-065e-4437-a4b9-606bef8feb86 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:34:32.377184 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-90413bbf-065e-4437-a4b9-606bef8feb86 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:34:32.377653 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-90413bbf-065e-4437-a4b9-606bef8feb86 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:34:32.378402 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-90413bbf-065e-4437-a4b9-606bef8feb86 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:34:32.378895 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-90413bbf-065e-4437-a4b9-606bef8feb86 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:34:32.379414 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-90413bbf-065e-4437-a4b9-606bef8feb86 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:34:32.516487 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-90413bbf-065e-4437-a4b9-606bef8feb86 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:34:32.525247 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-90413bbf-065e-4437-a4b9-606bef8feb86 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e" status: 200 len: 1685 microversion: 2.1 time: 0.160465 Sep 23 05:34:32.525824 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3607/7392] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:34:32 2022] GET /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e => generated 1685 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:34:33.550124 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-aef5c8f4-3750-4440-802b-7dbf2b98be8b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:34:33.550697 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-aef5c8f4-3750-4440-802b-7dbf2b98be8b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: e597857c-9b3b-4406-83d7-395c5ad5912e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:34:33.557201 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aef5c8f4-3750-4440-802b-7dbf2b98be8b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:34:33.557696 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aef5c8f4-3750-4440-802b-7dbf2b98be8b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:34:33.558176 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aef5c8f4-3750-4440-802b-7dbf2b98be8b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:34:33.558878 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aef5c8f4-3750-4440-802b-7dbf2b98be8b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:34:33.559340 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aef5c8f4-3750-4440-802b-7dbf2b98be8b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:34:33.559772 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aef5c8f4-3750-4440-802b-7dbf2b98be8b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:34:33.687716 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-aef5c8f4-3750-4440-802b-7dbf2b98be8b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:34:33.695398 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-aef5c8f4-3750-4440-802b-7dbf2b98be8b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e" status: 200 len: 1685 microversion: 2.1 time: 0.149753 Sep 23 05:34:33.695974 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3786/7393] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:34:33 2022] GET /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e => generated 1685 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:34:34.719082 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ea6ac8c1-90c3-4c22-82fe-d23e75f14f17 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:34:34.719713 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-ea6ac8c1-90c3-4c22-82fe-d23e75f14f17 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: e597857c-9b3b-4406-83d7-395c5ad5912e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:34:34.726720 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ea6ac8c1-90c3-4c22-82fe-d23e75f14f17 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:34:34.727227 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ea6ac8c1-90c3-4c22-82fe-d23e75f14f17 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:34:34.727688 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ea6ac8c1-90c3-4c22-82fe-d23e75f14f17 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:34:34.728399 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ea6ac8c1-90c3-4c22-82fe-d23e75f14f17 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:34:34.728876 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ea6ac8c1-90c3-4c22-82fe-d23e75f14f17 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:34:34.729320 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ea6ac8c1-90c3-4c22-82fe-d23e75f14f17 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:34:34.862051 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ea6ac8c1-90c3-4c22-82fe-d23e75f14f17 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:34:34.869920 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ea6ac8c1-90c3-4c22-82fe-d23e75f14f17 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e" status: 200 len: 1685 microversion: 2.1 time: 0.154734 Sep 23 05:34:34.870436 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3608/7394] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:34:34 2022] GET /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e => generated 1685 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:34:35.895044 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0bcf65b9-56a5-4f94-8b9b-55a8b51b8ca3 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:34:35.895661 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-0bcf65b9-56a5-4f94-8b9b-55a8b51b8ca3 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: e597857c-9b3b-4406-83d7-395c5ad5912e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:34:35.901719 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0bcf65b9-56a5-4f94-8b9b-55a8b51b8ca3 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:34:35.902248 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0bcf65b9-56a5-4f94-8b9b-55a8b51b8ca3 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:34:35.902699 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0bcf65b9-56a5-4f94-8b9b-55a8b51b8ca3 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:34:35.903396 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0bcf65b9-56a5-4f94-8b9b-55a8b51b8ca3 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:34:35.903860 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0bcf65b9-56a5-4f94-8b9b-55a8b51b8ca3 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:34:35.904288 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0bcf65b9-56a5-4f94-8b9b-55a8b51b8ca3 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:34:36.034331 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-0bcf65b9-56a5-4f94-8b9b-55a8b51b8ca3 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:34:36.042120 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0bcf65b9-56a5-4f94-8b9b-55a8b51b8ca3 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e" status: 200 len: 1685 microversion: 2.1 time: 0.152029 Sep 23 05:34:36.042694 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3787/7395] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:34:35 2022] GET /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e => generated 1685 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:34:37.065865 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8974e0dc-bc5d-4f73-b204-eb44eabe2412 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:34:37.066513 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8974e0dc-bc5d-4f73-b204-eb44eabe2412 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: e597857c-9b3b-4406-83d7-395c5ad5912e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:34:37.073393 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8974e0dc-bc5d-4f73-b204-eb44eabe2412 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:34:37.073976 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8974e0dc-bc5d-4f73-b204-eb44eabe2412 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:34:37.074548 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8974e0dc-bc5d-4f73-b204-eb44eabe2412 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:34:37.075257 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8974e0dc-bc5d-4f73-b204-eb44eabe2412 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:34:37.075727 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8974e0dc-bc5d-4f73-b204-eb44eabe2412 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:34:37.076169 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8974e0dc-bc5d-4f73-b204-eb44eabe2412 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:34:37.207758 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8974e0dc-bc5d-4f73-b204-eb44eabe2412 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:34:37.215927 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8974e0dc-bc5d-4f73-b204-eb44eabe2412 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e" status: 200 len: 1685 microversion: 2.1 time: 0.154006 Sep 23 05:34:37.216518 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3609/7396] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:34:37 2022] GET /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e => generated 1685 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:34:38.240714 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9d0811a4-a2b1-4324-b473-ad36b4332e3a tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:34:38.241512 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-9d0811a4-a2b1-4324-b473-ad36b4332e3a tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: e597857c-9b3b-4406-83d7-395c5ad5912e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:34:38.248293 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9d0811a4-a2b1-4324-b473-ad36b4332e3a tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:34:38.248797 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9d0811a4-a2b1-4324-b473-ad36b4332e3a tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:34:38.249241 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9d0811a4-a2b1-4324-b473-ad36b4332e3a tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:34:38.249982 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9d0811a4-a2b1-4324-b473-ad36b4332e3a tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:34:38.250451 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9d0811a4-a2b1-4324-b473-ad36b4332e3a tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:34:38.250884 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9d0811a4-a2b1-4324-b473-ad36b4332e3a tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:34:38.405811 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-9d0811a4-a2b1-4324-b473-ad36b4332e3a tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:34:38.414743 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-9d0811a4-a2b1-4324-b473-ad36b4332e3a tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e" status: 200 len: 1685 microversion: 2.1 time: 0.178568 Sep 23 05:34:38.415266 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3788/7397] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:34:38 2022] GET /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e => generated 1685 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:34:39.438877 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-58ca4fb2-727b-4c82-8ab4-3ecac4beccc8 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:34:39.440133 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-58ca4fb2-727b-4c82-8ab4-3ecac4beccc8 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: e597857c-9b3b-4406-83d7-395c5ad5912e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:34:39.447090 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-58ca4fb2-727b-4c82-8ab4-3ecac4beccc8 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:34:39.447602 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-58ca4fb2-727b-4c82-8ab4-3ecac4beccc8 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:34:39.448069 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-58ca4fb2-727b-4c82-8ab4-3ecac4beccc8 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:34:39.448783 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-58ca4fb2-727b-4c82-8ab4-3ecac4beccc8 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:34:39.449272 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-58ca4fb2-727b-4c82-8ab4-3ecac4beccc8 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:34:39.449720 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-58ca4fb2-727b-4c82-8ab4-3ecac4beccc8 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:34:39.579209 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-58ca4fb2-727b-4c82-8ab4-3ecac4beccc8 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:34:39.587258 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-58ca4fb2-727b-4c82-8ab4-3ecac4beccc8 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e" status: 200 len: 1685 microversion: 2.1 time: 0.152255 Sep 23 05:34:39.587841 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3610/7398] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:34:39 2022] GET /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e => generated 1685 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:34:40.610979 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8c745992-61d0-4757-b86c-afb840d9cb2a tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:34:40.611747 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-8c745992-61d0-4757-b86c-afb840d9cb2a tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: e597857c-9b3b-4406-83d7-395c5ad5912e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:34:40.618838 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8c745992-61d0-4757-b86c-afb840d9cb2a tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:34:40.622382 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8c745992-61d0-4757-b86c-afb840d9cb2a tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:34:40.622382 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8c745992-61d0-4757-b86c-afb840d9cb2a tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:34:40.622382 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8c745992-61d0-4757-b86c-afb840d9cb2a tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:34:40.622382 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8c745992-61d0-4757-b86c-afb840d9cb2a tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:34:40.622382 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8c745992-61d0-4757-b86c-afb840d9cb2a tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:34:40.768688 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-8c745992-61d0-4757-b86c-afb840d9cb2a tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:34:40.776513 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-8c745992-61d0-4757-b86c-afb840d9cb2a tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e" status: 200 len: 1685 microversion: 2.1 time: 0.169575 Sep 23 05:34:40.777087 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3789/7399] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:34:40 2022] GET /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e => generated 1685 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:34:41.349341 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-57ea58b1-97cd-4976-a3cf-a460ed42b29b req-29f7e224-d139-4f05-a5a5-1c92e66cab02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e597857c-9b3b-4406-83d7-395c5ad5912e", "name": "network-vif-unplugged", "status": "completed", "tag": "e5785a72-0c01-4a0e-959b-809f065d425b"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:34:41.358834 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-57ea58b1-97cd-4976-a3cf-a460ed42b29b req-29f7e224-d139-4f05-a5a5-1c92e66cab02 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:34:41.359335 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-57ea58b1-97cd-4976-a3cf-a460ed42b29b req-29f7e224-d139-4f05-a5a5-1c92e66cab02 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:34:41.359786 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-57ea58b1-97cd-4976-a3cf-a460ed42b29b req-29f7e224-d139-4f05-a5a5-1c92e66cab02 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:34:41.372297 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-57ea58b1-97cd-4976-a3cf-a460ed42b29b req-29f7e224-d139-4f05-a5a5-1c92e66cab02 service nova] Creating event network-vif-unplugged:e5785a72-0c01-4a0e-959b-809f065d425b for instance e597857c-9b3b-4406-83d7-395c5ad5912e on n-h1-846463-3 Sep 23 05:34:41.377669 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [req-57ea58b1-97cd-4976-a3cf-a460ed42b29b req-29f7e224-d139-4f05-a5a5-1c92e66cab02 service nova] Instance e597857c-9b3b-4406-83d7-395c5ad5912e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846463-3', 'n-h2-846463-3'} {{(pid=122698) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 23 05:34:41.388654 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-57ea58b1-97cd-4976-a3cf-a460ed42b29b req-29f7e224-d139-4f05-a5a5-1c92e66cab02 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.101299 Sep 23 05:34:41.389247 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3611/7400] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:34:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:34:41.799452 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-70c07368-2c66-4368-b267-3498c9cf377f tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:34:41.800169 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-70c07368-2c66-4368-b267-3498c9cf377f tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: e597857c-9b3b-4406-83d7-395c5ad5912e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:34:41.806709 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-70c07368-2c66-4368-b267-3498c9cf377f tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:34:41.807283 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-70c07368-2c66-4368-b267-3498c9cf377f tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:34:41.807719 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-70c07368-2c66-4368-b267-3498c9cf377f tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:34:41.808421 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-70c07368-2c66-4368-b267-3498c9cf377f tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:34:41.808874 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-70c07368-2c66-4368-b267-3498c9cf377f tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:34:41.809298 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-70c07368-2c66-4368-b267-3498c9cf377f tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:34:41.938704 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-70c07368-2c66-4368-b267-3498c9cf377f tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:34:41.947671 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-70c07368-2c66-4368-b267-3498c9cf377f tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e" status: 200 len: 1684 microversion: 2.1 time: 0.151800 Sep 23 05:34:41.948865 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3790/7401] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:34:41 2022] GET /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:34:42.982622 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a3ce1c41-e373-4a9d-bd6e-a52097ac4cee tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:34:42.983265 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a3ce1c41-e373-4a9d-bd6e-a52097ac4cee tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: e597857c-9b3b-4406-83d7-395c5ad5912e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:34:42.989476 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a3ce1c41-e373-4a9d-bd6e-a52097ac4cee tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:34:42.990023 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a3ce1c41-e373-4a9d-bd6e-a52097ac4cee tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:34:42.990485 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a3ce1c41-e373-4a9d-bd6e-a52097ac4cee tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:34:42.991198 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a3ce1c41-e373-4a9d-bd6e-a52097ac4cee tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:34:42.991670 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a3ce1c41-e373-4a9d-bd6e-a52097ac4cee tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:34:42.992123 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a3ce1c41-e373-4a9d-bd6e-a52097ac4cee tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:34:43.125165 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a3ce1c41-e373-4a9d-bd6e-a52097ac4cee tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:34:43.132937 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a3ce1c41-e373-4a9d-bd6e-a52097ac4cee tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e" status: 200 len: 1682 microversion: 2.1 time: 0.155908 Sep 23 05:34:43.133515 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3612/7402] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:34:42 2022] GET /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:34:43.403498 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-ef3e1993-6842-409f-b53f-411b2352a033 req-a088424a-a954-47e6-90bb-4f7bc7cc8aab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e597857c-9b3b-4406-83d7-395c5ad5912e", "tag": "e5785a72-0c01-4a0e-959b-809f065d425b"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:34:43.413317 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-ef3e1993-6842-409f-b53f-411b2352a033 req-a088424a-a954-47e6-90bb-4f7bc7cc8aab service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:34:43.413799 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-ef3e1993-6842-409f-b53f-411b2352a033 req-a088424a-a954-47e6-90bb-4f7bc7cc8aab service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:34:43.414261 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-ef3e1993-6842-409f-b53f-411b2352a033 req-a088424a-a954-47e6-90bb-4f7bc7cc8aab service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:34:43.425418 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-ef3e1993-6842-409f-b53f-411b2352a033 req-a088424a-a954-47e6-90bb-4f7bc7cc8aab service nova] Creating event network-changed:e5785a72-0c01-4a0e-959b-809f065d425b for instance e597857c-9b3b-4406-83d7-395c5ad5912e on n-h1-846463-3 Sep 23 05:34:43.430586 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [req-ef3e1993-6842-409f-b53f-411b2352a033 req-a088424a-a954-47e6-90bb-4f7bc7cc8aab service nova] Instance e597857c-9b3b-4406-83d7-395c5ad5912e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846463-3', 'n-h2-846463-3'} {{(pid=122699) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 23 05:34:43.441811 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-ef3e1993-6842-409f-b53f-411b2352a033 req-a088424a-a954-47e6-90bb-4f7bc7cc8aab service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041981 Sep 23 05:34:43.442459 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3791/7403] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:34:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:34:44.156918 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6b8aee15-39c5-4b00-879c-4f0d0cf2febe tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:34:44.157549 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-6b8aee15-39c5-4b00-879c-4f0d0cf2febe tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: e597857c-9b3b-4406-83d7-395c5ad5912e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:34:44.164934 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6b8aee15-39c5-4b00-879c-4f0d0cf2febe tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:34:44.165440 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6b8aee15-39c5-4b00-879c-4f0d0cf2febe tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:34:44.165939 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6b8aee15-39c5-4b00-879c-4f0d0cf2febe tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:34:44.166619 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6b8aee15-39c5-4b00-879c-4f0d0cf2febe tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:34:44.167091 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6b8aee15-39c5-4b00-879c-4f0d0cf2febe tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:34:44.167531 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6b8aee15-39c5-4b00-879c-4f0d0cf2febe tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:34:44.307874 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6b8aee15-39c5-4b00-879c-4f0d0cf2febe tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:34:44.317795 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-6b8aee15-39c5-4b00-879c-4f0d0cf2febe tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e" status: 200 len: 1682 microversion: 2.1 time: 0.164725 Sep 23 05:34:44.331916 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3613/7404] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:34:44 2022] GET /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e => generated 1682 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:34:45.343328 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-da2d6a0e-9020-4d3b-af15-c44a50403628 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:34:45.344314 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-da2d6a0e-9020-4d3b-af15-c44a50403628 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: e597857c-9b3b-4406-83d7-395c5ad5912e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:34:45.350515 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-da2d6a0e-9020-4d3b-af15-c44a50403628 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:34:45.351016 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-da2d6a0e-9020-4d3b-af15-c44a50403628 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:34:45.351583 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-da2d6a0e-9020-4d3b-af15-c44a50403628 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:34:45.352848 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-da2d6a0e-9020-4d3b-af15-c44a50403628 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:34:45.353696 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-da2d6a0e-9020-4d3b-af15-c44a50403628 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:34:45.354222 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-da2d6a0e-9020-4d3b-af15-c44a50403628 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:34:45.487733 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-da2d6a0e-9020-4d3b-af15-c44a50403628 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:34:45.495669 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-da2d6a0e-9020-4d3b-af15-c44a50403628 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e" status: 200 len: 1679 microversion: 2.1 time: 0.157308 Sep 23 05:34:45.496185 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3792/7405] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:34:45 2022] GET /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:34:45.519181 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3690c6e7-1bec-4ff1-82b1-08999568ed2b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:34:45.520023 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3690c6e7-1bec-4ff1-82b1-08999568ed2b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: e597857c-9b3b-4406-83d7-395c5ad5912e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:34:45.526892 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3690c6e7-1bec-4ff1-82b1-08999568ed2b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:34:45.527397 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3690c6e7-1bec-4ff1-82b1-08999568ed2b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:34:45.527855 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3690c6e7-1bec-4ff1-82b1-08999568ed2b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:34:45.528865 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3690c6e7-1bec-4ff1-82b1-08999568ed2b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:34:45.529356 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3690c6e7-1bec-4ff1-82b1-08999568ed2b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:34:45.529800 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3690c6e7-1bec-4ff1-82b1-08999568ed2b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:34:45.571619 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3690c6e7-1bec-4ff1-82b1-08999568ed2b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:34:45.572121 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3690c6e7-1bec-4ff1-82b1-08999568ed2b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:34:45.572575 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3690c6e7-1bec-4ff1-82b1-08999568ed2b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:34:45.573324 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3690c6e7-1bec-4ff1-82b1-08999568ed2b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:34:45.573797 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3690c6e7-1bec-4ff1-82b1-08999568ed2b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:34:45.574270 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3690c6e7-1bec-4ff1-82b1-08999568ed2b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:34:45.594346 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-3690c6e7-1bec-4ff1-82b1-08999568ed2b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Getting quotas for project f991e11ed0c44131a4bd9be0110dffe0. Resources: {'cores', 'ram'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 05:34:45.599984 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-3690c6e7-1bec-4ff1-82b1-08999568ed2b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Getting quotas for user f398aeafcbcb48d88d8cfd3bdf59bbed and project f991e11ed0c44131a4bd9be0110dffe0. Resources: {'cores', 'ram'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 05:34:46.023595 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3690c6e7-1bec-4ff1-82b1-08999568ed2b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "POST /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e/action" status: 202 len: 0 microversion: 2.1 time: 0.508333 Sep 23 05:34:46.024234 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3614/7406] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 05:34:45 2022] POST /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e/action => generated 0 bytes in 510 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 05:34:46.033909 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7797fe07-490b-47f0-a7f5-da05b073ba2d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:34:46.034549 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-7797fe07-490b-47f0-a7f5-da05b073ba2d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: e597857c-9b3b-4406-83d7-395c5ad5912e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:34:46.040717 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7797fe07-490b-47f0-a7f5-da05b073ba2d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:34:46.041218 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7797fe07-490b-47f0-a7f5-da05b073ba2d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:34:46.041668 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7797fe07-490b-47f0-a7f5-da05b073ba2d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:34:46.042447 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7797fe07-490b-47f0-a7f5-da05b073ba2d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:34:46.042920 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7797fe07-490b-47f0-a7f5-da05b073ba2d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:34:46.043354 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7797fe07-490b-47f0-a7f5-da05b073ba2d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:34:46.179655 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-7797fe07-490b-47f0-a7f5-da05b073ba2d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:34:46.187460 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-7797fe07-490b-47f0-a7f5-da05b073ba2d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e" status: 200 len: 1678 microversion: 2.1 time: 0.158996 Sep 23 05:34:46.188038 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3793/7407] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:34:46 2022] GET /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:34:47.211927 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-03b2232c-0ccf-4125-bdc1-8a9de5643662 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:34:47.215186 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-03b2232c-0ccf-4125-bdc1-8a9de5643662 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: e597857c-9b3b-4406-83d7-395c5ad5912e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:34:47.220040 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-03b2232c-0ccf-4125-bdc1-8a9de5643662 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:34:47.220589 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-03b2232c-0ccf-4125-bdc1-8a9de5643662 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:34:47.221042 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-03b2232c-0ccf-4125-bdc1-8a9de5643662 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:34:47.222006 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-03b2232c-0ccf-4125-bdc1-8a9de5643662 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:34:47.222910 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-03b2232c-0ccf-4125-bdc1-8a9de5643662 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:34:47.222910 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-03b2232c-0ccf-4125-bdc1-8a9de5643662 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:34:47.282926 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-e87c920c-49dc-4191-b865-487d78b55310 req-a30352df-1b38-4845-b32d-d8b44653fcf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e597857c-9b3b-4406-83d7-395c5ad5912e", "name": "network-vif-plugged", "status": "completed", "tag": "e5785a72-0c01-4a0e-959b-809f065d425b"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:34:47.292636 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-e87c920c-49dc-4191-b865-487d78b55310 req-a30352df-1b38-4845-b32d-d8b44653fcf0 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:34:47.293945 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-e87c920c-49dc-4191-b865-487d78b55310 req-a30352df-1b38-4845-b32d-d8b44653fcf0 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:34:47.294391 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-e87c920c-49dc-4191-b865-487d78b55310 req-a30352df-1b38-4845-b32d-d8b44653fcf0 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:34:47.309912 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-e87c920c-49dc-4191-b865-487d78b55310 req-a30352df-1b38-4845-b32d-d8b44653fcf0 service nova] Creating event network-vif-plugged:e5785a72-0c01-4a0e-959b-809f065d425b for instance e597857c-9b3b-4406-83d7-395c5ad5912e on n-h1-846463-3 Sep 23 05:34:47.323037 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [req-e87c920c-49dc-4191-b865-487d78b55310 req-a30352df-1b38-4845-b32d-d8b44653fcf0 service nova] Instance e597857c-9b3b-4406-83d7-395c5ad5912e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846463-3', 'n-h2-846463-3'} {{(pid=122699) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 23 05:34:47.335538 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-e87c920c-49dc-4191-b865-487d78b55310 req-a30352df-1b38-4845-b32d-d8b44653fcf0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120837 Sep 23 05:34:47.337078 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3794/7408] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:34:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:34:47.373013 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-03b2232c-0ccf-4125-bdc1-8a9de5643662 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:34:47.377153 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:34:47.381831 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-03b2232c-0ccf-4125-bdc1-8a9de5643662 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e" status: 200 len: 1678 microversion: 2.1 time: 0.174291 Sep 23 05:34:47.382441 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3615/7409] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:34:47 2022] GET /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e => generated 1678 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:34:48.406885 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f6a3dfa3-ac23-4792-8a1b-8031df460627 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:34:48.407584 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f6a3dfa3-ac23-4792-8a1b-8031df460627 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: e597857c-9b3b-4406-83d7-395c5ad5912e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:34:48.414322 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f6a3dfa3-ac23-4792-8a1b-8031df460627 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:34:48.414806 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f6a3dfa3-ac23-4792-8a1b-8031df460627 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:34:48.415239 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f6a3dfa3-ac23-4792-8a1b-8031df460627 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:34:48.415918 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f6a3dfa3-ac23-4792-8a1b-8031df460627 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:34:48.416366 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f6a3dfa3-ac23-4792-8a1b-8031df460627 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:34:48.416784 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f6a3dfa3-ac23-4792-8a1b-8031df460627 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:34:48.550386 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f6a3dfa3-ac23-4792-8a1b-8031df460627 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:34:48.553963 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:34:48.558522 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f6a3dfa3-ac23-4792-8a1b-8031df460627 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e" status: 200 len: 1678 microversion: 2.1 time: 0.156427 Sep 23 05:34:48.559094 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3795/7410] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:34:48 2022] GET /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:34:49.582809 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c35de764-2647-4e81-937f-8734489a659b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:34:49.583437 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c35de764-2647-4e81-937f-8734489a659b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: e597857c-9b3b-4406-83d7-395c5ad5912e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:34:49.591226 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c35de764-2647-4e81-937f-8734489a659b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:34:49.591728 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c35de764-2647-4e81-937f-8734489a659b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:34:49.592184 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c35de764-2647-4e81-937f-8734489a659b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:34:49.592898 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c35de764-2647-4e81-937f-8734489a659b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:34:49.593368 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c35de764-2647-4e81-937f-8734489a659b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:34:49.593808 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c35de764-2647-4e81-937f-8734489a659b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:34:49.714187 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-8289148a-e43c-4284-b9e0-76d495824327 req-e704c25f-0955-46e7-a835-1726f4f8c861 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e597857c-9b3b-4406-83d7-395c5ad5912e", "name": "network-vif-unplugged", "status": "completed", "tag": "e5785a72-0c01-4a0e-959b-809f065d425b"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:34:49.727985 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-8289148a-e43c-4284-b9e0-76d495824327 req-e704c25f-0955-46e7-a835-1726f4f8c861 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:34:49.728482 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-8289148a-e43c-4284-b9e0-76d495824327 req-e704c25f-0955-46e7-a835-1726f4f8c861 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:34:49.728944 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-8289148a-e43c-4284-b9e0-76d495824327 req-e704c25f-0955-46e7-a835-1726f4f8c861 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:34:49.729058 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c35de764-2647-4e81-937f-8734489a659b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:34:49.736954 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c35de764-2647-4e81-937f-8734489a659b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e" status: 200 len: 1678 microversion: 2.1 time: 0.158274 Sep 23 05:34:49.737847 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3616/7411] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:34:49 2022] GET /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:34:49.740927 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-8289148a-e43c-4284-b9e0-76d495824327 req-e704c25f-0955-46e7-a835-1726f4f8c861 service nova] Creating event network-vif-unplugged:e5785a72-0c01-4a0e-959b-809f065d425b for instance e597857c-9b3b-4406-83d7-395c5ad5912e on n-h2-846463-3 Sep 23 05:34:49.746429 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [req-8289148a-e43c-4284-b9e0-76d495824327 req-e704c25f-0955-46e7-a835-1726f4f8c861 service nova] Instance e597857c-9b3b-4406-83d7-395c5ad5912e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846463-3', 'n-h2-846463-3'} {{(pid=122699) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 23 05:34:49.757298 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-8289148a-e43c-4284-b9e0-76d495824327 req-e704c25f-0955-46e7-a835-1726f4f8c861 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047421 Sep 23 05:34:49.758075 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3796/7412] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:34:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 05:34:50.772044 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1d5f10e5-7903-4575-8021-0253d28e9802 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:34:50.772044 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-1d5f10e5-7903-4575-8021-0253d28e9802 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: e597857c-9b3b-4406-83d7-395c5ad5912e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:34:50.772044 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:34:50.772044 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1d5f10e5-7903-4575-8021-0253d28e9802 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:34:50.772044 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1d5f10e5-7903-4575-8021-0253d28e9802 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:34:50.772044 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1d5f10e5-7903-4575-8021-0253d28e9802 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:34:50.772044 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1d5f10e5-7903-4575-8021-0253d28e9802 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:34:50.772044 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1d5f10e5-7903-4575-8021-0253d28e9802 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:34:50.773126 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1d5f10e5-7903-4575-8021-0253d28e9802 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:34:50.902511 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-1d5f10e5-7903-4575-8021-0253d28e9802 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:34:50.910880 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-1d5f10e5-7903-4575-8021-0253d28e9802 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e" status: 200 len: 1678 microversion: 2.1 time: 0.154622 Sep 23 05:34:50.911500 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3617/7413] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:34:50 2022] GET /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:34:51.773361 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-990dfda5-13d3-418e-a4f6-7d18febbade6 req-c3bca2f4-7064-49f4-ae96-42658b87da68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e597857c-9b3b-4406-83d7-395c5ad5912e", "tag": "e5785a72-0c01-4a0e-959b-809f065d425b"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:34:51.778680 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=39 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:34:51.784810 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-990dfda5-13d3-418e-a4f6-7d18febbade6 req-c3bca2f4-7064-49f4-ae96-42658b87da68 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:34:51.785298 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-990dfda5-13d3-418e-a4f6-7d18febbade6 req-c3bca2f4-7064-49f4-ae96-42658b87da68 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:34:51.785738 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-990dfda5-13d3-418e-a4f6-7d18febbade6 req-c3bca2f4-7064-49f4-ae96-42658b87da68 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:34:51.797246 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-990dfda5-13d3-418e-a4f6-7d18febbade6 req-c3bca2f4-7064-49f4-ae96-42658b87da68 service nova] Creating event network-changed:e5785a72-0c01-4a0e-959b-809f065d425b for instance e597857c-9b3b-4406-83d7-395c5ad5912e on n-h2-846463-3 Sep 23 05:34:51.803335 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [req-990dfda5-13d3-418e-a4f6-7d18febbade6 req-c3bca2f4-7064-49f4-ae96-42658b87da68 service nova] Instance e597857c-9b3b-4406-83d7-395c5ad5912e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846463-3', 'n-h2-846463-3'} {{(pid=122699) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 23 05:34:51.813784 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-990dfda5-13d3-418e-a4f6-7d18febbade6 req-c3bca2f4-7064-49f4-ae96-42658b87da68 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044828 Sep 23 05:34:51.814402 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3797/7414] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:34:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:34:51.936106 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-df126abe-c971-4471-b55b-cd78a4c73e66 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:34:51.936749 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-df126abe-c971-4471-b55b-cd78a4c73e66 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: e597857c-9b3b-4406-83d7-395c5ad5912e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:34:51.945859 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-df126abe-c971-4471-b55b-cd78a4c73e66 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:34:51.946402 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-df126abe-c971-4471-b55b-cd78a4c73e66 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:34:51.946864 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-df126abe-c971-4471-b55b-cd78a4c73e66 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:34:51.947980 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-df126abe-c971-4471-b55b-cd78a4c73e66 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:34:51.948518 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-df126abe-c971-4471-b55b-cd78a4c73e66 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:34:51.948966 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-df126abe-c971-4471-b55b-cd78a4c73e66 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:34:52.094747 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-df126abe-c971-4471-b55b-cd78a4c73e66 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:34:52.103645 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-df126abe-c971-4471-b55b-cd78a4c73e66 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e" status: 200 len: 1678 microversion: 2.1 time: 0.171653 Sep 23 05:34:52.104247 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3618/7415] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:34:51 2022] GET /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e => generated 1678 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:34:53.128211 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d326882f-a10a-41cc-94f3-25eab84af5e5 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:34:53.128951 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d326882f-a10a-41cc-94f3-25eab84af5e5 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: e597857c-9b3b-4406-83d7-395c5ad5912e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:34:53.135705 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d326882f-a10a-41cc-94f3-25eab84af5e5 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:34:53.136226 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d326882f-a10a-41cc-94f3-25eab84af5e5 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:34:53.136654 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d326882f-a10a-41cc-94f3-25eab84af5e5 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:34:53.137353 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d326882f-a10a-41cc-94f3-25eab84af5e5 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:34:53.137820 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d326882f-a10a-41cc-94f3-25eab84af5e5 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:34:53.138282 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d326882f-a10a-41cc-94f3-25eab84af5e5 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:34:53.267994 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d326882f-a10a-41cc-94f3-25eab84af5e5 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:34:53.275888 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d326882f-a10a-41cc-94f3-25eab84af5e5 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e" status: 200 len: 1671 microversion: 2.1 time: 0.152882 Sep 23 05:34:53.276468 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3798/7416] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:34:53 2022] GET /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e => generated 1671 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:34:53.299694 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6f281e11-bba4-45f8-bf46-11039204897b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:34:53.300336 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-6f281e11-bba4-45f8-bf46-11039204897b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: e597857c-9b3b-4406-83d7-395c5ad5912e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:34:53.307368 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6f281e11-bba4-45f8-bf46-11039204897b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:34:53.312953 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6f281e11-bba4-45f8-bf46-11039204897b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:34:53.312953 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6f281e11-bba4-45f8-bf46-11039204897b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:34:53.312953 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6f281e11-bba4-45f8-bf46-11039204897b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:34:53.312953 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6f281e11-bba4-45f8-bf46-11039204897b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:34:53.312953 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6f281e11-bba4-45f8-bf46-11039204897b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:34:53.451199 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6f281e11-bba4-45f8-bf46-11039204897b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:34:53.459419 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-6f281e11-bba4-45f8-bf46-11039204897b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e" status: 200 len: 1671 microversion: 2.1 time: 0.164438 Sep 23 05:34:53.459996 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3619/7417] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:34:53 2022] GET /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e => generated 1671 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:34:53.482006 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b1283798-35ee-45b0-892f-13ecb8f8b25c tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:34:53.482690 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b1283798-35ee-45b0-892f-13ecb8f8b25c tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: e597857c-9b3b-4406-83d7-395c5ad5912e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:34:53.488707 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b1283798-35ee-45b0-892f-13ecb8f8b25c tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:34:53.489206 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b1283798-35ee-45b0-892f-13ecb8f8b25c tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:34:53.489656 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b1283798-35ee-45b0-892f-13ecb8f8b25c tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:34:53.490453 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b1283798-35ee-45b0-892f-13ecb8f8b25c tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:34:53.490923 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b1283798-35ee-45b0-892f-13ecb8f8b25c tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:34:53.491361 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b1283798-35ee-45b0-892f-13ecb8f8b25c tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:34:53.618919 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b1283798-35ee-45b0-892f-13ecb8f8b25c tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:34:53.626601 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b1283798-35ee-45b0-892f-13ecb8f8b25c tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e" status: 200 len: 1671 microversion: 2.1 time: 0.148484 Sep 23 05:34:53.627174 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3799/7418] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:34:53 2022] GET /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e => generated 1671 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:34:53.649446 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-df287fae-a821-4ac2-8c7d-64be52b09ad9 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:34:53.650005 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-df287fae-a821-4ac2-8c7d-64be52b09ad9 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: e597857c-9b3b-4406-83d7-395c5ad5912e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:34:53.655927 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-df287fae-a821-4ac2-8c7d-64be52b09ad9 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:34:53.656373 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-df287fae-a821-4ac2-8c7d-64be52b09ad9 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:34:53.656825 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-df287fae-a821-4ac2-8c7d-64be52b09ad9 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:34:53.658186 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-df287fae-a821-4ac2-8c7d-64be52b09ad9 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:34:53.658665 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-df287fae-a821-4ac2-8c7d-64be52b09ad9 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:34:53.659109 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-df287fae-a821-4ac2-8c7d-64be52b09ad9 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:34:53.683259 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-df287fae-a821-4ac2-8c7d-64be52b09ad9 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: e597857c-9b3b-4406-83d7-395c5ad5912e] Going to try to terminate instance {{(pid=122698) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 05:34:53.967593 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-df287fae-a821-4ac2-8c7d-64be52b09ad9 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e" status: 204 len: 0 microversion: 2.1 time: 0.321432 Sep 23 05:34:53.968111 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3620/7419] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 05:34:53 2022] DELETE /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 23 05:34:53.976685 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2d74ebf8-86b0-4636-838d-c54bc5ba1e4f tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:34:53.977302 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-2d74ebf8-86b0-4636-838d-c54bc5ba1e4f tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: e597857c-9b3b-4406-83d7-395c5ad5912e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:34:53.983439 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2d74ebf8-86b0-4636-838d-c54bc5ba1e4f tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:34:53.983936 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2d74ebf8-86b0-4636-838d-c54bc5ba1e4f tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:34:53.984381 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2d74ebf8-86b0-4636-838d-c54bc5ba1e4f tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:34:53.985078 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2d74ebf8-86b0-4636-838d-c54bc5ba1e4f tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:34:53.985541 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2d74ebf8-86b0-4636-838d-c54bc5ba1e4f tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:34:53.985999 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2d74ebf8-86b0-4636-838d-c54bc5ba1e4f tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:34:54.125244 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2d74ebf8-86b0-4636-838d-c54bc5ba1e4f tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:34:54.134473 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2d74ebf8-86b0-4636-838d-c54bc5ba1e4f tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e" status: 200 len: 1677 microversion: 2.1 time: 0.161675 Sep 23 05:34:54.149926 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3800/7420] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:34:53 2022] GET /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e => generated 1677 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:34:55.160043 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4d082f71-154e-4ca5-b56d-60082fd10553 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:34:55.160842 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4d082f71-154e-4ca5-b56d-60082fd10553 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: e597857c-9b3b-4406-83d7-395c5ad5912e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:34:55.167930 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4d082f71-154e-4ca5-b56d-60082fd10553 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:34:55.168505 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4d082f71-154e-4ca5-b56d-60082fd10553 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:34:55.168966 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4d082f71-154e-4ca5-b56d-60082fd10553 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:34:55.169689 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4d082f71-154e-4ca5-b56d-60082fd10553 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:34:55.170203 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4d082f71-154e-4ca5-b56d-60082fd10553 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:34:55.170650 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4d082f71-154e-4ca5-b56d-60082fd10553 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:34:55.302066 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4d082f71-154e-4ca5-b56d-60082fd10553 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:34:55.310030 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4d082f71-154e-4ca5-b56d-60082fd10553 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e" status: 200 len: 1677 microversion: 2.1 time: 0.154915 Sep 23 05:34:55.310626 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3621/7421] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:34:55 2022] GET /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:34:56.115651 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-42dfcd32-60e1-4c11-9f3b-d981354f8180 req-2e1ff221-9973-4dd5-974c-bc75e5b8d93d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e597857c-9b3b-4406-83d7-395c5ad5912e", "name": "network-vif-deleted", "tag": "e5785a72-0c01-4a0e-959b-809f065d425b"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:34:56.125995 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-42dfcd32-60e1-4c11-9f3b-d981354f8180 req-2e1ff221-9973-4dd5-974c-bc75e5b8d93d service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:34:56.127025 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-42dfcd32-60e1-4c11-9f3b-d981354f8180 req-2e1ff221-9973-4dd5-974c-bc75e5b8d93d service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:34:56.127462 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-42dfcd32-60e1-4c11-9f3b-d981354f8180 req-2e1ff221-9973-4dd5-974c-bc75e5b8d93d service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:34:56.139212 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-42dfcd32-60e1-4c11-9f3b-d981354f8180 req-2e1ff221-9973-4dd5-974c-bc75e5b8d93d service nova] Creating event network-vif-deleted:e5785a72-0c01-4a0e-959b-809f065d425b for instance e597857c-9b3b-4406-83d7-395c5ad5912e on n-h2-846463-3 Sep 23 05:34:56.145087 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-42dfcd32-60e1-4c11-9f3b-d981354f8180 req-2e1ff221-9973-4dd5-974c-bc75e5b8d93d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033380 Sep 23 05:34:56.145711 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3801/7422] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:34:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:34:56.334323 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4b1bbd4f-7444-47eb-ba75-5367d69749e5 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:34:56.335748 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4b1bbd4f-7444-47eb-ba75-5367d69749e5 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: e597857c-9b3b-4406-83d7-395c5ad5912e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:34:56.338915 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=3 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:34:56.343377 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4b1bbd4f-7444-47eb-ba75-5367d69749e5 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:34:56.343883 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4b1bbd4f-7444-47eb-ba75-5367d69749e5 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:34:56.344340 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4b1bbd4f-7444-47eb-ba75-5367d69749e5 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:34:56.345168 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4b1bbd4f-7444-47eb-ba75-5367d69749e5 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:34:56.345645 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4b1bbd4f-7444-47eb-ba75-5367d69749e5 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:34:56.346123 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4b1bbd4f-7444-47eb-ba75-5367d69749e5 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:34:56.418488 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4b1bbd4f-7444-47eb-ba75-5367d69749e5 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:34:56.428539 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4b1bbd4f-7444-47eb-ba75-5367d69749e5 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e" status: 200 len: 1324 microversion: 2.1 time: 0.099031 Sep 23 05:34:56.429133 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3622/7423] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:34:56 2022] GET /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e => generated 1324 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:34:57.453049 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-965238bb-1ff7-410a-825a-4e402126a6d6 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:34:57.453679 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-965238bb-1ff7-410a-825a-4e402126a6d6 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: e597857c-9b3b-4406-83d7-395c5ad5912e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:34:57.460897 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-965238bb-1ff7-410a-825a-4e402126a6d6 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:34:57.461388 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-965238bb-1ff7-410a-825a-4e402126a6d6 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:34:57.461830 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-965238bb-1ff7-410a-825a-4e402126a6d6 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:34:57.462554 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-965238bb-1ff7-410a-825a-4e402126a6d6 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:34:57.463013 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-965238bb-1ff7-410a-825a-4e402126a6d6 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:34:57.463441 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-965238bb-1ff7-410a-825a-4e402126a6d6 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:34:57.477259 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-965238bb-1ff7-410a-825a-4e402126a6d6 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] HTTP exception thrown: Instance e597857c-9b3b-4406-83d7-395c5ad5912e could not be found. Sep 23 05:34:57.478908 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-965238bb-1ff7-410a-825a-4e402126a6d6 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Request method failure captured: Sep 23 05:34:57.478908 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e HTTP/1.1 Sep 23 05:34:57.478908 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 05:34:57.478908 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 05:34:57.478908 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 05:34:57.478908 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 05:34:57.478908 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 05:34:57.478908 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 05:34:57.478908 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 05:34:57.478908 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 05:34:57.478908 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLUSNPTcpFt7b1SQrBrdC4rAqFbUXLEG8j5xh3rTP1qyrEhV8SHPScnfZxRBpUy9MBZ19dFgqZBh9ggYKPA2VLn9rpizyOQlJ_nBmDT4jVqC1BV3Kf2f8DXLNaNiW44Z1VNZeBb_3I4dNJUWbXOX8beHhp39Bmiy2ImuZpbhlNdAaR6A Sep 23 05:34:57.478908 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 05:34:57.478908 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 05:34:57.478908 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 05:34:57.478908 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 05:34:57.478908 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 05:34:57.478908 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 05:34:57.478908 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: f991e11ed0c44131a4bd9be0110dffe0 Sep 23 05:34:57.478908 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ServerActionsTestJSON-551956227 Sep 23 05:34:57.478908 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 05:34:57.478908 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 05:34:57.478908 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f991e11ed0c44131a4bd9be0110dffe0", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f991e11ed0c44131a4bd9be0110dffe0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f991e11ed0c44131a4bd9be0110dffe0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f991e11ed0c44131a4bd9be0110dffe0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:34:57.478908 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ServerActionsTestJSON-551956227 Sep 23 05:34:57.478908 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: f991e11ed0c44131a4bd9be0110dffe0 Sep 23 05:34:57.478908 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ServerActionsTestJSON-551956227 Sep 23 05:34:57.478908 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ServerActionsTestJSON-551956227-project Sep 23 05:34:57.478908 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 05:34:57.478908 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 05:34:57.478908 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: f398aeafcbcb48d88d8cfd3bdf59bbed Sep 23 05:34:57.478908 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ServerActionsTestJSON-551956227-project Sep 23 05:34:57.478908 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 05:34:57.478908 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance e597857c-9b3b-4406-83d7-395c5ad5912e could not be found. Sep 23 05:34:57.478908 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': 'e597857c-9b3b-4406-83d7-395c5ad5912e'} Sep 23 05:34:57.478908 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:34:57.478908 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:34:57.478908 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 05:34:57.478908 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 05:34:57.478908 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 05:34:57.478908 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 05:34:57.478908 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 05:34:57.478908 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 05:34:57.478908 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 05:34:57.478908 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 05:34:57.478908 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e597857c-9b3b-4406-83d7-395c5ad5912e could not be found. Sep 23 05:34:57.478908 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:34:57.478908 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:34:57.478908 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:34:57.478908 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:34:57.478908 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:34:57.478908 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:34:57.478908 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:34:57.478908 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:34:57.478908 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:34:57.478908 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:34:57.478908 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 05:34:57.478908 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 05:34:57.478908 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 05:34:57.478908 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 05:34:57.478908 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 05:34:57.478908 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:34:57.478908 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e597857c-9b3b-4406-83d7-395c5ad5912e could not be found. Sep 23 05:34:57.478908 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:34:57.478908 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:34:57.478908 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:34:57.483704 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:34:57.483704 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:34:57.483704 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:34:57.483704 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:34:57.483704 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:34:57.483704 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e597857c-9b3b-4406-83d7-395c5ad5912e could not be found. Sep 23 05:34:57.483704 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:34:57.483704 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-965238bb-1ff7-410a-825a-4e402126a6d6 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Returning 404 to user: Instance e597857c-9b3b-4406-83d7-395c5ad5912e could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:34:57.483704 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-965238bb-1ff7-410a-825a-4e402126a6d6 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e" status: 404 len: 111 microversion: 2.1 time: 0.031675 Sep 23 05:34:57.483704 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3802/7424] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:34:57 2022] GET /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 05:34:57.498454 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-afaf314a-8486-4735-9459-670a118cc0a9 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:34:57.499092 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-afaf314a-8486-4735-9459-670a118cc0a9 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: e597857c-9b3b-4406-83d7-395c5ad5912e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:34:57.505960 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-afaf314a-8486-4735-9459-670a118cc0a9 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:34:57.506474 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-afaf314a-8486-4735-9459-670a118cc0a9 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:34:57.506930 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-afaf314a-8486-4735-9459-670a118cc0a9 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:34:57.507646 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-afaf314a-8486-4735-9459-670a118cc0a9 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:34:57.508122 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-afaf314a-8486-4735-9459-670a118cc0a9 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:34:57.508569 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-afaf314a-8486-4735-9459-670a118cc0a9 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:34:57.522752 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-afaf314a-8486-4735-9459-670a118cc0a9 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] HTTP exception thrown: Instance e597857c-9b3b-4406-83d7-395c5ad5912e could not be found. Sep 23 05:34:57.524434 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-afaf314a-8486-4735-9459-670a118cc0a9 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Request method failure captured: Sep 23 05:34:57.524434 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e HTTP/1.1 Sep 23 05:34:57.524434 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 05:34:57.524434 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 05:34:57.524434 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 05:34:57.524434 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 05:34:57.524434 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 05:34:57.524434 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 05:34:57.524434 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 05:34:57.524434 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 05:34:57.524434 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLUSNPTcpFt7b1SQrBrdC4rAqFbUXLEG8j5xh3rTP1qyrEhV8SHPScnfZxRBpUy9MBZ19dFgqZBh9ggYKPA2VLn9rpizyOQlJ_nBmDT4jVqC1BV3Kf2f8DXLNaNiW44Z1VNZeBb_3I4dNJUWbXOX8beHhp39Bmiy2ImuZpbhlNdAaR6A Sep 23 05:34:57.524434 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 05:34:57.524434 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 05:34:57.524434 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 05:34:57.524434 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 05:34:57.524434 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 05:34:57.524434 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 05:34:57.524434 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: f991e11ed0c44131a4bd9be0110dffe0 Sep 23 05:34:57.524434 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ServerActionsTestJSON-551956227 Sep 23 05:34:57.524434 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 05:34:57.524434 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 05:34:57.524434 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f991e11ed0c44131a4bd9be0110dffe0", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f991e11ed0c44131a4bd9be0110dffe0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f991e11ed0c44131a4bd9be0110dffe0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f991e11ed0c44131a4bd9be0110dffe0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:34:57.524434 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ServerActionsTestJSON-551956227 Sep 23 05:34:57.524434 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: f991e11ed0c44131a4bd9be0110dffe0 Sep 23 05:34:57.524434 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ServerActionsTestJSON-551956227 Sep 23 05:34:57.524434 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ServerActionsTestJSON-551956227-project Sep 23 05:34:57.524434 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 05:34:57.524434 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 05:34:57.524434 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: f398aeafcbcb48d88d8cfd3bdf59bbed Sep 23 05:34:57.524434 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ServerActionsTestJSON-551956227-project Sep 23 05:34:57.524434 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 05:34:57.524434 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance e597857c-9b3b-4406-83d7-395c5ad5912e could not be found. Sep 23 05:34:57.524434 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': 'e597857c-9b3b-4406-83d7-395c5ad5912e'} Sep 23 05:34:57.524434 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:34:57.524434 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:34:57.524434 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 05:34:57.524434 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 05:34:57.524434 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 05:34:57.524434 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 05:34:57.524434 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 05:34:57.524434 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 05:34:57.524434 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 05:34:57.524434 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 05:34:57.524434 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e597857c-9b3b-4406-83d7-395c5ad5912e could not be found. Sep 23 05:34:57.524434 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:34:57.524434 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:34:57.524434 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:34:57.524434 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:34:57.524434 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:34:57.524434 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:34:57.524434 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:34:57.524434 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:34:57.524434 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:34:57.524434 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:34:57.524434 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 05:34:57.524434 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 05:34:57.524434 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 05:34:57.524434 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 05:34:57.524434 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 05:34:57.524434 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:34:57.524434 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e597857c-9b3b-4406-83d7-395c5ad5912e could not be found. Sep 23 05:34:57.524434 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:34:57.524434 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:34:57.524434 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:34:57.529114 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:34:57.529114 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:34:57.529114 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:34:57.529114 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:34:57.529114 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:34:57.529114 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e597857c-9b3b-4406-83d7-395c5ad5912e could not be found. Sep 23 05:34:57.529114 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:34:57.529114 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-afaf314a-8486-4735-9459-670a118cc0a9 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Returning 404 to user: Instance e597857c-9b3b-4406-83d7-395c5ad5912e could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:34:57.529114 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-afaf314a-8486-4735-9459-670a118cc0a9 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e" status: 404 len: 111 microversion: 2.1 time: 0.031271 Sep 23 05:34:57.529114 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3623/7425] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:34:57 2022] GET /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 05:34:57.575672 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-65bf52b4-7e4e-4e8c-9ae3-1bb00d871021 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1056900796", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "networks": [{"uuid": "37e382a2-7105-4d7e-b7ef-1b58c783c9f2"}], "security_groups": [{"name": "tempest-securitygroup--381295551"}], "key_name": "tempest-keypair-2117157152", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:34:57.679443 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.neutron [None req-65bf52b4-7e4e-4e8c-9ae3-1bb00d871021 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] validate_networks() for [('37e382a2-7105-4d7e-b7ef-1b58c783c9f2', None, None, None, None, None)] {{(pid=122699) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 05:34:58.049756 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-65bf52b4-7e4e-4e8c-9ae3-1bb00d871021 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Flavor limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 05:34:58.050230 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-65bf52b4-7e4e-4e8c-9ae3-1bb00d871021 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Image limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 05:34:58.050710 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-65bf52b4-7e4e-4e8c-9ae3-1bb00d871021 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Flavor pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 05:34:58.051127 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-65bf52b4-7e4e-4e8c-9ae3-1bb00d871021 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Image pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 05:34:58.051549 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-65bf52b4-7e4e-4e8c-9ae3-1bb00d871021 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 05:34:58.060607 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-65bf52b4-7e4e-4e8c-9ae3-1bb00d871021 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:34:58.061101 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-65bf52b4-7e4e-4e8c-9ae3-1bb00d871021 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:34:58.061547 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-65bf52b4-7e4e-4e8c-9ae3-1bb00d871021 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:34:58.062313 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-65bf52b4-7e4e-4e8c-9ae3-1bb00d871021 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:34:58.062784 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-65bf52b4-7e4e-4e8c-9ae3-1bb00d871021 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:34:58.063217 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-65bf52b4-7e4e-4e8c-9ae3-1bb00d871021 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:34:58.080369 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-65bf52b4-7e4e-4e8c-9ae3-1bb00d871021 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Getting quotas for project f991e11ed0c44131a4bd9be0110dffe0. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 05:34:58.085859 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-65bf52b4-7e4e-4e8c-9ae3-1bb00d871021 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Getting quotas for user f398aeafcbcb48d88d8cfd3bdf59bbed and project f991e11ed0c44131a4bd9be0110dffe0. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 05:34:58.099115 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-65bf52b4-7e4e-4e8c-9ae3-1bb00d871021 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Going to run 1 instances... {{(pid=122699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 05:34:58.102462 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-65bf52b4-7e4e-4e8c-9ae3-1bb00d871021 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 95d38066-ca04-4351-abd6-28e65ff4d0b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 05:34:58.236928 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-65bf52b4-7e4e-4e8c-9ae3-1bb00d871021 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.665038 Sep 23 05:34:58.237585 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3803/7426] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 05:34:57 2022] POST /compute/v2.1/servers => generated 405 bytes in 666 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 05:34:58.249096 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f5e8006d-4a1a-4581-8bdb-6efc7b184faa tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:34:58.249950 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f5e8006d-4a1a-4581-8bdb-6efc7b184faa tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 95d38066-ca04-4351-abd6-28e65ff4d0b7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:34:58.308048 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f5e8006d-4a1a-4581-8bdb-6efc7b184faa tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:34:58.315935 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f5e8006d-4a1a-4581-8bdb-6efc7b184faa tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7" status: 200 len: 1239 microversion: 2.1 time: 0.070785 Sep 23 05:34:58.316514 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3624/7427] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:34:58 2022] GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7 => generated 1239 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:34:59.341362 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d28bd254-f2cc-4e9c-bf62-1599b12bde31 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:34:59.342154 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d28bd254-f2cc-4e9c-bf62-1599b12bde31 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 95d38066-ca04-4351-abd6-28e65ff4d0b7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:34:59.349593 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d28bd254-f2cc-4e9c-bf62-1599b12bde31 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:34:59.350144 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d28bd254-f2cc-4e9c-bf62-1599b12bde31 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:34:59.350593 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d28bd254-f2cc-4e9c-bf62-1599b12bde31 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:34:59.351298 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d28bd254-f2cc-4e9c-bf62-1599b12bde31 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:34:59.351771 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d28bd254-f2cc-4e9c-bf62-1599b12bde31 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:34:59.352237 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d28bd254-f2cc-4e9c-bf62-1599b12bde31 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:34:59.418463 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d28bd254-f2cc-4e9c-bf62-1599b12bde31 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:34:59.427577 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d28bd254-f2cc-4e9c-bf62-1599b12bde31 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7" status: 200 len: 1243 microversion: 2.1 time: 0.090771 Sep 23 05:34:59.428785 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3804/7428] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:34:59 2022] GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7 => generated 1243 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:35:00.451413 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-fe5aa19f-cd7b-422b-917d-1050974ec6b7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:35:00.452048 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-fe5aa19f-cd7b-422b-917d-1050974ec6b7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 95d38066-ca04-4351-abd6-28e65ff4d0b7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:35:00.459014 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fe5aa19f-cd7b-422b-917d-1050974ec6b7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:35:00.459534 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fe5aa19f-cd7b-422b-917d-1050974ec6b7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:35:00.460000 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fe5aa19f-cd7b-422b-917d-1050974ec6b7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:35:00.460726 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fe5aa19f-cd7b-422b-917d-1050974ec6b7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:35:00.461214 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fe5aa19f-cd7b-422b-917d-1050974ec6b7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:35:00.461665 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fe5aa19f-cd7b-422b-917d-1050974ec6b7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:35:00.525012 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-fe5aa19f-cd7b-422b-917d-1050974ec6b7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:35:00.533377 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-fe5aa19f-cd7b-422b-917d-1050974ec6b7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7" status: 200 len: 1309 microversion: 2.1 time: 0.086159 Sep 23 05:35:00.541269 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3625/7429] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:35:00 2022] GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7 => generated 1309 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:35:01.557767 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-899c13ec-a05d-49a7-afa7-ed6673b7b320 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:35:01.558632 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-899c13ec-a05d-49a7-afa7-ed6673b7b320 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 95d38066-ca04-4351-abd6-28e65ff4d0b7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:35:01.565220 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-899c13ec-a05d-49a7-afa7-ed6673b7b320 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:35:01.565710 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-899c13ec-a05d-49a7-afa7-ed6673b7b320 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:35:01.566193 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-899c13ec-a05d-49a7-afa7-ed6673b7b320 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:35:01.566902 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-899c13ec-a05d-49a7-afa7-ed6673b7b320 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:35:01.567366 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-899c13ec-a05d-49a7-afa7-ed6673b7b320 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:35:01.567795 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-899c13ec-a05d-49a7-afa7-ed6673b7b320 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:35:01.702166 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-899c13ec-a05d-49a7-afa7-ed6673b7b320 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:35:01.711305 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-899c13ec-a05d-49a7-afa7-ed6673b7b320 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7" status: 200 len: 1364 microversion: 2.1 time: 0.157484 Sep 23 05:35:01.711921 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3805/7430] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:35:01 2022] GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7 => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:35:01.925770 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-bae4de2b-c665-4361-871b-2ccbc7a34ee3 req-88faa8d9-5528-4a6c-a503-3600ba704c64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95d38066-ca04-4351-abd6-28e65ff4d0b7", "tag": "106907e5-bf3f-4a30-badd-9d493457de51"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:35:01.936734 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-bae4de2b-c665-4361-871b-2ccbc7a34ee3 req-88faa8d9-5528-4a6c-a503-3600ba704c64 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:35:01.937245 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-bae4de2b-c665-4361-871b-2ccbc7a34ee3 req-88faa8d9-5528-4a6c-a503-3600ba704c64 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:35:01.937700 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-bae4de2b-c665-4361-871b-2ccbc7a34ee3 req-88faa8d9-5528-4a6c-a503-3600ba704c64 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:35:01.949426 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-bae4de2b-c665-4361-871b-2ccbc7a34ee3 req-88faa8d9-5528-4a6c-a503-3600ba704c64 service nova] Creating event network-changed:106907e5-bf3f-4a30-badd-9d493457de51 for instance 95d38066-ca04-4351-abd6-28e65ff4d0b7 on n-h2-846463-3 Sep 23 05:35:01.956436 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-bae4de2b-c665-4361-871b-2ccbc7a34ee3 req-88faa8d9-5528-4a6c-a503-3600ba704c64 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034643 Sep 23 05:35:01.957384 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3626/7431] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:35:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:35:02.735877 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9d925b12-905a-4bad-b402-f41a836d3027 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:35:02.736488 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-9d925b12-905a-4bad-b402-f41a836d3027 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 95d38066-ca04-4351-abd6-28e65ff4d0b7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:35:02.742954 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9d925b12-905a-4bad-b402-f41a836d3027 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:35:02.743438 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9d925b12-905a-4bad-b402-f41a836d3027 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:35:02.743874 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9d925b12-905a-4bad-b402-f41a836d3027 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:35:02.744559 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9d925b12-905a-4bad-b402-f41a836d3027 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:35:02.745010 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9d925b12-905a-4bad-b402-f41a836d3027 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:35:02.745432 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9d925b12-905a-4bad-b402-f41a836d3027 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:35:02.872289 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-9d925b12-905a-4bad-b402-f41a836d3027 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:35:02.880254 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-9d925b12-905a-4bad-b402-f41a836d3027 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7" status: 200 len: 1364 microversion: 2.1 time: 0.148746 Sep 23 05:35:02.880825 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3806/7432] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:35:02 2022] GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7 => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:35:03.904788 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c004e4f4-45b2-4db6-9619-c08c89053eda tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:35:03.912018 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c004e4f4-45b2-4db6-9619-c08c89053eda tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 95d38066-ca04-4351-abd6-28e65ff4d0b7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:35:03.912018 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c004e4f4-45b2-4db6-9619-c08c89053eda tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:35:03.912543 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c004e4f4-45b2-4db6-9619-c08c89053eda tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:35:03.913006 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c004e4f4-45b2-4db6-9619-c08c89053eda tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:35:03.913728 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c004e4f4-45b2-4db6-9619-c08c89053eda tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:35:03.914254 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c004e4f4-45b2-4db6-9619-c08c89053eda tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:35:03.914707 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c004e4f4-45b2-4db6-9619-c08c89053eda tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:35:04.048787 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c004e4f4-45b2-4db6-9619-c08c89053eda tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:35:04.056502 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c004e4f4-45b2-4db6-9619-c08c89053eda tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7" status: 200 len: 1364 microversion: 2.1 time: 0.156977 Sep 23 05:35:04.057076 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3627/7433] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:35:03 2022] GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7 => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:35:05.081643 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1e137ef1-f471-4cfa-b3fb-ec3f685101c8 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:35:05.082325 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1e137ef1-f471-4cfa-b3fb-ec3f685101c8 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 95d38066-ca04-4351-abd6-28e65ff4d0b7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:35:05.088455 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e137ef1-f471-4cfa-b3fb-ec3f685101c8 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:35:05.088941 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e137ef1-f471-4cfa-b3fb-ec3f685101c8 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:35:05.089378 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e137ef1-f471-4cfa-b3fb-ec3f685101c8 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:35:05.090122 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e137ef1-f471-4cfa-b3fb-ec3f685101c8 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:35:05.090579 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e137ef1-f471-4cfa-b3fb-ec3f685101c8 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:35:05.091001 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e137ef1-f471-4cfa-b3fb-ec3f685101c8 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:35:05.220130 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1e137ef1-f471-4cfa-b3fb-ec3f685101c8 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:35:05.227802 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1e137ef1-f471-4cfa-b3fb-ec3f685101c8 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7" status: 200 len: 1364 microversion: 2.1 time: 0.150666 Sep 23 05:35:05.228376 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3807/7434] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:35:05 2022] GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7 => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:35:06.251290 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-afe0366a-64d1-4797-9e51-e20c68a68a51 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:35:06.252041 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-afe0366a-64d1-4797-9e51-e20c68a68a51 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 95d38066-ca04-4351-abd6-28e65ff4d0b7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:35:06.259121 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-afe0366a-64d1-4797-9e51-e20c68a68a51 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:35:06.259670 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-afe0366a-64d1-4797-9e51-e20c68a68a51 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:35:06.260129 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-afe0366a-64d1-4797-9e51-e20c68a68a51 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:35:06.260853 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-afe0366a-64d1-4797-9e51-e20c68a68a51 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:35:06.261362 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-afe0366a-64d1-4797-9e51-e20c68a68a51 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:35:06.261813 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-afe0366a-64d1-4797-9e51-e20c68a68a51 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:35:06.290868 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-a5f09f03-ac3f-4248-8451-abe1e7393a02 req-f78f0ed4-7e3b-4347-a4cc-d3620dfa1475 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95d38066-ca04-4351-abd6-28e65ff4d0b7", "name": "network-vif-plugged", "status": "completed", "tag": "106907e5-bf3f-4a30-badd-9d493457de51"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:35:06.301425 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-a5f09f03-ac3f-4248-8451-abe1e7393a02 req-f78f0ed4-7e3b-4347-a4cc-d3620dfa1475 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:35:06.301986 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-a5f09f03-ac3f-4248-8451-abe1e7393a02 req-f78f0ed4-7e3b-4347-a4cc-d3620dfa1475 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:35:06.302426 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-a5f09f03-ac3f-4248-8451-abe1e7393a02 req-f78f0ed4-7e3b-4347-a4cc-d3620dfa1475 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:35:06.314089 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-a5f09f03-ac3f-4248-8451-abe1e7393a02 req-f78f0ed4-7e3b-4347-a4cc-d3620dfa1475 service nova] Creating event network-vif-plugged:106907e5-bf3f-4a30-badd-9d493457de51 for instance 95d38066-ca04-4351-abd6-28e65ff4d0b7 on n-h2-846463-3 Sep 23 05:35:06.319223 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-a5f09f03-ac3f-4248-8451-abe1e7393a02 req-f78f0ed4-7e3b-4347-a4cc-d3620dfa1475 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032288 Sep 23 05:35:06.320192 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3808/7435] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:35:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 05:35:06.405135 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-afe0366a-64d1-4797-9e51-e20c68a68a51 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:35:06.414354 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-afe0366a-64d1-4797-9e51-e20c68a68a51 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7" status: 200 len: 1364 microversion: 2.1 time: 0.166917 Sep 23 05:35:06.415586 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3628/7436] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:35:06 2022] GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7 => generated 1364 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:35:07.438942 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3d609a6c-4486-4213-a8cb-3fa2df34c8d6 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:35:07.439655 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-3d609a6c-4486-4213-a8cb-3fa2df34c8d6 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 95d38066-ca04-4351-abd6-28e65ff4d0b7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:35:07.446566 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3d609a6c-4486-4213-a8cb-3fa2df34c8d6 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:35:07.450413 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3d609a6c-4486-4213-a8cb-3fa2df34c8d6 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:35:07.450413 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3d609a6c-4486-4213-a8cb-3fa2df34c8d6 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:35:07.450413 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3d609a6c-4486-4213-a8cb-3fa2df34c8d6 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:35:07.450413 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3d609a6c-4486-4213-a8cb-3fa2df34c8d6 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:35:07.450413 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3d609a6c-4486-4213-a8cb-3fa2df34c8d6 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:35:07.583773 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-3d609a6c-4486-4213-a8cb-3fa2df34c8d6 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:35:07.591636 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3d609a6c-4486-4213-a8cb-3fa2df34c8d6 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7" status: 200 len: 1364 microversion: 2.1 time: 0.156929 Sep 23 05:35:07.592210 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3809/7437] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:35:07 2022] GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7 => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:35:08.616434 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-115134a8-c6ff-4b21-8137-e6c694632334 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:35:08.617066 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-115134a8-c6ff-4b21-8137-e6c694632334 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 95d38066-ca04-4351-abd6-28e65ff4d0b7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:35:08.619922 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:35:08.624846 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-115134a8-c6ff-4b21-8137-e6c694632334 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:35:08.630097 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-115134a8-c6ff-4b21-8137-e6c694632334 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:35:08.630097 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-115134a8-c6ff-4b21-8137-e6c694632334 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:35:08.630097 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-115134a8-c6ff-4b21-8137-e6c694632334 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:35:08.630097 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-115134a8-c6ff-4b21-8137-e6c694632334 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:35:08.630097 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-115134a8-c6ff-4b21-8137-e6c694632334 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:35:08.755743 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-115134a8-c6ff-4b21-8137-e6c694632334 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:35:08.763698 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-115134a8-c6ff-4b21-8137-e6c694632334 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7" status: 200 len: 1552 microversion: 2.1 time: 0.151212 Sep 23 05:35:08.764273 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3629/7438] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:35:08 2022] GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7 => generated 1552 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:35:08.786526 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0dca475c-c7df-4f6e-9d3b-29d6128c63ef tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:35:08.787024 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-0dca475c-c7df-4f6e-9d3b-29d6128c63ef tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 95d38066-ca04-4351-abd6-28e65ff4d0b7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:35:08.788986 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:35:08.789812 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=6 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:35:08.794912 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0dca475c-c7df-4f6e-9d3b-29d6128c63ef tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:35:08.802012 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0dca475c-c7df-4f6e-9d3b-29d6128c63ef tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:35:08.802012 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0dca475c-c7df-4f6e-9d3b-29d6128c63ef tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:35:08.802012 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0dca475c-c7df-4f6e-9d3b-29d6128c63ef tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:35:08.802012 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0dca475c-c7df-4f6e-9d3b-29d6128c63ef tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:35:08.802012 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0dca475c-c7df-4f6e-9d3b-29d6128c63ef tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:35:08.876479 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0dca475c-c7df-4f6e-9d3b-29d6128c63ef tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091624 Sep 23 05:35:08.876479 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3810/7439] 10.222.0.33 () {58 vars in 1275 bytes} [Fri Sep 23 05:35:08 2022] GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:35:09.879216 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-7af297a5-5abd-4113-bc01-1437577a1aed req-4ed72b52-9f29-47dc-8ed3-bdd92dfbb431 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95d38066-ca04-4351-abd6-28e65ff4d0b7", "tag": "106907e5-bf3f-4a30-badd-9d493457de51"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:35:09.889707 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-7af297a5-5abd-4113-bc01-1437577a1aed req-4ed72b52-9f29-47dc-8ed3-bdd92dfbb431 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:35:09.890663 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-7af297a5-5abd-4113-bc01-1437577a1aed req-4ed72b52-9f29-47dc-8ed3-bdd92dfbb431 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:35:09.891128 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-7af297a5-5abd-4113-bc01-1437577a1aed req-4ed72b52-9f29-47dc-8ed3-bdd92dfbb431 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:35:09.903099 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-7af297a5-5abd-4113-bc01-1437577a1aed req-4ed72b52-9f29-47dc-8ed3-bdd92dfbb431 service nova] Creating event network-changed:106907e5-bf3f-4a30-badd-9d493457de51 for instance 95d38066-ca04-4351-abd6-28e65ff4d0b7 on n-h2-846463-3 Sep 23 05:35:09.908406 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-7af297a5-5abd-4113-bc01-1437577a1aed req-4ed72b52-9f29-47dc-8ed3-bdd92dfbb431 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033650 Sep 23 05:35:09.909344 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3630/7440] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:35:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:35:45.545335 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:35:45.546187 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=68 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:35:45.551673 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d62d926a-c7d9-4391-bff5-410dfe29420e tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:35:45.552804 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d62d926a-c7d9-4391-bff5-410dfe29420e tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 95d38066-ca04-4351-abd6-28e65ff4d0b7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:35:45.559160 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d62d926a-c7d9-4391-bff5-410dfe29420e tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:35:45.563649 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d62d926a-c7d9-4391-bff5-410dfe29420e tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:35:45.563649 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d62d926a-c7d9-4391-bff5-410dfe29420e tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:35:45.563649 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d62d926a-c7d9-4391-bff5-410dfe29420e tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:35:45.563649 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d62d926a-c7d9-4391-bff5-410dfe29420e tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:35:45.563649 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d62d926a-c7d9-4391-bff5-410dfe29420e tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:35:45.699045 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d62d926a-c7d9-4391-bff5-410dfe29420e tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:35:45.707401 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d62d926a-c7d9-4391-bff5-410dfe29420e tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7" status: 200 len: 1671 microversion: 2.1 time: 0.163475 Sep 23 05:35:45.707965 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3811/7441] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:35:45 2022] GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7 => generated 1671 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:35:45.729031 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:35:45.729798 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:35:45.734051 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2c97db24-2371-47ed-a81e-e153b751cbf7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0125b4bf-45ad-4204-a760-2d4040ffbb50"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:35:45.736530 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-2c97db24-2371-47ed-a81e-e153b751cbf7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 95d38066-ca04-4351-abd6-28e65ff4d0b7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:35:45.742474 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2c97db24-2371-47ed-a81e-e153b751cbf7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:35:45.742973 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2c97db24-2371-47ed-a81e-e153b751cbf7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:35:45.743419 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2c97db24-2371-47ed-a81e-e153b751cbf7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:35:45.744120 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2c97db24-2371-47ed-a81e-e153b751cbf7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:35:45.744589 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2c97db24-2371-47ed-a81e-e153b751cbf7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:35:45.745027 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2c97db24-2371-47ed-a81e-e153b751cbf7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:35:46.426627 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2c97db24-2371-47ed-a81e-e153b751cbf7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "POST /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.699508 Sep 23 05:35:46.427249 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3631/7442] 10.222.0.33 () {60 vars in 1323 bytes} [Fri Sep 23 05:35:45 2022] POST /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7/os-volume_attachments => generated 194 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:35:58.358820 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c86ab4c2-b2f3-429e-b0b4-ca30627adfbf tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:35:58.361094 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c86ab4c2-b2f3-429e-b0b4-ca30627adfbf tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 95d38066-ca04-4351-abd6-28e65ff4d0b7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:35:58.363541 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:35:58.364368 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=6 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:35:58.368863 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c86ab4c2-b2f3-429e-b0b4-ca30627adfbf tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:35:58.369396 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c86ab4c2-b2f3-429e-b0b4-ca30627adfbf tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:35:58.369841 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c86ab4c2-b2f3-429e-b0b4-ca30627adfbf tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:35:58.374869 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c86ab4c2-b2f3-429e-b0b4-ca30627adfbf tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:35:58.374869 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c86ab4c2-b2f3-429e-b0b4-ca30627adfbf tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:35:58.374869 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c86ab4c2-b2f3-429e-b0b4-ca30627adfbf tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:35:58.663564 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c86ab4c2-b2f3-429e-b0b4-ca30627adfbf tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:35:58.669368 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c86ab4c2-b2f3-429e-b0b4-ca30627adfbf tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 95d38066-ca04-4351-abd6-28e65ff4d0b7] Old instance type m1.heat2, new instance type m1.heat {{(pid=122699) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 23 05:35:58.677297 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-c86ab4c2-b2f3-429e-b0b4-ca30627adfbf tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Flavor limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 05:35:58.677727 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-c86ab4c2-b2f3-429e-b0b4-ca30627adfbf tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Image limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 05:35:58.678240 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-c86ab4c2-b2f3-429e-b0b4-ca30627adfbf tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Flavor pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 05:35:58.678665 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-c86ab4c2-b2f3-429e-b0b4-ca30627adfbf tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Image pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 05:35:58.679088 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-c86ab4c2-b2f3-429e-b0b4-ca30627adfbf tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 05:35:58.938452 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c86ab4c2-b2f3-429e-b0b4-ca30627adfbf tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "POST /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7/action" status: 202 len: 0 microversion: 2.1 time: 0.583299 Sep 23 05:35:58.939005 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3812/7443] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 05:35:58 2022] POST /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7/action => generated 0 bytes in 585 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 05:35:58.945395 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:35:58.946275 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:35:58.950481 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1ce74442-8c85-4943-96c6-51b1c4d6408d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:35:58.951130 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-1ce74442-8c85-4943-96c6-51b1c4d6408d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 95d38066-ca04-4351-abd6-28e65ff4d0b7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:35:58.958086 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1ce74442-8c85-4943-96c6-51b1c4d6408d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:35:58.958609 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1ce74442-8c85-4943-96c6-51b1c4d6408d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:35:58.959073 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1ce74442-8c85-4943-96c6-51b1c4d6408d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:35:58.959800 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1ce74442-8c85-4943-96c6-51b1c4d6408d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:35:58.960284 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1ce74442-8c85-4943-96c6-51b1c4d6408d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:35:58.960733 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1ce74442-8c85-4943-96c6-51b1c4d6408d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:35:59.092925 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-1ce74442-8c85-4943-96c6-51b1c4d6408d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:35:59.101194 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-1ce74442-8c85-4943-96c6-51b1c4d6408d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7" status: 200 len: 1726 microversion: 2.1 time: 0.157686 Sep 23 05:35:59.101750 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3632/7444] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:35:58 2022] GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7 => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:36:00.125677 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-93b7d5e3-fda3-4460-ae90-29b0397430dd tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:36:00.126328 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-93b7d5e3-fda3-4460-ae90-29b0397430dd tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 95d38066-ca04-4351-abd6-28e65ff4d0b7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:36:00.134947 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-93b7d5e3-fda3-4460-ae90-29b0397430dd tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:00.135449 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-93b7d5e3-fda3-4460-ae90-29b0397430dd tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:00.135899 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-93b7d5e3-fda3-4460-ae90-29b0397430dd tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:00.136605 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-93b7d5e3-fda3-4460-ae90-29b0397430dd tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:00.137074 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-93b7d5e3-fda3-4460-ae90-29b0397430dd tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:00.137509 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-93b7d5e3-fda3-4460-ae90-29b0397430dd tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:00.282967 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-93b7d5e3-fda3-4460-ae90-29b0397430dd tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:36:00.291296 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-93b7d5e3-fda3-4460-ae90-29b0397430dd tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7" status: 200 len: 1726 microversion: 2.1 time: 0.170647 Sep 23 05:36:00.291851 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3813/7445] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:36:00 2022] GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7 => generated 1726 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:36:01.316393 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4d995071-d8c5-4b08-8c63-8c1a7123e896 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:36:01.317027 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4d995071-d8c5-4b08-8c63-8c1a7123e896 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 95d38066-ca04-4351-abd6-28e65ff4d0b7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:36:01.319803 n-d-846463-3 devstack@n-api.service[122698]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 05:36:01.319976 n-d-846463-3 devstack@n-api.service[122698]: Fri Sep 23 05:36:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7 (ip 10.222.0.33) !!! Sep 23 05:36:01.329053 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4d995071-d8c5-4b08-8c63-8c1a7123e896 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:01.329565 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4d995071-d8c5-4b08-8c63-8c1a7123e896 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:01.330059 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4d995071-d8c5-4b08-8c63-8c1a7123e896 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:01.330804 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4d995071-d8c5-4b08-8c63-8c1a7123e896 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:01.331284 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4d995071-d8c5-4b08-8c63-8c1a7123e896 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:01.332389 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4d995071-d8c5-4b08-8c63-8c1a7123e896 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:01.477167 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4d995071-d8c5-4b08-8c63-8c1a7123e896 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:36:01.486824 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4d995071-d8c5-4b08-8c63-8c1a7123e896 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7" status: 200 len: 1726 microversion: 2.1 time: 0.175133 Sep 23 05:36:01.487453 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3633/7446] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:36:01 2022] GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7 => generated 1726 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:36:02.511903 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b513561e-45a5-4ab8-964d-86d60137eced tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:36:02.512428 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b513561e-45a5-4ab8-964d-86d60137eced tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 95d38066-ca04-4351-abd6-28e65ff4d0b7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:36:02.519831 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b513561e-45a5-4ab8-964d-86d60137eced tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:02.520325 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b513561e-45a5-4ab8-964d-86d60137eced tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:02.520772 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b513561e-45a5-4ab8-964d-86d60137eced tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:02.521471 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b513561e-45a5-4ab8-964d-86d60137eced tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:02.521959 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b513561e-45a5-4ab8-964d-86d60137eced tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:02.522394 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b513561e-45a5-4ab8-964d-86d60137eced tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:02.653435 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b513561e-45a5-4ab8-964d-86d60137eced tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:36:02.662449 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b513561e-45a5-4ab8-964d-86d60137eced tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7" status: 200 len: 1731 microversion: 2.1 time: 0.154600 Sep 23 05:36:02.663015 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3814/7447] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:36:02 2022] GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7 => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:36:03.685459 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c4a3d0dc-d7ad-4e8c-8df6-6d15fb19c8f9 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:36:03.686128 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c4a3d0dc-d7ad-4e8c-8df6-6d15fb19c8f9 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 95d38066-ca04-4351-abd6-28e65ff4d0b7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:36:03.693005 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c4a3d0dc-d7ad-4e8c-8df6-6d15fb19c8f9 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:03.693520 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c4a3d0dc-d7ad-4e8c-8df6-6d15fb19c8f9 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:03.694001 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c4a3d0dc-d7ad-4e8c-8df6-6d15fb19c8f9 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:03.694750 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c4a3d0dc-d7ad-4e8c-8df6-6d15fb19c8f9 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:03.695234 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c4a3d0dc-d7ad-4e8c-8df6-6d15fb19c8f9 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:03.695677 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c4a3d0dc-d7ad-4e8c-8df6-6d15fb19c8f9 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:03.823421 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c4a3d0dc-d7ad-4e8c-8df6-6d15fb19c8f9 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:36:03.831732 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c4a3d0dc-d7ad-4e8c-8df6-6d15fb19c8f9 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7" status: 200 len: 1731 microversion: 2.1 time: 0.150302 Sep 23 05:36:03.832310 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3634/7448] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:36:03 2022] GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7 => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:36:04.854576 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1d604256-5b41-459b-bb8b-8148a43a99fb tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:36:04.855227 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1d604256-5b41-459b-bb8b-8148a43a99fb tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 95d38066-ca04-4351-abd6-28e65ff4d0b7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:36:04.861754 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1d604256-5b41-459b-bb8b-8148a43a99fb tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:04.862279 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1d604256-5b41-459b-bb8b-8148a43a99fb tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:04.862728 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1d604256-5b41-459b-bb8b-8148a43a99fb tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:04.863432 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1d604256-5b41-459b-bb8b-8148a43a99fb tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:04.863894 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1d604256-5b41-459b-bb8b-8148a43a99fb tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:04.864327 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1d604256-5b41-459b-bb8b-8148a43a99fb tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:04.992839 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1d604256-5b41-459b-bb8b-8148a43a99fb tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:36:05.001879 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1d604256-5b41-459b-bb8b-8148a43a99fb tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7" status: 200 len: 1731 microversion: 2.1 time: 0.151280 Sep 23 05:36:05.002476 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3815/7449] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:36:04 2022] GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7 => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:36:06.026283 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d1cec481-d70e-4d8f-bd0b-fb1aaad68aa1 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:36:06.027097 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d1cec481-d70e-4d8f-bd0b-fb1aaad68aa1 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 95d38066-ca04-4351-abd6-28e65ff4d0b7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:36:06.034968 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d1cec481-d70e-4d8f-bd0b-fb1aaad68aa1 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:06.035482 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d1cec481-d70e-4d8f-bd0b-fb1aaad68aa1 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:06.035944 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d1cec481-d70e-4d8f-bd0b-fb1aaad68aa1 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:06.036659 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d1cec481-d70e-4d8f-bd0b-fb1aaad68aa1 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:06.037266 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d1cec481-d70e-4d8f-bd0b-fb1aaad68aa1 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:06.037713 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d1cec481-d70e-4d8f-bd0b-fb1aaad68aa1 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:06.169635 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d1cec481-d70e-4d8f-bd0b-fb1aaad68aa1 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:36:06.178151 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d1cec481-d70e-4d8f-bd0b-fb1aaad68aa1 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7" status: 200 len: 1731 microversion: 2.1 time: 0.155778 Sep 23 05:36:06.178736 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3635/7450] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:36:06 2022] GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:36:07.201299 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9afc4fbc-6d23-4f90-9d0a-67e030a0367a tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:36:07.201932 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-9afc4fbc-6d23-4f90-9d0a-67e030a0367a tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 95d38066-ca04-4351-abd6-28e65ff4d0b7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:36:07.208868 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9afc4fbc-6d23-4f90-9d0a-67e030a0367a tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:07.209360 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9afc4fbc-6d23-4f90-9d0a-67e030a0367a tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:07.209796 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9afc4fbc-6d23-4f90-9d0a-67e030a0367a tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:07.210527 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9afc4fbc-6d23-4f90-9d0a-67e030a0367a tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:07.210983 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9afc4fbc-6d23-4f90-9d0a-67e030a0367a tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:07.211408 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9afc4fbc-6d23-4f90-9d0a-67e030a0367a tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:07.339768 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-9afc4fbc-6d23-4f90-9d0a-67e030a0367a tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:36:07.348519 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-9afc4fbc-6d23-4f90-9d0a-67e030a0367a tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7" status: 200 len: 1731 microversion: 2.1 time: 0.151117 Sep 23 05:36:07.349084 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3816/7451] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:36:07 2022] GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7 => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:36:08.373517 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ba5ec301-677b-4448-96d2-d7c0e83df4df tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:36:08.374202 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-ba5ec301-677b-4448-96d2-d7c0e83df4df tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 95d38066-ca04-4351-abd6-28e65ff4d0b7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:36:08.381385 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ba5ec301-677b-4448-96d2-d7c0e83df4df tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:08.381909 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ba5ec301-677b-4448-96d2-d7c0e83df4df tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:08.382389 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ba5ec301-677b-4448-96d2-d7c0e83df4df tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:08.383139 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ba5ec301-677b-4448-96d2-d7c0e83df4df tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:08.383622 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ba5ec301-677b-4448-96d2-d7c0e83df4df tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:08.384072 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ba5ec301-677b-4448-96d2-d7c0e83df4df tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:08.514627 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ba5ec301-677b-4448-96d2-d7c0e83df4df tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:36:08.523846 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ba5ec301-677b-4448-96d2-d7c0e83df4df tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7" status: 200 len: 1731 microversion: 2.1 time: 0.154346 Sep 23 05:36:08.524428 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3636/7452] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:36:08 2022] GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7 => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:36:09.548074 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-16222980-9b72-4329-a79c-ad6524e10a4a tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:36:09.548718 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-16222980-9b72-4329-a79c-ad6524e10a4a tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 95d38066-ca04-4351-abd6-28e65ff4d0b7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:36:09.555453 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-16222980-9b72-4329-a79c-ad6524e10a4a tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:09.555947 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-16222980-9b72-4329-a79c-ad6524e10a4a tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:09.556393 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-16222980-9b72-4329-a79c-ad6524e10a4a tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:09.557090 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-16222980-9b72-4329-a79c-ad6524e10a4a tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:09.557553 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-16222980-9b72-4329-a79c-ad6524e10a4a tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:09.558014 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-16222980-9b72-4329-a79c-ad6524e10a4a tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:09.692922 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-16222980-9b72-4329-a79c-ad6524e10a4a tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:36:09.701314 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-16222980-9b72-4329-a79c-ad6524e10a4a tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7" status: 200 len: 1731 microversion: 2.1 time: 0.157301 Sep 23 05:36:09.701921 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3817/7453] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:36:09 2022] GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7 => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:36:10.725911 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ffdf5645-3e09-450f-82e2-ec61828c5753 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:36:10.726549 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-ffdf5645-3e09-450f-82e2-ec61828c5753 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 95d38066-ca04-4351-abd6-28e65ff4d0b7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:36:10.733702 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ffdf5645-3e09-450f-82e2-ec61828c5753 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:10.734245 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ffdf5645-3e09-450f-82e2-ec61828c5753 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:10.734767 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ffdf5645-3e09-450f-82e2-ec61828c5753 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:10.735496 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ffdf5645-3e09-450f-82e2-ec61828c5753 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:10.735974 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ffdf5645-3e09-450f-82e2-ec61828c5753 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:10.736419 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ffdf5645-3e09-450f-82e2-ec61828c5753 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:10.865664 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ffdf5645-3e09-450f-82e2-ec61828c5753 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:36:10.874129 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ffdf5645-3e09-450f-82e2-ec61828c5753 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7" status: 200 len: 1731 microversion: 2.1 time: 0.152155 Sep 23 05:36:10.874707 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3637/7454] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:36:10 2022] GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7 => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:36:11.896966 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-297badbb-d4a2-44e3-912f-3baa4e3d27e9 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:36:11.897572 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-297badbb-d4a2-44e3-912f-3baa4e3d27e9 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 95d38066-ca04-4351-abd6-28e65ff4d0b7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:36:11.903931 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-297badbb-d4a2-44e3-912f-3baa4e3d27e9 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:11.904419 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-297badbb-d4a2-44e3-912f-3baa4e3d27e9 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:11.904857 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-297badbb-d4a2-44e3-912f-3baa4e3d27e9 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:11.905551 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-297badbb-d4a2-44e3-912f-3baa4e3d27e9 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:11.906033 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-297badbb-d4a2-44e3-912f-3baa4e3d27e9 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:11.906997 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-297badbb-d4a2-44e3-912f-3baa4e3d27e9 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:12.038595 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-297badbb-d4a2-44e3-912f-3baa4e3d27e9 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:36:12.047719 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-297badbb-d4a2-44e3-912f-3baa4e3d27e9 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7" status: 200 len: 1731 microversion: 2.1 time: 0.154051 Sep 23 05:36:12.048384 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3818/7455] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:36:11 2022] GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7 => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:36:13.070866 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-91f3fc4c-f9ab-40c8-bd70-6b506cd18112 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:36:13.071480 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-91f3fc4c-f9ab-40c8-bd70-6b506cd18112 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 95d38066-ca04-4351-abd6-28e65ff4d0b7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:36:13.078426 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-91f3fc4c-f9ab-40c8-bd70-6b506cd18112 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:13.078937 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-91f3fc4c-f9ab-40c8-bd70-6b506cd18112 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:13.079394 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-91f3fc4c-f9ab-40c8-bd70-6b506cd18112 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:13.080104 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-91f3fc4c-f9ab-40c8-bd70-6b506cd18112 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:13.080583 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-91f3fc4c-f9ab-40c8-bd70-6b506cd18112 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:13.081032 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-91f3fc4c-f9ab-40c8-bd70-6b506cd18112 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:13.210292 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-91f3fc4c-f9ab-40c8-bd70-6b506cd18112 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:36:13.218749 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-91f3fc4c-f9ab-40c8-bd70-6b506cd18112 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7" status: 200 len: 1731 microversion: 2.1 time: 0.151904 Sep 23 05:36:13.219346 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3638/7456] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:36:13 2022] GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7 => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:36:14.243538 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5ca94651-c76e-43af-9dda-6d093f5a68a7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:36:14.244087 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-5ca94651-c76e-43af-9dda-6d093f5a68a7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 95d38066-ca04-4351-abd6-28e65ff4d0b7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:36:14.250512 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5ca94651-c76e-43af-9dda-6d093f5a68a7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:14.251029 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5ca94651-c76e-43af-9dda-6d093f5a68a7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:14.251463 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5ca94651-c76e-43af-9dda-6d093f5a68a7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:14.252160 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5ca94651-c76e-43af-9dda-6d093f5a68a7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:14.252622 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5ca94651-c76e-43af-9dda-6d093f5a68a7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:14.253041 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5ca94651-c76e-43af-9dda-6d093f5a68a7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:14.387530 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-5ca94651-c76e-43af-9dda-6d093f5a68a7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:36:14.396569 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5ca94651-c76e-43af-9dda-6d093f5a68a7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7" status: 200 len: 1731 microversion: 2.1 time: 0.157158 Sep 23 05:36:14.397143 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3819/7457] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:36:14 2022] GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7 => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:36:15.420396 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e7f6d828-67a4-4608-8f62-66eee7f6524f tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:36:15.421032 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e7f6d828-67a4-4608-8f62-66eee7f6524f tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 95d38066-ca04-4351-abd6-28e65ff4d0b7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:36:15.428120 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e7f6d828-67a4-4608-8f62-66eee7f6524f tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:15.428630 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e7f6d828-67a4-4608-8f62-66eee7f6524f tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:15.429092 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e7f6d828-67a4-4608-8f62-66eee7f6524f tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:15.429809 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e7f6d828-67a4-4608-8f62-66eee7f6524f tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:15.430314 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e7f6d828-67a4-4608-8f62-66eee7f6524f tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:15.430763 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e7f6d828-67a4-4608-8f62-66eee7f6524f tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:15.563660 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e7f6d828-67a4-4608-8f62-66eee7f6524f tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:36:15.572012 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e7f6d828-67a4-4608-8f62-66eee7f6524f tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7" status: 200 len: 1731 microversion: 2.1 time: 0.155559 Sep 23 05:36:15.572632 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3639/7458] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:36:15 2022] GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:36:16.596730 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e102207a-e6ec-4cae-af12-df4d78883ed4 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:36:16.597279 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e102207a-e6ec-4cae-af12-df4d78883ed4 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 95d38066-ca04-4351-abd6-28e65ff4d0b7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:36:16.603808 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e102207a-e6ec-4cae-af12-df4d78883ed4 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:16.604302 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e102207a-e6ec-4cae-af12-df4d78883ed4 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:16.604751 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e102207a-e6ec-4cae-af12-df4d78883ed4 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:16.605456 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e102207a-e6ec-4cae-af12-df4d78883ed4 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:16.605950 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e102207a-e6ec-4cae-af12-df4d78883ed4 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:16.606395 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e102207a-e6ec-4cae-af12-df4d78883ed4 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:16.738051 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e102207a-e6ec-4cae-af12-df4d78883ed4 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:36:16.746599 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e102207a-e6ec-4cae-af12-df4d78883ed4 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7" status: 200 len: 1731 microversion: 2.1 time: 0.154368 Sep 23 05:36:16.747171 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3820/7459] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:36:16 2022] GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7 => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:36:17.827694 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7cfe07c6-3f67-4ab1-a352-400f46659ca6 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:36:17.828368 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7cfe07c6-3f67-4ab1-a352-400f46659ca6 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 95d38066-ca04-4351-abd6-28e65ff4d0b7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:36:17.835324 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7cfe07c6-3f67-4ab1-a352-400f46659ca6 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:17.835839 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7cfe07c6-3f67-4ab1-a352-400f46659ca6 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:17.836297 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7cfe07c6-3f67-4ab1-a352-400f46659ca6 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:17.837010 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7cfe07c6-3f67-4ab1-a352-400f46659ca6 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:17.837491 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7cfe07c6-3f67-4ab1-a352-400f46659ca6 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:17.837967 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7cfe07c6-3f67-4ab1-a352-400f46659ca6 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:17.967720 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-7cfe07c6-3f67-4ab1-a352-400f46659ca6 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:36:17.979269 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7cfe07c6-3f67-4ab1-a352-400f46659ca6 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7" status: 200 len: 1731 microversion: 2.1 time: 0.155529 Sep 23 05:36:17.979972 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3640/7460] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:36:17 2022] GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:36:19.003933 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f1e6c124-5b14-40e2-968c-4382866245c3 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:36:19.004623 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f1e6c124-5b14-40e2-968c-4382866245c3 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 95d38066-ca04-4351-abd6-28e65ff4d0b7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:36:19.011484 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f1e6c124-5b14-40e2-968c-4382866245c3 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:19.011983 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f1e6c124-5b14-40e2-968c-4382866245c3 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:19.012434 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f1e6c124-5b14-40e2-968c-4382866245c3 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:19.013139 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f1e6c124-5b14-40e2-968c-4382866245c3 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:19.013605 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f1e6c124-5b14-40e2-968c-4382866245c3 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:19.014075 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f1e6c124-5b14-40e2-968c-4382866245c3 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:19.147612 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f1e6c124-5b14-40e2-968c-4382866245c3 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:36:19.155890 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f1e6c124-5b14-40e2-968c-4382866245c3 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7" status: 200 len: 1731 microversion: 2.1 time: 0.156364 Sep 23 05:36:19.157084 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3821/7461] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:36:18 2022] GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7 => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:36:20.180394 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f64526ff-c1e8-4bc9-ad56-6dd895cbd529 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:36:20.181026 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f64526ff-c1e8-4bc9-ad56-6dd895cbd529 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 95d38066-ca04-4351-abd6-28e65ff4d0b7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:36:20.188646 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f64526ff-c1e8-4bc9-ad56-6dd895cbd529 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:20.189184 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f64526ff-c1e8-4bc9-ad56-6dd895cbd529 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:20.189640 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f64526ff-c1e8-4bc9-ad56-6dd895cbd529 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:20.190406 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f64526ff-c1e8-4bc9-ad56-6dd895cbd529 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:20.190876 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f64526ff-c1e8-4bc9-ad56-6dd895cbd529 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:20.191316 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f64526ff-c1e8-4bc9-ad56-6dd895cbd529 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:20.328845 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f64526ff-c1e8-4bc9-ad56-6dd895cbd529 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:36:20.337684 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f64526ff-c1e8-4bc9-ad56-6dd895cbd529 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7" status: 200 len: 1731 microversion: 2.1 time: 0.161188 Sep 23 05:36:20.338396 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3641/7462] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:36:20 2022] GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7 => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:36:21.361970 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-252e74ac-cc01-4347-a553-302ba921c19f tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:36:21.362591 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-252e74ac-cc01-4347-a553-302ba921c19f tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 95d38066-ca04-4351-abd6-28e65ff4d0b7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:36:21.369123 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-252e74ac-cc01-4347-a553-302ba921c19f tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:21.369614 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-252e74ac-cc01-4347-a553-302ba921c19f tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:21.370095 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-252e74ac-cc01-4347-a553-302ba921c19f tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:21.370792 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-252e74ac-cc01-4347-a553-302ba921c19f tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:21.371252 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-252e74ac-cc01-4347-a553-302ba921c19f tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:21.371685 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-252e74ac-cc01-4347-a553-302ba921c19f tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:21.497821 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-252e74ac-cc01-4347-a553-302ba921c19f tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:36:21.506549 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-252e74ac-cc01-4347-a553-302ba921c19f tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7" status: 200 len: 1731 microversion: 2.1 time: 0.148478 Sep 23 05:36:21.507129 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3822/7463] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:36:21 2022] GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7 => generated 1731 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:36:22.530713 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-74abc1b0-efff-40c6-8c5c-b07e0922e082 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:36:22.531808 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-74abc1b0-efff-40c6-8c5c-b07e0922e082 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 95d38066-ca04-4351-abd6-28e65ff4d0b7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:36:22.538814 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-74abc1b0-efff-40c6-8c5c-b07e0922e082 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:22.539329 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-74abc1b0-efff-40c6-8c5c-b07e0922e082 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:22.539790 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-74abc1b0-efff-40c6-8c5c-b07e0922e082 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:22.540509 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-74abc1b0-efff-40c6-8c5c-b07e0922e082 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:22.540990 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-74abc1b0-efff-40c6-8c5c-b07e0922e082 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:22.541444 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-74abc1b0-efff-40c6-8c5c-b07e0922e082 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:22.671866 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-74abc1b0-efff-40c6-8c5c-b07e0922e082 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:36:22.680279 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-74abc1b0-efff-40c6-8c5c-b07e0922e082 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7" status: 200 len: 1731 microversion: 2.1 time: 0.153696 Sep 23 05:36:22.680863 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3642/7464] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:36:22 2022] GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7 => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:36:23.705955 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-11d8c921-4f32-4215-9655-e0d166cba1dd tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:36:23.706582 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-11d8c921-4f32-4215-9655-e0d166cba1dd tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 95d38066-ca04-4351-abd6-28e65ff4d0b7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:36:23.713036 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-11d8c921-4f32-4215-9655-e0d166cba1dd tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:23.713532 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-11d8c921-4f32-4215-9655-e0d166cba1dd tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:23.714008 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-11d8c921-4f32-4215-9655-e0d166cba1dd tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:23.714716 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-11d8c921-4f32-4215-9655-e0d166cba1dd tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:23.715182 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-11d8c921-4f32-4215-9655-e0d166cba1dd tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:23.715623 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-11d8c921-4f32-4215-9655-e0d166cba1dd tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:23.850547 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-11d8c921-4f32-4215-9655-e0d166cba1dd tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:36:23.858031 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-11d8c921-4f32-4215-9655-e0d166cba1dd tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7" status: 200 len: 1731 microversion: 2.1 time: 0.158072 Sep 23 05:36:23.858604 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3823/7465] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:36:23 2022] GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7 => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:36:24.880711 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5834a04b-540c-4445-b000-d629e16d3d1a tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:36:24.881346 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5834a04b-540c-4445-b000-d629e16d3d1a tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 95d38066-ca04-4351-abd6-28e65ff4d0b7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:36:24.888261 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5834a04b-540c-4445-b000-d629e16d3d1a tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:24.888764 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5834a04b-540c-4445-b000-d629e16d3d1a tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:24.889224 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5834a04b-540c-4445-b000-d629e16d3d1a tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:24.889961 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5834a04b-540c-4445-b000-d629e16d3d1a tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:24.891179 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5834a04b-540c-4445-b000-d629e16d3d1a tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:24.891624 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5834a04b-540c-4445-b000-d629e16d3d1a tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:25.024297 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-5834a04b-540c-4445-b000-d629e16d3d1a tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:36:25.033240 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5834a04b-540c-4445-b000-d629e16d3d1a tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7" status: 200 len: 1731 microversion: 2.1 time: 0.156497 Sep 23 05:36:25.033831 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3643/7466] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:36:24 2022] GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7 => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:36:26.056736 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-20504b7f-e1e1-490c-8176-ff97427775f0 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:36:26.057354 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-20504b7f-e1e1-490c-8176-ff97427775f0 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 95d38066-ca04-4351-abd6-28e65ff4d0b7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:36:26.064382 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-20504b7f-e1e1-490c-8176-ff97427775f0 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:26.064884 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-20504b7f-e1e1-490c-8176-ff97427775f0 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:26.065338 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-20504b7f-e1e1-490c-8176-ff97427775f0 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:26.066082 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-20504b7f-e1e1-490c-8176-ff97427775f0 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:26.066550 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-20504b7f-e1e1-490c-8176-ff97427775f0 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:26.066991 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-20504b7f-e1e1-490c-8176-ff97427775f0 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:26.198522 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-20504b7f-e1e1-490c-8176-ff97427775f0 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:36:26.207430 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-20504b7f-e1e1-490c-8176-ff97427775f0 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7" status: 200 len: 1731 microversion: 2.1 time: 0.154609 Sep 23 05:36:26.207997 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3824/7467] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:36:26 2022] GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7 => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:36:27.230757 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-aca5c340-6860-40c1-a16e-a20c76ab5cf5 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:36:27.231413 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-aca5c340-6860-40c1-a16e-a20c76ab5cf5 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 95d38066-ca04-4351-abd6-28e65ff4d0b7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:36:27.238450 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-aca5c340-6860-40c1-a16e-a20c76ab5cf5 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:27.238958 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-aca5c340-6860-40c1-a16e-a20c76ab5cf5 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:27.239429 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-aca5c340-6860-40c1-a16e-a20c76ab5cf5 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:27.240168 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-aca5c340-6860-40c1-a16e-a20c76ab5cf5 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:27.240637 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-aca5c340-6860-40c1-a16e-a20c76ab5cf5 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:27.241078 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-aca5c340-6860-40c1-a16e-a20c76ab5cf5 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:27.369353 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-aca5c340-6860-40c1-a16e-a20c76ab5cf5 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:36:27.378159 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-aca5c340-6860-40c1-a16e-a20c76ab5cf5 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7" status: 200 len: 1731 microversion: 2.1 time: 0.151370 Sep 23 05:36:27.379123 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3644/7468] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:36:27 2022] GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7 => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:36:28.404415 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c82d3224-6876-44a9-82ca-1dc9e8bc85ef tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:36:28.405056 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c82d3224-6876-44a9-82ca-1dc9e8bc85ef tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 95d38066-ca04-4351-abd6-28e65ff4d0b7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:36:28.417731 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c82d3224-6876-44a9-82ca-1dc9e8bc85ef tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:28.418258 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c82d3224-6876-44a9-82ca-1dc9e8bc85ef tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:28.418705 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c82d3224-6876-44a9-82ca-1dc9e8bc85ef tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:28.419411 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c82d3224-6876-44a9-82ca-1dc9e8bc85ef tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:28.419879 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c82d3224-6876-44a9-82ca-1dc9e8bc85ef tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:28.420352 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c82d3224-6876-44a9-82ca-1dc9e8bc85ef tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:28.863432 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c82d3224-6876-44a9-82ca-1dc9e8bc85ef tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:36:28.865631 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:36:28.872295 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c82d3224-6876-44a9-82ca-1dc9e8bc85ef tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7" status: 200 len: 1731 microversion: 2.1 time: 0.473143 Sep 23 05:36:28.877508 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3825/7469] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:36:28 2022] GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7 => generated 1731 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:36:29.896775 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-81d8131a-0731-4b01-82b3-6e524fdf0b17 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:36:29.897402 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-81d8131a-0731-4b01-82b3-6e524fdf0b17 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 95d38066-ca04-4351-abd6-28e65ff4d0b7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:36:29.900147 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=27 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:36:29.904946 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-81d8131a-0731-4b01-82b3-6e524fdf0b17 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:29.910586 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-81d8131a-0731-4b01-82b3-6e524fdf0b17 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:29.910586 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-81d8131a-0731-4b01-82b3-6e524fdf0b17 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:29.910586 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-81d8131a-0731-4b01-82b3-6e524fdf0b17 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:29.910586 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-81d8131a-0731-4b01-82b3-6e524fdf0b17 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:29.910586 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-81d8131a-0731-4b01-82b3-6e524fdf0b17 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:30.041521 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-81d8131a-0731-4b01-82b3-6e524fdf0b17 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:36:30.050608 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-81d8131a-0731-4b01-82b3-6e524fdf0b17 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7" status: 200 len: 1731 microversion: 2.1 time: 0.157705 Sep 23 05:36:30.051202 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3645/7470] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:36:29 2022] GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7 => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:36:31.074699 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-47e1ae2f-611e-4b64-b639-c9062c64803f tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:36:31.075257 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-47e1ae2f-611e-4b64-b639-c9062c64803f tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 95d38066-ca04-4351-abd6-28e65ff4d0b7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:36:31.078025 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=33 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:36:31.083143 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-47e1ae2f-611e-4b64-b639-c9062c64803f tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:31.095398 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-47e1ae2f-611e-4b64-b639-c9062c64803f tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:31.095398 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-47e1ae2f-611e-4b64-b639-c9062c64803f tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:31.095398 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-47e1ae2f-611e-4b64-b639-c9062c64803f tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:31.095398 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-47e1ae2f-611e-4b64-b639-c9062c64803f tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:31.095398 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-47e1ae2f-611e-4b64-b639-c9062c64803f tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:31.217353 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-47e1ae2f-611e-4b64-b639-c9062c64803f tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:36:31.226164 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-47e1ae2f-611e-4b64-b639-c9062c64803f tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7" status: 200 len: 1731 microversion: 2.1 time: 0.155828 Sep 23 05:36:31.226731 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3826/7471] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:36:31 2022] GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:36:32.249342 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f7a26e7c-489d-49c4-bf23-36cee36cdc4d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:36:32.250563 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f7a26e7c-489d-49c4-bf23-36cee36cdc4d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 95d38066-ca04-4351-abd6-28e65ff4d0b7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:36:32.257213 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f7a26e7c-489d-49c4-bf23-36cee36cdc4d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:32.257731 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f7a26e7c-489d-49c4-bf23-36cee36cdc4d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:32.258264 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f7a26e7c-489d-49c4-bf23-36cee36cdc4d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:32.258990 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f7a26e7c-489d-49c4-bf23-36cee36cdc4d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:32.259472 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f7a26e7c-489d-49c4-bf23-36cee36cdc4d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:32.259921 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f7a26e7c-489d-49c4-bf23-36cee36cdc4d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:32.264023 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=85 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:36:32.391996 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f7a26e7c-489d-49c4-bf23-36cee36cdc4d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:36:32.400256 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f7a26e7c-489d-49c4-bf23-36cee36cdc4d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7" status: 200 len: 1731 microversion: 2.1 time: 0.154994 Sep 23 05:36:32.400833 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3646/7472] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:36:32 2022] GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7 => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:36:33.425113 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-da9ba46a-5a42-4beb-96b9-fdc3533e05f9 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:36:33.425729 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-da9ba46a-5a42-4beb-96b9-fdc3533e05f9 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 95d38066-ca04-4351-abd6-28e65ff4d0b7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:36:33.432440 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-da9ba46a-5a42-4beb-96b9-fdc3533e05f9 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:33.432933 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-da9ba46a-5a42-4beb-96b9-fdc3533e05f9 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:33.433377 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-da9ba46a-5a42-4beb-96b9-fdc3533e05f9 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:33.434111 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-da9ba46a-5a42-4beb-96b9-fdc3533e05f9 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:33.434577 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-da9ba46a-5a42-4beb-96b9-fdc3533e05f9 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:33.435008 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-da9ba46a-5a42-4beb-96b9-fdc3533e05f9 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:33.563767 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-da9ba46a-5a42-4beb-96b9-fdc3533e05f9 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:36:33.572002 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-da9ba46a-5a42-4beb-96b9-fdc3533e05f9 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7" status: 200 len: 1731 microversion: 2.1 time: 0.151228 Sep 23 05:36:33.572581 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3827/7473] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:36:33 2022] GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7 => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:36:34.596909 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6bd7207f-3bcb-44d2-b9ea-bcf875b915d4 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:36:34.597463 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-6bd7207f-3bcb-44d2-b9ea-bcf875b915d4 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 95d38066-ca04-4351-abd6-28e65ff4d0b7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:36:34.604546 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6bd7207f-3bcb-44d2-b9ea-bcf875b915d4 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:34.605054 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6bd7207f-3bcb-44d2-b9ea-bcf875b915d4 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:34.605548 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6bd7207f-3bcb-44d2-b9ea-bcf875b915d4 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:34.606290 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6bd7207f-3bcb-44d2-b9ea-bcf875b915d4 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:34.606765 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6bd7207f-3bcb-44d2-b9ea-bcf875b915d4 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:34.607210 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6bd7207f-3bcb-44d2-b9ea-bcf875b915d4 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:34.743367 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6bd7207f-3bcb-44d2-b9ea-bcf875b915d4 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:36:34.752021 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-6bd7207f-3bcb-44d2-b9ea-bcf875b915d4 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7" status: 200 len: 1731 microversion: 2.1 time: 0.159549 Sep 23 05:36:34.752609 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3647/7474] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:36:34 2022] GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7 => generated 1731 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:36:35.776974 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a7a1b575-10ab-438d-81df-e2e7b96315b8 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:36:35.777509 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a7a1b575-10ab-438d-81df-e2e7b96315b8 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 95d38066-ca04-4351-abd6-28e65ff4d0b7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:36:35.784381 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a7a1b575-10ab-438d-81df-e2e7b96315b8 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:35.784882 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a7a1b575-10ab-438d-81df-e2e7b96315b8 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:35.785330 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a7a1b575-10ab-438d-81df-e2e7b96315b8 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:35.786076 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a7a1b575-10ab-438d-81df-e2e7b96315b8 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:35.786556 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a7a1b575-10ab-438d-81df-e2e7b96315b8 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:35.786980 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a7a1b575-10ab-438d-81df-e2e7b96315b8 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:35.918583 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a7a1b575-10ab-438d-81df-e2e7b96315b8 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:36:35.927605 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a7a1b575-10ab-438d-81df-e2e7b96315b8 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7" status: 200 len: 1731 microversion: 2.1 time: 0.154728 Sep 23 05:36:35.928272 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3828/7475] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:36:35 2022] GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7 => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:36:36.951258 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7a236892-27db-4dd3-961b-9e474518177e tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:36:36.951902 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7a236892-27db-4dd3-961b-9e474518177e tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 95d38066-ca04-4351-abd6-28e65ff4d0b7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:36:36.959463 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7a236892-27db-4dd3-961b-9e474518177e tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:36.959994 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7a236892-27db-4dd3-961b-9e474518177e tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:36.960455 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7a236892-27db-4dd3-961b-9e474518177e tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:36.961172 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7a236892-27db-4dd3-961b-9e474518177e tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:36.961657 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7a236892-27db-4dd3-961b-9e474518177e tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:36.962232 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7a236892-27db-4dd3-961b-9e474518177e tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:37.101644 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-7a236892-27db-4dd3-961b-9e474518177e tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:36:37.110208 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7a236892-27db-4dd3-961b-9e474518177e tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7" status: 200 len: 1730 microversion: 2.1 time: 0.162911 Sep 23 05:36:37.110951 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3648/7476] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:36:36 2022] GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7 => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:36:37.465677 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-8cfa7ed2-6f14-433b-801f-1d05050b6743 req-ef8289c6-9c35-4d62-9c52-72e29fbd6e14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95d38066-ca04-4351-abd6-28e65ff4d0b7", "name": "network-vif-unplugged", "status": "completed", "tag": "106907e5-bf3f-4a30-badd-9d493457de51"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:36:37.477010 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-8cfa7ed2-6f14-433b-801f-1d05050b6743 req-ef8289c6-9c35-4d62-9c52-72e29fbd6e14 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:37.477010 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-8cfa7ed2-6f14-433b-801f-1d05050b6743 req-ef8289c6-9c35-4d62-9c52-72e29fbd6e14 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:37.477268 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-8cfa7ed2-6f14-433b-801f-1d05050b6743 req-ef8289c6-9c35-4d62-9c52-72e29fbd6e14 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:37.489700 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-8cfa7ed2-6f14-433b-801f-1d05050b6743 req-ef8289c6-9c35-4d62-9c52-72e29fbd6e14 service nova] Creating event network-vif-unplugged:106907e5-bf3f-4a30-badd-9d493457de51 for instance 95d38066-ca04-4351-abd6-28e65ff4d0b7 on n-h1-846463-3 Sep 23 05:36:37.495167 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [req-8cfa7ed2-6f14-433b-801f-1d05050b6743 req-ef8289c6-9c35-4d62-9c52-72e29fbd6e14 service nova] Instance 95d38066-ca04-4351-abd6-28e65ff4d0b7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846463-3', 'n-h2-846463-3'} {{(pid=122699) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 23 05:36:37.506179 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-8cfa7ed2-6f14-433b-801f-1d05050b6743 req-ef8289c6-9c35-4d62-9c52-72e29fbd6e14 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044281 Sep 23 05:36:37.506769 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3829/7477] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:36:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:36:38.135355 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1023506c-7104-4b29-8a5d-23527b2cd149 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:36:38.136275 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-1023506c-7104-4b29-8a5d-23527b2cd149 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 95d38066-ca04-4351-abd6-28e65ff4d0b7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:36:38.144783 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1023506c-7104-4b29-8a5d-23527b2cd149 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:38.145286 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1023506c-7104-4b29-8a5d-23527b2cd149 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:38.145942 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1023506c-7104-4b29-8a5d-23527b2cd149 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:38.146841 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1023506c-7104-4b29-8a5d-23527b2cd149 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:38.147400 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1023506c-7104-4b29-8a5d-23527b2cd149 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:38.147881 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1023506c-7104-4b29-8a5d-23527b2cd149 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:38.303370 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-1023506c-7104-4b29-8a5d-23527b2cd149 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:36:38.314379 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-1023506c-7104-4b29-8a5d-23527b2cd149 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7" status: 200 len: 1730 microversion: 2.1 time: 0.183583 Sep 23 05:36:38.315292 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3649/7478] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:36:38 2022] GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7 => generated 1730 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:36:39.339931 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-64c5bc5f-0784-45f0-a016-da91eef6a156 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:36:39.340643 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-64c5bc5f-0784-45f0-a016-da91eef6a156 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 95d38066-ca04-4351-abd6-28e65ff4d0b7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:36:39.348037 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-64c5bc5f-0784-45f0-a016-da91eef6a156 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:39.349290 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-64c5bc5f-0784-45f0-a016-da91eef6a156 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:39.349737 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-64c5bc5f-0784-45f0-a016-da91eef6a156 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:39.350913 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-64c5bc5f-0784-45f0-a016-da91eef6a156 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:39.351381 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-64c5bc5f-0784-45f0-a016-da91eef6a156 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:39.351812 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-64c5bc5f-0784-45f0-a016-da91eef6a156 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:39.496374 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-64c5bc5f-0784-45f0-a016-da91eef6a156 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:36:39.505455 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-64c5bc5f-0784-45f0-a016-da91eef6a156 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7" status: 200 len: 1728 microversion: 2.1 time: 0.169904 Sep 23 05:36:39.506183 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3830/7479] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:36:39 2022] GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7 => generated 1728 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:36:39.521103 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-e26b7887-d17b-4b34-8d54-8ad9a6a77842 req-56869202-de01-4c68-a3d2-d16a564a8308 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95d38066-ca04-4351-abd6-28e65ff4d0b7", "tag": "106907e5-bf3f-4a30-badd-9d493457de51"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:36:39.532542 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-e26b7887-d17b-4b34-8d54-8ad9a6a77842 req-56869202-de01-4c68-a3d2-d16a564a8308 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:39.533048 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-e26b7887-d17b-4b34-8d54-8ad9a6a77842 req-56869202-de01-4c68-a3d2-d16a564a8308 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:39.533503 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-e26b7887-d17b-4b34-8d54-8ad9a6a77842 req-56869202-de01-4c68-a3d2-d16a564a8308 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:39.545475 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-e26b7887-d17b-4b34-8d54-8ad9a6a77842 req-56869202-de01-4c68-a3d2-d16a564a8308 service nova] Creating event network-changed:106907e5-bf3f-4a30-badd-9d493457de51 for instance 95d38066-ca04-4351-abd6-28e65ff4d0b7 on n-h1-846463-3 Sep 23 05:36:39.551481 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [req-e26b7887-d17b-4b34-8d54-8ad9a6a77842 req-56869202-de01-4c68-a3d2-d16a564a8308 service nova] Instance 95d38066-ca04-4351-abd6-28e65ff4d0b7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846463-3', 'n-h2-846463-3'} {{(pid=122698) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 23 05:36:39.562176 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-e26b7887-d17b-4b34-8d54-8ad9a6a77842 req-56869202-de01-4c68-a3d2-d16a564a8308 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044781 Sep 23 05:36:39.562871 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3650/7480] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:36:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 05:36:40.531359 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-daa2699d-13ab-46fd-8a02-7d3241caed00 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:36:40.532064 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-daa2699d-13ab-46fd-8a02-7d3241caed00 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 95d38066-ca04-4351-abd6-28e65ff4d0b7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:36:40.538597 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-daa2699d-13ab-46fd-8a02-7d3241caed00 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:40.539090 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-daa2699d-13ab-46fd-8a02-7d3241caed00 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:40.539534 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-daa2699d-13ab-46fd-8a02-7d3241caed00 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:40.540238 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-daa2699d-13ab-46fd-8a02-7d3241caed00 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:40.540704 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-daa2699d-13ab-46fd-8a02-7d3241caed00 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:40.541137 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-daa2699d-13ab-46fd-8a02-7d3241caed00 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:40.673748 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-daa2699d-13ab-46fd-8a02-7d3241caed00 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:36:40.682145 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-daa2699d-13ab-46fd-8a02-7d3241caed00 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7" status: 200 len: 1728 microversion: 2.1 time: 0.155403 Sep 23 05:36:40.694242 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3831/7481] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:36:40 2022] GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7 => generated 1728 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:36:41.713141 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b3e0995e-680b-4611-bfed-ebd33a5802e3 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:36:41.718290 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b3e0995e-680b-4611-bfed-ebd33a5802e3 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 95d38066-ca04-4351-abd6-28e65ff4d0b7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:36:41.725445 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b3e0995e-680b-4611-bfed-ebd33a5802e3 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:41.726135 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b3e0995e-680b-4611-bfed-ebd33a5802e3 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:41.726747 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b3e0995e-680b-4611-bfed-ebd33a5802e3 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:41.727485 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b3e0995e-680b-4611-bfed-ebd33a5802e3 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:41.728094 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b3e0995e-680b-4611-bfed-ebd33a5802e3 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:41.728737 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b3e0995e-680b-4611-bfed-ebd33a5802e3 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:41.862500 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b3e0995e-680b-4611-bfed-ebd33a5802e3 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:36:41.870976 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b3e0995e-680b-4611-bfed-ebd33a5802e3 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7" status: 200 len: 1728 microversion: 2.1 time: 0.168751 Sep 23 05:36:41.871556 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3651/7482] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:36:41 2022] GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7 => generated 1728 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:36:42.896019 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4af4b821-3f98-42cc-991f-75af24d39f0b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:36:42.896750 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4af4b821-3f98-42cc-991f-75af24d39f0b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 95d38066-ca04-4351-abd6-28e65ff4d0b7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:36:42.903375 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4af4b821-3f98-42cc-991f-75af24d39f0b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:42.903871 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4af4b821-3f98-42cc-991f-75af24d39f0b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:42.904312 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4af4b821-3f98-42cc-991f-75af24d39f0b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:42.905016 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4af4b821-3f98-42cc-991f-75af24d39f0b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:42.906092 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4af4b821-3f98-42cc-991f-75af24d39f0b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:42.906559 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4af4b821-3f98-42cc-991f-75af24d39f0b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:43.042614 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-4af4b821-3f98-42cc-991f-75af24d39f0b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:36:43.051180 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4af4b821-3f98-42cc-991f-75af24d39f0b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7" status: 200 len: 1728 microversion: 2.1 time: 0.159158 Sep 23 05:36:43.051767 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3832/7483] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:36:42 2022] GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7 => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:36:44.074517 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b06ddea5-cb56-403b-8384-e954f36cff7c tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:36:44.075147 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b06ddea5-cb56-403b-8384-e954f36cff7c tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 95d38066-ca04-4351-abd6-28e65ff4d0b7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:36:44.083110 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b06ddea5-cb56-403b-8384-e954f36cff7c tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:44.083730 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b06ddea5-cb56-403b-8384-e954f36cff7c tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:44.084145 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b06ddea5-cb56-403b-8384-e954f36cff7c tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:44.085016 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b06ddea5-cb56-403b-8384-e954f36cff7c tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:44.085490 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b06ddea5-cb56-403b-8384-e954f36cff7c tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:44.085962 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b06ddea5-cb56-403b-8384-e954f36cff7c tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:44.220510 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b06ddea5-cb56-403b-8384-e954f36cff7c tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:36:44.228935 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b06ddea5-cb56-403b-8384-e954f36cff7c tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7" status: 200 len: 1728 microversion: 2.1 time: 0.158413 Sep 23 05:36:44.229530 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3652/7484] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:36:44 2022] GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7 => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:36:45.252238 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5cb63b27-47e4-4049-b92c-5fdc075f5c00 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:36:45.252867 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-5cb63b27-47e4-4049-b92c-5fdc075f5c00 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 95d38066-ca04-4351-abd6-28e65ff4d0b7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:36:45.259547 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5cb63b27-47e4-4049-b92c-5fdc075f5c00 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:45.260047 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5cb63b27-47e4-4049-b92c-5fdc075f5c00 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:45.260492 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5cb63b27-47e4-4049-b92c-5fdc075f5c00 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:45.261200 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5cb63b27-47e4-4049-b92c-5fdc075f5c00 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:45.261668 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5cb63b27-47e4-4049-b92c-5fdc075f5c00 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:45.262134 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5cb63b27-47e4-4049-b92c-5fdc075f5c00 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:45.394333 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-5cb63b27-47e4-4049-b92c-5fdc075f5c00 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:36:45.402456 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5cb63b27-47e4-4049-b92c-5fdc075f5c00 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7" status: 200 len: 1728 microversion: 2.1 time: 0.154837 Sep 23 05:36:45.403029 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3833/7485] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:36:45 2022] GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7 => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:36:46.426267 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-58d11ea0-27bc-47d3-a726-86a9ed828562 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:36:46.426884 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-58d11ea0-27bc-47d3-a726-86a9ed828562 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 95d38066-ca04-4351-abd6-28e65ff4d0b7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:36:46.434494 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-58d11ea0-27bc-47d3-a726-86a9ed828562 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:46.435008 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-58d11ea0-27bc-47d3-a726-86a9ed828562 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:46.435466 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-58d11ea0-27bc-47d3-a726-86a9ed828562 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:46.436188 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-58d11ea0-27bc-47d3-a726-86a9ed828562 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:46.436709 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-58d11ea0-27bc-47d3-a726-86a9ed828562 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:46.437156 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-58d11ea0-27bc-47d3-a726-86a9ed828562 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:46.567563 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-58d11ea0-27bc-47d3-a726-86a9ed828562 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:36:46.575889 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-58d11ea0-27bc-47d3-a726-86a9ed828562 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7" status: 200 len: 1728 microversion: 2.1 time: 0.153585 Sep 23 05:36:46.576467 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3653/7486] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:36:46 2022] GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7 => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:36:47.599298 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0225b629-e29a-4d54-9167-93c9241d3748 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:36:47.599842 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-0225b629-e29a-4d54-9167-93c9241d3748 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 95d38066-ca04-4351-abd6-28e65ff4d0b7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:36:47.606398 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0225b629-e29a-4d54-9167-93c9241d3748 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:47.606871 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0225b629-e29a-4d54-9167-93c9241d3748 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:47.607316 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0225b629-e29a-4d54-9167-93c9241d3748 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:47.608019 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0225b629-e29a-4d54-9167-93c9241d3748 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:47.608645 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0225b629-e29a-4d54-9167-93c9241d3748 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:47.609086 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0225b629-e29a-4d54-9167-93c9241d3748 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:47.738179 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-0225b629-e29a-4d54-9167-93c9241d3748 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:36:47.746410 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0225b629-e29a-4d54-9167-93c9241d3748 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7" status: 200 len: 1728 microversion: 2.1 time: 0.151112 Sep 23 05:36:47.746994 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3834/7487] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:36:47 2022] GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7 => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:36:48.770603 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a1d3e4fa-6834-4446-87d6-028f7727358b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:36:48.771230 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a1d3e4fa-6834-4446-87d6-028f7727358b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 95d38066-ca04-4351-abd6-28e65ff4d0b7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:36:48.778096 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a1d3e4fa-6834-4446-87d6-028f7727358b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:48.778599 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a1d3e4fa-6834-4446-87d6-028f7727358b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:48.779074 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a1d3e4fa-6834-4446-87d6-028f7727358b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:48.779777 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a1d3e4fa-6834-4446-87d6-028f7727358b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:48.780801 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a1d3e4fa-6834-4446-87d6-028f7727358b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:48.781275 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a1d3e4fa-6834-4446-87d6-028f7727358b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:48.908108 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a1d3e4fa-6834-4446-87d6-028f7727358b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:36:48.916456 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a1d3e4fa-6834-4446-87d6-028f7727358b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7" status: 200 len: 1728 microversion: 2.1 time: 0.149772 Sep 23 05:36:48.917133 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3654/7488] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:36:48 2022] GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7 => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:36:49.938900 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-08631a96-9f89-45cc-a27f-74cc47c0310b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:36:49.939514 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-08631a96-9f89-45cc-a27f-74cc47c0310b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 95d38066-ca04-4351-abd6-28e65ff4d0b7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:36:49.946081 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-08631a96-9f89-45cc-a27f-74cc47c0310b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:49.946604 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-08631a96-9f89-45cc-a27f-74cc47c0310b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:49.947050 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-08631a96-9f89-45cc-a27f-74cc47c0310b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:49.947754 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-08631a96-9f89-45cc-a27f-74cc47c0310b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:49.948218 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-08631a96-9f89-45cc-a27f-74cc47c0310b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:49.948654 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-08631a96-9f89-45cc-a27f-74cc47c0310b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:50.079304 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-08631a96-9f89-45cc-a27f-74cc47c0310b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:36:50.087850 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-08631a96-9f89-45cc-a27f-74cc47c0310b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7" status: 200 len: 1728 microversion: 2.1 time: 0.152904 Sep 23 05:36:50.088425 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3835/7489] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:36:49 2022] GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7 => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:36:51.112204 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8f210b45-a659-45a8-8ce8-608a070b99c0 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:36:51.112832 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8f210b45-a659-45a8-8ce8-608a070b99c0 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 95d38066-ca04-4351-abd6-28e65ff4d0b7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:36:51.119579 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8f210b45-a659-45a8-8ce8-608a070b99c0 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:51.120081 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8f210b45-a659-45a8-8ce8-608a070b99c0 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:51.120535 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8f210b45-a659-45a8-8ce8-608a070b99c0 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:51.121243 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8f210b45-a659-45a8-8ce8-608a070b99c0 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:51.121719 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8f210b45-a659-45a8-8ce8-608a070b99c0 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:51.122188 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8f210b45-a659-45a8-8ce8-608a070b99c0 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:51.255826 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8f210b45-a659-45a8-8ce8-608a070b99c0 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:36:51.264749 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8f210b45-a659-45a8-8ce8-608a070b99c0 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7" status: 200 len: 1728 microversion: 2.1 time: 0.156618 Sep 23 05:36:51.265588 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3655/7490] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:36:51 2022] GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7 => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:36:52.288632 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7f927136-9c99-436d-82ea-385466999356 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:36:52.289245 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-7f927136-9c99-436d-82ea-385466999356 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 95d38066-ca04-4351-abd6-28e65ff4d0b7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:36:52.296479 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7f927136-9c99-436d-82ea-385466999356 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:52.296972 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7f927136-9c99-436d-82ea-385466999356 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:52.297413 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7f927136-9c99-436d-82ea-385466999356 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:52.298144 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7f927136-9c99-436d-82ea-385466999356 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:52.298610 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7f927136-9c99-436d-82ea-385466999356 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:52.299037 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7f927136-9c99-436d-82ea-385466999356 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:52.430405 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-7f927136-9c99-436d-82ea-385466999356 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:36:52.441198 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-7f927136-9c99-436d-82ea-385466999356 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7" status: 200 len: 1725 microversion: 2.1 time: 0.156484 Sep 23 05:36:52.441775 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3836/7491] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:36:52 2022] GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:36:52.469307 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5c050586-8111-4879-a163-9eb6f423040c tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:36:52.469854 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5c050586-8111-4879-a163-9eb6f423040c tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 95d38066-ca04-4351-abd6-28e65ff4d0b7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:36:52.476692 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5c050586-8111-4879-a163-9eb6f423040c tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:52.477195 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5c050586-8111-4879-a163-9eb6f423040c tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:52.477646 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5c050586-8111-4879-a163-9eb6f423040c tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:52.478385 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5c050586-8111-4879-a163-9eb6f423040c tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:52.478862 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5c050586-8111-4879-a163-9eb6f423040c tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:52.479333 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5c050586-8111-4879-a163-9eb6f423040c tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:52.517007 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5c050586-8111-4879-a163-9eb6f423040c tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:52.517498 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5c050586-8111-4879-a163-9eb6f423040c tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:52.517979 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5c050586-8111-4879-a163-9eb6f423040c tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:52.518712 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5c050586-8111-4879-a163-9eb6f423040c tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:52.519181 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5c050586-8111-4879-a163-9eb6f423040c tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:52.519621 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5c050586-8111-4879-a163-9eb6f423040c tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:52.539789 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-5c050586-8111-4879-a163-9eb6f423040c tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Getting quotas for project f991e11ed0c44131a4bd9be0110dffe0. Resources: {'cores', 'ram'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 05:36:52.544808 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-5c050586-8111-4879-a163-9eb6f423040c tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Getting quotas for user f398aeafcbcb48d88d8cfd3bdf59bbed and project f991e11ed0c44131a4bd9be0110dffe0. Resources: {'cores', 'ram'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 05:36:52.882740 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5c050586-8111-4879-a163-9eb6f423040c tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "POST /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7/action" status: 202 len: 0 microversion: 2.1 time: 0.417228 Sep 23 05:36:52.883408 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3656/7492] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 05:36:52 2022] POST /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7/action => generated 0 bytes in 419 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 05:36:52.894369 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2f8288b5-0b60-48f9-8fa5-abca62b47e9f tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:36:52.894976 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-2f8288b5-0b60-48f9-8fa5-abca62b47e9f tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 95d38066-ca04-4351-abd6-28e65ff4d0b7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:36:52.900983 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2f8288b5-0b60-48f9-8fa5-abca62b47e9f tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:52.902609 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2f8288b5-0b60-48f9-8fa5-abca62b47e9f tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:52.902609 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2f8288b5-0b60-48f9-8fa5-abca62b47e9f tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:52.902875 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2f8288b5-0b60-48f9-8fa5-abca62b47e9f tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:52.903120 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2f8288b5-0b60-48f9-8fa5-abca62b47e9f tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:52.903545 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2f8288b5-0b60-48f9-8fa5-abca62b47e9f tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:53.041703 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2f8288b5-0b60-48f9-8fa5-abca62b47e9f tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:36:53.052578 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2f8288b5-0b60-48f9-8fa5-abca62b47e9f tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7" status: 200 len: 1724 microversion: 2.1 time: 0.164794 Sep 23 05:36:53.053171 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3837/7493] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:36:52 2022] GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:36:53.712776 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-5cdb7b8d-7070-4f25-97f8-0faf451b1e59 req-f6044e10-ed3b-4340-a418-2df190e83216 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95d38066-ca04-4351-abd6-28e65ff4d0b7", "name": "network-vif-plugged", "status": "completed", "tag": "106907e5-bf3f-4a30-badd-9d493457de51"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:36:53.724185 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-5cdb7b8d-7070-4f25-97f8-0faf451b1e59 req-f6044e10-ed3b-4340-a418-2df190e83216 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:53.724689 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-5cdb7b8d-7070-4f25-97f8-0faf451b1e59 req-f6044e10-ed3b-4340-a418-2df190e83216 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:53.725141 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-5cdb7b8d-7070-4f25-97f8-0faf451b1e59 req-f6044e10-ed3b-4340-a418-2df190e83216 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:53.736230 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-5cdb7b8d-7070-4f25-97f8-0faf451b1e59 req-f6044e10-ed3b-4340-a418-2df190e83216 service nova] Creating event network-vif-plugged:106907e5-bf3f-4a30-badd-9d493457de51 for instance 95d38066-ca04-4351-abd6-28e65ff4d0b7 on n-h1-846463-3 Sep 23 05:36:53.741574 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [req-5cdb7b8d-7070-4f25-97f8-0faf451b1e59 req-f6044e10-ed3b-4340-a418-2df190e83216 service nova] Instance 95d38066-ca04-4351-abd6-28e65ff4d0b7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846463-3', 'n-h2-846463-3'} {{(pid=122698) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 23 05:36:53.752947 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-5cdb7b8d-7070-4f25-97f8-0faf451b1e59 req-f6044e10-ed3b-4340-a418-2df190e83216 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045223 Sep 23 05:36:53.757030 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3657/7494] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:36:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:36:54.075900 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-29362835-bb8a-4c47-88c7-773a3fa04116 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:36:54.076563 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-29362835-bb8a-4c47-88c7-773a3fa04116 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 95d38066-ca04-4351-abd6-28e65ff4d0b7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:36:54.083200 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-29362835-bb8a-4c47-88c7-773a3fa04116 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:54.083688 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-29362835-bb8a-4c47-88c7-773a3fa04116 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:54.084797 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-29362835-bb8a-4c47-88c7-773a3fa04116 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:54.085505 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-29362835-bb8a-4c47-88c7-773a3fa04116 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:54.086370 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-29362835-bb8a-4c47-88c7-773a3fa04116 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:54.088953 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-29362835-bb8a-4c47-88c7-773a3fa04116 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:54.218495 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-29362835-bb8a-4c47-88c7-773a3fa04116 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:36:54.226704 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-29362835-bb8a-4c47-88c7-773a3fa04116 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7" status: 200 len: 1724 microversion: 2.1 time: 0.154754 Sep 23 05:36:54.227278 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3838/7495] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:36:54 2022] GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:36:55.252397 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-20e26f4a-7359-4f97-84f8-e9f023e093c6 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:36:55.253108 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-20e26f4a-7359-4f97-84f8-e9f023e093c6 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 95d38066-ca04-4351-abd6-28e65ff4d0b7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:36:55.259564 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-20e26f4a-7359-4f97-84f8-e9f023e093c6 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:55.260066 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-20e26f4a-7359-4f97-84f8-e9f023e093c6 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:55.260517 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-20e26f4a-7359-4f97-84f8-e9f023e093c6 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:55.261225 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-20e26f4a-7359-4f97-84f8-e9f023e093c6 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:55.261692 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-20e26f4a-7359-4f97-84f8-e9f023e093c6 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:55.262155 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-20e26f4a-7359-4f97-84f8-e9f023e093c6 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:55.400285 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-20e26f4a-7359-4f97-84f8-e9f023e093c6 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:36:55.408776 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-20e26f4a-7359-4f97-84f8-e9f023e093c6 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7" status: 200 len: 1724 microversion: 2.1 time: 0.162292 Sep 23 05:36:55.409402 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3658/7496] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:36:55 2022] GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:36:56.432075 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c82d30db-6f7c-44ba-9048-6ca7aaff317a tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:36:56.432681 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c82d30db-6f7c-44ba-9048-6ca7aaff317a tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 95d38066-ca04-4351-abd6-28e65ff4d0b7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:36:56.439214 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c82d30db-6f7c-44ba-9048-6ca7aaff317a tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:56.439699 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c82d30db-6f7c-44ba-9048-6ca7aaff317a tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:56.440134 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c82d30db-6f7c-44ba-9048-6ca7aaff317a tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:56.440827 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c82d30db-6f7c-44ba-9048-6ca7aaff317a tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:56.441285 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c82d30db-6f7c-44ba-9048-6ca7aaff317a tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:56.441706 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c82d30db-6f7c-44ba-9048-6ca7aaff317a tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:56.576291 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c82d30db-6f7c-44ba-9048-6ca7aaff317a tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:36:56.585109 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c82d30db-6f7c-44ba-9048-6ca7aaff317a tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7" status: 200 len: 1724 microversion: 2.1 time: 0.156919 Sep 23 05:36:56.585676 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3839/7497] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:36:56 2022] GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:36:57.609053 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-af8f577d-f2bd-4436-9231-8d748d44056d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:36:57.609697 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-af8f577d-f2bd-4436-9231-8d748d44056d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 95d38066-ca04-4351-abd6-28e65ff4d0b7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:36:57.616582 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-af8f577d-f2bd-4436-9231-8d748d44056d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:57.617097 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-af8f577d-f2bd-4436-9231-8d748d44056d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:57.617561 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-af8f577d-f2bd-4436-9231-8d748d44056d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:57.618308 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-af8f577d-f2bd-4436-9231-8d748d44056d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:57.618793 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-af8f577d-f2bd-4436-9231-8d748d44056d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:57.619245 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-af8f577d-f2bd-4436-9231-8d748d44056d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:57.747602 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-af8f577d-f2bd-4436-9231-8d748d44056d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:36:57.756328 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-af8f577d-f2bd-4436-9231-8d748d44056d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7" status: 200 len: 1724 microversion: 2.1 time: 0.151297 Sep 23 05:36:57.756908 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3659/7498] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:36:57 2022] GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:36:58.780943 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2f4bdc83-1151-41bf-b064-cc4d91be3309 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:36:58.781590 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-2f4bdc83-1151-41bf-b064-cc4d91be3309 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 95d38066-ca04-4351-abd6-28e65ff4d0b7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:36:58.788878 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2f4bdc83-1151-41bf-b064-cc4d91be3309 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:58.789382 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2f4bdc83-1151-41bf-b064-cc4d91be3309 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:58.789861 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2f4bdc83-1151-41bf-b064-cc4d91be3309 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:58.790633 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2f4bdc83-1151-41bf-b064-cc4d91be3309 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:58.791119 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2f4bdc83-1151-41bf-b064-cc4d91be3309 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:58.791538 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2f4bdc83-1151-41bf-b064-cc4d91be3309 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:58.928120 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2f4bdc83-1151-41bf-b064-cc4d91be3309 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:36:58.936775 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2f4bdc83-1151-41bf-b064-cc4d91be3309 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7" status: 200 len: 1724 microversion: 2.1 time: 0.160353 Sep 23 05:36:58.937717 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3840/7499] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:36:58 2022] GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:36:58.985315 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-633afa2e-ac3e-47e2-a34c-cada862befda req-b0acc8a6-e472-49ed-8eb3-c35a230989e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95d38066-ca04-4351-abd6-28e65ff4d0b7", "name": "network-vif-unplugged", "status": "completed", "tag": "106907e5-bf3f-4a30-badd-9d493457de51"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:36:58.996738 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-633afa2e-ac3e-47e2-a34c-cada862befda req-b0acc8a6-e472-49ed-8eb3-c35a230989e0 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:58.997251 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-633afa2e-ac3e-47e2-a34c-cada862befda req-b0acc8a6-e472-49ed-8eb3-c35a230989e0 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:58.997844 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-633afa2e-ac3e-47e2-a34c-cada862befda req-b0acc8a6-e472-49ed-8eb3-c35a230989e0 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:59.010284 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-633afa2e-ac3e-47e2-a34c-cada862befda req-b0acc8a6-e472-49ed-8eb3-c35a230989e0 service nova] Creating event network-vif-unplugged:106907e5-bf3f-4a30-badd-9d493457de51 for instance 95d38066-ca04-4351-abd6-28e65ff4d0b7 on n-h2-846463-3 Sep 23 05:36:59.012725 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:36:59.016907 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [req-633afa2e-ac3e-47e2-a34c-cada862befda req-b0acc8a6-e472-49ed-8eb3-c35a230989e0 service nova] Instance 95d38066-ca04-4351-abd6-28e65ff4d0b7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846463-3', 'n-h2-846463-3'} {{(pid=122698) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 23 05:36:59.027967 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-633afa2e-ac3e-47e2-a34c-cada862befda req-b0acc8a6-e472-49ed-8eb3-c35a230989e0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046663 Sep 23 05:36:59.028504 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3660/7500] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:36:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:36:59.961394 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0734ea74-0fee-476e-b20a-7e36f9016880 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:36:59.961988 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-0734ea74-0fee-476e-b20a-7e36f9016880 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 95d38066-ca04-4351-abd6-28e65ff4d0b7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:36:59.969600 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0734ea74-0fee-476e-b20a-7e36f9016880 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:59.970306 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0734ea74-0fee-476e-b20a-7e36f9016880 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:59.970779 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0734ea74-0fee-476e-b20a-7e36f9016880 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:36:59.971529 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0734ea74-0fee-476e-b20a-7e36f9016880 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:36:59.971999 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0734ea74-0fee-476e-b20a-7e36f9016880 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:36:59.972431 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0734ea74-0fee-476e-b20a-7e36f9016880 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:37:00.108732 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-0734ea74-0fee-476e-b20a-7e36f9016880 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:37:00.117108 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0734ea74-0fee-476e-b20a-7e36f9016880 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7" status: 200 len: 1724 microversion: 2.1 time: 0.159957 Sep 23 05:37:00.117943 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3841/7501] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:36:59 2022] GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:37:01.047040 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-844c6de8-c89d-4af3-8c81-6561e7968611 req-07a93ebb-f6fd-4f42-abe4-fd6fcffe90c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95d38066-ca04-4351-abd6-28e65ff4d0b7", "tag": "106907e5-bf3f-4a30-badd-9d493457de51"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:37:01.052255 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:37:01.058449 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-844c6de8-c89d-4af3-8c81-6561e7968611 req-07a93ebb-f6fd-4f42-abe4-fd6fcffe90c5 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:37:01.058950 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-844c6de8-c89d-4af3-8c81-6561e7968611 req-07a93ebb-f6fd-4f42-abe4-fd6fcffe90c5 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:37:01.059393 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-844c6de8-c89d-4af3-8c81-6561e7968611 req-07a93ebb-f6fd-4f42-abe4-fd6fcffe90c5 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:37:01.071496 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-844c6de8-c89d-4af3-8c81-6561e7968611 req-07a93ebb-f6fd-4f42-abe4-fd6fcffe90c5 service nova] Creating event network-changed:106907e5-bf3f-4a30-badd-9d493457de51 for instance 95d38066-ca04-4351-abd6-28e65ff4d0b7 on n-h2-846463-3 Sep 23 05:37:01.077815 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [req-844c6de8-c89d-4af3-8c81-6561e7968611 req-07a93ebb-f6fd-4f42-abe4-fd6fcffe90c5 service nova] Instance 95d38066-ca04-4351-abd6-28e65ff4d0b7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846463-3', 'n-h2-846463-3'} {{(pid=122698) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 23 05:37:01.088953 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-844c6de8-c89d-4af3-8c81-6561e7968611 req-07a93ebb-f6fd-4f42-abe4-fd6fcffe90c5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049368 Sep 23 05:37:01.089566 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3661/7502] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:37:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:37:01.142438 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-53591707-a19d-47de-a443-1743860d5734 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:37:01.143237 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-53591707-a19d-47de-a443-1743860d5734 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 95d38066-ca04-4351-abd6-28e65ff4d0b7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:37:01.147186 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=32 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:37:01.151170 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-53591707-a19d-47de-a443-1743860d5734 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:37:01.151692 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-53591707-a19d-47de-a443-1743860d5734 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:37:01.152132 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-53591707-a19d-47de-a443-1743860d5734 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:37:01.152853 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-53591707-a19d-47de-a443-1743860d5734 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:37:01.153358 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-53591707-a19d-47de-a443-1743860d5734 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:37:01.153795 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-53591707-a19d-47de-a443-1743860d5734 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:37:01.301993 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-53591707-a19d-47de-a443-1743860d5734 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:37:01.304999 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=100 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:37:01.313470 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-53591707-a19d-47de-a443-1743860d5734 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7" status: 200 len: 1724 microversion: 2.1 time: 0.176322 Sep 23 05:37:01.327588 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3842/7503] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:37:01 2022] GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7 => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:37:02.346273 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0cc1d5d2-c5ba-4676-add1-46c5fd47c40d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:37:02.347132 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-0cc1d5d2-c5ba-4676-add1-46c5fd47c40d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 95d38066-ca04-4351-abd6-28e65ff4d0b7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:37:02.355726 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0cc1d5d2-c5ba-4676-add1-46c5fd47c40d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:37:02.356349 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0cc1d5d2-c5ba-4676-add1-46c5fd47c40d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:37:02.356898 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0cc1d5d2-c5ba-4676-add1-46c5fd47c40d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:37:02.358367 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0cc1d5d2-c5ba-4676-add1-46c5fd47c40d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:37:02.358924 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0cc1d5d2-c5ba-4676-add1-46c5fd47c40d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:37:02.359443 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0cc1d5d2-c5ba-4676-add1-46c5fd47c40d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:37:02.510595 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-0cc1d5d2-c5ba-4676-add1-46c5fd47c40d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:37:02.521111 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0cc1d5d2-c5ba-4676-add1-46c5fd47c40d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7" status: 200 len: 1724 microversion: 2.1 time: 0.182543 Sep 23 05:37:02.521706 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3662/7504] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:37:02 2022] GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7 => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:37:03.545786 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-78e17922-ecf5-4a5a-9706-2ca7e13dd3bb tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:37:03.546423 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-78e17922-ecf5-4a5a-9706-2ca7e13dd3bb tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 95d38066-ca04-4351-abd6-28e65ff4d0b7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:37:03.553216 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-78e17922-ecf5-4a5a-9706-2ca7e13dd3bb tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:37:03.553778 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-78e17922-ecf5-4a5a-9706-2ca7e13dd3bb tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:37:03.554252 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-78e17922-ecf5-4a5a-9706-2ca7e13dd3bb tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:37:03.555071 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-78e17922-ecf5-4a5a-9706-2ca7e13dd3bb tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:37:03.558833 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-78e17922-ecf5-4a5a-9706-2ca7e13dd3bb tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:37:03.558833 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-78e17922-ecf5-4a5a-9706-2ca7e13dd3bb tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:37:03.692001 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-78e17922-ecf5-4a5a-9706-2ca7e13dd3bb tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:37:03.700850 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-78e17922-ecf5-4a5a-9706-2ca7e13dd3bb tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7" status: 200 len: 1724 microversion: 2.1 time: 0.159439 Sep 23 05:37:03.702376 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3843/7505] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:37:03 2022] GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:37:04.724803 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8e5acf88-46b4-462f-a471-0b037e8d90c0 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:37:04.725446 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8e5acf88-46b4-462f-a471-0b037e8d90c0 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 95d38066-ca04-4351-abd6-28e65ff4d0b7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:37:04.727455 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=3 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:37:04.733187 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8e5acf88-46b4-462f-a471-0b037e8d90c0 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:37:04.733694 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8e5acf88-46b4-462f-a471-0b037e8d90c0 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:37:04.734186 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8e5acf88-46b4-462f-a471-0b037e8d90c0 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:37:04.734909 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8e5acf88-46b4-462f-a471-0b037e8d90c0 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:37:04.735394 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8e5acf88-46b4-462f-a471-0b037e8d90c0 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:37:04.735851 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8e5acf88-46b4-462f-a471-0b037e8d90c0 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:37:04.874104 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8e5acf88-46b4-462f-a471-0b037e8d90c0 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:37:04.882450 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8e5acf88-46b4-462f-a471-0b037e8d90c0 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7" status: 200 len: 1724 microversion: 2.1 time: 0.161572 Sep 23 05:37:04.883260 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3663/7506] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:37:04 2022] GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:37:05.912852 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a472663e-5e60-45ba-b4b0-36e2bcf13f9d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:37:05.913496 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a472663e-5e60-45ba-b4b0-36e2bcf13f9d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 95d38066-ca04-4351-abd6-28e65ff4d0b7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:37:05.919740 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a472663e-5e60-45ba-b4b0-36e2bcf13f9d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:37:05.920932 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a472663e-5e60-45ba-b4b0-36e2bcf13f9d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:37:05.921376 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a472663e-5e60-45ba-b4b0-36e2bcf13f9d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:37:05.922105 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a472663e-5e60-45ba-b4b0-36e2bcf13f9d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:37:05.922569 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a472663e-5e60-45ba-b4b0-36e2bcf13f9d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:37:05.922998 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a472663e-5e60-45ba-b4b0-36e2bcf13f9d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:37:06.052226 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a472663e-5e60-45ba-b4b0-36e2bcf13f9d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:37:06.060575 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a472663e-5e60-45ba-b4b0-36e2bcf13f9d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7" status: 200 len: 1724 microversion: 2.1 time: 0.151791 Sep 23 05:37:06.061150 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3844/7507] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:37:05 2022] GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:37:07.083972 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3ebe82cc-a2d0-4728-be0e-3c936f8d190d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:37:07.084556 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3ebe82cc-a2d0-4728-be0e-3c936f8d190d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 95d38066-ca04-4351-abd6-28e65ff4d0b7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:37:07.091352 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3ebe82cc-a2d0-4728-be0e-3c936f8d190d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:37:07.092543 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3ebe82cc-a2d0-4728-be0e-3c936f8d190d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:37:07.093047 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3ebe82cc-a2d0-4728-be0e-3c936f8d190d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:37:07.093779 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3ebe82cc-a2d0-4728-be0e-3c936f8d190d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:37:07.094274 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3ebe82cc-a2d0-4728-be0e-3c936f8d190d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:37:07.094716 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3ebe82cc-a2d0-4728-be0e-3c936f8d190d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:37:07.228135 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-3ebe82cc-a2d0-4728-be0e-3c936f8d190d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:37:07.237028 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3ebe82cc-a2d0-4728-be0e-3c936f8d190d tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7" status: 200 len: 1724 microversion: 2.1 time: 0.157066 Sep 23 05:37:07.237601 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3664/7508] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:37:07 2022] GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:37:08.260875 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3dc139bb-74b8-4afb-b443-279706349159 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:37:08.261549 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-3dc139bb-74b8-4afb-b443-279706349159 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 95d38066-ca04-4351-abd6-28e65ff4d0b7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:37:08.269039 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3dc139bb-74b8-4afb-b443-279706349159 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:37:08.269544 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3dc139bb-74b8-4afb-b443-279706349159 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:37:08.270010 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3dc139bb-74b8-4afb-b443-279706349159 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:37:08.270715 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3dc139bb-74b8-4afb-b443-279706349159 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:37:08.271188 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3dc139bb-74b8-4afb-b443-279706349159 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:37:08.271621 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3dc139bb-74b8-4afb-b443-279706349159 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:37:08.411048 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-3dc139bb-74b8-4afb-b443-279706349159 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:37:08.419400 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3dc139bb-74b8-4afb-b443-279706349159 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7" status: 200 len: 1724 microversion: 2.1 time: 0.162478 Sep 23 05:37:08.420009 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3845/7509] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:37:08 2022] GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:37:09.443272 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8c896753-727c-4536-a35a-a7141e56dc58 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:37:09.443902 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8c896753-727c-4536-a35a-a7141e56dc58 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 95d38066-ca04-4351-abd6-28e65ff4d0b7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:37:09.450845 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8c896753-727c-4536-a35a-a7141e56dc58 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:37:09.451842 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8c896753-727c-4536-a35a-a7141e56dc58 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:37:09.452297 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8c896753-727c-4536-a35a-a7141e56dc58 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:37:09.453014 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8c896753-727c-4536-a35a-a7141e56dc58 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:37:09.453491 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8c896753-727c-4536-a35a-a7141e56dc58 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:37:09.453958 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8c896753-727c-4536-a35a-a7141e56dc58 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:37:09.585836 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8c896753-727c-4536-a35a-a7141e56dc58 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:37:09.594650 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8c896753-727c-4536-a35a-a7141e56dc58 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7" status: 200 len: 1724 microversion: 2.1 time: 0.155264 Sep 23 05:37:09.595244 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3665/7510] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:37:09 2022] GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:37:10.617303 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a0360578-d231-425f-891b-53358e38f470 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:37:10.617947 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a0360578-d231-425f-891b-53358e38f470 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 95d38066-ca04-4351-abd6-28e65ff4d0b7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:37:10.624418 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a0360578-d231-425f-891b-53358e38f470 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:37:10.624906 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a0360578-d231-425f-891b-53358e38f470 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:37:10.625346 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a0360578-d231-425f-891b-53358e38f470 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:37:10.626068 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a0360578-d231-425f-891b-53358e38f470 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:37:10.626531 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a0360578-d231-425f-891b-53358e38f470 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:37:10.626954 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a0360578-d231-425f-891b-53358e38f470 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:37:10.762438 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a0360578-d231-425f-891b-53358e38f470 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:37:10.771574 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a0360578-d231-425f-891b-53358e38f470 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7" status: 200 len: 1724 microversion: 2.1 time: 0.158213 Sep 23 05:37:10.772149 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3846/7511] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:37:10 2022] GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:37:11.796181 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f04f2ea9-766c-4e36-a917-462f6161fb73 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:37:11.796846 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f04f2ea9-766c-4e36-a917-462f6161fb73 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 95d38066-ca04-4351-abd6-28e65ff4d0b7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:37:11.803620 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f04f2ea9-766c-4e36-a917-462f6161fb73 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:37:11.804128 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f04f2ea9-766c-4e36-a917-462f6161fb73 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:37:11.804579 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f04f2ea9-766c-4e36-a917-462f6161fb73 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:37:11.805283 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f04f2ea9-766c-4e36-a917-462f6161fb73 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:37:11.805754 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f04f2ea9-766c-4e36-a917-462f6161fb73 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:37:11.806223 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f04f2ea9-766c-4e36-a917-462f6161fb73 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:37:11.934738 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f04f2ea9-766c-4e36-a917-462f6161fb73 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:37:11.946072 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f04f2ea9-766c-4e36-a917-462f6161fb73 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7" status: 200 len: 1724 microversion: 2.1 time: 0.154454 Sep 23 05:37:11.946652 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3666/7512] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:37:11 2022] GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:37:12.969284 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-987f9e63-0b04-4fb3-a6d6-95792ef156d3 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:37:12.969919 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-987f9e63-0b04-4fb3-a6d6-95792ef156d3 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 95d38066-ca04-4351-abd6-28e65ff4d0b7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:37:12.976345 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-987f9e63-0b04-4fb3-a6d6-95792ef156d3 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:37:12.978094 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-987f9e63-0b04-4fb3-a6d6-95792ef156d3 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:37:12.978094 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-987f9e63-0b04-4fb3-a6d6-95792ef156d3 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:37:12.978094 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-987f9e63-0b04-4fb3-a6d6-95792ef156d3 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:37:12.978430 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-987f9e63-0b04-4fb3-a6d6-95792ef156d3 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:37:12.978866 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-987f9e63-0b04-4fb3-a6d6-95792ef156d3 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:37:13.120438 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-987f9e63-0b04-4fb3-a6d6-95792ef156d3 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:37:13.129676 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-987f9e63-0b04-4fb3-a6d6-95792ef156d3 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7" status: 200 len: 1717 microversion: 2.1 time: 0.164267 Sep 23 05:37:13.130347 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3847/7513] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:37:12 2022] GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7 => generated 1717 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:37:13.152652 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-fd3e8e84-1ea3-4824-a496-9992c160f3ae tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:37:13.153285 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-fd3e8e84-1ea3-4824-a496-9992c160f3ae tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 95d38066-ca04-4351-abd6-28e65ff4d0b7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:37:13.160338 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fd3e8e84-1ea3-4824-a496-9992c160f3ae tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:37:13.160854 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fd3e8e84-1ea3-4824-a496-9992c160f3ae tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:37:13.161317 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fd3e8e84-1ea3-4824-a496-9992c160f3ae tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:37:13.162121 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fd3e8e84-1ea3-4824-a496-9992c160f3ae tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:37:13.162608 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fd3e8e84-1ea3-4824-a496-9992c160f3ae tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:37:13.163060 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fd3e8e84-1ea3-4824-a496-9992c160f3ae tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:37:13.293805 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-fd3e8e84-1ea3-4824-a496-9992c160f3ae tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:37:13.302906 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-fd3e8e84-1ea3-4824-a496-9992c160f3ae tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7" status: 200 len: 1717 microversion: 2.1 time: 0.154162 Sep 23 05:37:13.303499 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3667/7514] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:37:13 2022] GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7 => generated 1717 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:37:13.325416 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-30f7a26d-b071-450d-a4b4-b87a51d6b670 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:37:13.326123 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-30f7a26d-b071-450d-a4b4-b87a51d6b670 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 95d38066-ca04-4351-abd6-28e65ff4d0b7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:37:13.332262 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-30f7a26d-b071-450d-a4b4-b87a51d6b670 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:37:13.332792 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-30f7a26d-b071-450d-a4b4-b87a51d6b670 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:37:13.333219 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-30f7a26d-b071-450d-a4b4-b87a51d6b670 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:37:13.333963 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-30f7a26d-b071-450d-a4b4-b87a51d6b670 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:37:13.334433 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-30f7a26d-b071-450d-a4b4-b87a51d6b670 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:37:13.334867 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-30f7a26d-b071-450d-a4b4-b87a51d6b670 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:37:13.467227 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-30f7a26d-b071-450d-a4b4-b87a51d6b670 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:37:13.475629 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-30f7a26d-b071-450d-a4b4-b87a51d6b670 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7" status: 200 len: 1717 microversion: 2.1 time: 0.154188 Sep 23 05:37:13.476165 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3848/7515] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:37:13 2022] GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7 => generated 1717 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:37:13.499433 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a74ad84e-ead3-4d82-971a-483caefea4ee tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:37:13.499892 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a74ad84e-ead3-4d82-971a-483caefea4ee tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 95d38066-ca04-4351-abd6-28e65ff4d0b7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:37:13.505878 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a74ad84e-ead3-4d82-971a-483caefea4ee tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:37:13.506419 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a74ad84e-ead3-4d82-971a-483caefea4ee tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:37:13.506882 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a74ad84e-ead3-4d82-971a-483caefea4ee tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:37:13.507600 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a74ad84e-ead3-4d82-971a-483caefea4ee tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:37:13.508083 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a74ad84e-ead3-4d82-971a-483caefea4ee tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:37:13.508533 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a74ad84e-ead3-4d82-971a-483caefea4ee tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:37:13.533657 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a74ad84e-ead3-4d82-971a-483caefea4ee tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 95d38066-ca04-4351-abd6-28e65ff4d0b7] Going to try to terminate instance {{(pid=122698) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 05:37:13.806840 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a74ad84e-ead3-4d82-971a-483caefea4ee tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "DELETE /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7" status: 204 len: 0 microversion: 2.1 time: 0.311017 Sep 23 05:37:13.807363 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3668/7516] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 05:37:13 2022] DELETE /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 05:37:13.815444 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-799adb9e-f73c-49cd-bb45-6396fcf335a7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:37:13.816059 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-799adb9e-f73c-49cd-bb45-6396fcf335a7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 95d38066-ca04-4351-abd6-28e65ff4d0b7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:37:13.822038 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-799adb9e-f73c-49cd-bb45-6396fcf335a7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:37:13.822530 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-799adb9e-f73c-49cd-bb45-6396fcf335a7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:37:13.827867 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-799adb9e-f73c-49cd-bb45-6396fcf335a7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:37:13.827867 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-799adb9e-f73c-49cd-bb45-6396fcf335a7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:37:13.827867 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-799adb9e-f73c-49cd-bb45-6396fcf335a7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:37:13.827867 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-799adb9e-f73c-49cd-bb45-6396fcf335a7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:37:13.954118 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-799adb9e-f73c-49cd-bb45-6396fcf335a7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:37:13.962788 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-799adb9e-f73c-49cd-bb45-6396fcf335a7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7" status: 200 len: 1723 microversion: 2.1 time: 0.151223 Sep 23 05:37:13.963365 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3849/7517] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:37:13 2022] GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:37:14.957580 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-2366f6e6-5ebd-40fa-b871-13e1a1322836 req-2cba805f-5f14-4b47-b423-63cecef208e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95d38066-ca04-4351-abd6-28e65ff4d0b7", "name": "network-vif-plugged", "status": "completed", "tag": "106907e5-bf3f-4a30-badd-9d493457de51"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:37:14.969880 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-2366f6e6-5ebd-40fa-b871-13e1a1322836 req-2cba805f-5f14-4b47-b423-63cecef208e3 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:37:14.970411 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-2366f6e6-5ebd-40fa-b871-13e1a1322836 req-2cba805f-5f14-4b47-b423-63cecef208e3 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:37:14.970865 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-2366f6e6-5ebd-40fa-b871-13e1a1322836 req-2cba805f-5f14-4b47-b423-63cecef208e3 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:37:14.981150 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-2366f6e6-5ebd-40fa-b871-13e1a1322836 req-2cba805f-5f14-4b47-b423-63cecef208e3 service nova] Creating event network-vif-plugged:106907e5-bf3f-4a30-badd-9d493457de51 for instance 95d38066-ca04-4351-abd6-28e65ff4d0b7 on n-h2-846463-3 Sep 23 05:37:14.986772 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-2366f6e6-5ebd-40fa-b871-13e1a1322836 req-2cba805f-5f14-4b47-b423-63cecef208e3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033605 Sep 23 05:37:14.987373 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3669/7518] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:37:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:37:14.987855 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3ca66b09-36ab-40b2-a31d-39b5e6582ac2 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:37:14.988503 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-3ca66b09-36ab-40b2-a31d-39b5e6582ac2 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 95d38066-ca04-4351-abd6-28e65ff4d0b7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:37:14.995224 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3ca66b09-36ab-40b2-a31d-39b5e6582ac2 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:37:14.995737 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3ca66b09-36ab-40b2-a31d-39b5e6582ac2 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:37:14.996160 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3ca66b09-36ab-40b2-a31d-39b5e6582ac2 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:37:14.996865 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3ca66b09-36ab-40b2-a31d-39b5e6582ac2 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:37:14.997327 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3ca66b09-36ab-40b2-a31d-39b5e6582ac2 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:37:14.997813 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3ca66b09-36ab-40b2-a31d-39b5e6582ac2 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:37:15.130858 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-3ca66b09-36ab-40b2-a31d-39b5e6582ac2 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:37:15.139640 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3ca66b09-36ab-40b2-a31d-39b5e6582ac2 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7" status: 200 len: 1723 microversion: 2.1 time: 0.156024 Sep 23 05:37:15.140654 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3850/7519] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:37:14 2022] GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:37:16.166892 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c14c5fb0-fff7-4b41-8168-a797e105aa10 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:37:16.167633 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c14c5fb0-fff7-4b41-8168-a797e105aa10 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 95d38066-ca04-4351-abd6-28e65ff4d0b7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:37:16.174023 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c14c5fb0-fff7-4b41-8168-a797e105aa10 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:37:16.174537 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c14c5fb0-fff7-4b41-8168-a797e105aa10 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:37:16.174994 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c14c5fb0-fff7-4b41-8168-a797e105aa10 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:37:16.175750 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c14c5fb0-fff7-4b41-8168-a797e105aa10 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:37:16.176228 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c14c5fb0-fff7-4b41-8168-a797e105aa10 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:37:16.176679 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c14c5fb0-fff7-4b41-8168-a797e105aa10 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:37:16.247445 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c14c5fb0-fff7-4b41-8168-a797e105aa10 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:37:16.258467 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c14c5fb0-fff7-4b41-8168-a797e105aa10 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7" status: 200 len: 1656 microversion: 2.1 time: 0.097038 Sep 23 05:37:16.259258 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3670/7520] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:37:16 2022] GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7 => generated 1656 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:37:16.289697 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-82336061-8791-49d6-b7c5-899e9a1e1951 req-8f84ba86-6c43-4e6c-9d7e-7f9c973ae64e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95d38066-ca04-4351-abd6-28e65ff4d0b7", "name": "network-vif-deleted", "tag": "106907e5-bf3f-4a30-badd-9d493457de51"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:37:16.300086 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-82336061-8791-49d6-b7c5-899e9a1e1951 req-8f84ba86-6c43-4e6c-9d7e-7f9c973ae64e service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:37:16.304113 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-82336061-8791-49d6-b7c5-899e9a1e1951 req-8f84ba86-6c43-4e6c-9d7e-7f9c973ae64e service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:37:16.304113 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-82336061-8791-49d6-b7c5-899e9a1e1951 req-8f84ba86-6c43-4e6c-9d7e-7f9c973ae64e service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:37:16.314175 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-82336061-8791-49d6-b7c5-899e9a1e1951 req-8f84ba86-6c43-4e6c-9d7e-7f9c973ae64e service nova] Creating event network-vif-deleted:106907e5-bf3f-4a30-badd-9d493457de51 for instance 95d38066-ca04-4351-abd6-28e65ff4d0b7 on n-h2-846463-3 Sep 23 05:37:16.319241 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-82336061-8791-49d6-b7c5-899e9a1e1951 req-8f84ba86-6c43-4e6c-9d7e-7f9c973ae64e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033216 Sep 23 05:37:16.319833 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3851/7521] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:37:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:37:17.284805 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-55c672b4-1302-43da-9372-043028d787f6 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:37:17.285624 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-55c672b4-1302-43da-9372-043028d787f6 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 95d38066-ca04-4351-abd6-28e65ff4d0b7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:37:17.292471 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-55c672b4-1302-43da-9372-043028d787f6 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:37:17.293002 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-55c672b4-1302-43da-9372-043028d787f6 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:37:17.293471 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-55c672b4-1302-43da-9372-043028d787f6 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:37:17.294400 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-55c672b4-1302-43da-9372-043028d787f6 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:37:17.295444 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-55c672b4-1302-43da-9372-043028d787f6 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:37:17.295894 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-55c672b4-1302-43da-9372-043028d787f6 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:37:17.375305 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-55c672b4-1302-43da-9372-043028d787f6 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:37:17.383838 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-55c672b4-1302-43da-9372-043028d787f6 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7" status: 200 len: 1370 microversion: 2.1 time: 0.103256 Sep 23 05:37:17.385508 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3671/7522] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:37:17 2022] GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7 => generated 1370 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:37:18.409763 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-03b13670-1c1f-4224-9e90-b7db929e165b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:37:18.410424 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-03b13670-1c1f-4224-9e90-b7db929e165b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 95d38066-ca04-4351-abd6-28e65ff4d0b7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:37:18.416631 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-03b13670-1c1f-4224-9e90-b7db929e165b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:37:18.417121 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-03b13670-1c1f-4224-9e90-b7db929e165b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:37:18.417557 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-03b13670-1c1f-4224-9e90-b7db929e165b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:37:18.418271 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-03b13670-1c1f-4224-9e90-b7db929e165b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:37:18.418727 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-03b13670-1c1f-4224-9e90-b7db929e165b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:37:18.419150 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-03b13670-1c1f-4224-9e90-b7db929e165b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:37:18.482187 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-03b13670-1c1f-4224-9e90-b7db929e165b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:37:18.490504 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-03b13670-1c1f-4224-9e90-b7db929e165b tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7" status: 200 len: 1370 microversion: 2.1 time: 0.086298 Sep 23 05:37:18.491079 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3852/7523] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:37:18 2022] GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7 => generated 1370 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:37:19.514334 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1161c1a4-ae21-41f8-b5b2-9a94e4e782d4 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:37:19.514896 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-1161c1a4-ae21-41f8-b5b2-9a94e4e782d4 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 95d38066-ca04-4351-abd6-28e65ff4d0b7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:37:19.522130 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1161c1a4-ae21-41f8-b5b2-9a94e4e782d4 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:37:19.522645 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1161c1a4-ae21-41f8-b5b2-9a94e4e782d4 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:37:19.523105 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1161c1a4-ae21-41f8-b5b2-9a94e4e782d4 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:37:19.523826 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1161c1a4-ae21-41f8-b5b2-9a94e4e782d4 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:37:19.524304 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1161c1a4-ae21-41f8-b5b2-9a94e4e782d4 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:37:19.524754 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1161c1a4-ae21-41f8-b5b2-9a94e4e782d4 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:37:19.588688 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-1161c1a4-ae21-41f8-b5b2-9a94e4e782d4 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:37:19.597569 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-1161c1a4-ae21-41f8-b5b2-9a94e4e782d4 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7" status: 200 len: 1370 microversion: 2.1 time: 0.087436 Sep 23 05:37:19.598183 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3672/7524] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:37:19 2022] GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7 => generated 1370 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:37:20.620622 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-cf2d5744-52a9-4a7f-9f70-41f0d31cb0ce tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:37:20.621273 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-cf2d5744-52a9-4a7f-9f70-41f0d31cb0ce tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 95d38066-ca04-4351-abd6-28e65ff4d0b7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:37:20.628123 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cf2d5744-52a9-4a7f-9f70-41f0d31cb0ce tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:37:20.630380 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cf2d5744-52a9-4a7f-9f70-41f0d31cb0ce tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:37:20.630380 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cf2d5744-52a9-4a7f-9f70-41f0d31cb0ce tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:37:20.630380 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cf2d5744-52a9-4a7f-9f70-41f0d31cb0ce tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:37:20.630380 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cf2d5744-52a9-4a7f-9f70-41f0d31cb0ce tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:37:20.630778 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cf2d5744-52a9-4a7f-9f70-41f0d31cb0ce tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:37:20.694045 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-cf2d5744-52a9-4a7f-9f70-41f0d31cb0ce tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f398aeafcbcb48d88d8cfd3bdf59bbed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f991e11ed0c44131a4bd9be0110dffe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:37:20.702915 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-cf2d5744-52a9-4a7f-9f70-41f0d31cb0ce tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7" status: 200 len: 1370 microversion: 2.1 time: 0.086132 Sep 23 05:37:20.703950 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3853/7525] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:37:20 2022] GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7 => generated 1370 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:37:21.727402 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f62c92e9-dcdb-4a7d-8054-1a41003a2ad7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:37:21.728284 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f62c92e9-dcdb-4a7d-8054-1a41003a2ad7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 95d38066-ca04-4351-abd6-28e65ff4d0b7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:37:21.737688 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f62c92e9-dcdb-4a7d-8054-1a41003a2ad7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:37:21.738263 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f62c92e9-dcdb-4a7d-8054-1a41003a2ad7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:37:21.738733 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f62c92e9-dcdb-4a7d-8054-1a41003a2ad7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:37:21.739676 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f62c92e9-dcdb-4a7d-8054-1a41003a2ad7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:37:21.740340 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f62c92e9-dcdb-4a7d-8054-1a41003a2ad7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:37:21.740858 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f62c92e9-dcdb-4a7d-8054-1a41003a2ad7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:37:21.755027 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-f62c92e9-dcdb-4a7d-8054-1a41003a2ad7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] HTTP exception thrown: Instance 95d38066-ca04-4351-abd6-28e65ff4d0b7 could not be found. Sep 23 05:37:21.756710 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f62c92e9-dcdb-4a7d-8054-1a41003a2ad7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Request method failure captured: Sep 23 05:37:21.756710 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7 HTTP/1.1 Sep 23 05:37:21.756710 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 05:37:21.756710 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 05:37:21.756710 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 05:37:21.756710 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 05:37:21.756710 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 05:37:21.756710 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 05:37:21.756710 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 05:37:21.756710 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 05:37:21.756710 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLUSNPTcpFt7b1SQrBrdC4rAqFbUXLEG8j5xh3rTP1qyrEhV8SHPScnfZxRBpUy9MBZ19dFgqZBh9ggYKPA2VLn9rpizyOQlJ_nBmDT4jVqC1BV3Kf2f8DXLNaNiW44Z1VNZeBb_3I4dNJUWbXOX8beHhp39Bmiy2ImuZpbhlNdAaR6A Sep 23 05:37:21.756710 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 05:37:21.756710 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 05:37:21.756710 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 05:37:21.756710 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 05:37:21.756710 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 05:37:21.756710 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 05:37:21.756710 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: f991e11ed0c44131a4bd9be0110dffe0 Sep 23 05:37:21.756710 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ServerActionsTestJSON-551956227 Sep 23 05:37:21.756710 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 05:37:21.756710 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 05:37:21.756710 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f991e11ed0c44131a4bd9be0110dffe0", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f991e11ed0c44131a4bd9be0110dffe0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f991e11ed0c44131a4bd9be0110dffe0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f991e11ed0c44131a4bd9be0110dffe0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:37:21.756710 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ServerActionsTestJSON-551956227 Sep 23 05:37:21.756710 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: f991e11ed0c44131a4bd9be0110dffe0 Sep 23 05:37:21.756710 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ServerActionsTestJSON-551956227 Sep 23 05:37:21.756710 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ServerActionsTestJSON-551956227-project Sep 23 05:37:21.756710 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 05:37:21.756710 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 05:37:21.756710 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: f398aeafcbcb48d88d8cfd3bdf59bbed Sep 23 05:37:21.756710 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ServerActionsTestJSON-551956227-project Sep 23 05:37:21.756710 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 05:37:21.756710 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 95d38066-ca04-4351-abd6-28e65ff4d0b7 could not be found. Sep 23 05:37:21.756710 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '95d38066-ca04-4351-abd6-28e65ff4d0b7'} Sep 23 05:37:21.756710 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:37:21.756710 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:37:21.756710 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 05:37:21.756710 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 05:37:21.756710 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 05:37:21.756710 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 05:37:21.756710 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 05:37:21.756710 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 05:37:21.756710 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 05:37:21.756710 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 05:37:21.756710 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95d38066-ca04-4351-abd6-28e65ff4d0b7 could not be found. Sep 23 05:37:21.756710 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:37:21.756710 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:37:21.756710 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:37:21.756710 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:37:21.756710 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:37:21.756710 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:37:21.756710 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:37:21.756710 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:37:21.756710 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:37:21.756710 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:37:21.756710 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 05:37:21.756710 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 05:37:21.756710 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 05:37:21.756710 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 05:37:21.756710 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 05:37:21.756710 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:37:21.756710 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95d38066-ca04-4351-abd6-28e65ff4d0b7 could not be found. Sep 23 05:37:21.756710 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:37:21.756710 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:37:21.756710 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:37:21.761776 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:37:21.761776 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:37:21.761776 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:37:21.761776 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:37:21.761776 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:37:21.761776 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95d38066-ca04-4351-abd6-28e65ff4d0b7 could not be found. Sep 23 05:37:21.761776 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:37:21.761776 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f62c92e9-dcdb-4a7d-8054-1a41003a2ad7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Returning 404 to user: Instance 95d38066-ca04-4351-abd6-28e65ff4d0b7 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:37:21.761776 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f62c92e9-dcdb-4a7d-8054-1a41003a2ad7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7" status: 404 len: 111 microversion: 2.1 time: 0.036136 Sep 23 05:37:21.761776 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3673/7526] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:37:21 2022] GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 05:37:21.820551 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3b8b8a89-0bc1-45c5-b4a8-8768c4267823 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:37:21.822794 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-3b8b8a89-0bc1-45c5-b4a8-8768c4267823 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 95d38066-ca04-4351-abd6-28e65ff4d0b7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:37:21.829244 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3b8b8a89-0bc1-45c5-b4a8-8768c4267823 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:37:21.829739 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3b8b8a89-0bc1-45c5-b4a8-8768c4267823 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:37:21.830218 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3b8b8a89-0bc1-45c5-b4a8-8768c4267823 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:37:21.830920 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3b8b8a89-0bc1-45c5-b4a8-8768c4267823 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:37:21.831387 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3b8b8a89-0bc1-45c5-b4a8-8768c4267823 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:37:21.831824 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3b8b8a89-0bc1-45c5-b4a8-8768c4267823 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:37:21.844757 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-3b8b8a89-0bc1-45c5-b4a8-8768c4267823 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] HTTP exception thrown: Instance 95d38066-ca04-4351-abd6-28e65ff4d0b7 could not be found. Sep 23 05:37:21.846452 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3b8b8a89-0bc1-45c5-b4a8-8768c4267823 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Request method failure captured: Sep 23 05:37:21.846452 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7/os-volume_attachments HTTP/1.1 Sep 23 05:37:21.846452 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 05:37:21.846452 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 05:37:21.846452 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 05:37:21.846452 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 05:37:21.846452 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 05:37:21.846452 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 05:37:21.846452 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 05:37:21.846452 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 05:37:21.846452 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLUSNPTcpFt7b1SQrBrdC4rAqFbUXLEG8j5xh3rTP1qyrEhV8SHPScnfZxRBpUy9MBZ19dFgqZBh9ggYKPA2VLn9rpizyOQlJ_nBmDT4jVqC1BV3Kf2f8DXLNaNiW44Z1VNZeBb_3I4dNJUWbXOX8beHhp39Bmiy2ImuZpbhlNdAaR6A Sep 23 05:37:21.846452 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 05:37:21.846452 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 05:37:21.846452 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 05:37:21.846452 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 05:37:21.846452 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 05:37:21.846452 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 05:37:21.846452 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: f991e11ed0c44131a4bd9be0110dffe0 Sep 23 05:37:21.846452 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ServerActionsTestJSON-551956227 Sep 23 05:37:21.846452 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 05:37:21.846452 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 05:37:21.846452 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f991e11ed0c44131a4bd9be0110dffe0", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f991e11ed0c44131a4bd9be0110dffe0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f991e11ed0c44131a4bd9be0110dffe0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f991e11ed0c44131a4bd9be0110dffe0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:37:21.846452 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ServerActionsTestJSON-551956227 Sep 23 05:37:21.846452 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: f991e11ed0c44131a4bd9be0110dffe0 Sep 23 05:37:21.846452 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ServerActionsTestJSON-551956227 Sep 23 05:37:21.846452 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ServerActionsTestJSON-551956227-project Sep 23 05:37:21.846452 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 05:37:21.846452 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 05:37:21.846452 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: f398aeafcbcb48d88d8cfd3bdf59bbed Sep 23 05:37:21.846452 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ServerActionsTestJSON-551956227-project Sep 23 05:37:21.846452 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 05:37:21.846452 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 95d38066-ca04-4351-abd6-28e65ff4d0b7 could not be found. Sep 23 05:37:21.846452 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'server_id': '95d38066-ca04-4351-abd6-28e65ff4d0b7'} Sep 23 05:37:21.846452 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:37:21.846452 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:37:21.846452 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 05:37:21.846452 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 05:37:21.846452 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 05:37:21.846452 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 05:37:21.846452 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 05:37:21.846452 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 05:37:21.846452 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 05:37:21.846452 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 05:37:21.846452 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95d38066-ca04-4351-abd6-28e65ff4d0b7 could not be found. Sep 23 05:37:21.846452 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:37:21.846452 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:37:21.846452 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:37:21.846452 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:37:21.846452 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:37:21.846452 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:37:21.846452 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:37:21.846452 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:37:21.846452 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:37:21.846452 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:37:21.846452 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 23 05:37:21.846452 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 05:37:21.846452 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 23 05:37:21.846452 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 05:37:21.846452 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 23 05:37:21.846452 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 23 05:37:21.846452 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 05:37:21.846452 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:37:21.851586 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95d38066-ca04-4351-abd6-28e65ff4d0b7 could not be found. Sep 23 05:37:21.851586 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:37:21.851586 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:37:21.851586 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:37:21.851586 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:37:21.851586 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:37:21.851586 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:37:21.851586 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:37:21.851586 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:37:21.851586 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95d38066-ca04-4351-abd6-28e65ff4d0b7 could not be found. Sep 23 05:37:21.851586 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:37:21.851586 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3b8b8a89-0bc1-45c5-b4a8-8768c4267823 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Returning 404 to user: Instance 95d38066-ca04-4351-abd6-28e65ff4d0b7 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:37:21.851586 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3b8b8a89-0bc1-45c5-b4a8-8768c4267823 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.031409 Sep 23 05:37:21.851586 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3854/7527] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Sep 23 05:37:21 2022] GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7/os-volume_attachments => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 05:37:25.323135 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7153937d-dceb-4bb0-bc71-c009ce89e5af tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:37:25.323661 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7153937d-dceb-4bb0-bc71-c009ce89e5af tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 95d38066-ca04-4351-abd6-28e65ff4d0b7] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:37:25.332309 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7153937d-dceb-4bb0-bc71-c009ce89e5af tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:37:25.332834 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7153937d-dceb-4bb0-bc71-c009ce89e5af tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:37:25.333300 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7153937d-dceb-4bb0-bc71-c009ce89e5af tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:37:25.334064 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7153937d-dceb-4bb0-bc71-c009ce89e5af tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:37:25.334549 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7153937d-dceb-4bb0-bc71-c009ce89e5af tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:37:25.335001 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7153937d-dceb-4bb0-bc71-c009ce89e5af tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:37:25.348957 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-7153937d-dceb-4bb0-bc71-c009ce89e5af tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] HTTP exception thrown: Instance 95d38066-ca04-4351-abd6-28e65ff4d0b7 could not be found. Sep 23 05:37:25.350603 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7153937d-dceb-4bb0-bc71-c009ce89e5af tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Request method failure captured: Sep 23 05:37:25.350603 n-d-846463-3 devstack@n-api.service[122698]: request: DELETE /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7 HTTP/1.1 Sep 23 05:37:25.350603 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 05:37:25.350603 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 05:37:25.350603 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 05:37:25.350603 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 05:37:25.350603 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 05:37:25.350603 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 05:37:25.350603 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 05:37:25.350603 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 05:37:25.350603 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLUSNPTcpFt7b1SQrBrdC4rAqFbUXLEG8j5xh3rTP1qyrEhV8SHPScnfZxRBpUy9MBZ19dFgqZBh9ggYKPA2VLn9rpizyOQlJ_nBmDT4jVqC1BV3Kf2f8DXLNaNiW44Z1VNZeBb_3I4dNJUWbXOX8beHhp39Bmiy2ImuZpbhlNdAaR6A Sep 23 05:37:25.350603 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 05:37:25.350603 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 05:37:25.350603 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 05:37:25.350603 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 05:37:25.350603 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 05:37:25.350603 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 05:37:25.350603 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: f991e11ed0c44131a4bd9be0110dffe0 Sep 23 05:37:25.350603 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ServerActionsTestJSON-551956227 Sep 23 05:37:25.350603 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 05:37:25.350603 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 05:37:25.350603 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f991e11ed0c44131a4bd9be0110dffe0", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f991e11ed0c44131a4bd9be0110dffe0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f991e11ed0c44131a4bd9be0110dffe0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f991e11ed0c44131a4bd9be0110dffe0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:37:25.350603 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ServerActionsTestJSON-551956227 Sep 23 05:37:25.350603 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: f991e11ed0c44131a4bd9be0110dffe0 Sep 23 05:37:25.350603 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ServerActionsTestJSON-551956227 Sep 23 05:37:25.350603 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ServerActionsTestJSON-551956227-project Sep 23 05:37:25.350603 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 05:37:25.350603 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 05:37:25.350603 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: f398aeafcbcb48d88d8cfd3bdf59bbed Sep 23 05:37:25.350603 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ServerActionsTestJSON-551956227-project Sep 23 05:37:25.350603 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 05:37:25.350603 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 95d38066-ca04-4351-abd6-28e65ff4d0b7 could not be found. Sep 23 05:37:25.350603 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '95d38066-ca04-4351-abd6-28e65ff4d0b7'} Sep 23 05:37:25.350603 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:37:25.350603 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:37:25.350603 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 05:37:25.350603 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 05:37:25.350603 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 05:37:25.350603 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 05:37:25.350603 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 05:37:25.350603 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 05:37:25.350603 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 05:37:25.350603 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 05:37:25.350603 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95d38066-ca04-4351-abd6-28e65ff4d0b7 could not be found. Sep 23 05:37:25.350603 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:37:25.350603 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:37:25.350603 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:37:25.350603 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:37:25.350603 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:37:25.350603 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:37:25.350603 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:37:25.350603 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:37:25.350603 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:37:25.350603 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:37:25.350603 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 05:37:25.350603 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 05:37:25.350603 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 05:37:25.350603 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 05:37:25.350603 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 05:37:25.350603 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 05:37:25.350603 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 05:37:25.350603 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:37:25.355258 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95d38066-ca04-4351-abd6-28e65ff4d0b7 could not be found. Sep 23 05:37:25.355258 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:37:25.355258 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:37:25.355258 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:37:25.355258 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:37:25.355258 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:37:25.355258 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:37:25.355258 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:37:25.355258 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:37:25.355258 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95d38066-ca04-4351-abd6-28e65ff4d0b7 could not be found. Sep 23 05:37:25.355258 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:37:25.355258 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7153937d-dceb-4bb0-bc71-c009ce89e5af tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Returning 404 to user: Instance 95d38066-ca04-4351-abd6-28e65ff4d0b7 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:37:25.355258 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7153937d-dceb-4bb0-bc71-c009ce89e5af tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "DELETE /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7" status: 404 len: 111 microversion: 2.1 time: 0.032876 Sep 23 05:37:25.355258 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3674/7528] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 05:37:25 2022] DELETE /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 05:37:25.360546 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-aa7697eb-e23c-4dbc-92c4-67657bd139ab tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:37:25.361183 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-aa7697eb-e23c-4dbc-92c4-67657bd139ab tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 95d38066-ca04-4351-abd6-28e65ff4d0b7] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:37:25.367824 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aa7697eb-e23c-4dbc-92c4-67657bd139ab tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:37:25.368303 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aa7697eb-e23c-4dbc-92c4-67657bd139ab tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:37:25.368753 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aa7697eb-e23c-4dbc-92c4-67657bd139ab tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:37:25.369459 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aa7697eb-e23c-4dbc-92c4-67657bd139ab tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:37:25.369966 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aa7697eb-e23c-4dbc-92c4-67657bd139ab tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:37:25.370409 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aa7697eb-e23c-4dbc-92c4-67657bd139ab tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:37:25.384394 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-aa7697eb-e23c-4dbc-92c4-67657bd139ab tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] HTTP exception thrown: Instance 95d38066-ca04-4351-abd6-28e65ff4d0b7 could not be found. Sep 23 05:37:25.385959 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-aa7697eb-e23c-4dbc-92c4-67657bd139ab tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Request method failure captured: Sep 23 05:37:25.385959 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7 HTTP/1.1 Sep 23 05:37:25.385959 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 05:37:25.385959 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 05:37:25.385959 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 05:37:25.385959 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 05:37:25.385959 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 05:37:25.385959 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 05:37:25.385959 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 05:37:25.385959 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 05:37:25.385959 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLUSNPTcpFt7b1SQrBrdC4rAqFbUXLEG8j5xh3rTP1qyrEhV8SHPScnfZxRBpUy9MBZ19dFgqZBh9ggYKPA2VLn9rpizyOQlJ_nBmDT4jVqC1BV3Kf2f8DXLNaNiW44Z1VNZeBb_3I4dNJUWbXOX8beHhp39Bmiy2ImuZpbhlNdAaR6A Sep 23 05:37:25.385959 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 05:37:25.385959 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 05:37:25.385959 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 05:37:25.385959 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 05:37:25.385959 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 05:37:25.385959 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 05:37:25.385959 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: f991e11ed0c44131a4bd9be0110dffe0 Sep 23 05:37:25.385959 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ServerActionsTestJSON-551956227 Sep 23 05:37:25.385959 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 05:37:25.385959 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 05:37:25.385959 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f991e11ed0c44131a4bd9be0110dffe0", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f991e11ed0c44131a4bd9be0110dffe0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f991e11ed0c44131a4bd9be0110dffe0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f991e11ed0c44131a4bd9be0110dffe0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:37:25.385959 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ServerActionsTestJSON-551956227 Sep 23 05:37:25.385959 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: f991e11ed0c44131a4bd9be0110dffe0 Sep 23 05:37:25.385959 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ServerActionsTestJSON-551956227 Sep 23 05:37:25.385959 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ServerActionsTestJSON-551956227-project Sep 23 05:37:25.385959 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 05:37:25.385959 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 05:37:25.385959 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: f398aeafcbcb48d88d8cfd3bdf59bbed Sep 23 05:37:25.385959 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ServerActionsTestJSON-551956227-project Sep 23 05:37:25.385959 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 05:37:25.385959 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 95d38066-ca04-4351-abd6-28e65ff4d0b7 could not be found. Sep 23 05:37:25.385959 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '95d38066-ca04-4351-abd6-28e65ff4d0b7'} Sep 23 05:37:25.385959 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:37:25.385959 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:37:25.385959 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 05:37:25.385959 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 05:37:25.385959 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 05:37:25.385959 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 05:37:25.385959 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 05:37:25.385959 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 05:37:25.385959 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 05:37:25.385959 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 05:37:25.385959 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95d38066-ca04-4351-abd6-28e65ff4d0b7 could not be found. Sep 23 05:37:25.385959 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:37:25.385959 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:37:25.385959 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:37:25.385959 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:37:25.385959 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:37:25.385959 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:37:25.385959 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:37:25.385959 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:37:25.385959 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:37:25.385959 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:37:25.385959 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 05:37:25.385959 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 05:37:25.385959 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 05:37:25.385959 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 05:37:25.385959 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 05:37:25.385959 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:37:25.385959 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95d38066-ca04-4351-abd6-28e65ff4d0b7 could not be found. Sep 23 05:37:25.385959 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:37:25.385959 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:37:25.385959 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:37:25.391680 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:37:25.391680 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:37:25.391680 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:37:25.391680 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:37:25.391680 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:37:25.391680 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95d38066-ca04-4351-abd6-28e65ff4d0b7 could not be found. Sep 23 05:37:25.391680 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:37:25.391680 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-aa7697eb-e23c-4dbc-92c4-67657bd139ab tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Returning 404 to user: Instance 95d38066-ca04-4351-abd6-28e65ff4d0b7 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:37:25.391680 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-aa7697eb-e23c-4dbc-92c4-67657bd139ab tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7" status: 404 len: 111 microversion: 2.1 time: 0.030610 Sep 23 05:37:25.391680 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3855/7529] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:37:25 2022] GET /compute/v2.1/servers/95d38066-ca04-4351-abd6-28e65ff4d0b7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 05:37:25.398695 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-33ded704-34e3-4b9c-a882-abd66520b5d2 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:37:25.399244 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-33ded704-34e3-4b9c-a882-abd66520b5d2 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: e597857c-9b3b-4406-83d7-395c5ad5912e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:37:25.405502 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-33ded704-34e3-4b9c-a882-abd66520b5d2 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:37:25.406052 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-33ded704-34e3-4b9c-a882-abd66520b5d2 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:37:25.406519 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-33ded704-34e3-4b9c-a882-abd66520b5d2 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:37:25.407233 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-33ded704-34e3-4b9c-a882-abd66520b5d2 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:37:25.407719 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-33ded704-34e3-4b9c-a882-abd66520b5d2 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:37:25.408169 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-33ded704-34e3-4b9c-a882-abd66520b5d2 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:37:25.422038 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-33ded704-34e3-4b9c-a882-abd66520b5d2 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] HTTP exception thrown: Instance e597857c-9b3b-4406-83d7-395c5ad5912e could not be found. Sep 23 05:37:25.423663 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-33ded704-34e3-4b9c-a882-abd66520b5d2 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Request method failure captured: Sep 23 05:37:25.423663 n-d-846463-3 devstack@n-api.service[122698]: request: DELETE /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e HTTP/1.1 Sep 23 05:37:25.423663 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 05:37:25.423663 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 05:37:25.423663 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 05:37:25.423663 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 05:37:25.423663 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 05:37:25.423663 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 05:37:25.423663 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 05:37:25.423663 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 05:37:25.423663 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLUSNPTcpFt7b1SQrBrdC4rAqFbUXLEG8j5xh3rTP1qyrEhV8SHPScnfZxRBpUy9MBZ19dFgqZBh9ggYKPA2VLn9rpizyOQlJ_nBmDT4jVqC1BV3Kf2f8DXLNaNiW44Z1VNZeBb_3I4dNJUWbXOX8beHhp39Bmiy2ImuZpbhlNdAaR6A Sep 23 05:37:25.423663 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 05:37:25.423663 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 05:37:25.423663 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 05:37:25.423663 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 05:37:25.423663 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 05:37:25.423663 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 05:37:25.423663 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: f991e11ed0c44131a4bd9be0110dffe0 Sep 23 05:37:25.423663 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ServerActionsTestJSON-551956227 Sep 23 05:37:25.423663 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 05:37:25.423663 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 05:37:25.423663 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f991e11ed0c44131a4bd9be0110dffe0", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f991e11ed0c44131a4bd9be0110dffe0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f991e11ed0c44131a4bd9be0110dffe0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f991e11ed0c44131a4bd9be0110dffe0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:37:25.423663 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ServerActionsTestJSON-551956227 Sep 23 05:37:25.423663 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: f991e11ed0c44131a4bd9be0110dffe0 Sep 23 05:37:25.423663 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ServerActionsTestJSON-551956227 Sep 23 05:37:25.423663 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ServerActionsTestJSON-551956227-project Sep 23 05:37:25.423663 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 05:37:25.423663 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 05:37:25.423663 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: f398aeafcbcb48d88d8cfd3bdf59bbed Sep 23 05:37:25.423663 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ServerActionsTestJSON-551956227-project Sep 23 05:37:25.423663 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 05:37:25.423663 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance e597857c-9b3b-4406-83d7-395c5ad5912e could not be found. Sep 23 05:37:25.423663 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': 'e597857c-9b3b-4406-83d7-395c5ad5912e'} Sep 23 05:37:25.423663 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:37:25.423663 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:37:25.423663 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 05:37:25.423663 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 05:37:25.423663 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 05:37:25.423663 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 05:37:25.423663 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 05:37:25.423663 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 05:37:25.423663 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 05:37:25.423663 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 05:37:25.423663 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e597857c-9b3b-4406-83d7-395c5ad5912e could not be found. Sep 23 05:37:25.423663 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:37:25.423663 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:37:25.423663 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:37:25.423663 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:37:25.423663 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:37:25.423663 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:37:25.423663 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:37:25.423663 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:37:25.423663 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:37:25.423663 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:37:25.423663 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 05:37:25.423663 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 05:37:25.423663 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 05:37:25.423663 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 05:37:25.423663 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 05:37:25.423663 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 05:37:25.423663 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 05:37:25.423663 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:37:25.428775 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e597857c-9b3b-4406-83d7-395c5ad5912e could not be found. Sep 23 05:37:25.428775 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:37:25.428775 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:37:25.428775 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:37:25.428775 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:37:25.428775 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:37:25.428775 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:37:25.428775 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:37:25.428775 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:37:25.428775 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e597857c-9b3b-4406-83d7-395c5ad5912e could not be found. Sep 23 05:37:25.428775 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:37:25.428775 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-33ded704-34e3-4b9c-a882-abd66520b5d2 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Returning 404 to user: Instance e597857c-9b3b-4406-83d7-395c5ad5912e could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:37:25.428775 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-33ded704-34e3-4b9c-a882-abd66520b5d2 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e" status: 404 len: 111 microversion: 2.1 time: 0.030280 Sep 23 05:37:25.428775 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3675/7530] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 05:37:25 2022] DELETE /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 05:37:25.434474 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b2ff4326-b328-4839-92d8-b167b94723c4 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:37:25.435175 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b2ff4326-b328-4839-92d8-b167b94723c4 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: e597857c-9b3b-4406-83d7-395c5ad5912e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:37:25.441773 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b2ff4326-b328-4839-92d8-b167b94723c4 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:37:25.442382 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b2ff4326-b328-4839-92d8-b167b94723c4 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:37:25.442920 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b2ff4326-b328-4839-92d8-b167b94723c4 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:37:25.443701 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b2ff4326-b328-4839-92d8-b167b94723c4 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:37:25.444237 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b2ff4326-b328-4839-92d8-b167b94723c4 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:37:25.444746 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b2ff4326-b328-4839-92d8-b167b94723c4 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:37:25.458839 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-b2ff4326-b328-4839-92d8-b167b94723c4 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] HTTP exception thrown: Instance e597857c-9b3b-4406-83d7-395c5ad5912e could not be found. Sep 23 05:37:25.460407 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b2ff4326-b328-4839-92d8-b167b94723c4 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Request method failure captured: Sep 23 05:37:25.460407 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e HTTP/1.1 Sep 23 05:37:25.460407 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 05:37:25.460407 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 05:37:25.460407 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 05:37:25.460407 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 05:37:25.460407 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 05:37:25.460407 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 05:37:25.460407 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 05:37:25.460407 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 05:37:25.460407 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLUSNPTcpFt7b1SQrBrdC4rAqFbUXLEG8j5xh3rTP1qyrEhV8SHPScnfZxRBpUy9MBZ19dFgqZBh9ggYKPA2VLn9rpizyOQlJ_nBmDT4jVqC1BV3Kf2f8DXLNaNiW44Z1VNZeBb_3I4dNJUWbXOX8beHhp39Bmiy2ImuZpbhlNdAaR6A Sep 23 05:37:25.460407 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 05:37:25.460407 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 05:37:25.460407 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 05:37:25.460407 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 05:37:25.460407 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 05:37:25.460407 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 05:37:25.460407 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: f991e11ed0c44131a4bd9be0110dffe0 Sep 23 05:37:25.460407 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ServerActionsTestJSON-551956227 Sep 23 05:37:25.460407 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 05:37:25.460407 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 05:37:25.460407 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f991e11ed0c44131a4bd9be0110dffe0", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f991e11ed0c44131a4bd9be0110dffe0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f991e11ed0c44131a4bd9be0110dffe0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f991e11ed0c44131a4bd9be0110dffe0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:37:25.460407 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ServerActionsTestJSON-551956227 Sep 23 05:37:25.460407 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: f991e11ed0c44131a4bd9be0110dffe0 Sep 23 05:37:25.460407 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ServerActionsTestJSON-551956227 Sep 23 05:37:25.460407 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ServerActionsTestJSON-551956227-project Sep 23 05:37:25.460407 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 05:37:25.460407 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 05:37:25.460407 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: f398aeafcbcb48d88d8cfd3bdf59bbed Sep 23 05:37:25.460407 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ServerActionsTestJSON-551956227-project Sep 23 05:37:25.460407 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 05:37:25.460407 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance e597857c-9b3b-4406-83d7-395c5ad5912e could not be found. Sep 23 05:37:25.460407 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': 'e597857c-9b3b-4406-83d7-395c5ad5912e'} Sep 23 05:37:25.460407 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:37:25.460407 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:37:25.460407 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 05:37:25.460407 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 05:37:25.460407 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 05:37:25.460407 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 05:37:25.460407 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 05:37:25.460407 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 05:37:25.460407 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 05:37:25.460407 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 05:37:25.460407 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e597857c-9b3b-4406-83d7-395c5ad5912e could not be found. Sep 23 05:37:25.460407 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:37:25.460407 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:37:25.460407 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:37:25.460407 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:37:25.460407 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:37:25.460407 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:37:25.460407 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:37:25.460407 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:37:25.460407 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:37:25.460407 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:37:25.460407 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 05:37:25.460407 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 05:37:25.460407 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 05:37:25.460407 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 05:37:25.460407 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 05:37:25.460407 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:37:25.460407 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e597857c-9b3b-4406-83d7-395c5ad5912e could not be found. Sep 23 05:37:25.460407 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:37:25.460407 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:37:25.460407 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:37:25.464758 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:37:25.464758 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:37:25.464758 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:37:25.464758 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:37:25.464758 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:37:25.464758 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e597857c-9b3b-4406-83d7-395c5ad5912e could not be found. Sep 23 05:37:25.464758 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:37:25.464758 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b2ff4326-b328-4839-92d8-b167b94723c4 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Returning 404 to user: Instance e597857c-9b3b-4406-83d7-395c5ad5912e could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:37:25.464758 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b2ff4326-b328-4839-92d8-b167b94723c4 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e" status: 404 len: 111 microversion: 2.1 time: 0.031318 Sep 23 05:37:25.464758 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3856/7531] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:37:25 2022] GET /compute/v2.1/servers/e597857c-9b3b-4406-83d7-395c5ad5912e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 05:37:25.470628 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a406c3b6-ccad-47d1-956e-b1a314acbe4c tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:37:25.471143 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a406c3b6-ccad-47d1-956e-b1a314acbe4c tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:37:25.477146 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a406c3b6-ccad-47d1-956e-b1a314acbe4c tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:37:25.477644 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a406c3b6-ccad-47d1-956e-b1a314acbe4c tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:37:25.478123 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a406c3b6-ccad-47d1-956e-b1a314acbe4c tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:37:25.478822 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a406c3b6-ccad-47d1-956e-b1a314acbe4c tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:37:25.479294 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a406c3b6-ccad-47d1-956e-b1a314acbe4c tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:37:25.479733 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a406c3b6-ccad-47d1-956e-b1a314acbe4c tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:37:25.493185 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-a406c3b6-ccad-47d1-956e-b1a314acbe4c tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] HTTP exception thrown: Instance 6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4 could not be found. Sep 23 05:37:25.494707 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a406c3b6-ccad-47d1-956e-b1a314acbe4c tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Request method failure captured: Sep 23 05:37:25.494707 n-d-846463-3 devstack@n-api.service[122698]: request: DELETE /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4 HTTP/1.1 Sep 23 05:37:25.494707 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 05:37:25.494707 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 05:37:25.494707 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 05:37:25.494707 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 05:37:25.494707 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 05:37:25.494707 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 05:37:25.494707 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 05:37:25.494707 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 05:37:25.494707 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLUSNPTcpFt7b1SQrBrdC4rAqFbUXLEG8j5xh3rTP1qyrEhV8SHPScnfZxRBpUy9MBZ19dFgqZBh9ggYKPA2VLn9rpizyOQlJ_nBmDT4jVqC1BV3Kf2f8DXLNaNiW44Z1VNZeBb_3I4dNJUWbXOX8beHhp39Bmiy2ImuZpbhlNdAaR6A Sep 23 05:37:25.494707 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 05:37:25.494707 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 05:37:25.494707 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 05:37:25.494707 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 05:37:25.494707 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 05:37:25.494707 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 05:37:25.494707 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: f991e11ed0c44131a4bd9be0110dffe0 Sep 23 05:37:25.494707 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ServerActionsTestJSON-551956227 Sep 23 05:37:25.494707 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 05:37:25.494707 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 05:37:25.494707 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f991e11ed0c44131a4bd9be0110dffe0", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f991e11ed0c44131a4bd9be0110dffe0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f991e11ed0c44131a4bd9be0110dffe0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f991e11ed0c44131a4bd9be0110dffe0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:37:25.494707 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ServerActionsTestJSON-551956227 Sep 23 05:37:25.494707 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: f991e11ed0c44131a4bd9be0110dffe0 Sep 23 05:37:25.494707 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ServerActionsTestJSON-551956227 Sep 23 05:37:25.494707 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ServerActionsTestJSON-551956227-project Sep 23 05:37:25.494707 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 05:37:25.494707 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 05:37:25.494707 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: f398aeafcbcb48d88d8cfd3bdf59bbed Sep 23 05:37:25.494707 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ServerActionsTestJSON-551956227-project Sep 23 05:37:25.494707 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 05:37:25.494707 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4 could not be found. Sep 23 05:37:25.494707 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4'} Sep 23 05:37:25.494707 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:37:25.494707 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:37:25.494707 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 05:37:25.494707 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 05:37:25.494707 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 05:37:25.494707 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 05:37:25.494707 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 05:37:25.494707 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 05:37:25.494707 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 05:37:25.494707 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 05:37:25.494707 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4 could not be found. Sep 23 05:37:25.494707 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:37:25.494707 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:37:25.494707 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:37:25.494707 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:37:25.494707 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:37:25.494707 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:37:25.494707 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:37:25.494707 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:37:25.494707 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:37:25.494707 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:37:25.494707 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 05:37:25.494707 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 05:37:25.494707 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 05:37:25.494707 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 05:37:25.494707 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 05:37:25.494707 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 05:37:25.494707 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 05:37:25.494707 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:37:25.499549 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4 could not be found. Sep 23 05:37:25.499549 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:37:25.499549 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:37:25.499549 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:37:25.499549 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:37:25.499549 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:37:25.499549 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:37:25.499549 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:37:25.499549 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:37:25.499549 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4 could not be found. Sep 23 05:37:25.499549 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:37:25.499549 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a406c3b6-ccad-47d1-956e-b1a314acbe4c tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Returning 404 to user: Instance 6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:37:25.499549 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a406c3b6-ccad-47d1-956e-b1a314acbe4c tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4" status: 404 len: 111 microversion: 2.1 time: 0.029423 Sep 23 05:37:25.499549 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3676/7532] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 05:37:25 2022] DELETE /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 05:37:25.505107 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3f4b231f-24fa-48b1-81b7-1fbe90ef6ae5 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:37:25.505712 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-3f4b231f-24fa-48b1-81b7-1fbe90ef6ae5 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: 6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:37:25.511685 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3f4b231f-24fa-48b1-81b7-1fbe90ef6ae5 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:37:25.512174 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3f4b231f-24fa-48b1-81b7-1fbe90ef6ae5 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:37:25.512616 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3f4b231f-24fa-48b1-81b7-1fbe90ef6ae5 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:37:25.513306 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3f4b231f-24fa-48b1-81b7-1fbe90ef6ae5 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:37:25.514364 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3f4b231f-24fa-48b1-81b7-1fbe90ef6ae5 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:37:25.514828 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3f4b231f-24fa-48b1-81b7-1fbe90ef6ae5 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:37:25.528840 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-3f4b231f-24fa-48b1-81b7-1fbe90ef6ae5 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] HTTP exception thrown: Instance 6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4 could not be found. Sep 23 05:37:25.531034 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3f4b231f-24fa-48b1-81b7-1fbe90ef6ae5 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Request method failure captured: Sep 23 05:37:25.531034 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4 HTTP/1.1 Sep 23 05:37:25.531034 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 05:37:25.531034 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 05:37:25.531034 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 05:37:25.531034 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 05:37:25.531034 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 05:37:25.531034 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 05:37:25.531034 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 05:37:25.531034 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 05:37:25.531034 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLUSNPTcpFt7b1SQrBrdC4rAqFbUXLEG8j5xh3rTP1qyrEhV8SHPScnfZxRBpUy9MBZ19dFgqZBh9ggYKPA2VLn9rpizyOQlJ_nBmDT4jVqC1BV3Kf2f8DXLNaNiW44Z1VNZeBb_3I4dNJUWbXOX8beHhp39Bmiy2ImuZpbhlNdAaR6A Sep 23 05:37:25.531034 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 05:37:25.531034 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 05:37:25.531034 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 05:37:25.531034 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 05:37:25.531034 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 05:37:25.531034 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 05:37:25.531034 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: f991e11ed0c44131a4bd9be0110dffe0 Sep 23 05:37:25.531034 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ServerActionsTestJSON-551956227 Sep 23 05:37:25.531034 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 05:37:25.531034 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 05:37:25.531034 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f991e11ed0c44131a4bd9be0110dffe0", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f991e11ed0c44131a4bd9be0110dffe0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f991e11ed0c44131a4bd9be0110dffe0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f991e11ed0c44131a4bd9be0110dffe0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:37:25.531034 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ServerActionsTestJSON-551956227 Sep 23 05:37:25.531034 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: f991e11ed0c44131a4bd9be0110dffe0 Sep 23 05:37:25.531034 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ServerActionsTestJSON-551956227 Sep 23 05:37:25.531034 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ServerActionsTestJSON-551956227-project Sep 23 05:37:25.531034 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 05:37:25.531034 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 05:37:25.531034 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: f398aeafcbcb48d88d8cfd3bdf59bbed Sep 23 05:37:25.531034 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ServerActionsTestJSON-551956227-project Sep 23 05:37:25.531034 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 05:37:25.531034 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4 could not be found. Sep 23 05:37:25.531034 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4'} Sep 23 05:37:25.531034 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:37:25.531034 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:37:25.531034 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 05:37:25.531034 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 05:37:25.531034 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 05:37:25.531034 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 05:37:25.531034 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 05:37:25.531034 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 05:37:25.531034 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 05:37:25.531034 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 05:37:25.531034 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4 could not be found. Sep 23 05:37:25.531034 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:37:25.531034 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:37:25.531034 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:37:25.531034 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:37:25.531034 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:37:25.531034 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:37:25.531034 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:37:25.531034 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:37:25.531034 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:37:25.531034 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:37:25.531034 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 05:37:25.531034 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 05:37:25.531034 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 05:37:25.531034 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 05:37:25.531034 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 05:37:25.531034 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:37:25.531034 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4 could not be found. Sep 23 05:37:25.531034 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:37:25.531034 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:37:25.531034 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:37:25.535474 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:37:25.535474 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:37:25.535474 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:37:25.535474 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:37:25.535474 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:37:25.535474 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4 could not be found. Sep 23 05:37:25.535474 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:37:25.535474 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3f4b231f-24fa-48b1-81b7-1fbe90ef6ae5 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Returning 404 to user: Instance 6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:37:25.535474 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3f4b231f-24fa-48b1-81b7-1fbe90ef6ae5 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4" status: 404 len: 111 microversion: 2.1 time: 0.031127 Sep 23 05:37:25.535474 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3857/7533] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:37:25 2022] GET /compute/v2.1/servers/6d44728b-1ddd-4c98-b71b-e5fdd0e7f5b4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 05:37:25.541171 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-35f4921f-531c-44f2-ba27-1fa8bcc85cc7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:37:25.541690 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-35f4921f-531c-44f2-ba27-1fa8bcc85cc7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: c3c9b3c1-515c-4cd1-adcc-b8fa755fa489] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:37:25.548468 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-35f4921f-531c-44f2-ba27-1fa8bcc85cc7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:37:25.548981 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-35f4921f-531c-44f2-ba27-1fa8bcc85cc7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:37:25.549467 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-35f4921f-531c-44f2-ba27-1fa8bcc85cc7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:37:25.550200 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-35f4921f-531c-44f2-ba27-1fa8bcc85cc7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:37:25.550680 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-35f4921f-531c-44f2-ba27-1fa8bcc85cc7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:37:25.551135 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-35f4921f-531c-44f2-ba27-1fa8bcc85cc7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:37:25.565160 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-35f4921f-531c-44f2-ba27-1fa8bcc85cc7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] HTTP exception thrown: Instance c3c9b3c1-515c-4cd1-adcc-b8fa755fa489 could not be found. Sep 23 05:37:25.566749 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-35f4921f-531c-44f2-ba27-1fa8bcc85cc7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Request method failure captured: Sep 23 05:37:25.566749 n-d-846463-3 devstack@n-api.service[122698]: request: DELETE /compute/v2.1/servers/c3c9b3c1-515c-4cd1-adcc-b8fa755fa489 HTTP/1.1 Sep 23 05:37:25.566749 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 05:37:25.566749 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 05:37:25.566749 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 05:37:25.566749 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 05:37:25.566749 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 05:37:25.566749 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 05:37:25.566749 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 05:37:25.566749 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 05:37:25.566749 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLUSNPTcpFt7b1SQrBrdC4rAqFbUXLEG8j5xh3rTP1qyrEhV8SHPScnfZxRBpUy9MBZ19dFgqZBh9ggYKPA2VLn9rpizyOQlJ_nBmDT4jVqC1BV3Kf2f8DXLNaNiW44Z1VNZeBb_3I4dNJUWbXOX8beHhp39Bmiy2ImuZpbhlNdAaR6A Sep 23 05:37:25.566749 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 05:37:25.566749 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 05:37:25.566749 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 05:37:25.566749 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 05:37:25.566749 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 05:37:25.566749 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 05:37:25.566749 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: f991e11ed0c44131a4bd9be0110dffe0 Sep 23 05:37:25.566749 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ServerActionsTestJSON-551956227 Sep 23 05:37:25.566749 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 05:37:25.566749 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 05:37:25.566749 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f991e11ed0c44131a4bd9be0110dffe0", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f991e11ed0c44131a4bd9be0110dffe0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f991e11ed0c44131a4bd9be0110dffe0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f991e11ed0c44131a4bd9be0110dffe0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:37:25.566749 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ServerActionsTestJSON-551956227 Sep 23 05:37:25.566749 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: f991e11ed0c44131a4bd9be0110dffe0 Sep 23 05:37:25.566749 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ServerActionsTestJSON-551956227 Sep 23 05:37:25.566749 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ServerActionsTestJSON-551956227-project Sep 23 05:37:25.566749 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 05:37:25.566749 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 05:37:25.566749 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: f398aeafcbcb48d88d8cfd3bdf59bbed Sep 23 05:37:25.566749 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ServerActionsTestJSON-551956227-project Sep 23 05:37:25.566749 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 05:37:25.566749 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance c3c9b3c1-515c-4cd1-adcc-b8fa755fa489 could not be found. Sep 23 05:37:25.566749 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': 'c3c9b3c1-515c-4cd1-adcc-b8fa755fa489'} Sep 23 05:37:25.566749 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:37:25.566749 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:37:25.566749 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 05:37:25.566749 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 05:37:25.566749 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 05:37:25.566749 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 05:37:25.566749 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 05:37:25.566749 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 05:37:25.566749 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 05:37:25.566749 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 05:37:25.566749 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3c9b3c1-515c-4cd1-adcc-b8fa755fa489 could not be found. Sep 23 05:37:25.566749 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:37:25.566749 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:37:25.566749 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:37:25.566749 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:37:25.566749 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:37:25.566749 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:37:25.566749 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:37:25.566749 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:37:25.566749 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:37:25.566749 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:37:25.566749 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 05:37:25.566749 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 05:37:25.566749 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 05:37:25.566749 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 05:37:25.566749 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 05:37:25.566749 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 05:37:25.566749 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 05:37:25.566749 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:37:25.572140 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3c9b3c1-515c-4cd1-adcc-b8fa755fa489 could not be found. Sep 23 05:37:25.572140 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:37:25.572140 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:37:25.572140 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:37:25.572140 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:37:25.572140 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:37:25.572140 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:37:25.572140 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:37:25.572140 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:37:25.572140 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3c9b3c1-515c-4cd1-adcc-b8fa755fa489 could not be found. Sep 23 05:37:25.572140 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:37:25.572140 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-35f4921f-531c-44f2-ba27-1fa8bcc85cc7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Returning 404 to user: Instance c3c9b3c1-515c-4cd1-adcc-b8fa755fa489 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:37:25.572140 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-35f4921f-531c-44f2-ba27-1fa8bcc85cc7 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c3c9b3c1-515c-4cd1-adcc-b8fa755fa489" status: 404 len: 111 microversion: 2.1 time: 0.030885 Sep 23 05:37:25.572140 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3677/7534] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 05:37:25 2022] DELETE /compute/v2.1/servers/c3c9b3c1-515c-4cd1-adcc-b8fa755fa489 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 05:37:25.576673 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-62f1b7b9-c543-49a3-9f38-0d40af35a7f0 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:37:25.577299 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-62f1b7b9-c543-49a3-9f38-0d40af35a7f0 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [instance: c3c9b3c1-515c-4cd1-adcc-b8fa755fa489] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:37:25.583331 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-62f1b7b9-c543-49a3-9f38-0d40af35a7f0 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:37:25.583781 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-62f1b7b9-c543-49a3-9f38-0d40af35a7f0 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:37:25.584226 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-62f1b7b9-c543-49a3-9f38-0d40af35a7f0 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:37:25.584929 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-62f1b7b9-c543-49a3-9f38-0d40af35a7f0 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:37:25.585390 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-62f1b7b9-c543-49a3-9f38-0d40af35a7f0 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:37:25.586106 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-62f1b7b9-c543-49a3-9f38-0d40af35a7f0 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:37:25.600677 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-62f1b7b9-c543-49a3-9f38-0d40af35a7f0 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] HTTP exception thrown: Instance c3c9b3c1-515c-4cd1-adcc-b8fa755fa489 could not be found. Sep 23 05:37:25.602243 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-62f1b7b9-c543-49a3-9f38-0d40af35a7f0 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Request method failure captured: Sep 23 05:37:25.602243 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/c3c9b3c1-515c-4cd1-adcc-b8fa755fa489 HTTP/1.1 Sep 23 05:37:25.602243 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 05:37:25.602243 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 05:37:25.602243 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 05:37:25.602243 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 05:37:25.602243 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 05:37:25.602243 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 05:37:25.602243 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 05:37:25.602243 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 05:37:25.602243 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLUSNPTcpFt7b1SQrBrdC4rAqFbUXLEG8j5xh3rTP1qyrEhV8SHPScnfZxRBpUy9MBZ19dFgqZBh9ggYKPA2VLn9rpizyOQlJ_nBmDT4jVqC1BV3Kf2f8DXLNaNiW44Z1VNZeBb_3I4dNJUWbXOX8beHhp39Bmiy2ImuZpbhlNdAaR6A Sep 23 05:37:25.602243 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 05:37:25.602243 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 05:37:25.602243 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 05:37:25.602243 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 05:37:25.602243 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 05:37:25.602243 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 05:37:25.602243 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: f991e11ed0c44131a4bd9be0110dffe0 Sep 23 05:37:25.602243 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ServerActionsTestJSON-551956227 Sep 23 05:37:25.602243 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 05:37:25.602243 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 05:37:25.602243 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f991e11ed0c44131a4bd9be0110dffe0", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f991e11ed0c44131a4bd9be0110dffe0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f991e11ed0c44131a4bd9be0110dffe0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f991e11ed0c44131a4bd9be0110dffe0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:37:25.602243 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ServerActionsTestJSON-551956227 Sep 23 05:37:25.602243 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: f991e11ed0c44131a4bd9be0110dffe0 Sep 23 05:37:25.602243 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ServerActionsTestJSON-551956227 Sep 23 05:37:25.602243 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ServerActionsTestJSON-551956227-project Sep 23 05:37:25.602243 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 05:37:25.602243 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 05:37:25.602243 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: f398aeafcbcb48d88d8cfd3bdf59bbed Sep 23 05:37:25.602243 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ServerActionsTestJSON-551956227-project Sep 23 05:37:25.602243 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 05:37:25.602243 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance c3c9b3c1-515c-4cd1-adcc-b8fa755fa489 could not be found. Sep 23 05:37:25.602243 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': 'c3c9b3c1-515c-4cd1-adcc-b8fa755fa489'} Sep 23 05:37:25.602243 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:37:25.602243 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:37:25.602243 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 05:37:25.602243 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 05:37:25.602243 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 05:37:25.602243 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 05:37:25.602243 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 05:37:25.602243 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 05:37:25.602243 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 05:37:25.602243 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 05:37:25.602243 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3c9b3c1-515c-4cd1-adcc-b8fa755fa489 could not be found. Sep 23 05:37:25.602243 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:37:25.602243 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:37:25.602243 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:37:25.602243 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:37:25.602243 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:37:25.602243 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:37:25.602243 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:37:25.602243 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:37:25.602243 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:37:25.602243 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:37:25.602243 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 05:37:25.602243 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 05:37:25.602243 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 05:37:25.602243 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 05:37:25.602243 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 05:37:25.602243 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:37:25.602243 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3c9b3c1-515c-4cd1-adcc-b8fa755fa489 could not be found. Sep 23 05:37:25.602243 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:37:25.602243 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:37:25.602243 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:37:25.609997 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:37:25.609997 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:37:25.609997 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:37:25.609997 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:37:25.609997 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:37:25.609997 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3c9b3c1-515c-4cd1-adcc-b8fa755fa489 could not be found. Sep 23 05:37:25.609997 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:37:25.609997 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-62f1b7b9-c543-49a3-9f38-0d40af35a7f0 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Returning 404 to user: Instance c3c9b3c1-515c-4cd1-adcc-b8fa755fa489 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:37:25.609997 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-62f1b7b9-c543-49a3-9f38-0d40af35a7f0 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "GET /compute/v2.1/servers/c3c9b3c1-515c-4cd1-adcc-b8fa755fa489" status: 404 len: 111 microversion: 2.1 time: 0.030843 Sep 23 05:37:25.609997 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3858/7535] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:37:25 2022] GET /compute/v2.1/servers/c3c9b3c1-515c-4cd1-adcc-b8fa755fa489 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 05:37:25.613869 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a21290d8-9d20-4c97-9ce9-303dd54f4a95 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] Calling method '.version_select at 0x7ff1bba92af0>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:37:25.618400 n-d-846463-3 devstack@n-api.service[122698]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a21290d8-9d20-4c97-9ce9-303dd54f4a95 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [6cdd8a14-50a8-4880-b40e-d5bfc2780872] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 23 05:37:26.626982 n-d-846463-3 devstack@n-api.service[122698]: INFO oslo.messaging._drivers.impl_rabbit [None req-a21290d8-9d20-4c97-9ce9-303dd54f4a95 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] [6cdd8a14-50a8-4880-b40e-d5bfc2780872] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 53062. Sep 23 05:37:26.701197 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a21290d8-9d20-4c97-9ce9-303dd54f4a95 tempest-ServerActionsTestJSON-551956227 tempest-ServerActionsTestJSON-551956227-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2117157152" status: 202 len: 0 microversion: 2.1 time: 1.091876 Sep 23 05:37:26.701649 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3678/7536] 10.222.0.33 () {58 vars in 1221 bytes} [Fri Sep 23 05:37:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2117157152 => generated 0 bytes in 1094 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 05:37:38.581091 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=33 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:37:38.582713 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=73 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:37:38.710172 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d67b4c35-6401-4239-b281-0d2aeb575714 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-823194651", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "networks": [{"uuid": "fa01a4e7-48b2-4c60-a448-9cde5ab3ea14"}]}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:37:38.784507 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.neutron [None req-d67b4c35-6401-4239-b281-0d2aeb575714 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] validate_networks() for [('fa01a4e7-48b2-4c60-a448-9cde5ab3ea14', None, None, None, None, None)] {{(pid=122699) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 05:37:39.206891 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-d67b4c35-6401-4239-b281-0d2aeb575714 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Flavor limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 05:37:39.207320 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-d67b4c35-6401-4239-b281-0d2aeb575714 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Image limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 05:37:39.208199 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-d67b4c35-6401-4239-b281-0d2aeb575714 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Flavor pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 05:37:39.208896 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-d67b4c35-6401-4239-b281-0d2aeb575714 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Image pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 05:37:39.209316 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-d67b4c35-6401-4239-b281-0d2aeb575714 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 05:37:39.218980 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d67b4c35-6401-4239-b281-0d2aeb575714 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:37:39.219469 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d67b4c35-6401-4239-b281-0d2aeb575714 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:37:39.219902 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d67b4c35-6401-4239-b281-0d2aeb575714 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:37:39.220631 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d67b4c35-6401-4239-b281-0d2aeb575714 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:37:39.221090 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d67b4c35-6401-4239-b281-0d2aeb575714 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:37:39.221526 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d67b4c35-6401-4239-b281-0d2aeb575714 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:37:39.239352 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-d67b4c35-6401-4239-b281-0d2aeb575714 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Getting quotas for project d86ed3daabed4372b955cd83af7ea375. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 05:37:39.245080 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-d67b4c35-6401-4239-b281-0d2aeb575714 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Getting quotas for user b558443264ea404983933609b1f9076c and project d86ed3daabed4372b955cd83af7ea375. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 05:37:39.260095 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d67b4c35-6401-4239-b281-0d2aeb575714 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Going to run 1 instances... {{(pid=122699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 05:37:39.262602 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d67b4c35-6401-4239-b281-0d2aeb575714 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] [instance: 289f7bc3-97f6-4f2a-920f-f9dd9dd9c87d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 05:37:39.377015 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d67b4c35-6401-4239-b281-0d2aeb575714 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.801000 Sep 23 05:37:39.377678 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3859/7537] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 05:37:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 802 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 05:37:39.387407 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:37:39.388944 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:37:39.393180 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-85e870db-295a-4549-af9a-05d4e8904534 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:37:39.393827 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-85e870db-295a-4549-af9a-05d4e8904534 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] [instance: 289f7bc3-97f6-4f2a-920f-f9dd9dd9c87d] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:37:39.456948 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-85e870db-295a-4549-af9a-05d4e8904534 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b558443264ea404983933609b1f9076c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86ed3daabed4372b955cd83af7ea375', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:37:39.465021 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-85e870db-295a-4549-af9a-05d4e8904534 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] 10.222.0.33 "GET /compute/v2.1/servers/289f7bc3-97f6-4f2a-920f-f9dd9dd9c87d" status: 200 len: 1216 microversion: 2.1 time: 0.079742 Sep 23 05:37:39.470684 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3679/7538] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:37:39 2022] GET /compute/v2.1/servers/289f7bc3-97f6-4f2a-920f-f9dd9dd9c87d => generated 1216 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:37:40.489410 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c8d3d4b8-b79c-453e-b701-970ba92765a8 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:37:40.490102 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c8d3d4b8-b79c-453e-b701-970ba92765a8 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] [instance: 289f7bc3-97f6-4f2a-920f-f9dd9dd9c87d] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:37:40.492779 n-d-846463-3 devstack@n-api.service[122699]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 05:37:40.492933 n-d-846463-3 devstack@n-api.service[122699]: Fri Sep 23 05:37:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/289f7bc3-97f6-4f2a-920f-f9dd9dd9c87d (ip 10.222.0.33) !!! Sep 23 05:37:40.500124 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c8d3d4b8-b79c-453e-b701-970ba92765a8 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:37:40.500625 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c8d3d4b8-b79c-453e-b701-970ba92765a8 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:37:40.501085 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c8d3d4b8-b79c-453e-b701-970ba92765a8 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:37:40.502046 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c8d3d4b8-b79c-453e-b701-970ba92765a8 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:37:40.502574 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c8d3d4b8-b79c-453e-b701-970ba92765a8 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:37:40.502985 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c8d3d4b8-b79c-453e-b701-970ba92765a8 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:37:40.575011 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c8d3d4b8-b79c-453e-b701-970ba92765a8 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b558443264ea404983933609b1f9076c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86ed3daabed4372b955cd83af7ea375', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:37:40.583482 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c8d3d4b8-b79c-453e-b701-970ba92765a8 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] 10.222.0.33 "GET /compute/v2.1/servers/289f7bc3-97f6-4f2a-920f-f9dd9dd9c87d" status: 200 len: 1220 microversion: 2.1 time: 0.098067 Sep 23 05:37:40.583996 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3860/7539] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:37:40 2022] GET /compute/v2.1/servers/289f7bc3-97f6-4f2a-920f-f9dd9dd9c87d => generated 1220 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:37:41.608324 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3e7f00d3-2071-48f8-899a-3bc205a3faae tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:37:41.609956 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3e7f00d3-2071-48f8-899a-3bc205a3faae tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] [instance: 289f7bc3-97f6-4f2a-920f-f9dd9dd9c87d] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:37:41.620302 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3e7f00d3-2071-48f8-899a-3bc205a3faae tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:37:41.620824 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3e7f00d3-2071-48f8-899a-3bc205a3faae tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:37:41.621342 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3e7f00d3-2071-48f8-899a-3bc205a3faae tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:37:41.622121 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3e7f00d3-2071-48f8-899a-3bc205a3faae tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:37:41.623223 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3e7f00d3-2071-48f8-899a-3bc205a3faae tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:37:41.629288 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3e7f00d3-2071-48f8-899a-3bc205a3faae tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:37:41.689131 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-3e7f00d3-2071-48f8-899a-3bc205a3faae tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b558443264ea404983933609b1f9076c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86ed3daabed4372b955cd83af7ea375', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:37:41.699142 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3e7f00d3-2071-48f8-899a-3bc205a3faae tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] 10.222.0.33 "GET /compute/v2.1/servers/289f7bc3-97f6-4f2a-920f-f9dd9dd9c87d" status: 200 len: 1268 microversion: 2.1 time: 0.095434 Sep 23 05:37:41.708469 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3680/7540] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:37:41 2022] GET /compute/v2.1/servers/289f7bc3-97f6-4f2a-920f-f9dd9dd9c87d => generated 1268 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:37:42.724630 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3315c875-0e49-4bfe-866d-f6969125708f tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:37:42.725261 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-3315c875-0e49-4bfe-866d-f6969125708f tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] [instance: 289f7bc3-97f6-4f2a-920f-f9dd9dd9c87d] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:37:42.731485 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3315c875-0e49-4bfe-866d-f6969125708f tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:37:42.732029 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3315c875-0e49-4bfe-866d-f6969125708f tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:37:42.732478 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3315c875-0e49-4bfe-866d-f6969125708f tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:37:42.733185 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3315c875-0e49-4bfe-866d-f6969125708f tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:37:42.733833 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3315c875-0e49-4bfe-866d-f6969125708f tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:37:42.734308 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3315c875-0e49-4bfe-866d-f6969125708f tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:37:42.893726 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-3315c875-0e49-4bfe-866d-f6969125708f tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b558443264ea404983933609b1f9076c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86ed3daabed4372b955cd83af7ea375', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:37:42.902340 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3315c875-0e49-4bfe-866d-f6969125708f tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] 10.222.0.33 "GET /compute/v2.1/servers/289f7bc3-97f6-4f2a-920f-f9dd9dd9c87d" status: 200 len: 1316 microversion: 2.1 time: 0.182410 Sep 23 05:37:42.903203 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3861/7541] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:37:42 2022] GET /compute/v2.1/servers/289f7bc3-97f6-4f2a-920f-f9dd9dd9c87d => generated 1316 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:37:43.493051 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-dc610ea2-f4cc-4bc4-bffe-966eec994f36 req-5c030b92-7203-4e5a-8c1c-9053ebb1c940 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "289f7bc3-97f6-4f2a-920f-f9dd9dd9c87d", "tag": "0089c1b9-9fa4-4ae4-9d5d-02f72a8bdcf6"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:37:43.504511 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-dc610ea2-f4cc-4bc4-bffe-966eec994f36 req-5c030b92-7203-4e5a-8c1c-9053ebb1c940 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:37:43.505008 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-dc610ea2-f4cc-4bc4-bffe-966eec994f36 req-5c030b92-7203-4e5a-8c1c-9053ebb1c940 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:37:43.505448 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-dc610ea2-f4cc-4bc4-bffe-966eec994f36 req-5c030b92-7203-4e5a-8c1c-9053ebb1c940 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:37:43.517410 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-dc610ea2-f4cc-4bc4-bffe-966eec994f36 req-5c030b92-7203-4e5a-8c1c-9053ebb1c940 service nova] Creating event network-changed:0089c1b9-9fa4-4ae4-9d5d-02f72a8bdcf6 for instance 289f7bc3-97f6-4f2a-920f-f9dd9dd9c87d on n-h1-846463-3 Sep 23 05:37:43.522866 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-dc610ea2-f4cc-4bc4-bffe-966eec994f36 req-5c030b92-7203-4e5a-8c1c-9053ebb1c940 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034409 Sep 23 05:37:43.524056 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3681/7542] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:37:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:37:43.927104 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c07fa66b-01b9-44cf-b9dd-b3199f5e7834 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:37:43.927737 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c07fa66b-01b9-44cf-b9dd-b3199f5e7834 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] [instance: 289f7bc3-97f6-4f2a-920f-f9dd9dd9c87d] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:37:43.934361 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c07fa66b-01b9-44cf-b9dd-b3199f5e7834 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:37:43.934869 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c07fa66b-01b9-44cf-b9dd-b3199f5e7834 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:37:43.936134 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c07fa66b-01b9-44cf-b9dd-b3199f5e7834 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:37:43.936865 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c07fa66b-01b9-44cf-b9dd-b3199f5e7834 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:37:43.937328 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c07fa66b-01b9-44cf-b9dd-b3199f5e7834 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:37:43.937762 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c07fa66b-01b9-44cf-b9dd-b3199f5e7834 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:37:44.073568 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c07fa66b-01b9-44cf-b9dd-b3199f5e7834 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b558443264ea404983933609b1f9076c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86ed3daabed4372b955cd83af7ea375', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:37:44.081384 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c07fa66b-01b9-44cf-b9dd-b3199f5e7834 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] 10.222.0.33 "GET /compute/v2.1/servers/289f7bc3-97f6-4f2a-920f-f9dd9dd9c87d" status: 200 len: 1316 microversion: 2.1 time: 0.158662 Sep 23 05:37:44.082124 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3862/7543] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:37:43 2022] GET /compute/v2.1/servers/289f7bc3-97f6-4f2a-920f-f9dd9dd9c87d => generated 1316 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:37:45.106352 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-bd24eed8-990c-45be-9bde-110ca6f0fe21 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:37:45.107485 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-bd24eed8-990c-45be-9bde-110ca6f0fe21 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] [instance: 289f7bc3-97f6-4f2a-920f-f9dd9dd9c87d] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:37:45.113843 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bd24eed8-990c-45be-9bde-110ca6f0fe21 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:37:45.114395 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bd24eed8-990c-45be-9bde-110ca6f0fe21 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:37:45.114861 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bd24eed8-990c-45be-9bde-110ca6f0fe21 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:37:45.115573 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bd24eed8-990c-45be-9bde-110ca6f0fe21 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:37:45.116052 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bd24eed8-990c-45be-9bde-110ca6f0fe21 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:37:45.116572 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bd24eed8-990c-45be-9bde-110ca6f0fe21 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:37:45.249520 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-bd24eed8-990c-45be-9bde-110ca6f0fe21 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b558443264ea404983933609b1f9076c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86ed3daabed4372b955cd83af7ea375', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:37:45.257543 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-bd24eed8-990c-45be-9bde-110ca6f0fe21 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] 10.222.0.33 "GET /compute/v2.1/servers/289f7bc3-97f6-4f2a-920f-f9dd9dd9c87d" status: 200 len: 1316 microversion: 2.1 time: 0.156651 Sep 23 05:37:45.258167 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3682/7544] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:37:45 2022] GET /compute/v2.1/servers/289f7bc3-97f6-4f2a-920f-f9dd9dd9c87d => generated 1316 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:37:46.280825 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-19792d24-f936-401b-9dbf-bbf7775dfce1 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:37:46.281387 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-19792d24-f936-401b-9dbf-bbf7775dfce1 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] [instance: 289f7bc3-97f6-4f2a-920f-f9dd9dd9c87d] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:37:46.287790 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-19792d24-f936-401b-9dbf-bbf7775dfce1 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:37:46.288284 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-19792d24-f936-401b-9dbf-bbf7775dfce1 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:37:46.288732 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-19792d24-f936-401b-9dbf-bbf7775dfce1 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:37:46.289437 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-19792d24-f936-401b-9dbf-bbf7775dfce1 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:37:46.289920 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-19792d24-f936-401b-9dbf-bbf7775dfce1 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:37:46.290361 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-19792d24-f936-401b-9dbf-bbf7775dfce1 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:37:46.423128 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-19792d24-f936-401b-9dbf-bbf7775dfce1 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b558443264ea404983933609b1f9076c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86ed3daabed4372b955cd83af7ea375', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:37:46.430787 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-19792d24-f936-401b-9dbf-bbf7775dfce1 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] 10.222.0.33 "GET /compute/v2.1/servers/289f7bc3-97f6-4f2a-920f-f9dd9dd9c87d" status: 200 len: 1316 microversion: 2.1 time: 0.154513 Sep 23 05:37:46.431363 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3863/7545] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:37:46 2022] GET /compute/v2.1/servers/289f7bc3-97f6-4f2a-920f-f9dd9dd9c87d => generated 1316 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:37:47.453747 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7bc18a48-4371-4761-af07-f1cfa9bb4378 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:37:47.454409 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7bc18a48-4371-4761-af07-f1cfa9bb4378 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] [instance: 289f7bc3-97f6-4f2a-920f-f9dd9dd9c87d] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:37:47.461297 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7bc18a48-4371-4761-af07-f1cfa9bb4378 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:37:47.461805 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7bc18a48-4371-4761-af07-f1cfa9bb4378 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:37:47.462309 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7bc18a48-4371-4761-af07-f1cfa9bb4378 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:37:47.463029 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7bc18a48-4371-4761-af07-f1cfa9bb4378 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:37:47.463510 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7bc18a48-4371-4761-af07-f1cfa9bb4378 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:37:47.463959 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7bc18a48-4371-4761-af07-f1cfa9bb4378 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:37:47.595062 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-7bc18a48-4371-4761-af07-f1cfa9bb4378 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b558443264ea404983933609b1f9076c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86ed3daabed4372b955cd83af7ea375', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:37:47.602763 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7bc18a48-4371-4761-af07-f1cfa9bb4378 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] 10.222.0.33 "GET /compute/v2.1/servers/289f7bc3-97f6-4f2a-920f-f9dd9dd9c87d" status: 200 len: 1316 microversion: 2.1 time: 0.153465 Sep 23 05:37:47.603338 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3683/7546] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:37:47 2022] GET /compute/v2.1/servers/289f7bc3-97f6-4f2a-920f-f9dd9dd9c87d => generated 1316 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:37:47.983268 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-9ee97ee7-3772-4382-bb36-52ab4546194e req-6b6d19e3-38bc-4874-8d93-7f5d8284023a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "289f7bc3-97f6-4f2a-920f-f9dd9dd9c87d", "name": "network-vif-plugged", "status": "completed", "tag": "0089c1b9-9fa4-4ae4-9d5d-02f72a8bdcf6"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:37:47.993640 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-9ee97ee7-3772-4382-bb36-52ab4546194e req-6b6d19e3-38bc-4874-8d93-7f5d8284023a service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:37:47.994146 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-9ee97ee7-3772-4382-bb36-52ab4546194e req-6b6d19e3-38bc-4874-8d93-7f5d8284023a service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:37:47.994585 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-9ee97ee7-3772-4382-bb36-52ab4546194e req-6b6d19e3-38bc-4874-8d93-7f5d8284023a service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:37:48.006335 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-9ee97ee7-3772-4382-bb36-52ab4546194e req-6b6d19e3-38bc-4874-8d93-7f5d8284023a service nova] Creating event network-vif-plugged:0089c1b9-9fa4-4ae4-9d5d-02f72a8bdcf6 for instance 289f7bc3-97f6-4f2a-920f-f9dd9dd9c87d on n-h1-846463-3 Sep 23 05:37:48.011378 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-9ee97ee7-3772-4382-bb36-52ab4546194e req-6b6d19e3-38bc-4874-8d93-7f5d8284023a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031990 Sep 23 05:37:48.014550 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3864/7547] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:37:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:37:48.625689 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-991051c0-3d01-459e-8ed0-ce334869afc5 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:37:48.626357 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-991051c0-3d01-459e-8ed0-ce334869afc5 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] [instance: 289f7bc3-97f6-4f2a-920f-f9dd9dd9c87d] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:37:48.633200 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-991051c0-3d01-459e-8ed0-ce334869afc5 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:37:48.634013 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-991051c0-3d01-459e-8ed0-ce334869afc5 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:37:48.634471 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-991051c0-3d01-459e-8ed0-ce334869afc5 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:37:48.635176 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-991051c0-3d01-459e-8ed0-ce334869afc5 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:37:48.635646 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-991051c0-3d01-459e-8ed0-ce334869afc5 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:37:48.636086 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-991051c0-3d01-459e-8ed0-ce334869afc5 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:37:48.765716 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-991051c0-3d01-459e-8ed0-ce334869afc5 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b558443264ea404983933609b1f9076c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86ed3daabed4372b955cd83af7ea375', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:37:48.773456 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-991051c0-3d01-459e-8ed0-ce334869afc5 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] 10.222.0.33 "GET /compute/v2.1/servers/289f7bc3-97f6-4f2a-920f-f9dd9dd9c87d" status: 200 len: 1316 microversion: 2.1 time: 0.151676 Sep 23 05:37:48.774051 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3684/7548] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:37:48 2022] GET /compute/v2.1/servers/289f7bc3-97f6-4f2a-920f-f9dd9dd9c87d => generated 1316 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:37:49.805356 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b7c040e0-04a4-4f51-a729-319f585db2e1 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:37:49.806009 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b7c040e0-04a4-4f51-a729-319f585db2e1 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] [instance: 289f7bc3-97f6-4f2a-920f-f9dd9dd9c87d] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:37:49.808452 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:37:49.809281 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=6 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:37:49.814219 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b7c040e0-04a4-4f51-a729-319f585db2e1 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:37:49.814724 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b7c040e0-04a4-4f51-a729-319f585db2e1 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:37:49.815170 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b7c040e0-04a4-4f51-a729-319f585db2e1 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:37:49.815875 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b7c040e0-04a4-4f51-a729-319f585db2e1 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:37:49.816341 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b7c040e0-04a4-4f51-a729-319f585db2e1 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:37:49.816774 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b7c040e0-04a4-4f51-a729-319f585db2e1 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:37:49.952261 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b7c040e0-04a4-4f51-a729-319f585db2e1 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b558443264ea404983933609b1f9076c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86ed3daabed4372b955cd83af7ea375', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:37:49.960201 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b7c040e0-04a4-4f51-a729-319f585db2e1 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] 10.222.0.33 "GET /compute/v2.1/servers/289f7bc3-97f6-4f2a-920f-f9dd9dd9c87d" status: 200 len: 1506 microversion: 2.1 time: 0.159254 Sep 23 05:37:49.960784 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3865/7549] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:37:49 2022] GET /compute/v2.1/servers/289f7bc3-97f6-4f2a-920f-f9dd9dd9c87d => generated 1506 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:37:50.025662 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7c98a067-aa9b-4bf3-9f19-6e62601a835f tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-958791345", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "networks": [{"uuid": "fa01a4e7-48b2-4c60-a448-9cde5ab3ea14"}]}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:37:50.034382 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:37:50.080918 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.network.neutron [None req-7c98a067-aa9b-4bf3-9f19-6e62601a835f tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] validate_networks() for [('fa01a4e7-48b2-4c60-a448-9cde5ab3ea14', None, None, None, None, None)] {{(pid=122698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 05:37:50.511878 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-7c98a067-aa9b-4bf3-9f19-6e62601a835f tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Flavor limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 05:37:50.512356 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-7c98a067-aa9b-4bf3-9f19-6e62601a835f tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Image limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 05:37:50.512883 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-7c98a067-aa9b-4bf3-9f19-6e62601a835f tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Flavor pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 05:37:50.513318 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-7c98a067-aa9b-4bf3-9f19-6e62601a835f tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Image pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 05:37:50.513760 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-7c98a067-aa9b-4bf3-9f19-6e62601a835f tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 05:37:50.522940 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7c98a067-aa9b-4bf3-9f19-6e62601a835f tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:37:50.523450 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7c98a067-aa9b-4bf3-9f19-6e62601a835f tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:37:50.523913 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7c98a067-aa9b-4bf3-9f19-6e62601a835f tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:37:50.524672 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7c98a067-aa9b-4bf3-9f19-6e62601a835f tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:37:50.525161 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7c98a067-aa9b-4bf3-9f19-6e62601a835f tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:37:50.527856 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7c98a067-aa9b-4bf3-9f19-6e62601a835f tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:37:50.542439 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-7c98a067-aa9b-4bf3-9f19-6e62601a835f tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Getting quotas for project d86ed3daabed4372b955cd83af7ea375. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 05:37:50.548259 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-7c98a067-aa9b-4bf3-9f19-6e62601a835f tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Getting quotas for user b558443264ea404983933609b1f9076c and project d86ed3daabed4372b955cd83af7ea375. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 05:37:50.561084 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7c98a067-aa9b-4bf3-9f19-6e62601a835f tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Going to run 1 instances... {{(pid=122698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 05:37:50.563452 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7c98a067-aa9b-4bf3-9f19-6e62601a835f tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] [instance: 049618db-3a54-4a23-aa03-ca9085693e86] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 05:37:50.681564 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7c98a067-aa9b-4bf3-9f19-6e62601a835f tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.659654 Sep 23 05:37:50.682264 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3685/7550] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 05:37:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 661 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 05:37:50.694610 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-16780fa6-8907-497b-8c40-e0de2f4e7657 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:37:50.695238 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-16780fa6-8907-497b-8c40-e0de2f4e7657 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] [instance: 049618db-3a54-4a23-aa03-ca9085693e86] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:37:50.750970 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-16780fa6-8907-497b-8c40-e0de2f4e7657 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b558443264ea404983933609b1f9076c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86ed3daabed4372b955cd83af7ea375', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:37:50.757829 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-16780fa6-8907-497b-8c40-e0de2f4e7657 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] 10.222.0.33 "GET /compute/v2.1/servers/049618db-3a54-4a23-aa03-ca9085693e86" status: 200 len: 1216 microversion: 2.1 time: 0.067714 Sep 23 05:37:50.758470 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3866/7551] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:37:50 2022] GET /compute/v2.1/servers/049618db-3a54-4a23-aa03-ca9085693e86 => generated 1216 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:37:51.782698 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-25ceafb2-be47-4e35-b290-f50abf3e3ea1 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:37:51.783329 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-25ceafb2-be47-4e35-b290-f50abf3e3ea1 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] [instance: 049618db-3a54-4a23-aa03-ca9085693e86] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:37:51.790187 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-25ceafb2-be47-4e35-b290-f50abf3e3ea1 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:37:51.790698 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-25ceafb2-be47-4e35-b290-f50abf3e3ea1 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:37:51.791157 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-25ceafb2-be47-4e35-b290-f50abf3e3ea1 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:37:51.791869 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-25ceafb2-be47-4e35-b290-f50abf3e3ea1 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:37:51.792346 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-25ceafb2-be47-4e35-b290-f50abf3e3ea1 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:37:51.792796 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-25ceafb2-be47-4e35-b290-f50abf3e3ea1 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:37:51.855513 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-25ceafb2-be47-4e35-b290-f50abf3e3ea1 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b558443264ea404983933609b1f9076c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86ed3daabed4372b955cd83af7ea375', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:37:51.863911 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-25ceafb2-be47-4e35-b290-f50abf3e3ea1 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] 10.222.0.33 "GET /compute/v2.1/servers/049618db-3a54-4a23-aa03-ca9085693e86" status: 200 len: 1220 microversion: 2.1 time: 0.086164 Sep 23 05:37:51.864491 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3686/7552] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:37:51 2022] GET /compute/v2.1/servers/049618db-3a54-4a23-aa03-ca9085693e86 => generated 1220 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:37:52.886982 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-77d4f3a9-2d68-4e41-a27d-40a25ceb2977 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:37:52.888127 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-77d4f3a9-2d68-4e41-a27d-40a25ceb2977 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] [instance: 049618db-3a54-4a23-aa03-ca9085693e86] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:37:52.894962 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-77d4f3a9-2d68-4e41-a27d-40a25ceb2977 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:37:52.895456 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-77d4f3a9-2d68-4e41-a27d-40a25ceb2977 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:37:52.895901 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-77d4f3a9-2d68-4e41-a27d-40a25ceb2977 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:37:52.896607 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-77d4f3a9-2d68-4e41-a27d-40a25ceb2977 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:37:52.897076 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-77d4f3a9-2d68-4e41-a27d-40a25ceb2977 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:37:52.897509 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-77d4f3a9-2d68-4e41-a27d-40a25ceb2977 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:37:52.965424 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-77d4f3a9-2d68-4e41-a27d-40a25ceb2977 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b558443264ea404983933609b1f9076c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86ed3daabed4372b955cd83af7ea375', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:37:52.974332 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-77d4f3a9-2d68-4e41-a27d-40a25ceb2977 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] 10.222.0.33 "GET /compute/v2.1/servers/049618db-3a54-4a23-aa03-ca9085693e86" status: 200 len: 1286 microversion: 2.1 time: 0.091194 Sep 23 05:37:52.974917 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3867/7553] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:37:52 2022] GET /compute/v2.1/servers/049618db-3a54-4a23-aa03-ca9085693e86 => generated 1286 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:37:54.006968 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7a3e5ca1-7767-41fa-bdbc-db04dd6c0d20 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:37:54.007608 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7a3e5ca1-7767-41fa-bdbc-db04dd6c0d20 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] [instance: 049618db-3a54-4a23-aa03-ca9085693e86] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:37:54.014773 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7a3e5ca1-7767-41fa-bdbc-db04dd6c0d20 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:37:54.015611 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7a3e5ca1-7767-41fa-bdbc-db04dd6c0d20 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:37:54.016063 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7a3e5ca1-7767-41fa-bdbc-db04dd6c0d20 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:37:54.016768 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7a3e5ca1-7767-41fa-bdbc-db04dd6c0d20 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:37:54.017240 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7a3e5ca1-7767-41fa-bdbc-db04dd6c0d20 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:37:54.017677 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7a3e5ca1-7767-41fa-bdbc-db04dd6c0d20 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:37:54.148400 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-7a3e5ca1-7767-41fa-bdbc-db04dd6c0d20 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b558443264ea404983933609b1f9076c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86ed3daabed4372b955cd83af7ea375', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:37:54.161154 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7a3e5ca1-7767-41fa-bdbc-db04dd6c0d20 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] 10.222.0.33 "GET /compute/v2.1/servers/049618db-3a54-4a23-aa03-ca9085693e86" status: 200 len: 1316 microversion: 2.1 time: 0.166093 Sep 23 05:37:54.162122 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3687/7554] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:37:53 2022] GET /compute/v2.1/servers/049618db-3a54-4a23-aa03-ca9085693e86 => generated 1316 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:37:54.405489 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-bb0ad201-c3ce-491d-b777-21cfac252ffd req-325f36bc-5fa0-4ae7-9793-9399cc66932a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "049618db-3a54-4a23-aa03-ca9085693e86", "tag": "97a30c99-f6f6-418f-8008-e294ebd09de8"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:37:54.415844 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-bb0ad201-c3ce-491d-b777-21cfac252ffd req-325f36bc-5fa0-4ae7-9793-9399cc66932a service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:37:54.416365 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-bb0ad201-c3ce-491d-b777-21cfac252ffd req-325f36bc-5fa0-4ae7-9793-9399cc66932a service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:37:54.416822 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-bb0ad201-c3ce-491d-b777-21cfac252ffd req-325f36bc-5fa0-4ae7-9793-9399cc66932a service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:37:54.432525 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-bb0ad201-c3ce-491d-b777-21cfac252ffd req-325f36bc-5fa0-4ae7-9793-9399cc66932a service nova] Creating event network-changed:97a30c99-f6f6-418f-8008-e294ebd09de8 for instance 049618db-3a54-4a23-aa03-ca9085693e86 on n-h2-846463-3 Sep 23 05:37:54.437848 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-bb0ad201-c3ce-491d-b777-21cfac252ffd req-325f36bc-5fa0-4ae7-9793-9399cc66932a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036741 Sep 23 05:37:54.438493 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3868/7555] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:37:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 05:37:55.185370 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e39b6029-2e79-48c0-984d-d652605e4e95 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:37:55.186058 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e39b6029-2e79-48c0-984d-d652605e4e95 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] [instance: 049618db-3a54-4a23-aa03-ca9085693e86] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:37:55.192962 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e39b6029-2e79-48c0-984d-d652605e4e95 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:37:55.194628 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e39b6029-2e79-48c0-984d-d652605e4e95 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:37:55.194628 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e39b6029-2e79-48c0-984d-d652605e4e95 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:37:55.194628 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e39b6029-2e79-48c0-984d-d652605e4e95 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:37:55.195097 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e39b6029-2e79-48c0-984d-d652605e4e95 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:37:55.195535 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e39b6029-2e79-48c0-984d-d652605e4e95 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:37:55.332855 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e39b6029-2e79-48c0-984d-d652605e4e95 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b558443264ea404983933609b1f9076c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86ed3daabed4372b955cd83af7ea375', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:37:55.341182 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e39b6029-2e79-48c0-984d-d652605e4e95 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] 10.222.0.33 "GET /compute/v2.1/servers/049618db-3a54-4a23-aa03-ca9085693e86" status: 200 len: 1316 microversion: 2.1 time: 0.159939 Sep 23 05:37:55.341766 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3688/7556] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:37:55 2022] GET /compute/v2.1/servers/049618db-3a54-4a23-aa03-ca9085693e86 => generated 1316 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:37:56.364379 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d8b52851-c4ce-41ab-8f33-2d715d489cf3 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:37:56.365105 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d8b52851-c4ce-41ab-8f33-2d715d489cf3 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] [instance: 049618db-3a54-4a23-aa03-ca9085693e86] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:37:56.371735 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d8b52851-c4ce-41ab-8f33-2d715d489cf3 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:37:56.372273 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d8b52851-c4ce-41ab-8f33-2d715d489cf3 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:37:56.372714 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d8b52851-c4ce-41ab-8f33-2d715d489cf3 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:37:56.373405 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d8b52851-c4ce-41ab-8f33-2d715d489cf3 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:37:56.373857 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d8b52851-c4ce-41ab-8f33-2d715d489cf3 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:37:56.374309 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d8b52851-c4ce-41ab-8f33-2d715d489cf3 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:37:56.507292 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d8b52851-c4ce-41ab-8f33-2d715d489cf3 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b558443264ea404983933609b1f9076c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86ed3daabed4372b955cd83af7ea375', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:37:56.515729 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d8b52851-c4ce-41ab-8f33-2d715d489cf3 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] 10.222.0.33 "GET /compute/v2.1/servers/049618db-3a54-4a23-aa03-ca9085693e86" status: 200 len: 1316 microversion: 2.1 time: 0.155659 Sep 23 05:37:56.516292 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3869/7557] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:37:56 2022] GET /compute/v2.1/servers/049618db-3a54-4a23-aa03-ca9085693e86 => generated 1316 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:37:57.539025 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d4e28d02-0007-40e9-81b9-d6e50c124e41 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:37:57.539662 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d4e28d02-0007-40e9-81b9-d6e50c124e41 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] [instance: 049618db-3a54-4a23-aa03-ca9085693e86] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:37:57.547162 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d4e28d02-0007-40e9-81b9-d6e50c124e41 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:37:57.547674 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d4e28d02-0007-40e9-81b9-d6e50c124e41 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:37:57.548138 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d4e28d02-0007-40e9-81b9-d6e50c124e41 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:37:57.548854 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d4e28d02-0007-40e9-81b9-d6e50c124e41 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:37:57.549334 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d4e28d02-0007-40e9-81b9-d6e50c124e41 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:37:57.549780 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d4e28d02-0007-40e9-81b9-d6e50c124e41 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:37:57.676387 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d4e28d02-0007-40e9-81b9-d6e50c124e41 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b558443264ea404983933609b1f9076c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86ed3daabed4372b955cd83af7ea375', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:37:57.684077 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d4e28d02-0007-40e9-81b9-d6e50c124e41 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] 10.222.0.33 "GET /compute/v2.1/servers/049618db-3a54-4a23-aa03-ca9085693e86" status: 200 len: 1316 microversion: 2.1 time: 0.148984 Sep 23 05:37:57.684654 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3689/7558] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:37:57 2022] GET /compute/v2.1/servers/049618db-3a54-4a23-aa03-ca9085693e86 => generated 1316 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:37:58.706811 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-695cb821-7524-4898-b19b-60feb90874ab tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:37:58.707434 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-695cb821-7524-4898-b19b-60feb90874ab tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] [instance: 049618db-3a54-4a23-aa03-ca9085693e86] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:37:58.714028 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-695cb821-7524-4898-b19b-60feb90874ab tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:37:58.714517 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-695cb821-7524-4898-b19b-60feb90874ab tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:37:58.714958 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-695cb821-7524-4898-b19b-60feb90874ab tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:37:58.715677 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-695cb821-7524-4898-b19b-60feb90874ab tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:37:58.716142 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-695cb821-7524-4898-b19b-60feb90874ab tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:37:58.716573 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-695cb821-7524-4898-b19b-60feb90874ab tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:37:58.846443 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-695cb821-7524-4898-b19b-60feb90874ab tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b558443264ea404983933609b1f9076c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86ed3daabed4372b955cd83af7ea375', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:37:58.854167 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-695cb821-7524-4898-b19b-60feb90874ab tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] 10.222.0.33 "GET /compute/v2.1/servers/049618db-3a54-4a23-aa03-ca9085693e86" status: 200 len: 1316 microversion: 2.1 time: 0.151210 Sep 23 05:37:58.854739 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3870/7559] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:37:58 2022] GET /compute/v2.1/servers/049618db-3a54-4a23-aa03-ca9085693e86 => generated 1316 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:37:59.099467 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-9723777f-d738-41d6-a2c9-5926203ec203 req-158b674c-0f51-450a-9a6d-ac4db7cbde8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "049618db-3a54-4a23-aa03-ca9085693e86", "name": "network-vif-plugged", "status": "completed", "tag": "97a30c99-f6f6-418f-8008-e294ebd09de8"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:37:59.110807 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-9723777f-d738-41d6-a2c9-5926203ec203 req-158b674c-0f51-450a-9a6d-ac4db7cbde8f service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:37:59.111310 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-9723777f-d738-41d6-a2c9-5926203ec203 req-158b674c-0f51-450a-9a6d-ac4db7cbde8f service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:37:59.111762 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-9723777f-d738-41d6-a2c9-5926203ec203 req-158b674c-0f51-450a-9a6d-ac4db7cbde8f service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:37:59.122711 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-9723777f-d738-41d6-a2c9-5926203ec203 req-158b674c-0f51-450a-9a6d-ac4db7cbde8f service nova] Creating event network-vif-plugged:97a30c99-f6f6-418f-8008-e294ebd09de8 for instance 049618db-3a54-4a23-aa03-ca9085693e86 on n-h2-846463-3 Sep 23 05:37:59.127711 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-9723777f-d738-41d6-a2c9-5926203ec203 req-158b674c-0f51-450a-9a6d-ac4db7cbde8f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032017 Sep 23 05:37:59.128298 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3690/7560] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:37:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:37:59.877941 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1e40904f-a837-4a8a-8249-db0a106fddcd tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:37:59.878566 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1e40904f-a837-4a8a-8249-db0a106fddcd tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] [instance: 049618db-3a54-4a23-aa03-ca9085693e86] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:37:59.885162 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e40904f-a837-4a8a-8249-db0a106fddcd tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:37:59.885659 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e40904f-a837-4a8a-8249-db0a106fddcd tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:37:59.886136 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e40904f-a837-4a8a-8249-db0a106fddcd tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:37:59.886842 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e40904f-a837-4a8a-8249-db0a106fddcd tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:37:59.887308 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e40904f-a837-4a8a-8249-db0a106fddcd tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:37:59.888340 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e40904f-a837-4a8a-8249-db0a106fddcd tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:38:00.017595 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1e40904f-a837-4a8a-8249-db0a106fddcd tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b558443264ea404983933609b1f9076c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86ed3daabed4372b955cd83af7ea375', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:38:00.025469 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1e40904f-a837-4a8a-8249-db0a106fddcd tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] 10.222.0.33 "GET /compute/v2.1/servers/049618db-3a54-4a23-aa03-ca9085693e86" status: 200 len: 1316 microversion: 2.1 time: 0.151437 Sep 23 05:38:00.026079 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3871/7561] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:37:59 2022] GET /compute/v2.1/servers/049618db-3a54-4a23-aa03-ca9085693e86 => generated 1316 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:38:01.047221 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:38:01.047946 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=6 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:38:01.052058 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2f98d839-a370-4667-8bc1-22da2dac8d11 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:38:01.052779 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-2f98d839-a370-4667-8bc1-22da2dac8d11 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] [instance: 049618db-3a54-4a23-aa03-ca9085693e86] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:38:01.058934 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2f98d839-a370-4667-8bc1-22da2dac8d11 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:38:01.060102 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2f98d839-a370-4667-8bc1-22da2dac8d11 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:38:01.060102 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2f98d839-a370-4667-8bc1-22da2dac8d11 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:38:01.060686 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2f98d839-a370-4667-8bc1-22da2dac8d11 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:38:01.061162 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2f98d839-a370-4667-8bc1-22da2dac8d11 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:38:01.061608 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2f98d839-a370-4667-8bc1-22da2dac8d11 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:38:01.196297 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-2f98d839-a370-4667-8bc1-22da2dac8d11 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b558443264ea404983933609b1f9076c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86ed3daabed4372b955cd83af7ea375', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:38:01.204768 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2f98d839-a370-4667-8bc1-22da2dac8d11 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] 10.222.0.33 "GET /compute/v2.1/servers/049618db-3a54-4a23-aa03-ca9085693e86" status: 200 len: 1506 microversion: 2.1 time: 0.159770 Sep 23 05:38:01.205337 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3691/7562] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:38:01 2022] GET /compute/v2.1/servers/049618db-3a54-4a23-aa03-ca9085693e86 => generated 1506 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:38:01.227820 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5a752c57-1e19-4ac0-9d73-b937d1baa401 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:38:01.228314 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-5a752c57-1e19-4ac0-9d73-b937d1baa401 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] [instance: 049618db-3a54-4a23-aa03-ca9085693e86] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:38:01.230310 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:38:01.235882 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5a752c57-1e19-4ac0-9d73-b937d1baa401 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:38:01.236370 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5a752c57-1e19-4ac0-9d73-b937d1baa401 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:38:01.236807 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5a752c57-1e19-4ac0-9d73-b937d1baa401 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:38:01.237501 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5a752c57-1e19-4ac0-9d73-b937d1baa401 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:38:01.237991 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5a752c57-1e19-4ac0-9d73-b937d1baa401 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:38:01.238440 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5a752c57-1e19-4ac0-9d73-b937d1baa401 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:38:01.264329 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-5a752c57-1e19-4ac0-9d73-b937d1baa401 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] [instance: 049618db-3a54-4a23-aa03-ca9085693e86] Going to try to terminate instance {{(pid=122699) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 05:38:01.557425 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5a752c57-1e19-4ac0-9d73-b937d1baa401 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] 10.222.0.33 "DELETE /compute/v2.1/servers/049618db-3a54-4a23-aa03-ca9085693e86" status: 204 len: 0 microversion: 2.1 time: 0.333172 Sep 23 05:38:01.558135 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3872/7563] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 05:38:01 2022] DELETE /compute/v2.1/servers/049618db-3a54-4a23-aa03-ca9085693e86 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 05:38:01.566741 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7ccc0cb3-461b-40c2-8702-6a7c3b3c8bac tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:38:01.567413 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7ccc0cb3-461b-40c2-8702-6a7c3b3c8bac tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] [instance: 049618db-3a54-4a23-aa03-ca9085693e86] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:38:01.573555 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7ccc0cb3-461b-40c2-8702-6a7c3b3c8bac tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:38:01.574025 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7ccc0cb3-461b-40c2-8702-6a7c3b3c8bac tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:38:01.574491 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7ccc0cb3-461b-40c2-8702-6a7c3b3c8bac tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:38:01.575823 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7ccc0cb3-461b-40c2-8702-6a7c3b3c8bac tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:38:01.576306 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7ccc0cb3-461b-40c2-8702-6a7c3b3c8bac tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:38:01.576765 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7ccc0cb3-461b-40c2-8702-6a7c3b3c8bac tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:38:01.708068 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-7ccc0cb3-461b-40c2-8702-6a7c3b3c8bac tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b558443264ea404983933609b1f9076c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86ed3daabed4372b955cd83af7ea375', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:38:01.715700 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7ccc0cb3-461b-40c2-8702-6a7c3b3c8bac tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] 10.222.0.33 "GET /compute/v2.1/servers/049618db-3a54-4a23-aa03-ca9085693e86" status: 200 len: 1512 microversion: 2.1 time: 0.152922 Sep 23 05:38:01.716275 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3692/7564] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:38:01 2022] GET /compute/v2.1/servers/049618db-3a54-4a23-aa03-ca9085693e86 => generated 1512 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:38:02.739796 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-72c2ca07-0786-4b97-ac64-d51029789b4e tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:38:02.740515 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-72c2ca07-0786-4b97-ac64-d51029789b4e tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] [instance: 049618db-3a54-4a23-aa03-ca9085693e86] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:38:02.747578 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-72c2ca07-0786-4b97-ac64-d51029789b4e tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:38:02.748076 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-72c2ca07-0786-4b97-ac64-d51029789b4e tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:38:02.748522 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-72c2ca07-0786-4b97-ac64-d51029789b4e tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:38:02.749239 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-72c2ca07-0786-4b97-ac64-d51029789b4e tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:38:02.749699 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-72c2ca07-0786-4b97-ac64-d51029789b4e tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:38:02.750172 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-72c2ca07-0786-4b97-ac64-d51029789b4e tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:38:02.880959 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-72c2ca07-0786-4b97-ac64-d51029789b4e tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b558443264ea404983933609b1f9076c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86ed3daabed4372b955cd83af7ea375', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:38:02.889591 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-72c2ca07-0786-4b97-ac64-d51029789b4e tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] 10.222.0.33 "GET /compute/v2.1/servers/049618db-3a54-4a23-aa03-ca9085693e86" status: 200 len: 1512 microversion: 2.1 time: 0.154109 Sep 23 05:38:02.890507 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3873/7565] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:38:02 2022] GET /compute/v2.1/servers/049618db-3a54-4a23-aa03-ca9085693e86 => generated 1512 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:38:03.372985 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-d6cf2313-1353-4b36-9e73-e7fada6bc999 req-1e6efeb3-039e-41ec-93a5-96c6da8827c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "049618db-3a54-4a23-aa03-ca9085693e86", "name": "network-vif-deleted", "tag": "97a30c99-f6f6-418f-8008-e294ebd09de8"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:38:03.384765 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-d6cf2313-1353-4b36-9e73-e7fada6bc999 req-1e6efeb3-039e-41ec-93a5-96c6da8827c8 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:38:03.385372 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-d6cf2313-1353-4b36-9e73-e7fada6bc999 req-1e6efeb3-039e-41ec-93a5-96c6da8827c8 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:38:03.385931 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-d6cf2313-1353-4b36-9e73-e7fada6bc999 req-1e6efeb3-039e-41ec-93a5-96c6da8827c8 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:38:03.399011 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-d6cf2313-1353-4b36-9e73-e7fada6bc999 req-1e6efeb3-039e-41ec-93a5-96c6da8827c8 service nova] Creating event network-vif-deleted:97a30c99-f6f6-418f-8008-e294ebd09de8 for instance 049618db-3a54-4a23-aa03-ca9085693e86 on n-h2-846463-3 Sep 23 05:38:03.404511 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-d6cf2313-1353-4b36-9e73-e7fada6bc999 req-1e6efeb3-039e-41ec-93a5-96c6da8827c8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037362 Sep 23 05:38:03.405412 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3693/7566] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:38:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:38:03.912956 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5589a61e-bcb4-4f76-af3a-a4ce7d64b5e7 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:38:03.913577 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-5589a61e-bcb4-4f76-af3a-a4ce7d64b5e7 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] [instance: 049618db-3a54-4a23-aa03-ca9085693e86] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:38:03.920286 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5589a61e-bcb4-4f76-af3a-a4ce7d64b5e7 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:38:03.920788 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5589a61e-bcb4-4f76-af3a-a4ce7d64b5e7 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:38:03.921235 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5589a61e-bcb4-4f76-af3a-a4ce7d64b5e7 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:38:03.922048 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5589a61e-bcb4-4f76-af3a-a4ce7d64b5e7 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:38:03.922523 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5589a61e-bcb4-4f76-af3a-a4ce7d64b5e7 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:38:03.922947 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5589a61e-bcb4-4f76-af3a-a4ce7d64b5e7 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:38:03.956234 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5589a61e-bcb4-4f76-af3a-a4ce7d64b5e7 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:38:03.956729 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5589a61e-bcb4-4f76-af3a-a4ce7d64b5e7 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:38:03.957179 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5589a61e-bcb4-4f76-af3a-a4ce7d64b5e7 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:38:03.957636 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-5589a61e-bcb4-4f76-af3a-a4ce7d64b5e7 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lazy-loading 'fault' on Instance uuid 049618db-3a54-4a23-aa03-ca9085693e86 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 05:38:04.002161 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-5589a61e-bcb4-4f76-af3a-a4ce7d64b5e7 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b558443264ea404983933609b1f9076c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86ed3daabed4372b955cd83af7ea375', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:38:04.010028 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5589a61e-bcb4-4f76-af3a-a4ce7d64b5e7 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] 10.222.0.33 "GET /compute/v2.1/servers/049618db-3a54-4a23-aa03-ca9085693e86" status: 200 len: 1306 microversion: 2.1 time: 0.100931 Sep 23 05:38:04.013210 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3874/7567] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:38:03 2022] GET /compute/v2.1/servers/049618db-3a54-4a23-aa03-ca9085693e86 => generated 1306 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:38:05.036773 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-28251ca7-1339-4e5c-9ce9-29a3853cc280 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:38:05.037421 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-28251ca7-1339-4e5c-9ce9-29a3853cc280 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] [instance: 049618db-3a54-4a23-aa03-ca9085693e86] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:38:05.044506 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-28251ca7-1339-4e5c-9ce9-29a3853cc280 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:38:05.048085 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-28251ca7-1339-4e5c-9ce9-29a3853cc280 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:38:05.048085 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-28251ca7-1339-4e5c-9ce9-29a3853cc280 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:38:05.048085 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-28251ca7-1339-4e5c-9ce9-29a3853cc280 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:38:05.048085 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-28251ca7-1339-4e5c-9ce9-29a3853cc280 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:38:05.048085 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-28251ca7-1339-4e5c-9ce9-29a3853cc280 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:38:05.060862 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-28251ca7-1339-4e5c-9ce9-29a3853cc280 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] HTTP exception thrown: Instance 049618db-3a54-4a23-aa03-ca9085693e86 could not be found. Sep 23 05:38:05.062548 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-28251ca7-1339-4e5c-9ce9-29a3853cc280 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Request method failure captured: Sep 23 05:38:05.062548 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/049618db-3a54-4a23-aa03-ca9085693e86 HTTP/1.1 Sep 23 05:38:05.062548 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 05:38:05.062548 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 05:38:05.062548 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 05:38:05.062548 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 05:38:05.062548 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 05:38:05.062548 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 05:38:05.062548 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 05:38:05.062548 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 05:38:05.062548 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLUYi3RbaY5_-Z32UMivbwibb3SJjx7H71KOjuHuf7HmDZwb-48FVBSFdAm8nDDVA5RCIKaeT2sk3c09rb6_6ODgZ5b0IHRSzScU8IOZrh0dFOT6bCgTTYzw3tLMKSq5GA9_X85JqtqBiJW2oVUj5UaTLKBIqybwFQFbI1a3PxBZ567I Sep 23 05:38:05.062548 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 05:38:05.062548 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 05:38:05.062548 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 05:38:05.062548 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 05:38:05.062548 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 05:38:05.062548 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 05:38:05.062548 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: d86ed3daabed4372b955cd83af7ea375 Sep 23 05:38:05.062548 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ServersNegativeTestJSON-1467030007 Sep 23 05:38:05.062548 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 05:38:05.062548 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 05:38:05.062548 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d86ed3daabed4372b955cd83af7ea375", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d86ed3daabed4372b955cd83af7ea375"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d86ed3daabed4372b955cd83af7ea375"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d86ed3daabed4372b955cd83af7ea375"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:38:05.062548 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ServersNegativeTestJSON-1467030007 Sep 23 05:38:05.062548 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: d86ed3daabed4372b955cd83af7ea375 Sep 23 05:38:05.062548 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1467030007 Sep 23 05:38:05.062548 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ServersNegativeTestJSON-1467030007-project Sep 23 05:38:05.062548 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 05:38:05.062548 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 05:38:05.062548 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: b558443264ea404983933609b1f9076c Sep 23 05:38:05.062548 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ServersNegativeTestJSON-1467030007-project Sep 23 05:38:05.062548 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 05:38:05.062548 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 049618db-3a54-4a23-aa03-ca9085693e86 could not be found. Sep 23 05:38:05.062548 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '049618db-3a54-4a23-aa03-ca9085693e86'} Sep 23 05:38:05.062548 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:38:05.062548 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:38:05.062548 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 05:38:05.062548 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 05:38:05.062548 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 05:38:05.062548 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 05:38:05.062548 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 05:38:05.062548 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 05:38:05.062548 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 05:38:05.062548 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 05:38:05.062548 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 049618db-3a54-4a23-aa03-ca9085693e86 could not be found. Sep 23 05:38:05.062548 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:38:05.062548 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:38:05.062548 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:38:05.062548 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:38:05.062548 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:38:05.062548 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:38:05.062548 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:38:05.062548 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:38:05.062548 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:38:05.062548 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:38:05.062548 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 05:38:05.062548 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 05:38:05.062548 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 05:38:05.062548 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 05:38:05.062548 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 05:38:05.062548 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:38:05.062548 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 049618db-3a54-4a23-aa03-ca9085693e86 could not be found. Sep 23 05:38:05.062548 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:38:05.062548 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:38:05.062548 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:38:05.067785 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:38:05.067785 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:38:05.067785 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:38:05.067785 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:38:05.067785 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:38:05.067785 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 049618db-3a54-4a23-aa03-ca9085693e86 could not be found. Sep 23 05:38:05.067785 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:38:05.067785 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-28251ca7-1339-4e5c-9ce9-29a3853cc280 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Returning 404 to user: Instance 049618db-3a54-4a23-aa03-ca9085693e86 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:38:05.067785 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-28251ca7-1339-4e5c-9ce9-29a3853cc280 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] 10.222.0.33 "GET /compute/v2.1/servers/049618db-3a54-4a23-aa03-ca9085693e86" status: 404 len: 111 microversion: 2.1 time: 0.032761 Sep 23 05:38:05.067785 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3694/7568] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:38:05 2022] GET /compute/v2.1/servers/049618db-3a54-4a23-aa03-ca9085693e86 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 05:38:05.078355 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-cb0faa8f-7c4b-4cff-9e03-e5126356072c tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:38:05.079770 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-cb0faa8f-7c4b-4cff-9e03-e5126356072c tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] [instance: 289f7bc3-97f6-4f2a-920f-f9dd9dd9c87d] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:38:05.085439 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cb0faa8f-7c4b-4cff-9e03-e5126356072c tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:38:05.086071 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cb0faa8f-7c4b-4cff-9e03-e5126356072c tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:38:05.086430 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cb0faa8f-7c4b-4cff-9e03-e5126356072c tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:38:05.087125 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cb0faa8f-7c4b-4cff-9e03-e5126356072c tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:38:05.087581 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cb0faa8f-7c4b-4cff-9e03-e5126356072c tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:38:05.088002 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cb0faa8f-7c4b-4cff-9e03-e5126356072c tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:38:05.215119 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-cb0faa8f-7c4b-4cff-9e03-e5126356072c tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b558443264ea404983933609b1f9076c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86ed3daabed4372b955cd83af7ea375', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:38:05.223346 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-cb0faa8f-7c4b-4cff-9e03-e5126356072c tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] 10.222.0.33 "GET /compute/v2.1/servers/289f7bc3-97f6-4f2a-920f-f9dd9dd9c87d" status: 200 len: 1506 microversion: 2.1 time: 0.149832 Sep 23 05:38:05.223942 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3875/7569] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:38:05 2022] GET /compute/v2.1/servers/289f7bc3-97f6-4f2a-920f-f9dd9dd9c87d => generated 1506 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:38:05.246064 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c069c1a7-385f-4cb1-970b-34950b3b1106 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:38:05.248469 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c069c1a7-385f-4cb1-970b-34950b3b1106 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] [instance: 2dab1d6a-e82a-4c69-be6c-257b184d7fcc] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:38:05.254101 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-c069c1a7-385f-4cb1-970b-34950b3b1106 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] HTTP exception thrown: Instance 2dab1d6a-e82a-4c69-be6c-257b184d7fcc could not be found. Sep 23 05:38:05.255693 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c069c1a7-385f-4cb1-970b-34950b3b1106 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Request method failure captured: Sep 23 05:38:05.255693 n-d-846463-3 devstack@n-api.service[122698]: request: POST /compute/v2.1/servers/2dab1d6a-e82a-4c69-be6c-257b184d7fcc/action HTTP/1.1 Sep 23 05:38:05.255693 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 05:38:05.255693 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 05:38:05.255693 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 05:38:05.255693 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 32 Sep 23 05:38:05.255693 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 05:38:05.255693 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 05:38:05.255693 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 05:38:05.255693 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 05:38:05.255693 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLUYi3RbaY5_-Z32UMivbwibb3SJjx7H71KOjuHuf7HmDZwb-48FVBSFdAm8nDDVA5RCIKaeT2sk3c09rb6_6ODgZ5b0IHRSzScU8IOZrh0dFOT6bCgTTYzw3tLMKSq5GA9_X85JqtqBiJW2oVUj5UaTLKBIqybwFQFbI1a3PxBZ567I Sep 23 05:38:05.255693 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 05:38:05.255693 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 05:38:05.255693 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 05:38:05.255693 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 05:38:05.255693 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 05:38:05.255693 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 05:38:05.255693 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: d86ed3daabed4372b955cd83af7ea375 Sep 23 05:38:05.255693 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ServersNegativeTestJSON-1467030007 Sep 23 05:38:05.255693 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 05:38:05.255693 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 05:38:05.255693 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d86ed3daabed4372b955cd83af7ea375", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d86ed3daabed4372b955cd83af7ea375"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d86ed3daabed4372b955cd83af7ea375"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d86ed3daabed4372b955cd83af7ea375"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:38:05.255693 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ServersNegativeTestJSON-1467030007 Sep 23 05:38:05.255693 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: d86ed3daabed4372b955cd83af7ea375 Sep 23 05:38:05.255693 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1467030007 Sep 23 05:38:05.255693 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ServersNegativeTestJSON-1467030007-project Sep 23 05:38:05.255693 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 05:38:05.255693 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 05:38:05.255693 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: b558443264ea404983933609b1f9076c Sep 23 05:38:05.255693 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ServersNegativeTestJSON-1467030007-project Sep 23 05:38:05.255693 n-d-846463-3 devstack@n-api.service[122698]: Sep 23 05:38:05.255693 n-d-846463-3 devstack@n-api.service[122698]: {"resize": {"flavorRef": "452"}} Sep 23 05:38:05.255693 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 05:38:05.255693 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 2dab1d6a-e82a-4c69-be6c-257b184d7fcc could not be found. Sep 23 05:38:05.255693 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '2dab1d6a-e82a-4c69-be6c-257b184d7fcc', 'body': {'resize': {'flavorRef': '452'}}} Sep 23 05:38:05.255693 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:38:05.255693 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:38:05.255693 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 05:38:05.255693 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 05:38:05.255693 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 05:38:05.255693 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 05:38:05.255693 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 23 05:38:05.255693 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 23 05:38:05.255693 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2dab1d6a-e82a-4c69-be6c-257b184d7fcc could not be found. Sep 23 05:38:05.255693 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:38:05.255693 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:38:05.255693 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:38:05.255693 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:38:05.255693 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:38:05.255693 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:38:05.255693 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:38:05.255693 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:38:05.255693 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:38:05.255693 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:38:05.255693 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 05:38:05.255693 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 05:38:05.255693 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Sep 23 05:38:05.255693 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Sep 23 05:38:05.255693 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Sep 23 05:38:05.255693 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Sep 23 05:38:05.255693 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 05:38:05.255693 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 05:38:05.255693 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 05:38:05.255693 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:38:05.261066 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2dab1d6a-e82a-4c69-be6c-257b184d7fcc could not be found. Sep 23 05:38:05.261066 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:38:05.261066 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:38:05.261066 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:38:05.261066 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:38:05.261066 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:38:05.261066 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:38:05.261066 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:38:05.261066 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:38:05.261066 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2dab1d6a-e82a-4c69-be6c-257b184d7fcc could not be found. Sep 23 05:38:05.261066 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:38:05.261066 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c069c1a7-385f-4cb1-970b-34950b3b1106 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Returning 404 to user: Instance 2dab1d6a-e82a-4c69-be6c-257b184d7fcc could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:38:05.261066 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c069c1a7-385f-4cb1-970b-34950b3b1106 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] 10.222.0.33 "POST /compute/v2.1/servers/2dab1d6a-e82a-4c69-be6c-257b184d7fcc/action" status: 404 len: 111 microversion: 2.1 time: 0.015164 Sep 23 05:38:05.261066 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3695/7570] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 05:38:05 2022] POST /compute/v2.1/servers/2dab1d6a-e82a-4c69-be6c-257b184d7fcc/action => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 05:38:05.265671 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2b0ac612-7a2b-48ba-a5ea-025ea3c61502 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:38:05.266328 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-2b0ac612-7a2b-48ba-a5ea-025ea3c61502 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] [instance: 289f7bc3-97f6-4f2a-920f-f9dd9dd9c87d] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:38:05.272438 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2b0ac612-7a2b-48ba-a5ea-025ea3c61502 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:38:05.272942 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2b0ac612-7a2b-48ba-a5ea-025ea3c61502 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:38:05.273388 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2b0ac612-7a2b-48ba-a5ea-025ea3c61502 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:38:05.274127 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2b0ac612-7a2b-48ba-a5ea-025ea3c61502 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:38:05.274597 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2b0ac612-7a2b-48ba-a5ea-025ea3c61502 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:38:05.275069 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2b0ac612-7a2b-48ba-a5ea-025ea3c61502 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:38:05.294418 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:38:05.404375 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2b0ac612-7a2b-48ba-a5ea-025ea3c61502 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b558443264ea404983933609b1f9076c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86ed3daabed4372b955cd83af7ea375', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:38:05.412122 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2b0ac612-7a2b-48ba-a5ea-025ea3c61502 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] 10.222.0.33 "GET /compute/v2.1/servers/289f7bc3-97f6-4f2a-920f-f9dd9dd9c87d" status: 200 len: 1506 microversion: 2.1 time: 0.150541 Sep 23 05:38:05.412697 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3876/7571] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:38:05 2022] GET /compute/v2.1/servers/289f7bc3-97f6-4f2a-920f-f9dd9dd9c87d => generated 1506 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:38:05.434987 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-68635559-d9ea-4307-8052-daaa6ab1e3a8 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:38:05.435626 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-68635559-d9ea-4307-8052-daaa6ab1e3a8 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] [instance: 289f7bc3-97f6-4f2a-920f-f9dd9dd9c87d] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:38:05.442511 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-68635559-d9ea-4307-8052-daaa6ab1e3a8 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:38:05.443012 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-68635559-d9ea-4307-8052-daaa6ab1e3a8 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:38:05.443470 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-68635559-d9ea-4307-8052-daaa6ab1e3a8 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:38:05.444178 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-68635559-d9ea-4307-8052-daaa6ab1e3a8 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:38:05.444654 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-68635559-d9ea-4307-8052-daaa6ab1e3a8 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:38:05.445132 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-68635559-d9ea-4307-8052-daaa6ab1e3a8 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:38:05.576558 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-68635559-d9ea-4307-8052-daaa6ab1e3a8 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b558443264ea404983933609b1f9076c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86ed3daabed4372b955cd83af7ea375', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:38:05.584397 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-68635559-d9ea-4307-8052-daaa6ab1e3a8 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] 10.222.0.33 "GET /compute/v2.1/servers/289f7bc3-97f6-4f2a-920f-f9dd9dd9c87d" status: 200 len: 1506 microversion: 2.1 time: 0.153316 Sep 23 05:38:05.584942 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3696/7572] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:38:05 2022] GET /compute/v2.1/servers/289f7bc3-97f6-4f2a-920f-f9dd9dd9c87d => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:38:05.607587 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-fe25494c-97ad-4631-aad5-8941db4ed78a tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "60577b3b-5211-42b3-82bd-e8d2ff229c31"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:38:05.609910 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-fe25494c-97ad-4631-aad5-8941db4ed78a tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] [instance: 289f7bc3-97f6-4f2a-920f-f9dd9dd9c87d] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:38:05.615810 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fe25494c-97ad-4631-aad5-8941db4ed78a tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:38:05.616296 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fe25494c-97ad-4631-aad5-8941db4ed78a tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:38:05.616814 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fe25494c-97ad-4631-aad5-8941db4ed78a tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:38:05.617503 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fe25494c-97ad-4631-aad5-8941db4ed78a tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:38:05.618015 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fe25494c-97ad-4631-aad5-8941db4ed78a tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:38:05.618444 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fe25494c-97ad-4631-aad5-8941db4ed78a tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:38:05.657690 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-fe25494c-97ad-4631-aad5-8941db4ed78a tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b558443264ea404983933609b1f9076c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86ed3daabed4372b955cd83af7ea375', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:38:05.663005 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-fe25494c-97ad-4631-aad5-8941db4ed78a tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] HTTP exception thrown: Flavor 60577b3b-5211-42b3-82bd-e8d2ff229c31 could not be found. Sep 23 05:38:05.664932 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-fe25494c-97ad-4631-aad5-8941db4ed78a tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Request method failure captured: Sep 23 05:38:05.664932 n-d-846463-3 devstack@n-api.service[122699]: request: POST /compute/v2.1/servers/289f7bc3-97f6-4f2a-920f-f9dd9dd9c87d/action HTTP/1.1 Sep 23 05:38:05.664932 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 05:38:05.664932 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 05:38:05.664932 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 05:38:05.664932 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 65 Sep 23 05:38:05.664932 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 05:38:05.664932 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 05:38:05.664932 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 05:38:05.664932 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 05:38:05.664932 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLUYi3RbaY5_-Z32UMivbwibb3SJjx7H71KOjuHuf7HmDZwb-48FVBSFdAm8nDDVA5RCIKaeT2sk3c09rb6_6ODgZ5b0IHRSzScU8IOZrh0dFOT6bCgTTYzw3tLMKSq5GA9_X85JqtqBiJW2oVUj5UaTLKBIqybwFQFbI1a3PxBZ567I Sep 23 05:38:05.664932 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 05:38:05.664932 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 05:38:05.664932 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 05:38:05.664932 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 05:38:05.664932 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 05:38:05.664932 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 05:38:05.664932 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: d86ed3daabed4372b955cd83af7ea375 Sep 23 05:38:05.664932 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ServersNegativeTestJSON-1467030007 Sep 23 05:38:05.664932 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 05:38:05.664932 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 05:38:05.664932 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d86ed3daabed4372b955cd83af7ea375", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d86ed3daabed4372b955cd83af7ea375"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d86ed3daabed4372b955cd83af7ea375"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d86ed3daabed4372b955cd83af7ea375"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:38:05.664932 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ServersNegativeTestJSON-1467030007 Sep 23 05:38:05.664932 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: d86ed3daabed4372b955cd83af7ea375 Sep 23 05:38:05.664932 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1467030007 Sep 23 05:38:05.664932 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ServersNegativeTestJSON-1467030007-project Sep 23 05:38:05.664932 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 05:38:05.664932 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 05:38:05.664932 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: b558443264ea404983933609b1f9076c Sep 23 05:38:05.664932 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ServersNegativeTestJSON-1467030007-project Sep 23 05:38:05.664932 n-d-846463-3 devstack@n-api.service[122699]: Sep 23 05:38:05.664932 n-d-846463-3 devstack@n-api.service[122699]: {"resize": {"flavorRef": "60577b3b-5211-42b3-82bd-e8d2ff229c31"}} Sep 23 05:38:05.664932 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 05:38:05.664932 n-d-846463-3 devstack@n-api.service[122699]: exception: Flavor 60577b3b-5211-42b3-82bd-e8d2ff229c31 could not be found. Sep 23 05:38:05.664932 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '289f7bc3-97f6-4f2a-920f-f9dd9dd9c87d', 'body': {'resize': {'flavorRef': '60577b3b-5211-42b3-82bd-e8d2ff229c31'}}} Sep 23 05:38:05.664932 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:38:05.664932 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:38:05.664932 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Sep 23 05:38:05.664932 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Sep 23 05:38:05.664932 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 23 05:38:05.664932 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 23 05:38:05.664932 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 23 05:38:05.664932 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 23 05:38:05.664932 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 23 05:38:05.664932 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 23 05:38:05.664932 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 23 05:38:05.664932 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 23 05:38:05.664932 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 23 05:38:05.664932 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 23 05:38:05.664932 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 23 05:38:05.664932 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 23 05:38:05.664932 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4200, in resize Sep 23 05:38:05.664932 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Sep 23 05:38:05.664932 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 23 05:38:05.664932 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 23 05:38:05.664932 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 05:38:05.664932 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 05:38:05.664932 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 23 05:38:05.664932 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 23 05:38:05.664932 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 23 05:38:05.664932 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:38:05.664932 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 23 05:38:05.669735 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 23 05:38:05.669735 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 60577b3b-5211-42b3-82bd-e8d2ff229c31 could not be found. Sep 23 05:38:05.669735 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:38:05.669735 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:38:05.669735 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:38:05.669735 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:38:05.669735 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:38:05.669735 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:38:05.669735 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:38:05.669735 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:38:05.669735 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:38:05.669735 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:38:05.669735 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 05:38:05.669735 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 05:38:05.669735 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Sep 23 05:38:05.669735 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Sep 23 05:38:05.669735 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Sep 23 05:38:05.669735 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 23 05:38:05.669735 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 60577b3b-5211-42b3-82bd-e8d2ff229c31 could not be found. Sep 23 05:38:05.669735 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:38:05.669735 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:38:05.669735 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:38:05.669735 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:38:05.669735 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:38:05.669735 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:38:05.669735 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:38:05.669735 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:38:05.669735 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 60577b3b-5211-42b3-82bd-e8d2ff229c31 could not be found. Sep 23 05:38:05.669735 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:38:05.669735 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-fe25494c-97ad-4631-aad5-8941db4ed78a tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Returning 400 to user: Flavor 60577b3b-5211-42b3-82bd-e8d2ff229c31 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:38:05.669735 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-fe25494c-97ad-4631-aad5-8941db4ed78a tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] 10.222.0.33 "POST /compute/v2.1/servers/289f7bc3-97f6-4f2a-920f-f9dd9dd9c87d/action" status: 400 len: 107 microversion: 2.1 time: 0.062800 Sep 23 05:38:05.669735 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3877/7573] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 05:38:05 2022] POST /compute/v2.1/servers/289f7bc3-97f6-4f2a-920f-f9dd9dd9c87d/action => generated 107 bytes in 64 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 05:38:05.675315 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-572cf21f-a4a8-4fe4-a40b-e2943ea9228f tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:38:05.675961 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-572cf21f-a4a8-4fe4-a40b-e2943ea9228f tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] [instance: 289f7bc3-97f6-4f2a-920f-f9dd9dd9c87d] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:38:05.681848 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-572cf21f-a4a8-4fe4-a40b-e2943ea9228f tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:38:05.682383 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-572cf21f-a4a8-4fe4-a40b-e2943ea9228f tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:38:05.682841 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-572cf21f-a4a8-4fe4-a40b-e2943ea9228f tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:38:05.683549 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-572cf21f-a4a8-4fe4-a40b-e2943ea9228f tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:38:05.684026 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-572cf21f-a4a8-4fe4-a40b-e2943ea9228f tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:38:05.684469 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-572cf21f-a4a8-4fe4-a40b-e2943ea9228f tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:38:05.811571 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-572cf21f-a4a8-4fe4-a40b-e2943ea9228f tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b558443264ea404983933609b1f9076c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86ed3daabed4372b955cd83af7ea375', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:38:05.819404 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-572cf21f-a4a8-4fe4-a40b-e2943ea9228f tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] 10.222.0.33 "GET /compute/v2.1/servers/289f7bc3-97f6-4f2a-920f-f9dd9dd9c87d" status: 200 len: 1506 microversion: 2.1 time: 0.148087 Sep 23 05:38:05.819988 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3697/7574] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:38:05 2022] GET /compute/v2.1/servers/289f7bc3-97f6-4f2a-920f-f9dd9dd9c87d => generated 1506 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:38:05.842845 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a62b1b1c-3413-44a2-b705-6cbf3185ada1 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:38:05.843396 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a62b1b1c-3413-44a2-b705-6cbf3185ada1 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] [instance: 289f7bc3-97f6-4f2a-920f-f9dd9dd9c87d] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:38:05.849362 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a62b1b1c-3413-44a2-b705-6cbf3185ada1 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:38:05.849855 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a62b1b1c-3413-44a2-b705-6cbf3185ada1 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:38:05.850342 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a62b1b1c-3413-44a2-b705-6cbf3185ada1 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:38:05.851047 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a62b1b1c-3413-44a2-b705-6cbf3185ada1 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:38:05.851504 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a62b1b1c-3413-44a2-b705-6cbf3185ada1 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:38:05.851934 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a62b1b1c-3413-44a2-b705-6cbf3185ada1 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:38:05.983108 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a62b1b1c-3413-44a2-b705-6cbf3185ada1 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b558443264ea404983933609b1f9076c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86ed3daabed4372b955cd83af7ea375', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:38:05.990865 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a62b1b1c-3413-44a2-b705-6cbf3185ada1 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] 10.222.0.33 "GET /compute/v2.1/servers/289f7bc3-97f6-4f2a-920f-f9dd9dd9c87d" status: 200 len: 1506 microversion: 2.1 time: 0.151955 Sep 23 05:38:05.991429 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3878/7575] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:38:05 2022] GET /compute/v2.1/servers/289f7bc3-97f6-4f2a-920f-f9dd9dd9c87d => generated 1506 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:38:06.014218 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-802616b5-ed91-46b7-859b-085409eee02e tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:38:06.018197 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-802616b5-ed91-46b7-859b-085409eee02e tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Request method failure captured: Sep 23 05:38:06.018197 n-d-846463-3 devstack@n-api.service[122698]: request: POST /compute/v2.1/servers/289f7bc3-97f6-4f2a-920f-f9dd9dd9c87d/action HTTP/1.1 Sep 23 05:38:06.018197 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 05:38:06.018197 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 05:38:06.018197 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 05:38:06.018197 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 29 Sep 23 05:38:06.018197 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 05:38:06.018197 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 05:38:06.018197 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 05:38:06.018197 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 05:38:06.018197 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLUYi3RbaY5_-Z32UMivbwibb3SJjx7H71KOjuHuf7HmDZwb-48FVBSFdAm8nDDVA5RCIKaeT2sk3c09rb6_6ODgZ5b0IHRSzScU8IOZrh0dFOT6bCgTTYzw3tLMKSq5GA9_X85JqtqBiJW2oVUj5UaTLKBIqybwFQFbI1a3PxBZ567I Sep 23 05:38:06.018197 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 05:38:06.018197 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 05:38:06.018197 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 05:38:06.018197 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 05:38:06.018197 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 05:38:06.018197 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 05:38:06.018197 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: d86ed3daabed4372b955cd83af7ea375 Sep 23 05:38:06.018197 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ServersNegativeTestJSON-1467030007 Sep 23 05:38:06.018197 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 05:38:06.018197 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 05:38:06.018197 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d86ed3daabed4372b955cd83af7ea375", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d86ed3daabed4372b955cd83af7ea375"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d86ed3daabed4372b955cd83af7ea375"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d86ed3daabed4372b955cd83af7ea375"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:38:06.018197 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ServersNegativeTestJSON-1467030007 Sep 23 05:38:06.018197 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: d86ed3daabed4372b955cd83af7ea375 Sep 23 05:38:06.018197 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1467030007 Sep 23 05:38:06.018197 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ServersNegativeTestJSON-1467030007-project Sep 23 05:38:06.018197 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 05:38:06.018197 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 05:38:06.018197 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: b558443264ea404983933609b1f9076c Sep 23 05:38:06.018197 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ServersNegativeTestJSON-1467030007-project Sep 23 05:38:06.018197 n-d-846463-3 devstack@n-api.service[122698]: Sep 23 05:38:06.018197 n-d-846463-3 devstack@n-api.service[122698]: {"resize": {"flavorRef": ""}} Sep 23 05:38:06.018197 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 05:38:06.018197 n-d-846463-3 devstack@n-api.service[122698]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Sep 23 05:38:06.018197 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '289f7bc3-97f6-4f2a-920f-f9dd9dd9c87d', 'body': {'resize': {'flavorRef': ''}}} Sep 23 05:38:06.018197 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:38:06.018197 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:38:06.018197 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 23 05:38:06.018197 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 23 05:38:06.018197 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 23 05:38:06.018197 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise error Sep 23 05:38:06.018197 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 23 05:38:06.018197 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:38:06.018197 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Sep 23 05:38:06.018197 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Sep 23 05:38:06.018197 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:38:06.018197 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi On instance['resize']: Sep 23 05:38:06.018197 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi '' Sep 23 05:38:06.018197 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:38:06.018197 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:38:06.018197 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:38:06.018197 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:38:06.018197 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:38:06.018197 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:38:06.018197 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:38:06.018197 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:38:06.018197 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:38:06.018197 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:38:06.018197 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 23 05:38:06.018197 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 23 05:38:06.018197 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 23 05:38:06.018197 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 23 05:38:06.018197 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 23 05:38:06.018197 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 23 05:38:06.018197 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Sep 23 05:38:06.018197 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:38:06.018197 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:38:06.023805 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:38:06.023805 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:38:06.023805 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:38:06.023805 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:38:06.023805 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 23 05:38:06.023805 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 23 05:38:06.023805 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Sep 23 05:38:06.023805 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:38:06.023805 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-802616b5-ed91-46b7-859b-085409eee02e tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:38:06.023805 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-802616b5-ed91-46b7-859b-085409eee02e tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] 10.222.0.33 "POST /compute/v2.1/servers/289f7bc3-97f6-4f2a-920f-f9dd9dd9c87d/action" status: 400 len: 113 microversion: 2.1 time: 0.010062 Sep 23 05:38:06.023805 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3698/7576] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 05:38:06 2022] POST /compute/v2.1/servers/289f7bc3-97f6-4f2a-920f-f9dd9dd9c87d/action => generated 113 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 05:38:06.028187 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-cb2a9115-e3e2-4846-9f7e-c784d22923d5 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:38:06.028798 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-cb2a9115-e3e2-4846-9f7e-c784d22923d5 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] [instance: 289f7bc3-97f6-4f2a-920f-f9dd9dd9c87d] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:38:06.034812 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cb2a9115-e3e2-4846-9f7e-c784d22923d5 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:38:06.035300 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cb2a9115-e3e2-4846-9f7e-c784d22923d5 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:38:06.035738 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cb2a9115-e3e2-4846-9f7e-c784d22923d5 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:38:06.036421 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cb2a9115-e3e2-4846-9f7e-c784d22923d5 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:38:06.036879 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cb2a9115-e3e2-4846-9f7e-c784d22923d5 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:38:06.037329 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cb2a9115-e3e2-4846-9f7e-c784d22923d5 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:38:06.163592 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-cb2a9115-e3e2-4846-9f7e-c784d22923d5 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b558443264ea404983933609b1f9076c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86ed3daabed4372b955cd83af7ea375', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:38:06.171973 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-cb2a9115-e3e2-4846-9f7e-c784d22923d5 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] 10.222.0.33 "GET /compute/v2.1/servers/289f7bc3-97f6-4f2a-920f-f9dd9dd9c87d" status: 200 len: 1506 microversion: 2.1 time: 0.147651 Sep 23 05:38:06.172553 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3879/7577] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:38:06 2022] GET /compute/v2.1/servers/289f7bc3-97f6-4f2a-920f-f9dd9dd9c87d => generated 1506 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:38:06.198835 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6be18af6-96ac-4efd-b828-b0949311893b tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:38:06.199344 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-6be18af6-96ac-4efd-b828-b0949311893b tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] [instance: 049618db-3a54-4a23-aa03-ca9085693e86] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:38:06.208711 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6be18af6-96ac-4efd-b828-b0949311893b tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:38:06.209219 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6be18af6-96ac-4efd-b828-b0949311893b tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:38:06.209677 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6be18af6-96ac-4efd-b828-b0949311893b tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:38:06.210416 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6be18af6-96ac-4efd-b828-b0949311893b tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:38:06.210892 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6be18af6-96ac-4efd-b828-b0949311893b tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:38:06.211341 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6be18af6-96ac-4efd-b828-b0949311893b tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:38:06.224312 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-6be18af6-96ac-4efd-b828-b0949311893b tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] HTTP exception thrown: Instance 049618db-3a54-4a23-aa03-ca9085693e86 could not be found. Sep 23 05:38:06.225924 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6be18af6-96ac-4efd-b828-b0949311893b tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Request method failure captured: Sep 23 05:38:06.225924 n-d-846463-3 devstack@n-api.service[122698]: request: DELETE /compute/v2.1/servers/049618db-3a54-4a23-aa03-ca9085693e86 HTTP/1.1 Sep 23 05:38:06.225924 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 05:38:06.225924 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 05:38:06.225924 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 05:38:06.225924 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 05:38:06.225924 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 05:38:06.225924 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 05:38:06.225924 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 05:38:06.225924 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 05:38:06.225924 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLUYi3RbaY5_-Z32UMivbwibb3SJjx7H71KOjuHuf7HmDZwb-48FVBSFdAm8nDDVA5RCIKaeT2sk3c09rb6_6ODgZ5b0IHRSzScU8IOZrh0dFOT6bCgTTYzw3tLMKSq5GA9_X85JqtqBiJW2oVUj5UaTLKBIqybwFQFbI1a3PxBZ567I Sep 23 05:38:06.225924 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 05:38:06.225924 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 05:38:06.225924 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 05:38:06.225924 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 05:38:06.225924 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 05:38:06.225924 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 05:38:06.225924 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: d86ed3daabed4372b955cd83af7ea375 Sep 23 05:38:06.225924 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-ServersNegativeTestJSON-1467030007 Sep 23 05:38:06.225924 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 05:38:06.225924 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 05:38:06.225924 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d86ed3daabed4372b955cd83af7ea375", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d86ed3daabed4372b955cd83af7ea375"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d86ed3daabed4372b955cd83af7ea375"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d86ed3daabed4372b955cd83af7ea375"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:38:06.225924 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-ServersNegativeTestJSON-1467030007 Sep 23 05:38:06.225924 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: d86ed3daabed4372b955cd83af7ea375 Sep 23 05:38:06.225924 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1467030007 Sep 23 05:38:06.225924 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-ServersNegativeTestJSON-1467030007-project Sep 23 05:38:06.225924 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 05:38:06.225924 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 05:38:06.225924 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: b558443264ea404983933609b1f9076c Sep 23 05:38:06.225924 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-ServersNegativeTestJSON-1467030007-project Sep 23 05:38:06.225924 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 05:38:06.225924 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 049618db-3a54-4a23-aa03-ca9085693e86 could not be found. Sep 23 05:38:06.225924 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '049618db-3a54-4a23-aa03-ca9085693e86'} Sep 23 05:38:06.225924 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:38:06.225924 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:38:06.225924 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 05:38:06.225924 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 05:38:06.225924 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 05:38:06.225924 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 05:38:06.225924 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 05:38:06.225924 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 05:38:06.225924 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 05:38:06.225924 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 05:38:06.225924 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 049618db-3a54-4a23-aa03-ca9085693e86 could not be found. Sep 23 05:38:06.225924 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:38:06.225924 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:38:06.225924 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:38:06.225924 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:38:06.225924 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:38:06.225924 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:38:06.225924 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:38:06.225924 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:38:06.225924 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:38:06.225924 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:38:06.225924 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 05:38:06.225924 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 05:38:06.225924 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 05:38:06.225924 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 05:38:06.225924 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 05:38:06.225924 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 05:38:06.225924 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 05:38:06.225924 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:38:06.230314 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 049618db-3a54-4a23-aa03-ca9085693e86 could not be found. Sep 23 05:38:06.230314 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:38:06.230314 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:38:06.230314 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:38:06.230314 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:38:06.230314 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:38:06.230314 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:38:06.230314 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:38:06.230314 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:38:06.230314 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 049618db-3a54-4a23-aa03-ca9085693e86 could not be found. Sep 23 05:38:06.230314 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:38:06.230314 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6be18af6-96ac-4efd-b828-b0949311893b tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Returning 404 to user: Instance 049618db-3a54-4a23-aa03-ca9085693e86 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:38:06.230314 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-6be18af6-96ac-4efd-b828-b0949311893b tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] 10.222.0.33 "DELETE /compute/v2.1/servers/049618db-3a54-4a23-aa03-ca9085693e86" status: 404 len: 111 microversion: 2.1 time: 0.033300 Sep 23 05:38:06.230314 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3699/7578] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 05:38:06 2022] DELETE /compute/v2.1/servers/049618db-3a54-4a23-aa03-ca9085693e86 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 05:38:06.236386 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-abce4945-9651-4aa5-aac0-e7af03dbb5c5 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:38:06.237005 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-abce4945-9651-4aa5-aac0-e7af03dbb5c5 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] [instance: 049618db-3a54-4a23-aa03-ca9085693e86] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:38:06.243070 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-abce4945-9651-4aa5-aac0-e7af03dbb5c5 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:38:06.243561 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-abce4945-9651-4aa5-aac0-e7af03dbb5c5 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:38:06.244004 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-abce4945-9651-4aa5-aac0-e7af03dbb5c5 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:38:06.244702 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-abce4945-9651-4aa5-aac0-e7af03dbb5c5 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:38:06.245169 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-abce4945-9651-4aa5-aac0-e7af03dbb5c5 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:38:06.245605 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-abce4945-9651-4aa5-aac0-e7af03dbb5c5 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:38:06.259697 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-abce4945-9651-4aa5-aac0-e7af03dbb5c5 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] HTTP exception thrown: Instance 049618db-3a54-4a23-aa03-ca9085693e86 could not be found. Sep 23 05:38:06.261228 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-abce4945-9651-4aa5-aac0-e7af03dbb5c5 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Request method failure captured: Sep 23 05:38:06.261228 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/049618db-3a54-4a23-aa03-ca9085693e86 HTTP/1.1 Sep 23 05:38:06.261228 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 05:38:06.261228 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 05:38:06.261228 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 05:38:06.261228 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 05:38:06.261228 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 05:38:06.261228 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 05:38:06.261228 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 05:38:06.261228 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 05:38:06.261228 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLUYi3RbaY5_-Z32UMivbwibb3SJjx7H71KOjuHuf7HmDZwb-48FVBSFdAm8nDDVA5RCIKaeT2sk3c09rb6_6ODgZ5b0IHRSzScU8IOZrh0dFOT6bCgTTYzw3tLMKSq5GA9_X85JqtqBiJW2oVUj5UaTLKBIqybwFQFbI1a3PxBZ567I Sep 23 05:38:06.261228 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 05:38:06.261228 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 05:38:06.261228 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 05:38:06.261228 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 05:38:06.261228 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 05:38:06.261228 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 05:38:06.261228 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: d86ed3daabed4372b955cd83af7ea375 Sep 23 05:38:06.261228 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ServersNegativeTestJSON-1467030007 Sep 23 05:38:06.261228 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 05:38:06.261228 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 05:38:06.261228 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d86ed3daabed4372b955cd83af7ea375", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d86ed3daabed4372b955cd83af7ea375"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d86ed3daabed4372b955cd83af7ea375"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d86ed3daabed4372b955cd83af7ea375"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:38:06.261228 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ServersNegativeTestJSON-1467030007 Sep 23 05:38:06.261228 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: d86ed3daabed4372b955cd83af7ea375 Sep 23 05:38:06.261228 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1467030007 Sep 23 05:38:06.261228 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ServersNegativeTestJSON-1467030007-project Sep 23 05:38:06.261228 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 05:38:06.261228 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 05:38:06.261228 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: b558443264ea404983933609b1f9076c Sep 23 05:38:06.261228 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ServersNegativeTestJSON-1467030007-project Sep 23 05:38:06.261228 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 05:38:06.261228 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 049618db-3a54-4a23-aa03-ca9085693e86 could not be found. Sep 23 05:38:06.261228 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '049618db-3a54-4a23-aa03-ca9085693e86'} Sep 23 05:38:06.261228 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:38:06.261228 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:38:06.261228 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 05:38:06.261228 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 05:38:06.261228 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 05:38:06.261228 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 05:38:06.261228 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 05:38:06.261228 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 05:38:06.261228 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 05:38:06.261228 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 05:38:06.261228 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 049618db-3a54-4a23-aa03-ca9085693e86 could not be found. Sep 23 05:38:06.261228 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:38:06.261228 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:38:06.261228 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:38:06.261228 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:38:06.261228 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:38:06.261228 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:38:06.261228 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:38:06.261228 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:38:06.261228 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:38:06.261228 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:38:06.261228 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 05:38:06.261228 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 05:38:06.261228 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 05:38:06.261228 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 05:38:06.261228 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 05:38:06.261228 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:38:06.261228 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 049618db-3a54-4a23-aa03-ca9085693e86 could not be found. Sep 23 05:38:06.261228 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:38:06.261228 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:38:06.261228 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:38:06.266361 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:38:06.266361 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:38:06.266361 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:38:06.266361 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:38:06.266361 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:38:06.266361 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 049618db-3a54-4a23-aa03-ca9085693e86 could not be found. Sep 23 05:38:06.266361 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:38:06.266361 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-abce4945-9651-4aa5-aac0-e7af03dbb5c5 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Returning 404 to user: Instance 049618db-3a54-4a23-aa03-ca9085693e86 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:38:06.266361 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-abce4945-9651-4aa5-aac0-e7af03dbb5c5 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] 10.222.0.33 "GET /compute/v2.1/servers/049618db-3a54-4a23-aa03-ca9085693e86" status: 404 len: 111 microversion: 2.1 time: 0.030173 Sep 23 05:38:06.266361 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3880/7579] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:38:06 2022] GET /compute/v2.1/servers/049618db-3a54-4a23-aa03-ca9085693e86 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 05:38:06.271591 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a5d90317-04ca-4a48-bcc1-3e7acfaf53de tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:38:06.272106 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a5d90317-04ca-4a48-bcc1-3e7acfaf53de tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] [instance: 289f7bc3-97f6-4f2a-920f-f9dd9dd9c87d] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:38:06.278131 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a5d90317-04ca-4a48-bcc1-3e7acfaf53de tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:38:06.278637 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a5d90317-04ca-4a48-bcc1-3e7acfaf53de tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:38:06.279095 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a5d90317-04ca-4a48-bcc1-3e7acfaf53de tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:38:06.279806 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a5d90317-04ca-4a48-bcc1-3e7acfaf53de tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:38:06.280284 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a5d90317-04ca-4a48-bcc1-3e7acfaf53de tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:38:06.280734 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a5d90317-04ca-4a48-bcc1-3e7acfaf53de tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:38:06.306107 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a5d90317-04ca-4a48-bcc1-3e7acfaf53de tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] [instance: 289f7bc3-97f6-4f2a-920f-f9dd9dd9c87d] Going to try to terminate instance {{(pid=122698) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 05:38:06.421602 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:38:06.588718 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a5d90317-04ca-4a48-bcc1-3e7acfaf53de tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] 10.222.0.33 "DELETE /compute/v2.1/servers/289f7bc3-97f6-4f2a-920f-f9dd9dd9c87d" status: 204 len: 0 microversion: 2.1 time: 0.320782 Sep 23 05:38:06.589318 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3700/7580] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 05:38:06 2022] DELETE /compute/v2.1/servers/289f7bc3-97f6-4f2a-920f-f9dd9dd9c87d => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 05:38:06.597345 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-168123a0-0c0e-4893-8e69-e92c62c623e5 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:38:06.598002 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-168123a0-0c0e-4893-8e69-e92c62c623e5 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] [instance: 289f7bc3-97f6-4f2a-920f-f9dd9dd9c87d] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:38:06.604102 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-168123a0-0c0e-4893-8e69-e92c62c623e5 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:38:06.604599 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-168123a0-0c0e-4893-8e69-e92c62c623e5 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:38:06.605625 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-168123a0-0c0e-4893-8e69-e92c62c623e5 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:38:06.606445 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-168123a0-0c0e-4893-8e69-e92c62c623e5 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:38:06.607051 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-168123a0-0c0e-4893-8e69-e92c62c623e5 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:38:06.607490 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-168123a0-0c0e-4893-8e69-e92c62c623e5 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:38:06.735416 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-168123a0-0c0e-4893-8e69-e92c62c623e5 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b558443264ea404983933609b1f9076c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86ed3daabed4372b955cd83af7ea375', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:38:06.743263 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-168123a0-0c0e-4893-8e69-e92c62c623e5 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] 10.222.0.33 "GET /compute/v2.1/servers/289f7bc3-97f6-4f2a-920f-f9dd9dd9c87d" status: 200 len: 1512 microversion: 2.1 time: 0.149871 Sep 23 05:38:06.743830 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3881/7581] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:38:06 2022] GET /compute/v2.1/servers/289f7bc3-97f6-4f2a-920f-f9dd9dd9c87d => generated 1512 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:38:07.768476 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-be013d73-ff0b-47a7-ab86-31f7da84ba91 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:38:07.769202 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-be013d73-ff0b-47a7-ab86-31f7da84ba91 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] [instance: 289f7bc3-97f6-4f2a-920f-f9dd9dd9c87d] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:38:07.776540 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-be013d73-ff0b-47a7-ab86-31f7da84ba91 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:38:07.777046 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-be013d73-ff0b-47a7-ab86-31f7da84ba91 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:38:07.777505 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-be013d73-ff0b-47a7-ab86-31f7da84ba91 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:38:07.778882 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-be013d73-ff0b-47a7-ab86-31f7da84ba91 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:38:07.779360 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-be013d73-ff0b-47a7-ab86-31f7da84ba91 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:38:07.779808 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-be013d73-ff0b-47a7-ab86-31f7da84ba91 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:38:07.911666 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-be013d73-ff0b-47a7-ab86-31f7da84ba91 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b558443264ea404983933609b1f9076c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86ed3daabed4372b955cd83af7ea375', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:38:07.919365 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-be013d73-ff0b-47a7-ab86-31f7da84ba91 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] 10.222.0.33 "GET /compute/v2.1/servers/289f7bc3-97f6-4f2a-920f-f9dd9dd9c87d" status: 200 len: 1512 microversion: 2.1 time: 0.155791 Sep 23 05:38:07.919944 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3701/7582] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:38:07 2022] GET /compute/v2.1/servers/289f7bc3-97f6-4f2a-920f-f9dd9dd9c87d => generated 1512 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:38:08.468034 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-21d541bd-dfa2-4fc9-ad22-3acd99be57cc req-869a4238-1966-4634-a9c9-de22187ac709 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "289f7bc3-97f6-4f2a-920f-f9dd9dd9c87d", "name": "network-vif-deleted", "tag": "0089c1b9-9fa4-4ae4-9d5d-02f72a8bdcf6"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:38:08.478378 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-21d541bd-dfa2-4fc9-ad22-3acd99be57cc req-869a4238-1966-4634-a9c9-de22187ac709 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:38:08.484455 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-21d541bd-dfa2-4fc9-ad22-3acd99be57cc req-869a4238-1966-4634-a9c9-de22187ac709 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:38:08.484455 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-21d541bd-dfa2-4fc9-ad22-3acd99be57cc req-869a4238-1966-4634-a9c9-de22187ac709 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:38:08.493971 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-21d541bd-dfa2-4fc9-ad22-3acd99be57cc req-869a4238-1966-4634-a9c9-de22187ac709 service nova] Creating event network-vif-deleted:0089c1b9-9fa4-4ae4-9d5d-02f72a8bdcf6 for instance 289f7bc3-97f6-4f2a-920f-f9dd9dd9c87d on n-h1-846463-3 Sep 23 05:38:08.499947 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-21d541bd-dfa2-4fc9-ad22-3acd99be57cc req-869a4238-1966-4634-a9c9-de22187ac709 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035684 Sep 23 05:38:08.500648 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3882/7583] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:38:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:38:08.942384 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a67625b0-5000-41fb-bd3c-931f862dc04a tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:38:08.943019 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a67625b0-5000-41fb-bd3c-931f862dc04a tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] [instance: 289f7bc3-97f6-4f2a-920f-f9dd9dd9c87d] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:38:08.949865 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a67625b0-5000-41fb-bd3c-931f862dc04a tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:38:08.950405 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a67625b0-5000-41fb-bd3c-931f862dc04a tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:38:08.950863 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a67625b0-5000-41fb-bd3c-931f862dc04a tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:38:08.951582 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a67625b0-5000-41fb-bd3c-931f862dc04a tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:38:08.952056 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a67625b0-5000-41fb-bd3c-931f862dc04a tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:38:08.952501 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a67625b0-5000-41fb-bd3c-931f862dc04a tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:38:08.983422 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a67625b0-5000-41fb-bd3c-931f862dc04a tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:38:08.983944 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a67625b0-5000-41fb-bd3c-931f862dc04a tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:38:08.984405 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a67625b0-5000-41fb-bd3c-931f862dc04a tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:38:08.984868 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-a67625b0-5000-41fb-bd3c-931f862dc04a tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lazy-loading 'fault' on Instance uuid 289f7bc3-97f6-4f2a-920f-f9dd9dd9c87d {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 05:38:09.024779 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a67625b0-5000-41fb-bd3c-931f862dc04a tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b558443264ea404983933609b1f9076c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86ed3daabed4372b955cd83af7ea375', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:38:09.033151 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a67625b0-5000-41fb-bd3c-931f862dc04a tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] 10.222.0.33 "GET /compute/v2.1/servers/289f7bc3-97f6-4f2a-920f-f9dd9dd9c87d" status: 200 len: 1306 microversion: 2.1 time: 0.094704 Sep 23 05:38:09.033728 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3702/7584] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:38:08 2022] GET /compute/v2.1/servers/289f7bc3-97f6-4f2a-920f-f9dd9dd9c87d => generated 1306 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:38:10.057707 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1bb9fa8a-af52-404c-ac42-4aabb6e0b7b0 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:38:10.058472 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1bb9fa8a-af52-404c-ac42-4aabb6e0b7b0 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] [instance: 289f7bc3-97f6-4f2a-920f-f9dd9dd9c87d] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:38:10.061047 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:38:10.066436 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1bb9fa8a-af52-404c-ac42-4aabb6e0b7b0 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:38:10.066940 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1bb9fa8a-af52-404c-ac42-4aabb6e0b7b0 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:38:10.067391 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1bb9fa8a-af52-404c-ac42-4aabb6e0b7b0 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:38:10.068127 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1bb9fa8a-af52-404c-ac42-4aabb6e0b7b0 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:38:10.068598 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1bb9fa8a-af52-404c-ac42-4aabb6e0b7b0 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:38:10.069035 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1bb9fa8a-af52-404c-ac42-4aabb6e0b7b0 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:38:10.082739 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-1bb9fa8a-af52-404c-ac42-4aabb6e0b7b0 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] HTTP exception thrown: Instance 289f7bc3-97f6-4f2a-920f-f9dd9dd9c87d could not be found. Sep 23 05:38:10.084494 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1bb9fa8a-af52-404c-ac42-4aabb6e0b7b0 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Request method failure captured: Sep 23 05:38:10.084494 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/289f7bc3-97f6-4f2a-920f-f9dd9dd9c87d HTTP/1.1 Sep 23 05:38:10.084494 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 05:38:10.084494 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 05:38:10.084494 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 05:38:10.084494 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 05:38:10.084494 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 05:38:10.084494 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 05:38:10.084494 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 05:38:10.084494 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 05:38:10.084494 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLUYi3RbaY5_-Z32UMivbwibb3SJjx7H71KOjuHuf7HmDZwb-48FVBSFdAm8nDDVA5RCIKaeT2sk3c09rb6_6ODgZ5b0IHRSzScU8IOZrh0dFOT6bCgTTYzw3tLMKSq5GA9_X85JqtqBiJW2oVUj5UaTLKBIqybwFQFbI1a3PxBZ567I Sep 23 05:38:10.084494 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 05:38:10.084494 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 05:38:10.084494 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 05:38:10.084494 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 05:38:10.084494 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 05:38:10.084494 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 05:38:10.084494 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: d86ed3daabed4372b955cd83af7ea375 Sep 23 05:38:10.084494 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-ServersNegativeTestJSON-1467030007 Sep 23 05:38:10.084494 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 05:38:10.084494 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 05:38:10.084494 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d86ed3daabed4372b955cd83af7ea375", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d86ed3daabed4372b955cd83af7ea375"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d86ed3daabed4372b955cd83af7ea375"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d86ed3daabed4372b955cd83af7ea375"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:38:10.084494 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-ServersNegativeTestJSON-1467030007 Sep 23 05:38:10.084494 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: d86ed3daabed4372b955cd83af7ea375 Sep 23 05:38:10.084494 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1467030007 Sep 23 05:38:10.084494 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-ServersNegativeTestJSON-1467030007-project Sep 23 05:38:10.084494 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 05:38:10.084494 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 05:38:10.084494 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: b558443264ea404983933609b1f9076c Sep 23 05:38:10.084494 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-ServersNegativeTestJSON-1467030007-project Sep 23 05:38:10.084494 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 05:38:10.084494 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 289f7bc3-97f6-4f2a-920f-f9dd9dd9c87d could not be found. Sep 23 05:38:10.084494 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '289f7bc3-97f6-4f2a-920f-f9dd9dd9c87d'} Sep 23 05:38:10.084494 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:38:10.084494 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:38:10.084494 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 05:38:10.084494 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 05:38:10.084494 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 05:38:10.084494 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 05:38:10.084494 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 05:38:10.084494 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 05:38:10.084494 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 05:38:10.084494 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 05:38:10.084494 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 289f7bc3-97f6-4f2a-920f-f9dd9dd9c87d could not be found. Sep 23 05:38:10.084494 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:38:10.084494 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:38:10.084494 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:38:10.084494 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:38:10.084494 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:38:10.084494 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:38:10.084494 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:38:10.084494 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:38:10.084494 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:38:10.084494 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:38:10.084494 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 05:38:10.084494 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 05:38:10.084494 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 05:38:10.084494 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 05:38:10.084494 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 05:38:10.084494 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:38:10.084494 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 289f7bc3-97f6-4f2a-920f-f9dd9dd9c87d could not be found. Sep 23 05:38:10.084494 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:38:10.084494 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:38:10.084494 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:38:10.089579 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:38:10.089579 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:38:10.089579 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:38:10.089579 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:38:10.089579 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:38:10.089579 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 289f7bc3-97f6-4f2a-920f-f9dd9dd9c87d could not be found. Sep 23 05:38:10.089579 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:38:10.089579 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1bb9fa8a-af52-404c-ac42-4aabb6e0b7b0 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] Returning 404 to user: Instance 289f7bc3-97f6-4f2a-920f-f9dd9dd9c87d could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:38:10.089579 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1bb9fa8a-af52-404c-ac42-4aabb6e0b7b0 tempest-ServersNegativeTestJSON-1467030007 tempest-ServersNegativeTestJSON-1467030007-project] 10.222.0.33 "GET /compute/v2.1/servers/289f7bc3-97f6-4f2a-920f-f9dd9dd9c87d" status: 404 len: 111 microversion: 2.1 time: 0.033069 Sep 23 05:38:10.089579 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3883/7585] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:38:10 2022] GET /compute/v2.1/servers/289f7bc3-97f6-4f2a-920f-f9dd9dd9c87d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 05:38:55.322876 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:38:55.323638 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=14 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:38:55.501531 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f9fae303-175a-4486-abe5-2e65f9bbaf2c tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Action: 'create', calling method: .version_select at 0x7ff1c01384c0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1368348776", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOSLOfc467Tiq+Irifxw7vLb0JCUUjFVRBV71/yXExLDV7XUjPvhywh7A7rFfgfr1EHP3/bicLy1olchjGNQY+U76ouZbjQXfUQR6yX9GyNRv0Kn797lmHAQRmm/0fOQuw=="}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:38:55.519023 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-f9fae303-175a-4486-abe5-2e65f9bbaf2c tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Getting quotas for project 5117afeb2bef4c278a568b425d109a6a. Resources: {'key_pairs'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 05:38:55.524243 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-f9fae303-175a-4486-abe5-2e65f9bbaf2c tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Getting quotas for user 2120ec508557410abc1d13fe13355078 and project 5117afeb2bef4c278a568b425d109a6a. Resources: {'key_pairs'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 05:38:55.638519 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f9fae303-175a-4486-abe5-2e65f9bbaf2c tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.320994 Sep 23 05:38:55.639135 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3703/7586] 10.222.0.33 () {60 vars in 1159 bytes} [Fri Sep 23 05:38:55 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:38:55.689872 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1e07f20e-32d5-46a9-b547-483af3abdbc4 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1502728786", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1368348776", "networks": [{"uuid": "407c633d-2992-4277-81a6-47e9946a6635"}]}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:38:55.699767 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=30 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:38:55.746623 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.neutron [None req-1e07f20e-32d5-46a9-b547-483af3abdbc4 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] validate_networks() for [('407c633d-2992-4277-81a6-47e9946a6635', None, None, None, None, None)] {{(pid=122699) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 05:38:56.213017 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-1e07f20e-32d5-46a9-b547-483af3abdbc4 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Flavor limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 05:38:56.213480 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-1e07f20e-32d5-46a9-b547-483af3abdbc4 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Image limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 05:38:56.214022 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-1e07f20e-32d5-46a9-b547-483af3abdbc4 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Flavor pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 05:38:56.214442 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-1e07f20e-32d5-46a9-b547-483af3abdbc4 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Image pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 05:38:56.214861 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-1e07f20e-32d5-46a9-b547-483af3abdbc4 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 05:38:56.223756 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e07f20e-32d5-46a9-b547-483af3abdbc4 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:38:56.224248 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e07f20e-32d5-46a9-b547-483af3abdbc4 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:38:56.224692 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e07f20e-32d5-46a9-b547-483af3abdbc4 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:38:56.225433 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e07f20e-32d5-46a9-b547-483af3abdbc4 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:38:56.225919 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e07f20e-32d5-46a9-b547-483af3abdbc4 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:38:56.226364 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e07f20e-32d5-46a9-b547-483af3abdbc4 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:38:56.245476 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-1e07f20e-32d5-46a9-b547-483af3abdbc4 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Getting quotas for project 5117afeb2bef4c278a568b425d109a6a. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 05:38:56.250945 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-1e07f20e-32d5-46a9-b547-483af3abdbc4 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Getting quotas for user 2120ec508557410abc1d13fe13355078 and project 5117afeb2bef4c278a568b425d109a6a. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 05:38:56.264263 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1e07f20e-32d5-46a9-b547-483af3abdbc4 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Going to run 1 instances... {{(pid=122699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 05:38:56.266924 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1e07f20e-32d5-46a9-b547-483af3abdbc4 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] [instance: 312aa3a9-f50a-4112-9b74-2b5ec21cb5c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 05:38:56.401810 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1e07f20e-32d5-46a9-b547-483af3abdbc4 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.715742 Sep 23 05:38:56.402616 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3884/7587] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 05:38:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 717 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 05:38:56.415756 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-50ced73b-812e-4501-86bc-c01557b820d1 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:38:56.416959 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-50ced73b-812e-4501-86bc-c01557b820d1 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] [instance: 312aa3a9-f50a-4112-9b74-2b5ec21cb5c8] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:38:56.488640 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-50ced73b-812e-4501-86bc-c01557b820d1 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2120ec508557410abc1d13fe13355078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5117afeb2bef4c278a568b425d109a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:38:56.497509 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-50ced73b-812e-4501-86bc-c01557b820d1 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] 10.222.0.33 "GET /compute/v2.1/servers/312aa3a9-f50a-4112-9b74-2b5ec21cb5c8" status: 200 len: 1263 microversion: 2.1 time: 0.087781 Sep 23 05:38:56.498116 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3704/7588] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:38:56 2022] GET /compute/v2.1/servers/312aa3a9-f50a-4112-9b74-2b5ec21cb5c8 => generated 1263 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:38:57.521648 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-95d24305-c445-48e6-93e5-9adcba5d0322 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:38:57.522330 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-95d24305-c445-48e6-93e5-9adcba5d0322 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] [instance: 312aa3a9-f50a-4112-9b74-2b5ec21cb5c8] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:38:57.530295 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-95d24305-c445-48e6-93e5-9adcba5d0322 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:38:57.530295 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-95d24305-c445-48e6-93e5-9adcba5d0322 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:38:57.530295 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-95d24305-c445-48e6-93e5-9adcba5d0322 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:38:57.530940 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-95d24305-c445-48e6-93e5-9adcba5d0322 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:38:57.531403 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-95d24305-c445-48e6-93e5-9adcba5d0322 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:38:57.531834 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-95d24305-c445-48e6-93e5-9adcba5d0322 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:38:57.597509 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-95d24305-c445-48e6-93e5-9adcba5d0322 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2120ec508557410abc1d13fe13355078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5117afeb2bef4c278a568b425d109a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:38:57.605906 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-95d24305-c445-48e6-93e5-9adcba5d0322 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] 10.222.0.33 "GET /compute/v2.1/servers/312aa3a9-f50a-4112-9b74-2b5ec21cb5c8" status: 200 len: 1267 microversion: 2.1 time: 0.089129 Sep 23 05:38:57.606493 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3885/7589] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:38:57 2022] GET /compute/v2.1/servers/312aa3a9-f50a-4112-9b74-2b5ec21cb5c8 => generated 1267 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:38:58.630027 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a5bafed2-66a4-424b-8c38-ca2a53b1538a tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:38:58.631323 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a5bafed2-66a4-424b-8c38-ca2a53b1538a tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] [instance: 312aa3a9-f50a-4112-9b74-2b5ec21cb5c8] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:38:58.639047 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a5bafed2-66a4-424b-8c38-ca2a53b1538a tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:38:58.640079 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a5bafed2-66a4-424b-8c38-ca2a53b1538a tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:38:58.640557 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a5bafed2-66a4-424b-8c38-ca2a53b1538a tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:38:58.641289 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a5bafed2-66a4-424b-8c38-ca2a53b1538a tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:38:58.641956 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a5bafed2-66a4-424b-8c38-ca2a53b1538a tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:38:58.642595 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a5bafed2-66a4-424b-8c38-ca2a53b1538a tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:38:58.717436 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a5bafed2-66a4-424b-8c38-ca2a53b1538a tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2120ec508557410abc1d13fe13355078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5117afeb2bef4c278a568b425d109a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:38:58.725407 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a5bafed2-66a4-424b-8c38-ca2a53b1538a tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] 10.222.0.33 "GET /compute/v2.1/servers/312aa3a9-f50a-4112-9b74-2b5ec21cb5c8" status: 200 len: 1323 microversion: 2.1 time: 0.100189 Sep 23 05:38:58.726360 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3705/7590] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:38:58 2022] GET /compute/v2.1/servers/312aa3a9-f50a-4112-9b74-2b5ec21cb5c8 => generated 1323 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:38:59.750350 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ad656368-54b0-4ca2-b69d-9c7817e2af68 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:38:59.750977 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ad656368-54b0-4ca2-b69d-9c7817e2af68 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] [instance: 312aa3a9-f50a-4112-9b74-2b5ec21cb5c8] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:38:59.757534 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ad656368-54b0-4ca2-b69d-9c7817e2af68 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:38:59.758080 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ad656368-54b0-4ca2-b69d-9c7817e2af68 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:38:59.758529 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ad656368-54b0-4ca2-b69d-9c7817e2af68 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:38:59.759250 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ad656368-54b0-4ca2-b69d-9c7817e2af68 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:38:59.759714 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ad656368-54b0-4ca2-b69d-9c7817e2af68 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:38:59.760188 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ad656368-54b0-4ca2-b69d-9c7817e2af68 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:38:59.888483 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ad656368-54b0-4ca2-b69d-9c7817e2af68 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2120ec508557410abc1d13fe13355078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5117afeb2bef4c278a568b425d109a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:38:59.896557 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ad656368-54b0-4ca2-b69d-9c7817e2af68 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] 10.222.0.33 "GET /compute/v2.1/servers/312aa3a9-f50a-4112-9b74-2b5ec21cb5c8" status: 200 len: 1363 microversion: 2.1 time: 0.150070 Sep 23 05:38:59.897134 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3886/7591] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:38:59 2022] GET /compute/v2.1/servers/312aa3a9-f50a-4112-9b74-2b5ec21cb5c8 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:39:00.265377 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-f09ec1c2-984b-4200-ab6f-a1d91551c5e9 req-5e838132-f8e4-4c1e-a6e4-84abe19b254d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "312aa3a9-f50a-4112-9b74-2b5ec21cb5c8", "tag": "af3f5c6b-3eba-4ad8-ac47-2a3814aceb5a"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:39:00.276617 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-f09ec1c2-984b-4200-ab6f-a1d91551c5e9 req-5e838132-f8e4-4c1e-a6e4-84abe19b254d service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:39:00.277160 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-f09ec1c2-984b-4200-ab6f-a1d91551c5e9 req-5e838132-f8e4-4c1e-a6e4-84abe19b254d service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:39:00.277616 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-f09ec1c2-984b-4200-ab6f-a1d91551c5e9 req-5e838132-f8e4-4c1e-a6e4-84abe19b254d service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:39:00.292224 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-f09ec1c2-984b-4200-ab6f-a1d91551c5e9 req-5e838132-f8e4-4c1e-a6e4-84abe19b254d service nova] Creating event network-changed:af3f5c6b-3eba-4ad8-ac47-2a3814aceb5a for instance 312aa3a9-f50a-4112-9b74-2b5ec21cb5c8 on n-h2-846463-3 Sep 23 05:39:00.297487 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-f09ec1c2-984b-4200-ab6f-a1d91551c5e9 req-5e838132-f8e4-4c1e-a6e4-84abe19b254d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036284 Sep 23 05:39:00.298148 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3706/7592] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:39:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:39:00.920603 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-58819bf0-1c77-43bf-a109-496628cd44c4 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:39:00.921362 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-58819bf0-1c77-43bf-a109-496628cd44c4 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] [instance: 312aa3a9-f50a-4112-9b74-2b5ec21cb5c8] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:39:00.928035 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-58819bf0-1c77-43bf-a109-496628cd44c4 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:39:00.928537 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-58819bf0-1c77-43bf-a109-496628cd44c4 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:39:00.928987 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-58819bf0-1c77-43bf-a109-496628cd44c4 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:39:00.929692 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-58819bf0-1c77-43bf-a109-496628cd44c4 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:39:00.930201 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-58819bf0-1c77-43bf-a109-496628cd44c4 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:39:00.930638 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-58819bf0-1c77-43bf-a109-496628cd44c4 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:39:01.064175 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-58819bf0-1c77-43bf-a109-496628cd44c4 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2120ec508557410abc1d13fe13355078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5117afeb2bef4c278a568b425d109a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:39:01.072601 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-58819bf0-1c77-43bf-a109-496628cd44c4 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] 10.222.0.33 "GET /compute/v2.1/servers/312aa3a9-f50a-4112-9b74-2b5ec21cb5c8" status: 200 len: 1363 microversion: 2.1 time: 0.156391 Sep 23 05:39:01.073182 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3887/7593] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:39:00 2022] GET /compute/v2.1/servers/312aa3a9-f50a-4112-9b74-2b5ec21cb5c8 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:39:02.102223 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-14f78c9e-1d4e-4ae4-906c-b4f4bfc4d757 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:39:02.102865 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-14f78c9e-1d4e-4ae4-906c-b4f4bfc4d757 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] [instance: 312aa3a9-f50a-4112-9b74-2b5ec21cb5c8] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:39:02.109124 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-14f78c9e-1d4e-4ae4-906c-b4f4bfc4d757 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:39:02.109634 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-14f78c9e-1d4e-4ae4-906c-b4f4bfc4d757 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:39:02.110122 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-14f78c9e-1d4e-4ae4-906c-b4f4bfc4d757 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:39:02.110844 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-14f78c9e-1d4e-4ae4-906c-b4f4bfc4d757 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:39:02.111335 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-14f78c9e-1d4e-4ae4-906c-b4f4bfc4d757 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:39:02.111776 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-14f78c9e-1d4e-4ae4-906c-b4f4bfc4d757 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:39:02.238831 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-14f78c9e-1d4e-4ae4-906c-b4f4bfc4d757 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2120ec508557410abc1d13fe13355078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5117afeb2bef4c278a568b425d109a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:39:02.247057 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-14f78c9e-1d4e-4ae4-906c-b4f4bfc4d757 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] 10.222.0.33 "GET /compute/v2.1/servers/312aa3a9-f50a-4112-9b74-2b5ec21cb5c8" status: 200 len: 1363 microversion: 2.1 time: 0.150081 Sep 23 05:39:02.247637 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3707/7594] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:39:02 2022] GET /compute/v2.1/servers/312aa3a9-f50a-4112-9b74-2b5ec21cb5c8 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:39:03.271036 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3ab1e8a8-4bc6-491f-9089-6c6941249678 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:39:03.271646 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-3ab1e8a8-4bc6-491f-9089-6c6941249678 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] [instance: 312aa3a9-f50a-4112-9b74-2b5ec21cb5c8] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:39:03.279060 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3ab1e8a8-4bc6-491f-9089-6c6941249678 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:39:03.279574 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3ab1e8a8-4bc6-491f-9089-6c6941249678 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:39:03.280026 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3ab1e8a8-4bc6-491f-9089-6c6941249678 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:39:03.280775 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3ab1e8a8-4bc6-491f-9089-6c6941249678 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:39:03.281244 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3ab1e8a8-4bc6-491f-9089-6c6941249678 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:39:03.281679 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3ab1e8a8-4bc6-491f-9089-6c6941249678 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:39:03.411492 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-3ab1e8a8-4bc6-491f-9089-6c6941249678 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2120ec508557410abc1d13fe13355078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5117afeb2bef4c278a568b425d109a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:39:03.419589 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3ab1e8a8-4bc6-491f-9089-6c6941249678 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] 10.222.0.33 "GET /compute/v2.1/servers/312aa3a9-f50a-4112-9b74-2b5ec21cb5c8" status: 200 len: 1363 microversion: 2.1 time: 0.152511 Sep 23 05:39:03.420182 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3888/7595] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:39:03 2022] GET /compute/v2.1/servers/312aa3a9-f50a-4112-9b74-2b5ec21cb5c8 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:39:04.442396 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9b594ab2-5ea0-4ddc-860c-740d60c2f34f tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:39:04.442960 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-9b594ab2-5ea0-4ddc-860c-740d60c2f34f tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] [instance: 312aa3a9-f50a-4112-9b74-2b5ec21cb5c8] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:39:04.450398 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9b594ab2-5ea0-4ddc-860c-740d60c2f34f tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:39:04.450955 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9b594ab2-5ea0-4ddc-860c-740d60c2f34f tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:39:04.451413 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9b594ab2-5ea0-4ddc-860c-740d60c2f34f tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:39:04.452129 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9b594ab2-5ea0-4ddc-860c-740d60c2f34f tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:39:04.452876 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9b594ab2-5ea0-4ddc-860c-740d60c2f34f tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:39:04.453327 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9b594ab2-5ea0-4ddc-860c-740d60c2f34f tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:39:04.586790 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-9b594ab2-5ea0-4ddc-860c-740d60c2f34f tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2120ec508557410abc1d13fe13355078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5117afeb2bef4c278a568b425d109a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:39:04.595113 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9b594ab2-5ea0-4ddc-860c-740d60c2f34f tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] 10.222.0.33 "GET /compute/v2.1/servers/312aa3a9-f50a-4112-9b74-2b5ec21cb5c8" status: 200 len: 1363 microversion: 2.1 time: 0.156846 Sep 23 05:39:04.595690 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3708/7596] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:39:04 2022] GET /compute/v2.1/servers/312aa3a9-f50a-4112-9b74-2b5ec21cb5c8 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:39:05.468582 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-0608005d-f29b-4935-bb81-ab008d1df89e req-81cedcca-d5dd-40e0-8e98-776309c4ed01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "312aa3a9-f50a-4112-9b74-2b5ec21cb5c8", "name": "network-vif-plugged", "status": "completed", "tag": "af3f5c6b-3eba-4ad8-ac47-2a3814aceb5a"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:39:05.478147 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-0608005d-f29b-4935-bb81-ab008d1df89e req-81cedcca-d5dd-40e0-8e98-776309c4ed01 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:39:05.479136 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-0608005d-f29b-4935-bb81-ab008d1df89e req-81cedcca-d5dd-40e0-8e98-776309c4ed01 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:39:05.479575 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-0608005d-f29b-4935-bb81-ab008d1df89e req-81cedcca-d5dd-40e0-8e98-776309c4ed01 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:39:05.490456 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-0608005d-f29b-4935-bb81-ab008d1df89e req-81cedcca-d5dd-40e0-8e98-776309c4ed01 service nova] Creating event network-vif-plugged:af3f5c6b-3eba-4ad8-ac47-2a3814aceb5a for instance 312aa3a9-f50a-4112-9b74-2b5ec21cb5c8 on n-h2-846463-3 Sep 23 05:39:05.496159 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-0608005d-f29b-4935-bb81-ab008d1df89e req-81cedcca-d5dd-40e0-8e98-776309c4ed01 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031573 Sep 23 05:39:05.496740 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3889/7597] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:39:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:39:05.619937 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d8c985d0-2ac0-4be5-ae9f-09702ee0502f tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:39:05.621148 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d8c985d0-2ac0-4be5-ae9f-09702ee0502f tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] [instance: 312aa3a9-f50a-4112-9b74-2b5ec21cb5c8] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:39:05.628155 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d8c985d0-2ac0-4be5-ae9f-09702ee0502f tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:39:05.628662 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d8c985d0-2ac0-4be5-ae9f-09702ee0502f tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:39:05.629118 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d8c985d0-2ac0-4be5-ae9f-09702ee0502f tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:39:05.629831 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d8c985d0-2ac0-4be5-ae9f-09702ee0502f tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:39:05.630450 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d8c985d0-2ac0-4be5-ae9f-09702ee0502f tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:39:05.630808 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d8c985d0-2ac0-4be5-ae9f-09702ee0502f tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:39:05.759990 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d8c985d0-2ac0-4be5-ae9f-09702ee0502f tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2120ec508557410abc1d13fe13355078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5117afeb2bef4c278a568b425d109a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:39:05.768405 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d8c985d0-2ac0-4be5-ae9f-09702ee0502f tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] 10.222.0.33 "GET /compute/v2.1/servers/312aa3a9-f50a-4112-9b74-2b5ec21cb5c8" status: 200 len: 1363 microversion: 2.1 time: 0.153230 Sep 23 05:39:05.774979 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3709/7598] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:39:05 2022] GET /compute/v2.1/servers/312aa3a9-f50a-4112-9b74-2b5ec21cb5c8 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:39:06.792931 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6decea26-9300-4110-8146-c3ac2381b00a tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:39:06.794178 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-6decea26-9300-4110-8146-c3ac2381b00a tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] [instance: 312aa3a9-f50a-4112-9b74-2b5ec21cb5c8] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:39:06.797278 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:39:06.798116 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=6 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:39:06.804255 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6decea26-9300-4110-8146-c3ac2381b00a tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:39:06.804750 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6decea26-9300-4110-8146-c3ac2381b00a tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:39:06.805194 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6decea26-9300-4110-8146-c3ac2381b00a tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:39:06.805932 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6decea26-9300-4110-8146-c3ac2381b00a tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:39:06.806403 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6decea26-9300-4110-8146-c3ac2381b00a tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:39:06.807328 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6decea26-9300-4110-8146-c3ac2381b00a tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:39:06.948416 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-6decea26-9300-4110-8146-c3ac2381b00a tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2120ec508557410abc1d13fe13355078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5117afeb2bef4c278a568b425d109a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:39:06.957935 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6decea26-9300-4110-8146-c3ac2381b00a tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] 10.222.0.33 "GET /compute/v2.1/servers/312aa3a9-f50a-4112-9b74-2b5ec21cb5c8" status: 200 len: 1363 microversion: 2.1 time: 0.169045 Sep 23 05:39:06.958632 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3890/7599] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:39:06 2022] GET /compute/v2.1/servers/312aa3a9-f50a-4112-9b74-2b5ec21cb5c8 => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:39:07.982221 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9e2adf4b-5064-44ed-9e3c-6242583869d5 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:39:07.982861 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-9e2adf4b-5064-44ed-9e3c-6242583869d5 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] [instance: 312aa3a9-f50a-4112-9b74-2b5ec21cb5c8] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:39:07.985244 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=6 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:39:07.991497 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9e2adf4b-5064-44ed-9e3c-6242583869d5 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:39:07.991998 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9e2adf4b-5064-44ed-9e3c-6242583869d5 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:39:07.993991 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9e2adf4b-5064-44ed-9e3c-6242583869d5 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:39:07.993991 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9e2adf4b-5064-44ed-9e3c-6242583869d5 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:39:07.993991 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9e2adf4b-5064-44ed-9e3c-6242583869d5 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:39:07.995028 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9e2adf4b-5064-44ed-9e3c-6242583869d5 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:39:08.127668 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-9e2adf4b-5064-44ed-9e3c-6242583869d5 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2120ec508557410abc1d13fe13355078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5117afeb2bef4c278a568b425d109a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:39:08.136608 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9e2adf4b-5064-44ed-9e3c-6242583869d5 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] 10.222.0.33 "GET /compute/v2.1/servers/312aa3a9-f50a-4112-9b74-2b5ec21cb5c8" status: 200 len: 1554 microversion: 2.1 time: 0.158376 Sep 23 05:39:08.142551 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3710/7600] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:39:07 2022] GET /compute/v2.1/servers/312aa3a9-f50a-4112-9b74-2b5ec21cb5c8 => generated 1554 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:39:08.158828 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-39a2e412-3276-41d1-9aa0-8b95f82e5553 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:39:08.159452 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-39a2e412-3276-41d1-9aa0-8b95f82e5553 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] [instance: 312aa3a9-f50a-4112-9b74-2b5ec21cb5c8] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:39:08.165954 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-39a2e412-3276-41d1-9aa0-8b95f82e5553 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:39:08.166455 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-39a2e412-3276-41d1-9aa0-8b95f82e5553 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:39:08.166901 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-39a2e412-3276-41d1-9aa0-8b95f82e5553 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:39:08.167599 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-39a2e412-3276-41d1-9aa0-8b95f82e5553 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:39:08.168065 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-39a2e412-3276-41d1-9aa0-8b95f82e5553 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:39:08.168497 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-39a2e412-3276-41d1-9aa0-8b95f82e5553 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:39:08.301166 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-39a2e412-3276-41d1-9aa0-8b95f82e5553 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2120ec508557410abc1d13fe13355078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5117afeb2bef4c278a568b425d109a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:39:08.310797 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-39a2e412-3276-41d1-9aa0-8b95f82e5553 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] 10.222.0.33 "GET /compute/v2.1/servers/312aa3a9-f50a-4112-9b74-2b5ec21cb5c8" status: 200 len: 1554 microversion: 2.1 time: 0.155754 Sep 23 05:39:08.315521 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3891/7601] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:39:08 2022] GET /compute/v2.1/servers/312aa3a9-f50a-4112-9b74-2b5ec21cb5c8 => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:39:11.417939 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-bc00ae42-c0cb-45b9-8444-b78a39c65092 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "afe64e2c-3df4-44ee-a000-5a453cabc631"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:39:11.420450 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-bc00ae42-c0cb-45b9-8444-b78a39c65092 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] [instance: 312aa3a9-f50a-4112-9b74-2b5ec21cb5c8] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:39:11.427311 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bc00ae42-c0cb-45b9-8444-b78a39c65092 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:39:11.427847 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bc00ae42-c0cb-45b9-8444-b78a39c65092 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:39:11.428306 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bc00ae42-c0cb-45b9-8444-b78a39c65092 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:39:11.429019 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bc00ae42-c0cb-45b9-8444-b78a39c65092 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:39:11.429495 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bc00ae42-c0cb-45b9-8444-b78a39c65092 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:39:11.429963 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bc00ae42-c0cb-45b9-8444-b78a39c65092 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:39:12.051674 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-bc00ae42-c0cb-45b9-8444-b78a39c65092 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] 10.222.0.33 "POST /compute/v2.1/servers/312aa3a9-f50a-4112-9b74-2b5ec21cb5c8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.637794 Sep 23 05:39:12.052225 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3711/7602] 10.222.0.33 () {60 vars in 1323 bytes} [Fri Sep 23 05:39:11 2022] POST /compute/v2.1/servers/312aa3a9-f50a-4112-9b74-2b5ec21cb5c8/os-volume_attachments => generated 194 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:39:23.818166 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1b8aee8f-5c9b-4594-99dd-01d5a36c97d2 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:39:23.818659 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1b8aee8f-5c9b-4594-99dd-01d5a36c97d2 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] [instance: 312aa3a9-f50a-4112-9b74-2b5ec21cb5c8] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:39:23.821147 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:39:23.821839 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=40 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:39:23.827676 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1b8aee8f-5c9b-4594-99dd-01d5a36c97d2 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:39:23.830968 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1b8aee8f-5c9b-4594-99dd-01d5a36c97d2 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:39:23.830968 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1b8aee8f-5c9b-4594-99dd-01d5a36c97d2 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:39:23.830968 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1b8aee8f-5c9b-4594-99dd-01d5a36c97d2 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:39:23.830968 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1b8aee8f-5c9b-4594-99dd-01d5a36c97d2 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:39:23.830968 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1b8aee8f-5c9b-4594-99dd-01d5a36c97d2 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:39:23.960640 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-1b8aee8f-5c9b-4594-99dd-01d5a36c97d2 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lazy-loading 'services' on Instance uuid 312aa3a9-f50a-4112-9b74-2b5ec21cb5c8 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 05:39:24.145596 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1b8aee8f-5c9b-4594-99dd-01d5a36c97d2 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] 10.222.0.33 "DELETE /compute/v2.1/servers/312aa3a9-f50a-4112-9b74-2b5ec21cb5c8/os-volume_attachments/afe64e2c-3df4-44ee-a000-5a453cabc631" status: 202 len: 0 microversion: 2.1 time: 0.331242 Sep 23 05:39:24.146307 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3892/7603] 10.222.0.33 () {58 vars in 1416 bytes} [Fri Sep 23 05:39:23 2022] DELETE /compute/v2.1/servers/312aa3a9-f50a-4112-9b74-2b5ec21cb5c8/os-volume_attachments/afe64e2c-3df4-44ee-a000-5a453cabc631 => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 05:39:24.155999 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4a870271-778e-4b41-9c01-69ad74eb2a17 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:39:24.158426 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4a870271-778e-4b41-9c01-69ad74eb2a17 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] [instance: 312aa3a9-f50a-4112-9b74-2b5ec21cb5c8] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:39:24.161473 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:39:24.162761 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:39:24.171583 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4a870271-778e-4b41-9c01-69ad74eb2a17 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:39:24.172090 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4a870271-778e-4b41-9c01-69ad74eb2a17 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:39:24.172588 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4a870271-778e-4b41-9c01-69ad74eb2a17 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:39:24.173285 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4a870271-778e-4b41-9c01-69ad74eb2a17 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:39:24.173759 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4a870271-778e-4b41-9c01-69ad74eb2a17 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:39:24.174228 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4a870271-778e-4b41-9c01-69ad74eb2a17 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:39:24.203733 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4a870271-778e-4b41-9c01-69ad74eb2a17 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] 10.222.0.33 "GET /compute/v2.1/servers/312aa3a9-f50a-4112-9b74-2b5ec21cb5c8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052230 Sep 23 05:39:24.204246 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3712/7604] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Sep 23 05:39:24 2022] GET /compute/v2.1/servers/312aa3a9-f50a-4112-9b74-2b5ec21cb5c8/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:39:25.218382 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-42134857-46d9-4a12-b725-46828a180d6b tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:39:25.220779 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-42134857-46d9-4a12-b725-46828a180d6b tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] [instance: 312aa3a9-f50a-4112-9b74-2b5ec21cb5c8] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:39:25.227228 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-42134857-46d9-4a12-b725-46828a180d6b tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:39:25.227712 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-42134857-46d9-4a12-b725-46828a180d6b tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:39:25.228180 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-42134857-46d9-4a12-b725-46828a180d6b tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:39:25.229407 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-42134857-46d9-4a12-b725-46828a180d6b tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:39:25.229943 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-42134857-46d9-4a12-b725-46828a180d6b tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:39:25.230392 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-42134857-46d9-4a12-b725-46828a180d6b tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:39:25.260936 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-42134857-46d9-4a12-b725-46828a180d6b tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] 10.222.0.33 "GET /compute/v2.1/servers/312aa3a9-f50a-4112-9b74-2b5ec21cb5c8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048238 Sep 23 05:39:25.261530 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3893/7605] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Sep 23 05:39:25 2022] GET /compute/v2.1/servers/312aa3a9-f50a-4112-9b74-2b5ec21cb5c8/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:39:26.274321 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-db4173b7-bcc0-4a9f-8bd7-417bc9081633 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:39:26.276699 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-db4173b7-bcc0-4a9f-8bd7-417bc9081633 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] [instance: 312aa3a9-f50a-4112-9b74-2b5ec21cb5c8] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:39:26.284923 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-db4173b7-bcc0-4a9f-8bd7-417bc9081633 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:39:26.285439 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-db4173b7-bcc0-4a9f-8bd7-417bc9081633 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:39:26.285912 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-db4173b7-bcc0-4a9f-8bd7-417bc9081633 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:39:26.286654 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-db4173b7-bcc0-4a9f-8bd7-417bc9081633 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:39:26.287138 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-db4173b7-bcc0-4a9f-8bd7-417bc9081633 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:39:26.287607 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-db4173b7-bcc0-4a9f-8bd7-417bc9081633 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:39:26.320412 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-db4173b7-bcc0-4a9f-8bd7-417bc9081633 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] 10.222.0.33 "GET /compute/v2.1/servers/312aa3a9-f50a-4112-9b74-2b5ec21cb5c8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050810 Sep 23 05:39:26.321088 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3713/7606] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Sep 23 05:39:26 2022] GET /compute/v2.1/servers/312aa3a9-f50a-4112-9b74-2b5ec21cb5c8/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:39:27.333805 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ecd32114-91d8-4723-902c-6744afdf7266 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:39:27.336028 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ecd32114-91d8-4723-902c-6744afdf7266 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] [instance: 312aa3a9-f50a-4112-9b74-2b5ec21cb5c8] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:39:27.343085 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ecd32114-91d8-4723-902c-6744afdf7266 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:39:27.343578 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ecd32114-91d8-4723-902c-6744afdf7266 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:39:27.344025 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ecd32114-91d8-4723-902c-6744afdf7266 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:39:27.344730 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ecd32114-91d8-4723-902c-6744afdf7266 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:39:27.345190 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ecd32114-91d8-4723-902c-6744afdf7266 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:39:27.345623 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ecd32114-91d8-4723-902c-6744afdf7266 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:39:27.375260 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ecd32114-91d8-4723-902c-6744afdf7266 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] 10.222.0.33 "GET /compute/v2.1/servers/312aa3a9-f50a-4112-9b74-2b5ec21cb5c8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045422 Sep 23 05:39:27.375832 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3894/7607] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Sep 23 05:39:27 2022] GET /compute/v2.1/servers/312aa3a9-f50a-4112-9b74-2b5ec21cb5c8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:39:28.388201 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7019c826-2ae2-41fa-a55f-c8ae6e92e7a0 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:39:28.390773 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7019c826-2ae2-41fa-a55f-c8ae6e92e7a0 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] [instance: 312aa3a9-f50a-4112-9b74-2b5ec21cb5c8] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:39:28.398276 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7019c826-2ae2-41fa-a55f-c8ae6e92e7a0 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:39:28.398818 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7019c826-2ae2-41fa-a55f-c8ae6e92e7a0 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:39:28.399278 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7019c826-2ae2-41fa-a55f-c8ae6e92e7a0 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:39:28.399995 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7019c826-2ae2-41fa-a55f-c8ae6e92e7a0 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:39:28.400473 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7019c826-2ae2-41fa-a55f-c8ae6e92e7a0 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:39:28.400918 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7019c826-2ae2-41fa-a55f-c8ae6e92e7a0 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:39:28.430057 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7019c826-2ae2-41fa-a55f-c8ae6e92e7a0 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] 10.222.0.33 "GET /compute/v2.1/servers/312aa3a9-f50a-4112-9b74-2b5ec21cb5c8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046864 Sep 23 05:39:28.430850 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3714/7608] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Sep 23 05:39:28 2022] GET /compute/v2.1/servers/312aa3a9-f50a-4112-9b74-2b5ec21cb5c8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 05:39:29.442512 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-554e18fe-ab4b-40ce-a5f6-eeff30e5f059 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:39:29.444738 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-554e18fe-ab4b-40ce-a5f6-eeff30e5f059 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] [instance: 312aa3a9-f50a-4112-9b74-2b5ec21cb5c8] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:39:29.451717 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-554e18fe-ab4b-40ce-a5f6-eeff30e5f059 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:39:29.452206 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-554e18fe-ab4b-40ce-a5f6-eeff30e5f059 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:39:29.452643 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-554e18fe-ab4b-40ce-a5f6-eeff30e5f059 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:39:29.453334 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-554e18fe-ab4b-40ce-a5f6-eeff30e5f059 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:39:29.453789 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-554e18fe-ab4b-40ce-a5f6-eeff30e5f059 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:39:29.454244 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-554e18fe-ab4b-40ce-a5f6-eeff30e5f059 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:39:29.483833 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-554e18fe-ab4b-40ce-a5f6-eeff30e5f059 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] 10.222.0.33 "GET /compute/v2.1/servers/312aa3a9-f50a-4112-9b74-2b5ec21cb5c8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045455 Sep 23 05:39:29.484387 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3895/7609] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Sep 23 05:39:29 2022] GET /compute/v2.1/servers/312aa3a9-f50a-4112-9b74-2b5ec21cb5c8/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 05:39:29.495185 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-781deca3-ea8f-44e7-b115-9129939d35fe tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:39:29.495713 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-781deca3-ea8f-44e7-b115-9129939d35fe tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] [instance: 312aa3a9-f50a-4112-9b74-2b5ec21cb5c8] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:39:29.502556 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-781deca3-ea8f-44e7-b115-9129939d35fe tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:39:29.504208 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-781deca3-ea8f-44e7-b115-9129939d35fe tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:39:29.504208 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-781deca3-ea8f-44e7-b115-9129939d35fe tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:39:29.504208 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-781deca3-ea8f-44e7-b115-9129939d35fe tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:39:29.504669 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-781deca3-ea8f-44e7-b115-9129939d35fe tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:39:29.505098 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-781deca3-ea8f-44e7-b115-9129939d35fe tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:39:29.626735 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-781deca3-ea8f-44e7-b115-9129939d35fe tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] HTTP exception thrown: Instance 312aa3a9-f50a-4112-9b74-2b5ec21cb5c8 is not attached to volume afe64e2c-3df4-44ee-a000-5a453cabc631 Sep 23 05:39:29.632622 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-781deca3-ea8f-44e7-b115-9129939d35fe tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Request method failure captured: Sep 23 05:39:29.632622 n-d-846463-3 devstack@n-api.service[122698]: request: DELETE /compute/v2.1/servers/312aa3a9-f50a-4112-9b74-2b5ec21cb5c8/os-volume_attachments/afe64e2c-3df4-44ee-a000-5a453cabc631 HTTP/1.1 Sep 23 05:39:29.632622 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 05:39:29.632622 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 05:39:29.632622 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 05:39:29.632622 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 05:39:29.632622 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 05:39:29.632622 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 05:39:29.632622 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 05:39:29.632622 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 05:39:29.632622 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLUZoO0Zlb5wEJzyWQv_kCFraY7Qaq6MtQjlJhob3FIRPW0M1hjfpK8nHBgkkiisPzLeyiv8DHEeemI6clu4FlfbhG2IPIsyeNdOh80moVQQ5UK7Fa9PsdJsLADEz6AyJokgAYAwFBXENS6OGfLgnoyFcibM-eV_t2QU5NAXt2aq8tSk Sep 23 05:39:29.632622 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 05:39:29.632622 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 05:39:29.632622 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 05:39:29.632622 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 05:39:29.632622 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 05:39:29.632622 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 05:39:29.632622 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 5117afeb2bef4c278a568b425d109a6a Sep 23 05:39:29.632622 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-TestEncryptedCinderVolumes-2079194995 Sep 23 05:39:29.632622 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 05:39:29.632622 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 05:39:29.632622 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5117afeb2bef4c278a568b425d109a6a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5117afeb2bef4c278a568b425d109a6a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5117afeb2bef4c278a568b425d109a6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5117afeb2bef4c278a568b425d109a6a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:39:29.632622 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-TestEncryptedCinderVolumes-2079194995 Sep 23 05:39:29.632622 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 5117afeb2bef4c278a568b425d109a6a Sep 23 05:39:29.632622 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-2079194995 Sep 23 05:39:29.632622 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-TestEncryptedCinderVolumes-2079194995-project Sep 23 05:39:29.632622 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 05:39:29.632622 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 05:39:29.632622 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 2120ec508557410abc1d13fe13355078 Sep 23 05:39:29.632622 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-TestEncryptedCinderVolumes-2079194995-project Sep 23 05:39:29.632622 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 05:39:29.632622 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 312aa3a9-f50a-4112-9b74-2b5ec21cb5c8 is not attached to volume afe64e2c-3df4-44ee-a000-5a453cabc631 Sep 23 05:39:29.632622 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'server_id': '312aa3a9-f50a-4112-9b74-2b5ec21cb5c8', 'id': 'afe64e2c-3df4-44ee-a000-5a453cabc631'} Sep 23 05:39:29.632622 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:39:29.632622 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:39:29.632622 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 23 05:39:29.632622 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 23 05:39:29.632622 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 05:39:29.632622 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 05:39:29.632622 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 23 05:39:29.632622 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 23 05:39:29.632622 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id afe64e2c-3df4-44ee-a000-5a453cabc631. Sep 23 05:39:29.632622 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:39:29.632622 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:39:29.632622 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:39:29.632622 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:39:29.632622 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:39:29.632622 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:39:29.632622 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:39:29.632622 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:39:29.632622 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:39:29.632622 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:39:29.632622 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 23 05:39:29.632622 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 23 05:39:29.632622 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 312aa3a9-f50a-4112-9b74-2b5ec21cb5c8 is not attached to volume afe64e2c-3df4-44ee-a000-5a453cabc631 Sep 23 05:39:29.632622 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:39:29.632622 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:39:29.632622 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:39:29.632622 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:39:29.632622 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:39:29.632622 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:39:29.638347 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:39:29.638347 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:39:29.638347 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 312aa3a9-f50a-4112-9b74-2b5ec21cb5c8 is not attached to volume afe64e2c-3df4-44ee-a000-5a453cabc631 Sep 23 05:39:29.638347 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:39:29.638347 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-781deca3-ea8f-44e7-b115-9129939d35fe tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Returning 404 to user: Instance 312aa3a9-f50a-4112-9b74-2b5ec21cb5c8 is not attached to volume afe64e2c-3df4-44ee-a000-5a453cabc631 {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:39:29.638347 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-781deca3-ea8f-44e7-b115-9129939d35fe tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] 10.222.0.33 "DELETE /compute/v2.1/servers/312aa3a9-f50a-4112-9b74-2b5ec21cb5c8/os-volume_attachments/afe64e2c-3df4-44ee-a000-5a453cabc631" status: 404 len: 154 microversion: 2.1 time: 0.142996 Sep 23 05:39:29.638347 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3715/7610] 10.222.0.33 () {58 vars in 1416 bytes} [Fri Sep 23 05:39:29 2022] DELETE /compute/v2.1/servers/312aa3a9-f50a-4112-9b74-2b5ec21cb5c8/os-volume_attachments/afe64e2c-3df4-44ee-a000-5a453cabc631 => generated 154 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 05:39:33.169217 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d41c2d33-c38e-43e3-9d14-da13cd0a546b tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:39:33.171309 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d41c2d33-c38e-43e3-9d14-da13cd0a546b tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] [instance: 312aa3a9-f50a-4112-9b74-2b5ec21cb5c8] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:39:33.176436 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d41c2d33-c38e-43e3-9d14-da13cd0a546b tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:39:33.176911 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d41c2d33-c38e-43e3-9d14-da13cd0a546b tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:39:33.177359 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d41c2d33-c38e-43e3-9d14-da13cd0a546b tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:39:33.178089 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d41c2d33-c38e-43e3-9d14-da13cd0a546b tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:39:33.178552 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d41c2d33-c38e-43e3-9d14-da13cd0a546b tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:39:33.178981 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d41c2d33-c38e-43e3-9d14-da13cd0a546b tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:39:33.204854 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d41c2d33-c38e-43e3-9d14-da13cd0a546b tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] [instance: 312aa3a9-f50a-4112-9b74-2b5ec21cb5c8] Going to try to terminate instance {{(pid=122699) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 05:39:33.429979 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d41c2d33-c38e-43e3-9d14-da13cd0a546b tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] 10.222.0.33 "DELETE /compute/v2.1/servers/312aa3a9-f50a-4112-9b74-2b5ec21cb5c8" status: 204 len: 0 microversion: 2.1 time: 0.264785 Sep 23 05:39:33.430504 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3896/7611] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 05:39:33 2022] DELETE /compute/v2.1/servers/312aa3a9-f50a-4112-9b74-2b5ec21cb5c8 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 05:39:33.439695 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3ac0ebcf-fd73-44ce-9d39-4ecbaa988a52 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:39:33.440324 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3ac0ebcf-fd73-44ce-9d39-4ecbaa988a52 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] [instance: 312aa3a9-f50a-4112-9b74-2b5ec21cb5c8] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:39:33.446850 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3ac0ebcf-fd73-44ce-9d39-4ecbaa988a52 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:39:33.447352 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3ac0ebcf-fd73-44ce-9d39-4ecbaa988a52 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:39:33.447804 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3ac0ebcf-fd73-44ce-9d39-4ecbaa988a52 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:39:33.448502 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3ac0ebcf-fd73-44ce-9d39-4ecbaa988a52 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:39:33.448970 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3ac0ebcf-fd73-44ce-9d39-4ecbaa988a52 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:39:33.449410 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3ac0ebcf-fd73-44ce-9d39-4ecbaa988a52 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:39:33.585465 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-3ac0ebcf-fd73-44ce-9d39-4ecbaa988a52 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2120ec508557410abc1d13fe13355078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5117afeb2bef4c278a568b425d109a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:39:33.594084 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3ac0ebcf-fd73-44ce-9d39-4ecbaa988a52 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] 10.222.0.33 "GET /compute/v2.1/servers/312aa3a9-f50a-4112-9b74-2b5ec21cb5c8" status: 200 len: 1560 microversion: 2.1 time: 0.158370 Sep 23 05:39:33.594664 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3716/7612] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:39:33 2022] GET /compute/v2.1/servers/312aa3a9-f50a-4112-9b74-2b5ec21cb5c8 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:39:34.618432 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f2652b85-b1d5-4ae4-988d-c4ea734e2f69 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:39:34.619139 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f2652b85-b1d5-4ae4-988d-c4ea734e2f69 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] [instance: 312aa3a9-f50a-4112-9b74-2b5ec21cb5c8] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:39:34.625422 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f2652b85-b1d5-4ae4-988d-c4ea734e2f69 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:39:34.625943 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f2652b85-b1d5-4ae4-988d-c4ea734e2f69 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:39:34.626391 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f2652b85-b1d5-4ae4-988d-c4ea734e2f69 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:39:34.627086 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f2652b85-b1d5-4ae4-988d-c4ea734e2f69 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:39:34.627545 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f2652b85-b1d5-4ae4-988d-c4ea734e2f69 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:39:34.627974 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f2652b85-b1d5-4ae4-988d-c4ea734e2f69 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:39:34.758250 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f2652b85-b1d5-4ae4-988d-c4ea734e2f69 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2120ec508557410abc1d13fe13355078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5117afeb2bef4c278a568b425d109a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:39:34.766752 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f2652b85-b1d5-4ae4-988d-c4ea734e2f69 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] 10.222.0.33 "GET /compute/v2.1/servers/312aa3a9-f50a-4112-9b74-2b5ec21cb5c8" status: 200 len: 1560 microversion: 2.1 time: 0.152673 Sep 23 05:39:34.767337 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3897/7613] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:39:34 2022] GET /compute/v2.1/servers/312aa3a9-f50a-4112-9b74-2b5ec21cb5c8 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:39:35.511269 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-fd80d650-4567-4bf2-8fc1-e5fa0030579e req-89b2c587-de76-4664-b2fe-448d758e462d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "312aa3a9-f50a-4112-9b74-2b5ec21cb5c8", "name": "network-vif-deleted", "tag": "af3f5c6b-3eba-4ad8-ac47-2a3814aceb5a"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:39:35.522300 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-fd80d650-4567-4bf2-8fc1-e5fa0030579e req-89b2c587-de76-4664-b2fe-448d758e462d service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:39:35.522803 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-fd80d650-4567-4bf2-8fc1-e5fa0030579e req-89b2c587-de76-4664-b2fe-448d758e462d service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:39:35.523254 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-fd80d650-4567-4bf2-8fc1-e5fa0030579e req-89b2c587-de76-4664-b2fe-448d758e462d service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:39:35.534565 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-fd80d650-4567-4bf2-8fc1-e5fa0030579e req-89b2c587-de76-4664-b2fe-448d758e462d service nova] Creating event network-vif-deleted:af3f5c6b-3eba-4ad8-ac47-2a3814aceb5a for instance 312aa3a9-f50a-4112-9b74-2b5ec21cb5c8 on n-h2-846463-3 Sep 23 05:39:35.540011 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-fd80d650-4567-4bf2-8fc1-e5fa0030579e req-89b2c587-de76-4664-b2fe-448d758e462d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032791 Sep 23 05:39:35.541101 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3717/7614] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:39:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:39:35.791585 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-918748cd-2db3-4b05-bee1-e1e171d1584a tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:39:35.792217 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-918748cd-2db3-4b05-bee1-e1e171d1584a tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] [instance: 312aa3a9-f50a-4112-9b74-2b5ec21cb5c8] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:39:35.800062 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-918748cd-2db3-4b05-bee1-e1e171d1584a tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:39:35.800560 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-918748cd-2db3-4b05-bee1-e1e171d1584a tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:39:35.801014 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-918748cd-2db3-4b05-bee1-e1e171d1584a tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:39:35.801741 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-918748cd-2db3-4b05-bee1-e1e171d1584a tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:39:35.802243 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-918748cd-2db3-4b05-bee1-e1e171d1584a tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:39:35.807055 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-918748cd-2db3-4b05-bee1-e1e171d1584a tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:39:35.835553 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-918748cd-2db3-4b05-bee1-e1e171d1584a tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:39:35.836154 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-918748cd-2db3-4b05-bee1-e1e171d1584a tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:39:35.836604 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-918748cd-2db3-4b05-bee1-e1e171d1584a tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:39:35.837071 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-918748cd-2db3-4b05-bee1-e1e171d1584a tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lazy-loading 'fault' on Instance uuid 312aa3a9-f50a-4112-9b74-2b5ec21cb5c8 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 05:39:35.883297 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-918748cd-2db3-4b05-bee1-e1e171d1584a tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2120ec508557410abc1d13fe13355078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5117afeb2bef4c278a568b425d109a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:39:35.893010 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-918748cd-2db3-4b05-bee1-e1e171d1584a tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] 10.222.0.33 "GET /compute/v2.1/servers/312aa3a9-f50a-4112-9b74-2b5ec21cb5c8" status: 200 len: 1353 microversion: 2.1 time: 0.106048 Sep 23 05:39:35.898016 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3898/7615] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:39:35 2022] GET /compute/v2.1/servers/312aa3a9-f50a-4112-9b74-2b5ec21cb5c8 => generated 1353 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:39:36.920814 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-31ef575f-1567-42d4-82b4-dfacea0e6cea tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:39:36.921527 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-31ef575f-1567-42d4-82b4-dfacea0e6cea tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] [instance: 312aa3a9-f50a-4112-9b74-2b5ec21cb5c8] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:39:36.927790 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-31ef575f-1567-42d4-82b4-dfacea0e6cea tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:39:36.928292 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-31ef575f-1567-42d4-82b4-dfacea0e6cea tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:39:36.928744 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-31ef575f-1567-42d4-82b4-dfacea0e6cea tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:39:36.929450 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-31ef575f-1567-42d4-82b4-dfacea0e6cea tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:39:36.929931 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-31ef575f-1567-42d4-82b4-dfacea0e6cea tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:39:36.930375 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-31ef575f-1567-42d4-82b4-dfacea0e6cea tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:39:36.944407 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-31ef575f-1567-42d4-82b4-dfacea0e6cea tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] HTTP exception thrown: Instance 312aa3a9-f50a-4112-9b74-2b5ec21cb5c8 could not be found. Sep 23 05:39:36.946107 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-31ef575f-1567-42d4-82b4-dfacea0e6cea tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Request method failure captured: Sep 23 05:39:36.946107 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/312aa3a9-f50a-4112-9b74-2b5ec21cb5c8 HTTP/1.1 Sep 23 05:39:36.946107 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 05:39:36.946107 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 05:39:36.946107 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 05:39:36.946107 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 05:39:36.946107 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 05:39:36.946107 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 05:39:36.946107 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 05:39:36.946107 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 05:39:36.946107 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLUZoO0Zlb5wEJzyWQv_kCFraY7Qaq6MtQjlJhob3FIRPW0M1hjfpK8nHBgkkiisPzLeyiv8DHEeemI6clu4FlfbhG2IPIsyeNdOh80moVQQ5UK7Fa9PsdJsLADEz6AyJokgAYAwFBXENS6OGfLgnoyFcibM-eV_t2QU5NAXt2aq8tSk Sep 23 05:39:36.946107 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 05:39:36.946107 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 05:39:36.946107 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 05:39:36.946107 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 05:39:36.946107 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 05:39:36.946107 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 05:39:36.946107 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 5117afeb2bef4c278a568b425d109a6a Sep 23 05:39:36.946107 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-TestEncryptedCinderVolumes-2079194995 Sep 23 05:39:36.946107 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 05:39:36.946107 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 05:39:36.946107 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5117afeb2bef4c278a568b425d109a6a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5117afeb2bef4c278a568b425d109a6a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5117afeb2bef4c278a568b425d109a6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5117afeb2bef4c278a568b425d109a6a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:39:36.946107 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-TestEncryptedCinderVolumes-2079194995 Sep 23 05:39:36.946107 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 5117afeb2bef4c278a568b425d109a6a Sep 23 05:39:36.946107 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-2079194995 Sep 23 05:39:36.946107 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-TestEncryptedCinderVolumes-2079194995-project Sep 23 05:39:36.946107 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 05:39:36.946107 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 05:39:36.946107 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 2120ec508557410abc1d13fe13355078 Sep 23 05:39:36.946107 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-TestEncryptedCinderVolumes-2079194995-project Sep 23 05:39:36.946107 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 05:39:36.946107 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 312aa3a9-f50a-4112-9b74-2b5ec21cb5c8 could not be found. Sep 23 05:39:36.946107 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '312aa3a9-f50a-4112-9b74-2b5ec21cb5c8'} Sep 23 05:39:36.946107 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:39:36.946107 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:39:36.946107 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 05:39:36.946107 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 05:39:36.946107 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 05:39:36.946107 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 05:39:36.946107 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 05:39:36.946107 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 05:39:36.946107 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 05:39:36.946107 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 05:39:36.946107 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 312aa3a9-f50a-4112-9b74-2b5ec21cb5c8 could not be found. Sep 23 05:39:36.946107 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:39:36.946107 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:39:36.946107 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:39:36.946107 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:39:36.946107 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:39:36.946107 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:39:36.946107 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:39:36.946107 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:39:36.946107 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:39:36.946107 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:39:36.946107 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 05:39:36.946107 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 05:39:36.946107 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 05:39:36.946107 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 05:39:36.946107 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 05:39:36.946107 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:39:36.946107 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 312aa3a9-f50a-4112-9b74-2b5ec21cb5c8 could not be found. Sep 23 05:39:36.946107 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:39:36.946107 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:39:36.951078 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:39:36.951078 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:39:36.951078 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:39:36.951078 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:39:36.951078 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:39:36.951078 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:39:36.951078 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 312aa3a9-f50a-4112-9b74-2b5ec21cb5c8 could not be found. Sep 23 05:39:36.951078 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:39:36.951078 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-31ef575f-1567-42d4-82b4-dfacea0e6cea tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Returning 404 to user: Instance 312aa3a9-f50a-4112-9b74-2b5ec21cb5c8 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:39:36.951078 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-31ef575f-1567-42d4-82b4-dfacea0e6cea tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] 10.222.0.33 "GET /compute/v2.1/servers/312aa3a9-f50a-4112-9b74-2b5ec21cb5c8" status: 404 len: 111 microversion: 2.1 time: 0.032479 Sep 23 05:39:36.951078 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3718/7616] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:39:36 2022] GET /compute/v2.1/servers/312aa3a9-f50a-4112-9b74-2b5ec21cb5c8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 05:39:36.956536 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4e4b1f56-5fc1-4a87-b72e-4a8c56c2ee43 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Calling method '.version_select at 0x7ff1ba8ac8b0>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:39:37.016310 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4e4b1f56-5fc1-4a87-b72e-4a8c56c2ee43 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1368348776" status: 202 len: 0 microversion: 2.1 time: 0.063441 Sep 23 05:39:37.016918 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3899/7617] 10.222.0.33 () {58 vars in 1278 bytes} [Fri Sep 23 05:39:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1368348776 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 05:39:37.034506 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-402d615f-2de2-4441-baef-5573e2672829 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Action: 'create', calling method: .version_select at 0x7ff1ba93f1f0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1827732261", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLHAyPAKWtjhUUuCjv8l0FHKPnbC8e1zkrRXACWJwyw4K4E6DgesO/hybA8wz9e26mH3LaGi1m4YslRHfIaGGMy3yjA1Ao03l5fmJp0Ytg7ciXcoJEMTQGhTAW+PDfXoNA=="}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:39:37.050217 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-402d615f-2de2-4441-baef-5573e2672829 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Getting quotas for project 5117afeb2bef4c278a568b425d109a6a. Resources: {'key_pairs'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 05:39:37.056710 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-402d615f-2de2-4441-baef-5573e2672829 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Getting quotas for user 2120ec508557410abc1d13fe13355078 and project 5117afeb2bef4c278a568b425d109a6a. Resources: {'key_pairs'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 05:39:37.153018 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-402d615f-2de2-4441-baef-5573e2672829 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.122392 Sep 23 05:39:37.153620 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3719/7618] 10.222.0.33 () {60 vars in 1159 bytes} [Fri Sep 23 05:39:37 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:39:37.232209 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ee8e4837-0b71-4f2c-a787-253daf349903 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-607511294", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1827732261", "networks": [{"uuid": "407c633d-2992-4277-81a6-47e9946a6635"}]}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:39:37.285621 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.neutron [None req-ee8e4837-0b71-4f2c-a787-253daf349903 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] validate_networks() for [('407c633d-2992-4277-81a6-47e9946a6635', None, None, None, None, None)] {{(pid=122699) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 05:39:37.973860 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-ee8e4837-0b71-4f2c-a787-253daf349903 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Flavor limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 05:39:37.974470 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-ee8e4837-0b71-4f2c-a787-253daf349903 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Image limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 05:39:37.974905 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-ee8e4837-0b71-4f2c-a787-253daf349903 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Flavor pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 05:39:37.975320 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-ee8e4837-0b71-4f2c-a787-253daf349903 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Image pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 05:39:37.975733 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-ee8e4837-0b71-4f2c-a787-253daf349903 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 05:39:37.984748 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ee8e4837-0b71-4f2c-a787-253daf349903 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:39:37.985279 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ee8e4837-0b71-4f2c-a787-253daf349903 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:39:37.985745 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ee8e4837-0b71-4f2c-a787-253daf349903 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:39:37.986547 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ee8e4837-0b71-4f2c-a787-253daf349903 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:39:37.987004 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ee8e4837-0b71-4f2c-a787-253daf349903 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:39:37.987427 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ee8e4837-0b71-4f2c-a787-253daf349903 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:39:38.005083 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-ee8e4837-0b71-4f2c-a787-253daf349903 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Getting quotas for project 5117afeb2bef4c278a568b425d109a6a. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 05:39:38.010879 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-ee8e4837-0b71-4f2c-a787-253daf349903 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Getting quotas for user 2120ec508557410abc1d13fe13355078 and project 5117afeb2bef4c278a568b425d109a6a. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 05:39:38.023254 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ee8e4837-0b71-4f2c-a787-253daf349903 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Going to run 1 instances... {{(pid=122699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 05:39:38.025605 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ee8e4837-0b71-4f2c-a787-253daf349903 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] [instance: 80a26547-1e67-4db6-a977-7b6b80b6a766] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 05:39:38.136436 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ee8e4837-0b71-4f2c-a787-253daf349903 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.908319 Sep 23 05:39:38.137231 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3900/7619] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 05:39:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 910 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 05:39:38.149511 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-986569ab-52ac-4e46-9a0d-29da6a8d7450 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:39:38.151742 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-986569ab-52ac-4e46-9a0d-29da6a8d7450 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] [instance: 80a26547-1e67-4db6-a977-7b6b80b6a766] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:39:38.212238 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-986569ab-52ac-4e46-9a0d-29da6a8d7450 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2120ec508557410abc1d13fe13355078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5117afeb2bef4c278a568b425d109a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:39:38.219342 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-986569ab-52ac-4e46-9a0d-29da6a8d7450 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] 10.222.0.33 "GET /compute/v2.1/servers/80a26547-1e67-4db6-a977-7b6b80b6a766" status: 200 len: 1262 microversion: 2.1 time: 0.074819 Sep 23 05:39:38.220164 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3720/7620] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:39:38 2022] GET /compute/v2.1/servers/80a26547-1e67-4db6-a977-7b6b80b6a766 => generated 1262 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:39:39.243322 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b73b4cb2-86fd-4c2f-bae1-da5206525ab5 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:39:39.243938 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b73b4cb2-86fd-4c2f-bae1-da5206525ab5 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] [instance: 80a26547-1e67-4db6-a977-7b6b80b6a766] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:39:39.250394 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b73b4cb2-86fd-4c2f-bae1-da5206525ab5 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:39:39.250833 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b73b4cb2-86fd-4c2f-bae1-da5206525ab5 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:39:39.251277 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b73b4cb2-86fd-4c2f-bae1-da5206525ab5 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:39:39.251989 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b73b4cb2-86fd-4c2f-bae1-da5206525ab5 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:39:39.252497 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b73b4cb2-86fd-4c2f-bae1-da5206525ab5 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:39:39.252925 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b73b4cb2-86fd-4c2f-bae1-da5206525ab5 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:39:39.316063 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b73b4cb2-86fd-4c2f-bae1-da5206525ab5 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2120ec508557410abc1d13fe13355078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5117afeb2bef4c278a568b425d109a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:39:39.324962 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b73b4cb2-86fd-4c2f-bae1-da5206525ab5 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] 10.222.0.33 "GET /compute/v2.1/servers/80a26547-1e67-4db6-a977-7b6b80b6a766" status: 200 len: 1266 microversion: 2.1 time: 0.086098 Sep 23 05:39:39.332510 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3901/7621] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:39:39 2022] GET /compute/v2.1/servers/80a26547-1e67-4db6-a977-7b6b80b6a766 => generated 1266 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:39:40.348887 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-73ddcf2e-cab1-46d9-8f66-f41ecba4942e tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:39:40.349659 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-73ddcf2e-cab1-46d9-8f66-f41ecba4942e tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] [instance: 80a26547-1e67-4db6-a977-7b6b80b6a766] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:39:40.361084 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-73ddcf2e-cab1-46d9-8f66-f41ecba4942e tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:39:40.361605 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-73ddcf2e-cab1-46d9-8f66-f41ecba4942e tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:39:40.362120 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-73ddcf2e-cab1-46d9-8f66-f41ecba4942e tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:39:40.363100 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-73ddcf2e-cab1-46d9-8f66-f41ecba4942e tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:39:40.363592 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-73ddcf2e-cab1-46d9-8f66-f41ecba4942e tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:39:40.364049 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-73ddcf2e-cab1-46d9-8f66-f41ecba4942e tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:39:40.430994 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-73ddcf2e-cab1-46d9-8f66-f41ecba4942e tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2120ec508557410abc1d13fe13355078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5117afeb2bef4c278a568b425d109a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:39:40.438851 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-73ddcf2e-cab1-46d9-8f66-f41ecba4942e tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] 10.222.0.33 "GET /compute/v2.1/servers/80a26547-1e67-4db6-a977-7b6b80b6a766" status: 200 len: 1332 microversion: 2.1 time: 0.094114 Sep 23 05:39:40.439436 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3721/7622] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:39:40 2022] GET /compute/v2.1/servers/80a26547-1e67-4db6-a977-7b6b80b6a766 => generated 1332 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:39:41.462022 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b9556ee0-6651-4597-b5de-9bbea939ab86 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:39:41.462665 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b9556ee0-6651-4597-b5de-9bbea939ab86 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] [instance: 80a26547-1e67-4db6-a977-7b6b80b6a766] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:39:41.469096 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b9556ee0-6651-4597-b5de-9bbea939ab86 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:39:41.469588 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b9556ee0-6651-4597-b5de-9bbea939ab86 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:39:41.470125 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b9556ee0-6651-4597-b5de-9bbea939ab86 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:39:41.470819 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b9556ee0-6651-4597-b5de-9bbea939ab86 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:39:41.471280 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b9556ee0-6651-4597-b5de-9bbea939ab86 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:39:41.471709 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b9556ee0-6651-4597-b5de-9bbea939ab86 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:39:41.608126 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b9556ee0-6651-4597-b5de-9bbea939ab86 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2120ec508557410abc1d13fe13355078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5117afeb2bef4c278a568b425d109a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:39:41.616363 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b9556ee0-6651-4597-b5de-9bbea939ab86 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] 10.222.0.33 "GET /compute/v2.1/servers/80a26547-1e67-4db6-a977-7b6b80b6a766" status: 200 len: 1362 microversion: 2.1 time: 0.158606 Sep 23 05:39:41.616970 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3902/7623] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:39:41 2022] GET /compute/v2.1/servers/80a26547-1e67-4db6-a977-7b6b80b6a766 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:39:42.277593 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-b9602679-aa1a-4192-991c-ad8bdd919079 req-6e96f6d6-9ecc-41cd-a395-481045676d64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80a26547-1e67-4db6-a977-7b6b80b6a766", "tag": "24ac9dbe-5ac4-4d87-8b44-defcc36c4043"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:39:42.285904 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-b9602679-aa1a-4192-991c-ad8bdd919079 req-6e96f6d6-9ecc-41cd-a395-481045676d64 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:39:42.286424 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-b9602679-aa1a-4192-991c-ad8bdd919079 req-6e96f6d6-9ecc-41cd-a395-481045676d64 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:39:42.286885 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-b9602679-aa1a-4192-991c-ad8bdd919079 req-6e96f6d6-9ecc-41cd-a395-481045676d64 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:39:42.298972 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-b9602679-aa1a-4192-991c-ad8bdd919079 req-6e96f6d6-9ecc-41cd-a395-481045676d64 service nova] Creating event network-changed:24ac9dbe-5ac4-4d87-8b44-defcc36c4043 for instance 80a26547-1e67-4db6-a977-7b6b80b6a766 on n-h2-846463-3 Sep 23 05:39:42.303896 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-b9602679-aa1a-4192-991c-ad8bdd919079 req-6e96f6d6-9ecc-41cd-a395-481045676d64 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090780 Sep 23 05:39:42.312237 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3722/7624] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:39:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:39:42.640379 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-90566b6f-b05f-4246-8897-86f3ba6237b0 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:39:42.641033 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-90566b6f-b05f-4246-8897-86f3ba6237b0 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] [instance: 80a26547-1e67-4db6-a977-7b6b80b6a766] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:39:42.647611 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-90566b6f-b05f-4246-8897-86f3ba6237b0 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:39:42.650245 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-90566b6f-b05f-4246-8897-86f3ba6237b0 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:39:42.650245 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-90566b6f-b05f-4246-8897-86f3ba6237b0 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:39:42.650245 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-90566b6f-b05f-4246-8897-86f3ba6237b0 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:39:42.650245 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-90566b6f-b05f-4246-8897-86f3ba6237b0 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:39:42.650712 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-90566b6f-b05f-4246-8897-86f3ba6237b0 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:39:42.789566 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-90566b6f-b05f-4246-8897-86f3ba6237b0 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2120ec508557410abc1d13fe13355078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5117afeb2bef4c278a568b425d109a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:39:42.797994 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-90566b6f-b05f-4246-8897-86f3ba6237b0 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] 10.222.0.33 "GET /compute/v2.1/servers/80a26547-1e67-4db6-a977-7b6b80b6a766" status: 200 len: 1362 microversion: 2.1 time: 0.161764 Sep 23 05:39:42.798576 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3903/7625] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:39:42 2022] GET /compute/v2.1/servers/80a26547-1e67-4db6-a977-7b6b80b6a766 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:39:43.821945 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f0852fc2-a8b0-4b01-a3b9-3f6c96d5b19c tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:39:43.822683 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f0852fc2-a8b0-4b01-a3b9-3f6c96d5b19c tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] [instance: 80a26547-1e67-4db6-a977-7b6b80b6a766] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:39:43.830033 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f0852fc2-a8b0-4b01-a3b9-3f6c96d5b19c tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:39:43.830487 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f0852fc2-a8b0-4b01-a3b9-3f6c96d5b19c tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:39:43.830952 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f0852fc2-a8b0-4b01-a3b9-3f6c96d5b19c tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:39:43.831688 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f0852fc2-a8b0-4b01-a3b9-3f6c96d5b19c tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:39:43.832168 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f0852fc2-a8b0-4b01-a3b9-3f6c96d5b19c tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:39:43.832617 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f0852fc2-a8b0-4b01-a3b9-3f6c96d5b19c tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:39:43.971077 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f0852fc2-a8b0-4b01-a3b9-3f6c96d5b19c tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2120ec508557410abc1d13fe13355078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5117afeb2bef4c278a568b425d109a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:39:43.980199 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f0852fc2-a8b0-4b01-a3b9-3f6c96d5b19c tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] 10.222.0.33 "GET /compute/v2.1/servers/80a26547-1e67-4db6-a977-7b6b80b6a766" status: 200 len: 1362 microversion: 2.1 time: 0.163082 Sep 23 05:39:43.980785 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3723/7626] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:39:43 2022] GET /compute/v2.1/servers/80a26547-1e67-4db6-a977-7b6b80b6a766 => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:39:45.004274 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-44011110-d6bd-430f-ad74-4d7b14160e2b tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:39:45.004882 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-44011110-d6bd-430f-ad74-4d7b14160e2b tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] [instance: 80a26547-1e67-4db6-a977-7b6b80b6a766] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:39:45.012228 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-44011110-d6bd-430f-ad74-4d7b14160e2b tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:39:45.012712 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-44011110-d6bd-430f-ad74-4d7b14160e2b tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:39:45.013152 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-44011110-d6bd-430f-ad74-4d7b14160e2b tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:39:45.013846 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-44011110-d6bd-430f-ad74-4d7b14160e2b tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:39:45.014336 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-44011110-d6bd-430f-ad74-4d7b14160e2b tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:39:45.015025 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-44011110-d6bd-430f-ad74-4d7b14160e2b tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:39:45.144137 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-44011110-d6bd-430f-ad74-4d7b14160e2b tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2120ec508557410abc1d13fe13355078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5117afeb2bef4c278a568b425d109a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:39:45.151918 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-44011110-d6bd-430f-ad74-4d7b14160e2b tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] 10.222.0.33 "GET /compute/v2.1/servers/80a26547-1e67-4db6-a977-7b6b80b6a766" status: 200 len: 1362 microversion: 2.1 time: 0.151861 Sep 23 05:39:45.152488 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3904/7627] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:39:44 2022] GET /compute/v2.1/servers/80a26547-1e67-4db6-a977-7b6b80b6a766 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:39:46.174608 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1464818b-951d-4598-a7e9-9450c5687044 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:39:46.175316 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-1464818b-951d-4598-a7e9-9450c5687044 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] [instance: 80a26547-1e67-4db6-a977-7b6b80b6a766] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:39:46.182289 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1464818b-951d-4598-a7e9-9450c5687044 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:39:46.182872 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1464818b-951d-4598-a7e9-9450c5687044 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:39:46.183456 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1464818b-951d-4598-a7e9-9450c5687044 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:39:46.184272 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1464818b-951d-4598-a7e9-9450c5687044 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:39:46.184821 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1464818b-951d-4598-a7e9-9450c5687044 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:39:46.185279 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1464818b-951d-4598-a7e9-9450c5687044 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:39:46.320226 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-1464818b-951d-4598-a7e9-9450c5687044 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2120ec508557410abc1d13fe13355078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5117afeb2bef4c278a568b425d109a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:39:46.330842 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-1464818b-951d-4598-a7e9-9450c5687044 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] 10.222.0.33 "GET /compute/v2.1/servers/80a26547-1e67-4db6-a977-7b6b80b6a766" status: 200 len: 1362 microversion: 2.1 time: 0.160095 Sep 23 05:39:46.331428 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3724/7628] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:39:46 2022] GET /compute/v2.1/servers/80a26547-1e67-4db6-a977-7b6b80b6a766 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:39:47.353518 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3ff4eac7-d18e-4656-9d17-ca8055d63b59 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:39:47.354156 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-3ff4eac7-d18e-4656-9d17-ca8055d63b59 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] [instance: 80a26547-1e67-4db6-a977-7b6b80b6a766] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:39:47.360687 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3ff4eac7-d18e-4656-9d17-ca8055d63b59 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:39:47.361180 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3ff4eac7-d18e-4656-9d17-ca8055d63b59 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:39:47.361624 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3ff4eac7-d18e-4656-9d17-ca8055d63b59 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:39:47.362357 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3ff4eac7-d18e-4656-9d17-ca8055d63b59 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:39:47.362822 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3ff4eac7-d18e-4656-9d17-ca8055d63b59 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:39:47.363257 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3ff4eac7-d18e-4656-9d17-ca8055d63b59 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:39:47.490376 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-3ff4eac7-d18e-4656-9d17-ca8055d63b59 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2120ec508557410abc1d13fe13355078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5117afeb2bef4c278a568b425d109a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:39:47.498224 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3ff4eac7-d18e-4656-9d17-ca8055d63b59 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] 10.222.0.33 "GET /compute/v2.1/servers/80a26547-1e67-4db6-a977-7b6b80b6a766" status: 200 len: 1362 microversion: 2.1 time: 0.148547 Sep 23 05:39:47.498819 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3905/7629] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:39:47 2022] GET /compute/v2.1/servers/80a26547-1e67-4db6-a977-7b6b80b6a766 => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:39:47.743365 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-2a40bf3a-63c5-44f9-ad39-1fe665780281 req-c24e1c80-72c6-463a-90d3-aebb70953fcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80a26547-1e67-4db6-a977-7b6b80b6a766", "name": "network-vif-plugged", "status": "completed", "tag": "24ac9dbe-5ac4-4d87-8b44-defcc36c4043"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:39:47.753339 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-2a40bf3a-63c5-44f9-ad39-1fe665780281 req-c24e1c80-72c6-463a-90d3-aebb70953fcf service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:39:47.753835 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-2a40bf3a-63c5-44f9-ad39-1fe665780281 req-c24e1c80-72c6-463a-90d3-aebb70953fcf service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:39:47.754307 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-2a40bf3a-63c5-44f9-ad39-1fe665780281 req-c24e1c80-72c6-463a-90d3-aebb70953fcf service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:39:47.766077 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-2a40bf3a-63c5-44f9-ad39-1fe665780281 req-c24e1c80-72c6-463a-90d3-aebb70953fcf service nova] Creating event network-vif-plugged:24ac9dbe-5ac4-4d87-8b44-defcc36c4043 for instance 80a26547-1e67-4db6-a977-7b6b80b6a766 on n-h2-846463-3 Sep 23 05:39:47.771014 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-2a40bf3a-63c5-44f9-ad39-1fe665780281 req-c24e1c80-72c6-463a-90d3-aebb70953fcf service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087636 Sep 23 05:39:47.771595 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3725/7630] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:39:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:39:48.521451 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a9bac3a3-7c08-4585-8599-c521829ad703 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:39:48.522097 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a9bac3a3-7c08-4585-8599-c521829ad703 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] [instance: 80a26547-1e67-4db6-a977-7b6b80b6a766] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:39:48.524064 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:39:48.524828 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=6 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:39:48.529943 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a9bac3a3-7c08-4585-8599-c521829ad703 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:39:48.530433 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a9bac3a3-7c08-4585-8599-c521829ad703 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:39:48.536018 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a9bac3a3-7c08-4585-8599-c521829ad703 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:39:48.536018 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a9bac3a3-7c08-4585-8599-c521829ad703 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:39:48.536018 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a9bac3a3-7c08-4585-8599-c521829ad703 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:39:48.536018 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a9bac3a3-7c08-4585-8599-c521829ad703 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:39:48.660869 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a9bac3a3-7c08-4585-8599-c521829ad703 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2120ec508557410abc1d13fe13355078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5117afeb2bef4c278a568b425d109a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:39:48.668573 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a9bac3a3-7c08-4585-8599-c521829ad703 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] 10.222.0.33 "GET /compute/v2.1/servers/80a26547-1e67-4db6-a977-7b6b80b6a766" status: 200 len: 1362 microversion: 2.1 time: 0.150988 Sep 23 05:39:48.669146 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3906/7631] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:39:48 2022] GET /compute/v2.1/servers/80a26547-1e67-4db6-a977-7b6b80b6a766 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:39:49.688960 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=6 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:39:49.694163 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3317e84e-60d5-476f-a3dd-aa856bde8883 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:39:49.694887 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3317e84e-60d5-476f-a3dd-aa856bde8883 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] [instance: 80a26547-1e67-4db6-a977-7b6b80b6a766] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:39:49.701498 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3317e84e-60d5-476f-a3dd-aa856bde8883 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:39:49.703452 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3317e84e-60d5-476f-a3dd-aa856bde8883 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:39:49.703452 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3317e84e-60d5-476f-a3dd-aa856bde8883 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:39:49.703452 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3317e84e-60d5-476f-a3dd-aa856bde8883 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:39:49.703768 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3317e84e-60d5-476f-a3dd-aa856bde8883 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:39:49.704158 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3317e84e-60d5-476f-a3dd-aa856bde8883 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:39:49.841458 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-3317e84e-60d5-476f-a3dd-aa856bde8883 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2120ec508557410abc1d13fe13355078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5117afeb2bef4c278a568b425d109a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:39:49.849739 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3317e84e-60d5-476f-a3dd-aa856bde8883 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] 10.222.0.33 "GET /compute/v2.1/servers/80a26547-1e67-4db6-a977-7b6b80b6a766" status: 200 len: 1553 microversion: 2.1 time: 0.161721 Sep 23 05:39:49.850392 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3726/7632] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:39:49 2022] GET /compute/v2.1/servers/80a26547-1e67-4db6-a977-7b6b80b6a766 => generated 1553 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:39:49.871644 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e43d7b03-c890-4ca3-a273-9d7ad6216c4b tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:39:49.872254 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e43d7b03-c890-4ca3-a273-9d7ad6216c4b tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] [instance: 80a26547-1e67-4db6-a977-7b6b80b6a766] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:39:49.878736 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e43d7b03-c890-4ca3-a273-9d7ad6216c4b tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:39:49.879218 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e43d7b03-c890-4ca3-a273-9d7ad6216c4b tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:39:49.879654 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e43d7b03-c890-4ca3-a273-9d7ad6216c4b tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:39:49.880343 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e43d7b03-c890-4ca3-a273-9d7ad6216c4b tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:39:49.880797 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e43d7b03-c890-4ca3-a273-9d7ad6216c4b tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:39:49.881221 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e43d7b03-c890-4ca3-a273-9d7ad6216c4b tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:39:49.899436 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:39:50.010788 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e43d7b03-c890-4ca3-a273-9d7ad6216c4b tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2120ec508557410abc1d13fe13355078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5117afeb2bef4c278a568b425d109a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:39:50.019427 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e43d7b03-c890-4ca3-a273-9d7ad6216c4b tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] 10.222.0.33 "GET /compute/v2.1/servers/80a26547-1e67-4db6-a977-7b6b80b6a766" status: 200 len: 1553 microversion: 2.1 time: 0.151554 Sep 23 05:39:50.020034 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3907/7633] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:39:49 2022] GET /compute/v2.1/servers/80a26547-1e67-4db6-a977-7b6b80b6a766 => generated 1553 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:39:53.065025 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d86330c4-7aac-430d-aca0-0f0b5cc264cf tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c18eb6ca-2195-4b2d-a53e-d6aaaaf4ecb9"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:39:53.067544 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d86330c4-7aac-430d-aca0-0f0b5cc264cf tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] [instance: 80a26547-1e67-4db6-a977-7b6b80b6a766] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:39:53.075487 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d86330c4-7aac-430d-aca0-0f0b5cc264cf tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:39:53.075944 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d86330c4-7aac-430d-aca0-0f0b5cc264cf tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:39:53.076406 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d86330c4-7aac-430d-aca0-0f0b5cc264cf tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:39:53.077514 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d86330c4-7aac-430d-aca0-0f0b5cc264cf tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:39:53.078293 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d86330c4-7aac-430d-aca0-0f0b5cc264cf tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:39:53.078749 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d86330c4-7aac-430d-aca0-0f0b5cc264cf tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:39:53.778926 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d86330c4-7aac-430d-aca0-0f0b5cc264cf tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] 10.222.0.33 "POST /compute/v2.1/servers/80a26547-1e67-4db6-a977-7b6b80b6a766/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.717681 Sep 23 05:39:53.779553 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3727/7634] 10.222.0.33 () {60 vars in 1323 bytes} [Fri Sep 23 05:39:53 2022] POST /compute/v2.1/servers/80a26547-1e67-4db6-a977-7b6b80b6a766/os-volume_attachments => generated 194 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:40:05.558167 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-767a64a9-9fe8-426b-ad91-90d65960b0b2 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:40:05.558659 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-767a64a9-9fe8-426b-ad91-90d65960b0b2 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] [instance: 80a26547-1e67-4db6-a977-7b6b80b6a766] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:40:05.560926 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:40:05.561620 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:40:05.566338 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-767a64a9-9fe8-426b-ad91-90d65960b0b2 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:40:05.566832 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-767a64a9-9fe8-426b-ad91-90d65960b0b2 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:40:05.567279 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-767a64a9-9fe8-426b-ad91-90d65960b0b2 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:40:05.567981 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-767a64a9-9fe8-426b-ad91-90d65960b0b2 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:40:05.568447 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-767a64a9-9fe8-426b-ad91-90d65960b0b2 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:40:05.568879 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-767a64a9-9fe8-426b-ad91-90d65960b0b2 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:40:05.649575 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-767a64a9-9fe8-426b-ad91-90d65960b0b2 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lazy-loading 'services' on Instance uuid 80a26547-1e67-4db6-a977-7b6b80b6a766 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 05:40:05.870170 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-767a64a9-9fe8-426b-ad91-90d65960b0b2 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] 10.222.0.33 "DELETE /compute/v2.1/servers/80a26547-1e67-4db6-a977-7b6b80b6a766/os-volume_attachments/c18eb6ca-2195-4b2d-a53e-d6aaaaf4ecb9" status: 202 len: 0 microversion: 2.1 time: 0.315834 Sep 23 05:40:05.870780 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3908/7635] 10.222.0.33 () {58 vars in 1416 bytes} [Fri Sep 23 05:40:05 2022] DELETE /compute/v2.1/servers/80a26547-1e67-4db6-a977-7b6b80b6a766/os-volume_attachments/c18eb6ca-2195-4b2d-a53e-d6aaaaf4ecb9 => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 05:40:05.877416 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:40:05.881204 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:40:05.882428 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3434d52e-11a3-4813-b6e4-d5564aa66898 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:40:05.884712 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3434d52e-11a3-4813-b6e4-d5564aa66898 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] [instance: 80a26547-1e67-4db6-a977-7b6b80b6a766] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:40:05.890975 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3434d52e-11a3-4813-b6e4-d5564aa66898 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:40:05.891477 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3434d52e-11a3-4813-b6e4-d5564aa66898 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:40:05.891933 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3434d52e-11a3-4813-b6e4-d5564aa66898 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:40:05.892640 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3434d52e-11a3-4813-b6e4-d5564aa66898 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:40:05.893116 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3434d52e-11a3-4813-b6e4-d5564aa66898 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:40:05.893563 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3434d52e-11a3-4813-b6e4-d5564aa66898 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:40:05.925324 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3434d52e-11a3-4813-b6e4-d5564aa66898 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] 10.222.0.33 "GET /compute/v2.1/servers/80a26547-1e67-4db6-a977-7b6b80b6a766/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049935 Sep 23 05:40:05.926083 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3728/7636] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Sep 23 05:40:05 2022] GET /compute/v2.1/servers/80a26547-1e67-4db6-a977-7b6b80b6a766/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:40:06.940859 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-410a8889-a270-4ffe-8ae9-bdf6dc466659 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:40:06.943331 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-410a8889-a270-4ffe-8ae9-bdf6dc466659 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] [instance: 80a26547-1e67-4db6-a977-7b6b80b6a766] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:40:06.949875 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-410a8889-a270-4ffe-8ae9-bdf6dc466659 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:40:06.953496 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-410a8889-a270-4ffe-8ae9-bdf6dc466659 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:40:06.953496 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-410a8889-a270-4ffe-8ae9-bdf6dc466659 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:40:06.953496 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-410a8889-a270-4ffe-8ae9-bdf6dc466659 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:40:06.953496 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-410a8889-a270-4ffe-8ae9-bdf6dc466659 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:40:06.953496 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-410a8889-a270-4ffe-8ae9-bdf6dc466659 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:40:06.984310 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-410a8889-a270-4ffe-8ae9-bdf6dc466659 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] 10.222.0.33 "GET /compute/v2.1/servers/80a26547-1e67-4db6-a977-7b6b80b6a766/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049729 Sep 23 05:40:06.984898 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3909/7637] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Sep 23 05:40:06 2022] GET /compute/v2.1/servers/80a26547-1e67-4db6-a977-7b6b80b6a766/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:40:07.998908 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-934e8b8c-3012-49dc-9d30-a95522d87416 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:40:08.001116 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-934e8b8c-3012-49dc-9d30-a95522d87416 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] [instance: 80a26547-1e67-4db6-a977-7b6b80b6a766] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:40:08.008476 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-934e8b8c-3012-49dc-9d30-a95522d87416 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:40:08.011122 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-934e8b8c-3012-49dc-9d30-a95522d87416 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:40:08.011122 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-934e8b8c-3012-49dc-9d30-a95522d87416 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:40:08.011122 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-934e8b8c-3012-49dc-9d30-a95522d87416 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:40:08.011442 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-934e8b8c-3012-49dc-9d30-a95522d87416 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:40:08.011811 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-934e8b8c-3012-49dc-9d30-a95522d87416 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:40:08.045663 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-934e8b8c-3012-49dc-9d30-a95522d87416 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] 10.222.0.33 "GET /compute/v2.1/servers/80a26547-1e67-4db6-a977-7b6b80b6a766/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052438 Sep 23 05:40:08.046304 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3729/7638] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Sep 23 05:40:07 2022] GET /compute/v2.1/servers/80a26547-1e67-4db6-a977-7b6b80b6a766/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:40:09.058442 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7fe31fa6-fce1-4d38-9cf6-41f1d2744492 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:40:09.061237 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-7fe31fa6-fce1-4d38-9cf6-41f1d2744492 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] [instance: 80a26547-1e67-4db6-a977-7b6b80b6a766] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:40:09.068004 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7fe31fa6-fce1-4d38-9cf6-41f1d2744492 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:40:09.068500 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7fe31fa6-fce1-4d38-9cf6-41f1d2744492 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:40:09.068947 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7fe31fa6-fce1-4d38-9cf6-41f1d2744492 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:40:09.069655 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7fe31fa6-fce1-4d38-9cf6-41f1d2744492 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:40:09.070153 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7fe31fa6-fce1-4d38-9cf6-41f1d2744492 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:40:09.070592 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7fe31fa6-fce1-4d38-9cf6-41f1d2744492 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:40:09.105198 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-7fe31fa6-fce1-4d38-9cf6-41f1d2744492 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] 10.222.0.33 "GET /compute/v2.1/servers/80a26547-1e67-4db6-a977-7b6b80b6a766/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050939 Sep 23 05:40:09.105777 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3910/7639] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Sep 23 05:40:09 2022] GET /compute/v2.1/servers/80a26547-1e67-4db6-a977-7b6b80b6a766/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:40:10.118771 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ede25b11-7d55-4a82-8710-116bf849ca2f tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:40:10.120996 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-ede25b11-7d55-4a82-8710-116bf849ca2f tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] [instance: 80a26547-1e67-4db6-a977-7b6b80b6a766] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:40:10.128784 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ede25b11-7d55-4a82-8710-116bf849ca2f tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:40:10.129298 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ede25b11-7d55-4a82-8710-116bf849ca2f tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:40:10.129751 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ede25b11-7d55-4a82-8710-116bf849ca2f tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:40:10.130558 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ede25b11-7d55-4a82-8710-116bf849ca2f tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:40:10.131031 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ede25b11-7d55-4a82-8710-116bf849ca2f tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:40:10.131473 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ede25b11-7d55-4a82-8710-116bf849ca2f tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:40:10.162400 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ede25b11-7d55-4a82-8710-116bf849ca2f tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] 10.222.0.33 "GET /compute/v2.1/servers/80a26547-1e67-4db6-a977-7b6b80b6a766/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048375 Sep 23 05:40:10.162972 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3730/7640] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Sep 23 05:40:10 2022] GET /compute/v2.1/servers/80a26547-1e67-4db6-a977-7b6b80b6a766/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:40:11.174379 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d5db853c-36bb-42fe-a08d-a149dc9abc93 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:40:11.176570 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d5db853c-36bb-42fe-a08d-a149dc9abc93 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] [instance: 80a26547-1e67-4db6-a977-7b6b80b6a766] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:40:11.183532 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d5db853c-36bb-42fe-a08d-a149dc9abc93 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:40:11.184024 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d5db853c-36bb-42fe-a08d-a149dc9abc93 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:40:11.184468 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d5db853c-36bb-42fe-a08d-a149dc9abc93 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:40:11.185166 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d5db853c-36bb-42fe-a08d-a149dc9abc93 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:40:11.185629 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d5db853c-36bb-42fe-a08d-a149dc9abc93 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:40:11.186099 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d5db853c-36bb-42fe-a08d-a149dc9abc93 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:40:11.217087 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d5db853c-36bb-42fe-a08d-a149dc9abc93 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] 10.222.0.33 "GET /compute/v2.1/servers/80a26547-1e67-4db6-a977-7b6b80b6a766/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046658 Sep 23 05:40:11.217678 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3911/7641] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Sep 23 05:40:11 2022] GET /compute/v2.1/servers/80a26547-1e67-4db6-a977-7b6b80b6a766/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 05:40:11.228604 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a4af4767-b5ad-48f8-bb1d-aff1aa642869 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:40:11.229101 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a4af4767-b5ad-48f8-bb1d-aff1aa642869 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] [instance: 80a26547-1e67-4db6-a977-7b6b80b6a766] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:40:11.236209 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a4af4767-b5ad-48f8-bb1d-aff1aa642869 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:40:11.239982 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a4af4767-b5ad-48f8-bb1d-aff1aa642869 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:40:11.239982 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a4af4767-b5ad-48f8-bb1d-aff1aa642869 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:40:11.239982 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a4af4767-b5ad-48f8-bb1d-aff1aa642869 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:40:11.239982 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a4af4767-b5ad-48f8-bb1d-aff1aa642869 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:40:11.239982 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a4af4767-b5ad-48f8-bb1d-aff1aa642869 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:40:11.313996 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-a4af4767-b5ad-48f8-bb1d-aff1aa642869 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] HTTP exception thrown: Instance 80a26547-1e67-4db6-a977-7b6b80b6a766 is not attached to volume c18eb6ca-2195-4b2d-a53e-d6aaaaf4ecb9 Sep 23 05:40:11.315660 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a4af4767-b5ad-48f8-bb1d-aff1aa642869 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Request method failure captured: Sep 23 05:40:11.315660 n-d-846463-3 devstack@n-api.service[122698]: request: DELETE /compute/v2.1/servers/80a26547-1e67-4db6-a977-7b6b80b6a766/os-volume_attachments/c18eb6ca-2195-4b2d-a53e-d6aaaaf4ecb9 HTTP/1.1 Sep 23 05:40:11.315660 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 05:40:11.315660 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 05:40:11.315660 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 05:40:11.315660 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 05:40:11.315660 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 05:40:11.315660 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 05:40:11.315660 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 05:40:11.315660 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 05:40:11.315660 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLUZoO0Zlb5wEJzyWQv_kCFraY7Qaq6MtQjlJhob3FIRPW0M1hjfpK8nHBgkkiisPzLeyiv8DHEeemI6clu4FlfbhG2IPIsyeNdOh80moVQQ5UK7Fa9PsdJsLADEz6AyJokgAYAwFBXENS6OGfLgnoyFcibM-eV_t2QU5NAXt2aq8tSk Sep 23 05:40:11.315660 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 05:40:11.315660 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 05:40:11.315660 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 05:40:11.315660 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 05:40:11.315660 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 05:40:11.315660 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 05:40:11.315660 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 5117afeb2bef4c278a568b425d109a6a Sep 23 05:40:11.315660 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-TestEncryptedCinderVolumes-2079194995 Sep 23 05:40:11.315660 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 05:40:11.315660 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 05:40:11.315660 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5117afeb2bef4c278a568b425d109a6a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5117afeb2bef4c278a568b425d109a6a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5117afeb2bef4c278a568b425d109a6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5117afeb2bef4c278a568b425d109a6a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:40:11.315660 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-TestEncryptedCinderVolumes-2079194995 Sep 23 05:40:11.315660 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 5117afeb2bef4c278a568b425d109a6a Sep 23 05:40:11.315660 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-2079194995 Sep 23 05:40:11.315660 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-TestEncryptedCinderVolumes-2079194995-project Sep 23 05:40:11.315660 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 05:40:11.315660 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 05:40:11.315660 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 2120ec508557410abc1d13fe13355078 Sep 23 05:40:11.315660 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-TestEncryptedCinderVolumes-2079194995-project Sep 23 05:40:11.315660 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 05:40:11.315660 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 80a26547-1e67-4db6-a977-7b6b80b6a766 is not attached to volume c18eb6ca-2195-4b2d-a53e-d6aaaaf4ecb9 Sep 23 05:40:11.315660 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'server_id': '80a26547-1e67-4db6-a977-7b6b80b6a766', 'id': 'c18eb6ca-2195-4b2d-a53e-d6aaaaf4ecb9'} Sep 23 05:40:11.315660 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:40:11.315660 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:40:11.315660 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 23 05:40:11.315660 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 23 05:40:11.315660 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 05:40:11.315660 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 05:40:11.315660 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 23 05:40:11.315660 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 23 05:40:11.315660 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id c18eb6ca-2195-4b2d-a53e-d6aaaaf4ecb9. Sep 23 05:40:11.315660 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:40:11.315660 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:40:11.315660 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:40:11.315660 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:40:11.315660 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:40:11.315660 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:40:11.315660 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:40:11.315660 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:40:11.315660 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:40:11.315660 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:40:11.315660 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 23 05:40:11.315660 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 23 05:40:11.315660 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80a26547-1e67-4db6-a977-7b6b80b6a766 is not attached to volume c18eb6ca-2195-4b2d-a53e-d6aaaaf4ecb9 Sep 23 05:40:11.315660 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:40:11.315660 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:40:11.315660 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:40:11.315660 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:40:11.315660 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:40:11.315660 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:40:11.320654 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:40:11.320654 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:40:11.320654 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80a26547-1e67-4db6-a977-7b6b80b6a766 is not attached to volume c18eb6ca-2195-4b2d-a53e-d6aaaaf4ecb9 Sep 23 05:40:11.320654 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:40:11.320654 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a4af4767-b5ad-48f8-bb1d-aff1aa642869 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Returning 404 to user: Instance 80a26547-1e67-4db6-a977-7b6b80b6a766 is not attached to volume c18eb6ca-2195-4b2d-a53e-d6aaaaf4ecb9 {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:40:11.320654 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a4af4767-b5ad-48f8-bb1d-aff1aa642869 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] 10.222.0.33 "DELETE /compute/v2.1/servers/80a26547-1e67-4db6-a977-7b6b80b6a766/os-volume_attachments/c18eb6ca-2195-4b2d-a53e-d6aaaaf4ecb9" status: 404 len: 154 microversion: 2.1 time: 0.092680 Sep 23 05:40:11.320654 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3731/7642] 10.222.0.33 () {58 vars in 1416 bytes} [Fri Sep 23 05:40:11 2022] DELETE /compute/v2.1/servers/80a26547-1e67-4db6-a977-7b6b80b6a766/os-volume_attachments/c18eb6ca-2195-4b2d-a53e-d6aaaaf4ecb9 => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 05:40:14.839794 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-781ddccd-5254-43dd-aaee-b976f9d62b7a tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:40:14.842292 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-781ddccd-5254-43dd-aaee-b976f9d62b7a tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] [instance: 80a26547-1e67-4db6-a977-7b6b80b6a766] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:40:14.846786 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-781ddccd-5254-43dd-aaee-b976f9d62b7a tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:40:14.847277 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-781ddccd-5254-43dd-aaee-b976f9d62b7a tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:40:14.847713 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-781ddccd-5254-43dd-aaee-b976f9d62b7a tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:40:14.848408 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-781ddccd-5254-43dd-aaee-b976f9d62b7a tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:40:14.848908 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-781ddccd-5254-43dd-aaee-b976f9d62b7a tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:40:14.849333 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-781ddccd-5254-43dd-aaee-b976f9d62b7a tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:40:14.875262 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-781ddccd-5254-43dd-aaee-b976f9d62b7a tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] [instance: 80a26547-1e67-4db6-a977-7b6b80b6a766] Going to try to terminate instance {{(pid=122699) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 05:40:15.197634 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-781ddccd-5254-43dd-aaee-b976f9d62b7a tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] 10.222.0.33 "DELETE /compute/v2.1/servers/80a26547-1e67-4db6-a977-7b6b80b6a766" status: 204 len: 0 microversion: 2.1 time: 0.361381 Sep 23 05:40:15.198280 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3912/7643] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 05:40:14 2022] DELETE /compute/v2.1/servers/80a26547-1e67-4db6-a977-7b6b80b6a766 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 05:40:15.206639 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0b4b65b0-8878-45d5-860f-5f7d6c37e98d tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:40:15.207281 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-0b4b65b0-8878-45d5-860f-5f7d6c37e98d tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] [instance: 80a26547-1e67-4db6-a977-7b6b80b6a766] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:40:15.215826 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0b4b65b0-8878-45d5-860f-5f7d6c37e98d tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:40:15.218053 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0b4b65b0-8878-45d5-860f-5f7d6c37e98d tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:40:15.218053 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0b4b65b0-8878-45d5-860f-5f7d6c37e98d tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:40:15.218053 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0b4b65b0-8878-45d5-860f-5f7d6c37e98d tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:40:15.218053 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0b4b65b0-8878-45d5-860f-5f7d6c37e98d tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:40:15.218458 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0b4b65b0-8878-45d5-860f-5f7d6c37e98d tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:40:15.355436 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-0b4b65b0-8878-45d5-860f-5f7d6c37e98d tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2120ec508557410abc1d13fe13355078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5117afeb2bef4c278a568b425d109a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:40:15.363463 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0b4b65b0-8878-45d5-860f-5f7d6c37e98d tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] 10.222.0.33 "GET /compute/v2.1/servers/80a26547-1e67-4db6-a977-7b6b80b6a766" status: 200 len: 1559 microversion: 2.1 time: 0.160914 Sep 23 05:40:15.364041 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3732/7644] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:40:15 2022] GET /compute/v2.1/servers/80a26547-1e67-4db6-a977-7b6b80b6a766 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:40:16.387980 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0f6eb034-913c-4e70-a9f7-52c07cb2fef8 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:40:16.388718 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-0f6eb034-913c-4e70-a9f7-52c07cb2fef8 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] [instance: 80a26547-1e67-4db6-a977-7b6b80b6a766] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:40:16.395499 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0f6eb034-913c-4e70-a9f7-52c07cb2fef8 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:40:16.395989 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0f6eb034-913c-4e70-a9f7-52c07cb2fef8 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:40:16.396424 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0f6eb034-913c-4e70-a9f7-52c07cb2fef8 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:40:16.397115 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0f6eb034-913c-4e70-a9f7-52c07cb2fef8 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:40:16.397573 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0f6eb034-913c-4e70-a9f7-52c07cb2fef8 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:40:16.398026 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0f6eb034-913c-4e70-a9f7-52c07cb2fef8 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:40:16.524380 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-0f6eb034-913c-4e70-a9f7-52c07cb2fef8 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2120ec508557410abc1d13fe13355078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5117afeb2bef4c278a568b425d109a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:40:16.532617 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0f6eb034-913c-4e70-a9f7-52c07cb2fef8 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] 10.222.0.33 "GET /compute/v2.1/servers/80a26547-1e67-4db6-a977-7b6b80b6a766" status: 200 len: 1559 microversion: 2.1 time: 0.149210 Sep 23 05:40:16.533185 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3913/7645] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:40:16 2022] GET /compute/v2.1/servers/80a26547-1e67-4db6-a977-7b6b80b6a766 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:40:17.338671 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-7cb34590-47aa-4ca1-bc2e-2e3d242af47c req-127d1b63-f218-4b95-a200-61274cd58561 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80a26547-1e67-4db6-a977-7b6b80b6a766", "name": "network-vif-deleted", "tag": "24ac9dbe-5ac4-4d87-8b44-defcc36c4043"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:40:17.349044 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-7cb34590-47aa-4ca1-bc2e-2e3d242af47c req-127d1b63-f218-4b95-a200-61274cd58561 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:40:17.349545 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-7cb34590-47aa-4ca1-bc2e-2e3d242af47c req-127d1b63-f218-4b95-a200-61274cd58561 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:40:17.350035 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-7cb34590-47aa-4ca1-bc2e-2e3d242af47c req-127d1b63-f218-4b95-a200-61274cd58561 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:40:17.361306 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-7cb34590-47aa-4ca1-bc2e-2e3d242af47c req-127d1b63-f218-4b95-a200-61274cd58561 service nova] Creating event network-vif-deleted:24ac9dbe-5ac4-4d87-8b44-defcc36c4043 for instance 80a26547-1e67-4db6-a977-7b6b80b6a766 on n-h2-846463-3 Sep 23 05:40:17.366356 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-7cb34590-47aa-4ca1-bc2e-2e3d242af47c req-127d1b63-f218-4b95-a200-61274cd58561 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031978 Sep 23 05:40:17.366960 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3733/7646] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:40:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:40:17.555524 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-fdb6f505-5b6d-4ec7-8de5-f786bcf395a0 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:40:17.556095 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-fdb6f505-5b6d-4ec7-8de5-f786bcf395a0 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] [instance: 80a26547-1e67-4db6-a977-7b6b80b6a766] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:40:17.562634 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fdb6f505-5b6d-4ec7-8de5-f786bcf395a0 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:40:17.563128 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fdb6f505-5b6d-4ec7-8de5-f786bcf395a0 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:40:17.563575 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fdb6f505-5b6d-4ec7-8de5-f786bcf395a0 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:40:17.564271 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fdb6f505-5b6d-4ec7-8de5-f786bcf395a0 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:40:17.564736 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fdb6f505-5b6d-4ec7-8de5-f786bcf395a0 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:40:17.565167 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fdb6f505-5b6d-4ec7-8de5-f786bcf395a0 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:40:17.630868 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-fdb6f505-5b6d-4ec7-8de5-f786bcf395a0 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2120ec508557410abc1d13fe13355078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5117afeb2bef4c278a568b425d109a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:40:17.640674 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-fdb6f505-5b6d-4ec7-8de5-f786bcf395a0 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] 10.222.0.33 "GET /compute/v2.1/servers/80a26547-1e67-4db6-a977-7b6b80b6a766" status: 200 len: 1347 microversion: 2.1 time: 0.089028 Sep 23 05:40:17.641275 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3914/7647] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:40:17 2022] GET /compute/v2.1/servers/80a26547-1e67-4db6-a977-7b6b80b6a766 => generated 1347 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:40:18.665710 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-246da4fb-cc0c-42c6-acbc-8ae022b70770 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:40:18.666458 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-246da4fb-cc0c-42c6-acbc-8ae022b70770 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] [instance: 80a26547-1e67-4db6-a977-7b6b80b6a766] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:40:18.672629 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-246da4fb-cc0c-42c6-acbc-8ae022b70770 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:40:18.679368 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-246da4fb-cc0c-42c6-acbc-8ae022b70770 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:40:18.679368 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-246da4fb-cc0c-42c6-acbc-8ae022b70770 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:40:18.679368 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-246da4fb-cc0c-42c6-acbc-8ae022b70770 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:40:18.679368 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-246da4fb-cc0c-42c6-acbc-8ae022b70770 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:40:18.679368 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-246da4fb-cc0c-42c6-acbc-8ae022b70770 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:40:18.691883 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-246da4fb-cc0c-42c6-acbc-8ae022b70770 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] HTTP exception thrown: Instance 80a26547-1e67-4db6-a977-7b6b80b6a766 could not be found. Sep 23 05:40:18.693526 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-246da4fb-cc0c-42c6-acbc-8ae022b70770 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Request method failure captured: Sep 23 05:40:18.693526 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/80a26547-1e67-4db6-a977-7b6b80b6a766 HTTP/1.1 Sep 23 05:40:18.693526 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 05:40:18.693526 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 05:40:18.693526 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 05:40:18.693526 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 05:40:18.693526 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 05:40:18.693526 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 05:40:18.693526 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 05:40:18.693526 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 05:40:18.693526 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLUZoO0Zlb5wEJzyWQv_kCFraY7Qaq6MtQjlJhob3FIRPW0M1hjfpK8nHBgkkiisPzLeyiv8DHEeemI6clu4FlfbhG2IPIsyeNdOh80moVQQ5UK7Fa9PsdJsLADEz6AyJokgAYAwFBXENS6OGfLgnoyFcibM-eV_t2QU5NAXt2aq8tSk Sep 23 05:40:18.693526 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 05:40:18.693526 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 05:40:18.693526 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 05:40:18.693526 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 05:40:18.693526 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 05:40:18.693526 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 05:40:18.693526 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 5117afeb2bef4c278a568b425d109a6a Sep 23 05:40:18.693526 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-TestEncryptedCinderVolumes-2079194995 Sep 23 05:40:18.693526 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 05:40:18.693526 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 05:40:18.693526 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5117afeb2bef4c278a568b425d109a6a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5117afeb2bef4c278a568b425d109a6a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5117afeb2bef4c278a568b425d109a6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5117afeb2bef4c278a568b425d109a6a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:40:18.693526 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-TestEncryptedCinderVolumes-2079194995 Sep 23 05:40:18.693526 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 5117afeb2bef4c278a568b425d109a6a Sep 23 05:40:18.693526 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-2079194995 Sep 23 05:40:18.693526 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-TestEncryptedCinderVolumes-2079194995-project Sep 23 05:40:18.693526 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 05:40:18.693526 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 05:40:18.693526 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 2120ec508557410abc1d13fe13355078 Sep 23 05:40:18.693526 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-TestEncryptedCinderVolumes-2079194995-project Sep 23 05:40:18.693526 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 05:40:18.693526 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 80a26547-1e67-4db6-a977-7b6b80b6a766 could not be found. Sep 23 05:40:18.693526 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '80a26547-1e67-4db6-a977-7b6b80b6a766'} Sep 23 05:40:18.693526 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:40:18.693526 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:40:18.693526 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 05:40:18.693526 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 05:40:18.693526 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 05:40:18.693526 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 05:40:18.693526 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 05:40:18.693526 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 05:40:18.693526 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 05:40:18.693526 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 05:40:18.693526 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80a26547-1e67-4db6-a977-7b6b80b6a766 could not be found. Sep 23 05:40:18.693526 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:40:18.693526 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:40:18.693526 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:40:18.693526 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:40:18.693526 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:40:18.693526 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:40:18.693526 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:40:18.693526 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:40:18.693526 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:40:18.693526 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:40:18.693526 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 05:40:18.693526 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 05:40:18.693526 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 05:40:18.693526 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 05:40:18.693526 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 05:40:18.693526 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:40:18.693526 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80a26547-1e67-4db6-a977-7b6b80b6a766 could not be found. Sep 23 05:40:18.693526 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:40:18.693526 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:40:18.699234 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:40:18.699234 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:40:18.699234 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:40:18.699234 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:40:18.699234 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:40:18.699234 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:40:18.699234 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80a26547-1e67-4db6-a977-7b6b80b6a766 could not be found. Sep 23 05:40:18.699234 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:40:18.699234 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-246da4fb-cc0c-42c6-acbc-8ae022b70770 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Returning 404 to user: Instance 80a26547-1e67-4db6-a977-7b6b80b6a766 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:40:18.699234 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-246da4fb-cc0c-42c6-acbc-8ae022b70770 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] 10.222.0.33 "GET /compute/v2.1/servers/80a26547-1e67-4db6-a977-7b6b80b6a766" status: 404 len: 111 microversion: 2.1 time: 0.034444 Sep 23 05:40:18.699234 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3734/7648] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:40:18 2022] GET /compute/v2.1/servers/80a26547-1e67-4db6-a977-7b6b80b6a766 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 05:40:18.704386 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-37766117-88ac-4274-9feb-1023d265204c tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Calling method '.version_select at 0x7ff1ba8704c0>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:40:18.792352 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-37766117-88ac-4274-9feb-1023d265204c tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1827732261" status: 202 len: 0 microversion: 2.1 time: 0.091754 Sep 23 05:40:18.792928 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3915/7649] 10.222.0.33 () {58 vars in 1278 bytes} [Fri Sep 23 05:40:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1827732261 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 05:40:18.812583 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7b49b424-6f3c-4960-a81f-776fe26d65ce tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Action: 'create', calling method: .version_select at 0x7ff1c01b6ee0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-427102665", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIAEFjHqBgvRog1ha5gOYZF9iniqgqDYTKXL8exQQxh0ar3qjc4VXWfT3AUHf09WlyxpiPL9d2a4iI6fj8K2hSCBS1h1FYJA5UbquoFlJ2g8SJ1Ge4WU7WTQQJaq/twNOQ=="}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:40:18.828259 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-7b49b424-6f3c-4960-a81f-776fe26d65ce tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Getting quotas for project 5117afeb2bef4c278a568b425d109a6a. Resources: {'key_pairs'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 05:40:18.833528 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-7b49b424-6f3c-4960-a81f-776fe26d65ce tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Getting quotas for user 2120ec508557410abc1d13fe13355078 and project 5117afeb2bef4c278a568b425d109a6a. Resources: {'key_pairs'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 05:40:18.961600 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7b49b424-6f3c-4960-a81f-776fe26d65ce tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.153352 Sep 23 05:40:18.962178 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3735/7650] 10.222.0.33 () {60 vars in 1159 bytes} [Fri Sep 23 05:40:18 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:40:19.016098 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-935a88bb-e104-47a4-864c-030c9f05a6fd tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1469702473", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-427102665", "networks": [{"uuid": "407c633d-2992-4277-81a6-47e9946a6635"}]}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:40:19.068643 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.neutron [None req-935a88bb-e104-47a4-864c-030c9f05a6fd tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] validate_networks() for [('407c633d-2992-4277-81a6-47e9946a6635', None, None, None, None, None)] {{(pid=122699) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 05:40:19.453785 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-935a88bb-e104-47a4-864c-030c9f05a6fd tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Flavor limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 05:40:19.454248 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-935a88bb-e104-47a4-864c-030c9f05a6fd tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Image limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 05:40:19.454720 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-935a88bb-e104-47a4-864c-030c9f05a6fd tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Flavor pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 05:40:19.455132 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-935a88bb-e104-47a4-864c-030c9f05a6fd tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Image pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 05:40:19.455545 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-935a88bb-e104-47a4-864c-030c9f05a6fd tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 05:40:19.464790 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-935a88bb-e104-47a4-864c-030c9f05a6fd tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:40:19.465271 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-935a88bb-e104-47a4-864c-030c9f05a6fd tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:40:19.465705 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-935a88bb-e104-47a4-864c-030c9f05a6fd tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:40:19.466465 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-935a88bb-e104-47a4-864c-030c9f05a6fd tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:40:19.466920 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-935a88bb-e104-47a4-864c-030c9f05a6fd tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:40:19.467344 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-935a88bb-e104-47a4-864c-030c9f05a6fd tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:40:19.484072 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-935a88bb-e104-47a4-864c-030c9f05a6fd tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Getting quotas for project 5117afeb2bef4c278a568b425d109a6a. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 05:40:19.489161 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-935a88bb-e104-47a4-864c-030c9f05a6fd tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Getting quotas for user 2120ec508557410abc1d13fe13355078 and project 5117afeb2bef4c278a568b425d109a6a. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 05:40:19.502163 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-935a88bb-e104-47a4-864c-030c9f05a6fd tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Going to run 1 instances... {{(pid=122699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 05:40:19.504380 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-935a88bb-e104-47a4-864c-030c9f05a6fd tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] [instance: d5934a78-03a2-4466-8bf0-1574b76428f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 05:40:19.616311 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-935a88bb-e104-47a4-864c-030c9f05a6fd tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.604503 Sep 23 05:40:19.617006 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3916/7651] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 05:40:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 606 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 05:40:19.628556 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-bb173c62-bc05-4e42-9ac3-66c5209d8eb1 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:40:19.629317 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-bb173c62-bc05-4e42-9ac3-66c5209d8eb1 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] [instance: d5934a78-03a2-4466-8bf0-1574b76428f9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:40:19.684471 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-bb173c62-bc05-4e42-9ac3-66c5209d8eb1 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2120ec508557410abc1d13fe13355078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5117afeb2bef4c278a568b425d109a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:40:19.691735 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-bb173c62-bc05-4e42-9ac3-66c5209d8eb1 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] 10.222.0.33 "GET /compute/v2.1/servers/d5934a78-03a2-4466-8bf0-1574b76428f9" status: 200 len: 1262 microversion: 2.1 time: 0.067162 Sep 23 05:40:19.692654 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3736/7652] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:40:19 2022] GET /compute/v2.1/servers/d5934a78-03a2-4466-8bf0-1574b76428f9 => generated 1262 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:40:20.716413 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-27186f5a-5348-48a2-a1c2-86449c0bbe37 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:40:20.717036 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-27186f5a-5348-48a2-a1c2-86449c0bbe37 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] [instance: d5934a78-03a2-4466-8bf0-1574b76428f9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:40:20.723155 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-27186f5a-5348-48a2-a1c2-86449c0bbe37 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:40:20.723693 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-27186f5a-5348-48a2-a1c2-86449c0bbe37 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:40:20.724235 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-27186f5a-5348-48a2-a1c2-86449c0bbe37 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:40:20.724947 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-27186f5a-5348-48a2-a1c2-86449c0bbe37 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:40:20.725418 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-27186f5a-5348-48a2-a1c2-86449c0bbe37 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:40:20.725850 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-27186f5a-5348-48a2-a1c2-86449c0bbe37 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:40:20.791090 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-27186f5a-5348-48a2-a1c2-86449c0bbe37 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2120ec508557410abc1d13fe13355078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5117afeb2bef4c278a568b425d109a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:40:20.798980 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-27186f5a-5348-48a2-a1c2-86449c0bbe37 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] 10.222.0.33 "GET /compute/v2.1/servers/d5934a78-03a2-4466-8bf0-1574b76428f9" status: 200 len: 1266 microversion: 2.1 time: 0.087640 Sep 23 05:40:20.799567 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3917/7653] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:40:20 2022] GET /compute/v2.1/servers/d5934a78-03a2-4466-8bf0-1574b76428f9 => generated 1266 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:40:21.823197 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-831f6ddd-72b8-4a0b-9713-5a7eda9a9145 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:40:21.823834 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-831f6ddd-72b8-4a0b-9713-5a7eda9a9145 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] [instance: d5934a78-03a2-4466-8bf0-1574b76428f9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:40:21.833175 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-831f6ddd-72b8-4a0b-9713-5a7eda9a9145 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:40:21.834122 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-831f6ddd-72b8-4a0b-9713-5a7eda9a9145 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:40:21.834777 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-831f6ddd-72b8-4a0b-9713-5a7eda9a9145 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:40:21.835588 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-831f6ddd-72b8-4a0b-9713-5a7eda9a9145 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:40:21.838691 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-831f6ddd-72b8-4a0b-9713-5a7eda9a9145 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:40:21.838691 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-831f6ddd-72b8-4a0b-9713-5a7eda9a9145 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:40:21.902517 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-831f6ddd-72b8-4a0b-9713-5a7eda9a9145 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2120ec508557410abc1d13fe13355078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5117afeb2bef4c278a568b425d109a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:40:21.910369 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-831f6ddd-72b8-4a0b-9713-5a7eda9a9145 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] 10.222.0.33 "GET /compute/v2.1/servers/d5934a78-03a2-4466-8bf0-1574b76428f9" status: 200 len: 1320 microversion: 2.1 time: 0.091663 Sep 23 05:40:21.910953 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3737/7654] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:40:21 2022] GET /compute/v2.1/servers/d5934a78-03a2-4466-8bf0-1574b76428f9 => generated 1320 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:40:22.933593 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-59b2110a-8d06-4385-a7de-e0d94a7690ac tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:40:22.934241 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-59b2110a-8d06-4385-a7de-e0d94a7690ac tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] [instance: d5934a78-03a2-4466-8bf0-1574b76428f9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:40:22.941144 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-59b2110a-8d06-4385-a7de-e0d94a7690ac tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:40:22.941719 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-59b2110a-8d06-4385-a7de-e0d94a7690ac tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:40:22.942469 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-59b2110a-8d06-4385-a7de-e0d94a7690ac tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:40:22.943272 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-59b2110a-8d06-4385-a7de-e0d94a7690ac tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:40:22.943811 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-59b2110a-8d06-4385-a7de-e0d94a7690ac tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:40:22.944338 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-59b2110a-8d06-4385-a7de-e0d94a7690ac tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:40:23.081103 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-59b2110a-8d06-4385-a7de-e0d94a7690ac tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2120ec508557410abc1d13fe13355078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5117afeb2bef4c278a568b425d109a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:40:23.086462 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-dea6da3a-90d8-45a2-ad55-f2de989a8210 req-49a8c053-f362-4139-9312-3df2616b7a74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5934a78-03a2-4466-8bf0-1574b76428f9", "tag": "d6848aa1-d280-487d-ab2b-5b33f4a246b3"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:40:23.099042 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-59b2110a-8d06-4385-a7de-e0d94a7690ac tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] 10.222.0.33 "GET /compute/v2.1/servers/d5934a78-03a2-4466-8bf0-1574b76428f9" status: 200 len: 1362 microversion: 2.1 time: 0.170194 Sep 23 05:40:23.101934 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3918/7655] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:40:22 2022] GET /compute/v2.1/servers/d5934a78-03a2-4466-8bf0-1574b76428f9 => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:40:23.102098 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-dea6da3a-90d8-45a2-ad55-f2de989a8210 req-49a8c053-f362-4139-9312-3df2616b7a74 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:40:23.102098 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-dea6da3a-90d8-45a2-ad55-f2de989a8210 req-49a8c053-f362-4139-9312-3df2616b7a74 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:40:23.102098 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-dea6da3a-90d8-45a2-ad55-f2de989a8210 req-49a8c053-f362-4139-9312-3df2616b7a74 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:40:23.114145 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-dea6da3a-90d8-45a2-ad55-f2de989a8210 req-49a8c053-f362-4139-9312-3df2616b7a74 service nova] Creating event network-changed:d6848aa1-d280-487d-ab2b-5b33f4a246b3 for instance d5934a78-03a2-4466-8bf0-1574b76428f9 on n-h2-846463-3 Sep 23 05:40:23.120239 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-dea6da3a-90d8-45a2-ad55-f2de989a8210 req-49a8c053-f362-4139-9312-3df2616b7a74 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037470 Sep 23 05:40:23.120877 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3738/7656] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:40:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:40:24.124629 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f6a47883-6be5-4679-b94c-9259879c9990 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:40:24.125258 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f6a47883-6be5-4679-b94c-9259879c9990 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] [instance: d5934a78-03a2-4466-8bf0-1574b76428f9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:40:24.131762 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f6a47883-6be5-4679-b94c-9259879c9990 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:40:24.132259 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f6a47883-6be5-4679-b94c-9259879c9990 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:40:24.132704 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f6a47883-6be5-4679-b94c-9259879c9990 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:40:24.133404 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f6a47883-6be5-4679-b94c-9259879c9990 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:40:24.133868 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f6a47883-6be5-4679-b94c-9259879c9990 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:40:24.134830 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f6a47883-6be5-4679-b94c-9259879c9990 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:40:24.263080 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f6a47883-6be5-4679-b94c-9259879c9990 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2120ec508557410abc1d13fe13355078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5117afeb2bef4c278a568b425d109a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:40:24.271029 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f6a47883-6be5-4679-b94c-9259879c9990 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] 10.222.0.33 "GET /compute/v2.1/servers/d5934a78-03a2-4466-8bf0-1574b76428f9" status: 200 len: 1362 microversion: 2.1 time: 0.150631 Sep 23 05:40:24.271606 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3919/7657] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:40:24 2022] GET /compute/v2.1/servers/d5934a78-03a2-4466-8bf0-1574b76428f9 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:40:25.296078 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-11cf83e4-1f1e-4f5d-b16b-4ba46053c909 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:40:25.296787 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-11cf83e4-1f1e-4f5d-b16b-4ba46053c909 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] [instance: d5934a78-03a2-4466-8bf0-1574b76428f9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:40:25.303313 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-11cf83e4-1f1e-4f5d-b16b-4ba46053c909 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:40:25.303824 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-11cf83e4-1f1e-4f5d-b16b-4ba46053c909 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:40:25.304286 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-11cf83e4-1f1e-4f5d-b16b-4ba46053c909 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:40:25.304999 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-11cf83e4-1f1e-4f5d-b16b-4ba46053c909 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:40:25.305507 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-11cf83e4-1f1e-4f5d-b16b-4ba46053c909 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:40:25.306504 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-11cf83e4-1f1e-4f5d-b16b-4ba46053c909 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:40:25.439698 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-11cf83e4-1f1e-4f5d-b16b-4ba46053c909 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2120ec508557410abc1d13fe13355078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5117afeb2bef4c278a568b425d109a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:40:25.448452 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-11cf83e4-1f1e-4f5d-b16b-4ba46053c909 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] 10.222.0.33 "GET /compute/v2.1/servers/d5934a78-03a2-4466-8bf0-1574b76428f9" status: 200 len: 1362 microversion: 2.1 time: 0.157487 Sep 23 05:40:25.449015 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3739/7658] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:40:25 2022] GET /compute/v2.1/servers/d5934a78-03a2-4466-8bf0-1574b76428f9 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:40:26.471087 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-070660fc-e2e3-40c0-b92e-4f40e252daef tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:40:26.471705 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-070660fc-e2e3-40c0-b92e-4f40e252daef tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] [instance: d5934a78-03a2-4466-8bf0-1574b76428f9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:40:26.478237 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-070660fc-e2e3-40c0-b92e-4f40e252daef tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:40:26.478731 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-070660fc-e2e3-40c0-b92e-4f40e252daef tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:40:26.479174 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-070660fc-e2e3-40c0-b92e-4f40e252daef tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:40:26.479869 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-070660fc-e2e3-40c0-b92e-4f40e252daef tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:40:26.480326 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-070660fc-e2e3-40c0-b92e-4f40e252daef tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:40:26.480755 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-070660fc-e2e3-40c0-b92e-4f40e252daef tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:40:26.606308 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-070660fc-e2e3-40c0-b92e-4f40e252daef tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2120ec508557410abc1d13fe13355078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5117afeb2bef4c278a568b425d109a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:40:26.614385 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-070660fc-e2e3-40c0-b92e-4f40e252daef tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] 10.222.0.33 "GET /compute/v2.1/servers/d5934a78-03a2-4466-8bf0-1574b76428f9" status: 200 len: 1362 microversion: 2.1 time: 0.147100 Sep 23 05:40:26.614967 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3920/7659] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:40:26 2022] GET /compute/v2.1/servers/d5934a78-03a2-4466-8bf0-1574b76428f9 => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:40:27.638451 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4ffb5b9b-1fd8-40c0-866a-c72bab2ec1b7 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:40:27.639273 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4ffb5b9b-1fd8-40c0-866a-c72bab2ec1b7 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] [instance: d5934a78-03a2-4466-8bf0-1574b76428f9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:40:27.646422 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4ffb5b9b-1fd8-40c0-866a-c72bab2ec1b7 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:40:27.646924 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4ffb5b9b-1fd8-40c0-866a-c72bab2ec1b7 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:40:27.647382 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4ffb5b9b-1fd8-40c0-866a-c72bab2ec1b7 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:40:27.648095 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4ffb5b9b-1fd8-40c0-866a-c72bab2ec1b7 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:40:27.648565 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4ffb5b9b-1fd8-40c0-866a-c72bab2ec1b7 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:40:27.649006 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4ffb5b9b-1fd8-40c0-866a-c72bab2ec1b7 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:40:27.778157 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4ffb5b9b-1fd8-40c0-866a-c72bab2ec1b7 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2120ec508557410abc1d13fe13355078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5117afeb2bef4c278a568b425d109a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:40:27.785787 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4ffb5b9b-1fd8-40c0-866a-c72bab2ec1b7 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] 10.222.0.33 "GET /compute/v2.1/servers/d5934a78-03a2-4466-8bf0-1574b76428f9" status: 200 len: 1362 microversion: 2.1 time: 0.151863 Sep 23 05:40:27.786393 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3740/7660] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:40:27 2022] GET /compute/v2.1/servers/d5934a78-03a2-4466-8bf0-1574b76428f9 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:40:28.020845 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-54929513-dfca-4d3b-b20f-f313dc6eb30a req-8c6a6dd3-3d61-44d3-a2de-1dfe98241e4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5934a78-03a2-4466-8bf0-1574b76428f9", "name": "network-vif-plugged", "status": "completed", "tag": "d6848aa1-d280-487d-ab2b-5b33f4a246b3"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:40:28.031061 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-54929513-dfca-4d3b-b20f-f313dc6eb30a req-8c6a6dd3-3d61-44d3-a2de-1dfe98241e4c service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:40:28.031548 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-54929513-dfca-4d3b-b20f-f313dc6eb30a req-8c6a6dd3-3d61-44d3-a2de-1dfe98241e4c service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:40:28.031988 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-54929513-dfca-4d3b-b20f-f313dc6eb30a req-8c6a6dd3-3d61-44d3-a2de-1dfe98241e4c service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:40:28.043225 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-54929513-dfca-4d3b-b20f-f313dc6eb30a req-8c6a6dd3-3d61-44d3-a2de-1dfe98241e4c service nova] Creating event network-vif-plugged:d6848aa1-d280-487d-ab2b-5b33f4a246b3 for instance d5934a78-03a2-4466-8bf0-1574b76428f9 on n-h2-846463-3 Sep 23 05:40:28.048211 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-54929513-dfca-4d3b-b20f-f313dc6eb30a req-8c6a6dd3-3d61-44d3-a2de-1dfe98241e4c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031125 Sep 23 05:40:28.048807 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3921/7661] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:40:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:40:28.808846 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2098a3c4-e390-4f55-8e8b-34639e224a28 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:40:28.809322 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-2098a3c4-e390-4f55-8e8b-34639e224a28 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] [instance: d5934a78-03a2-4466-8bf0-1574b76428f9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:40:28.816210 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2098a3c4-e390-4f55-8e8b-34639e224a28 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:40:28.816714 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2098a3c4-e390-4f55-8e8b-34639e224a28 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:40:28.817171 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2098a3c4-e390-4f55-8e8b-34639e224a28 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:40:28.817904 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2098a3c4-e390-4f55-8e8b-34639e224a28 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:40:28.818456 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2098a3c4-e390-4f55-8e8b-34639e224a28 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:40:28.818902 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2098a3c4-e390-4f55-8e8b-34639e224a28 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:40:28.950663 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-2098a3c4-e390-4f55-8e8b-34639e224a28 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2120ec508557410abc1d13fe13355078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5117afeb2bef4c278a568b425d109a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:40:28.958405 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2098a3c4-e390-4f55-8e8b-34639e224a28 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] 10.222.0.33 "GET /compute/v2.1/servers/d5934a78-03a2-4466-8bf0-1574b76428f9" status: 200 len: 1362 microversion: 2.1 time: 0.153672 Sep 23 05:40:28.958986 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3741/7662] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:40:28 2022] GET /compute/v2.1/servers/d5934a78-03a2-4466-8bf0-1574b76428f9 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:40:29.982903 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2a369b90-0061-48db-b2fb-dc430003fa1c tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:40:29.983615 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-2a369b90-0061-48db-b2fb-dc430003fa1c tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] [instance: d5934a78-03a2-4466-8bf0-1574b76428f9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:40:29.986120 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:40:29.986802 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=6 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:40:29.992996 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2a369b90-0061-48db-b2fb-dc430003fa1c tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:40:29.996590 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2a369b90-0061-48db-b2fb-dc430003fa1c tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:40:29.996590 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2a369b90-0061-48db-b2fb-dc430003fa1c tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:40:29.996590 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2a369b90-0061-48db-b2fb-dc430003fa1c tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:40:29.996590 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2a369b90-0061-48db-b2fb-dc430003fa1c tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:40:29.996959 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2a369b90-0061-48db-b2fb-dc430003fa1c tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:40:30.126873 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2a369b90-0061-48db-b2fb-dc430003fa1c tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2120ec508557410abc1d13fe13355078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5117afeb2bef4c278a568b425d109a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:40:30.135183 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2a369b90-0061-48db-b2fb-dc430003fa1c tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] 10.222.0.33 "GET /compute/v2.1/servers/d5934a78-03a2-4466-8bf0-1574b76428f9" status: 200 len: 1554 microversion: 2.1 time: 0.157287 Sep 23 05:40:30.135792 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3922/7663] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:40:29 2022] GET /compute/v2.1/servers/d5934a78-03a2-4466-8bf0-1574b76428f9 => generated 1554 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:40:30.158360 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b9394645-9f18-4ecb-8219-15309f79394e tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:40:30.158995 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b9394645-9f18-4ecb-8219-15309f79394e tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] [instance: d5934a78-03a2-4466-8bf0-1574b76428f9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:40:30.161013 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=6 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:40:30.166418 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b9394645-9f18-4ecb-8219-15309f79394e tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:40:30.166536 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b9394645-9f18-4ecb-8219-15309f79394e tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:40:30.166934 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b9394645-9f18-4ecb-8219-15309f79394e tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:40:30.167660 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b9394645-9f18-4ecb-8219-15309f79394e tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:40:30.168141 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b9394645-9f18-4ecb-8219-15309f79394e tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:40:30.168588 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b9394645-9f18-4ecb-8219-15309f79394e tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:40:30.303637 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b9394645-9f18-4ecb-8219-15309f79394e tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2120ec508557410abc1d13fe13355078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5117afeb2bef4c278a568b425d109a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:40:30.311662 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b9394645-9f18-4ecb-8219-15309f79394e tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] 10.222.0.33 "GET /compute/v2.1/servers/d5934a78-03a2-4466-8bf0-1574b76428f9" status: 200 len: 1554 microversion: 2.1 time: 0.157468 Sep 23 05:40:30.312248 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3742/7664] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:40:30 2022] GET /compute/v2.1/servers/d5934a78-03a2-4466-8bf0-1574b76428f9 => generated 1554 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:40:33.316700 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-662877ff-bacd-4731-ac61-b38c1ec17e22 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8dd967e2-5fa4-4e06-bf96-a97cdf9e2a7d"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:40:33.319162 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-662877ff-bacd-4731-ac61-b38c1ec17e22 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] [instance: d5934a78-03a2-4466-8bf0-1574b76428f9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:40:33.325816 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-662877ff-bacd-4731-ac61-b38c1ec17e22 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:40:33.326350 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-662877ff-bacd-4731-ac61-b38c1ec17e22 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:40:33.326803 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-662877ff-bacd-4731-ac61-b38c1ec17e22 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:40:33.327518 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-662877ff-bacd-4731-ac61-b38c1ec17e22 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:40:33.327986 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-662877ff-bacd-4731-ac61-b38c1ec17e22 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:40:33.328428 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-662877ff-bacd-4731-ac61-b38c1ec17e22 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:40:33.823860 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:40:33.955796 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-662877ff-bacd-4731-ac61-b38c1ec17e22 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] 10.222.0.33 "POST /compute/v2.1/servers/d5934a78-03a2-4466-8bf0-1574b76428f9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.642685 Sep 23 05:40:33.956689 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3923/7665] 10.222.0.33 () {60 vars in 1323 bytes} [Fri Sep 23 05:40:33 2022] POST /compute/v2.1/servers/d5934a78-03a2-4466-8bf0-1574b76428f9/os-volume_attachments => generated 194 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:40:45.747222 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0564b94f-1610-412c-8c30-cda7d705c4e8 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:40:45.747806 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-0564b94f-1610-412c-8c30-cda7d705c4e8 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] [instance: d5934a78-03a2-4466-8bf0-1574b76428f9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:40:45.750598 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:40:45.751508 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=66 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:40:45.756162 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0564b94f-1610-412c-8c30-cda7d705c4e8 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:40:45.756671 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0564b94f-1610-412c-8c30-cda7d705c4e8 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:40:45.757130 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0564b94f-1610-412c-8c30-cda7d705c4e8 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:40:45.757857 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0564b94f-1610-412c-8c30-cda7d705c4e8 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:40:45.758367 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0564b94f-1610-412c-8c30-cda7d705c4e8 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:40:45.758814 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0564b94f-1610-412c-8c30-cda7d705c4e8 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:40:45.842417 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-0564b94f-1610-412c-8c30-cda7d705c4e8 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lazy-loading 'services' on Instance uuid d5934a78-03a2-4466-8bf0-1574b76428f9 {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 05:40:46.032850 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0564b94f-1610-412c-8c30-cda7d705c4e8 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] 10.222.0.33 "DELETE /compute/v2.1/servers/d5934a78-03a2-4466-8bf0-1574b76428f9/os-volume_attachments/8dd967e2-5fa4-4e06-bf96-a97cdf9e2a7d" status: 202 len: 0 microversion: 2.1 time: 0.290074 Sep 23 05:40:46.033850 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3743/7666] 10.222.0.33 () {58 vars in 1416 bytes} [Fri Sep 23 05:40:45 2022] DELETE /compute/v2.1/servers/d5934a78-03a2-4466-8bf0-1574b76428f9/os-volume_attachments/8dd967e2-5fa4-4e06-bf96-a97cdf9e2a7d => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 05:40:46.042581 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e111101f-cb4d-400e-9837-58af2af68cae tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:40:46.045526 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e111101f-cb4d-400e-9837-58af2af68cae tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] [instance: d5934a78-03a2-4466-8bf0-1574b76428f9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:40:46.048610 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:40:46.053872 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e111101f-cb4d-400e-9837-58af2af68cae tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:40:46.054429 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e111101f-cb4d-400e-9837-58af2af68cae tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:40:46.054884 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e111101f-cb4d-400e-9837-58af2af68cae tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:40:46.055603 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e111101f-cb4d-400e-9837-58af2af68cae tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:40:46.056076 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e111101f-cb4d-400e-9837-58af2af68cae tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:40:46.056515 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e111101f-cb4d-400e-9837-58af2af68cae tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:40:46.087855 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e111101f-cb4d-400e-9837-58af2af68cae tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] 10.222.0.33 "GET /compute/v2.1/servers/d5934a78-03a2-4466-8bf0-1574b76428f9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049635 Sep 23 05:40:46.088439 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3924/7667] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Sep 23 05:40:46 2022] GET /compute/v2.1/servers/d5934a78-03a2-4466-8bf0-1574b76428f9/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:40:47.102686 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7b7c9144-e2dd-4a3c-94eb-df1768965ff3 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:40:47.106165 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7b7c9144-e2dd-4a3c-94eb-df1768965ff3 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] [instance: d5934a78-03a2-4466-8bf0-1574b76428f9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:40:47.113004 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7b7c9144-e2dd-4a3c-94eb-df1768965ff3 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:40:47.114144 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7b7c9144-e2dd-4a3c-94eb-df1768965ff3 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:40:47.114144 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7b7c9144-e2dd-4a3c-94eb-df1768965ff3 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:40:47.114834 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7b7c9144-e2dd-4a3c-94eb-df1768965ff3 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:40:47.115237 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7b7c9144-e2dd-4a3c-94eb-df1768965ff3 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:40:47.115690 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7b7c9144-e2dd-4a3c-94eb-df1768965ff3 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:40:47.148697 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7b7c9144-e2dd-4a3c-94eb-df1768965ff3 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] 10.222.0.33 "GET /compute/v2.1/servers/d5934a78-03a2-4466-8bf0-1574b76428f9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051646 Sep 23 05:40:47.149443 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3744/7668] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Sep 23 05:40:47 2022] GET /compute/v2.1/servers/d5934a78-03a2-4466-8bf0-1574b76428f9/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:40:48.161081 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-83a8804c-6486-436e-b188-892e2ecbeb0b tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:40:48.163628 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-83a8804c-6486-436e-b188-892e2ecbeb0b tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] [instance: d5934a78-03a2-4466-8bf0-1574b76428f9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:40:48.171454 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-83a8804c-6486-436e-b188-892e2ecbeb0b tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:40:48.172048 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-83a8804c-6486-436e-b188-892e2ecbeb0b tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:40:48.172564 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-83a8804c-6486-436e-b188-892e2ecbeb0b tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:40:48.173356 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-83a8804c-6486-436e-b188-892e2ecbeb0b tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:40:48.173826 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-83a8804c-6486-436e-b188-892e2ecbeb0b tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:40:48.174298 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-83a8804c-6486-436e-b188-892e2ecbeb0b tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:40:48.206602 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-83a8804c-6486-436e-b188-892e2ecbeb0b tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] 10.222.0.33 "GET /compute/v2.1/servers/d5934a78-03a2-4466-8bf0-1574b76428f9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049633 Sep 23 05:40:48.207200 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3925/7669] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Sep 23 05:40:48 2022] GET /compute/v2.1/servers/d5934a78-03a2-4466-8bf0-1574b76428f9/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:40:49.219251 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-71b1476a-de0e-46ed-a532-1f0f7520b0b4 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:40:49.221496 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-71b1476a-de0e-46ed-a532-1f0f7520b0b4 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] [instance: d5934a78-03a2-4466-8bf0-1574b76428f9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:40:49.228539 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-71b1476a-de0e-46ed-a532-1f0f7520b0b4 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:40:49.229043 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-71b1476a-de0e-46ed-a532-1f0f7520b0b4 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:40:49.229497 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-71b1476a-de0e-46ed-a532-1f0f7520b0b4 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:40:49.230249 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-71b1476a-de0e-46ed-a532-1f0f7520b0b4 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:40:49.230725 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-71b1476a-de0e-46ed-a532-1f0f7520b0b4 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:40:49.231170 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-71b1476a-de0e-46ed-a532-1f0f7520b0b4 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:40:49.265048 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-71b1476a-de0e-46ed-a532-1f0f7520b0b4 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] 10.222.0.33 "GET /compute/v2.1/servers/d5934a78-03a2-4466-8bf0-1574b76428f9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049438 Sep 23 05:40:49.265986 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3745/7670] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Sep 23 05:40:49 2022] GET /compute/v2.1/servers/d5934a78-03a2-4466-8bf0-1574b76428f9/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:40:50.278143 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-27ec8747-5d46-4609-a1dc-bd01599d05aa tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:40:50.280317 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-27ec8747-5d46-4609-a1dc-bd01599d05aa tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] [instance: d5934a78-03a2-4466-8bf0-1574b76428f9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:40:50.287278 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-27ec8747-5d46-4609-a1dc-bd01599d05aa tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:40:50.287763 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-27ec8747-5d46-4609-a1dc-bd01599d05aa tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:40:50.288205 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-27ec8747-5d46-4609-a1dc-bd01599d05aa tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:40:50.288930 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-27ec8747-5d46-4609-a1dc-bd01599d05aa tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:40:50.289386 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-27ec8747-5d46-4609-a1dc-bd01599d05aa tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:40:50.289812 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-27ec8747-5d46-4609-a1dc-bd01599d05aa tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:40:50.328112 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-27ec8747-5d46-4609-a1dc-bd01599d05aa tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] 10.222.0.33 "GET /compute/v2.1/servers/d5934a78-03a2-4466-8bf0-1574b76428f9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049818 Sep 23 05:40:50.328912 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3926/7671] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Sep 23 05:40:50 2022] GET /compute/v2.1/servers/d5934a78-03a2-4466-8bf0-1574b76428f9/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:40:51.336767 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3c867099-7eac-4c59-8031-f7d2818e05bd tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:40:51.339006 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3c867099-7eac-4c59-8031-f7d2818e05bd tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] [instance: d5934a78-03a2-4466-8bf0-1574b76428f9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:40:51.346614 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3c867099-7eac-4c59-8031-f7d2818e05bd tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:40:51.347124 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3c867099-7eac-4c59-8031-f7d2818e05bd tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:40:51.347582 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3c867099-7eac-4c59-8031-f7d2818e05bd tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:40:51.348297 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3c867099-7eac-4c59-8031-f7d2818e05bd tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:40:51.348783 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3c867099-7eac-4c59-8031-f7d2818e05bd tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:40:51.349230 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3c867099-7eac-4c59-8031-f7d2818e05bd tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:40:51.378653 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3c867099-7eac-4c59-8031-f7d2818e05bd tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] 10.222.0.33 "GET /compute/v2.1/servers/d5934a78-03a2-4466-8bf0-1574b76428f9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045832 Sep 23 05:40:51.379148 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3746/7672] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Sep 23 05:40:51 2022] GET /compute/v2.1/servers/d5934a78-03a2-4466-8bf0-1574b76428f9/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 05:40:51.390937 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9a057287-cbe9-4112-af24-9a183d8d1779 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:40:51.391503 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-9a057287-cbe9-4112-af24-9a183d8d1779 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] [instance: d5934a78-03a2-4466-8bf0-1574b76428f9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:40:51.398046 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9a057287-cbe9-4112-af24-9a183d8d1779 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:40:51.398535 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9a057287-cbe9-4112-af24-9a183d8d1779 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:40:51.398972 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9a057287-cbe9-4112-af24-9a183d8d1779 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:40:51.399664 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9a057287-cbe9-4112-af24-9a183d8d1779 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:40:51.400124 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9a057287-cbe9-4112-af24-9a183d8d1779 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:40:51.400553 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9a057287-cbe9-4112-af24-9a183d8d1779 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:40:51.475151 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-9a057287-cbe9-4112-af24-9a183d8d1779 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] HTTP exception thrown: Instance d5934a78-03a2-4466-8bf0-1574b76428f9 is not attached to volume 8dd967e2-5fa4-4e06-bf96-a97cdf9e2a7d Sep 23 05:40:51.477152 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9a057287-cbe9-4112-af24-9a183d8d1779 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Request method failure captured: Sep 23 05:40:51.477152 n-d-846463-3 devstack@n-api.service[122699]: request: DELETE /compute/v2.1/servers/d5934a78-03a2-4466-8bf0-1574b76428f9/os-volume_attachments/8dd967e2-5fa4-4e06-bf96-a97cdf9e2a7d HTTP/1.1 Sep 23 05:40:51.477152 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 05:40:51.477152 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 05:40:51.477152 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 05:40:51.477152 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 05:40:51.477152 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 05:40:51.477152 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 05:40:51.477152 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 05:40:51.477152 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 05:40:51.477152 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLUZoO0Zlb5wEJzyWQv_kCFraY7Qaq6MtQjlJhob3FIRPW0M1hjfpK8nHBgkkiisPzLeyiv8DHEeemI6clu4FlfbhG2IPIsyeNdOh80moVQQ5UK7Fa9PsdJsLADEz6AyJokgAYAwFBXENS6OGfLgnoyFcibM-eV_t2QU5NAXt2aq8tSk Sep 23 05:40:51.477152 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 05:40:51.477152 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 05:40:51.477152 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 05:40:51.477152 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 05:40:51.477152 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 05:40:51.477152 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 05:40:51.477152 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 5117afeb2bef4c278a568b425d109a6a Sep 23 05:40:51.477152 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-TestEncryptedCinderVolumes-2079194995 Sep 23 05:40:51.477152 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 05:40:51.477152 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 05:40:51.477152 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5117afeb2bef4c278a568b425d109a6a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5117afeb2bef4c278a568b425d109a6a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5117afeb2bef4c278a568b425d109a6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5117afeb2bef4c278a568b425d109a6a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:40:51.477152 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-TestEncryptedCinderVolumes-2079194995 Sep 23 05:40:51.477152 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 5117afeb2bef4c278a568b425d109a6a Sep 23 05:40:51.477152 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-2079194995 Sep 23 05:40:51.477152 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-TestEncryptedCinderVolumes-2079194995-project Sep 23 05:40:51.477152 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 05:40:51.477152 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 05:40:51.477152 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 2120ec508557410abc1d13fe13355078 Sep 23 05:40:51.477152 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-TestEncryptedCinderVolumes-2079194995-project Sep 23 05:40:51.477152 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 05:40:51.477152 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance d5934a78-03a2-4466-8bf0-1574b76428f9 is not attached to volume 8dd967e2-5fa4-4e06-bf96-a97cdf9e2a7d Sep 23 05:40:51.477152 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'server_id': 'd5934a78-03a2-4466-8bf0-1574b76428f9', 'id': '8dd967e2-5fa4-4e06-bf96-a97cdf9e2a7d'} Sep 23 05:40:51.477152 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:40:51.477152 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:40:51.477152 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 23 05:40:51.477152 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 23 05:40:51.477152 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 05:40:51.477152 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 05:40:51.477152 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 23 05:40:51.477152 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 23 05:40:51.477152 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 8dd967e2-5fa4-4e06-bf96-a97cdf9e2a7d. Sep 23 05:40:51.477152 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:40:51.477152 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:40:51.477152 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:40:51.477152 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:40:51.477152 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:40:51.477152 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:40:51.477152 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:40:51.477152 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:40:51.477152 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:40:51.477152 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:40:51.477152 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 23 05:40:51.477152 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 23 05:40:51.477152 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5934a78-03a2-4466-8bf0-1574b76428f9 is not attached to volume 8dd967e2-5fa4-4e06-bf96-a97cdf9e2a7d Sep 23 05:40:51.477152 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:40:51.477152 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:40:51.477152 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:40:51.477152 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:40:51.477152 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:40:51.477152 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:40:51.481838 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:40:51.481838 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:40:51.481838 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5934a78-03a2-4466-8bf0-1574b76428f9 is not attached to volume 8dd967e2-5fa4-4e06-bf96-a97cdf9e2a7d Sep 23 05:40:51.481838 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:40:51.481838 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9a057287-cbe9-4112-af24-9a183d8d1779 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Returning 404 to user: Instance d5934a78-03a2-4466-8bf0-1574b76428f9 is not attached to volume 8dd967e2-5fa4-4e06-bf96-a97cdf9e2a7d {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:40:51.481838 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-9a057287-cbe9-4112-af24-9a183d8d1779 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] 10.222.0.33 "DELETE /compute/v2.1/servers/d5934a78-03a2-4466-8bf0-1574b76428f9/os-volume_attachments/8dd967e2-5fa4-4e06-bf96-a97cdf9e2a7d" status: 404 len: 154 microversion: 2.1 time: 0.092940 Sep 23 05:40:51.481838 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3927/7673] 10.222.0.33 () {58 vars in 1416 bytes} [Fri Sep 23 05:40:51 2022] DELETE /compute/v2.1/servers/d5934a78-03a2-4466-8bf0-1574b76428f9/os-volume_attachments/8dd967e2-5fa4-4e06-bf96-a97cdf9e2a7d => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 05:40:55.013436 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e43fdb9a-3a73-4338-b3bb-d67a4594619a tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:40:55.014146 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e43fdb9a-3a73-4338-b3bb-d67a4594619a tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] [instance: d5934a78-03a2-4466-8bf0-1574b76428f9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:40:55.021634 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e43fdb9a-3a73-4338-b3bb-d67a4594619a tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:40:55.022167 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e43fdb9a-3a73-4338-b3bb-d67a4594619a tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:40:55.022625 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e43fdb9a-3a73-4338-b3bb-d67a4594619a tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:40:55.023337 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e43fdb9a-3a73-4338-b3bb-d67a4594619a tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:40:55.023838 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e43fdb9a-3a73-4338-b3bb-d67a4594619a tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:40:55.024515 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e43fdb9a-3a73-4338-b3bb-d67a4594619a tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:40:55.050823 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e43fdb9a-3a73-4338-b3bb-d67a4594619a tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] [instance: d5934a78-03a2-4466-8bf0-1574b76428f9] Going to try to terminate instance {{(pid=122698) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 05:40:55.365696 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e43fdb9a-3a73-4338-b3bb-d67a4594619a tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] 10.222.0.33 "DELETE /compute/v2.1/servers/d5934a78-03a2-4466-8bf0-1574b76428f9" status: 204 len: 0 microversion: 2.1 time: 0.356377 Sep 23 05:40:55.366332 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3747/7674] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 05:40:55 2022] DELETE /compute/v2.1/servers/d5934a78-03a2-4466-8bf0-1574b76428f9 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 05:40:55.375066 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-268557d5-c0bc-4e9b-ab85-1667033ba4e8 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:40:55.375726 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-268557d5-c0bc-4e9b-ab85-1667033ba4e8 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] [instance: d5934a78-03a2-4466-8bf0-1574b76428f9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:40:55.382337 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-268557d5-c0bc-4e9b-ab85-1667033ba4e8 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:40:55.382833 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-268557d5-c0bc-4e9b-ab85-1667033ba4e8 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:40:55.383331 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-268557d5-c0bc-4e9b-ab85-1667033ba4e8 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:40:55.384031 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-268557d5-c0bc-4e9b-ab85-1667033ba4e8 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:40:55.384499 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-268557d5-c0bc-4e9b-ab85-1667033ba4e8 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:40:55.384932 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-268557d5-c0bc-4e9b-ab85-1667033ba4e8 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:40:55.521936 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-268557d5-c0bc-4e9b-ab85-1667033ba4e8 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2120ec508557410abc1d13fe13355078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5117afeb2bef4c278a568b425d109a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:40:55.530095 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-268557d5-c0bc-4e9b-ab85-1667033ba4e8 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] 10.222.0.33 "GET /compute/v2.1/servers/d5934a78-03a2-4466-8bf0-1574b76428f9" status: 200 len: 1560 microversion: 2.1 time: 0.159266 Sep 23 05:40:55.530681 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3928/7675] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:40:55 2022] GET /compute/v2.1/servers/d5934a78-03a2-4466-8bf0-1574b76428f9 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:40:56.554648 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-19f68539-f48c-4fc9-9c18-3a57f6a17ddb tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:40:56.555284 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-19f68539-f48c-4fc9-9c18-3a57f6a17ddb tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] [instance: d5934a78-03a2-4466-8bf0-1574b76428f9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:40:56.562227 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-19f68539-f48c-4fc9-9c18-3a57f6a17ddb tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:40:56.562740 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-19f68539-f48c-4fc9-9c18-3a57f6a17ddb tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:40:56.563204 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-19f68539-f48c-4fc9-9c18-3a57f6a17ddb tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:40:56.563919 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-19f68539-f48c-4fc9-9c18-3a57f6a17ddb tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:40:56.564408 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-19f68539-f48c-4fc9-9c18-3a57f6a17ddb tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:40:56.564858 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-19f68539-f48c-4fc9-9c18-3a57f6a17ddb tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:40:56.697294 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-19f68539-f48c-4fc9-9c18-3a57f6a17ddb tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2120ec508557410abc1d13fe13355078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5117afeb2bef4c278a568b425d109a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:40:56.705883 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-19f68539-f48c-4fc9-9c18-3a57f6a17ddb tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] 10.222.0.33 "GET /compute/v2.1/servers/d5934a78-03a2-4466-8bf0-1574b76428f9" status: 200 len: 1560 microversion: 2.1 time: 0.155685 Sep 23 05:40:56.706492 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3748/7676] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:40:56 2022] GET /compute/v2.1/servers/d5934a78-03a2-4466-8bf0-1574b76428f9 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:40:57.416791 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-974a6115-72e3-4bc2-a30c-ab5590cdcaba req-acc8c0ea-ebb3-4917-8cb6-2edf9042c2ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5934a78-03a2-4466-8bf0-1574b76428f9", "name": "network-vif-deleted", "tag": "d6848aa1-d280-487d-ab2b-5b33f4a246b3"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:40:57.426877 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-974a6115-72e3-4bc2-a30c-ab5590cdcaba req-acc8c0ea-ebb3-4917-8cb6-2edf9042c2ba service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:40:57.429971 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-974a6115-72e3-4bc2-a30c-ab5590cdcaba req-acc8c0ea-ebb3-4917-8cb6-2edf9042c2ba service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:40:57.429971 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-974a6115-72e3-4bc2-a30c-ab5590cdcaba req-acc8c0ea-ebb3-4917-8cb6-2edf9042c2ba service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:40:57.439188 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-974a6115-72e3-4bc2-a30c-ab5590cdcaba req-acc8c0ea-ebb3-4917-8cb6-2edf9042c2ba service nova] Creating event network-vif-deleted:d6848aa1-d280-487d-ab2b-5b33f4a246b3 for instance d5934a78-03a2-4466-8bf0-1574b76428f9 on n-h2-846463-3 Sep 23 05:40:57.444148 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-974a6115-72e3-4bc2-a30c-ab5590cdcaba req-acc8c0ea-ebb3-4917-8cb6-2edf9042c2ba service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031195 Sep 23 05:40:57.444733 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3929/7677] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:40:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:40:57.729022 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0579e86b-968b-46d8-b58c-62fa99280f75 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:40:57.730044 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-0579e86b-968b-46d8-b58c-62fa99280f75 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] [instance: d5934a78-03a2-4466-8bf0-1574b76428f9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:40:57.737657 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0579e86b-968b-46d8-b58c-62fa99280f75 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:40:57.738129 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0579e86b-968b-46d8-b58c-62fa99280f75 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:40:57.738597 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0579e86b-968b-46d8-b58c-62fa99280f75 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:40:57.739335 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0579e86b-968b-46d8-b58c-62fa99280f75 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:40:57.739851 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0579e86b-968b-46d8-b58c-62fa99280f75 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:40:57.740310 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0579e86b-968b-46d8-b58c-62fa99280f75 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:40:57.815172 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-0579e86b-968b-46d8-b58c-62fa99280f75 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2120ec508557410abc1d13fe13355078', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5117afeb2bef4c278a568b425d109a6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:40:57.823291 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0579e86b-968b-46d8-b58c-62fa99280f75 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] 10.222.0.33 "GET /compute/v2.1/servers/d5934a78-03a2-4466-8bf0-1574b76428f9" status: 200 len: 1347 microversion: 2.1 time: 0.098404 Sep 23 05:40:57.824107 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3749/7678] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:40:57 2022] GET /compute/v2.1/servers/d5934a78-03a2-4466-8bf0-1574b76428f9 => generated 1347 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:40:58.847427 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-06e289a6-52ab-4cb8-a539-85b497fa9097 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:40:58.848166 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-06e289a6-52ab-4cb8-a539-85b497fa9097 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] [instance: d5934a78-03a2-4466-8bf0-1574b76428f9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:40:58.854397 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-06e289a6-52ab-4cb8-a539-85b497fa9097 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:40:58.854888 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-06e289a6-52ab-4cb8-a539-85b497fa9097 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:40:58.855331 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-06e289a6-52ab-4cb8-a539-85b497fa9097 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:40:58.856023 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-06e289a6-52ab-4cb8-a539-85b497fa9097 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:40:58.856484 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-06e289a6-52ab-4cb8-a539-85b497fa9097 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:40:58.856912 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-06e289a6-52ab-4cb8-a539-85b497fa9097 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:40:58.870013 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-06e289a6-52ab-4cb8-a539-85b497fa9097 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] HTTP exception thrown: Instance d5934a78-03a2-4466-8bf0-1574b76428f9 could not be found. Sep 23 05:40:58.871606 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-06e289a6-52ab-4cb8-a539-85b497fa9097 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Request method failure captured: Sep 23 05:40:58.871606 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/d5934a78-03a2-4466-8bf0-1574b76428f9 HTTP/1.1 Sep 23 05:40:58.871606 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 05:40:58.871606 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 05:40:58.871606 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 05:40:58.871606 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 05:40:58.871606 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 05:40:58.871606 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 05:40:58.871606 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 05:40:58.871606 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 05:40:58.871606 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLUZoO0Zlb5wEJzyWQv_kCFraY7Qaq6MtQjlJhob3FIRPW0M1hjfpK8nHBgkkiisPzLeyiv8DHEeemI6clu4FlfbhG2IPIsyeNdOh80moVQQ5UK7Fa9PsdJsLADEz6AyJokgAYAwFBXENS6OGfLgnoyFcibM-eV_t2QU5NAXt2aq8tSk Sep 23 05:40:58.871606 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 05:40:58.871606 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 05:40:58.871606 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 05:40:58.871606 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 05:40:58.871606 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 05:40:58.871606 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 05:40:58.871606 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 5117afeb2bef4c278a568b425d109a6a Sep 23 05:40:58.871606 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-TestEncryptedCinderVolumes-2079194995 Sep 23 05:40:58.871606 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 05:40:58.871606 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 05:40:58.871606 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5117afeb2bef4c278a568b425d109a6a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5117afeb2bef4c278a568b425d109a6a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5117afeb2bef4c278a568b425d109a6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5117afeb2bef4c278a568b425d109a6a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:40:58.871606 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-TestEncryptedCinderVolumes-2079194995 Sep 23 05:40:58.871606 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 5117afeb2bef4c278a568b425d109a6a Sep 23 05:40:58.871606 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-2079194995 Sep 23 05:40:58.871606 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-TestEncryptedCinderVolumes-2079194995-project Sep 23 05:40:58.871606 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 05:40:58.871606 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 05:40:58.871606 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 2120ec508557410abc1d13fe13355078 Sep 23 05:40:58.871606 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-TestEncryptedCinderVolumes-2079194995-project Sep 23 05:40:58.871606 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 05:40:58.871606 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance d5934a78-03a2-4466-8bf0-1574b76428f9 could not be found. Sep 23 05:40:58.871606 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': 'd5934a78-03a2-4466-8bf0-1574b76428f9'} Sep 23 05:40:58.871606 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:40:58.871606 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:40:58.871606 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 05:40:58.871606 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 05:40:58.871606 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 05:40:58.871606 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 05:40:58.871606 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 05:40:58.871606 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 05:40:58.871606 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 05:40:58.871606 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 05:40:58.871606 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5934a78-03a2-4466-8bf0-1574b76428f9 could not be found. Sep 23 05:40:58.871606 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:40:58.871606 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:40:58.871606 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:40:58.871606 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:40:58.871606 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:40:58.871606 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:40:58.871606 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:40:58.871606 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:40:58.871606 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:40:58.871606 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:40:58.871606 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 05:40:58.871606 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 05:40:58.871606 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 05:40:58.871606 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 05:40:58.871606 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 05:40:58.871606 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:40:58.871606 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5934a78-03a2-4466-8bf0-1574b76428f9 could not be found. Sep 23 05:40:58.871606 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:40:58.871606 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:40:58.877591 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:40:58.877591 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:40:58.877591 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:40:58.877591 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:40:58.877591 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:40:58.877591 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:40:58.877591 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5934a78-03a2-4466-8bf0-1574b76428f9 could not be found. Sep 23 05:40:58.877591 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:40:58.877591 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-06e289a6-52ab-4cb8-a539-85b497fa9097 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Returning 404 to user: Instance d5934a78-03a2-4466-8bf0-1574b76428f9 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:40:58.877591 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-06e289a6-52ab-4cb8-a539-85b497fa9097 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] 10.222.0.33 "GET /compute/v2.1/servers/d5934a78-03a2-4466-8bf0-1574b76428f9" status: 404 len: 111 microversion: 2.1 time: 0.030771 Sep 23 05:40:58.877591 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3930/7679] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:40:58 2022] GET /compute/v2.1/servers/d5934a78-03a2-4466-8bf0-1574b76428f9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 05:40:58.882146 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-af5e4fe6-ba0e-41bf-8a1c-0b7716090c06 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] Calling method '.version_select at 0x7ff1ba9c03a0>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:40:58.968076 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-af5e4fe6-ba0e-41bf-8a1c-0b7716090c06 tempest-TestEncryptedCinderVolumes-2079194995 tempest-TestEncryptedCinderVolumes-2079194995-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-427102665" status: 202 len: 0 microversion: 2.1 time: 0.089744 Sep 23 05:40:58.968689 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3750/7680] 10.222.0.33 () {58 vars in 1275 bytes} [Fri Sep 23 05:40:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-427102665 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 05:41:31.532102 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-343212f2-7b5c-42e1-a1c5-250744e704c2 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Action: 'create', calling method: .version_select at 0x7ff1ba828040>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1674598540", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDxfEmhqYMTj9IpNKW8H5wVgbm+W390p4nXtx/lCfX13OrJEQLiChtB7TXKQ11no8X2ZGnwPvNaydEcBb4J/DxzWJOqOIrU45GiQsHywnIk3RmpxkczO4e4icWrFza5VPg=="}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:41:31.538338 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=14 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:41:31.542813 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=36,nova_cell1:INSERT=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:41:31.549935 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-343212f2-7b5c-42e1-a1c5-250744e704c2 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Getting quotas for project 8f008a7ab34b4a8d956c6200b4adc3ed. Resources: {'key_pairs'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 05:41:31.555889 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-343212f2-7b5c-42e1-a1c5-250744e704c2 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Getting quotas for user 327d75316ac943feafd46049c2267a7e and project 8f008a7ab34b4a8d956c6200b4adc3ed. Resources: {'key_pairs'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 05:41:31.619992 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-343212f2-7b5c-42e1-a1c5-250744e704c2 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.091779 Sep 23 05:41:31.620598 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3931/7681] 10.222.0.33 () {60 vars in 1159 bytes} [Fri Sep 23 05:41:31 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 05:41:31.679633 n-d-846463-3 devstack@n-api.service[122698]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 05:41:31.680140 n-d-846463-3 devstack@n-api.service[122698]: Fri Sep 23 05:41:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.33) !!! Sep 23 05:41:31.681366 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=53,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:41:31.682171 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:41:31.688834 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-cb781ebf-a5b6-44a4-8fa8-dc2247032642 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-721255359", "imageRef": "a4ed1557-b7a6-494f-8aea-87aa656faf1d", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1674598540", "networks": [{"uuid": "33ee7c0d-8bab-41d2-b06c-84a7a76ab5f6"}]}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:41:31.741197 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.network.neutron [None req-cb781ebf-a5b6-44a4-8fa8-dc2247032642 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] validate_networks() for [('33ee7c0d-8bab-41d2-b06c-84a7a76ab5f6', None, None, None, None, None)] {{(pid=122698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 05:41:32.420465 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-cb781ebf-a5b6-44a4-8fa8-dc2247032642 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Flavor limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 05:41:32.420915 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-cb781ebf-a5b6-44a4-8fa8-dc2247032642 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Image limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 05:41:32.421414 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-cb781ebf-a5b6-44a4-8fa8-dc2247032642 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Flavor pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 05:41:32.421844 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-cb781ebf-a5b6-44a4-8fa8-dc2247032642 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Image pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 05:41:32.422303 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-cb781ebf-a5b6-44a4-8fa8-dc2247032642 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 05:41:32.431764 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cb781ebf-a5b6-44a4-8fa8-dc2247032642 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:41:32.432295 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cb781ebf-a5b6-44a4-8fa8-dc2247032642 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:41:32.432744 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cb781ebf-a5b6-44a4-8fa8-dc2247032642 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:41:32.433495 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cb781ebf-a5b6-44a4-8fa8-dc2247032642 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:41:32.434002 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cb781ebf-a5b6-44a4-8fa8-dc2247032642 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:41:32.434453 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cb781ebf-a5b6-44a4-8fa8-dc2247032642 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:41:32.453312 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-cb781ebf-a5b6-44a4-8fa8-dc2247032642 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Getting quotas for project 8f008a7ab34b4a8d956c6200b4adc3ed. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 05:41:32.458904 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-cb781ebf-a5b6-44a4-8fa8-dc2247032642 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Getting quotas for user 327d75316ac943feafd46049c2267a7e and project 8f008a7ab34b4a8d956c6200b4adc3ed. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 05:41:32.472066 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-cb781ebf-a5b6-44a4-8fa8-dc2247032642 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Going to run 1 instances... {{(pid=122698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 05:41:32.474407 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-cb781ebf-a5b6-44a4-8fa8-dc2247032642 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] [instance: 1d7df37d-82e3-4513-b976-cebca6a3e6f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4ed1557-b7a6-494f-8aea-87aa656faf1d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 05:41:32.603933 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-cb781ebf-a5b6-44a4-8fa8-dc2247032642 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.926982 Sep 23 05:41:32.604665 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3751/7682] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 05:41:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 928 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 05:41:32.616120 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-40cfb121-5756-4b98-b893-00957369206c tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:41:32.616722 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-40cfb121-5756-4b98-b893-00957369206c tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] [instance: 1d7df37d-82e3-4513-b976-cebca6a3e6f9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:41:32.672655 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-40cfb121-5756-4b98-b893-00957369206c tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327d75316ac943feafd46049c2267a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f008a7ab34b4a8d956c6200b4adc3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:41:32.679918 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-40cfb121-5756-4b98-b893-00957369206c tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] 10.222.0.33 "GET /compute/v2.1/servers/1d7df37d-82e3-4513-b976-cebca6a3e6f9" status: 200 len: 1258 microversion: 2.1 time: 0.068093 Sep 23 05:41:32.680681 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3932/7683] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:41:32 2022] GET /compute/v2.1/servers/1d7df37d-82e3-4513-b976-cebca6a3e6f9 => generated 1258 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:41:33.704874 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d2543b5b-6e3d-4748-a947-4655b53ba910 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:41:33.705506 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d2543b5b-6e3d-4748-a947-4655b53ba910 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] [instance: 1d7df37d-82e3-4513-b976-cebca6a3e6f9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:41:33.757503 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d2543b5b-6e3d-4748-a947-4655b53ba910 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327d75316ac943feafd46049c2267a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f008a7ab34b4a8d956c6200b4adc3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:41:33.764956 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d2543b5b-6e3d-4748-a947-4655b53ba910 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] 10.222.0.33 "GET /compute/v2.1/servers/1d7df37d-82e3-4513-b976-cebca6a3e6f9" status: 200 len: 1258 microversion: 2.1 time: 0.065317 Sep 23 05:41:33.765994 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3752/7684] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:41:33 2022] GET /compute/v2.1/servers/1d7df37d-82e3-4513-b976-cebca6a3e6f9 => generated 1258 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:41:34.788698 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-81e85500-766c-43d2-bca5-f83d17d87bf7 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:41:34.789220 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-81e85500-766c-43d2-bca5-f83d17d87bf7 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] [instance: 1d7df37d-82e3-4513-b976-cebca6a3e6f9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:41:34.796381 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-81e85500-766c-43d2-bca5-f83d17d87bf7 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:41:34.796877 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-81e85500-766c-43d2-bca5-f83d17d87bf7 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:41:34.797321 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-81e85500-766c-43d2-bca5-f83d17d87bf7 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:41:34.798081 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-81e85500-766c-43d2-bca5-f83d17d87bf7 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:41:34.798549 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-81e85500-766c-43d2-bca5-f83d17d87bf7 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:41:34.798982 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-81e85500-766c-43d2-bca5-f83d17d87bf7 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:41:34.864428 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-81e85500-766c-43d2-bca5-f83d17d87bf7 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327d75316ac943feafd46049c2267a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f008a7ab34b4a8d956c6200b4adc3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:41:34.872283 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-81e85500-766c-43d2-bca5-f83d17d87bf7 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] 10.222.0.33 "GET /compute/v2.1/servers/1d7df37d-82e3-4513-b976-cebca6a3e6f9" status: 200 len: 1310 microversion: 2.1 time: 0.087562 Sep 23 05:41:34.872835 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3933/7685] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:41:34 2022] GET /compute/v2.1/servers/1d7df37d-82e3-4513-b976-cebca6a3e6f9 => generated 1310 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:41:35.896873 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4f1073d3-2431-44b8-837c-508f2d439b0c tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:41:35.898437 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4f1073d3-2431-44b8-837c-508f2d439b0c tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] [instance: 1d7df37d-82e3-4513-b976-cebca6a3e6f9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:41:35.908036 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4f1073d3-2431-44b8-837c-508f2d439b0c tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:41:35.909072 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4f1073d3-2431-44b8-837c-508f2d439b0c tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:41:35.909724 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4f1073d3-2431-44b8-837c-508f2d439b0c tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:41:35.910559 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4f1073d3-2431-44b8-837c-508f2d439b0c tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:41:35.911108 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4f1073d3-2431-44b8-837c-508f2d439b0c tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:41:35.911626 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4f1073d3-2431-44b8-837c-508f2d439b0c tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:41:36.091251 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4f1073d3-2431-44b8-837c-508f2d439b0c tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327d75316ac943feafd46049c2267a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f008a7ab34b4a8d956c6200b4adc3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:41:36.101453 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4f1073d3-2431-44b8-837c-508f2d439b0c tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] 10.222.0.33 "GET /compute/v2.1/servers/1d7df37d-82e3-4513-b976-cebca6a3e6f9" status: 200 len: 1358 microversion: 2.1 time: 0.209605 Sep 23 05:41:36.103229 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3753/7686] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:41:35 2022] GET /compute/v2.1/servers/1d7df37d-82e3-4513-b976-cebca6a3e6f9 => generated 1358 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:41:37.128083 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b84dfc32-664d-4085-a5ab-aef82ce05ffa tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:41:37.128705 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b84dfc32-664d-4085-a5ab-aef82ce05ffa tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] [instance: 1d7df37d-82e3-4513-b976-cebca6a3e6f9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:41:37.135739 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b84dfc32-664d-4085-a5ab-aef82ce05ffa tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:41:37.136238 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b84dfc32-664d-4085-a5ab-aef82ce05ffa tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:41:37.136687 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b84dfc32-664d-4085-a5ab-aef82ce05ffa tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:41:37.138064 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b84dfc32-664d-4085-a5ab-aef82ce05ffa tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:41:37.138533 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b84dfc32-664d-4085-a5ab-aef82ce05ffa tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:41:37.138977 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b84dfc32-664d-4085-a5ab-aef82ce05ffa tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:41:37.277433 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b84dfc32-664d-4085-a5ab-aef82ce05ffa tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327d75316ac943feafd46049c2267a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f008a7ab34b4a8d956c6200b4adc3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:41:37.287012 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b84dfc32-664d-4085-a5ab-aef82ce05ffa tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] 10.222.0.33 "GET /compute/v2.1/servers/1d7df37d-82e3-4513-b976-cebca6a3e6f9" status: 200 len: 1358 microversion: 2.1 time: 0.162956 Sep 23 05:41:37.289399 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3934/7687] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:41:37 2022] GET /compute/v2.1/servers/1d7df37d-82e3-4513-b976-cebca6a3e6f9 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:41:38.310487 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-22d67b95-0e24-4162-8a19-e81475596542 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:41:38.311863 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-22d67b95-0e24-4162-8a19-e81475596542 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] [instance: 1d7df37d-82e3-4513-b976-cebca6a3e6f9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:41:38.319142 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-22d67b95-0e24-4162-8a19-e81475596542 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:41:38.319904 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-22d67b95-0e24-4162-8a19-e81475596542 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:41:38.320588 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-22d67b95-0e24-4162-8a19-e81475596542 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:41:38.321546 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-22d67b95-0e24-4162-8a19-e81475596542 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:41:38.322269 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-22d67b95-0e24-4162-8a19-e81475596542 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:41:38.322950 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-22d67b95-0e24-4162-8a19-e81475596542 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:41:38.481443 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-22d67b95-0e24-4162-8a19-e81475596542 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327d75316ac943feafd46049c2267a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f008a7ab34b4a8d956c6200b4adc3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:41:38.492146 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-22d67b95-0e24-4162-8a19-e81475596542 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] 10.222.0.33 "GET /compute/v2.1/servers/1d7df37d-82e3-4513-b976-cebca6a3e6f9" status: 200 len: 1358 microversion: 2.1 time: 0.185688 Sep 23 05:41:38.493372 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3754/7688] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:41:38 2022] GET /compute/v2.1/servers/1d7df37d-82e3-4513-b976-cebca6a3e6f9 => generated 1358 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:41:39.520985 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-abeaf225-f87b-4e46-a3dd-eab8c1f97289 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:41:39.523407 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-abeaf225-f87b-4e46-a3dd-eab8c1f97289 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] [instance: 1d7df37d-82e3-4513-b976-cebca6a3e6f9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:41:39.531312 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-abeaf225-f87b-4e46-a3dd-eab8c1f97289 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:41:39.531959 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-abeaf225-f87b-4e46-a3dd-eab8c1f97289 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:41:39.532502 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-abeaf225-f87b-4e46-a3dd-eab8c1f97289 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:41:39.533351 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-abeaf225-f87b-4e46-a3dd-eab8c1f97289 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:41:39.533977 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-abeaf225-f87b-4e46-a3dd-eab8c1f97289 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:41:39.534493 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-abeaf225-f87b-4e46-a3dd-eab8c1f97289 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:41:39.677618 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-abeaf225-f87b-4e46-a3dd-eab8c1f97289 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327d75316ac943feafd46049c2267a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f008a7ab34b4a8d956c6200b4adc3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:41:39.686075 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-abeaf225-f87b-4e46-a3dd-eab8c1f97289 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] 10.222.0.33 "GET /compute/v2.1/servers/1d7df37d-82e3-4513-b976-cebca6a3e6f9" status: 200 len: 1358 microversion: 2.1 time: 0.171576 Sep 23 05:41:39.686660 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3935/7689] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:41:39 2022] GET /compute/v2.1/servers/1d7df37d-82e3-4513-b976-cebca6a3e6f9 => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:41:40.710161 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-55a6ded2-f9ea-4029-94a2-49ae4e3ce06f tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:41:40.710814 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-55a6ded2-f9ea-4029-94a2-49ae4e3ce06f tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] [instance: 1d7df37d-82e3-4513-b976-cebca6a3e6f9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:41:40.719129 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-55a6ded2-f9ea-4029-94a2-49ae4e3ce06f tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:41:40.719736 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-55a6ded2-f9ea-4029-94a2-49ae4e3ce06f tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:41:40.720344 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-55a6ded2-f9ea-4029-94a2-49ae4e3ce06f tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:41:40.721165 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-55a6ded2-f9ea-4029-94a2-49ae4e3ce06f tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:41:40.721707 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-55a6ded2-f9ea-4029-94a2-49ae4e3ce06f tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:41:40.722251 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-55a6ded2-f9ea-4029-94a2-49ae4e3ce06f tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:41:40.869999 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-55a6ded2-f9ea-4029-94a2-49ae4e3ce06f tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327d75316ac943feafd46049c2267a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f008a7ab34b4a8d956c6200b4adc3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:41:40.878985 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-55a6ded2-f9ea-4029-94a2-49ae4e3ce06f tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] 10.222.0.33 "GET /compute/v2.1/servers/1d7df37d-82e3-4513-b976-cebca6a3e6f9" status: 200 len: 1358 microversion: 2.1 time: 0.172918 Sep 23 05:41:40.879594 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3755/7690] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:41:40 2022] GET /compute/v2.1/servers/1d7df37d-82e3-4513-b976-cebca6a3e6f9 => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:41:41.904697 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6709560e-9990-40c9-b844-f6d99ad689bb tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:41:41.905518 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-6709560e-9990-40c9-b844-f6d99ad689bb tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] [instance: 1d7df37d-82e3-4513-b976-cebca6a3e6f9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:41:41.912740 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6709560e-9990-40c9-b844-f6d99ad689bb tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:41:41.913348 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6709560e-9990-40c9-b844-f6d99ad689bb tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:41:41.913928 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6709560e-9990-40c9-b844-f6d99ad689bb tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:41:41.914678 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6709560e-9990-40c9-b844-f6d99ad689bb tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:41:41.915237 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6709560e-9990-40c9-b844-f6d99ad689bb tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:41:41.915741 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6709560e-9990-40c9-b844-f6d99ad689bb tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:41:42.051595 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-6709560e-9990-40c9-b844-f6d99ad689bb tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327d75316ac943feafd46049c2267a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f008a7ab34b4a8d956c6200b4adc3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:41:42.060172 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6709560e-9990-40c9-b844-f6d99ad689bb tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] 10.222.0.33 "GET /compute/v2.1/servers/1d7df37d-82e3-4513-b976-cebca6a3e6f9" status: 200 len: 1358 microversion: 2.1 time: 0.159382 Sep 23 05:41:42.074168 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3936/7691] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:41:41 2022] GET /compute/v2.1/servers/1d7df37d-82e3-4513-b976-cebca6a3e6f9 => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:41:43.084999 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a076c6d4-f12e-4df9-804d-a9b010bc7f6c tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:41:43.085769 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a076c6d4-f12e-4df9-804d-a9b010bc7f6c tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] [instance: 1d7df37d-82e3-4513-b976-cebca6a3e6f9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:41:43.088600 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:41:43.093814 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a076c6d4-f12e-4df9-804d-a9b010bc7f6c tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:41:43.094458 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a076c6d4-f12e-4df9-804d-a9b010bc7f6c tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:41:43.094919 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a076c6d4-f12e-4df9-804d-a9b010bc7f6c tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:41:43.095648 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a076c6d4-f12e-4df9-804d-a9b010bc7f6c tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:41:43.096131 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a076c6d4-f12e-4df9-804d-a9b010bc7f6c tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:41:43.096581 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a076c6d4-f12e-4df9-804d-a9b010bc7f6c tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:41:43.231324 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a076c6d4-f12e-4df9-804d-a9b010bc7f6c tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327d75316ac943feafd46049c2267a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f008a7ab34b4a8d956c6200b4adc3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:41:43.239422 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a076c6d4-f12e-4df9-804d-a9b010bc7f6c tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] 10.222.0.33 "GET /compute/v2.1/servers/1d7df37d-82e3-4513-b976-cebca6a3e6f9" status: 200 len: 1358 microversion: 2.1 time: 0.158356 Sep 23 05:41:43.240387 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3756/7692] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:41:43 2022] GET /compute/v2.1/servers/1d7df37d-82e3-4513-b976-cebca6a3e6f9 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:41:43.755858 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-6d49e16a-1372-404f-be65-0d4c9e7bffc8 req-e36cbfff-340a-4242-9b15-7cb8add88ace service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d7df37d-82e3-4513-b976-cebca6a3e6f9", "tag": "7eea5c5a-90e2-49d5-98d0-d9760f94be16"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:41:43.762203 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=6 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:41:43.767680 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-6d49e16a-1372-404f-be65-0d4c9e7bffc8 req-e36cbfff-340a-4242-9b15-7cb8add88ace service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:41:43.768206 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-6d49e16a-1372-404f-be65-0d4c9e7bffc8 req-e36cbfff-340a-4242-9b15-7cb8add88ace service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:41:43.768642 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-6d49e16a-1372-404f-be65-0d4c9e7bffc8 req-e36cbfff-340a-4242-9b15-7cb8add88ace service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:41:43.780234 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-6d49e16a-1372-404f-be65-0d4c9e7bffc8 req-e36cbfff-340a-4242-9b15-7cb8add88ace service nova] Creating event network-changed:7eea5c5a-90e2-49d5-98d0-d9760f94be16 for instance 1d7df37d-82e3-4513-b976-cebca6a3e6f9 on n-h1-846463-3 Sep 23 05:41:43.785748 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-6d49e16a-1372-404f-be65-0d4c9e7bffc8 req-e36cbfff-340a-4242-9b15-7cb8add88ace service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033450 Sep 23 05:41:43.790763 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3937/7693] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:41:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:41:44.263593 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-bb943919-77f4-4ed5-9cfa-56cac996b758 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:41:44.264062 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-bb943919-77f4-4ed5-9cfa-56cac996b758 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] [instance: 1d7df37d-82e3-4513-b976-cebca6a3e6f9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:41:44.266417 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=8 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:41:44.272060 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bb943919-77f4-4ed5-9cfa-56cac996b758 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:41:44.278826 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bb943919-77f4-4ed5-9cfa-56cac996b758 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:41:44.278826 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bb943919-77f4-4ed5-9cfa-56cac996b758 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:41:44.278826 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bb943919-77f4-4ed5-9cfa-56cac996b758 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:41:44.278826 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bb943919-77f4-4ed5-9cfa-56cac996b758 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:41:44.278826 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bb943919-77f4-4ed5-9cfa-56cac996b758 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:41:44.417007 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-bb943919-77f4-4ed5-9cfa-56cac996b758 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327d75316ac943feafd46049c2267a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f008a7ab34b4a8d956c6200b4adc3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:41:44.424646 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-bb943919-77f4-4ed5-9cfa-56cac996b758 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] 10.222.0.33 "GET /compute/v2.1/servers/1d7df37d-82e3-4513-b976-cebca6a3e6f9" status: 200 len: 1358 microversion: 2.1 time: 0.165665 Sep 23 05:41:44.425220 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3757/7694] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:41:44 2022] GET /compute/v2.1/servers/1d7df37d-82e3-4513-b976-cebca6a3e6f9 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:41:45.448053 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a61d6154-f292-4555-9f70-2a95728d1f45 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:41:45.448786 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a61d6154-f292-4555-9f70-2a95728d1f45 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] [instance: 1d7df37d-82e3-4513-b976-cebca6a3e6f9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:41:45.455936 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a61d6154-f292-4555-9f70-2a95728d1f45 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:41:45.457965 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a61d6154-f292-4555-9f70-2a95728d1f45 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:41:45.457965 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a61d6154-f292-4555-9f70-2a95728d1f45 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:41:45.457965 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a61d6154-f292-4555-9f70-2a95728d1f45 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:41:45.458271 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a61d6154-f292-4555-9f70-2a95728d1f45 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:41:45.458460 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a61d6154-f292-4555-9f70-2a95728d1f45 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:41:45.586093 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a61d6154-f292-4555-9f70-2a95728d1f45 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327d75316ac943feafd46049c2267a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f008a7ab34b4a8d956c6200b4adc3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:41:45.594487 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a61d6154-f292-4555-9f70-2a95728d1f45 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] 10.222.0.33 "GET /compute/v2.1/servers/1d7df37d-82e3-4513-b976-cebca6a3e6f9" status: 200 len: 1358 microversion: 2.1 time: 0.150701 Sep 23 05:41:45.595541 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3938/7695] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:41:45 2022] GET /compute/v2.1/servers/1d7df37d-82e3-4513-b976-cebca6a3e6f9 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:41:46.618270 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-565a3100-927b-4993-bf69-79a69039363b tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:41:46.618911 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-565a3100-927b-4993-bf69-79a69039363b tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] [instance: 1d7df37d-82e3-4513-b976-cebca6a3e6f9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:41:46.626451 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-565a3100-927b-4993-bf69-79a69039363b tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:41:46.626963 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-565a3100-927b-4993-bf69-79a69039363b tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:41:46.627430 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-565a3100-927b-4993-bf69-79a69039363b tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:41:46.628143 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-565a3100-927b-4993-bf69-79a69039363b tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:41:46.628627 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-565a3100-927b-4993-bf69-79a69039363b tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:41:46.629078 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-565a3100-927b-4993-bf69-79a69039363b tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:41:46.783003 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-565a3100-927b-4993-bf69-79a69039363b tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327d75316ac943feafd46049c2267a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f008a7ab34b4a8d956c6200b4adc3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:41:46.792567 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-565a3100-927b-4993-bf69-79a69039363b tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] 10.222.0.33 "GET /compute/v2.1/servers/1d7df37d-82e3-4513-b976-cebca6a3e6f9" status: 200 len: 1358 microversion: 2.1 time: 0.178154 Sep 23 05:41:46.793287 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3758/7696] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:41:46 2022] GET /compute/v2.1/servers/1d7df37d-82e3-4513-b976-cebca6a3e6f9 => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:41:47.817649 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e6c90417-0316-4901-b606-33b0d372dbad tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:41:47.818237 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e6c90417-0316-4901-b606-33b0d372dbad tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] [instance: 1d7df37d-82e3-4513-b976-cebca6a3e6f9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:41:47.824707 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e6c90417-0316-4901-b606-33b0d372dbad tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:41:47.825796 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e6c90417-0316-4901-b606-33b0d372dbad tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:41:47.826366 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e6c90417-0316-4901-b606-33b0d372dbad tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:41:47.833080 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e6c90417-0316-4901-b606-33b0d372dbad tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:41:47.833080 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e6c90417-0316-4901-b606-33b0d372dbad tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:41:47.833080 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e6c90417-0316-4901-b606-33b0d372dbad tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:41:47.955489 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e6c90417-0316-4901-b606-33b0d372dbad tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327d75316ac943feafd46049c2267a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f008a7ab34b4a8d956c6200b4adc3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:41:47.963337 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e6c90417-0316-4901-b606-33b0d372dbad tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] 10.222.0.33 "GET /compute/v2.1/servers/1d7df37d-82e3-4513-b976-cebca6a3e6f9" status: 200 len: 1358 microversion: 2.1 time: 0.149693 Sep 23 05:41:47.963917 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3939/7697] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:41:47 2022] GET /compute/v2.1/servers/1d7df37d-82e3-4513-b976-cebca6a3e6f9 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:41:48.985803 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ea0c2242-ccf5-4aae-9424-54413e3b5387 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:41:48.986406 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-ea0c2242-ccf5-4aae-9424-54413e3b5387 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] [instance: 1d7df37d-82e3-4513-b976-cebca6a3e6f9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:41:48.993379 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ea0c2242-ccf5-4aae-9424-54413e3b5387 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:41:48.993906 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ea0c2242-ccf5-4aae-9424-54413e3b5387 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:41:48.994387 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ea0c2242-ccf5-4aae-9424-54413e3b5387 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:41:48.995114 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ea0c2242-ccf5-4aae-9424-54413e3b5387 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:41:48.995617 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ea0c2242-ccf5-4aae-9424-54413e3b5387 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:41:48.996069 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ea0c2242-ccf5-4aae-9424-54413e3b5387 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:41:49.128135 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ea0c2242-ccf5-4aae-9424-54413e3b5387 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327d75316ac943feafd46049c2267a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f008a7ab34b4a8d956c6200b4adc3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:41:49.136201 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ea0c2242-ccf5-4aae-9424-54413e3b5387 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] 10.222.0.33 "GET /compute/v2.1/servers/1d7df37d-82e3-4513-b976-cebca6a3e6f9" status: 200 len: 1358 microversion: 2.1 time: 0.154346 Sep 23 05:41:49.136860 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3759/7698] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:41:48 2022] GET /compute/v2.1/servers/1d7df37d-82e3-4513-b976-cebca6a3e6f9 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:41:49.233129 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-61fedf4c-765a-4a9f-9eb4-08c3266b7268 req-9f2ffd0a-8746-4ec1-998c-3782da31f9f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d7df37d-82e3-4513-b976-cebca6a3e6f9", "name": "network-vif-plugged", "status": "completed", "tag": "7eea5c5a-90e2-49d5-98d0-d9760f94be16"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:41:49.243380 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-61fedf4c-765a-4a9f-9eb4-08c3266b7268 req-9f2ffd0a-8746-4ec1-998c-3782da31f9f7 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:41:49.243873 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-61fedf4c-765a-4a9f-9eb4-08c3266b7268 req-9f2ffd0a-8746-4ec1-998c-3782da31f9f7 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:41:49.244312 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-61fedf4c-765a-4a9f-9eb4-08c3266b7268 req-9f2ffd0a-8746-4ec1-998c-3782da31f9f7 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:41:49.255830 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-61fedf4c-765a-4a9f-9eb4-08c3266b7268 req-9f2ffd0a-8746-4ec1-998c-3782da31f9f7 service nova] Creating event network-vif-plugged:7eea5c5a-90e2-49d5-98d0-d9760f94be16 for instance 1d7df37d-82e3-4513-b976-cebca6a3e6f9 on n-h1-846463-3 Sep 23 05:41:49.260769 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-61fedf4c-765a-4a9f-9eb4-08c3266b7268 req-9f2ffd0a-8746-4ec1-998c-3782da31f9f7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031425 Sep 23 05:41:49.262039 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3940/7699] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:41:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:41:50.159629 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1fda5e7a-51ce-41dd-925c-921790b4e13e tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:41:50.160263 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-1fda5e7a-51ce-41dd-925c-921790b4e13e tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] [instance: 1d7df37d-82e3-4513-b976-cebca6a3e6f9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:41:50.167227 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1fda5e7a-51ce-41dd-925c-921790b4e13e tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:41:50.167736 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1fda5e7a-51ce-41dd-925c-921790b4e13e tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:41:50.168199 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1fda5e7a-51ce-41dd-925c-921790b4e13e tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:41:50.168962 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1fda5e7a-51ce-41dd-925c-921790b4e13e tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:41:50.169448 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1fda5e7a-51ce-41dd-925c-921790b4e13e tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:41:50.169916 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1fda5e7a-51ce-41dd-925c-921790b4e13e tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:41:50.298721 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-1fda5e7a-51ce-41dd-925c-921790b4e13e tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327d75316ac943feafd46049c2267a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f008a7ab34b4a8d956c6200b4adc3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:41:50.306397 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-1fda5e7a-51ce-41dd-925c-921790b4e13e tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] 10.222.0.33 "GET /compute/v2.1/servers/1d7df37d-82e3-4513-b976-cebca6a3e6f9" status: 200 len: 1358 microversion: 2.1 time: 0.150710 Sep 23 05:41:50.306982 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3760/7700] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:41:50 2022] GET /compute/v2.1/servers/1d7df37d-82e3-4513-b976-cebca6a3e6f9 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:41:51.329922 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8e9ed35f-fcab-4e54-97e5-5b05a5475b92 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:41:51.330403 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-8e9ed35f-fcab-4e54-97e5-5b05a5475b92 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] [instance: 1d7df37d-82e3-4513-b976-cebca6a3e6f9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:41:51.336749 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8e9ed35f-fcab-4e54-97e5-5b05a5475b92 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:41:51.337237 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8e9ed35f-fcab-4e54-97e5-5b05a5475b92 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:41:51.337688 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8e9ed35f-fcab-4e54-97e5-5b05a5475b92 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:41:51.338405 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8e9ed35f-fcab-4e54-97e5-5b05a5475b92 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:41:51.338869 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8e9ed35f-fcab-4e54-97e5-5b05a5475b92 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:41:51.339330 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8e9ed35f-fcab-4e54-97e5-5b05a5475b92 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:41:51.467714 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-8e9ed35f-fcab-4e54-97e5-5b05a5475b92 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327d75316ac943feafd46049c2267a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f008a7ab34b4a8d956c6200b4adc3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:41:51.475781 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-8e9ed35f-fcab-4e54-97e5-5b05a5475b92 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] 10.222.0.33 "GET /compute/v2.1/servers/1d7df37d-82e3-4513-b976-cebca6a3e6f9" status: 200 len: 1548 microversion: 2.1 time: 0.150936 Sep 23 05:41:51.476360 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3941/7701] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:41:51 2022] GET /compute/v2.1/servers/1d7df37d-82e3-4513-b976-cebca6a3e6f9 => generated 1548 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:41:51.498432 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4b23255b-472b-4db0-94bf-08123964da80 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:41:51.499098 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4b23255b-472b-4db0-94bf-08123964da80 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] [instance: 1d7df37d-82e3-4513-b976-cebca6a3e6f9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:41:51.506034 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4b23255b-472b-4db0-94bf-08123964da80 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:41:51.506549 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4b23255b-472b-4db0-94bf-08123964da80 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:41:51.507012 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4b23255b-472b-4db0-94bf-08123964da80 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:41:51.507727 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4b23255b-472b-4db0-94bf-08123964da80 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:41:51.508208 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4b23255b-472b-4db0-94bf-08123964da80 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:41:51.508654 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4b23255b-472b-4db0-94bf-08123964da80 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:41:51.646093 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4b23255b-472b-4db0-94bf-08123964da80 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327d75316ac943feafd46049c2267a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f008a7ab34b4a8d956c6200b4adc3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:41:51.654589 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4b23255b-472b-4db0-94bf-08123964da80 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] 10.222.0.33 "GET /compute/v2.1/servers/1d7df37d-82e3-4513-b976-cebca6a3e6f9" status: 200 len: 1548 microversion: 2.1 time: 0.160032 Sep 23 05:41:51.655178 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3761/7702] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:41:51 2022] GET /compute/v2.1/servers/1d7df37d-82e3-4513-b976-cebca6a3e6f9 => generated 1548 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:41:51.676316 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ba9b4ea8-30ae-42a5-95aa-155ef4f40898 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:41:51.681029 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ba9b4ea8-30ae-42a5-95aa-155ef4f40898 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '327d75316ac943feafd46049c2267a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f008a7ab34b4a8d956c6200b4adc3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:41:51.681791 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ba9b4ea8-30ae-42a5-95aa-155ef4f40898 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Searching by: {'deleted': False, 'project_id': '8f008a7ab34b4a8d956c6200b4adc3ed'} {{(pid=122699) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 05:41:51.687128 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ba9b4ea8-30ae-42a5-95aa-155ef4f40898 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:41:51.687871 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ba9b4ea8-30ae-42a5-95aa-155ef4f40898 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:41:51.688672 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ba9b4ea8-30ae-42a5-95aa-155ef4f40898 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:41:51.689682 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ba9b4ea8-30ae-42a5-95aa-155ef4f40898 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:41:51.690172 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ba9b4ea8-30ae-42a5-95aa-155ef4f40898 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:41:51.690603 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ba9b4ea8-30ae-42a5-95aa-155ef4f40898 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:41:51.718864 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.multi_cell_list [None req-ba9b4ea8-30ae-42a5-95aa-155ef4f40898 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122699) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 23 05:41:51.744555 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ba9b4ea8-30ae-42a5-95aa-155ef4f40898 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.072085 Sep 23 05:41:51.745137 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3942/7703] 10.222.0.33 () {58 vars in 1125 bytes} [Fri Sep 23 05:41:51 2022] GET /compute/v2.1/servers => generated 342 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:41:51.756786 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-552d53be-b038-4990-ba95-00164c0f8623 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:41:51.757422 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-552d53be-b038-4990-ba95-00164c0f8623 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] [instance: 1d7df37d-82e3-4513-b976-cebca6a3e6f9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:41:51.764122 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-552d53be-b038-4990-ba95-00164c0f8623 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:41:51.764629 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-552d53be-b038-4990-ba95-00164c0f8623 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:41:51.765084 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-552d53be-b038-4990-ba95-00164c0f8623 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:41:51.766096 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-552d53be-b038-4990-ba95-00164c0f8623 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:41:51.766572 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-552d53be-b038-4990-ba95-00164c0f8623 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:41:51.767013 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-552d53be-b038-4990-ba95-00164c0f8623 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:41:51.894162 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-552d53be-b038-4990-ba95-00164c0f8623 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327d75316ac943feafd46049c2267a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f008a7ab34b4a8d956c6200b4adc3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:41:51.902689 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-552d53be-b038-4990-ba95-00164c0f8623 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] 10.222.0.33 "GET /compute/v2.1/servers/1d7df37d-82e3-4513-b976-cebca6a3e6f9" status: 200 len: 1548 microversion: 2.1 time: 0.149860 Sep 23 05:41:51.904157 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3762/7704] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:41:51 2022] GET /compute/v2.1/servers/1d7df37d-82e3-4513-b976-cebca6a3e6f9 => generated 1548 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:41:54.904879 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-75ac8fd4-0b6b-4fa3-a453-313fadcae62e tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d90185f5-1e60-4823-97c6-42196a06947a"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:41:54.907978 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-75ac8fd4-0b6b-4fa3-a453-313fadcae62e tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] [instance: 1d7df37d-82e3-4513-b976-cebca6a3e6f9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:41:54.914536 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-75ac8fd4-0b6b-4fa3-a453-313fadcae62e tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:41:54.915024 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-75ac8fd4-0b6b-4fa3-a453-313fadcae62e tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:41:54.915473 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-75ac8fd4-0b6b-4fa3-a453-313fadcae62e tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:41:54.916171 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-75ac8fd4-0b6b-4fa3-a453-313fadcae62e tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:41:54.916638 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-75ac8fd4-0b6b-4fa3-a453-313fadcae62e tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:41:54.917078 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-75ac8fd4-0b6b-4fa3-a453-313fadcae62e tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:41:55.663025 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-75ac8fd4-0b6b-4fa3-a453-313fadcae62e tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] 10.222.0.33 "POST /compute/v2.1/servers/1d7df37d-82e3-4513-b976-cebca6a3e6f9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.761552 Sep 23 05:41:55.663653 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3943/7705] 10.222.0.33 () {60 vars in 1323 bytes} [Fri Sep 23 05:41:54 2022] POST /compute/v2.1/servers/1d7df37d-82e3-4513-b976-cebca6a3e6f9/os-volume_attachments => generated 194 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:42:10.065919 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f94d97cb-898f-4946-b27c-17a1402e28f0 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:42:10.069693 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f94d97cb-898f-4946-b27c-17a1402e28f0 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] [instance: 1d7df37d-82e3-4513-b976-cebca6a3e6f9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:42:10.069693 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:42:10.069693 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=62 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:42:10.074364 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f94d97cb-898f-4946-b27c-17a1402e28f0 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:42:10.074863 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f94d97cb-898f-4946-b27c-17a1402e28f0 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:42:10.075341 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f94d97cb-898f-4946-b27c-17a1402e28f0 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:42:10.076633 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f94d97cb-898f-4946-b27c-17a1402e28f0 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:42:10.077104 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f94d97cb-898f-4946-b27c-17a1402e28f0 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:42:10.077542 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f94d97cb-898f-4946-b27c-17a1402e28f0 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:42:10.211070 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f94d97cb-898f-4946-b27c-17a1402e28f0 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327d75316ac943feafd46049c2267a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f008a7ab34b4a8d956c6200b4adc3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:42:10.219522 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f94d97cb-898f-4946-b27c-17a1402e28f0 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] 10.222.0.33 "GET /compute/v2.1/servers/1d7df37d-82e3-4513-b976-cebca6a3e6f9" status: 200 len: 1594 microversion: 2.1 time: 0.157459 Sep 23 05:42:10.220103 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3763/7706] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:42:10 2022] GET /compute/v2.1/servers/1d7df37d-82e3-4513-b976-cebca6a3e6f9 => generated 1594 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:42:12.181661 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:42:12.182972 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:42:12.184028 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:42:12.348563 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-c6d1a267-0a27-4b28-9deb-5d41412d70fe req-ecb8e855-3968-4e1a-aea5-94c4bfdcf01e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d7df37d-82e3-4513-b976-cebca6a3e6f9", "tag": "7eea5c5a-90e2-49d5-98d0-d9760f94be16"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:42:12.359734 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-c6d1a267-0a27-4b28-9deb-5d41412d70fe req-ecb8e855-3968-4e1a-aea5-94c4bfdcf01e service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:42:12.360223 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-c6d1a267-0a27-4b28-9deb-5d41412d70fe req-ecb8e855-3968-4e1a-aea5-94c4bfdcf01e service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:42:12.361681 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-c6d1a267-0a27-4b28-9deb-5d41412d70fe req-ecb8e855-3968-4e1a-aea5-94c4bfdcf01e service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:42:12.372306 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-c6d1a267-0a27-4b28-9deb-5d41412d70fe req-ecb8e855-3968-4e1a-aea5-94c4bfdcf01e service nova] Creating event network-changed:7eea5c5a-90e2-49d5-98d0-d9760f94be16 for instance 1d7df37d-82e3-4513-b976-cebca6a3e6f9 on n-h1-846463-3 Sep 23 05:42:12.377791 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-c6d1a267-0a27-4b28-9deb-5d41412d70fe req-ecb8e855-3968-4e1a-aea5-94c4bfdcf01e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.197950 Sep 23 05:42:12.378572 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3944/7707] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:42:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:42:14.560587 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-cf5c3bd5-4398-4f59-bb23-9cc56dbc5c12 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2051935108"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:42:14.561145 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-cf5c3bd5-4398-4f59-bb23-9cc56dbc5c12 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] [instance: 1d7df37d-82e3-4513-b976-cebca6a3e6f9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:42:14.568112 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cf5c3bd5-4398-4f59-bb23-9cc56dbc5c12 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:42:14.568609 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cf5c3bd5-4398-4f59-bb23-9cc56dbc5c12 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:42:14.569059 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cf5c3bd5-4398-4f59-bb23-9cc56dbc5c12 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:42:14.569771 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cf5c3bd5-4398-4f59-bb23-9cc56dbc5c12 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:42:14.570256 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cf5c3bd5-4398-4f59-bb23-9cc56dbc5c12 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:42:14.570696 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cf5c3bd5-4398-4f59-bb23-9cc56dbc5c12 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:42:14.695286 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.network.security_group_api [None req-cf5c3bd5-4398-4f59-bb23-9cc56dbc5c12 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Adding security group be8c369a-6e51-4002-bc26-662a76b2b8ee to port 7eea5c5a-90e2-49d5-98d0-d9760f94be16 Sep 23 05:42:15.064212 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-cf5c3bd5-4398-4f59-bb23-9cc56dbc5c12 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] 10.222.0.33 "POST /compute/v2.1/servers/1d7df37d-82e3-4513-b976-cebca6a3e6f9/action" status: 202 len: 0 microversion: 2.1 time: 0.508105 Sep 23 05:42:15.064856 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3764/7708] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 05:42:14 2022] POST /compute/v2.1/servers/1d7df37d-82e3-4513-b976-cebca6a3e6f9/action => generated 0 bytes in 509 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 05:42:15.073882 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-0d6f6da3-9cb2-41d7-ab21-ba29842d06ec req-d2ee79b7-1f6b-4ab8-9e39-809b02475dbe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d7df37d-82e3-4513-b976-cebca6a3e6f9", "tag": "7eea5c5a-90e2-49d5-98d0-d9760f94be16"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:42:15.074449 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f79a7bbe-68f4-440c-9d1b-f58b4b83e039 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:42:15.074813 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f79a7bbe-68f4-440c-9d1b-f58b4b83e039 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] [instance: 1d7df37d-82e3-4513-b976-cebca6a3e6f9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:42:15.085582 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f79a7bbe-68f4-440c-9d1b-f58b4b83e039 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:42:15.095224 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f79a7bbe-68f4-440c-9d1b-f58b4b83e039 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:42:15.095402 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-0d6f6da3-9cb2-41d7-ab21-ba29842d06ec req-d2ee79b7-1f6b-4ab8-9e39-809b02475dbe service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:42:15.095509 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f79a7bbe-68f4-440c-9d1b-f58b4b83e039 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:42:15.095758 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-0d6f6da3-9cb2-41d7-ab21-ba29842d06ec req-d2ee79b7-1f6b-4ab8-9e39-809b02475dbe service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:42:15.095758 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-0d6f6da3-9cb2-41d7-ab21-ba29842d06ec req-d2ee79b7-1f6b-4ab8-9e39-809b02475dbe service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:42:15.095934 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f79a7bbe-68f4-440c-9d1b-f58b4b83e039 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:42:15.095934 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f79a7bbe-68f4-440c-9d1b-f58b4b83e039 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:42:15.095934 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f79a7bbe-68f4-440c-9d1b-f58b4b83e039 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:42:15.101495 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-0d6f6da3-9cb2-41d7-ab21-ba29842d06ec req-d2ee79b7-1f6b-4ab8-9e39-809b02475dbe service nova] Creating event network-changed:7eea5c5a-90e2-49d5-98d0-d9760f94be16 for instance 1d7df37d-82e3-4513-b976-cebca6a3e6f9 on n-h1-846463-3 Sep 23 05:42:15.110627 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-0d6f6da3-9cb2-41d7-ab21-ba29842d06ec req-d2ee79b7-1f6b-4ab8-9e39-809b02475dbe service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041162 Sep 23 05:42:15.111270 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3945/7709] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:42:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 05:42:15.271157 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f79a7bbe-68f4-440c-9d1b-f58b4b83e039 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327d75316ac943feafd46049c2267a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f008a7ab34b4a8d956c6200b4adc3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:42:15.282774 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f79a7bbe-68f4-440c-9d1b-f58b4b83e039 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] 10.222.0.33 "GET /compute/v2.1/servers/1d7df37d-82e3-4513-b976-cebca6a3e6f9" status: 200 len: 1759 microversion: 2.1 time: 0.212227 Sep 23 05:42:15.285930 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3765/7710] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:42:15 2022] GET /compute/v2.1/servers/1d7df37d-82e3-4513-b976-cebca6a3e6f9 => generated 1759 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:43:47.141749 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=4 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:43:47.143181 n-d-846463-3 devstack@n-api.service[122699]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 05:43:47.143362 n-d-846463-3 devstack@n-api.service[122699]: Fri Sep 23 05:43:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1d7df37d-82e3-4513-b976-cebca6a3e6f9/action (ip 10.222.0.33) !!! Sep 23 05:43:47.144725 n-d-846463-3 devstack@n-api.service[122699]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 23 05:43:47.144871 n-d-846463-3 devstack@n-api.service[122699]: Fri Sep 23 05:43:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1d7df37d-82e3-4513-b976-cebca6a3e6f9/action (ip 10.222.0.33) !!! Sep 23 05:43:47.149375 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1c727610-c86f-4722-a477-13ae60f3160d tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:43:47.151702 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1c727610-c86f-4722-a477-13ae60f3160d tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] [instance: 1d7df37d-82e3-4513-b976-cebca6a3e6f9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:43:47.162165 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1c727610-c86f-4722-a477-13ae60f3160d tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:43:47.162660 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1c727610-c86f-4722-a477-13ae60f3160d tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:43:47.163102 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1c727610-c86f-4722-a477-13ae60f3160d tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:43:47.163881 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1c727610-c86f-4722-a477-13ae60f3160d tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:43:47.164319 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1c727610-c86f-4722-a477-13ae60f3160d tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:43:47.164704 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1c727610-c86f-4722-a477-13ae60f3160d tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:43:47.370047 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1c727610-c86f-4722-a477-13ae60f3160d tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] 10.222.0.33 "POST /compute/v2.1/servers/1d7df37d-82e3-4513-b976-cebca6a3e6f9/action" status: 202 len: 0 microversion: 2.1 time: 0.230019 Sep 23 05:43:47.371036 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3946/7711] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 05:43:47 2022] POST /compute/v2.1/servers/1d7df37d-82e3-4513-b976-cebca6a3e6f9/action => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 05:43:47.377601 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=6 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:43:47.378421 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=16 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:43:47.379286 n-d-846463-3 devstack@n-api.service[122698]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 05:43:47.379548 n-d-846463-3 devstack@n-api.service[122698]: Fri Sep 23 05:43:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1d7df37d-82e3-4513-b976-cebca6a3e6f9 (ip 10.222.0.33) !!! Sep 23 05:43:47.380678 n-d-846463-3 devstack@n-api.service[122698]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 05:43:47.380839 n-d-846463-3 devstack@n-api.service[122698]: Fri Sep 23 05:43:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1d7df37d-82e3-4513-b976-cebca6a3e6f9 (ip 10.222.0.33) !!! Sep 23 05:43:47.385734 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-edcfe930-b15f-4d71-bc92-14eb060d98a9 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:43:47.386402 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-edcfe930-b15f-4d71-bc92-14eb060d98a9 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] [instance: 1d7df37d-82e3-4513-b976-cebca6a3e6f9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:43:47.402270 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-edcfe930-b15f-4d71-bc92-14eb060d98a9 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:43:47.402779 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-edcfe930-b15f-4d71-bc92-14eb060d98a9 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:43:47.403241 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-edcfe930-b15f-4d71-bc92-14eb060d98a9 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:43:47.403958 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-edcfe930-b15f-4d71-bc92-14eb060d98a9 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:43:47.404437 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-edcfe930-b15f-4d71-bc92-14eb060d98a9 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:43:47.404879 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-edcfe930-b15f-4d71-bc92-14eb060d98a9 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:43:47.559663 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-edcfe930-b15f-4d71-bc92-14eb060d98a9 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327d75316ac943feafd46049c2267a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f008a7ab34b4a8d956c6200b4adc3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:43:47.568844 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-edcfe930-b15f-4d71-bc92-14eb060d98a9 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] 10.222.0.33 "GET /compute/v2.1/servers/1d7df37d-82e3-4513-b976-cebca6a3e6f9" status: 200 len: 1761 microversion: 2.1 time: 0.193835 Sep 23 05:43:47.569692 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3766/7712] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:43:47 2022] GET /compute/v2.1/servers/1d7df37d-82e3-4513-b976-cebca6a3e6f9 => generated 1761 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:43:48.593787 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4bf46cfc-551e-4448-a417-d5215115efc3 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:43:48.594473 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4bf46cfc-551e-4448-a417-d5215115efc3 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] [instance: 1d7df37d-82e3-4513-b976-cebca6a3e6f9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:43:48.601408 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4bf46cfc-551e-4448-a417-d5215115efc3 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:43:48.601916 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4bf46cfc-551e-4448-a417-d5215115efc3 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:43:48.602382 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4bf46cfc-551e-4448-a417-d5215115efc3 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:43:48.603087 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4bf46cfc-551e-4448-a417-d5215115efc3 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:43:48.603548 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4bf46cfc-551e-4448-a417-d5215115efc3 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:43:48.603977 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4bf46cfc-551e-4448-a417-d5215115efc3 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:43:48.748998 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-4bf46cfc-551e-4448-a417-d5215115efc3 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327d75316ac943feafd46049c2267a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f008a7ab34b4a8d956c6200b4adc3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:43:48.757282 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4bf46cfc-551e-4448-a417-d5215115efc3 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] 10.222.0.33 "GET /compute/v2.1/servers/1d7df37d-82e3-4513-b976-cebca6a3e6f9" status: 200 len: 1759 microversion: 2.1 time: 0.168355 Sep 23 05:43:48.757850 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3947/7713] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:43:48 2022] GET /compute/v2.1/servers/1d7df37d-82e3-4513-b976-cebca6a3e6f9 => generated 1759 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:45:01.654055 n-d-846463-3 devstack@n-api.service[122698]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2416b61d-0aee-4a62-9508-aa1fc06b9213] AMQP server on 10.222.0.33:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 23 05:45:01.655204 n-d-846463-3 devstack@n-api.service[122698]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f191bc7a-c250-407c-bbf3-646bef550c22] AMQP server on 10.222.0.33:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 23 05:45:01.655731 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:45:01.656497 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=6 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:45:01.660497 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-729ecf21-ad42-4bd7-94e7-a16cc767a200 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2051935108"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:45:01.661093 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-729ecf21-ad42-4bd7-94e7-a16cc767a200 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] [instance: 1d7df37d-82e3-4513-b976-cebca6a3e6f9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:45:01.667408 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-729ecf21-ad42-4bd7-94e7-a16cc767a200 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:45:01.667920 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-729ecf21-ad42-4bd7-94e7-a16cc767a200 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:45:01.668382 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-729ecf21-ad42-4bd7-94e7-a16cc767a200 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:45:01.669098 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-729ecf21-ad42-4bd7-94e7-a16cc767a200 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:45:01.669591 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-729ecf21-ad42-4bd7-94e7-a16cc767a200 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:45:01.670084 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-729ecf21-ad42-4bd7-94e7-a16cc767a200 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:45:01.852207 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.network.security_group_api [None req-729ecf21-ad42-4bd7-94e7-a16cc767a200 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Removing security group be8c369a-6e51-4002-bc26-662a76b2b8ee from port 7eea5c5a-90e2-49d5-98d0-d9760f94be16 Sep 23 05:45:02.236760 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-729ecf21-ad42-4bd7-94e7-a16cc767a200 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] 10.222.0.33 "POST /compute/v2.1/servers/1d7df37d-82e3-4513-b976-cebca6a3e6f9/action" status: 202 len: 0 microversion: 2.1 time: 0.584398 Sep 23 05:45:02.240696 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3767/7714] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 05:45:01 2022] POST /compute/v2.1/servers/1d7df37d-82e3-4513-b976-cebca6a3e6f9/action => generated 0 bytes in 586 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 05:45:02.242800 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=4 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:45:02.243574 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=20,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:45:02.247479 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-ee90d160-5c3b-494d-8262-4520caf4c9fd req-71f552ee-015c-4032-ae45-ae4aadcf421f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d7df37d-82e3-4513-b976-cebca6a3e6f9", "tag": "7eea5c5a-90e2-49d5-98d0-d9760f94be16"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:45:02.257652 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-ee90d160-5c3b-494d-8262-4520caf4c9fd req-71f552ee-015c-4032-ae45-ae4aadcf421f service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:45:02.258165 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-ee90d160-5c3b-494d-8262-4520caf4c9fd req-71f552ee-015c-4032-ae45-ae4aadcf421f service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:45:02.258605 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-ee90d160-5c3b-494d-8262-4520caf4c9fd req-71f552ee-015c-4032-ae45-ae4aadcf421f service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:45:02.271931 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-ee90d160-5c3b-494d-8262-4520caf4c9fd req-71f552ee-015c-4032-ae45-ae4aadcf421f service nova] Creating event network-changed:7eea5c5a-90e2-49d5-98d0-d9760f94be16 for instance 1d7df37d-82e3-4513-b976-cebca6a3e6f9 on n-h1-846463-3 Sep 23 05:45:02.277093 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-ee90d160-5c3b-494d-8262-4520caf4c9fd req-71f552ee-015c-4032-ae45-ae4aadcf421f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036148 Sep 23 05:45:02.277857 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3948/7715] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:45:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 05:45:03.822604 n-d-846463-3 devstack@n-api.service[122698]: INFO oslo.messaging._drivers.impl_rabbit [-] [f191bc7a-c250-407c-bbf3-646bef550c22] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 54448. Sep 23 05:45:03.827296 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7ace4963-f7ba-4872-a2e3-7fdad23a9e02 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:45:03.828035 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7ace4963-f7ba-4872-a2e3-7fdad23a9e02 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] [instance: 1d7df37d-82e3-4513-b976-cebca6a3e6f9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:45:03.837078 n-d-846463-3 devstack@n-api.service[122698]: INFO oslo.messaging._drivers.impl_rabbit [-] [2416b61d-0aee-4a62-9508-aa1fc06b9213] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 54446. Sep 23 05:45:03.843094 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7ace4963-f7ba-4872-a2e3-7fdad23a9e02 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:45:03.843609 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7ace4963-f7ba-4872-a2e3-7fdad23a9e02 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:45:03.844072 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7ace4963-f7ba-4872-a2e3-7fdad23a9e02 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:45:03.844811 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7ace4963-f7ba-4872-a2e3-7fdad23a9e02 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:45:03.845292 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7ace4963-f7ba-4872-a2e3-7fdad23a9e02 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:45:03.845746 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7ace4963-f7ba-4872-a2e3-7fdad23a9e02 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:45:03.927643 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-7ace4963-f7ba-4872-a2e3-7fdad23a9e02 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lazy-loading 'services' on Instance uuid 1d7df37d-82e3-4513-b976-cebca6a3e6f9 {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 05:45:04.132225 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7ace4963-f7ba-4872-a2e3-7fdad23a9e02 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] 10.222.0.33 "DELETE /compute/v2.1/servers/1d7df37d-82e3-4513-b976-cebca6a3e6f9/os-volume_attachments/d90185f5-1e60-4823-97c6-42196a06947a" status: 202 len: 0 microversion: 2.1 time: 0.319894 Sep 23 05:45:04.135054 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3768/7716] 10.222.0.33 () {58 vars in 1416 bytes} [Fri Sep 23 05:45:03 2022] DELETE /compute/v2.1/servers/1d7df37d-82e3-4513-b976-cebca6a3e6f9/os-volume_attachments/d90185f5-1e60-4823-97c6-42196a06947a => generated 0 bytes in 324 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 05:45:04.141872 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8c3a263e-ced3-4d0f-81fe-c49c60d10f7a tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:45:04.145240 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-8c3a263e-ced3-4d0f-81fe-c49c60d10f7a tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] [instance: 1d7df37d-82e3-4513-b976-cebca6a3e6f9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:45:04.153914 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8c3a263e-ced3-4d0f-81fe-c49c60d10f7a tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:45:04.154403 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8c3a263e-ced3-4d0f-81fe-c49c60d10f7a tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:45:04.154846 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8c3a263e-ced3-4d0f-81fe-c49c60d10f7a tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:45:04.155551 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8c3a263e-ced3-4d0f-81fe-c49c60d10f7a tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:45:04.156011 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8c3a263e-ced3-4d0f-81fe-c49c60d10f7a tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:45:04.156440 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8c3a263e-ced3-4d0f-81fe-c49c60d10f7a tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:45:04.187539 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-8c3a263e-ced3-4d0f-81fe-c49c60d10f7a tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] 10.222.0.33 "GET /compute/v2.1/servers/1d7df37d-82e3-4513-b976-cebca6a3e6f9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049870 Sep 23 05:45:04.188124 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3949/7717] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Sep 23 05:45:04 2022] GET /compute/v2.1/servers/1d7df37d-82e3-4513-b976-cebca6a3e6f9/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:45:04.297569 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-cbf8824e-e125-46dc-a795-7a25b26613f6 req-29305669-937c-42ec-9f1f-13f9d6b2b43e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d7df37d-82e3-4513-b976-cebca6a3e6f9", "tag": "7eea5c5a-90e2-49d5-98d0-d9760f94be16"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:45:04.309563 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-cbf8824e-e125-46dc-a795-7a25b26613f6 req-29305669-937c-42ec-9f1f-13f9d6b2b43e service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:45:04.310163 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-cbf8824e-e125-46dc-a795-7a25b26613f6 req-29305669-937c-42ec-9f1f-13f9d6b2b43e service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:45:04.310682 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-cbf8824e-e125-46dc-a795-7a25b26613f6 req-29305669-937c-42ec-9f1f-13f9d6b2b43e service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:45:04.322494 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-cbf8824e-e125-46dc-a795-7a25b26613f6 req-29305669-937c-42ec-9f1f-13f9d6b2b43e service nova] Creating event network-changed:7eea5c5a-90e2-49d5-98d0-d9760f94be16 for instance 1d7df37d-82e3-4513-b976-cebca6a3e6f9 on n-h1-846463-3 Sep 23 05:45:04.328051 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-cbf8824e-e125-46dc-a795-7a25b26613f6 req-29305669-937c-42ec-9f1f-13f9d6b2b43e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036085 Sep 23 05:45:04.329222 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3769/7718] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:45:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:45:05.199969 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-514b589b-aae2-4466-8225-e39eac424be9 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:45:05.202193 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-514b589b-aae2-4466-8225-e39eac424be9 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] [instance: 1d7df37d-82e3-4513-b976-cebca6a3e6f9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:45:05.209838 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-514b589b-aae2-4466-8225-e39eac424be9 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:45:05.210361 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-514b589b-aae2-4466-8225-e39eac424be9 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:45:05.210805 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-514b589b-aae2-4466-8225-e39eac424be9 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:45:05.211511 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-514b589b-aae2-4466-8225-e39eac424be9 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:45:05.211975 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-514b589b-aae2-4466-8225-e39eac424be9 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:45:05.212457 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-514b589b-aae2-4466-8225-e39eac424be9 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:45:05.243115 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-514b589b-aae2-4466-8225-e39eac424be9 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] 10.222.0.33 "GET /compute/v2.1/servers/1d7df37d-82e3-4513-b976-cebca6a3e6f9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047112 Sep 23 05:45:05.243697 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3950/7719] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Sep 23 05:45:05 2022] GET /compute/v2.1/servers/1d7df37d-82e3-4513-b976-cebca6a3e6f9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:45:06.257326 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-485c4efb-9891-4fdc-be91-5ef4298619b2 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:45:06.259960 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-485c4efb-9891-4fdc-be91-5ef4298619b2 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] [instance: 1d7df37d-82e3-4513-b976-cebca6a3e6f9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:45:06.266746 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-485c4efb-9891-4fdc-be91-5ef4298619b2 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:45:06.267267 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-485c4efb-9891-4fdc-be91-5ef4298619b2 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:45:06.267732 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-485c4efb-9891-4fdc-be91-5ef4298619b2 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:45:06.268760 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-485c4efb-9891-4fdc-be91-5ef4298619b2 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:45:06.269245 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-485c4efb-9891-4fdc-be91-5ef4298619b2 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:45:06.269693 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-485c4efb-9891-4fdc-be91-5ef4298619b2 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:45:06.303781 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-485c4efb-9891-4fdc-be91-5ef4298619b2 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] 10.222.0.33 "GET /compute/v2.1/servers/1d7df37d-82e3-4513-b976-cebca6a3e6f9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051678 Sep 23 05:45:06.304385 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3770/7720] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Sep 23 05:45:06 2022] GET /compute/v2.1/servers/1d7df37d-82e3-4513-b976-cebca6a3e6f9/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:45:07.316327 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-af72e292-4dd6-4927-b984-8b452113599f tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:45:07.319181 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-af72e292-4dd6-4927-b984-8b452113599f tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] [instance: 1d7df37d-82e3-4513-b976-cebca6a3e6f9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:45:07.326659 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-af72e292-4dd6-4927-b984-8b452113599f tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:45:07.327163 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-af72e292-4dd6-4927-b984-8b452113599f tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:45:07.327610 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-af72e292-4dd6-4927-b984-8b452113599f tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:45:07.328320 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-af72e292-4dd6-4927-b984-8b452113599f tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:45:07.328785 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-af72e292-4dd6-4927-b984-8b452113599f tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:45:07.329267 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-af72e292-4dd6-4927-b984-8b452113599f tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:45:07.361124 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-af72e292-4dd6-4927-b984-8b452113599f tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] 10.222.0.33 "GET /compute/v2.1/servers/1d7df37d-82e3-4513-b976-cebca6a3e6f9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048888 Sep 23 05:45:07.361692 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3951/7721] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Sep 23 05:45:07 2022] GET /compute/v2.1/servers/1d7df37d-82e3-4513-b976-cebca6a3e6f9/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:45:08.373815 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9d77a0ef-07e8-4857-8ccd-cacbe8d8d0e7 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:45:08.376101 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-9d77a0ef-07e8-4857-8ccd-cacbe8d8d0e7 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] [instance: 1d7df37d-82e3-4513-b976-cebca6a3e6f9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:45:08.383098 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9d77a0ef-07e8-4857-8ccd-cacbe8d8d0e7 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:45:08.383604 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9d77a0ef-07e8-4857-8ccd-cacbe8d8d0e7 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:45:08.384059 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9d77a0ef-07e8-4857-8ccd-cacbe8d8d0e7 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:45:08.384809 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9d77a0ef-07e8-4857-8ccd-cacbe8d8d0e7 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:45:08.385284 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9d77a0ef-07e8-4857-8ccd-cacbe8d8d0e7 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:45:08.385731 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9d77a0ef-07e8-4857-8ccd-cacbe8d8d0e7 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:45:08.415777 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9d77a0ef-07e8-4857-8ccd-cacbe8d8d0e7 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] 10.222.0.33 "GET /compute/v2.1/servers/1d7df37d-82e3-4513-b976-cebca6a3e6f9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045983 Sep 23 05:45:08.416346 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3771/7722] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Sep 23 05:45:08 2022] GET /compute/v2.1/servers/1d7df37d-82e3-4513-b976-cebca6a3e6f9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:45:09.429041 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-89ab30f5-10d3-4b37-9739-b609c09ecc51 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:45:09.431280 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-89ab30f5-10d3-4b37-9739-b609c09ecc51 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] [instance: 1d7df37d-82e3-4513-b976-cebca6a3e6f9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:45:09.437715 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-89ab30f5-10d3-4b37-9739-b609c09ecc51 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:45:09.438246 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-89ab30f5-10d3-4b37-9739-b609c09ecc51 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:45:09.438696 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-89ab30f5-10d3-4b37-9739-b609c09ecc51 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:45:09.439392 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-89ab30f5-10d3-4b37-9739-b609c09ecc51 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:45:09.439859 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-89ab30f5-10d3-4b37-9739-b609c09ecc51 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:45:09.440290 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-89ab30f5-10d3-4b37-9739-b609c09ecc51 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:45:09.468996 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-89ab30f5-10d3-4b37-9739-b609c09ecc51 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] 10.222.0.33 "GET /compute/v2.1/servers/1d7df37d-82e3-4513-b976-cebca6a3e6f9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044564 Sep 23 05:45:09.469551 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3952/7723] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Sep 23 05:45:09 2022] GET /compute/v2.1/servers/1d7df37d-82e3-4513-b976-cebca6a3e6f9/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 05:45:09.480075 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-53e9dfa4-5e20-4974-bd20-73c1955965ec tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:45:09.480599 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-53e9dfa4-5e20-4974-bd20-73c1955965ec tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] [instance: 1d7df37d-82e3-4513-b976-cebca6a3e6f9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:45:09.487350 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-53e9dfa4-5e20-4974-bd20-73c1955965ec tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:45:09.487850 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-53e9dfa4-5e20-4974-bd20-73c1955965ec tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:45:09.488303 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-53e9dfa4-5e20-4974-bd20-73c1955965ec tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:45:09.489003 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-53e9dfa4-5e20-4974-bd20-73c1955965ec tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:45:09.489477 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-53e9dfa4-5e20-4974-bd20-73c1955965ec tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:45:09.490461 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-53e9dfa4-5e20-4974-bd20-73c1955965ec tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:45:09.564551 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-53e9dfa4-5e20-4974-bd20-73c1955965ec tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] HTTP exception thrown: Instance 1d7df37d-82e3-4513-b976-cebca6a3e6f9 is not attached to volume d90185f5-1e60-4823-97c6-42196a06947a Sep 23 05:45:09.566205 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-53e9dfa4-5e20-4974-bd20-73c1955965ec tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Request method failure captured: Sep 23 05:45:09.566205 n-d-846463-3 devstack@n-api.service[122698]: request: DELETE /compute/v2.1/servers/1d7df37d-82e3-4513-b976-cebca6a3e6f9/os-volume_attachments/d90185f5-1e60-4823-97c6-42196a06947a HTTP/1.1 Sep 23 05:45:09.566205 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 05:45:09.566205 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 05:45:09.566205 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 05:45:09.566205 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 05:45:09.566205 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 05:45:09.566205 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 05:45:09.566205 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 05:45:09.566205 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 05:45:09.566205 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLUb5WPCRrxt-pjo0wq3llkI2HedrkywOSh1wcJZCpDrqfJyBF9ombOvpKlEA9l1PT53t7j9CxSnG4wj4CsqwqgTeL-DZFkf8i38QVFN14bko1kEeUCJJeuOTaTpU9f3RhBv2GaI1r0NmzPN2GiYMG-Q1LSsW9v2AzawKnWKP1U9ZKzw Sep 23 05:45:09.566205 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 05:45:09.566205 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 05:45:09.566205 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 05:45:09.566205 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 05:45:09.566205 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 05:45:09.566205 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 05:45:09.566205 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 8f008a7ab34b4a8d956c6200b4adc3ed Sep 23 05:45:09.566205 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-TestMinimumBasicScenario-561736272 Sep 23 05:45:09.566205 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 05:45:09.566205 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 05:45:09.566205 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8f008a7ab34b4a8d956c6200b4adc3ed", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8f008a7ab34b4a8d956c6200b4adc3ed"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8f008a7ab34b4a8d956c6200b4adc3ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8f008a7ab34b4a8d956c6200b4adc3ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:45:09.566205 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-TestMinimumBasicScenario-561736272 Sep 23 05:45:09.566205 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 8f008a7ab34b4a8d956c6200b4adc3ed Sep 23 05:45:09.566205 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-TestMinimumBasicScenario-561736272 Sep 23 05:45:09.566205 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-TestMinimumBasicScenario-561736272-project Sep 23 05:45:09.566205 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 05:45:09.566205 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 05:45:09.566205 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 327d75316ac943feafd46049c2267a7e Sep 23 05:45:09.566205 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-TestMinimumBasicScenario-561736272-project Sep 23 05:45:09.566205 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 05:45:09.566205 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 1d7df37d-82e3-4513-b976-cebca6a3e6f9 is not attached to volume d90185f5-1e60-4823-97c6-42196a06947a Sep 23 05:45:09.566205 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'server_id': '1d7df37d-82e3-4513-b976-cebca6a3e6f9', 'id': 'd90185f5-1e60-4823-97c6-42196a06947a'} Sep 23 05:45:09.566205 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:45:09.566205 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:45:09.566205 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 23 05:45:09.566205 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 23 05:45:09.566205 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 05:45:09.566205 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 05:45:09.566205 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 23 05:45:09.566205 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 23 05:45:09.566205 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id d90185f5-1e60-4823-97c6-42196a06947a. Sep 23 05:45:09.566205 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:45:09.566205 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:45:09.566205 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:45:09.566205 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:45:09.566205 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:45:09.566205 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:45:09.566205 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:45:09.566205 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:45:09.566205 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:45:09.566205 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:45:09.566205 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 23 05:45:09.566205 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 23 05:45:09.566205 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d7df37d-82e3-4513-b976-cebca6a3e6f9 is not attached to volume d90185f5-1e60-4823-97c6-42196a06947a Sep 23 05:45:09.566205 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:45:09.566205 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:45:09.566205 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:45:09.566205 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:45:09.566205 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:45:09.566205 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:45:09.572067 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:45:09.572067 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:45:09.572067 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d7df37d-82e3-4513-b976-cebca6a3e6f9 is not attached to volume d90185f5-1e60-4823-97c6-42196a06947a Sep 23 05:45:09.572067 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:45:09.572067 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-53e9dfa4-5e20-4974-bd20-73c1955965ec tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Returning 404 to user: Instance 1d7df37d-82e3-4513-b976-cebca6a3e6f9 is not attached to volume d90185f5-1e60-4823-97c6-42196a06947a {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:45:09.572067 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-53e9dfa4-5e20-4974-bd20-73c1955965ec tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] 10.222.0.33 "DELETE /compute/v2.1/servers/1d7df37d-82e3-4513-b976-cebca6a3e6f9/os-volume_attachments/d90185f5-1e60-4823-97c6-42196a06947a" status: 404 len: 154 microversion: 2.1 time: 0.091596 Sep 23 05:45:09.572067 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3772/7724] 10.222.0.33 () {58 vars in 1416 bytes} [Fri Sep 23 05:45:09 2022] DELETE /compute/v2.1/servers/1d7df37d-82e3-4513-b976-cebca6a3e6f9/os-volume_attachments/d90185f5-1e60-4823-97c6-42196a06947a => generated 154 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 05:45:12.925938 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-392059b6-1b21-4bc6-8573-903093f02711 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:45:12.926578 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-392059b6-1b21-4bc6-8573-903093f02711 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] [instance: 1d7df37d-82e3-4513-b976-cebca6a3e6f9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:45:12.933877 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-392059b6-1b21-4bc6-8573-903093f02711 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:45:12.934401 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-392059b6-1b21-4bc6-8573-903093f02711 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:45:12.934845 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-392059b6-1b21-4bc6-8573-903093f02711 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:45:12.935549 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-392059b6-1b21-4bc6-8573-903093f02711 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:45:12.936012 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-392059b6-1b21-4bc6-8573-903093f02711 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:45:12.936444 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-392059b6-1b21-4bc6-8573-903093f02711 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:45:12.961987 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-392059b6-1b21-4bc6-8573-903093f02711 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] [instance: 1d7df37d-82e3-4513-b976-cebca6a3e6f9] Going to try to terminate instance {{(pid=122699) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 05:45:13.215595 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-392059b6-1b21-4bc6-8573-903093f02711 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] 10.222.0.33 "DELETE /compute/v2.1/servers/1d7df37d-82e3-4513-b976-cebca6a3e6f9" status: 204 len: 0 microversion: 2.1 time: 0.293205 Sep 23 05:45:13.216183 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3953/7725] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 05:45:12 2022] DELETE /compute/v2.1/servers/1d7df37d-82e3-4513-b976-cebca6a3e6f9 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 23 05:45:13.225115 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-75f312e4-53fd-441c-972b-7fcd73dc08b4 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:45:13.225757 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-75f312e4-53fd-441c-972b-7fcd73dc08b4 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] [instance: 1d7df37d-82e3-4513-b976-cebca6a3e6f9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:45:13.233129 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-75f312e4-53fd-441c-972b-7fcd73dc08b4 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:45:13.233646 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-75f312e4-53fd-441c-972b-7fcd73dc08b4 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:45:13.234143 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-75f312e4-53fd-441c-972b-7fcd73dc08b4 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:45:13.234865 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-75f312e4-53fd-441c-972b-7fcd73dc08b4 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:45:13.235344 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-75f312e4-53fd-441c-972b-7fcd73dc08b4 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:45:13.236095 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-75f312e4-53fd-441c-972b-7fcd73dc08b4 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:45:13.368722 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-75f312e4-53fd-441c-972b-7fcd73dc08b4 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327d75316ac943feafd46049c2267a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f008a7ab34b4a8d956c6200b4adc3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:45:13.376659 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-75f312e4-53fd-441c-972b-7fcd73dc08b4 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] 10.222.0.33 "GET /compute/v2.1/servers/1d7df37d-82e3-4513-b976-cebca6a3e6f9" status: 200 len: 1554 microversion: 2.1 time: 0.156031 Sep 23 05:45:13.377233 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3773/7726] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:45:13 2022] GET /compute/v2.1/servers/1d7df37d-82e3-4513-b976-cebca6a3e6f9 => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:45:14.400573 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-cb868da5-6a36-4ad9-97e0-a73b56ae161b tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:45:14.401286 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-cb868da5-6a36-4ad9-97e0-a73b56ae161b tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] [instance: 1d7df37d-82e3-4513-b976-cebca6a3e6f9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:45:14.407753 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cb868da5-6a36-4ad9-97e0-a73b56ae161b tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:45:14.408246 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cb868da5-6a36-4ad9-97e0-a73b56ae161b tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:45:14.408688 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cb868da5-6a36-4ad9-97e0-a73b56ae161b tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:45:14.409386 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cb868da5-6a36-4ad9-97e0-a73b56ae161b tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:45:14.409844 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cb868da5-6a36-4ad9-97e0-a73b56ae161b tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:45:14.410302 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cb868da5-6a36-4ad9-97e0-a73b56ae161b tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:45:14.590587 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-cb868da5-6a36-4ad9-97e0-a73b56ae161b tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327d75316ac943feafd46049c2267a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f008a7ab34b4a8d956c6200b4adc3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:45:14.598412 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-cb868da5-6a36-4ad9-97e0-a73b56ae161b tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] 10.222.0.33 "GET /compute/v2.1/servers/1d7df37d-82e3-4513-b976-cebca6a3e6f9" status: 200 len: 1554 microversion: 2.1 time: 0.202227 Sep 23 05:45:14.598989 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3954/7727] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:45:14 2022] GET /compute/v2.1/servers/1d7df37d-82e3-4513-b976-cebca6a3e6f9 => generated 1554 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:45:15.417497 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-c82c5a5c-ba22-4a6e-8894-fd52cbbc28be req-34974ad8-ce0b-4972-8a33-7b4d9975d7e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d7df37d-82e3-4513-b976-cebca6a3e6f9", "name": "network-vif-deleted", "tag": "7eea5c5a-90e2-49d5-98d0-d9760f94be16"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:45:15.428888 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-c82c5a5c-ba22-4a6e-8894-fd52cbbc28be req-34974ad8-ce0b-4972-8a33-7b4d9975d7e6 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:45:15.429392 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-c82c5a5c-ba22-4a6e-8894-fd52cbbc28be req-34974ad8-ce0b-4972-8a33-7b4d9975d7e6 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:45:15.429844 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-c82c5a5c-ba22-4a6e-8894-fd52cbbc28be req-34974ad8-ce0b-4972-8a33-7b4d9975d7e6 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:45:15.442235 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-c82c5a5c-ba22-4a6e-8894-fd52cbbc28be req-34974ad8-ce0b-4972-8a33-7b4d9975d7e6 service nova] Creating event network-vif-deleted:7eea5c5a-90e2-49d5-98d0-d9760f94be16 for instance 1d7df37d-82e3-4513-b976-cebca6a3e6f9 on n-h1-846463-3 Sep 23 05:45:15.448133 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-c82c5a5c-ba22-4a6e-8894-fd52cbbc28be req-34974ad8-ce0b-4972-8a33-7b4d9975d7e6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093093 Sep 23 05:45:15.449730 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3774/7728] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:45:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:45:15.623242 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6f3e3182-3c7e-4ba7-82b7-5c8c9bc4f848 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:45:15.623931 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-6f3e3182-3c7e-4ba7-82b7-5c8c9bc4f848 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] [instance: 1d7df37d-82e3-4513-b976-cebca6a3e6f9] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:45:15.631020 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6f3e3182-3c7e-4ba7-82b7-5c8c9bc4f848 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:45:15.631529 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6f3e3182-3c7e-4ba7-82b7-5c8c9bc4f848 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:45:15.631979 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6f3e3182-3c7e-4ba7-82b7-5c8c9bc4f848 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:45:15.632703 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6f3e3182-3c7e-4ba7-82b7-5c8c9bc4f848 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:45:15.633168 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6f3e3182-3c7e-4ba7-82b7-5c8c9bc4f848 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:45:15.633590 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6f3e3182-3c7e-4ba7-82b7-5c8c9bc4f848 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:45:15.666274 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6f3e3182-3c7e-4ba7-82b7-5c8c9bc4f848 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:45:15.666743 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6f3e3182-3c7e-4ba7-82b7-5c8c9bc4f848 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:45:15.667199 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6f3e3182-3c7e-4ba7-82b7-5c8c9bc4f848 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:45:15.667637 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-6f3e3182-3c7e-4ba7-82b7-5c8c9bc4f848 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lazy-loading 'fault' on Instance uuid 1d7df37d-82e3-4513-b976-cebca6a3e6f9 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 05:45:15.712225 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-6f3e3182-3c7e-4ba7-82b7-5c8c9bc4f848 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327d75316ac943feafd46049c2267a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f008a7ab34b4a8d956c6200b4adc3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:45:15.722744 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6f3e3182-3c7e-4ba7-82b7-5c8c9bc4f848 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] 10.222.0.33 "GET /compute/v2.1/servers/1d7df37d-82e3-4513-b976-cebca6a3e6f9" status: 200 len: 1348 microversion: 2.1 time: 0.104060 Sep 23 05:45:15.730142 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3955/7729] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:45:15 2022] GET /compute/v2.1/servers/1d7df37d-82e3-4513-b976-cebca6a3e6f9 => generated 1348 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:45:16.753101 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-caf123ed-1ee0-4dc6-810e-0353990d097d tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:45:16.753831 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-caf123ed-1ee0-4dc6-810e-0353990d097d tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] [instance: 1d7df37d-82e3-4513-b976-cebca6a3e6f9] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:45:16.761431 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-caf123ed-1ee0-4dc6-810e-0353990d097d tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:45:16.761977 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-caf123ed-1ee0-4dc6-810e-0353990d097d tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:45:16.762444 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-caf123ed-1ee0-4dc6-810e-0353990d097d tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:45:16.763163 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-caf123ed-1ee0-4dc6-810e-0353990d097d tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:45:16.763638 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-caf123ed-1ee0-4dc6-810e-0353990d097d tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:45:16.764086 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-caf123ed-1ee0-4dc6-810e-0353990d097d tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:45:16.778548 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-caf123ed-1ee0-4dc6-810e-0353990d097d tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] HTTP exception thrown: Instance 1d7df37d-82e3-4513-b976-cebca6a3e6f9 could not be found. Sep 23 05:45:16.780244 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-caf123ed-1ee0-4dc6-810e-0353990d097d tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Request method failure captured: Sep 23 05:45:16.780244 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/1d7df37d-82e3-4513-b976-cebca6a3e6f9 HTTP/1.1 Sep 23 05:45:16.780244 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 05:45:16.780244 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 05:45:16.780244 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 05:45:16.780244 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 05:45:16.780244 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 05:45:16.780244 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 05:45:16.780244 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 05:45:16.780244 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 05:45:16.780244 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLUb5WPCRrxt-pjo0wq3llkI2HedrkywOSh1wcJZCpDrqfJyBF9ombOvpKlEA9l1PT53t7j9CxSnG4wj4CsqwqgTeL-DZFkf8i38QVFN14bko1kEeUCJJeuOTaTpU9f3RhBv2GaI1r0NmzPN2GiYMG-Q1LSsW9v2AzawKnWKP1U9ZKzw Sep 23 05:45:16.780244 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 05:45:16.780244 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 05:45:16.780244 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 05:45:16.780244 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 05:45:16.780244 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 05:45:16.780244 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 05:45:16.780244 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 8f008a7ab34b4a8d956c6200b4adc3ed Sep 23 05:45:16.780244 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-TestMinimumBasicScenario-561736272 Sep 23 05:45:16.780244 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 05:45:16.780244 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 05:45:16.780244 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8f008a7ab34b4a8d956c6200b4adc3ed", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8f008a7ab34b4a8d956c6200b4adc3ed"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8f008a7ab34b4a8d956c6200b4adc3ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8f008a7ab34b4a8d956c6200b4adc3ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:45:16.780244 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-TestMinimumBasicScenario-561736272 Sep 23 05:45:16.780244 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 8f008a7ab34b4a8d956c6200b4adc3ed Sep 23 05:45:16.780244 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-TestMinimumBasicScenario-561736272 Sep 23 05:45:16.780244 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-TestMinimumBasicScenario-561736272-project Sep 23 05:45:16.780244 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 05:45:16.780244 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 05:45:16.780244 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 327d75316ac943feafd46049c2267a7e Sep 23 05:45:16.780244 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-TestMinimumBasicScenario-561736272-project Sep 23 05:45:16.780244 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 05:45:16.780244 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 1d7df37d-82e3-4513-b976-cebca6a3e6f9 could not be found. Sep 23 05:45:16.780244 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '1d7df37d-82e3-4513-b976-cebca6a3e6f9'} Sep 23 05:45:16.780244 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:45:16.780244 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:45:16.780244 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 05:45:16.780244 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 05:45:16.780244 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 05:45:16.780244 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 05:45:16.780244 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 05:45:16.780244 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 05:45:16.780244 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 05:45:16.780244 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 05:45:16.780244 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d7df37d-82e3-4513-b976-cebca6a3e6f9 could not be found. Sep 23 05:45:16.780244 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:45:16.780244 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:45:16.780244 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:45:16.780244 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:45:16.780244 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:45:16.780244 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:45:16.780244 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:45:16.780244 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:45:16.780244 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:45:16.780244 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:45:16.780244 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 05:45:16.780244 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 05:45:16.780244 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 05:45:16.780244 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 05:45:16.780244 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 05:45:16.780244 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:45:16.780244 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d7df37d-82e3-4513-b976-cebca6a3e6f9 could not be found. Sep 23 05:45:16.780244 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:45:16.780244 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:45:16.780244 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:45:16.785601 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:45:16.785601 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:45:16.785601 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:45:16.785601 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:45:16.785601 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:45:16.785601 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d7df37d-82e3-4513-b976-cebca6a3e6f9 could not be found. Sep 23 05:45:16.785601 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:45:16.785601 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-caf123ed-1ee0-4dc6-810e-0353990d097d tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Returning 404 to user: Instance 1d7df37d-82e3-4513-b976-cebca6a3e6f9 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:45:16.785601 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-caf123ed-1ee0-4dc6-810e-0353990d097d tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] 10.222.0.33 "GET /compute/v2.1/servers/1d7df37d-82e3-4513-b976-cebca6a3e6f9" status: 404 len: 111 microversion: 2.1 time: 0.033163 Sep 23 05:45:16.788645 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3775/7730] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:45:16 2022] GET /compute/v2.1/servers/1d7df37d-82e3-4513-b976-cebca6a3e6f9 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 05:45:16.790842 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e4cc566a-0b28-44d0-9c06-182d24a31ba8 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Calling method '.version_select at 0x7ff1ba8289d0>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:45:16.942245 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e4cc566a-0b28-44d0-9c06-182d24a31ba8 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1674598540" status: 202 len: 0 microversion: 2.1 time: 0.155289 Sep 23 05:45:16.942858 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3956/7731] 10.222.0.33 () {58 vars in 1272 bytes} [Fri Sep 23 05:45:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1674598540 => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 05:45:28.253623 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c0f4b1ed-ec49-4c22-bc0e-89b3a3d9c01d tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Action: 'create', calling method: .version_select at 0x7ff1ba9ad0d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-640633726", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCg+2ubxdTbYMuv0dtglskrjaQGBmSI7K40q3kmqr6aoksTgKRrEX3Ge69HBR7le1rsbsDdFDS0L1Wy8V2M8FJ11Of/YmVEbleK0fGaEZO7Aiq9xoREm4MBnXbG+M4Lp8Q=="}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:45:28.262053 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=18 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:45:28.262053 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:45:28.262285 n-d-846463-3 devstack@n-api.service[122698]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 05:45:28.262395 n-d-846463-3 devstack@n-api.service[122698]: Fri Sep 23 05:45:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.33) !!! Sep 23 05:45:28.278061 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-c0f4b1ed-ec49-4c22-bc0e-89b3a3d9c01d tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Getting quotas for project 8f008a7ab34b4a8d956c6200b4adc3ed. Resources: {'key_pairs'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 05:45:28.283335 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-c0f4b1ed-ec49-4c22-bc0e-89b3a3d9c01d tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Getting quotas for user 327d75316ac943feafd46049c2267a7e and project 8f008a7ab34b4a8d956c6200b4adc3ed. Resources: {'key_pairs'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 05:45:28.412392 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c0f4b1ed-ec49-4c22-bc0e-89b3a3d9c01d tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.162716 Sep 23 05:45:28.413757 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3776/7732] 10.222.0.33 () {60 vars in 1159 bytes} [Fri Sep 23 05:45:28 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 05:45:28.461594 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:45:28.462365 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:45:28.466880 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c2ca9f6a-cb57-40be-a0e0-e746d560b447 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-157585952", "imageRef": "17f29cc0-24bd-47ae-8759-89645d6abb01", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-640633726", "networks": [{"uuid": "33ee7c0d-8bab-41d2-b06c-84a7a76ab5f6"}]}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:45:28.518055 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.neutron [None req-c2ca9f6a-cb57-40be-a0e0-e746d560b447 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] validate_networks() for [('33ee7c0d-8bab-41d2-b06c-84a7a76ab5f6', None, None, None, None, None)] {{(pid=122699) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 05:45:28.940740 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-c2ca9f6a-cb57-40be-a0e0-e746d560b447 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Flavor limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 05:45:28.941166 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-c2ca9f6a-cb57-40be-a0e0-e746d560b447 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Image limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 05:45:28.941638 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-c2ca9f6a-cb57-40be-a0e0-e746d560b447 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Flavor pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 05:45:28.942097 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-c2ca9f6a-cb57-40be-a0e0-e746d560b447 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Image pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 05:45:28.942512 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-c2ca9f6a-cb57-40be-a0e0-e746d560b447 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 05:45:28.951961 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c2ca9f6a-cb57-40be-a0e0-e746d560b447 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:45:28.952442 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c2ca9f6a-cb57-40be-a0e0-e746d560b447 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:45:28.952879 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c2ca9f6a-cb57-40be-a0e0-e746d560b447 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:45:28.953604 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c2ca9f6a-cb57-40be-a0e0-e746d560b447 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:45:28.954092 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c2ca9f6a-cb57-40be-a0e0-e746d560b447 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:45:28.954522 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c2ca9f6a-cb57-40be-a0e0-e746d560b447 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:45:28.971587 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-c2ca9f6a-cb57-40be-a0e0-e746d560b447 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Getting quotas for project 8f008a7ab34b4a8d956c6200b4adc3ed. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 05:45:28.976954 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-c2ca9f6a-cb57-40be-a0e0-e746d560b447 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Getting quotas for user 327d75316ac943feafd46049c2267a7e and project 8f008a7ab34b4a8d956c6200b4adc3ed. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 05:45:28.989065 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c2ca9f6a-cb57-40be-a0e0-e746d560b447 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Going to run 1 instances... {{(pid=122699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 05:45:28.991870 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c2ca9f6a-cb57-40be-a0e0-e746d560b447 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] [instance: 2be14c16-aac7-41ad-b3a0-8503a8582271] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='17f29cc0-24bd-47ae-8759-89645d6abb01',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 05:45:29.128406 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c2ca9f6a-cb57-40be-a0e0-e746d560b447 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.668715 Sep 23 05:45:29.129074 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3957/7733] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 05:45:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 670 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 05:45:29.140807 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-82675b41-0719-4c82-86eb-4af8a512fe7b tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:45:29.141695 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-82675b41-0719-4c82-86eb-4af8a512fe7b tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] [instance: 2be14c16-aac7-41ad-b3a0-8503a8582271] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:45:29.196821 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-82675b41-0719-4c82-86eb-4af8a512fe7b tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327d75316ac943feafd46049c2267a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f008a7ab34b4a8d956c6200b4adc3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:45:29.203698 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-82675b41-0719-4c82-86eb-4af8a512fe7b tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] 10.222.0.33 "GET /compute/v2.1/servers/2be14c16-aac7-41ad-b3a0-8503a8582271" status: 200 len: 1257 microversion: 2.1 time: 0.066849 Sep 23 05:45:29.207043 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3777/7734] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:45:29 2022] GET /compute/v2.1/servers/2be14c16-aac7-41ad-b3a0-8503a8582271 => generated 1257 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:45:30.236485 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-34af7850-38d7-48c2-a89c-16c45eaf4448 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:45:30.237120 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-34af7850-38d7-48c2-a89c-16c45eaf4448 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] [instance: 2be14c16-aac7-41ad-b3a0-8503a8582271] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:45:30.295620 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-34af7850-38d7-48c2-a89c-16c45eaf4448 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327d75316ac943feafd46049c2267a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f008a7ab34b4a8d956c6200b4adc3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:45:30.303152 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-34af7850-38d7-48c2-a89c-16c45eaf4448 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] 10.222.0.33 "GET /compute/v2.1/servers/2be14c16-aac7-41ad-b3a0-8503a8582271" status: 200 len: 1257 microversion: 2.1 time: 0.071090 Sep 23 05:45:30.304234 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3958/7735] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:45:30 2022] GET /compute/v2.1/servers/2be14c16-aac7-41ad-b3a0-8503a8582271 => generated 1257 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:45:31.326588 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e3ceee20-2c8d-4fcc-b686-713cec3c3bbb tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:45:31.329815 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e3ceee20-2c8d-4fcc-b686-713cec3c3bbb tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] [instance: 2be14c16-aac7-41ad-b3a0-8503a8582271] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:45:31.386105 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e3ceee20-2c8d-4fcc-b686-713cec3c3bbb tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327d75316ac943feafd46049c2267a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f008a7ab34b4a8d956c6200b4adc3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:45:31.394241 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e3ceee20-2c8d-4fcc-b686-713cec3c3bbb tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] 10.222.0.33 "GET /compute/v2.1/servers/2be14c16-aac7-41ad-b3a0-8503a8582271" status: 200 len: 1257 microversion: 2.1 time: 0.071335 Sep 23 05:45:31.394801 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3778/7736] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:45:31 2022] GET /compute/v2.1/servers/2be14c16-aac7-41ad-b3a0-8503a8582271 => generated 1257 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:45:32.416620 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-fc8f1455-0004-4df1-84b5-d9f2b52ebe06 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:45:32.418975 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-fc8f1455-0004-4df1-84b5-d9f2b52ebe06 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] [instance: 2be14c16-aac7-41ad-b3a0-8503a8582271] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:45:32.469758 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-fc8f1455-0004-4df1-84b5-d9f2b52ebe06 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327d75316ac943feafd46049c2267a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f008a7ab34b4a8d956c6200b4adc3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:45:32.477713 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-fc8f1455-0004-4df1-84b5-d9f2b52ebe06 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] 10.222.0.33 "GET /compute/v2.1/servers/2be14c16-aac7-41ad-b3a0-8503a8582271" status: 200 len: 1257 microversion: 2.1 time: 0.064977 Sep 23 05:45:32.478337 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3959/7737] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:45:32 2022] GET /compute/v2.1/servers/2be14c16-aac7-41ad-b3a0-8503a8582271 => generated 1257 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:45:33.500579 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9eb4f20c-1748-4081-bc2e-372ded71d26e tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:45:33.501212 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-9eb4f20c-1748-4081-bc2e-372ded71d26e tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] [instance: 2be14c16-aac7-41ad-b3a0-8503a8582271] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:45:33.508610 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9eb4f20c-1748-4081-bc2e-372ded71d26e tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:45:33.509910 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9eb4f20c-1748-4081-bc2e-372ded71d26e tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:45:33.509910 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9eb4f20c-1748-4081-bc2e-372ded71d26e tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:45:33.510278 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9eb4f20c-1748-4081-bc2e-372ded71d26e tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:45:33.510751 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9eb4f20c-1748-4081-bc2e-372ded71d26e tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:45:33.511193 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9eb4f20c-1748-4081-bc2e-372ded71d26e tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:45:33.573647 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-9eb4f20c-1748-4081-bc2e-372ded71d26e tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327d75316ac943feafd46049c2267a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f008a7ab34b4a8d956c6200b4adc3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:45:33.581706 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9eb4f20c-1748-4081-bc2e-372ded71d26e tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] 10.222.0.33 "GET /compute/v2.1/servers/2be14c16-aac7-41ad-b3a0-8503a8582271" status: 200 len: 1253 microversion: 2.1 time: 0.085031 Sep 23 05:45:33.582317 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3779/7738] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:45:33 2022] GET /compute/v2.1/servers/2be14c16-aac7-41ad-b3a0-8503a8582271 => generated 1253 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:45:34.604862 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-97dc0968-b78e-4d16-9328-43bb2878acb1 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:45:34.605526 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-97dc0968-b78e-4d16-9328-43bb2878acb1 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] [instance: 2be14c16-aac7-41ad-b3a0-8503a8582271] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:45:34.612775 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-97dc0968-b78e-4d16-9328-43bb2878acb1 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:45:34.613271 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-97dc0968-b78e-4d16-9328-43bb2878acb1 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:45:34.613710 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-97dc0968-b78e-4d16-9328-43bb2878acb1 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:45:34.614471 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-97dc0968-b78e-4d16-9328-43bb2878acb1 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:45:34.614926 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-97dc0968-b78e-4d16-9328-43bb2878acb1 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:45:34.615345 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-97dc0968-b78e-4d16-9328-43bb2878acb1 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:45:34.692754 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-97dc0968-b78e-4d16-9328-43bb2878acb1 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327d75316ac943feafd46049c2267a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f008a7ab34b4a8d956c6200b4adc3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:45:34.705258 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-97dc0968-b78e-4d16-9328-43bb2878acb1 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] 10.222.0.33 "GET /compute/v2.1/servers/2be14c16-aac7-41ad-b3a0-8503a8582271" status: 200 len: 1315 microversion: 2.1 time: 0.104548 Sep 23 05:45:34.706061 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3960/7739] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:45:34 2022] GET /compute/v2.1/servers/2be14c16-aac7-41ad-b3a0-8503a8582271 => generated 1315 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:45:35.733637 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-67d45b31-9f26-4404-aec2-30b39f6453a3 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:45:35.734897 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-67d45b31-9f26-4404-aec2-30b39f6453a3 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] [instance: 2be14c16-aac7-41ad-b3a0-8503a8582271] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:45:35.742876 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-67d45b31-9f26-4404-aec2-30b39f6453a3 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:45:35.743795 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-67d45b31-9f26-4404-aec2-30b39f6453a3 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:45:35.744496 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-67d45b31-9f26-4404-aec2-30b39f6453a3 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:45:35.746432 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-67d45b31-9f26-4404-aec2-30b39f6453a3 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:45:35.747160 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-67d45b31-9f26-4404-aec2-30b39f6453a3 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:45:35.747852 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-67d45b31-9f26-4404-aec2-30b39f6453a3 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:45:35.896939 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-67d45b31-9f26-4404-aec2-30b39f6453a3 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327d75316ac943feafd46049c2267a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f008a7ab34b4a8d956c6200b4adc3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:45:35.905881 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-67d45b31-9f26-4404-aec2-30b39f6453a3 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] 10.222.0.33 "GET /compute/v2.1/servers/2be14c16-aac7-41ad-b3a0-8503a8582271" status: 200 len: 1357 microversion: 2.1 time: 0.180086 Sep 23 05:45:35.906674 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3780/7740] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:45:35 2022] GET /compute/v2.1/servers/2be14c16-aac7-41ad-b3a0-8503a8582271 => generated 1357 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:45:36.931197 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-642809d0-b997-4157-8b73-1535b04d5f7f tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:45:36.932681 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-642809d0-b997-4157-8b73-1535b04d5f7f tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] [instance: 2be14c16-aac7-41ad-b3a0-8503a8582271] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:45:36.939544 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-642809d0-b997-4157-8b73-1535b04d5f7f tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:45:36.940133 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-642809d0-b997-4157-8b73-1535b04d5f7f tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:45:36.940755 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-642809d0-b997-4157-8b73-1535b04d5f7f tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:45:36.941558 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-642809d0-b997-4157-8b73-1535b04d5f7f tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:45:36.942177 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-642809d0-b997-4157-8b73-1535b04d5f7f tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:45:36.942708 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-642809d0-b997-4157-8b73-1535b04d5f7f tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:45:37.116536 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-642809d0-b997-4157-8b73-1535b04d5f7f tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327d75316ac943feafd46049c2267a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f008a7ab34b4a8d956c6200b4adc3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:45:37.125060 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-642809d0-b997-4157-8b73-1535b04d5f7f tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] 10.222.0.33 "GET /compute/v2.1/servers/2be14c16-aac7-41ad-b3a0-8503a8582271" status: 200 len: 1357 microversion: 2.1 time: 0.198092 Sep 23 05:45:37.125716 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3961/7741] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:45:36 2022] GET /compute/v2.1/servers/2be14c16-aac7-41ad-b3a0-8503a8582271 => generated 1357 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:45:38.149707 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f7bc5042-1743-405d-b933-32117761cdab tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:45:38.150700 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f7bc5042-1743-405d-b933-32117761cdab tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] [instance: 2be14c16-aac7-41ad-b3a0-8503a8582271] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:45:38.169934 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f7bc5042-1743-405d-b933-32117761cdab tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:45:38.173706 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f7bc5042-1743-405d-b933-32117761cdab tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:45:38.173706 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f7bc5042-1743-405d-b933-32117761cdab tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:45:38.173706 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f7bc5042-1743-405d-b933-32117761cdab tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:45:38.173706 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f7bc5042-1743-405d-b933-32117761cdab tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:45:38.173706 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f7bc5042-1743-405d-b933-32117761cdab tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:45:38.383289 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f7bc5042-1743-405d-b933-32117761cdab tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327d75316ac943feafd46049c2267a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f008a7ab34b4a8d956c6200b4adc3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:45:38.391912 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f7bc5042-1743-405d-b933-32117761cdab tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] 10.222.0.33 "GET /compute/v2.1/servers/2be14c16-aac7-41ad-b3a0-8503a8582271" status: 200 len: 1357 microversion: 2.1 time: 0.246546 Sep 23 05:45:38.392904 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3781/7742] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:45:38 2022] GET /compute/v2.1/servers/2be14c16-aac7-41ad-b3a0-8503a8582271 => generated 1357 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:45:39.420090 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1e57c814-5eda-45ed-8c3b-18e86410f4db tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:45:39.420836 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1e57c814-5eda-45ed-8c3b-18e86410f4db tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] [instance: 2be14c16-aac7-41ad-b3a0-8503a8582271] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:45:39.423707 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:45:39.428981 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e57c814-5eda-45ed-8c3b-18e86410f4db tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:45:39.429803 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e57c814-5eda-45ed-8c3b-18e86410f4db tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:45:39.430661 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e57c814-5eda-45ed-8c3b-18e86410f4db tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:45:39.431619 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e57c814-5eda-45ed-8c3b-18e86410f4db tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:45:39.432086 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e57c814-5eda-45ed-8c3b-18e86410f4db tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:45:39.432521 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1e57c814-5eda-45ed-8c3b-18e86410f4db tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:45:39.576569 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1e57c814-5eda-45ed-8c3b-18e86410f4db tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327d75316ac943feafd46049c2267a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f008a7ab34b4a8d956c6200b4adc3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:45:39.584750 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1e57c814-5eda-45ed-8c3b-18e86410f4db tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] 10.222.0.33 "GET /compute/v2.1/servers/2be14c16-aac7-41ad-b3a0-8503a8582271" status: 200 len: 1357 microversion: 2.1 time: 0.168509 Sep 23 05:45:39.585350 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3962/7743] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:45:39 2022] GET /compute/v2.1/servers/2be14c16-aac7-41ad-b3a0-8503a8582271 => generated 1357 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:45:40.609342 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-78c9c62a-4c50-409f-8202-0044c60c8733 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:45:40.610079 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-78c9c62a-4c50-409f-8202-0044c60c8733 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] [instance: 2be14c16-aac7-41ad-b3a0-8503a8582271] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:45:40.617776 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-78c9c62a-4c50-409f-8202-0044c60c8733 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:45:40.618344 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-78c9c62a-4c50-409f-8202-0044c60c8733 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:45:40.618799 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-78c9c62a-4c50-409f-8202-0044c60c8733 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:45:40.619541 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-78c9c62a-4c50-409f-8202-0044c60c8733 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:45:40.620018 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-78c9c62a-4c50-409f-8202-0044c60c8733 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:45:40.620604 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-78c9c62a-4c50-409f-8202-0044c60c8733 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:45:40.776655 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-78c9c62a-4c50-409f-8202-0044c60c8733 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327d75316ac943feafd46049c2267a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f008a7ab34b4a8d956c6200b4adc3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:45:40.785179 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-78c9c62a-4c50-409f-8202-0044c60c8733 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] 10.222.0.33 "GET /compute/v2.1/servers/2be14c16-aac7-41ad-b3a0-8503a8582271" status: 200 len: 1357 microversion: 2.1 time: 0.180542 Sep 23 05:45:40.786147 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3782/7744] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:45:40 2022] GET /compute/v2.1/servers/2be14c16-aac7-41ad-b3a0-8503a8582271 => generated 1357 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:45:41.810107 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-57d4671d-0b9f-48e2-acaf-796f81c5d2bb tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:45:41.810703 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-57d4671d-0b9f-48e2-acaf-796f81c5d2bb tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] [instance: 2be14c16-aac7-41ad-b3a0-8503a8582271] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:45:41.818028 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-57d4671d-0b9f-48e2-acaf-796f81c5d2bb tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:45:41.818526 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-57d4671d-0b9f-48e2-acaf-796f81c5d2bb tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:45:41.818959 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-57d4671d-0b9f-48e2-acaf-796f81c5d2bb tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:45:41.819655 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-57d4671d-0b9f-48e2-acaf-796f81c5d2bb tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:45:41.820108 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-57d4671d-0b9f-48e2-acaf-796f81c5d2bb tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:45:41.820532 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-57d4671d-0b9f-48e2-acaf-796f81c5d2bb tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:45:41.952499 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-57d4671d-0b9f-48e2-acaf-796f81c5d2bb tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327d75316ac943feafd46049c2267a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f008a7ab34b4a8d956c6200b4adc3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:45:41.961347 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-57d4671d-0b9f-48e2-acaf-796f81c5d2bb tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] 10.222.0.33 "GET /compute/v2.1/servers/2be14c16-aac7-41ad-b3a0-8503a8582271" status: 200 len: 1357 microversion: 2.1 time: 0.155159 Sep 23 05:45:41.961937 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3963/7745] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:45:41 2022] GET /compute/v2.1/servers/2be14c16-aac7-41ad-b3a0-8503a8582271 => generated 1357 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:45:42.985134 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0ced0024-2966-4d17-8eac-f5df8146cb5b tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:45:42.985776 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-0ced0024-2966-4d17-8eac-f5df8146cb5b tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] [instance: 2be14c16-aac7-41ad-b3a0-8503a8582271] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:45:42.987804 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=8 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:45:42.994324 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0ced0024-2966-4d17-8eac-f5df8146cb5b tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:45:42.994847 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0ced0024-2966-4d17-8eac-f5df8146cb5b tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:45:42.995309 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0ced0024-2966-4d17-8eac-f5df8146cb5b tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:45:42.996040 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0ced0024-2966-4d17-8eac-f5df8146cb5b tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:45:42.996522 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0ced0024-2966-4d17-8eac-f5df8146cb5b tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:45:42.996973 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0ced0024-2966-4d17-8eac-f5df8146cb5b tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:45:43.090791 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-6a57c48e-1d67-4300-a553-6efb9a7ac1a3 req-fb8b6a4b-88d3-40f2-a709-cfca0752ff27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2be14c16-aac7-41ad-b3a0-8503a8582271", "tag": "f327f981-e8ae-499b-9f8d-01b058708eac"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:45:43.099460 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=10 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:45:43.102714 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-6a57c48e-1d67-4300-a553-6efb9a7ac1a3 req-fb8b6a4b-88d3-40f2-a709-cfca0752ff27 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:45:43.103287 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-6a57c48e-1d67-4300-a553-6efb9a7ac1a3 req-fb8b6a4b-88d3-40f2-a709-cfca0752ff27 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:45:43.103790 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-6a57c48e-1d67-4300-a553-6efb9a7ac1a3 req-fb8b6a4b-88d3-40f2-a709-cfca0752ff27 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:45:43.115333 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-6a57c48e-1d67-4300-a553-6efb9a7ac1a3 req-fb8b6a4b-88d3-40f2-a709-cfca0752ff27 service nova] Creating event network-changed:f327f981-e8ae-499b-9f8d-01b058708eac for instance 2be14c16-aac7-41ad-b3a0-8503a8582271 on n-h2-846463-3 Sep 23 05:45:43.120712 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-6a57c48e-1d67-4300-a553-6efb9a7ac1a3 req-fb8b6a4b-88d3-40f2-a709-cfca0752ff27 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033623 Sep 23 05:45:43.122040 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3964/7746] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:45:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 05:45:43.135127 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-0ced0024-2966-4d17-8eac-f5df8146cb5b tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327d75316ac943feafd46049c2267a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f008a7ab34b4a8d956c6200b4adc3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:45:43.143365 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0ced0024-2966-4d17-8eac-f5df8146cb5b tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] 10.222.0.33 "GET /compute/v2.1/servers/2be14c16-aac7-41ad-b3a0-8503a8582271" status: 200 len: 1357 microversion: 2.1 time: 0.162305 Sep 23 05:45:43.144255 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3783/7747] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:45:42 2022] GET /compute/v2.1/servers/2be14c16-aac7-41ad-b3a0-8503a8582271 => generated 1357 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:45:44.169718 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b6c53ee5-188f-41b6-a346-8c47094b7406 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:45:44.170463 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b6c53ee5-188f-41b6-a346-8c47094b7406 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] [instance: 2be14c16-aac7-41ad-b3a0-8503a8582271] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:45:44.177278 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b6c53ee5-188f-41b6-a346-8c47094b7406 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:45:44.177773 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b6c53ee5-188f-41b6-a346-8c47094b7406 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:45:44.178914 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b6c53ee5-188f-41b6-a346-8c47094b7406 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:45:44.179623 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b6c53ee5-188f-41b6-a346-8c47094b7406 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:45:44.180091 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b6c53ee5-188f-41b6-a346-8c47094b7406 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:45:44.180532 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b6c53ee5-188f-41b6-a346-8c47094b7406 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:45:44.311335 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b6c53ee5-188f-41b6-a346-8c47094b7406 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327d75316ac943feafd46049c2267a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f008a7ab34b4a8d956c6200b4adc3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:45:44.319305 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b6c53ee5-188f-41b6-a346-8c47094b7406 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] 10.222.0.33 "GET /compute/v2.1/servers/2be14c16-aac7-41ad-b3a0-8503a8582271" status: 200 len: 1357 microversion: 2.1 time: 0.154177 Sep 23 05:45:44.319884 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3965/7748] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:45:44 2022] GET /compute/v2.1/servers/2be14c16-aac7-41ad-b3a0-8503a8582271 => generated 1357 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:45:45.342168 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-35fc634e-dea9-4baf-ab8c-cdf2dd0b7fde tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:45:45.342814 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-35fc634e-dea9-4baf-ab8c-cdf2dd0b7fde tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] [instance: 2be14c16-aac7-41ad-b3a0-8503a8582271] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:45:45.350133 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-35fc634e-dea9-4baf-ab8c-cdf2dd0b7fde tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:45:45.350645 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-35fc634e-dea9-4baf-ab8c-cdf2dd0b7fde tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:45:45.351115 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-35fc634e-dea9-4baf-ab8c-cdf2dd0b7fde tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:45:45.351868 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-35fc634e-dea9-4baf-ab8c-cdf2dd0b7fde tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:45:45.352350 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-35fc634e-dea9-4baf-ab8c-cdf2dd0b7fde tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:45:45.352805 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-35fc634e-dea9-4baf-ab8c-cdf2dd0b7fde tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:45:45.481878 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-35fc634e-dea9-4baf-ab8c-cdf2dd0b7fde tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327d75316ac943feafd46049c2267a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f008a7ab34b4a8d956c6200b4adc3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:45:45.489899 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-35fc634e-dea9-4baf-ab8c-cdf2dd0b7fde tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] 10.222.0.33 "GET /compute/v2.1/servers/2be14c16-aac7-41ad-b3a0-8503a8582271" status: 200 len: 1357 microversion: 2.1 time: 0.151618 Sep 23 05:45:45.491125 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3784/7749] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:45:45 2022] GET /compute/v2.1/servers/2be14c16-aac7-41ad-b3a0-8503a8582271 => generated 1357 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:45:46.513551 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c0cc39b8-4c7c-4ebc-ba5f-ad1488c61c55 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:45:46.514175 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c0cc39b8-4c7c-4ebc-ba5f-ad1488c61c55 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] [instance: 2be14c16-aac7-41ad-b3a0-8503a8582271] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:45:46.520915 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c0cc39b8-4c7c-4ebc-ba5f-ad1488c61c55 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:45:46.521401 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c0cc39b8-4c7c-4ebc-ba5f-ad1488c61c55 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:45:46.521841 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c0cc39b8-4c7c-4ebc-ba5f-ad1488c61c55 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:45:46.523534 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c0cc39b8-4c7c-4ebc-ba5f-ad1488c61c55 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:45:46.524026 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c0cc39b8-4c7c-4ebc-ba5f-ad1488c61c55 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:45:46.524480 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c0cc39b8-4c7c-4ebc-ba5f-ad1488c61c55 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:45:46.657948 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c0cc39b8-4c7c-4ebc-ba5f-ad1488c61c55 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327d75316ac943feafd46049c2267a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f008a7ab34b4a8d956c6200b4adc3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:45:46.665835 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c0cc39b8-4c7c-4ebc-ba5f-ad1488c61c55 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] 10.222.0.33 "GET /compute/v2.1/servers/2be14c16-aac7-41ad-b3a0-8503a8582271" status: 200 len: 1357 microversion: 2.1 time: 0.156255 Sep 23 05:45:46.666433 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3966/7750] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:45:46 2022] GET /compute/v2.1/servers/2be14c16-aac7-41ad-b3a0-8503a8582271 => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:45:47.547129 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-be5c4706-1720-4aa2-b72b-3e88e7cfb589 req-3d188572-4d29-47f7-9e47-90e9f540738d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2be14c16-aac7-41ad-b3a0-8503a8582271", "name": "network-vif-plugged", "status": "completed", "tag": "f327f981-e8ae-499b-9f8d-01b058708eac"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:45:47.556733 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-be5c4706-1720-4aa2-b72b-3e88e7cfb589 req-3d188572-4d29-47f7-9e47-90e9f540738d service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:45:47.557314 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-be5c4706-1720-4aa2-b72b-3e88e7cfb589 req-3d188572-4d29-47f7-9e47-90e9f540738d service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:45:47.557742 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-be5c4706-1720-4aa2-b72b-3e88e7cfb589 req-3d188572-4d29-47f7-9e47-90e9f540738d service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:45:47.569028 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-be5c4706-1720-4aa2-b72b-3e88e7cfb589 req-3d188572-4d29-47f7-9e47-90e9f540738d service nova] Creating event network-vif-plugged:f327f981-e8ae-499b-9f8d-01b058708eac for instance 2be14c16-aac7-41ad-b3a0-8503a8582271 on n-h2-846463-3 Sep 23 05:45:47.574211 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-be5c4706-1720-4aa2-b72b-3e88e7cfb589 req-3d188572-4d29-47f7-9e47-90e9f540738d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085867 Sep 23 05:45:47.574970 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3785/7751] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:45:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 05:45:47.688683 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-218d5260-6a4d-4573-9e7a-b6f022728311 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:45:47.689303 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-218d5260-6a4d-4573-9e7a-b6f022728311 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] [instance: 2be14c16-aac7-41ad-b3a0-8503a8582271] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:45:47.695897 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-218d5260-6a4d-4573-9e7a-b6f022728311 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:45:47.696395 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-218d5260-6a4d-4573-9e7a-b6f022728311 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:45:47.696837 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-218d5260-6a4d-4573-9e7a-b6f022728311 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:45:47.697602 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-218d5260-6a4d-4573-9e7a-b6f022728311 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:45:47.698096 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-218d5260-6a4d-4573-9e7a-b6f022728311 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:45:47.698527 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-218d5260-6a4d-4573-9e7a-b6f022728311 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:45:47.826837 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-218d5260-6a4d-4573-9e7a-b6f022728311 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327d75316ac943feafd46049c2267a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f008a7ab34b4a8d956c6200b4adc3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:45:47.834521 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-218d5260-6a4d-4573-9e7a-b6f022728311 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] 10.222.0.33 "GET /compute/v2.1/servers/2be14c16-aac7-41ad-b3a0-8503a8582271" status: 200 len: 1357 microversion: 2.1 time: 0.149871 Sep 23 05:45:47.835101 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3967/7752] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:45:47 2022] GET /compute/v2.1/servers/2be14c16-aac7-41ad-b3a0-8503a8582271 => generated 1357 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:45:48.859493 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9e17b0ac-3247-4b6d-807b-4f9d8906efb2 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:45:48.860254 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-9e17b0ac-3247-4b6d-807b-4f9d8906efb2 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] [instance: 2be14c16-aac7-41ad-b3a0-8503a8582271] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:45:48.867283 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9e17b0ac-3247-4b6d-807b-4f9d8906efb2 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:45:48.867802 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9e17b0ac-3247-4b6d-807b-4f9d8906efb2 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:45:48.868266 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9e17b0ac-3247-4b6d-807b-4f9d8906efb2 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:45:48.868986 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9e17b0ac-3247-4b6d-807b-4f9d8906efb2 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:45:48.869594 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9e17b0ac-3247-4b6d-807b-4f9d8906efb2 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:45:48.870077 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9e17b0ac-3247-4b6d-807b-4f9d8906efb2 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:45:49.005101 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-9e17b0ac-3247-4b6d-807b-4f9d8906efb2 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327d75316ac943feafd46049c2267a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f008a7ab34b4a8d956c6200b4adc3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:45:49.012948 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9e17b0ac-3247-4b6d-807b-4f9d8906efb2 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] 10.222.0.33 "GET /compute/v2.1/servers/2be14c16-aac7-41ad-b3a0-8503a8582271" status: 200 len: 1357 microversion: 2.1 time: 0.158937 Sep 23 05:45:49.013524 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3786/7753] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:45:48 2022] GET /compute/v2.1/servers/2be14c16-aac7-41ad-b3a0-8503a8582271 => generated 1357 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:45:50.037214 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-39292be8-6258-4788-aeab-f74766fc2e18 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:45:50.038207 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-39292be8-6258-4788-aeab-f74766fc2e18 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] [instance: 2be14c16-aac7-41ad-b3a0-8503a8582271] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:45:50.044817 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-39292be8-6258-4788-aeab-f74766fc2e18 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:45:50.045750 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-39292be8-6258-4788-aeab-f74766fc2e18 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:45:50.045943 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-39292be8-6258-4788-aeab-f74766fc2e18 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:45:50.046515 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-39292be8-6258-4788-aeab-f74766fc2e18 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:45:50.046987 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-39292be8-6258-4788-aeab-f74766fc2e18 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:45:50.047766 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-39292be8-6258-4788-aeab-f74766fc2e18 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:45:50.180753 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-39292be8-6258-4788-aeab-f74766fc2e18 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327d75316ac943feafd46049c2267a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f008a7ab34b4a8d956c6200b4adc3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:45:50.188560 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-39292be8-6258-4788-aeab-f74766fc2e18 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] 10.222.0.33 "GET /compute/v2.1/servers/2be14c16-aac7-41ad-b3a0-8503a8582271" status: 200 len: 1547 microversion: 2.1 time: 0.156095 Sep 23 05:45:50.189141 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3968/7754] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:45:50 2022] GET /compute/v2.1/servers/2be14c16-aac7-41ad-b3a0-8503a8582271 => generated 1547 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:45:50.217655 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-208df670-4b48-4b84-bc9a-0bb33105a81e tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:45:50.217655 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-208df670-4b48-4b84-bc9a-0bb33105a81e tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] [instance: 2be14c16-aac7-41ad-b3a0-8503a8582271] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:45:50.218749 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-208df670-4b48-4b84-bc9a-0bb33105a81e tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:45:50.219251 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-208df670-4b48-4b84-bc9a-0bb33105a81e tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:45:50.219706 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-208df670-4b48-4b84-bc9a-0bb33105a81e tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:45:50.220412 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-208df670-4b48-4b84-bc9a-0bb33105a81e tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:45:50.220880 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-208df670-4b48-4b84-bc9a-0bb33105a81e tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:45:50.221320 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-208df670-4b48-4b84-bc9a-0bb33105a81e tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:45:50.356780 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-208df670-4b48-4b84-bc9a-0bb33105a81e tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327d75316ac943feafd46049c2267a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f008a7ab34b4a8d956c6200b4adc3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:45:50.364621 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-208df670-4b48-4b84-bc9a-0bb33105a81e tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] 10.222.0.33 "GET /compute/v2.1/servers/2be14c16-aac7-41ad-b3a0-8503a8582271" status: 200 len: 1547 microversion: 2.1 time: 0.157402 Sep 23 05:45:50.365208 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3787/7755] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:45:50 2022] GET /compute/v2.1/servers/2be14c16-aac7-41ad-b3a0-8503a8582271 => generated 1547 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:45:50.386835 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b91554f1-ca52-4cfa-a96d-299534296ae8 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:45:50.391572 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b91554f1-ca52-4cfa-a96d-299534296ae8 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '327d75316ac943feafd46049c2267a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f008a7ab34b4a8d956c6200b4adc3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:45:50.392343 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b91554f1-ca52-4cfa-a96d-299534296ae8 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Searching by: {'deleted': False, 'project_id': '8f008a7ab34b4a8d956c6200b4adc3ed'} {{(pid=122699) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 05:45:50.398543 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b91554f1-ca52-4cfa-a96d-299534296ae8 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:45:50.399064 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b91554f1-ca52-4cfa-a96d-299534296ae8 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:45:50.399505 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b91554f1-ca52-4cfa-a96d-299534296ae8 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:45:50.400233 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b91554f1-ca52-4cfa-a96d-299534296ae8 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:45:50.400692 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b91554f1-ca52-4cfa-a96d-299534296ae8 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:45:50.401117 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b91554f1-ca52-4cfa-a96d-299534296ae8 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:45:50.424283 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.multi_cell_list [None req-b91554f1-ca52-4cfa-a96d-299534296ae8 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122699) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 23 05:45:50.450497 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b91554f1-ca52-4cfa-a96d-299534296ae8 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.068138 Sep 23 05:45:50.451079 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3969/7756] 10.222.0.33 () {58 vars in 1125 bytes} [Fri Sep 23 05:45:50 2022] GET /compute/v2.1/servers => generated 342 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:45:50.463502 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a171527c-c69a-4e27-a199-fa4cda4f6355 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:45:50.464145 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a171527c-c69a-4e27-a199-fa4cda4f6355 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] [instance: 2be14c16-aac7-41ad-b3a0-8503a8582271] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:45:50.470244 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a171527c-c69a-4e27-a199-fa4cda4f6355 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:45:50.470698 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a171527c-c69a-4e27-a199-fa4cda4f6355 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:45:50.471160 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a171527c-c69a-4e27-a199-fa4cda4f6355 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:45:50.471883 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a171527c-c69a-4e27-a199-fa4cda4f6355 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:45:50.472367 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a171527c-c69a-4e27-a199-fa4cda4f6355 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:45:50.472817 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a171527c-c69a-4e27-a199-fa4cda4f6355 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:45:50.603390 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a171527c-c69a-4e27-a199-fa4cda4f6355 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327d75316ac943feafd46049c2267a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f008a7ab34b4a8d956c6200b4adc3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:45:50.611327 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a171527c-c69a-4e27-a199-fa4cda4f6355 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] 10.222.0.33 "GET /compute/v2.1/servers/2be14c16-aac7-41ad-b3a0-8503a8582271" status: 200 len: 1547 microversion: 2.1 time: 0.152338 Sep 23 05:45:50.611916 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3788/7757] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:45:50 2022] GET /compute/v2.1/servers/2be14c16-aac7-41ad-b3a0-8503a8582271 => generated 1547 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:45:53.483890 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-102a60cf-4ba7-4dd5-afb2-c48ffb52c66f tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5772def3-1732-4ca3-ab65-db6442bd75cd"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:45:53.486267 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-102a60cf-4ba7-4dd5-afb2-c48ffb52c66f tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] [instance: 2be14c16-aac7-41ad-b3a0-8503a8582271] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:45:53.492765 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-102a60cf-4ba7-4dd5-afb2-c48ffb52c66f tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:45:53.493252 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-102a60cf-4ba7-4dd5-afb2-c48ffb52c66f tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:45:53.493695 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-102a60cf-4ba7-4dd5-afb2-c48ffb52c66f tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:45:53.494421 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-102a60cf-4ba7-4dd5-afb2-c48ffb52c66f tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:45:53.494880 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-102a60cf-4ba7-4dd5-afb2-c48ffb52c66f tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:45:53.495316 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-102a60cf-4ba7-4dd5-afb2-c48ffb52c66f tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:45:54.146602 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-102a60cf-4ba7-4dd5-afb2-c48ffb52c66f tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] 10.222.0.33 "POST /compute/v2.1/servers/2be14c16-aac7-41ad-b3a0-8503a8582271/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.666494 Sep 23 05:45:54.147259 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3970/7758] 10.222.0.33 () {60 vars in 1323 bytes} [Fri Sep 23 05:45:53 2022] POST /compute/v2.1/servers/2be14c16-aac7-41ad-b3a0-8503a8582271/os-volume_attachments => generated 194 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:46:05.965553 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-42585252-9a78-44ea-97d2-547d47a1a9df tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:46:05.966238 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-42585252-9a78-44ea-97d2-547d47a1a9df tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] [instance: 2be14c16-aac7-41ad-b3a0-8503a8582271] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:46:05.968760 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:46:05.969444 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=56 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:46:05.974123 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-42585252-9a78-44ea-97d2-547d47a1a9df tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:46:05.974631 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-42585252-9a78-44ea-97d2-547d47a1a9df tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:46:05.975091 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-42585252-9a78-44ea-97d2-547d47a1a9df tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:46:05.975801 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-42585252-9a78-44ea-97d2-547d47a1a9df tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:46:05.976807 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-42585252-9a78-44ea-97d2-547d47a1a9df tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:46:05.977256 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-42585252-9a78-44ea-97d2-547d47a1a9df tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:46:06.105883 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-42585252-9a78-44ea-97d2-547d47a1a9df tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327d75316ac943feafd46049c2267a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f008a7ab34b4a8d956c6200b4adc3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:46:06.114285 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-42585252-9a78-44ea-97d2-547d47a1a9df tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] 10.222.0.33 "GET /compute/v2.1/servers/2be14c16-aac7-41ad-b3a0-8503a8582271" status: 200 len: 1593 microversion: 2.1 time: 0.152630 Sep 23 05:46:06.114866 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3789/7759] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:46:05 2022] GET /compute/v2.1/servers/2be14c16-aac7-41ad-b3a0-8503a8582271 => generated 1593 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:46:07.988527 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:46:07.989577 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:46:07.990179 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:46:07.994774 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-1bbcca34-5ac9-49a9-a72b-7af336812e26 req-5bca1e37-ea72-448e-bdf2-0b425c58701e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2be14c16-aac7-41ad-b3a0-8503a8582271", "tag": "f327f981-e8ae-499b-9f8d-01b058708eac"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:46:08.005197 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-1bbcca34-5ac9-49a9-a72b-7af336812e26 req-5bca1e37-ea72-448e-bdf2-0b425c58701e service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:46:08.005582 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-1bbcca34-5ac9-49a9-a72b-7af336812e26 req-5bca1e37-ea72-448e-bdf2-0b425c58701e service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:46:08.006066 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-1bbcca34-5ac9-49a9-a72b-7af336812e26 req-5bca1e37-ea72-448e-bdf2-0b425c58701e service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:46:08.018582 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-1bbcca34-5ac9-49a9-a72b-7af336812e26 req-5bca1e37-ea72-448e-bdf2-0b425c58701e service nova] Creating event network-changed:f327f981-e8ae-499b-9f8d-01b058708eac for instance 2be14c16-aac7-41ad-b3a0-8503a8582271 on n-h2-846463-3 Sep 23 05:46:08.024830 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-1bbcca34-5ac9-49a9-a72b-7af336812e26 req-5bca1e37-ea72-448e-bdf2-0b425c58701e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037865 Sep 23 05:46:08.025449 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3971/7760] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:46:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:46:10.908086 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f9f0006e-0575-4e65-ac46-2b98aad3ed1d tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1748411571"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:46:10.908622 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f9f0006e-0575-4e65-ac46-2b98aad3ed1d tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] [instance: 2be14c16-aac7-41ad-b3a0-8503a8582271] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:46:10.916694 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f9f0006e-0575-4e65-ac46-2b98aad3ed1d tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:46:10.917154 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f9f0006e-0575-4e65-ac46-2b98aad3ed1d tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:46:10.917614 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f9f0006e-0575-4e65-ac46-2b98aad3ed1d tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:46:10.918361 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f9f0006e-0575-4e65-ac46-2b98aad3ed1d tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:46:10.918837 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f9f0006e-0575-4e65-ac46-2b98aad3ed1d tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:46:10.919287 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f9f0006e-0575-4e65-ac46-2b98aad3ed1d tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:46:11.055116 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.network.security_group_api [None req-f9f0006e-0575-4e65-ac46-2b98aad3ed1d tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Adding security group 9e05129e-d7f3-4566-91c4-558d5d6eaea8 to port f327f981-e8ae-499b-9f8d-01b058708eac Sep 23 05:46:11.478136 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f9f0006e-0575-4e65-ac46-2b98aad3ed1d tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] 10.222.0.33 "POST /compute/v2.1/servers/2be14c16-aac7-41ad-b3a0-8503a8582271/action" status: 202 len: 0 microversion: 2.1 time: 0.574062 Sep 23 05:46:11.482432 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3790/7761] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 05:46:10 2022] POST /compute/v2.1/servers/2be14c16-aac7-41ad-b3a0-8503a8582271/action => generated 0 bytes in 576 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 05:46:11.488329 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2ce9b98f-7140-4b8c-823c-af47f25d380b tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:46:11.489286 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-2ce9b98f-7140-4b8c-823c-af47f25d380b tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] [instance: 2be14c16-aac7-41ad-b3a0-8503a8582271] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:46:11.490312 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-621c91d4-78ed-4590-b32b-0dec6679202e req-4cab24fa-5b6d-4688-b1e0-ee37004020ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2be14c16-aac7-41ad-b3a0-8503a8582271", "tag": "f327f981-e8ae-499b-9f8d-01b058708eac"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:46:11.497530 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2ce9b98f-7140-4b8c-823c-af47f25d380b tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:46:11.498984 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2ce9b98f-7140-4b8c-823c-af47f25d380b tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:46:11.499193 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2ce9b98f-7140-4b8c-823c-af47f25d380b tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:46:11.500546 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2ce9b98f-7140-4b8c-823c-af47f25d380b tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:46:11.501099 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2ce9b98f-7140-4b8c-823c-af47f25d380b tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:46:11.501671 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2ce9b98f-7140-4b8c-823c-af47f25d380b tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:46:11.506973 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-621c91d4-78ed-4590-b32b-0dec6679202e req-4cab24fa-5b6d-4688-b1e0-ee37004020ec service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:46:11.513261 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-621c91d4-78ed-4590-b32b-0dec6679202e req-4cab24fa-5b6d-4688-b1e0-ee37004020ec service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:46:11.513261 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-621c91d4-78ed-4590-b32b-0dec6679202e req-4cab24fa-5b6d-4688-b1e0-ee37004020ec service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:46:11.525522 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-621c91d4-78ed-4590-b32b-0dec6679202e req-4cab24fa-5b6d-4688-b1e0-ee37004020ec service nova] Creating event network-changed:f327f981-e8ae-499b-9f8d-01b058708eac for instance 2be14c16-aac7-41ad-b3a0-8503a8582271 on n-h2-846463-3 Sep 23 05:46:11.533531 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-621c91d4-78ed-4590-b32b-0dec6679202e req-4cab24fa-5b6d-4688-b1e0-ee37004020ec service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049037 Sep 23 05:46:11.534796 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3972/7762] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:46:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:46:11.674463 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-2ce9b98f-7140-4b8c-823c-af47f25d380b tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327d75316ac943feafd46049c2267a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f008a7ab34b4a8d956c6200b4adc3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:46:11.688906 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2ce9b98f-7140-4b8c-823c-af47f25d380b tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] 10.222.0.33 "GET /compute/v2.1/servers/2be14c16-aac7-41ad-b3a0-8503a8582271" status: 200 len: 1758 microversion: 2.1 time: 0.204791 Sep 23 05:46:11.690249 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3791/7763] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:46:11 2022] GET /compute/v2.1/servers/2be14c16-aac7-41ad-b3a0-8503a8582271 => generated 1758 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:46:21.173485 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-280d92b2-5b59-49b1-9934-ccb4ec479703 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:46:21.175853 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-280d92b2-5b59-49b1-9934-ccb4ec479703 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] [instance: 2be14c16-aac7-41ad-b3a0-8503a8582271] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:46:21.182742 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-280d92b2-5b59-49b1-9934-ccb4ec479703 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:46:21.184271 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-280d92b2-5b59-49b1-9934-ccb4ec479703 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:46:21.184271 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-280d92b2-5b59-49b1-9934-ccb4ec479703 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:46:21.184504 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-280d92b2-5b59-49b1-9934-ccb4ec479703 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:46:21.184890 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-280d92b2-5b59-49b1-9934-ccb4ec479703 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:46:21.185325 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-280d92b2-5b59-49b1-9934-ccb4ec479703 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:46:21.368975 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-280d92b2-5b59-49b1-9934-ccb4ec479703 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] 10.222.0.33 "POST /compute/v2.1/servers/2be14c16-aac7-41ad-b3a0-8503a8582271/action" status: 202 len: 0 microversion: 2.1 time: 0.247714 Sep 23 05:46:21.369595 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3973/7764] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 05:46:21 2022] POST /compute/v2.1/servers/2be14c16-aac7-41ad-b3a0-8503a8582271/action => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 05:46:21.379339 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-99f5083a-472f-43af-ac33-37bde8558b75 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:46:21.379339 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-99f5083a-472f-43af-ac33-37bde8558b75 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] [instance: 2be14c16-aac7-41ad-b3a0-8503a8582271] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:46:21.388491 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-99f5083a-472f-43af-ac33-37bde8558b75 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:46:21.389000 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-99f5083a-472f-43af-ac33-37bde8558b75 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:46:21.389456 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-99f5083a-472f-43af-ac33-37bde8558b75 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:46:21.390216 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-99f5083a-472f-43af-ac33-37bde8558b75 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:46:21.390733 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-99f5083a-472f-43af-ac33-37bde8558b75 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:46:21.391186 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-99f5083a-472f-43af-ac33-37bde8558b75 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:46:21.539170 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-99f5083a-472f-43af-ac33-37bde8558b75 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327d75316ac943feafd46049c2267a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f008a7ab34b4a8d956c6200b4adc3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:46:21.547740 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-99f5083a-472f-43af-ac33-37bde8558b75 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] 10.222.0.33 "GET /compute/v2.1/servers/2be14c16-aac7-41ad-b3a0-8503a8582271" status: 200 len: 1750 microversion: 2.1 time: 0.173108 Sep 23 05:46:21.548331 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3792/7765] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:46:21 2022] GET /compute/v2.1/servers/2be14c16-aac7-41ad-b3a0-8503a8582271 => generated 1750 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:46:22.572612 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-977dc111-1a2c-473a-8a15-f726ae798ed0 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:46:22.573322 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-977dc111-1a2c-473a-8a15-f726ae798ed0 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] [instance: 2be14c16-aac7-41ad-b3a0-8503a8582271] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:46:22.579851 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-977dc111-1a2c-473a-8a15-f726ae798ed0 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:46:22.580345 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-977dc111-1a2c-473a-8a15-f726ae798ed0 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:46:22.580794 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-977dc111-1a2c-473a-8a15-f726ae798ed0 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:46:22.581496 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-977dc111-1a2c-473a-8a15-f726ae798ed0 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:46:22.581994 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-977dc111-1a2c-473a-8a15-f726ae798ed0 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:46:22.582438 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-977dc111-1a2c-473a-8a15-f726ae798ed0 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:46:22.727116 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-977dc111-1a2c-473a-8a15-f726ae798ed0 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327d75316ac943feafd46049c2267a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f008a7ab34b4a8d956c6200b4adc3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:46:22.735753 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-977dc111-1a2c-473a-8a15-f726ae798ed0 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] 10.222.0.33 "GET /compute/v2.1/servers/2be14c16-aac7-41ad-b3a0-8503a8582271" status: 200 len: 1755 microversion: 2.1 time: 0.167983 Sep 23 05:46:22.736364 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3974/7766] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:46:22 2022] GET /compute/v2.1/servers/2be14c16-aac7-41ad-b3a0-8503a8582271 => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:46:23.764267 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1bd31cdd-1d11-4d15-a33e-ecfbb4bc7e69 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:46:23.764911 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-1bd31cdd-1d11-4d15-a33e-ecfbb4bc7e69 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] [instance: 2be14c16-aac7-41ad-b3a0-8503a8582271] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:46:23.772151 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1bd31cdd-1d11-4d15-a33e-ecfbb4bc7e69 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:46:23.772667 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1bd31cdd-1d11-4d15-a33e-ecfbb4bc7e69 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:46:23.773130 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1bd31cdd-1d11-4d15-a33e-ecfbb4bc7e69 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:46:23.773850 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1bd31cdd-1d11-4d15-a33e-ecfbb4bc7e69 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:46:23.774356 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1bd31cdd-1d11-4d15-a33e-ecfbb4bc7e69 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:46:23.774809 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1bd31cdd-1d11-4d15-a33e-ecfbb4bc7e69 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:46:23.919963 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-1bd31cdd-1d11-4d15-a33e-ecfbb4bc7e69 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327d75316ac943feafd46049c2267a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f008a7ab34b4a8d956c6200b4adc3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:46:23.928292 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-1bd31cdd-1d11-4d15-a33e-ecfbb4bc7e69 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] 10.222.0.33 "GET /compute/v2.1/servers/2be14c16-aac7-41ad-b3a0-8503a8582271" status: 200 len: 1755 microversion: 2.1 time: 0.168059 Sep 23 05:46:23.929497 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3793/7767] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:46:23 2022] GET /compute/v2.1/servers/2be14c16-aac7-41ad-b3a0-8503a8582271 => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:46:24.952544 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b08a72a4-1749-4ba3-9c78-4e53ce554225 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:46:24.953160 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b08a72a4-1749-4ba3-9c78-4e53ce554225 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] [instance: 2be14c16-aac7-41ad-b3a0-8503a8582271] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:46:24.959695 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b08a72a4-1749-4ba3-9c78-4e53ce554225 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:46:24.960865 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b08a72a4-1749-4ba3-9c78-4e53ce554225 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:46:24.961306 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b08a72a4-1749-4ba3-9c78-4e53ce554225 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:46:24.962031 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b08a72a4-1749-4ba3-9c78-4e53ce554225 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:46:24.962491 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b08a72a4-1749-4ba3-9c78-4e53ce554225 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:46:24.962925 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b08a72a4-1749-4ba3-9c78-4e53ce554225 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:46:25.103717 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b08a72a4-1749-4ba3-9c78-4e53ce554225 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327d75316ac943feafd46049c2267a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f008a7ab34b4a8d956c6200b4adc3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:46:25.112106 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b08a72a4-1749-4ba3-9c78-4e53ce554225 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] 10.222.0.33 "GET /compute/v2.1/servers/2be14c16-aac7-41ad-b3a0-8503a8582271" status: 200 len: 1755 microversion: 2.1 time: 0.163441 Sep 23 05:46:25.112682 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3975/7768] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:46:24 2022] GET /compute/v2.1/servers/2be14c16-aac7-41ad-b3a0-8503a8582271 => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:46:26.135632 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0de51d65-08c2-4c56-a7c6-b05a97477e54 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:46:26.136265 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-0de51d65-08c2-4c56-a7c6-b05a97477e54 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] [instance: 2be14c16-aac7-41ad-b3a0-8503a8582271] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:46:26.143189 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0de51d65-08c2-4c56-a7c6-b05a97477e54 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:46:26.143690 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0de51d65-08c2-4c56-a7c6-b05a97477e54 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:46:26.144404 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0de51d65-08c2-4c56-a7c6-b05a97477e54 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:46:26.145130 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0de51d65-08c2-4c56-a7c6-b05a97477e54 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:46:26.145602 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0de51d65-08c2-4c56-a7c6-b05a97477e54 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:46:26.146080 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0de51d65-08c2-4c56-a7c6-b05a97477e54 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:46:26.285592 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-0de51d65-08c2-4c56-a7c6-b05a97477e54 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327d75316ac943feafd46049c2267a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f008a7ab34b4a8d956c6200b4adc3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:46:26.294009 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0de51d65-08c2-4c56-a7c6-b05a97477e54 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] 10.222.0.33 "GET /compute/v2.1/servers/2be14c16-aac7-41ad-b3a0-8503a8582271" status: 200 len: 1755 microversion: 2.1 time: 0.162776 Sep 23 05:46:26.294588 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3794/7769] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:46:26 2022] GET /compute/v2.1/servers/2be14c16-aac7-41ad-b3a0-8503a8582271 => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:46:27.318036 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c21c5ca2-8876-4738-a5d8-2a8214a27760 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:46:27.318583 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c21c5ca2-8876-4738-a5d8-2a8214a27760 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] [instance: 2be14c16-aac7-41ad-b3a0-8503a8582271] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:46:27.325646 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c21c5ca2-8876-4738-a5d8-2a8214a27760 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:46:27.326171 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c21c5ca2-8876-4738-a5d8-2a8214a27760 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:46:27.326619 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c21c5ca2-8876-4738-a5d8-2a8214a27760 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:46:27.327330 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c21c5ca2-8876-4738-a5d8-2a8214a27760 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:46:27.327795 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c21c5ca2-8876-4738-a5d8-2a8214a27760 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:46:27.328230 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c21c5ca2-8876-4738-a5d8-2a8214a27760 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:46:27.472348 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c21c5ca2-8876-4738-a5d8-2a8214a27760 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327d75316ac943feafd46049c2267a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f008a7ab34b4a8d956c6200b4adc3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:46:27.481297 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c21c5ca2-8876-4738-a5d8-2a8214a27760 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] 10.222.0.33 "GET /compute/v2.1/servers/2be14c16-aac7-41ad-b3a0-8503a8582271" status: 200 len: 1755 microversion: 2.1 time: 0.167445 Sep 23 05:46:27.481876 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3976/7770] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:46:27 2022] GET /compute/v2.1/servers/2be14c16-aac7-41ad-b3a0-8503a8582271 => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:46:28.504715 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1e85dfc6-8738-48d4-bb19-e369e5d0ea49 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:46:28.505353 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-1e85dfc6-8738-48d4-bb19-e369e5d0ea49 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] [instance: 2be14c16-aac7-41ad-b3a0-8503a8582271] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:46:28.512306 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1e85dfc6-8738-48d4-bb19-e369e5d0ea49 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:46:28.512817 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1e85dfc6-8738-48d4-bb19-e369e5d0ea49 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:46:28.513272 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1e85dfc6-8738-48d4-bb19-e369e5d0ea49 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:46:28.514017 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1e85dfc6-8738-48d4-bb19-e369e5d0ea49 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:46:28.514492 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1e85dfc6-8738-48d4-bb19-e369e5d0ea49 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:46:28.514940 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1e85dfc6-8738-48d4-bb19-e369e5d0ea49 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:46:28.659483 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-1e85dfc6-8738-48d4-bb19-e369e5d0ea49 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327d75316ac943feafd46049c2267a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f008a7ab34b4a8d956c6200b4adc3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:46:28.668318 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-1e85dfc6-8738-48d4-bb19-e369e5d0ea49 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] 10.222.0.33 "GET /compute/v2.1/servers/2be14c16-aac7-41ad-b3a0-8503a8582271" status: 200 len: 1755 microversion: 2.1 time: 0.167579 Sep 23 05:46:28.668904 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3795/7771] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:46:28 2022] GET /compute/v2.1/servers/2be14c16-aac7-41ad-b3a0-8503a8582271 => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:46:29.692007 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2e6af839-0477-484d-9261-8241e70c06d0 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:46:29.692621 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-2e6af839-0477-484d-9261-8241e70c06d0 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] [instance: 2be14c16-aac7-41ad-b3a0-8503a8582271] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:46:29.699792 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2e6af839-0477-484d-9261-8241e70c06d0 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:46:29.700281 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2e6af839-0477-484d-9261-8241e70c06d0 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:46:29.700723 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2e6af839-0477-484d-9261-8241e70c06d0 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:46:29.701424 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2e6af839-0477-484d-9261-8241e70c06d0 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:46:29.701900 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2e6af839-0477-484d-9261-8241e70c06d0 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:46:29.702333 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2e6af839-0477-484d-9261-8241e70c06d0 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:46:29.846255 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2e6af839-0477-484d-9261-8241e70c06d0 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327d75316ac943feafd46049c2267a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f008a7ab34b4a8d956c6200b4adc3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:46:29.854582 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2e6af839-0477-484d-9261-8241e70c06d0 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] 10.222.0.33 "GET /compute/v2.1/servers/2be14c16-aac7-41ad-b3a0-8503a8582271" status: 200 len: 1755 microversion: 2.1 time: 0.166526 Sep 23 05:46:29.855164 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3977/7772] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:46:29 2022] GET /compute/v2.1/servers/2be14c16-aac7-41ad-b3a0-8503a8582271 => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:46:30.878486 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b3b7d365-f06d-4427-b3cc-5ed8ef29ecec tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:46:30.879125 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b3b7d365-f06d-4427-b3cc-5ed8ef29ecec tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] [instance: 2be14c16-aac7-41ad-b3a0-8503a8582271] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:46:30.886506 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b3b7d365-f06d-4427-b3cc-5ed8ef29ecec tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:46:30.887014 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b3b7d365-f06d-4427-b3cc-5ed8ef29ecec tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:46:30.887474 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b3b7d365-f06d-4427-b3cc-5ed8ef29ecec tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:46:30.888190 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b3b7d365-f06d-4427-b3cc-5ed8ef29ecec tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:46:30.888673 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b3b7d365-f06d-4427-b3cc-5ed8ef29ecec tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:46:30.889120 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b3b7d365-f06d-4427-b3cc-5ed8ef29ecec tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:46:31.033737 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b3b7d365-f06d-4427-b3cc-5ed8ef29ecec tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327d75316ac943feafd46049c2267a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f008a7ab34b4a8d956c6200b4adc3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:46:31.041989 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b3b7d365-f06d-4427-b3cc-5ed8ef29ecec tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] 10.222.0.33 "GET /compute/v2.1/servers/2be14c16-aac7-41ad-b3a0-8503a8582271" status: 200 len: 1755 microversion: 2.1 time: 0.167429 Sep 23 05:46:31.042559 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3796/7773] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:46:30 2022] GET /compute/v2.1/servers/2be14c16-aac7-41ad-b3a0-8503a8582271 => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:46:32.064533 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-883ab99e-922e-4c23-840b-90c49b0eafda tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:46:32.065147 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-883ab99e-922e-4c23-840b-90c49b0eafda tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] [instance: 2be14c16-aac7-41ad-b3a0-8503a8582271] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:46:32.071712 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-883ab99e-922e-4c23-840b-90c49b0eafda tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:46:32.072204 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-883ab99e-922e-4c23-840b-90c49b0eafda tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:46:32.072647 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-883ab99e-922e-4c23-840b-90c49b0eafda tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:46:32.073343 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-883ab99e-922e-4c23-840b-90c49b0eafda tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:46:32.073803 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-883ab99e-922e-4c23-840b-90c49b0eafda tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:46:32.074261 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-883ab99e-922e-4c23-840b-90c49b0eafda tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:46:32.223399 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-883ab99e-922e-4c23-840b-90c49b0eafda tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327d75316ac943feafd46049c2267a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f008a7ab34b4a8d956c6200b4adc3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:46:32.231702 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-883ab99e-922e-4c23-840b-90c49b0eafda tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] 10.222.0.33 "GET /compute/v2.1/servers/2be14c16-aac7-41ad-b3a0-8503a8582271" status: 200 len: 1755 microversion: 2.1 time: 0.171086 Sep 23 05:46:32.232276 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3978/7774] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:46:32 2022] GET /compute/v2.1/servers/2be14c16-aac7-41ad-b3a0-8503a8582271 => generated 1755 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:46:33.255558 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2262a748-6f09-406a-9175-806767d16f28 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:46:33.256116 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-2262a748-6f09-406a-9175-806767d16f28 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] [instance: 2be14c16-aac7-41ad-b3a0-8503a8582271] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:46:33.263195 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2262a748-6f09-406a-9175-806767d16f28 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:46:33.263705 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2262a748-6f09-406a-9175-806767d16f28 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:46:33.264168 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2262a748-6f09-406a-9175-806767d16f28 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:46:33.264883 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2262a748-6f09-406a-9175-806767d16f28 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:46:33.265363 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2262a748-6f09-406a-9175-806767d16f28 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:46:33.265813 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2262a748-6f09-406a-9175-806767d16f28 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:46:33.406555 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-2262a748-6f09-406a-9175-806767d16f28 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327d75316ac943feafd46049c2267a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f008a7ab34b4a8d956c6200b4adc3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:46:33.415447 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2262a748-6f09-406a-9175-806767d16f28 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] 10.222.0.33 "GET /compute/v2.1/servers/2be14c16-aac7-41ad-b3a0-8503a8582271" status: 200 len: 1758 microversion: 2.1 time: 0.163888 Sep 23 05:46:33.416020 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3797/7775] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:46:33 2022] GET /compute/v2.1/servers/2be14c16-aac7-41ad-b3a0-8503a8582271 => generated 1758 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:47:05.632068 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ea5e6aaf-8089-4454-914a-097f8a12227a tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1748411571"}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:47:05.632653 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ea5e6aaf-8089-4454-914a-097f8a12227a tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] [instance: 2be14c16-aac7-41ad-b3a0-8503a8582271] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:47:05.634940 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=16 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:47:05.635592 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:47:05.640290 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ea5e6aaf-8089-4454-914a-097f8a12227a tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:47:05.640845 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ea5e6aaf-8089-4454-914a-097f8a12227a tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:47:05.641283 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ea5e6aaf-8089-4454-914a-097f8a12227a tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:47:05.641997 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ea5e6aaf-8089-4454-914a-097f8a12227a tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:47:05.642460 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ea5e6aaf-8089-4454-914a-097f8a12227a tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:47:05.645953 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ea5e6aaf-8089-4454-914a-097f8a12227a tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:47:05.771459 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.network.security_group_api [None req-ea5e6aaf-8089-4454-914a-097f8a12227a tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Removing security group 9e05129e-d7f3-4566-91c4-558d5d6eaea8 from port f327f981-e8ae-499b-9f8d-01b058708eac Sep 23 05:47:06.114958 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ea5e6aaf-8089-4454-914a-097f8a12227a tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] 10.222.0.33 "POST /compute/v2.1/servers/2be14c16-aac7-41ad-b3a0-8503a8582271/action" status: 202 len: 0 microversion: 2.1 time: 0.486695 Sep 23 05:47:06.125014 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-c09457dd-924f-48bd-bf73-9862756804fc req-04d05515-e951-4b7f-b092-b5da005ace0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2be14c16-aac7-41ad-b3a0-8503a8582271", "tag": "f327f981-e8ae-499b-9f8d-01b058708eac"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:47:06.126317 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3979/7776] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 05:47:05 2022] POST /compute/v2.1/servers/2be14c16-aac7-41ad-b3a0-8503a8582271/action => generated 0 bytes in 499 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 05:47:06.138881 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=18 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:47:06.139444 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=52 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:47:06.152606 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-c09457dd-924f-48bd-bf73-9862756804fc req-04d05515-e951-4b7f-b092-b5da005ace0f service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:47:06.153067 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-c09457dd-924f-48bd-bf73-9862756804fc req-04d05515-e951-4b7f-b092-b5da005ace0f service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:47:06.153545 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-c09457dd-924f-48bd-bf73-9862756804fc req-04d05515-e951-4b7f-b092-b5da005ace0f service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:47:06.174774 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-c09457dd-924f-48bd-bf73-9862756804fc req-04d05515-e951-4b7f-b092-b5da005ace0f service nova] Creating event network-changed:f327f981-e8ae-499b-9f8d-01b058708eac for instance 2be14c16-aac7-41ad-b3a0-8503a8582271 on n-h2-846463-3 Sep 23 05:47:06.182966 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-c09457dd-924f-48bd-bf73-9862756804fc req-04d05515-e951-4b7f-b092-b5da005ace0f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061668 Sep 23 05:47:06.186557 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3798/7777] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:47:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:47:07.652268 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-34b32849-ecd5-4ffd-9567-ec32214d1451 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:47:07.652813 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-34b32849-ecd5-4ffd-9567-ec32214d1451 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] [instance: 2be14c16-aac7-41ad-b3a0-8503a8582271] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:47:07.658764 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-34b32849-ecd5-4ffd-9567-ec32214d1451 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:47:07.659251 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-34b32849-ecd5-4ffd-9567-ec32214d1451 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:47:07.659686 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-34b32849-ecd5-4ffd-9567-ec32214d1451 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:47:07.660370 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-34b32849-ecd5-4ffd-9567-ec32214d1451 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:47:07.660824 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-34b32849-ecd5-4ffd-9567-ec32214d1451 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:47:07.661245 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-34b32849-ecd5-4ffd-9567-ec32214d1451 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:47:07.742410 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-34b32849-ecd5-4ffd-9567-ec32214d1451 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lazy-loading 'services' on Instance uuid 2be14c16-aac7-41ad-b3a0-8503a8582271 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 05:47:07.933899 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-34b32849-ecd5-4ffd-9567-ec32214d1451 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] 10.222.0.33 "DELETE /compute/v2.1/servers/2be14c16-aac7-41ad-b3a0-8503a8582271/os-volume_attachments/5772def3-1732-4ca3-ab65-db6442bd75cd" status: 202 len: 0 microversion: 2.1 time: 0.286762 Sep 23 05:47:07.934565 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3980/7778] 10.222.0.33 () {58 vars in 1416 bytes} [Fri Sep 23 05:47:07 2022] DELETE /compute/v2.1/servers/2be14c16-aac7-41ad-b3a0-8503a8582271/os-volume_attachments/5772def3-1732-4ca3-ab65-db6442bd75cd => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 05:47:07.945814 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d30f3797-50da-4978-9294-36fce6309c25 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:47:07.948837 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d30f3797-50da-4978-9294-36fce6309c25 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] [instance: 2be14c16-aac7-41ad-b3a0-8503a8582271] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:47:07.956029 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d30f3797-50da-4978-9294-36fce6309c25 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:47:07.956658 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d30f3797-50da-4978-9294-36fce6309c25 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:47:07.957255 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d30f3797-50da-4978-9294-36fce6309c25 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:47:07.958098 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d30f3797-50da-4978-9294-36fce6309c25 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:47:07.958821 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d30f3797-50da-4978-9294-36fce6309c25 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:47:07.959266 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d30f3797-50da-4978-9294-36fce6309c25 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:47:07.989585 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d30f3797-50da-4978-9294-36fce6309c25 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] 10.222.0.33 "GET /compute/v2.1/servers/2be14c16-aac7-41ad-b3a0-8503a8582271/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050457 Sep 23 05:47:07.990204 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3799/7779] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Sep 23 05:47:07 2022] GET /compute/v2.1/servers/2be14c16-aac7-41ad-b3a0-8503a8582271/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:47:08.200677 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-a865c668-2194-49fa-ac30-5fb023f595a5 req-e704999a-20f8-47d7-9596-649813f6d985 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2be14c16-aac7-41ad-b3a0-8503a8582271", "tag": "f327f981-e8ae-499b-9f8d-01b058708eac"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:47:08.211593 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-a865c668-2194-49fa-ac30-5fb023f595a5 req-e704999a-20f8-47d7-9596-649813f6d985 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:47:08.212145 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-a865c668-2194-49fa-ac30-5fb023f595a5 req-e704999a-20f8-47d7-9596-649813f6d985 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:47:08.212586 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-a865c668-2194-49fa-ac30-5fb023f595a5 req-e704999a-20f8-47d7-9596-649813f6d985 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:47:08.226954 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-a865c668-2194-49fa-ac30-5fb023f595a5 req-e704999a-20f8-47d7-9596-649813f6d985 service nova] Creating event network-changed:f327f981-e8ae-499b-9f8d-01b058708eac for instance 2be14c16-aac7-41ad-b3a0-8503a8582271 on n-h2-846463-3 Sep 23 05:47:08.232349 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-a865c668-2194-49fa-ac30-5fb023f595a5 req-e704999a-20f8-47d7-9596-649813f6d985 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035745 Sep 23 05:47:08.232973 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3981/7780] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:47:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:47:09.003225 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-94e9c8df-3d85-49d1-906d-e140ca8963ff tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:47:09.005374 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-94e9c8df-3d85-49d1-906d-e140ca8963ff tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] [instance: 2be14c16-aac7-41ad-b3a0-8503a8582271] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:47:09.013773 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-94e9c8df-3d85-49d1-906d-e140ca8963ff tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:47:09.014310 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-94e9c8df-3d85-49d1-906d-e140ca8963ff tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:47:09.014776 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-94e9c8df-3d85-49d1-906d-e140ca8963ff tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:47:09.015521 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-94e9c8df-3d85-49d1-906d-e140ca8963ff tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:47:09.016002 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-94e9c8df-3d85-49d1-906d-e140ca8963ff tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:47:09.016437 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-94e9c8df-3d85-49d1-906d-e140ca8963ff tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:47:09.047204 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-94e9c8df-3d85-49d1-906d-e140ca8963ff tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] 10.222.0.33 "GET /compute/v2.1/servers/2be14c16-aac7-41ad-b3a0-8503a8582271/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048048 Sep 23 05:47:09.047789 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3800/7781] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Sep 23 05:47:08 2022] GET /compute/v2.1/servers/2be14c16-aac7-41ad-b3a0-8503a8582271/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:47:10.062477 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-adf528a5-739a-4c48-b867-b84039481f0e tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:47:10.064813 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-adf528a5-739a-4c48-b867-b84039481f0e tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] [instance: 2be14c16-aac7-41ad-b3a0-8503a8582271] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:47:10.072651 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-adf528a5-739a-4c48-b867-b84039481f0e tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:47:10.073166 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-adf528a5-739a-4c48-b867-b84039481f0e tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:47:10.073619 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-adf528a5-739a-4c48-b867-b84039481f0e tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:47:10.074374 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-adf528a5-739a-4c48-b867-b84039481f0e tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:47:10.074845 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-adf528a5-739a-4c48-b867-b84039481f0e tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:47:10.075280 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-adf528a5-739a-4c48-b867-b84039481f0e tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:47:10.107678 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-adf528a5-739a-4c48-b867-b84039481f0e tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] 10.222.0.33 "GET /compute/v2.1/servers/2be14c16-aac7-41ad-b3a0-8503a8582271/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050906 Sep 23 05:47:10.108269 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3982/7782] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Sep 23 05:47:10 2022] GET /compute/v2.1/servers/2be14c16-aac7-41ad-b3a0-8503a8582271/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:47:11.120387 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-fd96f9a6-50d8-438a-914e-c51046c5a48b tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:47:11.122720 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-fd96f9a6-50d8-438a-914e-c51046c5a48b tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] [instance: 2be14c16-aac7-41ad-b3a0-8503a8582271] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:47:11.129542 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fd96f9a6-50d8-438a-914e-c51046c5a48b tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:47:11.130092 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fd96f9a6-50d8-438a-914e-c51046c5a48b tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:47:11.130546 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fd96f9a6-50d8-438a-914e-c51046c5a48b tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:47:11.131253 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fd96f9a6-50d8-438a-914e-c51046c5a48b tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:47:11.132210 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fd96f9a6-50d8-438a-914e-c51046c5a48b tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:47:11.132649 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fd96f9a6-50d8-438a-914e-c51046c5a48b tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:47:11.165365 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-fd96f9a6-50d8-438a-914e-c51046c5a48b tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] 10.222.0.33 "GET /compute/v2.1/servers/2be14c16-aac7-41ad-b3a0-8503a8582271/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048823 Sep 23 05:47:11.165949 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3801/7783] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Sep 23 05:47:11 2022] GET /compute/v2.1/servers/2be14c16-aac7-41ad-b3a0-8503a8582271/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:47:12.177394 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7146586f-20a9-418c-94ce-299fe586ce4a tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:47:12.180413 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-7146586f-20a9-418c-94ce-299fe586ce4a tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] [instance: 2be14c16-aac7-41ad-b3a0-8503a8582271] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:47:12.187561 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7146586f-20a9-418c-94ce-299fe586ce4a tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:47:12.188130 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7146586f-20a9-418c-94ce-299fe586ce4a tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:47:12.188647 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7146586f-20a9-418c-94ce-299fe586ce4a tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:47:12.189421 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7146586f-20a9-418c-94ce-299fe586ce4a tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:47:12.189985 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7146586f-20a9-418c-94ce-299fe586ce4a tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:47:12.190492 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7146586f-20a9-418c-94ce-299fe586ce4a tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:47:12.220178 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-7146586f-20a9-418c-94ce-299fe586ce4a tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] 10.222.0.33 "GET /compute/v2.1/servers/2be14c16-aac7-41ad-b3a0-8503a8582271/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046866 Sep 23 05:47:12.220757 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3983/7784] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Sep 23 05:47:12 2022] GET /compute/v2.1/servers/2be14c16-aac7-41ad-b3a0-8503a8582271/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:47:13.232741 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3f1bf170-2166-41dd-843d-14ce79aa3bbb tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:47:13.236060 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3f1bf170-2166-41dd-843d-14ce79aa3bbb tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] [instance: 2be14c16-aac7-41ad-b3a0-8503a8582271] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:47:13.242930 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3f1bf170-2166-41dd-843d-14ce79aa3bbb tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:47:13.243436 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3f1bf170-2166-41dd-843d-14ce79aa3bbb tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:47:13.243896 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3f1bf170-2166-41dd-843d-14ce79aa3bbb tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:47:13.244620 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3f1bf170-2166-41dd-843d-14ce79aa3bbb tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:47:13.245097 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3f1bf170-2166-41dd-843d-14ce79aa3bbb tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:47:13.245540 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3f1bf170-2166-41dd-843d-14ce79aa3bbb tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:47:13.276159 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3f1bf170-2166-41dd-843d-14ce79aa3bbb tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] 10.222.0.33 "GET /compute/v2.1/servers/2be14c16-aac7-41ad-b3a0-8503a8582271/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047289 Sep 23 05:47:13.276658 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3802/7785] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Sep 23 05:47:13 2022] GET /compute/v2.1/servers/2be14c16-aac7-41ad-b3a0-8503a8582271/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 05:47:13.287531 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-fbe10adb-aaed-4c33-afa3-95310939dc46 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:47:13.288687 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-fbe10adb-aaed-4c33-afa3-95310939dc46 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] [instance: 2be14c16-aac7-41ad-b3a0-8503a8582271] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:47:13.295190 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fbe10adb-aaed-4c33-afa3-95310939dc46 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:47:13.295683 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fbe10adb-aaed-4c33-afa3-95310939dc46 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:47:13.296123 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fbe10adb-aaed-4c33-afa3-95310939dc46 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:47:13.296822 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fbe10adb-aaed-4c33-afa3-95310939dc46 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:47:13.297290 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fbe10adb-aaed-4c33-afa3-95310939dc46 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:47:13.297726 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fbe10adb-aaed-4c33-afa3-95310939dc46 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:47:13.385150 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-fbe10adb-aaed-4c33-afa3-95310939dc46 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] HTTP exception thrown: Instance 2be14c16-aac7-41ad-b3a0-8503a8582271 is not attached to volume 5772def3-1732-4ca3-ab65-db6442bd75cd Sep 23 05:47:13.386870 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-fbe10adb-aaed-4c33-afa3-95310939dc46 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Request method failure captured: Sep 23 05:47:13.386870 n-d-846463-3 devstack@n-api.service[122699]: request: DELETE /compute/v2.1/servers/2be14c16-aac7-41ad-b3a0-8503a8582271/os-volume_attachments/5772def3-1732-4ca3-ab65-db6442bd75cd HTTP/1.1 Sep 23 05:47:13.386870 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 05:47:13.386870 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 05:47:13.386870 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 05:47:13.386870 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 05:47:13.386870 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 05:47:13.386870 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 05:47:13.386870 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 05:47:13.386870 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 05:47:13.386870 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLUb5WPCRrxt-pjo0wq3llkI2HedrkywOSh1wcJZCpDrqfJyBF9ombOvpKlEA9l1PT53t7j9CxSnG4wj4CsqwqgTeL-DZFkf8i38QVFN14bko1kEeUCJJeuOTaTpU9f3RhBv2GaI1r0NmzPN2GiYMG-Q1LSsW9v2AzawKnWKP1U9ZKzw Sep 23 05:47:13.386870 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 05:47:13.386870 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 05:47:13.386870 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 05:47:13.386870 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 05:47:13.386870 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 05:47:13.386870 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 05:47:13.386870 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 8f008a7ab34b4a8d956c6200b4adc3ed Sep 23 05:47:13.386870 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-TestMinimumBasicScenario-561736272 Sep 23 05:47:13.386870 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 05:47:13.386870 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 05:47:13.386870 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8f008a7ab34b4a8d956c6200b4adc3ed", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8f008a7ab34b4a8d956c6200b4adc3ed"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8f008a7ab34b4a8d956c6200b4adc3ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8f008a7ab34b4a8d956c6200b4adc3ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:47:13.386870 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-TestMinimumBasicScenario-561736272 Sep 23 05:47:13.386870 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 8f008a7ab34b4a8d956c6200b4adc3ed Sep 23 05:47:13.386870 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-TestMinimumBasicScenario-561736272 Sep 23 05:47:13.386870 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-TestMinimumBasicScenario-561736272-project Sep 23 05:47:13.386870 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 05:47:13.386870 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 05:47:13.386870 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 327d75316ac943feafd46049c2267a7e Sep 23 05:47:13.386870 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-TestMinimumBasicScenario-561736272-project Sep 23 05:47:13.386870 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 05:47:13.386870 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 2be14c16-aac7-41ad-b3a0-8503a8582271 is not attached to volume 5772def3-1732-4ca3-ab65-db6442bd75cd Sep 23 05:47:13.386870 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'server_id': '2be14c16-aac7-41ad-b3a0-8503a8582271', 'id': '5772def3-1732-4ca3-ab65-db6442bd75cd'} Sep 23 05:47:13.386870 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:47:13.386870 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:47:13.386870 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 23 05:47:13.386870 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 23 05:47:13.386870 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 05:47:13.386870 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 05:47:13.386870 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 23 05:47:13.386870 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 23 05:47:13.386870 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 5772def3-1732-4ca3-ab65-db6442bd75cd. Sep 23 05:47:13.386870 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:47:13.386870 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:47:13.386870 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:47:13.386870 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:47:13.386870 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:47:13.386870 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:47:13.386870 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:47:13.386870 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:47:13.386870 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:47:13.386870 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:47:13.386870 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 23 05:47:13.386870 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 23 05:47:13.386870 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2be14c16-aac7-41ad-b3a0-8503a8582271 is not attached to volume 5772def3-1732-4ca3-ab65-db6442bd75cd Sep 23 05:47:13.386870 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:47:13.386870 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:47:13.386870 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:47:13.386870 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:47:13.386870 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:47:13.386870 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:47:13.392818 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:47:13.392818 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:47:13.392818 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2be14c16-aac7-41ad-b3a0-8503a8582271 is not attached to volume 5772def3-1732-4ca3-ab65-db6442bd75cd Sep 23 05:47:13.392818 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:47:13.392818 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-fbe10adb-aaed-4c33-afa3-95310939dc46 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Returning 404 to user: Instance 2be14c16-aac7-41ad-b3a0-8503a8582271 is not attached to volume 5772def3-1732-4ca3-ab65-db6442bd75cd {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:47:13.392818 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-fbe10adb-aaed-4c33-afa3-95310939dc46 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] 10.222.0.33 "DELETE /compute/v2.1/servers/2be14c16-aac7-41ad-b3a0-8503a8582271/os-volume_attachments/5772def3-1732-4ca3-ab65-db6442bd75cd" status: 404 len: 154 microversion: 2.1 time: 0.105437 Sep 23 05:47:13.392818 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3984/7786] 10.222.0.33 () {58 vars in 1416 bytes} [Fri Sep 23 05:47:13 2022] DELETE /compute/v2.1/servers/2be14c16-aac7-41ad-b3a0-8503a8582271/os-volume_attachments/5772def3-1732-4ca3-ab65-db6442bd75cd => generated 154 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 05:47:16.814044 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1692f5e7-44d3-492a-ba33-991e2cf9b808 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:47:16.814637 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-1692f5e7-44d3-492a-ba33-991e2cf9b808 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] [instance: 2be14c16-aac7-41ad-b3a0-8503a8582271] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:47:16.821707 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1692f5e7-44d3-492a-ba33-991e2cf9b808 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:47:16.824461 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1692f5e7-44d3-492a-ba33-991e2cf9b808 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:47:16.824461 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1692f5e7-44d3-492a-ba33-991e2cf9b808 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:47:16.824461 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1692f5e7-44d3-492a-ba33-991e2cf9b808 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:47:16.824461 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1692f5e7-44d3-492a-ba33-991e2cf9b808 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:47:16.824461 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1692f5e7-44d3-492a-ba33-991e2cf9b808 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:47:16.851378 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-1692f5e7-44d3-492a-ba33-991e2cf9b808 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] [instance: 2be14c16-aac7-41ad-b3a0-8503a8582271] Going to try to terminate instance {{(pid=122698) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 05:47:17.148531 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-1692f5e7-44d3-492a-ba33-991e2cf9b808 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] 10.222.0.33 "DELETE /compute/v2.1/servers/2be14c16-aac7-41ad-b3a0-8503a8582271" status: 204 len: 0 microversion: 2.1 time: 0.338297 Sep 23 05:47:17.149132 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3803/7787] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 05:47:16 2022] DELETE /compute/v2.1/servers/2be14c16-aac7-41ad-b3a0-8503a8582271 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 05:47:17.157353 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-51d0f6bf-54bf-4205-adc9-586e73b0b3a4 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:47:17.158148 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-51d0f6bf-54bf-4205-adc9-586e73b0b3a4 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] [instance: 2be14c16-aac7-41ad-b3a0-8503a8582271] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:47:17.164816 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-51d0f6bf-54bf-4205-adc9-586e73b0b3a4 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:47:17.165313 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-51d0f6bf-54bf-4205-adc9-586e73b0b3a4 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:47:17.165756 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-51d0f6bf-54bf-4205-adc9-586e73b0b3a4 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:47:17.166488 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-51d0f6bf-54bf-4205-adc9-586e73b0b3a4 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:47:17.166955 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-51d0f6bf-54bf-4205-adc9-586e73b0b3a4 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:47:17.167393 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-51d0f6bf-54bf-4205-adc9-586e73b0b3a4 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:47:17.309554 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-51d0f6bf-54bf-4205-adc9-586e73b0b3a4 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327d75316ac943feafd46049c2267a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f008a7ab34b4a8d956c6200b4adc3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:47:17.317840 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-51d0f6bf-54bf-4205-adc9-586e73b0b3a4 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] 10.222.0.33 "GET /compute/v2.1/servers/2be14c16-aac7-41ad-b3a0-8503a8582271" status: 200 len: 1553 microversion: 2.1 time: 0.164376 Sep 23 05:47:17.318439 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3985/7788] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:47:17 2022] GET /compute/v2.1/servers/2be14c16-aac7-41ad-b3a0-8503a8582271 => generated 1553 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:47:18.343767 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4c793b56-089c-4a92-8da9-799659e09dbc tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:47:18.344497 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4c793b56-089c-4a92-8da9-799659e09dbc tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] [instance: 2be14c16-aac7-41ad-b3a0-8503a8582271] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:47:18.351426 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4c793b56-089c-4a92-8da9-799659e09dbc tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:47:18.351938 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4c793b56-089c-4a92-8da9-799659e09dbc tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:47:18.352401 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4c793b56-089c-4a92-8da9-799659e09dbc tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:47:18.353120 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4c793b56-089c-4a92-8da9-799659e09dbc tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:47:18.353595 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4c793b56-089c-4a92-8da9-799659e09dbc tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:47:18.354073 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4c793b56-089c-4a92-8da9-799659e09dbc tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:47:18.482884 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4c793b56-089c-4a92-8da9-799659e09dbc tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327d75316ac943feafd46049c2267a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f008a7ab34b4a8d956c6200b4adc3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:47:18.491244 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4c793b56-089c-4a92-8da9-799659e09dbc tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] 10.222.0.33 "GET /compute/v2.1/servers/2be14c16-aac7-41ad-b3a0-8503a8582271" status: 200 len: 1553 microversion: 2.1 time: 0.152228 Sep 23 05:47:18.491816 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3804/7789] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:47:18 2022] GET /compute/v2.1/servers/2be14c16-aac7-41ad-b3a0-8503a8582271 => generated 1553 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:47:19.304275 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-8c5d5809-ed75-440d-bad8-126551103f57 req-5a6ce915-c838-4f4d-97bf-f5c4d60a0d21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2be14c16-aac7-41ad-b3a0-8503a8582271", "name": "network-vif-deleted", "tag": "f327f981-e8ae-499b-9f8d-01b058708eac"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:47:19.314752 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-8c5d5809-ed75-440d-bad8-126551103f57 req-5a6ce915-c838-4f4d-97bf-f5c4d60a0d21 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:47:19.315244 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-8c5d5809-ed75-440d-bad8-126551103f57 req-5a6ce915-c838-4f4d-97bf-f5c4d60a0d21 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:47:19.316961 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-8c5d5809-ed75-440d-bad8-126551103f57 req-5a6ce915-c838-4f4d-97bf-f5c4d60a0d21 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:47:19.334005 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-8c5d5809-ed75-440d-bad8-126551103f57 req-5a6ce915-c838-4f4d-97bf-f5c4d60a0d21 service nova] Creating event network-vif-deleted:f327f981-e8ae-499b-9f8d-01b058708eac for instance 2be14c16-aac7-41ad-b3a0-8503a8582271 on n-h2-846463-3 Sep 23 05:47:19.339731 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-8c5d5809-ed75-440d-bad8-126551103f57 req-5a6ce915-c838-4f4d-97bf-f5c4d60a0d21 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039214 Sep 23 05:47:19.340335 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3986/7790] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:47:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:47:19.515605 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3db34906-b8bc-4d77-8fce-afb18d751ed5 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:47:19.516224 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3db34906-b8bc-4d77-8fce-afb18d751ed5 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] [instance: 2be14c16-aac7-41ad-b3a0-8503a8582271] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:47:19.524603 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3db34906-b8bc-4d77-8fce-afb18d751ed5 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:47:19.527150 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3db34906-b8bc-4d77-8fce-afb18d751ed5 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:47:19.527150 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3db34906-b8bc-4d77-8fce-afb18d751ed5 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:47:19.527150 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3db34906-b8bc-4d77-8fce-afb18d751ed5 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:47:19.527150 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3db34906-b8bc-4d77-8fce-afb18d751ed5 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:47:19.527817 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3db34906-b8bc-4d77-8fce-afb18d751ed5 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:47:19.594010 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-3db34906-b8bc-4d77-8fce-afb18d751ed5 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '327d75316ac943feafd46049c2267a7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f008a7ab34b4a8d956c6200b4adc3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:47:19.604591 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3db34906-b8bc-4d77-8fce-afb18d751ed5 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] 10.222.0.33 "GET /compute/v2.1/servers/2be14c16-aac7-41ad-b3a0-8503a8582271" status: 200 len: 1342 microversion: 2.1 time: 0.092994 Sep 23 05:47:19.605191 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3805/7791] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:47:19 2022] GET /compute/v2.1/servers/2be14c16-aac7-41ad-b3a0-8503a8582271 => generated 1342 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:47:20.628322 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-23735342-6c0e-4e5d-9ef1-67695af80e73 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:47:20.629028 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-23735342-6c0e-4e5d-9ef1-67695af80e73 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] [instance: 2be14c16-aac7-41ad-b3a0-8503a8582271] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:47:20.636367 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-23735342-6c0e-4e5d-9ef1-67695af80e73 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:47:20.636857 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-23735342-6c0e-4e5d-9ef1-67695af80e73 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:47:20.637297 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-23735342-6c0e-4e5d-9ef1-67695af80e73 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:47:20.638036 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-23735342-6c0e-4e5d-9ef1-67695af80e73 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:47:20.638498 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-23735342-6c0e-4e5d-9ef1-67695af80e73 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:47:20.638931 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-23735342-6c0e-4e5d-9ef1-67695af80e73 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:47:20.652372 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-23735342-6c0e-4e5d-9ef1-67695af80e73 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] HTTP exception thrown: Instance 2be14c16-aac7-41ad-b3a0-8503a8582271 could not be found. Sep 23 05:47:20.654045 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-23735342-6c0e-4e5d-9ef1-67695af80e73 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Request method failure captured: Sep 23 05:47:20.654045 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/2be14c16-aac7-41ad-b3a0-8503a8582271 HTTP/1.1 Sep 23 05:47:20.654045 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 05:47:20.654045 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 05:47:20.654045 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 05:47:20.654045 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 05:47:20.654045 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 05:47:20.654045 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 05:47:20.654045 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 05:47:20.654045 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 05:47:20.654045 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLUb5WPCRrxt-pjo0wq3llkI2HedrkywOSh1wcJZCpDrqfJyBF9ombOvpKlEA9l1PT53t7j9CxSnG4wj4CsqwqgTeL-DZFkf8i38QVFN14bko1kEeUCJJeuOTaTpU9f3RhBv2GaI1r0NmzPN2GiYMG-Q1LSsW9v2AzawKnWKP1U9ZKzw Sep 23 05:47:20.654045 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 05:47:20.654045 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 05:47:20.654045 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 05:47:20.654045 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 05:47:20.654045 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 05:47:20.654045 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 05:47:20.654045 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 8f008a7ab34b4a8d956c6200b4adc3ed Sep 23 05:47:20.654045 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-TestMinimumBasicScenario-561736272 Sep 23 05:47:20.654045 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 05:47:20.654045 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 05:47:20.654045 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8f008a7ab34b4a8d956c6200b4adc3ed", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8f008a7ab34b4a8d956c6200b4adc3ed"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8f008a7ab34b4a8d956c6200b4adc3ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8f008a7ab34b4a8d956c6200b4adc3ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:47:20.654045 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-TestMinimumBasicScenario-561736272 Sep 23 05:47:20.654045 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 8f008a7ab34b4a8d956c6200b4adc3ed Sep 23 05:47:20.654045 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-TestMinimumBasicScenario-561736272 Sep 23 05:47:20.654045 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-TestMinimumBasicScenario-561736272-project Sep 23 05:47:20.654045 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 05:47:20.654045 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 05:47:20.654045 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 327d75316ac943feafd46049c2267a7e Sep 23 05:47:20.654045 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-TestMinimumBasicScenario-561736272-project Sep 23 05:47:20.654045 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 05:47:20.654045 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 2be14c16-aac7-41ad-b3a0-8503a8582271 could not be found. Sep 23 05:47:20.654045 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '2be14c16-aac7-41ad-b3a0-8503a8582271'} Sep 23 05:47:20.654045 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:47:20.654045 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:47:20.654045 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 05:47:20.654045 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 05:47:20.654045 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 05:47:20.654045 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 05:47:20.654045 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 05:47:20.654045 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 05:47:20.654045 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 05:47:20.654045 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 05:47:20.654045 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2be14c16-aac7-41ad-b3a0-8503a8582271 could not be found. Sep 23 05:47:20.654045 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:47:20.654045 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:47:20.654045 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:47:20.654045 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:47:20.654045 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:47:20.654045 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:47:20.654045 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:47:20.654045 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:47:20.654045 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:47:20.654045 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:47:20.654045 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 05:47:20.654045 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 05:47:20.654045 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 05:47:20.654045 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 05:47:20.654045 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 05:47:20.654045 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:47:20.654045 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2be14c16-aac7-41ad-b3a0-8503a8582271 could not be found. Sep 23 05:47:20.654045 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:47:20.654045 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:47:20.654045 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:47:20.659386 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:47:20.659386 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:47:20.659386 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:47:20.659386 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:47:20.659386 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:47:20.659386 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2be14c16-aac7-41ad-b3a0-8503a8582271 could not be found. Sep 23 05:47:20.659386 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:47:20.659386 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-23735342-6c0e-4e5d-9ef1-67695af80e73 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Returning 404 to user: Instance 2be14c16-aac7-41ad-b3a0-8503a8582271 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:47:20.659386 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-23735342-6c0e-4e5d-9ef1-67695af80e73 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] 10.222.0.33 "GET /compute/v2.1/servers/2be14c16-aac7-41ad-b3a0-8503a8582271" status: 404 len: 111 microversion: 2.1 time: 0.031486 Sep 23 05:47:20.659386 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3987/7792] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:47:20 2022] GET /compute/v2.1/servers/2be14c16-aac7-41ad-b3a0-8503a8582271 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 05:47:20.664192 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-22e4ed38-abb2-45e1-b543-a401004c6f08 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] Calling method '.version_select at 0x7ff1bbf27dc0>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:47:20.743029 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-22e4ed38-abb2-45e1-b543-a401004c6f08 tempest-TestMinimumBasicScenario-561736272 tempest-TestMinimumBasicScenario-561736272-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-640633726" status: 202 len: 0 microversion: 2.1 time: 0.082621 Sep 23 05:47:20.743615 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3806/7793] 10.222.0.33 () {58 vars in 1269 bytes} [Fri Sep 23 05:47:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-640633726 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 05:47:32.281720 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=18 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:47:32.282481 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:47:32.445279 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f6d6b4eb-3d36-445d-9b91-f1bbb4492383 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Action: 'create', calling method: .version_select at 0x7ff1ba8aca60>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-960325802", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDpCo+iW/OPbH6+lKUsJL1T3RF/J9XrlrQ/3qRAZTP1zNdwzpov2sh4UjQ3bfzygVeoRfstGqZoACFB2jU4j0Kc5LUF1jk7wm2BN10qi9ucku/aQ8yRObUHMMH6zBEakDQ=="}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:47:32.461694 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-f6d6b4eb-3d36-445d-9b91-f1bbb4492383 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Getting quotas for project 498fb069adef49d19ed802d2133adb89. Resources: {'key_pairs'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 05:47:32.466960 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-f6d6b4eb-3d36-445d-9b91-f1bbb4492383 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Getting quotas for user e9d36972d8f2413b8838e64998b43359 and project 498fb069adef49d19ed802d2133adb89. Resources: {'key_pairs'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 05:47:32.571752 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f6d6b4eb-3d36-445d-9b91-f1bbb4492383 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.295103 Sep 23 05:47:32.572365 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3988/7794] 10.222.0.33 () {60 vars in 1159 bytes} [Fri Sep 23 05:47:32 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:47:40.919110 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f1fc2721-1cef-4dbc-a4d0-8340fc575906 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1190542135", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "networks": [{"uuid": "df436ed9-5af2-4e37-98a0-0e4e4988f657"}], "key_name": "tempest-TestNetworkAdvancedServerOps-960325802", "security_groups": [{"name": "tempest-secgroup-smoke-1850136085"}]}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:47:40.931240 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:47:40.932060 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:47:41.041413 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.network.neutron [None req-f1fc2721-1cef-4dbc-a4d0-8340fc575906 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] validate_networks() for [('df436ed9-5af2-4e37-98a0-0e4e4988f657', None, None, None, None, None)] {{(pid=122698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 05:47:41.506915 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-f1fc2721-1cef-4dbc-a4d0-8340fc575906 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Flavor limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 05:47:41.507369 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-f1fc2721-1cef-4dbc-a4d0-8340fc575906 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Image limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 05:47:41.507865 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-f1fc2721-1cef-4dbc-a4d0-8340fc575906 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Flavor pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 05:47:41.508299 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-f1fc2721-1cef-4dbc-a4d0-8340fc575906 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Image pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 05:47:41.509143 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-f1fc2721-1cef-4dbc-a4d0-8340fc575906 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 05:47:41.518466 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f1fc2721-1cef-4dbc-a4d0-8340fc575906 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:47:41.518979 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f1fc2721-1cef-4dbc-a4d0-8340fc575906 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:47:41.519443 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f1fc2721-1cef-4dbc-a4d0-8340fc575906 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:47:41.520457 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f1fc2721-1cef-4dbc-a4d0-8340fc575906 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:47:41.520936 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f1fc2721-1cef-4dbc-a4d0-8340fc575906 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:47:41.521410 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f1fc2721-1cef-4dbc-a4d0-8340fc575906 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:47:41.539154 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-f1fc2721-1cef-4dbc-a4d0-8340fc575906 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Getting quotas for project 498fb069adef49d19ed802d2133adb89. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 05:47:41.545192 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-f1fc2721-1cef-4dbc-a4d0-8340fc575906 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Getting quotas for user e9d36972d8f2413b8838e64998b43359 and project 498fb069adef49d19ed802d2133adb89. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 05:47:41.557842 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f1fc2721-1cef-4dbc-a4d0-8340fc575906 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Going to run 1 instances... {{(pid=122698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 05:47:41.560237 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f1fc2721-1cef-4dbc-a4d0-8340fc575906 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: df225dff-e869-447a-988c-9872618b01e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 05:47:41.698214 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f1fc2721-1cef-4dbc-a4d0-8340fc575906 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.783404 Sep 23 05:47:41.702897 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3807/7795] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 05:47:40 2022] POST /compute/v2.1/servers => generated 406 bytes in 785 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 05:47:41.711724 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a6105616-0e30-4d55-96fa-e6370c0e574d tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:47:41.712869 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a6105616-0e30-4d55-96fa-e6370c0e574d tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: df225dff-e869-447a-988c-9872618b01e5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:47:41.785398 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a6105616-0e30-4d55-96fa-e6370c0e574d tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:47:41.797801 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a6105616-0e30-4d55-96fa-e6370c0e574d tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/df225dff-e869-447a-988c-9872618b01e5" status: 200 len: 1266 microversion: 2.1 time: 0.090685 Sep 23 05:47:41.800397 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3989/7796] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:47:41 2022] GET /compute/v2.1/servers/df225dff-e869-447a-988c-9872618b01e5 => generated 1266 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:47:42.823559 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1105d6c6-65f7-4bee-8291-75b7014c83e9 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:47:42.824399 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-1105d6c6-65f7-4bee-8291-75b7014c83e9 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: df225dff-e869-447a-988c-9872618b01e5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:47:42.879669 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-1105d6c6-65f7-4bee-8291-75b7014c83e9 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:47:42.892573 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-1105d6c6-65f7-4bee-8291-75b7014c83e9 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/df225dff-e869-447a-988c-9872618b01e5" status: 200 len: 1266 microversion: 2.1 time: 0.074802 Sep 23 05:47:42.893175 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3808/7797] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:47:42 2022] GET /compute/v2.1/servers/df225dff-e869-447a-988c-9872618b01e5 => generated 1266 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:47:43.921449 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-644f11d8-8f66-440b-a6b3-6a44f4e4fb52 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:47:43.922672 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-644f11d8-8f66-440b-a6b3-6a44f4e4fb52 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: df225dff-e869-447a-988c-9872618b01e5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:47:43.929566 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-644f11d8-8f66-440b-a6b3-6a44f4e4fb52 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:47:43.930565 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-644f11d8-8f66-440b-a6b3-6a44f4e4fb52 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:47:43.930750 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-644f11d8-8f66-440b-a6b3-6a44f4e4fb52 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:47:43.931427 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-644f11d8-8f66-440b-a6b3-6a44f4e4fb52 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:47:43.931903 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-644f11d8-8f66-440b-a6b3-6a44f4e4fb52 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:47:43.932340 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-644f11d8-8f66-440b-a6b3-6a44f4e4fb52 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:47:43.998503 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-644f11d8-8f66-440b-a6b3-6a44f4e4fb52 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:47:44.006498 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-644f11d8-8f66-440b-a6b3-6a44f4e4fb52 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/df225dff-e869-447a-988c-9872618b01e5" status: 200 len: 1318 microversion: 2.1 time: 0.088959 Sep 23 05:47:44.007079 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3990/7798] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:47:43 2022] GET /compute/v2.1/servers/df225dff-e869-447a-988c-9872618b01e5 => generated 1318 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:47:45.033831 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-608f24bd-8f71-434c-b8a9-38ac984323dd tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:47:45.034650 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-608f24bd-8f71-434c-b8a9-38ac984323dd tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: df225dff-e869-447a-988c-9872618b01e5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:47:45.044044 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-608f24bd-8f71-434c-b8a9-38ac984323dd tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:47:45.044600 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-608f24bd-8f71-434c-b8a9-38ac984323dd tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:47:45.045142 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-608f24bd-8f71-434c-b8a9-38ac984323dd tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:47:45.045787 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-608f24bd-8f71-434c-b8a9-38ac984323dd tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:47:45.046295 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-608f24bd-8f71-434c-b8a9-38ac984323dd tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:47:45.046769 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-608f24bd-8f71-434c-b8a9-38ac984323dd tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:47:45.194901 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-608f24bd-8f71-434c-b8a9-38ac984323dd tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:47:45.203867 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-608f24bd-8f71-434c-b8a9-38ac984323dd tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/df225dff-e869-447a-988c-9872618b01e5" status: 200 len: 1392 microversion: 2.1 time: 0.173589 Sep 23 05:47:45.204758 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3809/7799] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:47:45 2022] GET /compute/v2.1/servers/df225dff-e869-447a-988c-9872618b01e5 => generated 1392 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:47:45.935775 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-191d1a7e-46d1-4a1b-8c7e-d5f4b22e199f req-b738ad86-dc94-498d-8fcf-6c9f0c061058 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df225dff-e869-447a-988c-9872618b01e5", "tag": "d8ccd56d-54ac-4e7d-aa11-3e4b52a40f72"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:47:45.946059 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-191d1a7e-46d1-4a1b-8c7e-d5f4b22e199f req-b738ad86-dc94-498d-8fcf-6c9f0c061058 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:47:45.947183 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-191d1a7e-46d1-4a1b-8c7e-d5f4b22e199f req-b738ad86-dc94-498d-8fcf-6c9f0c061058 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:47:45.947623 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-191d1a7e-46d1-4a1b-8c7e-d5f4b22e199f req-b738ad86-dc94-498d-8fcf-6c9f0c061058 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:47:45.958855 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-191d1a7e-46d1-4a1b-8c7e-d5f4b22e199f req-b738ad86-dc94-498d-8fcf-6c9f0c061058 service nova] Creating event network-changed:d8ccd56d-54ac-4e7d-aa11-3e4b52a40f72 for instance df225dff-e869-447a-988c-9872618b01e5 on n-h1-846463-3 Sep 23 05:47:45.963812 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-191d1a7e-46d1-4a1b-8c7e-d5f4b22e199f req-b738ad86-dc94-498d-8fcf-6c9f0c061058 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032107 Sep 23 05:47:45.964565 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3991/7800] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:47:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:47:46.228440 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9fcd707c-6c7d-4036-8686-9c8a7db26b83 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:47:46.229005 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-9fcd707c-6c7d-4036-8686-9c8a7db26b83 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: df225dff-e869-447a-988c-9872618b01e5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:47:46.236259 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9fcd707c-6c7d-4036-8686-9c8a7db26b83 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:47:46.236779 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9fcd707c-6c7d-4036-8686-9c8a7db26b83 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:47:46.237238 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9fcd707c-6c7d-4036-8686-9c8a7db26b83 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:47:46.238001 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9fcd707c-6c7d-4036-8686-9c8a7db26b83 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:47:46.238477 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9fcd707c-6c7d-4036-8686-9c8a7db26b83 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:47:46.238923 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9fcd707c-6c7d-4036-8686-9c8a7db26b83 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:47:46.381388 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-9fcd707c-6c7d-4036-8686-9c8a7db26b83 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:47:46.390586 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9fcd707c-6c7d-4036-8686-9c8a7db26b83 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/df225dff-e869-447a-988c-9872618b01e5" status: 200 len: 1392 microversion: 2.1 time: 0.166079 Sep 23 05:47:46.402360 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3810/7801] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:47:46 2022] GET /compute/v2.1/servers/df225dff-e869-447a-988c-9872618b01e5 => generated 1392 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:47:47.414951 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0742a59e-49cd-4fa2-85a8-f5d74ec0324e tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:47:47.415699 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-0742a59e-49cd-4fa2-85a8-f5d74ec0324e tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: df225dff-e869-447a-988c-9872618b01e5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:47:47.422681 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0742a59e-49cd-4fa2-85a8-f5d74ec0324e tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:47:47.423180 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0742a59e-49cd-4fa2-85a8-f5d74ec0324e tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:47:47.423627 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0742a59e-49cd-4fa2-85a8-f5d74ec0324e tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:47:47.424355 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0742a59e-49cd-4fa2-85a8-f5d74ec0324e tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:47:47.424857 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0742a59e-49cd-4fa2-85a8-f5d74ec0324e tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:47:47.425287 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0742a59e-49cd-4fa2-85a8-f5d74ec0324e tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:47:47.556494 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-0742a59e-49cd-4fa2-85a8-f5d74ec0324e tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:47:47.564265 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0742a59e-49cd-4fa2-85a8-f5d74ec0324e tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/df225dff-e869-447a-988c-9872618b01e5" status: 200 len: 1392 microversion: 2.1 time: 0.153630 Sep 23 05:47:47.564839 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3992/7802] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:47:47 2022] GET /compute/v2.1/servers/df225dff-e869-447a-988c-9872618b01e5 => generated 1392 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:47:48.587649 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6c3d4a48-ece6-4a37-a792-f9c787092c05 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:47:48.588186 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-6c3d4a48-ece6-4a37-a792-f9c787092c05 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: df225dff-e869-447a-988c-9872618b01e5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:47:48.595420 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6c3d4a48-ece6-4a37-a792-f9c787092c05 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:47:48.595926 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6c3d4a48-ece6-4a37-a792-f9c787092c05 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:47:48.596396 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6c3d4a48-ece6-4a37-a792-f9c787092c05 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:47:48.597080 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6c3d4a48-ece6-4a37-a792-f9c787092c05 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:47:48.597550 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6c3d4a48-ece6-4a37-a792-f9c787092c05 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:47:48.598021 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6c3d4a48-ece6-4a37-a792-f9c787092c05 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:47:48.732236 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6c3d4a48-ece6-4a37-a792-f9c787092c05 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:47:48.739838 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-6c3d4a48-ece6-4a37-a792-f9c787092c05 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/df225dff-e869-447a-988c-9872618b01e5" status: 200 len: 1392 microversion: 2.1 time: 0.156251 Sep 23 05:47:48.740417 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3811/7803] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:47:48 2022] GET /compute/v2.1/servers/df225dff-e869-447a-988c-9872618b01e5 => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:47:49.762645 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-512e61f6-fcb5-4f24-9e6d-1604b717d89e tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:47:49.763179 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-512e61f6-fcb5-4f24-9e6d-1604b717d89e tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: df225dff-e869-447a-988c-9872618b01e5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:47:49.770148 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-512e61f6-fcb5-4f24-9e6d-1604b717d89e tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:47:49.770648 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-512e61f6-fcb5-4f24-9e6d-1604b717d89e tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:47:49.771093 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-512e61f6-fcb5-4f24-9e6d-1604b717d89e tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:47:49.771787 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-512e61f6-fcb5-4f24-9e6d-1604b717d89e tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:47:49.772249 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-512e61f6-fcb5-4f24-9e6d-1604b717d89e tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:47:49.772678 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-512e61f6-fcb5-4f24-9e6d-1604b717d89e tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:47:49.905347 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-512e61f6-fcb5-4f24-9e6d-1604b717d89e tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:47:49.913279 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-512e61f6-fcb5-4f24-9e6d-1604b717d89e tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/df225dff-e869-447a-988c-9872618b01e5" status: 200 len: 1392 microversion: 2.1 time: 0.154800 Sep 23 05:47:49.913851 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3993/7804] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:47:49 2022] GET /compute/v2.1/servers/df225dff-e869-447a-988c-9872618b01e5 => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:47:50.936809 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3cf5a7a1-5513-4d71-8ce4-3fb88d20ecb2 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:47:50.937443 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3cf5a7a1-5513-4d71-8ce4-3fb88d20ecb2 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: df225dff-e869-447a-988c-9872618b01e5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:47:50.944165 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3cf5a7a1-5513-4d71-8ce4-3fb88d20ecb2 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:47:50.944702 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3cf5a7a1-5513-4d71-8ce4-3fb88d20ecb2 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:47:50.945161 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3cf5a7a1-5513-4d71-8ce4-3fb88d20ecb2 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:47:50.945883 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3cf5a7a1-5513-4d71-8ce4-3fb88d20ecb2 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:47:50.946891 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3cf5a7a1-5513-4d71-8ce4-3fb88d20ecb2 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:47:50.947337 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3cf5a7a1-5513-4d71-8ce4-3fb88d20ecb2 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:47:51.044159 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-59bfce9a-78cd-4ddc-9a72-d794510d9f1b req-9c0d6894-ee44-4fb2-b894-66e030508d35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df225dff-e869-447a-988c-9872618b01e5", "name": "network-vif-plugged", "status": "completed", "tag": "d8ccd56d-54ac-4e7d-aa11-3e4b52a40f72"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:47:51.058188 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-59bfce9a-78cd-4ddc-9a72-d794510d9f1b req-9c0d6894-ee44-4fb2-b894-66e030508d35 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:47:51.058682 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-59bfce9a-78cd-4ddc-9a72-d794510d9f1b req-9c0d6894-ee44-4fb2-b894-66e030508d35 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:47:51.059118 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-59bfce9a-78cd-4ddc-9a72-d794510d9f1b req-9c0d6894-ee44-4fb2-b894-66e030508d35 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:47:51.070611 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-59bfce9a-78cd-4ddc-9a72-d794510d9f1b req-9c0d6894-ee44-4fb2-b894-66e030508d35 service nova] Creating event network-vif-plugged:d8ccd56d-54ac-4e7d-aa11-3e4b52a40f72 for instance df225dff-e869-447a-988c-9872618b01e5 on n-h1-846463-3 Sep 23 05:47:51.076217 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-59bfce9a-78cd-4ddc-9a72-d794510d9f1b req-9c0d6894-ee44-4fb2-b894-66e030508d35 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035709 Sep 23 05:47:51.076818 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3994/7805] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:47:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:47:51.090620 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-3cf5a7a1-5513-4d71-8ce4-3fb88d20ecb2 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:47:51.099194 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3cf5a7a1-5513-4d71-8ce4-3fb88d20ecb2 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/df225dff-e869-447a-988c-9872618b01e5" status: 200 len: 1392 microversion: 2.1 time: 0.165868 Sep 23 05:47:51.100162 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3812/7806] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:47:50 2022] GET /compute/v2.1/servers/df225dff-e869-447a-988c-9872618b01e5 => generated 1392 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:47:52.120311 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=6 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:47:52.124989 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d49033a2-18cd-4e65-9422-2b088b451d2f tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:47:52.125776 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d49033a2-18cd-4e65-9422-2b088b451d2f tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: df225dff-e869-447a-988c-9872618b01e5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:47:52.131993 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d49033a2-18cd-4e65-9422-2b088b451d2f tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:47:52.132492 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d49033a2-18cd-4e65-9422-2b088b451d2f tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:47:52.132937 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d49033a2-18cd-4e65-9422-2b088b451d2f tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:47:52.134297 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d49033a2-18cd-4e65-9422-2b088b451d2f tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:47:52.134765 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d49033a2-18cd-4e65-9422-2b088b451d2f tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:47:52.135199 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d49033a2-18cd-4e65-9422-2b088b451d2f tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:47:52.271828 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d49033a2-18cd-4e65-9422-2b088b451d2f tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:47:52.280515 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d49033a2-18cd-4e65-9422-2b088b451d2f tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/df225dff-e869-447a-988c-9872618b01e5" status: 200 len: 1392 microversion: 2.1 time: 0.161147 Sep 23 05:47:52.281203 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3995/7807] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:47:52 2022] GET /compute/v2.1/servers/df225dff-e869-447a-988c-9872618b01e5 => generated 1392 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:47:53.304270 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-79c434cd-68b6-49e0-b6f0-1c0018b97130 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:47:53.304819 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-79c434cd-68b6-49e0-b6f0-1c0018b97130 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: df225dff-e869-447a-988c-9872618b01e5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:47:53.307324 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:47:53.308850 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=8 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:47:53.313638 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-79c434cd-68b6-49e0-b6f0-1c0018b97130 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:47:53.314180 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-79c434cd-68b6-49e0-b6f0-1c0018b97130 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:47:53.314670 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-79c434cd-68b6-49e0-b6f0-1c0018b97130 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:47:53.315378 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-79c434cd-68b6-49e0-b6f0-1c0018b97130 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:47:53.315851 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-79c434cd-68b6-49e0-b6f0-1c0018b97130 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:47:53.316296 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-79c434cd-68b6-49e0-b6f0-1c0018b97130 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:47:53.446859 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-79c434cd-68b6-49e0-b6f0-1c0018b97130 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:47:53.454606 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-79c434cd-68b6-49e0-b6f0-1c0018b97130 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/df225dff-e869-447a-988c-9872618b01e5" status: 200 len: 1564 microversion: 2.1 time: 0.154343 Sep 23 05:47:53.458382 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3813/7808] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:47:53 2022] GET /compute/v2.1/servers/df225dff-e869-447a-988c-9872618b01e5 => generated 1564 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:47:53.478720 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4214f661-9abd-4e5e-8c88-0997c0a5a2ba tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:47:53.479339 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4214f661-9abd-4e5e-8c88-0997c0a5a2ba tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: df225dff-e869-447a-988c-9872618b01e5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:47:53.486166 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4214f661-9abd-4e5e-8c88-0997c0a5a2ba tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:47:53.486669 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4214f661-9abd-4e5e-8c88-0997c0a5a2ba tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:47:53.487195 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4214f661-9abd-4e5e-8c88-0997c0a5a2ba tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:47:53.487906 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4214f661-9abd-4e5e-8c88-0997c0a5a2ba tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:47:53.488411 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4214f661-9abd-4e5e-8c88-0997c0a5a2ba tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:47:53.488851 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4214f661-9abd-4e5e-8c88-0997c0a5a2ba tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:47:53.623679 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-4214f661-9abd-4e5e-8c88-0997c0a5a2ba tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:47:53.631395 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4214f661-9abd-4e5e-8c88-0997c0a5a2ba tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/df225dff-e869-447a-988c-9872618b01e5" status: 200 len: 1564 microversion: 2.1 time: 0.157253 Sep 23 05:47:53.631971 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3996/7809] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:47:53 2022] GET /compute/v2.1/servers/df225dff-e869-447a-988c-9872618b01e5 => generated 1564 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:47:55.842025 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a2e0dd48-f093-44a5-9b67-bb251a7e3f44 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:47:55.842732 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a2e0dd48-f093-44a5-9b67-bb251a7e3f44 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: df225dff-e869-447a-988c-9872618b01e5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:47:55.850708 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a2e0dd48-f093-44a5-9b67-bb251a7e3f44 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:47:55.851440 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a2e0dd48-f093-44a5-9b67-bb251a7e3f44 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:47:55.851899 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a2e0dd48-f093-44a5-9b67-bb251a7e3f44 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:47:55.852655 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a2e0dd48-f093-44a5-9b67-bb251a7e3f44 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:47:55.853129 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a2e0dd48-f093-44a5-9b67-bb251a7e3f44 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:47:55.853572 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a2e0dd48-f093-44a5-9b67-bb251a7e3f44 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:47:55.916621 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-0491d53f-016c-46ba-ad2c-920cfeaa9465 req-dd4ec581-f537-444c-9fb2-a87d193f5eb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df225dff-e869-447a-988c-9872618b01e5", "tag": "d8ccd56d-54ac-4e7d-aa11-3e4b52a40f72"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:47:55.926637 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-0491d53f-016c-46ba-ad2c-920cfeaa9465 req-dd4ec581-f537-444c-9fb2-a87d193f5eb9 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:47:55.927646 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-0491d53f-016c-46ba-ad2c-920cfeaa9465 req-dd4ec581-f537-444c-9fb2-a87d193f5eb9 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:47:55.927646 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-0491d53f-016c-46ba-ad2c-920cfeaa9465 req-dd4ec581-f537-444c-9fb2-a87d193f5eb9 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:47:55.939742 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-0491d53f-016c-46ba-ad2c-920cfeaa9465 req-dd4ec581-f537-444c-9fb2-a87d193f5eb9 service nova] Creating event network-changed:d8ccd56d-54ac-4e7d-aa11-3e4b52a40f72 for instance df225dff-e869-447a-988c-9872618b01e5 on n-h1-846463-3 Sep 23 05:47:55.944996 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-0491d53f-016c-46ba-ad2c-920cfeaa9465 req-dd4ec581-f537-444c-9fb2-a87d193f5eb9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107335 Sep 23 05:47:55.946413 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3997/7810] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:47:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:47:56.005121 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a2e0dd48-f093-44a5-9b67-bb251a7e3f44 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:47:56.016160 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a2e0dd48-f093-44a5-9b67-bb251a7e3f44 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/df225dff-e869-447a-988c-9872618b01e5" status: 200 len: 1564 microversion: 2.1 time: 0.183777 Sep 23 05:47:56.030185 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3814/7811] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:47:55 2022] GET /compute/v2.1/servers/df225dff-e869-447a-988c-9872618b01e5 => generated 1564 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:48:17.305153 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:48:17.306022 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=36 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:48:17.310239 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-184443d1-86f9-4a2b-8903-60d5352945c9 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:48:17.320120 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-184443d1-86f9-4a2b-8903-60d5352945c9 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: df225dff-e869-447a-988c-9872618b01e5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:48:17.320120 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-184443d1-86f9-4a2b-8903-60d5352945c9 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:48:17.320120 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-184443d1-86f9-4a2b-8903-60d5352945c9 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:48:17.320120 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-184443d1-86f9-4a2b-8903-60d5352945c9 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:48:17.320554 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-184443d1-86f9-4a2b-8903-60d5352945c9 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:48:17.320762 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-184443d1-86f9-4a2b-8903-60d5352945c9 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:48:17.321209 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-184443d1-86f9-4a2b-8903-60d5352945c9 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:48:17.380764 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-184443d1-86f9-4a2b-8903-60d5352945c9 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "POST /compute/v2.1/servers/df225dff-e869-447a-988c-9872618b01e5/action" status: 200 len: 24575 microversion: 2.1 time: 0.077138 Sep 23 05:48:17.381412 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3998/7812] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 05:48:17 2022] POST /compute/v2.1/servers/df225dff-e869-447a-988c-9872618b01e5/action => generated 24575 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 05:48:28.419130 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3df320aa-2461-48f9-9396-93a4bd078ab8 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:48:28.419688 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3df320aa-2461-48f9-9396-93a4bd078ab8 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: df225dff-e869-447a-988c-9872618b01e5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:48:28.422082 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:48:28.422772 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=38 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:48:28.427500 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3df320aa-2461-48f9-9396-93a4bd078ab8 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:48:28.432569 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3df320aa-2461-48f9-9396-93a4bd078ab8 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:48:28.432569 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3df320aa-2461-48f9-9396-93a4bd078ab8 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:48:28.432569 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3df320aa-2461-48f9-9396-93a4bd078ab8 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:48:28.432569 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3df320aa-2461-48f9-9396-93a4bd078ab8 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:48:28.432569 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3df320aa-2461-48f9-9396-93a4bd078ab8 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:48:28.646339 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3df320aa-2461-48f9-9396-93a4bd078ab8 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "POST /compute/v2.1/servers/df225dff-e869-447a-988c-9872618b01e5/action" status: 202 len: 0 microversion: 2.1 time: 0.230994 Sep 23 05:48:28.647086 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3815/7813] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 05:48:28 2022] POST /compute/v2.1/servers/df225dff-e869-447a-988c-9872618b01e5/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 05:48:28.657155 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-94b6aeb0-9056-4287-a174-22cdc56f1efa tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:48:28.657873 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-94b6aeb0-9056-4287-a174-22cdc56f1efa tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: df225dff-e869-447a-988c-9872618b01e5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:48:28.660437 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=4 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:48:28.665991 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-94b6aeb0-9056-4287-a174-22cdc56f1efa tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:48:28.666487 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-94b6aeb0-9056-4287-a174-22cdc56f1efa tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:48:28.666937 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-94b6aeb0-9056-4287-a174-22cdc56f1efa tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:48:28.667645 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-94b6aeb0-9056-4287-a174-22cdc56f1efa tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:48:28.668113 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-94b6aeb0-9056-4287-a174-22cdc56f1efa tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:48:28.668547 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-94b6aeb0-9056-4287-a174-22cdc56f1efa tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:48:28.800537 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-94b6aeb0-9056-4287-a174-22cdc56f1efa tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:48:28.809307 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-94b6aeb0-9056-4287-a174-22cdc56f1efa tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/df225dff-e869-447a-988c-9872618b01e5" status: 200 len: 1687 microversion: 2.1 time: 0.156819 Sep 23 05:48:28.811758 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 3999/7814] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:48:28 2022] GET /compute/v2.1/servers/df225dff-e869-447a-988c-9872618b01e5 => generated 1687 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:48:29.835290 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-699b7cec-425f-4a5a-b0cf-41ae0f5bebaf tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:48:29.836021 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-699b7cec-425f-4a5a-b0cf-41ae0f5bebaf tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: df225dff-e869-447a-988c-9872618b01e5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:48:29.843165 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-699b7cec-425f-4a5a-b0cf-41ae0f5bebaf tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:48:29.843682 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-699b7cec-425f-4a5a-b0cf-41ae0f5bebaf tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:48:29.844145 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-699b7cec-425f-4a5a-b0cf-41ae0f5bebaf tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:48:29.844863 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-699b7cec-425f-4a5a-b0cf-41ae0f5bebaf tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:48:29.845346 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-699b7cec-425f-4a5a-b0cf-41ae0f5bebaf tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:48:29.845796 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-699b7cec-425f-4a5a-b0cf-41ae0f5bebaf tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:48:29.975495 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-699b7cec-425f-4a5a-b0cf-41ae0f5bebaf tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:48:29.983437 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-699b7cec-425f-4a5a-b0cf-41ae0f5bebaf tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/df225dff-e869-447a-988c-9872618b01e5" status: 200 len: 1667 microversion: 2.1 time: 0.153316 Sep 23 05:48:29.984019 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3816/7815] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:48:29 2022] GET /compute/v2.1/servers/df225dff-e869-447a-988c-9872618b01e5 => generated 1667 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:48:31.081987 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-abf746fe-6f67-43ae-9880-79a430fb351a tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:48:31.084279 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-abf746fe-6f67-43ae-9880-79a430fb351a tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: df225dff-e869-447a-988c-9872618b01e5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:48:31.091402 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-abf746fe-6f67-43ae-9880-79a430fb351a tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:48:31.091897 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-abf746fe-6f67-43ae-9880-79a430fb351a tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:48:31.092344 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-abf746fe-6f67-43ae-9880-79a430fb351a tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:48:31.093047 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-abf746fe-6f67-43ae-9880-79a430fb351a tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:48:31.093514 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-abf746fe-6f67-43ae-9880-79a430fb351a tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:48:31.093976 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-abf746fe-6f67-43ae-9880-79a430fb351a tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:48:31.149902 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-abf746fe-6f67-43ae-9880-79a430fb351a tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "POST /compute/v2.1/servers/df225dff-e869-447a-988c-9872618b01e5/action" status: 200 len: 32644 microversion: 2.1 time: 0.071810 Sep 23 05:48:31.151475 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4000/7816] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 05:48:31 2022] POST /compute/v2.1/servers/df225dff-e869-447a-988c-9872618b01e5/action => generated 32644 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 05:48:31.162923 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f3812e66-4810-4840-92db-2847840077cb tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:48:31.163475 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f3812e66-4810-4840-92db-2847840077cb tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: df225dff-e869-447a-988c-9872618b01e5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:48:31.171338 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f3812e66-4810-4840-92db-2847840077cb tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:48:31.171855 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f3812e66-4810-4840-92db-2847840077cb tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:48:31.172318 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f3812e66-4810-4840-92db-2847840077cb tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:48:31.173041 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f3812e66-4810-4840-92db-2847840077cb tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:48:31.173529 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f3812e66-4810-4840-92db-2847840077cb tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:48:31.174010 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f3812e66-4810-4840-92db-2847840077cb tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:48:31.333266 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f3812e66-4810-4840-92db-2847840077cb tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "POST /compute/v2.1/servers/df225dff-e869-447a-988c-9872618b01e5/action" status: 202 len: 0 microversion: 2.1 time: 0.174051 Sep 23 05:48:31.335310 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3817/7817] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 05:48:31 2022] POST /compute/v2.1/servers/df225dff-e869-447a-988c-9872618b01e5/action => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 05:48:31.343637 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a024f0be-b44b-4967-a28a-cdff9ea241fd tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:48:31.344369 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a024f0be-b44b-4967-a28a-cdff9ea241fd tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: df225dff-e869-447a-988c-9872618b01e5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:48:31.351487 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a024f0be-b44b-4967-a28a-cdff9ea241fd tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:48:31.351985 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a024f0be-b44b-4967-a28a-cdff9ea241fd tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:48:31.352524 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a024f0be-b44b-4967-a28a-cdff9ea241fd tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:48:31.353247 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a024f0be-b44b-4967-a28a-cdff9ea241fd tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:48:31.353697 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a024f0be-b44b-4967-a28a-cdff9ea241fd tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:48:31.354160 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a024f0be-b44b-4967-a28a-cdff9ea241fd tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:48:31.491527 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a024f0be-b44b-4967-a28a-cdff9ea241fd tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:48:31.499343 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a024f0be-b44b-4967-a28a-cdff9ea241fd tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/df225dff-e869-447a-988c-9872618b01e5" status: 200 len: 1674 microversion: 2.1 time: 0.160739 Sep 23 05:48:31.499907 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4001/7818] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:48:31 2022] GET /compute/v2.1/servers/df225dff-e869-447a-988c-9872618b01e5 => generated 1674 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:48:32.524995 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d54c5c9d-5d27-4476-a2bb-ea43fa1c8f76 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:48:32.525809 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d54c5c9d-5d27-4476-a2bb-ea43fa1c8f76 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: df225dff-e869-447a-988c-9872618b01e5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:48:32.532547 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d54c5c9d-5d27-4476-a2bb-ea43fa1c8f76 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:48:32.533036 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d54c5c9d-5d27-4476-a2bb-ea43fa1c8f76 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:48:32.533486 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d54c5c9d-5d27-4476-a2bb-ea43fa1c8f76 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:48:32.534210 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d54c5c9d-5d27-4476-a2bb-ea43fa1c8f76 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:48:32.534679 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d54c5c9d-5d27-4476-a2bb-ea43fa1c8f76 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:48:32.535149 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d54c5c9d-5d27-4476-a2bb-ea43fa1c8f76 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:48:32.668325 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d54c5c9d-5d27-4476-a2bb-ea43fa1c8f76 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:48:32.676177 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d54c5c9d-5d27-4476-a2bb-ea43fa1c8f76 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/df225dff-e869-447a-988c-9872618b01e5" status: 200 len: 1682 microversion: 2.1 time: 0.156596 Sep 23 05:48:32.676774 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3818/7819] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:48:32 2022] GET /compute/v2.1/servers/df225dff-e869-447a-988c-9872618b01e5 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:48:32.774655 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-df67ebde-c734-4abd-b0a5-1e74c25c5a46 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:48:32.777567 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-df67ebde-c734-4abd-b0a5-1e74c25c5a46 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: df225dff-e869-447a-988c-9872618b01e5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:48:32.784048 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-df67ebde-c734-4abd-b0a5-1e74c25c5a46 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:48:32.784540 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-df67ebde-c734-4abd-b0a5-1e74c25c5a46 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:48:32.784978 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-df67ebde-c734-4abd-b0a5-1e74c25c5a46 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:48:32.785676 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-df67ebde-c734-4abd-b0a5-1e74c25c5a46 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:48:32.786173 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-df67ebde-c734-4abd-b0a5-1e74c25c5a46 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:48:32.786613 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-df67ebde-c734-4abd-b0a5-1e74c25c5a46 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:48:32.836857 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-df67ebde-c734-4abd-b0a5-1e74c25c5a46 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "POST /compute/v2.1/servers/df225dff-e869-447a-988c-9872618b01e5/action" status: 200 len: 38470 microversion: 2.1 time: 0.066251 Sep 23 05:48:32.837736 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4002/7820] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 05:48:32 2022] POST /compute/v2.1/servers/df225dff-e869-447a-988c-9872618b01e5/action => generated 38470 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 05:48:33.911365 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-0d375f1f-5eaf-4dd1-a6c4-a8dcadb97075 req-59704978-c00e-47ea-a258-174c22719def service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df225dff-e869-447a-988c-9872618b01e5", "tag": "d8ccd56d-54ac-4e7d-aa11-3e4b52a40f72"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:48:33.913363 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6e67135e-8528-4980-8ff1-7a83c3da7812 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:48:33.920494 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-6e67135e-8528-4980-8ff1-7a83c3da7812 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: df225dff-e869-447a-988c-9872618b01e5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:48:33.925097 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-0d375f1f-5eaf-4dd1-a6c4-a8dcadb97075 req-59704978-c00e-47ea-a258-174c22719def service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:48:33.925592 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-0d375f1f-5eaf-4dd1-a6c4-a8dcadb97075 req-59704978-c00e-47ea-a258-174c22719def service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:48:33.926067 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-0d375f1f-5eaf-4dd1-a6c4-a8dcadb97075 req-59704978-c00e-47ea-a258-174c22719def service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:48:33.927091 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6e67135e-8528-4980-8ff1-7a83c3da7812 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:48:33.927801 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6e67135e-8528-4980-8ff1-7a83c3da7812 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:48:33.928329 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6e67135e-8528-4980-8ff1-7a83c3da7812 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:48:33.929064 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6e67135e-8528-4980-8ff1-7a83c3da7812 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:48:33.929545 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6e67135e-8528-4980-8ff1-7a83c3da7812 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:48:33.930021 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6e67135e-8528-4980-8ff1-7a83c3da7812 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:48:33.938138 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-0d375f1f-5eaf-4dd1-a6c4-a8dcadb97075 req-59704978-c00e-47ea-a258-174c22719def service nova] Creating event network-changed:d8ccd56d-54ac-4e7d-aa11-3e4b52a40f72 for instance df225dff-e869-447a-988c-9872618b01e5 on n-h1-846463-3 Sep 23 05:48:33.943035 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-0d375f1f-5eaf-4dd1-a6c4-a8dcadb97075 req-59704978-c00e-47ea-a258-174c22719def service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035691 Sep 23 05:48:33.944030 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4003/7821] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:48:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:48:33.957197 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-6e67135e-8528-4980-8ff1-7a83c3da7812 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: df225dff-e869-447a-988c-9872618b01e5] Going to try to terminate instance {{(pid=122698) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 05:48:34.227001 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-6e67135e-8528-4980-8ff1-7a83c3da7812 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "DELETE /compute/v2.1/servers/df225dff-e869-447a-988c-9872618b01e5" status: 204 len: 0 microversion: 2.1 time: 0.323273 Sep 23 05:48:34.227684 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3819/7822] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 05:48:33 2022] DELETE /compute/v2.1/servers/df225dff-e869-447a-988c-9872618b01e5 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 23 05:48:34.237554 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-84fb8b4d-5572-4533-ad46-4638ccd52bb9 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:48:34.243496 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-84fb8b4d-5572-4533-ad46-4638ccd52bb9 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: df225dff-e869-447a-988c-9872618b01e5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:48:34.247248 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-84fb8b4d-5572-4533-ad46-4638ccd52bb9 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:48:34.248329 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-84fb8b4d-5572-4533-ad46-4638ccd52bb9 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:48:34.249075 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-84fb8b4d-5572-4533-ad46-4638ccd52bb9 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:48:34.250167 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-84fb8b4d-5572-4533-ad46-4638ccd52bb9 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:48:34.250967 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-84fb8b4d-5572-4533-ad46-4638ccd52bb9 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:48:34.251583 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-84fb8b4d-5572-4533-ad46-4638ccd52bb9 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:48:34.396717 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-84fb8b4d-5572-4533-ad46-4638ccd52bb9 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:48:34.405310 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-84fb8b4d-5572-4533-ad46-4638ccd52bb9 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/df225dff-e869-447a-988c-9872618b01e5" status: 200 len: 1688 microversion: 2.1 time: 0.172726 Sep 23 05:48:34.406139 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4004/7823] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:48:34 2022] GET /compute/v2.1/servers/df225dff-e869-447a-988c-9872618b01e5 => generated 1688 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:48:35.430649 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-916e160c-e20a-4a69-9c7e-04c71009e2ab tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:48:35.431368 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-916e160c-e20a-4a69-9c7e-04c71009e2ab tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: df225dff-e869-447a-988c-9872618b01e5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:48:35.438194 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-916e160c-e20a-4a69-9c7e-04c71009e2ab tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:48:35.438698 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-916e160c-e20a-4a69-9c7e-04c71009e2ab tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:48:35.439153 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-916e160c-e20a-4a69-9c7e-04c71009e2ab tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:48:35.439854 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-916e160c-e20a-4a69-9c7e-04c71009e2ab tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:48:35.440324 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-916e160c-e20a-4a69-9c7e-04c71009e2ab tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:48:35.440764 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-916e160c-e20a-4a69-9c7e-04c71009e2ab tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:48:35.572185 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-916e160c-e20a-4a69-9c7e-04c71009e2ab tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:48:35.580020 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-916e160c-e20a-4a69-9c7e-04c71009e2ab tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/df225dff-e869-447a-988c-9872618b01e5" status: 200 len: 1688 microversion: 2.1 time: 0.153639 Sep 23 05:48:35.580561 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3820/7824] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:48:35 2022] GET /compute/v2.1/servers/df225dff-e869-447a-988c-9872618b01e5 => generated 1688 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:48:36.292262 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-c74fa917-f79d-4757-81d9-aebc9699555c req-2adb188c-7c51-4e4f-8349-293ffbf77e07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df225dff-e869-447a-988c-9872618b01e5", "name": "network-vif-deleted", "tag": "d8ccd56d-54ac-4e7d-aa11-3e4b52a40f72"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:48:36.302243 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-c74fa917-f79d-4757-81d9-aebc9699555c req-2adb188c-7c51-4e4f-8349-293ffbf77e07 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:48:36.302730 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-c74fa917-f79d-4757-81d9-aebc9699555c req-2adb188c-7c51-4e4f-8349-293ffbf77e07 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:48:36.303255 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-c74fa917-f79d-4757-81d9-aebc9699555c req-2adb188c-7c51-4e4f-8349-293ffbf77e07 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:48:36.314914 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-c74fa917-f79d-4757-81d9-aebc9699555c req-2adb188c-7c51-4e4f-8349-293ffbf77e07 service nova] Creating event network-vif-deleted:d8ccd56d-54ac-4e7d-aa11-3e4b52a40f72 for instance df225dff-e869-447a-988c-9872618b01e5 on n-h1-846463-3 Sep 23 05:48:36.319816 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-c74fa917-f79d-4757-81d9-aebc9699555c req-2adb188c-7c51-4e4f-8349-293ffbf77e07 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031572 Sep 23 05:48:36.321440 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4005/7825] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:48:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:48:36.603683 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0c3357ae-b4cd-4b39-ab90-164a7785c761 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:48:36.604323 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-0c3357ae-b4cd-4b39-ab90-164a7785c761 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: df225dff-e869-447a-988c-9872618b01e5] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:48:36.612123 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0c3357ae-b4cd-4b39-ab90-164a7785c761 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:48:36.612334 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0c3357ae-b4cd-4b39-ab90-164a7785c761 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:48:36.612969 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0c3357ae-b4cd-4b39-ab90-164a7785c761 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:48:36.613704 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0c3357ae-b4cd-4b39-ab90-164a7785c761 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:48:36.614215 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0c3357ae-b4cd-4b39-ab90-164a7785c761 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:48:36.614658 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0c3357ae-b4cd-4b39-ab90-164a7785c761 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:48:36.652576 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0c3357ae-b4cd-4b39-ab90-164a7785c761 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:48:36.653083 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0c3357ae-b4cd-4b39-ab90-164a7785c761 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:48:36.653536 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0c3357ae-b4cd-4b39-ab90-164a7785c761 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:48:36.654037 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-0c3357ae-b4cd-4b39-ab90-164a7785c761 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lazy-loading 'fault' on Instance uuid df225dff-e869-447a-988c-9872618b01e5 {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 05:48:36.704988 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-0c3357ae-b4cd-4b39-ab90-164a7785c761 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:48:36.713033 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0c3357ae-b4cd-4b39-ab90-164a7785c761 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/df225dff-e869-447a-988c-9872618b01e5" status: 200 len: 1356 microversion: 2.1 time: 0.113244 Sep 23 05:48:36.713618 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3821/7826] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:48:36 2022] GET /compute/v2.1/servers/df225dff-e869-447a-988c-9872618b01e5 => generated 1356 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:48:37.739315 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d7f2fe69-1583-4a8d-93f0-580a96353811 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:48:37.740026 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d7f2fe69-1583-4a8d-93f0-580a96353811 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: df225dff-e869-447a-988c-9872618b01e5] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:48:37.746955 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d7f2fe69-1583-4a8d-93f0-580a96353811 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:48:37.747458 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d7f2fe69-1583-4a8d-93f0-580a96353811 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:48:37.747905 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d7f2fe69-1583-4a8d-93f0-580a96353811 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:48:37.748622 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d7f2fe69-1583-4a8d-93f0-580a96353811 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:48:37.749086 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d7f2fe69-1583-4a8d-93f0-580a96353811 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:48:37.749517 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d7f2fe69-1583-4a8d-93f0-580a96353811 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:48:37.764564 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-d7f2fe69-1583-4a8d-93f0-580a96353811 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] HTTP exception thrown: Instance df225dff-e869-447a-988c-9872618b01e5 could not be found. Sep 23 05:48:37.766274 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d7f2fe69-1583-4a8d-93f0-580a96353811 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Request method failure captured: Sep 23 05:48:37.766274 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/df225dff-e869-447a-988c-9872618b01e5 HTTP/1.1 Sep 23 05:48:37.766274 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 05:48:37.766274 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 05:48:37.766274 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 05:48:37.766274 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 05:48:37.766274 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 05:48:37.766274 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 05:48:37.766274 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 05:48:37.766274 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 05:48:37.766274 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLUhz7bpvepG5vaaNTB45PETsbu7BFN8GjZeZ_vLrd5WJDjgd_oQ5bhmVua4C2ZhQgOahIirm-KuGCZTB_5bToAYjCLfVfw81RihC56n3ttHDJ0Tgc_iEV4MwjR_WQmCh9B38US55e6l82-uxms5I3hOmslhT2_3dhZB9TyAC0xyC3YM Sep 23 05:48:37.766274 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 05:48:37.766274 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 05:48:37.766274 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 05:48:37.766274 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 05:48:37.766274 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 05:48:37.766274 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 05:48:37.766274 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 498fb069adef49d19ed802d2133adb89 Sep 23 05:48:37.766274 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2142034074 Sep 23 05:48:37.766274 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 05:48:37.766274 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 05:48:37.766274 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_498fb069adef49d19ed802d2133adb89", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/498fb069adef49d19ed802d2133adb89"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/498fb069adef49d19ed802d2133adb89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/498fb069adef49d19ed802d2133adb89"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:48:37.766274 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2142034074 Sep 23 05:48:37.766274 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 498fb069adef49d19ed802d2133adb89 Sep 23 05:48:37.766274 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2142034074 Sep 23 05:48:37.766274 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-TestNetworkAdvancedServerOps-2142034074-project Sep 23 05:48:37.766274 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 05:48:37.766274 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 05:48:37.766274 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: e9d36972d8f2413b8838e64998b43359 Sep 23 05:48:37.766274 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2142034074-project Sep 23 05:48:37.766274 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 05:48:37.766274 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance df225dff-e869-447a-988c-9872618b01e5 could not be found. Sep 23 05:48:37.766274 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': 'df225dff-e869-447a-988c-9872618b01e5'} Sep 23 05:48:37.766274 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:48:37.766274 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:48:37.766274 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 05:48:37.766274 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 05:48:37.766274 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 05:48:37.766274 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 05:48:37.766274 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 05:48:37.766274 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 05:48:37.766274 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 05:48:37.766274 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 05:48:37.766274 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df225dff-e869-447a-988c-9872618b01e5 could not be found. Sep 23 05:48:37.766274 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:48:37.766274 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:48:37.766274 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:48:37.766274 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:48:37.766274 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:48:37.766274 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:48:37.766274 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:48:37.766274 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:48:37.766274 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:48:37.766274 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:48:37.766274 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 05:48:37.766274 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 05:48:37.766274 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 05:48:37.766274 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 05:48:37.766274 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 05:48:37.766274 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:48:37.766274 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df225dff-e869-447a-988c-9872618b01e5 could not be found. Sep 23 05:48:37.766274 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:48:37.766274 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:48:37.773292 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:48:37.773292 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:48:37.773292 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:48:37.773292 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:48:37.773292 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:48:37.773292 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:48:37.773292 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df225dff-e869-447a-988c-9872618b01e5 could not be found. Sep 23 05:48:37.773292 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:48:37.773292 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d7f2fe69-1583-4a8d-93f0-580a96353811 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Returning 404 to user: Instance df225dff-e869-447a-988c-9872618b01e5 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:48:37.773292 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d7f2fe69-1583-4a8d-93f0-580a96353811 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/df225dff-e869-447a-988c-9872618b01e5" status: 404 len: 111 microversion: 2.1 time: 0.033140 Sep 23 05:48:37.773292 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4006/7827] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:48:37 2022] GET /compute/v2.1/servers/df225dff-e869-447a-988c-9872618b01e5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 05:48:41.157495 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-70a93c20-6f24-4c1d-8d38-34f4b901cf88 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '.version_select at 0x7ff1ba856b80>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:48:41.244418 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-70a93c20-6f24-4c1d-8d38-34f4b901cf88 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-960325802" status: 202 len: 0 microversion: 2.1 time: 0.096880 Sep 23 05:48:41.245017 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3822/7828] 10.222.0.33 () {58 vars in 1281 bytes} [Fri Sep 23 05:48:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-960325802 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 05:48:41.274354 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-fe039775-35c2-493d-ba7b-4a51c92e19ec tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Action: 'create', calling method: .version_select at 0x7ff1bb733b80>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2044519979", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBQGMTMTPleUJj9N5hbmYhz8GnN+URvUHoT1Ul6KSK8/kvDtq8fsZQow876zpbhql0aC+/BBSUgIBvsxkmi1QQJj3Des+GD6KvQCsbx+AGKL9bAFoIn6scVawXgtL8ZANw=="}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:48:41.291334 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-fe039775-35c2-493d-ba7b-4a51c92e19ec tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Getting quotas for project 498fb069adef49d19ed802d2133adb89. Resources: {'key_pairs'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 05:48:41.297487 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-fe039775-35c2-493d-ba7b-4a51c92e19ec tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Getting quotas for user e9d36972d8f2413b8838e64998b43359 and project 498fb069adef49d19ed802d2133adb89. Resources: {'key_pairs'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 05:48:41.375213 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-fe039775-35c2-493d-ba7b-4a51c92e19ec tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.105514 Sep 23 05:48:41.375865 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4007/7829] 10.222.0.33 () {60 vars in 1159 bytes} [Fri Sep 23 05:48:41 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:48:49.640040 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:48:49.645760 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-324cc21c-6ed4-4410-a5a2-fc1315504f30 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1094751138", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "networks": [{"uuid": "0b26a7d1-a55e-40ec-be43-101d818158b0"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2044519979", "security_groups": [{"name": "tempest-secgroup-smoke-1347026949"}]}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:48:49.785562 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.network.neutron [None req-324cc21c-6ed4-4410-a5a2-fc1315504f30 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] validate_networks() for [('0b26a7d1-a55e-40ec-be43-101d818158b0', None, None, None, None, None)] {{(pid=122698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 05:48:50.213754 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-324cc21c-6ed4-4410-a5a2-fc1315504f30 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Flavor limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 05:48:50.214235 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-324cc21c-6ed4-4410-a5a2-fc1315504f30 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Image limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 05:48:50.214777 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-324cc21c-6ed4-4410-a5a2-fc1315504f30 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Flavor pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 05:48:50.215203 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-324cc21c-6ed4-4410-a5a2-fc1315504f30 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Image pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 05:48:50.215662 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-324cc21c-6ed4-4410-a5a2-fc1315504f30 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 05:48:50.224412 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-324cc21c-6ed4-4410-a5a2-fc1315504f30 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:48:50.224909 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-324cc21c-6ed4-4410-a5a2-fc1315504f30 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:48:50.225365 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-324cc21c-6ed4-4410-a5a2-fc1315504f30 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:48:50.226137 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-324cc21c-6ed4-4410-a5a2-fc1315504f30 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:48:50.226612 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-324cc21c-6ed4-4410-a5a2-fc1315504f30 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:48:50.227084 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-324cc21c-6ed4-4410-a5a2-fc1315504f30 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:48:50.245187 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-324cc21c-6ed4-4410-a5a2-fc1315504f30 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Getting quotas for project 498fb069adef49d19ed802d2133adb89. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 05:48:50.251706 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-324cc21c-6ed4-4410-a5a2-fc1315504f30 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Getting quotas for user e9d36972d8f2413b8838e64998b43359 and project 498fb069adef49d19ed802d2133adb89. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 05:48:50.265716 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-324cc21c-6ed4-4410-a5a2-fc1315504f30 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Going to run 1 instances... {{(pid=122698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 05:48:50.268816 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-324cc21c-6ed4-4410-a5a2-fc1315504f30 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 8e5aa2c7-20e6-4ca6-8337-7032247c956f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 05:48:50.390147 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-324cc21c-6ed4-4410-a5a2-fc1315504f30 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.751875 Sep 23 05:48:50.391526 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3823/7830] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 05:48:49 2022] POST /compute/v2.1/servers => generated 406 bytes in 755 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 05:48:50.403299 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d00383e0-5437-4a90-9038-6c10b79673ee tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:48:50.405390 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d00383e0-5437-4a90-9038-6c10b79673ee tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 8e5aa2c7-20e6-4ca6-8337-7032247c956f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:48:50.409343 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=32 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:48:50.410582 n-d-846463-3 devstack@n-api.service[122699]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 05:48:50.410945 n-d-846463-3 devstack@n-api.service[122699]: Fri Sep 23 05:48:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8e5aa2c7-20e6-4ca6-8337-7032247c956f (ip 10.222.0.33) !!! Sep 23 05:48:50.474516 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d00383e0-5437-4a90-9038-6c10b79673ee tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:48:50.482693 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d00383e0-5437-4a90-9038-6c10b79673ee tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/8e5aa2c7-20e6-4ca6-8337-7032247c956f" status: 200 len: 1267 microversion: 2.1 time: 0.083460 Sep 23 05:48:50.494078 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4008/7831] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:48:50 2022] GET /compute/v2.1/servers/8e5aa2c7-20e6-4ca6-8337-7032247c956f => generated 1267 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:48:51.507484 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d639ac89-ad53-460c-ad52-69e5f02f4483 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:48:51.508131 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d639ac89-ad53-460c-ad52-69e5f02f4483 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 8e5aa2c7-20e6-4ca6-8337-7032247c956f] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:48:51.519312 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d639ac89-ad53-460c-ad52-69e5f02f4483 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:48:51.519818 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d639ac89-ad53-460c-ad52-69e5f02f4483 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:48:51.520310 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d639ac89-ad53-460c-ad52-69e5f02f4483 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:48:51.521290 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d639ac89-ad53-460c-ad52-69e5f02f4483 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:48:51.521767 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d639ac89-ad53-460c-ad52-69e5f02f4483 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:48:51.522296 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d639ac89-ad53-460c-ad52-69e5f02f4483 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:48:51.609329 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d639ac89-ad53-460c-ad52-69e5f02f4483 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:48:51.618613 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d639ac89-ad53-460c-ad52-69e5f02f4483 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/8e5aa2c7-20e6-4ca6-8337-7032247c956f" status: 200 len: 1271 microversion: 2.1 time: 0.114897 Sep 23 05:48:51.619307 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3824/7832] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:48:51 2022] GET /compute/v2.1/servers/8e5aa2c7-20e6-4ca6-8337-7032247c956f => generated 1271 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:48:52.643357 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8531a055-69da-4717-8a23-4fc59a52617b tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:48:52.644347 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-8531a055-69da-4717-8a23-4fc59a52617b tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 8e5aa2c7-20e6-4ca6-8337-7032247c956f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:48:52.652969 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8531a055-69da-4717-8a23-4fc59a52617b tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:48:52.653491 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8531a055-69da-4717-8a23-4fc59a52617b tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:48:52.653964 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8531a055-69da-4717-8a23-4fc59a52617b tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:48:52.654720 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8531a055-69da-4717-8a23-4fc59a52617b tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:48:52.655190 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8531a055-69da-4717-8a23-4fc59a52617b tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:48:52.655622 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8531a055-69da-4717-8a23-4fc59a52617b tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:48:52.721034 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-8531a055-69da-4717-8a23-4fc59a52617b tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:48:52.729071 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-8531a055-69da-4717-8a23-4fc59a52617b tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/8e5aa2c7-20e6-4ca6-8337-7032247c956f" status: 200 len: 1327 microversion: 2.1 time: 0.091267 Sep 23 05:48:52.729924 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4009/7833] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:48:52 2022] GET /compute/v2.1/servers/8e5aa2c7-20e6-4ca6-8337-7032247c956f => generated 1327 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:48:53.759381 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-23ef06cd-3b1f-4337-9bd4-6739374d6869 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:48:53.760030 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-23ef06cd-3b1f-4337-9bd4-6739374d6869 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 8e5aa2c7-20e6-4ca6-8337-7032247c956f] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:48:53.767454 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-23ef06cd-3b1f-4337-9bd4-6739374d6869 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:48:53.767965 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-23ef06cd-3b1f-4337-9bd4-6739374d6869 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:48:53.768430 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-23ef06cd-3b1f-4337-9bd4-6739374d6869 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:48:53.769146 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-23ef06cd-3b1f-4337-9bd4-6739374d6869 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:48:53.769625 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-23ef06cd-3b1f-4337-9bd4-6739374d6869 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:48:53.770103 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-23ef06cd-3b1f-4337-9bd4-6739374d6869 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:48:53.902176 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-23ef06cd-3b1f-4337-9bd4-6739374d6869 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:48:53.911897 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-23ef06cd-3b1f-4337-9bd4-6739374d6869 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/8e5aa2c7-20e6-4ca6-8337-7032247c956f" status: 200 len: 1393 microversion: 2.1 time: 0.156481 Sep 23 05:48:53.912476 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3825/7834] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:48:53 2022] GET /compute/v2.1/servers/8e5aa2c7-20e6-4ca6-8337-7032247c956f => generated 1393 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:48:54.411469 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-31f450ef-d309-4d18-8d24-2217bc57bd0e req-155a4357-e833-435c-9ffa-542b5a0525cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e5aa2c7-20e6-4ca6-8337-7032247c956f", "tag": "53431a0b-b778-4e55-9432-2bdbdbfe9167"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:48:54.422559 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-31f450ef-d309-4d18-8d24-2217bc57bd0e req-155a4357-e833-435c-9ffa-542b5a0525cd service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:48:54.423243 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-31f450ef-d309-4d18-8d24-2217bc57bd0e req-155a4357-e833-435c-9ffa-542b5a0525cd service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:48:54.423684 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-31f450ef-d309-4d18-8d24-2217bc57bd0e req-155a4357-e833-435c-9ffa-542b5a0525cd service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:48:54.435622 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-31f450ef-d309-4d18-8d24-2217bc57bd0e req-155a4357-e833-435c-9ffa-542b5a0525cd service nova] Creating event network-changed:53431a0b-b778-4e55-9432-2bdbdbfe9167 for instance 8e5aa2c7-20e6-4ca6-8337-7032247c956f on n-h2-846463-3 Sep 23 05:48:54.440800 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-31f450ef-d309-4d18-8d24-2217bc57bd0e req-155a4357-e833-435c-9ffa-542b5a0525cd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033084 Sep 23 05:48:54.441596 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4010/7835] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:48:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:48:54.935638 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8cfdbbed-ceb7-48ec-9b02-4215efe279d9 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:48:54.936273 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8cfdbbed-ceb7-48ec-9b02-4215efe279d9 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 8e5aa2c7-20e6-4ca6-8337-7032247c956f] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:48:54.943252 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8cfdbbed-ceb7-48ec-9b02-4215efe279d9 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:48:54.943766 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8cfdbbed-ceb7-48ec-9b02-4215efe279d9 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:48:54.944229 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8cfdbbed-ceb7-48ec-9b02-4215efe279d9 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:48:54.944947 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8cfdbbed-ceb7-48ec-9b02-4215efe279d9 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:48:54.945424 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8cfdbbed-ceb7-48ec-9b02-4215efe279d9 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:48:54.945871 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8cfdbbed-ceb7-48ec-9b02-4215efe279d9 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:48:55.081143 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8cfdbbed-ceb7-48ec-9b02-4215efe279d9 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:48:55.089744 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8cfdbbed-ceb7-48ec-9b02-4215efe279d9 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/8e5aa2c7-20e6-4ca6-8337-7032247c956f" status: 200 len: 1393 microversion: 2.1 time: 0.158091 Sep 23 05:48:55.090317 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3826/7836] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:48:54 2022] GET /compute/v2.1/servers/8e5aa2c7-20e6-4ca6-8337-7032247c956f => generated 1393 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:48:56.113353 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ef514ba1-d1b6-4b78-aa4f-28fa0f394dda tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:48:56.114200 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ef514ba1-d1b6-4b78-aa4f-28fa0f394dda tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 8e5aa2c7-20e6-4ca6-8337-7032247c956f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:48:56.121306 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ef514ba1-d1b6-4b78-aa4f-28fa0f394dda tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:48:56.121908 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ef514ba1-d1b6-4b78-aa4f-28fa0f394dda tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:48:56.122439 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ef514ba1-d1b6-4b78-aa4f-28fa0f394dda tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:48:56.123223 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ef514ba1-d1b6-4b78-aa4f-28fa0f394dda tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:48:56.123761 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ef514ba1-d1b6-4b78-aa4f-28fa0f394dda tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:48:56.124208 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ef514ba1-d1b6-4b78-aa4f-28fa0f394dda tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:48:56.263559 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ef514ba1-d1b6-4b78-aa4f-28fa0f394dda tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:48:56.271915 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ef514ba1-d1b6-4b78-aa4f-28fa0f394dda tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/8e5aa2c7-20e6-4ca6-8337-7032247c956f" status: 200 len: 1393 microversion: 2.1 time: 0.163306 Sep 23 05:48:56.272506 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4011/7837] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:48:56 2022] GET /compute/v2.1/servers/8e5aa2c7-20e6-4ca6-8337-7032247c956f => generated 1393 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:48:57.294937 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f1a4a01f-9bfa-4b0d-ad23-a41a7b67c21a tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:48:57.295499 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f1a4a01f-9bfa-4b0d-ad23-a41a7b67c21a tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 8e5aa2c7-20e6-4ca6-8337-7032247c956f] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:48:57.302448 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f1a4a01f-9bfa-4b0d-ad23-a41a7b67c21a tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:48:57.302959 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f1a4a01f-9bfa-4b0d-ad23-a41a7b67c21a tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:48:57.303420 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f1a4a01f-9bfa-4b0d-ad23-a41a7b67c21a tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:48:57.304139 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f1a4a01f-9bfa-4b0d-ad23-a41a7b67c21a tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:48:57.304625 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f1a4a01f-9bfa-4b0d-ad23-a41a7b67c21a tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:48:57.305101 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f1a4a01f-9bfa-4b0d-ad23-a41a7b67c21a tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:48:57.435093 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-f1a4a01f-9bfa-4b0d-ad23-a41a7b67c21a tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:48:57.442803 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f1a4a01f-9bfa-4b0d-ad23-a41a7b67c21a tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/8e5aa2c7-20e6-4ca6-8337-7032247c956f" status: 200 len: 1393 microversion: 2.1 time: 0.151850 Sep 23 05:48:57.443383 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3827/7838] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:48:57 2022] GET /compute/v2.1/servers/8e5aa2c7-20e6-4ca6-8337-7032247c956f => generated 1393 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:48:58.389625 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-53d83d7a-e9b7-4195-8bc5-f053c3c9af54 req-2a9088ba-0493-4c2f-91ce-95b7598189c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e5aa2c7-20e6-4ca6-8337-7032247c956f", "name": "network-vif-plugged", "status": "completed", "tag": "53431a0b-b778-4e55-9432-2bdbdbfe9167"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:48:58.400493 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-53d83d7a-e9b7-4195-8bc5-f053c3c9af54 req-2a9088ba-0493-4c2f-91ce-95b7598189c7 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:48:58.400913 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-53d83d7a-e9b7-4195-8bc5-f053c3c9af54 req-2a9088ba-0493-4c2f-91ce-95b7598189c7 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:48:58.401346 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-53d83d7a-e9b7-4195-8bc5-f053c3c9af54 req-2a9088ba-0493-4c2f-91ce-95b7598189c7 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:48:58.412696 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-53d83d7a-e9b7-4195-8bc5-f053c3c9af54 req-2a9088ba-0493-4c2f-91ce-95b7598189c7 service nova] Creating event network-vif-plugged:53431a0b-b778-4e55-9432-2bdbdbfe9167 for instance 8e5aa2c7-20e6-4ca6-8337-7032247c956f on n-h2-846463-3 Sep 23 05:48:58.417580 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-53d83d7a-e9b7-4195-8bc5-f053c3c9af54 req-2a9088ba-0493-4c2f-91ce-95b7598189c7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032637 Sep 23 05:48:58.418204 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4012/7839] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:48:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:48:58.465561 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-be168211-9ad6-43d6-82ad-e1d15375526f tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:48:58.466273 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-be168211-9ad6-43d6-82ad-e1d15375526f tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 8e5aa2c7-20e6-4ca6-8337-7032247c956f] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:48:58.473676 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-be168211-9ad6-43d6-82ad-e1d15375526f tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:48:58.474233 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-be168211-9ad6-43d6-82ad-e1d15375526f tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:48:58.474694 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-be168211-9ad6-43d6-82ad-e1d15375526f tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:48:58.475493 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-be168211-9ad6-43d6-82ad-e1d15375526f tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:48:58.475972 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-be168211-9ad6-43d6-82ad-e1d15375526f tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:48:58.476424 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-be168211-9ad6-43d6-82ad-e1d15375526f tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:48:58.624044 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-be168211-9ad6-43d6-82ad-e1d15375526f tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:48:58.629779 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-be168211-9ad6-43d6-82ad-e1d15375526f tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/8e5aa2c7-20e6-4ca6-8337-7032247c956f" status: 200 len: 1393 microversion: 2.1 time: 0.168969 Sep 23 05:48:58.630397 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3828/7840] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:48:58 2022] GET /compute/v2.1/servers/8e5aa2c7-20e6-4ca6-8337-7032247c956f => generated 1393 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:48:59.654139 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5ce37786-dba7-4440-8c02-be351ad08425 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:48:59.654854 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-5ce37786-dba7-4440-8c02-be351ad08425 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 8e5aa2c7-20e6-4ca6-8337-7032247c956f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:48:59.656938 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:48:59.662117 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5ce37786-dba7-4440-8c02-be351ad08425 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:48:59.662621 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5ce37786-dba7-4440-8c02-be351ad08425 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:48:59.663070 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5ce37786-dba7-4440-8c02-be351ad08425 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:48:59.663770 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5ce37786-dba7-4440-8c02-be351ad08425 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:48:59.664239 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5ce37786-dba7-4440-8c02-be351ad08425 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:48:59.664715 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5ce37786-dba7-4440-8c02-be351ad08425 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:48:59.798497 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-5ce37786-dba7-4440-8c02-be351ad08425 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:48:59.807007 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5ce37786-dba7-4440-8c02-be351ad08425 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/8e5aa2c7-20e6-4ca6-8337-7032247c956f" status: 200 len: 1393 microversion: 2.1 time: 0.157806 Sep 23 05:48:59.807600 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4013/7841] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:48:59 2022] GET /compute/v2.1/servers/8e5aa2c7-20e6-4ca6-8337-7032247c956f => generated 1393 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:49:00.830722 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e9f557b5-7883-49f0-bb8c-88d2b1dcf816 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:49:00.831360 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e9f557b5-7883-49f0-bb8c-88d2b1dcf816 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 8e5aa2c7-20e6-4ca6-8337-7032247c956f] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:49:00.834115 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:49:00.834906 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=6 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:49:00.835501 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:49:00.840317 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e9f557b5-7883-49f0-bb8c-88d2b1dcf816 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:49:00.840826 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e9f557b5-7883-49f0-bb8c-88d2b1dcf816 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:49:00.841288 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e9f557b5-7883-49f0-bb8c-88d2b1dcf816 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:49:00.842044 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e9f557b5-7883-49f0-bb8c-88d2b1dcf816 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:49:00.842525 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e9f557b5-7883-49f0-bb8c-88d2b1dcf816 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:49:00.842977 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e9f557b5-7883-49f0-bb8c-88d2b1dcf816 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:49:00.975927 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e9f557b5-7883-49f0-bb8c-88d2b1dcf816 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:49:00.984294 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e9f557b5-7883-49f0-bb8c-88d2b1dcf816 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/8e5aa2c7-20e6-4ca6-8337-7032247c956f" status: 200 len: 1566 microversion: 2.1 time: 0.157535 Sep 23 05:49:00.991830 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3829/7842] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:49:00 2022] GET /compute/v2.1/servers/8e5aa2c7-20e6-4ca6-8337-7032247c956f => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:49:01.006871 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b4c1dcce-8d81-48b9-92db-8e5cdf0ea095 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:49:01.007482 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b4c1dcce-8d81-48b9-92db-8e5cdf0ea095 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 8e5aa2c7-20e6-4ca6-8337-7032247c956f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:49:01.009356 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=6 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:49:01.015191 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b4c1dcce-8d81-48b9-92db-8e5cdf0ea095 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:49:01.020767 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b4c1dcce-8d81-48b9-92db-8e5cdf0ea095 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:49:01.020767 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b4c1dcce-8d81-48b9-92db-8e5cdf0ea095 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:49:01.020767 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b4c1dcce-8d81-48b9-92db-8e5cdf0ea095 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:49:01.020767 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b4c1dcce-8d81-48b9-92db-8e5cdf0ea095 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:49:01.020767 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b4c1dcce-8d81-48b9-92db-8e5cdf0ea095 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:49:01.148537 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b4c1dcce-8d81-48b9-92db-8e5cdf0ea095 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:49:01.156352 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b4c1dcce-8d81-48b9-92db-8e5cdf0ea095 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/8e5aa2c7-20e6-4ca6-8337-7032247c956f" status: 200 len: 1566 microversion: 2.1 time: 0.153397 Sep 23 05:49:01.156930 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4014/7843] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:49:01 2022] GET /compute/v2.1/servers/8e5aa2c7-20e6-4ca6-8337-7032247c956f => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:49:03.347490 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e6c855f0-7c85-4fe8-b190-bfd5be85fad4 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:49:03.348134 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e6c855f0-7c85-4fe8-b190-bfd5be85fad4 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 8e5aa2c7-20e6-4ca6-8337-7032247c956f] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:49:03.354598 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-de55f6b2-04e9-41a5-818b-e2d15580d4e9 req-ff234b00-ce5c-4876-ab80-7d62939c5176 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e5aa2c7-20e6-4ca6-8337-7032247c956f", "tag": "53431a0b-b778-4e55-9432-2bdbdbfe9167"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:49:03.356444 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e6c855f0-7c85-4fe8-b190-bfd5be85fad4 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:49:03.357257 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e6c855f0-7c85-4fe8-b190-bfd5be85fad4 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:49:03.357991 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e6c855f0-7c85-4fe8-b190-bfd5be85fad4 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:49:03.358731 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e6c855f0-7c85-4fe8-b190-bfd5be85fad4 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:49:03.359217 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e6c855f0-7c85-4fe8-b190-bfd5be85fad4 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:49:03.359670 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e6c855f0-7c85-4fe8-b190-bfd5be85fad4 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:49:03.366315 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-de55f6b2-04e9-41a5-818b-e2d15580d4e9 req-ff234b00-ce5c-4876-ab80-7d62939c5176 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:49:03.367153 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-de55f6b2-04e9-41a5-818b-e2d15580d4e9 req-ff234b00-ce5c-4876-ab80-7d62939c5176 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:49:03.367608 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-de55f6b2-04e9-41a5-818b-e2d15580d4e9 req-ff234b00-ce5c-4876-ab80-7d62939c5176 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:49:03.379189 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-de55f6b2-04e9-41a5-818b-e2d15580d4e9 req-ff234b00-ce5c-4876-ab80-7d62939c5176 service nova] Creating event network-changed:53431a0b-b778-4e55-9432-2bdbdbfe9167 for instance 8e5aa2c7-20e6-4ca6-8337-7032247c956f on n-h2-846463-3 Sep 23 05:49:03.384345 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-de55f6b2-04e9-41a5-818b-e2d15580d4e9 req-ff234b00-ce5c-4876-ab80-7d62939c5176 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033900 Sep 23 05:49:03.385039 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4015/7844] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:49:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 05:49:03.507634 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e6c855f0-7c85-4fe8-b190-bfd5be85fad4 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:49:03.517069 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e6c855f0-7c85-4fe8-b190-bfd5be85fad4 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/8e5aa2c7-20e6-4ca6-8337-7032247c956f" status: 200 len: 1566 microversion: 2.1 time: 0.173813 Sep 23 05:49:03.517775 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3830/7845] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:49:03 2022] GET /compute/v2.1/servers/8e5aa2c7-20e6-4ca6-8337-7032247c956f => generated 1566 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:49:24.766015 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=5 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:49:24.766785 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=30 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:49:24.771194 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9c338023-8ca6-498a-8ed9-026466d0ad1b tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:49:24.773474 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-9c338023-8ca6-498a-8ed9-026466d0ad1b tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 8e5aa2c7-20e6-4ca6-8337-7032247c956f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:49:24.779635 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9c338023-8ca6-498a-8ed9-026466d0ad1b tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:49:24.783548 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9c338023-8ca6-498a-8ed9-026466d0ad1b tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:49:24.783548 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9c338023-8ca6-498a-8ed9-026466d0ad1b tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:49:24.783548 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9c338023-8ca6-498a-8ed9-026466d0ad1b tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:49:24.783548 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9c338023-8ca6-498a-8ed9-026466d0ad1b tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:49:24.783548 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9c338023-8ca6-498a-8ed9-026466d0ad1b tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:49:24.836133 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-9c338023-8ca6-498a-8ed9-026466d0ad1b tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "POST /compute/v2.1/servers/8e5aa2c7-20e6-4ca6-8337-7032247c956f/action" status: 200 len: 24571 microversion: 2.1 time: 0.071472 Sep 23 05:49:24.836774 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4016/7846] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 05:49:24 2022] POST /compute/v2.1/servers/8e5aa2c7-20e6-4ca6-8337-7032247c956f/action => generated 24571 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 05:49:31.150682 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-613294ad-eb58-4a63-8242-caf302cb7b17 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:49:31.153042 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-613294ad-eb58-4a63-8242-caf302cb7b17 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 8e5aa2c7-20e6-4ca6-8337-7032247c956f] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:49:31.155935 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=3 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:49:31.156657 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=44 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:49:31.161403 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-613294ad-eb58-4a63-8242-caf302cb7b17 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:49:31.161917 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-613294ad-eb58-4a63-8242-caf302cb7b17 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:49:31.162381 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-613294ad-eb58-4a63-8242-caf302cb7b17 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:49:31.163084 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-613294ad-eb58-4a63-8242-caf302cb7b17 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:49:31.163557 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-613294ad-eb58-4a63-8242-caf302cb7b17 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:49:31.163999 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-613294ad-eb58-4a63-8242-caf302cb7b17 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:49:31.441194 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-613294ad-eb58-4a63-8242-caf302cb7b17 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "POST /compute/v2.1/servers/8e5aa2c7-20e6-4ca6-8337-7032247c956f/action" status: 202 len: 0 microversion: 2.1 time: 0.294372 Sep 23 05:49:31.441905 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3831/7847] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 05:49:31 2022] POST /compute/v2.1/servers/8e5aa2c7-20e6-4ca6-8337-7032247c956f/action => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 05:49:31.452406 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ea8b8e17-3c39-437f-b2c4-dff9ba61161e tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:49:31.453204 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ea8b8e17-3c39-437f-b2c4-dff9ba61161e tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 8e5aa2c7-20e6-4ca6-8337-7032247c956f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:49:31.460495 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ea8b8e17-3c39-437f-b2c4-dff9ba61161e tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:49:31.460982 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ea8b8e17-3c39-437f-b2c4-dff9ba61161e tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:49:31.461422 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ea8b8e17-3c39-437f-b2c4-dff9ba61161e tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:49:31.462152 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ea8b8e17-3c39-437f-b2c4-dff9ba61161e tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:49:31.462621 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ea8b8e17-3c39-437f-b2c4-dff9ba61161e tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:49:31.465655 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ea8b8e17-3c39-437f-b2c4-dff9ba61161e tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:49:31.603429 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ea8b8e17-3c39-437f-b2c4-dff9ba61161e tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:49:31.611400 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ea8b8e17-3c39-437f-b2c4-dff9ba61161e tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/8e5aa2c7-20e6-4ca6-8337-7032247c956f" status: 200 len: 1676 microversion: 2.1 time: 0.164418 Sep 23 05:49:31.611982 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4017/7848] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:49:31 2022] GET /compute/v2.1/servers/8e5aa2c7-20e6-4ca6-8337-7032247c956f => generated 1676 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:49:32.639638 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-11f8cddb-b390-403a-9b0f-ceb0a2643acf tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:49:32.640371 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-11f8cddb-b390-403a-9b0f-ceb0a2643acf tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 8e5aa2c7-20e6-4ca6-8337-7032247c956f] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:49:32.647867 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-11f8cddb-b390-403a-9b0f-ceb0a2643acf tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:49:32.648383 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-11f8cddb-b390-403a-9b0f-ceb0a2643acf tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:49:32.648851 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-11f8cddb-b390-403a-9b0f-ceb0a2643acf tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:49:32.649571 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-11f8cddb-b390-403a-9b0f-ceb0a2643acf tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:49:32.650086 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-11f8cddb-b390-403a-9b0f-ceb0a2643acf tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:49:32.650536 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-11f8cddb-b390-403a-9b0f-ceb0a2643acf tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:49:32.783587 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-11f8cddb-b390-403a-9b0f-ceb0a2643acf tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:49:32.791448 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-11f8cddb-b390-403a-9b0f-ceb0a2643acf tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/8e5aa2c7-20e6-4ca6-8337-7032247c956f" status: 200 len: 1681 microversion: 2.1 time: 0.156214 Sep 23 05:49:32.792020 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3832/7849] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:49:32 2022] GET /compute/v2.1/servers/8e5aa2c7-20e6-4ca6-8337-7032247c956f => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:49:33.815679 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-268a61f3-9f04-41c1-89d2-43b87853a17a tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:49:33.816285 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-268a61f3-9f04-41c1-89d2-43b87853a17a tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 8e5aa2c7-20e6-4ca6-8337-7032247c956f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:49:33.823023 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-268a61f3-9f04-41c1-89d2-43b87853a17a tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:49:33.823660 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-268a61f3-9f04-41c1-89d2-43b87853a17a tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:49:33.824113 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-268a61f3-9f04-41c1-89d2-43b87853a17a tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:49:33.824825 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-268a61f3-9f04-41c1-89d2-43b87853a17a tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:49:33.825298 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-268a61f3-9f04-41c1-89d2-43b87853a17a tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:49:33.825737 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-268a61f3-9f04-41c1-89d2-43b87853a17a tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:49:33.956097 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-268a61f3-9f04-41c1-89d2-43b87853a17a tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:49:33.963898 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-268a61f3-9f04-41c1-89d2-43b87853a17a tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/8e5aa2c7-20e6-4ca6-8337-7032247c956f" status: 200 len: 1681 microversion: 2.1 time: 0.152215 Sep 23 05:49:33.964470 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4018/7850] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:49:33 2022] GET /compute/v2.1/servers/8e5aa2c7-20e6-4ca6-8337-7032247c956f => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:49:34.989988 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5001c4d8-a4e3-490d-b23b-489b365d7b67 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:49:34.990617 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5001c4d8-a4e3-490d-b23b-489b365d7b67 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 8e5aa2c7-20e6-4ca6-8337-7032247c956f] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:49:34.996669 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5001c4d8-a4e3-490d-b23b-489b365d7b67 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:49:34.997171 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5001c4d8-a4e3-490d-b23b-489b365d7b67 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:49:34.997622 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5001c4d8-a4e3-490d-b23b-489b365d7b67 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:49:34.998958 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5001c4d8-a4e3-490d-b23b-489b365d7b67 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:49:34.999431 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5001c4d8-a4e3-490d-b23b-489b365d7b67 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:49:34.999872 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5001c4d8-a4e3-490d-b23b-489b365d7b67 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:49:35.134941 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-5001c4d8-a4e3-490d-b23b-489b365d7b67 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:49:35.142868 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5001c4d8-a4e3-490d-b23b-489b365d7b67 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/8e5aa2c7-20e6-4ca6-8337-7032247c956f" status: 200 len: 1681 microversion: 2.1 time: 0.157070 Sep 23 05:49:35.143489 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3833/7851] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:49:34 2022] GET /compute/v2.1/servers/8e5aa2c7-20e6-4ca6-8337-7032247c956f => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:49:36.166312 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-05660bdc-bed9-45e0-b594-9c55f72eb30e tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:49:36.166953 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-05660bdc-bed9-45e0-b594-9c55f72eb30e tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 8e5aa2c7-20e6-4ca6-8337-7032247c956f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:49:36.173476 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-05660bdc-bed9-45e0-b594-9c55f72eb30e tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:49:36.174000 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-05660bdc-bed9-45e0-b594-9c55f72eb30e tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:49:36.174441 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-05660bdc-bed9-45e0-b594-9c55f72eb30e tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:49:36.175129 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-05660bdc-bed9-45e0-b594-9c55f72eb30e tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:49:36.175586 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-05660bdc-bed9-45e0-b594-9c55f72eb30e tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:49:36.176009 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-05660bdc-bed9-45e0-b594-9c55f72eb30e tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:49:36.305621 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-05660bdc-bed9-45e0-b594-9c55f72eb30e tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:49:36.314113 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-05660bdc-bed9-45e0-b594-9c55f72eb30e tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/8e5aa2c7-20e6-4ca6-8337-7032247c956f" status: 200 len: 1681 microversion: 2.1 time: 0.151700 Sep 23 05:49:36.314734 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4019/7852] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:49:36 2022] GET /compute/v2.1/servers/8e5aa2c7-20e6-4ca6-8337-7032247c956f => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:49:37.338611 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6843f7ce-ee87-4a76-bac4-0eb3ce93a0a7 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:49:37.339283 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-6843f7ce-ee87-4a76-bac4-0eb3ce93a0a7 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 8e5aa2c7-20e6-4ca6-8337-7032247c956f] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:49:37.346893 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6843f7ce-ee87-4a76-bac4-0eb3ce93a0a7 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:49:37.347351 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6843f7ce-ee87-4a76-bac4-0eb3ce93a0a7 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:49:37.347812 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6843f7ce-ee87-4a76-bac4-0eb3ce93a0a7 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:49:37.348531 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6843f7ce-ee87-4a76-bac4-0eb3ce93a0a7 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:49:37.349060 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6843f7ce-ee87-4a76-bac4-0eb3ce93a0a7 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:49:37.349508 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6843f7ce-ee87-4a76-bac4-0eb3ce93a0a7 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:49:37.486606 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6843f7ce-ee87-4a76-bac4-0eb3ce93a0a7 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:49:37.494283 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-6843f7ce-ee87-4a76-bac4-0eb3ce93a0a7 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/8e5aa2c7-20e6-4ca6-8337-7032247c956f" status: 200 len: 1681 microversion: 2.1 time: 0.159690 Sep 23 05:49:37.494855 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3834/7853] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:49:37 2022] GET /compute/v2.1/servers/8e5aa2c7-20e6-4ca6-8337-7032247c956f => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:49:38.519254 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e11a025d-76c3-432f-b3e6-fc90ee4fdd40 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:49:38.527756 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e11a025d-76c3-432f-b3e6-fc90ee4fdd40 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 8e5aa2c7-20e6-4ca6-8337-7032247c956f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:49:38.527756 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e11a025d-76c3-432f-b3e6-fc90ee4fdd40 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:49:38.527756 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e11a025d-76c3-432f-b3e6-fc90ee4fdd40 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:49:38.528156 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e11a025d-76c3-432f-b3e6-fc90ee4fdd40 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:49:38.528690 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e11a025d-76c3-432f-b3e6-fc90ee4fdd40 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:49:38.529160 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e11a025d-76c3-432f-b3e6-fc90ee4fdd40 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:49:38.530112 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e11a025d-76c3-432f-b3e6-fc90ee4fdd40 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:49:38.663025 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e11a025d-76c3-432f-b3e6-fc90ee4fdd40 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:49:38.671184 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e11a025d-76c3-432f-b3e6-fc90ee4fdd40 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/8e5aa2c7-20e6-4ca6-8337-7032247c956f" status: 200 len: 1681 microversion: 2.1 time: 0.157097 Sep 23 05:49:38.671783 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4020/7854] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:49:38 2022] GET /compute/v2.1/servers/8e5aa2c7-20e6-4ca6-8337-7032247c956f => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:49:39.695031 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-92876d14-0bde-42a7-b08d-44a7abc2fd5c tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:49:39.695691 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-92876d14-0bde-42a7-b08d-44a7abc2fd5c tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 8e5aa2c7-20e6-4ca6-8337-7032247c956f] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:49:39.702621 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-92876d14-0bde-42a7-b08d-44a7abc2fd5c tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:49:39.703131 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-92876d14-0bde-42a7-b08d-44a7abc2fd5c tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:49:39.703588 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-92876d14-0bde-42a7-b08d-44a7abc2fd5c tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:49:39.704298 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-92876d14-0bde-42a7-b08d-44a7abc2fd5c tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:49:39.704776 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-92876d14-0bde-42a7-b08d-44a7abc2fd5c tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:49:39.705220 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-92876d14-0bde-42a7-b08d-44a7abc2fd5c tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:49:39.833087 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-92876d14-0bde-42a7-b08d-44a7abc2fd5c tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:49:39.840801 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-92876d14-0bde-42a7-b08d-44a7abc2fd5c tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/8e5aa2c7-20e6-4ca6-8337-7032247c956f" status: 200 len: 1681 microversion: 2.1 time: 0.149705 Sep 23 05:49:39.841370 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3835/7855] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:49:39 2022] GET /compute/v2.1/servers/8e5aa2c7-20e6-4ca6-8337-7032247c956f => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:49:40.864552 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-52c7ccc8-47f2-4f5c-9de6-a9753b592feb tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:49:40.865166 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-52c7ccc8-47f2-4f5c-9de6-a9753b592feb tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 8e5aa2c7-20e6-4ca6-8337-7032247c956f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:49:40.871642 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-52c7ccc8-47f2-4f5c-9de6-a9753b592feb tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:49:40.872127 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-52c7ccc8-47f2-4f5c-9de6-a9753b592feb tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:49:40.872565 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-52c7ccc8-47f2-4f5c-9de6-a9753b592feb tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:49:40.873968 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-52c7ccc8-47f2-4f5c-9de6-a9753b592feb tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:49:40.874464 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-52c7ccc8-47f2-4f5c-9de6-a9753b592feb tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:49:40.874889 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-52c7ccc8-47f2-4f5c-9de6-a9753b592feb tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:49:41.013418 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-52c7ccc8-47f2-4f5c-9de6-a9753b592feb tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:49:41.021766 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-52c7ccc8-47f2-4f5c-9de6-a9753b592feb tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/8e5aa2c7-20e6-4ca6-8337-7032247c956f" status: 200 len: 1681 microversion: 2.1 time: 0.161121 Sep 23 05:49:41.022361 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4021/7856] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:49:40 2022] GET /compute/v2.1/servers/8e5aa2c7-20e6-4ca6-8337-7032247c956f => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:49:42.044795 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-65de9f21-70b0-413d-90e4-f585155df886 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:49:42.045439 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-65de9f21-70b0-413d-90e4-f585155df886 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 8e5aa2c7-20e6-4ca6-8337-7032247c956f] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:49:42.052545 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-65de9f21-70b0-413d-90e4-f585155df886 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:49:42.053059 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-65de9f21-70b0-413d-90e4-f585155df886 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:49:42.053523 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-65de9f21-70b0-413d-90e4-f585155df886 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:49:42.054306 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-65de9f21-70b0-413d-90e4-f585155df886 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:49:42.054790 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-65de9f21-70b0-413d-90e4-f585155df886 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:49:42.055240 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-65de9f21-70b0-413d-90e4-f585155df886 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:49:42.186778 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-65de9f21-70b0-413d-90e4-f585155df886 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:49:42.194574 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-65de9f21-70b0-413d-90e4-f585155df886 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/8e5aa2c7-20e6-4ca6-8337-7032247c956f" status: 200 len: 1681 microversion: 2.1 time: 0.153824 Sep 23 05:49:42.195150 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3836/7857] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:49:42 2022] GET /compute/v2.1/servers/8e5aa2c7-20e6-4ca6-8337-7032247c956f => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:49:43.219094 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-767438fd-91af-40a3-bcca-3faa2c4c9b16 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:49:43.219707 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-767438fd-91af-40a3-bcca-3faa2c4c9b16 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 8e5aa2c7-20e6-4ca6-8337-7032247c956f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:49:43.226399 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-767438fd-91af-40a3-bcca-3faa2c4c9b16 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:49:43.226927 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-767438fd-91af-40a3-bcca-3faa2c4c9b16 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:49:43.227371 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-767438fd-91af-40a3-bcca-3faa2c4c9b16 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:49:43.228068 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-767438fd-91af-40a3-bcca-3faa2c4c9b16 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:49:43.228529 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-767438fd-91af-40a3-bcca-3faa2c4c9b16 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:49:43.228963 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-767438fd-91af-40a3-bcca-3faa2c4c9b16 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:49:43.363472 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-767438fd-91af-40a3-bcca-3faa2c4c9b16 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:49:43.371345 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-767438fd-91af-40a3-bcca-3faa2c4c9b16 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/8e5aa2c7-20e6-4ca6-8337-7032247c956f" status: 200 len: 1684 microversion: 2.1 time: 0.156832 Sep 23 05:49:43.371915 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4022/7858] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:49:43 2022] GET /compute/v2.1/servers/8e5aa2c7-20e6-4ca6-8337-7032247c956f => generated 1684 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:50:07.561503 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-03a17224-ed84-4376-a3d6-9d86581b198c tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:50:07.563680 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-03a17224-ed84-4376-a3d6-9d86581b198c tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 8e5aa2c7-20e6-4ca6-8337-7032247c956f] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:50:07.565832 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=12 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:50:07.566706 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:50:07.571332 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-03a17224-ed84-4376-a3d6-9d86581b198c tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:50:07.571840 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-03a17224-ed84-4376-a3d6-9d86581b198c tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:50:07.572297 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-03a17224-ed84-4376-a3d6-9d86581b198c tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:50:07.573011 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-03a17224-ed84-4376-a3d6-9d86581b198c tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:50:07.573491 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-03a17224-ed84-4376-a3d6-9d86581b198c tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:50:07.573964 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-03a17224-ed84-4376-a3d6-9d86581b198c tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:50:07.630758 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-03a17224-ed84-4376-a3d6-9d86581b198c tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "POST /compute/v2.1/servers/8e5aa2c7-20e6-4ca6-8337-7032247c956f/action" status: 200 len: 68976 microversion: 2.1 time: 0.073879 Sep 23 05:50:07.631426 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3837/7859] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 05:50:07 2022] POST /compute/v2.1/servers/8e5aa2c7-20e6-4ca6-8337-7032247c956f/action => generated 68976 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 05:50:14.669958 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b52d3020-ffdc-4320-b524-32e2c7a19009 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:50:14.670496 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b52d3020-ffdc-4320-b524-32e2c7a19009 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 8e5aa2c7-20e6-4ca6-8337-7032247c956f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:50:14.672778 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-58017aa0-3998-45a0-8ce7-9ad3ab222960 req-ac74e2c8-ac46-4e1e-ac97-f9081f241bfb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e5aa2c7-20e6-4ca6-8337-7032247c956f", "tag": "53431a0b-b778-4e55-9432-2bdbdbfe9167"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:50:14.673196 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=14 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:50:14.673456 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=40 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:50:14.678661 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b52d3020-ffdc-4320-b524-32e2c7a19009 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:50:14.679620 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b52d3020-ffdc-4320-b524-32e2c7a19009 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:50:14.680387 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b52d3020-ffdc-4320-b524-32e2c7a19009 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:50:14.681356 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b52d3020-ffdc-4320-b524-32e2c7a19009 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:50:14.681936 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b52d3020-ffdc-4320-b524-32e2c7a19009 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:50:14.682436 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b52d3020-ffdc-4320-b524-32e2c7a19009 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:50:14.685967 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-58017aa0-3998-45a0-8ce7-9ad3ab222960 req-ac74e2c8-ac46-4e1e-ac97-f9081f241bfb service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:50:14.688835 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-58017aa0-3998-45a0-8ce7-9ad3ab222960 req-ac74e2c8-ac46-4e1e-ac97-f9081f241bfb service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:50:14.688835 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-58017aa0-3998-45a0-8ce7-9ad3ab222960 req-ac74e2c8-ac46-4e1e-ac97-f9081f241bfb service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:50:14.699752 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-58017aa0-3998-45a0-8ce7-9ad3ab222960 req-ac74e2c8-ac46-4e1e-ac97-f9081f241bfb service nova] Creating event network-changed:53431a0b-b778-4e55-9432-2bdbdbfe9167 for instance 8e5aa2c7-20e6-4ca6-8337-7032247c956f on n-h2-846463-3 Sep 23 05:50:14.705683 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-58017aa0-3998-45a0-8ce7-9ad3ab222960 req-ac74e2c8-ac46-4e1e-ac97-f9081f241bfb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037566 Sep 23 05:50:14.706623 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3838/7860] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:50:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 05:50:14.715090 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b52d3020-ffdc-4320-b524-32e2c7a19009 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 8e5aa2c7-20e6-4ca6-8337-7032247c956f] Going to try to terminate instance {{(pid=122699) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 05:50:15.001905 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b52d3020-ffdc-4320-b524-32e2c7a19009 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "DELETE /compute/v2.1/servers/8e5aa2c7-20e6-4ca6-8337-7032247c956f" status: 204 len: 0 microversion: 2.1 time: 0.336442 Sep 23 05:50:15.002586 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4023/7861] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 05:50:14 2022] DELETE /compute/v2.1/servers/8e5aa2c7-20e6-4ca6-8337-7032247c956f => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 05:50:15.016071 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d9a5f8f7-22da-4275-ac7b-9fa319f66cff tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:50:15.016071 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d9a5f8f7-22da-4275-ac7b-9fa319f66cff tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 8e5aa2c7-20e6-4ca6-8337-7032247c956f] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:50:15.021867 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d9a5f8f7-22da-4275-ac7b-9fa319f66cff tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:50:15.022437 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d9a5f8f7-22da-4275-ac7b-9fa319f66cff tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:50:15.022894 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d9a5f8f7-22da-4275-ac7b-9fa319f66cff tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:50:15.023611 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d9a5f8f7-22da-4275-ac7b-9fa319f66cff tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:50:15.024082 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d9a5f8f7-22da-4275-ac7b-9fa319f66cff tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:50:15.024519 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d9a5f8f7-22da-4275-ac7b-9fa319f66cff tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:50:15.296357 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d9a5f8f7-22da-4275-ac7b-9fa319f66cff tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:50:15.304523 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d9a5f8f7-22da-4275-ac7b-9fa319f66cff tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/8e5aa2c7-20e6-4ca6-8337-7032247c956f" status: 200 len: 1690 microversion: 2.1 time: 0.297359 Sep 23 05:50:15.308543 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3839/7862] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:50:15 2022] GET /compute/v2.1/servers/8e5aa2c7-20e6-4ca6-8337-7032247c956f => generated 1690 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:50:16.329822 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4b660752-322f-417f-8ef5-ba9c0b7e6d6c tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:50:16.330985 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4b660752-322f-417f-8ef5-ba9c0b7e6d6c tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 8e5aa2c7-20e6-4ca6-8337-7032247c956f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:50:16.337479 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4b660752-322f-417f-8ef5-ba9c0b7e6d6c tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:50:16.338014 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4b660752-322f-417f-8ef5-ba9c0b7e6d6c tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:50:16.338611 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4b660752-322f-417f-8ef5-ba9c0b7e6d6c tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:50:16.339159 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4b660752-322f-417f-8ef5-ba9c0b7e6d6c tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:50:16.339643 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4b660752-322f-417f-8ef5-ba9c0b7e6d6c tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:50:16.340072 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4b660752-322f-417f-8ef5-ba9c0b7e6d6c tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:50:16.535914 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-4b660752-322f-417f-8ef5-ba9c0b7e6d6c tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:50:16.543960 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4b660752-322f-417f-8ef5-ba9c0b7e6d6c tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/8e5aa2c7-20e6-4ca6-8337-7032247c956f" status: 200 len: 1690 microversion: 2.1 time: 0.218969 Sep 23 05:50:16.544602 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4024/7863] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:50:16 2022] GET /compute/v2.1/servers/8e5aa2c7-20e6-4ca6-8337-7032247c956f => generated 1690 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:50:17.078476 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-4f987cd4-0605-443b-9631-65ffe4f8f073 req-3bb2d27a-1cff-4b70-a41f-d34ee6a0534e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e5aa2c7-20e6-4ca6-8337-7032247c956f", "name": "network-vif-deleted", "tag": "53431a0b-b778-4e55-9432-2bdbdbfe9167"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:50:17.089099 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-4f987cd4-0605-443b-9631-65ffe4f8f073 req-3bb2d27a-1cff-4b70-a41f-d34ee6a0534e service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:50:17.089603 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-4f987cd4-0605-443b-9631-65ffe4f8f073 req-3bb2d27a-1cff-4b70-a41f-d34ee6a0534e service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:50:17.090087 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-4f987cd4-0605-443b-9631-65ffe4f8f073 req-3bb2d27a-1cff-4b70-a41f-d34ee6a0534e service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:50:17.110814 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-4f987cd4-0605-443b-9631-65ffe4f8f073 req-3bb2d27a-1cff-4b70-a41f-d34ee6a0534e service nova] Creating event network-vif-deleted:53431a0b-b778-4e55-9432-2bdbdbfe9167 for instance 8e5aa2c7-20e6-4ca6-8337-7032247c956f on n-h2-846463-3 Sep 23 05:50:17.115805 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-4f987cd4-0605-443b-9631-65ffe4f8f073 req-3bb2d27a-1cff-4b70-a41f-d34ee6a0534e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099929 Sep 23 05:50:17.116354 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3840/7864] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:50:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 05:50:17.567058 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0ffcf125-9386-4927-b9a4-e36b04df150c tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:50:17.567600 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-0ffcf125-9386-4927-b9a4-e36b04df150c tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 8e5aa2c7-20e6-4ca6-8337-7032247c956f] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:50:17.574108 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0ffcf125-9386-4927-b9a4-e36b04df150c tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:50:17.574597 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0ffcf125-9386-4927-b9a4-e36b04df150c tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:50:17.575036 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0ffcf125-9386-4927-b9a4-e36b04df150c tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:50:17.576245 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0ffcf125-9386-4927-b9a4-e36b04df150c tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:50:17.576748 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0ffcf125-9386-4927-b9a4-e36b04df150c tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:50:17.577185 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0ffcf125-9386-4927-b9a4-e36b04df150c tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:50:17.607936 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0ffcf125-9386-4927-b9a4-e36b04df150c tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:50:17.608438 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0ffcf125-9386-4927-b9a4-e36b04df150c tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:50:17.608854 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0ffcf125-9386-4927-b9a4-e36b04df150c tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:50:17.609296 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-0ffcf125-9386-4927-b9a4-e36b04df150c tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lazy-loading 'fault' on Instance uuid 8e5aa2c7-20e6-4ca6-8337-7032247c956f {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 05:50:17.649252 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-0ffcf125-9386-4927-b9a4-e36b04df150c tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:50:17.657539 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0ffcf125-9386-4927-b9a4-e36b04df150c tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/8e5aa2c7-20e6-4ca6-8337-7032247c956f" status: 200 len: 1357 microversion: 2.1 time: 0.094428 Sep 23 05:50:17.658131 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4025/7865] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:50:17 2022] GET /compute/v2.1/servers/8e5aa2c7-20e6-4ca6-8337-7032247c956f => generated 1357 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:50:18.684463 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0ddd33d3-a1ce-4df9-8003-9ea471720235 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:50:18.685241 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-0ddd33d3-a1ce-4df9-8003-9ea471720235 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 8e5aa2c7-20e6-4ca6-8337-7032247c956f] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:50:18.691869 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0ddd33d3-a1ce-4df9-8003-9ea471720235 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:50:18.692387 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0ddd33d3-a1ce-4df9-8003-9ea471720235 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:50:18.692849 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0ddd33d3-a1ce-4df9-8003-9ea471720235 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:50:18.693561 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0ddd33d3-a1ce-4df9-8003-9ea471720235 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:50:18.694074 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0ddd33d3-a1ce-4df9-8003-9ea471720235 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:50:18.694522 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0ddd33d3-a1ce-4df9-8003-9ea471720235 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:50:18.709659 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-0ddd33d3-a1ce-4df9-8003-9ea471720235 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] HTTP exception thrown: Instance 8e5aa2c7-20e6-4ca6-8337-7032247c956f could not be found. Sep 23 05:50:18.711367 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0ddd33d3-a1ce-4df9-8003-9ea471720235 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Request method failure captured: Sep 23 05:50:18.711367 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/8e5aa2c7-20e6-4ca6-8337-7032247c956f HTTP/1.1 Sep 23 05:50:18.711367 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 05:50:18.711367 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 05:50:18.711367 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 05:50:18.711367 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 05:50:18.711367 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 05:50:18.711367 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 05:50:18.711367 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 05:50:18.711367 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 05:50:18.711367 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLUhz7bpvepG5vaaNTB45PETsbu7BFN8GjZeZ_vLrd5WJDjgd_oQ5bhmVua4C2ZhQgOahIirm-KuGCZTB_5bToAYjCLfVfw81RihC56n3ttHDJ0Tgc_iEV4MwjR_WQmCh9B38US55e6l82-uxms5I3hOmslhT2_3dhZB9TyAC0xyC3YM Sep 23 05:50:18.711367 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 05:50:18.711367 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 05:50:18.711367 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 05:50:18.711367 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 05:50:18.711367 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 05:50:18.711367 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 05:50:18.711367 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 498fb069adef49d19ed802d2133adb89 Sep 23 05:50:18.711367 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2142034074 Sep 23 05:50:18.711367 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 05:50:18.711367 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 05:50:18.711367 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_498fb069adef49d19ed802d2133adb89", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/498fb069adef49d19ed802d2133adb89"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/498fb069adef49d19ed802d2133adb89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/498fb069adef49d19ed802d2133adb89"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:50:18.711367 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2142034074 Sep 23 05:50:18.711367 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 498fb069adef49d19ed802d2133adb89 Sep 23 05:50:18.711367 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2142034074 Sep 23 05:50:18.711367 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-TestNetworkAdvancedServerOps-2142034074-project Sep 23 05:50:18.711367 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 05:50:18.711367 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 05:50:18.711367 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: e9d36972d8f2413b8838e64998b43359 Sep 23 05:50:18.711367 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2142034074-project Sep 23 05:50:18.711367 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 05:50:18.711367 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 8e5aa2c7-20e6-4ca6-8337-7032247c956f could not be found. Sep 23 05:50:18.711367 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '8e5aa2c7-20e6-4ca6-8337-7032247c956f'} Sep 23 05:50:18.711367 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:50:18.711367 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:50:18.711367 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 05:50:18.711367 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 05:50:18.711367 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 05:50:18.711367 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 05:50:18.711367 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 05:50:18.711367 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 05:50:18.711367 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 05:50:18.711367 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 05:50:18.711367 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e5aa2c7-20e6-4ca6-8337-7032247c956f could not be found. Sep 23 05:50:18.711367 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:50:18.711367 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:50:18.711367 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:50:18.711367 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:50:18.711367 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:50:18.711367 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:50:18.711367 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:50:18.711367 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:50:18.711367 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:50:18.711367 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:50:18.711367 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 05:50:18.711367 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 05:50:18.711367 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 05:50:18.711367 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 05:50:18.711367 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 05:50:18.711367 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:50:18.711367 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e5aa2c7-20e6-4ca6-8337-7032247c956f could not be found. Sep 23 05:50:18.711367 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:50:18.711367 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:50:18.717779 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:50:18.717779 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:50:18.717779 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:50:18.717779 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:50:18.717779 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:50:18.717779 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:50:18.717779 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e5aa2c7-20e6-4ca6-8337-7032247c956f could not be found. Sep 23 05:50:18.717779 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:50:18.717779 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0ddd33d3-a1ce-4df9-8003-9ea471720235 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Returning 404 to user: Instance 8e5aa2c7-20e6-4ca6-8337-7032247c956f could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:50:18.717779 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0ddd33d3-a1ce-4df9-8003-9ea471720235 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/8e5aa2c7-20e6-4ca6-8337-7032247c956f" status: 404 len: 111 microversion: 2.1 time: 0.033650 Sep 23 05:50:18.717779 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3841/7866] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:50:18 2022] GET /compute/v2.1/servers/8e5aa2c7-20e6-4ca6-8337-7032247c956f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 05:50:22.522312 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d586c98d-cbce-4046-a8f6-ad126f9ddc9a tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '.version_select at 0x7ff1ba8421f0>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:50:22.591656 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d586c98d-cbce-4046-a8f6-ad126f9ddc9a tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2044519979" status: 202 len: 0 microversion: 2.1 time: 0.073850 Sep 23 05:50:22.592194 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4026/7867] 10.222.0.33 () {58 vars in 1284 bytes} [Fri Sep 23 05:50:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2044519979 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 05:50:22.620484 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5eeab531-bc1e-4636-95e0-49041ea70cdb tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Action: 'create', calling method: .version_select at 0x7ff1ba72ac10>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1797074374", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLbWQK33NloW4JhZDntLbaXvLWgAl9pHy0QwlcotNC+SMbPaovWOgj5ITZTRkBQ7Idc4BsAfyYSlcZfw2BUgAGW9Z5FUotHaC1g1pHCmFe00EUxtzz6JdOcO8R9lYLUZRA=="}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:50:22.641210 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-5eeab531-bc1e-4636-95e0-49041ea70cdb tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Getting quotas for project 498fb069adef49d19ed802d2133adb89. Resources: {'key_pairs'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 05:50:22.646587 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-5eeab531-bc1e-4636-95e0-49041ea70cdb tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Getting quotas for user e9d36972d8f2413b8838e64998b43359 and project 498fb069adef49d19ed802d2133adb89. Resources: {'key_pairs'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 05:50:22.746207 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5eeab531-bc1e-4636-95e0-49041ea70cdb tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.129745 Sep 23 05:50:22.746917 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3842/7868] 10.222.0.33 () {60 vars in 1159 bytes} [Fri Sep 23 05:50:22 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:50:31.196209 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:50:31.206453 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-895de3cc-dc56-4b31-b950-3a6521dd7950 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-878468405", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "networks": [{"uuid": "8498a0e6-e80a-4c3c-b169-3e461414e673"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1797074374", "security_groups": [{"name": "tempest-secgroup-smoke-659983723"}]}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:50:31.354402 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.neutron [None req-895de3cc-dc56-4b31-b950-3a6521dd7950 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] validate_networks() for [('8498a0e6-e80a-4c3c-b169-3e461414e673', None, None, None, None, None)] {{(pid=122699) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 05:50:31.816838 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-895de3cc-dc56-4b31-b950-3a6521dd7950 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Flavor limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 05:50:31.817540 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-895de3cc-dc56-4b31-b950-3a6521dd7950 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Image limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 05:50:31.818074 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-895de3cc-dc56-4b31-b950-3a6521dd7950 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Flavor pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 05:50:31.818530 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-895de3cc-dc56-4b31-b950-3a6521dd7950 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Image pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 05:50:31.819002 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-895de3cc-dc56-4b31-b950-3a6521dd7950 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 05:50:31.828646 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-895de3cc-dc56-4b31-b950-3a6521dd7950 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:50:31.829356 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-895de3cc-dc56-4b31-b950-3a6521dd7950 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:50:31.829569 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-895de3cc-dc56-4b31-b950-3a6521dd7950 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:50:31.830328 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-895de3cc-dc56-4b31-b950-3a6521dd7950 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:50:31.830790 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-895de3cc-dc56-4b31-b950-3a6521dd7950 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:50:31.831219 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-895de3cc-dc56-4b31-b950-3a6521dd7950 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:50:31.849806 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-895de3cc-dc56-4b31-b950-3a6521dd7950 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Getting quotas for project 498fb069adef49d19ed802d2133adb89. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 05:50:31.855138 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-895de3cc-dc56-4b31-b950-3a6521dd7950 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Getting quotas for user e9d36972d8f2413b8838e64998b43359 and project 498fb069adef49d19ed802d2133adb89. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 05:50:31.867679 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-895de3cc-dc56-4b31-b950-3a6521dd7950 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Going to run 1 instances... {{(pid=122699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 05:50:31.870297 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-895de3cc-dc56-4b31-b950-3a6521dd7950 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 107d520c-6f84-41bc-86f9-84c21718cc35] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 05:50:32.000643 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-895de3cc-dc56-4b31-b950-3a6521dd7950 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.807504 Sep 23 05:50:32.001305 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4027/7869] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 05:50:31 2022] POST /compute/v2.1/servers => generated 405 bytes in 809 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 23 05:50:32.010587 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=16 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:50:32.015924 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d0a77738-0ea7-4c0b-ad71-147ae6fb3f96 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:50:32.016561 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d0a77738-0ea7-4c0b-ad71-147ae6fb3f96 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 107d520c-6f84-41bc-86f9-84c21718cc35] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:50:32.074580 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d0a77738-0ea7-4c0b-ad71-147ae6fb3f96 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:50:32.082356 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d0a77738-0ea7-4c0b-ad71-147ae6fb3f96 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/107d520c-6f84-41bc-86f9-84c21718cc35" status: 200 len: 1266 microversion: 2.1 time: 0.073492 Sep 23 05:50:32.082950 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3843/7870] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:50:32 2022] GET /compute/v2.1/servers/107d520c-6f84-41bc-86f9-84c21718cc35 => generated 1266 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:50:33.107113 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1982cadb-4b06-496a-8acb-82f340ec6ba1 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:50:33.107732 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1982cadb-4b06-496a-8acb-82f340ec6ba1 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 107d520c-6f84-41bc-86f9-84c21718cc35] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:50:33.166305 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1982cadb-4b06-496a-8acb-82f340ec6ba1 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:50:33.174456 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1982cadb-4b06-496a-8acb-82f340ec6ba1 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/107d520c-6f84-41bc-86f9-84c21718cc35" status: 200 len: 1266 microversion: 2.1 time: 0.071307 Sep 23 05:50:33.175024 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4028/7871] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:50:33 2022] GET /compute/v2.1/servers/107d520c-6f84-41bc-86f9-84c21718cc35 => generated 1266 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:50:34.198101 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-df683dfe-b558-494a-91a6-94978d3f8047 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:50:34.199323 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-df683dfe-b558-494a-91a6-94978d3f8047 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 107d520c-6f84-41bc-86f9-84c21718cc35] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:50:34.254082 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-df683dfe-b558-494a-91a6-94978d3f8047 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:50:34.261176 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-df683dfe-b558-494a-91a6-94978d3f8047 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/107d520c-6f84-41bc-86f9-84c21718cc35" status: 200 len: 1266 microversion: 2.1 time: 0.067170 Sep 23 05:50:34.261763 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3844/7872] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:50:34 2022] GET /compute/v2.1/servers/107d520c-6f84-41bc-86f9-84c21718cc35 => generated 1266 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:50:35.285489 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b544dbcd-5fb4-4823-b08f-49ca1d484b83 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:50:35.286214 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b544dbcd-5fb4-4823-b08f-49ca1d484b83 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 107d520c-6f84-41bc-86f9-84c21718cc35] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:50:35.344055 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b544dbcd-5fb4-4823-b08f-49ca1d484b83 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:50:35.351176 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b544dbcd-5fb4-4823-b08f-49ca1d484b83 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/107d520c-6f84-41bc-86f9-84c21718cc35" status: 200 len: 1266 microversion: 2.1 time: 0.069933 Sep 23 05:50:35.351743 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4029/7873] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:50:35 2022] GET /compute/v2.1/servers/107d520c-6f84-41bc-86f9-84c21718cc35 => generated 1266 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:50:36.375496 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0b89edc9-9cbb-444f-a04e-1988a43ed325 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:50:36.376199 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-0b89edc9-9cbb-444f-a04e-1988a43ed325 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 107d520c-6f84-41bc-86f9-84c21718cc35] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:50:36.383097 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0b89edc9-9cbb-444f-a04e-1988a43ed325 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:50:36.383605 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0b89edc9-9cbb-444f-a04e-1988a43ed325 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:50:36.384064 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0b89edc9-9cbb-444f-a04e-1988a43ed325 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:50:36.384778 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0b89edc9-9cbb-444f-a04e-1988a43ed325 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:50:36.385259 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0b89edc9-9cbb-444f-a04e-1988a43ed325 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:50:36.385705 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0b89edc9-9cbb-444f-a04e-1988a43ed325 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:50:36.450313 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-0b89edc9-9cbb-444f-a04e-1988a43ed325 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:50:36.458034 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0b89edc9-9cbb-444f-a04e-1988a43ed325 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/107d520c-6f84-41bc-86f9-84c21718cc35" status: 200 len: 1270 microversion: 2.1 time: 0.087119 Sep 23 05:50:36.458615 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3845/7874] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:50:36 2022] GET /compute/v2.1/servers/107d520c-6f84-41bc-86f9-84c21718cc35 => generated 1270 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:50:37.481406 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-430c84d4-e177-4c33-90a9-e5f7e538b329 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:50:37.482057 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-430c84d4-e177-4c33-90a9-e5f7e538b329 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 107d520c-6f84-41bc-86f9-84c21718cc35] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:50:37.489109 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-430c84d4-e177-4c33-90a9-e5f7e538b329 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:50:37.489608 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-430c84d4-e177-4c33-90a9-e5f7e538b329 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:50:37.490099 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-430c84d4-e177-4c33-90a9-e5f7e538b329 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:50:37.490811 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-430c84d4-e177-4c33-90a9-e5f7e538b329 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:50:37.491281 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-430c84d4-e177-4c33-90a9-e5f7e538b329 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:50:37.491714 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-430c84d4-e177-4c33-90a9-e5f7e538b329 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:50:37.552089 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-430c84d4-e177-4c33-90a9-e5f7e538b329 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:50:37.560470 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-430c84d4-e177-4c33-90a9-e5f7e538b329 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/107d520c-6f84-41bc-86f9-84c21718cc35" status: 200 len: 1318 microversion: 2.1 time: 0.082428 Sep 23 05:50:37.561082 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4030/7875] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:50:37 2022] GET /compute/v2.1/servers/107d520c-6f84-41bc-86f9-84c21718cc35 => generated 1318 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:50:38.587179 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5766a648-181e-450c-be05-e85ab49fa54d tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:50:38.588016 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5766a648-181e-450c-be05-e85ab49fa54d tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 107d520c-6f84-41bc-86f9-84c21718cc35] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:50:38.592788 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:50:38.597054 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5766a648-181e-450c-be05-e85ab49fa54d tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:50:38.597660 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5766a648-181e-450c-be05-e85ab49fa54d tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:50:38.598486 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5766a648-181e-450c-be05-e85ab49fa54d tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:50:38.599303 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5766a648-181e-450c-be05-e85ab49fa54d tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:50:38.599879 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5766a648-181e-450c-be05-e85ab49fa54d tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:50:38.600397 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5766a648-181e-450c-be05-e85ab49fa54d tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:50:38.667963 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-5766a648-181e-450c-be05-e85ab49fa54d tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:50:38.676301 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5766a648-181e-450c-be05-e85ab49fa54d tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/107d520c-6f84-41bc-86f9-84c21718cc35" status: 200 len: 1324 microversion: 2.1 time: 0.093503 Sep 23 05:50:38.680477 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3846/7876] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:50:38 2022] GET /compute/v2.1/servers/107d520c-6f84-41bc-86f9-84c21718cc35 => generated 1324 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:50:39.701023 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-dee67c25-246f-4ea2-bd38-fc5622ebb16b tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:50:39.701692 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-dee67c25-246f-4ea2-bd38-fc5622ebb16b tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 107d520c-6f84-41bc-86f9-84c21718cc35] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:50:39.708489 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dee67c25-246f-4ea2-bd38-fc5622ebb16b tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:50:39.708993 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dee67c25-246f-4ea2-bd38-fc5622ebb16b tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:50:39.709444 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dee67c25-246f-4ea2-bd38-fc5622ebb16b tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:50:39.710186 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dee67c25-246f-4ea2-bd38-fc5622ebb16b tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:50:39.710651 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dee67c25-246f-4ea2-bd38-fc5622ebb16b tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:50:39.711086 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-dee67c25-246f-4ea2-bd38-fc5622ebb16b tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:50:39.754133 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-c30193e0-43bb-4f71-9104-7d2c4c1b03bf req-1220f824-9731-49a5-a44d-42424d971094 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "107d520c-6f84-41bc-86f9-84c21718cc35", "tag": "351e31fb-27e8-4b86-96d5-9150d67b4f93"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:50:39.773400 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-c30193e0-43bb-4f71-9104-7d2c4c1b03bf req-1220f824-9731-49a5-a44d-42424d971094 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:50:39.774741 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-c30193e0-43bb-4f71-9104-7d2c4c1b03bf req-1220f824-9731-49a5-a44d-42424d971094 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:50:39.774741 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-c30193e0-43bb-4f71-9104-7d2c4c1b03bf req-1220f824-9731-49a5-a44d-42424d971094 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:50:39.787091 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-c30193e0-43bb-4f71-9104-7d2c4c1b03bf req-1220f824-9731-49a5-a44d-42424d971094 service nova] Creating event network-changed:351e31fb-27e8-4b86-96d5-9150d67b4f93 for instance 107d520c-6f84-41bc-86f9-84c21718cc35 on n-h1-846463-3 Sep 23 05:50:39.792666 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-c30193e0-43bb-4f71-9104-7d2c4c1b03bf req-1220f824-9731-49a5-a44d-42424d971094 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042876 Sep 23 05:50:39.794017 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3847/7877] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:50:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 05:50:39.855600 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-dee67c25-246f-4ea2-bd38-fc5622ebb16b tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:50:39.863547 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-dee67c25-246f-4ea2-bd38-fc5622ebb16b tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/107d520c-6f84-41bc-86f9-84c21718cc35" status: 200 len: 1391 microversion: 2.1 time: 0.167093 Sep 23 05:50:39.864140 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4031/7878] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:50:39 2022] GET /compute/v2.1/servers/107d520c-6f84-41bc-86f9-84c21718cc35 => generated 1391 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:50:40.888870 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1f5d06ce-726c-4dc4-9506-c152be9e2a38 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:50:40.889592 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-1f5d06ce-726c-4dc4-9506-c152be9e2a38 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 107d520c-6f84-41bc-86f9-84c21718cc35] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:50:40.895838 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1f5d06ce-726c-4dc4-9506-c152be9e2a38 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:50:40.896628 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1f5d06ce-726c-4dc4-9506-c152be9e2a38 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:50:40.897087 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1f5d06ce-726c-4dc4-9506-c152be9e2a38 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:50:40.897797 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1f5d06ce-726c-4dc4-9506-c152be9e2a38 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:50:40.898297 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1f5d06ce-726c-4dc4-9506-c152be9e2a38 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:50:40.898742 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1f5d06ce-726c-4dc4-9506-c152be9e2a38 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:50:41.028644 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-1f5d06ce-726c-4dc4-9506-c152be9e2a38 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:50:41.036349 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-1f5d06ce-726c-4dc4-9506-c152be9e2a38 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/107d520c-6f84-41bc-86f9-84c21718cc35" status: 200 len: 1391 microversion: 2.1 time: 0.152577 Sep 23 05:50:41.036919 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3848/7879] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:50:40 2022] GET /compute/v2.1/servers/107d520c-6f84-41bc-86f9-84c21718cc35 => generated 1391 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:50:42.060299 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d0b88474-3d91-4eef-b60f-2e55a59b91ea tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:50:42.060847 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d0b88474-3d91-4eef-b60f-2e55a59b91ea tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 107d520c-6f84-41bc-86f9-84c21718cc35] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:50:42.063223 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:50:42.068086 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d0b88474-3d91-4eef-b60f-2e55a59b91ea tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:50:42.068569 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d0b88474-3d91-4eef-b60f-2e55a59b91ea tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:50:42.069003 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d0b88474-3d91-4eef-b60f-2e55a59b91ea tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:50:42.069688 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d0b88474-3d91-4eef-b60f-2e55a59b91ea tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:50:42.070172 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d0b88474-3d91-4eef-b60f-2e55a59b91ea tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:50:42.070606 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d0b88474-3d91-4eef-b60f-2e55a59b91ea tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:50:42.199845 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d0b88474-3d91-4eef-b60f-2e55a59b91ea tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:50:42.208126 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d0b88474-3d91-4eef-b60f-2e55a59b91ea tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/107d520c-6f84-41bc-86f9-84c21718cc35" status: 200 len: 1391 microversion: 2.1 time: 0.152285 Sep 23 05:50:42.208707 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4032/7880] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:50:42 2022] GET /compute/v2.1/servers/107d520c-6f84-41bc-86f9-84c21718cc35 => generated 1391 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:50:43.231976 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8ed3d6e6-531f-4ff5-9be4-ecf281c9d80d tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:50:43.232629 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8ed3d6e6-531f-4ff5-9be4-ecf281c9d80d tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 107d520c-6f84-41bc-86f9-84c21718cc35] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:50:43.239619 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8ed3d6e6-531f-4ff5-9be4-ecf281c9d80d tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:50:43.240119 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8ed3d6e6-531f-4ff5-9be4-ecf281c9d80d tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:50:43.240569 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8ed3d6e6-531f-4ff5-9be4-ecf281c9d80d tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:50:43.241273 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8ed3d6e6-531f-4ff5-9be4-ecf281c9d80d tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:50:43.241741 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8ed3d6e6-531f-4ff5-9be4-ecf281c9d80d tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:50:43.242200 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8ed3d6e6-531f-4ff5-9be4-ecf281c9d80d tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:50:43.377500 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8ed3d6e6-531f-4ff5-9be4-ecf281c9d80d tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:50:43.385339 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8ed3d6e6-531f-4ff5-9be4-ecf281c9d80d tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/107d520c-6f84-41bc-86f9-84c21718cc35" status: 200 len: 1391 microversion: 2.1 time: 0.157782 Sep 23 05:50:43.385855 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3849/7881] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:50:43 2022] GET /compute/v2.1/servers/107d520c-6f84-41bc-86f9-84c21718cc35 => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:50:44.409145 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f727bd93-54cb-4a27-9851-94112b8fc050 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:50:44.409693 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f727bd93-54cb-4a27-9851-94112b8fc050 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 107d520c-6f84-41bc-86f9-84c21718cc35] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:50:44.416164 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f727bd93-54cb-4a27-9851-94112b8fc050 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:50:44.416651 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f727bd93-54cb-4a27-9851-94112b8fc050 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:50:44.417091 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f727bd93-54cb-4a27-9851-94112b8fc050 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:50:44.417779 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f727bd93-54cb-4a27-9851-94112b8fc050 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:50:44.418261 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f727bd93-54cb-4a27-9851-94112b8fc050 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:50:44.419325 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f727bd93-54cb-4a27-9851-94112b8fc050 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:50:44.548236 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f727bd93-54cb-4a27-9851-94112b8fc050 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:50:44.555926 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f727bd93-54cb-4a27-9851-94112b8fc050 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/107d520c-6f84-41bc-86f9-84c21718cc35" status: 200 len: 1391 microversion: 2.1 time: 0.150805 Sep 23 05:50:44.556496 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4033/7882] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:50:44 2022] GET /compute/v2.1/servers/107d520c-6f84-41bc-86f9-84c21718cc35 => generated 1391 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:50:45.578677 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4fdc4dc1-ef8d-4434-a45f-55ce56ab0c98 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:50:45.579314 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4fdc4dc1-ef8d-4434-a45f-55ce56ab0c98 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 107d520c-6f84-41bc-86f9-84c21718cc35] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:50:45.582259 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=8 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:50:45.587184 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4fdc4dc1-ef8d-4434-a45f-55ce56ab0c98 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:50:45.587696 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4fdc4dc1-ef8d-4434-a45f-55ce56ab0c98 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:50:45.588159 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4fdc4dc1-ef8d-4434-a45f-55ce56ab0c98 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:50:45.588884 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4fdc4dc1-ef8d-4434-a45f-55ce56ab0c98 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:50:45.589371 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4fdc4dc1-ef8d-4434-a45f-55ce56ab0c98 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:50:45.589820 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4fdc4dc1-ef8d-4434-a45f-55ce56ab0c98 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:50:45.615945 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-c18f2218-1955-4924-b8f3-e6390bbc69ea req-75bafb24-4652-4efb-b27f-c820dd22ce88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "107d520c-6f84-41bc-86f9-84c21718cc35", "name": "network-vif-plugged", "status": "completed", "tag": "351e31fb-27e8-4b86-96d5-9150d67b4f93"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:50:45.621312 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=10 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:50:45.626186 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:50:45.629769 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-c18f2218-1955-4924-b8f3-e6390bbc69ea req-75bafb24-4652-4efb-b27f-c820dd22ce88 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:50:45.630301 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-c18f2218-1955-4924-b8f3-e6390bbc69ea req-75bafb24-4652-4efb-b27f-c820dd22ce88 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:50:45.630732 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-c18f2218-1955-4924-b8f3-e6390bbc69ea req-75bafb24-4652-4efb-b27f-c820dd22ce88 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:50:45.642715 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-c18f2218-1955-4924-b8f3-e6390bbc69ea req-75bafb24-4652-4efb-b27f-c820dd22ce88 service nova] Creating event network-vif-plugged:351e31fb-27e8-4b86-96d5-9150d67b4f93 for instance 107d520c-6f84-41bc-86f9-84c21718cc35 on n-h1-846463-3 Sep 23 05:50:45.648311 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-c18f2218-1955-4924-b8f3-e6390bbc69ea req-75bafb24-4652-4efb-b27f-c820dd22ce88 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036153 Sep 23 05:50:45.648945 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4034/7883] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:50:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:50:45.734386 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4fdc4dc1-ef8d-4434-a45f-55ce56ab0c98 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:50:45.742516 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4fdc4dc1-ef8d-4434-a45f-55ce56ab0c98 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/107d520c-6f84-41bc-86f9-84c21718cc35" status: 200 len: 1391 microversion: 2.1 time: 0.167625 Sep 23 05:50:45.746561 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3850/7884] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:50:45 2022] GET /compute/v2.1/servers/107d520c-6f84-41bc-86f9-84c21718cc35 => generated 1391 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:50:46.768413 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-bc572f71-32ec-4cd7-92c3-848fd216bb13 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:50:46.769784 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-bc572f71-32ec-4cd7-92c3-848fd216bb13 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 107d520c-6f84-41bc-86f9-84c21718cc35] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:50:46.777535 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bc572f71-32ec-4cd7-92c3-848fd216bb13 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:50:46.777535 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bc572f71-32ec-4cd7-92c3-848fd216bb13 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:50:46.781288 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bc572f71-32ec-4cd7-92c3-848fd216bb13 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:50:46.781288 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bc572f71-32ec-4cd7-92c3-848fd216bb13 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:50:46.781288 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bc572f71-32ec-4cd7-92c3-848fd216bb13 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:50:46.781288 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bc572f71-32ec-4cd7-92c3-848fd216bb13 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:50:46.917250 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-bc572f71-32ec-4cd7-92c3-848fd216bb13 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:50:46.925663 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-bc572f71-32ec-4cd7-92c3-848fd216bb13 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/107d520c-6f84-41bc-86f9-84c21718cc35" status: 200 len: 1391 microversion: 2.1 time: 0.162691 Sep 23 05:50:46.926289 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4035/7885] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:50:46 2022] GET /compute/v2.1/servers/107d520c-6f84-41bc-86f9-84c21718cc35 => generated 1391 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:50:47.949222 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-adcfbaea-9028-4aa6-a0a2-ce6f653b6e9a tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:50:47.950490 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-adcfbaea-9028-4aa6-a0a2-ce6f653b6e9a tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 107d520c-6f84-41bc-86f9-84c21718cc35] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:50:47.957352 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-adcfbaea-9028-4aa6-a0a2-ce6f653b6e9a tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:50:47.957853 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-adcfbaea-9028-4aa6-a0a2-ce6f653b6e9a tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:50:47.958341 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-adcfbaea-9028-4aa6-a0a2-ce6f653b6e9a tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:50:47.959044 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-adcfbaea-9028-4aa6-a0a2-ce6f653b6e9a tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:50:47.959515 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-adcfbaea-9028-4aa6-a0a2-ce6f653b6e9a tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:50:47.959953 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-adcfbaea-9028-4aa6-a0a2-ce6f653b6e9a tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:50:48.101877 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-adcfbaea-9028-4aa6-a0a2-ce6f653b6e9a tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:50:48.109923 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-adcfbaea-9028-4aa6-a0a2-ce6f653b6e9a tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/107d520c-6f84-41bc-86f9-84c21718cc35" status: 200 len: 1563 microversion: 2.1 time: 0.164566 Sep 23 05:50:48.110496 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3851/7886] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:50:47 2022] GET /compute/v2.1/servers/107d520c-6f84-41bc-86f9-84c21718cc35 => generated 1563 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:50:48.133263 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-34848a35-bdad-4be1-92c1-01d65538ba7c tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:50:48.133879 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-34848a35-bdad-4be1-92c1-01d65538ba7c tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 107d520c-6f84-41bc-86f9-84c21718cc35] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:50:48.141660 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-34848a35-bdad-4be1-92c1-01d65538ba7c tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:50:48.142194 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-34848a35-bdad-4be1-92c1-01d65538ba7c tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:50:48.142646 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-34848a35-bdad-4be1-92c1-01d65538ba7c tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:50:48.143351 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-34848a35-bdad-4be1-92c1-01d65538ba7c tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:50:48.143816 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-34848a35-bdad-4be1-92c1-01d65538ba7c tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:50:48.144247 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-34848a35-bdad-4be1-92c1-01d65538ba7c tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:50:48.278770 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-34848a35-bdad-4be1-92c1-01d65538ba7c tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:50:48.292371 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-34848a35-bdad-4be1-92c1-01d65538ba7c tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/107d520c-6f84-41bc-86f9-84c21718cc35" status: 200 len: 1563 microversion: 2.1 time: 0.163032 Sep 23 05:50:48.292968 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4036/7887] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:50:48 2022] GET /compute/v2.1/servers/107d520c-6f84-41bc-86f9-84c21718cc35 => generated 1563 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:50:50.642523 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4b3202ad-32a9-4e2b-a07a-a9f2b6610202 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:50:50.643154 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4b3202ad-32a9-4e2b-a07a-a9f2b6610202 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 107d520c-6f84-41bc-86f9-84c21718cc35] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:50:50.643283 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-5fe0aaec-7cee-486e-9da6-0d13358dea68 req-6043ea50-bb1c-46b3-bdfd-57242ebb2f94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "107d520c-6f84-41bc-86f9-84c21718cc35", "tag": "351e31fb-27e8-4b86-96d5-9150d67b4f93"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:50:50.649488 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4b3202ad-32a9-4e2b-a07a-a9f2b6610202 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:50:50.650149 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4b3202ad-32a9-4e2b-a07a-a9f2b6610202 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:50:50.650609 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4b3202ad-32a9-4e2b-a07a-a9f2b6610202 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:50:50.651321 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4b3202ad-32a9-4e2b-a07a-a9f2b6610202 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:50:50.651984 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4b3202ad-32a9-4e2b-a07a-a9f2b6610202 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:50:50.652493 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4b3202ad-32a9-4e2b-a07a-a9f2b6610202 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:50:50.653775 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-5fe0aaec-7cee-486e-9da6-0d13358dea68 req-6043ea50-bb1c-46b3-bdfd-57242ebb2f94 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:50:50.654377 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-5fe0aaec-7cee-486e-9da6-0d13358dea68 req-6043ea50-bb1c-46b3-bdfd-57242ebb2f94 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:50:50.654915 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-5fe0aaec-7cee-486e-9da6-0d13358dea68 req-6043ea50-bb1c-46b3-bdfd-57242ebb2f94 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:50:50.667131 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-5fe0aaec-7cee-486e-9da6-0d13358dea68 req-6043ea50-bb1c-46b3-bdfd-57242ebb2f94 service nova] Creating event network-changed:351e31fb-27e8-4b86-96d5-9150d67b4f93 for instance 107d520c-6f84-41bc-86f9-84c21718cc35 on n-h1-846463-3 Sep 23 05:50:50.672875 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-5fe0aaec-7cee-486e-9da6-0d13358dea68 req-6043ea50-bb1c-46b3-bdfd-57242ebb2f94 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033246 Sep 23 05:50:50.673484 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4037/7888] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:50:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:50:50.812996 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4b3202ad-32a9-4e2b-a07a-a9f2b6610202 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:50:50.821049 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4b3202ad-32a9-4e2b-a07a-a9f2b6610202 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/107d520c-6f84-41bc-86f9-84c21718cc35" status: 200 len: 1563 microversion: 2.1 time: 0.183928 Sep 23 05:50:50.821861 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3852/7889] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:50:50 2022] GET /compute/v2.1/servers/107d520c-6f84-41bc-86f9-84c21718cc35 => generated 1563 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:51:12.073950 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=7 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:51:12.074727 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=42 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:51:12.079093 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f453b7a0-8d62-4759-8497-ed08d91c720d tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:51:12.083798 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f453b7a0-8d62-4759-8497-ed08d91c720d tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 107d520c-6f84-41bc-86f9-84c21718cc35] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:51:12.087819 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f453b7a0-8d62-4759-8497-ed08d91c720d tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:51:12.088331 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f453b7a0-8d62-4759-8497-ed08d91c720d tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:51:12.088760 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f453b7a0-8d62-4759-8497-ed08d91c720d tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:51:12.089465 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f453b7a0-8d62-4759-8497-ed08d91c720d tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:51:12.090031 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f453b7a0-8d62-4759-8497-ed08d91c720d tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:51:12.090472 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f453b7a0-8d62-4759-8497-ed08d91c720d tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:51:12.144913 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f453b7a0-8d62-4759-8497-ed08d91c720d tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "POST /compute/v2.1/servers/107d520c-6f84-41bc-86f9-84c21718cc35/action" status: 200 len: 24568 microversion: 2.1 time: 0.072415 Sep 23 05:51:12.145876 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4038/7890] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 05:51:12 2022] POST /compute/v2.1/servers/107d520c-6f84-41bc-86f9-84c21718cc35/action => generated 24568 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 05:51:18.605547 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a371d948-ee2a-4ed0-914d-70975d4a7bf3 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:51:18.608371 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a371d948-ee2a-4ed0-914d-70975d4a7bf3 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 107d520c-6f84-41bc-86f9-84c21718cc35] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:51:18.610653 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=13 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:51:18.611353 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=44 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:51:18.616106 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a371d948-ee2a-4ed0-914d-70975d4a7bf3 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:51:18.616614 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a371d948-ee2a-4ed0-914d-70975d4a7bf3 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:51:18.617075 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a371d948-ee2a-4ed0-914d-70975d4a7bf3 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:51:18.617797 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a371d948-ee2a-4ed0-914d-70975d4a7bf3 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:51:18.618306 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a371d948-ee2a-4ed0-914d-70975d4a7bf3 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:51:18.618771 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a371d948-ee2a-4ed0-914d-70975d4a7bf3 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:51:18.658593 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a371d948-ee2a-4ed0-914d-70975d4a7bf3 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:51:18.664373 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a371d948-ee2a-4ed0-914d-70975d4a7bf3 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 107d520c-6f84-41bc-86f9-84c21718cc35] Old instance type m1.heat2, new instance type m1.heat {{(pid=122698) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 23 05:51:18.671921 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-a371d948-ee2a-4ed0-914d-70975d4a7bf3 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Flavor limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 05:51:18.673427 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-a371d948-ee2a-4ed0-914d-70975d4a7bf3 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Image limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 05:51:18.673427 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-a371d948-ee2a-4ed0-914d-70975d4a7bf3 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Flavor pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 05:51:18.673427 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-a371d948-ee2a-4ed0-914d-70975d4a7bf3 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Image pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 05:51:18.673743 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-a371d948-ee2a-4ed0-914d-70975d4a7bf3 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 05:51:18.861667 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a371d948-ee2a-4ed0-914d-70975d4a7bf3 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "POST /compute/v2.1/servers/107d520c-6f84-41bc-86f9-84c21718cc35/action" status: 202 len: 0 microversion: 2.1 time: 0.260375 Sep 23 05:51:18.862330 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3853/7891] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 05:51:18 2022] POST /compute/v2.1/servers/107d520c-6f84-41bc-86f9-84c21718cc35/action => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 05:51:18.871338 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e4593d05-0939-4d78-9e70-926bfeb7cdff tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:51:18.873691 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e4593d05-0939-4d78-9e70-926bfeb7cdff tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 107d520c-6f84-41bc-86f9-84c21718cc35] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:51:18.880045 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e4593d05-0939-4d78-9e70-926bfeb7cdff tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:51:18.880720 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e4593d05-0939-4d78-9e70-926bfeb7cdff tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:51:18.881176 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e4593d05-0939-4d78-9e70-926bfeb7cdff tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:51:18.881911 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e4593d05-0939-4d78-9e70-926bfeb7cdff tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:51:18.882399 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e4593d05-0939-4d78-9e70-926bfeb7cdff tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:51:18.882818 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e4593d05-0939-4d78-9e70-926bfeb7cdff tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:51:19.019110 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e4593d05-0939-4d78-9e70-926bfeb7cdff tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:51:19.027678 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e4593d05-0939-4d78-9e70-926bfeb7cdff tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/107d520c-6f84-41bc-86f9-84c21718cc35" status: 200 len: 1690 microversion: 2.1 time: 0.160722 Sep 23 05:51:19.030311 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4039/7892] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:51:18 2022] GET /compute/v2.1/servers/107d520c-6f84-41bc-86f9-84c21718cc35 => generated 1690 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:51:20.054917 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4fca7508-d353-4596-9485-24a23788b8ac tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:51:20.062396 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4fca7508-d353-4596-9485-24a23788b8ac tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 107d520c-6f84-41bc-86f9-84c21718cc35] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:51:20.065034 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4fca7508-d353-4596-9485-24a23788b8ac tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:51:20.065558 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4fca7508-d353-4596-9485-24a23788b8ac tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:51:20.066053 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4fca7508-d353-4596-9485-24a23788b8ac tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:51:20.066782 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4fca7508-d353-4596-9485-24a23788b8ac tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:51:20.067262 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4fca7508-d353-4596-9485-24a23788b8ac tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:51:20.067711 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4fca7508-d353-4596-9485-24a23788b8ac tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:51:20.208835 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4fca7508-d353-4596-9485-24a23788b8ac tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:51:20.218117 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4fca7508-d353-4596-9485-24a23788b8ac tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/107d520c-6f84-41bc-86f9-84c21718cc35" status: 200 len: 1690 microversion: 2.1 time: 0.166724 Sep 23 05:51:20.219142 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3854/7893] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:51:20 2022] GET /compute/v2.1/servers/107d520c-6f84-41bc-86f9-84c21718cc35 => generated 1690 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:51:21.242976 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-30eff2fe-f265-4c2e-9b3b-8e1c5bef140c tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:51:21.243642 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-30eff2fe-f265-4c2e-9b3b-8e1c5bef140c tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 107d520c-6f84-41bc-86f9-84c21718cc35] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:51:21.250740 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-30eff2fe-f265-4c2e-9b3b-8e1c5bef140c tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:51:21.251238 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-30eff2fe-f265-4c2e-9b3b-8e1c5bef140c tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:51:21.251705 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-30eff2fe-f265-4c2e-9b3b-8e1c5bef140c tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:51:21.252412 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-30eff2fe-f265-4c2e-9b3b-8e1c5bef140c tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:51:21.252874 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-30eff2fe-f265-4c2e-9b3b-8e1c5bef140c tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:51:21.253304 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-30eff2fe-f265-4c2e-9b3b-8e1c5bef140c tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:51:21.396214 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-30eff2fe-f265-4c2e-9b3b-8e1c5bef140c tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:51:21.404526 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-30eff2fe-f265-4c2e-9b3b-8e1c5bef140c tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/107d520c-6f84-41bc-86f9-84c21718cc35" status: 200 len: 1690 microversion: 2.1 time: 0.165434 Sep 23 05:51:21.405042 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4040/7894] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:51:21 2022] GET /compute/v2.1/servers/107d520c-6f84-41bc-86f9-84c21718cc35 => generated 1690 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:51:22.429405 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3a1825aa-0030-4545-8f28-df18e30b4a88 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:51:22.430075 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3a1825aa-0030-4545-8f28-df18e30b4a88 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 107d520c-6f84-41bc-86f9-84c21718cc35] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:51:22.437496 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3a1825aa-0030-4545-8f28-df18e30b4a88 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:51:22.438102 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3a1825aa-0030-4545-8f28-df18e30b4a88 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:51:22.438560 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3a1825aa-0030-4545-8f28-df18e30b4a88 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:51:22.439279 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3a1825aa-0030-4545-8f28-df18e30b4a88 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:51:22.439760 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3a1825aa-0030-4545-8f28-df18e30b4a88 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:51:22.440205 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3a1825aa-0030-4545-8f28-df18e30b4a88 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:51:22.577678 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-3a1825aa-0030-4545-8f28-df18e30b4a88 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:51:22.585500 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3a1825aa-0030-4545-8f28-df18e30b4a88 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/107d520c-6f84-41bc-86f9-84c21718cc35" status: 200 len: 1695 microversion: 2.1 time: 0.160092 Sep 23 05:51:22.586852 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3855/7895] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:51:22 2022] GET /compute/v2.1/servers/107d520c-6f84-41bc-86f9-84c21718cc35 => generated 1695 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:51:23.611352 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0de255af-1abd-4d14-9758-7794e86d1a2f tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:51:23.611969 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-0de255af-1abd-4d14-9758-7794e86d1a2f tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 107d520c-6f84-41bc-86f9-84c21718cc35] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:51:23.618798 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0de255af-1abd-4d14-9758-7794e86d1a2f tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:51:23.619352 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0de255af-1abd-4d14-9758-7794e86d1a2f tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:51:23.619801 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0de255af-1abd-4d14-9758-7794e86d1a2f tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:51:23.620505 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0de255af-1abd-4d14-9758-7794e86d1a2f tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:51:23.621013 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0de255af-1abd-4d14-9758-7794e86d1a2f tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:51:23.621448 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0de255af-1abd-4d14-9758-7794e86d1a2f tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:51:23.752211 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-0de255af-1abd-4d14-9758-7794e86d1a2f tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:51:23.759940 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0de255af-1abd-4d14-9758-7794e86d1a2f tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/107d520c-6f84-41bc-86f9-84c21718cc35" status: 200 len: 1695 microversion: 2.1 time: 0.153638 Sep 23 05:51:23.760521 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4041/7896] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:51:23 2022] GET /compute/v2.1/servers/107d520c-6f84-41bc-86f9-84c21718cc35 => generated 1695 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:51:24.783890 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-162016d4-265a-4d11-8cf4-4671afd99612 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:51:24.784517 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-162016d4-265a-4d11-8cf4-4671afd99612 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 107d520c-6f84-41bc-86f9-84c21718cc35] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:51:24.791466 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-162016d4-265a-4d11-8cf4-4671afd99612 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:51:24.791970 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-162016d4-265a-4d11-8cf4-4671afd99612 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:51:24.792426 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-162016d4-265a-4d11-8cf4-4671afd99612 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:51:24.793138 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-162016d4-265a-4d11-8cf4-4671afd99612 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:51:24.793616 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-162016d4-265a-4d11-8cf4-4671afd99612 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:51:24.794142 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-162016d4-265a-4d11-8cf4-4671afd99612 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:51:24.930178 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-162016d4-265a-4d11-8cf4-4671afd99612 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:51:24.938340 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-162016d4-265a-4d11-8cf4-4671afd99612 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/107d520c-6f84-41bc-86f9-84c21718cc35" status: 200 len: 1695 microversion: 2.1 time: 0.158416 Sep 23 05:51:24.938913 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3856/7897] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:51:24 2022] GET /compute/v2.1/servers/107d520c-6f84-41bc-86f9-84c21718cc35 => generated 1695 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:51:25.962434 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-393f78b7-96c6-4692-8c1a-40c8d00ddfdf tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:51:25.963056 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-393f78b7-96c6-4692-8c1a-40c8d00ddfdf tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 107d520c-6f84-41bc-86f9-84c21718cc35] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:51:25.970247 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-393f78b7-96c6-4692-8c1a-40c8d00ddfdf tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:51:25.970749 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-393f78b7-96c6-4692-8c1a-40c8d00ddfdf tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:51:25.971194 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-393f78b7-96c6-4692-8c1a-40c8d00ddfdf tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:51:25.971896 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-393f78b7-96c6-4692-8c1a-40c8d00ddfdf tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:51:25.972359 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-393f78b7-96c6-4692-8c1a-40c8d00ddfdf tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:51:25.972792 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-393f78b7-96c6-4692-8c1a-40c8d00ddfdf tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:51:26.102841 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-393f78b7-96c6-4692-8c1a-40c8d00ddfdf tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:51:26.110654 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-393f78b7-96c6-4692-8c1a-40c8d00ddfdf tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/107d520c-6f84-41bc-86f9-84c21718cc35" status: 200 len: 1695 microversion: 2.1 time: 0.152197 Sep 23 05:51:26.111229 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4042/7898] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:51:25 2022] GET /compute/v2.1/servers/107d520c-6f84-41bc-86f9-84c21718cc35 => generated 1695 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:51:27.134702 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d8f5d082-a940-4966-8a7b-ac3d03a33e53 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:51:27.135330 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d8f5d082-a940-4966-8a7b-ac3d03a33e53 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 107d520c-6f84-41bc-86f9-84c21718cc35] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:51:27.142224 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d8f5d082-a940-4966-8a7b-ac3d03a33e53 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:51:27.142736 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d8f5d082-a940-4966-8a7b-ac3d03a33e53 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:51:27.143199 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d8f5d082-a940-4966-8a7b-ac3d03a33e53 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:51:27.143913 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d8f5d082-a940-4966-8a7b-ac3d03a33e53 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:51:27.144394 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d8f5d082-a940-4966-8a7b-ac3d03a33e53 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:51:27.144838 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d8f5d082-a940-4966-8a7b-ac3d03a33e53 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:51:27.275787 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d8f5d082-a940-4966-8a7b-ac3d03a33e53 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:51:27.284218 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d8f5d082-a940-4966-8a7b-ac3d03a33e53 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/107d520c-6f84-41bc-86f9-84c21718cc35" status: 200 len: 1695 microversion: 2.1 time: 0.153470 Sep 23 05:51:27.284794 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3857/7899] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:51:27 2022] GET /compute/v2.1/servers/107d520c-6f84-41bc-86f9-84c21718cc35 => generated 1695 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:51:28.307706 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-287e903d-6b12-407a-a566-0c1a32feedf3 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:51:28.308353 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-287e903d-6b12-407a-a566-0c1a32feedf3 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 107d520c-6f84-41bc-86f9-84c21718cc35] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:51:28.315840 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-287e903d-6b12-407a-a566-0c1a32feedf3 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:51:28.316383 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-287e903d-6b12-407a-a566-0c1a32feedf3 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:51:28.316835 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-287e903d-6b12-407a-a566-0c1a32feedf3 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:51:28.317543 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-287e903d-6b12-407a-a566-0c1a32feedf3 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:51:28.318052 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-287e903d-6b12-407a-a566-0c1a32feedf3 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:51:28.318495 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-287e903d-6b12-407a-a566-0c1a32feedf3 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:51:28.453477 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-287e903d-6b12-407a-a566-0c1a32feedf3 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:51:28.461308 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-287e903d-6b12-407a-a566-0c1a32feedf3 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/107d520c-6f84-41bc-86f9-84c21718cc35" status: 200 len: 1695 microversion: 2.1 time: 0.157568 Sep 23 05:51:28.461932 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4043/7900] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:51:28 2022] GET /compute/v2.1/servers/107d520c-6f84-41bc-86f9-84c21718cc35 => generated 1695 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:51:29.484810 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9417e05a-876e-428b-a002-ae07059b69ee tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:51:29.485352 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-9417e05a-876e-428b-a002-ae07059b69ee tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 107d520c-6f84-41bc-86f9-84c21718cc35] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:51:29.492548 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9417e05a-876e-428b-a002-ae07059b69ee tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:51:29.493059 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9417e05a-876e-428b-a002-ae07059b69ee tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:51:29.493615 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9417e05a-876e-428b-a002-ae07059b69ee tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:51:29.494360 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9417e05a-876e-428b-a002-ae07059b69ee tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:51:29.494842 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9417e05a-876e-428b-a002-ae07059b69ee tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:51:29.495293 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9417e05a-876e-428b-a002-ae07059b69ee tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:51:29.626825 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-9417e05a-876e-428b-a002-ae07059b69ee tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:51:29.634819 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9417e05a-876e-428b-a002-ae07059b69ee tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/107d520c-6f84-41bc-86f9-84c21718cc35" status: 200 len: 1695 microversion: 2.1 time: 0.154043 Sep 23 05:51:29.635389 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3858/7901] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:51:29 2022] GET /compute/v2.1/servers/107d520c-6f84-41bc-86f9-84c21718cc35 => generated 1695 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:51:30.659510 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d0f3ff51-df85-48d6-ad6d-5f89bb4e2754 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:51:30.660138 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d0f3ff51-df85-48d6-ad6d-5f89bb4e2754 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 107d520c-6f84-41bc-86f9-84c21718cc35] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:51:30.666704 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d0f3ff51-df85-48d6-ad6d-5f89bb4e2754 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:51:30.667201 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d0f3ff51-df85-48d6-ad6d-5f89bb4e2754 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:51:30.667648 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d0f3ff51-df85-48d6-ad6d-5f89bb4e2754 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:51:30.668353 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d0f3ff51-df85-48d6-ad6d-5f89bb4e2754 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:51:30.669465 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d0f3ff51-df85-48d6-ad6d-5f89bb4e2754 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:51:30.670004 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d0f3ff51-df85-48d6-ad6d-5f89bb4e2754 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:51:30.807466 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d0f3ff51-df85-48d6-ad6d-5f89bb4e2754 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:51:30.815397 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d0f3ff51-df85-48d6-ad6d-5f89bb4e2754 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/107d520c-6f84-41bc-86f9-84c21718cc35" status: 200 len: 1695 microversion: 2.1 time: 0.159810 Sep 23 05:51:30.815966 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4044/7902] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:51:30 2022] GET /compute/v2.1/servers/107d520c-6f84-41bc-86f9-84c21718cc35 => generated 1695 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:51:31.838729 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-dcbce6c7-4ef7-4573-9471-da0b295c68c6 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:51:31.839397 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-dcbce6c7-4ef7-4573-9471-da0b295c68c6 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 107d520c-6f84-41bc-86f9-84c21718cc35] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:51:31.846210 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dcbce6c7-4ef7-4573-9471-da0b295c68c6 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:51:31.846712 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dcbce6c7-4ef7-4573-9471-da0b295c68c6 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:51:31.847167 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dcbce6c7-4ef7-4573-9471-da0b295c68c6 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:51:31.847871 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dcbce6c7-4ef7-4573-9471-da0b295c68c6 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:51:31.848342 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dcbce6c7-4ef7-4573-9471-da0b295c68c6 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:51:31.848784 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dcbce6c7-4ef7-4573-9471-da0b295c68c6 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:51:31.977844 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-dcbce6c7-4ef7-4573-9471-da0b295c68c6 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:51:31.985979 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-dcbce6c7-4ef7-4573-9471-da0b295c68c6 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/107d520c-6f84-41bc-86f9-84c21718cc35" status: 200 len: 1695 microversion: 2.1 time: 0.151164 Sep 23 05:51:31.986559 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3859/7903] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:51:31 2022] GET /compute/v2.1/servers/107d520c-6f84-41bc-86f9-84c21718cc35 => generated 1695 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:51:33.009602 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8721d2d6-6dc3-4ceb-a5df-63841749d2f3 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:51:33.010281 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-8721d2d6-6dc3-4ceb-a5df-63841749d2f3 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 107d520c-6f84-41bc-86f9-84c21718cc35] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:51:33.016732 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8721d2d6-6dc3-4ceb-a5df-63841749d2f3 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:51:33.017221 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8721d2d6-6dc3-4ceb-a5df-63841749d2f3 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:51:33.017668 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8721d2d6-6dc3-4ceb-a5df-63841749d2f3 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:51:33.018388 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8721d2d6-6dc3-4ceb-a5df-63841749d2f3 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:51:33.018851 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8721d2d6-6dc3-4ceb-a5df-63841749d2f3 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:51:33.019280 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8721d2d6-6dc3-4ceb-a5df-63841749d2f3 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:51:33.148126 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-8721d2d6-6dc3-4ceb-a5df-63841749d2f3 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:51:33.156677 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-8721d2d6-6dc3-4ceb-a5df-63841749d2f3 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/107d520c-6f84-41bc-86f9-84c21718cc35" status: 200 len: 1695 microversion: 2.1 time: 0.150907 Sep 23 05:51:33.157136 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4045/7904] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:51:33 2022] GET /compute/v2.1/servers/107d520c-6f84-41bc-86f9-84c21718cc35 => generated 1695 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:51:34.180853 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-bd0b3822-fe16-468c-b3c4-67f39c76eca0 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:51:34.181421 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-bd0b3822-fe16-468c-b3c4-67f39c76eca0 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 107d520c-6f84-41bc-86f9-84c21718cc35] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:51:34.188780 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bd0b3822-fe16-468c-b3c4-67f39c76eca0 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:51:34.192118 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bd0b3822-fe16-468c-b3c4-67f39c76eca0 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:51:34.192118 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bd0b3822-fe16-468c-b3c4-67f39c76eca0 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:51:34.192118 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bd0b3822-fe16-468c-b3c4-67f39c76eca0 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:51:34.192118 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bd0b3822-fe16-468c-b3c4-67f39c76eca0 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:51:34.192118 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bd0b3822-fe16-468c-b3c4-67f39c76eca0 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:51:34.329748 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-bd0b3822-fe16-468c-b3c4-67f39c76eca0 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:51:34.338594 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-bd0b3822-fe16-468c-b3c4-67f39c76eca0 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/107d520c-6f84-41bc-86f9-84c21718cc35" status: 200 len: 1694 microversion: 2.1 time: 0.162047 Sep 23 05:51:34.339175 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3860/7905] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:51:34 2022] GET /compute/v2.1/servers/107d520c-6f84-41bc-86f9-84c21718cc35 => generated 1694 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:51:34.812473 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-9b7283f1-9542-4109-810b-c0d5f215bc93 req-f72429b4-7beb-433f-8d74-bfc28e9065ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "107d520c-6f84-41bc-86f9-84c21718cc35", "name": "network-vif-unplugged", "status": "completed", "tag": "351e31fb-27e8-4b86-96d5-9150d67b4f93"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:51:34.822613 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-9b7283f1-9542-4109-810b-c0d5f215bc93 req-f72429b4-7beb-433f-8d74-bfc28e9065ac service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:51:34.823095 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-9b7283f1-9542-4109-810b-c0d5f215bc93 req-f72429b4-7beb-433f-8d74-bfc28e9065ac service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:51:34.823526 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-9b7283f1-9542-4109-810b-c0d5f215bc93 req-f72429b4-7beb-433f-8d74-bfc28e9065ac service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:51:34.835924 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-9b7283f1-9542-4109-810b-c0d5f215bc93 req-f72429b4-7beb-433f-8d74-bfc28e9065ac service nova] Creating event network-vif-unplugged:351e31fb-27e8-4b86-96d5-9150d67b4f93 for instance 107d520c-6f84-41bc-86f9-84c21718cc35 on n-h2-846463-3 Sep 23 05:51:34.841879 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [req-9b7283f1-9542-4109-810b-c0d5f215bc93 req-f72429b4-7beb-433f-8d74-bfc28e9065ac service nova] Instance 107d520c-6f84-41bc-86f9-84c21718cc35 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846463-3', 'n-h2-846463-3'} {{(pid=122699) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 23 05:51:34.852915 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-9b7283f1-9542-4109-810b-c0d5f215bc93 req-f72429b4-7beb-433f-8d74-bfc28e9065ac service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044260 Sep 23 05:51:34.853586 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4046/7906] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:51:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:51:35.363165 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-82e5cb92-5b93-48e6-99d2-c35c3f5f7087 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:51:35.363853 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-82e5cb92-5b93-48e6-99d2-c35c3f5f7087 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 107d520c-6f84-41bc-86f9-84c21718cc35] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:51:35.371221 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-82e5cb92-5b93-48e6-99d2-c35c3f5f7087 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:51:35.371651 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-82e5cb92-5b93-48e6-99d2-c35c3f5f7087 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:51:35.372734 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-82e5cb92-5b93-48e6-99d2-c35c3f5f7087 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:51:35.373458 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-82e5cb92-5b93-48e6-99d2-c35c3f5f7087 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:51:35.373967 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-82e5cb92-5b93-48e6-99d2-c35c3f5f7087 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:51:35.378585 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-82e5cb92-5b93-48e6-99d2-c35c3f5f7087 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:51:35.518230 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-82e5cb92-5b93-48e6-99d2-c35c3f5f7087 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:51:35.526306 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-82e5cb92-5b93-48e6-99d2-c35c3f5f7087 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/107d520c-6f84-41bc-86f9-84c21718cc35" status: 200 len: 1694 microversion: 2.1 time: 0.167004 Sep 23 05:51:35.526879 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3861/7907] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:51:35 2022] GET /compute/v2.1/servers/107d520c-6f84-41bc-86f9-84c21718cc35 => generated 1694 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:51:36.549983 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-79a304a0-80dc-4c45-b552-600dd38cf860 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:51:36.550629 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-79a304a0-80dc-4c45-b552-600dd38cf860 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 107d520c-6f84-41bc-86f9-84c21718cc35] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:51:36.557301 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-79a304a0-80dc-4c45-b552-600dd38cf860 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:51:36.557795 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-79a304a0-80dc-4c45-b552-600dd38cf860 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:51:36.558266 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-79a304a0-80dc-4c45-b552-600dd38cf860 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:51:36.558961 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-79a304a0-80dc-4c45-b552-600dd38cf860 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:51:36.559422 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-79a304a0-80dc-4c45-b552-600dd38cf860 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:51:36.559853 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-79a304a0-80dc-4c45-b552-600dd38cf860 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:51:36.694340 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-79a304a0-80dc-4c45-b552-600dd38cf860 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:51:36.702890 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-79a304a0-80dc-4c45-b552-600dd38cf860 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/107d520c-6f84-41bc-86f9-84c21718cc35" status: 200 len: 1692 microversion: 2.1 time: 0.157314 Sep 23 05:51:36.703469 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4047/7908] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:51:36 2022] GET /compute/v2.1/servers/107d520c-6f84-41bc-86f9-84c21718cc35 => generated 1692 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:51:36.867862 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-1c5d70d2-b46d-4350-a022-8983b6aa3824 req-bd265621-3a7c-4897-bea8-bd1310c7f518 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "107d520c-6f84-41bc-86f9-84c21718cc35", "tag": "351e31fb-27e8-4b86-96d5-9150d67b4f93"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:51:36.878754 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-1c5d70d2-b46d-4350-a022-8983b6aa3824 req-bd265621-3a7c-4897-bea8-bd1310c7f518 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:51:36.879256 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-1c5d70d2-b46d-4350-a022-8983b6aa3824 req-bd265621-3a7c-4897-bea8-bd1310c7f518 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:51:36.879707 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-1c5d70d2-b46d-4350-a022-8983b6aa3824 req-bd265621-3a7c-4897-bea8-bd1310c7f518 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:51:36.891875 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-1c5d70d2-b46d-4350-a022-8983b6aa3824 req-bd265621-3a7c-4897-bea8-bd1310c7f518 service nova] Creating event network-changed:351e31fb-27e8-4b86-96d5-9150d67b4f93 for instance 107d520c-6f84-41bc-86f9-84c21718cc35 on n-h2-846463-3 Sep 23 05:51:36.897341 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [req-1c5d70d2-b46d-4350-a022-8983b6aa3824 req-bd265621-3a7c-4897-bea8-bd1310c7f518 service nova] Instance 107d520c-6f84-41bc-86f9-84c21718cc35 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-846463-3', 'n-h2-846463-3'} {{(pid=122698) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 23 05:51:36.908444 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-1c5d70d2-b46d-4350-a022-8983b6aa3824 req-bd265621-3a7c-4897-bea8-bd1310c7f518 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044366 Sep 23 05:51:36.909028 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3862/7909] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:51:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:51:37.728756 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-798d54c4-25d1-4b6f-966d-ce15eb6e7a02 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:51:37.729453 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-798d54c4-25d1-4b6f-966d-ce15eb6e7a02 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 107d520c-6f84-41bc-86f9-84c21718cc35] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:51:37.736727 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-798d54c4-25d1-4b6f-966d-ce15eb6e7a02 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:51:37.737229 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-798d54c4-25d1-4b6f-966d-ce15eb6e7a02 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:51:37.737676 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-798d54c4-25d1-4b6f-966d-ce15eb6e7a02 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:51:37.738415 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-798d54c4-25d1-4b6f-966d-ce15eb6e7a02 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:51:37.738883 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-798d54c4-25d1-4b6f-966d-ce15eb6e7a02 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:51:37.739321 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-798d54c4-25d1-4b6f-966d-ce15eb6e7a02 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:51:37.890058 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-798d54c4-25d1-4b6f-966d-ce15eb6e7a02 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:51:37.899336 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-798d54c4-25d1-4b6f-966d-ce15eb6e7a02 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/107d520c-6f84-41bc-86f9-84c21718cc35" status: 200 len: 1692 microversion: 2.1 time: 0.174598 Sep 23 05:51:37.900566 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4048/7910] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:51:37 2022] GET /compute/v2.1/servers/107d520c-6f84-41bc-86f9-84c21718cc35 => generated 1692 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:51:38.928904 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-55e22bf7-e143-4784-b7a9-790c5b35ebe2 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:51:38.929634 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-55e22bf7-e143-4784-b7a9-790c5b35ebe2 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 107d520c-6f84-41bc-86f9-84c21718cc35] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:51:38.936365 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-55e22bf7-e143-4784-b7a9-790c5b35ebe2 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:51:38.936879 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-55e22bf7-e143-4784-b7a9-790c5b35ebe2 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:51:38.937338 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-55e22bf7-e143-4784-b7a9-790c5b35ebe2 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:51:38.938091 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-55e22bf7-e143-4784-b7a9-790c5b35ebe2 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:51:38.938582 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-55e22bf7-e143-4784-b7a9-790c5b35ebe2 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:51:38.939018 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-55e22bf7-e143-4784-b7a9-790c5b35ebe2 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:51:39.083287 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-55e22bf7-e143-4784-b7a9-790c5b35ebe2 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:51:39.091220 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-55e22bf7-e143-4784-b7a9-790c5b35ebe2 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/107d520c-6f84-41bc-86f9-84c21718cc35" status: 200 len: 1689 microversion: 2.1 time: 0.167517 Sep 23 05:51:39.091804 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3863/7911] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:51:38 2022] GET /compute/v2.1/servers/107d520c-6f84-41bc-86f9-84c21718cc35 => generated 1689 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:51:39.116574 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-920a71bd-06ac-4f45-9064-29ec1d8a4223 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:51:39.117118 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-920a71bd-06ac-4f45-9064-29ec1d8a4223 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 107d520c-6f84-41bc-86f9-84c21718cc35] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:51:39.124274 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-920a71bd-06ac-4f45-9064-29ec1d8a4223 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:51:39.124777 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-920a71bd-06ac-4f45-9064-29ec1d8a4223 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:51:39.125223 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-920a71bd-06ac-4f45-9064-29ec1d8a4223 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:51:39.125985 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-920a71bd-06ac-4f45-9064-29ec1d8a4223 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:51:39.126455 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-920a71bd-06ac-4f45-9064-29ec1d8a4223 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:51:39.126887 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-920a71bd-06ac-4f45-9064-29ec1d8a4223 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:51:39.337164 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-920a71bd-06ac-4f45-9064-29ec1d8a4223 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "POST /compute/v2.1/servers/107d520c-6f84-41bc-86f9-84c21718cc35/action" status: 204 len: 0 microversion: 2.1 time: 0.224319 Sep 23 05:51:39.338012 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4049/7912] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 05:51:39 2022] POST /compute/v2.1/servers/107d520c-6f84-41bc-86f9-84c21718cc35/action => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 05:51:39.346241 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4d1da1cf-84e7-41eb-9aa8-e8fa8c498aba tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:51:39.347231 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4d1da1cf-84e7-41eb-9aa8-e8fa8c498aba tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 107d520c-6f84-41bc-86f9-84c21718cc35] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:51:39.353453 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4d1da1cf-84e7-41eb-9aa8-e8fa8c498aba tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:51:39.353998 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4d1da1cf-84e7-41eb-9aa8-e8fa8c498aba tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:51:39.360776 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4d1da1cf-84e7-41eb-9aa8-e8fa8c498aba tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:51:39.360776 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4d1da1cf-84e7-41eb-9aa8-e8fa8c498aba tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:51:39.360776 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4d1da1cf-84e7-41eb-9aa8-e8fa8c498aba tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:51:39.360776 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4d1da1cf-84e7-41eb-9aa8-e8fa8c498aba tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:51:39.497331 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4d1da1cf-84e7-41eb-9aa8-e8fa8c498aba tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:51:39.505449 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4d1da1cf-84e7-41eb-9aa8-e8fa8c498aba tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/107d520c-6f84-41bc-86f9-84c21718cc35" status: 200 len: 1689 microversion: 2.1 time: 0.163278 Sep 23 05:51:39.506087 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3864/7913] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:51:39 2022] GET /compute/v2.1/servers/107d520c-6f84-41bc-86f9-84c21718cc35 => generated 1689 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:51:39.529520 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-89372095-4363-4af7-b18e-8a545a5ece57 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:51:39.530402 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-89372095-4363-4af7-b18e-8a545a5ece57 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 107d520c-6f84-41bc-86f9-84c21718cc35] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:51:39.537080 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-89372095-4363-4af7-b18e-8a545a5ece57 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:51:39.537679 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-89372095-4363-4af7-b18e-8a545a5ece57 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:51:39.538230 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-89372095-4363-4af7-b18e-8a545a5ece57 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:51:39.539017 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-89372095-4363-4af7-b18e-8a545a5ece57 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:51:39.539694 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-89372095-4363-4af7-b18e-8a545a5ece57 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:51:39.540357 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-89372095-4363-4af7-b18e-8a545a5ece57 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:51:39.678586 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-89372095-4363-4af7-b18e-8a545a5ece57 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:51:39.687215 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-89372095-4363-4af7-b18e-8a545a5ece57 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/107d520c-6f84-41bc-86f9-84c21718cc35" status: 200 len: 1689 microversion: 2.1 time: 0.162259 Sep 23 05:51:39.687807 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4050/7914] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:51:39 2022] GET /compute/v2.1/servers/107d520c-6f84-41bc-86f9-84c21718cc35 => generated 1689 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:51:40.711234 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-086fd22d-4294-4913-b908-877d53b5bc8c tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:51:40.711947 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-086fd22d-4294-4913-b908-877d53b5bc8c tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 107d520c-6f84-41bc-86f9-84c21718cc35] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:51:40.719497 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-086fd22d-4294-4913-b908-877d53b5bc8c tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:51:40.720012 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-086fd22d-4294-4913-b908-877d53b5bc8c tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:51:40.720474 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-086fd22d-4294-4913-b908-877d53b5bc8c tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:51:40.721209 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-086fd22d-4294-4913-b908-877d53b5bc8c tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:51:40.721686 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-086fd22d-4294-4913-b908-877d53b5bc8c tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:51:40.722157 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-086fd22d-4294-4913-b908-877d53b5bc8c tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:51:40.865734 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-086fd22d-4294-4913-b908-877d53b5bc8c tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:51:40.874383 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-086fd22d-4294-4913-b908-877d53b5bc8c tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/107d520c-6f84-41bc-86f9-84c21718cc35" status: 200 len: 1689 microversion: 2.1 time: 0.166987 Sep 23 05:51:40.874979 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3865/7915] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:51:40 2022] GET /compute/v2.1/servers/107d520c-6f84-41bc-86f9-84c21718cc35 => generated 1689 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:51:41.159181 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-e0a84ef9-2287-41b5-812c-ab52048dd6f9 req-af7cac43-1de3-4da8-afe3-b0406d1fa6d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "107d520c-6f84-41bc-86f9-84c21718cc35", "name": "network-vif-plugged", "status": "completed", "tag": "351e31fb-27e8-4b86-96d5-9150d67b4f93"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:51:41.169174 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-e0a84ef9-2287-41b5-812c-ab52048dd6f9 req-af7cac43-1de3-4da8-afe3-b0406d1fa6d5 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:51:41.169728 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-e0a84ef9-2287-41b5-812c-ab52048dd6f9 req-af7cac43-1de3-4da8-afe3-b0406d1fa6d5 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:51:41.170384 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-e0a84ef9-2287-41b5-812c-ab52048dd6f9 req-af7cac43-1de3-4da8-afe3-b0406d1fa6d5 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:51:41.182639 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-e0a84ef9-2287-41b5-812c-ab52048dd6f9 req-af7cac43-1de3-4da8-afe3-b0406d1fa6d5 service nova] Creating event network-vif-plugged:351e31fb-27e8-4b86-96d5-9150d67b4f93 for instance 107d520c-6f84-41bc-86f9-84c21718cc35 on n-h2-846463-3 Sep 23 05:51:41.188363 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-e0a84ef9-2287-41b5-812c-ab52048dd6f9 req-af7cac43-1de3-4da8-afe3-b0406d1fa6d5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101495 Sep 23 05:51:41.188981 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4051/7916] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:51:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:51:41.898747 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-edd22b98-e032-4fb2-a9cd-d744587d93da tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:51:41.899387 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-edd22b98-e032-4fb2-a9cd-d744587d93da tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 107d520c-6f84-41bc-86f9-84c21718cc35] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:51:41.907725 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-edd22b98-e032-4fb2-a9cd-d744587d93da tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:51:41.908278 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-edd22b98-e032-4fb2-a9cd-d744587d93da tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:51:41.908744 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-edd22b98-e032-4fb2-a9cd-d744587d93da tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:51:41.909721 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-edd22b98-e032-4fb2-a9cd-d744587d93da tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:51:41.910312 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-edd22b98-e032-4fb2-a9cd-d744587d93da tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:51:41.910922 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-edd22b98-e032-4fb2-a9cd-d744587d93da tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:51:42.039779 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-edd22b98-e032-4fb2-a9cd-d744587d93da tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:51:42.048195 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-edd22b98-e032-4fb2-a9cd-d744587d93da tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/107d520c-6f84-41bc-86f9-84c21718cc35" status: 200 len: 1681 microversion: 2.1 time: 0.153673 Sep 23 05:51:42.048769 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3866/7917] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:51:41 2022] GET /compute/v2.1/servers/107d520c-6f84-41bc-86f9-84c21718cc35 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:52:02.221808 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=28 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:52:02.222583 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:52:02.226739 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a533a9a1-681d-4769-8d43-8c2bd348427f tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:52:02.229069 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a533a9a1-681d-4769-8d43-8c2bd348427f tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 107d520c-6f84-41bc-86f9-84c21718cc35] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:52:02.235788 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a533a9a1-681d-4769-8d43-8c2bd348427f tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:52:02.239410 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a533a9a1-681d-4769-8d43-8c2bd348427f tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:52:02.239410 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a533a9a1-681d-4769-8d43-8c2bd348427f tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:52:02.239410 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a533a9a1-681d-4769-8d43-8c2bd348427f tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:52:02.239410 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a533a9a1-681d-4769-8d43-8c2bd348427f tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:52:02.239410 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a533a9a1-681d-4769-8d43-8c2bd348427f tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:52:02.292604 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a533a9a1-681d-4769-8d43-8c2bd348427f tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "POST /compute/v2.1/servers/107d520c-6f84-41bc-86f9-84c21718cc35/action" status: 200 len: 24549 microversion: 2.1 time: 0.072087 Sep 23 05:52:02.293298 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4052/7918] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 05:52:02 2022] POST /compute/v2.1/servers/107d520c-6f84-41bc-86f9-84c21718cc35/action => generated 24549 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 05:52:09.335347 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-25bccc98-13c2-4932-9bb4-63eba9c617bf tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:52:09.335934 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-25bccc98-13c2-4932-9bb4-63eba9c617bf tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 107d520c-6f84-41bc-86f9-84c21718cc35] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:52:09.337026 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-cea46bc8-9bf1-4603-ac58-14ae73cc9c01 req-5ac341e2-7e10-4db6-8204-533b672b291e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "107d520c-6f84-41bc-86f9-84c21718cc35", "tag": "351e31fb-27e8-4b86-96d5-9150d67b4f93"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:52:09.338734 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=32 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:52:09.339627 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:52:09.345346 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-25bccc98-13c2-4932-9bb4-63eba9c617bf tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:52:09.355575 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-25bccc98-13c2-4932-9bb4-63eba9c617bf tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:52:09.355575 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-25bccc98-13c2-4932-9bb4-63eba9c617bf tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:52:09.355575 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-25bccc98-13c2-4932-9bb4-63eba9c617bf tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:52:09.355575 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-25bccc98-13c2-4932-9bb4-63eba9c617bf tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:52:09.355575 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-25bccc98-13c2-4932-9bb4-63eba9c617bf tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:52:09.356116 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-cea46bc8-9bf1-4603-ac58-14ae73cc9c01 req-5ac341e2-7e10-4db6-8204-533b672b291e service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:52:09.356116 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-cea46bc8-9bf1-4603-ac58-14ae73cc9c01 req-5ac341e2-7e10-4db6-8204-533b672b291e service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:52:09.356116 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-cea46bc8-9bf1-4603-ac58-14ae73cc9c01 req-5ac341e2-7e10-4db6-8204-533b672b291e service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:52:09.362543 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-cea46bc8-9bf1-4603-ac58-14ae73cc9c01 req-5ac341e2-7e10-4db6-8204-533b672b291e service nova] Creating event network-changed:351e31fb-27e8-4b86-96d5-9150d67b4f93 for instance 107d520c-6f84-41bc-86f9-84c21718cc35 on n-h2-846463-3 Sep 23 05:52:09.367893 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-cea46bc8-9bf1-4603-ac58-14ae73cc9c01 req-5ac341e2-7e10-4db6-8204-533b672b291e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041571 Sep 23 05:52:09.368859 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4053/7919] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:52:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:52:09.378185 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-25bccc98-13c2-4932-9bb4-63eba9c617bf tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 107d520c-6f84-41bc-86f9-84c21718cc35] Going to try to terminate instance {{(pid=122698) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 05:52:09.657099 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-25bccc98-13c2-4932-9bb4-63eba9c617bf tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "DELETE /compute/v2.1/servers/107d520c-6f84-41bc-86f9-84c21718cc35" status: 204 len: 0 microversion: 2.1 time: 0.333091 Sep 23 05:52:09.657948 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3867/7920] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 05:52:09 2022] DELETE /compute/v2.1/servers/107d520c-6f84-41bc-86f9-84c21718cc35 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 05:52:09.670249 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e32b8746-77ff-46ad-ac36-dd56a153f774 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:52:09.670971 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e32b8746-77ff-46ad-ac36-dd56a153f774 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 107d520c-6f84-41bc-86f9-84c21718cc35] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:52:09.677618 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e32b8746-77ff-46ad-ac36-dd56a153f774 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:52:09.678165 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e32b8746-77ff-46ad-ac36-dd56a153f774 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:52:09.678584 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e32b8746-77ff-46ad-ac36-dd56a153f774 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:52:09.679296 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e32b8746-77ff-46ad-ac36-dd56a153f774 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:52:09.679764 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e32b8746-77ff-46ad-ac36-dd56a153f774 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:52:09.680201 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e32b8746-77ff-46ad-ac36-dd56a153f774 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:52:09.816639 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e32b8746-77ff-46ad-ac36-dd56a153f774 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:52:09.824801 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e32b8746-77ff-46ad-ac36-dd56a153f774 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/107d520c-6f84-41bc-86f9-84c21718cc35" status: 200 len: 1687 microversion: 2.1 time: 0.162330 Sep 23 05:52:09.825513 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4054/7921] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:52:09 2022] GET /compute/v2.1/servers/107d520c-6f84-41bc-86f9-84c21718cc35 => generated 1687 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:52:10.850853 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4b6b4de1-2147-4d48-a635-3d9d1e432cac tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:52:10.851717 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4b6b4de1-2147-4d48-a635-3d9d1e432cac tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 107d520c-6f84-41bc-86f9-84c21718cc35] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:52:10.859081 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4b6b4de1-2147-4d48-a635-3d9d1e432cac tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:52:10.859598 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4b6b4de1-2147-4d48-a635-3d9d1e432cac tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:52:10.860058 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4b6b4de1-2147-4d48-a635-3d9d1e432cac tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:52:10.860777 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4b6b4de1-2147-4d48-a635-3d9d1e432cac tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:52:10.861256 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4b6b4de1-2147-4d48-a635-3d9d1e432cac tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:52:10.861708 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4b6b4de1-2147-4d48-a635-3d9d1e432cac tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:52:11.317430 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4b6b4de1-2147-4d48-a635-3d9d1e432cac tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:52:11.325467 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4b6b4de1-2147-4d48-a635-3d9d1e432cac tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/107d520c-6f84-41bc-86f9-84c21718cc35" status: 200 len: 1687 microversion: 2.1 time: 0.478831 Sep 23 05:52:11.327051 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3868/7922] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:52:10 2022] GET /compute/v2.1/servers/107d520c-6f84-41bc-86f9-84c21718cc35 => generated 1687 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:52:11.568798 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-a571d900-f83e-4506-9645-6aab5322eb65 req-344de282-effe-430a-abba-1b4e9dec0884 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "107d520c-6f84-41bc-86f9-84c21718cc35", "name": "network-vif-deleted", "tag": "351e31fb-27e8-4b86-96d5-9150d67b4f93"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:52:11.579838 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-a571d900-f83e-4506-9645-6aab5322eb65 req-344de282-effe-430a-abba-1b4e9dec0884 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:52:11.580336 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-a571d900-f83e-4506-9645-6aab5322eb65 req-344de282-effe-430a-abba-1b4e9dec0884 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:52:11.580910 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-a571d900-f83e-4506-9645-6aab5322eb65 req-344de282-effe-430a-abba-1b4e9dec0884 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:52:11.592057 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-a571d900-f83e-4506-9645-6aab5322eb65 req-344de282-effe-430a-abba-1b4e9dec0884 service nova] Creating event network-vif-deleted:351e31fb-27e8-4b86-96d5-9150d67b4f93 for instance 107d520c-6f84-41bc-86f9-84c21718cc35 on n-h2-846463-3 Sep 23 05:52:11.597343 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-a571d900-f83e-4506-9645-6aab5322eb65 req-344de282-effe-430a-abba-1b4e9dec0884 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032230 Sep 23 05:52:11.597977 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4055/7923] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:52:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:52:12.351320 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5314d655-c780-4fba-87a9-ca8a698a34b2 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:52:12.351957 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5314d655-c780-4fba-87a9-ca8a698a34b2 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 107d520c-6f84-41bc-86f9-84c21718cc35] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:52:12.360301 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5314d655-c780-4fba-87a9-ca8a698a34b2 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:52:12.360810 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5314d655-c780-4fba-87a9-ca8a698a34b2 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:52:12.361268 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5314d655-c780-4fba-87a9-ca8a698a34b2 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:52:12.362060 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5314d655-c780-4fba-87a9-ca8a698a34b2 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:52:12.362539 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5314d655-c780-4fba-87a9-ca8a698a34b2 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:52:12.374878 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5314d655-c780-4fba-87a9-ca8a698a34b2 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:52:12.397507 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5314d655-c780-4fba-87a9-ca8a698a34b2 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:52:12.398139 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5314d655-c780-4fba-87a9-ca8a698a34b2 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:52:12.398600 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5314d655-c780-4fba-87a9-ca8a698a34b2 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:52:12.404016 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-5314d655-c780-4fba-87a9-ca8a698a34b2 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lazy-loading 'fault' on Instance uuid 107d520c-6f84-41bc-86f9-84c21718cc35 {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 05:52:12.441580 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-5314d655-c780-4fba-87a9-ca8a698a34b2 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:52:12.448825 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5314d655-c780-4fba-87a9-ca8a698a34b2 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/107d520c-6f84-41bc-86f9-84c21718cc35" status: 200 len: 1356 microversion: 2.1 time: 0.101893 Sep 23 05:52:12.449404 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3869/7924] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:52:12 2022] GET /compute/v2.1/servers/107d520c-6f84-41bc-86f9-84c21718cc35 => generated 1356 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:52:13.475822 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-fe6464cf-da4d-4eb5-a8f8-ebb2b7801d42 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:52:13.476493 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-fe6464cf-da4d-4eb5-a8f8-ebb2b7801d42 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 107d520c-6f84-41bc-86f9-84c21718cc35] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:52:13.482732 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fe6464cf-da4d-4eb5-a8f8-ebb2b7801d42 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:52:13.483222 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fe6464cf-da4d-4eb5-a8f8-ebb2b7801d42 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:52:13.483663 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fe6464cf-da4d-4eb5-a8f8-ebb2b7801d42 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:52:13.484358 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fe6464cf-da4d-4eb5-a8f8-ebb2b7801d42 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:52:13.484820 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fe6464cf-da4d-4eb5-a8f8-ebb2b7801d42 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:52:13.485251 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fe6464cf-da4d-4eb5-a8f8-ebb2b7801d42 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:52:13.498932 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-fe6464cf-da4d-4eb5-a8f8-ebb2b7801d42 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] HTTP exception thrown: Instance 107d520c-6f84-41bc-86f9-84c21718cc35 could not be found. Sep 23 05:52:13.500540 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-fe6464cf-da4d-4eb5-a8f8-ebb2b7801d42 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Request method failure captured: Sep 23 05:52:13.500540 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/107d520c-6f84-41bc-86f9-84c21718cc35 HTTP/1.1 Sep 23 05:52:13.500540 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 05:52:13.500540 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 05:52:13.500540 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 05:52:13.500540 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 05:52:13.500540 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 05:52:13.500540 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 05:52:13.500540 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 05:52:13.500540 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 05:52:13.500540 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLUhz7bpvepG5vaaNTB45PETsbu7BFN8GjZeZ_vLrd5WJDjgd_oQ5bhmVua4C2ZhQgOahIirm-KuGCZTB_5bToAYjCLfVfw81RihC56n3ttHDJ0Tgc_iEV4MwjR_WQmCh9B38US55e6l82-uxms5I3hOmslhT2_3dhZB9TyAC0xyC3YM Sep 23 05:52:13.500540 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 05:52:13.500540 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 05:52:13.500540 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 05:52:13.500540 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 05:52:13.500540 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 05:52:13.500540 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 05:52:13.500540 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 498fb069adef49d19ed802d2133adb89 Sep 23 05:52:13.500540 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2142034074 Sep 23 05:52:13.500540 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 05:52:13.500540 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 05:52:13.500540 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_498fb069adef49d19ed802d2133adb89", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/498fb069adef49d19ed802d2133adb89"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/498fb069adef49d19ed802d2133adb89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/498fb069adef49d19ed802d2133adb89"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:52:13.500540 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2142034074 Sep 23 05:52:13.500540 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 498fb069adef49d19ed802d2133adb89 Sep 23 05:52:13.500540 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2142034074 Sep 23 05:52:13.500540 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-TestNetworkAdvancedServerOps-2142034074-project Sep 23 05:52:13.500540 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 05:52:13.500540 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 05:52:13.500540 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: e9d36972d8f2413b8838e64998b43359 Sep 23 05:52:13.500540 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2142034074-project Sep 23 05:52:13.500540 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 05:52:13.500540 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 107d520c-6f84-41bc-86f9-84c21718cc35 could not be found. Sep 23 05:52:13.500540 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '107d520c-6f84-41bc-86f9-84c21718cc35'} Sep 23 05:52:13.500540 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:52:13.500540 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:52:13.500540 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 05:52:13.500540 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 05:52:13.500540 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 05:52:13.500540 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 05:52:13.500540 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 05:52:13.500540 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 05:52:13.500540 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 05:52:13.500540 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 05:52:13.500540 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 107d520c-6f84-41bc-86f9-84c21718cc35 could not be found. Sep 23 05:52:13.500540 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:52:13.500540 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:52:13.500540 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:52:13.500540 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:52:13.500540 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:52:13.500540 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:52:13.500540 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:52:13.500540 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:52:13.500540 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:52:13.500540 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:52:13.500540 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 05:52:13.500540 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 05:52:13.500540 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 05:52:13.500540 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 05:52:13.500540 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 05:52:13.500540 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:52:13.500540 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 107d520c-6f84-41bc-86f9-84c21718cc35 could not be found. Sep 23 05:52:13.500540 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:52:13.500540 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:52:13.506313 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:52:13.506313 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:52:13.506313 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:52:13.506313 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:52:13.506313 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:52:13.506313 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:52:13.506313 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 107d520c-6f84-41bc-86f9-84c21718cc35 could not be found. Sep 23 05:52:13.506313 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 05:52:13.506313 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-fe6464cf-da4d-4eb5-a8f8-ebb2b7801d42 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Returning 404 to user: Instance 107d520c-6f84-41bc-86f9-84c21718cc35 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:52:13.506313 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-fe6464cf-da4d-4eb5-a8f8-ebb2b7801d42 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/107d520c-6f84-41bc-86f9-84c21718cc35" status: 404 len: 111 microversion: 2.1 time: 0.031134 Sep 23 05:52:13.506313 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4056/7925] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:52:13 2022] GET /compute/v2.1/servers/107d520c-6f84-41bc-86f9-84c21718cc35 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 05:52:16.876765 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8bf4a9df-01d1-4280-97bb-1b878ae3c76b tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '.version_select at 0x7ff1c13b1550>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:52:16.979153 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8bf4a9df-01d1-4280-97bb-1b878ae3c76b tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1797074374" status: 202 len: 0 microversion: 2.1 time: 0.107768 Sep 23 05:52:16.979661 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3870/7926] 10.222.0.33 () {58 vars in 1284 bytes} [Fri Sep 23 05:52:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1797074374 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 05:52:17.009012 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-dabd6f2c-b573-4c7c-89cd-199208a0fe5a tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Action: 'create', calling method: .version_select at 0x7ff1bab82280>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1508617881", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMWePuDduDaPVNCbgvdH8rAWqsF5/9aS2G6PUSrgAS35GV0mdJFWPQ+jExVTMHVdWj1S1VViLka2KE8074sSjXjz89QU4NBuI8kQSvRoaFvDKzzoOn96Lr/MoWPj4TmZGw=="}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:52:17.025914 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-dabd6f2c-b573-4c7c-89cd-199208a0fe5a tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Getting quotas for project 498fb069adef49d19ed802d2133adb89. Resources: {'key_pairs'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 05:52:17.032535 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-dabd6f2c-b573-4c7c-89cd-199208a0fe5a tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Getting quotas for user e9d36972d8f2413b8838e64998b43359 and project 498fb069adef49d19ed802d2133adb89. Resources: {'key_pairs'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 05:52:17.132668 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-dabd6f2c-b573-4c7c-89cd-199208a0fe5a tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.127468 Sep 23 05:52:17.133310 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4057/7927] 10.222.0.33 () {60 vars in 1159 bytes} [Fri Sep 23 05:52:17 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:52:25.451617 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-127f056d-9afc-4421-ad0f-fbab8178622d tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-45242802", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "networks": [{"uuid": "b74ff221-369a-4d6a-b894-307fb7b991b0"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1508617881", "security_groups": [{"name": "tempest-secgroup-smoke-436264893"}]}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:52:25.463594 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:52:25.574227 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.network.neutron [None req-127f056d-9afc-4421-ad0f-fbab8178622d tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] validate_networks() for [('b74ff221-369a-4d6a-b894-307fb7b991b0', None, None, None, None, None)] {{(pid=122698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 05:52:26.034754 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-127f056d-9afc-4421-ad0f-fbab8178622d tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Flavor limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 05:52:26.035269 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-127f056d-9afc-4421-ad0f-fbab8178622d tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Image limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 05:52:26.035971 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-127f056d-9afc-4421-ad0f-fbab8178622d tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Flavor pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 05:52:26.036497 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-127f056d-9afc-4421-ad0f-fbab8178622d tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Image pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 05:52:26.037004 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-127f056d-9afc-4421-ad0f-fbab8178622d tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 05:52:26.047130 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-127f056d-9afc-4421-ad0f-fbab8178622d tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:52:26.047714 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-127f056d-9afc-4421-ad0f-fbab8178622d tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:52:26.048269 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-127f056d-9afc-4421-ad0f-fbab8178622d tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:52:26.049119 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-127f056d-9afc-4421-ad0f-fbab8178622d tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:52:26.049658 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-127f056d-9afc-4421-ad0f-fbab8178622d tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:52:26.050136 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-127f056d-9afc-4421-ad0f-fbab8178622d tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:52:26.068222 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-127f056d-9afc-4421-ad0f-fbab8178622d tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Getting quotas for project 498fb069adef49d19ed802d2133adb89. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 05:52:26.073868 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-127f056d-9afc-4421-ad0f-fbab8178622d tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Getting quotas for user e9d36972d8f2413b8838e64998b43359 and project 498fb069adef49d19ed802d2133adb89. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 05:52:26.088528 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-127f056d-9afc-4421-ad0f-fbab8178622d tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Going to run 1 instances... {{(pid=122698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 05:52:26.091628 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-127f056d-9afc-4421-ad0f-fbab8178622d tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 065fbd75-3cb8-44d9-86ce-5bf7b0ffa350] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 05:52:26.224266 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-127f056d-9afc-4421-ad0f-fbab8178622d tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.777949 Sep 23 05:52:26.224940 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3871/7928] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 05:52:25 2022] POST /compute/v2.1/servers => generated 405 bytes in 779 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 05:52:26.236350 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-081b92d5-c7d2-41e2-8bc9-8ff2ddad2db1 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:52:26.238843 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-081b92d5-c7d2-41e2-8bc9-8ff2ddad2db1 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 065fbd75-3cb8-44d9-86ce-5bf7b0ffa350] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:52:26.239883 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=16 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:52:26.317260 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-081b92d5-c7d2-41e2-8bc9-8ff2ddad2db1 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:52:26.326518 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-081b92d5-c7d2-41e2-8bc9-8ff2ddad2db1 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/065fbd75-3cb8-44d9-86ce-5bf7b0ffa350" status: 200 len: 1265 microversion: 2.1 time: 0.093241 Sep 23 05:52:26.330124 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4058/7929] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:52:26 2022] GET /compute/v2.1/servers/065fbd75-3cb8-44d9-86ce-5bf7b0ffa350 => generated 1265 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:52:27.355254 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e0e52c5d-0a11-4d29-bab0-4e4be1c874a5 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:52:27.357046 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e0e52c5d-0a11-4d29-bab0-4e4be1c874a5 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 065fbd75-3cb8-44d9-86ce-5bf7b0ffa350] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:52:27.365176 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e0e52c5d-0a11-4d29-bab0-4e4be1c874a5 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:52:27.366009 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e0e52c5d-0a11-4d29-bab0-4e4be1c874a5 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:52:27.366760 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e0e52c5d-0a11-4d29-bab0-4e4be1c874a5 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:52:27.367718 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e0e52c5d-0a11-4d29-bab0-4e4be1c874a5 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:52:27.368398 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e0e52c5d-0a11-4d29-bab0-4e4be1c874a5 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:52:27.369085 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e0e52c5d-0a11-4d29-bab0-4e4be1c874a5 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:52:27.458751 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e0e52c5d-0a11-4d29-bab0-4e4be1c874a5 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:52:27.470221 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e0e52c5d-0a11-4d29-bab0-4e4be1c874a5 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/065fbd75-3cb8-44d9-86ce-5bf7b0ffa350" status: 200 len: 1261 microversion: 2.1 time: 0.118722 Sep 23 05:52:27.478953 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3872/7930] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:52:27 2022] GET /compute/v2.1/servers/065fbd75-3cb8-44d9-86ce-5bf7b0ffa350 => generated 1261 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:52:28.494605 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-58853d08-244d-4aa9-99b7-db5771dd02d2 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:52:28.495944 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-58853d08-244d-4aa9-99b7-db5771dd02d2 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 065fbd75-3cb8-44d9-86ce-5bf7b0ffa350] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:52:28.503997 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-58853d08-244d-4aa9-99b7-db5771dd02d2 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:52:28.504808 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-58853d08-244d-4aa9-99b7-db5771dd02d2 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:52:28.506344 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-58853d08-244d-4aa9-99b7-db5771dd02d2 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:52:28.510210 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-58853d08-244d-4aa9-99b7-db5771dd02d2 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:52:28.510804 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-58853d08-244d-4aa9-99b7-db5771dd02d2 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:52:28.511487 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-58853d08-244d-4aa9-99b7-db5771dd02d2 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:52:28.586364 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-58853d08-244d-4aa9-99b7-db5771dd02d2 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:52:28.594899 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-58853d08-244d-4aa9-99b7-db5771dd02d2 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/065fbd75-3cb8-44d9-86ce-5bf7b0ffa350" status: 200 len: 1335 microversion: 2.1 time: 0.104619 Sep 23 05:52:28.595467 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4059/7931] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:52:28 2022] GET /compute/v2.1/servers/065fbd75-3cb8-44d9-86ce-5bf7b0ffa350 => generated 1335 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:52:29.618990 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a033fd66-5d53-410b-88df-d486758c66b0 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:52:29.619805 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a033fd66-5d53-410b-88df-d486758c66b0 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 065fbd75-3cb8-44d9-86ce-5bf7b0ffa350] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:52:29.627885 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a033fd66-5d53-410b-88df-d486758c66b0 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:52:29.628479 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a033fd66-5d53-410b-88df-d486758c66b0 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:52:29.628948 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a033fd66-5d53-410b-88df-d486758c66b0 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:52:29.629723 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a033fd66-5d53-410b-88df-d486758c66b0 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:52:29.630229 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a033fd66-5d53-410b-88df-d486758c66b0 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:52:29.630678 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a033fd66-5d53-410b-88df-d486758c66b0 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:52:29.766161 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a033fd66-5d53-410b-88df-d486758c66b0 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:52:29.774324 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a033fd66-5d53-410b-88df-d486758c66b0 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/065fbd75-3cb8-44d9-86ce-5bf7b0ffa350" status: 200 len: 1390 microversion: 2.1 time: 0.159218 Sep 23 05:52:29.774898 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3873/7932] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:52:29 2022] GET /compute/v2.1/servers/065fbd75-3cb8-44d9-86ce-5bf7b0ffa350 => generated 1390 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:52:29.959613 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-6654a63f-ea53-4b2f-a243-b781fdeb0e11 req-7dad3f4b-71b6-4664-9be3-a58fd8c6e310 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "065fbd75-3cb8-44d9-86ce-5bf7b0ffa350", "tag": "be5ed1db-c02d-49ac-9e2c-4ef47bf5f37d"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:52:29.970367 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-6654a63f-ea53-4b2f-a243-b781fdeb0e11 req-7dad3f4b-71b6-4664-9be3-a58fd8c6e310 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:52:29.971176 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-6654a63f-ea53-4b2f-a243-b781fdeb0e11 req-7dad3f4b-71b6-4664-9be3-a58fd8c6e310 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:52:29.971613 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-6654a63f-ea53-4b2f-a243-b781fdeb0e11 req-7dad3f4b-71b6-4664-9be3-a58fd8c6e310 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:52:29.983283 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-6654a63f-ea53-4b2f-a243-b781fdeb0e11 req-7dad3f4b-71b6-4664-9be3-a58fd8c6e310 service nova] Creating event network-changed:be5ed1db-c02d-49ac-9e2c-4ef47bf5f37d for instance 065fbd75-3cb8-44d9-86ce-5bf7b0ffa350 on n-h2-846463-3 Sep 23 05:52:29.988297 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-6654a63f-ea53-4b2f-a243-b781fdeb0e11 req-7dad3f4b-71b6-4664-9be3-a58fd8c6e310 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032396 Sep 23 05:52:29.988961 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4060/7933] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:52:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:52:30.797118 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-03795db1-9f53-4fe8-9b55-2c5bdb9156c8 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:52:30.797755 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-03795db1-9f53-4fe8-9b55-2c5bdb9156c8 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 065fbd75-3cb8-44d9-86ce-5bf7b0ffa350] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:52:30.804667 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-03795db1-9f53-4fe8-9b55-2c5bdb9156c8 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:52:30.805175 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-03795db1-9f53-4fe8-9b55-2c5bdb9156c8 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:52:30.805631 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-03795db1-9f53-4fe8-9b55-2c5bdb9156c8 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:52:30.806378 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-03795db1-9f53-4fe8-9b55-2c5bdb9156c8 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:52:30.806856 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-03795db1-9f53-4fe8-9b55-2c5bdb9156c8 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:52:30.807300 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-03795db1-9f53-4fe8-9b55-2c5bdb9156c8 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:52:30.942109 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-03795db1-9f53-4fe8-9b55-2c5bdb9156c8 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:52:30.949846 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-03795db1-9f53-4fe8-9b55-2c5bdb9156c8 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/065fbd75-3cb8-44d9-86ce-5bf7b0ffa350" status: 200 len: 1390 microversion: 2.1 time: 0.156687 Sep 23 05:52:30.951226 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3874/7934] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:52:30 2022] GET /compute/v2.1/servers/065fbd75-3cb8-44d9-86ce-5bf7b0ffa350 => generated 1390 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:52:31.975467 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-638e0f95-3aea-413b-9e0e-1ad5e8a8b887 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:52:31.976623 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-638e0f95-3aea-413b-9e0e-1ad5e8a8b887 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 065fbd75-3cb8-44d9-86ce-5bf7b0ffa350] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:52:31.983715 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-638e0f95-3aea-413b-9e0e-1ad5e8a8b887 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:52:31.984210 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-638e0f95-3aea-413b-9e0e-1ad5e8a8b887 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:52:31.984657 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-638e0f95-3aea-413b-9e0e-1ad5e8a8b887 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:52:31.985358 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-638e0f95-3aea-413b-9e0e-1ad5e8a8b887 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:52:31.985821 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-638e0f95-3aea-413b-9e0e-1ad5e8a8b887 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:52:31.986277 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-638e0f95-3aea-413b-9e0e-1ad5e8a8b887 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:52:32.114792 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-638e0f95-3aea-413b-9e0e-1ad5e8a8b887 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:52:32.123007 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-638e0f95-3aea-413b-9e0e-1ad5e8a8b887 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/065fbd75-3cb8-44d9-86ce-5bf7b0ffa350" status: 200 len: 1390 microversion: 2.1 time: 0.153419 Sep 23 05:52:32.123589 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4061/7935] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:52:31 2022] GET /compute/v2.1/servers/065fbd75-3cb8-44d9-86ce-5bf7b0ffa350 => generated 1390 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:52:33.192972 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d99147d7-2794-49fc-9e97-ad14edcc04a1 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:52:33.193614 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d99147d7-2794-49fc-9e97-ad14edcc04a1 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 065fbd75-3cb8-44d9-86ce-5bf7b0ffa350] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:52:33.199719 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d99147d7-2794-49fc-9e97-ad14edcc04a1 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:52:33.200909 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d99147d7-2794-49fc-9e97-ad14edcc04a1 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:52:33.201415 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d99147d7-2794-49fc-9e97-ad14edcc04a1 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:52:33.202169 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d99147d7-2794-49fc-9e97-ad14edcc04a1 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:52:33.202654 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d99147d7-2794-49fc-9e97-ad14edcc04a1 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:52:33.203101 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d99147d7-2794-49fc-9e97-ad14edcc04a1 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:52:33.336309 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d99147d7-2794-49fc-9e97-ad14edcc04a1 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:52:33.343958 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d99147d7-2794-49fc-9e97-ad14edcc04a1 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/065fbd75-3cb8-44d9-86ce-5bf7b0ffa350" status: 200 len: 1390 microversion: 2.1 time: 0.200948 Sep 23 05:52:33.344530 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3875/7936] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:52:33 2022] GET /compute/v2.1/servers/065fbd75-3cb8-44d9-86ce-5bf7b0ffa350 => generated 1390 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:52:34.367336 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5fad157a-09ee-4903-9d56-6be684bc43ae tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:52:34.368253 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-5fad157a-09ee-4903-9d56-6be684bc43ae tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 065fbd75-3cb8-44d9-86ce-5bf7b0ffa350] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:52:34.370795 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:52:34.376320 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5fad157a-09ee-4903-9d56-6be684bc43ae tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:52:34.376818 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5fad157a-09ee-4903-9d56-6be684bc43ae tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:52:34.377264 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5fad157a-09ee-4903-9d56-6be684bc43ae tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:52:34.378004 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5fad157a-09ee-4903-9d56-6be684bc43ae tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:52:34.378469 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5fad157a-09ee-4903-9d56-6be684bc43ae tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:52:34.378896 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5fad157a-09ee-4903-9d56-6be684bc43ae tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:52:34.509652 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-5fad157a-09ee-4903-9d56-6be684bc43ae tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:52:34.518078 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5fad157a-09ee-4903-9d56-6be684bc43ae tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/065fbd75-3cb8-44d9-86ce-5bf7b0ffa350" status: 200 len: 1390 microversion: 2.1 time: 0.154702 Sep 23 05:52:34.518660 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4062/7937] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:52:34 2022] GET /compute/v2.1/servers/065fbd75-3cb8-44d9-86ce-5bf7b0ffa350 => generated 1390 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:52:35.541831 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b47fd8c3-958a-4e86-915c-6d14bac90bd9 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:52:35.546878 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b47fd8c3-958a-4e86-915c-6d14bac90bd9 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 065fbd75-3cb8-44d9-86ce-5bf7b0ffa350] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:52:35.548949 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b47fd8c3-958a-4e86-915c-6d14bac90bd9 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:52:35.549467 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b47fd8c3-958a-4e86-915c-6d14bac90bd9 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:52:35.549950 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b47fd8c3-958a-4e86-915c-6d14bac90bd9 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:52:35.550680 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b47fd8c3-958a-4e86-915c-6d14bac90bd9 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:52:35.551164 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b47fd8c3-958a-4e86-915c-6d14bac90bd9 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:52:35.551672 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b47fd8c3-958a-4e86-915c-6d14bac90bd9 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:52:35.696063 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b47fd8c3-958a-4e86-915c-6d14bac90bd9 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:52:35.704671 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b47fd8c3-958a-4e86-915c-6d14bac90bd9 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/065fbd75-3cb8-44d9-86ce-5bf7b0ffa350" status: 200 len: 1390 microversion: 2.1 time: 0.167149 Sep 23 05:52:35.705316 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3876/7938] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:52:35 2022] GET /compute/v2.1/servers/065fbd75-3cb8-44d9-86ce-5bf7b0ffa350 => generated 1390 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:52:36.728654 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f981826a-46df-461b-b806-b4374d8fae61 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:52:36.729297 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f981826a-46df-461b-b806-b4374d8fae61 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 065fbd75-3cb8-44d9-86ce-5bf7b0ffa350] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:52:36.732119 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=6 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:52:36.736882 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f981826a-46df-461b-b806-b4374d8fae61 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:52:36.737368 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f981826a-46df-461b-b806-b4374d8fae61 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:52:36.737805 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f981826a-46df-461b-b806-b4374d8fae61 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:52:36.738525 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f981826a-46df-461b-b806-b4374d8fae61 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:52:36.738979 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f981826a-46df-461b-b806-b4374d8fae61 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:52:36.739426 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f981826a-46df-461b-b806-b4374d8fae61 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:52:36.872780 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-f981826a-46df-461b-b806-b4374d8fae61 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:52:36.880555 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f981826a-46df-461b-b806-b4374d8fae61 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/065fbd75-3cb8-44d9-86ce-5bf7b0ffa350" status: 200 len: 1390 microversion: 2.1 time: 0.155838 Sep 23 05:52:36.881129 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4063/7939] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:52:36 2022] GET /compute/v2.1/servers/065fbd75-3cb8-44d9-86ce-5bf7b0ffa350 => generated 1390 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:52:37.252220 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-3d2406f7-7f75-4b4d-bae7-0d0353f12142 req-a412a7d0-34ee-44f9-81ba-8e59d177edbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "065fbd75-3cb8-44d9-86ce-5bf7b0ffa350", "name": "network-vif-plugged", "status": "completed", "tag": "be5ed1db-c02d-49ac-9e2c-4ef47bf5f37d"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:52:37.259080 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:52:37.259080 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=6 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:52:37.264185 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-3d2406f7-7f75-4b4d-bae7-0d0353f12142 req-a412a7d0-34ee-44f9-81ba-8e59d177edbd service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:52:37.264688 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-3d2406f7-7f75-4b4d-bae7-0d0353f12142 req-a412a7d0-34ee-44f9-81ba-8e59d177edbd service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:52:37.265144 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-3d2406f7-7f75-4b4d-bae7-0d0353f12142 req-a412a7d0-34ee-44f9-81ba-8e59d177edbd service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:52:37.276772 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-3d2406f7-7f75-4b4d-bae7-0d0353f12142 req-a412a7d0-34ee-44f9-81ba-8e59d177edbd service nova] Creating event network-vif-plugged:be5ed1db-c02d-49ac-9e2c-4ef47bf5f37d for instance 065fbd75-3cb8-44d9-86ce-5bf7b0ffa350 on n-h2-846463-3 Sep 23 05:52:37.282487 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-3d2406f7-7f75-4b4d-bae7-0d0353f12142 req-a412a7d0-34ee-44f9-81ba-8e59d177edbd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034213 Sep 23 05:52:37.283097 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3877/7940] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:52:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:52:37.904792 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-27de6ef3-d978-430c-a8d2-a2eabd83002a tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:52:37.905420 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-27de6ef3-d978-430c-a8d2-a2eabd83002a tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 065fbd75-3cb8-44d9-86ce-5bf7b0ffa350] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:52:37.912128 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-27de6ef3-d978-430c-a8d2-a2eabd83002a tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:52:37.912620 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-27de6ef3-d978-430c-a8d2-a2eabd83002a tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:52:37.913066 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-27de6ef3-d978-430c-a8d2-a2eabd83002a tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:52:37.913781 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-27de6ef3-d978-430c-a8d2-a2eabd83002a tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:52:37.914278 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-27de6ef3-d978-430c-a8d2-a2eabd83002a tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:52:37.914713 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-27de6ef3-d978-430c-a8d2-a2eabd83002a tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:52:38.045361 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-27de6ef3-d978-430c-a8d2-a2eabd83002a tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:52:38.053332 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-27de6ef3-d978-430c-a8d2-a2eabd83002a tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/065fbd75-3cb8-44d9-86ce-5bf7b0ffa350" status: 200 len: 1390 microversion: 2.1 time: 0.153321 Sep 23 05:52:38.053936 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4064/7941] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:52:37 2022] GET /compute/v2.1/servers/065fbd75-3cb8-44d9-86ce-5bf7b0ffa350 => generated 1390 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:52:39.078190 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0c4dbf72-6450-4f00-924e-f0e78e5f3019 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:52:39.078915 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-0c4dbf72-6450-4f00-924e-f0e78e5f3019 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 065fbd75-3cb8-44d9-86ce-5bf7b0ffa350] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:52:39.085817 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0c4dbf72-6450-4f00-924e-f0e78e5f3019 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:52:39.086353 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0c4dbf72-6450-4f00-924e-f0e78e5f3019 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:52:39.086812 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0c4dbf72-6450-4f00-924e-f0e78e5f3019 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:52:39.087522 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0c4dbf72-6450-4f00-924e-f0e78e5f3019 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:52:39.087996 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0c4dbf72-6450-4f00-924e-f0e78e5f3019 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:52:39.088442 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0c4dbf72-6450-4f00-924e-f0e78e5f3019 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:52:39.225561 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-0c4dbf72-6450-4f00-924e-f0e78e5f3019 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:52:39.234563 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0c4dbf72-6450-4f00-924e-f0e78e5f3019 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/065fbd75-3cb8-44d9-86ce-5bf7b0ffa350" status: 200 len: 1562 microversion: 2.1 time: 0.161622 Sep 23 05:52:39.235326 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3878/7942] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:52:39 2022] GET /compute/v2.1/servers/065fbd75-3cb8-44d9-86ce-5bf7b0ffa350 => generated 1562 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:52:39.256769 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1518c403-dd6e-464f-8f65-c4c5fac40f0b tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:52:39.257384 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1518c403-dd6e-464f-8f65-c4c5fac40f0b tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 065fbd75-3cb8-44d9-86ce-5bf7b0ffa350] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:52:39.264428 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1518c403-dd6e-464f-8f65-c4c5fac40f0b tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:52:39.264917 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1518c403-dd6e-464f-8f65-c4c5fac40f0b tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:52:39.265359 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1518c403-dd6e-464f-8f65-c4c5fac40f0b tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:52:39.266104 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1518c403-dd6e-464f-8f65-c4c5fac40f0b tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:52:39.266568 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1518c403-dd6e-464f-8f65-c4c5fac40f0b tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:52:39.267503 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1518c403-dd6e-464f-8f65-c4c5fac40f0b tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:52:39.397591 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1518c403-dd6e-464f-8f65-c4c5fac40f0b tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:52:39.406075 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1518c403-dd6e-464f-8f65-c4c5fac40f0b tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/065fbd75-3cb8-44d9-86ce-5bf7b0ffa350" status: 200 len: 1562 microversion: 2.1 time: 0.153122 Sep 23 05:52:39.406655 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4065/7943] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:52:39 2022] GET /compute/v2.1/servers/065fbd75-3cb8-44d9-86ce-5bf7b0ffa350 => generated 1562 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:52:41.308066 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d40ee441-1cee-4ac2-b7f9-38b1fcf4d1a1 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:52:41.308707 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d40ee441-1cee-4ac2-b7f9-38b1fcf4d1a1 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 065fbd75-3cb8-44d9-86ce-5bf7b0ffa350] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:52:41.311486 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-e7061b1a-8bb4-4d7f-a36c-38836d0a95fc req-3d56f8cb-f5bc-4a7d-95a6-f7dd2f37fcc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "065fbd75-3cb8-44d9-86ce-5bf7b0ffa350", "tag": "be5ed1db-c02d-49ac-9e2c-4ef47bf5f37d"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:52:41.318750 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:52:41.327976 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d40ee441-1cee-4ac2-b7f9-38b1fcf4d1a1 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:52:41.329712 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-e7061b1a-8bb4-4d7f-a36c-38836d0a95fc req-3d56f8cb-f5bc-4a7d-95a6-f7dd2f37fcc2 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:52:41.330611 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d40ee441-1cee-4ac2-b7f9-38b1fcf4d1a1 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:52:41.331087 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d40ee441-1cee-4ac2-b7f9-38b1fcf4d1a1 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:52:41.331825 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d40ee441-1cee-4ac2-b7f9-38b1fcf4d1a1 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:52:41.332510 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-e7061b1a-8bb4-4d7f-a36c-38836d0a95fc req-3d56f8cb-f5bc-4a7d-95a6-f7dd2f37fcc2 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:52:41.333110 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-e7061b1a-8bb4-4d7f-a36c-38836d0a95fc req-3d56f8cb-f5bc-4a7d-95a6-f7dd2f37fcc2 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:52:41.333826 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d40ee441-1cee-4ac2-b7f9-38b1fcf4d1a1 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:52:41.334374 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d40ee441-1cee-4ac2-b7f9-38b1fcf4d1a1 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:52:41.347521 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-e7061b1a-8bb4-4d7f-a36c-38836d0a95fc req-3d56f8cb-f5bc-4a7d-95a6-f7dd2f37fcc2 service nova] Creating event network-changed:be5ed1db-c02d-49ac-9e2c-4ef47bf5f37d for instance 065fbd75-3cb8-44d9-86ce-5bf7b0ffa350 on n-h2-846463-3 Sep 23 05:52:41.353098 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-e7061b1a-8bb4-4d7f-a36c-38836d0a95fc req-3d56f8cb-f5bc-4a7d-95a6-f7dd2f37fcc2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049868 Sep 23 05:52:41.354219 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4066/7944] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:52:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:52:41.479260 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d40ee441-1cee-4ac2-b7f9-38b1fcf4d1a1 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:52:41.489107 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d40ee441-1cee-4ac2-b7f9-38b1fcf4d1a1 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/065fbd75-3cb8-44d9-86ce-5bf7b0ffa350" status: 200 len: 1562 microversion: 2.1 time: 0.189458 Sep 23 05:52:41.490200 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3879/7945] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:52:41 2022] GET /compute/v2.1/servers/065fbd75-3cb8-44d9-86ce-5bf7b0ffa350 => generated 1562 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:53:02.738360 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=9 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:53:02.739265 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=40 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:53:02.743262 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a95f217c-bdd1-4ccc-b7f9-ebd527fbdd3f tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:53:02.745536 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a95f217c-bdd1-4ccc-b7f9-ebd527fbdd3f tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 065fbd75-3cb8-44d9-86ce-5bf7b0ffa350] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:53:02.751637 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a95f217c-bdd1-4ccc-b7f9-ebd527fbdd3f tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:53:02.752126 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a95f217c-bdd1-4ccc-b7f9-ebd527fbdd3f tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:53:02.752570 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a95f217c-bdd1-4ccc-b7f9-ebd527fbdd3f tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:53:02.753268 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a95f217c-bdd1-4ccc-b7f9-ebd527fbdd3f tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:53:02.753733 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a95f217c-bdd1-4ccc-b7f9-ebd527fbdd3f tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:53:02.754192 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a95f217c-bdd1-4ccc-b7f9-ebd527fbdd3f tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:53:02.812151 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a95f217c-bdd1-4ccc-b7f9-ebd527fbdd3f tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "POST /compute/v2.1/servers/065fbd75-3cb8-44d9-86ce-5bf7b0ffa350/action" status: 200 len: 24566 microversion: 2.1 time: 0.074738 Sep 23 05:53:02.812967 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4067/7946] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 05:53:02 2022] POST /compute/v2.1/servers/065fbd75-3cb8-44d9-86ce-5bf7b0ffa350/action => generated 24566 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 05:53:09.212002 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-eaa8953e-e106-4adb-81a2-b102468d018e tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:53:09.214103 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=46 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:53:09.219762 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-eaa8953e-e106-4adb-81a2-b102468d018e tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:53:09.228034 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-eaa8953e-e106-4adb-81a2-b102468d018e tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:53:09.228034 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-eaa8953e-e106-4adb-81a2-b102468d018e tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:53:09.242908 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-eaa8953e-e106-4adb-81a2-b102468d018e tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 065fbd75-3cb8-44d9-86ce-5bf7b0ffa350] Going to try to stop instance {{(pid=122698) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 23 05:53:09.373785 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-eaa8953e-e106-4adb-81a2-b102468d018e tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "POST /compute/v2.1/servers/065fbd75-3cb8-44d9-86ce-5bf7b0ffa350/action" status: 202 len: 0 microversion: 2.1 time: 0.166157 Sep 23 05:53:09.374445 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3880/7947] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 05:53:09 2022] POST /compute/v2.1/servers/065fbd75-3cb8-44d9-86ce-5bf7b0ffa350/action => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 05:53:09.383170 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a0c3bf8f-cbad-46bf-a5f2-2f10ccda0f67 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:53:09.383878 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a0c3bf8f-cbad-46bf-a5f2-2f10ccda0f67 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 065fbd75-3cb8-44d9-86ce-5bf7b0ffa350] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:53:09.391802 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a0c3bf8f-cbad-46bf-a5f2-2f10ccda0f67 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:53:09.392293 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a0c3bf8f-cbad-46bf-a5f2-2f10ccda0f67 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:53:09.392734 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a0c3bf8f-cbad-46bf-a5f2-2f10ccda0f67 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:53:09.393435 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a0c3bf8f-cbad-46bf-a5f2-2f10ccda0f67 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:53:09.393917 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a0c3bf8f-cbad-46bf-a5f2-2f10ccda0f67 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:53:09.402099 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a0c3bf8f-cbad-46bf-a5f2-2f10ccda0f67 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:53:09.528376 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a0c3bf8f-cbad-46bf-a5f2-2f10ccda0f67 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:53:09.536779 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a0c3bf8f-cbad-46bf-a5f2-2f10ccda0f67 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/065fbd75-3cb8-44d9-86ce-5bf7b0ffa350" status: 200 len: 1690 microversion: 2.1 time: 0.157821 Sep 23 05:53:09.537360 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4068/7948] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:53:09 2022] GET /compute/v2.1/servers/065fbd75-3cb8-44d9-86ce-5bf7b0ffa350 => generated 1690 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:53:10.562293 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-64748554-0e4e-404b-bbf3-d14fc5a28416 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:53:10.563016 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-64748554-0e4e-404b-bbf3-d14fc5a28416 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 065fbd75-3cb8-44d9-86ce-5bf7b0ffa350] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:53:10.569243 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-64748554-0e4e-404b-bbf3-d14fc5a28416 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:53:10.569746 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-64748554-0e4e-404b-bbf3-d14fc5a28416 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:53:10.570237 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-64748554-0e4e-404b-bbf3-d14fc5a28416 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:53:10.570949 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-64748554-0e4e-404b-bbf3-d14fc5a28416 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:53:10.571423 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-64748554-0e4e-404b-bbf3-d14fc5a28416 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:53:10.571870 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-64748554-0e4e-404b-bbf3-d14fc5a28416 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:53:10.702311 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-64748554-0e4e-404b-bbf3-d14fc5a28416 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:53:10.710154 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-64748554-0e4e-404b-bbf3-d14fc5a28416 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/065fbd75-3cb8-44d9-86ce-5bf7b0ffa350" status: 200 len: 1690 microversion: 2.1 time: 0.152959 Sep 23 05:53:10.710731 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3881/7949] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:53:10 2022] GET /compute/v2.1/servers/065fbd75-3cb8-44d9-86ce-5bf7b0ffa350 => generated 1690 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:53:11.733948 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-02479ff1-955e-40c6-b9ce-6500ee43bd6f tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:53:11.734566 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-02479ff1-955e-40c6-b9ce-6500ee43bd6f tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 065fbd75-3cb8-44d9-86ce-5bf7b0ffa350] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:53:11.741011 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-02479ff1-955e-40c6-b9ce-6500ee43bd6f tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:53:11.741492 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-02479ff1-955e-40c6-b9ce-6500ee43bd6f tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:53:11.741966 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-02479ff1-955e-40c6-b9ce-6500ee43bd6f tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:53:11.742648 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-02479ff1-955e-40c6-b9ce-6500ee43bd6f tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:53:11.743101 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-02479ff1-955e-40c6-b9ce-6500ee43bd6f tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:53:11.743526 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-02479ff1-955e-40c6-b9ce-6500ee43bd6f tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:53:11.879623 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-02479ff1-955e-40c6-b9ce-6500ee43bd6f tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:53:11.887443 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-02479ff1-955e-40c6-b9ce-6500ee43bd6f tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/065fbd75-3cb8-44d9-86ce-5bf7b0ffa350" status: 200 len: 1690 microversion: 2.1 time: 0.158036 Sep 23 05:53:11.888022 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4069/7950] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:53:11 2022] GET /compute/v2.1/servers/065fbd75-3cb8-44d9-86ce-5bf7b0ffa350 => generated 1690 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:53:12.911020 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5109743b-a6fa-4b3f-a699-967e184e8d7c tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:53:12.911669 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5109743b-a6fa-4b3f-a699-967e184e8d7c tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 065fbd75-3cb8-44d9-86ce-5bf7b0ffa350] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:53:12.918594 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5109743b-a6fa-4b3f-a699-967e184e8d7c tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:53:12.919110 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5109743b-a6fa-4b3f-a699-967e184e8d7c tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:53:12.919574 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5109743b-a6fa-4b3f-a699-967e184e8d7c tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:53:12.920870 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5109743b-a6fa-4b3f-a699-967e184e8d7c tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:53:12.921356 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5109743b-a6fa-4b3f-a699-967e184e8d7c tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:53:12.921907 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5109743b-a6fa-4b3f-a699-967e184e8d7c tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:53:13.052515 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-5109743b-a6fa-4b3f-a699-967e184e8d7c tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:53:13.060311 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5109743b-a6fa-4b3f-a699-967e184e8d7c tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/065fbd75-3cb8-44d9-86ce-5bf7b0ffa350" status: 200 len: 1690 microversion: 2.1 time: 0.153344 Sep 23 05:53:13.061495 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3882/7951] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:53:12 2022] GET /compute/v2.1/servers/065fbd75-3cb8-44d9-86ce-5bf7b0ffa350 => generated 1690 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:53:14.083604 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ee5840ee-f8df-4c3f-8908-ff8ee9cc6779 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:53:14.084267 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ee5840ee-f8df-4c3f-8908-ff8ee9cc6779 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 065fbd75-3cb8-44d9-86ce-5bf7b0ffa350] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:53:14.090912 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ee5840ee-f8df-4c3f-8908-ff8ee9cc6779 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:53:14.095292 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ee5840ee-f8df-4c3f-8908-ff8ee9cc6779 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:53:14.095292 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ee5840ee-f8df-4c3f-8908-ff8ee9cc6779 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:53:14.095292 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ee5840ee-f8df-4c3f-8908-ff8ee9cc6779 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:53:14.095292 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ee5840ee-f8df-4c3f-8908-ff8ee9cc6779 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:53:14.095292 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ee5840ee-f8df-4c3f-8908-ff8ee9cc6779 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:53:14.227188 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ee5840ee-f8df-4c3f-8908-ff8ee9cc6779 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:53:14.235161 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ee5840ee-f8df-4c3f-8908-ff8ee9cc6779 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/065fbd75-3cb8-44d9-86ce-5bf7b0ffa350" status: 200 len: 1690 microversion: 2.1 time: 0.155537 Sep 23 05:53:14.235730 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4070/7952] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:53:14 2022] GET /compute/v2.1/servers/065fbd75-3cb8-44d9-86ce-5bf7b0ffa350 => generated 1690 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:53:15.259158 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-da288424-4546-4742-93ed-302294c6c327 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:53:15.259793 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-da288424-4546-4742-93ed-302294c6c327 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 065fbd75-3cb8-44d9-86ce-5bf7b0ffa350] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:53:15.267512 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-da288424-4546-4742-93ed-302294c6c327 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:53:15.268019 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-da288424-4546-4742-93ed-302294c6c327 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:53:15.268473 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-da288424-4546-4742-93ed-302294c6c327 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:53:15.269186 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-da288424-4546-4742-93ed-302294c6c327 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:53:15.269783 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-da288424-4546-4742-93ed-302294c6c327 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:53:15.270248 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-da288424-4546-4742-93ed-302294c6c327 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:53:15.404096 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-da288424-4546-4742-93ed-302294c6c327 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:53:15.412560 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-da288424-4546-4742-93ed-302294c6c327 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/065fbd75-3cb8-44d9-86ce-5bf7b0ffa350" status: 200 len: 1690 microversion: 2.1 time: 0.157446 Sep 23 05:53:15.413147 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3883/7953] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:53:15 2022] GET /compute/v2.1/servers/065fbd75-3cb8-44d9-86ce-5bf7b0ffa350 => generated 1690 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:53:16.435590 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4b712418-7559-42d1-a42a-c6bc06184e9a tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:53:16.436212 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4b712418-7559-42d1-a42a-c6bc06184e9a tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 065fbd75-3cb8-44d9-86ce-5bf7b0ffa350] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:53:16.442764 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4b712418-7559-42d1-a42a-c6bc06184e9a tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:53:16.447158 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4b712418-7559-42d1-a42a-c6bc06184e9a tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:53:16.447158 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4b712418-7559-42d1-a42a-c6bc06184e9a tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:53:16.447158 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4b712418-7559-42d1-a42a-c6bc06184e9a tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:53:16.447158 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4b712418-7559-42d1-a42a-c6bc06184e9a tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:53:16.447158 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4b712418-7559-42d1-a42a-c6bc06184e9a tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:53:16.573457 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-4b712418-7559-42d1-a42a-c6bc06184e9a tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:53:16.581304 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4b712418-7559-42d1-a42a-c6bc06184e9a tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/065fbd75-3cb8-44d9-86ce-5bf7b0ffa350" status: 200 len: 1690 microversion: 2.1 time: 0.149699 Sep 23 05:53:16.581874 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4071/7954] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:53:16 2022] GET /compute/v2.1/servers/065fbd75-3cb8-44d9-86ce-5bf7b0ffa350 => generated 1690 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:53:17.605281 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6c0f6398-8134-43cc-80c8-a2a4162a2054 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:53:17.605839 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-6c0f6398-8134-43cc-80c8-a2a4162a2054 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 065fbd75-3cb8-44d9-86ce-5bf7b0ffa350] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:53:17.613213 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6c0f6398-8134-43cc-80c8-a2a4162a2054 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:53:17.613713 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6c0f6398-8134-43cc-80c8-a2a4162a2054 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:53:17.614210 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6c0f6398-8134-43cc-80c8-a2a4162a2054 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:53:17.614912 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6c0f6398-8134-43cc-80c8-a2a4162a2054 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:53:17.615383 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6c0f6398-8134-43cc-80c8-a2a4162a2054 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:53:17.615828 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6c0f6398-8134-43cc-80c8-a2a4162a2054 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:53:17.755272 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6c0f6398-8134-43cc-80c8-a2a4162a2054 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:53:17.763478 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-6c0f6398-8134-43cc-80c8-a2a4162a2054 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/065fbd75-3cb8-44d9-86ce-5bf7b0ffa350" status: 200 len: 1690 microversion: 2.1 time: 0.161966 Sep 23 05:53:17.764169 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3884/7955] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:53:17 2022] GET /compute/v2.1/servers/065fbd75-3cb8-44d9-86ce-5bf7b0ffa350 => generated 1690 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:53:18.787327 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-83940213-2fbb-44b4-84e3-494a7d404df0 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:53:18.787941 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-83940213-2fbb-44b4-84e3-494a7d404df0 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 065fbd75-3cb8-44d9-86ce-5bf7b0ffa350] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:53:18.794505 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-83940213-2fbb-44b4-84e3-494a7d404df0 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:53:18.795003 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-83940213-2fbb-44b4-84e3-494a7d404df0 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:53:18.795529 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-83940213-2fbb-44b4-84e3-494a7d404df0 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:53:18.797059 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-83940213-2fbb-44b4-84e3-494a7d404df0 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:53:18.797938 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-83940213-2fbb-44b4-84e3-494a7d404df0 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:53:18.798737 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-83940213-2fbb-44b4-84e3-494a7d404df0 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:53:18.930313 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-83940213-2fbb-44b4-84e3-494a7d404df0 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:53:18.938122 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-83940213-2fbb-44b4-84e3-494a7d404df0 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/065fbd75-3cb8-44d9-86ce-5bf7b0ffa350" status: 200 len: 1690 microversion: 2.1 time: 0.154739 Sep 23 05:53:18.938708 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4072/7956] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:53:18 2022] GET /compute/v2.1/servers/065fbd75-3cb8-44d9-86ce-5bf7b0ffa350 => generated 1690 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:53:19.962800 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2fc913f5-4c5a-4326-9855-34592f0fcf23 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:53:19.963484 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-2fc913f5-4c5a-4326-9855-34592f0fcf23 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 065fbd75-3cb8-44d9-86ce-5bf7b0ffa350] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:53:19.970524 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2fc913f5-4c5a-4326-9855-34592f0fcf23 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:53:19.971037 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2fc913f5-4c5a-4326-9855-34592f0fcf23 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:53:19.971505 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2fc913f5-4c5a-4326-9855-34592f0fcf23 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:53:19.972223 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2fc913f5-4c5a-4326-9855-34592f0fcf23 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:53:19.972705 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2fc913f5-4c5a-4326-9855-34592f0fcf23 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:53:19.973156 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2fc913f5-4c5a-4326-9855-34592f0fcf23 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:53:20.109773 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-2fc913f5-4c5a-4326-9855-34592f0fcf23 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:53:20.117593 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2fc913f5-4c5a-4326-9855-34592f0fcf23 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/065fbd75-3cb8-44d9-86ce-5bf7b0ffa350" status: 200 len: 1667 microversion: 2.1 time: 0.158823 Sep 23 05:53:20.118394 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3885/7957] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:53:19 2022] GET /compute/v2.1/servers/065fbd75-3cb8-44d9-86ce-5bf7b0ffa350 => generated 1667 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:53:21.212417 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-710732dc-0da8-4a3b-8285-034549d72104 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:53:21.214723 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-710732dc-0da8-4a3b-8285-034549d72104 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 065fbd75-3cb8-44d9-86ce-5bf7b0ffa350] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:53:21.221263 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-710732dc-0da8-4a3b-8285-034549d72104 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:53:21.238343 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-710732dc-0da8-4a3b-8285-034549d72104 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:53:21.238343 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-710732dc-0da8-4a3b-8285-034549d72104 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:53:21.238343 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-710732dc-0da8-4a3b-8285-034549d72104 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:53:21.238343 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-710732dc-0da8-4a3b-8285-034549d72104 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:53:21.238343 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-710732dc-0da8-4a3b-8285-034549d72104 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:53:21.277204 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-710732dc-0da8-4a3b-8285-034549d72104 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "POST /compute/v2.1/servers/065fbd75-3cb8-44d9-86ce-5bf7b0ffa350/action" status: 200 len: 35168 microversion: 2.1 time: 0.068552 Sep 23 05:53:21.278460 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4073/7958] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 05:53:21 2022] POST /compute/v2.1/servers/065fbd75-3cb8-44d9-86ce-5bf7b0ffa350/action => generated 35168 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 05:53:21.293543 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f6e8f392-da2b-4b78-99a7-3fe9ecc0f238 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:53:21.301104 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f6e8f392-da2b-4b78-99a7-3fe9ecc0f238 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:53:21.301619 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f6e8f392-da2b-4b78-99a7-3fe9ecc0f238 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:53:21.302113 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f6e8f392-da2b-4b78-99a7-3fe9ecc0f238 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:53:21.324778 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f6e8f392-da2b-4b78-99a7-3fe9ecc0f238 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 065fbd75-3cb8-44d9-86ce-5bf7b0ffa350] Going to try to start instance {{(pid=122698) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 23 05:53:21.504877 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f6e8f392-da2b-4b78-99a7-3fe9ecc0f238 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "POST /compute/v2.1/servers/065fbd75-3cb8-44d9-86ce-5bf7b0ffa350/action" status: 202 len: 0 microversion: 2.1 time: 0.214913 Sep 23 05:53:21.505468 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3886/7959] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 05:53:21 2022] POST /compute/v2.1/servers/065fbd75-3cb8-44d9-86ce-5bf7b0ffa350/action => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 05:53:21.514465 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ccf1fdaf-4314-4756-873f-86954af3a357 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:53:21.515174 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ccf1fdaf-4314-4756-873f-86954af3a357 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 065fbd75-3cb8-44d9-86ce-5bf7b0ffa350] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:53:21.522650 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ccf1fdaf-4314-4756-873f-86954af3a357 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:53:21.523145 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ccf1fdaf-4314-4756-873f-86954af3a357 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:53:21.523587 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ccf1fdaf-4314-4756-873f-86954af3a357 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:53:21.524292 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ccf1fdaf-4314-4756-873f-86954af3a357 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:53:21.524753 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ccf1fdaf-4314-4756-873f-86954af3a357 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:53:21.525184 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ccf1fdaf-4314-4756-873f-86954af3a357 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:53:21.666028 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ccf1fdaf-4314-4756-873f-86954af3a357 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:53:21.674527 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ccf1fdaf-4314-4756-873f-86954af3a357 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/065fbd75-3cb8-44d9-86ce-5bf7b0ffa350" status: 200 len: 1676 microversion: 2.1 time: 0.164428 Sep 23 05:53:21.675100 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4074/7960] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:53:21 2022] GET /compute/v2.1/servers/065fbd75-3cb8-44d9-86ce-5bf7b0ffa350 => generated 1676 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:53:22.699974 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-651b1b10-53a9-4b90-bcab-8a1c1f66da42 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:53:22.700696 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-651b1b10-53a9-4b90-bcab-8a1c1f66da42 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 065fbd75-3cb8-44d9-86ce-5bf7b0ffa350] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:53:22.706963 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-651b1b10-53a9-4b90-bcab-8a1c1f66da42 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:53:22.707473 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-651b1b10-53a9-4b90-bcab-8a1c1f66da42 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:53:22.707935 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-651b1b10-53a9-4b90-bcab-8a1c1f66da42 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:53:22.708648 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-651b1b10-53a9-4b90-bcab-8a1c1f66da42 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:53:22.709127 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-651b1b10-53a9-4b90-bcab-8a1c1f66da42 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:53:22.709574 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-651b1b10-53a9-4b90-bcab-8a1c1f66da42 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:53:22.845727 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-651b1b10-53a9-4b90-bcab-8a1c1f66da42 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:53:22.853600 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-651b1b10-53a9-4b90-bcab-8a1c1f66da42 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/065fbd75-3cb8-44d9-86ce-5bf7b0ffa350" status: 200 len: 1676 microversion: 2.1 time: 0.158720 Sep 23 05:53:22.854213 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3887/7961] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:53:22 2022] GET /compute/v2.1/servers/065fbd75-3cb8-44d9-86ce-5bf7b0ffa350 => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:53:23.877181 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2d570b61-d842-4b86-849a-9e4d0b2582d5 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:53:23.877797 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-2d570b61-d842-4b86-849a-9e4d0b2582d5 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 065fbd75-3cb8-44d9-86ce-5bf7b0ffa350] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:53:23.884419 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2d570b61-d842-4b86-849a-9e4d0b2582d5 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:53:23.884912 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2d570b61-d842-4b86-849a-9e4d0b2582d5 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:53:23.885357 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2d570b61-d842-4b86-849a-9e4d0b2582d5 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:53:23.886089 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2d570b61-d842-4b86-849a-9e4d0b2582d5 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:53:23.886555 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2d570b61-d842-4b86-849a-9e4d0b2582d5 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:53:23.886989 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2d570b61-d842-4b86-849a-9e4d0b2582d5 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:53:24.018278 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2d570b61-d842-4b86-849a-9e4d0b2582d5 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:53:24.026434 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2d570b61-d842-4b86-849a-9e4d0b2582d5 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/065fbd75-3cb8-44d9-86ce-5bf7b0ffa350" status: 200 len: 1680 microversion: 2.1 time: 0.153694 Sep 23 05:53:24.027051 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4075/7962] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:53:23 2022] GET /compute/v2.1/servers/065fbd75-3cb8-44d9-86ce-5bf7b0ffa350 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:53:46.218189 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f363f775-bc0a-43f4-8c58-89dd817e33d6 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:53:46.220798 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f363f775-bc0a-43f4-8c58-89dd817e33d6 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 065fbd75-3cb8-44d9-86ce-5bf7b0ffa350] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:53:46.223051 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=17 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:53:46.223837 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:53:46.228546 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f363f775-bc0a-43f4-8c58-89dd817e33d6 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:53:46.272577 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f363f775-bc0a-43f4-8c58-89dd817e33d6 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:53:46.272577 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f363f775-bc0a-43f4-8c58-89dd817e33d6 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:53:46.272577 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f363f775-bc0a-43f4-8c58-89dd817e33d6 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:53:46.272577 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f363f775-bc0a-43f4-8c58-89dd817e33d6 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:53:46.272577 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f363f775-bc0a-43f4-8c58-89dd817e33d6 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:53:46.294217 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f363f775-bc0a-43f4-8c58-89dd817e33d6 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "POST /compute/v2.1/servers/065fbd75-3cb8-44d9-86ce-5bf7b0ffa350/action" status: 200 len: 59732 microversion: 2.1 time: 0.080699 Sep 23 05:53:46.296061 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3888/7963] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 05:53:46 2022] POST /compute/v2.1/servers/065fbd75-3cb8-44d9-86ce-5bf7b0ffa350/action => generated 59732 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 05:53:53.346922 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ffb92f59-f551-4828-a374-6c5b0c661582 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:53:53.349287 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ffb92f59-f551-4828-a374-6c5b0c661582 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 065fbd75-3cb8-44d9-86ce-5bf7b0ffa350] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:53:53.350281 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=18 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:53:53.351768 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=50 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:53:53.354064 n-d-846463-3 devstack@n-api.service[122699]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 05:53:53.354231 n-d-846463-3 devstack@n-api.service[122699]: Fri Sep 23 05:53:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/065fbd75-3cb8-44d9-86ce-5bf7b0ffa350 (ip 10.222.0.33) !!! Sep 23 05:53:53.361797 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ffb92f59-f551-4828-a374-6c5b0c661582 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:53:53.362335 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ffb92f59-f551-4828-a374-6c5b0c661582 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:53:53.362777 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ffb92f59-f551-4828-a374-6c5b0c661582 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:53:53.363498 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ffb92f59-f551-4828-a374-6c5b0c661582 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:53:53.363963 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ffb92f59-f551-4828-a374-6c5b0c661582 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:53:53.365099 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ffb92f59-f551-4828-a374-6c5b0c661582 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:53:53.396660 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ffb92f59-f551-4828-a374-6c5b0c661582 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 065fbd75-3cb8-44d9-86ce-5bf7b0ffa350] Going to try to terminate instance {{(pid=122699) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 05:53:53.405865 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-ea68c62c-bade-4ef1-9926-e3c7fb0a8598 req-9dffabff-45ba-4011-b9f5-5851923c6032 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "065fbd75-3cb8-44d9-86ce-5bf7b0ffa350", "tag": "be5ed1db-c02d-49ac-9e2c-4ef47bf5f37d"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:53:53.416086 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-ea68c62c-bade-4ef1-9926-e3c7fb0a8598 req-9dffabff-45ba-4011-b9f5-5851923c6032 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:53:53.418138 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-ea68c62c-bade-4ef1-9926-e3c7fb0a8598 req-9dffabff-45ba-4011-b9f5-5851923c6032 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:53:53.418138 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-ea68c62c-bade-4ef1-9926-e3c7fb0a8598 req-9dffabff-45ba-4011-b9f5-5851923c6032 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:53:53.428693 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-ea68c62c-bade-4ef1-9926-e3c7fb0a8598 req-9dffabff-45ba-4011-b9f5-5851923c6032 service nova] Creating event network-changed:be5ed1db-c02d-49ac-9e2c-4ef47bf5f37d for instance 065fbd75-3cb8-44d9-86ce-5bf7b0ffa350 on n-h2-846463-3 Sep 23 05:53:53.434262 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-ea68c62c-bade-4ef1-9926-e3c7fb0a8598 req-9dffabff-45ba-4011-b9f5-5851923c6032 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089458 Sep 23 05:53:53.435015 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3889/7964] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:53:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 05:53:53.684336 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ffb92f59-f551-4828-a374-6c5b0c661582 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "DELETE /compute/v2.1/servers/065fbd75-3cb8-44d9-86ce-5bf7b0ffa350" status: 204 len: 0 microversion: 2.1 time: 0.342360 Sep 23 05:53:53.685398 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4076/7965] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 05:53:53 2022] DELETE /compute/v2.1/servers/065fbd75-3cb8-44d9-86ce-5bf7b0ffa350 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 05:53:53.694170 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c6149359-6b36-4d61-acfe-18fd6caaf0f7 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:53:53.694981 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c6149359-6b36-4d61-acfe-18fd6caaf0f7 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 065fbd75-3cb8-44d9-86ce-5bf7b0ffa350] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:53:53.703057 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c6149359-6b36-4d61-acfe-18fd6caaf0f7 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:53:53.703671 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c6149359-6b36-4d61-acfe-18fd6caaf0f7 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:53:53.704198 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c6149359-6b36-4d61-acfe-18fd6caaf0f7 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:53:53.705027 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c6149359-6b36-4d61-acfe-18fd6caaf0f7 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:53:53.705609 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c6149359-6b36-4d61-acfe-18fd6caaf0f7 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:53:53.706187 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c6149359-6b36-4d61-acfe-18fd6caaf0f7 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:53:53.848598 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c6149359-6b36-4d61-acfe-18fd6caaf0f7 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:53:53.856664 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c6149359-6b36-4d61-acfe-18fd6caaf0f7 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/065fbd75-3cb8-44d9-86ce-5bf7b0ffa350" status: 200 len: 1686 microversion: 2.1 time: 0.166773 Sep 23 05:53:53.857957 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3890/7966] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:53:53 2022] GET /compute/v2.1/servers/065fbd75-3cb8-44d9-86ce-5bf7b0ffa350 => generated 1686 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:53:54.882947 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-83e51622-d6df-4108-b764-8ae727b773d8 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:53:54.883669 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-83e51622-d6df-4108-b764-8ae727b773d8 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 065fbd75-3cb8-44d9-86ce-5bf7b0ffa350] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:53:54.892346 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-83e51622-d6df-4108-b764-8ae727b773d8 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:53:54.893266 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-83e51622-d6df-4108-b764-8ae727b773d8 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:53:54.893795 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-83e51622-d6df-4108-b764-8ae727b773d8 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:53:54.894681 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-83e51622-d6df-4108-b764-8ae727b773d8 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:53:54.895165 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-83e51622-d6df-4108-b764-8ae727b773d8 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:53:54.895606 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-83e51622-d6df-4108-b764-8ae727b773d8 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:53:55.032169 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-83e51622-d6df-4108-b764-8ae727b773d8 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:53:55.040244 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-83e51622-d6df-4108-b764-8ae727b773d8 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/065fbd75-3cb8-44d9-86ce-5bf7b0ffa350" status: 200 len: 1686 microversion: 2.1 time: 0.161598 Sep 23 05:53:55.040832 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4077/7967] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:53:54 2022] GET /compute/v2.1/servers/065fbd75-3cb8-44d9-86ce-5bf7b0ffa350 => generated 1686 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:53:55.643860 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-ae74ccbc-ad5c-4931-be06-e2989290f8fa req-dbc7add8-b5a4-428a-b0f8-d1650cbd621c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "065fbd75-3cb8-44d9-86ce-5bf7b0ffa350", "name": "network-vif-deleted", "tag": "be5ed1db-c02d-49ac-9e2c-4ef47bf5f37d"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:53:55.655154 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-ae74ccbc-ad5c-4931-be06-e2989290f8fa req-dbc7add8-b5a4-428a-b0f8-d1650cbd621c service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:53:55.655658 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-ae74ccbc-ad5c-4931-be06-e2989290f8fa req-dbc7add8-b5a4-428a-b0f8-d1650cbd621c service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:53:55.656115 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-ae74ccbc-ad5c-4931-be06-e2989290f8fa req-dbc7add8-b5a4-428a-b0f8-d1650cbd621c service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:53:55.667522 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-ae74ccbc-ad5c-4931-be06-e2989290f8fa req-dbc7add8-b5a4-428a-b0f8-d1650cbd621c service nova] Creating event network-vif-deleted:be5ed1db-c02d-49ac-9e2c-4ef47bf5f37d for instance 065fbd75-3cb8-44d9-86ce-5bf7b0ffa350 on n-h2-846463-3 Sep 23 05:53:55.672429 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-ae74ccbc-ad5c-4931-be06-e2989290f8fa req-dbc7add8-b5a4-428a-b0f8-d1650cbd621c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032418 Sep 23 05:53:55.673001 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3891/7968] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:53:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:53:56.065091 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8578bd88-00d8-4d5a-bcc7-b54ec9f129ce tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:53:56.065723 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-8578bd88-00d8-4d5a-bcc7-b54ec9f129ce tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 065fbd75-3cb8-44d9-86ce-5bf7b0ffa350] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:53:56.071919 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8578bd88-00d8-4d5a-bcc7-b54ec9f129ce tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:53:56.072418 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8578bd88-00d8-4d5a-bcc7-b54ec9f129ce tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:53:56.072866 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8578bd88-00d8-4d5a-bcc7-b54ec9f129ce tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:53:56.073568 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8578bd88-00d8-4d5a-bcc7-b54ec9f129ce tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:53:56.074077 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8578bd88-00d8-4d5a-bcc7-b54ec9f129ce tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:53:56.074511 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8578bd88-00d8-4d5a-bcc7-b54ec9f129ce tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:53:56.105758 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8578bd88-00d8-4d5a-bcc7-b54ec9f129ce tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:53:56.106276 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8578bd88-00d8-4d5a-bcc7-b54ec9f129ce tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:53:56.106718 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8578bd88-00d8-4d5a-bcc7-b54ec9f129ce tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:53:56.107166 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-8578bd88-00d8-4d5a-bcc7-b54ec9f129ce tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lazy-loading 'fault' on Instance uuid 065fbd75-3cb8-44d9-86ce-5bf7b0ffa350 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 05:53:56.150445 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-8578bd88-00d8-4d5a-bcc7-b54ec9f129ce tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:53:56.158348 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-8578bd88-00d8-4d5a-bcc7-b54ec9f129ce tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/065fbd75-3cb8-44d9-86ce-5bf7b0ffa350" status: 200 len: 1355 microversion: 2.1 time: 0.096953 Sep 23 05:53:56.158864 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4078/7969] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:53:56 2022] GET /compute/v2.1/servers/065fbd75-3cb8-44d9-86ce-5bf7b0ffa350 => generated 1355 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:53:57.182565 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-895517c7-d7d9-483c-b980-e2da2852c7a4 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:53:57.183293 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-895517c7-d7d9-483c-b980-e2da2852c7a4 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: 065fbd75-3cb8-44d9-86ce-5bf7b0ffa350] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:53:57.189624 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-895517c7-d7d9-483c-b980-e2da2852c7a4 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:53:57.190181 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-895517c7-d7d9-483c-b980-e2da2852c7a4 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:53:57.190647 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-895517c7-d7d9-483c-b980-e2da2852c7a4 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:53:57.191366 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-895517c7-d7d9-483c-b980-e2da2852c7a4 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:53:57.191846 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-895517c7-d7d9-483c-b980-e2da2852c7a4 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:53:57.192300 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-895517c7-d7d9-483c-b980-e2da2852c7a4 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:53:57.206028 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-895517c7-d7d9-483c-b980-e2da2852c7a4 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] HTTP exception thrown: Instance 065fbd75-3cb8-44d9-86ce-5bf7b0ffa350 could not be found. Sep 23 05:53:57.207610 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-895517c7-d7d9-483c-b980-e2da2852c7a4 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Request method failure captured: Sep 23 05:53:57.207610 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/065fbd75-3cb8-44d9-86ce-5bf7b0ffa350 HTTP/1.1 Sep 23 05:53:57.207610 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 05:53:57.207610 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 05:53:57.207610 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 05:53:57.207610 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 05:53:57.207610 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 05:53:57.207610 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 05:53:57.207610 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 05:53:57.207610 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 05:53:57.207610 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLUhz7bpvepG5vaaNTB45PETsbu7BFN8GjZeZ_vLrd5WJDjgd_oQ5bhmVua4C2ZhQgOahIirm-KuGCZTB_5bToAYjCLfVfw81RihC56n3ttHDJ0Tgc_iEV4MwjR_WQmCh9B38US55e6l82-uxms5I3hOmslhT2_3dhZB9TyAC0xyC3YM Sep 23 05:53:57.207610 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 05:53:57.207610 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 05:53:57.207610 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 05:53:57.207610 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 05:53:57.207610 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 05:53:57.207610 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 05:53:57.207610 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 498fb069adef49d19ed802d2133adb89 Sep 23 05:53:57.207610 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2142034074 Sep 23 05:53:57.207610 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 05:53:57.207610 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 05:53:57.207610 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_498fb069adef49d19ed802d2133adb89", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/498fb069adef49d19ed802d2133adb89"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/498fb069adef49d19ed802d2133adb89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/498fb069adef49d19ed802d2133adb89"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:53:57.207610 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2142034074 Sep 23 05:53:57.207610 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 498fb069adef49d19ed802d2133adb89 Sep 23 05:53:57.207610 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2142034074 Sep 23 05:53:57.207610 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-TestNetworkAdvancedServerOps-2142034074-project Sep 23 05:53:57.207610 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 05:53:57.207610 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 05:53:57.207610 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: e9d36972d8f2413b8838e64998b43359 Sep 23 05:53:57.207610 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2142034074-project Sep 23 05:53:57.207610 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 05:53:57.207610 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 065fbd75-3cb8-44d9-86ce-5bf7b0ffa350 could not be found. Sep 23 05:53:57.207610 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '065fbd75-3cb8-44d9-86ce-5bf7b0ffa350'} Sep 23 05:53:57.207610 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:53:57.207610 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:53:57.207610 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 05:53:57.207610 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 05:53:57.207610 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 05:53:57.207610 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 05:53:57.207610 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 05:53:57.207610 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 05:53:57.207610 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 05:53:57.207610 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 05:53:57.207610 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 065fbd75-3cb8-44d9-86ce-5bf7b0ffa350 could not be found. Sep 23 05:53:57.207610 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:53:57.207610 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:53:57.207610 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:53:57.207610 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:53:57.207610 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:53:57.207610 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:53:57.207610 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:53:57.207610 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:53:57.207610 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:53:57.207610 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:53:57.207610 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 05:53:57.207610 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 05:53:57.207610 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 05:53:57.207610 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 05:53:57.207610 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 05:53:57.207610 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:53:57.207610 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 065fbd75-3cb8-44d9-86ce-5bf7b0ffa350 could not be found. Sep 23 05:53:57.207610 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:53:57.207610 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:53:57.213463 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:53:57.213463 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:53:57.213463 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:53:57.213463 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:53:57.213463 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:53:57.213463 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:53:57.213463 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 065fbd75-3cb8-44d9-86ce-5bf7b0ffa350 could not be found. Sep 23 05:53:57.213463 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:53:57.213463 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-895517c7-d7d9-483c-b980-e2da2852c7a4 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Returning 404 to user: Instance 065fbd75-3cb8-44d9-86ce-5bf7b0ffa350 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:53:57.213463 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-895517c7-d7d9-483c-b980-e2da2852c7a4 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/065fbd75-3cb8-44d9-86ce-5bf7b0ffa350" status: 404 len: 111 microversion: 2.1 time: 0.031792 Sep 23 05:53:57.213463 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3892/7970] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:53:57 2022] GET /compute/v2.1/servers/065fbd75-3cb8-44d9-86ce-5bf7b0ffa350 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 05:54:01.038156 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-124773c8-a7e9-43ea-9c6d-e3d7e5409907 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '.version_select at 0x7ff1ba9491f0>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:54:01.113565 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-124773c8-a7e9-43ea-9c6d-e3d7e5409907 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1508617881" status: 202 len: 0 microversion: 2.1 time: 0.079448 Sep 23 05:54:01.114198 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4079/7971] 10.222.0.33 () {58 vars in 1284 bytes} [Fri Sep 23 05:54:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1508617881 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 05:54:01.147043 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-96e0e255-90da-412f-a11b-079bee72c90d tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Action: 'create', calling method: .version_select at 0x7ff1b86103a0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1394391733", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFBdAcbsKiU+BzKhUW9+mOUdi7itEJAcBNlxPX9CIPi5/jKx0p8wzFzaBfjQwaVbvY18fefvrXvr8KUb8KORIub7Bpp9A9dalNm79Gv6nDsr+TH/itygSPA9Rwpz8VBGAw=="}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:54:01.164227 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-96e0e255-90da-412f-a11b-079bee72c90d tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Getting quotas for project 498fb069adef49d19ed802d2133adb89. Resources: {'key_pairs'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 05:54:01.170176 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-96e0e255-90da-412f-a11b-079bee72c90d tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Getting quotas for user e9d36972d8f2413b8838e64998b43359 and project 498fb069adef49d19ed802d2133adb89. Resources: {'key_pairs'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 05:54:01.291340 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-96e0e255-90da-412f-a11b-079bee72c90d tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.148320 Sep 23 05:54:01.292388 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3893/7972] 10.222.0.33 () {60 vars in 1159 bytes} [Fri Sep 23 05:54:01 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:54:08.870175 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:54:08.874534 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-53e87095-0897-4dfe-908d-4c7d2bfc1865 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-622011862", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "networks": [{"uuid": "15c61417-d5e7-4aef-a2a7-f0113d41b4d6"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1394391733", "security_groups": [{"name": "tempest-secgroup-smoke-209343703"}]}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:54:08.994770 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.neutron [None req-53e87095-0897-4dfe-908d-4c7d2bfc1865 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] validate_networks() for [('15c61417-d5e7-4aef-a2a7-f0113d41b4d6', None, None, None, None, None)] {{(pid=122699) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 05:54:09.460748 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-53e87095-0897-4dfe-908d-4c7d2bfc1865 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Flavor limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 05:54:09.461201 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-53e87095-0897-4dfe-908d-4c7d2bfc1865 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Image limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 05:54:09.461680 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-53e87095-0897-4dfe-908d-4c7d2bfc1865 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Flavor pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 05:54:09.462121 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-53e87095-0897-4dfe-908d-4c7d2bfc1865 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Image pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 05:54:09.462542 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-53e87095-0897-4dfe-908d-4c7d2bfc1865 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 05:54:09.471825 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-53e87095-0897-4dfe-908d-4c7d2bfc1865 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:54:09.472320 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-53e87095-0897-4dfe-908d-4c7d2bfc1865 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:54:09.472761 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-53e87095-0897-4dfe-908d-4c7d2bfc1865 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:54:09.473532 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-53e87095-0897-4dfe-908d-4c7d2bfc1865 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:54:09.474473 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-53e87095-0897-4dfe-908d-4c7d2bfc1865 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:54:09.474914 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-53e87095-0897-4dfe-908d-4c7d2bfc1865 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:54:09.492965 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-53e87095-0897-4dfe-908d-4c7d2bfc1865 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Getting quotas for project 498fb069adef49d19ed802d2133adb89. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 05:54:09.498819 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-53e87095-0897-4dfe-908d-4c7d2bfc1865 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Getting quotas for user e9d36972d8f2413b8838e64998b43359 and project 498fb069adef49d19ed802d2133adb89. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 05:54:09.511889 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-53e87095-0897-4dfe-908d-4c7d2bfc1865 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Going to run 1 instances... {{(pid=122699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 05:54:09.514316 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-53e87095-0897-4dfe-908d-4c7d2bfc1865 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: d70836ba-1790-4a2f-95f4-cb7c8ec6dda3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 05:54:09.625440 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-53e87095-0897-4dfe-908d-4c7d2bfc1865 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.756833 Sep 23 05:54:09.632755 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4080/7973] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 05:54:08 2022] POST /compute/v2.1/servers => generated 405 bytes in 758 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 05:54:09.638142 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-21d4d88e-f916-447a-affb-d47d94ec0a88 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:54:09.638961 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-21d4d88e-f916-447a-affb-d47d94ec0a88 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: d70836ba-1790-4a2f-95f4-cb7c8ec6dda3] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:54:09.641954 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=16 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:54:09.704478 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-21d4d88e-f916-447a-affb-d47d94ec0a88 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:54:09.711880 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-21d4d88e-f916-447a-affb-d47d94ec0a88 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/d70836ba-1790-4a2f-95f4-cb7c8ec6dda3" status: 200 len: 1266 microversion: 2.1 time: 0.077848 Sep 23 05:54:09.712394 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3894/7974] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:54:09 2022] GET /compute/v2.1/servers/d70836ba-1790-4a2f-95f4-cb7c8ec6dda3 => generated 1266 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 05:54:10.736900 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-61b6f472-f393-4067-8a99-8a9441ae5200 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:54:10.737526 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-61b6f472-f393-4067-8a99-8a9441ae5200 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: d70836ba-1790-4a2f-95f4-cb7c8ec6dda3] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:54:10.791673 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-61b6f472-f393-4067-8a99-8a9441ae5200 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:54:10.799332 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-61b6f472-f393-4067-8a99-8a9441ae5200 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/d70836ba-1790-4a2f-95f4-cb7c8ec6dda3" status: 200 len: 1266 microversion: 2.1 time: 0.066804 Sep 23 05:54:10.799947 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4081/7975] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:54:10 2022] GET /compute/v2.1/servers/d70836ba-1790-4a2f-95f4-cb7c8ec6dda3 => generated 1266 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:54:11.823304 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3f6fb8dd-dcf5-4d5f-b42f-f67c40abf7b1 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:54:11.824109 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3f6fb8dd-dcf5-4d5f-b42f-f67c40abf7b1 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: d70836ba-1790-4a2f-95f4-cb7c8ec6dda3] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:54:11.881187 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-3f6fb8dd-dcf5-4d5f-b42f-f67c40abf7b1 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:54:11.889358 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3f6fb8dd-dcf5-4d5f-b42f-f67c40abf7b1 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/d70836ba-1790-4a2f-95f4-cb7c8ec6dda3" status: 200 len: 1266 microversion: 2.1 time: 0.070022 Sep 23 05:54:11.890085 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3895/7976] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:54:11 2022] GET /compute/v2.1/servers/d70836ba-1790-4a2f-95f4-cb7c8ec6dda3 => generated 1266 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:54:12.912752 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-46395fa9-3515-4136-9a46-48b8bcf49866 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:54:12.913361 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-46395fa9-3515-4136-9a46-48b8bcf49866 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: d70836ba-1790-4a2f-95f4-cb7c8ec6dda3] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:54:12.968009 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-46395fa9-3515-4136-9a46-48b8bcf49866 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:54:12.975098 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-46395fa9-3515-4136-9a46-48b8bcf49866 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/d70836ba-1790-4a2f-95f4-cb7c8ec6dda3" status: 200 len: 1266 microversion: 2.1 time: 0.066375 Sep 23 05:54:12.975789 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4082/7977] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:54:12 2022] GET /compute/v2.1/servers/d70836ba-1790-4a2f-95f4-cb7c8ec6dda3 => generated 1266 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:54:13.998061 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3738706f-8480-4556-a4e7-bca28edc94c3 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:54:13.998727 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3738706f-8480-4556-a4e7-bca28edc94c3 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: d70836ba-1790-4a2f-95f4-cb7c8ec6dda3] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:54:14.005569 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3738706f-8480-4556-a4e7-bca28edc94c3 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:54:14.006121 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3738706f-8480-4556-a4e7-bca28edc94c3 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:54:14.006579 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3738706f-8480-4556-a4e7-bca28edc94c3 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:54:14.007301 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3738706f-8480-4556-a4e7-bca28edc94c3 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:54:14.007778 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3738706f-8480-4556-a4e7-bca28edc94c3 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:54:14.008223 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3738706f-8480-4556-a4e7-bca28edc94c3 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:54:14.075236 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-3738706f-8480-4556-a4e7-bca28edc94c3 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:54:14.083030 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3738706f-8480-4556-a4e7-bca28edc94c3 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/d70836ba-1790-4a2f-95f4-cb7c8ec6dda3" status: 200 len: 1270 microversion: 2.1 time: 0.089537 Sep 23 05:54:14.083613 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3896/7978] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:54:13 2022] GET /compute/v2.1/servers/d70836ba-1790-4a2f-95f4-cb7c8ec6dda3 => generated 1270 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:54:15.107199 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a2320bb7-5b1d-49b6-ae48-e5823ee13b43 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:54:15.107823 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a2320bb7-5b1d-49b6-ae48-e5823ee13b43 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: d70836ba-1790-4a2f-95f4-cb7c8ec6dda3] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:54:15.115295 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a2320bb7-5b1d-49b6-ae48-e5823ee13b43 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:54:15.115797 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a2320bb7-5b1d-49b6-ae48-e5823ee13b43 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:54:15.116241 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a2320bb7-5b1d-49b6-ae48-e5823ee13b43 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:54:15.116978 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a2320bb7-5b1d-49b6-ae48-e5823ee13b43 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:54:15.117698 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a2320bb7-5b1d-49b6-ae48-e5823ee13b43 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:54:15.118283 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a2320bb7-5b1d-49b6-ae48-e5823ee13b43 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:54:15.183865 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a2320bb7-5b1d-49b6-ae48-e5823ee13b43 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:54:15.191548 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a2320bb7-5b1d-49b6-ae48-e5823ee13b43 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/d70836ba-1790-4a2f-95f4-cb7c8ec6dda3" status: 200 len: 1318 microversion: 2.1 time: 0.089044 Sep 23 05:54:15.192123 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4083/7979] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:54:15 2022] GET /compute/v2.1/servers/d70836ba-1790-4a2f-95f4-cb7c8ec6dda3 => generated 1318 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:54:16.216543 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-61d2a116-9269-4a59-ace8-153e8bd256c8 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:54:16.217206 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-61d2a116-9269-4a59-ace8-153e8bd256c8 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: d70836ba-1790-4a2f-95f4-cb7c8ec6dda3] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:54:16.224234 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-61d2a116-9269-4a59-ace8-153e8bd256c8 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:54:16.224762 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-61d2a116-9269-4a59-ace8-153e8bd256c8 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:54:16.225232 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-61d2a116-9269-4a59-ace8-153e8bd256c8 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:54:16.226002 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-61d2a116-9269-4a59-ace8-153e8bd256c8 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:54:16.226492 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-61d2a116-9269-4a59-ace8-153e8bd256c8 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:54:16.226949 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-61d2a116-9269-4a59-ace8-153e8bd256c8 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:54:16.381628 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-61d2a116-9269-4a59-ace8-153e8bd256c8 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:54:16.390683 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-61d2a116-9269-4a59-ace8-153e8bd256c8 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/d70836ba-1790-4a2f-95f4-cb7c8ec6dda3" status: 200 len: 1391 microversion: 2.1 time: 0.179727 Sep 23 05:54:16.392076 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3897/7980] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:54:16 2022] GET /compute/v2.1/servers/d70836ba-1790-4a2f-95f4-cb7c8ec6dda3 => generated 1391 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:54:17.106683 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-b4879ae0-c31d-4375-bb4c-c447cfa6de6f req-146125a6-e930-4adb-8b90-a301803d040c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d70836ba-1790-4a2f-95f4-cb7c8ec6dda3", "tag": "890c0b29-38d3-4d1b-a7a2-a536691d78f9"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:54:17.117247 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-b4879ae0-c31d-4375-bb4c-c447cfa6de6f req-146125a6-e930-4adb-8b90-a301803d040c service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:54:17.117728 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-b4879ae0-c31d-4375-bb4c-c447cfa6de6f req-146125a6-e930-4adb-8b90-a301803d040c service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:54:17.118209 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-b4879ae0-c31d-4375-bb4c-c447cfa6de6f req-146125a6-e930-4adb-8b90-a301803d040c service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:54:17.129800 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-b4879ae0-c31d-4375-bb4c-c447cfa6de6f req-146125a6-e930-4adb-8b90-a301803d040c service nova] Creating event network-changed:890c0b29-38d3-4d1b-a7a2-a536691d78f9 for instance d70836ba-1790-4a2f-95f4-cb7c8ec6dda3 on n-h2-846463-3 Sep 23 05:54:17.135330 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-b4879ae0-c31d-4375-bb4c-c447cfa6de6f req-146125a6-e930-4adb-8b90-a301803d040c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034052 Sep 23 05:54:17.135945 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4084/7981] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:54:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:54:17.421085 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0af1488f-2e5a-42df-a3a6-cc3fc77c283b tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:54:17.424082 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-0af1488f-2e5a-42df-a3a6-cc3fc77c283b tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: d70836ba-1790-4a2f-95f4-cb7c8ec6dda3] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:54:17.429964 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0af1488f-2e5a-42df-a3a6-cc3fc77c283b tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:54:17.430477 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0af1488f-2e5a-42df-a3a6-cc3fc77c283b tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:54:17.430960 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0af1488f-2e5a-42df-a3a6-cc3fc77c283b tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:54:17.432050 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0af1488f-2e5a-42df-a3a6-cc3fc77c283b tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:54:17.432531 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0af1488f-2e5a-42df-a3a6-cc3fc77c283b tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:54:17.432979 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0af1488f-2e5a-42df-a3a6-cc3fc77c283b tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:54:17.574456 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-0af1488f-2e5a-42df-a3a6-cc3fc77c283b tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:54:17.583844 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0af1488f-2e5a-42df-a3a6-cc3fc77c283b tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/d70836ba-1790-4a2f-95f4-cb7c8ec6dda3" status: 200 len: 1391 microversion: 2.1 time: 0.171553 Sep 23 05:54:17.584469 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3898/7982] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:54:17 2022] GET /compute/v2.1/servers/d70836ba-1790-4a2f-95f4-cb7c8ec6dda3 => generated 1391 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:54:18.608264 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-40c5f3ec-6189-4616-8e21-1761f4d23bea tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:54:18.608975 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-40c5f3ec-6189-4616-8e21-1761f4d23bea tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: d70836ba-1790-4a2f-95f4-cb7c8ec6dda3] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:54:18.615289 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-40c5f3ec-6189-4616-8e21-1761f4d23bea tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:54:18.615787 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-40c5f3ec-6189-4616-8e21-1761f4d23bea tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:54:18.616234 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-40c5f3ec-6189-4616-8e21-1761f4d23bea tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:54:18.616936 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-40c5f3ec-6189-4616-8e21-1761f4d23bea tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:54:18.617399 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-40c5f3ec-6189-4616-8e21-1761f4d23bea tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:54:18.617831 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-40c5f3ec-6189-4616-8e21-1761f4d23bea tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:54:18.748950 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-40c5f3ec-6189-4616-8e21-1761f4d23bea tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:54:18.756650 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-40c5f3ec-6189-4616-8e21-1761f4d23bea tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/d70836ba-1790-4a2f-95f4-cb7c8ec6dda3" status: 200 len: 1391 microversion: 2.1 time: 0.153801 Sep 23 05:54:18.757231 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4085/7983] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:54:18 2022] GET /compute/v2.1/servers/d70836ba-1790-4a2f-95f4-cb7c8ec6dda3 => generated 1391 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:54:19.780406 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b3e5869f-435e-4b38-8b7a-96c3b41bc863 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:54:19.781041 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b3e5869f-435e-4b38-8b7a-96c3b41bc863 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: d70836ba-1790-4a2f-95f4-cb7c8ec6dda3] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:54:19.788045 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b3e5869f-435e-4b38-8b7a-96c3b41bc863 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:54:19.788558 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b3e5869f-435e-4b38-8b7a-96c3b41bc863 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:54:19.789022 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b3e5869f-435e-4b38-8b7a-96c3b41bc863 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:54:19.789741 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b3e5869f-435e-4b38-8b7a-96c3b41bc863 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:54:19.790246 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b3e5869f-435e-4b38-8b7a-96c3b41bc863 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:54:19.790697 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b3e5869f-435e-4b38-8b7a-96c3b41bc863 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:54:19.924944 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b3e5869f-435e-4b38-8b7a-96c3b41bc863 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:54:19.932722 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b3e5869f-435e-4b38-8b7a-96c3b41bc863 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/d70836ba-1790-4a2f-95f4-cb7c8ec6dda3" status: 200 len: 1391 microversion: 2.1 time: 0.156268 Sep 23 05:54:19.933318 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3899/7984] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:54:19 2022] GET /compute/v2.1/servers/d70836ba-1790-4a2f-95f4-cb7c8ec6dda3 => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:54:20.956877 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ca3d3810-bab6-4b33-b1ab-5a71a2d494ff tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:54:20.957497 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ca3d3810-bab6-4b33-b1ab-5a71a2d494ff tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: d70836ba-1790-4a2f-95f4-cb7c8ec6dda3] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:54:20.959499 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:54:20.964766 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ca3d3810-bab6-4b33-b1ab-5a71a2d494ff tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:54:20.965257 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ca3d3810-bab6-4b33-b1ab-5a71a2d494ff tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:54:20.965781 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ca3d3810-bab6-4b33-b1ab-5a71a2d494ff tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:54:20.966499 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ca3d3810-bab6-4b33-b1ab-5a71a2d494ff tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:54:20.966997 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ca3d3810-bab6-4b33-b1ab-5a71a2d494ff tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:54:20.967425 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ca3d3810-bab6-4b33-b1ab-5a71a2d494ff tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:54:21.104526 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ca3d3810-bab6-4b33-b1ab-5a71a2d494ff tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:54:21.112821 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ca3d3810-bab6-4b33-b1ab-5a71a2d494ff tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/d70836ba-1790-4a2f-95f4-cb7c8ec6dda3" status: 200 len: 1391 microversion: 2.1 time: 0.159910 Sep 23 05:54:21.113386 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4086/7985] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:54:20 2022] GET /compute/v2.1/servers/d70836ba-1790-4a2f-95f4-cb7c8ec6dda3 => generated 1391 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:54:22.137008 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-754e59e3-9ed6-4ba0-b651-14eeaac330fb tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:54:22.138206 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-754e59e3-9ed6-4ba0-b651-14eeaac330fb tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: d70836ba-1790-4a2f-95f4-cb7c8ec6dda3] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:54:22.141972 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=8 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:54:22.145612 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-754e59e3-9ed6-4ba0-b651-14eeaac330fb tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:54:22.146157 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-754e59e3-9ed6-4ba0-b651-14eeaac330fb tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:54:22.146616 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-754e59e3-9ed6-4ba0-b651-14eeaac330fb tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:54:22.147589 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-754e59e3-9ed6-4ba0-b651-14eeaac330fb tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:54:22.148110 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-754e59e3-9ed6-4ba0-b651-14eeaac330fb tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:54:22.148555 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-754e59e3-9ed6-4ba0-b651-14eeaac330fb tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:54:22.282970 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-754e59e3-9ed6-4ba0-b651-14eeaac330fb tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:54:22.291942 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-754e59e3-9ed6-4ba0-b651-14eeaac330fb tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/d70836ba-1790-4a2f-95f4-cb7c8ec6dda3" status: 200 len: 1391 microversion: 2.1 time: 0.159151 Sep 23 05:54:22.292535 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3900/7986] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:54:22 2022] GET /compute/v2.1/servers/d70836ba-1790-4a2f-95f4-cb7c8ec6dda3 => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:54:23.315271 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-44d65121-c27a-4883-b9e6-e2955376881d tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:54:23.315887 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-44d65121-c27a-4883-b9e6-e2955376881d tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: d70836ba-1790-4a2f-95f4-cb7c8ec6dda3] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:54:23.318350 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=10 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:54:23.323226 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-44d65121-c27a-4883-b9e6-e2955376881d tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:54:23.323731 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-44d65121-c27a-4883-b9e6-e2955376881d tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:54:23.324176 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-44d65121-c27a-4883-b9e6-e2955376881d tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:54:23.324935 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-44d65121-c27a-4883-b9e6-e2955376881d tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:54:23.325397 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-44d65121-c27a-4883-b9e6-e2955376881d tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:54:23.325827 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-44d65121-c27a-4883-b9e6-e2955376881d tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:54:23.465399 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-44d65121-c27a-4883-b9e6-e2955376881d tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:54:23.474252 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-44d65121-c27a-4883-b9e6-e2955376881d tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/d70836ba-1790-4a2f-95f4-cb7c8ec6dda3" status: 200 len: 1391 microversion: 2.1 time: 0.162850 Sep 23 05:54:23.474839 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4087/7987] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:54:23 2022] GET /compute/v2.1/servers/d70836ba-1790-4a2f-95f4-cb7c8ec6dda3 => generated 1391 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:54:23.896558 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-f92ecde7-65b5-48c9-bbbf-456d37876ea1 req-e103e058-8a10-4aac-8f9e-2a0029a6eefa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d70836ba-1790-4a2f-95f4-cb7c8ec6dda3", "name": "network-vif-plugged", "status": "completed", "tag": "890c0b29-38d3-4d1b-a7a2-a536691d78f9"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:54:23.902538 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:54:23.907753 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-f92ecde7-65b5-48c9-bbbf-456d37876ea1 req-e103e058-8a10-4aac-8f9e-2a0029a6eefa service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:54:23.908277 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-f92ecde7-65b5-48c9-bbbf-456d37876ea1 req-e103e058-8a10-4aac-8f9e-2a0029a6eefa service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:54:23.908725 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-f92ecde7-65b5-48c9-bbbf-456d37876ea1 req-e103e058-8a10-4aac-8f9e-2a0029a6eefa service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:54:23.919880 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-f92ecde7-65b5-48c9-bbbf-456d37876ea1 req-e103e058-8a10-4aac-8f9e-2a0029a6eefa service nova] Creating event network-vif-plugged:890c0b29-38d3-4d1b-a7a2-a536691d78f9 for instance d70836ba-1790-4a2f-95f4-cb7c8ec6dda3 on n-h2-846463-3 Sep 23 05:54:23.925039 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-f92ecde7-65b5-48c9-bbbf-456d37876ea1 req-e103e058-8a10-4aac-8f9e-2a0029a6eefa service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035696 Sep 23 05:54:23.925643 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3901/7988] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:54:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:54:24.498233 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2380d768-b371-44b7-9359-237283f23b65 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:54:24.498848 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-2380d768-b371-44b7-9359-237283f23b65 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: d70836ba-1790-4a2f-95f4-cb7c8ec6dda3] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:54:24.501182 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:54:24.506001 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2380d768-b371-44b7-9359-237283f23b65 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:54:24.506496 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2380d768-b371-44b7-9359-237283f23b65 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:54:24.506935 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2380d768-b371-44b7-9359-237283f23b65 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:54:24.507629 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2380d768-b371-44b7-9359-237283f23b65 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:54:24.508085 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2380d768-b371-44b7-9359-237283f23b65 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:54:24.508508 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2380d768-b371-44b7-9359-237283f23b65 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:54:24.640031 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2380d768-b371-44b7-9359-237283f23b65 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:54:24.647915 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2380d768-b371-44b7-9359-237283f23b65 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/d70836ba-1790-4a2f-95f4-cb7c8ec6dda3" status: 200 len: 1391 microversion: 2.1 time: 0.154154 Sep 23 05:54:24.648498 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4088/7989] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:54:24 2022] GET /compute/v2.1/servers/d70836ba-1790-4a2f-95f4-cb7c8ec6dda3 => generated 1391 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:54:25.673427 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1be9d1ca-f58f-40c8-8f66-e1c689c055b4 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:54:25.674167 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-1be9d1ca-f58f-40c8-8f66-e1c689c055b4 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: d70836ba-1790-4a2f-95f4-cb7c8ec6dda3] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:54:25.680799 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1be9d1ca-f58f-40c8-8f66-e1c689c055b4 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:54:25.681291 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1be9d1ca-f58f-40c8-8f66-e1c689c055b4 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:54:25.681738 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1be9d1ca-f58f-40c8-8f66-e1c689c055b4 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:54:25.682471 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1be9d1ca-f58f-40c8-8f66-e1c689c055b4 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:54:25.682943 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1be9d1ca-f58f-40c8-8f66-e1c689c055b4 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:54:25.683382 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1be9d1ca-f58f-40c8-8f66-e1c689c055b4 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:54:25.820383 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-1be9d1ca-f58f-40c8-8f66-e1c689c055b4 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:54:25.828144 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-1be9d1ca-f58f-40c8-8f66-e1c689c055b4 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/d70836ba-1790-4a2f-95f4-cb7c8ec6dda3" status: 200 len: 1562 microversion: 2.1 time: 0.160390 Sep 23 05:54:25.828724 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3902/7990] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:54:25 2022] GET /compute/v2.1/servers/d70836ba-1790-4a2f-95f4-cb7c8ec6dda3 => generated 1562 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:54:25.850366 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e400fd83-c7bc-4d11-a6d1-64c56a993d1d tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:54:25.851003 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e400fd83-c7bc-4d11-a6d1-64c56a993d1d tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: d70836ba-1790-4a2f-95f4-cb7c8ec6dda3] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:54:25.857933 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e400fd83-c7bc-4d11-a6d1-64c56a993d1d tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:54:25.858441 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e400fd83-c7bc-4d11-a6d1-64c56a993d1d tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:54:25.858890 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e400fd83-c7bc-4d11-a6d1-64c56a993d1d tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:54:25.859590 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e400fd83-c7bc-4d11-a6d1-64c56a993d1d tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:54:25.860061 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e400fd83-c7bc-4d11-a6d1-64c56a993d1d tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:54:25.860499 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e400fd83-c7bc-4d11-a6d1-64c56a993d1d tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:54:25.989342 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e400fd83-c7bc-4d11-a6d1-64c56a993d1d tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:54:25.997164 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e400fd83-c7bc-4d11-a6d1-64c56a993d1d tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/d70836ba-1790-4a2f-95f4-cb7c8ec6dda3" status: 200 len: 1562 microversion: 2.1 time: 0.150706 Sep 23 05:54:25.997790 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4089/7991] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:54:25 2022] GET /compute/v2.1/servers/d70836ba-1790-4a2f-95f4-cb7c8ec6dda3 => generated 1562 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:54:28.189335 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-07f99968-a2e4-4953-be18-fdb5e33f099b req-9dc3c70a-01db-4cb9-af72-9750351523dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d70836ba-1790-4a2f-95f4-cb7c8ec6dda3", "tag": "890c0b29-38d3-4d1b-a7a2-a536691d78f9"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:54:28.193108 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-af7e6411-4643-480e-b7d3-161e291747af tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:54:28.193742 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-af7e6411-4643-480e-b7d3-161e291747af tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: d70836ba-1790-4a2f-95f4-cb7c8ec6dda3] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:54:28.200296 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-af7e6411-4643-480e-b7d3-161e291747af tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:54:28.200902 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-af7e6411-4643-480e-b7d3-161e291747af tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:54:28.201355 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-af7e6411-4643-480e-b7d3-161e291747af tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:54:28.208263 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-af7e6411-4643-480e-b7d3-161e291747af tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:54:28.208882 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-af7e6411-4643-480e-b7d3-161e291747af tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:54:28.209251 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-af7e6411-4643-480e-b7d3-161e291747af tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:54:28.212385 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-07f99968-a2e4-4953-be18-fdb5e33f099b req-9dc3c70a-01db-4cb9-af72-9750351523dc service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:54:28.212888 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-07f99968-a2e4-4953-be18-fdb5e33f099b req-9dc3c70a-01db-4cb9-af72-9750351523dc service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:54:28.213335 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-07f99968-a2e4-4953-be18-fdb5e33f099b req-9dc3c70a-01db-4cb9-af72-9750351523dc service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:54:28.228208 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-07f99968-a2e4-4953-be18-fdb5e33f099b req-9dc3c70a-01db-4cb9-af72-9750351523dc service nova] Creating event network-changed:890c0b29-38d3-4d1b-a7a2-a536691d78f9 for instance d70836ba-1790-4a2f-95f4-cb7c8ec6dda3 on n-h2-846463-3 Sep 23 05:54:28.234344 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-07f99968-a2e4-4953-be18-fdb5e33f099b req-9dc3c70a-01db-4cb9-af72-9750351523dc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049133 Sep 23 05:54:28.237238 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4090/7992] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:54:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:54:28.358379 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-af7e6411-4643-480e-b7d3-161e291747af tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:54:28.367547 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-af7e6411-4643-480e-b7d3-161e291747af tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/d70836ba-1790-4a2f-95f4-cb7c8ec6dda3" status: 200 len: 1562 microversion: 2.1 time: 0.184643 Sep 23 05:54:28.368573 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3903/7993] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:54:28 2022] GET /compute/v2.1/servers/d70836ba-1790-4a2f-95f4-cb7c8ec6dda3 => generated 1562 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:54:49.617828 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ca4cafd7-0b0b-48c4-a6b3-385e4fb68947 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:54:49.620158 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ca4cafd7-0b0b-48c4-a6b3-385e4fb68947 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: d70836ba-1790-4a2f-95f4-cb7c8ec6dda3] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:54:49.623047 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=5 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:54:49.623706 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=42 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:54:49.628685 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ca4cafd7-0b0b-48c4-a6b3-385e4fb68947 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:54:49.629190 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ca4cafd7-0b0b-48c4-a6b3-385e4fb68947 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:54:49.629640 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ca4cafd7-0b0b-48c4-a6b3-385e4fb68947 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:54:49.630397 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ca4cafd7-0b0b-48c4-a6b3-385e4fb68947 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:54:49.630868 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ca4cafd7-0b0b-48c4-a6b3-385e4fb68947 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:54:49.631321 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ca4cafd7-0b0b-48c4-a6b3-385e4fb68947 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:54:49.695019 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ca4cafd7-0b0b-48c4-a6b3-385e4fb68947 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "POST /compute/v2.1/servers/d70836ba-1790-4a2f-95f4-cb7c8ec6dda3/action" status: 200 len: 24574 microversion: 2.1 time: 0.081451 Sep 23 05:54:49.695970 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4091/7994] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 05:54:49 2022] POST /compute/v2.1/servers/d70836ba-1790-4a2f-95f4-cb7c8ec6dda3/action => generated 24574 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 05:55:00.767372 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-88becd09-9709-4a13-8c90-b8bd2ccd394f tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:55:00.767982 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-88becd09-9709-4a13-8c90-b8bd2ccd394f tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: d70836ba-1790-4a2f-95f4-cb7c8ec6dda3] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:55:00.770058 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=5 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:55:00.770800 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=44 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:55:00.775796 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-88becd09-9709-4a13-8c90-b8bd2ccd394f tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:55:00.776302 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-88becd09-9709-4a13-8c90-b8bd2ccd394f tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:55:00.776763 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-88becd09-9709-4a13-8c90-b8bd2ccd394f tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:55:00.777474 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-88becd09-9709-4a13-8c90-b8bd2ccd394f tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:55:00.777975 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-88becd09-9709-4a13-8c90-b8bd2ccd394f tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:55:00.778423 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-88becd09-9709-4a13-8c90-b8bd2ccd394f tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:55:00.801788 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-88becd09-9709-4a13-8c90-b8bd2ccd394f tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lazy-loading 'flavor' on Instance uuid d70836ba-1790-4a2f-95f4-cb7c8ec6dda3 {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 05:55:01.047443 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-88becd09-9709-4a13-8c90-b8bd2ccd394f tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "POST /compute/v2.1/servers/d70836ba-1790-4a2f-95f4-cb7c8ec6dda3/action" status: 202 len: 0 microversion: 2.1 time: 0.283973 Sep 23 05:55:01.048086 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3904/7995] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 05:55:00 2022] POST /compute/v2.1/servers/d70836ba-1790-4a2f-95f4-cb7c8ec6dda3/action => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 05:55:01.057158 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1f03842a-aa2e-4b56-99e5-4413ad58c608 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:55:01.057872 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1f03842a-aa2e-4b56-99e5-4413ad58c608 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: d70836ba-1790-4a2f-95f4-cb7c8ec6dda3] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:55:01.061004 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:55:01.061665 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=4 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:55:01.066665 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1f03842a-aa2e-4b56-99e5-4413ad58c608 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:55:01.067161 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1f03842a-aa2e-4b56-99e5-4413ad58c608 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:55:01.067609 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1f03842a-aa2e-4b56-99e5-4413ad58c608 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:55:01.068319 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1f03842a-aa2e-4b56-99e5-4413ad58c608 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:55:01.068780 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1f03842a-aa2e-4b56-99e5-4413ad58c608 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:55:01.069241 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1f03842a-aa2e-4b56-99e5-4413ad58c608 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:55:01.206636 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1f03842a-aa2e-4b56-99e5-4413ad58c608 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:55:01.214781 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1f03842a-aa2e-4b56-99e5-4413ad58c608 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/d70836ba-1790-4a2f-95f4-cb7c8ec6dda3" status: 200 len: 1689 microversion: 2.1 time: 0.161962 Sep 23 05:55:01.215356 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4092/7996] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:55:01 2022] GET /compute/v2.1/servers/d70836ba-1790-4a2f-95f4-cb7c8ec6dda3 => generated 1689 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:55:02.240761 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3c1482e2-2274-4a77-80f2-33a94e32b251 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:55:02.241487 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3c1482e2-2274-4a77-80f2-33a94e32b251 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: d70836ba-1790-4a2f-95f4-cb7c8ec6dda3] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:55:02.248240 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3c1482e2-2274-4a77-80f2-33a94e32b251 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:55:02.248707 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3c1482e2-2274-4a77-80f2-33a94e32b251 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:55:02.249164 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3c1482e2-2274-4a77-80f2-33a94e32b251 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:55:02.249874 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3c1482e2-2274-4a77-80f2-33a94e32b251 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:55:02.250387 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3c1482e2-2274-4a77-80f2-33a94e32b251 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:55:02.250831 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3c1482e2-2274-4a77-80f2-33a94e32b251 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:55:02.388382 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-3c1482e2-2274-4a77-80f2-33a94e32b251 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:55:02.392949 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3c1482e2-2274-4a77-80f2-33a94e32b251 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/d70836ba-1790-4a2f-95f4-cb7c8ec6dda3" status: 200 len: 1672 microversion: 2.1 time: 0.157587 Sep 23 05:55:02.393528 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3905/7997] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:55:02 2022] GET /compute/v2.1/servers/d70836ba-1790-4a2f-95f4-cb7c8ec6dda3 => generated 1672 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:55:03.490796 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6404749f-2491-49fe-a377-46a26c8ccfd9 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:55:03.492990 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-6404749f-2491-49fe-a377-46a26c8ccfd9 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: d70836ba-1790-4a2f-95f4-cb7c8ec6dda3] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:55:03.500061 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6404749f-2491-49fe-a377-46a26c8ccfd9 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:55:03.500542 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6404749f-2491-49fe-a377-46a26c8ccfd9 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:55:03.501006 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6404749f-2491-49fe-a377-46a26c8ccfd9 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:55:03.501749 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6404749f-2491-49fe-a377-46a26c8ccfd9 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:55:03.502181 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6404749f-2491-49fe-a377-46a26c8ccfd9 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:55:03.502628 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6404749f-2491-49fe-a377-46a26c8ccfd9 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:55:03.552985 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6404749f-2491-49fe-a377-46a26c8ccfd9 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "POST /compute/v2.1/servers/d70836ba-1790-4a2f-95f4-cb7c8ec6dda3/action" status: 200 len: 38462 microversion: 2.1 time: 0.066095 Sep 23 05:55:03.553616 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4093/7998] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 05:55:03 2022] POST /compute/v2.1/servers/d70836ba-1790-4a2f-95f4-cb7c8ec6dda3/action => generated 38462 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 05:55:03.565923 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9c245baa-0daa-4a98-a5e7-68ce83a123ce tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:55:03.566490 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-9c245baa-0daa-4a98-a5e7-68ce83a123ce tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: d70836ba-1790-4a2f-95f4-cb7c8ec6dda3] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:55:03.573317 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9c245baa-0daa-4a98-a5e7-68ce83a123ce tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:55:03.573823 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9c245baa-0daa-4a98-a5e7-68ce83a123ce tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:55:03.574311 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9c245baa-0daa-4a98-a5e7-68ce83a123ce tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:55:03.575023 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9c245baa-0daa-4a98-a5e7-68ce83a123ce tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:55:03.575501 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9c245baa-0daa-4a98-a5e7-68ce83a123ce tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:55:03.575948 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9c245baa-0daa-4a98-a5e7-68ce83a123ce tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:55:03.789281 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9c245baa-0daa-4a98-a5e7-68ce83a123ce tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "POST /compute/v2.1/servers/d70836ba-1790-4a2f-95f4-cb7c8ec6dda3/action" status: 202 len: 0 microversion: 2.1 time: 0.226960 Sep 23 05:55:03.790093 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3906/7999] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 05:55:03 2022] POST /compute/v2.1/servers/d70836ba-1790-4a2f-95f4-cb7c8ec6dda3/action => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 23 05:55:03.799348 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-67d54805-fae8-4c70-b571-c3191129c440 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:55:03.800060 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-67d54805-fae8-4c70-b571-c3191129c440 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: d70836ba-1790-4a2f-95f4-cb7c8ec6dda3] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:55:03.807138 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-67d54805-fae8-4c70-b571-c3191129c440 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:55:03.807628 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-67d54805-fae8-4c70-b571-c3191129c440 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:55:03.808067 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-67d54805-fae8-4c70-b571-c3191129c440 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:55:03.808757 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-67d54805-fae8-4c70-b571-c3191129c440 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:55:03.809214 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-67d54805-fae8-4c70-b571-c3191129c440 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:55:03.809641 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-67d54805-fae8-4c70-b571-c3191129c440 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:55:03.949469 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-67d54805-fae8-4c70-b571-c3191129c440 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:55:03.958175 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-67d54805-fae8-4c70-b571-c3191129c440 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/d70836ba-1790-4a2f-95f4-cb7c8ec6dda3" status: 200 len: 1678 microversion: 2.1 time: 0.163551 Sep 23 05:55:03.958753 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4094/8000] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:55:03 2022] GET /compute/v2.1/servers/d70836ba-1790-4a2f-95f4-cb7c8ec6dda3 => generated 1678 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:55:04.983958 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8507d7f5-34f8-4266-a664-070ebcbfcfc6 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:55:04.984677 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8507d7f5-34f8-4266-a664-070ebcbfcfc6 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: d70836ba-1790-4a2f-95f4-cb7c8ec6dda3] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:55:04.990804 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8507d7f5-34f8-4266-a664-070ebcbfcfc6 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:55:04.991308 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8507d7f5-34f8-4266-a664-070ebcbfcfc6 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:55:04.991764 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8507d7f5-34f8-4266-a664-070ebcbfcfc6 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:55:04.992466 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8507d7f5-34f8-4266-a664-070ebcbfcfc6 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:55:04.992937 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8507d7f5-34f8-4266-a664-070ebcbfcfc6 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:55:04.993378 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8507d7f5-34f8-4266-a664-070ebcbfcfc6 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:55:05.124390 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8507d7f5-34f8-4266-a664-070ebcbfcfc6 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:55:05.132992 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8507d7f5-34f8-4266-a664-070ebcbfcfc6 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/d70836ba-1790-4a2f-95f4-cb7c8ec6dda3" status: 200 len: 1678 microversion: 2.1 time: 0.154867 Sep 23 05:55:05.133571 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3907/8001] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:55:04 2022] GET /compute/v2.1/servers/d70836ba-1790-4a2f-95f4-cb7c8ec6dda3 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:55:06.156613 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-aed35ae5-9f53-46e8-9d3d-71a92515328b tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:55:06.157234 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-aed35ae5-9f53-46e8-9d3d-71a92515328b tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: d70836ba-1790-4a2f-95f4-cb7c8ec6dda3] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:55:06.163843 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aed35ae5-9f53-46e8-9d3d-71a92515328b tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:55:06.164339 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aed35ae5-9f53-46e8-9d3d-71a92515328b tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:55:06.164786 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aed35ae5-9f53-46e8-9d3d-71a92515328b tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:55:06.165489 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aed35ae5-9f53-46e8-9d3d-71a92515328b tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:55:06.165982 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aed35ae5-9f53-46e8-9d3d-71a92515328b tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:55:06.166420 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-aed35ae5-9f53-46e8-9d3d-71a92515328b tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:55:06.301639 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-aed35ae5-9f53-46e8-9d3d-71a92515328b tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:55:06.309416 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-aed35ae5-9f53-46e8-9d3d-71a92515328b tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/d70836ba-1790-4a2f-95f4-cb7c8ec6dda3" status: 200 len: 1681 microversion: 2.1 time: 0.156881 Sep 23 05:55:06.310000 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4095/8002] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:55:06 2022] GET /compute/v2.1/servers/d70836ba-1790-4a2f-95f4-cb7c8ec6dda3 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:55:06.405939 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a2c0b2de-93a4-49fe-883b-eaa4bcd24c9a tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:55:06.408125 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a2c0b2de-93a4-49fe-883b-eaa4bcd24c9a tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: d70836ba-1790-4a2f-95f4-cb7c8ec6dda3] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:55:06.415016 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a2c0b2de-93a4-49fe-883b-eaa4bcd24c9a tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:55:06.415529 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a2c0b2de-93a4-49fe-883b-eaa4bcd24c9a tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:55:06.415994 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a2c0b2de-93a4-49fe-883b-eaa4bcd24c9a tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:55:06.416709 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a2c0b2de-93a4-49fe-883b-eaa4bcd24c9a tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:55:06.417192 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a2c0b2de-93a4-49fe-883b-eaa4bcd24c9a tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:55:06.417641 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a2c0b2de-93a4-49fe-883b-eaa4bcd24c9a tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:55:06.457870 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a2c0b2de-93a4-49fe-883b-eaa4bcd24c9a tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "POST /compute/v2.1/servers/d70836ba-1790-4a2f-95f4-cb7c8ec6dda3/action" status: 200 len: 38462 microversion: 2.1 time: 0.056484 Sep 23 05:55:06.458536 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3908/8003] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 05:55:06 2022] POST /compute/v2.1/servers/d70836ba-1790-4a2f-95f4-cb7c8ec6dda3/action => generated 38462 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 05:55:07.521653 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4aeb3b53-18ff-4bb5-87fa-5a2208dda155 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:55:07.522214 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4aeb3b53-18ff-4bb5-87fa-5a2208dda155 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: d70836ba-1790-4a2f-95f4-cb7c8ec6dda3] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:55:07.524035 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-83b9ba20-9313-4a2b-a9a6-81156f360fcf req-8b4f908d-4a1d-4e47-8c01-ad41d382e851 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d70836ba-1790-4a2f-95f4-cb7c8ec6dda3", "tag": "890c0b29-38d3-4d1b-a7a2-a536691d78f9"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:55:07.529290 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4aeb3b53-18ff-4bb5-87fa-5a2208dda155 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:55:07.530126 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4aeb3b53-18ff-4bb5-87fa-5a2208dda155 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:55:07.530866 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4aeb3b53-18ff-4bb5-87fa-5a2208dda155 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:55:07.531651 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4aeb3b53-18ff-4bb5-87fa-5a2208dda155 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:55:07.532339 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4aeb3b53-18ff-4bb5-87fa-5a2208dda155 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:55:07.533028 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4aeb3b53-18ff-4bb5-87fa-5a2208dda155 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:55:07.535338 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-83b9ba20-9313-4a2b-a9a6-81156f360fcf req-8b4f908d-4a1d-4e47-8c01-ad41d382e851 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:55:07.535837 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-83b9ba20-9313-4a2b-a9a6-81156f360fcf req-8b4f908d-4a1d-4e47-8c01-ad41d382e851 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:55:07.536526 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-83b9ba20-9313-4a2b-a9a6-81156f360fcf req-8b4f908d-4a1d-4e47-8c01-ad41d382e851 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:55:07.548611 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-83b9ba20-9313-4a2b-a9a6-81156f360fcf req-8b4f908d-4a1d-4e47-8c01-ad41d382e851 service nova] Creating event network-changed:890c0b29-38d3-4d1b-a7a2-a536691d78f9 for instance d70836ba-1790-4a2f-95f4-cb7c8ec6dda3 on n-h2-846463-3 Sep 23 05:55:07.553599 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-83b9ba20-9313-4a2b-a9a6-81156f360fcf req-8b4f908d-4a1d-4e47-8c01-ad41d382e851 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033721 Sep 23 05:55:07.554551 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3909/8004] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:55:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:55:07.564093 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4aeb3b53-18ff-4bb5-87fa-5a2208dda155 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: d70836ba-1790-4a2f-95f4-cb7c8ec6dda3] Going to try to terminate instance {{(pid=122699) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 05:55:07.860327 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4aeb3b53-18ff-4bb5-87fa-5a2208dda155 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "DELETE /compute/v2.1/servers/d70836ba-1790-4a2f-95f4-cb7c8ec6dda3" status: 204 len: 0 microversion: 2.1 time: 0.342811 Sep 23 05:55:07.860944 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4096/8005] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 05:55:07 2022] DELETE /compute/v2.1/servers/d70836ba-1790-4a2f-95f4-cb7c8ec6dda3 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 05:55:07.869805 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9b7b8083-28a3-4f11-ac34-398bce001e6d tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:55:07.870699 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-9b7b8083-28a3-4f11-ac34-398bce001e6d tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: d70836ba-1790-4a2f-95f4-cb7c8ec6dda3] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:55:07.880088 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9b7b8083-28a3-4f11-ac34-398bce001e6d tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:55:07.882525 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9b7b8083-28a3-4f11-ac34-398bce001e6d tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:55:07.882525 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9b7b8083-28a3-4f11-ac34-398bce001e6d tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:55:07.882525 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9b7b8083-28a3-4f11-ac34-398bce001e6d tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:55:07.882871 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9b7b8083-28a3-4f11-ac34-398bce001e6d tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:55:07.883305 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9b7b8083-28a3-4f11-ac34-398bce001e6d tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:55:08.028950 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-9b7b8083-28a3-4f11-ac34-398bce001e6d tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:55:08.037299 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9b7b8083-28a3-4f11-ac34-398bce001e6d tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/d70836ba-1790-4a2f-95f4-cb7c8ec6dda3" status: 200 len: 1687 microversion: 2.1 time: 0.171714 Sep 23 05:55:08.037924 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3910/8006] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:55:07 2022] GET /compute/v2.1/servers/d70836ba-1790-4a2f-95f4-cb7c8ec6dda3 => generated 1687 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:55:09.062832 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e948eb6f-7ab1-444c-8d76-1d9a262edf19 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:55:09.063541 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e948eb6f-7ab1-444c-8d76-1d9a262edf19 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: d70836ba-1790-4a2f-95f4-cb7c8ec6dda3] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:55:09.070091 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e948eb6f-7ab1-444c-8d76-1d9a262edf19 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:55:09.070584 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e948eb6f-7ab1-444c-8d76-1d9a262edf19 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:55:09.071030 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e948eb6f-7ab1-444c-8d76-1d9a262edf19 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:55:09.071733 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e948eb6f-7ab1-444c-8d76-1d9a262edf19 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:55:09.072199 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e948eb6f-7ab1-444c-8d76-1d9a262edf19 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:55:09.072631 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e948eb6f-7ab1-444c-8d76-1d9a262edf19 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:55:09.207765 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e948eb6f-7ab1-444c-8d76-1d9a262edf19 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:55:09.215601 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e948eb6f-7ab1-444c-8d76-1d9a262edf19 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/d70836ba-1790-4a2f-95f4-cb7c8ec6dda3" status: 200 len: 1687 microversion: 2.1 time: 0.157688 Sep 23 05:55:09.216179 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4097/8007] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:55:09 2022] GET /compute/v2.1/servers/d70836ba-1790-4a2f-95f4-cb7c8ec6dda3 => generated 1687 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:55:09.924940 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-b536757a-a741-4457-b133-95dc3b81e56a req-df7e99e9-f89e-49a9-9e47-be1f15635db1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d70836ba-1790-4a2f-95f4-cb7c8ec6dda3", "name": "network-vif-deleted", "tag": "890c0b29-38d3-4d1b-a7a2-a536691d78f9"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:55:09.935733 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-b536757a-a741-4457-b133-95dc3b81e56a req-df7e99e9-f89e-49a9-9e47-be1f15635db1 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:55:09.936236 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-b536757a-a741-4457-b133-95dc3b81e56a req-df7e99e9-f89e-49a9-9e47-be1f15635db1 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:55:09.936683 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-b536757a-a741-4457-b133-95dc3b81e56a req-df7e99e9-f89e-49a9-9e47-be1f15635db1 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:55:09.947074 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-b536757a-a741-4457-b133-95dc3b81e56a req-df7e99e9-f89e-49a9-9e47-be1f15635db1 service nova] Creating event network-vif-deleted:890c0b29-38d3-4d1b-a7a2-a536691d78f9 for instance d70836ba-1790-4a2f-95f4-cb7c8ec6dda3 on n-h2-846463-3 Sep 23 05:55:09.952480 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-b536757a-a741-4457-b133-95dc3b81e56a req-df7e99e9-f89e-49a9-9e47-be1f15635db1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031225 Sep 23 05:55:09.953058 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3911/8008] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:55:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:55:10.240224 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-16b4cb31-b102-48f6-b9f6-b82b4b6c4e73 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:55:10.240931 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-16b4cb31-b102-48f6-b9f6-b82b4b6c4e73 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: d70836ba-1790-4a2f-95f4-cb7c8ec6dda3] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:55:10.249025 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-16b4cb31-b102-48f6-b9f6-b82b4b6c4e73 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:55:10.250122 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-16b4cb31-b102-48f6-b9f6-b82b4b6c4e73 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:55:10.251011 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-16b4cb31-b102-48f6-b9f6-b82b4b6c4e73 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:55:10.251769 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-16b4cb31-b102-48f6-b9f6-b82b4b6c4e73 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:55:10.252262 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-16b4cb31-b102-48f6-b9f6-b82b4b6c4e73 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:55:10.252682 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-16b4cb31-b102-48f6-b9f6-b82b4b6c4e73 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:55:10.288942 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-16b4cb31-b102-48f6-b9f6-b82b4b6c4e73 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:55:10.289448 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-16b4cb31-b102-48f6-b9f6-b82b4b6c4e73 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:55:10.289915 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-16b4cb31-b102-48f6-b9f6-b82b4b6c4e73 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:55:10.290580 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-16b4cb31-b102-48f6-b9f6-b82b4b6c4e73 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lazy-loading 'fault' on Instance uuid d70836ba-1790-4a2f-95f4-cb7c8ec6dda3 {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 05:55:10.333413 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-16b4cb31-b102-48f6-b9f6-b82b4b6c4e73 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9d36972d8f2413b8838e64998b43359', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '498fb069adef49d19ed802d2133adb89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:55:10.342229 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-16b4cb31-b102-48f6-b9f6-b82b4b6c4e73 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/d70836ba-1790-4a2f-95f4-cb7c8ec6dda3" status: 200 len: 1356 microversion: 2.1 time: 0.106017 Sep 23 05:55:10.346176 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4098/8009] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:55:10 2022] GET /compute/v2.1/servers/d70836ba-1790-4a2f-95f4-cb7c8ec6dda3 => generated 1356 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:55:11.366161 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b9ee7f8d-1f6c-4b94-9164-b11cbd2e0c72 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:55:11.366874 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b9ee7f8d-1f6c-4b94-9164-b11cbd2e0c72 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] [instance: d70836ba-1790-4a2f-95f4-cb7c8ec6dda3] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:55:11.374149 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b9ee7f8d-1f6c-4b94-9164-b11cbd2e0c72 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:55:11.375370 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b9ee7f8d-1f6c-4b94-9164-b11cbd2e0c72 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:55:11.375823 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b9ee7f8d-1f6c-4b94-9164-b11cbd2e0c72 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:55:11.376531 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b9ee7f8d-1f6c-4b94-9164-b11cbd2e0c72 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:55:11.376999 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b9ee7f8d-1f6c-4b94-9164-b11cbd2e0c72 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:55:11.377463 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b9ee7f8d-1f6c-4b94-9164-b11cbd2e0c72 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:55:11.390591 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-b9ee7f8d-1f6c-4b94-9164-b11cbd2e0c72 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] HTTP exception thrown: Instance d70836ba-1790-4a2f-95f4-cb7c8ec6dda3 could not be found. Sep 23 05:55:11.392192 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b9ee7f8d-1f6c-4b94-9164-b11cbd2e0c72 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Request method failure captured: Sep 23 05:55:11.392192 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/d70836ba-1790-4a2f-95f4-cb7c8ec6dda3 HTTP/1.1 Sep 23 05:55:11.392192 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 05:55:11.392192 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 05:55:11.392192 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 05:55:11.392192 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 05:55:11.392192 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 05:55:11.392192 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 05:55:11.392192 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 05:55:11.392192 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 05:55:11.392192 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLUhz7bpvepG5vaaNTB45PETsbu7BFN8GjZeZ_vLrd5WJDjgd_oQ5bhmVua4C2ZhQgOahIirm-KuGCZTB_5bToAYjCLfVfw81RihC56n3ttHDJ0Tgc_iEV4MwjR_WQmCh9B38US55e6l82-uxms5I3hOmslhT2_3dhZB9TyAC0xyC3YM Sep 23 05:55:11.392192 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 05:55:11.392192 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 05:55:11.392192 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 05:55:11.392192 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 05:55:11.392192 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 05:55:11.392192 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 05:55:11.392192 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 498fb069adef49d19ed802d2133adb89 Sep 23 05:55:11.392192 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2142034074 Sep 23 05:55:11.392192 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 05:55:11.392192 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 05:55:11.392192 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_498fb069adef49d19ed802d2133adb89", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/498fb069adef49d19ed802d2133adb89"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/498fb069adef49d19ed802d2133adb89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/498fb069adef49d19ed802d2133adb89"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:55:11.392192 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2142034074 Sep 23 05:55:11.392192 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 498fb069adef49d19ed802d2133adb89 Sep 23 05:55:11.392192 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2142034074 Sep 23 05:55:11.392192 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-TestNetworkAdvancedServerOps-2142034074-project Sep 23 05:55:11.392192 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 05:55:11.392192 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 05:55:11.392192 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: e9d36972d8f2413b8838e64998b43359 Sep 23 05:55:11.392192 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2142034074-project Sep 23 05:55:11.392192 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 05:55:11.392192 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance d70836ba-1790-4a2f-95f4-cb7c8ec6dda3 could not be found. Sep 23 05:55:11.392192 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': 'd70836ba-1790-4a2f-95f4-cb7c8ec6dda3'} Sep 23 05:55:11.392192 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:55:11.392192 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:55:11.392192 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 05:55:11.392192 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 05:55:11.392192 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 05:55:11.392192 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 05:55:11.392192 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 05:55:11.392192 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 05:55:11.392192 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 05:55:11.392192 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 05:55:11.392192 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d70836ba-1790-4a2f-95f4-cb7c8ec6dda3 could not be found. Sep 23 05:55:11.392192 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:55:11.392192 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:55:11.392192 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:55:11.392192 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:55:11.392192 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:55:11.392192 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:55:11.392192 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:55:11.392192 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:55:11.392192 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:55:11.392192 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:55:11.392192 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 05:55:11.392192 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 05:55:11.392192 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 05:55:11.392192 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 05:55:11.392192 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 05:55:11.392192 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:55:11.392192 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d70836ba-1790-4a2f-95f4-cb7c8ec6dda3 could not be found. Sep 23 05:55:11.392192 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:55:11.392192 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:55:11.398704 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:55:11.398704 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:55:11.398704 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:55:11.398704 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:55:11.398704 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:55:11.398704 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:55:11.398704 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d70836ba-1790-4a2f-95f4-cb7c8ec6dda3 could not be found. Sep 23 05:55:11.398704 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:55:11.398704 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b9ee7f8d-1f6c-4b94-9164-b11cbd2e0c72 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Returning 404 to user: Instance d70836ba-1790-4a2f-95f4-cb7c8ec6dda3 could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:55:11.398704 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b9ee7f8d-1f6c-4b94-9164-b11cbd2e0c72 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "GET /compute/v2.1/servers/d70836ba-1790-4a2f-95f4-cb7c8ec6dda3" status: 404 len: 111 microversion: 2.1 time: 0.031792 Sep 23 05:55:11.398704 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3912/8010] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:55:11 2022] GET /compute/v2.1/servers/d70836ba-1790-4a2f-95f4-cb7c8ec6dda3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 05:55:15.242135 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e08cb7ea-1b0c-46cd-bbc6-5bb946406e67 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] Calling method '.version_select at 0x7ff1bb03bf70>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:55:15.334930 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e08cb7ea-1b0c-46cd-bbc6-5bb946406e67 tempest-TestNetworkAdvancedServerOps-2142034074 tempest-TestNetworkAdvancedServerOps-2142034074-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1394391733" status: 202 len: 0 microversion: 2.1 time: 0.093185 Sep 23 05:55:15.334930 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4099/8011] 10.222.0.33 () {58 vars in 1284 bytes} [Fri Sep 23 05:55:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1394391733 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 05:55:29.605477 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=18 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:55:29.606390 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:55:29.792615 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-341bbb1c-e05a-40b8-8595-d7448703398f tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Action: 'create', calling method: .version_select at 0x7ff1b862da60>, body: {"keypair": {"name": "tempest-TestShelveInstance-482879276", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA8sp2S7gXRLfUDeEhM/T4wVtxyJGg3QuBsDLEsQ7GHl4lbS3jsZerz0bxqRf+hvSf1CWO3U/9LVVjv/gi2ZFhD6cZlkMwlzHKztFB67TvNSCYqJlDG/S0pYJOIIjzYErQ=="}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:55:29.814509 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-341bbb1c-e05a-40b8-8595-d7448703398f tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Getting quotas for project 93cf9690c0ef4fcf925253bed0fcd6a7. Resources: {'key_pairs'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 05:55:29.819953 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-341bbb1c-e05a-40b8-8595-d7448703398f tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Getting quotas for user 0b929c8797a041c683b207e2d20d25b2 and project 93cf9690c0ef4fcf925253bed0fcd6a7. Resources: {'key_pairs'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 05:55:29.907841 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-341bbb1c-e05a-40b8-8595-d7448703398f tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.307924 Sep 23 05:55:29.908520 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3913/8012] 10.222.0.33 () {60 vars in 1159 bytes} [Fri Sep 23 05:55:29 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:55:32.508131 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:55:32.509069 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:55:32.513007 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-bcf4ee38-9003-4bff-9895-53c40061b6b9 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2132723226", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-482879276", "security_groups": [{"name": "tempest-secgroup-smoke-987389961"}], "networks": [{"uuid": "94127e09-cec2-4c86-b0b3-8ac4e7896dee"}]}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:55:32.746621 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.neutron [None req-bcf4ee38-9003-4bff-9895-53c40061b6b9 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] validate_networks() for [('94127e09-cec2-4c86-b0b3-8ac4e7896dee', None, None, None, None, None)] {{(pid=122699) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 05:55:33.246710 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-bcf4ee38-9003-4bff-9895-53c40061b6b9 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Flavor limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 05:55:33.247139 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-bcf4ee38-9003-4bff-9895-53c40061b6b9 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Image limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 05:55:33.247617 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-bcf4ee38-9003-4bff-9895-53c40061b6b9 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Flavor pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 05:55:33.248028 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-bcf4ee38-9003-4bff-9895-53c40061b6b9 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Image pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 05:55:33.248653 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-bcf4ee38-9003-4bff-9895-53c40061b6b9 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 05:55:33.258358 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bcf4ee38-9003-4bff-9895-53c40061b6b9 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:55:33.258852 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bcf4ee38-9003-4bff-9895-53c40061b6b9 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:55:33.259321 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bcf4ee38-9003-4bff-9895-53c40061b6b9 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:55:33.260062 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bcf4ee38-9003-4bff-9895-53c40061b6b9 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:55:33.260525 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bcf4ee38-9003-4bff-9895-53c40061b6b9 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:55:33.260952 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bcf4ee38-9003-4bff-9895-53c40061b6b9 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:55:33.278847 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-bcf4ee38-9003-4bff-9895-53c40061b6b9 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Getting quotas for project 93cf9690c0ef4fcf925253bed0fcd6a7. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 05:55:33.284571 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-bcf4ee38-9003-4bff-9895-53c40061b6b9 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Getting quotas for user 0b929c8797a041c683b207e2d20d25b2 and project 93cf9690c0ef4fcf925253bed0fcd6a7. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 05:55:33.300059 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-bcf4ee38-9003-4bff-9895-53c40061b6b9 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Going to run 1 instances... {{(pid=122699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 05:55:33.303115 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-bcf4ee38-9003-4bff-9895-53c40061b6b9 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 7fb3325f-2d1e-4b15-9088-04ad4d03ad6a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 05:55:33.429408 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-bcf4ee38-9003-4bff-9895-53c40061b6b9 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.922544 Sep 23 05:55:33.430679 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4100/8013] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 05:55:32 2022] POST /compute/v2.1/servers => generated 405 bytes in 924 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 05:55:33.443302 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1654fd1e-a49a-4067-b60b-025e69fd3bb7 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:55:33.444617 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-1654fd1e-a49a-4067-b60b-025e69fd3bb7 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 7fb3325f-2d1e-4b15-9088-04ad4d03ad6a] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:55:33.453843 n-d-846463-3 devstack@n-api.service[122698]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 05:55:33.454288 n-d-846463-3 devstack@n-api.service[122698]: Fri Sep 23 05:55:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a (ip 10.222.0.33) !!! Sep 23 05:55:33.592253 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-1654fd1e-a49a-4067-b60b-025e69fd3bb7 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:55:33.601022 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-1654fd1e-a49a-4067-b60b-025e69fd3bb7 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a" status: 200 len: 1246 microversion: 2.1 time: 0.163182 Sep 23 05:55:33.602008 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3914/8014] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:55:33 2022] GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a => generated 1246 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:55:34.626535 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-371afd0f-d606-441d-9991-30da96303283 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:55:34.627164 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-371afd0f-d606-441d-9991-30da96303283 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 7fb3325f-2d1e-4b15-9088-04ad4d03ad6a] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:55:34.633515 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-371afd0f-d606-441d-9991-30da96303283 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:55:34.634154 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-371afd0f-d606-441d-9991-30da96303283 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:55:34.634518 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-371afd0f-d606-441d-9991-30da96303283 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:55:34.635234 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-371afd0f-d606-441d-9991-30da96303283 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:55:34.635707 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-371afd0f-d606-441d-9991-30da96303283 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:55:34.636144 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-371afd0f-d606-441d-9991-30da96303283 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:55:34.701437 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-371afd0f-d606-441d-9991-30da96303283 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:55:34.711932 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-371afd0f-d606-441d-9991-30da96303283 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a" status: 200 len: 1250 microversion: 2.1 time: 0.089911 Sep 23 05:55:34.712528 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4101/8015] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:55:34 2022] GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a => generated 1250 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:55:35.741011 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-267be2ac-d7df-46c8-a201-fb2e6b1288aa tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:55:35.742853 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-267be2ac-d7df-46c8-a201-fb2e6b1288aa tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 7fb3325f-2d1e-4b15-9088-04ad4d03ad6a] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:55:35.749464 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-267be2ac-d7df-46c8-a201-fb2e6b1288aa tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:55:35.750054 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-267be2ac-d7df-46c8-a201-fb2e6b1288aa tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:55:35.750522 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-267be2ac-d7df-46c8-a201-fb2e6b1288aa tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:55:35.751252 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-267be2ac-d7df-46c8-a201-fb2e6b1288aa tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:55:35.751867 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-267be2ac-d7df-46c8-a201-fb2e6b1288aa tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:55:35.752431 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-267be2ac-d7df-46c8-a201-fb2e6b1288aa tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:55:35.821352 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-267be2ac-d7df-46c8-a201-fb2e6b1288aa tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:55:35.829449 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-267be2ac-d7df-46c8-a201-fb2e6b1288aa tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a" status: 200 len: 1306 microversion: 2.1 time: 0.092663 Sep 23 05:55:35.830166 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3915/8016] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:55:35 2022] GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a => generated 1306 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:55:36.854863 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-87526f36-b332-420b-b313-a126cb603d44 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:55:36.856404 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-87526f36-b332-420b-b313-a126cb603d44 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 7fb3325f-2d1e-4b15-9088-04ad4d03ad6a] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:55:36.863076 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-87526f36-b332-420b-b313-a126cb603d44 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:55:36.863622 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-87526f36-b332-420b-b313-a126cb603d44 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:55:36.864065 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-87526f36-b332-420b-b313-a126cb603d44 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:55:36.864772 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-87526f36-b332-420b-b313-a126cb603d44 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:55:36.865230 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-87526f36-b332-420b-b313-a126cb603d44 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:55:36.865658 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-87526f36-b332-420b-b313-a126cb603d44 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:55:37.002938 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-87526f36-b332-420b-b313-a126cb603d44 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:55:37.010748 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-87526f36-b332-420b-b313-a126cb603d44 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a" status: 200 len: 1371 microversion: 2.1 time: 0.160536 Sep 23 05:55:37.011415 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4102/8017] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:55:36 2022] GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a => generated 1371 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:55:37.515843 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-0546f547-ebc9-42b7-9002-2cffe8419b9b req-7787bb3f-34ce-45a5-b4aa-95ea7979f4b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fb3325f-2d1e-4b15-9088-04ad4d03ad6a", "tag": "6c24a4aa-6e3a-4ae8-96bc-f30544de8277"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:55:37.525810 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-0546f547-ebc9-42b7-9002-2cffe8419b9b req-7787bb3f-34ce-45a5-b4aa-95ea7979f4b4 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:55:37.526344 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-0546f547-ebc9-42b7-9002-2cffe8419b9b req-7787bb3f-34ce-45a5-b4aa-95ea7979f4b4 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:55:37.526805 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-0546f547-ebc9-42b7-9002-2cffe8419b9b req-7787bb3f-34ce-45a5-b4aa-95ea7979f4b4 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:55:37.538200 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-0546f547-ebc9-42b7-9002-2cffe8419b9b req-7787bb3f-34ce-45a5-b4aa-95ea7979f4b4 service nova] Creating event network-changed:6c24a4aa-6e3a-4ae8-96bc-f30544de8277 for instance 7fb3325f-2d1e-4b15-9088-04ad4d03ad6a on n-h1-846463-3 Sep 23 05:55:37.543235 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-0546f547-ebc9-42b7-9002-2cffe8419b9b req-7787bb3f-34ce-45a5-b4aa-95ea7979f4b4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090102 Sep 23 05:55:37.543781 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3916/8018] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:55:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:55:38.034504 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2e3b029e-d118-4faa-bd90-1ed05be35304 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:55:38.035217 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-2e3b029e-d118-4faa-bd90-1ed05be35304 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 7fb3325f-2d1e-4b15-9088-04ad4d03ad6a] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:55:38.041999 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2e3b029e-d118-4faa-bd90-1ed05be35304 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:55:38.042498 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2e3b029e-d118-4faa-bd90-1ed05be35304 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:55:38.042948 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2e3b029e-d118-4faa-bd90-1ed05be35304 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:55:38.043650 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2e3b029e-d118-4faa-bd90-1ed05be35304 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:55:38.044144 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2e3b029e-d118-4faa-bd90-1ed05be35304 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:55:38.044579 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2e3b029e-d118-4faa-bd90-1ed05be35304 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:55:38.181441 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2e3b029e-d118-4faa-bd90-1ed05be35304 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:55:38.189318 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2e3b029e-d118-4faa-bd90-1ed05be35304 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a" status: 200 len: 1371 microversion: 2.1 time: 0.159508 Sep 23 05:55:38.189914 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4103/8019] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:55:38 2022] GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a => generated 1371 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:55:39.214267 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-82eeea38-2462-46e7-99e1-097e6f838006 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:55:39.215003 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-82eeea38-2462-46e7-99e1-097e6f838006 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 7fb3325f-2d1e-4b15-9088-04ad4d03ad6a] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:55:39.221680 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-82eeea38-2462-46e7-99e1-097e6f838006 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:55:39.222398 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-82eeea38-2462-46e7-99e1-097e6f838006 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:55:39.223090 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-82eeea38-2462-46e7-99e1-097e6f838006 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:55:39.223830 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-82eeea38-2462-46e7-99e1-097e6f838006 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:55:39.224311 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-82eeea38-2462-46e7-99e1-097e6f838006 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:55:39.225167 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-82eeea38-2462-46e7-99e1-097e6f838006 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:55:39.362917 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-82eeea38-2462-46e7-99e1-097e6f838006 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:55:39.370697 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-82eeea38-2462-46e7-99e1-097e6f838006 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a" status: 200 len: 1371 microversion: 2.1 time: 0.161695 Sep 23 05:55:39.371267 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3917/8020] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:55:39 2022] GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a => generated 1371 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:55:40.396642 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3afb4d63-4fd3-49cb-bd56-e348234d7989 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:55:40.397276 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-3afb4d63-4fd3-49cb-bd56-e348234d7989 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 7fb3325f-2d1e-4b15-9088-04ad4d03ad6a] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:55:40.404019 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3afb4d63-4fd3-49cb-bd56-e348234d7989 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:55:40.404506 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3afb4d63-4fd3-49cb-bd56-e348234d7989 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:55:40.404950 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3afb4d63-4fd3-49cb-bd56-e348234d7989 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:55:40.405744 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3afb4d63-4fd3-49cb-bd56-e348234d7989 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:55:40.406301 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3afb4d63-4fd3-49cb-bd56-e348234d7989 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:55:40.406733 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3afb4d63-4fd3-49cb-bd56-e348234d7989 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:55:40.840210 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-3afb4d63-4fd3-49cb-bd56-e348234d7989 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:55:40.848080 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3afb4d63-4fd3-49cb-bd56-e348234d7989 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a" status: 200 len: 1371 microversion: 2.1 time: 0.455393 Sep 23 05:55:40.848656 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4104/8021] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:55:40 2022] GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a => generated 1371 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:55:41.872066 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-acedb72f-b6aa-4b1e-a2a4-309c75be4de7 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:55:41.872778 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-acedb72f-b6aa-4b1e-a2a4-309c75be4de7 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 7fb3325f-2d1e-4b15-9088-04ad4d03ad6a] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:55:41.879924 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-acedb72f-b6aa-4b1e-a2a4-309c75be4de7 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:55:41.880393 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-acedb72f-b6aa-4b1e-a2a4-309c75be4de7 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:55:41.880856 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-acedb72f-b6aa-4b1e-a2a4-309c75be4de7 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:55:41.881581 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-acedb72f-b6aa-4b1e-a2a4-309c75be4de7 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:55:41.882091 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-acedb72f-b6aa-4b1e-a2a4-309c75be4de7 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:55:41.882543 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-acedb72f-b6aa-4b1e-a2a4-309c75be4de7 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:55:42.014794 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-acedb72f-b6aa-4b1e-a2a4-309c75be4de7 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:55:42.023480 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-acedb72f-b6aa-4b1e-a2a4-309c75be4de7 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a" status: 200 len: 1371 microversion: 2.1 time: 0.155865 Sep 23 05:55:42.024056 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3918/8022] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:55:41 2022] GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:55:43.046816 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2eec2d91-5f18-4e9f-847a-d920cc268150 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:55:43.047447 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-2eec2d91-5f18-4e9f-847a-d920cc268150 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 7fb3325f-2d1e-4b15-9088-04ad4d03ad6a] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:55:43.054589 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2eec2d91-5f18-4e9f-847a-d920cc268150 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:55:43.055081 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2eec2d91-5f18-4e9f-847a-d920cc268150 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:55:43.055532 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2eec2d91-5f18-4e9f-847a-d920cc268150 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:55:43.056231 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2eec2d91-5f18-4e9f-847a-d920cc268150 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:55:43.056693 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2eec2d91-5f18-4e9f-847a-d920cc268150 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:55:43.057194 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2eec2d91-5f18-4e9f-847a-d920cc268150 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:55:43.191856 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2eec2d91-5f18-4e9f-847a-d920cc268150 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:55:43.199749 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2eec2d91-5f18-4e9f-847a-d920cc268150 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a" status: 200 len: 1371 microversion: 2.1 time: 0.156857 Sep 23 05:55:43.202969 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4105/8023] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:55:43 2022] GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a => generated 1371 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:55:43.347389 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-1e356a3e-133b-4ff7-9cd0-a7eedfa2da21 req-419c8c95-c272-4581-b3a9-9cd610698461 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fb3325f-2d1e-4b15-9088-04ad4d03ad6a", "name": "network-vif-plugged", "status": "completed", "tag": "6c24a4aa-6e3a-4ae8-96bc-f30544de8277"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:55:43.358040 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-1e356a3e-133b-4ff7-9cd0-a7eedfa2da21 req-419c8c95-c272-4581-b3a9-9cd610698461 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:55:43.358538 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-1e356a3e-133b-4ff7-9cd0-a7eedfa2da21 req-419c8c95-c272-4581-b3a9-9cd610698461 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:55:43.358989 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-1e356a3e-133b-4ff7-9cd0-a7eedfa2da21 req-419c8c95-c272-4581-b3a9-9cd610698461 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:55:43.370473 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-1e356a3e-133b-4ff7-9cd0-a7eedfa2da21 req-419c8c95-c272-4581-b3a9-9cd610698461 service nova] Creating event network-vif-plugged:6c24a4aa-6e3a-4ae8-96bc-f30544de8277 for instance 7fb3325f-2d1e-4b15-9088-04ad4d03ad6a on n-h1-846463-3 Sep 23 05:55:43.375582 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-1e356a3e-133b-4ff7-9cd0-a7eedfa2da21 req-419c8c95-c272-4581-b3a9-9cd610698461 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032460 Sep 23 05:55:43.383544 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3919/8024] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:55:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:55:44.222610 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6894790a-c34f-4be8-a92d-7279c06c2e28 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:55:44.223272 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-6894790a-c34f-4be8-a92d-7279c06c2e28 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 7fb3325f-2d1e-4b15-9088-04ad4d03ad6a] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:55:44.225127 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:55:44.225805 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=6 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:55:44.231302 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6894790a-c34f-4be8-a92d-7279c06c2e28 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:55:44.234986 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6894790a-c34f-4be8-a92d-7279c06c2e28 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:55:44.234986 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6894790a-c34f-4be8-a92d-7279c06c2e28 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:55:44.234986 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6894790a-c34f-4be8-a92d-7279c06c2e28 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:55:44.234986 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6894790a-c34f-4be8-a92d-7279c06c2e28 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:55:44.234986 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6894790a-c34f-4be8-a92d-7279c06c2e28 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:55:44.366317 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-6894790a-c34f-4be8-a92d-7279c06c2e28 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:55:44.373969 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6894790a-c34f-4be8-a92d-7279c06c2e28 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a" status: 200 len: 1371 microversion: 2.1 time: 0.155326 Sep 23 05:55:44.374541 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4106/8025] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:55:44 2022] GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:55:45.395151 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=6 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:55:45.400431 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c00f22f2-5a28-445d-bc70-e736afd189e3 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:55:45.401141 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c00f22f2-5a28-445d-bc70-e736afd189e3 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 7fb3325f-2d1e-4b15-9088-04ad4d03ad6a] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:55:45.407377 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c00f22f2-5a28-445d-bc70-e736afd189e3 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:55:45.409251 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c00f22f2-5a28-445d-bc70-e736afd189e3 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:55:45.409251 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c00f22f2-5a28-445d-bc70-e736afd189e3 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:55:45.410171 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c00f22f2-5a28-445d-bc70-e736afd189e3 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:55:45.410664 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c00f22f2-5a28-445d-bc70-e736afd189e3 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:55:45.411230 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c00f22f2-5a28-445d-bc70-e736afd189e3 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:55:45.547348 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c00f22f2-5a28-445d-bc70-e736afd189e3 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:55:45.555322 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c00f22f2-5a28-445d-bc70-e736afd189e3 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a" status: 200 len: 1554 microversion: 2.1 time: 0.161172 Sep 23 05:55:45.555892 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3920/8026] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:55:45 2022] GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a => generated 1554 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:55:45.577903 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-45ed2bfc-1347-480b-b51c-183f07d8937c tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:55:45.578530 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-45ed2bfc-1347-480b-b51c-183f07d8937c tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 7fb3325f-2d1e-4b15-9088-04ad4d03ad6a] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:55:45.585630 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-45ed2bfc-1347-480b-b51c-183f07d8937c tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:55:45.586182 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-45ed2bfc-1347-480b-b51c-183f07d8937c tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:55:45.586647 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-45ed2bfc-1347-480b-b51c-183f07d8937c tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:55:45.587328 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-45ed2bfc-1347-480b-b51c-183f07d8937c tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:55:45.587789 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-45ed2bfc-1347-480b-b51c-183f07d8937c tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:55:45.588217 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-45ed2bfc-1347-480b-b51c-183f07d8937c tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:55:45.715379 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-45ed2bfc-1347-480b-b51c-183f07d8937c tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:55:45.723205 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-45ed2bfc-1347-480b-b51c-183f07d8937c tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a" status: 200 len: 1554 microversion: 2.1 time: 0.149145 Sep 23 05:55:45.723783 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4107/8027] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:55:45 2022] GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a => generated 1554 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:55:47.607483 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-60450547-e647-4b65-8fc1-6f2375cb07bf req-6075bfa0-30f3-4aa1-932a-ce5cc9aaeeb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fb3325f-2d1e-4b15-9088-04ad4d03ad6a", "tag": "6c24a4aa-6e3a-4ae8-96bc-f30544de8277"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:55:47.618478 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-60450547-e647-4b65-8fc1-6f2375cb07bf req-6075bfa0-30f3-4aa1-932a-ce5cc9aaeeb1 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:55:47.618984 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-60450547-e647-4b65-8fc1-6f2375cb07bf req-6075bfa0-30f3-4aa1-932a-ce5cc9aaeeb1 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:55:47.619422 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-60450547-e647-4b65-8fc1-6f2375cb07bf req-6075bfa0-30f3-4aa1-932a-ce5cc9aaeeb1 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:55:47.633141 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-60450547-e647-4b65-8fc1-6f2375cb07bf req-6075bfa0-30f3-4aa1-932a-ce5cc9aaeeb1 service nova] Creating event network-changed:6c24a4aa-6e3a-4ae8-96bc-f30544de8277 for instance 7fb3325f-2d1e-4b15-9088-04ad4d03ad6a on n-h1-846463-3 Sep 23 05:55:47.638574 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-60450547-e647-4b65-8fc1-6f2375cb07bf req-6075bfa0-30f3-4aa1-932a-ce5cc9aaeeb1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034498 Sep 23 05:55:47.639203 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3921/8028] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:55:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 05:57:42.655667 n-d-846463-3 devstack@n-api.service[122699]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c6c7f4e7-3ce9-40e8-ba39-9d563bbcd13f] AMQP server on 10.222.0.33:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 23 05:57:42.656352 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:57:42.657110 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=44 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:57:42.657956 n-d-846463-3 devstack@n-api.service[122699]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 05:57:42.658105 n-d-846463-3 devstack@n-api.service[122699]: Fri Sep 23 05:57:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a/action (ip 10.222.0.33) !!! Sep 23 05:57:42.659450 n-d-846463-3 devstack@n-api.service[122699]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Sep 23 05:57:42.664465 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-bc890205-47ba-4877-b3a8-831bb9582d67 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:57:42.665004 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-bc890205-47ba-4877-b3a8-831bb9582d67 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 7fb3325f-2d1e-4b15-9088-04ad4d03ad6a] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:57:42.672111 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bc890205-47ba-4877-b3a8-831bb9582d67 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:57:42.675721 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bc890205-47ba-4877-b3a8-831bb9582d67 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:57:42.675721 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bc890205-47ba-4877-b3a8-831bb9582d67 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:57:42.675721 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bc890205-47ba-4877-b3a8-831bb9582d67 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:57:42.675721 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bc890205-47ba-4877-b3a8-831bb9582d67 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:57:42.675721 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bc890205-47ba-4877-b3a8-831bb9582d67 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:57:42.699340 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-bc890205-47ba-4877-b3a8-831bb9582d67 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lazy-loading 'flavor' on Instance uuid 7fb3325f-2d1e-4b15-9088-04ad4d03ad6a {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 05:57:43.166623 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-bc890205-47ba-4877-b3a8-831bb9582d67 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "POST /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a/action" status: 202 len: 0 microversion: 2.1 time: 0.512777 Sep 23 05:57:43.167224 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4108/8029] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 05:57:42 2022] POST /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a/action => generated 0 bytes in 514 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 05:57:43.173828 n-d-846463-3 devstack@n-api.service[122698]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2416b61d-0aee-4a62-9508-aa1fc06b9213] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 23 05:57:43.177353 n-d-846463-3 devstack@n-api.service[122698]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f191bc7a-c250-407c-bbf3-646bef550c22] AMQP server on 10.222.0.33:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Sep 23 05:57:43.177353 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:57:43.177353 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=30 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:57:43.178061 n-d-846463-3 devstack@n-api.service[122698]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Sep 23 05:57:43.183697 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-cd66bc90-45ae-41f0-8374-2dbb4e3e6603 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:57:43.184416 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-cd66bc90-45ae-41f0-8374-2dbb4e3e6603 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 7fb3325f-2d1e-4b15-9088-04ad4d03ad6a] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:57:43.191628 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cd66bc90-45ae-41f0-8374-2dbb4e3e6603 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:57:43.192136 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cd66bc90-45ae-41f0-8374-2dbb4e3e6603 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:57:43.192587 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cd66bc90-45ae-41f0-8374-2dbb4e3e6603 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:57:43.193290 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cd66bc90-45ae-41f0-8374-2dbb4e3e6603 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:57:43.193765 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cd66bc90-45ae-41f0-8374-2dbb4e3e6603 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:57:43.194238 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-cd66bc90-45ae-41f0-8374-2dbb4e3e6603 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:57:43.338475 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-cd66bc90-45ae-41f0-8374-2dbb4e3e6603 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:57:43.346289 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-cd66bc90-45ae-41f0-8374-2dbb4e3e6603 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a" status: 200 len: 1679 microversion: 2.1 time: 0.174403 Sep 23 05:57:43.346874 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3922/8030] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:57:43 2022] GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a => generated 1679 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:57:44.370868 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5fad4b3c-8ccb-4a78-9e99-f2bbf0b23dca tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:57:44.371581 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-5fad4b3c-8ccb-4a78-9e99-f2bbf0b23dca tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 7fb3325f-2d1e-4b15-9088-04ad4d03ad6a] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:57:44.379428 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5fad4b3c-8ccb-4a78-9e99-f2bbf0b23dca tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:57:44.382825 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5fad4b3c-8ccb-4a78-9e99-f2bbf0b23dca tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:57:44.382825 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5fad4b3c-8ccb-4a78-9e99-f2bbf0b23dca tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:57:44.382825 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5fad4b3c-8ccb-4a78-9e99-f2bbf0b23dca tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:57:44.382825 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5fad4b3c-8ccb-4a78-9e99-f2bbf0b23dca tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:57:44.382825 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5fad4b3c-8ccb-4a78-9e99-f2bbf0b23dca tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:57:44.390845 n-d-846463-3 devstack@n-api.service[122699]: INFO oslo.messaging._drivers.impl_rabbit [-] [c6c7f4e7-3ce9-40e8-ba39-9d563bbcd13f] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 56212. Sep 23 05:57:44.515268 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-5fad4b3c-8ccb-4a78-9e99-f2bbf0b23dca tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:57:44.523900 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5fad4b3c-8ccb-4a78-9e99-f2bbf0b23dca tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a" status: 200 len: 1679 microversion: 2.1 time: 0.157939 Sep 23 05:57:44.524406 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4109/8031] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:57:44 2022] GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:57:45.547917 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9d94eccf-b370-42b7-a6cc-9b607ae76286 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:57:45.548551 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-9d94eccf-b370-42b7-a6cc-9b607ae76286 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 7fb3325f-2d1e-4b15-9088-04ad4d03ad6a] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:57:45.561260 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9d94eccf-b370-42b7-a6cc-9b607ae76286 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:57:45.561653 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9d94eccf-b370-42b7-a6cc-9b607ae76286 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:57:45.562155 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9d94eccf-b370-42b7-a6cc-9b607ae76286 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:57:45.562883 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9d94eccf-b370-42b7-a6cc-9b607ae76286 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:57:45.563362 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9d94eccf-b370-42b7-a6cc-9b607ae76286 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:57:45.563830 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9d94eccf-b370-42b7-a6cc-9b607ae76286 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:57:45.571308 n-d-846463-3 devstack@n-api.service[122698]: INFO oslo.messaging._drivers.impl_rabbit [-] [f191bc7a-c250-407c-bbf3-646bef550c22] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 56218. Sep 23 05:57:45.582140 n-d-846463-3 devstack@n-api.service[122698]: INFO oslo.messaging._drivers.impl_rabbit [-] [2416b61d-0aee-4a62-9508-aa1fc06b9213] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 56216. Sep 23 05:57:45.696765 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-9d94eccf-b370-42b7-a6cc-9b607ae76286 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:57:45.704587 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9d94eccf-b370-42b7-a6cc-9b607ae76286 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a" status: 200 len: 1679 microversion: 2.1 time: 0.160649 Sep 23 05:57:45.705161 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3923/8032] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:57:45 2022] GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:57:46.727734 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e04866ac-fde7-400c-abe6-c3dfbb6406ea tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:57:46.728358 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e04866ac-fde7-400c-abe6-c3dfbb6406ea tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 7fb3325f-2d1e-4b15-9088-04ad4d03ad6a] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:57:46.734642 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e04866ac-fde7-400c-abe6-c3dfbb6406ea tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:57:46.735140 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e04866ac-fde7-400c-abe6-c3dfbb6406ea tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:57:46.735581 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e04866ac-fde7-400c-abe6-c3dfbb6406ea tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:57:46.736276 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e04866ac-fde7-400c-abe6-c3dfbb6406ea tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:57:46.737351 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e04866ac-fde7-400c-abe6-c3dfbb6406ea tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:57:46.737798 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e04866ac-fde7-400c-abe6-c3dfbb6406ea tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:57:46.873170 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e04866ac-fde7-400c-abe6-c3dfbb6406ea tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:57:46.882015 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e04866ac-fde7-400c-abe6-c3dfbb6406ea tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a" status: 200 len: 1679 microversion: 2.1 time: 0.158245 Sep 23 05:57:46.882586 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4110/8033] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:57:46 2022] GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:57:47.906914 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5a6b9797-4a98-42c2-a06e-57499fdecb96 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:57:47.907544 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5a6b9797-4a98-42c2-a06e-57499fdecb96 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 7fb3325f-2d1e-4b15-9088-04ad4d03ad6a] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:57:47.916225 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5a6b9797-4a98-42c2-a06e-57499fdecb96 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:57:47.930830 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5a6b9797-4a98-42c2-a06e-57499fdecb96 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:57:47.930830 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5a6b9797-4a98-42c2-a06e-57499fdecb96 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:57:47.930830 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5a6b9797-4a98-42c2-a06e-57499fdecb96 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:57:47.930830 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5a6b9797-4a98-42c2-a06e-57499fdecb96 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:57:47.930830 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5a6b9797-4a98-42c2-a06e-57499fdecb96 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:57:48.048144 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-5a6b9797-4a98-42c2-a06e-57499fdecb96 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:57:48.056721 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5a6b9797-4a98-42c2-a06e-57499fdecb96 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a" status: 200 len: 1679 microversion: 2.1 time: 0.153839 Sep 23 05:57:48.057307 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3924/8034] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:57:47 2022] GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:57:49.081556 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0736384a-83f9-4ab5-b264-33d89d891c74 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:57:49.082159 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-0736384a-83f9-4ab5-b264-33d89d891c74 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 7fb3325f-2d1e-4b15-9088-04ad4d03ad6a] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:57:49.088717 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0736384a-83f9-4ab5-b264-33d89d891c74 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:57:49.089212 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0736384a-83f9-4ab5-b264-33d89d891c74 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:57:49.089688 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0736384a-83f9-4ab5-b264-33d89d891c74 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:57:49.090413 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0736384a-83f9-4ab5-b264-33d89d891c74 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:57:49.090883 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0736384a-83f9-4ab5-b264-33d89d891c74 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:57:49.091447 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0736384a-83f9-4ab5-b264-33d89d891c74 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:57:49.227362 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-0736384a-83f9-4ab5-b264-33d89d891c74 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:57:49.236216 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0736384a-83f9-4ab5-b264-33d89d891c74 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a" status: 200 len: 1679 microversion: 2.1 time: 0.159156 Sep 23 05:57:49.237400 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4111/8035] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:57:49 2022] GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:57:50.260624 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b1a78a46-0ee5-4e70-aa28-7ed91a79395f tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:57:50.261252 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b1a78a46-0ee5-4e70-aa28-7ed91a79395f tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 7fb3325f-2d1e-4b15-9088-04ad4d03ad6a] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:57:50.268144 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b1a78a46-0ee5-4e70-aa28-7ed91a79395f tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:57:50.268658 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b1a78a46-0ee5-4e70-aa28-7ed91a79395f tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:57:50.269120 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b1a78a46-0ee5-4e70-aa28-7ed91a79395f tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:57:50.269829 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b1a78a46-0ee5-4e70-aa28-7ed91a79395f tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:57:50.270333 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b1a78a46-0ee5-4e70-aa28-7ed91a79395f tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:57:50.270775 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b1a78a46-0ee5-4e70-aa28-7ed91a79395f tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:57:50.403217 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b1a78a46-0ee5-4e70-aa28-7ed91a79395f tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:57:50.411073 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b1a78a46-0ee5-4e70-aa28-7ed91a79395f tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a" status: 200 len: 1679 microversion: 2.1 time: 0.154387 Sep 23 05:57:50.411860 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3925/8036] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:57:50 2022] GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:57:51.435048 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b5940752-a497-4c42-8a2e-ee9044b46379 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:57:51.435663 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b5940752-a497-4c42-8a2e-ee9044b46379 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 7fb3325f-2d1e-4b15-9088-04ad4d03ad6a] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:57:51.442710 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b5940752-a497-4c42-8a2e-ee9044b46379 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:57:51.443236 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b5940752-a497-4c42-8a2e-ee9044b46379 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:57:51.443677 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b5940752-a497-4c42-8a2e-ee9044b46379 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:57:51.444373 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b5940752-a497-4c42-8a2e-ee9044b46379 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:57:51.445210 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b5940752-a497-4c42-8a2e-ee9044b46379 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:57:51.445643 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b5940752-a497-4c42-8a2e-ee9044b46379 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:57:51.579962 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b5940752-a497-4c42-8a2e-ee9044b46379 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:57:51.587804 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b5940752-a497-4c42-8a2e-ee9044b46379 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a" status: 200 len: 1679 microversion: 2.1 time: 0.156701 Sep 23 05:57:51.588378 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4112/8037] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:57:51 2022] GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:57:52.610625 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4956906e-e4f1-4a9b-8689-f16ac98de1da tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:57:52.611269 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4956906e-e4f1-4a9b-8689-f16ac98de1da tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 7fb3325f-2d1e-4b15-9088-04ad4d03ad6a] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:57:52.618823 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4956906e-e4f1-4a9b-8689-f16ac98de1da tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:57:52.622710 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4956906e-e4f1-4a9b-8689-f16ac98de1da tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:57:52.622710 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4956906e-e4f1-4a9b-8689-f16ac98de1da tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:57:52.622710 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4956906e-e4f1-4a9b-8689-f16ac98de1da tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:57:52.622710 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4956906e-e4f1-4a9b-8689-f16ac98de1da tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:57:52.622710 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4956906e-e4f1-4a9b-8689-f16ac98de1da tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:57:52.752746 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4956906e-e4f1-4a9b-8689-f16ac98de1da tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:57:52.760520 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4956906e-e4f1-4a9b-8689-f16ac98de1da tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a" status: 200 len: 1679 microversion: 2.1 time: 0.153854 Sep 23 05:57:52.761104 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3926/8038] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:57:52 2022] GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:57:53.784866 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4646bcd5-24bc-44a1-b555-a83f2affc030 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:57:53.785460 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4646bcd5-24bc-44a1-b555-a83f2affc030 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 7fb3325f-2d1e-4b15-9088-04ad4d03ad6a] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:57:53.792038 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4646bcd5-24bc-44a1-b555-a83f2affc030 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:57:53.792523 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4646bcd5-24bc-44a1-b555-a83f2affc030 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:57:53.792958 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4646bcd5-24bc-44a1-b555-a83f2affc030 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:57:53.793645 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4646bcd5-24bc-44a1-b555-a83f2affc030 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:57:53.794129 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4646bcd5-24bc-44a1-b555-a83f2affc030 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:57:53.794559 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4646bcd5-24bc-44a1-b555-a83f2affc030 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:57:53.926451 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-4646bcd5-24bc-44a1-b555-a83f2affc030 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:57:53.934504 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4646bcd5-24bc-44a1-b555-a83f2affc030 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a" status: 200 len: 1700 microversion: 2.1 time: 0.153687 Sep 23 05:57:53.935086 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4113/8039] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:57:53 2022] GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a => generated 1700 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:57:54.959111 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9e122247-dfd3-4257-9d12-09d18265b2f6 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:57:54.959748 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-9e122247-dfd3-4257-9d12-09d18265b2f6 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 7fb3325f-2d1e-4b15-9088-04ad4d03ad6a] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:57:54.966752 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9e122247-dfd3-4257-9d12-09d18265b2f6 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:57:54.967260 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9e122247-dfd3-4257-9d12-09d18265b2f6 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:57:54.967716 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9e122247-dfd3-4257-9d12-09d18265b2f6 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:57:54.968425 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9e122247-dfd3-4257-9d12-09d18265b2f6 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:57:54.968901 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9e122247-dfd3-4257-9d12-09d18265b2f6 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:57:54.969346 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9e122247-dfd3-4257-9d12-09d18265b2f6 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:57:55.105835 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-9e122247-dfd3-4257-9d12-09d18265b2f6 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:57:55.114080 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9e122247-dfd3-4257-9d12-09d18265b2f6 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a" status: 200 len: 1700 microversion: 2.1 time: 0.158941 Sep 23 05:57:55.114661 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3927/8040] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:57:54 2022] GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a => generated 1700 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:57:56.136931 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-14d7a3b0-8071-4839-9ef4-536a779d6d4a tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:57:56.137651 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-14d7a3b0-8071-4839-9ef4-536a779d6d4a tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 7fb3325f-2d1e-4b15-9088-04ad4d03ad6a] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:57:56.144751 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-14d7a3b0-8071-4839-9ef4-536a779d6d4a tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:57:56.145243 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-14d7a3b0-8071-4839-9ef4-536a779d6d4a tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:57:56.147730 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-14d7a3b0-8071-4839-9ef4-536a779d6d4a tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:57:56.147730 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-14d7a3b0-8071-4839-9ef4-536a779d6d4a tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:57:56.147730 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-14d7a3b0-8071-4839-9ef4-536a779d6d4a tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:57:56.147730 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-14d7a3b0-8071-4839-9ef4-536a779d6d4a tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:57:56.291775 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-14d7a3b0-8071-4839-9ef4-536a779d6d4a tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:57:56.300077 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-14d7a3b0-8071-4839-9ef4-536a779d6d4a tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a" status: 200 len: 1695 microversion: 2.1 time: 0.167034 Sep 23 05:57:56.300659 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4114/8041] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:57:56 2022] GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a => generated 1695 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:57:57.325338 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e9761697-14f2-4826-8f5f-967abc4e0992 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:57:57.326644 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e9761697-14f2-4826-8f5f-967abc4e0992 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 7fb3325f-2d1e-4b15-9088-04ad4d03ad6a] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:57:57.338227 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e9761697-14f2-4826-8f5f-967abc4e0992 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:57:57.339567 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e9761697-14f2-4826-8f5f-967abc4e0992 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:57:57.339924 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e9761697-14f2-4826-8f5f-967abc4e0992 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:57:57.340622 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e9761697-14f2-4826-8f5f-967abc4e0992 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:57:57.341098 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e9761697-14f2-4826-8f5f-967abc4e0992 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:57:57.341540 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e9761697-14f2-4826-8f5f-967abc4e0992 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:57:57.787810 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e9761697-14f2-4826-8f5f-967abc4e0992 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:57:57.801925 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e9761697-14f2-4826-8f5f-967abc4e0992 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a" status: 200 len: 1695 microversion: 2.1 time: 0.480904 Sep 23 05:57:57.821913 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3928/8042] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:57:57 2022] GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a => generated 1695 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:57:58.016789 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-67346056-128b-43e9-8b12-d44da8348db6 req-27807311-d71b-4efa-928d-5edc02909d98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fb3325f-2d1e-4b15-9088-04ad4d03ad6a", "name": "network-vif-plugged", "status": "completed", "tag": "6c24a4aa-6e3a-4ae8-96bc-f30544de8277"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:57:58.028768 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-67346056-128b-43e9-8b12-d44da8348db6 req-27807311-d71b-4efa-928d-5edc02909d98 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:57:58.029265 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-67346056-128b-43e9-8b12-d44da8348db6 req-27807311-d71b-4efa-928d-5edc02909d98 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:57:58.029706 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-67346056-128b-43e9-8b12-d44da8348db6 req-27807311-d71b-4efa-928d-5edc02909d98 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:57:58.046798 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-67346056-128b-43e9-8b12-d44da8348db6 req-27807311-d71b-4efa-928d-5edc02909d98 service nova] Creating event network-vif-plugged:6c24a4aa-6e3a-4ae8-96bc-f30544de8277 for instance 7fb3325f-2d1e-4b15-9088-04ad4d03ad6a on n-h1-846463-3 Sep 23 05:57:58.052579 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-67346056-128b-43e9-8b12-d44da8348db6 req-27807311-d71b-4efa-928d-5edc02909d98 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107733 Sep 23 05:57:58.053602 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4115/8043] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:57:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:57:58.833076 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d7be39bc-9dc8-4adb-ae76-2328d600dad7 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:57:58.834484 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d7be39bc-9dc8-4adb-ae76-2328d600dad7 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 7fb3325f-2d1e-4b15-9088-04ad4d03ad6a] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:57:58.841651 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d7be39bc-9dc8-4adb-ae76-2328d600dad7 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:57:58.842280 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d7be39bc-9dc8-4adb-ae76-2328d600dad7 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:57:58.843000 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d7be39bc-9dc8-4adb-ae76-2328d600dad7 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:57:58.843992 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d7be39bc-9dc8-4adb-ae76-2328d600dad7 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:57:58.844482 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d7be39bc-9dc8-4adb-ae76-2328d600dad7 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:57:58.844936 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d7be39bc-9dc8-4adb-ae76-2328d600dad7 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:57:59.021674 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d7be39bc-9dc8-4adb-ae76-2328d600dad7 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:57:59.031097 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d7be39bc-9dc8-4adb-ae76-2328d600dad7 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a" status: 200 len: 1695 microversion: 2.1 time: 0.201737 Sep 23 05:57:59.031703 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3929/8044] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:57:58 2022] GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a => generated 1695 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:58:00.056039 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ec425229-4679-4fa0-90c0-e910c642079e tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:58:00.057478 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ec425229-4679-4fa0-90c0-e910c642079e tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 7fb3325f-2d1e-4b15-9088-04ad4d03ad6a] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:58:00.064724 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ec425229-4679-4fa0-90c0-e910c642079e tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:58:00.065584 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ec425229-4679-4fa0-90c0-e910c642079e tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:58:00.066131 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ec425229-4679-4fa0-90c0-e910c642079e tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:58:00.067033 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ec425229-4679-4fa0-90c0-e910c642079e tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:58:00.067497 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ec425229-4679-4fa0-90c0-e910c642079e tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:58:00.068133 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ec425229-4679-4fa0-90c0-e910c642079e tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:58:00.222643 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ec425229-4679-4fa0-90c0-e910c642079e tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:58:00.231106 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ec425229-4679-4fa0-90c0-e910c642079e tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a" status: 200 len: 1695 microversion: 2.1 time: 0.180058 Sep 23 05:58:00.231867 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4116/8045] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:58:00 2022] GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a => generated 1695 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:58:01.261156 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-992b6628-a66e-49ce-a45f-dcb3e039d304 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:58:01.269514 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-992b6628-a66e-49ce-a45f-dcb3e039d304 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 7fb3325f-2d1e-4b15-9088-04ad4d03ad6a] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:58:01.281504 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-992b6628-a66e-49ce-a45f-dcb3e039d304 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:58:01.282379 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-992b6628-a66e-49ce-a45f-dcb3e039d304 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:58:01.283881 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-992b6628-a66e-49ce-a45f-dcb3e039d304 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:58:01.285060 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-992b6628-a66e-49ce-a45f-dcb3e039d304 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:58:01.285918 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-992b6628-a66e-49ce-a45f-dcb3e039d304 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:58:01.286325 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-992b6628-a66e-49ce-a45f-dcb3e039d304 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:58:01.482162 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-992b6628-a66e-49ce-a45f-dcb3e039d304 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:58:01.491358 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-992b6628-a66e-49ce-a45f-dcb3e039d304 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a" status: 200 len: 1695 microversion: 2.1 time: 0.236938 Sep 23 05:58:01.492438 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3930/8046] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:58:01 2022] GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a => generated 1695 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:58:02.517825 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-859f70b5-2458-47ef-a6af-e4b5b672409c tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:58:02.518751 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-859f70b5-2458-47ef-a6af-e4b5b672409c tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 7fb3325f-2d1e-4b15-9088-04ad4d03ad6a] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:58:02.526350 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-859f70b5-2458-47ef-a6af-e4b5b672409c tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:58:02.526850 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-859f70b5-2458-47ef-a6af-e4b5b672409c tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:58:02.527294 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-859f70b5-2458-47ef-a6af-e4b5b672409c tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:58:02.528003 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-859f70b5-2458-47ef-a6af-e4b5b672409c tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:58:02.528470 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-859f70b5-2458-47ef-a6af-e4b5b672409c tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:58:02.528947 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-859f70b5-2458-47ef-a6af-e4b5b672409c tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:58:02.665557 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-859f70b5-2458-47ef-a6af-e4b5b672409c tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:58:02.673514 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-859f70b5-2458-47ef-a6af-e4b5b672409c tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a" status: 200 len: 1695 microversion: 2.1 time: 0.159739 Sep 23 05:58:02.674188 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4117/8047] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:58:02 2022] GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a => generated 1695 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:58:03.698459 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5b081be8-2fa3-4b56-bbc7-fee7b53b15d7 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:58:03.699381 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5b081be8-2fa3-4b56-bbc7-fee7b53b15d7 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 7fb3325f-2d1e-4b15-9088-04ad4d03ad6a] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:58:03.709959 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5b081be8-2fa3-4b56-bbc7-fee7b53b15d7 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:58:03.710484 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5b081be8-2fa3-4b56-bbc7-fee7b53b15d7 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:58:03.710985 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5b081be8-2fa3-4b56-bbc7-fee7b53b15d7 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:58:03.711717 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5b081be8-2fa3-4b56-bbc7-fee7b53b15d7 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:58:03.712191 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5b081be8-2fa3-4b56-bbc7-fee7b53b15d7 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:58:03.712636 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5b081be8-2fa3-4b56-bbc7-fee7b53b15d7 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:58:03.863434 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-5b081be8-2fa3-4b56-bbc7-fee7b53b15d7 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:58:03.871874 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5b081be8-2fa3-4b56-bbc7-fee7b53b15d7 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a" status: 200 len: 1695 microversion: 2.1 time: 0.177348 Sep 23 05:58:03.872440 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3931/8048] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:58:03 2022] GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a => generated 1695 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:58:04.899043 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9022b3b5-958e-430b-8998-40fa06591ab9 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:58:04.900494 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-9022b3b5-958e-430b-8998-40fa06591ab9 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 7fb3325f-2d1e-4b15-9088-04ad4d03ad6a] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:58:04.907459 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9022b3b5-958e-430b-8998-40fa06591ab9 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:58:04.908021 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9022b3b5-958e-430b-8998-40fa06591ab9 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:58:04.908698 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9022b3b5-958e-430b-8998-40fa06591ab9 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:58:04.910217 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9022b3b5-958e-430b-8998-40fa06591ab9 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:58:04.910687 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9022b3b5-958e-430b-8998-40fa06591ab9 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:58:04.911249 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9022b3b5-958e-430b-8998-40fa06591ab9 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:58:05.075551 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-9022b3b5-958e-430b-8998-40fa06591ab9 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:58:05.084472 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-9022b3b5-958e-430b-8998-40fa06591ab9 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a" status: 200 len: 1695 microversion: 2.1 time: 0.192263 Sep 23 05:58:05.085085 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4118/8049] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:58:04 2022] GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a => generated 1695 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:58:06.111055 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0308088e-47a6-45ba-acc9-bb68ce2b831a tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:58:06.112203 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-0308088e-47a6-45ba-acc9-bb68ce2b831a tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 7fb3325f-2d1e-4b15-9088-04ad4d03ad6a] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:58:06.119639 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0308088e-47a6-45ba-acc9-bb68ce2b831a tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:58:06.120161 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0308088e-47a6-45ba-acc9-bb68ce2b831a tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:58:06.120626 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0308088e-47a6-45ba-acc9-bb68ce2b831a tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:58:06.121370 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0308088e-47a6-45ba-acc9-bb68ce2b831a tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:58:06.122376 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0308088e-47a6-45ba-acc9-bb68ce2b831a tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:58:06.122834 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0308088e-47a6-45ba-acc9-bb68ce2b831a tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:58:06.277765 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-0308088e-47a6-45ba-acc9-bb68ce2b831a tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:58:06.287609 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0308088e-47a6-45ba-acc9-bb68ce2b831a tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a" status: 200 len: 1695 microversion: 2.1 time: 0.182787 Sep 23 05:58:06.289928 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3932/8050] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:58:06 2022] GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a => generated 1695 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:58:07.320032 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d84eece3-a372-4334-8681-b184587c1de3 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:58:07.320651 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d84eece3-a372-4334-8681-b184587c1de3 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 7fb3325f-2d1e-4b15-9088-04ad4d03ad6a] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:58:07.328901 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d84eece3-a372-4334-8681-b184587c1de3 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:58:07.329400 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d84eece3-a372-4334-8681-b184587c1de3 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:58:07.332964 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d84eece3-a372-4334-8681-b184587c1de3 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:58:07.332964 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d84eece3-a372-4334-8681-b184587c1de3 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:58:07.332964 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d84eece3-a372-4334-8681-b184587c1de3 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:58:07.332964 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d84eece3-a372-4334-8681-b184587c1de3 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:58:07.469553 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d84eece3-a372-4334-8681-b184587c1de3 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:58:07.478117 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d84eece3-a372-4334-8681-b184587c1de3 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a" status: 200 len: 1677 microversion: 2.1 time: 0.162018 Sep 23 05:58:07.478702 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4119/8051] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:58:07 2022] GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:58:08.503344 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c384de73-32f9-49f6-aa82-c289d1399ef7 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:58:08.504008 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c384de73-32f9-49f6-aa82-c289d1399ef7 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 7fb3325f-2d1e-4b15-9088-04ad4d03ad6a] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:58:08.511018 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c384de73-32f9-49f6-aa82-c289d1399ef7 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:58:08.511530 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c384de73-32f9-49f6-aa82-c289d1399ef7 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:58:08.512000 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c384de73-32f9-49f6-aa82-c289d1399ef7 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:58:08.512723 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c384de73-32f9-49f6-aa82-c289d1399ef7 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:58:08.513207 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c384de73-32f9-49f6-aa82-c289d1399ef7 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:58:08.513655 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c384de73-32f9-49f6-aa82-c289d1399ef7 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:58:08.645263 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c384de73-32f9-49f6-aa82-c289d1399ef7 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:58:08.653330 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c384de73-32f9-49f6-aa82-c289d1399ef7 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a" status: 200 len: 1677 microversion: 2.1 time: 0.154013 Sep 23 05:58:08.653909 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3933/8052] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:58:08 2022] GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:58:09.677077 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-39b43c2e-bb8a-48ba-a4af-efc77956a09e tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:58:09.677816 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-39b43c2e-bb8a-48ba-a4af-efc77956a09e tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 7fb3325f-2d1e-4b15-9088-04ad4d03ad6a] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:58:09.684462 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-39b43c2e-bb8a-48ba-a4af-efc77956a09e tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:58:09.684945 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-39b43c2e-bb8a-48ba-a4af-efc77956a09e tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:58:09.685382 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-39b43c2e-bb8a-48ba-a4af-efc77956a09e tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:58:09.686107 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-39b43c2e-bb8a-48ba-a4af-efc77956a09e tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:58:09.686562 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-39b43c2e-bb8a-48ba-a4af-efc77956a09e tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:58:09.687019 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-39b43c2e-bb8a-48ba-a4af-efc77956a09e tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:58:09.824847 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-39b43c2e-bb8a-48ba-a4af-efc77956a09e tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:58:09.832682 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-39b43c2e-bb8a-48ba-a4af-efc77956a09e tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a" status: 200 len: 1680 microversion: 2.1 time: 0.160037 Sep 23 05:58:09.833359 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4120/8053] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:58:09 2022] GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:58:09.856179 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d2265166-bc82-4ee0-8730-f1fa35458890 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:58:09.857340 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d2265166-bc82-4ee0-8730-f1fa35458890 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 7fb3325f-2d1e-4b15-9088-04ad4d03ad6a] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:58:09.864917 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d2265166-bc82-4ee0-8730-f1fa35458890 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:58:09.865459 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d2265166-bc82-4ee0-8730-f1fa35458890 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:58:09.865934 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d2265166-bc82-4ee0-8730-f1fa35458890 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:58:09.866657 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d2265166-bc82-4ee0-8730-f1fa35458890 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:58:09.867131 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d2265166-bc82-4ee0-8730-f1fa35458890 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:58:09.867576 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d2265166-bc82-4ee0-8730-f1fa35458890 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:58:09.959302 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-5f08b75e-4e22-4be8-87f1-83a7aaaf6897 req-f403fa36-9991-4223-8cd3-91ab232b63b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fb3325f-2d1e-4b15-9088-04ad4d03ad6a", "name": "network-vif-unplugged", "status": "completed", "tag": "6c24a4aa-6e3a-4ae8-96bc-f30544de8277"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:58:09.966320 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d2265166-bc82-4ee0-8730-f1fa35458890 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 7fb3325f-2d1e-4b15-9088-04ad4d03ad6a] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122698) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 23 05:58:09.972759 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-5f08b75e-4e22-4be8-87f1-83a7aaaf6897 req-f403fa36-9991-4223-8cd3-91ab232b63b2 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:58:09.973332 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-5f08b75e-4e22-4be8-87f1-83a7aaaf6897 req-f403fa36-9991-4223-8cd3-91ab232b63b2 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:58:09.973840 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-5f08b75e-4e22-4be8-87f1-83a7aaaf6897 req-f403fa36-9991-4223-8cd3-91ab232b63b2 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:58:09.985246 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-5f08b75e-4e22-4be8-87f1-83a7aaaf6897 req-f403fa36-9991-4223-8cd3-91ab232b63b2 service nova] Creating event network-vif-unplugged:6c24a4aa-6e3a-4ae8-96bc-f30544de8277 for instance 7fb3325f-2d1e-4b15-9088-04ad4d03ad6a on n-h1-846463-3 Sep 23 05:58:09.991881 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-5f08b75e-4e22-4be8-87f1-83a7aaaf6897 req-f403fa36-9991-4223-8cd3-91ab232b63b2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036687 Sep 23 05:58:09.995128 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4121/8054] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:58:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 05:58:10.324709 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d2265166-bc82-4ee0-8730-f1fa35458890 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "POST /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a/action" status: 202 len: 0 microversion: 2.1 time: 0.472568 Sep 23 05:58:10.327694 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3934/8055] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 05:58:09 2022] POST /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a/action => generated 0 bytes in 474 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 05:58:10.337124 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-0717b68b-bce5-44e2-8b9d-29fd7f7bd333 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:58:10.339210 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-0717b68b-bce5-44e2-8b9d-29fd7f7bd333 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 7fb3325f-2d1e-4b15-9088-04ad4d03ad6a] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:58:10.345925 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0717b68b-bce5-44e2-8b9d-29fd7f7bd333 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:58:10.351288 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0717b68b-bce5-44e2-8b9d-29fd7f7bd333 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:58:10.351288 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0717b68b-bce5-44e2-8b9d-29fd7f7bd333 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:58:10.351288 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0717b68b-bce5-44e2-8b9d-29fd7f7bd333 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:58:10.351288 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0717b68b-bce5-44e2-8b9d-29fd7f7bd333 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:58:10.351288 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-0717b68b-bce5-44e2-8b9d-29fd7f7bd333 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:58:10.485334 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-0717b68b-bce5-44e2-8b9d-29fd7f7bd333 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:58:10.493842 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-0717b68b-bce5-44e2-8b9d-29fd7f7bd333 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a" status: 200 len: 1628 microversion: 2.1 time: 0.162191 Sep 23 05:58:10.494444 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4122/8056] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:58:10 2022] GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a => generated 1628 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:58:11.517865 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-d8001a60-f0db-4bac-8245-2931b8913119 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:58:11.518535 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-d8001a60-f0db-4bac-8245-2931b8913119 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 7fb3325f-2d1e-4b15-9088-04ad4d03ad6a] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:58:11.525692 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d8001a60-f0db-4bac-8245-2931b8913119 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:58:11.526238 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d8001a60-f0db-4bac-8245-2931b8913119 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:58:11.526706 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d8001a60-f0db-4bac-8245-2931b8913119 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:58:11.527420 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d8001a60-f0db-4bac-8245-2931b8913119 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:58:11.527900 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d8001a60-f0db-4bac-8245-2931b8913119 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:58:11.528349 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-d8001a60-f0db-4bac-8245-2931b8913119 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:58:11.666305 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-d8001a60-f0db-4bac-8245-2931b8913119 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:58:11.674147 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-d8001a60-f0db-4bac-8245-2931b8913119 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a" status: 200 len: 1628 microversion: 2.1 time: 0.160224 Sep 23 05:58:11.675378 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3935/8057] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:58:11 2022] GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a => generated 1628 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:58:12.698254 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e6fa7216-11ab-460b-8b62-5060bdac36b6 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:58:12.698929 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e6fa7216-11ab-460b-8b62-5060bdac36b6 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 7fb3325f-2d1e-4b15-9088-04ad4d03ad6a] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:58:12.705460 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e6fa7216-11ab-460b-8b62-5060bdac36b6 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:58:12.706543 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e6fa7216-11ab-460b-8b62-5060bdac36b6 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:58:12.706984 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e6fa7216-11ab-460b-8b62-5060bdac36b6 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:58:12.707676 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e6fa7216-11ab-460b-8b62-5060bdac36b6 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:58:12.708138 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e6fa7216-11ab-460b-8b62-5060bdac36b6 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:58:12.708563 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e6fa7216-11ab-460b-8b62-5060bdac36b6 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:58:12.839295 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e6fa7216-11ab-460b-8b62-5060bdac36b6 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:58:12.841650 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:58:12.847834 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e6fa7216-11ab-460b-8b62-5060bdac36b6 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a" status: 200 len: 1628 microversion: 2.1 time: 0.153528 Sep 23 05:58:12.853327 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4123/8058] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:58:12 2022] GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a => generated 1628 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:58:13.871822 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-eaab3c33-a1e2-4ca9-8b34-faeea1cbb264 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:58:13.872446 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-eaab3c33-a1e2-4ca9-8b34-faeea1cbb264 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 7fb3325f-2d1e-4b15-9088-04ad4d03ad6a] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:58:13.875130 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:58:13.880445 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-eaab3c33-a1e2-4ca9-8b34-faeea1cbb264 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:58:13.880949 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-eaab3c33-a1e2-4ca9-8b34-faeea1cbb264 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:58:13.881396 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-eaab3c33-a1e2-4ca9-8b34-faeea1cbb264 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:58:13.882159 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-eaab3c33-a1e2-4ca9-8b34-faeea1cbb264 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:58:13.882626 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-eaab3c33-a1e2-4ca9-8b34-faeea1cbb264 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:58:13.883058 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-eaab3c33-a1e2-4ca9-8b34-faeea1cbb264 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:58:13.886986 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:58:14.016824 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-eaab3c33-a1e2-4ca9-8b34-faeea1cbb264 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:58:14.025439 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-eaab3c33-a1e2-4ca9-8b34-faeea1cbb264 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a" status: 200 len: 1628 microversion: 2.1 time: 0.157514 Sep 23 05:58:14.026062 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3936/8059] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:58:13 2022] GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a => generated 1628 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:58:15.049836 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ad354ea9-c41b-463c-a493-017d48d60133 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:58:15.050485 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ad354ea9-c41b-463c-a493-017d48d60133 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 7fb3325f-2d1e-4b15-9088-04ad4d03ad6a] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:58:15.052856 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=33 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:58:15.058087 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ad354ea9-c41b-463c-a493-017d48d60133 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:58:15.058566 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ad354ea9-c41b-463c-a493-017d48d60133 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:58:15.059009 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ad354ea9-c41b-463c-a493-017d48d60133 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:58:15.059707 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ad354ea9-c41b-463c-a493-017d48d60133 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:58:15.060168 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ad354ea9-c41b-463c-a493-017d48d60133 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:58:15.060638 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ad354ea9-c41b-463c-a493-017d48d60133 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:58:15.193913 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ad354ea9-c41b-463c-a493-017d48d60133 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:58:15.201604 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ad354ea9-c41b-463c-a493-017d48d60133 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a" status: 200 len: 1686 microversion: 2.1 time: 0.156231 Sep 23 05:58:15.202219 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4124/8060] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:58:15 2022] GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a => generated 1686 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:58:16.227563 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-30dbdb30-d1f5-4f54-8c79-973c2d67a368 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:58:16.231484 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-30dbdb30-d1f5-4f54-8c79-973c2d67a368 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 7fb3325f-2d1e-4b15-9088-04ad4d03ad6a] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:58:16.235534 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-30dbdb30-d1f5-4f54-8c79-973c2d67a368 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:58:16.236058 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-30dbdb30-d1f5-4f54-8c79-973c2d67a368 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:58:16.236521 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-30dbdb30-d1f5-4f54-8c79-973c2d67a368 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:58:16.238028 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-30dbdb30-d1f5-4f54-8c79-973c2d67a368 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:58:16.238513 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-30dbdb30-d1f5-4f54-8c79-973c2d67a368 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:58:16.238964 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-30dbdb30-d1f5-4f54-8c79-973c2d67a368 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:58:16.351167 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-44875cb6-de9e-4f40-9385-ca0d0d20880d req-3bc7de50-73b7-4e89-b917-85ccfdf699d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fb3325f-2d1e-4b15-9088-04ad4d03ad6a", "tag": "6c24a4aa-6e3a-4ae8-96bc-f30544de8277"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:58:16.361716 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-44875cb6-de9e-4f40-9385-ca0d0d20880d req-3bc7de50-73b7-4e89-b917-85ccfdf699d8 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:58:16.369015 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-44875cb6-de9e-4f40-9385-ca0d0d20880d req-3bc7de50-73b7-4e89-b917-85ccfdf699d8 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:58:16.369015 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-44875cb6-de9e-4f40-9385-ca0d0d20880d req-3bc7de50-73b7-4e89-b917-85ccfdf699d8 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:58:16.377323 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-44875cb6-de9e-4f40-9385-ca0d0d20880d req-3bc7de50-73b7-4e89-b917-85ccfdf699d8 service nova] Creating event network-changed:6c24a4aa-6e3a-4ae8-96bc-f30544de8277 for instance 7fb3325f-2d1e-4b15-9088-04ad4d03ad6a on n-h2-846463-3 Sep 23 05:58:16.384841 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-44875cb6-de9e-4f40-9385-ca0d0d20880d req-3bc7de50-73b7-4e89-b917-85ccfdf699d8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037340 Sep 23 05:58:16.385771 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4125/8061] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:58:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 05:58:16.395275 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-30dbdb30-d1f5-4f54-8c79-973c2d67a368 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:58:16.403478 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-30dbdb30-d1f5-4f54-8c79-973c2d67a368 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a" status: 200 len: 1686 microversion: 2.1 time: 0.180422 Sep 23 05:58:16.404382 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3937/8062] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:58:16 2022] GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a => generated 1686 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:58:17.429269 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d3ae4463-0591-4dcb-bcad-07f6984e340c tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:58:17.430018 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d3ae4463-0591-4dcb-bcad-07f6984e340c tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 7fb3325f-2d1e-4b15-9088-04ad4d03ad6a] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:58:17.439541 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d3ae4463-0591-4dcb-bcad-07f6984e340c tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:58:17.441280 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d3ae4463-0591-4dcb-bcad-07f6984e340c tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:58:17.442160 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d3ae4463-0591-4dcb-bcad-07f6984e340c tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:58:17.443487 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d3ae4463-0591-4dcb-bcad-07f6984e340c tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:58:17.444296 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d3ae4463-0591-4dcb-bcad-07f6984e340c tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:58:17.444895 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-d3ae4463-0591-4dcb-bcad-07f6984e340c tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:58:17.624414 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d3ae4463-0591-4dcb-bcad-07f6984e340c tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:58:17.634767 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d3ae4463-0591-4dcb-bcad-07f6984e340c tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a" status: 200 len: 1686 microversion: 2.1 time: 0.210715 Sep 23 05:58:17.650823 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4126/8063] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:58:17 2022] GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a => generated 1686 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:58:18.662844 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2542838a-ca86-4bd5-a240-12e25b38f1d3 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:58:18.664231 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-2542838a-ca86-4bd5-a240-12e25b38f1d3 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 7fb3325f-2d1e-4b15-9088-04ad4d03ad6a] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:58:18.671376 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2542838a-ca86-4bd5-a240-12e25b38f1d3 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:58:18.671965 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2542838a-ca86-4bd5-a240-12e25b38f1d3 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:58:18.672432 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2542838a-ca86-4bd5-a240-12e25b38f1d3 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:58:18.673159 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2542838a-ca86-4bd5-a240-12e25b38f1d3 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:58:18.673643 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2542838a-ca86-4bd5-a240-12e25b38f1d3 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:58:18.674623 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2542838a-ca86-4bd5-a240-12e25b38f1d3 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:58:18.815790 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-2542838a-ca86-4bd5-a240-12e25b38f1d3 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:58:18.823969 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2542838a-ca86-4bd5-a240-12e25b38f1d3 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a" status: 200 len: 1686 microversion: 2.1 time: 0.165146 Sep 23 05:58:18.824593 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3938/8064] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:58:18 2022] GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a => generated 1686 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:58:19.850025 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-019f4d60-a9af-4663-b96a-dbd739eb37c8 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:58:19.850868 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-019f4d60-a9af-4663-b96a-dbd739eb37c8 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 7fb3325f-2d1e-4b15-9088-04ad4d03ad6a] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:58:19.862722 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-019f4d60-a9af-4663-b96a-dbd739eb37c8 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:58:19.863224 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-019f4d60-a9af-4663-b96a-dbd739eb37c8 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:58:19.863662 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-019f4d60-a9af-4663-b96a-dbd739eb37c8 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:58:19.864367 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-019f4d60-a9af-4663-b96a-dbd739eb37c8 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:58:19.864822 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-019f4d60-a9af-4663-b96a-dbd739eb37c8 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:58:19.865246 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-019f4d60-a9af-4663-b96a-dbd739eb37c8 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:58:20.025367 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-019f4d60-a9af-4663-b96a-dbd739eb37c8 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:58:20.043029 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-019f4d60-a9af-4663-b96a-dbd739eb37c8 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a" status: 200 len: 1686 microversion: 2.1 time: 0.197353 Sep 23 05:58:20.043642 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4127/8065] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:58:19 2022] GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a => generated 1686 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:58:21.071806 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-1f59a788-ccd1-42bf-8b6d-80335d297594 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:58:21.072402 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-1f59a788-ccd1-42bf-8b6d-80335d297594 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 7fb3325f-2d1e-4b15-9088-04ad4d03ad6a] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:58:21.079277 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1f59a788-ccd1-42bf-8b6d-80335d297594 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:58:21.079788 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1f59a788-ccd1-42bf-8b6d-80335d297594 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:58:21.080749 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1f59a788-ccd1-42bf-8b6d-80335d297594 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:58:21.081451 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1f59a788-ccd1-42bf-8b6d-80335d297594 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:58:21.081949 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1f59a788-ccd1-42bf-8b6d-80335d297594 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:58:21.082404 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-1f59a788-ccd1-42bf-8b6d-80335d297594 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:58:21.220434 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-1f59a788-ccd1-42bf-8b6d-80335d297594 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:58:21.228375 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-1f59a788-ccd1-42bf-8b6d-80335d297594 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a" status: 200 len: 1686 microversion: 2.1 time: 0.160584 Sep 23 05:58:21.228962 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3939/8066] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:58:21 2022] GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a => generated 1686 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:58:22.251877 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-35f640af-4f7e-4770-a7d0-e27490352ce8 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:58:22.253126 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-35f640af-4f7e-4770-a7d0-e27490352ce8 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 7fb3325f-2d1e-4b15-9088-04ad4d03ad6a] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:58:22.267342 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-35f640af-4f7e-4770-a7d0-e27490352ce8 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:58:22.268409 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-35f640af-4f7e-4770-a7d0-e27490352ce8 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:58:22.268861 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-35f640af-4f7e-4770-a7d0-e27490352ce8 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:58:22.269590 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-35f640af-4f7e-4770-a7d0-e27490352ce8 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:58:22.270235 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-35f640af-4f7e-4770-a7d0-e27490352ce8 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:58:22.270673 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-35f640af-4f7e-4770-a7d0-e27490352ce8 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:58:22.420774 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-35f640af-4f7e-4770-a7d0-e27490352ce8 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:58:22.432776 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-35f640af-4f7e-4770-a7d0-e27490352ce8 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a" status: 200 len: 1686 microversion: 2.1 time: 0.185012 Sep 23 05:58:22.433757 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4128/8067] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:58:22 2022] GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a => generated 1686 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:58:23.457141 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-97de78b1-36a6-46f1-a040-19a698aee426 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:58:23.457739 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-97de78b1-36a6-46f1-a040-19a698aee426 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 7fb3325f-2d1e-4b15-9088-04ad4d03ad6a] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:58:23.464809 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-97de78b1-36a6-46f1-a040-19a698aee426 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:58:23.465335 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-97de78b1-36a6-46f1-a040-19a698aee426 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:58:23.465799 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-97de78b1-36a6-46f1-a040-19a698aee426 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:58:23.466699 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-97de78b1-36a6-46f1-a040-19a698aee426 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:58:23.467185 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-97de78b1-36a6-46f1-a040-19a698aee426 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:58:23.467633 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-97de78b1-36a6-46f1-a040-19a698aee426 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:58:23.606772 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-97de78b1-36a6-46f1-a040-19a698aee426 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:58:23.614576 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-97de78b1-36a6-46f1-a040-19a698aee426 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a" status: 200 len: 1686 microversion: 2.1 time: 0.161628 Sep 23 05:58:23.615159 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3940/8068] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:58:23 2022] GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a => generated 1686 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:58:24.638814 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-883706e9-5535-4e61-a743-436be706bd2a tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:58:24.639427 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-883706e9-5535-4e61-a743-436be706bd2a tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 7fb3325f-2d1e-4b15-9088-04ad4d03ad6a] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:58:24.646614 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-883706e9-5535-4e61-a743-436be706bd2a tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:58:24.647114 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-883706e9-5535-4e61-a743-436be706bd2a tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:58:24.647565 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-883706e9-5535-4e61-a743-436be706bd2a tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:58:24.648530 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-883706e9-5535-4e61-a743-436be706bd2a tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:58:24.648994 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-883706e9-5535-4e61-a743-436be706bd2a tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:58:24.649425 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-883706e9-5535-4e61-a743-436be706bd2a tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:58:24.791710 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-883706e9-5535-4e61-a743-436be706bd2a tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:58:24.800005 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-883706e9-5535-4e61-a743-436be706bd2a tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a" status: 200 len: 1686 microversion: 2.1 time: 0.165154 Sep 23 05:58:24.800581 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4129/8069] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:58:24 2022] GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a => generated 1686 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:58:25.824145 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5621297d-c884-4156-bd7b-0e17e4ac8ffb tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:58:25.824811 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5621297d-c884-4156-bd7b-0e17e4ac8ffb tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 7fb3325f-2d1e-4b15-9088-04ad4d03ad6a] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:58:25.832390 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5621297d-c884-4156-bd7b-0e17e4ac8ffb tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:58:25.835997 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5621297d-c884-4156-bd7b-0e17e4ac8ffb tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:58:25.835997 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5621297d-c884-4156-bd7b-0e17e4ac8ffb tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:58:25.835997 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5621297d-c884-4156-bd7b-0e17e4ac8ffb tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:58:25.835997 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5621297d-c884-4156-bd7b-0e17e4ac8ffb tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:58:25.835997 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5621297d-c884-4156-bd7b-0e17e4ac8ffb tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:58:25.969667 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-5621297d-c884-4156-bd7b-0e17e4ac8ffb tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:58:25.977553 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5621297d-c884-4156-bd7b-0e17e4ac8ffb tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a" status: 200 len: 1686 microversion: 2.1 time: 0.157430 Sep 23 05:58:25.978165 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3941/8070] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:58:25 2022] GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a => generated 1686 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:58:27.000304 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-410f5429-96fd-4a5f-9620-3d3f234fbdc7 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:58:27.000930 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-410f5429-96fd-4a5f-9620-3d3f234fbdc7 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 7fb3325f-2d1e-4b15-9088-04ad4d03ad6a] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:58:27.008144 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-410f5429-96fd-4a5f-9620-3d3f234fbdc7 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:58:27.008641 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-410f5429-96fd-4a5f-9620-3d3f234fbdc7 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:58:27.009091 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-410f5429-96fd-4a5f-9620-3d3f234fbdc7 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:58:27.009797 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-410f5429-96fd-4a5f-9620-3d3f234fbdc7 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:58:27.010289 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-410f5429-96fd-4a5f-9620-3d3f234fbdc7 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:58:27.010720 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-410f5429-96fd-4a5f-9620-3d3f234fbdc7 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:58:27.143753 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-410f5429-96fd-4a5f-9620-3d3f234fbdc7 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:58:27.151845 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-410f5429-96fd-4a5f-9620-3d3f234fbdc7 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a" status: 200 len: 1686 microversion: 2.1 time: 0.155475 Sep 23 05:58:27.159086 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4130/8071] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:58:26 2022] GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a => generated 1686 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:58:28.176268 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4648595a-2d69-406d-8ef1-3b8ea4521a98 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:58:28.177070 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4648595a-2d69-406d-8ef1-3b8ea4521a98 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 7fb3325f-2d1e-4b15-9088-04ad4d03ad6a] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:58:28.185340 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4648595a-2d69-406d-8ef1-3b8ea4521a98 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:58:28.185854 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4648595a-2d69-406d-8ef1-3b8ea4521a98 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:58:28.186392 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4648595a-2d69-406d-8ef1-3b8ea4521a98 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:58:28.187081 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4648595a-2d69-406d-8ef1-3b8ea4521a98 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:58:28.187645 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4648595a-2d69-406d-8ef1-3b8ea4521a98 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:58:28.188081 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4648595a-2d69-406d-8ef1-3b8ea4521a98 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:58:28.337270 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4648595a-2d69-406d-8ef1-3b8ea4521a98 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:58:28.345366 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4648595a-2d69-406d-8ef1-3b8ea4521a98 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a" status: 200 len: 1686 microversion: 2.1 time: 0.173315 Sep 23 05:58:28.346046 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3942/8072] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:58:28 2022] GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a => generated 1686 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:58:29.370625 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-026a7512-5597-4ed1-aed9-5ddc7c47db9e tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:58:29.371287 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-026a7512-5597-4ed1-aed9-5ddc7c47db9e tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 7fb3325f-2d1e-4b15-9088-04ad4d03ad6a] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:58:29.379431 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-026a7512-5597-4ed1-aed9-5ddc7c47db9e tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:58:29.382695 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-026a7512-5597-4ed1-aed9-5ddc7c47db9e tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:58:29.382695 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-026a7512-5597-4ed1-aed9-5ddc7c47db9e tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:58:29.382695 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-026a7512-5597-4ed1-aed9-5ddc7c47db9e tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:58:29.382695 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-026a7512-5597-4ed1-aed9-5ddc7c47db9e tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:58:29.382695 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-026a7512-5597-4ed1-aed9-5ddc7c47db9e tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:58:29.514865 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-026a7512-5597-4ed1-aed9-5ddc7c47db9e tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:58:29.523621 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-026a7512-5597-4ed1-aed9-5ddc7c47db9e tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a" status: 200 len: 1686 microversion: 2.1 time: 0.156672 Sep 23 05:58:29.524401 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4131/8073] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:58:29 2022] GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a => generated 1686 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:58:30.546911 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-bf3a3083-4100-494f-b28f-057788995d3c tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:58:30.547548 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-bf3a3083-4100-494f-b28f-057788995d3c tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 7fb3325f-2d1e-4b15-9088-04ad4d03ad6a] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:58:30.554994 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bf3a3083-4100-494f-b28f-057788995d3c tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:58:30.555501 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bf3a3083-4100-494f-b28f-057788995d3c tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:58:30.555957 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bf3a3083-4100-494f-b28f-057788995d3c tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:58:30.556671 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bf3a3083-4100-494f-b28f-057788995d3c tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:58:30.557149 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bf3a3083-4100-494f-b28f-057788995d3c tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:58:30.557594 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-bf3a3083-4100-494f-b28f-057788995d3c tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:58:30.690655 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-bf3a3083-4100-494f-b28f-057788995d3c tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:58:30.698495 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-bf3a3083-4100-494f-b28f-057788995d3c tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a" status: 200 len: 1686 microversion: 2.1 time: 0.155540 Sep 23 05:58:30.699070 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3943/8074] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:58:30 2022] GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a => generated 1686 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:58:31.078583 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-46a07893-79dd-49a2-981b-8d85dfdbd4aa req-9ba101ae-3090-4bce-b91e-95198cd1af0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fb3325f-2d1e-4b15-9088-04ad4d03ad6a", "name": "network-vif-plugged", "status": "completed", "tag": "6c24a4aa-6e3a-4ae8-96bc-f30544de8277"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:58:31.088811 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-46a07893-79dd-49a2-981b-8d85dfdbd4aa req-9ba101ae-3090-4bce-b91e-95198cd1af0e service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:58:31.089297 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-46a07893-79dd-49a2-981b-8d85dfdbd4aa req-9ba101ae-3090-4bce-b91e-95198cd1af0e service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:58:31.089733 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-46a07893-79dd-49a2-981b-8d85dfdbd4aa req-9ba101ae-3090-4bce-b91e-95198cd1af0e service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:58:31.101459 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-46a07893-79dd-49a2-981b-8d85dfdbd4aa req-9ba101ae-3090-4bce-b91e-95198cd1af0e service nova] Creating event network-vif-plugged:6c24a4aa-6e3a-4ae8-96bc-f30544de8277 for instance 7fb3325f-2d1e-4b15-9088-04ad4d03ad6a on n-h2-846463-3 Sep 23 05:58:31.106627 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-46a07893-79dd-49a2-981b-8d85dfdbd4aa req-9ba101ae-3090-4bce-b91e-95198cd1af0e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031790 Sep 23 05:58:31.107236 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4132/8075] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:58:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:58:31.722432 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ec16ab57-e103-4ef4-8525-c3be1bbe3dd9 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:58:31.723162 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-ec16ab57-e103-4ef4-8525-c3be1bbe3dd9 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 7fb3325f-2d1e-4b15-9088-04ad4d03ad6a] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:58:31.730220 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ec16ab57-e103-4ef4-8525-c3be1bbe3dd9 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:58:31.730734 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ec16ab57-e103-4ef4-8525-c3be1bbe3dd9 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:58:31.731203 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ec16ab57-e103-4ef4-8525-c3be1bbe3dd9 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:58:31.731924 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ec16ab57-e103-4ef4-8525-c3be1bbe3dd9 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:58:31.732406 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ec16ab57-e103-4ef4-8525-c3be1bbe3dd9 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:58:31.732857 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ec16ab57-e103-4ef4-8525-c3be1bbe3dd9 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:58:31.864322 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ec16ab57-e103-4ef4-8525-c3be1bbe3dd9 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:58:31.872129 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ec16ab57-e103-4ef4-8525-c3be1bbe3dd9 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a" status: 200 len: 1686 microversion: 2.1 time: 0.154299 Sep 23 05:58:31.872717 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3944/8076] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:58:31 2022] GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a => generated 1686 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:58:32.899741 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-84fa501f-5cf7-463a-b766-a6e0c3529364 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:58:32.900723 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-84fa501f-5cf7-463a-b766-a6e0c3529364 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 7fb3325f-2d1e-4b15-9088-04ad4d03ad6a] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:58:32.906717 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-84fa501f-5cf7-463a-b766-a6e0c3529364 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:58:32.907204 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-84fa501f-5cf7-463a-b766-a6e0c3529364 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:58:32.907947 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-84fa501f-5cf7-463a-b766-a6e0c3529364 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:58:32.909027 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-84fa501f-5cf7-463a-b766-a6e0c3529364 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:58:32.909492 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-84fa501f-5cf7-463a-b766-a6e0c3529364 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:58:32.909946 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-84fa501f-5cf7-463a-b766-a6e0c3529364 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:58:33.049633 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-84fa501f-5cf7-463a-b766-a6e0c3529364 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:58:33.057524 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-84fa501f-5cf7-463a-b766-a6e0c3529364 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a" status: 200 len: 1686 microversion: 2.1 time: 0.165149 Sep 23 05:58:33.058132 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4133/8077] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:58:32 2022] GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a => generated 1686 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:58:34.081217 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-262e1832-a90a-4bad-9c80-df862d626a5f tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:58:34.081857 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-262e1832-a90a-4bad-9c80-df862d626a5f tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 7fb3325f-2d1e-4b15-9088-04ad4d03ad6a] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:58:34.088885 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-262e1832-a90a-4bad-9c80-df862d626a5f tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:58:34.089401 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-262e1832-a90a-4bad-9c80-df862d626a5f tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:58:34.089864 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-262e1832-a90a-4bad-9c80-df862d626a5f tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:58:34.090615 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-262e1832-a90a-4bad-9c80-df862d626a5f tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:58:34.091099 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-262e1832-a90a-4bad-9c80-df862d626a5f tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:58:34.091550 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-262e1832-a90a-4bad-9c80-df862d626a5f tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:58:34.228113 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-262e1832-a90a-4bad-9c80-df862d626a5f tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:58:34.235934 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-262e1832-a90a-4bad-9c80-df862d626a5f tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a" status: 200 len: 1673 microversion: 2.1 time: 0.158787 Sep 23 05:58:34.237091 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3945/8078] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:58:34 2022] GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a => generated 1673 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:59:45.859723 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=19 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:59:45.862499 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=59 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:59:45.862644 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5f0fdfa7-a5a1-4129-ad15-3f09b3cc1a5e tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:59:45.863065 n-d-846463-3 devstack@n-api.service[122698]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 05:59:45.863176 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-5f0fdfa7-a5a1-4129-ad15-3f09b3cc1a5e tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 7fb3325f-2d1e-4b15-9088-04ad4d03ad6a] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:59:45.863279 n-d-846463-3 devstack@n-api.service[122698]: Fri Sep 23 05:59:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.33) !!! Sep 23 05:59:45.867586 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-28a4e50f-5eac-4d6e-a390-cc0c24dc2435 req-4805493c-4e52-4ab8-ad42-d4f4a8c6188c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fb3325f-2d1e-4b15-9088-04ad4d03ad6a", "tag": "6c24a4aa-6e3a-4ae8-96bc-f30544de8277"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:59:45.869427 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=19 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:59:45.870308 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=53 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 05:59:45.871462 n-d-846463-3 devstack@n-api.service[122699]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 05:59:45.871635 n-d-846463-3 devstack@n-api.service[122699]: Fri Sep 23 05:59:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a (ip 10.222.0.33) !!! Sep 23 05:59:45.875491 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5f0fdfa7-a5a1-4129-ad15-3f09b3cc1a5e tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:59:45.875491 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5f0fdfa7-a5a1-4129-ad15-3f09b3cc1a5e tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:59:45.877374 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5f0fdfa7-a5a1-4129-ad15-3f09b3cc1a5e tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:59:45.878210 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5f0fdfa7-a5a1-4129-ad15-3f09b3cc1a5e tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:59:45.878792 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5f0fdfa7-a5a1-4129-ad15-3f09b3cc1a5e tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:59:45.879164 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-28a4e50f-5eac-4d6e-a390-cc0c24dc2435 req-4805493c-4e52-4ab8-ad42-d4f4a8c6188c service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:59:45.879671 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-28a4e50f-5eac-4d6e-a390-cc0c24dc2435 req-4805493c-4e52-4ab8-ad42-d4f4a8c6188c service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:59:45.879896 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5f0fdfa7-a5a1-4129-ad15-3f09b3cc1a5e tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:59:45.880182 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-28a4e50f-5eac-4d6e-a390-cc0c24dc2435 req-4805493c-4e52-4ab8-ad42-d4f4a8c6188c service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:59:45.896720 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-28a4e50f-5eac-4d6e-a390-cc0c24dc2435 req-4805493c-4e52-4ab8-ad42-d4f4a8c6188c service nova] Creating event network-changed:6c24a4aa-6e3a-4ae8-96bc-f30544de8277 for instance 7fb3325f-2d1e-4b15-9088-04ad4d03ad6a on n-h2-846463-3 Sep 23 05:59:45.905518 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-28a4e50f-5eac-4d6e-a390-cc0c24dc2435 req-4805493c-4e52-4ab8-ad42-d4f4a8c6188c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046290 Sep 23 05:59:45.906497 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3946/8079] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:59:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 05:59:45.913197 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-5f0fdfa7-a5a1-4129-ad15-3f09b3cc1a5e tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 7fb3325f-2d1e-4b15-9088-04ad4d03ad6a] Going to try to terminate instance {{(pid=122699) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 05:59:46.182238 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5f0fdfa7-a5a1-4129-ad15-3f09b3cc1a5e tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "DELETE /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a" status: 204 len: 0 microversion: 2.1 time: 0.326900 Sep 23 05:59:46.184915 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4134/8080] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 05:59:45 2022] DELETE /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 05:59:46.193366 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5067fcb6-4aac-49c2-90ef-b215fafa7798 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:59:46.194304 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5067fcb6-4aac-49c2-90ef-b215fafa7798 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 7fb3325f-2d1e-4b15-9088-04ad4d03ad6a] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:59:46.200767 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5067fcb6-4aac-49c2-90ef-b215fafa7798 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:59:46.201572 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5067fcb6-4aac-49c2-90ef-b215fafa7798 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:59:46.202080 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5067fcb6-4aac-49c2-90ef-b215fafa7798 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:59:46.203343 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5067fcb6-4aac-49c2-90ef-b215fafa7798 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:59:46.203925 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5067fcb6-4aac-49c2-90ef-b215fafa7798 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:59:46.204380 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5067fcb6-4aac-49c2-90ef-b215fafa7798 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:59:46.345257 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-5067fcb6-4aac-49c2-90ef-b215fafa7798 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:59:46.352997 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5067fcb6-4aac-49c2-90ef-b215fafa7798 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a" status: 200 len: 1679 microversion: 2.1 time: 0.165203 Sep 23 05:59:46.353580 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3947/8081] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:59:46 2022] GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a => generated 1679 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:59:47.377367 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-3779be3a-0b4e-4260-b8dc-69e1d870c406 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:59:47.378217 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-3779be3a-0b4e-4260-b8dc-69e1d870c406 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 7fb3325f-2d1e-4b15-9088-04ad4d03ad6a] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:59:47.384804 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3779be3a-0b4e-4260-b8dc-69e1d870c406 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:59:47.385305 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3779be3a-0b4e-4260-b8dc-69e1d870c406 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:59:47.385754 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3779be3a-0b4e-4260-b8dc-69e1d870c406 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:59:47.386494 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3779be3a-0b4e-4260-b8dc-69e1d870c406 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:59:47.386956 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3779be3a-0b4e-4260-b8dc-69e1d870c406 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:59:47.387402 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-3779be3a-0b4e-4260-b8dc-69e1d870c406 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:59:47.531057 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-3779be3a-0b4e-4260-b8dc-69e1d870c406 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:59:47.539564 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-3779be3a-0b4e-4260-b8dc-69e1d870c406 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a" status: 200 len: 1679 microversion: 2.1 time: 0.166476 Sep 23 05:59:47.540153 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4135/8082] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:59:47 2022] GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a => generated 1679 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:59:48.008465 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-f88685ad-36c1-4ee5-b795-a7f1562775a1 req-0e9167f3-77c5-4eb7-9c78-182138fca5ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fb3325f-2d1e-4b15-9088-04ad4d03ad6a", "name": "network-vif-deleted", "tag": "6c24a4aa-6e3a-4ae8-96bc-f30544de8277"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:59:48.019545 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-f88685ad-36c1-4ee5-b795-a7f1562775a1 req-0e9167f3-77c5-4eb7-9c78-182138fca5ae service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:59:48.020042 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-f88685ad-36c1-4ee5-b795-a7f1562775a1 req-0e9167f3-77c5-4eb7-9c78-182138fca5ae service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:59:48.020514 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-f88685ad-36c1-4ee5-b795-a7f1562775a1 req-0e9167f3-77c5-4eb7-9c78-182138fca5ae service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:59:48.032053 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-f88685ad-36c1-4ee5-b795-a7f1562775a1 req-0e9167f3-77c5-4eb7-9c78-182138fca5ae service nova] Creating event network-vif-deleted:6c24a4aa-6e3a-4ae8-96bc-f30544de8277 for instance 7fb3325f-2d1e-4b15-9088-04ad4d03ad6a on n-h2-846463-3 Sep 23 05:59:48.037025 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-f88685ad-36c1-4ee5-b795-a7f1562775a1 req-0e9167f3-77c5-4eb7-9c78-182138fca5ae service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032327 Sep 23 05:59:48.037612 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3948/8083] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 05:59:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 05:59:48.563774 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7b371569-a542-49a7-af4e-58e7f3aea37c tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:59:48.564896 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-7b371569-a542-49a7-af4e-58e7f3aea37c tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 7fb3325f-2d1e-4b15-9088-04ad4d03ad6a] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:59:48.571379 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7b371569-a542-49a7-af4e-58e7f3aea37c tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:59:48.571874 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7b371569-a542-49a7-af4e-58e7f3aea37c tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:59:48.572321 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7b371569-a542-49a7-af4e-58e7f3aea37c tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:59:48.573015 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7b371569-a542-49a7-af4e-58e7f3aea37c tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:59:48.573481 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7b371569-a542-49a7-af4e-58e7f3aea37c tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:59:48.573928 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7b371569-a542-49a7-af4e-58e7f3aea37c tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:59:48.603978 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7b371569-a542-49a7-af4e-58e7f3aea37c tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:59:48.604456 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7b371569-a542-49a7-af4e-58e7f3aea37c tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:59:48.604896 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7b371569-a542-49a7-af4e-58e7f3aea37c tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:59:48.605340 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.objects.instance [None req-7b371569-a542-49a7-af4e-58e7f3aea37c tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lazy-loading 'fault' on Instance uuid 7fb3325f-2d1e-4b15-9088-04ad4d03ad6a {{(pid=122699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 05:59:48.646033 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-7b371569-a542-49a7-af4e-58e7f3aea37c tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 05:59:48.654301 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-7b371569-a542-49a7-af4e-58e7f3aea37c tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a" status: 200 len: 1336 microversion: 2.1 time: 0.094546 Sep 23 05:59:48.654887 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4136/8084] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:59:48 2022] GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a => generated 1336 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 05:59:49.678390 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3f2fa437-755b-46cf-8dd4-c6cc9ef4fcee tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:59:49.679107 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3f2fa437-755b-46cf-8dd4-c6cc9ef4fcee tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 7fb3325f-2d1e-4b15-9088-04ad4d03ad6a] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 05:59:49.685598 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3f2fa437-755b-46cf-8dd4-c6cc9ef4fcee tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:59:49.686141 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3f2fa437-755b-46cf-8dd4-c6cc9ef4fcee tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:59:49.686606 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3f2fa437-755b-46cf-8dd4-c6cc9ef4fcee tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:59:49.687330 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3f2fa437-755b-46cf-8dd4-c6cc9ef4fcee tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 05:59:49.687812 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3f2fa437-755b-46cf-8dd4-c6cc9ef4fcee tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 05:59:49.688262 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3f2fa437-755b-46cf-8dd4-c6cc9ef4fcee tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 05:59:49.702207 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-3f2fa437-755b-46cf-8dd4-c6cc9ef4fcee tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] HTTP exception thrown: Instance 7fb3325f-2d1e-4b15-9088-04ad4d03ad6a could not be found. Sep 23 05:59:49.703863 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3f2fa437-755b-46cf-8dd4-c6cc9ef4fcee tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Request method failure captured: Sep 23 05:59:49.703863 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a HTTP/1.1 Sep 23 05:59:49.703863 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 05:59:49.703863 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 05:59:49.703863 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 05:59:49.703863 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 05:59:49.703863 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 05:59:49.703863 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 05:59:49.703863 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 05:59:49.703863 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 05:59:49.703863 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLUpL_GpPY3rMYfaRzw1KBWNuFFuAbuLkf9vxNdauuGts65mPUhhMLPtVaWGcu9KEyXkszWn0usznArU7yZENKzj2QCg1Y1DjtrPVGfIMjfcC7j1w_KWHsixEVb5dJsClGc7RVKET0BDn6W3aTQGEoiSPDoU9-6hMZTxWJkVFtxTOS2I Sep 23 05:59:49.703863 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 05:59:49.703863 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 05:59:49.703863 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 05:59:49.703863 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 05:59:49.703863 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 05:59:49.703863 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 05:59:49.703863 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: 93cf9690c0ef4fcf925253bed0fcd6a7 Sep 23 05:59:49.703863 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-TestShelveInstance-1773482243 Sep 23 05:59:49.703863 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 05:59:49.703863 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 05:59:49.703863 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_93cf9690c0ef4fcf925253bed0fcd6a7", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/93cf9690c0ef4fcf925253bed0fcd6a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/93cf9690c0ef4fcf925253bed0fcd6a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/93cf9690c0ef4fcf925253bed0fcd6a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 05:59:49.703863 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-TestShelveInstance-1773482243 Sep 23 05:59:49.703863 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: 93cf9690c0ef4fcf925253bed0fcd6a7 Sep 23 05:59:49.703863 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-TestShelveInstance-1773482243 Sep 23 05:59:49.703863 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-TestShelveInstance-1773482243-project Sep 23 05:59:49.703863 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 05:59:49.703863 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 05:59:49.703863 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: 0b929c8797a041c683b207e2d20d25b2 Sep 23 05:59:49.703863 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-TestShelveInstance-1773482243-project Sep 23 05:59:49.703863 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 05:59:49.703863 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 7fb3325f-2d1e-4b15-9088-04ad4d03ad6a could not be found. Sep 23 05:59:49.703863 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '7fb3325f-2d1e-4b15-9088-04ad4d03ad6a'} Sep 23 05:59:49.703863 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 05:59:49.703863 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:59:49.703863 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 05:59:49.703863 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 05:59:49.703863 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 05:59:49.703863 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 05:59:49.703863 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 05:59:49.703863 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 05:59:49.703863 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 05:59:49.703863 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 05:59:49.703863 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fb3325f-2d1e-4b15-9088-04ad4d03ad6a could not be found. Sep 23 05:59:49.703863 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:59:49.703863 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:59:49.703863 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:59:49.703863 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:59:49.703863 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:59:49.703863 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:59:49.703863 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 05:59:49.703863 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 05:59:49.703863 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 05:59:49.703863 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 05:59:49.703863 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 05:59:49.703863 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 05:59:49.703863 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 05:59:49.703863 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 05:59:49.703863 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 05:59:49.703863 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 05:59:49.703863 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fb3325f-2d1e-4b15-9088-04ad4d03ad6a could not be found. Sep 23 05:59:49.703863 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:59:49.703863 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 05:59:49.703863 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:59:49.710748 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 05:59:49.710748 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 05:59:49.710748 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 05:59:49.710748 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 05:59:49.710748 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 05:59:49.710748 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fb3325f-2d1e-4b15-9088-04ad4d03ad6a could not be found. Sep 23 05:59:49.710748 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 05:59:49.710748 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3f2fa437-755b-46cf-8dd4-c6cc9ef4fcee tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Returning 404 to user: Instance 7fb3325f-2d1e-4b15-9088-04ad4d03ad6a could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 05:59:49.710748 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3f2fa437-755b-46cf-8dd4-c6cc9ef4fcee tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a" status: 404 len: 111 microversion: 2.1 time: 0.032960 Sep 23 05:59:49.710748 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3949/8085] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 05:59:49 2022] GET /compute/v2.1/servers/7fb3325f-2d1e-4b15-9088-04ad4d03ad6a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 05:59:49.939618 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-89d2f489-24f8-41ed-9950-e0fff62e0a64 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '.version_select at 0x7ff1ba59e940>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 05:59:49.944363 n-d-846463-3 devstack@n-api.service[122699]: ERROR oslo.messaging._drivers.impl_rabbit [None req-89d2f489-24f8-41ed-9950-e0fff62e0a64 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [77f72e41-09e4-435a-9369-351999b7498d] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 23 05:59:50.952021 n-d-846463-3 devstack@n-api.service[122699]: INFO oslo.messaging._drivers.impl_rabbit [None req-89d2f489-24f8-41ed-9950-e0fff62e0a64 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [77f72e41-09e4-435a-9369-351999b7498d] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 56506. Sep 23 05:59:51.039676 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-89d2f489-24f8-41ed-9950-e0fff62e0a64 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-482879276" status: 202 len: 0 microversion: 2.1 time: 1.104527 Sep 23 05:59:51.040297 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4137/8086] 10.222.0.33 () {58 vars in 1251 bytes} [Fri Sep 23 05:59:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-482879276 => generated 0 bytes in 1106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 05:59:51.069148 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2324403b-478c-4613-8c01-a6b22bf5a6c3 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Action: 'create', calling method: .version_select at 0x7ff1ba714b80>, body: {"keypair": {"name": "tempest-TestShelveInstance-499892786", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC/E8MPmR2w1JTR2KoJAlSh8xqCj6qtyIhzttVsxv/P7iml7GgJQbGvqu6EmXgyfPLYGhj/Cj5HcBr/JHjqf/CXlHvWvBC0+pCb9kPP61s3v8h+5vN8bjQC4j7AAJmxrPw=="}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 05:59:51.088160 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-2324403b-478c-4613-8c01-a6b22bf5a6c3 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Getting quotas for project 93cf9690c0ef4fcf925253bed0fcd6a7. Resources: {'key_pairs'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 05:59:51.091266 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-2324403b-478c-4613-8c01-a6b22bf5a6c3 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Getting quotas for user 0b929c8797a041c683b207e2d20d25b2 and project 93cf9690c0ef4fcf925253bed0fcd6a7. Resources: {'key_pairs'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 05:59:51.104986 n-d-846463-3 devstack@n-api.service[122698]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2324403b-478c-4613-8c01-a6b22bf5a6c3 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [6cdd8a14-50a8-4880-b40e-d5bfc2780872] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 23 05:59:52.114231 n-d-846463-3 devstack@n-api.service[122698]: INFO oslo.messaging._drivers.impl_rabbit [None req-2324403b-478c-4613-8c01-a6b22bf5a6c3 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [6cdd8a14-50a8-4880-b40e-d5bfc2780872] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 56510. Sep 23 05:59:52.206360 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2324403b-478c-4613-8c01-a6b22bf5a6c3 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 1.141052 Sep 23 05:59:52.206962 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3950/8087] 10.222.0.33 () {60 vars in 1159 bytes} [Fri Sep 23 05:59:51 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 06:00:15.652137 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 06:00:15.652907 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 06:00:15.656849 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-f998a86a-010f-4bfd-ac68-4db9d3619123 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-133202353", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-499892786", "security_groups": [{"name": "tempest-secgroup-smoke-825180893"}], "networks": [{"uuid": "94127e09-cec2-4c86-b0b3-8ac4e7896dee"}], "block_device_mapping_v2": [{"uuid": "c44493d0-82e2-4b9d-9807-b574c4b51f99", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 06:00:15.770567 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.network.neutron [None req-f998a86a-010f-4bfd-ac68-4db9d3619123 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] validate_networks() for [('94127e09-cec2-4c86-b0b3-8ac4e7896dee', None, None, None, None, None)] {{(pid=122699) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 06:00:16.139966 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-f998a86a-010f-4bfd-ac68-4db9d3619123 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Flavor limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 06:00:16.140494 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-f998a86a-010f-4bfd-ac68-4db9d3619123 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Image limits 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 06:00:16.141053 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-f998a86a-010f-4bfd-ac68-4db9d3619123 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Flavor pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 06:00:16.141544 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-f998a86a-010f-4bfd-ac68-4db9d3619123 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Image pref 0:0:0 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 06:00:16.142069 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.virt.hardware [None req-f998a86a-010f-4bfd-ac68-4db9d3619123 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 06:00:16.151498 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f998a86a-010f-4bfd-ac68-4db9d3619123 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:00:16.152068 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f998a86a-010f-4bfd-ac68-4db9d3619123 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:00:16.152615 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f998a86a-010f-4bfd-ac68-4db9d3619123 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:00:16.153429 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f998a86a-010f-4bfd-ac68-4db9d3619123 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:00:16.153914 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f998a86a-010f-4bfd-ac68-4db9d3619123 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:00:16.154361 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-f998a86a-010f-4bfd-ac68-4db9d3619123 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:00:16.172666 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-f998a86a-010f-4bfd-ac68-4db9d3619123 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Getting quotas for project 93cf9690c0ef4fcf925253bed0fcd6a7. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 06:00:16.178719 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-f998a86a-010f-4bfd-ac68-4db9d3619123 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Getting quotas for user 0b929c8797a041c683b207e2d20d25b2 and project 93cf9690c0ef4fcf925253bed0fcd6a7. Resources: {'cores', 'ram', 'instances'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 06:00:16.237409 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f998a86a-010f-4bfd-ac68-4db9d3619123 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Going to run 1 instances... {{(pid=122699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 06:00:16.239606 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-f998a86a-010f-4bfd-ac68-4db9d3619123 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 27562067-687f-4487-805b-a0ee71981f90] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c44493d0-82e2-4b9d-9807-b574c4b51f99',volume_size=None,volume_type=None)] {{(pid=122699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 06:00:16.642343 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-f998a86a-010f-4bfd-ac68-4db9d3619123 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.991506 Sep 23 06:00:16.643542 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4138/8088] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 06:00:15 2022] POST /compute/v2.1/servers => generated 405 bytes in 993 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 06:00:16.653141 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=12 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 06:00:16.654294 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=4 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 06:00:16.655055 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 06:00:16.659330 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-93d621ae-1bef-4490-9ce6-144e3b9b1b90 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:00:16.660061 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-93d621ae-1bef-4490-9ce6-144e3b9b1b90 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 27562067-687f-4487-805b-a0ee71981f90] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:00:16.717416 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-93d621ae-1bef-4490-9ce6-144e3b9b1b90 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 06:00:16.725786 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-93d621ae-1bef-4490-9ce6-144e3b9b1b90 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90" status: 200 len: 1087 microversion: 2.1 time: 0.074692 Sep 23 06:00:16.733188 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3951/8089] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:00:16 2022] GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90 => generated 1087 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 06:00:17.748602 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4f1609a9-521f-4b78-91b9-b5ca6915636c tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:00:17.749227 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4f1609a9-521f-4b78-91b9-b5ca6915636c tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 27562067-687f-4487-805b-a0ee71981f90] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:00:17.803304 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-4f1609a9-521f-4b78-91b9-b5ca6915636c tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 06:00:17.810372 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4f1609a9-521f-4b78-91b9-b5ca6915636c tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90" status: 200 len: 1087 microversion: 2.1 time: 0.065745 Sep 23 06:00:17.810952 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4139/8090] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:00:17 2022] GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90 => generated 1087 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 06:00:18.833376 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e84fb778-caf6-479e-91be-b86f46f985bf tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:00:18.834124 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e84fb778-caf6-479e-91be-b86f46f985bf tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 27562067-687f-4487-805b-a0ee71981f90] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:00:18.888754 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e84fb778-caf6-479e-91be-b86f46f985bf tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 06:00:18.895797 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e84fb778-caf6-479e-91be-b86f46f985bf tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90" status: 200 len: 1087 microversion: 2.1 time: 0.067180 Sep 23 06:00:18.896391 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3952/8091] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:00:18 2022] GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90 => generated 1087 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 06:00:19.919766 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d9929ca6-47d9-4c90-9d56-040b1cd92438 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:00:19.920433 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-d9929ca6-47d9-4c90-9d56-040b1cd92438 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 27562067-687f-4487-805b-a0ee71981f90] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:00:19.972345 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-d9929ca6-47d9-4c90-9d56-040b1cd92438 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 06:00:19.979225 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d9929ca6-47d9-4c90-9d56-040b1cd92438 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90" status: 200 len: 1087 microversion: 2.1 time: 0.063406 Sep 23 06:00:19.979803 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4140/8092] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:00:19 2022] GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90 => generated 1087 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 06:00:21.002345 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b072c74f-b6d4-49bf-8134-f05cb6d0592a tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:00:21.002993 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b072c74f-b6d4-49bf-8134-f05cb6d0592a tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 27562067-687f-4487-805b-a0ee71981f90] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:00:21.010543 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b072c74f-b6d4-49bf-8134-f05cb6d0592a tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:00:21.011049 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b072c74f-b6d4-49bf-8134-f05cb6d0592a tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:00:21.011505 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b072c74f-b6d4-49bf-8134-f05cb6d0592a tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:00:21.012213 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b072c74f-b6d4-49bf-8134-f05cb6d0592a tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:00:21.012681 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b072c74f-b6d4-49bf-8134-f05cb6d0592a tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:00:21.013119 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b072c74f-b6d4-49bf-8134-f05cb6d0592a tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:00:21.077062 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b072c74f-b6d4-49bf-8134-f05cb6d0592a tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 06:00:21.085468 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b072c74f-b6d4-49bf-8134-f05cb6d0592a tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90" status: 200 len: 1137 microversion: 2.1 time: 0.087024 Sep 23 06:00:21.086073 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3953/8093] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:00:20 2022] GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90 => generated 1137 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 06:00:22.107528 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2c981e9a-ee84-4b4f-bb46-c810a895d2a0 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:00:22.108144 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-2c981e9a-ee84-4b4f-bb46-c810a895d2a0 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 27562067-687f-4487-805b-a0ee71981f90] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:00:22.115940 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2c981e9a-ee84-4b4f-bb46-c810a895d2a0 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:00:22.116465 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2c981e9a-ee84-4b4f-bb46-c810a895d2a0 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:00:22.116939 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2c981e9a-ee84-4b4f-bb46-c810a895d2a0 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:00:22.117646 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2c981e9a-ee84-4b4f-bb46-c810a895d2a0 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:00:22.118147 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2c981e9a-ee84-4b4f-bb46-c810a895d2a0 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:00:22.118582 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2c981e9a-ee84-4b4f-bb46-c810a895d2a0 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:00:22.179195 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2c981e9a-ee84-4b4f-bb46-c810a895d2a0 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 06:00:22.186927 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2c981e9a-ee84-4b4f-bb46-c810a895d2a0 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90" status: 200 len: 1185 microversion: 2.1 time: 0.083313 Sep 23 06:00:22.187504 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4141/8094] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:00:22 2022] GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90 => generated 1185 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 06:00:23.211533 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6800faec-b1a4-4b74-ba70-804752332f41 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:00:23.212386 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-6800faec-b1a4-4b74-ba70-804752332f41 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 27562067-687f-4487-805b-a0ee71981f90] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:00:23.220788 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6800faec-b1a4-4b74-ba70-804752332f41 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:00:23.222320 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6800faec-b1a4-4b74-ba70-804752332f41 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:00:23.222776 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6800faec-b1a4-4b74-ba70-804752332f41 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:00:23.223502 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6800faec-b1a4-4b74-ba70-804752332f41 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:00:23.223984 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6800faec-b1a4-4b74-ba70-804752332f41 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:00:23.224419 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6800faec-b1a4-4b74-ba70-804752332f41 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:00:23.380778 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6800faec-b1a4-4b74-ba70-804752332f41 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 06:00:23.389851 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-6800faec-b1a4-4b74-ba70-804752332f41 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90" status: 200 len: 1270 microversion: 2.1 time: 0.183194 Sep 23 06:00:23.391151 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3954/8095] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:00:23 2022] GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90 => generated 1270 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 06:00:24.069703 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-f412f17d-e6b1-4d94-ac20-65e9e0a7e628 req-36aee524-56e4-4165-87c0-be99d76f997a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27562067-687f-4487-805b-a0ee71981f90", "tag": "16b2e719-7de3-45da-ba11-9c6a23bb45da"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 06:00:24.085478 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-f412f17d-e6b1-4d94-ac20-65e9e0a7e628 req-36aee524-56e4-4165-87c0-be99d76f997a service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:00:24.086454 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-f412f17d-e6b1-4d94-ac20-65e9e0a7e628 req-36aee524-56e4-4165-87c0-be99d76f997a service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:00:24.088743 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-f412f17d-e6b1-4d94-ac20-65e9e0a7e628 req-36aee524-56e4-4165-87c0-be99d76f997a service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:00:24.101694 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-f412f17d-e6b1-4d94-ac20-65e9e0a7e628 req-36aee524-56e4-4165-87c0-be99d76f997a service nova] Creating event network-changed:16b2e719-7de3-45da-ba11-9c6a23bb45da for instance 27562067-687f-4487-805b-a0ee71981f90 on n-h2-846463-3 Sep 23 06:00:24.107057 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-f412f17d-e6b1-4d94-ac20-65e9e0a7e628 req-36aee524-56e4-4165-87c0-be99d76f997a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041108 Sep 23 06:00:24.108000 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4142/8096] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 06:00:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 06:00:24.414750 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ec436839-4ec4-40fd-ab68-d6ca9567863b tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:00:24.415295 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-ec436839-4ec4-40fd-ab68-d6ca9567863b tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 27562067-687f-4487-805b-a0ee71981f90] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:00:24.423063 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ec436839-4ec4-40fd-ab68-d6ca9567863b tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:00:24.423912 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ec436839-4ec4-40fd-ab68-d6ca9567863b tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:00:24.425050 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ec436839-4ec4-40fd-ab68-d6ca9567863b tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:00:24.426228 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ec436839-4ec4-40fd-ab68-d6ca9567863b tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:00:24.426890 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ec436839-4ec4-40fd-ab68-d6ca9567863b tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:00:24.427559 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ec436839-4ec4-40fd-ab68-d6ca9567863b tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:00:24.567309 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ec436839-4ec4-40fd-ab68-d6ca9567863b tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 06:00:24.575475 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ec436839-4ec4-40fd-ab68-d6ca9567863b tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90" status: 200 len: 1270 microversion: 2.1 time: 0.164682 Sep 23 06:00:24.583210 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3955/8097] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:00:24 2022] GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90 => generated 1270 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 06:00:25.600481 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-2858bc23-02a3-40aa-a44b-5054459bf834 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:00:25.601300 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-2858bc23-02a3-40aa-a44b-5054459bf834 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 27562067-687f-4487-805b-a0ee71981f90] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:00:25.607715 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2858bc23-02a3-40aa-a44b-5054459bf834 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:00:25.608219 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2858bc23-02a3-40aa-a44b-5054459bf834 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:00:25.608668 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2858bc23-02a3-40aa-a44b-5054459bf834 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:00:25.609376 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2858bc23-02a3-40aa-a44b-5054459bf834 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:00:25.609843 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2858bc23-02a3-40aa-a44b-5054459bf834 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:00:25.610304 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-2858bc23-02a3-40aa-a44b-5054459bf834 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:00:25.749059 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-2858bc23-02a3-40aa-a44b-5054459bf834 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 06:00:25.757805 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-2858bc23-02a3-40aa-a44b-5054459bf834 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90" status: 200 len: 1270 microversion: 2.1 time: 0.162604 Sep 23 06:00:25.758605 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4143/8098] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:00:25 2022] GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90 => generated 1270 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 06:00:26.780700 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a9a2d65a-d853-4200-80ba-81b743806907 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:00:26.781327 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a9a2d65a-d853-4200-80ba-81b743806907 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 27562067-687f-4487-805b-a0ee71981f90] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:00:26.788497 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a9a2d65a-d853-4200-80ba-81b743806907 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:00:26.789021 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a9a2d65a-d853-4200-80ba-81b743806907 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:00:26.789548 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a9a2d65a-d853-4200-80ba-81b743806907 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:00:26.790337 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a9a2d65a-d853-4200-80ba-81b743806907 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:00:26.790826 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a9a2d65a-d853-4200-80ba-81b743806907 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:00:26.791284 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a9a2d65a-d853-4200-80ba-81b743806907 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:00:26.926774 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a9a2d65a-d853-4200-80ba-81b743806907 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 06:00:26.934720 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a9a2d65a-d853-4200-80ba-81b743806907 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90" status: 200 len: 1270 microversion: 2.1 time: 0.157975 Sep 23 06:00:26.935323 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3956/8099] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:00:26 2022] GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90 => generated 1270 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 06:00:27.958498 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-91edb6b5-17f6-4258-a9cb-26582fd33a7b tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:00:27.959072 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-91edb6b5-17f6-4258-a9cb-26582fd33a7b tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 27562067-687f-4487-805b-a0ee71981f90] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:00:27.961078 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=2 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 06:00:27.966446 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-91edb6b5-17f6-4258-a9cb-26582fd33a7b tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:00:27.966993 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-91edb6b5-17f6-4258-a9cb-26582fd33a7b tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:00:27.967450 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-91edb6b5-17f6-4258-a9cb-26582fd33a7b tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:00:27.968154 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-91edb6b5-17f6-4258-a9cb-26582fd33a7b tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:00:27.968624 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-91edb6b5-17f6-4258-a9cb-26582fd33a7b tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:00:27.969058 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-91edb6b5-17f6-4258-a9cb-26582fd33a7b tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:00:28.107976 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-91edb6b5-17f6-4258-a9cb-26582fd33a7b tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 06:00:28.116977 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-91edb6b5-17f6-4258-a9cb-26582fd33a7b tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90" status: 200 len: 1270 microversion: 2.1 time: 0.162379 Sep 23 06:00:28.117685 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4144/8100] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:00:27 2022] GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90 => generated 1270 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 06:00:29.141380 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=4 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 06:00:29.236900 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-70b16586-11e0-415d-a042-f0513c6e6bd6 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:00:29.237533 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-70b16586-11e0-415d-a042-f0513c6e6bd6 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 27562067-687f-4487-805b-a0ee71981f90] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:00:29.243542 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-70b16586-11e0-415d-a042-f0513c6e6bd6 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:00:29.244052 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-70b16586-11e0-415d-a042-f0513c6e6bd6 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:00:29.244511 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-70b16586-11e0-415d-a042-f0513c6e6bd6 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:00:29.245226 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-70b16586-11e0-415d-a042-f0513c6e6bd6 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:00:29.245705 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-70b16586-11e0-415d-a042-f0513c6e6bd6 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:00:29.246188 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-70b16586-11e0-415d-a042-f0513c6e6bd6 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:00:29.377434 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-70b16586-11e0-415d-a042-f0513c6e6bd6 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 06:00:29.385872 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-70b16586-11e0-415d-a042-f0513c6e6bd6 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90" status: 200 len: 1258 microversion: 2.1 time: 0.249844 Sep 23 06:00:29.386492 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3957/8101] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:00:29 2022] GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90 => generated 1258 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 06:00:30.409755 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5f43ce44-ceee-4f1d-89e7-d50ff0e2200b tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:00:30.410457 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-5f43ce44-ceee-4f1d-89e7-d50ff0e2200b tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 27562067-687f-4487-805b-a0ee71981f90] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:00:30.412870 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=10 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 06:00:30.418509 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5f43ce44-ceee-4f1d-89e7-d50ff0e2200b tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:00:30.418952 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5f43ce44-ceee-4f1d-89e7-d50ff0e2200b tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:00:30.419398 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5f43ce44-ceee-4f1d-89e7-d50ff0e2200b tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:00:30.420108 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5f43ce44-ceee-4f1d-89e7-d50ff0e2200b tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:00:30.420573 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5f43ce44-ceee-4f1d-89e7-d50ff0e2200b tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:00:30.421006 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5f43ce44-ceee-4f1d-89e7-d50ff0e2200b tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:00:30.559928 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-5f43ce44-ceee-4f1d-89e7-d50ff0e2200b tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 06:00:30.568566 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5f43ce44-ceee-4f1d-89e7-d50ff0e2200b tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90" status: 200 len: 1258 microversion: 2.1 time: 0.163376 Sep 23 06:00:30.569153 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4145/8102] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:00:30 2022] GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90 => generated 1258 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 06:00:31.592360 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-148e3177-7980-4c78-ab8d-66320d5686a0 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:00:31.592912 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-148e3177-7980-4c78-ab8d-66320d5686a0 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 27562067-687f-4487-805b-a0ee71981f90] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:00:31.601521 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-148e3177-7980-4c78-ab8d-66320d5686a0 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:00:31.602068 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-148e3177-7980-4c78-ab8d-66320d5686a0 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:00:31.602525 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-148e3177-7980-4c78-ab8d-66320d5686a0 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:00:31.603244 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-148e3177-7980-4c78-ab8d-66320d5686a0 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:00:31.603718 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-148e3177-7980-4c78-ab8d-66320d5686a0 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:00:31.604161 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-148e3177-7980-4c78-ab8d-66320d5686a0 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:00:31.739453 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-148e3177-7980-4c78-ab8d-66320d5686a0 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 06:00:31.747268 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-148e3177-7980-4c78-ab8d-66320d5686a0 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90" status: 200 len: 1258 microversion: 2.1 time: 0.158961 Sep 23 06:00:31.747849 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3958/8103] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:00:31 2022] GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90 => generated 1258 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 06:00:32.771252 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-55a0ee70-708b-4832-91fe-8ef32a65e4ea tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:00:32.771871 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-55a0ee70-708b-4832-91fe-8ef32a65e4ea tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 27562067-687f-4487-805b-a0ee71981f90] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:00:32.778730 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-55a0ee70-708b-4832-91fe-8ef32a65e4ea tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:00:32.779225 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-55a0ee70-708b-4832-91fe-8ef32a65e4ea tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:00:32.779667 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-55a0ee70-708b-4832-91fe-8ef32a65e4ea tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:00:32.780486 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-55a0ee70-708b-4832-91fe-8ef32a65e4ea tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:00:32.780955 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-55a0ee70-708b-4832-91fe-8ef32a65e4ea tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:00:32.781388 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-55a0ee70-708b-4832-91fe-8ef32a65e4ea tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:00:32.971809 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-55a0ee70-708b-4832-91fe-8ef32a65e4ea tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 06:00:32.979662 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-55a0ee70-708b-4832-91fe-8ef32a65e4ea tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90" status: 200 len: 1258 microversion: 2.1 time: 0.212393 Sep 23 06:00:32.980782 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4146/8104] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:00:32 2022] GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90 => generated 1258 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 06:00:34.003311 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4ff8904a-19e9-42ba-9905-ed1ce3466918 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:00:34.004004 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4ff8904a-19e9-42ba-9905-ed1ce3466918 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 27562067-687f-4487-805b-a0ee71981f90] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:00:34.010945 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4ff8904a-19e9-42ba-9905-ed1ce3466918 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:00:34.011456 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4ff8904a-19e9-42ba-9905-ed1ce3466918 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:00:34.011918 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4ff8904a-19e9-42ba-9905-ed1ce3466918 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:00:34.012635 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4ff8904a-19e9-42ba-9905-ed1ce3466918 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:00:34.013116 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4ff8904a-19e9-42ba-9905-ed1ce3466918 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:00:34.013562 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4ff8904a-19e9-42ba-9905-ed1ce3466918 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:00:34.193537 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4ff8904a-19e9-42ba-9905-ed1ce3466918 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 06:00:34.196929 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4ff8904a-19e9-42ba-9905-ed1ce3466918 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90" status: 200 len: 1258 microversion: 2.1 time: 0.197529 Sep 23 06:00:34.197474 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3959/8105] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:00:33 2022] GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90 => generated 1258 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 06:00:35.222066 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ef8d52e0-cc28-4d2a-be7a-c99f4dc32149 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:00:35.222661 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ef8d52e0-cc28-4d2a-be7a-c99f4dc32149 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 27562067-687f-4487-805b-a0ee71981f90] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:00:35.229154 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ef8d52e0-cc28-4d2a-be7a-c99f4dc32149 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:00:35.229638 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ef8d52e0-cc28-4d2a-be7a-c99f4dc32149 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:00:35.230107 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ef8d52e0-cc28-4d2a-be7a-c99f4dc32149 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:00:35.230803 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ef8d52e0-cc28-4d2a-be7a-c99f4dc32149 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:00:35.231259 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ef8d52e0-cc28-4d2a-be7a-c99f4dc32149 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:00:35.231685 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ef8d52e0-cc28-4d2a-be7a-c99f4dc32149 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:00:35.363631 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ef8d52e0-cc28-4d2a-be7a-c99f4dc32149 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 06:00:35.372179 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ef8d52e0-cc28-4d2a-be7a-c99f4dc32149 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90" status: 200 len: 1258 microversion: 2.1 time: 0.155845 Sep 23 06:00:35.372767 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4147/8106] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:00:35 2022] GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90 => generated 1258 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 06:00:36.395112 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6a781c75-2d1d-4d09-b32b-d6a67f81db25 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:00:36.395751 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-6a781c75-2d1d-4d09-b32b-d6a67f81db25 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 27562067-687f-4487-805b-a0ee71981f90] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:00:36.402956 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6a781c75-2d1d-4d09-b32b-d6a67f81db25 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:00:36.403470 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6a781c75-2d1d-4d09-b32b-d6a67f81db25 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:00:36.403932 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6a781c75-2d1d-4d09-b32b-d6a67f81db25 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:00:36.404646 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6a781c75-2d1d-4d09-b32b-d6a67f81db25 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:00:36.405124 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6a781c75-2d1d-4d09-b32b-d6a67f81db25 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:00:36.405572 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6a781c75-2d1d-4d09-b32b-d6a67f81db25 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:00:36.538392 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6a781c75-2d1d-4d09-b32b-d6a67f81db25 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 06:00:36.546148 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-6a781c75-2d1d-4d09-b32b-d6a67f81db25 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90" status: 200 len: 1258 microversion: 2.1 time: 0.154908 Sep 23 06:00:36.546723 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3960/8107] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:00:36 2022] GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90 => generated 1258 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 06:00:37.569236 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6d6b8268-1db6-414b-aa40-847672f87423 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:00:37.569996 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-6d6b8268-1db6-414b-aa40-847672f87423 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 27562067-687f-4487-805b-a0ee71981f90] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:00:37.576493 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6d6b8268-1db6-414b-aa40-847672f87423 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:00:37.576977 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6d6b8268-1db6-414b-aa40-847672f87423 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:00:37.577469 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6d6b8268-1db6-414b-aa40-847672f87423 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:00:37.578197 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6d6b8268-1db6-414b-aa40-847672f87423 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:00:37.584404 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6d6b8268-1db6-414b-aa40-847672f87423 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:00:37.584404 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6d6b8268-1db6-414b-aa40-847672f87423 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:00:37.619564 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-f3689807-cd60-4d86-8524-367f30b2b6c2 req-059eeb36-087c-4ee8-9dc9-3ec030c0bdfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27562067-687f-4487-805b-a0ee71981f90", "name": "network-vif-plugged", "status": "completed", "tag": "16b2e719-7de3-45da-ba11-9c6a23bb45da"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 06:00:37.630539 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-f3689807-cd60-4d86-8524-367f30b2b6c2 req-059eeb36-087c-4ee8-9dc9-3ec030c0bdfa service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:00:37.631041 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-f3689807-cd60-4d86-8524-367f30b2b6c2 req-059eeb36-087c-4ee8-9dc9-3ec030c0bdfa service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:00:37.631485 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-f3689807-cd60-4d86-8524-367f30b2b6c2 req-059eeb36-087c-4ee8-9dc9-3ec030c0bdfa service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:00:37.642603 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-f3689807-cd60-4d86-8524-367f30b2b6c2 req-059eeb36-087c-4ee8-9dc9-3ec030c0bdfa service nova] Creating event network-vif-plugged:16b2e719-7de3-45da-ba11-9c6a23bb45da for instance 27562067-687f-4487-805b-a0ee71981f90 on n-h2-846463-3 Sep 23 06:00:37.647751 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-f3689807-cd60-4d86-8524-367f30b2b6c2 req-059eeb36-087c-4ee8-9dc9-3ec030c0bdfa service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031852 Sep 23 06:00:37.648266 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3961/8108] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 06:00:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 06:00:37.716173 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-6d6b8268-1db6-414b-aa40-847672f87423 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 06:00:37.724922 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6d6b8268-1db6-414b-aa40-847672f87423 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90" status: 200 len: 1258 microversion: 2.1 time: 0.159545 Sep 23 06:00:37.725838 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4148/8109] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:00:37 2022] GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90 => generated 1258 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 06:00:38.750666 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-294122b4-1643-4185-85cb-970c9f02fc62 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:00:38.752146 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-294122b4-1643-4185-85cb-970c9f02fc62 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 27562067-687f-4487-805b-a0ee71981f90] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:00:38.759061 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-294122b4-1643-4185-85cb-970c9f02fc62 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:00:38.759577 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-294122b4-1643-4185-85cb-970c9f02fc62 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:00:38.760027 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-294122b4-1643-4185-85cb-970c9f02fc62 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:00:38.760761 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-294122b4-1643-4185-85cb-970c9f02fc62 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:00:38.761207 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-294122b4-1643-4185-85cb-970c9f02fc62 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:00:38.761646 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-294122b4-1643-4185-85cb-970c9f02fc62 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:00:38.910724 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-294122b4-1643-4185-85cb-970c9f02fc62 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 06:00:38.920115 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-294122b4-1643-4185-85cb-970c9f02fc62 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90" status: 200 len: 1258 microversion: 2.1 time: 0.173572 Sep 23 06:00:38.920724 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3962/8110] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:00:38 2022] GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90 => generated 1258 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 06:00:39.942871 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-19a9438a-34b5-4dbf-9cf0-6e1f8687c3f5 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:00:39.943475 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-19a9438a-34b5-4dbf-9cf0-6e1f8687c3f5 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 27562067-687f-4487-805b-a0ee71981f90] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:00:39.950114 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-19a9438a-34b5-4dbf-9cf0-6e1f8687c3f5 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:00:39.950610 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-19a9438a-34b5-4dbf-9cf0-6e1f8687c3f5 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:00:39.951062 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-19a9438a-34b5-4dbf-9cf0-6e1f8687c3f5 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:00:39.951760 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-19a9438a-34b5-4dbf-9cf0-6e1f8687c3f5 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:00:39.952225 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-19a9438a-34b5-4dbf-9cf0-6e1f8687c3f5 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:00:39.952658 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-19a9438a-34b5-4dbf-9cf0-6e1f8687c3f5 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:00:40.087162 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-19a9438a-34b5-4dbf-9cf0-6e1f8687c3f5 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 06:00:40.095809 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-19a9438a-34b5-4dbf-9cf0-6e1f8687c3f5 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90" status: 200 len: 1441 microversion: 2.1 time: 0.156316 Sep 23 06:00:40.096390 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4149/8111] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:00:39 2022] GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90 => generated 1441 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 06:00:40.118413 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-191017ba-5cff-467f-a357-87814efd83b1 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:00:40.119047 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-191017ba-5cff-467f-a357-87814efd83b1 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 27562067-687f-4487-805b-a0ee71981f90] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:00:40.125941 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-191017ba-5cff-467f-a357-87814efd83b1 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:00:40.126485 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-191017ba-5cff-467f-a357-87814efd83b1 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:00:40.126953 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-191017ba-5cff-467f-a357-87814efd83b1 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:00:40.127671 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-191017ba-5cff-467f-a357-87814efd83b1 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:00:40.128153 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-191017ba-5cff-467f-a357-87814efd83b1 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:00:40.128603 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-191017ba-5cff-467f-a357-87814efd83b1 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:00:40.258037 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-191017ba-5cff-467f-a357-87814efd83b1 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 06:00:40.265913 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-191017ba-5cff-467f-a357-87814efd83b1 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90" status: 200 len: 1441 microversion: 2.1 time: 0.151390 Sep 23 06:00:40.266502 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3963/8112] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:00:40 2022] GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90 => generated 1441 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 06:00:42.602163 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-23f06209-7248-4db2-82b0-213e87465e4f req-f084f219-57f4-4a0b-9bdd-7539d1661f6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27562067-687f-4487-805b-a0ee71981f90", "tag": "16b2e719-7de3-45da-ba11-9c6a23bb45da"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 06:00:42.612417 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-23f06209-7248-4db2-82b0-213e87465e4f req-f084f219-57f4-4a0b-9bdd-7539d1661f6d service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:00:42.612898 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-23f06209-7248-4db2-82b0-213e87465e4f req-f084f219-57f4-4a0b-9bdd-7539d1661f6d service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:00:42.613328 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-23f06209-7248-4db2-82b0-213e87465e4f req-f084f219-57f4-4a0b-9bdd-7539d1661f6d service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:00:42.625002 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-23f06209-7248-4db2-82b0-213e87465e4f req-f084f219-57f4-4a0b-9bdd-7539d1661f6d service nova] Creating event network-changed:16b2e719-7de3-45da-ba11-9c6a23bb45da for instance 27562067-687f-4487-805b-a0ee71981f90 on n-h2-846463-3 Sep 23 06:00:42.630826 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-23f06209-7248-4db2-82b0-213e87465e4f req-f084f219-57f4-4a0b-9bdd-7539d1661f6d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102666 Sep 23 06:00:42.631432 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4150/8113] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 06:00:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 06:03:00.773710 n-d-846463-3 devstack@n-api.service[122698]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f191bc7a-c250-407c-bbf3-646bef550c22] AMQP server on 10.222.0.33:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 23 06:03:00.774967 n-d-846463-3 devstack@n-api.service[122698]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2416b61d-0aee-4a62-9508-aa1fc06b9213] AMQP server on 10.222.0.33:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 23 06:03:00.775811 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=30 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 06:03:00.776632 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=62 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 06:03:00.777355 n-d-846463-3 devstack@n-api.service[122698]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 06:03:00.777486 n-d-846463-3 devstack@n-api.service[122698]: Fri Sep 23 06:03:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90/action (ip 10.222.0.33) !!! Sep 23 06:03:00.779026 n-d-846463-3 devstack@n-api.service[122698]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 23 06:03:00.779168 n-d-846463-3 devstack@n-api.service[122698]: Fri Sep 23 06:03:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90/action (ip 10.222.0.33) !!! Sep 23 06:03:00.780260 n-d-846463-3 devstack@n-api.service[122698]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 23 06:03:00.780406 n-d-846463-3 devstack@n-api.service[122698]: Fri Sep 23 06:03:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90/action (ip 10.222.0.33) !!! Sep 23 06:03:00.785471 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-3f6c2d2b-5f71-430e-aff6-e6c0083f1c00 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 06:03:00.786057 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-3f6c2d2b-5f71-430e-aff6-e6c0083f1c00 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 27562067-687f-4487-805b-a0ee71981f90] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:03:00.795691 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3f6c2d2b-5f71-430e-aff6-e6c0083f1c00 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:03:00.802209 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3f6c2d2b-5f71-430e-aff6-e6c0083f1c00 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:03:00.802209 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3f6c2d2b-5f71-430e-aff6-e6c0083f1c00 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:03:00.802209 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3f6c2d2b-5f71-430e-aff6-e6c0083f1c00 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:03:00.802209 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3f6c2d2b-5f71-430e-aff6-e6c0083f1c00 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:03:00.802209 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-3f6c2d2b-5f71-430e-aff6-e6c0083f1c00 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:03:00.822669 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-3f6c2d2b-5f71-430e-aff6-e6c0083f1c00 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lazy-loading 'flavor' on Instance uuid 27562067-687f-4487-805b-a0ee71981f90 {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 06:03:01.132967 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-3f6c2d2b-5f71-430e-aff6-e6c0083f1c00 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "POST /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90/action" status: 202 len: 0 microversion: 2.1 time: 0.360996 Sep 23 06:03:01.133574 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3964/8114] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 06:03:00 2022] POST /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90/action => generated 0 bytes in 362 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 06:03:01.139986 n-d-846463-3 devstack@n-api.service[122699]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c6c7f4e7-3ce9-40e8-ba39-9d563bbcd13f] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 23 06:03:01.141582 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 06:03:01.141582 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=54 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 06:03:01.142344 n-d-846463-3 devstack@n-api.service[122699]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 23 06:03:01.142496 n-d-846463-3 devstack@n-api.service[122699]: Fri Sep 23 06:03:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90 (ip 10.222.0.33) !!! Sep 23 06:03:01.143649 n-d-846463-3 devstack@n-api.service[122699]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 23 06:03:01.143784 n-d-846463-3 devstack@n-api.service[122699]: Fri Sep 23 06:03:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90 (ip 10.222.0.33) !!! Sep 23 06:03:01.144804 n-d-846463-3 devstack@n-api.service[122699]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 23 06:03:01.144942 n-d-846463-3 devstack@n-api.service[122699]: Fri Sep 23 06:03:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90 (ip 10.222.0.33) !!! Sep 23 06:03:01.152314 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-cc4d92dc-6e94-4bbb-a18a-237e88890e1a tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:03:01.153037 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-cc4d92dc-6e94-4bbb-a18a-237e88890e1a tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 27562067-687f-4487-805b-a0ee71981f90] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:03:01.165827 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cc4d92dc-6e94-4bbb-a18a-237e88890e1a tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:03:01.170244 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cc4d92dc-6e94-4bbb-a18a-237e88890e1a tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:03:01.170244 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cc4d92dc-6e94-4bbb-a18a-237e88890e1a tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:03:01.170244 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cc4d92dc-6e94-4bbb-a18a-237e88890e1a tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:03:01.170244 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cc4d92dc-6e94-4bbb-a18a-237e88890e1a tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:03:01.170244 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cc4d92dc-6e94-4bbb-a18a-237e88890e1a tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:03:01.304961 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-cc4d92dc-6e94-4bbb-a18a-237e88890e1a tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 06:03:01.313649 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-cc4d92dc-6e94-4bbb-a18a-237e88890e1a tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90" status: 200 len: 1566 microversion: 2.1 time: 0.175607 Sep 23 06:03:01.314447 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4151/8115] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:03:01 2022] GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90 => generated 1566 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 06:03:02.341528 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-316733a6-a917-4ff1-892c-b27260a8b888 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:03:02.342320 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-316733a6-a917-4ff1-892c-b27260a8b888 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 27562067-687f-4487-805b-a0ee71981f90] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:03:02.351460 n-d-846463-3 devstack@n-api.service[122698]: INFO oslo.messaging._drivers.impl_rabbit [-] [2416b61d-0aee-4a62-9508-aa1fc06b9213] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 56806. Sep 23 06:03:02.359377 n-d-846463-3 devstack@n-api.service[122698]: INFO oslo.messaging._drivers.impl_rabbit [-] [f191bc7a-c250-407c-bbf3-646bef550c22] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 56804. Sep 23 06:03:02.361026 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-316733a6-a917-4ff1-892c-b27260a8b888 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:03:02.361538 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-316733a6-a917-4ff1-892c-b27260a8b888 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:03:02.362032 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-316733a6-a917-4ff1-892c-b27260a8b888 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:03:02.362755 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-316733a6-a917-4ff1-892c-b27260a8b888 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:03:02.363266 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-316733a6-a917-4ff1-892c-b27260a8b888 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:03:02.363714 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-316733a6-a917-4ff1-892c-b27260a8b888 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:03:02.493763 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-316733a6-a917-4ff1-892c-b27260a8b888 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 06:03:02.502218 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-316733a6-a917-4ff1-892c-b27260a8b888 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90" status: 200 len: 1566 microversion: 2.1 time: 0.168801 Sep 23 06:03:02.502883 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3965/8116] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:03:02 2022] GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90 => generated 1566 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 06:03:03.526645 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ddb49024-ed97-4011-bfc2-8258d8c76f66 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:03:03.527270 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ddb49024-ed97-4011-bfc2-8258d8c76f66 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 27562067-687f-4487-805b-a0ee71981f90] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:03:03.534747 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ddb49024-ed97-4011-bfc2-8258d8c76f66 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:03:03.535239 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ddb49024-ed97-4011-bfc2-8258d8c76f66 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:03:03.535681 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ddb49024-ed97-4011-bfc2-8258d8c76f66 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:03:03.536377 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ddb49024-ed97-4011-bfc2-8258d8c76f66 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:03:03.536838 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ddb49024-ed97-4011-bfc2-8258d8c76f66 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:03:03.537274 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ddb49024-ed97-4011-bfc2-8258d8c76f66 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:03:03.553875 n-d-846463-3 devstack@n-api.service[122699]: INFO oslo.messaging._drivers.impl_rabbit [-] [c6c7f4e7-3ce9-40e8-ba39-9d563bbcd13f] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 56812. Sep 23 06:03:03.672179 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ddb49024-ed97-4011-bfc2-8258d8c76f66 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 06:03:03.679992 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ddb49024-ed97-4011-bfc2-8258d8c76f66 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90" status: 200 len: 1566 microversion: 2.1 time: 0.157876 Sep 23 06:03:03.680586 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4152/8117] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:03:03 2022] GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90 => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 06:03:04.705006 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-66f3d523-58ea-4926-9892-7f8da51a558d tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:03:04.705641 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-66f3d523-58ea-4926-9892-7f8da51a558d tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 27562067-687f-4487-805b-a0ee71981f90] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:03:04.713873 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-66f3d523-58ea-4926-9892-7f8da51a558d tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:03:04.714410 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-66f3d523-58ea-4926-9892-7f8da51a558d tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:03:04.714862 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-66f3d523-58ea-4926-9892-7f8da51a558d tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:03:04.715577 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-66f3d523-58ea-4926-9892-7f8da51a558d tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:03:04.716050 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-66f3d523-58ea-4926-9892-7f8da51a558d tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:03:04.716492 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-66f3d523-58ea-4926-9892-7f8da51a558d tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:03:04.849588 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-66f3d523-58ea-4926-9892-7f8da51a558d tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 06:03:04.857440 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-66f3d523-58ea-4926-9892-7f8da51a558d tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90" status: 200 len: 1566 microversion: 2.1 time: 0.157117 Sep 23 06:03:04.869913 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3966/8118] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:03:04 2022] GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 06:03:05.880893 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-48b36932-b422-4e48-96fd-200881f549d0 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:03:05.881530 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-48b36932-b422-4e48-96fd-200881f549d0 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 27562067-687f-4487-805b-a0ee71981f90] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:03:05.888239 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-48b36932-b422-4e48-96fd-200881f549d0 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:03:05.888722 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-48b36932-b422-4e48-96fd-200881f549d0 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:03:05.889160 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-48b36932-b422-4e48-96fd-200881f549d0 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:03:05.889842 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-48b36932-b422-4e48-96fd-200881f549d0 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:03:05.890874 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-48b36932-b422-4e48-96fd-200881f549d0 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:03:05.891301 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-48b36932-b422-4e48-96fd-200881f549d0 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:03:06.025496 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-48b36932-b422-4e48-96fd-200881f549d0 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 06:03:06.030029 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-48b36932-b422-4e48-96fd-200881f549d0 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90" status: 200 len: 1566 microversion: 2.1 time: 0.153004 Sep 23 06:03:06.030603 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4153/8119] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:03:05 2022] GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90 => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 06:03:07.053268 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-de8fcf1a-e693-4cc1-abbb-bd170a841866 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:03:07.053937 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-de8fcf1a-e693-4cc1-abbb-bd170a841866 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 27562067-687f-4487-805b-a0ee71981f90] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:03:07.060962 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-de8fcf1a-e693-4cc1-abbb-bd170a841866 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:03:07.061480 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-de8fcf1a-e693-4cc1-abbb-bd170a841866 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:03:07.061973 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-de8fcf1a-e693-4cc1-abbb-bd170a841866 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:03:07.062704 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-de8fcf1a-e693-4cc1-abbb-bd170a841866 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:03:07.063190 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-de8fcf1a-e693-4cc1-abbb-bd170a841866 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:03:07.063640 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-de8fcf1a-e693-4cc1-abbb-bd170a841866 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:03:07.197363 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-de8fcf1a-e693-4cc1-abbb-bd170a841866 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 06:03:07.205672 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-de8fcf1a-e693-4cc1-abbb-bd170a841866 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90" status: 200 len: 1566 microversion: 2.1 time: 0.156354 Sep 23 06:03:07.206281 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3967/8120] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:03:07 2022] GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 06:03:08.231080 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-67a08829-8d13-42b6-bae4-669b8df0df7d tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:03:08.231694 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-67a08829-8d13-42b6-bae4-669b8df0df7d tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 27562067-687f-4487-805b-a0ee71981f90] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:03:08.238927 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-67a08829-8d13-42b6-bae4-669b8df0df7d tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:03:08.239418 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-67a08829-8d13-42b6-bae4-669b8df0df7d tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:03:08.239863 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-67a08829-8d13-42b6-bae4-669b8df0df7d tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:03:08.240561 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-67a08829-8d13-42b6-bae4-669b8df0df7d tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:03:08.241022 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-67a08829-8d13-42b6-bae4-669b8df0df7d tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:03:08.241450 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-67a08829-8d13-42b6-bae4-669b8df0df7d tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:03:08.370800 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-67a08829-8d13-42b6-bae4-669b8df0df7d tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 06:03:08.378619 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-67a08829-8d13-42b6-bae4-669b8df0df7d tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90" status: 200 len: 1566 microversion: 2.1 time: 0.151492 Sep 23 06:03:08.379197 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4154/8121] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:03:08 2022] GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90 => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 06:03:09.402235 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-398d2a57-ab6e-4e7b-b9d0-634d69fd1e29 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:03:09.402881 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-398d2a57-ab6e-4e7b-b9d0-634d69fd1e29 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 27562067-687f-4487-805b-a0ee71981f90] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:03:09.410461 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-398d2a57-ab6e-4e7b-b9d0-634d69fd1e29 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:03:09.410973 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-398d2a57-ab6e-4e7b-b9d0-634d69fd1e29 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:03:09.411437 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-398d2a57-ab6e-4e7b-b9d0-634d69fd1e29 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:03:09.412155 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-398d2a57-ab6e-4e7b-b9d0-634d69fd1e29 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:03:09.412636 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-398d2a57-ab6e-4e7b-b9d0-634d69fd1e29 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:03:09.413087 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-398d2a57-ab6e-4e7b-b9d0-634d69fd1e29 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:03:09.552817 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-398d2a57-ab6e-4e7b-b9d0-634d69fd1e29 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 06:03:09.560644 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-398d2a57-ab6e-4e7b-b9d0-634d69fd1e29 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90" status: 200 len: 1566 microversion: 2.1 time: 0.162675 Sep 23 06:03:09.561228 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3968/8122] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:03:09 2022] GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90 => generated 1566 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 06:03:10.592667 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-76dc1619-af08-46a0-87f8-dc6ea3c6e3dc tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:03:10.592667 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-76dc1619-af08-46a0-87f8-dc6ea3c6e3dc tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 27562067-687f-4487-805b-a0ee71981f90] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:03:10.592667 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-76dc1619-af08-46a0-87f8-dc6ea3c6e3dc tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:03:10.592667 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-76dc1619-af08-46a0-87f8-dc6ea3c6e3dc tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:03:10.592667 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-76dc1619-af08-46a0-87f8-dc6ea3c6e3dc tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:03:10.592667 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-76dc1619-af08-46a0-87f8-dc6ea3c6e3dc tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:03:10.594272 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-76dc1619-af08-46a0-87f8-dc6ea3c6e3dc tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:03:10.594272 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-76dc1619-af08-46a0-87f8-dc6ea3c6e3dc tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:03:10.722005 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-76dc1619-af08-46a0-87f8-dc6ea3c6e3dc tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 06:03:10.729827 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-76dc1619-af08-46a0-87f8-dc6ea3c6e3dc tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90" status: 200 len: 1566 microversion: 2.1 time: 0.149891 Sep 23 06:03:10.730420 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4155/8123] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:03:10 2022] GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90 => generated 1566 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 06:03:11.754356 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-664f9017-cf7f-4091-87cc-28ab80c2f892 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:03:11.754983 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-664f9017-cf7f-4091-87cc-28ab80c2f892 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 27562067-687f-4487-805b-a0ee71981f90] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:03:11.761883 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-664f9017-cf7f-4091-87cc-28ab80c2f892 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:03:11.762407 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-664f9017-cf7f-4091-87cc-28ab80c2f892 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:03:11.762861 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-664f9017-cf7f-4091-87cc-28ab80c2f892 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:03:11.763559 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-664f9017-cf7f-4091-87cc-28ab80c2f892 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:03:11.764029 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-664f9017-cf7f-4091-87cc-28ab80c2f892 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:03:11.764465 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-664f9017-cf7f-4091-87cc-28ab80c2f892 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:03:11.896972 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-664f9017-cf7f-4091-87cc-28ab80c2f892 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 06:03:11.905061 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-664f9017-cf7f-4091-87cc-28ab80c2f892 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90" status: 200 len: 1566 microversion: 2.1 time: 0.154599 Sep 23 06:03:11.905643 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3969/8124] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:03:11 2022] GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 06:03:12.928513 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-fb90f2d7-bab6-405e-9ae3-9f251e73b9bd tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:03:12.929130 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-fb90f2d7-bab6-405e-9ae3-9f251e73b9bd tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 27562067-687f-4487-805b-a0ee71981f90] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:03:12.935756 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fb90f2d7-bab6-405e-9ae3-9f251e73b9bd tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:03:12.936250 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fb90f2d7-bab6-405e-9ae3-9f251e73b9bd tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:03:12.937189 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fb90f2d7-bab6-405e-9ae3-9f251e73b9bd tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:03:12.937920 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fb90f2d7-bab6-405e-9ae3-9f251e73b9bd tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:03:12.938390 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fb90f2d7-bab6-405e-9ae3-9f251e73b9bd tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:03:12.938825 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-fb90f2d7-bab6-405e-9ae3-9f251e73b9bd tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:03:13.066898 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-fb90f2d7-bab6-405e-9ae3-9f251e73b9bd tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 06:03:13.074823 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-fb90f2d7-bab6-405e-9ae3-9f251e73b9bd tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90" status: 200 len: 1566 microversion: 2.1 time: 0.150388 Sep 23 06:03:13.075410 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4156/8125] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:03:12 2022] GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90 => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 06:03:14.100610 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b50aa21a-3bee-436b-80e4-120cdb6f83f4 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:03:14.101277 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b50aa21a-3bee-436b-80e4-120cdb6f83f4 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 27562067-687f-4487-805b-a0ee71981f90] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:03:14.108223 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b50aa21a-3bee-436b-80e4-120cdb6f83f4 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:03:14.111145 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b50aa21a-3bee-436b-80e4-120cdb6f83f4 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:03:14.111145 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b50aa21a-3bee-436b-80e4-120cdb6f83f4 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:03:14.111145 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b50aa21a-3bee-436b-80e4-120cdb6f83f4 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:03:14.111145 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b50aa21a-3bee-436b-80e4-120cdb6f83f4 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:03:14.111683 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b50aa21a-3bee-436b-80e4-120cdb6f83f4 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:03:14.243414 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b50aa21a-3bee-436b-80e4-120cdb6f83f4 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 06:03:14.252532 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b50aa21a-3bee-436b-80e4-120cdb6f83f4 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90" status: 200 len: 1566 microversion: 2.1 time: 0.155829 Sep 23 06:03:14.253122 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3970/8126] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:03:14 2022] GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 06:03:15.275890 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-cae90025-1753-4833-90d8-0717df8b05d2 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:03:15.276499 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-cae90025-1753-4833-90d8-0717df8b05d2 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 27562067-687f-4487-805b-a0ee71981f90] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:03:15.283060 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cae90025-1753-4833-90d8-0717df8b05d2 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:03:15.283552 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cae90025-1753-4833-90d8-0717df8b05d2 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:03:15.283987 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cae90025-1753-4833-90d8-0717df8b05d2 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:03:15.284706 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cae90025-1753-4833-90d8-0717df8b05d2 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:03:15.285166 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cae90025-1753-4833-90d8-0717df8b05d2 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:03:15.285587 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-cae90025-1753-4833-90d8-0717df8b05d2 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:03:15.420125 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-cae90025-1753-4833-90d8-0717df8b05d2 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 06:03:15.428294 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-cae90025-1753-4833-90d8-0717df8b05d2 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90" status: 200 len: 1566 microversion: 2.1 time: 0.156619 Sep 23 06:03:15.428861 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4157/8127] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:03:15 2022] GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 06:03:16.452158 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5e327c03-c6e5-4057-b735-ad427a3bf758 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:03:16.453377 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5e327c03-c6e5-4057-b735-ad427a3bf758 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 27562067-687f-4487-805b-a0ee71981f90] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:03:16.460307 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5e327c03-c6e5-4057-b735-ad427a3bf758 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:03:16.460818 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5e327c03-c6e5-4057-b735-ad427a3bf758 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:03:16.461275 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5e327c03-c6e5-4057-b735-ad427a3bf758 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:03:16.462166 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5e327c03-c6e5-4057-b735-ad427a3bf758 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:03:16.462487 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5e327c03-c6e5-4057-b735-ad427a3bf758 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:03:16.462981 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5e327c03-c6e5-4057-b735-ad427a3bf758 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:03:16.593390 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-5e327c03-c6e5-4057-b735-ad427a3bf758 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 06:03:16.601355 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5e327c03-c6e5-4057-b735-ad427a3bf758 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90" status: 200 len: 1566 microversion: 2.1 time: 0.153263 Sep 23 06:03:16.601954 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3971/8128] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:03:16 2022] GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90 => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 06:03:17.624420 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-89edda4f-349f-4af8-8d72-0facab7015cf tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:03:17.625030 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-89edda4f-349f-4af8-8d72-0facab7015cf tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 27562067-687f-4487-805b-a0ee71981f90] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:03:17.631479 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-89edda4f-349f-4af8-8d72-0facab7015cf tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:03:17.631967 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-89edda4f-349f-4af8-8d72-0facab7015cf tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:03:17.632404 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-89edda4f-349f-4af8-8d72-0facab7015cf tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:03:17.633085 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-89edda4f-349f-4af8-8d72-0facab7015cf tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:03:17.633537 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-89edda4f-349f-4af8-8d72-0facab7015cf tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:03:17.633991 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-89edda4f-349f-4af8-8d72-0facab7015cf tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:03:17.765117 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-89edda4f-349f-4af8-8d72-0facab7015cf tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 06:03:17.772804 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-89edda4f-349f-4af8-8d72-0facab7015cf tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90" status: 200 len: 1566 microversion: 2.1 time: 0.152255 Sep 23 06:03:17.773381 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4158/8129] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:03:17 2022] GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90 => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 06:03:18.797809 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a9f166dd-923b-46f7-8d03-a31ee0ca27bf tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:03:18.798470 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a9f166dd-923b-46f7-8d03-a31ee0ca27bf tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 27562067-687f-4487-805b-a0ee71981f90] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:03:18.805352 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a9f166dd-923b-46f7-8d03-a31ee0ca27bf tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:03:18.805858 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a9f166dd-923b-46f7-8d03-a31ee0ca27bf tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:03:18.806348 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a9f166dd-923b-46f7-8d03-a31ee0ca27bf tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:03:18.807061 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a9f166dd-923b-46f7-8d03-a31ee0ca27bf tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:03:18.807536 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a9f166dd-923b-46f7-8d03-a31ee0ca27bf tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:03:18.807977 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a9f166dd-923b-46f7-8d03-a31ee0ca27bf tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:03:18.940020 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-a9f166dd-923b-46f7-8d03-a31ee0ca27bf tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 06:03:18.947946 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a9f166dd-923b-46f7-8d03-a31ee0ca27bf tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90" status: 200 len: 1566 microversion: 2.1 time: 0.154006 Sep 23 06:03:18.948470 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3972/8130] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:03:18 2022] GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 06:03:19.972280 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b64447e9-6657-43eb-b601-db57846e2afc tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:03:19.973048 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b64447e9-6657-43eb-b601-db57846e2afc tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 27562067-687f-4487-805b-a0ee71981f90] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:03:19.979734 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b64447e9-6657-43eb-b601-db57846e2afc tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:03:19.980304 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b64447e9-6657-43eb-b601-db57846e2afc tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:03:19.980822 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b64447e9-6657-43eb-b601-db57846e2afc tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:03:19.981608 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b64447e9-6657-43eb-b601-db57846e2afc tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:03:19.982096 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b64447e9-6657-43eb-b601-db57846e2afc tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:03:19.982538 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b64447e9-6657-43eb-b601-db57846e2afc tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:03:20.113379 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-b64447e9-6657-43eb-b601-db57846e2afc tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 06:03:20.121320 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b64447e9-6657-43eb-b601-db57846e2afc tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90" status: 200 len: 1566 microversion: 2.1 time: 0.153615 Sep 23 06:03:20.121922 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4159/8131] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:03:19 2022] GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 06:03:21.144648 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-0785f107-49b2-4422-aedf-25dbbfe6d277 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:03:21.145357 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-0785f107-49b2-4422-aedf-25dbbfe6d277 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 27562067-687f-4487-805b-a0ee71981f90] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:03:21.152641 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0785f107-49b2-4422-aedf-25dbbfe6d277 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:03:21.156430 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0785f107-49b2-4422-aedf-25dbbfe6d277 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:03:21.156430 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0785f107-49b2-4422-aedf-25dbbfe6d277 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:03:21.156430 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0785f107-49b2-4422-aedf-25dbbfe6d277 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:03:21.156430 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0785f107-49b2-4422-aedf-25dbbfe6d277 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:03:21.156430 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-0785f107-49b2-4422-aedf-25dbbfe6d277 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:03:21.296417 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-0785f107-49b2-4422-aedf-25dbbfe6d277 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 06:03:21.304915 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-0785f107-49b2-4422-aedf-25dbbfe6d277 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90" status: 200 len: 1567 microversion: 2.1 time: 0.164233 Sep 23 06:03:21.308389 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3973/8132] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:03:21 2022] GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90 => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 06:03:21.327622 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6bbc8111-d1c8-42d1-ad62-2ec4dde9ed9a tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 06:03:21.331257 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-6bbc8111-d1c8-42d1-ad62-2ec4dde9ed9a tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 27562067-687f-4487-805b-a0ee71981f90] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:03:21.335833 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6bbc8111-d1c8-42d1-ad62-2ec4dde9ed9a tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:03:21.336337 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6bbc8111-d1c8-42d1-ad62-2ec4dde9ed9a tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:03:21.336786 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6bbc8111-d1c8-42d1-ad62-2ec4dde9ed9a tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:03:21.337498 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6bbc8111-d1c8-42d1-ad62-2ec4dde9ed9a tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:03:21.338002 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6bbc8111-d1c8-42d1-ad62-2ec4dde9ed9a tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:03:21.338444 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6bbc8111-d1c8-42d1-ad62-2ec4dde9ed9a tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:03:21.418487 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-6bbc8111-d1c8-42d1-ad62-2ec4dde9ed9a tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 27562067-687f-4487-805b-a0ee71981f90] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122699) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 23 06:03:21.653071 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6bbc8111-d1c8-42d1-ad62-2ec4dde9ed9a tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "POST /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90/action" status: 202 len: 0 microversion: 2.1 time: 0.329369 Sep 23 06:03:21.653704 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4160/8133] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 06:03:21 2022] POST /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90/action => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 23 06:03:21.662393 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-16855c2b-a00d-4c42-9b27-8bf739db5c15 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:03:21.663021 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-16855c2b-a00d-4c42-9b27-8bf739db5c15 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 27562067-687f-4487-805b-a0ee71981f90] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:03:21.669096 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-16855c2b-a00d-4c42-9b27-8bf739db5c15 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:03:21.669598 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-16855c2b-a00d-4c42-9b27-8bf739db5c15 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:03:21.670083 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-16855c2b-a00d-4c42-9b27-8bf739db5c15 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:03:21.670809 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-16855c2b-a00d-4c42-9b27-8bf739db5c15 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:03:21.671276 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-16855c2b-a00d-4c42-9b27-8bf739db5c15 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:03:21.671793 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-16855c2b-a00d-4c42-9b27-8bf739db5c15 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:03:21.804894 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-16855c2b-a00d-4c42-9b27-8bf739db5c15 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 06:03:21.813570 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-16855c2b-a00d-4c42-9b27-8bf739db5c15 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90" status: 200 len: 1515 microversion: 2.1 time: 0.155024 Sep 23 06:03:21.814208 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3974/8134] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:03:21 2022] GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 06:03:22.320033 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-b22e4468-147c-476e-bcd2-67f884811cde req-fa18dab7-6fc3-477c-be90-59329841fbfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27562067-687f-4487-805b-a0ee71981f90", "name": "network-vif-unplugged", "status": "completed", "tag": "16b2e719-7de3-45da-ba11-9c6a23bb45da"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 06:03:22.333046 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-b22e4468-147c-476e-bcd2-67f884811cde req-fa18dab7-6fc3-477c-be90-59329841fbfd service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:03:22.333046 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-b22e4468-147c-476e-bcd2-67f884811cde req-fa18dab7-6fc3-477c-be90-59329841fbfd service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:03:22.333046 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-b22e4468-147c-476e-bcd2-67f884811cde req-fa18dab7-6fc3-477c-be90-59329841fbfd service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:03:22.344310 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.compute.server_external_events [req-b22e4468-147c-476e-bcd2-67f884811cde req-fa18dab7-6fc3-477c-be90-59329841fbfd service nova] Unable to find a host for instance 27562067-687f-4487-805b-a0ee71981f90. Dropping event network-vif-unplugged {{(pid=122699) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 23 06:03:22.345705 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-b22e4468-147c-476e-bcd2-67f884811cde req-fa18dab7-6fc3-477c-be90-59329841fbfd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.085731 Sep 23 06:03:22.346225 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4161/8135] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 06:03:22 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 87 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 23 06:03:22.837802 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-5e113f62-d9cf-4e08-9526-fe58bb5a855b tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:03:22.838366 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-5e113f62-d9cf-4e08-9526-fe58bb5a855b tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 27562067-687f-4487-805b-a0ee71981f90] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:03:22.847934 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5e113f62-d9cf-4e08-9526-fe58bb5a855b tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:03:22.848827 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5e113f62-d9cf-4e08-9526-fe58bb5a855b tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:03:22.850603 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5e113f62-d9cf-4e08-9526-fe58bb5a855b tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:03:22.852000 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5e113f62-d9cf-4e08-9526-fe58bb5a855b tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:03:22.852514 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5e113f62-d9cf-4e08-9526-fe58bb5a855b tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:03:22.852931 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-5e113f62-d9cf-4e08-9526-fe58bb5a855b tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:03:23.029154 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-5e113f62-d9cf-4e08-9526-fe58bb5a855b tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 06:03:23.037719 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-5e113f62-d9cf-4e08-9526-fe58bb5a855b tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90" status: 200 len: 1515 microversion: 2.1 time: 0.203997 Sep 23 06:03:23.038317 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3975/8136] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:03:22 2022] GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90 => generated 1515 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 06:03:24.060917 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e2e4249a-ce43-47fe-bed8-f8dd1f63a47c tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:03:24.061538 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e2e4249a-ce43-47fe-bed8-f8dd1f63a47c tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 27562067-687f-4487-805b-a0ee71981f90] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:03:24.068656 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e2e4249a-ce43-47fe-bed8-f8dd1f63a47c tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:03:24.069153 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e2e4249a-ce43-47fe-bed8-f8dd1f63a47c tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:03:24.069595 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e2e4249a-ce43-47fe-bed8-f8dd1f63a47c tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:03:24.070323 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e2e4249a-ce43-47fe-bed8-f8dd1f63a47c tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:03:24.070781 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e2e4249a-ce43-47fe-bed8-f8dd1f63a47c tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:03:24.071253 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e2e4249a-ce43-47fe-bed8-f8dd1f63a47c tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:03:24.209081 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e2e4249a-ce43-47fe-bed8-f8dd1f63a47c tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 06:03:24.217298 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e2e4249a-ce43-47fe-bed8-f8dd1f63a47c tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90" status: 200 len: 1515 microversion: 2.1 time: 0.160264 Sep 23 06:03:24.222034 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4162/8137] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:03:24 2022] GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90 => generated 1515 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 06:03:25.240920 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-4c416349-52b4-46fe-a736-2e097d4aad6f tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:03:25.241556 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-4c416349-52b4-46fe-a736-2e097d4aad6f tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 27562067-687f-4487-805b-a0ee71981f90] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:03:25.248476 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4c416349-52b4-46fe-a736-2e097d4aad6f tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:03:25.248993 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4c416349-52b4-46fe-a736-2e097d4aad6f tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:03:25.249455 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4c416349-52b4-46fe-a736-2e097d4aad6f tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:03:25.250209 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4c416349-52b4-46fe-a736-2e097d4aad6f tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:03:25.250696 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4c416349-52b4-46fe-a736-2e097d4aad6f tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:03:25.251148 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-4c416349-52b4-46fe-a736-2e097d4aad6f tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:03:25.387556 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-4c416349-52b4-46fe-a736-2e097d4aad6f tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 06:03:25.397562 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-4c416349-52b4-46fe-a736-2e097d4aad6f tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90" status: 200 len: 1515 microversion: 2.1 time: 0.160611 Sep 23 06:03:25.398377 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3976/8138] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:03:25 2022] GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90 => generated 1515 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 06:03:26.421373 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-19eeeffd-5768-4212-8440-00c004d04cbb tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:03:26.422707 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-19eeeffd-5768-4212-8440-00c004d04cbb tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 27562067-687f-4487-805b-a0ee71981f90] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:03:26.429564 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-19eeeffd-5768-4212-8440-00c004d04cbb tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:03:26.430139 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-19eeeffd-5768-4212-8440-00c004d04cbb tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:03:26.430588 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-19eeeffd-5768-4212-8440-00c004d04cbb tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:03:26.431306 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-19eeeffd-5768-4212-8440-00c004d04cbb tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:03:26.431802 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-19eeeffd-5768-4212-8440-00c004d04cbb tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:03:26.432239 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-19eeeffd-5768-4212-8440-00c004d04cbb tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:03:26.566197 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-19eeeffd-5768-4212-8440-00c004d04cbb tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 06:03:26.574070 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-19eeeffd-5768-4212-8440-00c004d04cbb tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90" status: 200 len: 1517 microversion: 2.1 time: 0.156696 Sep 23 06:03:26.574641 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4163/8139] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:03:26 2022] GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90 => generated 1517 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 06:03:27.599223 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e1685bc6-0a0b-4f38-90fd-9ce61851f63a tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:03:27.599991 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e1685bc6-0a0b-4f38-90fd-9ce61851f63a tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 27562067-687f-4487-805b-a0ee71981f90] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:03:27.607103 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e1685bc6-0a0b-4f38-90fd-9ce61851f63a tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:03:27.607613 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e1685bc6-0a0b-4f38-90fd-9ce61851f63a tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:03:27.608194 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e1685bc6-0a0b-4f38-90fd-9ce61851f63a tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:03:27.609011 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e1685bc6-0a0b-4f38-90fd-9ce61851f63a tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:03:27.609494 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e1685bc6-0a0b-4f38-90fd-9ce61851f63a tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:03:27.609960 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e1685bc6-0a0b-4f38-90fd-9ce61851f63a tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:03:27.743833 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e1685bc6-0a0b-4f38-90fd-9ce61851f63a tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 06:03:27.754096 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e1685bc6-0a0b-4f38-90fd-9ce61851f63a tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90" status: 200 len: 1517 microversion: 2.1 time: 0.158245 Sep 23 06:03:27.755087 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3977/8140] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:03:27 2022] GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90 => generated 1517 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 06:03:28.779112 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4e90f4c9-c5e5-4a0f-aeb8-e7856db09ecf tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:03:28.779776 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4e90f4c9-c5e5-4a0f-aeb8-e7856db09ecf tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 27562067-687f-4487-805b-a0ee71981f90] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:03:28.786649 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4e90f4c9-c5e5-4a0f-aeb8-e7856db09ecf tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:03:28.787156 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4e90f4c9-c5e5-4a0f-aeb8-e7856db09ecf tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:03:28.787603 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4e90f4c9-c5e5-4a0f-aeb8-e7856db09ecf tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:03:28.788324 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4e90f4c9-c5e5-4a0f-aeb8-e7856db09ecf tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:03:28.788788 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4e90f4c9-c5e5-4a0f-aeb8-e7856db09ecf tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:03:28.789216 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4e90f4c9-c5e5-4a0f-aeb8-e7856db09ecf tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:03:28.924145 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-4e90f4c9-c5e5-4a0f-aeb8-e7856db09ecf tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 06:03:28.931971 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4e90f4c9-c5e5-4a0f-aeb8-e7856db09ecf tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90" status: 200 len: 1517 microversion: 2.1 time: 0.156898 Sep 23 06:03:28.932546 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4164/8141] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:03:28 2022] GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90 => generated 1517 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 06:03:29.955511 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-14f51f97-df9a-4b4a-a454-1ebb1f98944a tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:03:29.956050 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-14f51f97-df9a-4b4a-a454-1ebb1f98944a tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 27562067-687f-4487-805b-a0ee71981f90] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:03:29.962986 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-14f51f97-df9a-4b4a-a454-1ebb1f98944a tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:03:29.963521 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-14f51f97-df9a-4b4a-a454-1ebb1f98944a tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:03:29.963973 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-14f51f97-df9a-4b4a-a454-1ebb1f98944a tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:03:29.964707 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-14f51f97-df9a-4b4a-a454-1ebb1f98944a tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:03:29.965181 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-14f51f97-df9a-4b4a-a454-1ebb1f98944a tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:03:29.965635 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-14f51f97-df9a-4b4a-a454-1ebb1f98944a tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:03:29.984561 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 06:03:30.100929 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-14f51f97-df9a-4b4a-a454-1ebb1f98944a tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 06:03:30.108960 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-14f51f97-df9a-4b4a-a454-1ebb1f98944a tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90" status: 200 len: 1517 microversion: 2.1 time: 0.157879 Sep 23 06:03:30.109547 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3978/8142] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:03:29 2022] GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90 => generated 1517 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 06:03:31.132694 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ba511157-2ac9-433c-9f9e-7574595538f1 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:03:31.133310 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ba511157-2ac9-433c-9f9e-7574595538f1 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 27562067-687f-4487-805b-a0ee71981f90] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:03:31.140481 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ba511157-2ac9-433c-9f9e-7574595538f1 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:03:31.140977 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ba511157-2ac9-433c-9f9e-7574595538f1 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:03:31.141431 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ba511157-2ac9-433c-9f9e-7574595538f1 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:03:31.142194 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ba511157-2ac9-433c-9f9e-7574595538f1 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:03:31.142676 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ba511157-2ac9-433c-9f9e-7574595538f1 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:03:31.143089 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ba511157-2ac9-433c-9f9e-7574595538f1 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:03:31.297583 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ba511157-2ac9-433c-9f9e-7574595538f1 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 06:03:31.303137 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 06:03:31.310067 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ba511157-2ac9-433c-9f9e-7574595538f1 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90" status: 200 len: 1517 microversion: 2.1 time: 0.181202 Sep 23 06:03:31.310671 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4165/8143] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:03:31 2022] GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90 => generated 1517 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 06:03:32.333922 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7e526b51-2dbb-4a05-94ec-07d00efedb87 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:03:32.334598 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7e526b51-2dbb-4a05-94ec-07d00efedb87 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 27562067-687f-4487-805b-a0ee71981f90] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:03:32.337444 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=31 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 06:03:32.342223 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7e526b51-2dbb-4a05-94ec-07d00efedb87 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:03:32.342737 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7e526b51-2dbb-4a05-94ec-07d00efedb87 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:03:32.343700 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7e526b51-2dbb-4a05-94ec-07d00efedb87 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:03:32.344427 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7e526b51-2dbb-4a05-94ec-07d00efedb87 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:03:32.344905 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7e526b51-2dbb-4a05-94ec-07d00efedb87 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:03:32.345353 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7e526b51-2dbb-4a05-94ec-07d00efedb87 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:03:32.478898 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-7e526b51-2dbb-4a05-94ec-07d00efedb87 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 06:03:32.488156 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7e526b51-2dbb-4a05-94ec-07d00efedb87 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90" status: 200 len: 1573 microversion: 2.1 time: 0.158000 Sep 23 06:03:32.488545 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3979/8144] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:03:32 2022] GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90 => generated 1573 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 06:03:32.615174 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-38390937-e01b-42a8-a7ae-6563771704e4 req-b79a0618-6c14-4f92-83e4-f1bd5165de8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27562067-687f-4487-805b-a0ee71981f90", "tag": "16b2e719-7de3-45da-ba11-9c6a23bb45da"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 06:03:32.625331 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-38390937-e01b-42a8-a7ae-6563771704e4 req-b79a0618-6c14-4f92-83e4-f1bd5165de8b service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:03:32.628777 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-38390937-e01b-42a8-a7ae-6563771704e4 req-b79a0618-6c14-4f92-83e4-f1bd5165de8b service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:03:32.628777 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-38390937-e01b-42a8-a7ae-6563771704e4 req-b79a0618-6c14-4f92-83e4-f1bd5165de8b service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:03:32.641035 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-38390937-e01b-42a8-a7ae-6563771704e4 req-b79a0618-6c14-4f92-83e4-f1bd5165de8b service nova] Creating event network-changed:16b2e719-7de3-45da-ba11-9c6a23bb45da for instance 27562067-687f-4487-805b-a0ee71981f90 on n-h1-846463-3 Sep 23 06:03:32.648092 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-38390937-e01b-42a8-a7ae-6563771704e4 req-b79a0618-6c14-4f92-83e4-f1bd5165de8b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090420 Sep 23 06:03:32.649923 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4166/8145] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 06:03:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 06:03:33.511548 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-2d0281f3-dde3-4143-9c2d-6834473674dd tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:03:33.512189 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-2d0281f3-dde3-4143-9c2d-6834473674dd tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 27562067-687f-4487-805b-a0ee71981f90] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:03:33.519103 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2d0281f3-dde3-4143-9c2d-6834473674dd tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:03:33.519526 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2d0281f3-dde3-4143-9c2d-6834473674dd tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:03:33.519990 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2d0281f3-dde3-4143-9c2d-6834473674dd tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:03:33.520715 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2d0281f3-dde3-4143-9c2d-6834473674dd tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:03:33.521289 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2d0281f3-dde3-4143-9c2d-6834473674dd tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:03:33.521642 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-2d0281f3-dde3-4143-9c2d-6834473674dd tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:03:33.657579 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-2d0281f3-dde3-4143-9c2d-6834473674dd tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 06:03:33.665360 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-2d0281f3-dde3-4143-9c2d-6834473674dd tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90" status: 200 len: 1573 microversion: 2.1 time: 0.157787 Sep 23 06:03:33.665882 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3980/8146] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:03:33 2022] GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90 => generated 1573 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 06:03:34.689657 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-7865a150-64fb-4aa0-8cd0-45f7e32073b4 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:03:34.690396 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-7865a150-64fb-4aa0-8cd0-45f7e32073b4 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 27562067-687f-4487-805b-a0ee71981f90] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:03:34.692728 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 06:03:34.698126 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7865a150-64fb-4aa0-8cd0-45f7e32073b4 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:03:34.702738 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7865a150-64fb-4aa0-8cd0-45f7e32073b4 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:03:34.702738 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7865a150-64fb-4aa0-8cd0-45f7e32073b4 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:03:34.702738 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7865a150-64fb-4aa0-8cd0-45f7e32073b4 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:03:34.702738 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7865a150-64fb-4aa0-8cd0-45f7e32073b4 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:03:34.702738 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-7865a150-64fb-4aa0-8cd0-45f7e32073b4 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:03:34.835470 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-7865a150-64fb-4aa0-8cd0-45f7e32073b4 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 06:03:34.843325 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-7865a150-64fb-4aa0-8cd0-45f7e32073b4 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90" status: 200 len: 1573 microversion: 2.1 time: 0.158666 Sep 23 06:03:34.843900 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4167/8147] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:03:34 2022] GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90 => generated 1573 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 06:03:35.866564 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e3039aae-50d3-41d3-ab8f-4f954ef4ecca tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:03:35.867201 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e3039aae-50d3-41d3-ab8f-4f954ef4ecca tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 27562067-687f-4487-805b-a0ee71981f90] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:03:35.874105 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e3039aae-50d3-41d3-ab8f-4f954ef4ecca tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:03:35.874614 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e3039aae-50d3-41d3-ab8f-4f954ef4ecca tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:03:35.875070 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e3039aae-50d3-41d3-ab8f-4f954ef4ecca tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:03:35.875782 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e3039aae-50d3-41d3-ab8f-4f954ef4ecca tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:03:35.876255 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e3039aae-50d3-41d3-ab8f-4f954ef4ecca tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:03:35.876698 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e3039aae-50d3-41d3-ab8f-4f954ef4ecca tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:03:36.010714 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e3039aae-50d3-41d3-ab8f-4f954ef4ecca tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 06:03:36.019192 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e3039aae-50d3-41d3-ab8f-4f954ef4ecca tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90" status: 200 len: 1573 microversion: 2.1 time: 0.156568 Sep 23 06:03:36.019769 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3981/8148] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:03:35 2022] GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90 => generated 1573 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 06:03:37.042531 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1c2aed0d-3015-4ba4-ae1f-5b87b6c74fc5 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:03:37.043183 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1c2aed0d-3015-4ba4-ae1f-5b87b6c74fc5 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 27562067-687f-4487-805b-a0ee71981f90] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:03:37.050350 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1c2aed0d-3015-4ba4-ae1f-5b87b6c74fc5 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:03:37.050848 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1c2aed0d-3015-4ba4-ae1f-5b87b6c74fc5 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:03:37.051296 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1c2aed0d-3015-4ba4-ae1f-5b87b6c74fc5 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:03:37.052002 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1c2aed0d-3015-4ba4-ae1f-5b87b6c74fc5 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:03:37.052467 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1c2aed0d-3015-4ba4-ae1f-5b87b6c74fc5 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:03:37.052898 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1c2aed0d-3015-4ba4-ae1f-5b87b6c74fc5 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:03:37.183958 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1c2aed0d-3015-4ba4-ae1f-5b87b6c74fc5 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 06:03:37.192029 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1c2aed0d-3015-4ba4-ae1f-5b87b6c74fc5 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90" status: 200 len: 1573 microversion: 2.1 time: 0.153410 Sep 23 06:03:37.192609 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4168/8149] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:03:37 2022] GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90 => generated 1573 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 06:03:38.215692 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c212a142-994e-48af-afb3-1784c136ab73 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:03:38.216322 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c212a142-994e-48af-afb3-1784c136ab73 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 27562067-687f-4487-805b-a0ee71981f90] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:03:38.223810 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c212a142-994e-48af-afb3-1784c136ab73 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:03:38.224322 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c212a142-994e-48af-afb3-1784c136ab73 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:03:38.224780 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c212a142-994e-48af-afb3-1784c136ab73 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:03:38.225497 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c212a142-994e-48af-afb3-1784c136ab73 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:03:38.226010 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c212a142-994e-48af-afb3-1784c136ab73 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:03:38.226465 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c212a142-994e-48af-afb3-1784c136ab73 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:03:38.369134 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-c212a142-994e-48af-afb3-1784c136ab73 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 06:03:38.377562 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c212a142-994e-48af-afb3-1784c136ab73 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90" status: 200 len: 1573 microversion: 2.1 time: 0.165783 Sep 23 06:03:38.378743 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3982/8150] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:03:38 2022] GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90 => generated 1573 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 06:03:39.401184 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-56b15d54-5a30-41b0-b029-1ec22af36da8 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:03:39.401799 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-56b15d54-5a30-41b0-b029-1ec22af36da8 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 27562067-687f-4487-805b-a0ee71981f90] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:03:39.408954 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-56b15d54-5a30-41b0-b029-1ec22af36da8 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:03:39.409451 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-56b15d54-5a30-41b0-b029-1ec22af36da8 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:03:39.409916 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-56b15d54-5a30-41b0-b029-1ec22af36da8 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:03:39.410616 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-56b15d54-5a30-41b0-b029-1ec22af36da8 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:03:39.411081 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-56b15d54-5a30-41b0-b029-1ec22af36da8 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:03:39.411515 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-56b15d54-5a30-41b0-b029-1ec22af36da8 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:03:39.545504 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-56b15d54-5a30-41b0-b029-1ec22af36da8 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 06:03:39.556474 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-56b15d54-5a30-41b0-b029-1ec22af36da8 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90" status: 200 len: 1573 microversion: 2.1 time: 0.156428 Sep 23 06:03:39.556474 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4169/8151] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:03:39 2022] GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90 => generated 1573 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 06:03:40.576860 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-dc641982-468f-4dc9-ba2e-fce7b7032179 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:03:40.577493 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-dc641982-468f-4dc9-ba2e-fce7b7032179 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 27562067-687f-4487-805b-a0ee71981f90] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:03:40.584491 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dc641982-468f-4dc9-ba2e-fce7b7032179 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:03:40.584942 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dc641982-468f-4dc9-ba2e-fce7b7032179 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:03:40.585401 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dc641982-468f-4dc9-ba2e-fce7b7032179 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:03:40.586154 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dc641982-468f-4dc9-ba2e-fce7b7032179 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:03:40.586636 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dc641982-468f-4dc9-ba2e-fce7b7032179 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:03:40.587081 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dc641982-468f-4dc9-ba2e-fce7b7032179 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:03:40.718590 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-dc641982-468f-4dc9-ba2e-fce7b7032179 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 06:03:40.726403 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-dc641982-468f-4dc9-ba2e-fce7b7032179 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90" status: 200 len: 1573 microversion: 2.1 time: 0.153554 Sep 23 06:03:40.726979 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3983/8152] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:03:40 2022] GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90 => generated 1573 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 06:03:41.751419 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-a670da14-c8e5-4cb3-bc79-7594d5c3f55b tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:03:41.752337 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-a670da14-c8e5-4cb3-bc79-7594d5c3f55b tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 27562067-687f-4487-805b-a0ee71981f90] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:03:41.758927 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a670da14-c8e5-4cb3-bc79-7594d5c3f55b tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:03:41.759427 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a670da14-c8e5-4cb3-bc79-7594d5c3f55b tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:03:41.759876 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a670da14-c8e5-4cb3-bc79-7594d5c3f55b tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:03:41.760579 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a670da14-c8e5-4cb3-bc79-7594d5c3f55b tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:03:41.761046 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a670da14-c8e5-4cb3-bc79-7594d5c3f55b tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:03:41.761481 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-a670da14-c8e5-4cb3-bc79-7594d5c3f55b tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:03:41.895200 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-a670da14-c8e5-4cb3-bc79-7594d5c3f55b tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 06:03:41.903371 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-a670da14-c8e5-4cb3-bc79-7594d5c3f55b tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90" status: 200 len: 1573 microversion: 2.1 time: 0.156455 Sep 23 06:03:41.903962 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4170/8153] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:03:41 2022] GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90 => generated 1573 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 06:03:42.926378 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9a1ee0f4-c579-4640-be5e-aad827680544 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:03:42.927050 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-9a1ee0f4-c579-4640-be5e-aad827680544 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 27562067-687f-4487-805b-a0ee71981f90] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:03:42.934039 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9a1ee0f4-c579-4640-be5e-aad827680544 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:03:42.934554 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9a1ee0f4-c579-4640-be5e-aad827680544 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:03:42.935016 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9a1ee0f4-c579-4640-be5e-aad827680544 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:03:42.935731 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9a1ee0f4-c579-4640-be5e-aad827680544 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:03:42.936215 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9a1ee0f4-c579-4640-be5e-aad827680544 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:03:42.937153 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9a1ee0f4-c579-4640-be5e-aad827680544 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:03:43.064474 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-9a1ee0f4-c579-4640-be5e-aad827680544 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 06:03:43.072333 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9a1ee0f4-c579-4640-be5e-aad827680544 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90" status: 200 len: 1573 microversion: 2.1 time: 0.149943 Sep 23 06:03:43.072938 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3984/8154] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:03:42 2022] GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90 => generated 1573 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 06:03:43.655459 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-7e1dd3c2-7d8f-47e9-9ed7-1ecb510b4d28 req-a0e93a36-da9f-426e-bd3a-a28a07b618f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27562067-687f-4487-805b-a0ee71981f90", "name": "network-vif-plugged", "status": "completed", "tag": "16b2e719-7de3-45da-ba11-9c6a23bb45da"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 06:03:43.665819 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-7e1dd3c2-7d8f-47e9-9ed7-1ecb510b4d28 req-a0e93a36-da9f-426e-bd3a-a28a07b618f0 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:03:43.666346 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-7e1dd3c2-7d8f-47e9-9ed7-1ecb510b4d28 req-a0e93a36-da9f-426e-bd3a-a28a07b618f0 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:03:43.666788 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-7e1dd3c2-7d8f-47e9-9ed7-1ecb510b4d28 req-a0e93a36-da9f-426e-bd3a-a28a07b618f0 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:03:43.681470 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-7e1dd3c2-7d8f-47e9-9ed7-1ecb510b4d28 req-a0e93a36-da9f-426e-bd3a-a28a07b618f0 service nova] Creating event network-vif-plugged:16b2e719-7de3-45da-ba11-9c6a23bb45da for instance 27562067-687f-4487-805b-a0ee71981f90 on n-h1-846463-3 Sep 23 06:03:43.686752 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-7e1dd3c2-7d8f-47e9-9ed7-1ecb510b4d28 req-a0e93a36-da9f-426e-bd3a-a28a07b618f0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035810 Sep 23 06:03:43.687619 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4171/8155] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 06:03:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 06:03:44.096804 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9d57fb06-994a-43f4-9b09-6dc65cc2fe8e tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:03:44.097474 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-9d57fb06-994a-43f4-9b09-6dc65cc2fe8e tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 27562067-687f-4487-805b-a0ee71981f90] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:03:44.104394 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9d57fb06-994a-43f4-9b09-6dc65cc2fe8e tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:03:44.104903 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9d57fb06-994a-43f4-9b09-6dc65cc2fe8e tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:03:44.105364 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9d57fb06-994a-43f4-9b09-6dc65cc2fe8e tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:03:44.106123 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9d57fb06-994a-43f4-9b09-6dc65cc2fe8e tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:03:44.106615 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9d57fb06-994a-43f4-9b09-6dc65cc2fe8e tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:03:44.107066 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9d57fb06-994a-43f4-9b09-6dc65cc2fe8e tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:03:44.242593 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-9d57fb06-994a-43f4-9b09-6dc65cc2fe8e tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 06:03:44.250954 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9d57fb06-994a-43f4-9b09-6dc65cc2fe8e tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90" status: 200 len: 1573 microversion: 2.1 time: 0.158714 Sep 23 06:03:44.251546 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3985/8156] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:03:44 2022] GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90 => generated 1573 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 06:03:45.276446 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-06729ff8-8608-4b30-b0d8-2bf1c63a95e5 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:03:45.277187 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-06729ff8-8608-4b30-b0d8-2bf1c63a95e5 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 27562067-687f-4487-805b-a0ee71981f90] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:03:45.283912 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-06729ff8-8608-4b30-b0d8-2bf1c63a95e5 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:03:45.284407 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-06729ff8-8608-4b30-b0d8-2bf1c63a95e5 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:03:45.284855 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-06729ff8-8608-4b30-b0d8-2bf1c63a95e5 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:03:45.285555 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-06729ff8-8608-4b30-b0d8-2bf1c63a95e5 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:03:45.286047 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-06729ff8-8608-4b30-b0d8-2bf1c63a95e5 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:03:45.286578 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-06729ff8-8608-4b30-b0d8-2bf1c63a95e5 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:03:45.419115 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-06729ff8-8608-4b30-b0d8-2bf1c63a95e5 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 06:03:45.426937 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-06729ff8-8608-4b30-b0d8-2bf1c63a95e5 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90" status: 200 len: 1560 microversion: 2.1 time: 0.155722 Sep 23 06:03:45.427514 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4172/8157] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:03:45 2022] GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 06:05:22.623277 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=13 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 06:05:22.624218 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=44 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 06:05:22.628288 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-ad5cda6f-09b4-46d6-9d51-b3ebb81561c9 req-2953545f-63fa-4673-9e45-4895d4e07a82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27562067-687f-4487-805b-a0ee71981f90", "tag": "16b2e719-7de3-45da-ba11-9c6a23bb45da"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 06:05:22.629417 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b7e8ab2e-be87-46b1-a4ec-f44f7efeb1e8 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:05:22.629975 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b7e8ab2e-be87-46b1-a4ec-f44f7efeb1e8 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 27562067-687f-4487-805b-a0ee71981f90] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:05:22.641776 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b7e8ab2e-be87-46b1-a4ec-f44f7efeb1e8 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:05:22.641776 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b7e8ab2e-be87-46b1-a4ec-f44f7efeb1e8 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:05:22.641776 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b7e8ab2e-be87-46b1-a4ec-f44f7efeb1e8 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:05:22.641776 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b7e8ab2e-be87-46b1-a4ec-f44f7efeb1e8 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:05:22.641776 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b7e8ab2e-be87-46b1-a4ec-f44f7efeb1e8 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:05:22.642356 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=11 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 06:05:22.642468 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b7e8ab2e-be87-46b1-a4ec-f44f7efeb1e8 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:05:22.642563 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=35 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 06:05:22.643788 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-ad5cda6f-09b4-46d6-9d51-b3ebb81561c9 req-2953545f-63fa-4673-9e45-4895d4e07a82 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:05:22.644503 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-ad5cda6f-09b4-46d6-9d51-b3ebb81561c9 req-2953545f-63fa-4673-9e45-4895d4e07a82 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:05:22.644943 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-ad5cda6f-09b4-46d6-9d51-b3ebb81561c9 req-2953545f-63fa-4673-9e45-4895d4e07a82 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:05:22.659550 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-ad5cda6f-09b4-46d6-9d51-b3ebb81561c9 req-2953545f-63fa-4673-9e45-4895d4e07a82 service nova] Creating event network-changed:16b2e719-7de3-45da-ba11-9c6a23bb45da for instance 27562067-687f-4487-805b-a0ee71981f90 on n-h1-846463-3 Sep 23 06:05:22.665785 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-ad5cda6f-09b4-46d6-9d51-b3ebb81561c9 req-2953545f-63fa-4673-9e45-4895d4e07a82 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041911 Sep 23 06:05:22.669441 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4173/8158] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 06:05:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 06:05:22.671817 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b7e8ab2e-be87-46b1-a4ec-f44f7efeb1e8 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 27562067-687f-4487-805b-a0ee71981f90] Going to try to terminate instance {{(pid=122698) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 06:05:23.052018 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b7e8ab2e-be87-46b1-a4ec-f44f7efeb1e8 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "DELETE /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90" status: 204 len: 0 microversion: 2.1 time: 0.430092 Sep 23 06:05:23.052793 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3986/8159] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 06:05:22 2022] DELETE /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 06:05:23.063398 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-bd717212-0f22-417a-8c8f-e8f6304c9555 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:05:23.064109 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-bd717212-0f22-417a-8c8f-e8f6304c9555 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 27562067-687f-4487-805b-a0ee71981f90] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:05:23.071782 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bd717212-0f22-417a-8c8f-e8f6304c9555 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:05:23.072572 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bd717212-0f22-417a-8c8f-e8f6304c9555 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:05:23.073237 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bd717212-0f22-417a-8c8f-e8f6304c9555 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:05:23.074261 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bd717212-0f22-417a-8c8f-e8f6304c9555 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:05:23.074990 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bd717212-0f22-417a-8c8f-e8f6304c9555 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:05:23.077939 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-bd717212-0f22-417a-8c8f-e8f6304c9555 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:05:23.210594 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-bd717212-0f22-417a-8c8f-e8f6304c9555 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 06:05:23.218548 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-bd717212-0f22-417a-8c8f-e8f6304c9555 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90" status: 200 len: 1566 microversion: 2.1 time: 0.160486 Sep 23 06:05:23.219178 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4174/8160] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:05:23 2022] GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90 => generated 1566 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 06:05:24.242951 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b8784a95-2fad-4931-9725-5639a65a6196 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:05:24.243680 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b8784a95-2fad-4931-9725-5639a65a6196 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 27562067-687f-4487-805b-a0ee71981f90] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:05:24.250781 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b8784a95-2fad-4931-9725-5639a65a6196 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:05:24.251299 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b8784a95-2fad-4931-9725-5639a65a6196 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:05:24.251757 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b8784a95-2fad-4931-9725-5639a65a6196 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:05:24.252478 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b8784a95-2fad-4931-9725-5639a65a6196 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:05:24.252958 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b8784a95-2fad-4931-9725-5639a65a6196 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:05:24.253408 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b8784a95-2fad-4931-9725-5639a65a6196 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:05:24.389553 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b8784a95-2fad-4931-9725-5639a65a6196 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 06:05:24.397382 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b8784a95-2fad-4931-9725-5639a65a6196 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90" status: 200 len: 1447 microversion: 2.1 time: 0.158804 Sep 23 06:05:24.397976 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3987/8161] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:05:24 2022] GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90 => generated 1447 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 06:05:25.095709 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-f854222b-5197-49b5-8ade-a7a1438924d0 req-b24cffe8-863c-4f74-9e25-78dc317ee31d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27562067-687f-4487-805b-a0ee71981f90", "name": "network-vif-deleted", "tag": "16b2e719-7de3-45da-ba11-9c6a23bb45da"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 06:05:25.106446 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-f854222b-5197-49b5-8ade-a7a1438924d0 req-b24cffe8-863c-4f74-9e25-78dc317ee31d service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:05:25.113497 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-f854222b-5197-49b5-8ade-a7a1438924d0 req-b24cffe8-863c-4f74-9e25-78dc317ee31d service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:05:25.113497 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-f854222b-5197-49b5-8ade-a7a1438924d0 req-b24cffe8-863c-4f74-9e25-78dc317ee31d service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:05:25.118891 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-f854222b-5197-49b5-8ade-a7a1438924d0 req-b24cffe8-863c-4f74-9e25-78dc317ee31d service nova] Creating event network-vif-deleted:16b2e719-7de3-45da-ba11-9c6a23bb45da for instance 27562067-687f-4487-805b-a0ee71981f90 on n-h1-846463-3 Sep 23 06:05:25.124383 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-f854222b-5197-49b5-8ade-a7a1438924d0 req-b24cffe8-863c-4f74-9e25-78dc317ee31d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032397 Sep 23 06:05:25.125023 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4175/8162] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 06:05:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 06:05:25.421479 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-73bac22e-b8f8-404c-99b3-609a43c889fe tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:05:25.422942 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-73bac22e-b8f8-404c-99b3-609a43c889fe tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 27562067-687f-4487-805b-a0ee71981f90] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:05:25.431134 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-73bac22e-b8f8-404c-99b3-609a43c889fe tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:05:25.431656 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-73bac22e-b8f8-404c-99b3-609a43c889fe tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:05:25.432360 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-73bac22e-b8f8-404c-99b3-609a43c889fe tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:05:25.433092 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-73bac22e-b8f8-404c-99b3-609a43c889fe tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:05:25.433593 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-73bac22e-b8f8-404c-99b3-609a43c889fe tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:05:25.434065 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-73bac22e-b8f8-404c-99b3-609a43c889fe tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:05:25.500308 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-73bac22e-b8f8-404c-99b3-609a43c889fe tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 06:05:25.509043 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-73bac22e-b8f8-404c-99b3-609a43c889fe tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90" status: 200 len: 1218 microversion: 2.1 time: 0.091527 Sep 23 06:05:25.509553 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3988/8163] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:05:25 2022] GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90 => generated 1218 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 06:05:26.533713 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-682fa01f-a363-4ef2-ad91-9f845df95b32 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:05:26.534440 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-682fa01f-a363-4ef2-ad91-9f845df95b32 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 27562067-687f-4487-805b-a0ee71981f90] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:05:26.541385 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-682fa01f-a363-4ef2-ad91-9f845df95b32 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:05:26.541879 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-682fa01f-a363-4ef2-ad91-9f845df95b32 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:05:26.542337 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-682fa01f-a363-4ef2-ad91-9f845df95b32 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:05:26.543039 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-682fa01f-a363-4ef2-ad91-9f845df95b32 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:05:26.543505 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-682fa01f-a363-4ef2-ad91-9f845df95b32 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:05:26.543925 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-682fa01f-a363-4ef2-ad91-9f845df95b32 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:05:26.606949 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-682fa01f-a363-4ef2-ad91-9f845df95b32 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 06:05:26.614877 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-682fa01f-a363-4ef2-ad91-9f845df95b32 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90" status: 200 len: 1218 microversion: 2.1 time: 0.085912 Sep 23 06:05:26.615448 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4176/8164] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:05:26 2022] GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 06:05:27.637595 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-232773a5-29e0-4c34-9490-17af02b1a2e1 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:05:27.638290 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-232773a5-29e0-4c34-9490-17af02b1a2e1 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 27562067-687f-4487-805b-a0ee71981f90] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:05:27.645468 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-232773a5-29e0-4c34-9490-17af02b1a2e1 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:05:27.646050 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-232773a5-29e0-4c34-9490-17af02b1a2e1 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:05:27.646519 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-232773a5-29e0-4c34-9490-17af02b1a2e1 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:05:27.647259 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-232773a5-29e0-4c34-9490-17af02b1a2e1 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:05:27.647742 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-232773a5-29e0-4c34-9490-17af02b1a2e1 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:05:27.648195 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-232773a5-29e0-4c34-9490-17af02b1a2e1 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:05:27.717038 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-232773a5-29e0-4c34-9490-17af02b1a2e1 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 06:05:27.725043 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-232773a5-29e0-4c34-9490-17af02b1a2e1 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90" status: 200 len: 1218 microversion: 2.1 time: 0.091672 Sep 23 06:05:27.725858 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3989/8165] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:05:27 2022] GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90 => generated 1218 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 06:05:28.748441 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-5e736485-600d-4985-a414-5c3121271b7c tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:05:28.749019 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-5e736485-600d-4985-a414-5c3121271b7c tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 27562067-687f-4487-805b-a0ee71981f90] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:05:28.755527 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5e736485-600d-4985-a414-5c3121271b7c tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:05:28.756018 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5e736485-600d-4985-a414-5c3121271b7c tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:05:28.756461 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5e736485-600d-4985-a414-5c3121271b7c tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:05:28.757168 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5e736485-600d-4985-a414-5c3121271b7c tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:05:28.757631 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5e736485-600d-4985-a414-5c3121271b7c tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:05:28.758100 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-5e736485-600d-4985-a414-5c3121271b7c tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:05:28.819826 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-5e736485-600d-4985-a414-5c3121271b7c tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 06:05:28.827641 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-5e736485-600d-4985-a414-5c3121271b7c tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90" status: 200 len: 1218 microversion: 2.1 time: 0.083176 Sep 23 06:05:28.828223 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4177/8166] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:05:28 2022] GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 06:05:29.851165 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6d95a2b8-093b-4a87-b735-6259830ecce5 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:05:29.858118 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-6d95a2b8-093b-4a87-b735-6259830ecce5 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 27562067-687f-4487-805b-a0ee71981f90] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:05:29.859272 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6d95a2b8-093b-4a87-b735-6259830ecce5 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:05:29.859789 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6d95a2b8-093b-4a87-b735-6259830ecce5 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:05:29.860839 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6d95a2b8-093b-4a87-b735-6259830ecce5 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:05:29.861560 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6d95a2b8-093b-4a87-b735-6259830ecce5 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:05:29.862075 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6d95a2b8-093b-4a87-b735-6259830ecce5 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:05:29.862522 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6d95a2b8-093b-4a87-b735-6259830ecce5 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:05:29.894509 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6d95a2b8-093b-4a87-b735-6259830ecce5 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:05:29.895019 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6d95a2b8-093b-4a87-b735-6259830ecce5 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:05:29.895478 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6d95a2b8-093b-4a87-b735-6259830ecce5 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:05:29.895947 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-6d95a2b8-093b-4a87-b735-6259830ecce5 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lazy-loading 'fault' on Instance uuid 27562067-687f-4487-805b-a0ee71981f90 {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 06:05:29.939069 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6d95a2b8-093b-4a87-b735-6259830ecce5 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b929c8797a041c683b207e2d20d25b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93cf9690c0ef4fcf925253bed0fcd6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 06:05:29.947841 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-6d95a2b8-093b-4a87-b735-6259830ecce5 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90" status: 200 len: 1223 microversion: 2.1 time: 0.100555 Sep 23 06:05:29.948463 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3990/8167] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:05:29 2022] GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90 => generated 1223 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 06:05:30.972289 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b045b078-490d-48b5-ac45-59df82b0b604 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:05:30.972901 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-b045b078-490d-48b5-ac45-59df82b0b604 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] [instance: 27562067-687f-4487-805b-a0ee71981f90] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:05:30.979505 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b045b078-490d-48b5-ac45-59df82b0b604 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:05:30.980005 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b045b078-490d-48b5-ac45-59df82b0b604 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:05:30.980448 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b045b078-490d-48b5-ac45-59df82b0b604 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:05:30.981147 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b045b078-490d-48b5-ac45-59df82b0b604 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:05:30.981610 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b045b078-490d-48b5-ac45-59df82b0b604 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:05:30.982081 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-b045b078-490d-48b5-ac45-59df82b0b604 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:05:30.995792 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-b045b078-490d-48b5-ac45-59df82b0b604 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] HTTP exception thrown: Instance 27562067-687f-4487-805b-a0ee71981f90 could not be found. Sep 23 06:05:30.997436 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b045b078-490d-48b5-ac45-59df82b0b604 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Request method failure captured: Sep 23 06:05:30.997436 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90 HTTP/1.1 Sep 23 06:05:30.997436 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 06:05:30.997436 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 06:05:30.997436 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 06:05:30.997436 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 06:05:30.997436 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 06:05:30.997436 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 06:05:30.997436 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 06:05:30.997436 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 06:05:30.997436 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLUpL_GpPY3rMYfaRzw1KBWNuFFuAbuLkf9vxNdauuGts65mPUhhMLPtVaWGcu9KEyXkszWn0usznArU7yZENKzj2QCg1Y1DjtrPVGfIMjfcC7j1w_KWHsixEVb5dJsClGc7RVKET0BDn6W3aTQGEoiSPDoU9-6hMZTxWJkVFtxTOS2I Sep 23 06:05:30.997436 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 06:05:30.997436 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 06:05:30.997436 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 06:05:30.997436 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 06:05:30.997436 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 06:05:30.997436 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 06:05:30.997436 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: 93cf9690c0ef4fcf925253bed0fcd6a7 Sep 23 06:05:30.997436 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-TestShelveInstance-1773482243 Sep 23 06:05:30.997436 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 06:05:30.997436 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 06:05:30.997436 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_93cf9690c0ef4fcf925253bed0fcd6a7", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/93cf9690c0ef4fcf925253bed0fcd6a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/93cf9690c0ef4fcf925253bed0fcd6a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/93cf9690c0ef4fcf925253bed0fcd6a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 06:05:30.997436 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-TestShelveInstance-1773482243 Sep 23 06:05:30.997436 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: 93cf9690c0ef4fcf925253bed0fcd6a7 Sep 23 06:05:30.997436 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-TestShelveInstance-1773482243 Sep 23 06:05:30.997436 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-TestShelveInstance-1773482243-project Sep 23 06:05:30.997436 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 06:05:30.997436 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 06:05:30.997436 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: 0b929c8797a041c683b207e2d20d25b2 Sep 23 06:05:30.997436 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-TestShelveInstance-1773482243-project Sep 23 06:05:30.997436 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 06:05:30.997436 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance 27562067-687f-4487-805b-a0ee71981f90 could not be found. Sep 23 06:05:30.997436 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': '27562067-687f-4487-805b-a0ee71981f90'} Sep 23 06:05:30.997436 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 06:05:30.997436 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 06:05:30.997436 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 06:05:30.997436 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 06:05:30.997436 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 06:05:30.997436 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 06:05:30.997436 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 06:05:30.997436 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 06:05:30.997436 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 06:05:30.997436 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 06:05:30.997436 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27562067-687f-4487-805b-a0ee71981f90 could not be found. Sep 23 06:05:30.997436 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 06:05:30.997436 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 06:05:30.997436 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 06:05:30.997436 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 06:05:30.997436 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 06:05:30.997436 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 06:05:30.997436 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 06:05:30.997436 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 06:05:30.997436 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 06:05:30.997436 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 06:05:30.997436 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 06:05:30.997436 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 06:05:30.997436 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 06:05:30.997436 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 06:05:30.997436 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 06:05:30.997436 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 06:05:30.997436 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27562067-687f-4487-805b-a0ee71981f90 could not be found. Sep 23 06:05:30.997436 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 06:05:30.997436 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 06:05:30.997436 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 06:05:31.002738 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 06:05:31.002738 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 06:05:31.002738 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 06:05:31.002738 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 06:05:31.002738 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 06:05:31.002738 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27562067-687f-4487-805b-a0ee71981f90 could not be found. Sep 23 06:05:31.002738 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 06:05:31.002738 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-b045b078-490d-48b5-ac45-59df82b0b604 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Returning 404 to user: Instance 27562067-687f-4487-805b-a0ee71981f90 could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 06:05:31.002738 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-b045b078-490d-48b5-ac45-59df82b0b604 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90" status: 404 len: 111 microversion: 2.1 time: 0.030537 Sep 23 06:05:31.002738 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4178/8168] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:05:30 2022] GET /compute/v2.1/servers/27562067-687f-4487-805b-a0ee71981f90 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 06:05:31.255213 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ef11de8e-477b-4389-b6a9-db0a626743b6 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] Calling method '.version_select at 0x7ff1c0732430>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:05:31.365882 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ef11de8e-477b-4389-b6a9-db0a626743b6 tempest-TestShelveInstance-1773482243 tempest-TestShelveInstance-1773482243-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-499892786" status: 202 len: 0 microversion: 2.1 time: 0.114575 Sep 23 06:05:31.366641 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3991/8169] 10.222.0.33 () {58 vars in 1251 bytes} [Fri Sep 23 06:05:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-499892786 => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 06:05:53.177049 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=12 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 06:05:53.178084 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=24 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 06:05:53.369695 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-688f9314-bdd7-406c-89ab-42cc4621044c tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Action: 'create', calling method: .version_select at 0x7ff1bab27280>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-670755896", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOcmFNoPofoar2IFbn0b2llmj+a23eTjvYCne9kgu/aUOUTcw7m8ZsuifNPrYfiFE1eP690QP3+CicN/spJVOxb6QpQSebuFdOorpdFMZsG/syji61sdEO9nmsta1oUwEA=="}} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 06:05:53.386128 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-688f9314-bdd7-406c-89ab-42cc4621044c tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Getting quotas for project be42ada0a7c7487baa2733e5af4a3a05. Resources: {'key_pairs'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 06:05:53.391629 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.quota [None req-688f9314-bdd7-406c-89ab-42cc4621044c tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Getting quotas for user c8b0275002b74104979c605386448bdb and project be42ada0a7c7487baa2733e5af4a3a05. Resources: {'key_pairs'} {{(pid=122699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 06:05:53.514850 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-688f9314-bdd7-406c-89ab-42cc4621044c tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.343933 Sep 23 06:05:53.515493 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4179/8170] 10.222.0.33 () {60 vars in 1159 bytes} [Fri Sep 23 06:05:53 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 06:05:55.907847 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 06:05:55.909049 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 06:05:55.914255 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-c3d48afc-165d-4062-b2d1-bd9da1a0430e tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1730242638", "imageRef": "b8dd79b9-f0b9-43a9-9605-17244137c0ee", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-670755896", "security_groups": [{"name": "tempest-secgroup-smoke-2098595354"}], "networks": [{"uuid": "c4408167-004c-4356-9659-b9f7f03632f1"}]}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 06:05:56.146614 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.network.neutron [None req-c3d48afc-165d-4062-b2d1-bd9da1a0430e tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] validate_networks() for [('c4408167-004c-4356-9659-b9f7f03632f1', None, None, None, None, None)] {{(pid=122698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 06:05:56.635856 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-c3d48afc-165d-4062-b2d1-bd9da1a0430e tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Flavor limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 06:05:56.636302 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-c3d48afc-165d-4062-b2d1-bd9da1a0430e tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Image limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 06:05:56.636795 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-c3d48afc-165d-4062-b2d1-bd9da1a0430e tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Flavor pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 06:05:56.637224 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-c3d48afc-165d-4062-b2d1-bd9da1a0430e tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Image pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 06:05:56.637658 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-c3d48afc-165d-4062-b2d1-bd9da1a0430e tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 06:05:56.647135 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c3d48afc-165d-4062-b2d1-bd9da1a0430e tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:05:56.655816 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c3d48afc-165d-4062-b2d1-bd9da1a0430e tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:05:56.655816 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c3d48afc-165d-4062-b2d1-bd9da1a0430e tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:05:56.655816 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c3d48afc-165d-4062-b2d1-bd9da1a0430e tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:05:56.655816 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c3d48afc-165d-4062-b2d1-bd9da1a0430e tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:05:56.655816 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-c3d48afc-165d-4062-b2d1-bd9da1a0430e tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:05:56.669138 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-c3d48afc-165d-4062-b2d1-bd9da1a0430e tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Getting quotas for project be42ada0a7c7487baa2733e5af4a3a05. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 06:05:56.674655 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-c3d48afc-165d-4062-b2d1-bd9da1a0430e tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Getting quotas for user c8b0275002b74104979c605386448bdb and project be42ada0a7c7487baa2733e5af4a3a05. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 06:05:56.688069 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c3d48afc-165d-4062-b2d1-bd9da1a0430e tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Going to run 1 instances... {{(pid=122698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 06:05:56.690602 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-c3d48afc-165d-4062-b2d1-bd9da1a0430e tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] [instance: 42c52f0c-4e4c-418c-9584-388fd2dae3cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8dd79b9-f0b9-43a9-9605-17244137c0ee',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 06:05:56.808566 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-c3d48afc-165d-4062-b2d1-bd9da1a0430e tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.902626 Sep 23 06:05:56.809567 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3992/8171] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 06:05:55 2022] POST /compute/v2.1/servers => generated 406 bytes in 904 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 06:05:56.821145 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-dc54ec2c-eb6b-470b-8a51-a8bc3d74380f tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:05:56.822414 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-dc54ec2c-eb6b-470b-8a51-a8bc3d74380f tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] [instance: 42c52f0c-4e4c-418c-9584-388fd2dae3cc] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:05:56.944106 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-dc54ec2c-eb6b-470b-8a51-a8bc3d74380f tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b0275002b74104979c605386448bdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be42ada0a7c7487baa2733e5af4a3a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 06:05:56.957631 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-dc54ec2c-eb6b-470b-8a51-a8bc3d74380f tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] 10.222.0.33 "GET /compute/v2.1/servers/42c52f0c-4e4c-418c-9584-388fd2dae3cc" status: 200 len: 1248 microversion: 2.1 time: 0.140302 Sep 23 06:05:56.959583 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4180/8172] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:05:56 2022] GET /compute/v2.1/servers/42c52f0c-4e4c-418c-9584-388fd2dae3cc => generated 1248 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 06:05:57.983058 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-628ed739-0f65-433f-8ad8-346dc844c5c1 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:05:57.983692 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-628ed739-0f65-433f-8ad8-346dc844c5c1 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] [instance: 42c52f0c-4e4c-418c-9584-388fd2dae3cc] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:05:58.040169 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-628ed739-0f65-433f-8ad8-346dc844c5c1 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b0275002b74104979c605386448bdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be42ada0a7c7487baa2733e5af4a3a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 06:05:58.047138 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-628ed739-0f65-433f-8ad8-346dc844c5c1 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] 10.222.0.33 "GET /compute/v2.1/servers/42c52f0c-4e4c-418c-9584-388fd2dae3cc" status: 200 len: 1248 microversion: 2.1 time: 0.069084 Sep 23 06:05:58.049552 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3993/8173] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:05:57 2022] GET /compute/v2.1/servers/42c52f0c-4e4c-418c-9584-388fd2dae3cc => generated 1248 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 06:05:59.070359 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9e00510d-019e-4e27-a5b9-8dda3ed1bb00 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:05:59.070974 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-9e00510d-019e-4e27-a5b9-8dda3ed1bb00 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] [instance: 42c52f0c-4e4c-418c-9584-388fd2dae3cc] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:05:59.077459 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9e00510d-019e-4e27-a5b9-8dda3ed1bb00 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:05:59.081323 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9e00510d-019e-4e27-a5b9-8dda3ed1bb00 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:05:59.081323 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9e00510d-019e-4e27-a5b9-8dda3ed1bb00 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:05:59.081323 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9e00510d-019e-4e27-a5b9-8dda3ed1bb00 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:05:59.081323 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9e00510d-019e-4e27-a5b9-8dda3ed1bb00 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:05:59.081323 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-9e00510d-019e-4e27-a5b9-8dda3ed1bb00 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:05:59.145348 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-9e00510d-019e-4e27-a5b9-8dda3ed1bb00 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b0275002b74104979c605386448bdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be42ada0a7c7487baa2733e5af4a3a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 06:05:59.153817 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-9e00510d-019e-4e27-a5b9-8dda3ed1bb00 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] 10.222.0.33 "GET /compute/v2.1/servers/42c52f0c-4e4c-418c-9584-388fd2dae3cc" status: 200 len: 1300 microversion: 2.1 time: 0.087485 Sep 23 06:05:59.154507 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4181/8174] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:05:59 2022] GET /compute/v2.1/servers/42c52f0c-4e4c-418c-9584-388fd2dae3cc => generated 1300 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 06:06:00.180496 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-922008bb-ef95-4120-80fd-64a87e416247 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:06:00.181840 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-922008bb-ef95-4120-80fd-64a87e416247 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] [instance: 42c52f0c-4e4c-418c-9584-388fd2dae3cc] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:06:00.189606 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-922008bb-ef95-4120-80fd-64a87e416247 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:06:00.190283 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-922008bb-ef95-4120-80fd-64a87e416247 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:06:00.190846 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-922008bb-ef95-4120-80fd-64a87e416247 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:06:00.191695 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-922008bb-ef95-4120-80fd-64a87e416247 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:06:00.192346 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-922008bb-ef95-4120-80fd-64a87e416247 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:06:00.192796 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-922008bb-ef95-4120-80fd-64a87e416247 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:06:00.331197 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-922008bb-ef95-4120-80fd-64a87e416247 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b0275002b74104979c605386448bdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be42ada0a7c7487baa2733e5af4a3a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 06:06:00.339603 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-922008bb-ef95-4120-80fd-64a87e416247 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] 10.222.0.33 "GET /compute/v2.1/servers/42c52f0c-4e4c-418c-9584-388fd2dae3cc" status: 200 len: 1374 microversion: 2.1 time: 0.164946 Sep 23 06:06:00.340533 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3994/8175] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:06:00 2022] GET /compute/v2.1/servers/42c52f0c-4e4c-418c-9584-388fd2dae3cc => generated 1374 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 06:06:00.852039 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-be645a9e-70df-4bae-9b5d-983bf1afec70 req-e0923243-206a-4242-9af6-99a323db2dfd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42c52f0c-4e4c-418c-9584-388fd2dae3cc", "tag": "d1d18851-f17e-4561-926c-86fec04607dd"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 06:06:00.862411 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-be645a9e-70df-4bae-9b5d-983bf1afec70 req-e0923243-206a-4242-9af6-99a323db2dfd service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:06:00.862894 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-be645a9e-70df-4bae-9b5d-983bf1afec70 req-e0923243-206a-4242-9af6-99a323db2dfd service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:06:00.863324 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-be645a9e-70df-4bae-9b5d-983bf1afec70 req-e0923243-206a-4242-9af6-99a323db2dfd service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:06:00.875458 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-be645a9e-70df-4bae-9b5d-983bf1afec70 req-e0923243-206a-4242-9af6-99a323db2dfd service nova] Creating event network-changed:d1d18851-f17e-4561-926c-86fec04607dd for instance 42c52f0c-4e4c-418c-9584-388fd2dae3cc on n-h2-846463-3 Sep 23 06:06:00.881011 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-be645a9e-70df-4bae-9b5d-983bf1afec70 req-e0923243-206a-4242-9af6-99a323db2dfd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033284 Sep 23 06:06:00.881624 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4182/8176] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 06:06:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 06:06:01.363863 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b017d9df-8682-46a9-a192-d7ade38457da tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:06:01.364529 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b017d9df-8682-46a9-a192-d7ade38457da tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] [instance: 42c52f0c-4e4c-418c-9584-388fd2dae3cc] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:06:01.372062 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b017d9df-8682-46a9-a192-d7ade38457da tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:06:01.372572 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b017d9df-8682-46a9-a192-d7ade38457da tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:06:01.373025 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b017d9df-8682-46a9-a192-d7ade38457da tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:06:01.373743 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b017d9df-8682-46a9-a192-d7ade38457da tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:06:01.374241 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b017d9df-8682-46a9-a192-d7ade38457da tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:06:01.374687 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b017d9df-8682-46a9-a192-d7ade38457da tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:06:01.510525 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b017d9df-8682-46a9-a192-d7ade38457da tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b0275002b74104979c605386448bdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be42ada0a7c7487baa2733e5af4a3a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 06:06:01.518366 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b017d9df-8682-46a9-a192-d7ade38457da tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] 10.222.0.33 "GET /compute/v2.1/servers/42c52f0c-4e4c-418c-9584-388fd2dae3cc" status: 200 len: 1374 microversion: 2.1 time: 0.158752 Sep 23 06:06:01.518988 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3995/8177] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:06:01 2022] GET /compute/v2.1/servers/42c52f0c-4e4c-418c-9584-388fd2dae3cc => generated 1374 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 06:06:02.543316 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-8a22df9c-2bb4-4a8e-a11d-27746bcb3adc tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:06:02.544021 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-8a22df9c-2bb4-4a8e-a11d-27746bcb3adc tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] [instance: 42c52f0c-4e4c-418c-9584-388fd2dae3cc] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:06:02.550212 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8a22df9c-2bb4-4a8e-a11d-27746bcb3adc tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:06:02.550706 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8a22df9c-2bb4-4a8e-a11d-27746bcb3adc tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:06:02.551146 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8a22df9c-2bb4-4a8e-a11d-27746bcb3adc tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:06:02.551840 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8a22df9c-2bb4-4a8e-a11d-27746bcb3adc tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:06:02.552301 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8a22df9c-2bb4-4a8e-a11d-27746bcb3adc tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:06:02.552733 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-8a22df9c-2bb4-4a8e-a11d-27746bcb3adc tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:06:02.685820 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-8a22df9c-2bb4-4a8e-a11d-27746bcb3adc tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b0275002b74104979c605386448bdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be42ada0a7c7487baa2733e5af4a3a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 06:06:02.694230 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-8a22df9c-2bb4-4a8e-a11d-27746bcb3adc tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] 10.222.0.33 "GET /compute/v2.1/servers/42c52f0c-4e4c-418c-9584-388fd2dae3cc" status: 200 len: 1374 microversion: 2.1 time: 0.156154 Sep 23 06:06:02.694802 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4183/8178] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:06:02 2022] GET /compute/v2.1/servers/42c52f0c-4e4c-418c-9584-388fd2dae3cc => generated 1374 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 06:06:03.717335 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-85d4929d-3033-41e0-8a06-96b91cfd69c4 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:06:03.717986 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-85d4929d-3033-41e0-8a06-96b91cfd69c4 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] [instance: 42c52f0c-4e4c-418c-9584-388fd2dae3cc] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:06:03.724172 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-85d4929d-3033-41e0-8a06-96b91cfd69c4 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:06:03.724677 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-85d4929d-3033-41e0-8a06-96b91cfd69c4 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:06:03.725127 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-85d4929d-3033-41e0-8a06-96b91cfd69c4 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:06:03.725917 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-85d4929d-3033-41e0-8a06-96b91cfd69c4 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:06:03.726400 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-85d4929d-3033-41e0-8a06-96b91cfd69c4 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:06:03.726842 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-85d4929d-3033-41e0-8a06-96b91cfd69c4 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:06:03.865474 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-85d4929d-3033-41e0-8a06-96b91cfd69c4 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b0275002b74104979c605386448bdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be42ada0a7c7487baa2733e5af4a3a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 06:06:03.873713 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-85d4929d-3033-41e0-8a06-96b91cfd69c4 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] 10.222.0.33 "GET /compute/v2.1/servers/42c52f0c-4e4c-418c-9584-388fd2dae3cc" status: 200 len: 1374 microversion: 2.1 time: 0.160485 Sep 23 06:06:03.874322 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3996/8179] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:06:03 2022] GET /compute/v2.1/servers/42c52f0c-4e4c-418c-9584-388fd2dae3cc => generated 1374 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 06:06:04.896795 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4f9dc313-6862-419c-83e1-8f323b949a2b tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:06:04.897538 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4f9dc313-6862-419c-83e1-8f323b949a2b tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] [instance: 42c52f0c-4e4c-418c-9584-388fd2dae3cc] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:06:04.904076 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4f9dc313-6862-419c-83e1-8f323b949a2b tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:06:04.904575 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4f9dc313-6862-419c-83e1-8f323b949a2b tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:06:04.905048 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4f9dc313-6862-419c-83e1-8f323b949a2b tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:06:04.905747 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4f9dc313-6862-419c-83e1-8f323b949a2b tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:06:04.906243 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4f9dc313-6862-419c-83e1-8f323b949a2b tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:06:04.906675 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4f9dc313-6862-419c-83e1-8f323b949a2b tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:06:05.036746 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-4f9dc313-6862-419c-83e1-8f323b949a2b tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b0275002b74104979c605386448bdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be42ada0a7c7487baa2733e5af4a3a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 06:06:05.045325 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4f9dc313-6862-419c-83e1-8f323b949a2b tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] 10.222.0.33 "GET /compute/v2.1/servers/42c52f0c-4e4c-418c-9584-388fd2dae3cc" status: 200 len: 1374 microversion: 2.1 time: 0.152470 Sep 23 06:06:05.045922 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4184/8180] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:06:04 2022] GET /compute/v2.1/servers/42c52f0c-4e4c-418c-9584-388fd2dae3cc => generated 1374 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 06:06:06.069185 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-7dfb48b5-4ac7-4854-9490-c3d1bd319e83 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:06:06.070338 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-7dfb48b5-4ac7-4854-9490-c3d1bd319e83 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] [instance: 42c52f0c-4e4c-418c-9584-388fd2dae3cc] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:06:06.077153 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7dfb48b5-4ac7-4854-9490-c3d1bd319e83 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:06:06.077658 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7dfb48b5-4ac7-4854-9490-c3d1bd319e83 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:06:06.078159 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7dfb48b5-4ac7-4854-9490-c3d1bd319e83 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:06:06.078850 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7dfb48b5-4ac7-4854-9490-c3d1bd319e83 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:06:06.079318 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7dfb48b5-4ac7-4854-9490-c3d1bd319e83 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:06:06.079758 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-7dfb48b5-4ac7-4854-9490-c3d1bd319e83 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:06:06.212960 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-7dfb48b5-4ac7-4854-9490-c3d1bd319e83 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b0275002b74104979c605386448bdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be42ada0a7c7487baa2733e5af4a3a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 06:06:06.220777 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-7dfb48b5-4ac7-4854-9490-c3d1bd319e83 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] 10.222.0.33 "GET /compute/v2.1/servers/42c52f0c-4e4c-418c-9584-388fd2dae3cc" status: 200 len: 1374 microversion: 2.1 time: 0.155622 Sep 23 06:06:06.221351 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3997/8181] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:06:06 2022] GET /compute/v2.1/servers/42c52f0c-4e4c-418c-9584-388fd2dae3cc => generated 1374 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 06:06:07.024821 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-16d1e6f6-1f07-4bc5-a3dc-e55d569e76ed req-55e9ac49-52ba-42e1-8bbd-4f5fe70c5ab3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42c52f0c-4e4c-418c-9584-388fd2dae3cc", "name": "network-vif-plugged", "status": "completed", "tag": "d1d18851-f17e-4561-926c-86fec04607dd"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 06:06:07.030560 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=6 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 06:06:07.036088 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-16d1e6f6-1f07-4bc5-a3dc-e55d569e76ed req-55e9ac49-52ba-42e1-8bbd-4f5fe70c5ab3 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:06:07.036572 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-16d1e6f6-1f07-4bc5-a3dc-e55d569e76ed req-55e9ac49-52ba-42e1-8bbd-4f5fe70c5ab3 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:06:07.037009 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-16d1e6f6-1f07-4bc5-a3dc-e55d569e76ed req-55e9ac49-52ba-42e1-8bbd-4f5fe70c5ab3 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:06:07.048968 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-16d1e6f6-1f07-4bc5-a3dc-e55d569e76ed req-55e9ac49-52ba-42e1-8bbd-4f5fe70c5ab3 service nova] Creating event network-vif-plugged:d1d18851-f17e-4561-926c-86fec04607dd for instance 42c52f0c-4e4c-418c-9584-388fd2dae3cc on n-h2-846463-3 Sep 23 06:06:07.054153 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-16d1e6f6-1f07-4bc5-a3dc-e55d569e76ed req-55e9ac49-52ba-42e1-8bbd-4f5fe70c5ab3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034165 Sep 23 06:06:07.054755 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4185/8182] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 06:06:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 06:06:07.243689 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ac48a270-1528-4ae9-a7e1-45cf4bc0285a tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:06:07.244343 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-ac48a270-1528-4ae9-a7e1-45cf4bc0285a tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] [instance: 42c52f0c-4e4c-418c-9584-388fd2dae3cc] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:06:07.246235 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 06:06:07.252035 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ac48a270-1528-4ae9-a7e1-45cf4bc0285a tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:06:07.252540 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ac48a270-1528-4ae9-a7e1-45cf4bc0285a tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:06:07.252995 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ac48a270-1528-4ae9-a7e1-45cf4bc0285a tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:06:07.253701 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ac48a270-1528-4ae9-a7e1-45cf4bc0285a tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:06:07.254218 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ac48a270-1528-4ae9-a7e1-45cf4bc0285a tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:06:07.254660 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ac48a270-1528-4ae9-a7e1-45cf4bc0285a tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:06:07.695681 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ac48a270-1528-4ae9-a7e1-45cf4bc0285a tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b0275002b74104979c605386448bdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be42ada0a7c7487baa2733e5af4a3a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 06:06:07.703539 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ac48a270-1528-4ae9-a7e1-45cf4bc0285a tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] 10.222.0.33 "GET /compute/v2.1/servers/42c52f0c-4e4c-418c-9584-388fd2dae3cc" status: 200 len: 1374 microversion: 2.1 time: 0.463808 Sep 23 06:06:07.704156 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3998/8183] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:06:07 2022] GET /compute/v2.1/servers/42c52f0c-4e4c-418c-9584-388fd2dae3cc => generated 1374 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 06:06:08.729064 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4c5827d3-4e19-4c8d-82b8-f2e39918f892 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:06:08.729776 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4c5827d3-4e19-4c8d-82b8-f2e39918f892 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] [instance: 42c52f0c-4e4c-418c-9584-388fd2dae3cc] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:06:08.736214 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4c5827d3-4e19-4c8d-82b8-f2e39918f892 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:06:08.736709 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4c5827d3-4e19-4c8d-82b8-f2e39918f892 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:06:08.737158 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4c5827d3-4e19-4c8d-82b8-f2e39918f892 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:06:08.737859 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4c5827d3-4e19-4c8d-82b8-f2e39918f892 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:06:08.738351 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4c5827d3-4e19-4c8d-82b8-f2e39918f892 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:06:08.738785 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4c5827d3-4e19-4c8d-82b8-f2e39918f892 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:06:08.869441 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-4c5827d3-4e19-4c8d-82b8-f2e39918f892 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b0275002b74104979c605386448bdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be42ada0a7c7487baa2733e5af4a3a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 06:06:08.877188 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4c5827d3-4e19-4c8d-82b8-f2e39918f892 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] 10.222.0.33 "GET /compute/v2.1/servers/42c52f0c-4e4c-418c-9584-388fd2dae3cc" status: 200 len: 1559 microversion: 2.1 time: 0.153812 Sep 23 06:06:08.877760 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4186/8184] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:06:08 2022] GET /compute/v2.1/servers/42c52f0c-4e4c-418c-9584-388fd2dae3cc => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 06:06:08.899553 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-dd47ae08-5b71-4cb4-81fe-a35f1678080b tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:06:08.900178 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-dd47ae08-5b71-4cb4-81fe-a35f1678080b tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] [instance: 42c52f0c-4e4c-418c-9584-388fd2dae3cc] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:06:08.902057 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=8 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 06:06:08.907708 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dd47ae08-5b71-4cb4-81fe-a35f1678080b tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:06:08.908211 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dd47ae08-5b71-4cb4-81fe-a35f1678080b tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:06:08.908666 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dd47ae08-5b71-4cb4-81fe-a35f1678080b tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:06:08.909377 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dd47ae08-5b71-4cb4-81fe-a35f1678080b tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:06:08.909848 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dd47ae08-5b71-4cb4-81fe-a35f1678080b tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:06:08.910316 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dd47ae08-5b71-4cb4-81fe-a35f1678080b tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:06:09.042443 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-dd47ae08-5b71-4cb4-81fe-a35f1678080b tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b0275002b74104979c605386448bdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be42ada0a7c7487baa2733e5af4a3a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 06:06:09.050282 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-dd47ae08-5b71-4cb4-81fe-a35f1678080b tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] 10.222.0.33 "GET /compute/v2.1/servers/42c52f0c-4e4c-418c-9584-388fd2dae3cc" status: 200 len: 1559 microversion: 2.1 time: 0.154848 Sep 23 06:06:09.050853 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 3999/8185] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:06:08 2022] GET /compute/v2.1/servers/42c52f0c-4e4c-418c-9584-388fd2dae3cc => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 06:06:11.054536 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-1575b828-bee5-401c-a239-9ea46c88cad0 req-f3d6f43a-b829-4c59-bd3e-ff5f7f04d6ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42c52f0c-4e4c-418c-9584-388fd2dae3cc", "tag": "d1d18851-f17e-4561-926c-86fec04607dd"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 06:06:11.064051 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-1575b828-bee5-401c-a239-9ea46c88cad0 req-f3d6f43a-b829-4c59-bd3e-ff5f7f04d6ad service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:06:11.064536 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-1575b828-bee5-401c-a239-9ea46c88cad0 req-f3d6f43a-b829-4c59-bd3e-ff5f7f04d6ad service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:06:11.064971 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-1575b828-bee5-401c-a239-9ea46c88cad0 req-f3d6f43a-b829-4c59-bd3e-ff5f7f04d6ad service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:06:11.076147 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-1575b828-bee5-401c-a239-9ea46c88cad0 req-f3d6f43a-b829-4c59-bd3e-ff5f7f04d6ad service nova] Creating event network-changed:d1d18851-f17e-4561-926c-86fec04607dd for instance 42c52f0c-4e4c-418c-9584-388fd2dae3cc on n-h2-846463-3 Sep 23 06:06:11.081395 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-1575b828-bee5-401c-a239-9ea46c88cad0 req-f3d6f43a-b829-4c59-bd3e-ff5f7f04d6ad service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085862 Sep 23 06:06:11.082312 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4187/8186] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 06:06:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 06:08:06.141574 n-d-846463-3 devstack@n-api.service[122698]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2416b61d-0aee-4a62-9508-aa1fc06b9213] AMQP server on 10.222.0.33:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 23 06:08:06.142543 n-d-846463-3 devstack@n-api.service[122698]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f191bc7a-c250-407c-bbf3-646bef550c22] AMQP server on 10.222.0.33:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 23 06:08:06.143085 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 06:08:06.143961 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=38 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 06:08:06.144884 n-d-846463-3 devstack@n-api.service[122698]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 23 06:08:06.145053 n-d-846463-3 devstack@n-api.service[122698]: Fri Sep 23 06:08:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/42c52f0c-4e4c-418c-9584-388fd2dae3cc/action (ip 10.222.0.33) !!! Sep 23 06:08:06.146208 n-d-846463-3 devstack@n-api.service[122698]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 23 06:08:06.146338 n-d-846463-3 devstack@n-api.service[122698]: Fri Sep 23 06:08:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/42c52f0c-4e4c-418c-9584-388fd2dae3cc/action (ip 10.222.0.33) !!! Sep 23 06:08:06.147842 n-d-846463-3 devstack@n-api.service[122698]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 23 06:08:06.148005 n-d-846463-3 devstack@n-api.service[122698]: Fri Sep 23 06:08:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/42c52f0c-4e4c-418c-9584-388fd2dae3cc/action (ip 10.222.0.33) !!! Sep 23 06:08:06.152717 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-173c602b-d5b5-4600-bf97-150dc668aae8 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-727724899"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 06:08:06.156852 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-173c602b-d5b5-4600-bf97-150dc668aae8 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] [instance: 42c52f0c-4e4c-418c-9584-388fd2dae3cc] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:08:06.168561 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-173c602b-d5b5-4600-bf97-150dc668aae8 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:08:06.169075 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-173c602b-d5b5-4600-bf97-150dc668aae8 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:08:06.169541 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-173c602b-d5b5-4600-bf97-150dc668aae8 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:08:06.170295 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-173c602b-d5b5-4600-bf97-150dc668aae8 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:08:06.170776 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-173c602b-d5b5-4600-bf97-150dc668aae8 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:08:06.171226 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-173c602b-d5b5-4600-bf97-150dc668aae8 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:08:06.541645 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-173c602b-d5b5-4600-bf97-150dc668aae8 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] 10.222.0.33 "POST /compute/v2.1/servers/42c52f0c-4e4c-418c-9584-388fd2dae3cc/action" status: 202 len: 0 microversion: 2.1 time: 0.401811 Sep 23 06:08:06.542253 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 4000/8187] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 06:08:06 2022] POST /compute/v2.1/servers/42c52f0c-4e4c-418c-9584-388fd2dae3cc/action => generated 0 bytes in 403 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 23 06:08:11.463801 n-d-846463-3 devstack@n-api.service[122699]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c6c7f4e7-3ce9-40e8-ba39-9d563bbcd13f] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 23 06:08:11.465946 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 06:08:11.466869 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=30 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 06:08:11.469340 n-d-846463-3 devstack@n-api.service[122699]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 06:08:11.470174 n-d-846463-3 devstack@n-api.service[122699]: Fri Sep 23 06:08:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.33) !!! Sep 23 06:08:11.475113 n-d-846463-3 devstack@n-api.service[122699]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 23 06:08:11.477440 n-d-846463-3 devstack@n-api.service[122699]: Fri Sep 23 06:08:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.33) !!! Sep 23 06:08:11.493140 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-fe497e1d-718d-4ba3-9031-b035b751e7a1 req-7e702dcc-896c-498d-80f7-dfc0d9186ac0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42c52f0c-4e4c-418c-9584-388fd2dae3cc", "name": "network-vif-plugged", "status": "completed", "tag": "d1d18851-f17e-4561-926c-86fec04607dd"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 06:08:11.523215 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-fe497e1d-718d-4ba3-9031-b035b751e7a1 req-7e702dcc-896c-498d-80f7-dfc0d9186ac0 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:08:11.523998 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-fe497e1d-718d-4ba3-9031-b035b751e7a1 req-7e702dcc-896c-498d-80f7-dfc0d9186ac0 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:08:11.524822 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-fe497e1d-718d-4ba3-9031-b035b751e7a1 req-7e702dcc-896c-498d-80f7-dfc0d9186ac0 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:08:11.538162 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-fe497e1d-718d-4ba3-9031-b035b751e7a1 req-7e702dcc-896c-498d-80f7-dfc0d9186ac0 service nova] Creating event network-vif-plugged:d1d18851-f17e-4561-926c-86fec04607dd for instance 42c52f0c-4e4c-418c-9584-388fd2dae3cc on n-h2-846463-3 Sep 23 06:08:11.548359 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-fe497e1d-718d-4ba3-9031-b035b751e7a1 req-7e702dcc-896c-498d-80f7-dfc0d9186ac0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086178 Sep 23 06:08:11.552383 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4188/8188] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 06:08:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 06:08:22.282196 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 06:08:22.283049 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 06:08:22.287126 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-f9eec324-75ab-480d-b343-d752a53a2322 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-945547520", "imageRef": "98dfdb94-9871-46a0-a54a-7adfafa8087c", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-670755896", "security_groups": [{"name": "tempest-secgroup-smoke-2098595354"}], "networks": [{"uuid": "c4408167-004c-4356-9659-b9f7f03632f1"}]}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 06:08:22.310228 n-d-846463-3 devstack@n-api.service[122698]: INFO oslo.messaging._drivers.impl_rabbit [-] [2416b61d-0aee-4a62-9508-aa1fc06b9213] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 57380. Sep 23 06:08:22.310930 n-d-846463-3 devstack@n-api.service[122698]: INFO oslo.messaging._drivers.impl_rabbit [-] [f191bc7a-c250-407c-bbf3-646bef550c22] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 57382. Sep 23 06:08:22.404607 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.network.neutron [None req-f9eec324-75ab-480d-b343-d752a53a2322 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] validate_networks() for [('c4408167-004c-4356-9659-b9f7f03632f1', None, None, None, None, None)] {{(pid=122698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 06:08:22.777321 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-f9eec324-75ab-480d-b343-d752a53a2322 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Flavor limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 06:08:22.777777 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-f9eec324-75ab-480d-b343-d752a53a2322 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Image limits 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 06:08:22.778336 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-f9eec324-75ab-480d-b343-d752a53a2322 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Flavor pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 06:08:22.778804 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-f9eec324-75ab-480d-b343-d752a53a2322 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Image pref 0:0:0 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 06:08:22.779243 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.virt.hardware [None req-f9eec324-75ab-480d-b343-d752a53a2322 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 06:08:22.788187 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f9eec324-75ab-480d-b343-d752a53a2322 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:08:22.796316 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f9eec324-75ab-480d-b343-d752a53a2322 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:08:22.796316 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f9eec324-75ab-480d-b343-d752a53a2322 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:08:22.796316 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f9eec324-75ab-480d-b343-d752a53a2322 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:08:22.796316 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f9eec324-75ab-480d-b343-d752a53a2322 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:08:22.796316 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-f9eec324-75ab-480d-b343-d752a53a2322 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:08:22.809251 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-f9eec324-75ab-480d-b343-d752a53a2322 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Getting quotas for project be42ada0a7c7487baa2733e5af4a3a05. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 06:08:22.814612 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.quota [None req-f9eec324-75ab-480d-b343-d752a53a2322 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Getting quotas for user c8b0275002b74104979c605386448bdb and project be42ada0a7c7487baa2733e5af4a3a05. Resources: {'cores', 'ram', 'instances'} {{(pid=122698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 06:08:22.826890 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f9eec324-75ab-480d-b343-d752a53a2322 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Going to run 1 instances... {{(pid=122698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 06:08:22.829390 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-f9eec324-75ab-480d-b343-d752a53a2322 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] [instance: e4a70a0a-337b-445c-9367-c19ef7fd049e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='98dfdb94-9871-46a0-a54a-7adfafa8087c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 06:08:22.971290 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-f9eec324-75ab-480d-b343-d752a53a2322 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.691283 Sep 23 06:08:22.971962 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 4001/8189] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Sep 23 06:08:22 2022] POST /compute/v2.1/servers => generated 406 bytes in 693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 06:08:22.985053 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6355e294-8713-4fbf-afeb-38ca8d57868b tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:08:22.985760 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-6355e294-8713-4fbf-afeb-38ca8d57868b tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] [instance: e4a70a0a-337b-445c-9367-c19ef7fd049e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:08:22.999088 n-d-846463-3 devstack@n-api.service[122699]: INFO oslo.messaging._drivers.impl_rabbit [-] [c6c7f4e7-3ce9-40e8-ba39-9d563bbcd13f] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 57396. Sep 23 06:08:23.044317 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-6355e294-8713-4fbf-afeb-38ca8d57868b tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b0275002b74104979c605386448bdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be42ada0a7c7487baa2733e5af4a3a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 06:08:23.051409 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6355e294-8713-4fbf-afeb-38ca8d57868b tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] 10.222.0.33 "GET /compute/v2.1/servers/e4a70a0a-337b-445c-9367-c19ef7fd049e" status: 200 len: 1247 microversion: 2.1 time: 0.071517 Sep 23 06:08:23.051989 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4189/8190] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:08:22 2022] GET /compute/v2.1/servers/e4a70a0a-337b-445c-9367-c19ef7fd049e => generated 1247 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 06:08:24.075653 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-942bf1c5-14d5-4920-ba2f-5a000625a9fb tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:08:24.076278 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-942bf1c5-14d5-4920-ba2f-5a000625a9fb tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] [instance: e4a70a0a-337b-445c-9367-c19ef7fd049e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:08:24.136673 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-942bf1c5-14d5-4920-ba2f-5a000625a9fb tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b0275002b74104979c605386448bdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be42ada0a7c7487baa2733e5af4a3a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 06:08:24.143977 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-942bf1c5-14d5-4920-ba2f-5a000625a9fb tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] 10.222.0.33 "GET /compute/v2.1/servers/e4a70a0a-337b-445c-9367-c19ef7fd049e" status: 200 len: 1247 microversion: 2.1 time: 0.073029 Sep 23 06:08:24.144563 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 4002/8191] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:08:24 2022] GET /compute/v2.1/servers/e4a70a0a-337b-445c-9367-c19ef7fd049e => generated 1247 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 06:08:25.167679 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-bd5dd588-c7f0-4f2a-9823-b0256ce1b530 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:08:25.168303 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-bd5dd588-c7f0-4f2a-9823-b0256ce1b530 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] [instance: e4a70a0a-337b-445c-9367-c19ef7fd049e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:08:25.223480 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-bd5dd588-c7f0-4f2a-9823-b0256ce1b530 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b0275002b74104979c605386448bdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be42ada0a7c7487baa2733e5af4a3a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 06:08:25.230726 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-bd5dd588-c7f0-4f2a-9823-b0256ce1b530 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] 10.222.0.33 "GET /compute/v2.1/servers/e4a70a0a-337b-445c-9367-c19ef7fd049e" status: 200 len: 1247 microversion: 2.1 time: 0.067250 Sep 23 06:08:25.231374 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4190/8192] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:08:25 2022] GET /compute/v2.1/servers/e4a70a0a-337b-445c-9367-c19ef7fd049e => generated 1247 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 06:08:25.482262 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-f9f11879-7253-4788-adbf-42be04164e1f req-40df5bbd-66f8-4ca7-8dca-37c9463a2aad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42c52f0c-4e4c-418c-9584-388fd2dae3cc", "name": "network-vif-unplugged", "status": "completed", "tag": "d1d18851-f17e-4561-926c-86fec04607dd"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 06:08:25.493058 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-f9f11879-7253-4788-adbf-42be04164e1f req-40df5bbd-66f8-4ca7-8dca-37c9463a2aad service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:08:25.493562 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-f9f11879-7253-4788-adbf-42be04164e1f req-40df5bbd-66f8-4ca7-8dca-37c9463a2aad service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:08:25.494086 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-f9f11879-7253-4788-adbf-42be04164e1f req-40df5bbd-66f8-4ca7-8dca-37c9463a2aad service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:08:25.505108 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-f9f11879-7253-4788-adbf-42be04164e1f req-40df5bbd-66f8-4ca7-8dca-37c9463a2aad service nova] Creating event network-vif-unplugged:d1d18851-f17e-4561-926c-86fec04607dd for instance 42c52f0c-4e4c-418c-9584-388fd2dae3cc on n-h2-846463-3 Sep 23 06:08:25.511150 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-f9f11879-7253-4788-adbf-42be04164e1f req-40df5bbd-66f8-4ca7-8dca-37c9463a2aad service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.093049 Sep 23 06:08:25.511758 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 4003/8193] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 06:08:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 06:08:26.252805 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-9e34cf74-cb92-478a-8985-33f632b6d08e tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:08:26.253429 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-9e34cf74-cb92-478a-8985-33f632b6d08e tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] [instance: e4a70a0a-337b-445c-9367-c19ef7fd049e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:08:26.306153 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-9e34cf74-cb92-478a-8985-33f632b6d08e tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b0275002b74104979c605386448bdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be42ada0a7c7487baa2733e5af4a3a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 06:08:26.312862 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-9e34cf74-cb92-478a-8985-33f632b6d08e tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] 10.222.0.33 "GET /compute/v2.1/servers/e4a70a0a-337b-445c-9367-c19ef7fd049e" status: 200 len: 1247 microversion: 2.1 time: 0.063977 Sep 23 06:08:26.313440 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4191/8194] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:08:26 2022] GET /compute/v2.1/servers/e4a70a0a-337b-445c-9367-c19ef7fd049e => generated 1247 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 06:08:27.338762 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-8638b7a8-b678-4599-a927-c4450fe9153c tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:08:27.339485 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-8638b7a8-b678-4599-a927-c4450fe9153c tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] [instance: e4a70a0a-337b-445c-9367-c19ef7fd049e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:08:27.345838 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8638b7a8-b678-4599-a927-c4450fe9153c tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:08:27.346379 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8638b7a8-b678-4599-a927-c4450fe9153c tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:08:27.346839 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8638b7a8-b678-4599-a927-c4450fe9153c tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:08:27.347554 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8638b7a8-b678-4599-a927-c4450fe9153c tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:08:27.348031 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8638b7a8-b678-4599-a927-c4450fe9153c tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:08:27.348476 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-8638b7a8-b678-4599-a927-c4450fe9153c tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:08:27.412731 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-8638b7a8-b678-4599-a927-c4450fe9153c tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b0275002b74104979c605386448bdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be42ada0a7c7487baa2733e5af4a3a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 06:08:27.421133 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-8638b7a8-b678-4599-a927-c4450fe9153c tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] 10.222.0.33 "GET /compute/v2.1/servers/e4a70a0a-337b-445c-9367-c19ef7fd049e" status: 200 len: 1243 microversion: 2.1 time: 0.088244 Sep 23 06:08:27.421728 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 4004/8195] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:08:27 2022] GET /compute/v2.1/servers/e4a70a0a-337b-445c-9367-c19ef7fd049e => generated 1243 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 06:08:28.446264 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-86a2068b-69cb-4dfa-aa1e-50cc09fc843e tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:08:28.446264 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-86a2068b-69cb-4dfa-aa1e-50cc09fc843e tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] [instance: e4a70a0a-337b-445c-9367-c19ef7fd049e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:08:28.456305 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-86a2068b-69cb-4dfa-aa1e-50cc09fc843e tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:08:28.456889 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-86a2068b-69cb-4dfa-aa1e-50cc09fc843e tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:08:28.457342 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-86a2068b-69cb-4dfa-aa1e-50cc09fc843e tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:08:28.458091 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-86a2068b-69cb-4dfa-aa1e-50cc09fc843e tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:08:28.458565 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-86a2068b-69cb-4dfa-aa1e-50cc09fc843e tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:08:28.459005 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-86a2068b-69cb-4dfa-aa1e-50cc09fc843e tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:08:28.529577 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-86a2068b-69cb-4dfa-aa1e-50cc09fc843e tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b0275002b74104979c605386448bdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be42ada0a7c7487baa2733e5af4a3a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 06:08:28.538255 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-86a2068b-69cb-4dfa-aa1e-50cc09fc843e tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] 10.222.0.33 "GET /compute/v2.1/servers/e4a70a0a-337b-445c-9367-c19ef7fd049e" status: 200 len: 1305 microversion: 2.1 time: 0.097625 Sep 23 06:08:28.539552 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4192/8196] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:08:28 2022] GET /compute/v2.1/servers/e4a70a0a-337b-445c-9367-c19ef7fd049e => generated 1305 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 06:08:29.562183 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-fc448be6-c4af-4e40-855a-1df40f5ee45d tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:08:29.564068 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-fc448be6-c4af-4e40-855a-1df40f5ee45d tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] [instance: e4a70a0a-337b-445c-9367-c19ef7fd049e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:08:29.571877 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fc448be6-c4af-4e40-855a-1df40f5ee45d tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:08:29.572474 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fc448be6-c4af-4e40-855a-1df40f5ee45d tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:08:29.573008 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fc448be6-c4af-4e40-855a-1df40f5ee45d tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:08:29.573818 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fc448be6-c4af-4e40-855a-1df40f5ee45d tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:08:29.574407 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fc448be6-c4af-4e40-855a-1df40f5ee45d tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:08:29.574930 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-fc448be6-c4af-4e40-855a-1df40f5ee45d tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:08:29.718511 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-fc448be6-c4af-4e40-855a-1df40f5ee45d tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b0275002b74104979c605386448bdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be42ada0a7c7487baa2733e5af4a3a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 06:08:29.726928 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-fc448be6-c4af-4e40-855a-1df40f5ee45d tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] 10.222.0.33 "GET /compute/v2.1/servers/e4a70a0a-337b-445c-9367-c19ef7fd049e" status: 200 len: 1373 microversion: 2.1 time: 0.168698 Sep 23 06:08:29.728795 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 4005/8197] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:08:29 2022] GET /compute/v2.1/servers/e4a70a0a-337b-445c-9367-c19ef7fd049e => generated 1373 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 06:08:30.754166 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c0ae40b7-ee91-4f46-abde-6f9c854e434a tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:08:30.755244 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c0ae40b7-ee91-4f46-abde-6f9c854e434a tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] [instance: e4a70a0a-337b-445c-9367-c19ef7fd049e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:08:30.764924 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c0ae40b7-ee91-4f46-abde-6f9c854e434a tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:08:30.765960 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c0ae40b7-ee91-4f46-abde-6f9c854e434a tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:08:30.766898 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c0ae40b7-ee91-4f46-abde-6f9c854e434a tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:08:30.768245 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c0ae40b7-ee91-4f46-abde-6f9c854e434a tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:08:30.769612 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c0ae40b7-ee91-4f46-abde-6f9c854e434a tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:08:30.770427 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c0ae40b7-ee91-4f46-abde-6f9c854e434a tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:08:30.921393 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c0ae40b7-ee91-4f46-abde-6f9c854e434a tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b0275002b74104979c605386448bdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be42ada0a7c7487baa2733e5af4a3a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 06:08:30.930554 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c0ae40b7-ee91-4f46-abde-6f9c854e434a tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] 10.222.0.33 "GET /compute/v2.1/servers/e4a70a0a-337b-445c-9367-c19ef7fd049e" status: 200 len: 1373 microversion: 2.1 time: 0.183986 Sep 23 06:08:30.931331 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4193/8198] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:08:30 2022] GET /compute/v2.1/servers/e4a70a0a-337b-445c-9367-c19ef7fd049e => generated 1373 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 06:08:31.953740 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-b3784214-3f3b-449c-90b5-26129cc0a2ed tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:08:31.954452 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-b3784214-3f3b-449c-90b5-26129cc0a2ed tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] [instance: e4a70a0a-337b-445c-9367-c19ef7fd049e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:08:31.962736 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b3784214-3f3b-449c-90b5-26129cc0a2ed tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:08:31.963546 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b3784214-3f3b-449c-90b5-26129cc0a2ed tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:08:31.964294 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b3784214-3f3b-449c-90b5-26129cc0a2ed tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:08:31.965304 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b3784214-3f3b-449c-90b5-26129cc0a2ed tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:08:31.966058 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b3784214-3f3b-449c-90b5-26129cc0a2ed tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:08:31.966740 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-b3784214-3f3b-449c-90b5-26129cc0a2ed tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:08:32.111063 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-b3784214-3f3b-449c-90b5-26129cc0a2ed tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b0275002b74104979c605386448bdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be42ada0a7c7487baa2733e5af4a3a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 06:08:32.119760 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-b3784214-3f3b-449c-90b5-26129cc0a2ed tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] 10.222.0.33 "GET /compute/v2.1/servers/e4a70a0a-337b-445c-9367-c19ef7fd049e" status: 200 len: 1373 microversion: 2.1 time: 0.169917 Sep 23 06:08:32.130796 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 4006/8199] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:08:31 2022] GET /compute/v2.1/servers/e4a70a0a-337b-445c-9367-c19ef7fd049e => generated 1373 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 06:08:33.145929 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-1b15e5fd-9485-45c5-a1f9-59ecda29d9f5 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:08:33.145929 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-1b15e5fd-9485-45c5-a1f9-59ecda29d9f5 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] [instance: e4a70a0a-337b-445c-9367-c19ef7fd049e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:08:33.153835 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1b15e5fd-9485-45c5-a1f9-59ecda29d9f5 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:08:33.154506 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1b15e5fd-9485-45c5-a1f9-59ecda29d9f5 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:08:33.155024 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1b15e5fd-9485-45c5-a1f9-59ecda29d9f5 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:08:33.155841 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1b15e5fd-9485-45c5-a1f9-59ecda29d9f5 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:08:33.156384 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1b15e5fd-9485-45c5-a1f9-59ecda29d9f5 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:08:33.156892 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-1b15e5fd-9485-45c5-a1f9-59ecda29d9f5 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:08:33.304777 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-1b15e5fd-9485-45c5-a1f9-59ecda29d9f5 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b0275002b74104979c605386448bdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be42ada0a7c7487baa2733e5af4a3a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 06:08:33.313454 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-1b15e5fd-9485-45c5-a1f9-59ecda29d9f5 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] 10.222.0.33 "GET /compute/v2.1/servers/e4a70a0a-337b-445c-9367-c19ef7fd049e" status: 200 len: 1373 microversion: 2.1 time: 0.172672 Sep 23 06:08:33.314288 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4194/8200] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:08:33 2022] GET /compute/v2.1/servers/e4a70a0a-337b-445c-9367-c19ef7fd049e => generated 1373 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 06:08:34.345904 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9ce53f60-0883-4ba8-984c-c31eb6c741c0 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:08:34.347069 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-9ce53f60-0883-4ba8-984c-c31eb6c741c0 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] [instance: e4a70a0a-337b-445c-9367-c19ef7fd049e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:08:34.349357 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 06:08:34.351539 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell0:SELECT=8 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 06:08:34.359789 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9ce53f60-0883-4ba8-984c-c31eb6c741c0 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:08:34.359789 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9ce53f60-0883-4ba8-984c-c31eb6c741c0 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:08:34.359789 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9ce53f60-0883-4ba8-984c-c31eb6c741c0 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:08:34.359789 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9ce53f60-0883-4ba8-984c-c31eb6c741c0 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:08:34.360392 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9ce53f60-0883-4ba8-984c-c31eb6c741c0 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:08:34.360807 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9ce53f60-0883-4ba8-984c-c31eb6c741c0 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:08:34.526447 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-9ce53f60-0883-4ba8-984c-c31eb6c741c0 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b0275002b74104979c605386448bdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be42ada0a7c7487baa2733e5af4a3a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 06:08:34.540311 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9ce53f60-0883-4ba8-984c-c31eb6c741c0 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] 10.222.0.33 "GET /compute/v2.1/servers/e4a70a0a-337b-445c-9367-c19ef7fd049e" status: 200 len: 1373 microversion: 2.1 time: 0.203647 Sep 23 06:08:34.541134 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 4007/8201] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:08:34 2022] GET /compute/v2.1/servers/e4a70a0a-337b-445c-9367-c19ef7fd049e => generated 1373 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 06:08:35.564389 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-ffae87b1-5844-41ff-aee8-59c578557c99 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:08:35.565835 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-ffae87b1-5844-41ff-aee8-59c578557c99 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] [instance: e4a70a0a-337b-445c-9367-c19ef7fd049e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:08:35.573789 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ffae87b1-5844-41ff-aee8-59c578557c99 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:08:35.574381 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ffae87b1-5844-41ff-aee8-59c578557c99 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:08:35.574968 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ffae87b1-5844-41ff-aee8-59c578557c99 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:08:35.575667 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ffae87b1-5844-41ff-aee8-59c578557c99 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:08:35.576313 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ffae87b1-5844-41ff-aee8-59c578557c99 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:08:35.577016 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-ffae87b1-5844-41ff-aee8-59c578557c99 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:08:35.733578 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-ffae87b1-5844-41ff-aee8-59c578557c99 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b0275002b74104979c605386448bdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be42ada0a7c7487baa2733e5af4a3a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 06:08:35.742366 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-ffae87b1-5844-41ff-aee8-59c578557c99 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] 10.222.0.33 "GET /compute/v2.1/servers/e4a70a0a-337b-445c-9367-c19ef7fd049e" status: 200 len: 1373 microversion: 2.1 time: 0.183062 Sep 23 06:08:35.749626 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4195/8202] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:08:35 2022] GET /compute/v2.1/servers/e4a70a0a-337b-445c-9367-c19ef7fd049e => generated 1373 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 06:08:36.765989 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-98e9bd17-7587-407e-8eb9-948897fe625c tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:08:36.766811 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-98e9bd17-7587-407e-8eb9-948897fe625c tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] [instance: e4a70a0a-337b-445c-9367-c19ef7fd049e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:08:36.775356 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-98e9bd17-7587-407e-8eb9-948897fe625c tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:08:36.775915 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-98e9bd17-7587-407e-8eb9-948897fe625c tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:08:36.780386 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-98e9bd17-7587-407e-8eb9-948897fe625c tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:08:36.780386 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-98e9bd17-7587-407e-8eb9-948897fe625c tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:08:36.780386 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-98e9bd17-7587-407e-8eb9-948897fe625c tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:08:36.780386 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-98e9bd17-7587-407e-8eb9-948897fe625c tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:08:36.921835 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-98e9bd17-7587-407e-8eb9-948897fe625c tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b0275002b74104979c605386448bdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be42ada0a7c7487baa2733e5af4a3a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 06:08:36.929318 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-98e9bd17-7587-407e-8eb9-948897fe625c tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] 10.222.0.33 "GET /compute/v2.1/servers/e4a70a0a-337b-445c-9367-c19ef7fd049e" status: 200 len: 1373 microversion: 2.1 time: 0.167627 Sep 23 06:08:36.929938 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 4008/8203] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:08:36 2022] GET /compute/v2.1/servers/e4a70a0a-337b-445c-9367-c19ef7fd049e => generated 1373 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 06:08:37.166392 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell0:SELECT=6 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 06:08:37.223304 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-e206b2b2-d202-4853-8809-4663e936100a req-cbb4a067-d2ed-4b5d-af3e-b24e196f1bef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4a70a0a-337b-445c-9367-c19ef7fd049e", "tag": "a857ebf6-cf93-4a0c-ad40-a00d04f38d90"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 06:08:37.233128 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-e206b2b2-d202-4853-8809-4663e936100a req-cbb4a067-d2ed-4b5d-af3e-b24e196f1bef service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:08:37.233621 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-e206b2b2-d202-4853-8809-4663e936100a req-cbb4a067-d2ed-4b5d-af3e-b24e196f1bef service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:08:37.234100 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-e206b2b2-d202-4853-8809-4663e936100a req-cbb4a067-d2ed-4b5d-af3e-b24e196f1bef service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:08:37.247344 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-e206b2b2-d202-4853-8809-4663e936100a req-cbb4a067-d2ed-4b5d-af3e-b24e196f1bef service nova] Creating event network-changed:a857ebf6-cf93-4a0c-ad40-a00d04f38d90 for instance e4a70a0a-337b-445c-9367-c19ef7fd049e on n-h1-846463-3 Sep 23 06:08:37.253284 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-e206b2b2-d202-4853-8809-4663e936100a req-cbb4a067-d2ed-4b5d-af3e-b24e196f1bef service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091945 Sep 23 06:08:37.253918 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4196/8204] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 06:08:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 06:08:37.952326 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e92ab43a-1217-4c1c-a162-fa045d881e48 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:08:37.953016 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e92ab43a-1217-4c1c-a162-fa045d881e48 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] [instance: e4a70a0a-337b-445c-9367-c19ef7fd049e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:08:37.960025 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e92ab43a-1217-4c1c-a162-fa045d881e48 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:08:37.960534 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e92ab43a-1217-4c1c-a162-fa045d881e48 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:08:37.960987 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e92ab43a-1217-4c1c-a162-fa045d881e48 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:08:37.961731 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e92ab43a-1217-4c1c-a162-fa045d881e48 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:08:37.962235 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e92ab43a-1217-4c1c-a162-fa045d881e48 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:08:37.962677 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e92ab43a-1217-4c1c-a162-fa045d881e48 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:08:38.098673 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e92ab43a-1217-4c1c-a162-fa045d881e48 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b0275002b74104979c605386448bdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be42ada0a7c7487baa2733e5af4a3a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 06:08:38.107558 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e92ab43a-1217-4c1c-a162-fa045d881e48 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] 10.222.0.33 "GET /compute/v2.1/servers/e4a70a0a-337b-445c-9367-c19ef7fd049e" status: 200 len: 1373 microversion: 2.1 time: 0.159099 Sep 23 06:08:38.108140 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 4009/8205] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:08:37 2022] GET /compute/v2.1/servers/e4a70a0a-337b-445c-9367-c19ef7fd049e => generated 1373 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 06:08:39.133161 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c61b48f9-ac9b-48ff-b197-aeb8af4eaa3d tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:08:39.133791 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c61b48f9-ac9b-48ff-b197-aeb8af4eaa3d tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] [instance: e4a70a0a-337b-445c-9367-c19ef7fd049e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:08:39.140527 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c61b48f9-ac9b-48ff-b197-aeb8af4eaa3d tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:08:39.141448 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c61b48f9-ac9b-48ff-b197-aeb8af4eaa3d tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:08:39.141567 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c61b48f9-ac9b-48ff-b197-aeb8af4eaa3d tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:08:39.142290 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c61b48f9-ac9b-48ff-b197-aeb8af4eaa3d tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:08:39.142755 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c61b48f9-ac9b-48ff-b197-aeb8af4eaa3d tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:08:39.143186 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c61b48f9-ac9b-48ff-b197-aeb8af4eaa3d tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:08:39.274986 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c61b48f9-ac9b-48ff-b197-aeb8af4eaa3d tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b0275002b74104979c605386448bdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be42ada0a7c7487baa2733e5af4a3a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 06:08:39.282695 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c61b48f9-ac9b-48ff-b197-aeb8af4eaa3d tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] 10.222.0.33 "GET /compute/v2.1/servers/e4a70a0a-337b-445c-9367-c19ef7fd049e" status: 200 len: 1373 microversion: 2.1 time: 0.155369 Sep 23 06:08:39.283263 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4197/8206] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:08:39 2022] GET /compute/v2.1/servers/e4a70a0a-337b-445c-9367-c19ef7fd049e => generated 1373 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 06:08:40.305514 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-ba03404e-9696-47b5-b623-79685a65300a tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:08:40.306303 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-ba03404e-9696-47b5-b623-79685a65300a tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] [instance: e4a70a0a-337b-445c-9367-c19ef7fd049e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:08:40.313490 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ba03404e-9696-47b5-b623-79685a65300a tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:08:40.314036 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ba03404e-9696-47b5-b623-79685a65300a tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:08:40.314506 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ba03404e-9696-47b5-b623-79685a65300a tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:08:40.315724 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ba03404e-9696-47b5-b623-79685a65300a tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:08:40.316223 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ba03404e-9696-47b5-b623-79685a65300a tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:08:40.316681 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-ba03404e-9696-47b5-b623-79685a65300a tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:08:40.453522 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-ba03404e-9696-47b5-b623-79685a65300a tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b0275002b74104979c605386448bdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be42ada0a7c7487baa2733e5af4a3a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 06:08:40.463446 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-ba03404e-9696-47b5-b623-79685a65300a tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] 10.222.0.33 "GET /compute/v2.1/servers/e4a70a0a-337b-445c-9367-c19ef7fd049e" status: 200 len: 1373 microversion: 2.1 time: 0.161816 Sep 23 06:08:40.464024 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 4010/8207] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:08:40 2022] GET /compute/v2.1/servers/e4a70a0a-337b-445c-9367-c19ef7fd049e => generated 1373 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 06:08:41.488820 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-6c457637-fc5d-427b-8d36-6876e476c8d9 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:08:41.489678 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-6c457637-fc5d-427b-8d36-6876e476c8d9 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] [instance: e4a70a0a-337b-445c-9367-c19ef7fd049e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:08:41.496651 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6c457637-fc5d-427b-8d36-6876e476c8d9 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:08:41.497148 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6c457637-fc5d-427b-8d36-6876e476c8d9 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:08:41.497586 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6c457637-fc5d-427b-8d36-6876e476c8d9 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:08:41.498306 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6c457637-fc5d-427b-8d36-6876e476c8d9 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:08:41.498764 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6c457637-fc5d-427b-8d36-6876e476c8d9 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:08:41.499190 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-6c457637-fc5d-427b-8d36-6876e476c8d9 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:08:41.631463 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-6c457637-fc5d-427b-8d36-6876e476c8d9 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b0275002b74104979c605386448bdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be42ada0a7c7487baa2733e5af4a3a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 06:08:41.639412 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-6c457637-fc5d-427b-8d36-6876e476c8d9 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] 10.222.0.33 "GET /compute/v2.1/servers/e4a70a0a-337b-445c-9367-c19ef7fd049e" status: 200 len: 1373 microversion: 2.1 time: 0.154507 Sep 23 06:08:41.639992 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4198/8208] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:08:41 2022] GET /compute/v2.1/servers/e4a70a0a-337b-445c-9367-c19ef7fd049e => generated 1373 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 06:08:42.662617 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-17d31fe1-d6b4-4762-ab92-6884bdd3d8df tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:08:42.663289 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-17d31fe1-d6b4-4762-ab92-6884bdd3d8df tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] [instance: e4a70a0a-337b-445c-9367-c19ef7fd049e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:08:42.670357 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-17d31fe1-d6b4-4762-ab92-6884bdd3d8df tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:08:42.671244 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-17d31fe1-d6b4-4762-ab92-6884bdd3d8df tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:08:42.671714 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-17d31fe1-d6b4-4762-ab92-6884bdd3d8df tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:08:42.672442 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-17d31fe1-d6b4-4762-ab92-6884bdd3d8df tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:08:42.672924 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-17d31fe1-d6b4-4762-ab92-6884bdd3d8df tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:08:42.673379 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-17d31fe1-d6b4-4762-ab92-6884bdd3d8df tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:08:42.808700 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-17d31fe1-d6b4-4762-ab92-6884bdd3d8df tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b0275002b74104979c605386448bdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be42ada0a7c7487baa2733e5af4a3a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 06:08:42.818315 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-17d31fe1-d6b4-4762-ab92-6884bdd3d8df tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] 10.222.0.33 "GET /compute/v2.1/servers/e4a70a0a-337b-445c-9367-c19ef7fd049e" status: 200 len: 1373 microversion: 2.1 time: 0.159679 Sep 23 06:08:42.819642 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 4011/8209] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:08:42 2022] GET /compute/v2.1/servers/e4a70a0a-337b-445c-9367-c19ef7fd049e => generated 1373 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 06:08:43.182418 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-3ab724bb-bfa0-430f-9585-78a4c7af170a req-a5591d03-39ca-4793-84bc-31d3bd755b71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4a70a0a-337b-445c-9367-c19ef7fd049e", "name": "network-vif-plugged", "status": "completed", "tag": "a857ebf6-cf93-4a0c-ad40-a00d04f38d90"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 06:08:43.192183 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-3ab724bb-bfa0-430f-9585-78a4c7af170a req-a5591d03-39ca-4793-84bc-31d3bd755b71 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:08:43.192668 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-3ab724bb-bfa0-430f-9585-78a4c7af170a req-a5591d03-39ca-4793-84bc-31d3bd755b71 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:08:43.193098 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-3ab724bb-bfa0-430f-9585-78a4c7af170a req-a5591d03-39ca-4793-84bc-31d3bd755b71 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:08:43.204334 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-3ab724bb-bfa0-430f-9585-78a4c7af170a req-a5591d03-39ca-4793-84bc-31d3bd755b71 service nova] Creating event network-vif-plugged:a857ebf6-cf93-4a0c-ad40-a00d04f38d90 for instance e4a70a0a-337b-445c-9367-c19ef7fd049e on n-h1-846463-3 Sep 23 06:08:43.209470 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-3ab724bb-bfa0-430f-9585-78a4c7af170a req-a5591d03-39ca-4793-84bc-31d3bd755b71 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031603 Sep 23 06:08:43.210133 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4199/8210] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 06:08:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 06:08:43.842144 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-e1770ce0-da1a-45b8-a45e-4a2b6ca5c37d tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:08:43.842776 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-e1770ce0-da1a-45b8-a45e-4a2b6ca5c37d tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] [instance: e4a70a0a-337b-445c-9367-c19ef7fd049e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:08:43.849576 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e1770ce0-da1a-45b8-a45e-4a2b6ca5c37d tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:08:43.850173 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e1770ce0-da1a-45b8-a45e-4a2b6ca5c37d tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:08:43.850631 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e1770ce0-da1a-45b8-a45e-4a2b6ca5c37d tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:08:43.851340 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e1770ce0-da1a-45b8-a45e-4a2b6ca5c37d tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:08:43.851814 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e1770ce0-da1a-45b8-a45e-4a2b6ca5c37d tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:08:43.852255 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-e1770ce0-da1a-45b8-a45e-4a2b6ca5c37d tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:08:43.981303 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-e1770ce0-da1a-45b8-a45e-4a2b6ca5c37d tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b0275002b74104979c605386448bdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be42ada0a7c7487baa2733e5af4a3a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 06:08:43.988933 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-e1770ce0-da1a-45b8-a45e-4a2b6ca5c37d tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] 10.222.0.33 "GET /compute/v2.1/servers/e4a70a0a-337b-445c-9367-c19ef7fd049e" status: 200 len: 1373 microversion: 2.1 time: 0.150698 Sep 23 06:08:43.989504 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 4012/8211] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:08:43 2022] GET /compute/v2.1/servers/e4a70a0a-337b-445c-9367-c19ef7fd049e => generated 1373 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 06:08:45.013040 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-4566438a-6d52-45db-a001-f5ee5bed1295 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:08:45.013730 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-4566438a-6d52-45db-a001-f5ee5bed1295 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] [instance: e4a70a0a-337b-445c-9367-c19ef7fd049e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:08:45.019891 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4566438a-6d52-45db-a001-f5ee5bed1295 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:08:45.020379 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4566438a-6d52-45db-a001-f5ee5bed1295 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:08:45.020817 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4566438a-6d52-45db-a001-f5ee5bed1295 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:08:45.021507 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4566438a-6d52-45db-a001-f5ee5bed1295 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:08:45.022479 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4566438a-6d52-45db-a001-f5ee5bed1295 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:08:45.022905 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-4566438a-6d52-45db-a001-f5ee5bed1295 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:08:45.154428 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-4566438a-6d52-45db-a001-f5ee5bed1295 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b0275002b74104979c605386448bdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be42ada0a7c7487baa2733e5af4a3a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 06:08:45.162294 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-4566438a-6d52-45db-a001-f5ee5bed1295 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] 10.222.0.33 "GET /compute/v2.1/servers/e4a70a0a-337b-445c-9367-c19ef7fd049e" status: 200 len: 1559 microversion: 2.1 time: 0.153979 Sep 23 06:08:45.163499 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4200/8212] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:08:45 2022] GET /compute/v2.1/servers/e4a70a0a-337b-445c-9367-c19ef7fd049e => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 06:08:45.190625 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-56ca619f-a166-4b15-a226-5929331e7feb tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:08:45.190625 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-56ca619f-a166-4b15-a226-5929331e7feb tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] [instance: e4a70a0a-337b-445c-9367-c19ef7fd049e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:08:45.193350 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-56ca619f-a166-4b15-a226-5929331e7feb tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:08:45.193868 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-56ca619f-a166-4b15-a226-5929331e7feb tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:08:45.194373 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-56ca619f-a166-4b15-a226-5929331e7feb tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:08:45.195150 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-56ca619f-a166-4b15-a226-5929331e7feb tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:08:45.195636 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-56ca619f-a166-4b15-a226-5929331e7feb tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:08:45.196087 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-56ca619f-a166-4b15-a226-5929331e7feb tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:08:45.333786 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-56ca619f-a166-4b15-a226-5929331e7feb tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b0275002b74104979c605386448bdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be42ada0a7c7487baa2733e5af4a3a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 06:08:45.342455 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-56ca619f-a166-4b15-a226-5929331e7feb tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] 10.222.0.33 "GET /compute/v2.1/servers/e4a70a0a-337b-445c-9367-c19ef7fd049e" status: 200 len: 1559 microversion: 2.1 time: 0.161245 Sep 23 06:08:45.343029 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 4013/8213] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:08:45 2022] GET /compute/v2.1/servers/e4a70a0a-337b-445c-9367-c19ef7fd049e => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 06:08:47.544859 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-b201ff3a-fd46-4b40-a93c-247832a6e8f6 req-8d7dd16e-1a31-4352-8019-d8627a6c70b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4a70a0a-337b-445c-9367-c19ef7fd049e", "tag": "a857ebf6-cf93-4a0c-ad40-a00d04f38d90"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 06:08:47.555515 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-b201ff3a-fd46-4b40-a93c-247832a6e8f6 req-8d7dd16e-1a31-4352-8019-d8627a6c70b8 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:08:47.556005 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-b201ff3a-fd46-4b40-a93c-247832a6e8f6 req-8d7dd16e-1a31-4352-8019-d8627a6c70b8 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:08:47.556438 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-b201ff3a-fd46-4b40-a93c-247832a6e8f6 req-8d7dd16e-1a31-4352-8019-d8627a6c70b8 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:08:47.567605 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-b201ff3a-fd46-4b40-a93c-247832a6e8f6 req-8d7dd16e-1a31-4352-8019-d8627a6c70b8 service nova] Creating event network-changed:a857ebf6-cf93-4a0c-ad40-a00d04f38d90 for instance e4a70a0a-337b-445c-9367-c19ef7fd049e on n-h1-846463-3 Sep 23 06:08:47.572770 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-b201ff3a-fd46-4b40-a93c-247832a6e8f6 req-8d7dd16e-1a31-4352-8019-d8627a6c70b8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031636 Sep 23 06:08:47.573450 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4201/8214] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 06:08:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 06:10:26.184049 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 06:10:26.184840 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=64 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 06:10:26.189986 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-dfc2c9d5-97bc-47a2-a5ff-42b3d7077def tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-305069956"}} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 06:10:26.192389 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-dfc2c9d5-97bc-47a2-a5ff-42b3d7077def tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] [instance: e4a70a0a-337b-445c-9367-c19ef7fd049e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:10:26.198707 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dfc2c9d5-97bc-47a2-a5ff-42b3d7077def tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:10:26.206229 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dfc2c9d5-97bc-47a2-a5ff-42b3d7077def tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:10:26.206229 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dfc2c9d5-97bc-47a2-a5ff-42b3d7077def tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:10:26.206229 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dfc2c9d5-97bc-47a2-a5ff-42b3d7077def tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:10:26.206229 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dfc2c9d5-97bc-47a2-a5ff-42b3d7077def tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:10:26.206229 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-dfc2c9d5-97bc-47a2-a5ff-42b3d7077def tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:10:26.595800 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-dfc2c9d5-97bc-47a2-a5ff-42b3d7077def tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] 10.222.0.33 "POST /compute/v2.1/servers/e4a70a0a-337b-445c-9367-c19ef7fd049e/action" status: 202 len: 0 microversion: 2.1 time: 0.413628 Sep 23 06:10:26.596368 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 4014/8215] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Sep 23 06:10:26 2022] POST /compute/v2.1/servers/e4a70a0a-337b-445c-9367-c19ef7fd049e/action => generated 0 bytes in 415 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Sep 23 06:10:31.484788 n-d-846463-3 devstack@n-api.service[122699]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c6c7f4e7-3ce9-40e8-ba39-9d563bbcd13f] AMQP server on 10.222.0.33:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Sep 23 06:10:31.484788 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_api:SELECT=34 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 06:10:31.484788 n-d-846463-3 devstack@n-api.service[122699]: DEBUG dbcounter [-] [122699] Writing DB stats nova_cell1:SELECT=50 {{(pid=122699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 06:10:31.487009 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-2201f1b6-8d54-4c30-a499-2b627e1c4661 req-4d099724-3f2d-4d5e-b425-3996dcbc1319 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4a70a0a-337b-445c-9367-c19ef7fd049e", "name": "network-vif-plugged", "status": "completed", "tag": "a857ebf6-cf93-4a0c-ad40-a00d04f38d90"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 06:10:31.501647 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-2201f1b6-8d54-4c30-a499-2b627e1c4661 req-4d099724-3f2d-4d5e-b425-3996dcbc1319 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:10:31.502171 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-2201f1b6-8d54-4c30-a499-2b627e1c4661 req-4d099724-3f2d-4d5e-b425-3996dcbc1319 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:10:31.502630 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-2201f1b6-8d54-4c30-a499-2b627e1c4661 req-4d099724-3f2d-4d5e-b425-3996dcbc1319 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:10:31.516963 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-2201f1b6-8d54-4c30-a499-2b627e1c4661 req-4d099724-3f2d-4d5e-b425-3996dcbc1319 service nova] Creating event network-vif-plugged:a857ebf6-cf93-4a0c-ad40-a00d04f38d90 for instance e4a70a0a-337b-445c-9367-c19ef7fd049e on n-h1-846463-3 Sep 23 06:10:31.523394 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-2201f1b6-8d54-4c30-a499-2b627e1c4661 req-4d099724-3f2d-4d5e-b425-3996dcbc1319 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050637 Sep 23 06:10:31.524046 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4202/8216] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 06:10:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 06:10:43.046895 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_api:SELECT=2 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 06:10:43.046895 n-d-846463-3 devstack@n-api.service[122698]: DEBUG dbcounter [-] [122698] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 06:10:43.049945 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-a7f6af3e-096c-4087-a252-a27b4fce99e8 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:10:43.050554 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a7f6af3e-096c-4087-a252-a27b4fce99e8 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] [instance: e4a70a0a-337b-445c-9367-c19ef7fd049e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:10:43.051227 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-2a335aab-baa3-4a9c-a38b-8b0b8a95ff67 req-fd5b6c12-3b45-422a-ad07-8f9abb5a503e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4a70a0a-337b-445c-9367-c19ef7fd049e", "tag": "a857ebf6-cf93-4a0c-ad40-a00d04f38d90"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 06:10:43.056885 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a7f6af3e-096c-4087-a252-a27b4fce99e8 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:10:43.057649 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a7f6af3e-096c-4087-a252-a27b4fce99e8 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:10:43.058272 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a7f6af3e-096c-4087-a252-a27b4fce99e8 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:10:43.059006 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a7f6af3e-096c-4087-a252-a27b4fce99e8 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:10:43.059487 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a7f6af3e-096c-4087-a252-a27b4fce99e8 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:10:43.059937 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-a7f6af3e-096c-4087-a252-a27b4fce99e8 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:10:43.065355 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-2a335aab-baa3-4a9c-a38b-8b0b8a95ff67 req-fd5b6c12-3b45-422a-ad07-8f9abb5a503e service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:10:43.066121 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-2a335aab-baa3-4a9c-a38b-8b0b8a95ff67 req-fd5b6c12-3b45-422a-ad07-8f9abb5a503e service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:10:43.066561 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-2a335aab-baa3-4a9c-a38b-8b0b8a95ff67 req-fd5b6c12-3b45-422a-ad07-8f9abb5a503e service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:10:43.082232 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-2a335aab-baa3-4a9c-a38b-8b0b8a95ff67 req-fd5b6c12-3b45-422a-ad07-8f9abb5a503e service nova] Creating event network-changed:a857ebf6-cf93-4a0c-ad40-a00d04f38d90 for instance e4a70a0a-337b-445c-9367-c19ef7fd049e on n-h1-846463-3 Sep 23 06:10:43.088170 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-2a335aab-baa3-4a9c-a38b-8b0b8a95ff67 req-fd5b6c12-3b45-422a-ad07-8f9abb5a503e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042763 Sep 23 06:10:43.089242 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4203/8217] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 06:10:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 06:10:43.095346 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-a7f6af3e-096c-4087-a252-a27b4fce99e8 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] [instance: e4a70a0a-337b-445c-9367-c19ef7fd049e] Going to try to terminate instance {{(pid=122698) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 06:10:43.366176 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-a7f6af3e-096c-4087-a252-a27b4fce99e8 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e4a70a0a-337b-445c-9367-c19ef7fd049e" status: 204 len: 0 microversion: 2.1 time: 0.323171 Sep 23 06:10:43.370340 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 4015/8218] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 06:10:43 2022] DELETE /compute/v2.1/servers/e4a70a0a-337b-445c-9367-c19ef7fd049e => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 23 06:10:43.378838 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-e0170a3f-a52e-4196-a557-1d60f1607d1b tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:10:43.379593 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-e0170a3f-a52e-4196-a557-1d60f1607d1b tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] [instance: e4a70a0a-337b-445c-9367-c19ef7fd049e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:10:43.387874 n-d-846463-3 devstack@n-api.service[122699]: INFO oslo.messaging._drivers.impl_rabbit [-] [c6c7f4e7-3ce9-40e8-ba39-9d563bbcd13f] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 57718. Sep 23 06:10:43.392613 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e0170a3f-a52e-4196-a557-1d60f1607d1b tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:10:43.393325 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e0170a3f-a52e-4196-a557-1d60f1607d1b tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:10:43.393985 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e0170a3f-a52e-4196-a557-1d60f1607d1b tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:10:43.395089 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e0170a3f-a52e-4196-a557-1d60f1607d1b tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:10:43.395753 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e0170a3f-a52e-4196-a557-1d60f1607d1b tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:10:43.396375 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-e0170a3f-a52e-4196-a557-1d60f1607d1b tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:10:43.539923 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-e0170a3f-a52e-4196-a557-1d60f1607d1b tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b0275002b74104979c605386448bdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be42ada0a7c7487baa2733e5af4a3a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 06:10:43.548524 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-e0170a3f-a52e-4196-a557-1d60f1607d1b tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] 10.222.0.33 "GET /compute/v2.1/servers/e4a70a0a-337b-445c-9367-c19ef7fd049e" status: 200 len: 1684 microversion: 2.1 time: 0.176517 Sep 23 06:10:43.549131 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4204/8219] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:10:43 2022] GET /compute/v2.1/servers/e4a70a0a-337b-445c-9367-c19ef7fd049e => generated 1684 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 06:10:44.573382 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-77785a3f-d8e9-4f8e-85da-1ca934dbd18d tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:10:44.574168 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-77785a3f-d8e9-4f8e-85da-1ca934dbd18d tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] [instance: e4a70a0a-337b-445c-9367-c19ef7fd049e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:10:44.581117 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-77785a3f-d8e9-4f8e-85da-1ca934dbd18d tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:10:44.581565 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-77785a3f-d8e9-4f8e-85da-1ca934dbd18d tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:10:44.582052 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-77785a3f-d8e9-4f8e-85da-1ca934dbd18d tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:10:44.582760 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-77785a3f-d8e9-4f8e-85da-1ca934dbd18d tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:10:44.583231 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-77785a3f-d8e9-4f8e-85da-1ca934dbd18d tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:10:44.583672 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-77785a3f-d8e9-4f8e-85da-1ca934dbd18d tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:10:44.716250 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-77785a3f-d8e9-4f8e-85da-1ca934dbd18d tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b0275002b74104979c605386448bdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be42ada0a7c7487baa2733e5af4a3a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 06:10:44.724284 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-77785a3f-d8e9-4f8e-85da-1ca934dbd18d tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] 10.222.0.33 "GET /compute/v2.1/servers/e4a70a0a-337b-445c-9367-c19ef7fd049e" status: 200 len: 1684 microversion: 2.1 time: 0.155735 Sep 23 06:10:44.724866 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 4016/8220] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:10:44 2022] GET /compute/v2.1/servers/e4a70a0a-337b-445c-9367-c19ef7fd049e => generated 1684 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 06:10:45.440480 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-34217c8a-04f1-4cda-9fe7-ef94761cd7c6 req-b3220939-992b-4f4c-b1ca-2ff5cd7ec6ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4a70a0a-337b-445c-9367-c19ef7fd049e", "name": "network-vif-deleted", "tag": "a857ebf6-cf93-4a0c-ad40-a00d04f38d90"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 06:10:45.450438 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-34217c8a-04f1-4cda-9fe7-ef94761cd7c6 req-b3220939-992b-4f4c-b1ca-2ff5cd7ec6ff service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:10:45.454156 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-34217c8a-04f1-4cda-9fe7-ef94761cd7c6 req-b3220939-992b-4f4c-b1ca-2ff5cd7ec6ff service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:10:45.454156 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-34217c8a-04f1-4cda-9fe7-ef94761cd7c6 req-b3220939-992b-4f4c-b1ca-2ff5cd7ec6ff service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:10:45.462191 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-34217c8a-04f1-4cda-9fe7-ef94761cd7c6 req-b3220939-992b-4f4c-b1ca-2ff5cd7ec6ff service nova] Creating event network-vif-deleted:a857ebf6-cf93-4a0c-ad40-a00d04f38d90 for instance e4a70a0a-337b-445c-9367-c19ef7fd049e on n-h1-846463-3 Sep 23 06:10:45.468319 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-34217c8a-04f1-4cda-9fe7-ef94761cd7c6 req-b3220939-992b-4f4c-b1ca-2ff5cd7ec6ff service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031756 Sep 23 06:10:45.469143 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4205/8221] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 06:10:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 06:10:45.747885 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-79aa49b2-5a86-49a9-ab7e-a5bba71979e9 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:10:45.748520 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-79aa49b2-5a86-49a9-ab7e-a5bba71979e9 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] [instance: e4a70a0a-337b-445c-9367-c19ef7fd049e] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:10:45.755770 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-79aa49b2-5a86-49a9-ab7e-a5bba71979e9 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:10:45.756159 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-79aa49b2-5a86-49a9-ab7e-a5bba71979e9 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:10:45.756744 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-79aa49b2-5a86-49a9-ab7e-a5bba71979e9 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:10:45.757329 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-79aa49b2-5a86-49a9-ab7e-a5bba71979e9 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:10:45.757810 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-79aa49b2-5a86-49a9-ab7e-a5bba71979e9 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:10:45.758325 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-79aa49b2-5a86-49a9-ab7e-a5bba71979e9 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:10:45.793306 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-79aa49b2-5a86-49a9-ab7e-a5bba71979e9 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:10:45.793815 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-79aa49b2-5a86-49a9-ab7e-a5bba71979e9 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:10:45.794297 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-79aa49b2-5a86-49a9-ab7e-a5bba71979e9 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:10:45.794768 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.objects.instance [None req-79aa49b2-5a86-49a9-ab7e-a5bba71979e9 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lazy-loading 'fault' on Instance uuid e4a70a0a-337b-445c-9367-c19ef7fd049e {{(pid=122698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 06:10:45.841261 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-79aa49b2-5a86-49a9-ab7e-a5bba71979e9 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b0275002b74104979c605386448bdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be42ada0a7c7487baa2733e5af4a3a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 06:10:45.850133 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-79aa49b2-5a86-49a9-ab7e-a5bba71979e9 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] 10.222.0.33 "GET /compute/v2.1/servers/e4a70a0a-337b-445c-9367-c19ef7fd049e" status: 200 len: 1337 microversion: 2.1 time: 0.106109 Sep 23 06:10:45.851712 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 4017/8222] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:10:45 2022] GET /compute/v2.1/servers/e4a70a0a-337b-445c-9367-c19ef7fd049e => generated 1337 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 06:10:46.875758 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-36a1705f-7c30-4cb5-bae8-97fdf1177ee8 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:10:46.876539 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-36a1705f-7c30-4cb5-bae8-97fdf1177ee8 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] [instance: e4a70a0a-337b-445c-9367-c19ef7fd049e] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:10:46.882853 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-36a1705f-7c30-4cb5-bae8-97fdf1177ee8 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:10:46.883355 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-36a1705f-7c30-4cb5-bae8-97fdf1177ee8 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:10:46.883803 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-36a1705f-7c30-4cb5-bae8-97fdf1177ee8 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:10:46.884506 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-36a1705f-7c30-4cb5-bae8-97fdf1177ee8 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:10:46.884970 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-36a1705f-7c30-4cb5-bae8-97fdf1177ee8 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:10:46.885403 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-36a1705f-7c30-4cb5-bae8-97fdf1177ee8 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:10:46.899165 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.wsgi [None req-36a1705f-7c30-4cb5-bae8-97fdf1177ee8 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] HTTP exception thrown: Instance e4a70a0a-337b-445c-9367-c19ef7fd049e could not be found. Sep 23 06:10:46.901058 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-36a1705f-7c30-4cb5-bae8-97fdf1177ee8 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Request method failure captured: Sep 23 06:10:46.901058 n-d-846463-3 devstack@n-api.service[122699]: request: GET /compute/v2.1/servers/e4a70a0a-337b-445c-9367-c19ef7fd049e HTTP/1.1 Sep 23 06:10:46.901058 n-d-846463-3 devstack@n-api.service[122699]: Accept: application/json Sep 23 06:10:46.901058 n-d-846463-3 devstack@n-api.service[122699]: Accept-Encoding: identity Sep 23 06:10:46.901058 n-d-846463-3 devstack@n-api.service[122699]: Connection: close Sep 23 06:10:46.901058 n-d-846463-3 devstack@n-api.service[122699]: Content-Length: 0 Sep 23 06:10:46.901058 n-d-846463-3 devstack@n-api.service[122699]: Content-Type: application/json Sep 23 06:10:46.901058 n-d-846463-3 devstack@n-api.service[122699]: Host: 10.222.0.33 Sep 23 06:10:46.901058 n-d-846463-3 devstack@n-api.service[122699]: Openstack-System-Scope: None Sep 23 06:10:46.901058 n-d-846463-3 devstack@n-api.service[122699]: User-Agent: python-urllib3/1.26.12 Sep 23 06:10:46.901058 n-d-846463-3 devstack@n-api.service[122699]: X-Auth-Token: gAAAAABjLUy6do-ZVxFCcQroOnHnVp4MDTtO2BaWEsuiTIuKRqoli2_U6nJGva_KdRIhwAlQYSg0u-Y2fTuVzF92m_tYj8Bq6ifBW5NrQ4031y_7iQETlrNxGQQFTlw7bwVJLzBoMAGvyXjvUBr-REFIekNqRd46TFFVqV4jiknzMYu0ii-UHnY Sep 23 06:10:46.901058 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Id: None Sep 23 06:10:46.901058 n-d-846463-3 devstack@n-api.service[122699]: X-Domain-Name: None Sep 23 06:10:46.901058 n-d-846463-3 devstack@n-api.service[122699]: X-Identity-Status: Confirmed Sep 23 06:10:46.901058 n-d-846463-3 devstack@n-api.service[122699]: X-Is-Admin-Project: True Sep 23 06:10:46.901058 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Id: default Sep 23 06:10:46.901058 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Domain-Name: Default Sep 23 06:10:46.901058 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Id: be42ada0a7c7487baa2733e5af4a3a05 Sep 23 06:10:46.901058 n-d-846463-3 devstack@n-api.service[122699]: X-Project-Name: tempest-TestSnapshotPattern-1879749531 Sep 23 06:10:46.901058 n-d-846463-3 devstack@n-api.service[122699]: X-Role: reader,member Sep 23 06:10:46.901058 n-d-846463-3 devstack@n-api.service[122699]: X-Roles: reader,member Sep 23 06:10:46.901058 n-d-846463-3 devstack@n-api.service[122699]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_be42ada0a7c7487baa2733e5af4a3a05", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/be42ada0a7c7487baa2733e5af4a3a05"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/be42ada0a7c7487baa2733e5af4a3a05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/be42ada0a7c7487baa2733e5af4a3a05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 06:10:46.901058 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant: tempest-TestSnapshotPattern-1879749531 Sep 23 06:10:46.901058 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Id: be42ada0a7c7487baa2733e5af4a3a05 Sep 23 06:10:46.901058 n-d-846463-3 devstack@n-api.service[122699]: X-Tenant-Name: tempest-TestSnapshotPattern-1879749531 Sep 23 06:10:46.901058 n-d-846463-3 devstack@n-api.service[122699]: X-User: tempest-TestSnapshotPattern-1879749531-project Sep 23 06:10:46.901058 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Id: default Sep 23 06:10:46.901058 n-d-846463-3 devstack@n-api.service[122699]: X-User-Domain-Name: Default Sep 23 06:10:46.901058 n-d-846463-3 devstack@n-api.service[122699]: X-User-Id: c8b0275002b74104979c605386448bdb Sep 23 06:10:46.901058 n-d-846463-3 devstack@n-api.service[122699]: X-User-Name: tempest-TestSnapshotPattern-1879749531-project Sep 23 06:10:46.901058 n-d-846463-3 devstack@n-api.service[122699]: method: > Sep 23 06:10:46.901058 n-d-846463-3 devstack@n-api.service[122699]: exception: Instance e4a70a0a-337b-445c-9367-c19ef7fd049e could not be found. Sep 23 06:10:46.901058 n-d-846463-3 devstack@n-api.service[122699]: action_args: {'id': 'e4a70a0a-337b-445c-9367-c19ef7fd049e'} Sep 23 06:10:46.901058 n-d-846463-3 devstack@n-api.service[122699]: {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 06:10:46.901058 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 06:10:46.901058 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 06:10:46.901058 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 06:10:46.901058 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 06:10:46.901058 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 06:10:46.901058 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 06:10:46.901058 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 06:10:46.901058 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 06:10:46.901058 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 06:10:46.901058 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4a70a0a-337b-445c-9367-c19ef7fd049e could not be found. Sep 23 06:10:46.901058 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 06:10:46.901058 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 06:10:46.901058 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 06:10:46.901058 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 06:10:46.901058 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 06:10:46.901058 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 06:10:46.901058 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 06:10:46.901058 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 06:10:46.901058 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 06:10:46.901058 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 06:10:46.901058 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 06:10:46.901058 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 06:10:46.901058 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 06:10:46.901058 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 06:10:46.901058 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 06:10:46.901058 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 06:10:46.901058 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4a70a0a-337b-445c-9367-c19ef7fd049e could not be found. Sep 23 06:10:46.901058 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 06:10:46.901058 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 06:10:46.901058 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 06:10:46.907078 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 06:10:46.907078 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 06:10:46.907078 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 06:10:46.907078 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 06:10:46.907078 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 06:10:46.907078 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4a70a0a-337b-445c-9367-c19ef7fd049e could not be found. Sep 23 06:10:46.907078 n-d-846463-3 devstack@n-api.service[122699]: ERROR nova.api.openstack.wsgi Sep 23 06:10:46.907078 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-36a1705f-7c30-4cb5-bae8-97fdf1177ee8 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Returning 404 to user: Instance e4a70a0a-337b-445c-9367-c19ef7fd049e could not be found. {{(pid=122699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 06:10:46.907078 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-36a1705f-7c30-4cb5-bae8-97fdf1177ee8 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] 10.222.0.33 "GET /compute/v2.1/servers/e4a70a0a-337b-445c-9367-c19ef7fd049e" status: 404 len: 111 microversion: 2.1 time: 0.031544 Sep 23 06:10:46.907078 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4206/8223] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:10:46 2022] GET /compute/v2.1/servers/e4a70a0a-337b-445c-9367-c19ef7fd049e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 06:10:49.168850 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-9f7fc4a7-bdd4-4819-a978-88b89d0e02f5 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:10:49.169379 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-9f7fc4a7-bdd4-4819-a978-88b89d0e02f5 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] [instance: 42c52f0c-4e4c-418c-9584-388fd2dae3cc] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:10:49.171730 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [req-9412f261-6d16-4208-9112-3f26dc8eb5b1 req-0e92ff8d-a901-4cec-bde1-675d535c4e2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42c52f0c-4e4c-418c-9584-388fd2dae3cc", "tag": "d1d18851-f17e-4561-926c-86fec04607dd"}]} {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 06:10:49.176375 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9f7fc4a7-bdd4-4819-a978-88b89d0e02f5 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:10:49.176881 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9f7fc4a7-bdd4-4819-a978-88b89d0e02f5 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:10:49.177334 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9f7fc4a7-bdd4-4819-a978-88b89d0e02f5 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:10:49.178076 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9f7fc4a7-bdd4-4819-a978-88b89d0e02f5 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:10:49.179082 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9f7fc4a7-bdd4-4819-a978-88b89d0e02f5 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:10:49.180112 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-9f7fc4a7-bdd4-4819-a978-88b89d0e02f5 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:10:49.186234 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-9412f261-6d16-4208-9112-3f26dc8eb5b1 req-0e92ff8d-a901-4cec-bde1-675d535c4e2d service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:10:49.187049 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-9412f261-6d16-4208-9112-3f26dc8eb5b1 req-0e92ff8d-a901-4cec-bde1-675d535c4e2d service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:10:49.187596 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [req-9412f261-6d16-4208-9112-3f26dc8eb5b1 req-0e92ff8d-a901-4cec-bde1-675d535c4e2d service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:10:49.204816 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.compute.server_external_events [req-9412f261-6d16-4208-9112-3f26dc8eb5b1 req-0e92ff8d-a901-4cec-bde1-675d535c4e2d service nova] Creating event network-changed:d1d18851-f17e-4561-926c-86fec04607dd for instance 42c52f0c-4e4c-418c-9584-388fd2dae3cc on n-h2-846463-3 Sep 23 06:10:49.212427 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [req-9412f261-6d16-4208-9112-3f26dc8eb5b1 req-0e92ff8d-a901-4cec-bde1-675d535c4e2d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044905 Sep 23 06:10:49.216909 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4207/8224] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 06:10:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 06:10:49.217525 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-9f7fc4a7-bdd4-4819-a978-88b89d0e02f5 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] [instance: 42c52f0c-4e4c-418c-9584-388fd2dae3cc] Going to try to terminate instance {{(pid=122698) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 06:10:49.479944 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-9f7fc4a7-bdd4-4819-a978-88b89d0e02f5 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] 10.222.0.33 "DELETE /compute/v2.1/servers/42c52f0c-4e4c-418c-9584-388fd2dae3cc" status: 204 len: 0 microversion: 2.1 time: 0.314781 Sep 23 06:10:49.480950 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 4018/8225] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Sep 23 06:10:49 2022] DELETE /compute/v2.1/servers/42c52f0c-4e4c-418c-9584-388fd2dae3cc => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 06:10:49.490432 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-c3ee1ff0-a7a8-413c-ac7d-25b2866ec0b9 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:10:49.491821 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-c3ee1ff0-a7a8-413c-ac7d-25b2866ec0b9 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] [instance: 42c52f0c-4e4c-418c-9584-388fd2dae3cc] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:10:49.498977 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c3ee1ff0-a7a8-413c-ac7d-25b2866ec0b9 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:10:49.499692 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c3ee1ff0-a7a8-413c-ac7d-25b2866ec0b9 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:10:49.500332 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c3ee1ff0-a7a8-413c-ac7d-25b2866ec0b9 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:10:49.501402 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c3ee1ff0-a7a8-413c-ac7d-25b2866ec0b9 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:10:49.504426 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c3ee1ff0-a7a8-413c-ac7d-25b2866ec0b9 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:10:49.505087 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-c3ee1ff0-a7a8-413c-ac7d-25b2866ec0b9 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:10:49.648310 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-c3ee1ff0-a7a8-413c-ac7d-25b2866ec0b9 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b0275002b74104979c605386448bdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be42ada0a7c7487baa2733e5af4a3a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 06:10:49.656483 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-c3ee1ff0-a7a8-413c-ac7d-25b2866ec0b9 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] 10.222.0.33 "GET /compute/v2.1/servers/42c52f0c-4e4c-418c-9584-388fd2dae3cc" status: 200 len: 1683 microversion: 2.1 time: 0.170702 Sep 23 06:10:49.657157 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4208/8226] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:10:49 2022] GET /compute/v2.1/servers/42c52f0c-4e4c-418c-9584-388fd2dae3cc => generated 1683 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 06:10:50.680909 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-6f47f963-895f-4d45-92d6-47bc1e3a1696 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:10:50.681625 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-6f47f963-895f-4d45-92d6-47bc1e3a1696 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] [instance: 42c52f0c-4e4c-418c-9584-388fd2dae3cc] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:10:50.688394 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6f47f963-895f-4d45-92d6-47bc1e3a1696 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:10:50.688894 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6f47f963-895f-4d45-92d6-47bc1e3a1696 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:10:50.689346 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6f47f963-895f-4d45-92d6-47bc1e3a1696 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:10:50.690076 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6f47f963-895f-4d45-92d6-47bc1e3a1696 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:10:50.690549 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6f47f963-895f-4d45-92d6-47bc1e3a1696 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:10:50.690988 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-6f47f963-895f-4d45-92d6-47bc1e3a1696 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:10:50.825208 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.policy [None req-6f47f963-895f-4d45-92d6-47bc1e3a1696 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b0275002b74104979c605386448bdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be42ada0a7c7487baa2733e5af4a3a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 06:10:50.833178 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-6f47f963-895f-4d45-92d6-47bc1e3a1696 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] 10.222.0.33 "GET /compute/v2.1/servers/42c52f0c-4e4c-418c-9584-388fd2dae3cc" status: 200 len: 1683 microversion: 2.1 time: 0.156559 Sep 23 06:10:50.840425 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 4019/8227] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:10:50 2022] GET /compute/v2.1/servers/42c52f0c-4e4c-418c-9584-388fd2dae3cc => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 06:10:51.857520 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-30a4ba49-ae12-44b4-8ef8-ed82f15b32bb tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Calling method '>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:10:51.858914 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.compute.api [None req-30a4ba49-ae12-44b4-8ef8-ed82f15b32bb tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] [instance: 42c52f0c-4e4c-418c-9584-388fd2dae3cc] Fetching instance by UUID {{(pid=122699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:10:51.865031 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-30a4ba49-ae12-44b4-8ef8-ed82f15b32bb tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:10:51.865524 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-30a4ba49-ae12-44b4-8ef8-ed82f15b32bb tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:10:51.866253 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-30a4ba49-ae12-44b4-8ef8-ed82f15b32bb tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:10:51.866964 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-30a4ba49-ae12-44b4-8ef8-ed82f15b32bb tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:10:51.867467 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-30a4ba49-ae12-44b4-8ef8-ed82f15b32bb tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:10:51.867921 n-d-846463-3 devstack@n-api.service[122699]: DEBUG oslo_concurrency.lockutils [None req-30a4ba49-ae12-44b4-8ef8-ed82f15b32bb tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:10:51.903980 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [req-bde56f3e-86de-4de8-afb3-5f538e2ef0e2 req-f3f0abf7-838c-40a4-af36-5d690f804309 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42c52f0c-4e4c-418c-9584-388fd2dae3cc", "name": "network-vif-deleted", "tag": "d1d18851-f17e-4561-926c-86fec04607dd"}]} {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 06:10:51.916307 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-bde56f3e-86de-4de8-afb3-5f538e2ef0e2 req-f3f0abf7-838c-40a4-af36-5d690f804309 service nova] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:10:51.920259 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-bde56f3e-86de-4de8-afb3-5f538e2ef0e2 req-f3f0abf7-838c-40a4-af36-5d690f804309 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:10:51.920259 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [req-bde56f3e-86de-4de8-afb3-5f538e2ef0e2 req-f3f0abf7-838c-40a4-af36-5d690f804309 service nova] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:10:51.930235 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.compute.server_external_events [req-bde56f3e-86de-4de8-afb3-5f538e2ef0e2 req-f3f0abf7-838c-40a4-af36-5d690f804309 service nova] Creating event network-vif-deleted:d1d18851-f17e-4561-926c-86fec04607dd for instance 42c52f0c-4e4c-418c-9584-388fd2dae3cc on n-h2-846463-3 Sep 23 06:10:51.935925 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [req-bde56f3e-86de-4de8-afb3-5f538e2ef0e2 req-f3f0abf7-838c-40a4-af36-5d690f804309 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036178 Sep 23 06:10:51.936595 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 4020/8228] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Sep 23 06:10:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 06:10:51.940225 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.policy [None req-30a4ba49-ae12-44b4-8ef8-ed82f15b32bb tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8b0275002b74104979c605386448bdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be42ada0a7c7487baa2733e5af4a3a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 06:10:51.952134 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-30a4ba49-ae12-44b4-8ef8-ed82f15b32bb tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] 10.222.0.33 "GET /compute/v2.1/servers/42c52f0c-4e4c-418c-9584-388fd2dae3cc" status: 200 len: 1497 microversion: 2.1 time: 0.098877 Sep 23 06:10:51.952740 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4209/8229] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:10:51 2022] GET /compute/v2.1/servers/42c52f0c-4e4c-418c-9584-388fd2dae3cc => generated 1497 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 06:10:52.978939 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-68438765-ddd0-4884-a43b-4483400cc3bb tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Calling method '>' {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:10:52.979670 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.compute.api [None req-68438765-ddd0-4884-a43b-4483400cc3bb tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] [instance: 42c52f0c-4e4c-418c-9584-388fd2dae3cc] Fetching instance by UUID {{(pid=122698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 06:10:52.986068 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-68438765-ddd0-4884-a43b-4483400cc3bb tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:10:52.986584 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-68438765-ddd0-4884-a43b-4483400cc3bb tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:10:52.987048 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-68438765-ddd0-4884-a43b-4483400cc3bb tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:10:52.988050 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-68438765-ddd0-4884-a43b-4483400cc3bb tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Acquiring lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 06:10:52.988532 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-68438765-ddd0-4884-a43b-4483400cc3bb tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 06:10:52.988982 n-d-846463-3 devstack@n-api.service[122698]: DEBUG oslo_concurrency.lockutils [None req-68438765-ddd0-4884-a43b-4483400cc3bb tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Lock "feac528b-4983-4e61-aae7-f1973fe5bc2c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 06:10:53.002557 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.wsgi [None req-68438765-ddd0-4884-a43b-4483400cc3bb tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] HTTP exception thrown: Instance 42c52f0c-4e4c-418c-9584-388fd2dae3cc could not be found. Sep 23 06:10:53.004163 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-68438765-ddd0-4884-a43b-4483400cc3bb tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Request method failure captured: Sep 23 06:10:53.004163 n-d-846463-3 devstack@n-api.service[122698]: request: GET /compute/v2.1/servers/42c52f0c-4e4c-418c-9584-388fd2dae3cc HTTP/1.1 Sep 23 06:10:53.004163 n-d-846463-3 devstack@n-api.service[122698]: Accept: application/json Sep 23 06:10:53.004163 n-d-846463-3 devstack@n-api.service[122698]: Accept-Encoding: identity Sep 23 06:10:53.004163 n-d-846463-3 devstack@n-api.service[122698]: Connection: close Sep 23 06:10:53.004163 n-d-846463-3 devstack@n-api.service[122698]: Content-Length: 0 Sep 23 06:10:53.004163 n-d-846463-3 devstack@n-api.service[122698]: Content-Type: application/json Sep 23 06:10:53.004163 n-d-846463-3 devstack@n-api.service[122698]: Host: 10.222.0.33 Sep 23 06:10:53.004163 n-d-846463-3 devstack@n-api.service[122698]: Openstack-System-Scope: None Sep 23 06:10:53.004163 n-d-846463-3 devstack@n-api.service[122698]: User-Agent: python-urllib3/1.26.12 Sep 23 06:10:53.004163 n-d-846463-3 devstack@n-api.service[122698]: X-Auth-Token: gAAAAABjLUy6do-ZVxFCcQroOnHnVp4MDTtO2BaWEsuiTIuKRqoli2_U6nJGva_KdRIhwAlQYSg0u-Y2fTuVzF92m_tYj8Bq6ifBW5NrQ4031y_7iQETlrNxGQQFTlw7bwVJLzBoMAGvyXjvUBr-REFIekNqRd46TFFVqV4jiknzMYu0ii-UHnY Sep 23 06:10:53.004163 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Id: None Sep 23 06:10:53.004163 n-d-846463-3 devstack@n-api.service[122698]: X-Domain-Name: None Sep 23 06:10:53.004163 n-d-846463-3 devstack@n-api.service[122698]: X-Identity-Status: Confirmed Sep 23 06:10:53.004163 n-d-846463-3 devstack@n-api.service[122698]: X-Is-Admin-Project: True Sep 23 06:10:53.004163 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Id: default Sep 23 06:10:53.004163 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Domain-Name: Default Sep 23 06:10:53.004163 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Id: be42ada0a7c7487baa2733e5af4a3a05 Sep 23 06:10:53.004163 n-d-846463-3 devstack@n-api.service[122698]: X-Project-Name: tempest-TestSnapshotPattern-1879749531 Sep 23 06:10:53.004163 n-d-846463-3 devstack@n-api.service[122698]: X-Role: reader,member Sep 23 06:10:53.004163 n-d-846463-3 devstack@n-api.service[122698]: X-Roles: reader,member Sep 23 06:10:53.004163 n-d-846463-3 devstack@n-api.service[122698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_be42ada0a7c7487baa2733e5af4a3a05", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/be42ada0a7c7487baa2733e5af4a3a05"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/be42ada0a7c7487baa2733e5af4a3a05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/be42ada0a7c7487baa2733e5af4a3a05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Sep 23 06:10:53.004163 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant: tempest-TestSnapshotPattern-1879749531 Sep 23 06:10:53.004163 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Id: be42ada0a7c7487baa2733e5af4a3a05 Sep 23 06:10:53.004163 n-d-846463-3 devstack@n-api.service[122698]: X-Tenant-Name: tempest-TestSnapshotPattern-1879749531 Sep 23 06:10:53.004163 n-d-846463-3 devstack@n-api.service[122698]: X-User: tempest-TestSnapshotPattern-1879749531-project Sep 23 06:10:53.004163 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Id: default Sep 23 06:10:53.004163 n-d-846463-3 devstack@n-api.service[122698]: X-User-Domain-Name: Default Sep 23 06:10:53.004163 n-d-846463-3 devstack@n-api.service[122698]: X-User-Id: c8b0275002b74104979c605386448bdb Sep 23 06:10:53.004163 n-d-846463-3 devstack@n-api.service[122698]: X-User-Name: tempest-TestSnapshotPattern-1879749531-project Sep 23 06:10:53.004163 n-d-846463-3 devstack@n-api.service[122698]: method: > Sep 23 06:10:53.004163 n-d-846463-3 devstack@n-api.service[122698]: exception: Instance 42c52f0c-4e4c-418c-9584-388fd2dae3cc could not be found. Sep 23 06:10:53.004163 n-d-846463-3 devstack@n-api.service[122698]: action_args: {'id': '42c52f0c-4e4c-418c-9584-388fd2dae3cc'} Sep 23 06:10:53.004163 n-d-846463-3 devstack@n-api.service[122698]: {{(pid=122698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 06:10:53.004163 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 06:10:53.004163 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 06:10:53.004163 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 06:10:53.004163 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 06:10:53.004163 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 06:10:53.004163 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 06:10:53.004163 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 06:10:53.004163 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 06:10:53.004163 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 06:10:53.004163 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42c52f0c-4e4c-418c-9584-388fd2dae3cc could not be found. Sep 23 06:10:53.004163 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 06:10:53.004163 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 06:10:53.004163 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 06:10:53.004163 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 06:10:53.004163 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 06:10:53.004163 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 06:10:53.004163 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 06:10:53.004163 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 06:10:53.004163 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 06:10:53.004163 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 06:10:53.004163 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 06:10:53.004163 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 06:10:53.004163 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 06:10:53.004163 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 06:10:53.004163 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 06:10:53.004163 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 06:10:53.004163 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42c52f0c-4e4c-418c-9584-388fd2dae3cc could not be found. Sep 23 06:10:53.004163 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 06:10:53.004163 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 06:10:53.004163 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 06:10:53.010578 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 06:10:53.010578 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 06:10:53.010578 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 06:10:53.010578 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 06:10:53.010578 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 06:10:53.010578 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42c52f0c-4e4c-418c-9584-388fd2dae3cc could not be found. Sep 23 06:10:53.010578 n-d-846463-3 devstack@n-api.service[122698]: ERROR nova.api.openstack.wsgi Sep 23 06:10:53.010578 n-d-846463-3 devstack@n-api.service[122698]: DEBUG nova.api.openstack.wsgi [None req-68438765-ddd0-4884-a43b-4483400cc3bb tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Returning 404 to user: Instance 42c52f0c-4e4c-418c-9584-388fd2dae3cc could not be found. {{(pid=122698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 06:10:53.010578 n-d-846463-3 devstack@n-api.service[122698]: INFO nova.api.openstack.requestlog [None req-68438765-ddd0-4884-a43b-4483400cc3bb tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] 10.222.0.33 "GET /compute/v2.1/servers/42c52f0c-4e4c-418c-9584-388fd2dae3cc" status: 404 len: 111 microversion: 2.1 time: 0.033098 Sep 23 06:10:53.010578 n-d-846463-3 devstack@n-api.service[122698]: [pid: 122698|app: 0|req: 4021/8230] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Sep 23 06:10:52 2022] GET /compute/v2.1/servers/42c52f0c-4e4c-418c-9584-388fd2dae3cc => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 06:10:53.227140 n-d-846463-3 devstack@n-api.service[122699]: DEBUG nova.api.openstack.wsgi [None req-d3dc227e-3360-4e2a-b3e1-31dcf99ddf11 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] Calling method '.version_select at 0x7ff1babe8550>' {{(pid=122699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 06:10:53.305223 n-d-846463-3 devstack@n-api.service[122699]: INFO nova.api.openstack.requestlog [None req-d3dc227e-3360-4e2a-b3e1-31dcf99ddf11 tempest-TestSnapshotPattern-1879749531 tempest-TestSnapshotPattern-1879749531-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-670755896" status: 202 len: 0 microversion: 2.1 time: 0.082919 Sep 23 06:10:53.305821 n-d-846463-3 devstack@n-api.service[122699]: [pid: 122699|app: 0|req: 4210/8231] 10.222.0.33 () {58 vars in 1254 bytes} [Fri Sep 23 06:10:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-670755896 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)